2024-09-19T06:51:56.373 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-19T06:51:56.399 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T06:51:56.493 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911775 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/blogbench}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7911775' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule name: teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount - mds.dir_split install: ceph: flavor: default sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=crc - wsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 1747 sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 sleep_before_teardown: 0 subset: 176/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi148.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF7cb2B+POYS0+iPUo9iNKFtS/m1ayPJcWFME62Ty4+7NjkNXL4Bcwes4Re1iwvxP7lX1zqAkzsdQDy4xrLtRfk= smithi165.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHvAhKy0B1jGgAFuQm1gitnqCwlQC2NhXjU18Jogp4/5IGql02EPTNnIg4OPdLeY4otkm4xKePk/YkFPgna8Ux8= smithi179.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMknhEDlfnuvd7mFTgPye7Uo7HU7wQLFOe6vXJM35fYLBqpLUACx06SThAYhwHrCB0JO/poAy0Ish++wc65aRfQ= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph config set mgr mgr/snap_schedule/log_level debug - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - workunit: clients: all: - suites/blogbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-18_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-19T06:51:56.493 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa; will attempt to use it 2024-09-19T06:51:56.494 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks 2024-09-19T06:51:56.494 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-19T06:51:56.496 INFO:teuthology.task.internal:Checking packages... 2024-09-19T06:51:56.517 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2f599a46ad10e37c929e5c43da2f6907ddcd1961' 2024-09-19T06:51:56.517 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T06:51:56.517 INFO:teuthology.packaging:ref: None 2024-09-19T06:51:56.517 INFO:teuthology.packaging:tag: None 2024-09-19T06:51:56.517 INFO:teuthology.packaging:branch: squid 2024-09-19T06:51:56.517 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:51:56.517 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-19T06:51:56.759 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-363.g6fad5dd7 2024-09-19T06:51:56.761 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-19T06:51:56.767 INFO:teuthology.task.internal:no buildpackages task found 2024-09-19T06:51:56.767 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-19T06:51:56.774 INFO:teuthology.task.internal:Saving configuration 2024-09-19T06:51:56.797 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-19T06:51:56.804 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-19T06:51:56.823 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi148.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911775', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 06:46:37.147499', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF7cb2B+POYS0+iPUo9iNKFtS/m1ayPJcWFME62Ty4+7NjkNXL4Bcwes4Re1iwvxP7lX1zqAkzsdQDy4xrLtRfk='} 2024-09-19T06:51:56.842 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi165.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911775', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 06:46:37.144556', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHvAhKy0B1jGgAFuQm1gitnqCwlQC2NhXjU18Jogp4/5IGql02EPTNnIg4OPdLeY4otkm4xKePk/YkFPgna8Ux8='} 2024-09-19T06:51:56.859 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911775', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 06:46:37.146263', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMknhEDlfnuvd7mFTgPye7Uo7HU7wQLFOe6vXJM35fYLBqpLUACx06SThAYhwHrCB0JO/poAy0Ish++wc65aRfQ='} 2024-09-19T06:51:56.859 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-19T06:51:56.866 INFO:teuthology.task.internal:roles: ubuntu@smithi148.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-19T06:51:56.866 INFO:teuthology.task.internal:roles: ubuntu@smithi165.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-19T06:51:56.866 INFO:teuthology.task.internal:roles: ubuntu@smithi179.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-19T06:51:56.866 INFO:teuthology.run_tasks:Running task console_log... 2024-09-19T06:51:56.936 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb7e425b520>, signals=[15]) 2024-09-19T06:51:56.936 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-19T06:51:56.943 INFO:teuthology.task.internal:Opening connections... 2024-09-19T06:51:56.943 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi148.front.sepia.ceph.com 2024-09-19T06:51:56.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:51:57.027 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi165.front.sepia.ceph.com 2024-09-19T06:51:57.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:51:57.105 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi179.front.sepia.ceph.com 2024-09-19T06:51:57.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:51:57.182 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-19T06:51:57.189 DEBUG:teuthology.orchestra.run.smithi148:> uname -m 2024-09-19T06:51:57.208 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64 2024-09-19T06:51:57.208 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2024-09-19T06:51:57.266 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="CentOS Stream" 2024-09-19T06:51:57.266 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="9" 2024-09-19T06:51:57.267 INFO:teuthology.orchestra.run.smithi148.stdout:ID="centos" 2024-09-19T06:51:57.267 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="rhel fedora" 2024-09-19T06:51:57.267 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="9" 2024-09-19T06:51:57.267 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el9" 2024-09-19T06:51:57.267 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T06:51:57.267 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31" 2024-09-19T06:51:57.267 INFO:teuthology.orchestra.run.smithi148.stdout:LOGO="fedora-logo-icon" 2024-09-19T06:51:57.267 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T06:51:57.267 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://centos.org/" 2024-09-19T06:51:57.267 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T06:51:57.267 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T06:51:57.267 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T06:51:57.268 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2024-09-19T06:51:57.290 DEBUG:teuthology.orchestra.run.smithi165:> uname -m 2024-09-19T06:51:57.308 INFO:teuthology.orchestra.run.smithi165.stdout:x86_64 2024-09-19T06:51:57.309 DEBUG:teuthology.orchestra.run.smithi165:> cat /etc/os-release 2024-09-19T06:51:57.367 INFO:teuthology.orchestra.run.smithi165.stdout:NAME="CentOS Stream" 2024-09-19T06:51:57.367 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION="9" 2024-09-19T06:51:57.367 INFO:teuthology.orchestra.run.smithi165.stdout:ID="centos" 2024-09-19T06:51:57.367 INFO:teuthology.orchestra.run.smithi165.stdout:ID_LIKE="rhel fedora" 2024-09-19T06:51:57.367 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION_ID="9" 2024-09-19T06:51:57.367 INFO:teuthology.orchestra.run.smithi165.stdout:PLATFORM_ID="platform:el9" 2024-09-19T06:51:57.367 INFO:teuthology.orchestra.run.smithi165.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T06:51:57.367 INFO:teuthology.orchestra.run.smithi165.stdout:ANSI_COLOR="0;31" 2024-09-19T06:51:57.367 INFO:teuthology.orchestra.run.smithi165.stdout:LOGO="fedora-logo-icon" 2024-09-19T06:51:57.368 INFO:teuthology.orchestra.run.smithi165.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T06:51:57.368 INFO:teuthology.orchestra.run.smithi165.stdout:HOME_URL="https://centos.org/" 2024-09-19T06:51:57.368 INFO:teuthology.orchestra.run.smithi165.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T06:51:57.368 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T06:51:57.368 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T06:51:57.368 INFO:teuthology.lock.ops:Updating smithi165.front.sepia.ceph.com on lock server 2024-09-19T06:51:57.389 DEBUG:teuthology.orchestra.run.smithi179:> uname -m 2024-09-19T06:51:57.408 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64 2024-09-19T06:51:57.408 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2024-09-19T06:51:57.466 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="CentOS Stream" 2024-09-19T06:51:57.466 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="9" 2024-09-19T06:51:57.466 INFO:teuthology.orchestra.run.smithi179.stdout:ID="centos" 2024-09-19T06:51:57.467 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="rhel fedora" 2024-09-19T06:51:57.467 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="9" 2024-09-19T06:51:57.467 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el9" 2024-09-19T06:51:57.467 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T06:51:57.467 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2024-09-19T06:51:57.467 INFO:teuthology.orchestra.run.smithi179.stdout:LOGO="fedora-logo-icon" 2024-09-19T06:51:57.467 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T06:51:57.467 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://centos.org/" 2024-09-19T06:51:57.467 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T06:51:57.467 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T06:51:57.467 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T06:51:57.468 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2024-09-19T06:51:57.489 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-19T06:51:57.500 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-19T06:51:57.539 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-19T06:51:57.539 DEBUG:teuthology.orchestra.run.smithi148:> test '!' -e /home/ubuntu/cephtest 2024-09-19T06:51:57.542 DEBUG:teuthology.orchestra.run.smithi165:> test '!' -e /home/ubuntu/cephtest 2024-09-19T06:51:57.544 DEBUG:teuthology.orchestra.run.smithi179:> test '!' -e /home/ubuntu/cephtest 2024-09-19T06:51:57.562 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-19T06:51:57.569 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-19T06:51:57.569 DEBUG:teuthology.orchestra.run.smithi148:> test -z $(ls -A /var/lib/ceph) 2024-09-19T06:51:57.600 DEBUG:teuthology.orchestra.run.smithi165:> test -z $(ls -A /var/lib/ceph) 2024-09-19T06:51:57.602 DEBUG:teuthology.orchestra.run.smithi179:> test -z $(ls -A /var/lib/ceph) 2024-09-19T06:51:57.701 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-19T06:51:57.779 INFO:teuthology.run_tasks:Running task kernel... 2024-09-19T06:51:57.794 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-19T06:51:57.794 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-19T06:51:57.794 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-19T06:51:57.795 DEBUG:teuthology.orchestra.run.smithi148:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T06:51:57.812 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:51:57.812 DEBUG:teuthology.orchestra.run.smithi148:> uname -r 2024-09-19T06:51:57.869 INFO:teuthology.orchestra.run.smithi148.stdout:5.14.0-503.el9.x86_64 2024-09-19T06:51:57.870 INFO:teuthology.task.kernel:Running kernel on smithi148: 5.14.0-503.el9.x86_64 2024-09-19T06:51:57.870 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum install -y kernel 2024-09-19T06:52:00.477 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.3 MB 00:00 2024-09-19T06:52:02.211 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-19T06:52:06.545 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-19T06:52:07.971 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - Extras packages 84 kB/s | 19 kB 00:00 2024-09-19T06:52:08.808 INFO:teuthology.orchestra.run.smithi148.stdout:Extra Packages for Enterprise Linux 32 MB/s | 23 MB 00:00 2024-09-19T06:52:14.132 INFO:teuthology.orchestra.run.smithi148.stdout:lab-extras 25 kB/s | 1.7 kB 00:00 2024-09-19T06:52:16.038 INFO:teuthology.orchestra.run.smithi148.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T06:52:16.038 INFO:teuthology.orchestra.run.smithi148.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T06:52:16.133 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-19T06:52:16.142 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-19T06:52:16.142 INFO:teuthology.orchestra.run.smithi148.stdout: Package Architecture Version Repository Size 2024-09-19T06:52:16.142 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-19T06:52:16.142 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-19T06:52:16.143 INFO:teuthology.orchestra.run.smithi148.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T06:52:16.143 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2024-09-19T06:52:16.143 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T06:52:16.143 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T06:52:16.143 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T06:52:16.143 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T06:52:16.143 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-19T06:52:16.143 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-19T06:52:16.143 INFO:teuthology.orchestra.run.smithi148.stdout:Install 4 Packages 2024-09-19T06:52:16.143 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T06:52:16.144 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 79 M 2024-09-19T06:52:16.144 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 126 M 2024-09-19T06:52:16.144 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-19T06:52:16.257 INFO:teuthology.orchestra.run.smithi148.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 392 kB/s | 36 kB 00:00 2024-09-19T06:52:16.608 INFO:teuthology.orchestra.run.smithi148.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 35 MB/s | 16 MB 00:00 2024-09-19T06:52:16.916 INFO:teuthology.orchestra.run.smithi148.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 43 MB/s | 29 MB 00:00 2024-09-19T06:52:17.233 INFO:teuthology.orchestra.run.smithi148.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 32 MB/s | 35 MB 00:01 2024-09-19T06:52:17.233 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:52:17.233 INFO:teuthology.orchestra.run.smithi148.stdout:Total 72 MB/s | 79 MB 00:01 2024-09-19T06:52:17.912 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-19T06:52:18.281 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-19T06:52:18.281 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-19T06:52:19.242 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-19T06:52:19.242 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-19T06:52:21.689 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-19T06:52:22.311 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T06:52:22.392 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T06:52:25.162 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T06:52:25.318 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T06:52:30.133 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T06:52:30.185 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:52:35.022 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:53:13.275 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:53:13.317 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:53:13.619 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:53:13.619 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T06:53:13.620 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T06:53:13.620 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T06:53:14.432 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:53:14.433 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T06:53:14.433 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-19T06:53:14.433 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T06:53:14.433 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T06:53:14.433 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T06:53:14.433 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T06:53:14.433 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T06:53:14.434 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-19T06:53:14.808 DEBUG:teuthology.orchestra.run.smithi148:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T06:53:14.896 INFO:teuthology.orchestra.run.smithi148.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T06:53:14.896 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T06:53:14.896 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T06:53:14.896 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T06:53:14.897 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T06:53:14.897 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-19T06:53:14.897 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi148.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T06:53:14.897 DEBUG:teuthology.orchestra.run.smithi148:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T06:53:14.955 INFO:teuthology.orchestra.run.smithi148.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T06:53:14.956 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T06:53:14.956 DEBUG:teuthology.orchestra.run.smithi148:> sudo rpm -qi grub2-tools 2024-09-19T06:53:14.991 INFO:teuthology.orchestra.run.smithi148.stdout:Name : grub2-tools 2024-09-19T06:53:14.992 INFO:teuthology.orchestra.run.smithi148.stdout:Epoch : 1 2024-09-19T06:53:14.992 INFO:teuthology.orchestra.run.smithi148.stdout:Version : 2.06 2024-09-19T06:53:14.992 INFO:teuthology.orchestra.run.smithi148.stdout:Release : 82.el9 2024-09-19T06:53:14.992 INFO:teuthology.orchestra.run.smithi148.stdout:Architecture: x86_64 2024-09-19T06:53:14.992 INFO:teuthology.orchestra.run.smithi148.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T06:53:14.992 INFO:teuthology.orchestra.run.smithi148.stdout:Group : Unspecified 2024-09-19T06:53:14.992 INFO:teuthology.orchestra.run.smithi148.stdout:Size : 8274670 2024-09-19T06:53:14.992 INFO:teuthology.orchestra.run.smithi148.stdout:License : GPLv3+ 2024-09-19T06:53:14.992 INFO:teuthology.orchestra.run.smithi148.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T06:53:14.992 INFO:teuthology.orchestra.run.smithi148.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T06:53:14.993 INFO:teuthology.orchestra.run.smithi148.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T06:53:14.993 INFO:teuthology.orchestra.run.smithi148.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T06:53:14.993 INFO:teuthology.orchestra.run.smithi148.stdout:Packager : builder@centos.org 2024-09-19T06:53:14.993 INFO:teuthology.orchestra.run.smithi148.stdout:Vendor : CentOS 2024-09-19T06:53:14.993 INFO:teuthology.orchestra.run.smithi148.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T06:53:14.993 INFO:teuthology.orchestra.run.smithi148.stdout:Summary : Support tools for GRUB. 2024-09-19T06:53:14.993 INFO:teuthology.orchestra.run.smithi148.stdout:Description : 2024-09-19T06:53:14.993 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T06:53:14.993 INFO:teuthology.orchestra.run.smithi148.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T06:53:14.993 INFO:teuthology.orchestra.run.smithi148.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T06:53:14.993 INFO:teuthology.orchestra.run.smithi148.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T06:53:14.993 INFO:teuthology.orchestra.run.smithi148.stdout:hardware devices. 2024-09-19T06:53:14.993 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T06:53:14.993 INFO:teuthology.orchestra.run.smithi148.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T06:53:14.994 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T06:53:14.994 INFO:teuthology.task.kernel:Updating grub on smithi148 to boot 5.14.0-508.el9.x86_64 2024-09-19T06:53:14.994 DEBUG:teuthology.orchestra.run.smithi148:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T06:53:15.666 INFO:teuthology.orchestra.run.smithi148.stderr:Generating grub configuration file ... 2024-09-19T06:53:16.926 INFO:teuthology.orchestra.run.smithi148.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T06:53:16.967 INFO:teuthology.orchestra.run.smithi148.stderr:done 2024-09-19T06:53:16.969 DEBUG:teuthology.orchestra.run.smithi148:> mktemp 2024-09-19T06:53:16.985 INFO:teuthology.orchestra.run.smithi148.stdout:/tmp/tmp.VqQra9frxC 2024-09-19T06:53:16.986 DEBUG:teuthology.orchestra.run.smithi148:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.VqQra9frxC 2024-09-19T06:53:17.054 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0666 /tmp/tmp.VqQra9frxC 2024-09-19T06:53:17.188 DEBUG:teuthology.orchestra.remote:smithi148:/tmp/tmp.VqQra9frxC is 6KB 2024-09-19T06:53:17.208 DEBUG:teuthology.orchestra.run.smithi148:> rm -fr /tmp/tmp.VqQra9frxC 2024-09-19T06:53:17.223 DEBUG:teuthology.orchestra.run.smithi148:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T06:53:17.285 INFO:teuthology.orchestra.run.smithi148.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T06:53:17.285 INFO:teuthology.orchestra.run.smithi148.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T06:53:17.285 INFO:teuthology.orchestra.run.smithi148.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T06:53:17.286 INFO:teuthology.orchestra.run.smithi148.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T06:53:17.287 DEBUG:teuthology.orchestra.run.smithi148:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T06:53:17.453 DEBUG:teuthology.orchestra.run.smithi148:> sudo shutdown -r now 2024-09-19T06:53:25.407 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2024-09-19T06:53:47.456 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-19T06:53:47.456 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-19T06:53:47.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:54:05.885 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-09-19T06:54:14.886 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-19T06:54:14.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:54:17.949 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-09-19T06:54:29.950 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-19T06:54:29.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:54:48.381 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-09-19T06:55:03.382 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-19T06:55:03.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:55:03.767 DEBUG:teuthology.orchestra.run.smithi148:> true 2024-09-19T06:55:04.148 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-19T06:55:04.148 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-508.el9.x86_64"... 2024-09-19T06:55:04.149 DEBUG:teuthology.orchestra.run.smithi148:> uname -r 2024-09-19T06:55:04.163 INFO:teuthology.orchestra.run.smithi148.stdout:5.14.0-508.el9.x86_64 2024-09-19T06:55:04.164 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T06:55:04.164 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T06:55:04.164 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T06:55:05.165 DEBUG:teuthology.parallel:result is None 2024-09-19T06:55:05.166 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-19T06:55:05.173 INFO:teuthology.task.internal:Creating test directory... 2024-09-19T06:55:05.173 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T06:55:05.176 DEBUG:teuthology.orchestra.run.smithi165:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T06:55:05.179 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-09-19T06:55:05.179 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:55:05.258 DEBUG:teuthology.orchestra.run.smithi179:> true 2024-09-19T06:55:05.338 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-09-19T06:55:05.338 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T06:55:05.395 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-19T06:55:05.402 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-19T06:55:05.458 INFO:teuthology.task.internal:Creating archive directory... 2024-09-19T06:55:05.458 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T06:55:05.461 DEBUG:teuthology.orchestra.run.smithi165:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T06:55:05.464 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T06:55:05.493 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-19T06:55:05.500 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-19T06:55:05.500 DEBUG:teuthology.orchestra.run.smithi165:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T06:55:05.543 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:55:05.544 DEBUG:teuthology.orchestra.run.smithi179:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T06:55:05.560 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:55:05.561 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T06:55:05.563 DEBUG:teuthology.orchestra.run.smithi165:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T06:55:05.586 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T06:55:05.620 INFO:teuthology.orchestra.run.smithi165.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T06:55:05.635 INFO:teuthology.orchestra.run.smithi165.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T06:55:05.639 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T06:55:05.642 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T06:55:05.660 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T06:55:05.743 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T06:55:05.745 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-19T06:55:05.752 INFO:teuthology.task.internal:Configuring sudo... 2024-09-19T06:55:05.752 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T06:55:05.754 DEBUG:teuthology.orchestra.run.smithi165:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T06:55:05.757 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T06:55:05.784 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-19T06:55:05.793 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-19T06:55:05.793 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T06:55:05.817 DEBUG:teuthology.orchestra.run.smithi165:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T06:55:05.826 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T06:55:05.843 DEBUG:teuthology.orchestra.run.smithi148:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T06:55:05.910 DEBUG:teuthology.orchestra.run.smithi148:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T06:55:05.968 DEBUG:teuthology.orchestra.run.smithi148:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T06:55:06.012 DEBUG:teuthology.orchestra.run.smithi148:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T06:55:06.046 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-19T06:55:06.046 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T06:55:06.118 DEBUG:teuthology.orchestra.run.smithi165:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T06:55:06.160 DEBUG:teuthology.orchestra.run.smithi165:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T06:55:06.218 DEBUG:teuthology.orchestra.run.smithi165:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T06:55:06.303 DEBUG:teuthology.orchestra.run.smithi165:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T06:55:06.347 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-19T06:55:06.348 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T06:55:06.416 DEBUG:teuthology.orchestra.run.smithi179:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T06:55:06.461 DEBUG:teuthology.orchestra.run.smithi179:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T06:55:06.535 DEBUG:teuthology.orchestra.run.smithi179:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T06:55:06.580 DEBUG:teuthology.orchestra.run.smithi179:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T06:55:06.622 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-19T06:55:06.622 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T06:55:06.690 DEBUG:teuthology.orchestra.run.smithi148:> sudo service rsyslog restart 2024-09-19T06:55:06.692 DEBUG:teuthology.orchestra.run.smithi165:> sudo service rsyslog restart 2024-09-19T06:55:06.695 DEBUG:teuthology.orchestra.run.smithi179:> sudo service rsyslog restart 2024-09-19T06:55:06.733 INFO:teuthology.orchestra.run.smithi148.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T06:55:06.737 INFO:teuthology.orchestra.run.smithi165.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T06:55:06.772 INFO:teuthology.orchestra.run.smithi179.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T06:55:07.175 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-19T06:55:07.183 INFO:teuthology.task.internal:Starting timer... 2024-09-19T06:55:07.183 INFO:teuthology.run_tasks:Running task pcp... 2024-09-19T06:55:07.194 INFO:teuthology.run_tasks:Running task selinux... 2024-09-19T06:55:07.202 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-19T06:55:07.202 DEBUG:teuthology.orchestra.run.smithi148:> sudo service auditd rotate 2024-09-19T06:55:07.315 INFO:teuthology.orchestra.run.smithi148.stdout:Rotating logs: 2024-09-19T06:55:07.322 DEBUG:teuthology.orchestra.run.smithi165:> sudo service auditd rotate 2024-09-19T06:55:07.379 INFO:teuthology.orchestra.run.smithi165.stdout:Rotating logs: 2024-09-19T06:55:07.382 DEBUG:teuthology.orchestra.run.smithi179:> sudo service auditd rotate 2024-09-19T06:55:07.446 INFO:teuthology.orchestra.run.smithi179.stdout:Rotating logs: 2024-09-19T06:55:07.448 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-19T06:55:07.448 DEBUG:teuthology.orchestra.run.smithi148:> /usr/sbin/getenforce 2024-09-19T06:55:07.509 INFO:teuthology.orchestra.run.smithi148.stdout:Permissive 2024-09-19T06:55:07.509 DEBUG:teuthology.orchestra.run.smithi165:> /usr/sbin/getenforce 2024-09-19T06:55:07.534 INFO:teuthology.orchestra.run.smithi165.stdout:Permissive 2024-09-19T06:55:07.535 DEBUG:teuthology.orchestra.run.smithi179:> /usr/sbin/getenforce 2024-09-19T06:55:07.562 INFO:teuthology.orchestra.run.smithi179.stdout:Permissive 2024-09-19T06:55:07.563 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi148.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi165.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi179.front.sepia.ceph.com': 'permissive'} 2024-09-19T06:55:07.563 DEBUG:teuthology.orchestra.run.smithi148:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T06:55:07.617 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:55:07.618 DEBUG:teuthology.orchestra.run.smithi165:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T06:55:07.647 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:55:07.648 DEBUG:teuthology.orchestra.run.smithi179:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T06:55:07.676 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:55:07.677 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-19T06:55:07.677 DEBUG:teuthology.orchestra.run.smithi148:> sudo /usr/sbin/setenforce permissive 2024-09-19T06:55:07.907 DEBUG:teuthology.orchestra.run.smithi165:> sudo /usr/sbin/setenforce permissive 2024-09-19T06:55:07.940 DEBUG:teuthology.orchestra.run.smithi179:> sudo /usr/sbin/setenforce permissive 2024-09-19T06:55:07.969 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-19T06:55:07.978 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-19T06:55:07.985 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-19T06:55:08.116 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-19T06:55:08.133 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-19T06:55:08.134 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi148.front.sepia.ceph.com,smithi165.front.sepia.ceph.com,smithi179.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-19T06:59:16.316 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi148.front.sepia.ceph.com'), Remote(name='ubuntu@smithi165.front.sepia.ceph.com'), Remote(name='ubuntu@smithi179.front.sepia.ceph.com')] 2024-09-19T06:59:16.318 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-19T06:59:16.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:59:16.396 DEBUG:teuthology.orchestra.run.smithi148:> true 2024-09-19T06:59:16.471 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-19T06:59:16.472 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-09-19T06:59:16.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:59:16.547 DEBUG:teuthology.orchestra.run.smithi165:> true 2024-09-19T06:59:16.625 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-09-19T06:59:16.625 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-09-19T06:59:16.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:59:16.702 DEBUG:teuthology.orchestra.run.smithi179:> true 2024-09-19T06:59:16.780 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-09-19T06:59:16.781 INFO:teuthology.run_tasks:Running task clock... 2024-09-19T06:59:16.792 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-19T06:59:16.792 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T06:59:16.793 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T06:59:16.795 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T06:59:16.796 DEBUG:teuthology.orchestra.run.smithi165:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T06:59:16.798 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T06:59:16.798 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T06:59:16.822 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T06:59:16.827 INFO:teuthology.orchestra.run.smithi165.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T06:59:16.836 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T06:59:16.843 INFO:teuthology.orchestra.run.smithi165.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T06:59:16.852 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T06:59:16.861 INFO:teuthology.orchestra.run.smithi148.stderr:sudo: ntpd: command not found 2024-09-19T06:59:16.866 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T06:59:16.868 INFO:teuthology.orchestra.run.smithi165.stderr:sudo: ntpd: command not found 2024-09-19T06:59:16.872 INFO:teuthology.orchestra.run.smithi148.stdout:506 Cannot talk to daemon 2024-09-19T06:59:16.880 INFO:teuthology.orchestra.run.smithi165.stdout:506 Cannot talk to daemon 2024-09-19T06:59:16.886 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T06:59:16.891 INFO:teuthology.orchestra.run.smithi179.stderr:sudo: ntpd: command not found 2024-09-19T06:59:16.895 INFO:teuthology.orchestra.run.smithi165.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T06:59:16.901 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T06:59:16.902 INFO:teuthology.orchestra.run.smithi179.stdout:506 Cannot talk to daemon 2024-09-19T06:59:16.910 INFO:teuthology.orchestra.run.smithi165.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T06:59:16.917 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T06:59:16.931 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T06:59:16.958 INFO:teuthology.orchestra.run.smithi148.stderr:bash: line 1: ntpq: command not found 2024-09-19T06:59:16.961 INFO:teuthology.orchestra.run.smithi148.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T06:59:16.961 INFO:teuthology.orchestra.run.smithi148.stdout:=============================================================================== 2024-09-19T06:59:16.961 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:59:16.961 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:59:16.962 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:59:16.962 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:59:16.965 INFO:teuthology.orchestra.run.smithi165.stderr:bash: line 1: ntpq: command not found 2024-09-19T06:59:16.968 INFO:teuthology.orchestra.run.smithi165.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T06:59:16.968 INFO:teuthology.orchestra.run.smithi165.stdout:=============================================================================== 2024-09-19T06:59:16.968 INFO:teuthology.orchestra.run.smithi165.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:59:16.969 INFO:teuthology.orchestra.run.smithi165.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:59:16.969 INFO:teuthology.orchestra.run.smithi165.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:59:16.969 INFO:teuthology.orchestra.run.smithi165.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:59:16.991 INFO:teuthology.orchestra.run.smithi179.stderr:bash: line 1: ntpq: command not found 2024-09-19T06:59:16.995 INFO:teuthology.orchestra.run.smithi179.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T06:59:16.996 INFO:teuthology.orchestra.run.smithi179.stdout:=============================================================================== 2024-09-19T06:59:16.996 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:59:16.996 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:59:16.996 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:59:16.996 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:59:16.996 INFO:teuthology.run_tasks:Running task install... 2024-09-19T06:59:17.004 DEBUG:teuthology.task.install:project ceph 2024-09-19T06:59:17.004 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}} 2024-09-19T06:59:17.004 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'} 2024-09-19T06:59:17.004 INFO:teuthology.task.install:Using flavor: default 2024-09-19T06:59:17.009 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-19T06:59:17.009 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-19T06:59:17.010 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T06:59:17.011 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:59:17.012 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T06:59:17.013 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:59:17.014 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T06:59:17.014 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:59:17.162 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T06:59:17.162 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T06:59:17.166 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T06:59:17.166 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T06:59:17.202 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T06:59:17.202 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T06:59:17.271 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T06:59:17.271 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-19T06:59:17.272 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T06:59:17.280 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T06:59:17.281 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-19T06:59:17.281 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T06:59:17.298 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T06:59:17.299 DEBUG:teuthology.orchestra.run.smithi148:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T06:59:17.306 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T06:59:17.307 DEBUG:teuthology.orchestra.run.smithi179:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T06:59:17.311 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T06:59:17.311 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-19T06:59:17.311 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T06:59:17.338 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T06:59:17.339 DEBUG:teuthology.orchestra.run.smithi165:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T06:59:17.365 DEBUG:teuthology.orchestra.run.smithi148:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T06:59:17.372 DEBUG:teuthology.orchestra.run.smithi179:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T06:59:17.405 DEBUG:teuthology.orchestra.run.smithi165:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T06:59:17.440 DEBUG:teuthology.orchestra.run.smithi148:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T06:59:17.448 DEBUG:teuthology.orchestra.run.smithi179:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T06:59:17.481 DEBUG:teuthology.orchestra.run.smithi165:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T06:59:17.504 INFO:teuthology.orchestra.run.smithi148.stdout:check_obsoletes = 1 2024-09-19T06:59:17.505 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum clean all 2024-09-19T06:59:17.511 INFO:teuthology.orchestra.run.smithi179.stdout:check_obsoletes = 1 2024-09-19T06:59:17.513 DEBUG:teuthology.orchestra.run.smithi179:> sudo yum clean all 2024-09-19T06:59:17.547 INFO:teuthology.orchestra.run.smithi165.stdout:check_obsoletes = 1 2024-09-19T06:59:17.548 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum clean all 2024-09-19T06:59:17.727 INFO:teuthology.orchestra.run.smithi148.stdout:45 files removed 2024-09-19T06:59:17.737 INFO:teuthology.orchestra.run.smithi179.stdout:45 files removed 2024-09-19T06:59:17.755 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T06:59:17.765 DEBUG:teuthology.orchestra.run.smithi179:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T06:59:17.775 INFO:teuthology.orchestra.run.smithi165.stdout:45 files removed 2024-09-19T06:59:17.802 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T06:59:18.303 INFO:teuthology.orchestra.run.smithi179.stdout:ceph packages for x86_64 322 kB/s | 84 kB 00:00 2024-09-19T06:59:18.315 INFO:teuthology.orchestra.run.smithi148.stdout:ceph packages for x86_64 307 kB/s | 84 kB 00:00 2024-09-19T06:59:18.349 INFO:teuthology.orchestra.run.smithi165.stdout:ceph packages for x86_64 312 kB/s | 84 kB 00:00 2024-09-19T06:59:18.570 INFO:teuthology.orchestra.run.smithi179.stdout:ceph noarch packages 52 kB/s | 12 kB 00:00 2024-09-19T06:59:18.582 INFO:teuthology.orchestra.run.smithi148.stdout:ceph noarch packages 53 kB/s | 12 kB 00:00 2024-09-19T06:59:18.642 INFO:teuthology.orchestra.run.smithi165.stdout:ceph noarch packages 47 kB/s | 12 kB 00:00 2024-09-19T06:59:18.837 INFO:teuthology.orchestra.run.smithi179.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-19T06:59:18.850 INFO:teuthology.orchestra.run.smithi148.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-19T06:59:18.918 INFO:teuthology.orchestra.run.smithi165.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-19T06:59:19.413 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.3 MB 00:00 2024-09-19T06:59:19.500 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.3 MB 00:00 2024-09-19T06:59:21.542 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - BaseOS 3.2 MB/s | 8.3 MB 00:02 2024-09-19T06:59:22.669 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - AppStream 9.7 MB/s | 20 MB 00:02 2024-09-19T06:59:27.103 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - CRB 9.9 MB/s | 6.5 MB 00:00 2024-09-19T06:59:27.270 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - AppStream 4.4 MB/s | 20 MB 00:04 2024-09-19T06:59:29.203 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - Extras packages 24 kB/s | 19 kB 00:00 2024-09-19T06:59:29.946 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - AppStream 2.2 MB/s | 20 MB 00:09 2024-09-19T06:59:30.032 INFO:teuthology.orchestra.run.smithi148.stdout:Extra Packages for Enterprise Linux 32 MB/s | 23 MB 00:00 2024-09-19T06:59:31.502 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-19T06:59:33.103 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - Extras packages 49 kB/s | 19 kB 00:00 2024-09-19T06:59:34.274 INFO:teuthology.orchestra.run.smithi165.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-19T06:59:35.197 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - CRB 4.4 MB/s | 6.5 MB 00:01 2024-09-19T06:59:35.463 INFO:teuthology.orchestra.run.smithi148.stdout:lab-extras 37 kB/s | 1.7 kB 00:00 2024-09-19T06:59:36.598 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - Extras packages 102 kB/s | 19 kB 00:00 2024-09-19T06:59:37.535 INFO:teuthology.orchestra.run.smithi179.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-19T06:59:37.657 INFO:teuthology.orchestra.run.smithi148.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T06:59:37.658 INFO:teuthology.orchestra.run.smithi148.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T06:59:37.669 INFO:teuthology.orchestra.run.smithi148.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T06:59:37.670 INFO:teuthology.orchestra.run.smithi148.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T06:59:37.671 INFO:teuthology.orchestra.run.smithi148.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T06:59:37.672 INFO:teuthology.orchestra.run.smithi148.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T06:59:37.673 INFO:teuthology.orchestra.run.smithi148.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T06:59:37.676 INFO:teuthology.orchestra.run.smithi148.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T06:59:37.676 INFO:teuthology.orchestra.run.smithi148.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T06:59:37.740 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-19T06:59:37.761 INFO:teuthology.orchestra.run.smithi148.stdout:====================================================================================== 2024-09-19T06:59:37.761 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repository Size 2024-09-19T06:59:37.761 INFO:teuthology.orchestra.run.smithi148.stdout:====================================================================================== 2024-09-19T06:59:37.761 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-19T06:59:37.761 INFO:teuthology.orchestra.run.smithi148.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T06:59:37.761 INFO:teuthology.orchestra.run.smithi148.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T06:59:37.761 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T06:59:37.761 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T06:59:37.761 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T06:59:37.762 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T06:59:37.762 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T06:59:37.762 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T06:59:37.762 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T06:59:37.762 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T06:59:37.762 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T06:59:37.762 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T06:59:37.762 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T06:59:37.762 INFO:teuthology.orchestra.run.smithi148.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T06:59:37.762 INFO:teuthology.orchestra.run.smithi148.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T06:59:37.762 INFO:teuthology.orchestra.run.smithi148.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T06:59:37.762 INFO:teuthology.orchestra.run.smithi148.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T06:59:37.763 INFO:teuthology.orchestra.run.smithi148.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T06:59:37.763 INFO:teuthology.orchestra.run.smithi148.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T06:59:37.763 INFO:teuthology.orchestra.run.smithi148.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T06:59:37.763 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T06:59:37.763 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T06:59:37.763 INFO:teuthology.orchestra.run.smithi148.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T06:59:37.763 INFO:teuthology.orchestra.run.smithi148.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T06:59:37.763 INFO:teuthology.orchestra.run.smithi148.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T06:59:37.763 INFO:teuthology.orchestra.run.smithi148.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T06:59:37.763 INFO:teuthology.orchestra.run.smithi148.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T06:59:37.763 INFO:teuthology.orchestra.run.smithi148.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T06:59:37.763 INFO:teuthology.orchestra.run.smithi148.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T06:59:37.763 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T06:59:37.764 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T06:59:37.764 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T06:59:37.764 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T06:59:37.764 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T06:59:37.764 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T06:59:37.764 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T06:59:37.764 INFO:teuthology.orchestra.run.smithi148.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T06:59:37.764 INFO:teuthology.orchestra.run.smithi148.stdout:Upgrading: 2024-09-19T06:59:37.764 INFO:teuthology.orchestra.run.smithi148.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T06:59:37.764 INFO:teuthology.orchestra.run.smithi148.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T06:59:37.765 INFO:teuthology.orchestra.run.smithi148.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T06:59:37.765 INFO:teuthology.orchestra.run.smithi148.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T06:59:37.765 INFO:teuthology.orchestra.run.smithi148.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T06:59:37.765 INFO:teuthology.orchestra.run.smithi148.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T06:59:37.765 INFO:teuthology.orchestra.run.smithi148.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T06:59:37.765 INFO:teuthology.orchestra.run.smithi148.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T06:59:37.765 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2024-09-19T06:59:37.765 INFO:teuthology.orchestra.run.smithi148.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T06:59:37.765 INFO:teuthology.orchestra.run.smithi148.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T06:59:37.766 INFO:teuthology.orchestra.run.smithi148.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T06:59:37.766 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T06:59:37.766 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T06:59:37.766 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T06:59:37.766 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T06:59:37.766 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T06:59:37.766 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T06:59:37.766 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T06:59:37.766 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T06:59:37.766 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T06:59:37.766 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T06:59:37.766 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T06:59:37.767 INFO:teuthology.orchestra.run.smithi148.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T06:59:37.767 INFO:teuthology.orchestra.run.smithi148.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T06:59:37.767 INFO:teuthology.orchestra.run.smithi148.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T06:59:37.767 INFO:teuthology.orchestra.run.smithi148.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T06:59:37.767 INFO:teuthology.orchestra.run.smithi148.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T06:59:37.767 INFO:teuthology.orchestra.run.smithi148.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T06:59:37.767 INFO:teuthology.orchestra.run.smithi148.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T06:59:37.767 INFO:teuthology.orchestra.run.smithi148.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T06:59:37.767 INFO:teuthology.orchestra.run.smithi148.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T06:59:37.767 INFO:teuthology.orchestra.run.smithi148.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T06:59:37.768 INFO:teuthology.orchestra.run.smithi148.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T06:59:37.768 INFO:teuthology.orchestra.run.smithi148.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T06:59:37.768 INFO:teuthology.orchestra.run.smithi148.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T06:59:37.768 INFO:teuthology.orchestra.run.smithi148.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T06:59:37.768 INFO:teuthology.orchestra.run.smithi148.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T06:59:37.768 INFO:teuthology.orchestra.run.smithi148.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T06:59:37.768 INFO:teuthology.orchestra.run.smithi148.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T06:59:37.768 INFO:teuthology.orchestra.run.smithi148.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T06:59:37.768 INFO:teuthology.orchestra.run.smithi148.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T06:59:37.768 INFO:teuthology.orchestra.run.smithi148.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T06:59:37.769 INFO:teuthology.orchestra.run.smithi148.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T06:59:37.769 INFO:teuthology.orchestra.run.smithi148.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T06:59:37.769 INFO:teuthology.orchestra.run.smithi148.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T06:59:37.769 INFO:teuthology.orchestra.run.smithi148.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T06:59:37.769 INFO:teuthology.orchestra.run.smithi148.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T06:59:37.769 INFO:teuthology.orchestra.run.smithi148.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T06:59:37.769 INFO:teuthology.orchestra.run.smithi148.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T06:59:37.769 INFO:teuthology.orchestra.run.smithi148.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T06:59:37.769 INFO:teuthology.orchestra.run.smithi148.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T06:59:37.769 INFO:teuthology.orchestra.run.smithi148.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T06:59:37.770 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T06:59:37.770 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T06:59:37.770 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T06:59:37.770 INFO:teuthology.orchestra.run.smithi148.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T06:59:37.770 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T06:59:37.770 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T06:59:37.770 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T06:59:37.770 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T06:59:37.770 INFO:teuthology.orchestra.run.smithi148.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T06:59:37.770 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T06:59:37.770 INFO:teuthology.orchestra.run.smithi148.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T06:59:37.771 INFO:teuthology.orchestra.run.smithi148.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T06:59:37.771 INFO:teuthology.orchestra.run.smithi148.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T06:59:37.771 INFO:teuthology.orchestra.run.smithi148.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T06:59:37.771 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T06:59:37.771 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T06:59:37.771 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T06:59:37.771 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T06:59:37.771 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T06:59:37.771 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T06:59:37.772 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T06:59:37.772 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T06:59:37.772 INFO:teuthology.orchestra.run.smithi148.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T06:59:37.772 INFO:teuthology.orchestra.run.smithi148.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T06:59:37.772 INFO:teuthology.orchestra.run.smithi148.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T06:59:37.772 INFO:teuthology.orchestra.run.smithi148.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T06:59:37.772 INFO:teuthology.orchestra.run.smithi148.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T06:59:37.772 INFO:teuthology.orchestra.run.smithi148.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T06:59:37.772 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T06:59:37.772 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T06:59:37.772 INFO:teuthology.orchestra.run.smithi148.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T06:59:37.773 INFO:teuthology.orchestra.run.smithi148.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T06:59:37.773 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T06:59:37.773 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T06:59:37.773 INFO:teuthology.orchestra.run.smithi148.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T06:59:37.773 INFO:teuthology.orchestra.run.smithi148.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T06:59:37.773 INFO:teuthology.orchestra.run.smithi148.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T06:59:37.773 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T06:59:37.773 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T06:59:37.773 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T06:59:37.774 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T06:59:37.774 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T06:59:37.774 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T06:59:37.774 INFO:teuthology.orchestra.run.smithi148.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T06:59:37.774 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T06:59:37.774 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T06:59:37.774 INFO:teuthology.orchestra.run.smithi148.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T06:59:37.774 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T06:59:37.774 INFO:teuthology.orchestra.run.smithi148.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T06:59:37.775 INFO:teuthology.orchestra.run.smithi148.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T06:59:37.775 INFO:teuthology.orchestra.run.smithi148.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T06:59:37.775 INFO:teuthology.orchestra.run.smithi148.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T06:59:37.775 INFO:teuthology.orchestra.run.smithi148.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T06:59:37.775 INFO:teuthology.orchestra.run.smithi148.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T06:59:37.775 INFO:teuthology.orchestra.run.smithi148.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T06:59:37.775 INFO:teuthology.orchestra.run.smithi148.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T06:59:37.775 INFO:teuthology.orchestra.run.smithi148.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T06:59:37.775 INFO:teuthology.orchestra.run.smithi148.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T06:59:37.775 INFO:teuthology.orchestra.run.smithi148.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T06:59:37.775 INFO:teuthology.orchestra.run.smithi148.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T06:59:37.775 INFO:teuthology.orchestra.run.smithi148.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T06:59:37.775 INFO:teuthology.orchestra.run.smithi148.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T06:59:37.776 INFO:teuthology.orchestra.run.smithi148.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T06:59:37.776 INFO:teuthology.orchestra.run.smithi148.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T06:59:37.776 INFO:teuthology.orchestra.run.smithi148.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T06:59:37.776 INFO:teuthology.orchestra.run.smithi148.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T06:59:37.776 INFO:teuthology.orchestra.run.smithi148.stdout:Installing weak dependencies: 2024-09-19T06:59:37.776 INFO:teuthology.orchestra.run.smithi148.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T06:59:37.776 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T06:59:37.776 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-19T06:59:37.776 INFO:teuthology.orchestra.run.smithi148.stdout:====================================================================================== 2024-09-19T06:59:37.776 INFO:teuthology.orchestra.run.smithi148.stdout:Install 148 Packages 2024-09-19T06:59:37.776 INFO:teuthology.orchestra.run.smithi148.stdout:Upgrade 8 Packages 2024-09-19T06:59:37.776 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T06:59:37.777 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 226 M 2024-09-19T06:59:37.777 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-19T06:59:38.423 INFO:teuthology.orchestra.run.smithi148.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 46 kB/s | 6.6 kB 00:00 2024-09-19T06:59:38.640 INFO:teuthology.orchestra.run.smithi148.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 4.0 MB/s | 896 kB 00:00 2024-09-19T06:59:38.731 INFO:teuthology.orchestra.run.smithi148.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 1.6 MB/s | 145 kB 00:00 2024-09-19T06:59:38.826 INFO:teuthology.orchestra.run.smithi148.stdout:(4/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 9.9 MB/s | 5.4 MB 00:00 2024-09-19T06:59:38.959 INFO:teuthology.orchestra.run.smithi148.stdout:(5/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 11 MB/s | 1.5 MB 00:00 2024-09-19T06:59:39.126 INFO:teuthology.orchestra.run.smithi148.stdout:(6/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 6.0 MB/s | 2.4 MB 00:00 2024-09-19T06:59:39.326 INFO:teuthology.orchestra.run.smithi148.stdout:(7/156): ceph-common-19.1.1-361.g2f599a46.el9.x 20 MB/s | 21 MB 00:01 2024-09-19T06:59:39.410 INFO:teuthology.orchestra.run.smithi148.stdout:(8/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 10 MB/s | 4.7 MB 00:00 2024-09-19T06:59:39.460 INFO:teuthology.orchestra.run.smithi148.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 504 kB/s | 25 kB 00:00 2024-09-19T06:59:39.696 INFO:teuthology.orchestra.run.smithi165.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2024-09-19T06:59:39.819 INFO:teuthology.orchestra.run.smithi148.stdout:(10/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 22 MB/s | 11 MB 00:00 2024-09-19T06:59:39.869 INFO:teuthology.orchestra.run.smithi148.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 4.5 MB/s | 228 kB 00:00 2024-09-19T06:59:39.919 INFO:teuthology.orchestra.run.smithi148.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 542 kB/s | 27 kB 00:00 2024-09-19T06:59:39.970 INFO:teuthology.orchestra.run.smithi148.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 635 kB/s | 32 kB 00:00 2024-09-19T06:59:40.045 INFO:teuthology.orchestra.run.smithi148.stdout:(14/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 9.8 MB/s | 751 kB 00:00 2024-09-19T06:59:40.112 INFO:teuthology.orchestra.run.smithi148.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 2.4 MB/s | 163 kB 00:00 2024-09-19T06:59:40.179 INFO:teuthology.orchestra.run.smithi148.stdout:(16/156): librados-devel-19.1.1-361.g2f599a46.e 1.9 MB/s | 127 kB 00:00 2024-09-19T06:59:40.262 INFO:teuthology.orchestra.run.smithi148.stdout:(17/156): libradosstriper1-19.1.1-361.g2f599a46 5.9 MB/s | 506 kB 00:00 2024-09-19T06:59:40.655 INFO:teuthology.orchestra.run.smithi148.stdout:(18/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 11 MB/s | 17 MB 00:01 2024-09-19T06:59:40.730 INFO:teuthology.orchestra.run.smithi148.stdout:(19/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 11 MB/s | 5.3 MB 00:00 2024-09-19T06:59:40.755 INFO:teuthology.orchestra.run.smithi148.stdout:(20/156): python3-ceph-argparse-19.1.1-361.g2f5 451 kB/s | 45 kB 00:00 2024-09-19T06:59:40.780 INFO:teuthology.orchestra.run.smithi148.stdout:(21/156): python3-ceph-common-19.1.1-361.g2f599 2.7 MB/s | 136 kB 00:00 2024-09-19T06:59:40.805 INFO:teuthology.orchestra.run.smithi148.stdout:(22/156): python3-cephfs-19.1.1-361.g2f599a46.e 3.1 MB/s | 161 kB 00:00 2024-09-19T06:59:40.839 INFO:teuthology.orchestra.run.smithi148.stdout:(23/156): python3-rados-19.1.1-361.g2f599a46.el 5.3 MB/s | 320 kB 00:00 2024-09-19T06:59:40.865 INFO:teuthology.orchestra.run.smithi148.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 5.0 MB/s | 300 kB 00:00 2024-09-19T06:59:40.890 INFO:teuthology.orchestra.run.smithi148.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.9 MB/s | 99 kB 00:00 2024-09-19T06:59:40.915 INFO:teuthology.orchestra.run.smithi148.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-19T06:59:40.975 INFO:teuthology.orchestra.run.smithi148.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 2.9 MB/s | 171 kB 00:00 2024-09-19T06:59:41.066 INFO:teuthology.orchestra.run.smithi148.stdout:(28/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 18 MB/s | 3.1 MB 00:00 2024-09-19T06:59:41.091 INFO:teuthology.orchestra.run.smithi148.stdout:(29/156): ceph-grafana-dashboards-19.1.1-361.g2 272 kB/s | 32 kB 00:00 2024-09-19T06:59:41.116 INFO:teuthology.orchestra.run.smithi148.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 2.8 MB/s | 146 kB 00:00 2024-09-19T06:59:41.525 INFO:teuthology.orchestra.run.smithi148.stdout:(31/156): ceph-mgr-diskprediction-local-19.1.1- 18 MB/s | 7.4 MB 00:00 2024-09-19T06:59:41.583 INFO:teuthology.orchestra.run.smithi148.stdout:(32/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 7.2 MB/s | 3.6 MB 00:00 2024-09-19T06:59:41.609 INFO:teuthology.orchestra.run.smithi148.stdout:(33/156): ceph-mgr-modules-core-19.1.1-361.g2f5 2.9 MB/s | 249 kB 00:00 2024-09-19T06:59:41.634 INFO:teuthology.orchestra.run.smithi148.stdout:(34/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 981 kB/s | 49 kB 00:00 2024-09-19T06:59:41.659 INFO:teuthology.orchestra.run.smithi148.stdout:(35/156): ceph-prometheus-alerts-19.1.1-361.g2f 326 kB/s | 16 kB 00:00 2024-09-19T06:59:41.685 INFO:teuthology.orchestra.run.smithi148.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 5.5 MB/s | 285 kB 00:00 2024-09-19T06:59:41.865 INFO:teuthology.orchestra.run.smithi165.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T06:59:41.866 INFO:teuthology.orchestra.run.smithi165.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T06:59:41.877 INFO:teuthology.orchestra.run.smithi165.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T06:59:41.878 INFO:teuthology.orchestra.run.smithi165.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T06:59:41.879 INFO:teuthology.orchestra.run.smithi165.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T06:59:41.879 INFO:teuthology.orchestra.run.smithi165.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T06:59:41.881 INFO:teuthology.orchestra.run.smithi165.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T06:59:41.883 INFO:teuthology.orchestra.run.smithi165.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T06:59:41.884 INFO:teuthology.orchestra.run.smithi165.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T06:59:41.946 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-19T06:59:41.961 INFO:teuthology.orchestra.run.smithi165.stdout:====================================================================================== 2024-09-19T06:59:41.962 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-09-19T06:59:41.962 INFO:teuthology.orchestra.run.smithi165.stdout:====================================================================================== 2024-09-19T06:59:41.962 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-19T06:59:41.962 INFO:teuthology.orchestra.run.smithi165.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T06:59:41.962 INFO:teuthology.orchestra.run.smithi165.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T06:59:41.962 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T06:59:41.962 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T06:59:41.962 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T06:59:41.962 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T06:59:41.962 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T06:59:41.962 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T06:59:41.962 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T06:59:41.963 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T06:59:41.963 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T06:59:41.963 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T06:59:41.963 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T06:59:41.963 INFO:teuthology.orchestra.run.smithi165.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T06:59:41.963 INFO:teuthology.orchestra.run.smithi165.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T06:59:41.963 INFO:teuthology.orchestra.run.smithi165.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T06:59:41.963 INFO:teuthology.orchestra.run.smithi165.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T06:59:41.963 INFO:teuthology.orchestra.run.smithi165.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T06:59:41.963 INFO:teuthology.orchestra.run.smithi165.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T06:59:41.963 INFO:teuthology.orchestra.run.smithi165.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T06:59:41.963 INFO:teuthology.orchestra.run.smithi165.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T06:59:41.963 INFO:teuthology.orchestra.run.smithi165.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T06:59:41.964 INFO:teuthology.orchestra.run.smithi165.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T06:59:41.964 INFO:teuthology.orchestra.run.smithi165.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T06:59:41.964 INFO:teuthology.orchestra.run.smithi165.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T06:59:41.964 INFO:teuthology.orchestra.run.smithi165.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T06:59:41.964 INFO:teuthology.orchestra.run.smithi165.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T06:59:41.964 INFO:teuthology.orchestra.run.smithi165.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T06:59:41.964 INFO:teuthology.orchestra.run.smithi165.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T06:59:41.964 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T06:59:41.964 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T06:59:41.964 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T06:59:41.964 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T06:59:41.964 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T06:59:41.965 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T06:59:41.965 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T06:59:41.965 INFO:teuthology.orchestra.run.smithi165.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T06:59:41.965 INFO:teuthology.orchestra.run.smithi165.stdout:Upgrading: 2024-09-19T06:59:41.965 INFO:teuthology.orchestra.run.smithi165.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T06:59:41.965 INFO:teuthology.orchestra.run.smithi165.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T06:59:41.965 INFO:teuthology.orchestra.run.smithi165.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T06:59:41.965 INFO:teuthology.orchestra.run.smithi165.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T06:59:41.965 INFO:teuthology.orchestra.run.smithi165.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T06:59:41.965 INFO:teuthology.orchestra.run.smithi165.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T06:59:41.965 INFO:teuthology.orchestra.run.smithi165.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T06:59:41.965 INFO:teuthology.orchestra.run.smithi165.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T06:59:41.966 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2024-09-19T06:59:41.966 INFO:teuthology.orchestra.run.smithi165.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T06:59:41.966 INFO:teuthology.orchestra.run.smithi165.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T06:59:41.966 INFO:teuthology.orchestra.run.smithi165.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T06:59:41.966 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T06:59:41.966 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T06:59:41.966 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T06:59:41.966 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T06:59:41.966 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T06:59:41.966 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T06:59:41.966 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T06:59:41.966 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T06:59:41.966 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T06:59:41.967 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T06:59:41.967 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T06:59:41.967 INFO:teuthology.orchestra.run.smithi165.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T06:59:41.967 INFO:teuthology.orchestra.run.smithi165.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T06:59:41.967 INFO:teuthology.orchestra.run.smithi165.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T06:59:41.967 INFO:teuthology.orchestra.run.smithi165.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T06:59:41.967 INFO:teuthology.orchestra.run.smithi165.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T06:59:41.967 INFO:teuthology.orchestra.run.smithi165.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T06:59:41.967 INFO:teuthology.orchestra.run.smithi165.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T06:59:41.967 INFO:teuthology.orchestra.run.smithi165.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T06:59:41.967 INFO:teuthology.orchestra.run.smithi165.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T06:59:41.967 INFO:teuthology.orchestra.run.smithi165.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T06:59:41.968 INFO:teuthology.orchestra.run.smithi165.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T06:59:41.968 INFO:teuthology.orchestra.run.smithi165.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T06:59:41.968 INFO:teuthology.orchestra.run.smithi165.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T06:59:41.968 INFO:teuthology.orchestra.run.smithi165.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T06:59:41.968 INFO:teuthology.orchestra.run.smithi165.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T06:59:41.968 INFO:teuthology.orchestra.run.smithi165.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T06:59:41.968 INFO:teuthology.orchestra.run.smithi165.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T06:59:41.968 INFO:teuthology.orchestra.run.smithi165.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T06:59:41.968 INFO:teuthology.orchestra.run.smithi165.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T06:59:41.968 INFO:teuthology.orchestra.run.smithi165.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T06:59:41.968 INFO:teuthology.orchestra.run.smithi165.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T06:59:41.968 INFO:teuthology.orchestra.run.smithi165.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T06:59:41.968 INFO:teuthology.orchestra.run.smithi165.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T06:59:41.969 INFO:teuthology.orchestra.run.smithi165.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T06:59:41.969 INFO:teuthology.orchestra.run.smithi165.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T06:59:41.969 INFO:teuthology.orchestra.run.smithi165.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T06:59:41.969 INFO:teuthology.orchestra.run.smithi165.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T06:59:41.969 INFO:teuthology.orchestra.run.smithi165.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T06:59:41.969 INFO:teuthology.orchestra.run.smithi165.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T06:59:41.969 INFO:teuthology.orchestra.run.smithi165.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T06:59:41.969 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T06:59:41.969 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T06:59:41.969 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T06:59:41.969 INFO:teuthology.orchestra.run.smithi165.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T06:59:41.969 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T06:59:41.969 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T06:59:41.970 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T06:59:41.970 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T06:59:41.970 INFO:teuthology.orchestra.run.smithi165.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T06:59:41.970 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T06:59:41.970 INFO:teuthology.orchestra.run.smithi165.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T06:59:41.970 INFO:teuthology.orchestra.run.smithi165.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T06:59:41.970 INFO:teuthology.orchestra.run.smithi165.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T06:59:41.970 INFO:teuthology.orchestra.run.smithi165.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T06:59:41.970 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T06:59:41.970 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T06:59:41.970 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T06:59:41.971 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T06:59:41.971 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T06:59:41.971 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T06:59:41.971 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T06:59:41.971 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T06:59:41.971 INFO:teuthology.orchestra.run.smithi165.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T06:59:41.971 INFO:teuthology.orchestra.run.smithi165.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T06:59:41.971 INFO:teuthology.orchestra.run.smithi165.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T06:59:41.971 INFO:teuthology.orchestra.run.smithi165.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T06:59:41.971 INFO:teuthology.orchestra.run.smithi165.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T06:59:41.971 INFO:teuthology.orchestra.run.smithi165.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T06:59:41.972 INFO:teuthology.orchestra.run.smithi165.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T06:59:41.972 INFO:teuthology.orchestra.run.smithi165.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T06:59:41.972 INFO:teuthology.orchestra.run.smithi165.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T06:59:41.972 INFO:teuthology.orchestra.run.smithi165.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T06:59:41.972 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T06:59:41.972 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T06:59:41.972 INFO:teuthology.orchestra.run.smithi165.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T06:59:41.972 INFO:teuthology.orchestra.run.smithi165.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T06:59:41.972 INFO:teuthology.orchestra.run.smithi165.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T06:59:41.972 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T06:59:41.972 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T06:59:41.973 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T06:59:41.973 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T06:59:41.973 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T06:59:41.973 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T06:59:41.973 INFO:teuthology.orchestra.run.smithi165.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T06:59:41.973 INFO:teuthology.orchestra.run.smithi165.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T06:59:41.973 INFO:teuthology.orchestra.run.smithi165.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T06:59:41.973 INFO:teuthology.orchestra.run.smithi165.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T06:59:41.973 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T06:59:41.973 INFO:teuthology.orchestra.run.smithi165.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T06:59:41.973 INFO:teuthology.orchestra.run.smithi165.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T06:59:41.974 INFO:teuthology.orchestra.run.smithi165.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T06:59:41.974 INFO:teuthology.orchestra.run.smithi165.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T06:59:41.974 INFO:teuthology.orchestra.run.smithi165.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T06:59:41.974 INFO:teuthology.orchestra.run.smithi165.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T06:59:41.974 INFO:teuthology.orchestra.run.smithi165.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T06:59:41.974 INFO:teuthology.orchestra.run.smithi165.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T06:59:41.974 INFO:teuthology.orchestra.run.smithi165.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T06:59:41.974 INFO:teuthology.orchestra.run.smithi165.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T06:59:41.974 INFO:teuthology.orchestra.run.smithi165.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T06:59:41.974 INFO:teuthology.orchestra.run.smithi165.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T06:59:41.974 INFO:teuthology.orchestra.run.smithi165.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T06:59:41.974 INFO:teuthology.orchestra.run.smithi165.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T06:59:41.975 INFO:teuthology.orchestra.run.smithi165.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T06:59:41.975 INFO:teuthology.orchestra.run.smithi165.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T06:59:41.975 INFO:teuthology.orchestra.run.smithi165.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T06:59:41.975 INFO:teuthology.orchestra.run.smithi165.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T06:59:41.975 INFO:teuthology.orchestra.run.smithi165.stdout:Installing weak dependencies: 2024-09-19T06:59:41.975 INFO:teuthology.orchestra.run.smithi165.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T06:59:41.975 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-19T06:59:41.975 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-19T06:59:41.975 INFO:teuthology.orchestra.run.smithi165.stdout:====================================================================================== 2024-09-19T06:59:41.975 INFO:teuthology.orchestra.run.smithi165.stdout:Install 148 Packages 2024-09-19T06:59:41.975 INFO:teuthology.orchestra.run.smithi165.stdout:Upgrade 8 Packages 2024-09-19T06:59:41.976 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-19T06:59:41.976 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 226 M 2024-09-19T06:59:41.976 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-19T06:59:42.110 INFO:teuthology.orchestra.run.smithi148.stdout:(37/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 18 MB/s | 49 MB 00:02 2024-09-19T06:59:42.135 INFO:teuthology.orchestra.run.smithi148.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 40 kB/s | 18 kB 00:00 2024-09-19T06:59:42.177 INFO:teuthology.orchestra.run.smithi148.stdout:(39/156): cephadm-19.1.1-361.g2f599a46.el9.noar 1.4 MB/s | 765 kB 00:00 2024-09-19T06:59:42.278 INFO:teuthology.orchestra.run.smithi148.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 479 kB/s | 80 kB 00:00 2024-09-19T06:59:42.311 INFO:teuthology.orchestra.run.smithi148.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.4 MB/s | 191 kB 00:00 2024-09-19T06:59:42.353 INFO:teuthology.orchestra.run.smithi148.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-09-19T06:59:42.356 INFO:teuthology.orchestra.run.smithi165.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 43 kB/s | 6.6 kB 00:00 2024-09-19T06:59:42.378 INFO:teuthology.orchestra.run.smithi148.stdout:(43/156): libgfortran-11.5.0-2.el9.x86_64.rpm 3.2 MB/s | 801 kB 00:00 2024-09-19T06:59:42.403 INFO:teuthology.orchestra.run.smithi148.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-19T06:59:42.429 INFO:teuthology.orchestra.run.smithi148.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-19T06:59:42.454 INFO:teuthology.orchestra.run.smithi148.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-19T06:59:42.480 INFO:teuthology.orchestra.run.smithi148.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-19T06:59:42.546 INFO:teuthology.orchestra.run.smithi148.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 5.2 MB/s | 1.2 MB 00:00 2024-09-19T06:59:42.613 INFO:teuthology.orchestra.run.smithi148.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 4.2 MB/s | 689 kB 00:00 2024-09-19T06:59:42.648 INFO:teuthology.orchestra.run.smithi165.stdout:(2/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 12 MB/s | 5.4 MB 00:00 2024-09-19T06:59:42.655 INFO:teuthology.orchestra.run.smithi148.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 521 kB/s | 22 kB 00:00 2024-09-19T06:59:42.680 INFO:teuthology.orchestra.run.smithi148.stdout:(51/156): boost-program-options-1.75.0-8.el9.x8 799 kB/s | 107 kB 00:00 2024-09-19T06:59:42.690 INFO:teuthology.orchestra.run.smithi165.stdout:(3/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 2.6 MB/s | 896 kB 00:00 2024-09-19T06:59:42.715 INFO:teuthology.orchestra.run.smithi165.stdout:(4/156): ceph-immutable-object-cache-19.1.1-361 2.1 MB/s | 145 kB 00:00 2024-09-19T06:59:42.722 INFO:teuthology.orchestra.run.smithi148.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 3.8 MB/s | 943 kB 00:00 2024-09-19T06:59:42.748 INFO:teuthology.orchestra.run.smithi148.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 487 kB/s | 33 kB 00:00 2024-09-19T06:59:42.773 INFO:teuthology.orchestra.run.smithi148.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-09-19T06:59:42.799 INFO:teuthology.orchestra.run.smithi148.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 363 kB/s | 18 kB 00:00 2024-09-19T06:59:42.799 INFO:teuthology.orchestra.run.smithi165.stdout:(5/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 18 MB/s | 1.5 MB 00:00 2024-09-19T06:59:42.823 INFO:teuthology.orchestra.run.smithi148.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 223 kB/s | 11 kB 00:00 2024-09-19T06:59:42.849 INFO:teuthology.orchestra.run.smithi148.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-19T06:59:42.874 INFO:teuthology.orchestra.run.smithi148.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 900 kB/s | 45 kB 00:00 2024-09-19T06:59:42.908 INFO:teuthology.orchestra.run.smithi148.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-19T06:59:42.958 INFO:teuthology.orchestra.run.smithi148.stdout:(60/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 13 MB/s | 3.0 MB 00:00 2024-09-19T06:59:42.983 INFO:teuthology.orchestra.run.smithi148.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 326 kB/s | 24 kB 00:00 2024-09-19T06:59:42.991 INFO:teuthology.orchestra.run.smithi179.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-09-19T06:59:43.017 INFO:teuthology.orchestra.run.smithi148.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 808 kB/s | 47 kB 00:00 2024-09-19T06:59:43.051 INFO:teuthology.orchestra.run.smithi148.stdout:(63/156): libtool-2.4.6-46.el9.x86_64.rpm 3.2 MB/s | 581 kB 00:00 2024-09-19T06:59:43.076 INFO:teuthology.orchestra.run.smithi148.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-09-19T06:59:43.101 INFO:teuthology.orchestra.run.smithi148.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 768 kB/s | 38 kB 00:00 2024-09-19T06:59:43.126 INFO:teuthology.orchestra.run.smithi148.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-09-19T06:59:43.141 INFO:teuthology.orchestra.run.smithi165.stdout:(6/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 5.3 MB/s | 2.4 MB 00:00 2024-09-19T06:59:43.210 INFO:teuthology.orchestra.run.smithi148.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-19T06:59:43.286 INFO:teuthology.orchestra.run.smithi148.stdout:(68/156): openblas-openmp-0.3.26-2.el9.x86_64.r 24 MB/s | 4.9 MB 00:00 2024-09-19T06:59:43.319 INFO:teuthology.orchestra.run.smithi148.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 8.2 MB/s | 910 kB 00:00 2024-09-19T06:59:43.333 INFO:teuthology.orchestra.run.smithi165.stdout:(7/156): ceph-common-19.1.1-361.g2f599a46.el9.x 19 MB/s | 21 MB 00:01 2024-09-19T06:59:43.344 INFO:teuthology.orchestra.run.smithi148.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-19T06:59:43.400 INFO:teuthology.orchestra.run.smithi165.stdout:(8/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 7.8 MB/s | 4.7 MB 00:00 2024-09-19T06:59:43.411 INFO:teuthology.orchestra.run.smithi148.stdout:(71/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-09-19T06:59:43.445 INFO:teuthology.orchestra.run.smithi148.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2024-09-19T06:59:43.458 INFO:teuthology.orchestra.run.smithi165.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 432 kB/s | 25 kB 00:00 2024-09-19T06:59:43.470 INFO:teuthology.orchestra.run.smithi148.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-19T06:59:43.562 INFO:teuthology.orchestra.run.smithi148.stdout:(74/156): postgresql-server-13.16-1.el9.x86_64. 24 MB/s | 5.8 MB 00:00 2024-09-19T06:59:43.587 INFO:teuthology.orchestra.run.smithi148.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 524 kB/s | 61 kB 00:00 2024-09-19T06:59:43.613 INFO:teuthology.orchestra.run.smithi148.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 4.8 MB/s | 245 kB 00:00 2024-09-19T06:59:43.638 INFO:teuthology.orchestra.run.smithi148.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-19T06:59:43.663 INFO:teuthology.orchestra.run.smithi148.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 511 kB/s | 26 kB 00:00 2024-09-19T06:59:43.680 INFO:teuthology.orchestra.run.smithi148.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 457 kB/s | 19 kB 00:00 2024-09-19T06:59:43.705 INFO:teuthology.orchestra.run.smithi148.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 4.0 MB/s | 172 kB 00:00 2024-09-19T06:59:43.722 INFO:teuthology.orchestra.run.smithi148.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 829 kB/s | 35 kB 00:00 2024-09-19T06:59:43.806 INFO:teuthology.orchestra.run.smithi148.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-09-19T06:59:43.831 INFO:teuthology.orchestra.run.smithi148.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.2 MB/s | 250 kB 00:00 2024-09-19T06:59:43.833 INFO:teuthology.orchestra.run.smithi165.stdout:(10/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 21 MB/s | 11 MB 00:00 2024-09-19T06:59:43.857 INFO:teuthology.orchestra.run.smithi148.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-19T06:59:43.882 INFO:teuthology.orchestra.run.smithi148.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-19T06:59:43.884 INFO:teuthology.orchestra.run.smithi165.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 4.5 MB/s | 228 kB 00:00 2024-09-19T06:59:43.907 INFO:teuthology.orchestra.run.smithi148.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 844 kB/s | 42 kB 00:00 2024-09-19T06:59:43.941 INFO:teuthology.orchestra.run.smithi148.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-19T06:59:43.951 INFO:teuthology.orchestra.run.smithi165.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 406 kB/s | 27 kB 00:00 2024-09-19T06:59:43.966 INFO:teuthology.orchestra.run.smithi148.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-09-19T06:59:43.991 INFO:teuthology.orchestra.run.smithi148.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-19T06:59:44.010 INFO:teuthology.orchestra.run.smithi165.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 545 kB/s | 32 kB 00:00 2024-09-19T06:59:44.016 INFO:teuthology.orchestra.run.smithi148.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-19T06:59:44.042 INFO:teuthology.orchestra.run.smithi148.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-19T06:59:44.093 INFO:teuthology.orchestra.run.smithi165.stdout:(14/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 8.8 MB/s | 751 kB 00:00 2024-09-19T06:59:44.126 INFO:teuthology.orchestra.run.smithi148.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-19T06:59:44.151 INFO:teuthology.orchestra.run.smithi148.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 382 kB/s | 42 kB 00:00 2024-09-19T06:59:44.160 INFO:teuthology.orchestra.run.smithi165.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 2.4 MB/s | 163 kB 00:00 2024-09-19T06:59:44.176 INFO:teuthology.orchestra.run.smithi148.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 884 kB/s | 44 kB 00:00 2024-09-19T06:59:44.201 INFO:teuthology.orchestra.run.smithi148.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-19T06:59:44.226 INFO:teuthology.orchestra.run.smithi148.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 714 kB/s | 36 kB 00:00 2024-09-19T06:59:44.235 INFO:teuthology.orchestra.run.smithi165.stdout:(16/156): librados-devel-19.1.1-361.g2f599a46.e 1.7 MB/s | 127 kB 00:00 2024-09-19T06:59:44.252 INFO:teuthology.orchestra.run.smithi148.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-09-19T06:59:44.277 INFO:teuthology.orchestra.run.smithi148.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-19T06:59:44.302 INFO:teuthology.orchestra.run.smithi148.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-19T06:59:44.327 INFO:teuthology.orchestra.run.smithi165.stdout:(17/156): libradosstriper1-19.1.1-361.g2f599a46 5.4 MB/s | 506 kB 00:00 2024-09-19T06:59:44.328 INFO:teuthology.orchestra.run.smithi148.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-19T06:59:44.353 INFO:teuthology.orchestra.run.smithi148.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-19T06:59:44.378 INFO:teuthology.orchestra.run.smithi148.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 892 kB/s | 45 kB 00:00 2024-09-19T06:59:44.403 INFO:teuthology.orchestra.run.smithi148.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 445 kB/s | 22 kB 00:00 2024-09-19T06:59:44.454 INFO:teuthology.orchestra.run.smithi148.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-19T06:59:44.487 INFO:teuthology.orchestra.run.smithi148.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 9.0 MB/s | 308 kB 00:00 2024-09-19T06:59:44.513 INFO:teuthology.orchestra.run.smithi148.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 781 kB/s | 19 kB 00:00 2024-09-19T06:59:44.645 INFO:teuthology.orchestra.run.smithi165.stdout:(18/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 17 MB/s | 5.3 MB 00:00 2024-09-19T06:59:44.694 INFO:teuthology.orchestra.run.smithi165.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 910 kB/s | 45 kB 00:00 2024-09-19T06:59:44.696 INFO:teuthology.orchestra.run.smithi148.stdout:(107/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 24 MB/s | 16 MB 00:00 2024-09-19T06:59:44.730 INFO:teuthology.orchestra.run.smithi148.stdout:(108/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.4 MB/s | 863 kB 00:00 2024-09-19T06:59:44.762 INFO:teuthology.orchestra.run.smithi165.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 2.0 MB/s | 136 kB 00:00 2024-09-19T06:59:44.763 INFO:teuthology.orchestra.run.smithi148.stdout:(109/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 390 kB/s | 26 kB 00:00 2024-09-19T06:59:44.789 INFO:teuthology.orchestra.run.smithi148.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.8 MB/s | 67 kB 00:00 2024-09-19T06:59:44.814 INFO:teuthology.orchestra.run.smithi148.stdout:(111/156): liboath-2.6.7-2.el9.x86_64.rpm 591 kB/s | 49 kB 00:00 2024-09-19T06:59:44.840 INFO:teuthology.orchestra.run.smithi148.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-09-19T06:59:44.906 INFO:teuthology.orchestra.run.smithi148.stdout:(113/156): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-19T06:59:44.931 INFO:teuthology.orchestra.run.smithi148.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T06:59:44.957 INFO:teuthology.orchestra.run.smithi148.stdout:(115/156): python3-asyncssh-2.13.2-5.el9.noarch 4.6 MB/s | 548 kB 00:00 2024-09-19T06:59:44.982 INFO:teuthology.orchestra.run.smithi148.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 638 kB/s | 32 kB 00:00 2024-09-19T06:59:45.007 INFO:teuthology.orchestra.run.smithi148.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-19T06:59:45.041 INFO:teuthology.orchestra.run.smithi148.stdout:(118/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.6 MB/s | 839 kB 00:00 2024-09-19T06:59:45.066 INFO:teuthology.orchestra.run.smithi148.stdout:(119/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-09-19T06:59:45.092 INFO:teuthology.orchestra.run.smithi148.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-09-19T06:59:45.126 INFO:teuthology.orchestra.run.smithi148.stdout:(121/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.5 MB/s | 303 kB 00:00 2024-09-19T06:59:45.128 INFO:teuthology.orchestra.run.smithi179.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T06:59:45.129 INFO:teuthology.orchestra.run.smithi179.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T06:59:45.143 INFO:teuthology.orchestra.run.smithi179.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T06:59:45.144 INFO:teuthology.orchestra.run.smithi179.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T06:59:45.145 INFO:teuthology.orchestra.run.smithi179.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T06:59:45.146 INFO:teuthology.orchestra.run.smithi179.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T06:59:45.148 INFO:teuthology.orchestra.run.smithi179.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T06:59:45.151 INFO:teuthology.orchestra.run.smithi148.stdout:(122/156): python3-google-auth-2.34.0-1.el9.noa 2.6 MB/s | 220 kB 00:00 2024-09-19T06:59:45.151 INFO:teuthology.orchestra.run.smithi179.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T06:59:45.152 INFO:teuthology.orchestra.run.smithi179.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T06:59:45.176 INFO:teuthology.orchestra.run.smithi148.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-09-19T06:59:45.193 INFO:teuthology.orchestra.run.smithi148.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 255 kB/s | 11 kB 00:00 2024-09-19T06:59:45.204 INFO:teuthology.orchestra.run.smithi165.stdout:(21/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 28 MB/s | 49 MB 00:01 2024-09-19T06:59:45.210 INFO:teuthology.orchestra.run.smithi148.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 527 kB/s | 18 kB 00:00 2024-09-19T06:59:45.214 INFO:teuthology.orchestra.run.smithi179.stdout:Dependencies resolved. 2024-09-19T06:59:45.228 INFO:teuthology.orchestra.run.smithi179.stdout:====================================================================================== 2024-09-19T06:59:45.228 INFO:teuthology.orchestra.run.smithi179.stdout: Package Arch Version Repository Size 2024-09-19T06:59:45.229 INFO:teuthology.orchestra.run.smithi179.stdout:====================================================================================== 2024-09-19T06:59:45.229 INFO:teuthology.orchestra.run.smithi179.stdout:Installing: 2024-09-19T06:59:45.229 INFO:teuthology.orchestra.run.smithi179.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T06:59:45.229 INFO:teuthology.orchestra.run.smithi179.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T06:59:45.229 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T06:59:45.229 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T06:59:45.229 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T06:59:45.229 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T06:59:45.229 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T06:59:45.229 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T06:59:45.229 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T06:59:45.229 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T06:59:45.229 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T06:59:45.230 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T06:59:45.230 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T06:59:45.230 INFO:teuthology.orchestra.run.smithi179.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T06:59:45.230 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T06:59:45.230 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T06:59:45.230 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T06:59:45.230 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T06:59:45.230 INFO:teuthology.orchestra.run.smithi179.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T06:59:45.230 INFO:teuthology.orchestra.run.smithi179.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T06:59:45.230 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T06:59:45.230 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T06:59:45.230 INFO:teuthology.orchestra.run.smithi179.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T06:59:45.230 INFO:teuthology.orchestra.run.smithi179.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T06:59:45.231 INFO:teuthology.orchestra.run.smithi179.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T06:59:45.231 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T06:59:45.231 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T06:59:45.231 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T06:59:45.231 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T06:59:45.231 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T06:59:45.231 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T06:59:45.231 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T06:59:45.231 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T06:59:45.231 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T06:59:45.231 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T06:59:45.231 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T06:59:45.231 INFO:teuthology.orchestra.run.smithi179.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T06:59:45.232 INFO:teuthology.orchestra.run.smithi179.stdout:Upgrading: 2024-09-19T06:59:45.232 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T06:59:45.232 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T06:59:45.232 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T06:59:45.232 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T06:59:45.232 INFO:teuthology.orchestra.run.smithi179.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T06:59:45.232 INFO:teuthology.orchestra.run.smithi179.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T06:59:45.232 INFO:teuthology.orchestra.run.smithi179.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T06:59:45.232 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T06:59:45.232 INFO:teuthology.orchestra.run.smithi179.stdout:Installing dependencies: 2024-09-19T06:59:45.232 INFO:teuthology.orchestra.run.smithi179.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T06:59:45.232 INFO:teuthology.orchestra.run.smithi179.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T06:59:45.232 INFO:teuthology.orchestra.run.smithi179.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T06:59:45.233 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T06:59:45.233 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T06:59:45.233 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T06:59:45.233 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T06:59:45.233 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T06:59:45.233 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T06:59:45.233 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T06:59:45.233 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T06:59:45.233 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T06:59:45.233 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T06:59:45.233 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T06:59:45.233 INFO:teuthology.orchestra.run.smithi179.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T06:59:45.233 INFO:teuthology.orchestra.run.smithi179.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T06:59:45.234 INFO:teuthology.orchestra.run.smithi179.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T06:59:45.234 INFO:teuthology.orchestra.run.smithi179.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T06:59:45.234 INFO:teuthology.orchestra.run.smithi179.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T06:59:45.234 INFO:teuthology.orchestra.run.smithi179.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T06:59:45.234 INFO:teuthology.orchestra.run.smithi179.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T06:59:45.234 INFO:teuthology.orchestra.run.smithi179.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T06:59:45.234 INFO:teuthology.orchestra.run.smithi179.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T06:59:45.234 INFO:teuthology.orchestra.run.smithi179.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T06:59:45.234 INFO:teuthology.orchestra.run.smithi179.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T06:59:45.234 INFO:teuthology.orchestra.run.smithi179.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T06:59:45.235 INFO:teuthology.orchestra.run.smithi179.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T06:59:45.235 INFO:teuthology.orchestra.run.smithi179.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T06:59:45.235 INFO:teuthology.orchestra.run.smithi179.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T06:59:45.235 INFO:teuthology.orchestra.run.smithi179.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T06:59:45.235 INFO:teuthology.orchestra.run.smithi179.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T06:59:45.235 INFO:teuthology.orchestra.run.smithi179.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T06:59:45.235 INFO:teuthology.orchestra.run.smithi179.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T06:59:45.235 INFO:teuthology.orchestra.run.smithi179.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T06:59:45.235 INFO:teuthology.orchestra.run.smithi179.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T06:59:45.235 INFO:teuthology.orchestra.run.smithi179.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T06:59:45.235 INFO:teuthology.orchestra.run.smithi179.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T06:59:45.235 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T06:59:45.235 INFO:teuthology.orchestra.run.smithi179.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T06:59:45.236 INFO:teuthology.orchestra.run.smithi179.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T06:59:45.236 INFO:teuthology.orchestra.run.smithi179.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T06:59:45.236 INFO:teuthology.orchestra.run.smithi179.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T06:59:45.236 INFO:teuthology.orchestra.run.smithi179.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T06:59:45.236 INFO:teuthology.orchestra.run.smithi179.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T06:59:45.236 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T06:59:45.236 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T06:59:45.236 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T06:59:45.236 INFO:teuthology.orchestra.run.smithi179.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T06:59:45.236 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T06:59:45.236 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T06:59:45.236 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T06:59:45.236 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T06:59:45.237 INFO:teuthology.orchestra.run.smithi179.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T06:59:45.237 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T06:59:45.237 INFO:teuthology.orchestra.run.smithi179.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T06:59:45.237 INFO:teuthology.orchestra.run.smithi179.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T06:59:45.237 INFO:teuthology.orchestra.run.smithi179.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T06:59:45.237 INFO:teuthology.orchestra.run.smithi179.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T06:59:45.237 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T06:59:45.237 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T06:59:45.237 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T06:59:45.237 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T06:59:45.237 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T06:59:45.237 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T06:59:45.237 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T06:59:45.238 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T06:59:45.238 INFO:teuthology.orchestra.run.smithi179.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T06:59:45.238 INFO:teuthology.orchestra.run.smithi179.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T06:59:45.238 INFO:teuthology.orchestra.run.smithi179.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T06:59:45.238 INFO:teuthology.orchestra.run.smithi179.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T06:59:45.238 INFO:teuthology.orchestra.run.smithi179.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T06:59:45.239 INFO:teuthology.orchestra.run.smithi179.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T06:59:45.239 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T06:59:45.239 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T06:59:45.239 INFO:teuthology.orchestra.run.smithi179.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T06:59:45.239 INFO:teuthology.orchestra.run.smithi179.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T06:59:45.239 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T06:59:45.239 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T06:59:45.239 INFO:teuthology.orchestra.run.smithi179.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T06:59:45.239 INFO:teuthology.orchestra.run.smithi179.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T06:59:45.239 INFO:teuthology.orchestra.run.smithi179.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T06:59:45.240 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T06:59:45.240 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T06:59:45.240 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T06:59:45.240 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T06:59:45.240 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T06:59:45.241 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T06:59:45.241 INFO:teuthology.orchestra.run.smithi179.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T06:59:45.241 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T06:59:45.241 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T06:59:45.241 INFO:teuthology.orchestra.run.smithi179.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T06:59:45.241 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T06:59:45.241 INFO:teuthology.orchestra.run.smithi179.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T06:59:45.241 INFO:teuthology.orchestra.run.smithi179.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T06:59:45.241 INFO:teuthology.orchestra.run.smithi179.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T06:59:45.242 INFO:teuthology.orchestra.run.smithi179.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T06:59:45.242 INFO:teuthology.orchestra.run.smithi179.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T06:59:45.242 INFO:teuthology.orchestra.run.smithi179.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T06:59:45.242 INFO:teuthology.orchestra.run.smithi179.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T06:59:45.242 INFO:teuthology.orchestra.run.smithi179.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T06:59:45.242 INFO:teuthology.orchestra.run.smithi179.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T06:59:45.242 INFO:teuthology.orchestra.run.smithi179.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T06:59:45.242 INFO:teuthology.orchestra.run.smithi179.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T06:59:45.242 INFO:teuthology.orchestra.run.smithi179.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T06:59:45.242 INFO:teuthology.orchestra.run.smithi179.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T06:59:45.242 INFO:teuthology.orchestra.run.smithi179.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T06:59:45.242 INFO:teuthology.orchestra.run.smithi179.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T06:59:45.242 INFO:teuthology.orchestra.run.smithi179.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T06:59:45.242 INFO:teuthology.orchestra.run.smithi179.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T06:59:45.243 INFO:teuthology.orchestra.run.smithi179.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T06:59:45.243 INFO:teuthology.orchestra.run.smithi179.stdout:Installing weak dependencies: 2024-09-19T06:59:45.243 INFO:teuthology.orchestra.run.smithi179.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T06:59:45.243 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-19T06:59:45.243 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction Summary 2024-09-19T06:59:45.243 INFO:teuthology.orchestra.run.smithi179.stdout:====================================================================================== 2024-09-19T06:59:45.243 INFO:teuthology.orchestra.run.smithi179.stdout:Install 148 Packages 2024-09-19T06:59:45.243 INFO:teuthology.orchestra.run.smithi179.stdout:Upgrade 8 Packages 2024-09-19T06:59:45.243 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-19T06:59:45.244 INFO:teuthology.orchestra.run.smithi148.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 552 kB/s | 23 kB 00:00 2024-09-19T06:59:45.244 INFO:teuthology.orchestra.run.smithi165.stdout:(22/156): python3-cephfs-19.1.1-361.g2f599a46.e 346 kB/s | 161 kB 00:00 2024-09-19T06:59:45.244 INFO:teuthology.orchestra.run.smithi179.stdout:Total download size: 226 M 2024-09-19T06:59:45.245 INFO:teuthology.orchestra.run.smithi179.stdout:Downloading Packages: 2024-09-19T06:59:45.254 INFO:teuthology.orchestra.run.smithi165.stdout:(23/156): python3-rados-19.1.1-361.g2f599a46.el 6.3 MB/s | 320 kB 00:00 2024-09-19T06:59:45.260 INFO:teuthology.orchestra.run.smithi148.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-09-19T06:59:45.280 INFO:teuthology.orchestra.run.smithi165.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 5.8 MB/s | 300 kB 00:00 2024-09-19T06:59:45.286 INFO:teuthology.orchestra.run.smithi148.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-19T06:59:45.305 INFO:teuthology.orchestra.run.smithi165.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.9 MB/s | 99 kB 00:00 2024-09-19T06:59:45.311 INFO:teuthology.orchestra.run.smithi148.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T06:59:45.330 INFO:teuthology.orchestra.run.smithi165.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-19T06:59:45.353 INFO:teuthology.orchestra.run.smithi148.stdout:(130/156): python3-kubernetes-26.1.0-2.el9.noar 11 MB/s | 1.0 MB 00:00 2024-09-19T06:59:45.378 INFO:teuthology.orchestra.run.smithi148.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2024-09-19T06:59:45.397 INFO:teuthology.orchestra.run.smithi165.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 2.5 MB/s | 171 kB 00:00 2024-09-19T06:59:45.403 INFO:teuthology.orchestra.run.smithi148.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-19T06:59:45.429 INFO:teuthology.orchestra.run.smithi148.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 654 kB/s | 16 kB 00:00 2024-09-19T06:59:45.454 INFO:teuthology.orchestra.run.smithi148.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-19T06:59:45.473 INFO:teuthology.orchestra.run.smithi165.stdout:(28/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 19 MB/s | 3.1 MB 00:00 2024-09-19T06:59:45.479 INFO:teuthology.orchestra.run.smithi148.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-19T06:59:45.489 INFO:teuthology.orchestra.run.smithi165.stdout:(29/156): ceph-grafana-dashboards-19.1.1-361.g2 347 kB/s | 32 kB 00:00 2024-09-19T06:59:45.496 INFO:teuthology.orchestra.run.smithi148.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 676 kB/s | 28 kB 00:00 2024-09-19T06:59:45.524 INFO:teuthology.orchestra.run.smithi165.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 2.8 MB/s | 146 kB 00:00 2024-09-19T06:59:45.546 INFO:teuthology.orchestra.run.smithi148.stdout:(137/156): python3-grpcio-1.46.7-10.el9.x86_64. 4.5 MB/s | 2.0 MB 00:00 2024-09-19T06:59:45.572 INFO:teuthology.orchestra.run.smithi148.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 409 kB/s | 31 kB 00:00 2024-09-19T06:59:45.597 INFO:teuthology.orchestra.run.smithi148.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-19T06:59:45.622 INFO:teuthology.orchestra.run.smithi148.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-09-19T06:59:45.664 INFO:teuthology.orchestra.run.smithi148.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.1 MB/s | 188 kB 00:00 2024-09-19T06:59:45.673 INFO:teuthology.orchestra.run.smithi165.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 19 MB/s | 3.6 MB 00:00 2024-09-19T06:59:45.689 INFO:teuthology.orchestra.run.smithi148.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 806 kB/s | 74 kB 00:00 2024-09-19T06:59:45.715 INFO:teuthology.orchestra.run.smithi148.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-19T06:59:45.724 INFO:teuthology.orchestra.run.smithi165.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 4.9 MB/s | 249 kB 00:00 2024-09-19T06:59:45.740 INFO:teuthology.orchestra.run.smithi148.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-19T06:59:45.757 INFO:teuthology.orchestra.run.smithi148.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 478 kB/s | 20 kB 00:00 2024-09-19T06:59:45.782 INFO:teuthology.orchestra.run.smithi148.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-19T06:59:45.808 INFO:teuthology.orchestra.run.smithi148.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.5 MB/s | 427 kB 00:00 2024-09-19T06:59:45.816 INFO:teuthology.orchestra.run.smithi165.stdout:(33/156): ceph-mgr-diskprediction-local-19.1.1- 25 MB/s | 7.4 MB 00:00 2024-09-19T06:59:45.841 INFO:teuthology.orchestra.run.smithi165.stdout:(34/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 422 kB/s | 49 kB 00:00 2024-09-19T06:59:45.857 INFO:teuthology.orchestra.run.smithi148.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-19T06:59:45.866 INFO:teuthology.orchestra.run.smithi165.stdout:(35/156): ceph-prometheus-alerts-19.1.1-361.g2f 329 kB/s | 16 kB 00:00 2024-09-19T06:59:45.892 INFO:teuthology.orchestra.run.smithi165.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 5.6 MB/s | 285 kB 00:00 2024-09-19T06:59:45.926 INFO:teuthology.orchestra.run.smithi165.stdout:(37/156): cephadm-19.1.1-361.g2f599a46.el9.noar 13 MB/s | 765 kB 00:00 2024-09-19T06:59:45.951 INFO:teuthology.orchestra.run.smithi165.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 311 kB/s | 18 kB 00:00 2024-09-19T06:59:46.128 INFO:teuthology.orchestra.run.smithi148.stdout:(149/156): librbd1-19.1.1-361.g2f599a46.el9.x86 9.9 MB/s | 3.2 MB 00:00 2024-09-19T06:59:46.176 INFO:teuthology.orchestra.run.smithi165.stdout:(39/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 5.6 MB/s | 17 MB 00:03 2024-09-19T06:59:46.200 INFO:teuthology.orchestra.run.smithi148.stdout:(150/156): librados2-19.1.1-361.g2f599a46.el9.x 8.2 MB/s | 3.4 MB 00:00 2024-09-19T06:59:46.201 INFO:teuthology.orchestra.run.smithi179.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 56 kB/s | 6.6 kB 00:00 2024-09-19T06:59:46.210 INFO:teuthology.orchestra.run.smithi165.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 281 kB/s | 80 kB 00:00 2024-09-19T06:59:46.267 INFO:teuthology.orchestra.run.smithi148.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 613 kB/s | 41 kB 00:00 2024-09-19T06:59:46.318 INFO:teuthology.orchestra.run.smithi165.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-09-19T06:59:46.348 INFO:teuthology.orchestra.run.smithi165.stdout:(42/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 191 kB 00:00 2024-09-19T06:59:46.359 INFO:teuthology.orchestra.run.smithi148.stdout:(152/156): NetworkManager-1.51.0-1.el9.x86_64.r 4.6 MB/s | 2.3 MB 00:00 2024-09-19T06:59:46.384 INFO:teuthology.orchestra.run.smithi148.stdout:(153/156): NetworkManager-tui-1.51.0-1.el9.x86_ 2.1 MB/s | 249 kB 00:00 2024-09-19T06:59:46.398 INFO:teuthology.orchestra.run.smithi165.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-19T06:59:46.435 INFO:teuthology.orchestra.run.smithi179.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 3.7 MB/s | 896 kB 00:00 2024-09-19T06:59:46.440 INFO:teuthology.orchestra.run.smithi165.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 10 MB/s | 1.2 MB 00:00 2024-09-19T06:59:46.474 INFO:teuthology.orchestra.run.smithi165.stdout:(45/156): libgfortran-11.5.0-2.el9.x86_64.rpm 1.5 MB/s | 801 kB 00:00 2024-09-19T06:59:46.499 INFO:teuthology.orchestra.run.smithi165.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 1.3 MB/s | 135 kB 00:00 2024-09-19T06:59:46.518 INFO:teuthology.orchestra.run.smithi179.stdout:(3/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 12 MB/s | 5.4 MB 00:00 2024-09-19T06:59:46.525 INFO:teuthology.orchestra.run.smithi165.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-09-19T06:59:46.544 INFO:teuthology.orchestra.run.smithi179.stdout:(4/156): ceph-immutable-object-cache-19.1.1-361 1.3 MB/s | 145 kB 00:00 2024-09-19T06:59:46.551 INFO:teuthology.orchestra.run.smithi148.stdout:(154/156): NetworkManager-libnm-1.51.0-1.el9.x8 4.3 MB/s | 1.8 MB 00:00 2024-09-19T06:59:46.575 INFO:teuthology.orchestra.run.smithi165.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.1 MB/s | 215 kB 00:00 2024-09-19T06:59:46.609 INFO:teuthology.orchestra.run.smithi165.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 6.2 MB/s | 689 kB 00:00 2024-09-19T06:59:46.651 INFO:teuthology.orchestra.run.smithi165.stdout:(50/156): bison-3.7.4-5.el9.x86_64.rpm 7.3 MB/s | 943 kB 00:00 2024-09-19T06:59:46.668 INFO:teuthology.orchestra.run.smithi165.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 369 kB/s | 22 kB 00:00 2024-09-19T06:59:46.669 INFO:teuthology.orchestra.run.smithi179.stdout:(5/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 16 MB/s | 2.4 MB 00:00 2024-09-19T06:59:46.693 INFO:teuthology.orchestra.run.smithi165.stdout:(52/156): boost-program-options-1.75.0-8.el9.x8 908 kB/s | 107 kB 00:00 2024-09-19T06:59:46.710 INFO:teuthology.orchestra.run.smithi165.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 782 kB/s | 33 kB 00:00 2024-09-19T06:59:46.711 INFO:teuthology.orchestra.run.smithi179.stdout:(6/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 9.1 MB/s | 1.5 MB 00:00 2024-09-19T06:59:46.736 INFO:teuthology.orchestra.run.smithi165.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 3.6 MB/s | 313 kB 00:00 2024-09-19T06:59:46.752 INFO:teuthology.orchestra.run.smithi165.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 434 kB/s | 18 kB 00:00 2024-09-19T06:59:46.769 INFO:teuthology.orchestra.run.smithi165.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 331 kB/s | 11 kB 00:00 2024-09-19T06:59:46.802 INFO:teuthology.orchestra.run.smithi148.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 3.1 MB/s | 1.4 MB 00:00 2024-09-19T06:59:46.803 INFO:teuthology.orchestra.run.smithi165.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-19T06:59:46.828 INFO:teuthology.orchestra.run.smithi165.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 774 kB/s | 45 kB 00:00 2024-09-19T06:59:46.870 INFO:teuthology.orchestra.run.smithi165.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-09-19T06:59:46.903 INFO:teuthology.orchestra.run.smithi165.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 7.5 MB/s | 581 kB 00:00 2024-09-19T06:59:46.928 INFO:teuthology.orchestra.run.smithi179.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 18 MB/s | 4.7 MB 00:00 2024-09-19T06:59:46.929 INFO:teuthology.orchestra.run.smithi165.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 418 kB/s | 24 kB 00:00 2024-09-19T06:59:46.954 INFO:teuthology.orchestra.run.smithi165.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-09-19T06:59:46.979 INFO:teuthology.orchestra.run.smithi165.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-19T06:59:47.014 INFO:teuthology.orchestra.run.smithi165.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2024-09-19T06:59:47.027 INFO:teuthology.orchestra.run.smithi148.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 3.7 MB/s | 2.4 MB 00:00 2024-09-19T06:59:47.033 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:59:47.033 INFO:teuthology.orchestra.run.smithi148.stdout:Total 24 MB/s | 226 MB 00:09 2024-09-19T06:59:47.038 INFO:teuthology.orchestra.run.smithi165.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 654 kB/s | 38 kB 00:00 2024-09-19T06:59:47.156 INFO:teuthology.orchestra.run.smithi165.stdout:(66/156): openblas-openmp-0.3.26-2.el9.x86_64.r 35 MB/s | 4.9 MB 00:00 2024-09-19T06:59:47.231 INFO:teuthology.orchestra.run.smithi165.stdout:(67/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 23 MB/s | 4.4 MB 00:00 2024-09-19T06:59:47.281 INFO:teuthology.orchestra.run.smithi165.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-19T06:59:47.331 INFO:teuthology.orchestra.run.smithi165.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 8.9 MB/s | 910 kB 00:00 2024-09-19T06:59:47.353 INFO:teuthology.orchestra.run.smithi179.stdout:(8/156): ceph-common-19.1.1-361.g2f599a46.el9.x 17 MB/s | 21 MB 00:01 2024-09-19T06:59:47.366 INFO:teuthology.orchestra.run.smithi165.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.6 MB/s | 137 kB 00:00 2024-09-19T06:59:47.403 INFO:teuthology.orchestra.run.smithi179.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 506 kB/s | 25 kB 00:00 2024-09-19T06:59:47.441 INFO:teuthology.orchestra.run.smithi165.stdout:(71/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.0 MB/s | 3.0 MB 00:00 2024-09-19T06:59:47.482 INFO:teuthology.orchestra.run.smithi165.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 8.6 MB/s | 1.0 MB 00:00 2024-09-19T06:59:47.508 INFO:teuthology.orchestra.run.smithi165.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-19T06:59:47.583 INFO:teuthology.orchestra.run.smithi165.stdout:(74/156): postgresql-server-13.16-1.el9.x86_64. 23 MB/s | 5.8 MB 00:00 2024-09-19T06:59:47.608 INFO:teuthology.orchestra.run.smithi165.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 612 kB/s | 61 kB 00:00 2024-09-19T06:59:47.634 INFO:teuthology.orchestra.run.smithi165.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 4.8 MB/s | 245 kB 00:00 2024-09-19T06:59:47.654 INFO:teuthology.orchestra.run.smithi179.stdout:(10/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 18 MB/s | 17 MB 00:00 2024-09-19T06:59:47.676 INFO:teuthology.orchestra.run.smithi165.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 614 kB/s | 26 kB 00:00 2024-09-19T06:59:47.701 INFO:teuthology.orchestra.run.smithi165.stdout:(78/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.6 MB/s | 248 kB 00:00 2024-09-19T06:59:47.703 INFO:teuthology.orchestra.run.smithi179.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 4.5 MB/s | 228 kB 00:00 2024-09-19T06:59:47.729 INFO:teuthology.orchestra.run.smithi165.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 383 kB/s | 19 kB 00:00 2024-09-19T06:59:47.763 INFO:teuthology.orchestra.run.smithi179.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 464 kB/s | 27 kB 00:00 2024-09-19T06:59:47.793 INFO:teuthology.orchestra.run.smithi165.stdout:(80/156): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 6.0 MB 00:00 2024-09-19T06:59:47.818 INFO:teuthology.orchestra.run.smithi165.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 378 kB/s | 35 kB 00:00 2024-09-19T06:59:47.821 INFO:teuthology.orchestra.run.smithi179.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 545 kB/s | 32 kB 00:00 2024-09-19T06:59:47.843 INFO:teuthology.orchestra.run.smithi165.stdout:(82/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.2 MB/s | 172 kB 00:00 2024-09-19T06:59:47.869 INFO:teuthology.orchestra.run.smithi165.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.9 MB/s | 250 kB 00:00 2024-09-19T06:59:47.896 INFO:teuthology.orchestra.run.smithi179.stdout:(14/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 9.8 MB/s | 751 kB 00:00 2024-09-19T06:59:47.911 INFO:teuthology.orchestra.run.smithi165.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.8 MB/s | 77 kB 00:00 2024-09-19T06:59:47.936 INFO:teuthology.orchestra.run.smithi165.stdout:(85/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.3 MB/s | 222 kB 00:00 2024-09-19T06:59:47.953 INFO:teuthology.orchestra.run.smithi165.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-19T06:59:47.971 INFO:teuthology.orchestra.run.smithi179.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 2.1 MB/s | 163 kB 00:00 2024-09-19T06:59:48.020 INFO:teuthology.orchestra.run.smithi165.stdout:(87/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 22 MB/s | 5.1 MB 00:00 2024-09-19T06:59:48.038 INFO:teuthology.orchestra.run.smithi179.stdout:(16/156): librados-devel-19.1.1-361.g2f599a46.e 1.9 MB/s | 127 kB 00:00 2024-09-19T06:59:48.045 INFO:teuthology.orchestra.run.smithi165.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 159 kB 00:00 2024-09-19T06:59:48.071 INFO:teuthology.orchestra.run.smithi165.stdout:(89/156): python3-protobuf-3.14.0-13.el9.noarch 2.0 MB/s | 269 kB 00:00 2024-09-19T06:59:48.096 INFO:teuthology.orchestra.run.smithi165.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-19T06:59:48.114 INFO:teuthology.orchestra.run.smithi179.stdout:(17/156): libradosstriper1-19.1.1-361.g2f599a46 6.6 MB/s | 506 kB 00:00 2024-09-19T06:59:48.138 INFO:teuthology.orchestra.run.smithi165.stdout:(91/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 279 kB 00:00 2024-09-19T06:59:48.164 INFO:teuthology.orchestra.run.smithi165.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 581 kB/s | 54 kB 00:00 2024-09-19T06:59:48.446 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-19T06:59:48.446 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-19T06:59:48.446 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-19T06:59:48.447 INFO:teuthology.orchestra.run.smithi179.stdout:(18/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 8.2 MB/s | 11 MB 00:01 2024-09-19T06:59:48.447 INFO:teuthology.orchestra.run.smithi179.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 679 kB/s | 45 kB 00:00 2024-09-19T06:59:48.447 INFO:teuthology.orchestra.run.smithi179.stdout:(20/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 20 MB/s | 5.3 MB 00:00 2024-09-19T06:59:48.447 INFO:teuthology.orchestra.run.smithi179.stdout:(21/156): python3-ceph-common-19.1.1-361.g2f599 1.1 MB/s | 136 kB 00:00 2024-09-19T06:59:48.447 INFO:teuthology.orchestra.run.smithi179.stdout:(22/156): python3-cephfs-19.1.1-361.g2f599a46.e 2.7 MB/s | 161 kB 00:00 2024-09-19T06:59:48.448 INFO:teuthology.orchestra.run.smithi165.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 830 kB/s | 42 kB 00:00 2024-09-19T06:59:48.448 INFO:teuthology.orchestra.run.smithi165.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 753 kB/s | 44 kB 00:00 2024-09-19T06:59:48.449 INFO:teuthology.orchestra.run.smithi165.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-19T06:59:48.449 INFO:teuthology.orchestra.run.smithi165.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 713 kB/s | 36 kB 00:00 2024-09-19T06:59:48.449 INFO:teuthology.orchestra.run.smithi165.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-09-19T06:59:48.449 INFO:teuthology.orchestra.run.smithi165.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2024-09-19T06:59:48.449 INFO:teuthology.orchestra.run.smithi165.stdout:(99/156): socat-1.7.4.1-6.el9.x86_64.rpm 3.2 MB/s | 304 kB 00:00 2024-09-19T06:59:48.449 INFO:teuthology.orchestra.run.smithi165.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-19T06:59:48.449 INFO:teuthology.orchestra.run.smithi165.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-19T06:59:48.449 INFO:teuthology.orchestra.run.smithi165.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 888 kB/s | 45 kB 00:00 2024-09-19T06:59:48.475 INFO:teuthology.orchestra.run.smithi179.stdout:(23/156): python3-rados-19.1.1-361.g2f599a46.el 4.6 MB/s | 320 kB 00:00 2024-09-19T06:59:48.500 INFO:teuthology.orchestra.run.smithi179.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 5.0 MB/s | 300 kB 00:00 2024-09-19T06:59:48.517 INFO:teuthology.orchestra.run.smithi165.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 222 kB/s | 22 kB 00:00 2024-09-19T06:59:48.525 INFO:teuthology.orchestra.run.smithi179.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.9 MB/s | 99 kB 00:00 2024-09-19T06:59:48.550 INFO:teuthology.orchestra.run.smithi179.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-19T06:59:48.568 INFO:teuthology.orchestra.run.smithi165.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-19T06:59:48.600 INFO:teuthology.orchestra.run.smithi179.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 3.3 MB/s | 171 kB 00:00 2024-09-19T06:59:48.610 INFO:teuthology.orchestra.run.smithi165.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 7.2 MB/s | 308 kB 00:00 2024-09-19T06:59:48.635 INFO:teuthology.orchestra.run.smithi165.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 781 kB/s | 19 kB 00:00 2024-09-19T06:59:48.668 INFO:teuthology.orchestra.run.smithi179.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 478 kB/s | 32 kB 00:00 2024-09-19T06:59:48.668 INFO:teuthology.orchestra.run.smithi165.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.7 MB/s | 863 kB 00:00 2024-09-19T06:59:48.759 INFO:teuthology.orchestra.run.smithi179.stdout:(29/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 13 MB/s | 3.1 MB 00:00 2024-09-19T06:59:48.785 INFO:teuthology.orchestra.run.smithi179.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 1.2 MB/s | 146 kB 00:00 2024-09-19T06:59:48.844 INFO:teuthology.orchestra.run.smithi165.stdout:(108/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 22 MB/s | 16 MB 00:00 2024-09-19T06:59:48.869 INFO:teuthology.orchestra.run.smithi165.stdout:(109/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 130 kB/s | 26 kB 00:00 2024-09-19T06:59:48.911 INFO:teuthology.orchestra.run.smithi165.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.9 MB/s | 67 kB 00:00 2024-09-19T06:59:48.953 INFO:teuthology.orchestra.run.smithi165.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 3.7 MB/s | 151 kB 00:00 2024-09-19T06:59:48.978 INFO:teuthology.orchestra.run.smithi165.stdout:(112/156): liboath-2.6.7-2.el9.x86_64.rpm 363 kB/s | 49 kB 00:00 2024-09-19T06:59:49.020 INFO:teuthology.orchestra.run.smithi165.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-09-19T06:59:49.045 INFO:teuthology.orchestra.run.smithi165.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T06:59:49.071 INFO:teuthology.orchestra.run.smithi165.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-19T06:59:49.096 INFO:teuthology.orchestra.run.smithi165.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 566 kB/s | 14 kB 00:00 2024-09-19T06:59:49.130 INFO:teuthology.orchestra.run.smithi165.stdout:(117/156): python3-asyncssh-2.13.2-5.el9.noarch 3.5 MB/s | 548 kB 00:00 2024-09-19T06:59:49.143 INFO:teuthology.orchestra.run.smithi179.stdout:(31/156): ceph-mgr-diskprediction-local-19.1.1- 21 MB/s | 7.4 MB 00:00 2024-09-19T06:59:49.164 INFO:teuthology.orchestra.run.smithi165.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.5 MB/s | 172 kB 00:00 2024-09-19T06:59:49.202 INFO:teuthology.orchestra.run.smithi179.stdout:(32/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 8.1 MB/s | 3.6 MB 00:00 2024-09-19T06:59:49.227 INFO:teuthology.orchestra.run.smithi179.stdout:(33/156): ceph-mgr-modules-core-19.1.1-361.g2f5 2.9 MB/s | 249 kB 00:00 2024-09-19T06:59:49.238 INFO:teuthology.orchestra.run.smithi165.stdout:(119/156): libarrow-9.0.0-11.el9.x86_64.rpm 7.3 MB/s | 4.4 MB 00:00 2024-09-19T06:59:49.252 INFO:teuthology.orchestra.run.smithi179.stdout:(34/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 985 kB/s | 49 kB 00:00 2024-09-19T06:59:49.264 INFO:teuthology.orchestra.run.smithi165.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 2.6 MB/s | 358 kB 00:00 2024-09-19T06:59:49.277 INFO:teuthology.orchestra.run.smithi179.stdout:(35/156): ceph-prometheus-alerts-19.1.1-361.g2f 327 kB/s | 16 kB 00:00 2024-09-19T06:59:49.298 INFO:teuthology.orchestra.run.smithi165.stdout:(121/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.2 MB/s | 303 kB 00:00 2024-09-19T06:59:49.303 INFO:teuthology.orchestra.run.smithi179.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 5.6 MB/s | 285 kB 00:00 2024-09-19T06:59:49.323 INFO:teuthology.orchestra.run.smithi165.stdout:(122/156): python3-google-auth-2.34.0-1.el9.noa 2.6 MB/s | 220 kB 00:00 2024-09-19T06:59:49.336 INFO:teuthology.orchestra.run.smithi179.stdout:(37/156): cephadm-19.1.1-361.g2f599a46.el9.noar 13 MB/s | 765 kB 00:00 2024-09-19T06:59:49.348 INFO:teuthology.orchestra.run.smithi165.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-09-19T06:59:49.353 INFO:teuthology.orchestra.run.smithi179.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 365 kB/s | 18 kB 00:00 2024-09-19T06:59:49.365 INFO:teuthology.orchestra.run.smithi165.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 255 kB/s | 11 kB 00:00 2024-09-19T06:59:49.382 INFO:teuthology.orchestra.run.smithi165.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 528 kB/s | 18 kB 00:00 2024-09-19T06:59:49.407 INFO:teuthology.orchestra.run.smithi165.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 554 kB/s | 23 kB 00:00 2024-09-19T06:59:49.433 INFO:teuthology.orchestra.run.smithi165.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-09-19T06:59:49.458 INFO:teuthology.orchestra.run.smithi165.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-19T06:59:49.483 INFO:teuthology.orchestra.run.smithi165.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T06:59:49.517 INFO:teuthology.orchestra.run.smithi165.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-19T06:59:49.542 INFO:teuthology.orchestra.run.smithi165.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-19T06:59:49.576 INFO:teuthology.orchestra.run.smithi165.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-09-19T06:59:49.601 INFO:teuthology.orchestra.run.smithi165.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 4.6 MB/s | 272 kB 00:00 2024-09-19T06:59:49.626 INFO:teuthology.orchestra.run.smithi165.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 328 kB/s | 16 kB 00:00 2024-09-19T06:59:49.652 INFO:teuthology.orchestra.run.smithi165.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-19T06:59:49.677 INFO:teuthology.orchestra.run.smithi165.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-19T06:59:49.703 INFO:teuthology.orchestra.run.smithi165.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-09-19T06:59:49.728 INFO:teuthology.orchestra.run.smithi165.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-19T06:59:49.822 INFO:teuthology.orchestra.run.smithi179.stdout:(39/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 20 MB/s | 49 MB 00:02 2024-09-19T06:59:49.847 INFO:teuthology.orchestra.run.smithi179.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 156 kB/s | 80 kB 00:00 2024-09-19T06:59:49.853 INFO:teuthology.orchestra.run.smithi165.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 1.0 MB/s | 188 kB 00:00 2024-09-19T06:59:49.878 INFO:teuthology.orchestra.run.smithi165.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 238 kB/s | 36 kB 00:00 2024-09-19T06:59:49.921 INFO:teuthology.orchestra.run.smithi165.stdout:(141/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.1 MB/s | 2.0 MB 00:00 2024-09-19T06:59:49.939 INFO:teuthology.orchestra.run.smithi179.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-09-19T06:59:49.946 INFO:teuthology.orchestra.run.smithi165.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 1.1 MB/s | 74 kB 00:00 2024-09-19T06:59:49.964 INFO:teuthology.orchestra.run.smithi179.stdout:(42/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 191 kB 00:00 2024-09-19T06:59:49.979 INFO:teuthology.orchestra.run.smithi165.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-09-19T06:59:49.998 INFO:teuthology.orchestra.run.smithi179.stdout:(43/156): libgfortran-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 801 kB 00:00 2024-09-19T06:59:50.005 INFO:teuthology.orchestra.run.smithi165.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 806 kB/s | 20 kB 00:00 2024-09-19T06:59:50.023 INFO:teuthology.orchestra.run.smithi179.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-19T06:59:50.038 INFO:teuthology.orchestra.run.smithi165.stdout:(145/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.4 MB/s | 230 kB 00:00 2024-09-19T06:59:50.048 INFO:teuthology.orchestra.run.smithi179.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-19T06:59:50.064 INFO:teuthology.orchestra.run.smithi165.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-19T06:59:50.074 INFO:teuthology.orchestra.run.smithi179.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-19T06:59:50.098 INFO:teuthology.orchestra.run.smithi165.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-09-19T06:59:50.099 INFO:teuthology.orchestra.run.smithi179.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-19T06:59:50.141 INFO:teuthology.orchestra.run.smithi179.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 6.1 MB/s | 1.2 MB 00:00 2024-09-19T06:59:50.148 INFO:teuthology.orchestra.run.smithi165.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-19T06:59:50.183 INFO:teuthology.orchestra.run.smithi179.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 6.2 MB/s | 689 kB 00:00 2024-09-19T06:59:50.208 INFO:teuthology.orchestra.run.smithi179.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-09-19T06:59:50.231 INFO:teuthology.orchestra.run.smithi165.stdout:(149/156): NetworkManager-1.51.0-1.el9.x86_64.r 28 MB/s | 2.3 MB 00:00 2024-09-19T06:59:50.233 INFO:teuthology.orchestra.run.smithi179.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 432 kB/s | 22 kB 00:00 2024-09-19T06:59:50.267 INFO:teuthology.orchestra.run.smithi179.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 313 kB 00:00 2024-09-19T06:59:50.301 INFO:teuthology.orchestra.run.smithi179.stdout:(53/156): bison-3.7.4-5.el9.x86_64.rpm 4.6 MB/s | 943 kB 00:00 2024-09-19T06:59:50.315 INFO:teuthology.orchestra.run.smithi165.stdout:(150/156): NetworkManager-libnm-1.51.0-1.el9.x8 22 MB/s | 1.8 MB 00:00 2024-09-19T06:59:50.326 INFO:teuthology.orchestra.run.smithi179.stdout:(54/156): flexiblas-3.0.4-8.el9.x86_64.rpm 354 kB/s | 33 kB 00:00 2024-09-19T06:59:50.349 INFO:teuthology.orchestra.run.smithi165.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 1.2 MB/s | 41 kB 00:00 2024-09-19T06:59:50.351 INFO:teuthology.orchestra.run.smithi179.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 362 kB/s | 18 kB 00:00 2024-09-19T06:59:50.377 INFO:teuthology.orchestra.run.smithi179.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-19T06:59:50.399 INFO:teuthology.orchestra.run.smithi165.stdout:(152/156): NetworkManager-tui-1.51.0-1.el9.x86_ 4.9 MB/s | 249 kB 00:00 2024-09-19T06:59:50.402 INFO:teuthology.orchestra.run.smithi179.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-19T06:59:50.428 INFO:teuthology.orchestra.run.smithi179.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 901 kB/s | 45 kB 00:00 2024-09-19T06:59:50.449 INFO:teuthology.orchestra.run.smithi165.stdout:(153/156): librbd1-19.1.1-361.g2f599a46.el9.x86 9.0 MB/s | 3.2 MB 00:00 2024-09-19T06:59:50.461 INFO:teuthology.orchestra.run.smithi179.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-19T06:59:50.491 INFO:teuthology.orchestra.run.smithi165.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 15 MB/s | 1.4 MB 00:00 2024-09-19T06:59:50.503 INFO:teuthology.orchestra.run.smithi179.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 7.6 MB/s | 581 kB 00:00 2024-09-19T06:59:50.528 INFO:teuthology.orchestra.run.smithi179.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 365 kB/s | 24 kB 00:00 2024-09-19T06:59:50.554 INFO:teuthology.orchestra.run.smithi179.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 947 kB/s | 47 kB 00:00 2024-09-19T06:59:50.579 INFO:teuthology.orchestra.run.smithi179.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-19T06:59:50.604 INFO:teuthology.orchestra.run.smithi179.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-19T06:59:50.614 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-19T06:59:50.615 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-19T06:59:50.616 INFO:teuthology.orchestra.run.smithi165.stdout:(155/156): librados2-19.1.1-361.g2f599a46.el9.x 6.2 MB/s | 3.4 MB 00:00 2024-09-19T06:59:50.629 INFO:teuthology.orchestra.run.smithi179.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 769 kB/s | 38 kB 00:00 2024-09-19T06:59:50.696 INFO:teuthology.orchestra.run.smithi179.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.0 MB/s | 3.0 MB 00:00 2024-09-19T06:59:50.780 INFO:teuthology.orchestra.run.smithi179.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-19T06:59:50.817 INFO:teuthology.orchestra.run.smithi165.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 6.5 MB/s | 2.4 MB 00:00 2024-09-19T06:59:50.823 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:59:50.823 INFO:teuthology.orchestra.run.smithi165.stdout:Total 26 MB/s | 226 MB 00:08 2024-09-19T06:59:50.847 INFO:teuthology.orchestra.run.smithi179.stdout:(68/156): openblas-openmp-0.3.26-2.el9.x86_64.r 20 MB/s | 4.9 MB 00:00 2024-09-19T06:59:50.889 INFO:teuthology.orchestra.run.smithi179.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 8.2 MB/s | 910 kB 00:00 2024-09-19T06:59:50.914 INFO:teuthology.orchestra.run.smithi179.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-19T06:59:50.981 INFO:teuthology.orchestra.run.smithi179.stdout:(71/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-09-19T06:59:51.023 INFO:teuthology.orchestra.run.smithi179.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 9.3 MB/s | 1.0 MB 00:00 2024-09-19T06:59:51.048 INFO:teuthology.orchestra.run.smithi179.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-19T06:59:51.099 INFO:teuthology.orchestra.run.smithi179.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-19T06:59:51.174 INFO:teuthology.orchestra.run.smithi179.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 20 MB/s | 5.8 MB 00:00 2024-09-19T06:59:51.199 INFO:teuthology.orchestra.run.smithi179.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-19T06:59:51.224 INFO:teuthology.orchestra.run.smithi179.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-19T06:59:51.241 INFO:teuthology.orchestra.run.smithi179.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 613 kB/s | 26 kB 00:00 2024-09-19T06:59:51.275 INFO:teuthology.orchestra.run.smithi179.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-09-19T06:59:51.300 INFO:teuthology.orchestra.run.smithi179.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-19T06:59:51.317 INFO:teuthology.orchestra.run.smithi179.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 828 kB/s | 35 kB 00:00 2024-09-19T06:59:51.393 INFO:teuthology.orchestra.run.smithi179.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-19T06:59:51.418 INFO:teuthology.orchestra.run.smithi179.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.4 MB/s | 250 kB 00:00 2024-09-19T06:59:51.443 INFO:teuthology.orchestra.run.smithi179.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-19T06:59:51.469 INFO:teuthology.orchestra.run.smithi179.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-19T06:59:51.485 INFO:teuthology.orchestra.run.smithi179.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-19T06:59:51.511 INFO:teuthology.orchestra.run.smithi179.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 6.3 MB/s | 269 kB 00:00 2024-09-19T06:59:51.536 INFO:teuthology.orchestra.run.smithi179.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-19T06:59:51.561 INFO:teuthology.orchestra.run.smithi179.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-19T06:59:51.578 INFO:teuthology.orchestra.run.smithi179.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-19T06:59:51.595 INFO:teuthology.orchestra.run.smithi179.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.6 MB/s | 54 kB 00:00 2024-09-19T06:59:51.671 INFO:teuthology.orchestra.run.smithi179.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 14 MB/s | 5.1 MB 00:00 2024-09-19T06:59:51.687 INFO:teuthology.orchestra.run.smithi179.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 453 kB/s | 42 kB 00:00 2024-09-19T06:59:51.704 INFO:teuthology.orchestra.run.smithi179.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.3 MB/s | 44 kB 00:00 2024-09-19T06:59:51.729 INFO:teuthology.orchestra.run.smithi179.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 5.1 MB/s | 221 kB 00:00 2024-09-19T06:59:51.746 INFO:teuthology.orchestra.run.smithi179.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 858 kB/s | 36 kB 00:00 2024-09-19T06:59:51.763 INFO:teuthology.orchestra.run.smithi179.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-09-19T06:59:51.789 INFO:teuthology.orchestra.run.smithi179.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 7.1 MB/s | 304 kB 00:00 2024-09-19T06:59:51.805 INFO:teuthology.orchestra.run.smithi179.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.3 MB/s | 58 kB 00:00 2024-09-19T06:59:51.831 INFO:teuthology.orchestra.run.smithi179.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 2.2 MB/s | 96 kB 00:00 2024-09-19T06:59:51.848 INFO:teuthology.orchestra.run.smithi179.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-19T06:59:51.865 INFO:teuthology.orchestra.run.smithi179.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.3 MB/s | 45 kB 00:00 2024-09-19T06:59:51.957 INFO:teuthology.orchestra.run.smithi179.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 206 kB/s | 22 kB 00:00 2024-09-19T06:59:52.059 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-19T06:59:52.165 INFO:teuthology.orchestra.run.smithi179.stdout:(104/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 28 MB/s | 16 MB 00:00 2024-09-19T06:59:52.207 INFO:teuthology.orchestra.run.smithi179.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 2.1 MB/s | 548 kB 00:00 2024-09-19T06:59:52.211 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-19T06:59:52.211 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-19T06:59:52.241 INFO:teuthology.orchestra.run.smithi179.stdout:(106/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.2 MB/s | 863 kB 00:00 2024-09-19T06:59:52.266 INFO:teuthology.orchestra.run.smithi179.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 342 kB/s | 19 kB 00:00 2024-09-19T06:59:52.300 INFO:teuthology.orchestra.run.smithi179.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 987 kB/s | 26 kB 00:00 2024-09-19T06:59:52.325 INFO:teuthology.orchestra.run.smithi179.stdout:(109/156): gperftools-libs-2.9.1-3.el9.x86_64.r 1.9 MB/s | 308 kB 00:00 2024-09-19T06:59:52.359 INFO:teuthology.orchestra.run.smithi179.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 853 kB/s | 49 kB 00:00 2024-09-19T06:59:52.386 INFO:teuthology.orchestra.run.smithi179.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-09-19T06:59:52.410 INFO:teuthology.orchestra.run.smithi179.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-09-19T06:59:52.460 INFO:teuthology.orchestra.run.smithi179.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-19T06:59:52.485 INFO:teuthology.orchestra.run.smithi179.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T06:59:52.510 INFO:teuthology.orchestra.run.smithi179.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-19T06:59:52.536 INFO:teuthology.orchestra.run.smithi179.stdout:(116/156): python3-asyncssh-2.13.2-5.el9.noarch 4.3 MB/s | 548 kB 00:00 2024-09-19T06:59:52.561 INFO:teuthology.orchestra.run.smithi179.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-19T06:59:52.595 INFO:teuthology.orchestra.run.smithi179.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-19T06:59:52.628 INFO:teuthology.orchestra.run.smithi179.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-19T06:59:52.662 INFO:teuthology.orchestra.run.smithi179.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-09-19T06:59:52.687 INFO:teuthology.orchestra.run.smithi179.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-19T06:59:52.721 INFO:teuthology.orchestra.run.smithi179.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-19T06:59:52.738 INFO:teuthology.orchestra.run.smithi179.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 647 kB/s | 11 kB 00:00 2024-09-19T06:59:52.763 INFO:teuthology.orchestra.run.smithi179.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 707 kB/s | 18 kB 00:00 2024-09-19T06:59:52.788 INFO:teuthology.orchestra.run.smithi179.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 927 kB/s | 23 kB 00:00 2024-09-19T06:59:52.813 INFO:teuthology.orchestra.run.smithi179.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 783 kB/s | 19 kB 00:00 2024-09-19T06:59:52.856 INFO:teuthology.orchestra.run.smithi179.stdout:(127/156): python3-grpcio-1.46.7-10.el9.x86_64. 11 MB/s | 2.0 MB 00:00 2024-09-19T06:59:52.881 INFO:teuthology.orchestra.run.smithi179.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 293 kB/s | 20 kB 00:00 2024-09-19T06:59:52.948 INFO:teuthology.orchestra.run.smithi179.stdout:(129/156): libarrow-9.0.0-11.el9.x86_64.rpm 6.2 MB/s | 4.4 MB 00:00 2024-09-19T06:59:52.973 INFO:teuthology.orchestra.run.smithi179.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 504 kB/s | 46 kB 00:00 2024-09-19T06:59:52.998 INFO:teuthology.orchestra.run.smithi179.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-09-19T06:59:53.024 INFO:teuthology.orchestra.run.smithi179.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-19T06:59:53.049 INFO:teuthology.orchestra.run.smithi179.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 662 kB/s | 16 kB 00:00 2024-09-19T06:59:53.083 INFO:teuthology.orchestra.run.smithi179.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-19T06:59:53.108 INFO:teuthology.orchestra.run.smithi179.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-19T06:59:53.133 INFO:teuthology.orchestra.run.smithi179.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-09-19T06:59:53.158 INFO:teuthology.orchestra.run.smithi179.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-09-19T06:59:53.184 INFO:teuthology.orchestra.run.smithi179.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-19T06:59:53.209 INFO:teuthology.orchestra.run.smithi179.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-19T06:59:53.235 INFO:teuthology.orchestra.run.smithi179.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 710 kB/s | 36 kB 00:00 2024-09-19T06:59:53.268 INFO:teuthology.orchestra.run.smithi179.stdout:(141/156): python3-kubernetes-26.1.0-2.el9.noar 2.5 MB/s | 1.0 MB 00:00 2024-09-19T06:59:53.294 INFO:teuthology.orchestra.run.smithi179.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 889 kB/s | 74 kB 00:00 2024-09-19T06:59:53.319 INFO:teuthology.orchestra.run.smithi179.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-19T06:59:53.352 INFO:teuthology.orchestra.run.smithi179.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-19T06:59:53.378 INFO:teuthology.orchestra.run.smithi179.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 342 kB/s | 20 kB 00:00 2024-09-19T06:59:53.403 INFO:teuthology.orchestra.run.smithi179.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-19T06:59:53.428 INFO:teuthology.orchestra.run.smithi179.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-19T06:59:53.530 INFO:teuthology.orchestra.run.smithi179.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-09-19T06:59:53.696 INFO:teuthology.orchestra.run.smithi179.stdout:(149/156): librados2-19.1.1-361.g2f599a46.el9.x 12 MB/s | 3.4 MB 00:00 2024-09-19T06:59:53.746 INFO:teuthology.orchestra.run.smithi179.stdout:(150/156): NetworkManager-1.51.0-1.el9.x86_64.r 11 MB/s | 2.3 MB 00:00 2024-09-19T06:59:53.788 INFO:teuthology.orchestra.run.smithi179.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 987 kB/s | 41 kB 00:00 2024-09-19T06:59:53.838 INFO:teuthology.orchestra.run.smithi179.stdout:(152/156): librbd1-19.1.1-361.g2f599a46.el9.x86 7.7 MB/s | 3.2 MB 00:00 2024-09-19T06:59:53.863 INFO:teuthology.orchestra.run.smithi179.stdout:(153/156): NetworkManager-tui-1.51.0-1.el9.x86_ 3.2 MB/s | 249 kB 00:00 2024-09-19T06:59:53.972 INFO:teuthology.orchestra.run.smithi179.stdout:(154/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 22 MB/s | 2.4 MB 00:00 2024-09-19T06:59:54.014 INFO:teuthology.orchestra.run.smithi179.stdout:(155/156): NetworkManager-libnm-1.51.0-1.el9.x8 5.7 MB/s | 1.8 MB 00:00 2024-09-19T06:59:54.030 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-19T06:59:54.031 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-19T06:59:54.089 INFO:teuthology.orchestra.run.smithi179.stdout:(156/156): openssl-3.2.2-6.el9.x86_64.rpm 5.4 MB/s | 1.4 MB 00:00 2024-09-19T06:59:54.096 INFO:teuthology.orchestra.run.smithi179.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:59:54.096 INFO:teuthology.orchestra.run.smithi179.stdout:Total 26 MB/s | 226 MB 00:08 2024-09-19T06:59:55.333 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction check 2024-09-19T06:59:55.486 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction check succeeded. 2024-09-19T06:59:55.487 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction test 2024-09-19T06:59:56.993 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-19T06:59:57.123 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T06:59:57.277 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T06:59:57.309 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction test succeeded. 2024-09-19T06:59:57.309 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction 2024-09-19T06:59:57.365 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T06:59:57.398 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T06:59:57.423 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T06:59:57.485 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T06:59:57.814 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T06:59:57.925 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T06:59:58.047 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T06:59:58.076 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T06:59:58.167 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T06:59:58.206 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T06:59:58.386 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T06:59:58.452 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T06:59:58.480 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T06:59:58.584 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T06:59:58.606 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T06:59:58.669 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T06:59:58.699 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T06:59:58.723 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T06:59:58.918 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T06:59:59.088 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T06:59:59.189 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T06:59:59.302 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T06:59:59.382 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T06:59:59.609 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T06:59:59.727 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T06:59:59.815 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T06:59:59.853 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T06:59:59.888 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T06:59:59.953 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T07:00:00.006 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T07:00:00.046 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T07:00:00.090 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T07:00:00.122 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T07:00:00.150 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T07:00:00.220 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T07:00:00.272 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T07:00:00.303 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T07:00:00.330 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-19T07:00:00.338 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T07:00:00.415 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T07:00:00.428 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T07:00:00.457 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T07:00:00.518 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T07:00:00.543 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T07:00:00.546 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T07:00:00.615 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T07:00:00.655 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T07:00:00.660 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T07:00:00.696 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T07:00:00.730 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T07:00:00.735 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T07:00:00.774 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T07:00:00.885 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T07:00:00.938 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T07:00:01.107 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T07:00:01.223 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T07:00:01.346 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T07:00:01.374 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T07:00:01.465 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T07:00:01.466 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T07:00:01.495 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T07:00:01.550 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T07:00:01.579 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T07:00:01.614 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T07:00:01.644 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T07:00:01.652 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T07:00:01.695 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T07:00:01.709 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T07:00:01.737 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T07:00:01.841 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T07:00:01.843 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T07:00:01.863 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T07:00:01.897 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T07:00:01.917 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T07:00:01.939 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T07:00:01.951 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T07:00:01.975 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T07:00:02.033 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T07:00:02.064 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T07:00:02.100 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T07:00:02.146 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T07:00:02.157 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T07:00:02.183 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T07:00:02.226 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T07:00:02.268 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T07:00:02.288 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T07:00:02.403 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T07:00:02.422 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T07:00:02.513 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T07:00:02.530 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T07:00:02.612 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T07:00:02.615 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T07:00:02.714 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T07:00:02.754 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T07:00:02.795 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T07:00:02.827 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T07:00:02.852 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T07:00:02.858 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T07:00:02.957 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T07:00:02.974 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T07:00:03.069 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T07:00:03.084 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T07:00:03.103 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T07:00:03.121 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T07:00:03.138 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T07:00:03.149 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T07:00:03.183 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T07:00:03.221 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T07:00:03.222 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T07:00:03.254 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T07:00:03.281 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T07:00:03.292 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T07:00:03.322 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T07:00:03.326 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T07:00:03.360 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T07:00:03.377 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T07:00:03.402 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T07:00:03.418 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T07:00:03.435 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T07:00:03.446 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T07:00:03.516 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T07:00:03.522 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T07:00:03.566 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T07:00:03.577 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T07:00:03.587 INFO:teuthology.orchestra.run.smithi179.stdout: Preparing : 1/1 2024-09-19T07:00:03.597 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T07:00:03.607 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T07:00:03.651 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T07:00:03.676 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T07:00:03.700 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T07:00:03.714 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T07:00:03.727 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T07:00:03.756 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T07:00:03.762 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T07:00:03.768 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T07:00:03.805 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T07:00:03.810 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T07:00:03.836 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T07:00:03.842 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T07:00:03.878 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T07:00:03.913 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T07:00:03.966 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T07:00:04.041 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T07:00:04.181 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T07:00:04.212 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T07:00:04.243 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T07:00:04.329 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T07:00:04.434 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T07:00:04.463 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T07:00:04.482 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T07:00:04.529 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T07:00:04.538 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T07:00:04.562 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T07:00:04.567 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T07:00:04.670 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T07:00:04.718 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T07:00:04.721 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T07:00:04.771 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T07:00:04.778 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T07:00:04.782 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T07:00:04.809 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T07:00:04.857 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T07:00:04.858 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T07:00:04.885 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T07:00:04.906 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T07:00:04.907 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T07:00:04.919 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T07:00:04.952 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T07:00:04.957 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T07:00:05.008 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T07:00:05.014 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T07:00:05.036 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T07:00:05.064 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T07:00:05.093 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T07:00:05.132 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T07:00:05.171 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T07:00:05.209 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T07:00:05.219 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T07:00:05.237 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T07:00:05.300 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T07:00:05.370 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T07:00:05.377 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T07:00:05.418 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T07:00:05.454 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T07:00:05.492 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T07:00:05.500 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T07:00:05.537 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T07:00:05.580 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T07:00:05.601 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T07:00:05.677 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T07:00:05.706 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T07:00:05.865 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T07:00:05.892 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T07:00:05.893 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T07:00:05.933 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T07:00:05.974 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T07:00:05.978 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T07:00:06.007 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T07:00:06.087 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T07:00:06.112 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T07:00:06.136 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T07:00:06.149 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T07:00:06.173 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T07:00:06.183 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T07:00:06.198 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T07:00:06.223 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T07:00:06.248 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T07:00:06.293 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T07:00:06.297 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T07:00:06.336 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T07:00:06.380 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T07:00:06.412 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T07:00:06.426 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T07:00:06.440 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T07:00:06.455 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T07:00:06.483 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T07:00:06.511 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T07:00:06.526 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T07:00:06.571 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T07:00:06.574 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T07:00:06.602 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T07:00:06.606 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T07:00:06.635 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T07:00:06.636 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T07:00:06.670 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T07:00:06.704 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T07:00:06.712 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T07:00:06.745 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T07:00:06.747 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T07:00:06.780 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T07:00:06.790 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T07:00:06.819 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T07:00:06.866 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T07:00:06.900 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T07:00:06.918 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T07:00:06.943 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T07:00:06.958 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T07:00:07.026 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T07:00:07.061 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T07:00:07.110 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T07:00:07.169 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T07:00:07.221 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T07:00:07.252 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T07:00:07.333 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T07:00:07.361 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T07:00:07.411 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T07:00:07.722 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T07:00:07.748 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T07:00:07.832 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T07:00:07.833 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T07:00:07.840 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T07:00:07.862 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T07:00:07.890 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T07:00:07.904 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T07:00:07.931 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T07:00:07.932 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T07:00:07.942 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T07:00:07.962 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T07:00:07.984 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T07:00:08.008 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T07:00:08.048 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T07:00:08.095 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T07:00:08.141 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T07:00:08.159 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T07:00:08.221 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T07:00:08.228 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T07:00:08.268 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T07:00:08.275 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T07:00:08.372 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T07:00:08.408 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T07:00:08.444 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T07:00:08.454 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T07:00:08.487 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T07:00:08.491 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T07:00:08.499 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T07:00:08.527 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T07:00:08.535 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T07:00:08.569 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T07:00:08.578 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T07:00:08.606 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T07:00:08.621 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T07:00:08.645 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T07:00:08.756 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T07:00:08.805 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T07:00:08.852 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T07:00:08.958 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T07:00:08.997 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T07:00:09.036 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T07:00:09.062 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T07:00:09.087 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T07:00:09.162 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T07:00:09.225 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T07:00:09.289 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T07:00:09.319 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T07:00:09.349 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T07:00:09.447 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T07:00:09.666 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T07:00:09.706 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T07:00:09.754 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T07:00:09.783 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T07:00:09.817 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T07:00:09.851 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T07:00:09.893 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T07:00:09.927 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T07:00:10.017 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T07:00:10.065 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T07:00:10.105 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T07:00:10.216 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T07:00:10.272 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T07:00:10.586 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T07:00:10.671 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T07:00:10.699 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T07:00:10.805 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T07:00:10.988 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T07:00:10.994 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T07:00:11.025 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T07:00:11.044 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T07:00:11.078 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T07:00:11.185 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T07:00:11.241 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T07:00:11.245 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T07:00:11.286 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T07:00:11.287 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T07:00:11.373 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T07:00:11.378 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T07:00:11.409 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T07:00:11.413 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T07:00:11.445 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T07:00:11.573 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T07:00:11.597 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T07:00:11.611 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T07:00:11.628 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T07:00:11.704 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T07:00:11.704 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T07:00:11.705 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T07:00:11.705 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:00:11.705 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T07:00:11.738 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T07:00:11.927 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T07:00:11.965 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T07:00:12.028 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T07:00:12.051 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T07:00:12.350 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T07:00:12.468 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T07:00:13.695 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T07:00:13.782 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T07:00:13.810 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T07:00:13.843 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T07:00:14.152 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T07:00:14.189 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T07:00:14.280 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T07:00:14.311 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T07:00:14.347 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T07:00:14.422 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T07:00:14.464 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T07:00:14.826 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T07:00:14.859 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T07:00:14.930 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T07:00:15.008 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T07:00:15.027 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T07:00:15.051 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T07:00:15.129 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T07:00:15.129 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T07:00:15.129 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T07:00:15.129 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-19T07:00:15.169 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T07:00:17.523 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T07:00:17.557 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T07:00:18.107 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T07:00:18.144 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T07:00:18.236 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T07:00:18.237 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T07:00:18.237 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T07:00:18.237 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-19T07:00:18.270 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T07:00:23.518 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T07:00:23.518 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /sys 2024-09-19T07:00:23.519 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /proc 2024-09-19T07:00:23.519 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /mnt 2024-09-19T07:00:23.519 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /var/tmp 2024-09-19T07:00:23.519 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /home 2024-09-19T07:00:23.519 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /root 2024-09-19T07:00:23.519 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /tmp 2024-09-19T07:00:23.519 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:00:23.701 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T07:00:23.717 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T07:00:23.717 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:00:23.717 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T07:00:23.717 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:00:25.186 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T07:00:25.213 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T07:00:25.213 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:00:25.214 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T07:00:25.214 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T07:00:25.214 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T07:00:25.214 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:00:25.454 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T07:00:25.478 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T07:00:25.478 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:00:25.478 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T07:00:25.478 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T07:00:25.478 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T07:00:25.479 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:00:25.913 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T07:00:25.937 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T07:00:25.937 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:00:25.937 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T07:00:25.937 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T07:00:25.937 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T07:00:25.937 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:00:26.051 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T07:00:26.100 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T07:00:26.155 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T07:00:26.347 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T07:00:26.397 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T07:00:26.474 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T07:00:26.562 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T07:00:26.703 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T07:00:26.765 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T07:00:26.796 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T07:00:26.824 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T07:00:26.861 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T07:00:26.861 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /sys 2024-09-19T07:00:26.861 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /proc 2024-09-19T07:00:26.861 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /mnt 2024-09-19T07:00:26.861 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /var/tmp 2024-09-19T07:00:26.861 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /home 2024-09-19T07:00:26.862 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /root 2024-09-19T07:00:26.862 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /tmp 2024-09-19T07:00:26.862 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-19T07:00:27.040 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T07:00:27.056 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T07:00:27.056 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:00:27.056 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T07:00:27.056 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-19T07:00:27.244 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T07:00:27.272 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T07:00:27.295 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T07:00:27.349 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T07:00:27.378 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T07:00:28.422 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T07:00:28.455 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T07:00:28.528 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T07:00:28.555 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T07:00:28.555 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:00:28.555 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T07:00:28.555 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T07:00:28.555 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T07:00:28.555 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-19T07:00:28.779 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T07:00:28.802 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T07:00:28.802 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:00:28.802 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T07:00:28.803 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T07:00:28.803 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T07:00:28.803 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-19T07:00:29.237 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T07:00:29.261 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T07:00:29.262 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:00:29.262 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T07:00:29.262 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T07:00:29.262 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T07:00:29.262 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-19T07:00:29.359 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T07:00:29.408 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T07:00:29.420 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T07:00:29.447 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T07:00:29.471 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T07:00:29.551 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T07:00:29.665 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T07:00:29.709 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T07:00:29.713 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T07:00:29.741 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T07:00:29.765 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T07:00:29.765 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:00:29.765 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T07:00:29.765 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T07:00:29.765 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T07:00:29.765 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:00:29.783 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T07:00:29.816 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T07:00:29.828 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T07:00:29.871 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T07:00:29.925 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T07:00:29.976 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T07:00:30.000 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T07:00:30.044 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T07:00:30.044 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /sys 2024-09-19T07:00:30.045 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /proc 2024-09-19T07:00:30.045 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /mnt 2024-09-19T07:00:30.045 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /var/tmp 2024-09-19T07:00:30.045 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /home 2024-09-19T07:00:30.045 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /root 2024-09-19T07:00:30.045 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /tmp 2024-09-19T07:00:30.045 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-19T07:00:30.047 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T07:00:30.079 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T07:00:30.107 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T07:00:30.224 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T07:00:30.241 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T07:00:30.241 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:00:30.242 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T07:00:30.242 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-19T07:00:30.597 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T07:00:30.623 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T07:00:30.645 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T07:00:30.699 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T07:00:30.729 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T07:00:30.900 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T07:00:30.927 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T07:00:30.952 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T07:00:30.952 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:00:30.952 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T07:00:30.952 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T07:00:30.952 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T07:00:30.952 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:00:30.995 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T07:00:31.017 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T07:00:31.017 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:00:31.018 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T07:00:31.018 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:00:31.062 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T07:00:31.086 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T07:00:31.086 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:00:31.086 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T07:00:31.086 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T07:00:31.086 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T07:00:31.086 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:00:31.388 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T07:00:31.412 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T07:00:31.412 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:00:31.412 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T07:00:31.412 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T07:00:31.412 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T07:00:31.412 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:00:31.727 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T07:00:31.755 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T07:00:31.755 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:00:31.755 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T07:00:31.755 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T07:00:31.755 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T07:00:31.755 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-19T07:00:31.769 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T07:00:31.806 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T07:00:31.986 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T07:00:32.010 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T07:00:32.010 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:00:32.010 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T07:00:32.011 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T07:00:32.011 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T07:00:32.011 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-19T07:00:32.446 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T07:00:32.469 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T07:00:32.469 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:00:32.469 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T07:00:32.469 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T07:00:32.470 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T07:00:32.470 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-19T07:00:32.576 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T07:00:32.633 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T07:00:32.688 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T07:00:32.765 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T07:00:32.790 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T07:00:32.883 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T07:00:32.893 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T07:00:32.930 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T07:00:33.007 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T07:00:33.051 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T07:00:33.075 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T07:00:33.099 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T07:00:33.099 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:00:33.099 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T07:00:33.099 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T07:00:33.100 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T07:00:33.100 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-19T07:00:33.105 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T07:00:33.160 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T07:00:33.171 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T07:00:33.243 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T07:00:33.269 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T07:00:33.297 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T07:00:33.315 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T07:00:33.329 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T07:00:33.356 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T07:00:33.857 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T07:00:33.889 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T07:00:33.921 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T07:00:33.982 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T07:00:34.012 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T07:00:34.238 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T07:00:34.270 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T07:00:34.294 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T07:00:34.294 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:00:34.294 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T07:00:34.294 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T07:00:34.294 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T07:00:34.294 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-19T07:00:34.338 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T07:00:34.361 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T07:00:34.361 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:00:34.361 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T07:00:34.361 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-19T07:00:34.413 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T07:00:34.436 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T07:00:34.437 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:00:34.437 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T07:00:34.437 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T07:00:34.437 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T07:00:34.437 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-19T07:00:34.739 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T07:00:34.763 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T07:00:34.763 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:00:34.763 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T07:00:34.763 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T07:00:34.763 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T07:00:34.763 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-19T07:00:35.062 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T07:00:35.097 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T07:00:35.958 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T07:00:35.999 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T07:00:36.040 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T07:00:36.054 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T07:00:36.072 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T07:00:36.089 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T07:00:36.099 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T07:00:36.191 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T07:00:36.292 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T07:00:36.337 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T07:00:36.359 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T07:00:36.368 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T07:00:36.399 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T07:00:36.407 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T07:00:36.423 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T07:00:36.423 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:00:36.424 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T07:00:36.424 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T07:00:36.424 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T07:00:36.424 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-19T07:00:36.452 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T07:00:36.476 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T07:00:36.487 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T07:00:36.583 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T07:00:36.632 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T07:00:37.077 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T07:00:37.116 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T07:00:37.138 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T07:00:37.552 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T07:00:37.577 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T07:00:37.601 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T07:00:37.601 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:00:37.602 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T07:00:37.602 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T07:00:37.602 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T07:00:37.602 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-19T07:00:37.645 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T07:00:37.668 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T07:00:37.668 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:00:37.668 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T07:00:37.668 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-19T07:00:37.712 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T07:00:37.736 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T07:00:37.736 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:00:37.736 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T07:00:37.736 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T07:00:37.737 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T07:00:37.737 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-19T07:00:37.980 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T07:00:38.054 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T07:00:38.054 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T07:00:38.078 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T07:00:38.078 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:00:38.078 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T07:00:38.078 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T07:00:38.079 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T07:00:38.079 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-19T07:00:38.106 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T07:00:38.203 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T07:00:38.232 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T07:00:38.258 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T07:00:38.292 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T07:00:38.292 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T07:00:38.384 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T07:00:38.384 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T07:00:38.477 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T07:00:38.501 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T07:00:38.507 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T07:00:38.507 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T07:00:38.687 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T07:00:38.687 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T07:00:38.771 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T07:00:38.836 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T07:00:39.343 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T07:00:39.384 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T07:00:39.425 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T07:00:39.457 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T07:00:39.484 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T07:00:39.669 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T07:00:39.715 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T07:00:39.752 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T07:00:39.776 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T07:00:39.826 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T07:00:40.394 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T07:00:40.428 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T07:00:40.449 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T07:00:41.292 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T07:00:41.367 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T07:00:41.407 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T07:00:41.489 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T07:00:41.520 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T07:00:41.545 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T07:00:41.571 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T07:00:41.571 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T07:00:41.664 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T07:00:41.664 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T07:00:41.748 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T07:00:41.773 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T07:00:41.778 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T07:00:41.778 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T07:00:41.958 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T07:00:41.958 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T07:00:42.042 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T07:00:42.105 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T07:00:42.650 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T07:00:42.691 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T07:00:42.732 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T07:00:42.764 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T07:00:42.791 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T07:00:42.978 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T07:00:43.030 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T07:00:43.060 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T07:00:43.090 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T07:00:43.136 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T07:00:43.801 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T07:00:43.842 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T07:00:43.863 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T07:00:44.608 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T07:00:44.608 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T07:00:44.608 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T07:00:44.608 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T07:00:44.608 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T07:00:44.609 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T07:00:44.609 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T07:00:44.609 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T07:00:44.609 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T07:00:44.609 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T07:00:44.609 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T07:00:44.609 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T07:00:44.609 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T07:00:44.609 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T07:00:44.609 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T07:00:44.609 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T07:00:44.609 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T07:00:44.609 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T07:00:44.610 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T07:00:44.610 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T07:00:44.610 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T07:00:44.610 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T07:00:44.610 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T07:00:44.610 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T07:00:44.610 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T07:00:44.610 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T07:00:44.610 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T07:00:44.610 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T07:00:44.610 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T07:00:44.610 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T07:00:44.610 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T07:00:44.611 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T07:00:44.611 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T07:00:44.611 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T07:00:44.611 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T07:00:44.611 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T07:00:44.611 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T07:00:44.611 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T07:00:44.611 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T07:00:44.611 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T07:00:44.611 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T07:00:44.611 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T07:00:44.611 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T07:00:44.611 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T07:00:44.612 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T07:00:44.612 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T07:00:44.612 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T07:00:44.612 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T07:00:44.612 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T07:00:44.612 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T07:00:44.612 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T07:00:44.612 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T07:00:44.612 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T07:00:44.612 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T07:00:44.612 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T07:00:44.612 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T07:00:44.613 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T07:00:44.613 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T07:00:44.613 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T07:00:44.613 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T07:00:44.613 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T07:00:44.613 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T07:00:44.613 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T07:00:44.613 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T07:00:44.613 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T07:00:44.613 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T07:00:44.613 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T07:00:44.613 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T07:00:44.614 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T07:00:44.614 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T07:00:44.614 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T07:00:44.614 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T07:00:44.614 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T07:00:44.614 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T07:00:44.614 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T07:00:44.614 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T07:00:44.614 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T07:00:44.614 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T07:00:44.614 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T07:00:44.614 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T07:00:44.614 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T07:00:44.614 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T07:00:44.615 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T07:00:44.615 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T07:00:44.615 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T07:00:44.615 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T07:00:44.615 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T07:00:44.615 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T07:00:44.615 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T07:00:44.615 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T07:00:44.615 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T07:00:44.615 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T07:00:44.615 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T07:00:44.615 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T07:00:44.615 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T07:00:44.616 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T07:00:44.616 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T07:00:44.616 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T07:00:44.616 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T07:00:44.616 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T07:00:44.616 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T07:00:44.616 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T07:00:44.616 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T07:00:44.616 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T07:00:44.616 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T07:00:44.616 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T07:00:44.616 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T07:00:44.617 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T07:00:44.617 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T07:00:44.617 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T07:00:44.617 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T07:00:44.617 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T07:00:44.617 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T07:00:44.617 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T07:00:44.617 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T07:00:44.617 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T07:00:44.617 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T07:00:44.617 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T07:00:44.617 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T07:00:44.617 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T07:00:44.617 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T07:00:44.618 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T07:00:44.618 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T07:00:44.618 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T07:00:44.618 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T07:00:44.618 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T07:00:44.618 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T07:00:44.618 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T07:00:44.618 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T07:00:44.618 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T07:00:44.618 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T07:00:44.618 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T07:00:44.618 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T07:00:44.618 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T07:00:44.618 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T07:00:44.619 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T07:00:44.619 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T07:00:44.619 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T07:00:44.619 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T07:00:44.619 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T07:00:44.619 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T07:00:44.619 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T07:00:44.619 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T07:00:44.619 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T07:00:44.619 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T07:00:44.619 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T07:00:44.619 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T07:00:44.619 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T07:00:44.619 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T07:00:44.620 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T07:00:44.620 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T07:00:44.620 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T07:00:44.620 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T07:00:44.620 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T07:00:44.620 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T07:00:44.620 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T07:00:44.620 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T07:00:44.620 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T07:00:44.620 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T07:00:44.620 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T07:00:44.620 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T07:00:44.620 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T07:00:44.621 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T07:00:44.621 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T07:00:44.698 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T07:00:44.822 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T07:00:44.871 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T07:00:44.954 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T07:00:44.991 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T07:00:45.017 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T07:00:45.051 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T07:00:45.051 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T07:00:45.135 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T07:00:45.136 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T07:00:45.219 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T07:00:45.245 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T07:00:45.253 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T07:00:45.254 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T07:00:45.430 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T07:00:45.430 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T07:00:45.522 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T07:00:45.594 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T07:00:47.503 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T07:00:47.503 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:00:47.504 INFO:teuthology.orchestra.run.smithi148.stdout:Upgraded: 2024-09-19T07:00:47.504 INFO:teuthology.orchestra.run.smithi148.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T07:00:47.504 INFO:teuthology.orchestra.run.smithi148.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T07:00:47.504 INFO:teuthology.orchestra.run.smithi148.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T07:00:47.504 INFO:teuthology.orchestra.run.smithi148.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T07:00:47.504 INFO:teuthology.orchestra.run.smithi148.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:47.504 INFO:teuthology.orchestra.run.smithi148.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:47.504 INFO:teuthology.orchestra.run.smithi148.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T07:00:47.504 INFO:teuthology.orchestra.run.smithi148.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T07:00:47.504 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-19T07:00:47.504 INFO:teuthology.orchestra.run.smithi148.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T07:00:47.504 INFO:teuthology.orchestra.run.smithi148.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T07:00:47.505 INFO:teuthology.orchestra.run.smithi148.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T07:00:47.505 INFO:teuthology.orchestra.run.smithi148.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T07:00:47.505 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:47.505 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:47.505 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:47.505 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:47.505 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:00:47.505 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:47.505 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:47.505 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:47.506 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:00:47.506 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:00:47.506 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:00:47.506 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:00:47.506 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:00:47.506 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:47.506 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:47.506 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:00:47.506 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:47.506 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:47.506 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:47.506 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:00:47.507 INFO:teuthology.orchestra.run.smithi148.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:00:47.507 INFO:teuthology.orchestra.run.smithi148.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:47.507 INFO:teuthology.orchestra.run.smithi148.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:47.507 INFO:teuthology.orchestra.run.smithi148.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:00:47.507 INFO:teuthology.orchestra.run.smithi148.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T07:00:47.507 INFO:teuthology.orchestra.run.smithi148.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T07:00:47.507 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T07:00:47.507 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T07:00:47.507 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T07:00:47.507 INFO:teuthology.orchestra.run.smithi148.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T07:00:47.508 INFO:teuthology.orchestra.run.smithi148.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T07:00:47.508 INFO:teuthology.orchestra.run.smithi148.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T07:00:47.508 INFO:teuthology.orchestra.run.smithi148.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T07:00:47.508 INFO:teuthology.orchestra.run.smithi148.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T07:00:47.508 INFO:teuthology.orchestra.run.smithi148.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T07:00:47.508 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:47.508 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:47.508 INFO:teuthology.orchestra.run.smithi148.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:47.508 INFO:teuthology.orchestra.run.smithi148.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T07:00:47.508 INFO:teuthology.orchestra.run.smithi148.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T07:00:47.508 INFO:teuthology.orchestra.run.smithi148.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T07:00:47.509 INFO:teuthology.orchestra.run.smithi148.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T07:00:47.509 INFO:teuthology.orchestra.run.smithi148.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T07:00:47.509 INFO:teuthology.orchestra.run.smithi148.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:47.509 INFO:teuthology.orchestra.run.smithi148.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:47.509 INFO:teuthology.orchestra.run.smithi148.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T07:00:47.509 INFO:teuthology.orchestra.run.smithi148.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:47.509 INFO:teuthology.orchestra.run.smithi148.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T07:00:47.509 INFO:teuthology.orchestra.run.smithi148.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T07:00:47.509 INFO:teuthology.orchestra.run.smithi148.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T07:00:47.509 INFO:teuthology.orchestra.run.smithi148.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T07:00:47.509 INFO:teuthology.orchestra.run.smithi148.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T07:00:47.510 INFO:teuthology.orchestra.run.smithi148.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T07:00:47.510 INFO:teuthology.orchestra.run.smithi148.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T07:00:47.510 INFO:teuthology.orchestra.run.smithi148.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T07:00:47.510 INFO:teuthology.orchestra.run.smithi148.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T07:00:47.510 INFO:teuthology.orchestra.run.smithi148.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T07:00:47.510 INFO:teuthology.orchestra.run.smithi148.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T07:00:47.510 INFO:teuthology.orchestra.run.smithi148.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T07:00:47.510 INFO:teuthology.orchestra.run.smithi148.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T07:00:47.510 INFO:teuthology.orchestra.run.smithi148.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T07:00:47.510 INFO:teuthology.orchestra.run.smithi148.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T07:00:47.510 INFO:teuthology.orchestra.run.smithi148.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T07:00:47.510 INFO:teuthology.orchestra.run.smithi148.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T07:00:47.510 INFO:teuthology.orchestra.run.smithi148.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T07:00:47.510 INFO:teuthology.orchestra.run.smithi148.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T07:00:47.511 INFO:teuthology.orchestra.run.smithi148.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T07:00:47.511 INFO:teuthology.orchestra.run.smithi148.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T07:00:47.511 INFO:teuthology.orchestra.run.smithi148.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T07:00:47.511 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T07:00:47.511 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:47.511 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:47.511 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:47.511 INFO:teuthology.orchestra.run.smithi148.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T07:00:47.511 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T07:00:47.511 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T07:00:47.511 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T07:00:47.511 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T07:00:47.511 INFO:teuthology.orchestra.run.smithi148.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T07:00:47.512 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T07:00:47.512 INFO:teuthology.orchestra.run.smithi148.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T07:00:47.512 INFO:teuthology.orchestra.run.smithi148.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T07:00:47.512 INFO:teuthology.orchestra.run.smithi148.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T07:00:47.512 INFO:teuthology.orchestra.run.smithi148.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T07:00:47.512 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T07:00:47.512 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T07:00:47.512 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T07:00:47.512 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T07:00:47.512 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T07:00:47.512 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T07:00:47.513 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T07:00:47.513 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T07:00:47.513 INFO:teuthology.orchestra.run.smithi148.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T07:00:47.513 INFO:teuthology.orchestra.run.smithi148.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T07:00:47.513 INFO:teuthology.orchestra.run.smithi148.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T07:00:47.513 INFO:teuthology.orchestra.run.smithi148.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T07:00:47.513 INFO:teuthology.orchestra.run.smithi148.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T07:00:47.513 INFO:teuthology.orchestra.run.smithi148.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T07:00:47.513 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T07:00:47.513 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T07:00:47.513 INFO:teuthology.orchestra.run.smithi148.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T07:00:47.513 INFO:teuthology.orchestra.run.smithi148.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T07:00:47.513 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T07:00:47.513 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T07:00:47.514 INFO:teuthology.orchestra.run.smithi148.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T07:00:47.514 INFO:teuthology.orchestra.run.smithi148.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T07:00:47.514 INFO:teuthology.orchestra.run.smithi148.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T07:00:47.514 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T07:00:47.514 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T07:00:47.514 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T07:00:47.514 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T07:00:47.514 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T07:00:47.514 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T07:00:47.514 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:47.514 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:47.514 INFO:teuthology.orchestra.run.smithi148.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T07:00:47.515 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T07:00:47.515 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T07:00:47.515 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:47.515 INFO:teuthology.orchestra.run.smithi148.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T07:00:47.515 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T07:00:47.515 INFO:teuthology.orchestra.run.smithi148.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T07:00:47.515 INFO:teuthology.orchestra.run.smithi148.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T07:00:47.515 INFO:teuthology.orchestra.run.smithi148.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T07:00:47.515 INFO:teuthology.orchestra.run.smithi148.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T07:00:47.515 INFO:teuthology.orchestra.run.smithi148.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T07:00:47.515 INFO:teuthology.orchestra.run.smithi148.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T07:00:47.515 INFO:teuthology.orchestra.run.smithi148.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T07:00:47.515 INFO:teuthology.orchestra.run.smithi148.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T07:00:47.516 INFO:teuthology.orchestra.run.smithi148.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T07:00:47.516 INFO:teuthology.orchestra.run.smithi148.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T07:00:47.516 INFO:teuthology.orchestra.run.smithi148.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T07:00:47.516 INFO:teuthology.orchestra.run.smithi148.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T07:00:47.516 INFO:teuthology.orchestra.run.smithi148.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T07:00:47.516 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:47.516 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:47.516 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:47.516 INFO:teuthology.orchestra.run.smithi148.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T07:00:47.516 INFO:teuthology.orchestra.run.smithi148.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T07:00:47.516 INFO:teuthology.orchestra.run.smithi148.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T07:00:47.516 INFO:teuthology.orchestra.run.smithi148.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T07:00:47.516 INFO:teuthology.orchestra.run.smithi148.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T07:00:47.517 INFO:teuthology.orchestra.run.smithi148.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T07:00:47.517 INFO:teuthology.orchestra.run.smithi148.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T07:00:47.517 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:00:47.517 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-19T07:00:47.765 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T07:00:47.765 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T07:00:47.765 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T07:00:47.765 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T07:00:47.765 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T07:00:47.765 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T07:00:47.765 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T07:00:47.765 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T07:00:47.765 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T07:00:47.766 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T07:00:47.766 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T07:00:47.766 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T07:00:47.766 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T07:00:47.766 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T07:00:47.766 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T07:00:47.766 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T07:00:47.766 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T07:00:47.766 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T07:00:47.766 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T07:00:47.766 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T07:00:47.766 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T07:00:47.766 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T07:00:47.767 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T07:00:47.767 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T07:00:47.767 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T07:00:47.767 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T07:00:47.767 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T07:00:47.767 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T07:00:47.767 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T07:00:47.767 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T07:00:47.767 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T07:00:47.767 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T07:00:47.767 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T07:00:47.767 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T07:00:47.767 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T07:00:47.768 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T07:00:47.768 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T07:00:47.768 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T07:00:47.768 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T07:00:47.768 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T07:00:47.768 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T07:00:47.768 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T07:00:47.768 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T07:00:47.768 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T07:00:47.768 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T07:00:47.768 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T07:00:47.769 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T07:00:47.769 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T07:00:47.769 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T07:00:47.769 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T07:00:47.769 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T07:00:47.769 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T07:00:47.769 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T07:00:47.769 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T07:00:47.769 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T07:00:47.769 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T07:00:47.770 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T07:00:47.770 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T07:00:47.770 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T07:00:47.770 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T07:00:47.770 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T07:00:47.770 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T07:00:47.770 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T07:00:47.770 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T07:00:47.770 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T07:00:47.770 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T07:00:47.770 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T07:00:47.770 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T07:00:47.770 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T07:00:47.770 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T07:00:47.771 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T07:00:47.771 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T07:00:47.771 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T07:00:47.771 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T07:00:47.771 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T07:00:47.771 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T07:00:47.771 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T07:00:47.771 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T07:00:47.771 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T07:00:47.771 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T07:00:47.771 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T07:00:47.771 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T07:00:47.771 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T07:00:47.772 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T07:00:47.772 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T07:00:47.772 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T07:00:47.772 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T07:00:47.772 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T07:00:47.772 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T07:00:47.772 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T07:00:47.772 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T07:00:47.772 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T07:00:47.772 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T07:00:47.772 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T07:00:47.773 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T07:00:47.773 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T07:00:47.773 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T07:00:47.773 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T07:00:47.773 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T07:00:47.773 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T07:00:47.773 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T07:00:47.773 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T07:00:47.773 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T07:00:47.773 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T07:00:47.773 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T07:00:47.773 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T07:00:47.774 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T07:00:47.774 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T07:00:47.774 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T07:00:47.774 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T07:00:47.774 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T07:00:47.774 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T07:00:47.774 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T07:00:47.774 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T07:00:47.774 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T07:00:47.774 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T07:00:47.774 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T07:00:47.774 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T07:00:47.774 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T07:00:47.775 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T07:00:47.775 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T07:00:47.775 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T07:00:47.775 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T07:00:47.775 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T07:00:47.775 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T07:00:47.775 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T07:00:47.775 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T07:00:47.775 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T07:00:47.775 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T07:00:47.775 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T07:00:47.776 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T07:00:47.776 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T07:00:47.776 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T07:00:47.776 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T07:00:47.776 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T07:00:47.776 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T07:00:47.776 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T07:00:47.776 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T07:00:47.777 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T07:00:47.777 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T07:00:47.777 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T07:00:47.777 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T07:00:47.777 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T07:00:47.777 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T07:00:47.777 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T07:00:47.777 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T07:00:47.777 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T07:00:47.777 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T07:00:47.778 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T07:00:47.778 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T07:00:47.778 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T07:00:47.778 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T07:00:47.778 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T07:00:47.778 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T07:00:47.778 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T07:00:47.779 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T07:00:47.779 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T07:00:47.779 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T07:00:47.779 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T07:00:47.779 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T07:00:47.779 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T07:00:47.779 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T07:00:47.779 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T07:00:47.779 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T07:00:47.938 DEBUG:teuthology.parallel:result is None 2024-09-19T07:00:50.429 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T07:00:50.429 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-19T07:00:50.429 INFO:teuthology.orchestra.run.smithi165.stdout:Upgraded: 2024-09-19T07:00:50.429 INFO:teuthology.orchestra.run.smithi165.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T07:00:50.429 INFO:teuthology.orchestra.run.smithi165.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T07:00:50.429 INFO:teuthology.orchestra.run.smithi165.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T07:00:50.429 INFO:teuthology.orchestra.run.smithi165.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T07:00:50.430 INFO:teuthology.orchestra.run.smithi165.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:50.430 INFO:teuthology.orchestra.run.smithi165.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:50.430 INFO:teuthology.orchestra.run.smithi165.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T07:00:50.430 INFO:teuthology.orchestra.run.smithi165.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T07:00:50.430 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-19T07:00:50.430 INFO:teuthology.orchestra.run.smithi165.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T07:00:50.430 INFO:teuthology.orchestra.run.smithi165.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T07:00:50.430 INFO:teuthology.orchestra.run.smithi165.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T07:00:50.430 INFO:teuthology.orchestra.run.smithi165.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T07:00:50.430 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:50.431 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:50.431 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:50.431 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:50.431 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:00:50.431 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:50.431 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:50.431 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:50.431 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:00:50.431 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:00:50.431 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:00:50.431 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:00:50.431 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:00:50.432 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:50.432 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:50.432 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:00:50.432 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:50.432 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:50.432 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:50.432 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:00:50.432 INFO:teuthology.orchestra.run.smithi165.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:00:50.432 INFO:teuthology.orchestra.run.smithi165.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:50.432 INFO:teuthology.orchestra.run.smithi165.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:50.432 INFO:teuthology.orchestra.run.smithi165.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:00:50.432 INFO:teuthology.orchestra.run.smithi165.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T07:00:50.432 INFO:teuthology.orchestra.run.smithi165.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T07:00:50.433 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T07:00:50.433 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T07:00:50.433 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T07:00:50.433 INFO:teuthology.orchestra.run.smithi165.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T07:00:50.433 INFO:teuthology.orchestra.run.smithi165.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T07:00:50.433 INFO:teuthology.orchestra.run.smithi165.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T07:00:50.433 INFO:teuthology.orchestra.run.smithi165.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T07:00:50.433 INFO:teuthology.orchestra.run.smithi165.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T07:00:50.433 INFO:teuthology.orchestra.run.smithi165.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T07:00:50.433 INFO:teuthology.orchestra.run.smithi165.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:50.433 INFO:teuthology.orchestra.run.smithi165.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:50.433 INFO:teuthology.orchestra.run.smithi165.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:50.434 INFO:teuthology.orchestra.run.smithi165.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T07:00:50.434 INFO:teuthology.orchestra.run.smithi165.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T07:00:50.434 INFO:teuthology.orchestra.run.smithi165.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T07:00:50.434 INFO:teuthology.orchestra.run.smithi165.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T07:00:50.434 INFO:teuthology.orchestra.run.smithi165.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T07:00:50.434 INFO:teuthology.orchestra.run.smithi165.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:50.434 INFO:teuthology.orchestra.run.smithi165.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:50.434 INFO:teuthology.orchestra.run.smithi165.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T07:00:50.434 INFO:teuthology.orchestra.run.smithi165.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:50.434 INFO:teuthology.orchestra.run.smithi165.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T07:00:50.434 INFO:teuthology.orchestra.run.smithi165.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T07:00:50.434 INFO:teuthology.orchestra.run.smithi165.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T07:00:50.435 INFO:teuthology.orchestra.run.smithi165.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T07:00:50.435 INFO:teuthology.orchestra.run.smithi165.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T07:00:50.435 INFO:teuthology.orchestra.run.smithi165.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T07:00:50.435 INFO:teuthology.orchestra.run.smithi165.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T07:00:50.435 INFO:teuthology.orchestra.run.smithi165.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T07:00:50.435 INFO:teuthology.orchestra.run.smithi165.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T07:00:50.435 INFO:teuthology.orchestra.run.smithi165.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T07:00:50.435 INFO:teuthology.orchestra.run.smithi165.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T07:00:50.435 INFO:teuthology.orchestra.run.smithi165.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T07:00:50.435 INFO:teuthology.orchestra.run.smithi165.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T07:00:50.435 INFO:teuthology.orchestra.run.smithi165.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T07:00:50.435 INFO:teuthology.orchestra.run.smithi165.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T07:00:50.435 INFO:teuthology.orchestra.run.smithi165.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T07:00:50.436 INFO:teuthology.orchestra.run.smithi165.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T07:00:50.436 INFO:teuthology.orchestra.run.smithi165.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T07:00:50.436 INFO:teuthology.orchestra.run.smithi165.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T07:00:50.436 INFO:teuthology.orchestra.run.smithi165.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T07:00:50.436 INFO:teuthology.orchestra.run.smithi165.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T07:00:50.436 INFO:teuthology.orchestra.run.smithi165.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T07:00:50.436 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T07:00:50.436 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:50.436 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:50.436 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:50.436 INFO:teuthology.orchestra.run.smithi165.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T07:00:50.436 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T07:00:50.436 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T07:00:50.437 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T07:00:50.437 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T07:00:50.437 INFO:teuthology.orchestra.run.smithi165.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T07:00:50.437 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T07:00:50.437 INFO:teuthology.orchestra.run.smithi165.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T07:00:50.437 INFO:teuthology.orchestra.run.smithi165.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T07:00:50.437 INFO:teuthology.orchestra.run.smithi165.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T07:00:50.437 INFO:teuthology.orchestra.run.smithi165.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T07:00:50.437 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T07:00:50.437 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T07:00:50.437 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T07:00:50.437 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T07:00:50.437 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T07:00:50.438 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T07:00:50.438 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T07:00:50.438 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T07:00:50.438 INFO:teuthology.orchestra.run.smithi165.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T07:00:50.438 INFO:teuthology.orchestra.run.smithi165.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T07:00:50.438 INFO:teuthology.orchestra.run.smithi165.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T07:00:50.438 INFO:teuthology.orchestra.run.smithi165.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T07:00:50.438 INFO:teuthology.orchestra.run.smithi165.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T07:00:50.438 INFO:teuthology.orchestra.run.smithi165.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T07:00:50.438 INFO:teuthology.orchestra.run.smithi165.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T07:00:50.438 INFO:teuthology.orchestra.run.smithi165.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T07:00:50.438 INFO:teuthology.orchestra.run.smithi165.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T07:00:50.439 INFO:teuthology.orchestra.run.smithi165.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T07:00:50.439 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T07:00:50.439 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T07:00:50.439 INFO:teuthology.orchestra.run.smithi165.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T07:00:50.439 INFO:teuthology.orchestra.run.smithi165.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T07:00:50.439 INFO:teuthology.orchestra.run.smithi165.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T07:00:50.439 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T07:00:50.439 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T07:00:50.439 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T07:00:50.439 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T07:00:50.440 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T07:00:50.440 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T07:00:50.440 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:50.440 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:50.440 INFO:teuthology.orchestra.run.smithi165.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T07:00:50.440 INFO:teuthology.orchestra.run.smithi165.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T07:00:50.440 INFO:teuthology.orchestra.run.smithi165.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T07:00:50.440 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:50.440 INFO:teuthology.orchestra.run.smithi165.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T07:00:50.440 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T07:00:50.440 INFO:teuthology.orchestra.run.smithi165.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T07:00:50.441 INFO:teuthology.orchestra.run.smithi165.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T07:00:50.441 INFO:teuthology.orchestra.run.smithi165.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T07:00:50.441 INFO:teuthology.orchestra.run.smithi165.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T07:00:50.441 INFO:teuthology.orchestra.run.smithi165.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T07:00:50.441 INFO:teuthology.orchestra.run.smithi165.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T07:00:50.441 INFO:teuthology.orchestra.run.smithi165.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T07:00:50.441 INFO:teuthology.orchestra.run.smithi165.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T07:00:50.441 INFO:teuthology.orchestra.run.smithi165.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T07:00:50.441 INFO:teuthology.orchestra.run.smithi165.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T07:00:50.441 INFO:teuthology.orchestra.run.smithi165.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T07:00:50.441 INFO:teuthology.orchestra.run.smithi165.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T07:00:50.441 INFO:teuthology.orchestra.run.smithi165.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T07:00:50.441 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:50.442 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:50.442 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:50.442 INFO:teuthology.orchestra.run.smithi165.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T07:00:50.442 INFO:teuthology.orchestra.run.smithi165.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T07:00:50.442 INFO:teuthology.orchestra.run.smithi165.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T07:00:50.442 INFO:teuthology.orchestra.run.smithi165.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T07:00:50.442 INFO:teuthology.orchestra.run.smithi165.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T07:00:50.442 INFO:teuthology.orchestra.run.smithi165.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T07:00:50.443 INFO:teuthology.orchestra.run.smithi165.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T07:00:50.443 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-19T07:00:50.443 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-19T07:00:50.869 DEBUG:teuthology.parallel:result is None 2024-09-19T07:00:51.553 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T07:00:51.553 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T07:00:51.553 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T07:00:51.553 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T07:00:51.553 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T07:00:51.553 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T07:00:51.553 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T07:00:51.553 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T07:00:51.554 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T07:00:51.554 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T07:00:51.554 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T07:00:51.554 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T07:00:51.554 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T07:00:51.554 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T07:00:51.554 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T07:00:51.554 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T07:00:51.554 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T07:00:51.554 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T07:00:51.554 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T07:00:51.554 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T07:00:51.555 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T07:00:51.555 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T07:00:51.555 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T07:00:51.555 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T07:00:51.555 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T07:00:51.555 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T07:00:51.555 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T07:00:51.555 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T07:00:51.555 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T07:00:51.555 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T07:00:51.556 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T07:00:51.556 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T07:00:51.556 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T07:00:51.556 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T07:00:51.556 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T07:00:51.556 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T07:00:51.556 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T07:00:51.556 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T07:00:51.556 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T07:00:51.556 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T07:00:51.556 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T07:00:51.557 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T07:00:51.557 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T07:00:51.557 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T07:00:51.557 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T07:00:51.557 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T07:00:51.557 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T07:00:51.557 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T07:00:51.557 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T07:00:51.557 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T07:00:51.557 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T07:00:51.557 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T07:00:51.558 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T07:00:51.558 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T07:00:51.558 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T07:00:51.558 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T07:00:51.558 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T07:00:51.558 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T07:00:51.558 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T07:00:51.558 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T07:00:51.558 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T07:00:51.558 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T07:00:51.559 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T07:00:51.559 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T07:00:51.559 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T07:00:51.559 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T07:00:51.559 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T07:00:51.559 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T07:00:51.559 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T07:00:51.559 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T07:00:51.559 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T07:00:51.559 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T07:00:51.559 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T07:00:51.560 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T07:00:51.560 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T07:00:51.560 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T07:00:51.560 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T07:00:51.560 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T07:00:51.560 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T07:00:51.560 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T07:00:51.560 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T07:00:51.560 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T07:00:51.560 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T07:00:51.560 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T07:00:51.561 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T07:00:51.561 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T07:00:51.561 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T07:00:51.561 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T07:00:51.561 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T07:00:51.561 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T07:00:51.561 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T07:00:51.561 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T07:00:51.561 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T07:00:51.561 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T07:00:51.561 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T07:00:51.561 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T07:00:51.561 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T07:00:51.562 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T07:00:51.562 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T07:00:51.562 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T07:00:51.562 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T07:00:51.562 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T07:00:51.562 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T07:00:51.562 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T07:00:51.562 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T07:00:51.562 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T07:00:51.562 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T07:00:51.562 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T07:00:51.562 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T07:00:51.562 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T07:00:51.562 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T07:00:51.563 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T07:00:51.563 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T07:00:51.563 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T07:00:51.563 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T07:00:51.563 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T07:00:51.563 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T07:00:51.563 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T07:00:51.563 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T07:00:51.563 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T07:00:51.563 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T07:00:51.563 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T07:00:51.563 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T07:00:51.563 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T07:00:51.564 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T07:00:51.564 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T07:00:51.564 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T07:00:51.564 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T07:00:51.564 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T07:00:51.564 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T07:00:51.564 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T07:00:51.564 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T07:00:51.564 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T07:00:51.564 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T07:00:51.564 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T07:00:51.565 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T07:00:51.565 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T07:00:51.565 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T07:00:51.565 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T07:00:51.565 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T07:00:51.565 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T07:00:51.565 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T07:00:51.565 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T07:00:51.565 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T07:00:51.565 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T07:00:51.565 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T07:00:51.565 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T07:00:51.566 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T07:00:51.566 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T07:00:51.566 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T07:00:51.566 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T07:00:51.566 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T07:00:51.566 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T07:00:51.566 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T07:00:51.566 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T07:00:51.566 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T07:00:51.566 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T07:00:51.566 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T07:00:51.567 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T07:00:51.567 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T07:00:51.567 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T07:00:51.567 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T07:00:51.567 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T07:00:51.567 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T07:00:54.143 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T07:00:54.144 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-19T07:00:54.144 INFO:teuthology.orchestra.run.smithi179.stdout:Upgraded: 2024-09-19T07:00:54.144 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T07:00:54.144 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T07:00:54.144 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T07:00:54.144 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T07:00:54.144 INFO:teuthology.orchestra.run.smithi179.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:54.144 INFO:teuthology.orchestra.run.smithi179.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:54.145 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T07:00:54.145 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T07:00:54.145 INFO:teuthology.orchestra.run.smithi179.stdout:Installed: 2024-09-19T07:00:54.145 INFO:teuthology.orchestra.run.smithi179.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T07:00:54.145 INFO:teuthology.orchestra.run.smithi179.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T07:00:54.145 INFO:teuthology.orchestra.run.smithi179.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T07:00:54.145 INFO:teuthology.orchestra.run.smithi179.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T07:00:54.145 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:54.146 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:54.146 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:54.146 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:54.146 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:00:54.146 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:54.146 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:54.146 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:54.146 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:00:54.146 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:00:54.146 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:00:54.147 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:00:54.147 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:00:54.147 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:54.147 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:54.147 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:00:54.147 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:54.147 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:54.147 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:54.147 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:00:54.147 INFO:teuthology.orchestra.run.smithi179.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:00:54.148 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:54.148 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:54.148 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:00:54.148 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T07:00:54.148 INFO:teuthology.orchestra.run.smithi179.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T07:00:54.148 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T07:00:54.148 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T07:00:54.148 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T07:00:54.148 INFO:teuthology.orchestra.run.smithi179.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T07:00:54.148 INFO:teuthology.orchestra.run.smithi179.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T07:00:54.149 INFO:teuthology.orchestra.run.smithi179.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T07:00:54.149 INFO:teuthology.orchestra.run.smithi179.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T07:00:54.149 INFO:teuthology.orchestra.run.smithi179.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T07:00:54.149 INFO:teuthology.orchestra.run.smithi179.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T07:00:54.149 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:54.149 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:54.149 INFO:teuthology.orchestra.run.smithi179.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:54.149 INFO:teuthology.orchestra.run.smithi179.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T07:00:54.149 INFO:teuthology.orchestra.run.smithi179.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T07:00:54.149 INFO:teuthology.orchestra.run.smithi179.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T07:00:54.150 INFO:teuthology.orchestra.run.smithi179.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T07:00:54.150 INFO:teuthology.orchestra.run.smithi179.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T07:00:54.150 INFO:teuthology.orchestra.run.smithi179.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:54.150 INFO:teuthology.orchestra.run.smithi179.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:54.150 INFO:teuthology.orchestra.run.smithi179.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T07:00:54.150 INFO:teuthology.orchestra.run.smithi179.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:54.150 INFO:teuthology.orchestra.run.smithi179.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T07:00:54.150 INFO:teuthology.orchestra.run.smithi179.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T07:00:54.150 INFO:teuthology.orchestra.run.smithi179.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T07:00:54.150 INFO:teuthology.orchestra.run.smithi179.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T07:00:54.151 INFO:teuthology.orchestra.run.smithi179.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T07:00:54.151 INFO:teuthology.orchestra.run.smithi179.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T07:00:54.151 INFO:teuthology.orchestra.run.smithi179.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T07:00:54.151 INFO:teuthology.orchestra.run.smithi179.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T07:00:54.151 INFO:teuthology.orchestra.run.smithi179.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T07:00:54.151 INFO:teuthology.orchestra.run.smithi179.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T07:00:54.151 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T07:00:54.151 INFO:teuthology.orchestra.run.smithi179.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T07:00:54.151 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T07:00:54.152 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T07:00:54.152 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T07:00:54.152 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T07:00:54.152 INFO:teuthology.orchestra.run.smithi179.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T07:00:54.152 INFO:teuthology.orchestra.run.smithi179.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T07:00:54.152 INFO:teuthology.orchestra.run.smithi179.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T07:00:54.152 INFO:teuthology.orchestra.run.smithi179.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T07:00:54.152 INFO:teuthology.orchestra.run.smithi179.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T07:00:54.152 INFO:teuthology.orchestra.run.smithi179.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T07:00:54.153 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T07:00:54.153 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:54.153 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:54.153 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:54.153 INFO:teuthology.orchestra.run.smithi179.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T07:00:54.153 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T07:00:54.153 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T07:00:54.153 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T07:00:54.153 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T07:00:54.153 INFO:teuthology.orchestra.run.smithi179.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T07:00:54.154 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T07:00:54.154 INFO:teuthology.orchestra.run.smithi179.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T07:00:54.154 INFO:teuthology.orchestra.run.smithi179.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T07:00:54.154 INFO:teuthology.orchestra.run.smithi179.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T07:00:54.154 INFO:teuthology.orchestra.run.smithi179.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T07:00:54.154 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T07:00:54.154 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T07:00:54.154 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T07:00:54.154 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T07:00:54.154 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T07:00:54.155 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T07:00:54.155 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T07:00:54.155 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T07:00:54.155 INFO:teuthology.orchestra.run.smithi179.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T07:00:54.155 INFO:teuthology.orchestra.run.smithi179.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T07:00:54.155 INFO:teuthology.orchestra.run.smithi179.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T07:00:54.155 INFO:teuthology.orchestra.run.smithi179.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T07:00:54.155 INFO:teuthology.orchestra.run.smithi179.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T07:00:54.155 INFO:teuthology.orchestra.run.smithi179.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T07:00:54.155 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T07:00:54.155 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T07:00:54.156 INFO:teuthology.orchestra.run.smithi179.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T07:00:54.156 INFO:teuthology.orchestra.run.smithi179.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T07:00:54.156 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T07:00:54.156 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T07:00:54.156 INFO:teuthology.orchestra.run.smithi179.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T07:00:54.156 INFO:teuthology.orchestra.run.smithi179.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T07:00:54.156 INFO:teuthology.orchestra.run.smithi179.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T07:00:54.156 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T07:00:54.156 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T07:00:54.156 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T07:00:54.156 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T07:00:54.157 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T07:00:54.157 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T07:00:54.157 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:54.157 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:54.157 INFO:teuthology.orchestra.run.smithi179.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T07:00:54.157 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T07:00:54.157 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T07:00:54.157 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:54.157 INFO:teuthology.orchestra.run.smithi179.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T07:00:54.157 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T07:00:54.157 INFO:teuthology.orchestra.run.smithi179.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T07:00:54.158 INFO:teuthology.orchestra.run.smithi179.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T07:00:54.158 INFO:teuthology.orchestra.run.smithi179.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T07:00:54.158 INFO:teuthology.orchestra.run.smithi179.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T07:00:54.158 INFO:teuthology.orchestra.run.smithi179.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T07:00:54.158 INFO:teuthology.orchestra.run.smithi179.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T07:00:54.158 INFO:teuthology.orchestra.run.smithi179.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T07:00:54.158 INFO:teuthology.orchestra.run.smithi179.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T07:00:54.158 INFO:teuthology.orchestra.run.smithi179.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T07:00:54.158 INFO:teuthology.orchestra.run.smithi179.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T07:00:54.158 INFO:teuthology.orchestra.run.smithi179.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T07:00:54.158 INFO:teuthology.orchestra.run.smithi179.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T07:00:54.158 INFO:teuthology.orchestra.run.smithi179.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T07:00:54.159 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:54.159 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:54.159 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:00:54.159 INFO:teuthology.orchestra.run.smithi179.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T07:00:54.159 INFO:teuthology.orchestra.run.smithi179.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T07:00:54.159 INFO:teuthology.orchestra.run.smithi179.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T07:00:54.159 INFO:teuthology.orchestra.run.smithi179.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T07:00:54.159 INFO:teuthology.orchestra.run.smithi179.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T07:00:54.159 INFO:teuthology.orchestra.run.smithi179.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T07:00:54.160 INFO:teuthology.orchestra.run.smithi179.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T07:00:54.160 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-19T07:00:54.160 INFO:teuthology.orchestra.run.smithi179.stdout:Complete! 2024-09-19T07:00:54.593 DEBUG:teuthology.parallel:result is None 2024-09-19T07:00:54.593 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T07:00:54.749 DEBUG:teuthology.orchestra.run.smithi148:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T07:00:54.775 INFO:teuthology.orchestra.run.smithi148.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T07:00:54.776 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T07:00:54.776 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T07:00:54.778 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T07:00:54.931 DEBUG:teuthology.orchestra.run.smithi165:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T07:00:54.957 INFO:teuthology.orchestra.run.smithi165.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T07:00:54.957 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T07:00:54.958 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T07:00:54.960 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T07:00:55.107 DEBUG:teuthology.orchestra.run.smithi179:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T07:00:55.130 INFO:teuthology.orchestra.run.smithi179.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T07:00:55.131 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T07:00:55.131 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T07:00:55.133 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-19T07:00:55.133 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-19T07:00:55.133 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T07:00:55.165 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-19T07:00:55.165 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T07:00:55.199 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-19T07:00:55.199 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T07:00:55.229 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-19T07:00:55.229 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-19T07:00:55.229 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T07:00:55.258 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T07:00:55.326 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-19T07:00:55.326 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T07:00:55.356 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T07:00:55.425 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-19T07:00:55.425 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T07:00:55.452 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T07:00:55.518 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-19T07:00:55.518 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-19T07:00:55.519 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T07:00:55.548 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T07:00:55.615 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-19T07:00:55.615 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T07:00:55.644 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T07:00:55.714 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-19T07:00:55.714 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T07:00:55.740 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T07:00:55.804 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-19T07:00:55.805 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-19T07:00:55.805 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T07:00:55.832 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T07:00:55.901 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-19T07:00:55.901 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T07:00:55.929 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T07:00:55.997 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-19T07:00:55.998 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T07:00:56.022 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T07:00:56.088 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-19T07:00:56.221 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-09-19T07:00:56.221 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T07:00:56.222 INFO:tasks.cephadm:Cluster fsid is eae8a4a8-7654-11ef-bceb-c7b262605968 2024-09-19T07:00:56.222 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-19T07:00:56.222 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.148', 'mon.b': '172.21.15.165', 'mon.c': '172.21.15.179'} 2024-09-19T07:00:56.222 INFO:tasks.cephadm:First mon is mon.a on smithi148 2024-09-19T07:00:56.222 INFO:tasks.cephadm:First mgr is x 2024-09-19T07:00:56.222 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-19T07:00:56.223 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname $(hostname -s) 2024-09-19T07:00:56.253 DEBUG:teuthology.orchestra.run.smithi165:> sudo hostname $(hostname -s) 2024-09-19T07:00:56.284 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname $(hostname -s) 2024-09-19T07:00:56.310 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-19T07:00:56.310 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T07:00:56.457 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56106/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-361-g2f599a46', 'node_name': '172.21.2.7+braggi07', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-361.g2f599a46'}, 'url': 'https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-18 17:52:24.287651', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-19T07:00:56.600 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref squid, sha1 2f599a46ad10e37c929e5c43da2f6907ddcd1961 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T07:00:56.602 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T07:00:56.602 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T07:00:56.602 DEBUG:teuthology.orchestra.run.smithi148:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T07:00:56.988 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 07:00 /home/ubuntu/cephtest/cephadm 2024-09-19T07:00:56.989 DEBUG:teuthology.orchestra.run.smithi165:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T07:00:57.381 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 07:00 /home/ubuntu/cephtest/cephadm 2024-09-19T07:00:57.381 DEBUG:teuthology.orchestra.run.smithi179:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T07:00:57.767 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 07:00 /home/ubuntu/cephtest/cephadm 2024-09-19T07:00:57.767 DEBUG:teuthology.orchestra.run.smithi148:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T07:00:57.787 DEBUG:teuthology.orchestra.run.smithi165:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T07:00:57.807 DEBUG:teuthology.orchestra.run.smithi179:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T07:00:57.842 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 on all hosts... 2024-09-19T07:00:57.843 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T07:00:57.845 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T07:00:57.849 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T07:00:59.391 INFO:teuthology.orchestra.run.smithi148.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T07:00:59.442 INFO:teuthology.orchestra.run.smithi165.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T07:00:59.569 INFO:teuthology.orchestra.run.smithi179.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T07:01:31.451 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:01:31.452 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T07:01:31.452 INFO:teuthology.orchestra.run.smithi148.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T07:01:31.452 INFO:teuthology.orchestra.run.smithi148.stdout: "repo_digests": [ 2024-09-19T07:01:31.452 INFO:teuthology.orchestra.run.smithi148.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T07:01:31.452 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-19T07:01:31.452 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:01:35.605 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-19T07:01:35.606 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T07:01:35.606 INFO:teuthology.orchestra.run.smithi179.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T07:01:35.606 INFO:teuthology.orchestra.run.smithi179.stdout: "repo_digests": [ 2024-09-19T07:01:35.606 INFO:teuthology.orchestra.run.smithi179.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T07:01:35.606 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-19T07:01:35.606 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-19T07:01:38.824 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-09-19T07:01:38.824 INFO:teuthology.orchestra.run.smithi165.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T07:01:38.824 INFO:teuthology.orchestra.run.smithi165.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T07:01:38.824 INFO:teuthology.orchestra.run.smithi165.stdout: "repo_digests": [ 2024-09-19T07:01:38.825 INFO:teuthology.orchestra.run.smithi165.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T07:01:38.825 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-09-19T07:01:38.825 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-09-19T07:01:38.849 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /etc/ceph 2024-09-19T07:01:38.883 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /etc/ceph 2024-09-19T07:01:38.910 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /etc/ceph 2024-09-19T07:01:38.944 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 777 /etc/ceph 2024-09-19T07:01:38.972 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 777 /etc/ceph 2024-09-19T07:01:38.997 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 777 /etc/ceph 2024-09-19T07:01:39.025 INFO:tasks.cephadm:Writing seed config... 2024-09-19T07:01:39.027 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-19T07:01:39.027 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-19T07:01:39.027 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-19T07:01:39.027 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-19T07:01:39.027 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-19T07:01:39.027 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-19T07:01:39.027 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-19T07:01:39.027 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-19T07:01:39.027 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-19T07:01:39.027 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-19T07:01:39.027 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-19T07:01:39.028 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-19T07:01:39.028 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-19T07:01:39.028 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-19T07:01:39.028 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-19T07:01:39.028 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-19T07:01:39.028 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-19T07:01:39.028 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-09-19T07:01:39.028 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-19T07:01:39.028 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-19T07:01:39.028 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-19T07:01:39.028 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-19T07:01:39.028 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-09-19T07:01:39.028 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-19T07:01:39.029 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-19T07:01:39.029 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-19T07:01:39.029 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-19T07:01:39.029 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-19T07:01:39.029 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-19T07:01:39.029 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-19T07:01:39.029 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-19T07:01:39.029 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-19T07:01:39.029 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-19T07:01:39.029 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-19T07:01:39.029 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-19T07:01:39.029 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-19T07:01:39.029 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-19T07:01:39.029 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-19T07:01:39.030 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-19T07:01:39.030 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-19T07:01:39.030 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-19T07:01:39.030 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-19T07:01:39.030 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-19T07:01:39.030 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-19T07:01:39.030 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-19T07:01:39.030 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-19T07:01:39.030 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-19T07:01:39.030 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-19T07:01:39.031 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-19T07:01:39.031 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-19T07:01:39.031 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-19T07:01:39.031 DEBUG:teuthology.orchestra.run.smithi148:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-19T07:01:39.049 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = eae8a4a8-7654-11ef-bceb-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-19T07:01:39.049 DEBUG:teuthology.orchestra.run.smithi148:mon.a> sudo journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mon.a.service 2024-09-19T07:01:39.091 DEBUG:teuthology.orchestra.run.smithi148:mgr.x> sudo journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mgr.x.service 2024-09-19T07:01:39.134 INFO:tasks.cephadm:Bootstrapping... 2024-09-19T07:01:39.135 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 -v bootstrap --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.148 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-19T07:01:39.338 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-19T07:01:39.339 INFO:teuthology.orchestra.run.smithi148.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961', '-v', 'bootstrap', '--fsid', 'eae8a4a8-7654-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.148', '--skip-admin-label'] 2024-09-19T07:01:39.339 INFO:teuthology.orchestra.run.smithi148.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-19T07:01:39.339 INFO:teuthology.orchestra.run.smithi148.stdout:Verifying podman|docker is present... 2024-09-19T07:01:39.363 INFO:teuthology.orchestra.run.smithi148.stdout:/bin/podman: stdout 5.2.2 2024-09-19T07:01:39.363 INFO:teuthology.orchestra.run.smithi148.stdout:Verifying lvm2 is present... 2024-09-19T07:01:39.363 INFO:teuthology.orchestra.run.smithi148.stdout:Verifying time synchronization is in place... 2024-09-19T07:01:39.371 INFO:teuthology.orchestra.run.smithi148.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T07:01:39.371 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T07:01:39.377 INFO:teuthology.orchestra.run.smithi148.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T07:01:39.377 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stdout inactive 2024-09-19T07:01:39.384 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stdout enabled 2024-09-19T07:01:39.390 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stdout active 2024-09-19T07:01:39.390 INFO:teuthology.orchestra.run.smithi148.stdout:Unit chronyd.service is enabled and running 2024-09-19T07:01:39.390 INFO:teuthology.orchestra.run.smithi148.stdout:Repeating the final host check... 2024-09-19T07:01:39.413 INFO:teuthology.orchestra.run.smithi148.stdout:/bin/podman: stdout 5.2.2 2024-09-19T07:01:39.413 INFO:teuthology.orchestra.run.smithi148.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-19T07:01:39.413 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl is present 2024-09-19T07:01:39.414 INFO:teuthology.orchestra.run.smithi148.stdout:lvcreate is present 2024-09-19T07:01:39.420 INFO:teuthology.orchestra.run.smithi148.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T07:01:39.420 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T07:01:39.426 INFO:teuthology.orchestra.run.smithi148.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T07:01:39.426 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stdout inactive 2024-09-19T07:01:39.433 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stdout enabled 2024-09-19T07:01:39.440 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stdout active 2024-09-19T07:01:39.440 INFO:teuthology.orchestra.run.smithi148.stdout:Unit chronyd.service is enabled and running 2024-09-19T07:01:39.440 INFO:teuthology.orchestra.run.smithi148.stdout:Host looks OK 2024-09-19T07:01:39.440 INFO:teuthology.orchestra.run.smithi148.stdout:Cluster fsid: eae8a4a8-7654-11ef-bceb-c7b262605968 2024-09-19T07:01:39.440 INFO:teuthology.orchestra.run.smithi148.stdout:Acquiring lock 139961678164992 on /run/cephadm/eae8a4a8-7654-11ef-bceb-c7b262605968.lock 2024-09-19T07:01:39.440 INFO:teuthology.orchestra.run.smithi148.stdout:Lock 139961678164992 acquired on /run/cephadm/eae8a4a8-7654-11ef-bceb-c7b262605968.lock 2024-09-19T07:01:39.440 INFO:teuthology.orchestra.run.smithi148.stdout:Verifying IP 172.21.15.148 port 3300 ... 2024-09-19T07:01:39.441 INFO:teuthology.orchestra.run.smithi148.stdout:Verifying IP 172.21.15.148 port 6789 ... 2024-09-19T07:01:39.441 INFO:teuthology.orchestra.run.smithi148.stdout:Base mon IP(s) is [172.21.15.148:3300, 172.21.15.148:6789], mon addrv is [v2:172.21.15.148:3300,v1:172.21.15.148:6789] 2024-09-19T07:01:39.444 INFO:teuthology.orchestra.run.smithi148.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.148 metric 100 2024-09-19T07:01:39.444 INFO:teuthology.orchestra.run.smithi148.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.148 metric 100 2024-09-19T07:01:39.447 INFO:teuthology.orchestra.run.smithi148.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-19T07:01:39.447 INFO:teuthology.orchestra.run.smithi148.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-19T07:01:39.447 INFO:teuthology.orchestra.run.smithi148.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-19T07:01:39.449 INFO:teuthology.orchestra.run.smithi148.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-19T07:01:39.449 INFO:teuthology.orchestra.run.smithi148.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-19T07:01:39.449 INFO:teuthology.orchestra.run.smithi148.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T07:01:39.452 INFO:teuthology.orchestra.run.smithi148.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-19T07:01:39.452 INFO:teuthology.orchestra.run.smithi148.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe88:7257/64 scope link noprefixroute 2024-09-19T07:01:39.452 INFO:teuthology.orchestra.run.smithi148.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T07:01:39.453 INFO:teuthology.orchestra.run.smithi148.stdout:Mon IP `172.21.15.148` is in CIDR network `172.21.0.0/20` 2024-09-19T07:01:39.453 INFO:teuthology.orchestra.run.smithi148.stdout:Mon IP `172.21.15.148` is in CIDR network `172.21.0.0/20` 2024-09-19T07:01:39.453 INFO:teuthology.orchestra.run.smithi148.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-19T07:01:39.453 INFO:teuthology.orchestra.run.smithi148.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-19T07:01:39.453 INFO:teuthology.orchestra.run.smithi148.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T07:01:39.928 INFO:teuthology.orchestra.run.smithi148.stdout:/bin/podman: stdout d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T07:01:39.929 INFO:teuthology.orchestra.run.smithi148.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T07:01:39.929 INFO:teuthology.orchestra.run.smithi148.stdout:/bin/podman: stderr Getting image source signatures 2024-09-19T07:01:39.929 INFO:teuthology.orchestra.run.smithi148.stdout:/bin/podman: stderr Copying blob sha256:c4221751d16d26d2a4b7031ebd71ecffffff13c8cf7401cf95ce80dab3b6d67a 2024-09-19T07:01:39.929 INFO:teuthology.orchestra.run.smithi148.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-19T07:01:39.929 INFO:teuthology.orchestra.run.smithi148.stdout:/bin/podman: stderr Copying config sha256:d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T07:01:39.929 INFO:teuthology.orchestra.run.smithi148.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-19T07:01:40.833 INFO:teuthology.orchestra.run.smithi148.stdout:ceph: stdout ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T07:01:40.833 INFO:teuthology.orchestra.run.smithi148.stdout:Ceph version: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T07:01:40.833 INFO:teuthology.orchestra.run.smithi148.stdout:Extracting ceph user uid/gid from container image... 2024-09-19T07:01:41.763 INFO:teuthology.orchestra.run.smithi148.stdout:stat: stdout 167 167 2024-09-19T07:01:41.763 INFO:teuthology.orchestra.run.smithi148.stdout:Creating initial keys... 2024-09-19T07:01:42.645 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph-authtool: stdout AQBWzOtmGpM7BxAAroCunXkHeqUXxol8kbK5WA== 2024-09-19T07:01:43.615 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph-authtool: stdout AQBWzOtmzek1OBAAVNv1jdsKqJ1KBodZxVIRlg== 2024-09-19T07:01:44.579 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph-authtool: stdout AQBXzOtmtfz/NRAAV8IVk7cqq7WAh0YmaTgWgA== 2024-09-19T07:01:44.580 INFO:teuthology.orchestra.run.smithi148.stdout:Creating initial monmap... 2024-09-19T07:01:45.501 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T07:01:45.502 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-19T07:01:45.502 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to eae8a4a8-7654-11ef-bceb-c7b262605968 2024-09-19T07:01:45.502 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T07:01:45.502 INFO:teuthology.orchestra.run.smithi148.stdout:monmaptool for a [v2:172.21.15.148:3300,v1:172.21.15.148:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T07:01:45.502 INFO:teuthology.orchestra.run.smithi148.stdout:setting min_mon_release = quincy 2024-09-19T07:01:45.502 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/monmaptool: set fsid to eae8a4a8-7654-11ef-bceb-c7b262605968 2024-09-19T07:01:45.502 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T07:01:45.502 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:01:45.502 INFO:teuthology.orchestra.run.smithi148.stdout:Creating mon... 2024-09-19T07:01:46.424 INFO:teuthology.orchestra.run.smithi148.stdout:create mon.a on 2024-09-19T07:01:46.634 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-19T07:01:46.793 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-19T07:01:46.984 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-eae8a4a8-7654-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-eae8a4a8-7654-11ef-bceb-c7b262605968.target. 2024-09-19T07:01:46.984 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-eae8a4a8-7654-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-eae8a4a8-7654-11ef-bceb-c7b262605968.target. 2024-09-19T07:01:47.242 INFO:teuthology.orchestra.run.smithi148.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mon.a 2024-09-19T07:01:47.242 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stderr Failed to reset failed state of unit ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-19T07:01:47.413 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-eae8a4a8-7654-11ef-bceb-c7b262605968.target.wants/ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mon.a.service → /etc/systemd/system/ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@.service. 2024-09-19T07:01:47.898 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:47 smithi148 ceph-mon[30818]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T07:01:47.941 INFO:teuthology.orchestra.run.smithi148.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T07:01:47.941 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stdout disabled 2024-09-19T07:01:47.948 INFO:teuthology.orchestra.run.smithi148.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T07:01:47.949 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stdout inactive 2024-09-19T07:01:47.949 INFO:teuthology.orchestra.run.smithi148.stdout:firewalld.service is not enabled 2024-09-19T07:01:47.949 INFO:teuthology.orchestra.run.smithi148.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T07:01:47.949 INFO:teuthology.orchestra.run.smithi148.stdout:Waiting for mon to start... 2024-09-19T07:01:47.949 INFO:teuthology.orchestra.run.smithi148.stdout:Waiting for mon... 2024-09-19T07:01:48.213 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:47 smithi148 bash[30799]: b56d58ae38f50a0a83cb1e45360ace066ae3ecacbf1da63e7be4b124e782094a 2024-09-19T07:01:48.213 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:47 smithi148 systemd[1]: Started Ceph mon.a for eae8a4a8-7654-11ef-bceb-c7b262605968. 2024-09-19T07:01:49.009 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout cluster: 2024-09-19T07:01:49.015 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout id: eae8a4a8-7654-11ef-bceb-c7b262605968 2024-09-19T07:01:49.015 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-19T07:01:49.015 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout 2024-09-19T07:01:49.015 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout services: 2024-09-19T07:01:49.015 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.569052s) 2024-09-19T07:01:49.016 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-19T07:01:49.016 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-19T07:01:49.016 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout 2024-09-19T07:01:49.016 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout data: 2024-09-19T07:01:49.016 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-19T07:01:49.016 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-19T07:01:49.016 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-19T07:01:49.016 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout pgs: 2024-09-19T07:01:49.016 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout 2024-09-19T07:01:49.016 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:48.388+0000 7f3b57fd0640 1 Processor -- start 2024-09-19T07:01:49.016 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:48.388+0000 7f3b57fd0640 1 -- start start 2024-09-19T07:01:49.016 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:48.388+0000 7f3b57fd0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b5007dde0 0x7f3b5007c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:49.017 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:48.388+0000 7f3b57fd0640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5007c780 con 0x7f3b5007dde0 2024-09-19T07:01:49.017 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:48.389+0000 7f3b55d6c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b5007dde0 0x7f3b5007c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:49.017 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:48.389+0000 7f3b55d6c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b5007dde0 0x7f3b5007c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42090/0 (socket says 172.21.15.148:42090) 2024-09-19T07:01:49.017 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:48.389+0000 7f3b55d6c640 1 -- 172.21.15.148:0/486171941 learned_addr learned my addr 172.21.15.148:0/486171941 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:01:49.017 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:48.389+0000 7f3b55d6c640 1 -- 172.21.15.148:0/486171941 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b5007c900 con 0x7f3b5007dde0 2024-09-19T07:01:49.017 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:48.391+0000 7f3b55d6c640 1 --2- 172.21.15.148:0/486171941 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b5007dde0 0x7f3b5007c240 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3b48009820 tx=0x7f3b4802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8a6759f2e53c88 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:01:49.017 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:48.391+0000 7f3b54d6a640 1 -- 172.21.15.148:0/486171941 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b48037070 con 0x7f3b5007dde0 2024-09-19T07:01:49.017 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:48.391+0000 7f3b54d6a640 1 -- 172.21.15.148:0/486171941 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b48032440 con 0x7f3b5007dde0 2024-09-19T07:01:49.017 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:48.391+0000 7f3b54d6a640 1 -- 172.21.15.148:0/486171941 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b48032740 con 0x7f3b5007dde0 2024-09-19T07:01:49.017 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:48.391+0000 7f3b57fd0640 1 -- 172.21.15.148:0/486171941 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b5007dde0 msgr2=0x7f3b5007c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:49.017 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:48.391+0000 7f3b57fd0640 1 --2- 172.21.15.148:0/486171941 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b5007dde0 0x7f3b5007c240 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3b48009820 tx=0x7f3b4802a270 comp rx=0 tx=0).stop 2024-09-19T07:01:49.017 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:48.391+0000 7f3b57fd0640 1 -- 172.21.15.148:0/486171941 shutdown_connections 2024-09-19T07:01:49.018 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:48.392+0000 7f3b57fd0640 1 --2- 172.21.15.148:0/486171941 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b5007dde0 0x7f3b5007c240 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:49.018 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:48.392+0000 7f3b57fd0640 1 -- 172.21.15.148:0/486171941 >> 172.21.15.148:0/486171941 conn(0x7f3b50102f60 msgr2=0x7f3b501053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:01:49.018 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:48.392+0000 7f3b57fd0640 1 -- 172.21.15.148:0/486171941 shutdown_connections 2024-09-19T07:01:49.018 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:48.392+0000 7f3b57fd0640 1 -- 172.21.15.148:0/486171941 wait complete. 2024-09-19T07:01:49.018 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:48.392+0000 7f3b57fd0640 1 Processor -- start 2024-09-19T07:01:49.018 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:48.392+0000 7f3b57fd0640 1 -- start start 2024-09-19T07:01:49.018 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:48.392+0000 7f3b57fd0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b5007dde0 0x7f3b5019d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:49.018 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:48.392+0000 7f3b57fd0640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5007ce30 con 0x7f3b5007dde0 2024-09-19T07:01:49.018 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:48.392+0000 7f3b55d6c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b5007dde0 0x7f3b5019d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:49.018 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:48.392+0000 7f3b55d6c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b5007dde0 0x7f3b5019d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42104/0 (socket says 172.21.15.148:42104) 2024-09-19T07:01:49.018 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:48.392+0000 7f3b55d6c640 1 -- 172.21.15.148:0/737581348 learned_addr learned my addr 172.21.15.148:0/737581348 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:01:49.018 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:48.393+0000 7f3b55d6c640 1 -- 172.21.15.148:0/737581348 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b5019d6b0 con 0x7f3b5007dde0 2024-09-19T07:01:49.018 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:48.393+0000 7f3b55d6c640 1 --2- 172.21.15.148:0/737581348 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b5007dde0 0x7f3b5019d170 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f3b480090b0 tx=0x7f3b480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:01:49.019 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:48.393+0000 7f3b4effd640 1 -- 172.21.15.148:0/737581348 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b48041070 con 0x7f3b5007dde0 2024-09-19T07:01:49.019 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:48.393+0000 7f3b4effd640 1 -- 172.21.15.148:0/737581348 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b4803c7a0 con 0x7f3b5007dde0 2024-09-19T07:01:49.019 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:48.393+0000 7f3b4effd640 1 -- 172.21.15.148:0/737581348 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b48037040 con 0x7f3b5007dde0 2024-09-19T07:01:49.019 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:48.393+0000 7f3b57fd0640 1 -- 172.21.15.148:0/737581348 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b5019d940 con 0x7f3b5007dde0 2024-09-19T07:01:49.019 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:48.393+0000 7f3b57fd0640 1 -- 172.21.15.148:0/737581348 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b501a0630 con 0x7f3b5007dde0 2024-09-19T07:01:49.019 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:48.393+0000 7f3b4effd640 1 -- 172.21.15.148:0/737581348 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3b48044070 con 0x7f3b5007dde0 2024-09-19T07:01:49.019 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:48.393+0000 7f3b4effd640 1 -- 172.21.15.148:0/737581348 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3b4803d3f0 con 0x7f3b5007dde0 2024-09-19T07:01:49.019 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:48.394+0000 7f3b57fd0640 1 -- 172.21.15.148:0/737581348 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b5007c240 con 0x7f3b5007dde0 2024-09-19T07:01:49.019 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:48.396+0000 7f3b4effd640 1 -- 172.21.15.148:0/737581348 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f3b48046450 con 0x7f3b5007dde0 2024-09-19T07:01:49.019 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:48.458+0000 7f3b57fd0640 1 -- 172.21.15.148:0/737581348 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f3b5002d910 con 0x7f3b5007dde0 2024-09-19T07:01:49.019 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:48.458+0000 7f3b4effd640 1 -- 172.21.15.148:0/737581348 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f3b48046630 con 0x7f3b5007dde0 2024-09-19T07:01:49.019 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:48.459+0000 7f3b57fd0640 1 -- 172.21.15.148:0/737581348 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b5007dde0 msgr2=0x7f3b5019d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:49.020 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:48.459+0000 7f3b57fd0640 1 --2- 172.21.15.148:0/737581348 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b5007dde0 0x7f3b5019d170 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f3b480090b0 tx=0x7f3b480046c0 comp rx=0 tx=0).stop 2024-09-19T07:01:49.020 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:48.459+0000 7f3b57fd0640 1 -- 172.21.15.148:0/737581348 shutdown_connections 2024-09-19T07:01:49.020 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:48.459+0000 7f3b57fd0640 1 --2- 172.21.15.148:0/737581348 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b5007dde0 0x7f3b5019d170 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:49.020 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:48.459+0000 7f3b57fd0640 1 -- 172.21.15.148:0/737581348 >> 172.21.15.148:0/737581348 conn(0x7f3b50102f60 msgr2=0x7f3b50103f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:01:49.020 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:48.459+0000 7f3b57fd0640 1 -- 172.21.15.148:0/737581348 shutdown_connections 2024-09-19T07:01:49.020 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:48.459+0000 7f3b57fd0640 1 -- 172.21.15.148:0/737581348 wait complete. 2024-09-19T07:01:49.020 INFO:teuthology.orchestra.run.smithi148.stdout:mon is available 2024-09-19T07:01:49.020 INFO:teuthology.orchestra.run.smithi148.stdout:Assimilating anything we can from ceph.conf... 2024-09-19T07:01:49.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:48 smithi148 ceph-mon[30818]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T07:01:49.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:48 smithi148 ceph-mon[30818]: monmap epoch 1 2024-09-19T07:01:49.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:48 smithi148 ceph-mon[30818]: fsid eae8a4a8-7654-11ef-bceb-c7b262605968 2024-09-19T07:01:49.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:48 smithi148 ceph-mon[30818]: last_changed 2024-09-19T07:01:44.959428+0000 2024-09-19T07:01:49.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:48 smithi148 ceph-mon[30818]: created 2024-09-19T07:01:44.959428+0000 2024-09-19T07:01:49.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:48 smithi148 ceph-mon[30818]: min_mon_release 19 (squid) 2024-09-19T07:01:49.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:48 smithi148 ceph-mon[30818]: election_strategy: 1 2024-09-19T07:01:49.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:48 smithi148 ceph-mon[30818]: 0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-19T07:01:49.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:48 smithi148 ceph-mon[30818]: fsmap 2024-09-19T07:01:49.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:48 smithi148 ceph-mon[30818]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T07:01:49.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:48 smithi148 ceph-mon[30818]: mgrmap e1: no daemons active 2024-09-19T07:01:49.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:48 smithi148 ceph-mon[30818]: from='client.? 172.21.15.148:0/737581348' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-19T07:01:50.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:49 smithi148 ceph-mon[30818]: from='client.? 172.21.15.148:0/109422369' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T07:01:50.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:49 smithi148 ceph-mon[30818]: from='client.? 172.21.15.148:0/109422369' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-19T07:01:50.113 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout 2024-09-19T07:01:50.113 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T07:01:50.113 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout fsid = eae8a4a8-7654-11ef-bceb-c7b262605968 2024-09-19T07:01:50.113 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.148:3300,v1:172.21.15.148:6789] 2024-09-19T07:01:50.113 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T07:01:50.113 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T07:01:50.113 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T07:01:50.113 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T07:01:50.113 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout 2024-09-19T07:01:50.113 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T07:01:50.114 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T07:01:50.114 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout 2024-09-19T07:01:50.114 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T07:01:50.114 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T07:01:50.114 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T07:01:50.114 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T07:01:50.114 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T07:01:50.114 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T07:01:50.114 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:49.403+0000 7f9c36cdf640 1 Processor -- start 2024-09-19T07:01:50.114 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:49.403+0000 7f9c36cdf640 1 -- start start 2024-09-19T07:01:50.114 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:49.403+0000 7f9c36cdf640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c30107cc0 0x7f9c301080c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:50.114 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:49.403+0000 7f9c36cdf640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9c30108690 con 0x7f9c30107cc0 2024-09-19T07:01:50.114 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:49.404+0000 7f9c34a7b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c30107cc0 0x7f9c301080c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:50.114 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:49.404+0000 7f9c34a7b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c30107cc0 0x7f9c301080c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42108/0 (socket says 172.21.15.148:42108) 2024-09-19T07:01:50.115 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:49.404+0000 7f9c34a7b640 1 -- 172.21.15.148:0/3892141577 learned_addr learned my addr 172.21.15.148:0/3892141577 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:01:50.115 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:49.404+0000 7f9c34a7b640 1 -- 172.21.15.148:0/3892141577 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c30106920 con 0x7f9c30107cc0 2024-09-19T07:01:50.115 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:49.404+0000 7f9c34a7b640 1 --2- 172.21.15.148:0/3892141577 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c30107cc0 0x7f9c301080c0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f9c20009820 tx=0x7f9c2002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b8b57932418dd94 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:01:50.115 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:49.405+0000 7f9c2f7fe640 1 -- 172.21.15.148:0/3892141577 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c20037070 con 0x7f9c30107cc0 2024-09-19T07:01:50.115 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:49.405+0000 7f9c2f7fe640 1 -- 172.21.15.148:0/3892141577 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c20032440 con 0x7f9c30107cc0 2024-09-19T07:01:50.115 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:49.405+0000 7f9c2f7fe640 1 -- 172.21.15.148:0/3892141577 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c20032740 con 0x7f9c30107cc0 2024-09-19T07:01:50.115 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:49.405+0000 7f9c36cdf640 1 -- 172.21.15.148:0/3892141577 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c30107cc0 msgr2=0x7f9c301080c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:50.115 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:49.405+0000 7f9c36cdf640 1 --2- 172.21.15.148:0/3892141577 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c30107cc0 0x7f9c301080c0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f9c20009820 tx=0x7f9c2002a270 comp rx=0 tx=0).stop 2024-09-19T07:01:50.115 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:49.405+0000 7f9c36cdf640 1 -- 172.21.15.148:0/3892141577 shutdown_connections 2024-09-19T07:01:50.115 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:49.405+0000 7f9c36cdf640 1 --2- 172.21.15.148:0/3892141577 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c30107cc0 0x7f9c301080c0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:50.115 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:49.405+0000 7f9c36cdf640 1 -- 172.21.15.148:0/3892141577 >> 172.21.15.148:0/3892141577 conn(0x7f9c30101600 msgr2=0x7f9c30103a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:01:50.115 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:49.405+0000 7f9c36cdf640 1 -- 172.21.15.148:0/3892141577 shutdown_connections 2024-09-19T07:01:50.116 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:49.405+0000 7f9c36cdf640 1 -- 172.21.15.148:0/3892141577 wait complete. 2024-09-19T07:01:50.116 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:49.406+0000 7f9c36cdf640 1 Processor -- start 2024-09-19T07:01:50.116 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:49.406+0000 7f9c36cdf640 1 -- start start 2024-09-19T07:01:50.116 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:49.406+0000 7f9c36cdf640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c30107cc0 0x7f9c301906a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:50.116 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:49.406+0000 7f9c36cdf640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9c30106df0 con 0x7f9c30107cc0 2024-09-19T07:01:50.116 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:49.406+0000 7f9c34a7b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c30107cc0 0x7f9c301906a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:50.116 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:49.406+0000 7f9c34a7b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c30107cc0 0x7f9c301906a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42110/0 (socket says 172.21.15.148:42110) 2024-09-19T07:01:50.116 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:49.406+0000 7f9c34a7b640 1 -- 172.21.15.148:0/109422369 learned_addr learned my addr 172.21.15.148:0/109422369 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:01:50.116 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:49.406+0000 7f9c34a7b640 1 -- 172.21.15.148:0/109422369 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c30190be0 con 0x7f9c30107cc0 2024-09-19T07:01:50.116 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:49.407+0000 7f9c34a7b640 1 --2- 172.21.15.148:0/109422369 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c30107cc0 0x7f9c301906a0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f9c200090b0 tx=0x7f9c200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:01:50.116 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:49.407+0000 7f9c2dffb640 1 -- 172.21.15.148:0/109422369 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c20041070 con 0x7f9c30107cc0 2024-09-19T07:01:50.116 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:49.407+0000 7f9c2dffb640 1 -- 172.21.15.148:0/109422369 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c2003c7a0 con 0x7f9c30107cc0 2024-09-19T07:01:50.116 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:49.407+0000 7f9c36cdf640 1 -- 172.21.15.148:0/109422369 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c3018edd0 con 0x7f9c30107cc0 2024-09-19T07:01:50.116 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:49.407+0000 7f9c2dffb640 1 -- 172.21.15.148:0/109422369 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c20037040 con 0x7f9c30107cc0 2024-09-19T07:01:50.117 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:49.407+0000 7f9c36cdf640 1 -- 172.21.15.148:0/109422369 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c3018f310 con 0x7f9c30107cc0 2024-09-19T07:01:50.117 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:49.407+0000 7f9c2dffb640 1 -- 172.21.15.148:0/109422369 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9c20044070 con 0x7f9c30107cc0 2024-09-19T07:01:50.117 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:49.407+0000 7f9c2dffb640 1 -- 172.21.15.148:0/109422369 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9c2003d3f0 con 0x7f9c30107cc0 2024-09-19T07:01:50.117 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:49.408+0000 7f9c36cdf640 1 -- 172.21.15.148:0/109422369 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c301074b0 con 0x7f9c30107cc0 2024-09-19T07:01:50.117 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:49.410+0000 7f9c2dffb640 1 -- 172.21.15.148:0/109422369 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f9c20046450 con 0x7f9c30107cc0 2024-09-19T07:01:50.117 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:49.469+0000 7f9c36cdf640 1 -- 172.21.15.148:0/109422369 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f9c30194350 con 0x7f9c30107cc0 2024-09-19T07:01:50.117 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:49.472+0000 7f9c2dffb640 1 -- 172.21.15.148:0/109422369 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+431 (secure 0 0 0) 0x7f9c20046630 con 0x7f9c30107cc0 2024-09-19T07:01:50.117 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:49.473+0000 7f9c2dffb640 1 -- 172.21.15.148:0/109422369 <== mon.0 v2:172.21.15.148:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9c20056070 con 0x7f9c30107cc0 2024-09-19T07:01:50.117 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:49.473+0000 7f9c36cdf640 1 -- 172.21.15.148:0/109422369 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c30107cc0 msgr2=0x7f9c301906a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:50.118 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:49.473+0000 7f9c36cdf640 1 --2- 172.21.15.148:0/109422369 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c30107cc0 0x7f9c301906a0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f9c200090b0 tx=0x7f9c200046c0 comp rx=0 tx=0).stop 2024-09-19T07:01:50.118 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:49.473+0000 7f9c36cdf640 1 -- 172.21.15.148:0/109422369 shutdown_connections 2024-09-19T07:01:50.118 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:49.473+0000 7f9c36cdf640 1 --2- 172.21.15.148:0/109422369 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c30107cc0 0x7f9c301906a0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:50.118 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:49.473+0000 7f9c36cdf640 1 -- 172.21.15.148:0/109422369 >> 172.21.15.148:0/109422369 conn(0x7f9c30101600 msgr2=0x7f9c3018e030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:01:50.118 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:49.474+0000 7f9c36cdf640 1 -- 172.21.15.148:0/109422369 shutdown_connections 2024-09-19T07:01:50.118 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:49.474+0000 7f9c36cdf640 1 -- 172.21.15.148:0/109422369 wait complete. 2024-09-19T07:01:50.118 INFO:teuthology.orchestra.run.smithi148.stdout:Generating new minimal ceph.conf... 2024-09-19T07:01:51.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:50 smithi148 ceph-mon[30818]: from='client.? 172.21.15.148:0/1940988171' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:01:51.126 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:50.459+0000 7f4156c50640 1 Processor -- start 2024-09-19T07:01:51.126 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:50.459+0000 7f4156c50640 1 -- start start 2024-09-19T07:01:51.126 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:50.459+0000 7f4156c50640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41501077d0 0x7f4150107bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:51.126 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:50.459+0000 7f4156c50640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f41501081a0 con 0x7f41501077d0 2024-09-19T07:01:51.126 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:50.459+0000 7f41549ec640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41501077d0 0x7f4150107bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:51.126 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:50.459+0000 7f41549ec640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41501077d0 0x7f4150107bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42116/0 (socket says 172.21.15.148:42116) 2024-09-19T07:01:51.127 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:50.459+0000 7f41549ec640 1 -- 172.21.15.148:0/1616967481 learned_addr learned my addr 172.21.15.148:0/1616967481 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:01:51.127 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:50.460+0000 7f41549ec640 1 -- 172.21.15.148:0/1616967481 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41501089d0 con 0x7f41501077d0 2024-09-19T07:01:51.127 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:50.460+0000 7f41549ec640 1 --2- 172.21.15.148:0/1616967481 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41501077d0 0x7f4150107bd0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f4144009820 tx=0x7f414402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6b23234ff377181 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:01:51.127 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:50.460+0000 7f414f7fe640 1 -- 172.21.15.148:0/1616967481 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4144037070 con 0x7f41501077d0 2024-09-19T07:01:51.127 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:50.461+0000 7f414f7fe640 1 -- 172.21.15.148:0/1616967481 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4144032900 con 0x7f41501077d0 2024-09-19T07:01:51.127 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:50.461+0000 7f414f7fe640 1 -- 172.21.15.148:0/1616967481 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4144030850 con 0x7f41501077d0 2024-09-19T07:01:51.127 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:50.461+0000 7f4156c50640 1 -- 172.21.15.148:0/1616967481 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41501077d0 msgr2=0x7f4150107bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:51.127 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:50.461+0000 7f4156c50640 1 --2- 172.21.15.148:0/1616967481 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41501077d0 0x7f4150107bd0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f4144009820 tx=0x7f414402a270 comp rx=0 tx=0).stop 2024-09-19T07:01:51.127 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:50.461+0000 7f4156c50640 1 -- 172.21.15.148:0/1616967481 shutdown_connections 2024-09-19T07:01:51.127 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:50.461+0000 7f4156c50640 1 --2- 172.21.15.148:0/1616967481 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41501077d0 0x7f4150107bd0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:51.127 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:50.461+0000 7f4156c50640 1 -- 172.21.15.148:0/1616967481 >> 172.21.15.148:0/1616967481 conn(0x7f4150102f60 msgr2=0x7f41501053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:01:51.128 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:50.461+0000 7f4156c50640 1 -- 172.21.15.148:0/1616967481 shutdown_connections 2024-09-19T07:01:51.128 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:50.461+0000 7f4156c50640 1 -- 172.21.15.148:0/1616967481 wait complete. 2024-09-19T07:01:51.128 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:50.462+0000 7f4156c50640 1 Processor -- start 2024-09-19T07:01:51.128 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:50.462+0000 7f4156c50640 1 -- start start 2024-09-19T07:01:51.128 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:50.462+0000 7f4156c50640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41501077d0 0x7f415019b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:51.128 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:50.462+0000 7f4156c50640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f415010bd80 con 0x7f41501077d0 2024-09-19T07:01:51.128 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:50.462+0000 7f41549ec640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41501077d0 0x7f415019b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:51.128 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:50.462+0000 7f41549ec640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41501077d0 0x7f415019b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42118/0 (socket says 172.21.15.148:42118) 2024-09-19T07:01:51.128 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:50.462+0000 7f41549ec640 1 -- 172.21.15.148:0/1940988171 learned_addr learned my addr 172.21.15.148:0/1940988171 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:01:51.128 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:50.462+0000 7f41549ec640 1 -- 172.21.15.148:0/1940988171 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f415019bcd0 con 0x7f41501077d0 2024-09-19T07:01:51.129 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:50.463+0000 7f41549ec640 1 --2- 172.21.15.148:0/1940988171 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41501077d0 0x7f415019b790 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4144009940 tx=0x7f4144032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:01:51.129 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:50.463+0000 7f414dffb640 1 -- 172.21.15.148:0/1940988171 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4144042070 con 0x7f41501077d0 2024-09-19T07:01:51.129 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:50.463+0000 7f414dffb640 1 -- 172.21.15.148:0/1940988171 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f41440308c0 con 0x7f41501077d0 2024-09-19T07:01:51.129 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:50.463+0000 7f4156c50640 1 -- 172.21.15.148:0/1940988171 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f415019bf60 con 0x7f41501077d0 2024-09-19T07:01:51.129 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:50.463+0000 7f414dffb640 1 -- 172.21.15.148:0/1940988171 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4144037040 con 0x7f41501077d0 2024-09-19T07:01:51.129 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:50.463+0000 7f4156c50640 1 -- 172.21.15.148:0/1940988171 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f415019ec50 con 0x7f41501077d0 2024-09-19T07:01:51.129 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:50.463+0000 7f414dffb640 1 -- 172.21.15.148:0/1940988171 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4144045070 con 0x7f41501077d0 2024-09-19T07:01:51.129 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:50.463+0000 7f414dffb640 1 -- 172.21.15.148:0/1940988171 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4144047bb0 con 0x7f41501077d0 2024-09-19T07:01:51.129 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:50.464+0000 7f4156c50640 1 -- 172.21.15.148:0/1940988171 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4150107c50 con 0x7f41501077d0 2024-09-19T07:01:51.129 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:50.466+0000 7f414dffb640 1 -- 172.21.15.148:0/1940988171 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f41440327b0 con 0x7f41501077d0 2024-09-19T07:01:51.129 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:50.523+0000 7f4156c50640 1 -- 172.21.15.148:0/1940988171 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f415019ee20 con 0x7f41501077d0 2024-09-19T07:01:51.130 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:50.523+0000 7f414dffb640 1 -- 172.21.15.148:0/1940988171 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+177 (secure 0 0 0) 0x7f414403c760 con 0x7f41501077d0 2024-09-19T07:01:51.130 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:50.524+0000 7f4156c50640 1 -- 172.21.15.148:0/1940988171 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41501077d0 msgr2=0x7f415019b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:51.130 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:50.524+0000 7f4156c50640 1 --2- 172.21.15.148:0/1940988171 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41501077d0 0x7f415019b790 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4144009940 tx=0x7f4144032ce0 comp rx=0 tx=0).stop 2024-09-19T07:01:51.130 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:50.524+0000 7f4156c50640 1 -- 172.21.15.148:0/1940988171 shutdown_connections 2024-09-19T07:01:51.130 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:50.524+0000 7f4156c50640 1 --2- 172.21.15.148:0/1940988171 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41501077d0 0x7f415019b790 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:51.130 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:50.524+0000 7f4156c50640 1 -- 172.21.15.148:0/1940988171 >> 172.21.15.148:0/1940988171 conn(0x7f4150102f60 msgr2=0x7f4150103b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:01:51.130 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:50.524+0000 7f4156c50640 1 -- 172.21.15.148:0/1940988171 shutdown_connections 2024-09-19T07:01:51.130 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:50.524+0000 7f4156c50640 1 -- 172.21.15.148:0/1940988171 wait complete. 2024-09-19T07:01:51.130 INFO:teuthology.orchestra.run.smithi148.stdout:Restarting the monitor... 2024-09-19T07:01:51.406 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:51 smithi148 systemd[1]: Stopping Ceph mon.a for eae8a4a8-7654-11ef-bceb-c7b262605968... 2024-09-19T07:01:51.789 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:51 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mon-a[30814]: 2024-09-19T07:01:51.404+0000 7f14dd37a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:01:51.789 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:51 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mon-a[30814]: 2024-09-19T07:01:51.404+0000 7f14dd37a640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-19T07:01:51.789 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:51 smithi148 podman[31059]: 2024-09-19 07:01:51.507834548 +0000 UTC m=+0.221073773 container died b56d58ae38f50a0a83cb1e45360ace066ae3ecacbf1da63e7be4b124e782094a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True) 2024-09-19T07:01:52.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:51 smithi148 podman[31059]: 2024-09-19 07:01:51.888227452 +0000 UTC m=+0.601466670 container cleanup b56d58ae38f50a0a83cb1e45360ace066ae3ecacbf1da63e7be4b124e782094a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mon-a, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-19T07:01:52.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:51 smithi148 bash[31059]: ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mon-a 2024-09-19T07:01:52.507 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 podman[31072]: 2024-09-19 07:01:52.157151628 +0000 UTC m=+0.652267757 container remove b56d58ae38f50a0a83cb1e45360ace066ae3ecacbf1da63e7be4b124e782094a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mon-a, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True) 2024-09-19T07:01:52.508 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 systemd[1]: ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-19T07:01:52.508 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 systemd[1]: Stopped Ceph mon.a for eae8a4a8-7654-11ef-bceb-c7b262605968. 2024-09-19T07:01:52.508 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 systemd[1]: Starting Ceph mon.a for eae8a4a8-7654-11ef-bceb-c7b262605968... 2024-09-19T07:01:52.777 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 podman[31161]: 2024-09-19 07:01:52.40880086 +0000 UTC m=+0.015757395 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T07:01:52.777 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 podman[31161]: 2024-09-19 07:01:52.507483832 +0000 UTC m=+0.114440399 container create 7c0ab7162492a83152cb993c7727315c02780aa3214440381f958117d46c2d43 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mon-a, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:01:52.777 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 podman[31161]: 2024-09-19 07:01:52.701469482 +0000 UTC m=+0.308426004 container init 7c0ab7162492a83152cb993c7727315c02780aa3214440381f958117d46c2d43 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:01:52.777 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 podman[31161]: 2024-09-19 07:01:52.704727721 +0000 UTC m=+0.311684244 container start 7c0ab7162492a83152cb993c7727315c02780aa3214440381f958117d46c2d43 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mon-a, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-19T07:01:52.777 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T07:01:52.777 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T07:01:52.777 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: pidfile_write: ignore empty --pid-file 2024-09-19T07:01:52.778 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: load: jerasure load: lrc 2024-09-19T07:01:52.778 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: RocksDB version: 7.9.2 2024-09-19T07:01:52.778 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Git sha 0 2024-09-19T07:01:52.778 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T07:01:52.778 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: DB SUMMARY 2024-09-19T07:01:52.778 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: DB Session ID: H96D47X2WS8YEAN0VC91 2024-09-19T07:01:52.778 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: CURRENT file: CURRENT 2024-09-19T07:01:52.778 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T07:01:52.778 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-19T07:01:52.778 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-19T07:01:52.778 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 106650 ; 2024-09-19T07:01:52.778 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.error_if_exists: 0 2024-09-19T07:01:52.779 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.create_if_missing: 0 2024-09-19T07:01:52.779 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.paranoid_checks: 1 2024-09-19T07:01:52.779 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T07:01:52.779 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T07:01:52.779 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T07:01:52.779 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.env: 0x55917fdc4940 2024-09-19T07:01:52.779 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T07:01:52.780 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.info_log: 0x5591812c96e0 2024-09-19T07:01:52.780 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T07:01:52.780 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.statistics: (nil) 2024-09-19T07:01:52.780 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.use_fsync: 0 2024-09-19T07:01:52.780 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.max_log_file_size: 0 2024-09-19T07:01:52.780 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T07:01:52.780 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T07:01:52.780 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T07:01:52.780 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T07:01:52.780 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.allow_fallocate: 1 2024-09-19T07:01:52.780 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T07:01:52.780 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T07:01:52.780 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.use_direct_reads: 0 2024-09-19T07:01:52.780 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T07:01:52.781 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T07:01:52.781 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.db_log_dir: 2024-09-19T07:01:52.781 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.wal_dir: 2024-09-19T07:01:52.781 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T07:01:52.781 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T07:01:52.781 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T07:01:52.781 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T07:01:52.781 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T07:01:52.781 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T07:01:52.781 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T07:01:52.781 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T07:01:52.781 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.write_buffer_manager: 0x5591812d8dc0 2024-09-19T07:01:52.781 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T07:01:52.781 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T07:01:52.782 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T07:01:52.782 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T07:01:52.782 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T07:01:52.782 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T07:01:52.782 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T07:01:52.782 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T07:01:52.782 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.unordered_write: 0 2024-09-19T07:01:52.782 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T07:01:52.782 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T07:01:52.782 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T07:01:52.782 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T07:01:52.782 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.row_cache: None 2024-09-19T07:01:52.782 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.wal_filter: None 2024-09-19T07:01:52.783 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T07:01:52.783 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T07:01:52.783 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.two_write_queues: 0 2024-09-19T07:01:52.783 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T07:01:52.783 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.wal_compression: 0 2024-09-19T07:01:52.783 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.atomic_flush: 0 2024-09-19T07:01:52.783 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T07:01:52.783 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T07:01:52.783 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T07:01:52.783 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.log_readahead_size: 0 2024-09-19T07:01:52.783 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T07:01:52.783 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T07:01:52.783 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T07:01:52.783 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T07:01:52.783 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T07:01:52.784 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T07:01:52.784 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T07:01:52.784 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.max_background_jobs: 2 2024-09-19T07:01:52.784 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.max_background_compactions: -1 2024-09-19T07:01:52.784 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.max_subcompactions: 1 2024-09-19T07:01:52.784 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T07:01:52.784 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T07:01:52.784 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T07:01:52.784 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T07:01:52.784 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T07:01:52.784 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T07:01:52.784 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T07:01:52.784 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T07:01:52.784 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.max_open_files: -1 2024-09-19T07:01:52.784 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T07:01:52.785 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T07:01:52.785 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T07:01:52.785 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T07:01:52.785 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.max_background_flushes: -1 2024-09-19T07:01:52.785 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Compression algorithms supported: 2024-09-19T07:01:52.785 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: kZSTD supported: 0 2024-09-19T07:01:52.785 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: kXpressCompression supported: 0 2024-09-19T07:01:52.785 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: kBZip2Compression supported: 0 2024-09-19T07:01:52.785 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T07:01:52.785 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: kLZ4Compression supported: 1 2024-09-19T07:01:52.785 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: kZlibCompression supported: 1 2024-09-19T07:01:52.785 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T07:01:52.785 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: kSnappyCompression supported: 1 2024-09-19T07:01:52.786 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T07:01:52.786 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T07:01:52.786 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-19T07:01:52.786 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T07:01:52.786 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T07:01:52.786 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.merge_operator: 2024-09-19T07:01:52.786 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.compaction_filter: None 2024-09-19T07:01:52.786 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T07:01:52.786 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T07:01:52.786 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T07:01:52.786 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T07:01:52.786 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5591812c9320) 2024-09-19T07:01:52.786 INFO:journalctl@ceph.mon.a.smithi148.stdout: cache_index_and_filter_blocks: 1 2024-09-19T07:01:52.787 INFO:journalctl@ceph.mon.a.smithi148.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T07:01:52.787 INFO:journalctl@ceph.mon.a.smithi148.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T07:01:52.787 INFO:journalctl@ceph.mon.a.smithi148.stdout: pin_top_level_index_and_filter: 1 2024-09-19T07:01:52.787 INFO:journalctl@ceph.mon.a.smithi148.stdout: index_type: 0 2024-09-19T07:01:52.787 INFO:journalctl@ceph.mon.a.smithi148.stdout: data_block_index_type: 0 2024-09-19T07:01:52.787 INFO:journalctl@ceph.mon.a.smithi148.stdout: index_shortening: 1 2024-09-19T07:01:52.787 INFO:journalctl@ceph.mon.a.smithi148.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T07:01:52.787 INFO:journalctl@ceph.mon.a.smithi148.stdout: checksum: 4 2024-09-19T07:01:52.787 INFO:journalctl@ceph.mon.a.smithi148.stdout: no_block_cache: 0 2024-09-19T07:01:52.787 INFO:journalctl@ceph.mon.a.smithi148.stdout: block_cache: 0x5591812bd1f0 2024-09-19T07:01:52.787 INFO:journalctl@ceph.mon.a.smithi148.stdout: block_cache_name: BinnedLRUCache 2024-09-19T07:01:52.787 INFO:journalctl@ceph.mon.a.smithi148.stdout: block_cache_options: 2024-09-19T07:01:52.787 INFO:journalctl@ceph.mon.a.smithi148.stdout: capacity : 536870912 2024-09-19T07:01:52.787 INFO:journalctl@ceph.mon.a.smithi148.stdout: num_shard_bits : 4 2024-09-19T07:01:52.788 INFO:journalctl@ceph.mon.a.smithi148.stdout: strict_capacity_limit : 0 2024-09-19T07:01:52.788 INFO:journalctl@ceph.mon.a.smithi148.stdout: high_pri_pool_ratio: 0.000 2024-09-19T07:01:52.788 INFO:journalctl@ceph.mon.a.smithi148.stdout: block_cache_compressed: (nil) 2024-09-19T07:01:52.788 INFO:journalctl@ceph.mon.a.smithi148.stdout: persistent_cache: (nil) 2024-09-19T07:01:52.788 INFO:journalctl@ceph.mon.a.smithi148.stdout: block_size: 4096 2024-09-19T07:01:52.788 INFO:journalctl@ceph.mon.a.smithi148.stdout: block_size_deviation: 10 2024-09-19T07:01:52.788 INFO:journalctl@ceph.mon.a.smithi148.stdout: block_restart_interval: 16 2024-09-19T07:01:52.788 INFO:journalctl@ceph.mon.a.smithi148.stdout: index_block_restart_interval: 1 2024-09-19T07:01:52.788 INFO:journalctl@ceph.mon.a.smithi148.stdout: metadata_block_size: 4096 2024-09-19T07:01:52.788 INFO:journalctl@ceph.mon.a.smithi148.stdout: partition_filters: 0 2024-09-19T07:01:52.789 INFO:journalctl@ceph.mon.a.smithi148.stdout: use_delta_encoding: 1 2024-09-19T07:01:52.789 INFO:journalctl@ceph.mon.a.smithi148.stdout: filter_policy: bloomfilter 2024-09-19T07:01:52.789 INFO:journalctl@ceph.mon.a.smithi148.stdout: whole_key_filtering: 1 2024-09-19T07:01:52.789 INFO:journalctl@ceph.mon.a.smithi148.stdout: verify_compression: 0 2024-09-19T07:01:52.789 INFO:journalctl@ceph.mon.a.smithi148.stdout: read_amp_bytes_per_bit: 0 2024-09-19T07:01:52.789 INFO:journalctl@ceph.mon.a.smithi148.stdout: format_version: 5 2024-09-19T07:01:52.789 INFO:journalctl@ceph.mon.a.smithi148.stdout: enable_index_compression: 1 2024-09-19T07:01:52.789 INFO:journalctl@ceph.mon.a.smithi148.stdout: block_align: 0 2024-09-19T07:01:52.789 INFO:journalctl@ceph.mon.a.smithi148.stdout: max_auto_readahead_size: 262144 2024-09-19T07:01:52.789 INFO:journalctl@ceph.mon.a.smithi148.stdout: prepopulate_block_cache: 0 2024-09-19T07:01:52.789 INFO:journalctl@ceph.mon.a.smithi148.stdout: initial_auto_readahead_size: 8192 2024-09-19T07:01:52.789 INFO:journalctl@ceph.mon.a.smithi148.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T07:01:52.789 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T07:01:52.789 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T07:01:52.790 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.compression: NoCompression 2024-09-19T07:01:52.790 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T07:01:52.790 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T07:01:52.790 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T07:01:52.790 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.num_levels: 7 2024-09-19T07:01:52.790 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T07:01:52.790 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T07:01:52.790 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T07:01:52.790 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T07:01:52.790 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T07:01:52.790 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T07:01:52.790 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T07:01:52.790 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T07:01:52.790 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T07:01:52.791 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T07:01:52.791 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T07:01:52.791 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T07:01:52.791 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T07:01:52.791 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T07:01:52.791 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T07:01:52.791 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T07:01:52.791 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T07:01:52.791 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T07:01:52.791 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T07:01:52.791 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T07:01:52.791 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T07:01:52.791 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T07:01:52.792 INFO:teuthology.orchestra.run.smithi148.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-19T07:01:52.792 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T07:01:52.792 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T07:01:52.793 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T07:01:52.793 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T07:01:52.793 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T07:01:52.793 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T07:01:52.793 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T07:01:52.793 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T07:01:52.793 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T07:01:52.793 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T07:01:52.793 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T07:01:52.793 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T07:01:52.793 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T07:01:52.793 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T07:01:52.793 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T07:01:52.794 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T07:01:52.794 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T07:01:52.794 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T07:01:52.794 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T07:01:52.794 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T07:01:52.794 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T07:01:52.794 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T07:01:52.794 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T07:01:52.794 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T07:01:52.794 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T07:01:52.794 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T07:01:52.794 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T07:01:52.795 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T07:01:52.795 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T07:01:52.795 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T07:01:52.795 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T07:01:52.795 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T07:01:52.795 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.inplace_update_support: 0 2024-09-19T07:01:52.795 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T07:01:52.795 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T07:01:52.795 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T07:01:52.795 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T07:01:52.796 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.bloom_locality: 0 2024-09-19T07:01:52.796 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.max_successive_merges: 0 2024-09-19T07:01:52.796 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T07:01:52.796 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T07:01:52.796 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T07:01:52.796 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T07:01:52.796 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.ttl: 2592000 2024-09-19T07:01:52.796 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T07:01:52.796 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T07:01:52.796 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T07:01:52.796 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.enable_blob_files: false 2024-09-19T07:01:52.796 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.min_blob_size: 0 2024-09-19T07:01:52.797 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T07:01:52.797 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T07:01:52.797 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T07:01:52.797 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T07:01:52.797 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T07:01:52.797 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T07:01:52.797 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T07:01:52.797 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T07:01:52.797 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-19T07:01:52.797 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-19T07:01:52.797 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e24911fc-21da-450d-b375-431aca3c8085 2024-09-19T07:01:52.797 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726729312730933, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-19T07:01:52.797 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-19T07:01:52.797 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726729312731957, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 101538, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 334, "table_properties": {"data_size": 99423, "index_size": 307, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14641, "raw_average_key_size": 49, "raw_value_size": 91554, "raw_average_value_size": 312, "num_data_blocks": 12, "num_entries": 293, "num_filter_entries": 293, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726729312, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e24911fc-21da-450d-b375-431aca3c8085", "db_session_id": "H96D47X2WS8YEAN0VC91", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-19T07:01:52.798 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726729312732060, "job": 1, "event": "recovery_finished"} 2024-09-19T07:01:52.798 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-19T07:01:52.798 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T07:01:52.798 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5591812eae00 2024-09-19T07:01:52.798 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: DB pointer 0x5591813e6000 2024-09-19T07:01:52.798 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T07:01:52.798 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T07:01:52.798 INFO:journalctl@ceph.mon.a.smithi148.stdout: ** DB Stats ** 2024-09-19T07:01:52.798 INFO:journalctl@ceph.mon.a.smithi148.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T07:01:52.798 INFO:journalctl@ceph.mon.a.smithi148.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T07:01:52.798 INFO:journalctl@ceph.mon.a.smithi148.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T07:01:52.798 INFO:journalctl@ceph.mon.a.smithi148.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T07:01:52.798 INFO:journalctl@ceph.mon.a.smithi148.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T07:01:52.799 INFO:journalctl@ceph.mon.a.smithi148.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T07:01:52.799 INFO:journalctl@ceph.mon.a.smithi148.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T07:01:52.799 INFO:journalctl@ceph.mon.a.smithi148.stdout: 2024-09-19T07:01:52.799 INFO:journalctl@ceph.mon.a.smithi148.stdout: ** Compaction Stats [default] ** 2024-09-19T07:01:52.799 INFO:journalctl@ceph.mon.a.smithi148.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T07:01:52.799 INFO:journalctl@ceph.mon.a.smithi148.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T07:01:52.799 INFO:journalctl@ceph.mon.a.smithi148.stdout: L0 2/0 101.02 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 148.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T07:01:52.799 INFO:journalctl@ceph.mon.a.smithi148.stdout: Sum 2/0 101.02 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 148.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T07:01:52.799 INFO:journalctl@ceph.mon.a.smithi148.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 148.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T07:01:52.799 INFO:journalctl@ceph.mon.a.smithi148.stdout: 2024-09-19T07:01:52.799 INFO:journalctl@ceph.mon.a.smithi148.stdout: ** Compaction Stats [default] ** 2024-09-19T07:01:52.799 INFO:journalctl@ceph.mon.a.smithi148.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T07:01:52.799 INFO:journalctl@ceph.mon.a.smithi148.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T07:01:52.799 INFO:journalctl@ceph.mon.a.smithi148.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 148.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T07:01:52.800 INFO:journalctl@ceph.mon.a.smithi148.stdout: 2024-09-19T07:01:52.800 INFO:journalctl@ceph.mon.a.smithi148.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T07:01:52.800 INFO:journalctl@ceph.mon.a.smithi148.stdout: 2024-09-19T07:01:52.800 INFO:journalctl@ceph.mon.a.smithi148.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T07:01:52.800 INFO:journalctl@ceph.mon.a.smithi148.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T07:01:52.800 INFO:journalctl@ceph.mon.a.smithi148.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T07:01:52.800 INFO:journalctl@ceph.mon.a.smithi148.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T07:01:52.800 INFO:journalctl@ceph.mon.a.smithi148.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T07:01:52.800 INFO:journalctl@ceph.mon.a.smithi148.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T07:01:52.800 INFO:journalctl@ceph.mon.a.smithi148.stdout: Cumulative compaction: 0.00 GB write, 29.93 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T07:01:52.800 INFO:journalctl@ceph.mon.a.smithi148.stdout: Interval compaction: 0.00 GB write, 29.93 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T07:01:52.800 INFO:journalctl@ceph.mon.a.smithi148.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T07:01:52.800 INFO:journalctl@ceph.mon.a.smithi148.stdout: Block cache BinnedLRUCache@0x5591812bd1f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-19T07:01:52.801 INFO:journalctl@ceph.mon.a.smithi148.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-19T07:01:52.801 INFO:journalctl@ceph.mon.a.smithi148.stdout: 2024-09-19T07:01:52.801 INFO:journalctl@ceph.mon.a.smithi148.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T07:01:52.801 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: starting mon.a rank 0 at public addrs [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] at bind addrs [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid eae8a4a8-7654-11ef-bceb-c7b262605968 2024-09-19T07:01:52.801 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: mon.a@-1(???) e1 preinit fsid eae8a4a8-7654-11ef-bceb-c7b262605968 2024-09-19T07:01:52.801 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: mon.a@-1(???).mds e1 new map 2024-09-19T07:01:52.801 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: mon.a@-1(???).mds e1 print_map 2024-09-19T07:01:52.801 INFO:journalctl@ceph.mon.a.smithi148.stdout: e1 2024-09-19T07:01:52.801 INFO:journalctl@ceph.mon.a.smithi148.stdout: btime 2024-09-19T07:01:47:891017+0000 2024-09-19T07:01:52.801 INFO:journalctl@ceph.mon.a.smithi148.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T07:01:52.801 INFO:journalctl@ceph.mon.a.smithi148.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T07:01:52.801 INFO:journalctl@ceph.mon.a.smithi148.stdout: legacy client fscid: -1 2024-09-19T07:01:52.801 INFO:journalctl@ceph.mon.a.smithi148.stdout: 2024-09-19T07:01:52.801 INFO:journalctl@ceph.mon.a.smithi148.stdout: No filesystems configured 2024-09-19T07:01:52.801 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T07:01:52.802 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T07:01:52.802 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T07:01:52.802 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T07:01:52.802 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-19T07:01:52.802 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 bash[31161]: 7c0ab7162492a83152cb993c7727315c02780aa3214440381f958117d46c2d43 2024-09-19T07:01:52.802 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 systemd[1]: Started Ceph mon.a for eae8a4a8-7654-11ef-bceb-c7b262605968. 2024-09-19T07:01:53.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T07:01:53.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: monmap epoch 1 2024-09-19T07:01:53.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: fsid eae8a4a8-7654-11ef-bceb-c7b262605968 2024-09-19T07:01:53.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: last_changed 2024-09-19T07:01:44.959428+0000 2024-09-19T07:01:53.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: created 2024-09-19T07:01:44.959428+0000 2024-09-19T07:01:53.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: min_mon_release 19 (squid) 2024-09-19T07:01:53.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: election_strategy: 1 2024-09-19T07:01:53.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: 0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-19T07:01:53.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: fsmap 2024-09-19T07:01:53.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T07:01:53.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:52 smithi148 ceph-mon[31180]: mgrmap e1: no daemons active 2024-09-19T07:01:53.740 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:53.218+0000 7f35f754a640 1 Processor -- start 2024-09-19T07:01:53.740 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:53.218+0000 7f35f754a640 1 -- start start 2024-09-19T07:01:53.740 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:53.219+0000 7f35f754a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35f01066d0 0x7f35f0106ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:53.740 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:53.219+0000 7f35f754a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f35f01070a0 con 0x7f35f01066d0 2024-09-19T07:01:53.740 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:53.219+0000 7f35f52e6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35f01066d0 0x7f35f0106ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:53.740 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:53.219+0000 7f35f52e6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35f01066d0 0x7f35f0106ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42130/0 (socket says 172.21.15.148:42130) 2024-09-19T07:01:53.741 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:53.219+0000 7f35f52e6640 1 -- 172.21.15.148:0/1721526105 learned_addr learned my addr 172.21.15.148:0/1721526105 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:01:53.741 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:53.219+0000 7f35f52e6640 1 -- 172.21.15.148:0/1721526105 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35f01078d0 con 0x7f35f01066d0 2024-09-19T07:01:53.741 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:53.221+0000 7f35f52e6640 1 --2- 172.21.15.148:0/1721526105 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35f01066d0 0x7f35f0106ad0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f35e0009e80 tx=0x7f35e002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dea58eb393e4d0e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:01:53.741 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:53.221+0000 7f35effff640 1 -- 172.21.15.148:0/1721526105 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35e0036070 con 0x7f35f01066d0 2024-09-19T07:01:53.741 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:53.221+0000 7f35effff640 1 -- 172.21.15.148:0/1721526105 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f35e00318c0 con 0x7f35f01066d0 2024-09-19T07:01:53.741 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:53.221+0000 7f35effff640 1 -- 172.21.15.148:0/1721526105 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35e0007ab0 con 0x7f35f01066d0 2024-09-19T07:01:53.741 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:53.222+0000 7f35f754a640 1 -- 172.21.15.148:0/1721526105 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35f01066d0 msgr2=0x7f35f0106ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:53.741 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:53.222+0000 7f35f754a640 1 --2- 172.21.15.148:0/1721526105 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35f01066d0 0x7f35f0106ad0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f35e0009e80 tx=0x7f35e002a7a0 comp rx=0 tx=0).stop 2024-09-19T07:01:53.741 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:53.222+0000 7f35f754a640 1 -- 172.21.15.148:0/1721526105 shutdown_connections 2024-09-19T07:01:53.741 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:53.222+0000 7f35f754a640 1 --2- 172.21.15.148:0/1721526105 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35f01066d0 0x7f35f0106ad0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:53.741 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:53.222+0000 7f35f754a640 1 -- 172.21.15.148:0/1721526105 >> 172.21.15.148:0/1721526105 conn(0x7f35f0101e60 msgr2=0x7f35f01042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:01:53.741 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:53.222+0000 7f35f754a640 1 -- 172.21.15.148:0/1721526105 shutdown_connections 2024-09-19T07:01:53.742 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:53.222+0000 7f35f754a640 1 -- 172.21.15.148:0/1721526105 wait complete. 2024-09-19T07:01:53.742 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:53.222+0000 7f35f754a640 1 Processor -- start 2024-09-19T07:01:53.742 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:53.223+0000 7f35f754a640 1 -- start start 2024-09-19T07:01:53.742 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:53.223+0000 7f35f754a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35f01066d0 0x7f35f019b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:53.742 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:53.223+0000 7f35f754a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f35f010ac80 con 0x7f35f01066d0 2024-09-19T07:01:53.742 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:53.223+0000 7f35f52e6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35f01066d0 0x7f35f019b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:53.742 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:53.223+0000 7f35f52e6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35f01066d0 0x7f35f019b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42136/0 (socket says 172.21.15.148:42136) 2024-09-19T07:01:53.742 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:53.223+0000 7f35f52e6640 1 -- 172.21.15.148:0/3606983071 learned_addr learned my addr 172.21.15.148:0/3606983071 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:01:53.742 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:53.223+0000 7f35f52e6640 1 -- 172.21.15.148:0/3606983071 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35f019bd10 con 0x7f35f01066d0 2024-09-19T07:01:53.742 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:53.223+0000 7f35f52e6640 1 --2- 172.21.15.148:0/3606983071 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35f01066d0 0x7f35f019b7d0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f35e002ad90 tx=0x7f35e0031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:01:53.743 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:53.223+0000 7f35ee7fc640 1 -- 172.21.15.148:0/3606983071 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35e0036050 con 0x7f35f01066d0 2024-09-19T07:01:53.743 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:53.223+0000 7f35ee7fc640 1 -- 172.21.15.148:0/3606983071 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f35e0042070 con 0x7f35f01066d0 2024-09-19T07:01:53.743 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:53.223+0000 7f35f754a640 1 -- 172.21.15.148:0/3606983071 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35f019bfa0 con 0x7f35f01066d0 2024-09-19T07:01:53.743 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:53.223+0000 7f35ee7fc640 1 -- 172.21.15.148:0/3606983071 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35e003d7e0 con 0x7f35f01066d0 2024-09-19T07:01:53.743 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:53.224+0000 7f35f754a640 1 -- 172.21.15.148:0/3606983071 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35f019ec90 con 0x7f35f01066d0 2024-09-19T07:01:53.743 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:53.224+0000 7f35ee7fc640 1 -- 172.21.15.148:0/3606983071 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f35e003dae0 con 0x7f35f01066d0 2024-09-19T07:01:53.743 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:53.224+0000 7f35ee7fc640 1 -- 172.21.15.148:0/3606983071 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f35e0007e00 con 0x7f35f01066d0 2024-09-19T07:01:53.743 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:53.225+0000 7f35f754a640 1 -- 172.21.15.148:0/3606983071 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35f0106b50 con 0x7f35f01066d0 2024-09-19T07:01:53.743 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:53.227+0000 7f35ee7fc640 1 -- 172.21.15.148:0/3606983071 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f35e00072f0 con 0x7f35f01066d0 2024-09-19T07:01:53.743 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:53.283+0000 7f35f754a640 1 -- 172.21.15.148:0/3606983071 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f35f002d9b0 con 0x7f35f01066d0 2024-09-19T07:01:53.743 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:53.288+0000 7f35ee7fc640 1 -- 172.21.15.148:0/3606983071 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f35e0047460 con 0x7f35f01066d0 2024-09-19T07:01:53.743 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:53.288+0000 7f35f754a640 1 -- 172.21.15.148:0/3606983071 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35f01066d0 msgr2=0x7f35f019b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:53.744 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:53.288+0000 7f35f754a640 1 --2- 172.21.15.148:0/3606983071 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35f01066d0 0x7f35f019b7d0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f35e002ad90 tx=0x7f35e0031ca0 comp rx=0 tx=0).stop 2024-09-19T07:01:53.744 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:53.288+0000 7f35f754a640 1 -- 172.21.15.148:0/3606983071 shutdown_connections 2024-09-19T07:01:53.744 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:53.288+0000 7f35f754a640 1 --2- 172.21.15.148:0/3606983071 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35f01066d0 0x7f35f019b7d0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:53.744 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:53.288+0000 7f35f754a640 1 -- 172.21.15.148:0/3606983071 >> 172.21.15.148:0/3606983071 conn(0x7f35f0101e60 msgr2=0x7f35f0102e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:01:53.744 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:53.288+0000 7f35f754a640 1 -- 172.21.15.148:0/3606983071 shutdown_connections 2024-09-19T07:01:53.744 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:53.288+0000 7f35f754a640 1 -- 172.21.15.148:0/3606983071 wait complete. 2024-09-19T07:01:53.744 INFO:teuthology.orchestra.run.smithi148.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-19T07:01:53.774 INFO:teuthology.orchestra.run.smithi148.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-19T07:01:53.774 INFO:teuthology.orchestra.run.smithi148.stdout:Creating mgr... 2024-09-19T07:01:53.775 INFO:teuthology.orchestra.run.smithi148.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-19T07:01:53.775 INFO:teuthology.orchestra.run.smithi148.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-19T07:01:54.048 INFO:teuthology.orchestra.run.smithi148.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mgr.x 2024-09-19T07:01:54.048 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stderr Failed to reset failed state of unit ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mgr.x.service: Unit ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mgr.x.service not loaded. 2024-09-19T07:01:54.203 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-eae8a4a8-7654-11ef-bceb-c7b262605968.target.wants/ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@.service. 2024-09-19T07:01:54.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:54 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/3606983071' entity='client.admin' 2024-09-19T07:01:54.737 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:01:54 smithi148 podman[31389]: 2024-09-19 07:01:54.656873864 +0000 UTC m=+0.330547362 container start f319d52d4e72ceef90f179d1eedf72b045f0674af830881876f9f0320726772c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-2f599a4) 2024-09-19T07:01:54.738 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:01:54 smithi148 bash[31389]: f319d52d4e72ceef90f179d1eedf72b045f0674af830881876f9f0320726772c 2024-09-19T07:01:54.752 INFO:teuthology.orchestra.run.smithi148.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T07:01:54.752 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stdout disabled 2024-09-19T07:01:54.760 INFO:teuthology.orchestra.run.smithi148.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T07:01:54.760 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stdout inactive 2024-09-19T07:01:54.760 INFO:teuthology.orchestra.run.smithi148.stdout:firewalld.service is not enabled 2024-09-19T07:01:54.760 INFO:teuthology.orchestra.run.smithi148.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T07:01:54.769 INFO:teuthology.orchestra.run.smithi148.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T07:01:54.769 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stdout disabled 2024-09-19T07:01:54.777 INFO:teuthology.orchestra.run.smithi148.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T07:01:54.777 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stdout inactive 2024-09-19T07:01:54.777 INFO:teuthology.orchestra.run.smithi148.stdout:firewalld.service is not enabled 2024-09-19T07:01:54.777 INFO:teuthology.orchestra.run.smithi148.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-19T07:01:54.777 INFO:teuthology.orchestra.run.smithi148.stdout:Waiting for mgr to start... 2024-09-19T07:01:54.777 INFO:teuthology.orchestra.run.smithi148.stdout:Waiting for mgr... 2024-09-19T07:01:54.993 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:01:54 smithi148 systemd[1]: Started Ceph mgr.x for eae8a4a8-7654-11ef-bceb-c7b262605968. 2024-09-19T07:01:54.993 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:01:54 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:01:54.778+0000 7f5594fa7040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T07:01:54.993 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:01:54 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:01:54.843+0000 7f5594fa7040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T07:01:54.993 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:01:54 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:01:54.991+0000 7f5594fa7040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T07:01:55.297 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:01:55 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:01:55.063+0000 7f5594fa7040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T07:01:55.297 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:01:55 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:01:55.212+0000 7f5594fa7040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:01:55.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:55 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/2253435213' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T07:01:55.583 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:01:55 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:01:55.362+0000 7f5594fa7040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T07:01:55.928 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:01:55 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:01:55.683+0000 7f5594fa7040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T07:01:55.928 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:01:55 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:01:55.743+0000 7f5594fa7040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T07:01:56.333 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:01:55 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:01:55.927+0000 7f5594fa7040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T07:01:57.083 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:01:56 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:01:56.812+0000 7f5594fa7040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T07:01:57.083 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:01:56 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:01:56.879+0000 7f5594fa7040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T07:01:57.833 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:01:57 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:01:57.613+0000 7f5594fa7040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T07:01:57.833 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:01:57 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:01:57.728+0000 7f5594fa7040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T07:01:58.164 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:01:57 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:01:57.873+0000 7f5594fa7040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:01:58.164 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:01:57 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:01:57.935+0000 7f5594fa7040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T07:01:58.164 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:01:58 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:01:58.088+0000 7f5594fa7040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T07:01:58.164 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:01:58 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:01:58.162+0000 7f5594fa7040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T07:01:58.405 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout 2024-09-19T07:01:58.405 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout { 2024-09-19T07:01:58.405 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "fsid": "eae8a4a8-7654-11ef-bceb-c7b262605968", 2024-09-19T07:01:58.405 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T07:01:58.405 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T07:01:58.405 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T07:01:58.405 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T07:01:58.405 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:01:58.405 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T07:01:58.405 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T07:01:58.406 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout 0 2024-09-19T07:01:58.406 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout ], 2024-09-19T07:01:58.406 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T07:01:58.406 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T07:01:58.406 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout ], 2024-09-19T07:01:58.406 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-19T07:01:58.406 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T07:01:58.406 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T07:01:58.406 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T07:01:58.406 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T07:01:58.406 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:01:58.406 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T07:01:58.407 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T07:01:58.407 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T07:01:58.407 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T07:01:58.407 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T07:01:58.407 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T07:01:58.407 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T07:01:58.407 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T07:01:58.407 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:01:58.407 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T07:01:58.407 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T07:01:58.408 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T07:01:58.408 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T07:01:58.408 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T07:01:58.408 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T07:01:58.408 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T07:01:58.408 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T07:01:58.408 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T07:01:58.408 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:01:58.408 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T07:01:58.408 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T07:01:58.408 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T07:01:47:891017+0000", 2024-09-19T07:01:58.409 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T07:01:58.409 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T07:01:58.409 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:01:58.409 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T07:01:58.409 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T07:01:58.409 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T07:01:58.409 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T07:01:58.409 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T07:01:58.409 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T07:01:58.409 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T07:01:58.409 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout ], 2024-09-19T07:01:58.409 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T07:01:58.409 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:01:58.409 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T07:01:58.410 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T07:01:58.410 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T07:01:47.891668+0000", 2024-09-19T07:01:58.410 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T07:01:58.410 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:01:58.410 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T07:01:58.410 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout } 2024-09-19T07:01:58.410 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:55.226+0000 7f7d40ed9640 1 Processor -- start 2024-09-19T07:01:58.411 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:55.226+0000 7f7d40ed9640 1 -- start start 2024-09-19T07:01:58.411 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:55.227+0000 7f7d40ed9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d3c107cc0 0x7f7d3c1080c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:58.411 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:55.227+0000 7f7d40ed9640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7d3c108690 con 0x7f7d3c107cc0 2024-09-19T07:01:58.411 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:55.227+0000 7f7d3a59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d3c107cc0 0x7f7d3c1080c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:58.411 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:55.227+0000 7f7d3a59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d3c107cc0 0x7f7d3c1080c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39544/0 (socket says 172.21.15.148:39544) 2024-09-19T07:01:58.411 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:55.227+0000 7f7d3a59c640 1 -- 172.21.15.148:0/2358501959 learned_addr learned my addr 172.21.15.148:0/2358501959 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:01:58.411 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:55.227+0000 7f7d3a59c640 1 -- 172.21.15.148:0/2358501959 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d3c106920 con 0x7f7d3c107cc0 2024-09-19T07:01:58.411 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:55.228+0000 7f7d3a59c640 1 --2- 172.21.15.148:0/2358501959 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d3c107cc0 0x7f7d3c1080c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c009820 tx=0x7f7d2c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7721519f7c67f90c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:01:58.411 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:55.228+0000 7f7d3959a640 1 -- 172.21.15.148:0/2358501959 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d2c037070 con 0x7f7d3c107cc0 2024-09-19T07:01:58.411 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:55.228+0000 7f7d3959a640 1 -- 172.21.15.148:0/2358501959 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7d2c032900 con 0x7f7d3c107cc0 2024-09-19T07:01:58.411 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:55.228+0000 7f7d3959a640 1 -- 172.21.15.148:0/2358501959 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d2c030850 con 0x7f7d3c107cc0 2024-09-19T07:01:58.411 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:55.229+0000 7f7d40ed9640 1 -- 172.21.15.148:0/2358501959 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d3c107cc0 msgr2=0x7f7d3c1080c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:58.412 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:55.229+0000 7f7d40ed9640 1 --2- 172.21.15.148:0/2358501959 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d3c107cc0 0x7f7d3c1080c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c009820 tx=0x7f7d2c02a270 comp rx=0 tx=0).stop 2024-09-19T07:01:58.412 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:55.229+0000 7f7d40ed9640 1 -- 172.21.15.148:0/2358501959 shutdown_connections 2024-09-19T07:01:58.412 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:55.229+0000 7f7d40ed9640 1 --2- 172.21.15.148:0/2358501959 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d3c107cc0 0x7f7d3c1080c0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:58.412 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:55.229+0000 7f7d40ed9640 1 -- 172.21.15.148:0/2358501959 >> 172.21.15.148:0/2358501959 conn(0x7f7d3c101600 msgr2=0x7f7d3c103a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:01:58.412 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:55.229+0000 7f7d40ed9640 1 -- 172.21.15.148:0/2358501959 shutdown_connections 2024-09-19T07:01:58.412 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:55.229+0000 7f7d40ed9640 1 -- 172.21.15.148:0/2358501959 wait complete. 2024-09-19T07:01:58.412 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:55.230+0000 7f7d40ed9640 1 Processor -- start 2024-09-19T07:01:58.412 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:55.230+0000 7f7d40ed9640 1 -- start start 2024-09-19T07:01:58.412 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:55.230+0000 7f7d40ed9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d3c107cc0 0x7f7d3c19b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:58.412 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:55.230+0000 7f7d40ed9640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7d3c10ace0 con 0x7f7d3c107cc0 2024-09-19T07:01:58.412 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:55.230+0000 7f7d3a59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d3c107cc0 0x7f7d3c19b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:58.412 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:55.230+0000 7f7d3a59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d3c107cc0 0x7f7d3c19b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39558/0 (socket says 172.21.15.148:39558) 2024-09-19T07:01:58.413 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:55.230+0000 7f7d3a59c640 1 -- 172.21.15.148:0/2253435213 learned_addr learned my addr 172.21.15.148:0/2253435213 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:01:58.413 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:55.231+0000 7f7d3a59c640 1 -- 172.21.15.148:0/2253435213 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d3c19bd70 con 0x7f7d3c107cc0 2024-09-19T07:01:58.413 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:55.231+0000 7f7d3a59c640 1 --2- 172.21.15.148:0/2253435213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d3c107cc0 0x7f7d3c19b830 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c0097f0 tx=0x7f7d2c030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:01:58.413 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:55.231+0000 7f7d2b7fe640 1 -- 172.21.15.148:0/2253435213 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d2c037040 con 0x7f7d3c107cc0 2024-09-19T07:01:58.413 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:55.231+0000 7f7d2b7fe640 1 -- 172.21.15.148:0/2253435213 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7d2c040070 con 0x7f7d3c107cc0 2024-09-19T07:01:58.413 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:55.231+0000 7f7d40ed9640 1 -- 172.21.15.148:0/2253435213 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d3c19c000 con 0x7f7d3c107cc0 2024-09-19T07:01:58.413 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:55.231+0000 7f7d2b7fe640 1 -- 172.21.15.148:0/2253435213 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d2c03a390 con 0x7f7d3c107cc0 2024-09-19T07:01:58.413 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:55.231+0000 7f7d40ed9640 1 -- 172.21.15.148:0/2253435213 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d3c19ecf0 con 0x7f7d3c107cc0 2024-09-19T07:01:58.413 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:55.231+0000 7f7d2b7fe640 1 -- 172.21.15.148:0/2253435213 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7d2c03a650 con 0x7f7d3c107cc0 2024-09-19T07:01:58.413 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:55.231+0000 7f7d2b7fe640 1 -- 172.21.15.148:0/2253435213 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7d2c045df0 con 0x7f7d3c107cc0 2024-09-19T07:01:58.413 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:55.232+0000 7f7d40ed9640 1 -- 172.21.15.148:0/2253435213 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d3c108140 con 0x7f7d3c107cc0 2024-09-19T07:01:58.413 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:55.236+0000 7f7d2b7fe640 1 -- 172.21.15.148:0/2253435213 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f7d2c03b430 con 0x7f7d3c107cc0 2024-09-19T07:01:58.413 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:55.296+0000 7f7d40ed9640 1 -- 172.21.15.148:0/2253435213 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f7d3c1957e0 con 0x7f7d3c107cc0 2024-09-19T07:01:58.414 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:55.296+0000 7f7d2b7fe640 1 -- 172.21.15.148:0/2253435213 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f7d3c1957e0 con 0x7f7d3c107cc0 2024-09-19T07:01:58.414 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:55.297+0000 7f7d40ed9640 1 -- 172.21.15.148:0/2253435213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d3c107cc0 msgr2=0x7f7d3c19b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:58.414 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:55.297+0000 7f7d40ed9640 1 --2- 172.21.15.148:0/2253435213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d3c107cc0 0x7f7d3c19b830 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c0097f0 tx=0x7f7d2c030d80 comp rx=0 tx=0).stop 2024-09-19T07:01:58.414 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:55.297+0000 7f7d40ed9640 1 -- 172.21.15.148:0/2253435213 shutdown_connections 2024-09-19T07:01:58.414 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:55.297+0000 7f7d40ed9640 1 --2- 172.21.15.148:0/2253435213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d3c107cc0 0x7f7d3c19b830 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:58.414 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:55.297+0000 7f7d40ed9640 1 -- 172.21.15.148:0/2253435213 >> 172.21.15.148:0/2253435213 conn(0x7f7d3c101600 msgr2=0x7f7d3c102540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:01:58.414 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:55.297+0000 7f7d40ed9640 1 -- 172.21.15.148:0/2253435213 shutdown_connections 2024-09-19T07:01:58.414 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:01:55.297+0000 7f7d40ed9640 1 -- 172.21.15.148:0/2253435213 wait complete. 2024-09-19T07:01:58.414 INFO:teuthology.orchestra.run.smithi148.stdout:mgr not available, waiting (1/15)... 2024-09-19T07:01:58.449 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:01:58 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:01:58.224+0000 7f5594fa7040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T07:01:58.450 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:01:58 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:01:58.382+0000 7f5594fa7040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T07:01:58.450 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:01:58 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:01:58.448+0000 7f5594fa7040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T07:01:58.720 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:01:58 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:01:58.517+0000 7f5594fa7040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T07:01:58.720 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:01:58 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:01:58.600+0000 7f5594fa7040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T07:01:58.720 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:01:58 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:01:58.660+0000 7f5594fa7040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T07:01:58.720 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:01:58 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:01:58.719+0000 7f5594fa7040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T07:01:59.834 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:01:59 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:01:59.514+0000 7f5594fa7040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T07:01:59.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:59 smithi148 ceph-mon[31180]: Activating manager daemon x 2024-09-19T07:01:59.835 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:59 smithi148 ceph-mon[31180]: mgrmap e2: x(active, starting, since 0.00301952s) 2024-09-19T07:01:59.835 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:59 smithi148 ceph-mon[31180]: from='mgr.14100 172.21.15.148:0/1886325283' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T07:01:59.835 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:59 smithi148 ceph-mon[31180]: from='mgr.14100 172.21.15.148:0/1886325283' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T07:01:59.835 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:59 smithi148 ceph-mon[31180]: from='mgr.14100 172.21.15.148:0/1886325283' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T07:01:59.836 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:59 smithi148 ceph-mon[31180]: from='mgr.14100 172.21.15.148:0/1886325283' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:01:59.836 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:59 smithi148 ceph-mon[31180]: from='mgr.14100 172.21.15.148:0/1886325283' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T07:01:59.836 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:59 smithi148 ceph-mon[31180]: Manager daemon x is now available 2024-09-19T07:01:59.836 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:59 smithi148 ceph-mon[31180]: from='mgr.14100 172.21.15.148:0/1886325283' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T07:01:59.837 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:59 smithi148 ceph-mon[31180]: from='mgr.14100 172.21.15.148:0/1886325283' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T07:01:59.837 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:59 smithi148 ceph-mon[31180]: from='mgr.14100 172.21.15.148:0/1886325283' entity='mgr.x' 2024-09-19T07:01:59.837 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:59 smithi148 ceph-mon[31180]: from='mgr.14100 172.21.15.148:0/1886325283' entity='mgr.x' 2024-09-19T07:01:59.837 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:01:59 smithi148 ceph-mon[31180]: from='mgr.14100 172.21.15.148:0/1886325283' entity='mgr.x' 2024-09-19T07:02:01.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:01 smithi148 ceph-mon[31180]: mgrmap e3: x(active, since 1.00663s) 2024-09-19T07:02:02.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:02 smithi148 ceph-mon[31180]: mgrmap e4: x(active, since 2s) 2024-09-19T07:02:04.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:04 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/1976026864' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T07:02:07.936 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout 2024-09-19T07:02:07.938 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout { 2024-09-19T07:02:07.938 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "fsid": "eae8a4a8-7654-11ef-bceb-c7b262605968", 2024-09-19T07:02:07.938 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T07:02:07.939 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T07:02:07.939 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T07:02:07.939 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T07:02:07.939 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:02:07.939 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T07:02:07.939 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T07:02:07.939 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout 0 2024-09-19T07:02:07.939 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout ], 2024-09-19T07:02:07.939 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T07:02:07.939 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T07:02:07.939 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout ], 2024-09-19T07:02:07.939 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2024-09-19T07:02:07.939 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T07:02:07.939 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T07:02:07.940 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T07:02:07.940 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T07:02:07.940 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:02:07.940 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T07:02:07.940 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T07:02:07.940 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T07:02:07.940 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T07:02:07.940 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T07:02:07.950 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T07:02:07.950 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T07:02:07.950 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T07:02:07.950 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:02:07.950 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T07:02:07.950 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T07:02:07.950 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T07:02:07.950 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T07:02:07.951 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T07:02:07.951 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T07:02:07.951 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T07:02:07.951 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T07:02:07.951 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T07:02:07.951 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:02:07.951 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T07:02:07.951 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T07:02:07.951 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T07:01:47:891017+0000", 2024-09-19T07:02:07.951 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T07:02:07.951 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T07:02:07.951 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:02:07.951 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T07:02:07.952 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T07:02:07.952 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T07:02:07.952 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T07:02:07.952 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T07:02:07.952 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T07:02:07.952 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T07:02:07.952 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout ], 2024-09-19T07:02:07.952 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T07:02:07.952 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:02:07.952 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T07:02:07.952 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T07:02:07.952 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T07:01:47.891668+0000", 2024-09-19T07:02:07.952 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T07:02:07.953 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:02:07.953 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T07:02:07.953 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout } 2024-09-19T07:02:07.953 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.065+0000 7f34bf3a3640 1 Processor -- start 2024-09-19T07:02:07.953 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.066+0000 7f34bf3a3640 1 -- start start 2024-09-19T07:02:07.953 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.066+0000 7f34bf3a3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34b81066d0 0x7f34b8106ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:07.953 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.066+0000 7f34bf3a3640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f34b81070a0 con 0x7f34b81066d0 2024-09-19T07:02:07.953 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.066+0000 7f34bd13f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34b81066d0 0x7f34b8106ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:07.953 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.066+0000 7f34bd13f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34b81066d0 0x7f34b8106ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39622/0 (socket says 172.21.15.148:39622) 2024-09-19T07:02:07.953 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.066+0000 7f34bd13f640 1 -- 172.21.15.148:0/2170395663 learned_addr learned my addr 172.21.15.148:0/2170395663 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:02:07.953 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.066+0000 7f34bd13f640 1 -- 172.21.15.148:0/2170395663 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34b81078d0 con 0x7f34b81066d0 2024-09-19T07:02:07.953 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.067+0000 7f34bd13f640 1 --2- 172.21.15.148:0/2170395663 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34b81066d0 0x7f34b8106ad0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f34b4009820 tx=0x7f34b402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ceb5e6dcd5e024d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:07.953 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.067+0000 7f34affff640 1 -- 172.21.15.148:0/2170395663 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34b4037070 con 0x7f34b81066d0 2024-09-19T07:02:07.954 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.067+0000 7f34affff640 1 -- 172.21.15.148:0/2170395663 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f34b4032900 con 0x7f34b81066d0 2024-09-19T07:02:07.954 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.067+0000 7f34affff640 1 -- 172.21.15.148:0/2170395663 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34b4030850 con 0x7f34b81066d0 2024-09-19T07:02:07.954 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.068+0000 7f34bf3a3640 1 -- 172.21.15.148:0/2170395663 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34b81066d0 msgr2=0x7f34b8106ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:07.954 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.068+0000 7f34bf3a3640 1 --2- 172.21.15.148:0/2170395663 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34b81066d0 0x7f34b8106ad0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f34b4009820 tx=0x7f34b402a270 comp rx=0 tx=0).stop 2024-09-19T07:02:07.954 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.068+0000 7f34bf3a3640 1 -- 172.21.15.148:0/2170395663 shutdown_connections 2024-09-19T07:02:07.954 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.068+0000 7f34bf3a3640 1 --2- 172.21.15.148:0/2170395663 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34b81066d0 0x7f34b8106ad0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:07.954 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.068+0000 7f34bf3a3640 1 -- 172.21.15.148:0/2170395663 >> 172.21.15.148:0/2170395663 conn(0x7f34b8101e60 msgr2=0x7f34b81042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:07.954 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.068+0000 7f34bf3a3640 1 -- 172.21.15.148:0/2170395663 shutdown_connections 2024-09-19T07:02:07.954 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.068+0000 7f34bf3a3640 1 -- 172.21.15.148:0/2170395663 wait complete. 2024-09-19T07:02:07.955 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.069+0000 7f34bf3a3640 1 Processor -- start 2024-09-19T07:02:07.955 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.069+0000 7f34bf3a3640 1 -- start start 2024-09-19T07:02:07.955 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.069+0000 7f34bf3a3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34b81066d0 0x7f34b819a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:07.955 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.069+0000 7f34bf3a3640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f34b810ac80 con 0x7f34b81066d0 2024-09-19T07:02:07.955 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.069+0000 7f34bd13f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34b81066d0 0x7f34b819a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:07.955 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.069+0000 7f34bd13f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34b81066d0 0x7f34b819a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39624/0 (socket says 172.21.15.148:39624) 2024-09-19T07:02:07.955 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.069+0000 7f34bd13f640 1 -- 172.21.15.148:0/1976026864 learned_addr learned my addr 172.21.15.148:0/1976026864 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:02:07.955 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.069+0000 7f34bd13f640 1 -- 172.21.15.148:0/1976026864 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34b819ac10 con 0x7f34b81066d0 2024-09-19T07:02:07.955 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.070+0000 7f34bd13f640 1 --2- 172.21.15.148:0/1976026864 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34b81066d0 0x7f34b819a6d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f34b4009940 tx=0x7f34b4032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:07.955 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.070+0000 7f34ae7fc640 1 -- 172.21.15.148:0/1976026864 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34b4042070 con 0x7f34b81066d0 2024-09-19T07:02:07.955 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.070+0000 7f34ae7fc640 1 -- 172.21.15.148:0/1976026864 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f34b40308c0 con 0x7f34b81066d0 2024-09-19T07:02:07.955 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.070+0000 7f34bf3a3640 1 -- 172.21.15.148:0/1976026864 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34b819aea0 con 0x7f34b81066d0 2024-09-19T07:02:07.955 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.070+0000 7f34ae7fc640 1 -- 172.21.15.148:0/1976026864 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34b4037040 con 0x7f34b81066d0 2024-09-19T07:02:07.956 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.070+0000 7f34bf3a3640 1 -- 172.21.15.148:0/1976026864 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34b819db90 con 0x7f34b81066d0 2024-09-19T07:02:07.956 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.071+0000 7f34ae7fc640 1 -- 172.21.15.148:0/1976026864 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f34b4045070 con 0x7f34b81066d0 2024-09-19T07:02:07.956 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.071+0000 7f34ae7fc640 1 --2- 172.21.15.148:0/1976026864 >> [v2:172.21.15.148:6800/2161746152,v1:172.21.15.148:6801/2161746152] conn(0x7f34a4039160 0x7f34a403b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:07.956 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.071+0000 7f34ae7fc640 1 -- 172.21.15.148:0/1976026864 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f34b406c260 con 0x7f34b81066d0 2024-09-19T07:02:07.956 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.071+0000 7f34bc93e640 1 --2- 172.21.15.148:0/1976026864 >> [v2:172.21.15.148:6800/2161746152,v1:172.21.15.148:6801/2161746152] conn(0x7f34a4039160 0x7f34a403b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:07.956 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.071+0000 7f34bf3a3640 1 -- 172.21.15.148:0/1976026864 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34b8106b50 con 0x7f34b81066d0 2024-09-19T07:02:07.956 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.071+0000 7f34bc93e640 1 --2- 172.21.15.148:0/1976026864 >> [v2:172.21.15.148:6800/2161746152,v1:172.21.15.148:6801/2161746152] conn(0x7f34a4039160 0x7f34a403b620 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f34a80098c0 tx=0x7f34a8006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:07.956 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.076+0000 7f34ae7fc640 1 -- 172.21.15.148:0/1976026864 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f34b403cd90 con 0x7f34b81066d0 2024-09-19T07:02:07.956 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.306+0000 7f34bf3a3640 1 -- 172.21.15.148:0/1976026864 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f34b819e0e0 con 0x7f34b81066d0 2024-09-19T07:02:07.957 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.307+0000 7f34ae7fc640 1 -- 172.21.15.148:0/1976026864 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f34b403c870 con 0x7f34b81066d0 2024-09-19T07:02:07.957 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.309+0000 7f34bf3a3640 1 -- 172.21.15.148:0/1976026864 >> [v2:172.21.15.148:6800/2161746152,v1:172.21.15.148:6801/2161746152] conn(0x7f34a4039160 msgr2=0x7f34a403b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:07.957 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.309+0000 7f34bf3a3640 1 --2- 172.21.15.148:0/1976026864 >> [v2:172.21.15.148:6800/2161746152,v1:172.21.15.148:6801/2161746152] conn(0x7f34a4039160 0x7f34a403b620 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f34a80098c0 tx=0x7f34a8006db0 comp rx=0 tx=0).stop 2024-09-19T07:02:07.957 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.309+0000 7f34bf3a3640 1 -- 172.21.15.148:0/1976026864 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34b81066d0 msgr2=0x7f34b819a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:07.957 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.309+0000 7f34bf3a3640 1 --2- 172.21.15.148:0/1976026864 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34b81066d0 0x7f34b819a6d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f34b4009940 tx=0x7f34b4032ce0 comp rx=0 tx=0).stop 2024-09-19T07:02:07.957 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.309+0000 7f34bf3a3640 1 -- 172.21.15.148:0/1976026864 shutdown_connections 2024-09-19T07:02:07.957 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.309+0000 7f34bf3a3640 1 --2- 172.21.15.148:0/1976026864 >> [v2:172.21.15.148:6800/2161746152,v1:172.21.15.148:6801/2161746152] conn(0x7f34a4039160 0x7f34a403b620 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:07.957 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.309+0000 7f34bf3a3640 1 --2- 172.21.15.148:0/1976026864 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34b81066d0 0x7f34b819a6d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:07.957 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.309+0000 7f34bf3a3640 1 -- 172.21.15.148:0/1976026864 >> 172.21.15.148:0/1976026864 conn(0x7f34b8101e60 msgr2=0x7f34b8102a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:07.957 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.309+0000 7f34bf3a3640 1 -- 172.21.15.148:0/1976026864 shutdown_connections 2024-09-19T07:02:07.957 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:04.309+0000 7f34bf3a3640 1 -- 172.21.15.148:0/1976026864 wait complete. 2024-09-19T07:02:07.957 INFO:teuthology.orchestra.run.smithi148.stdout:mgr is available 2024-09-19T07:02:09.014 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:08 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/1825415174' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T07:02:09.022 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout 2024-09-19T07:02:09.022 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T07:02:09.023 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout fsid = eae8a4a8-7654-11ef-bceb-c7b262605968 2024-09-19T07:02:09.023 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.148:3300,v1:172.21.15.148:6789] 2024-09-19T07:02:09.023 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T07:02:09.023 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T07:02:09.023 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T07:02:09.023 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T07:02:09.023 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout 2024-09-19T07:02:09.023 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T07:02:09.023 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T07:02:09.023 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout 2024-09-19T07:02:09.023 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T07:02:09.023 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T07:02:09.023 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T07:02:09.023 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T07:02:09.023 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T07:02:09.024 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T07:02:09.024 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.354+0000 7f8c2122d640 1 Processor -- start 2024-09-19T07:02:09.024 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.354+0000 7f8c2122d640 1 -- start start 2024-09-19T07:02:09.024 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.354+0000 7f8c2122d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c1c07de20 0x7f8c1c07c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:09.024 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.354+0000 7f8c2122d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1c07c850 con 0x7f8c1c07de20 2024-09-19T07:02:09.024 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.354+0000 7f8c1ad9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c1c07de20 0x7f8c1c07c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:09.024 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.354+0000 7f8c1ad9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c1c07de20 0x7f8c1c07c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42868/0 (socket says 172.21.15.148:42868) 2024-09-19T07:02:09.024 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.354+0000 7f8c1ad9d640 1 -- 172.21.15.148:0/1693732685 learned_addr learned my addr 172.21.15.148:0/1693732685 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:02:09.024 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.354+0000 7f8c1ad9d640 1 -- 172.21.15.148:0/1693732685 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c1c07c9d0 con 0x7f8c1c07de20 2024-09-19T07:02:09.024 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.355+0000 7f8c1ad9d640 1 --2- 172.21.15.148:0/1693732685 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c1c07de20 0x7f8c1c07c280 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c009820 tx=0x7f8c0c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4756dcb7120ec1ac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:09.024 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.355+0000 7f8c1a59c640 1 -- 172.21.15.148:0/1693732685 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c0c037070 con 0x7f8c1c07de20 2024-09-19T07:02:09.024 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.355+0000 7f8c1a59c640 1 -- 172.21.15.148:0/1693732685 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8c0c032900 con 0x7f8c1c07de20 2024-09-19T07:02:09.024 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.355+0000 7f8c1a59c640 1 -- 172.21.15.148:0/1693732685 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c0c030850 con 0x7f8c1c07de20 2024-09-19T07:02:09.024 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.356+0000 7f8c2122d640 1 -- 172.21.15.148:0/1693732685 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c1c07de20 msgr2=0x7f8c1c07c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:09.024 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.356+0000 7f8c2122d640 1 --2- 172.21.15.148:0/1693732685 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c1c07de20 0x7f8c1c07c280 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c009820 tx=0x7f8c0c02a270 comp rx=0 tx=0).stop 2024-09-19T07:02:09.025 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.356+0000 7f8c2122d640 1 -- 172.21.15.148:0/1693732685 shutdown_connections 2024-09-19T07:02:09.025 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.356+0000 7f8c2122d640 1 --2- 172.21.15.148:0/1693732685 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c1c07de20 0x7f8c1c07c280 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:09.025 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.356+0000 7f8c2122d640 1 -- 172.21.15.148:0/1693732685 >> 172.21.15.148:0/1693732685 conn(0x7f8c1c102f60 msgr2=0x7f8c1c1053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:09.025 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.356+0000 7f8c2122d640 1 -- 172.21.15.148:0/1693732685 shutdown_connections 2024-09-19T07:02:09.025 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.356+0000 7f8c2122d640 1 -- 172.21.15.148:0/1693732685 wait complete. 2024-09-19T07:02:09.025 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.357+0000 7f8c2122d640 1 Processor -- start 2024-09-19T07:02:09.025 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.357+0000 7f8c2122d640 1 -- start start 2024-09-19T07:02:09.025 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.357+0000 7f8c2122d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c1c07de20 0x7f8c1c19d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:09.025 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.357+0000 7f8c2122d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1c10dde0 con 0x7f8c1c07de20 2024-09-19T07:02:09.025 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.357+0000 7f8c1ad9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c1c07de20 0x7f8c1c19d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:09.025 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.357+0000 7f8c1ad9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c1c07de20 0x7f8c1c19d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42872/0 (socket says 172.21.15.148:42872) 2024-09-19T07:02:09.025 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.357+0000 7f8c1ad9d640 1 -- 172.21.15.148:0/1825415174 learned_addr learned my addr 172.21.15.148:0/1825415174 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:02:09.025 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.358+0000 7f8c1ad9d640 1 -- 172.21.15.148:0/1825415174 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c1c19df10 con 0x7f8c1c07de20 2024-09-19T07:02:09.025 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.358+0000 7f8c1ad9d640 1 --2- 172.21.15.148:0/1825415174 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c1c07de20 0x7f8c1c19d9d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c032ce0 tx=0x7f8c0c032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:09.026 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.358+0000 7f8c18d99640 1 -- 172.21.15.148:0/1825415174 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c0c042070 con 0x7f8c1c07de20 2024-09-19T07:02:09.026 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.358+0000 7f8c18d99640 1 -- 172.21.15.148:0/1825415174 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8c0c0308c0 con 0x7f8c1c07de20 2024-09-19T07:02:09.026 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.358+0000 7f8c2122d640 1 -- 172.21.15.148:0/1825415174 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c1c19e1a0 con 0x7f8c1c07de20 2024-09-19T07:02:09.026 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.358+0000 7f8c18d99640 1 -- 172.21.15.148:0/1825415174 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c0c037040 con 0x7f8c1c07de20 2024-09-19T07:02:09.026 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.358+0000 7f8c2122d640 1 -- 172.21.15.148:0/1825415174 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c1c1a0e90 con 0x7f8c1c07de20 2024-09-19T07:02:09.026 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.359+0000 7f8c18d99640 1 -- 172.21.15.148:0/1825415174 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f8c0c045070 con 0x7f8c1c07de20 2024-09-19T07:02:09.026 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.359+0000 7f8c18d99640 1 --2- 172.21.15.148:0/1825415174 >> [v2:172.21.15.148:6800/2161746152,v1:172.21.15.148:6801/2161746152] conn(0x7f8c08039160 0x7f8c0803b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:09.026 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.359+0000 7f8c18d99640 1 -- 172.21.15.148:0/1825415174 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8c0c06c270 con 0x7f8c1c07de20 2024-09-19T07:02:09.026 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.359+0000 7f8c13fff640 1 --2- 172.21.15.148:0/1825415174 >> [v2:172.21.15.148:6800/2161746152,v1:172.21.15.148:6801/2161746152] conn(0x7f8c08039160 0x7f8c0803b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:09.026 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.359+0000 7f8c2122d640 1 -- 172.21.15.148:0/1825415174 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c1c07c300 con 0x7f8c1c07de20 2024-09-19T07:02:09.026 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.360+0000 7f8c13fff640 1 --2- 172.21.15.148:0/1825415174 >> [v2:172.21.15.148:6800/2161746152,v1:172.21.15.148:6801/2161746152] conn(0x7f8c08039160 0x7f8c0803b620 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8c040098c0 tx=0x7f8c04006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:09.026 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.364+0000 7f8c18d99640 1 -- 172.21.15.148:0/1825415174 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8c0c045520 con 0x7f8c1c07de20 2024-09-19T07:02:09.026 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.531+0000 7f8c2122d640 1 -- 172.21.15.148:0/1825415174 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f8c1c1a24f0 con 0x7f8c1c07de20 2024-09-19T07:02:09.026 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.532+0000 7f8c18d99640 1 -- 172.21.15.148:0/1825415174 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+431 (secure 0 0 0) 0x7f8c0c03cd50 con 0x7f8c1c07de20 2024-09-19T07:02:09.026 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.534+0000 7f8c2122d640 1 -- 172.21.15.148:0/1825415174 >> [v2:172.21.15.148:6800/2161746152,v1:172.21.15.148:6801/2161746152] conn(0x7f8c08039160 msgr2=0x7f8c0803b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:09.026 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.534+0000 7f8c2122d640 1 --2- 172.21.15.148:0/1825415174 >> [v2:172.21.15.148:6800/2161746152,v1:172.21.15.148:6801/2161746152] conn(0x7f8c08039160 0x7f8c0803b620 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8c040098c0 tx=0x7f8c04006db0 comp rx=0 tx=0).stop 2024-09-19T07:02:09.027 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.534+0000 7f8c2122d640 1 -- 172.21.15.148:0/1825415174 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c1c07de20 msgr2=0x7f8c1c19d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:09.027 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.534+0000 7f8c2122d640 1 --2- 172.21.15.148:0/1825415174 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c1c07de20 0x7f8c1c19d9d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c032ce0 tx=0x7f8c0c032d10 comp rx=0 tx=0).stop 2024-09-19T07:02:09.027 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.534+0000 7f8c2122d640 1 -- 172.21.15.148:0/1825415174 shutdown_connections 2024-09-19T07:02:09.027 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.534+0000 7f8c2122d640 1 --2- 172.21.15.148:0/1825415174 >> [v2:172.21.15.148:6800/2161746152,v1:172.21.15.148:6801/2161746152] conn(0x7f8c08039160 0x7f8c0803b620 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:09.027 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.534+0000 7f8c2122d640 1 --2- 172.21.15.148:0/1825415174 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c1c07de20 0x7f8c1c19d9d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:09.027 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.534+0000 7f8c2122d640 1 -- 172.21.15.148:0/1825415174 >> 172.21.15.148:0/1825415174 conn(0x7f8c1c102f60 msgr2=0x7f8c1c103b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:09.027 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.534+0000 7f8c2122d640 1 -- 172.21.15.148:0/1825415174 shutdown_connections 2024-09-19T07:02:09.027 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:08.534+0000 7f8c2122d640 1 -- 172.21.15.148:0/1825415174 wait complete. 2024-09-19T07:02:09.027 INFO:teuthology.orchestra.run.smithi148.stdout:Enabling cephadm module... 2024-09-19T07:02:10.012 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:09 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/974842891' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-19T07:02:10.013 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:09 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: ignoring --setuser ceph since I am not root 2024-09-19T07:02:10.013 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:09 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: ignoring --setgroup ceph since I am not root 2024-09-19T07:02:10.013 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:09 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:09.806+0000 7fd065035040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T07:02:10.013 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:09 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:09.863+0000 7fd065035040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T07:02:10.013 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:10 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:10.011+0000 7fd065035040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T07:02:10.328 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:10 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:10.079+0000 7fd065035040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T07:02:10.329 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:10 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:10.228+0000 7fd065035040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:02:10.335 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.393+0000 7f191d87e640 1 Processor -- start 2024-09-19T07:02:10.335 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.393+0000 7f191d87e640 1 -- start start 2024-09-19T07:02:10.335 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.394+0000 7f191d87e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19181066d0 0x7f1918106ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:10.335 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.394+0000 7f191d87e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f19181070a0 con 0x7f19181066d0 2024-09-19T07:02:10.335 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.394+0000 7f1916ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19181066d0 0x7f1918106ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:10.335 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.394+0000 7f1916ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19181066d0 0x7f1918106ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42882/0 (socket says 172.21.15.148:42882) 2024-09-19T07:02:10.336 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.394+0000 7f1916ffd640 1 -- 172.21.15.148:0/273622137 learned_addr learned my addr 172.21.15.148:0/273622137 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:02:10.336 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.394+0000 7f1916ffd640 1 -- 172.21.15.148:0/273622137 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19181078d0 con 0x7f19181066d0 2024-09-19T07:02:10.336 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.395+0000 7f1916ffd640 1 --2- 172.21.15.148:0/273622137 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19181066d0 0x7f1918106ad0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1908009e80 tx=0x7f190802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a4bb0db756220a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:10.336 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.395+0000 7f1915ffb640 1 -- 172.21.15.148:0/273622137 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1908036070 con 0x7f19181066d0 2024-09-19T07:02:10.336 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.395+0000 7f1915ffb640 1 -- 172.21.15.148:0/273622137 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f19080318c0 con 0x7f19181066d0 2024-09-19T07:02:10.336 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.395+0000 7f1915ffb640 1 -- 172.21.15.148:0/273622137 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1908007ab0 con 0x7f19181066d0 2024-09-19T07:02:10.336 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.395+0000 7f191d87e640 1 -- 172.21.15.148:0/273622137 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19181066d0 msgr2=0x7f1918106ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:10.336 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.395+0000 7f191d87e640 1 --2- 172.21.15.148:0/273622137 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19181066d0 0x7f1918106ad0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1908009e80 tx=0x7f190802a7a0 comp rx=0 tx=0).stop 2024-09-19T07:02:10.336 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.395+0000 7f191d87e640 1 -- 172.21.15.148:0/273622137 shutdown_connections 2024-09-19T07:02:10.336 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.395+0000 7f191d87e640 1 --2- 172.21.15.148:0/273622137 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19181066d0 0x7f1918106ad0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:10.336 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.395+0000 7f191d87e640 1 -- 172.21.15.148:0/273622137 >> 172.21.15.148:0/273622137 conn(0x7f1918101e60 msgr2=0x7f19181042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:10.336 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.396+0000 7f191d87e640 1 -- 172.21.15.148:0/273622137 shutdown_connections 2024-09-19T07:02:10.336 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.396+0000 7f191d87e640 1 -- 172.21.15.148:0/273622137 wait complete. 2024-09-19T07:02:10.337 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.396+0000 7f191d87e640 1 Processor -- start 2024-09-19T07:02:10.337 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.396+0000 7f191d87e640 1 -- start start 2024-09-19T07:02:10.337 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.396+0000 7f191d87e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19181066d0 0x7f191819b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:10.337 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.396+0000 7f191d87e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f191810ac80 con 0x7f19181066d0 2024-09-19T07:02:10.337 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.396+0000 7f1916ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19181066d0 0x7f191819b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:10.337 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.397+0000 7f1916ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19181066d0 0x7f191819b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42896/0 (socket says 172.21.15.148:42896) 2024-09-19T07:02:10.337 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.397+0000 7f1916ffd640 1 -- 172.21.15.148:0/974842891 learned_addr learned my addr 172.21.15.148:0/974842891 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:02:10.337 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.397+0000 7f1916ffd640 1 -- 172.21.15.148:0/974842891 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f191819bd60 con 0x7f19181066d0 2024-09-19T07:02:10.337 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.397+0000 7f1916ffd640 1 --2- 172.21.15.148:0/974842891 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19181066d0 0x7f191819b820 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f190802acc0 tx=0x7f1908031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:10.337 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.397+0000 7f191c87c640 1 -- 172.21.15.148:0/974842891 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1908036050 con 0x7f19181066d0 2024-09-19T07:02:10.337 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.397+0000 7f191d87e640 1 -- 172.21.15.148:0/974842891 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f191819bff0 con 0x7f19181066d0 2024-09-19T07:02:10.337 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.397+0000 7f191c87c640 1 -- 172.21.15.148:0/974842891 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1908037040 con 0x7f19181066d0 2024-09-19T07:02:10.337 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.397+0000 7f191c87c640 1 -- 172.21.15.148:0/974842891 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f190803d8c0 con 0x7f19181066d0 2024-09-19T07:02:10.337 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.397+0000 7f191d87e640 1 -- 172.21.15.148:0/974842891 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f191819ece0 con 0x7f19181066d0 2024-09-19T07:02:10.338 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.398+0000 7f191c87c640 1 -- 172.21.15.148:0/974842891 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f1908044020 con 0x7f19181066d0 2024-09-19T07:02:10.338 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.398+0000 7f191d87e640 1 -- 172.21.15.148:0/974842891 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1918106b50 con 0x7f19181066d0 2024-09-19T07:02:10.338 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.398+0000 7f191c87c640 1 --2- 172.21.15.148:0/974842891 >> [v2:172.21.15.148:6800/2161746152,v1:172.21.15.148:6801/2161746152] conn(0x7f1904039160 0x7f190403b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:10.338 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.398+0000 7f191c87c640 1 -- 172.21.15.148:0/974842891 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1908042020 con 0x7f19181066d0 2024-09-19T07:02:10.338 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.398+0000 7f19167fc640 1 --2- 172.21.15.148:0/974842891 >> [v2:172.21.15.148:6800/2161746152,v1:172.21.15.148:6801/2161746152] conn(0x7f1904039160 0x7f190403b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:10.338 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.399+0000 7f19167fc640 1 --2- 172.21.15.148:0/974842891 >> [v2:172.21.15.148:6800/2161746152,v1:172.21.15.148:6801/2161746152] conn(0x7f1904039160 0x7f190403b620 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f19000098c0 tx=0x7f1900006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:10.338 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.403+0000 7f191c87c640 1 -- 172.21.15.148:0/974842891 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f190804b020 con 0x7f19181066d0 2024-09-19T07:02:10.338 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.615+0000 7f191d87e640 1 -- 172.21.15.148:0/974842891 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f191802da40 con 0x7f19181066d0 2024-09-19T07:02:10.338 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.667+0000 7f191c87c640 1 -- 172.21.15.148:0/974842891 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f19080371f0 con 0x7f19181066d0 2024-09-19T07:02:10.338 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.668+0000 7f191c87c640 1 -- 172.21.15.148:0/974842891 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f1908046790 con 0x7f19181066d0 2024-09-19T07:02:10.338 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.670+0000 7f191d87e640 1 -- 172.21.15.148:0/974842891 >> [v2:172.21.15.148:6800/2161746152,v1:172.21.15.148:6801/2161746152] conn(0x7f1904039160 msgr2=0x7f190403b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:10.338 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.670+0000 7f191d87e640 1 --2- 172.21.15.148:0/974842891 >> [v2:172.21.15.148:6800/2161746152,v1:172.21.15.148:6801/2161746152] conn(0x7f1904039160 0x7f190403b620 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f19000098c0 tx=0x7f1900006db0 comp rx=0 tx=0).stop 2024-09-19T07:02:10.338 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.670+0000 7f191d87e640 1 -- 172.21.15.148:0/974842891 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19181066d0 msgr2=0x7f191819b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:10.339 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.670+0000 7f191d87e640 1 --2- 172.21.15.148:0/974842891 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19181066d0 0x7f191819b820 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f190802acc0 tx=0x7f1908031ca0 comp rx=0 tx=0).stop 2024-09-19T07:02:10.339 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.670+0000 7f191d87e640 1 -- 172.21.15.148:0/974842891 shutdown_connections 2024-09-19T07:02:10.339 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.670+0000 7f191d87e640 1 --2- 172.21.15.148:0/974842891 >> [v2:172.21.15.148:6800/2161746152,v1:172.21.15.148:6801/2161746152] conn(0x7f1904039160 0x7f190403b620 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:10.339 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.670+0000 7f191d87e640 1 --2- 172.21.15.148:0/974842891 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19181066d0 0x7f191819b820 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:10.339 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.670+0000 7f191d87e640 1 -- 172.21.15.148:0/974842891 >> 172.21.15.148:0/974842891 conn(0x7f1918101e60 msgr2=0x7f1918102df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:10.339 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.670+0000 7f191d87e640 1 -- 172.21.15.148:0/974842891 shutdown_connections 2024-09-19T07:02:10.339 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:09.670+0000 7f191d87e640 1 -- 172.21.15.148:0/974842891 wait complete. 2024-09-19T07:02:10.579 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:10 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:10.380+0000 7fd065035040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T07:02:10.942 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:10 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/974842891' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-19T07:02:10.942 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:10 smithi148 ceph-mon[31180]: mgrmap e5: x(active, since 10s) 2024-09-19T07:02:10.942 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:10 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:10.713+0000 7fd065035040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T07:02:10.942 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:10 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:10.778+0000 7fd065035040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T07:02:11.333 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:10 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:10.969+0000 7fd065035040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T07:02:11.949 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:11 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/2780198238' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T07:02:11.950 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:11 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:11.879+0000 7fd065035040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T07:02:11.950 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:11 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:11.947+0000 7fd065035040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T07:02:12.069 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout { 2024-09-19T07:02:12.069 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-19T07:02:12.069 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T07:02:12.069 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T07:02:12.069 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T07:02:12.069 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout } 2024-09-19T07:02:12.069 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.734+0000 7fa27c5c4640 1 Processor -- start 2024-09-19T07:02:12.069 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.735+0000 7fa27c5c4640 1 -- start start 2024-09-19T07:02:12.069 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.735+0000 7fa27c5c4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2741066d0 0x7fa274106ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:12.070 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.735+0000 7fa27c5c4640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa2741070a0 con 0x7fa2741066d0 2024-09-19T07:02:12.070 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.735+0000 7fa27a360640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2741066d0 0x7fa274106ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:12.070 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.735+0000 7fa27a360640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2741066d0 0x7fa274106ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42920/0 (socket says 172.21.15.148:42920) 2024-09-19T07:02:12.070 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.735+0000 7fa27a360640 1 -- 172.21.15.148:0/1484147845 learned_addr learned my addr 172.21.15.148:0/1484147845 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:02:12.070 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.735+0000 7fa27a360640 1 -- 172.21.15.148:0/1484147845 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2741078d0 con 0x7fa2741066d0 2024-09-19T07:02:12.070 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.736+0000 7fa27a360640 1 --2- 172.21.15.148:0/1484147845 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2741066d0 0x7fa274106ad0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa270009820 tx=0x7fa27002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f22b10e80a1d659a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:12.070 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.736+0000 7fa27935e640 1 -- 172.21.15.148:0/1484147845 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa270037070 con 0x7fa2741066d0 2024-09-19T07:02:12.070 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.736+0000 7fa27935e640 1 -- 172.21.15.148:0/1484147845 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa270032900 con 0x7fa2741066d0 2024-09-19T07:02:12.070 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.736+0000 7fa27935e640 1 -- 172.21.15.148:0/1484147845 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa270030850 con 0x7fa2741066d0 2024-09-19T07:02:12.070 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.737+0000 7fa27c5c4640 1 -- 172.21.15.148:0/1484147845 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2741066d0 msgr2=0x7fa274106ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:12.070 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.737+0000 7fa27c5c4640 1 --2- 172.21.15.148:0/1484147845 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2741066d0 0x7fa274106ad0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa270009820 tx=0x7fa27002a270 comp rx=0 tx=0).stop 2024-09-19T07:02:12.070 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.737+0000 7fa27c5c4640 1 -- 172.21.15.148:0/1484147845 shutdown_connections 2024-09-19T07:02:12.071 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.737+0000 7fa27c5c4640 1 --2- 172.21.15.148:0/1484147845 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2741066d0 0x7fa274106ad0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:12.071 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.737+0000 7fa27c5c4640 1 -- 172.21.15.148:0/1484147845 >> 172.21.15.148:0/1484147845 conn(0x7fa274101e60 msgr2=0x7fa2741042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:12.071 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.737+0000 7fa27c5c4640 1 -- 172.21.15.148:0/1484147845 shutdown_connections 2024-09-19T07:02:12.071 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.737+0000 7fa27c5c4640 1 -- 172.21.15.148:0/1484147845 wait complete. 2024-09-19T07:02:12.071 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.737+0000 7fa27c5c4640 1 Processor -- start 2024-09-19T07:02:12.071 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.738+0000 7fa27c5c4640 1 -- start start 2024-09-19T07:02:12.071 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.738+0000 7fa27c5c4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2741066d0 0x7fa27419b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:12.071 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.738+0000 7fa27c5c4640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa27410ac80 con 0x7fa2741066d0 2024-09-19T07:02:12.071 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.738+0000 7fa27a360640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2741066d0 0x7fa27419b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:12.071 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.738+0000 7fa27a360640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2741066d0 0x7fa27419b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42932/0 (socket says 172.21.15.148:42932) 2024-09-19T07:02:12.071 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.738+0000 7fa27a360640 1 -- 172.21.15.148:0/2780198238 learned_addr learned my addr 172.21.15.148:0/2780198238 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:02:12.071 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.738+0000 7fa27a360640 1 -- 172.21.15.148:0/2780198238 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa27419bd30 con 0x7fa2741066d0 2024-09-19T07:02:12.071 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.738+0000 7fa27a360640 1 --2- 172.21.15.148:0/2780198238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2741066d0 0x7fa27419b7f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa2700097f0 tx=0x7fa270030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:12.072 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.738+0000 7fa26b7fe640 1 -- 172.21.15.148:0/2780198238 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa270037040 con 0x7fa2741066d0 2024-09-19T07:02:12.072 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.738+0000 7fa26b7fe640 1 -- 172.21.15.148:0/2780198238 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa270040070 con 0x7fa2741066d0 2024-09-19T07:02:12.072 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.738+0000 7fa27c5c4640 1 -- 172.21.15.148:0/2780198238 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa27419bfc0 con 0x7fa2741066d0 2024-09-19T07:02:12.072 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.738+0000 7fa26b7fe640 1 -- 172.21.15.148:0/2780198238 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa27003a390 con 0x7fa2741066d0 2024-09-19T07:02:12.072 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.739+0000 7fa27c5c4640 1 -- 172.21.15.148:0/2780198238 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa27419ecb0 con 0x7fa2741066d0 2024-09-19T07:02:12.072 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.739+0000 7fa26b7fe640 1 -- 172.21.15.148:0/2780198238 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7fa27003a5e0 con 0x7fa2741066d0 2024-09-19T07:02:12.072 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.740+0000 7fa27c5c4640 1 -- 172.21.15.148:0/2780198238 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa274106b50 con 0x7fa2741066d0 2024-09-19T07:02:12.072 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.740+0000 7fa26b7fe640 1 --2- 172.21.15.148:0/2780198238 >> [v2:172.21.15.148:6800/2161746152,v1:172.21.15.148:6801/2161746152] conn(0x7fa260039200 0x7fa26003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:12.072 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.740+0000 7fa279b5f640 1 -- 172.21.15.148:0/2780198238 >> [v2:172.21.15.148:6800/2161746152,v1:172.21.15.148:6801/2161746152] conn(0x7fa260039200 msgr2=0x7fa26003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:6800/2161746152 2024-09-19T07:02:12.072 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.740+0000 7fa26b7fe640 1 -- 172.21.15.148:0/2780198238 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa27006c400 con 0x7fa2741066d0 2024-09-19T07:02:12.072 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.740+0000 7fa279b5f640 1 --2- 172.21.15.148:0/2780198238 >> [v2:172.21.15.148:6800/2161746152,v1:172.21.15.148:6801/2161746152] conn(0x7fa260039200 0x7fa26003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T07:02:12.072 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.744+0000 7fa26b7fe640 1 -- 172.21.15.148:0/2780198238 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa27003a8d0 con 0x7fa2741066d0 2024-09-19T07:02:12.073 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.941+0000 7fa279b5f640 1 -- 172.21.15.148:0/2780198238 >> [v2:172.21.15.148:6800/2161746152,v1:172.21.15.148:6801/2161746152] conn(0x7fa260039200 msgr2=0x7fa26003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:6800/2161746152 2024-09-19T07:02:12.073 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.941+0000 7fa279b5f640 1 --2- 172.21.15.148:0/2780198238 >> [v2:172.21.15.148:6800/2161746152,v1:172.21.15.148:6801/2161746152] conn(0x7fa260039200 0x7fa26003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T07:02:12.073 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.965+0000 7fa27c5c4640 1 -- 172.21.15.148:0/2780198238 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fa27419f3a0 con 0x7fa2741066d0 2024-09-19T07:02:12.073 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.966+0000 7fa26b7fe640 1 -- 172.21.15.148:0/2780198238 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7fa270043760 con 0x7fa2741066d0 2024-09-19T07:02:12.073 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.968+0000 7fa27c5c4640 1 -- 172.21.15.148:0/2780198238 >> [v2:172.21.15.148:6800/2161746152,v1:172.21.15.148:6801/2161746152] conn(0x7fa260039200 msgr2=0x7fa26003b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T07:02:12.073 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.968+0000 7fa27c5c4640 1 --2- 172.21.15.148:0/2780198238 >> [v2:172.21.15.148:6800/2161746152,v1:172.21.15.148:6801/2161746152] conn(0x7fa260039200 0x7fa26003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:12.073 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.968+0000 7fa27c5c4640 1 -- 172.21.15.148:0/2780198238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2741066d0 msgr2=0x7fa27419b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:12.073 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.968+0000 7fa27c5c4640 1 --2- 172.21.15.148:0/2780198238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2741066d0 0x7fa27419b7f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa2700097f0 tx=0x7fa270030d80 comp rx=0 tx=0).stop 2024-09-19T07:02:12.073 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.968+0000 7fa27c5c4640 1 -- 172.21.15.148:0/2780198238 shutdown_connections 2024-09-19T07:02:12.073 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.968+0000 7fa27c5c4640 1 --2- 172.21.15.148:0/2780198238 >> [v2:172.21.15.148:6800/2161746152,v1:172.21.15.148:6801/2161746152] conn(0x7fa260039200 0x7fa26003b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:12.073 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.968+0000 7fa27c5c4640 1 --2- 172.21.15.148:0/2780198238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2741066d0 0x7fa27419b7f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:12.073 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.968+0000 7fa27c5c4640 1 -- 172.21.15.148:0/2780198238 >> 172.21.15.148:0/2780198238 conn(0x7fa274101e60 msgr2=0x7fa274102a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:12.073 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.968+0000 7fa27c5c4640 1 -- 172.21.15.148:0/2780198238 shutdown_connections 2024-09-19T07:02:12.073 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:10.968+0000 7fa27c5c4640 1 -- 172.21.15.148:0/2780198238 wait complete. 2024-09-19T07:02:12.074 INFO:teuthology.orchestra.run.smithi148.stdout:Waiting for the mgr to restart... 2024-09-19T07:02:12.074 INFO:teuthology.orchestra.run.smithi148.stdout:Waiting for mgr epoch 5... 2024-09-19T07:02:12.802 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:12 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:12.685+0000 7fd065035040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T07:02:12.802 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:12 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:12.801+0000 7fd065035040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T07:02:13.083 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:12 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:12.942+0000 7fd065035040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:02:13.083 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:13 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:13.005+0000 7fd065035040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T07:02:13.334 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:13 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:13.159+0000 7fd065035040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T07:02:13.334 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:13 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:13.226+0000 7fd065035040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T07:02:13.334 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:13 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:13.285+0000 7fd065035040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T07:02:13.711 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:13 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:13.441+0000 7fd065035040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T07:02:13.711 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:13 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:13.505+0000 7fd065035040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T07:02:13.711 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:13 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:13.570+0000 7fd065035040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T07:02:13.711 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:13 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:13.651+0000 7fd065035040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T07:02:13.711 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:13 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:13.710+0000 7fd065035040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T07:02:14.083 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:13 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:13.768+0000 7fd065035040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T07:02:14.833 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:14 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:14.555+0000 7fd065035040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T07:02:14.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:14 smithi148 ceph-mon[31180]: Active manager daemon x restarted 2024-09-19T07:02:14.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:14 smithi148 ceph-mon[31180]: Activating manager daemon x 2024-09-19T07:02:14.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:14 smithi148 ceph-mon[31180]: osdmap e2: 0 total, 0 up, 0 in 2024-09-19T07:02:14.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:14 smithi148 ceph-mon[31180]: mgrmap e6: x(active, starting, since 0.00350138s) 2024-09-19T07:02:14.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:14 smithi148 ceph-mon[31180]: from='mgr.14116 172.21.15.148:0/2118014832' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:02:14.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:14 smithi148 ceph-mon[31180]: from='mgr.14116 172.21.15.148:0/2118014832' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T07:02:14.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:14 smithi148 ceph-mon[31180]: from='mgr.14116 172.21.15.148:0/2118014832' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T07:02:14.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:14 smithi148 ceph-mon[31180]: from='mgr.14116 172.21.15.148:0/2118014832' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T07:02:14.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:14 smithi148 ceph-mon[31180]: from='mgr.14116 172.21.15.148:0/2118014832' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T07:02:14.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:14 smithi148 ceph-mon[31180]: Manager daemon x is now available 2024-09-19T07:02:14.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:14 smithi148 ceph-mon[31180]: from='mgr.14116 172.21.15.148:0/2118014832' entity='mgr.x' 2024-09-19T07:02:14.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:14 smithi148 ceph-mon[31180]: from='mgr.14116 172.21.15.148:0/2118014832' entity='mgr.x' 2024-09-19T07:02:14.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:14 smithi148 ceph-mon[31180]: from='mgr.14116 172.21.15.148:0/2118014832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:02:14.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:14 smithi148 ceph-mon[31180]: from='mgr.14116 172.21.15.148:0/2118014832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:02:14.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:14 smithi148 ceph-mon[31180]: from='mgr.14116 172.21.15.148:0/2118014832' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T07:02:14.835 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:14 smithi148 ceph-mon[31180]: from='mgr.14116 172.21.15.148:0/2118014832' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T07:02:15.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:15 smithi148 ceph-mon[31180]: Found migration_current of "None". Setting to last migration. 2024-09-19T07:02:15.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:15 smithi148 ceph-mon[31180]: from='mgr.14116 172.21.15.148:0/2118014832' entity='mgr.x' 2024-09-19T07:02:15.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:15 smithi148 ceph-mon[31180]: from='mgr.14116 172.21.15.148:0/2118014832' entity='mgr.x' 2024-09-19T07:02:15.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:15 smithi148 ceph-mon[31180]: mgrmap e7: x(active, since 1.00526s) 2024-09-19T07:02:16.126 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout { 2024-09-19T07:02:16.126 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-19T07:02:16.126 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T07:02:16.126 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout } 2024-09-19T07:02:16.126 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:12.473+0000 7f9446c0f640 1 Processor -- start 2024-09-19T07:02:16.126 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:12.473+0000 7f9446c0f640 1 -- start start 2024-09-19T07:02:16.127 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:12.473+0000 7f9446c0f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94401066f0 0x7f9440106af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:16.127 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:12.473+0000 7f9446c0f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f94401070c0 con 0x7f94401066f0 2024-09-19T07:02:16.127 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:12.473+0000 7f94449ab640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94401066f0 0x7f9440106af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:16.127 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:12.473+0000 7f94449ab640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94401066f0 0x7f9440106af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42940/0 (socket says 172.21.15.148:42940) 2024-09-19T07:02:16.127 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:12.473+0000 7f94449ab640 1 -- 172.21.15.148:0/1599464115 learned_addr learned my addr 172.21.15.148:0/1599464115 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:02:16.127 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:12.474+0000 7f94449ab640 1 -- 172.21.15.148:0/1599464115 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94401078f0 con 0x7f94401066f0 2024-09-19T07:02:16.127 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:12.474+0000 7f94449ab640 1 --2- 172.21.15.148:0/1599464115 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94401066f0 0x7f9440106af0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9434009820 tx=0x7f943402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af8b333ff97951c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:16.127 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:12.475+0000 7f943f7fe640 1 -- 172.21.15.148:0/1599464115 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9434037070 con 0x7f94401066f0 2024-09-19T07:02:16.127 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:12.475+0000 7f943f7fe640 1 -- 172.21.15.148:0/1599464115 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9434032900 con 0x7f94401066f0 2024-09-19T07:02:16.127 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:12.475+0000 7f943f7fe640 1 -- 172.21.15.148:0/1599464115 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9434030850 con 0x7f94401066f0 2024-09-19T07:02:16.128 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:12.475+0000 7f9446c0f640 1 -- 172.21.15.148:0/1599464115 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94401066f0 msgr2=0x7f9440106af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:16.128 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:12.475+0000 7f9446c0f640 1 --2- 172.21.15.148:0/1599464115 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94401066f0 0x7f9440106af0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9434009820 tx=0x7f943402a270 comp rx=0 tx=0).stop 2024-09-19T07:02:16.128 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:12.476+0000 7f9446c0f640 1 -- 172.21.15.148:0/1599464115 shutdown_connections 2024-09-19T07:02:16.128 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:12.476+0000 7f9446c0f640 1 --2- 172.21.15.148:0/1599464115 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94401066f0 0x7f9440106af0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:16.128 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:12.476+0000 7f9446c0f640 1 -- 172.21.15.148:0/1599464115 >> 172.21.15.148:0/1599464115 conn(0x7f9440101e80 msgr2=0x7f94401042c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:16.128 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:12.476+0000 7f9446c0f640 1 -- 172.21.15.148:0/1599464115 shutdown_connections 2024-09-19T07:02:16.128 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:12.476+0000 7f9446c0f640 1 -- 172.21.15.148:0/1599464115 wait complete. 2024-09-19T07:02:16.128 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:12.476+0000 7f9446c0f640 1 Processor -- start 2024-09-19T07:02:16.128 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:12.477+0000 7f9446c0f640 1 -- start start 2024-09-19T07:02:16.128 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:12.477+0000 7f9446c0f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94401066f0 0x7f944019a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:16.128 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:12.477+0000 7f9446c0f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f944010aca0 con 0x7f94401066f0 2024-09-19T07:02:16.128 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:12.477+0000 7f94449ab640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94401066f0 0x7f944019a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:16.128 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:12.477+0000 7f94449ab640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94401066f0 0x7f944019a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42952/0 (socket says 172.21.15.148:42952) 2024-09-19T07:02:16.129 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:12.477+0000 7f94449ab640 1 -- 172.21.15.148:0/3002000598 learned_addr learned my addr 172.21.15.148:0/3002000598 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:02:16.129 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:12.477+0000 7f94449ab640 1 -- 172.21.15.148:0/3002000598 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f944019ac60 con 0x7f94401066f0 2024-09-19T07:02:16.129 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:12.477+0000 7f94449ab640 1 --2- 172.21.15.148:0/3002000598 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94401066f0 0x7f944019a720 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f94340097f0 tx=0x7f9434030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:16.129 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:12.478+0000 7f943dffb640 1 -- 172.21.15.148:0/3002000598 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9434037040 con 0x7f94401066f0 2024-09-19T07:02:16.129 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:12.478+0000 7f943dffb640 1 -- 172.21.15.148:0/3002000598 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9434040070 con 0x7f94401066f0 2024-09-19T07:02:16.129 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:12.478+0000 7f9446c0f640 1 -- 172.21.15.148:0/3002000598 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f944019aef0 con 0x7f94401066f0 2024-09-19T07:02:16.129 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:12.478+0000 7f943dffb640 1 -- 172.21.15.148:0/3002000598 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f943403a390 con 0x7f94401066f0 2024-09-19T07:02:16.129 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:12.478+0000 7f9446c0f640 1 -- 172.21.15.148:0/3002000598 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f944019dbe0 con 0x7f94401066f0 2024-09-19T07:02:16.129 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:12.479+0000 7f943dffb640 1 -- 172.21.15.148:0/3002000598 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f943403a5e0 con 0x7f94401066f0 2024-09-19T07:02:16.129 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:12.479+0000 7f943dffb640 1 --2- 172.21.15.148:0/3002000598 >> [v2:172.21.15.148:6800/2161746152,v1:172.21.15.148:6801/2161746152] conn(0x7f9430039200 0x7f943003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:16.129 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:12.479+0000 7f943dffb640 1 -- 172.21.15.148:0/3002000598 --> [v2:172.21.15.148:6800/2161746152,v1:172.21.15.148:6801/2161746152] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f943003bdd0 con 0x7f9430039200 2024-09-19T07:02:16.129 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:12.479+0000 7f943dffb640 1 -- 172.21.15.148:0/3002000598 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f943406d490 con 0x7f94401066f0 2024-09-19T07:02:16.130 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:12.479+0000 7f943ffff640 1 -- 172.21.15.148:0/3002000598 >> [v2:172.21.15.148:6800/2161746152,v1:172.21.15.148:6801/2161746152] conn(0x7f9430039200 msgr2=0x7f943003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:6800/2161746152 2024-09-19T07:02:16.130 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:12.479+0000 7f943ffff640 1 --2- 172.21.15.148:0/3002000598 >> [v2:172.21.15.148:6800/2161746152,v1:172.21.15.148:6801/2161746152] conn(0x7f9430039200 0x7f943003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T07:02:16.130 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:12.680+0000 7f943ffff640 1 -- 172.21.15.148:0/3002000598 >> [v2:172.21.15.148:6800/2161746152,v1:172.21.15.148:6801/2161746152] conn(0x7f9430039200 msgr2=0x7f943003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:6800/2161746152 2024-09-19T07:02:16.130 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:12.680+0000 7f943ffff640 1 --2- 172.21.15.148:0/3002000598 >> [v2:172.21.15.148:6800/2161746152,v1:172.21.15.148:6801/2161746152] conn(0x7f9430039200 0x7f943003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T07:02:16.130 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:13.081+0000 7f943ffff640 1 -- 172.21.15.148:0/3002000598 >> [v2:172.21.15.148:6800/2161746152,v1:172.21.15.148:6801/2161746152] conn(0x7f9430039200 msgr2=0x7f943003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:6800/2161746152 2024-09-19T07:02:16.130 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:13.081+0000 7f943ffff640 1 --2- 172.21.15.148:0/3002000598 >> [v2:172.21.15.148:6800/2161746152,v1:172.21.15.148:6801/2161746152] conn(0x7f9430039200 0x7f943003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T07:02:16.130 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:13.882+0000 7f943ffff640 1 -- 172.21.15.148:0/3002000598 >> [v2:172.21.15.148:6800/2161746152,v1:172.21.15.148:6801/2161746152] conn(0x7f9430039200 msgr2=0x7f943003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:6800/2161746152 2024-09-19T07:02:16.130 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:13.882+0000 7f943ffff640 1 --2- 172.21.15.148:0/3002000598 >> [v2:172.21.15.148:6800/2161746152,v1:172.21.15.148:6801/2161746152] conn(0x7f9430039200 0x7f943003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T07:02:16.130 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:14.558+0000 7f943dffb640 1 -- 172.21.15.148:0/3002000598 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mgrmap(e 6) ==== 46228+0+0 (secure 0 0 0) 0x7f943402fd60 con 0x7f94401066f0 2024-09-19T07:02:16.130 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:14.558+0000 7f943dffb640 1 -- 172.21.15.148:0/3002000598 >> [v2:172.21.15.148:6800/2161746152,v1:172.21.15.148:6801/2161746152] conn(0x7f9430039200 msgr2=0x7f943003b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T07:02:16.130 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:14.558+0000 7f943dffb640 1 --2- 172.21.15.148:0/3002000598 >> [v2:172.21.15.148:6800/2161746152,v1:172.21.15.148:6801/2161746152] conn(0x7f9430039200 0x7f943003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:16.130 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:15.559+0000 7f943dffb640 1 -- 172.21.15.148:0/3002000598 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7f9434031cc0 con 0x7f94401066f0 2024-09-19T07:02:16.130 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:15.559+0000 7f943dffb640 1 --2- 172.21.15.148:0/3002000598 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f943003cb30 0x7f943003ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:16.131 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:15.559+0000 7f943dffb640 1 -- 172.21.15.148:0/3002000598 --> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f943403de70 con 0x7f943003cb30 2024-09-19T07:02:16.131 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:15.560+0000 7f943ffff640 1 --2- 172.21.15.148:0/3002000598 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f943003cb30 0x7f943003ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:16.131 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:15.560+0000 7f943ffff640 1 --2- 172.21.15.148:0/3002000598 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f943003cb30 0x7f943003ef20 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f942c003980 tx=0x7f942c0092b0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:16.131 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:15.561+0000 7f943dffb640 1 -- 172.21.15.148:0/3002000598 <== mgr.14116 v2:172.21.15.148:6800/1949849385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f943403de70 con 0x7f943003cb30 2024-09-19T07:02:16.131 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:15.568+0000 7f9446c0f640 1 -- 172.21.15.148:0/3002000598 --> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f9440106b70 con 0x7f943003cb30 2024-09-19T07:02:16.131 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:15.568+0000 7f943dffb640 1 -- 172.21.15.148:0/3002000598 <== mgr.14116 v2:172.21.15.148:6800/1949849385 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f9440106b70 con 0x7f943003cb30 2024-09-19T07:02:16.131 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:15.569+0000 7f9446c0f640 1 -- 172.21.15.148:0/3002000598 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f943003cb30 msgr2=0x7f943003ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:16.131 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:15.569+0000 7f9446c0f640 1 --2- 172.21.15.148:0/3002000598 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f943003cb30 0x7f943003ef20 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f942c003980 tx=0x7f942c0092b0 comp rx=0 tx=0).stop 2024-09-19T07:02:16.131 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:15.569+0000 7f9446c0f640 1 -- 172.21.15.148:0/3002000598 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94401066f0 msgr2=0x7f944019a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:16.131 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:15.569+0000 7f9446c0f640 1 --2- 172.21.15.148:0/3002000598 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94401066f0 0x7f944019a720 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f94340097f0 tx=0x7f9434030d80 comp rx=0 tx=0).stop 2024-09-19T07:02:16.131 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:15.569+0000 7f9446c0f640 1 -- 172.21.15.148:0/3002000598 shutdown_connections 2024-09-19T07:02:16.131 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:15.569+0000 7f9446c0f640 1 --2- 172.21.15.148:0/3002000598 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f943003cb30 0x7f943003ef20 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:16.131 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:15.569+0000 7f9446c0f640 1 --2- 172.21.15.148:0/3002000598 >> [v2:172.21.15.148:6800/2161746152,v1:172.21.15.148:6801/2161746152] conn(0x7f9430039200 0x7f943003b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:16.131 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:15.569+0000 7f9446c0f640 1 --2- 172.21.15.148:0/3002000598 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94401066f0 0x7f944019a720 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:16.132 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:15.569+0000 7f9446c0f640 1 -- 172.21.15.148:0/3002000598 >> 172.21.15.148:0/3002000598 conn(0x7f9440101e80 msgr2=0x7f9440102a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:16.132 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:15.569+0000 7f9446c0f640 1 -- 172.21.15.148:0/3002000598 shutdown_connections 2024-09-19T07:02:16.132 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:15.569+0000 7f9446c0f640 1 -- 172.21.15.148:0/3002000598 wait complete. 2024-09-19T07:02:16.132 INFO:teuthology.orchestra.run.smithi148.stdout:mgr epoch 5 is available 2024-09-19T07:02:16.132 INFO:teuthology.orchestra.run.smithi148.stdout:Setting orchestrator backend to cephadm... 2024-09-19T07:02:16.217 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:15 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:15.873+0000 7fcfcc38f640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:07:02:15] ENGINE Error in HTTPServer.serve 2024-09-19T07:02:16.218 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:15 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: Traceback (most recent call last): 2024-09-19T07:02:16.218 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:15 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T07:02:16.218 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:15 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: self._connections.run(self.expiration_interval) 2024-09-19T07:02:16.218 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:15 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T07:02:16.218 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:15 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: self._run(expiration_interval) 2024-09-19T07:02:16.218 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:15 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T07:02:16.218 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:15 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T07:02:16.218 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:15 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T07:02:16.218 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:15 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T07:02:16.218 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:15 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T07:02:16.218 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:15 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: s = self.context.wrap_socket( 2024-09-19T07:02:16.219 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:15 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T07:02:16.219 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:15 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: return self.sslsocket_class._create( 2024-09-19T07:02:16.219 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:15 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T07:02:16.219 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:15 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: self.do_handshake() 2024-09-19T07:02:16.219 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:15 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T07:02:16.219 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:15 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: self._sslobj.do_handshake() 2024-09-19T07:02:16.219 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:15 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T07:02:16.219 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:15 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:16.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:16 smithi148 ceph-mon[31180]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T07:02:16.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:16 smithi148 ceph-mon[31180]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T07:02:16.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:16 smithi148 ceph-mon[31180]: [19/Sep/2024:07:02:15] ENGINE Bus STARTING 2024-09-19T07:02:16.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:16 smithi148 ceph-mon[31180]: from='mgr.14116 172.21.15.148:0/2118014832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:02:17.230 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.504+0000 7f783103f640 1 Processor -- start 2024-09-19T07:02:17.230 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.505+0000 7f783103f640 1 -- start start 2024-09-19T07:02:17.230 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.505+0000 7f783103f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f782c1077d0 0x7f782c107bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:17.231 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.505+0000 7f783103f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f782c1081a0 con 0x7f782c1077d0 2024-09-19T07:02:17.231 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.505+0000 7f782ad9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f782c1077d0 0x7f782c107bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:17.231 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.505+0000 7f782ad9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f782c1077d0 0x7f782c107bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43476/0 (socket says 172.21.15.148:43476) 2024-09-19T07:02:17.231 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.505+0000 7f782ad9d640 1 -- 172.21.15.148:0/2303271933 learned_addr learned my addr 172.21.15.148:0/2303271933 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:02:17.231 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.505+0000 7f782ad9d640 1 -- 172.21.15.148:0/2303271933 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f782c1089d0 con 0x7f782c1077d0 2024-09-19T07:02:17.231 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.506+0000 7f782ad9d640 1 --2- 172.21.15.148:0/2303271933 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f782c1077d0 0x7f782c107bd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f781c009820 tx=0x7f781c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fa0d99c13db75d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:17.231 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.506+0000 7f7829d9b640 1 -- 172.21.15.148:0/2303271933 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f781c037070 con 0x7f782c1077d0 2024-09-19T07:02:17.231 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.506+0000 7f7829d9b640 1 -- 172.21.15.148:0/2303271933 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f781c032900 con 0x7f782c1077d0 2024-09-19T07:02:17.231 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.506+0000 7f7829d9b640 1 -- 172.21.15.148:0/2303271933 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f781c030850 con 0x7f782c1077d0 2024-09-19T07:02:17.231 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.506+0000 7f783103f640 1 -- 172.21.15.148:0/2303271933 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f782c1077d0 msgr2=0x7f782c107bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:17.231 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.506+0000 7f783103f640 1 --2- 172.21.15.148:0/2303271933 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f782c1077d0 0x7f782c107bd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f781c009820 tx=0x7f781c02a270 comp rx=0 tx=0).stop 2024-09-19T07:02:17.231 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.507+0000 7f783103f640 1 -- 172.21.15.148:0/2303271933 shutdown_connections 2024-09-19T07:02:17.231 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.507+0000 7f783103f640 1 --2- 172.21.15.148:0/2303271933 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f782c1077d0 0x7f782c107bd0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:17.232 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.507+0000 7f783103f640 1 -- 172.21.15.148:0/2303271933 >> 172.21.15.148:0/2303271933 conn(0x7f782c102f60 msgr2=0x7f782c1053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:17.232 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.507+0000 7f783103f640 1 -- 172.21.15.148:0/2303271933 shutdown_connections 2024-09-19T07:02:17.232 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.507+0000 7f783103f640 1 -- 172.21.15.148:0/2303271933 wait complete. 2024-09-19T07:02:17.232 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.507+0000 7f783103f640 1 Processor -- start 2024-09-19T07:02:17.232 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.508+0000 7f783103f640 1 -- start start 2024-09-19T07:02:17.232 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.508+0000 7f783103f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f782c1077d0 0x7f782c19b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:17.232 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.508+0000 7f783103f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f782c10bd80 con 0x7f782c1077d0 2024-09-19T07:02:17.232 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.508+0000 7f782ad9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f782c1077d0 0x7f782c19b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:17.232 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.508+0000 7f782ad9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f782c1077d0 0x7f782c19b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43492/0 (socket says 172.21.15.148:43492) 2024-09-19T07:02:17.232 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.508+0000 7f782ad9d640 1 -- 172.21.15.148:0/1558178578 learned_addr learned my addr 172.21.15.148:0/1558178578 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:02:17.232 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.508+0000 7f782ad9d640 1 -- 172.21.15.148:0/1558178578 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f782c19bcd0 con 0x7f782c1077d0 2024-09-19T07:02:17.232 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.508+0000 7f782ad9d640 1 --2- 172.21.15.148:0/1558178578 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f782c1077d0 0x7f782c19b790 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f781c009940 tx=0x7f781c032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:17.232 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.508+0000 7f7813fff640 1 -- 172.21.15.148:0/1558178578 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f781c042070 con 0x7f782c1077d0 2024-09-19T07:02:17.232 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.508+0000 7f7813fff640 1 -- 172.21.15.148:0/1558178578 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f781c0308c0 con 0x7f782c1077d0 2024-09-19T07:02:17.233 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.508+0000 7f783103f640 1 -- 172.21.15.148:0/1558178578 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f782c19bf60 con 0x7f782c1077d0 2024-09-19T07:02:17.233 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.508+0000 7f7813fff640 1 -- 172.21.15.148:0/1558178578 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f781c037040 con 0x7f782c1077d0 2024-09-19T07:02:17.233 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.508+0000 7f783103f640 1 -- 172.21.15.148:0/1558178578 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f782c19ec50 con 0x7f782c1077d0 2024-09-19T07:02:17.233 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.509+0000 7f7813fff640 1 -- 172.21.15.148:0/1558178578 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7f781c045070 con 0x7f782c1077d0 2024-09-19T07:02:17.233 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.509+0000 7f7813fff640 1 --2- 172.21.15.148:0/1558178578 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f78140390a0 0x7f781403b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:17.233 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.509+0000 7f7813fff640 1 -- 172.21.15.148:0/1558178578 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f781c06d1e0 con 0x7f782c1077d0 2024-09-19T07:02:17.233 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.510+0000 7f782a59c640 1 --2- 172.21.15.148:0/1558178578 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f78140390a0 0x7f781403b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:17.233 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.510+0000 7f783103f640 1 -- 172.21.15.148:0/1558178578 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f782c107c50 con 0x7f782c1077d0 2024-09-19T07:02:17.233 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.510+0000 7f782a59c640 1 --2- 172.21.15.148:0/1558178578 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f78140390a0 0x7f781403b560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f78200098c0 tx=0x7f7820006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:17.233 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.516+0000 7f7813fff640 1 -- 172.21.15.148:0/1558178578 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f781c03cd90 con 0x7f782c1077d0 2024-09-19T07:02:17.233 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.613+0000 7f7813fff640 1 -- 172.21.15.148:0/1558178578 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f781c03c870 con 0x7f782c1077d0 2024-09-19T07:02:17.233 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.698+0000 7f783103f640 1 -- 172.21.15.148:0/1558178578 --> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f782c104230 con 0x7f78140390a0 2024-09-19T07:02:17.233 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.702+0000 7f7813fff640 1 -- 172.21.15.148:0/1558178578 <== mgr.14116 v2:172.21.15.148:6800/1949849385 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f782c104230 con 0x7f78140390a0 2024-09-19T07:02:17.234 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.704+0000 7f783103f640 1 -- 172.21.15.148:0/1558178578 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f78140390a0 msgr2=0x7f781403b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:17.234 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.704+0000 7f783103f640 1 --2- 172.21.15.148:0/1558178578 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f78140390a0 0x7f781403b560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f78200098c0 tx=0x7f7820006db0 comp rx=0 tx=0).stop 2024-09-19T07:02:17.234 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.704+0000 7f783103f640 1 -- 172.21.15.148:0/1558178578 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f782c1077d0 msgr2=0x7f782c19b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:17.234 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.704+0000 7f783103f640 1 --2- 172.21.15.148:0/1558178578 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f782c1077d0 0x7f782c19b790 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f781c009940 tx=0x7f781c032ce0 comp rx=0 tx=0).stop 2024-09-19T07:02:17.234 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.705+0000 7f783103f640 1 -- 172.21.15.148:0/1558178578 shutdown_connections 2024-09-19T07:02:17.234 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.705+0000 7f783103f640 1 --2- 172.21.15.148:0/1558178578 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f78140390a0 0x7f781403b560 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:17.234 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.705+0000 7f783103f640 1 --2- 172.21.15.148:0/1558178578 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f782c1077d0 0x7f782c19b790 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:17.234 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.705+0000 7f783103f640 1 -- 172.21.15.148:0/1558178578 >> 172.21.15.148:0/1558178578 conn(0x7f782c102f60 msgr2=0x7f782c103b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:17.234 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.705+0000 7f783103f640 1 -- 172.21.15.148:0/1558178578 shutdown_connections 2024-09-19T07:02:17.234 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:16.705+0000 7f783103f640 1 -- 172.21.15.148:0/1558178578 wait complete. 2024-09-19T07:02:18.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:17 smithi148 ceph-mon[31180]: [19/Sep/2024:07:02:15] ENGINE Serving on http://172.21.15.148:8765 2024-09-19T07:02:18.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:17 smithi148 ceph-mon[31180]: [19/Sep/2024:07:02:15] ENGINE Serving on https://172.21.15.148:7150 2024-09-19T07:02:18.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:17 smithi148 ceph-mon[31180]: [19/Sep/2024:07:02:15] ENGINE Bus STARTED 2024-09-19T07:02:18.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:17 smithi148 ceph-mon[31180]: [19/Sep/2024:07:02:15] ENGINE Error in HTTPServer.serve 2024-09-19T07:02:18.084 INFO:journalctl@ceph.mon.a.smithi148.stdout: Traceback (most recent call last): 2024-09-19T07:02:18.084 INFO:journalctl@ceph.mon.a.smithi148.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T07:02:18.084 INFO:journalctl@ceph.mon.a.smithi148.stdout: self._connections.run(self.expiration_interval) 2024-09-19T07:02:18.084 INFO:journalctl@ceph.mon.a.smithi148.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T07:02:18.084 INFO:journalctl@ceph.mon.a.smithi148.stdout: self._run(expiration_interval) 2024-09-19T07:02:18.084 INFO:journalctl@ceph.mon.a.smithi148.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T07:02:18.084 INFO:journalctl@ceph.mon.a.smithi148.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T07:02:18.084 INFO:journalctl@ceph.mon.a.smithi148.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T07:02:18.084 INFO:journalctl@ceph.mon.a.smithi148.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T07:02:18.085 INFO:journalctl@ceph.mon.a.smithi148.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T07:02:18.085 INFO:journalctl@ceph.mon.a.smithi148.stdout: s = self.context.wrap_socket( 2024-09-19T07:02:18.085 INFO:journalctl@ceph.mon.a.smithi148.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T07:02:18.085 INFO:journalctl@ceph.mon.a.smithi148.stdout: return self.sslsocket_class._create( 2024-09-19T07:02:18.085 INFO:journalctl@ceph.mon.a.smithi148.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T07:02:18.085 INFO:journalctl@ceph.mon.a.smithi148.stdout: self.do_handshake() 2024-09-19T07:02:18.085 INFO:journalctl@ceph.mon.a.smithi148.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T07:02:18.085 INFO:journalctl@ceph.mon.a.smithi148.stdout: self._sslobj.do_handshake() 2024-09-19T07:02:18.085 INFO:journalctl@ceph.mon.a.smithi148.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T07:02:18.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:17 smithi148 ceph-mon[31180]: mgrmap e8: x(active, since 2s) 2024-09-19T07:02:18.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:17 smithi148 ceph-mon[31180]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:02:18.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:17 smithi148 ceph-mon[31180]: from='mgr.14116 172.21.15.148:0/2118014832' entity='mgr.x' 2024-09-19T07:02:18.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:17 smithi148 ceph-mon[31180]: from='mgr.14116 172.21.15.148:0/2118014832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:02:18.403 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-19T07:02:18.403 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.609+0000 7f38c8693640 1 Processor -- start 2024-09-19T07:02:18.403 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.609+0000 7f38c8693640 1 -- start start 2024-09-19T07:02:18.403 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.609+0000 7f38c8693640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38c007de20 0x7f38c007c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:18.403 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.609+0000 7f38c8693640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f38c007c850 con 0x7f38c007de20 2024-09-19T07:02:18.403 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.609+0000 7f38c642f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38c007de20 0x7f38c007c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:18.403 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.609+0000 7f38c642f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38c007de20 0x7f38c007c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43498/0 (socket says 172.21.15.148:43498) 2024-09-19T07:02:18.403 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.609+0000 7f38c642f640 1 -- 172.21.15.148:0/2311458953 learned_addr learned my addr 172.21.15.148:0/2311458953 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:02:18.403 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.609+0000 7f38c642f640 1 -- 172.21.15.148:0/2311458953 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38c007c9d0 con 0x7f38c007de20 2024-09-19T07:02:18.403 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.610+0000 7f38c642f640 1 --2- 172.21.15.148:0/2311458953 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38c007de20 0x7f38c007c280 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f38bc009820 tx=0x7f38bc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa698a29e4394123 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:18.403 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.610+0000 7f38c542d640 1 -- 172.21.15.148:0/2311458953 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38bc037070 con 0x7f38c007de20 2024-09-19T07:02:18.403 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.610+0000 7f38c542d640 1 -- 172.21.15.148:0/2311458953 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f38bc032900 con 0x7f38c007de20 2024-09-19T07:02:18.404 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.610+0000 7f38c542d640 1 -- 172.21.15.148:0/2311458953 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38bc030850 con 0x7f38c007de20 2024-09-19T07:02:18.404 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.611+0000 7f38c8693640 1 -- 172.21.15.148:0/2311458953 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38c007de20 msgr2=0x7f38c007c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:18.404 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.611+0000 7f38c8693640 1 --2- 172.21.15.148:0/2311458953 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38c007de20 0x7f38c007c280 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f38bc009820 tx=0x7f38bc02a270 comp rx=0 tx=0).stop 2024-09-19T07:02:18.404 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.611+0000 7f38c8693640 1 -- 172.21.15.148:0/2311458953 shutdown_connections 2024-09-19T07:02:18.404 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.611+0000 7f38c8693640 1 --2- 172.21.15.148:0/2311458953 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38c007de20 0x7f38c007c280 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:18.404 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.611+0000 7f38c8693640 1 -- 172.21.15.148:0/2311458953 >> 172.21.15.148:0/2311458953 conn(0x7f38c0103060 msgr2=0x7f38c0105480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:18.404 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.611+0000 7f38c8693640 1 -- 172.21.15.148:0/2311458953 shutdown_connections 2024-09-19T07:02:18.404 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.611+0000 7f38c8693640 1 -- 172.21.15.148:0/2311458953 wait complete. 2024-09-19T07:02:18.404 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.612+0000 7f38c8693640 1 Processor -- start 2024-09-19T07:02:18.404 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.612+0000 7f38c8693640 1 -- start start 2024-09-19T07:02:18.404 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.612+0000 7f38c8693640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38c007de20 0x7f38c019d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:18.404 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.612+0000 7f38c8693640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f38c010de00 con 0x7f38c007de20 2024-09-19T07:02:18.404 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.612+0000 7f38c642f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38c007de20 0x7f38c019d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:18.404 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.612+0000 7f38c642f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38c007de20 0x7f38c019d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43512/0 (socket says 172.21.15.148:43512) 2024-09-19T07:02:18.405 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.612+0000 7f38c642f640 1 -- 172.21.15.148:0/3554822451 learned_addr learned my addr 172.21.15.148:0/3554822451 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:02:18.405 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.612+0000 7f38c642f640 1 -- 172.21.15.148:0/3554822451 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38c019de90 con 0x7f38c007de20 2024-09-19T07:02:18.405 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.612+0000 7f38c642f640 1 --2- 172.21.15.148:0/3554822451 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38c007de20 0x7f38c019d950 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f38bc032ce0 tx=0x7f38bc032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:18.405 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.613+0000 7f38b77fe640 1 -- 172.21.15.148:0/3554822451 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38bc042070 con 0x7f38c007de20 2024-09-19T07:02:18.405 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.613+0000 7f38b77fe640 1 -- 172.21.15.148:0/3554822451 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f38bc0308c0 con 0x7f38c007de20 2024-09-19T07:02:18.405 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.613+0000 7f38c8693640 1 -- 172.21.15.148:0/3554822451 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38c019e120 con 0x7f38c007de20 2024-09-19T07:02:18.405 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.613+0000 7f38b77fe640 1 -- 172.21.15.148:0/3554822451 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38bc037040 con 0x7f38c007de20 2024-09-19T07:02:18.405 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.613+0000 7f38c8693640 1 -- 172.21.15.148:0/3554822451 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38c01a0e10 con 0x7f38c007de20 2024-09-19T07:02:18.405 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.614+0000 7f38c8693640 1 -- 172.21.15.148:0/3554822451 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38c007c300 con 0x7f38c007de20 2024-09-19T07:02:18.405 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.616+0000 7f38b77fe640 1 -- 172.21.15.148:0/3554822451 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f38bc045070 con 0x7f38c007de20 2024-09-19T07:02:18.405 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.616+0000 7f38b77fe640 1 --2- 172.21.15.148:0/3554822451 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f38ac039200 0x7f38ac03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:18.405 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.616+0000 7f38b77fe640 1 -- 172.21.15.148:0/3554822451 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f38bc06cbb0 con 0x7f38c007de20 2024-09-19T07:02:18.405 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.616+0000 7f38c5c2e640 1 --2- 172.21.15.148:0/3554822451 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f38ac039200 0x7f38ac03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:18.406 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.616+0000 7f38c5c2e640 1 --2- 172.21.15.148:0/3554822451 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f38ac039200 0x7f38ac03b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f38b00098c0 tx=0x7f38b0006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:18.406 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.620+0000 7f38b77fe640 1 -- 172.21.15.148:0/3554822451 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f38bc0392e0 con 0x7f38c007de20 2024-09-19T07:02:18.406 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.789+0000 7f38c8693640 1 -- 172.21.15.148:0/3554822451 --> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f38c01042e0 con 0x7f38ac039200 2024-09-19T07:02:18.406 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.790+0000 7f38b77fe640 1 -- 172.21.15.148:0/3554822451 <== mgr.14116 v2:172.21.15.148:6800/1949849385 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f38c01042e0 con 0x7f38ac039200 2024-09-19T07:02:18.406 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.792+0000 7f38c8693640 1 -- 172.21.15.148:0/3554822451 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f38ac039200 msgr2=0x7f38ac03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:18.406 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.792+0000 7f38c8693640 1 --2- 172.21.15.148:0/3554822451 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f38ac039200 0x7f38ac03b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f38b00098c0 tx=0x7f38b0006db0 comp rx=0 tx=0).stop 2024-09-19T07:02:18.406 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.792+0000 7f38c8693640 1 -- 172.21.15.148:0/3554822451 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38c007de20 msgr2=0x7f38c019d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:18.406 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.792+0000 7f38c8693640 1 --2- 172.21.15.148:0/3554822451 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38c007de20 0x7f38c019d950 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f38bc032ce0 tx=0x7f38bc032d10 comp rx=0 tx=0).stop 2024-09-19T07:02:18.406 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.792+0000 7f38c8693640 1 -- 172.21.15.148:0/3554822451 shutdown_connections 2024-09-19T07:02:18.406 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.792+0000 7f38c8693640 1 --2- 172.21.15.148:0/3554822451 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f38ac039200 0x7f38ac03b6c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:18.406 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.792+0000 7f38c8693640 1 --2- 172.21.15.148:0/3554822451 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38c007de20 0x7f38c019d950 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:18.406 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.792+0000 7f38c8693640 1 -- 172.21.15.148:0/3554822451 >> 172.21.15.148:0/3554822451 conn(0x7f38c0103060 msgr2=0x7f38c0103bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:18.406 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.792+0000 7f38c8693640 1 -- 172.21.15.148:0/3554822451 shutdown_connections 2024-09-19T07:02:18.406 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:17.792+0000 7f38c8693640 1 -- 172.21.15.148:0/3554822451 wait complete. 2024-09-19T07:02:18.406 INFO:teuthology.orchestra.run.smithi148.stdout:Generating ssh key... 2024-09-19T07:02:18.970 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:18 smithi148 ceph-mon[31180]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:02:19.333 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:19 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: Generating public/private rsa key pair. 2024-09-19T07:02:19.334 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:19 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: Your identification has been saved in /tmp/tmpjvdsh7nu/key 2024-09-19T07:02:19.334 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:19 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: Your public key has been saved in /tmp/tmpjvdsh7nu/key.pub 2024-09-19T07:02:19.334 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:19 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: The key fingerprint is: 2024-09-19T07:02:19.334 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:19 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: SHA256:xZtCIXKsgbSzCjK8XG4NF2g241FBRMxe/r7U3U7HbUs ceph-eae8a4a8-7654-11ef-bceb-c7b262605968 2024-09-19T07:02:19.334 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:19 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: The key's randomart image is: 2024-09-19T07:02:19.334 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:19 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: +---[RSA 3072]----+ 2024-09-19T07:02:19.334 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:19 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: | ...BB+ . | 2024-09-19T07:02:19.334 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:19 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: | ..+=.o o | 2024-09-19T07:02:19.334 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:19 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: | oB.+o . o | 2024-09-19T07:02:19.334 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:19 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: |. +o=..o . o | 2024-09-19T07:02:19.334 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:19 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: |+..+ . S o | 2024-09-19T07:02:19.334 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:19 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: |+o+ + o. . ...| 2024-09-19T07:02:19.335 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:19 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: |.o o . .. . . E=| 2024-09-19T07:02:19.335 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:19 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: | . .. +.o| 2024-09-19T07:02:19.335 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:19 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: | .. o | 2024-09-19T07:02:19.335 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:19 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: +----[SHA256]-----+ 2024-09-19T07:02:19.808 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:18.792+0000 7f5cd2b58640 1 Processor -- start 2024-09-19T07:02:19.808 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:18.792+0000 7f5cd2b58640 1 -- start start 2024-09-19T07:02:19.808 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:18.792+0000 7f5cd2b58640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ccc07de20 0x7f5ccc07c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:19.808 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:18.792+0000 7f5cd2b58640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5ccc07c850 con 0x7f5ccc07de20 2024-09-19T07:02:19.809 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:18.792+0000 7f5cd08f4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ccc07de20 0x7f5ccc07c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:19.809 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:18.792+0000 7f5cd08f4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ccc07de20 0x7f5ccc07c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43518/0 (socket says 172.21.15.148:43518) 2024-09-19T07:02:19.809 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:18.792+0000 7f5cd08f4640 1 -- 172.21.15.148:0/3858940941 learned_addr learned my addr 172.21.15.148:0/3858940941 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:02:19.809 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:18.792+0000 7f5cd08f4640 1 -- 172.21.15.148:0/3858940941 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ccc07c9d0 con 0x7f5ccc07de20 2024-09-19T07:02:19.809 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:18.793+0000 7f5cd08f4640 1 --2- 172.21.15.148:0/3858940941 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ccc07de20 0x7f5ccc07c280 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5cc0009820 tx=0x7f5cc002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24c42e79047e02fd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:19.809 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:18.793+0000 7f5ccb7fe640 1 -- 172.21.15.148:0/3858940941 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cc0037070 con 0x7f5ccc07de20 2024-09-19T07:02:19.809 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:18.793+0000 7f5ccb7fe640 1 -- 172.21.15.148:0/3858940941 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5cc0032900 con 0x7f5ccc07de20 2024-09-19T07:02:19.809 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:18.793+0000 7f5ccb7fe640 1 -- 172.21.15.148:0/3858940941 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cc0030850 con 0x7f5ccc07de20 2024-09-19T07:02:19.809 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:18.794+0000 7f5cd2b58640 1 -- 172.21.15.148:0/3858940941 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ccc07de20 msgr2=0x7f5ccc07c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:19.809 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:18.794+0000 7f5cd2b58640 1 --2- 172.21.15.148:0/3858940941 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ccc07de20 0x7f5ccc07c280 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5cc0009820 tx=0x7f5cc002a270 comp rx=0 tx=0).stop 2024-09-19T07:02:19.809 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:18.794+0000 7f5cd2b58640 1 -- 172.21.15.148:0/3858940941 shutdown_connections 2024-09-19T07:02:19.809 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:18.794+0000 7f5cd2b58640 1 --2- 172.21.15.148:0/3858940941 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ccc07de20 0x7f5ccc07c280 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:19.810 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:18.794+0000 7f5cd2b58640 1 -- 172.21.15.148:0/3858940941 >> 172.21.15.148:0/3858940941 conn(0x7f5ccc102f60 msgr2=0x7f5ccc1053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:19.810 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:18.794+0000 7f5cd2b58640 1 -- 172.21.15.148:0/3858940941 shutdown_connections 2024-09-19T07:02:19.810 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:18.794+0000 7f5cd2b58640 1 -- 172.21.15.148:0/3858940941 wait complete. 2024-09-19T07:02:19.810 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:18.794+0000 7f5cd2b58640 1 Processor -- start 2024-09-19T07:02:19.810 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:18.794+0000 7f5cd2b58640 1 -- start start 2024-09-19T07:02:19.810 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:18.794+0000 7f5cd2b58640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ccc07de20 0x7f5ccc19d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:19.810 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:18.795+0000 7f5cd2b58640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5ccc10dde0 con 0x7f5ccc07de20 2024-09-19T07:02:19.810 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:18.795+0000 7f5cd08f4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ccc07de20 0x7f5ccc19d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:19.810 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:18.795+0000 7f5cd08f4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ccc07de20 0x7f5ccc19d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43532/0 (socket says 172.21.15.148:43532) 2024-09-19T07:02:19.810 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:18.795+0000 7f5cd08f4640 1 -- 172.21.15.148:0/3269066634 learned_addr learned my addr 172.21.15.148:0/3269066634 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:02:19.810 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:18.795+0000 7f5cd08f4640 1 -- 172.21.15.148:0/3269066634 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ccc19df10 con 0x7f5ccc07de20 2024-09-19T07:02:19.810 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:18.795+0000 7f5cd08f4640 1 --2- 172.21.15.148:0/3269066634 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ccc07de20 0x7f5ccc19d9d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5cc0032ce0 tx=0x7f5cc0032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:19.810 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:18.795+0000 7f5cc9ffb640 1 -- 172.21.15.148:0/3269066634 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cc0042070 con 0x7f5ccc07de20 2024-09-19T07:02:19.811 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:18.795+0000 7f5cd2b58640 1 -- 172.21.15.148:0/3269066634 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ccc19e1a0 con 0x7f5ccc07de20 2024-09-19T07:02:19.811 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:18.795+0000 7f5cc9ffb640 1 -- 172.21.15.148:0/3269066634 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5cc00308c0 con 0x7f5ccc07de20 2024-09-19T07:02:19.811 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:18.795+0000 7f5cc9ffb640 1 -- 172.21.15.148:0/3269066634 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cc0037040 con 0x7f5ccc07de20 2024-09-19T07:02:19.811 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:18.795+0000 7f5cd2b58640 1 -- 172.21.15.148:0/3269066634 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ccc1a0e90 con 0x7f5ccc07de20 2024-09-19T07:02:19.811 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:18.796+0000 7f5cc9ffb640 1 -- 172.21.15.148:0/3269066634 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f5cc0045070 con 0x7f5ccc07de20 2024-09-19T07:02:19.811 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:18.796+0000 7f5cc9ffb640 1 --2- 172.21.15.148:0/3269066634 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f5cbc0391b0 0x7f5cbc03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:19.811 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:18.796+0000 7f5cc9ffb640 1 -- 172.21.15.148:0/3269066634 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f5cc006c330 con 0x7f5ccc07de20 2024-09-19T07:02:19.811 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:18.796+0000 7f5cd2b58640 1 -- 172.21.15.148:0/3269066634 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ccc07c300 con 0x7f5ccc07de20 2024-09-19T07:02:19.811 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:18.797+0000 7f5ccbfff640 1 --2- 172.21.15.148:0/3269066634 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f5cbc0391b0 0x7f5cbc03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:19.811 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:18.797+0000 7f5ccbfff640 1 --2- 172.21.15.148:0/3269066634 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f5cbc0391b0 0x7f5cbc03b670 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5cb80098c0 tx=0x7f5cb8006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:19.811 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:18.801+0000 7f5cc9ffb640 1 -- 172.21.15.148:0/3269066634 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5cc004b170 con 0x7f5ccc07de20 2024-09-19T07:02:19.811 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:18.969+0000 7f5cd2b58640 1 -- 172.21.15.148:0/3269066634 --> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f5ccc104250 con 0x7f5cbc0391b0 2024-09-19T07:02:19.811 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:19.195+0000 7f5cc9ffb640 1 -- 172.21.15.148:0/3269066634 <== mgr.14116 v2:172.21.15.148:6800/1949849385 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5ccc104250 con 0x7f5cbc0391b0 2024-09-19T07:02:19.812 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:19.198+0000 7f5cd2b58640 1 -- 172.21.15.148:0/3269066634 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f5cbc0391b0 msgr2=0x7f5cbc03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:19.812 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:19.198+0000 7f5cd2b58640 1 --2- 172.21.15.148:0/3269066634 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f5cbc0391b0 0x7f5cbc03b670 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5cb80098c0 tx=0x7f5cb8006db0 comp rx=0 tx=0).stop 2024-09-19T07:02:19.812 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:19.198+0000 7f5cd2b58640 1 -- 172.21.15.148:0/3269066634 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ccc07de20 msgr2=0x7f5ccc19d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:19.812 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:19.198+0000 7f5cd2b58640 1 --2- 172.21.15.148:0/3269066634 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ccc07de20 0x7f5ccc19d9d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5cc0032ce0 tx=0x7f5cc0032d10 comp rx=0 tx=0).stop 2024-09-19T07:02:19.812 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:19.198+0000 7f5cd2b58640 1 -- 172.21.15.148:0/3269066634 shutdown_connections 2024-09-19T07:02:19.812 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:19.198+0000 7f5cd2b58640 1 --2- 172.21.15.148:0/3269066634 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f5cbc0391b0 0x7f5cbc03b670 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:19.812 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:19.198+0000 7f5cd2b58640 1 --2- 172.21.15.148:0/3269066634 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ccc07de20 0x7f5ccc19d9d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:19.812 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:19.198+0000 7f5cd2b58640 1 -- 172.21.15.148:0/3269066634 >> 172.21.15.148:0/3269066634 conn(0x7f5ccc102f60 msgr2=0x7f5ccc103b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:19.812 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:19.198+0000 7f5cd2b58640 1 -- 172.21.15.148:0/3269066634 shutdown_connections 2024-09-19T07:02:19.812 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:19.198+0000 7f5cd2b58640 1 -- 172.21.15.148:0/3269066634 wait complete. 2024-09-19T07:02:20.368 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:20 smithi148 ceph-mon[31180]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:02:20.368 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:20 smithi148 ceph-mon[31180]: Generating ssh key... 2024-09-19T07:02:20.368 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:20 smithi148 ceph-mon[31180]: from='mgr.14116 172.21.15.148:0/2118014832' entity='mgr.x' 2024-09-19T07:02:20.368 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:20 smithi148 ceph-mon[31180]: from='mgr.14116 172.21.15.148:0/2118014832' entity='mgr.x' 2024-09-19T07:02:20.990 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCj3EiwnnJCWnLxqqlKiSRzADo0UWAxlBMSEMl1L0pYdOdHFjWK9HYa1LTK6Ra9SdRuzCwqvyqqL448fL+/PLgxzbPhgpFPowNe2vRXe5rnARNNHFUno3BRiZniifzmJq2zJvi0CwzY2kkVuVGyz9BrZtyo0KUgfgT9ufzEBA385Zs8TGFjnr/DPJ57Hxi6/LL+XHm6t4KgLQ8kUP8uM0bolDpp1ZMPO5e3yrmws2daty/kzm/vJAEIAbsJFykuUuHbyEBmqsbPe+vSDX5rFyNtRBY7gtYhbMkpq29ZNm2iXe+1kYwmNuRLLEPK/kKXATTQMMYzlwZXxtGJDTmRQEFS6Ydt78QY2mRYWrDQRmrTeGG94feL5fWgjYVxGcJWuw3LLEjLfPhnhYCs9ZDorQNsMU+YF44k2E0eE6ZxCTuPzhqAk7+OM/zHFVUPiNN23KDk/wJKExPMQfluRkpsARPOoDQ2VWgDrEjRue6cYPeCvRQDGtY+dfGh7Zc36zl3v5k= ceph-eae8a4a8-7654-11ef-bceb-c7b262605968 2024-09-19T07:02:20.990 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.187+0000 7f127585d640 1 Processor -- start 2024-09-19T07:02:20.990 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.187+0000 7f127585d640 1 -- start start 2024-09-19T07:02:20.990 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.187+0000 7f127585d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12701077f0 0x7f1270107bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:20.991 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.187+0000 7f127585d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f12701081c0 con 0x7f12701077f0 2024-09-19T07:02:20.991 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.187+0000 7f126effd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12701077f0 0x7f1270107bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:20.991 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.187+0000 7f126effd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12701077f0 0x7f1270107bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43534/0 (socket says 172.21.15.148:43534) 2024-09-19T07:02:20.991 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.187+0000 7f126effd640 1 -- 172.21.15.148:0/2359709558 learned_addr learned my addr 172.21.15.148:0/2359709558 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:02:20.991 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.188+0000 7f126effd640 1 -- 172.21.15.148:0/2359709558 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12701089f0 con 0x7f12701077f0 2024-09-19T07:02:20.991 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.188+0000 7f126effd640 1 --2- 172.21.15.148:0/2359709558 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12701077f0 0x7f1270107bf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1260009e80 tx=0x7f126002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a2d8a1d7ed7b397 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:20.991 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.189+0000 7f126dffb640 1 -- 172.21.15.148:0/2359709558 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1260036070 con 0x7f12701077f0 2024-09-19T07:02:20.991 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.189+0000 7f126dffb640 1 -- 172.21.15.148:0/2359709558 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f12600318c0 con 0x7f12701077f0 2024-09-19T07:02:20.991 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.189+0000 7f126dffb640 1 -- 172.21.15.148:0/2359709558 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1260007ab0 con 0x7f12701077f0 2024-09-19T07:02:20.991 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.189+0000 7f127585d640 1 -- 172.21.15.148:0/2359709558 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12701077f0 msgr2=0x7f1270107bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:20.991 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.189+0000 7f127585d640 1 --2- 172.21.15.148:0/2359709558 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12701077f0 0x7f1270107bf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1260009e80 tx=0x7f126002a7a0 comp rx=0 tx=0).stop 2024-09-19T07:02:20.991 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.189+0000 7f127585d640 1 -- 172.21.15.148:0/2359709558 shutdown_connections 2024-09-19T07:02:20.991 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.189+0000 7f127585d640 1 --2- 172.21.15.148:0/2359709558 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12701077f0 0x7f1270107bf0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:20.992 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.189+0000 7f127585d640 1 -- 172.21.15.148:0/2359709558 >> 172.21.15.148:0/2359709558 conn(0x7f1270103060 msgr2=0x7f1270105480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:20.992 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.189+0000 7f127585d640 1 -- 172.21.15.148:0/2359709558 shutdown_connections 2024-09-19T07:02:20.992 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.189+0000 7f127585d640 1 -- 172.21.15.148:0/2359709558 wait complete. 2024-09-19T07:02:20.992 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.190+0000 7f127585d640 1 Processor -- start 2024-09-19T07:02:20.992 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.190+0000 7f127585d640 1 -- start start 2024-09-19T07:02:20.992 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.190+0000 7f127585d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12701077f0 0x7f127019b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:20.992 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.190+0000 7f127585d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f127010bda0 con 0x7f12701077f0 2024-09-19T07:02:20.992 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.190+0000 7f126effd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12701077f0 0x7f127019b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:20.992 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.190+0000 7f126effd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12701077f0 0x7f127019b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43550/0 (socket says 172.21.15.148:43550) 2024-09-19T07:02:20.992 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.190+0000 7f126effd640 1 -- 172.21.15.148:0/1224177760 learned_addr learned my addr 172.21.15.148:0/1224177760 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:02:20.992 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.191+0000 7f126effd640 1 -- 172.21.15.148:0/1224177760 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f127019bce0 con 0x7f12701077f0 2024-09-19T07:02:20.992 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.191+0000 7f126effd640 1 --2- 172.21.15.148:0/1224177760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12701077f0 0x7f127019b7a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f126002ad90 tx=0x7f1260031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:20.993 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.191+0000 7f127485b640 1 -- 172.21.15.148:0/1224177760 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1260036050 con 0x7f12701077f0 2024-09-19T07:02:20.993 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.191+0000 7f127485b640 1 -- 172.21.15.148:0/1224177760 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1260042070 con 0x7f12701077f0 2024-09-19T07:02:20.993 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.191+0000 7f127585d640 1 -- 172.21.15.148:0/1224177760 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f127019bf70 con 0x7f12701077f0 2024-09-19T07:02:20.993 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.191+0000 7f127485b640 1 -- 172.21.15.148:0/1224177760 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f126003d7e0 con 0x7f12701077f0 2024-09-19T07:02:20.993 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.191+0000 7f127585d640 1 -- 172.21.15.148:0/1224177760 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f127019ec60 con 0x7f12701077f0 2024-09-19T07:02:20.993 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.192+0000 7f127485b640 1 -- 172.21.15.148:0/1224177760 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f126003dae0 con 0x7f12701077f0 2024-09-19T07:02:20.993 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.192+0000 7f127585d640 1 -- 172.21.15.148:0/1224177760 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1270107c70 con 0x7f12701077f0 2024-09-19T07:02:20.993 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.192+0000 7f127485b640 1 --2- 172.21.15.148:0/1224177760 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f12580391b0 0x7f125803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:20.993 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.192+0000 7f127485b640 1 -- 172.21.15.148:0/1224177760 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f1260007e00 con 0x7f12701077f0 2024-09-19T07:02:20.993 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.192+0000 7f126e7fc640 1 --2- 172.21.15.148:0/1224177760 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f12580391b0 0x7f125803b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:20.993 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.193+0000 7f126e7fc640 1 --2- 172.21.15.148:0/1224177760 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f12580391b0 0x7f125803b670 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f12640098c0 tx=0x7f1264006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:20.993 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.201+0000 7f127485b640 1 -- 172.21.15.148:0/1224177760 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f12600371f0 con 0x7f12701077f0 2024-09-19T07:02:20.993 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.366+0000 7f127585d640 1 -- 172.21.15.148:0/1224177760 --> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f12701042f0 con 0x7f12580391b0 2024-09-19T07:02:20.994 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.367+0000 7f127485b640 1 -- 172.21.15.148:0/1224177760 <== mgr.14116 v2:172.21.15.148:6800/1949849385 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f12701042f0 con 0x7f12580391b0 2024-09-19T07:02:20.994 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.369+0000 7f127585d640 1 -- 172.21.15.148:0/1224177760 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f12580391b0 msgr2=0x7f125803b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:20.994 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.369+0000 7f127585d640 1 --2- 172.21.15.148:0/1224177760 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f12580391b0 0x7f125803b670 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f12640098c0 tx=0x7f1264006db0 comp rx=0 tx=0).stop 2024-09-19T07:02:20.994 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.369+0000 7f127585d640 1 -- 172.21.15.148:0/1224177760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12701077f0 msgr2=0x7f127019b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:20.994 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.369+0000 7f127585d640 1 --2- 172.21.15.148:0/1224177760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12701077f0 0x7f127019b7a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f126002ad90 tx=0x7f1260031ca0 comp rx=0 tx=0).stop 2024-09-19T07:02:20.994 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.369+0000 7f127585d640 1 -- 172.21.15.148:0/1224177760 shutdown_connections 2024-09-19T07:02:20.994 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.369+0000 7f127585d640 1 --2- 172.21.15.148:0/1224177760 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f12580391b0 0x7f125803b670 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:20.994 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.369+0000 7f127585d640 1 --2- 172.21.15.148:0/1224177760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12701077f0 0x7f127019b7a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:20.994 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.369+0000 7f127585d640 1 -- 172.21.15.148:0/1224177760 >> 172.21.15.148:0/1224177760 conn(0x7f1270103060 msgr2=0x7f1270103be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:20.994 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.369+0000 7f127585d640 1 -- 172.21.15.148:0/1224177760 shutdown_connections 2024-09-19T07:02:20.994 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:20.369+0000 7f127585d640 1 -- 172.21.15.148:0/1224177760 wait complete. 2024-09-19T07:02:20.994 INFO:teuthology.orchestra.run.smithi148.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-19T07:02:20.994 INFO:teuthology.orchestra.run.smithi148.stdout:Adding key to root@localhost authorized_keys... 2024-09-19T07:02:20.996 INFO:teuthology.orchestra.run.smithi148.stdout:Adding host smithi148... 2024-09-19T07:02:21.284 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:21 smithi148 ceph-mon[31180]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:02:22.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:22 smithi148 ceph-mon[31180]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi148", "addr": "172.21.15.148", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:02:23.303 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:23 smithi148 ceph-mon[31180]: Deploying cephadm binary to smithi148 2024-09-19T07:02:25.264 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout Added host 'smithi148' with addr '172.21.15.148' 2024-09-19T07:02:25.264 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:21.363+0000 7ff1cbd11640 1 Processor -- start 2024-09-19T07:02:25.264 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:21.363+0000 7ff1cbd11640 1 -- start start 2024-09-19T07:02:25.264 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:21.364+0000 7ff1cbd11640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1c41066d0 0x7ff1c4106ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:25.264 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:21.364+0000 7ff1cbd11640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c41070a0 con 0x7ff1c41066d0 2024-09-19T07:02:25.264 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:21.364+0000 7ff1c9aad640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1c41066d0 0x7ff1c4106ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:25.264 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:21.364+0000 7ff1c9aad640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1c41066d0 0x7ff1c4106ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43562/0 (socket says 172.21.15.148:43562) 2024-09-19T07:02:25.264 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:21.364+0000 7ff1c9aad640 1 -- 172.21.15.148:0/3546623394 learned_addr learned my addr 172.21.15.148:0/3546623394 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:02:25.265 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:21.364+0000 7ff1c9aad640 1 -- 172.21.15.148:0/3546623394 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c41078d0 con 0x7ff1c41066d0 2024-09-19T07:02:25.265 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:21.365+0000 7ff1c9aad640 1 --2- 172.21.15.148:0/3546623394 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1c41066d0 0x7ff1c4106ad0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4009820 tx=0x7ff1b402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76679bc8beaca4cd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:25.265 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:21.365+0000 7ff1c8aab640 1 -- 172.21.15.148:0/3546623394 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1b4037070 con 0x7ff1c41066d0 2024-09-19T07:02:25.265 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:21.365+0000 7ff1c8aab640 1 -- 172.21.15.148:0/3546623394 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff1b4032900 con 0x7ff1c41066d0 2024-09-19T07:02:25.265 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:21.365+0000 7ff1c8aab640 1 -- 172.21.15.148:0/3546623394 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1b4030850 con 0x7ff1c41066d0 2024-09-19T07:02:25.265 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:21.365+0000 7ff1cbd11640 1 -- 172.21.15.148:0/3546623394 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1c41066d0 msgr2=0x7ff1c4106ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:25.265 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:21.365+0000 7ff1cbd11640 1 --2- 172.21.15.148:0/3546623394 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1c41066d0 0x7ff1c4106ad0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4009820 tx=0x7ff1b402a270 comp rx=0 tx=0).stop 2024-09-19T07:02:25.265 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:21.365+0000 7ff1cbd11640 1 -- 172.21.15.148:0/3546623394 shutdown_connections 2024-09-19T07:02:25.265 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:21.365+0000 7ff1cbd11640 1 --2- 172.21.15.148:0/3546623394 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1c41066d0 0x7ff1c4106ad0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:25.265 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:21.365+0000 7ff1cbd11640 1 -- 172.21.15.148:0/3546623394 >> 172.21.15.148:0/3546623394 conn(0x7ff1c4101e60 msgr2=0x7ff1c41042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:25.265 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:21.365+0000 7ff1cbd11640 1 -- 172.21.15.148:0/3546623394 shutdown_connections 2024-09-19T07:02:25.265 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:21.365+0000 7ff1cbd11640 1 -- 172.21.15.148:0/3546623394 wait complete. 2024-09-19T07:02:25.266 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:21.366+0000 7ff1cbd11640 1 Processor -- start 2024-09-19T07:02:25.266 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:21.366+0000 7ff1cbd11640 1 -- start start 2024-09-19T07:02:25.266 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:21.366+0000 7ff1cbd11640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1c41066d0 0x7ff1c4191890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:25.266 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:21.366+0000 7ff1cbd11640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c410ac80 con 0x7ff1c41066d0 2024-09-19T07:02:25.266 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:21.366+0000 7ff1c9aad640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1c41066d0 0x7ff1c4191890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:25.266 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:21.366+0000 7ff1c9aad640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1c41066d0 0x7ff1c4191890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43566/0 (socket says 172.21.15.148:43566) 2024-09-19T07:02:25.266 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:21.366+0000 7ff1c9aad640 1 -- 172.21.15.148:0/3852972954 learned_addr learned my addr 172.21.15.148:0/3852972954 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:02:25.266 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:21.366+0000 7ff1c9aad640 1 -- 172.21.15.148:0/3852972954 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c4191dd0 con 0x7ff1c41066d0 2024-09-19T07:02:25.266 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:21.367+0000 7ff1c9aad640 1 --2- 172.21.15.148:0/3852972954 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1c41066d0 0x7ff1c4191890 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4009940 tx=0x7ff1b4032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:25.266 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:21.367+0000 7ff1baffd640 1 -- 172.21.15.148:0/3852972954 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1b4042070 con 0x7ff1c41066d0 2024-09-19T07:02:25.266 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:21.367+0000 7ff1baffd640 1 -- 172.21.15.148:0/3852972954 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff1b40308c0 con 0x7ff1c41066d0 2024-09-19T07:02:25.266 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:21.367+0000 7ff1baffd640 1 -- 172.21.15.148:0/3852972954 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1b4037040 con 0x7ff1c41066d0 2024-09-19T07:02:25.266 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:21.367+0000 7ff1cbd11640 1 -- 172.21.15.148:0/3852972954 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1c418ffc0 con 0x7ff1c41066d0 2024-09-19T07:02:25.266 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:21.367+0000 7ff1cbd11640 1 -- 172.21.15.148:0/3852972954 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1c4190500 con 0x7ff1c41066d0 2024-09-19T07:02:25.267 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:21.368+0000 7ff1baffd640 1 -- 172.21.15.148:0/3852972954 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7ff1b4045070 con 0x7ff1c41066d0 2024-09-19T07:02:25.267 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:21.368+0000 7ff1cbd11640 1 -- 172.21.15.148:0/3852972954 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1c4106b50 con 0x7ff1c41066d0 2024-09-19T07:02:25.267 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:21.368+0000 7ff1baffd640 1 --2- 172.21.15.148:0/3852972954 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7ff1b0039200 0x7ff1b003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:25.267 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:21.368+0000 7ff1baffd640 1 -- 172.21.15.148:0/3852972954 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff1b406c2e0 con 0x7ff1c41066d0 2024-09-19T07:02:25.267 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:21.368+0000 7ff1c92ac640 1 --2- 172.21.15.148:0/3852972954 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7ff1b0039200 0x7ff1b003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:25.267 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:21.369+0000 7ff1c92ac640 1 --2- 172.21.15.148:0/3852972954 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7ff1b0039200 0x7ff1b003b6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff1c00098c0 tx=0x7ff1c0006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:25.267 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:21.373+0000 7ff1baffd640 1 -- 172.21.15.148:0/3852972954 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff1b404b170 con 0x7ff1c41066d0 2024-09-19T07:02:25.267 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:21.542+0000 7ff1cbd11640 1 -- 172.21.15.148:0/3852972954 --> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi148", "addr": "172.21.15.148", "target": ["mon-mgr", ""]}) -- 0x7ff1c41956f0 con 0x7ff1b0039200 2024-09-19T07:02:25.267 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:24.738+0000 7ff1baffd640 1 -- 172.21.15.148:0/3852972954 <== mgr.14116 v2:172.21.15.148:6800/1949849385 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7ff1c41956f0 con 0x7ff1b0039200 2024-09-19T07:02:25.267 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:24.740+0000 7ff1cbd11640 1 -- 172.21.15.148:0/3852972954 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7ff1b0039200 msgr2=0x7ff1b003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:25.267 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:24.740+0000 7ff1cbd11640 1 --2- 172.21.15.148:0/3852972954 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7ff1b0039200 0x7ff1b003b6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff1c00098c0 tx=0x7ff1c0006db0 comp rx=0 tx=0).stop 2024-09-19T07:02:25.267 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:24.740+0000 7ff1cbd11640 1 -- 172.21.15.148:0/3852972954 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1c41066d0 msgr2=0x7ff1c4191890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:25.268 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:24.740+0000 7ff1cbd11640 1 --2- 172.21.15.148:0/3852972954 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1c41066d0 0x7ff1c4191890 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4009940 tx=0x7ff1b4032ce0 comp rx=0 tx=0).stop 2024-09-19T07:02:25.268 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:24.740+0000 7ff1cbd11640 1 -- 172.21.15.148:0/3852972954 shutdown_connections 2024-09-19T07:02:25.268 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:24.740+0000 7ff1cbd11640 1 --2- 172.21.15.148:0/3852972954 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7ff1b0039200 0x7ff1b003b6c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:25.268 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:24.740+0000 7ff1cbd11640 1 --2- 172.21.15.148:0/3852972954 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1c41066d0 0x7ff1c4191890 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:25.268 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:24.740+0000 7ff1cbd11640 1 -- 172.21.15.148:0/3852972954 >> 172.21.15.148:0/3852972954 conn(0x7ff1c4101e60 msgr2=0x7ff1c4102e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:25.268 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:24.741+0000 7ff1cbd11640 1 -- 172.21.15.148:0/3852972954 shutdown_connections 2024-09-19T07:02:25.268 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:24.741+0000 7ff1cbd11640 1 -- 172.21.15.148:0/3852972954 wait complete. 2024-09-19T07:02:25.268 INFO:teuthology.orchestra.run.smithi148.stdout:Deploying unmanaged mon service... 2024-09-19T07:02:25.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:25 smithi148 ceph-mon[31180]: from='mgr.14116 172.21.15.148:0/2118014832' entity='mgr.x' 2024-09-19T07:02:25.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:25 smithi148 ceph-mon[31180]: Added host smithi148 2024-09-19T07:02:25.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:25 smithi148 ceph-mon[31180]: from='mgr.14116 172.21.15.148:0/2118014832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:02:26.681 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-19T07:02:26.681 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.655+0000 7f5c7d365640 1 Processor -- start 2024-09-19T07:02:26.681 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.655+0000 7f5c7d365640 1 -- start start 2024-09-19T07:02:26.681 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.655+0000 7f5c7d365640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c781066e0 0x7f5c78106ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:26.681 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.655+0000 7f5c7d365640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5c781070b0 con 0x7f5c781066e0 2024-09-19T07:02:26.681 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.655+0000 7f5c76ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c781066e0 0x7f5c78106ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:26.682 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.655+0000 7f5c76ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c781066e0 0x7f5c78106ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:32858/0 (socket says 172.21.15.148:32858) 2024-09-19T07:02:26.682 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.655+0000 7f5c76ffd640 1 -- 172.21.15.148:0/349484434 learned_addr learned my addr 172.21.15.148:0/349484434 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:02:26.682 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.656+0000 7f5c76ffd640 1 -- 172.21.15.148:0/349484434 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c781078e0 con 0x7f5c781066e0 2024-09-19T07:02:26.682 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.656+0000 7f5c76ffd640 1 --2- 172.21.15.148:0/349484434 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c781066e0 0x7f5c78106ae0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5c68009e80 tx=0x7f5c6802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86afac0fd3d600ad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:26.682 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.657+0000 7f5c75ffb640 1 -- 172.21.15.148:0/349484434 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c68036070 con 0x7f5c781066e0 2024-09-19T07:02:26.682 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.657+0000 7f5c75ffb640 1 -- 172.21.15.148:0/349484434 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5c680318c0 con 0x7f5c781066e0 2024-09-19T07:02:26.682 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.657+0000 7f5c75ffb640 1 -- 172.21.15.148:0/349484434 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c68007ab0 con 0x7f5c781066e0 2024-09-19T07:02:26.682 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.657+0000 7f5c7d365640 1 -- 172.21.15.148:0/349484434 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c781066e0 msgr2=0x7f5c78106ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:26.682 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.657+0000 7f5c7d365640 1 --2- 172.21.15.148:0/349484434 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c781066e0 0x7f5c78106ae0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5c68009e80 tx=0x7f5c6802a7a0 comp rx=0 tx=0).stop 2024-09-19T07:02:26.682 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.657+0000 7f5c7d365640 1 -- 172.21.15.148:0/349484434 shutdown_connections 2024-09-19T07:02:26.682 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.657+0000 7f5c7d365640 1 --2- 172.21.15.148:0/349484434 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c781066e0 0x7f5c78106ae0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:26.682 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.657+0000 7f5c7d365640 1 -- 172.21.15.148:0/349484434 >> 172.21.15.148:0/349484434 conn(0x7f5c78101ed0 msgr2=0x7f5c781042f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:26.683 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.657+0000 7f5c7d365640 1 -- 172.21.15.148:0/349484434 shutdown_connections 2024-09-19T07:02:26.683 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.657+0000 7f5c7d365640 1 -- 172.21.15.148:0/349484434 wait complete. 2024-09-19T07:02:26.683 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.658+0000 7f5c7d365640 1 Processor -- start 2024-09-19T07:02:26.683 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.658+0000 7f5c7d365640 1 -- start start 2024-09-19T07:02:26.683 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.658+0000 7f5c7d365640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c781066e0 0x7f5c7819d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:26.683 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.658+0000 7f5c7d365640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5c7810ac90 con 0x7f5c781066e0 2024-09-19T07:02:26.683 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.658+0000 7f5c76ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c781066e0 0x7f5c7819d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:26.683 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.658+0000 7f5c76ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c781066e0 0x7f5c7819d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:32874/0 (socket says 172.21.15.148:32874) 2024-09-19T07:02:26.683 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.658+0000 7f5c76ffd640 1 -- 172.21.15.148:0/188769957 learned_addr learned my addr 172.21.15.148:0/188769957 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:02:26.683 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.659+0000 7f5c76ffd640 1 -- 172.21.15.148:0/188769957 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c7819df10 con 0x7f5c781066e0 2024-09-19T07:02:26.683 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.659+0000 7f5c76ffd640 1 --2- 172.21.15.148:0/188769957 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c781066e0 0x7f5c7819d9d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5c6802acc0 tx=0x7f5c68031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:26.683 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.659+0000 7f5c5ffff640 1 -- 172.21.15.148:0/188769957 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c68036050 con 0x7f5c781066e0 2024-09-19T07:02:26.683 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.659+0000 7f5c7d365640 1 -- 172.21.15.148:0/188769957 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c7819e1a0 con 0x7f5c781066e0 2024-09-19T07:02:26.684 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.659+0000 7f5c5ffff640 1 -- 172.21.15.148:0/188769957 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5c68037040 con 0x7f5c781066e0 2024-09-19T07:02:26.684 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.659+0000 7f5c5ffff640 1 -- 172.21.15.148:0/188769957 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c6803d8c0 con 0x7f5c781066e0 2024-09-19T07:02:26.684 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.659+0000 7f5c7d365640 1 -- 172.21.15.148:0/188769957 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c781a0e90 con 0x7f5c781066e0 2024-09-19T07:02:26.684 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.660+0000 7f5c5ffff640 1 -- 172.21.15.148:0/188769957 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f5c68044020 con 0x7f5c781066e0 2024-09-19T07:02:26.684 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.660+0000 7f5c5ffff640 1 --2- 172.21.15.148:0/188769957 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f5c600391b0 0x7f5c6003b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:26.684 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.660+0000 7f5c7d365640 1 -- 172.21.15.148:0/188769957 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c78106b60 con 0x7f5c781066e0 2024-09-19T07:02:26.684 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.660+0000 7f5c5ffff640 1 -- 172.21.15.148:0/188769957 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f5c68042020 con 0x7f5c781066e0 2024-09-19T07:02:26.684 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.660+0000 7f5c767fc640 1 --2- 172.21.15.148:0/188769957 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f5c600391b0 0x7f5c6003b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:26.684 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.661+0000 7f5c767fc640 1 --2- 172.21.15.148:0/188769957 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f5c600391b0 0x7f5c6003b670 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c0098c0 tx=0x7f5c6c006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:26.684 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.665+0000 7f5c5ffff640 1 -- 172.21.15.148:0/188769957 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5c6804b020 con 0x7f5c781066e0 2024-09-19T07:02:26.684 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.880+0000 7f5c7d365640 1 -- 172.21.15.148:0/188769957 --> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f5c7802da90 con 0x7f5c600391b0 2024-09-19T07:02:26.684 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.885+0000 7f5c5ffff640 1 -- 172.21.15.148:0/188769957 <== mgr.14116 v2:172.21.15.148:6800/1949849385 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f5c7802da90 con 0x7f5c600391b0 2024-09-19T07:02:26.685 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.887+0000 7f5c7d365640 1 -- 172.21.15.148:0/188769957 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f5c600391b0 msgr2=0x7f5c6003b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:26.685 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.887+0000 7f5c7d365640 1 --2- 172.21.15.148:0/188769957 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f5c600391b0 0x7f5c6003b670 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c0098c0 tx=0x7f5c6c006db0 comp rx=0 tx=0).stop 2024-09-19T07:02:26.685 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.887+0000 7f5c7d365640 1 -- 172.21.15.148:0/188769957 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c781066e0 msgr2=0x7f5c7819d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:26.685 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.887+0000 7f5c7d365640 1 --2- 172.21.15.148:0/188769957 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c781066e0 0x7f5c7819d9d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5c6802acc0 tx=0x7f5c68031ca0 comp rx=0 tx=0).stop 2024-09-19T07:02:26.685 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.887+0000 7f5c7d365640 1 -- 172.21.15.148:0/188769957 shutdown_connections 2024-09-19T07:02:26.685 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.887+0000 7f5c7d365640 1 --2- 172.21.15.148:0/188769957 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f5c600391b0 0x7f5c6003b670 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:26.685 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.887+0000 7f5c7d365640 1 --2- 172.21.15.148:0/188769957 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c781066e0 0x7f5c7819d9d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:26.685 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.887+0000 7f5c7d365640 1 -- 172.21.15.148:0/188769957 >> 172.21.15.148:0/188769957 conn(0x7f5c78101ed0 msgr2=0x7f5c78102e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:26.685 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.888+0000 7f5c7d365640 1 -- 172.21.15.148:0/188769957 shutdown_connections 2024-09-19T07:02:26.685 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:25.888+0000 7f5c7d365640 1 -- 172.21.15.148:0/188769957 wait complete. 2024-09-19T07:02:26.685 INFO:teuthology.orchestra.run.smithi148.stdout:Deploying unmanaged mgr service... 2024-09-19T07:02:27.009 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:26 smithi148 ceph-mon[31180]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:02:27.009 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:26 smithi148 ceph-mon[31180]: Saving service mon spec with placement count:5 2024-09-19T07:02:27.009 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:26 smithi148 ceph-mon[31180]: from='mgr.14116 172.21.15.148:0/2118014832' entity='mgr.x' 2024-09-19T07:02:28.141 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-19T07:02:28.141 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.259+0000 7f2c0e1c7640 1 Processor -- start 2024-09-19T07:02:28.141 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.259+0000 7f2c0e1c7640 1 -- start start 2024-09-19T07:02:28.141 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.259+0000 7f2c0e1c7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c081066e0 0x7f2c08106ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:28.141 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.259+0000 7f2c0e1c7640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2c081070b0 con 0x7f2c081066e0 2024-09-19T07:02:28.141 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.259+0000 7f2c077fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c081066e0 0x7f2c08106ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:28.141 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.259+0000 7f2c077fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c081066e0 0x7f2c08106ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:32886/0 (socket says 172.21.15.148:32886) 2024-09-19T07:02:28.141 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.259+0000 7f2c077fe640 1 -- 172.21.15.148:0/1364691381 learned_addr learned my addr 172.21.15.148:0/1364691381 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:02:28.141 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.260+0000 7f2c077fe640 1 -- 172.21.15.148:0/1364691381 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c081078e0 con 0x7f2c081066e0 2024-09-19T07:02:28.142 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.260+0000 7f2c077fe640 1 --2- 172.21.15.148:0/1364691381 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c081066e0 0x7f2c08106ae0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2bf800bac0 tx=0x7f2bf802c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c1827cc1b5a9c17 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:28.142 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.261+0000 7f2c067fc640 1 -- 172.21.15.148:0/1364691381 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2bf80326d0 con 0x7f2c081066e0 2024-09-19T07:02:28.142 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.261+0000 7f2c067fc640 1 -- 172.21.15.148:0/1364691381 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2bf8038070 con 0x7f2c081066e0 2024-09-19T07:02:28.142 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.261+0000 7f2c067fc640 1 -- 172.21.15.148:0/1364691381 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2bf8033d70 con 0x7f2c081066e0 2024-09-19T07:02:28.142 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.261+0000 7f2c0e1c7640 1 -- 172.21.15.148:0/1364691381 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c081066e0 msgr2=0x7f2c08106ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:28.142 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.261+0000 7f2c0e1c7640 1 --2- 172.21.15.148:0/1364691381 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c081066e0 0x7f2c08106ae0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2bf800bac0 tx=0x7f2bf802c920 comp rx=0 tx=0).stop 2024-09-19T07:02:28.142 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.261+0000 7f2c0e1c7640 1 -- 172.21.15.148:0/1364691381 shutdown_connections 2024-09-19T07:02:28.142 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.261+0000 7f2c0e1c7640 1 --2- 172.21.15.148:0/1364691381 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c081066e0 0x7f2c08106ae0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:28.142 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.261+0000 7f2c0e1c7640 1 -- 172.21.15.148:0/1364691381 >> 172.21.15.148:0/1364691381 conn(0x7f2c08101ed0 msgr2=0x7f2c081042f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:28.142 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.261+0000 7f2c0e1c7640 1 -- 172.21.15.148:0/1364691381 shutdown_connections 2024-09-19T07:02:28.142 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.261+0000 7f2c0e1c7640 1 -- 172.21.15.148:0/1364691381 wait complete. 2024-09-19T07:02:28.142 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.262+0000 7f2c0e1c7640 1 Processor -- start 2024-09-19T07:02:28.142 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.262+0000 7f2c0e1c7640 1 -- start start 2024-09-19T07:02:28.142 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.262+0000 7f2c0e1c7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c081066e0 0x7f2c081995a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:28.143 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.262+0000 7f2c0e1c7640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2c0807af50 con 0x7f2c081066e0 2024-09-19T07:02:28.143 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.262+0000 7f2c077fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c081066e0 0x7f2c081995a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:28.143 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.263+0000 7f2c077fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c081066e0 0x7f2c081995a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:32896/0 (socket says 172.21.15.148:32896) 2024-09-19T07:02:28.143 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.263+0000 7f2c077fe640 1 -- 172.21.15.148:0/2273788625 learned_addr learned my addr 172.21.15.148:0/2273788625 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:02:28.143 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.263+0000 7f2c077fe640 1 -- 172.21.15.148:0/2273788625 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c08199ae0 con 0x7f2c081066e0 2024-09-19T07:02:28.143 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.263+0000 7f2c077fe640 1 --2- 172.21.15.148:0/2273788625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c081066e0 0x7f2c081995a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2bf800b2c0 tx=0x7f2bf8032820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:28.143 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.263+0000 7f2c04ff9640 1 -- 172.21.15.148:0/2273788625 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2bf8042070 con 0x7f2c081066e0 2024-09-19T07:02:28.143 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.263+0000 7f2c04ff9640 1 -- 172.21.15.148:0/2273788625 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2bf8032c40 con 0x7f2c081066e0 2024-09-19T07:02:28.143 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.263+0000 7f2c0e1c7640 1 -- 172.21.15.148:0/2273788625 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c08199d70 con 0x7f2c081066e0 2024-09-19T07:02:28.143 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.263+0000 7f2c04ff9640 1 -- 172.21.15.148:0/2273788625 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2bf803c610 con 0x7f2c081066e0 2024-09-19T07:02:28.143 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.263+0000 7f2c0e1c7640 1 -- 172.21.15.148:0/2273788625 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c0819ca60 con 0x7f2c081066e0 2024-09-19T07:02:28.143 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.264+0000 7f2c04ff9640 1 -- 172.21.15.148:0/2273788625 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f2bf803c7b0 con 0x7f2c081066e0 2024-09-19T07:02:28.144 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.264+0000 7f2c0e1c7640 1 -- 172.21.15.148:0/2273788625 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c08106ae0 con 0x7f2c081066e0 2024-09-19T07:02:28.144 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.264+0000 7f2c04ff9640 1 --2- 172.21.15.148:0/2273788625 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f2bf4039200 0x7f2bf403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:28.144 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.264+0000 7f2c04ff9640 1 -- 172.21.15.148:0/2273788625 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f2bf8030050 con 0x7f2c081066e0 2024-09-19T07:02:28.144 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.265+0000 7f2c06ffd640 1 --2- 172.21.15.148:0/2273788625 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f2bf4039200 0x7f2bf403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:28.144 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.265+0000 7f2c06ffd640 1 --2- 172.21.15.148:0/2273788625 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f2bf4039200 0x7f2bf403b6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2bf00098c0 tx=0x7f2bf0006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:28.144 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.269+0000 7f2c04ff9640 1 -- 172.21.15.148:0/2273788625 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2bf803bc80 con 0x7f2c081066e0 2024-09-19T07:02:28.144 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.451+0000 7f2c0e1c7640 1 -- 172.21.15.148:0/2273788625 --> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f2c08074c70 con 0x7f2bf4039200 2024-09-19T07:02:28.144 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.456+0000 7f2c04ff9640 1 -- 172.21.15.148:0/2273788625 <== mgr.14116 v2:172.21.15.148:6800/1949849385 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f2c08074c70 con 0x7f2bf4039200 2024-09-19T07:02:28.144 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.459+0000 7f2c0e1c7640 1 -- 172.21.15.148:0/2273788625 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f2bf4039200 msgr2=0x7f2bf403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:28.144 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.459+0000 7f2c0e1c7640 1 --2- 172.21.15.148:0/2273788625 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f2bf4039200 0x7f2bf403b6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2bf00098c0 tx=0x7f2bf0006db0 comp rx=0 tx=0).stop 2024-09-19T07:02:28.144 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.459+0000 7f2c0e1c7640 1 -- 172.21.15.148:0/2273788625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c081066e0 msgr2=0x7f2c081995a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:28.145 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.459+0000 7f2c0e1c7640 1 --2- 172.21.15.148:0/2273788625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c081066e0 0x7f2c081995a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2bf800b2c0 tx=0x7f2bf8032820 comp rx=0 tx=0).stop 2024-09-19T07:02:28.145 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.459+0000 7f2c0e1c7640 1 -- 172.21.15.148:0/2273788625 shutdown_connections 2024-09-19T07:02:28.145 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.459+0000 7f2c0e1c7640 1 --2- 172.21.15.148:0/2273788625 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f2bf4039200 0x7f2bf403b6c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:28.145 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.459+0000 7f2c0e1c7640 1 --2- 172.21.15.148:0/2273788625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c081066e0 0x7f2c081995a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:28.145 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.459+0000 7f2c0e1c7640 1 -- 172.21.15.148:0/2273788625 >> 172.21.15.148:0/2273788625 conn(0x7f2c08101ed0 msgr2=0x7f2c0818fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:28.145 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.459+0000 7f2c0e1c7640 1 -- 172.21.15.148:0/2273788625 shutdown_connections 2024-09-19T07:02:28.145 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:27.459+0000 7f2c0e1c7640 1 -- 172.21.15.148:0/2273788625 wait complete. 2024-09-19T07:02:28.730 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:28 smithi148 ceph-mon[31180]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:02:28.730 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:28 smithi148 ceph-mon[31180]: Saving service mgr spec with placement count:2 2024-09-19T07:02:28.730 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:28 smithi148 ceph-mon[31180]: from='mgr.14116 172.21.15.148:0/2118014832' entity='mgr.x' 2024-09-19T07:02:29.517 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.550+0000 7f0f37bb3640 1 Processor -- start 2024-09-19T07:02:29.517 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.550+0000 7f0f37bb3640 1 -- start start 2024-09-19T07:02:29.518 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.550+0000 7f0f37bb3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f301066d0 0x7f0f30106ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:29.518 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.550+0000 7f0f37bb3640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0f301070a0 con 0x7f0f301066d0 2024-09-19T07:02:29.518 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.550+0000 7f0f3594f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f301066d0 0x7f0f30106ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:29.518 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.550+0000 7f0f3594f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f301066d0 0x7f0f30106ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:32906/0 (socket says 172.21.15.148:32906) 2024-09-19T07:02:29.518 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.550+0000 7f0f3594f640 1 -- 172.21.15.148:0/1221676744 learned_addr learned my addr 172.21.15.148:0/1221676744 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:02:29.518 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.550+0000 7f0f3594f640 1 -- 172.21.15.148:0/1221676744 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f301078d0 con 0x7f0f301066d0 2024-09-19T07:02:29.518 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.551+0000 7f0f3594f640 1 --2- 172.21.15.148:0/1221676744 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f301066d0 0x7f0f30106ad0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0f24009820 tx=0x7f0f2402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8589bcf795859a90 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:29.518 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.551+0000 7f0f3494d640 1 -- 172.21.15.148:0/1221676744 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f24037070 con 0x7f0f301066d0 2024-09-19T07:02:29.518 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.551+0000 7f0f3494d640 1 -- 172.21.15.148:0/1221676744 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0f24032900 con 0x7f0f301066d0 2024-09-19T07:02:29.518 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.551+0000 7f0f3494d640 1 -- 172.21.15.148:0/1221676744 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f24030850 con 0x7f0f301066d0 2024-09-19T07:02:29.518 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.552+0000 7f0f37bb3640 1 -- 172.21.15.148:0/1221676744 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f301066d0 msgr2=0x7f0f30106ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:29.519 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.552+0000 7f0f37bb3640 1 --2- 172.21.15.148:0/1221676744 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f301066d0 0x7f0f30106ad0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0f24009820 tx=0x7f0f2402a270 comp rx=0 tx=0).stop 2024-09-19T07:02:29.519 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.552+0000 7f0f37bb3640 1 -- 172.21.15.148:0/1221676744 shutdown_connections 2024-09-19T07:02:29.519 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.552+0000 7f0f37bb3640 1 --2- 172.21.15.148:0/1221676744 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f301066d0 0x7f0f30106ad0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:29.519 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.552+0000 7f0f37bb3640 1 -- 172.21.15.148:0/1221676744 >> 172.21.15.148:0/1221676744 conn(0x7f0f30101e60 msgr2=0x7f0f301042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:29.519 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.552+0000 7f0f37bb3640 1 -- 172.21.15.148:0/1221676744 shutdown_connections 2024-09-19T07:02:29.519 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.552+0000 7f0f37bb3640 1 -- 172.21.15.148:0/1221676744 wait complete. 2024-09-19T07:02:29.519 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.552+0000 7f0f37bb3640 1 Processor -- start 2024-09-19T07:02:29.519 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.552+0000 7f0f37bb3640 1 -- start start 2024-09-19T07:02:29.519 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.553+0000 7f0f37bb3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f301066d0 0x7f0f3007b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:29.519 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.553+0000 7f0f37bb3640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0f3010ac80 con 0x7f0f301066d0 2024-09-19T07:02:29.519 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.553+0000 7f0f3594f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f301066d0 0x7f0f3007b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:29.519 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.553+0000 7f0f3594f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f301066d0 0x7f0f3007b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:32910/0 (socket says 172.21.15.148:32910) 2024-09-19T07:02:29.519 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.553+0000 7f0f3594f640 1 -- 172.21.15.148:0/2699576965 learned_addr learned my addr 172.21.15.148:0/2699576965 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:02:29.520 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.553+0000 7f0f3594f640 1 -- 172.21.15.148:0/2699576965 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f3019e520 con 0x7f0f301066d0 2024-09-19T07:02:29.520 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.553+0000 7f0f3594f640 1 --2- 172.21.15.148:0/2699576965 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f301066d0 0x7f0f3007b9d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0f240097f0 tx=0x7f0f24030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:29.520 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.553+0000 7f0f22ffd640 1 -- 172.21.15.148:0/2699576965 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f24037040 con 0x7f0f301066d0 2024-09-19T07:02:29.520 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.553+0000 7f0f22ffd640 1 -- 172.21.15.148:0/2699576965 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0f24040070 con 0x7f0f301066d0 2024-09-19T07:02:29.520 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.553+0000 7f0f37bb3640 1 -- 172.21.15.148:0/2699576965 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f3019e6f0 con 0x7f0f301066d0 2024-09-19T07:02:29.520 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.553+0000 7f0f22ffd640 1 -- 172.21.15.148:0/2699576965 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f2403a390 con 0x7f0f301066d0 2024-09-19T07:02:29.520 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.553+0000 7f0f37bb3640 1 -- 172.21.15.148:0/2699576965 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f3019ea90 con 0x7f0f301066d0 2024-09-19T07:02:29.520 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.554+0000 7f0f22ffd640 1 -- 172.21.15.148:0/2699576965 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f0f2403a630 con 0x7f0f301066d0 2024-09-19T07:02:29.520 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.554+0000 7f0f37bb3640 1 -- 172.21.15.148:0/2699576965 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f30106b50 con 0x7f0f301066d0 2024-09-19T07:02:29.520 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.554+0000 7f0f22ffd640 1 --2- 172.21.15.148:0/2699576965 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f0f1c0391b0 0x7f0f1c03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:29.520 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.554+0000 7f0f22ffd640 1 -- 172.21.15.148:0/2699576965 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f0f2406c8d0 con 0x7f0f301066d0 2024-09-19T07:02:29.520 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.555+0000 7f0f3514e640 1 --2- 172.21.15.148:0/2699576965 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f0f1c0391b0 0x7f0f1c03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:29.520 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.555+0000 7f0f3514e640 1 --2- 172.21.15.148:0/2699576965 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f0f1c0391b0 0x7f0f1c03b670 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c0098c0 tx=0x7f0f2c006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:29.521 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.559+0000 7f0f22ffd640 1 -- 172.21.15.148:0/2699576965 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0f24043bf0 con 0x7f0f301066d0 2024-09-19T07:02:29.521 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.728+0000 7f0f37bb3640 1 -- 172.21.15.148:0/2699576965 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f0f3019f320 con 0x7f0f301066d0 2024-09-19T07:02:29.521 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.733+0000 7f0f22ffd640 1 -- 172.21.15.148:0/2699576965 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v6)=0 v6) ==== 142+0+0 (secure 0 0 0) 0x7f0f2403b430 con 0x7f0f301066d0 2024-09-19T07:02:29.521 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.736+0000 7f0f37bb3640 1 -- 172.21.15.148:0/2699576965 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f0f1c0391b0 msgr2=0x7f0f1c03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:29.521 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.736+0000 7f0f37bb3640 1 --2- 172.21.15.148:0/2699576965 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f0f1c0391b0 0x7f0f1c03b670 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c0098c0 tx=0x7f0f2c006db0 comp rx=0 tx=0).stop 2024-09-19T07:02:29.521 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.736+0000 7f0f37bb3640 1 -- 172.21.15.148:0/2699576965 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f301066d0 msgr2=0x7f0f3007b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:29.521 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.736+0000 7f0f37bb3640 1 --2- 172.21.15.148:0/2699576965 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f301066d0 0x7f0f3007b9d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0f240097f0 tx=0x7f0f24030d80 comp rx=0 tx=0).stop 2024-09-19T07:02:29.521 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.736+0000 7f0f37bb3640 1 -- 172.21.15.148:0/2699576965 shutdown_connections 2024-09-19T07:02:29.521 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.736+0000 7f0f37bb3640 1 --2- 172.21.15.148:0/2699576965 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f0f1c0391b0 0x7f0f1c03b670 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:29.521 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.736+0000 7f0f37bb3640 1 --2- 172.21.15.148:0/2699576965 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f301066d0 0x7f0f3007b9d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:29.521 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.736+0000 7f0f37bb3640 1 -- 172.21.15.148:0/2699576965 >> 172.21.15.148:0/2699576965 conn(0x7f0f30101e60 msgr2=0x7f0f30102a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:29.521 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.736+0000 7f0f37bb3640 1 -- 172.21.15.148:0/2699576965 shutdown_connections 2024-09-19T07:02:29.521 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:28.736+0000 7f0f37bb3640 1 -- 172.21.15.148:0/2699576965 wait complete. 2024-09-19T07:02:29.926 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:29 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/2699576965' entity='client.admin' 2024-09-19T07:02:29.926 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:29 smithi148 ceph-mon[31180]: from='mgr.14116 172.21.15.148:0/2118014832' entity='mgr.x' 2024-09-19T07:02:30.690 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:29.925+0000 7f448db5c640 1 Processor -- start 2024-09-19T07:02:30.691 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:29.925+0000 7f448db5c640 1 -- start start 2024-09-19T07:02:30.691 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:29.925+0000 7f448db5c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f448807de40 0x7f448807c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:30.691 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:29.925+0000 7f448db5c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f448807c870 con 0x7f448807de40 2024-09-19T07:02:30.691 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:29.925+0000 7f44877fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f448807de40 0x7f448807c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:30.691 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:29.925+0000 7f44877fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f448807de40 0x7f448807c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:32920/0 (socket says 172.21.15.148:32920) 2024-09-19T07:02:30.691 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:29.925+0000 7f44877fe640 1 -- 172.21.15.148:0/3696381934 learned_addr learned my addr 172.21.15.148:0/3696381934 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:02:30.691 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:29.926+0000 7f44877fe640 1 -- 172.21.15.148:0/3696381934 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f448807c9f0 con 0x7f448807de40 2024-09-19T07:02:30.691 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:29.926+0000 7f44877fe640 1 --2- 172.21.15.148:0/3696381934 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f448807de40 0x7f448807c2a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4478009820 tx=0x7f447802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc913b4c7356abf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:30.691 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:29.926+0000 7f4486ffd640 1 -- 172.21.15.148:0/3696381934 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4478037070 con 0x7f448807de40 2024-09-19T07:02:30.691 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:29.926+0000 7f4486ffd640 1 -- 172.21.15.148:0/3696381934 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4478032920 con 0x7f448807de40 2024-09-19T07:02:30.691 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:29.926+0000 7f4486ffd640 1 -- 172.21.15.148:0/3696381934 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4478030810 con 0x7f448807de40 2024-09-19T07:02:30.691 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:29.927+0000 7f448db5c640 1 -- 172.21.15.148:0/3696381934 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f448807de40 msgr2=0x7f448807c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:30.692 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:29.927+0000 7f448db5c640 1 --2- 172.21.15.148:0/3696381934 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f448807de40 0x7f448807c2a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4478009820 tx=0x7f447802a270 comp rx=0 tx=0).stop 2024-09-19T07:02:30.692 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:29.927+0000 7f448db5c640 1 -- 172.21.15.148:0/3696381934 shutdown_connections 2024-09-19T07:02:30.692 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:29.927+0000 7f448db5c640 1 --2- 172.21.15.148:0/3696381934 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f448807de40 0x7f448807c2a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:30.692 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:29.927+0000 7f448db5c640 1 -- 172.21.15.148:0/3696381934 >> 172.21.15.148:0/3696381934 conn(0x7f4488102f60 msgr2=0x7f44881053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:30.692 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:29.927+0000 7f448db5c640 1 -- 172.21.15.148:0/3696381934 shutdown_connections 2024-09-19T07:02:30.692 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:29.927+0000 7f448db5c640 1 -- 172.21.15.148:0/3696381934 wait complete. 2024-09-19T07:02:30.692 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:29.928+0000 7f448db5c640 1 Processor -- start 2024-09-19T07:02:30.692 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:29.928+0000 7f448db5c640 1 -- start start 2024-09-19T07:02:30.692 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:29.928+0000 7f448db5c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f448807de40 0x7f448819d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:30.692 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:29.928+0000 7f448db5c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f448810de10 con 0x7f448807de40 2024-09-19T07:02:30.692 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:29.928+0000 7f44877fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f448807de40 0x7f448819d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:30.692 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:29.928+0000 7f44877fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f448807de40 0x7f448819d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:32922/0 (socket says 172.21.15.148:32922) 2024-09-19T07:02:30.693 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:29.928+0000 7f44877fe640 1 -- 172.21.15.148:0/4142826845 learned_addr learned my addr 172.21.15.148:0/4142826845 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:02:30.693 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:29.928+0000 7f44877fe640 1 -- 172.21.15.148:0/4142826845 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f448819def0 con 0x7f448807de40 2024-09-19T07:02:30.693 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:29.928+0000 7f44877fe640 1 --2- 172.21.15.148:0/4142826845 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f448807de40 0x7f448819d9b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4478030560 tx=0x7f4478032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:30.693 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:29.929+0000 7f44857fa640 1 -- 172.21.15.148:0/4142826845 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4478037040 con 0x7f448807de40 2024-09-19T07:02:30.693 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:29.929+0000 7f44857fa640 1 -- 172.21.15.148:0/4142826845 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4478040070 con 0x7f448807de40 2024-09-19T07:02:30.693 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:29.929+0000 7f448db5c640 1 -- 172.21.15.148:0/4142826845 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f448819e180 con 0x7f448807de40 2024-09-19T07:02:30.693 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:29.929+0000 7f44857fa640 1 -- 172.21.15.148:0/4142826845 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f447803a740 con 0x7f448807de40 2024-09-19T07:02:30.693 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:29.929+0000 7f448db5c640 1 -- 172.21.15.148:0/4142826845 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44881a0e70 con 0x7f448807de40 2024-09-19T07:02:30.693 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:29.930+0000 7f44857fa640 1 -- 172.21.15.148:0/4142826845 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f447803a9b0 con 0x7f448807de40 2024-09-19T07:02:30.693 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:29.930+0000 7f448db5c640 1 -- 172.21.15.148:0/4142826845 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f448807c320 con 0x7f448807de40 2024-09-19T07:02:30.693 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:29.930+0000 7f44857fa640 1 --2- 172.21.15.148:0/4142826845 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f44740391b0 0x7f447403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:30.694 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:29.930+0000 7f44857fa640 1 -- 172.21.15.148:0/4142826845 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f447806c9d0 con 0x7f448807de40 2024-09-19T07:02:30.694 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:29.930+0000 7f447ffff640 1 --2- 172.21.15.148:0/4142826845 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f44740391b0 0x7f447403b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:30.694 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:29.931+0000 7f447ffff640 1 --2- 172.21.15.148:0/4142826845 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f44740391b0 0x7f447403b670 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f44700098c0 tx=0x7f4470006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:30.694 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:29.935+0000 7f44857fa640 1 -- 172.21.15.148:0/4142826845 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f447803ada0 con 0x7f448807de40 2024-09-19T07:02:30.694 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:30.136+0000 7f448db5c640 1 -- 172.21.15.148:0/4142826845 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f44881a1040 con 0x7f448807de40 2024-09-19T07:02:30.694 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:30.140+0000 7f44857fa640 1 -- 172.21.15.148:0/4142826845 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f4478045460 con 0x7f448807de40 2024-09-19T07:02:30.694 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:30.143+0000 7f448db5c640 1 -- 172.21.15.148:0/4142826845 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f44740391b0 msgr2=0x7f447403b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:30.694 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:30.143+0000 7f448db5c640 1 --2- 172.21.15.148:0/4142826845 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f44740391b0 0x7f447403b670 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f44700098c0 tx=0x7f4470006db0 comp rx=0 tx=0).stop 2024-09-19T07:02:30.694 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:30.143+0000 7f448db5c640 1 -- 172.21.15.148:0/4142826845 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f448807de40 msgr2=0x7f448819d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:30.694 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:30.143+0000 7f448db5c640 1 --2- 172.21.15.148:0/4142826845 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f448807de40 0x7f448819d9b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4478030560 tx=0x7f4478032670 comp rx=0 tx=0).stop 2024-09-19T07:02:30.694 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:30.143+0000 7f448db5c640 1 -- 172.21.15.148:0/4142826845 shutdown_connections 2024-09-19T07:02:30.695 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:30.143+0000 7f448db5c640 1 --2- 172.21.15.148:0/4142826845 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f44740391b0 0x7f447403b670 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:30.695 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:30.143+0000 7f448db5c640 1 --2- 172.21.15.148:0/4142826845 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f448807de40 0x7f448819d9b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:30.695 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:30.143+0000 7f448db5c640 1 -- 172.21.15.148:0/4142826845 >> 172.21.15.148:0/4142826845 conn(0x7f4488102f60 msgr2=0x7f4488103b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:30.695 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:30.143+0000 7f448db5c640 1 -- 172.21.15.148:0/4142826845 shutdown_connections 2024-09-19T07:02:30.695 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:30.143+0000 7f448db5c640 1 -- 172.21.15.148:0/4142826845 wait complete. 2024-09-19T07:02:30.695 INFO:teuthology.orchestra.run.smithi148.stdout:Enabling the dashboard module... 2024-09-19T07:02:31.322 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:31 smithi148 ceph-mon[31180]: from='mgr.14116 172.21.15.148:0/2118014832' entity='mgr.x' 2024-09-19T07:02:31.322 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:31 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/4142826845' entity='client.admin' 2024-09-19T07:02:32.304 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:32 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/663409996' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-19T07:02:32.304 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:32 smithi148 ceph-mon[31180]: from='mgr.14116 172.21.15.148:0/2118014832' entity='mgr.x' 2024-09-19T07:02:32.304 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:32 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: ignoring --setuser ceph since I am not root 2024-09-19T07:02:32.304 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:32 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: ignoring --setgroup ceph since I am not root 2024-09-19T07:02:32.304 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:32 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:32.242+0000 7f6b4da15040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T07:02:32.304 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:32 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:32.302+0000 7f6b4da15040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T07:02:32.567 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:32 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:32.457+0000 7f6b4da15040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T07:02:32.567 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:32 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:32.526+0000 7f6b4da15040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T07:02:32.644 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:31.088+0000 7f658fbb9640 1 Processor -- start 2024-09-19T07:02:32.644 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:31.088+0000 7f658fbb9640 1 -- start start 2024-09-19T07:02:32.644 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:31.088+0000 7f658fbb9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65881077d0 0x7f6588107bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:32.644 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:31.088+0000 7f658fbb9640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f65881081a0 con 0x7f65881077d0 2024-09-19T07:02:32.644 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:31.088+0000 7f658d955640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65881077d0 0x7f6588107bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:32.644 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:31.088+0000 7f658d955640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65881077d0 0x7f6588107bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:32934/0 (socket says 172.21.15.148:32934) 2024-09-19T07:02:32.645 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:31.088+0000 7f658d955640 1 -- 172.21.15.148:0/428647904 learned_addr learned my addr 172.21.15.148:0/428647904 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:02:32.645 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:31.088+0000 7f658d955640 1 -- 172.21.15.148:0/428647904 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65881089d0 con 0x7f65881077d0 2024-09-19T07:02:32.645 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:31.089+0000 7f658d955640 1 --2- 172.21.15.148:0/428647904 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65881077d0 0x7f6588107bd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6578009820 tx=0x7f657802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=692445bf742edbf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:32.645 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:31.089+0000 7f658c953640 1 -- 172.21.15.148:0/428647904 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6578037070 con 0x7f65881077d0 2024-09-19T07:02:32.645 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:31.089+0000 7f658c953640 1 -- 172.21.15.148:0/428647904 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6578032920 con 0x7f65881077d0 2024-09-19T07:02:32.645 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:31.089+0000 7f658c953640 1 -- 172.21.15.148:0/428647904 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6578030810 con 0x7f65881077d0 2024-09-19T07:02:32.645 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:31.090+0000 7f658fbb9640 1 -- 172.21.15.148:0/428647904 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65881077d0 msgr2=0x7f6588107bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:32.645 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:31.090+0000 7f658fbb9640 1 --2- 172.21.15.148:0/428647904 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65881077d0 0x7f6588107bd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6578009820 tx=0x7f657802a270 comp rx=0 tx=0).stop 2024-09-19T07:02:32.645 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:31.090+0000 7f658fbb9640 1 -- 172.21.15.148:0/428647904 shutdown_connections 2024-09-19T07:02:32.645 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:31.090+0000 7f658fbb9640 1 --2- 172.21.15.148:0/428647904 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65881077d0 0x7f6588107bd0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:32.645 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:31.090+0000 7f658fbb9640 1 -- 172.21.15.148:0/428647904 >> 172.21.15.148:0/428647904 conn(0x7f6588102f60 msgr2=0x7f65881053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:32.645 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:31.090+0000 7f658fbb9640 1 -- 172.21.15.148:0/428647904 shutdown_connections 2024-09-19T07:02:32.646 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:31.090+0000 7f658fbb9640 1 -- 172.21.15.148:0/428647904 wait complete. 2024-09-19T07:02:32.646 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:31.090+0000 7f658fbb9640 1 Processor -- start 2024-09-19T07:02:32.646 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:31.091+0000 7f658fbb9640 1 -- start start 2024-09-19T07:02:32.646 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:31.091+0000 7f658fbb9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65881077d0 0x7f658819b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:32.646 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:31.091+0000 7f658fbb9640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f658810bd80 con 0x7f65881077d0 2024-09-19T07:02:32.646 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:31.091+0000 7f658d955640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65881077d0 0x7f658819b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:32.646 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:31.091+0000 7f658d955640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65881077d0 0x7f658819b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:32936/0 (socket says 172.21.15.148:32936) 2024-09-19T07:02:32.646 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:31.091+0000 7f658d955640 1 -- 172.21.15.148:0/663409996 learned_addr learned my addr 172.21.15.148:0/663409996 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:02:32.646 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:31.091+0000 7f658d955640 1 -- 172.21.15.148:0/663409996 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f658819bcf0 con 0x7f65881077d0 2024-09-19T07:02:32.646 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:31.091+0000 7f658d955640 1 --2- 172.21.15.148:0/663409996 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65881077d0 0x7f658819b7b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6578030560 tx=0x7f6578032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:32.646 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:31.091+0000 7f657effd640 1 -- 172.21.15.148:0/663409996 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6578037040 con 0x7f65881077d0 2024-09-19T07:02:32.646 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:31.091+0000 7f657effd640 1 -- 172.21.15.148:0/663409996 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6578040070 con 0x7f65881077d0 2024-09-19T07:02:32.646 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:31.091+0000 7f658fbb9640 1 -- 172.21.15.148:0/663409996 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f658819bf80 con 0x7f65881077d0 2024-09-19T07:02:32.646 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:31.091+0000 7f657effd640 1 -- 172.21.15.148:0/663409996 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f657803a740 con 0x7f65881077d0 2024-09-19T07:02:32.646 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:31.091+0000 7f658fbb9640 1 -- 172.21.15.148:0/663409996 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f658819ec70 con 0x7f65881077d0 2024-09-19T07:02:32.647 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:31.092+0000 7f657effd640 1 -- 172.21.15.148:0/663409996 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f657803b420 con 0x7f65881077d0 2024-09-19T07:02:32.647 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:31.092+0000 7f658fbb9640 1 -- 172.21.15.148:0/663409996 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6588107c50 con 0x7f65881077d0 2024-09-19T07:02:32.647 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:31.092+0000 7f657effd640 1 --2- 172.21.15.148:0/663409996 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f65740391b0 0x7f657403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:32.647 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:31.092+0000 7f657effd640 1 -- 172.21.15.148:0/663409996 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f657806c830 con 0x7f65881077d0 2024-09-19T07:02:32.647 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:31.093+0000 7f658d154640 1 --2- 172.21.15.148:0/663409996 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f65740391b0 0x7f657403b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:32.647 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:31.093+0000 7f658d154640 1 --2- 172.21.15.148:0/663409996 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f65740391b0 0x7f657403b670 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f65840098c0 tx=0x7f6584006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:32.647 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:31.097+0000 7f657effd640 1 -- 172.21.15.148:0/663409996 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f657804a200 con 0x7f65881077d0 2024-09-19T07:02:32.647 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:31.321+0000 7f658fbb9640 1 -- 172.21.15.148:0/663409996 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f658819f260 con 0x7f65881077d0 2024-09-19T07:02:32.647 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:32.026+0000 7f657effd640 1 -- 172.21.15.148:0/663409996 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f6578031e80 con 0x7f65881077d0 2024-09-19T07:02:32.647 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:32.028+0000 7f657effd640 1 -- 172.21.15.148:0/663409996 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f657803b710 con 0x7f65881077d0 2024-09-19T07:02:32.647 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:32.029+0000 7f658fbb9640 1 -- 172.21.15.148:0/663409996 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f65740391b0 msgr2=0x7f657403b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:32.647 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:32.029+0000 7f658fbb9640 1 --2- 172.21.15.148:0/663409996 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f65740391b0 0x7f657403b670 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f65840098c0 tx=0x7f6584006db0 comp rx=0 tx=0).stop 2024-09-19T07:02:32.647 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:32.029+0000 7f658fbb9640 1 -- 172.21.15.148:0/663409996 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65881077d0 msgr2=0x7f658819b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:32.647 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:32.029+0000 7f658fbb9640 1 --2- 172.21.15.148:0/663409996 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65881077d0 0x7f658819b7b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6578030560 tx=0x7f6578032670 comp rx=0 tx=0).stop 2024-09-19T07:02:32.648 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:32.029+0000 7f658fbb9640 1 -- 172.21.15.148:0/663409996 shutdown_connections 2024-09-19T07:02:32.648 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:32.029+0000 7f658fbb9640 1 --2- 172.21.15.148:0/663409996 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f65740391b0 0x7f657403b670 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:32.648 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:32.029+0000 7f658fbb9640 1 --2- 172.21.15.148:0/663409996 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65881077d0 0x7f658819b7b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:32.648 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:32.029+0000 7f658fbb9640 1 -- 172.21.15.148:0/663409996 >> 172.21.15.148:0/663409996 conn(0x7f6588102f60 msgr2=0x7f6588103b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:32.648 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:32.029+0000 7f658fbb9640 1 -- 172.21.15.148:0/663409996 shutdown_connections 2024-09-19T07:02:32.648 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:32.029+0000 7f658fbb9640 1 -- 172.21.15.148:0/663409996 wait complete. 2024-09-19T07:02:32.833 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:32 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:32.698+0000 7f6b4da15040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:02:33.183 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:33 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/663409996' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-19T07:02:33.183 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:33 smithi148 ceph-mon[31180]: mgrmap e9: x(active, since 17s) 2024-09-19T07:02:33.183 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:32 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:32.847+0000 7f6b4da15040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T07:02:33.440 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:33 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:33.182+0000 7f6b4da15040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T07:02:33.440 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:33 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:33.245+0000 7f6b4da15040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T07:02:33.833 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:33 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:33.448+0000 7f6b4da15040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T07:02:33.936 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout { 2024-09-19T07:02:33.943 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-19T07:02:33.943 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T07:02:33.943 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T07:02:33.943 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T07:02:33.943 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout } 2024-09-19T07:02:33.943 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.076+0000 7f1c0ff74640 1 Processor -- start 2024-09-19T07:02:33.944 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.076+0000 7f1c0ff74640 1 -- start start 2024-09-19T07:02:33.944 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.076+0000 7f1c0ff74640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c08108280 0x7f1c0810a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:33.944 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.076+0000 7f1c0ff74640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1c0807bdf0 con 0x7f1c08108280 2024-09-19T07:02:33.944 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.077+0000 7f1c0dd10640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c08108280 0x7f1c0810a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:33.944 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.077+0000 7f1c0dd10640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c08108280 0x7f1c0810a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:32954/0 (socket says 172.21.15.148:32954) 2024-09-19T07:02:33.944 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.077+0000 7f1c0dd10640 1 -- 172.21.15.148:0/78497016 learned_addr learned my addr 172.21.15.148:0/78497016 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:02:33.944 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.077+0000 7f1c0dd10640 1 -- 172.21.15.148:0/78497016 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c0810abb0 con 0x7f1c08108280 2024-09-19T07:02:33.944 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.078+0000 7f1c0dd10640 1 --2- 172.21.15.148:0/78497016 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c08108280 0x7f1c0810a670 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1c04009820 tx=0x7f1c0402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2183f96c3901f0e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:33.944 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.078+0000 7f1c0cd0e640 1 -- 172.21.15.148:0/78497016 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c04037070 con 0x7f1c08108280 2024-09-19T07:02:33.944 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.078+0000 7f1c0cd0e640 1 -- 172.21.15.148:0/78497016 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c04032920 con 0x7f1c08108280 2024-09-19T07:02:33.944 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.078+0000 7f1c0cd0e640 1 -- 172.21.15.148:0/78497016 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c04030810 con 0x7f1c08108280 2024-09-19T07:02:33.944 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.079+0000 7f1c0ff74640 1 -- 172.21.15.148:0/78497016 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c08108280 msgr2=0x7f1c0810a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:33.945 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.079+0000 7f1c0ff74640 1 --2- 172.21.15.148:0/78497016 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c08108280 0x7f1c0810a670 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1c04009820 tx=0x7f1c0402a270 comp rx=0 tx=0).stop 2024-09-19T07:02:33.945 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.079+0000 7f1c0ff74640 1 -- 172.21.15.148:0/78497016 shutdown_connections 2024-09-19T07:02:33.945 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.079+0000 7f1c0ff74640 1 --2- 172.21.15.148:0/78497016 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c08108280 0x7f1c0810a670 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:33.945 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.079+0000 7f1c0ff74640 1 -- 172.21.15.148:0/78497016 >> 172.21.15.148:0/78497016 conn(0x7f1c08101e60 msgr2=0x7f1c081042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:33.945 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.079+0000 7f1c0ff74640 1 -- 172.21.15.148:0/78497016 shutdown_connections 2024-09-19T07:02:33.945 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.079+0000 7f1c0ff74640 1 -- 172.21.15.148:0/78497016 wait complete. 2024-09-19T07:02:33.945 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.079+0000 7f1c0ff74640 1 Processor -- start 2024-09-19T07:02:33.945 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.080+0000 7f1c0ff74640 1 -- start start 2024-09-19T07:02:33.945 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.080+0000 7f1c0ff74640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c08108280 0x7f1c0819b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:33.945 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.080+0000 7f1c0ff74640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1c0810bbc0 con 0x7f1c08108280 2024-09-19T07:02:33.945 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.080+0000 7f1c0dd10640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c08108280 0x7f1c0819b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:33.946 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.080+0000 7f1c0dd10640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c08108280 0x7f1c0819b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:32970/0 (socket says 172.21.15.148:32970) 2024-09-19T07:02:33.946 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.080+0000 7f1c0dd10640 1 -- 172.21.15.148:0/618479732 learned_addr learned my addr 172.21.15.148:0/618479732 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:02:33.946 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.080+0000 7f1c0dd10640 1 -- 172.21.15.148:0/618479732 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c0819bcf0 con 0x7f1c08108280 2024-09-19T07:02:33.946 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.080+0000 7f1c0dd10640 1 --2- 172.21.15.148:0/618479732 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c08108280 0x7f1c0819b7b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1c040097f0 tx=0x7f1c040327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:33.946 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.081+0000 7f1bfeffd640 1 -- 172.21.15.148:0/618479732 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c04037040 con 0x7f1c08108280 2024-09-19T07:02:33.946 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.081+0000 7f1bfeffd640 1 -- 172.21.15.148:0/618479732 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c04030cc0 con 0x7f1c08108280 2024-09-19T07:02:33.946 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.081+0000 7f1bfeffd640 1 -- 172.21.15.148:0/618479732 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c0403a6b0 con 0x7f1c08108280 2024-09-19T07:02:33.946 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.081+0000 7f1c0ff74640 1 -- 172.21.15.148:0/618479732 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c0819bf80 con 0x7f1c08108280 2024-09-19T07:02:33.946 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.082+0000 7f1c0ff74640 1 -- 172.21.15.148:0/618479732 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c0819ec70 con 0x7f1c08108280 2024-09-19T07:02:33.946 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.082+0000 7f1bfeffd640 1 -- 172.21.15.148:0/618479732 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f1c0403a850 con 0x7f1c08108280 2024-09-19T07:02:33.946 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.082+0000 7f1c0ff74640 1 -- 172.21.15.148:0/618479732 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c081086e0 con 0x7f1c08108280 2024-09-19T07:02:33.946 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.083+0000 7f1bfeffd640 1 --2- 172.21.15.148:0/618479732 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f1bf4038e60 0x7f1bf403b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:33.947 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.083+0000 7f1bfeffd640 1 -- 172.21.15.148:0/618479732 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f1c0406c720 con 0x7f1c08108280 2024-09-19T07:02:33.947 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.083+0000 7f1c0d50f640 1 -- 172.21.15.148:0/618479732 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f1bf4038e60 msgr2=0x7f1bf403b320 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:6800/1949849385 2024-09-19T07:02:33.947 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.083+0000 7f1c0d50f640 1 --2- 172.21.15.148:0/618479732 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f1bf4038e60 0x7f1bf403b320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T07:02:33.947 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.087+0000 7f1bfeffd640 1 -- 172.21.15.148:0/618479732 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1c04049020 con 0x7f1c08108280 2024-09-19T07:02:33.947 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.284+0000 7f1c0d50f640 1 -- 172.21.15.148:0/618479732 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f1bf4038e60 msgr2=0x7f1bf403b320 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:6800/1949849385 2024-09-19T07:02:33.947 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.284+0000 7f1c0d50f640 1 --2- 172.21.15.148:0/618479732 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f1bf4038e60 0x7f1bf403b320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T07:02:33.947 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.308+0000 7f1c0ff74640 1 -- 172.21.15.148:0/618479732 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f1c0819ee40 con 0x7f1c08108280 2024-09-19T07:02:33.947 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.309+0000 7f1bfeffd640 1 -- 172.21.15.148:0/618479732 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f1c0819ee40 con 0x7f1c08108280 2024-09-19T07:02:33.947 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.311+0000 7f1c0ff74640 1 -- 172.21.15.148:0/618479732 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f1bf4038e60 msgr2=0x7f1bf403b320 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T07:02:33.947 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.311+0000 7f1c0ff74640 1 --2- 172.21.15.148:0/618479732 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f1bf4038e60 0x7f1bf403b320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:33.947 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.312+0000 7f1c0ff74640 1 -- 172.21.15.148:0/618479732 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c08108280 msgr2=0x7f1c0819b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:33.947 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.312+0000 7f1c0ff74640 1 --2- 172.21.15.148:0/618479732 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c08108280 0x7f1c0819b7b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1c040097f0 tx=0x7f1c040327b0 comp rx=0 tx=0).stop 2024-09-19T07:02:33.947 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.312+0000 7f1c0ff74640 1 -- 172.21.15.148:0/618479732 shutdown_connections 2024-09-19T07:02:33.948 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.312+0000 7f1c0ff74640 1 --2- 172.21.15.148:0/618479732 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f1bf4038e60 0x7f1bf403b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:33.948 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.312+0000 7f1c0ff74640 1 --2- 172.21.15.148:0/618479732 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c08108280 0x7f1c0819b7b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:33.948 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.312+0000 7f1c0ff74640 1 -- 172.21.15.148:0/618479732 >> 172.21.15.148:0/618479732 conn(0x7f1c08101e60 msgr2=0x7f1c08102a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:33.948 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.312+0000 7f1c0ff74640 1 -- 172.21.15.148:0/618479732 shutdown_connections 2024-09-19T07:02:33.948 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:33.312+0000 7f1c0ff74640 1 -- 172.21.15.148:0/618479732 wait complete. 2024-09-19T07:02:33.948 INFO:teuthology.orchestra.run.smithi148.stdout:Waiting for the mgr to restart... 2024-09-19T07:02:33.948 INFO:teuthology.orchestra.run.smithi148.stdout:Waiting for mgr epoch 9... 2024-09-19T07:02:34.186 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:34 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/618479732' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T07:02:34.556 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:34 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:34.359+0000 7f6b4da15040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T07:02:34.556 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:34 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:34.427+0000 7f6b4da15040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T07:02:35.251 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:35 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:35.135+0000 7f6b4da15040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T07:02:35.251 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:35 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:35.250+0000 7f6b4da15040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T07:02:35.583 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:35 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:35.390+0000 7f6b4da15040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:02:35.583 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:35 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:35.452+0000 7f6b4da15040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T07:02:35.888 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:35 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:35.601+0000 7f6b4da15040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T07:02:35.888 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:35 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:35.667+0000 7f6b4da15040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T07:02:35.889 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:35 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:35.727+0000 7f6b4da15040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T07:02:35.889 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:35 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:35.887+0000 7f6b4da15040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T07:02:36.160 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:35 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:35.952+0000 7f6b4da15040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T07:02:36.160 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:36 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:36.018+0000 7f6b4da15040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T07:02:36.160 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:36 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:36.099+0000 7f6b4da15040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T07:02:36.160 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:36 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:36.158+0000 7f6b4da15040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T07:02:36.583 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:36 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:36.218+0000 7f6b4da15040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T07:02:37.333 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:37 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:37.004+0000 7f6b4da15040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T07:02:37.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:37 smithi148 ceph-mon[31180]: Active manager daemon x restarted 2024-09-19T07:02:37.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:37 smithi148 ceph-mon[31180]: Activating manager daemon x 2024-09-19T07:02:37.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:37 smithi148 ceph-mon[31180]: osdmap e3: 0 total, 0 up, 0 in 2024-09-19T07:02:37.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:37 smithi148 ceph-mon[31180]: mgrmap e10: x(active, starting, since 0.00350183s) 2024-09-19T07:02:37.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:37 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:02:37.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:37 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T07:02:37.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:37 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T07:02:37.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:37 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T07:02:37.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:37 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T07:02:37.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:37 smithi148 ceph-mon[31180]: Manager daemon x is now available 2024-09-19T07:02:37.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:37 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:02:37.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:37 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T07:02:37.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:37 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T07:02:38.517 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:38 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:38.187+0000 7f6ab8d29640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:07:02:38] ENGINE Error in HTTPServer.serve 2024-09-19T07:02:38.518 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:38 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: Traceback (most recent call last): 2024-09-19T07:02:38.518 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:38 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T07:02:38.518 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:38 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: self._connections.run(self.expiration_interval) 2024-09-19T07:02:38.518 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:38 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T07:02:38.518 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:38 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: self._run(expiration_interval) 2024-09-19T07:02:38.518 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:38 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T07:02:38.518 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:38 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T07:02:38.518 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:38 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T07:02:38.518 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:38 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T07:02:38.518 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:38 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T07:02:38.518 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:38 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: s = self.context.wrap_socket( 2024-09-19T07:02:38.518 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:38 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T07:02:38.519 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:38 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: return self.sslsocket_class._create( 2024-09-19T07:02:38.519 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:38 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T07:02:38.519 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:38 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: self.do_handshake() 2024-09-19T07:02:38.519 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:38 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T07:02:38.519 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:38 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: self._sslobj.do_handshake() 2024-09-19T07:02:38.519 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:38 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T07:02:38.519 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:02:38 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:02:38.778 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout { 2024-09-19T07:02:38.778 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-19T07:02:38.778 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T07:02:38.778 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout } 2024-09-19T07:02:38.778 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:34.349+0000 7f3125f5d640 1 Processor -- start 2024-09-19T07:02:38.779 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:34.349+0000 7f3125f5d640 1 -- start start 2024-09-19T07:02:38.779 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:34.349+0000 7f3125f5d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31201066f0 0x7f3120106af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:38.779 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:34.349+0000 7f3125f5d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f31201070c0 con 0x7f31201066f0 2024-09-19T07:02:38.779 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:34.349+0000 7f311f7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31201066f0 0x7f3120106af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:38.779 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:34.349+0000 7f311f7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31201066f0 0x7f3120106af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51926/0 (socket says 172.21.15.148:51926) 2024-09-19T07:02:38.779 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:34.349+0000 7f311f7fe640 1 -- 172.21.15.148:0/1170581573 learned_addr learned my addr 172.21.15.148:0/1170581573 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:02:38.779 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:34.349+0000 7f311f7fe640 1 -- 172.21.15.148:0/1170581573 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31201078f0 con 0x7f31201066f0 2024-09-19T07:02:38.779 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:34.350+0000 7f311f7fe640 1 --2- 172.21.15.148:0/1170581573 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31201066f0 0x7f3120106af0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3110009820 tx=0x7f311002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21b1fe29528318b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:38.779 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:34.350+0000 7f311effd640 1 -- 172.21.15.148:0/1170581573 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3110037070 con 0x7f31201066f0 2024-09-19T07:02:38.780 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:34.350+0000 7f311effd640 1 -- 172.21.15.148:0/1170581573 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3110032920 con 0x7f31201066f0 2024-09-19T07:02:38.780 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:34.350+0000 7f311effd640 1 -- 172.21.15.148:0/1170581573 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3110030810 con 0x7f31201066f0 2024-09-19T07:02:38.780 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:34.351+0000 7f3125f5d640 1 -- 172.21.15.148:0/1170581573 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31201066f0 msgr2=0x7f3120106af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:38.780 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:34.351+0000 7f3125f5d640 1 --2- 172.21.15.148:0/1170581573 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31201066f0 0x7f3120106af0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3110009820 tx=0x7f311002a270 comp rx=0 tx=0).stop 2024-09-19T07:02:38.780 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:34.351+0000 7f3125f5d640 1 -- 172.21.15.148:0/1170581573 shutdown_connections 2024-09-19T07:02:38.780 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:34.351+0000 7f3125f5d640 1 --2- 172.21.15.148:0/1170581573 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31201066f0 0x7f3120106af0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:38.780 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:34.351+0000 7f3125f5d640 1 -- 172.21.15.148:0/1170581573 >> 172.21.15.148:0/1170581573 conn(0x7f3120101e80 msgr2=0x7f31201042c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:38.780 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:34.351+0000 7f3125f5d640 1 -- 172.21.15.148:0/1170581573 shutdown_connections 2024-09-19T07:02:38.780 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:34.351+0000 7f3125f5d640 1 -- 172.21.15.148:0/1170581573 wait complete. 2024-09-19T07:02:38.780 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:34.352+0000 7f3125f5d640 1 Processor -- start 2024-09-19T07:02:38.780 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:34.352+0000 7f3125f5d640 1 -- start start 2024-09-19T07:02:38.780 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:34.352+0000 7f3125f5d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31201066f0 0x7f312019b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:38.781 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:34.352+0000 7f3125f5d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f312010aca0 con 0x7f31201066f0 2024-09-19T07:02:38.781 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:34.352+0000 7f311f7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31201066f0 0x7f312019b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:38.781 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:34.352+0000 7f311f7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31201066f0 0x7f312019b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51934/0 (socket says 172.21.15.148:51934) 2024-09-19T07:02:38.781 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:34.352+0000 7f311f7fe640 1 -- 172.21.15.148:0/2289605384 learned_addr learned my addr 172.21.15.148:0/2289605384 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:02:38.781 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:34.352+0000 7f311f7fe640 1 -- 172.21.15.148:0/2289605384 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f312019bd50 con 0x7f31201066f0 2024-09-19T07:02:38.781 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:34.352+0000 7f311f7fe640 1 --2- 172.21.15.148:0/2289605384 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31201066f0 0x7f312019b810 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3110030560 tx=0x7f3110032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:38.781 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:34.353+0000 7f311d7fa640 1 -- 172.21.15.148:0/2289605384 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3110037040 con 0x7f31201066f0 2024-09-19T07:02:38.781 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:34.353+0000 7f311d7fa640 1 -- 172.21.15.148:0/2289605384 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3110040070 con 0x7f31201066f0 2024-09-19T07:02:38.781 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:34.353+0000 7f3125f5d640 1 -- 172.21.15.148:0/2289605384 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f312019bfe0 con 0x7f31201066f0 2024-09-19T07:02:38.781 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:34.353+0000 7f311d7fa640 1 -- 172.21.15.148:0/2289605384 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f311003a740 con 0x7f31201066f0 2024-09-19T07:02:38.782 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:34.353+0000 7f3125f5d640 1 -- 172.21.15.148:0/2289605384 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f312019ecd0 con 0x7f31201066f0 2024-09-19T07:02:38.782 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:34.354+0000 7f311d7fa640 1 -- 172.21.15.148:0/2289605384 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f311003bb90 con 0x7f31201066f0 2024-09-19T07:02:38.782 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:34.354+0000 7f311d7fa640 1 --2- 172.21.15.148:0/2289605384 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f310c039200 0x7f310c03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:38.782 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:34.354+0000 7f311d7fa640 1 -- 172.21.15.148:0/2289605384 --> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f310c03bdd0 con 0x7f310c039200 2024-09-19T07:02:38.782 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:34.354+0000 7f3117fff640 1 -- 172.21.15.148:0/2289605384 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f310c039200 msgr2=0x7f310c03b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:6800/1949849385 2024-09-19T07:02:38.782 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:34.354+0000 7f311d7fa640 1 -- 172.21.15.148:0/2289605384 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f311006c900 con 0x7f31201066f0 2024-09-19T07:02:38.782 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:34.354+0000 7f3117fff640 1 --2- 172.21.15.148:0/2289605384 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f310c039200 0x7f310c03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T07:02:38.782 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:34.555+0000 7f3117fff640 1 -- 172.21.15.148:0/2289605384 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f310c039200 msgr2=0x7f310c03b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:6800/1949849385 2024-09-19T07:02:38.782 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:34.555+0000 7f3117fff640 1 --2- 172.21.15.148:0/2289605384 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f310c039200 0x7f310c03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T07:02:38.782 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:34.956+0000 7f3117fff640 1 -- 172.21.15.148:0/2289605384 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f310c039200 msgr2=0x7f310c03b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:6800/1949849385 2024-09-19T07:02:38.782 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:34.956+0000 7f3117fff640 1 --2- 172.21.15.148:0/2289605384 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f310c039200 0x7f310c03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T07:02:38.782 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:35.757+0000 7f3117fff640 1 -- 172.21.15.148:0/2289605384 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f310c039200 msgr2=0x7f310c03b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:6800/1949849385 2024-09-19T07:02:38.783 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:35.757+0000 7f3117fff640 1 --2- 172.21.15.148:0/2289605384 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f310c039200 0x7f310c03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T07:02:38.783 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:37.008+0000 7f311d7fa640 1 -- 172.21.15.148:0/2289605384 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mgrmap(e 10) ==== 46241+0+0 (secure 0 0 0) 0x7f311006b3b0 con 0x7f31201066f0 2024-09-19T07:02:38.783 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:37.008+0000 7f311d7fa640 1 -- 172.21.15.148:0/2289605384 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f310c039200 msgr2=0x7f310c03b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T07:02:38.783 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:37.008+0000 7f311d7fa640 1 --2- 172.21.15.148:0/2289605384 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f310c039200 0x7f310c03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:38.783 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:38.010+0000 7f311d7fa640 1 -- 172.21.15.148:0/2289605384 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7f311003ad30 con 0x7f31201066f0 2024-09-19T07:02:38.783 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:38.010+0000 7f311d7fa640 1 --2- 172.21.15.148:0/2289605384 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f310c03ccc0 0x7f310c03f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:38.783 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:38.010+0000 7f311d7fa640 1 -- 172.21.15.148:0/2289605384 --> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f311003de70 con 0x7f310c03ccc0 2024-09-19T07:02:38.783 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:38.010+0000 7f3117fff640 1 --2- 172.21.15.148:0/2289605384 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f310c03ccc0 0x7f310c03f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:38.783 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:38.011+0000 7f3117fff640 1 --2- 172.21.15.148:0/2289605384 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f310c03ccc0 0x7f310c03f0b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f3108003980 tx=0x7f3108006e10 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:38.784 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:38.012+0000 7f311d7fa640 1 -- 172.21.15.148:0/2289605384 <== mgr.14148 v2:172.21.15.148:6800/3007822654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f311003de70 con 0x7f310c03ccc0 2024-09-19T07:02:38.784 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:38.018+0000 7f3125f5d640 1 -- 172.21.15.148:0/2289605384 --> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f3120106b70 con 0x7f310c03ccc0 2024-09-19T07:02:38.784 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:38.019+0000 7f311d7fa640 1 -- 172.21.15.148:0/2289605384 <== mgr.14148 v2:172.21.15.148:6800/3007822654 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f3120106b70 con 0x7f310c03ccc0 2024-09-19T07:02:38.784 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:38.019+0000 7f3125f5d640 1 -- 172.21.15.148:0/2289605384 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f310c03ccc0 msgr2=0x7f310c03f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:38.784 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:38.019+0000 7f3125f5d640 1 --2- 172.21.15.148:0/2289605384 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f310c03ccc0 0x7f310c03f0b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f3108003980 tx=0x7f3108006e10 comp rx=0 tx=0).stop 2024-09-19T07:02:38.784 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:38.019+0000 7f3125f5d640 1 -- 172.21.15.148:0/2289605384 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31201066f0 msgr2=0x7f312019b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:38.784 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:38.019+0000 7f3125f5d640 1 --2- 172.21.15.148:0/2289605384 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31201066f0 0x7f312019b810 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3110030560 tx=0x7f3110032670 comp rx=0 tx=0).stop 2024-09-19T07:02:38.784 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:38.019+0000 7f3125f5d640 1 -- 172.21.15.148:0/2289605384 shutdown_connections 2024-09-19T07:02:38.784 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:38.019+0000 7f3125f5d640 1 --2- 172.21.15.148:0/2289605384 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f310c03ccc0 0x7f310c03f0b0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:38.784 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:38.019+0000 7f3125f5d640 1 --2- 172.21.15.148:0/2289605384 >> [v2:172.21.15.148:6800/1949849385,v1:172.21.15.148:6801/1949849385] conn(0x7f310c039200 0x7f310c03b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:38.785 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:38.019+0000 7f3125f5d640 1 --2- 172.21.15.148:0/2289605384 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31201066f0 0x7f312019b810 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:38.785 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:38.019+0000 7f3125f5d640 1 -- 172.21.15.148:0/2289605384 >> 172.21.15.148:0/2289605384 conn(0x7f3120101e80 msgr2=0x7f3120102df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:38.785 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:38.019+0000 7f3125f5d640 1 -- 172.21.15.148:0/2289605384 shutdown_connections 2024-09-19T07:02:38.785 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:38.019+0000 7f3125f5d640 1 -- 172.21.15.148:0/2289605384 wait complete. 2024-09-19T07:02:38.785 INFO:teuthology.orchestra.run.smithi148.stdout:mgr epoch 9 is available 2024-09-19T07:02:38.785 INFO:teuthology.orchestra.run.smithi148.stdout:Generating a dashboard self-signed certificate... 2024-09-19T07:02:39.022 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:39 smithi148 ceph-mon[31180]: mgrmap e11: x(active, since 1.00626s) 2024-09-19T07:02:39.022 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:39 smithi148 ceph-mon[31180]: [19/Sep/2024:07:02:38] ENGINE Bus STARTING 2024-09-19T07:02:39.022 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:39 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:02:40.031 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-19T07:02:40.031 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.222+0000 7f38be536640 1 Processor -- start 2024-09-19T07:02:40.031 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.222+0000 7f38be536640 1 -- start start 2024-09-19T07:02:40.031 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.223+0000 7f38be536640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38b81060b0 0x7f38b81064b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:40.031 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.223+0000 7f38be536640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f38b807bdb0 con 0x7f38b81060b0 2024-09-19T07:02:40.031 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.223+0000 7f38b7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38b81060b0 0x7f38b81064b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:40.031 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.223+0000 7f38b7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38b81060b0 0x7f38b81064b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52008/0 (socket says 172.21.15.148:52008) 2024-09-19T07:02:40.031 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.223+0000 7f38b7fff640 1 -- 172.21.15.148:0/1517333610 learned_addr learned my addr 172.21.15.148:0/1517333610 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:02:40.031 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.223+0000 7f38b7fff640 1 -- 172.21.15.148:0/1517333610 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b81069f0 con 0x7f38b81060b0 2024-09-19T07:02:40.031 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.224+0000 7f38b7fff640 1 --2- 172.21.15.148:0/1517333610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38b81060b0 0x7f38b81064b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f38a8009820 tx=0x7f38a802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eefe8cfb57e2ab3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:40.031 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.224+0000 7f38b6ffd640 1 -- 172.21.15.148:0/1517333610 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38a8037070 con 0x7f38b81060b0 2024-09-19T07:02:40.031 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.224+0000 7f38b6ffd640 1 -- 172.21.15.148:0/1517333610 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38a8032920 con 0x7f38b81060b0 2024-09-19T07:02:40.032 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.224+0000 7f38b6ffd640 1 -- 172.21.15.148:0/1517333610 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38a8030810 con 0x7f38b81060b0 2024-09-19T07:02:40.032 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.224+0000 7f38be536640 1 -- 172.21.15.148:0/1517333610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38b81060b0 msgr2=0x7f38b81064b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:40.032 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.224+0000 7f38be536640 1 --2- 172.21.15.148:0/1517333610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38b81060b0 0x7f38b81064b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f38a8009820 tx=0x7f38a802a270 comp rx=0 tx=0).stop 2024-09-19T07:02:40.032 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.225+0000 7f38be536640 1 -- 172.21.15.148:0/1517333610 shutdown_connections 2024-09-19T07:02:40.032 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.225+0000 7f38be536640 1 --2- 172.21.15.148:0/1517333610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38b81060b0 0x7f38b81064b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:40.032 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.225+0000 7f38be536640 1 -- 172.21.15.148:0/1517333610 >> 172.21.15.148:0/1517333610 conn(0x7f38b8101e60 msgr2=0x7f38b81042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:40.032 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.225+0000 7f38be536640 1 -- 172.21.15.148:0/1517333610 shutdown_connections 2024-09-19T07:02:40.032 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.225+0000 7f38be536640 1 -- 172.21.15.148:0/1517333610 wait complete. 2024-09-19T07:02:40.032 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.225+0000 7f38be536640 1 Processor -- start 2024-09-19T07:02:40.032 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.225+0000 7f38be536640 1 -- start start 2024-09-19T07:02:40.032 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.226+0000 7f38be536640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38b81060b0 0x7f38b819d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:40.032 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.226+0000 7f38be536640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f38b8107ac0 con 0x7f38b81060b0 2024-09-19T07:02:40.032 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.226+0000 7f38b7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38b81060b0 0x7f38b819d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:40.033 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.226+0000 7f38b7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38b81060b0 0x7f38b819d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52022/0 (socket says 172.21.15.148:52022) 2024-09-19T07:02:40.033 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.226+0000 7f38b7fff640 1 -- 172.21.15.148:0/3758509242 learned_addr learned my addr 172.21.15.148:0/3758509242 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:02:40.033 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.226+0000 7f38b7fff640 1 -- 172.21.15.148:0/3758509242 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b819deb0 con 0x7f38b81060b0 2024-09-19T07:02:40.033 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.226+0000 7f38b7fff640 1 --2- 172.21.15.148:0/3758509242 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38b81060b0 0x7f38b819d970 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f38a8030380 tx=0x7f38a8032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:40.033 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.226+0000 7f38b57fa640 1 -- 172.21.15.148:0/3758509242 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38a8037040 con 0x7f38b81060b0 2024-09-19T07:02:40.033 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.226+0000 7f38b57fa640 1 -- 172.21.15.148:0/3758509242 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38a8040070 con 0x7f38b81060b0 2024-09-19T07:02:40.033 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.226+0000 7f38be536640 1 -- 172.21.15.148:0/3758509242 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38b819e140 con 0x7f38b81060b0 2024-09-19T07:02:40.033 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.226+0000 7f38b57fa640 1 -- 172.21.15.148:0/3758509242 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38a803a7b0 con 0x7f38b81060b0 2024-09-19T07:02:40.033 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.226+0000 7f38be536640 1 -- 172.21.15.148:0/3758509242 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38b81a0e30 con 0x7f38b81060b0 2024-09-19T07:02:40.033 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.227+0000 7f38b57fa640 1 -- 172.21.15.148:0/3758509242 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7f38a803aa30 con 0x7f38b81060b0 2024-09-19T07:02:40.033 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.227+0000 7f38b57fa640 1 --2- 172.21.15.148:0/3758509242 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f38a40390f0 0x7f38a403b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:40.033 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.227+0000 7f38be536640 1 -- 172.21.15.148:0/3758509242 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38b81064b0 con 0x7f38b81060b0 2024-09-19T07:02:40.033 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.227+0000 7f38b57fa640 1 -- 172.21.15.148:0/3758509242 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f38a806c810 con 0x7f38b81060b0 2024-09-19T07:02:40.034 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.228+0000 7f38b77fe640 1 --2- 172.21.15.148:0/3758509242 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f38a40390f0 0x7f38a403b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:40.034 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.228+0000 7f38b77fe640 1 --2- 172.21.15.148:0/3758509242 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f38a40390f0 0x7f38a403b5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f38a00098c0 tx=0x7f38a0006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:40.034 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.232+0000 7f38b57fa640 1 -- 172.21.15.148:0/3758509242 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f38a804a200 con 0x7f38b81060b0 2024-09-19T07:02:40.034 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.433+0000 7f38be536640 1 -- 172.21.15.148:0/3758509242 --> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f38b802d9f0 con 0x7f38a40390f0 2024-09-19T07:02:40.034 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.474+0000 7f38b57fa640 1 -- 172.21.15.148:0/3758509242 <== mgr.14148 v2:172.21.15.148:6800/3007822654 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f38b802d9f0 con 0x7f38a40390f0 2024-09-19T07:02:40.034 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.476+0000 7f38be536640 1 -- 172.21.15.148:0/3758509242 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f38a40390f0 msgr2=0x7f38a403b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:40.034 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.476+0000 7f38be536640 1 --2- 172.21.15.148:0/3758509242 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f38a40390f0 0x7f38a403b5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f38a00098c0 tx=0x7f38a0006db0 comp rx=0 tx=0).stop 2024-09-19T07:02:40.034 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.477+0000 7f38be536640 1 -- 172.21.15.148:0/3758509242 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38b81060b0 msgr2=0x7f38b819d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:40.034 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.477+0000 7f38be536640 1 --2- 172.21.15.148:0/3758509242 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38b81060b0 0x7f38b819d970 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f38a8030380 tx=0x7f38a8032670 comp rx=0 tx=0).stop 2024-09-19T07:02:40.034 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.477+0000 7f38be536640 1 -- 172.21.15.148:0/3758509242 shutdown_connections 2024-09-19T07:02:40.034 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.477+0000 7f38be536640 1 --2- 172.21.15.148:0/3758509242 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f38a40390f0 0x7f38a403b5b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:40.034 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.477+0000 7f38be536640 1 --2- 172.21.15.148:0/3758509242 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38b81060b0 0x7f38b819d970 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:40.034 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.477+0000 7f38be536640 1 -- 172.21.15.148:0/3758509242 >> 172.21.15.148:0/3758509242 conn(0x7f38b8101e60 msgr2=0x7f38b8194610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:40.035 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.477+0000 7f38be536640 1 -- 172.21.15.148:0/3758509242 shutdown_connections 2024-09-19T07:02:40.035 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:39.477+0000 7f38be536640 1 -- 172.21.15.148:0/3758509242 wait complete. 2024-09-19T07:02:40.035 INFO:teuthology.orchestra.run.smithi148.stdout:Creating initial admin user... 2024-09-19T07:02:40.231 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:40 smithi148 ceph-mon[31180]: [19/Sep/2024:07:02:38] ENGINE Serving on https://172.21.15.148:7150 2024-09-19T07:02:40.231 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:40 smithi148 ceph-mon[31180]: [19/Sep/2024:07:02:38] ENGINE Error in HTTPServer.serve 2024-09-19T07:02:40.231 INFO:journalctl@ceph.mon.a.smithi148.stdout: Traceback (most recent call last): 2024-09-19T07:02:40.231 INFO:journalctl@ceph.mon.a.smithi148.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T07:02:40.231 INFO:journalctl@ceph.mon.a.smithi148.stdout: self._connections.run(self.expiration_interval) 2024-09-19T07:02:40.231 INFO:journalctl@ceph.mon.a.smithi148.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T07:02:40.232 INFO:journalctl@ceph.mon.a.smithi148.stdout: self._run(expiration_interval) 2024-09-19T07:02:40.232 INFO:journalctl@ceph.mon.a.smithi148.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T07:02:40.232 INFO:journalctl@ceph.mon.a.smithi148.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T07:02:40.232 INFO:journalctl@ceph.mon.a.smithi148.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T07:02:40.232 INFO:journalctl@ceph.mon.a.smithi148.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T07:02:40.232 INFO:journalctl@ceph.mon.a.smithi148.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T07:02:40.232 INFO:journalctl@ceph.mon.a.smithi148.stdout: s = self.context.wrap_socket( 2024-09-19T07:02:40.232 INFO:journalctl@ceph.mon.a.smithi148.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T07:02:40.232 INFO:journalctl@ceph.mon.a.smithi148.stdout: return self.sslsocket_class._create( 2024-09-19T07:02:40.232 INFO:journalctl@ceph.mon.a.smithi148.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T07:02:40.232 INFO:journalctl@ceph.mon.a.smithi148.stdout: self.do_handshake() 2024-09-19T07:02:40.232 INFO:journalctl@ceph.mon.a.smithi148.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T07:02:40.232 INFO:journalctl@ceph.mon.a.smithi148.stdout: self._sslobj.do_handshake() 2024-09-19T07:02:40.232 INFO:journalctl@ceph.mon.a.smithi148.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T07:02:40.233 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:40 smithi148 ceph-mon[31180]: [19/Sep/2024:07:02:38] ENGINE Serving on http://172.21.15.148:8765 2024-09-19T07:02:40.233 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:40 smithi148 ceph-mon[31180]: [19/Sep/2024:07:02:38] ENGINE Bus STARTED 2024-09-19T07:02:40.233 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:40 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:02:40.233 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:40 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:02:40.233 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:40 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:02:40.233 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:40 smithi148 ceph-mon[31180]: mgrmap e12: x(active, since 2s) 2024-09-19T07:02:41.266 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:41 smithi148 ceph-mon[31180]: from='client.14160 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:02:41.267 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:41 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:02:42.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:42 smithi148 ceph-mon[31180]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:02:42.212 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$WZw/qeRSDKpBxBjza3x8.eKsxrJhW6ju522IsoQAD9qiALlEj1fhG", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726729360, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-19T07:02:42.212 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.400+0000 7fdd6671d640 1 Processor -- start 2024-09-19T07:02:42.212 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.400+0000 7fdd6671d640 1 -- start start 2024-09-19T07:02:42.212 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.400+0000 7fdd6671d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd601066d0 0x7fdd60106ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:42.212 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.400+0000 7fdd6671d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdd601070a0 con 0x7fdd601066d0 2024-09-19T07:02:42.213 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.400+0000 7fdd5ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd601066d0 0x7fdd60106ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:42.213 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.400+0000 7fdd5ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd601066d0 0x7fdd60106ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52028/0 (socket says 172.21.15.148:52028) 2024-09-19T07:02:42.213 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.400+0000 7fdd5ffff640 1 -- 172.21.15.148:0/1505529873 learned_addr learned my addr 172.21.15.148:0/1505529873 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:02:42.213 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.400+0000 7fdd5ffff640 1 -- 172.21.15.148:0/1505529873 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd601078d0 con 0x7fdd601066d0 2024-09-19T07:02:42.213 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.401+0000 7fdd5ffff640 1 --2- 172.21.15.148:0/1505529873 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd601066d0 0x7fdd60106ad0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdd50009820 tx=0x7fdd5002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95698655b0413baa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:42.213 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.401+0000 7fdd5f7fe640 1 -- 172.21.15.148:0/1505529873 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd50037070 con 0x7fdd601066d0 2024-09-19T07:02:42.213 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.401+0000 7fdd5f7fe640 1 -- 172.21.15.148:0/1505529873 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd50032920 con 0x7fdd601066d0 2024-09-19T07:02:42.213 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.401+0000 7fdd5f7fe640 1 -- 172.21.15.148:0/1505529873 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd50030810 con 0x7fdd601066d0 2024-09-19T07:02:42.213 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.402+0000 7fdd6671d640 1 -- 172.21.15.148:0/1505529873 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd601066d0 msgr2=0x7fdd60106ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:42.213 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.402+0000 7fdd6671d640 1 --2- 172.21.15.148:0/1505529873 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd601066d0 0x7fdd60106ad0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdd50009820 tx=0x7fdd5002a270 comp rx=0 tx=0).stop 2024-09-19T07:02:42.213 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.402+0000 7fdd6671d640 1 -- 172.21.15.148:0/1505529873 shutdown_connections 2024-09-19T07:02:42.213 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.402+0000 7fdd6671d640 1 --2- 172.21.15.148:0/1505529873 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd601066d0 0x7fdd60106ad0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:42.213 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.402+0000 7fdd6671d640 1 -- 172.21.15.148:0/1505529873 >> 172.21.15.148:0/1505529873 conn(0x7fdd60101e60 msgr2=0x7fdd601042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:42.214 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.402+0000 7fdd6671d640 1 -- 172.21.15.148:0/1505529873 shutdown_connections 2024-09-19T07:02:42.214 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.402+0000 7fdd6671d640 1 -- 172.21.15.148:0/1505529873 wait complete. 2024-09-19T07:02:42.214 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.403+0000 7fdd6671d640 1 Processor -- start 2024-09-19T07:02:42.214 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.403+0000 7fdd6671d640 1 -- start start 2024-09-19T07:02:42.214 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.403+0000 7fdd6671d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd601066d0 0x7fdd6019a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:42.214 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.403+0000 7fdd6671d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdd6010ac80 con 0x7fdd601066d0 2024-09-19T07:02:42.214 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.403+0000 7fdd5ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd601066d0 0x7fdd6019a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:42.214 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.403+0000 7fdd5ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd601066d0 0x7fdd6019a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52040/0 (socket says 172.21.15.148:52040) 2024-09-19T07:02:42.214 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.403+0000 7fdd5ffff640 1 -- 172.21.15.148:0/1016136007 learned_addr learned my addr 172.21.15.148:0/1016136007 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:02:42.214 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.403+0000 7fdd5ffff640 1 -- 172.21.15.148:0/1016136007 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd6019ac10 con 0x7fdd601066d0 2024-09-19T07:02:42.214 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.403+0000 7fdd5ffff640 1 --2- 172.21.15.148:0/1016136007 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd601066d0 0x7fdd6019a6d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdd50030560 tx=0x7fdd50032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:42.214 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.403+0000 7fdd5dffb640 1 -- 172.21.15.148:0/1016136007 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd50037040 con 0x7fdd601066d0 2024-09-19T07:02:42.215 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.403+0000 7fdd6671d640 1 -- 172.21.15.148:0/1016136007 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd6019aea0 con 0x7fdd601066d0 2024-09-19T07:02:42.215 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.403+0000 7fdd5dffb640 1 -- 172.21.15.148:0/1016136007 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd50040070 con 0x7fdd601066d0 2024-09-19T07:02:42.215 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.404+0000 7fdd5dffb640 1 -- 172.21.15.148:0/1016136007 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd5003a740 con 0x7fdd601066d0 2024-09-19T07:02:42.215 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.404+0000 7fdd6671d640 1 -- 172.21.15.148:0/1016136007 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd6019db90 con 0x7fdd601066d0 2024-09-19T07:02:42.215 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.404+0000 7fdd5dffb640 1 -- 172.21.15.148:0/1016136007 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7fdd5003a9b0 con 0x7fdd601066d0 2024-09-19T07:02:42.215 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.404+0000 7fdd5dffb640 1 --2- 172.21.15.148:0/1016136007 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fdd4c039200 0x7fdd4c03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:42.215 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.405+0000 7fdd5dffb640 1 -- 172.21.15.148:0/1016136007 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fdd5006c9f0 con 0x7fdd601066d0 2024-09-19T07:02:42.215 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.405+0000 7fdd6671d640 1 -- 172.21.15.148:0/1016136007 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd60106b50 con 0x7fdd601066d0 2024-09-19T07:02:42.215 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.405+0000 7fdd57fff640 1 --2- 172.21.15.148:0/1016136007 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fdd4c039200 0x7fdd4c03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:42.215 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.405+0000 7fdd57fff640 1 --2- 172.21.15.148:0/1016136007 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fdd4c039200 0x7fdd4c03b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdd480098c0 tx=0x7fdd48006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:42.215 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.409+0000 7fdd5dffb640 1 -- 172.21.15.148:0/1016136007 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdd50042e30 con 0x7fdd601066d0 2024-09-19T07:02:42.215 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.602+0000 7fdd6671d640 1 -- 172.21.15.148:0/1016136007 --> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7fdd601031c0 con 0x7fdd4c039200 2024-09-19T07:02:42.215 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.825+0000 7fdd5dffb640 1 -- 172.21.15.148:0/1016136007 <== mgr.14148 v2:172.21.15.148:6800/3007822654 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7fdd601031c0 con 0x7fdd4c039200 2024-09-19T07:02:42.215 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.827+0000 7fdd6671d640 1 -- 172.21.15.148:0/1016136007 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fdd4c039200 msgr2=0x7fdd4c03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:42.216 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.827+0000 7fdd6671d640 1 --2- 172.21.15.148:0/1016136007 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fdd4c039200 0x7fdd4c03b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdd480098c0 tx=0x7fdd48006db0 comp rx=0 tx=0).stop 2024-09-19T07:02:42.216 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.827+0000 7fdd6671d640 1 -- 172.21.15.148:0/1016136007 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd601066d0 msgr2=0x7fdd6019a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:42.216 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.827+0000 7fdd6671d640 1 --2- 172.21.15.148:0/1016136007 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd601066d0 0x7fdd6019a6d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdd50030560 tx=0x7fdd50032670 comp rx=0 tx=0).stop 2024-09-19T07:02:42.216 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.827+0000 7fdd6671d640 1 -- 172.21.15.148:0/1016136007 shutdown_connections 2024-09-19T07:02:42.216 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.827+0000 7fdd6671d640 1 --2- 172.21.15.148:0/1016136007 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fdd4c039200 0x7fdd4c03b6c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:42.216 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.827+0000 7fdd6671d640 1 --2- 172.21.15.148:0/1016136007 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd601066d0 0x7fdd6019a6d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:42.216 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.827+0000 7fdd6671d640 1 -- 172.21.15.148:0/1016136007 >> 172.21.15.148:0/1016136007 conn(0x7fdd60101e60 msgr2=0x7fdd60102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:42.216 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.827+0000 7fdd6671d640 1 -- 172.21.15.148:0/1016136007 shutdown_connections 2024-09-19T07:02:42.216 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:40.827+0000 7fdd6671d640 1 -- 172.21.15.148:0/1016136007 wait complete. 2024-09-19T07:02:42.216 INFO:teuthology.orchestra.run.smithi148.stdout:Fetching dashboard port number... 2024-09-19T07:02:43.142 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:43 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/3240126884' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-19T07:02:43.358 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout 8443 2024-09-19T07:02:43.359 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.659+0000 7efc54211640 1 Processor -- start 2024-09-19T07:02:43.359 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.659+0000 7efc54211640 1 -- start start 2024-09-19T07:02:43.359 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.659+0000 7efc54211640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc4c107cf0 0x7efc4c1080f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:43.359 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.659+0000 7efc54211640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7efc4c1086c0 con 0x7efc4c107cf0 2024-09-19T07:02:43.359 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.660+0000 7efc51fad640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc4c107cf0 0x7efc4c1080f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:43.359 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.660+0000 7efc51fad640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc4c107cf0 0x7efc4c1080f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52046/0 (socket says 172.21.15.148:52046) 2024-09-19T07:02:43.359 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.660+0000 7efc51fad640 1 -- 172.21.15.148:0/103915171 learned_addr learned my addr 172.21.15.148:0/103915171 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:02:43.359 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.660+0000 7efc51fad640 1 -- 172.21.15.148:0/103915171 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc4c1069a0 con 0x7efc4c107cf0 2024-09-19T07:02:43.359 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.661+0000 7efc51fad640 1 --2- 172.21.15.148:0/103915171 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc4c107cf0 0x7efc4c1080f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efc48009820 tx=0x7efc4802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=562901426380c3b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:43.359 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.661+0000 7efc50fab640 1 -- 172.21.15.148:0/103915171 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc48037070 con 0x7efc4c107cf0 2024-09-19T07:02:43.359 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.661+0000 7efc50fab640 1 -- 172.21.15.148:0/103915171 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc48032920 con 0x7efc4c107cf0 2024-09-19T07:02:43.360 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.661+0000 7efc50fab640 1 -- 172.21.15.148:0/103915171 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc48030810 con 0x7efc4c107cf0 2024-09-19T07:02:43.360 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.661+0000 7efc54211640 1 -- 172.21.15.148:0/103915171 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc4c107cf0 msgr2=0x7efc4c1080f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:43.360 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.661+0000 7efc54211640 1 --2- 172.21.15.148:0/103915171 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc4c107cf0 0x7efc4c1080f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efc48009820 tx=0x7efc4802a270 comp rx=0 tx=0).stop 2024-09-19T07:02:43.360 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.661+0000 7efc54211640 1 -- 172.21.15.148:0/103915171 shutdown_connections 2024-09-19T07:02:43.360 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.661+0000 7efc54211640 1 --2- 172.21.15.148:0/103915171 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc4c107cf0 0x7efc4c1080f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:43.360 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.661+0000 7efc54211640 1 -- 172.21.15.148:0/103915171 >> 172.21.15.148:0/103915171 conn(0x7efc4c101600 msgr2=0x7efc4c103a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:43.360 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.662+0000 7efc54211640 1 -- 172.21.15.148:0/103915171 shutdown_connections 2024-09-19T07:02:43.360 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.662+0000 7efc54211640 1 -- 172.21.15.148:0/103915171 wait complete. 2024-09-19T07:02:43.360 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.662+0000 7efc54211640 1 Processor -- start 2024-09-19T07:02:43.361 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.662+0000 7efc54211640 1 -- start start 2024-09-19T07:02:43.361 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.662+0000 7efc54211640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc4c107cf0 0x7efc4c106310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:43.361 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.662+0000 7efc54211640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7efc4c10abe0 con 0x7efc4c107cf0 2024-09-19T07:02:43.361 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.662+0000 7efc51fad640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc4c107cf0 0x7efc4c106310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:43.361 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.662+0000 7efc51fad640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc4c107cf0 0x7efc4c106310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52052/0 (socket says 172.21.15.148:52052) 2024-09-19T07:02:43.361 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.662+0000 7efc51fad640 1 -- 172.21.15.148:0/3240126884 learned_addr learned my addr 172.21.15.148:0/3240126884 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:02:43.361 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.663+0000 7efc51fad640 1 -- 172.21.15.148:0/3240126884 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc4c19e520 con 0x7efc4c107cf0 2024-09-19T07:02:43.361 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.663+0000 7efc51fad640 1 --2- 172.21.15.148:0/3240126884 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc4c107cf0 0x7efc4c106310 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efc48030560 tx=0x7efc48032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:43.361 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.663+0000 7efc42ffd640 1 -- 172.21.15.148:0/3240126884 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc48037040 con 0x7efc4c107cf0 2024-09-19T07:02:43.361 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.663+0000 7efc54211640 1 -- 172.21.15.148:0/3240126884 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc4c19e6f0 con 0x7efc4c107cf0 2024-09-19T07:02:43.362 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.663+0000 7efc42ffd640 1 -- 172.21.15.148:0/3240126884 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc48040070 con 0x7efc4c107cf0 2024-09-19T07:02:43.362 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.663+0000 7efc42ffd640 1 -- 172.21.15.148:0/3240126884 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc4803a740 con 0x7efc4c107cf0 2024-09-19T07:02:43.362 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.663+0000 7efc54211640 1 -- 172.21.15.148:0/3240126884 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc4c19ea90 con 0x7efc4c107cf0 2024-09-19T07:02:43.362 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.664+0000 7efc42ffd640 1 -- 172.21.15.148:0/3240126884 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7efc4803a9b0 con 0x7efc4c107cf0 2024-09-19T07:02:43.362 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.664+0000 7efc54211640 1 -- 172.21.15.148:0/3240126884 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc4c108170 con 0x7efc4c107cf0 2024-09-19T07:02:43.362 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.664+0000 7efc42ffd640 1 --2- 172.21.15.148:0/3240126884 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7efc38039200 0x7efc3803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:43.362 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.664+0000 7efc42ffd640 1 -- 172.21.15.148:0/3240126884 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7efc4806cb10 con 0x7efc4c107cf0 2024-09-19T07:02:43.362 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.664+0000 7efc517ac640 1 --2- 172.21.15.148:0/3240126884 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7efc38039200 0x7efc3803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:43.362 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.665+0000 7efc517ac640 1 --2- 172.21.15.148:0/3240126884 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7efc38039200 0x7efc3803b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7efc3c0098c0 tx=0x7efc3c006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:43.362 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.669+0000 7efc42ffd640 1 -- 172.21.15.148:0/3240126884 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7efc4803adf0 con 0x7efc4c107cf0 2024-09-19T07:02:43.362 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.839+0000 7efc54211640 1 -- 172.21.15.148:0/3240126884 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7efc4c19f320 con 0x7efc4c107cf0 2024-09-19T07:02:43.362 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.840+0000 7efc42ffd640 1 -- 172.21.15.148:0/3240126884 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7efc48032920 con 0x7efc4c107cf0 2024-09-19T07:02:43.363 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.842+0000 7efc54211640 1 -- 172.21.15.148:0/3240126884 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7efc38039200 msgr2=0x7efc3803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:43.363 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.842+0000 7efc54211640 1 --2- 172.21.15.148:0/3240126884 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7efc38039200 0x7efc3803b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7efc3c0098c0 tx=0x7efc3c006db0 comp rx=0 tx=0).stop 2024-09-19T07:02:43.363 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.842+0000 7efc54211640 1 -- 172.21.15.148:0/3240126884 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc4c107cf0 msgr2=0x7efc4c106310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:43.363 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.842+0000 7efc54211640 1 --2- 172.21.15.148:0/3240126884 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc4c107cf0 0x7efc4c106310 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efc48030560 tx=0x7efc48032670 comp rx=0 tx=0).stop 2024-09-19T07:02:43.363 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.842+0000 7efc54211640 1 -- 172.21.15.148:0/3240126884 shutdown_connections 2024-09-19T07:02:43.363 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.842+0000 7efc54211640 1 --2- 172.21.15.148:0/3240126884 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7efc38039200 0x7efc3803b6c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:43.363 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.842+0000 7efc54211640 1 --2- 172.21.15.148:0/3240126884 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc4c107cf0 0x7efc4c106310 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:43.363 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.842+0000 7efc54211640 1 -- 172.21.15.148:0/3240126884 >> 172.21.15.148:0/3240126884 conn(0x7efc4c101600 msgr2=0x7efc4c102170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:43.363 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.842+0000 7efc54211640 1 -- 172.21.15.148:0/3240126884 shutdown_connections 2024-09-19T07:02:43.363 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:42.842+0000 7efc54211640 1 -- 172.21.15.148:0/3240126884 wait complete. 2024-09-19T07:02:43.365 INFO:teuthology.orchestra.run.smithi148.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T07:02:43.365 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stdout disabled 2024-09-19T07:02:43.373 INFO:teuthology.orchestra.run.smithi148.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T07:02:43.373 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stdout inactive 2024-09-19T07:02:43.373 INFO:teuthology.orchestra.run.smithi148.stdout:firewalld.service is not enabled 2024-09-19T07:02:43.373 INFO:teuthology.orchestra.run.smithi148.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-19T07:02:43.375 INFO:teuthology.orchestra.run.smithi148.stdout:Ceph Dashboard is now available at: 2024-09-19T07:02:43.375 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:02:43.375 INFO:teuthology.orchestra.run.smithi148.stdout: URL: https://smithi148.front.sepia.ceph.com:8443/ 2024-09-19T07:02:43.375 INFO:teuthology.orchestra.run.smithi148.stdout: User: admin 2024-09-19T07:02:43.375 INFO:teuthology.orchestra.run.smithi148.stdout: Password: dd8rvp1zgm 2024-09-19T07:02:43.375 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:02:43.375 INFO:teuthology.orchestra.run.smithi148.stdout:Saving cluster configuration to /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/config directory 2024-09-19T07:02:44.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:44 smithi148 ceph-mon[31180]: mgrmap e13: x(active, since 6s) 2024-09-19T07:02:44.783 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:43.830+0000 7fd206f59640 1 Processor -- start 2024-09-19T07:02:44.783 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:43.830+0000 7fd206f59640 1 -- start start 2024-09-19T07:02:44.783 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:43.831+0000 7fd206f59640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd20007de20 0x7fd20007c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:44.783 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:43.831+0000 7fd206f59640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd20007c850 con 0x7fd20007de20 2024-09-19T07:02:44.783 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:43.831+0000 7fd204cf5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd20007de20 0x7fd20007c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:44.783 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:43.831+0000 7fd204cf5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd20007de20 0x7fd20007c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52056/0 (socket says 172.21.15.148:52056) 2024-09-19T07:02:44.783 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:43.831+0000 7fd204cf5640 1 -- 172.21.15.148:0/451023617 learned_addr learned my addr 172.21.15.148:0/451023617 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:02:44.784 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:43.831+0000 7fd204cf5640 1 -- 172.21.15.148:0/451023617 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd20007c9d0 con 0x7fd20007de20 2024-09-19T07:02:44.784 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:43.832+0000 7fd204cf5640 1 --2- 172.21.15.148:0/451023617 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd20007de20 0x7fd20007c280 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc009820 tx=0x7fd1fc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a685d6589f859c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:44.784 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:43.832+0000 7fd1f77fe640 1 -- 172.21.15.148:0/451023617 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1fc037070 con 0x7fd20007de20 2024-09-19T07:02:44.784 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:43.832+0000 7fd1f77fe640 1 -- 172.21.15.148:0/451023617 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1fc032920 con 0x7fd20007de20 2024-09-19T07:02:44.784 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:43.832+0000 7fd1f77fe640 1 -- 172.21.15.148:0/451023617 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1fc030810 con 0x7fd20007de20 2024-09-19T07:02:44.784 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:43.833+0000 7fd206f59640 1 -- 172.21.15.148:0/451023617 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd20007de20 msgr2=0x7fd20007c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:44.784 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:43.833+0000 7fd206f59640 1 --2- 172.21.15.148:0/451023617 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd20007de20 0x7fd20007c280 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc009820 tx=0x7fd1fc02a270 comp rx=0 tx=0).stop 2024-09-19T07:02:44.784 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:43.833+0000 7fd206f59640 1 -- 172.21.15.148:0/451023617 shutdown_connections 2024-09-19T07:02:44.784 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:43.833+0000 7fd206f59640 1 --2- 172.21.15.148:0/451023617 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd20007de20 0x7fd20007c280 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:44.784 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:43.833+0000 7fd206f59640 1 -- 172.21.15.148:0/451023617 >> 172.21.15.148:0/451023617 conn(0x7fd200102f60 msgr2=0x7fd2001053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:44.784 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:43.833+0000 7fd206f59640 1 -- 172.21.15.148:0/451023617 shutdown_connections 2024-09-19T07:02:44.784 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:43.833+0000 7fd206f59640 1 -- 172.21.15.148:0/451023617 wait complete. 2024-09-19T07:02:44.785 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:43.833+0000 7fd206f59640 1 Processor -- start 2024-09-19T07:02:44.785 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:43.833+0000 7fd206f59640 1 -- start start 2024-09-19T07:02:44.785 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:43.834+0000 7fd206f59640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd20007de20 0x7fd20019d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:44.785 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:43.834+0000 7fd206f59640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd20010de30 con 0x7fd20007de20 2024-09-19T07:02:44.785 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:43.834+0000 7fd204cf5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd20007de20 0x7fd20019d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:44.785 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:43.834+0000 7fd204cf5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd20007de20 0x7fd20019d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52060/0 (socket says 172.21.15.148:52060) 2024-09-19T07:02:44.785 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:43.834+0000 7fd204cf5640 1 -- 172.21.15.148:0/3619044551 learned_addr learned my addr 172.21.15.148:0/3619044551 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:02:44.785 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:43.834+0000 7fd204cf5640 1 -- 172.21.15.148:0/3619044551 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd20019df30 con 0x7fd20007de20 2024-09-19T07:02:44.785 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:43.834+0000 7fd204cf5640 1 --2- 172.21.15.148:0/3619044551 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd20007de20 0x7fd20019d9f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc0097f0 tx=0x7fd1fc0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:44.785 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:43.834+0000 7fd1f5ffb640 1 -- 172.21.15.148:0/3619044551 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1fc037040 con 0x7fd20007de20 2024-09-19T07:02:44.786 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:43.834+0000 7fd1f5ffb640 1 -- 172.21.15.148:0/3619044551 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1fc030cc0 con 0x7fd20007de20 2024-09-19T07:02:44.786 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:43.834+0000 7fd206f59640 1 -- 172.21.15.148:0/3619044551 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd20019e1c0 con 0x7fd20007de20 2024-09-19T07:02:44.786 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:43.834+0000 7fd1f5ffb640 1 -- 172.21.15.148:0/3619044551 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1fc03a6b0 con 0x7fd20007de20 2024-09-19T07:02:44.786 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:43.834+0000 7fd206f59640 1 -- 172.21.15.148:0/3619044551 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2001a0eb0 con 0x7fd20007de20 2024-09-19T07:02:44.786 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:43.835+0000 7fd1f5ffb640 1 -- 172.21.15.148:0/3619044551 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7fd1fc03a8a0 con 0x7fd20007de20 2024-09-19T07:02:44.786 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:43.835+0000 7fd206f59640 1 -- 172.21.15.148:0/3619044551 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd20007c300 con 0x7fd20007de20 2024-09-19T07:02:44.786 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:43.835+0000 7fd1f5ffb640 1 --2- 172.21.15.148:0/3619044551 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fd1e80392a0 0x7fd1e803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:44.786 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:43.836+0000 7fd1f5ffb640 1 -- 172.21.15.148:0/3619044551 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd1fc06cc20 con 0x7fd20007de20 2024-09-19T07:02:44.786 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:43.836+0000 7fd1f7fff640 1 --2- 172.21.15.148:0/3619044551 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fd1e80392a0 0x7fd1e803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:44.786 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:43.836+0000 7fd1f7fff640 1 --2- 172.21.15.148:0/3619044551 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fd1e80392a0 0x7fd1e803b760 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd1f00098c0 tx=0x7fd1f0006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:44.786 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:43.840+0000 7fd1f5ffb640 1 -- 172.21.15.148:0/3619044551 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd1fc02fd40 con 0x7fd20007de20 2024-09-19T07:02:44.786 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:44.095+0000 7fd206f59640 1 -- 172.21.15.148:0/3619044551 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7fd2001a1430 con 0x7fd20007de20 2024-09-19T07:02:44.786 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:44.098+0000 7fd1f5ffb640 1 -- 172.21.15.148:0/3619044551 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v27)=0 set mgr/dashboard/cluster/status v27) ==== 153+0+0 (secure 0 0 0) 0x7fd1fc0448d0 con 0x7fd20007de20 2024-09-19T07:02:44.786 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-19T07:02:44.787 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:44.100+0000 7fd206f59640 1 -- 172.21.15.148:0/3619044551 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fd1e80392a0 msgr2=0x7fd1e803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:44.787 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:44.100+0000 7fd206f59640 1 --2- 172.21.15.148:0/3619044551 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fd1e80392a0 0x7fd1e803b760 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd1f00098c0 tx=0x7fd1f0006db0 comp rx=0 tx=0).stop 2024-09-19T07:02:44.787 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:44.100+0000 7fd206f59640 1 -- 172.21.15.148:0/3619044551 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd20007de20 msgr2=0x7fd20019d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:44.787 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:44.100+0000 7fd206f59640 1 --2- 172.21.15.148:0/3619044551 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd20007de20 0x7fd20019d9f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc0097f0 tx=0x7fd1fc0327b0 comp rx=0 tx=0).stop 2024-09-19T07:02:44.787 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:44.100+0000 7fd206f59640 1 -- 172.21.15.148:0/3619044551 shutdown_connections 2024-09-19T07:02:44.787 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:44.100+0000 7fd206f59640 1 --2- 172.21.15.148:0/3619044551 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fd1e80392a0 0x7fd1e803b760 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:44.787 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:44.100+0000 7fd206f59640 1 --2- 172.21.15.148:0/3619044551 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd20007de20 0x7fd20019d9f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:44.787 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:44.100+0000 7fd206f59640 1 -- 172.21.15.148:0/3619044551 >> 172.21.15.148:0/3619044551 conn(0x7fd200102f60 msgr2=0x7fd200103b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:44.787 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:44.100+0000 7fd206f59640 1 -- 172.21.15.148:0/3619044551 shutdown_connections 2024-09-19T07:02:44.787 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-09-19T07:02:44.100+0000 7fd206f59640 1 -- 172.21.15.148:0/3619044551 wait complete. 2024-09-19T07:02:44.787 INFO:teuthology.orchestra.run.smithi148.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-19T07:02:44.787 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:02:44.787 INFO:teuthology.orchestra.run.smithi148.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-19T07:02:44.787 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:02:44.788 INFO:teuthology.orchestra.run.smithi148.stdout:Or, if you are only running a single cluster on this host: 2024-09-19T07:02:44.788 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:02:44.788 INFO:teuthology.orchestra.run.smithi148.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-19T07:02:44.788 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:02:44.788 INFO:teuthology.orchestra.run.smithi148.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-19T07:02:44.788 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:02:44.788 INFO:teuthology.orchestra.run.smithi148.stdout: ceph telemetry on 2024-09-19T07:02:44.788 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:02:44.788 INFO:teuthology.orchestra.run.smithi148.stdout:For more information see: 2024-09-19T07:02:44.788 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:02:44.788 INFO:teuthology.orchestra.run.smithi148.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-19T07:02:44.788 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:02:44.788 INFO:teuthology.orchestra.run.smithi148.stdout:Bootstrap complete. 2024-09-19T07:02:44.822 INFO:tasks.cephadm:Fetching config... 2024-09-19T07:02:44.822 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-19T07:02:44.822 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-19T07:02:44.839 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-19T07:02:44.839 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-19T07:02:44.839 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-19T07:02:44.895 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-19T07:02:44.895 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-19T07:02:44.895 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-19T07:02:44.960 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-19T07:02:44.960 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-19T07:02:44.960 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-19T07:02:45.016 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-19T07:02:45.016 DEBUG:teuthology.orchestra.run.smithi148:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCj3EiwnnJCWnLxqqlKiSRzADo0UWAxlBMSEMl1L0pYdOdHFjWK9HYa1LTK6Ra9SdRuzCwqvyqqL448fL+/PLgxzbPhgpFPowNe2vRXe5rnARNNHFUno3BRiZniifzmJq2zJvi0CwzY2kkVuVGyz9BrZtyo0KUgfgT9ufzEBA385Zs8TGFjnr/DPJ57Hxi6/LL+XHm6t4KgLQ8kUP8uM0bolDpp1ZMPO5e3yrmws2daty/kzm/vJAEIAbsJFykuUuHbyEBmqsbPe+vSDX5rFyNtRBY7gtYhbMkpq29ZNm2iXe+1kYwmNuRLLEPK/kKXATTQMMYzlwZXxtGJDTmRQEFS6Ydt78QY2mRYWrDQRmrTeGG94feL5fWgjYVxGcJWuw3LLEjLfPhnhYCs9ZDorQNsMU+YF44k2E0eE6ZxCTuPzhqAk7+OM/zHFVUPiNN23KDk/wJKExPMQfluRkpsARPOoDQ2VWgDrEjRue6cYPeCvRQDGtY+dfGh7Zc36zl3v5k= ceph-eae8a4a8-7654-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T07:02:45.099 INFO:teuthology.orchestra.run.smithi148.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCj3EiwnnJCWnLxqqlKiSRzADo0UWAxlBMSEMl1L0pYdOdHFjWK9HYa1LTK6Ra9SdRuzCwqvyqqL448fL+/PLgxzbPhgpFPowNe2vRXe5rnARNNHFUno3BRiZniifzmJq2zJvi0CwzY2kkVuVGyz9BrZtyo0KUgfgT9ufzEBA385Zs8TGFjnr/DPJ57Hxi6/LL+XHm6t4KgLQ8kUP8uM0bolDpp1ZMPO5e3yrmws2daty/kzm/vJAEIAbsJFykuUuHbyEBmqsbPe+vSDX5rFyNtRBY7gtYhbMkpq29ZNm2iXe+1kYwmNuRLLEPK/kKXATTQMMYzlwZXxtGJDTmRQEFS6Ydt78QY2mRYWrDQRmrTeGG94feL5fWgjYVxGcJWuw3LLEjLfPhnhYCs9ZDorQNsMU+YF44k2E0eE6ZxCTuPzhqAk7+OM/zHFVUPiNN23KDk/wJKExPMQfluRkpsARPOoDQ2VWgDrEjRue6cYPeCvRQDGtY+dfGh7Zc36zl3v5k= ceph-eae8a4a8-7654-11ef-bceb-c7b262605968 2024-09-19T07:02:45.111 DEBUG:teuthology.orchestra.run.smithi165:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCj3EiwnnJCWnLxqqlKiSRzADo0UWAxlBMSEMl1L0pYdOdHFjWK9HYa1LTK6Ra9SdRuzCwqvyqqL448fL+/PLgxzbPhgpFPowNe2vRXe5rnARNNHFUno3BRiZniifzmJq2zJvi0CwzY2kkVuVGyz9BrZtyo0KUgfgT9ufzEBA385Zs8TGFjnr/DPJ57Hxi6/LL+XHm6t4KgLQ8kUP8uM0bolDpp1ZMPO5e3yrmws2daty/kzm/vJAEIAbsJFykuUuHbyEBmqsbPe+vSDX5rFyNtRBY7gtYhbMkpq29ZNm2iXe+1kYwmNuRLLEPK/kKXATTQMMYzlwZXxtGJDTmRQEFS6Ydt78QY2mRYWrDQRmrTeGG94feL5fWgjYVxGcJWuw3LLEjLfPhnhYCs9ZDorQNsMU+YF44k2E0eE6ZxCTuPzhqAk7+OM/zHFVUPiNN23KDk/wJKExPMQfluRkpsARPOoDQ2VWgDrEjRue6cYPeCvRQDGtY+dfGh7Zc36zl3v5k= ceph-eae8a4a8-7654-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T07:02:45.154 INFO:teuthology.orchestra.run.smithi165.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCj3EiwnnJCWnLxqqlKiSRzADo0UWAxlBMSEMl1L0pYdOdHFjWK9HYa1LTK6Ra9SdRuzCwqvyqqL448fL+/PLgxzbPhgpFPowNe2vRXe5rnARNNHFUno3BRiZniifzmJq2zJvi0CwzY2kkVuVGyz9BrZtyo0KUgfgT9ufzEBA385Zs8TGFjnr/DPJ57Hxi6/LL+XHm6t4KgLQ8kUP8uM0bolDpp1ZMPO5e3yrmws2daty/kzm/vJAEIAbsJFykuUuHbyEBmqsbPe+vSDX5rFyNtRBY7gtYhbMkpq29ZNm2iXe+1kYwmNuRLLEPK/kKXATTQMMYzlwZXxtGJDTmRQEFS6Ydt78QY2mRYWrDQRmrTeGG94feL5fWgjYVxGcJWuw3LLEjLfPhnhYCs9ZDorQNsMU+YF44k2E0eE6ZxCTuPzhqAk7+OM/zHFVUPiNN23KDk/wJKExPMQfluRkpsARPOoDQ2VWgDrEjRue6cYPeCvRQDGtY+dfGh7Zc36zl3v5k= ceph-eae8a4a8-7654-11ef-bceb-c7b262605968 2024-09-19T07:02:45.167 DEBUG:teuthology.orchestra.run.smithi179:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCj3EiwnnJCWnLxqqlKiSRzADo0UWAxlBMSEMl1L0pYdOdHFjWK9HYa1LTK6Ra9SdRuzCwqvyqqL448fL+/PLgxzbPhgpFPowNe2vRXe5rnARNNHFUno3BRiZniifzmJq2zJvi0CwzY2kkVuVGyz9BrZtyo0KUgfgT9ufzEBA385Zs8TGFjnr/DPJ57Hxi6/LL+XHm6t4KgLQ8kUP8uM0bolDpp1ZMPO5e3yrmws2daty/kzm/vJAEIAbsJFykuUuHbyEBmqsbPe+vSDX5rFyNtRBY7gtYhbMkpq29ZNm2iXe+1kYwmNuRLLEPK/kKXATTQMMYzlwZXxtGJDTmRQEFS6Ydt78QY2mRYWrDQRmrTeGG94feL5fWgjYVxGcJWuw3LLEjLfPhnhYCs9ZDorQNsMU+YF44k2E0eE6ZxCTuPzhqAk7+OM/zHFVUPiNN23KDk/wJKExPMQfluRkpsARPOoDQ2VWgDrEjRue6cYPeCvRQDGtY+dfGh7Zc36zl3v5k= ceph-eae8a4a8-7654-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T07:02:45.207 INFO:teuthology.orchestra.run.smithi179.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCj3EiwnnJCWnLxqqlKiSRzADo0UWAxlBMSEMl1L0pYdOdHFjWK9HYa1LTK6Ra9SdRuzCwqvyqqL448fL+/PLgxzbPhgpFPowNe2vRXe5rnARNNHFUno3BRiZniifzmJq2zJvi0CwzY2kkVuVGyz9BrZtyo0KUgfgT9ufzEBA385Zs8TGFjnr/DPJ57Hxi6/LL+XHm6t4KgLQ8kUP8uM0bolDpp1ZMPO5e3yrmws2daty/kzm/vJAEIAbsJFykuUuHbyEBmqsbPe+vSDX5rFyNtRBY7gtYhbMkpq29ZNm2iXe+1kYwmNuRLLEPK/kKXATTQMMYzlwZXxtGJDTmRQEFS6Ydt78QY2mRYWrDQRmrTeGG94feL5fWgjYVxGcJWuw3LLEjLfPhnhYCs9ZDorQNsMU+YF44k2E0eE6ZxCTuPzhqAk7+OM/zHFVUPiNN23KDk/wJKExPMQfluRkpsARPOoDQ2VWgDrEjRue6cYPeCvRQDGtY+dfGh7Zc36zl3v5k= ceph-eae8a4a8-7654-11ef-bceb-c7b262605968 2024-09-19T07:02:45.220 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-19T07:02:45.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:45 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/3619044551' entity='client.admin' 2024-09-19T07:02:45.467 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:02:45.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:45.953+0000 7f728a9bc640 1 -- 172.21.15.148:0/1717391416 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7284101620 msgr2=0x7f7284101a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:45.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:45.953+0000 7f728a9bc640 1 --2- 172.21.15.148:0/1717391416 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7284101620 0x7f7284101a20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7274009880 tx=0x7f727402a5d0 comp rx=0 tx=0).stop 2024-09-19T07:02:45.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:45.953+0000 7f728a9bc640 1 -- 172.21.15.148:0/1717391416 shutdown_connections 2024-09-19T07:02:45.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:45.953+0000 7f728a9bc640 1 --2- 172.21.15.148:0/1717391416 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7284101620 0x7f7284101a20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:45.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:45.953+0000 7f728a9bc640 1 -- 172.21.15.148:0/1717391416 >> 172.21.15.148:0/1717391416 conn(0x7f72840fcdf0 msgr2=0x7f72840ff210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:45.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:45.953+0000 7f728a9bc640 1 -- 172.21.15.148:0/1717391416 shutdown_connections 2024-09-19T07:02:45.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:45.953+0000 7f728a9bc640 1 -- 172.21.15.148:0/1717391416 wait complete. 2024-09-19T07:02:45.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:45.954+0000 7f728a9bc640 1 Processor -- start 2024-09-19T07:02:45.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:45.954+0000 7f728a9bc640 1 -- start start 2024-09-19T07:02:45.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:45.954+0000 7f728a9bc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7284101620 0x7f7284196da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:45.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:45.954+0000 7f728a9bc640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7284107730 con 0x7f7284101620 2024-09-19T07:02:45.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:45.954+0000 7f7283fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7284101620 0x7f7284196da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:45.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:45.954+0000 7f7283fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7284101620 0x7f7284196da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36958/0 (socket says 172.21.15.148:36958) 2024-09-19T07:02:45.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:45.954+0000 7f7283fff640 1 -- 172.21.15.148:0/1381239647 learned_addr learned my addr 172.21.15.148:0/1381239647 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:02:45.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:45.954+0000 7f7283fff640 1 -- 172.21.15.148:0/1381239647 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72841972e0 con 0x7f7284101620 2024-09-19T07:02:45.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:45.955+0000 7f7283fff640 1 --2- 172.21.15.148:0/1381239647 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7284101620 0x7f7284196da0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7274004f60 tx=0x7f72740048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:45.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:45.955+0000 7f72817fa640 1 -- 172.21.15.148:0/1381239647 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f727403f070 con 0x7f7284101620 2024-09-19T07:02:45.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:45.955+0000 7f72817fa640 1 -- 172.21.15.148:0/1381239647 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7274004cc0 con 0x7f7284101620 2024-09-19T07:02:45.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:45.955+0000 7f728a9bc640 1 -- 172.21.15.148:0/1381239647 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7284197570 con 0x7f7284101620 2024-09-19T07:02:45.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:45.955+0000 7f72817fa640 1 -- 172.21.15.148:0/1381239647 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7274035030 con 0x7f7284101620 2024-09-19T07:02:45.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:45.955+0000 7f728a9bc640 1 -- 172.21.15.148:0/1381239647 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f728419a260 con 0x7f7284101620 2024-09-19T07:02:45.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:45.956+0000 7f72817fa640 1 -- 172.21.15.148:0/1381239647 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f7274042070 con 0x7f7284101620 2024-09-19T07:02:45.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:45.956+0000 7f728a9bc640 1 -- 172.21.15.148:0/1381239647 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7284107eb0 con 0x7f7284101620 2024-09-19T07:02:45.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:45.956+0000 7f72817fa640 1 --2- 172.21.15.148:0/1381239647 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f726c039300 0x7f726c03b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:45.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:45.956+0000 7f72817fa640 1 -- 172.21.15.148:0/1381239647 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f727406d060 con 0x7f7284101620 2024-09-19T07:02:45.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:45.956+0000 7f72837fe640 1 --2- 172.21.15.148:0/1381239647 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f726c039300 0x7f726c03b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:45.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:45.956+0000 7f72837fe640 1 --2- 172.21.15.148:0/1381239647 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f726c039300 0x7f726c03b7c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f72780098c0 tx=0x7f7278006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:45.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:45.961+0000 7f72817fa640 1 -- 172.21.15.148:0/1381239647 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f72740433b0 con 0x7f7284101620 2024-09-19T07:02:46.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:46.130+0000 7f728a9bc640 1 -- 172.21.15.148:0/1381239647 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f728402d830 con 0x7f7284101620 2024-09-19T07:02:46.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:46.133+0000 7f72817fa640 1 -- 172.21.15.148:0/1381239647 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f727402f300 con 0x7f7284101620 2024-09-19T07:02:46.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:46.136+0000 7f728a9bc640 1 -- 172.21.15.148:0/1381239647 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f726c039300 msgr2=0x7f726c03b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:46.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:46.136+0000 7f728a9bc640 1 --2- 172.21.15.148:0/1381239647 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f726c039300 0x7f726c03b7c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f72780098c0 tx=0x7f7278006db0 comp rx=0 tx=0).stop 2024-09-19T07:02:46.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:46.136+0000 7f728a9bc640 1 -- 172.21.15.148:0/1381239647 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7284101620 msgr2=0x7f7284196da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:46.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:46.136+0000 7f728a9bc640 1 --2- 172.21.15.148:0/1381239647 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7284101620 0x7f7284196da0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7274004f60 tx=0x7f72740048f0 comp rx=0 tx=0).stop 2024-09-19T07:02:46.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:46.136+0000 7f728a9bc640 1 -- 172.21.15.148:0/1381239647 shutdown_connections 2024-09-19T07:02:46.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:46.136+0000 7f728a9bc640 1 --2- 172.21.15.148:0/1381239647 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f726c039300 0x7f726c03b7c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:46.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:46.136+0000 7f728a9bc640 1 --2- 172.21.15.148:0/1381239647 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7284101620 0x7f7284196da0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:46.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:46.136+0000 7f728a9bc640 1 -- 172.21.15.148:0/1381239647 >> 172.21.15.148:0/1381239647 conn(0x7f72840fcdf0 msgr2=0x7f72840fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:46.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:46.136+0000 7f728a9bc640 1 -- 172.21.15.148:0/1381239647 shutdown_connections 2024-09-19T07:02:46.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:46.136+0000 7f728a9bc640 1 -- 172.21.15.148:0/1381239647 wait complete. 2024-09-19T07:02:46.731 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-19T07:02:46.732 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-19T07:02:47.219 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:02:47.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:47 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/1381239647' entity='client.admin' 2024-09-19T07:02:47.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:47.658+0000 7f8bc6051640 1 -- 172.21.15.148:0/419060411 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bc0101620 msgr2=0x7f8bc0101a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:47.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:47.658+0000 7f8bc6051640 1 --2- 172.21.15.148:0/419060411 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bc0101620 0x7f8bc0101a20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8009880 tx=0x7f8ba802a5d0 comp rx=0 tx=0).stop 2024-09-19T07:02:47.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:47.658+0000 7f8bc6051640 1 -- 172.21.15.148:0/419060411 shutdown_connections 2024-09-19T07:02:47.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:47.658+0000 7f8bc6051640 1 --2- 172.21.15.148:0/419060411 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bc0101620 0x7f8bc0101a20 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:47.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:47.658+0000 7f8bc6051640 1 -- 172.21.15.148:0/419060411 >> 172.21.15.148:0/419060411 conn(0x7f8bc00fcdf0 msgr2=0x7f8bc00ff210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:47.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:47.658+0000 7f8bc6051640 1 -- 172.21.15.148:0/419060411 shutdown_connections 2024-09-19T07:02:47.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:47.658+0000 7f8bc6051640 1 -- 172.21.15.148:0/419060411 wait complete. 2024-09-19T07:02:47.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:47.659+0000 7f8bc6051640 1 Processor -- start 2024-09-19T07:02:47.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:47.659+0000 7f8bc6051640 1 -- start start 2024-09-19T07:02:47.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:47.659+0000 7f8bc6051640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bc0101620 0x7f8bc0075eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:47.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:47.659+0000 7f8bc6051640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc0107730 con 0x7f8bc0101620 2024-09-19T07:02:47.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:47.659+0000 7f8bbf7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bc0101620 0x7f8bc0075eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:47.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:47.659+0000 7f8bbf7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bc0101620 0x7f8bc0075eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36988/0 (socket says 172.21.15.148:36988) 2024-09-19T07:02:47.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:47.659+0000 7f8bbf7fe640 1 -- 172.21.15.148:0/1883058638 learned_addr learned my addr 172.21.15.148:0/1883058638 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:02:47.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:47.660+0000 7f8bbf7fe640 1 -- 172.21.15.148:0/1883058638 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bc00763f0 con 0x7f8bc0101620 2024-09-19T07:02:47.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:47.660+0000 7f8bbf7fe640 1 --2- 172.21.15.148:0/1883058638 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bc0101620 0x7f8bc0075eb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8004f60 tx=0x7f8ba80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:47.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:47.660+0000 7f8bbcff9640 1 -- 172.21.15.148:0/1883058638 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ba803f070 con 0x7f8bc0101620 2024-09-19T07:02:47.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:47.660+0000 7f8bbcff9640 1 -- 172.21.15.148:0/1883058638 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ba8004d40 con 0x7f8bc0101620 2024-09-19T07:02:47.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:47.660+0000 7f8bc6051640 1 -- 172.21.15.148:0/1883058638 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bc00745e0 con 0x7f8bc0101620 2024-09-19T07:02:47.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:47.660+0000 7f8bbcff9640 1 -- 172.21.15.148:0/1883058638 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ba8035030 con 0x7f8bc0101620 2024-09-19T07:02:47.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:47.660+0000 7f8bc6051640 1 -- 172.21.15.148:0/1883058638 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bc0074b20 con 0x7f8bc0101620 2024-09-19T07:02:47.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:47.661+0000 7f8bbcff9640 1 -- 172.21.15.148:0/1883058638 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f8ba8042070 con 0x7f8bc0101620 2024-09-19T07:02:47.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:47.661+0000 7f8bc6051640 1 -- 172.21.15.148:0/1883058638 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bc0107eb0 con 0x7f8bc0101620 2024-09-19T07:02:47.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:47.661+0000 7f8bbcff9640 1 --2- 172.21.15.148:0/1883058638 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f8bac039300 0x7f8bac03b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:47.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:47.661+0000 7f8bbcff9640 1 -- 172.21.15.148:0/1883058638 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f8ba806cff0 con 0x7f8bc0101620 2024-09-19T07:02:47.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:47.661+0000 7f8bbeffd640 1 --2- 172.21.15.148:0/1883058638 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f8bac039300 0x7f8bac03b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:47.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:47.662+0000 7f8bbeffd640 1 --2- 172.21.15.148:0/1883058638 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f8bac039300 0x7f8bac03b7c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8bb00098c0 tx=0x7f8bb0006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:47.666 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:47.666+0000 7f8bbcff9640 1 -- 172.21.15.148:0/1883058638 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8ba8039350 con 0x7f8bc0101620 2024-09-19T07:02:47.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:47.834+0000 7f8bc6051640 1 -- 172.21.15.148:0/1883058638 --> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f8bc01901d0 con 0x7f8bac039300 2024-09-19T07:02:47.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:47.838+0000 7f8bbcff9640 1 -- 172.21.15.148:0/1883058638 <== mgr.14148 v2:172.21.15.148:6800/3007822654 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8bc01901d0 con 0x7f8bac039300 2024-09-19T07:02:47.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:47.840+0000 7f8bc6051640 1 -- 172.21.15.148:0/1883058638 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f8bac039300 msgr2=0x7f8bac03b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:47.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:47.840+0000 7f8bc6051640 1 --2- 172.21.15.148:0/1883058638 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f8bac039300 0x7f8bac03b7c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8bb00098c0 tx=0x7f8bb0006db0 comp rx=0 tx=0).stop 2024-09-19T07:02:47.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:47.840+0000 7f8bc6051640 1 -- 172.21.15.148:0/1883058638 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bc0101620 msgr2=0x7f8bc0075eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:47.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:47.840+0000 7f8bc6051640 1 --2- 172.21.15.148:0/1883058638 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bc0101620 0x7f8bc0075eb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8004f60 tx=0x7f8ba80048f0 comp rx=0 tx=0).stop 2024-09-19T07:02:47.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:47.840+0000 7f8bc6051640 1 -- 172.21.15.148:0/1883058638 shutdown_connections 2024-09-19T07:02:47.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:47.840+0000 7f8bc6051640 1 --2- 172.21.15.148:0/1883058638 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f8bac039300 0x7f8bac03b7c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:47.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:47.840+0000 7f8bc6051640 1 --2- 172.21.15.148:0/1883058638 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bc0101620 0x7f8bc0075eb0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:47.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:47.840+0000 7f8bc6051640 1 -- 172.21.15.148:0/1883058638 >> 172.21.15.148:0/1883058638 conn(0x7f8bc00fcdf0 msgr2=0x7f8bc00fd880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:47.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:47.840+0000 7f8bc6051640 1 -- 172.21.15.148:0/1883058638 shutdown_connections 2024-09-19T07:02:47.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:47.840+0000 7f8bc6051640 1 -- 172.21.15.148:0/1883058638 wait complete. 2024-09-19T07:02:48.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:48 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:02:48.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:48 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:02:48.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:48 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi148", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:02:48.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:48 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:02:48.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:48 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:02:48.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:48 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:02:48.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:48 smithi148 ceph-mon[31180]: from='client.14170 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:02:48.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:48 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:02:48.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:48 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:02:48.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:48 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:02:48.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:48 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:02:48.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:48 smithi148 ceph-mon[31180]: Updating smithi148:/etc/ceph/ceph.conf 2024-09-19T07:02:48.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:48 smithi148 ceph-mon[31180]: Updating smithi148:/var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:02:48.634 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi165 2024-09-19T07:02:48.634 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-19T07:02:48.634 DEBUG:teuthology.orchestra.run.smithi165:> dd of=/etc/ceph/ceph.conf 2024-09-19T07:02:48.654 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-19T07:02:48.654 DEBUG:teuthology.orchestra.run.smithi165:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:02:48.711 INFO:tasks.cephadm:Adding host smithi165 to orchestrator... 2024-09-19T07:02:48.711 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph orch host add smithi165 2024-09-19T07:02:48.953 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:02:49.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:49.390+0000 7f39a2f6f640 1 -- 172.21.15.148:0/830890800 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f399c107660 msgr2=0x7f399c107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:49.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:49.390+0000 7f39a2f6f640 1 --2- 172.21.15.148:0/830890800 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f399c107660 0x7f399c107a40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3990009880 tx=0x7f399002a5d0 comp rx=0 tx=0).stop 2024-09-19T07:02:49.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:49.390+0000 7f39a2f6f640 1 -- 172.21.15.148:0/830890800 shutdown_connections 2024-09-19T07:02:49.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:49.390+0000 7f39a2f6f640 1 --2- 172.21.15.148:0/830890800 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f399c107660 0x7f399c107a40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:49.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:49.390+0000 7f39a2f6f640 1 -- 172.21.15.148:0/830890800 >> 172.21.15.148:0/830890800 conn(0x7f399c0fd2b0 msgr2=0x7f399c0ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:49.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:49.390+0000 7f39a2f6f640 1 -- 172.21.15.148:0/830890800 shutdown_connections 2024-09-19T07:02:49.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:49.390+0000 7f39a2f6f640 1 -- 172.21.15.148:0/830890800 wait complete. 2024-09-19T07:02:49.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:49.391+0000 7f39a2f6f640 1 Processor -- start 2024-09-19T07:02:49.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:49.391+0000 7f39a2f6f640 1 -- start start 2024-09-19T07:02:49.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:49.391+0000 7f39a2f6f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f399c107660 0x7f399c1970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:49.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:49.391+0000 7f39a2f6f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f399c10bc70 con 0x7f399c107660 2024-09-19T07:02:49.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:49.391+0000 7f39a0d0b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f399c107660 0x7f399c1970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:49.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:49.391+0000 7f39a0d0b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f399c107660 0x7f399c1970a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37006/0 (socket says 172.21.15.148:37006) 2024-09-19T07:02:49.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:49.391+0000 7f39a0d0b640 1 -- 172.21.15.148:0/2958838515 learned_addr learned my addr 172.21.15.148:0/2958838515 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:02:49.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:49.391+0000 7f39a0d0b640 1 -- 172.21.15.148:0/2958838515 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f399c1975e0 con 0x7f399c107660 2024-09-19T07:02:49.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:49.391+0000 7f39a0d0b640 1 --2- 172.21.15.148:0/2958838515 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f399c107660 0x7f399c1970a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3990009230 tx=0x7f3990003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:49.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:49.392+0000 7f3999ffb640 1 -- 172.21.15.148:0/2958838515 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f399003f070 con 0x7f399c107660 2024-09-19T07:02:49.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:49.392+0000 7f39a2f6f640 1 -- 172.21.15.148:0/2958838515 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f399c1978d0 con 0x7f399c107660 2024-09-19T07:02:49.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:49.392+0000 7f3999ffb640 1 -- 172.21.15.148:0/2958838515 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f399003bc80 con 0x7f399c107660 2024-09-19T07:02:49.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:49.392+0000 7f3999ffb640 1 -- 172.21.15.148:0/2958838515 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3990035030 con 0x7f399c107660 2024-09-19T07:02:49.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:49.392+0000 7f39a2f6f640 1 -- 172.21.15.148:0/2958838515 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f399c19b970 con 0x7f399c107660 2024-09-19T07:02:49.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:49.393+0000 7f3999ffb640 1 -- 172.21.15.148:0/2958838515 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f3990042070 con 0x7f399c107660 2024-09-19T07:02:49.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:49.393+0000 7f39a2f6f640 1 -- 172.21.15.148:0/2958838515 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f399c102d10 con 0x7f399c107660 2024-09-19T07:02:49.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:49.393+0000 7f3999ffb640 1 --2- 172.21.15.148:0/2958838515 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f398c0392a0 0x7f398c03b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:49.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:49.393+0000 7f3999ffb640 1 -- 172.21.15.148:0/2958838515 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f399006d080 con 0x7f399c107660 2024-09-19T07:02:49.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:49.393+0000 7f399bfff640 1 --2- 172.21.15.148:0/2958838515 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f398c0392a0 0x7f398c03b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:49.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:49.393+0000 7f399bfff640 1 --2- 172.21.15.148:0/2958838515 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f398c0392a0 0x7f398c03b760 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f39880098c0 tx=0x7f3988006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:49.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:49.398+0000 7f3999ffb640 1 -- 172.21.15.148:0/2958838515 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f399004c350 con 0x7f399c107660 2024-09-19T07:02:49.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:49.569+0000 7f39a2f6f640 1 -- 172.21.15.148:0/2958838515 --> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi165", "target": ["mon-mgr", ""]}) -- 0x7f399c107af0 con 0x7f398c0392a0 2024-09-19T07:02:50.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:49 smithi148 ceph-mon[31180]: Updating smithi148:/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:02:50.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:49 smithi148 ceph-mon[31180]: Updating smithi148:/var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T07:02:50.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:49 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:02:50.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:49 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:02:50.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:49 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:02:51.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:50 smithi148 ceph-mon[31180]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi165", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:02:52.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:51 smithi148 ceph-mon[31180]: Deploying cephadm binary to smithi165 2024-09-19T07:02:52.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:52.704+0000 7f3999ffb640 1 -- 172.21.15.148:0/2958838515 <== mgr.14148 v2:172.21.15.148:6800/3007822654 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f399c107af0 con 0x7f398c0392a0 2024-09-19T07:02:52.706 INFO:teuthology.orchestra.run.smithi148.stdout:Added host 'smithi165' with addr '172.21.15.165' 2024-09-19T07:02:52.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:52.707+0000 7f39a2f6f640 1 -- 172.21.15.148:0/2958838515 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f398c0392a0 msgr2=0x7f398c03b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:52.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:52.707+0000 7f39a2f6f640 1 --2- 172.21.15.148:0/2958838515 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f398c0392a0 0x7f398c03b760 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f39880098c0 tx=0x7f3988006db0 comp rx=0 tx=0).stop 2024-09-19T07:02:52.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:52.707+0000 7f39a2f6f640 1 -- 172.21.15.148:0/2958838515 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f399c107660 msgr2=0x7f399c1970a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:52.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:52.707+0000 7f39a2f6f640 1 --2- 172.21.15.148:0/2958838515 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f399c107660 0x7f399c1970a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3990009230 tx=0x7f3990003d40 comp rx=0 tx=0).stop 2024-09-19T07:02:52.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:52.707+0000 7f39a2f6f640 1 -- 172.21.15.148:0/2958838515 shutdown_connections 2024-09-19T07:02:52.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:52.707+0000 7f39a2f6f640 1 --2- 172.21.15.148:0/2958838515 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f398c0392a0 0x7f398c03b760 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:52.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:52.707+0000 7f39a2f6f640 1 --2- 172.21.15.148:0/2958838515 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f399c107660 0x7f399c1970a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:52.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:52.707+0000 7f39a2f6f640 1 -- 172.21.15.148:0/2958838515 >> 172.21.15.148:0/2958838515 conn(0x7f399c0fd2b0 msgr2=0x7f399c0feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:52.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:52.707+0000 7f39a2f6f640 1 -- 172.21.15.148:0/2958838515 shutdown_connections 2024-09-19T07:02:52.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:52.707+0000 7f39a2f6f640 1 -- 172.21.15.148:0/2958838515 wait complete. 2024-09-19T07:02:53.350 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T07:02:53.590 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:02:53.995 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:53 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:02:53.995 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:53 smithi148 ceph-mon[31180]: Added host smithi165 2024-09-19T07:02:53.996 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:53 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:02:53.996 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:53 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:02:53.996 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:53 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:02:53.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:53.994+0000 7fbf6cfc0640 1 -- 172.21.15.148:0/3209015131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf68107660 msgr2=0x7fbf68107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:53.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:53.994+0000 7fbf6cfc0640 1 --2- 172.21.15.148:0/3209015131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf68107660 0x7fbf68107a40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbf50009880 tx=0x7fbf5002a5d0 comp rx=0 tx=0).stop 2024-09-19T07:02:53.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:53.994+0000 7fbf6cfc0640 1 -- 172.21.15.148:0/3209015131 shutdown_connections 2024-09-19T07:02:53.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:53.994+0000 7fbf6cfc0640 1 --2- 172.21.15.148:0/3209015131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf68107660 0x7fbf68107a40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:53.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:53.994+0000 7fbf6cfc0640 1 -- 172.21.15.148:0/3209015131 >> 172.21.15.148:0/3209015131 conn(0x7fbf680fd2b0 msgr2=0x7fbf680ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:53.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:53.994+0000 7fbf6cfc0640 1 -- 172.21.15.148:0/3209015131 shutdown_connections 2024-09-19T07:02:53.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:53.994+0000 7fbf6cfc0640 1 -- 172.21.15.148:0/3209015131 wait complete. 2024-09-19T07:02:53.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:53.995+0000 7fbf6cfc0640 1 Processor -- start 2024-09-19T07:02:53.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:53.995+0000 7fbf6cfc0640 1 -- start start 2024-09-19T07:02:53.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:53.995+0000 7fbf6cfc0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf68107660 0x7fbf681970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:54.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:53.995+0000 7fbf6cfc0640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6810bc70 con 0x7fbf68107660 2024-09-19T07:02:54.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:53.995+0000 7fbf6659c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf68107660 0x7fbf681970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:54.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:53.995+0000 7fbf6659c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf68107660 0x7fbf681970a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37012/0 (socket says 172.21.15.148:37012) 2024-09-19T07:02:54.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:53.995+0000 7fbf6659c640 1 -- 172.21.15.148:0/3551748829 learned_addr learned my addr 172.21.15.148:0/3551748829 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:02:54.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:53.996+0000 7fbf6659c640 1 -- 172.21.15.148:0/3551748829 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf681975e0 con 0x7fbf68107660 2024-09-19T07:02:54.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:53.996+0000 7fbf6659c640 1 --2- 172.21.15.148:0/3551748829 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf68107660 0x7fbf681970a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbf50009230 tx=0x7fbf50003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:54.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:53.996+0000 7fbf5f7fe640 1 -- 172.21.15.148:0/3551748829 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf5003f070 con 0x7fbf68107660 2024-09-19T07:02:54.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:53.996+0000 7fbf5f7fe640 1 -- 172.21.15.148:0/3551748829 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf5003bc80 con 0x7fbf68107660 2024-09-19T07:02:54.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:53.996+0000 7fbf6cfc0640 1 -- 172.21.15.148:0/3551748829 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf681978d0 con 0x7fbf68107660 2024-09-19T07:02:54.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:53.996+0000 7fbf5f7fe640 1 -- 172.21.15.148:0/3551748829 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf50035030 con 0x7fbf68107660 2024-09-19T07:02:54.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:53.996+0000 7fbf6cfc0640 1 -- 172.21.15.148:0/3551748829 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf6819b970 con 0x7fbf68107660 2024-09-19T07:02:54.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:53.997+0000 7fbf5f7fe640 1 -- 172.21.15.148:0/3551748829 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7fbf50042070 con 0x7fbf68107660 2024-09-19T07:02:54.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:53.997+0000 7fbf5f7fe640 1 --2- 172.21.15.148:0/3551748829 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fbf540392a0 0x7fbf5403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:54.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:53.997+0000 7fbf5f7fe640 1 -- 172.21.15.148:0/3551748829 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fbf5006deb0 con 0x7fbf68107660 2024-09-19T07:02:54.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:53.997+0000 7fbf65d9b640 1 --2- 172.21.15.148:0/3551748829 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fbf540392a0 0x7fbf5403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:54.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:53.997+0000 7fbf6cfc0640 1 -- 172.21.15.148:0/3551748829 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf68102d10 con 0x7fbf68107660 2024-09-19T07:02:54.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:53.997+0000 7fbf65d9b640 1 --2- 172.21.15.148:0/3551748829 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fbf540392a0 0x7fbf5403b760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbf580098c0 tx=0x7fbf58006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:54.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:54.002+0000 7fbf5f7fe640 1 -- 172.21.15.148:0/3551748829 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbf5004c350 con 0x7fbf68107660 2024-09-19T07:02:54.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:54.175+0000 7fbf6cfc0640 1 -- 172.21.15.148:0/3551748829 --> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbf68198400 con 0x7fbf540392a0 2024-09-19T07:02:54.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:54.176+0000 7fbf5f7fe640 1 -- 172.21.15.148:0/3551748829 <== mgr.14148 v2:172.21.15.148:6800/3007822654 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+161 (secure 0 0 0) 0x7fbf68198400 con 0x7fbf540392a0 2024-09-19T07:02:54.178 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:02:54.178 INFO:teuthology.orchestra.run.smithi148.stdout:[{"addr": "172.21.15.148", "hostname": "smithi148", "labels": [], "status": ""}, {"addr": "172.21.15.165", "hostname": "smithi165", "labels": [], "status": ""}] 2024-09-19T07:02:54.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:54.178+0000 7fbf6cfc0640 1 -- 172.21.15.148:0/3551748829 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fbf540392a0 msgr2=0x7fbf5403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:54.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:54.178+0000 7fbf6cfc0640 1 --2- 172.21.15.148:0/3551748829 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fbf540392a0 0x7fbf5403b760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbf580098c0 tx=0x7fbf58006db0 comp rx=0 tx=0).stop 2024-09-19T07:02:54.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:54.178+0000 7fbf6cfc0640 1 -- 172.21.15.148:0/3551748829 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf68107660 msgr2=0x7fbf681970a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:54.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:54.178+0000 7fbf6cfc0640 1 --2- 172.21.15.148:0/3551748829 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf68107660 0x7fbf681970a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbf50009230 tx=0x7fbf50003d40 comp rx=0 tx=0).stop 2024-09-19T07:02:54.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:54.178+0000 7fbf6cfc0640 1 -- 172.21.15.148:0/3551748829 shutdown_connections 2024-09-19T07:02:54.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:54.178+0000 7fbf6cfc0640 1 --2- 172.21.15.148:0/3551748829 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fbf540392a0 0x7fbf5403b760 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:54.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:54.178+0000 7fbf6cfc0640 1 --2- 172.21.15.148:0/3551748829 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf68107660 0x7fbf681970a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:54.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:54.178+0000 7fbf6cfc0640 1 -- 172.21.15.148:0/3551748829 >> 172.21.15.148:0/3551748829 conn(0x7fbf680fd2b0 msgr2=0x7fbf680fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:54.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:54.179+0000 7fbf6cfc0640 1 -- 172.21.15.148:0/3551748829 shutdown_connections 2024-09-19T07:02:54.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:54.179+0000 7fbf6cfc0640 1 -- 172.21.15.148:0/3551748829 wait complete. 2024-09-19T07:02:54.722 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi179 2024-09-19T07:02:54.722 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-19T07:02:54.722 DEBUG:teuthology.orchestra.run.smithi179:> dd of=/etc/ceph/ceph.conf 2024-09-19T07:02:54.742 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-19T07:02:54.742 DEBUG:teuthology.orchestra.run.smithi179:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:02:54.801 INFO:tasks.cephadm:Adding host smithi179 to orchestrator... 2024-09-19T07:02:54.801 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph orch host add smithi179 2024-09-19T07:02:55.042 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:02:55.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:55 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:02:55.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:55.452+0000 7f1d6346a640 1 -- 172.21.15.148:0/4072146305 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d5c107660 msgr2=0x7f1d5c107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:55.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:55.452+0000 7f1d6346a640 1 --2- 172.21.15.148:0/4072146305 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d5c107660 0x7f1d5c107a40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1d58009880 tx=0x7f1d5802a5d0 comp rx=0 tx=0).stop 2024-09-19T07:02:55.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:55.453+0000 7f1d6346a640 1 -- 172.21.15.148:0/4072146305 shutdown_connections 2024-09-19T07:02:55.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:55.453+0000 7f1d6346a640 1 --2- 172.21.15.148:0/4072146305 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d5c107660 0x7f1d5c107a40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:55.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:55.453+0000 7f1d6346a640 1 -- 172.21.15.148:0/4072146305 >> 172.21.15.148:0/4072146305 conn(0x7f1d5c0fd2b0 msgr2=0x7f1d5c0ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:55.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:55.453+0000 7f1d6346a640 1 -- 172.21.15.148:0/4072146305 shutdown_connections 2024-09-19T07:02:55.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:55.453+0000 7f1d6346a640 1 -- 172.21.15.148:0/4072146305 wait complete. 2024-09-19T07:02:55.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:55.453+0000 7f1d6346a640 1 Processor -- start 2024-09-19T07:02:55.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:55.453+0000 7f1d6346a640 1 -- start start 2024-09-19T07:02:55.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:55.454+0000 7f1d6346a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d5c107660 0x7f1d5c197110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:55.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:55.454+0000 7f1d6346a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5c10bc70 con 0x7f1d5c107660 2024-09-19T07:02:55.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:55.454+0000 7f1d61206640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d5c107660 0x7f1d5c197110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:55.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:55.454+0000 7f1d61206640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d5c107660 0x7f1d5c197110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56142/0 (socket says 172.21.15.148:56142) 2024-09-19T07:02:55.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:55.454+0000 7f1d61206640 1 -- 172.21.15.148:0/261893591 learned_addr learned my addr 172.21.15.148:0/261893591 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:02:55.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:55.454+0000 7f1d61206640 1 -- 172.21.15.148:0/261893591 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d5c197650 con 0x7f1d5c107660 2024-09-19T07:02:55.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:55.454+0000 7f1d61206640 1 --2- 172.21.15.148:0/261893591 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d5c107660 0x7f1d5c197110 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1d58009230 tx=0x7f1d58003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:55.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:55.454+0000 7f1d527fc640 1 -- 172.21.15.148:0/261893591 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d5803f070 con 0x7f1d5c107660 2024-09-19T07:02:55.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:55.454+0000 7f1d527fc640 1 -- 172.21.15.148:0/261893591 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d5803bc80 con 0x7f1d5c107660 2024-09-19T07:02:55.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:55.454+0000 7f1d6346a640 1 -- 172.21.15.148:0/261893591 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d5c197940 con 0x7f1d5c107660 2024-09-19T07:02:55.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:55.454+0000 7f1d527fc640 1 -- 172.21.15.148:0/261893591 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d58035030 con 0x7f1d5c107660 2024-09-19T07:02:55.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:55.454+0000 7f1d6346a640 1 -- 172.21.15.148:0/261893591 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d5c19b9e0 con 0x7f1d5c107660 2024-09-19T07:02:55.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:55.455+0000 7f1d527fc640 1 -- 172.21.15.148:0/261893591 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f1d58042070 con 0x7f1d5c107660 2024-09-19T07:02:55.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:55.455+0000 7f1d6346a640 1 -- 172.21.15.148:0/261893591 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d5c102d10 con 0x7f1d5c107660 2024-09-19T07:02:55.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:55.455+0000 7f1d527fc640 1 --2- 172.21.15.148:0/261893591 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f1d480392a0 0x7f1d4803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:55.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:55.455+0000 7f1d527fc640 1 -- 172.21.15.148:0/261893591 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f1d5806d050 con 0x7f1d5c107660 2024-09-19T07:02:55.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:55.456+0000 7f1d60a05640 1 --2- 172.21.15.148:0/261893591 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f1d480392a0 0x7f1d4803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:55.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:55.456+0000 7f1d60a05640 1 --2- 172.21.15.148:0/261893591 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f1d480392a0 0x7f1d4803b760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c0098c0 tx=0x7f1d4c006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:55.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:55.460+0000 7f1d527fc640 1 -- 172.21.15.148:0/261893591 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1d5803a3c0 con 0x7f1d5c107660 2024-09-19T07:02:55.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:55.629+0000 7f1d6346a640 1 -- 172.21.15.148:0/261893591 --> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi179", "target": ["mon-mgr", ""]}) -- 0x7f1d5c107af0 con 0x7f1d480392a0 2024-09-19T07:02:56.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:56 smithi148 ceph-mon[31180]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:02:57.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:57 smithi148 ceph-mon[31180]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi179", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:02:57.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:57 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:02:57.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:57 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:02:57.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:57 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:02:57.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:57 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:02:57.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:57 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi165", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:02:57.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:57 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:02:57.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:57 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:02:58.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:58 smithi148 ceph-mon[31180]: Deploying cephadm binary to smithi179 2024-09-19T07:02:58.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:58 smithi148 ceph-mon[31180]: Updating smithi165:/etc/ceph/ceph.conf 2024-09-19T07:02:58.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:58 smithi148 ceph-mon[31180]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:02:58.810 INFO:teuthology.orchestra.run.smithi148.stdout:Added host 'smithi179' with addr '172.21.15.179' 2024-09-19T07:02:58.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:58.809+0000 7f1d527fc640 1 -- 172.21.15.148:0/261893591 <== mgr.14148 v2:172.21.15.148:6800/3007822654 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f1d5c107af0 con 0x7f1d480392a0 2024-09-19T07:02:58.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:58.811+0000 7f1d6346a640 1 -- 172.21.15.148:0/261893591 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f1d480392a0 msgr2=0x7f1d4803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:58.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:58.811+0000 7f1d6346a640 1 --2- 172.21.15.148:0/261893591 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f1d480392a0 0x7f1d4803b760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c0098c0 tx=0x7f1d4c006db0 comp rx=0 tx=0).stop 2024-09-19T07:02:58.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:58.811+0000 7f1d6346a640 1 -- 172.21.15.148:0/261893591 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d5c107660 msgr2=0x7f1d5c197110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:58.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:58.811+0000 7f1d6346a640 1 --2- 172.21.15.148:0/261893591 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d5c107660 0x7f1d5c197110 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1d58009230 tx=0x7f1d58003d40 comp rx=0 tx=0).stop 2024-09-19T07:02:58.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:58.811+0000 7f1d6346a640 1 -- 172.21.15.148:0/261893591 shutdown_connections 2024-09-19T07:02:58.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:58.811+0000 7f1d6346a640 1 --2- 172.21.15.148:0/261893591 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f1d480392a0 0x7f1d4803b760 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:58.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:58.811+0000 7f1d6346a640 1 --2- 172.21.15.148:0/261893591 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d5c107660 0x7f1d5c197110 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:58.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:58.811+0000 7f1d6346a640 1 -- 172.21.15.148:0/261893591 >> 172.21.15.148:0/261893591 conn(0x7f1d5c0fd2b0 msgr2=0x7f1d5c0feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:58.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:58.811+0000 7f1d6346a640 1 -- 172.21.15.148:0/261893591 shutdown_connections 2024-09-19T07:02:58.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:02:58.812+0000 7f1d6346a640 1 -- 172.21.15.148:0/261893591 wait complete. 2024-09-19T07:02:59.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:59 smithi148 ceph-mon[31180]: Updating smithi165:/var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:02:59.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:59 smithi148 ceph-mon[31180]: Updating smithi165:/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:02:59.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:59 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:02:59.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:59 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:02:59.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:59 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:02:59.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:59 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:02:59.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:02:59 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:02:59.402 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T07:02:59.641 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:03:00.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:00.077+0000 7f00e1f8e640 1 -- 172.21.15.148:0/3478894110 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00dc107690 msgr2=0x7f00dc107a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:00.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:00.077+0000 7f00e1f8e640 1 --2- 172.21.15.148:0/3478894110 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00dc107690 0x7f00dc107a70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f00cc009880 tx=0x7f00cc02a670 comp rx=0 tx=0).stop 2024-09-19T07:03:00.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:00.077+0000 7f00e1f8e640 1 -- 172.21.15.148:0/3478894110 shutdown_connections 2024-09-19T07:03:00.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:00.077+0000 7f00e1f8e640 1 --2- 172.21.15.148:0/3478894110 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00dc107690 0x7f00dc107a70 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:00.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:00.077+0000 7f00e1f8e640 1 -- 172.21.15.148:0/3478894110 >> 172.21.15.148:0/3478894110 conn(0x7f00dc0fb920 msgr2=0x7f00dc0fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:00.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:00.077+0000 7f00e1f8e640 1 -- 172.21.15.148:0/3478894110 shutdown_connections 2024-09-19T07:03:00.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:00.077+0000 7f00e1f8e640 1 -- 172.21.15.148:0/3478894110 wait complete. 2024-09-19T07:03:00.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:00.078+0000 7f00e1f8e640 1 Processor -- start 2024-09-19T07:03:00.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:00.078+0000 7f00e1f8e640 1 -- start start 2024-09-19T07:03:00.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:00.078+0000 7f00e1f8e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00dc107690 0x7f00dc197170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:00.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:00.078+0000 7f00e1f8e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f00dc10bc80 con 0x7f00dc107690 2024-09-19T07:03:00.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:00.078+0000 7f00db7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00dc107690 0x7f00dc197170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:00.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:00.078+0000 7f00db7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00dc107690 0x7f00dc197170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56168/0 (socket says 172.21.15.148:56168) 2024-09-19T07:03:00.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:00.078+0000 7f00db7fe640 1 -- 172.21.15.148:0/4234900561 learned_addr learned my addr 172.21.15.148:0/4234900561 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:03:00.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:00.079+0000 7f00db7fe640 1 -- 172.21.15.148:0/4234900561 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00dc1976b0 con 0x7f00dc107690 2024-09-19T07:03:00.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:00.079+0000 7f00db7fe640 1 --2- 172.21.15.148:0/4234900561 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00dc107690 0x7f00dc197170 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f00cc009230 tx=0x7f00cc003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:00.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:00.079+0000 7f00d97fa640 1 -- 172.21.15.148:0/4234900561 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00cc03f070 con 0x7f00dc107690 2024-09-19T07:03:00.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:00.079+0000 7f00d97fa640 1 -- 172.21.15.148:0/4234900561 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00cc03bc80 con 0x7f00dc107690 2024-09-19T07:03:00.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:00.079+0000 7f00e1f8e640 1 -- 172.21.15.148:0/4234900561 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00dc1979a0 con 0x7f00dc107690 2024-09-19T07:03:00.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:00.079+0000 7f00d97fa640 1 -- 172.21.15.148:0/4234900561 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00cc035030 con 0x7f00dc107690 2024-09-19T07:03:00.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:00.079+0000 7f00e1f8e640 1 -- 172.21.15.148:0/4234900561 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00dc19ba40 con 0x7f00dc107690 2024-09-19T07:03:00.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:00.080+0000 7f00d97fa640 1 -- 172.21.15.148:0/4234900561 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f00cc042070 con 0x7f00dc107690 2024-09-19T07:03:00.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:00.080+0000 7f00d97fa640 1 --2- 172.21.15.148:0/4234900561 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f00c80392a0 0x7f00c803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:00.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:00.080+0000 7f00e1f8e640 1 -- 172.21.15.148:0/4234900561 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00dc102d30 con 0x7f00dc107690 2024-09-19T07:03:00.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:00.080+0000 7f00d97fa640 1 -- 172.21.15.148:0/4234900561 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f00cc06cf80 con 0x7f00dc107690 2024-09-19T07:03:00.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:00.080+0000 7f00d3fff640 1 --2- 172.21.15.148:0/4234900561 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f00c80392a0 0x7f00c803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:00.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:00.081+0000 7f00d3fff640 1 --2- 172.21.15.148:0/4234900561 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f00c80392a0 0x7f00c803b760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f00c40098c0 tx=0x7f00c4006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:00.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:00.085+0000 7f00d97fa640 1 -- 172.21.15.148:0/4234900561 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f00cc0372d0 con 0x7f00dc107690 2024-09-19T07:03:00.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:00.264+0000 7f00e1f8e640 1 -- 172.21.15.148:0/4234900561 --> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f00dc107af0 con 0x7f00c80392a0 2024-09-19T07:03:00.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:00.265+0000 7f00d97fa640 1 -- 172.21.15.148:0/4234900561 <== mgr.14148 v2:172.21.15.148:6800/3007822654 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+241 (secure 0 0 0) 0x7f00dc107af0 con 0x7f00c80392a0 2024-09-19T07:03:00.266 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:03:00.266 INFO:teuthology.orchestra.run.smithi148.stdout:[{"addr": "172.21.15.148", "hostname": "smithi148", "labels": [], "status": ""}, {"addr": "172.21.15.165", "hostname": "smithi165", "labels": [], "status": ""}, {"addr": "172.21.15.179", "hostname": "smithi179", "labels": [], "status": ""}] 2024-09-19T07:03:00.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:00.267+0000 7f00e1f8e640 1 -- 172.21.15.148:0/4234900561 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f00c80392a0 msgr2=0x7f00c803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:00.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:00.267+0000 7f00e1f8e640 1 --2- 172.21.15.148:0/4234900561 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f00c80392a0 0x7f00c803b760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f00c40098c0 tx=0x7f00c4006db0 comp rx=0 tx=0).stop 2024-09-19T07:03:00.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:00.267+0000 7f00e1f8e640 1 -- 172.21.15.148:0/4234900561 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00dc107690 msgr2=0x7f00dc197170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:00.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:00.267+0000 7f00e1f8e640 1 --2- 172.21.15.148:0/4234900561 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00dc107690 0x7f00dc197170 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f00cc009230 tx=0x7f00cc003d40 comp rx=0 tx=0).stop 2024-09-19T07:03:00.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:00.267+0000 7f00e1f8e640 1 -- 172.21.15.148:0/4234900561 shutdown_connections 2024-09-19T07:03:00.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:00.267+0000 7f00e1f8e640 1 --2- 172.21.15.148:0/4234900561 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f00c80392a0 0x7f00c803b760 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:00.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:00.267+0000 7f00e1f8e640 1 --2- 172.21.15.148:0/4234900561 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00dc107690 0x7f00dc197170 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:00.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:00.267+0000 7f00e1f8e640 1 -- 172.21.15.148:0/4234900561 >> 172.21.15.148:0/4234900561 conn(0x7f00dc0fb920 msgr2=0x7f00dc0fd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:00.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:00.267+0000 7f00e1f8e640 1 -- 172.21.15.148:0/4234900561 shutdown_connections 2024-09-19T07:03:00.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:00.267+0000 7f00e1f8e640 1 -- 172.21.15.148:0/4234900561 wait complete. 2024-09-19T07:03:00.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:00 smithi148 ceph-mon[31180]: Updating smithi165:/var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T07:03:00.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:00 smithi148 ceph-mon[31180]: Added host smithi179 2024-09-19T07:03:00.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:00 smithi148 ceph-mon[31180]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:00.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:00 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:00.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:00 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:00.935 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-19T07:03:00.935 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-19T07:03:01.185 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:03:01.453 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:01 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:01.453 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:01 smithi148 ceph-mon[31180]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:03:01.453 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:01 smithi148 ceph-mon[31180]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:01.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:01.632+0000 7f0260579640 1 -- 172.21.15.148:0/448902305 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0258100990 msgr2=0x7f0258100d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:01.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:01.632+0000 7f0260579640 1 --2- 172.21.15.148:0/448902305 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0258100990 0x7f0258100d70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0254009880 tx=0x7f025402a5d0 comp rx=0 tx=0).stop 2024-09-19T07:03:01.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:01.632+0000 7f0260579640 1 -- 172.21.15.148:0/448902305 shutdown_connections 2024-09-19T07:03:01.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:01.632+0000 7f0260579640 1 --2- 172.21.15.148:0/448902305 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0258100990 0x7f0258100d70 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:01.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:01.632+0000 7f0260579640 1 -- 172.21.15.148:0/448902305 >> 172.21.15.148:0/448902305 conn(0x7f0258076250 msgr2=0x7f0258076660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:01.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:01.633+0000 7f0260579640 1 -- 172.21.15.148:0/448902305 shutdown_connections 2024-09-19T07:03:01.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:01.633+0000 7f0260579640 1 -- 172.21.15.148:0/448902305 wait complete. 2024-09-19T07:03:01.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:01.633+0000 7f0260579640 1 Processor -- start 2024-09-19T07:03:01.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:01.633+0000 7f0260579640 1 -- start start 2024-09-19T07:03:01.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:01.633+0000 7f0260579640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0258100990 0x7f0258199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:01.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:01.634+0000 7f0260579640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f025810ab90 con 0x7f0258100990 2024-09-19T07:03:01.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:01.634+0000 7f025e315640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0258100990 0x7f0258199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:01.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:01.634+0000 7f025e315640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0258100990 0x7f0258199360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56188/0 (socket says 172.21.15.148:56188) 2024-09-19T07:03:01.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:01.634+0000 7f025e315640 1 -- 172.21.15.148:0/2727274483 learned_addr learned my addr 172.21.15.148:0/2727274483 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:03:01.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:01.634+0000 7f025e315640 1 -- 172.21.15.148:0/2727274483 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02581998a0 con 0x7f0258100990 2024-09-19T07:03:01.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:01.634+0000 7f025e315640 1 --2- 172.21.15.148:0/2727274483 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0258100990 0x7f0258199360 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0254009230 tx=0x7f0254003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:01.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:01.635+0000 7f024f7fe640 1 -- 172.21.15.148:0/2727274483 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f025404c070 con 0x7f0258100990 2024-09-19T07:03:01.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:01.635+0000 7f024f7fe640 1 -- 172.21.15.148:0/2727274483 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0254003db0 con 0x7f0258100990 2024-09-19T07:03:01.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:01.635+0000 7f024f7fe640 1 -- 172.21.15.148:0/2727274483 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0254035070 con 0x7f0258100990 2024-09-19T07:03:01.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:01.635+0000 7f0260579640 1 -- 172.21.15.148:0/2727274483 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0258199b30 con 0x7f0258100990 2024-09-19T07:03:01.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:01.635+0000 7f0260579640 1 -- 172.21.15.148:0/2727274483 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f025819dc30 con 0x7f0258100990 2024-09-19T07:03:01.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:01.635+0000 7f024f7fe640 1 -- 172.21.15.148:0/2727274483 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f025404f070 con 0x7f0258100990 2024-09-19T07:03:01.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:01.636+0000 7f024f7fe640 1 --2- 172.21.15.148:0/2727274483 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f02440392a0 0x7f024403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:01.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:01.636+0000 7f024f7fe640 1 -- 172.21.15.148:0/2727274483 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f0254044070 con 0x7f0258100990 2024-09-19T07:03:01.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:01.636+0000 7f0260579640 1 -- 172.21.15.148:0/2727274483 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0258101c40 con 0x7f0258100990 2024-09-19T07:03:01.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:01.636+0000 7f025db14640 1 --2- 172.21.15.148:0/2727274483 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f02440392a0 0x7f024403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:01.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:01.636+0000 7f025db14640 1 --2- 172.21.15.148:0/2727274483 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f02440392a0 0x7f024403b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f02480098c0 tx=0x7f0248006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:01.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:01.641+0000 7f024f7fe640 1 -- 172.21.15.148:0/2727274483 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f02540071c0 con 0x7f0258100990 2024-09-19T07:03:01.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:01.812+0000 7f0260579640 1 -- 172.21.15.148:0/2727274483 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f025819a6c0 con 0x7f0258100990 2024-09-19T07:03:02.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:02.163+0000 7f024f7fe640 1 -- 172.21.15.148:0/2727274483 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f025404f760 con 0x7f0258100990 2024-09-19T07:03:02.164 INFO:teuthology.orchestra.run.smithi148.stderr:adjusted tunables profile to default 2024-09-19T07:03:02.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:02.166+0000 7f0260579640 1 -- 172.21.15.148:0/2727274483 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f02440392a0 msgr2=0x7f024403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:02.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:02.166+0000 7f0260579640 1 --2- 172.21.15.148:0/2727274483 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f02440392a0 0x7f024403b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f02480098c0 tx=0x7f0248006db0 comp rx=0 tx=0).stop 2024-09-19T07:03:02.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:02.166+0000 7f0260579640 1 -- 172.21.15.148:0/2727274483 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0258100990 msgr2=0x7f0258199360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:02.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:02.166+0000 7f0260579640 1 --2- 172.21.15.148:0/2727274483 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0258100990 0x7f0258199360 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0254009230 tx=0x7f0254003820 comp rx=0 tx=0).stop 2024-09-19T07:03:02.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:02.166+0000 7f0260579640 1 -- 172.21.15.148:0/2727274483 shutdown_connections 2024-09-19T07:03:02.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:02.166+0000 7f0260579640 1 --2- 172.21.15.148:0/2727274483 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f02440392a0 0x7f024403b760 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:02.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:02.166+0000 7f0260579640 1 --2- 172.21.15.148:0/2727274483 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0258100990 0x7f0258199360 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:02.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:02.166+0000 7f0260579640 1 -- 172.21.15.148:0/2727274483 >> 172.21.15.148:0/2727274483 conn(0x7f0258076250 msgr2=0x7f0258069fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:02.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:02.166+0000 7f0260579640 1 -- 172.21.15.148:0/2727274483 shutdown_connections 2024-09-19T07:03:02.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:02.166+0000 7f0260579640 1 -- 172.21.15.148:0/2727274483 wait complete. 2024-09-19T07:03:02.471 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:02 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/2727274483' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T07:03:02.792 INFO:tasks.cephadm:Adding mon.a on smithi148 2024-09-19T07:03:02.792 INFO:tasks.cephadm:Adding mon.b on smithi165 2024-09-19T07:03:02.792 INFO:tasks.cephadm:Adding mon.c on smithi179 2024-09-19T07:03:02.792 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph orch apply mon '3;smithi148:172.21.15.148=a;smithi165:172.21.15.165=b;smithi179:172.21.15.179=c' 2024-09-19T07:03:03.160 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T07:03:03.208 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T07:03:03.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:03 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/2727274483' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T07:03:03.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:03 smithi148 ceph-mon[31180]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T07:03:03.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:03 smithi148 ceph-mon[31180]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:03.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:03 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:03.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:03 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:03.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:03 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:03.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:03 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:03.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:03 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi179", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:03:03.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:03 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:03.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:03 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:03:03.750 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:03.717+0000 7f72c47a3640 1 -- 172.21.15.179:0/2569833192 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72bc101620 msgr2=0x7f72bc101a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:03.750 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:03.717+0000 7f72c47a3640 1 --2- 172.21.15.179:0/2569833192 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72bc101620 0x7f72bc101a20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f72b8009880 tx=0x7f72b802a5d0 comp rx=0 tx=0).stop 2024-09-19T07:03:03.750 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:03.717+0000 7f72c47a3640 1 -- 172.21.15.179:0/2569833192 shutdown_connections 2024-09-19T07:03:03.750 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:03.717+0000 7f72c47a3640 1 --2- 172.21.15.179:0/2569833192 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72bc101620 0x7f72bc101a20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:03.751 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:03.717+0000 7f72c47a3640 1 -- 172.21.15.179:0/2569833192 >> 172.21.15.179:0/2569833192 conn(0x7f72bc0fcdb0 msgr2=0x7f72bc0ff1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:03.751 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:03.717+0000 7f72c47a3640 1 -- 172.21.15.179:0/2569833192 shutdown_connections 2024-09-19T07:03:03.751 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:03.717+0000 7f72c47a3640 1 -- 172.21.15.179:0/2569833192 wait complete. 2024-09-19T07:03:03.751 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:03.717+0000 7f72c47a3640 1 Processor -- start 2024-09-19T07:03:03.751 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:03.717+0000 7f72c47a3640 1 -- start start 2024-09-19T07:03:03.751 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:03.718+0000 7f72c47a3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72bc101620 0x7f72bc196d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:03.751 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:03.718+0000 7f72c47a3640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f72bc107730 con 0x7f72bc101620 2024-09-19T07:03:03.751 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:03.718+0000 7f72c253f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72bc101620 0x7f72bc196d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:03.751 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:03.718+0000 7f72c253f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72bc101620 0x7f72bc196d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.179:55578/0 (socket says 172.21.15.179:55578) 2024-09-19T07:03:03.752 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:03.718+0000 7f72c253f640 1 -- 172.21.15.179:0/3117066152 learned_addr learned my addr 172.21.15.179:0/3117066152 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-09-19T07:03:03.752 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:03.718+0000 7f72c253f640 1 -- 172.21.15.179:0/3117066152 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72bc197270 con 0x7f72bc101620 2024-09-19T07:03:03.752 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:03.718+0000 7f72c253f640 1 --2- 172.21.15.179:0/3117066152 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72bc101620 0x7f72bc196d30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f72b8004f60 tx=0x7f72b80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:03.752 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:03.718+0000 7f72b37fe640 1 -- 172.21.15.179:0/3117066152 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72b803f070 con 0x7f72bc101620 2024-09-19T07:03:03.752 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:03.719+0000 7f72b37fe640 1 -- 172.21.15.179:0/3117066152 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72b8004d40 con 0x7f72bc101620 2024-09-19T07:03:03.752 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:03.719+0000 7f72c47a3640 1 -- 172.21.15.179:0/3117066152 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72bc197500 con 0x7f72bc101620 2024-09-19T07:03:03.752 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:03.719+0000 7f72b37fe640 1 -- 172.21.15.179:0/3117066152 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72b8035030 con 0x7f72bc101620 2024-09-19T07:03:03.752 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:03.719+0000 7f72c47a3640 1 -- 172.21.15.179:0/3117066152 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72bc19a1f0 con 0x7f72bc101620 2024-09-19T07:03:03.752 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:03.719+0000 7f72b37fe640 1 -- 172.21.15.179:0/3117066152 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f72b8042070 con 0x7f72bc101620 2024-09-19T07:03:03.752 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:03.720+0000 7f72c47a3640 1 -- 172.21.15.179:0/3117066152 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72bc107eb0 con 0x7f72bc101620 2024-09-19T07:03:03.753 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:03.720+0000 7f72b37fe640 1 --2- 172.21.15.179:0/3117066152 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f72a80392a0 0x7f72a803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:03.753 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:03.720+0000 7f72b37fe640 1 -- 172.21.15.179:0/3117066152 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f72b806d260 con 0x7f72bc101620 2024-09-19T07:03:03.753 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:03.720+0000 7f72c1d3e640 1 --2- 172.21.15.179:0/3117066152 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f72a80392a0 0x7f72a803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:03.753 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:03.720+0000 7f72c1d3e640 1 --2- 172.21.15.179:0/3117066152 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f72a80392a0 0x7f72a803b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f72ac0098c0 tx=0x7f72ac006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:03.753 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:03.725+0000 7f72b37fe640 1 -- 172.21.15.179:0/3117066152 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f72b80307a0 con 0x7f72bc101620 2024-09-19T07:03:03.916 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:03.915+0000 7f72c47a3640 1 -- 172.21.15.179:0/3117066152 --> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi148:172.21.15.148=a;smithi165:172.21.15.165=b;smithi179:172.21.15.179=c", "target": ["mon-mgr", ""]}) -- 0x7f72bc02d8f0 con 0x7f72a80392a0 2024-09-19T07:03:03.922 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:03.921+0000 7f72b37fe640 1 -- 172.21.15.179:0/3117066152 <== mgr.14148 v2:172.21.15.148:6800/3007822654 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f72bc02d8f0 con 0x7f72a80392a0 2024-09-19T07:03:03.922 INFO:teuthology.orchestra.run.smithi179.stdout:Scheduled mon update... 2024-09-19T07:03:03.924 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:03.923+0000 7f72c47a3640 1 -- 172.21.15.179:0/3117066152 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f72a80392a0 msgr2=0x7f72a803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:03.924 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:03.923+0000 7f72c47a3640 1 --2- 172.21.15.179:0/3117066152 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f72a80392a0 0x7f72a803b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f72ac0098c0 tx=0x7f72ac006db0 comp rx=0 tx=0).stop 2024-09-19T07:03:03.925 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:03.923+0000 7f72c47a3640 1 -- 172.21.15.179:0/3117066152 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72bc101620 msgr2=0x7f72bc196d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:03.925 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:03.923+0000 7f72c47a3640 1 --2- 172.21.15.179:0/3117066152 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72bc101620 0x7f72bc196d30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f72b8004f60 tx=0x7f72b80048f0 comp rx=0 tx=0).stop 2024-09-19T07:03:03.925 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:03.923+0000 7f72c47a3640 1 -- 172.21.15.179:0/3117066152 shutdown_connections 2024-09-19T07:03:03.925 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:03.923+0000 7f72c47a3640 1 --2- 172.21.15.179:0/3117066152 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f72a80392a0 0x7f72a803b760 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:03.925 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:03.923+0000 7f72c47a3640 1 --2- 172.21.15.179:0/3117066152 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72bc101620 0x7f72bc196d30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:03.925 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:03.923+0000 7f72c47a3640 1 -- 172.21.15.179:0/3117066152 >> 172.21.15.179:0/3117066152 conn(0x7f72bc0fcdb0 msgr2=0x7f72bc0fd7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:03.925 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:03.923+0000 7f72c47a3640 1 -- 172.21.15.179:0/3117066152 shutdown_connections 2024-09-19T07:03:03.925 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:03.923+0000 7f72c47a3640 1 -- 172.21.15.179:0/3117066152 wait complete. 2024-09-19T07:03:04.624 DEBUG:teuthology.orchestra.run.smithi165:mon.b> sudo journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mon.b.service 2024-09-19T07:03:04.627 DEBUG:teuthology.orchestra.run.smithi179:mon.c> sudo journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mon.c.service 2024-09-19T07:03:04.630 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T07:03:04.630 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T07:03:05.268 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:03:05.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:04 smithi148 ceph-mon[31180]: Updating smithi179:/etc/ceph/ceph.conf 2024-09-19T07:03:05.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:04 smithi148 ceph-mon[31180]: Updating smithi179:/var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:03:05.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:04 smithi148 ceph-mon[31180]: Updating smithi179:/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:03:05.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:04 smithi148 ceph-mon[31180]: Updating smithi179:/var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T07:03:05.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:04 smithi148 ceph-mon[31180]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi148:172.21.15.148=a;smithi165:172.21.15.165=b;smithi179:172.21.15.179=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:03:05.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:04 smithi148 ceph-mon[31180]: Saving service mon spec with placement smithi148:172.21.15.148=a;smithi165:172.21.15.165=b;smithi179:172.21.15.179=c;count:3 2024-09-19T07:03:05.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:04 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:05.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:04 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:05.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:04 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:05.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:04 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:05.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:04 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T07:03:05.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:04 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:05.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:04 smithi148 ceph-mon[31180]: Deploying daemon mon.c on smithi179 2024-09-19T07:03:06.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:05 smithi148 ceph-mon[31180]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:07.210 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:07.191+0000 7fb8a2ce1640 1 -- 172.21.15.179:0/2230229006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb89c100990 msgr2=0x7fb89c100d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:07.210 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:07.191+0000 7fb8a2ce1640 1 --2- 172.21.15.179:0/2230229006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb89c100990 0x7fb89c100d70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb890009880 tx=0x7fb89002a5d0 comp rx=0 tx=0).stop 2024-09-19T07:03:07.210 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:07.191+0000 7fb8a2ce1640 1 -- 172.21.15.179:0/2230229006 shutdown_connections 2024-09-19T07:03:07.210 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:07.191+0000 7fb8a2ce1640 1 --2- 172.21.15.179:0/2230229006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb89c100990 0x7fb89c100d70 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:07.210 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:07.191+0000 7fb8a2ce1640 1 -- 172.21.15.179:0/2230229006 >> 172.21.15.179:0/2230229006 conn(0x7fb89c076250 msgr2=0x7fb89c076660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:07.210 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:07.191+0000 7fb8a2ce1640 1 -- 172.21.15.179:0/2230229006 shutdown_connections 2024-09-19T07:03:07.210 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:07.191+0000 7fb8a2ce1640 1 -- 172.21.15.179:0/2230229006 wait complete. 2024-09-19T07:03:07.210 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:07.192+0000 7fb8a2ce1640 1 Processor -- start 2024-09-19T07:03:07.210 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:07.192+0000 7fb8a2ce1640 1 -- start start 2024-09-19T07:03:07.210 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:07.192+0000 7fb8a2ce1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb89c100990 0x7fb89c195e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:07.211 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:07.192+0000 7fb8a2ce1640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb89c10ab90 con 0x7fb89c100990 2024-09-19T07:03:07.211 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:07.192+0000 7fb8a0a7d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb89c100990 0x7fb89c195e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:07.211 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:07.192+0000 7fb8a0a7d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb89c100990 0x7fb89c195e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.179:48362/0 (socket says 172.21.15.179:48362) 2024-09-19T07:03:07.211 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:07.192+0000 7fb8a0a7d640 1 -- 172.21.15.179:0/2852658361 learned_addr learned my addr 172.21.15.179:0/2852658361 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-09-19T07:03:07.211 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:07.193+0000 7fb8a0a7d640 1 -- 172.21.15.179:0/2852658361 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb89c06a4e0 con 0x7fb89c100990 2024-09-19T07:03:07.211 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:07.193+0000 7fb8a0a7d640 1 --2- 172.21.15.179:0/2852658361 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb89c100990 0x7fb89c195e90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb890009230 tx=0x7fb890003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:07.211 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:07.193+0000 7fb899ffb640 1 -- 172.21.15.179:0/2852658361 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb89003f070 con 0x7fb89c100990 2024-09-19T07:03:07.211 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:07.193+0000 7fb899ffb640 1 -- 172.21.15.179:0/2852658361 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb89003bc80 con 0x7fb89c100990 2024-09-19T07:03:07.211 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:07.193+0000 7fb8a2ce1640 1 -- 172.21.15.179:0/2852658361 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb89c1963d0 con 0x7fb89c100990 2024-09-19T07:03:07.211 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:07.193+0000 7fb899ffb640 1 -- 172.21.15.179:0/2852658361 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb890035030 con 0x7fb89c100990 2024-09-19T07:03:07.211 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:07.193+0000 7fb8a2ce1640 1 -- 172.21.15.179:0/2852658361 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb89c196890 con 0x7fb89c100990 2024-09-19T07:03:07.211 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:07.194+0000 7fb899ffb640 1 -- 172.21.15.179:0/2852658361 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7fb890042070 con 0x7fb89c100990 2024-09-19T07:03:07.211 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:07.194+0000 7fb899ffb640 1 --2- 172.21.15.179:0/2852658361 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fb88c0392a0 0x7fb88c03b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:07.211 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:07.195+0000 7fb899ffb640 1 -- 172.21.15.179:0/2852658361 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb89006d040 con 0x7fb89c100990 2024-09-19T07:03:07.211 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:07.195+0000 7fb89bfff640 1 --2- 172.21.15.179:0/2852658361 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fb88c0392a0 0x7fb88c03b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:07.212 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:07.195+0000 7fb8a2ce1640 1 -- 172.21.15.179:0/2852658361 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb89c101c40 con 0x7fb89c100990 2024-09-19T07:03:07.212 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:07.195+0000 7fb89bfff640 1 --2- 172.21.15.179:0/2852658361 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fb88c0392a0 0x7fb88c03b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb8880098c0 tx=0x7fb888006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:07.212 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:07.200+0000 7fb899ffb640 1 -- 172.21.15.179:0/2852658361 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb8900372d0 con 0x7fb89c100990 2024-09-19T07:03:07.462 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:07.461+0000 7fb8a2ce1640 1 -- 172.21.15.179:0/2852658361 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fb89c069cb0 con 0x7fb89c100990 2024-09-19T07:03:07.462 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:07.462+0000 7fb899ffb640 1 -- 172.21.15.179:0/2852658361 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+749 (secure 0 0 0) 0x7fb8900314c0 con 0x7fb89c100990 2024-09-19T07:03:07.463 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-19T07:03:07.463 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":1,"fsid":"eae8a4a8-7654-11ef-bceb-c7b262605968","modified":"2024-09-19T07:01:44.959428Z","created":"2024-09-19T07:01:44.959428Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T07:03:07.463 INFO:teuthology.orchestra.run.smithi179.stderr:dumped monmap epoch 1 2024-09-19T07:03:07.466 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:07.465+0000 7fb8a2ce1640 1 -- 172.21.15.179:0/2852658361 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fb88c0392a0 msgr2=0x7fb88c03b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:07.466 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:07.465+0000 7fb8a2ce1640 1 --2- 172.21.15.179:0/2852658361 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fb88c0392a0 0x7fb88c03b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb8880098c0 tx=0x7fb888006db0 comp rx=0 tx=0).stop 2024-09-19T07:03:07.466 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:07.465+0000 7fb8a2ce1640 1 -- 172.21.15.179:0/2852658361 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb89c100990 msgr2=0x7fb89c195e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:07.466 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:07.465+0000 7fb8a2ce1640 1 --2- 172.21.15.179:0/2852658361 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb89c100990 0x7fb89c195e90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb890009230 tx=0x7fb890003d40 comp rx=0 tx=0).stop 2024-09-19T07:03:07.466 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:07.465+0000 7fb8a2ce1640 1 -- 172.21.15.179:0/2852658361 shutdown_connections 2024-09-19T07:03:07.466 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:07.465+0000 7fb8a2ce1640 1 --2- 172.21.15.179:0/2852658361 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fb88c0392a0 0x7fb88c03b760 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:07.466 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:07.465+0000 7fb8a2ce1640 1 --2- 172.21.15.179:0/2852658361 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb89c100990 0x7fb89c195e90 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:07.466 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:07.465+0000 7fb8a2ce1640 1 -- 172.21.15.179:0/2852658361 >> 172.21.15.179:0/2852658361 conn(0x7fb89c076250 msgr2=0x7fb89c1020c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:07.466 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:07.465+0000 7fb8a2ce1640 1 -- 172.21.15.179:0/2852658361 shutdown_connections 2024-09-19T07:03:07.467 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:07.465+0000 7fb8a2ce1640 1 -- 172.21.15.179:0/2852658361 wait complete. 2024-09-19T07:03:07.759 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:07 smithi179 systemd[1]: Starting Ceph mon.c for eae8a4a8-7654-11ef-bceb-c7b262605968... 2024-09-19T07:03:08.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 podman[35696]: 2024-09-19 07:03:08.119619012 +0000 UTC m=+0.015837328 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:03:08.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 podman[35696]: 2024-09-19 07:03:08.21708569 +0000 UTC m=+0.113303996 container create 1e64fd3b171300230f246009e665796b80e1c37437e86555db0f896e20188481 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mon-c, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-19T07:03:08.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:08 smithi148 ceph-mon[31180]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:08.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:08 smithi148 ceph-mon[31180]: from='client.? 172.21.15.179:0/2852658361' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T07:03:08.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 podman[35696]: 2024-09-19 07:03:08.419962506 +0000 UTC m=+0.316180812 container init 1e64fd3b171300230f246009e665796b80e1c37437e86555db0f896e20188481 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mon-c, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-19T07:03:08.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 podman[35696]: 2024-09-19 07:03:08.423278363 +0000 UTC m=+0.319496675 container start 1e64fd3b171300230f246009e665796b80e1c37437e86555db0f896e20188481 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mon-c, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-19T07:03:08.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T07:03:08.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T07:03:08.774 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: pidfile_write: ignore empty --pid-file 2024-09-19T07:03:08.774 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: load: jerasure load: lrc 2024-09-19T07:03:08.774 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: RocksDB version: 7.9.2 2024-09-19T07:03:08.774 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Git sha 0 2024-09-19T07:03:08.774 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T07:03:08.774 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: DB SUMMARY 2024-09-19T07:03:08.774 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: DB Session ID: E7HR5PWCUC6ZU7Y0SZ6P 2024-09-19T07:03:08.774 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: CURRENT file: CURRENT 2024-09-19T07:03:08.774 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T07:03:08.774 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-19T07:03:08.774 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-19T07:03:08.774 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-19T07:03:08.775 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.error_if_exists: 0 2024-09-19T07:03:08.775 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.create_if_missing: 0 2024-09-19T07:03:08.775 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.paranoid_checks: 1 2024-09-19T07:03:08.775 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T07:03:08.775 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T07:03:08.775 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T07:03:08.775 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.env: 0x55f101c6e940 2024-09-19T07:03:08.775 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T07:03:08.775 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.info_log: 0x55f10404d6e0 2024-09-19T07:03:08.775 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T07:03:08.775 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.statistics: (nil) 2024-09-19T07:03:08.775 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.use_fsync: 0 2024-09-19T07:03:08.775 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.max_log_file_size: 0 2024-09-19T07:03:08.776 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T07:03:08.776 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T07:03:08.776 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T07:03:08.776 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T07:03:08.776 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.allow_fallocate: 1 2024-09-19T07:03:08.776 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T07:03:08.776 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T07:03:08.776 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.use_direct_reads: 0 2024-09-19T07:03:08.776 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T07:03:08.776 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T07:03:08.776 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.db_log_dir: 2024-09-19T07:03:08.776 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.wal_dir: 2024-09-19T07:03:08.776 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T07:03:08.777 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T07:03:08.777 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T07:03:08.777 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T07:03:08.777 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T07:03:08.777 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T07:03:08.777 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T07:03:08.777 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T07:03:08.777 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.write_buffer_manager: 0x55f10405cdc0 2024-09-19T07:03:08.777 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T07:03:08.777 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T07:03:08.777 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T07:03:08.777 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T07:03:08.778 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T07:03:08.778 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T07:03:08.778 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T07:03:08.778 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T07:03:08.778 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.unordered_write: 0 2024-09-19T07:03:08.778 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T07:03:08.778 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T07:03:08.778 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T07:03:08.778 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T07:03:08.778 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.row_cache: None 2024-09-19T07:03:08.778 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.wal_filter: None 2024-09-19T07:03:08.780 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T07:03:08.780 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T07:03:08.780 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.two_write_queues: 0 2024-09-19T07:03:08.780 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T07:03:08.780 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.wal_compression: 0 2024-09-19T07:03:08.780 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.atomic_flush: 0 2024-09-19T07:03:08.780 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T07:03:08.780 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T07:03:08.780 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T07:03:08.781 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.log_readahead_size: 0 2024-09-19T07:03:08.781 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T07:03:08.781 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T07:03:08.781 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T07:03:08.781 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T07:03:08.781 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T07:03:08.781 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T07:03:08.781 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T07:03:08.781 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.max_background_jobs: 2 2024-09-19T07:03:08.781 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.max_background_compactions: -1 2024-09-19T07:03:08.781 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.max_subcompactions: 1 2024-09-19T07:03:08.781 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T07:03:08.781 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T07:03:08.782 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T07:03:08.782 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T07:03:08.782 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T07:03:08.782 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T07:03:08.782 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T07:03:08.782 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T07:03:08.782 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.max_open_files: -1 2024-09-19T07:03:08.782 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T07:03:08.782 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T07:03:08.782 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T07:03:08.782 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T07:03:08.782 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.max_background_flushes: -1 2024-09-19T07:03:08.782 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Compression algorithms supported: 2024-09-19T07:03:08.783 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: kZSTD supported: 0 2024-09-19T07:03:08.783 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: kXpressCompression supported: 0 2024-09-19T07:03:08.783 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: kBZip2Compression supported: 0 2024-09-19T07:03:08.783 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T07:03:08.783 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: kLZ4Compression supported: 1 2024-09-19T07:03:08.783 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: kZlibCompression supported: 1 2024-09-19T07:03:08.783 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T07:03:08.783 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: kSnappyCompression supported: 1 2024-09-19T07:03:08.783 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T07:03:08.783 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T07:03:08.783 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-19T07:03:08.783 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T07:03:08.783 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T07:03:08.783 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.merge_operator: 2024-09-19T07:03:08.784 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.compaction_filter: None 2024-09-19T07:03:08.784 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T07:03:08.784 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T07:03:08.784 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T07:03:08.784 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T07:03:08.784 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55f10404d320) 2024-09-19T07:03:08.784 INFO:journalctl@ceph.mon.c.smithi179.stdout: cache_index_and_filter_blocks: 1 2024-09-19T07:03:08.784 INFO:journalctl@ceph.mon.c.smithi179.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T07:03:08.784 INFO:journalctl@ceph.mon.c.smithi179.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T07:03:08.785 INFO:journalctl@ceph.mon.c.smithi179.stdout: pin_top_level_index_and_filter: 1 2024-09-19T07:03:08.785 INFO:journalctl@ceph.mon.c.smithi179.stdout: index_type: 0 2024-09-19T07:03:08.785 INFO:journalctl@ceph.mon.c.smithi179.stdout: data_block_index_type: 0 2024-09-19T07:03:08.785 INFO:journalctl@ceph.mon.c.smithi179.stdout: index_shortening: 1 2024-09-19T07:03:08.785 INFO:journalctl@ceph.mon.c.smithi179.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T07:03:08.785 INFO:journalctl@ceph.mon.c.smithi179.stdout: checksum: 4 2024-09-19T07:03:08.785 INFO:journalctl@ceph.mon.c.smithi179.stdout: no_block_cache: 0 2024-09-19T07:03:08.785 INFO:journalctl@ceph.mon.c.smithi179.stdout: block_cache: 0x55f1040411f0 2024-09-19T07:03:08.785 INFO:journalctl@ceph.mon.c.smithi179.stdout: block_cache_name: BinnedLRUCache 2024-09-19T07:03:08.785 INFO:journalctl@ceph.mon.c.smithi179.stdout: block_cache_options: 2024-09-19T07:03:08.786 INFO:journalctl@ceph.mon.c.smithi179.stdout: capacity : 536870912 2024-09-19T07:03:08.786 INFO:journalctl@ceph.mon.c.smithi179.stdout: num_shard_bits : 4 2024-09-19T07:03:08.786 INFO:journalctl@ceph.mon.c.smithi179.stdout: strict_capacity_limit : 0 2024-09-19T07:03:08.786 INFO:journalctl@ceph.mon.c.smithi179.stdout: high_pri_pool_ratio: 0.000 2024-09-19T07:03:08.786 INFO:journalctl@ceph.mon.c.smithi179.stdout: block_cache_compressed: (nil) 2024-09-19T07:03:08.786 INFO:journalctl@ceph.mon.c.smithi179.stdout: persistent_cache: (nil) 2024-09-19T07:03:08.786 INFO:journalctl@ceph.mon.c.smithi179.stdout: block_size: 4096 2024-09-19T07:03:08.786 INFO:journalctl@ceph.mon.c.smithi179.stdout: block_size_deviation: 10 2024-09-19T07:03:08.786 INFO:journalctl@ceph.mon.c.smithi179.stdout: block_restart_interval: 16 2024-09-19T07:03:08.786 INFO:journalctl@ceph.mon.c.smithi179.stdout: index_block_restart_interval: 1 2024-09-19T07:03:08.786 INFO:journalctl@ceph.mon.c.smithi179.stdout: metadata_block_size: 4096 2024-09-19T07:03:08.786 INFO:journalctl@ceph.mon.c.smithi179.stdout: partition_filters: 0 2024-09-19T07:03:08.786 INFO:journalctl@ceph.mon.c.smithi179.stdout: use_delta_encoding: 1 2024-09-19T07:03:08.787 INFO:journalctl@ceph.mon.c.smithi179.stdout: filter_policy: bloomfilter 2024-09-19T07:03:08.787 INFO:journalctl@ceph.mon.c.smithi179.stdout: whole_key_filtering: 1 2024-09-19T07:03:08.787 INFO:journalctl@ceph.mon.c.smithi179.stdout: verify_compression: 0 2024-09-19T07:03:08.787 INFO:journalctl@ceph.mon.c.smithi179.stdout: read_amp_bytes_per_bit: 0 2024-09-19T07:03:08.787 INFO:journalctl@ceph.mon.c.smithi179.stdout: format_version: 5 2024-09-19T07:03:08.787 INFO:journalctl@ceph.mon.c.smithi179.stdout: enable_index_compression: 1 2024-09-19T07:03:08.787 INFO:journalctl@ceph.mon.c.smithi179.stdout: block_align: 0 2024-09-19T07:03:08.787 INFO:journalctl@ceph.mon.c.smithi179.stdout: max_auto_readahead_size: 262144 2024-09-19T07:03:08.787 INFO:journalctl@ceph.mon.c.smithi179.stdout: prepopulate_block_cache: 0 2024-09-19T07:03:08.787 INFO:journalctl@ceph.mon.c.smithi179.stdout: initial_auto_readahead_size: 8192 2024-09-19T07:03:08.787 INFO:journalctl@ceph.mon.c.smithi179.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T07:03:08.787 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T07:03:08.787 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T07:03:08.787 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.compression: NoCompression 2024-09-19T07:03:08.788 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T07:03:08.788 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T07:03:08.788 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T07:03:08.788 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.num_levels: 7 2024-09-19T07:03:08.788 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T07:03:08.788 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T07:03:08.788 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T07:03:08.788 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T07:03:08.788 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T07:03:08.788 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T07:03:08.788 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T07:03:08.788 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T07:03:08.789 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T07:03:08.789 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T07:03:08.789 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T07:03:08.789 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T07:03:08.789 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T07:03:08.789 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T07:03:08.789 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T07:03:08.789 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T07:03:08.789 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T07:03:08.789 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T07:03:08.789 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T07:03:08.789 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T07:03:08.789 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T07:03:08.789 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T07:03:08.790 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T07:03:08.790 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T07:03:08.790 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T07:03:08.790 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T07:03:08.790 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T07:03:08.790 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T07:03:08.790 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T07:03:08.790 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T07:03:08.790 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T07:03:08.790 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T07:03:08.790 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T07:03:08.790 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T07:03:08.790 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T07:03:08.791 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T07:03:08.791 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T07:03:08.791 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T07:03:08.791 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T07:03:08.791 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T07:03:08.791 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T07:03:08.791 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T07:03:08.791 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T07:03:08.791 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T07:03:08.791 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T07:03:08.791 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T07:03:08.791 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T07:03:08.792 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T07:03:08.792 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T07:03:08.792 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T07:03:08.792 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T07:03:08.792 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T07:03:08.792 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T07:03:08.792 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T07:03:08.792 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.inplace_update_support: 0 2024-09-19T07:03:08.792 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T07:03:08.792 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T07:03:08.792 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T07:03:08.792 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T07:03:08.792 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.bloom_locality: 0 2024-09-19T07:03:08.793 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.max_successive_merges: 0 2024-09-19T07:03:08.793 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T07:03:08.793 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T07:03:08.793 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T07:03:08.793 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T07:03:08.793 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.ttl: 2592000 2024-09-19T07:03:08.793 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T07:03:08.793 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T07:03:08.793 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T07:03:08.793 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.enable_blob_files: false 2024-09-19T07:03:08.793 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.min_blob_size: 0 2024-09-19T07:03:08.793 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T07:03:08.793 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T07:03:08.794 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T07:03:08.794 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T07:03:08.794 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T07:03:08.794 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T07:03:08.794 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T07:03:08.794 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T07:03:08.794 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-19T07:03:08.794 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-19T07:03:08.794 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 3c8c9f29-df94-4bde-a6e1-5a3d8d9691af 2024-09-19T07:03:08.794 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726729388451103, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-19T07:03:08.794 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-19T07:03:08.794 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726729388451516, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726729388, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "3c8c9f29-df94-4bde-a6e1-5a3d8d9691af", "db_session_id": "E7HR5PWCUC6ZU7Y0SZ6P", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-19T07:03:08.794 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726729388451610, "job": 1, "event": "recovery_finished"} 2024-09-19T07:03:08.795 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-19T07:03:08.795 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T07:03:08.795 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55f10406ee00 2024-09-19T07:03:08.795 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: DB pointer 0x55f10416a000 2024-09-19T07:03:08.795 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T07:03:08.795 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T07:03:08.795 INFO:journalctl@ceph.mon.c.smithi179.stdout: ** DB Stats ** 2024-09-19T07:03:08.795 INFO:journalctl@ceph.mon.c.smithi179.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T07:03:08.795 INFO:journalctl@ceph.mon.c.smithi179.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T07:03:08.795 INFO:journalctl@ceph.mon.c.smithi179.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T07:03:08.795 INFO:journalctl@ceph.mon.c.smithi179.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T07:03:08.795 INFO:journalctl@ceph.mon.c.smithi179.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T07:03:08.795 INFO:journalctl@ceph.mon.c.smithi179.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T07:03:08.795 INFO:journalctl@ceph.mon.c.smithi179.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T07:03:08.796 INFO:journalctl@ceph.mon.c.smithi179.stdout: 2024-09-19T07:03:08.796 INFO:journalctl@ceph.mon.c.smithi179.stdout: ** Compaction Stats [default] ** 2024-09-19T07:03:08.796 INFO:journalctl@ceph.mon.c.smithi179.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T07:03:08.796 INFO:journalctl@ceph.mon.c.smithi179.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T07:03:08.796 INFO:journalctl@ceph.mon.c.smithi179.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T07:03:08.796 INFO:journalctl@ceph.mon.c.smithi179.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T07:03:08.796 INFO:journalctl@ceph.mon.c.smithi179.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T07:03:08.796 INFO:journalctl@ceph.mon.c.smithi179.stdout: 2024-09-19T07:03:08.796 INFO:journalctl@ceph.mon.c.smithi179.stdout: ** Compaction Stats [default] ** 2024-09-19T07:03:08.796 INFO:journalctl@ceph.mon.c.smithi179.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T07:03:08.796 INFO:journalctl@ceph.mon.c.smithi179.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T07:03:08.796 INFO:journalctl@ceph.mon.c.smithi179.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T07:03:08.796 INFO:journalctl@ceph.mon.c.smithi179.stdout: 2024-09-19T07:03:08.796 INFO:journalctl@ceph.mon.c.smithi179.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T07:03:08.797 INFO:journalctl@ceph.mon.c.smithi179.stdout: 2024-09-19T07:03:08.797 INFO:journalctl@ceph.mon.c.smithi179.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T07:03:08.797 INFO:journalctl@ceph.mon.c.smithi179.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T07:03:08.797 INFO:journalctl@ceph.mon.c.smithi179.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T07:03:08.797 INFO:journalctl@ceph.mon.c.smithi179.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T07:03:08.797 INFO:journalctl@ceph.mon.c.smithi179.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T07:03:08.797 INFO:journalctl@ceph.mon.c.smithi179.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T07:03:08.797 INFO:journalctl@ceph.mon.c.smithi179.stdout: Cumulative compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T07:03:08.797 INFO:journalctl@ceph.mon.c.smithi179.stdout: Interval compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T07:03:08.797 INFO:journalctl@ceph.mon.c.smithi179.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T07:03:08.797 INFO:journalctl@ceph.mon.c.smithi179.stdout: Block cache BinnedLRUCache@0x55f1040411f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-19T07:03:08.797 INFO:journalctl@ceph.mon.c.smithi179.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-19T07:03:08.797 INFO:journalctl@ceph.mon.c.smithi179.stdout: 2024-09-19T07:03:08.798 INFO:journalctl@ceph.mon.c.smithi179.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T07:03:08.798 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-19T07:03:08.798 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: using public_addr v2:172.21.15.179:0/0 -> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] 2024-09-19T07:03:08.798 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: starting mon.c rank -1 at public addrs [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] at bind addrs [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid eae8a4a8-7654-11ef-bceb-c7b262605968 2024-09-19T07:03:08.798 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: mon.c@-1(???) e0 preinit fsid eae8a4a8-7654-11ef-bceb-c7b262605968 2024-09-19T07:03:08.798 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: mon.c@-1(synchronizing).mds e1 new map 2024-09-19T07:03:08.798 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-19T07:03:08.798 INFO:journalctl@ceph.mon.c.smithi179.stdout: e1 2024-09-19T07:03:08.798 INFO:journalctl@ceph.mon.c.smithi179.stdout: btime 2024-09-19T07:01:47:891017+0000 2024-09-19T07:03:08.798 INFO:journalctl@ceph.mon.c.smithi179.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T07:03:08.798 INFO:journalctl@ceph.mon.c.smithi179.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T07:03:08.799 INFO:journalctl@ceph.mon.c.smithi179.stdout: legacy client fscid: -1 2024-09-19T07:03:08.799 INFO:journalctl@ceph.mon.c.smithi179.stdout: 2024-09-19T07:03:08.799 INFO:journalctl@ceph.mon.c.smithi179.stdout: No filesystems configured 2024-09-19T07:03:08.799 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-19T07:03:08.799 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-19T07:03:08.799 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-19T07:03:08.799 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-19T07:03:08.799 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-19T07:03:08.799 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-19T07:03:08.799 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T07:03:08.799 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T07:03:08.799 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T07:03:08.799 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T07:03:08.800 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: Updating smithi165:/var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:03:08.800 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: Updating smithi165:/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:03:08.800 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:08.800 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:08.800 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:08.800 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:08.800 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:03:08.800 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: Updating smithi165:/var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T07:03:08.800 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: Added host smithi179 2024-09-19T07:03:08.800 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:08.800 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:08.800 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:08.800 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:08.801 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:03:08.801 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:08.801 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/2727274483' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T07:03:08.801 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/2727274483' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T07:03:08.801 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T07:03:08.801 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:08.801 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:08.801 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:08.801 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:08.801 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:08.801 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi179", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:03:08.801 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:08.801 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:03:08.801 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: Updating smithi179:/etc/ceph/ceph.conf 2024-09-19T07:03:08.802 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: Updating smithi179:/var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:03:08.802 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: Updating smithi179:/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:03:08.802 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: Updating smithi179:/var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T07:03:08.802 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi148:172.21.15.148=a;smithi165:172.21.15.165=b;smithi179:172.21.15.179=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:03:08.802 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: Saving service mon spec with placement smithi148:172.21.15.148=a;smithi165:172.21.15.165=b;smithi179:172.21.15.179=c;count:3 2024-09-19T07:03:08.802 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:08.802 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:08.802 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:08.802 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:08.802 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T07:03:08.802 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:08.802 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: Deploying daemon mon.c on smithi179 2024-09-19T07:03:08.802 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:08.803 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:08.803 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: from='client.? 172.21.15.179:0/2852658361' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T07:03:08.803 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 ceph-mon[35716]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-19T07:03:08.803 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 bash[35696]: 1e64fd3b171300230f246009e665796b80e1c37437e86555db0f896e20188481 2024-09-19T07:03:08.803 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:08 smithi179 systemd[1]: Started Ceph mon.c for eae8a4a8-7654-11ef-bceb-c7b262605968. 2024-09-19T07:03:09.039 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T07:03:09.039 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T07:03:09.295 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:03:13.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:13 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:03:13.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:13 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:03:13.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:13 smithi148 ceph-mon[31180]: mon.a calling monitor election 2024-09-19T07:03:13.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:13 smithi148 ceph-mon[31180]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:13.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:13 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:03:13.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:13 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:03:13.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:13 smithi148 ceph-mon[31180]: mon.c calling monitor election 2024-09-19T07:03:13.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:13 smithi148 ceph-mon[31180]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:13.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:13 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:03:13.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:13 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:03:13.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:13 smithi148 ceph-mon[31180]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:13.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:13 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:03:13.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:13 smithi148 ceph-mon[31180]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T07:03:13.835 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:13 smithi148 ceph-mon[31180]: monmap epoch 2 2024-09-19T07:03:13.835 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:13 smithi148 ceph-mon[31180]: fsid eae8a4a8-7654-11ef-bceb-c7b262605968 2024-09-19T07:03:13.835 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:13 smithi148 ceph-mon[31180]: last_changed 2024-09-19T07:03:08.476772+0000 2024-09-19T07:03:13.835 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:13 smithi148 ceph-mon[31180]: created 2024-09-19T07:01:44.959428+0000 2024-09-19T07:03:13.835 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:13 smithi148 ceph-mon[31180]: min_mon_release 19 (squid) 2024-09-19T07:03:13.835 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:13 smithi148 ceph-mon[31180]: election_strategy: 1 2024-09-19T07:03:13.835 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:13 smithi148 ceph-mon[31180]: 0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-19T07:03:13.835 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:13 smithi148 ceph-mon[31180]: 1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.c 2024-09-19T07:03:13.835 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:13 smithi148 ceph-mon[31180]: fsmap 2024-09-19T07:03:13.835 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:13 smithi148 ceph-mon[31180]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T07:03:13.835 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:13 smithi148 ceph-mon[31180]: mgrmap e13: x(active, since 36s) 2024-09-19T07:03:13.835 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:13 smithi148 ceph-mon[31180]: overall HEALTH_OK 2024-09-19T07:03:13.835 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:13 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:13.835 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:13 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:13.836 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:13 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:13.836 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:13 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T07:03:13.836 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:13 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:14.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:13 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:03:14.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:13 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:03:14.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:13 smithi179 ceph-mon[35716]: mon.a calling monitor election 2024-09-19T07:03:14.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:13 smithi179 ceph-mon[35716]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:14.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:13 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:03:14.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:13 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:03:14.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:13 smithi179 ceph-mon[35716]: mon.c calling monitor election 2024-09-19T07:03:14.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:13 smithi179 ceph-mon[35716]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:14.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:13 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:03:14.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:13 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:03:14.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:13 smithi179 ceph-mon[35716]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:14.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:13 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:03:14.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:13 smithi179 ceph-mon[35716]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T07:03:14.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:13 smithi179 ceph-mon[35716]: monmap epoch 2 2024-09-19T07:03:14.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:13 smithi179 ceph-mon[35716]: fsid eae8a4a8-7654-11ef-bceb-c7b262605968 2024-09-19T07:03:14.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:13 smithi179 ceph-mon[35716]: last_changed 2024-09-19T07:03:08.476772+0000 2024-09-19T07:03:14.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:13 smithi179 ceph-mon[35716]: created 2024-09-19T07:01:44.959428+0000 2024-09-19T07:03:14.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:13 smithi179 ceph-mon[35716]: min_mon_release 19 (squid) 2024-09-19T07:03:14.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:13 smithi179 ceph-mon[35716]: election_strategy: 1 2024-09-19T07:03:14.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:13 smithi179 ceph-mon[35716]: 0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-19T07:03:14.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:13 smithi179 ceph-mon[35716]: 1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.c 2024-09-19T07:03:14.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:13 smithi179 ceph-mon[35716]: fsmap 2024-09-19T07:03:14.025 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:13 smithi179 ceph-mon[35716]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T07:03:14.025 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:13 smithi179 ceph-mon[35716]: mgrmap e13: x(active, since 36s) 2024-09-19T07:03:14.025 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:13 smithi179 ceph-mon[35716]: overall HEALTH_OK 2024-09-19T07:03:14.025 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:13 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:14.025 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:13 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:14.025 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:13 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:14.025 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:13 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T07:03:14.025 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:13 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:14.127 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:14.125+0000 7f3974568640 1 -- 172.21.15.179:0/2804706118 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3958003530 msgr2=0x7f39580059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:14.127 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:14.125+0000 7f3974568640 1 --2- 172.21.15.179:0/2804706118 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3958003530 0x7f39580059c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f396c06aa60 tx=0x7f396802c490 comp rx=0 tx=0).stop 2024-09-19T07:03:14.127 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:14.126+0000 7f3974568640 1 -- 172.21.15.179:0/2804706118 shutdown_connections 2024-09-19T07:03:14.128 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:14.126+0000 7f3974568640 1 --2- 172.21.15.179:0/2804706118 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3958003530 0x7f39580059c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:14.128 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:14.126+0000 7f3974568640 1 -- 172.21.15.179:0/2804706118 >> 172.21.15.179:0/2804706118 conn(0x7f396c0fc290 msgr2=0x7f396c0fe6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:14.128 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:14.126+0000 7f3974568640 1 -- 172.21.15.179:0/2804706118 shutdown_connections 2024-09-19T07:03:14.128 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:14.126+0000 7f3974568640 1 -- 172.21.15.179:0/2804706118 wait complete. 2024-09-19T07:03:14.128 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:14.126+0000 7f3974568640 1 Processor -- start 2024-09-19T07:03:14.128 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:14.126+0000 7f3974568640 1 -- start start 2024-09-19T07:03:14.129 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:14.127+0000 7f3974568640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3958003530 0x7f396c199520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:14.129 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:14.127+0000 7f3974568640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f396c199a60 0x7f396c19ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:14.130 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:14.127+0000 7f3974568640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f396c1097d0 con 0x7f396c199a60 2024-09-19T07:03:14.130 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:14.127+0000 7f3974568640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f396c109650 con 0x7f3958003530 2024-09-19T07:03:14.130 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:14.127+0000 7f3972304640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3958003530 0x7f396c199520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:14.130 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:14.127+0000 7f3972304640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3958003530 0x7f396c199520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:35824/0 (socket says 172.21.15.179:35824) 2024-09-19T07:03:14.130 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:14.127+0000 7f3972304640 1 -- 172.21.15.179:0/1951908671 learned_addr learned my addr 172.21.15.179:0/1951908671 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-09-19T07:03:14.130 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:14.127+0000 7f3971b03640 1 --2- 172.21.15.179:0/1951908671 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f396c199a60 0x7f396c19ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:14.130 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:14.127+0000 7f3972304640 1 -- 172.21.15.179:0/1951908671 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3958003530 msgr2=0x7f396c199520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T07:03:14.130 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:14.127+0000 7f3972304640 1 -- 172.21.15.179:0/1951908671 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3958003530 msgr2=0x7f396c199520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T07:03:14.130 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:14.127+0000 7f3972304640 1 --2- 172.21.15.179:0/1951908671 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3958003530 0x7f396c199520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T07:03:14.130 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:14.127+0000 7f3972304640 1 --2- 172.21.15.179:0/1951908671 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3958003530 0x7f396c199520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T07:03:14.130 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:14.127+0000 7f3971b03640 1 -- 172.21.15.179:0/1951908671 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3958003530 msgr2=0x7f396c199520 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T07:03:14.130 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:14.127+0000 7f3971b03640 1 --2- 172.21.15.179:0/1951908671 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3958003530 0x7f396c199520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:14.130 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:14.127+0000 7f3971b03640 1 -- 172.21.15.179:0/1951908671 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f396c19a080 con 0x7f396c199a60 2024-09-19T07:03:14.130 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:14.128+0000 7f3971b03640 1 --2- 172.21.15.179:0/1951908671 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f396c199a60 0x7f396c19ddf0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f395c00b3d0 tx=0x7f395c00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:14.131 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:14.128+0000 7f39637fe640 1 -- 172.21.15.179:0/1951908671 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f395c011630 con 0x7f396c199a60 2024-09-19T07:03:14.131 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:14.128+0000 7f39637fe640 1 -- 172.21.15.179:0/1951908671 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f395c011cb0 con 0x7f396c199a60 2024-09-19T07:03:14.131 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:14.128+0000 7f3974568640 1 -- 172.21.15.179:0/1951908671 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f396c19e330 con 0x7f396c199a60 2024-09-19T07:03:14.131 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:14.128+0000 7f39637fe640 1 -- 172.21.15.179:0/1951908671 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f395c010df0 con 0x7f396c199a60 2024-09-19T07:03:14.131 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:14.128+0000 7f3974568640 1 -- 172.21.15.179:0/1951908671 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f396c19e870 con 0x7f396c199a60 2024-09-19T07:03:14.132 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:14.129+0000 7f39637fe640 1 -- 172.21.15.179:0/1951908671 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f395c018020 con 0x7f396c199a60 2024-09-19T07:03:14.132 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:14.129+0000 7f3974568640 1 -- 172.21.15.179:0/1951908671 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f396c06ad10 con 0x7f396c199a60 2024-09-19T07:03:14.132 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:14.129+0000 7f39637fe640 1 --2- 172.21.15.179:0/1951908671 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f3950039090 0x7f395003b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:14.132 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:14.129+0000 7f39637fe640 1 -- 172.21.15.179:0/1951908671 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f395c04bfc0 con 0x7f396c199a60 2024-09-19T07:03:14.132 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:14.130+0000 7f3972304640 1 --2- 172.21.15.179:0/1951908671 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f3950039090 0x7f395003b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:14.132 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:14.130+0000 7f3972304640 1 --2- 172.21.15.179:0/1951908671 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f3950039090 0x7f395003b550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3968012c10 tx=0x7f39680323a0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:14.135 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:14.135+0000 7f39637fe640 1 -- 172.21.15.179:0/1951908671 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f395c01f020 con 0x7f396c199a60 2024-09-19T07:03:14.371 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:14.370+0000 7f3974568640 1 -- 172.21.15.179:0/1951908671 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f396c106510 con 0x7f396c199a60 2024-09-19T07:03:14.371 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:14.371+0000 7f39637fe640 1 -- 172.21.15.179:0/1951908671 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1019 (secure 0 0 0) 0x7f395c018310 con 0x7f396c199a60 2024-09-19T07:03:14.372 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-19T07:03:14.372 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":2,"fsid":"eae8a4a8-7654-11ef-bceb-c7b262605968","modified":"2024-09-19T07:03:08.476772Z","created":"2024-09-19T07:01:44.959428Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:3300","nonce":0},{"type":"v1","addr":"172.21.15.179:6789","nonce":0}]},"addr":"172.21.15.179:6789/0","public_addr":"172.21.15.179:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T07:03:14.372 INFO:teuthology.orchestra.run.smithi179.stderr:dumped monmap epoch 2 2024-09-19T07:03:14.374 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:14.373+0000 7f3974568640 1 -- 172.21.15.179:0/1951908671 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f3950039090 msgr2=0x7f395003b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:14.374 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:14.373+0000 7f3974568640 1 --2- 172.21.15.179:0/1951908671 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f3950039090 0x7f395003b550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3968012c10 tx=0x7f39680323a0 comp rx=0 tx=0).stop 2024-09-19T07:03:14.374 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:14.373+0000 7f3974568640 1 -- 172.21.15.179:0/1951908671 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f396c199a60 msgr2=0x7f396c19ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:14.374 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:14.373+0000 7f3974568640 1 --2- 172.21.15.179:0/1951908671 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f396c199a60 0x7f396c19ddf0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f395c00b3d0 tx=0x7f395c00b890 comp rx=0 tx=0).stop 2024-09-19T07:03:14.374 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:14.373+0000 7f3974568640 1 -- 172.21.15.179:0/1951908671 shutdown_connections 2024-09-19T07:03:14.374 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:14.373+0000 7f3974568640 1 --2- 172.21.15.179:0/1951908671 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f3950039090 0x7f395003b550 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:14.374 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:14.373+0000 7f3974568640 1 --2- 172.21.15.179:0/1951908671 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f396c199a60 0x7f396c19ddf0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:14.374 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:14.373+0000 7f3974568640 1 --2- 172.21.15.179:0/1951908671 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3958003530 0x7f396c199520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:14.374 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:14.373+0000 7f3974568640 1 -- 172.21.15.179:0/1951908671 >> 172.21.15.179:0/1951908671 conn(0x7f396c0fc290 msgr2=0x7f396c0fdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:14.374 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:14.373+0000 7f3974568640 1 -- 172.21.15.179:0/1951908671 shutdown_connections 2024-09-19T07:03:14.374 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:14.373+0000 7f3974568640 1 -- 172.21.15.179:0/1951908671 wait complete. 2024-09-19T07:03:14.667 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:14 smithi179 ceph-mon[35716]: Deploying daemon mon.b on smithi165 2024-09-19T07:03:14.668 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:14 smithi179 ceph-mon[35716]: from='client.? 172.21.15.179:0/1951908671' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T07:03:14.668 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:14 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:03:14.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:14 smithi148 ceph-mon[31180]: Deploying daemon mon.b on smithi165 2024-09-19T07:03:14.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:14 smithi148 ceph-mon[31180]: from='client.? 172.21.15.179:0/1951908671' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T07:03:14.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:14 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:03:15.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:15 smithi148 ceph-mon[31180]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:15.834 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:03:15 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:03:15.476+0000 7f6aec71e640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-19T07:03:15.978 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T07:03:15.979 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T07:03:16.007 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:15 smithi179 ceph-mon[35716]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:16.238 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:03:16.712 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:16.709+0000 7f87ba167640 1 -- 172.21.15.179:0/4099349584 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f87b4107660 msgr2=0x7f87b4107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:16.712 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:16.709+0000 7f87ba167640 1 --2- 172.21.15.179:0/4099349584 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f87b4107660 0x7f87b4107a40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f87a4009880 tx=0x7f87a402a5d0 comp rx=0 tx=0).stop 2024-09-19T07:03:16.712 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:16.709+0000 7f87ba167640 1 -- 172.21.15.179:0/4099349584 shutdown_connections 2024-09-19T07:03:16.712 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:16.709+0000 7f87ba167640 1 --2- 172.21.15.179:0/4099349584 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f87b4107660 0x7f87b4107a40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:16.712 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:16.709+0000 7f87ba167640 1 -- 172.21.15.179:0/4099349584 >> 172.21.15.179:0/4099349584 conn(0x7f87b40fd320 msgr2=0x7f87b40ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:16.712 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:16.709+0000 7f87ba167640 1 -- 172.21.15.179:0/4099349584 shutdown_connections 2024-09-19T07:03:16.712 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:16.709+0000 7f87ba167640 1 -- 172.21.15.179:0/4099349584 wait complete. 2024-09-19T07:03:16.712 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:16.709+0000 7f87ba167640 1 Processor -- start 2024-09-19T07:03:16.712 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:16.709+0000 7f87ba167640 1 -- start start 2024-09-19T07:03:16.713 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:16.710+0000 7f87ba167640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87b4107660 0x7f87b41973c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:16.713 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:16.710+0000 7f87ba167640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f87b4197900 0x7f87b419bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:16.713 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:16.710+0000 7f87ba167640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f87b410bd20 con 0x7f87b4197900 2024-09-19T07:03:16.713 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:16.710+0000 7f87ba167640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f87b410bba0 con 0x7f87b4107660 2024-09-19T07:03:16.713 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:16.710+0000 7f87b37fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87b4107660 0x7f87b41973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:16.713 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:16.710+0000 7f87b37fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87b4107660 0x7f87b41973c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:35840/0 (socket says 172.21.15.179:35840) 2024-09-19T07:03:16.713 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:16.710+0000 7f87b37fe640 1 -- 172.21.15.179:0/4121360805 learned_addr learned my addr 172.21.15.179:0/4121360805 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-09-19T07:03:16.713 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:16.710+0000 7f87b2ffd640 1 --2- 172.21.15.179:0/4121360805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f87b4197900 0x7f87b419bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:16.713 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:16.710+0000 7f87b37fe640 1 -- 172.21.15.179:0/4121360805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87b4107660 msgr2=0x7f87b41973c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T07:03:16.713 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:16.710+0000 7f87b37fe640 1 -- 172.21.15.179:0/4121360805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87b4107660 msgr2=0x7f87b41973c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T07:03:16.713 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:16.710+0000 7f87b37fe640 1 --2- 172.21.15.179:0/4121360805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87b4107660 0x7f87b41973c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T07:03:16.713 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:16.710+0000 7f87b37fe640 1 --2- 172.21.15.179:0/4121360805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87b4107660 0x7f87b41973c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T07:03:16.713 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:16.710+0000 7f87b2ffd640 1 -- 172.21.15.179:0/4121360805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87b4107660 msgr2=0x7f87b41973c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T07:03:16.714 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:16.710+0000 7f87b2ffd640 1 --2- 172.21.15.179:0/4121360805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87b4107660 0x7f87b41973c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:16.714 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:16.710+0000 7f87b2ffd640 1 -- 172.21.15.179:0/4121360805 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87b4197f20 con 0x7f87b4197900 2024-09-19T07:03:16.714 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:16.710+0000 7f87b2ffd640 1 --2- 172.21.15.179:0/4121360805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f87b4197900 0x7f87b419bc90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f87a800b3d0 tx=0x7f87a800b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:16.714 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:16.711+0000 7f87b0ff9640 1 -- 172.21.15.179:0/4121360805 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f87a8011630 con 0x7f87b4197900 2024-09-19T07:03:16.714 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:16.711+0000 7f87ba167640 1 -- 172.21.15.179:0/4121360805 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87b419c1d0 con 0x7f87b4197900 2024-09-19T07:03:16.714 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:16.711+0000 7f87b0ff9640 1 -- 172.21.15.179:0/4121360805 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87a8011cb0 con 0x7f87b4197900 2024-09-19T07:03:16.714 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:16.711+0000 7f87b0ff9640 1 -- 172.21.15.179:0/4121360805 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f87a8010df0 con 0x7f87b4197900 2024-09-19T07:03:16.714 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:16.711+0000 7f87ba167640 1 -- 172.21.15.179:0/4121360805 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87b419c710 con 0x7f87b4197900 2024-09-19T07:03:16.715 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:16.711+0000 7f87b0ff9640 1 -- 172.21.15.179:0/4121360805 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f87a8018020 con 0x7f87b4197900 2024-09-19T07:03:16.715 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:16.712+0000 7f87ba167640 1 -- 172.21.15.179:0/4121360805 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87b4102da0 con 0x7f87b4197900 2024-09-19T07:03:16.715 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:16.712+0000 7f87b0ff9640 1 --2- 172.21.15.179:0/4121360805 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f879c039040 0x7f879c03b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:16.715 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:16.712+0000 7f87b0ff9640 1 -- 172.21.15.179:0/4121360805 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f87a804bfb0 con 0x7f87b4197900 2024-09-19T07:03:16.715 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:16.712+0000 7f87b37fe640 1 --2- 172.21.15.179:0/4121360805 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f879c039040 0x7f879c03b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:16.715 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:16.712+0000 7f87b37fe640 1 --2- 172.21.15.179:0/4121360805 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f879c039040 0x7f879c03b500 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f87a40096c0 tx=0x7f87a4005a40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:16.718 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:16.717+0000 7f87b0ff9640 1 -- 172.21.15.179:0/4121360805 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f87a801f020 con 0x7f87b4197900 2024-09-19T07:03:16.949 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:16.948+0000 7f87ba167640 1 -- 172.21.15.179:0/4121360805 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f87b419ca20 con 0x7f87b4197900 2024-09-19T07:03:16.950 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:16.949+0000 7f87b0ff9640 1 -- 172.21.15.179:0/4121360805 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1019 (secure 0 0 0) 0x7f87a8017500 con 0x7f87b4197900 2024-09-19T07:03:16.950 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-19T07:03:16.950 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":2,"fsid":"eae8a4a8-7654-11ef-bceb-c7b262605968","modified":"2024-09-19T07:03:08.476772Z","created":"2024-09-19T07:01:44.959428Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:3300","nonce":0},{"type":"v1","addr":"172.21.15.179:6789","nonce":0}]},"addr":"172.21.15.179:6789/0","public_addr":"172.21.15.179:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T07:03:16.950 INFO:teuthology.orchestra.run.smithi179.stderr:dumped monmap epoch 2 2024-09-19T07:03:16.953 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:16.951+0000 7f87ba167640 1 -- 172.21.15.179:0/4121360805 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f879c039040 msgr2=0x7f879c03b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:16.953 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:16.951+0000 7f87ba167640 1 --2- 172.21.15.179:0/4121360805 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f879c039040 0x7f879c03b500 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f87a40096c0 tx=0x7f87a4005a40 comp rx=0 tx=0).stop 2024-09-19T07:03:16.953 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:16.951+0000 7f87ba167640 1 -- 172.21.15.179:0/4121360805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f87b4197900 msgr2=0x7f87b419bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:16.953 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:16.951+0000 7f87ba167640 1 --2- 172.21.15.179:0/4121360805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f87b4197900 0x7f87b419bc90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f87a800b3d0 tx=0x7f87a800b890 comp rx=0 tx=0).stop 2024-09-19T07:03:16.953 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:16.952+0000 7f87ba167640 1 -- 172.21.15.179:0/4121360805 shutdown_connections 2024-09-19T07:03:16.953 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:16.952+0000 7f87ba167640 1 --2- 172.21.15.179:0/4121360805 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f879c039040 0x7f879c03b500 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:16.953 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:16.952+0000 7f87ba167640 1 --2- 172.21.15.179:0/4121360805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f87b4197900 0x7f87b419bc90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:16.953 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:16.952+0000 7f87ba167640 1 --2- 172.21.15.179:0/4121360805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87b4107660 0x7f87b41973c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:16.953 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:16.952+0000 7f87ba167640 1 -- 172.21.15.179:0/4121360805 >> 172.21.15.179:0/4121360805 conn(0x7f87b40fd320 msgr2=0x7f87b40fee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:16.954 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:16.952+0000 7f87ba167640 1 -- 172.21.15.179:0/4121360805 shutdown_connections 2024-09-19T07:03:16.954 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:16.952+0000 7f87ba167640 1 -- 172.21.15.179:0/4121360805 wait complete. 2024-09-19T07:03:17.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:17 smithi179 ceph-mon[35716]: from='client.? 172.21.15.179:0/4121360805' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T07:03:17.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:17 smithi148 ceph-mon[31180]: from='client.? 172.21.15.179:0/4121360805' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T07:03:17.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:17 smithi165 systemd[1]: Started Ceph mon.b for eae8a4a8-7654-11ef-bceb-c7b262605968. 2024-09-19T07:03:18.476 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T07:03:18.477 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T07:03:18.727 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:03:22.351 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.349+0000 7fe5ae655640 1 -- 172.21.15.179:0/2071386859 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe590003530 msgr2=0x7fe5900059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:22.351 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.349+0000 7fe5ae655640 1 --2- 172.21.15.179:0/2071386859 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe590003530 0x7fe5900059c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe5a806aa60 tx=0x7fe59802c150 comp rx=0 tx=0).stop 2024-09-19T07:03:22.351 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.349+0000 7fe5ae655640 1 -- 172.21.15.179:0/2071386859 shutdown_connections 2024-09-19T07:03:22.351 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.349+0000 7fe5ae655640 1 --2- 172.21.15.179:0/2071386859 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe590003530 0x7fe5900059c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:22.351 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.349+0000 7fe5ae655640 1 -- 172.21.15.179:0/2071386859 >> 172.21.15.179:0/2071386859 conn(0x7fe5a80fc220 msgr2=0x7fe5a80fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:22.351 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.349+0000 7fe5ae655640 1 -- 172.21.15.179:0/2071386859 shutdown_connections 2024-09-19T07:03:22.352 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.349+0000 7fe5ae655640 1 -- 172.21.15.179:0/2071386859 wait complete. 2024-09-19T07:03:22.352 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.350+0000 7fe5ae655640 1 Processor -- start 2024-09-19T07:03:22.352 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.350+0000 7fe5ae655640 1 -- start start 2024-09-19T07:03:22.354 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.351+0000 7fe5ae655640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe590003530 0x7fe5a81973a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:22.354 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.351+0000 7fe5ae655640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5a81978e0 0x7fe5a819bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:22.354 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.351+0000 7fe5ae655640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5a819c1b0 0x7fe5a819c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:22.354 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.351+0000 7fe5ae655640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a8109780 con 0x7fe5a819c1b0 2024-09-19T07:03:22.354 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.351+0000 7fe5ae655640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a8109600 con 0x7fe590003530 2024-09-19T07:03:22.354 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.351+0000 7fe5ae655640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a8109900 con 0x7fe5a81978e0 2024-09-19T07:03:22.354 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.351+0000 7fe5a77fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5a81978e0 0x7fe5a819bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:22.354 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.351+0000 7fe5a77fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5a81978e0 0x7fe5a819bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39924/0 (socket says 172.21.15.179:39924) 2024-09-19T07:03:22.355 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.351+0000 7fe5a77fe640 1 -- 172.21.15.179:0/611382300 learned_addr learned my addr 172.21.15.179:0/611382300 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-09-19T07:03:22.355 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.351+0000 7fe5acbf2640 1 --2- 172.21.15.179:0/611382300 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5a819c1b0 0x7fe5a819c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:22.355 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.351+0000 7fe5a7fff640 1 --2- 172.21.15.179:0/611382300 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe590003530 0x7fe5a81973a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:22.355 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.351+0000 7fe5a77fe640 1 -- 172.21.15.179:0/611382300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5a81978e0 msgr2=0x7fe5a819bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-19T07:03:22.355 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.351+0000 7fe5a77fe640 1 -- 172.21.15.179:0/611382300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5a81978e0 msgr2=0x7fe5a819bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T07:03:22.355 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.351+0000 7fe5a77fe640 1 --2- 172.21.15.179:0/611382300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5a81978e0 0x7fe5a819bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T07:03:22.355 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.351+0000 7fe5a77fe640 1 --2- 172.21.15.179:0/611382300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5a81978e0 0x7fe5a819bc70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T07:03:22.355 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.351+0000 7fe5a7fff640 1 -- 172.21.15.179:0/611382300 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe590003530 msgr2=0x7fe5a81973a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T07:03:22.355 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.351+0000 7fe5a7fff640 1 -- 172.21.15.179:0/611382300 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe590003530 msgr2=0x7fe5a81973a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T07:03:22.355 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.351+0000 7fe5a7fff640 1 --2- 172.21.15.179:0/611382300 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe590003530 0x7fe5a81973a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T07:03:22.355 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.351+0000 7fe5a7fff640 1 --2- 172.21.15.179:0/611382300 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe590003530 0x7fe5a81973a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T07:03:22.355 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.351+0000 7fe5acbf2640 1 -- 172.21.15.179:0/611382300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5a81978e0 msgr2=0x7fe5a819bc70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T07:03:22.355 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.351+0000 7fe5acbf2640 1 --2- 172.21.15.179:0/611382300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5a81978e0 0x7fe5a819bc70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:22.356 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.351+0000 7fe5acbf2640 1 -- 172.21.15.179:0/611382300 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe590003530 msgr2=0x7fe5a81973a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T07:03:22.356 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.351+0000 7fe5acbf2640 1 --2- 172.21.15.179:0/611382300 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe590003530 0x7fe5a81973a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:22.356 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.351+0000 7fe5acbf2640 1 -- 172.21.15.179:0/611382300 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5a81a3f20 con 0x7fe5a819c1b0 2024-09-19T07:03:22.356 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.352+0000 7fe5acbf2640 1 --2- 172.21.15.179:0/611382300 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5a819c1b0 0x7fe5a819c660 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe5a000bd50 tx=0x7fe5a000be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:22.356 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.352+0000 7fe5a57fa640 1 -- 172.21.15.179:0/611382300 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a0019070 con 0x7fe5a819c1b0 2024-09-19T07:03:22.356 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.352+0000 7fe5ae655640 1 -- 172.21.15.179:0/611382300 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5a81a4150 con 0x7fe5a819c1b0 2024-09-19T07:03:22.356 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.352+0000 7fe5a57fa640 1 -- 172.21.15.179:0/611382300 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5a0014920 con 0x7fe5a819c1b0 2024-09-19T07:03:22.356 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.352+0000 7fe5a57fa640 1 -- 172.21.15.179:0/611382300 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a0012990 con 0x7fe5a819c1b0 2024-09-19T07:03:22.356 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.352+0000 7fe5ae655640 1 -- 172.21.15.179:0/611382300 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5a81a4610 con 0x7fe5a819c1b0 2024-09-19T07:03:22.356 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.353+0000 7fe5a57fa640 1 -- 172.21.15.179:0/611382300 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7fe5a001c070 con 0x7fe5a819c1b0 2024-09-19T07:03:22.357 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.353+0000 7fe5a57fa640 1 --2- 172.21.15.179:0/611382300 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fe594039730 0x7fe59403bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:22.357 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.353+0000 7fe5a57fa640 1 -- 172.21.15.179:0/611382300 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe5a00146d0 con 0x7fe5a819c1b0 2024-09-19T07:03:22.357 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.353+0000 7fe5ae655640 1 -- 172.21.15.179:0/611382300 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5a810a890 con 0x7fe5a819c1b0 2024-09-19T07:03:22.357 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.354+0000 7fe5a7fff640 1 --2- 172.21.15.179:0/611382300 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fe594039730 0x7fe59403bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:22.357 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.354+0000 7fe5a7fff640 1 --2- 172.21.15.179:0/611382300 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fe594039730 0x7fe59403bbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe598005dc0 tx=0x7fe598005d10 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:22.359 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.359+0000 7fe5a57fa640 1 -- 172.21.15.179:0/611382300 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe5a0013e60 con 0x7fe5a819c1b0 2024-09-19T07:03:22.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:22 smithi179 ceph-mon[35716]: mon.c calling monitor election 2024-09-19T07:03:22.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:22 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:03:22.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:22 smithi179 ceph-mon[35716]: mon.a calling monitor election 2024-09-19T07:03:22.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:22 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:03:22.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:22 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:03:22.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:22 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:03:22.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:22 smithi179 ceph-mon[35716]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:22.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:22 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:03:22.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:22 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:03:22.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:22 smithi179 ceph-mon[35716]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:22.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:22 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:03:22.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:22 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:03:22.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:22 smithi179 ceph-mon[35716]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T07:03:22.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:22 smithi179 ceph-mon[35716]: monmap epoch 3 2024-09-19T07:03:22.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:22 smithi179 ceph-mon[35716]: fsid eae8a4a8-7654-11ef-bceb-c7b262605968 2024-09-19T07:03:22.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:22 smithi179 ceph-mon[35716]: last_changed 2024-09-19T07:03:17.163357+0000 2024-09-19T07:03:22.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:22 smithi179 ceph-mon[35716]: created 2024-09-19T07:01:44.959428+0000 2024-09-19T07:03:22.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:22 smithi179 ceph-mon[35716]: min_mon_release 19 (squid) 2024-09-19T07:03:22.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:22 smithi179 ceph-mon[35716]: election_strategy: 1 2024-09-19T07:03:22.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:22 smithi179 ceph-mon[35716]: 0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-19T07:03:22.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:22 smithi179 ceph-mon[35716]: 1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.c 2024-09-19T07:03:22.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:22 smithi179 ceph-mon[35716]: 2: [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] mon.b 2024-09-19T07:03:22.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:22 smithi179 ceph-mon[35716]: fsmap 2024-09-19T07:03:22.525 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:22 smithi179 ceph-mon[35716]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T07:03:22.525 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:22 smithi179 ceph-mon[35716]: mgrmap e13: x(active, since 45s) 2024-09-19T07:03:22.525 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:22 smithi179 ceph-mon[35716]: overall HEALTH_OK 2024-09-19T07:03:22.525 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:22 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:22.525 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:22 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:22.525 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:22 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:22.525 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:22 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:22.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:22 smithi148 ceph-mon[31180]: mon.c calling monitor election 2024-09-19T07:03:22.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:22 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:03:22.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:22 smithi148 ceph-mon[31180]: mon.a calling monitor election 2024-09-19T07:03:22.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:22 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:03:22.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:22 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:03:22.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:22 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:03:22.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:22 smithi148 ceph-mon[31180]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:22.585 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:22 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:03:22.585 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:22 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:03:22.585 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:22 smithi148 ceph-mon[31180]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:22.585 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:22 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:03:22.585 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:22 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:03:22.585 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:22 smithi148 ceph-mon[31180]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T07:03:22.585 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:22 smithi148 ceph-mon[31180]: monmap epoch 3 2024-09-19T07:03:22.585 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:22 smithi148 ceph-mon[31180]: fsid eae8a4a8-7654-11ef-bceb-c7b262605968 2024-09-19T07:03:22.585 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:22 smithi148 ceph-mon[31180]: last_changed 2024-09-19T07:03:17.163357+0000 2024-09-19T07:03:22.585 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:22 smithi148 ceph-mon[31180]: created 2024-09-19T07:01:44.959428+0000 2024-09-19T07:03:22.585 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:22 smithi148 ceph-mon[31180]: min_mon_release 19 (squid) 2024-09-19T07:03:22.585 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:22 smithi148 ceph-mon[31180]: election_strategy: 1 2024-09-19T07:03:22.585 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:22 smithi148 ceph-mon[31180]: 0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-19T07:03:22.586 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:22 smithi148 ceph-mon[31180]: 1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.c 2024-09-19T07:03:22.586 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:22 smithi148 ceph-mon[31180]: 2: [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] mon.b 2024-09-19T07:03:22.586 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:22 smithi148 ceph-mon[31180]: fsmap 2024-09-19T07:03:22.586 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:22 smithi148 ceph-mon[31180]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T07:03:22.586 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:22 smithi148 ceph-mon[31180]: mgrmap e13: x(active, since 45s) 2024-09-19T07:03:22.586 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:22 smithi148 ceph-mon[31180]: overall HEALTH_OK 2024-09-19T07:03:22.586 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:22 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:22.586 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:22 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:22.586 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:22 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:22.586 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:22 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:22.610 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.609+0000 7fe5ae655640 1 -- 172.21.15.179:0/611382300 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fe5a81a48a0 con 0x7fe5a819c1b0 2024-09-19T07:03:22.610 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.609+0000 7fe5a57fa640 1 -- 172.21.15.179:0/611382300 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1287 (secure 0 0 0) 0x7fe5a000e080 con 0x7fe5a819c1b0 2024-09-19T07:03:22.611 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-19T07:03:22.611 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":3,"fsid":"eae8a4a8-7654-11ef-bceb-c7b262605968","modified":"2024-09-19T07:03:17.163357Z","created":"2024-09-19T07:01:44.959428Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:3300","nonce":0},{"type":"v1","addr":"172.21.15.179:6789","nonce":0}]},"addr":"172.21.15.179:6789/0","public_addr":"172.21.15.179:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:3300","nonce":0},{"type":"v1","addr":"172.21.15.165:6789","nonce":0}]},"addr":"172.21.15.165:6789/0","public_addr":"172.21.15.165:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T07:03:22.611 INFO:teuthology.orchestra.run.smithi179.stderr:dumped monmap epoch 3 2024-09-19T07:03:22.614 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.612+0000 7fe5ae655640 1 -- 172.21.15.179:0/611382300 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fe594039730 msgr2=0x7fe59403bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:22.614 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.612+0000 7fe5ae655640 1 --2- 172.21.15.179:0/611382300 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fe594039730 0x7fe59403bbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe598005dc0 tx=0x7fe598005d10 comp rx=0 tx=0).stop 2024-09-19T07:03:22.614 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.612+0000 7fe5ae655640 1 -- 172.21.15.179:0/611382300 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5a819c1b0 msgr2=0x7fe5a819c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:22.614 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.612+0000 7fe5ae655640 1 --2- 172.21.15.179:0/611382300 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5a819c1b0 0x7fe5a819c660 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe5a000bd50 tx=0x7fe5a000be40 comp rx=0 tx=0).stop 2024-09-19T07:03:22.614 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.613+0000 7fe5ae655640 1 -- 172.21.15.179:0/611382300 shutdown_connections 2024-09-19T07:03:22.614 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.613+0000 7fe5ae655640 1 --2- 172.21.15.179:0/611382300 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fe594039730 0x7fe59403bbf0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:22.614 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.613+0000 7fe5ae655640 1 --2- 172.21.15.179:0/611382300 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5a819c1b0 0x7fe5a819c660 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:22.614 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.613+0000 7fe5ae655640 1 --2- 172.21.15.179:0/611382300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5a81978e0 0x7fe5a819bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:22.614 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.613+0000 7fe5ae655640 1 --2- 172.21.15.179:0/611382300 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe590003530 0x7fe5a81973a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:22.614 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.613+0000 7fe5ae655640 1 -- 172.21.15.179:0/611382300 >> 172.21.15.179:0/611382300 conn(0x7fe5a80fc220 msgr2=0x7fe5a80fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:22.614 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.613+0000 7fe5ae655640 1 -- 172.21.15.179:0/611382300 shutdown_connections 2024-09-19T07:03:22.614 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:22.613+0000 7fe5ae655640 1 -- 172.21.15.179:0/611382300 wait complete. 2024-09-19T07:03:23.216 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-19T07:03:23.216 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-19T07:03:23.474 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:03:23.507 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:23 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:03:23.507 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:23 smithi179 ceph-mon[35716]: from='client.? 172.21.15.179:0/611382300' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T07:03:23.507 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:23 smithi179 ceph-mon[35716]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:23.507 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:23 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:03:23.579 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:23 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:03:23.579 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:23 smithi148 ceph-mon[31180]: from='client.? 172.21.15.179:0/611382300' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T07:03:23.579 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:23 smithi148 ceph-mon[31180]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:23.579 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:23 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:03:23.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:23.885+0000 7f61fb1f0640 1 -- 172.21.15.148:0/3393507447 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61f4102780 msgr2=0x7f61f4102b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:23.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:23.885+0000 7f61fb1f0640 1 --2- 172.21.15.148:0/3393507447 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61f4102780 0x7f61f4102b60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f61e8009880 tx=0x7f61e802a670 comp rx=0 tx=0).stop 2024-09-19T07:03:23.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:23.885+0000 7f61fb1f0640 1 -- 172.21.15.148:0/3393507447 shutdown_connections 2024-09-19T07:03:23.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:23.885+0000 7f61fb1f0640 1 --2- 172.21.15.148:0/3393507447 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61f4102780 0x7f61f4102b60 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:23.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:23.885+0000 7f61fb1f0640 1 -- 172.21.15.148:0/3393507447 >> 172.21.15.148:0/3393507447 conn(0x7f61f40fc1a0 msgr2=0x7f61f40fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:23.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:23.885+0000 7f61fb1f0640 1 -- 172.21.15.148:0/3393507447 shutdown_connections 2024-09-19T07:03:23.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:23.885+0000 7f61fb1f0640 1 -- 172.21.15.148:0/3393507447 wait complete. 2024-09-19T07:03:23.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:23.886+0000 7f61fb1f0640 1 Processor -- start 2024-09-19T07:03:23.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:23.886+0000 7f61fb1f0640 1 -- start start 2024-09-19T07:03:23.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:23.886+0000 7f61fb1f0640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f61f4102780 0x7f61f4197410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:23.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:23.886+0000 7f61fb1f0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61f4197950 0x7f61f419bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:23.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:23.886+0000 7f61fb1f0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61f419c220 0x7f61f419c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:23.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:23.886+0000 7f61fb1f0640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f61f410bca0 con 0x7f61f4197950 2024-09-19T07:03:23.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:23.886+0000 7f61fb1f0640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f61f410bb20 con 0x7f61f4102780 2024-09-19T07:03:23.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:23.886+0000 7f61fb1f0640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f61f410be20 con 0x7f61f419c220 2024-09-19T07:03:23.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:23.886+0000 7f61f3fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61f4197950 0x7f61f419bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:23.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:23.886+0000 7f61f3fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61f4197950 0x7f61f419bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42446/0 (socket says 172.21.15.148:42446) 2024-09-19T07:03:23.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:23.886+0000 7f61f3fff640 1 -- 172.21.15.148:0/3035844727 learned_addr learned my addr 172.21.15.148:0/3035844727 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:03:23.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:23.886+0000 7f61f978d640 1 --2- 172.21.15.148:0/3035844727 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61f419c220 0x7f61f419c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:23.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:23.886+0000 7f61f8f8c640 1 --2- 172.21.15.148:0/3035844727 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f61f4102780 0x7f61f4197410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:23.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:23.886+0000 7f61f3fff640 1 -- 172.21.15.148:0/3035844727 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61f419c220 msgr2=0x7f61f419c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:23.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:23.886+0000 7f61f3fff640 1 --2- 172.21.15.148:0/3035844727 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61f419c220 0x7f61f419c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:23.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:23.886+0000 7f61f3fff640 1 -- 172.21.15.148:0/3035844727 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f61f4102780 msgr2=0x7f61f4197410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:23.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:23.886+0000 7f61f3fff640 1 --2- 172.21.15.148:0/3035844727 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f61f4102780 0x7f61f4197410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:23.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:23.886+0000 7f61f3fff640 1 -- 172.21.15.148:0/3035844727 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61f41a3f90 con 0x7f61f4197950 2024-09-19T07:03:23.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:23.886+0000 7f61f8f8c640 1 --2- 172.21.15.148:0/3035844727 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f61f4102780 0x7f61f4197410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:03:23.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:23.887+0000 7f61f3fff640 1 --2- 172.21.15.148:0/3035844727 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61f4197950 0x7f61f419bce0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f61e000b520 tx=0x7f61e000b9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:23.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:23.887+0000 7f61f1ffb640 1 -- 172.21.15.148:0/3035844727 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e0004230 con 0x7f61f4197950 2024-09-19T07:03:23.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:23.887+0000 7f61fb1f0640 1 -- 172.21.15.148:0/3035844727 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61f41a41c0 con 0x7f61f4197950 2024-09-19T07:03:23.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:23.887+0000 7f61f1ffb640 1 -- 172.21.15.148:0/3035844727 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61e00043d0 con 0x7f61f4197950 2024-09-19T07:03:23.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:23.887+0000 7f61f1ffb640 1 -- 172.21.15.148:0/3035844727 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e0003d60 con 0x7f61f4197950 2024-09-19T07:03:23.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:23.887+0000 7f61fb1f0640 1 -- 172.21.15.148:0/3035844727 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61f41a46d0 con 0x7f61f4197950 2024-09-19T07:03:23.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:23.888+0000 7f61f1ffb640 1 -- 172.21.15.148:0/3035844727 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f61e000e070 con 0x7f61f4197950 2024-09-19T07:03:23.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:23.888+0000 7f61f1ffb640 1 --2- 172.21.15.148:0/3035844727 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f61e4039730 0x7f61e403bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:23.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:23.888+0000 7f61f1ffb640 1 -- 172.21.15.148:0/3035844727 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f61e004bd50 con 0x7f61f4197950 2024-09-19T07:03:23.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:23.888+0000 7f61f8f8c640 1 --2- 172.21.15.148:0/3035844727 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f61e4039730 0x7f61e403bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:23.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:23.888+0000 7f61fb1f0640 1 -- 172.21.15.148:0/3035844727 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61f4102be0 con 0x7f61f4197950 2024-09-19T07:03:23.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:23.889+0000 7f61f8f8c640 1 --2- 172.21.15.148:0/3035844727 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f61e4039730 0x7f61e403bbf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f61e8031550 tx=0x7f61e8005a40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:23.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:23.893+0000 7f61f1ffb640 1 -- 172.21.15.148:0/3035844727 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f61e0014020 con 0x7f61f4197950 2024-09-19T07:03:24.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:24.081+0000 7f61fb1f0640 1 -- 172.21.15.148:0/3035844727 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f61f41a4960 con 0x7f61f4197950 2024-09-19T07:03:24.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:24.082+0000 7f61f1ffb640 1 -- 172.21.15.148:0/3035844727 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+277 (secure 0 0 0) 0x7f61e0010d70 con 0x7f61f4197950 2024-09-19T07:03:24.083 INFO:teuthology.orchestra.run.smithi148.stdout:# minimal ceph.conf for eae8a4a8-7654-11ef-bceb-c7b262605968 2024-09-19T07:03:24.083 INFO:teuthology.orchestra.run.smithi148.stdout:[global] 2024-09-19T07:03:24.083 INFO:teuthology.orchestra.run.smithi148.stdout: fsid = eae8a4a8-7654-11ef-bceb-c7b262605968 2024-09-19T07:03:24.083 INFO:teuthology.orchestra.run.smithi148.stdout: mon_host = [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] 2024-09-19T07:03:24.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:24.085+0000 7f61fb1f0640 1 -- 172.21.15.148:0/3035844727 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f61e4039730 msgr2=0x7f61e403bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:24.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:24.085+0000 7f61fb1f0640 1 --2- 172.21.15.148:0/3035844727 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f61e4039730 0x7f61e403bbf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f61e8031550 tx=0x7f61e8005a40 comp rx=0 tx=0).stop 2024-09-19T07:03:24.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:24.085+0000 7f61fb1f0640 1 -- 172.21.15.148:0/3035844727 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61f4197950 msgr2=0x7f61f419bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:24.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:24.085+0000 7f61fb1f0640 1 --2- 172.21.15.148:0/3035844727 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61f4197950 0x7f61f419bce0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f61e000b520 tx=0x7f61e000b9e0 comp rx=0 tx=0).stop 2024-09-19T07:03:24.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:24.085+0000 7f61fb1f0640 1 -- 172.21.15.148:0/3035844727 shutdown_connections 2024-09-19T07:03:24.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:24.085+0000 7f61fb1f0640 1 --2- 172.21.15.148:0/3035844727 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f61e4039730 0x7f61e403bbf0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:24.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:24.085+0000 7f61fb1f0640 1 --2- 172.21.15.148:0/3035844727 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61f419c220 0x7f61f419c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:24.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:24.085+0000 7f61fb1f0640 1 --2- 172.21.15.148:0/3035844727 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61f4197950 0x7f61f419bce0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:24.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:24.085+0000 7f61fb1f0640 1 --2- 172.21.15.148:0/3035844727 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f61f4102780 0x7f61f4197410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:24.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:24.085+0000 7f61fb1f0640 1 -- 172.21.15.148:0/3035844727 >> 172.21.15.148:0/3035844727 conn(0x7f61f40fc1a0 msgr2=0x7f61f4105540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:24.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:24.085+0000 7f61fb1f0640 1 -- 172.21.15.148:0/3035844727 shutdown_connections 2024-09-19T07:03:24.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:24.086+0000 7f61fb1f0640 1 -- 172.21.15.148:0/3035844727 wait complete. 2024-09-19T07:03:24.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: mon.c calling monitor election 2024-09-19T07:03:24.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:03:24.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: mon.a calling monitor election 2024-09-19T07:03:24.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:03:24.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:03:24.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:03:24.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:24.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:03:24.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:03:24.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:24.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:03:24.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:03:24.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T07:03:24.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: monmap epoch 3 2024-09-19T07:03:24.636 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: fsid eae8a4a8-7654-11ef-bceb-c7b262605968 2024-09-19T07:03:24.636 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: last_changed 2024-09-19T07:03:17.163357+0000 2024-09-19T07:03:24.636 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: created 2024-09-19T07:01:44.959428+0000 2024-09-19T07:03:24.636 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: min_mon_release 19 (squid) 2024-09-19T07:03:24.636 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: election_strategy: 1 2024-09-19T07:03:24.636 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: 0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-19T07:03:24.636 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: 1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.c 2024-09-19T07:03:24.636 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: 2: [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] mon.b 2024-09-19T07:03:24.636 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: fsmap 2024-09-19T07:03:24.636 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T07:03:24.636 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: mgrmap e13: x(active, since 45s) 2024-09-19T07:03:24.636 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: overall HEALTH_OK 2024-09-19T07:03:24.636 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:24.637 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:24.637 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:24.637 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:24.637 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:03:24.637 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: from='client.? 172.21.15.179:0/611382300' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T07:03:24.637 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:24.637 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:03:24.783 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-19T07:03:24.783 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-19T07:03:24.784 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T07:03:24.812 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-19T07:03:24.812 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:03:24.879 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-19T07:03:24.880 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T07:03:24.908 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-19T07:03:24.908 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:03:24.974 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-19T07:03:24.975 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T07:03:25.001 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-19T07:03:25.002 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:03:25.013 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:24 smithi148 ceph-mon[31180]: mon.b calling monitor election 2024-09-19T07:03:25.013 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:24 smithi148 ceph-mon[31180]: mon.b calling monitor election 2024-09-19T07:03:25.013 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:24 smithi148 ceph-mon[31180]: mon.c calling monitor election 2024-09-19T07:03:25.013 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:24 smithi148 ceph-mon[31180]: mon.a calling monitor election 2024-09-19T07:03:25.013 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:24 smithi148 ceph-mon[31180]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T07:03:25.013 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:24 smithi148 ceph-mon[31180]: monmap epoch 3 2024-09-19T07:03:25.013 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:24 smithi148 ceph-mon[31180]: fsid eae8a4a8-7654-11ef-bceb-c7b262605968 2024-09-19T07:03:25.013 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:24 smithi148 ceph-mon[31180]: last_changed 2024-09-19T07:03:17.163357+0000 2024-09-19T07:03:25.013 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:24 smithi148 ceph-mon[31180]: created 2024-09-19T07:01:44.959428+0000 2024-09-19T07:03:25.014 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:24 smithi148 ceph-mon[31180]: min_mon_release 19 (squid) 2024-09-19T07:03:25.014 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:24 smithi148 ceph-mon[31180]: election_strategy: 1 2024-09-19T07:03:25.014 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:24 smithi148 ceph-mon[31180]: 0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-19T07:03:25.014 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:24 smithi148 ceph-mon[31180]: 1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.c 2024-09-19T07:03:25.014 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:24 smithi148 ceph-mon[31180]: 2: [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] mon.b 2024-09-19T07:03:25.014 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:24 smithi148 ceph-mon[31180]: fsmap 2024-09-19T07:03:25.014 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:24 smithi148 ceph-mon[31180]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T07:03:25.014 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:24 smithi148 ceph-mon[31180]: mgrmap e13: x(active, since 47s) 2024-09-19T07:03:25.014 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:24 smithi148 ceph-mon[31180]: overall HEALTH_OK 2024-09-19T07:03:25.014 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:24 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:25.014 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:24 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:25.014 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:24 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:25.014 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:24 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:25.015 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:24 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:25.015 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:24 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:25.015 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:24 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:25.015 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:24 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:25.015 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:24 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:25.015 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:24 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:25.015 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:24 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:25.015 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:24 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T07:03:25.015 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:24 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T07:03:25.015 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:24 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:25.067 INFO:tasks.cephadm:Adding mgr.x on smithi148 2024-09-19T07:03:25.067 INFO:tasks.cephadm:Adding mgr.y on smithi165 2024-09-19T07:03:25.067 INFO:tasks.cephadm:Adding mgr.z on smithi179 2024-09-19T07:03:25.067 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph orch apply mgr '3;smithi148=x;smithi165=y;smithi179=z' 2024-09-19T07:03:25.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:24 smithi179 ceph-mon[35716]: mon.b calling monitor election 2024-09-19T07:03:25.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:24 smithi179 ceph-mon[35716]: mon.b calling monitor election 2024-09-19T07:03:25.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:24 smithi179 ceph-mon[35716]: mon.c calling monitor election 2024-09-19T07:03:25.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:24 smithi179 ceph-mon[35716]: mon.a calling monitor election 2024-09-19T07:03:25.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:24 smithi179 ceph-mon[35716]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T07:03:25.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:24 smithi179 ceph-mon[35716]: monmap epoch 3 2024-09-19T07:03:25.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:24 smithi179 ceph-mon[35716]: fsid eae8a4a8-7654-11ef-bceb-c7b262605968 2024-09-19T07:03:25.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:24 smithi179 ceph-mon[35716]: last_changed 2024-09-19T07:03:17.163357+0000 2024-09-19T07:03:25.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:24 smithi179 ceph-mon[35716]: created 2024-09-19T07:01:44.959428+0000 2024-09-19T07:03:25.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:24 smithi179 ceph-mon[35716]: min_mon_release 19 (squid) 2024-09-19T07:03:25.274 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:24 smithi179 ceph-mon[35716]: election_strategy: 1 2024-09-19T07:03:25.274 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:24 smithi179 ceph-mon[35716]: 0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-19T07:03:25.274 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:24 smithi179 ceph-mon[35716]: 1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.c 2024-09-19T07:03:25.274 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:24 smithi179 ceph-mon[35716]: 2: [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] mon.b 2024-09-19T07:03:25.274 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:24 smithi179 ceph-mon[35716]: fsmap 2024-09-19T07:03:25.274 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:24 smithi179 ceph-mon[35716]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T07:03:25.274 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:24 smithi179 ceph-mon[35716]: mgrmap e13: x(active, since 47s) 2024-09-19T07:03:25.274 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:24 smithi179 ceph-mon[35716]: overall HEALTH_OK 2024-09-19T07:03:25.274 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:24 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:25.274 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:24 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:25.274 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:24 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:25.274 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:24 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:25.274 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:24 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:25.275 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:24 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:25.275 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:24 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:25.275 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:24 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:25.275 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:24 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:25.275 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:24 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:25.275 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:24 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:25.275 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:24 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T07:03:25.275 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:24 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T07:03:25.275 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:24 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:25.340 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:03:25.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: mon.b calling monitor election 2024-09-19T07:03:25.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: mon.b calling monitor election 2024-09-19T07:03:25.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: mon.c calling monitor election 2024-09-19T07:03:25.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: mon.a calling monitor election 2024-09-19T07:03:25.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T07:03:25.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: monmap epoch 3 2024-09-19T07:03:25.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: fsid eae8a4a8-7654-11ef-bceb-c7b262605968 2024-09-19T07:03:25.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: last_changed 2024-09-19T07:03:17.163357+0000 2024-09-19T07:03:25.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: created 2024-09-19T07:01:44.959428+0000 2024-09-19T07:03:25.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: min_mon_release 19 (squid) 2024-09-19T07:03:25.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: election_strategy: 1 2024-09-19T07:03:25.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: 0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-19T07:03:25.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: 1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.c 2024-09-19T07:03:25.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: 2: [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] mon.b 2024-09-19T07:03:25.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: fsmap 2024-09-19T07:03:25.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T07:03:25.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: mgrmap e13: x(active, since 47s) 2024-09-19T07:03:25.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: overall HEALTH_OK 2024-09-19T07:03:25.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:25.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:25.386 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:25.386 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:25.386 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:25.386 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:25.386 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:25.386 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:25.386 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:25.386 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:25.386 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:25.386 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T07:03:25.386 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T07:03:25.386 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:24 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:25.771 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.767+0000 7fe664a91640 1 -- 172.21.15.179:0/1376112748 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6601005f0 msgr2=0x7fe6601009f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:25.771 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.767+0000 7fe664a91640 1 --2- 172.21.15.179:0/1376112748 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6601005f0 0x7fe6601009f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe650009880 tx=0x7fe65002a5d0 comp rx=0 tx=0).stop 2024-09-19T07:03:25.771 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.767+0000 7fe664a91640 1 -- 172.21.15.179:0/1376112748 shutdown_connections 2024-09-19T07:03:25.771 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.767+0000 7fe664a91640 1 --2- 172.21.15.179:0/1376112748 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6601005f0 0x7fe6601009f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:25.771 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.767+0000 7fe664a91640 1 -- 172.21.15.179:0/1376112748 >> 172.21.15.179:0/1376112748 conn(0x7fe6600fbda0 msgr2=0x7fe6600fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:25.771 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.767+0000 7fe664a91640 1 -- 172.21.15.179:0/1376112748 shutdown_connections 2024-09-19T07:03:25.771 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.767+0000 7fe664a91640 1 -- 172.21.15.179:0/1376112748 wait complete. 2024-09-19T07:03:25.771 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.768+0000 7fe664a91640 1 Processor -- start 2024-09-19T07:03:25.771 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.768+0000 7fe664a91640 1 -- start start 2024-09-19T07:03:25.771 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.768+0000 7fe664a91640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6601005f0 0x7fe660195ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:25.772 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.768+0000 7fe664a91640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe660196420 0x7fe66019b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:25.772 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.768+0000 7fe664a91640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe6601968a0 0x7fe66019da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:25.772 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.768+0000 7fe664a91640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe6601066e0 con 0x7fe660196420 2024-09-19T07:03:25.772 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.768+0000 7fe664a91640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe660106560 con 0x7fe6601968a0 2024-09-19T07:03:25.772 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.768+0000 7fe664a91640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe660106860 con 0x7fe6601005f0 2024-09-19T07:03:25.772 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.768+0000 7fe65e59c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6601005f0 0x7fe660195ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:25.772 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.768+0000 7fe65e59c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6601005f0 0x7fe660195ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39926/0 (socket says 172.21.15.179:39926) 2024-09-19T07:03:25.772 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.768+0000 7fe65e59c640 1 -- 172.21.15.179:0/37739930 learned_addr learned my addr 172.21.15.179:0/37739930 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-09-19T07:03:25.772 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.768+0000 7fe657fff640 1 --2- 172.21.15.179:0/37739930 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe660196420 0x7fe66019b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:25.772 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.769+0000 7fe65ed9d640 1 --2- 172.21.15.179:0/37739930 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe6601968a0 0x7fe66019da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:25.772 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.769+0000 7fe657fff640 1 -- 172.21.15.179:0/37739930 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6601005f0 msgr2=0x7fe660195ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:25.772 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.769+0000 7fe657fff640 1 --2- 172.21.15.179:0/37739930 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6601005f0 0x7fe660195ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:25.772 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.769+0000 7fe657fff640 1 -- 172.21.15.179:0/37739930 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe6601968a0 msgr2=0x7fe66019da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:25.773 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.769+0000 7fe657fff640 1 --2- 172.21.15.179:0/37739930 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe6601968a0 0x7fe66019da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:25.773 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.769+0000 7fe657fff640 1 -- 172.21.15.179:0/37739930 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe66019e2e0 con 0x7fe660196420 2024-09-19T07:03:25.773 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.769+0000 7fe65e59c640 1 --2- 172.21.15.179:0/37739930 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6601005f0 0x7fe660195ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:03:25.773 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.769+0000 7fe657fff640 1 --2- 172.21.15.179:0/37739930 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe660196420 0x7fe66019b490 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe64800b450 tx=0x7fe64800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:25.773 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.769+0000 7fe6577fe640 1 -- 172.21.15.179:0/37739930 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe648004230 con 0x7fe660196420 2024-09-19T07:03:25.773 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.769+0000 7fe6577fe640 1 -- 172.21.15.179:0/37739930 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe6480043d0 con 0x7fe660196420 2024-09-19T07:03:25.773 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.769+0000 7fe6577fe640 1 -- 172.21.15.179:0/37739930 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe648003cb0 con 0x7fe660196420 2024-09-19T07:03:25.773 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.769+0000 7fe664a91640 1 -- 172.21.15.179:0/37739930 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe66019e5d0 con 0x7fe660196420 2024-09-19T07:03:25.773 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.769+0000 7fe664a91640 1 -- 172.21.15.179:0/37739930 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe66019eb40 con 0x7fe660196420 2024-09-19T07:03:25.774 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.770+0000 7fe6577fe640 1 -- 172.21.15.179:0/37739930 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7fe64800f050 con 0x7fe660196420 2024-09-19T07:03:25.774 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.770+0000 7fe664a91640 1 -- 172.21.15.179:0/37739930 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe66018f4a0 con 0x7fe660196420 2024-09-19T07:03:25.774 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.770+0000 7fe6577fe640 1 --2- 172.21.15.179:0/37739930 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fe64c039730 0x7fe64c03bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:25.774 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.770+0000 7fe6577fe640 1 -- 172.21.15.179:0/37739930 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe64804c290 con 0x7fe660196420 2024-09-19T07:03:25.774 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.771+0000 7fe65e59c640 1 --2- 172.21.15.179:0/37739930 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fe64c039730 0x7fe64c03bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:25.774 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.771+0000 7fe65e59c640 1 --2- 172.21.15.179:0/37739930 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fe64c039730 0x7fe64c03bbf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe650009230 tx=0x7fe6500058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:25.776 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.776+0000 7fe6577fe640 1 -- 172.21.15.179:0/37739930 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe64800d040 con 0x7fe660196420 2024-09-19T07:03:25.952 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.951+0000 7fe664a91640 1 -- 172.21.15.179:0/37739930 --> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi148=x;smithi165=y;smithi179=z", "target": ["mon-mgr", ""]}) -- 0x7fe6600626c0 con 0x7fe64c039730 2024-09-19T07:03:25.958 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.957+0000 7fe6577fe640 1 -- 172.21.15.179:0/37739930 <== mgr.14148 v2:172.21.15.148:6800/3007822654 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fe6600626c0 con 0x7fe64c039730 2024-09-19T07:03:25.958 INFO:teuthology.orchestra.run.smithi179.stdout:Scheduled mgr update... 2024-09-19T07:03:25.961 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.959+0000 7fe664a91640 1 -- 172.21.15.179:0/37739930 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fe64c039730 msgr2=0x7fe64c03bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:25.961 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.959+0000 7fe664a91640 1 --2- 172.21.15.179:0/37739930 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fe64c039730 0x7fe64c03bbf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe650009230 tx=0x7fe6500058d0 comp rx=0 tx=0).stop 2024-09-19T07:03:25.961 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.959+0000 7fe664a91640 1 -- 172.21.15.179:0/37739930 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe660196420 msgr2=0x7fe66019b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:25.961 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.959+0000 7fe664a91640 1 --2- 172.21.15.179:0/37739930 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe660196420 0x7fe66019b490 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe64800b450 tx=0x7fe64800b910 comp rx=0 tx=0).stop 2024-09-19T07:03:25.961 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.960+0000 7fe664a91640 1 -- 172.21.15.179:0/37739930 shutdown_connections 2024-09-19T07:03:25.961 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.960+0000 7fe664a91640 1 --2- 172.21.15.179:0/37739930 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fe64c039730 0x7fe64c03bbf0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:25.961 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.960+0000 7fe664a91640 1 --2- 172.21.15.179:0/37739930 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe6601968a0 0x7fe66019da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:25.961 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.960+0000 7fe664a91640 1 --2- 172.21.15.179:0/37739930 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe660196420 0x7fe66019b490 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:25.961 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.960+0000 7fe664a91640 1 --2- 172.21.15.179:0/37739930 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6601005f0 0x7fe660195ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:25.961 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.960+0000 7fe664a91640 1 -- 172.21.15.179:0/37739930 >> 172.21.15.179:0/37739930 conn(0x7fe6600fbda0 msgr2=0x7fe6600fc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:25.962 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.960+0000 7fe664a91640 1 -- 172.21.15.179:0/37739930 shutdown_connections 2024-09-19T07:03:25.962 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:03:25.960+0000 7fe664a91640 1 -- 172.21.15.179:0/37739930 wait complete. 2024-09-19T07:03:25.968 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:25 smithi148 ceph-mon[31180]: Updating smithi179:/var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:03:25.968 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:25 smithi148 ceph-mon[31180]: Updating smithi148:/var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:03:25.968 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:25 smithi148 ceph-mon[31180]: Updating smithi165:/var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:03:25.968 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:25 smithi148 ceph-mon[31180]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T07:03:25.968 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:25 smithi148 ceph-mon[31180]: Reconfiguring daemon mon.a on smithi148 2024-09-19T07:03:25.968 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:25 smithi148 ceph-mon[31180]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:25.968 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:25 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:03:26.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:25 smithi179 ceph-mon[35716]: Updating smithi179:/var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:03:26.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:25 smithi179 ceph-mon[35716]: Updating smithi148:/var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:03:26.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:25 smithi179 ceph-mon[35716]: Updating smithi165:/var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:03:26.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:25 smithi179 ceph-mon[35716]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T07:03:26.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:25 smithi179 ceph-mon[35716]: Reconfiguring daemon mon.a on smithi148 2024-09-19T07:03:26.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:25 smithi179 ceph-mon[35716]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:26.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:25 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:03:26.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:25 smithi165 ceph-mon[35326]: Updating smithi179:/var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:03:26.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:25 smithi165 ceph-mon[35326]: Updating smithi148:/var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:03:26.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:25 smithi165 ceph-mon[35326]: Updating smithi165:/var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:03:26.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:25 smithi165 ceph-mon[35326]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T07:03:26.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:25 smithi165 ceph-mon[35326]: Reconfiguring daemon mon.a on smithi148 2024-09-19T07:03:26.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:25 smithi165 ceph-mon[35326]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:26.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:25 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:03:26.521 DEBUG:teuthology.orchestra.run.smithi165:mgr.y> sudo journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mgr.y.service 2024-09-19T07:03:26.523 DEBUG:teuthology.orchestra.run.smithi179:mgr.z> sudo journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mgr.z.service 2024-09-19T07:03:26.526 INFO:tasks.cephadm:Deploying OSDs... 2024-09-19T07:03:26.526 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-19T07:03:26.526 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T07:03:26.542 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T07:03:26.543 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_1 2024-09-19T07:03:26.600 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T07:03:26.600 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T07:03:26.600 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-19T07:03:26.600 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:03:26.600 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T07:03:26.600 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-09-19 07:02:45.633199514 +0000 2024-09-19T07:03:26.601 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-09-19 06:58:31.645678913 +0000 2024-09-19T07:03:26.601 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-09-19 06:58:31.645678913 +0000 2024-09-19T07:03:26.601 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2024-09-19 06:58:31.645678913 +0000 2024-09-19T07:03:26.601 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T07:03:26.666 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-09-19T07:03:26.666 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-09-19T07:03:26.666 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000210833 s, 2.4 MB/s 2024-09-19T07:03:26.667 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T07:03:26.724 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_2 2024-09-19T07:03:26.780 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T07:03:26.780 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T07:03:26.780 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-19T07:03:26.780 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:03:26.780 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T07:03:26.780 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-09-19 07:02:45.659198899 +0000 2024-09-19T07:03:26.780 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-09-19 06:58:31.984670849 +0000 2024-09-19T07:03:26.780 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-09-19 06:58:31.984670849 +0000 2024-09-19T07:03:26.780 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2024-09-19 06:58:31.984670849 +0000 2024-09-19T07:03:26.781 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T07:03:26.843 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-09-19T07:03:26.843 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-09-19T07:03:26.843 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000189979 s, 2.7 MB/s 2024-09-19T07:03:26.845 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T07:03:26.901 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_3 2024-09-19T07:03:26.957 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T07:03:26.958 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T07:03:26.958 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-19T07:03:26.958 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:03:26.958 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T07:03:26.958 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-09-19 07:02:45.684198307 +0000 2024-09-19T07:03:26.958 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-09-19 06:58:32.327662690 +0000 2024-09-19T07:03:26.958 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-09-19 06:58:32.327662690 +0000 2024-09-19T07:03:26.958 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2024-09-19 06:58:32.327662690 +0000 2024-09-19T07:03:26.958 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T07:03:27.022 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-09-19T07:03:27.022 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-09-19T07:03:27.022 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000248704 s, 2.1 MB/s 2024-09-19T07:03:27.023 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T07:03:27.081 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_4 2024-09-19T07:03:27.136 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T07:03:27.136 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T07:03:27.137 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-19T07:03:27.137 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:03:27.137 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T07:03:27.137 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-09-19 07:02:45.710197692 +0000 2024-09-19T07:03:27.137 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-09-19 06:58:32.654654911 +0000 2024-09-19T07:03:27.137 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-09-19 06:58:32.654654911 +0000 2024-09-19T07:03:27.137 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2024-09-19 06:58:32.654654911 +0000 2024-09-19T07:03:27.137 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T07:03:27.200 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-09-19T07:03:27.200 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-09-19T07:03:27.200 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000200021 s, 2.6 MB/s 2024-09-19T07:03:27.201 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T07:03:27.258 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-19T07:03:27.258 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T07:03:27.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:26 smithi179 ceph-mon[35716]: from='client.14208 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi148=x;smithi165=y;smithi179=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:03:27.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:26 smithi179 ceph-mon[35716]: Saving service mgr spec with placement smithi148=x;smithi165=y;smithi179=z;count:3 2024-09-19T07:03:27.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:26 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:27.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:26 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:27.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:26 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:27.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:26 smithi179 ceph-mon[35716]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T07:03:27.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:26 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T07:03:27.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:26 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T07:03:27.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:26 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:27.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:26 smithi179 ceph-mon[35716]: Reconfiguring daemon mgr.x on smithi148 2024-09-19T07:03:27.274 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T07:03:27.275 DEBUG:teuthology.orchestra.run.smithi165:> stat /dev/vg_nvme/lv_1 2024-09-19T07:03:27.330 INFO:teuthology.orchestra.run.smithi165.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T07:03:27.330 INFO:teuthology.orchestra.run.smithi165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T07:03:27.330 INFO:teuthology.orchestra.run.smithi165.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-19T07:03:27.330 INFO:teuthology.orchestra.run.smithi165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:03:27.330 INFO:teuthology.orchestra.run.smithi165.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T07:03:27.330 INFO:teuthology.orchestra.run.smithi165.stdout:Access: 2024-09-19 07:03:16.588405564 +0000 2024-09-19T07:03:27.330 INFO:teuthology.orchestra.run.smithi165.stdout:Modify: 2024-09-19 06:58:57.576681652 +0000 2024-09-19T07:03:27.330 INFO:teuthology.orchestra.run.smithi165.stdout:Change: 2024-09-19 06:58:57.576681652 +0000 2024-09-19T07:03:27.331 INFO:teuthology.orchestra.run.smithi165.stdout: Birth: 2024-09-19 06:58:57.576681652 +0000 2024-09-19T07:03:27.331 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T07:03:27.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:26 smithi148 ceph-mon[31180]: from='client.14208 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi148=x;smithi165=y;smithi179=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:03:27.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:26 smithi148 ceph-mon[31180]: Saving service mgr spec with placement smithi148=x;smithi165=y;smithi179=z;count:3 2024-09-19T07:03:27.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:26 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:27.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:26 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:27.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:26 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:27.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:26 smithi148 ceph-mon[31180]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T07:03:27.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:26 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T07:03:27.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:26 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T07:03:27.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:26 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:27.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:26 smithi148 ceph-mon[31180]: Reconfiguring daemon mgr.x on smithi148 2024-09-19T07:03:27.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:26 smithi165 ceph-mon[35326]: from='client.14208 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi148=x;smithi165=y;smithi179=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:03:27.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:26 smithi165 ceph-mon[35326]: Saving service mgr spec with placement smithi148=x;smithi165=y;smithi179=z;count:3 2024-09-19T07:03:27.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:26 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:27.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:26 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:27.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:26 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:27.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:26 smithi165 ceph-mon[35326]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T07:03:27.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:26 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T07:03:27.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:26 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T07:03:27.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:26 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:27.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:26 smithi165 ceph-mon[35326]: Reconfiguring daemon mgr.x on smithi148 2024-09-19T07:03:27.395 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records in 2024-09-19T07:03:27.395 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records out 2024-09-19T07:03:27.395 INFO:teuthology.orchestra.run.smithi165.stderr:512 bytes copied, 0.000268111 s, 1.9 MB/s 2024-09-19T07:03:27.396 DEBUG:teuthology.orchestra.run.smithi165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T07:03:27.453 DEBUG:teuthology.orchestra.run.smithi165:> stat /dev/vg_nvme/lv_2 2024-09-19T07:03:27.510 INFO:teuthology.orchestra.run.smithi165.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T07:03:27.510 INFO:teuthology.orchestra.run.smithi165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T07:03:27.511 INFO:teuthology.orchestra.run.smithi165.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-09-19T07:03:27.511 INFO:teuthology.orchestra.run.smithi165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:03:27.511 INFO:teuthology.orchestra.run.smithi165.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T07:03:27.511 INFO:teuthology.orchestra.run.smithi165.stdout:Access: 2024-09-19 07:03:16.588405564 +0000 2024-09-19T07:03:27.511 INFO:teuthology.orchestra.run.smithi165.stdout:Modify: 2024-09-19 06:58:57.904676530 +0000 2024-09-19T07:03:27.511 INFO:teuthology.orchestra.run.smithi165.stdout:Change: 2024-09-19 06:58:57.904676530 +0000 2024-09-19T07:03:27.511 INFO:teuthology.orchestra.run.smithi165.stdout: Birth: 2024-09-19 06:58:57.904676530 +0000 2024-09-19T07:03:27.511 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T07:03:27.574 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records in 2024-09-19T07:03:27.574 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records out 2024-09-19T07:03:27.575 INFO:teuthology.orchestra.run.smithi165.stderr:512 bytes copied, 0.000203299 s, 2.5 MB/s 2024-09-19T07:03:27.576 DEBUG:teuthology.orchestra.run.smithi165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T07:03:27.633 DEBUG:teuthology.orchestra.run.smithi165:> stat /dev/vg_nvme/lv_3 2024-09-19T07:03:27.688 INFO:teuthology.orchestra.run.smithi165.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T07:03:27.689 INFO:teuthology.orchestra.run.smithi165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T07:03:27.689 INFO:teuthology.orchestra.run.smithi165.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-19T07:03:27.689 INFO:teuthology.orchestra.run.smithi165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:03:27.689 INFO:teuthology.orchestra.run.smithi165.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T07:03:27.689 INFO:teuthology.orchestra.run.smithi165.stdout:Access: 2024-09-19 07:03:16.589405549 +0000 2024-09-19T07:03:27.689 INFO:teuthology.orchestra.run.smithi165.stdout:Modify: 2024-09-19 06:58:58.231671427 +0000 2024-09-19T07:03:27.689 INFO:teuthology.orchestra.run.smithi165.stdout:Change: 2024-09-19 06:58:58.231671427 +0000 2024-09-19T07:03:27.689 INFO:teuthology.orchestra.run.smithi165.stdout: Birth: 2024-09-19 06:58:58.231671427 +0000 2024-09-19T07:03:27.689 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T07:03:27.753 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records in 2024-09-19T07:03:27.753 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records out 2024-09-19T07:03:27.753 INFO:teuthology.orchestra.run.smithi165.stderr:512 bytes copied, 0.000229011 s, 2.2 MB/s 2024-09-19T07:03:27.754 DEBUG:teuthology.orchestra.run.smithi165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T07:03:27.811 DEBUG:teuthology.orchestra.run.smithi165:> stat /dev/vg_nvme/lv_4 2024-09-19T07:03:27.867 INFO:teuthology.orchestra.run.smithi165.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T07:03:27.867 INFO:teuthology.orchestra.run.smithi165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T07:03:27.867 INFO:teuthology.orchestra.run.smithi165.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-09-19T07:03:27.867 INFO:teuthology.orchestra.run.smithi165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:03:27.867 INFO:teuthology.orchestra.run.smithi165.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T07:03:27.867 INFO:teuthology.orchestra.run.smithi165.stdout:Access: 2024-09-19 07:03:16.589405549 +0000 2024-09-19T07:03:27.867 INFO:teuthology.orchestra.run.smithi165.stdout:Modify: 2024-09-19 06:58:58.595665747 +0000 2024-09-19T07:03:27.867 INFO:teuthology.orchestra.run.smithi165.stdout:Change: 2024-09-19 06:58:58.595665747 +0000 2024-09-19T07:03:27.867 INFO:teuthology.orchestra.run.smithi165.stdout: Birth: 2024-09-19 06:58:58.595665747 +0000 2024-09-19T07:03:27.867 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T07:03:27.929 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records in 2024-09-19T07:03:27.930 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records out 2024-09-19T07:03:27.930 INFO:teuthology.orchestra.run.smithi165.stderr:512 bytes copied, 0.000170809 s, 3.0 MB/s 2024-09-19T07:03:27.931 DEBUG:teuthology.orchestra.run.smithi165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T07:03:27.988 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-19T07:03:27.988 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T07:03:28.008 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T07:03:28.008 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_1 2024-09-19T07:03:28.067 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T07:03:28.067 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T07:03:28.067 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-09-19T07:03:28.067 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:03:28.067 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T07:03:28.067 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-09-19 07:03:07.560796084 +0000 2024-09-19T07:03:28.068 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-09-19 06:58:47.682763435 +0000 2024-09-19T07:03:28.068 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-09-19 06:58:47.682763435 +0000 2024-09-19T07:03:28.068 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: 2024-09-19 06:58:47.682763435 +0000 2024-09-19T07:03:28.068 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T07:03:28.136 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-09-19T07:03:28.136 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-09-19T07:03:28.136 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000303218 s, 1.7 MB/s 2024-09-19T07:03:28.137 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T07:03:28.194 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_2 2024-09-19T07:03:28.251 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T07:03:28.251 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T07:03:28.251 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 682 Links: 1 2024-09-19T07:03:28.251 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:03:28.252 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T07:03:28.252 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-09-19 07:03:07.560796084 +0000 2024-09-19T07:03:28.252 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-09-19 06:58:47.999756137 +0000 2024-09-19T07:03:28.252 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-09-19 06:58:47.999756137 +0000 2024-09-19T07:03:28.252 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: 2024-09-19 06:58:47.999756137 +0000 2024-09-19T07:03:28.252 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T07:03:28.314 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:28 smithi179 ceph-mon[35716]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:28.314 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:28 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:28.314 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:28 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:28.315 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:28 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:28.315 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:28 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T07:03:28.315 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:28 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T07:03:28.315 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:28 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:28.317 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-09-19T07:03:28.317 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-09-19T07:03:28.317 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000193541 s, 2.6 MB/s 2024-09-19T07:03:28.318 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T07:03:28.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:28 smithi148 ceph-mon[31180]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:28.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:28 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:28.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:28 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:28.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:28 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:28.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:28 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T07:03:28.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:28 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T07:03:28.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:28 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:28.376 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_3 2024-09-19T07:03:28.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:28 smithi165 ceph-mon[35326]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:28.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:28 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:28.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:28 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:28.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:28 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:28.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:28 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T07:03:28.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:28 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T07:03:28.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:28 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:28.431 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T07:03:28.432 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T07:03:28.432 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-09-19T07:03:28.432 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:03:28.432 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T07:03:28.432 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-09-19 07:03:07.561796061 +0000 2024-09-19T07:03:28.432 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-09-19 06:58:48.336748379 +0000 2024-09-19T07:03:28.432 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-09-19 06:58:48.336748379 +0000 2024-09-19T07:03:28.432 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: 2024-09-19 06:58:48.336748379 +0000 2024-09-19T07:03:28.432 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T07:03:28.496 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-09-19T07:03:28.496 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-09-19T07:03:28.496 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000210511 s, 2.4 MB/s 2024-09-19T07:03:28.498 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T07:03:28.554 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_4 2024-09-19T07:03:28.610 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T07:03:28.611 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T07:03:28.611 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-09-19T07:03:28.611 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:03:28.611 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T07:03:28.611 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-09-19 07:03:07.561796061 +0000 2024-09-19T07:03:28.611 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-09-19 06:58:48.652741104 +0000 2024-09-19T07:03:28.611 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-09-19 06:58:48.652741104 +0000 2024-09-19T07:03:28.611 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: 2024-09-19 06:58:48.652741104 +0000 2024-09-19T07:03:28.611 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T07:03:28.674 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-09-19T07:03:28.674 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-09-19T07:03:28.674 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.00020475 s, 2.5 MB/s 2024-09-19T07:03:28.675 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T07:03:28.732 INFO:tasks.cephadm:Deploying osd.0 on smithi148 with /dev/vg_nvme/lv_4... 2024-09-19T07:03:28.732 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T07:03:28.988 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:03:29.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:29 smithi148 ceph-mon[31180]: Reconfiguring mon.b (monmap changed)... 2024-09-19T07:03:29.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:29 smithi148 ceph-mon[31180]: Reconfiguring daemon mon.b on smithi165 2024-09-19T07:03:29.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:29 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:29.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:29 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:29.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:29 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T07:03:29.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:29 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T07:03:29.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:29 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:29.377 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:29 smithi179 ceph-mon[35716]: Reconfiguring mon.b (monmap changed)... 2024-09-19T07:03:29.377 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:29 smithi179 ceph-mon[35716]: Reconfiguring daemon mon.b on smithi165 2024-09-19T07:03:29.377 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:29 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:29.377 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:29 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:29.377 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:29 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T07:03:29.377 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:29 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T07:03:29.377 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:29 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:29.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:29 smithi165 ceph-mon[35326]: Reconfiguring mon.b (monmap changed)... 2024-09-19T07:03:29.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:29 smithi165 ceph-mon[35326]: Reconfiguring daemon mon.b on smithi165 2024-09-19T07:03:29.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:29 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:29.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:29 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:29.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:29 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T07:03:29.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:29 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T07:03:29.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:29 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:30.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:30 smithi148 ceph-mon[31180]: Reconfiguring mon.c (monmap changed)... 2024-09-19T07:03:30.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:30 smithi148 ceph-mon[31180]: Reconfiguring daemon mon.c on smithi179 2024-09-19T07:03:30.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:30 smithi148 ceph-mon[31180]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:30.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:30 smithi165 ceph-mon[35326]: Reconfiguring mon.c (monmap changed)... 2024-09-19T07:03:30.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:30 smithi165 ceph-mon[35326]: Reconfiguring daemon mon.c on smithi179 2024-09-19T07:03:30.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:30 smithi165 ceph-mon[35326]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:30.514 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:30 smithi179 ceph-mon[35716]: Reconfiguring mon.c (monmap changed)... 2024-09-19T07:03:30.514 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:30 smithi179 ceph-mon[35716]: Reconfiguring daemon mon.c on smithi179 2024-09-19T07:03:30.514 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:30 smithi179 ceph-mon[35716]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:31.145 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:31 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:31.145 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:31 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:31.145 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:31 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:03:31.145 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:31 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:31.145 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:31 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:03:31.145 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:31 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:31.146 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:31 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T07:03:31.146 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:31 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T07:03:31.146 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:31 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T07:03:31.146 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:31 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:31.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:31 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:31.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:31 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:31.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:31 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:03:31.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:31 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:31.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:31 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:03:31.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:31 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:31.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:31 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T07:03:31.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:31 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T07:03:31.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:31 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T07:03:31.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:31 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:31.407 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:03:31.420 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:31 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:31.420 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:31 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:31.420 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:31 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:03:31.420 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:31 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:31.420 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:31 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:03:31.420 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:31 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:31.420 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:31 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T07:03:31.420 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:31 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T07:03:31.420 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:31 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T07:03:31.421 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:31 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:31.432 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi148:vg_nvme/lv_4 2024-09-19T07:03:31.677 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:03:32.023 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:03:31 smithi179 systemd[1]: Starting Ceph mgr.z for eae8a4a8-7654-11ef-bceb-c7b262605968... 2024-09-19T07:03:32.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:32.124+0000 7f111748d640 1 -- 172.21.15.148:0/1958206712 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1110101d10 msgr2=0x7f1110102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:32.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:32.124+0000 7f111748d640 1 --2- 172.21.15.148:0/1958206712 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1110101d10 0x7f1110102190 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1100009900 tx=0x7f110002a410 comp rx=0 tx=0).stop 2024-09-19T07:03:32.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:32.124+0000 7f111748d640 1 -- 172.21.15.148:0/1958206712 shutdown_connections 2024-09-19T07:03:32.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:32.124+0000 7f111748d640 1 --2- 172.21.15.148:0/1958206712 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11101026d0 0x7f1110108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:32.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:32.124+0000 7f111748d640 1 --2- 172.21.15.148:0/1958206712 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1110101d10 0x7f1110102190 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:32.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:32.124+0000 7f111748d640 1 --2- 172.21.15.148:0/1958206712 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1110100b10 0x7f1110100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:32.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:32.124+0000 7f111748d640 1 -- 172.21.15.148:0/1958206712 >> 172.21.15.148:0/1958206712 conn(0x7f11100fc2a0 msgr2=0x7f11100fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:32.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:32.124+0000 7f111748d640 1 -- 172.21.15.148:0/1958206712 shutdown_connections 2024-09-19T07:03:32.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:32.124+0000 7f111748d640 1 -- 172.21.15.148:0/1958206712 wait complete. 2024-09-19T07:03:32.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:32.124+0000 7f111748d640 1 Processor -- start 2024-09-19T07:03:32.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:32.125+0000 7f111748d640 1 -- start start 2024-09-19T07:03:32.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:32.125+0000 7f111748d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1110100b10 0x7f1110197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:32.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:32.125+0000 7f111748d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1110101d10 0x7f1110198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:32.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:32.125+0000 7f111748d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f11101026d0 0x7f111019f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:32.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:32.125+0000 7f111748d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f111010d8c0 con 0x7f1110101d10 2024-09-19T07:03:32.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:32.125+0000 7f111748d640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f111010d740 con 0x7f11101026d0 2024-09-19T07:03:32.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:32.125+0000 7f111748d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f111010da40 con 0x7f1110100b10 2024-09-19T07:03:32.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:32.125+0000 7f1114a28640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1110101d10 0x7f1110198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:32.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:32.125+0000 7f1114a28640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1110101d10 0x7f1110198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60922/0 (socket says 172.21.15.148:60922) 2024-09-19T07:03:32.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:32.125+0000 7f1114a28640 1 -- 172.21.15.148:0/2124255226 learned_addr learned my addr 172.21.15.148:0/2124255226 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:03:32.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:32.125+0000 7f1115229640 1 --2- 172.21.15.148:0/2124255226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1110100b10 0x7f1110197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:32.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:32.125+0000 7f1115a2a640 1 --2- 172.21.15.148:0/2124255226 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f11101026d0 0x7f111019f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:32.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:32.125+0000 7f1114a28640 1 -- 172.21.15.148:0/2124255226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1110100b10 msgr2=0x7f1110197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:32.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:32.125+0000 7f1114a28640 1 --2- 172.21.15.148:0/2124255226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1110100b10 0x7f1110197f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:32.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:32.125+0000 7f1114a28640 1 -- 172.21.15.148:0/2124255226 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f11101026d0 msgr2=0x7f111019f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:32.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:32.125+0000 7f1114a28640 1 --2- 172.21.15.148:0/2124255226 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f11101026d0 0x7f111019f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:32.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:32.125+0000 7f1114a28640 1 -- 172.21.15.148:0/2124255226 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f111019fb50 con 0x7f1110101d10 2024-09-19T07:03:32.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:32.125+0000 7f1114a28640 1 --2- 172.21.15.148:0/2124255226 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1110101d10 0x7f1110198460 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1100009230 tx=0x7f1100031b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:32.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:32.126+0000 7f11067fc640 1 -- 172.21.15.148:0/2124255226 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f110003f030 con 0x7f1110101d10 2024-09-19T07:03:32.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:32.126+0000 7f11067fc640 1 -- 172.21.15.148:0/2124255226 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1100003ad0 con 0x7f1110101d10 2024-09-19T07:03:32.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:32.126+0000 7f11067fc640 1 -- 172.21.15.148:0/2124255226 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1100035070 con 0x7f1110101d10 2024-09-19T07:03:32.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:32.126+0000 7f111748d640 1 -- 172.21.15.148:0/2124255226 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f111019fde0 con 0x7f1110101d10 2024-09-19T07:03:32.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:32.126+0000 7f111748d640 1 -- 172.21.15.148:0/2124255226 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11101a0260 con 0x7f1110101d10 2024-09-19T07:03:32.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:32.126+0000 7f11067fc640 1 -- 172.21.15.148:0/2124255226 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f1100042030 con 0x7f1110101d10 2024-09-19T07:03:32.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:32.127+0000 7f111748d640 1 -- 172.21.15.148:0/2124255226 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1110107f60 con 0x7f1110101d10 2024-09-19T07:03:32.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:32.127+0000 7f11067fc640 1 --2- 172.21.15.148:0/2124255226 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f10fc039500 0x7f10fc03b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:32.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:32.127+0000 7f11067fc640 1 -- 172.21.15.148:0/2124255226 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f110006cbf0 con 0x7f1110101d10 2024-09-19T07:03:32.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:32.127+0000 7f1115229640 1 --2- 172.21.15.148:0/2124255226 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f10fc039500 0x7f10fc03b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:32.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:32.127+0000 7f1115229640 1 --2- 172.21.15.148:0/2124255226 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f10fc039500 0x7f10fc03b9c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1110101b70 tx=0x7f110c00a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:32.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:32.131+0000 7f11067fc640 1 -- 172.21.15.148:0/2124255226 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f110004cd90 con 0x7f1110101d10 2024-09-19T07:03:32.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:32.307+0000 7f111748d640 1 -- 172.21.15.148:0/2124255226 --> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f1110062630 con 0x7f10fc039500 2024-09-19T07:03:32.324 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:32 smithi179 ceph-mon[35716]: Deploying daemon mgr.z on smithi179 2024-09-19T07:03:32.324 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:32 smithi179 ceph-mon[35716]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:32.324 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:03:32 smithi179 podman[37499]: 2024-09-19 07:03:32.063375923 +0000 UTC m=+0.099192250 container create 217ea58788b84adc27a0a6a82eff251118e348438c94915648854e2ce328aa6c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_BRANCH=HEAD) 2024-09-19T07:03:32.324 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:03:32 smithi179 podman[37499]: 2024-09-19 07:03:31.980097932 +0000 UTC m=+0.015914272 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:03:32.324 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:03:32 smithi179 podman[37499]: 2024-09-19 07:03:32.249148381 +0000 UTC m=+0.284964712 container init 217ea58788b84adc27a0a6a82eff251118e348438c94915648854e2ce328aa6c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-19T07:03:32.324 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:03:32 smithi179 podman[37499]: 2024-09-19 07:03:32.251865592 +0000 UTC m=+0.287681930 container start 217ea58788b84adc27a0a6a82eff251118e348438c94915648854e2ce328aa6c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-19T07:03:32.324 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:03:32 smithi179 ceph-mgr[37517]: -- 172.21.15.179:0/3252357779 <== mon.1 v2:172.21.15.179:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b4ad0bb0e0 con 0x55b4ad099400 2024-09-19T07:03:32.325 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:03:32 smithi179 bash[37499]: 217ea58788b84adc27a0a6a82eff251118e348438c94915648854e2ce328aa6c 2024-09-19T07:03:32.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:32 smithi165 ceph-mon[35326]: Deploying daemon mgr.z on smithi179 2024-09-19T07:03:32.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:32 smithi165 ceph-mon[35326]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:32.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:32 smithi148 ceph-mon[31180]: Deploying daemon mgr.z on smithi179 2024-09-19T07:03:32.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:32 smithi148 ceph-mon[31180]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:32.597 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:03:32 smithi179 systemd[1]: Started Ceph mgr.z for eae8a4a8-7654-11ef-bceb-c7b262605968. 2024-09-19T07:03:32.597 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:03:32 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: 2024-09-19T07:03:32.388+0000 7f23bb48f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T07:03:32.597 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:03:32 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: 2024-09-19T07:03:32.450+0000 7f23bb48f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T07:03:32.597 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:03:32 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: 2024-09-19T07:03:32.596+0000 7f23bb48f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T07:03:32.949 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:03:32 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: 2024-09-19T07:03:32.662+0000 7f23bb48f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T07:03:32.949 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:03:32 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: 2024-09-19T07:03:32.809+0000 7f23bb48f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:03:32.949 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:03:32 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: 2024-09-19T07:03:32.947+0000 7f23bb48f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T07:03:33.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:33 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:03:33.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:33 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:03:33.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:33 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:33.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:33 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:33.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:33 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:33.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:33 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:33.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:33 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T07:03:33.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:33 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T07:03:33.135 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:33 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T07:03:33.135 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:33 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:33.263 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:33 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:03:33.263 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:33 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:03:33.263 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:33 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:33.263 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:33 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:33.263 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:33 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:33.263 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:33 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:33.263 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:33 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T07:03:33.263 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:33 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T07:03:33.263 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:33 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T07:03:33.263 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:33 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:33.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:33 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:03:33.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:33 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:03:33.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:33 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:33.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:33 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:33.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:33 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:33.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:33 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:33.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:33 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T07:03:33.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:33 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T07:03:33.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:33 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T07:03:33.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:33 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:33.522 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:03:33 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: 2024-09-19T07:03:33.261+0000 7f23bb48f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T07:03:33.522 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:03:33 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: 2024-09-19T07:03:33.322+0000 7f23bb48f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T07:03:33.523 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:03:33 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: 2024-09-19T07:03:33.504+0000 7f23bb48f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T07:03:34.377 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:34 smithi179 ceph-mon[35716]: from='client.14214 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:03:34.377 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:34 smithi179 ceph-mon[35716]: Deploying daemon mgr.y on smithi165 2024-09-19T07:03:34.377 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:34 smithi179 ceph-mon[35716]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:34.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:34 smithi165 ceph-mon[35326]: from='client.14214 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:03:34.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:34 smithi165 ceph-mon[35326]: Deploying daemon mgr.y on smithi165 2024-09-19T07:03:34.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:34 smithi165 ceph-mon[35326]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:34.384 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:03:34 smithi165 systemd[1]: Starting Ceph mgr.y for eae8a4a8-7654-11ef-bceb-c7b262605968... 2024-09-19T07:03:34.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:34 smithi148 ceph-mon[31180]: from='client.14214 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:03:34.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:34 smithi148 ceph-mon[31180]: Deploying daemon mgr.y on smithi165 2024-09-19T07:03:34.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:34 smithi148 ceph-mon[31180]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:34.698 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:03:34 smithi165 podman[36677]: 2024-09-19 07:03:34.339136033 +0000 UTC m=+0.016457812 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:03:34.698 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:03:34 smithi165 podman[36677]: 2024-09-19 07:03:34.440252211 +0000 UTC m=+0.117573975 container create 5462059cc1dfc71f36300b0fd2738badf4fe9fcddaa71e16d03c6af903de87bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-19T07:03:34.773 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:03:34 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: 2024-09-19T07:03:34.376+0000 7f23bb48f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T07:03:34.773 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:03:34 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: 2024-09-19T07:03:34.443+0000 7f23bb48f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T07:03:35.095 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:03:34 smithi165 podman[36677]: 2024-09-19 07:03:34.800759826 +0000 UTC m=+0.478081591 container init 5462059cc1dfc71f36300b0fd2738badf4fe9fcddaa71e16d03c6af903de87bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-19T07:03:35.095 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:03:34 smithi165 podman[36677]: 2024-09-19 07:03:34.803493931 +0000 UTC m=+0.480815698 container start 5462059cc1dfc71f36300b0fd2738badf4fe9fcddaa71e16d03c6af903de87bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-19T07:03:35.095 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:03:34 smithi165 ceph-mgr[36696]: -- 172.21.15.165:0/3924359631 <== mon.2 v2:172.21.15.165:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558716b2f0e0 con 0x558716b0d000 2024-09-19T07:03:35.095 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:03:34 smithi165 bash[36677]: 5462059cc1dfc71f36300b0fd2738badf4fe9fcddaa71e16d03c6af903de87bb 2024-09-19T07:03:35.095 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:03:34 smithi165 systemd[1]: Started Ceph mgr.y for eae8a4a8-7654-11ef-bceb-c7b262605968. 2024-09-19T07:03:35.095 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:03:34 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: 2024-09-19T07:03:34.938+0000 7f09043f8040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T07:03:35.096 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:03:35 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: 2024-09-19T07:03:35.004+0000 7f09043f8040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T07:03:35.384 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:03:35 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: 2024-09-19T07:03:35.163+0000 7f09043f8040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T07:03:35.384 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:03:35 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: 2024-09-19T07:03:35.231+0000 7f09043f8040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T07:03:35.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:35 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/2836082106' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7b854fad-d5a3-43e3-862e-7a0e8f243c56"}]: dispatch 2024-09-19T07:03:35.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:35 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/2836082106' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7b854fad-d5a3-43e3-862e-7a0e8f243c56"}]': finished 2024-09-19T07:03:35.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:35 smithi165 ceph-mon[35326]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T07:03:35.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:35 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:03:35.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:35 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:35.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:35 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:35.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:35 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:35.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:35 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:35.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:35 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:03:35.446 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:03:35 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: 2024-09-19T07:03:35.164+0000 7f23bb48f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T07:03:35.446 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:03:35 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: 2024-09-19T07:03:35.285+0000 7f23bb48f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T07:03:35.446 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:03:35 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: 2024-09-19T07:03:35.444+0000 7f23bb48f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:03:35.446 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:35 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/2836082106' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7b854fad-d5a3-43e3-862e-7a0e8f243c56"}]: dispatch 2024-09-19T07:03:35.446 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:35 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/2836082106' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7b854fad-d5a3-43e3-862e-7a0e8f243c56"}]': finished 2024-09-19T07:03:35.446 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:35 smithi179 ceph-mon[35716]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T07:03:35.446 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:35 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:03:35.446 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:35 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:35.447 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:35 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:35.447 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:35 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:35.447 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:35 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:35.447 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:35 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:03:35.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:35 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/2836082106' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7b854fad-d5a3-43e3-862e-7a0e8f243c56"}]: dispatch 2024-09-19T07:03:35.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:35 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/2836082106' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7b854fad-d5a3-43e3-862e-7a0e8f243c56"}]': finished 2024-09-19T07:03:35.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:35 smithi148 ceph-mon[31180]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T07:03:35.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:35 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:03:35.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:35 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:35.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:35 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:35.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:35 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:35.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:35 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:35.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:35 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:03:35.674 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:03:35 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: 2024-09-19T07:03:35.405+0000 7f09043f8040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:03:35.674 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:03:35 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: 2024-09-19T07:03:35.553+0000 7f09043f8040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T07:03:35.729 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:03:35 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: 2024-09-19T07:03:35.507+0000 7f23bb48f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T07:03:35.730 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:03:35 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: 2024-09-19T07:03:35.657+0000 7f23bb48f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T07:03:35.730 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:03:35 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: 2024-09-19T07:03:35.728+0000 7f23bb48f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T07:03:35.949 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:03:35 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: 2024-09-19T07:03:35.886+0000 7f09043f8040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T07:03:36.019 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:03:35 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: 2024-09-19T07:03:35.791+0000 7f23bb48f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T07:03:36.377 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:03:35 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: 2024-09-19T07:03:35.953+0000 7f23bb48f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T07:03:36.377 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:03:36 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: 2024-09-19T07:03:36.018+0000 7f23bb48f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T07:03:36.378 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:36 smithi179 ceph-mon[35716]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:36.378 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:36 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/345395310' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:03:36.378 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:03:36 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: 2024-09-19T07:03:36.085+0000 7f23bb48f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T07:03:36.378 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:03:36 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: 2024-09-19T07:03:36.175+0000 7f23bb48f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T07:03:36.379 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:03:36 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: 2024-09-19T07:03:36.236+0000 7f23bb48f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T07:03:36.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:36 smithi165 ceph-mon[35326]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:36.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:36 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/345395310' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:03:36.385 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:03:35 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: 2024-09-19T07:03:35.948+0000 7f09043f8040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T07:03:36.385 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:03:36 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: 2024-09-19T07:03:36.145+0000 7f09043f8040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T07:03:36.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:36 smithi148 ceph-mon[31180]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:36.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:36 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/345395310' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:03:36.772 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:03:36 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: 2024-09-19T07:03:36.298+0000 7f23bb48f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T07:03:37.384 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:03:37 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: 2024-09-19T07:03:37.034+0000 7f09043f8040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T07:03:37.384 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:03:37 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: 2024-09-19T07:03:37.101+0000 7f09043f8040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T07:03:37.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:37 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:37.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:37 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:37.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:37 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:37.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:37 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:37.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:37 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:37.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:37 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:03:37.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:37 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:37.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:37 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:03:37.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:37 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:37.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:37 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:03:37.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:37 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:37.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:37 smithi165 ceph-mon[35326]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:37.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:37 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:37.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:37 smithi165 ceph-mon[35326]: Standby manager daemon z started 2024-09-19T07:03:37.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:37 smithi165 ceph-mon[35326]: from='mgr.? 172.21.15.179:0/441480592' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T07:03:37.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:37 smithi165 ceph-mon[35326]: from='mgr.? 172.21.15.179:0/441480592' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T07:03:37.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:37 smithi165 ceph-mon[35326]: from='mgr.? 172.21.15.179:0/441480592' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T07:03:37.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:37 smithi165 ceph-mon[35326]: from='mgr.? 172.21.15.179:0/441480592' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T07:03:37.523 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:03:37 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: 2024-09-19T07:03:37.088+0000 7f23bb48f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T07:03:37.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:37 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:37.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:37 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:37.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:37 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:37.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:37 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:37.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:37 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:37.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:37 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:03:37.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:37 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:37.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:37 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:03:37.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:37 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:37.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:37 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:03:37.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:37 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:37.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:37 smithi179 ceph-mon[35716]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:37.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:37 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:37.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:37 smithi179 ceph-mon[35716]: Standby manager daemon z started 2024-09-19T07:03:37.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:37 smithi179 ceph-mon[35716]: from='mgr.? 172.21.15.179:0/441480592' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T07:03:37.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:37 smithi179 ceph-mon[35716]: from='mgr.? 172.21.15.179:0/441480592' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T07:03:37.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:37 smithi179 ceph-mon[35716]: from='mgr.? 172.21.15.179:0/441480592' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T07:03:37.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:37 smithi179 ceph-mon[35716]: from='mgr.? 172.21.15.179:0/441480592' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T07:03:37.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:37 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:37.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:37 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:37.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:37 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:37.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:37 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:37.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:37 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:37.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:37 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:03:37.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:37 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:37.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:37 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:03:37.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:37 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:37.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:37 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:03:37.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:37 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:37.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:37 smithi148 ceph-mon[31180]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:37.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:37 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:37.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:37 smithi148 ceph-mon[31180]: Standby manager daemon z started 2024-09-19T07:03:37.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:37 smithi148 ceph-mon[31180]: from='mgr.? 172.21.15.179:0/441480592' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T07:03:37.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:37 smithi148 ceph-mon[31180]: from='mgr.? 172.21.15.179:0/441480592' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T07:03:37.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:37 smithi148 ceph-mon[31180]: from='mgr.? 172.21.15.179:0/441480592' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T07:03:37.585 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:37 smithi148 ceph-mon[31180]: from='mgr.? 172.21.15.179:0/441480592' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T07:03:38.054 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:38.053+0000 7f11067fc640 1 -- 172.21.15.148:0/2124255226 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 14) ==== 92409+0+0 (secure 0 0 0) 0x7f1100003c80 con 0x7f1110101d10 2024-09-19T07:03:38.074 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:03:37 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: 2024-09-19T07:03:37.817+0000 7f09043f8040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T07:03:38.074 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:03:37 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: 2024-09-19T07:03:37.932+0000 7f09043f8040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T07:03:38.349 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:03:38 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: 2024-09-19T07:03:38.073+0000 7f09043f8040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:03:38.349 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:03:38 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: 2024-09-19T07:03:38.134+0000 7f09043f8040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T07:03:38.350 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:03:38 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: 2024-09-19T07:03:38.281+0000 7f09043f8040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T07:03:38.350 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:03:38 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: 2024-09-19T07:03:38.348+0000 7f09043f8040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T07:03:38.631 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:03:38 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: 2024-09-19T07:03:38.408+0000 7f09043f8040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T07:03:38.631 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:03:38 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: 2024-09-19T07:03:38.565+0000 7f09043f8040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T07:03:38.631 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:03:38 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: 2024-09-19T07:03:38.630+0000 7f09043f8040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T07:03:38.884 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:03:38 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: 2024-09-19T07:03:38.696+0000 7f09043f8040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T07:03:38.884 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:03:38 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: 2024-09-19T07:03:38.777+0000 7f09043f8040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T07:03:38.884 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:03:38 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: 2024-09-19T07:03:38.835+0000 7f09043f8040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T07:03:39.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:39 smithi148 ceph-mon[31180]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-19T07:03:39.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:39 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T07:03:39.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:39 smithi165 ceph-mon[35326]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-19T07:03:39.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:39 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T07:03:39.384 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:03:38 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: 2024-09-19T07:03:38.894+0000 7f09043f8040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T07:03:39.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:39 smithi179 ceph-mon[35716]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-19T07:03:39.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:39 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T07:03:40.057 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:03:39 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: 2024-09-19T07:03:39.680+0000 7f09043f8040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T07:03:40.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:40.065+0000 7f11067fc640 1 -- 172.21.15.148:0/2124255226 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mgrmap(e 15) ==== 138300+0+0 (secure 0 0 0) 0x7f110003bc70 con 0x7f1110101d10 2024-09-19T07:03:40.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:40 smithi148 ceph-mon[31180]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:40.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:40 smithi148 ceph-mon[31180]: Standby manager daemon y started 2024-09-19T07:03:40.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:40 smithi148 ceph-mon[31180]: from='mgr.? 172.21.15.165:0/1841047981' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T07:03:40.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:40 smithi148 ceph-mon[31180]: from='mgr.? 172.21.15.165:0/1841047981' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T07:03:40.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:40 smithi148 ceph-mon[31180]: from='mgr.? 172.21.15.165:0/1841047981' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T07:03:40.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:40 smithi148 ceph-mon[31180]: from='mgr.? 172.21.15.165:0/1841047981' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T07:03:40.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:40 smithi165 ceph-mon[35326]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:40.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:40 smithi165 ceph-mon[35326]: Standby manager daemon y started 2024-09-19T07:03:40.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:40 smithi165 ceph-mon[35326]: from='mgr.? 172.21.15.165:0/1841047981' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T07:03:40.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:40 smithi165 ceph-mon[35326]: from='mgr.? 172.21.15.165:0/1841047981' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T07:03:40.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:40 smithi165 ceph-mon[35326]: from='mgr.? 172.21.15.165:0/1841047981' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T07:03:40.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:40 smithi165 ceph-mon[35326]: from='mgr.? 172.21.15.165:0/1841047981' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T07:03:40.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:40 smithi179 ceph-mon[35716]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:40.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:40 smithi179 ceph-mon[35716]: Standby manager daemon y started 2024-09-19T07:03:40.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:40 smithi179 ceph-mon[35716]: from='mgr.? 172.21.15.165:0/1841047981' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T07:03:40.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:40 smithi179 ceph-mon[35716]: from='mgr.? 172.21.15.165:0/1841047981' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T07:03:40.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:40 smithi179 ceph-mon[35716]: from='mgr.? 172.21.15.165:0/1841047981' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T07:03:40.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:40 smithi179 ceph-mon[35716]: from='mgr.? 172.21.15.165:0/1841047981' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T07:03:41.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:41 smithi148 ceph-mon[31180]: mgrmap e15: x(active, since 63s), standbys: y, z 2024-09-19T07:03:41.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:41 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T07:03:41.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:41 smithi165 ceph-mon[35326]: mgrmap e15: x(active, since 63s), standbys: y, z 2024-09-19T07:03:41.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:41 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T07:03:41.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:41 smithi179 ceph-mon[35716]: mgrmap e15: x(active, since 63s), standbys: y, z 2024-09-19T07:03:41.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:41 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T07:03:42.182 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:42 smithi148 ceph-mon[31180]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:42.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:42 smithi165 ceph-mon[35326]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:42.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:42 smithi179 ceph-mon[35716]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:44.331 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:44 smithi148 ceph-mon[31180]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:44.331 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:44 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T07:03:44.331 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:44 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:44.331 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:44 smithi148 ceph-mon[31180]: Deploying daemon osd.0 on smithi148 2024-09-19T07:03:44.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:44 smithi165 ceph-mon[35326]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:44.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:44 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T07:03:44.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:44 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:44.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:44 smithi165 ceph-mon[35326]: Deploying daemon osd.0 on smithi148 2024-09-19T07:03:44.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:44 smithi179 ceph-mon[35716]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:44.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:44 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T07:03:44.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:44 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:44.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:44 smithi179 ceph-mon[35716]: Deploying daemon osd.0 on smithi148 2024-09-19T07:03:46.324 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:46 smithi179 ceph-mon[35716]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:46.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:46 smithi148 ceph-mon[31180]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:46.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:46 smithi165 ceph-mon[35326]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:48.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:48 smithi148 ceph-mon[31180]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:48.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:48 smithi165 ceph-mon[35326]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:48.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:48 smithi179 ceph-mon[35716]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:50.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:50 smithi148 ceph-mon[31180]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:50.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:50 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:03:50.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:50 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:50.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:50 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:50.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:50 smithi165 ceph-mon[35326]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:50.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:50 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:03:50.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:50 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:50.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:50 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:50.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:50 smithi179 ceph-mon[35716]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:50.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:50 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:03:50.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:50 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:50.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:50 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:52.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:52 smithi148 ceph-mon[31180]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:52.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:52 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:52.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:52 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:52.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:52 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:52.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:52 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:03:52.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:52 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:52.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:52 smithi165 ceph-mon[35326]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:52.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:52 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:52.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:52 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:52.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:52 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:52.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:52 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:03:52.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:52 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:52.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:52 smithi179 ceph-mon[35716]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:52.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:52 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:52.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:52 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:52.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:52 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:52.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:52 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:03:52.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:52 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:53.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:53.383+0000 7f11067fc640 1 -- 172.21.15.148:0/2124255226 <== mgr.14148 v2:172.21.15.148:6800/3007822654 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1110062630 con 0x7f10fc039500 2024-09-19T07:03:53.385 INFO:teuthology.orchestra.run.smithi148.stdout:Created osd(s) 0 on host 'smithi148' 2024-09-19T07:03:53.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:53.386+0000 7f111748d640 1 -- 172.21.15.148:0/2124255226 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f10fc039500 msgr2=0x7f10fc03b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:53.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:53.386+0000 7f111748d640 1 --2- 172.21.15.148:0/2124255226 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f10fc039500 0x7f10fc03b9c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1110101b70 tx=0x7f110c00a2d0 comp rx=0 tx=0).stop 2024-09-19T07:03:53.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:53.386+0000 7f111748d640 1 -- 172.21.15.148:0/2124255226 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1110101d10 msgr2=0x7f1110198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:53.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:53.386+0000 7f111748d640 1 --2- 172.21.15.148:0/2124255226 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1110101d10 0x7f1110198460 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1100009230 tx=0x7f1100031b60 comp rx=0 tx=0).stop 2024-09-19T07:03:53.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:53.387+0000 7f111748d640 1 -- 172.21.15.148:0/2124255226 shutdown_connections 2024-09-19T07:03:53.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:53.387+0000 7f111748d640 1 --2- 172.21.15.148:0/2124255226 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f10fc039500 0x7f10fc03b9c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:53.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:53.387+0000 7f111748d640 1 --2- 172.21.15.148:0/2124255226 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f11101026d0 0x7f111019f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:53.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:53.387+0000 7f111748d640 1 --2- 172.21.15.148:0/2124255226 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1110101d10 0x7f1110198460 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:53.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:53.387+0000 7f111748d640 1 --2- 172.21.15.148:0/2124255226 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1110100b10 0x7f1110197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:53.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:53.387+0000 7f111748d640 1 -- 172.21.15.148:0/2124255226 >> 172.21.15.148:0/2124255226 conn(0x7f11100fc2a0 msgr2=0x7f1110105130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:53.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:53.387+0000 7f111748d640 1 -- 172.21.15.148:0/2124255226 shutdown_connections 2024-09-19T07:03:53.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:03:53.387+0000 7f111748d640 1 -- 172.21.15.148:0/2124255226 wait complete. 2024-09-19T07:03:53.960 DEBUG:teuthology.orchestra.run.smithi148:osd.0> sudo journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@osd.0.service 2024-09-19T07:03:53.963 INFO:tasks.cephadm:Deploying osd.1 on smithi165 with /dev/vg_nvme/lv_4... 2024-09-19T07:03:53.963 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T07:03:54.218 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T07:03:54.243 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:54 smithi148 ceph-mon[31180]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:54.243 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:54 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:03:54.243 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:54 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:54.243 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:54 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:54.338 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:54 smithi165 ceph-mon[35326]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:54.338 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:54 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:03:54.338 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:54 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:54.339 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:54 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:54.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:54 smithi179 ceph-mon[35716]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:54.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:54 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:03:54.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:54 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:54.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:54 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:55.575 INFO:journalctl@ceph.osd.0.smithi148.stdout:Sep 19 07:03:55 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-0[42190]: 2024-09-19T07:03:55.319+0000 7f32e2920640 -1 osd.0 0 log_to_monitors true 2024-09-19T07:03:56.347 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:56 smithi165 ceph-mon[35326]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:56.348 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:56 smithi165 ceph-mon[35326]: from='osd.0 [v2:172.21.15.148:6802/512186330,v1:172.21.15.148:6803/512186330]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T07:03:56.404 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:56 smithi148 ceph-mon[31180]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:56.405 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:56 smithi148 ceph-mon[31180]: from='osd.0 [v2:172.21.15.148:6802/512186330,v1:172.21.15.148:6803/512186330]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T07:03:56.500 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-19T07:03:56.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:56 smithi179 ceph-mon[35716]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:56.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:56 smithi179 ceph-mon[35716]: from='osd.0 [v2:172.21.15.148:6802/512186330,v1:172.21.15.148:6803/512186330]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T07:03:56.526 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi165:vg_nvme/lv_4 2024-09-19T07:03:56.767 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T07:03:57.184 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:57 smithi165 ceph-mon[35326]: from='osd.0 [v2:172.21.15.148:6802/512186330,v1:172.21.15.148:6803/512186330]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T07:03:57.184 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:57 smithi165 ceph-mon[35326]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T07:03:57.184 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:57 smithi165 ceph-mon[35326]: from='osd.0 [v2:172.21.15.148:6802/512186330,v1:172.21.15.148:6803/512186330]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]: dispatch 2024-09-19T07:03:57.185 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:57 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:03:57.185 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:57 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:57.185 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:57 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:57.185 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:57 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:03:57.185 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:57 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:57.185 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:57 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:57.185 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:57 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:03:57.185 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:57 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:57.185 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:57 smithi165 ceph-mon[35326]: from='osd.0 [v2:172.21.15.148:6802/512186330,v1:172.21.15.148:6803/512186330]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-19T07:03:57.185 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:57 smithi165 ceph-mon[35326]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T07:03:57.185 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:57 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:03:57.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:03:57.267+0000 7f5e62d28640 1 -- 172.21.15.165:0/237580445 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5e5c101c00 msgr2=0x7f5e5c102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:57.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:03:57.267+0000 7f5e62d28640 1 --2- 172.21.15.165:0/237580445 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5e5c101c00 0x7f5e5c102000 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5e50009900 tx=0x7f5e5002a410 comp rx=0 tx=0).stop 2024-09-19T07:03:57.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:03:57.267+0000 7f5e62d28640 1 -- 172.21.15.165:0/237580445 shutdown_connections 2024-09-19T07:03:57.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:03:57.267+0000 7f5e62d28640 1 --2- 172.21.15.165:0/237580445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e5c1037c0 0x7f5e5c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:57.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:03:57.267+0000 7f5e62d28640 1 --2- 172.21.15.165:0/237580445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e5c102e00 0x7f5e5c103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:57.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:03:57.267+0000 7f5e62d28640 1 --2- 172.21.15.165:0/237580445 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5e5c101c00 0x7f5e5c102000 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:57.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:03:57.267+0000 7f5e62d28640 1 -- 172.21.15.165:0/237580445 >> 172.21.15.165:0/237580445 conn(0x7f5e5c0fd390 msgr2=0x7f5e5c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:57.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:03:57.267+0000 7f5e62d28640 1 -- 172.21.15.165:0/237580445 shutdown_connections 2024-09-19T07:03:57.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:03:57.267+0000 7f5e62d28640 1 -- 172.21.15.165:0/237580445 wait complete. 2024-09-19T07:03:57.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:03:57.268+0000 7f5e62d28640 1 Processor -- start 2024-09-19T07:03:57.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:03:57.268+0000 7f5e62d28640 1 -- start start 2024-09-19T07:03:57.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:03:57.268+0000 7f5e62d28640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5e5c101c00 0x7f5e5c197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:57.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:03:57.268+0000 7f5e62d28640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e5c102e00 0x7f5e5c198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:57.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:03:57.268+0000 7f5e62d28640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e5c1037c0 0x7f5e5c19f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:57.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:03:57.268+0000 7f5e62d28640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5e5c10d860 con 0x7f5e5c102e00 2024-09-19T07:03:57.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:03:57.268+0000 7f5e62d28640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5e5c10d6e0 con 0x7f5e5c101c00 2024-09-19T07:03:57.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:03:57.268+0000 7f5e62d28640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5e5c10d9e0 con 0x7f5e5c1037c0 2024-09-19T07:03:57.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:03:57.268+0000 7f5e60ac4640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5e5c101c00 0x7f5e5c197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:57.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:03:57.268+0000 7f5e60ac4640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5e5c101c00 0x7f5e5c197f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.165:35296/0 (socket says 172.21.15.165:35296) 2024-09-19T07:03:57.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:03:57.268+0000 7f5e60ac4640 1 -- 172.21.15.165:0/4012777604 learned_addr learned my addr 172.21.15.165:0/4012777604 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-19T07:03:57.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:03:57.268+0000 7f5e5bfff640 1 --2- 172.21.15.165:0/4012777604 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e5c102e00 0x7f5e5c198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:57.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:03:57.268+0000 7f5e612c5640 1 --2- 172.21.15.165:0/4012777604 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e5c1037c0 0x7f5e5c19f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:57.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:03:57.269+0000 7f5e60ac4640 1 -- 172.21.15.165:0/4012777604 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e5c1037c0 msgr2=0x7f5e5c19f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:57.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:03:57.269+0000 7f5e60ac4640 1 --2- 172.21.15.165:0/4012777604 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e5c1037c0 0x7f5e5c19f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:57.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:03:57.269+0000 7f5e60ac4640 1 -- 172.21.15.165:0/4012777604 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e5c102e00 msgr2=0x7f5e5c198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:57.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:03:57.269+0000 7f5e60ac4640 1 --2- 172.21.15.165:0/4012777604 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e5c102e00 0x7f5e5c198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:57.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:03:57.269+0000 7f5e60ac4640 1 -- 172.21.15.165:0/4012777604 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e5c19fb30 con 0x7f5e5c101c00 2024-09-19T07:03:57.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:03:57.269+0000 7f5e60ac4640 1 --2- 172.21.15.165:0/4012777604 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5e5c101c00 0x7f5e5c197f00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5e50031610 tx=0x7f5e500043b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:57.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:03:57.269+0000 7f5e59ffb640 1 -- 172.21.15.165:0/4012777604 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e5003f030 con 0x7f5e5c101c00 2024-09-19T07:03:57.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:03:57.269+0000 7f5e59ffb640 1 -- 172.21.15.165:0/4012777604 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e50003ce0 con 0x7f5e5c101c00 2024-09-19T07:03:57.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:03:57.269+0000 7f5e62d28640 1 -- 172.21.15.165:0/4012777604 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e5c19fdc0 con 0x7f5e5c101c00 2024-09-19T07:03:57.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:03:57.269+0000 7f5e59ffb640 1 -- 172.21.15.165:0/4012777604 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e50035070 con 0x7f5e5c101c00 2024-09-19T07:03:57.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:03:57.269+0000 7f5e62d28640 1 -- 172.21.15.165:0/4012777604 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e5c1a0210 con 0x7f5e5c101c00 2024-09-19T07:03:57.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:03:57.270+0000 7f5e62d28640 1 -- 172.21.15.165:0/4012777604 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e5c109000 con 0x7f5e5c101c00 2024-09-19T07:03:57.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:03:57.271+0000 7f5e59ffb640 1 -- 172.21.15.165:0/4012777604 <== mon.2 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 15) ==== 138300+0+0 (secure 0 0 0) 0x7f5e50042030 con 0x7f5e5c101c00 2024-09-19T07:03:57.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:03:57.272+0000 7f5e59ffb640 1 --2- 172.21.15.165:0/4012777604 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f5e4c0a3260 0x7f5e4c0a5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:57.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:03:57.272+0000 7f5e59ffb640 1 -- 172.21.15.165:0/4012777604 <== mon.2 v2:172.21.15.165:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7f5e500ee230 con 0x7f5e5c101c00 2024-09-19T07:03:57.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:03:57.272+0000 7f5e5bfff640 1 --2- 172.21.15.165:0/4012777604 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f5e4c0a3260 0x7f5e4c0a5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:57.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:03:57.272+0000 7f5e5bfff640 1 --2- 172.21.15.165:0/4012777604 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f5e4c0a3260 0x7f5e4c0a5720 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c199420 tx=0x7f5e4800a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:57.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:03:57.276+0000 7f5e59ffb640 1 -- 172.21.15.165:0/4012777604 <== mon.2 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5e500bcae0 con 0x7f5e5c101c00 2024-09-19T07:03:57.429 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:57 smithi148 ceph-mon[31180]: from='osd.0 [v2:172.21.15.148:6802/512186330,v1:172.21.15.148:6803/512186330]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T07:03:57.429 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:57 smithi148 ceph-mon[31180]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T07:03:57.429 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:57 smithi148 ceph-mon[31180]: from='osd.0 [v2:172.21.15.148:6802/512186330,v1:172.21.15.148:6803/512186330]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]: dispatch 2024-09-19T07:03:57.429 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:57 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:03:57.429 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:57 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:57.429 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:57 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:57.429 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:57 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:03:57.430 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:57 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:57.430 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:57 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:57.430 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:57 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:03:57.430 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:57 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:57.430 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:57 smithi148 ceph-mon[31180]: from='osd.0 [v2:172.21.15.148:6802/512186330,v1:172.21.15.148:6803/512186330]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-19T07:03:57.430 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:57 smithi148 ceph-mon[31180]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T07:03:57.430 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:57 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:03:57.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:03:57.454+0000 7f5e62d28640 1 -- 172.21.15.165:0/4012777604 --> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi165:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f5e5c062630 con 0x7f5e4c0a3260 2024-09-19T07:03:57.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:57 smithi179 ceph-mon[35716]: from='osd.0 [v2:172.21.15.148:6802/512186330,v1:172.21.15.148:6803/512186330]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T07:03:57.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:57 smithi179 ceph-mon[35716]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T07:03:57.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:57 smithi179 ceph-mon[35716]: from='osd.0 [v2:172.21.15.148:6802/512186330,v1:172.21.15.148:6803/512186330]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]: dispatch 2024-09-19T07:03:57.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:57 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:03:57.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:57 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:57.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:57 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:57.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:57 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:03:57.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:57 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:57.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:57 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:57.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:57 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:03:57.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:57 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:03:57.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:57 smithi179 ceph-mon[35716]: from='osd.0 [v2:172.21.15.148:6802/512186330,v1:172.21.15.148:6803/512186330]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-19T07:03:57.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:57 smithi179 ceph-mon[35716]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T07:03:57.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:57 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:03:58.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:58 smithi165 ceph-mon[35326]: Detected new or changed devices on smithi148 2024-09-19T07:03:58.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:58 smithi165 ceph-mon[35326]: Adjusting osd_memory_target on smithi148 to 17088M 2024-09-19T07:03:58.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:58 smithi165 ceph-mon[35326]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:58.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:58 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:03:58.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:58 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:03:58.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:58 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:03:58.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:58 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:58.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:58 smithi165 ceph-mon[35326]: from='osd.0 [v2:172.21.15.148:6802/512186330,v1:172.21.15.148:6803/512186330]' entity='osd.0' 2024-09-19T07:03:58.135 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:58 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:03:58.333 INFO:journalctl@ceph.osd.0.smithi148.stdout:Sep 19 07:03:57 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-0[42190]: 2024-09-19T07:03:57.860+0000 7f32de080640 -1 osd.0 0 waiting for initial osdmap 2024-09-19T07:03:58.333 INFO:journalctl@ceph.osd.0.smithi148.stdout:Sep 19 07:03:57 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-0[42190]: 2024-09-19T07:03:57.865+0000 7f32d66b2640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T07:03:58.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:58 smithi148 ceph-mon[31180]: Detected new or changed devices on smithi148 2024-09-19T07:03:58.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:58 smithi148 ceph-mon[31180]: Adjusting osd_memory_target on smithi148 to 17088M 2024-09-19T07:03:58.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:58 smithi148 ceph-mon[31180]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:58.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:58 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:03:58.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:58 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:03:58.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:58 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:03:58.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:58 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:58.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:58 smithi148 ceph-mon[31180]: from='osd.0 [v2:172.21.15.148:6802/512186330,v1:172.21.15.148:6803/512186330]' entity='osd.0' 2024-09-19T07:03:58.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:58 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:03:58.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:58 smithi179 ceph-mon[35716]: Detected new or changed devices on smithi148 2024-09-19T07:03:58.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:58 smithi179 ceph-mon[35716]: Adjusting osd_memory_target on smithi148 to 17088M 2024-09-19T07:03:58.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:58 smithi179 ceph-mon[35716]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:58.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:58 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:03:58.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:58 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:03:58.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:58 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:03:58.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:58 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:58.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:58 smithi179 ceph-mon[35716]: from='osd.0 [v2:172.21.15.148:6802/512186330,v1:172.21.15.148:6803/512186330]' entity='osd.0' 2024-09-19T07:03:58.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:58 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:03:59.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:59 smithi165 ceph-mon[35326]: purged_snaps scrub starts 2024-09-19T07:03:59.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:59 smithi165 ceph-mon[35326]: purged_snaps scrub ok 2024-09-19T07:03:59.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:59 smithi165 ceph-mon[35326]: from='client.24131 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi165:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:03:59.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:59 smithi165 ceph-mon[35326]: osd.0 [v2:172.21.15.148:6802/512186330,v1:172.21.15.148:6803/512186330] boot 2024-09-19T07:03:59.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:59 smithi165 ceph-mon[35326]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T07:03:59.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:59 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:03:59.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:03:59 smithi165 ceph-mon[35326]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:59.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:59 smithi179 ceph-mon[35716]: purged_snaps scrub starts 2024-09-19T07:03:59.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:59 smithi179 ceph-mon[35716]: purged_snaps scrub ok 2024-09-19T07:03:59.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:59 smithi179 ceph-mon[35716]: from='client.24131 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi165:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:03:59.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:59 smithi179 ceph-mon[35716]: osd.0 [v2:172.21.15.148:6802/512186330,v1:172.21.15.148:6803/512186330] boot 2024-09-19T07:03:59.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:59 smithi179 ceph-mon[35716]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T07:03:59.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:59 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:03:59.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:03:59 smithi179 ceph-mon[35716]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:03:59.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:59 smithi148 ceph-mon[31180]: purged_snaps scrub starts 2024-09-19T07:03:59.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:59 smithi148 ceph-mon[31180]: purged_snaps scrub ok 2024-09-19T07:03:59.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:59 smithi148 ceph-mon[31180]: from='client.24131 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi165:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:03:59.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:59 smithi148 ceph-mon[31180]: osd.0 [v2:172.21.15.148:6802/512186330,v1:172.21.15.148:6803/512186330] boot 2024-09-19T07:03:59.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:59 smithi148 ceph-mon[31180]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T07:03:59.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:59 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:03:59.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:03:59 smithi148 ceph-mon[31180]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:04:00.246 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:00 smithi165 ceph-mon[35326]: from='client.? 172.21.15.165:0/2196811483' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "61b26278-f4db-40f0-97b9-c12a6ef1cd06"}]: dispatch 2024-09-19T07:04:00.246 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:00 smithi165 ceph-mon[35326]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "61b26278-f4db-40f0-97b9-c12a6ef1cd06"}]: dispatch 2024-09-19T07:04:00.246 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:00 smithi165 ceph-mon[35326]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "61b26278-f4db-40f0-97b9-c12a6ef1cd06"}]': finished 2024-09-19T07:04:00.246 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:00 smithi165 ceph-mon[35326]: osdmap e9: 2 total, 1 up, 2 in 2024-09-19T07:04:00.246 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:00 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:04:00.485 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:00 smithi148 ceph-mon[31180]: from='client.? 172.21.15.165:0/2196811483' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "61b26278-f4db-40f0-97b9-c12a6ef1cd06"}]: dispatch 2024-09-19T07:04:00.485 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:00 smithi148 ceph-mon[31180]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "61b26278-f4db-40f0-97b9-c12a6ef1cd06"}]: dispatch 2024-09-19T07:04:00.485 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:00 smithi148 ceph-mon[31180]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "61b26278-f4db-40f0-97b9-c12a6ef1cd06"}]': finished 2024-09-19T07:04:00.485 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:00 smithi148 ceph-mon[31180]: osdmap e9: 2 total, 1 up, 2 in 2024-09-19T07:04:00.485 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:00 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:04:00.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:00 smithi179 ceph-mon[35716]: from='client.? 172.21.15.165:0/2196811483' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "61b26278-f4db-40f0-97b9-c12a6ef1cd06"}]: dispatch 2024-09-19T07:04:00.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:00 smithi179 ceph-mon[35716]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "61b26278-f4db-40f0-97b9-c12a6ef1cd06"}]: dispatch 2024-09-19T07:04:00.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:00 smithi179 ceph-mon[35716]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "61b26278-f4db-40f0-97b9-c12a6ef1cd06"}]': finished 2024-09-19T07:04:00.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:00 smithi179 ceph-mon[35716]: osdmap e9: 2 total, 1 up, 2 in 2024-09-19T07:04:00.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:00 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:04:01.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:01 smithi165 ceph-mon[35326]: from='client.? 172.21.15.165:0/3974821016' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:04:01.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:01 smithi165 ceph-mon[35326]: pgmap v41: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:04:01.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:01 smithi179 ceph-mon[35716]: from='client.? 172.21.15.165:0/3974821016' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:04:01.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:01 smithi179 ceph-mon[35716]: pgmap v41: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:04:01.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:01 smithi148 ceph-mon[31180]: from='client.? 172.21.15.165:0/3974821016' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:04:01.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:01 smithi148 ceph-mon[31180]: pgmap v41: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:04:04.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:04 smithi148 ceph-mon[31180]: pgmap v42: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:04:04.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:04 smithi165 ceph-mon[35326]: pgmap v42: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:04:04.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:04 smithi179 ceph-mon[35716]: pgmap v42: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:04:06.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:06 smithi148 ceph-mon[31180]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:04:06.368 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:06 smithi165 ceph-mon[35326]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:04:06.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:06 smithi179 ceph-mon[35716]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:04:08.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:08 smithi165 ceph-mon[35326]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:04:08.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:08 smithi179 ceph-mon[35716]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:04:08.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:08 smithi148 ceph-mon[31180]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:04:09.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:09 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T07:04:09.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:09 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:09.525 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:09 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T07:04:09.525 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:09 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:09.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:09 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T07:04:09.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:09 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:10.140 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:10 smithi165 ceph-mon[35326]: Deploying daemon osd.1 on smithi165 2024-09-19T07:04:10.141 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:10 smithi165 ceph-mon[35326]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:04:10.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:10 smithi179 ceph-mon[35716]: Deploying daemon osd.1 on smithi165 2024-09-19T07:04:10.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:10 smithi179 ceph-mon[35716]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:04:10.535 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:10 smithi148 ceph-mon[31180]: Deploying daemon osd.1 on smithi165 2024-09-19T07:04:10.535 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:10 smithi148 ceph-mon[31180]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:04:12.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:12 smithi165 ceph-mon[35326]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:04:12.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:12 smithi179 ceph-mon[35716]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:04:12.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:12 smithi148 ceph-mon[31180]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:04:14.347 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:14 smithi165 ceph-mon[35326]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:04:14.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:14 smithi179 ceph-mon[35716]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:04:14.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:14 smithi148 ceph-mon[31180]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:04:15.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:15 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:04:15.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:15 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:15.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:15 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:15.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:15 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:04:15.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:15 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:15.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:15 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:15.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:15 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:04:15.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:15 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:15.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:15 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:16.336 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:16 smithi165 ceph-mon[35326]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:04:16.424 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:16 smithi179 ceph-mon[35716]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:04:16.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:16 smithi148 ceph-mon[31180]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:04:18.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:17 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:18.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:17 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:18.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:17 smithi165 ceph-mon[35326]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:04:18.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:17 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:18.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:17 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:04:18.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:17 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:18.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:17 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:18.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:17 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:18.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:17 smithi179 ceph-mon[35716]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:04:18.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:17 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:18.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:17 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:04:18.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:17 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:18.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:17 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:18.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:17 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:18.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:17 smithi148 ceph-mon[31180]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:04:18.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:17 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:18.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:17 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:04:18.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:17 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:18.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:04:18.434+0000 7f5e59ffb640 1 -- 172.21.15.165:0/4012777604 <== mgr.14148 v2:172.21.15.148:6800/3007822654 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5e5c062630 con 0x7f5e4c0a3260 2024-09-19T07:04:18.437 INFO:teuthology.orchestra.run.smithi165.stdout:Created osd(s) 1 on host 'smithi165' 2024-09-19T07:04:18.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:04:18.437+0000 7f5e62d28640 1 -- 172.21.15.165:0/4012777604 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f5e4c0a3260 msgr2=0x7f5e4c0a5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:04:18.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:04:18.437+0000 7f5e62d28640 1 --2- 172.21.15.165:0/4012777604 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f5e4c0a3260 0x7f5e4c0a5720 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c199420 tx=0x7f5e4800a2d0 comp rx=0 tx=0).stop 2024-09-19T07:04:18.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:04:18.437+0000 7f5e62d28640 1 -- 172.21.15.165:0/4012777604 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5e5c101c00 msgr2=0x7f5e5c197f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:04:18.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:04:18.437+0000 7f5e62d28640 1 --2- 172.21.15.165:0/4012777604 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5e5c101c00 0x7f5e5c197f00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5e50031610 tx=0x7f5e500043b0 comp rx=0 tx=0).stop 2024-09-19T07:04:18.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:04:18.437+0000 7f5e62d28640 1 -- 172.21.15.165:0/4012777604 shutdown_connections 2024-09-19T07:04:18.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:04:18.437+0000 7f5e62d28640 1 --2- 172.21.15.165:0/4012777604 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f5e4c0a3260 0x7f5e4c0a5720 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:18.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:04:18.437+0000 7f5e62d28640 1 --2- 172.21.15.165:0/4012777604 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e5c1037c0 0x7f5e5c19f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:18.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:04:18.437+0000 7f5e62d28640 1 --2- 172.21.15.165:0/4012777604 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e5c102e00 0x7f5e5c198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:18.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:04:18.437+0000 7f5e62d28640 1 --2- 172.21.15.165:0/4012777604 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5e5c101c00 0x7f5e5c197f00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:18.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:04:18.437+0000 7f5e62d28640 1 -- 172.21.15.165:0/4012777604 >> 172.21.15.165:0/4012777604 conn(0x7f5e5c0fd390 msgr2=0x7f5e5c1061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:04:18.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:04:18.437+0000 7f5e62d28640 1 -- 172.21.15.165:0/4012777604 shutdown_connections 2024-09-19T07:04:18.439 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:04:18.437+0000 7f5e62d28640 1 -- 172.21.15.165:0/4012777604 wait complete. 2024-09-19T07:04:19.035 DEBUG:teuthology.orchestra.run.smithi165:osd.1> sudo journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@osd.1.service 2024-09-19T07:04:19.038 INFO:tasks.cephadm:Deploying osd.2 on smithi179 with /dev/vg_nvme/lv_4... 2024-09-19T07:04:19.038 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T07:04:19.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:18 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:04:19.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:18 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:19.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:18 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:19.275 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:18 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:04:19.275 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:18 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:19.275 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:18 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:19.291 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:04:19.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:18 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:04:19.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:18 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:19.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:18 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:20.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:19 smithi179 ceph-mon[35716]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:04:20.330 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:19 smithi165 ceph-mon[35326]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:04:20.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:19 smithi148 ceph-mon[31180]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:04:20.582 INFO:journalctl@ceph.osd.1.smithi165.stdout:Sep 19 07:04:20 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-1[39697]: 2024-09-19T07:04:20.447+0000 7f5fd7bf0640 -1 osd.1 0 log_to_monitors true 2024-09-19T07:04:21.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:20 smithi179 ceph-mon[35716]: from='osd.1 [v2:172.21.15.165:6800/2433984552,v1:172.21.15.165:6801/2433984552]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T07:04:21.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:20 smithi179 ceph-mon[35716]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T07:04:21.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:20 smithi148 ceph-mon[31180]: from='osd.1 [v2:172.21.15.165:6800/2433984552,v1:172.21.15.165:6801/2433984552]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T07:04:21.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:20 smithi148 ceph-mon[31180]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T07:04:21.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:20 smithi165 ceph-mon[35326]: from='osd.1 [v2:172.21.15.165:6800/2433984552,v1:172.21.15.165:6801/2433984552]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T07:04:21.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:20 smithi165 ceph-mon[35326]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T07:04:21.735 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-19T07:04:21.762 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi179:vg_nvme/lv_4 2024-09-19T07:04:22.017 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:04:22.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:21 smithi179 ceph-mon[35716]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T07:04:22.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:21 smithi179 ceph-mon[35716]: from='osd.1 [v2:172.21.15.165:6800/2433984552,v1:172.21.15.165:6801/2433984552]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-19T07:04:22.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:21 smithi179 ceph-mon[35716]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T07:04:22.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:21 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:04:22.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:21 smithi179 ceph-mon[35716]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-19T07:04:22.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:21 smithi179 ceph-mon[35716]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:04:22.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:21 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:22.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:21 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:22.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:21 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:04:22.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:21 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:22.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:21 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:22.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:21 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:04:22.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:21 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:22.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:21 smithi148 ceph-mon[31180]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T07:04:22.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:21 smithi148 ceph-mon[31180]: from='osd.1 [v2:172.21.15.165:6800/2433984552,v1:172.21.15.165:6801/2433984552]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-19T07:04:22.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:21 smithi148 ceph-mon[31180]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T07:04:22.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:21 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:04:22.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:21 smithi148 ceph-mon[31180]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-19T07:04:22.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:21 smithi148 ceph-mon[31180]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:04:22.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:21 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:22.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:21 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:22.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:21 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:04:22.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:21 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:22.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:21 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:22.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:21 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:04:22.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:21 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:22.384 INFO:journalctl@ceph.osd.1.smithi165.stdout:Sep 19 07:04:21 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-1[39697]: 2024-09-19T07:04:21.982+0000 7f5fd3350640 -1 osd.1 0 waiting for initial osdmap 2024-09-19T07:04:22.384 INFO:journalctl@ceph.osd.1.smithi165.stdout:Sep 19 07:04:21 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-1[39697]: 2024-09-19T07:04:21.985+0000 7f5fcf98a640 -1 osd.1 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T07:04:22.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:21 smithi165 ceph-mon[35326]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T07:04:22.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:21 smithi165 ceph-mon[35326]: from='osd.1 [v2:172.21.15.165:6800/2433984552,v1:172.21.15.165:6801/2433984552]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-19T07:04:22.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:21 smithi165 ceph-mon[35326]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T07:04:22.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:21 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:04:22.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:21 smithi165 ceph-mon[35326]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-19T07:04:22.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:21 smithi165 ceph-mon[35326]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:04:22.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:21 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:22.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:21 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:22.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:21 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:04:22.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:21 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:22.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:21 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:22.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:21 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:04:22.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:21 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:22.480 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:22.477+0000 7f894c47e640 1 -- 172.21.15.179:0/4165209119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8944107940 msgr2=0x7f8944109d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:04:22.480 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:22.477+0000 7f894c47e640 1 --2- 172.21.15.179:0/4165209119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8944107940 0x7f8944109d30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f893c009ca0 tx=0x7f893c02a8c0 comp rx=0 tx=0).stop 2024-09-19T07:04:22.480 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:22.477+0000 7f894c47e640 1 -- 172.21.15.179:0/4165209119 shutdown_connections 2024-09-19T07:04:22.480 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:22.477+0000 7f894c47e640 1 --2- 172.21.15.179:0/4165209119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8944107940 0x7f8944109d30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:22.481 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:22.477+0000 7f894c47e640 1 --2- 172.21.15.179:0/4165209119 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8944105010 0x7f8944107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:22.481 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:22.477+0000 7f894c47e640 1 --2- 172.21.15.179:0/4165209119 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89441026e0 0x7f8944104ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:22.481 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:22.477+0000 7f894c47e640 1 -- 172.21.15.179:0/4165209119 >> 172.21.15.179:0/4165209119 conn(0x7f89440fc280 msgr2=0x7f89440fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:04:22.481 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:22.477+0000 7f894c47e640 1 -- 172.21.15.179:0/4165209119 shutdown_connections 2024-09-19T07:04:22.481 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:22.477+0000 7f894c47e640 1 -- 172.21.15.179:0/4165209119 wait complete. 2024-09-19T07:04:22.481 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:22.477+0000 7f894c47e640 1 Processor -- start 2024-09-19T07:04:22.481 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:22.477+0000 7f894c47e640 1 -- start start 2024-09-19T07:04:22.481 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:22.478+0000 7f894c47e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89441026e0 0x7f8944197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:04:22.481 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:22.478+0000 7f894c47e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8944105010 0x7f89441983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:04:22.481 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:22.478+0000 7f894c47e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8944107940 0x7f894419f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:04:22.481 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:22.478+0000 7f894c47e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f894410d8d0 con 0x7f8944105010 2024-09-19T07:04:22.481 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:22.478+0000 7f894c47e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f894410d750 con 0x7f89441026e0 2024-09-19T07:04:22.482 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:22.478+0000 7f894c47e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f894410da50 con 0x7f8944107940 2024-09-19T07:04:22.482 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:22.478+0000 7f894aa1b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8944107940 0x7f894419f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:04:22.482 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:22.478+0000 7f894aa1b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8944107940 0x7f894419f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:33444/0 (socket says 172.21.15.179:33444) 2024-09-19T07:04:22.482 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:22.478+0000 7f894aa1b640 1 -- 172.21.15.179:0/2849373477 learned_addr learned my addr 172.21.15.179:0/2849373477 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-09-19T07:04:22.482 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:22.478+0000 7f894a21a640 1 --2- 172.21.15.179:0/2849373477 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89441026e0 0x7f8944197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:04:22.482 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:22.478+0000 7f8949a19640 1 --2- 172.21.15.179:0/2849373477 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8944105010 0x7f89441983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:04:22.482 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:22.478+0000 7f894aa1b640 1 -- 172.21.15.179:0/2849373477 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89441026e0 msgr2=0x7f8944197e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:04:22.482 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:22.478+0000 7f894aa1b640 1 --2- 172.21.15.179:0/2849373477 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89441026e0 0x7f8944197e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:22.482 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:22.478+0000 7f894aa1b640 1 -- 172.21.15.179:0/2849373477 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8944105010 msgr2=0x7f89441983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:04:22.482 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:22.478+0000 7f894aa1b640 1 --2- 172.21.15.179:0/2849373477 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8944105010 0x7f89441983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:22.482 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:22.478+0000 7f894aa1b640 1 -- 172.21.15.179:0/2849373477 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f894419fac0 con 0x7f8944107940 2024-09-19T07:04:22.482 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:22.478+0000 7f894a21a640 1 --2- 172.21.15.179:0/2849373477 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89441026e0 0x7f8944197e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:04:22.483 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:22.478+0000 7f894aa1b640 1 --2- 172.21.15.179:0/2849373477 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8944107940 0x7f894419f450 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f893c0098d0 tx=0x7f893c02f840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:04:22.483 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:22.478+0000 7f893b7fe640 1 -- 172.21.15.179:0/2849373477 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f893c02fc30 con 0x7f8944107940 2024-09-19T07:04:22.483 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:22.478+0000 7f893b7fe640 1 -- 172.21.15.179:0/2849373477 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f893c003e50 con 0x7f8944107940 2024-09-19T07:04:22.483 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:22.478+0000 7f894c47e640 1 -- 172.21.15.179:0/2849373477 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f894419fd50 con 0x7f8944107940 2024-09-19T07:04:22.483 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:22.478+0000 7f893b7fe640 1 -- 172.21.15.179:0/2849373477 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f893c0305c0 con 0x7f8944107940 2024-09-19T07:04:22.483 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:22.479+0000 7f894c47e640 1 -- 172.21.15.179:0/2849373477 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89441a02d0 con 0x7f8944107940 2024-09-19T07:04:22.484 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:22.480+0000 7f894c47e640 1 -- 172.21.15.179:0/2849373477 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89440fdd70 con 0x7f8944107940 2024-09-19T07:04:22.484 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:22.481+0000 7f893b7fe640 1 -- 172.21.15.179:0/2849373477 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 15) ==== 138300+0+0 (secure 0 0 0) 0x7f893c004b40 con 0x7f8944107940 2024-09-19T07:04:22.484 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:22.482+0000 7f893b7fe640 1 --2- 172.21.15.179:0/2849373477 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f89300a3260 0x7f89300a5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:04:22.484 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:22.482+0000 7f893b7fe640 1 -- 172.21.15.179:0/2849373477 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 2029+0+0 (secure 0 0 0) 0x7f893c0ef4b0 con 0x7f8944107940 2024-09-19T07:04:22.484 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:22.482+0000 7f894a21a640 1 --2- 172.21.15.179:0/2849373477 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f89300a3260 0x7f89300a5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:04:22.484 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:22.483+0000 7f894a21a640 1 --2- 172.21.15.179:0/2849373477 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f89300a3260 0x7f89300a5720 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f894000baa0 tx=0x7f8940005d90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:04:22.486 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:22.485+0000 7f893b7fe640 1 -- 172.21.15.179:0/2849373477 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f893c0433d0 con 0x7f8944107940 2024-09-19T07:04:22.661 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:22.660+0000 7f894c47e640 1 -- 172.21.15.179:0/2849373477 --> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f8944062630 con 0x7f89300a3260 2024-09-19T07:04:23.264 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:22 smithi179 ceph-mon[35716]: Detected new or changed devices on smithi165 2024-09-19T07:04:23.264 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:22 smithi179 ceph-mon[35716]: Adjusting osd_memory_target on smithi165 to 17088M 2024-09-19T07:04:23.264 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:22 smithi179 ceph-mon[35716]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]': finished 2024-09-19T07:04:23.264 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:22 smithi179 ceph-mon[35716]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T07:04:23.265 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:22 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:04:23.265 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:22 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:04:23.265 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:22 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:04:23.265 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:22 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:04:23.265 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:22 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:23.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:22 smithi148 ceph-mon[31180]: Detected new or changed devices on smithi165 2024-09-19T07:04:23.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:22 smithi148 ceph-mon[31180]: Adjusting osd_memory_target on smithi165 to 17088M 2024-09-19T07:04:23.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:22 smithi148 ceph-mon[31180]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]': finished 2024-09-19T07:04:23.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:22 smithi148 ceph-mon[31180]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T07:04:23.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:22 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:04:23.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:22 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:04:23.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:22 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:04:23.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:22 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:04:23.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:22 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:23.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:22 smithi165 ceph-mon[35326]: Detected new or changed devices on smithi165 2024-09-19T07:04:23.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:22 smithi165 ceph-mon[35326]: Adjusting osd_memory_target on smithi165 to 17088M 2024-09-19T07:04:23.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:22 smithi165 ceph-mon[35326]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]': finished 2024-09-19T07:04:23.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:22 smithi165 ceph-mon[35326]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T07:04:23.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:22 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:04:23.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:22 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:04:23.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:22 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:04:23.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:22 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:04:23.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:22 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:24.112 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:23 smithi179 ceph-mon[35716]: purged_snaps scrub starts 2024-09-19T07:04:24.112 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:23 smithi179 ceph-mon[35716]: purged_snaps scrub ok 2024-09-19T07:04:24.112 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:23 smithi179 ceph-mon[35716]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:04:24.112 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:23 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:04:24.112 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:23 smithi179 ceph-mon[35716]: osd.1 [v2:172.21.15.165:6800/2433984552,v1:172.21.15.165:6801/2433984552] boot 2024-09-19T07:04:24.112 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:23 smithi179 ceph-mon[35716]: osdmap e12: 2 total, 2 up, 2 in 2024-09-19T07:04:24.113 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:23 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:04:24.113 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:23 smithi179 ceph-mon[35716]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:04:24.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:23 smithi148 ceph-mon[31180]: purged_snaps scrub starts 2024-09-19T07:04:24.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:23 smithi148 ceph-mon[31180]: purged_snaps scrub ok 2024-09-19T07:04:24.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:23 smithi148 ceph-mon[31180]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:04:24.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:23 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:04:24.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:23 smithi148 ceph-mon[31180]: osd.1 [v2:172.21.15.165:6800/2433984552,v1:172.21.15.165:6801/2433984552] boot 2024-09-19T07:04:24.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:23 smithi148 ceph-mon[31180]: osdmap e12: 2 total, 2 up, 2 in 2024-09-19T07:04:24.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:23 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:04:24.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:23 smithi148 ceph-mon[31180]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:04:24.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:23 smithi165 ceph-mon[35326]: purged_snaps scrub starts 2024-09-19T07:04:24.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:23 smithi165 ceph-mon[35326]: purged_snaps scrub ok 2024-09-19T07:04:24.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:23 smithi165 ceph-mon[35326]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:04:24.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:23 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:04:24.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:23 smithi165 ceph-mon[35326]: osd.1 [v2:172.21.15.165:6800/2433984552,v1:172.21.15.165:6801/2433984552] boot 2024-09-19T07:04:24.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:23 smithi165 ceph-mon[35326]: osdmap e12: 2 total, 2 up, 2 in 2024-09-19T07:04:24.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:23 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:04:24.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:23 smithi165 ceph-mon[35326]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:04:25.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:24 smithi179 ceph-mon[35716]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T07:04:25.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:24 smithi179 ceph-mon[35716]: from='client.? 172.21.15.179:0/1589162359' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "06620bbc-cdb5-4afc-8122-0bb3126630f1"}]: dispatch 2024-09-19T07:04:25.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:24 smithi179 ceph-mon[35716]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "06620bbc-cdb5-4afc-8122-0bb3126630f1"}]: dispatch 2024-09-19T07:04:25.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:24 smithi179 ceph-mon[35716]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "06620bbc-cdb5-4afc-8122-0bb3126630f1"}]': finished 2024-09-19T07:04:25.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:24 smithi179 ceph-mon[35716]: osdmap e14: 3 total, 2 up, 3 in 2024-09-19T07:04:25.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:24 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:04:25.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:24 smithi148 ceph-mon[31180]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T07:04:25.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:24 smithi148 ceph-mon[31180]: from='client.? 172.21.15.179:0/1589162359' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "06620bbc-cdb5-4afc-8122-0bb3126630f1"}]: dispatch 2024-09-19T07:04:25.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:24 smithi148 ceph-mon[31180]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "06620bbc-cdb5-4afc-8122-0bb3126630f1"}]: dispatch 2024-09-19T07:04:25.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:24 smithi148 ceph-mon[31180]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "06620bbc-cdb5-4afc-8122-0bb3126630f1"}]': finished 2024-09-19T07:04:25.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:24 smithi148 ceph-mon[31180]: osdmap e14: 3 total, 2 up, 3 in 2024-09-19T07:04:25.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:24 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:04:25.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:24 smithi165 ceph-mon[35326]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T07:04:25.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:24 smithi165 ceph-mon[35326]: from='client.? 172.21.15.179:0/1589162359' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "06620bbc-cdb5-4afc-8122-0bb3126630f1"}]: dispatch 2024-09-19T07:04:25.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:24 smithi165 ceph-mon[35326]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "06620bbc-cdb5-4afc-8122-0bb3126630f1"}]: dispatch 2024-09-19T07:04:25.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:24 smithi165 ceph-mon[35326]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "06620bbc-cdb5-4afc-8122-0bb3126630f1"}]': finished 2024-09-19T07:04:25.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:24 smithi165 ceph-mon[35326]: osdmap e14: 3 total, 2 up, 3 in 2024-09-19T07:04:25.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:24 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:04:26.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:26 smithi148 ceph-mon[31180]: pgmap v58: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:04:26.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:26 smithi148 ceph-mon[31180]: from='client.? 172.21.15.179:0/2113156763' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:04:26.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:26 smithi165 ceph-mon[35326]: pgmap v58: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:04:26.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:26 smithi165 ceph-mon[35326]: from='client.? 172.21.15.179:0/2113156763' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:04:26.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:26 smithi179 ceph-mon[35716]: pgmap v58: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:04:26.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:26 smithi179 ceph-mon[35716]: from='client.? 172.21.15.179:0/2113156763' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:04:28.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:28 smithi148 ceph-mon[31180]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:04:28.347 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:28 smithi165 ceph-mon[35326]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:04:28.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:28 smithi179 ceph-mon[35716]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:04:30.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:30 smithi165 ceph-mon[35326]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:04:30.510 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:30 smithi179 ceph-mon[35716]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:04:30.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:30 smithi148 ceph-mon[31180]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:04:32.381 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:32 smithi179 ceph-mon[35716]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:04:32.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:32 smithi165 ceph-mon[35326]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:04:32.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:32 smithi148 ceph-mon[31180]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:04:34.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:34 smithi165 ceph-mon[35326]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:04:34.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:34 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T07:04:34.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:34 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:34.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:34 smithi179 ceph-mon[35716]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:04:34.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:34 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T07:04:34.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:34 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:34.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:34 smithi148 ceph-mon[31180]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:04:34.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:34 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T07:04:34.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:34 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:35.161 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:35 smithi179 ceph-mon[35716]: Deploying daemon osd.2 on smithi179 2024-09-19T07:04:35.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:35 smithi165 ceph-mon[35326]: Deploying daemon osd.2 on smithi179 2024-09-19T07:04:35.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:35 smithi148 ceph-mon[31180]: Deploying daemon osd.2 on smithi179 2024-09-19T07:04:36.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:36 smithi165 ceph-mon[35326]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:04:36.441 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:36 smithi179 ceph-mon[35716]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:04:36.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:36 smithi148 ceph-mon[31180]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:04:38.358 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:38 smithi179 ceph-mon[35716]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:04:38.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:38 smithi165 ceph-mon[35326]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:04:38.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:38 smithi148 ceph-mon[31180]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:04:40.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:40 smithi179 ceph-mon[35716]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:04:40.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:40 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:04:40.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:40 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:40.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:40 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:40.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:40 smithi165 ceph-mon[35326]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:04:40.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:40 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:04:40.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:40 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:40.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:40 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:40.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:40 smithi148 ceph-mon[31180]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:04:40.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:40 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:04:40.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:40 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:40.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:40 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:42.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:42 smithi165 ceph-mon[35326]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:04:42.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:42 smithi179 ceph-mon[35716]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:04:42.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:42 smithi148 ceph-mon[31180]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:04:43.240 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:43.239+0000 7f893b7fe640 1 -- 172.21.15.179:0/2849373477 <== mgr.14148 v2:172.21.15.148:6800/3007822654 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8944062630 con 0x7f89300a3260 2024-09-19T07:04:43.240 INFO:teuthology.orchestra.run.smithi179.stdout:Created osd(s) 2 on host 'smithi179' 2024-09-19T07:04:43.243 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:43.242+0000 7f894c47e640 1 -- 172.21.15.179:0/2849373477 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f89300a3260 msgr2=0x7f89300a5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:04:43.243 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:43.242+0000 7f894c47e640 1 --2- 172.21.15.179:0/2849373477 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f89300a3260 0x7f89300a5720 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f894000baa0 tx=0x7f8940005d90 comp rx=0 tx=0).stop 2024-09-19T07:04:43.243 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:43.242+0000 7f894c47e640 1 -- 172.21.15.179:0/2849373477 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8944107940 msgr2=0x7f894419f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:04:43.243 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:43.242+0000 7f894c47e640 1 --2- 172.21.15.179:0/2849373477 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8944107940 0x7f894419f450 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f893c0098d0 tx=0x7f893c02f840 comp rx=0 tx=0).stop 2024-09-19T07:04:43.243 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:43.242+0000 7f894c47e640 1 -- 172.21.15.179:0/2849373477 shutdown_connections 2024-09-19T07:04:43.244 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:43.242+0000 7f894c47e640 1 --2- 172.21.15.179:0/2849373477 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f89300a3260 0x7f89300a5720 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:43.244 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:43.242+0000 7f894c47e640 1 --2- 172.21.15.179:0/2849373477 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8944107940 0x7f894419f450 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:43.244 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:43.242+0000 7f894c47e640 1 --2- 172.21.15.179:0/2849373477 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8944105010 0x7f89441983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:43.244 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:43.242+0000 7f894c47e640 1 --2- 172.21.15.179:0/2849373477 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89441026e0 0x7f8944197e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:43.244 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:43.242+0000 7f894c47e640 1 -- 172.21.15.179:0/2849373477 >> 172.21.15.179:0/2849373477 conn(0x7f89440fc280 msgr2=0x7f8944102f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:04:43.244 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:43.242+0000 7f894c47e640 1 -- 172.21.15.179:0/2849373477 shutdown_connections 2024-09-19T07:04:43.244 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:04:43.242+0000 7f894c47e640 1 -- 172.21.15.179:0/2849373477 wait complete. 2024-09-19T07:04:43.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:43 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:43.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:43 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:43.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:43 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:43.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:43 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:04:43.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:43 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:43.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:43 smithi179 ceph-mon[35716]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:04:43.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:43 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:43.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:43 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:43.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:43 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:43.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:43 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:04:43.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:43 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:43.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:43 smithi148 ceph-mon[31180]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:04:43.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:43 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:43.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:43 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:43.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:43 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:43.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:43 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:04:43.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:43 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:43.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:43 smithi165 ceph-mon[35326]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:04:43.900 DEBUG:teuthology.orchestra.run.smithi179:osd.2> sudo journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@osd.2.service 2024-09-19T07:04:43.902 INFO:tasks.cephadm:Deploying osd.3 on smithi148 with /dev/vg_nvme/lv_3... 2024-09-19T07:04:43.902 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T07:04:44.160 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:04:44.494 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:44 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:04:44.494 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:44 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:44.494 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:44 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:44.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:44 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:04:44.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:44 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:44.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:44 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:44.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:44 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:04:44.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:44 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:44.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:44 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:45.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:45 smithi179 ceph-mon[35716]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:04:45.426 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:45 smithi148 ceph-mon[31180]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:04:45.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:45 smithi165 ceph-mon[35326]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:04:45.773 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 19 07:04:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-2[40686]: 2024-09-19T07:04:45.375+0000 7f5abb365640 -1 osd.2 0 log_to_monitors true 2024-09-19T07:04:46.487 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:46 smithi148 ceph-mon[31180]: from='osd.2 [v2:172.21.15.179:6800/3048365223,v1:172.21.15.179:6801/3048365223]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T07:04:46.487 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:46 smithi148 ceph-mon[31180]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T07:04:46.490 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:04:46.514 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi148:vg_nvme/lv_3 2024-09-19T07:04:46.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:46 smithi179 ceph-mon[35716]: from='osd.2 [v2:172.21.15.179:6800/3048365223,v1:172.21.15.179:6801/3048365223]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T07:04:46.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:46 smithi179 ceph-mon[35716]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T07:04:46.535 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:46 smithi165 ceph-mon[35326]: from='osd.2 [v2:172.21.15.179:6800/3048365223,v1:172.21.15.179:6801/3048365223]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T07:04:46.535 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:46 smithi165 ceph-mon[35326]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T07:04:46.771 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:04:47.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:04:47.208+0000 7fcb812f5640 1 -- 172.21.15.148:0/1893761952 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb7c102e00 msgr2=0x7fcb7c103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:04:47.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:04:47.208+0000 7fcb812f5640 1 --2- 172.21.15.148:0/1893761952 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb7c102e00 0x7fcb7c103280 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c009900 tx=0x7fcb6c02a410 comp rx=0 tx=0).stop 2024-09-19T07:04:47.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:04:47.208+0000 7fcb812f5640 1 -- 172.21.15.148:0/1893761952 shutdown_connections 2024-09-19T07:04:47.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:04:47.208+0000 7fcb812f5640 1 --2- 172.21.15.148:0/1893761952 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb7c1037c0 0x7fcb7c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:47.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:04:47.208+0000 7fcb812f5640 1 --2- 172.21.15.148:0/1893761952 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb7c102e00 0x7fcb7c103280 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:47.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:04:47.208+0000 7fcb812f5640 1 --2- 172.21.15.148:0/1893761952 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb7c101c00 0x7fcb7c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:47.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:04:47.208+0000 7fcb812f5640 1 -- 172.21.15.148:0/1893761952 >> 172.21.15.148:0/1893761952 conn(0x7fcb7c0fd390 msgr2=0x7fcb7c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:04:47.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:04:47.208+0000 7fcb812f5640 1 -- 172.21.15.148:0/1893761952 shutdown_connections 2024-09-19T07:04:47.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:04:47.208+0000 7fcb812f5640 1 -- 172.21.15.148:0/1893761952 wait complete. 2024-09-19T07:04:47.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:04:47.208+0000 7fcb812f5640 1 Processor -- start 2024-09-19T07:04:47.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:04:47.209+0000 7fcb812f5640 1 -- start start 2024-09-19T07:04:47.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:04:47.209+0000 7fcb812f5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb7c101c00 0x7fcb7c197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:04:47.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:04:47.209+0000 7fcb812f5640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb7c102e00 0x7fcb7c1984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:04:47.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:04:47.209+0000 7fcb812f5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb7c1037c0 0x7fcb7c19f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:04:47.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:04:47.209+0000 7fcb812f5640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c10d880 con 0x7fcb7c1037c0 2024-09-19T07:04:47.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:04:47.209+0000 7fcb812f5640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c10d700 con 0x7fcb7c102e00 2024-09-19T07:04:47.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:04:47.209+0000 7fcb812f5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c10da00 con 0x7fcb7c101c00 2024-09-19T07:04:47.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:04:47.209+0000 7fcb7b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb7c1037c0 0x7fcb7c19f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:04:47.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:04:47.209+0000 7fcb7b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb7c1037c0 0x7fcb7c19f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34352/0 (socket says 172.21.15.148:34352) 2024-09-19T07:04:47.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:04:47.209+0000 7fcb7b7fe640 1 -- 172.21.15.148:0/838472976 learned_addr learned my addr 172.21.15.148:0/838472976 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:04:47.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:04:47.209+0000 7fcb7a7fc640 1 --2- 172.21.15.148:0/838472976 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb7c102e00 0x7fcb7c1984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:04:47.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:04:47.209+0000 7fcb7affd640 1 --2- 172.21.15.148:0/838472976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb7c101c00 0x7fcb7c197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:04:47.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:04:47.209+0000 7fcb7b7fe640 1 -- 172.21.15.148:0/838472976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb7c101c00 msgr2=0x7fcb7c197f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:04:47.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:04:47.209+0000 7fcb7b7fe640 1 --2- 172.21.15.148:0/838472976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb7c101c00 0x7fcb7c197f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:47.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:04:47.209+0000 7fcb7b7fe640 1 -- 172.21.15.148:0/838472976 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb7c102e00 msgr2=0x7fcb7c1984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:04:47.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:04:47.209+0000 7fcb7b7fe640 1 --2- 172.21.15.148:0/838472976 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb7c102e00 0x7fcb7c1984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:47.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:04:47.209+0000 7fcb7b7fe640 1 -- 172.21.15.148:0/838472976 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb7c19fb90 con 0x7fcb7c1037c0 2024-09-19T07:04:47.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:04:47.209+0000 7fcb7b7fe640 1 --2- 172.21.15.148:0/838472976 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb7c1037c0 0x7fcb7c19f520 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcb74009fd0 tx=0x7fcb7400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:04:47.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:04:47.210+0000 7fcb63fff640 1 -- 172.21.15.148:0/838472976 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb74017070 con 0x7fcb7c1037c0 2024-09-19T07:04:47.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:04:47.210+0000 7fcb812f5640 1 -- 172.21.15.148:0/838472976 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb7c19fe80 con 0x7fcb7c1037c0 2024-09-19T07:04:47.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:04:47.210+0000 7fcb63fff640 1 -- 172.21.15.148:0/838472976 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb74003e50 con 0x7fcb7c1037c0 2024-09-19T07:04:47.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:04:47.210+0000 7fcb63fff640 1 -- 172.21.15.148:0/838472976 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb740106c0 con 0x7fcb7c1037c0 2024-09-19T07:04:47.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:04:47.210+0000 7fcb812f5640 1 -- 172.21.15.148:0/838472976 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb7c1a02e0 con 0x7fcb7c1037c0 2024-09-19T07:04:47.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:04:47.211+0000 7fcb812f5640 1 -- 172.21.15.148:0/838472976 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb7c1090a0 con 0x7fcb7c1037c0 2024-09-19T07:04:47.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:04:47.212+0000 7fcb63fff640 1 -- 172.21.15.148:0/838472976 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 15) ==== 138300+0+0 (secure 0 0 0) 0x7fcb74003970 con 0x7fcb7c1037c0 2024-09-19T07:04:47.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:04:47.212+0000 7fcb63fff640 1 --2- 172.21.15.148:0/838472976 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fcb640a31e0 0x7fcb640a56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:04:47.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:04:47.212+0000 7fcb7affd640 1 --2- 172.21.15.148:0/838472976 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fcb640a31e0 0x7fcb640a56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:04:47.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:04:47.213+0000 7fcb63fff640 1 -- 172.21.15.148:0/838472976 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2445+0+0 (secure 0 0 0) 0x7fcb740cddb0 con 0x7fcb7c1037c0 2024-09-19T07:04:47.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:04:47.213+0000 7fcb7affd640 1 --2- 172.21.15.148:0/838472976 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fcb640a31e0 0x7fcb640a56a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcb700058c0 tx=0x7fcb7000a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:04:47.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:04:47.217+0000 7fcb63fff640 1 -- 172.21.15.148:0/838472976 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcb7409bc50 con 0x7fcb7c1037c0 2024-09-19T07:04:47.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:04:47.400+0000 7fcb812f5640 1 -- 172.21.15.148:0/838472976 --> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fcb7c062630 con 0x7fcb640a31e0 2024-09-19T07:04:47.401 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:47 smithi148 ceph-mon[31180]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T07:04:47.401 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:47 smithi148 ceph-mon[31180]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T07:04:47.401 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:47 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:04:47.402 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:47 smithi148 ceph-mon[31180]: from='osd.2 [v2:172.21.15.179:6800/3048365223,v1:172.21.15.179:6801/3048365223]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-19T07:04:47.402 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:47 smithi148 ceph-mon[31180]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-19T07:04:47.402 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:47 smithi148 ceph-mon[31180]: Detected new or changed devices on smithi179 2024-09-19T07:04:47.402 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:47 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:47.402 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:47 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:47.402 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:47 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:04:47.402 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:47 smithi148 ceph-mon[31180]: Adjusting osd_memory_target on smithi179 to 17088M 2024-09-19T07:04:47.402 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:47 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:47.402 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:47 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:47.402 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:47 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:04:47.402 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:47 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:47.402 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:47 smithi148 ceph-mon[31180]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:04:47.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:47 smithi179 ceph-mon[35716]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T07:04:47.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:47 smithi179 ceph-mon[35716]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T07:04:47.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:47 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:04:47.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:47 smithi179 ceph-mon[35716]: from='osd.2 [v2:172.21.15.179:6800/3048365223,v1:172.21.15.179:6801/3048365223]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-19T07:04:47.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:47 smithi179 ceph-mon[35716]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-19T07:04:47.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:47 smithi179 ceph-mon[35716]: Detected new or changed devices on smithi179 2024-09-19T07:04:47.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:47 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:47.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:47 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:47.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:47 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:04:47.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:47 smithi179 ceph-mon[35716]: Adjusting osd_memory_target on smithi179 to 17088M 2024-09-19T07:04:47.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:47 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:47.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:47 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:47.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:47 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:04:47.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:47 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:47.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:47 smithi179 ceph-mon[35716]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:04:47.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:47 smithi165 ceph-mon[35326]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T07:04:47.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:47 smithi165 ceph-mon[35326]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T07:04:47.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:47 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:04:47.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:47 smithi165 ceph-mon[35326]: from='osd.2 [v2:172.21.15.179:6800/3048365223,v1:172.21.15.179:6801/3048365223]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-19T07:04:47.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:47 smithi165 ceph-mon[35326]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-19T07:04:47.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:47 smithi165 ceph-mon[35326]: Detected new or changed devices on smithi179 2024-09-19T07:04:47.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:47 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:47.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:47 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:47.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:47 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:04:47.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:47 smithi165 ceph-mon[35326]: Adjusting osd_memory_target on smithi179 to 17088M 2024-09-19T07:04:47.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:47 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:47.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:47 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:47.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:47 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:04:47.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:47 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:47.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:47 smithi165 ceph-mon[35326]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:04:48.055 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 19 07:04:48 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-2[40686]: 2024-09-19T07:04:48.004+0000 7f5ab6ac5640 -1 osd.2 0 waiting for initial osdmap 2024-09-19T07:04:48.055 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 19 07:04:48 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-2[40686]: 2024-09-19T07:04:48.010+0000 7f5aaf0f7640 -1 osd.2 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T07:04:48.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:48 smithi179 ceph-mon[35716]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-09-19T07:04:48.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:48 smithi179 ceph-mon[35716]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T07:04:48.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:48 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:04:48.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:48 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:04:48.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:48 smithi179 ceph-mon[35716]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:04:48.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:48 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:04:48.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:48 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:04:48.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:48 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:48.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:48 smithi179 ceph-mon[35716]: from='osd.2 ' entity='osd.2' 2024-09-19T07:04:48.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:48 smithi148 ceph-mon[31180]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-09-19T07:04:48.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:48 smithi148 ceph-mon[31180]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T07:04:48.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:48 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:04:48.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:48 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:04:48.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:48 smithi148 ceph-mon[31180]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:04:48.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:48 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:04:48.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:48 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:04:48.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:48 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:48.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:48 smithi148 ceph-mon[31180]: from='osd.2 ' entity='osd.2' 2024-09-19T07:04:48.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:48 smithi165 ceph-mon[35326]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-09-19T07:04:48.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:48 smithi165 ceph-mon[35326]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T07:04:48.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:48 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:04:48.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:48 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:04:48.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:48 smithi165 ceph-mon[35326]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:04:48.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:48 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:04:48.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:48 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:04:48.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:48 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:48.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:48 smithi165 ceph-mon[35326]: from='osd.2 ' entity='osd.2' 2024-09-19T07:04:49.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:49 smithi148 ceph-mon[31180]: purged_snaps scrub starts 2024-09-19T07:04:49.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:49 smithi148 ceph-mon[31180]: purged_snaps scrub ok 2024-09-19T07:04:49.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:49 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:04:49.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:49 smithi148 ceph-mon[31180]: osd.2 [v2:172.21.15.179:6800/3048365223,v1:172.21.15.179:6801/3048365223] boot 2024-09-19T07:04:49.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:49 smithi148 ceph-mon[31180]: osdmap e17: 3 total, 3 up, 3 in 2024-09-19T07:04:49.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:49 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:04:49.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:49 smithi165 ceph-mon[35326]: purged_snaps scrub starts 2024-09-19T07:04:49.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:49 smithi165 ceph-mon[35326]: purged_snaps scrub ok 2024-09-19T07:04:49.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:49 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:04:49.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:49 smithi165 ceph-mon[35326]: osd.2 [v2:172.21.15.179:6800/3048365223,v1:172.21.15.179:6801/3048365223] boot 2024-09-19T07:04:49.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:49 smithi165 ceph-mon[35326]: osdmap e17: 3 total, 3 up, 3 in 2024-09-19T07:04:49.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:49 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:04:49.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:49 smithi179 ceph-mon[35716]: purged_snaps scrub starts 2024-09-19T07:04:49.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:49 smithi179 ceph-mon[35716]: purged_snaps scrub ok 2024-09-19T07:04:49.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:49 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:04:49.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:49 smithi179 ceph-mon[35716]: osd.2 [v2:172.21.15.179:6800/3048365223,v1:172.21.15.179:6801/3048365223] boot 2024-09-19T07:04:49.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:49 smithi179 ceph-mon[35716]: osdmap e17: 3 total, 3 up, 3 in 2024-09-19T07:04:49.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:49 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:04:50.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:50 smithi148 ceph-mon[31180]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:04:50.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:50 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T07:04:50.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:50 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/337655248' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d7df45d4-5ef1-4f66-84a7-f61b8756c0c5"}]: dispatch 2024-09-19T07:04:50.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:50 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T07:04:50.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:50 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/337655248' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d7df45d4-5ef1-4f66-84a7-f61b8756c0c5"}]': finished 2024-09-19T07:04:50.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:50 smithi148 ceph-mon[31180]: osdmap e18: 4 total, 3 up, 4 in 2024-09-19T07:04:50.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:50 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:04:50.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:50 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T07:04:50.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:50 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/109122675' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:04:50.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:50 smithi165 ceph-mon[35326]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:04:50.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:50 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T07:04:50.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:50 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/337655248' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d7df45d4-5ef1-4f66-84a7-f61b8756c0c5"}]: dispatch 2024-09-19T07:04:50.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:50 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T07:04:50.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:50 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/337655248' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d7df45d4-5ef1-4f66-84a7-f61b8756c0c5"}]': finished 2024-09-19T07:04:50.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:50 smithi165 ceph-mon[35326]: osdmap e18: 4 total, 3 up, 4 in 2024-09-19T07:04:50.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:50 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:04:50.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:50 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T07:04:50.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:50 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/109122675' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:04:50.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:50 smithi179 ceph-mon[35716]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:04:50.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:50 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T07:04:50.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:50 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/337655248' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d7df45d4-5ef1-4f66-84a7-f61b8756c0c5"}]: dispatch 2024-09-19T07:04:50.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:50 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T07:04:50.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:50 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/337655248' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d7df45d4-5ef1-4f66-84a7-f61b8756c0c5"}]': finished 2024-09-19T07:04:50.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:50 smithi179 ceph-mon[35716]: osdmap e18: 4 total, 3 up, 4 in 2024-09-19T07:04:50.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:50 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:04:50.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:50 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T07:04:50.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:50 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/109122675' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:04:51.534 INFO:journalctl@ceph.osd.0.smithi148.stdout:Sep 19 07:04:51 smithi148 sudo[47112]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T07:04:51.534 INFO:journalctl@ceph.osd.0.smithi148.stdout:Sep 19 07:04:51 smithi148 sudo[47112]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T07:04:51.534 INFO:journalctl@ceph.osd.0.smithi148.stdout:Sep 19 07:04:51 smithi148 sudo[47112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T07:04:51.534 INFO:journalctl@ceph.osd.0.smithi148.stdout:Sep 19 07:04:51 smithi148 sudo[47112]: pam_unix(sudo:session): session closed for user root 2024-09-19T07:04:51.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:04:51.769+0000 7fcb63fff640 1 -- 172.21.15.148:0/838472976 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fcb740982c0 con 0x7fcb7c1037c0 2024-09-19T07:04:51.833 INFO:journalctl@ceph.osd.0.smithi148.stdout:Sep 19 07:04:51 smithi148 sudo[47118]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T07:04:51.833 INFO:journalctl@ceph.osd.0.smithi148.stdout:Sep 19 07:04:51 smithi148 sudo[47118]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T07:04:51.833 INFO:journalctl@ceph.osd.0.smithi148.stdout:Sep 19 07:04:51 smithi148 sudo[47118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T07:04:51.833 INFO:journalctl@ceph.osd.0.smithi148.stdout:Sep 19 07:04:51 smithi148 sudo[47118]: pam_unix(sudo:session): session closed for user root 2024-09-19T07:04:51.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:51 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T07:04:51.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:51 smithi148 ceph-mon[31180]: osdmap e19: 4 total, 3 up, 4 in 2024-09-19T07:04:51.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:51 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:04:51.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:51 smithi148 ceph-mon[31180]: pgmap v76: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:04:51.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:51 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:52.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:51 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T07:04:52.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:51 smithi179 ceph-mon[35716]: osdmap e19: 4 total, 3 up, 4 in 2024-09-19T07:04:52.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:51 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:04:52.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:51 smithi179 ceph-mon[35716]: pgmap v76: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:04:52.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:51 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:52.065 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:51 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T07:04:52.066 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:51 smithi165 ceph-mon[35326]: osdmap e19: 4 total, 3 up, 4 in 2024-09-19T07:04:52.066 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:51 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:04:52.066 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:51 smithi165 ceph-mon[35326]: pgmap v76: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:04:52.066 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:51 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:52.066 INFO:journalctl@ceph.osd.1.smithi165.stdout:Sep 19 07:04:51 smithi165 sudo[43836]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T07:04:52.066 INFO:journalctl@ceph.osd.1.smithi165.stdout:Sep 19 07:04:51 smithi165 sudo[43836]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T07:04:52.066 INFO:journalctl@ceph.osd.1.smithi165.stdout:Sep 19 07:04:51 smithi165 sudo[43836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T07:04:52.066 INFO:journalctl@ceph.osd.1.smithi165.stdout:Sep 19 07:04:51 smithi165 sudo[43836]: pam_unix(sudo:session): session closed for user root 2024-09-19T07:04:52.384 INFO:journalctl@ceph.osd.1.smithi165.stdout:Sep 19 07:04:52 smithi165 sudo[43839]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T07:04:52.384 INFO:journalctl@ceph.osd.1.smithi165.stdout:Sep 19 07:04:52 smithi165 sudo[43839]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T07:04:52.385 INFO:journalctl@ceph.osd.1.smithi165.stdout:Sep 19 07:04:52 smithi165 sudo[43839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T07:04:52.385 INFO:journalctl@ceph.osd.1.smithi165.stdout:Sep 19 07:04:52 smithi165 sudo[43839]: pam_unix(sudo:session): session closed for user root 2024-09-19T07:04:52.593 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 19 07:04:52 smithi179 sudo[44491]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T07:04:52.593 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 19 07:04:52 smithi179 sudo[44491]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T07:04:52.593 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 19 07:04:52 smithi179 sudo[44491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T07:04:52.593 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 19 07:04:52 smithi179 sudo[44491]: pam_unix(sudo:session): session closed for user root 2024-09-19T07:04:53.022 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 19 07:04:52 smithi179 sudo[44494]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T07:04:53.023 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 19 07:04:52 smithi179 sudo[44494]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T07:04:53.023 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 19 07:04:52 smithi179 sudo[44494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T07:04:53.023 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 19 07:04:52 smithi179 sudo[44494]: pam_unix(sudo:session): session closed for user root 2024-09-19T07:04:53.116 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:52 smithi148 sudo[47499]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T07:04:53.116 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:52 smithi148 sudo[47499]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T07:04:53.116 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:52 smithi148 sudo[47499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T07:04:53.117 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:52 smithi148 sudo[47499]: pam_unix(sudo:session): session closed for user root 2024-09-19T07:04:53.381 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:53 smithi179 ceph-mon[35716]: mgrmap e16: x(active, since 2m), standbys: y, z 2024-09-19T07:04:53.381 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:53 smithi179 ceph-mon[35716]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T07:04:53.381 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:53 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:04:53.382 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:53 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:53.382 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:53 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:53.382 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:53 smithi179 ceph-mon[35716]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T07:04:53.382 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:53 smithi179 sudo[44497]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T07:04:53.382 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:53 smithi179 sudo[44497]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T07:04:53.382 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:53 smithi179 sudo[44497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T07:04:53.382 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:53 smithi179 sudo[44497]: pam_unix(sudo:session): session closed for user root 2024-09-19T07:04:53.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:53 smithi165 ceph-mon[35326]: mgrmap e16: x(active, since 2m), standbys: y, z 2024-09-19T07:04:53.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:53 smithi165 ceph-mon[35326]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T07:04:53.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:53 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:04:53.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:53 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:53.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:53 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:53.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:53 smithi165 ceph-mon[35326]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T07:04:53.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:53 smithi148 sudo[47689]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T07:04:53.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:53 smithi148 sudo[47689]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T07:04:53.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:53 smithi148 sudo[47689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T07:04:53.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:53 smithi148 sudo[47689]: pam_unix(sudo:session): session closed for user root 2024-09-19T07:04:53.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:53 smithi148 ceph-mon[31180]: mgrmap e16: x(active, since 2m), standbys: y, z 2024-09-19T07:04:53.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:53 smithi148 ceph-mon[31180]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T07:04:53.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:53 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:04:53.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:53 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:53.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:53 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:04:53.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:53 smithi148 ceph-mon[31180]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T07:04:53.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:53 smithi179 sudo[44500]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T07:04:53.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:53 smithi179 sudo[44500]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T07:04:53.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:53 smithi179 sudo[44500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T07:04:53.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:53 smithi179 sudo[44500]: pam_unix(sudo:session): session closed for user root 2024-09-19T07:04:54.123 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:53 smithi165 sudo[43842]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T07:04:54.123 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:53 smithi165 sudo[43842]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T07:04:54.123 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:53 smithi165 sudo[43842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T07:04:54.123 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:53 smithi165 sudo[43842]: pam_unix(sudo:session): session closed for user root 2024-09-19T07:04:54.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:54 smithi165 sudo[43845]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T07:04:54.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:54 smithi165 sudo[43845]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T07:04:54.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:54 smithi165 sudo[43845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T07:04:54.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:54 smithi165 sudo[43845]: pam_unix(sudo:session): session closed for user root 2024-09-19T07:04:54.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:54 smithi165 ceph-mon[35326]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:04:54.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:54 smithi165 ceph-mon[35326]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T07:04:54.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:54 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:04:54.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:54 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:04:54.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:54 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:04:54.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:54 smithi165 ceph-mon[35326]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T07:04:54.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:54 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:04:54.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:54 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:04:54.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:54 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:04:54.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:54 smithi165 ceph-mon[35326]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T07:04:54.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:54 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:04:54.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:54 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:04:54.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:54 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:04:54.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:54 smithi179 ceph-mon[35716]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:04:54.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:54 smithi179 ceph-mon[35716]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T07:04:54.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:54 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:04:54.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:54 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:04:54.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:54 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:04:54.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:54 smithi179 ceph-mon[35716]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T07:04:54.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:54 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:04:54.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:54 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:04:54.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:54 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:04:54.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:54 smithi179 ceph-mon[35716]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T07:04:54.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:54 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:04:54.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:54 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:04:54.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:54 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:04:54.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:54 smithi148 ceph-mon[31180]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:04:54.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:54 smithi148 ceph-mon[31180]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T07:04:54.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:54 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:04:54.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:54 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:04:54.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:54 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:04:54.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:54 smithi148 ceph-mon[31180]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T07:04:54.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:54 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:04:54.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:54 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:04:54.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:54 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:04:54.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:54 smithi148 ceph-mon[31180]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T07:04:54.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:54 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:04:54.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:54 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:04:54.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:54 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:04:55.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:55 smithi148 ceph-mon[31180]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T07:04:55.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:55 smithi148 ceph-mon[31180]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T07:04:55.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:55 smithi148 ceph-mon[31180]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:04:55.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:55 smithi179 ceph-mon[35716]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T07:04:55.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:55 smithi179 ceph-mon[35716]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T07:04:55.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:55 smithi179 ceph-mon[35716]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:04:55.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:55 smithi165 ceph-mon[35326]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T07:04:55.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:55 smithi165 ceph-mon[35326]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T07:04:55.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:55 smithi165 ceph-mon[35326]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:04:58.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:58 smithi165 ceph-mon[35326]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:04:58.311 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:58 smithi148 ceph-mon[31180]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:04:58.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:58 smithi179 ceph-mon[35716]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:04:59.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:59 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T07:04:59.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:04:59 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:59.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:59 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T07:04:59.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:04:59 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:59.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:59 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T07:04:59.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:04:59 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:00.219 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:00 smithi148 ceph-mon[31180]: Deploying daemon osd.3 on smithi148 2024-09-19T07:05:00.219 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:00 smithi148 ceph-mon[31180]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2024-09-19T07:05:00.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:00 smithi165 ceph-mon[35326]: Deploying daemon osd.3 on smithi148 2024-09-19T07:05:00.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:00 smithi165 ceph-mon[35326]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2024-09-19T07:05:00.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:00 smithi179 ceph-mon[35716]: Deploying daemon osd.3 on smithi148 2024-09-19T07:05:00.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:00 smithi179 ceph-mon[35716]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2024-09-19T07:05:02.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:02 smithi165 ceph-mon[35326]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-19T07:05:02.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:02 smithi179 ceph-mon[35716]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-19T07:05:02.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:02 smithi148 ceph-mon[31180]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-19T07:05:04.359 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:04 smithi148 ceph-mon[31180]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-19T07:05:04.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:04 smithi165 ceph-mon[35326]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-19T07:05:04.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:04 smithi179 ceph-mon[35716]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-19T07:05:05.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:05 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:05:05.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:05 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:05.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:05 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:05.499 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:05 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:05:05.499 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:05 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:05.500 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:05 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:05.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:05 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:05:05.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:05 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:05.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:05 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:06.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:06 smithi165 ceph-mon[35326]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-19T07:05:06.494 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:06 smithi148 ceph-mon[31180]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-19T07:05:06.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:06 smithi179 ceph-mon[35716]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-19T07:05:08.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:05:08.160+0000 7fcb63fff640 1 -- 172.21.15.148:0/838472976 <== mgr.14148 v2:172.21.15.148:6800/3007822654 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fcb7c062630 con 0x7fcb640a31e0 2024-09-19T07:05:08.162 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:07 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:08.162 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:07 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:08.162 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:07 smithi148 ceph-mon[31180]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T07:05:08.162 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:07 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:08.162 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:07 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:05:08.162 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:07 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:08.163 INFO:teuthology.orchestra.run.smithi148.stdout:Created osd(s) 3 on host 'smithi148' 2024-09-19T07:05:08.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:05:08.164+0000 7fcb812f5640 1 -- 172.21.15.148:0/838472976 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fcb640a31e0 msgr2=0x7fcb640a56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:08.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:05:08.164+0000 7fcb812f5640 1 --2- 172.21.15.148:0/838472976 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fcb640a31e0 0x7fcb640a56a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcb700058c0 tx=0x7fcb7000a2d0 comp rx=0 tx=0).stop 2024-09-19T07:05:08.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:05:08.164+0000 7fcb812f5640 1 -- 172.21.15.148:0/838472976 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb7c1037c0 msgr2=0x7fcb7c19f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:08.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:05:08.164+0000 7fcb812f5640 1 --2- 172.21.15.148:0/838472976 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb7c1037c0 0x7fcb7c19f520 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcb74009fd0 tx=0x7fcb7400b260 comp rx=0 tx=0).stop 2024-09-19T07:05:08.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:05:08.164+0000 7fcb812f5640 1 -- 172.21.15.148:0/838472976 shutdown_connections 2024-09-19T07:05:08.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:05:08.164+0000 7fcb812f5640 1 --2- 172.21.15.148:0/838472976 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fcb640a31e0 0x7fcb640a56a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:08.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:05:08.164+0000 7fcb812f5640 1 --2- 172.21.15.148:0/838472976 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb7c1037c0 0x7fcb7c19f520 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:08.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:05:08.164+0000 7fcb812f5640 1 --2- 172.21.15.148:0/838472976 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb7c102e00 0x7fcb7c1984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:08.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:05:08.164+0000 7fcb812f5640 1 --2- 172.21.15.148:0/838472976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb7c101c00 0x7fcb7c197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:08.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:05:08.164+0000 7fcb812f5640 1 -- 172.21.15.148:0/838472976 >> 172.21.15.148:0/838472976 conn(0x7fcb7c0fd390 msgr2=0x7fcb7c106270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:05:08.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:05:08.164+0000 7fcb812f5640 1 -- 172.21.15.148:0/838472976 shutdown_connections 2024-09-19T07:05:08.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:05:08.164+0000 7fcb812f5640 1 -- 172.21.15.148:0/838472976 wait complete. 2024-09-19T07:05:08.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:07 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:08.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:07 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:08.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:07 smithi179 ceph-mon[35716]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T07:05:08.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:07 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:08.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:07 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:05:08.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:07 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:08.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:07 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:08.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:07 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:08.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:07 smithi165 ceph-mon[35326]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T07:05:08.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:07 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:08.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:07 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:05:08.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:07 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:08.788 DEBUG:teuthology.orchestra.run.smithi148:osd.3> sudo journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@osd.3.service 2024-09-19T07:05:08.791 INFO:tasks.cephadm:Deploying osd.4 on smithi165 with /dev/vg_nvme/lv_3... 2024-09-19T07:05:08.791 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T07:05:09.037 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:08 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:05:09.037 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:08 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:09.037 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:08 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:09.058 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T07:05:09.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:08 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:05:09.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:08 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:09.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:08 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:09.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:08 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:05:09.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:08 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:09.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:08 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:10.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:09 smithi148 ceph-mon[31180]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T07:05:10.183 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:09 smithi165 ceph-mon[35326]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T07:05:10.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:09 smithi179 ceph-mon[35716]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T07:05:10.833 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 19 07:05:10 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-3[49116]: 2024-09-19T07:05:10.502+0000 7fd5353b2640 -1 osd.3 0 log_to_monitors true 2024-09-19T07:05:11.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:10 smithi165 ceph-mon[35326]: from='osd.3 [v2:172.21.15.148:6810/3662789091,v1:172.21.15.148:6811/3662789091]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T07:05:11.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:10 smithi179 ceph-mon[35716]: from='osd.3 [v2:172.21.15.148:6810/3662789091,v1:172.21.15.148:6811/3662789091]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T07:05:11.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:10 smithi148 ceph-mon[31180]: from='osd.3 [v2:172.21.15.148:6810/3662789091,v1:172.21.15.148:6811/3662789091]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T07:05:11.512 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-19T07:05:11.539 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi165:vg_nvme/lv_3 2024-09-19T07:05:11.796 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T07:05:12.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:11 smithi165 ceph-mon[35326]: from='osd.3 [v2:172.21.15.148:6810/3662789091,v1:172.21.15.148:6811/3662789091]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T07:05:12.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:11 smithi165 ceph-mon[35326]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T07:05:12.135 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:11 smithi165 ceph-mon[35326]: from='osd.3 [v2:172.21.15.148:6810/3662789091,v1:172.21.15.148:6811/3662789091]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]: dispatch 2024-09-19T07:05:12.135 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:11 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:05:12.135 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:11 smithi165 ceph-mon[35326]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:05:12.135 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:11 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:12.135 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:11 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:12.135 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:11 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:05:12.135 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:11 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:05:12.135 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:11 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:12.135 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:11 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:12.135 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:11 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:05:12.135 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:11 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:12.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:12.248+0000 7fc24fe1c640 1 -- 172.21.15.165:0/2417768161 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc248100ad0 msgr2=0x7fc248100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:12.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:12.248+0000 7fc24fe1c640 1 --2- 172.21.15.165:0/2417768161 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc248100ad0 0x7fc248100ed0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc244009900 tx=0x7fc24402a410 comp rx=0 tx=0).stop 2024-09-19T07:05:12.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:12.248+0000 7fc24fe1c640 1 -- 172.21.15.165:0/2417768161 shutdown_connections 2024-09-19T07:05:12.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:12.248+0000 7fc24fe1c640 1 --2- 172.21.15.165:0/2417768161 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc248102690 0x7fc248108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:12.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:12.248+0000 7fc24fe1c640 1 --2- 172.21.15.165:0/2417768161 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc248101cd0 0x7fc248102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:12.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:12.248+0000 7fc24fe1c640 1 --2- 172.21.15.165:0/2417768161 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc248100ad0 0x7fc248100ed0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:12.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:12.248+0000 7fc24fe1c640 1 -- 172.21.15.165:0/2417768161 >> 172.21.15.165:0/2417768161 conn(0x7fc2480fc280 msgr2=0x7fc2480fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:05:12.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:12.248+0000 7fc24fe1c640 1 -- 172.21.15.165:0/2417768161 shutdown_connections 2024-09-19T07:05:12.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:12.248+0000 7fc24fe1c640 1 -- 172.21.15.165:0/2417768161 wait complete. 2024-09-19T07:05:12.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:12.249+0000 7fc24fe1c640 1 Processor -- start 2024-09-19T07:05:12.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:12.249+0000 7fc24fe1c640 1 -- start start 2024-09-19T07:05:12.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:12.249+0000 7fc24fe1c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc248100ad0 0x7fc24806aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:12.264 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:12.249+0000 7fc24fe1c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc248101cd0 0x7fc24819ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:12.264 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:12.249+0000 7fc24fe1c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc248102690 0x7fc24819f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:12.264 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:12.249+0000 7fc24fe1c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc24810c750 con 0x7fc248100ad0 2024-09-19T07:05:12.264 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:12.249+0000 7fc24fe1c640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc24810c5d0 con 0x7fc248102690 2024-09-19T07:05:12.264 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:12.249+0000 7fc24fe1c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc24810c8d0 con 0x7fc248101cd0 2024-09-19T07:05:12.264 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:12.249+0000 7fc24e3b9640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc248102690 0x7fc24819f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:12.264 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:12.249+0000 7fc24dbb8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc248100ad0 0x7fc24806aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:12.264 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:12.249+0000 7fc24e3b9640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc248102690 0x7fc24819f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.165:38784/0 (socket says 172.21.15.165:38784) 2024-09-19T07:05:12.264 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:12.249+0000 7fc24e3b9640 1 -- 172.21.15.165:0/4238358394 learned_addr learned my addr 172.21.15.165:0/4238358394 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-19T07:05:12.264 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:12.250+0000 7fc24d3b7640 1 --2- 172.21.15.165:0/4238358394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc248101cd0 0x7fc24819ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:12.264 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:12.250+0000 7fc24dbb8640 1 -- 172.21.15.165:0/4238358394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc248101cd0 msgr2=0x7fc24819ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:12.265 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:12.250+0000 7fc24dbb8640 1 --2- 172.21.15.165:0/4238358394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc248101cd0 0x7fc24819ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:12.265 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:12.250+0000 7fc24dbb8640 1 -- 172.21.15.165:0/4238358394 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc248102690 msgr2=0x7fc24819f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:12.265 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:12.250+0000 7fc24dbb8640 1 --2- 172.21.15.165:0/4238358394 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc248102690 0x7fc24819f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:12.265 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:12.250+0000 7fc24dbb8640 1 -- 172.21.15.165:0/4238358394 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc24819fc00 con 0x7fc248100ad0 2024-09-19T07:05:12.265 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:12.250+0000 7fc24e3b9640 1 --2- 172.21.15.165:0/4238358394 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc248102690 0x7fc24819f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:05:12.265 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:12.250+0000 7fc24dbb8640 1 --2- 172.21.15.165:0/4238358394 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc248100ad0 0x7fc24806aad0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc244009230 tx=0x7fc244031b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:05:12.265 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:12.250+0000 7fc23effd640 1 -- 172.21.15.165:0/4238358394 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24403f070 con 0x7fc248100ad0 2024-09-19T07:05:12.265 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:12.250+0000 7fc24fe1c640 1 -- 172.21.15.165:0/4238358394 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc24819fe30 con 0x7fc248100ad0 2024-09-19T07:05:12.265 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:12.250+0000 7fc23effd640 1 -- 172.21.15.165:0/4238358394 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc244003cd0 con 0x7fc248100ad0 2024-09-19T07:05:12.265 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:12.250+0000 7fc23effd640 1 -- 172.21.15.165:0/4238358394 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc244035070 con 0x7fc248100ad0 2024-09-19T07:05:12.265 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:12.250+0000 7fc24fe1c640 1 -- 172.21.15.165:0/4238358394 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2481a0280 con 0x7fc248100ad0 2024-09-19T07:05:12.265 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:12.251+0000 7fc24fe1c640 1 -- 172.21.15.165:0/4238358394 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc248107f70 con 0x7fc248100ad0 2024-09-19T07:05:12.265 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:12.252+0000 7fc23effd640 1 -- 172.21.15.165:0/4238358394 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fc24403b4f0 con 0x7fc248100ad0 2024-09-19T07:05:12.266 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:12.253+0000 7fc23effd640 1 --2- 172.21.15.165:0/4238358394 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fc2340a3240 0x7fc2340a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:12.266 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:12.253+0000 7fc23effd640 1 -- 172.21.15.165:0/4238358394 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 3389+0+0 (secure 0 0 0) 0x7fc2440eeb50 con 0x7fc248100ad0 2024-09-19T07:05:12.266 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:12.253+0000 7fc24d3b7640 1 --2- 172.21.15.165:0/4238358394 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fc2340a3240 0x7fc2340a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:12.266 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:12.253+0000 7fc24d3b7640 1 --2- 172.21.15.165:0/4238358394 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fc2340a3240 0x7fc2340a5700 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc238005fd0 tx=0x7fc238005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:05:12.266 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:12.258+0000 7fc23effd640 1 -- 172.21.15.165:0/4238358394 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc2440bcb10 con 0x7fc248100ad0 2024-09-19T07:05:12.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:11 smithi179 ceph-mon[35716]: from='osd.3 [v2:172.21.15.148:6810/3662789091,v1:172.21.15.148:6811/3662789091]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T07:05:12.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:11 smithi179 ceph-mon[35716]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T07:05:12.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:11 smithi179 ceph-mon[35716]: from='osd.3 [v2:172.21.15.148:6810/3662789091,v1:172.21.15.148:6811/3662789091]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]: dispatch 2024-09-19T07:05:12.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:11 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:05:12.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:11 smithi179 ceph-mon[35716]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:05:12.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:11 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:12.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:11 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:12.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:11 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:05:12.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:11 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:05:12.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:11 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:12.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:11 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:12.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:11 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:05:12.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:11 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:12.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:11 smithi148 ceph-mon[31180]: from='osd.3 [v2:172.21.15.148:6810/3662789091,v1:172.21.15.148:6811/3662789091]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T07:05:12.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:11 smithi148 ceph-mon[31180]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T07:05:12.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:11 smithi148 ceph-mon[31180]: from='osd.3 [v2:172.21.15.148:6810/3662789091,v1:172.21.15.148:6811/3662789091]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]: dispatch 2024-09-19T07:05:12.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:11 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:05:12.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:11 smithi148 ceph-mon[31180]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:05:12.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:11 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:12.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:11 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:12.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:11 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:05:12.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:11 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:05:12.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:11 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:12.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:11 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:12.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:11 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:05:12.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:11 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:12.441 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:12.440+0000 7fc24fe1c640 1 -- 172.21.15.165:0/4238358394 --> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi165:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fc248062630 con 0x7fc2340a3240 2024-09-19T07:05:13.083 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 19 07:05:12 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-3[49116]: 2024-09-19T07:05:12.692+0000 7fd530b12640 -1 osd.3 0 waiting for initial osdmap 2024-09-19T07:05:13.083 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 19 07:05:12 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-3[49116]: 2024-09-19T07:05:12.700+0000 7fd529144640 -1 osd.3 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T07:05:13.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:12 smithi148 ceph-mon[31180]: Detected new or changed devices on smithi148 2024-09-19T07:05:13.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:12 smithi148 ceph-mon[31180]: Adjusting osd_memory_target on smithi148 to 8544M 2024-09-19T07:05:13.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:12 smithi148 ceph-mon[31180]: from='osd.3 [v2:172.21.15.148:6810/3662789091,v1:172.21.15.148:6811/3662789091]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-19T07:05:13.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:12 smithi148 ceph-mon[31180]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T07:05:13.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:12 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:05:13.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:12 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:05:13.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:12 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:05:13.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:12 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:05:13.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:12 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:13.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:12 smithi148 ceph-mon[31180]: from='osd.3 [v2:172.21.15.148:6810/3662789091,v1:172.21.15.148:6811/3662789091]' entity='osd.3' 2024-09-19T07:05:13.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:12 smithi148 ceph-mon[31180]: osd.3 [v2:172.21.15.148:6810/3662789091,v1:172.21.15.148:6811/3662789091] boot 2024-09-19T07:05:13.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:12 smithi148 ceph-mon[31180]: osdmap e23: 4 total, 4 up, 4 in 2024-09-19T07:05:13.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:12 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:05:13.098 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:12 smithi165 ceph-mon[35326]: Detected new or changed devices on smithi148 2024-09-19T07:05:13.098 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:12 smithi165 ceph-mon[35326]: Adjusting osd_memory_target on smithi148 to 8544M 2024-09-19T07:05:13.098 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:12 smithi165 ceph-mon[35326]: from='osd.3 [v2:172.21.15.148:6810/3662789091,v1:172.21.15.148:6811/3662789091]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-19T07:05:13.098 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:12 smithi165 ceph-mon[35326]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T07:05:13.098 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:12 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:05:13.098 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:12 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:05:13.099 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:12 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:05:13.099 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:12 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:05:13.099 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:12 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:13.099 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:12 smithi165 ceph-mon[35326]: from='osd.3 [v2:172.21.15.148:6810/3662789091,v1:172.21.15.148:6811/3662789091]' entity='osd.3' 2024-09-19T07:05:13.099 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:12 smithi165 ceph-mon[35326]: osd.3 [v2:172.21.15.148:6810/3662789091,v1:172.21.15.148:6811/3662789091] boot 2024-09-19T07:05:13.099 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:12 smithi165 ceph-mon[35326]: osdmap e23: 4 total, 4 up, 4 in 2024-09-19T07:05:13.099 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:12 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:05:13.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:12 smithi179 ceph-mon[35716]: Detected new or changed devices on smithi148 2024-09-19T07:05:13.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:12 smithi179 ceph-mon[35716]: Adjusting osd_memory_target on smithi148 to 8544M 2024-09-19T07:05:13.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:12 smithi179 ceph-mon[35716]: from='osd.3 [v2:172.21.15.148:6810/3662789091,v1:172.21.15.148:6811/3662789091]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-19T07:05:13.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:12 smithi179 ceph-mon[35716]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T07:05:13.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:12 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:05:13.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:12 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:05:13.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:12 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:05:13.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:12 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:05:13.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:12 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:13.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:12 smithi179 ceph-mon[35716]: from='osd.3 [v2:172.21.15.148:6810/3662789091,v1:172.21.15.148:6811/3662789091]' entity='osd.3' 2024-09-19T07:05:13.274 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:12 smithi179 ceph-mon[35716]: osd.3 [v2:172.21.15.148:6810/3662789091,v1:172.21.15.148:6811/3662789091] boot 2024-09-19T07:05:13.274 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:12 smithi179 ceph-mon[35716]: osdmap e23: 4 total, 4 up, 4 in 2024-09-19T07:05:13.274 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:12 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:05:14.056 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:13 smithi165 ceph-mon[35326]: purged_snaps scrub starts 2024-09-19T07:05:14.056 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:13 smithi165 ceph-mon[35326]: purged_snaps scrub ok 2024-09-19T07:05:14.056 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:13 smithi165 ceph-mon[35326]: from='client.14322 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi165:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:05:14.056 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:13 smithi165 ceph-mon[35326]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 523 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:05:14.057 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:13 smithi165 ceph-mon[35326]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T07:05:14.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:13 smithi179 ceph-mon[35716]: purged_snaps scrub starts 2024-09-19T07:05:14.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:13 smithi179 ceph-mon[35716]: purged_snaps scrub ok 2024-09-19T07:05:14.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:13 smithi179 ceph-mon[35716]: from='client.14322 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi165:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:05:14.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:13 smithi179 ceph-mon[35716]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 523 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:05:14.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:13 smithi179 ceph-mon[35716]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T07:05:14.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:13 smithi148 ceph-mon[31180]: purged_snaps scrub starts 2024-09-19T07:05:14.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:13 smithi148 ceph-mon[31180]: purged_snaps scrub ok 2024-09-19T07:05:14.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:13 smithi148 ceph-mon[31180]: from='client.14322 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi165:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:05:14.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:13 smithi148 ceph-mon[31180]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 523 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:05:14.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:13 smithi148 ceph-mon[31180]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T07:05:15.297 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:15 smithi165 ceph-mon[35326]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T07:05:15.297 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:15 smithi165 ceph-mon[35326]: from='client.? 172.21.15.165:0/1337954502' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5cfd359b-a8d2-4bdc-858f-087d26e0869c"}]: dispatch 2024-09-19T07:05:15.297 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:15 smithi165 ceph-mon[35326]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5cfd359b-a8d2-4bdc-858f-087d26e0869c"}]: dispatch 2024-09-19T07:05:15.297 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:15 smithi165 ceph-mon[35326]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5cfd359b-a8d2-4bdc-858f-087d26e0869c"}]': finished 2024-09-19T07:05:15.297 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:15 smithi165 ceph-mon[35326]: osdmap e26: 5 total, 4 up, 5 in 2024-09-19T07:05:15.297 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:15 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:05:15.297 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:15 smithi165 ceph-mon[35326]: pgmap v95: 1 pgs: 1 remapped+peering; 577 KiB data, 522 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:05:15.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:15 smithi179 ceph-mon[35716]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T07:05:15.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:15 smithi179 ceph-mon[35716]: from='client.? 172.21.15.165:0/1337954502' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5cfd359b-a8d2-4bdc-858f-087d26e0869c"}]: dispatch 2024-09-19T07:05:15.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:15 smithi179 ceph-mon[35716]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5cfd359b-a8d2-4bdc-858f-087d26e0869c"}]: dispatch 2024-09-19T07:05:15.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:15 smithi179 ceph-mon[35716]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5cfd359b-a8d2-4bdc-858f-087d26e0869c"}]': finished 2024-09-19T07:05:15.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:15 smithi179 ceph-mon[35716]: osdmap e26: 5 total, 4 up, 5 in 2024-09-19T07:05:15.525 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:15 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:05:15.525 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:15 smithi179 ceph-mon[35716]: pgmap v95: 1 pgs: 1 remapped+peering; 577 KiB data, 522 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:05:15.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:15 smithi148 ceph-mon[31180]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T07:05:15.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:15 smithi148 ceph-mon[31180]: from='client.? 172.21.15.165:0/1337954502' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5cfd359b-a8d2-4bdc-858f-087d26e0869c"}]: dispatch 2024-09-19T07:05:15.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:15 smithi148 ceph-mon[31180]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5cfd359b-a8d2-4bdc-858f-087d26e0869c"}]: dispatch 2024-09-19T07:05:15.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:15 smithi148 ceph-mon[31180]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5cfd359b-a8d2-4bdc-858f-087d26e0869c"}]': finished 2024-09-19T07:05:15.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:15 smithi148 ceph-mon[31180]: osdmap e26: 5 total, 4 up, 5 in 2024-09-19T07:05:15.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:15 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:05:15.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:15 smithi148 ceph-mon[31180]: pgmap v95: 1 pgs: 1 remapped+peering; 577 KiB data, 522 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:05:16.424 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:16 smithi179 ceph-mon[35716]: from='client.? 172.21.15.165:0/4084052010' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:05:16.424 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:16 smithi179 ceph-mon[35716]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T07:05:16.424 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:16 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:05:16.535 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:16 smithi165 ceph-mon[35326]: from='client.? 172.21.15.165:0/4084052010' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:05:16.535 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:16 smithi165 ceph-mon[35326]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T07:05:16.535 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:16 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:05:16.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:16 smithi148 ceph-mon[31180]: from='client.? 172.21.15.165:0/4084052010' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:05:16.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:16 smithi148 ceph-mon[31180]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T07:05:16.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:16 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:05:17.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:17 smithi179 ceph-mon[35716]: pgmap v97: 1 pgs: 1 remapped+peering; 577 KiB data, 522 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:05:17.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:17 smithi148 ceph-mon[31180]: pgmap v97: 1 pgs: 1 remapped+peering; 577 KiB data, 522 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:05:17.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:17 smithi165 ceph-mon[35326]: pgmap v97: 1 pgs: 1 remapped+peering; 577 KiB data, 522 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:05:20.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:20 smithi165 ceph-mon[35326]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-19T07:05:20.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:20 smithi179 ceph-mon[35716]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-19T07:05:20.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:20 smithi148 ceph-mon[31180]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-19T07:05:22.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:22 smithi165 ceph-mon[35326]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-19T07:05:22.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:22 smithi179 ceph-mon[35716]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-19T07:05:22.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:22 smithi148 ceph-mon[31180]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-19T07:05:24.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:24 smithi165 ceph-mon[35326]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-19T07:05:24.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:24 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T07:05:24.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:24 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:24.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:24 smithi179 ceph-mon[35716]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-19T07:05:24.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:24 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T07:05:24.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:24 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:24.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:24 smithi148 ceph-mon[31180]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-19T07:05:24.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:24 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T07:05:24.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:24 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:25.205 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:25 smithi165 ceph-mon[35326]: Deploying daemon osd.4 on smithi165 2024-09-19T07:05:25.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:25 smithi179 ceph-mon[35716]: Deploying daemon osd.4 on smithi165 2024-09-19T07:05:25.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:25 smithi148 ceph-mon[31180]: Deploying daemon osd.4 on smithi165 2024-09-19T07:05:26.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:26 smithi165 ceph-mon[35326]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T07:05:26.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:26 smithi179 ceph-mon[35716]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T07:05:26.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:26 smithi148 ceph-mon[31180]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T07:05:28.176 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:28 smithi165 ceph-mon[35326]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-19T07:05:28.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:28 smithi179 ceph-mon[35716]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-19T07:05:28.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:28 smithi148 ceph-mon[31180]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-19T07:05:30.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:30 smithi165 ceph-mon[35326]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T07:05:30.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:30 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:05:30.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:30 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:30.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:30 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:30.385 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:30 smithi148 ceph-mon[31180]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T07:05:30.385 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:30 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:05:30.385 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:30 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:30.385 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:30 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:30.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:30 smithi179 ceph-mon[35716]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T07:05:30.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:30 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:05:30.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:30 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:30.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:30 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:32.272 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:32 smithi165 ceph-mon[35326]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:05:32.272 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:32 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:32.272 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:32 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:32.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:32 smithi179 ceph-mon[35716]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:05:32.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:32 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:32.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:32 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:32.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:32.569+0000 7fc23effd640 1 -- 172.21.15.165:0/4238358394 <== mgr.14148 v2:172.21.15.148:6800/3007822654 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc248062630 con 0x7fc2340a3240 2024-09-19T07:05:32.571 INFO:teuthology.orchestra.run.smithi165.stdout:Created osd(s) 4 on host 'smithi165' 2024-09-19T07:05:32.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:32.572+0000 7fc24fe1c640 1 -- 172.21.15.165:0/4238358394 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fc2340a3240 msgr2=0x7fc2340a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:32.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:32.572+0000 7fc24fe1c640 1 --2- 172.21.15.165:0/4238358394 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fc2340a3240 0x7fc2340a5700 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc238005fd0 tx=0x7fc238005850 comp rx=0 tx=0).stop 2024-09-19T07:05:32.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:32.572+0000 7fc24fe1c640 1 -- 172.21.15.165:0/4238358394 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc248100ad0 msgr2=0x7fc24806aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:32.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:32.572+0000 7fc24fe1c640 1 --2- 172.21.15.165:0/4238358394 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc248100ad0 0x7fc24806aad0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc244009230 tx=0x7fc244031b60 comp rx=0 tx=0).stop 2024-09-19T07:05:32.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:32.572+0000 7fc24fe1c640 1 -- 172.21.15.165:0/4238358394 shutdown_connections 2024-09-19T07:05:32.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:32.572+0000 7fc24fe1c640 1 --2- 172.21.15.165:0/4238358394 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fc2340a3240 0x7fc2340a5700 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:32.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:32.572+0000 7fc24fe1c640 1 --2- 172.21.15.165:0/4238358394 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc248102690 0x7fc24819f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:32.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:32.572+0000 7fc24fe1c640 1 --2- 172.21.15.165:0/4238358394 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc248101cd0 0x7fc24819ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:32.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:32.572+0000 7fc24fe1c640 1 --2- 172.21.15.165:0/4238358394 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc248100ad0 0x7fc24806aad0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:32.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:32.572+0000 7fc24fe1c640 1 -- 172.21.15.165:0/4238358394 >> 172.21.15.165:0/4238358394 conn(0x7fc2480fc280 msgr2=0x7fc248105140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:05:32.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:32.572+0000 7fc24fe1c640 1 -- 172.21.15.165:0/4238358394 shutdown_connections 2024-09-19T07:05:32.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:05:32.572+0000 7fc24fe1c640 1 -- 172.21.15.165:0/4238358394 wait complete. 2024-09-19T07:05:32.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:32 smithi148 ceph-mon[31180]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:05:32.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:32 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:32.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:32 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:33.187 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:33 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:33.187 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:33 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:05:33.187 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:33 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:33.187 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:33 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:05:33.188 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:33 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:33.188 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:33 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:33.190 DEBUG:teuthology.orchestra.run.smithi165:osd.4> sudo journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@osd.4.service 2024-09-19T07:05:33.192 INFO:tasks.cephadm:Deploying osd.5 on smithi179 with /dev/vg_nvme/lv_3... 2024-09-19T07:05:33.192 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T07:05:33.445 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:05:33.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:33 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:33.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:33 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:05:33.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:33 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:33.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:33 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:05:33.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:33 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:33.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:33 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:33.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:33 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:33.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:33 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:05:33.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:33 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:33.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:33 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:05:33.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:33 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:33.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:33 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:34.231 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:34 smithi165 ceph-mon[35326]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:05:34.498 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:34 smithi179 ceph-mon[35716]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:05:34.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:34 smithi148 ceph-mon[31180]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:05:35.298 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:35 smithi179 ceph-mon[35716]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:05:35.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:35 smithi165 ceph-mon[35326]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:05:35.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:35 smithi148 ceph-mon[31180]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:05:35.784 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-19T07:05:35.811 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi179:vg_nvme/lv_3 2024-09-19T07:05:35.884 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 19 07:05:35 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-4[46511]: 2024-09-19T07:05:35.678+0000 7f0011ccb640 -1 osd.4 0 log_to_monitors true 2024-09-19T07:05:36.058 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:05:36.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:36 smithi165 ceph-mon[35326]: from='osd.4 [v2:172.21.15.165:6808/3082550323,v1:172.21.15.165:6809/3082550323]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T07:05:36.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:36 smithi165 ceph-mon[35326]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T07:05:36.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:36 smithi165 ceph-mon[35326]: Detected new or changed devices on smithi165 2024-09-19T07:05:36.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:36 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:36.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:36 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:36.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:36 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:05:36.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:36 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:05:36.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:36 smithi165 ceph-mon[35326]: Adjusting osd_memory_target on smithi165 to 8544M 2024-09-19T07:05:36.386 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:36 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:36.386 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:36 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:36.386 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:36 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:05:36.386 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:36 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:36.387 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:36 smithi179 ceph-mon[35716]: from='osd.4 [v2:172.21.15.165:6808/3082550323,v1:172.21.15.165:6809/3082550323]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T07:05:36.387 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:36 smithi179 ceph-mon[35716]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T07:05:36.387 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:36 smithi179 ceph-mon[35716]: Detected new or changed devices on smithi165 2024-09-19T07:05:36.388 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:36 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:36.388 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:36 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:36.388 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:36 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:05:36.388 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:36 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:05:36.388 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:36 smithi179 ceph-mon[35716]: Adjusting osd_memory_target on smithi165 to 8544M 2024-09-19T07:05:36.388 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:36 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:36.389 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:36 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:36.389 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:36 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:05:36.389 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:36 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:36.477 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:36.467+0000 7ff19e7ed640 1 -- 172.21.15.179:0/2310496514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff198102e00 msgr2=0x7ff198103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:36.477 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:36.467+0000 7ff19e7ed640 1 --2- 172.21.15.179:0/2310496514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff198102e00 0x7ff198103280 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff18c009900 tx=0x7ff18c02a410 comp rx=0 tx=0).stop 2024-09-19T07:05:36.477 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:36.468+0000 7ff19e7ed640 1 -- 172.21.15.179:0/2310496514 shutdown_connections 2024-09-19T07:05:36.478 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:36.468+0000 7ff19e7ed640 1 --2- 172.21.15.179:0/2310496514 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1981037c0 0x7ff19810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:36.478 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:36.468+0000 7ff19e7ed640 1 --2- 172.21.15.179:0/2310496514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff198102e00 0x7ff198103280 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:36.478 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:36.468+0000 7ff19e7ed640 1 --2- 172.21.15.179:0/2310496514 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff198101c00 0x7ff198102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:36.478 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:36.468+0000 7ff19e7ed640 1 -- 172.21.15.179:0/2310496514 >> 172.21.15.179:0/2310496514 conn(0x7ff1980fd390 msgr2=0x7ff1980ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:05:36.478 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:36.468+0000 7ff19e7ed640 1 -- 172.21.15.179:0/2310496514 shutdown_connections 2024-09-19T07:05:36.478 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:36.468+0000 7ff19e7ed640 1 -- 172.21.15.179:0/2310496514 wait complete. 2024-09-19T07:05:36.478 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:36.468+0000 7ff19e7ed640 1 Processor -- start 2024-09-19T07:05:36.478 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:36.468+0000 7ff19e7ed640 1 -- start start 2024-09-19T07:05:36.478 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:36.469+0000 7ff19e7ed640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff198101c00 0x7ff198197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:36.478 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:36.469+0000 7ff19e7ed640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff198102e00 0x7ff198198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:36.478 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:36.469+0000 7ff19e7ed640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff1981037c0 0x7ff19819f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:36.479 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:36.469+0000 7ff19e7ed640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff19810d860 con 0x7ff198102e00 2024-09-19T07:05:36.479 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:36.469+0000 7ff19e7ed640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff19810d6e0 con 0x7ff1981037c0 2024-09-19T07:05:36.479 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:36.469+0000 7ff19e7ed640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff19810d9e0 con 0x7ff198101c00 2024-09-19T07:05:36.479 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:36.469+0000 7ff197fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff198101c00 0x7ff198197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:36.479 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:36.469+0000 7ff197fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff198101c00 0x7ff198197ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:44098/0 (socket says 172.21.15.179:44098) 2024-09-19T07:05:36.479 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:36.469+0000 7ff197fff640 1 -- 172.21.15.179:0/2915937417 learned_addr learned my addr 172.21.15.179:0/2915937417 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-09-19T07:05:36.479 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:36.469+0000 7ff1977fe640 1 --2- 172.21.15.179:0/2915937417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff198102e00 0x7ff198198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:36.479 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:36.469+0000 7ff19cd8a640 1 --2- 172.21.15.179:0/2915937417 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff1981037c0 0x7ff19819f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:36.479 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:36.469+0000 7ff197fff640 1 -- 172.21.15.179:0/2915937417 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff1981037c0 msgr2=0x7ff19819f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:36.479 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:36.469+0000 7ff197fff640 1 --2- 172.21.15.179:0/2915937417 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff1981037c0 0x7ff19819f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:36.479 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:36.469+0000 7ff197fff640 1 -- 172.21.15.179:0/2915937417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff198102e00 msgr2=0x7ff198198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:36.479 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:36.469+0000 7ff197fff640 1 --2- 172.21.15.179:0/2915937417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff198102e00 0x7ff198198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:36.480 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:36.469+0000 7ff197fff640 1 -- 172.21.15.179:0/2915937417 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff19819fb20 con 0x7ff198101c00 2024-09-19T07:05:36.480 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:36.469+0000 7ff1977fe640 1 --2- 172.21.15.179:0/2915937417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff198102e00 0x7ff198198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:05:36.480 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:36.469+0000 7ff197fff640 1 --2- 172.21.15.179:0/2915937417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff198101c00 0x7ff198197ef0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff18800c970 tx=0x7ff18800ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:05:36.480 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:36.469+0000 7ff1957fa640 1 -- 172.21.15.179:0/2915937417 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff188004220 con 0x7ff198101c00 2024-09-19T07:05:36.480 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:36.469+0000 7ff1957fa640 1 -- 172.21.15.179:0/2915937417 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1880043c0 con 0x7ff198101c00 2024-09-19T07:05:36.480 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:36.469+0000 7ff19e7ed640 1 -- 172.21.15.179:0/2915937417 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff19819fe10 con 0x7ff198101c00 2024-09-19T07:05:36.480 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:36.469+0000 7ff1957fa640 1 -- 172.21.15.179:0/2915937417 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff18800f450 con 0x7ff198101c00 2024-09-19T07:05:36.480 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:36.469+0000 7ff19e7ed640 1 -- 172.21.15.179:0/2915937417 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1981a0260 con 0x7ff198101c00 2024-09-19T07:05:36.480 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:36.470+0000 7ff19e7ed640 1 -- 172.21.15.179:0/2915937417 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff198108ff0 con 0x7ff198101c00 2024-09-19T07:05:36.480 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:36.471+0000 7ff1957fa640 1 -- 172.21.15.179:0/2915937417 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7ff1880079b0 con 0x7ff198101c00 2024-09-19T07:05:36.480 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:36.472+0000 7ff1957fa640 1 --2- 172.21.15.179:0/2915937417 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff1800a3270 0x7ff1800a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:36.480 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:36.472+0000 7ff1957fa640 1 -- 172.21.15.179:0/2915937417 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 3805+0+0 (secure 0 0 0) 0x7ff1880ce560 con 0x7ff198101c00 2024-09-19T07:05:36.481 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:36.472+0000 7ff1977fe640 1 --2- 172.21.15.179:0/2915937417 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff1800a3270 0x7ff1800a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:36.481 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:36.473+0000 7ff1977fe640 1 --2- 172.21.15.179:0/2915937417 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff1800a3270 0x7ff1800a5730 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff18c000c00 tx=0x7ff18c0315d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:05:36.481 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:36.476+0000 7ff1957fa640 1 -- 172.21.15.179:0/2915937417 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff188014030 con 0x7ff198101c00 2024-09-19T07:05:36.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:36 smithi148 ceph-mon[31180]: from='osd.4 [v2:172.21.15.165:6808/3082550323,v1:172.21.15.165:6809/3082550323]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T07:05:36.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:36 smithi148 ceph-mon[31180]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T07:05:36.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:36 smithi148 ceph-mon[31180]: Detected new or changed devices on smithi165 2024-09-19T07:05:36.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:36 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:36.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:36 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:36.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:36 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:05:36.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:36 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:05:36.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:36 smithi148 ceph-mon[31180]: Adjusting osd_memory_target on smithi165 to 8544M 2024-09-19T07:05:36.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:36 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:36.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:36 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:36.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:36 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:05:36.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:36 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:36.652 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:36.651+0000 7ff19e7ed640 1 -- 172.21.15.179:0/2915937417 --> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7ff198062630 con 0x7ff1800a3270 2024-09-19T07:05:37.372 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:37 smithi179 ceph-mon[35716]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T07:05:37.372 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:37 smithi179 ceph-mon[35716]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T07:05:37.372 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:37 smithi179 ceph-mon[35716]: from='osd.4 [v2:172.21.15.165:6808/3082550323,v1:172.21.15.165:6809/3082550323]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-19T07:05:37.372 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:37 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:05:37.372 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:37 smithi179 ceph-mon[35716]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-19T07:05:37.372 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:37 smithi179 ceph-mon[35716]: from='client.24223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:05:37.372 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:37 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:05:37.372 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:37 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:05:37.372 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:37 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:37.372 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:37 smithi179 ceph-mon[35716]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:05:37.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:37 smithi165 ceph-mon[35326]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T07:05:37.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:37 smithi165 ceph-mon[35326]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T07:05:37.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:37 smithi165 ceph-mon[35326]: from='osd.4 [v2:172.21.15.165:6808/3082550323,v1:172.21.15.165:6809/3082550323]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-19T07:05:37.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:37 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:05:37.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:37 smithi165 ceph-mon[35326]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-19T07:05:37.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:37 smithi165 ceph-mon[35326]: from='client.24223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:05:37.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:37 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:05:37.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:37 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:05:37.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:37 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:37.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:37 smithi165 ceph-mon[35326]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:05:37.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:37 smithi148 ceph-mon[31180]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T07:05:37.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:37 smithi148 ceph-mon[31180]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T07:05:37.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:37 smithi148 ceph-mon[31180]: from='osd.4 [v2:172.21.15.165:6808/3082550323,v1:172.21.15.165:6809/3082550323]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-19T07:05:37.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:37 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:05:37.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:37 smithi148 ceph-mon[31180]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-19T07:05:37.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:37 smithi148 ceph-mon[31180]: from='client.24223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:05:37.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:37 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:05:37.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:37 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:05:37.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:37 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:37.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:37 smithi148 ceph-mon[31180]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:05:38.384 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 19 07:05:37 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-4[46511]: 2024-09-19T07:05:37.927+0000 7f000e462640 -1 osd.4 0 waiting for initial osdmap 2024-09-19T07:05:38.384 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 19 07:05:37 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-4[46511]: 2024-09-19T07:05:37.935+0000 7f0005a5d640 -1 osd.4 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T07:05:38.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:38 smithi165 ceph-mon[35326]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]': finished 2024-09-19T07:05:38.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:38 smithi165 ceph-mon[35326]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T07:05:38.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:38 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:05:38.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:38 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:05:38.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:38 smithi165 ceph-mon[35326]: from='osd.4 ' entity='osd.4' 2024-09-19T07:05:38.420 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:38 smithi179 ceph-mon[35716]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]': finished 2024-09-19T07:05:38.420 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:38 smithi179 ceph-mon[35716]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T07:05:38.421 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:38 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:05:38.421 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:38 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:05:38.421 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:38 smithi179 ceph-mon[35716]: from='osd.4 ' entity='osd.4' 2024-09-19T07:05:38.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:38 smithi148 ceph-mon[31180]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]': finished 2024-09-19T07:05:38.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:38 smithi148 ceph-mon[31180]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T07:05:38.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:38 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:05:38.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:38 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:05:38.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:38 smithi148 ceph-mon[31180]: from='osd.4 ' entity='osd.4' 2024-09-19T07:05:39.456 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:39 smithi179 ceph-mon[35716]: purged_snaps scrub starts 2024-09-19T07:05:39.456 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:39 smithi179 ceph-mon[35716]: purged_snaps scrub ok 2024-09-19T07:05:39.456 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:39 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:05:39.456 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:39 smithi179 ceph-mon[35716]: from='client.? 172.21.15.179:0/1950624681' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8295e69b-87fe-4403-bb2e-d9dd42e2f398"}]: dispatch 2024-09-19T07:05:39.456 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:39 smithi179 ceph-mon[35716]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8295e69b-87fe-4403-bb2e-d9dd42e2f398"}]: dispatch 2024-09-19T07:05:39.456 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:39 smithi179 ceph-mon[35716]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8295e69b-87fe-4403-bb2e-d9dd42e2f398"}]': finished 2024-09-19T07:05:39.456 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:39 smithi179 ceph-mon[35716]: osd.4 [v2:172.21.15.165:6808/3082550323,v1:172.21.15.165:6809/3082550323] boot 2024-09-19T07:05:39.457 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:39 smithi179 ceph-mon[35716]: osdmap e30: 6 total, 5 up, 6 in 2024-09-19T07:05:39.457 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:39 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:05:39.457 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:39 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:05:39.457 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:39 smithi179 ceph-mon[35716]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:05:39.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:39 smithi148 ceph-mon[31180]: purged_snaps scrub starts 2024-09-19T07:05:39.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:39 smithi148 ceph-mon[31180]: purged_snaps scrub ok 2024-09-19T07:05:39.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:39 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:05:39.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:39 smithi148 ceph-mon[31180]: from='client.? 172.21.15.179:0/1950624681' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8295e69b-87fe-4403-bb2e-d9dd42e2f398"}]: dispatch 2024-09-19T07:05:39.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:39 smithi148 ceph-mon[31180]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8295e69b-87fe-4403-bb2e-d9dd42e2f398"}]: dispatch 2024-09-19T07:05:39.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:39 smithi148 ceph-mon[31180]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8295e69b-87fe-4403-bb2e-d9dd42e2f398"}]': finished 2024-09-19T07:05:39.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:39 smithi148 ceph-mon[31180]: osd.4 [v2:172.21.15.165:6808/3082550323,v1:172.21.15.165:6809/3082550323] boot 2024-09-19T07:05:39.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:39 smithi148 ceph-mon[31180]: osdmap e30: 6 total, 5 up, 6 in 2024-09-19T07:05:39.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:39 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:05:39.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:39 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:05:39.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:39 smithi148 ceph-mon[31180]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:05:39.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:39 smithi165 ceph-mon[35326]: purged_snaps scrub starts 2024-09-19T07:05:39.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:39 smithi165 ceph-mon[35326]: purged_snaps scrub ok 2024-09-19T07:05:39.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:39 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:05:39.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:39 smithi165 ceph-mon[35326]: from='client.? 172.21.15.179:0/1950624681' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8295e69b-87fe-4403-bb2e-d9dd42e2f398"}]: dispatch 2024-09-19T07:05:39.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:39 smithi165 ceph-mon[35326]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8295e69b-87fe-4403-bb2e-d9dd42e2f398"}]: dispatch 2024-09-19T07:05:39.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:39 smithi165 ceph-mon[35326]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8295e69b-87fe-4403-bb2e-d9dd42e2f398"}]': finished 2024-09-19T07:05:39.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:39 smithi165 ceph-mon[35326]: osd.4 [v2:172.21.15.165:6808/3082550323,v1:172.21.15.165:6809/3082550323] boot 2024-09-19T07:05:39.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:39 smithi165 ceph-mon[35326]: osdmap e30: 6 total, 5 up, 6 in 2024-09-19T07:05:39.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:39 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:05:39.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:39 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:05:39.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:39 smithi165 ceph-mon[35326]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:05:40.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:40 smithi179 ceph-mon[35716]: from='client.? 172.21.15.179:0/3644791633' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:05:40.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:40 smithi148 ceph-mon[31180]: from='client.? 172.21.15.179:0/3644791633' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:05:40.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:40 smithi165 ceph-mon[35326]: from='client.? 172.21.15.179:0/3644791633' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:05:41.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:41 smithi179 ceph-mon[35716]: osdmap e31: 6 total, 5 up, 6 in 2024-09-19T07:05:41.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:41 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:05:41.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:41 smithi179 ceph-mon[35716]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:05:41.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:41 smithi148 ceph-mon[31180]: osdmap e31: 6 total, 5 up, 6 in 2024-09-19T07:05:41.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:41 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:05:41.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:41 smithi148 ceph-mon[31180]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:05:41.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:41 smithi165 ceph-mon[35326]: osdmap e31: 6 total, 5 up, 6 in 2024-09-19T07:05:41.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:41 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:05:41.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:41 smithi165 ceph-mon[35326]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:05:44.177 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:44 smithi179 ceph-mon[35716]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:05:44.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:44 smithi165 ceph-mon[35326]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:05:44.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:44 smithi148 ceph-mon[31180]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:05:46.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:46 smithi165 ceph-mon[35326]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:05:46.499 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:46 smithi179 ceph-mon[35716]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:05:46.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:46 smithi148 ceph-mon[31180]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:05:47.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:47 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T07:05:47.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:47 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:47.427 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:47 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T07:05:47.428 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:47 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:47.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:47 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T07:05:47.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:47 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:48.374 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:48 smithi179 ceph-mon[35716]: Deploying daemon osd.5 on smithi179 2024-09-19T07:05:48.374 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:48 smithi179 ceph-mon[35716]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:05:48.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:48 smithi165 ceph-mon[35326]: Deploying daemon osd.5 on smithi179 2024-09-19T07:05:48.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:48 smithi165 ceph-mon[35326]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:05:48.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:48 smithi148 ceph-mon[31180]: Deploying daemon osd.5 on smithi179 2024-09-19T07:05:48.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:48 smithi148 ceph-mon[31180]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:05:50.167 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:50 smithi179 ceph-mon[35716]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:05:50.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:50 smithi165 ceph-mon[35326]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:05:50.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:50 smithi148 ceph-mon[31180]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:05:52.374 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:52 smithi179 ceph-mon[35716]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:05:52.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:52 smithi165 ceph-mon[35326]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:05:52.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:52 smithi148 ceph-mon[31180]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:05:53.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:53 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:05:53.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:53 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:53.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:53 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:53.419 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:53 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:05:53.419 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:53 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:53.419 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:53 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:53.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:53 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:05:53.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:53 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:53.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:53 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:54.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:54 smithi165 ceph-mon[35326]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:05:54.391 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:54 smithi148 ceph-mon[31180]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:05:54.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:54 smithi179 ceph-mon[35716]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:05:56.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:56 smithi165 ceph-mon[35326]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:05:56.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:56 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:56.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:56 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:56.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:56 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:56.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:56 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:05:56.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:56 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:56.395 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:56 smithi179 ceph-mon[35716]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:05:56.395 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:56 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:56.395 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:56 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:56.395 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:56 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:56.395 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:56 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:05:56.395 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:56 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:56.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:56 smithi148 ceph-mon[31180]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:05:56.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:56 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:56.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:56 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:56.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:56 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:56.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:56 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:05:56.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:56 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:56.746 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:56.744+0000 7ff1957fa640 1 -- 172.21.15.179:0/2915937417 <== mgr.14148 v2:172.21.15.148:6800/3007822654 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff198062630 con 0x7ff1800a3270 2024-09-19T07:05:56.746 INFO:teuthology.orchestra.run.smithi179.stdout:Created osd(s) 5 on host 'smithi179' 2024-09-19T07:05:56.747 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:56.746+0000 7ff19e7ed640 1 -- 172.21.15.179:0/2915937417 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff1800a3270 msgr2=0x7ff1800a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:56.747 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:56.746+0000 7ff19e7ed640 1 --2- 172.21.15.179:0/2915937417 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff1800a3270 0x7ff1800a5730 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff18c000c00 tx=0x7ff18c0315d0 comp rx=0 tx=0).stop 2024-09-19T07:05:56.747 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:56.746+0000 7ff19e7ed640 1 -- 172.21.15.179:0/2915937417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff198101c00 msgr2=0x7ff198197ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:56.747 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:56.746+0000 7ff19e7ed640 1 --2- 172.21.15.179:0/2915937417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff198101c00 0x7ff198197ef0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff18800c970 tx=0x7ff18800ce30 comp rx=0 tx=0).stop 2024-09-19T07:05:56.747 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:56.746+0000 7ff19e7ed640 1 -- 172.21.15.179:0/2915937417 shutdown_connections 2024-09-19T07:05:56.747 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:56.746+0000 7ff19e7ed640 1 --2- 172.21.15.179:0/2915937417 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff1800a3270 0x7ff1800a5730 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:56.747 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:56.746+0000 7ff19e7ed640 1 --2- 172.21.15.179:0/2915937417 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff1981037c0 0x7ff19819f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:56.748 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:56.746+0000 7ff19e7ed640 1 --2- 172.21.15.179:0/2915937417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff198102e00 0x7ff198198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:56.748 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:56.746+0000 7ff19e7ed640 1 --2- 172.21.15.179:0/2915937417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff198101c00 0x7ff198197ef0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:56.748 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:56.746+0000 7ff19e7ed640 1 -- 172.21.15.179:0/2915937417 >> 172.21.15.179:0/2915937417 conn(0x7ff1980fd390 msgr2=0x7ff1981061c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:05:56.748 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:56.746+0000 7ff19e7ed640 1 -- 172.21.15.179:0/2915937417 shutdown_connections 2024-09-19T07:05:56.748 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:05:56.746+0000 7ff19e7ed640 1 -- 172.21.15.179:0/2915937417 wait complete. 2024-09-19T07:05:57.368 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:57 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:05:57.368 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:57 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:57.368 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:57 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:57.368 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:05:57 smithi179 ceph-mon[35716]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:05:57.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:57 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:05:57.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:57 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:57.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:57 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:57.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:05:57 smithi165 ceph-mon[35326]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:05:57.395 DEBUG:teuthology.orchestra.run.smithi179:osd.5> sudo journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@osd.5.service 2024-09-19T07:05:57.398 INFO:tasks.cephadm:Deploying osd.6 on smithi148 with /dev/vg_nvme/lv_2... 2024-09-19T07:05:57.398 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T07:05:57.426 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:57 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:05:57.427 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:57 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:57.427 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:57 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:05:57.427 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:05:57 smithi148 ceph-mon[31180]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:05:57.658 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:05:59.773 INFO:journalctl@ceph.osd.5.smithi179.stdout:Sep 19 07:05:59 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-5[47352]: 2024-09-19T07:05:59.288+0000 7f809f1ae640 -1 osd.5 0 log_to_monitors true 2024-09-19T07:06:00.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:00 smithi179 ceph-mon[35716]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:06:00.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:00 smithi179 ceph-mon[35716]: from='osd.5 [v2:172.21.15.179:6808/2125213751,v1:172.21.15.179:6809/2125213751]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T07:06:00.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:00 smithi179 ceph-mon[35716]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T07:06:00.304 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:06:00.329 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi148:vg_nvme/lv_2 2024-09-19T07:06:00.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:00 smithi165 ceph-mon[35326]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:06:00.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:00 smithi165 ceph-mon[35326]: from='osd.5 [v2:172.21.15.179:6808/2125213751,v1:172.21.15.179:6809/2125213751]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T07:06:00.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:00 smithi165 ceph-mon[35326]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T07:06:00.392 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:00 smithi148 ceph-mon[31180]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:06:00.392 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:00 smithi148 ceph-mon[31180]: from='osd.5 [v2:172.21.15.179:6808/2125213751,v1:172.21.15.179:6809/2125213751]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T07:06:00.392 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:00 smithi148 ceph-mon[31180]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T07:06:00.612 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:06:01.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:01.069+0000 7f956eba1640 1 -- 172.21.15.148:0/3012975383 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9568101600 msgr2=0x7f9568108ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:01.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:01.069+0000 7f956eba1640 1 --2- 172.21.15.148:0/3012975383 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9568101600 0x7f9568108ea0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9560009ca0 tx=0x7f956002a8c0 comp rx=0 tx=0).stop 2024-09-19T07:06:01.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:01.069+0000 7f956eba1640 1 -- 172.21.15.148:0/3012975383 shutdown_connections 2024-09-19T07:06:01.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:01.069+0000 7f956eba1640 1 --2- 172.21.15.148:0/3012975383 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9568101600 0x7f9568108ea0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:01.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:01.069+0000 7f956eba1640 1 --2- 172.21.15.148:0/3012975383 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9568100c40 0x7f95681010c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:01.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:01.069+0000 7f956eba1640 1 --2- 172.21.15.148:0/3012975383 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9568101f00 0x7f9568102300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:01.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:01.069+0000 7f956eba1640 1 -- 172.21.15.148:0/3012975383 >> 172.21.15.148:0/3012975383 conn(0x7f95680fb8a0 msgr2=0x7f95680fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:01.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:01.069+0000 7f956eba1640 1 -- 172.21.15.148:0/3012975383 shutdown_connections 2024-09-19T07:06:01.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:01.069+0000 7f956eba1640 1 -- 172.21.15.148:0/3012975383 wait complete. 2024-09-19T07:06:01.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:01.070+0000 7f956eba1640 1 Processor -- start 2024-09-19T07:06:01.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:01.070+0000 7f956eba1640 1 -- start start 2024-09-19T07:06:01.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:01.070+0000 7f956eba1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9568100c40 0x7f9568197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:01.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:01.070+0000 7f956eba1640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9568101600 0x7f9568198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:01.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:01.070+0000 7f956eba1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9568101f00 0x7f956819f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:01.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:01.070+0000 7f956eba1640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f956810d790 con 0x7f9568100c40 2024-09-19T07:06:01.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:01.070+0000 7f956eba1640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f956810d610 con 0x7f9568101600 2024-09-19T07:06:01.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:01.070+0000 7f956eba1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f956810d910 con 0x7f9568101f00 2024-09-19T07:06:01.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:01.070+0000 7f956db9f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9568100c40 0x7f9568197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:01.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:01.070+0000 7f956db9f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9568100c40 0x7f9568197dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:41750/0 (socket says 172.21.15.148:41750) 2024-09-19T07:06:01.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:01.070+0000 7f956db9f640 1 -- 172.21.15.148:0/3277506724 learned_addr learned my addr 172.21.15.148:0/3277506724 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:06:01.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:01.070+0000 7f956e3a0640 1 --2- 172.21.15.148:0/3277506724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9568101f00 0x7f956819f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:01.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:01.070+0000 7f956d39e640 1 --2- 172.21.15.148:0/3277506724 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9568101600 0x7f9568198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:01.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:01.070+0000 7f956db9f640 1 -- 172.21.15.148:0/3277506724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9568101f00 msgr2=0x7f956819f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:01.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:01.070+0000 7f956db9f640 1 --2- 172.21.15.148:0/3277506724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9568101f00 0x7f956819f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:01.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:01.070+0000 7f956db9f640 1 -- 172.21.15.148:0/3277506724 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9568101600 msgr2=0x7f9568198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:01.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:01.070+0000 7f956db9f640 1 --2- 172.21.15.148:0/3277506724 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9568101600 0x7f9568198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:01.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:01.070+0000 7f956db9f640 1 -- 172.21.15.148:0/3277506724 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f956819f9f0 con 0x7f9568100c40 2024-09-19T07:06:01.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:01.070+0000 7f956d39e640 1 --2- 172.21.15.148:0/3277506724 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9568101600 0x7f9568198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:06:01.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:01.070+0000 7f956e3a0640 1 --2- 172.21.15.148:0/3277506724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9568101f00 0x7f956819f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:06:01.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:01.071+0000 7f956db9f640 1 --2- 172.21.15.148:0/3277506724 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9568100c40 0x7f9568197dc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f955c00b450 tx=0x7f955c00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:01.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:01.071+0000 7f955affd640 1 -- 172.21.15.148:0/3277506724 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f955c015020 con 0x7f9568100c40 2024-09-19T07:06:01.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:01.071+0000 7f955affd640 1 -- 172.21.15.148:0/3277506724 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f955c011d70 con 0x7f9568100c40 2024-09-19T07:06:01.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:01.071+0000 7f956eba1640 1 -- 172.21.15.148:0/3277506724 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f956819fce0 con 0x7f9568100c40 2024-09-19T07:06:01.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:01.071+0000 7f955affd640 1 -- 172.21.15.148:0/3277506724 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f955c00f340 con 0x7f9568100c40 2024-09-19T07:06:01.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:01.071+0000 7f956eba1640 1 -- 172.21.15.148:0/3277506724 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95681a0170 con 0x7f9568100c40 2024-09-19T07:06:01.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:01.072+0000 7f956eba1640 1 -- 172.21.15.148:0/3277506724 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9568107e50 con 0x7f9568100c40 2024-09-19T07:06:01.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:01.074+0000 7f955affd640 1 -- 172.21.15.148:0/3277506724 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f955c018020 con 0x7f9568100c40 2024-09-19T07:06:01.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:01.075+0000 7f955affd640 1 --2- 172.21.15.148:0/3277506724 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f95540a3270 0x7f95540a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:01.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:01.075+0000 7f956d39e640 1 --2- 172.21.15.148:0/3277506724 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f95540a3270 0x7f95540a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:01.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:01.075+0000 7f955affd640 1 -- 172.21.15.148:0/3277506724 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4237+0+0 (secure 0 0 0) 0x7f955c0ce9b0 con 0x7f9568100c40 2024-09-19T07:06:01.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:01.075+0000 7f956d39e640 1 --2- 172.21.15.148:0/3277506724 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f95540a3270 0x7f95540a5730 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f95681992e0 tx=0x7f9564005d30 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:01.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:01.078+0000 7f955affd640 1 -- 172.21.15.148:0/3277506724 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f955c01f020 con 0x7f9568100c40 2024-09-19T07:06:01.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:01.265+0000 7f956eba1640 1 -- 172.21.15.148:0/3277506724 --> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f9568062630 con 0x7f95540a3270 2024-09-19T07:06:01.267 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:01 smithi148 ceph-mon[31180]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T07:06:01.267 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:01 smithi148 ceph-mon[31180]: osdmap e32: 6 total, 5 up, 6 in 2024-09-19T07:06:01.267 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:01 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:06:01.267 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:01 smithi148 ceph-mon[31180]: from='osd.5 [v2:172.21.15.179:6808/2125213751,v1:172.21.15.179:6809/2125213751]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-19T07:06:01.267 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:01 smithi148 ceph-mon[31180]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-19T07:06:01.267 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:01 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:01.267 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:01 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:01.267 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:01 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:06:01.267 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:01 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:06:01.268 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:01 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:01.268 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:01 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:01.268 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:01 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:06:01.268 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:01 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:01.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:01 smithi165 ceph-mon[35326]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T07:06:01.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:01 smithi165 ceph-mon[35326]: osdmap e32: 6 total, 5 up, 6 in 2024-09-19T07:06:01.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:01 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:06:01.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:01 smithi165 ceph-mon[35326]: from='osd.5 [v2:172.21.15.179:6808/2125213751,v1:172.21.15.179:6809/2125213751]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-19T07:06:01.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:01 smithi165 ceph-mon[35326]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-19T07:06:01.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:01 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:01.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:01 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:01.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:01 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:06:01.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:01 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:06:01.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:01 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:01.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:01 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:01.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:01 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:06:01.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:01 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:01.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:01 smithi179 ceph-mon[35716]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T07:06:01.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:01 smithi179 ceph-mon[35716]: osdmap e32: 6 total, 5 up, 6 in 2024-09-19T07:06:01.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:01 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:06:01.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:01 smithi179 ceph-mon[35716]: from='osd.5 [v2:172.21.15.179:6808/2125213751,v1:172.21.15.179:6809/2125213751]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-19T07:06:01.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:01 smithi179 ceph-mon[35716]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-19T07:06:01.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:01 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:01.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:01 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:01.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:01 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:06:01.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:01 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:06:01.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:01 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:01.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:01 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:01.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:01 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:06:01.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:01 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:02.272 INFO:journalctl@ceph.osd.5.smithi179.stdout:Sep 19 07:06:01 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-5[47352]: 2024-09-19T07:06:01.892+0000 7f809a90e640 -1 osd.5 0 waiting for initial osdmap 2024-09-19T07:06:02.272 INFO:journalctl@ceph.osd.5.smithi179.stdout:Sep 19 07:06:01 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-5[47352]: 2024-09-19T07:06:01.901+0000 7f8092f40640 -1 osd.5 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T07:06:02.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:02 smithi179 ceph-mon[35716]: Detected new or changed devices on smithi179 2024-09-19T07:06:02.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:02 smithi179 ceph-mon[35716]: Adjusting osd_memory_target on smithi179 to 8544M 2024-09-19T07:06:02.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:02 smithi179 ceph-mon[35716]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:06:02.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:02 smithi179 ceph-mon[35716]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-09-19T07:06:02.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:02 smithi179 ceph-mon[35716]: osdmap e33: 6 total, 5 up, 6 in 2024-09-19T07:06:02.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:02 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:06:02.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:02 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:06:02.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:02 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:06:02.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:02 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:06:02.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:02 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:02.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:02 smithi179 ceph-mon[35716]: from='osd.5 ' entity='osd.5' 2024-09-19T07:06:02.274 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:02 smithi179 ceph-mon[35716]: osd.5 [v2:172.21.15.179:6808/2125213751,v1:172.21.15.179:6809/2125213751] boot 2024-09-19T07:06:02.274 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:02 smithi179 ceph-mon[35716]: osdmap e34: 6 total, 6 up, 6 in 2024-09-19T07:06:02.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:02 smithi165 ceph-mon[35326]: Detected new or changed devices on smithi179 2024-09-19T07:06:02.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:02 smithi165 ceph-mon[35326]: Adjusting osd_memory_target on smithi179 to 8544M 2024-09-19T07:06:02.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:02 smithi165 ceph-mon[35326]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:06:02.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:02 smithi165 ceph-mon[35326]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-09-19T07:06:02.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:02 smithi165 ceph-mon[35326]: osdmap e33: 6 total, 5 up, 6 in 2024-09-19T07:06:02.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:02 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:06:02.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:02 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:06:02.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:02 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:06:02.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:02 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:06:02.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:02 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:02.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:02 smithi165 ceph-mon[35326]: from='osd.5 ' entity='osd.5' 2024-09-19T07:06:02.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:02 smithi165 ceph-mon[35326]: osd.5 [v2:172.21.15.179:6808/2125213751,v1:172.21.15.179:6809/2125213751] boot 2024-09-19T07:06:02.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:02 smithi165 ceph-mon[35326]: osdmap e34: 6 total, 6 up, 6 in 2024-09-19T07:06:02.540 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:02 smithi148 ceph-mon[31180]: Detected new or changed devices on smithi179 2024-09-19T07:06:02.540 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:02 smithi148 ceph-mon[31180]: Adjusting osd_memory_target on smithi179 to 8544M 2024-09-19T07:06:02.540 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:02 smithi148 ceph-mon[31180]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:06:02.540 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:02 smithi148 ceph-mon[31180]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-09-19T07:06:02.540 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:02 smithi148 ceph-mon[31180]: osdmap e33: 6 total, 5 up, 6 in 2024-09-19T07:06:02.540 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:02 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:06:02.540 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:02 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:06:02.540 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:02 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:06:02.540 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:02 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:06:02.540 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:02 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:02.540 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:02 smithi148 ceph-mon[31180]: from='osd.5 ' entity='osd.5' 2024-09-19T07:06:02.541 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:02 smithi148 ceph-mon[31180]: osd.5 [v2:172.21.15.179:6808/2125213751,v1:172.21.15.179:6809/2125213751] boot 2024-09-19T07:06:02.541 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:02 smithi148 ceph-mon[31180]: osdmap e34: 6 total, 6 up, 6 in 2024-09-19T07:06:03.376 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:03 smithi148 ceph-mon[31180]: purged_snaps scrub starts 2024-09-19T07:06:03.376 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:03 smithi148 ceph-mon[31180]: purged_snaps scrub ok 2024-09-19T07:06:03.376 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:03 smithi148 ceph-mon[31180]: from='client.14355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:06:03.377 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:03 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:06:03.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:03 smithi165 ceph-mon[35326]: purged_snaps scrub starts 2024-09-19T07:06:03.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:03 smithi165 ceph-mon[35326]: purged_snaps scrub ok 2024-09-19T07:06:03.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:03 smithi165 ceph-mon[35326]: from='client.14355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:06:03.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:03 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:06:03.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:03 smithi179 ceph-mon[35716]: purged_snaps scrub starts 2024-09-19T07:06:03.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:03 smithi179 ceph-mon[35716]: purged_snaps scrub ok 2024-09-19T07:06:03.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:03 smithi179 ceph-mon[35716]: from='client.14355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:06:03.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:03 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:06:04.255 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:04 smithi148 ceph-mon[31180]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 462 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:06:04.255 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:04 smithi148 ceph-mon[31180]: osdmap e35: 6 total, 6 up, 6 in 2024-09-19T07:06:04.255 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:04 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/943756378' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4ce38d1a-06d3-4606-b00d-aa1ff977025f"}]: dispatch 2024-09-19T07:06:04.255 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:04 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/943756378' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4ce38d1a-06d3-4606-b00d-aa1ff977025f"}]': finished 2024-09-19T07:06:04.255 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:04 smithi148 ceph-mon[31180]: osdmap e36: 7 total, 6 up, 7 in 2024-09-19T07:06:04.255 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:04 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:06:04.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:04 smithi165 ceph-mon[35326]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 462 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:06:04.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:04 smithi165 ceph-mon[35326]: osdmap e35: 6 total, 6 up, 6 in 2024-09-19T07:06:04.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:04 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/943756378' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4ce38d1a-06d3-4606-b00d-aa1ff977025f"}]: dispatch 2024-09-19T07:06:04.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:04 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/943756378' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4ce38d1a-06d3-4606-b00d-aa1ff977025f"}]': finished 2024-09-19T07:06:04.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:04 smithi165 ceph-mon[35326]: osdmap e36: 7 total, 6 up, 7 in 2024-09-19T07:06:04.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:04 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:06:04.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:04 smithi179 ceph-mon[35716]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 462 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:06:04.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:04 smithi179 ceph-mon[35716]: osdmap e35: 6 total, 6 up, 6 in 2024-09-19T07:06:04.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:04 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/943756378' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4ce38d1a-06d3-4606-b00d-aa1ff977025f"}]: dispatch 2024-09-19T07:06:04.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:04 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/943756378' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4ce38d1a-06d3-4606-b00d-aa1ff977025f"}]': finished 2024-09-19T07:06:04.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:04 smithi179 ceph-mon[35716]: osdmap e36: 7 total, 6 up, 7 in 2024-09-19T07:06:04.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:04 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:06:05.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:05 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/2834451607' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:06:05.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:05 smithi165 ceph-mon[35326]: osdmap e37: 7 total, 6 up, 7 in 2024-09-19T07:06:05.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:05 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:06:05.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:05 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/2834451607' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:06:05.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:05 smithi179 ceph-mon[35716]: osdmap e37: 7 total, 6 up, 7 in 2024-09-19T07:06:05.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:05 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:06:05.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:05 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/2834451607' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:06:05.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:05 smithi148 ceph-mon[31180]: osdmap e37: 7 total, 6 up, 7 in 2024-09-19T07:06:05.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:05 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:06:06.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:06 smithi165 ceph-mon[35326]: pgmap v131: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 462 MiB used, 536 GiB / 536 GiB avail; 146 KiB/s, 0 objects/s recovering 2024-09-19T07:06:06.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:06 smithi165 ceph-mon[35326]: osdmap e38: 7 total, 6 up, 7 in 2024-09-19T07:06:06.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:06 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:06:06.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:06 smithi179 ceph-mon[35716]: pgmap v131: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 462 MiB used, 536 GiB / 536 GiB avail; 146 KiB/s, 0 objects/s recovering 2024-09-19T07:06:06.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:06 smithi179 ceph-mon[35716]: osdmap e38: 7 total, 6 up, 7 in 2024-09-19T07:06:06.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:06 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:06:06.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:06 smithi148 ceph-mon[31180]: pgmap v131: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 462 MiB used, 536 GiB / 536 GiB avail; 146 KiB/s, 0 objects/s recovering 2024-09-19T07:06:06.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:06 smithi148 ceph-mon[31180]: osdmap e38: 7 total, 6 up, 7 in 2024-09-19T07:06:06.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:06 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:06:07.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:07 smithi165 ceph-mon[35326]: pgmap v133: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 462 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T07:06:07.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:07 smithi179 ceph-mon[35716]: pgmap v133: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 462 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T07:06:07.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:07 smithi148 ceph-mon[31180]: pgmap v133: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 462 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T07:06:10.154 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:10 smithi148 ceph-mon[31180]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-19T07:06:10.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:10 smithi165 ceph-mon[35326]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-19T07:06:10.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:10 smithi179 ceph-mon[35716]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-19T07:06:12.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:12 smithi148 ceph-mon[31180]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-19T07:06:12.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:12 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T07:06:12.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:12 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:12.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:12 smithi165 ceph-mon[35326]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-19T07:06:12.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:12 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T07:06:12.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:12 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:12.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:12 smithi179 ceph-mon[35716]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-19T07:06:12.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:12 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T07:06:12.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:12 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:13.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:13 smithi165 ceph-mon[35326]: Deploying daemon osd.6 on smithi148 2024-09-19T07:06:13.407 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:13 smithi148 ceph-mon[31180]: Deploying daemon osd.6 on smithi148 2024-09-19T07:06:13.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:13 smithi179 ceph-mon[35716]: Deploying daemon osd.6 on smithi148 2024-09-19T07:06:14.369 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:14 smithi148 ceph-mon[31180]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:06:14.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:14 smithi165 ceph-mon[35326]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:06:14.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:14 smithi179 ceph-mon[35716]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:06:16.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:16 smithi165 ceph-mon[35326]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:06:16.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:16 smithi179 ceph-mon[35716]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:06:16.562 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:16 smithi148 ceph-mon[31180]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:06:18.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:18 smithi165 ceph-mon[35326]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:06:18.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:18 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:06:18.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:18 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:18.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:18 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:18.440 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:18 smithi148 ceph-mon[31180]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:06:18.440 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:18 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:06:18.440 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:18 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:18.440 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:18 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:18.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:18 smithi179 ceph-mon[35716]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:06:18.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:18 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:06:18.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:18 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:18.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:18 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:20.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:20 smithi165 ceph-mon[35326]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:06:20.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:20 smithi179 ceph-mon[35716]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:06:20.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:20 smithi148 ceph-mon[31180]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:06:21.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:21.284+0000 7f955affd640 1 -- 172.21.15.148:0/3277506724 <== mgr.14148 v2:172.21.15.148:6800/3007822654 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9568062630 con 0x7f95540a3270 2024-09-19T07:06:21.285 INFO:teuthology.orchestra.run.smithi148.stdout:Created osd(s) 6 on host 'smithi148' 2024-09-19T07:06:21.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:21.286+0000 7f956eba1640 1 -- 172.21.15.148:0/3277506724 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f95540a3270 msgr2=0x7f95540a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:21.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:21.286+0000 7f956eba1640 1 --2- 172.21.15.148:0/3277506724 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f95540a3270 0x7f95540a5730 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f95681992e0 tx=0x7f9564005d30 comp rx=0 tx=0).stop 2024-09-19T07:06:21.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:21.286+0000 7f956eba1640 1 -- 172.21.15.148:0/3277506724 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9568100c40 msgr2=0x7f9568197dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:21.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:21.286+0000 7f956eba1640 1 --2- 172.21.15.148:0/3277506724 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9568100c40 0x7f9568197dc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f955c00b450 tx=0x7f955c00b910 comp rx=0 tx=0).stop 2024-09-19T07:06:21.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:21.287+0000 7f956eba1640 1 -- 172.21.15.148:0/3277506724 shutdown_connections 2024-09-19T07:06:21.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:21.287+0000 7f956eba1640 1 --2- 172.21.15.148:0/3277506724 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f95540a3270 0x7f95540a5730 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:21.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:21.287+0000 7f956eba1640 1 --2- 172.21.15.148:0/3277506724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9568101f00 0x7f956819f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:21.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:21.287+0000 7f956eba1640 1 --2- 172.21.15.148:0/3277506724 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9568101600 0x7f9568198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:21.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:21.287+0000 7f956eba1640 1 --2- 172.21.15.148:0/3277506724 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9568100c40 0x7f9568197dc0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:21.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:21.287+0000 7f956eba1640 1 -- 172.21.15.148:0/3277506724 >> 172.21.15.148:0/3277506724 conn(0x7f95680fb8a0 msgr2=0x7f9568105020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:21.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:21.287+0000 7f956eba1640 1 -- 172.21.15.148:0/3277506724 shutdown_connections 2024-09-19T07:06:21.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:06:21.287+0000 7f956eba1640 1 -- 172.21.15.148:0/3277506724 wait complete. 2024-09-19T07:06:21.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:21 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:21.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:21 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:21.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:21 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:21.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:21 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:06:21.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:21 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:21.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:21 smithi179 ceph-mon[35716]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:06:21.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:21 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:21.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:21 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:21.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:21 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:21.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:21 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:06:21.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:21 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:21.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:21 smithi148 ceph-mon[31180]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:06:21.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:21 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:21.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:21 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:21.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:21 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:21.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:21 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:06:21.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:21 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:21.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:21 smithi165 ceph-mon[35326]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:06:21.902 DEBUG:teuthology.orchestra.run.smithi148:osd.6> sudo journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@osd.6.service 2024-09-19T07:06:21.945 INFO:tasks.cephadm:Deploying osd.7 on smithi165 with /dev/vg_nvme/lv_2... 2024-09-19T07:06:21.945 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T07:06:22.205 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T07:06:22.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:22 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:06:22.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:22 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:22.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:22 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:22.569 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:22 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:06:22.569 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:22 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:22.569 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:22 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:22.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:22 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:06:22.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:22 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:22.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:22 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:23.313 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:23 smithi148 ceph-mon[31180]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:06:23.468 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:23 smithi165 ceph-mon[35326]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:06:23.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:23 smithi179 ceph-mon[35716]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:06:24.263 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:06:24 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:06:24.096+0000 7f269ac09640 -1 osd.6 0 log_to_monitors true 2024-09-19T07:06:24.481 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-19T07:06:24.507 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi165:vg_nvme/lv_2 2024-09-19T07:06:24.517 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:24 smithi165 ceph-mon[35326]: from='osd.6 [v2:172.21.15.148:6818/2178980310,v1:172.21.15.148:6819/2178980310]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T07:06:24.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:24 smithi179 ceph-mon[35716]: from='osd.6 [v2:172.21.15.148:6818/2178980310,v1:172.21.15.148:6819/2178980310]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T07:06:24.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:24 smithi148 ceph-mon[31180]: from='osd.6 [v2:172.21.15.148:6818/2178980310,v1:172.21.15.148:6819/2178980310]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T07:06:24.772 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T07:06:25.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:25.198+0000 7f0dd334d640 1 -- 172.21.15.165:0/1098937007 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0dcc100ad0 msgr2=0x7f0dcc100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:25.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:25.198+0000 7f0dd334d640 1 --2- 172.21.15.165:0/1098937007 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0dcc100ad0 0x7f0dcc100ed0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8009900 tx=0x7f0dc802a410 comp rx=0 tx=0).stop 2024-09-19T07:06:25.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:25.198+0000 7f0dd334d640 1 -- 172.21.15.165:0/1098937007 shutdown_connections 2024-09-19T07:06:25.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:25.198+0000 7f0dd334d640 1 --2- 172.21.15.165:0/1098937007 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0dcc102690 0x7f0dcc108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:25.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:25.198+0000 7f0dd334d640 1 --2- 172.21.15.165:0/1098937007 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0dcc101cd0 0x7f0dcc102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:25.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:25.198+0000 7f0dd334d640 1 --2- 172.21.15.165:0/1098937007 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0dcc100ad0 0x7f0dcc100ed0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:25.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:25.198+0000 7f0dd334d640 1 -- 172.21.15.165:0/1098937007 >> 172.21.15.165:0/1098937007 conn(0x7f0dcc0fc280 msgr2=0x7f0dcc0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:25.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:25.198+0000 7f0dd334d640 1 -- 172.21.15.165:0/1098937007 shutdown_connections 2024-09-19T07:06:25.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:25.198+0000 7f0dd334d640 1 -- 172.21.15.165:0/1098937007 wait complete. 2024-09-19T07:06:25.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:25.199+0000 7f0dd334d640 1 Processor -- start 2024-09-19T07:06:25.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:25.199+0000 7f0dd334d640 1 -- start start 2024-09-19T07:06:25.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:25.199+0000 7f0dd334d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0dcc100ad0 0x7f0dcc197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:25.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:25.199+0000 7f0dd334d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0dcc101cd0 0x7f0dcc198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:25.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:25.199+0000 7f0dd334d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0dcc102690 0x7f0dcc19f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:25.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:25.199+0000 7f0dd334d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0dcc10c730 con 0x7f0dcc102690 2024-09-19T07:06:25.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:25.199+0000 7f0dd334d640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0dcc10c5b0 con 0x7f0dcc100ad0 2024-09-19T07:06:25.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:25.199+0000 7f0dd334d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0dcc10c8b0 con 0x7f0dcc101cd0 2024-09-19T07:06:25.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:25.199+0000 7f0dd10e9640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0dcc100ad0 0x7f0dcc197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:25.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:25.199+0000 7f0dd10e9640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0dcc100ad0 0x7f0dcc197f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.165:56022/0 (socket says 172.21.15.165:56022) 2024-09-19T07:06:25.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:25.199+0000 7f0dd10e9640 1 -- 172.21.15.165:0/2108217555 learned_addr learned my addr 172.21.15.165:0/2108217555 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-19T07:06:25.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:25.200+0000 7f0dd08e8640 1 --2- 172.21.15.165:0/2108217555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0dcc101cd0 0x7f0dcc198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:25.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:25.200+0000 7f0dd18ea640 1 --2- 172.21.15.165:0/2108217555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0dcc102690 0x7f0dcc19f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:25.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:25.200+0000 7f0dd10e9640 1 -- 172.21.15.165:0/2108217555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0dcc101cd0 msgr2=0x7f0dcc198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:25.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:25.200+0000 7f0dd10e9640 1 --2- 172.21.15.165:0/2108217555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0dcc101cd0 0x7f0dcc198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:25.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:25.200+0000 7f0dd10e9640 1 -- 172.21.15.165:0/2108217555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0dcc102690 msgr2=0x7f0dcc19f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:25.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:25.200+0000 7f0dd10e9640 1 --2- 172.21.15.165:0/2108217555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0dcc102690 0x7f0dcc19f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:25.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:25.200+0000 7f0dd10e9640 1 -- 172.21.15.165:0/2108217555 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dcc19fb30 con 0x7f0dcc100ad0 2024-09-19T07:06:25.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:25.200+0000 7f0dd10e9640 1 --2- 172.21.15.165:0/2108217555 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0dcc100ad0 0x7f0dcc197f00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8031610 tx=0x7f0dc80043b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:25.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:25.200+0000 7f0dc27fc640 1 -- 172.21.15.165:0/2108217555 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc803f030 con 0x7f0dcc100ad0 2024-09-19T07:06:25.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:25.200+0000 7f0dd334d640 1 -- 172.21.15.165:0/2108217555 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dcc19fdc0 con 0x7f0dcc100ad0 2024-09-19T07:06:25.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:25.200+0000 7f0dc27fc640 1 -- 172.21.15.165:0/2108217555 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0dc8003ce0 con 0x7f0dcc100ad0 2024-09-19T07:06:25.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:25.200+0000 7f0dc27fc640 1 -- 172.21.15.165:0/2108217555 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc8035070 con 0x7f0dcc100ad0 2024-09-19T07:06:25.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:25.200+0000 7f0dd334d640 1 -- 172.21.15.165:0/2108217555 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dcc1a0210 con 0x7f0dcc100ad0 2024-09-19T07:06:25.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:25.202+0000 7f0dd334d640 1 -- 172.21.15.165:0/2108217555 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dcc1a0500 con 0x7f0dcc100ad0 2024-09-19T07:06:25.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:25.203+0000 7f0dc27fc640 1 -- 172.21.15.165:0/2108217555 <== mon.2 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f0dc8042030 con 0x7f0dcc100ad0 2024-09-19T07:06:25.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:25.204+0000 7f0dc27fc640 1 --2- 172.21.15.165:0/2108217555 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f0db80a3270 0x7f0db80a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:25.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:25.204+0000 7f0dc27fc640 1 -- 172.21.15.165:0/2108217555 <== mon.2 v2:172.21.15.165:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4669+0+0 (secure 0 0 0) 0x7f0dc80ef2b0 con 0x7f0dcc100ad0 2024-09-19T07:06:25.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:25.204+0000 7f0dd08e8640 1 --2- 172.21.15.165:0/2108217555 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f0db80a3270 0x7f0db80a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:25.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:25.204+0000 7f0dd08e8640 1 --2- 172.21.15.165:0/2108217555 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f0db80a3270 0x7f0db80a5730 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc199420 tx=0x7f0dbc00b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:25.211 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:25.211+0000 7f0dc27fc640 1 -- 172.21.15.165:0/2108217555 <== mon.2 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0dc80bce10 con 0x7f0dcc100ad0 2024-09-19T07:06:25.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:25 smithi165 ceph-mon[35326]: from='osd.6 [v2:172.21.15.148:6818/2178980310,v1:172.21.15.148:6819/2178980310]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T07:06:25.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:25 smithi165 ceph-mon[35326]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T07:06:25.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:25 smithi165 ceph-mon[35326]: from='osd.6 [v2:172.21.15.148:6818/2178980310,v1:172.21.15.148:6819/2178980310]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]: dispatch 2024-09-19T07:06:25.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:25 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:06:25.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:25 smithi165 ceph-mon[35326]: Detected new or changed devices on smithi148 2024-09-19T07:06:25.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:25 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:25.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:25 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:25.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:25 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:06:25.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:25 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:06:25.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:25 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:06:25.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:25 smithi165 ceph-mon[35326]: Adjusting osd_memory_target on smithi148 to 5696M 2024-09-19T07:06:25.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:25 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:25.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:25 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:25.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:25 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:06:25.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:25 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:25.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:25 smithi165 ceph-mon[35326]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:06:25.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:25.453+0000 7f0dd334d640 1 -- 172.21.15.165:0/2108217555 --> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi165:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f0dcc1a06d0 con 0x7f0db80a3270 2024-09-19T07:06:25.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:25 smithi148 ceph-mon[31180]: from='osd.6 [v2:172.21.15.148:6818/2178980310,v1:172.21.15.148:6819/2178980310]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T07:06:25.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:25 smithi148 ceph-mon[31180]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T07:06:25.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:25 smithi148 ceph-mon[31180]: from='osd.6 [v2:172.21.15.148:6818/2178980310,v1:172.21.15.148:6819/2178980310]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]: dispatch 2024-09-19T07:06:25.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:25 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:06:25.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:25 smithi148 ceph-mon[31180]: Detected new or changed devices on smithi148 2024-09-19T07:06:25.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:25 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:25.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:25 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:25.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:25 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:06:25.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:25 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:06:25.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:25 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:06:25.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:25 smithi148 ceph-mon[31180]: Adjusting osd_memory_target on smithi148 to 5696M 2024-09-19T07:06:25.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:25 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:25.585 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:25 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:25.585 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:25 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:06:25.585 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:25 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:25.585 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:25 smithi148 ceph-mon[31180]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:06:25.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:25 smithi179 ceph-mon[35716]: from='osd.6 [v2:172.21.15.148:6818/2178980310,v1:172.21.15.148:6819/2178980310]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T07:06:25.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:25 smithi179 ceph-mon[35716]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T07:06:25.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:25 smithi179 ceph-mon[35716]: from='osd.6 [v2:172.21.15.148:6818/2178980310,v1:172.21.15.148:6819/2178980310]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]: dispatch 2024-09-19T07:06:25.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:25 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:06:25.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:25 smithi179 ceph-mon[35716]: Detected new or changed devices on smithi148 2024-09-19T07:06:25.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:25 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:25.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:25 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:25.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:25 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:06:25.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:25 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:06:25.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:25 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:06:25.774 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:25 smithi179 ceph-mon[35716]: Adjusting osd_memory_target on smithi148 to 5696M 2024-09-19T07:06:25.774 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:25 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:25.774 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:25 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:25.774 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:25 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:06:25.774 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:25 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:25.774 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:25 smithi179 ceph-mon[35716]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:06:26.333 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:06:26 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:06:26.067+0000 7f2696369640 -1 osd.6 0 waiting for initial osdmap 2024-09-19T07:06:26.333 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:06:26 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:06:26.080+0000 7f268e99b640 -1 osd.6 40 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T07:06:26.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:26 smithi148 ceph-mon[31180]: from='osd.6 [v2:172.21.15.148:6818/2178980310,v1:172.21.15.148:6819/2178980310]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-19T07:06:26.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:26 smithi148 ceph-mon[31180]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T07:06:26.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:26 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:06:26.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:26 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:06:26.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:26 smithi148 ceph-mon[31180]: from='client.24236 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi165:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:06:26.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:26 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:06:26.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:26 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:06:26.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:26 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:26.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:26 smithi148 ceph-mon[31180]: from='osd.6 [v2:172.21.15.148:6818/2178980310,v1:172.21.15.148:6819/2178980310]' entity='osd.6' 2024-09-19T07:06:26.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:26 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:06:26.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:26 smithi165 ceph-mon[35326]: from='osd.6 [v2:172.21.15.148:6818/2178980310,v1:172.21.15.148:6819/2178980310]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-19T07:06:26.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:26 smithi165 ceph-mon[35326]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T07:06:26.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:26 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:06:26.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:26 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:06:26.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:26 smithi165 ceph-mon[35326]: from='client.24236 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi165:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:06:26.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:26 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:06:26.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:26 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:06:26.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:26 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:26.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:26 smithi165 ceph-mon[35326]: from='osd.6 [v2:172.21.15.148:6818/2178980310,v1:172.21.15.148:6819/2178980310]' entity='osd.6' 2024-09-19T07:06:26.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:26 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:06:26.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:26 smithi179 ceph-mon[35716]: from='osd.6 [v2:172.21.15.148:6818/2178980310,v1:172.21.15.148:6819/2178980310]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-19T07:06:26.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:26 smithi179 ceph-mon[35716]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T07:06:26.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:26 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:06:26.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:26 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:06:26.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:26 smithi179 ceph-mon[35716]: from='client.24236 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi165:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:06:26.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:26 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:06:26.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:26 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:06:26.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:26 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:26.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:26 smithi179 ceph-mon[35716]: from='osd.6 [v2:172.21.15.148:6818/2178980310,v1:172.21.15.148:6819/2178980310]' entity='osd.6' 2024-09-19T07:06:26.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:26 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:06:28.298 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:28 smithi165 ceph-mon[35326]: purged_snaps scrub starts 2024-09-19T07:06:28.298 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:28 smithi165 ceph-mon[35326]: purged_snaps scrub ok 2024-09-19T07:06:28.298 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:28 smithi165 ceph-mon[35326]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:06:28.298 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:28 smithi165 ceph-mon[35326]: osd.6 [v2:172.21.15.148:6818/2178980310,v1:172.21.15.148:6819/2178980310] boot 2024-09-19T07:06:28.298 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:28 smithi165 ceph-mon[35326]: osdmap e41: 7 total, 7 up, 7 in 2024-09-19T07:06:28.298 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:28 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:06:28.299 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:28 smithi165 ceph-mon[35326]: from='client.? 172.21.15.165:0/2107471246' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e68e2b2-9838-4ec0-b473-24f2434695ec"}]: dispatch 2024-09-19T07:06:28.299 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:28 smithi165 ceph-mon[35326]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e68e2b2-9838-4ec0-b473-24f2434695ec"}]: dispatch 2024-09-19T07:06:28.299 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:28 smithi165 ceph-mon[35326]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9e68e2b2-9838-4ec0-b473-24f2434695ec"}]': finished 2024-09-19T07:06:28.299 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:28 smithi165 ceph-mon[35326]: osdmap e42: 8 total, 7 up, 8 in 2024-09-19T07:06:28.299 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:28 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:06:28.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:28 smithi148 ceph-mon[31180]: purged_snaps scrub starts 2024-09-19T07:06:28.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:28 smithi148 ceph-mon[31180]: purged_snaps scrub ok 2024-09-19T07:06:28.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:28 smithi148 ceph-mon[31180]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:06:28.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:28 smithi148 ceph-mon[31180]: osd.6 [v2:172.21.15.148:6818/2178980310,v1:172.21.15.148:6819/2178980310] boot 2024-09-19T07:06:28.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:28 smithi148 ceph-mon[31180]: osdmap e41: 7 total, 7 up, 7 in 2024-09-19T07:06:28.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:28 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:06:28.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:28 smithi148 ceph-mon[31180]: from='client.? 172.21.15.165:0/2107471246' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e68e2b2-9838-4ec0-b473-24f2434695ec"}]: dispatch 2024-09-19T07:06:28.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:28 smithi148 ceph-mon[31180]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e68e2b2-9838-4ec0-b473-24f2434695ec"}]: dispatch 2024-09-19T07:06:28.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:28 smithi148 ceph-mon[31180]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9e68e2b2-9838-4ec0-b473-24f2434695ec"}]': finished 2024-09-19T07:06:28.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:28 smithi148 ceph-mon[31180]: osdmap e42: 8 total, 7 up, 8 in 2024-09-19T07:06:28.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:28 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:06:28.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:28 smithi179 ceph-mon[35716]: purged_snaps scrub starts 2024-09-19T07:06:28.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:28 smithi179 ceph-mon[35716]: purged_snaps scrub ok 2024-09-19T07:06:28.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:28 smithi179 ceph-mon[35716]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:06:28.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:28 smithi179 ceph-mon[35716]: osd.6 [v2:172.21.15.148:6818/2178980310,v1:172.21.15.148:6819/2178980310] boot 2024-09-19T07:06:28.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:28 smithi179 ceph-mon[35716]: osdmap e41: 7 total, 7 up, 7 in 2024-09-19T07:06:28.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:28 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:06:28.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:28 smithi179 ceph-mon[35716]: from='client.? 172.21.15.165:0/2107471246' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e68e2b2-9838-4ec0-b473-24f2434695ec"}]: dispatch 2024-09-19T07:06:28.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:28 smithi179 ceph-mon[35716]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e68e2b2-9838-4ec0-b473-24f2434695ec"}]: dispatch 2024-09-19T07:06:28.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:28 smithi179 ceph-mon[35716]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9e68e2b2-9838-4ec0-b473-24f2434695ec"}]': finished 2024-09-19T07:06:28.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:28 smithi179 ceph-mon[35716]: osdmap e42: 8 total, 7 up, 8 in 2024-09-19T07:06:28.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:28 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:06:29.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:29 smithi148 ceph-mon[31180]: from='client.? 172.21.15.165:0/322720665' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:06:29.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:29 smithi165 ceph-mon[35326]: from='client.? 172.21.15.165:0/322720665' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:06:29.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:29 smithi179 ceph-mon[35716]: from='client.? 172.21.15.165:0/322720665' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:06:30.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:30 smithi148 ceph-mon[31180]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:06:30.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:30 smithi148 ceph-mon[31180]: osdmap e43: 8 total, 7 up, 8 in 2024-09-19T07:06:30.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:30 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:06:30.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:30 smithi165 ceph-mon[35326]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:06:30.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:30 smithi165 ceph-mon[35326]: osdmap e43: 8 total, 7 up, 8 in 2024-09-19T07:06:30.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:30 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:06:30.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:30 smithi179 ceph-mon[35716]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:06:30.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:30 smithi179 ceph-mon[35716]: osdmap e43: 8 total, 7 up, 8 in 2024-09-19T07:06:30.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:30 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:06:32.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:32 smithi165 ceph-mon[35326]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:06:32.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:32 smithi179 ceph-mon[35716]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:06:32.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:32 smithi148 ceph-mon[31180]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:06:34.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:34 smithi165 ceph-mon[35326]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:06:34.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:34 smithi179 ceph-mon[35716]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:06:34.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:34 smithi148 ceph-mon[31180]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:06:36.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:36 smithi165 ceph-mon[35326]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:06:36.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:36 smithi179 ceph-mon[35716]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:06:36.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:36 smithi148 ceph-mon[31180]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:06:37.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:37 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T07:06:37.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:37 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:37.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:37 smithi165 ceph-mon[35326]: Deploying daemon osd.7 on smithi165 2024-09-19T07:06:37.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:37 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T07:06:37.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:37 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:37.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:37 smithi179 ceph-mon[35716]: Deploying daemon osd.7 on smithi165 2024-09-19T07:06:37.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:37 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T07:06:37.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:37 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:37.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:37 smithi148 ceph-mon[31180]: Deploying daemon osd.7 on smithi165 2024-09-19T07:06:38.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:38 smithi165 ceph-mon[35326]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:06:38.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:38 smithi179 ceph-mon[35716]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:06:38.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:38 smithi148 ceph-mon[31180]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:06:40.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:40 smithi165 ceph-mon[35326]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:06:40.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:40 smithi179 ceph-mon[35716]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:06:40.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:40 smithi148 ceph-mon[31180]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:06:42.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:42 smithi165 ceph-mon[35326]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:06:42.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:42 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:06:42.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:42 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:42.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:42 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:42.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:42 smithi179 ceph-mon[35716]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:06:42.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:42 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:06:42.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:42 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:42.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:42 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:42.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:42 smithi148 ceph-mon[31180]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:06:42.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:42 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:06:42.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:42 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:42.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:42 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:44.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:44 smithi165 ceph-mon[35326]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:06:44.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:44 smithi179 ceph-mon[35716]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:06:44.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:44 smithi148 ceph-mon[31180]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:06:45.620 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:45 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:45.621 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:45 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:45.621 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:45 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:45.621 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:45 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:06:45.621 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:45 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:45.621 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:45 smithi165 ceph-mon[35326]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:06:45.663 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:45.662+0000 7f0dc27fc640 1 -- 172.21.15.165:0/2108217555 <== mgr.14148 v2:172.21.15.148:6800/3007822654 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0dcc1a06d0 con 0x7f0db80a3270 2024-09-19T07:06:45.663 INFO:teuthology.orchestra.run.smithi165.stdout:Created osd(s) 7 on host 'smithi165' 2024-09-19T07:06:45.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:45.664+0000 7f0dd334d640 1 -- 172.21.15.165:0/2108217555 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f0db80a3270 msgr2=0x7f0db80a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:45.669 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:45.664+0000 7f0dd334d640 1 --2- 172.21.15.165:0/2108217555 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f0db80a3270 0x7f0db80a5730 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc199420 tx=0x7f0dbc00b410 comp rx=0 tx=0).stop 2024-09-19T07:06:45.669 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:45.664+0000 7f0dd334d640 1 -- 172.21.15.165:0/2108217555 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0dcc100ad0 msgr2=0x7f0dcc197f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:45.669 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:45.664+0000 7f0dd334d640 1 --2- 172.21.15.165:0/2108217555 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0dcc100ad0 0x7f0dcc197f00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8031610 tx=0x7f0dc80043b0 comp rx=0 tx=0).stop 2024-09-19T07:06:45.669 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:45.664+0000 7f0dd334d640 1 -- 172.21.15.165:0/2108217555 shutdown_connections 2024-09-19T07:06:45.669 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:45.664+0000 7f0dd334d640 1 --2- 172.21.15.165:0/2108217555 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f0db80a3270 0x7f0db80a5730 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:45.669 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:45.664+0000 7f0dd334d640 1 --2- 172.21.15.165:0/2108217555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0dcc102690 0x7f0dcc19f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:45.669 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:45.664+0000 7f0dd334d640 1 --2- 172.21.15.165:0/2108217555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0dcc101cd0 0x7f0dcc198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:45.669 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:45.664+0000 7f0dd334d640 1 --2- 172.21.15.165:0/2108217555 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0dcc100ad0 0x7f0dcc197f00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:45.669 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:45.664+0000 7f0dd334d640 1 -- 172.21.15.165:0/2108217555 >> 172.21.15.165:0/2108217555 conn(0x7f0dcc0fc280 msgr2=0x7f0dcc06a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:45.669 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:45.664+0000 7f0dd334d640 1 -- 172.21.15.165:0/2108217555 shutdown_connections 2024-09-19T07:06:45.669 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:06:45.664+0000 7f0dd334d640 1 -- 172.21.15.165:0/2108217555 wait complete. 2024-09-19T07:06:46.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:45 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:46.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:45 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:46.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:45 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:46.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:45 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:06:46.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:45 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:46.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:45 smithi179 ceph-mon[35716]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:06:46.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:45 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:46.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:45 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:46.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:45 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:46.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:45 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:06:46.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:45 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:46.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:45 smithi148 ceph-mon[31180]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:06:46.297 DEBUG:teuthology.orchestra.run.smithi165:osd.7> sudo journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@osd.7.service 2024-09-19T07:06:46.340 INFO:tasks.cephadm:Deploying osd.8 on smithi179 with /dev/vg_nvme/lv_2... 2024-09-19T07:06:46.340 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T07:06:46.594 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:06:46.715 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:46 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:06:46.715 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:46 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:46.715 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:46 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:46.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:46 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:06:46.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:46 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:46.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:46 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:47.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:46 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:06:47.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:46 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:47.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:46 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:47.717 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:47 smithi165 ceph-mon[35326]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:06:47.825 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:47 smithi179 ceph-mon[35716]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:06:48.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:47 smithi148 ceph-mon[31180]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:06:48.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:48 smithi165 ceph-mon[35326]: from='osd.7 [v2:172.21.15.165:6816/3961600099,v1:172.21.15.165:6817/3961600099]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T07:06:48.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:48 smithi165 ceph-mon[35326]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T07:06:48.634 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:06:48 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:06:48.357+0000 7f9120a60640 -1 osd.7 0 log_to_monitors true 2024-09-19T07:06:48.939 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:48 smithi179 ceph-mon[35716]: from='osd.7 [v2:172.21.15.165:6816/3961600099,v1:172.21.15.165:6817/3961600099]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T07:06:48.939 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:48 smithi179 ceph-mon[35716]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T07:06:48.942 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-19T07:06:48.970 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi179:vg_nvme/lv_2 2024-09-19T07:06:49.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:48 smithi148 ceph-mon[31180]: from='osd.7 [v2:172.21.15.165:6816/3961600099,v1:172.21.15.165:6817/3961600099]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T07:06:49.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:48 smithi148 ceph-mon[31180]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T07:06:49.220 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:06:49.710 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:06:49.691+0000 7fec6d73a640 1 -- 172.21.15.179:0/2013000657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec68103230 msgr2=0x7fec68103630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:49.710 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:06:49.691+0000 7fec6d73a640 1 --2- 172.21.15.179:0/2013000657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec68103230 0x7fec68103630 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fec58009900 tx=0x7fec5802a410 comp rx=0 tx=0).stop 2024-09-19T07:06:49.710 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:06:49.691+0000 7fec6d73a640 1 -- 172.21.15.179:0/2013000657 shutdown_connections 2024-09-19T07:06:49.710 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:06:49.691+0000 7fec6d73a640 1 --2- 172.21.15.179:0/2013000657 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec68100350 0x7fec6810a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:49.710 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:06:49.691+0000 7fec6d73a640 1 --2- 172.21.15.179:0/2013000657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec68103c00 0x7fec680ffcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:49.711 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:06:49.691+0000 7fec6d73a640 1 --2- 172.21.15.179:0/2013000657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec68103230 0x7fec68103630 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:49.711 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:06:49.691+0000 7fec6d73a640 1 -- 172.21.15.179:0/2013000657 >> 172.21.15.179:0/2013000657 conn(0x7fec680fba40 msgr2=0x7fec680fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:49.711 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:06:49.691+0000 7fec6d73a640 1 -- 172.21.15.179:0/2013000657 shutdown_connections 2024-09-19T07:06:49.711 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:06:49.691+0000 7fec6d73a640 1 -- 172.21.15.179:0/2013000657 wait complete. 2024-09-19T07:06:49.711 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:06:49.692+0000 7fec6d73a640 1 Processor -- start 2024-09-19T07:06:49.711 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:06:49.692+0000 7fec6d73a640 1 -- start start 2024-09-19T07:06:49.711 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:06:49.692+0000 7fec6d73a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec68100350 0x7fec68197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:49.711 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:06:49.692+0000 7fec6d73a640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec68103230 0x7fec681984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:49.711 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:06:49.692+0000 7fec6d73a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec68103c00 0x7fec6819f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:49.711 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:06:49.692+0000 7fec6d73a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fec6810d890 con 0x7fec68103c00 2024-09-19T07:06:49.711 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:06:49.692+0000 7fec6d73a640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fec6810d710 con 0x7fec68103230 2024-09-19T07:06:49.711 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:06:49.692+0000 7fec6d73a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fec6810da10 con 0x7fec68100350 2024-09-19T07:06:49.712 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:06:49.692+0000 7fec66ffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec68100350 0x7fec68197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:49.712 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:06:49.693+0000 7fec66ffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec68100350 0x7fec68197f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:50296/0 (socket says 172.21.15.179:50296) 2024-09-19T07:06:49.712 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:06:49.693+0000 7fec66ffd640 1 -- 172.21.15.179:0/1454316166 learned_addr learned my addr 172.21.15.179:0/1454316166 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-09-19T07:06:49.712 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:06:49.693+0000 7fec667fc640 1 --2- 172.21.15.179:0/1454316166 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec68103230 0x7fec681984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:49.712 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:06:49.693+0000 7fec677fe640 1 --2- 172.21.15.179:0/1454316166 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec68103c00 0x7fec6819f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:49.712 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:06:49.693+0000 7fec66ffd640 1 -- 172.21.15.179:0/1454316166 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec68103230 msgr2=0x7fec681984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:49.712 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:06:49.693+0000 7fec66ffd640 1 --2- 172.21.15.179:0/1454316166 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec68103230 0x7fec681984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:49.712 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:06:49.693+0000 7fec66ffd640 1 -- 172.21.15.179:0/1454316166 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec68103c00 msgr2=0x7fec6819f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:49.712 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:06:49.693+0000 7fec66ffd640 1 --2- 172.21.15.179:0/1454316166 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec68103c00 0x7fec6819f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:49.712 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:06:49.693+0000 7fec66ffd640 1 -- 172.21.15.179:0/1454316166 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec6819fba0 con 0x7fec68100350 2024-09-19T07:06:49.712 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:06:49.693+0000 7fec677fe640 1 --2- 172.21.15.179:0/1454316166 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec68103c00 0x7fec6819f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:06:49.712 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:06:49.693+0000 7fec66ffd640 1 --2- 172.21.15.179:0/1454316166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec68100350 0x7fec68197f70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fec58006010 tx=0x7fec58031b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:49.712 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:06:49.693+0000 7fec4ffff640 1 -- 172.21.15.179:0/1454316166 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec5803f030 con 0x7fec68100350 2024-09-19T07:06:49.713 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:06:49.693+0000 7fec6d73a640 1 -- 172.21.15.179:0/1454316166 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec6819fe30 con 0x7fec68100350 2024-09-19T07:06:49.713 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:06:49.693+0000 7fec4ffff640 1 -- 172.21.15.179:0/1454316166 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec580044a0 con 0x7fec68100350 2024-09-19T07:06:49.713 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:06:49.693+0000 7fec4ffff640 1 -- 172.21.15.179:0/1454316166 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec58035070 con 0x7fec68100350 2024-09-19T07:06:49.713 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:06:49.693+0000 7fec6d73a640 1 -- 172.21.15.179:0/1454316166 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec681a0230 con 0x7fec68100350 2024-09-19T07:06:49.713 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:06:49.694+0000 7fec6d73a640 1 -- 172.21.15.179:0/1454316166 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec68109270 con 0x7fec68100350 2024-09-19T07:06:49.713 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:06:49.695+0000 7fec4ffff640 1 -- 172.21.15.179:0/1454316166 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fec58042030 con 0x7fec68100350 2024-09-19T07:06:49.713 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:06:49.696+0000 7fec4ffff640 1 --2- 172.21.15.179:0/1454316166 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fec500a3270 0x7fec500a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:49.713 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:06:49.696+0000 7fec4ffff640 1 -- 172.21.15.179:0/1454316166 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5117+0+0 (secure 0 0 0) 0x7fec580ef1c0 con 0x7fec68100350 2024-09-19T07:06:49.713 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:06:49.696+0000 7fec667fc640 1 --2- 172.21.15.179:0/1454316166 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fec500a3270 0x7fec500a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:49.713 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:06:49.697+0000 7fec667fc640 1 --2- 172.21.15.179:0/1454316166 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fec500a3270 0x7fec500a5730 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fec68199490 tx=0x7fec5c00b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:49.713 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:06:49.700+0000 7fec4ffff640 1 -- 172.21.15.179:0/1454316166 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fec580bcb60 con 0x7fec68100350 2024-09-19T07:06:49.878 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:06:49.877+0000 7fec6d73a640 1 -- 172.21.15.179:0/1454316166 --> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fec68062630 con 0x7fec500a3270 2024-09-19T07:06:49.878 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:49 smithi179 ceph-mon[35716]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T07:06:49.878 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:49 smithi179 ceph-mon[35716]: from='osd.7 [v2:172.21.15.165:6816/3961600099,v1:172.21.15.165:6817/3961600099]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-19T07:06:49.878 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:49 smithi179 ceph-mon[35716]: osdmap e44: 8 total, 7 up, 8 in 2024-09-19T07:06:49.878 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:49 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:06:49.878 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:49 smithi179 ceph-mon[35716]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-19T07:06:49.879 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:49 smithi179 ceph-mon[35716]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:06:49.879 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:49 smithi179 ceph-mon[35716]: Detected new or changed devices on smithi165 2024-09-19T07:06:49.879 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:49 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:49.879 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:49 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:49.879 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:49 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:06:49.879 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:49 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:06:49.879 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:49 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:06:49.879 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:49 smithi179 ceph-mon[35716]: Adjusting osd_memory_target on smithi165 to 5696M 2024-09-19T07:06:49.879 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:49 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:49.879 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:49 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:49.879 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:49 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:06:49.880 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:49 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:49.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:49 smithi165 ceph-mon[35326]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T07:06:49.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:49 smithi165 ceph-mon[35326]: from='osd.7 [v2:172.21.15.165:6816/3961600099,v1:172.21.15.165:6817/3961600099]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-19T07:06:49.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:49 smithi165 ceph-mon[35326]: osdmap e44: 8 total, 7 up, 8 in 2024-09-19T07:06:49.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:49 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:06:49.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:49 smithi165 ceph-mon[35326]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-19T07:06:49.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:49 smithi165 ceph-mon[35326]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:06:49.885 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:49 smithi165 ceph-mon[35326]: Detected new or changed devices on smithi165 2024-09-19T07:06:49.885 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:49 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:49.885 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:49 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:49.885 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:49 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:06:49.885 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:49 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:06:49.885 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:49 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:06:49.885 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:49 smithi165 ceph-mon[35326]: Adjusting osd_memory_target on smithi165 to 5696M 2024-09-19T07:06:49.885 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:49 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:49.885 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:49 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:49.885 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:49 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:06:49.885 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:49 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:50.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:49 smithi148 ceph-mon[31180]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T07:06:50.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:49 smithi148 ceph-mon[31180]: from='osd.7 [v2:172.21.15.165:6816/3961600099,v1:172.21.15.165:6817/3961600099]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-19T07:06:50.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:49 smithi148 ceph-mon[31180]: osdmap e44: 8 total, 7 up, 8 in 2024-09-19T07:06:50.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:49 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:06:50.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:49 smithi148 ceph-mon[31180]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-19T07:06:50.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:49 smithi148 ceph-mon[31180]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:06:50.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:49 smithi148 ceph-mon[31180]: Detected new or changed devices on smithi165 2024-09-19T07:06:50.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:49 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:50.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:49 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:50.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:49 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:06:50.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:49 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:06:50.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:49 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:06:50.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:49 smithi148 ceph-mon[31180]: Adjusting osd_memory_target on smithi165 to 5696M 2024-09-19T07:06:50.086 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:49 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:50.086 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:49 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:50.086 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:49 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:06:50.086 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:49 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:06:50.884 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:06:50 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:06:50.455+0000 7f911c1c0640 -1 osd.7 0 waiting for initial osdmap 2024-09-19T07:06:50.884 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:06:50 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:06:50.473+0000 7f91147f2640 -1 osd.7 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T07:06:50.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:50 smithi165 ceph-mon[35326]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]': finished 2024-09-19T07:06:50.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:50 smithi165 ceph-mon[35326]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T07:06:50.885 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:50 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:06:50.885 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:50 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:06:50.885 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:50 smithi165 ceph-mon[35326]: from='client.24280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:06:50.885 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:50 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:06:50.885 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:50 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:06:50.885 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:50 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:50.885 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:50 smithi165 ceph-mon[35326]: from='osd.7 ' entity='osd.7' 2024-09-19T07:06:50.885 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:50 smithi165 ceph-mon[35326]: osd.7 [v2:172.21.15.165:6816/3961600099,v1:172.21.15.165:6817/3961600099] boot 2024-09-19T07:06:50.885 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:50 smithi165 ceph-mon[35326]: osdmap e46: 8 total, 8 up, 8 in 2024-09-19T07:06:50.885 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:50 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:06:50.932 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:50 smithi179 ceph-mon[35716]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]': finished 2024-09-19T07:06:50.932 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:50 smithi179 ceph-mon[35716]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T07:06:50.933 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:50 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:06:50.933 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:50 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:06:50.933 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:50 smithi179 ceph-mon[35716]: from='client.24280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:06:50.933 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:50 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:06:50.933 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:50 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:06:50.933 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:50 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:50.933 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:50 smithi179 ceph-mon[35716]: from='osd.7 ' entity='osd.7' 2024-09-19T07:06:50.933 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:50 smithi179 ceph-mon[35716]: osd.7 [v2:172.21.15.165:6816/3961600099,v1:172.21.15.165:6817/3961600099] boot 2024-09-19T07:06:50.933 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:50 smithi179 ceph-mon[35716]: osdmap e46: 8 total, 8 up, 8 in 2024-09-19T07:06:50.933 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:50 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:06:51.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:50 smithi148 ceph-mon[31180]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]': finished 2024-09-19T07:06:51.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:50 smithi148 ceph-mon[31180]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T07:06:51.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:50 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:06:51.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:50 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:06:51.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:50 smithi148 ceph-mon[31180]: from='client.24280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:06:51.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:50 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:06:51.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:50 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:06:51.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:50 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:51.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:50 smithi148 ceph-mon[31180]: from='osd.7 ' entity='osd.7' 2024-09-19T07:06:51.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:50 smithi148 ceph-mon[31180]: osd.7 [v2:172.21.15.165:6816/3961600099,v1:172.21.15.165:6817/3961600099] boot 2024-09-19T07:06:51.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:50 smithi148 ceph-mon[31180]: osdmap e46: 8 total, 8 up, 8 in 2024-09-19T07:06:51.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:50 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:06:51.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:51 smithi179 ceph-mon[35716]: purged_snaps scrub starts 2024-09-19T07:06:51.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:51 smithi179 ceph-mon[35716]: purged_snaps scrub ok 2024-09-19T07:06:51.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:51 smithi179 ceph-mon[35716]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 646 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:06:51.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:51 smithi179 ceph-mon[35716]: osdmap e47: 8 total, 8 up, 8 in 2024-09-19T07:06:51.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:51 smithi165 ceph-mon[35326]: purged_snaps scrub starts 2024-09-19T07:06:51.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:51 smithi165 ceph-mon[35326]: purged_snaps scrub ok 2024-09-19T07:06:51.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:51 smithi165 ceph-mon[35326]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 646 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:06:51.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:51 smithi165 ceph-mon[35326]: osdmap e47: 8 total, 8 up, 8 in 2024-09-19T07:06:52.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:51 smithi148 ceph-mon[31180]: purged_snaps scrub starts 2024-09-19T07:06:52.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:51 smithi148 ceph-mon[31180]: purged_snaps scrub ok 2024-09-19T07:06:52.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:51 smithi148 ceph-mon[31180]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 646 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:06:52.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:51 smithi148 ceph-mon[31180]: osdmap e47: 8 total, 8 up, 8 in 2024-09-19T07:06:52.733 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:52 smithi179 ceph-mon[35716]: from='client.? 172.21.15.179:0/2123413140' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "297acce6-d3c7-4e1a-bf87-be093de51a6c"}]: dispatch 2024-09-19T07:06:52.733 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:52 smithi179 ceph-mon[35716]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "297acce6-d3c7-4e1a-bf87-be093de51a6c"}]: dispatch 2024-09-19T07:06:52.733 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:52 smithi179 ceph-mon[35716]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "297acce6-d3c7-4e1a-bf87-be093de51a6c"}]': finished 2024-09-19T07:06:52.733 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:52 smithi179 ceph-mon[35716]: osdmap e48: 9 total, 8 up, 9 in 2024-09-19T07:06:52.733 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:52 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:06:52.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:52 smithi165 ceph-mon[35326]: from='client.? 172.21.15.179:0/2123413140' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "297acce6-d3c7-4e1a-bf87-be093de51a6c"}]: dispatch 2024-09-19T07:06:52.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:52 smithi165 ceph-mon[35326]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "297acce6-d3c7-4e1a-bf87-be093de51a6c"}]: dispatch 2024-09-19T07:06:52.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:52 smithi165 ceph-mon[35326]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "297acce6-d3c7-4e1a-bf87-be093de51a6c"}]': finished 2024-09-19T07:06:52.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:52 smithi165 ceph-mon[35326]: osdmap e48: 9 total, 8 up, 9 in 2024-09-19T07:06:52.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:52 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:06:53.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:52 smithi148 ceph-mon[31180]: from='client.? 172.21.15.179:0/2123413140' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "297acce6-d3c7-4e1a-bf87-be093de51a6c"}]: dispatch 2024-09-19T07:06:53.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:52 smithi148 ceph-mon[31180]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "297acce6-d3c7-4e1a-bf87-be093de51a6c"}]: dispatch 2024-09-19T07:06:53.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:52 smithi148 ceph-mon[31180]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "297acce6-d3c7-4e1a-bf87-be093de51a6c"}]': finished 2024-09-19T07:06:53.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:52 smithi148 ceph-mon[31180]: osdmap e48: 9 total, 8 up, 9 in 2024-09-19T07:06:53.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:52 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:06:53.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:53 smithi165 ceph-mon[35326]: from='client.? 172.21.15.179:0/1722030885' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:06:53.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:53 smithi165 ceph-mon[35326]: pgmap v166: 1 pgs: 1 remapped+peering; 577 KiB data, 646 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:06:53.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:53 smithi165 ceph-mon[35326]: osdmap e49: 9 total, 8 up, 9 in 2024-09-19T07:06:53.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:53 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:06:54.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:53 smithi179 ceph-mon[35716]: from='client.? 172.21.15.179:0/1722030885' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:06:54.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:53 smithi179 ceph-mon[35716]: pgmap v166: 1 pgs: 1 remapped+peering; 577 KiB data, 646 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:06:54.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:53 smithi179 ceph-mon[35716]: osdmap e49: 9 total, 8 up, 9 in 2024-09-19T07:06:54.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:53 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:06:54.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:53 smithi148 ceph-mon[31180]: from='client.? 172.21.15.179:0/1722030885' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:06:54.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:53 smithi148 ceph-mon[31180]: pgmap v166: 1 pgs: 1 remapped+peering; 577 KiB data, 646 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:06:54.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:53 smithi148 ceph-mon[31180]: osdmap e49: 9 total, 8 up, 9 in 2024-09-19T07:06:54.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:53 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:06:55.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:55 smithi179 ceph-mon[35716]: osdmap e50: 9 total, 8 up, 9 in 2024-09-19T07:06:55.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:55 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:06:55.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:55 smithi179 ceph-mon[35716]: pgmap v169: 1 pgs: 1 remapped+peering; 577 KiB data, 646 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:06:55.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:55 smithi148 ceph-mon[31180]: osdmap e50: 9 total, 8 up, 9 in 2024-09-19T07:06:55.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:55 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:06:55.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:55 smithi148 ceph-mon[31180]: pgmap v169: 1 pgs: 1 remapped+peering; 577 KiB data, 646 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:06:55.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:55 smithi165 ceph-mon[35326]: osdmap e50: 9 total, 8 up, 9 in 2024-09-19T07:06:55.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:55 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:06:55.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:55 smithi165 ceph-mon[35326]: pgmap v169: 1 pgs: 1 remapped+peering; 577 KiB data, 646 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:06:58.152 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:06:58 smithi179 ceph-mon[35716]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:06:58.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:06:58 smithi165 ceph-mon[35326]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:06:58.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:06:58 smithi148 ceph-mon[31180]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:07:00.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:00 smithi165 ceph-mon[35326]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:07:00.385 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:00 smithi148 ceph-mon[31180]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:07:00.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:00 smithi179 ceph-mon[35716]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:07:01.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:01 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T07:07:01.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:01 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:07:01.428 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:01 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T07:07:01.429 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:01 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:07:01.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:01 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T07:07:01.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:01 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:07:02.134 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:02 smithi179 ceph-mon[35716]: Deploying daemon osd.8 on smithi179 2024-09-19T07:07:02.134 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:02 smithi179 ceph-mon[35716]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:07:02.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:02 smithi165 ceph-mon[35326]: Deploying daemon osd.8 on smithi179 2024-09-19T07:07:02.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:02 smithi165 ceph-mon[35326]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:07:02.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:02 smithi148 ceph-mon[31180]: Deploying daemon osd.8 on smithi179 2024-09-19T07:07:02.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:02 smithi148 ceph-mon[31180]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:07:04.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:04 smithi179 ceph-mon[35716]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:07:04.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:04 smithi165 ceph-mon[35326]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:07:04.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:04 smithi148 ceph-mon[31180]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:07:06.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:06 smithi165 ceph-mon[35326]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:07:06.404 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:06 smithi179 ceph-mon[35716]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:07:06.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:06 smithi148 ceph-mon[31180]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:07:07.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:07 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:07:07.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:07 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:07.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:07 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:07.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:07 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:07:07.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:07 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:07.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:07 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:07.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:07 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:07:07.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:07 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:07.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:07 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:08.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:08 smithi165 ceph-mon[35326]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:07:08.468 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:08 smithi179 ceph-mon[35716]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:07:08.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:08 smithi148 ceph-mon[31180]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:07:09.390 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:09 smithi179 ceph-mon[35716]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:07:09.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:09 smithi148 ceph-mon[31180]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:07:09.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:09 smithi165 ceph-mon[35326]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:07:09.717 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:07:09.716+0000 7fec4ffff640 1 -- 172.21.15.179:0/1454316166 <== mgr.14148 v2:172.21.15.148:6800/3007822654 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fec68062630 con 0x7fec500a3270 2024-09-19T07:07:09.717 INFO:teuthology.orchestra.run.smithi179.stdout:Created osd(s) 8 on host 'smithi179' 2024-09-19T07:07:09.720 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:07:09.718+0000 7fec6d73a640 1 -- 172.21.15.179:0/1454316166 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fec500a3270 msgr2=0x7fec500a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:09.720 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:07:09.718+0000 7fec6d73a640 1 --2- 172.21.15.179:0/1454316166 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fec500a3270 0x7fec500a5730 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fec68199490 tx=0x7fec5c00b410 comp rx=0 tx=0).stop 2024-09-19T07:07:09.720 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:07:09.718+0000 7fec6d73a640 1 -- 172.21.15.179:0/1454316166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec68100350 msgr2=0x7fec68197f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:09.720 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:07:09.718+0000 7fec6d73a640 1 --2- 172.21.15.179:0/1454316166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec68100350 0x7fec68197f70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fec58006010 tx=0x7fec58031b60 comp rx=0 tx=0).stop 2024-09-19T07:07:09.721 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:07:09.718+0000 7fec6d73a640 1 -- 172.21.15.179:0/1454316166 shutdown_connections 2024-09-19T07:07:09.721 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:07:09.719+0000 7fec6d73a640 1 --2- 172.21.15.179:0/1454316166 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fec500a3270 0x7fec500a5730 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:09.721 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:07:09.719+0000 7fec6d73a640 1 --2- 172.21.15.179:0/1454316166 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec68103c00 0x7fec6819f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:09.721 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:07:09.719+0000 7fec6d73a640 1 --2- 172.21.15.179:0/1454316166 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec68103230 0x7fec681984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:09.721 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:07:09.719+0000 7fec6d73a640 1 --2- 172.21.15.179:0/1454316166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec68100350 0x7fec68197f70 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:09.721 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:07:09.719+0000 7fec6d73a640 1 -- 172.21.15.179:0/1454316166 >> 172.21.15.179:0/1454316166 conn(0x7fec680fba40 msgr2=0x7fec68106440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:09.721 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:07:09.719+0000 7fec6d73a640 1 -- 172.21.15.179:0/1454316166 shutdown_connections 2024-09-19T07:07:09.721 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:07:09.719+0000 7fec6d73a640 1 -- 172.21.15.179:0/1454316166 wait complete. 2024-09-19T07:07:10.313 DEBUG:teuthology.orchestra.run.smithi179:osd.8> sudo journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@osd.8.service 2024-09-19T07:07:10.316 INFO:tasks.cephadm:Deploying osd.9 on smithi148 with /dev/vg_nvme/lv_1... 2024-09-19T07:07:10.316 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T07:07:10.579 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:07:11.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:10 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:11.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:10 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:11.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:10 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:11.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:10 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:11.036 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:10 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:11.037 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:10 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:11.037 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:10 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:11.037 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:10 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:11.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:10 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:11.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:10 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:11.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:10 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:11.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:10 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:11.912 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:11 smithi179 ceph-mon[35716]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:07:12.024 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:11 smithi148 ceph-mon[31180]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:07:12.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:11 smithi165 ceph-mon[35326]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:07:13.073 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:12 smithi148 ceph-mon[31180]: from='osd.8 [v2:172.21.15.179:6816/3642931467,v1:172.21.15.179:6817/3642931467]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T07:07:13.073 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:12 smithi148 ceph-mon[31180]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T07:07:13.076 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:07:13.104 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi148:vg_nvme/lv_1 2024-09-19T07:07:13.202 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:12 smithi179 ceph-mon[35716]: from='osd.8 [v2:172.21.15.179:6816/3642931467,v1:172.21.15.179:6817/3642931467]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T07:07:13.202 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:12 smithi179 ceph-mon[35716]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T07:07:13.203 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:07:12 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:07:12.866+0000 7fb32f23e640 -1 osd.8 0 log_to_monitors true 2024-09-19T07:07:13.383 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:07:13.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:12 smithi165 ceph-mon[35326]: from='osd.8 [v2:172.21.15.179:6816/3642931467,v1:172.21.15.179:6817/3642931467]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T07:07:13.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:12 smithi165 ceph-mon[35326]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T07:07:13.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:13.836+0000 7f067f4a6640 1 -- 172.21.15.148:0/2943620084 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0678100ad0 msgr2=0x7f0678100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:13.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:13.836+0000 7f067f4a6640 1 --2- 172.21.15.148:0/2943620084 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0678100ad0 0x7f0678100ed0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0668009ca0 tx=0x7f066802a8c0 comp rx=0 tx=0).stop 2024-09-19T07:07:13.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:13.836+0000 7f067f4a6640 1 -- 172.21.15.148:0/2943620084 shutdown_connections 2024-09-19T07:07:13.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:13.836+0000 7f067f4a6640 1 --2- 172.21.15.148:0/2943620084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0678102690 0x7f0678108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:13.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:13.836+0000 7f067f4a6640 1 --2- 172.21.15.148:0/2943620084 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0678101cd0 0x7f0678102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:13.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:13.836+0000 7f067f4a6640 1 --2- 172.21.15.148:0/2943620084 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0678100ad0 0x7f0678100ed0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:13.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:13.836+0000 7f067f4a6640 1 -- 172.21.15.148:0/2943620084 >> 172.21.15.148:0/2943620084 conn(0x7f06780fc280 msgr2=0x7f06780fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:13.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:13.836+0000 7f067f4a6640 1 -- 172.21.15.148:0/2943620084 shutdown_connections 2024-09-19T07:07:13.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:13.836+0000 7f067f4a6640 1 -- 172.21.15.148:0/2943620084 wait complete. 2024-09-19T07:07:13.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:13.837+0000 7f067f4a6640 1 Processor -- start 2024-09-19T07:07:13.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:13.837+0000 7f067f4a6640 1 -- start start 2024-09-19T07:07:13.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:13.837+0000 7f067f4a6640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0678100ad0 0x7f0678196de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:13.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:13.837+0000 7f067f4a6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0678101cd0 0x7f0678197320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:13.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:13.837+0000 7f067f4a6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0678102690 0x7f067819e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:13.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:13.837+0000 7f067f4a6640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f067810c760 con 0x7f0678102690 2024-09-19T07:07:13.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:13.837+0000 7f067f4a6640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f067810c5e0 con 0x7f0678100ad0 2024-09-19T07:07:13.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:13.837+0000 7f067f4a6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f067810c8e0 con 0x7f0678101cd0 2024-09-19T07:07:13.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:13.837+0000 7f067da43640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0678102690 0x7f067819e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:13.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:13.837+0000 7f067da43640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0678102690 0x7f067819e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38646/0 (socket says 172.21.15.148:38646) 2024-09-19T07:07:13.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:13.837+0000 7f067da43640 1 -- 172.21.15.148:0/3176944640 learned_addr learned my addr 172.21.15.148:0/3176944640 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:07:13.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:13.837+0000 7f067ca41640 1 --2- 172.21.15.148:0/3176944640 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0678101cd0 0x7f0678197320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:13.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:13.837+0000 7f067d242640 1 --2- 172.21.15.148:0/3176944640 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0678100ad0 0x7f0678196de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:13.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:13.837+0000 7f067da43640 1 -- 172.21.15.148:0/3176944640 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0678101cd0 msgr2=0x7f0678197320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:13.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:13.837+0000 7f067da43640 1 --2- 172.21.15.148:0/3176944640 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0678101cd0 0x7f0678197320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:13.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:13.837+0000 7f067da43640 1 -- 172.21.15.148:0/3176944640 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0678100ad0 msgr2=0x7f0678196de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:13.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:13.837+0000 7f067da43640 1 --2- 172.21.15.148:0/3176944640 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0678100ad0 0x7f0678196de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:13.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:13.837+0000 7f067da43640 1 -- 172.21.15.148:0/3176944640 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f067819ea10 con 0x7f0678102690 2024-09-19T07:07:13.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:13.838+0000 7f067da43640 1 --2- 172.21.15.148:0/3176944640 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0678102690 0x7f067819e3a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f067000eb00 tx=0x7f067000ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:13.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:13.838+0000 7f06767fc640 1 -- 172.21.15.148:0/3176944640 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f067000bbb0 con 0x7f0678102690 2024-09-19T07:07:13.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:13.838+0000 7f067f4a6640 1 -- 172.21.15.148:0/3176944640 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0678069fd0 con 0x7f0678102690 2024-09-19T07:07:13.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:13.838+0000 7f06767fc640 1 -- 172.21.15.148:0/3176944640 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f067000bd50 con 0x7f0678102690 2024-09-19T07:07:13.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:13.838+0000 7f06767fc640 1 -- 172.21.15.148:0/3176944640 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0670017410 con 0x7f0678102690 2024-09-19T07:07:13.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:13.838+0000 7f067f4a6640 1 -- 172.21.15.148:0/3176944640 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f067806a510 con 0x7f0678102690 2024-09-19T07:07:13.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:13.839+0000 7f067f4a6640 1 -- 172.21.15.148:0/3176944640 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0678100ed0 con 0x7f0678102690 2024-09-19T07:07:13.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:13.840+0000 7f06767fc640 1 -- 172.21.15.148:0/3176944640 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f0670004f20 con 0x7f0678102690 2024-09-19T07:07:13.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:13.841+0000 7f06767fc640 1 --2- 172.21.15.148:0/3176944640 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f06600a3270 0x7f06600a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:13.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:13.841+0000 7f067d242640 1 --2- 172.21.15.148:0/3176944640 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f06600a3270 0x7f06600a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:13.854 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:13.841+0000 7f06767fc640 1 -- 172.21.15.148:0/3176944640 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5533+0+0 (secure 0 0 0) 0x7f06700d0980 con 0x7f0678102690 2024-09-19T07:07:13.854 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:13.842+0000 7f067d242640 1 --2- 172.21.15.148:0/3176944640 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f06600a3270 0x7f06600a5730 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0668006010 tx=0x7f0668000f40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:13.854 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:13.845+0000 7f06767fc640 1 -- 172.21.15.148:0/3176944640 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f067009db30 con 0x7f0678102690 2024-09-19T07:07:14.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:14.024+0000 7f067f4a6640 1 -- 172.21.15.148:0/3176944640 --> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f067806a770 con 0x7f06600a3270 2024-09-19T07:07:14.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:13 smithi148 ceph-mon[31180]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T07:07:14.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:13 smithi148 ceph-mon[31180]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T07:07:14.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:13 smithi148 ceph-mon[31180]: from='osd.8 [v2:172.21.15.179:6816/3642931467,v1:172.21.15.179:6817/3642931467]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-19T07:07:14.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:13 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:07:14.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:13 smithi148 ceph-mon[31180]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-19T07:07:14.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:13 smithi148 ceph-mon[31180]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:07:14.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:13 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:14.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:13 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:14.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:13 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:07:14.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:13 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:07:14.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:13 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:07:14.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:13 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:14.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:13 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:07:14.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:13 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:07:14.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:13 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:14.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:13 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:07:14.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:13 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:07:14.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:13 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:07:14.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:13 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:14.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:13 smithi148 ceph-mon[31180]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-09-19T07:07:14.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:13 smithi148 ceph-mon[31180]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T07:07:14.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:13 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:07:14.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:13 smithi179 ceph-mon[35716]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T07:07:14.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:13 smithi179 ceph-mon[35716]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T07:07:14.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:13 smithi179 ceph-mon[35716]: from='osd.8 [v2:172.21.15.179:6816/3642931467,v1:172.21.15.179:6817/3642931467]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-19T07:07:14.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:13 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:07:14.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:13 smithi179 ceph-mon[35716]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-19T07:07:14.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:13 smithi179 ceph-mon[35716]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:07:14.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:13 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:14.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:13 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:14.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:13 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:07:14.274 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:13 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:07:14.274 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:13 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:07:14.274 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:13 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:14.274 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:13 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:07:14.274 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:13 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:07:14.274 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:13 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:14.274 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:13 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:07:14.274 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:13 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:07:14.274 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:13 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:07:14.274 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:13 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:14.274 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:13 smithi179 ceph-mon[35716]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-09-19T07:07:14.274 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:13 smithi179 ceph-mon[35716]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T07:07:14.274 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:13 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:07:14.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:13 smithi165 ceph-mon[35326]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T07:07:14.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:13 smithi165 ceph-mon[35326]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T07:07:14.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:13 smithi165 ceph-mon[35326]: from='osd.8 [v2:172.21.15.179:6816/3642931467,v1:172.21.15.179:6817/3642931467]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-19T07:07:14.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:13 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:07:14.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:13 smithi165 ceph-mon[35326]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-19T07:07:14.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:13 smithi165 ceph-mon[35326]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:07:14.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:13 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:14.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:13 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:14.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:13 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:07:14.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:13 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:07:14.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:13 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:07:14.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:13 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:14.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:13 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:07:14.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:13 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:07:14.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:13 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:14.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:13 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:07:14.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:13 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:07:14.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:13 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:07:14.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:13 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:14.386 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:13 smithi165 ceph-mon[35326]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-09-19T07:07:14.386 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:13 smithi165 ceph-mon[35326]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T07:07:14.386 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:13 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:07:15.022 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:07:14 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:07:14.748+0000 7fb32a99e640 -1 osd.8 0 waiting for initial osdmap 2024-09-19T07:07:15.023 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:07:14 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:07:14.763+0000 7fb322fd0640 -1 osd.8 52 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T07:07:15.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:14 smithi179 ceph-mon[35716]: Detected new or changed devices on smithi179 2024-09-19T07:07:15.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:14 smithi179 ceph-mon[35716]: Adjusting osd_memory_target on smithi179 to 5696M 2024-09-19T07:07:15.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:14 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:07:15.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:14 smithi179 ceph-mon[35716]: from='client.14409 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:07:15.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:14 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:07:15.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:14 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:07:15.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:14 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:07:15.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:14 smithi179 ceph-mon[35716]: from='osd.8 ' entity='osd.8' 2024-09-19T07:07:15.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:14 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:07:15.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:14 smithi148 ceph-mon[31180]: Detected new or changed devices on smithi179 2024-09-19T07:07:15.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:14 smithi148 ceph-mon[31180]: Adjusting osd_memory_target on smithi179 to 5696M 2024-09-19T07:07:15.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:14 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:07:15.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:14 smithi148 ceph-mon[31180]: from='client.14409 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:07:15.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:14 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:07:15.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:14 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:07:15.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:14 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:07:15.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:14 smithi148 ceph-mon[31180]: from='osd.8 ' entity='osd.8' 2024-09-19T07:07:15.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:14 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:07:15.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:14 smithi165 ceph-mon[35326]: Detected new or changed devices on smithi179 2024-09-19T07:07:15.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:14 smithi165 ceph-mon[35326]: Adjusting osd_memory_target on smithi179 to 5696M 2024-09-19T07:07:15.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:14 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:07:15.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:14 smithi165 ceph-mon[35326]: from='client.14409 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:07:15.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:14 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:07:15.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:14 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:07:15.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:14 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:07:15.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:14 smithi165 ceph-mon[35326]: from='osd.8 ' entity='osd.8' 2024-09-19T07:07:15.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:14 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:07:16.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:15 smithi148 ceph-mon[31180]: purged_snaps scrub starts 2024-09-19T07:07:16.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:15 smithi148 ceph-mon[31180]: purged_snaps scrub ok 2024-09-19T07:07:16.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:15 smithi148 ceph-mon[31180]: osd.8 [v2:172.21.15.179:6816/3642931467,v1:172.21.15.179:6817/3642931467] boot 2024-09-19T07:07:16.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:15 smithi148 ceph-mon[31180]: osdmap e53: 9 total, 9 up, 9 in 2024-09-19T07:07:16.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:15 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:07:16.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:15 smithi148 ceph-mon[31180]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:07:16.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:15 smithi179 ceph-mon[35716]: purged_snaps scrub starts 2024-09-19T07:07:16.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:15 smithi179 ceph-mon[35716]: purged_snaps scrub ok 2024-09-19T07:07:16.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:15 smithi179 ceph-mon[35716]: osd.8 [v2:172.21.15.179:6816/3642931467,v1:172.21.15.179:6817/3642931467] boot 2024-09-19T07:07:16.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:15 smithi179 ceph-mon[35716]: osdmap e53: 9 total, 9 up, 9 in 2024-09-19T07:07:16.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:15 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:07:16.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:15 smithi179 ceph-mon[35716]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:07:16.285 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:15 smithi165 ceph-mon[35326]: purged_snaps scrub starts 2024-09-19T07:07:16.285 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:15 smithi165 ceph-mon[35326]: purged_snaps scrub ok 2024-09-19T07:07:16.285 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:15 smithi165 ceph-mon[35326]: osd.8 [v2:172.21.15.179:6816/3642931467,v1:172.21.15.179:6817/3642931467] boot 2024-09-19T07:07:16.285 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:15 smithi165 ceph-mon[35326]: osdmap e53: 9 total, 9 up, 9 in 2024-09-19T07:07:16.286 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:15 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:07:16.286 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:15 smithi165 ceph-mon[35326]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:07:17.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:16 smithi148 ceph-mon[31180]: osdmap e54: 9 total, 9 up, 9 in 2024-09-19T07:07:17.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:16 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/150274107' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ef488c5e-5353-4695-99dd-5b74ade436d7"}]: dispatch 2024-09-19T07:07:17.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:16 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/150274107' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ef488c5e-5353-4695-99dd-5b74ade436d7"}]': finished 2024-09-19T07:07:17.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:16 smithi148 ceph-mon[31180]: osdmap e55: 10 total, 9 up, 10 in 2024-09-19T07:07:17.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:16 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:07:17.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:16 smithi179 ceph-mon[35716]: osdmap e54: 9 total, 9 up, 9 in 2024-09-19T07:07:17.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:16 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/150274107' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ef488c5e-5353-4695-99dd-5b74ade436d7"}]: dispatch 2024-09-19T07:07:17.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:16 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/150274107' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ef488c5e-5353-4695-99dd-5b74ade436d7"}]': finished 2024-09-19T07:07:17.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:16 smithi179 ceph-mon[35716]: osdmap e55: 10 total, 9 up, 10 in 2024-09-19T07:07:17.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:16 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:07:17.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:16 smithi165 ceph-mon[35326]: osdmap e54: 9 total, 9 up, 9 in 2024-09-19T07:07:17.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:16 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/150274107' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ef488c5e-5353-4695-99dd-5b74ade436d7"}]: dispatch 2024-09-19T07:07:17.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:16 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/150274107' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ef488c5e-5353-4695-99dd-5b74ade436d7"}]': finished 2024-09-19T07:07:17.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:16 smithi165 ceph-mon[35326]: osdmap e55: 10 total, 9 up, 10 in 2024-09-19T07:07:17.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:16 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:07:18.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:17 smithi179 ceph-mon[35716]: pgmap v185: 1 pgs: 1 remapped+peering; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:07:18.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:17 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/1615997379' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:07:18.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:17 smithi148 ceph-mon[31180]: pgmap v185: 1 pgs: 1 remapped+peering; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:07:18.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:17 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/1615997379' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:07:18.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:17 smithi165 ceph-mon[35326]: pgmap v185: 1 pgs: 1 remapped+peering; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:07:18.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:17 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/1615997379' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:07:19.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:18 smithi179 ceph-mon[35716]: osdmap e56: 10 total, 9 up, 10 in 2024-09-19T07:07:19.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:18 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:07:19.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:18 smithi148 ceph-mon[31180]: osdmap e56: 10 total, 9 up, 10 in 2024-09-19T07:07:19.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:18 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:07:19.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:18 smithi165 ceph-mon[35326]: osdmap e56: 10 total, 9 up, 10 in 2024-09-19T07:07:19.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:18 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:07:20.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:19 smithi179 ceph-mon[35716]: osdmap e57: 10 total, 9 up, 10 in 2024-09-19T07:07:20.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:19 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:07:20.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:19 smithi179 ceph-mon[35716]: pgmap v188: 1 pgs: 1 remapped+peering; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:07:20.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:19 smithi148 ceph-mon[31180]: osdmap e57: 10 total, 9 up, 10 in 2024-09-19T07:07:20.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:19 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:07:20.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:19 smithi148 ceph-mon[31180]: pgmap v188: 1 pgs: 1 remapped+peering; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:07:20.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:19 smithi165 ceph-mon[35326]: osdmap e57: 10 total, 9 up, 10 in 2024-09-19T07:07:20.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:19 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:07:20.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:19 smithi165 ceph-mon[35326]: pgmap v188: 1 pgs: 1 remapped+peering; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:07:22.324 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:22 smithi148 ceph-mon[31180]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-09-19T07:07:22.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:22 smithi165 ceph-mon[35326]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-09-19T07:07:22.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:22 smithi179 ceph-mon[35716]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-09-19T07:07:24.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:24 smithi165 ceph-mon[35326]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-19T07:07:24.398 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:24 smithi148 ceph-mon[31180]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-19T07:07:24.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:24 smithi179 ceph-mon[35716]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-19T07:07:26.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:26 smithi165 ceph-mon[35326]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T07:07:26.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:26 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T07:07:26.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:26 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:07:26.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:26 smithi179 ceph-mon[35716]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T07:07:26.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:26 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T07:07:26.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:26 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:07:26.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:26 smithi148 ceph-mon[31180]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T07:07:26.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:26 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T07:07:26.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:26 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:07:27.206 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:27 smithi148 ceph-mon[31180]: Deploying daemon osd.9 on smithi148 2024-09-19T07:07:27.946 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:27 smithi165 ceph-mon[35326]: Deploying daemon osd.9 on smithi148 2024-09-19T07:07:27.946 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:27 smithi179 ceph-mon[35716]: Deploying daemon osd.9 on smithi148 2024-09-19T07:07:28.296 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:28 smithi148 ceph-mon[31180]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-19T07:07:28.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:28 smithi165 ceph-mon[35326]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-19T07:07:28.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:28 smithi179 ceph-mon[35716]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-19T07:07:29.275 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:29 smithi148 ceph-mon[31180]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-19T07:07:29.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:29 smithi179 ceph-mon[35716]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-19T07:07:29.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:29 smithi165 ceph-mon[35326]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-19T07:07:32.294 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:32 smithi148 ceph-mon[31180]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T07:07:32.294 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:32 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:07:32.294 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:32 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:32.295 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:32 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:32.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:32 smithi165 ceph-mon[35326]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T07:07:32.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:32 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:07:32.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:32 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:32.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:32 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:32.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:32 smithi179 ceph-mon[35716]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T07:07:32.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:32 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:07:32.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:32 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:32.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:32 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:34.330 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:34 smithi148 ceph-mon[31180]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:07:34.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:34 smithi165 ceph-mon[35326]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:07:34.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:34 smithi179 ceph-mon[35716]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:07:35.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:35.296+0000 7f06767fc640 1 -- 172.21.15.148:0/3176944640 <== mgr.14148 v2:172.21.15.148:6800/3007822654 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f067806a770 con 0x7f06600a3270 2024-09-19T07:07:35.297 INFO:teuthology.orchestra.run.smithi148.stdout:Created osd(s) 9 on host 'smithi148' 2024-09-19T07:07:35.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:35.298+0000 7f067f4a6640 1 -- 172.21.15.148:0/3176944640 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f06600a3270 msgr2=0x7f06600a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:35.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:35.298+0000 7f067f4a6640 1 --2- 172.21.15.148:0/3176944640 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f06600a3270 0x7f06600a5730 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0668006010 tx=0x7f0668000f40 comp rx=0 tx=0).stop 2024-09-19T07:07:35.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:35.298+0000 7f067f4a6640 1 -- 172.21.15.148:0/3176944640 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0678102690 msgr2=0x7f067819e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:35.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:35.298+0000 7f067f4a6640 1 --2- 172.21.15.148:0/3176944640 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0678102690 0x7f067819e3a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f067000eb00 tx=0x7f067000ef00 comp rx=0 tx=0).stop 2024-09-19T07:07:35.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:35.299+0000 7f067f4a6640 1 -- 172.21.15.148:0/3176944640 shutdown_connections 2024-09-19T07:07:35.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:35.299+0000 7f067f4a6640 1 --2- 172.21.15.148:0/3176944640 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f06600a3270 0x7f06600a5730 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:35.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:35.299+0000 7f067f4a6640 1 --2- 172.21.15.148:0/3176944640 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0678102690 0x7f067819e3a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:35.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:35.299+0000 7f067f4a6640 1 --2- 172.21.15.148:0/3176944640 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0678101cd0 0x7f0678197320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:35.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:35.299+0000 7f067f4a6640 1 --2- 172.21.15.148:0/3176944640 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0678100ad0 0x7f0678196de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:35.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:35.299+0000 7f067f4a6640 1 -- 172.21.15.148:0/3176944640 >> 172.21.15.148:0/3176944640 conn(0x7f06780fc280 msgr2=0x7f06781050c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:35.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:35.299+0000 7f067f4a6640 1 -- 172.21.15.148:0/3176944640 shutdown_connections 2024-09-19T07:07:35.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:07:35.299+0000 7f067f4a6640 1 -- 172.21.15.148:0/3176944640 wait complete. 2024-09-19T07:07:35.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:35 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:35.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:35 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:35.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:35 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:07:35.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:35 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:07:35.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:35 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:35.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:35 smithi148 ceph-mon[31180]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:07:35.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:35 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:07:35.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:35 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:35.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:35 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:35.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:35 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:35.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:35 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:35.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:35 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:07:35.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:35 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:07:35.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:35 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:35.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:35 smithi179 ceph-mon[35716]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:07:35.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:35 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:07:35.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:35 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:35.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:35 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:35.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:35 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:35.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:35 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:35.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:35 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:07:35.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:35 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:07:35.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:35 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:35.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:35 smithi165 ceph-mon[35326]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:07:35.885 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:35 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:07:35.885 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:35 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:35.885 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:35 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:35.931 DEBUG:teuthology.orchestra.run.smithi148:osd.9> sudo journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@osd.9.service 2024-09-19T07:07:35.934 INFO:tasks.cephadm:Deploying osd.10 on smithi165 with /dev/vg_nvme/lv_1... 2024-09-19T07:07:35.934 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T07:07:36.194 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T07:07:38.308 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:38 smithi165 ceph-mon[35326]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:07:38.309 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:38 smithi165 ceph-mon[35326]: from='osd.9 [v2:172.21.15.148:6826/3135409630,v1:172.21.15.148:6827/3135409630]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T07:07:38.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:38 smithi148 ceph-mon[31180]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:07:38.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:38 smithi148 ceph-mon[31180]: from='osd.9 [v2:172.21.15.148:6826/3135409630,v1:172.21.15.148:6827/3135409630]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T07:07:38.334 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:07:37 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:07:37.959+0000 7f848c326640 -1 osd.9 0 log_to_monitors true 2024-09-19T07:07:38.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:38 smithi179 ceph-mon[35716]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:07:38.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:38 smithi179 ceph-mon[35716]: from='osd.9 [v2:172.21.15.148:6826/3135409630,v1:172.21.15.148:6827/3135409630]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T07:07:38.638 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-19T07:07:38.666 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi165:vg_nvme/lv_1 2024-09-19T07:07:38.925 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T07:07:39.304 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:39 smithi165 ceph-mon[35326]: from='osd.9 [v2:172.21.15.148:6826/3135409630,v1:172.21.15.148:6827/3135409630]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T07:07:39.305 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:39 smithi165 ceph-mon[35326]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T07:07:39.305 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:39 smithi165 ceph-mon[35326]: from='osd.9 [v2:172.21.15.148:6826/3135409630,v1:172.21.15.148:6827/3135409630]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]: dispatch 2024-09-19T07:07:39.305 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:39 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:07:39.305 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:39 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:39.305 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:39 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:39.305 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:39 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:07:39.305 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:39 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:07:39.305 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:39 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:07:39.306 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:39 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:07:39.306 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:39 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:39.306 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:39 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:07:39.306 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:39 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:07:39.306 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:39 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:39.306 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:39 smithi165 ceph-mon[35326]: from='osd.9 [v2:172.21.15.148:6826/3135409630,v1:172.21.15.148:6827/3135409630]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-19T07:07:39.442 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:39.439+0000 7f3703b04640 1 -- 172.21.15.165:0/1754544866 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36fc101c00 msgr2=0x7f36fc102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:39.442 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:39.439+0000 7f3703b04640 1 --2- 172.21.15.165:0/1754544866 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36fc101c00 0x7f36fc102000 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f36ec009900 tx=0x7f36ec02a410 comp rx=0 tx=0).stop 2024-09-19T07:07:39.442 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:39.439+0000 7f3703b04640 1 -- 172.21.15.165:0/1754544866 shutdown_connections 2024-09-19T07:07:39.443 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:39.439+0000 7f3703b04640 1 --2- 172.21.15.165:0/1754544866 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36fc1037c0 0x7f36fc10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:39.443 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:39.439+0000 7f3703b04640 1 --2- 172.21.15.165:0/1754544866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36fc102e00 0x7f36fc103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:39.443 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:39.439+0000 7f3703b04640 1 --2- 172.21.15.165:0/1754544866 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36fc101c00 0x7f36fc102000 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:39.443 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:39.439+0000 7f3703b04640 1 -- 172.21.15.165:0/1754544866 >> 172.21.15.165:0/1754544866 conn(0x7f36fc0fd390 msgr2=0x7f36fc0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:39.443 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:39.439+0000 7f3703b04640 1 -- 172.21.15.165:0/1754544866 shutdown_connections 2024-09-19T07:07:39.443 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:39.439+0000 7f3703b04640 1 -- 172.21.15.165:0/1754544866 wait complete. 2024-09-19T07:07:39.443 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:39.440+0000 7f3703b04640 1 Processor -- start 2024-09-19T07:07:39.443 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:39.440+0000 7f3703b04640 1 -- start start 2024-09-19T07:07:39.443 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:39.440+0000 7f3703b04640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36fc101c00 0x7f36fc197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:39.443 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:39.440+0000 7f3703b04640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36fc102e00 0x7f36fc198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:39.443 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:39.440+0000 7f3703b04640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36fc1037c0 0x7f36fc19f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:39.444 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:39.440+0000 7f3703b04640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f36fc10d860 con 0x7f36fc102e00 2024-09-19T07:07:39.444 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:39.440+0000 7f3703b04640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f36fc10d6e0 con 0x7f36fc1037c0 2024-09-19T07:07:39.444 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:39.440+0000 7f3703b04640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f36fc10d9e0 con 0x7f36fc101c00 2024-09-19T07:07:39.444 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:39.440+0000 7f37020a1640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36fc1037c0 0x7f36fc19f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:39.444 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:39.440+0000 7f37020a1640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36fc1037c0 0x7f36fc19f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.165:34472/0 (socket says 172.21.15.165:34472) 2024-09-19T07:07:39.444 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:39.440+0000 7f37020a1640 1 -- 172.21.15.165:0/3104169503 learned_addr learned my addr 172.21.15.165:0/3104169503 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-19T07:07:39.444 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:39.440+0000 7f370109f640 1 --2- 172.21.15.165:0/3104169503 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36fc102e00 0x7f36fc198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:39.444 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:39.440+0000 7f37018a0640 1 --2- 172.21.15.165:0/3104169503 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36fc101c00 0x7f36fc197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:39.444 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:39.441+0000 7f37020a1640 1 -- 172.21.15.165:0/3104169503 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36fc101c00 msgr2=0x7f36fc197f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:39.444 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:39.441+0000 7f37020a1640 1 --2- 172.21.15.165:0/3104169503 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36fc101c00 0x7f36fc197f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:39.444 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:39.441+0000 7f37020a1640 1 -- 172.21.15.165:0/3104169503 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36fc102e00 msgr2=0x7f36fc198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:39.444 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:39.441+0000 7f37020a1640 1 --2- 172.21.15.165:0/3104169503 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36fc102e00 0x7f36fc198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:39.445 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:39.441+0000 7f37020a1640 1 -- 172.21.15.165:0/3104169503 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36fc19fb30 con 0x7f36fc1037c0 2024-09-19T07:07:39.445 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:39.441+0000 7f370109f640 1 --2- 172.21.15.165:0/3104169503 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36fc102e00 0x7f36fc198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:07:39.445 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:39.441+0000 7f37020a1640 1 --2- 172.21.15.165:0/3104169503 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36fc1037c0 0x7f36fc19f4c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f36f400eaa0 tx=0x7f36f400ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:39.445 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:39.441+0000 7f36f2ffd640 1 -- 172.21.15.165:0/3104169503 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f400cdb0 con 0x7f36fc1037c0 2024-09-19T07:07:39.445 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:39.441+0000 7f36f2ffd640 1 -- 172.21.15.165:0/3104169503 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36f4005020 con 0x7f36fc1037c0 2024-09-19T07:07:39.445 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:39.441+0000 7f3703b04640 1 -- 172.21.15.165:0/3104169503 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36fc19fe20 con 0x7f36fc1037c0 2024-09-19T07:07:39.445 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:39.441+0000 7f36f2ffd640 1 -- 172.21.15.165:0/3104169503 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f40116b0 con 0x7f36fc1037c0 2024-09-19T07:07:39.445 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:39.441+0000 7f3703b04640 1 -- 172.21.15.165:0/3104169503 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36fc1a0280 con 0x7f36fc1037c0 2024-09-19T07:07:39.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:39.442+0000 7f3703b04640 1 -- 172.21.15.165:0/3104169503 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36fc109000 con 0x7f36fc1037c0 2024-09-19T07:07:39.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:39.443+0000 7f36f2ffd640 1 -- 172.21.15.165:0/3104169503 <== mon.2 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f36f4005560 con 0x7f36fc1037c0 2024-09-19T07:07:39.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:39.444+0000 7f36f2ffd640 1 --2- 172.21.15.165:0/3104169503 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f36e80a3270 0x7f36e80a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:39.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:39.444+0000 7f37018a0640 1 --2- 172.21.15.165:0/3104169503 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f36e80a3270 0x7f36e80a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:39.447 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:39.444+0000 7f36f2ffd640 1 -- 172.21.15.165:0/3104169503 <== mon.2 v2:172.21.15.165:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5981+0+0 (secure 0 0 0) 0x7f36f40cf5b0 con 0x7f36fc1037c0 2024-09-19T07:07:39.447 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:39.445+0000 7f37018a0640 1 --2- 172.21.15.165:0/3104169503 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f36e80a3270 0x7f36e80a5730 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f36ec005ab0 tx=0x7f36ec000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:39.448 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:39.448+0000 7f36f2ffd640 1 -- 172.21.15.165:0/3104169503 <== mon.2 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f36f4016030 con 0x7f36fc1037c0 2024-09-19T07:07:39.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:39 smithi179 ceph-mon[35716]: from='osd.9 [v2:172.21.15.148:6826/3135409630,v1:172.21.15.148:6827/3135409630]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T07:07:39.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:39 smithi179 ceph-mon[35716]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T07:07:39.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:39 smithi179 ceph-mon[35716]: from='osd.9 [v2:172.21.15.148:6826/3135409630,v1:172.21.15.148:6827/3135409630]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]: dispatch 2024-09-19T07:07:39.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:39 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:07:39.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:39 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:39.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:39 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:39.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:39 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:07:39.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:39 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:07:39.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:39 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:07:39.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:39 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:07:39.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:39 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:39.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:39 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:07:39.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:39 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:07:39.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:39 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:39.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:39 smithi179 ceph-mon[35716]: from='osd.9 [v2:172.21.15.148:6826/3135409630,v1:172.21.15.148:6827/3135409630]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-19T07:07:39.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:39 smithi148 ceph-mon[31180]: from='osd.9 [v2:172.21.15.148:6826/3135409630,v1:172.21.15.148:6827/3135409630]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T07:07:39.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:39 smithi148 ceph-mon[31180]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T07:07:39.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:39 smithi148 ceph-mon[31180]: from='osd.9 [v2:172.21.15.148:6826/3135409630,v1:172.21.15.148:6827/3135409630]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]: dispatch 2024-09-19T07:07:39.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:39 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:07:39.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:39 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:39.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:39 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:39.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:39 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:07:39.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:39 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:07:39.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:39 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:07:39.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:39 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:07:39.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:39 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:39.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:39 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:07:39.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:39 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:07:39.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:39 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:39.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:39 smithi148 ceph-mon[31180]: from='osd.9 [v2:172.21.15.148:6826/3135409630,v1:172.21.15.148:6827/3135409630]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-19T07:07:39.622 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:39.621+0000 7f3703b04640 1 -- 172.21.15.165:0/3104169503 --> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi165:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f36fc062630 con 0x7f36e80a3270 2024-09-19T07:07:40.158 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:07:39 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:07:39.886+0000 7f8487a86640 -1 osd.9 0 waiting for initial osdmap 2024-09-19T07:07:40.158 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:07:39 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:07:39.900+0000 7f84800b8640 -1 osd.9 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T07:07:40.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:40 smithi165 ceph-mon[35326]: Detected new or changed devices on smithi148 2024-09-19T07:07:40.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:40 smithi165 ceph-mon[35326]: Adjusting osd_memory_target on smithi148 to 4272M 2024-09-19T07:07:40.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:40 smithi165 ceph-mon[35326]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:07:40.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:40 smithi165 ceph-mon[35326]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T07:07:40.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:40 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:07:40.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:40 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:07:40.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:40 smithi165 ceph-mon[35326]: from='client.24299 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi165:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:07:40.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:40 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:07:40.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:40 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:07:40.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:40 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:07:40.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:40 smithi165 ceph-mon[35326]: from='osd.9 [v2:172.21.15.148:6826/3135409630,v1:172.21.15.148:6827/3135409630]' entity='osd.9' 2024-09-19T07:07:40.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:40 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:07:40.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:40 smithi179 ceph-mon[35716]: Detected new or changed devices on smithi148 2024-09-19T07:07:40.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:40 smithi179 ceph-mon[35716]: Adjusting osd_memory_target on smithi148 to 4272M 2024-09-19T07:07:40.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:40 smithi179 ceph-mon[35716]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:07:40.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:40 smithi179 ceph-mon[35716]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T07:07:40.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:40 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:07:40.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:40 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:07:40.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:40 smithi179 ceph-mon[35716]: from='client.24299 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi165:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:07:40.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:40 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:07:40.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:40 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:07:40.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:40 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:07:40.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:40 smithi179 ceph-mon[35716]: from='osd.9 [v2:172.21.15.148:6826/3135409630,v1:172.21.15.148:6827/3135409630]' entity='osd.9' 2024-09-19T07:07:40.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:40 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:07:40.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:40 smithi148 ceph-mon[31180]: Detected new or changed devices on smithi148 2024-09-19T07:07:40.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:40 smithi148 ceph-mon[31180]: Adjusting osd_memory_target on smithi148 to 4272M 2024-09-19T07:07:40.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:40 smithi148 ceph-mon[31180]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:07:40.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:40 smithi148 ceph-mon[31180]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T07:07:40.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:40 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:07:40.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:40 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:07:40.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:40 smithi148 ceph-mon[31180]: from='client.24299 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi165:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:07:40.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:40 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:07:40.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:40 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:07:40.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:40 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:07:40.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:40 smithi148 ceph-mon[31180]: from='osd.9 [v2:172.21.15.148:6826/3135409630,v1:172.21.15.148:6827/3135409630]' entity='osd.9' 2024-09-19T07:07:40.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:40 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:07:42.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:41 smithi165 ceph-mon[35326]: purged_snaps scrub starts 2024-09-19T07:07:42.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:41 smithi165 ceph-mon[35326]: purged_snaps scrub ok 2024-09-19T07:07:42.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:41 smithi165 ceph-mon[35326]: osd.9 [v2:172.21.15.148:6826/3135409630,v1:172.21.15.148:6827/3135409630] boot 2024-09-19T07:07:42.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:41 smithi165 ceph-mon[35326]: osdmap e60: 10 total, 10 up, 10 in 2024-09-19T07:07:42.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:41 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:07:42.135 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:41 smithi165 ceph-mon[35326]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:07:42.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:41 smithi179 ceph-mon[35716]: purged_snaps scrub starts 2024-09-19T07:07:42.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:41 smithi179 ceph-mon[35716]: purged_snaps scrub ok 2024-09-19T07:07:42.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:41 smithi179 ceph-mon[35716]: osd.9 [v2:172.21.15.148:6826/3135409630,v1:172.21.15.148:6827/3135409630] boot 2024-09-19T07:07:42.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:41 smithi179 ceph-mon[35716]: osdmap e60: 10 total, 10 up, 10 in 2024-09-19T07:07:42.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:41 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:07:42.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:41 smithi179 ceph-mon[35716]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:07:42.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:41 smithi148 ceph-mon[31180]: purged_snaps scrub starts 2024-09-19T07:07:42.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:41 smithi148 ceph-mon[31180]: purged_snaps scrub ok 2024-09-19T07:07:42.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:41 smithi148 ceph-mon[31180]: osd.9 [v2:172.21.15.148:6826/3135409630,v1:172.21.15.148:6827/3135409630] boot 2024-09-19T07:07:42.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:41 smithi148 ceph-mon[31180]: osdmap e60: 10 total, 10 up, 10 in 2024-09-19T07:07:42.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:41 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:07:42.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:41 smithi148 ceph-mon[31180]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:07:43.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:42 smithi179 ceph-mon[35716]: osdmap e61: 10 total, 10 up, 10 in 2024-09-19T07:07:43.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:42 smithi179 ceph-mon[35716]: from='client.? 172.21.15.165:0/3213545521' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a9f0379-1199-4266-910c-8d1d313d39e4"}]: dispatch 2024-09-19T07:07:43.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:42 smithi179 ceph-mon[35716]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a9f0379-1199-4266-910c-8d1d313d39e4"}]: dispatch 2024-09-19T07:07:43.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:42 smithi179 ceph-mon[35716]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7a9f0379-1199-4266-910c-8d1d313d39e4"}]': finished 2024-09-19T07:07:43.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:42 smithi179 ceph-mon[35716]: osdmap e62: 11 total, 10 up, 11 in 2024-09-19T07:07:43.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:42 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:07:43.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:42 smithi179 ceph-mon[35716]: from='client.? 172.21.15.165:0/3616877033' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:07:43.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:42 smithi148 ceph-mon[31180]: osdmap e61: 10 total, 10 up, 10 in 2024-09-19T07:07:43.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:42 smithi148 ceph-mon[31180]: from='client.? 172.21.15.165:0/3213545521' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a9f0379-1199-4266-910c-8d1d313d39e4"}]: dispatch 2024-09-19T07:07:43.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:42 smithi148 ceph-mon[31180]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a9f0379-1199-4266-910c-8d1d313d39e4"}]: dispatch 2024-09-19T07:07:43.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:42 smithi148 ceph-mon[31180]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7a9f0379-1199-4266-910c-8d1d313d39e4"}]': finished 2024-09-19T07:07:43.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:42 smithi148 ceph-mon[31180]: osdmap e62: 11 total, 10 up, 11 in 2024-09-19T07:07:43.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:42 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:07:43.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:42 smithi148 ceph-mon[31180]: from='client.? 172.21.15.165:0/3616877033' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:07:43.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:42 smithi165 ceph-mon[35326]: osdmap e61: 10 total, 10 up, 10 in 2024-09-19T07:07:43.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:42 smithi165 ceph-mon[35326]: from='client.? 172.21.15.165:0/3213545521' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a9f0379-1199-4266-910c-8d1d313d39e4"}]: dispatch 2024-09-19T07:07:43.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:42 smithi165 ceph-mon[35326]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a9f0379-1199-4266-910c-8d1d313d39e4"}]: dispatch 2024-09-19T07:07:43.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:42 smithi165 ceph-mon[35326]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7a9f0379-1199-4266-910c-8d1d313d39e4"}]': finished 2024-09-19T07:07:43.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:42 smithi165 ceph-mon[35326]: osdmap e62: 11 total, 10 up, 11 in 2024-09-19T07:07:43.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:42 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:07:43.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:42 smithi165 ceph-mon[35326]: from='client.? 172.21.15.165:0/3616877033' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:07:44.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:43 smithi179 ceph-mon[35716]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:07:44.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:43 smithi148 ceph-mon[31180]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:07:44.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:43 smithi165 ceph-mon[35326]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:07:46.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:46 smithi165 ceph-mon[35326]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:07:46.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:46 smithi179 ceph-mon[35716]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:07:46.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:46 smithi148 ceph-mon[31180]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:07:48.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:48 smithi165 ceph-mon[35326]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:07:48.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:48 smithi179 ceph-mon[35716]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:07:48.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:48 smithi148 ceph-mon[31180]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:07:50.381 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:50 smithi165 ceph-mon[35326]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:07:50.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:50 smithi179 ceph-mon[35716]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:07:50.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:50 smithi148 ceph-mon[31180]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:07:51.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:51 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T07:07:51.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:51 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:07:51.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:51 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T07:07:51.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:51 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:07:51.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:51 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T07:07:51.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:51 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:07:52.328 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:52 smithi165 ceph-mon[35326]: Deploying daemon osd.10 on smithi165 2024-09-19T07:07:52.328 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:52 smithi165 ceph-mon[35326]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:07:52.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:52 smithi179 ceph-mon[35716]: Deploying daemon osd.10 on smithi165 2024-09-19T07:07:52.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:52 smithi179 ceph-mon[35716]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:07:52.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:52 smithi148 ceph-mon[31180]: Deploying daemon osd.10 on smithi165 2024-09-19T07:07:52.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:52 smithi148 ceph-mon[31180]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:07:53.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:53 smithi165 ceph-mon[35326]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:07:53.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:53 smithi179 ceph-mon[35716]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:07:53.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:53 smithi148 ceph-mon[31180]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:07:56.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:56 smithi165 ceph-mon[35326]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:07:56.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:56 smithi179 ceph-mon[35716]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:07:56.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:56 smithi148 ceph-mon[31180]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:07:57.229 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:57 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:07:57.229 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:57 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:57.229 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:57 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:57.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:57 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:07:57.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:57 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:57.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:57 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:57.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:57 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:07:57.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:57 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:57.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:57 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:07:58.222 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:07:58 smithi165 ceph-mon[35326]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:07:58.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:07:58 smithi179 ceph-mon[35716]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:07:58.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:07:58 smithi148 ceph-mon[31180]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:07:59.993 INFO:teuthology.orchestra.run.smithi165.stdout:Created osd(s) 10 on host 'smithi165' 2024-09-19T07:07:59.993 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:59.992+0000 7f36f2ffd640 1 -- 172.21.15.165:0/3104169503 <== mgr.14148 v2:172.21.15.148:6800/3007822654 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f36fc062630 con 0x7f36e80a3270 2024-09-19T07:07:59.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:59.994+0000 7f3703b04640 1 -- 172.21.15.165:0/3104169503 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f36e80a3270 msgr2=0x7f36e80a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:59.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:59.994+0000 7f3703b04640 1 --2- 172.21.15.165:0/3104169503 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f36e80a3270 0x7f36e80a5730 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f36ec005ab0 tx=0x7f36ec000bc0 comp rx=0 tx=0).stop 2024-09-19T07:07:59.995 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:59.994+0000 7f3703b04640 1 -- 172.21.15.165:0/3104169503 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36fc1037c0 msgr2=0x7f36fc19f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:59.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:59.994+0000 7f3703b04640 1 --2- 172.21.15.165:0/3104169503 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36fc1037c0 0x7f36fc19f4c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f36f400eaa0 tx=0x7f36f400ef60 comp rx=0 tx=0).stop 2024-09-19T07:07:59.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:59.995+0000 7f3703b04640 1 -- 172.21.15.165:0/3104169503 shutdown_connections 2024-09-19T07:07:59.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:59.995+0000 7f3703b04640 1 --2- 172.21.15.165:0/3104169503 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f36e80a3270 0x7f36e80a5730 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:59.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:59.995+0000 7f3703b04640 1 --2- 172.21.15.165:0/3104169503 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36fc1037c0 0x7f36fc19f4c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:59.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:59.995+0000 7f3703b04640 1 --2- 172.21.15.165:0/3104169503 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36fc102e00 0x7f36fc198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:59.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:59.995+0000 7f3703b04640 1 --2- 172.21.15.165:0/3104169503 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36fc101c00 0x7f36fc197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:59.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:59.995+0000 7f3703b04640 1 -- 172.21.15.165:0/3104169503 >> 172.21.15.165:0/3104169503 conn(0x7f36fc0fd390 msgr2=0x7f36fc1061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:59.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:59.995+0000 7f3703b04640 1 -- 172.21.15.165:0/3104169503 shutdown_connections 2024-09-19T07:07:59.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-19T07:07:59.995+0000 7f3703b04640 1 -- 172.21.15.165:0/3104169503 wait complete. 2024-09-19T07:08:00.273 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:00 smithi165 ceph-mon[35326]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:08:00.273 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:00 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:00.273 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:00 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:00.273 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:00 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:00.273 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:00 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:00.386 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:00 smithi148 ceph-mon[31180]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:08:00.387 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:00 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:00.387 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:00 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:00.387 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:00 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:00.387 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:00 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:00.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:00 smithi179 ceph-mon[35716]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:08:00.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:00 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:00.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:00 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:00.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:00 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:00.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:00 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:00.542 DEBUG:teuthology.orchestra.run.smithi165:osd.10> sudo journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@osd.10.service 2024-09-19T07:08:00.544 INFO:tasks.cephadm:Deploying osd.11 on smithi179 with /dev/vg_nvme/lv_1... 2024-09-19T07:08:00.544 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T07:08:00.798 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:08:02.207 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:02 smithi165 ceph-mon[35326]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:08:02.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:02 smithi179 ceph-mon[35716]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:08:02.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:02 smithi148 ceph-mon[31180]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:08:03.134 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:08:02 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:08:02.786+0000 7f7e221c4640 -1 osd.10 0 log_to_monitors true 2024-09-19T07:08:03.467 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:03 smithi179 ceph-mon[35716]: from='osd.10 [v2:172.21.15.165:6824/3554110731,v1:172.21.15.165:6825/3554110731]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T07:08:03.467 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:03 smithi179 ceph-mon[35716]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T07:08:03.470 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-19T07:08:03.497 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi179:vg_nvme/lv_1 2024-09-19T07:08:03.569 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:03 smithi165 ceph-mon[35326]: from='osd.10 [v2:172.21.15.165:6824/3554110731,v1:172.21.15.165:6825/3554110731]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T07:08:03.569 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:03 smithi165 ceph-mon[35326]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T07:08:03.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:03 smithi148 ceph-mon[31180]: from='osd.10 [v2:172.21.15.165:6824/3554110731,v1:172.21.15.165:6825/3554110731]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T07:08:03.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:03 smithi148 ceph-mon[31180]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T07:08:03.760 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:08:04.247 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:04.224+0000 7ff136ede640 1 -- 172.21.15.179:0/4103513452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff130102690 msgr2=0x7ff130108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:04.247 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:04.224+0000 7ff136ede640 1 --2- 172.21.15.179:0/4103513452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff130102690 0x7ff130108f20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff128009ca0 tx=0x7ff12802a8c0 comp rx=0 tx=0).stop 2024-09-19T07:08:04.247 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:04.224+0000 7ff136ede640 1 -- 172.21.15.179:0/4103513452 shutdown_connections 2024-09-19T07:08:04.247 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:04.224+0000 7ff136ede640 1 --2- 172.21.15.179:0/4103513452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff130102690 0x7ff130108f20 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:04.247 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:04.224+0000 7ff136ede640 1 --2- 172.21.15.179:0/4103513452 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff130101cd0 0x7ff130102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:04.247 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:04.224+0000 7ff136ede640 1 --2- 172.21.15.179:0/4103513452 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff130100ad0 0x7ff130100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:04.248 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:04.224+0000 7ff136ede640 1 -- 172.21.15.179:0/4103513452 >> 172.21.15.179:0/4103513452 conn(0x7ff1300fc280 msgr2=0x7ff1300fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:04.248 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:04.224+0000 7ff136ede640 1 -- 172.21.15.179:0/4103513452 shutdown_connections 2024-09-19T07:08:04.248 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:04.224+0000 7ff136ede640 1 -- 172.21.15.179:0/4103513452 wait complete. 2024-09-19T07:08:04.248 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:04.225+0000 7ff136ede640 1 Processor -- start 2024-09-19T07:08:04.248 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:04.225+0000 7ff136ede640 1 -- start start 2024-09-19T07:08:04.248 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:04.225+0000 7ff136ede640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff130100ad0 0x7ff130197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:04.248 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:04.225+0000 7ff136ede640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff130101cd0 0x7ff1301983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:04.248 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:04.225+0000 7ff136ede640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff130102690 0x7ff13019f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:04.248 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:04.225+0000 7ff136ede640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff13010c730 con 0x7ff130101cd0 2024-09-19T07:08:04.248 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:04.225+0000 7ff136ede640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff13010c5b0 con 0x7ff130102690 2024-09-19T07:08:04.249 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:04.225+0000 7ff136ede640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff13010c8b0 con 0x7ff130100ad0 2024-09-19T07:08:04.249 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:04.225+0000 7ff134c7a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff130100ad0 0x7ff130197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:04.249 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:04.225+0000 7ff134c7a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff130100ad0 0x7ff130197e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:43566/0 (socket says 172.21.15.179:43566) 2024-09-19T07:08:04.249 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:04.225+0000 7ff134c7a640 1 -- 172.21.15.179:0/16517862 learned_addr learned my addr 172.21.15.179:0/16517862 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-09-19T07:08:04.249 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:04.225+0000 7ff13547b640 1 --2- 172.21.15.179:0/16517862 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff130102690 0x7ff13019f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:04.249 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:04.225+0000 7ff12ffff640 1 --2- 172.21.15.179:0/16517862 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff130101cd0 0x7ff1301983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:04.249 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:04.225+0000 7ff134c7a640 1 -- 172.21.15.179:0/16517862 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff130102690 msgr2=0x7ff13019f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:04.249 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:04.225+0000 7ff134c7a640 1 --2- 172.21.15.179:0/16517862 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff130102690 0x7ff13019f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:04.249 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:04.225+0000 7ff134c7a640 1 -- 172.21.15.179:0/16517862 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff130101cd0 msgr2=0x7ff1301983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:04.249 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:04.225+0000 7ff134c7a640 1 --2- 172.21.15.179:0/16517862 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff130101cd0 0x7ff1301983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:04.250 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:04.225+0000 7ff134c7a640 1 -- 172.21.15.179:0/16517862 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff13019fab0 con 0x7ff130100ad0 2024-09-19T07:08:04.250 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:04.226+0000 7ff134c7a640 1 --2- 172.21.15.179:0/16517862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff130100ad0 0x7ff130197e80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff12400d770 tx=0x7ff12400dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:04.250 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:04.226+0000 7ff12dffb640 1 -- 172.21.15.179:0/16517862 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff124017070 con 0x7ff130100ad0 2024-09-19T07:08:04.250 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:04.226+0000 7ff12dffb640 1 -- 172.21.15.179:0/16517862 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff124009c30 con 0x7ff130100ad0 2024-09-19T07:08:04.250 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:04.226+0000 7ff136ede640 1 -- 172.21.15.179:0/16517862 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff13019fda0 con 0x7ff130100ad0 2024-09-19T07:08:04.250 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:04.226+0000 7ff12dffb640 1 -- 172.21.15.179:0/16517862 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff124003dd0 con 0x7ff130100ad0 2024-09-19T07:08:04.250 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:04.226+0000 7ff136ede640 1 -- 172.21.15.179:0/16517862 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff130103260 con 0x7ff130100ad0 2024-09-19T07:08:04.250 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:04.227+0000 7ff136ede640 1 -- 172.21.15.179:0/16517862 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1301034c0 con 0x7ff130100ad0 2024-09-19T07:08:04.250 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:04.228+0000 7ff12dffb640 1 -- 172.21.15.179:0/16517862 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7ff124003f70 con 0x7ff130100ad0 2024-09-19T07:08:04.250 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:04.229+0000 7ff12dffb640 1 --2- 172.21.15.179:0/16517862 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff1200a3270 0x7ff1200a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:04.250 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:04.229+0000 7ff12dffb640 1 -- 172.21.15.179:0/16517862 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6414+0+0 (secure 0 0 0) 0x7ff1240cea50 con 0x7ff130100ad0 2024-09-19T07:08:04.251 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:04.229+0000 7ff12ffff640 1 --2- 172.21.15.179:0/16517862 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff1200a3270 0x7ff1200a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:04.251 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:04.230+0000 7ff12ffff640 1 --2- 172.21.15.179:0/16517862 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff1200a3270 0x7ff1200a5730 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff1301993a0 tx=0x7ff11c005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:04.251 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:04.233+0000 7ff12dffb640 1 -- 172.21.15.179:0/16517862 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff124009de0 con 0x7ff130100ad0 2024-09-19T07:08:04.412 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:04.411+0000 7ff136ede640 1 -- 172.21.15.179:0/16517862 --> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7ff13006a680 con 0x7ff1200a3270 2024-09-19T07:08:04.413 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:04 smithi179 ceph-mon[35716]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:08:04.413 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:04 smithi179 ceph-mon[35716]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T07:08:04.413 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:04 smithi179 ceph-mon[35716]: osdmap e63: 11 total, 10 up, 11 in 2024-09-19T07:08:04.413 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:04 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:08:04.413 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:04 smithi179 ceph-mon[35716]: from='osd.10 [v2:172.21.15.165:6824/3554110731,v1:172.21.15.165:6825/3554110731]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-19T07:08:04.413 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:04 smithi179 ceph-mon[35716]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-19T07:08:04.413 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:04 smithi179 ceph-mon[35716]: Detected new or changed devices on smithi165 2024-09-19T07:08:04.413 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:04 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:04.413 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:04 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:04.413 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:04 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:08:04.414 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:04 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:08:04.414 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:04 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:08:04.414 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:04 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:08:04.414 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:04 smithi179 ceph-mon[35716]: Adjusting osd_memory_target on smithi165 to 4272M 2024-09-19T07:08:04.414 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:04 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:04.414 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:04 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:04.414 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:04 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:08:04.414 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:04 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:04.414 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:04 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:08:04.414 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:04 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:04.414 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:04 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:08:04.414 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:04 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:04.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:04 smithi148 ceph-mon[31180]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:08:04.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:04 smithi148 ceph-mon[31180]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T07:08:04.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:04 smithi148 ceph-mon[31180]: osdmap e63: 11 total, 10 up, 11 in 2024-09-19T07:08:04.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:04 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:08:04.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:04 smithi148 ceph-mon[31180]: from='osd.10 [v2:172.21.15.165:6824/3554110731,v1:172.21.15.165:6825/3554110731]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-19T07:08:04.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:04 smithi148 ceph-mon[31180]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-19T07:08:04.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:04 smithi148 ceph-mon[31180]: Detected new or changed devices on smithi165 2024-09-19T07:08:04.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:04 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:04.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:04 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:04.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:04 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:08:04.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:04 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:08:04.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:04 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:08:04.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:04 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:08:04.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:04 smithi148 ceph-mon[31180]: Adjusting osd_memory_target on smithi165 to 4272M 2024-09-19T07:08:04.585 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:04 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:04.585 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:04 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:04.585 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:04 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:08:04.585 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:04 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:04.585 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:04 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:08:04.585 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:04 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:04.585 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:04 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:08:04.585 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:04 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:04.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:04 smithi165 ceph-mon[35326]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:08:04.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:04 smithi165 ceph-mon[35326]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T07:08:04.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:04 smithi165 ceph-mon[35326]: osdmap e63: 11 total, 10 up, 11 in 2024-09-19T07:08:04.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:04 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:08:04.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:04 smithi165 ceph-mon[35326]: from='osd.10 [v2:172.21.15.165:6824/3554110731,v1:172.21.15.165:6825/3554110731]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-19T07:08:04.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:04 smithi165 ceph-mon[35326]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-19T07:08:04.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:04 smithi165 ceph-mon[35326]: Detected new or changed devices on smithi165 2024-09-19T07:08:04.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:04 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:04.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:04 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:04.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:04 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:08:04.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:04 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:08:04.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:04 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:08:04.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:04 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:08:04.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:04 smithi165 ceph-mon[35326]: Adjusting osd_memory_target on smithi165 to 4272M 2024-09-19T07:08:04.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:04 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:04.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:04 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:04.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:04 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:08:04.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:04 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:04.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:04 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:08:04.636 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:04 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:04.636 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:04 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:08:04.636 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:04 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:05.384 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:08:04 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:08:04.908+0000 7f7e1e95b640 -1 osd.10 0 waiting for initial osdmap 2024-09-19T07:08:05.384 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:08:04 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:08:04.924+0000 7f7e15f56640 -1 osd.10 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T07:08:05.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:05 smithi165 ceph-mon[35326]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]': finished 2024-09-19T07:08:05.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:05 smithi165 ceph-mon[35326]: osdmap e64: 11 total, 10 up, 11 in 2024-09-19T07:08:05.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:05 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:08:05.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:05 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:08:05.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:05 smithi165 ceph-mon[35326]: from='client.24349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:08:05.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:05 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:08:05.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:05 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:08:05.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:05 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:05.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:05 smithi165 ceph-mon[35326]: from='osd.10 ' entity='osd.10' 2024-09-19T07:08:05.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:05 smithi165 ceph-mon[35326]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:08:05.429 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:05 smithi179 ceph-mon[35716]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]': finished 2024-09-19T07:08:05.429 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:05 smithi179 ceph-mon[35716]: osdmap e64: 11 total, 10 up, 11 in 2024-09-19T07:08:05.429 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:05 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:08:05.429 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:05 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:08:05.429 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:05 smithi179 ceph-mon[35716]: from='client.24349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:08:05.429 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:05 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:08:05.429 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:05 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:08:05.429 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:05 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:05.429 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:05 smithi179 ceph-mon[35716]: from='osd.10 ' entity='osd.10' 2024-09-19T07:08:05.429 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:05 smithi179 ceph-mon[35716]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:08:05.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:05 smithi148 ceph-mon[31180]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]': finished 2024-09-19T07:08:05.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:05 smithi148 ceph-mon[31180]: osdmap e64: 11 total, 10 up, 11 in 2024-09-19T07:08:05.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:05 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:08:05.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:05 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:08:05.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:05 smithi148 ceph-mon[31180]: from='client.24349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:08:05.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:05 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:08:05.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:05 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:08:05.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:05 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:05.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:05 smithi148 ceph-mon[31180]: from='osd.10 ' entity='osd.10' 2024-09-19T07:08:05.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:05 smithi148 ceph-mon[31180]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:08:06.425 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:06 smithi179 ceph-mon[35716]: purged_snaps scrub starts 2024-09-19T07:08:06.426 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:06 smithi179 ceph-mon[35716]: purged_snaps scrub ok 2024-09-19T07:08:06.426 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:06 smithi179 ceph-mon[35716]: osd.10 [v2:172.21.15.165:6824/3554110731,v1:172.21.15.165:6825/3554110731] boot 2024-09-19T07:08:06.426 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:06 smithi179 ceph-mon[35716]: osdmap e65: 11 total, 11 up, 11 in 2024-09-19T07:08:06.426 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:06 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:08:06.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:06 smithi148 ceph-mon[31180]: purged_snaps scrub starts 2024-09-19T07:08:06.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:06 smithi148 ceph-mon[31180]: purged_snaps scrub ok 2024-09-19T07:08:06.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:06 smithi148 ceph-mon[31180]: osd.10 [v2:172.21.15.165:6824/3554110731,v1:172.21.15.165:6825/3554110731] boot 2024-09-19T07:08:06.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:06 smithi148 ceph-mon[31180]: osdmap e65: 11 total, 11 up, 11 in 2024-09-19T07:08:06.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:06 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:08:06.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:06 smithi165 ceph-mon[35326]: purged_snaps scrub starts 2024-09-19T07:08:06.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:06 smithi165 ceph-mon[35326]: purged_snaps scrub ok 2024-09-19T07:08:06.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:06 smithi165 ceph-mon[35326]: osd.10 [v2:172.21.15.165:6824/3554110731,v1:172.21.15.165:6825/3554110731] boot 2024-09-19T07:08:06.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:06 smithi165 ceph-mon[35326]: osdmap e65: 11 total, 11 up, 11 in 2024-09-19T07:08:06.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:06 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:08:07.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:07 smithi179 ceph-mon[35716]: osdmap e66: 11 total, 11 up, 11 in 2024-09-19T07:08:07.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:07 smithi179 ceph-mon[35716]: from='client.? 172.21.15.179:0/1632860886' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eede97e9-5685-4603-806e-7078c6940536"}]: dispatch 2024-09-19T07:08:07.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:07 smithi179 ceph-mon[35716]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eede97e9-5685-4603-806e-7078c6940536"}]: dispatch 2024-09-19T07:08:07.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:07 smithi179 ceph-mon[35716]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eede97e9-5685-4603-806e-7078c6940536"}]': finished 2024-09-19T07:08:07.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:07 smithi179 ceph-mon[35716]: osdmap e67: 12 total, 11 up, 12 in 2024-09-19T07:08:07.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:07 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:08:07.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:07 smithi179 ceph-mon[35716]: pgmap v222: 1 pgs: 1 remapped+peering; 577 KiB data, 742 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:08:07.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:07 smithi148 ceph-mon[31180]: osdmap e66: 11 total, 11 up, 11 in 2024-09-19T07:08:07.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:07 smithi148 ceph-mon[31180]: from='client.? 172.21.15.179:0/1632860886' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eede97e9-5685-4603-806e-7078c6940536"}]: dispatch 2024-09-19T07:08:07.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:07 smithi148 ceph-mon[31180]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eede97e9-5685-4603-806e-7078c6940536"}]: dispatch 2024-09-19T07:08:07.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:07 smithi148 ceph-mon[31180]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eede97e9-5685-4603-806e-7078c6940536"}]': finished 2024-09-19T07:08:07.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:07 smithi148 ceph-mon[31180]: osdmap e67: 12 total, 11 up, 12 in 2024-09-19T07:08:07.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:07 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:08:07.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:07 smithi148 ceph-mon[31180]: pgmap v222: 1 pgs: 1 remapped+peering; 577 KiB data, 742 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:08:07.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:07 smithi165 ceph-mon[35326]: osdmap e66: 11 total, 11 up, 11 in 2024-09-19T07:08:07.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:07 smithi165 ceph-mon[35326]: from='client.? 172.21.15.179:0/1632860886' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eede97e9-5685-4603-806e-7078c6940536"}]: dispatch 2024-09-19T07:08:07.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:07 smithi165 ceph-mon[35326]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eede97e9-5685-4603-806e-7078c6940536"}]: dispatch 2024-09-19T07:08:07.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:07 smithi165 ceph-mon[35326]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eede97e9-5685-4603-806e-7078c6940536"}]': finished 2024-09-19T07:08:07.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:07 smithi165 ceph-mon[35326]: osdmap e67: 12 total, 11 up, 12 in 2024-09-19T07:08:07.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:07 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:08:07.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:07 smithi165 ceph-mon[35326]: pgmap v222: 1 pgs: 1 remapped+peering; 577 KiB data, 742 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:08:08.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:08 smithi179 ceph-mon[35716]: from='client.? 172.21.15.179:0/595367455' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:08:08.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:08 smithi148 ceph-mon[31180]: from='client.? 172.21.15.179:0/595367455' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:08:08.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:08 smithi165 ceph-mon[35326]: from='client.? 172.21.15.179:0/595367455' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:08:09.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:09 smithi179 ceph-mon[35716]: osdmap e68: 12 total, 11 up, 12 in 2024-09-19T07:08:09.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:09 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:08:09.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:09 smithi179 ceph-mon[35716]: pgmap v224: 1 pgs: 1 remapped+peering; 577 KiB data, 742 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:08:09.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:09 smithi148 ceph-mon[31180]: osdmap e68: 12 total, 11 up, 12 in 2024-09-19T07:08:09.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:09 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:08:09.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:09 smithi148 ceph-mon[31180]: pgmap v224: 1 pgs: 1 remapped+peering; 577 KiB data, 742 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:08:09.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:09 smithi165 ceph-mon[35326]: osdmap e68: 12 total, 11 up, 12 in 2024-09-19T07:08:09.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:09 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:08:09.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:09 smithi165 ceph-mon[35326]: pgmap v224: 1 pgs: 1 remapped+peering; 577 KiB data, 742 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:08:10.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:10 smithi179 ceph-mon[35716]: osdmap e69: 12 total, 11 up, 12 in 2024-09-19T07:08:10.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:10 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:08:10.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:10 smithi148 ceph-mon[31180]: osdmap e69: 12 total, 11 up, 12 in 2024-09-19T07:08:10.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:10 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:08:10.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:10 smithi165 ceph-mon[35326]: osdmap e69: 12 total, 11 up, 12 in 2024-09-19T07:08:10.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:10 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:08:11.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:11 smithi148 ceph-mon[31180]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-09-19T07:08:11.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:11 smithi165 ceph-mon[35326]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-09-19T07:08:11.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:11 smithi179 ceph-mon[35716]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-09-19T07:08:14.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:14 smithi165 ceph-mon[35326]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-09-19T07:08:14.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:14 smithi179 ceph-mon[35716]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-09-19T07:08:14.585 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:14 smithi148 ceph-mon[31180]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-09-19T07:08:16.284 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:16 smithi179 ceph-mon[35716]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T07:08:16.284 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:16 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T07:08:16.284 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:16 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:16.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:16 smithi165 ceph-mon[35326]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T07:08:16.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:16 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T07:08:16.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:16 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:16.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:16 smithi148 ceph-mon[31180]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T07:08:16.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:16 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T07:08:16.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:16 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:17.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:17 smithi179 ceph-mon[35716]: Deploying daemon osd.11 on smithi179 2024-09-19T07:08:17.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:17 smithi165 ceph-mon[35326]: Deploying daemon osd.11 on smithi179 2024-09-19T07:08:17.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:17 smithi148 ceph-mon[31180]: Deploying daemon osd.11 on smithi179 2024-09-19T07:08:18.255 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:18 smithi179 ceph-mon[35716]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-19T07:08:18.405 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:18 smithi165 ceph-mon[35326]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-19T07:08:18.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:18 smithi148 ceph-mon[31180]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-19T07:08:19.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:19 smithi179 ceph-mon[35716]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T07:08:19.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:19 smithi148 ceph-mon[31180]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T07:08:19.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:19 smithi165 ceph-mon[35326]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T07:08:22.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:22 smithi165 ceph-mon[35326]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-19T07:08:22.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:22 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:08:22.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:22 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:22.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:22 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:22.415 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:22 smithi179 ceph-mon[35716]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-19T07:08:22.415 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:22 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:08:22.415 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:22 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:22.415 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:22 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:22.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:22 smithi148 ceph-mon[31180]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-19T07:08:22.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:22 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:08:22.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:22 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:22.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:22 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:24.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:24 smithi165 ceph-mon[35326]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:08:24.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:24 smithi179 ceph-mon[35716]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:08:24.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:24 smithi148 ceph-mon[31180]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:08:25.232 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:25.231+0000 7ff12dffb640 1 -- 172.21.15.179:0/16517862 <== mgr.14148 v2:172.21.15.148:6800/3007822654 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7ff13006a680 con 0x7ff1200a3270 2024-09-19T07:08:25.233 INFO:teuthology.orchestra.run.smithi179.stdout:Created osd(s) 11 on host 'smithi179' 2024-09-19T07:08:25.238 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:25.233+0000 7ff136ede640 1 -- 172.21.15.179:0/16517862 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff1200a3270 msgr2=0x7ff1200a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:25.238 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:25.233+0000 7ff136ede640 1 --2- 172.21.15.179:0/16517862 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff1200a3270 0x7ff1200a5730 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff1301993a0 tx=0x7ff11c005f90 comp rx=0 tx=0).stop 2024-09-19T07:08:25.239 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:25.233+0000 7ff136ede640 1 -- 172.21.15.179:0/16517862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff130100ad0 msgr2=0x7ff130197e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:25.239 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:25.233+0000 7ff136ede640 1 --2- 172.21.15.179:0/16517862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff130100ad0 0x7ff130197e80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff12400d770 tx=0x7ff12400dc30 comp rx=0 tx=0).stop 2024-09-19T07:08:25.239 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:25.233+0000 7ff136ede640 1 -- 172.21.15.179:0/16517862 shutdown_connections 2024-09-19T07:08:25.239 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:25.233+0000 7ff136ede640 1 --2- 172.21.15.179:0/16517862 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff1200a3270 0x7ff1200a5730 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:25.239 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:25.233+0000 7ff136ede640 1 --2- 172.21.15.179:0/16517862 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff130102690 0x7ff13019f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:25.239 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:25.233+0000 7ff136ede640 1 --2- 172.21.15.179:0/16517862 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff130101cd0 0x7ff1301983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:25.239 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:25.233+0000 7ff136ede640 1 --2- 172.21.15.179:0/16517862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff130100ad0 0x7ff130197e80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:25.239 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:25.233+0000 7ff136ede640 1 -- 172.21.15.179:0/16517862 >> 172.21.15.179:0/16517862 conn(0x7ff1300fc280 msgr2=0x7ff130069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:25.239 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:25.233+0000 7ff136ede640 1 -- 172.21.15.179:0/16517862 shutdown_connections 2024-09-19T07:08:25.240 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:25.233+0000 7ff136ede640 1 -- 172.21.15.179:0/16517862 wait complete. 2024-09-19T07:08:25.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:25 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:25.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:25 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:25.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:25 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:25.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:25 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:08:25.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:25 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:25.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:25 smithi179 ceph-mon[35716]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:08:25.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:25 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:08:25.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:25 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:25.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:25 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:25.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:25 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:25.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:25 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:25.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:25 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:25.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:25 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:08:25.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:25 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:25.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:25 smithi148 ceph-mon[31180]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:08:25.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:25 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:08:25.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:25 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:25.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:25 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:25.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:25 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:25.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:25 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:25.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:25 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:25.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:25 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:08:25.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:25 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:25.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:25 smithi165 ceph-mon[35326]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:08:25.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:25 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:08:25.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:25 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:25.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:25 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:25.980 DEBUG:teuthology.orchestra.run.smithi179:osd.11> sudo journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@osd.11.service 2024-09-19T07:08:25.983 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-19T07:08:25.983 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T07:08:26.245 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:08:26.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.699+0000 7f409620a640 1 -- 172.21.15.148:0/3342026693 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4090101cd0 msgr2=0x7f4090102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:26.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.699+0000 7f409620a640 1 --2- 172.21.15.148:0/3342026693 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4090101cd0 0x7f4090102150 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4084009900 tx=0x7f408402a410 comp rx=0 tx=0).stop 2024-09-19T07:08:26.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.699+0000 7f409620a640 1 -- 172.21.15.148:0/3342026693 shutdown_connections 2024-09-19T07:08:26.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.699+0000 7f409620a640 1 --2- 172.21.15.148:0/3342026693 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4090102690 0x7f4090108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:26.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.699+0000 7f409620a640 1 --2- 172.21.15.148:0/3342026693 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4090101cd0 0x7f4090102150 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:26.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.699+0000 7f409620a640 1 --2- 172.21.15.148:0/3342026693 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4090100ad0 0x7f4090100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:26.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.699+0000 7f409620a640 1 -- 172.21.15.148:0/3342026693 >> 172.21.15.148:0/3342026693 conn(0x7f40900fc280 msgr2=0x7f40900fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:26.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.699+0000 7f409620a640 1 -- 172.21.15.148:0/3342026693 shutdown_connections 2024-09-19T07:08:26.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.699+0000 7f409620a640 1 -- 172.21.15.148:0/3342026693 wait complete. 2024-09-19T07:08:26.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.700+0000 7f409620a640 1 Processor -- start 2024-09-19T07:08:26.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.700+0000 7f409620a640 1 -- start start 2024-09-19T07:08:26.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.701+0000 7f409620a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4090100ad0 0x7f409019a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:26.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.701+0000 7f409620a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4090101cd0 0x7f409019a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:26.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.701+0000 7f409620a640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4090102690 0x7f40901a1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:26.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.701+0000 7f409620a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f409010c7d0 con 0x7f4090101cd0 2024-09-19T07:08:26.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.701+0000 7f409620a640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f409010c650 con 0x7f4090102690 2024-09-19T07:08:26.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.701+0000 7f409620a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f409010c950 con 0x7f4090100ad0 2024-09-19T07:08:26.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.701+0000 7f408f7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4090100ad0 0x7f409019a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:26.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.701+0000 7f408effd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4090101cd0 0x7f409019a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:26.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.701+0000 7f408f7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4090100ad0 0x7f409019a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:55896/0 (socket says 172.21.15.148:55896) 2024-09-19T07:08:26.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.701+0000 7f408f7fe640 1 -- 172.21.15.148:0/2274144912 learned_addr learned my addr 172.21.15.148:0/2274144912 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:08:26.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.701+0000 7f408ffff640 1 --2- 172.21.15.148:0/2274144912 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4090102690 0x7f40901a1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:26.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.701+0000 7f408effd640 1 -- 172.21.15.148:0/2274144912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4090100ad0 msgr2=0x7f409019a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:26.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.701+0000 7f408effd640 1 --2- 172.21.15.148:0/2274144912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4090100ad0 0x7f409019a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:26.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.701+0000 7f408effd640 1 -- 172.21.15.148:0/2274144912 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4090102690 msgr2=0x7f40901a1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:26.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.701+0000 7f408effd640 1 --2- 172.21.15.148:0/2274144912 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4090102690 0x7f40901a1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:26.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.701+0000 7f408effd640 1 -- 172.21.15.148:0/2274144912 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40901a1d80 con 0x7f4090101cd0 2024-09-19T07:08:26.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.701+0000 7f408f7fe640 1 --2- 172.21.15.148:0/2274144912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4090100ad0 0x7f409019a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:08:26.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.701+0000 7f408effd640 1 --2- 172.21.15.148:0/2274144912 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4090101cd0 0x7f409019a690 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4084031440 tx=0x7f40840043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:26.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.702+0000 7f408cff9640 1 -- 172.21.15.148:0/2274144912 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f408403f070 con 0x7f4090101cd0 2024-09-19T07:08:26.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.702+0000 7f408cff9640 1 -- 172.21.15.148:0/2274144912 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f408403b460 con 0x7f4090101cd0 2024-09-19T07:08:26.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.702+0000 7f409620a640 1 -- 172.21.15.148:0/2274144912 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40901a2010 con 0x7f4090101cd0 2024-09-19T07:08:26.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.702+0000 7f408cff9640 1 -- 172.21.15.148:0/2274144912 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4084035070 con 0x7f4090101cd0 2024-09-19T07:08:26.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.702+0000 7f409620a640 1 -- 172.21.15.148:0/2274144912 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40901a2570 con 0x7f4090101cd0 2024-09-19T07:08:26.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.703+0000 7f409620a640 1 -- 172.21.15.148:0/2274144912 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40901a2890 con 0x7f4090101cd0 2024-09-19T07:08:26.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.705+0000 7f408cff9640 1 -- 172.21.15.148:0/2274144912 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f408403b980 con 0x7f4090101cd0 2024-09-19T07:08:26.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.705+0000 7f408cff9640 1 --2- 172.21.15.148:0/2274144912 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f40780a3270 0x7f40780a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:26.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.705+0000 7f408cff9640 1 -- 172.21.15.148:0/2274144912 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6809+0+0 (secure 0 0 0) 0x7f40840efb20 con 0x7f4090101cd0 2024-09-19T07:08:26.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.705+0000 7f408f7fe640 1 --2- 172.21.15.148:0/2274144912 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f40780a3270 0x7f40780a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:26.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.706+0000 7f408f7fe640 1 --2- 172.21.15.148:0/2274144912 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f40780a3270 0x7f40780a5730 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4080005fd0 tx=0x7f408000b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:26.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.708+0000 7f408cff9640 1 -- 172.21.15.148:0/2274144912 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f40840efe20 con 0x7f4090101cd0 2024-09-19T07:08:26.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.880+0000 7f409620a640 1 -- 172.21.15.148:0/2274144912 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f40901a2ef0 con 0x7f4090101cd0 2024-09-19T07:08:26.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.881+0000 7f408cff9640 1 -- 172.21.15.148:0/2274144912 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v69) ==== 74+0+133 (secure 0 0 0) 0x7f40840bc7d0 con 0x7f4090101cd0 2024-09-19T07:08:26.882 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:08:26.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.883+0000 7f409620a640 1 -- 172.21.15.148:0/2274144912 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f40780a3270 msgr2=0x7f40780a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:26.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.883+0000 7f409620a640 1 --2- 172.21.15.148:0/2274144912 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f40780a3270 0x7f40780a5730 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4080005fd0 tx=0x7f408000b410 comp rx=0 tx=0).stop 2024-09-19T07:08:26.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.883+0000 7f409620a640 1 -- 172.21.15.148:0/2274144912 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4090101cd0 msgr2=0x7f409019a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:26.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.883+0000 7f409620a640 1 --2- 172.21.15.148:0/2274144912 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4090101cd0 0x7f409019a690 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4084031440 tx=0x7f40840043b0 comp rx=0 tx=0).stop 2024-09-19T07:08:26.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.884+0000 7f409620a640 1 -- 172.21.15.148:0/2274144912 shutdown_connections 2024-09-19T07:08:26.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.884+0000 7f409620a640 1 --2- 172.21.15.148:0/2274144912 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f40780a3270 0x7f40780a5730 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:26.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.884+0000 7f409620a640 1 --2- 172.21.15.148:0/2274144912 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4090102690 0x7f40901a1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:26.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.884+0000 7f409620a640 1 --2- 172.21.15.148:0/2274144912 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4090101cd0 0x7f409019a690 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:26.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.884+0000 7f409620a640 1 --2- 172.21.15.148:0/2274144912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4090100ad0 0x7f409019a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:26.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.884+0000 7f409620a640 1 -- 172.21.15.148:0/2274144912 >> 172.21.15.148:0/2274144912 conn(0x7f40900fc280 msgr2=0x7f4090069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:26.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.884+0000 7f409620a640 1 -- 172.21.15.148:0/2274144912 shutdown_connections 2024-09-19T07:08:26.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:26.884+0000 7f409620a640 1 -- 172.21.15.148:0/2274144912 wait complete. 2024-09-19T07:08:27.237 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:26 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/2274144912' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T07:08:27.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:26 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/2274144912' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T07:08:27.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:26 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/2274144912' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T07:08:27.599 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":69,"num_osds":12,"num_up_osds":11,"osd_up_since":1726729685,"num_in_osds":12,"osd_in_since":1726729687,"num_remapped_pgs":0} 2024-09-19T07:08:27.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:08:27 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:08:27.732+0000 7f5c2539a640 -1 osd.11 0 log_to_monitors true 2024-09-19T07:08:28.240 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:27 smithi179 ceph-mon[35716]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:08:28.241 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:27 smithi179 ceph-mon[35716]: from='osd.11 [v2:172.21.15.179:6824/2026109940,v1:172.21.15.179:6825/2026109940]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T07:08:28.241 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:27 smithi179 ceph-mon[35716]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T07:08:28.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:27 smithi148 ceph-mon[31180]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:08:28.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:27 smithi148 ceph-mon[31180]: from='osd.11 [v2:172.21.15.179:6824/2026109940,v1:172.21.15.179:6825/2026109940]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T07:08:28.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:27 smithi148 ceph-mon[31180]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T07:08:28.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:27 smithi165 ceph-mon[35326]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:08:28.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:27 smithi165 ceph-mon[35326]: from='osd.11 [v2:172.21.15.179:6824/2026109940,v1:172.21.15.179:6825/2026109940]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T07:08:28.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:27 smithi165 ceph-mon[35326]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T07:08:28.601 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T07:08:28.859 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:08:29.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:28 smithi179 ceph-mon[35716]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T07:08:29.031 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:28 smithi179 ceph-mon[35716]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T07:08:29.031 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:28 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:08:29.031 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:28 smithi179 ceph-mon[35716]: from='osd.11 [v2:172.21.15.179:6824/2026109940,v1:172.21.15.179:6825/2026109940]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-19T07:08:29.031 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:28 smithi179 ceph-mon[35716]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-19T07:08:29.031 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:28 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:29.031 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:28 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:29.031 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:28 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:08:29.031 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:28 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:08:29.031 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:28 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:08:29.032 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:28 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:08:29.032 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:28 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:29.032 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:28 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:29.032 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:28 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:08:29.032 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:28 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:29.217 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:28 smithi148 ceph-mon[31180]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T07:08:29.217 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:28 smithi148 ceph-mon[31180]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T07:08:29.217 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:28 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:08:29.217 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:28 smithi148 ceph-mon[31180]: from='osd.11 [v2:172.21.15.179:6824/2026109940,v1:172.21.15.179:6825/2026109940]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-19T07:08:29.217 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:28 smithi148 ceph-mon[31180]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-19T07:08:29.217 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:28 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:29.217 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:28 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:29.217 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:28 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:08:29.218 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:28 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:08:29.218 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:28 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:08:29.218 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:28 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:08:29.218 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:28 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:29.218 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:28 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:29.218 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:28 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:08:29.218 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:28 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:29.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.297+0000 7fda5ff2e640 1 -- 172.21.15.148:0/3709529103 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda58102690 msgr2=0x7fda58108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:29.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.297+0000 7fda5ff2e640 1 --2- 172.21.15.148:0/3709529103 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda58102690 0x7fda58108f20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fda48009900 tx=0x7fda4802a410 comp rx=0 tx=0).stop 2024-09-19T07:08:29.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.297+0000 7fda5ff2e640 1 -- 172.21.15.148:0/3709529103 shutdown_connections 2024-09-19T07:08:29.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.297+0000 7fda5ff2e640 1 --2- 172.21.15.148:0/3709529103 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda58102690 0x7fda58108f20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:29.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.297+0000 7fda5ff2e640 1 --2- 172.21.15.148:0/3709529103 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda58101cd0 0x7fda58102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:29.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.297+0000 7fda5ff2e640 1 --2- 172.21.15.148:0/3709529103 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda58100ad0 0x7fda58100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:29.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.297+0000 7fda5ff2e640 1 -- 172.21.15.148:0/3709529103 >> 172.21.15.148:0/3709529103 conn(0x7fda580fc280 msgr2=0x7fda580fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:29.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.297+0000 7fda5ff2e640 1 -- 172.21.15.148:0/3709529103 shutdown_connections 2024-09-19T07:08:29.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.297+0000 7fda5ff2e640 1 -- 172.21.15.148:0/3709529103 wait complete. 2024-09-19T07:08:29.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.297+0000 7fda5ff2e640 1 Processor -- start 2024-09-19T07:08:29.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.297+0000 7fda5ff2e640 1 -- start start 2024-09-19T07:08:29.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.298+0000 7fda5ff2e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda58100ad0 0x7fda58197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:29.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.298+0000 7fda5ff2e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda58101cd0 0x7fda58198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:29.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.298+0000 7fda5ff2e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda58102690 0x7fda5819f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:29.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.298+0000 7fda5ff2e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fda5810c750 con 0x7fda58100ad0 2024-09-19T07:08:29.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.298+0000 7fda5ff2e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fda5810c5d0 con 0x7fda58101cd0 2024-09-19T07:08:29.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.298+0000 7fda5ff2e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fda5810c8d0 con 0x7fda58102690 2024-09-19T07:08:29.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.298+0000 7fda5dcca640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda58100ad0 0x7fda58197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:29.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.298+0000 7fda5dcca640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda58100ad0 0x7fda58197f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34128/0 (socket says 172.21.15.148:34128) 2024-09-19T07:08:29.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.298+0000 7fda5dcca640 1 -- 172.21.15.148:0/1616000890 learned_addr learned my addr 172.21.15.148:0/1616000890 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:08:29.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.298+0000 7fda5e4cb640 1 --2- 172.21.15.148:0/1616000890 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda58102690 0x7fda5819f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:29.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.298+0000 7fda5d4c9640 1 --2- 172.21.15.148:0/1616000890 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda58101cd0 0x7fda58198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:29.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.298+0000 7fda5dcca640 1 -- 172.21.15.148:0/1616000890 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda58102690 msgr2=0x7fda5819f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:29.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.298+0000 7fda5dcca640 1 --2- 172.21.15.148:0/1616000890 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda58102690 0x7fda5819f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:29.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.298+0000 7fda5dcca640 1 -- 172.21.15.148:0/1616000890 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda58101cd0 msgr2=0x7fda58198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:29.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.298+0000 7fda5dcca640 1 --2- 172.21.15.148:0/1616000890 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda58101cd0 0x7fda58198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:29.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.298+0000 7fda5dcca640 1 -- 172.21.15.148:0/1616000890 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda5819fb50 con 0x7fda58100ad0 2024-09-19T07:08:29.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.298+0000 7fda5dcca640 1 --2- 172.21.15.148:0/1616000890 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda58100ad0 0x7fda58197f20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fda5000e9c0 tx=0x7fda5000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:29.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.298+0000 7fda56ffd640 1 -- 172.21.15.148:0/1616000890 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda5000cd80 con 0x7fda58100ad0 2024-09-19T07:08:29.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.298+0000 7fda56ffd640 1 -- 172.21.15.148:0/1616000890 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda500035f0 con 0x7fda58100ad0 2024-09-19T07:08:29.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.298+0000 7fda56ffd640 1 -- 172.21.15.148:0/1616000890 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda50010690 con 0x7fda58100ad0 2024-09-19T07:08:29.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.298+0000 7fda5ff2e640 1 -- 172.21.15.148:0/1616000890 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda5819fe40 con 0x7fda58100ad0 2024-09-19T07:08:29.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.298+0000 7fda5ff2e640 1 -- 172.21.15.148:0/1616000890 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda581a0240 con 0x7fda58100ad0 2024-09-19T07:08:29.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.299+0000 7fda5ff2e640 1 -- 172.21.15.148:0/1616000890 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda581a0500 con 0x7fda58100ad0 2024-09-19T07:08:29.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.300+0000 7fda56ffd640 1 -- 172.21.15.148:0/1616000890 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fda500037a0 con 0x7fda58100ad0 2024-09-19T07:08:29.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.301+0000 7fda56ffd640 1 --2- 172.21.15.148:0/1616000890 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fda400a3270 0x7fda400a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:29.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.301+0000 7fda5d4c9640 1 --2- 172.21.15.148:0/1616000890 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fda400a3270 0x7fda400a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:29.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.302+0000 7fda56ffd640 1 -- 172.21.15.148:0/1616000890 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6847+0+0 (secure 0 0 0) 0x7fda500cf680 con 0x7fda58100ad0 2024-09-19T07:08:29.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.302+0000 7fda5d4c9640 1 --2- 172.21.15.148:0/1616000890 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fda400a3270 0x7fda400a5730 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fda58199440 tx=0x7fda4c00a590 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:29.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.306+0000 7fda56ffd640 1 -- 172.21.15.148:0/1616000890 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fda5009c960 con 0x7fda58100ad0 2024-09-19T07:08:29.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:28 smithi165 ceph-mon[35326]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T07:08:29.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:28 smithi165 ceph-mon[35326]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T07:08:29.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:28 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:08:29.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:28 smithi165 ceph-mon[35326]: from='osd.11 [v2:172.21.15.179:6824/2026109940,v1:172.21.15.179:6825/2026109940]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-19T07:08:29.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:28 smithi165 ceph-mon[35326]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-19T07:08:29.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:28 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:29.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:28 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:29.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:28 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:08:29.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:28 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:08:29.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:28 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:08:29.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:28 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:08:29.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:28 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:29.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:28 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:29.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:28 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:08:29.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:28 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:29.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.473+0000 7fda5ff2e640 1 -- 172.21.15.148:0/1616000890 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fda581a0d00 con 0x7fda58100ad0 2024-09-19T07:08:29.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.473+0000 7fda56ffd640 1 -- 172.21.15.148:0/1616000890 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v71) ==== 74+0+133 (secure 0 0 0) 0x7fda5009c260 con 0x7fda58100ad0 2024-09-19T07:08:29.474 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:08:29.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.475+0000 7fda5ff2e640 1 -- 172.21.15.148:0/1616000890 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fda400a3270 msgr2=0x7fda400a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:29.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.475+0000 7fda5ff2e640 1 --2- 172.21.15.148:0/1616000890 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fda400a3270 0x7fda400a5730 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fda58199440 tx=0x7fda4c00a590 comp rx=0 tx=0).stop 2024-09-19T07:08:29.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.475+0000 7fda5ff2e640 1 -- 172.21.15.148:0/1616000890 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda58100ad0 msgr2=0x7fda58197f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:29.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.475+0000 7fda5ff2e640 1 --2- 172.21.15.148:0/1616000890 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda58100ad0 0x7fda58197f20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fda5000e9c0 tx=0x7fda5000ee80 comp rx=0 tx=0).stop 2024-09-19T07:08:29.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.475+0000 7fda5ff2e640 1 -- 172.21.15.148:0/1616000890 shutdown_connections 2024-09-19T07:08:29.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.475+0000 7fda5ff2e640 1 --2- 172.21.15.148:0/1616000890 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fda400a3270 0x7fda400a5730 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:29.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.475+0000 7fda5ff2e640 1 --2- 172.21.15.148:0/1616000890 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda58102690 0x7fda5819f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:29.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.475+0000 7fda5ff2e640 1 --2- 172.21.15.148:0/1616000890 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda58101cd0 0x7fda58198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:29.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.475+0000 7fda5ff2e640 1 --2- 172.21.15.148:0/1616000890 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda58100ad0 0x7fda58197f20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:29.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.475+0000 7fda5ff2e640 1 -- 172.21.15.148:0/1616000890 >> 172.21.15.148:0/1616000890 conn(0x7fda580fc280 msgr2=0x7fda5806a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:29.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.476+0000 7fda5ff2e640 1 -- 172.21.15.148:0/1616000890 shutdown_connections 2024-09-19T07:08:29.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:29.476+0000 7fda5ff2e640 1 -- 172.21.15.148:0/1616000890 wait complete. 2024-09-19T07:08:30.214 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:29 smithi148 ceph-mon[31180]: Detected new or changed devices on smithi179 2024-09-19T07:08:30.214 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:29 smithi148 ceph-mon[31180]: Adjusting osd_memory_target on smithi179 to 4272M 2024-09-19T07:08:30.214 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:29 smithi148 ceph-mon[31180]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-09-19T07:08:30.214 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:29 smithi148 ceph-mon[31180]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T07:08:30.214 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:29 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:08:30.214 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:29 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:08:30.214 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:29 smithi148 ceph-mon[31180]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:08:30.214 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:29 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/1616000890' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T07:08:30.214 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:29 smithi148 ceph-mon[31180]: from='osd.11 ' entity='osd.11' 2024-09-19T07:08:30.215 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:29 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:08:30.215 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":71,"num_osds":12,"num_up_osds":11,"osd_up_since":1726729685,"num_in_osds":12,"osd_in_since":1726729687,"num_remapped_pgs":0} 2024-09-19T07:08:30.272 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:08:29 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:08:29.782+0000 7f5c20afa640 -1 osd.11 0 waiting for initial osdmap 2024-09-19T07:08:30.272 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:08:29 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:08:29.801+0000 7f5c1912c640 -1 osd.11 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T07:08:30.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:29 smithi179 ceph-mon[35716]: Detected new or changed devices on smithi179 2024-09-19T07:08:30.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:29 smithi179 ceph-mon[35716]: Adjusting osd_memory_target on smithi179 to 4272M 2024-09-19T07:08:30.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:29 smithi179 ceph-mon[35716]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-09-19T07:08:30.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:29 smithi179 ceph-mon[35716]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T07:08:30.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:29 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:08:30.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:29 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:08:30.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:29 smithi179 ceph-mon[35716]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:08:30.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:29 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/1616000890' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T07:08:30.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:29 smithi179 ceph-mon[35716]: from='osd.11 ' entity='osd.11' 2024-09-19T07:08:30.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:29 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:08:30.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:29 smithi165 ceph-mon[35326]: Detected new or changed devices on smithi179 2024-09-19T07:08:30.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:29 smithi165 ceph-mon[35326]: Adjusting osd_memory_target on smithi179 to 4272M 2024-09-19T07:08:30.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:29 smithi165 ceph-mon[35326]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-09-19T07:08:30.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:29 smithi165 ceph-mon[35326]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T07:08:30.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:29 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:08:30.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:29 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:08:30.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:29 smithi165 ceph-mon[35326]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:08:30.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:29 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/1616000890' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T07:08:30.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:29 smithi165 ceph-mon[35326]: from='osd.11 ' entity='osd.11' 2024-09-19T07:08:30.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:29 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:08:31.217 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T07:08:31.229 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:30 smithi148 ceph-mon[31180]: purged_snaps scrub starts 2024-09-19T07:08:31.229 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:30 smithi148 ceph-mon[31180]: purged_snaps scrub ok 2024-09-19T07:08:31.229 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:30 smithi148 ceph-mon[31180]: osd.11 [v2:172.21.15.179:6824/2026109940,v1:172.21.15.179:6825/2026109940] boot 2024-09-19T07:08:31.229 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:30 smithi148 ceph-mon[31180]: osdmap e72: 12 total, 12 up, 12 in 2024-09-19T07:08:31.229 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:30 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:08:31.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:30 smithi179 ceph-mon[35716]: purged_snaps scrub starts 2024-09-19T07:08:31.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:30 smithi179 ceph-mon[35716]: purged_snaps scrub ok 2024-09-19T07:08:31.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:30 smithi179 ceph-mon[35716]: osd.11 [v2:172.21.15.179:6824/2026109940,v1:172.21.15.179:6825/2026109940] boot 2024-09-19T07:08:31.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:30 smithi179 ceph-mon[35716]: osdmap e72: 12 total, 12 up, 12 in 2024-09-19T07:08:31.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:30 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:08:31.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:30 smithi165 ceph-mon[35326]: purged_snaps scrub starts 2024-09-19T07:08:31.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:30 smithi165 ceph-mon[35326]: purged_snaps scrub ok 2024-09-19T07:08:31.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:30 smithi165 ceph-mon[35326]: osd.11 [v2:172.21.15.179:6824/2026109940,v1:172.21.15.179:6825/2026109940] boot 2024-09-19T07:08:31.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:30 smithi165 ceph-mon[35326]: osdmap e72: 12 total, 12 up, 12 in 2024-09-19T07:08:31.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:30 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:08:31.475 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:08:31.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:31.910+0000 7f1b94517640 1 -- 172.21.15.148:0/3080755423 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b8c101cd0 msgr2=0x7f1b8c102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:31.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:31.910+0000 7f1b94517640 1 --2- 172.21.15.148:0/3080755423 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b8c101cd0 0x7f1b8c102150 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c009900 tx=0x7f1b7c02a410 comp rx=0 tx=0).stop 2024-09-19T07:08:31.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:31.910+0000 7f1b94517640 1 -- 172.21.15.148:0/3080755423 shutdown_connections 2024-09-19T07:08:31.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:31.910+0000 7f1b94517640 1 --2- 172.21.15.148:0/3080755423 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b8c102690 0x7f1b8c108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:31.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:31.910+0000 7f1b94517640 1 --2- 172.21.15.148:0/3080755423 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b8c101cd0 0x7f1b8c102150 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:31.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:31.910+0000 7f1b94517640 1 --2- 172.21.15.148:0/3080755423 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b8c100ad0 0x7f1b8c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:31.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:31.910+0000 7f1b94517640 1 -- 172.21.15.148:0/3080755423 >> 172.21.15.148:0/3080755423 conn(0x7f1b8c0fc280 msgr2=0x7f1b8c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:31.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:31.910+0000 7f1b94517640 1 -- 172.21.15.148:0/3080755423 shutdown_connections 2024-09-19T07:08:31.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:31.910+0000 7f1b94517640 1 -- 172.21.15.148:0/3080755423 wait complete. 2024-09-19T07:08:31.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:31.910+0000 7f1b94517640 1 Processor -- start 2024-09-19T07:08:31.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:31.911+0000 7f1b94517640 1 -- start start 2024-09-19T07:08:31.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:31.911+0000 7f1b94517640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b8c100ad0 0x7f1b8c06aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:31.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:31.911+0000 7f1b94517640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b8c101cd0 0x7f1b8c19cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:31.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:31.911+0000 7f1b94517640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b8c102690 0x7f1b8c19f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:31.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:31.911+0000 7f1b94517640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8c10c850 con 0x7f1b8c100ad0 2024-09-19T07:08:31.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:31.911+0000 7f1b94517640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8c10c6d0 con 0x7f1b8c102690 2024-09-19T07:08:31.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:31.911+0000 7f1b94517640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8c10c9d0 con 0x7f1b8c101cd0 2024-09-19T07:08:31.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:31.911+0000 7f1b922b3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b8c100ad0 0x7f1b8c06aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:31.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:31.911+0000 7f1b922b3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b8c100ad0 0x7f1b8c06aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34154/0 (socket says 172.21.15.148:34154) 2024-09-19T07:08:31.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:31.911+0000 7f1b922b3640 1 -- 172.21.15.148:0/1271591463 learned_addr learned my addr 172.21.15.148:0/1271591463 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:08:31.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:31.911+0000 7f1b91ab2640 1 --2- 172.21.15.148:0/1271591463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b8c101cd0 0x7f1b8c19cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:31.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:31.911+0000 7f1b922b3640 1 -- 172.21.15.148:0/1271591463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b8c101cd0 msgr2=0x7f1b8c19cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:31.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:31.911+0000 7f1b922b3640 1 --2- 172.21.15.148:0/1271591463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b8c101cd0 0x7f1b8c19cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:31.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:31.911+0000 7f1b92ab4640 1 --2- 172.21.15.148:0/1271591463 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b8c102690 0x7f1b8c19f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:31.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:31.911+0000 7f1b922b3640 1 -- 172.21.15.148:0/1271591463 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b8c102690 msgr2=0x7f1b8c19f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:31.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:31.911+0000 7f1b922b3640 1 --2- 172.21.15.148:0/1271591463 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b8c102690 0x7f1b8c19f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:31.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:31.911+0000 7f1b922b3640 1 -- 172.21.15.148:0/1271591463 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b8c19fd20 con 0x7f1b8c100ad0 2024-09-19T07:08:31.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:31.911+0000 7f1b92ab4640 1 --2- 172.21.15.148:0/1271591463 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b8c102690 0x7f1b8c19f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:08:31.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:31.911+0000 7f1b922b3640 1 --2- 172.21.15.148:0/1271591463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b8c100ad0 0x7f1b8c06aad0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1b8800b450 tx=0x7f1b8800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:31.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:31.911+0000 7f1b837fe640 1 -- 172.21.15.148:0/1271591463 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b88015020 con 0x7f1b8c100ad0 2024-09-19T07:08:31.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:31.912+0000 7f1b837fe640 1 -- 172.21.15.148:0/1271591463 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b88011d70 con 0x7f1b8c100ad0 2024-09-19T07:08:31.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:31.912+0000 7f1b94517640 1 -- 172.21.15.148:0/1271591463 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b8c19ffb0 con 0x7f1b8c100ad0 2024-09-19T07:08:31.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:31.912+0000 7f1b837fe640 1 -- 172.21.15.148:0/1271591463 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b8800f340 con 0x7f1b8c100ad0 2024-09-19T07:08:31.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:31.912+0000 7f1b94517640 1 -- 172.21.15.148:0/1271591463 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b8c1a0430 con 0x7f1b8c100ad0 2024-09-19T07:08:31.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:31.913+0000 7f1b94517640 1 -- 172.21.15.148:0/1271591463 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b8c107f60 con 0x7f1b8c100ad0 2024-09-19T07:08:31.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:31.915+0000 7f1b837fe640 1 -- 172.21.15.148:0/1271591463 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f1b88018020 con 0x7f1b8c100ad0 2024-09-19T07:08:31.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:31.915+0000 7f1b837fe640 1 --2- 172.21.15.148:0/1271591463 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f1b780a3240 0x7f1b780a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:31.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:31.915+0000 7f1b91ab2640 1 --2- 172.21.15.148:0/1271591463 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f1b780a3240 0x7f1b780a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:31.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:31.915+0000 7f1b837fe640 1 -- 172.21.15.148:0/1271591463 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f1b880cefa0 con 0x7f1b8c100ad0 2024-09-19T07:08:31.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:31.916+0000 7f1b91ab2640 1 --2- 172.21.15.148:0/1271591463 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f1b780a3240 0x7f1b780a5700 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c000c00 tx=0x7f1b7c031400 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:31.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:31.920+0000 7f1b837fe640 1 -- 172.21.15.148:0/1271591463 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1b8801f020 con 0x7f1b8c100ad0 2024-09-19T07:08:32.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:32.090+0000 7f1b94517640 1 -- 172.21.15.148:0/1271591463 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f1b8c02da10 con 0x7f1b8c100ad0 2024-09-19T07:08:32.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:32.090+0000 7f1b837fe640 1 -- 172.21.15.148:0/1271591463 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v73) ==== 74+0+133 (secure 0 0 0) 0x7f1b8800d040 con 0x7f1b8c100ad0 2024-09-19T07:08:32.091 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:08:32.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:32.092+0000 7f1b94517640 1 -- 172.21.15.148:0/1271591463 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f1b780a3240 msgr2=0x7f1b780a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:32.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:32.092+0000 7f1b94517640 1 --2- 172.21.15.148:0/1271591463 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f1b780a3240 0x7f1b780a5700 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c000c00 tx=0x7f1b7c031400 comp rx=0 tx=0).stop 2024-09-19T07:08:32.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:32.092+0000 7f1b94517640 1 -- 172.21.15.148:0/1271591463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b8c100ad0 msgr2=0x7f1b8c06aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:32.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:32.092+0000 7f1b94517640 1 --2- 172.21.15.148:0/1271591463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b8c100ad0 0x7f1b8c06aad0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1b8800b450 tx=0x7f1b8800b910 comp rx=0 tx=0).stop 2024-09-19T07:08:32.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:32.092+0000 7f1b94517640 1 -- 172.21.15.148:0/1271591463 shutdown_connections 2024-09-19T07:08:32.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:32.092+0000 7f1b94517640 1 --2- 172.21.15.148:0/1271591463 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f1b780a3240 0x7f1b780a5700 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:32.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:32.092+0000 7f1b94517640 1 --2- 172.21.15.148:0/1271591463 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b8c102690 0x7f1b8c19f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:32.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:32.092+0000 7f1b94517640 1 --2- 172.21.15.148:0/1271591463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b8c101cd0 0x7f1b8c19cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:32.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:32.092+0000 7f1b94517640 1 --2- 172.21.15.148:0/1271591463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b8c100ad0 0x7f1b8c06aad0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:32.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:32.092+0000 7f1b94517640 1 -- 172.21.15.148:0/1271591463 >> 172.21.15.148:0/1271591463 conn(0x7f1b8c0fc280 msgr2=0x7f1b8c105130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:32.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:32.092+0000 7f1b94517640 1 -- 172.21.15.148:0/1271591463 shutdown_connections 2024-09-19T07:08:32.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:32.093+0000 7f1b94517640 1 -- 172.21.15.148:0/1271591463 wait complete. 2024-09-19T07:08:32.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:31 smithi179 ceph-mon[35716]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:08:32.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:31 smithi148 ceph-mon[31180]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:08:32.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:31 smithi165 ceph-mon[35326]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:08:32.774 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":73,"num_osds":12,"num_up_osds":12,"osd_up_since":1726729710,"num_in_osds":12,"osd_in_since":1726729687,"num_remapped_pgs":0} 2024-09-19T07:08:32.775 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T07:08:32.965 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:32 smithi148 ceph-mon[31180]: osdmap e73: 12 total, 12 up, 12 in 2024-09-19T07:08:32.966 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:32 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/1271591463' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T07:08:33.065 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:08:33.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:32 smithi179 ceph-mon[35716]: osdmap e73: 12 total, 12 up, 12 in 2024-09-19T07:08:33.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:32 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/1271591463' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T07:08:33.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:32 smithi165 ceph-mon[35326]: osdmap e73: 12 total, 12 up, 12 in 2024-09-19T07:08:33.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:32 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/1271591463' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T07:08:33.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.542+0000 7f59de11a640 1 -- 172.21.15.148:0/2303149526 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59d8103660 msgr2=0x7f59d810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:33.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.542+0000 7f59de11a640 1 --2- 172.21.15.148:0/2303149526 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59d8103660 0x7f59d810bb50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f59cc009900 tx=0x7f59cc02a480 comp rx=0 tx=0).stop 2024-09-19T07:08:33.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.542+0000 7f59de11a640 1 -- 172.21.15.148:0/2303149526 shutdown_connections 2024-09-19T07:08:33.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.542+0000 7f59de11a640 1 --2- 172.21.15.148:0/2303149526 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59d810c170 0x7f59d810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:33.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.542+0000 7f59de11a640 1 --2- 172.21.15.148:0/2303149526 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59d8103660 0x7f59d810bb50 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:33.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.542+0000 7f59de11a640 1 --2- 172.21.15.148:0/2303149526 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59d8102d40 0x7f59d8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:33.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.542+0000 7f59de11a640 1 -- 172.21.15.148:0/2303149526 >> 172.21.15.148:0/2303149526 conn(0x7f59d80fc7a0 msgr2=0x7f59d80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:33.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.542+0000 7f59de11a640 1 -- 172.21.15.148:0/2303149526 shutdown_connections 2024-09-19T07:08:33.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.542+0000 7f59de11a640 1 -- 172.21.15.148:0/2303149526 wait complete. 2024-09-19T07:08:33.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.543+0000 7f59de11a640 1 Processor -- start 2024-09-19T07:08:33.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.543+0000 7f59de11a640 1 -- start start 2024-09-19T07:08:33.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.543+0000 7f59de11a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59d8102d40 0x7f59d8198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:33.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.543+0000 7f59de11a640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59d8103660 0x7f59d8198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:33.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.543+0000 7f59de11a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59d810c170 0x7f59d819ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:33.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.543+0000 7f59de11a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f59d8112030 con 0x7f59d8102d40 2024-09-19T07:08:33.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.543+0000 7f59de11a640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f59d8111eb0 con 0x7f59d8103660 2024-09-19T07:08:33.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.543+0000 7f59de11a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f59d81121b0 con 0x7f59d810c170 2024-09-19T07:08:33.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.543+0000 7f59d77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59d8102d40 0x7f59d8198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:33.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.544+0000 7f59d77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59d8102d40 0x7f59d8198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34164/0 (socket says 172.21.15.148:34164) 2024-09-19T07:08:33.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.544+0000 7f59d77fe640 1 -- 172.21.15.148:0/740687551 learned_addr learned my addr 172.21.15.148:0/740687551 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:08:33.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.544+0000 7f59d6ffd640 1 --2- 172.21.15.148:0/740687551 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59d8103660 0x7f59d8198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:33.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.544+0000 7f59d7fff640 1 --2- 172.21.15.148:0/740687551 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59d810c170 0x7f59d819ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:33.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.544+0000 7f59d77fe640 1 -- 172.21.15.148:0/740687551 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59d810c170 msgr2=0x7f59d819ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:33.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.544+0000 7f59d77fe640 1 --2- 172.21.15.148:0/740687551 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59d810c170 0x7f59d819ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:33.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.544+0000 7f59d77fe640 1 -- 172.21.15.148:0/740687551 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59d8103660 msgr2=0x7f59d8198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:33.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.544+0000 7f59d77fe640 1 --2- 172.21.15.148:0/740687551 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59d8103660 0x7f59d8198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:33.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.544+0000 7f59d77fe640 1 -- 172.21.15.148:0/740687551 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59d819d530 con 0x7f59d8102d40 2024-09-19T07:08:33.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.544+0000 7f59d77fe640 1 --2- 172.21.15.148:0/740687551 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59d8102d40 0x7f59d8198580 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f59c800ba50 tx=0x7f59c800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:33.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.544+0000 7f59d4ff9640 1 -- 172.21.15.148:0/740687551 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c8019070 con 0x7f59d8102d40 2024-09-19T07:08:33.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.544+0000 7f59d4ff9640 1 -- 172.21.15.148:0/740687551 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59c800cbe0 con 0x7f59d8102d40 2024-09-19T07:08:33.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.544+0000 7f59de11a640 1 -- 172.21.15.148:0/740687551 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59d819d820 con 0x7f59d8102d40 2024-09-19T07:08:33.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.544+0000 7f59d4ff9640 1 -- 172.21.15.148:0/740687551 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c80076e0 con 0x7f59d8102d40 2024-09-19T07:08:33.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.544+0000 7f59de11a640 1 -- 172.21.15.148:0/740687551 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59d81a5100 con 0x7f59d8102d40 2024-09-19T07:08:33.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.545+0000 7f59de11a640 1 -- 172.21.15.148:0/740687551 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59d81031a0 con 0x7f59d8102d40 2024-09-19T07:08:33.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.546+0000 7f59d4ff9640 1 -- 172.21.15.148:0/740687551 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f59c801c070 con 0x7f59d8102d40 2024-09-19T07:08:33.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.547+0000 7f59d4ff9640 1 --2- 172.21.15.148:0/740687551 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f59c00a3240 0x7f59c00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:33.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.547+0000 7f59d6ffd640 1 --2- 172.21.15.148:0/740687551 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f59c00a3240 0x7f59c00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:33.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.547+0000 7f59d4ff9640 1 -- 172.21.15.148:0/740687551 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f59c80cea70 con 0x7f59d8102d40 2024-09-19T07:08:33.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.548+0000 7f59d6ffd640 1 --2- 172.21.15.148:0/740687551 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f59c00a3240 0x7f59c00a5700 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f59cc000c00 tx=0x7f59cc0058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:33.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.551+0000 7f59d4ff9640 1 -- 172.21.15.148:0/740687551 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f59c809b5e0 con 0x7f59d8102d40 2024-09-19T07:08:33.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.720+0000 7f59de11a640 1 -- 172.21.15.148:0/740687551 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f59d8107210 con 0x7f59d8102d40 2024-09-19T07:08:33.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.721+0000 7f59d4ff9640 1 -- 172.21.15.148:0/740687551 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+18563 (secure 0 0 0) 0x7f59c809f8e0 con 0x7f59d8102d40 2024-09-19T07:08:33.723 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:08:33.723 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":73,"fsid":"eae8a4a8-7654-11ef-bceb-c7b262605968","created":"2024-09-19T07:01:47.891210+0000","modified":"2024-09-19T07:08:31.958722+0000","last_up_change":"2024-09-19T07:08:30.785262+0000","last_in_change":"2024-09-19T07:08:07.001808+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:04:49.313270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7b854fad-d5a3-43e3-862e-7a0e8f243c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6803","nonce":512186330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6805","nonce":512186330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6809","nonce":512186330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6807","nonce":512186330}]},"public_addr":"172.21.15.148:6803/512186330","cluster_addr":"172.21.15.148:6805/512186330","heartbeat_back_addr":"172.21.15.148:6809/512186330","heartbeat_front_addr":"172.21.15.148:6807/512186330","state":["exists","up"]},{"osd":1,"uuid":"61b26278-f4db-40f0-97b9-c12a6ef1cd06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6801","nonce":2433984552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6803","nonce":2433984552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6807","nonce":2433984552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6805","nonce":2433984552}]},"public_addr":"172.21.15.165:6801/2433984552","cluster_addr":"172.21.15.165:6803/2433984552","heartbeat_back_addr":"172.21.15.165:6807/2433984552","heartbeat_front_addr":"172.21.15.165:6805/2433984552","state":["exists","up"]},{"osd":2,"uuid":"06620bbc-cdb5-4afc-8122-0bb3126630f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6801","nonce":3048365223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6803","nonce":3048365223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6807","nonce":3048365223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6805","nonce":3048365223}]},"public_addr":"172.21.15.179:6801/3048365223","cluster_addr":"172.21.15.179:6803/3048365223","heartbeat_back_addr":"172.21.15.179:6807/3048365223","heartbeat_front_addr":"172.21.15.179:6805/3048365223","state":["exists","up"]},{"osd":3,"uuid":"d7df45d4-5ef1-4f66-84a7-f61b8756c0c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6811","nonce":3662789091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6813","nonce":3662789091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6817","nonce":3662789091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6815","nonce":3662789091}]},"public_addr":"172.21.15.148:6811/3662789091","cluster_addr":"172.21.15.148:6813/3662789091","heartbeat_back_addr":"172.21.15.148:6817/3662789091","heartbeat_front_addr":"172.21.15.148:6815/3662789091","state":["exists","up"]},{"osd":4,"uuid":"5cfd359b-a8d2-4bdc-858f-087d26e0869c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6809","nonce":3082550323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6811","nonce":3082550323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6815","nonce":3082550323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6813","nonce":3082550323}]},"public_addr":"172.21.15.165:6809/3082550323","cluster_addr":"172.21.15.165:6811/3082550323","heartbeat_back_addr":"172.21.15.165:6815/3082550323","heartbeat_front_addr":"172.21.15.165:6813/3082550323","state":["exists","up"]},{"osd":5,"uuid":"8295e69b-87fe-4403-bb2e-d9dd42e2f398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6809","nonce":2125213751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6811","nonce":2125213751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6815","nonce":2125213751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6813","nonce":2125213751}]},"public_addr":"172.21.15.179:6809/2125213751","cluster_addr":"172.21.15.179:6811/2125213751","heartbeat_back_addr":"172.21.15.179:6815/2125213751","heartbeat_front_addr":"172.21.15.179:6813/2125213751","state":["exists","up"]},{"osd":6,"uuid":"4ce38d1a-06d3-4606-b00d-aa1ff977025f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6819","nonce":2178980310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6821","nonce":2178980310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6825","nonce":2178980310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6823","nonce":2178980310}]},"public_addr":"172.21.15.148:6819/2178980310","cluster_addr":"172.21.15.148:6821/2178980310","heartbeat_back_addr":"172.21.15.148:6825/2178980310","heartbeat_front_addr":"172.21.15.148:6823/2178980310","state":["exists","up"]},{"osd":7,"uuid":"9e68e2b2-9838-4ec0-b473-24f2434695ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6817","nonce":3961600099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6819","nonce":3961600099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6823","nonce":3961600099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6821","nonce":3961600099}]},"public_addr":"172.21.15.165:6817/3961600099","cluster_addr":"172.21.15.165:6819/3961600099","heartbeat_back_addr":"172.21.15.165:6823/3961600099","heartbeat_front_addr":"172.21.15.165:6821/3961600099","state":["exists","up"]},{"osd":8,"uuid":"297acce6-d3c7-4e1a-bf87-be093de51a6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6817","nonce":3642931467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6819","nonce":3642931467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6823","nonce":3642931467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6821","nonce":3642931467}]},"public_addr":"172.21.15.179:6817/3642931467","cluster_addr":"172.21.15.179:6819/3642931467","heartbeat_back_addr":"172.21.15.179:6823/3642931467","heartbeat_front_addr":"172.21.15.179:6821/3642931467","state":["exists","up"]},{"osd":9,"uuid":"ef488c5e-5353-4695-99dd-5b74ade436d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6827","nonce":3135409630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6829","nonce":3135409630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6833","nonce":3135409630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6831","nonce":3135409630}]},"public_addr":"172.21.15.148:6827/3135409630","cluster_addr":"172.21.15.148:6829/3135409630","heartbeat_back_addr":"172.21.15.148:6833/3135409630","heartbeat_front_addr":"172.21.15.148:6831/3135409630","state":["exists","up"]},{"osd":10,"uuid":"7a9f0379-1199-4266-910c-8d1d313d39e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6825","nonce":3554110731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6827","nonce":3554110731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6831","nonce":3554110731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6829","nonce":3554110731}]},"public_addr":"172.21.15.165:6825/3554110731","cluster_addr":"172.21.15.165:6827/3554110731","heartbeat_back_addr":"172.21.15.165:6831/3554110731","heartbeat_front_addr":"172.21.15.165:6829/3554110731","state":["exists","up"]},{"osd":11,"uuid":"eede97e9-5685-4603-806e-7078c6940536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6825","nonce":2026109940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6827","nonce":2026109940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6831","nonce":2026109940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6829","nonce":2026109940}]},"public_addr":"172.21.15.179:6825/2026109940","cluster_addr":"172.21.15.179:6827/2026109940","heartbeat_back_addr":"172.21.15.179:6831/2026109940","heartbeat_front_addr":"172.21.15.179:6829/2026109940","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:03:56.291685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:21.419682+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:46.377012+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:11.484234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:36.723101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:06:00.294617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:06:25.147230+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:06:49.318576+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:07:13.896399+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:07:38.930999+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:08:03.803463+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:08:28.731343+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.148:0/3534559227":"2024-09-20T07:02:37.007183+0000","172.21.15.148:0/1958388906":"2024-09-20T07:02:37.007183+0000","172.21.15.148:0/1922521135":"2024-09-20T07:02:37.007183+0000","172.21.15.148:6801/1949849385":"2024-09-20T07:02:37.007183+0000","172.21.15.148:6800/1949849385":"2024-09-20T07:02:37.007183+0000","172.21.15.148:6800/2161746152":"2024-09-20T07:02:14.557425+0000","172.21.15.148:6801/2161746152":"2024-09-20T07:02:14.557425+0000","172.21.15.148:0/1480486619":"2024-09-20T07:02:14.557425+0000","172.21.15.148:0/174481494":"2024-09-20T07:02:14.557425+0000","172.21.15.148:0/1114469409":"2024-09-20T07:02:14.557425+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T07:08:33.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.723+0000 7f59de11a640 1 -- 172.21.15.148:0/740687551 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f59c00a3240 msgr2=0x7f59c00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:33.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.723+0000 7f59de11a640 1 --2- 172.21.15.148:0/740687551 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f59c00a3240 0x7f59c00a5700 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f59cc000c00 tx=0x7f59cc0058d0 comp rx=0 tx=0).stop 2024-09-19T07:08:33.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.723+0000 7f59de11a640 1 -- 172.21.15.148:0/740687551 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59d8102d40 msgr2=0x7f59d8198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:33.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.723+0000 7f59de11a640 1 --2- 172.21.15.148:0/740687551 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59d8102d40 0x7f59d8198580 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f59c800ba50 tx=0x7f59c800bf10 comp rx=0 tx=0).stop 2024-09-19T07:08:33.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.724+0000 7f59de11a640 1 -- 172.21.15.148:0/740687551 shutdown_connections 2024-09-19T07:08:33.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.724+0000 7f59de11a640 1 --2- 172.21.15.148:0/740687551 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f59c00a3240 0x7f59c00a5700 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:33.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.724+0000 7f59de11a640 1 --2- 172.21.15.148:0/740687551 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59d810c170 0x7f59d819ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:33.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.724+0000 7f59de11a640 1 --2- 172.21.15.148:0/740687551 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59d8103660 0x7f59d8198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:33.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.724+0000 7f59de11a640 1 --2- 172.21.15.148:0/740687551 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59d8102d40 0x7f59d8198580 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:33.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.724+0000 7f59de11a640 1 -- 172.21.15.148:0/740687551 >> 172.21.15.148:0/740687551 conn(0x7f59d80fc7a0 msgr2=0x7f59d80fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:33.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.724+0000 7f59de11a640 1 -- 172.21.15.148:0/740687551 shutdown_connections 2024-09-19T07:08:33.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:33.724+0000 7f59de11a640 1 -- 172.21.15.148:0/740687551 wait complete. 2024-09-19T07:08:34.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:33 smithi179 ceph-mon[35716]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:08:34.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:33 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/740687551' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:08:34.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:33 smithi148 ceph-mon[31180]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:08:34.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:33 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/740687551' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:08:34.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:33 smithi165 ceph-mon[35326]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:08:34.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:33 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/740687551' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:08:34.471 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T07:04:49.313270+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T07:08:34.472 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-19T07:08:34.716 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:08:35.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.170+0000 7fb66e714640 1 -- 172.21.15.148:0/3275565063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb668101de0 msgr2=0x7fb6681021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:35.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.170+0000 7fb66e714640 1 --2- 172.21.15.148:0/3275565063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb668101de0 0x7fb6681021c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb658009900 tx=0x7fb65802a410 comp rx=0 tx=0).stop 2024-09-19T07:08:35.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.170+0000 7fb66e714640 1 -- 172.21.15.148:0/3275565063 shutdown_connections 2024-09-19T07:08:35.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.170+0000 7fb66e714640 1 --2- 172.21.15.148:0/3275565063 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb668106f10 0x7fb66810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:35.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.170+0000 7fb66e714640 1 --2- 172.21.15.148:0/3275565063 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb668102790 0x7fb6681067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:35.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.170+0000 7fb66e714640 1 --2- 172.21.15.148:0/3275565063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb668101de0 0x7fb6681021c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:35.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.170+0000 7fb66e714640 1 -- 172.21.15.148:0/3275565063 >> 172.21.15.148:0/3275565063 conn(0x7fb6680fd8c0 msgr2=0x7fb6680ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:35.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.170+0000 7fb66e714640 1 -- 172.21.15.148:0/3275565063 shutdown_connections 2024-09-19T07:08:35.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.170+0000 7fb66e714640 1 -- 172.21.15.148:0/3275565063 wait complete. 2024-09-19T07:08:35.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.170+0000 7fb66e714640 1 Processor -- start 2024-09-19T07:08:35.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.170+0000 7fb66e714640 1 -- start start 2024-09-19T07:08:35.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.171+0000 7fb66e714640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb668101de0 0x7fb6681984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:35.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.171+0000 7fb66e714640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb668102790 0x7fb668198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:35.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.171+0000 7fb66e714640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb668106f10 0x7fb66819cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:35.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.171+0000 7fb66e714640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb668111f70 con 0x7fb668102790 2024-09-19T07:08:35.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.171+0000 7fb66e714640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb668111df0 con 0x7fb668106f10 2024-09-19T07:08:35.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.171+0000 7fb66e714640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb6681120f0 con 0x7fb668101de0 2024-09-19T07:08:35.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.171+0000 7fb65ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb668102790 0x7fb668198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:35.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.171+0000 7fb65ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb668102790 0x7fb668198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34788/0 (socket says 172.21.15.148:34788) 2024-09-19T07:08:35.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.171+0000 7fb65ffff640 1 -- 172.21.15.148:0/998213713 learned_addr learned my addr 172.21.15.148:0/998213713 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:08:35.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.171+0000 7fb667fff640 1 --2- 172.21.15.148:0/998213713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb668101de0 0x7fb6681984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:35.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.171+0000 7fb66ccb1640 1 --2- 172.21.15.148:0/998213713 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb668106f10 0x7fb66819cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:35.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.171+0000 7fb65ffff640 1 -- 172.21.15.148:0/998213713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb668101de0 msgr2=0x7fb6681984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:35.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.171+0000 7fb65ffff640 1 --2- 172.21.15.148:0/998213713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb668101de0 0x7fb6681984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:35.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.171+0000 7fb65ffff640 1 -- 172.21.15.148:0/998213713 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb668106f10 msgr2=0x7fb66819cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:35.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.171+0000 7fb65ffff640 1 --2- 172.21.15.148:0/998213713 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb668106f10 0x7fb66819cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:35.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.171+0000 7fb65ffff640 1 -- 172.21.15.148:0/998213713 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb66819d480 con 0x7fb668102790 2024-09-19T07:08:35.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.171+0000 7fb65ffff640 1 --2- 172.21.15.148:0/998213713 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb668102790 0x7fb668198a10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb65000c890 tx=0x7fb65000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:35.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.171+0000 7fb665ffb640 1 -- 172.21.15.148:0/998213713 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb650004220 con 0x7fb668102790 2024-09-19T07:08:35.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.171+0000 7fb665ffb640 1 -- 172.21.15.148:0/998213713 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb6500043c0 con 0x7fb668102790 2024-09-19T07:08:35.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.171+0000 7fb66e714640 1 -- 172.21.15.148:0/998213713 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb66819d770 con 0x7fb668102790 2024-09-19T07:08:35.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.172+0000 7fb665ffb640 1 -- 172.21.15.148:0/998213713 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6500049e0 con 0x7fb668102790 2024-09-19T07:08:35.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.172+0000 7fb66e714640 1 -- 172.21.15.148:0/998213713 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6681a5050 con 0x7fb668102790 2024-09-19T07:08:35.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.172+0000 7fb66e714640 1 -- 172.21.15.148:0/998213713 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6681021c0 con 0x7fb668102790 2024-09-19T07:08:35.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.174+0000 7fb665ffb640 1 -- 172.21.15.148:0/998213713 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fb6500079b0 con 0x7fb668102790 2024-09-19T07:08:35.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.174+0000 7fb665ffb640 1 --2- 172.21.15.148:0/998213713 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fb6540a32c0 0x7fb6540a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:35.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.174+0000 7fb667fff640 1 --2- 172.21.15.148:0/998213713 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fb6540a32c0 0x7fb6540a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:35.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.174+0000 7fb665ffb640 1 -- 172.21.15.148:0/998213713 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fb6500cf4b0 con 0x7fb668102790 2024-09-19T07:08:35.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.175+0000 7fb667fff640 1 --2- 172.21.15.148:0/998213713 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fb6540a32c0 0x7fb6540a5780 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb658009230 tx=0x7fb6580058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:35.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.178+0000 7fb665ffb640 1 -- 172.21.15.148:0/998213713 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb650014030 con 0x7fb668102790 2024-09-19T07:08:35.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.345+0000 7fb66e714640 1 -- 172.21.15.148:0/998213713 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb66810a120 con 0x7fb668102790 2024-09-19T07:08:35.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.345+0000 7fb665ffb640 1 -- 172.21.15.148:0/998213713 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) ==== 93+0+10 (secure 0 0 0) 0x7fb65009c650 con 0x7fb668102790 2024-09-19T07:08:35.346 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 1 2024-09-19T07:08:35.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.347+0000 7fb66e714640 1 -- 172.21.15.148:0/998213713 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fb6540a32c0 msgr2=0x7fb6540a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:35.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.347+0000 7fb66e714640 1 --2- 172.21.15.148:0/998213713 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fb6540a32c0 0x7fb6540a5780 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb658009230 tx=0x7fb6580058d0 comp rx=0 tx=0).stop 2024-09-19T07:08:35.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.347+0000 7fb66e714640 1 -- 172.21.15.148:0/998213713 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb668102790 msgr2=0x7fb668198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:35.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.347+0000 7fb66e714640 1 --2- 172.21.15.148:0/998213713 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb668102790 0x7fb668198a10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb65000c890 tx=0x7fb65000cd50 comp rx=0 tx=0).stop 2024-09-19T07:08:35.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.348+0000 7fb66e714640 1 -- 172.21.15.148:0/998213713 shutdown_connections 2024-09-19T07:08:35.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.348+0000 7fb66e714640 1 --2- 172.21.15.148:0/998213713 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fb6540a32c0 0x7fb6540a5780 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:35.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.348+0000 7fb66e714640 1 --2- 172.21.15.148:0/998213713 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb668106f10 0x7fb66819cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:35.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.348+0000 7fb66e714640 1 --2- 172.21.15.148:0/998213713 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb668102790 0x7fb668198a10 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:35.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.348+0000 7fb66e714640 1 --2- 172.21.15.148:0/998213713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb668101de0 0x7fb6681984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:35.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.348+0000 7fb66e714640 1 -- 172.21.15.148:0/998213713 >> 172.21.15.148:0/998213713 conn(0x7fb6680fd8c0 msgr2=0x7fb6680fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:35.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.348+0000 7fb66e714640 1 -- 172.21.15.148:0/998213713 shutdown_connections 2024-09-19T07:08:35.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:35.348+0000 7fb66e714640 1 -- 172.21.15.148:0/998213713 wait complete. 2024-09-19T07:08:35.920 INFO:tasks.cephadm:Adding mds.a on smithi148 2024-09-19T07:08:35.920 INFO:tasks.cephadm:Adding mds.d on smithi148 2024-09-19T07:08:35.920 INFO:tasks.cephadm:Adding mds.g on smithi148 2024-09-19T07:08:35.920 INFO:tasks.cephadm:Adding mds.j on smithi148 2024-09-19T07:08:35.920 INFO:tasks.cephadm:Adding mds.b on smithi165 2024-09-19T07:08:35.921 INFO:tasks.cephadm:Adding mds.e on smithi165 2024-09-19T07:08:35.921 INFO:tasks.cephadm:Adding mds.h on smithi165 2024-09-19T07:08:35.921 INFO:tasks.cephadm:Adding mds.k on smithi165 2024-09-19T07:08:35.921 INFO:tasks.cephadm:Adding mds.c on smithi179 2024-09-19T07:08:35.921 INFO:tasks.cephadm:Adding mds.f on smithi179 2024-09-19T07:08:35.921 INFO:tasks.cephadm:Adding mds.i on smithi179 2024-09-19T07:08:35.921 INFO:tasks.cephadm:Adding mds.l on smithi179 2024-09-19T07:08:35.921 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph orch apply mds all '12;smithi148=a;smithi148=d;smithi148=g;smithi148=j;smithi165=b;smithi165=e;smithi165=h;smithi165=k;smithi179=c;smithi179=f;smithi179=i;smithi179=l' 2024-09-19T07:08:36.181 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:08:36.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:36 smithi179 ceph-mon[35716]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:08:36.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:36 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/998213713' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T07:08:36.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:36 smithi148 ceph-mon[31180]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:08:36.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:36 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/998213713' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T07:08:36.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:36 smithi165 ceph-mon[35326]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:08:36.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:36 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/998213713' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T07:08:36.656 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.638+0000 7f5b5ee8d640 1 -- 172.21.15.179:0/2133870349 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b58102e00 msgr2=0x7f5b58103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:36.657 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.638+0000 7f5b5ee8d640 1 --2- 172.21.15.179:0/2133870349 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b58102e00 0x7f5b58103280 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5b44009900 tx=0x7f5b4402a410 comp rx=0 tx=0).stop 2024-09-19T07:08:36.657 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.638+0000 7f5b5ee8d640 1 -- 172.21.15.179:0/2133870349 shutdown_connections 2024-09-19T07:08:36.657 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.638+0000 7f5b5ee8d640 1 --2- 172.21.15.179:0/2133870349 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5b581037c0 0x7f5b5810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:36.657 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.638+0000 7f5b5ee8d640 1 --2- 172.21.15.179:0/2133870349 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b58102e00 0x7f5b58103280 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:36.657 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.638+0000 7f5b5ee8d640 1 --2- 172.21.15.179:0/2133870349 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5b58101c00 0x7f5b58102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:36.657 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.638+0000 7f5b5ee8d640 1 -- 172.21.15.179:0/2133870349 >> 172.21.15.179:0/2133870349 conn(0x7f5b580fd390 msgr2=0x7f5b580ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:36.657 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.638+0000 7f5b5ee8d640 1 -- 172.21.15.179:0/2133870349 shutdown_connections 2024-09-19T07:08:36.657 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.638+0000 7f5b5ee8d640 1 -- 172.21.15.179:0/2133870349 wait complete. 2024-09-19T07:08:36.657 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.639+0000 7f5b5ee8d640 1 Processor -- start 2024-09-19T07:08:36.657 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.639+0000 7f5b5ee8d640 1 -- start start 2024-09-19T07:08:36.657 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.639+0000 7f5b5ee8d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b58101c00 0x7f5b58197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:36.657 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.639+0000 7f5b5ee8d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5b58102e00 0x7f5b581984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:36.658 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.639+0000 7f5b5ee8d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5b581037c0 0x7f5b5819f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:36.658 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.639+0000 7f5b5ee8d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5b5810d900 con 0x7f5b58102e00 2024-09-19T07:08:36.658 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.639+0000 7f5b5ee8d640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5b5810d780 con 0x7f5b581037c0 2024-09-19T07:08:36.658 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.639+0000 7f5b5ee8d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5b5810da80 con 0x7f5b58101c00 2024-09-19T07:08:36.658 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.639+0000 7f5b5cc29640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b58101c00 0x7f5b58197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:36.658 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.639+0000 7f5b5cc29640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b58101c00 0x7f5b58197f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:45310/0 (socket says 172.21.15.179:45310) 2024-09-19T07:08:36.658 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.639+0000 7f5b5cc29640 1 -- 172.21.15.179:0/48360866 learned_addr learned my addr 172.21.15.179:0/48360866 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-09-19T07:08:36.658 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.639+0000 7f5b5d42a640 1 --2- 172.21.15.179:0/48360866 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5b581037c0 0x7f5b5819f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:36.658 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.640+0000 7f5b5cc29640 1 -- 172.21.15.179:0/48360866 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5b581037c0 msgr2=0x7f5b5819f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:36.658 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.640+0000 7f5b5cc29640 1 --2- 172.21.15.179:0/48360866 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5b581037c0 0x7f5b5819f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:36.658 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.640+0000 7f5b5cc29640 1 -- 172.21.15.179:0/48360866 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5b58102e00 msgr2=0x7f5b581984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:36.658 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.640+0000 7f5b57fff640 1 --2- 172.21.15.179:0/48360866 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5b58102e00 0x7f5b581984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:36.659 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.640+0000 7f5b5cc29640 1 --2- 172.21.15.179:0/48360866 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5b58102e00 0x7f5b581984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:36.659 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.640+0000 7f5b5cc29640 1 -- 172.21.15.179:0/48360866 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b5819fbc0 con 0x7f5b58101c00 2024-09-19T07:08:36.659 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.640+0000 7f5b5cc29640 1 --2- 172.21.15.179:0/48360866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b58101c00 0x7f5b58197f90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c00b450 tx=0x7f5b4c00b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:36.659 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.640+0000 7f5b55ffb640 1 -- 172.21.15.179:0/48360866 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c015020 con 0x7f5b58101c00 2024-09-19T07:08:36.659 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.640+0000 7f5b55ffb640 1 -- 172.21.15.179:0/48360866 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b4c011d70 con 0x7f5b58101c00 2024-09-19T07:08:36.659 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.640+0000 7f5b55ffb640 1 -- 172.21.15.179:0/48360866 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c00f340 con 0x7f5b58101c00 2024-09-19T07:08:36.659 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.640+0000 7f5b5ee8d640 1 -- 172.21.15.179:0/48360866 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b5819feb0 con 0x7f5b58101c00 2024-09-19T07:08:36.659 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.640+0000 7f5b5ee8d640 1 -- 172.21.15.179:0/48360866 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b581a0380 con 0x7f5b58101c00 2024-09-19T07:08:36.659 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.641+0000 7f5b5ee8d640 1 -- 172.21.15.179:0/48360866 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b58108ff0 con 0x7f5b58101c00 2024-09-19T07:08:36.659 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.642+0000 7f5b55ffb640 1 -- 172.21.15.179:0/48360866 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f5b4c018020 con 0x7f5b58101c00 2024-09-19T07:08:36.659 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.643+0000 7f5b55ffb640 1 --2- 172.21.15.179:0/48360866 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f5b480a3270 0x7f5b480a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:36.659 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.643+0000 7f5b55ffb640 1 -- 172.21.15.179:0/48360866 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f5b4c0ceed0 con 0x7f5b58101c00 2024-09-19T07:08:36.659 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.643+0000 7f5b57fff640 1 --2- 172.21.15.179:0/48360866 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f5b480a3270 0x7f5b480a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:36.660 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.644+0000 7f5b57fff640 1 --2- 172.21.15.179:0/48360866 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f5b480a3270 0x7f5b480a5730 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5b44031610 tx=0x7f5b44000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:36.660 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.647+0000 7f5b55ffb640 1 -- 172.21.15.179:0/48360866 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5b4c01f020 con 0x7f5b58101c00 2024-09-19T07:08:36.826 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.825+0000 7f5b5ee8d640 1 -- 172.21.15.179:0/48360866 --> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi148=a;smithi148=d;smithi148=g;smithi148=j;smithi165=b;smithi165=e;smithi165=h;smithi165=k;smithi179=c;smithi179=f;smithi179=i;smithi179=l", "target": ["mon-mgr", ""]}) -- 0x7f5b58062830 con 0x7f5b480a3270 2024-09-19T07:08:36.834 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.833+0000 7f5b55ffb640 1 -- 172.21.15.179:0/48360866 <== mgr.14148 v2:172.21.15.148:6800/3007822654 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f5b58062830 con 0x7f5b480a3270 2024-09-19T07:08:36.834 INFO:teuthology.orchestra.run.smithi179.stdout:Scheduled mds.all update... 2024-09-19T07:08:36.836 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.835+0000 7f5b5ee8d640 1 -- 172.21.15.179:0/48360866 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f5b480a3270 msgr2=0x7f5b480a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:36.837 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.835+0000 7f5b5ee8d640 1 --2- 172.21.15.179:0/48360866 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f5b480a3270 0x7f5b480a5730 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5b44031610 tx=0x7f5b44000bc0 comp rx=0 tx=0).stop 2024-09-19T07:08:36.837 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.835+0000 7f5b5ee8d640 1 -- 172.21.15.179:0/48360866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b58101c00 msgr2=0x7f5b58197f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:36.837 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.835+0000 7f5b5ee8d640 1 --2- 172.21.15.179:0/48360866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b58101c00 0x7f5b58197f90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c00b450 tx=0x7f5b4c00b910 comp rx=0 tx=0).stop 2024-09-19T07:08:36.837 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.835+0000 7f5b5ee8d640 1 -- 172.21.15.179:0/48360866 shutdown_connections 2024-09-19T07:08:36.837 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.835+0000 7f5b5ee8d640 1 --2- 172.21.15.179:0/48360866 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f5b480a3270 0x7f5b480a5730 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:36.837 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.835+0000 7f5b5ee8d640 1 --2- 172.21.15.179:0/48360866 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5b581037c0 0x7f5b5819f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:36.837 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.835+0000 7f5b5ee8d640 1 --2- 172.21.15.179:0/48360866 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5b58102e00 0x7f5b581984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:36.837 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.835+0000 7f5b5ee8d640 1 --2- 172.21.15.179:0/48360866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b58101c00 0x7f5b58197f90 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:36.837 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.835+0000 7f5b5ee8d640 1 -- 172.21.15.179:0/48360866 >> 172.21.15.179:0/48360866 conn(0x7f5b580fd390 msgr2=0x7f5b581061c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:36.837 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.836+0000 7f5b5ee8d640 1 -- 172.21.15.179:0/48360866 shutdown_connections 2024-09-19T07:08:36.837 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-19T07:08:36.836+0000 7f5b5ee8d640 1 -- 172.21.15.179:0/48360866 wait complete. 2024-09-19T07:08:37.549 DEBUG:teuthology.orchestra.run.smithi148:mds.a> sudo journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mds.a.service 2024-09-19T07:08:37.552 DEBUG:teuthology.orchestra.run.smithi148:mds.d> sudo journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mds.d.service 2024-09-19T07:08:37.595 DEBUG:teuthology.orchestra.run.smithi148:mds.g> sudo journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mds.g.service 2024-09-19T07:08:37.638 DEBUG:teuthology.orchestra.run.smithi148:mds.j> sudo journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mds.j.service 2024-09-19T07:08:37.680 DEBUG:teuthology.orchestra.run.smithi165:mds.b> sudo journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mds.b.service 2024-09-19T07:08:37.684 DEBUG:teuthology.orchestra.run.smithi165:mds.e> sudo journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mds.e.service 2024-09-19T07:08:37.727 DEBUG:teuthology.orchestra.run.smithi165:mds.h> sudo journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mds.h.service 2024-09-19T07:08:37.771 DEBUG:teuthology.orchestra.run.smithi165:mds.k> sudo journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mds.k.service 2024-09-19T07:08:37.813 DEBUG:teuthology.orchestra.run.smithi179:mds.c> sudo journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mds.c.service 2024-09-19T07:08:37.816 DEBUG:teuthology.orchestra.run.smithi179:mds.f> sudo journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mds.f.service 2024-09-19T07:08:37.859 DEBUG:teuthology.orchestra.run.smithi179:mds.i> sudo journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mds.i.service 2024-09-19T07:08:37.902 DEBUG:teuthology.orchestra.run.smithi179:mds.l> sudo journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mds.l.service 2024-09-19T07:08:37.945 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-19T07:08:37.946 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:08:38.100 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:37 smithi179 ceph-mon[35716]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi148=a;smithi148=d;smithi148=g;smithi148=j;smithi165=b;smithi165=e;smithi165=h;smithi165=k;smithi179=c;smithi179=f;smithi179=i;smithi179=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:08:38.100 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:37 smithi179 ceph-mon[35716]: Saving service mds.all spec with placement smithi148=a;smithi148=d;smithi148=g;smithi148=j;smithi165=b;smithi165=e;smithi165=h;smithi165=k;smithi179=c;smithi179=f;smithi179=i;smithi179=l;count:12 2024-09-19T07:08:38.100 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:37 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:38.100 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:37 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:08:38.100 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:37 smithi179 ceph-mon[35716]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:08:38.100 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:37 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:38.100 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:37 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:08:38.101 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:37 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:38.101 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:37 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:08:38.101 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:37 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:08:38.101 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:37 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:38.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:37 smithi165 ceph-mon[35326]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi148=a;smithi148=d;smithi148=g;smithi148=j;smithi165=b;smithi165=e;smithi165=h;smithi165=k;smithi179=c;smithi179=f;smithi179=i;smithi179=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:08:38.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:37 smithi165 ceph-mon[35326]: Saving service mds.all spec with placement smithi148=a;smithi148=d;smithi148=g;smithi148=j;smithi165=b;smithi165=e;smithi165=h;smithi165=k;smithi179=c;smithi179=f;smithi179=i;smithi179=l;count:12 2024-09-19T07:08:38.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:37 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:38.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:37 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:08:38.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:37 smithi165 ceph-mon[35326]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:08:38.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:37 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:38.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:37 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:08:38.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:37 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:38.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:37 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:08:38.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:37 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:08:38.135 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:37 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:38.188 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:08:38.309 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:37 smithi148 ceph-mon[31180]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi148=a;smithi148=d;smithi148=g;smithi148=j;smithi165=b;smithi165=e;smithi165=h;smithi165=k;smithi179=c;smithi179=f;smithi179=i;smithi179=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:08:38.310 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:37 smithi148 ceph-mon[31180]: Saving service mds.all spec with placement smithi148=a;smithi148=d;smithi148=g;smithi148=j;smithi165=b;smithi165=e;smithi165=h;smithi165=k;smithi179=c;smithi179=f;smithi179=i;smithi179=l;count:12 2024-09-19T07:08:38.310 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:37 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:38.310 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:37 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:08:38.310 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:37 smithi148 ceph-mon[31180]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:08:38.310 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:37 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:38.310 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:37 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:08:38.310 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:37 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:38.310 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:37 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:08:38.310 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:37 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:08:38.310 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:37 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:38.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.656+0000 7fb04cc88640 1 -- 172.21.15.148:0/2823636549 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb048101df0 msgr2=0x7fb0481021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:38.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.656+0000 7fb04cc88640 1 --2- 172.21.15.148:0/2823636549 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb048101df0 0x7fb0481021d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb040009ca0 tx=0x7fb04002a8c0 comp rx=0 tx=0).stop 2024-09-19T07:08:38.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.656+0000 7fb04cc88640 1 -- 172.21.15.148:0/2823636549 shutdown_connections 2024-09-19T07:08:38.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.656+0000 7fb04cc88640 1 --2- 172.21.15.148:0/2823636549 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb048106f20 0x7fb04810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:38.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.656+0000 7fb04cc88640 1 --2- 172.21.15.148:0/2823636549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0481027a0 0x7fb0481067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:38.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.656+0000 7fb04cc88640 1 --2- 172.21.15.148:0/2823636549 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb048101df0 0x7fb0481021d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:38.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.656+0000 7fb04cc88640 1 -- 172.21.15.148:0/2823636549 >> 172.21.15.148:0/2823636549 conn(0x7fb0480fd8f0 msgr2=0x7fb0480ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:38.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.656+0000 7fb04cc88640 1 -- 172.21.15.148:0/2823636549 shutdown_connections 2024-09-19T07:08:38.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.656+0000 7fb04cc88640 1 -- 172.21.15.148:0/2823636549 wait complete. 2024-09-19T07:08:38.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.656+0000 7fb04cc88640 1 Processor -- start 2024-09-19T07:08:38.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.657+0000 7fb04cc88640 1 -- start start 2024-09-19T07:08:38.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.657+0000 7fb04cc88640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb048101df0 0x7fb04819a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:38.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.657+0000 7fb04cc88640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb0481027a0 0x7fb04819ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:38.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.657+0000 7fb04cc88640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb048106f20 0x7fb04819efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:38.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.657+0000 7fb04cc88640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb048111fa0 con 0x7fb048106f20 2024-09-19T07:08:38.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.657+0000 7fb04cc88640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb048111e20 con 0x7fb0481027a0 2024-09-19T07:08:38.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.657+0000 7fb04cc88640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb048112120 con 0x7fb048101df0 2024-09-19T07:08:38.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.657+0000 7fb046d9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb048106f20 0x7fb04819efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:38.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.657+0000 7fb04659c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb048101df0 0x7fb04819a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:38.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.657+0000 7fb046d9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb048106f20 0x7fb04819efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34818/0 (socket says 172.21.15.148:34818) 2024-09-19T07:08:38.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.657+0000 7fb046d9d640 1 -- 172.21.15.148:0/647579842 learned_addr learned my addr 172.21.15.148:0/647579842 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:08:38.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.657+0000 7fb045d9b640 1 --2- 172.21.15.148:0/647579842 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb0481027a0 0x7fb04819ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:38.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.657+0000 7fb046d9d640 1 -- 172.21.15.148:0/647579842 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb048101df0 msgr2=0x7fb04819a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:38.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.657+0000 7fb046d9d640 1 --2- 172.21.15.148:0/647579842 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb048101df0 0x7fb04819a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:38.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.657+0000 7fb046d9d640 1 -- 172.21.15.148:0/647579842 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb0481027a0 msgr2=0x7fb04819ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:38.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.657+0000 7fb046d9d640 1 --2- 172.21.15.148:0/647579842 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb0481027a0 0x7fb04819ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:38.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.657+0000 7fb046d9d640 1 -- 172.21.15.148:0/647579842 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb04819f690 con 0x7fb048106f20 2024-09-19T07:08:38.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.657+0000 7fb045d9b640 1 --2- 172.21.15.148:0/647579842 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb0481027a0 0x7fb04819ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:08:38.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.657+0000 7fb046d9d640 1 --2- 172.21.15.148:0/647579842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb048106f20 0x7fb04819efb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb038009fd0 tx=0x7fb03800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:38.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.657+0000 7fb03f7fe640 1 -- 172.21.15.148:0/647579842 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb038011830 con 0x7fb048106f20 2024-09-19T07:08:38.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.657+0000 7fb03f7fe640 1 -- 172.21.15.148:0/647579842 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb038016070 con 0x7fb048106f20 2024-09-19T07:08:38.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.658+0000 7fb04cc88640 1 -- 172.21.15.148:0/647579842 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb04819f980 con 0x7fb048106f20 2024-09-19T07:08:38.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.658+0000 7fb03f7fe640 1 -- 172.21.15.148:0/647579842 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03800f2e0 con 0x7fb048106f20 2024-09-19T07:08:38.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.658+0000 7fb04cc88640 1 -- 172.21.15.148:0/647579842 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0481a7260 con 0x7fb048106f20 2024-09-19T07:08:38.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.659+0000 7fb04cc88640 1 -- 172.21.15.148:0/647579842 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0481021d0 con 0x7fb048106f20 2024-09-19T07:08:38.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.660+0000 7fb03f7fe640 1 -- 172.21.15.148:0/647579842 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fb0380119d0 con 0x7fb048106f20 2024-09-19T07:08:38.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.661+0000 7fb03f7fe640 1 --2- 172.21.15.148:0/647579842 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fb0340a3240 0x7fb0340a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:38.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.661+0000 7fb04659c640 1 --2- 172.21.15.148:0/647579842 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fb0340a3240 0x7fb0340a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:38.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.661+0000 7fb03f7fe640 1 -- 172.21.15.148:0/647579842 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fb0380ceb20 con 0x7fb048106f20 2024-09-19T07:08:38.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.661+0000 7fb04659c640 1 --2- 172.21.15.148:0/647579842 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fb0340a3240 0x7fb0340a5700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb040006010 tx=0x7fb040009360 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:38.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.665+0000 7fb03f7fe640 1 -- 172.21.15.148:0/647579842 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb03809bce0 con 0x7fb048106f20 2024-09-19T07:08:38.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.871+0000 7fb04cc88640 1 -- 172.21.15.148:0/647579842 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb0481a7490 con 0x7fb048106f20 2024-09-19T07:08:38.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.871+0000 7fb03f7fe640 1 -- 172.21.15.148:0/647579842 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7fb03809b5e0 con 0x7fb048106f20 2024-09-19T07:08:38.872 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:08:38.873 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":1,"btime":"2024-09-19T07:01:47:891017+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-19T07:08:38.873 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 1 2024-09-19T07:08:38.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.873+0000 7fb04cc88640 1 -- 172.21.15.148:0/647579842 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fb0340a3240 msgr2=0x7fb0340a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:38.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.873+0000 7fb04cc88640 1 --2- 172.21.15.148:0/647579842 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fb0340a3240 0x7fb0340a5700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb040006010 tx=0x7fb040009360 comp rx=0 tx=0).stop 2024-09-19T07:08:38.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.873+0000 7fb04cc88640 1 -- 172.21.15.148:0/647579842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb048106f20 msgr2=0x7fb04819efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:38.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.873+0000 7fb04cc88640 1 --2- 172.21.15.148:0/647579842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb048106f20 0x7fb04819efb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb038009fd0 tx=0x7fb03800b8e0 comp rx=0 tx=0).stop 2024-09-19T07:08:38.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.873+0000 7fb04cc88640 1 -- 172.21.15.148:0/647579842 shutdown_connections 2024-09-19T07:08:38.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.873+0000 7fb04cc88640 1 --2- 172.21.15.148:0/647579842 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fb0340a3240 0x7fb0340a5700 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:38.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.873+0000 7fb04cc88640 1 --2- 172.21.15.148:0/647579842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb048106f20 0x7fb04819efb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:38.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.873+0000 7fb04cc88640 1 --2- 172.21.15.148:0/647579842 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb0481027a0 0x7fb04819ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:38.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.873+0000 7fb04cc88640 1 --2- 172.21.15.148:0/647579842 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb048101df0 0x7fb04819a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:38.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.873+0000 7fb04cc88640 1 -- 172.21.15.148:0/647579842 >> 172.21.15.148:0/647579842 conn(0x7fb0480fd8f0 msgr2=0x7fb0480fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:38.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.874+0000 7fb04cc88640 1 -- 172.21.15.148:0/647579842 shutdown_connections 2024-09-19T07:08:38.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:38.874+0000 7fb04cc88640 1 -- 172.21.15.148:0/647579842 wait complete. 2024-09-19T07:08:39.014 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:38 smithi179 ceph-mon[35716]: Deploying daemon mds.l on smithi179 2024-09-19T07:08:39.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:38 smithi165 ceph-mon[35326]: Deploying daemon mds.l on smithi179 2024-09-19T07:08:39.272 INFO:journalctl@ceph.mds.l.smithi179.stdout:Sep 19 07:08:39 smithi179 systemd[1]: Starting Ceph mds.l for eae8a4a8-7654-11ef-bceb-c7b262605968... 2024-09-19T07:08:39.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:38 smithi148 ceph-mon[31180]: Deploying daemon mds.l on smithi179 2024-09-19T07:08:39.702 INFO:journalctl@ceph.mds.l.smithi179.stdout:Sep 19 07:08:39 smithi179 podman[65361]: 2024-09-19 07:08:39.316952493 +0000 UTC m=+0.015988545 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:08:39.703 INFO:journalctl@ceph.mds.l.smithi179.stdout:Sep 19 07:08:39 smithi179 podman[65361]: 2024-09-19 07:08:39.480338824 +0000 UTC m=+0.179374863 container create 2c0b8b4f0308dd6835796d0103478006e2670fc9c79f5781781e2ba29e4f9959 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-l, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=) 2024-09-19T07:08:39.703 INFO:journalctl@ceph.mds.l.smithi179.stdout:Sep 19 07:08:39 smithi179 podman[65361]: 2024-09-19 07:08:39.69954585 +0000 UTC m=+0.398581889 container init 2c0b8b4f0308dd6835796d0103478006e2670fc9c79f5781781e2ba29e4f9959 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-l, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-19T07:08:40.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:39 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/647579842' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:08:40.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:39 smithi179 ceph-mon[35716]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:08:40.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:39 smithi179 ceph-mon[35716]: mds.? [v2:172.21.15.179:6832/1289882987,v1:172.21.15.179:6833/1289882987] up:boot 2024-09-19T07:08:40.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:39 smithi179 ceph-mon[35716]: fsmap 1 up:standby 2024-09-19T07:08:40.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:39 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T07:08:40.023 INFO:journalctl@ceph.mds.l.smithi179.stdout:Sep 19 07:08:39 smithi179 podman[65361]: 2024-09-19 07:08:39.702356636 +0000 UTC m=+0.401392675 container start 2c0b8b4f0308dd6835796d0103478006e2670fc9c79f5781781e2ba29e4f9959 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-l, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-19T07:08:40.023 INFO:journalctl@ceph.mds.l.smithi179.stdout:Sep 19 07:08:39 smithi179 ceph-mds[65380]: -- 172.21.15.179:0/861758033 <== mon.1 v2:172.21.15.179:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f7072e1860 con 0x55f7072bf000 2024-09-19T07:08:40.023 INFO:journalctl@ceph.mds.l.smithi179.stdout:Sep 19 07:08:39 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-l[65376]: starting mds.l at 2024-09-19T07:08:40.023 INFO:journalctl@ceph.mds.l.smithi179.stdout:Sep 19 07:08:39 smithi179 bash[65361]: 2c0b8b4f0308dd6835796d0103478006e2670fc9c79f5781781e2ba29e4f9959 2024-09-19T07:08:40.023 INFO:journalctl@ceph.mds.l.smithi179.stdout:Sep 19 07:08:39 smithi179 systemd[1]: Started Ceph mds.l for eae8a4a8-7654-11ef-bceb-c7b262605968. 2024-09-19T07:08:40.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:39 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/647579842' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:08:40.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:39 smithi165 ceph-mon[35326]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:08:40.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:39 smithi165 ceph-mon[35326]: mds.? [v2:172.21.15.179:6832/1289882987,v1:172.21.15.179:6833/1289882987] up:boot 2024-09-19T07:08:40.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:39 smithi165 ceph-mon[35326]: fsmap 1 up:standby 2024-09-19T07:08:40.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:39 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T07:08:40.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:39 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/647579842' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:08:40.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:39 smithi148 ceph-mon[31180]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:08:40.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:39 smithi148 ceph-mon[31180]: mds.? [v2:172.21.15.179:6832/1289882987,v1:172.21.15.179:6833/1289882987] up:boot 2024-09-19T07:08:40.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:39 smithi148 ceph-mon[31180]: fsmap 1 up:standby 2024-09-19T07:08:40.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:39 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T07:08:41.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:40 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:41.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:40 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:41.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:40 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:41.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:40 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:08:41.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:40 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:08:41.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:40 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:41.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:40 smithi165 ceph-mon[35326]: Deploying daemon mds.k on smithi165 2024-09-19T07:08:41.271 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:40 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:41.271 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:40 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:41.271 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:40 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:41.271 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:40 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:08:41.271 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:40 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:08:41.271 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:40 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:41.271 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:40 smithi148 ceph-mon[31180]: Deploying daemon mds.k on smithi165 2024-09-19T07:08:41.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:40 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:41.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:40 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:41.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:40 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:41.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:40 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:08:41.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:40 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:08:41.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:40 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:41.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:40 smithi179 ceph-mon[35716]: Deploying daemon mds.k on smithi165 2024-09-19T07:08:41.418 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:08:41.663 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:08:41.820 INFO:journalctl@ceph.mds.k.smithi165.stdout:Sep 19 07:08:41 smithi165 systemd[1]: Starting Ceph mds.k for eae8a4a8-7654-11ef-bceb-c7b262605968... 2024-09-19T07:08:42.042 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:41 smithi148 ceph-mon[31180]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:08:42.085 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:41 smithi165 ceph-mon[35326]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:08:42.086 INFO:journalctl@ceph.mds.k.smithi165.stdout:Sep 19 07:08:41 smithi165 podman[64658]: 2024-09-19 07:08:41.723523836 +0000 UTC m=+0.016148058 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:08:42.086 INFO:journalctl@ceph.mds.k.smithi165.stdout:Sep 19 07:08:41 smithi165 podman[64658]: 2024-09-19 07:08:41.85880316 +0000 UTC m=+0.151427378 container create 76df50e4476490c1e571e2ebba43d80e51d5a65f6f14c0d354aeafc3316862d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-k, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-19T07:08:42.086 INFO:journalctl@ceph.mds.k.smithi165.stdout:Sep 19 07:08:42 smithi165 podman[64658]: 2024-09-19 07:08:42.085379785 +0000 UTC m=+0.378004008 container init 76df50e4476490c1e571e2ebba43d80e51d5a65f6f14c0d354aeafc3316862d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-k, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True) 2024-09-19T07:08:42.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.121+0000 7fe39c152640 1 -- 172.21.15.148:0/2741941321 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe394100b30 msgr2=0x7fe394100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:42.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.121+0000 7fe39c152640 1 --2- 172.21.15.148:0/2741941321 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe394100b30 0x7fe394100f10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe384009900 tx=0x7fe38402a470 comp rx=0 tx=0).stop 2024-09-19T07:08:42.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.121+0000 7fe39c152640 1 -- 172.21.15.148:0/2741941321 shutdown_connections 2024-09-19T07:08:42.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.121+0000 7fe39c152640 1 --2- 172.21.15.148:0/2741941321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe394105f40 0x7fe3941063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:42.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.121+0000 7fe39c152640 1 --2- 172.21.15.148:0/2741941321 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe394101450 0x7fe394105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:42.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.121+0000 7fe39c152640 1 --2- 172.21.15.148:0/2741941321 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe394100b30 0x7fe394100f10 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:42.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.121+0000 7fe39c152640 1 -- 172.21.15.148:0/2741941321 >> 172.21.15.148:0/2741941321 conn(0x7fe3940fc7a0 msgr2=0x7fe3940febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:42.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.121+0000 7fe39c152640 1 -- 172.21.15.148:0/2741941321 shutdown_connections 2024-09-19T07:08:42.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.121+0000 7fe39c152640 1 -- 172.21.15.148:0/2741941321 wait complete. 2024-09-19T07:08:42.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.122+0000 7fe39c152640 1 Processor -- start 2024-09-19T07:08:42.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.122+0000 7fe39c152640 1 -- start start 2024-09-19T07:08:42.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.122+0000 7fe39c152640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe394100b30 0x7fe3941a46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:42.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.122+0000 7fe39c152640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe394101450 0x7fe3941a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:42.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.122+0000 7fe39c152640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe394105f40 0x7fe39419e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:42.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.122+0000 7fe39c152640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe394118620 con 0x7fe394101450 2024-09-19T07:08:42.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.122+0000 7fe39c152640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe3941184a0 con 0x7fe394105f40 2024-09-19T07:08:42.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.122+0000 7fe39c152640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe3941187a0 con 0x7fe394100b30 2024-09-19T07:08:42.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.122+0000 7fe3996ed640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe394101450 0x7fe3941a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:42.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.122+0000 7fe3996ed640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe394101450 0x7fe3941a4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34828/0 (socket says 172.21.15.148:34828) 2024-09-19T07:08:42.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.122+0000 7fe3996ed640 1 -- 172.21.15.148:0/3732384149 learned_addr learned my addr 172.21.15.148:0/3732384149 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:08:42.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.122+0000 7fe39a6ef640 1 --2- 172.21.15.148:0/3732384149 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe394105f40 0x7fe39419e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:42.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.122+0000 7fe399eee640 1 --2- 172.21.15.148:0/3732384149 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe394100b30 0x7fe3941a46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:42.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.122+0000 7fe3996ed640 1 -- 172.21.15.148:0/3732384149 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe394100b30 msgr2=0x7fe3941a46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:42.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.122+0000 7fe3996ed640 1 --2- 172.21.15.148:0/3732384149 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe394100b30 0x7fe3941a46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:42.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.122+0000 7fe3996ed640 1 -- 172.21.15.148:0/3732384149 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe394105f40 msgr2=0x7fe39419e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:42.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.122+0000 7fe3996ed640 1 --2- 172.21.15.148:0/3732384149 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe394105f40 0x7fe39419e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:42.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.122+0000 7fe3996ed640 1 -- 172.21.15.148:0/3732384149 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe39419efa0 con 0x7fe394101450 2024-09-19T07:08:42.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.123+0000 7fe3996ed640 1 --2- 172.21.15.148:0/3732384149 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe394101450 0x7fe3941a4bf0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe39000c970 tx=0x7fe39000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:42.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.123+0000 7fe38affd640 1 -- 172.21.15.148:0/3732384149 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe390007bb0 con 0x7fe394101450 2024-09-19T07:08:42.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.123+0000 7fe38affd640 1 -- 172.21.15.148:0/3732384149 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe390007d50 con 0x7fe394101450 2024-09-19T07:08:42.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.123+0000 7fe39c152640 1 -- 172.21.15.148:0/3732384149 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe39419f290 con 0x7fe394101450 2024-09-19T07:08:42.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.123+0000 7fe38affd640 1 -- 172.21.15.148:0/3732384149 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe390018820 con 0x7fe394101450 2024-09-19T07:08:42.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.123+0000 7fe39c152640 1 -- 172.21.15.148:0/3732384149 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3941ab580 con 0x7fe394101450 2024-09-19T07:08:42.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.124+0000 7fe39c152640 1 -- 172.21.15.148:0/3732384149 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe394105920 con 0x7fe394101450 2024-09-19T07:08:42.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.125+0000 7fe38affd640 1 -- 172.21.15.148:0/3732384149 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fe3900189c0 con 0x7fe394101450 2024-09-19T07:08:42.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.125+0000 7fe38affd640 1 --2- 172.21.15.148:0/3732384149 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fe3800a3240 0x7fe3800a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:42.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.126+0000 7fe399eee640 1 --2- 172.21.15.148:0/3732384149 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fe3800a3240 0x7fe3800a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:42.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.126+0000 7fe38affd640 1 -- 172.21.15.148:0/3732384149 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fe3900cf500 con 0x7fe394101450 2024-09-19T07:08:42.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.126+0000 7fe399eee640 1 --2- 172.21.15.148:0/3732384149 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fe3800a3240 0x7fe3800a5700 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe38402a990 tx=0x7fe384000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:42.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.130+0000 7fe38affd640 1 -- 172.21.15.148:0/3732384149 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe390014030 con 0x7fe394101450 2024-09-19T07:08:42.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:41 smithi179 ceph-mon[35716]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:08:42.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.338+0000 7fe39c152640 1 -- 172.21.15.148:0/3732384149 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe3941ab8d0 con 0x7fe394101450 2024-09-19T07:08:42.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.339+0000 7fe38affd640 1 -- 172.21.15.148:0/3732384149 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7fe39009c6c0 con 0x7fe394101450 2024-09-19T07:08:42.340 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:08:42.341 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":2,"btime":"2024-09-19T07:08:39:730573+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T07:08:42.341 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 2 2024-09-19T07:08:42.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.342+0000 7fe39c152640 1 -- 172.21.15.148:0/3732384149 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fe3800a3240 msgr2=0x7fe3800a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:42.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.342+0000 7fe39c152640 1 --2- 172.21.15.148:0/3732384149 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fe3800a3240 0x7fe3800a5700 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe38402a990 tx=0x7fe384000bc0 comp rx=0 tx=0).stop 2024-09-19T07:08:42.344 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.342+0000 7fe39c152640 1 -- 172.21.15.148:0/3732384149 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe394101450 msgr2=0x7fe3941a4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:42.344 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.342+0000 7fe39c152640 1 --2- 172.21.15.148:0/3732384149 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe394101450 0x7fe3941a4bf0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe39000c970 tx=0x7fe39000ce30 comp rx=0 tx=0).stop 2024-09-19T07:08:42.344 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.342+0000 7fe39c152640 1 -- 172.21.15.148:0/3732384149 shutdown_connections 2024-09-19T07:08:42.344 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.342+0000 7fe39c152640 1 --2- 172.21.15.148:0/3732384149 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fe3800a3240 0x7fe3800a5700 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:42.344 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.342+0000 7fe39c152640 1 --2- 172.21.15.148:0/3732384149 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe394105f40 0x7fe39419e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:42.344 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.342+0000 7fe39c152640 1 --2- 172.21.15.148:0/3732384149 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe394101450 0x7fe3941a4bf0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:42.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.342+0000 7fe39c152640 1 --2- 172.21.15.148:0/3732384149 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe394100b30 0x7fe3941a46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:42.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.342+0000 7fe39c152640 1 -- 172.21.15.148:0/3732384149 >> 172.21.15.148:0/3732384149 conn(0x7fe3940fc7a0 msgr2=0x7fe3941038f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:42.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.342+0000 7fe39c152640 1 -- 172.21.15.148:0/3732384149 shutdown_connections 2024-09-19T07:08:42.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:42.342+0000 7fe39c152640 1 -- 172.21.15.148:0/3732384149 wait complete. 2024-09-19T07:08:42.384 INFO:journalctl@ceph.mds.k.smithi165.stdout:Sep 19 07:08:42 smithi165 podman[64658]: 2024-09-19 07:08:42.088455211 +0000 UTC m=+0.381079438 container start 76df50e4476490c1e571e2ebba43d80e51d5a65f6f14c0d354aeafc3316862d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-k, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-19T07:08:42.384 INFO:journalctl@ceph.mds.k.smithi165.stdout:Sep 19 07:08:42 smithi165 ceph-mds[64677]: -- 172.21.15.165:0/2413919603 <== mon.2 v2:172.21.15.165:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557612f8f860 con 0x557612f6d400 2024-09-19T07:08:42.384 INFO:journalctl@ceph.mds.k.smithi165.stdout:Sep 19 07:08:42 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-k[64673]: starting mds.k at 2024-09-19T07:08:42.384 INFO:journalctl@ceph.mds.k.smithi165.stdout:Sep 19 07:08:42 smithi165 bash[64658]: 76df50e4476490c1e571e2ebba43d80e51d5a65f6f14c0d354aeafc3316862d5 2024-09-19T07:08:42.384 INFO:journalctl@ceph.mds.k.smithi165.stdout:Sep 19 07:08:42 smithi165 systemd[1]: Started Ceph mds.k for eae8a4a8-7654-11ef-bceb-c7b262605968. 2024-09-19T07:08:43.474 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:43 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:43.475 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:43 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:43.475 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:43 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:43.475 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:43 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:08:43.475 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:43 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:08:43.475 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:43 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:43.475 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:43 smithi148 ceph-mon[31180]: Deploying daemon mds.j on smithi148 2024-09-19T07:08:43.475 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:43 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/3732384149' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:08:43.476 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:43 smithi148 ceph-mon[31180]: mds.? [v2:172.21.15.165:6832/1860818320,v1:172.21.15.165:6833/1860818320] up:boot 2024-09-19T07:08:43.476 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:43 smithi148 ceph-mon[31180]: fsmap 2 up:standby 2024-09-19T07:08:43.476 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:43 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T07:08:43.476 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:43 smithi148 ceph-mon[31180]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:08:43.479 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:43 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:43.479 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:43 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:43.479 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:43 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:43.479 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:43 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:08:43.479 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:43 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:08:43.479 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:43 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:43.479 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:43 smithi165 ceph-mon[35326]: Deploying daemon mds.j on smithi148 2024-09-19T07:08:43.479 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:43 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/3732384149' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:08:43.479 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:43 smithi165 ceph-mon[35326]: mds.? [v2:172.21.15.165:6832/1860818320,v1:172.21.15.165:6833/1860818320] up:boot 2024-09-19T07:08:43.480 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:43 smithi165 ceph-mon[35326]: fsmap 2 up:standby 2024-09-19T07:08:43.480 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:43 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T07:08:43.480 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:43 smithi165 ceph-mon[35326]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:08:43.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:43 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:43.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:43 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:43.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:43 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:43.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:43 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:08:43.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:43 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:08:43.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:43 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:43.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:43 smithi179 ceph-mon[35716]: Deploying daemon mds.j on smithi148 2024-09-19T07:08:43.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:43 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/3732384149' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:08:43.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:43 smithi179 ceph-mon[35716]: mds.? [v2:172.21.15.165:6832/1860818320,v1:172.21.15.165:6833/1860818320] up:boot 2024-09-19T07:08:43.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:43 smithi179 ceph-mon[35716]: fsmap 2 up:standby 2024-09-19T07:08:43.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:43 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T07:08:43.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:43 smithi179 ceph-mon[35716]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:08:44.756 INFO:journalctl@ceph.mds.j.smithi148.stdout:Sep 19 07:08:44 smithi148 systemd[1]: Starting Ceph mds.j for eae8a4a8-7654-11ef-bceb-c7b262605968... 2024-09-19T07:08:44.959 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:08:45.033 INFO:journalctl@ceph.mds.j.smithi148.stdout:Sep 19 07:08:44 smithi148 podman[67557]: 2024-09-19 07:08:44.755256168 +0000 UTC m=+0.089571203 container create dd7931079e2177e8d1c199c484b0b152038b1553f89e66905b972d1d74ec2344 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-j, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4) 2024-09-19T07:08:45.033 INFO:journalctl@ceph.mds.j.smithi148.stdout:Sep 19 07:08:44 smithi148 podman[67557]: 2024-09-19 07:08:44.682168589 +0000 UTC m=+0.016483599 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:08:45.033 INFO:journalctl@ceph.mds.j.smithi148.stdout:Sep 19 07:08:45 smithi148 podman[67557]: 2024-09-19 07:08:45.032657297 +0000 UTC m=+0.366972301 container init dd7931079e2177e8d1c199c484b0b152038b1553f89e66905b972d1d74ec2344 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-j, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:08:45.224 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:08:45.333 INFO:journalctl@ceph.mds.j.smithi148.stdout:Sep 19 07:08:45 smithi148 podman[67557]: 2024-09-19 07:08:45.035837285 +0000 UTC m=+0.370152285 container start dd7931079e2177e8d1c199c484b0b152038b1553f89e66905b972d1d74ec2344 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-j, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-19T07:08:45.333 INFO:journalctl@ceph.mds.j.smithi148.stdout:Sep 19 07:08:45 smithi148 ceph-mds[67594]: -- 172.21.15.148:0/3230329439 <== mon.0 v2:172.21.15.148:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558614be5c20 con 0x558614bc3400 2024-09-19T07:08:45.333 INFO:journalctl@ceph.mds.j.smithi148.stdout:Sep 19 07:08:45 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-j[67572]: starting mds.j at 2024-09-19T07:08:45.333 INFO:journalctl@ceph.mds.j.smithi148.stdout:Sep 19 07:08:45 smithi148 bash[67557]: dd7931079e2177e8d1c199c484b0b152038b1553f89e66905b972d1d74ec2344 2024-09-19T07:08:45.333 INFO:journalctl@ceph.mds.j.smithi148.stdout:Sep 19 07:08:45 smithi148 systemd[1]: Started Ceph mds.j for eae8a4a8-7654-11ef-bceb-c7b262605968. 2024-09-19T07:08:45.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.691+0000 7f5a84893640 1 -- 172.21.15.148:0/1305444184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a80101420 msgr2=0x7f5a8010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:45.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.691+0000 7f5a84893640 1 --2- 172.21.15.148:0/1305444184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a80101420 0x7f5a8010d950 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5a78009cd0 tx=0x7f5a7802a8e0 comp rx=0 tx=0).stop 2024-09-19T07:08:45.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.692+0000 7f5a84893640 1 -- 172.21.15.148:0/1305444184 shutdown_connections 2024-09-19T07:08:45.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.692+0000 7f5a84893640 1 --2- 172.21.15.148:0/1305444184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a80101420 0x7f5a8010d950 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:45.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.692+0000 7f5a84893640 1 --2- 172.21.15.148:0/1305444184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a80100a80 0x7f5a80100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:45.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.692+0000 7f5a84893640 1 --2- 172.21.15.148:0/1305444184 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5a80106a80 0x7f5a80106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:45.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.692+0000 7f5a84893640 1 -- 172.21.15.148:0/1305444184 >> 172.21.15.148:0/1305444184 conn(0x7f5a800fc7a0 msgr2=0x7f5a800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:45.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.692+0000 7f5a84893640 1 -- 172.21.15.148:0/1305444184 shutdown_connections 2024-09-19T07:08:45.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.692+0000 7f5a84893640 1 -- 172.21.15.148:0/1305444184 wait complete. 2024-09-19T07:08:45.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.692+0000 7f5a84893640 1 Processor -- start 2024-09-19T07:08:45.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.692+0000 7f5a84893640 1 -- start start 2024-09-19T07:08:45.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.693+0000 7f5a84893640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a80100a80 0x7f5a80198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:45.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.693+0000 7f5a84893640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a80101420 0x7f5a80198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:45.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.693+0000 7f5a84893640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5a80106a80 0x7f5a8019ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:45.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.693+0000 7f5a84893640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5a80110f20 con 0x7f5a80100a80 2024-09-19T07:08:45.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.693+0000 7f5a84893640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5a80110da0 con 0x7f5a80106a80 2024-09-19T07:08:45.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.693+0000 7f5a84893640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5a801110a0 con 0x7f5a80101420 2024-09-19T07:08:45.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.693+0000 7f5a7e59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a80100a80 0x7f5a80198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:45.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.693+0000 7f5a7e59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a80100a80 0x7f5a80198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57246/0 (socket says 172.21.15.148:57246) 2024-09-19T07:08:45.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.693+0000 7f5a7e59c640 1 -- 172.21.15.148:0/4278080073 learned_addr learned my addr 172.21.15.148:0/4278080073 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:08:45.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.693+0000 7f5a7ed9d640 1 --2- 172.21.15.148:0/4278080073 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5a80106a80 0x7f5a8019ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:45.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.693+0000 7f5a7dd9b640 1 --2- 172.21.15.148:0/4278080073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a80101420 0x7f5a80198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:45.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.693+0000 7f5a7e59c640 1 -- 172.21.15.148:0/4278080073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a80101420 msgr2=0x7f5a80198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:45.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.693+0000 7f5a7e59c640 1 --2- 172.21.15.148:0/4278080073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a80101420 0x7f5a80198a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:45.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.693+0000 7f5a7e59c640 1 -- 172.21.15.148:0/4278080073 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5a80106a80 msgr2=0x7f5a8019ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:45.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.693+0000 7f5a7e59c640 1 --2- 172.21.15.148:0/4278080073 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5a80106a80 0x7f5a8019ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:45.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.693+0000 7f5a7e59c640 1 -- 172.21.15.148:0/4278080073 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a8019d500 con 0x7f5a80100a80 2024-09-19T07:08:45.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.693+0000 7f5a7ed9d640 1 --2- 172.21.15.148:0/4278080073 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5a80106a80 0x7f5a8019ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:08:45.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.693+0000 7f5a7e59c640 1 --2- 172.21.15.148:0/4278080073 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a80100a80 0x7f5a80198550 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5a7000b4a0 tx=0x7f5a7000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:45.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.693+0000 7f5a6f7fe640 1 -- 172.21.15.148:0/4278080073 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a70014070 con 0x7f5a80100a80 2024-09-19T07:08:45.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.693+0000 7f5a84893640 1 -- 172.21.15.148:0/4278080073 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a8019d7f0 con 0x7f5a80100a80 2024-09-19T07:08:45.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.693+0000 7f5a6f7fe640 1 -- 172.21.15.148:0/4278080073 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a70010af0 con 0x7f5a80100a80 2024-09-19T07:08:45.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.693+0000 7f5a6f7fe640 1 -- 172.21.15.148:0/4278080073 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a70017d10 con 0x7f5a80100a80 2024-09-19T07:08:45.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.693+0000 7f5a84893640 1 -- 172.21.15.148:0/4278080073 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a801a50d0 con 0x7f5a80100a80 2024-09-19T07:08:45.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.694+0000 7f5a84893640 1 -- 172.21.15.148:0/4278080073 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a80100f60 con 0x7f5a80100a80 2024-09-19T07:08:45.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.695+0000 7f5a6f7fe640 1 -- 172.21.15.148:0/4278080073 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f5a70017070 con 0x7f5a80100a80 2024-09-19T07:08:45.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.696+0000 7f5a6f7fe640 1 --2- 172.21.15.148:0/4278080073 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f5a680a3240 0x7f5a680a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:45.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.696+0000 7f5a7dd9b640 1 --2- 172.21.15.148:0/4278080073 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f5a680a3240 0x7f5a680a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:45.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.697+0000 7f5a6f7fe640 1 -- 172.21.15.148:0/4278080073 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f5a700ced20 con 0x7f5a80100a80 2024-09-19T07:08:45.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.697+0000 7f5a7dd9b640 1 --2- 172.21.15.148:0/4278080073 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f5a680a3240 0x7f5a680a5700 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5a800fed40 tx=0x7f5a74008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:45.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.700+0000 7f5a6f7fe640 1 -- 172.21.15.148:0/4278080073 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5a7009be40 con 0x7f5a80100a80 2024-09-19T07:08:45.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.920+0000 7f5a84893640 1 -- 172.21.15.148:0/4278080073 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5a801a5330 con 0x7f5a80100a80 2024-09-19T07:08:45.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.921+0000 7f5a6f7fe640 1 -- 172.21.15.148:0/4278080073 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3094 (secure 0 0 0) 0x7f5a7009b740 con 0x7f5a80100a80 2024-09-19T07:08:45.922 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:08:45.922 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":4,"btime":"2024-09-19T07:08:45:115858+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T07:08:45.922 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 4 2024-09-19T07:08:45.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.923+0000 7f5a84893640 1 -- 172.21.15.148:0/4278080073 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f5a680a3240 msgr2=0x7f5a680a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:45.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.923+0000 7f5a84893640 1 --2- 172.21.15.148:0/4278080073 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f5a680a3240 0x7f5a680a5700 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5a800fed40 tx=0x7f5a74008040 comp rx=0 tx=0).stop 2024-09-19T07:08:45.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.923+0000 7f5a84893640 1 -- 172.21.15.148:0/4278080073 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a80100a80 msgr2=0x7f5a80198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:45.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.923+0000 7f5a84893640 1 --2- 172.21.15.148:0/4278080073 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a80100a80 0x7f5a80198550 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5a7000b4a0 tx=0x7f5a7000b960 comp rx=0 tx=0).stop 2024-09-19T07:08:45.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.923+0000 7f5a84893640 1 -- 172.21.15.148:0/4278080073 shutdown_connections 2024-09-19T07:08:45.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.923+0000 7f5a84893640 1 --2- 172.21.15.148:0/4278080073 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f5a680a3240 0x7f5a680a5700 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:45.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.923+0000 7f5a84893640 1 --2- 172.21.15.148:0/4278080073 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5a80106a80 0x7f5a8019ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:45.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.923+0000 7f5a84893640 1 --2- 172.21.15.148:0/4278080073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a80101420 0x7f5a80198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:45.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.923+0000 7f5a84893640 1 --2- 172.21.15.148:0/4278080073 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a80100a80 0x7f5a80198550 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:45.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.923+0000 7f5a84893640 1 -- 172.21.15.148:0/4278080073 >> 172.21.15.148:0/4278080073 conn(0x7f5a800fc7a0 msgr2=0x7f5a80104890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:45.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.923+0000 7f5a84893640 1 -- 172.21.15.148:0/4278080073 shutdown_connections 2024-09-19T07:08:45.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:45.923+0000 7f5a84893640 1 -- 172.21.15.148:0/4278080073 wait complete. 2024-09-19T07:08:46.249 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:46 smithi148 ceph-mon[31180]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:08:46.250 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:46 smithi148 ceph-mon[31180]: mds.? [v2:172.21.15.148:6834/1040309943,v1:172.21.15.148:6835/1040309943] up:boot 2024-09-19T07:08:46.250 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:46 smithi148 ceph-mon[31180]: fsmap 3 up:standby 2024-09-19T07:08:46.250 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:46 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T07:08:46.250 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:46 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:46.250 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:46 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:46.250 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:46 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:46.250 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:46 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:08:46.250 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:46 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:08:46.250 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:46 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:46.250 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:46 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/4278080073' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:08:46.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:46 smithi165 ceph-mon[35326]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:08:46.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:46 smithi165 ceph-mon[35326]: mds.? [v2:172.21.15.148:6834/1040309943,v1:172.21.15.148:6835/1040309943] up:boot 2024-09-19T07:08:46.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:46 smithi165 ceph-mon[35326]: fsmap 3 up:standby 2024-09-19T07:08:46.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:46 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T07:08:46.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:46 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:46.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:46 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:46.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:46 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:46.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:46 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:08:46.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:46 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:08:46.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:46 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:46.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:46 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/4278080073' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:08:46.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:46 smithi179 ceph-mon[35716]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:08:46.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:46 smithi179 ceph-mon[35716]: mds.? [v2:172.21.15.148:6834/1040309943,v1:172.21.15.148:6835/1040309943] up:boot 2024-09-19T07:08:46.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:46 smithi179 ceph-mon[35716]: fsmap 3 up:standby 2024-09-19T07:08:46.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:46 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T07:08:46.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:46 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:46.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:46 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:46.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:46 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:46.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:46 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:08:46.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:46 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:08:46.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:46 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:46.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:46 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/4278080073' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:08:47.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:47 smithi148 ceph-mon[31180]: Deploying daemon mds.d on smithi148 2024-09-19T07:08:47.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:47 smithi165 ceph-mon[35326]: Deploying daemon mds.d on smithi148 2024-09-19T07:08:47.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:47 smithi179 ceph-mon[35716]: Deploying daemon mds.d on smithi148 2024-09-19T07:08:48.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:48 smithi165 ceph-mon[35326]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:08:48.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:48 smithi179 ceph-mon[35716]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:08:48.537 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:48 smithi148 ceph-mon[31180]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:08:48.671 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:08:48.945 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:08:49.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.418+0000 7f61c9b67640 1 -- 172.21.15.148:0/747246592 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61c4101de0 msgr2=0x7f61c41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:49.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.418+0000 7f61c9b67640 1 --2- 172.21.15.148:0/747246592 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61c4101de0 0x7f61c41021c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f61b4009900 tx=0x7f61b402a410 comp rx=0 tx=0).stop 2024-09-19T07:08:49.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.418+0000 7f61c9b67640 1 -- 172.21.15.148:0/747246592 shutdown_connections 2024-09-19T07:08:49.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.418+0000 7f61c9b67640 1 --2- 172.21.15.148:0/747246592 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f61c4106f10 0x7f61c410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:49.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.418+0000 7f61c9b67640 1 --2- 172.21.15.148:0/747246592 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61c4102790 0x7f61c41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:49.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.418+0000 7f61c9b67640 1 --2- 172.21.15.148:0/747246592 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61c4101de0 0x7f61c41021c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:49.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.418+0000 7f61c9b67640 1 -- 172.21.15.148:0/747246592 >> 172.21.15.148:0/747246592 conn(0x7f61c40fd8c0 msgr2=0x7f61c40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:49.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.418+0000 7f61c9b67640 1 -- 172.21.15.148:0/747246592 shutdown_connections 2024-09-19T07:08:49.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.418+0000 7f61c9b67640 1 -- 172.21.15.148:0/747246592 wait complete. 2024-09-19T07:08:49.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.419+0000 7f61c9b67640 1 Processor -- start 2024-09-19T07:08:49.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.419+0000 7f61c9b67640 1 -- start start 2024-09-19T07:08:49.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.420+0000 7f61c9b67640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61c4101de0 0x7f61c4198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:49.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.420+0000 7f61c9b67640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61c4102790 0x7f61c41988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:49.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.420+0000 7f61c9b67640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f61c4106f10 0x7f61c419cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:49.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.420+0000 7f61c9b67640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f61c4111f30 con 0x7f61c4102790 2024-09-19T07:08:49.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.420+0000 7f61c9b67640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f61c4111db0 con 0x7f61c4106f10 2024-09-19T07:08:49.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.420+0000 7f61c9b67640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f61c41120b0 con 0x7f61c4101de0 2024-09-19T07:08:49.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.420+0000 7f61c2ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61c4102790 0x7f61c41988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:49.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.420+0000 7f61c2ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61c4102790 0x7f61c41988d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57286/0 (socket says 172.21.15.148:57286) 2024-09-19T07:08:49.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.420+0000 7f61c2ffd640 1 -- 172.21.15.148:0/2376947944 learned_addr learned my addr 172.21.15.148:0/2376947944 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:08:49.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.420+0000 7f61c37fe640 1 --2- 172.21.15.148:0/2376947944 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61c4101de0 0x7f61c4198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:49.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.420+0000 7f61c3fff640 1 --2- 172.21.15.148:0/2376947944 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f61c4106f10 0x7f61c419cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:49.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.420+0000 7f61c2ffd640 1 -- 172.21.15.148:0/2376947944 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61c4101de0 msgr2=0x7f61c4198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:49.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.420+0000 7f61c2ffd640 1 --2- 172.21.15.148:0/2376947944 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61c4101de0 0x7f61c4198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:49.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.420+0000 7f61c2ffd640 1 -- 172.21.15.148:0/2376947944 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f61c4106f10 msgr2=0x7f61c419cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:49.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.420+0000 7f61c2ffd640 1 --2- 172.21.15.148:0/2376947944 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f61c4106f10 0x7f61c419cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:49.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.420+0000 7f61c2ffd640 1 -- 172.21.15.148:0/2376947944 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61c419d340 con 0x7f61c4102790 2024-09-19T07:08:49.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.420+0000 7f61c37fe640 1 --2- 172.21.15.148:0/2376947944 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61c4101de0 0x7f61c4198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:08:49.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.420+0000 7f61c2ffd640 1 --2- 172.21.15.148:0/2376947944 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61c4102790 0x7f61c41988d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f61b800c920 tx=0x7f61b800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:49.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.420+0000 7f61c0ff9640 1 -- 172.21.15.148:0/2376947944 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b8007c70 con 0x7f61c4102790 2024-09-19T07:08:49.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.420+0000 7f61c0ff9640 1 -- 172.21.15.148:0/2376947944 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61b8007e10 con 0x7f61c4102790 2024-09-19T07:08:49.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.420+0000 7f61c9b67640 1 -- 172.21.15.148:0/2376947944 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61c419d630 con 0x7f61c4102790 2024-09-19T07:08:49.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.420+0000 7f61c0ff9640 1 -- 172.21.15.148:0/2376947944 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b8018890 con 0x7f61c4102790 2024-09-19T07:08:49.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.421+0000 7f61c9b67640 1 -- 172.21.15.148:0/2376947944 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61c41a4f10 con 0x7f61c4102790 2024-09-19T07:08:49.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.422+0000 7f61c9b67640 1 -- 172.21.15.148:0/2376947944 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61c41021c0 con 0x7f61c4102790 2024-09-19T07:08:49.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.423+0000 7f61c0ff9640 1 -- 172.21.15.148:0/2376947944 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f61b8018a70 con 0x7f61c4102790 2024-09-19T07:08:49.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.423+0000 7f61c0ff9640 1 --2- 172.21.15.148:0/2376947944 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f61ac0a3240 0x7f61ac0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:49.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.423+0000 7f61c37fe640 1 --2- 172.21.15.148:0/2376947944 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f61ac0a3240 0x7f61ac0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:49.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.423+0000 7f61c0ff9640 1 -- 172.21.15.148:0/2376947944 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f61b80cf670 con 0x7f61c4102790 2024-09-19T07:08:49.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.424+0000 7f61c37fe640 1 --2- 172.21.15.148:0/2376947944 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f61ac0a3240 0x7f61ac0a5700 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f61b4005ab0 tx=0x7f61b4005a20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:49.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.427+0000 7f61c0ff9640 1 -- 172.21.15.148:0/2376947944 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f61b8014030 con 0x7f61c4102790 2024-09-19T07:08:49.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.628+0000 7f61c9b67640 1 -- 172.21.15.148:0/2376947944 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f61c402d7c0 con 0x7f61c4102790 2024-09-19T07:08:49.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.629+0000 7f61c0ff9640 1 -- 172.21.15.148:0/2376947944 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3922 (secure 0 0 0) 0x7f61b800de20 con 0x7f61c4102790 2024-09-19T07:08:49.630 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:08:49.630 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":5,"btime":"2024-09-19T07:08:49:125249+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T07:08:49.630 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 5 2024-09-19T07:08:49.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.631+0000 7f61c9b67640 1 -- 172.21.15.148:0/2376947944 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f61ac0a3240 msgr2=0x7f61ac0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:49.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.631+0000 7f61c9b67640 1 --2- 172.21.15.148:0/2376947944 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f61ac0a3240 0x7f61ac0a5700 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f61b4005ab0 tx=0x7f61b4005a20 comp rx=0 tx=0).stop 2024-09-19T07:08:49.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.631+0000 7f61c9b67640 1 -- 172.21.15.148:0/2376947944 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61c4102790 msgr2=0x7f61c41988d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:49.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.631+0000 7f61c9b67640 1 --2- 172.21.15.148:0/2376947944 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61c4102790 0x7f61c41988d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f61b800c920 tx=0x7f61b800cde0 comp rx=0 tx=0).stop 2024-09-19T07:08:49.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.631+0000 7f61c9b67640 1 -- 172.21.15.148:0/2376947944 shutdown_connections 2024-09-19T07:08:49.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.631+0000 7f61c9b67640 1 --2- 172.21.15.148:0/2376947944 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f61ac0a3240 0x7f61ac0a5700 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:49.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.631+0000 7f61c9b67640 1 --2- 172.21.15.148:0/2376947944 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f61c4106f10 0x7f61c419cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:49.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.631+0000 7f61c9b67640 1 --2- 172.21.15.148:0/2376947944 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61c4102790 0x7f61c41988d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:49.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.631+0000 7f61c9b67640 1 --2- 172.21.15.148:0/2376947944 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61c4101de0 0x7f61c4198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:49.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.631+0000 7f61c9b67640 1 -- 172.21.15.148:0/2376947944 >> 172.21.15.148:0/2376947944 conn(0x7f61c40fd8c0 msgr2=0x7f61c40fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:49.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.631+0000 7f61c9b67640 1 -- 172.21.15.148:0/2376947944 shutdown_connections 2024-09-19T07:08:49.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:49.631+0000 7f61c9b67640 1 -- 172.21.15.148:0/2376947944 wait complete. 2024-09-19T07:08:49.925 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:49 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:49.925 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:49 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:49.926 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:49 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:49.926 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:49 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:08:49.926 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:49 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:08:49.926 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:49 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:49.926 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:49 smithi148 ceph-mon[31180]: Deploying daemon mds.e on smithi165 2024-09-19T07:08:49.926 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:49 smithi148 ceph-mon[31180]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:08:49.926 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:49 smithi148 ceph-mon[31180]: mds.? [v2:172.21.15.148:6836/2835228384,v1:172.21.15.148:6837/2835228384] up:boot 2024-09-19T07:08:49.926 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:49 smithi148 ceph-mon[31180]: fsmap 4 up:standby 2024-09-19T07:08:49.926 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:49 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T07:08:49.926 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:49 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/2376947944' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:08:50.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:49 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:50.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:49 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:50.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:49 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:50.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:49 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:08:50.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:49 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:08:50.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:49 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:50.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:49 smithi179 ceph-mon[35716]: Deploying daemon mds.e on smithi165 2024-09-19T07:08:50.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:49 smithi179 ceph-mon[35716]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:08:50.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:49 smithi179 ceph-mon[35716]: mds.? [v2:172.21.15.148:6836/2835228384,v1:172.21.15.148:6837/2835228384] up:boot 2024-09-19T07:08:50.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:49 smithi179 ceph-mon[35716]: fsmap 4 up:standby 2024-09-19T07:08:50.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:49 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T07:08:50.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:49 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/2376947944' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:08:50.124 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:49 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:50.125 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:49 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:50.125 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:49 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:50.125 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:49 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:08:50.125 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:49 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:08:50.125 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:49 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:50.125 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:49 smithi165 ceph-mon[35326]: Deploying daemon mds.e on smithi165 2024-09-19T07:08:50.125 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:49 smithi165 ceph-mon[35326]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:08:50.125 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:49 smithi165 ceph-mon[35326]: mds.? [v2:172.21.15.148:6836/2835228384,v1:172.21.15.148:6837/2835228384] up:boot 2024-09-19T07:08:50.125 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:49 smithi165 ceph-mon[35326]: fsmap 4 up:standby 2024-09-19T07:08:50.125 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:49 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T07:08:50.125 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:49 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/2376947944' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:08:50.785 INFO:journalctl@ceph.mds.e.smithi165.stdout:Sep 19 07:08:50 smithi165 systemd[1]: Starting Ceph mds.e for eae8a4a8-7654-11ef-bceb-c7b262605968... 2024-09-19T07:08:51.045 INFO:journalctl@ceph.mds.e.smithi165.stdout:Sep 19 07:08:50 smithi165 podman[64969]: 2024-09-19 07:08:50.784706913 +0000 UTC m=+0.107813813 container create a7ec468e1ee23e6b9c326fe331f509cbd69ca4a78c16abc29506aa49d4066744 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-e, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:08:51.046 INFO:journalctl@ceph.mds.e.smithi165.stdout:Sep 19 07:08:50 smithi165 podman[64969]: 2024-09-19 07:08:50.693172527 +0000 UTC m=+0.016279427 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:08:51.046 INFO:journalctl@ceph.mds.e.smithi165.stdout:Sep 19 07:08:50 smithi165 podman[64969]: 2024-09-19 07:08:50.987176434 +0000 UTC m=+0.310283334 container init a7ec468e1ee23e6b9c326fe331f509cbd69ca4a78c16abc29506aa49d4066744 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-e, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-19T07:08:51.046 INFO:journalctl@ceph.mds.e.smithi165.stdout:Sep 19 07:08:50 smithi165 podman[64969]: 2024-09-19 07:08:50.990040652 +0000 UTC m=+0.313147553 container start a7ec468e1ee23e6b9c326fe331f509cbd69ca4a78c16abc29506aa49d4066744 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-e, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-19T07:08:51.046 INFO:journalctl@ceph.mds.e.smithi165.stdout:Sep 19 07:08:51 smithi165 ceph-mds[64988]: -- 172.21.15.165:0/3043918168 <== mon.2 v2:172.21.15.165:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5561088d1c20 con 0x5561088af000 2024-09-19T07:08:51.046 INFO:journalctl@ceph.mds.e.smithi165.stdout:Sep 19 07:08:51 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-e[64984]: starting mds.e at 2024-09-19T07:08:51.046 INFO:journalctl@ceph.mds.e.smithi165.stdout:Sep 19 07:08:51 smithi165 bash[64969]: a7ec468e1ee23e6b9c326fe331f509cbd69ca4a78c16abc29506aa49d4066744 2024-09-19T07:08:51.384 INFO:journalctl@ceph.mds.e.smithi165.stdout:Sep 19 07:08:51 smithi165 systemd[1]: Started Ceph mds.e for eae8a4a8-7654-11ef-bceb-c7b262605968. 2024-09-19T07:08:52.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:52 smithi148 ceph-mon[31180]: mds.? [v2:172.21.15.165:6834/2146820965,v1:172.21.15.165:6835/2146820965] up:boot 2024-09-19T07:08:52.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:52 smithi148 ceph-mon[31180]: fsmap 5 up:standby 2024-09-19T07:08:52.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:52 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T07:08:52.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:52 smithi148 ceph-mon[31180]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:08:52.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:52 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:52.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:52 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:52.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:52 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:52.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:52 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:08:52.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:52 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:08:52.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:52 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:52.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:52 smithi148 ceph-mon[31180]: Deploying daemon mds.f on smithi179 2024-09-19T07:08:52.364 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:08:52.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:52 smithi165 ceph-mon[35326]: mds.? [v2:172.21.15.165:6834/2146820965,v1:172.21.15.165:6835/2146820965] up:boot 2024-09-19T07:08:52.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:52 smithi165 ceph-mon[35326]: fsmap 5 up:standby 2024-09-19T07:08:52.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:52 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T07:08:52.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:52 smithi165 ceph-mon[35326]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:08:52.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:52 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:52.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:52 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:52.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:52 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:52.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:52 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:08:52.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:52 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:08:52.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:52 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:52.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:52 smithi165 ceph-mon[35326]: Deploying daemon mds.f on smithi179 2024-09-19T07:08:52.516 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:52 smithi179 ceph-mon[35716]: mds.? [v2:172.21.15.165:6834/2146820965,v1:172.21.15.165:6835/2146820965] up:boot 2024-09-19T07:08:52.516 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:52 smithi179 ceph-mon[35716]: fsmap 5 up:standby 2024-09-19T07:08:52.517 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:52 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T07:08:52.517 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:52 smithi179 ceph-mon[35716]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:08:52.517 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:52 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:52.517 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:52 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:52.517 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:52 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:52.518 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:52 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:08:52.518 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:52 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:08:52.518 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:52 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:52.518 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:52 smithi179 ceph-mon[35716]: Deploying daemon mds.f on smithi179 2024-09-19T07:08:52.627 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:08:53.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.158+0000 7f6cb6f19640 1 -- 172.21.15.148:0/346932261 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cb0106a80 msgr2=0x7f6cb0106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:53.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.158+0000 7f6cb6f19640 1 --2- 172.21.15.148:0/346932261 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cb0106a80 0x7f6cb0106e60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6ca4009930 tx=0x7f6ca402a420 comp rx=0 tx=0).stop 2024-09-19T07:08:53.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.158+0000 7f6cb6f19640 1 -- 172.21.15.148:0/346932261 shutdown_connections 2024-09-19T07:08:53.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.158+0000 7f6cb6f19640 1 --2- 172.21.15.148:0/346932261 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6cb0101420 0x7f6cb010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:53.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.158+0000 7f6cb6f19640 1 --2- 172.21.15.148:0/346932261 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cb0100a80 0x7f6cb0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:53.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.158+0000 7f6cb6f19640 1 --2- 172.21.15.148:0/346932261 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cb0106a80 0x7f6cb0106e60 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:53.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.158+0000 7f6cb6f19640 1 -- 172.21.15.148:0/346932261 >> 172.21.15.148:0/346932261 conn(0x7f6cb00fc7a0 msgr2=0x7f6cb00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:53.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.158+0000 7f6cb6f19640 1 -- 172.21.15.148:0/346932261 shutdown_connections 2024-09-19T07:08:53.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.158+0000 7f6cb6f19640 1 -- 172.21.15.148:0/346932261 wait complete. 2024-09-19T07:08:53.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.158+0000 7f6cb6f19640 1 Processor -- start 2024-09-19T07:08:53.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.159+0000 7f6cb6f19640 1 -- start start 2024-09-19T07:08:53.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.159+0000 7f6cb6f19640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cb0100a80 0x7f6cb0198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:53.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.159+0000 7f6cb6f19640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cb0101420 0x7f6cb01989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:53.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.159+0000 7f6cb6f19640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6cb0106a80 0x7f6cb019cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:53.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.159+0000 7f6cb6f19640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb0110ea0 con 0x7f6cb0100a80 2024-09-19T07:08:53.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.159+0000 7f6cb6f19640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb0110d20 con 0x7f6cb0106a80 2024-09-19T07:08:53.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.159+0000 7f6cb6f19640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb0111020 con 0x7f6cb0101420 2024-09-19T07:08:53.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.159+0000 7f6cb4cb5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cb0100a80 0x7f6cb0198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:53.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.159+0000 7f6cb4cb5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cb0100a80 0x7f6cb0198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57302/0 (socket says 172.21.15.148:57302) 2024-09-19T07:08:53.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.159+0000 7f6cb4cb5640 1 -- 172.21.15.148:0/2006727452 learned_addr learned my addr 172.21.15.148:0/2006727452 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:08:53.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.159+0000 7f6cb54b6640 1 --2- 172.21.15.148:0/2006727452 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6cb0106a80 0x7f6cb019cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:53.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.159+0000 7f6cb4cb5640 1 -- 172.21.15.148:0/2006727452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cb0101420 msgr2=0x7f6cb01989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:53.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.159+0000 7f6caffff640 1 --2- 172.21.15.148:0/2006727452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cb0101420 0x7f6cb01989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:53.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.159+0000 7f6cb4cb5640 1 --2- 172.21.15.148:0/2006727452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cb0101420 0x7f6cb01989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:53.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.159+0000 7f6cb4cb5640 1 -- 172.21.15.148:0/2006727452 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6cb0106a80 msgr2=0x7f6cb019cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:53.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.159+0000 7f6cb4cb5640 1 --2- 172.21.15.148:0/2006727452 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6cb0106a80 0x7f6cb019cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:53.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.159+0000 7f6cb4cb5640 1 -- 172.21.15.148:0/2006727452 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cb019d430 con 0x7f6cb0100a80 2024-09-19T07:08:53.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.159+0000 7f6caffff640 1 --2- 172.21.15.148:0/2006727452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cb0101420 0x7f6cb01989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:08:53.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.159+0000 7f6cb54b6640 1 --2- 172.21.15.148:0/2006727452 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6cb0106a80 0x7f6cb019cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:08:53.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.159+0000 7f6cb4cb5640 1 --2- 172.21.15.148:0/2006727452 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cb0100a80 0x7f6cb0198480 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6ca4009a50 tx=0x7f6ca4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:53.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.159+0000 7f6cadffb640 1 -- 172.21.15.148:0/2006727452 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca403f030 con 0x7f6cb0100a80 2024-09-19T07:08:53.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.160+0000 7f6cb6f19640 1 -- 172.21.15.148:0/2006727452 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cb019d6c0 con 0x7f6cb0100a80 2024-09-19T07:08:53.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.160+0000 7f6cadffb640 1 -- 172.21.15.148:0/2006727452 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ca4003ce0 con 0x7f6cb0100a80 2024-09-19T07:08:53.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.160+0000 7f6cadffb640 1 -- 172.21.15.148:0/2006727452 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca4035070 con 0x7f6cb0100a80 2024-09-19T07:08:53.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.160+0000 7f6cb6f19640 1 -- 172.21.15.148:0/2006727452 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cb01a5000 con 0x7f6cb0100a80 2024-09-19T07:08:53.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.161+0000 7f6cb6f19640 1 -- 172.21.15.148:0/2006727452 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cb0100ee0 con 0x7f6cb0100a80 2024-09-19T07:08:53.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.162+0000 7f6cadffb640 1 -- 172.21.15.148:0/2006727452 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f6ca4042030 con 0x7f6cb0100a80 2024-09-19T07:08:53.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.162+0000 7f6cadffb640 1 --2- 172.21.15.148:0/2006727452 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f6ca00a3240 0x7f6ca00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:53.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.163+0000 7f6cadffb640 1 -- 172.21.15.148:0/2006727452 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f6ca40eff60 con 0x7f6cb0100a80 2024-09-19T07:08:53.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.163+0000 7f6caffff640 1 --2- 172.21.15.148:0/2006727452 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f6ca00a3240 0x7f6ca00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:53.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.163+0000 7f6caffff640 1 --2- 172.21.15.148:0/2006727452 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f6ca00a3240 0x7f6ca00a5700 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c006fd0 tx=0x7f6c9c008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:53.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.166+0000 7f6cadffb640 1 -- 172.21.15.148:0/2006727452 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6ca40bd120 con 0x7f6cb0100a80 2024-09-19T07:08:53.210 INFO:journalctl@ceph.mds.f.smithi179.stdout:Sep 19 07:08:53 smithi179 systemd[1]: Starting Ceph mds.f for eae8a4a8-7654-11ef-bceb-c7b262605968... 2024-09-19T07:08:53.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.368+0000 7f6cb6f19640 1 -- 172.21.15.148:0/2006727452 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6cb010a000 con 0x7f6cb0100a80 2024-09-19T07:08:53.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.369+0000 7f6cadffb640 1 -- 172.21.15.148:0/2006727452 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4750 (secure 0 0 0) 0x7f6ca40bca20 con 0x7f6cb0100a80 2024-09-19T07:08:53.370 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:08:53.370 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":6,"btime":"2024-09-19T07:08:51:068470+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24383,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2146820965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2146820965},{"type":"v1","addr":"172.21.15.165:6835","nonce":2146820965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T07:08:53.370 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 6 2024-09-19T07:08:53.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.371+0000 7f6cb6f19640 1 -- 172.21.15.148:0/2006727452 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f6ca00a3240 msgr2=0x7f6ca00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:53.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.371+0000 7f6cb6f19640 1 --2- 172.21.15.148:0/2006727452 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f6ca00a3240 0x7f6ca00a5700 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c006fd0 tx=0x7f6c9c008040 comp rx=0 tx=0).stop 2024-09-19T07:08:53.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.371+0000 7f6cb6f19640 1 -- 172.21.15.148:0/2006727452 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cb0100a80 msgr2=0x7f6cb0198480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:53.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.371+0000 7f6cb6f19640 1 --2- 172.21.15.148:0/2006727452 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cb0100a80 0x7f6cb0198480 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6ca4009a50 tx=0x7f6ca4004270 comp rx=0 tx=0).stop 2024-09-19T07:08:53.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.371+0000 7f6cb6f19640 1 -- 172.21.15.148:0/2006727452 shutdown_connections 2024-09-19T07:08:53.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.371+0000 7f6cb6f19640 1 --2- 172.21.15.148:0/2006727452 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f6ca00a3240 0x7f6ca00a5700 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:53.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.371+0000 7f6cb6f19640 1 --2- 172.21.15.148:0/2006727452 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6cb0106a80 0x7f6cb019cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:53.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.371+0000 7f6cb6f19640 1 --2- 172.21.15.148:0/2006727452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cb0101420 0x7f6cb01989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:53.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.371+0000 7f6cb6f19640 1 --2- 172.21.15.148:0/2006727452 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cb0100a80 0x7f6cb0198480 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:53.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.371+0000 7f6cb6f19640 1 -- 172.21.15.148:0/2006727452 >> 172.21.15.148:0/2006727452 conn(0x7f6cb00fc7a0 msgr2=0x7f6cb006aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:53.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.371+0000 7f6cb6f19640 1 -- 172.21.15.148:0/2006727452 shutdown_connections 2024-09-19T07:08:53.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:53.371+0000 7f6cb6f19640 1 -- 172.21.15.148:0/2006727452 wait complete. 2024-09-19T07:08:53.464 INFO:journalctl@ceph.mds.f.smithi179.stdout:Sep 19 07:08:53 smithi179 podman[65659]: 2024-09-19 07:08:53.210119821 +0000 UTC m=+0.097670978 container create 967b3ea9b100138984eb08e98f0a43ab992202ec3249d8c604891e700b7cf7f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-f, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-19T07:08:53.465 INFO:journalctl@ceph.mds.f.smithi179.stdout:Sep 19 07:08:53 smithi179 podman[65659]: 2024-09-19 07:08:53.128927815 +0000 UTC m=+0.016478949 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:08:53.465 INFO:journalctl@ceph.mds.f.smithi179.stdout:Sep 19 07:08:53 smithi179 podman[65659]: 2024-09-19 07:08:53.437833372 +0000 UTC m=+0.325384496 container init 967b3ea9b100138984eb08e98f0a43ab992202ec3249d8c604891e700b7cf7f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-f, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-19T07:08:53.465 INFO:journalctl@ceph.mds.f.smithi179.stdout:Sep 19 07:08:53 smithi179 podman[65659]: 2024-09-19 07:08:53.440474655 +0000 UTC m=+0.328025773 container start 967b3ea9b100138984eb08e98f0a43ab992202ec3249d8c604891e700b7cf7f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-f, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True) 2024-09-19T07:08:53.772 INFO:journalctl@ceph.mds.f.smithi179.stdout:Sep 19 07:08:53 smithi179 ceph-mds[65680]: -- 172.21.15.179:0/2069375026 <== mon.1 v2:172.21.15.179:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559596a57860 con 0x559596a34800 2024-09-19T07:08:53.772 INFO:journalctl@ceph.mds.f.smithi179.stdout:Sep 19 07:08:53 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-f[65676]: starting mds.f at 2024-09-19T07:08:53.772 INFO:journalctl@ceph.mds.f.smithi179.stdout:Sep 19 07:08:53 smithi179 bash[65659]: 967b3ea9b100138984eb08e98f0a43ab992202ec3249d8c604891e700b7cf7f0 2024-09-19T07:08:53.773 INFO:journalctl@ceph.mds.f.smithi179.stdout:Sep 19 07:08:53 smithi179 systemd[1]: Started Ceph mds.f for eae8a4a8-7654-11ef-bceb-c7b262605968. 2024-09-19T07:08:54.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:54 smithi179 ceph-mon[35716]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:08:54.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:54 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/2006727452' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:08:54.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:54 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:54.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:54 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:54.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:54 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:54.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:54 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:08:54.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:54 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:08:54.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:54 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:54.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:54 smithi165 ceph-mon[35326]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:08:54.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:54 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/2006727452' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:08:54.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:54 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:54.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:54 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:54.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:54 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:54.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:54 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:08:54.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:54 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:08:54.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:54 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:54.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:54 smithi148 ceph-mon[31180]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:08:54.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:54 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/2006727452' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:08:54.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:54 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:54.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:54 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:54.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:54 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:54.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:54 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:08:54.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:54 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:08:54.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:54 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:55.239 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:55 smithi179 ceph-mon[35716]: Deploying daemon mds.c on smithi179 2024-09-19T07:08:55.239 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:55 smithi179 ceph-mon[35716]: mds.? [v2:172.21.15.179:6834/1566489108,v1:172.21.15.179:6835/1566489108] up:boot 2024-09-19T07:08:55.240 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:55 smithi179 ceph-mon[35716]: fsmap 6 up:standby 2024-09-19T07:08:55.240 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:55 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T07:08:55.525 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:08:55 smithi179 systemd[1]: Starting Ceph mds.c for eae8a4a8-7654-11ef-bceb-c7b262605968... 2024-09-19T07:08:55.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:55 smithi148 ceph-mon[31180]: Deploying daemon mds.c on smithi179 2024-09-19T07:08:55.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:55 smithi148 ceph-mon[31180]: mds.? [v2:172.21.15.179:6834/1566489108,v1:172.21.15.179:6835/1566489108] up:boot 2024-09-19T07:08:55.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:55 smithi148 ceph-mon[31180]: fsmap 6 up:standby 2024-09-19T07:08:55.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:55 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T07:08:55.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:55 smithi165 ceph-mon[35326]: Deploying daemon mds.c on smithi179 2024-09-19T07:08:55.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:55 smithi165 ceph-mon[35326]: mds.? [v2:172.21.15.179:6834/1566489108,v1:172.21.15.179:6835/1566489108] up:boot 2024-09-19T07:08:55.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:55 smithi165 ceph-mon[35326]: fsmap 6 up:standby 2024-09-19T07:08:55.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:55 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T07:08:55.927 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:08:55 smithi179 podman[65961]: 2024-09-19 07:08:55.545651379 +0000 UTC m=+0.016031197 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:08:55.927 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:08:55 smithi179 podman[65961]: 2024-09-19 07:08:55.665421326 +0000 UTC m=+0.135801191 container create 195696a9dfe25af7aed767dec73af5ed55cf03b70aede4dc4c02c95e945498f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c, ceph=True, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-19T07:08:56.148 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:08:56.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:56 smithi179 ceph-mon[35716]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:08:56.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:56 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:56.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:56 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:56.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:56 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:56.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:56 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:08:56.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:56 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:08:56.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:56 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:56.273 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:08:55 smithi179 podman[65961]: 2024-09-19 07:08:55.927387757 +0000 UTC m=+0.397767590 container init 195696a9dfe25af7aed767dec73af5ed55cf03b70aede4dc4c02c95e945498f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True) 2024-09-19T07:08:56.273 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:08:55 smithi179 podman[65961]: 2024-09-19 07:08:55.930465775 +0000 UTC m=+0.400845607 container start 195696a9dfe25af7aed767dec73af5ed55cf03b70aede4dc4c02c95e945498f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True) 2024-09-19T07:08:56.273 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:08:55 smithi179 ceph-mds[65980]: -- 172.21.15.179:0/3036158490 <== mon.1 v2:172.21.15.179:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c3597e5860 con 0x55c3597c2800 2024-09-19T07:08:56.273 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:08:55 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: starting mds.c at 2024-09-19T07:08:56.273 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:08:56 smithi179 bash[65961]: 195696a9dfe25af7aed767dec73af5ed55cf03b70aede4dc4c02c95e945498f0 2024-09-19T07:08:56.274 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:08:56 smithi179 systemd[1]: Started Ceph mds.c for eae8a4a8-7654-11ef-bceb-c7b262605968. 2024-09-19T07:08:56.403 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:08:56.521 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:56 smithi165 ceph-mon[35326]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:08:56.521 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:56 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:56.521 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:56 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:56.521 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:56 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:56.522 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:56 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:08:56.522 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:56 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:08:56.522 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:56 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:56.524 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:56 smithi148 ceph-mon[31180]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:08:56.524 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:56 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:56.524 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:56 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:56.524 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:56 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:56.525 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:56 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:08:56.525 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:56 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:08:56.525 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:56 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:56.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:56.837+0000 7fbe05bf4640 1 -- 172.21.15.148:0/1094599474 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe00102790 msgr2=0x7fbe001067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:56.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:56.837+0000 7fbe05bf4640 1 --2- 172.21.15.148:0/1094599474 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe00102790 0x7fbe001067e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4009900 tx=0x7fbdf402a410 comp rx=0 tx=0).stop 2024-09-19T07:08:56.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:56.837+0000 7fbe05bf4640 1 -- 172.21.15.148:0/1094599474 shutdown_connections 2024-09-19T07:08:56.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:56.837+0000 7fbe05bf4640 1 --2- 172.21.15.148:0/1094599474 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe00106f10 0x7fbe0010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:56.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:56.837+0000 7fbe05bf4640 1 --2- 172.21.15.148:0/1094599474 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe00102790 0x7fbe001067e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:56.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:56.837+0000 7fbe05bf4640 1 --2- 172.21.15.148:0/1094599474 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe00101de0 0x7fbe001021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:56.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:56.837+0000 7fbe05bf4640 1 -- 172.21.15.148:0/1094599474 >> 172.21.15.148:0/1094599474 conn(0x7fbe000fd8c0 msgr2=0x7fbe000ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:56.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:56.837+0000 7fbe05bf4640 1 -- 172.21.15.148:0/1094599474 shutdown_connections 2024-09-19T07:08:56.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:56.837+0000 7fbe05bf4640 1 -- 172.21.15.148:0/1094599474 wait complete. 2024-09-19T07:08:56.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:56.838+0000 7fbe05bf4640 1 Processor -- start 2024-09-19T07:08:56.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:56.838+0000 7fbe05bf4640 1 -- start start 2024-09-19T07:08:56.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:56.838+0000 7fbe05bf4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe00101de0 0x7fbe000744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:56.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:56.838+0000 7fbe05bf4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe00102790 0x7fbe00074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:56.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:56.838+0000 7fbe05bf4640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe00106f10 0x7fbe00074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:56.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:56.838+0000 7fbe05bf4640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbe00111f70 con 0x7fbe00102790 2024-09-19T07:08:56.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:56.838+0000 7fbe05bf4640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbe00111df0 con 0x7fbe00106f10 2024-09-19T07:08:56.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:56.838+0000 7fbe05bf4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbe001120f0 con 0x7fbe00101de0 2024-09-19T07:08:56.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:56.838+0000 7fbdfeffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe00102790 0x7fbe00074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:56.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:56.838+0000 7fbdfeffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe00102790 0x7fbe00074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38688/0 (socket says 172.21.15.148:38688) 2024-09-19T07:08:56.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:56.838+0000 7fbdfeffd640 1 -- 172.21.15.148:0/3586793070 learned_addr learned my addr 172.21.15.148:0/3586793070 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:08:56.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:56.839+0000 7fbdfffff640 1 --2- 172.21.15.148:0/3586793070 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe00106f10 0x7fbe00074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:56.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:56.839+0000 7fbdff7fe640 1 --2- 172.21.15.148:0/3586793070 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe00101de0 0x7fbe000744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:56.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:56.839+0000 7fbdfeffd640 1 -- 172.21.15.148:0/3586793070 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe00101de0 msgr2=0x7fbe000744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:56.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:56.839+0000 7fbdfeffd640 1 --2- 172.21.15.148:0/3586793070 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe00101de0 0x7fbe000744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:56.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:56.839+0000 7fbdfeffd640 1 -- 172.21.15.148:0/3586793070 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe00106f10 msgr2=0x7fbe00074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:56.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:56.839+0000 7fbdfeffd640 1 --2- 172.21.15.148:0/3586793070 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe00106f10 0x7fbe00074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:56.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:56.839+0000 7fbdfeffd640 1 -- 172.21.15.148:0/3586793070 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe001a6900 con 0x7fbe00102790 2024-09-19T07:08:56.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:56.839+0000 7fbdfeffd640 1 --2- 172.21.15.148:0/3586793070 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe00102790 0x7fbe00074a30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4006010 tx=0x7fbdf40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:56.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:56.839+0000 7fbdfcff9640 1 -- 172.21.15.148:0/3586793070 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf403f030 con 0x7fbe00102790 2024-09-19T07:08:56.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:56.839+0000 7fbdfcff9640 1 -- 172.21.15.148:0/3586793070 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbdf4003ce0 con 0x7fbe00102790 2024-09-19T07:08:56.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:56.839+0000 7fbe05bf4640 1 -- 172.21.15.148:0/3586793070 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe001a6b90 con 0x7fbe00102790 2024-09-19T07:08:56.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:56.839+0000 7fbdfcff9640 1 -- 172.21.15.148:0/3586793070 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf4035070 con 0x7fbe00102790 2024-09-19T07:08:56.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:56.839+0000 7fbe05bf4640 1 -- 172.21.15.148:0/3586793070 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe001a70c0 con 0x7fbe00102790 2024-09-19T07:08:56.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:56.840+0000 7fbe05bf4640 1 -- 172.21.15.148:0/3586793070 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe001021c0 con 0x7fbe00102790 2024-09-19T07:08:56.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:56.841+0000 7fbdfcff9640 1 -- 172.21.15.148:0/3586793070 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fbdf4042030 con 0x7fbe00102790 2024-09-19T07:08:56.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:56.842+0000 7fbdfcff9640 1 --2- 172.21.15.148:0/3586793070 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fbde80a32c0 0x7fbde80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:56.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:56.842+0000 7fbdff7fe640 1 --2- 172.21.15.148:0/3586793070 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fbde80a32c0 0x7fbde80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:56.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:56.842+0000 7fbdfcff9640 1 -- 172.21.15.148:0/3586793070 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fbdf40ef930 con 0x7fbe00102790 2024-09-19T07:08:56.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:56.843+0000 7fbdff7fe640 1 --2- 172.21.15.148:0/3586793070 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fbde80a32c0 0x7fbde80a5780 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0005fd0 tx=0x7fbdf0005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:56.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:56.846+0000 7fbdfcff9640 1 -- 172.21.15.148:0/3586793070 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbdf40bcbb0 con 0x7fbe00102790 2024-09-19T07:08:57.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:57.046+0000 7fbe05bf4640 1 -- 172.21.15.148:0/3586793070 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbe00109b60 con 0x7fbe00102790 2024-09-19T07:08:57.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:57.047+0000 7fbdfcff9640 1 -- 172.21.15.148:0/3586793070 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6406 (secure 0 0 0) 0x7fbdf40bc4b0 con 0x7fbe00102790 2024-09-19T07:08:57.048 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:08:57.048 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":8,"btime":"2024-09-19T07:08:56:148096+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24383,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2146820965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2146820965},{"type":"v1","addr":"172.21.15.165:6835","nonce":2146820965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24430,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1566489108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1566489108},{"type":"v1","addr":"172.21.15.179:6835","nonce":1566489108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24436,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-19T07:08:57.048 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 8 2024-09-19T07:08:57.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:57.049+0000 7fbe05bf4640 1 -- 172.21.15.148:0/3586793070 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fbde80a32c0 msgr2=0x7fbde80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:57.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:57.049+0000 7fbe05bf4640 1 --2- 172.21.15.148:0/3586793070 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fbde80a32c0 0x7fbde80a5780 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0005fd0 tx=0x7fbdf0005850 comp rx=0 tx=0).stop 2024-09-19T07:08:57.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:57.049+0000 7fbe05bf4640 1 -- 172.21.15.148:0/3586793070 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe00102790 msgr2=0x7fbe00074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:57.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:57.049+0000 7fbe05bf4640 1 --2- 172.21.15.148:0/3586793070 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe00102790 0x7fbe00074a30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4006010 tx=0x7fbdf40042f0 comp rx=0 tx=0).stop 2024-09-19T07:08:57.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:57.049+0000 7fbe05bf4640 1 -- 172.21.15.148:0/3586793070 shutdown_connections 2024-09-19T07:08:57.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:57.049+0000 7fbe05bf4640 1 --2- 172.21.15.148:0/3586793070 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fbde80a32c0 0x7fbde80a5780 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:57.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:57.049+0000 7fbe05bf4640 1 --2- 172.21.15.148:0/3586793070 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe00106f10 0x7fbe00074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:57.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:57.049+0000 7fbe05bf4640 1 --2- 172.21.15.148:0/3586793070 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe00102790 0x7fbe00074a30 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:57.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:57.049+0000 7fbe05bf4640 1 --2- 172.21.15.148:0/3586793070 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe00101de0 0x7fbe000744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:57.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:57.049+0000 7fbe05bf4640 1 -- 172.21.15.148:0/3586793070 >> 172.21.15.148:0/3586793070 conn(0x7fbe000fd8c0 msgr2=0x7fbe000fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:57.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:57.049+0000 7fbe05bf4640 1 -- 172.21.15.148:0/3586793070 shutdown_connections 2024-09-19T07:08:57.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:08:57.049+0000 7fbe05bf4640 1 -- 172.21.15.148:0/3586793070 wait complete. 2024-09-19T07:08:57.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:57 smithi179 ceph-mon[35716]: Deploying daemon mds.h on smithi165 2024-09-19T07:08:57.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:57 smithi179 ceph-mon[35716]: mds.? [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] up:boot 2024-09-19T07:08:57.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:57 smithi179 ceph-mon[35716]: fsmap 7 up:standby 2024-09-19T07:08:57.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:57 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T07:08:57.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:57 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/3586793070' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:08:57.525 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:57 smithi165 ceph-mon[35326]: Deploying daemon mds.h on smithi165 2024-09-19T07:08:57.525 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:57 smithi165 ceph-mon[35326]: mds.? [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] up:boot 2024-09-19T07:08:57.525 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:57 smithi165 ceph-mon[35326]: fsmap 7 up:standby 2024-09-19T07:08:57.525 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:57 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T07:08:57.525 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:57 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/3586793070' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:08:57.547 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:57 smithi148 ceph-mon[31180]: Deploying daemon mds.h on smithi165 2024-09-19T07:08:57.547 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:57 smithi148 ceph-mon[31180]: mds.? [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] up:boot 2024-09-19T07:08:57.547 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:57 smithi148 ceph-mon[31180]: fsmap 7 up:standby 2024-09-19T07:08:57.547 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:57 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T07:08:57.547 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:57 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/3586793070' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:08:58.134 INFO:journalctl@ceph.mds.h.smithi165.stdout:Sep 19 07:08:58 smithi165 systemd[1]: Starting Ceph mds.h for eae8a4a8-7654-11ef-bceb-c7b262605968... 2024-09-19T07:08:58.472 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:58 smithi165 ceph-mon[35326]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:08:58.473 INFO:journalctl@ceph.mds.h.smithi165.stdout:Sep 19 07:08:58 smithi165 podman[65269]: 2024-09-19 07:08:58.150669229 +0000 UTC m=+0.016285212 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:08:58.473 INFO:journalctl@ceph.mds.h.smithi165.stdout:Sep 19 07:08:58 smithi165 podman[65269]: 2024-09-19 07:08:58.262036468 +0000 UTC m=+0.127652442 container create 4a374e4fdd28f4c9a0cda75f00c51e190a630c8f3e82356a22c6e095065a3716 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-h, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=) 2024-09-19T07:08:58.473 INFO:journalctl@ceph.mds.h.smithi165.stdout:Sep 19 07:08:58 smithi165 podman[65269]: 2024-09-19 07:08:58.472596795 +0000 UTC m=+0.338212769 container init 4a374e4fdd28f4c9a0cda75f00c51e190a630c8f3e82356a22c6e095065a3716 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-h, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-19T07:08:58.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:58 smithi179 ceph-mon[35716]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:08:58.585 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:58 smithi148 ceph-mon[31180]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:08:58.884 INFO:journalctl@ceph.mds.h.smithi165.stdout:Sep 19 07:08:58 smithi165 podman[65269]: 2024-09-19 07:08:58.475585418 +0000 UTC m=+0.341201392 container start 4a374e4fdd28f4c9a0cda75f00c51e190a630c8f3e82356a22c6e095065a3716 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-h, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:08:58.884 INFO:journalctl@ceph.mds.h.smithi165.stdout:Sep 19 07:08:58 smithi165 ceph-mds[65288]: -- 172.21.15.165:0/1605635013 <== mon.2 v2:172.21.15.165:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e5dd08f860 con 0x55e5dd06c800 2024-09-19T07:08:58.884 INFO:journalctl@ceph.mds.h.smithi165.stdout:Sep 19 07:08:58 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-h[65284]: starting mds.h at 2024-09-19T07:08:58.884 INFO:journalctl@ceph.mds.h.smithi165.stdout:Sep 19 07:08:58 smithi165 bash[65269]: 4a374e4fdd28f4c9a0cda75f00c51e190a630c8f3e82356a22c6e095065a3716 2024-09-19T07:08:58.884 INFO:journalctl@ceph.mds.h.smithi165.stdout:Sep 19 07:08:58 smithi165 systemd[1]: Started Ceph mds.h for eae8a4a8-7654-11ef-bceb-c7b262605968. 2024-09-19T07:08:59.827 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:08:59.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:59 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:59.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:59 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:59.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:59 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:08:59.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:59 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:08:59.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:59 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:08:59.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:59 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:59.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:59 smithi165 ceph-mon[35326]: Deploying daemon mds.i on smithi179 2024-09-19T07:08:59.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:59 smithi165 ceph-mon[35326]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:08:59.885 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:59 smithi165 ceph-mon[35326]: mds.? [v2:172.21.15.165:6836/3847988837,v1:172.21.15.165:6837/3847988837] up:boot 2024-09-19T07:08:59.885 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:59 smithi165 ceph-mon[35326]: fsmap 8 up:standby 2024-09-19T07:08:59.885 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:08:59 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T07:09:00.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:59 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:00.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:59 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:00.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:59 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:00.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:59 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:09:00.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:59 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:09:00.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:59 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:09:00.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:59 smithi179 ceph-mon[35716]: Deploying daemon mds.i on smithi179 2024-09-19T07:09:00.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:59 smithi179 ceph-mon[35716]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:09:00.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:59 smithi179 ceph-mon[35716]: mds.? [v2:172.21.15.165:6836/3847988837,v1:172.21.15.165:6837/3847988837] up:boot 2024-09-19T07:09:00.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:59 smithi179 ceph-mon[35716]: fsmap 8 up:standby 2024-09-19T07:09:00.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:08:59 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T07:09:00.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:59 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:00.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:59 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:00.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:59 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:00.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:59 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:09:00.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:59 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:09:00.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:59 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:09:00.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:59 smithi148 ceph-mon[31180]: Deploying daemon mds.i on smithi179 2024-09-19T07:09:00.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:59 smithi148 ceph-mon[31180]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:09:00.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:59 smithi148 ceph-mon[31180]: mds.? [v2:172.21.15.165:6836/3847988837,v1:172.21.15.165:6837/3847988837] up:boot 2024-09-19T07:09:00.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:59 smithi148 ceph-mon[31180]: fsmap 8 up:standby 2024-09-19T07:09:00.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:08:59 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T07:09:00.089 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:09:00.584 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.565+0000 7f79fb8b4640 1 -- 172.21.15.148:0/1649442428 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79f4102790 msgr2=0x7f79f41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:00.584 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.565+0000 7f79fb8b4640 1 --2- 172.21.15.148:0/1649442428 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79f4102790 0x7f79f41067e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f79e4009900 tx=0x7f79e402a410 comp rx=0 tx=0).stop 2024-09-19T07:09:00.584 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.565+0000 7f79fb8b4640 1 -- 172.21.15.148:0/1649442428 shutdown_connections 2024-09-19T07:09:00.585 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.565+0000 7f79fb8b4640 1 --2- 172.21.15.148:0/1649442428 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79f4106f10 0x7f79f410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:00.585 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.565+0000 7f79fb8b4640 1 --2- 172.21.15.148:0/1649442428 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79f4102790 0x7f79f41067e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:00.585 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.565+0000 7f79fb8b4640 1 --2- 172.21.15.148:0/1649442428 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79f4101de0 0x7f79f41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:00.585 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.565+0000 7f79fb8b4640 1 -- 172.21.15.148:0/1649442428 >> 172.21.15.148:0/1649442428 conn(0x7f79f40fd8c0 msgr2=0x7f79f40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:00.585 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.565+0000 7f79fb8b4640 1 -- 172.21.15.148:0/1649442428 shutdown_connections 2024-09-19T07:09:00.585 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.565+0000 7f79fb8b4640 1 -- 172.21.15.148:0/1649442428 wait complete. 2024-09-19T07:09:00.585 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.566+0000 7f79fb8b4640 1 Processor -- start 2024-09-19T07:09:00.585 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.566+0000 7f79fb8b4640 1 -- start start 2024-09-19T07:09:00.585 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.566+0000 7f79fb8b4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79f4101de0 0x7f79f4198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:00.585 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.566+0000 7f79fb8b4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79f4102790 0x7f79f41988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:00.585 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.566+0000 7f79fb8b4640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79f4106f10 0x7f79f419cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:00.585 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.566+0000 7f79fb8b4640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f79f4111f70 con 0x7f79f4101de0 2024-09-19T07:09:00.585 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.566+0000 7f79fb8b4640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f79f4111df0 con 0x7f79f4106f10 2024-09-19T07:09:00.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.566+0000 7f79fb8b4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f79f41120f0 con 0x7f79f4102790 2024-09-19T07:09:00.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.566+0000 7f79f9650640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79f4101de0 0x7f79f4198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:00.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.566+0000 7f79f9650640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79f4101de0 0x7f79f4198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38714/0 (socket says 172.21.15.148:38714) 2024-09-19T07:09:00.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.566+0000 7f79f9650640 1 -- 172.21.15.148:0/1444447721 learned_addr learned my addr 172.21.15.148:0/1444447721 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:09:00.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.566+0000 7f79f8e4f640 1 --2- 172.21.15.148:0/1444447721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79f4102790 0x7f79f41988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:00.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.567+0000 7f79f9e51640 1 --2- 172.21.15.148:0/1444447721 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79f4106f10 0x7f79f419cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:00.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.567+0000 7f79f9650640 1 -- 172.21.15.148:0/1444447721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79f4102790 msgr2=0x7f79f41988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:00.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.567+0000 7f79f9650640 1 --2- 172.21.15.148:0/1444447721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79f4102790 0x7f79f41988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:00.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.567+0000 7f79f9650640 1 -- 172.21.15.148:0/1444447721 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79f4106f10 msgr2=0x7f79f419cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:00.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.567+0000 7f79f9650640 1 --2- 172.21.15.148:0/1444447721 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79f4106f10 0x7f79f419cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:00.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.567+0000 7f79f9650640 1 -- 172.21.15.148:0/1444447721 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79f419d310 con 0x7f79f4101de0 2024-09-19T07:09:00.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.567+0000 7f79f9650640 1 --2- 172.21.15.148:0/1444447721 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79f4101de0 0x7f79f4198360 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f79f000c920 tx=0x7f79f000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:00.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.567+0000 7f79ea7fc640 1 -- 172.21.15.148:0/1444447721 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f0007c70 con 0x7f79f4101de0 2024-09-19T07:09:00.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.567+0000 7f79fb8b4640 1 -- 172.21.15.148:0/1444447721 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79f419d600 con 0x7f79f4101de0 2024-09-19T07:09:00.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.567+0000 7f79ea7fc640 1 -- 172.21.15.148:0/1444447721 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79f0007e10 con 0x7f79f4101de0 2024-09-19T07:09:00.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.567+0000 7f79ea7fc640 1 -- 172.21.15.148:0/1444447721 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f0018890 con 0x7f79f4101de0 2024-09-19T07:09:00.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.567+0000 7f79fb8b4640 1 -- 172.21.15.148:0/1444447721 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79f41a4ee0 con 0x7f79f4101de0 2024-09-19T07:09:00.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.568+0000 7f79fb8b4640 1 -- 172.21.15.148:0/1444447721 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79f41021c0 con 0x7f79f4101de0 2024-09-19T07:09:00.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.569+0000 7f79ea7fc640 1 -- 172.21.15.148:0/1444447721 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f79f0018a70 con 0x7f79f4101de0 2024-09-19T07:09:00.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.570+0000 7f79ea7fc640 1 --2- 172.21.15.148:0/1444447721 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f79e00a3240 0x7f79e00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:00.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.570+0000 7f79ea7fc640 1 -- 172.21.15.148:0/1444447721 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f79f00cf510 con 0x7f79f4101de0 2024-09-19T07:09:00.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.570+0000 7f79f8e4f640 1 --2- 172.21.15.148:0/1444447721 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f79e00a3240 0x7f79e00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:00.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.570+0000 7f79f8e4f640 1 --2- 172.21.15.148:0/1444447721 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f79e00a3240 0x7f79e00a5700 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f79e4009230 tx=0x7f79e40058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:00.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.574+0000 7f79ea7fc640 1 -- 172.21.15.148:0/1444447721 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f79f0014030 con 0x7f79f4101de0 2024-09-19T07:09:00.743 INFO:journalctl@ceph.mds.i.smithi179.stdout:Sep 19 07:09:00 smithi179 systemd[1]: Starting Ceph mds.i for eae8a4a8-7654-11ef-bceb-c7b262605968... 2024-09-19T07:09:00.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.773+0000 7f79fb8b4640 1 -- 172.21.15.148:0/1444447721 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f79f410a150 con 0x7f79f4101de0 2024-09-19T07:09:00.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.773+0000 7f79ea7fc640 1 -- 172.21.15.148:0/1444447721 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7234 (secure 0 0 0) 0x7f79f009c6d0 con 0x7f79f4101de0 2024-09-19T07:09:00.774 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:09:00.775 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":9,"btime":"2024-09-19T07:08:59:143857+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24383,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2146820965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2146820965},{"type":"v1","addr":"172.21.15.165:6835","nonce":2146820965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24410,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24430,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1566489108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1566489108},{"type":"v1","addr":"172.21.15.179:6835","nonce":1566489108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24436,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-19T07:09:00.775 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 9 2024-09-19T07:09:00.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.776+0000 7f79fb8b4640 1 -- 172.21.15.148:0/1444447721 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f79e00a3240 msgr2=0x7f79e00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:00.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.776+0000 7f79fb8b4640 1 --2- 172.21.15.148:0/1444447721 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f79e00a3240 0x7f79e00a5700 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f79e4009230 tx=0x7f79e40058d0 comp rx=0 tx=0).stop 2024-09-19T07:09:00.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.776+0000 7f79fb8b4640 1 -- 172.21.15.148:0/1444447721 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79f4101de0 msgr2=0x7f79f4198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:00.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.776+0000 7f79fb8b4640 1 --2- 172.21.15.148:0/1444447721 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79f4101de0 0x7f79f4198360 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f79f000c920 tx=0x7f79f000cde0 comp rx=0 tx=0).stop 2024-09-19T07:09:00.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.776+0000 7f79fb8b4640 1 -- 172.21.15.148:0/1444447721 shutdown_connections 2024-09-19T07:09:00.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.776+0000 7f79fb8b4640 1 --2- 172.21.15.148:0/1444447721 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f79e00a3240 0x7f79e00a5700 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:00.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.776+0000 7f79fb8b4640 1 --2- 172.21.15.148:0/1444447721 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79f4106f10 0x7f79f419cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:00.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.776+0000 7f79fb8b4640 1 --2- 172.21.15.148:0/1444447721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79f4102790 0x7f79f41988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:00.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.776+0000 7f79fb8b4640 1 --2- 172.21.15.148:0/1444447721 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79f4101de0 0x7f79f4198360 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:00.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.776+0000 7f79fb8b4640 1 -- 172.21.15.148:0/1444447721 >> 172.21.15.148:0/1444447721 conn(0x7f79f40fd8c0 msgr2=0x7f79f40fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:00.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.776+0000 7f79fb8b4640 1 -- 172.21.15.148:0/1444447721 shutdown_connections 2024-09-19T07:09:00.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:00.776+0000 7f79fb8b4640 1 -- 172.21.15.148:0/1444447721 wait complete. 2024-09-19T07:09:01.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:00 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/1444447721' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:09:01.023 INFO:journalctl@ceph.mds.i.smithi179.stdout:Sep 19 07:09:00 smithi179 podman[66267]: 2024-09-19 07:09:00.645893695 +0000 UTC m=+0.016099934 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:09:01.023 INFO:journalctl@ceph.mds.i.smithi179.stdout:Sep 19 07:09:00 smithi179 podman[66267]: 2024-09-19 07:09:00.763229956 +0000 UTC m=+0.133436247 container create 9b255789fa9189021ec25f837e79f7ca77400f1f6df4a16f5ee9f40a0f981dec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-i, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-19T07:09:01.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:00 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/1444447721' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:09:01.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:00 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/1444447721' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:09:01.522 INFO:journalctl@ceph.mds.i.smithi179.stdout:Sep 19 07:09:01 smithi179 podman[66267]: 2024-09-19 07:09:01.03274539 +0000 UTC m=+0.402951618 container init 9b255789fa9189021ec25f837e79f7ca77400f1f6df4a16f5ee9f40a0f981dec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-i, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-19T07:09:01.523 INFO:journalctl@ceph.mds.i.smithi179.stdout:Sep 19 07:09:01 smithi179 podman[66267]: 2024-09-19 07:09:01.035651348 +0000 UTC m=+0.405857577 container start 9b255789fa9189021ec25f837e79f7ca77400f1f6df4a16f5ee9f40a0f981dec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-i, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-19T07:09:01.523 INFO:journalctl@ceph.mds.i.smithi179.stdout:Sep 19 07:09:01 smithi179 ceph-mds[66286]: -- 172.21.15.179:0/2838260350 <== mon.1 v2:172.21.15.179:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f451393860 con 0x55f451370800 2024-09-19T07:09:01.523 INFO:journalctl@ceph.mds.i.smithi179.stdout:Sep 19 07:09:01 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-i[66282]: starting mds.i at 2024-09-19T07:09:01.523 INFO:journalctl@ceph.mds.i.smithi179.stdout:Sep 19 07:09:01 smithi179 bash[66267]: 9b255789fa9189021ec25f837e79f7ca77400f1f6df4a16f5ee9f40a0f981dec 2024-09-19T07:09:01.523 INFO:journalctl@ceph.mds.i.smithi179.stdout:Sep 19 07:09:01 smithi179 systemd[1]: Started Ceph mds.i for eae8a4a8-7654-11ef-bceb-c7b262605968. 2024-09-19T07:09:01.874 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:01 smithi148 ceph-mon[31180]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:09:01.875 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:01 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:01.875 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:01 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:01.875 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:01 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:01.875 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:01 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:09:01.875 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:01 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:09:01.875 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:01 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:09:02.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:01 smithi165 ceph-mon[35326]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:09:02.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:01 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:02.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:01 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:02.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:01 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:02.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:01 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:09:02.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:01 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:09:02.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:01 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:09:02.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:01 smithi179 ceph-mon[35716]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:09:02.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:01 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:02.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:01 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:02.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:01 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:02.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:01 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:09:02.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:01 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:09:02.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:01 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:09:03.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:02 smithi148 ceph-mon[31180]: Deploying daemon mds.g on smithi148 2024-09-19T07:09:03.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:02 smithi148 ceph-mon[31180]: mds.? [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] up:boot 2024-09-19T07:09:03.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:02 smithi148 ceph-mon[31180]: fsmap 9 up:standby 2024-09-19T07:09:03.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:02 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T07:09:03.084 INFO:journalctl@ceph.mds.g.smithi148.stdout:Sep 19 07:09:03 smithi148 systemd[1]: Starting Ceph mds.g for eae8a4a8-7654-11ef-bceb-c7b262605968... 2024-09-19T07:09:03.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:02 smithi165 ceph-mon[35326]: Deploying daemon mds.g on smithi148 2024-09-19T07:09:03.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:02 smithi165 ceph-mon[35326]: mds.? [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] up:boot 2024-09-19T07:09:03.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:02 smithi165 ceph-mon[35326]: fsmap 9 up:standby 2024-09-19T07:09:03.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:02 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T07:09:03.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:02 smithi179 ceph-mon[35716]: Deploying daemon mds.g on smithi148 2024-09-19T07:09:03.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:02 smithi179 ceph-mon[35716]: mds.? [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] up:boot 2024-09-19T07:09:03.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:02 smithi179 ceph-mon[35716]: fsmap 9 up:standby 2024-09-19T07:09:03.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:02 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T07:09:03.446 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:09:03.484 INFO:journalctl@ceph.mds.g.smithi148.stdout:Sep 19 07:09:03 smithi148 podman[68739]: 2024-09-19 07:09:03.132383979 +0000 UTC m=+0.016231726 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:09:03.484 INFO:journalctl@ceph.mds.g.smithi148.stdout:Sep 19 07:09:03 smithi148 podman[68739]: 2024-09-19 07:09:03.246831126 +0000 UTC m=+0.130678861 container create 0244447b28e5a87c69c7bf3db9cd9368180e54ad46be48c2e3beae6d2bbd2e23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-g, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-19T07:09:03.484 INFO:journalctl@ceph.mds.g.smithi148.stdout:Sep 19 07:09:03 smithi148 podman[68739]: 2024-09-19 07:09:03.457345702 +0000 UTC m=+0.341193460 container init 0244447b28e5a87c69c7bf3db9cd9368180e54ad46be48c2e3beae6d2bbd2e23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-g, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-19T07:09:03.484 INFO:journalctl@ceph.mds.g.smithi148.stdout:Sep 19 07:09:03 smithi148 podman[68739]: 2024-09-19 07:09:03.460037697 +0000 UTC m=+0.343885440 container start 0244447b28e5a87c69c7bf3db9cd9368180e54ad46be48c2e3beae6d2bbd2e23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-g, ceph=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-19T07:09:03.720 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:09:03.833 INFO:journalctl@ceph.mds.g.smithi148.stdout:Sep 19 07:09:03 smithi148 ceph-mds[68772]: -- 172.21.15.148:0/2246843045 <== mon.0 v2:172.21.15.148:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d317f27860 con 0x55d317f05400 2024-09-19T07:09:03.833 INFO:journalctl@ceph.mds.g.smithi148.stdout:Sep 19 07:09:03 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-g[68754]: starting mds.g at 2024-09-19T07:09:03.833 INFO:journalctl@ceph.mds.g.smithi148.stdout:Sep 19 07:09:03 smithi148 bash[68739]: 0244447b28e5a87c69c7bf3db9cd9368180e54ad46be48c2e3beae6d2bbd2e23 2024-09-19T07:09:03.833 INFO:journalctl@ceph.mds.g.smithi148.stdout:Sep 19 07:09:03 smithi148 systemd[1]: Started Ceph mds.g for eae8a4a8-7654-11ef-bceb-c7b262605968. 2024-09-19T07:09:04.094 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:03 smithi148 ceph-mon[31180]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:09:04.094 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:03 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:04.094 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:03 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:04.094 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:03 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:04.094 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:03 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:09:04.094 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:03 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:09:04.095 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:03 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:09:04.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:03 smithi165 ceph-mon[35326]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:09:04.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:03 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:04.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:03 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:04.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:03 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:04.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:03 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:09:04.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:03 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:09:04.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:03 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:09:04.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.174+0000 7fdbfeb34640 1 -- 172.21.15.148:0/1252704212 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbf8102790 msgr2=0x7fdbf81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:04.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.174+0000 7fdbfeb34640 1 --2- 172.21.15.148:0/1252704212 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbf8102790 0x7fdbf81067e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdbe4009900 tx=0x7fdbe402a410 comp rx=0 tx=0).stop 2024-09-19T07:09:04.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.174+0000 7fdbfeb34640 1 -- 172.21.15.148:0/1252704212 shutdown_connections 2024-09-19T07:09:04.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.174+0000 7fdbfeb34640 1 --2- 172.21.15.148:0/1252704212 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdbf8106f10 0x7fdbf810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:04.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.174+0000 7fdbfeb34640 1 --2- 172.21.15.148:0/1252704212 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbf8102790 0x7fdbf81067e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:04.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.174+0000 7fdbfeb34640 1 --2- 172.21.15.148:0/1252704212 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbf8101de0 0x7fdbf81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:04.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.174+0000 7fdbfeb34640 1 -- 172.21.15.148:0/1252704212 >> 172.21.15.148:0/1252704212 conn(0x7fdbf80fd8c0 msgr2=0x7fdbf80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:04.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.174+0000 7fdbfeb34640 1 -- 172.21.15.148:0/1252704212 shutdown_connections 2024-09-19T07:09:04.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.174+0000 7fdbfeb34640 1 -- 172.21.15.148:0/1252704212 wait complete. 2024-09-19T07:09:04.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.175+0000 7fdbfeb34640 1 Processor -- start 2024-09-19T07:09:04.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.175+0000 7fdbfeb34640 1 -- start start 2024-09-19T07:09:04.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.175+0000 7fdbfeb34640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbf8101de0 0x7fdbf8198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:04.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.175+0000 7fdbfeb34640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbf8102790 0x7fdbf8198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:04.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.175+0000 7fdbfeb34640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdbf8106f10 0x7fdbf819cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:04.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.175+0000 7fdbfeb34640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf8111f70 con 0x7fdbf8101de0 2024-09-19T07:09:04.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.175+0000 7fdbfeb34640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf8111df0 con 0x7fdbf8106f10 2024-09-19T07:09:04.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.175+0000 7fdbfeb34640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf81120f0 con 0x7fdbf8102790 2024-09-19T07:09:04.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.175+0000 7fdbfc8d0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbf8101de0 0x7fdbf8198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:04.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.175+0000 7fdbfc8d0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbf8101de0 0x7fdbf8198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45624/0 (socket says 172.21.15.148:45624) 2024-09-19T07:09:04.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.175+0000 7fdbfc8d0640 1 -- 172.21.15.148:0/2506718985 learned_addr learned my addr 172.21.15.148:0/2506718985 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:09:04.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.175+0000 7fdbfd0d1640 1 --2- 172.21.15.148:0/2506718985 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdbf8106f10 0x7fdbf819cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:04.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.175+0000 7fdbf7fff640 1 --2- 172.21.15.148:0/2506718985 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbf8102790 0x7fdbf8198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:04.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.175+0000 7fdbfc8d0640 1 -- 172.21.15.148:0/2506718985 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbf8102790 msgr2=0x7fdbf8198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:04.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.175+0000 7fdbfc8d0640 1 --2- 172.21.15.148:0/2506718985 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbf8102790 0x7fdbf8198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:04.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.175+0000 7fdbfc8d0640 1 -- 172.21.15.148:0/2506718985 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdbf8106f10 msgr2=0x7fdbf819cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:04.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.175+0000 7fdbfc8d0640 1 --2- 172.21.15.148:0/2506718985 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdbf8106f10 0x7fdbf819cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:04.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.175+0000 7fdbfc8d0640 1 -- 172.21.15.148:0/2506718985 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbf819d3e0 con 0x7fdbf8101de0 2024-09-19T07:09:04.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.176+0000 7fdbfc8d0640 1 --2- 172.21.15.148:0/2506718985 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbf8101de0 0x7fdbf8198430 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdbec00d770 tx=0x7fdbec00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:04.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.176+0000 7fdbf5ffb640 1 -- 172.21.15.148:0/2506718985 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbec017070 con 0x7fdbf8101de0 2024-09-19T07:09:04.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.176+0000 7fdbf5ffb640 1 -- 172.21.15.148:0/2506718985 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbec005500 con 0x7fdbf8101de0 2024-09-19T07:09:04.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.176+0000 7fdbf5ffb640 1 -- 172.21.15.148:0/2506718985 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbec004e00 con 0x7fdbf8101de0 2024-09-19T07:09:04.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.176+0000 7fdbfeb34640 1 -- 172.21.15.148:0/2506718985 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbf819d6d0 con 0x7fdbf8101de0 2024-09-19T07:09:04.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.176+0000 7fdbfeb34640 1 -- 172.21.15.148:0/2506718985 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbf81a4fb0 con 0x7fdbf8101de0 2024-09-19T07:09:04.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.177+0000 7fdbfeb34640 1 -- 172.21.15.148:0/2506718985 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbf81021c0 con 0x7fdbf8101de0 2024-09-19T07:09:04.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.178+0000 7fdbf5ffb640 1 -- 172.21.15.148:0/2506718985 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fdbec004fa0 con 0x7fdbf8101de0 2024-09-19T07:09:04.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.179+0000 7fdbf5ffb640 1 --2- 172.21.15.148:0/2506718985 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fdbe80a32c0 0x7fdbe80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:04.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.179+0000 7fdbf7fff640 1 --2- 172.21.15.148:0/2506718985 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fdbe80a32c0 0x7fdbe80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:04.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.179+0000 7fdbf5ffb640 1 -- 172.21.15.148:0/2506718985 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fdbec0cee80 con 0x7fdbf8101de0 2024-09-19T07:09:04.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.179+0000 7fdbf7fff640 1 --2- 172.21.15.148:0/2506718985 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fdbe80a32c0 0x7fdbe80a5780 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdbe40096c0 tx=0x7fdbe4000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:04.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.183+0000 7fdbf5ffb640 1 -- 172.21.15.148:0/2506718985 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdbec09c040 con 0x7fdbf8101de0 2024-09-19T07:09:04.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:03 smithi179 ceph-mon[35716]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:09:04.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:03 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:04.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:03 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:04.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:03 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:04.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:03 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:09:04.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:03 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:09:04.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:03 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:09:04.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.395+0000 7fdbfeb34640 1 -- 172.21.15.148:0/2506718985 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdbf802d7c0 con 0x7fdbf8101de0 2024-09-19T07:09:04.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.396+0000 7fdbf5ffb640 1 -- 172.21.15.148:0/2506718985 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8893 (secure 0 0 0) 0x7fdbec09b940 con 0x7fdbf8101de0 2024-09-19T07:09:04.397 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:09:04.397 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":11,"btime":"2024-09-19T07:09:03:832640+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24383,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2146820965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2146820965},{"type":"v1","addr":"172.21.15.165:6835","nonce":2146820965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24410,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24430,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1566489108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1566489108},{"type":"v1","addr":"172.21.15.179:6835","nonce":1566489108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24436,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24457,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T07:09:04.398 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 11 2024-09-19T07:09:04.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.398+0000 7fdbfeb34640 1 -- 172.21.15.148:0/2506718985 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fdbe80a32c0 msgr2=0x7fdbe80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:04.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.399+0000 7fdbfeb34640 1 --2- 172.21.15.148:0/2506718985 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fdbe80a32c0 0x7fdbe80a5780 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdbe40096c0 tx=0x7fdbe4000bc0 comp rx=0 tx=0).stop 2024-09-19T07:09:04.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.399+0000 7fdbfeb34640 1 -- 172.21.15.148:0/2506718985 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbf8101de0 msgr2=0x7fdbf8198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:04.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.399+0000 7fdbfeb34640 1 --2- 172.21.15.148:0/2506718985 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbf8101de0 0x7fdbf8198430 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdbec00d770 tx=0x7fdbec00dc30 comp rx=0 tx=0).stop 2024-09-19T07:09:04.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.399+0000 7fdbfeb34640 1 -- 172.21.15.148:0/2506718985 shutdown_connections 2024-09-19T07:09:04.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.399+0000 7fdbfeb34640 1 --2- 172.21.15.148:0/2506718985 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fdbe80a32c0 0x7fdbe80a5780 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:04.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.399+0000 7fdbfeb34640 1 --2- 172.21.15.148:0/2506718985 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdbf8106f10 0x7fdbf819cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:04.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.399+0000 7fdbfeb34640 1 --2- 172.21.15.148:0/2506718985 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbf8102790 0x7fdbf8198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:04.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.399+0000 7fdbfeb34640 1 --2- 172.21.15.148:0/2506718985 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbf8101de0 0x7fdbf8198430 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:04.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.399+0000 7fdbfeb34640 1 -- 172.21.15.148:0/2506718985 >> 172.21.15.148:0/2506718985 conn(0x7fdbf80fd8c0 msgr2=0x7fdbf80fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:04.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.399+0000 7fdbfeb34640 1 -- 172.21.15.148:0/2506718985 shutdown_connections 2024-09-19T07:09:04.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:04.399+0000 7fdbfeb34640 1 -- 172.21.15.148:0/2506718985 wait complete. 2024-09-19T07:09:05.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:04 smithi165 ceph-mon[35326]: Deploying daemon mds.a on smithi148 2024-09-19T07:09:05.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:04 smithi165 ceph-mon[35326]: mds.? [v2:172.21.15.148:6838/2974467793,v1:172.21.15.148:6839/2974467793] up:boot 2024-09-19T07:09:05.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:04 smithi165 ceph-mon[35326]: fsmap 10 up:standby 2024-09-19T07:09:05.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:04 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T07:09:05.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:04 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/2506718985' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:09:05.184 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:04 smithi148 ceph-mon[31180]: Deploying daemon mds.a on smithi148 2024-09-19T07:09:05.184 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:04 smithi148 ceph-mon[31180]: mds.? [v2:172.21.15.148:6838/2974467793,v1:172.21.15.148:6839/2974467793] up:boot 2024-09-19T07:09:05.184 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:04 smithi148 ceph-mon[31180]: fsmap 10 up:standby 2024-09-19T07:09:05.184 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:04 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T07:09:05.184 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:04 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/2506718985' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:09:05.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:04 smithi179 ceph-mon[35716]: Deploying daemon mds.a on smithi148 2024-09-19T07:09:05.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:04 smithi179 ceph-mon[35716]: mds.? [v2:172.21.15.148:6838/2974467793,v1:172.21.15.148:6839/2974467793] up:boot 2024-09-19T07:09:05.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:04 smithi179 ceph-mon[35716]: fsmap 10 up:standby 2024-09-19T07:09:05.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:04 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T07:09:05.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:04 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/2506718985' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:09:06.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:05 smithi165 ceph-mon[35326]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:09:06.163 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:05 smithi148 ceph-mon[31180]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:09:06.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:05 smithi179 ceph-mon[35716]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:09:06.834 INFO:journalctl@ceph.mds.a.smithi148.stdout:Sep 19 07:09:06 smithi148 systemd[1]: Starting Ceph mds.a for eae8a4a8-7654-11ef-bceb-c7b262605968... 2024-09-19T07:09:07.120 INFO:journalctl@ceph.mds.a.smithi148.stdout:Sep 19 07:09:06 smithi148 podman[69153]: 2024-09-19 07:09:06.770629845 +0000 UTC m=+0.016319201 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:09:07.120 INFO:journalctl@ceph.mds.a.smithi148.stdout:Sep 19 07:09:06 smithi148 podman[69153]: 2024-09-19 07:09:06.890139233 +0000 UTC m=+0.135828575 container create 7fa2e17b51b11d0002b4e4dc2eec0dfd0eabdafbcd838af8fcaf6604afbffb46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-a, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True) 2024-09-19T07:09:07.120 INFO:journalctl@ceph.mds.a.smithi148.stdout:Sep 19 07:09:07 smithi148 podman[69153]: 2024-09-19 07:09:07.117146995 +0000 UTC m=+0.362836347 container init 7fa2e17b51b11d0002b4e4dc2eec0dfd0eabdafbcd838af8fcaf6604afbffb46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-19T07:09:07.120 INFO:journalctl@ceph.mds.a.smithi148.stdout:Sep 19 07:09:07 smithi148 podman[69153]: 2024-09-19 07:09:07.12008101 +0000 UTC m=+0.365770357 container start 7fa2e17b51b11d0002b4e4dc2eec0dfd0eabdafbcd838af8fcaf6604afbffb46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-a, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, ceph=True) 2024-09-19T07:09:07.215 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:09:07.473 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:09:07.583 INFO:journalctl@ceph.mds.a.smithi148.stdout:Sep 19 07:09:07 smithi148 ceph-mds[69172]: -- 172.21.15.148:0/2928350520 <== mon.0 v2:172.21.15.148:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55822aceb860 con 0x55822acc9400 2024-09-19T07:09:07.583 INFO:journalctl@ceph.mds.a.smithi148.stdout:Sep 19 07:09:07 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-a[69168]: starting mds.a at 2024-09-19T07:09:07.583 INFO:journalctl@ceph.mds.a.smithi148.stdout:Sep 19 07:09:07 smithi148 bash[69153]: 7fa2e17b51b11d0002b4e4dc2eec0dfd0eabdafbcd838af8fcaf6604afbffb46 2024-09-19T07:09:07.583 INFO:journalctl@ceph.mds.a.smithi148.stdout:Sep 19 07:09:07 smithi148 systemd[1]: Started Ceph mds.a for eae8a4a8-7654-11ef-bceb-c7b262605968. 2024-09-19T07:09:07.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:07.900+0000 7f8dd83fa640 1 -- 172.21.15.148:0/3019600579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8dd0106f10 msgr2=0x7f8dd010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:07.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:07.900+0000 7f8dd83fa640 1 --2- 172.21.15.148:0/3019600579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8dd0106f10 0x7f8dd010ea90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8dc8009ca0 tx=0x7f8dc802a8c0 comp rx=0 tx=0).stop 2024-09-19T07:09:07.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:07.900+0000 7f8dd83fa640 1 -- 172.21.15.148:0/3019600579 shutdown_connections 2024-09-19T07:09:07.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:07.900+0000 7f8dd83fa640 1 --2- 172.21.15.148:0/3019600579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8dd0106f10 0x7f8dd010ea90 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:07.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:07.900+0000 7f8dd83fa640 1 --2- 172.21.15.148:0/3019600579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8dd0102790 0x7f8dd01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:07.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:07.900+0000 7f8dd83fa640 1 --2- 172.21.15.148:0/3019600579 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8dd0101de0 0x7f8dd01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:07.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:07.900+0000 7f8dd83fa640 1 -- 172.21.15.148:0/3019600579 >> 172.21.15.148:0/3019600579 conn(0x7f8dd00fd8c0 msgr2=0x7f8dd00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:07.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:07.900+0000 7f8dd83fa640 1 -- 172.21.15.148:0/3019600579 shutdown_connections 2024-09-19T07:09:07.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:07.900+0000 7f8dd83fa640 1 -- 172.21.15.148:0/3019600579 wait complete. 2024-09-19T07:09:07.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:07.900+0000 7f8dd83fa640 1 Processor -- start 2024-09-19T07:09:07.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:07.900+0000 7f8dd83fa640 1 -- start start 2024-09-19T07:09:07.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:07.901+0000 7f8dd83fa640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8dd0101de0 0x7f8dd01a46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:07.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:07.901+0000 7f8dd83fa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8dd0102790 0x7f8dd01a4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:07.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:07.901+0000 7f8dd83fa640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8dd0106f10 0x7f8dd010dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:07.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:07.901+0000 7f8dd83fa640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8dd0111f70 con 0x7f8dd0106f10 2024-09-19T07:09:07.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:07.901+0000 7f8dd83fa640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8dd0111df0 con 0x7f8dd0101de0 2024-09-19T07:09:07.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:07.901+0000 7f8dd83fa640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8dd01120f0 con 0x7f8dd0102790 2024-09-19T07:09:07.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:07.901+0000 7f8dd6997640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8dd0106f10 0x7f8dd010dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:07.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:07.901+0000 7f8dd6997640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8dd0106f10 0x7f8dd010dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45664/0 (socket says 172.21.15.148:45664) 2024-09-19T07:09:07.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:07.901+0000 7f8dd6997640 1 -- 172.21.15.148:0/3998554321 learned_addr learned my addr 172.21.15.148:0/3998554321 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:09:07.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:07.901+0000 7f8dd6196640 1 --2- 172.21.15.148:0/3998554321 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8dd0101de0 0x7f8dd01a46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:07.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:07.901+0000 7f8dd5995640 1 --2- 172.21.15.148:0/3998554321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8dd0102790 0x7f8dd01a4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:07.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:07.901+0000 7f8dd6997640 1 -- 172.21.15.148:0/3998554321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8dd0102790 msgr2=0x7f8dd01a4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:07.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:07.901+0000 7f8dd6997640 1 --2- 172.21.15.148:0/3998554321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8dd0102790 0x7f8dd01a4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:07.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:07.901+0000 7f8dd6997640 1 -- 172.21.15.148:0/3998554321 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8dd0101de0 msgr2=0x7f8dd01a46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:07.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:07.901+0000 7f8dd6997640 1 --2- 172.21.15.148:0/3998554321 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8dd0101de0 0x7f8dd01a46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:07.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:07.901+0000 7f8dd6997640 1 -- 172.21.15.148:0/3998554321 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dd010e3c0 con 0x7f8dd0106f10 2024-09-19T07:09:07.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:07.901+0000 7f8dd6196640 1 --2- 172.21.15.148:0/3998554321 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8dd0101de0 0x7f8dd01a46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:09:07.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:07.901+0000 7f8dd6997640 1 --2- 172.21.15.148:0/3998554321 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8dd0106f10 0x7f8dd010dc20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8dc8031a20 tx=0x7f8dc8031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:07.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:07.901+0000 7f8dc77fe640 1 -- 172.21.15.148:0/3998554321 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc8003c30 con 0x7f8dd0106f10 2024-09-19T07:09:07.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:07.901+0000 7f8dc77fe640 1 -- 172.21.15.148:0/3998554321 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8dc8003dd0 con 0x7f8dd0106f10 2024-09-19T07:09:07.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:07.901+0000 7f8dd83fa640 1 -- 172.21.15.148:0/3998554321 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dd010e650 con 0x7f8dd0106f10 2024-09-19T07:09:07.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:07.902+0000 7f8dc77fe640 1 -- 172.21.15.148:0/3998554321 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc802fc40 con 0x7f8dd0106f10 2024-09-19T07:09:07.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:07.902+0000 7f8dd83fa640 1 -- 172.21.15.148:0/3998554321 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dd01ab520 con 0x7f8dd0106f10 2024-09-19T07:09:07.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:07.903+0000 7f8dd83fa640 1 -- 172.21.15.148:0/3998554321 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dd01032c0 con 0x7f8dd0106f10 2024-09-19T07:09:07.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:07.905+0000 7f8dc77fe640 1 -- 172.21.15.148:0/3998554321 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f8dc8004050 con 0x7f8dd0106f10 2024-09-19T07:09:07.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:07.905+0000 7f8dc77fe640 1 --2- 172.21.15.148:0/3998554321 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f8dbc0a32c0 0x7f8dbc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:07.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:07.905+0000 7f8dd6196640 1 --2- 172.21.15.148:0/3998554321 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f8dbc0a32c0 0x7f8dbc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:07.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:07.905+0000 7f8dc77fe640 1 -- 172.21.15.148:0/3998554321 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f8dc80f0730 con 0x7f8dd0106f10 2024-09-19T07:09:07.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:07.906+0000 7f8dd6196640 1 --2- 172.21.15.148:0/3998554321 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f8dbc0a32c0 0x7f8dbc0a5780 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc009fc0 tx=0x7f8dcc005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:07.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:07.908+0000 7f8dc77fe640 1 -- 172.21.15.148:0/3998554321 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8dc80bd980 con 0x7f8dd0106f10 2024-09-19T07:09:08.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:08.109+0000 7f8dd83fa640 1 -- 172.21.15.148:0/3998554321 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8dd01ab7c0 con 0x7f8dd0106f10 2024-09-19T07:09:08.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:08.110+0000 7f8dc77fe640 1 -- 172.21.15.148:0/3998554321 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8893 (secure 0 0 0) 0x7f8dc80bd280 con 0x7f8dd0106f10 2024-09-19T07:09:08.111 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:09:08.111 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":11,"btime":"2024-09-19T07:09:03:832640+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24383,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2146820965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2146820965},{"type":"v1","addr":"172.21.15.165:6835","nonce":2146820965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24410,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24430,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1566489108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1566489108},{"type":"v1","addr":"172.21.15.179:6835","nonce":1566489108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24436,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24457,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T07:09:08.112 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 11 2024-09-19T07:09:08.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:08.112+0000 7f8dd83fa640 1 -- 172.21.15.148:0/3998554321 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f8dbc0a32c0 msgr2=0x7f8dbc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:08.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:08.112+0000 7f8dd83fa640 1 --2- 172.21.15.148:0/3998554321 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f8dbc0a32c0 0x7f8dbc0a5780 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc009fc0 tx=0x7f8dcc005f90 comp rx=0 tx=0).stop 2024-09-19T07:09:08.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:08.112+0000 7f8dd83fa640 1 -- 172.21.15.148:0/3998554321 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8dd0106f10 msgr2=0x7f8dd010dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:08.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:08.112+0000 7f8dd83fa640 1 --2- 172.21.15.148:0/3998554321 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8dd0106f10 0x7f8dd010dc20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8dc8031a20 tx=0x7f8dc8031a50 comp rx=0 tx=0).stop 2024-09-19T07:09:08.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:08.112+0000 7f8dd83fa640 1 -- 172.21.15.148:0/3998554321 shutdown_connections 2024-09-19T07:09:08.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:08.112+0000 7f8dd83fa640 1 --2- 172.21.15.148:0/3998554321 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f8dbc0a32c0 0x7f8dbc0a5780 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:08.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:08.112+0000 7f8dd83fa640 1 --2- 172.21.15.148:0/3998554321 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8dd0106f10 0x7f8dd010dc20 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:08.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:08.112+0000 7f8dd83fa640 1 --2- 172.21.15.148:0/3998554321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8dd0102790 0x7f8dd01a4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:08.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:08.112+0000 7f8dd83fa640 1 --2- 172.21.15.148:0/3998554321 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8dd0101de0 0x7f8dd01a46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:08.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:08.112+0000 7f8dd83fa640 1 -- 172.21.15.148:0/3998554321 >> 172.21.15.148:0/3998554321 conn(0x7f8dd00fd8c0 msgr2=0x7f8dd00ffc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:08.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:08.112+0000 7f8dd83fa640 1 -- 172.21.15.148:0/3998554321 shutdown_connections 2024-09-19T07:09:08.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:08.112+0000 7f8dd83fa640 1 -- 172.21.15.148:0/3998554321 wait complete. 2024-09-19T07:09:08.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:08 smithi148 ceph-mon[31180]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:09:08.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:08 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:08.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:08 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:08.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:08 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:08.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:08 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:09:08.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:08 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:09:08.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:08 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:09:08.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:08 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/3998554321' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:09:08.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:08 smithi165 ceph-mon[35326]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:09:08.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:08 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:08.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:08 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:08.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:08 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:08.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:08 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:09:08.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:08 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:09:08.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:08 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:09:08.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:08 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/3998554321' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:09:08.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:08 smithi179 ceph-mon[35716]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:09:08.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:08 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:08.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:08 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:08.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:08 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:08.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:08 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:09:08.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:08 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:09:08.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:08 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:09:08.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:08 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/3998554321' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:09:09.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:09 smithi165 ceph-mon[35326]: Deploying daemon mds.b on smithi165 2024-09-19T07:09:09.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:09 smithi165 ceph-mon[35326]: mds.? [v2:172.21.15.148:6840/4263868576,v1:172.21.15.148:6841/4263868576] up:boot 2024-09-19T07:09:09.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:09 smithi165 ceph-mon[35326]: fsmap 11 up:standby 2024-09-19T07:09:09.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:09 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T07:09:09.385 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:09:09 smithi165 systemd[1]: Starting Ceph mds.b for eae8a4a8-7654-11ef-bceb-c7b262605968... 2024-09-19T07:09:09.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:09 smithi179 ceph-mon[35716]: Deploying daemon mds.b on smithi165 2024-09-19T07:09:09.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:09 smithi179 ceph-mon[35716]: mds.? [v2:172.21.15.148:6840/4263868576,v1:172.21.15.148:6841/4263868576] up:boot 2024-09-19T07:09:09.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:09 smithi179 ceph-mon[35716]: fsmap 11 up:standby 2024-09-19T07:09:09.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:09 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T07:09:09.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:09 smithi148 ceph-mon[31180]: Deploying daemon mds.b on smithi165 2024-09-19T07:09:09.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:09 smithi148 ceph-mon[31180]: mds.? [v2:172.21.15.148:6840/4263868576,v1:172.21.15.148:6841/4263868576] up:boot 2024-09-19T07:09:09.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:09 smithi148 ceph-mon[31180]: fsmap 11 up:standby 2024-09-19T07:09:09.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:09 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T07:09:09.717 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:09:09 smithi165 podman[65569]: 2024-09-19 07:09:09.367746745 +0000 UTC m=+0.016090400 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:09:09.718 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:09:09 smithi165 podman[65569]: 2024-09-19 07:09:09.488521238 +0000 UTC m=+0.136864887 container create db467f6599bcc454824df7f3738beb6dc258a0d8d74fd301d12c88f9685c850c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=) 2024-09-19T07:09:09.718 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:09:09 smithi165 podman[65569]: 2024-09-19 07:09:09.690955491 +0000 UTC m=+0.339299141 container init db467f6599bcc454824df7f3738beb6dc258a0d8d74fd301d12c88f9685c850c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=) 2024-09-19T07:09:09.718 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:09:09 smithi165 podman[65569]: 2024-09-19 07:09:09.693790386 +0000 UTC m=+0.342134037 container start db467f6599bcc454824df7f3738beb6dc258a0d8d74fd301d12c88f9685c850c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-19T07:09:09.718 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:09:09 smithi165 ceph-mds[65589]: -- 172.21.15.165:0/3537301191 <== mon.2 v2:172.21.15.165:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561fafe69860 con 0x561fafe47000 2024-09-19T07:09:10.134 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:09:09 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: starting mds.b at 2024-09-19T07:09:10.134 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:09:09 smithi165 bash[65569]: db467f6599bcc454824df7f3738beb6dc258a0d8d74fd301d12c88f9685c850c 2024-09-19T07:09:10.134 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:09:09 smithi165 systemd[1]: Started Ceph mds.b for eae8a4a8-7654-11ef-bceb-c7b262605968. 2024-09-19T07:09:10.416 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:10 smithi148 ceph-mon[31180]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:09:10.417 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:10 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:10.417 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:10 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:10.417 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:10 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:10.417 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:10 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:10.417 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:10 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:10.417 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:10 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:09:10.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:10 smithi179 ceph-mon[35716]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:09:10.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:10 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:10.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:10 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:10.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:10 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:10.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:10 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:10.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:10 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:10.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:10 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:09:10.571 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:10 smithi165 ceph-mon[35326]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:09:10.572 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:10 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:10.572 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:10 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:10.572 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:10 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:10.572 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:10 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:10.572 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:10 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:10.573 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:10 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:09:10.787 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:09:11.125 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:09:11.409 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:11 smithi148 ceph-mon[31180]: mds.? [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] up:boot 2024-09-19T07:09:11.409 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:11 smithi148 ceph-mon[31180]: fsmap 12 up:standby 2024-09-19T07:09:11.409 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:11 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T07:09:11.409 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:11 smithi148 ceph-mon[31180]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:09:11.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:11 smithi179 ceph-mon[35716]: mds.? [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] up:boot 2024-09-19T07:09:11.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:11 smithi179 ceph-mon[35716]: fsmap 12 up:standby 2024-09-19T07:09:11.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:11 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T07:09:11.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:11 smithi179 ceph-mon[35716]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:09:11.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:11 smithi165 ceph-mon[35326]: mds.? [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] up:boot 2024-09-19T07:09:11.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:11 smithi165 ceph-mon[35326]: fsmap 12 up:standby 2024-09-19T07:09:11.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:11 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T07:09:11.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:11 smithi165 ceph-mon[35326]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:09:11.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.617+0000 7f6944e61640 1 -- 172.21.15.148:0/3944313472 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6940100a80 msgr2=0x7f6940100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:11.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.617+0000 7f6944e61640 1 --2- 172.21.15.148:0/3944313472 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6940100a80 0x7f6940100ee0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6934009930 tx=0x7f693402a420 comp rx=0 tx=0).stop 2024-09-19T07:09:11.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.617+0000 7f6944e61640 1 -- 172.21.15.148:0/3944313472 shutdown_connections 2024-09-19T07:09:11.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.617+0000 7f6944e61640 1 --2- 172.21.15.148:0/3944313472 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6940101420 0x7f694010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:11.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.617+0000 7f6944e61640 1 --2- 172.21.15.148:0/3944313472 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6940100a80 0x7f6940100ee0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:11.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.617+0000 7f6944e61640 1 --2- 172.21.15.148:0/3944313472 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6940106a80 0x7f6940106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:11.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.617+0000 7f6944e61640 1 -- 172.21.15.148:0/3944313472 >> 172.21.15.148:0/3944313472 conn(0x7f69400fc7a0 msgr2=0x7f69400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:11.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.617+0000 7f6944e61640 1 -- 172.21.15.148:0/3944313472 shutdown_connections 2024-09-19T07:09:11.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.617+0000 7f6944e61640 1 -- 172.21.15.148:0/3944313472 wait complete. 2024-09-19T07:09:11.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.618+0000 7f6944e61640 1 Processor -- start 2024-09-19T07:09:11.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.618+0000 7f6944e61640 1 -- start start 2024-09-19T07:09:11.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.618+0000 7f6944e61640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6940100a80 0x7f6940197360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:11.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.618+0000 7f6944e61640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6940101420 0x7f69401978a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:11.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.618+0000 7f6944e61640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6940106a80 0x7f694019bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:11.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.618+0000 7f6944e61640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6940110e80 con 0x7f6940100a80 2024-09-19T07:09:11.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.618+0000 7f6944e61640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6940110d00 con 0x7f6940101420 2024-09-19T07:09:11.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.618+0000 7f6944e61640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6940111000 con 0x7f6940106a80 2024-09-19T07:09:11.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.618+0000 7f693e59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6940100a80 0x7f6940197360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:11.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.618+0000 7f693e59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6940100a80 0x7f6940197360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45674/0 (socket says 172.21.15.148:45674) 2024-09-19T07:09:11.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.619+0000 7f693e59c640 1 -- 172.21.15.148:0/1630122668 learned_addr learned my addr 172.21.15.148:0/1630122668 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:09:11.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.619+0000 7f693dd9b640 1 --2- 172.21.15.148:0/1630122668 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6940101420 0x7f69401978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:11.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.619+0000 7f693ed9d640 1 --2- 172.21.15.148:0/1630122668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6940106a80 0x7f694019bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:11.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.619+0000 7f693e59c640 1 -- 172.21.15.148:0/1630122668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6940106a80 msgr2=0x7f694019bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:11.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.619+0000 7f693e59c640 1 --2- 172.21.15.148:0/1630122668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6940106a80 0x7f694019bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:11.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.619+0000 7f693e59c640 1 -- 172.21.15.148:0/1630122668 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6940101420 msgr2=0x7f69401978a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:11.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.619+0000 7f693e59c640 1 --2- 172.21.15.148:0/1630122668 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6940101420 0x7f69401978a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:11.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.619+0000 7f693e59c640 1 -- 172.21.15.148:0/1630122668 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f694019c310 con 0x7f6940100a80 2024-09-19T07:09:11.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.619+0000 7f693e59c640 1 --2- 172.21.15.148:0/1630122668 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6940100a80 0x7f6940197360 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f693000d950 tx=0x7f693000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:11.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.619+0000 7f692f7fe640 1 -- 172.21.15.148:0/1630122668 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6930017070 con 0x7f6940100a80 2024-09-19T07:09:11.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.619+0000 7f6944e61640 1 -- 172.21.15.148:0/1630122668 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f694019c600 con 0x7f6940100a80 2024-09-19T07:09:11.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.619+0000 7f692f7fe640 1 -- 172.21.15.148:0/1630122668 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6930009c30 con 0x7f6940100a80 2024-09-19T07:09:11.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.619+0000 7f692f7fe640 1 -- 172.21.15.148:0/1630122668 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693000f6b0 con 0x7f6940100a80 2024-09-19T07:09:11.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.619+0000 7f6944e61640 1 -- 172.21.15.148:0/1630122668 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69401a3ee0 con 0x7f6940100a80 2024-09-19T07:09:11.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.620+0000 7f6944e61640 1 -- 172.21.15.148:0/1630122668 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6940100ee0 con 0x7f6940100a80 2024-09-19T07:09:11.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.621+0000 7f692f7fe640 1 -- 172.21.15.148:0/1630122668 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f69300109d0 con 0x7f6940100a80 2024-09-19T07:09:11.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.622+0000 7f692f7fe640 1 --2- 172.21.15.148:0/1630122668 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f69280a3240 0x7f69280a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:11.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.622+0000 7f693dd9b640 1 --2- 172.21.15.148:0/1630122668 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f69280a3240 0x7f69280a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:11.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.623+0000 7f692f7fe640 1 -- 172.21.15.148:0/1630122668 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f69300cefe0 con 0x7f6940100a80 2024-09-19T07:09:11.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.623+0000 7f693dd9b640 1 --2- 172.21.15.148:0/1630122668 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f69280a3240 0x7f69280a5700 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6934009900 tx=0x7f69340058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:11.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.626+0000 7f692f7fe640 1 -- 172.21.15.148:0/1630122668 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6930009de0 con 0x7f6940100a80 2024-09-19T07:09:11.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.853+0000 7f6944e61640 1 -- 172.21.15.148:0/1630122668 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f69401986c0 con 0x7f6940100a80 2024-09-19T07:09:11.854 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.853+0000 7f692f7fe640 1 -- 172.21.15.148:0/1630122668 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10551 (secure 0 0 0) 0x7f693009baf0 con 0x7f6940100a80 2024-09-19T07:09:11.855 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:09:11.855 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":13,"btime":"2024-09-19T07:09:10:144122+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/4263868576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":4263868576},{"type":"v1","addr":"172.21.15.148:6841","nonce":4263868576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24383,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2146820965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2146820965},{"type":"v1","addr":"172.21.15.165:6835","nonce":2146820965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24410,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24430,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1566489108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1566489108},{"type":"v1","addr":"172.21.15.179:6835","nonce":1566489108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24436,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6839/3993490234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":3993490234},{"type":"v1","addr":"172.21.15.165:6839","nonce":3993490234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24457,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T07:09:11.855 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 13 2024-09-19T07:09:11.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.856+0000 7f6944e61640 1 -- 172.21.15.148:0/1630122668 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f69280a3240 msgr2=0x7f69280a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:11.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.856+0000 7f6944e61640 1 --2- 172.21.15.148:0/1630122668 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f69280a3240 0x7f69280a5700 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6934009900 tx=0x7f69340058d0 comp rx=0 tx=0).stop 2024-09-19T07:09:11.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.856+0000 7f6944e61640 1 -- 172.21.15.148:0/1630122668 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6940100a80 msgr2=0x7f6940197360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:11.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.856+0000 7f6944e61640 1 --2- 172.21.15.148:0/1630122668 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6940100a80 0x7f6940197360 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f693000d950 tx=0x7f693000de10 comp rx=0 tx=0).stop 2024-09-19T07:09:11.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.856+0000 7f6944e61640 1 -- 172.21.15.148:0/1630122668 shutdown_connections 2024-09-19T07:09:11.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.856+0000 7f6944e61640 1 --2- 172.21.15.148:0/1630122668 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f69280a3240 0x7f69280a5700 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:11.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.856+0000 7f6944e61640 1 --2- 172.21.15.148:0/1630122668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6940106a80 0x7f694019bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:11.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.856+0000 7f6944e61640 1 --2- 172.21.15.148:0/1630122668 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6940101420 0x7f69401978a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:11.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.856+0000 7f6944e61640 1 --2- 172.21.15.148:0/1630122668 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6940100a80 0x7f6940197360 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:11.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.856+0000 7f6944e61640 1 -- 172.21.15.148:0/1630122668 >> 172.21.15.148:0/1630122668 conn(0x7f69400fc7a0 msgr2=0x7f69400fcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:11.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.856+0000 7f6944e61640 1 -- 172.21.15.148:0/1630122668 shutdown_connections 2024-09-19T07:09:11.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:11.856+0000 7f6944e61640 1 -- 172.21.15.148:0/1630122668 wait complete. 2024-09-19T07:09:12.468 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:12 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:12.469 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:12 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:12.469 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:12 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:12.469 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:12 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:12.469 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:12 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/1630122668' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:09:12.469 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:12 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:12.469 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:12 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:12.469 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:12 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:12.469 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:12 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:09:12.469 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:12 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:09:12.469 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:12 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:12.469 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:12 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:09:12.505 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-19T07:09:12.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:12 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:12.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:12 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:12.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:12 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:12.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:12 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:12.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:12 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/1630122668' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:09:12.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:12 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:12.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:12 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:12.774 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:12 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:12.774 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:12 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:09:12.774 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:12 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:09:12.774 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:12 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:12.774 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:12 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:09:12.797 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:12 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:12.797 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:12 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:12.797 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:12 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:12.797 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:12 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:12.797 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:12 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/1630122668' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:09:12.797 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:12 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:12.797 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:12 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:12.797 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:12 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:12.797 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:12 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:09:12.797 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:12 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:09:12.798 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:12 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:12.798 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:12 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:09:13.404 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:09:13.673 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:13 smithi148 ceph-mon[31180]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:09:13.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:13 smithi179 ceph-mon[35716]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:09:13.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:13 smithi165 ceph-mon[35326]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:09:13.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:13.895+0000 7f806f3c2640 1 -- 172.21.15.148:0/656193686 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8068101420 msgr2=0x7f806810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:13.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:13.895+0000 7f806f3c2640 1 --2- 172.21.15.148:0/656193686 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8068101420 0x7f806810d950 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8060009cd0 tx=0x7f806002a8e0 comp rx=0 tx=0).stop 2024-09-19T07:09:13.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:13.895+0000 7f806f3c2640 1 -- 172.21.15.148:0/656193686 shutdown_connections 2024-09-19T07:09:13.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:13.895+0000 7f806f3c2640 1 --2- 172.21.15.148:0/656193686 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8068101420 0x7f806810d950 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:13.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:13.895+0000 7f806f3c2640 1 --2- 172.21.15.148:0/656193686 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8068100a80 0x7f8068100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:13.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:13.895+0000 7f806f3c2640 1 --2- 172.21.15.148:0/656193686 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8068106a80 0x7f8068106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:13.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:13.895+0000 7f806f3c2640 1 -- 172.21.15.148:0/656193686 >> 172.21.15.148:0/656193686 conn(0x7f80680fc7a0 msgr2=0x7f80680febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:13.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:13.895+0000 7f806f3c2640 1 -- 172.21.15.148:0/656193686 shutdown_connections 2024-09-19T07:09:13.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:13.895+0000 7f806f3c2640 1 -- 172.21.15.148:0/656193686 wait complete. 2024-09-19T07:09:13.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:13.896+0000 7f806f3c2640 1 Processor -- start 2024-09-19T07:09:13.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:13.896+0000 7f806f3c2640 1 -- start start 2024-09-19T07:09:13.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:13.896+0000 7f806f3c2640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8068100a80 0x7f80680fccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:13.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:13.896+0000 7f806f3c2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8068101420 0x7f80680fd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:13.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:13.896+0000 7f806f3c2640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8068106a80 0x7f80680fd770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:13.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:13.896+0000 7f806f3c2640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8068110e80 con 0x7f8068100a80 2024-09-19T07:09:13.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:13.896+0000 7f806f3c2640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8068110d00 con 0x7f8068106a80 2024-09-19T07:09:13.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:13.896+0000 7f806f3c2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8068111000 con 0x7f8068101420 2024-09-19T07:09:13.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:13.896+0000 7f806d15e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8068100a80 0x7f80680fccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:13.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:13.896+0000 7f806d15e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8068100a80 0x7f80680fccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45694/0 (socket says 172.21.15.148:45694) 2024-09-19T07:09:13.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:13.896+0000 7f806d15e640 1 -- 172.21.15.148:0/2144787551 learned_addr learned my addr 172.21.15.148:0/2144787551 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:09:13.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:13.897+0000 7f806d15e640 1 -- 172.21.15.148:0/2144787551 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8068101420 msgr2=0x7f80680fd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:13.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:13.897+0000 7f806d15e640 1 --2- 172.21.15.148:0/2144787551 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8068101420 0x7f80680fd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:13.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:13.897+0000 7f806d15e640 1 -- 172.21.15.148:0/2144787551 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8068106a80 msgr2=0x7f80680fd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:13.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:13.897+0000 7f806d15e640 1 --2- 172.21.15.148:0/2144787551 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8068106a80 0x7f80680fd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:13.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:13.897+0000 7f806d15e640 1 -- 172.21.15.148:0/2144787551 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80681a68a0 con 0x7f8068100a80 2024-09-19T07:09:13.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:13.897+0000 7f806d15e640 1 --2- 172.21.15.148:0/2144787551 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8068100a80 0x7f80680fccf0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f806400d950 tx=0x7f806400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:13.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:13.897+0000 7f805e7fc640 1 -- 172.21.15.148:0/2144787551 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8064017030 con 0x7f8068100a80 2024-09-19T07:09:13.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:13.897+0000 7f805e7fc640 1 -- 172.21.15.148:0/2144787551 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8064004020 con 0x7f8068100a80 2024-09-19T07:09:13.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:13.897+0000 7f805e7fc640 1 -- 172.21.15.148:0/2144787551 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80640047a0 con 0x7f8068100a80 2024-09-19T07:09:13.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:13.897+0000 7f806f3c2640 1 -- 172.21.15.148:0/2144787551 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80681a6b90 con 0x7f8068100a80 2024-09-19T07:09:13.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:13.897+0000 7f806f3c2640 1 -- 172.21.15.148:0/2144787551 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80681a70d0 con 0x7f8068100a80 2024-09-19T07:09:13.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:13.898+0000 7f806f3c2640 1 -- 172.21.15.148:0/2144787551 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8068100ee0 con 0x7f8068100a80 2024-09-19T07:09:13.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:13.899+0000 7f805e7fc640 1 -- 172.21.15.148:0/2144787551 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f80640041d0 con 0x7f8068100a80 2024-09-19T07:09:13.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:13.900+0000 7f805e7fc640 1 --2- 172.21.15.148:0/2144787551 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f80540a3240 0x7f80540a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:13.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:13.900+0000 7f806c95d640 1 --2- 172.21.15.148:0/2144787551 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f80540a3240 0x7f80540a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:13.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:13.900+0000 7f805e7fc640 1 -- 172.21.15.148:0/2144787551 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f80640cee80 con 0x7f8068100a80 2024-09-19T07:09:13.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:13.900+0000 7f806c95d640 1 --2- 172.21.15.148:0/2144787551 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f80540a3240 0x7f80540a5700 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8058005fd0 tx=0x7f8058005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:13.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:13.904+0000 7f805e7fc640 1 -- 172.21.15.148:0/2144787551 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f806409c040 con 0x7f8068100a80 2024-09-19T07:09:14.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:14.092+0000 7f806f3c2640 1 -- 172.21.15.148:0/2144787551 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f80680fe220 con 0x7f8068100a80 2024-09-19T07:09:14.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:14.092+0000 7f805e7fc640 1 -- 172.21.15.148:0/2144787551 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v73) ==== 84+0+65 (secure 0 0 0) 0x7f806409b940 con 0x7f8068100a80 2024-09-19T07:09:14.094 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:09:14.094 INFO:teuthology.orchestra.run.smithi148.stdout:[ 2024-09-19T07:09:14.094 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:09:14.094 INFO:teuthology.orchestra.run.smithi148.stdout: "poolnum": 1, 2024-09-19T07:09:14.094 INFO:teuthology.orchestra.run.smithi148.stdout: "poolname": ".mgr" 2024-09-19T07:09:14.094 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:09:14.094 INFO:teuthology.orchestra.run.smithi148.stdout:] 2024-09-19T07:09:14.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:14.095+0000 7f806f3c2640 1 -- 172.21.15.148:0/2144787551 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f80540a3240 msgr2=0x7f80540a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:14.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:14.095+0000 7f806f3c2640 1 --2- 172.21.15.148:0/2144787551 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f80540a3240 0x7f80540a5700 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8058005fd0 tx=0x7f8058005850 comp rx=0 tx=0).stop 2024-09-19T07:09:14.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:14.095+0000 7f806f3c2640 1 -- 172.21.15.148:0/2144787551 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8068100a80 msgr2=0x7f80680fccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:14.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:14.095+0000 7f806f3c2640 1 --2- 172.21.15.148:0/2144787551 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8068100a80 0x7f80680fccf0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f806400d950 tx=0x7f806400de10 comp rx=0 tx=0).stop 2024-09-19T07:09:14.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:14.095+0000 7f806f3c2640 1 -- 172.21.15.148:0/2144787551 shutdown_connections 2024-09-19T07:09:14.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:14.095+0000 7f806f3c2640 1 --2- 172.21.15.148:0/2144787551 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f80540a3240 0x7f80540a5700 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:14.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:14.095+0000 7f806f3c2640 1 --2- 172.21.15.148:0/2144787551 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8068106a80 0x7f80680fd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:14.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:14.095+0000 7f806f3c2640 1 --2- 172.21.15.148:0/2144787551 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8068101420 0x7f80680fd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:14.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:14.095+0000 7f806f3c2640 1 --2- 172.21.15.148:0/2144787551 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8068100a80 0x7f80680fccf0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:14.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:14.095+0000 7f806f3c2640 1 -- 172.21.15.148:0/2144787551 >> 172.21.15.148:0/2144787551 conn(0x7f80680fc7a0 msgr2=0x7f806806a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:14.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:14.095+0000 7f806f3c2640 1 -- 172.21.15.148:0/2144787551 shutdown_connections 2024-09-19T07:09:14.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:14.095+0000 7f806f3c2640 1 -- 172.21.15.148:0/2144787551 wait complete. 2024-09-19T07:09:14.713 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T07:09:14.714 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T07:09:14.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:14 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:14.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:14 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:14.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:14 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:14.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:14 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:14.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:14 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/2144787551' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T07:09:14.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:14 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:14.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:14 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:14.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:14 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:14.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:14 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:14.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:14 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/2144787551' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T07:09:14.970 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:09:15.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:14 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:15.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:14 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:15.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:14 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:15.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:14 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:15.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:14 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/2144787551' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T07:09:15.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.430+0000 7f156b7c5640 1 -- 172.21.15.148:0/563338241 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1564102790 msgr2=0x7f15641067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:15.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.430+0000 7f156b7c5640 1 --2- 172.21.15.148:0/563338241 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1564102790 0x7f15641067e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1554009900 tx=0x7f155402a410 comp rx=0 tx=0).stop 2024-09-19T07:09:15.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.430+0000 7f156b7c5640 1 -- 172.21.15.148:0/563338241 shutdown_connections 2024-09-19T07:09:15.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.430+0000 7f156b7c5640 1 --2- 172.21.15.148:0/563338241 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1564106f10 0x7f156410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:15.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.430+0000 7f156b7c5640 1 --2- 172.21.15.148:0/563338241 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1564102790 0x7f15641067e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:15.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.430+0000 7f156b7c5640 1 --2- 172.21.15.148:0/563338241 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1564101de0 0x7f15641021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:15.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.430+0000 7f156b7c5640 1 -- 172.21.15.148:0/563338241 >> 172.21.15.148:0/563338241 conn(0x7f15640fd8c0 msgr2=0x7f15640ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:15.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.430+0000 7f156b7c5640 1 -- 172.21.15.148:0/563338241 shutdown_connections 2024-09-19T07:09:15.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.430+0000 7f156b7c5640 1 -- 172.21.15.148:0/563338241 wait complete. 2024-09-19T07:09:15.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.431+0000 7f156b7c5640 1 Processor -- start 2024-09-19T07:09:15.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.431+0000 7f156b7c5640 1 -- start start 2024-09-19T07:09:15.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.431+0000 7f156b7c5640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1564101de0 0x7f15640744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:15.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.431+0000 7f156b7c5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1564102790 0x7f1564074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:15.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.431+0000 7f156b7c5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1564106f10 0x7f1564074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:15.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.431+0000 7f156b7c5640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1564111f70 con 0x7f1564102790 2024-09-19T07:09:15.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.431+0000 7f156b7c5640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1564111df0 con 0x7f1564101de0 2024-09-19T07:09:15.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.431+0000 7f156b7c5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f15641120f0 con 0x7f1564106f10 2024-09-19T07:09:15.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.431+0000 7f1568d60640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1564102790 0x7f1564074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:15.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.431+0000 7f1568d60640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1564102790 0x7f1564074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37750/0 (socket says 172.21.15.148:37750) 2024-09-19T07:09:15.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.431+0000 7f1568d60640 1 -- 172.21.15.148:0/3257977014 learned_addr learned my addr 172.21.15.148:0/3257977014 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:09:15.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.431+0000 7f1569561640 1 --2- 172.21.15.148:0/3257977014 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1564101de0 0x7f15640744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:15.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.432+0000 7f1569d62640 1 --2- 172.21.15.148:0/3257977014 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1564106f10 0x7f1564074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:15.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.432+0000 7f1568d60640 1 -- 172.21.15.148:0/3257977014 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1564106f10 msgr2=0x7f1564074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:15.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.432+0000 7f1568d60640 1 --2- 172.21.15.148:0/3257977014 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1564106f10 0x7f1564074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:15.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.432+0000 7f1568d60640 1 -- 172.21.15.148:0/3257977014 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1564101de0 msgr2=0x7f15640744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:15.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.432+0000 7f1568d60640 1 --2- 172.21.15.148:0/3257977014 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1564101de0 0x7f15640744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:15.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.432+0000 7f1568d60640 1 -- 172.21.15.148:0/3257977014 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15641a6870 con 0x7f1564102790 2024-09-19T07:09:15.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.432+0000 7f1569d62640 1 --2- 172.21.15.148:0/3257977014 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1564106f10 0x7f1564074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:09:15.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.432+0000 7f1569561640 1 --2- 172.21.15.148:0/3257977014 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1564101de0 0x7f15640744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:09:15.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.432+0000 7f1568d60640 1 --2- 172.21.15.148:0/3257977014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1564102790 0x7f1564074a30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1554006010 tx=0x7f15540042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:15.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.432+0000 7f155a7fc640 1 -- 172.21.15.148:0/3257977014 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f155403f030 con 0x7f1564102790 2024-09-19T07:09:15.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.432+0000 7f156b7c5640 1 -- 172.21.15.148:0/3257977014 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15641a6b00 con 0x7f1564102790 2024-09-19T07:09:15.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.432+0000 7f155a7fc640 1 -- 172.21.15.148:0/3257977014 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1554003ce0 con 0x7f1564102790 2024-09-19T07:09:15.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.432+0000 7f155a7fc640 1 -- 172.21.15.148:0/3257977014 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1554035070 con 0x7f1564102790 2024-09-19T07:09:15.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.432+0000 7f156b7c5640 1 -- 172.21.15.148:0/3257977014 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15641a7030 con 0x7f1564102790 2024-09-19T07:09:15.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.433+0000 7f156b7c5640 1 -- 172.21.15.148:0/3257977014 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15641021c0 con 0x7f1564102790 2024-09-19T07:09:15.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.434+0000 7f155a7fc640 1 -- 172.21.15.148:0/3257977014 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f1554042030 con 0x7f1564102790 2024-09-19T07:09:15.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.435+0000 7f155a7fc640 1 --2- 172.21.15.148:0/3257977014 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f15500a3240 0x7f15500a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:15.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.435+0000 7f1569561640 1 --2- 172.21.15.148:0/3257977014 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f15500a3240 0x7f15500a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:15.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.435+0000 7f155a7fc640 1 -- 172.21.15.148:0/3257977014 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f15540efd80 con 0x7f1564102790 2024-09-19T07:09:15.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.435+0000 7f1569561640 1 --2- 172.21.15.148:0/3257977014 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f15500a3240 0x7f15500a5700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1560009b40 tx=0x7f1560005e50 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:15.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.438+0000 7f155a7fc640 1 -- 172.21.15.148:0/3257977014 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f15540bd000 con 0x7f1564102790 2024-09-19T07:09:15.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.604+0000 7f156b7c5640 1 -- 172.21.15.148:0/3257977014 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f156410a150 con 0x7f1564102790 2024-09-19T07:09:15.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.893+0000 7f155a7fc640 1 -- 172.21.15.148:0/3257977014 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v74) ==== 138+0+0 (secure 0 0 0) 0x7f15540bc900 con 0x7f1564102790 2024-09-19T07:09:15.895 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_metadata' created 2024-09-19T07:09:15.895 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:15 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:15.895 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:15 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:15.895 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:15 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:09:15.895 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:15 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:09:15.895 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:15 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:15.896 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:15 smithi148 ceph-mon[31180]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:09:15.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.895+0000 7f156b7c5640 1 -- 172.21.15.148:0/3257977014 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f15500a3240 msgr2=0x7f15500a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:15.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.895+0000 7f156b7c5640 1 --2- 172.21.15.148:0/3257977014 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f15500a3240 0x7f15500a5700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1560009b40 tx=0x7f1560005e50 comp rx=0 tx=0).stop 2024-09-19T07:09:15.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.895+0000 7f156b7c5640 1 -- 172.21.15.148:0/3257977014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1564102790 msgr2=0x7f1564074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:15.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.895+0000 7f156b7c5640 1 --2- 172.21.15.148:0/3257977014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1564102790 0x7f1564074a30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1554006010 tx=0x7f15540042f0 comp rx=0 tx=0).stop 2024-09-19T07:09:15.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.895+0000 7f156b7c5640 1 -- 172.21.15.148:0/3257977014 shutdown_connections 2024-09-19T07:09:15.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.895+0000 7f156b7c5640 1 --2- 172.21.15.148:0/3257977014 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f15500a3240 0x7f15500a5700 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:15.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.895+0000 7f156b7c5640 1 --2- 172.21.15.148:0/3257977014 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1564106f10 0x7f1564074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:15.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.895+0000 7f156b7c5640 1 --2- 172.21.15.148:0/3257977014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1564102790 0x7f1564074a30 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:15.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.895+0000 7f156b7c5640 1 --2- 172.21.15.148:0/3257977014 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1564101de0 0x7f15640744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:15.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.895+0000 7f156b7c5640 1 -- 172.21.15.148:0/3257977014 >> 172.21.15.148:0/3257977014 conn(0x7f15640fd8c0 msgr2=0x7f15640fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:15.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.895+0000 7f156b7c5640 1 -- 172.21.15.148:0/3257977014 shutdown_connections 2024-09-19T07:09:15.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:15.895+0000 7f156b7c5640 1 -- 172.21.15.148:0/3257977014 wait complete. 2024-09-19T07:09:16.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:15 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:16.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:15 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:16.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:15 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:09:16.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:15 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:09:16.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:15 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:16.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:15 smithi165 ceph-mon[35326]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:09:16.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:15 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:16.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:15 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:16.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:15 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:09:16.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:15 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:09:16.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:15 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:09:16.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:15 smithi179 ceph-mon[35716]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:09:16.532 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T07:09:16.780 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:09:17.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:16 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/3257977014' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T07:09:17.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:16 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/3257977014' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T07:09:17.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:16 smithi165 ceph-mon[35326]: osdmap e74: 12 total, 12 up, 12 in 2024-09-19T07:09:17.174 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:16 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/3257977014' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T07:09:17.174 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:16 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/3257977014' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T07:09:17.174 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:16 smithi179 ceph-mon[35716]: osdmap e74: 12 total, 12 up, 12 in 2024-09-19T07:09:17.189 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:16 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/3257977014' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T07:09:17.189 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:16 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/3257977014' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T07:09:17.189 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:16 smithi148 ceph-mon[31180]: osdmap e74: 12 total, 12 up, 12 in 2024-09-19T07:09:17.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.276+0000 7fc364e65640 1 -- 172.21.15.148:0/1150959772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc360101420 msgr2=0x7fc36010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:17.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.276+0000 7fc364e65640 1 --2- 172.21.15.148:0/1150959772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc360101420 0x7fc36010d950 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc358009cd0 tx=0x7fc35802a8e0 comp rx=0 tx=0).stop 2024-09-19T07:09:17.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.276+0000 7fc364e65640 1 -- 172.21.15.148:0/1150959772 shutdown_connections 2024-09-19T07:09:17.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.276+0000 7fc364e65640 1 --2- 172.21.15.148:0/1150959772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc360101420 0x7fc36010d950 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:17.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.276+0000 7fc364e65640 1 --2- 172.21.15.148:0/1150959772 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc360100a80 0x7fc360100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:17.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.276+0000 7fc364e65640 1 --2- 172.21.15.148:0/1150959772 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc360106a80 0x7fc360106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:17.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.276+0000 7fc364e65640 1 -- 172.21.15.148:0/1150959772 >> 172.21.15.148:0/1150959772 conn(0x7fc3600fc7a0 msgr2=0x7fc3600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:17.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.276+0000 7fc364e65640 1 -- 172.21.15.148:0/1150959772 shutdown_connections 2024-09-19T07:09:17.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.276+0000 7fc364e65640 1 -- 172.21.15.148:0/1150959772 wait complete. 2024-09-19T07:09:17.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.277+0000 7fc364e65640 1 Processor -- start 2024-09-19T07:09:17.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.277+0000 7fc364e65640 1 -- start start 2024-09-19T07:09:17.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.277+0000 7fc364e65640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc360100a80 0x7fc360197340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:17.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.277+0000 7fc364e65640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc360101420 0x7fc360197880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:17.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.277+0000 7fc364e65640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc360106a80 0x7fc36019bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:17.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.277+0000 7fc364e65640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc360110e80 con 0x7fc360101420 2024-09-19T07:09:17.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.277+0000 7fc364e65640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc360110d00 con 0x7fc360100a80 2024-09-19T07:09:17.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.277+0000 7fc364e65640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc360111000 con 0x7fc360106a80 2024-09-19T07:09:17.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.277+0000 7fc35dd9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc360101420 0x7fc360197880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:17.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.277+0000 7fc35dd9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc360101420 0x7fc360197880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37762/0 (socket says 172.21.15.148:37762) 2024-09-19T07:09:17.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.277+0000 7fc35dd9b640 1 -- 172.21.15.148:0/3339625019 learned_addr learned my addr 172.21.15.148:0/3339625019 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:09:17.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.277+0000 7fc35e59c640 1 --2- 172.21.15.148:0/3339625019 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc360100a80 0x7fc360197340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:17.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.277+0000 7fc35ed9d640 1 --2- 172.21.15.148:0/3339625019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc360106a80 0x7fc36019bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:17.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.277+0000 7fc35dd9b640 1 -- 172.21.15.148:0/3339625019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc360106a80 msgr2=0x7fc36019bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:17.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.277+0000 7fc35dd9b640 1 --2- 172.21.15.148:0/3339625019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc360106a80 0x7fc36019bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:17.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.277+0000 7fc35dd9b640 1 -- 172.21.15.148:0/3339625019 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc360100a80 msgr2=0x7fc360197340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:17.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.277+0000 7fc35dd9b640 1 --2- 172.21.15.148:0/3339625019 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc360100a80 0x7fc360197340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:17.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.277+0000 7fc35dd9b640 1 -- 172.21.15.148:0/3339625019 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc36019c2f0 con 0x7fc360101420 2024-09-19T07:09:17.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.278+0000 7fc35dd9b640 1 --2- 172.21.15.148:0/3339625019 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc360101420 0x7fc360197880 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc35400d950 tx=0x7fc35400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:17.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.278+0000 7fc34f7fe640 1 -- 172.21.15.148:0/3339625019 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc354017030 con 0x7fc360101420 2024-09-19T07:09:17.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.278+0000 7fc34f7fe640 1 -- 172.21.15.148:0/3339625019 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc354004020 con 0x7fc360101420 2024-09-19T07:09:17.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.278+0000 7fc364e65640 1 -- 172.21.15.148:0/3339625019 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc36019c5e0 con 0x7fc360101420 2024-09-19T07:09:17.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.278+0000 7fc34f7fe640 1 -- 172.21.15.148:0/3339625019 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3540047a0 con 0x7fc360101420 2024-09-19T07:09:17.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.278+0000 7fc364e65640 1 -- 172.21.15.148:0/3339625019 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3601a3ec0 con 0x7fc360101420 2024-09-19T07:09:17.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.279+0000 7fc364e65640 1 -- 172.21.15.148:0/3339625019 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc360100ee0 con 0x7fc360101420 2024-09-19T07:09:17.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.280+0000 7fc34f7fe640 1 -- 172.21.15.148:0/3339625019 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fc3540041d0 con 0x7fc360101420 2024-09-19T07:09:17.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.281+0000 7fc34f7fe640 1 --2- 172.21.15.148:0/3339625019 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fc3480a32c0 0x7fc3480a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:17.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.281+0000 7fc35e59c640 1 --2- 172.21.15.148:0/3339625019 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fc3480a32c0 0x7fc3480a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:17.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.281+0000 7fc34f7fe640 1 -- 172.21.15.148:0/3339625019 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7497+0+0 (secure 0 0 0) 0x7fc3540ceea0 con 0x7fc360101420 2024-09-19T07:09:17.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.281+0000 7fc35e59c640 1 --2- 172.21.15.148:0/3339625019 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fc3480a32c0 0x7fc3480a5780 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc350009b50 tx=0x7fc350005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:17.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.285+0000 7fc34f7fe640 1 -- 172.21.15.148:0/3339625019 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc35409bef0 con 0x7fc360101420 2024-09-19T07:09:17.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.456+0000 7fc364e65640 1 -- 172.21.15.148:0/3339625019 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fc360109050 con 0x7fc360101420 2024-09-19T07:09:17.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.902+0000 7fc34f7fe640 1 -- 172.21.15.148:0/3339625019 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v76) ==== 170+0+0 (secure 0 0 0) 0x7fc35409b7f0 con 0x7fc360101420 2024-09-19T07:09:17.903 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_data' created 2024-09-19T07:09:17.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.905+0000 7fc364e65640 1 -- 172.21.15.148:0/3339625019 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fc3480a32c0 msgr2=0x7fc3480a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:17.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.905+0000 7fc364e65640 1 --2- 172.21.15.148:0/3339625019 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fc3480a32c0 0x7fc3480a5780 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc350009b50 tx=0x7fc350005f90 comp rx=0 tx=0).stop 2024-09-19T07:09:17.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.905+0000 7fc364e65640 1 -- 172.21.15.148:0/3339625019 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc360101420 msgr2=0x7fc360197880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:17.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.905+0000 7fc364e65640 1 --2- 172.21.15.148:0/3339625019 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc360101420 0x7fc360197880 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc35400d950 tx=0x7fc35400de10 comp rx=0 tx=0).stop 2024-09-19T07:09:17.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.905+0000 7fc364e65640 1 -- 172.21.15.148:0/3339625019 shutdown_connections 2024-09-19T07:09:17.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.905+0000 7fc364e65640 1 --2- 172.21.15.148:0/3339625019 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fc3480a32c0 0x7fc3480a5780 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:17.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.905+0000 7fc364e65640 1 --2- 172.21.15.148:0/3339625019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc360106a80 0x7fc36019bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:17.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.905+0000 7fc364e65640 1 --2- 172.21.15.148:0/3339625019 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc360101420 0x7fc360197880 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:17.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.905+0000 7fc364e65640 1 --2- 172.21.15.148:0/3339625019 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc360100a80 0x7fc360197340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:17.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.905+0000 7fc364e65640 1 -- 172.21.15.148:0/3339625019 >> 172.21.15.148:0/3339625019 conn(0x7fc3600fc7a0 msgr2=0x7fc3600fcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:17.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.905+0000 7fc364e65640 1 -- 172.21.15.148:0/3339625019 shutdown_connections 2024-09-19T07:09:17.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:17.905+0000 7fc364e65640 1 -- 172.21.15.148:0/3339625019 wait complete. 2024-09-19T07:09:18.234 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:17 smithi148 ceph-mon[31180]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T07:09:18.234 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:17 smithi148 ceph-mon[31180]: pgmap v265: 33 pgs: 9 creating+peering, 23 unknown, 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:09:18.234 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:17 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/3339625019' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T07:09:18.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:17 smithi179 ceph-mon[35716]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T07:09:18.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:17 smithi179 ceph-mon[35716]: pgmap v265: 33 pgs: 9 creating+peering, 23 unknown, 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:09:18.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:17 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/3339625019' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T07:09:18.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:17 smithi165 ceph-mon[35326]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T07:09:18.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:17 smithi165 ceph-mon[35326]: pgmap v265: 33 pgs: 9 creating+peering, 23 unknown, 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:09:18.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:17 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/3339625019' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T07:09:18.604 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T07:09:18.853 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:09:19.246 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:18 smithi148 ceph-mon[31180]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T07:09:19.246 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:18 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/3339625019' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T07:09:19.247 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:18 smithi148 ceph-mon[31180]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T07:09:19.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:18 smithi179 ceph-mon[35716]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T07:09:19.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:18 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/3339625019' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T07:09:19.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:18 smithi179 ceph-mon[35716]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T07:09:19.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.329+0000 7f1ef081e640 1 -- 172.21.15.148:0/1106665834 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1eec100a80 msgr2=0x7f1eec100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:19.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.329+0000 7f1ef081e640 1 --2- 172.21.15.148:0/1106665834 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1eec100a80 0x7f1eec100ee0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4009930 tx=0x7f1ed402a420 comp rx=0 tx=0).stop 2024-09-19T07:09:19.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.329+0000 7f1ef081e640 1 -- 172.21.15.148:0/1106665834 shutdown_connections 2024-09-19T07:09:19.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.329+0000 7f1ef081e640 1 --2- 172.21.15.148:0/1106665834 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1eec101420 0x7f1eec10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:19.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.329+0000 7f1ef081e640 1 --2- 172.21.15.148:0/1106665834 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1eec100a80 0x7f1eec100ee0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:19.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.329+0000 7f1ef081e640 1 --2- 172.21.15.148:0/1106665834 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1eec106a80 0x7f1eec106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:19.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.329+0000 7f1ef081e640 1 -- 172.21.15.148:0/1106665834 >> 172.21.15.148:0/1106665834 conn(0x7f1eec0fc7a0 msgr2=0x7f1eec0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:19.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.329+0000 7f1ef081e640 1 -- 172.21.15.148:0/1106665834 shutdown_connections 2024-09-19T07:09:19.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.329+0000 7f1ef081e640 1 -- 172.21.15.148:0/1106665834 wait complete. 2024-09-19T07:09:19.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.330+0000 7f1ef081e640 1 Processor -- start 2024-09-19T07:09:19.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.330+0000 7f1ef081e640 1 -- start start 2024-09-19T07:09:19.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.330+0000 7f1ef081e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1eec100a80 0x7f1eec1984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:19.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.330+0000 7f1ef081e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1eec101420 0x7f1eec1989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:19.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.330+0000 7f1ef081e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1eec106a80 0x7f1eec19cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:19.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.330+0000 7f1ef081e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1eec111fc0 con 0x7f1eec106a80 2024-09-19T07:09:19.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.330+0000 7f1ef081e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1eec111e40 con 0x7f1eec101420 2024-09-19T07:09:19.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.330+0000 7f1ef081e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1eec112140 con 0x7f1eec100a80 2024-09-19T07:09:19.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.330+0000 7f1eead9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1eec106a80 0x7f1eec19cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:19.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.330+0000 7f1eead9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1eec106a80 0x7f1eec19cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37778/0 (socket says 172.21.15.148:37778) 2024-09-19T07:09:19.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.330+0000 7f1eead9d640 1 -- 172.21.15.148:0/1182392715 learned_addr learned my addr 172.21.15.148:0/1182392715 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:09:19.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.330+0000 7f1eea59c640 1 --2- 172.21.15.148:0/1182392715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1eec100a80 0x7f1eec1984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:19.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.331+0000 7f1eead9d640 1 -- 172.21.15.148:0/1182392715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1eec100a80 msgr2=0x7f1eec1984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:19.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.331+0000 7f1eead9d640 1 --2- 172.21.15.148:0/1182392715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1eec100a80 0x7f1eec1984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:19.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.331+0000 7f1eead9d640 1 -- 172.21.15.148:0/1182392715 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1eec101420 msgr2=0x7f1eec1989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:19.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.331+0000 7f1eead9d640 1 --2- 172.21.15.148:0/1182392715 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1eec101420 0x7f1eec1989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:19.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.331+0000 7f1eead9d640 1 -- 172.21.15.148:0/1182392715 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1eec19d450 con 0x7f1eec106a80 2024-09-19T07:09:19.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.331+0000 7f1eea59c640 1 --2- 172.21.15.148:0/1182392715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1eec100a80 0x7f1eec1984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:09:19.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.331+0000 7f1eead9d640 1 --2- 172.21.15.148:0/1182392715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1eec106a80 0x7f1eec19cd70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1ee400eb10 tx=0x7f1ee400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:19.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.331+0000 7f1ee37fe640 1 -- 172.21.15.148:0/1182392715 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4004b20 con 0x7f1eec106a80 2024-09-19T07:09:19.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.331+0000 7f1ef081e640 1 -- 172.21.15.148:0/1182392715 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1eec19d740 con 0x7f1eec106a80 2024-09-19T07:09:19.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.331+0000 7f1ee37fe640 1 -- 172.21.15.148:0/1182392715 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ee4004cc0 con 0x7f1eec106a80 2024-09-19T07:09:19.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.331+0000 7f1ee37fe640 1 -- 172.21.15.148:0/1182392715 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4010760 con 0x7f1eec106a80 2024-09-19T07:09:19.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.331+0000 7f1ef081e640 1 -- 172.21.15.148:0/1182392715 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1eec1a5020 con 0x7f1eec106a80 2024-09-19T07:09:19.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.332+0000 7f1ef081e640 1 -- 172.21.15.148:0/1182392715 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1eec100ee0 con 0x7f1eec106a80 2024-09-19T07:09:19.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.334+0000 7f1ee37fe640 1 -- 172.21.15.148:0/1182392715 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f1ee4005000 con 0x7f1eec106a80 2024-09-19T07:09:19.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.334+0000 7f1ee37fe640 1 --2- 172.21.15.148:0/1182392715 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f1ed80a3240 0x7f1ed80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:19.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.335+0000 7f1eea59c640 1 --2- 172.21.15.148:0/1182392715 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f1ed80a3240 0x7f1ed80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:19.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.335+0000 7f1ee37fe640 1 -- 172.21.15.148:0/1182392715 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7879+0+0 (secure 0 0 0) 0x7f1ee40d02d0 con 0x7f1eec106a80 2024-09-19T07:09:19.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.335+0000 7f1eea59c640 1 --2- 172.21.15.148:0/1182392715 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f1ed80a3240 0x7f1ed80a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1edc009930 tx=0x7f1edc008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:19.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.338+0000 7f1ee37fe640 1 -- 172.21.15.148:0/1182392715 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1ee409d1a0 con 0x7f1eec106a80 2024-09-19T07:09:19.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:18 smithi165 ceph-mon[35326]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T07:09:19.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:18 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/3339625019' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T07:09:19.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:18 smithi165 ceph-mon[35326]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T07:09:19.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.541+0000 7f1ef081e640 1 -- 172.21.15.148:0/1182392715 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f1eec199800 con 0x7f1eec106a80 2024-09-19T07:09:19.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.918+0000 7f1ee37fe640 1 -- 172.21.15.148:0/1182392715 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f1eec199800 con 0x7f1eec106a80 2024-09-19T07:09:19.919 INFO:teuthology.orchestra.run.smithi148.stderr:new fs with metadata pool 2 and data pool 3 2024-09-19T07:09:19.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.921+0000 7f1ef081e640 1 -- 172.21.15.148:0/1182392715 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f1ed80a3240 msgr2=0x7f1ed80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:19.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.921+0000 7f1ef081e640 1 --2- 172.21.15.148:0/1182392715 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f1ed80a3240 0x7f1ed80a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1edc009930 tx=0x7f1edc008040 comp rx=0 tx=0).stop 2024-09-19T07:09:19.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.921+0000 7f1ef081e640 1 -- 172.21.15.148:0/1182392715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1eec106a80 msgr2=0x7f1eec19cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:19.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.921+0000 7f1ef081e640 1 --2- 172.21.15.148:0/1182392715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1eec106a80 0x7f1eec19cd70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1ee400eb10 tx=0x7f1ee400c2d0 comp rx=0 tx=0).stop 2024-09-19T07:09:19.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.921+0000 7f1ef081e640 1 -- 172.21.15.148:0/1182392715 shutdown_connections 2024-09-19T07:09:19.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.921+0000 7f1ef081e640 1 --2- 172.21.15.148:0/1182392715 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f1ed80a3240 0x7f1ed80a5700 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:19.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.922+0000 7f1ef081e640 1 --2- 172.21.15.148:0/1182392715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1eec106a80 0x7f1eec19cd70 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:19.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.922+0000 7f1ef081e640 1 --2- 172.21.15.148:0/1182392715 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1eec101420 0x7f1eec1989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:19.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.922+0000 7f1ef081e640 1 --2- 172.21.15.148:0/1182392715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1eec100a80 0x7f1eec1984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:19.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.922+0000 7f1ef081e640 1 -- 172.21.15.148:0/1182392715 >> 172.21.15.148:0/1182392715 conn(0x7f1eec0fc7a0 msgr2=0x7f1eec0fcfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:19.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.922+0000 7f1ef081e640 1 -- 172.21.15.148:0/1182392715 shutdown_connections 2024-09-19T07:09:19.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:19.922+0000 7f1ef081e640 1 -- 172.21.15.148:0/1182392715 wait complete. 2024-09-19T07:09:20.250 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:19 smithi148 ceph-mon[31180]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T07:09:20.250 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:19 smithi148 ceph-mon[31180]: pgmap v268: 97 pgs: 17 creating+peering, 62 unknown, 18 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:09:20.250 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:19 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/1182392715' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T07:09:20.251 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:19 smithi148 ceph-mon[31180]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-19T07:09:20.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:19 smithi179 ceph-mon[35716]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T07:09:20.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:19 smithi179 ceph-mon[35716]: pgmap v268: 97 pgs: 17 creating+peering, 62 unknown, 18 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:09:20.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:19 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/1182392715' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T07:09:20.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:19 smithi179 ceph-mon[35716]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-19T07:09:20.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:19 smithi165 ceph-mon[35326]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T07:09:20.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:19 smithi165 ceph-mon[35326]: pgmap v268: 97 pgs: 17 creating+peering, 62 unknown, 18 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:09:20.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:19 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/1182392715' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T07:09:20.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:19 smithi165 ceph-mon[35326]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-19T07:09:20.598 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T07:09:20.847 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:09:21.222 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:20 smithi148 ceph-mon[31180]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T07:09:21.223 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:20 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/1182392715' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T07:09:21.223 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:20 smithi148 ceph-mon[31180]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-19T07:09:21.223 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:20 smithi148 ceph-mon[31180]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-19T07:09:21.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:20 smithi179 ceph-mon[35716]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T07:09:21.280 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:20 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/1182392715' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T07:09:21.280 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:20 smithi179 ceph-mon[35716]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-19T07:09:21.280 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:20 smithi179 ceph-mon[35716]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-19T07:09:21.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.300+0000 7fcfc2bf8640 1 -- 172.21.15.148:0/1958016500 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcfbc105f40 msgr2=0x7fcfbc1063d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:21.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.300+0000 7fcfc2bf8640 1 --2- 172.21.15.148:0/1958016500 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcfbc105f40 0x7fcfbc1063d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4009ca0 tx=0x7fcfb402a940 comp rx=0 tx=0).stop 2024-09-19T07:09:21.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.300+0000 7fcfc2bf8640 1 -- 172.21.15.148:0/1958016500 shutdown_connections 2024-09-19T07:09:21.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.300+0000 7fcfc2bf8640 1 --2- 172.21.15.148:0/1958016500 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcfbc105f40 0x7fcfbc1063d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:21.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.300+0000 7fcfc2bf8640 1 --2- 172.21.15.148:0/1958016500 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfbc101450 0x7fcfbc105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:21.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.300+0000 7fcfc2bf8640 1 --2- 172.21.15.148:0/1958016500 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcfbc100b30 0x7fcfbc100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:21.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.300+0000 7fcfc2bf8640 1 -- 172.21.15.148:0/1958016500 >> 172.21.15.148:0/1958016500 conn(0x7fcfbc0fc7a0 msgr2=0x7fcfbc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:21.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.300+0000 7fcfc2bf8640 1 -- 172.21.15.148:0/1958016500 shutdown_connections 2024-09-19T07:09:21.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.300+0000 7fcfc2bf8640 1 -- 172.21.15.148:0/1958016500 wait complete. 2024-09-19T07:09:21.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.301+0000 7fcfc2bf8640 1 Processor -- start 2024-09-19T07:09:21.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.301+0000 7fcfc2bf8640 1 -- start start 2024-09-19T07:09:21.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.301+0000 7fcfc2bf8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcfbc100b30 0x7fcfbc1a4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:21.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.301+0000 7fcfc2bf8640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfbc101450 0x7fcfbc1a4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:21.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.301+0000 7fcfc2bf8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcfbc105f40 0x7fcfbc19e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:21.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.301+0000 7fcfc2bf8640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fcfbc118570 con 0x7fcfbc100b30 2024-09-19T07:09:21.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.301+0000 7fcfc2bf8640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcfbc1183f0 con 0x7fcfbc101450 2024-09-19T07:09:21.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.301+0000 7fcfc2bf8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcfbc1186f0 con 0x7fcfbc105f40 2024-09-19T07:09:21.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.301+0000 7fcfc0994640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcfbc100b30 0x7fcfbc1a4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:21.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.301+0000 7fcfc0994640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcfbc100b30 0x7fcfbc1a4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37802/0 (socket says 172.21.15.148:37802) 2024-09-19T07:09:21.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.301+0000 7fcfc0994640 1 -- 172.21.15.148:0/3939517175 learned_addr learned my addr 172.21.15.148:0/3939517175 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:09:21.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.301+0000 7fcfc1195640 1 --2- 172.21.15.148:0/3939517175 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcfbc105f40 0x7fcfbc19e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:21.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.301+0000 7fcfc0994640 1 -- 172.21.15.148:0/3939517175 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcfbc105f40 msgr2=0x7fcfbc19e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:21.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.301+0000 7fcfc0994640 1 --2- 172.21.15.148:0/3939517175 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcfbc105f40 0x7fcfbc19e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:21.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.301+0000 7fcfb3fff640 1 --2- 172.21.15.148:0/3939517175 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfbc101450 0x7fcfbc1a4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:21.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.301+0000 7fcfc0994640 1 -- 172.21.15.148:0/3939517175 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfbc101450 msgr2=0x7fcfbc1a4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:21.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.301+0000 7fcfc0994640 1 --2- 172.21.15.148:0/3939517175 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfbc101450 0x7fcfbc1a4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:21.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.301+0000 7fcfc0994640 1 -- 172.21.15.148:0/3939517175 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfbc19ef60 con 0x7fcfbc100b30 2024-09-19T07:09:21.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.301+0000 7fcfb3fff640 1 --2- 172.21.15.148:0/3939517175 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfbc101450 0x7fcfbc1a4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:09:21.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.302+0000 7fcfc0994640 1 --2- 172.21.15.148:0/3939517175 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcfbc100b30 0x7fcfbc1a4640 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcfb800d770 tx=0x7fcfb800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:21.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.302+0000 7fcfb1ffb640 1 -- 172.21.15.148:0/3939517175 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb8017070 con 0x7fcfbc100b30 2024-09-19T07:09:21.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.302+0000 7fcfb1ffb640 1 -- 172.21.15.148:0/3939517175 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcfb8005500 con 0x7fcfbc100b30 2024-09-19T07:09:21.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.302+0000 7fcfb1ffb640 1 -- 172.21.15.148:0/3939517175 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb8004e00 con 0x7fcfbc100b30 2024-09-19T07:09:21.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.302+0000 7fcfc2bf8640 1 -- 172.21.15.148:0/3939517175 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfbc19f250 con 0x7fcfbc100b30 2024-09-19T07:09:21.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.302+0000 7fcfc2bf8640 1 -- 172.21.15.148:0/3939517175 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfbc1ab4a0 con 0x7fcfbc100b30 2024-09-19T07:09:21.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.303+0000 7fcfc2bf8640 1 -- 172.21.15.148:0/3939517175 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfbc06b070 con 0x7fcfbc100b30 2024-09-19T07:09:21.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.304+0000 7fcfb1ffb640 1 -- 172.21.15.148:0/3939517175 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fcfb8004fa0 con 0x7fcfbc100b30 2024-09-19T07:09:21.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.305+0000 7fcfb1ffb640 1 --2- 172.21.15.148:0/3939517175 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fcfa40a3240 0x7fcfa40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:21.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.305+0000 7fcfb3fff640 1 --2- 172.21.15.148:0/3939517175 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fcfa40a3240 0x7fcfa40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:21.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.305+0000 7fcfb1ffb640 1 -- 172.21.15.148:0/3939517175 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7fcfb80cf240 con 0x7fcfbc100b30 2024-09-19T07:09:21.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.305+0000 7fcfb3fff640 1 --2- 172.21.15.148:0/3939517175 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fcfa40a3240 0x7fcfa40a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcfac005fd0 tx=0x7fcfac005dc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:21.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.309+0000 7fcfb1ffb640 1 -- 172.21.15.148:0/3939517175 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcfb809c0b0 con 0x7fcfbc100b30 2024-09-19T07:09:21.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:20 smithi165 ceph-mon[35326]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T07:09:21.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:20 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/1182392715' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T07:09:21.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:20 smithi165 ceph-mon[35326]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-19T07:09:21.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:20 smithi165 ceph-mon[35326]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-19T07:09:21.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.478+0000 7fcfc2bf8640 1 -- 172.21.15.148:0/3939517175 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcfbc1ab6a0 con 0x7fcfbc100b30 2024-09-19T07:09:21.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.479+0000 7fcfb1ffb640 1 -- 172.21.15.148:0/3939517175 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+22374 (secure 0 0 0) 0x7fcfb809b9b0 con 0x7fcfbc100b30 2024-09-19T07:09:21.481 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:09:21.481 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":78,"fsid":"eae8a4a8-7654-11ef-bceb-c7b262605968","created":"2024-09-19T07:01:47.891210+0000","modified":"2024-09-19T07:09:19.543152+0000","last_up_change":"2024-09-19T07:08:30.785262+0000","last_in_change":"2024-09-19T07:08:07.001808+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:04:49.313270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T07:09:15.840600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T07:09:17.690782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7b854fad-d5a3-43e3-862e-7a0e8f243c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6803","nonce":512186330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6805","nonce":512186330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6809","nonce":512186330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6807","nonce":512186330}]},"public_addr":"172.21.15.148:6803/512186330","cluster_addr":"172.21.15.148:6805/512186330","heartbeat_back_addr":"172.21.15.148:6809/512186330","heartbeat_front_addr":"172.21.15.148:6807/512186330","state":["exists","up"]},{"osd":1,"uuid":"61b26278-f4db-40f0-97b9-c12a6ef1cd06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6801","nonce":2433984552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6803","nonce":2433984552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6807","nonce":2433984552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6805","nonce":2433984552}]},"public_addr":"172.21.15.165:6801/2433984552","cluster_addr":"172.21.15.165:6803/2433984552","heartbeat_back_addr":"172.21.15.165:6807/2433984552","heartbeat_front_addr":"172.21.15.165:6805/2433984552","state":["exists","up"]},{"osd":2,"uuid":"06620bbc-cdb5-4afc-8122-0bb3126630f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6801","nonce":3048365223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6803","nonce":3048365223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6807","nonce":3048365223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6805","nonce":3048365223}]},"public_addr":"172.21.15.179:6801/3048365223","cluster_addr":"172.21.15.179:6803/3048365223","heartbeat_back_addr":"172.21.15.179:6807/3048365223","heartbeat_front_addr":"172.21.15.179:6805/3048365223","state":["exists","up"]},{"osd":3,"uuid":"d7df45d4-5ef1-4f66-84a7-f61b8756c0c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6811","nonce":3662789091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6813","nonce":3662789091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6817","nonce":3662789091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6815","nonce":3662789091}]},"public_addr":"172.21.15.148:6811/3662789091","cluster_addr":"172.21.15.148:6813/3662789091","heartbeat_back_addr":"172.21.15.148:6817/3662789091","heartbeat_front_addr":"172.21.15.148:6815/3662789091","state":["exists","up"]},{"osd":4,"uuid":"5cfd359b-a8d2-4bdc-858f-087d26e0869c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6809","nonce":3082550323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6811","nonce":3082550323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6815","nonce":3082550323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6813","nonce":3082550323}]},"public_addr":"172.21.15.165:6809/3082550323","cluster_addr":"172.21.15.165:6811/3082550323","heartbeat_back_addr":"172.21.15.165:6815/3082550323","heartbeat_front_addr":"172.21.15.165:6813/3082550323","state":["exists","up"]},{"osd":5,"uuid":"8295e69b-87fe-4403-bb2e-d9dd42e2f398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6809","nonce":2125213751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6811","nonce":2125213751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6815","nonce":2125213751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6813","nonce":2125213751}]},"public_addr":"172.21.15.179:6809/2125213751","cluster_addr":"172.21.15.179:6811/2125213751","heartbeat_back_addr":"172.21.15.179:6815/2125213751","heartbeat_front_addr":"172.21.15.179:6813/2125213751","state":["exists","up"]},{"osd":6,"uuid":"4ce38d1a-06d3-4606-b00d-aa1ff977025f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6819","nonce":2178980310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6821","nonce":2178980310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6825","nonce":2178980310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6823","nonce":2178980310}]},"public_addr":"172.21.15.148:6819/2178980310","cluster_addr":"172.21.15.148:6821/2178980310","heartbeat_back_addr":"172.21.15.148:6825/2178980310","heartbeat_front_addr":"172.21.15.148:6823/2178980310","state":["exists","up"]},{"osd":7,"uuid":"9e68e2b2-9838-4ec0-b473-24f2434695ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6817","nonce":3961600099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6819","nonce":3961600099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6823","nonce":3961600099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6821","nonce":3961600099}]},"public_addr":"172.21.15.165:6817/3961600099","cluster_addr":"172.21.15.165:6819/3961600099","heartbeat_back_addr":"172.21.15.165:6823/3961600099","heartbeat_front_addr":"172.21.15.165:6821/3961600099","state":["exists","up"]},{"osd":8,"uuid":"297acce6-d3c7-4e1a-bf87-be093de51a6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6817","nonce":3642931467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6819","nonce":3642931467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6823","nonce":3642931467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6821","nonce":3642931467}]},"public_addr":"172.21.15.179:6817/3642931467","cluster_addr":"172.21.15.179:6819/3642931467","heartbeat_back_addr":"172.21.15.179:6823/3642931467","heartbeat_front_addr":"172.21.15.179:6821/3642931467","state":["exists","up"]},{"osd":9,"uuid":"ef488c5e-5353-4695-99dd-5b74ade436d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6827","nonce":3135409630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6829","nonce":3135409630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6833","nonce":3135409630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6831","nonce":3135409630}]},"public_addr":"172.21.15.148:6827/3135409630","cluster_addr":"172.21.15.148:6829/3135409630","heartbeat_back_addr":"172.21.15.148:6833/3135409630","heartbeat_front_addr":"172.21.15.148:6831/3135409630","state":["exists","up"]},{"osd":10,"uuid":"7a9f0379-1199-4266-910c-8d1d313d39e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6825","nonce":3554110731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6827","nonce":3554110731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6831","nonce":3554110731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6829","nonce":3554110731}]},"public_addr":"172.21.15.165:6825/3554110731","cluster_addr":"172.21.15.165:6827/3554110731","heartbeat_back_addr":"172.21.15.165:6831/3554110731","heartbeat_front_addr":"172.21.15.165:6829/3554110731","state":["exists","up"]},{"osd":11,"uuid":"eede97e9-5685-4603-806e-7078c6940536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6825","nonce":2026109940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6827","nonce":2026109940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6831","nonce":2026109940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6829","nonce":2026109940}]},"public_addr":"172.21.15.179:6825/2026109940","cluster_addr":"172.21.15.179:6827/2026109940","heartbeat_back_addr":"172.21.15.179:6831/2026109940","heartbeat_front_addr":"172.21.15.179:6829/2026109940","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:03:56.291685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:21.419682+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:46.377012+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:11.484234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:36.723101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:06:00.294617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:06:25.147230+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:06:49.318576+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:07:13.896399+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:07:38.930999+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:08:03.803463+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:08:28.731343+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.148:0/3534559227":"2024-09-20T07:02:37.007183+0000","172.21.15.148:0/1958388906":"2024-09-20T07:02:37.007183+0000","172.21.15.148:0/1922521135":"2024-09-20T07:02:37.007183+0000","172.21.15.148:6801/1949849385":"2024-09-20T07:02:37.007183+0000","172.21.15.148:6800/1949849385":"2024-09-20T07:02:37.007183+0000","172.21.15.148:6800/2161746152":"2024-09-20T07:02:14.557425+0000","172.21.15.148:6801/2161746152":"2024-09-20T07:02:14.557425+0000","172.21.15.148:0/1480486619":"2024-09-20T07:02:14.557425+0000","172.21.15.148:0/174481494":"2024-09-20T07:02:14.557425+0000","172.21.15.148:0/1114469409":"2024-09-20T07:02:14.557425+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T07:09:21.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.482+0000 7fcfc2bf8640 1 -- 172.21.15.148:0/3939517175 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fcfa40a3240 msgr2=0x7fcfa40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:21.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.482+0000 7fcfc2bf8640 1 --2- 172.21.15.148:0/3939517175 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fcfa40a3240 0x7fcfa40a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcfac005fd0 tx=0x7fcfac005dc0 comp rx=0 tx=0).stop 2024-09-19T07:09:21.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.482+0000 7fcfc2bf8640 1 -- 172.21.15.148:0/3939517175 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcfbc100b30 msgr2=0x7fcfbc1a4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:21.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.482+0000 7fcfc2bf8640 1 --2- 172.21.15.148:0/3939517175 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcfbc100b30 0x7fcfbc1a4640 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcfb800d770 tx=0x7fcfb800dc30 comp rx=0 tx=0).stop 2024-09-19T07:09:21.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.482+0000 7fcfc2bf8640 1 -- 172.21.15.148:0/3939517175 shutdown_connections 2024-09-19T07:09:21.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.482+0000 7fcfc2bf8640 1 --2- 172.21.15.148:0/3939517175 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fcfa40a3240 0x7fcfa40a5700 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:21.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.482+0000 7fcfc2bf8640 1 --2- 172.21.15.148:0/3939517175 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcfbc105f40 0x7fcfbc19e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:21.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.482+0000 7fcfc2bf8640 1 --2- 172.21.15.148:0/3939517175 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfbc101450 0x7fcfbc1a4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:21.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.482+0000 7fcfc2bf8640 1 --2- 172.21.15.148:0/3939517175 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcfbc100b30 0x7fcfbc1a4640 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:21.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.482+0000 7fcfc2bf8640 1 -- 172.21.15.148:0/3939517175 >> 172.21.15.148:0/3939517175 conn(0x7fcfbc0fc7a0 msgr2=0x7fcfbc1038f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:21.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.482+0000 7fcfc2bf8640 1 -- 172.21.15.148:0/3939517175 shutdown_connections 2024-09-19T07:09:21.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:21.482+0000 7fcfc2bf8640 1 -- 172.21.15.148:0/3939517175 wait complete. 2024-09-19T07:09:22.126 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:21 smithi148 ceph-mon[31180]: mds.? [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] up:active 2024-09-19T07:09:22.126 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:21 smithi148 ceph-mon[31180]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T07:09:22.126 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:21 smithi148 ceph-mon[31180]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T07:09:22.126 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:21 smithi148 ceph-mon[31180]: pgmap v270: 97 pgs: 11 creating+peering, 13 unknown, 73 active+clean; 578 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 979 B/s wr, 6 op/s 2024-09-19T07:09:22.127 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:21 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/3939517175' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:09:22.157 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T07:09:22.272 INFO:journalctl@ceph.mds.i.smithi179.stdout:Sep 19 07:09:21 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-i[66282]: 2024-09-19T07:09:21.841+0000 7f258aced640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T07:09:22.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:21 smithi179 ceph-mon[35716]: mds.? [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] up:active 2024-09-19T07:09:22.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:21 smithi179 ceph-mon[35716]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T07:09:22.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:21 smithi179 ceph-mon[35716]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T07:09:22.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:21 smithi179 ceph-mon[35716]: pgmap v270: 97 pgs: 11 creating+peering, 13 unknown, 73 active+clean; 578 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 979 B/s wr, 6 op/s 2024-09-19T07:09:22.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:21 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/3939517175' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:09:22.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:21 smithi165 ceph-mon[35326]: mds.? [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] up:active 2024-09-19T07:09:22.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:21 smithi165 ceph-mon[35326]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T07:09:22.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:21 smithi165 ceph-mon[35326]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T07:09:22.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:21 smithi165 ceph-mon[35326]: pgmap v270: 97 pgs: 11 creating+peering, 13 unknown, 73 active+clean; 578 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 979 B/s wr, 6 op/s 2024-09-19T07:09:22.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:21 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/3939517175' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:09:22.405 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:09:22.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:22.867+0000 7fc40231a640 1 -- 172.21.15.148:0/3830991326 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3fc100a80 msgr2=0x7fc3fc100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:22.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:22.867+0000 7fc40231a640 1 --2- 172.21.15.148:0/3830991326 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3fc100a80 0x7fc3fc100ee0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc3f0009930 tx=0x7fc3f002a420 comp rx=0 tx=0).stop 2024-09-19T07:09:22.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:22.867+0000 7fc40231a640 1 -- 172.21.15.148:0/3830991326 shutdown_connections 2024-09-19T07:09:22.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:22.867+0000 7fc40231a640 1 --2- 172.21.15.148:0/3830991326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3fc101420 0x7fc3fc10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:22.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:22.867+0000 7fc40231a640 1 --2- 172.21.15.148:0/3830991326 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3fc100a80 0x7fc3fc100ee0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:22.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:22.867+0000 7fc40231a640 1 --2- 172.21.15.148:0/3830991326 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3fc106a80 0x7fc3fc106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:22.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:22.867+0000 7fc40231a640 1 -- 172.21.15.148:0/3830991326 >> 172.21.15.148:0/3830991326 conn(0x7fc3fc0fc7a0 msgr2=0x7fc3fc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:22.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:22.867+0000 7fc40231a640 1 -- 172.21.15.148:0/3830991326 shutdown_connections 2024-09-19T07:09:22.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:22.867+0000 7fc40231a640 1 -- 172.21.15.148:0/3830991326 wait complete. 2024-09-19T07:09:22.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:22.867+0000 7fc40231a640 1 Processor -- start 2024-09-19T07:09:22.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:22.867+0000 7fc40231a640 1 -- start start 2024-09-19T07:09:22.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:22.868+0000 7fc40231a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3fc100a80 0x7fc3fc197380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:22.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:22.868+0000 7fc40231a640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3fc101420 0x7fc3fc1978c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:22.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:22.868+0000 7fc40231a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3fc106a80 0x7fc3fc19bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:22.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:22.868+0000 7fc40231a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc3fc110e80 con 0x7fc3fc106a80 2024-09-19T07:09:22.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:22.868+0000 7fc40231a640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc3fc110d00 con 0x7fc3fc101420 2024-09-19T07:09:22.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:22.868+0000 7fc40231a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc3fc111000 con 0x7fc3fc100a80 2024-09-19T07:09:22.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:22.868+0000 7fc4008b7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3fc106a80 0x7fc3fc19bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:22.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:22.868+0000 7fc4008b7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3fc106a80 0x7fc3fc19bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37818/0 (socket says 172.21.15.148:37818) 2024-09-19T07:09:22.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:22.868+0000 7fc4008b7640 1 -- 172.21.15.148:0/4073667023 learned_addr learned my addr 172.21.15.148:0/4073667023 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:09:22.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:22.868+0000 7fc3fb7fe640 1 --2- 172.21.15.148:0/4073667023 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3fc101420 0x7fc3fc1978c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:22.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:22.868+0000 7fc3fbfff640 1 --2- 172.21.15.148:0/4073667023 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3fc100a80 0x7fc3fc197380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:22.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:22.868+0000 7fc4008b7640 1 -- 172.21.15.148:0/4073667023 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3fc100a80 msgr2=0x7fc3fc197380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:22.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:22.868+0000 7fc4008b7640 1 --2- 172.21.15.148:0/4073667023 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3fc100a80 0x7fc3fc197380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:22.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:22.868+0000 7fc4008b7640 1 -- 172.21.15.148:0/4073667023 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3fc101420 msgr2=0x7fc3fc1978c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:22.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:22.868+0000 7fc4008b7640 1 --2- 172.21.15.148:0/4073667023 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3fc101420 0x7fc3fc1978c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:22.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:22.868+0000 7fc4008b7640 1 -- 172.21.15.148:0/4073667023 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3fc19c330 con 0x7fc3fc106a80 2024-09-19T07:09:22.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:22.868+0000 7fc4008b7640 1 --2- 172.21.15.148:0/4073667023 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3fc106a80 0x7fc3fc19bc50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc3f400cad0 tx=0x7fc3f400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:22.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:22.869+0000 7fc3f97fa640 1 -- 172.21.15.148:0/4073667023 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f400ae20 con 0x7fc3fc106a80 2024-09-19T07:09:22.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:22.869+0000 7fc40231a640 1 -- 172.21.15.148:0/4073667023 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3fc19c620 con 0x7fc3fc106a80 2024-09-19T07:09:22.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:22.869+0000 7fc3f97fa640 1 -- 172.21.15.148:0/4073667023 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3f4005020 con 0x7fc3fc106a80 2024-09-19T07:09:22.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:22.869+0000 7fc3f97fa640 1 -- 172.21.15.148:0/4073667023 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f400f6b0 con 0x7fc3fc106a80 2024-09-19T07:09:22.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:22.869+0000 7fc40231a640 1 -- 172.21.15.148:0/4073667023 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3fc1a3f00 con 0x7fc3fc106a80 2024-09-19T07:09:22.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:22.870+0000 7fc40231a640 1 -- 172.21.15.148:0/4073667023 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3fc100ee0 con 0x7fc3fc106a80 2024-09-19T07:09:22.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:22.871+0000 7fc3f97fa640 1 -- 172.21.15.148:0/4073667023 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fc3f40051d0 con 0x7fc3fc106a80 2024-09-19T07:09:22.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:22.871+0000 7fc3f97fa640 1 --2- 172.21.15.148:0/4073667023 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fc3e40a3240 0x7fc3e40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:22.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:22.872+0000 7fc3fbfff640 1 --2- 172.21.15.148:0/4073667023 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fc3e40a3240 0x7fc3e40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:22.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:22.872+0000 7fc3f97fa640 1 -- 172.21.15.148:0/4073667023 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7fc3f40cfaa0 con 0x7fc3fc106a80 2024-09-19T07:09:22.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:22.872+0000 7fc3fbfff640 1 --2- 172.21.15.148:0/4073667023 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fc3e40a3240 0x7fc3e40a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec0058c0 tx=0x7fc3ec00a250 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:22.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:22.875+0000 7fc3f97fa640 1 -- 172.21.15.148:0/4073667023 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc3f4014030 con 0x7fc3fc106a80 2024-09-19T07:09:23.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:23.046+0000 7fc40231a640 1 -- 172.21.15.148:0/4073667023 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc3fc109050 con 0x7fc3fc106a80 2024-09-19T07:09:23.047 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:22 smithi148 ceph-mon[31180]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T07:09:23.047 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:22 smithi148 ceph-mon[31180]: Cluster is now healthy 2024-09-19T07:09:23.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:23.047+0000 7fc3f97fa640 1 -- 172.21.15.148:0/4073667023 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+22374 (secure 0 0 0) 0x7fc3f409c2c0 con 0x7fc3fc106a80 2024-09-19T07:09:23.048 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:09:23.048 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":78,"fsid":"eae8a4a8-7654-11ef-bceb-c7b262605968","created":"2024-09-19T07:01:47.891210+0000","modified":"2024-09-19T07:09:19.543152+0000","last_up_change":"2024-09-19T07:08:30.785262+0000","last_in_change":"2024-09-19T07:08:07.001808+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:04:49.313270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T07:09:15.840600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T07:09:17.690782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7b854fad-d5a3-43e3-862e-7a0e8f243c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6803","nonce":512186330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6805","nonce":512186330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6809","nonce":512186330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6807","nonce":512186330}]},"public_addr":"172.21.15.148:6803/512186330","cluster_addr":"172.21.15.148:6805/512186330","heartbeat_back_addr":"172.21.15.148:6809/512186330","heartbeat_front_addr":"172.21.15.148:6807/512186330","state":["exists","up"]},{"osd":1,"uuid":"61b26278-f4db-40f0-97b9-c12a6ef1cd06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6801","nonce":2433984552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6803","nonce":2433984552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6807","nonce":2433984552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6805","nonce":2433984552}]},"public_addr":"172.21.15.165:6801/2433984552","cluster_addr":"172.21.15.165:6803/2433984552","heartbeat_back_addr":"172.21.15.165:6807/2433984552","heartbeat_front_addr":"172.21.15.165:6805/2433984552","state":["exists","up"]},{"osd":2,"uuid":"06620bbc-cdb5-4afc-8122-0bb3126630f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6801","nonce":3048365223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6803","nonce":3048365223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6807","nonce":3048365223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6805","nonce":3048365223}]},"public_addr":"172.21.15.179:6801/3048365223","cluster_addr":"172.21.15.179:6803/3048365223","heartbeat_back_addr":"172.21.15.179:6807/3048365223","heartbeat_front_addr":"172.21.15.179:6805/3048365223","state":["exists","up"]},{"osd":3,"uuid":"d7df45d4-5ef1-4f66-84a7-f61b8756c0c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6811","nonce":3662789091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6813","nonce":3662789091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6817","nonce":3662789091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6815","nonce":3662789091}]},"public_addr":"172.21.15.148:6811/3662789091","cluster_addr":"172.21.15.148:6813/3662789091","heartbeat_back_addr":"172.21.15.148:6817/3662789091","heartbeat_front_addr":"172.21.15.148:6815/3662789091","state":["exists","up"]},{"osd":4,"uuid":"5cfd359b-a8d2-4bdc-858f-087d26e0869c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6809","nonce":3082550323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6811","nonce":3082550323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6815","nonce":3082550323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6813","nonce":3082550323}]},"public_addr":"172.21.15.165:6809/3082550323","cluster_addr":"172.21.15.165:6811/3082550323","heartbeat_back_addr":"172.21.15.165:6815/3082550323","heartbeat_front_addr":"172.21.15.165:6813/3082550323","state":["exists","up"]},{"osd":5,"uuid":"8295e69b-87fe-4403-bb2e-d9dd42e2f398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6809","nonce":2125213751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6811","nonce":2125213751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6815","nonce":2125213751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6813","nonce":2125213751}]},"public_addr":"172.21.15.179:6809/2125213751","cluster_addr":"172.21.15.179:6811/2125213751","heartbeat_back_addr":"172.21.15.179:6815/2125213751","heartbeat_front_addr":"172.21.15.179:6813/2125213751","state":["exists","up"]},{"osd":6,"uuid":"4ce38d1a-06d3-4606-b00d-aa1ff977025f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6819","nonce":2178980310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6821","nonce":2178980310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6825","nonce":2178980310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6823","nonce":2178980310}]},"public_addr":"172.21.15.148:6819/2178980310","cluster_addr":"172.21.15.148:6821/2178980310","heartbeat_back_addr":"172.21.15.148:6825/2178980310","heartbeat_front_addr":"172.21.15.148:6823/2178980310","state":["exists","up"]},{"osd":7,"uuid":"9e68e2b2-9838-4ec0-b473-24f2434695ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6817","nonce":3961600099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6819","nonce":3961600099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6823","nonce":3961600099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6821","nonce":3961600099}]},"public_addr":"172.21.15.165:6817/3961600099","cluster_addr":"172.21.15.165:6819/3961600099","heartbeat_back_addr":"172.21.15.165:6823/3961600099","heartbeat_front_addr":"172.21.15.165:6821/3961600099","state":["exists","up"]},{"osd":8,"uuid":"297acce6-d3c7-4e1a-bf87-be093de51a6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6817","nonce":3642931467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6819","nonce":3642931467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6823","nonce":3642931467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6821","nonce":3642931467}]},"public_addr":"172.21.15.179:6817/3642931467","cluster_addr":"172.21.15.179:6819/3642931467","heartbeat_back_addr":"172.21.15.179:6823/3642931467","heartbeat_front_addr":"172.21.15.179:6821/3642931467","state":["exists","up"]},{"osd":9,"uuid":"ef488c5e-5353-4695-99dd-5b74ade436d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6827","nonce":3135409630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6829","nonce":3135409630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6833","nonce":3135409630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6831","nonce":3135409630}]},"public_addr":"172.21.15.148:6827/3135409630","cluster_addr":"172.21.15.148:6829/3135409630","heartbeat_back_addr":"172.21.15.148:6833/3135409630","heartbeat_front_addr":"172.21.15.148:6831/3135409630","state":["exists","up"]},{"osd":10,"uuid":"7a9f0379-1199-4266-910c-8d1d313d39e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6825","nonce":3554110731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6827","nonce":3554110731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6831","nonce":3554110731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6829","nonce":3554110731}]},"public_addr":"172.21.15.165:6825/3554110731","cluster_addr":"172.21.15.165:6827/3554110731","heartbeat_back_addr":"172.21.15.165:6831/3554110731","heartbeat_front_addr":"172.21.15.165:6829/3554110731","state":["exists","up"]},{"osd":11,"uuid":"eede97e9-5685-4603-806e-7078c6940536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6825","nonce":2026109940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6827","nonce":2026109940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6831","nonce":2026109940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6829","nonce":2026109940}]},"public_addr":"172.21.15.179:6825/2026109940","cluster_addr":"172.21.15.179:6827/2026109940","heartbeat_back_addr":"172.21.15.179:6831/2026109940","heartbeat_front_addr":"172.21.15.179:6829/2026109940","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:03:56.291685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:21.419682+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:46.377012+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:11.484234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:36.723101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:06:00.294617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:06:25.147230+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:06:49.318576+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:07:13.896399+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:07:38.930999+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:08:03.803463+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:08:28.731343+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.148:0/3534559227":"2024-09-20T07:02:37.007183+0000","172.21.15.148:0/1958388906":"2024-09-20T07:02:37.007183+0000","172.21.15.148:0/1922521135":"2024-09-20T07:02:37.007183+0000","172.21.15.148:6801/1949849385":"2024-09-20T07:02:37.007183+0000","172.21.15.148:6800/1949849385":"2024-09-20T07:02:37.007183+0000","172.21.15.148:6800/2161746152":"2024-09-20T07:02:14.557425+0000","172.21.15.148:6801/2161746152":"2024-09-20T07:02:14.557425+0000","172.21.15.148:0/1480486619":"2024-09-20T07:02:14.557425+0000","172.21.15.148:0/174481494":"2024-09-20T07:02:14.557425+0000","172.21.15.148:0/1114469409":"2024-09-20T07:02:14.557425+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T07:09:23.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:23.049+0000 7fc40231a640 1 -- 172.21.15.148:0/4073667023 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fc3e40a3240 msgr2=0x7fc3e40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:23.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:23.049+0000 7fc40231a640 1 --2- 172.21.15.148:0/4073667023 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fc3e40a3240 0x7fc3e40a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec0058c0 tx=0x7fc3ec00a250 comp rx=0 tx=0).stop 2024-09-19T07:09:23.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:23.049+0000 7fc40231a640 1 -- 172.21.15.148:0/4073667023 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3fc106a80 msgr2=0x7fc3fc19bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:23.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:23.049+0000 7fc40231a640 1 --2- 172.21.15.148:0/4073667023 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3fc106a80 0x7fc3fc19bc50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc3f400cad0 tx=0x7fc3f400cf90 comp rx=0 tx=0).stop 2024-09-19T07:09:23.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:23.049+0000 7fc40231a640 1 -- 172.21.15.148:0/4073667023 shutdown_connections 2024-09-19T07:09:23.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:23.049+0000 7fc40231a640 1 --2- 172.21.15.148:0/4073667023 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fc3e40a3240 0x7fc3e40a5700 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:23.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:23.049+0000 7fc40231a640 1 --2- 172.21.15.148:0/4073667023 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3fc106a80 0x7fc3fc19bc50 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:23.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:23.049+0000 7fc40231a640 1 --2- 172.21.15.148:0/4073667023 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3fc101420 0x7fc3fc1978c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:23.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:23.049+0000 7fc40231a640 1 --2- 172.21.15.148:0/4073667023 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3fc100a80 0x7fc3fc197380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:23.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:23.049+0000 7fc40231a640 1 -- 172.21.15.148:0/4073667023 >> 172.21.15.148:0/4073667023 conn(0x7fc3fc0fc7a0 msgr2=0x7fc3fc0fcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:23.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:23.049+0000 7fc40231a640 1 -- 172.21.15.148:0/4073667023 shutdown_connections 2024-09-19T07:09:23.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:23.049+0000 7fc40231a640 1 -- 172.21.15.148:0/4073667023 wait complete. 2024-09-19T07:09:23.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:22 smithi179 ceph-mon[35716]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T07:09:23.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:22 smithi179 ceph-mon[35716]: Cluster is now healthy 2024-09-19T07:09:23.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:22 smithi165 ceph-mon[35326]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T07:09:23.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:22 smithi165 ceph-mon[35326]: Cluster is now healthy 2024-09-19T07:09:23.791 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-19T07:09:24.043 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:09:24.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:23 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/4073667023' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:09:24.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:23 smithi148 ceph-mon[31180]: pgmap v271: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 6 op/s 2024-09-19T07:09:24.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:23 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/4073667023' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:09:24.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:23 smithi179 ceph-mon[35716]: pgmap v271: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 6 op/s 2024-09-19T07:09:24.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:23 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/4073667023' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:09:24.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:23 smithi165 ceph-mon[35326]: pgmap v271: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 6 op/s 2024-09-19T07:09:24.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.528+0000 7f66b24bf640 1 -- 172.21.15.148:0/246124790 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f66ac101dd0 msgr2=0x7f66ac1021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:24.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.528+0000 7f66b24bf640 1 --2- 172.21.15.148:0/246124790 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f66ac101dd0 0x7f66ac1021b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f669c009900 tx=0x7f669c02a410 comp rx=0 tx=0).stop 2024-09-19T07:09:24.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.528+0000 7f66b24bf640 1 -- 172.21.15.148:0/246124790 shutdown_connections 2024-09-19T07:09:24.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.528+0000 7f66b24bf640 1 --2- 172.21.15.148:0/246124790 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f66ac106f00 0x7f66ac10ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:24.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.528+0000 7f66b24bf640 1 --2- 172.21.15.148:0/246124790 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66ac102780 0x7f66ac1067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:24.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.528+0000 7f66b24bf640 1 --2- 172.21.15.148:0/246124790 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f66ac101dd0 0x7f66ac1021b0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:24.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.528+0000 7f66b24bf640 1 -- 172.21.15.148:0/246124790 >> 172.21.15.148:0/246124790 conn(0x7f66ac0fd8b0 msgr2=0x7f66ac0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:24.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.528+0000 7f66b24bf640 1 -- 172.21.15.148:0/246124790 shutdown_connections 2024-09-19T07:09:24.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.528+0000 7f66b24bf640 1 -- 172.21.15.148:0/246124790 wait complete. 2024-09-19T07:09:24.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.529+0000 7f66b24bf640 1 Processor -- start 2024-09-19T07:09:24.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.529+0000 7f66b24bf640 1 -- start start 2024-09-19T07:09:24.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.529+0000 7f66b24bf640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f66ac101dd0 0x7f66ac19a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:24.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.529+0000 7f66b24bf640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f66ac102780 0x7f66ac19abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:24.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.529+0000 7f66b24bf640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66ac106f00 0x7f66ac19ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:24.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.529+0000 7f66b24bf640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f66ac111f70 con 0x7f66ac101dd0 2024-09-19T07:09:24.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.529+0000 7f66b24bf640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f66ac111df0 con 0x7f66ac102780 2024-09-19T07:09:24.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.529+0000 7f66b24bf640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f66ac1120f0 con 0x7f66ac106f00 2024-09-19T07:09:24.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.529+0000 7f66abfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f66ac101dd0 0x7f66ac19a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:24.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.529+0000 7f66abfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f66ac101dd0 0x7f66ac19a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49818/0 (socket says 172.21.15.148:49818) 2024-09-19T07:09:24.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.529+0000 7f66abfff640 1 -- 172.21.15.148:0/1962918302 learned_addr learned my addr 172.21.15.148:0/1962918302 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:09:24.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.529+0000 7f66abfff640 1 -- 172.21.15.148:0/1962918302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66ac106f00 msgr2=0x7f66ac19ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:24.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.529+0000 7f66abfff640 1 --2- 172.21.15.148:0/1962918302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66ac106f00 0x7f66ac19ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:24.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.529+0000 7f66abfff640 1 -- 172.21.15.148:0/1962918302 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f66ac102780 msgr2=0x7f66ac19abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:24.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.529+0000 7f66abfff640 1 --2- 172.21.15.148:0/1962918302 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f66ac102780 0x7f66ac19abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:24.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.529+0000 7f66abfff640 1 -- 172.21.15.148:0/1962918302 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66ac19f630 con 0x7f66ac101dd0 2024-09-19T07:09:24.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.529+0000 7f66abfff640 1 --2- 172.21.15.148:0/1962918302 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f66ac101dd0 0x7f66ac19a680 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f669c004770 tx=0x7f669c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:24.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.530+0000 7f66a9ffb640 1 -- 172.21.15.148:0/1962918302 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f669c03f070 con 0x7f66ac101dd0 2024-09-19T07:09:24.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.530+0000 7f66b24bf640 1 -- 172.21.15.148:0/1962918302 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66ac19f8c0 con 0x7f66ac101dd0 2024-09-19T07:09:24.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.530+0000 7f66a9ffb640 1 -- 172.21.15.148:0/1962918302 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f669c031ca0 con 0x7f66ac101dd0 2024-09-19T07:09:24.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.530+0000 7f66a9ffb640 1 -- 172.21.15.148:0/1962918302 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f669c035030 con 0x7f66ac101dd0 2024-09-19T07:09:24.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.530+0000 7f66b24bf640 1 -- 172.21.15.148:0/1962918302 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66ac1a7200 con 0x7f66ac101dd0 2024-09-19T07:09:24.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.531+0000 7f66b24bf640 1 -- 172.21.15.148:0/1962918302 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66ac1021b0 con 0x7f66ac101dd0 2024-09-19T07:09:24.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.532+0000 7f66a9ffb640 1 -- 172.21.15.148:0/1962918302 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f669c042070 con 0x7f66ac101dd0 2024-09-19T07:09:24.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.532+0000 7f66a9ffb640 1 --2- 172.21.15.148:0/1962918302 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f66980a3240 0x7f66980a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:24.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.533+0000 7f66a3fff640 1 --2- 172.21.15.148:0/1962918302 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f66980a3240 0x7f66980a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:24.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.533+0000 7f66a9ffb640 1 -- 172.21.15.148:0/1962918302 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7f669c0efcf0 con 0x7f66ac101dd0 2024-09-19T07:09:24.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.533+0000 7f66a3fff640 1 --2- 172.21.15.148:0/1962918302 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f66980a3240 0x7f66980a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6694005fd0 tx=0x7f6694005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:24.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.537+0000 7f66a9ffb640 1 -- 172.21.15.148:0/1962918302 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f669c0f4070 con 0x7f66ac101dd0 2024-09-19T07:09:24.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.739+0000 7f66b24bf640 1 -- 172.21.15.148:0/1962918302 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f66ac1a7500 con 0x7f66ac101dd0 2024-09-19T07:09:24.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.943+0000 7f66a9ffb640 1 -- 172.21.15.148:0/1962918302 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f669c0bcb60 con 0x7f66ac101dd0 2024-09-19T07:09:24.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.945+0000 7f66b24bf640 1 -- 172.21.15.148:0/1962918302 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f66980a3240 msgr2=0x7f66980a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:24.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.945+0000 7f66b24bf640 1 --2- 172.21.15.148:0/1962918302 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f66980a3240 0x7f66980a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6694005fd0 tx=0x7f6694005850 comp rx=0 tx=0).stop 2024-09-19T07:09:24.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.945+0000 7f66b24bf640 1 -- 172.21.15.148:0/1962918302 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f66ac101dd0 msgr2=0x7f66ac19a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:24.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.945+0000 7f66b24bf640 1 --2- 172.21.15.148:0/1962918302 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f66ac101dd0 0x7f66ac19a680 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f669c004770 tx=0x7f669c003c10 comp rx=0 tx=0).stop 2024-09-19T07:09:24.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.945+0000 7f66b24bf640 1 -- 172.21.15.148:0/1962918302 shutdown_connections 2024-09-19T07:09:24.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.945+0000 7f66b24bf640 1 --2- 172.21.15.148:0/1962918302 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f66980a3240 0x7f66980a5700 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:24.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.945+0000 7f66b24bf640 1 --2- 172.21.15.148:0/1962918302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66ac106f00 0x7f66ac19ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:24.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.945+0000 7f66b24bf640 1 --2- 172.21.15.148:0/1962918302 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f66ac102780 0x7f66ac19abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:24.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.945+0000 7f66b24bf640 1 --2- 172.21.15.148:0/1962918302 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f66ac101dd0 0x7f66ac19a680 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:24.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.945+0000 7f66b24bf640 1 -- 172.21.15.148:0/1962918302 >> 172.21.15.148:0/1962918302 conn(0x7f66ac0fd8b0 msgr2=0x7f66ac0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:24.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.946+0000 7f66b24bf640 1 -- 172.21.15.148:0/1962918302 shutdown_connections 2024-09-19T07:09:24.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:24.946+0000 7f66b24bf640 1 -- 172.21.15.148:0/1962918302 wait complete. 2024-09-19T07:09:25.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:24 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/1962918302' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T07:09:25.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:24 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/1962918302' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T07:09:25.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:24 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/1962918302' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T07:09:25.709 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-09-19T07:09:25.710 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-09-19T07:09:25.955 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:09:26.200 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:25 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/1962918302' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T07:09:26.200 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:25 smithi148 ceph-mon[31180]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T07:09:26.200 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:25 smithi148 ceph-mon[31180]: pgmap v272: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-19T07:09:26.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:25 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/1962918302' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T07:09:26.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:25 smithi179 ceph-mon[35716]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T07:09:26.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:25 smithi179 ceph-mon[35716]: pgmap v272: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-19T07:09:26.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.374+0000 7f5741849640 1 -- 172.21.15.148:0/3223724320 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f573c106a90 msgr2=0x7f573c106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:26.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.374+0000 7f5741849640 1 --2- 172.21.15.148:0/3223724320 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f573c106a90 0x7f573c106e70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f572c009930 tx=0x7f572c02a420 comp rx=0 tx=0).stop 2024-09-19T07:09:26.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.375+0000 7f5741849640 1 -- 172.21.15.148:0/3223724320 shutdown_connections 2024-09-19T07:09:26.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.375+0000 7f5741849640 1 --2- 172.21.15.148:0/3223724320 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f573c101430 0x7f573c10d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:26.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.375+0000 7f5741849640 1 --2- 172.21.15.148:0/3223724320 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f573c100a90 0x7f573c100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:26.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.375+0000 7f5741849640 1 --2- 172.21.15.148:0/3223724320 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f573c106a90 0x7f573c106e70 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:26.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.375+0000 7f5741849640 1 -- 172.21.15.148:0/3223724320 >> 172.21.15.148:0/3223724320 conn(0x7f573c0fc7d0 msgr2=0x7f573c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:26.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.375+0000 7f5741849640 1 -- 172.21.15.148:0/3223724320 shutdown_connections 2024-09-19T07:09:26.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.375+0000 7f5741849640 1 -- 172.21.15.148:0/3223724320 wait complete. 2024-09-19T07:09:26.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.375+0000 7f5741849640 1 Processor -- start 2024-09-19T07:09:26.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.375+0000 7f5741849640 1 -- start start 2024-09-19T07:09:26.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.375+0000 7f5741849640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f573c100a90 0x7f573c1a4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:26.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.375+0000 7f5741849640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f573c101430 0x7f573c1a4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:26.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.375+0000 7f5741849640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f573c106a90 0x7f573c19e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:26.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.375+0000 7f5741849640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f573c118630 con 0x7f573c100a90 2024-09-19T07:09:26.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.376+0000 7f5741849640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f573c1184b0 con 0x7f573c106a90 2024-09-19T07:09:26.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.376+0000 7f5741849640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f573c1187b0 con 0x7f573c101430 2024-09-19T07:09:26.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.376+0000 7f573affd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f573c100a90 0x7f573c1a4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:26.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.376+0000 7f573affd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f573c100a90 0x7f573c1a4830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49836/0 (socket says 172.21.15.148:49836) 2024-09-19T07:09:26.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.376+0000 7f573affd640 1 -- 172.21.15.148:0/610710365 learned_addr learned my addr 172.21.15.148:0/610710365 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:09:26.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.376+0000 7f573b7fe640 1 --2- 172.21.15.148:0/610710365 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f573c106a90 0x7f573c19e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:26.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.376+0000 7f5733fff640 1 --2- 172.21.15.148:0/610710365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f573c101430 0x7f573c1a4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:26.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.376+0000 7f573affd640 1 -- 172.21.15.148:0/610710365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f573c101430 msgr2=0x7f573c1a4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:26.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.376+0000 7f573affd640 1 --2- 172.21.15.148:0/610710365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f573c101430 0x7f573c1a4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:26.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.376+0000 7f573affd640 1 -- 172.21.15.148:0/610710365 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f573c106a90 msgr2=0x7f573c19e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:26.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.376+0000 7f573affd640 1 --2- 172.21.15.148:0/610710365 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f573c106a90 0x7f573c19e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:26.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.376+0000 7f573affd640 1 -- 172.21.15.148:0/610710365 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f573c19f120 con 0x7f573c100a90 2024-09-19T07:09:26.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.376+0000 7f573affd640 1 --2- 172.21.15.148:0/610710365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f573c100a90 0x7f573c1a4830 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f572c009a50 tx=0x7f572c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:26.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.376+0000 7f5740847640 1 -- 172.21.15.148:0/610710365 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f572c03f030 con 0x7f573c100a90 2024-09-19T07:09:26.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.376+0000 7f5741849640 1 -- 172.21.15.148:0/610710365 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f573c19f3b0 con 0x7f573c100a90 2024-09-19T07:09:26.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.376+0000 7f5740847640 1 -- 172.21.15.148:0/610710365 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f572c003ce0 con 0x7f573c100a90 2024-09-19T07:09:26.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.376+0000 7f5740847640 1 -- 172.21.15.148:0/610710365 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f572c035070 con 0x7f573c100a90 2024-09-19T07:09:26.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.376+0000 7f5741849640 1 -- 172.21.15.148:0/610710365 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f573c1ab700 con 0x7f573c100a90 2024-09-19T07:09:26.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.377+0000 7f5741849640 1 -- 172.21.15.148:0/610710365 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f573c100f70 con 0x7f573c100a90 2024-09-19T07:09:26.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.378+0000 7f5740847640 1 -- 172.21.15.148:0/610710365 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f572c042030 con 0x7f573c100a90 2024-09-19T07:09:26.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.379+0000 7f5740847640 1 --2- 172.21.15.148:0/610710365 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f57280a3240 0x7f57280a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:26.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.379+0000 7f5733fff640 1 --2- 172.21.15.148:0/610710365 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f57280a3240 0x7f57280a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:26.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.379+0000 7f5740847640 1 -- 172.21.15.148:0/610710365 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7f572c0efd60 con 0x7f573c100a90 2024-09-19T07:09:26.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.380+0000 7f5733fff640 1 --2- 172.21.15.148:0/610710365 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f57280a3240 0x7f57280a5700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f573c0fef00 tx=0x7f5724008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:26.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:25 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/1962918302' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T07:09:26.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:25 smithi165 ceph-mon[35326]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T07:09:26.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:25 smithi165 ceph-mon[35326]: pgmap v272: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-19T07:09:26.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.383+0000 7f5740847640 1 -- 172.21.15.148:0/610710365 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f572c0bcbd0 con 0x7f573c100a90 2024-09-19T07:09:26.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.589+0000 7f5741849640 1 -- 172.21.15.148:0/610710365 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f573c109000 con 0x7f573c100a90 2024-09-19T07:09:26.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.955+0000 7f5740847640 1 -- 172.21.15.148:0/610710365 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7f572c0bc4d0 con 0x7f573c100a90 2024-09-19T07:09:26.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.958+0000 7f5741849640 1 -- 172.21.15.148:0/610710365 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f57280a3240 msgr2=0x7f57280a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:26.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.958+0000 7f5741849640 1 --2- 172.21.15.148:0/610710365 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f57280a3240 0x7f57280a5700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f573c0fef00 tx=0x7f5724008040 comp rx=0 tx=0).stop 2024-09-19T07:09:26.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.958+0000 7f5741849640 1 -- 172.21.15.148:0/610710365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f573c100a90 msgr2=0x7f573c1a4830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:26.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.958+0000 7f5741849640 1 --2- 172.21.15.148:0/610710365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f573c100a90 0x7f573c1a4830 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f572c009a50 tx=0x7f572c004270 comp rx=0 tx=0).stop 2024-09-19T07:09:26.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.958+0000 7f5741849640 1 -- 172.21.15.148:0/610710365 shutdown_connections 2024-09-19T07:09:26.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.958+0000 7f5741849640 1 --2- 172.21.15.148:0/610710365 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f57280a3240 0x7f57280a5700 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:26.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.958+0000 7f5741849640 1 --2- 172.21.15.148:0/610710365 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f573c106a90 0x7f573c19e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:26.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.958+0000 7f5741849640 1 --2- 172.21.15.148:0/610710365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f573c101430 0x7f573c1a4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:26.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.958+0000 7f5741849640 1 --2- 172.21.15.148:0/610710365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f573c100a90 0x7f573c1a4830 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:26.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.958+0000 7f5741849640 1 -- 172.21.15.148:0/610710365 >> 172.21.15.148:0/610710365 conn(0x7f573c0fc7d0 msgr2=0x7f573c0fd1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:26.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.958+0000 7f5741849640 1 -- 172.21.15.148:0/610710365 shutdown_connections 2024-09-19T07:09:26.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:26.958+0000 7f5741849640 1 -- 172.21.15.148:0/610710365 wait complete. 2024-09-19T07:09:27.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:26 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/610710365' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-19T07:09:27.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:26 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/610710365' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-19T07:09:27.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:26 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/610710365' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-19T07:09:27.659 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-19T07:09:27.917 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:09:28.209 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:27 smithi148 ceph-mon[31180]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T07:09:28.209 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:27 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/610710365' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-19T07:09:28.209 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:27 smithi148 ceph-mon[31180]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T07:09:28.209 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:27 smithi148 ceph-mon[31180]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T07:09:28.209 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:27 smithi148 ceph-mon[31180]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-09-19T07:09:28.209 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:27 smithi148 ceph-mon[31180]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-09-19T07:09:28.209 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:27 smithi148 ceph-mon[31180]: pgmap v273: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-19T07:09:28.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:27 smithi179 ceph-mon[35716]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T07:09:28.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:27 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/610710365' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-19T07:09:28.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:27 smithi179 ceph-mon[35716]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T07:09:28.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:27 smithi179 ceph-mon[35716]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T07:09:28.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:27 smithi179 ceph-mon[35716]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-09-19T07:09:28.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:27 smithi179 ceph-mon[35716]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-09-19T07:09:28.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:27 smithi179 ceph-mon[35716]: pgmap v273: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-19T07:09:28.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:27 smithi165 ceph-mon[35326]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T07:09:28.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:27 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/610710365' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-19T07:09:28.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:27 smithi165 ceph-mon[35326]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T07:09:28.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:27 smithi165 ceph-mon[35326]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T07:09:28.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:27 smithi165 ceph-mon[35326]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-09-19T07:09:28.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:27 smithi165 ceph-mon[35326]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-09-19T07:09:28.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:27 smithi165 ceph-mon[35326]: pgmap v273: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-19T07:09:28.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.416+0000 7fa7c267d640 1 -- 172.21.15.148:0/623025861 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7bc100a80 msgr2=0x7fa7bc100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:28.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.416+0000 7fa7c267d640 1 --2- 172.21.15.148:0/623025861 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7bc100a80 0x7fa7bc100ee0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa7b0009930 tx=0x7fa7b002a420 comp rx=0 tx=0).stop 2024-09-19T07:09:28.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.416+0000 7fa7c267d640 1 -- 172.21.15.148:0/623025861 shutdown_connections 2024-09-19T07:09:28.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.416+0000 7fa7c267d640 1 --2- 172.21.15.148:0/623025861 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7bc101420 0x7fa7bc10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:28.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.416+0000 7fa7c267d640 1 --2- 172.21.15.148:0/623025861 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7bc100a80 0x7fa7bc100ee0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:28.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.416+0000 7fa7c267d640 1 --2- 172.21.15.148:0/623025861 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7bc106a80 0x7fa7bc106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:28.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.416+0000 7fa7c267d640 1 -- 172.21.15.148:0/623025861 >> 172.21.15.148:0/623025861 conn(0x7fa7bc0fc7a0 msgr2=0x7fa7bc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:28.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.416+0000 7fa7c267d640 1 -- 172.21.15.148:0/623025861 shutdown_connections 2024-09-19T07:09:28.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.416+0000 7fa7c267d640 1 -- 172.21.15.148:0/623025861 wait complete. 2024-09-19T07:09:28.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.417+0000 7fa7c267d640 1 Processor -- start 2024-09-19T07:09:28.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.417+0000 7fa7c267d640 1 -- start start 2024-09-19T07:09:28.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.417+0000 7fa7c267d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7bc100a80 0x7fa7bc0fccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:28.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.417+0000 7fa7c267d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7bc101420 0x7fa7bc0fd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:28.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.417+0000 7fa7c267d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7bc106a80 0x7fa7bc0fd770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:28.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.417+0000 7fa7c267d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc110ea0 con 0x7fa7bc100a80 2024-09-19T07:09:28.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.417+0000 7fa7c267d640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc110d20 con 0x7fa7bc106a80 2024-09-19T07:09:28.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.417+0000 7fa7c267d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc111020 con 0x7fa7bc101420 2024-09-19T07:09:28.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.417+0000 7fa7bbfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7bc100a80 0x7fa7bc0fccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:28.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.417+0000 7fa7bbfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7bc100a80 0x7fa7bc0fccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49860/0 (socket says 172.21.15.148:49860) 2024-09-19T07:09:28.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.417+0000 7fa7bbfff640 1 -- 172.21.15.148:0/2360177374 learned_addr learned my addr 172.21.15.148:0/2360177374 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:09:28.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.417+0000 7fa7bb7fe640 1 --2- 172.21.15.148:0/2360177374 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7bc101420 0x7fa7bc0fd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:28.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.417+0000 7fa7c0c1a640 1 --2- 172.21.15.148:0/2360177374 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7bc106a80 0x7fa7bc0fd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:28.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.418+0000 7fa7bbfff640 1 -- 172.21.15.148:0/2360177374 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7bc101420 msgr2=0x7fa7bc0fd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:28.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.418+0000 7fa7bbfff640 1 --2- 172.21.15.148:0/2360177374 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7bc101420 0x7fa7bc0fd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:28.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.418+0000 7fa7bbfff640 1 -- 172.21.15.148:0/2360177374 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7bc106a80 msgr2=0x7fa7bc0fd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:28.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.418+0000 7fa7bbfff640 1 --2- 172.21.15.148:0/2360177374 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7bc106a80 0x7fa7bc0fd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:28.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.418+0000 7fa7bbfff640 1 -- 172.21.15.148:0/2360177374 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7bc1a6900 con 0x7fa7bc100a80 2024-09-19T07:09:28.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.418+0000 7fa7c0c1a640 1 --2- 172.21.15.148:0/2360177374 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7bc106a80 0x7fa7bc0fd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:09:28.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.418+0000 7fa7bbfff640 1 --2- 172.21.15.148:0/2360177374 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7bc100a80 0x7fa7bc0fccf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac00c920 tx=0x7fa7ac00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:28.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.418+0000 7fa7b97fa640 1 -- 172.21.15.148:0/2360177374 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac007c70 con 0x7fa7bc100a80 2024-09-19T07:09:28.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.418+0000 7fa7b97fa640 1 -- 172.21.15.148:0/2360177374 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7ac007e10 con 0x7fa7bc100a80 2024-09-19T07:09:28.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.418+0000 7fa7b97fa640 1 -- 172.21.15.148:0/2360177374 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac018890 con 0x7fa7bc100a80 2024-09-19T07:09:28.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.418+0000 7fa7c267d640 1 -- 172.21.15.148:0/2360177374 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7bc1a6bf0 con 0x7fa7bc100a80 2024-09-19T07:09:28.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.418+0000 7fa7c267d640 1 -- 172.21.15.148:0/2360177374 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7bc1a7150 con 0x7fa7bc100a80 2024-09-19T07:09:28.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.419+0000 7fa7c267d640 1 -- 172.21.15.148:0/2360177374 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7bc100ee0 con 0x7fa7bc100a80 2024-09-19T07:09:28.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.420+0000 7fa7b97fa640 1 -- 172.21.15.148:0/2360177374 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fa7ac018a50 con 0x7fa7bc100a80 2024-09-19T07:09:28.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.421+0000 7fa7b97fa640 1 --2- 172.21.15.148:0/2360177374 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fa7a40a32c0 0x7fa7a40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:28.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.421+0000 7fa7bb7fe640 1 --2- 172.21.15.148:0/2360177374 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fa7a40a32c0 0x7fa7a40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:28.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.421+0000 7fa7b97fa640 1 -- 172.21.15.148:0/2360177374 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7fa7ac0cfbd0 con 0x7fa7bc100a80 2024-09-19T07:09:28.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.421+0000 7fa7bb7fe640 1 --2- 172.21.15.148:0/2360177374 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fa7a40a32c0 0x7fa7a40a5780 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa7b0009900 tx=0x7fa7b00058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:28.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.425+0000 7fa7b97fa640 1 -- 172.21.15.148:0/2360177374 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa7ac014030 con 0x7fa7bc100a80 2024-09-19T07:09:28.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.629+0000 7fa7c267d640 1 -- 172.21.15.148:0/2360177374 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fa7bc0fe220 con 0x7fa7bc100a80 2024-09-19T07:09:28.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.977+0000 7fa7b97fa640 1 -- 172.21.15.148:0/2360177374 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7fa7bc0fe220 con 0x7fa7bc100a80 2024-09-19T07:09:28.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.979+0000 7fa7c267d640 1 -- 172.21.15.148:0/2360177374 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fa7a40a32c0 msgr2=0x7fa7a40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:28.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.979+0000 7fa7c267d640 1 --2- 172.21.15.148:0/2360177374 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fa7a40a32c0 0x7fa7a40a5780 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa7b0009900 tx=0x7fa7b00058d0 comp rx=0 tx=0).stop 2024-09-19T07:09:28.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.979+0000 7fa7c267d640 1 -- 172.21.15.148:0/2360177374 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7bc100a80 msgr2=0x7fa7bc0fccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:28.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.979+0000 7fa7c267d640 1 --2- 172.21.15.148:0/2360177374 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7bc100a80 0x7fa7bc0fccf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac00c920 tx=0x7fa7ac00cde0 comp rx=0 tx=0).stop 2024-09-19T07:09:28.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.979+0000 7fa7c267d640 1 -- 172.21.15.148:0/2360177374 shutdown_connections 2024-09-19T07:09:28.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.979+0000 7fa7c267d640 1 --2- 172.21.15.148:0/2360177374 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fa7a40a32c0 0x7fa7a40a5780 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:28.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.979+0000 7fa7c267d640 1 --2- 172.21.15.148:0/2360177374 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7bc106a80 0x7fa7bc0fd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:28.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.979+0000 7fa7c267d640 1 --2- 172.21.15.148:0/2360177374 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7bc101420 0x7fa7bc0fd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:28.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.979+0000 7fa7c267d640 1 --2- 172.21.15.148:0/2360177374 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7bc100a80 0x7fa7bc0fccf0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:28.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.979+0000 7fa7c267d640 1 -- 172.21.15.148:0/2360177374 >> 172.21.15.148:0/2360177374 conn(0x7fa7bc0fc7a0 msgr2=0x7fa7bc06a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:28.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.980+0000 7fa7c267d640 1 -- 172.21.15.148:0/2360177374 shutdown_connections 2024-09-19T07:09:28.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:28.980+0000 7fa7c267d640 1 -- 172.21.15.148:0/2360177374 wait complete. 2024-09-19T07:09:29.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:28 smithi179 ceph-mon[35716]: mds.? [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] up:active 2024-09-19T07:09:29.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:28 smithi179 ceph-mon[35716]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T07:09:29.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:28 smithi179 ceph-mon[35716]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T07:09:29.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:28 smithi179 ceph-mon[35716]: Cluster is now healthy 2024-09-19T07:09:29.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:28 smithi179 ceph-mon[35716]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-09-19T07:09:29.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:28 smithi179 ceph-mon[35716]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-09-19T07:09:29.274 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:28 smithi179 ceph-mon[35716]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-19T07:09:29.274 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:28 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/2360177374' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T07:09:29.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:28 smithi148 ceph-mon[31180]: mds.? [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] up:active 2024-09-19T07:09:29.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:28 smithi148 ceph-mon[31180]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T07:09:29.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:28 smithi148 ceph-mon[31180]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T07:09:29.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:28 smithi148 ceph-mon[31180]: Cluster is now healthy 2024-09-19T07:09:29.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:28 smithi148 ceph-mon[31180]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-09-19T07:09:29.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:28 smithi148 ceph-mon[31180]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-09-19T07:09:29.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:28 smithi148 ceph-mon[31180]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-19T07:09:29.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:28 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/2360177374' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T07:09:29.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:28 smithi165 ceph-mon[35326]: mds.? [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] up:active 2024-09-19T07:09:29.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:28 smithi165 ceph-mon[35326]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T07:09:29.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:28 smithi165 ceph-mon[35326]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T07:09:29.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:28 smithi165 ceph-mon[35326]: Cluster is now healthy 2024-09-19T07:09:29.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:28 smithi165 ceph-mon[35326]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-09-19T07:09:29.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:28 smithi165 ceph-mon[35326]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-09-19T07:09:29.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:28 smithi165 ceph-mon[35326]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-19T07:09:29.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:28 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/2360177374' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T07:09:29.698 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-19T07:09:29.945 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:09:30.232 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:29 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/2360177374' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T07:09:30.233 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:29 smithi148 ceph-mon[31180]: mds.? [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] up:active 2024-09-19T07:09:30.233 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:29 smithi148 ceph-mon[31180]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-09-19T07:09:30.233 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:29 smithi148 ceph-mon[31180]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:09:30.233 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:29 smithi148 ceph-mon[31180]: pgmap v274: 97 pgs: 97 active+clean; 580 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-19T07:09:30.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:29 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/2360177374' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T07:09:30.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:29 smithi179 ceph-mon[35716]: mds.? [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] up:active 2024-09-19T07:09:30.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:29 smithi179 ceph-mon[35716]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-09-19T07:09:30.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:29 smithi179 ceph-mon[35716]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:09:30.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:29 smithi179 ceph-mon[35716]: pgmap v274: 97 pgs: 97 active+clean; 580 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-19T07:09:30.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:29 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/2360177374' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T07:09:30.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:29 smithi165 ceph-mon[35326]: mds.? [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] up:active 2024-09-19T07:09:30.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:29 smithi165 ceph-mon[35326]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-09-19T07:09:30.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:29 smithi165 ceph-mon[35326]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:09:30.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:29 smithi165 ceph-mon[35326]: pgmap v274: 97 pgs: 97 active+clean; 580 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-19T07:09:30.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.471+0000 7f9166f0a640 1 -- 172.21.15.148:0/616682080 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91601027a0 msgr2=0x7f91601067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:30.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.471+0000 7f9166f0a640 1 --2- 172.21.15.148:0/616682080 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91601027a0 0x7f91601067f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9150009900 tx=0x7f915002a410 comp rx=0 tx=0).stop 2024-09-19T07:09:30.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.471+0000 7f9166f0a640 1 -- 172.21.15.148:0/616682080 shutdown_connections 2024-09-19T07:09:30.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.471+0000 7f9166f0a640 1 --2- 172.21.15.148:0/616682080 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9160106f20 0x7f916010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:30.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.471+0000 7f9166f0a640 1 --2- 172.21.15.148:0/616682080 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91601027a0 0x7f91601067f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:30.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.471+0000 7f9166f0a640 1 --2- 172.21.15.148:0/616682080 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9160101df0 0x7f91601021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:30.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.471+0000 7f9166f0a640 1 -- 172.21.15.148:0/616682080 >> 172.21.15.148:0/616682080 conn(0x7f91600fd8b0 msgr2=0x7f91600ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:30.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.472+0000 7f9166f0a640 1 -- 172.21.15.148:0/616682080 shutdown_connections 2024-09-19T07:09:30.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.472+0000 7f9166f0a640 1 -- 172.21.15.148:0/616682080 wait complete. 2024-09-19T07:09:30.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.472+0000 7f9166f0a640 1 Processor -- start 2024-09-19T07:09:30.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.472+0000 7f9166f0a640 1 -- start start 2024-09-19T07:09:30.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.472+0000 7f9166f0a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9160101df0 0x7f91600744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:30.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.472+0000 7f9166f0a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91601027a0 0x7f9160074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:30.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.472+0000 7f9166f0a640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9160106f20 0x7f9160074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:30.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.472+0000 7f9166f0a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9160111fa0 con 0x7f91601027a0 2024-09-19T07:09:30.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.472+0000 7f9166f0a640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9160111e20 con 0x7f9160106f20 2024-09-19T07:09:30.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.472+0000 7f9166f0a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9160112120 con 0x7f9160101df0 2024-09-19T07:09:30.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.472+0000 7f9157fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91601027a0 0x7f9160074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:30.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.472+0000 7f9157fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91601027a0 0x7f9160074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49884/0 (socket says 172.21.15.148:49884) 2024-09-19T07:09:30.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.472+0000 7f9157fff640 1 -- 172.21.15.148:0/2271298673 learned_addr learned my addr 172.21.15.148:0/2271298673 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:09:30.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.473+0000 7f91654a7640 1 --2- 172.21.15.148:0/2271298673 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9160106f20 0x7f9160074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:30.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.473+0000 7f9157fff640 1 -- 172.21.15.148:0/2271298673 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9160101df0 msgr2=0x7f91600744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:30.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.473+0000 7f9164ca6640 1 --2- 172.21.15.148:0/2271298673 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9160101df0 0x7f91600744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:30.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.473+0000 7f9157fff640 1 --2- 172.21.15.148:0/2271298673 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9160101df0 0x7f91600744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:30.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.473+0000 7f9157fff640 1 -- 172.21.15.148:0/2271298673 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9160106f20 msgr2=0x7f9160074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:30.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.473+0000 7f9157fff640 1 --2- 172.21.15.148:0/2271298673 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9160106f20 0x7f9160074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:30.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.473+0000 7f9157fff640 1 -- 172.21.15.148:0/2271298673 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91601a6a00 con 0x7f91601027a0 2024-09-19T07:09:30.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.473+0000 7f9157fff640 1 --2- 172.21.15.148:0/2271298673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91601027a0 0x7f9160074a30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9150005ab0 tx=0x7f91500042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:30.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.473+0000 7f9155ffb640 1 -- 172.21.15.148:0/2271298673 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915003f030 con 0x7f91601027a0 2024-09-19T07:09:30.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.473+0000 7f9155ffb640 1 -- 172.21.15.148:0/2271298673 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9150003ce0 con 0x7f91601027a0 2024-09-19T07:09:30.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.473+0000 7f9166f0a640 1 -- 172.21.15.148:0/2271298673 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91601a6c90 con 0x7f91601027a0 2024-09-19T07:09:30.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.473+0000 7f9155ffb640 1 -- 172.21.15.148:0/2271298673 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9150035070 con 0x7f91601027a0 2024-09-19T07:09:30.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.473+0000 7f9166f0a640 1 -- 172.21.15.148:0/2271298673 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91601a7170 con 0x7f91601027a0 2024-09-19T07:09:30.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.474+0000 7f9166f0a640 1 -- 172.21.15.148:0/2271298673 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91601021d0 con 0x7f91601027a0 2024-09-19T07:09:30.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.475+0000 7f9155ffb640 1 -- 172.21.15.148:0/2271298673 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f9150042030 con 0x7f91601027a0 2024-09-19T07:09:30.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.476+0000 7f9155ffb640 1 --2- 172.21.15.148:0/2271298673 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f91480a3240 0x7f91480a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:30.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.476+0000 7f9164ca6640 1 --2- 172.21.15.148:0/2271298673 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f91480a3240 0x7f91480a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:30.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.476+0000 7f9155ffb640 1 -- 172.21.15.148:0/2271298673 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7f91500f0180 con 0x7f91601027a0 2024-09-19T07:09:30.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.477+0000 7f9164ca6640 1 --2- 172.21.15.148:0/2271298673 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f91480a3240 0x7f91480a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f915c00a810 tx=0x7f915c008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:30.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.480+0000 7f9155ffb640 1 -- 172.21.15.148:0/2271298673 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f91500bcff0 con 0x7f91601027a0 2024-09-19T07:09:30.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.683+0000 7f9166f0a640 1 -- 172.21.15.148:0/2271298673 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f916010a100 con 0x7f91601027a0 2024-09-19T07:09:30.991 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.990+0000 7f9155ffb640 1 -- 172.21.15.148:0/2271298673 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v24) ==== 115+0+0 (secure 0 0 0) 0x7f91500bc8f0 con 0x7f91601027a0 2024-09-19T07:09:30.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.994+0000 7f9166f0a640 1 -- 172.21.15.148:0/2271298673 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f91480a3240 msgr2=0x7f91480a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:30.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.994+0000 7f9166f0a640 1 --2- 172.21.15.148:0/2271298673 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f91480a3240 0x7f91480a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f915c00a810 tx=0x7f915c008040 comp rx=0 tx=0).stop 2024-09-19T07:09:30.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.994+0000 7f9166f0a640 1 -- 172.21.15.148:0/2271298673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91601027a0 msgr2=0x7f9160074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:30.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.994+0000 7f9166f0a640 1 --2- 172.21.15.148:0/2271298673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91601027a0 0x7f9160074a30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9150005ab0 tx=0x7f91500042f0 comp rx=0 tx=0).stop 2024-09-19T07:09:30.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.994+0000 7f9166f0a640 1 -- 172.21.15.148:0/2271298673 shutdown_connections 2024-09-19T07:09:30.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.994+0000 7f9166f0a640 1 --2- 172.21.15.148:0/2271298673 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f91480a3240 0x7f91480a5700 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:30.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.994+0000 7f9166f0a640 1 --2- 172.21.15.148:0/2271298673 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9160106f20 0x7f9160074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:30.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.994+0000 7f9166f0a640 1 --2- 172.21.15.148:0/2271298673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91601027a0 0x7f9160074a30 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:30.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.994+0000 7f9166f0a640 1 --2- 172.21.15.148:0/2271298673 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9160101df0 0x7f91600744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:30.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.994+0000 7f9166f0a640 1 -- 172.21.15.148:0/2271298673 >> 172.21.15.148:0/2271298673 conn(0x7f91600fd8b0 msgr2=0x7f91600fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:30.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.994+0000 7f9166f0a640 1 -- 172.21.15.148:0/2271298673 shutdown_connections 2024-09-19T07:09:30.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:30.994+0000 7f9166f0a640 1 -- 172.21.15.148:0/2271298673 wait complete. 2024-09-19T07:09:31.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:30 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/2271298673' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T07:09:31.328 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:30 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/2271298673' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T07:09:31.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:30 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/2271298673' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T07:09:31.638 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2024-09-19T07:09:31.686 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-19T07:09:31.933 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:09:32.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:31 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/2271298673' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T07:09:32.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:31 smithi179 ceph-mon[35716]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:09:32.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:31 smithi179 ceph-mon[35716]: pgmap v275: 97 pgs: 97 active+clean; 582 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3.3 KiB/s wr, 11 op/s 2024-09-19T07:09:32.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:31 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/2271298673' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T07:09:32.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:31 smithi148 ceph-mon[31180]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:09:32.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:31 smithi148 ceph-mon[31180]: pgmap v275: 97 pgs: 97 active+clean; 582 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3.3 KiB/s wr, 11 op/s 2024-09-19T07:09:32.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:31 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/2271298673' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T07:09:32.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:31 smithi165 ceph-mon[35326]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:09:32.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:31 smithi165 ceph-mon[35326]: pgmap v275: 97 pgs: 97 active+clean; 582 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3.3 KiB/s wr, 11 op/s 2024-09-19T07:09:32.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.455+0000 7ff48c226640 1 -- 172.21.15.148:0/102026402 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff484100b30 msgr2=0x7ff484100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:32.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.455+0000 7ff48c226640 1 --2- 172.21.15.148:0/102026402 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff484100b30 0x7ff484100f10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff480009900 tx=0x7ff48002a470 comp rx=0 tx=0).stop 2024-09-19T07:09:32.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.455+0000 7ff48c226640 1 -- 172.21.15.148:0/102026402 shutdown_connections 2024-09-19T07:09:32.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.455+0000 7ff48c226640 1 --2- 172.21.15.148:0/102026402 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff484105f40 0x7ff4841063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:32.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.455+0000 7ff48c226640 1 --2- 172.21.15.148:0/102026402 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff484101450 0x7ff484105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:32.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.455+0000 7ff48c226640 1 --2- 172.21.15.148:0/102026402 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff484100b30 0x7ff484100f10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:32.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.455+0000 7ff48c226640 1 -- 172.21.15.148:0/102026402 >> 172.21.15.148:0/102026402 conn(0x7ff4840fc7a0 msgr2=0x7ff4840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:32.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.455+0000 7ff48c226640 1 -- 172.21.15.148:0/102026402 shutdown_connections 2024-09-19T07:09:32.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.455+0000 7ff48c226640 1 -- 172.21.15.148:0/102026402 wait complete. 2024-09-19T07:09:32.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.456+0000 7ff48c226640 1 Processor -- start 2024-09-19T07:09:32.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.456+0000 7ff48c226640 1 -- start start 2024-09-19T07:09:32.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.456+0000 7ff48c226640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff484100b30 0x7ff4841a4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:32.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.456+0000 7ff48c226640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff484101450 0x7ff4841a4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:32.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.456+0000 7ff48c226640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff484105f40 0x7ff48419e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:32.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.456+0000 7ff48c226640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff4841185d0 con 0x7ff484105f40 2024-09-19T07:09:32.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.456+0000 7ff48c226640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff484118450 con 0x7ff484101450 2024-09-19T07:09:32.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.456+0000 7ff48c226640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff484118750 con 0x7ff484100b30 2024-09-19T07:09:32.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.456+0000 7ff48a7c3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff484105f40 0x7ff48419e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:32.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.456+0000 7ff48a7c3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff484105f40 0x7ff48419e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49908/0 (socket says 172.21.15.148:49908) 2024-09-19T07:09:32.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.456+0000 7ff48a7c3640 1 -- 172.21.15.148:0/3339685144 learned_addr learned my addr 172.21.15.148:0/3339685144 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:09:32.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.456+0000 7ff489fc2640 1 --2- 172.21.15.148:0/3339685144 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff484100b30 0x7ff4841a4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:32.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.456+0000 7ff4897c1640 1 --2- 172.21.15.148:0/3339685144 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff484101450 0x7ff4841a4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:32.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.456+0000 7ff48a7c3640 1 -- 172.21.15.148:0/3339685144 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff484100b30 msgr2=0x7ff4841a4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:32.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.456+0000 7ff48a7c3640 1 --2- 172.21.15.148:0/3339685144 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff484100b30 0x7ff4841a4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:32.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.456+0000 7ff48a7c3640 1 -- 172.21.15.148:0/3339685144 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff484101450 msgr2=0x7ff4841a4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:32.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.456+0000 7ff48a7c3640 1 --2- 172.21.15.148:0/3339685144 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff484101450 0x7ff4841a4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:32.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.456+0000 7ff48a7c3640 1 -- 172.21.15.148:0/3339685144 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff48419f020 con 0x7ff484105f40 2024-09-19T07:09:32.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.456+0000 7ff4897c1640 1 --2- 172.21.15.148:0/3339685144 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff484101450 0x7ff4841a4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:09:32.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.456+0000 7ff48a7c3640 1 --2- 172.21.15.148:0/3339685144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff484105f40 0x7ff48419e8f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff47c00b970 tx=0x7ff47c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:32.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.457+0000 7ff47affd640 1 -- 172.21.15.148:0/3339685144 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff47c019070 con 0x7ff484105f40 2024-09-19T07:09:32.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.457+0000 7ff47affd640 1 -- 172.21.15.148:0/3339685144 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff47c00cb40 con 0x7ff484105f40 2024-09-19T07:09:32.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.457+0000 7ff47affd640 1 -- 172.21.15.148:0/3339685144 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff47c007650 con 0x7ff484105f40 2024-09-19T07:09:32.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.457+0000 7ff48c226640 1 -- 172.21.15.148:0/3339685144 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff48419f310 con 0x7ff484105f40 2024-09-19T07:09:32.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.457+0000 7ff48c226640 1 -- 172.21.15.148:0/3339685144 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4841ab600 con 0x7ff484105f40 2024-09-19T07:09:32.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.458+0000 7ff48c226640 1 -- 172.21.15.148:0/3339685144 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff484105920 con 0x7ff484105f40 2024-09-19T07:09:32.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.459+0000 7ff47affd640 1 -- 172.21.15.148:0/3339685144 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7ff47c01c070 con 0x7ff484105f40 2024-09-19T07:09:32.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.460+0000 7ff47affd640 1 --2- 172.21.15.148:0/3339685144 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff4700a32c0 0x7ff4700a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:32.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.460+0000 7ff489fc2640 1 --2- 172.21.15.148:0/3339685144 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff4700a32c0 0x7ff4700a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:32.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.460+0000 7ff47affd640 1 -- 172.21.15.148:0/3339685144 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7ff47c0cf260 con 0x7ff484105f40 2024-09-19T07:09:32.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.460+0000 7ff489fc2640 1 --2- 172.21.15.148:0/3339685144 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff4700a32c0 0x7ff4700a5780 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff480000c00 tx=0x7ff4800314b0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:32.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.463+0000 7ff47affd640 1 -- 172.21.15.148:0/3339685144 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff47c09c0d0 con 0x7ff484105f40 2024-09-19T07:09:32.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.650+0000 7ff48c226640 1 -- 172.21.15.148:0/3339685144 --> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7ff48410fe10 con 0x7ff4700a32c0 2024-09-19T07:09:32.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.677+0000 7ff47affd640 1 -- 172.21.15.148:0/3339685144 <== mgr.14148 v2:172.21.15.148:6800/3007822654 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff48410fe10 con 0x7ff4700a32c0 2024-09-19T07:09:32.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.679+0000 7ff48c226640 1 -- 172.21.15.148:0/3339685144 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff4700a32c0 msgr2=0x7ff4700a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:32.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.679+0000 7ff48c226640 1 --2- 172.21.15.148:0/3339685144 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff4700a32c0 0x7ff4700a5780 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff480000c00 tx=0x7ff4800314b0 comp rx=0 tx=0).stop 2024-09-19T07:09:32.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.679+0000 7ff48c226640 1 -- 172.21.15.148:0/3339685144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff484105f40 msgr2=0x7ff48419e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:32.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.679+0000 7ff48c226640 1 --2- 172.21.15.148:0/3339685144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff484105f40 0x7ff48419e8f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff47c00b970 tx=0x7ff47c00be30 comp rx=0 tx=0).stop 2024-09-19T07:09:32.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.679+0000 7ff48c226640 1 -- 172.21.15.148:0/3339685144 shutdown_connections 2024-09-19T07:09:32.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.679+0000 7ff48c226640 1 --2- 172.21.15.148:0/3339685144 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff4700a32c0 0x7ff4700a5780 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:32.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.679+0000 7ff48c226640 1 --2- 172.21.15.148:0/3339685144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff484105f40 0x7ff48419e8f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:32.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.679+0000 7ff48c226640 1 --2- 172.21.15.148:0/3339685144 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff484101450 0x7ff4841a4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:32.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.679+0000 7ff48c226640 1 --2- 172.21.15.148:0/3339685144 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff484100b30 0x7ff4841a4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:32.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.679+0000 7ff48c226640 1 -- 172.21.15.148:0/3339685144 >> 172.21.15.148:0/3339685144 conn(0x7ff4840fc7a0 msgr2=0x7ff48410f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:32.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.680+0000 7ff48c226640 1 -- 172.21.15.148:0/3339685144 shutdown_connections 2024-09-19T07:09:32.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:32.680+0000 7ff48c226640 1 -- 172.21.15.148:0/3339685144 wait complete. 2024-09-19T07:09:33.074 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:09:32 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:09:32.656+0000 7f6ab95aa640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:09:33.074 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:09:32 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:09:32.656+0000 7f6ab95aa640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:09:33.074 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:09:32 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:09:32.656+0000 7f6ab95aa640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:09:33.074 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:09:32 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:09:32.656+0000 7f6ab95aa640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:09:33.074 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:09:32 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:09:32.656+0000 7f6ab95aa640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:09:33.338 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-19T07:09:33.585 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:09:34.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.037+0000 7f0a72212640 1 -- 172.21.15.148:0/8689727 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a6c102da0 msgr2=0x7f0a6c103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:34.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.037+0000 7f0a72212640 1 --2- 172.21.15.148:0/8689727 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a6c102da0 0x7f0a6c103180 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0a60009900 tx=0x7f0a6002a480 comp rx=0 tx=0).stop 2024-09-19T07:09:34.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.037+0000 7f0a72212640 1 -- 172.21.15.148:0/8689727 shutdown_connections 2024-09-19T07:09:34.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.037+0000 7f0a72212640 1 --2- 172.21.15.148:0/8689727 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a6c10c180 0x7f0a6c10e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:34.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.037+0000 7f0a72212640 1 --2- 172.21.15.148:0/8689727 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0a6c1036c0 0x7f0a6c10bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:34.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.037+0000 7f0a72212640 1 --2- 172.21.15.148:0/8689727 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a6c102da0 0x7f0a6c103180 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:34.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.037+0000 7f0a72212640 1 -- 172.21.15.148:0/8689727 >> 172.21.15.148:0/8689727 conn(0x7f0a6c0fc7a0 msgr2=0x7f0a6c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:34.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.037+0000 7f0a72212640 1 -- 172.21.15.148:0/8689727 shutdown_connections 2024-09-19T07:09:34.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.037+0000 7f0a72212640 1 -- 172.21.15.148:0/8689727 wait complete. 2024-09-19T07:09:34.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.038+0000 7f0a72212640 1 Processor -- start 2024-09-19T07:09:34.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.038+0000 7f0a72212640 1 -- start start 2024-09-19T07:09:34.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.038+0000 7f0a72212640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a6c102da0 0x7f0a6c100a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:34.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.038+0000 7f0a72212640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a6c1036c0 0x7f0a6c100f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:34.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.038+0000 7f0a72212640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0a6c10c180 0x7f0a6c101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:34.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.038+0000 7f0a72212640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0a6c111fa0 con 0x7f0a6c102da0 2024-09-19T07:09:34.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.038+0000 7f0a72212640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0a6c111e20 con 0x7f0a6c10c180 2024-09-19T07:09:34.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.038+0000 7f0a72212640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0a6c112120 con 0x7f0a6c1036c0 2024-09-19T07:09:34.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.038+0000 7f0a6b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a6c102da0 0x7f0a6c100a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:34.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.038+0000 7f0a6b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a6c102da0 0x7f0a6c100a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49938/0 (socket says 172.21.15.148:49938) 2024-09-19T07:09:34.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.038+0000 7f0a6b7fe640 1 -- 172.21.15.148:0/3131914289 learned_addr learned my addr 172.21.15.148:0/3131914289 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:09:34.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.039+0000 7f0a6bfff640 1 --2- 172.21.15.148:0/3131914289 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0a6c10c180 0x7f0a6c101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:34.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.039+0000 7f0a6affd640 1 --2- 172.21.15.148:0/3131914289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a6c1036c0 0x7f0a6c100f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:34.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.039+0000 7f0a6b7fe640 1 -- 172.21.15.148:0/3131914289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a6c1036c0 msgr2=0x7f0a6c100f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:34.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.039+0000 7f0a6b7fe640 1 --2- 172.21.15.148:0/3131914289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a6c1036c0 0x7f0a6c100f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:34.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.039+0000 7f0a6b7fe640 1 -- 172.21.15.148:0/3131914289 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0a6c10c180 msgr2=0x7f0a6c101480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:34.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.039+0000 7f0a6b7fe640 1 --2- 172.21.15.148:0/3131914289 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0a6c10c180 0x7f0a6c101480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:34.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.039+0000 7f0a6b7fe640 1 -- 172.21.15.148:0/3131914289 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a6c1a6940 con 0x7f0a6c102da0 2024-09-19T07:09:34.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.039+0000 7f0a6affd640 1 --2- 172.21.15.148:0/3131914289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a6c1036c0 0x7f0a6c100f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:09:34.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.039+0000 7f0a6b7fe640 1 --2- 172.21.15.148:0/3131914289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a6c102da0 0x7f0a6c100a00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0a60006010 tx=0x7f0a600042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:34.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.039+0000 7f0a68ff9640 1 -- 172.21.15.148:0/3131914289 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a6003f030 con 0x7f0a6c102da0 2024-09-19T07:09:34.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.039+0000 7f0a72212640 1 -- 172.21.15.148:0/3131914289 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a6c1a6bd0 con 0x7f0a6c102da0 2024-09-19T07:09:34.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.039+0000 7f0a68ff9640 1 -- 172.21.15.148:0/3131914289 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a60003ce0 con 0x7f0a6c102da0 2024-09-19T07:09:34.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.039+0000 7f0a68ff9640 1 -- 172.21.15.148:0/3131914289 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a60035070 con 0x7f0a6c102da0 2024-09-19T07:09:34.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.039+0000 7f0a72212640 1 -- 172.21.15.148:0/3131914289 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a6c1a7100 con 0x7f0a6c102da0 2024-09-19T07:09:34.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.040+0000 7f0a72212640 1 -- 172.21.15.148:0/3131914289 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a6c103180 con 0x7f0a6c102da0 2024-09-19T07:09:34.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.041+0000 7f0a68ff9640 1 -- 172.21.15.148:0/3131914289 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f0a60042030 con 0x7f0a6c102da0 2024-09-19T07:09:34.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.042+0000 7f0a68ff9640 1 --2- 172.21.15.148:0/3131914289 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f0a540a3240 0x7f0a540a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:34.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.042+0000 7f0a6affd640 1 --2- 172.21.15.148:0/3131914289 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f0a540a3240 0x7f0a540a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:34.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.042+0000 7f0a68ff9640 1 -- 172.21.15.148:0/3131914289 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7f0a600f0170 con 0x7f0a6c102da0 2024-09-19T07:09:34.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.043+0000 7f0a6affd640 1 --2- 172.21.15.148:0/3131914289 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f0a540a3240 0x7f0a540a5700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c102490 tx=0x7f0a5c005e50 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:34.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.046+0000 7f0a68ff9640 1 -- 172.21.15.148:0/3131914289 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0a600bd000 con 0x7f0a6c102da0 2024-09-19T07:09:34.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.152+0000 7f0a68ff9640 1 -- 172.21.15.148:0/3131914289 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f0a600b8f70 con 0x7f0a6c102da0 2024-09-19T07:09:34.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.245+0000 7f0a72212640 1 -- 172.21.15.148:0/3131914289 --> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f0a6c062630 con 0x7f0a540a3240 2024-09-19T07:09:34.246 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:34 smithi148 ceph-mon[31180]: from='client.14670 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:09:34.246 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:34 smithi148 ceph-mon[31180]: pgmap v276: 97 pgs: 97 active+clean; 582 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-09-19T07:09:34.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.268+0000 7f0a68ff9640 1 -- 172.21.15.148:0/3131914289 <== mgr.14148 v2:172.21.15.148:6800/3007822654 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0a6c062630 con 0x7f0a540a3240 2024-09-19T07:09:34.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.270+0000 7f0a72212640 1 -- 172.21.15.148:0/3131914289 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f0a540a3240 msgr2=0x7f0a540a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:34.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.270+0000 7f0a72212640 1 --2- 172.21.15.148:0/3131914289 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f0a540a3240 0x7f0a540a5700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c102490 tx=0x7f0a5c005e50 comp rx=0 tx=0).stop 2024-09-19T07:09:34.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.270+0000 7f0a72212640 1 -- 172.21.15.148:0/3131914289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a6c102da0 msgr2=0x7f0a6c100a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:34.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.270+0000 7f0a72212640 1 --2- 172.21.15.148:0/3131914289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a6c102da0 0x7f0a6c100a00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0a60006010 tx=0x7f0a600042f0 comp rx=0 tx=0).stop 2024-09-19T07:09:34.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.270+0000 7f0a72212640 1 -- 172.21.15.148:0/3131914289 shutdown_connections 2024-09-19T07:09:34.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.270+0000 7f0a72212640 1 --2- 172.21.15.148:0/3131914289 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f0a540a3240 0x7f0a540a5700 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:34.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.270+0000 7f0a72212640 1 --2- 172.21.15.148:0/3131914289 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0a6c10c180 0x7f0a6c101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:34.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.270+0000 7f0a72212640 1 --2- 172.21.15.148:0/3131914289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a6c1036c0 0x7f0a6c100f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:34.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.270+0000 7f0a72212640 1 --2- 172.21.15.148:0/3131914289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a6c102da0 0x7f0a6c100a00 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:34.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.270+0000 7f0a72212640 1 -- 172.21.15.148:0/3131914289 >> 172.21.15.148:0/3131914289 conn(0x7f0a6c0fc7a0 msgr2=0x7f0a6c0fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:34.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.270+0000 7f0a72212640 1 -- 172.21.15.148:0/3131914289 shutdown_connections 2024-09-19T07:09:34.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:34.270+0000 7f0a72212640 1 -- 172.21.15.148:0/3131914289 wait complete. 2024-09-19T07:09:34.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:34 smithi179 ceph-mon[35716]: from='client.14670 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:09:34.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:34 smithi179 ceph-mon[35716]: pgmap v276: 97 pgs: 97 active+clean; 582 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-09-19T07:09:34.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:34 smithi165 ceph-mon[35326]: from='client.14670 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:09:34.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:34 smithi165 ceph-mon[35326]: pgmap v276: 97 pgs: 97 active+clean; 582 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-09-19T07:09:35.003 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-19T07:09:35.252 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:09:35.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:35 smithi148 ceph-mon[31180]: mgrmap e17: x(active, since 6m), standbys: y, z 2024-09-19T07:09:35.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:35 smithi148 ceph-mon[31180]: from='client.14682 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:09:35.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:35 smithi148 ceph-mon[31180]: pgmap v277: 97 pgs: 97 active+clean; 582 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-09-19T07:09:35.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:35 smithi179 ceph-mon[35716]: mgrmap e17: x(active, since 6m), standbys: y, z 2024-09-19T07:09:35.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:35 smithi179 ceph-mon[35716]: from='client.14682 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:09:35.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:35 smithi179 ceph-mon[35716]: pgmap v277: 97 pgs: 97 active+clean; 582 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-09-19T07:09:35.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:35 smithi165 ceph-mon[35326]: mgrmap e17: x(active, since 6m), standbys: y, z 2024-09-19T07:09:35.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:35 smithi165 ceph-mon[35326]: from='client.14682 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:09:35.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:35 smithi165 ceph-mon[35326]: pgmap v277: 97 pgs: 97 active+clean; 582 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-09-19T07:09:35.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.706+0000 7f40c63db640 1 -- 172.21.15.148:0/4149952861 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40c0102d30 msgr2=0x7f40c0103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:35.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.706+0000 7f40c63db640 1 --2- 172.21.15.148:0/4149952861 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40c0102d30 0x7f40c0103110 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f40b0009930 tx=0x7f40b002a420 comp rx=0 tx=0).stop 2024-09-19T07:09:35.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.706+0000 7f40c63db640 1 -- 172.21.15.148:0/4149952861 shutdown_connections 2024-09-19T07:09:35.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.706+0000 7f40c63db640 1 --2- 172.21.15.148:0/4149952861 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40c01082a0 0x7f40c010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:35.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.706+0000 7f40c63db640 1 --2- 172.21.15.148:0/4149952861 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f40c01036e0 0x7f40c0107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:35.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.706+0000 7f40c63db640 1 --2- 172.21.15.148:0/4149952861 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40c0102d30 0x7f40c0103110 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:35.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.706+0000 7f40c63db640 1 -- 172.21.15.148:0/4149952861 >> 172.21.15.148:0/4149952861 conn(0x7f40c00fc7d0 msgr2=0x7f40c00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:35.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.706+0000 7f40c63db640 1 -- 172.21.15.148:0/4149952861 shutdown_connections 2024-09-19T07:09:35.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.706+0000 7f40c63db640 1 -- 172.21.15.148:0/4149952861 wait complete. 2024-09-19T07:09:35.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.706+0000 7f40c63db640 1 Processor -- start 2024-09-19T07:09:35.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.706+0000 7f40c63db640 1 -- start start 2024-09-19T07:09:35.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.706+0000 7f40c63db640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40c0102d30 0x7f40c0198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:35.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.706+0000 7f40c63db640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40c01036e0 0x7f40c0198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:35.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.707+0000 7f40c63db640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f40c01082a0 0x7f40c019cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:35.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.707+0000 7f40c63db640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f40c0112100 con 0x7f40c0102d30 2024-09-19T07:09:35.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.707+0000 7f40c63db640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f40c0111f80 con 0x7f40c01082a0 2024-09-19T07:09:35.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.707+0000 7f40c63db640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f40c0112280 con 0x7f40c01036e0 2024-09-19T07:09:35.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.707+0000 7f40bffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40c0102d30 0x7f40c0198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:35.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.707+0000 7f40bffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40c0102d30 0x7f40c0198640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55992/0 (socket says 172.21.15.148:55992) 2024-09-19T07:09:35.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.707+0000 7f40bffff640 1 -- 172.21.15.148:0/635709084 learned_addr learned my addr 172.21.15.148:0/635709084 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:09:35.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.707+0000 7f40c4978640 1 --2- 172.21.15.148:0/635709084 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f40c01082a0 0x7f40c019cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:35.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.707+0000 7f40b7fff640 1 --2- 172.21.15.148:0/635709084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40c01036e0 0x7f40c0198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:35.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.707+0000 7f40bffff640 1 -- 172.21.15.148:0/635709084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40c01036e0 msgr2=0x7f40c0198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:35.731 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.707+0000 7f40bffff640 1 --2- 172.21.15.148:0/635709084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40c01036e0 0x7f40c0198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:35.731 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.707+0000 7f40bffff640 1 -- 172.21.15.148:0/635709084 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f40c01082a0 msgr2=0x7f40c019cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:35.731 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.707+0000 7f40bffff640 1 --2- 172.21.15.148:0/635709084 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f40c01082a0 0x7f40c019cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:35.731 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.707+0000 7f40bffff640 1 -- 172.21.15.148:0/635709084 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40c019d5f0 con 0x7f40c0102d30 2024-09-19T07:09:35.731 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.707+0000 7f40c4978640 1 --2- 172.21.15.148:0/635709084 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f40c01082a0 0x7f40c019cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:09:35.731 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.707+0000 7f40bffff640 1 --2- 172.21.15.148:0/635709084 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40c0102d30 0x7f40c0198640 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f40b0009a50 tx=0x7f40b0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:35.731 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.707+0000 7f40bdffb640 1 -- 172.21.15.148:0/635709084 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b003f030 con 0x7f40c0102d30 2024-09-19T07:09:35.731 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.707+0000 7f40c63db640 1 -- 172.21.15.148:0/635709084 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40c019d880 con 0x7f40c0102d30 2024-09-19T07:09:35.731 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.707+0000 7f40bdffb640 1 -- 172.21.15.148:0/635709084 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40b0003ce0 con 0x7f40c0102d30 2024-09-19T07:09:35.731 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.707+0000 7f40bdffb640 1 -- 172.21.15.148:0/635709084 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b0035070 con 0x7f40c0102d30 2024-09-19T07:09:35.731 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.707+0000 7f40c63db640 1 -- 172.21.15.148:0/635709084 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40c01a51c0 con 0x7f40c0102d30 2024-09-19T07:09:35.731 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.708+0000 7f40c63db640 1 -- 172.21.15.148:0/635709084 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40c0103110 con 0x7f40c0102d30 2024-09-19T07:09:35.731 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.709+0000 7f40bdffb640 1 -- 172.21.15.148:0/635709084 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f40b0042030 con 0x7f40c0102d30 2024-09-19T07:09:35.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.710+0000 7f40bdffb640 1 --2- 172.21.15.148:0/635709084 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f40ac0a32d0 0x7f40ac0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:35.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.710+0000 7f40b7fff640 1 --2- 172.21.15.148:0/635709084 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f40ac0a32d0 0x7f40ac0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:35.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.710+0000 7f40bdffb640 1 -- 172.21.15.148:0/635709084 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7f40b00eff40 con 0x7f40c0102d30 2024-09-19T07:09:35.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.710+0000 7f40b7fff640 1 --2- 172.21.15.148:0/635709084 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f40ac0a32d0 0x7f40ac0a5790 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f40c00fedd0 tx=0x7f40a800a4c0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:35.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.714+0000 7f40bdffb640 1 -- 172.21.15.148:0/635709084 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f40b00bccb0 con 0x7f40c0102d30 2024-09-19T07:09:35.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.907+0000 7f40c63db640 1 -- 172.21.15.148:0/635709084 --> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f40c0062630 con 0x7f40ac0a32d0 2024-09-19T07:09:35.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.912+0000 7f40bdffb640 1 -- 172.21.15.148:0/635709084 <== mgr.14148 v2:172.21.15.148:6800/3007822654 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f40c0062630 con 0x7f40ac0a32d0 2024-09-19T07:09:35.913 INFO:teuthology.orchestra.run.smithi148.stdout:/volumes/qa/sv_0/11ed6980-b8e9-4080-93c5-45917fdd7bdd 2024-09-19T07:09:35.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.914+0000 7f40c63db640 1 -- 172.21.15.148:0/635709084 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f40ac0a32d0 msgr2=0x7f40ac0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:35.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.914+0000 7f40c63db640 1 --2- 172.21.15.148:0/635709084 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f40ac0a32d0 0x7f40ac0a5790 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f40c00fedd0 tx=0x7f40a800a4c0 comp rx=0 tx=0).stop 2024-09-19T07:09:35.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.914+0000 7f40c63db640 1 -- 172.21.15.148:0/635709084 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40c0102d30 msgr2=0x7f40c0198640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:35.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.914+0000 7f40c63db640 1 --2- 172.21.15.148:0/635709084 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40c0102d30 0x7f40c0198640 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f40b0009a50 tx=0x7f40b0004270 comp rx=0 tx=0).stop 2024-09-19T07:09:35.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.914+0000 7f40c63db640 1 -- 172.21.15.148:0/635709084 shutdown_connections 2024-09-19T07:09:35.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.914+0000 7f40c63db640 1 --2- 172.21.15.148:0/635709084 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f40ac0a32d0 0x7f40ac0a5790 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:35.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.914+0000 7f40c63db640 1 --2- 172.21.15.148:0/635709084 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f40c01082a0 0x7f40c019cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:35.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.914+0000 7f40c63db640 1 --2- 172.21.15.148:0/635709084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40c01036e0 0x7f40c0198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:35.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.914+0000 7f40c63db640 1 --2- 172.21.15.148:0/635709084 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40c0102d30 0x7f40c0198640 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:35.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.914+0000 7f40c63db640 1 -- 172.21.15.148:0/635709084 >> 172.21.15.148:0/635709084 conn(0x7f40c00fc7d0 msgr2=0x7f40c0105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:35.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.914+0000 7f40c63db640 1 -- 172.21.15.148:0/635709084 shutdown_connections 2024-09-19T07:09:35.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:35.914+0000 7f40c63db640 1 -- 172.21.15.148:0/635709084 wait complete. 2024-09-19T07:09:36.516 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:36 smithi148 ceph-mon[31180]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:09:36.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:36 smithi179 ceph-mon[35716]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:09:36.544 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-19T07:09:36.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:36 smithi165 ceph-mon[35326]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:09:36.791 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:09:37.438 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:37 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-09-19T07:09:37.438 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:37 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2024-09-19T07:09:37.438 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:37 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-09-19T07:09:37.439 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:37 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2024-09-19T07:09:37.439 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:37 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]}]: dispatch 2024-09-19T07:09:37.439 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:37 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]: dispatch 2024-09-19T07:09:37.439 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:37 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-09-19T07:09:37.439 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:37 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]: dispatch 2024-09-19T07:09:37.439 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:37 smithi148 ceph-mon[31180]: pgmap v278: 97 pgs: 97 active+clean; 602 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 4.2 KiB/s wr, 12 op/s 2024-09-19T07:09:37.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:37.437+0000 7f03efacc640 1 -- 172.21.15.148:0/3970739765 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f03e8101de0 msgr2=0x7f03e81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:37.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:37.437+0000 7f03efacc640 1 --2- 172.21.15.148:0/3970739765 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f03e8101de0 0x7f03e81021c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f03dc009900 tx=0x7f03dc02a410 comp rx=0 tx=0).stop 2024-09-19T07:09:37.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:37.437+0000 7f03efacc640 1 -- 172.21.15.148:0/3970739765 shutdown_connections 2024-09-19T07:09:37.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:37.437+0000 7f03efacc640 1 --2- 172.21.15.148:0/3970739765 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f03e8106f10 0x7f03e810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:37.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:37.437+0000 7f03efacc640 1 --2- 172.21.15.148:0/3970739765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03e8102790 0x7f03e81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:37.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:37.437+0000 7f03efacc640 1 --2- 172.21.15.148:0/3970739765 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f03e8101de0 0x7f03e81021c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:37.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:37.437+0000 7f03efacc640 1 -- 172.21.15.148:0/3970739765 >> 172.21.15.148:0/3970739765 conn(0x7f03e80fd8c0 msgr2=0x7f03e80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:37.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:37.437+0000 7f03efacc640 1 -- 172.21.15.148:0/3970739765 shutdown_connections 2024-09-19T07:09:37.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:37.437+0000 7f03efacc640 1 -- 172.21.15.148:0/3970739765 wait complete. 2024-09-19T07:09:37.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:37.438+0000 7f03efacc640 1 Processor -- start 2024-09-19T07:09:37.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:37.438+0000 7f03efacc640 1 -- start start 2024-09-19T07:09:37.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:37.438+0000 7f03efacc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f03e8101de0 0x7f03e8198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:37.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:37.438+0000 7f03efacc640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f03e8102790 0x7f03e8198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:37.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:37.438+0000 7f03efacc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03e8106f10 0x7f03e819cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:37.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:37.438+0000 7f03efacc640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f03e8111f70 con 0x7f03e8101de0 2024-09-19T07:09:37.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:37.438+0000 7f03efacc640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f03e8111df0 con 0x7f03e8102790 2024-09-19T07:09:37.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:37.438+0000 7f03efacc640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f03e81120f0 con 0x7f03e8106f10 2024-09-19T07:09:37.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:37.438+0000 7f03ed868640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f03e8101de0 0x7f03e8198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:37.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:37.438+0000 7f03ed868640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f03e8101de0 0x7f03e8198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56010/0 (socket says 172.21.15.148:56010) 2024-09-19T07:09:37.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:37.438+0000 7f03ed868640 1 -- 172.21.15.148:0/2617008530 learned_addr learned my addr 172.21.15.148:0/2617008530 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:09:37.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:37.438+0000 7f03ed868640 1 -- 172.21.15.148:0/2617008530 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03e8106f10 msgr2=0x7f03e819cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:37.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:37.438+0000 7f03ed868640 1 --2- 172.21.15.148:0/2617008530 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03e8106f10 0x7f03e819cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:37.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:37.438+0000 7f03ed868640 1 -- 172.21.15.148:0/2617008530 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f03e8102790 msgr2=0x7f03e8198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:37.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:37.438+0000 7f03ed868640 1 --2- 172.21.15.148:0/2617008530 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f03e8102790 0x7f03e8198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:37.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:37.438+0000 7f03ed868640 1 -- 172.21.15.148:0/2617008530 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03e819d3e0 con 0x7f03e8101de0 2024-09-19T07:09:37.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:37.439+0000 7f03ed868640 1 --2- 172.21.15.148:0/2617008530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f03e8101de0 0x7f03e8198430 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f03dc005ab0 tx=0x7f03dc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:37.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:37.439+0000 7f03daffd640 1 -- 172.21.15.148:0/2617008530 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03dc03f030 con 0x7f03e8101de0 2024-09-19T07:09:37.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:37.439+0000 7f03daffd640 1 -- 172.21.15.148:0/2617008530 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03dc003ce0 con 0x7f03e8101de0 2024-09-19T07:09:37.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:37.439+0000 7f03efacc640 1 -- 172.21.15.148:0/2617008530 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03e819d670 con 0x7f03e8101de0 2024-09-19T07:09:37.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:37.439+0000 7f03daffd640 1 -- 172.21.15.148:0/2617008530 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03dc035070 con 0x7f03e8101de0 2024-09-19T07:09:37.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:37.439+0000 7f03efacc640 1 -- 172.21.15.148:0/2617008530 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03e81a4fb0 con 0x7f03e8101de0 2024-09-19T07:09:37.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:37.440+0000 7f03efacc640 1 -- 172.21.15.148:0/2617008530 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03e81032c0 con 0x7f03e8101de0 2024-09-19T07:09:37.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:37.441+0000 7f03daffd640 1 -- 172.21.15.148:0/2617008530 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f03dc042030 con 0x7f03e8101de0 2024-09-19T07:09:37.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:37.442+0000 7f03daffd640 1 --2- 172.21.15.148:0/2617008530 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f03d40a32d0 0x7f03d40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:37.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:37.442+0000 7f03ed067640 1 --2- 172.21.15.148:0/2617008530 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f03d40a32d0 0x7f03d40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:37.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:37.442+0000 7f03daffd640 1 -- 172.21.15.148:0/2617008530 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8211+0+0 (secure 0 0 0) 0x7f03dc0f0450 con 0x7f03e8101de0 2024-09-19T07:09:37.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:37.442+0000 7f03ed067640 1 --2- 172.21.15.148:0/2617008530 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f03d40a32d0 0x7f03d40a5790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f03e80fdd50 tx=0x7f03e4005bf0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:37.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:37.446+0000 7f03daffd640 1 -- 172.21.15.148:0/2617008530 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f03dc0bd020 con 0x7f03e8101de0 2024-09-19T07:09:37.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:37 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-09-19T07:09:37.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:37 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2024-09-19T07:09:37.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:37 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-09-19T07:09:37.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:37 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2024-09-19T07:09:37.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:37 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]}]: dispatch 2024-09-19T07:09:37.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:37 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]: dispatch 2024-09-19T07:09:37.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:37 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-09-19T07:09:37.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:37 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]: dispatch 2024-09-19T07:09:37.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:37 smithi179 ceph-mon[35716]: pgmap v278: 97 pgs: 97 active+clean; 602 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 4.2 KiB/s wr, 12 op/s 2024-09-19T07:09:37.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:37 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-09-19T07:09:37.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:37 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2024-09-19T07:09:37.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:37 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-09-19T07:09:37.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:37 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2024-09-19T07:09:37.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:37 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]}]: dispatch 2024-09-19T07:09:37.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:37 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]: dispatch 2024-09-19T07:09:37.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:37 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-09-19T07:09:37.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:37 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]: dispatch 2024-09-19T07:09:37.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:37 smithi165 ceph-mon[35326]: pgmap v278: 97 pgs: 97 active+clean; 602 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 4.2 KiB/s wr, 12 op/s 2024-09-19T07:09:37.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:37.638+0000 7f03efacc640 1 -- 172.21.15.148:0/2617008530 --> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f03e810a160 con 0x7f03d40a32d0 2024-09-19T07:09:38.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:38.241+0000 7f03daffd640 1 -- 172.21.15.148:0/2617008530 <== mgr.14148 v2:172.21.15.148:6800/3007822654 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f03e400a500 con 0x7f03d40a32d0 2024-09-19T07:09:38.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:38.243+0000 7f03efacc640 1 -- 172.21.15.148:0/2617008530 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f03d40a32d0 msgr2=0x7f03d40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:38.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:38.243+0000 7f03efacc640 1 --2- 172.21.15.148:0/2617008530 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f03d40a32d0 0x7f03d40a5790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f03e80fdd50 tx=0x7f03e4005bf0 comp rx=0 tx=0).stop 2024-09-19T07:09:38.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:38.244+0000 7f03efacc640 1 -- 172.21.15.148:0/2617008530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f03e8101de0 msgr2=0x7f03e8198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:38.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:38.244+0000 7f03efacc640 1 --2- 172.21.15.148:0/2617008530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f03e8101de0 0x7f03e8198430 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f03dc005ab0 tx=0x7f03dc0042f0 comp rx=0 tx=0).stop 2024-09-19T07:09:38.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:38.244+0000 7f03efacc640 1 -- 172.21.15.148:0/2617008530 shutdown_connections 2024-09-19T07:09:38.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:38.244+0000 7f03efacc640 1 --2- 172.21.15.148:0/2617008530 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f03d40a32d0 0x7f03d40a5790 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:38.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:38.244+0000 7f03efacc640 1 --2- 172.21.15.148:0/2617008530 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03e8106f10 0x7f03e819cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:38.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:38.244+0000 7f03efacc640 1 --2- 172.21.15.148:0/2617008530 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f03e8102790 0x7f03e8198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:38.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:38.244+0000 7f03efacc640 1 --2- 172.21.15.148:0/2617008530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f03e8101de0 0x7f03e8198430 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:38.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:38.244+0000 7f03efacc640 1 -- 172.21.15.148:0/2617008530 >> 172.21.15.148:0/2617008530 conn(0x7f03e80fd8c0 msgr2=0x7f03e80fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:38.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:38.244+0000 7f03efacc640 1 -- 172.21.15.148:0/2617008530 shutdown_connections 2024-09-19T07:09:38.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:38.244+0000 7f03efacc640 1 -- 172.21.15.148:0/2617008530 wait complete. 2024-09-19T07:09:38.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:38 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-09-19T07:09:38.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:38 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-09-19T07:09:38.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:38 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-09-19T07:09:38.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:38 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-09-19T07:09:38.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:38 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]}]': finished 2024-09-19T07:09:38.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:38 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]': finished 2024-09-19T07:09:38.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:38 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-09-19T07:09:38.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:38 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-09-19T07:09:38.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:38 smithi179 ceph-mon[35716]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T07:09:38.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:38 smithi179 ceph-mon[35716]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:09:38.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:38 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-09-19T07:09:38.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:38 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-09-19T07:09:38.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:38 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-09-19T07:09:38.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:38 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-09-19T07:09:38.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:38 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]}]': finished 2024-09-19T07:09:38.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:38 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]': finished 2024-09-19T07:09:38.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:38 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-09-19T07:09:38.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:38 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-09-19T07:09:38.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:38 smithi148 ceph-mon[31180]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T07:09:38.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:38 smithi148 ceph-mon[31180]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:09:38.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:38 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-09-19T07:09:38.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:38 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-09-19T07:09:38.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:38 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-09-19T07:09:38.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:38 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-09-19T07:09:38.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:38 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]}]': finished 2024-09-19T07:09:38.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:38 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]': finished 2024-09-19T07:09:38.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:38 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-09-19T07:09:38.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:38 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-09-19T07:09:38.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:38 smithi165 ceph-mon[35326]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T07:09:38.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:38 smithi165 ceph-mon[35326]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:09:38.922 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-19T07:09:39.174 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:09:39.429 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:39 smithi148 ceph-mon[31180]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T07:09:39.430 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:39 smithi148 ceph-mon[31180]: pgmap v281: 97 pgs: 1 peering, 96 active+clean; 603 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.5 KiB/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T07:09:39.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:39 smithi179 ceph-mon[35716]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T07:09:39.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:39 smithi179 ceph-mon[35716]: pgmap v281: 97 pgs: 1 peering, 96 active+clean; 603 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.5 KiB/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T07:09:39.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:39 smithi165 ceph-mon[35326]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T07:09:39.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:39 smithi165 ceph-mon[35326]: pgmap v281: 97 pgs: 1 peering, 96 active+clean; 603 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.5 KiB/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T07:09:39.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.667+0000 7f7d57972640 1 -- 172.21.15.148:0/4106435001 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d50100e30 msgr2=0x7f7d50104e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:39.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.667+0000 7f7d57972640 1 --2- 172.21.15.148:0/4106435001 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d50100e30 0x7f7d50104e80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7d40009900 tx=0x7f7d4002a410 comp rx=0 tx=0).stop 2024-09-19T07:09:39.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.667+0000 7f7d57972640 1 -- 172.21.15.148:0/4106435001 shutdown_connections 2024-09-19T07:09:39.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.667+0000 7f7d57972640 1 --2- 172.21.15.148:0/4106435001 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7d501055b0 0x7f7d5010d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:39.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.667+0000 7f7d57972640 1 --2- 172.21.15.148:0/4106435001 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d50100e30 0x7f7d50104e80 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:39.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.667+0000 7f7d57972640 1 --2- 172.21.15.148:0/4106435001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d50100480 0x7f7d50100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:39.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.667+0000 7f7d57972640 1 -- 172.21.15.148:0/4106435001 >> 172.21.15.148:0/4106435001 conn(0x7f7d50077210 msgr2=0x7f7d500fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:39.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.668+0000 7f7d57972640 1 -- 172.21.15.148:0/4106435001 shutdown_connections 2024-09-19T07:09:39.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.668+0000 7f7d57972640 1 -- 172.21.15.148:0/4106435001 wait complete. 2024-09-19T07:09:39.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.668+0000 7f7d57972640 1 Processor -- start 2024-09-19T07:09:39.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.668+0000 7f7d57972640 1 -- start start 2024-09-19T07:09:39.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.668+0000 7f7d57972640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7d50100480 0x7f7d500fc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:39.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.668+0000 7f7d57972640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d50100e30 0x7f7d500fcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:39.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.668+0000 7f7d57972640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d501055b0 0x7f7d500fd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:39.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.668+0000 7f7d57972640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7d501106b0 con 0x7f7d50100e30 2024-09-19T07:09:39.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.668+0000 7f7d57972640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7d50110530 con 0x7f7d50100480 2024-09-19T07:09:39.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.668+0000 7f7d57972640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7d50110830 con 0x7f7d501055b0 2024-09-19T07:09:39.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.668+0000 7f7d54f0d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d50100e30 0x7f7d500fcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:39.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.669+0000 7f7d54f0d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d50100e30 0x7f7d500fcbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56028/0 (socket says 172.21.15.148:56028) 2024-09-19T07:09:39.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.669+0000 7f7d54f0d640 1 -- 172.21.15.148:0/3681494232 learned_addr learned my addr 172.21.15.148:0/3681494232 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:09:39.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.669+0000 7f7d5570e640 1 --2- 172.21.15.148:0/3681494232 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7d50100480 0x7f7d500fc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:39.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.669+0000 7f7d55f0f640 1 --2- 172.21.15.148:0/3681494232 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d501055b0 0x7f7d500fd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:39.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.669+0000 7f7d54f0d640 1 -- 172.21.15.148:0/3681494232 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d501055b0 msgr2=0x7f7d500fd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:39.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.669+0000 7f7d54f0d640 1 --2- 172.21.15.148:0/3681494232 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d501055b0 0x7f7d500fd110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:39.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.669+0000 7f7d54f0d640 1 -- 172.21.15.148:0/3681494232 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7d50100480 msgr2=0x7f7d500fc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:39.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.669+0000 7f7d54f0d640 1 --2- 172.21.15.148:0/3681494232 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7d50100480 0x7f7d500fc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:39.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.669+0000 7f7d54f0d640 1 -- 172.21.15.148:0/3681494232 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d501a6ae0 con 0x7f7d50100e30 2024-09-19T07:09:39.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.669+0000 7f7d54f0d640 1 --2- 172.21.15.148:0/3681494232 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d50100e30 0x7f7d500fcbd0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7d40005ab0 tx=0x7f7d400042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:39.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.669+0000 7f7d467fc640 1 -- 172.21.15.148:0/3681494232 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d4003f030 con 0x7f7d50100e30 2024-09-19T07:09:39.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.669+0000 7f7d57972640 1 -- 172.21.15.148:0/3681494232 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d501a6d70 con 0x7f7d50100e30 2024-09-19T07:09:39.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.669+0000 7f7d467fc640 1 -- 172.21.15.148:0/3681494232 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d40003ce0 con 0x7f7d50100e30 2024-09-19T07:09:39.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.669+0000 7f7d467fc640 1 -- 172.21.15.148:0/3681494232 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d40035070 con 0x7f7d50100e30 2024-09-19T07:09:39.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.669+0000 7f7d57972640 1 -- 172.21.15.148:0/3681494232 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d501a71f0 con 0x7f7d50100e30 2024-09-19T07:09:39.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.670+0000 7f7d57972640 1 -- 172.21.15.148:0/3681494232 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d501008e0 con 0x7f7d50100e30 2024-09-19T07:09:39.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.671+0000 7f7d467fc640 1 -- 172.21.15.148:0/3681494232 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f7d40042030 con 0x7f7d50100e30 2024-09-19T07:09:39.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.672+0000 7f7d467fc640 1 --2- 172.21.15.148:0/3681494232 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f7d3c0a32d0 0x7f7d3c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:39.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.672+0000 7f7d5570e640 1 --2- 172.21.15.148:0/3681494232 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f7d3c0a32d0 0x7f7d3c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:39.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.672+0000 7f7d467fc640 1 -- 172.21.15.148:0/3681494232 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7f7d400f0450 con 0x7f7d50100e30 2024-09-19T07:09:39.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.672+0000 7f7d5570e640 1 --2- 172.21.15.148:0/3681494232 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f7d3c0a32d0 0x7f7d3c0a5790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c009890 tx=0x7f7d4c008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:39.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.676+0000 7f7d467fc640 1 -- 172.21.15.148:0/3681494232 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7d400bd020 con 0x7f7d50100e30 2024-09-19T07:09:39.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.869+0000 7f7d57972640 1 -- 172.21.15.148:0/3681494232 --> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f7d50062630 con 0x7f7d3c0a32d0 2024-09-19T07:09:39.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.874+0000 7f7d467fc640 1 -- 172.21.15.148:0/3681494232 <== mgr.14148 v2:172.21.15.148:6800/3007822654 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f7d50062630 con 0x7f7d3c0a32d0 2024-09-19T07:09:39.875 INFO:teuthology.orchestra.run.smithi148.stdout:/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f 2024-09-19T07:09:39.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.876+0000 7f7d57972640 1 -- 172.21.15.148:0/3681494232 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f7d3c0a32d0 msgr2=0x7f7d3c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:39.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.876+0000 7f7d57972640 1 --2- 172.21.15.148:0/3681494232 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f7d3c0a32d0 0x7f7d3c0a5790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c009890 tx=0x7f7d4c008040 comp rx=0 tx=0).stop 2024-09-19T07:09:39.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.876+0000 7f7d57972640 1 -- 172.21.15.148:0/3681494232 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d50100e30 msgr2=0x7f7d500fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:39.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.876+0000 7f7d57972640 1 --2- 172.21.15.148:0/3681494232 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d50100e30 0x7f7d500fcbd0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7d40005ab0 tx=0x7f7d400042f0 comp rx=0 tx=0).stop 2024-09-19T07:09:39.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.876+0000 7f7d57972640 1 -- 172.21.15.148:0/3681494232 shutdown_connections 2024-09-19T07:09:39.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.876+0000 7f7d57972640 1 --2- 172.21.15.148:0/3681494232 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f7d3c0a32d0 0x7f7d3c0a5790 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:39.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.876+0000 7f7d57972640 1 --2- 172.21.15.148:0/3681494232 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d501055b0 0x7f7d500fd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:39.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.876+0000 7f7d57972640 1 --2- 172.21.15.148:0/3681494232 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d50100e30 0x7f7d500fcbd0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:39.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.876+0000 7f7d57972640 1 --2- 172.21.15.148:0/3681494232 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7d50100480 0x7f7d500fc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:39.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.876+0000 7f7d57972640 1 -- 172.21.15.148:0/3681494232 >> 172.21.15.148:0/3681494232 conn(0x7f7d50077210 msgr2=0x7f7d50107080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:39.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.876+0000 7f7d57972640 1 -- 172.21.15.148:0/3681494232 shutdown_connections 2024-09-19T07:09:39.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:39.876+0000 7f7d57972640 1 -- 172.21.15.148:0/3681494232 wait complete. 2024-09-19T07:09:40.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:40 smithi179 ceph-mon[35716]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:09:40.555 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:40 smithi148 ceph-mon[31180]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:09:40.583 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:09:40.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:40 smithi165 ceph-mon[35326]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:09:40.828 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:09:41.246 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:41 smithi148 ceph-mon[31180]: pgmap v282: 97 pgs: 1 peering, 96 active+clean; 621 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.0 KiB/s wr, 8 op/s; 3.3 KiB/s, 0 objects/s recovering 2024-09-19T07:09:41.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.245+0000 7fbfe91bc640 1 -- 172.21.15.148:0/3263397575 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfe4102d40 msgr2=0x7fbfe4103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:41.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.245+0000 7fbfe91bc640 1 --2- 172.21.15.148:0/3263397575 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfe4102d40 0x7fbfe4103120 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4009900 tx=0x7fbfd402a480 comp rx=0 tx=0).stop 2024-09-19T07:09:41.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.245+0000 7fbfe91bc640 1 -- 172.21.15.148:0/3263397575 shutdown_connections 2024-09-19T07:09:41.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.245+0000 7fbfe91bc640 1 --2- 172.21.15.148:0/3263397575 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfe410c170 0x7fbfe410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:41.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.245+0000 7fbfe91bc640 1 --2- 172.21.15.148:0/3263397575 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbfe4103660 0x7fbfe410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:41.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.245+0000 7fbfe91bc640 1 --2- 172.21.15.148:0/3263397575 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfe4102d40 0x7fbfe4103120 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:41.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.245+0000 7fbfe91bc640 1 -- 172.21.15.148:0/3263397575 >> 172.21.15.148:0/3263397575 conn(0x7fbfe40fc7a0 msgr2=0x7fbfe40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:41.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.245+0000 7fbfe91bc640 1 -- 172.21.15.148:0/3263397575 shutdown_connections 2024-09-19T07:09:41.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.245+0000 7fbfe91bc640 1 -- 172.21.15.148:0/3263397575 wait complete. 2024-09-19T07:09:41.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.246+0000 7fbfe91bc640 1 Processor -- start 2024-09-19T07:09:41.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.246+0000 7fbfe91bc640 1 -- start start 2024-09-19T07:09:41.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.246+0000 7fbfe91bc640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbfe4102d40 0x7fbfe4198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:41.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.246+0000 7fbfe91bc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfe4103660 0x7fbfe4198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:41.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.246+0000 7fbfe91bc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfe410c170 0x7fbfe419cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:41.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.246+0000 7fbfe91bc640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe4112030 con 0x7fbfe4103660 2024-09-19T07:09:41.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.246+0000 7fbfe91bc640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe4111eb0 con 0x7fbfe4102d40 2024-09-19T07:09:41.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.246+0000 7fbfe91bc640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe41121b0 con 0x7fbfe410c170 2024-09-19T07:09:41.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.246+0000 7fbfdbfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfe4103660 0x7fbfe4198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:41.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.246+0000 7fbfdbfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfe4103660 0x7fbfe4198b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56054/0 (socket says 172.21.15.148:56054) 2024-09-19T07:09:41.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.246+0000 7fbfdbfff640 1 -- 172.21.15.148:0/1234230114 learned_addr learned my addr 172.21.15.148:0/1234230114 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:09:41.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.246+0000 7fbfe359e640 1 --2- 172.21.15.148:0/1234230114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfe410c170 0x7fbfe419cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:41.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.246+0000 7fbfdbfff640 1 -- 172.21.15.148:0/1234230114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfe410c170 msgr2=0x7fbfe419cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:41.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.246+0000 7fbfdbfff640 1 --2- 172.21.15.148:0/1234230114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfe410c170 0x7fbfe419cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:41.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.246+0000 7fbfdbfff640 1 -- 172.21.15.148:0/1234230114 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbfe4102d40 msgr2=0x7fbfe4198610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:41.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.246+0000 7fbfe2d9d640 1 --2- 172.21.15.148:0/1234230114 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbfe4102d40 0x7fbfe4198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:41.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.247+0000 7fbfdbfff640 1 --2- 172.21.15.148:0/1234230114 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbfe4102d40 0x7fbfe4198610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:41.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.247+0000 7fbfdbfff640 1 -- 172.21.15.148:0/1234230114 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfe419d5c0 con 0x7fbfe4103660 2024-09-19T07:09:41.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.247+0000 7fbfe359e640 1 --2- 172.21.15.148:0/1234230114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfe410c170 0x7fbfe419cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:09:41.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.247+0000 7fbfe2d9d640 1 --2- 172.21.15.148:0/1234230114 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbfe4102d40 0x7fbfe4198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:09:41.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.247+0000 7fbfdbfff640 1 --2- 172.21.15.148:0/1234230114 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfe4103660 0x7fbfe4198b50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc00b3f0 tx=0x7fbfcc00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:41.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.247+0000 7fbfe0d99640 1 -- 172.21.15.148:0/1234230114 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc015020 con 0x7fbfe4103660 2024-09-19T07:09:41.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.247+0000 7fbfe91bc640 1 -- 172.21.15.148:0/1234230114 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfe419d8b0 con 0x7fbfe4103660 2024-09-19T07:09:41.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.247+0000 7fbfe0d99640 1 -- 172.21.15.148:0/1234230114 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfcc011d10 con 0x7fbfe4103660 2024-09-19T07:09:41.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.247+0000 7fbfe0d99640 1 -- 172.21.15.148:0/1234230114 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc00f2e0 con 0x7fbfe4103660 2024-09-19T07:09:41.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.247+0000 7fbfe91bc640 1 -- 172.21.15.148:0/1234230114 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfe41a5190 con 0x7fbfe4103660 2024-09-19T07:09:41.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.248+0000 7fbfe91bc640 1 -- 172.21.15.148:0/1234230114 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfe41031a0 con 0x7fbfe4103660 2024-09-19T07:09:41.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.249+0000 7fbfe0d99640 1 -- 172.21.15.148:0/1234230114 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fbfcc018020 con 0x7fbfe4103660 2024-09-19T07:09:41.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.250+0000 7fbfe0d99640 1 --2- 172.21.15.148:0/1234230114 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fbfd00a32d0 0x7fbfd00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:41.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.250+0000 7fbfe2d9d640 1 --2- 172.21.15.148:0/1234230114 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fbfd00a32d0 0x7fbfd00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:41.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.250+0000 7fbfe0d99640 1 -- 172.21.15.148:0/1234230114 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7fbfcc0cf2f0 con 0x7fbfe4103660 2024-09-19T07:09:41.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.250+0000 7fbfe2d9d640 1 --2- 172.21.15.148:0/1234230114 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fbfd00a32d0 0x7fbfd00a5790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4000c00 tx=0x7fbfd4032d50 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:41.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.254+0000 7fbfe0d99640 1 -- 172.21.15.148:0/1234230114 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbfcc01f020 con 0x7fbfe4103660 2024-09-19T07:09:41.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.455+0000 7fbfe91bc640 1 -- 172.21.15.148:0/1234230114 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbfe4106c80 con 0x7fbfe4103660 2024-09-19T07:09:41.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.455+0000 7fbfe0d99640 1 -- 172.21.15.148:0/1234230114 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11939 (secure 0 0 0) 0x7fbfcc09bf70 con 0x7fbfe4103660 2024-09-19T07:09:41.456 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:09:41.457 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":24,"btime":"2024-09-19T07:09:30:984194+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/4263868576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":4263868576},{"type":"v1","addr":"172.21.15.148:6841","nonce":4263868576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24383,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2146820965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2146820965},{"type":"v1","addr":"172.21.15.165:6835","nonce":2146820965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:09:19.543369+0000","modified":"2024-09-19T07:09:30.685034+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24457,"mds_1":24437,"mds_2":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/1566489108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1566489108},{"type":"v1","addr":"172.21.15.179:6835","nonce":1566489108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.165:6839/3993490234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":3993490234},{"type":"v1","addr":"172.21.15.165:6839","nonce":3993490234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24457,"qdb_cluster":[24436,24437,24457]},"id":1}]} 2024-09-19T07:09:41.457 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 24 2024-09-19T07:09:41.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.457+0000 7fbfe91bc640 1 -- 172.21.15.148:0/1234230114 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fbfd00a32d0 msgr2=0x7fbfd00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:41.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.457+0000 7fbfe91bc640 1 --2- 172.21.15.148:0/1234230114 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fbfd00a32d0 0x7fbfd00a5790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4000c00 tx=0x7fbfd4032d50 comp rx=0 tx=0).stop 2024-09-19T07:09:41.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.457+0000 7fbfe91bc640 1 -- 172.21.15.148:0/1234230114 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfe4103660 msgr2=0x7fbfe4198b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:41.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.457+0000 7fbfe91bc640 1 --2- 172.21.15.148:0/1234230114 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfe4103660 0x7fbfe4198b50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc00b3f0 tx=0x7fbfcc00b8b0 comp rx=0 tx=0).stop 2024-09-19T07:09:41.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.458+0000 7fbfe91bc640 1 -- 172.21.15.148:0/1234230114 shutdown_connections 2024-09-19T07:09:41.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.458+0000 7fbfe91bc640 1 --2- 172.21.15.148:0/1234230114 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fbfd00a32d0 0x7fbfd00a5790 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:41.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.458+0000 7fbfe91bc640 1 --2- 172.21.15.148:0/1234230114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfe410c170 0x7fbfe419cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:41.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.458+0000 7fbfe91bc640 1 --2- 172.21.15.148:0/1234230114 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfe4103660 0x7fbfe4198b50 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:41.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.458+0000 7fbfe91bc640 1 --2- 172.21.15.148:0/1234230114 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbfe4102d40 0x7fbfe4198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:41.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.458+0000 7fbfe91bc640 1 -- 172.21.15.148:0/1234230114 >> 172.21.15.148:0/1234230114 conn(0x7fbfe40fc7a0 msgr2=0x7fbfe40fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:41.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.458+0000 7fbfe91bc640 1 -- 172.21.15.148:0/1234230114 shutdown_connections 2024-09-19T07:09:41.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:41.458+0000 7fbfe91bc640 1 -- 172.21.15.148:0/1234230114 wait complete. 2024-09-19T07:09:41.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:41 smithi179 ceph-mon[35716]: pgmap v282: 97 pgs: 1 peering, 96 active+clean; 621 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.0 KiB/s wr, 8 op/s; 3.3 KiB/s, 0 objects/s recovering 2024-09-19T07:09:41.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:41 smithi165 ceph-mon[35326]: pgmap v282: 97 pgs: 1 peering, 96 active+clean; 621 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.0 KiB/s wr, 8 op/s; 3.3 KiB/s, 0 objects/s recovering 2024-09-19T07:09:42.095 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T07:09:42.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:42 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/1234230114' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:09:42.347 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:09:42.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:42 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/1234230114' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:09:42.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:42 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/1234230114' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:09:42.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:42.830+0000 7f8a68824640 1 -- 172.21.15.148:0/203119834 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a64103660 msgr2=0x7f8a6410bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:42.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:42.830+0000 7f8a68824640 1 --2- 172.21.15.148:0/203119834 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a64103660 0x7f8a6410bb50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8a58009900 tx=0x7f8a5802a480 comp rx=0 tx=0).stop 2024-09-19T07:09:42.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:42.830+0000 7f8a68824640 1 -- 172.21.15.148:0/203119834 shutdown_connections 2024-09-19T07:09:42.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:42.830+0000 7f8a68824640 1 --2- 172.21.15.148:0/203119834 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a6410c170 0x7f8a6410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:42.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:42.830+0000 7f8a68824640 1 --2- 172.21.15.148:0/203119834 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a64103660 0x7f8a6410bb50 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:42.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:42.830+0000 7f8a68824640 1 --2- 172.21.15.148:0/203119834 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a64102d40 0x7f8a64103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:42.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:42.830+0000 7f8a68824640 1 -- 172.21.15.148:0/203119834 >> 172.21.15.148:0/203119834 conn(0x7f8a640fc7a0 msgr2=0x7f8a640febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:42.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:42.830+0000 7f8a68824640 1 -- 172.21.15.148:0/203119834 shutdown_connections 2024-09-19T07:09:42.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:42.830+0000 7f8a68824640 1 -- 172.21.15.148:0/203119834 wait complete. 2024-09-19T07:09:42.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:42.831+0000 7f8a68824640 1 Processor -- start 2024-09-19T07:09:42.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:42.831+0000 7f8a68824640 1 -- start start 2024-09-19T07:09:42.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:42.831+0000 7f8a68824640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a64102d40 0x7f8a64198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:42.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:42.831+0000 7f8a68824640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a64103660 0x7f8a64198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:42.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:42.831+0000 7f8a68824640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a6410c170 0x7f8a6419cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:42.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:42.831+0000 7f8a68824640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8a64111fb0 con 0x7f8a64102d40 2024-09-19T07:09:42.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:42.831+0000 7f8a68824640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8a64111e30 con 0x7f8a6410c170 2024-09-19T07:09:42.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:42.831+0000 7f8a68824640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8a64112130 con 0x7f8a64103660 2024-09-19T07:09:42.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:42.831+0000 7f8a6259c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a64102d40 0x7f8a64198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:42.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:42.831+0000 7f8a6259c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a64102d40 0x7f8a64198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56074/0 (socket says 172.21.15.148:56074) 2024-09-19T07:09:42.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:42.831+0000 7f8a6259c640 1 -- 172.21.15.148:0/2271433074 learned_addr learned my addr 172.21.15.148:0/2271433074 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:09:42.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:42.831+0000 7f8a61d9b640 1 --2- 172.21.15.148:0/2271433074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a64103660 0x7f8a64198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:42.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:42.831+0000 7f8a62d9d640 1 --2- 172.21.15.148:0/2271433074 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a6410c170 0x7f8a6419cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:42.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:42.831+0000 7f8a6259c640 1 -- 172.21.15.148:0/2271433074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a64103660 msgr2=0x7f8a64198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:42.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:42.831+0000 7f8a6259c640 1 --2- 172.21.15.148:0/2271433074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a64103660 0x7f8a64198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:42.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:42.831+0000 7f8a6259c640 1 -- 172.21.15.148:0/2271433074 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a6410c170 msgr2=0x7f8a6419cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:42.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:42.831+0000 7f8a6259c640 1 --2- 172.21.15.148:0/2271433074 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a6410c170 0x7f8a6419cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:42.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:42.831+0000 7f8a6259c640 1 -- 172.21.15.148:0/2271433074 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a6419d3c0 con 0x7f8a64102d40 2024-09-19T07:09:42.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:42.831+0000 7f8a61d9b640 1 --2- 172.21.15.148:0/2271433074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a64103660 0x7f8a64198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:09:42.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:42.832+0000 7f8a6259c640 1 --2- 172.21.15.148:0/2271433074 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a64102d40 0x7f8a64198410 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8a5400c920 tx=0x7f8a5400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:42.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:42.832+0000 7f8a537fe640 1 -- 172.21.15.148:0/2271433074 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a54007c70 con 0x7f8a64102d40 2024-09-19T07:09:42.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:42.832+0000 7f8a537fe640 1 -- 172.21.15.148:0/2271433074 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a54007e10 con 0x7f8a64102d40 2024-09-19T07:09:42.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:42.832+0000 7f8a68824640 1 -- 172.21.15.148:0/2271433074 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a6419d6b0 con 0x7f8a64102d40 2024-09-19T07:09:42.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:42.832+0000 7f8a537fe640 1 -- 172.21.15.148:0/2271433074 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a54018890 con 0x7f8a64102d40 2024-09-19T07:09:42.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:42.832+0000 7f8a68824640 1 -- 172.21.15.148:0/2271433074 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a641008d0 con 0x7f8a64102d40 2024-09-19T07:09:42.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:42.833+0000 7f8a68824640 1 -- 172.21.15.148:0/2271433074 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a64103120 con 0x7f8a64102d40 2024-09-19T07:09:42.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:42.834+0000 7f8a537fe640 1 -- 172.21.15.148:0/2271433074 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f8a54018a50 con 0x7f8a64102d40 2024-09-19T07:09:42.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:42.834+0000 7f8a537fe640 1 --2- 172.21.15.148:0/2271433074 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f8a4c0a32d0 0x7f8a4c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:42.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:42.835+0000 7f8a61d9b640 1 --2- 172.21.15.148:0/2271433074 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f8a4c0a32d0 0x7f8a4c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:42.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:42.835+0000 7f8a537fe640 1 -- 172.21.15.148:0/2271433074 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7f8a540cfc80 con 0x7f8a64102d40 2024-09-19T07:09:42.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:42.835+0000 7f8a61d9b640 1 --2- 172.21.15.148:0/2271433074 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f8a4c0a32d0 0x7f8a4c0a5790 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8a58000c00 tx=0x7f8a58032d50 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:42.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:42.839+0000 7f8a537fe640 1 -- 172.21.15.148:0/2271433074 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8a54014030 con 0x7f8a64102d40 2024-09-19T07:09:43.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:43.012+0000 7f8a68824640 1 -- 172.21.15.148:0/2271433074 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8a64199770 con 0x7f8a64102d40 2024-09-19T07:09:43.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:43.013+0000 7f8a537fe640 1 -- 172.21.15.148:0/2271433074 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22807 (secure 0 0 0) 0x7f8a5409c850 con 0x7f8a64102d40 2024-09-19T07:09:43.015 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:09:43.015 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":80,"fsid":"eae8a4a8-7654-11ef-bceb-c7b262605968","created":"2024-09-19T07:01:47.891210+0000","modified":"2024-09-19T07:09:38.168257+0000","last_up_change":"2024-09-19T07:08:30.785262+0000","last_in_change":"2024-09-19T07:08:07.001808+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:04:49.313270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T07:09:15.840600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T07:09:17.690782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7b854fad-d5a3-43e3-862e-7a0e8f243c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6803","nonce":512186330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6805","nonce":512186330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6809","nonce":512186330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6807","nonce":512186330}]},"public_addr":"172.21.15.148:6803/512186330","cluster_addr":"172.21.15.148:6805/512186330","heartbeat_back_addr":"172.21.15.148:6809/512186330","heartbeat_front_addr":"172.21.15.148:6807/512186330","state":["exists","up"]},{"osd":1,"uuid":"61b26278-f4db-40f0-97b9-c12a6ef1cd06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6801","nonce":2433984552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6803","nonce":2433984552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6807","nonce":2433984552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6805","nonce":2433984552}]},"public_addr":"172.21.15.165:6801/2433984552","cluster_addr":"172.21.15.165:6803/2433984552","heartbeat_back_addr":"172.21.15.165:6807/2433984552","heartbeat_front_addr":"172.21.15.165:6805/2433984552","state":["exists","up"]},{"osd":2,"uuid":"06620bbc-cdb5-4afc-8122-0bb3126630f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6801","nonce":3048365223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6803","nonce":3048365223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6807","nonce":3048365223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6805","nonce":3048365223}]},"public_addr":"172.21.15.179:6801/3048365223","cluster_addr":"172.21.15.179:6803/3048365223","heartbeat_back_addr":"172.21.15.179:6807/3048365223","heartbeat_front_addr":"172.21.15.179:6805/3048365223","state":["exists","up"]},{"osd":3,"uuid":"d7df45d4-5ef1-4f66-84a7-f61b8756c0c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6811","nonce":3662789091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6813","nonce":3662789091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6817","nonce":3662789091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6815","nonce":3662789091}]},"public_addr":"172.21.15.148:6811/3662789091","cluster_addr":"172.21.15.148:6813/3662789091","heartbeat_back_addr":"172.21.15.148:6817/3662789091","heartbeat_front_addr":"172.21.15.148:6815/3662789091","state":["exists","up"]},{"osd":4,"uuid":"5cfd359b-a8d2-4bdc-858f-087d26e0869c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6809","nonce":3082550323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6811","nonce":3082550323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6815","nonce":3082550323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6813","nonce":3082550323}]},"public_addr":"172.21.15.165:6809/3082550323","cluster_addr":"172.21.15.165:6811/3082550323","heartbeat_back_addr":"172.21.15.165:6815/3082550323","heartbeat_front_addr":"172.21.15.165:6813/3082550323","state":["exists","up"]},{"osd":5,"uuid":"8295e69b-87fe-4403-bb2e-d9dd42e2f398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6809","nonce":2125213751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6811","nonce":2125213751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6815","nonce":2125213751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6813","nonce":2125213751}]},"public_addr":"172.21.15.179:6809/2125213751","cluster_addr":"172.21.15.179:6811/2125213751","heartbeat_back_addr":"172.21.15.179:6815/2125213751","heartbeat_front_addr":"172.21.15.179:6813/2125213751","state":["exists","up"]},{"osd":6,"uuid":"4ce38d1a-06d3-4606-b00d-aa1ff977025f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6819","nonce":2178980310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6821","nonce":2178980310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6825","nonce":2178980310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6823","nonce":2178980310}]},"public_addr":"172.21.15.148:6819/2178980310","cluster_addr":"172.21.15.148:6821/2178980310","heartbeat_back_addr":"172.21.15.148:6825/2178980310","heartbeat_front_addr":"172.21.15.148:6823/2178980310","state":["exists","up"]},{"osd":7,"uuid":"9e68e2b2-9838-4ec0-b473-24f2434695ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6817","nonce":3961600099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6819","nonce":3961600099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6823","nonce":3961600099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6821","nonce":3961600099}]},"public_addr":"172.21.15.165:6817/3961600099","cluster_addr":"172.21.15.165:6819/3961600099","heartbeat_back_addr":"172.21.15.165:6823/3961600099","heartbeat_front_addr":"172.21.15.165:6821/3961600099","state":["exists","up"]},{"osd":8,"uuid":"297acce6-d3c7-4e1a-bf87-be093de51a6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6817","nonce":3642931467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6819","nonce":3642931467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6823","nonce":3642931467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6821","nonce":3642931467}]},"public_addr":"172.21.15.179:6817/3642931467","cluster_addr":"172.21.15.179:6819/3642931467","heartbeat_back_addr":"172.21.15.179:6823/3642931467","heartbeat_front_addr":"172.21.15.179:6821/3642931467","state":["exists","up"]},{"osd":9,"uuid":"ef488c5e-5353-4695-99dd-5b74ade436d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6827","nonce":3135409630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6829","nonce":3135409630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6833","nonce":3135409630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6831","nonce":3135409630}]},"public_addr":"172.21.15.148:6827/3135409630","cluster_addr":"172.21.15.148:6829/3135409630","heartbeat_back_addr":"172.21.15.148:6833/3135409630","heartbeat_front_addr":"172.21.15.148:6831/3135409630","state":["exists","up"]},{"osd":10,"uuid":"7a9f0379-1199-4266-910c-8d1d313d39e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6825","nonce":3554110731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6827","nonce":3554110731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6831","nonce":3554110731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6829","nonce":3554110731}]},"public_addr":"172.21.15.165:6825/3554110731","cluster_addr":"172.21.15.165:6827/3554110731","heartbeat_back_addr":"172.21.15.165:6831/3554110731","heartbeat_front_addr":"172.21.15.165:6829/3554110731","state":["exists","up"]},{"osd":11,"uuid":"eede97e9-5685-4603-806e-7078c6940536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6825","nonce":2026109940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6827","nonce":2026109940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6831","nonce":2026109940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6829","nonce":2026109940}]},"public_addr":"172.21.15.179:6825/2026109940","cluster_addr":"172.21.15.179:6827/2026109940","heartbeat_back_addr":"172.21.15.179:6831/2026109940","heartbeat_front_addr":"172.21.15.179:6829/2026109940","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:03:56.291685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:21.419682+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:46.377012+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:11.484234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:36.723101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:06:00.294617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:06:25.147230+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:06:49.318576+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:07:13.896399+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:07:38.930999+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:08:03.803463+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:08:28.731343+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.148:0/3534559227":"2024-09-20T07:02:37.007183+0000","172.21.15.148:0/1958388906":"2024-09-20T07:02:37.007183+0000","172.21.15.148:0/1922521135":"2024-09-20T07:02:37.007183+0000","172.21.15.148:6801/1949849385":"2024-09-20T07:02:37.007183+0000","172.21.15.148:6800/1949849385":"2024-09-20T07:02:37.007183+0000","172.21.15.148:6800/2161746152":"2024-09-20T07:02:14.557425+0000","172.21.15.148:6801/2161746152":"2024-09-20T07:02:14.557425+0000","172.21.15.148:0/1480486619":"2024-09-20T07:02:14.557425+0000","172.21.15.148:0/174481494":"2024-09-20T07:02:14.557425+0000","172.21.15.148:0/1114469409":"2024-09-20T07:02:14.557425+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T07:09:43.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:43.015+0000 7f8a68824640 1 -- 172.21.15.148:0/2271433074 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f8a4c0a32d0 msgr2=0x7f8a4c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:43.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:43.015+0000 7f8a68824640 1 --2- 172.21.15.148:0/2271433074 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f8a4c0a32d0 0x7f8a4c0a5790 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8a58000c00 tx=0x7f8a58032d50 comp rx=0 tx=0).stop 2024-09-19T07:09:43.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:43.015+0000 7f8a68824640 1 -- 172.21.15.148:0/2271433074 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a64102d40 msgr2=0x7f8a64198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:43.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:43.015+0000 7f8a68824640 1 --2- 172.21.15.148:0/2271433074 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a64102d40 0x7f8a64198410 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8a5400c920 tx=0x7f8a5400cde0 comp rx=0 tx=0).stop 2024-09-19T07:09:43.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:43.015+0000 7f8a68824640 1 -- 172.21.15.148:0/2271433074 shutdown_connections 2024-09-19T07:09:43.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:43.015+0000 7f8a68824640 1 --2- 172.21.15.148:0/2271433074 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f8a4c0a32d0 0x7f8a4c0a5790 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:43.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:43.015+0000 7f8a68824640 1 --2- 172.21.15.148:0/2271433074 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a6410c170 0x7f8a6419cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:43.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:43.015+0000 7f8a68824640 1 --2- 172.21.15.148:0/2271433074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a64103660 0x7f8a64198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:43.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:43.015+0000 7f8a68824640 1 --2- 172.21.15.148:0/2271433074 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a64102d40 0x7f8a64198410 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:43.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:43.016+0000 7f8a68824640 1 -- 172.21.15.148:0/2271433074 >> 172.21.15.148:0/2271433074 conn(0x7f8a640fc7a0 msgr2=0x7f8a640fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:43.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:43.016+0000 7f8a68824640 1 -- 172.21.15.148:0/2271433074 shutdown_connections 2024-09-19T07:09:43.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:43.016+0000 7f8a68824640 1 -- 172.21.15.148:0/2271433074 wait complete. 2024-09-19T07:09:43.302 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:43 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/2271433074' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:09:43.302 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:43 smithi148 ceph-mon[31180]: pgmap v283: 97 pgs: 97 active+clean; 621 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.2 KiB/s wr, 10 op/s; 3.3 KiB/s, 0 objects/s recovering 2024-09-19T07:09:43.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:43 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/2271433074' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:09:43.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:43 smithi179 ceph-mon[35716]: pgmap v283: 97 pgs: 97 active+clean; 621 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.2 KiB/s wr, 10 op/s; 3.3 KiB/s, 0 objects/s recovering 2024-09-19T07:09:43.622 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T07:09:43.623 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T07:09:43.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:43 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/2271433074' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:09:43.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:43 smithi165 ceph-mon[35326]: pgmap v283: 97 pgs: 97 active+clean; 621 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.2 KiB/s wr, 10 op/s; 3.3 KiB/s, 0 objects/s recovering 2024-09-19T07:09:43.871 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:09:44.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.318+0000 7f33c3119640 1 -- 172.21.15.148:0/51255275 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33bc100e20 msgr2=0x7f33bc101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:44.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.318+0000 7f33c3119640 1 --2- 172.21.15.148:0/51255275 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33bc100e20 0x7f33bc101200 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f33ac009ca0 tx=0x7f33ac02a950 comp rx=0 tx=0).stop 2024-09-19T07:09:44.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.318+0000 7f33c3119640 1 -- 172.21.15.148:0/51255275 shutdown_connections 2024-09-19T07:09:44.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.318+0000 7f33c3119640 1 --2- 172.21.15.148:0/51255275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f33bc102ef0 0x7f33bc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:44.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.318+0000 7f33c3119640 1 --2- 172.21.15.148:0/51255275 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33bc102570 0x7f33bc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:44.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.318+0000 7f33c3119640 1 --2- 172.21.15.148:0/51255275 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33bc100e20 0x7f33bc101200 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:44.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.318+0000 7f33c3119640 1 -- 172.21.15.148:0/51255275 >> 172.21.15.148:0/51255275 conn(0x7f33bc0fc7d0 msgr2=0x7f33bc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:44.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.318+0000 7f33c3119640 1 -- 172.21.15.148:0/51255275 shutdown_connections 2024-09-19T07:09:44.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.318+0000 7f33c3119640 1 -- 172.21.15.148:0/51255275 wait complete. 2024-09-19T07:09:44.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.318+0000 7f33c3119640 1 Processor -- start 2024-09-19T07:09:44.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.319+0000 7f33c3119640 1 -- start start 2024-09-19T07:09:44.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.319+0000 7f33c3119640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33bc100e20 0x7f33bc0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:44.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.319+0000 7f33c3119640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f33bc102570 0x7f33bc0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:44.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.319+0000 7f33c3119640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33bc102ef0 0x7f33bc0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:44.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.319+0000 7f33c3119640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f33bc110f50 con 0x7f33bc100e20 2024-09-19T07:09:44.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.319+0000 7f33c3119640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f33bc110dd0 con 0x7f33bc102570 2024-09-19T07:09:44.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.319+0000 7f33c3119640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f33bc1110d0 con 0x7f33bc102ef0 2024-09-19T07:09:44.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.319+0000 7f33c0eb5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33bc100e20 0x7f33bc0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:44.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.319+0000 7f33c0eb5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33bc100e20 0x7f33bc0fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60206/0 (socket says 172.21.15.148:60206) 2024-09-19T07:09:44.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.319+0000 7f33c0eb5640 1 -- 172.21.15.148:0/2296431812 learned_addr learned my addr 172.21.15.148:0/2296431812 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:09:44.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.319+0000 7f33c16b6640 1 --2- 172.21.15.148:0/2296431812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33bc102ef0 0x7f33bc0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:44.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.319+0000 7f33bbfff640 1 --2- 172.21.15.148:0/2296431812 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f33bc102570 0x7f33bc0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:44.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.319+0000 7f33c0eb5640 1 -- 172.21.15.148:0/2296431812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33bc102ef0 msgr2=0x7f33bc0fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:44.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.319+0000 7f33c0eb5640 1 --2- 172.21.15.148:0/2296431812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33bc102ef0 0x7f33bc0fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:44.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.319+0000 7f33c0eb5640 1 -- 172.21.15.148:0/2296431812 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f33bc102570 msgr2=0x7f33bc0fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:44.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.319+0000 7f33c0eb5640 1 --2- 172.21.15.148:0/2296431812 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f33bc102570 0x7f33bc0fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:44.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.319+0000 7f33c0eb5640 1 -- 172.21.15.148:0/2296431812 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33bc1a6960 con 0x7f33bc100e20 2024-09-19T07:09:44.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.319+0000 7f33c16b6640 1 --2- 172.21.15.148:0/2296431812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33bc102ef0 0x7f33bc0fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:09:44.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.319+0000 7f33c0eb5640 1 --2- 172.21.15.148:0/2296431812 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33bc100e20 0x7f33bc0fcc80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f33ac005cc0 tx=0x7f33ac02f630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:44.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.319+0000 7f33b9ffb640 1 -- 172.21.15.148:0/2296431812 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ac034040 con 0x7f33bc100e20 2024-09-19T07:09:44.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.319+0000 7f33c3119640 1 -- 172.21.15.148:0/2296431812 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33bc1a6bf0 con 0x7f33bc100e20 2024-09-19T07:09:44.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.319+0000 7f33b9ffb640 1 -- 172.21.15.148:0/2296431812 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33ac030920 con 0x7f33bc100e20 2024-09-19T07:09:44.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.319+0000 7f33b9ffb640 1 -- 172.21.15.148:0/2296431812 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ac004790 con 0x7f33bc100e20 2024-09-19T07:09:44.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.320+0000 7f33c3119640 1 -- 172.21.15.148:0/2296431812 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33bc1a70d0 con 0x7f33bc100e20 2024-09-19T07:09:44.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.321+0000 7f33c3119640 1 -- 172.21.15.148:0/2296431812 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33bc101200 con 0x7f33bc100e20 2024-09-19T07:09:44.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.322+0000 7f33b9ffb640 1 -- 172.21.15.148:0/2296431812 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f33ac037020 con 0x7f33bc100e20 2024-09-19T07:09:44.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.322+0000 7f33b9ffb640 1 --2- 172.21.15.148:0/2296431812 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f33a40a32d0 0x7f33a40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:44.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.322+0000 7f33bbfff640 1 --2- 172.21.15.148:0/2296431812 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f33a40a32d0 0x7f33a40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:44.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.322+0000 7f33b9ffb640 1 -- 172.21.15.148:0/2296431812 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7f33ac0f0960 con 0x7f33bc100e20 2024-09-19T07:09:44.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.323+0000 7f33bbfff640 1 --2- 172.21.15.148:0/2296431812 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f33a40a32d0 0x7f33a40a5790 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f33b0005fd0 tx=0x7f33b0005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:44.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.326+0000 7f33b9ffb640 1 -- 172.21.15.148:0/2296431812 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f33ac0bd640 con 0x7f33bc100e20 2024-09-19T07:09:44.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.490+0000 7f33c3119640 1 -- 172.21.15.148:0/2296431812 --> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f33bc106f10 con 0x7f33a40a32d0 2024-09-19T07:09:44.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.497+0000 7f33b9ffb640 1 -- 172.21.15.148:0/2296431812 <== mgr.14148 v2:172.21.15.148:6800/3007822654 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258720 (secure 0 0 0) 0x7f33bc106f10 con 0x7f33a40a32d0 2024-09-19T07:09:44.500 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:09:44.505 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2024-09-19T07:09:44.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.500+0000 7f33c3119640 1 -- 172.21.15.148:0/2296431812 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f33a40a32d0 msgr2=0x7f33a40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:44.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.500+0000 7f33c3119640 1 --2- 172.21.15.148:0/2296431812 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f33a40a32d0 0x7f33a40a5790 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f33b0005fd0 tx=0x7f33b0005850 comp rx=0 tx=0).stop 2024-09-19T07:09:44.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.500+0000 7f33c3119640 1 -- 172.21.15.148:0/2296431812 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33bc100e20 msgr2=0x7f33bc0fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:44.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.500+0000 7f33c3119640 1 --2- 172.21.15.148:0/2296431812 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33bc100e20 0x7f33bc0fcc80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f33ac005cc0 tx=0x7f33ac02f630 comp rx=0 tx=0).stop 2024-09-19T07:09:44.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.500+0000 7f33c3119640 1 -- 172.21.15.148:0/2296431812 shutdown_connections 2024-09-19T07:09:44.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.500+0000 7f33c3119640 1 --2- 172.21.15.148:0/2296431812 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f33a40a32d0 0x7f33a40a5790 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:44.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.500+0000 7f33c3119640 1 --2- 172.21.15.148:0/2296431812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33bc102ef0 0x7f33bc0fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:44.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.500+0000 7f33c3119640 1 --2- 172.21.15.148:0/2296431812 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f33bc102570 0x7f33bc0fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:44.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.500+0000 7f33c3119640 1 --2- 172.21.15.148:0/2296431812 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33bc100e20 0x7f33bc0fcc80 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:44.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.500+0000 7f33c3119640 1 -- 172.21.15.148:0/2296431812 >> 172.21.15.148:0/2296431812 conn(0x7f33bc0fc7d0 msgr2=0x7f33bc069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:44.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.500+0000 7f33c3119640 1 -- 172.21.15.148:0/2296431812 shutdown_connections 2024-09-19T07:09:44.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:44.500+0000 7f33c3119640 1 -- 172.21.15.148:0/2296431812 wait complete. 2024-09-19T07:09:45.315 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":283,"stamp":"2024-09-19T07:09:43.089301+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":636063,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":231,"num_read_kb":210,"num_write":335,"num_write_kb":3027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1207683,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":269,"ondisk_log_size":269,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":382396,"kb_used_data":12276,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124559428,"statfs":{"total":1151940427776,"available":1151548854272,"internally_reserved":0,"allocated":12570624,"data_stored":6992745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":378713402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":40080,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":62,"num_write":28,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":26947,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001668"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.173070+0000","last_change":"2024-09-19T07:09:18.926902+0000","last_active":"2024-09-19T07:09:38.173070+0000","last_peered":"2024-09-19T07:09:38.173070+0000","last_clean":"2024-09-19T07:09:38.173070+0000","last_became_active":"2024-09-19T07:09:18.926582+0000","last_became_peered":"2024-09-19T07:09:18.926582+0000","last_unstale":"2024-09-19T07:09:38.173070+0000","last_undegraded":"2024-09-19T07:09:38.173070+0000","last_fullsized":"2024-09-19T07:09:38.173070+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:37.875779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.178193+0000","last_change":"2024-09-19T07:09:18.934205+0000","last_active":"2024-09-19T07:09:38.178193+0000","last_peered":"2024-09-19T07:09:38.178193+0000","last_clean":"2024-09-19T07:09:38.178193+0000","last_became_active":"2024-09-19T07:09:18.933767+0000","last_became_peered":"2024-09-19T07:09:18.933767+0000","last_unstale":"2024-09-19T07:09:38.178193+0000","last_undegraded":"2024-09-19T07:09:38.178193+0000","last_fullsized":"2024-09-19T07:09:38.178193+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:10:45.391428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.177846+0000","last_change":"2024-09-19T07:09:18.922312+0000","last_active":"2024-09-19T07:09:38.177846+0000","last_peered":"2024-09-19T07:09:38.177846+0000","last_clean":"2024-09-19T07:09:38.177846+0000","last_became_active":"2024-09-19T07:09:18.921476+0000","last_became_peered":"2024-09-19T07:09:18.921476+0000","last_unstale":"2024-09-19T07:09:38.177846+0000","last_undegraded":"2024-09-19T07:09:38.177846+0000","last_fullsized":"2024-09-19T07:09:38.177846+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:29.470616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.217953+0000","last_change":"2024-09-19T07:09:18.938218+0000","last_active":"2024-09-19T07:09:38.217953+0000","last_peered":"2024-09-19T07:09:38.217953+0000","last_clean":"2024-09-19T07:09:38.217953+0000","last_became_active":"2024-09-19T07:09:18.937306+0000","last_became_peered":"2024-09-19T07:09:18.937306+0000","last_unstale":"2024-09-19T07:09:38.217953+0000","last_undegraded":"2024-09-19T07:09:38.217953+0000","last_fullsized":"2024-09-19T07:09:38.217953+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:54.146506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.176208+0000","last_change":"2024-09-19T07:09:18.925837+0000","last_active":"2024-09-19T07:09:38.176208+0000","last_peered":"2024-09-19T07:09:38.176208+0000","last_clean":"2024-09-19T07:09:38.176208+0000","last_became_active":"2024-09-19T07:09:18.925559+0000","last_became_peered":"2024-09-19T07:09:18.925559+0000","last_unstale":"2024-09-19T07:09:38.176208+0000","last_undegraded":"2024-09-19T07:09:38.176208+0000","last_fullsized":"2024-09-19T07:09:38.176208+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:15:58.348347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.172737+0000","last_change":"2024-09-19T07:09:18.938911+0000","last_active":"2024-09-19T07:09:38.172737+0000","last_peered":"2024-09-19T07:09:38.172737+0000","last_clean":"2024-09-19T07:09:38.172737+0000","last_became_active":"2024-09-19T07:09:18.938601+0000","last_became_peered":"2024-09-19T07:09:18.938601+0000","last_unstale":"2024-09-19T07:09:38.172737+0000","last_undegraded":"2024-09-19T07:09:38.172737+0000","last_fullsized":"2024-09-19T07:09:38.172737+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:34.517324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175176+0000","last_change":"2024-09-19T07:09:18.930253+0000","last_active":"2024-09-19T07:09:38.175176+0000","last_peered":"2024-09-19T07:09:38.175176+0000","last_clean":"2024-09-19T07:09:38.175176+0000","last_became_active":"2024-09-19T07:09:18.929927+0000","last_became_peered":"2024-09-19T07:09:18.929927+0000","last_unstale":"2024-09-19T07:09:38.175176+0000","last_undegraded":"2024-09-19T07:09:38.175176+0000","last_fullsized":"2024-09-19T07:09:38.175176+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:31:39.186230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.180634+0000","last_change":"2024-09-19T07:09:38.180197+0000","last_active":"2024-09-19T07:09:38.180634+0000","last_peered":"2024-09-19T07:09:38.180634+0000","last_clean":"2024-09-19T07:09:38.180634+0000","last_became_active":"2024-09-19T07:09:38.179767+0000","last_became_peered":"2024-09-19T07:09:38.179767+0000","last_unstale":"2024-09-19T07:09:38.180634+0000","last_undegraded":"2024-09-19T07:09:38.180634+0000","last_fullsized":"2024-09-19T07:09:38.180634+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:43.581181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.176298+0000","last_change":"2024-09-19T07:09:18.937100+0000","last_active":"2024-09-19T07:09:38.176298+0000","last_peered":"2024-09-19T07:09:38.176298+0000","last_clean":"2024-09-19T07:09:38.176298+0000","last_became_active":"2024-09-19T07:09:18.935151+0000","last_became_peered":"2024-09-19T07:09:18.935151+0000","last_unstale":"2024-09-19T07:09:38.176298+0000","last_undegraded":"2024-09-19T07:09:38.176298+0000","last_fullsized":"2024-09-19T07:09:38.176298+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:46:30.950667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.173253+0000","last_change":"2024-09-19T07:09:18.940119+0000","last_active":"2024-09-19T07:09:38.173253+0000","last_peered":"2024-09-19T07:09:38.173253+0000","last_clean":"2024-09-19T07:09:38.173253+0000","last_became_active":"2024-09-19T07:09:18.939703+0000","last_became_peered":"2024-09-19T07:09:18.939703+0000","last_unstale":"2024-09-19T07:09:38.173253+0000","last_undegraded":"2024-09-19T07:09:38.173253+0000","last_fullsized":"2024-09-19T07:09:38.173253+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:51:04.982727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175765+0000","last_change":"2024-09-19T07:09:18.939146+0000","last_active":"2024-09-19T07:09:38.175765+0000","last_peered":"2024-09-19T07:09:38.175765+0000","last_clean":"2024-09-19T07:09:38.175765+0000","last_became_active":"2024-09-19T07:09:18.936842+0000","last_became_peered":"2024-09-19T07:09:18.936842+0000","last_unstale":"2024-09-19T07:09:38.175765+0000","last_undegraded":"2024-09-19T07:09:38.175765+0000","last_fullsized":"2024-09-19T07:09:38.175765+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:32.713505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.179358+0000","last_change":"2024-09-19T07:09:38.178834+0000","last_active":"2024-09-19T07:09:38.179358+0000","last_peered":"2024-09-19T07:09:38.179358+0000","last_clean":"2024-09-19T07:09:38.179358+0000","last_became_active":"2024-09-19T07:09:38.178477+0000","last_became_peered":"2024-09-19T07:09:38.178477+0000","last_unstale":"2024-09-19T07:09:38.179358+0000","last_undegraded":"2024-09-19T07:09:38.179358+0000","last_fullsized":"2024-09-19T07:09:38.179358+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:04:44.524920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.392086+0000","last_change":"2024-09-19T07:09:18.935422+0000","last_active":"2024-09-19T07:09:38.392086+0000","last_peered":"2024-09-19T07:09:38.392086+0000","last_clean":"2024-09-19T07:09:38.392086+0000","last_became_active":"2024-09-19T07:09:18.934994+0000","last_became_peered":"2024-09-19T07:09:18.934994+0000","last_unstale":"2024-09-19T07:09:38.392086+0000","last_undegraded":"2024-09-19T07:09:38.392086+0000","last_fullsized":"2024-09-19T07:09:38.392086+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:37:30.751247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.177649+0000","last_change":"2024-09-19T07:09:18.933954+0000","last_active":"2024-09-19T07:09:38.177649+0000","last_peered":"2024-09-19T07:09:38.177649+0000","last_clean":"2024-09-19T07:09:38.177649+0000","last_became_active":"2024-09-19T07:09:18.933588+0000","last_became_peered":"2024-09-19T07:09:18.933588+0000","last_unstale":"2024-09-19T07:09:38.177649+0000","last_undegraded":"2024-09-19T07:09:38.177649+0000","last_fullsized":"2024-09-19T07:09:38.177649+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:10.161172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.177587+0000","last_change":"2024-09-19T07:09:18.932122+0000","last_active":"2024-09-19T07:09:38.177587+0000","last_peered":"2024-09-19T07:09:38.177587+0000","last_clean":"2024-09-19T07:09:38.177587+0000","last_became_active":"2024-09-19T07:09:18.931798+0000","last_became_peered":"2024-09-19T07:09:18.931798+0000","last_unstale":"2024-09-19T07:09:38.177587+0000","last_undegraded":"2024-09-19T07:09:38.177587+0000","last_fullsized":"2024-09-19T07:09:38.177587+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:44.776375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175320+0000","last_change":"2024-09-19T07:09:18.935632+0000","last_active":"2024-09-19T07:09:38.175320+0000","last_peered":"2024-09-19T07:09:38.175320+0000","last_clean":"2024-09-19T07:09:38.175320+0000","last_became_active":"2024-09-19T07:09:18.935174+0000","last_became_peered":"2024-09-19T07:09:18.935174+0000","last_unstale":"2024-09-19T07:09:38.175320+0000","last_undegraded":"2024-09-19T07:09:38.175320+0000","last_fullsized":"2024-09-19T07:09:38.175320+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:22.170777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.173065+0000","last_change":"2024-09-19T07:09:18.931836+0000","last_active":"2024-09-19T07:09:38.173065+0000","last_peered":"2024-09-19T07:09:38.173065+0000","last_clean":"2024-09-19T07:09:38.173065+0000","last_became_active":"2024-09-19T07:09:18.931564+0000","last_became_peered":"2024-09-19T07:09:18.931564+0000","last_unstale":"2024-09-19T07:09:38.173065+0000","last_undegraded":"2024-09-19T07:09:38.173065+0000","last_fullsized":"2024-09-19T07:09:38.173065+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:53.674584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.173640+0000","last_change":"2024-09-19T07:09:18.933210+0000","last_active":"2024-09-19T07:09:38.173640+0000","last_peered":"2024-09-19T07:09:38.173640+0000","last_clean":"2024-09-19T07:09:38.173640+0000","last_became_active":"2024-09-19T07:09:18.932894+0000","last_became_peered":"2024-09-19T07:09:18.932894+0000","last_unstale":"2024-09-19T07:09:38.173640+0000","last_undegraded":"2024-09-19T07:09:38.173640+0000","last_fullsized":"2024-09-19T07:09:38.173640+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:50:56.669801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175421+0000","last_change":"2024-09-19T07:09:18.925627+0000","last_active":"2024-09-19T07:09:38.175421+0000","last_peered":"2024-09-19T07:09:38.175421+0000","last_clean":"2024-09-19T07:09:38.175421+0000","last_became_active":"2024-09-19T07:09:18.925340+0000","last_became_peered":"2024-09-19T07:09:18.925340+0000","last_unstale":"2024-09-19T07:09:38.175421+0000","last_undegraded":"2024-09-19T07:09:38.175421+0000","last_fullsized":"2024-09-19T07:09:38.175421+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:29.544534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.172766+0000","last_change":"2024-09-19T07:09:18.936963+0000","last_active":"2024-09-19T07:09:38.172766+0000","last_peered":"2024-09-19T07:09:38.172766+0000","last_clean":"2024-09-19T07:09:38.172766+0000","last_became_active":"2024-09-19T07:09:18.936615+0000","last_became_peered":"2024-09-19T07:09:18.936615+0000","last_unstale":"2024-09-19T07:09:38.172766+0000","last_undegraded":"2024-09-19T07:09:38.172766+0000","last_fullsized":"2024-09-19T07:09:38.172766+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:13.036392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.392101+0000","last_change":"2024-09-19T07:09:18.932018+0000","last_active":"2024-09-19T07:09:38.392101+0000","last_peered":"2024-09-19T07:09:38.392101+0000","last_clean":"2024-09-19T07:09:38.392101+0000","last_became_active":"2024-09-19T07:09:18.931624+0000","last_became_peered":"2024-09-19T07:09:18.931624+0000","last_unstale":"2024-09-19T07:09:38.392101+0000","last_undegraded":"2024-09-19T07:09:38.392101+0000","last_fullsized":"2024-09-19T07:09:38.392101+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:53:05.585166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175898+0000","last_change":"2024-09-19T07:09:18.935474+0000","last_active":"2024-09-19T07:09:38.175898+0000","last_peered":"2024-09-19T07:09:38.175898+0000","last_clean":"2024-09-19T07:09:38.175898+0000","last_became_active":"2024-09-19T07:09:18.929018+0000","last_became_peered":"2024-09-19T07:09:18.929018+0000","last_unstale":"2024-09-19T07:09:38.175898+0000","last_undegraded":"2024-09-19T07:09:38.175898+0000","last_fullsized":"2024-09-19T07:09:38.175898+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:01.383024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.171441+0000","last_change":"2024-09-19T07:09:18.928733+0000","last_active":"2024-09-19T07:09:38.171441+0000","last_peered":"2024-09-19T07:09:38.171441+0000","last_clean":"2024-09-19T07:09:38.171441+0000","last_became_active":"2024-09-19T07:09:18.928431+0000","last_became_peered":"2024-09-19T07:09:18.928431+0000","last_unstale":"2024-09-19T07:09:38.171441+0000","last_undegraded":"2024-09-19T07:09:38.171441+0000","last_fullsized":"2024-09-19T07:09:38.171441+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:37.313958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.178508+0000","last_change":"2024-09-19T07:09:18.921268+0000","last_active":"2024-09-19T07:09:38.178508+0000","last_peered":"2024-09-19T07:09:38.178508+0000","last_clean":"2024-09-19T07:09:38.178508+0000","last_became_active":"2024-09-19T07:09:18.920482+0000","last_became_peered":"2024-09-19T07:09:18.920482+0000","last_unstale":"2024-09-19T07:09:38.178508+0000","last_undegraded":"2024-09-19T07:09:38.178508+0000","last_fullsized":"2024-09-19T07:09:38.178508+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:35.201826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.179136+0000","last_change":"2024-09-19T07:09:38.179136+0000","last_active":"2024-09-19T07:09:38.179136+0000","last_peered":"2024-09-19T07:09:38.179136+0000","last_clean":"2024-09-19T07:09:38.179136+0000","last_became_active":"2024-09-19T07:09:38.178746+0000","last_became_peered":"2024-09-19T07:09:38.178746+0000","last_unstale":"2024-09-19T07:09:38.179136+0000","last_undegraded":"2024-09-19T07:09:38.179136+0000","last_fullsized":"2024-09-19T07:09:38.179136+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:03.788114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.177288+0000","last_change":"2024-09-19T07:09:18.924099+0000","last_active":"2024-09-19T07:09:38.177288+0000","last_peered":"2024-09-19T07:09:38.177288+0000","last_clean":"2024-09-19T07:09:38.177288+0000","last_became_active":"2024-09-19T07:09:18.923772+0000","last_became_peered":"2024-09-19T07:09:18.923772+0000","last_unstale":"2024-09-19T07:09:38.177288+0000","last_undegraded":"2024-09-19T07:09:38.177288+0000","last_fullsized":"2024-09-19T07:09:38.177288+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:05:04.954087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.172932+0000","last_change":"2024-09-19T07:09:18.923391+0000","last_active":"2024-09-19T07:09:38.172932+0000","last_peered":"2024-09-19T07:09:38.172932+0000","last_clean":"2024-09-19T07:09:38.172932+0000","last_became_active":"2024-09-19T07:09:18.923085+0000","last_became_peered":"2024-09-19T07:09:18.923085+0000","last_unstale":"2024-09-19T07:09:38.172932+0000","last_undegraded":"2024-09-19T07:09:38.172932+0000","last_fullsized":"2024-09-19T07:09:38.172932+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:43:27.032400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.392065+0000","last_change":"2024-09-19T07:09:18.937188+0000","last_active":"2024-09-19T07:09:38.392065+0000","last_peered":"2024-09-19T07:09:38.392065+0000","last_clean":"2024-09-19T07:09:38.392065+0000","last_became_active":"2024-09-19T07:09:18.936866+0000","last_became_peered":"2024-09-19T07:09:18.936866+0000","last_unstale":"2024-09-19T07:09:38.392065+0000","last_undegraded":"2024-09-19T07:09:38.392065+0000","last_fullsized":"2024-09-19T07:09:38.392065+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:29:08.835307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.177927+0000","last_change":"2024-09-19T07:09:18.935170+0000","last_active":"2024-09-19T07:09:38.177927+0000","last_peered":"2024-09-19T07:09:38.177927+0000","last_clean":"2024-09-19T07:09:38.177927+0000","last_became_active":"2024-09-19T07:09:18.934356+0000","last_became_peered":"2024-09-19T07:09:18.934356+0000","last_unstale":"2024-09-19T07:09:38.177927+0000","last_undegraded":"2024-09-19T07:09:38.177927+0000","last_fullsized":"2024-09-19T07:09:38.177927+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:53.567392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175782+0000","last_change":"2024-09-19T07:09:18.922640+0000","last_active":"2024-09-19T07:09:38.175782+0000","last_peered":"2024-09-19T07:09:38.175782+0000","last_clean":"2024-09-19T07:09:38.175782+0000","last_became_active":"2024-09-19T07:09:18.922312+0000","last_became_peered":"2024-09-19T07:09:18.922312+0000","last_unstale":"2024-09-19T07:09:38.175782+0000","last_undegraded":"2024-09-19T07:09:38.175782+0000","last_fullsized":"2024-09-19T07:09:38.175782+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:50.868818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.176074+0000","last_change":"2024-09-19T07:09:18.934364+0000","last_active":"2024-09-19T07:09:38.176074+0000","last_peered":"2024-09-19T07:09:38.176074+0000","last_clean":"2024-09-19T07:09:38.176074+0000","last_became_active":"2024-09-19T07:09:18.933533+0000","last_became_peered":"2024-09-19T07:09:18.933533+0000","last_unstale":"2024-09-19T07:09:38.176074+0000","last_undegraded":"2024-09-19T07:09:38.176074+0000","last_fullsized":"2024-09-19T07:09:38.176074+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:54.175425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.172694+0000","last_change":"2024-09-19T07:09:18.927456+0000","last_active":"2024-09-19T07:09:38.172694+0000","last_peered":"2024-09-19T07:09:38.172694+0000","last_clean":"2024-09-19T07:09:38.172694+0000","last_became_active":"2024-09-19T07:09:18.927117+0000","last_became_peered":"2024-09-19T07:09:18.927117+0000","last_unstale":"2024-09-19T07:09:38.172694+0000","last_undegraded":"2024-09-19T07:09:38.172694+0000","last_fullsized":"2024-09-19T07:09:38.172694+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:08.885898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.176351+0000","last_change":"2024-09-19T07:09:18.926024+0000","last_active":"2024-09-19T07:09:38.176351+0000","last_peered":"2024-09-19T07:09:38.176351+0000","last_clean":"2024-09-19T07:09:38.176351+0000","last_became_active":"2024-09-19T07:09:18.925689+0000","last_became_peered":"2024-09-19T07:09:18.925689+0000","last_unstale":"2024-09-19T07:09:38.176351+0000","last_undegraded":"2024-09-19T07:09:38.176351+0000","last_fullsized":"2024-09-19T07:09:38.176351+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:09:08.178214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'6","reported_seq":45,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:41.008807+0000","last_change":"2024-09-19T07:09:16.915804+0000","last_active":"2024-09-19T07:09:41.008807+0000","last_peered":"2024-09-19T07:09:41.008807+0000","last_clean":"2024-09-19T07:09:41.008807+0000","last_became_active":"2024-09-19T07:09:16.915434+0000","last_became_peered":"2024-09-19T07:09:16.915434+0000","last_unstale":"2024-09-19T07:09:41.008807+0000","last_undegraded":"2024-09-19T07:09:41.008807+0000","last_fullsized":"2024-09-19T07:09:41.008807+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:57.230475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.176935+0000","last_change":"2024-09-19T07:09:18.932497+0000","last_active":"2024-09-19T07:09:38.176935+0000","last_peered":"2024-09-19T07:09:38.176935+0000","last_clean":"2024-09-19T07:09:38.176935+0000","last_became_active":"2024-09-19T07:09:18.932213+0000","last_became_peered":"2024-09-19T07:09:18.932213+0000","last_unstale":"2024-09-19T07:09:38.176935+0000","last_undegraded":"2024-09-19T07:09:38.176935+0000","last_fullsized":"2024-09-19T07:09:38.176935+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:10.299077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.172875+0000","last_change":"2024-09-19T07:09:16.910171+0000","last_active":"2024-09-19T07:09:38.172875+0000","last_peered":"2024-09-19T07:09:38.172875+0000","last_clean":"2024-09-19T07:09:38.172875+0000","last_became_active":"2024-09-19T07:09:16.909840+0000","last_became_peered":"2024-09-19T07:09:16.909840+0000","last_unstale":"2024-09-19T07:09:38.172875+0000","last_undegraded":"2024-09-19T07:09:38.172875+0000","last_fullsized":"2024-09-19T07:09:38.172875+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:35.448892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.391818+0000","last_change":"2024-09-19T07:09:16.911336+0000","last_active":"2024-09-19T07:09:38.391818+0000","last_peered":"2024-09-19T07:09:38.391818+0000","last_clean":"2024-09-19T07:09:38.391818+0000","last_became_active":"2024-09-19T07:09:16.911027+0000","last_became_peered":"2024-09-19T07:09:16.911027+0000","last_unstale":"2024-09-19T07:09:38.391818+0000","last_undegraded":"2024-09-19T07:09:38.391818+0000","last_fullsized":"2024-09-19T07:09:38.391818+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:37:50.698597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.171395+0000","last_change":"2024-09-19T07:09:18.927713+0000","last_active":"2024-09-19T07:09:38.171395+0000","last_peered":"2024-09-19T07:09:38.171395+0000","last_clean":"2024-09-19T07:09:38.171395+0000","last_became_active":"2024-09-19T07:09:18.927430+0000","last_became_peered":"2024-09-19T07:09:18.927430+0000","last_unstale":"2024-09-19T07:09:38.171395+0000","last_undegraded":"2024-09-19T07:09:38.171395+0000","last_fullsized":"2024-09-19T07:09:38.171395+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:15:07.707723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.178877+0000","last_change":"2024-09-19T07:09:16.912391+0000","last_active":"2024-09-19T07:09:38.178877+0000","last_peered":"2024-09-19T07:09:38.178877+0000","last_clean":"2024-09-19T07:09:38.178877+0000","last_became_active":"2024-09-19T07:09:16.912034+0000","last_became_peered":"2024-09-19T07:09:16.912034+0000","last_unstale":"2024-09-19T07:09:38.178877+0000","last_undegraded":"2024-09-19T07:09:38.178877+0000","last_fullsized":"2024-09-19T07:09:38.178877+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:18:45.226107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.173014+0000","last_change":"2024-09-19T07:09:18.929476+0000","last_active":"2024-09-19T07:09:38.173014+0000","last_peered":"2024-09-19T07:09:38.173014+0000","last_clean":"2024-09-19T07:09:38.173014+0000","last_became_active":"2024-09-19T07:09:18.929183+0000","last_became_peered":"2024-09-19T07:09:18.929183+0000","last_unstale":"2024-09-19T07:09:38.173014+0000","last_undegraded":"2024-09-19T07:09:38.173014+0000","last_fullsized":"2024-09-19T07:09:38.173014+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:19:38.827130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'3","reported_seq":37,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:39.004941+0000","last_change":"2024-09-19T07:09:16.913012+0000","last_active":"2024-09-19T07:09:39.004941+0000","last_peered":"2024-09-19T07:09:39.004941+0000","last_clean":"2024-09-19T07:09:39.004941+0000","last_became_active":"2024-09-19T07:09:16.912633+0000","last_became_peered":"2024-09-19T07:09:16.912633+0000","last_unstale":"2024-09-19T07:09:39.004941+0000","last_undegraded":"2024-09-19T07:09:39.004941+0000","last_fullsized":"2024-09-19T07:09:39.004941+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:21:39.669961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175677+0000","last_change":"2024-09-19T07:09:18.937323+0000","last_active":"2024-09-19T07:09:38.175677+0000","last_peered":"2024-09-19T07:09:38.175677+0000","last_clean":"2024-09-19T07:09:38.175677+0000","last_became_active":"2024-09-19T07:09:18.936762+0000","last_became_peered":"2024-09-19T07:09:18.936762+0000","last_unstale":"2024-09-19T07:09:38.175677+0000","last_undegraded":"2024-09-19T07:09:38.175677+0000","last_fullsized":"2024-09-19T07:09:38.175677+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:37.692290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.176072+0000","last_change":"2024-09-19T07:09:16.912167+0000","last_active":"2024-09-19T07:09:38.176072+0000","last_peered":"2024-09-19T07:09:38.176072+0000","last_clean":"2024-09-19T07:09:38.176072+0000","last_became_active":"2024-09-19T07:09:16.911840+0000","last_became_peered":"2024-09-19T07:09:16.911840+0000","last_unstale":"2024-09-19T07:09:38.176072+0000","last_undegraded":"2024-09-19T07:09:38.176072+0000","last_fullsized":"2024-09-19T07:09:38.176072+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:31.901906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.178050+0000","last_change":"2024-09-19T07:09:18.932239+0000","last_active":"2024-09-19T07:09:38.178050+0000","last_peered":"2024-09-19T07:09:38.178050+0000","last_clean":"2024-09-19T07:09:38.178050+0000","last_became_active":"2024-09-19T07:09:18.931820+0000","last_became_peered":"2024-09-19T07:09:18.931820+0000","last_unstale":"2024-09-19T07:09:38.178050+0000","last_undegraded":"2024-09-19T07:09:38.178050+0000","last_fullsized":"2024-09-19T07:09:38.178050+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:09.407524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.178561+0000","last_change":"2024-09-19T07:09:17.085077+0000","last_active":"2024-09-19T07:09:38.178561+0000","last_peered":"2024-09-19T07:09:38.178561+0000","last_clean":"2024-09-19T07:09:38.178561+0000","last_became_active":"2024-09-19T07:09:17.084457+0000","last_became_peered":"2024-09-19T07:09:17.084457+0000","last_unstale":"2024-09-19T07:09:38.178561+0000","last_undegraded":"2024-09-19T07:09:38.178561+0000","last_fullsized":"2024-09-19T07:09:38.178561+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:42.416193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175612+0000","last_change":"2024-09-19T07:09:18.939830+0000","last_active":"2024-09-19T07:09:38.175612+0000","last_peered":"2024-09-19T07:09:38.175612+0000","last_clean":"2024-09-19T07:09:38.175612+0000","last_became_active":"2024-09-19T07:09:18.939359+0000","last_became_peered":"2024-09-19T07:09:18.939359+0000","last_unstale":"2024-09-19T07:09:38.175612+0000","last_undegraded":"2024-09-19T07:09:38.175612+0000","last_fullsized":"2024-09-19T07:09:38.175612+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:24:46.241902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'21","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:39.227381+0000","last_change":"2024-09-19T07:09:38.227707+0000","last_active":"2024-09-19T07:09:39.227381+0000","last_peered":"2024-09-19T07:09:39.227381+0000","last_clean":"2024-09-19T07:09:39.227381+0000","last_became_active":"2024-09-19T07:09:38.219073+0000","last_became_peered":"2024-09-19T07:09:38.219073+0000","last_unstale":"2024-09-19T07:09:39.227381+0000","last_undegraded":"2024-09-19T07:09:39.227381+0000","last_fullsized":"2024-09-19T07:09:39.227381+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:46.035315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41065,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":47,"num_write":22,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":26947,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.176558+0000","last_change":"2024-09-19T07:09:18.929531+0000","last_active":"2024-09-19T07:09:38.176558+0000","last_peered":"2024-09-19T07:09:38.176558+0000","last_clean":"2024-09-19T07:09:38.176558+0000","last_became_active":"2024-09-19T07:09:18.929253+0000","last_became_peered":"2024-09-19T07:09:18.929253+0000","last_unstale":"2024-09-19T07:09:38.176558+0000","last_undegraded":"2024-09-19T07:09:38.176558+0000","last_fullsized":"2024-09-19T07:09:38.176558+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:10.635116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175337+0000","last_change":"2024-09-19T07:09:16.914964+0000","last_active":"2024-09-19T07:09:38.175337+0000","last_peered":"2024-09-19T07:09:38.175337+0000","last_clean":"2024-09-19T07:09:38.175337+0000","last_became_active":"2024-09-19T07:09:16.914540+0000","last_became_peered":"2024-09-19T07:09:16.914540+0000","last_unstale":"2024-09-19T07:09:38.175337+0000","last_undegraded":"2024-09-19T07:09:38.175337+0000","last_fullsized":"2024-09-19T07:09:38.175337+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:30.903046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.391882+0000","last_change":"2024-09-19T07:09:18.931709+0000","last_active":"2024-09-19T07:09:38.391882+0000","last_peered":"2024-09-19T07:09:38.391882+0000","last_clean":"2024-09-19T07:09:38.391882+0000","last_became_active":"2024-09-19T07:09:18.931345+0000","last_became_peered":"2024-09-19T07:09:18.931345+0000","last_unstale":"2024-09-19T07:09:38.391882+0000","last_undegraded":"2024-09-19T07:09:38.391882+0000","last_fullsized":"2024-09-19T07:09:38.391882+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:28.916820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.177361+0000","last_change":"2024-09-19T07:09:16.914055+0000","last_active":"2024-09-19T07:09:38.177361+0000","last_peered":"2024-09-19T07:09:38.177361+0000","last_clean":"2024-09-19T07:09:38.177361+0000","last_became_active":"2024-09-19T07:09:16.913589+0000","last_became_peered":"2024-09-19T07:09:16.913589+0000","last_unstale":"2024-09-19T07:09:38.177361+0000","last_undegraded":"2024-09-19T07:09:38.177361+0000","last_fullsized":"2024-09-19T07:09:38.177361+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:29:16.322059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175501+0000","last_change":"2024-09-19T07:09:18.934879+0000","last_active":"2024-09-19T07:09:38.175501+0000","last_peered":"2024-09-19T07:09:38.175501+0000","last_clean":"2024-09-19T07:09:38.175501+0000","last_became_active":"2024-09-19T07:09:18.934432+0000","last_became_peered":"2024-09-19T07:09:18.934432+0000","last_unstale":"2024-09-19T07:09:38.175501+0000","last_undegraded":"2024-09-19T07:09:38.175501+0000","last_fullsized":"2024-09-19T07:09:38.175501+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:25.782782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'4","reported_seq":40,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.217414+0000","last_change":"2024-09-19T07:09:16.909256+0000","last_active":"2024-09-19T07:09:38.217414+0000","last_peered":"2024-09-19T07:09:38.217414+0000","last_clean":"2024-09-19T07:09:38.217414+0000","last_became_active":"2024-09-19T07:09:16.908932+0000","last_became_peered":"2024-09-19T07:09:16.908932+0000","last_unstale":"2024-09-19T07:09:38.217414+0000","last_undegraded":"2024-09-19T07:09:38.217414+0000","last_fullsized":"2024-09-19T07:09:38.217414+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:28.344756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175202+0000","last_change":"2024-09-19T07:09:18.931844+0000","last_active":"2024-09-19T07:09:38.175202+0000","last_peered":"2024-09-19T07:09:38.175202+0000","last_clean":"2024-09-19T07:09:38.175202+0000","last_became_active":"2024-09-19T07:09:18.931516+0000","last_became_peered":"2024-09-19T07:09:18.931516+0000","last_unstale":"2024-09-19T07:09:38.175202+0000","last_undegraded":"2024-09-19T07:09:38.175202+0000","last_fullsized":"2024-09-19T07:09:38.175202+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:27:29.812144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.176125+0000","last_change":"2024-09-19T07:09:17.085252+0000","last_active":"2024-09-19T07:09:38.176125+0000","last_peered":"2024-09-19T07:09:38.176125+0000","last_clean":"2024-09-19T07:09:38.176125+0000","last_became_active":"2024-09-19T07:09:17.084907+0000","last_became_peered":"2024-09-19T07:09:17.084907+0000","last_unstale":"2024-09-19T07:09:38.176125+0000","last_undegraded":"2024-09-19T07:09:38.176125+0000","last_fullsized":"2024-09-19T07:09:38.176125+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:59:40.351181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.177112+0000","last_change":"2024-09-19T07:09:18.932491+0000","last_active":"2024-09-19T07:09:38.177112+0000","last_peered":"2024-09-19T07:09:38.177112+0000","last_clean":"2024-09-19T07:09:38.177112+0000","last_became_active":"2024-09-19T07:09:18.932159+0000","last_became_peered":"2024-09-19T07:09:18.932159+0000","last_unstale":"2024-09-19T07:09:38.177112+0000","last_undegraded":"2024-09-19T07:09:38.177112+0000","last_fullsized":"2024-09-19T07:09:38.177112+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:31.144130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.178704+0000","last_change":"2024-09-19T07:09:16.911012+0000","last_active":"2024-09-19T07:09:38.178704+0000","last_peered":"2024-09-19T07:09:38.178704+0000","last_clean":"2024-09-19T07:09:38.178704+0000","last_became_active":"2024-09-19T07:09:16.910618+0000","last_became_peered":"2024-09-19T07:09:16.910618+0000","last_unstale":"2024-09-19T07:09:38.178704+0000","last_undegraded":"2024-09-19T07:09:38.178704+0000","last_fullsized":"2024-09-19T07:09:38.178704+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:16.316680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.217870+0000","last_change":"2024-09-19T07:09:38.217870+0000","last_active":"2024-09-19T07:09:38.217870+0000","last_peered":"2024-09-19T07:09:38.217870+0000","last_clean":"2024-09-19T07:09:38.217870+0000","last_became_active":"2024-09-19T07:09:38.217585+0000","last_became_peered":"2024-09-19T07:09:38.217585+0000","last_unstale":"2024-09-19T07:09:38.217870+0000","last_undegraded":"2024-09-19T07:09:38.217870+0000","last_fullsized":"2024-09-19T07:09:38.217870+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:41.320705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.392249+0000","last_change":"2024-09-19T07:09:16.911644+0000","last_active":"2024-09-19T07:09:38.392249+0000","last_peered":"2024-09-19T07:09:38.392249+0000","last_clean":"2024-09-19T07:09:38.392249+0000","last_became_active":"2024-09-19T07:09:16.911368+0000","last_became_peered":"2024-09-19T07:09:16.911368+0000","last_unstale":"2024-09-19T07:09:38.392249+0000","last_undegraded":"2024-09-19T07:09:38.392249+0000","last_fullsized":"2024-09-19T07:09:38.392249+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:12.953466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.176202+0000","last_change":"2024-09-19T07:09:18.933667+0000","last_active":"2024-09-19T07:09:38.176202+0000","last_peered":"2024-09-19T07:09:38.176202+0000","last_clean":"2024-09-19T07:09:38.176202+0000","last_became_active":"2024-09-19T07:09:18.933288+0000","last_became_peered":"2024-09-19T07:09:18.933288+0000","last_unstale":"2024-09-19T07:09:38.176202+0000","last_undegraded":"2024-09-19T07:09:38.176202+0000","last_fullsized":"2024-09-19T07:09:38.176202+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:54:38.127799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.178634+0000","last_change":"2024-09-19T07:09:16.909722+0000","last_active":"2024-09-19T07:09:38.178634+0000","last_peered":"2024-09-19T07:09:38.178634+0000","last_clean":"2024-09-19T07:09:38.178634+0000","last_became_active":"2024-09-19T07:09:16.909394+0000","last_became_peered":"2024-09-19T07:09:16.909394+0000","last_unstale":"2024-09-19T07:09:38.178634+0000","last_undegraded":"2024-09-19T07:09:38.178634+0000","last_fullsized":"2024-09-19T07:09:38.178634+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:21:53.342710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175698+0000","last_change":"2024-09-19T07:09:18.929473+0000","last_active":"2024-09-19T07:09:38.175698+0000","last_peered":"2024-09-19T07:09:38.175698+0000","last_clean":"2024-09-19T07:09:38.175698+0000","last_became_active":"2024-09-19T07:09:18.929176+0000","last_became_peered":"2024-09-19T07:09:18.929176+0000","last_unstale":"2024-09-19T07:09:38.175698+0000","last_undegraded":"2024-09-19T07:09:38.175698+0000","last_fullsized":"2024-09-19T07:09:38.175698+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:32:30.409528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175529+0000","last_change":"2024-09-19T07:09:17.084868+0000","last_active":"2024-09-19T07:09:38.175529+0000","last_peered":"2024-09-19T07:09:38.175529+0000","last_clean":"2024-09-19T07:09:38.175529+0000","last_became_active":"2024-09-19T07:09:17.084448+0000","last_became_peered":"2024-09-19T07:09:17.084448+0000","last_unstale":"2024-09-19T07:09:38.175529+0000","last_undegraded":"2024-09-19T07:09:38.175529+0000","last_fullsized":"2024-09-19T07:09:38.175529+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:38.211697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175880+0000","last_change":"2024-09-19T07:09:18.938865+0000","last_active":"2024-09-19T07:09:38.175880+0000","last_peered":"2024-09-19T07:09:38.175880+0000","last_clean":"2024-09-19T07:09:38.175880+0000","last_became_active":"2024-09-19T07:09:18.936324+0000","last_became_peered":"2024-09-19T07:09:18.936324+0000","last_unstale":"2024-09-19T07:09:38.175880+0000","last_undegraded":"2024-09-19T07:09:38.175880+0000","last_fullsized":"2024-09-19T07:09:38.175880+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:29:51.081140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":342,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175329+0000","last_change":"2024-09-19T07:08:09.270850+0000","last_active":"2024-09-19T07:09:38.175329+0000","last_peered":"2024-09-19T07:09:38.175329+0000","last_clean":"2024-09-19T07:09:38.175329+0000","last_became_active":"2024-09-19T07:08:09.270308+0000","last_became_peered":"2024-09-19T07:08:09.270308+0000","last_unstale":"2024-09-19T07:09:38.175329+0000","last_undegraded":"2024-09-19T07:09:38.175329+0000","last_fullsized":"2024-09-19T07:09:38.175329+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:04:49.729632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:04:49.729632+0000","last_clean_scrub_stamp":"2024-09-19T07:04:49.729632+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:15.588732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.217622+0000","last_change":"2024-09-19T07:09:16.907648+0000","last_active":"2024-09-19T07:09:38.217622+0000","last_peered":"2024-09-19T07:09:38.217622+0000","last_clean":"2024-09-19T07:09:38.217622+0000","last_became_active":"2024-09-19T07:09:16.907363+0000","last_became_peered":"2024-09-19T07:09:16.907363+0000","last_unstale":"2024-09-19T07:09:38.217622+0000","last_undegraded":"2024-09-19T07:09:38.217622+0000","last_fullsized":"2024-09-19T07:09:38.217622+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:12:27.898493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.171872+0000","last_change":"2024-09-19T07:09:18.926008+0000","last_active":"2024-09-19T07:09:38.171872+0000","last_peered":"2024-09-19T07:09:38.171872+0000","last_clean":"2024-09-19T07:09:38.171872+0000","last_became_active":"2024-09-19T07:09:18.925689+0000","last_became_peered":"2024-09-19T07:09:18.925689+0000","last_unstale":"2024-09-19T07:09:38.171872+0000","last_undegraded":"2024-09-19T07:09:38.171872+0000","last_fullsized":"2024-09-19T07:09:38.171872+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:16:06.467934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175270+0000","last_change":"2024-09-19T07:09:16.911327+0000","last_active":"2024-09-19T07:09:38.175270+0000","last_peered":"2024-09-19T07:09:38.175270+0000","last_clean":"2024-09-19T07:09:38.175270+0000","last_became_active":"2024-09-19T07:09:16.911031+0000","last_became_peered":"2024-09-19T07:09:16.911031+0000","last_unstale":"2024-09-19T07:09:38.175270+0000","last_undegraded":"2024-09-19T07:09:38.175270+0000","last_fullsized":"2024-09-19T07:09:38.175270+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:03.307119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.391808+0000","last_change":"2024-09-19T07:09:18.933813+0000","last_active":"2024-09-19T07:09:38.391808+0000","last_peered":"2024-09-19T07:09:38.391808+0000","last_clean":"2024-09-19T07:09:38.391808+0000","last_became_active":"2024-09-19T07:09:18.933475+0000","last_became_peered":"2024-09-19T07:09:18.933475+0000","last_unstale":"2024-09-19T07:09:38.391808+0000","last_undegraded":"2024-09-19T07:09:38.391808+0000","last_fullsized":"2024-09-19T07:09:38.391808+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:34:09.149593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'4","reported_seq":40,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:41.007515+0000","last_change":"2024-09-19T07:09:17.084833+0000","last_active":"2024-09-19T07:09:41.007515+0000","last_peered":"2024-09-19T07:09:41.007515+0000","last_clean":"2024-09-19T07:09:41.007515+0000","last_became_active":"2024-09-19T07:09:17.084477+0000","last_became_peered":"2024-09-19T07:09:17.084477+0000","last_unstale":"2024-09-19T07:09:41.007515+0000","last_undegraded":"2024-09-19T07:09:41.007515+0000","last_fullsized":"2024-09-19T07:09:41.007515+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:17:50.962480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.178639+0000","last_change":"2024-09-19T07:09:18.935991+0000","last_active":"2024-09-19T07:09:38.178639+0000","last_peered":"2024-09-19T07:09:38.178639+0000","last_clean":"2024-09-19T07:09:38.178639+0000","last_became_active":"2024-09-19T07:09:18.935677+0000","last_became_peered":"2024-09-19T07:09:18.935677+0000","last_unstale":"2024-09-19T07:09:38.178639+0000","last_undegraded":"2024-09-19T07:09:38.178639+0000","last_fullsized":"2024-09-19T07:09:38.178639+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:45.550119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175650+0000","last_change":"2024-09-19T07:09:16.911755+0000","last_active":"2024-09-19T07:09:38.175650+0000","last_peered":"2024-09-19T07:09:38.175650+0000","last_clean":"2024-09-19T07:09:38.175650+0000","last_became_active":"2024-09-19T07:09:16.911211+0000","last_became_peered":"2024-09-19T07:09:16.911211+0000","last_unstale":"2024-09-19T07:09:38.175650+0000","last_undegraded":"2024-09-19T07:09:38.175650+0000","last_fullsized":"2024-09-19T07:09:38.175650+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:15.365423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.173027+0000","last_change":"2024-09-19T07:09:18.940282+0000","last_active":"2024-09-19T07:09:38.173027+0000","last_peered":"2024-09-19T07:09:38.173027+0000","last_clean":"2024-09-19T07:09:38.173027+0000","last_became_active":"2024-09-19T07:09:18.939918+0000","last_became_peered":"2024-09-19T07:09:18.939918+0000","last_unstale":"2024-09-19T07:09:38.173027+0000","last_undegraded":"2024-09-19T07:09:38.173027+0000","last_fullsized":"2024-09-19T07:09:38.173027+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:11.161676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.173522+0000","last_change":"2024-09-19T07:09:17.086103+0000","last_active":"2024-09-19T07:09:38.173522+0000","last_peered":"2024-09-19T07:09:38.173522+0000","last_clean":"2024-09-19T07:09:38.173522+0000","last_became_active":"2024-09-19T07:09:17.085805+0000","last_became_peered":"2024-09-19T07:09:17.085805+0000","last_unstale":"2024-09-19T07:09:38.173522+0000","last_undegraded":"2024-09-19T07:09:38.173522+0000","last_fullsized":"2024-09-19T07:09:38.173522+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:28.522487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"78'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.173192+0000","last_change":"2024-09-19T07:09:18.932603+0000","last_active":"2024-09-19T07:09:38.173192+0000","last_peered":"2024-09-19T07:09:38.173192+0000","last_clean":"2024-09-19T07:09:38.173192+0000","last_became_active":"2024-09-19T07:09:18.932309+0000","last_became_peered":"2024-09-19T07:09:18.932309+0000","last_unstale":"2024-09-19T07:09:38.173192+0000","last_undegraded":"2024-09-19T07:09:38.173192+0000","last_fullsized":"2024-09-19T07:09:38.173192+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:19.746024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.176846+0000","last_change":"2024-09-19T07:09:17.085287+0000","last_active":"2024-09-19T07:09:38.176846+0000","last_peered":"2024-09-19T07:09:38.176846+0000","last_clean":"2024-09-19T07:09:38.176846+0000","last_became_active":"2024-09-19T07:09:17.084964+0000","last_became_peered":"2024-09-19T07:09:17.084964+0000","last_unstale":"2024-09-19T07:09:38.176846+0000","last_undegraded":"2024-09-19T07:09:38.176846+0000","last_fullsized":"2024-09-19T07:09:38.176846+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:51:01.035344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.392115+0000","last_change":"2024-09-19T07:09:18.921623+0000","last_active":"2024-09-19T07:09:38.392115+0000","last_peered":"2024-09-19T07:09:38.392115+0000","last_clean":"2024-09-19T07:09:38.392115+0000","last_became_active":"2024-09-19T07:09:18.921321+0000","last_became_peered":"2024-09-19T07:09:18.921321+0000","last_unstale":"2024-09-19T07:09:38.392115+0000","last_undegraded":"2024-09-19T07:09:38.392115+0000","last_fullsized":"2024-09-19T07:09:38.392115+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:28:55.616889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'9","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.928391+0000","last_change":"2024-09-19T07:09:16.910251+0000","last_active":"2024-09-19T07:09:38.928391+0000","last_peered":"2024-09-19T07:09:38.928391+0000","last_clean":"2024-09-19T07:09:38.928391+0000","last_became_active":"2024-09-19T07:09:16.909821+0000","last_became_peered":"2024-09-19T07:09:16.909821+0000","last_unstale":"2024-09-19T07:09:38.928391+0000","last_undegraded":"2024-09-19T07:09:38.928391+0000","last_fullsized":"2024-09-19T07:09:38.928391+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:02.958557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.171648+0000","last_change":"2024-09-19T07:09:18.930831+0000","last_active":"2024-09-19T07:09:38.171648+0000","last_peered":"2024-09-19T07:09:38.171648+0000","last_clean":"2024-09-19T07:09:38.171648+0000","last_became_active":"2024-09-19T07:09:18.930475+0000","last_became_peered":"2024-09-19T07:09:18.930475+0000","last_unstale":"2024-09-19T07:09:38.171648+0000","last_undegraded":"2024-09-19T07:09:38.171648+0000","last_fullsized":"2024-09-19T07:09:38.171648+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:30.512246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.217761+0000","last_change":"2024-09-19T07:09:16.906666+0000","last_active":"2024-09-19T07:09:38.217761+0000","last_peered":"2024-09-19T07:09:38.217761+0000","last_clean":"2024-09-19T07:09:38.217761+0000","last_became_active":"2024-09-19T07:09:16.906369+0000","last_became_peered":"2024-09-19T07:09:16.906369+0000","last_unstale":"2024-09-19T07:09:38.217761+0000","last_undegraded":"2024-09-19T07:09:38.217761+0000","last_fullsized":"2024-09-19T07:09:38.217761+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:56.915089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.178077+0000","last_change":"2024-09-19T07:09:18.934942+0000","last_active":"2024-09-19T07:09:38.178077+0000","last_peered":"2024-09-19T07:09:38.178077+0000","last_clean":"2024-09-19T07:09:38.178077+0000","last_became_active":"2024-09-19T07:09:18.934595+0000","last_became_peered":"2024-09-19T07:09:18.934595+0000","last_unstale":"2024-09-19T07:09:38.178077+0000","last_undegraded":"2024-09-19T07:09:38.178077+0000","last_fullsized":"2024-09-19T07:09:38.178077+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:54.306541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.183567+0000","last_change":"2024-09-19T07:09:38.183567+0000","last_active":"2024-09-19T07:09:38.183567+0000","last_peered":"2024-09-19T07:09:38.183567+0000","last_clean":"2024-09-19T07:09:38.183567+0000","last_became_active":"2024-09-19T07:09:38.180778+0000","last_became_peered":"2024-09-19T07:09:38.180778+0000","last_unstale":"2024-09-19T07:09:38.183567+0000","last_undegraded":"2024-09-19T07:09:38.183567+0000","last_fullsized":"2024-09-19T07:09:38.183567+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:43.226551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.176289+0000","last_change":"2024-09-19T07:09:18.934457+0000","last_active":"2024-09-19T07:09:38.176289+0000","last_peered":"2024-09-19T07:09:38.176289+0000","last_clean":"2024-09-19T07:09:38.176289+0000","last_became_active":"2024-09-19T07:09:18.934126+0000","last_became_peered":"2024-09-19T07:09:18.934126+0000","last_unstale":"2024-09-19T07:09:38.176289+0000","last_undegraded":"2024-09-19T07:09:38.176289+0000","last_fullsized":"2024-09-19T07:09:38.176289+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:37:16.152335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.171956+0000","last_change":"2024-09-19T07:09:16.908457+0000","last_active":"2024-09-19T07:09:38.171956+0000","last_peered":"2024-09-19T07:09:38.171956+0000","last_clean":"2024-09-19T07:09:38.171956+0000","last_became_active":"2024-09-19T07:09:16.908128+0000","last_became_peered":"2024-09-19T07:09:16.908128+0000","last_unstale":"2024-09-19T07:09:38.171956+0000","last_undegraded":"2024-09-19T07:09:38.171956+0000","last_fullsized":"2024-09-19T07:09:38.171956+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:48:50.579301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.172762+0000","last_change":"2024-09-19T07:09:18.928763+0000","last_active":"2024-09-19T07:09:38.172762+0000","last_peered":"2024-09-19T07:09:38.172762+0000","last_clean":"2024-09-19T07:09:38.172762+0000","last_became_active":"2024-09-19T07:09:18.928231+0000","last_became_peered":"2024-09-19T07:09:18.928231+0000","last_unstale":"2024-09-19T07:09:38.172762+0000","last_undegraded":"2024-09-19T07:09:38.172762+0000","last_fullsized":"2024-09-19T07:09:38.172762+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:26.652378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175889+0000","last_change":"2024-09-19T07:09:16.913740+0000","last_active":"2024-09-19T07:09:38.175889+0000","last_peered":"2024-09-19T07:09:38.175889+0000","last_clean":"2024-09-19T07:09:38.175889+0000","last_became_active":"2024-09-19T07:09:16.912419+0000","last_became_peered":"2024-09-19T07:09:16.912419+0000","last_unstale":"2024-09-19T07:09:38.175889+0000","last_undegraded":"2024-09-19T07:09:38.175889+0000","last_fullsized":"2024-09-19T07:09:38.175889+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:16.658996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.171848+0000","last_change":"2024-09-19T07:09:18.930697+0000","last_active":"2024-09-19T07:09:38.171848+0000","last_peered":"2024-09-19T07:09:38.171848+0000","last_clean":"2024-09-19T07:09:38.171848+0000","last_became_active":"2024-09-19T07:09:18.930355+0000","last_became_peered":"2024-09-19T07:09:18.930355+0000","last_unstale":"2024-09-19T07:09:38.171848+0000","last_undegraded":"2024-09-19T07:09:38.171848+0000","last_fullsized":"2024-09-19T07:09:38.171848+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:07.217195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.184284+0000","last_change":"2024-09-19T07:09:38.183637+0000","last_active":"2024-09-19T07:09:38.184284+0000","last_peered":"2024-09-19T07:09:38.184284+0000","last_clean":"2024-09-19T07:09:38.184284+0000","last_became_active":"2024-09-19T07:09:38.178732+0000","last_became_peered":"2024-09-19T07:09:38.178732+0000","last_unstale":"2024-09-19T07:09:38.184284+0000","last_undegraded":"2024-09-19T07:09:38.184284+0000","last_fullsized":"2024-09-19T07:09:38.184284+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:14.287130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175530+0000","last_change":"2024-09-19T07:09:18.935120+0000","last_active":"2024-09-19T07:09:38.175530+0000","last_peered":"2024-09-19T07:09:38.175530+0000","last_clean":"2024-09-19T07:09:38.175530+0000","last_became_active":"2024-09-19T07:09:18.934227+0000","last_became_peered":"2024-09-19T07:09:18.934227+0000","last_unstale":"2024-09-19T07:09:38.175530+0000","last_undegraded":"2024-09-19T07:09:38.175530+0000","last_fullsized":"2024-09-19T07:09:38.175530+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:20.328983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.393512+0000","last_change":"2024-09-19T07:09:38.393512+0000","last_active":"2024-09-19T07:09:38.393512+0000","last_peered":"2024-09-19T07:09:38.393512+0000","last_clean":"2024-09-19T07:09:38.393512+0000","last_became_active":"2024-09-19T07:09:38.393200+0000","last_became_peered":"2024-09-19T07:09:38.393200+0000","last_unstale":"2024-09-19T07:09:38.393512+0000","last_undegraded":"2024-09-19T07:09:38.393512+0000","last_fullsized":"2024-09-19T07:09:38.393512+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:51.637520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.177004+0000","last_change":"2024-09-19T07:09:16.911129+0000","last_active":"2024-09-19T07:09:38.177004+0000","last_peered":"2024-09-19T07:09:38.177004+0000","last_clean":"2024-09-19T07:09:38.177004+0000","last_became_active":"2024-09-19T07:09:16.910583+0000","last_became_peered":"2024-09-19T07:09:16.910583+0000","last_unstale":"2024-09-19T07:09:38.177004+0000","last_undegraded":"2024-09-19T07:09:38.177004+0000","last_fullsized":"2024-09-19T07:09:38.177004+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:34:37.295838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175577+0000","last_change":"2024-09-19T07:09:18.928622+0000","last_active":"2024-09-19T07:09:38.175577+0000","last_peered":"2024-09-19T07:09:38.175577+0000","last_clean":"2024-09-19T07:09:38.175577+0000","last_became_active":"2024-09-19T07:09:18.928284+0000","last_became_peered":"2024-09-19T07:09:18.928284+0000","last_unstale":"2024-09-19T07:09:38.175577+0000","last_undegraded":"2024-09-19T07:09:38.175577+0000","last_fullsized":"2024-09-19T07:09:38.175577+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:37:46.358756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.176700+0000","last_change":"2024-09-19T07:09:16.916142+0000","last_active":"2024-09-19T07:09:38.176700+0000","last_peered":"2024-09-19T07:09:38.176700+0000","last_clean":"2024-09-19T07:09:38.176700+0000","last_became_active":"2024-09-19T07:09:16.915766+0000","last_became_peered":"2024-09-19T07:09:16.915766+0000","last_unstale":"2024-09-19T07:09:38.176700+0000","last_undegraded":"2024-09-19T07:09:38.176700+0000","last_fullsized":"2024-09-19T07:09:38.176700+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:38.136422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.177929+0000","last_change":"2024-09-19T07:09:18.921912+0000","last_active":"2024-09-19T07:09:38.177929+0000","last_peered":"2024-09-19T07:09:38.177929+0000","last_clean":"2024-09-19T07:09:38.177929+0000","last_became_active":"2024-09-19T07:09:18.921595+0000","last_became_peered":"2024-09-19T07:09:18.921595+0000","last_unstale":"2024-09-19T07:09:38.177929+0000","last_undegraded":"2024-09-19T07:09:38.177929+0000","last_fullsized":"2024-09-19T07:09:38.177929+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:53.899052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.171786+0000","last_change":"2024-09-19T07:09:17.084856+0000","last_active":"2024-09-19T07:09:38.171786+0000","last_peered":"2024-09-19T07:09:38.171786+0000","last_clean":"2024-09-19T07:09:38.171786+0000","last_became_active":"2024-09-19T07:09:17.084541+0000","last_became_peered":"2024-09-19T07:09:17.084541+0000","last_unstale":"2024-09-19T07:09:38.171786+0000","last_undegraded":"2024-09-19T07:09:38.171786+0000","last_fullsized":"2024-09-19T07:09:38.171786+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:05.978765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.171659+0000","last_change":"2024-09-19T07:09:18.923732+0000","last_active":"2024-09-19T07:09:38.171659+0000","last_peered":"2024-09-19T07:09:38.171659+0000","last_clean":"2024-09-19T07:09:38.171659+0000","last_became_active":"2024-09-19T07:09:18.923410+0000","last_became_peered":"2024-09-19T07:09:18.923410+0000","last_unstale":"2024-09-19T07:09:38.171659+0000","last_undegraded":"2024-09-19T07:09:38.171659+0000","last_fullsized":"2024-09-19T07:09:38.171659+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:01:20.208414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.173640+0000","last_change":"2024-09-19T07:09:16.910364+0000","last_active":"2024-09-19T07:09:38.173640+0000","last_peered":"2024-09-19T07:09:38.173640+0000","last_clean":"2024-09-19T07:09:38.173640+0000","last_became_active":"2024-09-19T07:09:16.909835+0000","last_became_peered":"2024-09-19T07:09:16.909835+0000","last_unstale":"2024-09-19T07:09:38.173640+0000","last_undegraded":"2024-09-19T07:09:38.173640+0000","last_fullsized":"2024-09-19T07:09:38.173640+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:05.198823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":45461,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":95,"num_read_kb":91,"num_write":152,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":26947,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":356352,"data_stored":136383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645329,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":876544,"data_stored":428422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874261,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32704,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712448,"statfs":{"total":95995035648,"available":95961546752,"internally_reserved":0,"allocated":1552384,"data_stored":1061361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037787,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":892928,"data_stored":428658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266719,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":892928,"data_stored":428578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495652,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32644,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712508,"statfs":{"total":95995035648,"available":95961608192,"internally_reserved":0,"allocated":1486848,"data_stored":1020903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659178,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32052,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713100,"statfs":{"total":95995035648,"available":95962214400,"internally_reserved":0,"allocated":880640,"data_stored":428047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888110,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32652,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712500,"statfs":{"total":95995035648,"available":95961600000,"internally_reserved":0,"allocated":1499136,"data_stored":1020194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018931,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32040,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713112,"statfs":{"total":95995035648,"available":95962226688,"internally_reserved":0,"allocated":872448,"data_stored":420418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247864,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":897024,"data_stored":428358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444093,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":897024,"data_stored":429583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607618,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":921600,"data_stored":468905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738439,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":901120,"data_stored":429318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":41065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":42102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":43036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T07:09:45.325 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T07:09:45.577 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:09:46.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.025+0000 7fdcd5429640 1 -- 172.21.15.148:0/3438172078 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcd0102ef0 msgr2=0x7fdcd010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:46.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.025+0000 7fdcd5429640 1 --2- 172.21.15.148:0/3438172078 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcd0102ef0 0x7fdcd010da40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8009900 tx=0x7fdcc802a480 comp rx=0 tx=0).stop 2024-09-19T07:09:46.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.025+0000 7fdcd5429640 1 -- 172.21.15.148:0/3438172078 shutdown_connections 2024-09-19T07:09:46.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.025+0000 7fdcd5429640 1 --2- 172.21.15.148:0/3438172078 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcd0102ef0 0x7fdcd010da40 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:46.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.025+0000 7fdcd5429640 1 --2- 172.21.15.148:0/3438172078 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdcd0102570 0x7fdcd01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:46.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.025+0000 7fdcd5429640 1 --2- 172.21.15.148:0/3438172078 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdcd0100e20 0x7fdcd0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:46.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.025+0000 7fdcd5429640 1 -- 172.21.15.148:0/3438172078 >> 172.21.15.148:0/3438172078 conn(0x7fdcd00fc7d0 msgr2=0x7fdcd00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:46.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.025+0000 7fdcd5429640 1 -- 172.21.15.148:0/3438172078 shutdown_connections 2024-09-19T07:09:46.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.025+0000 7fdcd5429640 1 -- 172.21.15.148:0/3438172078 wait complete. 2024-09-19T07:09:46.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.026+0000 7fdcd5429640 1 Processor -- start 2024-09-19T07:09:46.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.026+0000 7fdcd5429640 1 -- start start 2024-09-19T07:09:46.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.026+0000 7fdcd5429640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdcd0100e20 0x7fdcd010e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:46.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.026+0000 7fdcd5429640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdcd0102570 0x7fdcd010ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:46.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.026+0000 7fdcd5429640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcd0102ef0 0x7fdcd010ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:46.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.026+0000 7fdcd5429640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd01120a0 con 0x7fdcd0102ef0 2024-09-19T07:09:46.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.026+0000 7fdcd5429640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd0111f20 con 0x7fdcd0100e20 2024-09-19T07:09:46.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.026+0000 7fdcd5429640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd0112220 con 0x7fdcd0102570 2024-09-19T07:09:46.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.027+0000 7fdccf7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcd0102ef0 0x7fdcd010ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:46.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.027+0000 7fdccf7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcd0102ef0 0x7fdcd010ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60222/0 (socket says 172.21.15.148:60222) 2024-09-19T07:09:46.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.027+0000 7fdccf7fe640 1 -- 172.21.15.148:0/4044307817 learned_addr learned my addr 172.21.15.148:0/4044307817 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:09:46.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.027+0000 7fdcceffd640 1 --2- 172.21.15.148:0/4044307817 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdcd0100e20 0x7fdcd010e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:46.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.027+0000 7fdcce7fc640 1 --2- 172.21.15.148:0/4044307817 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdcd0102570 0x7fdcd010ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:46.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.027+0000 7fdccf7fe640 1 -- 172.21.15.148:0/4044307817 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdcd0102570 msgr2=0x7fdcd010ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:46.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.027+0000 7fdccf7fe640 1 --2- 172.21.15.148:0/4044307817 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdcd0102570 0x7fdcd010ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:46.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.027+0000 7fdccf7fe640 1 -- 172.21.15.148:0/4044307817 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdcd0100e20 msgr2=0x7fdcd010e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:46.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.027+0000 7fdccf7fe640 1 --2- 172.21.15.148:0/4044307817 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdcd0100e20 0x7fdcd010e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:46.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.027+0000 7fdccf7fe640 1 -- 172.21.15.148:0/4044307817 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcd01a6920 con 0x7fdcd0102ef0 2024-09-19T07:09:46.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.027+0000 7fdcce7fc640 1 --2- 172.21.15.148:0/4044307817 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdcd0102570 0x7fdcd010ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:09:46.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.027+0000 7fdccf7fe640 1 --2- 172.21.15.148:0/4044307817 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcd0102ef0 0x7fdcd010ef50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8005ab0 tx=0x7fdcc8003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:46.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.027+0000 7fdcb7fff640 1 -- 172.21.15.148:0/4044307817 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc803f070 con 0x7fdcd0102ef0 2024-09-19T07:09:46.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.027+0000 7fdcb7fff640 1 -- 172.21.15.148:0/4044307817 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdcc8031e30 con 0x7fdcd0102ef0 2024-09-19T07:09:46.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.027+0000 7fdcd5429640 1 -- 172.21.15.148:0/4044307817 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcd01a6bb0 con 0x7fdcd0102ef0 2024-09-19T07:09:46.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.027+0000 7fdcb7fff640 1 -- 172.21.15.148:0/4044307817 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc8035030 con 0x7fdcd0102ef0 2024-09-19T07:09:46.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.027+0000 7fdcd5429640 1 -- 172.21.15.148:0/4044307817 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcd01a7090 con 0x7fdcd0102ef0 2024-09-19T07:09:46.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.028+0000 7fdcd5429640 1 -- 172.21.15.148:0/4044307817 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcd0101200 con 0x7fdcd0102ef0 2024-09-19T07:09:46.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.029+0000 7fdcb7fff640 1 -- 172.21.15.148:0/4044307817 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fdcc8042070 con 0x7fdcd0102ef0 2024-09-19T07:09:46.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.030+0000 7fdcb7fff640 1 --2- 172.21.15.148:0/4044307817 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fdcb80a32d0 0x7fdcb80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:46.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.030+0000 7fdcceffd640 1 --2- 172.21.15.148:0/4044307817 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fdcb80a32d0 0x7fdcb80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:46.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.030+0000 7fdcb7fff640 1 -- 172.21.15.148:0/4044307817 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7fdcc80f0b20 con 0x7fdcd0102ef0 2024-09-19T07:09:46.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.031+0000 7fdcceffd640 1 --2- 172.21.15.148:0/4044307817 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fdcb80a32d0 0x7fdcb80a5790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0005c40 tx=0x7fdcc000a780 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:46.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.033+0000 7fdcb7fff640 1 -- 172.21.15.148:0/4044307817 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdcc80bd6f0 con 0x7fdcd0102ef0 2024-09-19T07:09:46.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.201+0000 7fdcd5429640 1 -- 172.21.15.148:0/4044307817 --> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdcd0106f90 con 0x7fdcb80a32d0 2024-09-19T07:09:46.202 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:46 smithi148 ceph-mon[31180]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:09:46.203 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:46 smithi148 ceph-mon[31180]: pgmap v284: 97 pgs: 97 active+clean; 621 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 3.1 KiB/s wr, 7 op/s; 3.3 KiB/s, 0 objects/s recovering 2024-09-19T07:09:46.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.208+0000 7fdcb7fff640 1 -- 172.21.15.148:0/4044307817 <== mgr.14148 v2:172.21.15.148:6800/3007822654 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258721 (secure 0 0 0) 0x7fdcd0106f90 con 0x7fdcb80a32d0 2024-09-19T07:09:46.212 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:09:46.213 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2024-09-19T07:09:46.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.212+0000 7fdcd5429640 1 -- 172.21.15.148:0/4044307817 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fdcb80a32d0 msgr2=0x7fdcb80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:46.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.212+0000 7fdcd5429640 1 --2- 172.21.15.148:0/4044307817 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fdcb80a32d0 0x7fdcb80a5790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0005c40 tx=0x7fdcc000a780 comp rx=0 tx=0).stop 2024-09-19T07:09:46.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.212+0000 7fdcd5429640 1 -- 172.21.15.148:0/4044307817 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcd0102ef0 msgr2=0x7fdcd010ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:46.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.212+0000 7fdcd5429640 1 --2- 172.21.15.148:0/4044307817 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcd0102ef0 0x7fdcd010ef50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8005ab0 tx=0x7fdcc8003c30 comp rx=0 tx=0).stop 2024-09-19T07:09:46.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.212+0000 7fdcd5429640 1 -- 172.21.15.148:0/4044307817 shutdown_connections 2024-09-19T07:09:46.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.212+0000 7fdcd5429640 1 --2- 172.21.15.148:0/4044307817 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fdcb80a32d0 0x7fdcb80a5790 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:46.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.212+0000 7fdcd5429640 1 --2- 172.21.15.148:0/4044307817 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcd0102ef0 0x7fdcd010ef50 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:46.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.212+0000 7fdcd5429640 1 --2- 172.21.15.148:0/4044307817 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdcd0102570 0x7fdcd010ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:46.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.212+0000 7fdcd5429640 1 --2- 172.21.15.148:0/4044307817 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdcd0100e20 0x7fdcd010e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:46.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.212+0000 7fdcd5429640 1 -- 172.21.15.148:0/4044307817 >> 172.21.15.148:0/4044307817 conn(0x7fdcd00fc7d0 msgr2=0x7fdcd0106880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:46.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.212+0000 7fdcd5429640 1 -- 172.21.15.148:0/4044307817 shutdown_connections 2024-09-19T07:09:46.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:46.212+0000 7fdcd5429640 1 -- 172.21.15.148:0/4044307817 wait complete. 2024-09-19T07:09:46.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:46 smithi179 ceph-mon[35716]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:09:46.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:46 smithi179 ceph-mon[35716]: pgmap v284: 97 pgs: 97 active+clean; 621 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 3.1 KiB/s wr, 7 op/s; 3.3 KiB/s, 0 objects/s recovering 2024-09-19T07:09:46.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:46 smithi165 ceph-mon[35326]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:09:46.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:46 smithi165 ceph-mon[35326]: pgmap v284: 97 pgs: 97 active+clean; 621 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 3.1 KiB/s wr, 7 op/s; 3.3 KiB/s, 0 objects/s recovering 2024-09-19T07:09:46.935 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":284,"stamp":"2024-09-19T07:09:45.089751+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":636063,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":236,"num_read_kb":210,"num_write":335,"num_write_kb":3027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1207683,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":269,"ondisk_log_size":269,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":289,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":382468,"kb_used_data":12360,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124559356,"statfs":{"total":1151940427776,"available":1151548780544,"internally_reserved":0,"allocated":12656640,"data_stored":7060363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":378713402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19243,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":31,"num_write":16,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":26947,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001659"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.173070+0000","last_change":"2024-09-19T07:09:18.926902+0000","last_active":"2024-09-19T07:09:38.173070+0000","last_peered":"2024-09-19T07:09:38.173070+0000","last_clean":"2024-09-19T07:09:38.173070+0000","last_became_active":"2024-09-19T07:09:18.926582+0000","last_became_peered":"2024-09-19T07:09:18.926582+0000","last_unstale":"2024-09-19T07:09:38.173070+0000","last_undegraded":"2024-09-19T07:09:38.173070+0000","last_fullsized":"2024-09-19T07:09:38.173070+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:37.875779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.178193+0000","last_change":"2024-09-19T07:09:18.934205+0000","last_active":"2024-09-19T07:09:38.178193+0000","last_peered":"2024-09-19T07:09:38.178193+0000","last_clean":"2024-09-19T07:09:38.178193+0000","last_became_active":"2024-09-19T07:09:18.933767+0000","last_became_peered":"2024-09-19T07:09:18.933767+0000","last_unstale":"2024-09-19T07:09:38.178193+0000","last_undegraded":"2024-09-19T07:09:38.178193+0000","last_fullsized":"2024-09-19T07:09:38.178193+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:10:45.391428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.177846+0000","last_change":"2024-09-19T07:09:18.922312+0000","last_active":"2024-09-19T07:09:38.177846+0000","last_peered":"2024-09-19T07:09:38.177846+0000","last_clean":"2024-09-19T07:09:38.177846+0000","last_became_active":"2024-09-19T07:09:18.921476+0000","last_became_peered":"2024-09-19T07:09:18.921476+0000","last_unstale":"2024-09-19T07:09:38.177846+0000","last_undegraded":"2024-09-19T07:09:38.177846+0000","last_fullsized":"2024-09-19T07:09:38.177846+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:29.470616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.217953+0000","last_change":"2024-09-19T07:09:18.938218+0000","last_active":"2024-09-19T07:09:38.217953+0000","last_peered":"2024-09-19T07:09:38.217953+0000","last_clean":"2024-09-19T07:09:38.217953+0000","last_became_active":"2024-09-19T07:09:18.937306+0000","last_became_peered":"2024-09-19T07:09:18.937306+0000","last_unstale":"2024-09-19T07:09:38.217953+0000","last_undegraded":"2024-09-19T07:09:38.217953+0000","last_fullsized":"2024-09-19T07:09:38.217953+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:54.146506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.176208+0000","last_change":"2024-09-19T07:09:18.925837+0000","last_active":"2024-09-19T07:09:38.176208+0000","last_peered":"2024-09-19T07:09:38.176208+0000","last_clean":"2024-09-19T07:09:38.176208+0000","last_became_active":"2024-09-19T07:09:18.925559+0000","last_became_peered":"2024-09-19T07:09:18.925559+0000","last_unstale":"2024-09-19T07:09:38.176208+0000","last_undegraded":"2024-09-19T07:09:38.176208+0000","last_fullsized":"2024-09-19T07:09:38.176208+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:15:58.348347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.172737+0000","last_change":"2024-09-19T07:09:18.938911+0000","last_active":"2024-09-19T07:09:38.172737+0000","last_peered":"2024-09-19T07:09:38.172737+0000","last_clean":"2024-09-19T07:09:38.172737+0000","last_became_active":"2024-09-19T07:09:18.938601+0000","last_became_peered":"2024-09-19T07:09:18.938601+0000","last_unstale":"2024-09-19T07:09:38.172737+0000","last_undegraded":"2024-09-19T07:09:38.172737+0000","last_fullsized":"2024-09-19T07:09:38.172737+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:34.517324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175176+0000","last_change":"2024-09-19T07:09:18.930253+0000","last_active":"2024-09-19T07:09:38.175176+0000","last_peered":"2024-09-19T07:09:38.175176+0000","last_clean":"2024-09-19T07:09:38.175176+0000","last_became_active":"2024-09-19T07:09:18.929927+0000","last_became_peered":"2024-09-19T07:09:18.929927+0000","last_unstale":"2024-09-19T07:09:38.175176+0000","last_undegraded":"2024-09-19T07:09:38.175176+0000","last_fullsized":"2024-09-19T07:09:38.175176+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:31:39.186230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.180634+0000","last_change":"2024-09-19T07:09:38.180197+0000","last_active":"2024-09-19T07:09:38.180634+0000","last_peered":"2024-09-19T07:09:38.180634+0000","last_clean":"2024-09-19T07:09:38.180634+0000","last_became_active":"2024-09-19T07:09:38.179767+0000","last_became_peered":"2024-09-19T07:09:38.179767+0000","last_unstale":"2024-09-19T07:09:38.180634+0000","last_undegraded":"2024-09-19T07:09:38.180634+0000","last_fullsized":"2024-09-19T07:09:38.180634+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:43.581181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.176298+0000","last_change":"2024-09-19T07:09:18.937100+0000","last_active":"2024-09-19T07:09:38.176298+0000","last_peered":"2024-09-19T07:09:38.176298+0000","last_clean":"2024-09-19T07:09:38.176298+0000","last_became_active":"2024-09-19T07:09:18.935151+0000","last_became_peered":"2024-09-19T07:09:18.935151+0000","last_unstale":"2024-09-19T07:09:38.176298+0000","last_undegraded":"2024-09-19T07:09:38.176298+0000","last_fullsized":"2024-09-19T07:09:38.176298+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:46:30.950667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.173253+0000","last_change":"2024-09-19T07:09:18.940119+0000","last_active":"2024-09-19T07:09:38.173253+0000","last_peered":"2024-09-19T07:09:38.173253+0000","last_clean":"2024-09-19T07:09:38.173253+0000","last_became_active":"2024-09-19T07:09:18.939703+0000","last_became_peered":"2024-09-19T07:09:18.939703+0000","last_unstale":"2024-09-19T07:09:38.173253+0000","last_undegraded":"2024-09-19T07:09:38.173253+0000","last_fullsized":"2024-09-19T07:09:38.173253+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:51:04.982727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175765+0000","last_change":"2024-09-19T07:09:18.939146+0000","last_active":"2024-09-19T07:09:38.175765+0000","last_peered":"2024-09-19T07:09:38.175765+0000","last_clean":"2024-09-19T07:09:38.175765+0000","last_became_active":"2024-09-19T07:09:18.936842+0000","last_became_peered":"2024-09-19T07:09:18.936842+0000","last_unstale":"2024-09-19T07:09:38.175765+0000","last_undegraded":"2024-09-19T07:09:38.175765+0000","last_fullsized":"2024-09-19T07:09:38.175765+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:32.713505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.179358+0000","last_change":"2024-09-19T07:09:38.178834+0000","last_active":"2024-09-19T07:09:38.179358+0000","last_peered":"2024-09-19T07:09:38.179358+0000","last_clean":"2024-09-19T07:09:38.179358+0000","last_became_active":"2024-09-19T07:09:38.178477+0000","last_became_peered":"2024-09-19T07:09:38.178477+0000","last_unstale":"2024-09-19T07:09:38.179358+0000","last_undegraded":"2024-09-19T07:09:38.179358+0000","last_fullsized":"2024-09-19T07:09:38.179358+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:04:44.524920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.392086+0000","last_change":"2024-09-19T07:09:18.935422+0000","last_active":"2024-09-19T07:09:38.392086+0000","last_peered":"2024-09-19T07:09:38.392086+0000","last_clean":"2024-09-19T07:09:38.392086+0000","last_became_active":"2024-09-19T07:09:18.934994+0000","last_became_peered":"2024-09-19T07:09:18.934994+0000","last_unstale":"2024-09-19T07:09:38.392086+0000","last_undegraded":"2024-09-19T07:09:38.392086+0000","last_fullsized":"2024-09-19T07:09:38.392086+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:37:30.751247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.177649+0000","last_change":"2024-09-19T07:09:18.933954+0000","last_active":"2024-09-19T07:09:38.177649+0000","last_peered":"2024-09-19T07:09:38.177649+0000","last_clean":"2024-09-19T07:09:38.177649+0000","last_became_active":"2024-09-19T07:09:18.933588+0000","last_became_peered":"2024-09-19T07:09:18.933588+0000","last_unstale":"2024-09-19T07:09:38.177649+0000","last_undegraded":"2024-09-19T07:09:38.177649+0000","last_fullsized":"2024-09-19T07:09:38.177649+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:10.161172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.177587+0000","last_change":"2024-09-19T07:09:18.932122+0000","last_active":"2024-09-19T07:09:38.177587+0000","last_peered":"2024-09-19T07:09:38.177587+0000","last_clean":"2024-09-19T07:09:38.177587+0000","last_became_active":"2024-09-19T07:09:18.931798+0000","last_became_peered":"2024-09-19T07:09:18.931798+0000","last_unstale":"2024-09-19T07:09:38.177587+0000","last_undegraded":"2024-09-19T07:09:38.177587+0000","last_fullsized":"2024-09-19T07:09:38.177587+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:44.776375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175320+0000","last_change":"2024-09-19T07:09:18.935632+0000","last_active":"2024-09-19T07:09:38.175320+0000","last_peered":"2024-09-19T07:09:38.175320+0000","last_clean":"2024-09-19T07:09:38.175320+0000","last_became_active":"2024-09-19T07:09:18.935174+0000","last_became_peered":"2024-09-19T07:09:18.935174+0000","last_unstale":"2024-09-19T07:09:38.175320+0000","last_undegraded":"2024-09-19T07:09:38.175320+0000","last_fullsized":"2024-09-19T07:09:38.175320+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:22.170777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.173065+0000","last_change":"2024-09-19T07:09:18.931836+0000","last_active":"2024-09-19T07:09:38.173065+0000","last_peered":"2024-09-19T07:09:38.173065+0000","last_clean":"2024-09-19T07:09:38.173065+0000","last_became_active":"2024-09-19T07:09:18.931564+0000","last_became_peered":"2024-09-19T07:09:18.931564+0000","last_unstale":"2024-09-19T07:09:38.173065+0000","last_undegraded":"2024-09-19T07:09:38.173065+0000","last_fullsized":"2024-09-19T07:09:38.173065+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:53.674584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.173640+0000","last_change":"2024-09-19T07:09:18.933210+0000","last_active":"2024-09-19T07:09:38.173640+0000","last_peered":"2024-09-19T07:09:38.173640+0000","last_clean":"2024-09-19T07:09:38.173640+0000","last_became_active":"2024-09-19T07:09:18.932894+0000","last_became_peered":"2024-09-19T07:09:18.932894+0000","last_unstale":"2024-09-19T07:09:38.173640+0000","last_undegraded":"2024-09-19T07:09:38.173640+0000","last_fullsized":"2024-09-19T07:09:38.173640+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:50:56.669801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175421+0000","last_change":"2024-09-19T07:09:18.925627+0000","last_active":"2024-09-19T07:09:38.175421+0000","last_peered":"2024-09-19T07:09:38.175421+0000","last_clean":"2024-09-19T07:09:38.175421+0000","last_became_active":"2024-09-19T07:09:18.925340+0000","last_became_peered":"2024-09-19T07:09:18.925340+0000","last_unstale":"2024-09-19T07:09:38.175421+0000","last_undegraded":"2024-09-19T07:09:38.175421+0000","last_fullsized":"2024-09-19T07:09:38.175421+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:29.544534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.172766+0000","last_change":"2024-09-19T07:09:18.936963+0000","last_active":"2024-09-19T07:09:38.172766+0000","last_peered":"2024-09-19T07:09:38.172766+0000","last_clean":"2024-09-19T07:09:38.172766+0000","last_became_active":"2024-09-19T07:09:18.936615+0000","last_became_peered":"2024-09-19T07:09:18.936615+0000","last_unstale":"2024-09-19T07:09:38.172766+0000","last_undegraded":"2024-09-19T07:09:38.172766+0000","last_fullsized":"2024-09-19T07:09:38.172766+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:13.036392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.392101+0000","last_change":"2024-09-19T07:09:18.932018+0000","last_active":"2024-09-19T07:09:38.392101+0000","last_peered":"2024-09-19T07:09:38.392101+0000","last_clean":"2024-09-19T07:09:38.392101+0000","last_became_active":"2024-09-19T07:09:18.931624+0000","last_became_peered":"2024-09-19T07:09:18.931624+0000","last_unstale":"2024-09-19T07:09:38.392101+0000","last_undegraded":"2024-09-19T07:09:38.392101+0000","last_fullsized":"2024-09-19T07:09:38.392101+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:53:05.585166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175898+0000","last_change":"2024-09-19T07:09:18.935474+0000","last_active":"2024-09-19T07:09:38.175898+0000","last_peered":"2024-09-19T07:09:38.175898+0000","last_clean":"2024-09-19T07:09:38.175898+0000","last_became_active":"2024-09-19T07:09:18.929018+0000","last_became_peered":"2024-09-19T07:09:18.929018+0000","last_unstale":"2024-09-19T07:09:38.175898+0000","last_undegraded":"2024-09-19T07:09:38.175898+0000","last_fullsized":"2024-09-19T07:09:38.175898+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:01.383024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.171441+0000","last_change":"2024-09-19T07:09:18.928733+0000","last_active":"2024-09-19T07:09:38.171441+0000","last_peered":"2024-09-19T07:09:38.171441+0000","last_clean":"2024-09-19T07:09:38.171441+0000","last_became_active":"2024-09-19T07:09:18.928431+0000","last_became_peered":"2024-09-19T07:09:18.928431+0000","last_unstale":"2024-09-19T07:09:38.171441+0000","last_undegraded":"2024-09-19T07:09:38.171441+0000","last_fullsized":"2024-09-19T07:09:38.171441+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:37.313958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.178508+0000","last_change":"2024-09-19T07:09:18.921268+0000","last_active":"2024-09-19T07:09:38.178508+0000","last_peered":"2024-09-19T07:09:38.178508+0000","last_clean":"2024-09-19T07:09:38.178508+0000","last_became_active":"2024-09-19T07:09:18.920482+0000","last_became_peered":"2024-09-19T07:09:18.920482+0000","last_unstale":"2024-09-19T07:09:38.178508+0000","last_undegraded":"2024-09-19T07:09:38.178508+0000","last_fullsized":"2024-09-19T07:09:38.178508+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:35.201826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.179136+0000","last_change":"2024-09-19T07:09:38.179136+0000","last_active":"2024-09-19T07:09:38.179136+0000","last_peered":"2024-09-19T07:09:38.179136+0000","last_clean":"2024-09-19T07:09:38.179136+0000","last_became_active":"2024-09-19T07:09:38.178746+0000","last_became_peered":"2024-09-19T07:09:38.178746+0000","last_unstale":"2024-09-19T07:09:38.179136+0000","last_undegraded":"2024-09-19T07:09:38.179136+0000","last_fullsized":"2024-09-19T07:09:38.179136+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:03.788114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.177288+0000","last_change":"2024-09-19T07:09:18.924099+0000","last_active":"2024-09-19T07:09:38.177288+0000","last_peered":"2024-09-19T07:09:38.177288+0000","last_clean":"2024-09-19T07:09:38.177288+0000","last_became_active":"2024-09-19T07:09:18.923772+0000","last_became_peered":"2024-09-19T07:09:18.923772+0000","last_unstale":"2024-09-19T07:09:38.177288+0000","last_undegraded":"2024-09-19T07:09:38.177288+0000","last_fullsized":"2024-09-19T07:09:38.177288+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:05:04.954087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.172932+0000","last_change":"2024-09-19T07:09:18.923391+0000","last_active":"2024-09-19T07:09:38.172932+0000","last_peered":"2024-09-19T07:09:38.172932+0000","last_clean":"2024-09-19T07:09:38.172932+0000","last_became_active":"2024-09-19T07:09:18.923085+0000","last_became_peered":"2024-09-19T07:09:18.923085+0000","last_unstale":"2024-09-19T07:09:38.172932+0000","last_undegraded":"2024-09-19T07:09:38.172932+0000","last_fullsized":"2024-09-19T07:09:38.172932+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:43:27.032400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.392065+0000","last_change":"2024-09-19T07:09:18.937188+0000","last_active":"2024-09-19T07:09:38.392065+0000","last_peered":"2024-09-19T07:09:38.392065+0000","last_clean":"2024-09-19T07:09:38.392065+0000","last_became_active":"2024-09-19T07:09:18.936866+0000","last_became_peered":"2024-09-19T07:09:18.936866+0000","last_unstale":"2024-09-19T07:09:38.392065+0000","last_undegraded":"2024-09-19T07:09:38.392065+0000","last_fullsized":"2024-09-19T07:09:38.392065+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:29:08.835307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.177927+0000","last_change":"2024-09-19T07:09:18.935170+0000","last_active":"2024-09-19T07:09:38.177927+0000","last_peered":"2024-09-19T07:09:38.177927+0000","last_clean":"2024-09-19T07:09:38.177927+0000","last_became_active":"2024-09-19T07:09:18.934356+0000","last_became_peered":"2024-09-19T07:09:18.934356+0000","last_unstale":"2024-09-19T07:09:38.177927+0000","last_undegraded":"2024-09-19T07:09:38.177927+0000","last_fullsized":"2024-09-19T07:09:38.177927+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:53.567392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175782+0000","last_change":"2024-09-19T07:09:18.922640+0000","last_active":"2024-09-19T07:09:38.175782+0000","last_peered":"2024-09-19T07:09:38.175782+0000","last_clean":"2024-09-19T07:09:38.175782+0000","last_became_active":"2024-09-19T07:09:18.922312+0000","last_became_peered":"2024-09-19T07:09:18.922312+0000","last_unstale":"2024-09-19T07:09:38.175782+0000","last_undegraded":"2024-09-19T07:09:38.175782+0000","last_fullsized":"2024-09-19T07:09:38.175782+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:50.868818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.176074+0000","last_change":"2024-09-19T07:09:18.934364+0000","last_active":"2024-09-19T07:09:38.176074+0000","last_peered":"2024-09-19T07:09:38.176074+0000","last_clean":"2024-09-19T07:09:38.176074+0000","last_became_active":"2024-09-19T07:09:18.933533+0000","last_became_peered":"2024-09-19T07:09:18.933533+0000","last_unstale":"2024-09-19T07:09:38.176074+0000","last_undegraded":"2024-09-19T07:09:38.176074+0000","last_fullsized":"2024-09-19T07:09:38.176074+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:54.175425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.172694+0000","last_change":"2024-09-19T07:09:18.927456+0000","last_active":"2024-09-19T07:09:38.172694+0000","last_peered":"2024-09-19T07:09:38.172694+0000","last_clean":"2024-09-19T07:09:38.172694+0000","last_became_active":"2024-09-19T07:09:18.927117+0000","last_became_peered":"2024-09-19T07:09:18.927117+0000","last_unstale":"2024-09-19T07:09:38.172694+0000","last_undegraded":"2024-09-19T07:09:38.172694+0000","last_fullsized":"2024-09-19T07:09:38.172694+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:08.885898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.176351+0000","last_change":"2024-09-19T07:09:18.926024+0000","last_active":"2024-09-19T07:09:38.176351+0000","last_peered":"2024-09-19T07:09:38.176351+0000","last_clean":"2024-09-19T07:09:38.176351+0000","last_became_active":"2024-09-19T07:09:18.925689+0000","last_became_peered":"2024-09-19T07:09:18.925689+0000","last_unstale":"2024-09-19T07:09:38.176351+0000","last_undegraded":"2024-09-19T07:09:38.176351+0000","last_fullsized":"2024-09-19T07:09:38.176351+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:09:08.178214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'6","reported_seq":45,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:41.008807+0000","last_change":"2024-09-19T07:09:16.915804+0000","last_active":"2024-09-19T07:09:41.008807+0000","last_peered":"2024-09-19T07:09:41.008807+0000","last_clean":"2024-09-19T07:09:41.008807+0000","last_became_active":"2024-09-19T07:09:16.915434+0000","last_became_peered":"2024-09-19T07:09:16.915434+0000","last_unstale":"2024-09-19T07:09:41.008807+0000","last_undegraded":"2024-09-19T07:09:41.008807+0000","last_fullsized":"2024-09-19T07:09:41.008807+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:57.230475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.176935+0000","last_change":"2024-09-19T07:09:18.932497+0000","last_active":"2024-09-19T07:09:38.176935+0000","last_peered":"2024-09-19T07:09:38.176935+0000","last_clean":"2024-09-19T07:09:38.176935+0000","last_became_active":"2024-09-19T07:09:18.932213+0000","last_became_peered":"2024-09-19T07:09:18.932213+0000","last_unstale":"2024-09-19T07:09:38.176935+0000","last_undegraded":"2024-09-19T07:09:38.176935+0000","last_fullsized":"2024-09-19T07:09:38.176935+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:10.299077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.172875+0000","last_change":"2024-09-19T07:09:16.910171+0000","last_active":"2024-09-19T07:09:38.172875+0000","last_peered":"2024-09-19T07:09:38.172875+0000","last_clean":"2024-09-19T07:09:38.172875+0000","last_became_active":"2024-09-19T07:09:16.909840+0000","last_became_peered":"2024-09-19T07:09:16.909840+0000","last_unstale":"2024-09-19T07:09:38.172875+0000","last_undegraded":"2024-09-19T07:09:38.172875+0000","last_fullsized":"2024-09-19T07:09:38.172875+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:35.448892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.391818+0000","last_change":"2024-09-19T07:09:16.911336+0000","last_active":"2024-09-19T07:09:38.391818+0000","last_peered":"2024-09-19T07:09:38.391818+0000","last_clean":"2024-09-19T07:09:38.391818+0000","last_became_active":"2024-09-19T07:09:16.911027+0000","last_became_peered":"2024-09-19T07:09:16.911027+0000","last_unstale":"2024-09-19T07:09:38.391818+0000","last_undegraded":"2024-09-19T07:09:38.391818+0000","last_fullsized":"2024-09-19T07:09:38.391818+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:37:50.698597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.171395+0000","last_change":"2024-09-19T07:09:18.927713+0000","last_active":"2024-09-19T07:09:38.171395+0000","last_peered":"2024-09-19T07:09:38.171395+0000","last_clean":"2024-09-19T07:09:38.171395+0000","last_became_active":"2024-09-19T07:09:18.927430+0000","last_became_peered":"2024-09-19T07:09:18.927430+0000","last_unstale":"2024-09-19T07:09:38.171395+0000","last_undegraded":"2024-09-19T07:09:38.171395+0000","last_fullsized":"2024-09-19T07:09:38.171395+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:15:07.707723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.178877+0000","last_change":"2024-09-19T07:09:16.912391+0000","last_active":"2024-09-19T07:09:38.178877+0000","last_peered":"2024-09-19T07:09:38.178877+0000","last_clean":"2024-09-19T07:09:38.178877+0000","last_became_active":"2024-09-19T07:09:16.912034+0000","last_became_peered":"2024-09-19T07:09:16.912034+0000","last_unstale":"2024-09-19T07:09:38.178877+0000","last_undegraded":"2024-09-19T07:09:38.178877+0000","last_fullsized":"2024-09-19T07:09:38.178877+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:18:45.226107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.173014+0000","last_change":"2024-09-19T07:09:18.929476+0000","last_active":"2024-09-19T07:09:38.173014+0000","last_peered":"2024-09-19T07:09:38.173014+0000","last_clean":"2024-09-19T07:09:38.173014+0000","last_became_active":"2024-09-19T07:09:18.929183+0000","last_became_peered":"2024-09-19T07:09:18.929183+0000","last_unstale":"2024-09-19T07:09:38.173014+0000","last_undegraded":"2024-09-19T07:09:38.173014+0000","last_fullsized":"2024-09-19T07:09:38.173014+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:19:38.827130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'3","reported_seq":37,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:39.004941+0000","last_change":"2024-09-19T07:09:16.913012+0000","last_active":"2024-09-19T07:09:39.004941+0000","last_peered":"2024-09-19T07:09:39.004941+0000","last_clean":"2024-09-19T07:09:39.004941+0000","last_became_active":"2024-09-19T07:09:16.912633+0000","last_became_peered":"2024-09-19T07:09:16.912633+0000","last_unstale":"2024-09-19T07:09:39.004941+0000","last_undegraded":"2024-09-19T07:09:39.004941+0000","last_fullsized":"2024-09-19T07:09:39.004941+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:21:39.669961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175677+0000","last_change":"2024-09-19T07:09:18.937323+0000","last_active":"2024-09-19T07:09:38.175677+0000","last_peered":"2024-09-19T07:09:38.175677+0000","last_clean":"2024-09-19T07:09:38.175677+0000","last_became_active":"2024-09-19T07:09:18.936762+0000","last_became_peered":"2024-09-19T07:09:18.936762+0000","last_unstale":"2024-09-19T07:09:38.175677+0000","last_undegraded":"2024-09-19T07:09:38.175677+0000","last_fullsized":"2024-09-19T07:09:38.175677+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:37.692290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.176072+0000","last_change":"2024-09-19T07:09:16.912167+0000","last_active":"2024-09-19T07:09:38.176072+0000","last_peered":"2024-09-19T07:09:38.176072+0000","last_clean":"2024-09-19T07:09:38.176072+0000","last_became_active":"2024-09-19T07:09:16.911840+0000","last_became_peered":"2024-09-19T07:09:16.911840+0000","last_unstale":"2024-09-19T07:09:38.176072+0000","last_undegraded":"2024-09-19T07:09:38.176072+0000","last_fullsized":"2024-09-19T07:09:38.176072+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:31.901906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.178050+0000","last_change":"2024-09-19T07:09:18.932239+0000","last_active":"2024-09-19T07:09:38.178050+0000","last_peered":"2024-09-19T07:09:38.178050+0000","last_clean":"2024-09-19T07:09:38.178050+0000","last_became_active":"2024-09-19T07:09:18.931820+0000","last_became_peered":"2024-09-19T07:09:18.931820+0000","last_unstale":"2024-09-19T07:09:38.178050+0000","last_undegraded":"2024-09-19T07:09:38.178050+0000","last_fullsized":"2024-09-19T07:09:38.178050+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:09.407524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.178561+0000","last_change":"2024-09-19T07:09:17.085077+0000","last_active":"2024-09-19T07:09:38.178561+0000","last_peered":"2024-09-19T07:09:38.178561+0000","last_clean":"2024-09-19T07:09:38.178561+0000","last_became_active":"2024-09-19T07:09:17.084457+0000","last_became_peered":"2024-09-19T07:09:17.084457+0000","last_unstale":"2024-09-19T07:09:38.178561+0000","last_undegraded":"2024-09-19T07:09:38.178561+0000","last_fullsized":"2024-09-19T07:09:38.178561+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:42.416193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175612+0000","last_change":"2024-09-19T07:09:18.939830+0000","last_active":"2024-09-19T07:09:38.175612+0000","last_peered":"2024-09-19T07:09:38.175612+0000","last_clean":"2024-09-19T07:09:38.175612+0000","last_became_active":"2024-09-19T07:09:18.939359+0000","last_became_peered":"2024-09-19T07:09:18.939359+0000","last_unstale":"2024-09-19T07:09:38.175612+0000","last_undegraded":"2024-09-19T07:09:38.175612+0000","last_fullsized":"2024-09-19T07:09:38.175612+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:24:46.241902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'21","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:39.227381+0000","last_change":"2024-09-19T07:09:38.227707+0000","last_active":"2024-09-19T07:09:39.227381+0000","last_peered":"2024-09-19T07:09:39.227381+0000","last_clean":"2024-09-19T07:09:39.227381+0000","last_became_active":"2024-09-19T07:09:38.219073+0000","last_became_peered":"2024-09-19T07:09:38.219073+0000","last_unstale":"2024-09-19T07:09:39.227381+0000","last_undegraded":"2024-09-19T07:09:39.227381+0000","last_fullsized":"2024-09-19T07:09:39.227381+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:46.035315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41065,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":47,"num_write":22,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":26947,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.176558+0000","last_change":"2024-09-19T07:09:18.929531+0000","last_active":"2024-09-19T07:09:38.176558+0000","last_peered":"2024-09-19T07:09:38.176558+0000","last_clean":"2024-09-19T07:09:38.176558+0000","last_became_active":"2024-09-19T07:09:18.929253+0000","last_became_peered":"2024-09-19T07:09:18.929253+0000","last_unstale":"2024-09-19T07:09:38.176558+0000","last_undegraded":"2024-09-19T07:09:38.176558+0000","last_fullsized":"2024-09-19T07:09:38.176558+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:10.635116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175337+0000","last_change":"2024-09-19T07:09:16.914964+0000","last_active":"2024-09-19T07:09:38.175337+0000","last_peered":"2024-09-19T07:09:38.175337+0000","last_clean":"2024-09-19T07:09:38.175337+0000","last_became_active":"2024-09-19T07:09:16.914540+0000","last_became_peered":"2024-09-19T07:09:16.914540+0000","last_unstale":"2024-09-19T07:09:38.175337+0000","last_undegraded":"2024-09-19T07:09:38.175337+0000","last_fullsized":"2024-09-19T07:09:38.175337+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:30.903046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.391882+0000","last_change":"2024-09-19T07:09:18.931709+0000","last_active":"2024-09-19T07:09:38.391882+0000","last_peered":"2024-09-19T07:09:38.391882+0000","last_clean":"2024-09-19T07:09:38.391882+0000","last_became_active":"2024-09-19T07:09:18.931345+0000","last_became_peered":"2024-09-19T07:09:18.931345+0000","last_unstale":"2024-09-19T07:09:38.391882+0000","last_undegraded":"2024-09-19T07:09:38.391882+0000","last_fullsized":"2024-09-19T07:09:38.391882+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:28.916820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.177361+0000","last_change":"2024-09-19T07:09:16.914055+0000","last_active":"2024-09-19T07:09:38.177361+0000","last_peered":"2024-09-19T07:09:38.177361+0000","last_clean":"2024-09-19T07:09:38.177361+0000","last_became_active":"2024-09-19T07:09:16.913589+0000","last_became_peered":"2024-09-19T07:09:16.913589+0000","last_unstale":"2024-09-19T07:09:38.177361+0000","last_undegraded":"2024-09-19T07:09:38.177361+0000","last_fullsized":"2024-09-19T07:09:38.177361+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:29:16.322059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175501+0000","last_change":"2024-09-19T07:09:18.934879+0000","last_active":"2024-09-19T07:09:38.175501+0000","last_peered":"2024-09-19T07:09:38.175501+0000","last_clean":"2024-09-19T07:09:38.175501+0000","last_became_active":"2024-09-19T07:09:18.934432+0000","last_became_peered":"2024-09-19T07:09:18.934432+0000","last_unstale":"2024-09-19T07:09:38.175501+0000","last_undegraded":"2024-09-19T07:09:38.175501+0000","last_fullsized":"2024-09-19T07:09:38.175501+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:25.782782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'4","reported_seq":45,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:43.011263+0000","last_change":"2024-09-19T07:09:16.909256+0000","last_active":"2024-09-19T07:09:43.011263+0000","last_peered":"2024-09-19T07:09:43.011263+0000","last_clean":"2024-09-19T07:09:43.011263+0000","last_became_active":"2024-09-19T07:09:16.908932+0000","last_became_peered":"2024-09-19T07:09:16.908932+0000","last_unstale":"2024-09-19T07:09:43.011263+0000","last_undegraded":"2024-09-19T07:09:43.011263+0000","last_fullsized":"2024-09-19T07:09:43.011263+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:28.344756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175202+0000","last_change":"2024-09-19T07:09:18.931844+0000","last_active":"2024-09-19T07:09:38.175202+0000","last_peered":"2024-09-19T07:09:38.175202+0000","last_clean":"2024-09-19T07:09:38.175202+0000","last_became_active":"2024-09-19T07:09:18.931516+0000","last_became_peered":"2024-09-19T07:09:18.931516+0000","last_unstale":"2024-09-19T07:09:38.175202+0000","last_undegraded":"2024-09-19T07:09:38.175202+0000","last_fullsized":"2024-09-19T07:09:38.175202+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:27:29.812144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.176125+0000","last_change":"2024-09-19T07:09:17.085252+0000","last_active":"2024-09-19T07:09:38.176125+0000","last_peered":"2024-09-19T07:09:38.176125+0000","last_clean":"2024-09-19T07:09:38.176125+0000","last_became_active":"2024-09-19T07:09:17.084907+0000","last_became_peered":"2024-09-19T07:09:17.084907+0000","last_unstale":"2024-09-19T07:09:38.176125+0000","last_undegraded":"2024-09-19T07:09:38.176125+0000","last_fullsized":"2024-09-19T07:09:38.176125+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:59:40.351181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.177112+0000","last_change":"2024-09-19T07:09:18.932491+0000","last_active":"2024-09-19T07:09:38.177112+0000","last_peered":"2024-09-19T07:09:38.177112+0000","last_clean":"2024-09-19T07:09:38.177112+0000","last_became_active":"2024-09-19T07:09:18.932159+0000","last_became_peered":"2024-09-19T07:09:18.932159+0000","last_unstale":"2024-09-19T07:09:38.177112+0000","last_undegraded":"2024-09-19T07:09:38.177112+0000","last_fullsized":"2024-09-19T07:09:38.177112+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:31.144130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.178704+0000","last_change":"2024-09-19T07:09:16.911012+0000","last_active":"2024-09-19T07:09:38.178704+0000","last_peered":"2024-09-19T07:09:38.178704+0000","last_clean":"2024-09-19T07:09:38.178704+0000","last_became_active":"2024-09-19T07:09:16.910618+0000","last_became_peered":"2024-09-19T07:09:16.910618+0000","last_unstale":"2024-09-19T07:09:38.178704+0000","last_undegraded":"2024-09-19T07:09:38.178704+0000","last_fullsized":"2024-09-19T07:09:38.178704+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:16.316680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.217870+0000","last_change":"2024-09-19T07:09:38.217870+0000","last_active":"2024-09-19T07:09:38.217870+0000","last_peered":"2024-09-19T07:09:38.217870+0000","last_clean":"2024-09-19T07:09:38.217870+0000","last_became_active":"2024-09-19T07:09:38.217585+0000","last_became_peered":"2024-09-19T07:09:38.217585+0000","last_unstale":"2024-09-19T07:09:38.217870+0000","last_undegraded":"2024-09-19T07:09:38.217870+0000","last_fullsized":"2024-09-19T07:09:38.217870+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:41.320705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.392249+0000","last_change":"2024-09-19T07:09:16.911644+0000","last_active":"2024-09-19T07:09:38.392249+0000","last_peered":"2024-09-19T07:09:38.392249+0000","last_clean":"2024-09-19T07:09:38.392249+0000","last_became_active":"2024-09-19T07:09:16.911368+0000","last_became_peered":"2024-09-19T07:09:16.911368+0000","last_unstale":"2024-09-19T07:09:38.392249+0000","last_undegraded":"2024-09-19T07:09:38.392249+0000","last_fullsized":"2024-09-19T07:09:38.392249+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:12.953466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.176202+0000","last_change":"2024-09-19T07:09:18.933667+0000","last_active":"2024-09-19T07:09:38.176202+0000","last_peered":"2024-09-19T07:09:38.176202+0000","last_clean":"2024-09-19T07:09:38.176202+0000","last_became_active":"2024-09-19T07:09:18.933288+0000","last_became_peered":"2024-09-19T07:09:18.933288+0000","last_unstale":"2024-09-19T07:09:38.176202+0000","last_undegraded":"2024-09-19T07:09:38.176202+0000","last_fullsized":"2024-09-19T07:09:38.176202+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:54:38.127799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.178634+0000","last_change":"2024-09-19T07:09:16.909722+0000","last_active":"2024-09-19T07:09:38.178634+0000","last_peered":"2024-09-19T07:09:38.178634+0000","last_clean":"2024-09-19T07:09:38.178634+0000","last_became_active":"2024-09-19T07:09:16.909394+0000","last_became_peered":"2024-09-19T07:09:16.909394+0000","last_unstale":"2024-09-19T07:09:38.178634+0000","last_undegraded":"2024-09-19T07:09:38.178634+0000","last_fullsized":"2024-09-19T07:09:38.178634+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:21:53.342710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175698+0000","last_change":"2024-09-19T07:09:18.929473+0000","last_active":"2024-09-19T07:09:38.175698+0000","last_peered":"2024-09-19T07:09:38.175698+0000","last_clean":"2024-09-19T07:09:38.175698+0000","last_became_active":"2024-09-19T07:09:18.929176+0000","last_became_peered":"2024-09-19T07:09:18.929176+0000","last_unstale":"2024-09-19T07:09:38.175698+0000","last_undegraded":"2024-09-19T07:09:38.175698+0000","last_fullsized":"2024-09-19T07:09:38.175698+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:32:30.409528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175529+0000","last_change":"2024-09-19T07:09:17.084868+0000","last_active":"2024-09-19T07:09:38.175529+0000","last_peered":"2024-09-19T07:09:38.175529+0000","last_clean":"2024-09-19T07:09:38.175529+0000","last_became_active":"2024-09-19T07:09:17.084448+0000","last_became_peered":"2024-09-19T07:09:17.084448+0000","last_unstale":"2024-09-19T07:09:38.175529+0000","last_undegraded":"2024-09-19T07:09:38.175529+0000","last_fullsized":"2024-09-19T07:09:38.175529+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:38.211697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175880+0000","last_change":"2024-09-19T07:09:18.938865+0000","last_active":"2024-09-19T07:09:38.175880+0000","last_peered":"2024-09-19T07:09:38.175880+0000","last_clean":"2024-09-19T07:09:38.175880+0000","last_became_active":"2024-09-19T07:09:18.936324+0000","last_became_peered":"2024-09-19T07:09:18.936324+0000","last_unstale":"2024-09-19T07:09:38.175880+0000","last_undegraded":"2024-09-19T07:09:38.175880+0000","last_fullsized":"2024-09-19T07:09:38.175880+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:29:51.081140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":342,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175329+0000","last_change":"2024-09-19T07:08:09.270850+0000","last_active":"2024-09-19T07:09:38.175329+0000","last_peered":"2024-09-19T07:09:38.175329+0000","last_clean":"2024-09-19T07:09:38.175329+0000","last_became_active":"2024-09-19T07:08:09.270308+0000","last_became_peered":"2024-09-19T07:08:09.270308+0000","last_unstale":"2024-09-19T07:09:38.175329+0000","last_undegraded":"2024-09-19T07:09:38.175329+0000","last_fullsized":"2024-09-19T07:09:38.175329+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:04:49.729632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:04:49.729632+0000","last_clean_scrub_stamp":"2024-09-19T07:04:49.729632+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:15.588732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.217622+0000","last_change":"2024-09-19T07:09:16.907648+0000","last_active":"2024-09-19T07:09:38.217622+0000","last_peered":"2024-09-19T07:09:38.217622+0000","last_clean":"2024-09-19T07:09:38.217622+0000","last_became_active":"2024-09-19T07:09:16.907363+0000","last_became_peered":"2024-09-19T07:09:16.907363+0000","last_unstale":"2024-09-19T07:09:38.217622+0000","last_undegraded":"2024-09-19T07:09:38.217622+0000","last_fullsized":"2024-09-19T07:09:38.217622+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:12:27.898493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.171872+0000","last_change":"2024-09-19T07:09:18.926008+0000","last_active":"2024-09-19T07:09:38.171872+0000","last_peered":"2024-09-19T07:09:38.171872+0000","last_clean":"2024-09-19T07:09:38.171872+0000","last_became_active":"2024-09-19T07:09:18.925689+0000","last_became_peered":"2024-09-19T07:09:18.925689+0000","last_unstale":"2024-09-19T07:09:38.171872+0000","last_undegraded":"2024-09-19T07:09:38.171872+0000","last_fullsized":"2024-09-19T07:09:38.171872+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:16:06.467934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175270+0000","last_change":"2024-09-19T07:09:16.911327+0000","last_active":"2024-09-19T07:09:38.175270+0000","last_peered":"2024-09-19T07:09:38.175270+0000","last_clean":"2024-09-19T07:09:38.175270+0000","last_became_active":"2024-09-19T07:09:16.911031+0000","last_became_peered":"2024-09-19T07:09:16.911031+0000","last_unstale":"2024-09-19T07:09:38.175270+0000","last_undegraded":"2024-09-19T07:09:38.175270+0000","last_fullsized":"2024-09-19T07:09:38.175270+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:03.307119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.391808+0000","last_change":"2024-09-19T07:09:18.933813+0000","last_active":"2024-09-19T07:09:38.391808+0000","last_peered":"2024-09-19T07:09:38.391808+0000","last_clean":"2024-09-19T07:09:38.391808+0000","last_became_active":"2024-09-19T07:09:18.933475+0000","last_became_peered":"2024-09-19T07:09:18.933475+0000","last_unstale":"2024-09-19T07:09:38.391808+0000","last_undegraded":"2024-09-19T07:09:38.391808+0000","last_fullsized":"2024-09-19T07:09:38.391808+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:34:09.149593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'4","reported_seq":40,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:41.007515+0000","last_change":"2024-09-19T07:09:17.084833+0000","last_active":"2024-09-19T07:09:41.007515+0000","last_peered":"2024-09-19T07:09:41.007515+0000","last_clean":"2024-09-19T07:09:41.007515+0000","last_became_active":"2024-09-19T07:09:17.084477+0000","last_became_peered":"2024-09-19T07:09:17.084477+0000","last_unstale":"2024-09-19T07:09:41.007515+0000","last_undegraded":"2024-09-19T07:09:41.007515+0000","last_fullsized":"2024-09-19T07:09:41.007515+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:17:50.962480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.178639+0000","last_change":"2024-09-19T07:09:18.935991+0000","last_active":"2024-09-19T07:09:38.178639+0000","last_peered":"2024-09-19T07:09:38.178639+0000","last_clean":"2024-09-19T07:09:38.178639+0000","last_became_active":"2024-09-19T07:09:18.935677+0000","last_became_peered":"2024-09-19T07:09:18.935677+0000","last_unstale":"2024-09-19T07:09:38.178639+0000","last_undegraded":"2024-09-19T07:09:38.178639+0000","last_fullsized":"2024-09-19T07:09:38.178639+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:45.550119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175650+0000","last_change":"2024-09-19T07:09:16.911755+0000","last_active":"2024-09-19T07:09:38.175650+0000","last_peered":"2024-09-19T07:09:38.175650+0000","last_clean":"2024-09-19T07:09:38.175650+0000","last_became_active":"2024-09-19T07:09:16.911211+0000","last_became_peered":"2024-09-19T07:09:16.911211+0000","last_unstale":"2024-09-19T07:09:38.175650+0000","last_undegraded":"2024-09-19T07:09:38.175650+0000","last_fullsized":"2024-09-19T07:09:38.175650+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:15.365423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.173027+0000","last_change":"2024-09-19T07:09:18.940282+0000","last_active":"2024-09-19T07:09:38.173027+0000","last_peered":"2024-09-19T07:09:38.173027+0000","last_clean":"2024-09-19T07:09:38.173027+0000","last_became_active":"2024-09-19T07:09:18.939918+0000","last_became_peered":"2024-09-19T07:09:18.939918+0000","last_unstale":"2024-09-19T07:09:38.173027+0000","last_undegraded":"2024-09-19T07:09:38.173027+0000","last_fullsized":"2024-09-19T07:09:38.173027+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:11.161676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.173522+0000","last_change":"2024-09-19T07:09:17.086103+0000","last_active":"2024-09-19T07:09:38.173522+0000","last_peered":"2024-09-19T07:09:38.173522+0000","last_clean":"2024-09-19T07:09:38.173522+0000","last_became_active":"2024-09-19T07:09:17.085805+0000","last_became_peered":"2024-09-19T07:09:17.085805+0000","last_unstale":"2024-09-19T07:09:38.173522+0000","last_undegraded":"2024-09-19T07:09:38.173522+0000","last_fullsized":"2024-09-19T07:09:38.173522+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:28.522487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"78'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.173192+0000","last_change":"2024-09-19T07:09:18.932603+0000","last_active":"2024-09-19T07:09:38.173192+0000","last_peered":"2024-09-19T07:09:38.173192+0000","last_clean":"2024-09-19T07:09:38.173192+0000","last_became_active":"2024-09-19T07:09:18.932309+0000","last_became_peered":"2024-09-19T07:09:18.932309+0000","last_unstale":"2024-09-19T07:09:38.173192+0000","last_undegraded":"2024-09-19T07:09:38.173192+0000","last_fullsized":"2024-09-19T07:09:38.173192+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:19.746024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.176846+0000","last_change":"2024-09-19T07:09:17.085287+0000","last_active":"2024-09-19T07:09:38.176846+0000","last_peered":"2024-09-19T07:09:38.176846+0000","last_clean":"2024-09-19T07:09:38.176846+0000","last_became_active":"2024-09-19T07:09:17.084964+0000","last_became_peered":"2024-09-19T07:09:17.084964+0000","last_unstale":"2024-09-19T07:09:38.176846+0000","last_undegraded":"2024-09-19T07:09:38.176846+0000","last_fullsized":"2024-09-19T07:09:38.176846+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:51:01.035344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.392115+0000","last_change":"2024-09-19T07:09:18.921623+0000","last_active":"2024-09-19T07:09:38.392115+0000","last_peered":"2024-09-19T07:09:38.392115+0000","last_clean":"2024-09-19T07:09:38.392115+0000","last_became_active":"2024-09-19T07:09:18.921321+0000","last_became_peered":"2024-09-19T07:09:18.921321+0000","last_unstale":"2024-09-19T07:09:38.392115+0000","last_undegraded":"2024-09-19T07:09:38.392115+0000","last_fullsized":"2024-09-19T07:09:38.392115+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:28:55.616889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'9","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.928391+0000","last_change":"2024-09-19T07:09:16.910251+0000","last_active":"2024-09-19T07:09:38.928391+0000","last_peered":"2024-09-19T07:09:38.928391+0000","last_clean":"2024-09-19T07:09:38.928391+0000","last_became_active":"2024-09-19T07:09:16.909821+0000","last_became_peered":"2024-09-19T07:09:16.909821+0000","last_unstale":"2024-09-19T07:09:38.928391+0000","last_undegraded":"2024-09-19T07:09:38.928391+0000","last_fullsized":"2024-09-19T07:09:38.928391+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:02.958557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.171648+0000","last_change":"2024-09-19T07:09:18.930831+0000","last_active":"2024-09-19T07:09:38.171648+0000","last_peered":"2024-09-19T07:09:38.171648+0000","last_clean":"2024-09-19T07:09:38.171648+0000","last_became_active":"2024-09-19T07:09:18.930475+0000","last_became_peered":"2024-09-19T07:09:18.930475+0000","last_unstale":"2024-09-19T07:09:38.171648+0000","last_undegraded":"2024-09-19T07:09:38.171648+0000","last_fullsized":"2024-09-19T07:09:38.171648+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:30.512246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.217761+0000","last_change":"2024-09-19T07:09:16.906666+0000","last_active":"2024-09-19T07:09:38.217761+0000","last_peered":"2024-09-19T07:09:38.217761+0000","last_clean":"2024-09-19T07:09:38.217761+0000","last_became_active":"2024-09-19T07:09:16.906369+0000","last_became_peered":"2024-09-19T07:09:16.906369+0000","last_unstale":"2024-09-19T07:09:38.217761+0000","last_undegraded":"2024-09-19T07:09:38.217761+0000","last_fullsized":"2024-09-19T07:09:38.217761+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:56.915089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.178077+0000","last_change":"2024-09-19T07:09:18.934942+0000","last_active":"2024-09-19T07:09:38.178077+0000","last_peered":"2024-09-19T07:09:38.178077+0000","last_clean":"2024-09-19T07:09:38.178077+0000","last_became_active":"2024-09-19T07:09:18.934595+0000","last_became_peered":"2024-09-19T07:09:18.934595+0000","last_unstale":"2024-09-19T07:09:38.178077+0000","last_undegraded":"2024-09-19T07:09:38.178077+0000","last_fullsized":"2024-09-19T07:09:38.178077+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:54.306541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.183567+0000","last_change":"2024-09-19T07:09:38.183567+0000","last_active":"2024-09-19T07:09:38.183567+0000","last_peered":"2024-09-19T07:09:38.183567+0000","last_clean":"2024-09-19T07:09:38.183567+0000","last_became_active":"2024-09-19T07:09:38.180778+0000","last_became_peered":"2024-09-19T07:09:38.180778+0000","last_unstale":"2024-09-19T07:09:38.183567+0000","last_undegraded":"2024-09-19T07:09:38.183567+0000","last_fullsized":"2024-09-19T07:09:38.183567+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:43.226551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.176289+0000","last_change":"2024-09-19T07:09:18.934457+0000","last_active":"2024-09-19T07:09:38.176289+0000","last_peered":"2024-09-19T07:09:38.176289+0000","last_clean":"2024-09-19T07:09:38.176289+0000","last_became_active":"2024-09-19T07:09:18.934126+0000","last_became_peered":"2024-09-19T07:09:18.934126+0000","last_unstale":"2024-09-19T07:09:38.176289+0000","last_undegraded":"2024-09-19T07:09:38.176289+0000","last_fullsized":"2024-09-19T07:09:38.176289+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:37:16.152335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.171956+0000","last_change":"2024-09-19T07:09:16.908457+0000","last_active":"2024-09-19T07:09:38.171956+0000","last_peered":"2024-09-19T07:09:38.171956+0000","last_clean":"2024-09-19T07:09:38.171956+0000","last_became_active":"2024-09-19T07:09:16.908128+0000","last_became_peered":"2024-09-19T07:09:16.908128+0000","last_unstale":"2024-09-19T07:09:38.171956+0000","last_undegraded":"2024-09-19T07:09:38.171956+0000","last_fullsized":"2024-09-19T07:09:38.171956+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:48:50.579301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.172762+0000","last_change":"2024-09-19T07:09:18.928763+0000","last_active":"2024-09-19T07:09:38.172762+0000","last_peered":"2024-09-19T07:09:38.172762+0000","last_clean":"2024-09-19T07:09:38.172762+0000","last_became_active":"2024-09-19T07:09:18.928231+0000","last_became_peered":"2024-09-19T07:09:18.928231+0000","last_unstale":"2024-09-19T07:09:38.172762+0000","last_undegraded":"2024-09-19T07:09:38.172762+0000","last_fullsized":"2024-09-19T07:09:38.172762+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:26.652378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175889+0000","last_change":"2024-09-19T07:09:16.913740+0000","last_active":"2024-09-19T07:09:38.175889+0000","last_peered":"2024-09-19T07:09:38.175889+0000","last_clean":"2024-09-19T07:09:38.175889+0000","last_became_active":"2024-09-19T07:09:16.912419+0000","last_became_peered":"2024-09-19T07:09:16.912419+0000","last_unstale":"2024-09-19T07:09:38.175889+0000","last_undegraded":"2024-09-19T07:09:38.175889+0000","last_fullsized":"2024-09-19T07:09:38.175889+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:16.658996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.171848+0000","last_change":"2024-09-19T07:09:18.930697+0000","last_active":"2024-09-19T07:09:38.171848+0000","last_peered":"2024-09-19T07:09:38.171848+0000","last_clean":"2024-09-19T07:09:38.171848+0000","last_became_active":"2024-09-19T07:09:18.930355+0000","last_became_peered":"2024-09-19T07:09:18.930355+0000","last_unstale":"2024-09-19T07:09:38.171848+0000","last_undegraded":"2024-09-19T07:09:38.171848+0000","last_fullsized":"2024-09-19T07:09:38.171848+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:07.217195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.184284+0000","last_change":"2024-09-19T07:09:38.183637+0000","last_active":"2024-09-19T07:09:38.184284+0000","last_peered":"2024-09-19T07:09:38.184284+0000","last_clean":"2024-09-19T07:09:38.184284+0000","last_became_active":"2024-09-19T07:09:38.178732+0000","last_became_peered":"2024-09-19T07:09:38.178732+0000","last_unstale":"2024-09-19T07:09:38.184284+0000","last_undegraded":"2024-09-19T07:09:38.184284+0000","last_fullsized":"2024-09-19T07:09:38.184284+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:14.287130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175530+0000","last_change":"2024-09-19T07:09:18.935120+0000","last_active":"2024-09-19T07:09:38.175530+0000","last_peered":"2024-09-19T07:09:38.175530+0000","last_clean":"2024-09-19T07:09:38.175530+0000","last_became_active":"2024-09-19T07:09:18.934227+0000","last_became_peered":"2024-09-19T07:09:18.934227+0000","last_unstale":"2024-09-19T07:09:38.175530+0000","last_undegraded":"2024-09-19T07:09:38.175530+0000","last_fullsized":"2024-09-19T07:09:38.175530+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:20.328983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.393512+0000","last_change":"2024-09-19T07:09:38.393512+0000","last_active":"2024-09-19T07:09:38.393512+0000","last_peered":"2024-09-19T07:09:38.393512+0000","last_clean":"2024-09-19T07:09:38.393512+0000","last_became_active":"2024-09-19T07:09:38.393200+0000","last_became_peered":"2024-09-19T07:09:38.393200+0000","last_unstale":"2024-09-19T07:09:38.393512+0000","last_undegraded":"2024-09-19T07:09:38.393512+0000","last_fullsized":"2024-09-19T07:09:38.393512+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:51.637520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.177004+0000","last_change":"2024-09-19T07:09:16.911129+0000","last_active":"2024-09-19T07:09:38.177004+0000","last_peered":"2024-09-19T07:09:38.177004+0000","last_clean":"2024-09-19T07:09:38.177004+0000","last_became_active":"2024-09-19T07:09:16.910583+0000","last_became_peered":"2024-09-19T07:09:16.910583+0000","last_unstale":"2024-09-19T07:09:38.177004+0000","last_undegraded":"2024-09-19T07:09:38.177004+0000","last_fullsized":"2024-09-19T07:09:38.177004+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:34:37.295838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175577+0000","last_change":"2024-09-19T07:09:18.928622+0000","last_active":"2024-09-19T07:09:38.175577+0000","last_peered":"2024-09-19T07:09:38.175577+0000","last_clean":"2024-09-19T07:09:38.175577+0000","last_became_active":"2024-09-19T07:09:18.928284+0000","last_became_peered":"2024-09-19T07:09:18.928284+0000","last_unstale":"2024-09-19T07:09:38.175577+0000","last_undegraded":"2024-09-19T07:09:38.175577+0000","last_fullsized":"2024-09-19T07:09:38.175577+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:37:46.358756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.176700+0000","last_change":"2024-09-19T07:09:16.916142+0000","last_active":"2024-09-19T07:09:38.176700+0000","last_peered":"2024-09-19T07:09:38.176700+0000","last_clean":"2024-09-19T07:09:38.176700+0000","last_became_active":"2024-09-19T07:09:16.915766+0000","last_became_peered":"2024-09-19T07:09:16.915766+0000","last_unstale":"2024-09-19T07:09:38.176700+0000","last_undegraded":"2024-09-19T07:09:38.176700+0000","last_fullsized":"2024-09-19T07:09:38.176700+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:38.136422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.177929+0000","last_change":"2024-09-19T07:09:18.921912+0000","last_active":"2024-09-19T07:09:38.177929+0000","last_peered":"2024-09-19T07:09:38.177929+0000","last_clean":"2024-09-19T07:09:38.177929+0000","last_became_active":"2024-09-19T07:09:18.921595+0000","last_became_peered":"2024-09-19T07:09:18.921595+0000","last_unstale":"2024-09-19T07:09:38.177929+0000","last_undegraded":"2024-09-19T07:09:38.177929+0000","last_fullsized":"2024-09-19T07:09:38.177929+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:53.899052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.171786+0000","last_change":"2024-09-19T07:09:17.084856+0000","last_active":"2024-09-19T07:09:38.171786+0000","last_peered":"2024-09-19T07:09:38.171786+0000","last_clean":"2024-09-19T07:09:38.171786+0000","last_became_active":"2024-09-19T07:09:17.084541+0000","last_became_peered":"2024-09-19T07:09:17.084541+0000","last_unstale":"2024-09-19T07:09:38.171786+0000","last_undegraded":"2024-09-19T07:09:38.171786+0000","last_fullsized":"2024-09-19T07:09:38.171786+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:05.978765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.171659+0000","last_change":"2024-09-19T07:09:18.923732+0000","last_active":"2024-09-19T07:09:38.171659+0000","last_peered":"2024-09-19T07:09:38.171659+0000","last_clean":"2024-09-19T07:09:38.171659+0000","last_became_active":"2024-09-19T07:09:18.923410+0000","last_became_peered":"2024-09-19T07:09:18.923410+0000","last_unstale":"2024-09-19T07:09:38.171659+0000","last_undegraded":"2024-09-19T07:09:38.171659+0000","last_fullsized":"2024-09-19T07:09:38.171659+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:01:20.208414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.173640+0000","last_change":"2024-09-19T07:09:16.910364+0000","last_active":"2024-09-19T07:09:38.173640+0000","last_peered":"2024-09-19T07:09:38.173640+0000","last_clean":"2024-09-19T07:09:38.173640+0000","last_became_active":"2024-09-19T07:09:16.909835+0000","last_became_peered":"2024-09-19T07:09:16.909835+0000","last_unstale":"2024-09-19T07:09:38.173640+0000","last_undegraded":"2024-09-19T07:09:38.173640+0000","last_fullsized":"2024-09-19T07:09:38.173640+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:05.198823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":45461,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":100,"num_read_kb":91,"num_write":152,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":26947,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":380928,"data_stored":154477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645329,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":876544,"data_stored":428422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874261,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32704,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712448,"statfs":{"total":95995035648,"available":95961546752,"internally_reserved":0,"allocated":1552384,"data_stored":1061361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037787,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":892928,"data_stored":428658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266719,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":892928,"data_stored":428578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495652,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32644,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712508,"statfs":{"total":95995035648,"available":95961608192,"internally_reserved":0,"allocated":1486848,"data_stored":1020903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659178,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32052,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713100,"statfs":{"total":95995035648,"available":95962214400,"internally_reserved":0,"allocated":880640,"data_stored":428047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888110,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32652,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712500,"statfs":{"total":95995035648,"available":95961600000,"internally_reserved":0,"allocated":1499136,"data_stored":1020194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018932,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":946176,"data_stored":478989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247864,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":897024,"data_stored":428358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444094,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":897024,"data_stored":429583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607619,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":477952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":901120,"data_stored":429318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":50112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":51149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":43036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T07:09:46.939 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T07:09:46.940 INFO:tasks.cephadm:Setting up client nodes... 2024-09-19T07:09:46.940 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-19T07:09:47.190 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:09:47.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.693+0000 7f1cbb178640 1 -- 172.21.15.148:0/6705629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cb4101cd0 msgr2=0x7f1cb4102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:47.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.693+0000 7f1cbb178640 1 --2- 172.21.15.148:0/6705629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cb4101cd0 0x7f1cb4102150 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0009900 tx=0x7f1ca002a410 comp rx=0 tx=0).stop 2024-09-19T07:09:47.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.693+0000 7f1cbb178640 1 -- 172.21.15.148:0/6705629 shutdown_connections 2024-09-19T07:09:47.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.693+0000 7f1cbb178640 1 --2- 172.21.15.148:0/6705629 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1cb4102690 0x7f1cb4108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:47.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.693+0000 7f1cbb178640 1 --2- 172.21.15.148:0/6705629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cb4101cd0 0x7f1cb4102150 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:47.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.693+0000 7f1cbb178640 1 --2- 172.21.15.148:0/6705629 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1cb4100ad0 0x7f1cb4100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:47.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.693+0000 7f1cbb178640 1 -- 172.21.15.148:0/6705629 >> 172.21.15.148:0/6705629 conn(0x7f1cb40fc280 msgr2=0x7f1cb40fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:47.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.693+0000 7f1cbb178640 1 -- 172.21.15.148:0/6705629 shutdown_connections 2024-09-19T07:09:47.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.693+0000 7f1cbb178640 1 -- 172.21.15.148:0/6705629 wait complete. 2024-09-19T07:09:47.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.693+0000 7f1cbb178640 1 Processor -- start 2024-09-19T07:09:47.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.693+0000 7f1cbb178640 1 -- start start 2024-09-19T07:09:47.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.694+0000 7f1cbb178640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1cb4100ad0 0x7f1cb406ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:47.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.694+0000 7f1cbb178640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1cb4101cd0 0x7f1cb419cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:47.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.694+0000 7f1cbb178640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cb4102690 0x7f1cb419f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:47.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.694+0000 7f1cbb178640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1cb410c750 con 0x7f1cb4102690 2024-09-19T07:09:47.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.694+0000 7f1cbb178640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1cb410c5d0 con 0x7f1cb4101cd0 2024-09-19T07:09:47.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.694+0000 7f1cbb178640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1cb410c8d0 con 0x7f1cb4100ad0 2024-09-19T07:09:47.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.694+0000 7f1cb9715640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cb4102690 0x7f1cb419f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:47.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.694+0000 7f1cb9715640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cb4102690 0x7f1cb419f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60242/0 (socket says 172.21.15.148:60242) 2024-09-19T07:09:47.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.694+0000 7f1cb9715640 1 -- 172.21.15.148:0/2444257664 learned_addr learned my addr 172.21.15.148:0/2444257664 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:09:47.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.694+0000 7f1cb8f14640 1 --2- 172.21.15.148:0/2444257664 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1cb4100ad0 0x7f1cb406ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:47.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.694+0000 7f1cb3fff640 1 --2- 172.21.15.148:0/2444257664 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1cb4101cd0 0x7f1cb419cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:47.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.694+0000 7f1cb9715640 1 -- 172.21.15.148:0/2444257664 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1cb4100ad0 msgr2=0x7f1cb406ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:47.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.694+0000 7f1cb9715640 1 --2- 172.21.15.148:0/2444257664 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1cb4100ad0 0x7f1cb406ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:47.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.694+0000 7f1cb9715640 1 -- 172.21.15.148:0/2444257664 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1cb4101cd0 msgr2=0x7f1cb419cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:47.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.694+0000 7f1cb9715640 1 --2- 172.21.15.148:0/2444257664 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1cb4101cd0 0x7f1cb419cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:47.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.694+0000 7f1cb9715640 1 -- 172.21.15.148:0/2444257664 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cb419fb10 con 0x7f1cb4102690 2024-09-19T07:09:47.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.694+0000 7f1cb9715640 1 --2- 172.21.15.148:0/2444257664 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cb4102690 0x7f1cb419f250 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1cac00eb10 tx=0x7f1cac00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:47.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.694+0000 7f1cb1ffb640 1 -- 172.21.15.148:0/2444257664 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cac004b20 con 0x7f1cb4102690 2024-09-19T07:09:47.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.694+0000 7f1cbb178640 1 -- 172.21.15.148:0/2444257664 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cb419fe00 con 0x7f1cb4102690 2024-09-19T07:09:47.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.694+0000 7f1cb1ffb640 1 -- 172.21.15.148:0/2444257664 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1cac004cc0 con 0x7f1cb4102690 2024-09-19T07:09:47.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.694+0000 7f1cb1ffb640 1 -- 172.21.15.148:0/2444257664 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cac010760 con 0x7f1cb4102690 2024-09-19T07:09:47.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.695+0000 7f1cbb178640 1 -- 172.21.15.148:0/2444257664 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cb41a0300 con 0x7f1cb4102690 2024-09-19T07:09:47.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.696+0000 7f1cbb178640 1 -- 172.21.15.148:0/2444257664 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cb4107f20 con 0x7f1cb4102690 2024-09-19T07:09:47.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.696+0000 7f1cb1ffb640 1 -- 172.21.15.148:0/2444257664 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f1cac005020 con 0x7f1cb4102690 2024-09-19T07:09:47.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.697+0000 7f1cb1ffb640 1 --2- 172.21.15.148:0/2444257664 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f1ca40a32d0 0x7f1ca40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:47.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.697+0000 7f1cb8f14640 1 --2- 172.21.15.148:0/2444257664 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f1ca40a32d0 0x7f1ca40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:47.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.697+0000 7f1cb1ffb640 1 -- 172.21.15.148:0/2444257664 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7f1cac0d0170 con 0x7f1cb4102690 2024-09-19T07:09:47.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.698+0000 7f1cb8f14640 1 --2- 172.21.15.148:0/2444257664 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f1ca40a32d0 0x7f1ca40a5790 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1cb406b050 tx=0x7f1ca800b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:47.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.701+0000 7f1cb1ffb640 1 -- 172.21.15.148:0/2444257664 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1cac09cd40 con 0x7f1cb4102690 2024-09-19T07:09:47.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.933+0000 7f1cbb178640 1 -- 172.21.15.148:0/2444257664 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f1cb402d970 con 0x7f1cb4102690 2024-09-19T07:09:47.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.935+0000 7f1cb1ffb640 1 -- 172.21.15.148:0/2444257664 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v31) ==== 170+0+59 (secure 0 0 0) 0x7f1cac098020 con 0x7f1cb4102690 2024-09-19T07:09:47.936 INFO:teuthology.orchestra.run.smithi148.stdout:[client.0] 2024-09-19T07:09:47.936 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQA7zutmcK60NxAA/rLvSnXDbtJfKlDn8toB4w== 2024-09-19T07:09:47.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.937+0000 7f1cbb178640 1 -- 172.21.15.148:0/2444257664 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f1ca40a32d0 msgr2=0x7f1ca40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:47.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.937+0000 7f1cbb178640 1 --2- 172.21.15.148:0/2444257664 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f1ca40a32d0 0x7f1ca40a5790 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1cb406b050 tx=0x7f1ca800b410 comp rx=0 tx=0).stop 2024-09-19T07:09:47.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.937+0000 7f1cbb178640 1 -- 172.21.15.148:0/2444257664 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cb4102690 msgr2=0x7f1cb419f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:47.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.937+0000 7f1cbb178640 1 --2- 172.21.15.148:0/2444257664 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cb4102690 0x7f1cb419f250 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1cac00eb10 tx=0x7f1cac00c2d0 comp rx=0 tx=0).stop 2024-09-19T07:09:47.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.938+0000 7f1cbb178640 1 -- 172.21.15.148:0/2444257664 shutdown_connections 2024-09-19T07:09:47.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.938+0000 7f1cbb178640 1 --2- 172.21.15.148:0/2444257664 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f1ca40a32d0 0x7f1ca40a5790 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:47.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.938+0000 7f1cbb178640 1 --2- 172.21.15.148:0/2444257664 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cb4102690 0x7f1cb419f250 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:47.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.938+0000 7f1cbb178640 1 --2- 172.21.15.148:0/2444257664 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1cb4101cd0 0x7f1cb419cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:47.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.938+0000 7f1cbb178640 1 --2- 172.21.15.148:0/2444257664 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1cb4100ad0 0x7f1cb406ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:47.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.938+0000 7f1cbb178640 1 -- 172.21.15.148:0/2444257664 >> 172.21.15.148:0/2444257664 conn(0x7f1cb40fc280 msgr2=0x7f1cb41050f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:47.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.938+0000 7f1cbb178640 1 -- 172.21.15.148:0/2444257664 shutdown_connections 2024-09-19T07:09:47.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:47.938+0000 7f1cbb178640 1 -- 172.21.15.148:0/2444257664 wait complete. 2024-09-19T07:09:48.274 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:48 smithi148 ceph-mon[31180]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:09:48.274 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:48 smithi148 ceph-mon[31180]: pgmap v285: 97 pgs: 97 active+clean; 630 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 3.6 KiB/s wr, 7 op/s; 2.7 KiB/s, 0 objects/s recovering 2024-09-19T07:09:48.274 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:48 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/2444257664' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T07:09:48.274 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:48 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/2444257664' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T07:09:48.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:48 smithi179 ceph-mon[35716]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:09:48.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:48 smithi179 ceph-mon[35716]: pgmap v285: 97 pgs: 97 active+clean; 630 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 3.6 KiB/s wr, 7 op/s; 2.7 KiB/s, 0 objects/s recovering 2024-09-19T07:09:48.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:48 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/2444257664' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T07:09:48.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:48 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/2444257664' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T07:09:48.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:48 smithi165 ceph-mon[35326]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:09:48.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:48 smithi165 ceph-mon[35326]: pgmap v285: 97 pgs: 97 active+clean; 630 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 3.6 KiB/s wr, 7 op/s; 2.7 KiB/s, 0 objects/s recovering 2024-09-19T07:09:48.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:48 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/2444257664' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T07:09:48.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:48 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/2444257664' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T07:09:48.694 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-19T07:09:48.695 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-19T07:09:48.695 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-19T07:09:48.732 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-19T07:09:48.732 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-19T07:09:48.732 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-19T07:09:49.018 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:09:49.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.480+0000 7f4097c01640 1 -- 172.21.15.148:0/1781367511 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4090101240 msgr2=0x7f4090101680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:49.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.480+0000 7f4097c01640 1 --2- 172.21.15.148:0/1781367511 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4090101240 0x7f4090101680 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4080009900 tx=0x7f408002a410 comp rx=0 tx=0).stop 2024-09-19T07:09:49.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.480+0000 7f4097c01640 1 -- 172.21.15.148:0/1781367511 shutdown_connections 2024-09-19T07:09:49.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.480+0000 7f4097c01640 1 --2- 172.21.15.148:0/1781367511 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4090101bc0 0x7f409010d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:49.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.480+0000 7f4097c01640 1 --2- 172.21.15.148:0/1781367511 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4090101240 0x7f4090101680 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:49.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.480+0000 7f4097c01640 1 --2- 172.21.15.148:0/1781367511 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4090105a90 0x7f4090105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:49.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.480+0000 7f4097c01640 1 -- 172.21.15.148:0/1781367511 >> 172.21.15.148:0/1781367511 conn(0x7f4090077210 msgr2=0x7f40900fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:49.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.480+0000 7f4097c01640 1 -- 172.21.15.148:0/1781367511 shutdown_connections 2024-09-19T07:09:49.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.480+0000 7f4097c01640 1 -- 172.21.15.148:0/1781367511 wait complete. 2024-09-19T07:09:49.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.481+0000 7f4097c01640 1 Processor -- start 2024-09-19T07:09:49.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.481+0000 7f4097c01640 1 -- start start 2024-09-19T07:09:49.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.481+0000 7f4097c01640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4090101240 0x7f4090198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:49.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.481+0000 7f4097c01640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4090101bc0 0x7f4090198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:49.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.481+0000 7f4097c01640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4090105a90 0x7f409019ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:49.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.481+0000 7f4097c01640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f40901120b0 con 0x7f4090105a90 2024-09-19T07:09:49.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.481+0000 7f4097c01640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4090111f30 con 0x7f4090101bc0 2024-09-19T07:09:49.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.481+0000 7f4097c01640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4090112230 con 0x7f4090101240 2024-09-19T07:09:49.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.481+0000 7f409619e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4090105a90 0x7f409019ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:49.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.481+0000 7f409599d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4090101240 0x7f4090198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:49.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.481+0000 7f409619e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4090105a90 0x7f409019ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60254/0 (socket says 172.21.15.148:60254) 2024-09-19T07:09:49.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.481+0000 7f409599d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4090101240 0x7f4090198590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:42312/0 (socket says 172.21.15.148:42312) 2024-09-19T07:09:49.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.481+0000 7f409619e640 1 -- 172.21.15.148:0/2736001998 learned_addr learned my addr 172.21.15.148:0/2736001998 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:09:49.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.481+0000 7f409519c640 1 --2- 172.21.15.148:0/2736001998 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4090101bc0 0x7f4090198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:49.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.482+0000 7f409619e640 1 -- 172.21.15.148:0/2736001998 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4090101240 msgr2=0x7f4090198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:49.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.482+0000 7f409619e640 1 --2- 172.21.15.148:0/2736001998 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4090101240 0x7f4090198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:49.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.482+0000 7f409619e640 1 -- 172.21.15.148:0/2736001998 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4090101bc0 msgr2=0x7f4090198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:49.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.482+0000 7f409619e640 1 --2- 172.21.15.148:0/2736001998 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4090101bc0 0x7f4090198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:49.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.482+0000 7f409619e640 1 -- 172.21.15.148:0/2736001998 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f409019d540 con 0x7f4090105a90 2024-09-19T07:09:49.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.482+0000 7f409619e640 1 --2- 172.21.15.148:0/2736001998 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4090105a90 0x7f409019ce60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4088009fd0 tx=0x7f408800def0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:49.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.482+0000 7f4086ffd640 1 -- 172.21.15.148:0/2736001998 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4088017070 con 0x7f4090105a90 2024-09-19T07:09:49.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.482+0000 7f4086ffd640 1 -- 172.21.15.148:0/2736001998 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4088003e50 con 0x7f4090105a90 2024-09-19T07:09:49.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.482+0000 7f4097c01640 1 -- 172.21.15.148:0/2736001998 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f409019d830 con 0x7f4090105a90 2024-09-19T07:09:49.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.482+0000 7f4086ffd640 1 -- 172.21.15.148:0/2736001998 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4088010460 con 0x7f4090105a90 2024-09-19T07:09:49.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.482+0000 7f4097c01640 1 -- 172.21.15.148:0/2736001998 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40901a5110 con 0x7f4090105a90 2024-09-19T07:09:49.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.483+0000 7f4097c01640 1 -- 172.21.15.148:0/2736001998 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4090101680 con 0x7f4090105a90 2024-09-19T07:09:49.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.484+0000 7f4086ffd640 1 -- 172.21.15.148:0/2736001998 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f4088003970 con 0x7f4090105a90 2024-09-19T07:09:49.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.485+0000 7f4086ffd640 1 --2- 172.21.15.148:0/2736001998 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f407c0a32d0 0x7f407c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:49.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.485+0000 7f409599d640 1 --2- 172.21.15.148:0/2736001998 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f407c0a32d0 0x7f407c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:49.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.485+0000 7f4086ffd640 1 -- 172.21.15.148:0/2736001998 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7f40880cf810 con 0x7f4090105a90 2024-09-19T07:09:49.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.485+0000 7f409599d640 1 --2- 172.21.15.148:0/2736001998 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f407c0a32d0 0x7f407c0a5790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f408c009990 tx=0x7f408c009110 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:49.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.489+0000 7f4086ffd640 1 -- 172.21.15.148:0/2736001998 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f408809c3e0 con 0x7f4090105a90 2024-09-19T07:09:49.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.699+0000 7f4097c01640 1 -- 172.21.15.148:0/2736001998 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f4090108fb0 con 0x7f4090105a90 2024-09-19T07:09:49.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.704+0000 7f4086ffd640 1 -- 172.21.15.148:0/2736001998 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+264059 (secure 0 0 0) 0x7f408809bce0 con 0x7f4090105a90 2024-09-19T07:09:49.708 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:09:49.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.708+0000 7f4097c01640 1 -- 172.21.15.148:0/2736001998 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f407c0a32d0 msgr2=0x7f407c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:49.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.708+0000 7f4097c01640 1 --2- 172.21.15.148:0/2736001998 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f407c0a32d0 0x7f407c0a5790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f408c009990 tx=0x7f408c009110 comp rx=0 tx=0).stop 2024-09-19T07:09:49.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.708+0000 7f4097c01640 1 -- 172.21.15.148:0/2736001998 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4090105a90 msgr2=0x7f409019ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:49.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.708+0000 7f4097c01640 1 --2- 172.21.15.148:0/2736001998 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4090105a90 0x7f409019ce60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4088009fd0 tx=0x7f408800def0 comp rx=0 tx=0).stop 2024-09-19T07:09:49.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.708+0000 7f4097c01640 1 -- 172.21.15.148:0/2736001998 shutdown_connections 2024-09-19T07:09:49.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.708+0000 7f4097c01640 1 --2- 172.21.15.148:0/2736001998 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f407c0a32d0 0x7f407c0a5790 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:49.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.708+0000 7f4097c01640 1 --2- 172.21.15.148:0/2736001998 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4090105a90 0x7f409019ce60 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:49.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.708+0000 7f4097c01640 1 --2- 172.21.15.148:0/2736001998 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4090101bc0 0x7f4090198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:49.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.708+0000 7f4097c01640 1 --2- 172.21.15.148:0/2736001998 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4090101240 0x7f4090198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:49.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.708+0000 7f4097c01640 1 -- 172.21.15.148:0/2736001998 >> 172.21.15.148:0/2736001998 conn(0x7f4090077210 msgr2=0x7f4090103b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:49.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.708+0000 7f4097c01640 1 -- 172.21.15.148:0/2736001998 shutdown_connections 2024-09-19T07:09:49.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:49.708+0000 7f4097c01640 1 -- 172.21.15.148:0/2736001998 wait complete. 2024-09-19T07:09:50.406 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:50 smithi148 ceph-mon[31180]: pgmap v286: 97 pgs: 97 active+clean; 630 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 3.3 KiB/s wr, 7 op/s; 2.4 KiB/s, 0 objects/s recovering 2024-09-19T07:09:50.406 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:50 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/2736001998' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T07:09:50.433 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":17,"flags":0,"active_gid":14148,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":3007822654},{"type":"v1","addr":"172.21.15.148:6801","nonce":3007822654}]},"active_addr":"172.21.15.148:6801/3007822654","active_change":"2024-09-19T07:02:37.007289+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24113,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24115,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.148:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.148:0","nonce":2638338746}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.148:0","nonce":3756905316}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.148:0","nonce":1224758996}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.148:0","nonce":1725756124}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.148:0","nonce":2510377205}]}]} 2024-09-19T07:09:50.444 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-19T07:09:50.444 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-19T07:09:50.445 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T07:09:50.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:50 smithi179 ceph-mon[35716]: pgmap v286: 97 pgs: 97 active+clean; 630 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 3.3 KiB/s wr, 7 op/s; 2.4 KiB/s, 0 objects/s recovering 2024-09-19T07:09:50.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:50 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/2736001998' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T07:09:50.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:50 smithi165 ceph-mon[35326]: pgmap v286: 97 pgs: 97 active+clean; 630 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 3.3 KiB/s wr, 7 op/s; 2.4 KiB/s, 0 objects/s recovering 2024-09-19T07:09:50.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:50 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/2736001998' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T07:09:50.691 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:09:51.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.146+0000 7fc53959d640 1 -- 172.21.15.148:0/3514121429 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc534101270 msgr2=0x7fc53410d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:51.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.146+0000 7fc53959d640 1 --2- 172.21.15.148:0/3514121429 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc534101270 0x7fc53410d7a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc52c009cd0 tx=0x7fc52c02a8e0 comp rx=0 tx=0).stop 2024-09-19T07:09:51.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.146+0000 7fc53959d640 1 -- 172.21.15.148:0/3514121429 shutdown_connections 2024-09-19T07:09:51.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.146+0000 7fc53959d640 1 --2- 172.21.15.148:0/3514121429 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc534101270 0x7fc53410d7a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:51.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.146+0000 7fc53959d640 1 --2- 172.21.15.148:0/3514121429 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc5341008d0 0x7fc534100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:51.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.146+0000 7fc53959d640 1 --2- 172.21.15.148:0/3514121429 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5341068d0 0x7fc534106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:51.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.146+0000 7fc53959d640 1 -- 172.21.15.148:0/3514121429 >> 172.21.15.148:0/3514121429 conn(0x7fc5340fc610 msgr2=0x7fc5340fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:51.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.146+0000 7fc53959d640 1 -- 172.21.15.148:0/3514121429 shutdown_connections 2024-09-19T07:09:51.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.146+0000 7fc53959d640 1 -- 172.21.15.148:0/3514121429 wait complete. 2024-09-19T07:09:51.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.147+0000 7fc53959d640 1 Processor -- start 2024-09-19T07:09:51.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.147+0000 7fc53959d640 1 -- start start 2024-09-19T07:09:51.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.147+0000 7fc53959d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc5341008d0 0x7fc53419a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:51.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.147+0000 7fc53959d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc534101270 0x7fc53419a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:51.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.147+0000 7fc53959d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5341068d0 0x7fc53419ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:51.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.147+0000 7fc53959d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc534110d40 con 0x7fc5341068d0 2024-09-19T07:09:51.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.147+0000 7fc53959d640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc534110bc0 con 0x7fc5341008d0 2024-09-19T07:09:51.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.147+0000 7fc53959d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc534110ec0 con 0x7fc534101270 2024-09-19T07:09:51.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.147+0000 7fc538d9c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5341068d0 0x7fc53419ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:51.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.147+0000 7fc538d9c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5341068d0 0x7fc53419ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60266/0 (socket says 172.21.15.148:60266) 2024-09-19T07:09:51.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.147+0000 7fc538d9c640 1 -- 172.21.15.148:0/3370678086 learned_addr learned my addr 172.21.15.148:0/3370678086 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:09:51.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.147+0000 7fc5337fe640 1 --2- 172.21.15.148:0/3370678086 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc534101270 0x7fc53419a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:51.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.147+0000 7fc533fff640 1 --2- 172.21.15.148:0/3370678086 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc5341008d0 0x7fc53419a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:51.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.147+0000 7fc538d9c640 1 -- 172.21.15.148:0/3370678086 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc534101270 msgr2=0x7fc53419a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:51.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.147+0000 7fc538d9c640 1 --2- 172.21.15.148:0/3370678086 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc534101270 0x7fc53419a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:51.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.148+0000 7fc538d9c640 1 -- 172.21.15.148:0/3370678086 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc5341008d0 msgr2=0x7fc53419a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:51.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.148+0000 7fc538d9c640 1 --2- 172.21.15.148:0/3370678086 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc5341008d0 0x7fc53419a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:51.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.148+0000 7fc538d9c640 1 -- 172.21.15.148:0/3370678086 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc53419f400 con 0x7fc5341068d0 2024-09-19T07:09:51.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.148+0000 7fc538d9c640 1 --2- 172.21.15.148:0/3370678086 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5341068d0 0x7fc53419ed20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc52c033040 tx=0x7fc52c003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:51.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.148+0000 7fc5317fa640 1 -- 172.21.15.148:0/3370678086 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc52c004040 con 0x7fc5341068d0 2024-09-19T07:09:51.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.148+0000 7fc5317fa640 1 -- 172.21.15.148:0/3370678086 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc52c0046c0 con 0x7fc5341068d0 2024-09-19T07:09:51.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.148+0000 7fc5317fa640 1 -- 172.21.15.148:0/3370678086 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc52c030eb0 con 0x7fc5341068d0 2024-09-19T07:09:51.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.148+0000 7fc53959d640 1 -- 172.21.15.148:0/3370678086 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc53419f690 con 0x7fc5341068d0 2024-09-19T07:09:51.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.148+0000 7fc53959d640 1 -- 172.21.15.148:0/3370678086 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5341a6fd0 con 0x7fc5341068d0 2024-09-19T07:09:51.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.149+0000 7fc53959d640 1 -- 172.21.15.148:0/3370678086 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc534100d30 con 0x7fc5341068d0 2024-09-19T07:09:51.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.150+0000 7fc5317fa640 1 -- 172.21.15.148:0/3370678086 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fc52c0041e0 con 0x7fc5341068d0 2024-09-19T07:09:51.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.151+0000 7fc5317fa640 1 --2- 172.21.15.148:0/3370678086 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fc5200a32d0 0x7fc5200a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:51.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.151+0000 7fc533fff640 1 --2- 172.21.15.148:0/3370678086 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fc5200a32d0 0x7fc5200a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:51.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.151+0000 7fc5317fa640 1 -- 172.21.15.148:0/3370678086 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7fc52c02e030 con 0x7fc5341068d0 2024-09-19T07:09:51.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.152+0000 7fc533fff640 1 --2- 172.21.15.148:0/3370678086 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fc5200a32d0 0x7fc5200a5790 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc524005fd0 tx=0x7fc524005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:51.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.156+0000 7fc5317fa640 1 -- 172.21.15.148:0/3370678086 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc52c0bdd00 con 0x7fc5341068d0 2024-09-19T07:09:51.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.327+0000 7fc53959d640 1 -- 172.21.15.148:0/3370678086 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc5341a7200 con 0x7fc5341068d0 2024-09-19T07:09:51.329 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:51 smithi148 ceph-mon[31180]: pgmap v287: 97 pgs: 97 active+clean; 638 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.7 KiB/s wr, 8 op/s; 2.2 KiB/s, 0 objects/s recovering 2024-09-19T07:09:51.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.329+0000 7fc5317fa640 1 -- 172.21.15.148:0/3370678086 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22807 (secure 0 0 0) 0x7fc52c0bd600 con 0x7fc5341068d0 2024-09-19T07:09:51.330 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:09:51.330 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":80,"fsid":"eae8a4a8-7654-11ef-bceb-c7b262605968","created":"2024-09-19T07:01:47.891210+0000","modified":"2024-09-19T07:09:38.168257+0000","last_up_change":"2024-09-19T07:08:30.785262+0000","last_in_change":"2024-09-19T07:08:07.001808+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:04:49.313270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T07:09:15.840600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T07:09:17.690782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7b854fad-d5a3-43e3-862e-7a0e8f243c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6803","nonce":512186330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6805","nonce":512186330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6809","nonce":512186330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6807","nonce":512186330}]},"public_addr":"172.21.15.148:6803/512186330","cluster_addr":"172.21.15.148:6805/512186330","heartbeat_back_addr":"172.21.15.148:6809/512186330","heartbeat_front_addr":"172.21.15.148:6807/512186330","state":["exists","up"]},{"osd":1,"uuid":"61b26278-f4db-40f0-97b9-c12a6ef1cd06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6801","nonce":2433984552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6803","nonce":2433984552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6807","nonce":2433984552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6805","nonce":2433984552}]},"public_addr":"172.21.15.165:6801/2433984552","cluster_addr":"172.21.15.165:6803/2433984552","heartbeat_back_addr":"172.21.15.165:6807/2433984552","heartbeat_front_addr":"172.21.15.165:6805/2433984552","state":["exists","up"]},{"osd":2,"uuid":"06620bbc-cdb5-4afc-8122-0bb3126630f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6801","nonce":3048365223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6803","nonce":3048365223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6807","nonce":3048365223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6805","nonce":3048365223}]},"public_addr":"172.21.15.179:6801/3048365223","cluster_addr":"172.21.15.179:6803/3048365223","heartbeat_back_addr":"172.21.15.179:6807/3048365223","heartbeat_front_addr":"172.21.15.179:6805/3048365223","state":["exists","up"]},{"osd":3,"uuid":"d7df45d4-5ef1-4f66-84a7-f61b8756c0c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6811","nonce":3662789091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6813","nonce":3662789091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6817","nonce":3662789091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6815","nonce":3662789091}]},"public_addr":"172.21.15.148:6811/3662789091","cluster_addr":"172.21.15.148:6813/3662789091","heartbeat_back_addr":"172.21.15.148:6817/3662789091","heartbeat_front_addr":"172.21.15.148:6815/3662789091","state":["exists","up"]},{"osd":4,"uuid":"5cfd359b-a8d2-4bdc-858f-087d26e0869c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6809","nonce":3082550323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6811","nonce":3082550323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6815","nonce":3082550323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6813","nonce":3082550323}]},"public_addr":"172.21.15.165:6809/3082550323","cluster_addr":"172.21.15.165:6811/3082550323","heartbeat_back_addr":"172.21.15.165:6815/3082550323","heartbeat_front_addr":"172.21.15.165:6813/3082550323","state":["exists","up"]},{"osd":5,"uuid":"8295e69b-87fe-4403-bb2e-d9dd42e2f398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6809","nonce":2125213751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6811","nonce":2125213751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6815","nonce":2125213751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6813","nonce":2125213751}]},"public_addr":"172.21.15.179:6809/2125213751","cluster_addr":"172.21.15.179:6811/2125213751","heartbeat_back_addr":"172.21.15.179:6815/2125213751","heartbeat_front_addr":"172.21.15.179:6813/2125213751","state":["exists","up"]},{"osd":6,"uuid":"4ce38d1a-06d3-4606-b00d-aa1ff977025f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6819","nonce":2178980310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6821","nonce":2178980310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6825","nonce":2178980310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6823","nonce":2178980310}]},"public_addr":"172.21.15.148:6819/2178980310","cluster_addr":"172.21.15.148:6821/2178980310","heartbeat_back_addr":"172.21.15.148:6825/2178980310","heartbeat_front_addr":"172.21.15.148:6823/2178980310","state":["exists","up"]},{"osd":7,"uuid":"9e68e2b2-9838-4ec0-b473-24f2434695ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6817","nonce":3961600099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6819","nonce":3961600099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6823","nonce":3961600099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6821","nonce":3961600099}]},"public_addr":"172.21.15.165:6817/3961600099","cluster_addr":"172.21.15.165:6819/3961600099","heartbeat_back_addr":"172.21.15.165:6823/3961600099","heartbeat_front_addr":"172.21.15.165:6821/3961600099","state":["exists","up"]},{"osd":8,"uuid":"297acce6-d3c7-4e1a-bf87-be093de51a6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6817","nonce":3642931467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6819","nonce":3642931467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6823","nonce":3642931467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6821","nonce":3642931467}]},"public_addr":"172.21.15.179:6817/3642931467","cluster_addr":"172.21.15.179:6819/3642931467","heartbeat_back_addr":"172.21.15.179:6823/3642931467","heartbeat_front_addr":"172.21.15.179:6821/3642931467","state":["exists","up"]},{"osd":9,"uuid":"ef488c5e-5353-4695-99dd-5b74ade436d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6827","nonce":3135409630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6829","nonce":3135409630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6833","nonce":3135409630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6831","nonce":3135409630}]},"public_addr":"172.21.15.148:6827/3135409630","cluster_addr":"172.21.15.148:6829/3135409630","heartbeat_back_addr":"172.21.15.148:6833/3135409630","heartbeat_front_addr":"172.21.15.148:6831/3135409630","state":["exists","up"]},{"osd":10,"uuid":"7a9f0379-1199-4266-910c-8d1d313d39e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6825","nonce":3554110731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6827","nonce":3554110731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6831","nonce":3554110731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6829","nonce":3554110731}]},"public_addr":"172.21.15.165:6825/3554110731","cluster_addr":"172.21.15.165:6827/3554110731","heartbeat_back_addr":"172.21.15.165:6831/3554110731","heartbeat_front_addr":"172.21.15.165:6829/3554110731","state":["exists","up"]},{"osd":11,"uuid":"eede97e9-5685-4603-806e-7078c6940536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6825","nonce":2026109940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6827","nonce":2026109940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6831","nonce":2026109940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6829","nonce":2026109940}]},"public_addr":"172.21.15.179:6825/2026109940","cluster_addr":"172.21.15.179:6827/2026109940","heartbeat_back_addr":"172.21.15.179:6831/2026109940","heartbeat_front_addr":"172.21.15.179:6829/2026109940","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:03:56.291685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:21.419682+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:46.377012+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:11.484234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:36.723101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:06:00.294617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:06:25.147230+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:06:49.318576+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:07:13.896399+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:07:38.930999+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:08:03.803463+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:08:28.731343+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.148:0/3534559227":"2024-09-20T07:02:37.007183+0000","172.21.15.148:0/1958388906":"2024-09-20T07:02:37.007183+0000","172.21.15.148:0/1922521135":"2024-09-20T07:02:37.007183+0000","172.21.15.148:6801/1949849385":"2024-09-20T07:02:37.007183+0000","172.21.15.148:6800/1949849385":"2024-09-20T07:02:37.007183+0000","172.21.15.148:6800/2161746152":"2024-09-20T07:02:14.557425+0000","172.21.15.148:6801/2161746152":"2024-09-20T07:02:14.557425+0000","172.21.15.148:0/1480486619":"2024-09-20T07:02:14.557425+0000","172.21.15.148:0/174481494":"2024-09-20T07:02:14.557425+0000","172.21.15.148:0/1114469409":"2024-09-20T07:02:14.557425+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T07:09:51.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.332+0000 7fc53959d640 1 -- 172.21.15.148:0/3370678086 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fc5200a32d0 msgr2=0x7fc5200a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:51.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.332+0000 7fc53959d640 1 --2- 172.21.15.148:0/3370678086 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fc5200a32d0 0x7fc5200a5790 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc524005fd0 tx=0x7fc524005850 comp rx=0 tx=0).stop 2024-09-19T07:09:51.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.332+0000 7fc53959d640 1 -- 172.21.15.148:0/3370678086 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5341068d0 msgr2=0x7fc53419ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:51.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.332+0000 7fc53959d640 1 --2- 172.21.15.148:0/3370678086 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5341068d0 0x7fc53419ed20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc52c033040 tx=0x7fc52c003970 comp rx=0 tx=0).stop 2024-09-19T07:09:51.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.332+0000 7fc53959d640 1 -- 172.21.15.148:0/3370678086 shutdown_connections 2024-09-19T07:09:51.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.332+0000 7fc53959d640 1 --2- 172.21.15.148:0/3370678086 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fc5200a32d0 0x7fc5200a5790 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:51.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.332+0000 7fc53959d640 1 --2- 172.21.15.148:0/3370678086 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5341068d0 0x7fc53419ed20 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:51.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.332+0000 7fc53959d640 1 --2- 172.21.15.148:0/3370678086 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc534101270 0x7fc53419a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:51.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.332+0000 7fc53959d640 1 --2- 172.21.15.148:0/3370678086 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc5341008d0 0x7fc53419a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:51.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.332+0000 7fc53959d640 1 -- 172.21.15.148:0/3370678086 >> 172.21.15.148:0/3370678086 conn(0x7fc5340fc610 msgr2=0x7fc53406a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:51.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.332+0000 7fc53959d640 1 -- 172.21.15.148:0/3370678086 shutdown_connections 2024-09-19T07:09:51.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:51.332+0000 7fc53959d640 1 -- 172.21.15.148:0/3370678086 wait complete. 2024-09-19T07:09:51.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:51 smithi179 ceph-mon[35716]: pgmap v287: 97 pgs: 97 active+clean; 638 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.7 KiB/s wr, 8 op/s; 2.2 KiB/s, 0 objects/s recovering 2024-09-19T07:09:51.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:51 smithi165 ceph-mon[35326]: pgmap v287: 97 pgs: 97 active+clean; 638 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.7 KiB/s wr, 8 op/s; 2.2 KiB/s, 0 objects/s recovering 2024-09-19T07:09:51.967 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-19T07:09:51.967 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T07:09:52.213 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:09:52.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:52 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/3370678086' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:09:52.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:52 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/3370678086' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:09:52.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:52 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/3370678086' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:09:52.666 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.653+0000 7fe199914640 1 -- 172.21.15.148:0/2876230798 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe194106a80 msgr2=0x7fe194106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:52.666 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.653+0000 7fe199914640 1 --2- 172.21.15.148:0/2876230798 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe194106a80 0x7fe194106e60 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe184009930 tx=0x7fe18402a420 comp rx=0 tx=0).stop 2024-09-19T07:09:52.666 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.653+0000 7fe199914640 1 -- 172.21.15.148:0/2876230798 shutdown_connections 2024-09-19T07:09:52.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.653+0000 7fe199914640 1 --2- 172.21.15.148:0/2876230798 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe194101420 0x7fe19410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:52.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.653+0000 7fe199914640 1 --2- 172.21.15.148:0/2876230798 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe194100a80 0x7fe194100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:52.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.653+0000 7fe199914640 1 --2- 172.21.15.148:0/2876230798 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe194106a80 0x7fe194106e60 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:52.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.653+0000 7fe199914640 1 -- 172.21.15.148:0/2876230798 >> 172.21.15.148:0/2876230798 conn(0x7fe1940fc7a0 msgr2=0x7fe1940febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:52.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.653+0000 7fe199914640 1 -- 172.21.15.148:0/2876230798 shutdown_connections 2024-09-19T07:09:52.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.653+0000 7fe199914640 1 -- 172.21.15.148:0/2876230798 wait complete. 2024-09-19T07:09:52.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.653+0000 7fe199914640 1 Processor -- start 2024-09-19T07:09:52.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.654+0000 7fe199914640 1 -- start start 2024-09-19T07:09:52.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.654+0000 7fe199914640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe194100a80 0x7fe194199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:52.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.654+0000 7fe199914640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe194101420 0x7fe194199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:52.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.654+0000 7fe199914640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe194106a80 0x7fe1941a43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:52.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.654+0000 7fe199914640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe194110ea0 con 0x7fe194106a80 2024-09-19T07:09:52.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.654+0000 7fe199914640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe194110d20 con 0x7fe194100a80 2024-09-19T07:09:52.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.654+0000 7fe199914640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe194111020 con 0x7fe194101420 2024-09-19T07:09:52.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.654+0000 7fe1937fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe194106a80 0x7fe1941a43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:52.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.654+0000 7fe1937fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe194106a80 0x7fe1941a43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60290/0 (socket says 172.21.15.148:60290) 2024-09-19T07:09:52.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.654+0000 7fe1937fe640 1 -- 172.21.15.148:0/3212609125 learned_addr learned my addr 172.21.15.148:0/3212609125 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:09:52.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.654+0000 7fe192ffd640 1 --2- 172.21.15.148:0/3212609125 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe194100a80 0x7fe194199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:52.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.654+0000 7fe1927fc640 1 --2- 172.21.15.148:0/3212609125 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe194101420 0x7fe194199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:52.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.654+0000 7fe1937fe640 1 -- 172.21.15.148:0/3212609125 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe194101420 msgr2=0x7fe194199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:52.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.654+0000 7fe1937fe640 1 --2- 172.21.15.148:0/3212609125 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe194101420 0x7fe194199860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:52.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.654+0000 7fe1937fe640 1 -- 172.21.15.148:0/3212609125 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe194100a80 msgr2=0x7fe194199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:52.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.654+0000 7fe1937fe640 1 --2- 172.21.15.148:0/3212609125 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe194100a80 0x7fe194199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:52.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.654+0000 7fe1937fe640 1 -- 172.21.15.148:0/3212609125 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1941a48e0 con 0x7fe194106a80 2024-09-19T07:09:52.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.654+0000 7fe1937fe640 1 --2- 172.21.15.148:0/3212609125 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe194106a80 0x7fe1941a43a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe18c00b970 tx=0x7fe18c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:52.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.655+0000 7fe198912640 1 -- 172.21.15.148:0/3212609125 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18c019070 con 0x7fe194106a80 2024-09-19T07:09:52.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.655+0000 7fe198912640 1 -- 172.21.15.148:0/3212609125 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe18c00cb40 con 0x7fe194106a80 2024-09-19T07:09:52.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.655+0000 7fe199914640 1 -- 172.21.15.148:0/3212609125 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1941a4ab0 con 0x7fe194106a80 2024-09-19T07:09:52.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.655+0000 7fe198912640 1 -- 172.21.15.148:0/3212609125 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18c007650 con 0x7fe194106a80 2024-09-19T07:09:52.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.655+0000 7fe199914640 1 -- 172.21.15.148:0/3212609125 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1941a4fc0 con 0x7fe194106a80 2024-09-19T07:09:52.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.656+0000 7fe199914640 1 -- 172.21.15.148:0/3212609125 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe194100ee0 con 0x7fe194106a80 2024-09-19T07:09:52.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.657+0000 7fe198912640 1 -- 172.21.15.148:0/3212609125 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fe18c01c070 con 0x7fe194106a80 2024-09-19T07:09:52.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.658+0000 7fe198912640 1 --2- 172.21.15.148:0/3212609125 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fe17c0a3350 0x7fe17c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:52.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.658+0000 7fe192ffd640 1 --2- 172.21.15.148:0/3212609125 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fe17c0a3350 0x7fe17c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:52.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.658+0000 7fe198912640 1 -- 172.21.15.148:0/3212609125 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7fe18c0cef00 con 0x7fe194106a80 2024-09-19T07:09:52.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.658+0000 7fe192ffd640 1 --2- 172.21.15.148:0/3212609125 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fe17c0a3350 0x7fe17c0a5810 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe184009900 tx=0x7fe1840058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:52.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.662+0000 7fe198912640 1 -- 172.21.15.148:0/3212609125 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe18c09b590 con 0x7fe194106a80 2024-09-19T07:09:52.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.828+0000 7fe199914640 1 -- 172.21.15.148:0/3212609125 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe194108ff0 con 0x7fe194106a80 2024-09-19T07:09:52.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.829+0000 7fe198912640 1 -- 172.21.15.148:0/3212609125 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22807 (secure 0 0 0) 0x7fe18c09f890 con 0x7fe194106a80 2024-09-19T07:09:52.830 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:09:52.830 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":80,"fsid":"eae8a4a8-7654-11ef-bceb-c7b262605968","created":"2024-09-19T07:01:47.891210+0000","modified":"2024-09-19T07:09:38.168257+0000","last_up_change":"2024-09-19T07:08:30.785262+0000","last_in_change":"2024-09-19T07:08:07.001808+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:04:49.313270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T07:09:15.840600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T07:09:17.690782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7b854fad-d5a3-43e3-862e-7a0e8f243c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6803","nonce":512186330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6805","nonce":512186330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6809","nonce":512186330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6807","nonce":512186330}]},"public_addr":"172.21.15.148:6803/512186330","cluster_addr":"172.21.15.148:6805/512186330","heartbeat_back_addr":"172.21.15.148:6809/512186330","heartbeat_front_addr":"172.21.15.148:6807/512186330","state":["exists","up"]},{"osd":1,"uuid":"61b26278-f4db-40f0-97b9-c12a6ef1cd06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6801","nonce":2433984552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6803","nonce":2433984552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6807","nonce":2433984552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6805","nonce":2433984552}]},"public_addr":"172.21.15.165:6801/2433984552","cluster_addr":"172.21.15.165:6803/2433984552","heartbeat_back_addr":"172.21.15.165:6807/2433984552","heartbeat_front_addr":"172.21.15.165:6805/2433984552","state":["exists","up"]},{"osd":2,"uuid":"06620bbc-cdb5-4afc-8122-0bb3126630f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6801","nonce":3048365223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6803","nonce":3048365223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6807","nonce":3048365223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6805","nonce":3048365223}]},"public_addr":"172.21.15.179:6801/3048365223","cluster_addr":"172.21.15.179:6803/3048365223","heartbeat_back_addr":"172.21.15.179:6807/3048365223","heartbeat_front_addr":"172.21.15.179:6805/3048365223","state":["exists","up"]},{"osd":3,"uuid":"d7df45d4-5ef1-4f66-84a7-f61b8756c0c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6811","nonce":3662789091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6813","nonce":3662789091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6817","nonce":3662789091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6815","nonce":3662789091}]},"public_addr":"172.21.15.148:6811/3662789091","cluster_addr":"172.21.15.148:6813/3662789091","heartbeat_back_addr":"172.21.15.148:6817/3662789091","heartbeat_front_addr":"172.21.15.148:6815/3662789091","state":["exists","up"]},{"osd":4,"uuid":"5cfd359b-a8d2-4bdc-858f-087d26e0869c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6809","nonce":3082550323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6811","nonce":3082550323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6815","nonce":3082550323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6813","nonce":3082550323}]},"public_addr":"172.21.15.165:6809/3082550323","cluster_addr":"172.21.15.165:6811/3082550323","heartbeat_back_addr":"172.21.15.165:6815/3082550323","heartbeat_front_addr":"172.21.15.165:6813/3082550323","state":["exists","up"]},{"osd":5,"uuid":"8295e69b-87fe-4403-bb2e-d9dd42e2f398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6809","nonce":2125213751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6811","nonce":2125213751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6815","nonce":2125213751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6813","nonce":2125213751}]},"public_addr":"172.21.15.179:6809/2125213751","cluster_addr":"172.21.15.179:6811/2125213751","heartbeat_back_addr":"172.21.15.179:6815/2125213751","heartbeat_front_addr":"172.21.15.179:6813/2125213751","state":["exists","up"]},{"osd":6,"uuid":"4ce38d1a-06d3-4606-b00d-aa1ff977025f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6819","nonce":2178980310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6821","nonce":2178980310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6825","nonce":2178980310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6823","nonce":2178980310}]},"public_addr":"172.21.15.148:6819/2178980310","cluster_addr":"172.21.15.148:6821/2178980310","heartbeat_back_addr":"172.21.15.148:6825/2178980310","heartbeat_front_addr":"172.21.15.148:6823/2178980310","state":["exists","up"]},{"osd":7,"uuid":"9e68e2b2-9838-4ec0-b473-24f2434695ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6817","nonce":3961600099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6819","nonce":3961600099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6823","nonce":3961600099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6821","nonce":3961600099}]},"public_addr":"172.21.15.165:6817/3961600099","cluster_addr":"172.21.15.165:6819/3961600099","heartbeat_back_addr":"172.21.15.165:6823/3961600099","heartbeat_front_addr":"172.21.15.165:6821/3961600099","state":["exists","up"]},{"osd":8,"uuid":"297acce6-d3c7-4e1a-bf87-be093de51a6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6817","nonce":3642931467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6819","nonce":3642931467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6823","nonce":3642931467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6821","nonce":3642931467}]},"public_addr":"172.21.15.179:6817/3642931467","cluster_addr":"172.21.15.179:6819/3642931467","heartbeat_back_addr":"172.21.15.179:6823/3642931467","heartbeat_front_addr":"172.21.15.179:6821/3642931467","state":["exists","up"]},{"osd":9,"uuid":"ef488c5e-5353-4695-99dd-5b74ade436d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6827","nonce":3135409630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6829","nonce":3135409630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6833","nonce":3135409630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6831","nonce":3135409630}]},"public_addr":"172.21.15.148:6827/3135409630","cluster_addr":"172.21.15.148:6829/3135409630","heartbeat_back_addr":"172.21.15.148:6833/3135409630","heartbeat_front_addr":"172.21.15.148:6831/3135409630","state":["exists","up"]},{"osd":10,"uuid":"7a9f0379-1199-4266-910c-8d1d313d39e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6825","nonce":3554110731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6827","nonce":3554110731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6831","nonce":3554110731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6829","nonce":3554110731}]},"public_addr":"172.21.15.165:6825/3554110731","cluster_addr":"172.21.15.165:6827/3554110731","heartbeat_back_addr":"172.21.15.165:6831/3554110731","heartbeat_front_addr":"172.21.15.165:6829/3554110731","state":["exists","up"]},{"osd":11,"uuid":"eede97e9-5685-4603-806e-7078c6940536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6825","nonce":2026109940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6827","nonce":2026109940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6831","nonce":2026109940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6829","nonce":2026109940}]},"public_addr":"172.21.15.179:6825/2026109940","cluster_addr":"172.21.15.179:6827/2026109940","heartbeat_back_addr":"172.21.15.179:6831/2026109940","heartbeat_front_addr":"172.21.15.179:6829/2026109940","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:03:56.291685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:21.419682+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:46.377012+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:11.484234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:36.723101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:06:00.294617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:06:25.147230+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:06:49.318576+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:07:13.896399+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:07:38.930999+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:08:03.803463+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:08:28.731343+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.148:0/3534559227":"2024-09-20T07:02:37.007183+0000","172.21.15.148:0/1958388906":"2024-09-20T07:02:37.007183+0000","172.21.15.148:0/1922521135":"2024-09-20T07:02:37.007183+0000","172.21.15.148:6801/1949849385":"2024-09-20T07:02:37.007183+0000","172.21.15.148:6800/1949849385":"2024-09-20T07:02:37.007183+0000","172.21.15.148:6800/2161746152":"2024-09-20T07:02:14.557425+0000","172.21.15.148:6801/2161746152":"2024-09-20T07:02:14.557425+0000","172.21.15.148:0/1480486619":"2024-09-20T07:02:14.557425+0000","172.21.15.148:0/174481494":"2024-09-20T07:02:14.557425+0000","172.21.15.148:0/1114469409":"2024-09-20T07:02:14.557425+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T07:09:52.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.831+0000 7fe199914640 1 -- 172.21.15.148:0/3212609125 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fe17c0a3350 msgr2=0x7fe17c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:52.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.831+0000 7fe199914640 1 --2- 172.21.15.148:0/3212609125 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fe17c0a3350 0x7fe17c0a5810 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe184009900 tx=0x7fe1840058d0 comp rx=0 tx=0).stop 2024-09-19T07:09:52.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.831+0000 7fe199914640 1 -- 172.21.15.148:0/3212609125 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe194106a80 msgr2=0x7fe1941a43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:52.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.831+0000 7fe199914640 1 --2- 172.21.15.148:0/3212609125 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe194106a80 0x7fe1941a43a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe18c00b970 tx=0x7fe18c00be30 comp rx=0 tx=0).stop 2024-09-19T07:09:52.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.831+0000 7fe199914640 1 -- 172.21.15.148:0/3212609125 shutdown_connections 2024-09-19T07:09:52.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.831+0000 7fe199914640 1 --2- 172.21.15.148:0/3212609125 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fe17c0a3350 0x7fe17c0a5810 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:52.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.831+0000 7fe199914640 1 --2- 172.21.15.148:0/3212609125 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe194106a80 0x7fe1941a43a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:52.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.831+0000 7fe199914640 1 --2- 172.21.15.148:0/3212609125 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe194101420 0x7fe194199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:52.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.831+0000 7fe199914640 1 --2- 172.21.15.148:0/3212609125 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe194100a80 0x7fe194199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:52.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.831+0000 7fe199914640 1 -- 172.21.15.148:0/3212609125 >> 172.21.15.148:0/3212609125 conn(0x7fe1940fc7a0 msgr2=0x7fe1940fdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:52.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.831+0000 7fe199914640 1 -- 172.21.15.148:0/3212609125 shutdown_connections 2024-09-19T07:09:52.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:52.831+0000 7fe199914640 1 -- 172.21.15.148:0/3212609125 wait complete. 2024-09-19T07:09:53.495 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:53 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/3212609125' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:09:53.495 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:53 smithi148 ceph-mon[31180]: pgmap v288: 97 pgs: 97 active+clean; 638 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-09-19T07:09:53.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:53 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/3212609125' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:09:53.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:53 smithi179 ceph-mon[35716]: pgmap v288: 97 pgs: 97 active+clean; 638 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-09-19T07:09:53.525 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-19T07:09:53.525 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-19T07:09:53.525 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-19T07:09:53.526 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-19T07:09:53.526 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-19T07:09:53.527 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-19T07:09:53.527 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-19T07:09:53.528 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-19T07:09:53.528 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-19T07:09:53.529 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-19T07:09:53.529 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-19T07:09:53.530 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-19T07:09:53.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:53 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/3212609125' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:09:53.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:53 smithi165 ceph-mon[35326]: pgmap v288: 97 pgs: 97 active+clean; 638 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-09-19T07:09:54.242 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:09:54.258 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:09:54.279 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:09:54.285 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:09:54.286 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:09:55.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.050+0000 7fb53e48a640 1 -- 172.21.15.148:0/220730037 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb538106a70 msgr2=0x7fb538106e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:55.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.050+0000 7fb53e48a640 1 --2- 172.21.15.148:0/220730037 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb538106a70 0x7fb538106e50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb528009930 tx=0x7fb52802a420 comp rx=0 tx=0).stop 2024-09-19T07:09:55.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.050+0000 7fb53e48a640 1 -- 172.21.15.148:0/220730037 shutdown_connections 2024-09-19T07:09:55.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.050+0000 7fb53e48a640 1 --2- 172.21.15.148:0/220730037 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb538101410 0x7fb53810d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:55.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.050+0000 7fb53e48a640 1 --2- 172.21.15.148:0/220730037 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb538100a70 0x7fb538100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:55.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.050+0000 7fb53e48a640 1 --2- 172.21.15.148:0/220730037 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb538106a70 0x7fb538106e50 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:55.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.050+0000 7fb53e48a640 1 -- 172.21.15.148:0/220730037 >> 172.21.15.148:0/220730037 conn(0x7fb5380fc7d0 msgr2=0x7fb5380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:55.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.050+0000 7fb53e48a640 1 -- 172.21.15.148:0/220730037 shutdown_connections 2024-09-19T07:09:55.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.050+0000 7fb53e48a640 1 -- 172.21.15.148:0/220730037 wait complete. 2024-09-19T07:09:55.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.051+0000 7fb53e48a640 1 Processor -- start 2024-09-19T07:09:55.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.051+0000 7fb53e48a640 1 -- start start 2024-09-19T07:09:55.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.052+0000 7fb53e48a640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb538100a70 0x7fb538197390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:55.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.052+0000 7fb53e48a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb538101410 0x7fb5381978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:55.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.052+0000 7fb53e48a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb538106a70 0x7fb53819bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:55.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.052+0000 7fb53e48a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb538110e70 con 0x7fb538106a70 2024-09-19T07:09:55.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.052+0000 7fb53e48a640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb538110cf0 con 0x7fb538100a70 2024-09-19T07:09:55.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.052+0000 7fb53e48a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb538110ff0 con 0x7fb538101410 2024-09-19T07:09:55.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.052+0000 7fb53ca27640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb538106a70 0x7fb53819bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:55.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.052+0000 7fb53ca27640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb538106a70 0x7fb53819bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40238/0 (socket says 172.21.15.148:40238) 2024-09-19T07:09:55.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.052+0000 7fb53ca27640 1 -- 172.21.15.148:0/4182181449 learned_addr learned my addr 172.21.15.148:0/4182181449 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:09:55.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.052+0000 7fb5377fe640 1 --2- 172.21.15.148:0/4182181449 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb538101410 0x7fb5381978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:55.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.052+0000 7fb537fff640 1 --2- 172.21.15.148:0/4182181449 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb538100a70 0x7fb538197390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:55.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.052+0000 7fb53ca27640 1 -- 172.21.15.148:0/4182181449 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb538101410 msgr2=0x7fb5381978d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:55.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.052+0000 7fb53ca27640 1 --2- 172.21.15.148:0/4182181449 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb538101410 0x7fb5381978d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:55.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.052+0000 7fb53ca27640 1 -- 172.21.15.148:0/4182181449 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb538100a70 msgr2=0x7fb538197390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:55.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.052+0000 7fb53ca27640 1 --2- 172.21.15.148:0/4182181449 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb538100a70 0x7fb538197390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:55.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.052+0000 7fb53ca27640 1 -- 172.21.15.148:0/4182181449 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb53819c340 con 0x7fb538106a70 2024-09-19T07:09:55.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.052+0000 7fb53ca27640 1 --2- 172.21.15.148:0/4182181449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb538106a70 0x7fb53819bc60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb53000eaa0 tx=0x7fb53000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:55.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.052+0000 7fb5357fa640 1 -- 172.21.15.148:0/4182181449 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb53000cdb0 con 0x7fb538106a70 2024-09-19T07:09:55.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.053+0000 7fb53e48a640 1 -- 172.21.15.148:0/4182181449 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb53819c630 con 0x7fb538106a70 2024-09-19T07:09:55.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.053+0000 7fb5357fa640 1 -- 172.21.15.148:0/4182181449 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb530005020 con 0x7fb538106a70 2024-09-19T07:09:55.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.053+0000 7fb5357fa640 1 -- 172.21.15.148:0/4182181449 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5300116b0 con 0x7fb538106a70 2024-09-19T07:09:55.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.053+0000 7fb53e48a640 1 -- 172.21.15.148:0/4182181449 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5381a3f10 con 0x7fb538106a70 2024-09-19T07:09:55.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.053+0000 7fb53e48a640 1 -- 172.21.15.148:0/4182181449 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb538062980 con 0x7fb538106a70 2024-09-19T07:09:55.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.055+0000 7fb5357fa640 1 -- 172.21.15.148:0/4182181449 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fb530005560 con 0x7fb538106a70 2024-09-19T07:09:55.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.055+0000 7fb5357fa640 1 --2- 172.21.15.148:0/4182181449 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fb5240a32d0 0x7fb5240a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:55.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.055+0000 7fb537fff640 1 --2- 172.21.15.148:0/4182181449 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fb5240a32d0 0x7fb5240a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:55.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.055+0000 7fb5357fa640 1 -- 172.21.15.148:0/4182181449 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7fb5300cfff0 con 0x7fb538106a70 2024-09-19T07:09:55.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.056+0000 7fb5357fa640 1 --2- 172.21.15.148:0/4182181449 >> [v2:172.21.15.179:6808/2125213751,v1:172.21.15.179:6809/2125213751] conn(0x7fb5240ace80 0x7fb5240af320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:55.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.056+0000 7fb5357fa640 1 -- 172.21.15.148:0/4182181449 --> [v2:172.21.15.179:6808/2125213751,v1:172.21.15.179:6809/2125213751] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb530014ec0 con 0x7fb5240ace80 2024-09-19T07:09:55.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.056+0000 7fb5357fa640 1 -- 172.21.15.148:0/4182181449 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fb5300d0440 con 0x7fb538106a70 2024-09-19T07:09:55.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.056+0000 7fb537fff640 1 --2- 172.21.15.148:0/4182181449 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fb5240a32d0 0x7fb5240a5790 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb528009900 tx=0x7fb5280058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:55.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.056+0000 7fb5377fe640 1 --2- 172.21.15.148:0/4182181449 >> [v2:172.21.15.179:6808/2125213751,v1:172.21.15.179:6809/2125213751] conn(0x7fb5240ace80 0x7fb5240af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:55.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.056+0000 7fb5377fe640 1 --2- 172.21.15.148:0/4182181449 >> [v2:172.21.15.179:6808/2125213751,v1:172.21.15.179:6809/2125213751] conn(0x7fb5240ace80 0x7fb5240af320 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:55.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.057+0000 7fb5357fa640 1 -- 172.21.15.148:0/4182181449 <== osd.5 v2:172.21.15.179:6808/2125213751 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb530014ec0 con 0x7fb5240ace80 2024-09-19T07:09:55.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.070+0000 7fb53e48a640 1 -- 172.21.15.148:0/4182181449 --> [v2:172.21.15.179:6808/2125213751,v1:172.21.15.179:6809/2125213751] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb538062e00 con 0x7fb5240ace80 2024-09-19T07:09:55.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.071+0000 7fb5357fa640 1 -- 172.21.15.148:0/4182181449 <== osd.5 v2:172.21.15.179:6808/2125213751 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb538062e00 con 0x7fb5240ace80 2024-09-19T07:09:55.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.071+0000 7fb53e48a640 1 -- 172.21.15.148:0/4182181449 >> [v2:172.21.15.179:6808/2125213751,v1:172.21.15.179:6809/2125213751] conn(0x7fb5240ace80 msgr2=0x7fb5240af320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:55.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.071+0000 7fb53e48a640 1 --2- 172.21.15.148:0/4182181449 >> [v2:172.21.15.179:6808/2125213751,v1:172.21.15.179:6809/2125213751] conn(0x7fb5240ace80 0x7fb5240af320 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:55.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.071+0000 7fb53e48a640 1 -- 172.21.15.148:0/4182181449 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fb5240a32d0 msgr2=0x7fb5240a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:55.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.072+0000 7fb53e48a640 1 --2- 172.21.15.148:0/4182181449 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fb5240a32d0 0x7fb5240a5790 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb528009900 tx=0x7fb5280058d0 comp rx=0 tx=0).stop 2024-09-19T07:09:55.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.072+0000 7fb53e48a640 1 -- 172.21.15.148:0/4182181449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb538106a70 msgr2=0x7fb53819bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:55.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.072+0000 7fb53e48a640 1 --2- 172.21.15.148:0/4182181449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb538106a70 0x7fb53819bc60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb53000eaa0 tx=0x7fb53000ef60 comp rx=0 tx=0).stop 2024-09-19T07:09:55.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.072+0000 7fb53ca27640 1 -- 172.21.15.148:0/4182181449 reap_dead start 2024-09-19T07:09:55.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.072+0000 7fb53e48a640 1 -- 172.21.15.148:0/4182181449 shutdown_connections 2024-09-19T07:09:55.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.072+0000 7fb53e48a640 1 -- 172.21.15.148:0/4182181449 >> 172.21.15.148:0/4182181449 conn(0x7fb5380fc7d0 msgr2=0x7fb5380fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:55.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.072+0000 7fb53e48a640 1 -- 172.21.15.148:0/4182181449 shutdown_connections 2024-09-19T07:09:55.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:55.072+0000 7fb53e48a640 1 -- 172.21.15.148:0/4182181449 wait complete. 2024-09-19T07:09:55.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.972+0000 7fca41671640 1 -- 172.21.15.148:0/1012742214 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca3c102570 msgr2=0x7fca3c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:55.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.972+0000 7fca41671640 1 --2- 172.21.15.148:0/1012742214 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca3c102570 0x7fca3c1029b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fca30009900 tx=0x7fca3002a480 comp rx=0 tx=0).stop 2024-09-19T07:09:55.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.972+0000 7fca41671640 1 -- 172.21.15.148:0/1012742214 shutdown_connections 2024-09-19T07:09:55.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.972+0000 7fca41671640 1 --2- 172.21.15.148:0/1012742214 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca3c102ef0 0x7fca3c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:55.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.972+0000 7fca41671640 1 --2- 172.21.15.148:0/1012742214 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca3c102570 0x7fca3c1029b0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:55.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.972+0000 7fca41671640 1 --2- 172.21.15.148:0/1012742214 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca3c100e20 0x7fca3c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:55.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.972+0000 7fca41671640 1 -- 172.21.15.148:0/1012742214 >> 172.21.15.148:0/1012742214 conn(0x7fca3c0fc7d0 msgr2=0x7fca3c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:55.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.972+0000 7fca41671640 1 -- 172.21.15.148:0/1012742214 shutdown_connections 2024-09-19T07:09:55.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.972+0000 7fca41671640 1 -- 172.21.15.148:0/1012742214 wait complete. 2024-09-19T07:09:55.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.973+0000 7fca41671640 1 Processor -- start 2024-09-19T07:09:55.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.973+0000 7fca41671640 1 -- start start 2024-09-19T07:09:55.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.973+0000 7fca41671640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca3c100e20 0x7fca3c1971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:55.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.973+0000 7fca41671640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca3c102570 0x7fca3c1976f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:55.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.973+0000 7fca41671640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca3c102ef0 0x7fca3c197c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:55.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.973+0000 7fca41671640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fca3c110f50 con 0x7fca3c102ef0 2024-09-19T07:09:55.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.973+0000 7fca41671640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fca3c110dd0 con 0x7fca3c102570 2024-09-19T07:09:55.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.973+0000 7fca41671640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fca3c1110d0 con 0x7fca3c100e20 2024-09-19T07:09:55.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.973+0000 7fca3b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca3c102ef0 0x7fca3c197c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:55.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.973+0000 7fca3b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca3c102ef0 0x7fca3c197c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40222/0 (socket says 172.21.15.148:40222) 2024-09-19T07:09:55.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.973+0000 7fca3b7fe640 1 -- 172.21.15.148:0/1509733149 learned_addr learned my addr 172.21.15.148:0/1509733149 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:09:55.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.974+0000 7fca3a7fc640 1 --2- 172.21.15.148:0/1509733149 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca3c102570 0x7fca3c1976f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:55.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.974+0000 7fca3affd640 1 --2- 172.21.15.148:0/1509733149 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca3c100e20 0x7fca3c1971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:55.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.974+0000 7fca3b7fe640 1 -- 172.21.15.148:0/1509733149 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca3c100e20 msgr2=0x7fca3c1971b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:55.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.974+0000 7fca3b7fe640 1 --2- 172.21.15.148:0/1509733149 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca3c100e20 0x7fca3c1971b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:55.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.974+0000 7fca3b7fe640 1 -- 172.21.15.148:0/1509733149 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca3c102570 msgr2=0x7fca3c1976f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:55.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.974+0000 7fca3b7fe640 1 --2- 172.21.15.148:0/1509733149 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca3c102570 0x7fca3c1976f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:55.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.974+0000 7fca3b7fe640 1 -- 172.21.15.148:0/1509733149 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca3c1a6a20 con 0x7fca3c102ef0 2024-09-19T07:09:55.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.974+0000 7fca3b7fe640 1 --2- 172.21.15.148:0/1509733149 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca3c102ef0 0x7fca3c197c30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fca3400cad0 tx=0x7fca3400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:55.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.974+0000 7fca23fff640 1 -- 172.21.15.148:0/1509733149 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca3400ae20 con 0x7fca3c102ef0 2024-09-19T07:09:55.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.974+0000 7fca23fff640 1 -- 172.21.15.148:0/1509733149 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca34005020 con 0x7fca3c102ef0 2024-09-19T07:09:55.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.974+0000 7fca23fff640 1 -- 172.21.15.148:0/1509733149 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca3400f6f0 con 0x7fca3c102ef0 2024-09-19T07:09:55.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.974+0000 7fca41671640 1 -- 172.21.15.148:0/1509733149 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca3c1a6d10 con 0x7fca3c102ef0 2024-09-19T07:09:55.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.974+0000 7fca41671640 1 -- 172.21.15.148:0/1509733149 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca3c1a71d0 con 0x7fca3c102ef0 2024-09-19T07:09:55.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.975+0000 7fca41671640 1 -- 172.21.15.148:0/1509733149 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fca3c062940 con 0x7fca3c102ef0 2024-09-19T07:09:55.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.976+0000 7fca23fff640 1 -- 172.21.15.148:0/1509733149 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fca340051d0 con 0x7fca3c102ef0 2024-09-19T07:09:55.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.977+0000 7fca23fff640 1 --2- 172.21.15.148:0/1509733149 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fca240a32d0 0x7fca240a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:55.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.977+0000 7fca3affd640 1 --2- 172.21.15.148:0/1509733149 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fca240a32d0 0x7fca240a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:55.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.977+0000 7fca23fff640 1 -- 172.21.15.148:0/1509733149 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7fca340cfdf0 con 0x7fca3c102ef0 2024-09-19T07:09:55.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.977+0000 7fca23fff640 1 --2- 172.21.15.148:0/1509733149 >> [v2:172.21.15.179:6800/3048365223,v1:172.21.15.179:6801/3048365223] conn(0x7fca240ace80 0x7fca240af320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:55.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.977+0000 7fca23fff640 1 -- 172.21.15.148:0/1509733149 --> [v2:172.21.15.179:6800/3048365223,v1:172.21.15.179:6801/3048365223] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fca240af9f0 con 0x7fca240ace80 2024-09-19T07:09:55.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.977+0000 7fca23fff640 1 -- 172.21.15.148:0/1509733149 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fca340d0240 con 0x7fca3c102ef0 2024-09-19T07:09:55.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.978+0000 7fca3affd640 1 --2- 172.21.15.148:0/1509733149 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fca240a32d0 0x7fca240a5790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fca2c00bbe0 tx=0x7fca2c00b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:55.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.978+0000 7fca3a7fc640 1 --2- 172.21.15.148:0/1509733149 >> [v2:172.21.15.179:6800/3048365223,v1:172.21.15.179:6801/3048365223] conn(0x7fca240ace80 0x7fca240af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:55.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.978+0000 7fca3a7fc640 1 --2- 172.21.15.148:0/1509733149 >> [v2:172.21.15.179:6800/3048365223,v1:172.21.15.179:6801/3048365223] conn(0x7fca240ace80 0x7fca240af320 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:55.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.979+0000 7fca23fff640 1 -- 172.21.15.148:0/1509733149 <== osd.2 v2:172.21.15.179:6800/3048365223 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fca240af9f0 con 0x7fca240ace80 2024-09-19T07:09:55.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.992+0000 7fca41671640 1 -- 172.21.15.148:0/1509733149 --> [v2:172.21.15.179:6800/3048365223,v1:172.21.15.179:6801/3048365223] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fca3c062dc0 con 0x7fca240ace80 2024-09-19T07:09:55.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.993+0000 7fca23fff640 1 -- 172.21.15.148:0/1509733149 <== osd.2 v2:172.21.15.179:6800/3048365223 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fca3c062dc0 con 0x7fca240ace80 2024-09-19T07:09:55.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.993+0000 7fca41671640 1 -- 172.21.15.148:0/1509733149 >> [v2:172.21.15.179:6800/3048365223,v1:172.21.15.179:6801/3048365223] conn(0x7fca240ace80 msgr2=0x7fca240af320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:55.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.993+0000 7fca41671640 1 --2- 172.21.15.148:0/1509733149 >> [v2:172.21.15.179:6800/3048365223,v1:172.21.15.179:6801/3048365223] conn(0x7fca240ace80 0x7fca240af320 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:55.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.993+0000 7fca41671640 1 -- 172.21.15.148:0/1509733149 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fca240a32d0 msgr2=0x7fca240a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:55.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.993+0000 7fca41671640 1 --2- 172.21.15.148:0/1509733149 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fca240a32d0 0x7fca240a5790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fca2c00bbe0 tx=0x7fca2c00b390 comp rx=0 tx=0).stop 2024-09-19T07:09:55.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.993+0000 7fca41671640 1 -- 172.21.15.148:0/1509733149 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca3c102ef0 msgr2=0x7fca3c197c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:55.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.993+0000 7fca41671640 1 --2- 172.21.15.148:0/1509733149 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca3c102ef0 0x7fca3c197c30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fca3400cad0 tx=0x7fca3400cf90 comp rx=0 tx=0).stop 2024-09-19T07:09:55.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.993+0000 7fca3b7fe640 1 -- 172.21.15.148:0/1509733149 reap_dead start 2024-09-19T07:09:55.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.993+0000 7fca41671640 1 -- 172.21.15.148:0/1509733149 shutdown_connections 2024-09-19T07:09:55.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.993+0000 7fca41671640 1 -- 172.21.15.148:0/1509733149 >> 172.21.15.148:0/1509733149 conn(0x7fca3c0fc7d0 msgr2=0x7fca3c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:55.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.994+0000 7fca41671640 1 -- 172.21.15.148:0/1509733149 shutdown_connections 2024-09-19T07:09:55.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:54.994+0000 7fca41671640 1 -- 172.21.15.148:0/1509733149 wait complete. 2024-09-19T07:09:55.619 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:09:55.619 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:09:55.620 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:09:55.620 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:09:55.622 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:09:55.622 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:09:55.625 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:09:56.224 INFO:teuthology.orchestra.run.smithi148.stdout:146028888113 2024-09-19T07:09:56.225 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-19T07:09:56.412 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:56 smithi148 ceph-mon[31180]: pgmap v289: 97 pgs: 97 active+clean; 638 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-19T07:09:56.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:56 smithi179 ceph-mon[35716]: pgmap v289: 97 pgs: 97 active+clean; 638 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-19T07:09:56.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:56 smithi165 ceph-mon[35326]: pgmap v289: 97 pgs: 97 active+clean; 638 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-19T07:09:57.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.010+0000 7ff3f152c640 1 -- 172.21.15.148:0/2199399727 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3ec101420 msgr2=0x7ff3ec10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:57.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.010+0000 7ff3f152c640 1 --2- 172.21.15.148:0/2199399727 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3ec101420 0x7ff3ec10d950 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4009cd0 tx=0x7ff3e402a8e0 comp rx=0 tx=0).stop 2024-09-19T07:09:57.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.010+0000 7ff3f152c640 1 -- 172.21.15.148:0/2199399727 shutdown_connections 2024-09-19T07:09:57.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.010+0000 7ff3f152c640 1 --2- 172.21.15.148:0/2199399727 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3ec101420 0x7ff3ec10d950 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:57.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.010+0000 7ff3f152c640 1 --2- 172.21.15.148:0/2199399727 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3ec100a80 0x7ff3ec100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:57.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.010+0000 7ff3f152c640 1 --2- 172.21.15.148:0/2199399727 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff3ec106a80 0x7ff3ec106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:57.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.010+0000 7ff3f152c640 1 -- 172.21.15.148:0/2199399727 >> 172.21.15.148:0/2199399727 conn(0x7ff3ec0fc7a0 msgr2=0x7ff3ec0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:57.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.010+0000 7ff3f152c640 1 -- 172.21.15.148:0/2199399727 shutdown_connections 2024-09-19T07:09:57.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.011+0000 7ff3f152c640 1 -- 172.21.15.148:0/2199399727 wait complete. 2024-09-19T07:09:57.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.011+0000 7ff3f152c640 1 Processor -- start 2024-09-19T07:09:57.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.011+0000 7ff3f152c640 1 -- start start 2024-09-19T07:09:57.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.011+0000 7ff3f152c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3ec100a80 0x7ff3ec197340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:57.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.011+0000 7ff3f152c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff3ec101420 0x7ff3ec197880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:57.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.011+0000 7ff3f152c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3ec106a80 0x7ff3ec19bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:57.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.011+0000 7ff3f152c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff3ec110e80 con 0x7ff3ec100a80 2024-09-19T07:09:57.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.011+0000 7ff3f152c640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff3ec110d00 con 0x7ff3ec101420 2024-09-19T07:09:57.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.011+0000 7ff3f152c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff3ec111000 con 0x7ff3ec106a80 2024-09-19T07:09:57.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.012+0000 7ff3eaffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3ec100a80 0x7ff3ec197340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:57.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.012+0000 7ff3eaffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3ec100a80 0x7ff3ec197340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40248/0 (socket says 172.21.15.148:40248) 2024-09-19T07:09:57.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.012+0000 7ff3eaffd640 1 -- 172.21.15.148:0/2289788511 learned_addr learned my addr 172.21.15.148:0/2289788511 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:09:57.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.012+0000 7ff3e3fff640 1 --2- 172.21.15.148:0/2289788511 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff3ec101420 0x7ff3ec197880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:57.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.012+0000 7ff3eb7fe640 1 --2- 172.21.15.148:0/2289788511 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3ec106a80 0x7ff3ec19bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:57.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.012+0000 7ff3eaffd640 1 -- 172.21.15.148:0/2289788511 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3ec106a80 msgr2=0x7ff3ec19bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:57.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.012+0000 7ff3eaffd640 1 --2- 172.21.15.148:0/2289788511 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3ec106a80 0x7ff3ec19bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:57.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.012+0000 7ff3eaffd640 1 -- 172.21.15.148:0/2289788511 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff3ec101420 msgr2=0x7ff3ec197880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:57.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.012+0000 7ff3eaffd640 1 --2- 172.21.15.148:0/2289788511 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff3ec101420 0x7ff3ec197880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:57.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.012+0000 7ff3eaffd640 1 -- 172.21.15.148:0/2289788511 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3ec19c2f0 con 0x7ff3ec100a80 2024-09-19T07:09:57.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.012+0000 7ff3eaffd640 1 --2- 172.21.15.148:0/2289788511 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3ec100a80 0x7ff3ec197340 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc00d950 tx=0x7ff3dc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:57.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.012+0000 7ff3e8ff9640 1 -- 172.21.15.148:0/2289788511 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc017030 con 0x7ff3ec100a80 2024-09-19T07:09:57.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.012+0000 7ff3e8ff9640 1 -- 172.21.15.148:0/2289788511 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3dc004020 con 0x7ff3ec100a80 2024-09-19T07:09:57.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.012+0000 7ff3f152c640 1 -- 172.21.15.148:0/2289788511 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3ec19c5e0 con 0x7ff3ec100a80 2024-09-19T07:09:57.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.012+0000 7ff3e8ff9640 1 -- 172.21.15.148:0/2289788511 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc0047a0 con 0x7ff3ec100a80 2024-09-19T07:09:57.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.012+0000 7ff3f152c640 1 -- 172.21.15.148:0/2289788511 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3ec1a3ec0 con 0x7ff3ec100a80 2024-09-19T07:09:57.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.013+0000 7ff3f152c640 1 -- 172.21.15.148:0/2289788511 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff3ec062940 con 0x7ff3ec100a80 2024-09-19T07:09:57.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.014+0000 7ff3e8ff9640 1 -- 172.21.15.148:0/2289788511 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7ff3dc0041d0 con 0x7ff3ec100a80 2024-09-19T07:09:57.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.015+0000 7ff3e8ff9640 1 --2- 172.21.15.148:0/2289788511 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff3d80a32d0 0x7ff3d80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:57.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.015+0000 7ff3e3fff640 1 --2- 172.21.15.148:0/2289788511 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff3d80a32d0 0x7ff3d80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:57.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.015+0000 7ff3e8ff9640 1 -- 172.21.15.148:0/2289788511 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7ff3dc0cf360 con 0x7ff3ec100a80 2024-09-19T07:09:57.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.015+0000 7ff3e8ff9640 1 --2- 172.21.15.148:0/2289788511 >> [v2:172.21.15.148:6802/512186330,v1:172.21.15.148:6803/512186330] conn(0x7ff3d80ace80 0x7ff3d80af320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:57.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.015+0000 7ff3e8ff9640 1 -- 172.21.15.148:0/2289788511 --> [v2:172.21.15.148:6802/512186330,v1:172.21.15.148:6803/512186330] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff3dc021e50 con 0x7ff3d80ace80 2024-09-19T07:09:57.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.015+0000 7ff3e8ff9640 1 -- 172.21.15.148:0/2289788511 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7ff3dc0d6050 con 0x7ff3ec100a80 2024-09-19T07:09:57.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.015+0000 7ff3eb7fe640 1 --2- 172.21.15.148:0/2289788511 >> [v2:172.21.15.148:6802/512186330,v1:172.21.15.148:6803/512186330] conn(0x7ff3d80ace80 0x7ff3d80af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:57.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.015+0000 7ff3e3fff640 1 --2- 172.21.15.148:0/2289788511 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff3d80a32d0 0x7ff3d80a5790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec0fed60 tx=0x7ff3d400a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:57.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.016+0000 7ff3eb7fe640 1 --2- 172.21.15.148:0/2289788511 >> [v2:172.21.15.148:6802/512186330,v1:172.21.15.148:6803/512186330] conn(0x7ff3d80ace80 0x7ff3d80af320 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:57.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.016+0000 7ff3e8ff9640 1 -- 172.21.15.148:0/2289788511 <== osd.0 v2:172.21.15.148:6802/512186330 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff3dc021e50 con 0x7ff3d80ace80 2024-09-19T07:09:57.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.031+0000 7ff3f152c640 1 -- 172.21.15.148:0/2289788511 --> [v2:172.21.15.148:6802/512186330,v1:172.21.15.148:6803/512186330] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff3ec062dc0 con 0x7ff3d80ace80 2024-09-19T07:09:57.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.031+0000 7ff3e8ff9640 1 -- 172.21.15.148:0/2289788511 <== osd.0 v2:172.21.15.148:6802/512186330 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff3ec062dc0 con 0x7ff3d80ace80 2024-09-19T07:09:57.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.031+0000 7ff3f152c640 1 -- 172.21.15.148:0/2289788511 >> [v2:172.21.15.148:6802/512186330,v1:172.21.15.148:6803/512186330] conn(0x7ff3d80ace80 msgr2=0x7ff3d80af320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:57.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.031+0000 7ff3f152c640 1 --2- 172.21.15.148:0/2289788511 >> [v2:172.21.15.148:6802/512186330,v1:172.21.15.148:6803/512186330] conn(0x7ff3d80ace80 0x7ff3d80af320 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:57.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.031+0000 7ff3f152c640 1 -- 172.21.15.148:0/2289788511 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff3d80a32d0 msgr2=0x7ff3d80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:57.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.031+0000 7ff3f152c640 1 --2- 172.21.15.148:0/2289788511 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff3d80a32d0 0x7ff3d80a5790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec0fed60 tx=0x7ff3d400a2d0 comp rx=0 tx=0).stop 2024-09-19T07:09:57.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.031+0000 7ff3f152c640 1 -- 172.21.15.148:0/2289788511 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3ec100a80 msgr2=0x7ff3ec197340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:57.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.031+0000 7ff3f152c640 1 --2- 172.21.15.148:0/2289788511 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3ec100a80 0x7ff3ec197340 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc00d950 tx=0x7ff3dc00de10 comp rx=0 tx=0).stop 2024-09-19T07:09:57.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.031+0000 7ff3eb7fe640 1 -- 172.21.15.148:0/2289788511 reap_dead start 2024-09-19T07:09:57.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.031+0000 7ff3f152c640 1 -- 172.21.15.148:0/2289788511 shutdown_connections 2024-09-19T07:09:57.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.031+0000 7ff3f152c640 1 -- 172.21.15.148:0/2289788511 >> 172.21.15.148:0/2289788511 conn(0x7ff3ec0fc7a0 msgr2=0x7ff3ec0fcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:57.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.032+0000 7ff3f152c640 1 -- 172.21.15.148:0/2289788511 shutdown_connections 2024-09-19T07:09:57.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.032+0000 7ff3f152c640 1 -- 172.21.15.148:0/2289788511 wait complete. 2024-09-19T07:09:57.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.889+0000 7fd72f9c0640 1 -- 172.21.15.148:0/2716835809 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd728102570 msgr2=0x7fd7281029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:57.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.889+0000 7fd72f9c0640 1 --2- 172.21.15.148:0/2716835809 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd728102570 0x7fd7281029b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd724009900 tx=0x7fd72402a480 comp rx=0 tx=0).stop 2024-09-19T07:09:57.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.889+0000 7fd72f9c0640 1 -- 172.21.15.148:0/2716835809 shutdown_connections 2024-09-19T07:09:57.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.889+0000 7fd72f9c0640 1 --2- 172.21.15.148:0/2716835809 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd728102ef0 0x7fd72810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:57.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.889+0000 7fd72f9c0640 1 --2- 172.21.15.148:0/2716835809 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd728102570 0x7fd7281029b0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:57.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.889+0000 7fd72f9c0640 1 --2- 172.21.15.148:0/2716835809 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd728100e20 0x7fd728101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:57.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.889+0000 7fd72f9c0640 1 -- 172.21.15.148:0/2716835809 >> 172.21.15.148:0/2716835809 conn(0x7fd7280fc7d0 msgr2=0x7fd7280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:57.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.889+0000 7fd72f9c0640 1 -- 172.21.15.148:0/2716835809 shutdown_connections 2024-09-19T07:09:57.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.889+0000 7fd72f9c0640 1 -- 172.21.15.148:0/2716835809 wait complete. 2024-09-19T07:09:57.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.889+0000 7fd72f9c0640 1 Processor -- start 2024-09-19T07:09:57.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.889+0000 7fd72f9c0640 1 -- start start 2024-09-19T07:09:57.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.890+0000 7fd72f9c0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd728100e20 0x7fd728198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:57.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.890+0000 7fd72f9c0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd728102570 0x7fd728198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:57.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.890+0000 7fd72f9c0640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd728102ef0 0x7fd72819cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:57.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.890+0000 7fd72f9c0640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd728110f80 con 0x7fd728102570 2024-09-19T07:09:57.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.890+0000 7fd72f9c0640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd728110e00 con 0x7fd728102ef0 2024-09-19T07:09:57.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.890+0000 7fd72f9c0640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd728111100 con 0x7fd728100e20 2024-09-19T07:09:57.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.890+0000 7fd72cf5b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd728102570 0x7fd728198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:57.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.890+0000 7fd72cf5b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd728102570 0x7fd728198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40270/0 (socket says 172.21.15.148:40270) 2024-09-19T07:09:57.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.890+0000 7fd72cf5b640 1 -- 172.21.15.148:0/1576285579 learned_addr learned my addr 172.21.15.148:0/1576285579 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:09:57.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.890+0000 7fd72d75c640 1 --2- 172.21.15.148:0/1576285579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd728100e20 0x7fd728198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:57.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.890+0000 7fd72df5d640 1 --2- 172.21.15.148:0/1576285579 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd728102ef0 0x7fd72819cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:57.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.890+0000 7fd72cf5b640 1 -- 172.21.15.148:0/1576285579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd728100e20 msgr2=0x7fd728198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:57.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.890+0000 7fd72cf5b640 1 --2- 172.21.15.148:0/1576285579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd728100e20 0x7fd728198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:57.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.890+0000 7fd72cf5b640 1 -- 172.21.15.148:0/1576285579 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd728102ef0 msgr2=0x7fd72819cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:57.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.890+0000 7fd72cf5b640 1 --2- 172.21.15.148:0/1576285579 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd728102ef0 0x7fd72819cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:57.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.890+0000 7fd72cf5b640 1 -- 172.21.15.148:0/1576285579 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd72819d4c0 con 0x7fd728102570 2024-09-19T07:09:57.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.890+0000 7fd72df5d640 1 --2- 172.21.15.148:0/1576285579 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd728102ef0 0x7fd72819cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:09:57.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.890+0000 7fd72cf5b640 1 --2- 172.21.15.148:0/1576285579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd728102570 0x7fd728198a50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd724006010 tx=0x7fd724003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:57.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.891+0000 7fd71a7fc640 1 -- 172.21.15.148:0/1576285579 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd72403f070 con 0x7fd728102570 2024-09-19T07:09:57.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.891+0000 7fd71a7fc640 1 -- 172.21.15.148:0/1576285579 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd724031c30 con 0x7fd728102570 2024-09-19T07:09:57.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.891+0000 7fd72f9c0640 1 -- 172.21.15.148:0/1576285579 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd72819d750 con 0x7fd728102570 2024-09-19T07:09:57.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.891+0000 7fd71a7fc640 1 -- 172.21.15.148:0/1576285579 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd724035030 con 0x7fd728102570 2024-09-19T07:09:57.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.891+0000 7fd72f9c0640 1 -- 172.21.15.148:0/1576285579 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7281a5090 con 0x7fd728102570 2024-09-19T07:09:57.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.891+0000 7fd72f9c0640 1 -- 172.21.15.148:0/1576285579 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd728062980 con 0x7fd728102570 2024-09-19T07:09:57.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.893+0000 7fd71a7fc640 1 -- 172.21.15.148:0/1576285579 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fd724042070 con 0x7fd728102570 2024-09-19T07:09:57.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.893+0000 7fd71a7fc640 1 --2- 172.21.15.148:0/1576285579 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fd7140a32d0 0x7fd7140a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:57.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.893+0000 7fd72d75c640 1 --2- 172.21.15.148:0/1576285579 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fd7140a32d0 0x7fd7140a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:57.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.893+0000 7fd71a7fc640 1 -- 172.21.15.148:0/1576285579 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7fd7240f0a70 con 0x7fd728102570 2024-09-19T07:09:57.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.894+0000 7fd71a7fc640 1 --2- 172.21.15.148:0/1576285579 >> [v2:172.21.15.165:6800/2433984552,v1:172.21.15.165:6801/2433984552] conn(0x7fd7140ace80 0x7fd7140af320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:57.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.894+0000 7fd71a7fc640 1 -- 172.21.15.148:0/1576285579 --> [v2:172.21.15.165:6800/2433984552,v1:172.21.15.165:6801/2433984552] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd724046e50 con 0x7fd7140ace80 2024-09-19T07:09:57.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.894+0000 7fd71a7fc640 1 -- 172.21.15.148:0/1576285579 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fd7240f0ec0 con 0x7fd728102570 2024-09-19T07:09:57.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.894+0000 7fd72d75c640 1 --2- 172.21.15.148:0/1576285579 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fd7140a32d0 0x7fd7140a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd71c009bb0 tx=0x7fd71c005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:57.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.894+0000 7fd72df5d640 1 --2- 172.21.15.148:0/1576285579 >> [v2:172.21.15.165:6800/2433984552,v1:172.21.15.165:6801/2433984552] conn(0x7fd7140ace80 0x7fd7140af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:57.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.894+0000 7fd72df5d640 1 --2- 172.21.15.148:0/1576285579 >> [v2:172.21.15.165:6800/2433984552,v1:172.21.15.165:6801/2433984552] conn(0x7fd7140ace80 0x7fd7140af320 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:57.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.895+0000 7fd71a7fc640 1 -- 172.21.15.148:0/1576285579 <== osd.1 v2:172.21.15.165:6800/2433984552 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd724046e50 con 0x7fd7140ace80 2024-09-19T07:09:57.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.909+0000 7fd72f9c0640 1 -- 172.21.15.148:0/1576285579 --> [v2:172.21.15.165:6800/2433984552,v1:172.21.15.165:6801/2433984552] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd728062e00 con 0x7fd7140ace80 2024-09-19T07:09:57.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.910+0000 7fd71a7fc640 1 -- 172.21.15.148:0/1576285579 <== osd.1 v2:172.21.15.165:6800/2433984552 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd728062e00 con 0x7fd7140ace80 2024-09-19T07:09:57.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.910+0000 7fd72f9c0640 1 -- 172.21.15.148:0/1576285579 >> [v2:172.21.15.165:6800/2433984552,v1:172.21.15.165:6801/2433984552] conn(0x7fd7140ace80 msgr2=0x7fd7140af320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:57.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.910+0000 7fd72f9c0640 1 --2- 172.21.15.148:0/1576285579 >> [v2:172.21.15.165:6800/2433984552,v1:172.21.15.165:6801/2433984552] conn(0x7fd7140ace80 0x7fd7140af320 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:57.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.910+0000 7fd72f9c0640 1 -- 172.21.15.148:0/1576285579 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fd7140a32d0 msgr2=0x7fd7140a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:57.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.910+0000 7fd72f9c0640 1 --2- 172.21.15.148:0/1576285579 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fd7140a32d0 0x7fd7140a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd71c009bb0 tx=0x7fd71c005f90 comp rx=0 tx=0).stop 2024-09-19T07:09:57.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.910+0000 7fd72f9c0640 1 -- 172.21.15.148:0/1576285579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd728102570 msgr2=0x7fd728198a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:57.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.910+0000 7fd72f9c0640 1 --2- 172.21.15.148:0/1576285579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd728102570 0x7fd728198a50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd724006010 tx=0x7fd724003c10 comp rx=0 tx=0).stop 2024-09-19T07:09:57.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.910+0000 7fd72df5d640 1 -- 172.21.15.148:0/1576285579 reap_dead start 2024-09-19T07:09:57.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.912+0000 7fd72f9c0640 1 -- 172.21.15.148:0/1576285579 shutdown_connections 2024-09-19T07:09:57.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.912+0000 7fd72f9c0640 1 -- 172.21.15.148:0/1576285579 >> 172.21.15.148:0/1576285579 conn(0x7fd7280fc7d0 msgr2=0x7fd72806a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:57.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.912+0000 7fd72f9c0640 1 -- 172.21.15.148:0/1576285579 shutdown_connections 2024-09-19T07:09:57.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:57.912+0000 7fd72f9c0640 1 -- 172.21.15.148:0/1576285579 wait complete. 2024-09-19T07:09:58.469 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:09:58 smithi148 ceph-mon[31180]: pgmap v290: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-09-19T07:09:58.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:09:58 smithi179 ceph-mon[35716]: pgmap v290: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-09-19T07:09:58.636 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:09:58 smithi165 ceph-mon[35326]: pgmap v290: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-09-19T07:09:58.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.826+0000 7ff721003640 1 -- 172.21.15.148:0/437518533 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff71c102dd0 msgr2=0x7ff71c1031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:58.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.826+0000 7ff721003640 1 --2- 172.21.15.148:0/437518533 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff71c102dd0 0x7ff71c1031b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff70c009930 tx=0x7ff70c02a440 comp rx=0 tx=0).stop 2024-09-19T07:09:58.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.826+0000 7ff721003640 1 -- 172.21.15.148:0/437518533 shutdown_connections 2024-09-19T07:09:58.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.826+0000 7ff721003640 1 --2- 172.21.15.148:0/437518533 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff71c108300 0x7ff71c10ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:58.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.826+0000 7ff721003640 1 --2- 172.21.15.148:0/437518533 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff71c103780 0x7ff71c107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:58.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.826+0000 7ff721003640 1 --2- 172.21.15.148:0/437518533 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff71c102dd0 0x7ff71c1031b0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:58.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.826+0000 7ff721003640 1 -- 172.21.15.148:0/437518533 >> 172.21.15.148:0/437518533 conn(0x7ff71c0fc7d0 msgr2=0x7ff71c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:58.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.826+0000 7ff721003640 1 -- 172.21.15.148:0/437518533 shutdown_connections 2024-09-19T07:09:58.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.826+0000 7ff721003640 1 -- 172.21.15.148:0/437518533 wait complete. 2024-09-19T07:09:58.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.827+0000 7ff721003640 1 Processor -- start 2024-09-19T07:09:58.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.827+0000 7ff721003640 1 -- start start 2024-09-19T07:09:58.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.828+0000 7ff721003640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff71c102dd0 0x7ff71c100a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:58.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.828+0000 7ff721003640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff71c103780 0x7ff71c100f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:58.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.828+0000 7ff721003640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff71c108300 0x7ff71c1014b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:58.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.828+0000 7ff721003640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff71c112170 con 0x7ff71c102dd0 2024-09-19T07:09:58.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.828+0000 7ff721003640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff71c111ff0 con 0x7ff71c108300 2024-09-19T07:09:58.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.828+0000 7ff721003640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff71c1122f0 con 0x7ff71c103780 2024-09-19T07:09:58.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.828+0000 7ff71ad9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff71c102dd0 0x7ff71c100a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:58.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.828+0000 7ff71ad9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff71c102dd0 0x7ff71c100a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40284/0 (socket says 172.21.15.148:40284) 2024-09-19T07:09:58.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.828+0000 7ff71ad9d640 1 -- 172.21.15.148:0/3398505911 learned_addr learned my addr 172.21.15.148:0/3398505911 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:09:58.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.828+0000 7ff71a59c640 1 --2- 172.21.15.148:0/3398505911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff71c103780 0x7ff71c100f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:58.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.828+0000 7ff71b59e640 1 --2- 172.21.15.148:0/3398505911 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff71c108300 0x7ff71c1014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:58.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.828+0000 7ff71ad9d640 1 -- 172.21.15.148:0/3398505911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff71c103780 msgr2=0x7ff71c100f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:58.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.828+0000 7ff71ad9d640 1 --2- 172.21.15.148:0/3398505911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff71c103780 0x7ff71c100f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:58.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.828+0000 7ff71ad9d640 1 -- 172.21.15.148:0/3398505911 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff71c108300 msgr2=0x7ff71c1014b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:58.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.828+0000 7ff71ad9d640 1 --2- 172.21.15.148:0/3398505911 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff71c108300 0x7ff71c1014b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:58.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.828+0000 7ff71ad9d640 1 -- 172.21.15.148:0/3398505911 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff71c1a6bd0 con 0x7ff71c102dd0 2024-09-19T07:09:58.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.828+0000 7ff71ad9d640 1 --2- 172.21.15.148:0/3398505911 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff71c102dd0 0x7ff71c100a30 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff70c009a50 tx=0x7ff70c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:58.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.828+0000 7ff703fff640 1 -- 172.21.15.148:0/3398505911 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff70c03f030 con 0x7ff71c102dd0 2024-09-19T07:09:58.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.828+0000 7ff703fff640 1 -- 172.21.15.148:0/3398505911 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff70c003ad0 con 0x7ff71c102dd0 2024-09-19T07:09:58.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.828+0000 7ff721003640 1 -- 172.21.15.148:0/3398505911 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff71c1a6e60 con 0x7ff71c102dd0 2024-09-19T07:09:58.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.829+0000 7ff703fff640 1 -- 172.21.15.148:0/3398505911 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff70c035070 con 0x7ff71c102dd0 2024-09-19T07:09:58.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.829+0000 7ff721003640 1 -- 172.21.15.148:0/3398505911 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff71c1a72b0 con 0x7ff71c102dd0 2024-09-19T07:09:58.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.829+0000 7ff721003640 1 -- 172.21.15.148:0/3398505911 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff71c0628c0 con 0x7ff71c102dd0 2024-09-19T07:09:58.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.831+0000 7ff703fff640 1 -- 172.21.15.148:0/3398505911 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7ff70c042030 con 0x7ff71c102dd0 2024-09-19T07:09:58.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.831+0000 7ff703fff640 1 --2- 172.21.15.148:0/3398505911 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff7040a32d0 0x7ff7040a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:58.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.831+0000 7ff71a59c640 1 --2- 172.21.15.148:0/3398505911 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff7040a32d0 0x7ff7040a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:58.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.831+0000 7ff703fff640 1 -- 172.21.15.148:0/3398505911 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7ff70c0f0560 con 0x7ff71c102dd0 2024-09-19T07:09:58.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.832+0000 7ff703fff640 1 --2- 172.21.15.148:0/3398505911 >> [v2:172.21.15.148:6826/3135409630,v1:172.21.15.148:6827/3135409630] conn(0x7ff7040ace80 0x7ff7040af320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:58.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.832+0000 7ff703fff640 1 -- 172.21.15.148:0/3398505911 --> [v2:172.21.15.148:6826/3135409630,v1:172.21.15.148:6827/3135409630] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff7040af9f0 con 0x7ff7040ace80 2024-09-19T07:09:58.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.832+0000 7ff703fff640 1 -- 172.21.15.148:0/3398505911 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7ff70c0f09b0 con 0x7ff71c102dd0 2024-09-19T07:09:58.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.832+0000 7ff71a59c640 1 --2- 172.21.15.148:0/3398505911 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff7040a32d0 0x7ff7040a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff71c1024c0 tx=0x7ff710009110 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:58.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.832+0000 7ff71b59e640 1 --2- 172.21.15.148:0/3398505911 >> [v2:172.21.15.148:6826/3135409630,v1:172.21.15.148:6827/3135409630] conn(0x7ff7040ace80 0x7ff7040af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:58.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.832+0000 7ff71b59e640 1 --2- 172.21.15.148:0/3398505911 >> [v2:172.21.15.148:6826/3135409630,v1:172.21.15.148:6827/3135409630] conn(0x7ff7040ace80 0x7ff7040af320 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:58.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.833+0000 7ff703fff640 1 -- 172.21.15.148:0/3398505911 <== osd.9 v2:172.21.15.148:6826/3135409630 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff7040af9f0 con 0x7ff7040ace80 2024-09-19T07:09:58.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.846+0000 7ff721003640 1 -- 172.21.15.148:0/3398505911 --> [v2:172.21.15.148:6826/3135409630,v1:172.21.15.148:6827/3135409630] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff71c062cf0 con 0x7ff7040ace80 2024-09-19T07:09:58.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.846+0000 7ff703fff640 1 -- 172.21.15.148:0/3398505911 <== osd.9 v2:172.21.15.148:6826/3135409630 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff71c062cf0 con 0x7ff7040ace80 2024-09-19T07:09:58.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.846+0000 7ff721003640 1 -- 172.21.15.148:0/3398505911 >> [v2:172.21.15.148:6826/3135409630,v1:172.21.15.148:6827/3135409630] conn(0x7ff7040ace80 msgr2=0x7ff7040af320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:58.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.846+0000 7ff721003640 1 --2- 172.21.15.148:0/3398505911 >> [v2:172.21.15.148:6826/3135409630,v1:172.21.15.148:6827/3135409630] conn(0x7ff7040ace80 0x7ff7040af320 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:58.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.847+0000 7ff721003640 1 -- 172.21.15.148:0/3398505911 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff7040a32d0 msgr2=0x7ff7040a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:58.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.847+0000 7ff721003640 1 --2- 172.21.15.148:0/3398505911 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff7040a32d0 0x7ff7040a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff71c1024c0 tx=0x7ff710009110 comp rx=0 tx=0).stop 2024-09-19T07:09:58.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.847+0000 7ff721003640 1 -- 172.21.15.148:0/3398505911 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff71c102dd0 msgr2=0x7ff71c100a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:58.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.847+0000 7ff721003640 1 --2- 172.21.15.148:0/3398505911 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff71c102dd0 0x7ff71c100a30 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff70c009a50 tx=0x7ff70c004270 comp rx=0 tx=0).stop 2024-09-19T07:09:58.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.847+0000 7ff71b59e640 1 -- 172.21.15.148:0/3398505911 reap_dead start 2024-09-19T07:09:58.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.847+0000 7ff721003640 1 -- 172.21.15.148:0/3398505911 shutdown_connections 2024-09-19T07:09:58.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.847+0000 7ff721003640 1 -- 172.21.15.148:0/3398505911 >> 172.21.15.148:0/3398505911 conn(0x7ff71c0fc7d0 msgr2=0x7ff71c105e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:58.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.847+0000 7ff721003640 1 -- 172.21.15.148:0/3398505911 shutdown_connections 2024-09-19T07:09:58.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:58.847+0000 7ff721003640 1 -- 172.21.15.148:0/3398505911 wait complete. 2024-09-19T07:09:59.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.012+0000 7f2cee04c640 1 -- 172.21.15.148:0/964172242 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ce81082a0 msgr2=0x7f2ce810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:59.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.012+0000 7f2cee04c640 1 --2- 172.21.15.148:0/964172242 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ce81082a0 0x7f2ce810ec40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0009cd0 tx=0x7f2ce002a8e0 comp rx=0 tx=0).stop 2024-09-19T07:09:59.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.012+0000 7f2cee04c640 1 -- 172.21.15.148:0/964172242 shutdown_connections 2024-09-19T07:09:59.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.012+0000 7f2cee04c640 1 --2- 172.21.15.148:0/964172242 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ce81082a0 0x7f2ce810ec40 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:59.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.012+0000 7f2cee04c640 1 --2- 172.21.15.148:0/964172242 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ce81036e0 0x7f2ce8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:59.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.012+0000 7f2cee04c640 1 --2- 172.21.15.148:0/964172242 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2ce8102d30 0x7f2ce8103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:59.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.012+0000 7f2cee04c640 1 -- 172.21.15.148:0/964172242 >> 172.21.15.148:0/964172242 conn(0x7f2ce80fc7d0 msgr2=0x7f2ce80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:59.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.012+0000 7f2cee04c640 1 -- 172.21.15.148:0/964172242 shutdown_connections 2024-09-19T07:09:59.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.012+0000 7f2cee04c640 1 -- 172.21.15.148:0/964172242 wait complete. 2024-09-19T07:09:59.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.012+0000 7f2cee04c640 1 Processor -- start 2024-09-19T07:09:59.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.013+0000 7f2cee04c640 1 -- start start 2024-09-19T07:09:59.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.013+0000 7f2cee04c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2ce8102d30 0x7f2ce81985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:59.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.013+0000 7f2cee04c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ce81036e0 0x7f2ce8198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:59.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.013+0000 7f2cee04c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ce81082a0 0x7f2ce819ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:59.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.013+0000 7f2cee04c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce8112120 con 0x7f2ce81036e0 2024-09-19T07:09:59.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.013+0000 7f2cee04c640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce8111fa0 con 0x7f2ce8102d30 2024-09-19T07:09:59.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.013+0000 7f2cee04c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce81122a0 con 0x7f2ce81082a0 2024-09-19T07:09:59.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.013+0000 7f2cdffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ce81036e0 0x7f2ce8198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:59.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.013+0000 7f2cdffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ce81036e0 0x7f2ce8198b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40298/0 (socket says 172.21.15.148:40298) 2024-09-19T07:09:59.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.013+0000 7f2cdffff640 1 -- 172.21.15.148:0/2124812744 learned_addr learned my addr 172.21.15.148:0/2124812744 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:09:59.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.013+0000 7f2ce77fe640 1 --2- 172.21.15.148:0/2124812744 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2ce8102d30 0x7f2ce81985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:59.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.013+0000 7f2ce7fff640 1 --2- 172.21.15.148:0/2124812744 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ce81082a0 0x7f2ce819ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:59.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.013+0000 7f2cdffff640 1 -- 172.21.15.148:0/2124812744 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ce81082a0 msgr2=0x7f2ce819ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:59.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.013+0000 7f2cdffff640 1 --2- 172.21.15.148:0/2124812744 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ce81082a0 0x7f2ce819ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:59.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.013+0000 7f2cdffff640 1 -- 172.21.15.148:0/2124812744 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2ce8102d30 msgr2=0x7f2ce81985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:59.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.013+0000 7f2cdffff640 1 --2- 172.21.15.148:0/2124812744 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2ce8102d30 0x7f2ce81985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:59.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.013+0000 7f2cdffff640 1 -- 172.21.15.148:0/2124812744 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ce819d590 con 0x7f2ce81036e0 2024-09-19T07:09:59.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.013+0000 7f2ce7fff640 1 --2- 172.21.15.148:0/2124812744 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ce81082a0 0x7f2ce819ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:09:59.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.013+0000 7f2ce77fe640 1 --2- 172.21.15.148:0/2124812744 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2ce8102d30 0x7f2ce81985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:09:59.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.013+0000 7f2cdffff640 1 --2- 172.21.15.148:0/2124812744 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ce81036e0 0x7f2ce8198b20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2cd000c970 tx=0x7f2cd000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:59.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.013+0000 7f2ce57fa640 1 -- 172.21.15.148:0/2124812744 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd0004220 con 0x7f2ce81036e0 2024-09-19T07:09:59.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.014+0000 7f2cee04c640 1 -- 172.21.15.148:0/2124812744 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ce819d880 con 0x7f2ce81036e0 2024-09-19T07:09:59.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.014+0000 7f2ce57fa640 1 -- 172.21.15.148:0/2124812744 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cd00043c0 con 0x7f2ce81036e0 2024-09-19T07:09:59.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.014+0000 7f2ce57fa640 1 -- 172.21.15.148:0/2124812744 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd0004a00 con 0x7f2ce81036e0 2024-09-19T07:09:59.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.014+0000 7f2cee04c640 1 -- 172.21.15.148:0/2124812744 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ce81a5160 con 0x7f2ce81036e0 2024-09-19T07:09:59.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.015+0000 7f2cee04c640 1 -- 172.21.15.148:0/2124812744 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2ce8062980 con 0x7f2ce81036e0 2024-09-19T07:09:59.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.016+0000 7f2ce57fa640 1 -- 172.21.15.148:0/2124812744 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f2cd00079b0 con 0x7f2ce81036e0 2024-09-19T07:09:59.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.016+0000 7f2ce57fa640 1 --2- 172.21.15.148:0/2124812744 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f2cd40a32d0 0x7f2cd40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:59.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.016+0000 7f2ce77fe640 1 --2- 172.21.15.148:0/2124812744 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f2cd40a32d0 0x7f2cd40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:59.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.017+0000 7f2ce57fa640 1 -- 172.21.15.148:0/2124812744 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7f2cd00cfc60 con 0x7f2ce81036e0 2024-09-19T07:09:59.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.017+0000 7f2ce57fa640 1 --2- 172.21.15.148:0/2124812744 >> [v2:172.21.15.148:6810/3662789091,v1:172.21.15.148:6811/3662789091] conn(0x7f2cd40ace80 0x7f2cd40af320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:09:59.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.017+0000 7f2ce57fa640 1 -- 172.21.15.148:0/2124812744 --> [v2:172.21.15.148:6810/3662789091,v1:172.21.15.148:6811/3662789091] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2cd0008e50 con 0x7f2cd40ace80 2024-09-19T07:09:59.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.017+0000 7f2ce57fa640 1 -- 172.21.15.148:0/2124812744 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f2cd00d00b0 con 0x7f2ce81036e0 2024-09-19T07:09:59.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.017+0000 7f2ce7fff640 1 --2- 172.21.15.148:0/2124812744 >> [v2:172.21.15.148:6810/3662789091,v1:172.21.15.148:6811/3662789091] conn(0x7f2cd40ace80 0x7f2cd40af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:09:59.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.017+0000 7f2ce77fe640 1 --2- 172.21.15.148:0/2124812744 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f2cd40a32d0 0x7f2cd40a5790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2cd8009930 tx=0x7f2cd8008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:59.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.017+0000 7f2ce7fff640 1 --2- 172.21.15.148:0/2124812744 >> [v2:172.21.15.148:6810/3662789091,v1:172.21.15.148:6811/3662789091] conn(0x7f2cd40ace80 0x7f2cd40af320 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:09:59.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.018+0000 7f2ce57fa640 1 -- 172.21.15.148:0/2124812744 <== osd.3 v2:172.21.15.148:6810/3662789091 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2cd0008e50 con 0x7f2cd40ace80 2024-09-19T07:09:59.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.031+0000 7f2cee04c640 1 -- 172.21.15.148:0/2124812744 --> [v2:172.21.15.148:6810/3662789091,v1:172.21.15.148:6811/3662789091] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2ce8062e00 con 0x7f2cd40ace80 2024-09-19T07:09:59.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.031+0000 7f2ce57fa640 1 -- 172.21.15.148:0/2124812744 <== osd.3 v2:172.21.15.148:6810/3662789091 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2ce8062e00 con 0x7f2cd40ace80 2024-09-19T07:09:59.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.032+0000 7f2cee04c640 1 -- 172.21.15.148:0/2124812744 >> [v2:172.21.15.148:6810/3662789091,v1:172.21.15.148:6811/3662789091] conn(0x7f2cd40ace80 msgr2=0x7f2cd40af320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:59.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.032+0000 7f2cee04c640 1 --2- 172.21.15.148:0/2124812744 >> [v2:172.21.15.148:6810/3662789091,v1:172.21.15.148:6811/3662789091] conn(0x7f2cd40ace80 0x7f2cd40af320 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:09:59.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.032+0000 7f2cee04c640 1 -- 172.21.15.148:0/2124812744 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f2cd40a32d0 msgr2=0x7f2cd40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:59.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.032+0000 7f2cee04c640 1 --2- 172.21.15.148:0/2124812744 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f2cd40a32d0 0x7f2cd40a5790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2cd8009930 tx=0x7f2cd8008040 comp rx=0 tx=0).stop 2024-09-19T07:09:59.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.032+0000 7f2cee04c640 1 -- 172.21.15.148:0/2124812744 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ce81036e0 msgr2=0x7f2ce8198b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:09:59.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.032+0000 7f2cee04c640 1 --2- 172.21.15.148:0/2124812744 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ce81036e0 0x7f2ce8198b20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2cd000c970 tx=0x7f2cd000ce30 comp rx=0 tx=0).stop 2024-09-19T07:09:59.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.032+0000 7f2ce7fff640 1 -- 172.21.15.148:0/2124812744 reap_dead start 2024-09-19T07:09:59.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.032+0000 7f2cee04c640 1 -- 172.21.15.148:0/2124812744 shutdown_connections 2024-09-19T07:09:59.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.032+0000 7f2cee04c640 1 -- 172.21.15.148:0/2124812744 >> 172.21.15.148:0/2124812744 conn(0x7f2ce80fc7d0 msgr2=0x7f2ce8105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:09:59.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.032+0000 7f2cee04c640 1 -- 172.21.15.148:0/2124812744 shutdown_connections 2024-09-19T07:09:59.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:09:59.032+0000 7f2cee04c640 1 -- 172.21.15.148:0/2124812744 wait complete. 2024-09-19T07:09:59.941 INFO:teuthology.orchestra.run.smithi148.stdout:98784247868 2024-09-19T07:09:59.942 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-19T07:10:00.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.147+0000 7fae8a59b640 1 -- 172.21.15.148:0/1170621176 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fae84101de0 msgr2=0x7fae841021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:00.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.147+0000 7fae8a59b640 1 --2- 172.21.15.148:0/1170621176 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fae84101de0 0x7fae841021c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fae74009900 tx=0x7fae7402a410 comp rx=0 tx=0).stop 2024-09-19T07:10:00.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.147+0000 7fae8a59b640 1 -- 172.21.15.148:0/1170621176 shutdown_connections 2024-09-19T07:10:00.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.147+0000 7fae8a59b640 1 --2- 172.21.15.148:0/1170621176 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fae84106f10 0x7fae8410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:00.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.147+0000 7fae8a59b640 1 --2- 172.21.15.148:0/1170621176 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae84102790 0x7fae841067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:00.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.147+0000 7fae8a59b640 1 --2- 172.21.15.148:0/1170621176 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fae84101de0 0x7fae841021c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:00.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.147+0000 7fae8a59b640 1 -- 172.21.15.148:0/1170621176 >> 172.21.15.148:0/1170621176 conn(0x7fae840fd8c0 msgr2=0x7fae840ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:00.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.147+0000 7fae8a59b640 1 -- 172.21.15.148:0/1170621176 shutdown_connections 2024-09-19T07:10:00.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.147+0000 7fae8a59b640 1 -- 172.21.15.148:0/1170621176 wait complete. 2024-09-19T07:10:00.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.147+0000 7fae8a59b640 1 Processor -- start 2024-09-19T07:10:00.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.147+0000 7fae8a59b640 1 -- start start 2024-09-19T07:10:00.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.148+0000 7fae8a59b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fae84101de0 0x7fae84198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:00.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.148+0000 7fae8a59b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae84102790 0x7fae841989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:00.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.148+0000 7fae8a59b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fae84106f10 0x7fae8419cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:00.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.148+0000 7fae8a59b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fae84111f70 con 0x7fae84106f10 2024-09-19T07:10:00.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.148+0000 7fae8a59b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fae84111df0 con 0x7fae84101de0 2024-09-19T07:10:00.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.148+0000 7fae8a59b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fae841120f0 con 0x7fae84102790 2024-09-19T07:10:00.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.148+0000 7fae88b38640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fae84106f10 0x7fae8419cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:00.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.148+0000 7fae88b38640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fae84106f10 0x7fae8419cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40314/0 (socket says 172.21.15.148:40314) 2024-09-19T07:10:00.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.148+0000 7fae88b38640 1 -- 172.21.15.148:0/700459275 learned_addr learned my addr 172.21.15.148:0/700459275 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:00.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.148+0000 7fae7bfff640 1 --2- 172.21.15.148:0/700459275 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae84102790 0x7fae841989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:00.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.148+0000 7fae83fff640 1 --2- 172.21.15.148:0/700459275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fae84101de0 0x7fae84198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:00.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.148+0000 7fae88b38640 1 -- 172.21.15.148:0/700459275 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae84102790 msgr2=0x7fae841989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:00.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.148+0000 7fae88b38640 1 --2- 172.21.15.148:0/700459275 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae84102790 0x7fae841989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:00.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.148+0000 7fae88b38640 1 -- 172.21.15.148:0/700459275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fae84101de0 msgr2=0x7fae84198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:00.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.148+0000 7fae88b38640 1 --2- 172.21.15.148:0/700459275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fae84101de0 0x7fae84198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:00.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.148+0000 7fae88b38640 1 -- 172.21.15.148:0/700459275 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae8419d420 con 0x7fae84106f10 2024-09-19T07:10:00.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.148+0000 7fae83fff640 1 --2- 172.21.15.148:0/700459275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fae84101de0 0x7fae84198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:10:00.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.148+0000 7fae88b38640 1 --2- 172.21.15.148:0/700459275 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fae84106f10 0x7fae8419cd40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fae7c00eaa0 tx=0x7fae7c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:00.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.148+0000 7fae81ffb640 1 -- 172.21.15.148:0/700459275 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae7c00cdb0 con 0x7fae84106f10 2024-09-19T07:10:00.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.148+0000 7fae8a59b640 1 -- 172.21.15.148:0/700459275 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae8419d710 con 0x7fae84106f10 2024-09-19T07:10:00.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.148+0000 7fae8a59b640 1 -- 172.21.15.148:0/700459275 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae841a4ff0 con 0x7fae84106f10 2024-09-19T07:10:00.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.148+0000 7fae81ffb640 1 -- 172.21.15.148:0/700459275 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae7c005020 con 0x7fae84106f10 2024-09-19T07:10:00.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.148+0000 7fae81ffb640 1 -- 172.21.15.148:0/700459275 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae7c01f060 con 0x7fae84106f10 2024-09-19T07:10:00.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.149+0000 7fae8a59b640 1 -- 172.21.15.148:0/700459275 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fae84062940 con 0x7fae84106f10 2024-09-19T07:10:00.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.151+0000 7fae81ffb640 1 -- 172.21.15.148:0/700459275 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fae7c0051d0 con 0x7fae84106f10 2024-09-19T07:10:00.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.151+0000 7fae81ffb640 1 --2- 172.21.15.148:0/700459275 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fae700a32d0 0x7fae700a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:00.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.151+0000 7fae83fff640 1 --2- 172.21.15.148:0/700459275 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fae700a32d0 0x7fae700a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:00.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.151+0000 7fae81ffb640 1 -- 172.21.15.148:0/700459275 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7fae7c0cfc70 con 0x7fae84106f10 2024-09-19T07:10:00.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.152+0000 7fae81ffb640 1 --2- 172.21.15.148:0/700459275 >> [v2:172.21.15.148:6818/2178980310,v1:172.21.15.148:6819/2178980310] conn(0x7fae700ace80 0x7fae700af320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:00.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.152+0000 7fae81ffb640 1 -- 172.21.15.148:0/700459275 --> [v2:172.21.15.148:6818/2178980310,v1:172.21.15.148:6819/2178980310] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fae700af9f0 con 0x7fae700ace80 2024-09-19T07:10:00.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.152+0000 7fae7bfff640 1 --2- 172.21.15.148:0/700459275 >> [v2:172.21.15.148:6818/2178980310,v1:172.21.15.148:6819/2178980310] conn(0x7fae700ace80 0x7fae700af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:00.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.152+0000 7fae83fff640 1 --2- 172.21.15.148:0/700459275 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fae700a32d0 0x7fae700a5790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fae74005ab0 tx=0x7fae74005a20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:00.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.152+0000 7fae7bfff640 1 --2- 172.21.15.148:0/700459275 >> [v2:172.21.15.148:6818/2178980310,v1:172.21.15.148:6819/2178980310] conn(0x7fae700ace80 0x7fae700af320 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:00.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.153+0000 7fae81ffb640 1 -- 172.21.15.148:0/700459275 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fae7c0983e0 con 0x7fae84106f10 2024-09-19T07:10:00.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.153+0000 7fae81ffb640 1 -- 172.21.15.148:0/700459275 <== osd.6 v2:172.21.15.148:6818/2178980310 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fae700af9f0 con 0x7fae700ace80 2024-09-19T07:10:00.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.167+0000 7fae8a59b640 1 -- 172.21.15.148:0/700459275 --> [v2:172.21.15.148:6818/2178980310,v1:172.21.15.148:6819/2178980310] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fae84062df0 con 0x7fae700ace80 2024-09-19T07:10:00.169 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:00 smithi148 ceph-mon[31180]: pgmap v291: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-19T07:10:00.170 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:00 smithi148 ceph-mon[31180]: overall HEALTH_OK 2024-09-19T07:10:00.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.168+0000 7fae81ffb640 1 -- 172.21.15.148:0/700459275 <== osd.6 v2:172.21.15.148:6818/2178980310 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fae84062df0 con 0x7fae700ace80 2024-09-19T07:10:00.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.169+0000 7fae8a59b640 1 -- 172.21.15.148:0/700459275 >> [v2:172.21.15.148:6818/2178980310,v1:172.21.15.148:6819/2178980310] conn(0x7fae700ace80 msgr2=0x7fae700af320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:00.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.169+0000 7fae8a59b640 1 --2- 172.21.15.148:0/700459275 >> [v2:172.21.15.148:6818/2178980310,v1:172.21.15.148:6819/2178980310] conn(0x7fae700ace80 0x7fae700af320 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:00.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.169+0000 7fae8a59b640 1 -- 172.21.15.148:0/700459275 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fae700a32d0 msgr2=0x7fae700a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:00.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.169+0000 7fae8a59b640 1 --2- 172.21.15.148:0/700459275 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fae700a32d0 0x7fae700a5790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fae74005ab0 tx=0x7fae74005a20 comp rx=0 tx=0).stop 2024-09-19T07:10:00.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.169+0000 7fae8a59b640 1 -- 172.21.15.148:0/700459275 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fae84106f10 msgr2=0x7fae8419cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:00.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.169+0000 7fae8a59b640 1 --2- 172.21.15.148:0/700459275 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fae84106f10 0x7fae8419cd40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fae7c00eaa0 tx=0x7fae7c00ef60 comp rx=0 tx=0).stop 2024-09-19T07:10:00.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.169+0000 7fae88b38640 1 -- 172.21.15.148:0/700459275 reap_dead start 2024-09-19T07:10:00.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.169+0000 7fae8a59b640 1 -- 172.21.15.148:0/700459275 shutdown_connections 2024-09-19T07:10:00.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.169+0000 7fae8a59b640 1 -- 172.21.15.148:0/700459275 >> 172.21.15.148:0/700459275 conn(0x7fae840fd8c0 msgr2=0x7fae840fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:00.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.169+0000 7fae8a59b640 1 -- 172.21.15.148:0/700459275 shutdown_connections 2024-09-19T07:10:00.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.169+0000 7fae8a59b640 1 -- 172.21.15.148:0/700459275 wait complete. 2024-09-19T07:10:00.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.353+0000 7f0c00cb3640 1 -- 172.21.15.148:0/3360734835 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bfc106a80 msgr2=0x7f0bfc106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:00.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.353+0000 7f0c00cb3640 1 --2- 172.21.15.148:0/3360734835 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bfc106a80 0x7f0bfc106e60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0bec009930 tx=0x7f0bec02a420 comp rx=0 tx=0).stop 2024-09-19T07:10:00.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.353+0000 7f0c00cb3640 1 -- 172.21.15.148:0/3360734835 shutdown_connections 2024-09-19T07:10:00.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.353+0000 7f0c00cb3640 1 --2- 172.21.15.148:0/3360734835 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0bfc101420 0x7f0bfc10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:00.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.353+0000 7f0c00cb3640 1 --2- 172.21.15.148:0/3360734835 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0bfc100a80 0x7f0bfc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:00.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.353+0000 7f0c00cb3640 1 --2- 172.21.15.148:0/3360734835 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bfc106a80 0x7f0bfc106e60 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:00.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.353+0000 7f0c00cb3640 1 -- 172.21.15.148:0/3360734835 >> 172.21.15.148:0/3360734835 conn(0x7f0bfc0fc7a0 msgr2=0x7f0bfc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:00.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.353+0000 7f0c00cb3640 1 -- 172.21.15.148:0/3360734835 shutdown_connections 2024-09-19T07:10:00.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.354+0000 7f0c00cb3640 1 -- 172.21.15.148:0/3360734835 wait complete. 2024-09-19T07:10:00.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.354+0000 7f0c00cb3640 1 Processor -- start 2024-09-19T07:10:00.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.354+0000 7f0c00cb3640 1 -- start start 2024-09-19T07:10:00.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.355+0000 7f0c00cb3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bfc100a80 0x7f0bfc197400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:00.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.355+0000 7f0c00cb3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0bfc101420 0x7f0bfc197940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:00.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.355+0000 7f0c00cb3640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0bfc106a80 0x7f0bfc19bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:00.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.355+0000 7f0c00cb3640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0bfc110ea0 con 0x7f0bfc100a80 2024-09-19T07:10:00.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.355+0000 7f0c00cb3640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0bfc110d20 con 0x7f0bfc106a80 2024-09-19T07:10:00.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.355+0000 7f0c00cb3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0bfc111020 con 0x7f0bfc101420 2024-09-19T07:10:00.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.355+0000 7f0bfa59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bfc100a80 0x7f0bfc197400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:00.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.355+0000 7f0bfa59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bfc100a80 0x7f0bfc197400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40328/0 (socket says 172.21.15.148:40328) 2024-09-19T07:10:00.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.355+0000 7f0bfa59c640 1 -- 172.21.15.148:0/1830954717 learned_addr learned my addr 172.21.15.148:0/1830954717 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:00.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.355+0000 7f0bfad9d640 1 --2- 172.21.15.148:0/1830954717 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0bfc106a80 0x7f0bfc19bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:00.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.355+0000 7f0bf9d9b640 1 --2- 172.21.15.148:0/1830954717 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0bfc101420 0x7f0bfc197940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:00.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.355+0000 7f0bfa59c640 1 -- 172.21.15.148:0/1830954717 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0bfc101420 msgr2=0x7f0bfc197940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:00.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.355+0000 7f0bfa59c640 1 --2- 172.21.15.148:0/1830954717 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0bfc101420 0x7f0bfc197940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:00.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.355+0000 7f0bfa59c640 1 -- 172.21.15.148:0/1830954717 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0bfc106a80 msgr2=0x7f0bfc19bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:00.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.355+0000 7f0bfa59c640 1 --2- 172.21.15.148:0/1830954717 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0bfc106a80 0x7f0bfc19bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:00.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.355+0000 7f0bfa59c640 1 -- 172.21.15.148:0/1830954717 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bfc19c3b0 con 0x7f0bfc100a80 2024-09-19T07:10:00.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.355+0000 7f0bfad9d640 1 --2- 172.21.15.148:0/1830954717 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0bfc106a80 0x7f0bfc19bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:10:00.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.355+0000 7f0bf9d9b640 1 --2- 172.21.15.148:0/1830954717 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0bfc101420 0x7f0bfc197940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:10:00.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.355+0000 7f0bfa59c640 1 --2- 172.21.15.148:0/1830954717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bfc100a80 0x7f0bfc197400 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0bec009a50 tx=0x7f0bec004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:00.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.355+0000 7f0beb7fe640 1 -- 172.21.15.148:0/1830954717 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bec03f030 con 0x7f0bfc100a80 2024-09-19T07:10:00.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.355+0000 7f0c00cb3640 1 -- 172.21.15.148:0/1830954717 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bfc19c640 con 0x7f0bfc100a80 2024-09-19T07:10:00.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.355+0000 7f0beb7fe640 1 -- 172.21.15.148:0/1830954717 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0bec003ce0 con 0x7f0bfc100a80 2024-09-19T07:10:00.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.355+0000 7f0beb7fe640 1 -- 172.21.15.148:0/1830954717 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bec035070 con 0x7f0bfc100a80 2024-09-19T07:10:00.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.355+0000 7f0c00cb3640 1 -- 172.21.15.148:0/1830954717 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bfc1a3f80 con 0x7f0bfc100a80 2024-09-19T07:10:00.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.356+0000 7f0c00cb3640 1 -- 172.21.15.148:0/1830954717 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0bfc062980 con 0x7f0bfc100a80 2024-09-19T07:10:00.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.358+0000 7f0beb7fe640 1 -- 172.21.15.148:0/1830954717 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f0bec042030 con 0x7f0bfc100a80 2024-09-19T07:10:00.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.358+0000 7f0beb7fe640 1 --2- 172.21.15.148:0/1830954717 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f0be40a32d0 0x7f0be40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:00.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.358+0000 7f0bf9d9b640 1 --2- 172.21.15.148:0/1830954717 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f0be40a32d0 0x7f0be40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:00.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.358+0000 7f0beb7fe640 1 -- 172.21.15.148:0/1830954717 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7f0bec0f0540 con 0x7f0bfc100a80 2024-09-19T07:10:00.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.358+0000 7f0beb7fe640 1 --2- 172.21.15.148:0/1830954717 >> [v2:172.21.15.165:6808/3082550323,v1:172.21.15.165:6809/3082550323] conn(0x7f0be40ace80 0x7f0be40af320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:00.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.358+0000 7f0beb7fe640 1 -- 172.21.15.148:0/1830954717 --> [v2:172.21.15.165:6808/3082550323,v1:172.21.15.165:6809/3082550323] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0bec046e50 con 0x7f0be40ace80 2024-09-19T07:10:00.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.358+0000 7f0beb7fe640 1 -- 172.21.15.148:0/1830954717 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f0bec0f0990 con 0x7f0bfc100a80 2024-09-19T07:10:00.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.359+0000 7f0bf9d9b640 1 --2- 172.21.15.148:0/1830954717 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f0be40a32d0 0x7f0be40a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc0fedd0 tx=0x7f0bf0008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:00.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.359+0000 7f0bfad9d640 1 --2- 172.21.15.148:0/1830954717 >> [v2:172.21.15.165:6808/3082550323,v1:172.21.15.165:6809/3082550323] conn(0x7f0be40ace80 0x7f0be40af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:00.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.359+0000 7f0bfad9d640 1 --2- 172.21.15.148:0/1830954717 >> [v2:172.21.15.165:6808/3082550323,v1:172.21.15.165:6809/3082550323] conn(0x7f0be40ace80 0x7f0be40af320 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:00.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.360+0000 7f0beb7fe640 1 -- 172.21.15.148:0/1830954717 <== osd.4 v2:172.21.15.165:6808/3082550323 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0bec046e50 con 0x7f0be40ace80 2024-09-19T07:10:00.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.373+0000 7f0c00cb3640 1 -- 172.21.15.148:0/1830954717 --> [v2:172.21.15.165:6808/3082550323,v1:172.21.15.165:6809/3082550323] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0bfc062d80 con 0x7f0be40ace80 2024-09-19T07:10:00.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.374+0000 7f0beb7fe640 1 -- 172.21.15.148:0/1830954717 <== osd.4 v2:172.21.15.165:6808/3082550323 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0bfc062d80 con 0x7f0be40ace80 2024-09-19T07:10:00.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.374+0000 7f0c00cb3640 1 -- 172.21.15.148:0/1830954717 >> [v2:172.21.15.165:6808/3082550323,v1:172.21.15.165:6809/3082550323] conn(0x7f0be40ace80 msgr2=0x7f0be40af320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:00.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.374+0000 7f0c00cb3640 1 --2- 172.21.15.148:0/1830954717 >> [v2:172.21.15.165:6808/3082550323,v1:172.21.15.165:6809/3082550323] conn(0x7f0be40ace80 0x7f0be40af320 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:00.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.374+0000 7f0c00cb3640 1 -- 172.21.15.148:0/1830954717 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f0be40a32d0 msgr2=0x7f0be40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:00.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.374+0000 7f0c00cb3640 1 --2- 172.21.15.148:0/1830954717 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f0be40a32d0 0x7f0be40a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc0fedd0 tx=0x7f0bf0008040 comp rx=0 tx=0).stop 2024-09-19T07:10:00.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.374+0000 7f0c00cb3640 1 -- 172.21.15.148:0/1830954717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bfc100a80 msgr2=0x7f0bfc197400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:00.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.374+0000 7f0c00cb3640 1 --2- 172.21.15.148:0/1830954717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bfc100a80 0x7f0bfc197400 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0bec009a50 tx=0x7f0bec004270 comp rx=0 tx=0).stop 2024-09-19T07:10:00.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.374+0000 7f0bfad9d640 1 -- 172.21.15.148:0/1830954717 reap_dead start 2024-09-19T07:10:00.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.374+0000 7f0c00cb3640 1 -- 172.21.15.148:0/1830954717 shutdown_connections 2024-09-19T07:10:00.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.374+0000 7f0c00cb3640 1 -- 172.21.15.148:0/1830954717 >> 172.21.15.148:0/1830954717 conn(0x7f0bfc0fc7a0 msgr2=0x7f0bfc0fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:00.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.374+0000 7f0c00cb3640 1 -- 172.21.15.148:0/1830954717 shutdown_connections 2024-09-19T07:10:00.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:00.374+0000 7f0c00cb3640 1 -- 172.21.15.148:0/1830954717 wait complete. 2024-09-19T07:10:00.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:00 smithi179 ceph-mon[35716]: pgmap v291: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-19T07:10:00.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:00 smithi179 ceph-mon[35716]: overall HEALTH_OK 2024-09-19T07:10:00.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:00 smithi165 ceph-mon[35326]: pgmap v291: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-19T07:10:00.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:00 smithi165 ceph-mon[35326]: overall HEALTH_OK 2024-09-19T07:10:01.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:01 smithi148 ceph-mon[31180]: pgmap v292: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-19T07:10:01.382 INFO:teuthology.orchestra.run.smithi148.stdout:176093659182 2024-09-19T07:10:01.382 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-19T07:10:01.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:01 smithi179 ceph-mon[35716]: pgmap v292: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-19T07:10:01.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:01 smithi165 ceph-mon[35326]: pgmap v292: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-19T07:10:01.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.835+0000 7f96959eb640 1 -- 172.21.15.148:0/3620516043 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9690100a70 msgr2=0x7f9690100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:01.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.835+0000 7f96959eb640 1 --2- 172.21.15.148:0/3620516043 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9690100a70 0x7f9690100ed0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9678009930 tx=0x7f967802a420 comp rx=0 tx=0).stop 2024-09-19T07:10:01.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.835+0000 7f96959eb640 1 -- 172.21.15.148:0/3620516043 shutdown_connections 2024-09-19T07:10:01.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.835+0000 7f96959eb640 1 --2- 172.21.15.148:0/3620516043 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9690101410 0x7f969010d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:01.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.835+0000 7f96959eb640 1 --2- 172.21.15.148:0/3620516043 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9690100a70 0x7f9690100ed0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:01.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.835+0000 7f96959eb640 1 --2- 172.21.15.148:0/3620516043 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9690106a70 0x7f9690106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:01.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.835+0000 7f96959eb640 1 -- 172.21.15.148:0/3620516043 >> 172.21.15.148:0/3620516043 conn(0x7f96900fc790 msgr2=0x7f96900febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:01.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.835+0000 7f96959eb640 1 -- 172.21.15.148:0/3620516043 shutdown_connections 2024-09-19T07:10:01.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.835+0000 7f96959eb640 1 -- 172.21.15.148:0/3620516043 wait complete. 2024-09-19T07:10:01.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.835+0000 7f96959eb640 1 Processor -- start 2024-09-19T07:10:01.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.836+0000 7f96959eb640 1 -- start start 2024-09-19T07:10:01.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.836+0000 7f96959eb640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9690100a70 0x7f96901992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:01.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.836+0000 7f96959eb640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9690101410 0x7f9690199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:01.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.836+0000 7f96959eb640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9690106a70 0x7f96901a4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:01.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.836+0000 7f96959eb640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9690110e70 con 0x7f9690101410 2024-09-19T07:10:01.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.836+0000 7f96959eb640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9690110cf0 con 0x7f9690106a70 2024-09-19T07:10:01.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.836+0000 7f96959eb640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9690110ff0 con 0x7f9690100a70 2024-09-19T07:10:01.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.836+0000 7f968e7fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9690101410 0x7f9690199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:01.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.836+0000 7f968e7fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9690101410 0x7f9690199820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40342/0 (socket says 172.21.15.148:40342) 2024-09-19T07:10:01.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.836+0000 7f968e7fc640 1 -- 172.21.15.148:0/3335356689 learned_addr learned my addr 172.21.15.148:0/3335356689 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:01.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.836+0000 7f968f7fe640 1 --2- 172.21.15.148:0/3335356689 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9690106a70 0x7f96901a4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:01.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.836+0000 7f968effd640 1 --2- 172.21.15.148:0/3335356689 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9690100a70 0x7f96901992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:01.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.836+0000 7f968e7fc640 1 -- 172.21.15.148:0/3335356689 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9690100a70 msgr2=0x7f96901992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:01.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.836+0000 7f968e7fc640 1 --2- 172.21.15.148:0/3335356689 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9690100a70 0x7f96901992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:01.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.836+0000 7f968e7fc640 1 -- 172.21.15.148:0/3335356689 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9690106a70 msgr2=0x7f96901a4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:01.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.836+0000 7f968e7fc640 1 --2- 172.21.15.148:0/3335356689 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9690106a70 0x7f96901a4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:01.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.836+0000 7f968e7fc640 1 -- 172.21.15.148:0/3335356689 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96901a48a0 con 0x7f9690101410 2024-09-19T07:10:01.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.836+0000 7f968e7fc640 1 --2- 172.21.15.148:0/3335356689 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9690101410 0x7f9690199820 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9678009230 tx=0x7f9678004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:01.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.837+0000 7f96949e9640 1 -- 172.21.15.148:0/3335356689 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f967803f030 con 0x7f9690101410 2024-09-19T07:10:01.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.837+0000 7f96949e9640 1 -- 172.21.15.148:0/3335356689 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9678003ad0 con 0x7f9690101410 2024-09-19T07:10:01.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.837+0000 7f96959eb640 1 -- 172.21.15.148:0/3335356689 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96901a4a70 con 0x7f9690101410 2024-09-19T07:10:01.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.837+0000 7f96949e9640 1 -- 172.21.15.148:0/3335356689 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9678035070 con 0x7f9690101410 2024-09-19T07:10:01.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.837+0000 7f96959eb640 1 -- 172.21.15.148:0/3335356689 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96901a4f20 con 0x7f9690101410 2024-09-19T07:10:01.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.838+0000 7f96959eb640 1 -- 172.21.15.148:0/3335356689 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9690062900 con 0x7f9690101410 2024-09-19T07:10:01.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.839+0000 7f96949e9640 1 -- 172.21.15.148:0/3335356689 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f9678042030 con 0x7f9690101410 2024-09-19T07:10:01.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.840+0000 7f96949e9640 1 --2- 172.21.15.148:0/3335356689 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f967c0a3350 0x7f967c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:01.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.840+0000 7f96949e9640 1 -- 172.21.15.148:0/3335356689 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7f96780efe70 con 0x7f9690101410 2024-09-19T07:10:01.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.840+0000 7f968effd640 1 --2- 172.21.15.148:0/3335356689 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f967c0a3350 0x7f967c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:01.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.840+0000 7f96949e9640 1 --2- 172.21.15.148:0/3335356689 >> [v2:172.21.15.179:6816/3642931467,v1:172.21.15.179:6817/3642931467] conn(0x7f967c0acf00 0x7f967c0af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:01.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.840+0000 7f96949e9640 1 -- 172.21.15.148:0/3335356689 --> [v2:172.21.15.179:6816/3642931467,v1:172.21.15.179:6817/3642931467] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f967c0afa70 con 0x7f967c0acf00 2024-09-19T07:10:01.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.840+0000 7f96949e9640 1 -- 172.21.15.148:0/3335356689 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f96780f2530 con 0x7f9690101410 2024-09-19T07:10:01.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.840+0000 7f968effd640 1 --2- 172.21.15.148:0/3335356689 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f967c0a3350 0x7f967c0a5810 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f96800058c0 tx=0x7f968000a250 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:01.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.840+0000 7f968f7fe640 1 --2- 172.21.15.148:0/3335356689 >> [v2:172.21.15.179:6816/3642931467,v1:172.21.15.179:6817/3642931467] conn(0x7f967c0acf00 0x7f967c0af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:01.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.841+0000 7f968f7fe640 1 --2- 172.21.15.148:0/3335356689 >> [v2:172.21.15.179:6816/3642931467,v1:172.21.15.179:6817/3642931467] conn(0x7f967c0acf00 0x7f967c0af3a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:01.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.841+0000 7f96949e9640 1 -- 172.21.15.148:0/3335356689 <== osd.8 v2:172.21.15.179:6816/3642931467 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f967c0afa70 con 0x7f967c0acf00 2024-09-19T07:10:01.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.856+0000 7f96959eb640 1 -- 172.21.15.148:0/3335356689 --> [v2:172.21.15.179:6816/3642931467,v1:172.21.15.179:6817/3642931467] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9690062db0 con 0x7f967c0acf00 2024-09-19T07:10:01.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.857+0000 7f96949e9640 1 -- 172.21.15.148:0/3335356689 <== osd.8 v2:172.21.15.179:6816/3642931467 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9690062db0 con 0x7f967c0acf00 2024-09-19T07:10:01.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.857+0000 7f96959eb640 1 -- 172.21.15.148:0/3335356689 >> [v2:172.21.15.179:6816/3642931467,v1:172.21.15.179:6817/3642931467] conn(0x7f967c0acf00 msgr2=0x7f967c0af3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:01.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.857+0000 7f96959eb640 1 --2- 172.21.15.148:0/3335356689 >> [v2:172.21.15.179:6816/3642931467,v1:172.21.15.179:6817/3642931467] conn(0x7f967c0acf00 0x7f967c0af3a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:01.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.857+0000 7f96959eb640 1 -- 172.21.15.148:0/3335356689 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f967c0a3350 msgr2=0x7f967c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:01.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.857+0000 7f96959eb640 1 --2- 172.21.15.148:0/3335356689 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f967c0a3350 0x7f967c0a5810 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f96800058c0 tx=0x7f968000a250 comp rx=0 tx=0).stop 2024-09-19T07:10:01.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.857+0000 7f96959eb640 1 -- 172.21.15.148:0/3335356689 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9690101410 msgr2=0x7f9690199820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:01.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.857+0000 7f96959eb640 1 --2- 172.21.15.148:0/3335356689 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9690101410 0x7f9690199820 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9678009230 tx=0x7f9678004270 comp rx=0 tx=0).stop 2024-09-19T07:10:01.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.857+0000 7f968f7fe640 1 -- 172.21.15.148:0/3335356689 reap_dead start 2024-09-19T07:10:01.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.857+0000 7f96959eb640 1 -- 172.21.15.148:0/3335356689 shutdown_connections 2024-09-19T07:10:01.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.857+0000 7f96959eb640 1 -- 172.21.15.148:0/3335356689 >> 172.21.15.148:0/3335356689 conn(0x7f96900fc790 msgr2=0x7f96900fd030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:01.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.857+0000 7f96959eb640 1 -- 172.21.15.148:0/3335356689 shutdown_connections 2024-09-19T07:10:01.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:01.857+0000 7f96959eb640 1 -- 172.21.15.148:0/3335356689 wait complete. 2024-09-19T07:10:02.180 INFO:teuthology.orchestra.run.smithi148.stdout:73014444097 2024-09-19T07:10:02.180 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-19T07:10:02.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.700+0000 7ff4cd34b640 1 -- 172.21.15.148:0/39705536 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4c8106f10 msgr2=0x7ff4c810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:02.702 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.700+0000 7ff4cd34b640 1 --2- 172.21.15.148:0/39705536 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4c8106f10 0x7ff4c810ea90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0009ca0 tx=0x7ff4c002a8c0 comp rx=0 tx=0).stop 2024-09-19T07:10:02.702 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.700+0000 7ff4cd34b640 1 -- 172.21.15.148:0/39705536 shutdown_connections 2024-09-19T07:10:02.702 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.700+0000 7ff4cd34b640 1 --2- 172.21.15.148:0/39705536 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4c8106f10 0x7ff4c810ea90 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:02.702 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.700+0000 7ff4cd34b640 1 --2- 172.21.15.148:0/39705536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4c8102790 0x7ff4c81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:02.702 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.700+0000 7ff4cd34b640 1 --2- 172.21.15.148:0/39705536 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff4c8101de0 0x7ff4c81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:02.702 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.700+0000 7ff4cd34b640 1 -- 172.21.15.148:0/39705536 >> 172.21.15.148:0/39705536 conn(0x7ff4c80fd8c0 msgr2=0x7ff4c80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:02.702 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.700+0000 7ff4cd34b640 1 -- 172.21.15.148:0/39705536 shutdown_connections 2024-09-19T07:10:02.702 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.700+0000 7ff4cd34b640 1 -- 172.21.15.148:0/39705536 wait complete. 2024-09-19T07:10:02.702 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.701+0000 7ff4cd34b640 1 Processor -- start 2024-09-19T07:10:02.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.701+0000 7ff4cd34b640 1 -- start start 2024-09-19T07:10:02.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.701+0000 7ff4cd34b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4c8101de0 0x7ff4c80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:02.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.701+0000 7ff4cd34b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff4c8102790 0x7ff4c8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:02.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.701+0000 7ff4cd34b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4c8106f10 0x7ff4c8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:02.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.701+0000 7ff4cd34b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c8111f70 con 0x7ff4c8101de0 2024-09-19T07:10:02.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.701+0000 7ff4cd34b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c8111df0 con 0x7ff4c8102790 2024-09-19T07:10:02.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.701+0000 7ff4cd34b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c81120f0 con 0x7ff4c8106f10 2024-09-19T07:10:02.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.701+0000 7ff4c6ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4c8101de0 0x7ff4c80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:02.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.701+0000 7ff4c6ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4c8101de0 0x7ff4c80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40362/0 (socket says 172.21.15.148:40362) 2024-09-19T07:10:02.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.701+0000 7ff4c6ffd640 1 -- 172.21.15.148:0/1168617404 learned_addr learned my addr 172.21.15.148:0/1168617404 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:02.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.702+0000 7ff4be7fc640 1 --2- 172.21.15.148:0/1168617404 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff4c8102790 0x7ff4c8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:02.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.702+0000 7ff4c6ffd640 1 -- 172.21.15.148:0/1168617404 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4c8106f10 msgr2=0x7ff4c8074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:02.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.702+0000 7ff4c6ffd640 1 --2- 172.21.15.148:0/1168617404 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4c8106f10 0x7ff4c8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:02.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.702+0000 7ff4c6ffd640 1 -- 172.21.15.148:0/1168617404 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff4c8102790 msgr2=0x7ff4c8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:02.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.702+0000 7ff4c6ffd640 1 --2- 172.21.15.148:0/1168617404 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff4c8102790 0x7ff4c8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:02.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.702+0000 7ff4c6ffd640 1 -- 172.21.15.148:0/1168617404 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4c81a68b0 con 0x7ff4c8101de0 2024-09-19T07:10:02.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.702+0000 7ff4be7fc640 1 --2- 172.21.15.148:0/1168617404 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff4c8102790 0x7ff4c8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:10:02.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.702+0000 7ff4c6ffd640 1 --2- 172.21.15.148:0/1168617404 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4c8101de0 0x7ff4c80744f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff4b800d950 tx=0x7ff4b800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:02.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.702+0000 7ff4c4ff9640 1 -- 172.21.15.148:0/1168617404 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b8017030 con 0x7ff4c8101de0 2024-09-19T07:10:02.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.702+0000 7ff4cd34b640 1 -- 172.21.15.148:0/1168617404 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4c81a6ba0 con 0x7ff4c8101de0 2024-09-19T07:10:02.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.702+0000 7ff4c4ff9640 1 -- 172.21.15.148:0/1168617404 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4b8004020 con 0x7ff4c8101de0 2024-09-19T07:10:02.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.702+0000 7ff4c4ff9640 1 -- 172.21.15.148:0/1168617404 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b80047a0 con 0x7ff4c8101de0 2024-09-19T07:10:02.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.702+0000 7ff4cd34b640 1 -- 172.21.15.148:0/1168617404 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4c81a7130 con 0x7ff4c8101de0 2024-09-19T07:10:02.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.703+0000 7ff4cd34b640 1 -- 172.21.15.148:0/1168617404 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff4c80628c0 con 0x7ff4c8101de0 2024-09-19T07:10:02.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.704+0000 7ff4c4ff9640 1 -- 172.21.15.148:0/1168617404 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7ff4b80041d0 con 0x7ff4c8101de0 2024-09-19T07:10:02.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.705+0000 7ff4c4ff9640 1 --2- 172.21.15.148:0/1168617404 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff4b40a32d0 0x7ff4b40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:02.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.705+0000 7ff4be7fc640 1 --2- 172.21.15.148:0/1168617404 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff4b40a32d0 0x7ff4b40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:02.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.705+0000 7ff4c4ff9640 1 -- 172.21.15.148:0/1168617404 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7ff4b80cfbf0 con 0x7ff4c8101de0 2024-09-19T07:10:02.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.705+0000 7ff4c4ff9640 1 --2- 172.21.15.148:0/1168617404 >> [v2:172.21.15.165:6816/3961600099,v1:172.21.15.165:6817/3961600099] conn(0x7ff4b40ace80 0x7ff4b40af320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:02.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.705+0000 7ff4c4ff9640 1 -- 172.21.15.148:0/1168617404 --> [v2:172.21.15.165:6816/3961600099,v1:172.21.15.165:6817/3961600099] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff4b8021e70 con 0x7ff4b40ace80 2024-09-19T07:10:02.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.705+0000 7ff4c4ff9640 1 -- 172.21.15.148:0/1168617404 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7ff4b80d0040 con 0x7ff4c8101de0 2024-09-19T07:10:02.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.705+0000 7ff4be7fc640 1 --2- 172.21.15.148:0/1168617404 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff4b40a32d0 0x7ff4b40a5790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0005fd0 tx=0x7ff4b000b5d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:02.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.706+0000 7ff4c77fe640 1 --2- 172.21.15.148:0/1168617404 >> [v2:172.21.15.165:6816/3961600099,v1:172.21.15.165:6817/3961600099] conn(0x7ff4b40ace80 0x7ff4b40af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:02.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.706+0000 7ff4c77fe640 1 --2- 172.21.15.148:0/1168617404 >> [v2:172.21.15.165:6816/3961600099,v1:172.21.15.165:6817/3961600099] conn(0x7ff4b40ace80 0x7ff4b40af320 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:02.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.707+0000 7ff4c4ff9640 1 -- 172.21.15.148:0/1168617404 <== osd.7 v2:172.21.15.165:6816/3961600099 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff4b8021e70 con 0x7ff4b40ace80 2024-09-19T07:10:02.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.720+0000 7ff4cd34b640 1 -- 172.21.15.148:0/1168617404 --> [v2:172.21.15.165:6816/3961600099,v1:172.21.15.165:6817/3961600099] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff4c8062cf0 con 0x7ff4b40ace80 2024-09-19T07:10:02.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.721+0000 7ff4c4ff9640 1 -- 172.21.15.148:0/1168617404 <== osd.7 v2:172.21.15.165:6816/3961600099 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff4c8062cf0 con 0x7ff4b40ace80 2024-09-19T07:10:02.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.721+0000 7ff4cd34b640 1 -- 172.21.15.148:0/1168617404 >> [v2:172.21.15.165:6816/3961600099,v1:172.21.15.165:6817/3961600099] conn(0x7ff4b40ace80 msgr2=0x7ff4b40af320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:02.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.721+0000 7ff4cd34b640 1 --2- 172.21.15.148:0/1168617404 >> [v2:172.21.15.165:6816/3961600099,v1:172.21.15.165:6817/3961600099] conn(0x7ff4b40ace80 0x7ff4b40af320 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:02.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.721+0000 7ff4cd34b640 1 -- 172.21.15.148:0/1168617404 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff4b40a32d0 msgr2=0x7ff4b40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:02.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.721+0000 7ff4cd34b640 1 --2- 172.21.15.148:0/1168617404 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff4b40a32d0 0x7ff4b40a5790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0005fd0 tx=0x7ff4b000b5d0 comp rx=0 tx=0).stop 2024-09-19T07:10:02.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.721+0000 7ff4cd34b640 1 -- 172.21.15.148:0/1168617404 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4c8101de0 msgr2=0x7ff4c80744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:02.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.721+0000 7ff4cd34b640 1 --2- 172.21.15.148:0/1168617404 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4c8101de0 0x7ff4c80744f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff4b800d950 tx=0x7ff4b800de10 comp rx=0 tx=0).stop 2024-09-19T07:10:02.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.721+0000 7ff4c77fe640 1 -- 172.21.15.148:0/1168617404 reap_dead start 2024-09-19T07:10:02.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.721+0000 7ff4cd34b640 1 -- 172.21.15.148:0/1168617404 shutdown_connections 2024-09-19T07:10:02.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.721+0000 7ff4cd34b640 1 -- 172.21.15.148:0/1168617404 >> 172.21.15.148:0/1168617404 conn(0x7ff4c80fd8c0 msgr2=0x7ff4c80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:02.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.721+0000 7ff4cd34b640 1 -- 172.21.15.148:0/1168617404 shutdown_connections 2024-09-19T07:10:02.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:02.721+0000 7ff4cd34b640 1 -- 172.21.15.148:0/1168617404 wait complete. 2024-09-19T07:10:03.981 INFO:teuthology.orchestra.run.smithi148.stdout:227633266724 2024-09-19T07:10:03.981 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-19T07:10:04.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.120+0000 7efd31d5a640 1 -- 172.21.15.148:0/156515685 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd2c1012d0 msgr2=0x7efd2c10df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:04.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.120+0000 7efd31d5a640 1 --2- 172.21.15.148:0/156515685 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd2c1012d0 0x7efd2c10df90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7efd14009900 tx=0x7efd1402a410 comp rx=0 tx=0).stop 2024-09-19T07:10:04.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.120+0000 7efd31d5a640 1 -- 172.21.15.148:0/156515685 shutdown_connections 2024-09-19T07:10:04.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.120+0000 7efd31d5a640 1 --2- 172.21.15.148:0/156515685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd2c10e4d0 0x7efd2c1108c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:04.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.120+0000 7efd31d5a640 1 --2- 172.21.15.148:0/156515685 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd2c1012d0 0x7efd2c10df90 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:04.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.120+0000 7efd31d5a640 1 --2- 172.21.15.148:0/156515685 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd2c100920 0x7efd2c100d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:04.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.120+0000 7efd31d5a640 1 -- 172.21.15.148:0/156515685 >> 172.21.15.148:0/156515685 conn(0x7efd2c0fc790 msgr2=0x7efd2c0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:04.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.120+0000 7efd31d5a640 1 -- 172.21.15.148:0/156515685 shutdown_connections 2024-09-19T07:10:04.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.120+0000 7efd31d5a640 1 -- 172.21.15.148:0/156515685 wait complete. 2024-09-19T07:10:04.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.121+0000 7efd31d5a640 1 Processor -- start 2024-09-19T07:10:04.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.121+0000 7efd31d5a640 1 -- start start 2024-09-19T07:10:04.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.121+0000 7efd31d5a640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd2c100920 0x7efd2c19a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:04.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.121+0000 7efd31d5a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd2c1012d0 0x7efd2c19ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:04.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.121+0000 7efd31d5a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd2c10e4d0 0x7efd2c19ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:04.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.121+0000 7efd31d5a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c114150 con 0x7efd2c1012d0 2024-09-19T07:10:04.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.121+0000 7efd31d5a640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c113fd0 con 0x7efd2c100920 2024-09-19T07:10:04.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.121+0000 7efd31d5a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c1142d0 con 0x7efd2c10e4d0 2024-09-19T07:10:04.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.121+0000 7efd23fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd2c1012d0 0x7efd2c19ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:04.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.121+0000 7efd23fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd2c1012d0 0x7efd2c19ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40378/0 (socket says 172.21.15.148:40378) 2024-09-19T07:10:04.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.121+0000 7efd23fff640 1 -- 172.21.15.148:0/2226829117 learned_addr learned my addr 172.21.15.148:0/2226829117 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:04.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.121+0000 7efd2b7fe640 1 --2- 172.21.15.148:0/2226829117 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd2c100920 0x7efd2c19a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:04.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.121+0000 7efd2bfff640 1 --2- 172.21.15.148:0/2226829117 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd2c10e4d0 0x7efd2c19ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:04.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.121+0000 7efd23fff640 1 -- 172.21.15.148:0/2226829117 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd2c10e4d0 msgr2=0x7efd2c19ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:04.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.121+0000 7efd23fff640 1 --2- 172.21.15.148:0/2226829117 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd2c10e4d0 0x7efd2c19ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:04.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.121+0000 7efd23fff640 1 -- 172.21.15.148:0/2226829117 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd2c100920 msgr2=0x7efd2c19a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:04.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.121+0000 7efd23fff640 1 --2- 172.21.15.148:0/2226829117 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd2c100920 0x7efd2c19a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:04.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.121+0000 7efd23fff640 1 -- 172.21.15.148:0/2226829117 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd2c19f600 con 0x7efd2c1012d0 2024-09-19T07:10:04.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.122+0000 7efd23fff640 1 --2- 172.21.15.148:0/2226829117 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd2c1012d0 0x7efd2c19ab90 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7efd14005ab0 tx=0x7efd140042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:04.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.122+0000 7efd297fa640 1 -- 172.21.15.148:0/2226829117 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd1403f030 con 0x7efd2c1012d0 2024-09-19T07:10:04.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.122+0000 7efd297fa640 1 -- 172.21.15.148:0/2226829117 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd14003ce0 con 0x7efd2c1012d0 2024-09-19T07:10:04.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.122+0000 7efd31d5a640 1 -- 172.21.15.148:0/2226829117 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd2c19f890 con 0x7efd2c1012d0 2024-09-19T07:10:04.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.122+0000 7efd297fa640 1 -- 172.21.15.148:0/2226829117 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd14035070 con 0x7efd2c1012d0 2024-09-19T07:10:04.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.122+0000 7efd31d5a640 1 -- 172.21.15.148:0/2226829117 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd2c1a71d0 con 0x7efd2c1012d0 2024-09-19T07:10:04.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.123+0000 7efd31d5a640 1 -- 172.21.15.148:0/2226829117 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efd2c062980 con 0x7efd2c1012d0 2024-09-19T07:10:04.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.124+0000 7efd297fa640 1 -- 172.21.15.148:0/2226829117 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7efd14042030 con 0x7efd2c1012d0 2024-09-19T07:10:04.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.125+0000 7efd297fa640 1 --2- 172.21.15.148:0/2226829117 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7efd180a3350 0x7efd180a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:04.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.125+0000 7efd297fa640 1 -- 172.21.15.148:0/2226829117 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7efd140f0520 con 0x7efd2c1012d0 2024-09-19T07:10:04.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.125+0000 7efd2b7fe640 1 --2- 172.21.15.148:0/2226829117 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7efd180a3350 0x7efd180a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:04.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.125+0000 7efd297fa640 1 --2- 172.21.15.148:0/2226829117 >> [v2:172.21.15.165:6824/3554110731,v1:172.21.15.165:6825/3554110731] conn(0x7efd180acf00 0x7efd180af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:04.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.125+0000 7efd297fa640 1 -- 172.21.15.148:0/2226829117 --> [v2:172.21.15.165:6824/3554110731,v1:172.21.15.165:6825/3554110731] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efd14001d30 con 0x7efd180acf00 2024-09-19T07:10:04.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.125+0000 7efd297fa640 1 -- 172.21.15.148:0/2226829117 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7efd140f0970 con 0x7efd2c1012d0 2024-09-19T07:10:04.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.125+0000 7efd2b7fe640 1 --2- 172.21.15.148:0/2226829117 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7efd180a3350 0x7efd180a5810 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efd1c0058c0 tx=0x7efd1c00a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:04.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.125+0000 7efd2bfff640 1 --2- 172.21.15.148:0/2226829117 >> [v2:172.21.15.165:6824/3554110731,v1:172.21.15.165:6825/3554110731] conn(0x7efd180acf00 0x7efd180af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:04.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.126+0000 7efd2bfff640 1 --2- 172.21.15.148:0/2226829117 >> [v2:172.21.15.165:6824/3554110731,v1:172.21.15.165:6825/3554110731] conn(0x7efd180acf00 0x7efd180af3a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:04.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.127+0000 7efd297fa640 1 -- 172.21.15.148:0/2226829117 <== osd.10 v2:172.21.15.165:6824/3554110731 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efd14001d30 con 0x7efd180acf00 2024-09-19T07:10:04.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.142+0000 7efd31d5a640 1 -- 172.21.15.148:0/2226829117 --> [v2:172.21.15.165:6824/3554110731,v1:172.21.15.165:6825/3554110731] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efd2c062d80 con 0x7efd180acf00 2024-09-19T07:10:04.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.142+0000 7efd297fa640 1 -- 172.21.15.148:0/2226829117 <== osd.10 v2:172.21.15.165:6824/3554110731 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7efd2c062d80 con 0x7efd180acf00 2024-09-19T07:10:04.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.143+0000 7efd31d5a640 1 -- 172.21.15.148:0/2226829117 >> [v2:172.21.15.165:6824/3554110731,v1:172.21.15.165:6825/3554110731] conn(0x7efd180acf00 msgr2=0x7efd180af3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:04.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.143+0000 7efd31d5a640 1 --2- 172.21.15.148:0/2226829117 >> [v2:172.21.15.165:6824/3554110731,v1:172.21.15.165:6825/3554110731] conn(0x7efd180acf00 0x7efd180af3a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:04.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.143+0000 7efd31d5a640 1 -- 172.21.15.148:0/2226829117 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7efd180a3350 msgr2=0x7efd180a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:04.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.143+0000 7efd31d5a640 1 --2- 172.21.15.148:0/2226829117 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7efd180a3350 0x7efd180a5810 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efd1c0058c0 tx=0x7efd1c00a2d0 comp rx=0 tx=0).stop 2024-09-19T07:10:04.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.143+0000 7efd31d5a640 1 -- 172.21.15.148:0/2226829117 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd2c1012d0 msgr2=0x7efd2c19ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:04.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.143+0000 7efd31d5a640 1 --2- 172.21.15.148:0/2226829117 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd2c1012d0 0x7efd2c19ab90 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7efd14005ab0 tx=0x7efd140042f0 comp rx=0 tx=0).stop 2024-09-19T07:10:04.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.143+0000 7efd2bfff640 1 -- 172.21.15.148:0/2226829117 reap_dead start 2024-09-19T07:10:04.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.143+0000 7efd31d5a640 1 -- 172.21.15.148:0/2226829117 shutdown_connections 2024-09-19T07:10:04.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.143+0000 7efd31d5a640 1 -- 172.21.15.148:0/2226829117 >> 172.21.15.148:0/2226829117 conn(0x7efd2c0fc790 msgr2=0x7efd2c0feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:04.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.143+0000 7efd31d5a640 1 -- 172.21.15.148:0/2226829117 shutdown_connections 2024-09-19T07:10:04.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:04.143+0000 7efd31d5a640 1 -- 172.21.15.148:0/2226829117 wait complete. 2024-09-19T07:10:04.240 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:04 smithi148 ceph-mon[31180]: pgmap v293: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T07:10:04.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:04 smithi179 ceph-mon[35716]: pgmap v293: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T07:10:04.576 INFO:teuthology.orchestra.run.smithi148.stdout:34359738443 2024-09-19T07:10:04.577 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-19T07:10:04.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:04 smithi165 ceph-mon[35326]: pgmap v293: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T07:10:04.954 INFO:teuthology.orchestra.run.smithi148.stdout:51539607622 2024-09-19T07:10:04.955 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-19T07:10:05.290 INFO:teuthology.orchestra.run.smithi148.stdout:257698037791 2024-09-19T07:10:05.291 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-19T07:10:05.948 INFO:teuthology.orchestra.run.smithi148.stdout:128849018936 2024-09-19T07:10:05.948 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-19T07:10:06.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:06 smithi148 ceph-mon[31180]: pgmap v294: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T07:10:06.375 INFO:teuthology.orchestra.run.smithi148.stdout:197568495657 2024-09-19T07:10:06.376 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-19T07:10:06.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:06 smithi179 ceph-mon[35716]: pgmap v294: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T07:10:06.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:06 smithi165 ceph-mon[35326]: pgmap v294: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T07:10:06.840 INFO:teuthology.orchestra.run.smithi148.stdout:279172874266 2024-09-19T07:10:06.841 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-19T07:10:07.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.041+0000 7fd6b8d42640 1 -- 172.21.15.148:0/2154687475 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6b4100e30 msgr2=0x7fd6b4104e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:07.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.041+0000 7fd6b8d42640 1 --2- 172.21.15.148:0/2154687475 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6b4100e30 0x7fd6b4104e80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd69c00aa10 tx=0x7fd69c02b720 comp rx=0 tx=0).stop 2024-09-19T07:10:07.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.041+0000 7fd6b8d42640 1 -- 172.21.15.148:0/2154687475 shutdown_connections 2024-09-19T07:10:07.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.041+0000 7fd6b8d42640 1 --2- 172.21.15.148:0/2154687475 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd6b41055b0 0x7fd6b410d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:07.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.041+0000 7fd6b8d42640 1 --2- 172.21.15.148:0/2154687475 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6b4100e30 0x7fd6b4104e80 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:07.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.041+0000 7fd6b8d42640 1 --2- 172.21.15.148:0/2154687475 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd6b4100480 0x7fd6b4100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:07.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.041+0000 7fd6b8d42640 1 -- 172.21.15.148:0/2154687475 >> 172.21.15.148:0/2154687475 conn(0x7fd6b4077210 msgr2=0x7fd6b40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:07.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.041+0000 7fd6b8d42640 1 -- 172.21.15.148:0/2154687475 shutdown_connections 2024-09-19T07:10:07.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.041+0000 7fd6b8d42640 1 -- 172.21.15.148:0/2154687475 wait complete. 2024-09-19T07:10:07.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.041+0000 7fd6b8d42640 1 Processor -- start 2024-09-19T07:10:07.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.041+0000 7fd6b8d42640 1 -- start start 2024-09-19T07:10:07.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.042+0000 7fd6b8d42640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6b4100480 0x7fd6b41983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:07.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.042+0000 7fd6b8d42640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd6b4100e30 0x7fd6b4198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:07.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.042+0000 7fd6b8d42640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd6b41055b0 0x7fd6b419ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:07.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.042+0000 7fd6b8d42640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b410fd60 con 0x7fd6b4100480 2024-09-19T07:10:07.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.042+0000 7fd6b8d42640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b410fbe0 con 0x7fd6b41055b0 2024-09-19T07:10:07.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.042+0000 7fd6b8d42640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b410fee0 con 0x7fd6b4100e30 2024-09-19T07:10:07.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.042+0000 7fd6b259c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6b4100480 0x7fd6b41983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:07.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.042+0000 7fd6b259c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6b4100480 0x7fd6b41983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44364/0 (socket says 172.21.15.148:44364) 2024-09-19T07:10:07.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.042+0000 7fd6b259c640 1 -- 172.21.15.148:0/999265074 learned_addr learned my addr 172.21.15.148:0/999265074 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:07.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.042+0000 7fd6abfff640 1 --2- 172.21.15.148:0/999265074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd6b4100e30 0x7fd6b4198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:07.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.042+0000 7fd6b259c640 1 -- 172.21.15.148:0/999265074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd6b4100e30 msgr2=0x7fd6b4198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:07.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.042+0000 7fd6b259c640 1 --2- 172.21.15.148:0/999265074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd6b4100e30 0x7fd6b4198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:07.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.042+0000 7fd6b2d9d640 1 --2- 172.21.15.148:0/999265074 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd6b41055b0 0x7fd6b419ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:07.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.042+0000 7fd6b259c640 1 -- 172.21.15.148:0/999265074 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd6b41055b0 msgr2=0x7fd6b419ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:07.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.042+0000 7fd6b259c640 1 --2- 172.21.15.148:0/999265074 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd6b41055b0 0x7fd6b419ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:07.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.042+0000 7fd6b259c640 1 -- 172.21.15.148:0/999265074 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6b419d3a0 con 0x7fd6b4100480 2024-09-19T07:10:07.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.042+0000 7fd6abfff640 1 --2- 172.21.15.148:0/999265074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd6b4100e30 0x7fd6b4198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:10:07.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.042+0000 7fd6b2d9d640 1 --2- 172.21.15.148:0/999265074 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd6b41055b0 0x7fd6b419ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:10:07.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.042+0000 7fd6b259c640 1 --2- 172.21.15.148:0/999265074 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6b4100480 0x7fd6b41983f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd6a400c920 tx=0x7fd6a400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:07.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.042+0000 7fd6ab7fe640 1 -- 172.21.15.148:0/999265074 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a4007c70 con 0x7fd6b4100480 2024-09-19T07:10:07.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.042+0000 7fd6ab7fe640 1 -- 172.21.15.148:0/999265074 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6a4007e10 con 0x7fd6b4100480 2024-09-19T07:10:07.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.042+0000 7fd6b8d42640 1 -- 172.21.15.148:0/999265074 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6b419d690 con 0x7fd6b4100480 2024-09-19T07:10:07.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.042+0000 7fd6ab7fe640 1 -- 172.21.15.148:0/999265074 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a4018890 con 0x7fd6b4100480 2024-09-19T07:10:07.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.042+0000 7fd6b8d42640 1 -- 172.21.15.148:0/999265074 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6b41a4f70 con 0x7fd6b4100480 2024-09-19T07:10:07.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.043+0000 7fd6b8d42640 1 -- 172.21.15.148:0/999265074 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd6b4062900 con 0x7fd6b4100480 2024-09-19T07:10:07.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.045+0000 7fd6ab7fe640 1 -- 172.21.15.148:0/999265074 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fd6a4018a30 con 0x7fd6b4100480 2024-09-19T07:10:07.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.045+0000 7fd6ab7fe640 1 --2- 172.21.15.148:0/999265074 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fd6a00a3350 0x7fd6a00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:07.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.045+0000 7fd6abfff640 1 --2- 172.21.15.148:0/999265074 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fd6a00a3350 0x7fd6a00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:07.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.045+0000 7fd6ab7fe640 1 -- 172.21.15.148:0/999265074 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7fd6a40d0020 con 0x7fd6b4100480 2024-09-19T07:10:07.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.046+0000 7fd6ab7fe640 1 --2- 172.21.15.148:0/999265074 >> [v2:172.21.15.179:6824/2026109940,v1:172.21.15.179:6825/2026109940] conn(0x7fd6a00acf00 0x7fd6a00af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:07.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.046+0000 7fd6ab7fe640 1 -- 172.21.15.148:0/999265074 --> [v2:172.21.15.179:6824/2026109940,v1:172.21.15.179:6825/2026109940] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd6a00afa70 con 0x7fd6a00acf00 2024-09-19T07:10:07.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.046+0000 7fd6ab7fe640 1 -- 172.21.15.148:0/999265074 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fd6a40d0470 con 0x7fd6b4100480 2024-09-19T07:10:07.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.046+0000 7fd6b2d9d640 1 --2- 172.21.15.148:0/999265074 >> [v2:172.21.15.179:6824/2026109940,v1:172.21.15.179:6825/2026109940] conn(0x7fd6a00acf00 0x7fd6a00af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:07.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.046+0000 7fd6abfff640 1 --2- 172.21.15.148:0/999265074 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fd6a00a3350 0x7fd6a00a5810 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4102d90 tx=0x7fd69c005a20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:07.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.046+0000 7fd6b2d9d640 1 --2- 172.21.15.148:0/999265074 >> [v2:172.21.15.179:6824/2026109940,v1:172.21.15.179:6825/2026109940] conn(0x7fd6a00acf00 0x7fd6a00af3a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:07.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.047+0000 7fd6ab7fe640 1 -- 172.21.15.148:0/999265074 <== osd.11 v2:172.21.15.179:6824/2026109940 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd6a00afa70 con 0x7fd6a00acf00 2024-09-19T07:10:07.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.064+0000 7fd6b8d42640 1 -- 172.21.15.148:0/999265074 --> [v2:172.21.15.179:6824/2026109940,v1:172.21.15.179:6825/2026109940] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd6b4062d00 con 0x7fd6a00acf00 2024-09-19T07:10:07.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.067+0000 7fd6ab7fe640 1 -- 172.21.15.148:0/999265074 <== osd.11 v2:172.21.15.179:6824/2026109940 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd6b4062d00 con 0x7fd6a00acf00 2024-09-19T07:10:07.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.068+0000 7fd6b8d42640 1 -- 172.21.15.148:0/999265074 >> [v2:172.21.15.179:6824/2026109940,v1:172.21.15.179:6825/2026109940] conn(0x7fd6a00acf00 msgr2=0x7fd6a00af3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:07.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.068+0000 7fd6b8d42640 1 --2- 172.21.15.148:0/999265074 >> [v2:172.21.15.179:6824/2026109940,v1:172.21.15.179:6825/2026109940] conn(0x7fd6a00acf00 0x7fd6a00af3a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:07.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.069+0000 7fd6b8d42640 1 -- 172.21.15.148:0/999265074 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fd6a00a3350 msgr2=0x7fd6a00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:07.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.069+0000 7fd6b8d42640 1 --2- 172.21.15.148:0/999265074 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fd6a00a3350 0x7fd6a00a5810 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4102d90 tx=0x7fd69c005a20 comp rx=0 tx=0).stop 2024-09-19T07:10:07.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.069+0000 7fd6b8d42640 1 -- 172.21.15.148:0/999265074 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6b4100480 msgr2=0x7fd6b41983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:07.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.069+0000 7fd6b8d42640 1 --2- 172.21.15.148:0/999265074 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6b4100480 0x7fd6b41983f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd6a400c920 tx=0x7fd6a400cde0 comp rx=0 tx=0).stop 2024-09-19T07:10:07.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.069+0000 7fd6b2d9d640 1 -- 172.21.15.148:0/999265074 reap_dead start 2024-09-19T07:10:07.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.070+0000 7fd6b8d42640 1 -- 172.21.15.148:0/999265074 shutdown_connections 2024-09-19T07:10:07.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.070+0000 7fd6b8d42640 1 -- 172.21.15.148:0/999265074 >> 172.21.15.148:0/999265074 conn(0x7fd6b4077210 msgr2=0x7fd6b4103da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:07.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.077+0000 7fd6b8d42640 1 -- 172.21.15.148:0/999265074 shutdown_connections 2024-09-19T07:10:07.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:07.078+0000 7fd6b8d42640 1 -- 172.21.15.148:0/999265074 wait complete. 2024-09-19T07:10:07.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:07 smithi148 ceph-mon[31180]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T07:10:07.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:07 smithi179 ceph-mon[35716]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T07:10:07.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:07 smithi165 ceph-mon[35326]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T07:10:07.879 INFO:teuthology.orchestra.run.smithi148.stdout:309237645335 2024-09-19T07:10:07.880 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-19T07:10:07.981 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:10:07.983 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:10:07.983 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:10:07.984 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:10:07.996 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:10:07.996 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:10:08.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:08.830+0000 7f7806ca4640 1 -- 172.21.15.148:0/2804443639 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7800101420 msgr2=0x7f780010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:08.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:08.830+0000 7f7806ca4640 1 --2- 172.21.15.148:0/2804443639 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7800101420 0x7f780010d950 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f77f8009cd0 tx=0x7f77f802a8e0 comp rx=0 tx=0).stop 2024-09-19T07:10:08.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:08.830+0000 7f7806ca4640 1 -- 172.21.15.148:0/2804443639 shutdown_connections 2024-09-19T07:10:08.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:08.830+0000 7f7806ca4640 1 --2- 172.21.15.148:0/2804443639 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7800101420 0x7f780010d950 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:08.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:08.830+0000 7f7806ca4640 1 --2- 172.21.15.148:0/2804443639 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7800100a80 0x7f7800100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:08.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:08.830+0000 7f7806ca4640 1 --2- 172.21.15.148:0/2804443639 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7800106a80 0x7f7800106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:08.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:08.830+0000 7f7806ca4640 1 -- 172.21.15.148:0/2804443639 >> 172.21.15.148:0/2804443639 conn(0x7f78000fc7a0 msgr2=0x7f78000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:08.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:08.830+0000 7f7806ca4640 1 -- 172.21.15.148:0/2804443639 shutdown_connections 2024-09-19T07:10:08.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:08.830+0000 7f7806ca4640 1 -- 172.21.15.148:0/2804443639 wait complete. 2024-09-19T07:10:08.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:08.831+0000 7f7806ca4640 1 Processor -- start 2024-09-19T07:10:08.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:08.831+0000 7f7806ca4640 1 -- start start 2024-09-19T07:10:08.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:08.831+0000 7f7806ca4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7800100a80 0x7f7800197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:08.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:08.831+0000 7f7806ca4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7800101420 0x7f7800197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:08.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:08.831+0000 7f7806ca4640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7800106a80 0x7f780019bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:08.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:08.831+0000 7f7806ca4640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7800110e80 con 0x7f7800100a80 2024-09-19T07:10:08.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:08.831+0000 7f7806ca4640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7800110d00 con 0x7f7800106a80 2024-09-19T07:10:08.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:08.831+0000 7f7806ca4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7800111000 con 0x7f7800101420 2024-09-19T07:10:08.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:08.831+0000 7f7804a40640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7800100a80 0x7f7800197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:08.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:08.831+0000 7f7804a40640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7800100a80 0x7f7800197300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44386/0 (socket says 172.21.15.148:44386) 2024-09-19T07:10:08.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:08.831+0000 7f7804a40640 1 -- 172.21.15.148:0/2341458590 learned_addr learned my addr 172.21.15.148:0/2341458590 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:08.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:08.831+0000 7f77fffff640 1 --2- 172.21.15.148:0/2341458590 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7800101420 0x7f7800197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:08.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:08.831+0000 7f7804a40640 1 -- 172.21.15.148:0/2341458590 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7800101420 msgr2=0x7f7800197840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:08.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:08.831+0000 7f7804a40640 1 --2- 172.21.15.148:0/2341458590 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7800101420 0x7f7800197840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:08.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:08.831+0000 7f7804a40640 1 -- 172.21.15.148:0/2341458590 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7800106a80 msgr2=0x7f780019bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:08.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:08.831+0000 7f7804a40640 1 --2- 172.21.15.148:0/2341458590 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7800106a80 0x7f780019bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:08.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:08.831+0000 7f7804a40640 1 -- 172.21.15.148:0/2341458590 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f780019c2b0 con 0x7f7800100a80 2024-09-19T07:10:08.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:08.832+0000 7f7804a40640 1 --2- 172.21.15.148:0/2341458590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7800100a80 0x7f7800197300 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f77f400d770 tx=0x7f77f400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:08.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:08.832+0000 7f77fdffb640 1 -- 172.21.15.148:0/2341458590 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f4017070 con 0x7f7800100a80 2024-09-19T07:10:08.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:08.832+0000 7f77fdffb640 1 -- 172.21.15.148:0/2341458590 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77f4005500 con 0x7f7800100a80 2024-09-19T07:10:08.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:08.832+0000 7f7806ca4640 1 -- 172.21.15.148:0/2341458590 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f780019c5a0 con 0x7f7800100a80 2024-09-19T07:10:08.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:08.832+0000 7f77fdffb640 1 -- 172.21.15.148:0/2341458590 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f4004e00 con 0x7f7800100a80 2024-09-19T07:10:08.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:08.832+0000 7f7806ca4640 1 -- 172.21.15.148:0/2341458590 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78001a3e80 con 0x7f7800100a80 2024-09-19T07:10:08.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:08.833+0000 7f7806ca4640 1 -- 172.21.15.148:0/2341458590 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7800100ee0 con 0x7f7800100a80 2024-09-19T07:10:08.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:08.834+0000 7f77fdffb640 1 -- 172.21.15.148:0/2341458590 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f77f4004fa0 con 0x7f7800100a80 2024-09-19T07:10:08.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:08.835+0000 7f77fdffb640 1 --2- 172.21.15.148:0/2341458590 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f77f00a32d0 0x7f77f00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:08.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:08.835+0000 7f77fffff640 1 --2- 172.21.15.148:0/2341458590 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f77f00a32d0 0x7f77f00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:08.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:08.835+0000 7f77fdffb640 1 -- 172.21.15.148:0/2341458590 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7f77f40cf4b0 con 0x7f7800100a80 2024-09-19T07:10:08.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:08.835+0000 7f77fffff640 1 --2- 172.21.15.148:0/2341458590 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f77f00a32d0 0x7f77f00a5790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f78000fed40 tx=0x7f77ec00b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:08.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:08.839+0000 7f77fdffb640 1 -- 172.21.15.148:0/2341458590 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f77f409c080 con 0x7f7800100a80 2024-09-19T07:10:09.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.012+0000 7f7806ca4640 1 -- 172.21.15.148:0/2341458590 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f7800198660 con 0x7f7800100a80 2024-09-19T07:10:09.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.013+0000 7f77fdffb640 1 -- 172.21.15.148:0/2341458590 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f77f409b980 con 0x7f7800100a80 2024-09-19T07:10:09.014 INFO:teuthology.orchestra.run.smithi148.stdout:128849018937 2024-09-19T07:10:09.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.015+0000 7f7806ca4640 1 -- 172.21.15.148:0/2341458590 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f77f00a32d0 msgr2=0x7f77f00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:09.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.015+0000 7f7806ca4640 1 --2- 172.21.15.148:0/2341458590 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f77f00a32d0 0x7f77f00a5790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f78000fed40 tx=0x7f77ec00b410 comp rx=0 tx=0).stop 2024-09-19T07:10:09.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.015+0000 7f7806ca4640 1 -- 172.21.15.148:0/2341458590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7800100a80 msgr2=0x7f7800197300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:09.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.015+0000 7f7806ca4640 1 --2- 172.21.15.148:0/2341458590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7800100a80 0x7f7800197300 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f77f400d770 tx=0x7f77f400dc30 comp rx=0 tx=0).stop 2024-09-19T07:10:09.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.015+0000 7f7806ca4640 1 -- 172.21.15.148:0/2341458590 shutdown_connections 2024-09-19T07:10:09.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.015+0000 7f7806ca4640 1 --2- 172.21.15.148:0/2341458590 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f77f00a32d0 0x7f77f00a5790 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:09.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.015+0000 7f7806ca4640 1 --2- 172.21.15.148:0/2341458590 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7800106a80 0x7f780019bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:09.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.015+0000 7f7806ca4640 1 --2- 172.21.15.148:0/2341458590 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7800101420 0x7f7800197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:09.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.015+0000 7f7806ca4640 1 --2- 172.21.15.148:0/2341458590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7800100a80 0x7f7800197300 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:09.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.015+0000 7f7806ca4640 1 -- 172.21.15.148:0/2341458590 >> 172.21.15.148:0/2341458590 conn(0x7f78000fc7a0 msgr2=0x7f78000fcec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:09.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.015+0000 7f7806ca4640 1 -- 172.21.15.148:0/2341458590 shutdown_connections 2024-09-19T07:10:09.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.015+0000 7f7806ca4640 1 -- 172.21.15.148:0/2341458590 wait complete. 2024-09-19T07:10:09.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.058+0000 7fdf40880640 1 -- 172.21.15.148:0/825446095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf3c102ef0 msgr2=0x7fdf3c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:09.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.058+0000 7fdf40880640 1 --2- 172.21.15.148:0/825446095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf3c102ef0 0x7fdf3c10da40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fdf34009ca0 tx=0x7fdf3402a950 comp rx=0 tx=0).stop 2024-09-19T07:10:09.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.059+0000 7fdf40880640 1 -- 172.21.15.148:0/825446095 shutdown_connections 2024-09-19T07:10:09.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.059+0000 7fdf40880640 1 --2- 172.21.15.148:0/825446095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf3c102ef0 0x7fdf3c10da40 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:09.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.059+0000 7fdf40880640 1 --2- 172.21.15.148:0/825446095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf3c102570 0x7fdf3c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:09.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.059+0000 7fdf40880640 1 --2- 172.21.15.148:0/825446095 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdf3c100e20 0x7fdf3c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:09.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.059+0000 7fdf40880640 1 -- 172.21.15.148:0/825446095 >> 172.21.15.148:0/825446095 conn(0x7fdf3c0fc7d0 msgr2=0x7fdf3c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:09.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.059+0000 7fdf40880640 1 -- 172.21.15.148:0/825446095 shutdown_connections 2024-09-19T07:10:09.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.059+0000 7fdf40880640 1 -- 172.21.15.148:0/825446095 wait complete. 2024-09-19T07:10:09.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.059+0000 7fdf40880640 1 Processor -- start 2024-09-19T07:10:09.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.059+0000 7fdf40880640 1 -- start start 2024-09-19T07:10:09.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.059+0000 7fdf40880640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf3c100e20 0x7fdf3c1983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:09.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.060+0000 7fdf40880640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdf3c102570 0x7fdf3c198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:09.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.060+0000 7fdf40880640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf3c102ef0 0x7fdf3c19ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:09.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.060+0000 7fdf40880640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdf3c110f80 con 0x7fdf3c100e20 2024-09-19T07:10:09.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.060+0000 7fdf40880640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdf3c110e00 con 0x7fdf3c102570 2024-09-19T07:10:09.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.060+0000 7fdf40880640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdf3c111100 con 0x7fdf3c102ef0 2024-09-19T07:10:09.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.060+0000 7fdf3a59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf3c100e20 0x7fdf3c1983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:09.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.060+0000 7fdf3a59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf3c100e20 0x7fdf3c1983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44392/0 (socket says 172.21.15.148:44392) 2024-09-19T07:10:09.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.060+0000 7fdf3a59c640 1 -- 172.21.15.148:0/2171221477 learned_addr learned my addr 172.21.15.148:0/2171221477 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:09.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.060+0000 7fdf3ad9d640 1 --2- 172.21.15.148:0/2171221477 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf3c102ef0 0x7fdf3c19ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:09.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.060+0000 7fdf39d9b640 1 --2- 172.21.15.148:0/2171221477 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdf3c102570 0x7fdf3c198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:09.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.060+0000 7fdf3a59c640 1 -- 172.21.15.148:0/2171221477 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf3c102ef0 msgr2=0x7fdf3c19ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:09.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.060+0000 7fdf3a59c640 1 --2- 172.21.15.148:0/2171221477 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf3c102ef0 0x7fdf3c19ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:09.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.060+0000 7fdf3a59c640 1 -- 172.21.15.148:0/2171221477 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdf3c102570 msgr2=0x7fdf3c198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:09.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.060+0000 7fdf3a59c640 1 --2- 172.21.15.148:0/2171221477 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdf3c102570 0x7fdf3c198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:09.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.060+0000 7fdf3a59c640 1 -- 172.21.15.148:0/2171221477 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf3c19d3a0 con 0x7fdf3c100e20 2024-09-19T07:10:09.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.060+0000 7fdf3ad9d640 1 --2- 172.21.15.148:0/2171221477 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf3c102ef0 0x7fdf3c19ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:10:09.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.060+0000 7fdf3a59c640 1 --2- 172.21.15.148:0/2171221477 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf3c100e20 0x7fdf3c1983f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c00c920 tx=0x7fdf2c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:09.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.060+0000 7fdf2b7fe640 1 -- 172.21.15.148:0/2171221477 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c007c70 con 0x7fdf3c100e20 2024-09-19T07:10:09.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.060+0000 7fdf2b7fe640 1 -- 172.21.15.148:0/2171221477 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf2c007e10 con 0x7fdf3c100e20 2024-09-19T07:10:09.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.060+0000 7fdf40880640 1 -- 172.21.15.148:0/2171221477 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf3c19d690 con 0x7fdf3c100e20 2024-09-19T07:10:09.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.060+0000 7fdf2b7fe640 1 -- 172.21.15.148:0/2171221477 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c018890 con 0x7fdf3c100e20 2024-09-19T07:10:09.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.060+0000 7fdf40880640 1 -- 172.21.15.148:0/2171221477 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf3c1a4f70 con 0x7fdf3c100e20 2024-09-19T07:10:09.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.062+0000 7fdf40880640 1 -- 172.21.15.148:0/2171221477 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf3c101200 con 0x7fdf3c100e20 2024-09-19T07:10:09.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.062+0000 7fdf2b7fe640 1 -- 172.21.15.148:0/2171221477 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fdf2c018b30 con 0x7fdf3c100e20 2024-09-19T07:10:09.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.063+0000 7fdf2b7fe640 1 --2- 172.21.15.148:0/2171221477 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fdf240a3350 0x7fdf240a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:09.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.063+0000 7fdf39d9b640 1 --2- 172.21.15.148:0/2171221477 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fdf240a3350 0x7fdf240a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:09.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.063+0000 7fdf2b7fe640 1 -- 172.21.15.148:0/2171221477 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7fdf2c0cfc60 con 0x7fdf3c100e20 2024-09-19T07:10:09.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.064+0000 7fdf39d9b640 1 --2- 172.21.15.148:0/2171221477 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fdf240a3350 0x7fdf240a5810 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdf30005fd0 tx=0x7fdf30005e20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:09.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.067+0000 7fdf2b7fe640 1 -- 172.21.15.148:0/2171221477 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdf2c014030 con 0x7fdf3c100e20 2024-09-19T07:10:09.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.241+0000 7fdf40880640 1 -- 172.21.15.148:0/2171221477 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fdf3c10a0a0 con 0x7fdf3c100e20 2024-09-19T07:10:09.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.241+0000 7fdf2b7fe640 1 -- 172.21.15.148:0/2171221477 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fdf2c018e20 con 0x7fdf3c100e20 2024-09-19T07:10:09.242 INFO:teuthology.orchestra.run.smithi148.stdout:146028888115 2024-09-19T07:10:09.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.243+0000 7fdf40880640 1 -- 172.21.15.148:0/2171221477 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fdf240a3350 msgr2=0x7fdf240a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:09.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.243+0000 7fdf40880640 1 --2- 172.21.15.148:0/2171221477 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fdf240a3350 0x7fdf240a5810 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdf30005fd0 tx=0x7fdf30005e20 comp rx=0 tx=0).stop 2024-09-19T07:10:09.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.243+0000 7fdf40880640 1 -- 172.21.15.148:0/2171221477 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf3c100e20 msgr2=0x7fdf3c1983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:09.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.243+0000 7fdf40880640 1 --2- 172.21.15.148:0/2171221477 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf3c100e20 0x7fdf3c1983f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c00c920 tx=0x7fdf2c00cde0 comp rx=0 tx=0).stop 2024-09-19T07:10:09.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.243+0000 7fdf40880640 1 -- 172.21.15.148:0/2171221477 shutdown_connections 2024-09-19T07:10:09.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.243+0000 7fdf40880640 1 --2- 172.21.15.148:0/2171221477 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fdf240a3350 0x7fdf240a5810 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:09.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.243+0000 7fdf40880640 1 --2- 172.21.15.148:0/2171221477 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf3c102ef0 0x7fdf3c19ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:09.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.243+0000 7fdf40880640 1 --2- 172.21.15.148:0/2171221477 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdf3c102570 0x7fdf3c198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:09.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.243+0000 7fdf40880640 1 --2- 172.21.15.148:0/2171221477 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf3c100e20 0x7fdf3c1983f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:09.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.243+0000 7fdf40880640 1 -- 172.21.15.148:0/2171221477 >> 172.21.15.148:0/2171221477 conn(0x7fdf3c0fc7d0 msgr2=0x7fdf3c06a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:09.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.243+0000 7fdf40880640 1 -- 172.21.15.148:0/2171221477 shutdown_connections 2024-09-19T07:10:09.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:09.243+0000 7fdf40880640 1 -- 172.21.15.148:0/2171221477 wait complete. 2024-09-19T07:10:09.307 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:09 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/2341458590' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T07:10:09.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:09 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/2341458590' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T07:10:09.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:09 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/2341458590' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T07:10:09.958 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888113 got 146028888115 for osd.5 2024-09-19T07:10:09.958 DEBUG:teuthology.parallel:result is None 2024-09-19T07:10:10.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:10 smithi148 ceph-mon[31180]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:10:10.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:10 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/2171221477' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T07:10:10.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:10 smithi165 ceph-mon[35326]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:10:10.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:10 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/2171221477' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T07:10:10.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:10 smithi179 ceph-mon[35716]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:10:10.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:10 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/2171221477' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T07:10:10.587 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018936 got 128849018937 for osd.4 2024-09-19T07:10:10.587 DEBUG:teuthology.parallel:result is None 2024-09-19T07:10:10.613 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:10:10.614 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:10:10.615 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:10:10.616 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:10:11.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.355+0000 7fcb6ce44640 1 -- 172.21.15.148:0/92281783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb68102790 msgr2=0x7fcb681067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:11.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.355+0000 7fcb6ce44640 1 --2- 172.21.15.148:0/92281783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb68102790 0x7fcb681067e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fcb50009900 tx=0x7fcb5002a410 comp rx=0 tx=0).stop 2024-09-19T07:10:11.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.355+0000 7fcb6ce44640 1 -- 172.21.15.148:0/92281783 shutdown_connections 2024-09-19T07:10:11.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.355+0000 7fcb6ce44640 1 --2- 172.21.15.148:0/92281783 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb68106f10 0x7fcb6810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:11.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.355+0000 7fcb6ce44640 1 --2- 172.21.15.148:0/92281783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb68102790 0x7fcb681067e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:11.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.355+0000 7fcb6ce44640 1 --2- 172.21.15.148:0/92281783 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb68101de0 0x7fcb681021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:11.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.355+0000 7fcb6ce44640 1 -- 172.21.15.148:0/92281783 >> 172.21.15.148:0/92281783 conn(0x7fcb680fd8c0 msgr2=0x7fcb680ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:11.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.355+0000 7fcb6ce44640 1 -- 172.21.15.148:0/92281783 shutdown_connections 2024-09-19T07:10:11.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.355+0000 7fcb6ce44640 1 -- 172.21.15.148:0/92281783 wait complete. 2024-09-19T07:10:11.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.356+0000 7fcb6ce44640 1 Processor -- start 2024-09-19T07:10:11.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.356+0000 7fcb6ce44640 1 -- start start 2024-09-19T07:10:11.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.356+0000 7fcb6ce44640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb68101de0 0x7fcb680744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:11.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.356+0000 7fcb6ce44640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb68102790 0x7fcb68074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:11.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.356+0000 7fcb6ce44640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb68106f10 0x7fcb68074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:11.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.356+0000 7fcb6ce44640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fcb68112010 con 0x7fcb68106f10 2024-09-19T07:10:11.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.356+0000 7fcb6ce44640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcb68111e90 con 0x7fcb68102790 2024-09-19T07:10:11.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.356+0000 7fcb6ce44640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcb68112190 con 0x7fcb68101de0 2024-09-19T07:10:11.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.356+0000 7fcb66d9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb68106f10 0x7fcb68074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:11.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.356+0000 7fcb66d9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb68106f10 0x7fcb68074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44410/0 (socket says 172.21.15.148:44410) 2024-09-19T07:10:11.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.356+0000 7fcb66d9d640 1 -- 172.21.15.148:0/3432581950 learned_addr learned my addr 172.21.15.148:0/3432581950 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:11.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.356+0000 7fcb6659c640 1 --2- 172.21.15.148:0/3432581950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb68101de0 0x7fcb680744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:11.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.356+0000 7fcb65d9b640 1 --2- 172.21.15.148:0/3432581950 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb68102790 0x7fcb68074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:11.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.356+0000 7fcb66d9d640 1 -- 172.21.15.148:0/3432581950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb68101de0 msgr2=0x7fcb680744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:11.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.357+0000 7fcb66d9d640 1 --2- 172.21.15.148:0/3432581950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb68101de0 0x7fcb680744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:11.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.357+0000 7fcb66d9d640 1 -- 172.21.15.148:0/3432581950 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb68102790 msgr2=0x7fcb68074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:11.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.357+0000 7fcb66d9d640 1 --2- 172.21.15.148:0/3432581950 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb68102790 0x7fcb68074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:11.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.357+0000 7fcb66d9d640 1 -- 172.21.15.148:0/3432581950 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb681a6a70 con 0x7fcb68106f10 2024-09-19T07:10:11.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.357+0000 7fcb65d9b640 1 --2- 172.21.15.148:0/3432581950 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb68102790 0x7fcb68074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:10:11.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.357+0000 7fcb6659c640 1 --2- 172.21.15.148:0/3432581950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb68101de0 0x7fcb680744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:10:11.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.357+0000 7fcb66d9d640 1 --2- 172.21.15.148:0/3432581950 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb68106f10 0x7fcb68074f70 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fcb6000b970 tx=0x7fcb6000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:11.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.357+0000 7fcb5f7fe640 1 -- 172.21.15.148:0/3432581950 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb60019070 con 0x7fcb68106f10 2024-09-19T07:10:11.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.357+0000 7fcb6ce44640 1 -- 172.21.15.148:0/3432581950 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb681a6d60 con 0x7fcb68106f10 2024-09-19T07:10:11.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.357+0000 7fcb5f7fe640 1 -- 172.21.15.148:0/3432581950 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb6000cb40 con 0x7fcb68106f10 2024-09-19T07:10:11.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.357+0000 7fcb5f7fe640 1 -- 172.21.15.148:0/3432581950 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb60007650 con 0x7fcb68106f10 2024-09-19T07:10:11.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.357+0000 7fcb6ce44640 1 -- 172.21.15.148:0/3432581950 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb681a7250 con 0x7fcb68106f10 2024-09-19T07:10:11.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.358+0000 7fcb6ce44640 1 -- 172.21.15.148:0/3432581950 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb68102240 con 0x7fcb68106f10 2024-09-19T07:10:11.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.359+0000 7fcb5f7fe640 1 -- 172.21.15.148:0/3432581950 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fcb6001c070 con 0x7fcb68106f10 2024-09-19T07:10:11.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.360+0000 7fcb5f7fe640 1 --2- 172.21.15.148:0/3432581950 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fcb540a32d0 0x7fcb540a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:11.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.360+0000 7fcb6659c640 1 --2- 172.21.15.148:0/3432581950 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fcb540a32d0 0x7fcb540a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:11.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.360+0000 7fcb5f7fe640 1 -- 172.21.15.148:0/3432581950 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7fcb600cf430 con 0x7fcb68106f10 2024-09-19T07:10:11.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.361+0000 7fcb6659c640 1 --2- 172.21.15.148:0/3432581950 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fcb540a32d0 0x7fcb540a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcb58006fd0 tx=0x7fcb58008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:11.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.363+0000 7fcb5f7fe640 1 -- 172.21.15.148:0/3432581950 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcb6009c110 con 0x7fcb68106f10 2024-09-19T07:10:11.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.544+0000 7fcb6ce44640 1 -- 172.21.15.148:0/3432581950 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fcb6810a150 con 0x7fcb68106f10 2024-09-19T07:10:11.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.545+0000 7fcb5f7fe640 1 -- 172.21.15.148:0/3432581950 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcb6009ba10 con 0x7fcb68106f10 2024-09-19T07:10:11.546 INFO:teuthology.orchestra.run.smithi148.stdout:98784247870 2024-09-19T07:10:11.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.546+0000 7fcb6ce44640 1 -- 172.21.15.148:0/3432581950 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fcb540a32d0 msgr2=0x7fcb540a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:11.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.547+0000 7fcb6ce44640 1 --2- 172.21.15.148:0/3432581950 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fcb540a32d0 0x7fcb540a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcb58006fd0 tx=0x7fcb58008040 comp rx=0 tx=0).stop 2024-09-19T07:10:11.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.547+0000 7fcb6ce44640 1 -- 172.21.15.148:0/3432581950 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb68106f10 msgr2=0x7fcb68074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:11.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.547+0000 7fcb6ce44640 1 --2- 172.21.15.148:0/3432581950 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb68106f10 0x7fcb68074f70 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fcb6000b970 tx=0x7fcb6000be30 comp rx=0 tx=0).stop 2024-09-19T07:10:11.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.547+0000 7fcb6ce44640 1 -- 172.21.15.148:0/3432581950 shutdown_connections 2024-09-19T07:10:11.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.547+0000 7fcb6ce44640 1 --2- 172.21.15.148:0/3432581950 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fcb540a32d0 0x7fcb540a5790 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:11.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.547+0000 7fcb6ce44640 1 --2- 172.21.15.148:0/3432581950 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb68106f10 0x7fcb68074f70 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:11.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.547+0000 7fcb6ce44640 1 --2- 172.21.15.148:0/3432581950 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb68102790 0x7fcb68074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:11.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.547+0000 7fcb6ce44640 1 --2- 172.21.15.148:0/3432581950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb68101de0 0x7fcb680744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:11.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.547+0000 7fcb6ce44640 1 -- 172.21.15.148:0/3432581950 >> 172.21.15.148:0/3432581950 conn(0x7fcb680fd8c0 msgr2=0x7fcb680fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:11.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.547+0000 7fcb6ce44640 1 -- 172.21.15.148:0/3432581950 shutdown_connections 2024-09-19T07:10:11.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.547+0000 7fcb6ce44640 1 -- 172.21.15.148:0/3432581950 wait complete. 2024-09-19T07:10:11.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.780+0000 7f325d4fb640 1 -- 172.21.15.148:0/4257673709 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3258101410 msgr2=0x7f325810d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:11.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.780+0000 7f325d4fb640 1 --2- 172.21.15.148:0/4257673709 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3258101410 0x7f325810d940 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3250009cd0 tx=0x7f325002a8e0 comp rx=0 tx=0).stop 2024-09-19T07:10:11.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.780+0000 7f325d4fb640 1 -- 172.21.15.148:0/4257673709 shutdown_connections 2024-09-19T07:10:11.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.780+0000 7f325d4fb640 1 --2- 172.21.15.148:0/4257673709 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3258101410 0x7f325810d940 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:11.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.780+0000 7f325d4fb640 1 --2- 172.21.15.148:0/4257673709 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3258100a70 0x7f3258100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:11.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.780+0000 7f325d4fb640 1 --2- 172.21.15.148:0/4257673709 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3258106a70 0x7f3258106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:11.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.780+0000 7f325d4fb640 1 -- 172.21.15.148:0/4257673709 >> 172.21.15.148:0/4257673709 conn(0x7f32580fc790 msgr2=0x7f32580febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:11.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.780+0000 7f325d4fb640 1 -- 172.21.15.148:0/4257673709 shutdown_connections 2024-09-19T07:10:11.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.780+0000 7f325d4fb640 1 -- 172.21.15.148:0/4257673709 wait complete. 2024-09-19T07:10:11.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.781+0000 7f325d4fb640 1 Processor -- start 2024-09-19T07:10:11.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.781+0000 7f325d4fb640 1 -- start start 2024-09-19T07:10:11.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.781+0000 7f325d4fb640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3258100a70 0x7f32581992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:11.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.781+0000 7f325d4fb640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3258101410 0x7f3258199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:11.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.781+0000 7f325d4fb640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3258106a70 0x7f32581a4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:11.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.781+0000 7f325d4fb640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3258110e90 con 0x7f3258101410 2024-09-19T07:10:11.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.781+0000 7f325d4fb640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3258110d10 con 0x7f3258100a70 2024-09-19T07:10:11.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.781+0000 7f325d4fb640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3258111010 con 0x7f3258106a70 2024-09-19T07:10:11.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.781+0000 7f324e7fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3258101410 0x7f3258199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:11.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.781+0000 7f324e7fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3258101410 0x7f3258199800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44424/0 (socket says 172.21.15.148:44424) 2024-09-19T07:10:11.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.781+0000 7f324e7fc640 1 -- 172.21.15.148:0/813055773 learned_addr learned my addr 172.21.15.148:0/813055773 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:11.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.781+0000 7f324e7fc640 1 -- 172.21.15.148:0/813055773 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3258106a70 msgr2=0x7f32581a4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:11.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.781+0000 7f3256ffd640 1 --2- 172.21.15.148:0/813055773 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3258100a70 0x7f32581992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:11.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.781+0000 7f324e7fc640 1 --2- 172.21.15.148:0/813055773 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3258106a70 0x7f32581a4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:11.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.781+0000 7f324e7fc640 1 -- 172.21.15.148:0/813055773 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3258100a70 msgr2=0x7f32581992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:11.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.781+0000 7f324e7fc640 1 --2- 172.21.15.148:0/813055773 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3258100a70 0x7f32581992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:11.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.781+0000 7f324e7fc640 1 -- 172.21.15.148:0/813055773 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32581a4880 con 0x7f3258101410 2024-09-19T07:10:11.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.782+0000 7f324e7fc640 1 --2- 172.21.15.148:0/813055773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3258101410 0x7f3258199800 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f324000b4a0 tx=0x7f324000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:11.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.782+0000 7f3254ff9640 1 -- 172.21.15.148:0/813055773 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3240014070 con 0x7f3258101410 2024-09-19T07:10:11.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.782+0000 7f325d4fb640 1 -- 172.21.15.148:0/813055773 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32581a4a50 con 0x7f3258101410 2024-09-19T07:10:11.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.782+0000 7f3254ff9640 1 -- 172.21.15.148:0/813055773 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3240010af0 con 0x7f3258101410 2024-09-19T07:10:11.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.782+0000 7f3254ff9640 1 -- 172.21.15.148:0/813055773 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3240017d10 con 0x7f3258101410 2024-09-19T07:10:11.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.782+0000 7f325d4fb640 1 -- 172.21.15.148:0/813055773 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32581a4f40 con 0x7f3258101410 2024-09-19T07:10:11.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.783+0000 7f325d4fb640 1 -- 172.21.15.148:0/813055773 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3258100ed0 con 0x7f3258101410 2024-09-19T07:10:11.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.784+0000 7f3254ff9640 1 -- 172.21.15.148:0/813055773 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f3240017070 con 0x7f3258101410 2024-09-19T07:10:11.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.784+0000 7f3254ff9640 1 --2- 172.21.15.148:0/813055773 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f32440a32d0 0x7f32440a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:11.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.785+0000 7f3256ffd640 1 --2- 172.21.15.148:0/813055773 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f32440a32d0 0x7f32440a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:11.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.785+0000 7f3254ff9640 1 -- 172.21.15.148:0/813055773 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7f32400cee00 con 0x7f3258101410 2024-09-19T07:10:11.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.786+0000 7f3256ffd640 1 --2- 172.21.15.148:0/813055773 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f32440a32d0 0x7f32440a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f324800ba40 tx=0x7f3248005cc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:11.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.790+0000 7f3254ff9640 1 -- 172.21.15.148:0/813055773 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f324009bae0 con 0x7f3258101410 2024-09-19T07:10:11.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.958+0000 7f325d4fb640 1 -- 172.21.15.148:0/813055773 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f32581a51d0 con 0x7f3258101410 2024-09-19T07:10:11.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.958+0000 7f3254ff9640 1 -- 172.21.15.148:0/813055773 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f324009b3e0 con 0x7f3258101410 2024-09-19T07:10:11.960 INFO:teuthology.orchestra.run.smithi148.stdout:34359738446 2024-09-19T07:10:11.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.960+0000 7f325d4fb640 1 -- 172.21.15.148:0/813055773 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f32440a32d0 msgr2=0x7f32440a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:11.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.960+0000 7f325d4fb640 1 --2- 172.21.15.148:0/813055773 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f32440a32d0 0x7f32440a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f324800ba40 tx=0x7f3248005cc0 comp rx=0 tx=0).stop 2024-09-19T07:10:11.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.960+0000 7f325d4fb640 1 -- 172.21.15.148:0/813055773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3258101410 msgr2=0x7f3258199800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:11.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.960+0000 7f325d4fb640 1 --2- 172.21.15.148:0/813055773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3258101410 0x7f3258199800 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f324000b4a0 tx=0x7f324000b960 comp rx=0 tx=0).stop 2024-09-19T07:10:11.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.960+0000 7f325d4fb640 1 -- 172.21.15.148:0/813055773 shutdown_connections 2024-09-19T07:10:11.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.960+0000 7f325d4fb640 1 --2- 172.21.15.148:0/813055773 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f32440a32d0 0x7f32440a5790 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:11.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.960+0000 7f325d4fb640 1 --2- 172.21.15.148:0/813055773 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3258106a70 0x7f32581a4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:11.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.960+0000 7f325d4fb640 1 --2- 172.21.15.148:0/813055773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3258101410 0x7f3258199800 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:11.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.960+0000 7f325d4fb640 1 --2- 172.21.15.148:0/813055773 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3258100a70 0x7f32581992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:11.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.960+0000 7f325d4fb640 1 -- 172.21.15.148:0/813055773 >> 172.21.15.148:0/813055773 conn(0x7f32580fc790 msgr2=0x7f32580fced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:11.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.961+0000 7f325d4fb640 1 -- 172.21.15.148:0/813055773 shutdown_connections 2024-09-19T07:10:11.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:11.961+0000 7f325d4fb640 1 -- 172.21.15.148:0/813055773 wait complete. 2024-09-19T07:10:12.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:12 smithi148 ceph-mon[31180]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:10:12.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:12 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/3432581950' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T07:10:12.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:12 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/813055773' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T07:10:12.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:12 smithi179 ceph-mon[35716]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:10:12.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:12 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/3432581950' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T07:10:12.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:12 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/813055773' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T07:10:12.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:12 smithi165 ceph-mon[35326]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:10:12.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:12 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/3432581950' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T07:10:12.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:12 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/813055773' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T07:10:12.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:12.843+0000 7f13adbd9640 1 -- 172.21.15.148:0/3563134550 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13a8101420 msgr2=0x7f13a810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:12.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:12.843+0000 7f13adbd9640 1 --2- 172.21.15.148:0/3563134550 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13a8101420 0x7f13a810d950 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f13a0009cd0 tx=0x7f13a002a8e0 comp rx=0 tx=0).stop 2024-09-19T07:10:12.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:12.843+0000 7f13adbd9640 1 -- 172.21.15.148:0/3563134550 shutdown_connections 2024-09-19T07:10:12.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:12.843+0000 7f13adbd9640 1 --2- 172.21.15.148:0/3563134550 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13a8101420 0x7f13a810d950 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:12.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:12.843+0000 7f13adbd9640 1 --2- 172.21.15.148:0/3563134550 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13a8100a80 0x7f13a8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:12.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:12.843+0000 7f13adbd9640 1 --2- 172.21.15.148:0/3563134550 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13a8106a80 0x7f13a8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:12.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:12.843+0000 7f13adbd9640 1 -- 172.21.15.148:0/3563134550 >> 172.21.15.148:0/3563134550 conn(0x7f13a80fc7a0 msgr2=0x7f13a80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:12.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:12.843+0000 7f13adbd9640 1 -- 172.21.15.148:0/3563134550 shutdown_connections 2024-09-19T07:10:12.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:12.843+0000 7f13adbd9640 1 -- 172.21.15.148:0/3563134550 wait complete. 2024-09-19T07:10:12.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:12.844+0000 7f13adbd9640 1 Processor -- start 2024-09-19T07:10:12.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:12.844+0000 7f13adbd9640 1 -- start start 2024-09-19T07:10:12.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:12.844+0000 7f13adbd9640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13a8100a80 0x7f13a819a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:12.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:12.844+0000 7f13adbd9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13a8101420 0x7f13a819abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:12.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:12.844+0000 7f13adbd9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13a8106a80 0x7f13a819ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:12.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:12.844+0000 7f13adbd9640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f13a8110e80 con 0x7f13a8101420 2024-09-19T07:10:12.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:12.844+0000 7f13adbd9640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f13a8110d00 con 0x7f13a8100a80 2024-09-19T07:10:12.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:12.844+0000 7f13adbd9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f13a8111000 con 0x7f13a8106a80 2024-09-19T07:10:12.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:12.844+0000 7f139ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13a8101420 0x7f13a819abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:12.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:12.844+0000 7f139ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13a8101420 0x7f13a819abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44454/0 (socket says 172.21.15.148:44454) 2024-09-19T07:10:12.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:12.844+0000 7f139ffff640 1 -- 172.21.15.148:0/3456892196 learned_addr learned my addr 172.21.15.148:0/3456892196 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:12.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:12.844+0000 7f13a7fff640 1 --2- 172.21.15.148:0/3456892196 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13a8106a80 0x7f13a819ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:12.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:12.844+0000 7f13a77fe640 1 --2- 172.21.15.148:0/3456892196 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13a8100a80 0x7f13a819a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:12.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:12.844+0000 7f139ffff640 1 -- 172.21.15.148:0/3456892196 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13a8106a80 msgr2=0x7f13a819ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:12.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:12.844+0000 7f139ffff640 1 --2- 172.21.15.148:0/3456892196 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13a8106a80 0x7f13a819ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:12.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:12.844+0000 7f139ffff640 1 -- 172.21.15.148:0/3456892196 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13a8100a80 msgr2=0x7f13a819a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:12.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:12.844+0000 7f139ffff640 1 --2- 172.21.15.148:0/3456892196 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13a8100a80 0x7f13a819a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:12.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:12.844+0000 7f139ffff640 1 -- 172.21.15.148:0/3456892196 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13a819f650 con 0x7f13a8101420 2024-09-19T07:10:12.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:12.844+0000 7f13a7fff640 1 --2- 172.21.15.148:0/3456892196 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13a8106a80 0x7f13a819ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:10:12.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:12.844+0000 7f139ffff640 1 --2- 172.21.15.148:0/3456892196 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13a8101420 0x7f13a819abe0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f139000d950 tx=0x7f139000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:12.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:12.844+0000 7f13a57fa640 1 -- 172.21.15.148:0/3456892196 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1390017070 con 0x7f13a8101420 2024-09-19T07:10:12.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:12.845+0000 7f13a57fa640 1 -- 172.21.15.148:0/3456892196 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1390009c30 con 0x7f13a8101420 2024-09-19T07:10:12.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:12.845+0000 7f13adbd9640 1 -- 172.21.15.148:0/3456892196 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13a819f940 con 0x7f13a8101420 2024-09-19T07:10:12.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:12.845+0000 7f13a57fa640 1 -- 172.21.15.148:0/3456892196 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f139000f6b0 con 0x7f13a8101420 2024-09-19T07:10:12.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:12.845+0000 7f13adbd9640 1 -- 172.21.15.148:0/3456892196 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13a81a7220 con 0x7f13a8101420 2024-09-19T07:10:12.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:12.846+0000 7f13adbd9640 1 -- 172.21.15.148:0/3456892196 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13a8100ee0 con 0x7f13a8101420 2024-09-19T07:10:12.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:12.847+0000 7f13a57fa640 1 -- 172.21.15.148:0/3456892196 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f13900109d0 con 0x7f13a8101420 2024-09-19T07:10:12.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:12.847+0000 7f13a57fa640 1 --2- 172.21.15.148:0/3456892196 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f13940a3350 0x7f13940a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:12.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:12.847+0000 7f13a77fe640 1 --2- 172.21.15.148:0/3456892196 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f13940a3350 0x7f13940a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:12.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:12.848+0000 7f13a57fa640 1 -- 172.21.15.148:0/3456892196 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7f13900cf650 con 0x7f13a8101420 2024-09-19T07:10:12.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:12.848+0000 7f13a77fe640 1 --2- 172.21.15.148:0/3456892196 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f13940a3350 0x7f13940a5810 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1398005fd0 tx=0x7f139800b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:12.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:12.850+0000 7f13a57fa640 1 -- 172.21.15.148:0/3456892196 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1390009de0 con 0x7f13a8101420 2024-09-19T07:10:13.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.023+0000 7f13adbd9640 1 -- 172.21.15.148:0/3456892196 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f13a81a7480 con 0x7f13a8101420 2024-09-19T07:10:13.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.024+0000 7f13a57fa640 1 -- 172.21.15.148:0/3456892196 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f139009c2a0 con 0x7f13a8101420 2024-09-19T07:10:13.025 INFO:teuthology.orchestra.run.smithi148.stdout:73014444100 2024-09-19T07:10:13.028 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.026+0000 7f13adbd9640 1 -- 172.21.15.148:0/3456892196 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f13940a3350 msgr2=0x7f13940a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:13.028 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.026+0000 7f13adbd9640 1 --2- 172.21.15.148:0/3456892196 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f13940a3350 0x7f13940a5810 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1398005fd0 tx=0x7f139800b390 comp rx=0 tx=0).stop 2024-09-19T07:10:13.028 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.026+0000 7f13adbd9640 1 -- 172.21.15.148:0/3456892196 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13a8101420 msgr2=0x7f13a819abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:13.028 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.026+0000 7f13adbd9640 1 --2- 172.21.15.148:0/3456892196 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13a8101420 0x7f13a819abe0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f139000d950 tx=0x7f139000de10 comp rx=0 tx=0).stop 2024-09-19T07:10:13.028 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.027+0000 7f13adbd9640 1 -- 172.21.15.148:0/3456892196 shutdown_connections 2024-09-19T07:10:13.028 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.027+0000 7f13adbd9640 1 --2- 172.21.15.148:0/3456892196 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f13940a3350 0x7f13940a5810 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:13.028 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.027+0000 7f13adbd9640 1 --2- 172.21.15.148:0/3456892196 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13a8106a80 0x7f13a819ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:13.029 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.027+0000 7f13adbd9640 1 --2- 172.21.15.148:0/3456892196 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13a8101420 0x7f13a819abe0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:13.029 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.027+0000 7f13adbd9640 1 --2- 172.21.15.148:0/3456892196 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13a8100a80 0x7f13a819a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:13.029 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.027+0000 7f13adbd9640 1 -- 172.21.15.148:0/3456892196 >> 172.21.15.148:0/3456892196 conn(0x7f13a80fc7a0 msgr2=0x7f13a810c720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:13.029 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.027+0000 7f13adbd9640 1 -- 172.21.15.148:0/3456892196 shutdown_connections 2024-09-19T07:10:13.029 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.027+0000 7f13adbd9640 1 -- 172.21.15.148:0/3456892196 wait complete. 2024-09-19T07:10:13.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.026+0000 7f973555d640 1 -- 172.21.15.148:0/2641332907 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9730101dd0 msgr2=0x7f97301021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:13.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.026+0000 7f973555d640 1 --2- 172.21.15.148:0/2641332907 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9730101dd0 0x7f97301021b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9720009900 tx=0x7f972002a410 comp rx=0 tx=0).stop 2024-09-19T07:10:13.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.026+0000 7f973555d640 1 -- 172.21.15.148:0/2641332907 shutdown_connections 2024-09-19T07:10:13.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.026+0000 7f973555d640 1 --2- 172.21.15.148:0/2641332907 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9730106f00 0x7f973010ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:13.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.026+0000 7f973555d640 1 --2- 172.21.15.148:0/2641332907 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9730102780 0x7f97301067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:13.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.026+0000 7f973555d640 1 --2- 172.21.15.148:0/2641332907 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9730101dd0 0x7f97301021b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:13.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.026+0000 7f973555d640 1 -- 172.21.15.148:0/2641332907 >> 172.21.15.148:0/2641332907 conn(0x7f97300fd8b0 msgr2=0x7f97300ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:13.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.027+0000 7f973555d640 1 -- 172.21.15.148:0/2641332907 shutdown_connections 2024-09-19T07:10:13.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.027+0000 7f973555d640 1 -- 172.21.15.148:0/2641332907 wait complete. 2024-09-19T07:10:13.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.027+0000 7f973555d640 1 Processor -- start 2024-09-19T07:10:13.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.028+0000 7f973555d640 1 -- start start 2024-09-19T07:10:13.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.028+0000 7f973555d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9730101dd0 0x7f9730073a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:13.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.028+0000 7f973555d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9730102780 0x7f973006cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:13.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.028+0000 7f973555d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9730106f00 0x7f973006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:13.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.028+0000 7f973555d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9730111f60 con 0x7f9730106f00 2024-09-19T07:10:13.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.028+0000 7f973555d640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9730111de0 con 0x7f9730102780 2024-09-19T07:10:13.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.028+0000 7f973555d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f97301120e0 con 0x7f9730101dd0 2024-09-19T07:10:13.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.028+0000 7f972f7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9730106f00 0x7f973006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:13.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.028+0000 7f972f7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9730106f00 0x7f973006cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44478/0 (socket says 172.21.15.148:44478) 2024-09-19T07:10:13.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.028+0000 7f972f7fe640 1 -- 172.21.15.148:0/1614136029 learned_addr learned my addr 172.21.15.148:0/1614136029 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:13.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.028+0000 7f972e7fc640 1 --2- 172.21.15.148:0/1614136029 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9730102780 0x7f973006cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:13.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.028+0000 7f972effd640 1 --2- 172.21.15.148:0/1614136029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9730101dd0 0x7f9730073a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:13.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.028+0000 7f972f7fe640 1 -- 172.21.15.148:0/1614136029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9730101dd0 msgr2=0x7f9730073a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:13.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.028+0000 7f972f7fe640 1 --2- 172.21.15.148:0/1614136029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9730101dd0 0x7f9730073a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:13.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.029+0000 7f972f7fe640 1 -- 172.21.15.148:0/1614136029 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9730102780 msgr2=0x7f973006cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:13.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.029+0000 7f972f7fe640 1 --2- 172.21.15.148:0/1614136029 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9730102780 0x7f973006cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:13.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.029+0000 7f972f7fe640 1 -- 172.21.15.148:0/1614136029 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f973006d5e0 con 0x7f9730106f00 2024-09-19T07:10:13.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.029+0000 7f972e7fc640 1 --2- 172.21.15.148:0/1614136029 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9730102780 0x7f973006cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:10:13.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.029+0000 7f972f7fe640 1 --2- 172.21.15.148:0/1614136029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9730106f00 0x7f973006cff0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f972800cad0 tx=0x7f972800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:13.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.029+0000 7f9717fff640 1 -- 172.21.15.148:0/1614136029 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972800adc0 con 0x7f9730106f00 2024-09-19T07:10:13.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.029+0000 7f9717fff640 1 -- 172.21.15.148:0/1614136029 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9728005020 con 0x7f9730106f00 2024-09-19T07:10:13.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.029+0000 7f973555d640 1 -- 172.21.15.148:0/1614136029 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f973006d8d0 con 0x7f9730106f00 2024-09-19T07:10:13.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.029+0000 7f9717fff640 1 -- 172.21.15.148:0/1614136029 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972800f6b0 con 0x7f9730106f00 2024-09-19T07:10:13.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.030+0000 7f973555d640 1 -- 172.21.15.148:0/1614136029 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97300718c0 con 0x7f9730106f00 2024-09-19T07:10:13.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.031+0000 7f973555d640 1 -- 172.21.15.148:0/1614136029 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97301032b0 con 0x7f9730106f00 2024-09-19T07:10:13.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.032+0000 7f9717fff640 1 -- 172.21.15.148:0/1614136029 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f9728005560 con 0x7f9730106f00 2024-09-19T07:10:13.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.033+0000 7f9717fff640 1 --2- 172.21.15.148:0/1614136029 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f97180a3350 0x7f97180a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:13.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.033+0000 7f972effd640 1 --2- 172.21.15.148:0/1614136029 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f97180a3350 0x7f97180a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:13.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.033+0000 7f9717fff640 1 -- 172.21.15.148:0/1614136029 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7f97280cfd90 con 0x7f9730106f00 2024-09-19T07:10:13.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.033+0000 7f972effd640 1 --2- 172.21.15.148:0/1614136029 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f97180a3350 0x7f97180a5810 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f97200096c0 tx=0x7f9720031490 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:13.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.037+0000 7f9717fff640 1 -- 172.21.15.148:0/1614136029 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f97280d3030 con 0x7f9730106f00 2024-09-19T07:10:13.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.213+0000 7f973555d640 1 -- 172.21.15.148:0/1614136029 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f9730109b50 con 0x7f9730106f00 2024-09-19T07:10:13.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.214+0000 7f9717fff640 1 -- 172.21.15.148:0/1614136029 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f9728014030 con 0x7f9730106f00 2024-09-19T07:10:13.215 INFO:teuthology.orchestra.run.smithi148.stdout:176093659185 2024-09-19T07:10:13.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.216+0000 7f973555d640 1 -- 172.21.15.148:0/1614136029 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f97180a3350 msgr2=0x7f97180a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:13.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.216+0000 7f973555d640 1 --2- 172.21.15.148:0/1614136029 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f97180a3350 0x7f97180a5810 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f97200096c0 tx=0x7f9720031490 comp rx=0 tx=0).stop 2024-09-19T07:10:13.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.216+0000 7f973555d640 1 -- 172.21.15.148:0/1614136029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9730106f00 msgr2=0x7f973006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:13.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.216+0000 7f973555d640 1 --2- 172.21.15.148:0/1614136029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9730106f00 0x7f973006cff0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f972800cad0 tx=0x7f972800cf90 comp rx=0 tx=0).stop 2024-09-19T07:10:13.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.216+0000 7f973555d640 1 -- 172.21.15.148:0/1614136029 shutdown_connections 2024-09-19T07:10:13.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.216+0000 7f973555d640 1 --2- 172.21.15.148:0/1614136029 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f97180a3350 0x7f97180a5810 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:13.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.216+0000 7f973555d640 1 --2- 172.21.15.148:0/1614136029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9730106f00 0x7f973006cff0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:13.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.216+0000 7f973555d640 1 --2- 172.21.15.148:0/1614136029 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9730102780 0x7f973006cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:13.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.216+0000 7f973555d640 1 --2- 172.21.15.148:0/1614136029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9730101dd0 0x7f9730073a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:13.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.216+0000 7f973555d640 1 -- 172.21.15.148:0/1614136029 >> 172.21.15.148:0/1614136029 conn(0x7f97300fd8b0 msgr2=0x7f97300fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:13.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.216+0000 7f973555d640 1 -- 172.21.15.148:0/1614136029 shutdown_connections 2024-09-19T07:10:13.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:13.216+0000 7f973555d640 1 -- 172.21.15.148:0/1614136029 wait complete. 2024-09-19T07:10:13.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:13 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/3456892196' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T07:10:13.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:13 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/3456892196' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T07:10:13.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:13 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/3456892196' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T07:10:13.805 INFO:tasks.cephadm.ceph_manager.ceph:need seq 176093659182 got 176093659185 for osd.6 2024-09-19T07:10:13.805 DEBUG:teuthology.parallel:result is None 2024-09-19T07:10:14.418 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:14 smithi148 ceph-mon[31180]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:10:14.418 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:14 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/1614136029' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T07:10:14.446 INFO:tasks.cephadm.ceph_manager.ceph:need seq 98784247868 got 98784247870 for osd.3 2024-09-19T07:10:14.447 DEBUG:teuthology.parallel:result is None 2024-09-19T07:10:14.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:14 smithi179 ceph-mon[35716]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:10:14.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:14 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/1614136029' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T07:10:14.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:14 smithi165 ceph-mon[35326]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:10:14.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:14 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/1614136029' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T07:10:14.987 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444097 got 73014444100 for osd.2 2024-09-19T07:10:14.988 DEBUG:teuthology.parallel:result is None 2024-09-19T07:10:15.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.348+0000 7fe007cb1640 1 -- 172.21.15.148:0/1188798079 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe000106f10 msgr2=0x7fe00010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:15.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.348+0000 7fe007cb1640 1 --2- 172.21.15.148:0/1188798079 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe000106f10 0x7fe00010ea90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fdff8009ca0 tx=0x7fdff802a8c0 comp rx=0 tx=0).stop 2024-09-19T07:10:15.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.348+0000 7fe007cb1640 1 -- 172.21.15.148:0/1188798079 shutdown_connections 2024-09-19T07:10:15.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.348+0000 7fe007cb1640 1 --2- 172.21.15.148:0/1188798079 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe000106f10 0x7fe00010ea90 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:15.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.348+0000 7fe007cb1640 1 --2- 172.21.15.148:0/1188798079 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe000102790 0x7fe0001067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:15.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.348+0000 7fe007cb1640 1 --2- 172.21.15.148:0/1188798079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe000101de0 0x7fe0001021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:15.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.348+0000 7fe007cb1640 1 -- 172.21.15.148:0/1188798079 >> 172.21.15.148:0/1188798079 conn(0x7fe0000fd8c0 msgr2=0x7fe0000ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:15.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.349+0000 7fe007cb1640 1 -- 172.21.15.148:0/1188798079 shutdown_connections 2024-09-19T07:10:15.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.349+0000 7fe007cb1640 1 -- 172.21.15.148:0/1188798079 wait complete. 2024-09-19T07:10:15.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.349+0000 7fe007cb1640 1 Processor -- start 2024-09-19T07:10:15.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.349+0000 7fe007cb1640 1 -- start start 2024-09-19T07:10:15.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.349+0000 7fe007cb1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe000101de0 0x7fe0001983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:15.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.349+0000 7fe007cb1640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe000102790 0x7fe0001988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:15.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.349+0000 7fe007cb1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe000106f10 0x7fe00019cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:15.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.349+0000 7fe007cb1640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe000111f70 con 0x7fe000106f10 2024-09-19T07:10:15.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.349+0000 7fe007cb1640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe000111df0 con 0x7fe000102790 2024-09-19T07:10:15.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.349+0000 7fe007cb1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe0001120f0 con 0x7fe000101de0 2024-09-19T07:10:15.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.349+0000 7fe00624e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe000106f10 0x7fe00019cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:15.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.349+0000 7fe00624e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe000106f10 0x7fe00019cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47292/0 (socket says 172.21.15.148:47292) 2024-09-19T07:10:15.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.349+0000 7fe00624e640 1 -- 172.21.15.148:0/2043498934 learned_addr learned my addr 172.21.15.148:0/2043498934 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:15.109 INFO:teuthology.orchestra.run.smithi148.stdout:227633266726 2024-09-19T07:10:15.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.350+0000 7fe00524c640 1 --2- 172.21.15.148:0/2043498934 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe000102790 0x7fe0001988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:15.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.350+0000 7fe005a4d640 1 --2- 172.21.15.148:0/2043498934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe000101de0 0x7fe0001983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:15.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.350+0000 7fe00624e640 1 -- 172.21.15.148:0/2043498934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe000101de0 msgr2=0x7fe0001983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:15.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.350+0000 7fe00624e640 1 --2- 172.21.15.148:0/2043498934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe000101de0 0x7fe0001983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:15.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.350+0000 7fe00624e640 1 -- 172.21.15.148:0/2043498934 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe000102790 msgr2=0x7fe0001988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:15.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.350+0000 7fe00624e640 1 --2- 172.21.15.148:0/2043498934 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe000102790 0x7fe0001988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:15.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.350+0000 7fe00624e640 1 -- 172.21.15.148:0/2043498934 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe00019d360 con 0x7fe000106f10 2024-09-19T07:10:15.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.350+0000 7fe00624e640 1 --2- 172.21.15.148:0/2043498934 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe000106f10 0x7fe00019cc80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fdff8031a20 tx=0x7fdff8031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:15.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.350+0000 7fdff6ffd640 1 -- 172.21.15.148:0/2043498934 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff8003b70 con 0x7fe000106f10 2024-09-19T07:10:15.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.350+0000 7fdff6ffd640 1 -- 172.21.15.148:0/2043498934 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdff8003d10 con 0x7fe000106f10 2024-09-19T07:10:15.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.350+0000 7fdff6ffd640 1 -- 172.21.15.148:0/2043498934 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff802fc80 con 0x7fe000106f10 2024-09-19T07:10:15.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.350+0000 7fe007cb1640 1 -- 172.21.15.148:0/2043498934 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe00019d5f0 con 0x7fe000106f10 2024-09-19T07:10:15.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.350+0000 7fe007cb1640 1 -- 172.21.15.148:0/2043498934 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0001a4f30 con 0x7fe000106f10 2024-09-19T07:10:15.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.351+0000 7fe007cb1640 1 -- 172.21.15.148:0/2043498934 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0001021c0 con 0x7fe000106f10 2024-09-19T07:10:15.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.352+0000 7fdff6ffd640 1 -- 172.21.15.148:0/2043498934 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fdff80046a0 con 0x7fe000106f10 2024-09-19T07:10:15.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.353+0000 7fdff6ffd640 1 --2- 172.21.15.148:0/2043498934 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fdfec0a32d0 0x7fdfec0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:15.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.353+0000 7fe005a4d640 1 --2- 172.21.15.148:0/2043498934 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fdfec0a32d0 0x7fdfec0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:15.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.353+0000 7fdff6ffd640 1 -- 172.21.15.148:0/2043498934 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7fdff80f0db0 con 0x7fe000106f10 2024-09-19T07:10:15.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.354+0000 7fe005a4d640 1 --2- 172.21.15.148:0/2043498934 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fdfec0a32d0 0x7fdfec0a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdffc005fd0 tx=0x7fdffc005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:15.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.356+0000 7fdff6ffd640 1 -- 172.21.15.148:0/2043498934 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdff80bdb50 con 0x7fe000106f10 2024-09-19T07:10:15.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.533+0000 7fe007cb1640 1 -- 172.21.15.148:0/2043498934 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fe0001a5100 con 0x7fe000106f10 2024-09-19T07:10:15.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.533+0000 7fdff6ffd640 1 -- 172.21.15.148:0/2043498934 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fdff80bd450 con 0x7fe000106f10 2024-09-19T07:10:15.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.535+0000 7fe007cb1640 1 -- 172.21.15.148:0/2043498934 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fdfec0a32d0 msgr2=0x7fdfec0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:15.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.535+0000 7fe007cb1640 1 --2- 172.21.15.148:0/2043498934 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fdfec0a32d0 0x7fdfec0a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdffc005fd0 tx=0x7fdffc005850 comp rx=0 tx=0).stop 2024-09-19T07:10:15.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.535+0000 7fe007cb1640 1 -- 172.21.15.148:0/2043498934 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe000106f10 msgr2=0x7fe00019cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:15.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.535+0000 7fe007cb1640 1 --2- 172.21.15.148:0/2043498934 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe000106f10 0x7fe00019cc80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fdff8031a20 tx=0x7fdff8031a50 comp rx=0 tx=0).stop 2024-09-19T07:10:15.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.535+0000 7fe007cb1640 1 -- 172.21.15.148:0/2043498934 shutdown_connections 2024-09-19T07:10:15.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.535+0000 7fe007cb1640 1 --2- 172.21.15.148:0/2043498934 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fdfec0a32d0 0x7fdfec0a5790 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:15.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.535+0000 7fe007cb1640 1 --2- 172.21.15.148:0/2043498934 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe000106f10 0x7fe00019cc80 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:15.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.535+0000 7fe007cb1640 1 --2- 172.21.15.148:0/2043498934 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe000102790 0x7fe0001988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:15.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.535+0000 7fe007cb1640 1 --2- 172.21.15.148:0/2043498934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe000101de0 0x7fe0001983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:15.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.535+0000 7fe007cb1640 1 -- 172.21.15.148:0/2043498934 >> 172.21.15.148:0/2043498934 conn(0x7fe0000fd8c0 msgr2=0x7fe0000ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:15.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.535+0000 7fe007cb1640 1 -- 172.21.15.148:0/2043498934 shutdown_connections 2024-09-19T07:10:15.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:14.535+0000 7fe007cb1640 1 -- 172.21.15.148:0/2043498934 wait complete. 2024-09-19T07:10:15.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:15 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/2043498934' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T07:10:15.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:15 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:10:15.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:15 smithi148 ceph-mon[31180]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T07:10:15.512 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:15 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/2043498934' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T07:10:15.512 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:15 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:10:15.512 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:15 smithi179 ceph-mon[35716]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T07:10:15.529 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:15 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/2043498934' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T07:10:15.529 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:15 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:10:15.530 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:15 smithi165 ceph-mon[35326]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T07:10:15.711 INFO:tasks.cephadm.ceph_manager.ceph:need seq 227633266724 got 227633266726 for osd.8 2024-09-19T07:10:15.711 DEBUG:teuthology.parallel:result is None 2024-09-19T07:10:15.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:15.890+0000 7f7186fc7640 1 -- 172.21.15.148:0/2886569258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f718010c170 msgr2=0x7f718010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:15.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:15.890+0000 7f7186fc7640 1 --2- 172.21.15.148:0/2886569258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f718010c170 0x7f718010e610 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7178009ca0 tx=0x7f717802a950 comp rx=0 tx=0).stop 2024-09-19T07:10:15.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:15.890+0000 7f7186fc7640 1 -- 172.21.15.148:0/2886569258 shutdown_connections 2024-09-19T07:10:15.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:15.890+0000 7f7186fc7640 1 --2- 172.21.15.148:0/2886569258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f718010c170 0x7f718010e610 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:15.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:15.890+0000 7f7186fc7640 1 --2- 172.21.15.148:0/2886569258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7180103660 0x7f718010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:15.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:15.890+0000 7f7186fc7640 1 --2- 172.21.15.148:0/2886569258 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7180102d40 0x7f7180103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:15.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:15.890+0000 7f7186fc7640 1 -- 172.21.15.148:0/2886569258 >> 172.21.15.148:0/2886569258 conn(0x7f71800fc7a0 msgr2=0x7f71800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:15.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:15.890+0000 7f7186fc7640 1 -- 172.21.15.148:0/2886569258 shutdown_connections 2024-09-19T07:10:15.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:15.890+0000 7f7186fc7640 1 -- 172.21.15.148:0/2886569258 wait complete. 2024-09-19T07:10:15.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:15.891+0000 7f7186fc7640 1 Processor -- start 2024-09-19T07:10:15.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:15.891+0000 7f7186fc7640 1 -- start start 2024-09-19T07:10:15.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:15.891+0000 7f7186fc7640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7180102d40 0x7f71801009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:15.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:15.891+0000 7f7186fc7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7180103660 0x7f7180100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:15.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:15.891+0000 7f7186fc7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f718010c170 0x7f7180101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:15.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:15.891+0000 7f7186fc7640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7180111f50 con 0x7f7180103660 2024-09-19T07:10:15.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:15.891+0000 7f7186fc7640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7180111dd0 con 0x7f7180102d40 2024-09-19T07:10:15.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:15.891+0000 7f7186fc7640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f71801120d0 con 0x7f718010c170 2024-09-19T07:10:15.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:15.891+0000 7f717ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7180103660 0x7f7180100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:15.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:15.891+0000 7f717ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7180103660 0x7f7180100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47318/0 (socket says 172.21.15.148:47318) 2024-09-19T07:10:15.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:15.891+0000 7f717ffff640 1 -- 172.21.15.148:0/1970766050 learned_addr learned my addr 172.21.15.148:0/1970766050 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:15.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:15.891+0000 7f7185564640 1 --2- 172.21.15.148:0/1970766050 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f718010c170 0x7f7180101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:15.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:15.891+0000 7f7184d63640 1 --2- 172.21.15.148:0/1970766050 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7180102d40 0x7f71801009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:15.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:15.891+0000 7f717ffff640 1 -- 172.21.15.148:0/1970766050 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f718010c170 msgr2=0x7f7180101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:15.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:15.891+0000 7f717ffff640 1 --2- 172.21.15.148:0/1970766050 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f718010c170 0x7f7180101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:15.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:15.891+0000 7f717ffff640 1 -- 172.21.15.148:0/1970766050 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7180102d40 msgr2=0x7f71801009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:15.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:15.891+0000 7f717ffff640 1 --2- 172.21.15.148:0/1970766050 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7180102d40 0x7f71801009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:15.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:15.891+0000 7f717ffff640 1 -- 172.21.15.148:0/1970766050 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71801a68c0 con 0x7f7180103660 2024-09-19T07:10:15.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:15.891+0000 7f7184d63640 1 --2- 172.21.15.148:0/1970766050 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7180102d40 0x7f71801009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:10:15.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:15.891+0000 7f717ffff640 1 --2- 172.21.15.148:0/1970766050 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7180103660 0x7f7180100ee0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f716c00e9f0 tx=0x7f716c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:15.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:15.892+0000 7f717dffb640 1 -- 172.21.15.148:0/1970766050 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f716c00ccc0 con 0x7f7180103660 2024-09-19T07:10:15.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:15.892+0000 7f7186fc7640 1 -- 172.21.15.148:0/1970766050 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71801a6bb0 con 0x7f7180103660 2024-09-19T07:10:15.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:15.892+0000 7f717dffb640 1 -- 172.21.15.148:0/1970766050 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f716c00ce60 con 0x7f7180103660 2024-09-19T07:10:15.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:15.892+0000 7f717dffb640 1 -- 172.21.15.148:0/1970766050 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f716c010690 con 0x7f7180103660 2024-09-19T07:10:15.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:15.892+0000 7f7186fc7640 1 -- 172.21.15.148:0/1970766050 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71801a70a0 con 0x7f7180103660 2024-09-19T07:10:15.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:15.893+0000 7f7186fc7640 1 -- 172.21.15.148:0/1970766050 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7180103120 con 0x7f7180103660 2024-09-19T07:10:15.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:15.894+0000 7f717dffb640 1 -- 172.21.15.148:0/1970766050 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f716c0046c0 con 0x7f7180103660 2024-09-19T07:10:15.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:15.895+0000 7f717dffb640 1 --2- 172.21.15.148:0/1970766050 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f71700a32d0 0x7f71700a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:15.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:15.895+0000 7f7184d63640 1 --2- 172.21.15.148:0/1970766050 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f71700a32d0 0x7f71700a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:15.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:15.895+0000 7f717dffb640 1 -- 172.21.15.148:0/1970766050 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7f716c0cfe90 con 0x7f7180103660 2024-09-19T07:10:15.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:15.895+0000 7f7184d63640 1 --2- 172.21.15.148:0/1970766050 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f71700a32d0 0x7f71700a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7174009b50 tx=0x7f7174005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:15.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:15.899+0000 7f717dffb640 1 -- 172.21.15.148:0/1970766050 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f716c09ca00 con 0x7f7180103660 2024-09-19T07:10:16.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.069+0000 7f7186fc7640 1 -- 172.21.15.148:0/1970766050 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f71801071e0 con 0x7f7180103660 2024-09-19T07:10:16.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.070+0000 7f717dffb640 1 -- 172.21.15.148:0/1970766050 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f716c09c300 con 0x7f7180103660 2024-09-19T07:10:16.071 INFO:teuthology.orchestra.run.smithi148.stdout:257698037794 2024-09-19T07:10:16.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.072+0000 7f7186fc7640 1 -- 172.21.15.148:0/1970766050 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f71700a32d0 msgr2=0x7f71700a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:16.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.072+0000 7f7186fc7640 1 --2- 172.21.15.148:0/1970766050 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f71700a32d0 0x7f71700a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7174009b50 tx=0x7f7174005f90 comp rx=0 tx=0).stop 2024-09-19T07:10:16.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.072+0000 7f7186fc7640 1 -- 172.21.15.148:0/1970766050 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7180103660 msgr2=0x7f7180100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:16.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.072+0000 7f7186fc7640 1 --2- 172.21.15.148:0/1970766050 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7180103660 0x7f7180100ee0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f716c00e9f0 tx=0x7f716c00eeb0 comp rx=0 tx=0).stop 2024-09-19T07:10:16.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.072+0000 7f7186fc7640 1 -- 172.21.15.148:0/1970766050 shutdown_connections 2024-09-19T07:10:16.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.072+0000 7f7186fc7640 1 --2- 172.21.15.148:0/1970766050 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f71700a32d0 0x7f71700a5790 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:16.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.072+0000 7f7186fc7640 1 --2- 172.21.15.148:0/1970766050 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f718010c170 0x7f7180101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:16.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.072+0000 7f7186fc7640 1 --2- 172.21.15.148:0/1970766050 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7180103660 0x7f7180100ee0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:16.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.072+0000 7f7186fc7640 1 --2- 172.21.15.148:0/1970766050 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7180102d40 0x7f71801009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:16.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.072+0000 7f7186fc7640 1 -- 172.21.15.148:0/1970766050 >> 172.21.15.148:0/1970766050 conn(0x7f71800fc7a0 msgr2=0x7f71800fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:16.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.072+0000 7f7186fc7640 1 -- 172.21.15.148:0/1970766050 shutdown_connections 2024-09-19T07:10:16.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.072+0000 7f7186fc7640 1 -- 172.21.15.148:0/1970766050 wait complete. 2024-09-19T07:10:16.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:16 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/1970766050' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T07:10:16.444 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:10:16.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:16 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/1970766050' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T07:10:16.550 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:10:16.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:16 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/1970766050' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T07:10:16.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.988+0000 7fe006d3d640 1 -- 172.21.15.148:0/3586643560 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe000100e20 msgr2=0x7fe000101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:16.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.988+0000 7fe006d3d640 1 --2- 172.21.15.148:0/3586643560 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe000100e20 0x7fe000101200 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fdff0009900 tx=0x7fdff002a480 comp rx=0 tx=0).stop 2024-09-19T07:10:16.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.988+0000 7fe006d3d640 1 -- 172.21.15.148:0/3586643560 shutdown_connections 2024-09-19T07:10:16.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.988+0000 7fe006d3d640 1 --2- 172.21.15.148:0/3586643560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe000102ef0 0x7fe00010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:16.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.988+0000 7fe006d3d640 1 --2- 172.21.15.148:0/3586643560 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe000102570 0x7fe0001029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:16.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.988+0000 7fe006d3d640 1 --2- 172.21.15.148:0/3586643560 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe000100e20 0x7fe000101200 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:16.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.988+0000 7fe006d3d640 1 -- 172.21.15.148:0/3586643560 >> 172.21.15.148:0/3586643560 conn(0x7fe0000fc7d0 msgr2=0x7fe0000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:16.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.988+0000 7fe006d3d640 1 -- 172.21.15.148:0/3586643560 shutdown_connections 2024-09-19T07:10:16.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.988+0000 7fe006d3d640 1 -- 172.21.15.148:0/3586643560 wait complete. 2024-09-19T07:10:16.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.989+0000 7fe006d3d640 1 Processor -- start 2024-09-19T07:10:16.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.989+0000 7fe006d3d640 1 -- start start 2024-09-19T07:10:16.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.989+0000 7fe006d3d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe000100e20 0x7fe0001973e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:16.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.989+0000 7fe006d3d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe000102570 0x7fe000197920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:16.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.989+0000 7fe006d3d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe000102ef0 0x7fe00019bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:16.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.989+0000 7fe006d3d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe000110f80 con 0x7fe000100e20 2024-09-19T07:10:16.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.989+0000 7fe006d3d640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe000110e00 con 0x7fe000102570 2024-09-19T07:10:16.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.989+0000 7fe006d3d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe000111100 con 0x7fe000102ef0 2024-09-19T07:10:16.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.990+0000 7fe004ad9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe000100e20 0x7fe0001973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:16.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.990+0000 7fe004ad9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe000100e20 0x7fe0001973e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47328/0 (socket says 172.21.15.148:47328) 2024-09-19T07:10:16.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.990+0000 7fe004ad9640 1 -- 172.21.15.148:0/2569437915 learned_addr learned my addr 172.21.15.148:0/2569437915 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:16.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.990+0000 7fdffffff640 1 --2- 172.21.15.148:0/2569437915 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe000102570 0x7fe000197920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:16.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.990+0000 7fe0052da640 1 --2- 172.21.15.148:0/2569437915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe000102ef0 0x7fe00019bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:16.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.990+0000 7fe004ad9640 1 -- 172.21.15.148:0/2569437915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe000102ef0 msgr2=0x7fe00019bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:16.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.990+0000 7fe004ad9640 1 --2- 172.21.15.148:0/2569437915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe000102ef0 0x7fe00019bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:16.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.990+0000 7fe004ad9640 1 -- 172.21.15.148:0/2569437915 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe000102570 msgr2=0x7fe000197920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:16.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.990+0000 7fe004ad9640 1 --2- 172.21.15.148:0/2569437915 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe000102570 0x7fe000197920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:16.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.990+0000 7fe004ad9640 1 -- 172.21.15.148:0/2569437915 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe00019c390 con 0x7fe000100e20 2024-09-19T07:10:16.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.990+0000 7fe0052da640 1 --2- 172.21.15.148:0/2569437915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe000102ef0 0x7fe00019bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:10:16.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.990+0000 7fe004ad9640 1 --2- 172.21.15.148:0/2569437915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe000100e20 0x7fe0001973e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fdff0006010 tx=0x7fdff0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:16.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.990+0000 7fdffdffb640 1 -- 172.21.15.148:0/2569437915 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff003f070 con 0x7fe000100e20 2024-09-19T07:10:16.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.990+0000 7fdffdffb640 1 -- 172.21.15.148:0/2569437915 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdff0031c30 con 0x7fe000100e20 2024-09-19T07:10:16.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.990+0000 7fe006d3d640 1 -- 172.21.15.148:0/2569437915 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe00019c620 con 0x7fe000100e20 2024-09-19T07:10:16.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.990+0000 7fdffdffb640 1 -- 172.21.15.148:0/2569437915 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff0035030 con 0x7fe000100e20 2024-09-19T07:10:16.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.990+0000 7fe006d3d640 1 -- 172.21.15.148:0/2569437915 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0001a3f60 con 0x7fe000100e20 2024-09-19T07:10:16.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.991+0000 7fe006d3d640 1 -- 172.21.15.148:0/2569437915 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0001021b0 con 0x7fe000100e20 2024-09-19T07:10:16.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.993+0000 7fdffdffb640 1 -- 172.21.15.148:0/2569437915 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fdff0042070 con 0x7fe000100e20 2024-09-19T07:10:16.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.993+0000 7fdffdffb640 1 --2- 172.21.15.148:0/2569437915 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fdfe80a32d0 0x7fdfe80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:16.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.993+0000 7fdffffff640 1 --2- 172.21.15.148:0/2569437915 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fdfe80a32d0 0x7fdfe80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:16.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.993+0000 7fdffdffb640 1 -- 172.21.15.148:0/2569437915 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7fdff00f02f0 con 0x7fe000100e20 2024-09-19T07:10:16.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.994+0000 7fdffffff640 1 --2- 172.21.15.148:0/2569437915 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fdfe80a32d0 0x7fdfe80a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe0000ffda0 tx=0x7fdff400b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:16.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:16.997+0000 7fdffdffb640 1 -- 172.21.15.148:0/2569437915 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdff0031de0 con 0x7fe000100e20 2024-09-19T07:10:17.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.172+0000 7fe006d3d640 1 -- 172.21.15.148:0/2569437915 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fe000198770 con 0x7fe000100e20 2024-09-19T07:10:17.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.173+0000 7fdffdffb640 1 -- 172.21.15.148:0/2569437915 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fe000198770 con 0x7fe000100e20 2024-09-19T07:10:17.174 INFO:teuthology.orchestra.run.smithi148.stdout:279172874268 2024-09-19T07:10:17.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.175+0000 7fe006d3d640 1 -- 172.21.15.148:0/2569437915 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fdfe80a32d0 msgr2=0x7fdfe80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:17.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.175+0000 7fe006d3d640 1 --2- 172.21.15.148:0/2569437915 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fdfe80a32d0 0x7fdfe80a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe0000ffda0 tx=0x7fdff400b410 comp rx=0 tx=0).stop 2024-09-19T07:10:17.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.175+0000 7fe006d3d640 1 -- 172.21.15.148:0/2569437915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe000100e20 msgr2=0x7fe0001973e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:17.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.175+0000 7fe006d3d640 1 --2- 172.21.15.148:0/2569437915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe000100e20 0x7fe0001973e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fdff0006010 tx=0x7fdff0003c10 comp rx=0 tx=0).stop 2024-09-19T07:10:17.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.175+0000 7fe006d3d640 1 -- 172.21.15.148:0/2569437915 shutdown_connections 2024-09-19T07:10:17.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.175+0000 7fe006d3d640 1 --2- 172.21.15.148:0/2569437915 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fdfe80a32d0 0x7fdfe80a5790 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:17.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.175+0000 7fe006d3d640 1 --2- 172.21.15.148:0/2569437915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe000102ef0 0x7fe00019bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:17.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.175+0000 7fe006d3d640 1 --2- 172.21.15.148:0/2569437915 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe000102570 0x7fe000197920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:17.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.175+0000 7fe006d3d640 1 --2- 172.21.15.148:0/2569437915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe000100e20 0x7fe0001973e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:17.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.175+0000 7fe006d3d640 1 -- 172.21.15.148:0/2569437915 >> 172.21.15.148:0/2569437915 conn(0x7fe0000fc7d0 msgr2=0x7fe0000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:17.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.175+0000 7fe006d3d640 1 -- 172.21.15.148:0/2569437915 shutdown_connections 2024-09-19T07:10:17.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.175+0000 7fe006d3d640 1 -- 172.21.15.148:0/2569437915 wait complete. 2024-09-19T07:10:17.390 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:17 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:10:17.390 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:17 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:10:17.390 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:17 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:10:17.390 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:17 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:10:17.391 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:17 smithi148 ceph-mon[31180]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:10:17.391 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:17 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/2569437915' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T07:10:17.416 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738443 got 34359738446 for osd.0 2024-09-19T07:10:17.416 DEBUG:teuthology.parallel:result is None 2024-09-19T07:10:17.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:17 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:10:17.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:17 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:10:17.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:17 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:10:17.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:17 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:10:17.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:17 smithi165 ceph-mon[35326]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:10:17.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:17 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/2569437915' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T07:10:17.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:17 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:10:17.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:17 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:10:17.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:17 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:10:17.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:17 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:10:17.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:17 smithi179 ceph-mon[35716]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:10:17.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:17 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/2569437915' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T07:10:17.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.781+0000 7f5116017640 1 -- 172.21.15.148:0/1125550779 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5110102790 msgr2=0x7f51101067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:17.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.781+0000 7f5116017640 1 --2- 172.21.15.148:0/1125550779 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5110102790 0x7f51101067e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5104009900 tx=0x7f510402a410 comp rx=0 tx=0).stop 2024-09-19T07:10:17.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.781+0000 7f5116017640 1 -- 172.21.15.148:0/1125550779 shutdown_connections 2024-09-19T07:10:17.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.781+0000 7f5116017640 1 --2- 172.21.15.148:0/1125550779 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5110106f10 0x7f511010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:17.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.781+0000 7f5116017640 1 --2- 172.21.15.148:0/1125550779 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5110102790 0x7f51101067e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:17.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.781+0000 7f5116017640 1 --2- 172.21.15.148:0/1125550779 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5110101de0 0x7f51101021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:17.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.781+0000 7f5116017640 1 -- 172.21.15.148:0/1125550779 >> 172.21.15.148:0/1125550779 conn(0x7f51100fd8c0 msgr2=0x7f51100ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:17.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.781+0000 7f5116017640 1 -- 172.21.15.148:0/1125550779 shutdown_connections 2024-09-19T07:10:17.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.781+0000 7f5116017640 1 -- 172.21.15.148:0/1125550779 wait complete. 2024-09-19T07:10:17.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.782+0000 7f5116017640 1 Processor -- start 2024-09-19T07:10:17.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.782+0000 7f5116017640 1 -- start start 2024-09-19T07:10:17.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.782+0000 7f5116017640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5110101de0 0x7f51101984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:17.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.782+0000 7f5116017640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5110102790 0x7f51101989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:17.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.782+0000 7f5116017640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5110106f10 0x7f511019cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:17.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.782+0000 7f5116017640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5110111f70 con 0x7f5110106f10 2024-09-19T07:10:17.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.782+0000 7f5116017640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5110111df0 con 0x7f5110102790 2024-09-19T07:10:17.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.782+0000 7f5116017640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f51101120f0 con 0x7f5110101de0 2024-09-19T07:10:17.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.782+0000 7f510ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5110106f10 0x7f511019cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:17.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.782+0000 7f510ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5110106f10 0x7f511019cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47352/0 (socket says 172.21.15.148:47352) 2024-09-19T07:10:17.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.782+0000 7f510ffff640 1 -- 172.21.15.148:0/2652440871 learned_addr learned my addr 172.21.15.148:0/2652440871 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:17.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.782+0000 7f510f7fe640 1 --2- 172.21.15.148:0/2652440871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5110101de0 0x7f51101984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:17.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.782+0000 7f510effd640 1 --2- 172.21.15.148:0/2652440871 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5110102790 0x7f51101989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:17.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.782+0000 7f510ffff640 1 -- 172.21.15.148:0/2652440871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5110101de0 msgr2=0x7f51101984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:17.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.782+0000 7f510ffff640 1 --2- 172.21.15.148:0/2652440871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5110101de0 0x7f51101984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:17.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.782+0000 7f510ffff640 1 -- 172.21.15.148:0/2652440871 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5110102790 msgr2=0x7f51101989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:17.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.782+0000 7f510ffff640 1 --2- 172.21.15.148:0/2652440871 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5110102790 0x7f51101989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:17.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.783+0000 7f510ffff640 1 -- 172.21.15.148:0/2652440871 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f511019d460 con 0x7f5110106f10 2024-09-19T07:10:17.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.783+0000 7f510effd640 1 --2- 172.21.15.148:0/2652440871 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5110102790 0x7f51101989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:10:17.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.783+0000 7f510ffff640 1 --2- 172.21.15.148:0/2652440871 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5110106f10 0x7f511019cd80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f510800eb10 tx=0x7f510800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:17.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.783+0000 7f510cff9640 1 -- 172.21.15.148:0/2652440871 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5108004b20 con 0x7f5110106f10 2024-09-19T07:10:17.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.783+0000 7f5116017640 1 -- 172.21.15.148:0/2652440871 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f511019d750 con 0x7f5110106f10 2024-09-19T07:10:17.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.783+0000 7f510cff9640 1 -- 172.21.15.148:0/2652440871 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5108004cc0 con 0x7f5110106f10 2024-09-19T07:10:17.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.783+0000 7f510cff9640 1 -- 172.21.15.148:0/2652440871 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5108010760 con 0x7f5110106f10 2024-09-19T07:10:17.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.783+0000 7f5116017640 1 -- 172.21.15.148:0/2652440871 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51101a5030 con 0x7f5110106f10 2024-09-19T07:10:17.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.784+0000 7f5116017640 1 -- 172.21.15.148:0/2652440871 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51101021c0 con 0x7f5110106f10 2024-09-19T07:10:17.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.785+0000 7f510cff9640 1 -- 172.21.15.148:0/2652440871 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f5108005020 con 0x7f5110106f10 2024-09-19T07:10:17.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.786+0000 7f510cff9640 1 --2- 172.21.15.148:0/2652440871 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f50f80a32d0 0x7f50f80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:17.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.786+0000 7f510f7fe640 1 --2- 172.21.15.148:0/2652440871 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f50f80a32d0 0x7f50f80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:17.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.786+0000 7f510cff9640 1 -- 172.21.15.148:0/2652440871 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7f51080cff80 con 0x7f5110106f10 2024-09-19T07:10:17.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.786+0000 7f510f7fe640 1 --2- 172.21.15.148:0/2652440871 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f50f80a32d0 0x7f50f80a5790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f51000058c0 tx=0x7f510000a250 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:17.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.790+0000 7f510cff9640 1 -- 172.21.15.148:0/2652440871 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f510809cb50 con 0x7f5110106f10 2024-09-19T07:10:17.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.965+0000 7f5116017640 1 -- 172.21.15.148:0/2652440871 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f511010a150 con 0x7f5110106f10 2024-09-19T07:10:17.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.965+0000 7f510cff9640 1 -- 172.21.15.148:0/2652440871 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f510809c450 con 0x7f5110106f10 2024-09-19T07:10:17.966 INFO:teuthology.orchestra.run.smithi148.stdout:197568495660 2024-09-19T07:10:17.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.968+0000 7f5116017640 1 -- 172.21.15.148:0/2652440871 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f50f80a32d0 msgr2=0x7f50f80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:17.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.968+0000 7f5116017640 1 --2- 172.21.15.148:0/2652440871 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f50f80a32d0 0x7f50f80a5790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f51000058c0 tx=0x7f510000a250 comp rx=0 tx=0).stop 2024-09-19T07:10:17.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.968+0000 7f5116017640 1 -- 172.21.15.148:0/2652440871 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5110106f10 msgr2=0x7f511019cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:17.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.968+0000 7f5116017640 1 --2- 172.21.15.148:0/2652440871 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5110106f10 0x7f511019cd80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f510800eb10 tx=0x7f510800c2d0 comp rx=0 tx=0).stop 2024-09-19T07:10:17.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.968+0000 7f5116017640 1 -- 172.21.15.148:0/2652440871 shutdown_connections 2024-09-19T07:10:17.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.968+0000 7f5116017640 1 --2- 172.21.15.148:0/2652440871 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f50f80a32d0 0x7f50f80a5790 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:17.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.968+0000 7f5116017640 1 --2- 172.21.15.148:0/2652440871 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5110106f10 0x7f511019cd80 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:17.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.968+0000 7f5116017640 1 --2- 172.21.15.148:0/2652440871 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5110102790 0x7f51101989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:17.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.968+0000 7f5116017640 1 --2- 172.21.15.148:0/2652440871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5110101de0 0x7f51101984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:17.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.968+0000 7f5116017640 1 -- 172.21.15.148:0/2652440871 >> 172.21.15.148:0/2652440871 conn(0x7f51100fd8c0 msgr2=0x7f51100fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:17.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.968+0000 7f5116017640 1 -- 172.21.15.148:0/2652440871 shutdown_connections 2024-09-19T07:10:17.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:17.968+0000 7f5116017640 1 -- 172.21.15.148:0/2652440871 wait complete. 2024-09-19T07:10:18.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:18 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/2652440871' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T07:10:18.674 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:18 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/2652440871' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T07:10:18.723 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:18 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/2652440871' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T07:10:18.751 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495657 got 197568495660 for osd.7 2024-09-19T07:10:18.751 DEBUG:teuthology.parallel:result is None 2024-09-19T07:10:18.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:18.946+0000 7ff7fb00b640 1 -- 172.21.15.148:0/469271391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7f4106f10 msgr2=0x7ff7f410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:18.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:18.946+0000 7ff7fb00b640 1 --2- 172.21.15.148:0/469271391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7f4106f10 0x7ff7f410ea90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec009ca0 tx=0x7ff7ec02a8c0 comp rx=0 tx=0).stop 2024-09-19T07:10:18.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:18.946+0000 7ff7fb00b640 1 -- 172.21.15.148:0/469271391 shutdown_connections 2024-09-19T07:10:18.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:18.946+0000 7ff7fb00b640 1 --2- 172.21.15.148:0/469271391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7f4106f10 0x7ff7f410ea90 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:18.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:18.946+0000 7ff7fb00b640 1 --2- 172.21.15.148:0/469271391 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7f4102790 0x7ff7f41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:18.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:18.946+0000 7ff7fb00b640 1 --2- 172.21.15.148:0/469271391 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff7f4101de0 0x7ff7f41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:18.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:18.946+0000 7ff7fb00b640 1 -- 172.21.15.148:0/469271391 >> 172.21.15.148:0/469271391 conn(0x7ff7f40fd8c0 msgr2=0x7ff7f40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:18.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:18.946+0000 7ff7fb00b640 1 -- 172.21.15.148:0/469271391 shutdown_connections 2024-09-19T07:10:18.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:18.946+0000 7ff7fb00b640 1 -- 172.21.15.148:0/469271391 wait complete. 2024-09-19T07:10:18.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:18.947+0000 7ff7fb00b640 1 Processor -- start 2024-09-19T07:10:18.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:18.947+0000 7ff7fb00b640 1 -- start start 2024-09-19T07:10:18.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:18.947+0000 7ff7fb00b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff7f4101de0 0x7ff7f41983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:18.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:18.947+0000 7ff7fb00b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7f4102790 0x7ff7f41988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:18.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:18.947+0000 7ff7fb00b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7f4106f10 0x7ff7f419cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:18.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:18.947+0000 7ff7fb00b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f4111f70 con 0x7ff7f4102790 2024-09-19T07:10:18.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:18.947+0000 7ff7fb00b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f4111df0 con 0x7ff7f4101de0 2024-09-19T07:10:18.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:18.947+0000 7ff7fb00b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f41120f0 con 0x7ff7f4106f10 2024-09-19T07:10:18.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:18.947+0000 7ff7f3fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7f4102790 0x7ff7f41988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:18.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:18.947+0000 7ff7f3fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7f4102790 0x7ff7f41988f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47368/0 (socket says 172.21.15.148:47368) 2024-09-19T07:10:18.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:18.947+0000 7ff7f3fff640 1 -- 172.21.15.148:0/128493587 learned_addr learned my addr 172.21.15.148:0/128493587 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:18.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:18.947+0000 7ff7f8da7640 1 --2- 172.21.15.148:0/128493587 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff7f4101de0 0x7ff7f41983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:18.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:18.947+0000 7ff7f95a8640 1 --2- 172.21.15.148:0/128493587 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7f4106f10 0x7ff7f419cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:18.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:18.947+0000 7ff7f3fff640 1 -- 172.21.15.148:0/128493587 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7f4106f10 msgr2=0x7ff7f419cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:18.951 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:18.947+0000 7ff7f3fff640 1 --2- 172.21.15.148:0/128493587 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7f4106f10 0x7ff7f419cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:18.951 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:18.947+0000 7ff7f3fff640 1 -- 172.21.15.148:0/128493587 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff7f4101de0 msgr2=0x7ff7f41983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:18.951 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:18.947+0000 7ff7f3fff640 1 --2- 172.21.15.148:0/128493587 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff7f4101de0 0x7ff7f41983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:18.951 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:18.947+0000 7ff7f3fff640 1 -- 172.21.15.148:0/128493587 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7f419d360 con 0x7ff7f4102790 2024-09-19T07:10:18.951 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:18.947+0000 7ff7f3fff640 1 --2- 172.21.15.148:0/128493587 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7f4102790 0x7ff7f41988f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff7e400d770 tx=0x7ff7e400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:18.951 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:18.948+0000 7ff7f1ffb640 1 -- 172.21.15.148:0/128493587 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e4017070 con 0x7ff7f4102790 2024-09-19T07:10:18.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:18.948+0000 7ff7f1ffb640 1 -- 172.21.15.148:0/128493587 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7e4005500 con 0x7ff7f4102790 2024-09-19T07:10:18.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:18.948+0000 7ff7fb00b640 1 -- 172.21.15.148:0/128493587 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7f419d650 con 0x7ff7f4102790 2024-09-19T07:10:18.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:18.948+0000 7ff7f1ffb640 1 -- 172.21.15.148:0/128493587 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e4004e00 con 0x7ff7f4102790 2024-09-19T07:10:18.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:18.948+0000 7ff7fb00b640 1 -- 172.21.15.148:0/128493587 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7f41a4f30 con 0x7ff7f4102790 2024-09-19T07:10:18.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:18.949+0000 7ff7fb00b640 1 -- 172.21.15.148:0/128493587 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7f41021c0 con 0x7ff7f4102790 2024-09-19T07:10:18.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:18.950+0000 7ff7f1ffb640 1 -- 172.21.15.148:0/128493587 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7ff7e4004fa0 con 0x7ff7f4102790 2024-09-19T07:10:18.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:18.950+0000 7ff7f1ffb640 1 --2- 172.21.15.148:0/128493587 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff7e00a3350 0x7ff7e00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:18.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:18.951+0000 7ff7f8da7640 1 --2- 172.21.15.148:0/128493587 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff7e00a3350 0x7ff7e00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:18.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:18.951+0000 7ff7f1ffb640 1 -- 172.21.15.148:0/128493587 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7ff7e40cf430 con 0x7ff7f4102790 2024-09-19T07:10:18.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:18.951+0000 7ff7f8da7640 1 --2- 172.21.15.148:0/128493587 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff7e00a3350 0x7ff7e00a5810 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc0058c0 tx=0x7ff7dc00a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:18.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:18.955+0000 7ff7f1ffb640 1 -- 172.21.15.148:0/128493587 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff7e409c000 con 0x7ff7f4102790 2024-09-19T07:10:19.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.129+0000 7ff7fb00b640 1 -- 172.21.15.148:0/128493587 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7ff7f410a0f0 con 0x7ff7f4102790 2024-09-19T07:10:19.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.129+0000 7ff7f1ffb640 1 -- 172.21.15.148:0/128493587 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7ff7e409b900 con 0x7ff7f4102790 2024-09-19T07:10:19.130 INFO:teuthology.orchestra.run.smithi148.stdout:309237645337 2024-09-19T07:10:19.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.131+0000 7ff7fb00b640 1 -- 172.21.15.148:0/128493587 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff7e00a3350 msgr2=0x7ff7e00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:19.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.131+0000 7ff7fb00b640 1 --2- 172.21.15.148:0/128493587 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff7e00a3350 0x7ff7e00a5810 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc0058c0 tx=0x7ff7dc00a2d0 comp rx=0 tx=0).stop 2024-09-19T07:10:19.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.131+0000 7ff7fb00b640 1 -- 172.21.15.148:0/128493587 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7f4102790 msgr2=0x7ff7f41988f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:19.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.131+0000 7ff7fb00b640 1 --2- 172.21.15.148:0/128493587 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7f4102790 0x7ff7f41988f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff7e400d770 tx=0x7ff7e400dc30 comp rx=0 tx=0).stop 2024-09-19T07:10:19.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.131+0000 7ff7fb00b640 1 -- 172.21.15.148:0/128493587 shutdown_connections 2024-09-19T07:10:19.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.131+0000 7ff7fb00b640 1 --2- 172.21.15.148:0/128493587 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff7e00a3350 0x7ff7e00a5810 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:19.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.131+0000 7ff7fb00b640 1 --2- 172.21.15.148:0/128493587 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7f4106f10 0x7ff7f419cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:19.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.131+0000 7ff7fb00b640 1 --2- 172.21.15.148:0/128493587 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7f4102790 0x7ff7f41988f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:19.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.131+0000 7ff7fb00b640 1 --2- 172.21.15.148:0/128493587 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff7f4101de0 0x7ff7f41983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:19.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.131+0000 7ff7fb00b640 1 -- 172.21.15.148:0/128493587 >> 172.21.15.148:0/128493587 conn(0x7ff7f40fd8c0 msgr2=0x7ff7f40fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:19.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.131+0000 7ff7fb00b640 1 -- 172.21.15.148:0/128493587 shutdown_connections 2024-09-19T07:10:19.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.131+0000 7ff7fb00b640 1 -- 172.21.15.148:0/128493587 wait complete. 2024-09-19T07:10:19.422 INFO:tasks.cephadm.ceph_manager.ceph:need seq 279172874266 got 279172874268 for osd.10 2024-09-19T07:10:19.422 DEBUG:teuthology.parallel:result is None 2024-09-19T07:10:19.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:19 smithi165 ceph-mon[35326]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:10:19.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:19 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/128493587' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T07:10:19.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:19 smithi179 ceph-mon[35716]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:10:19.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:19 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/128493587' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T07:10:19.780 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:19 smithi148 ceph-mon[31180]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:10:19.780 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:19 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/128493587' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T07:10:19.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.862+0000 7f1268fad640 1 -- 172.21.15.148:0/193783139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1264102790 msgr2=0x7f12641067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:19.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.862+0000 7f1268fad640 1 --2- 172.21.15.148:0/193783139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1264102790 0x7f12641067e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1258009900 tx=0x7f125802a410 comp rx=0 tx=0).stop 2024-09-19T07:10:19.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.862+0000 7f1268fad640 1 -- 172.21.15.148:0/193783139 shutdown_connections 2024-09-19T07:10:19.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.862+0000 7f1268fad640 1 --2- 172.21.15.148:0/193783139 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1264106f10 0x7f126410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:19.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.862+0000 7f1268fad640 1 --2- 172.21.15.148:0/193783139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1264102790 0x7f12641067e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:19.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.862+0000 7f1268fad640 1 --2- 172.21.15.148:0/193783139 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1264101de0 0x7f12641021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:19.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.862+0000 7f1268fad640 1 -- 172.21.15.148:0/193783139 >> 172.21.15.148:0/193783139 conn(0x7f12640fd8c0 msgr2=0x7f12640ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:19.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.863+0000 7f1268fad640 1 -- 172.21.15.148:0/193783139 shutdown_connections 2024-09-19T07:10:19.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.863+0000 7f1268fad640 1 -- 172.21.15.148:0/193783139 wait complete. 2024-09-19T07:10:19.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.863+0000 7f1268fad640 1 Processor -- start 2024-09-19T07:10:19.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.864+0000 7f1268fad640 1 -- start start 2024-09-19T07:10:19.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.864+0000 7f1268fad640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1264101de0 0x7f1264198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:19.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.864+0000 7f1268fad640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1264102790 0x7f12641989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:19.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.864+0000 7f1268fad640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1264106f10 0x7f126419cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:19.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.864+0000 7f1268fad640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1264111f70 con 0x7f1264102790 2024-09-19T07:10:19.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.864+0000 7f1268fad640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1264111df0 con 0x7f1264106f10 2024-09-19T07:10:19.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.864+0000 7f1268fad640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f12641120f0 con 0x7f1264101de0 2024-09-19T07:10:19.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.864+0000 7f1261d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1264102790 0x7f12641989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:19.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.864+0000 7f1261d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1264102790 0x7f12641989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47392/0 (socket says 172.21.15.148:47392) 2024-09-19T07:10:19.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.864+0000 7f1261d9b640 1 -- 172.21.15.148:0/3642377735 learned_addr learned my addr 172.21.15.148:0/3642377735 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:19.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.864+0000 7f126259c640 1 --2- 172.21.15.148:0/3642377735 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1264101de0 0x7f1264198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:19.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.864+0000 7f1262d9d640 1 --2- 172.21.15.148:0/3642377735 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1264106f10 0x7f126419cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:19.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.864+0000 7f1261d9b640 1 -- 172.21.15.148:0/3642377735 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1264101de0 msgr2=0x7f1264198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:19.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.864+0000 7f1261d9b640 1 --2- 172.21.15.148:0/3642377735 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1264101de0 0x7f1264198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:19.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.864+0000 7f1261d9b640 1 -- 172.21.15.148:0/3642377735 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1264106f10 msgr2=0x7f126419cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:19.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.864+0000 7f1261d9b640 1 --2- 172.21.15.148:0/3642377735 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1264106f10 0x7f126419cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:19.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.864+0000 7f1261d9b640 1 -- 172.21.15.148:0/3642377735 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f126419d420 con 0x7f1264102790 2024-09-19T07:10:19.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.864+0000 7f1262d9d640 1 --2- 172.21.15.148:0/3642377735 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1264106f10 0x7f126419cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:10:19.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.865+0000 7f1261d9b640 1 --2- 172.21.15.148:0/3642377735 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1264102790 0x7f12641989b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1258006010 tx=0x7f12580042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:19.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.865+0000 7f12537fe640 1 -- 172.21.15.148:0/3642377735 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f125803f030 con 0x7f1264102790 2024-09-19T07:10:19.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.865+0000 7f12537fe640 1 -- 172.21.15.148:0/3642377735 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1258003ce0 con 0x7f1264102790 2024-09-19T07:10:19.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.865+0000 7f1268fad640 1 -- 172.21.15.148:0/3642377735 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f126419d6b0 con 0x7f1264102790 2024-09-19T07:10:19.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.865+0000 7f12537fe640 1 -- 172.21.15.148:0/3642377735 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1258035070 con 0x7f1264102790 2024-09-19T07:10:19.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.865+0000 7f1268fad640 1 -- 172.21.15.148:0/3642377735 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1264074420 con 0x7f1264102790 2024-09-19T07:10:19.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.866+0000 7f1268fad640 1 -- 172.21.15.148:0/3642377735 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12641032c0 con 0x7f1264102790 2024-09-19T07:10:19.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.868+0000 7f12537fe640 1 -- 172.21.15.148:0/3642377735 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f1258042030 con 0x7f1264102790 2024-09-19T07:10:19.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.868+0000 7f12537fe640 1 --2- 172.21.15.148:0/3642377735 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f124c0a32d0 0x7f124c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:19.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.869+0000 7f126259c640 1 --2- 172.21.15.148:0/3642377735 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f124c0a32d0 0x7f124c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:19.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.869+0000 7f12537fe640 1 -- 172.21.15.148:0/3642377735 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7f12580f03b0 con 0x7f1264102790 2024-09-19T07:10:19.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.869+0000 7f126259c640 1 --2- 172.21.15.148:0/3642377735 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f124c0a32d0 0x7f124c0a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f12540058c0 tx=0x7f125400a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:19.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:19.871+0000 7f12537fe640 1 -- 172.21.15.148:0/3642377735 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f12580bd040 con 0x7f1264102790 2024-09-19T07:10:20.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:20.043+0000 7f1268fad640 1 -- 172.21.15.148:0/3642377735 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f12641021c0 con 0x7f1264102790 2024-09-19T07:10:20.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:20.043+0000 7f12537fe640 1 -- 172.21.15.148:0/3642377735 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f12641021c0 con 0x7f1264102790 2024-09-19T07:10:20.044 INFO:teuthology.orchestra.run.smithi148.stdout:51539607627 2024-09-19T07:10:20.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:20.045+0000 7f1268fad640 1 -- 172.21.15.148:0/3642377735 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f124c0a32d0 msgr2=0x7f124c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:20.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:20.045+0000 7f1268fad640 1 --2- 172.21.15.148:0/3642377735 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f124c0a32d0 0x7f124c0a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f12540058c0 tx=0x7f125400a2d0 comp rx=0 tx=0).stop 2024-09-19T07:10:20.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:20.045+0000 7f1268fad640 1 -- 172.21.15.148:0/3642377735 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1264102790 msgr2=0x7f12641989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:20.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:20.045+0000 7f1268fad640 1 --2- 172.21.15.148:0/3642377735 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1264102790 0x7f12641989b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1258006010 tx=0x7f12580042f0 comp rx=0 tx=0).stop 2024-09-19T07:10:20.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:20.046+0000 7f1268fad640 1 -- 172.21.15.148:0/3642377735 shutdown_connections 2024-09-19T07:10:20.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:20.046+0000 7f1268fad640 1 --2- 172.21.15.148:0/3642377735 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f124c0a32d0 0x7f124c0a5790 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:20.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:20.046+0000 7f1268fad640 1 --2- 172.21.15.148:0/3642377735 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1264106f10 0x7f126419cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:20.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:20.046+0000 7f1268fad640 1 --2- 172.21.15.148:0/3642377735 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1264102790 0x7f12641989b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:20.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:20.046+0000 7f1268fad640 1 --2- 172.21.15.148:0/3642377735 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1264101de0 0x7f1264198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:20.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:20.046+0000 7f1268fad640 1 -- 172.21.15.148:0/3642377735 >> 172.21.15.148:0/3642377735 conn(0x7f12640fd8c0 msgr2=0x7f12640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:20.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:20.046+0000 7f1268fad640 1 -- 172.21.15.148:0/3642377735 shutdown_connections 2024-09-19T07:10:20.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:20.046+0000 7f1268fad640 1 -- 172.21.15.148:0/3642377735 wait complete. 2024-09-19T07:10:20.321 INFO:tasks.cephadm.ceph_manager.ceph:need seq 257698037791 got 257698037794 for osd.9 2024-09-19T07:10:20.321 DEBUG:teuthology.parallel:result is None 2024-09-19T07:10:20.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:20 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/3642377735' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T07:10:20.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:20 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/3642377735' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T07:10:20.723 INFO:tasks.cephadm.ceph_manager.ceph:need seq 309237645335 got 309237645337 for osd.11 2024-09-19T07:10:20.723 DEBUG:teuthology.parallel:result is None 2024-09-19T07:10:20.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:20 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/3642377735' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T07:10:21.385 INFO:tasks.cephadm.ceph_manager.ceph:need seq 51539607622 got 51539607627 for osd.1 2024-09-19T07:10:21.386 DEBUG:teuthology.parallel:result is None 2024-09-19T07:10:21.386 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T07:10:21.386 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T07:10:21.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:21 smithi165 ceph-mon[35326]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:10:21.634 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:21 smithi148 ceph-mon[31180]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:10:21.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:21 smithi179 ceph-mon[35716]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:10:22.169 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:10:22.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.659+0000 7efdaaf91640 1 -- 172.21.15.148:0/3194505422 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efda4106a80 msgr2=0x7efda4106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:22.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.659+0000 7efdaaf91640 1 --2- 172.21.15.148:0/3194505422 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efda4106a80 0x7efda4106e60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7efd98009930 tx=0x7efd9802a420 comp rx=0 tx=0).stop 2024-09-19T07:10:22.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.659+0000 7efdaaf91640 1 -- 172.21.15.148:0/3194505422 shutdown_connections 2024-09-19T07:10:22.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.659+0000 7efdaaf91640 1 --2- 172.21.15.148:0/3194505422 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efda4101420 0x7efda410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:22.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.659+0000 7efdaaf91640 1 --2- 172.21.15.148:0/3194505422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efda4100a80 0x7efda4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:22.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.659+0000 7efdaaf91640 1 --2- 172.21.15.148:0/3194505422 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efda4106a80 0x7efda4106e60 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:22.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.659+0000 7efdaaf91640 1 -- 172.21.15.148:0/3194505422 >> 172.21.15.148:0/3194505422 conn(0x7efda40fc7a0 msgr2=0x7efda40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:22.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.659+0000 7efdaaf91640 1 -- 172.21.15.148:0/3194505422 shutdown_connections 2024-09-19T07:10:22.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.659+0000 7efdaaf91640 1 -- 172.21.15.148:0/3194505422 wait complete. 2024-09-19T07:10:22.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.659+0000 7efdaaf91640 1 Processor -- start 2024-09-19T07:10:22.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.659+0000 7efdaaf91640 1 -- start start 2024-09-19T07:10:22.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.660+0000 7efdaaf91640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efda4100a80 0x7efda4197060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:22.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.660+0000 7efdaaf91640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efda4101420 0x7efda41975a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:22.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.660+0000 7efdaaf91640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efda4106a80 0x7efda4197ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:22.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.660+0000 7efdaaf91640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7efda4110e80 con 0x7efda4100a80 2024-09-19T07:10:22.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.660+0000 7efdaaf91640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7efda4110d00 con 0x7efda4101420 2024-09-19T07:10:22.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.660+0000 7efdaaf91640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7efda4111000 con 0x7efda4106a80 2024-09-19T07:10:22.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.660+0000 7efda8d2d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efda4100a80 0x7efda4197060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:22.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.660+0000 7efda8d2d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efda4100a80 0x7efda4197060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47410/0 (socket says 172.21.15.148:47410) 2024-09-19T07:10:22.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.660+0000 7efda8d2d640 1 -- 172.21.15.148:0/3338060253 learned_addr learned my addr 172.21.15.148:0/3338060253 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:22.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.660+0000 7efda952e640 1 --2- 172.21.15.148:0/3338060253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efda4106a80 0x7efda4197ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:22.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.660+0000 7efda3fff640 1 --2- 172.21.15.148:0/3338060253 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efda4101420 0x7efda41975a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:22.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.660+0000 7efda8d2d640 1 -- 172.21.15.148:0/3338060253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efda4106a80 msgr2=0x7efda4197ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:22.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.660+0000 7efda8d2d640 1 --2- 172.21.15.148:0/3338060253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efda4106a80 0x7efda4197ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:22.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.660+0000 7efda8d2d640 1 -- 172.21.15.148:0/3338060253 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efda4101420 msgr2=0x7efda41975a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:22.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.660+0000 7efda8d2d640 1 --2- 172.21.15.148:0/3338060253 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efda4101420 0x7efda41975a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:22.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.660+0000 7efda8d2d640 1 -- 172.21.15.148:0/3338060253 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efda41a68d0 con 0x7efda4100a80 2024-09-19T07:10:22.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.660+0000 7efda8d2d640 1 --2- 172.21.15.148:0/3338060253 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efda4100a80 0x7efda4197060 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7efd98009230 tx=0x7efd98004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:22.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.660+0000 7efda1ffb640 1 -- 172.21.15.148:0/3338060253 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd9803f030 con 0x7efda4100a80 2024-09-19T07:10:22.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.660+0000 7efdaaf91640 1 -- 172.21.15.148:0/3338060253 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efda41a6b60 con 0x7efda4100a80 2024-09-19T07:10:22.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.660+0000 7efda1ffb640 1 -- 172.21.15.148:0/3338060253 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd98003ad0 con 0x7efda4100a80 2024-09-19T07:10:22.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.660+0000 7efda1ffb640 1 -- 172.21.15.148:0/3338060253 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd98035070 con 0x7efda4100a80 2024-09-19T07:10:22.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.661+0000 7efdaaf91640 1 -- 172.21.15.148:0/3338060253 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efda41a7090 con 0x7efda4100a80 2024-09-19T07:10:22.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.662+0000 7efdaaf91640 1 -- 172.21.15.148:0/3338060253 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efda4100ee0 con 0x7efda4100a80 2024-09-19T07:10:22.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.663+0000 7efda1ffb640 1 -- 172.21.15.148:0/3338060253 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7efd98042030 con 0x7efda4100a80 2024-09-19T07:10:22.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.663+0000 7efda1ffb640 1 --2- 172.21.15.148:0/3338060253 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7efd940a32d0 0x7efd940a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:22.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.663+0000 7efda3fff640 1 --2- 172.21.15.148:0/3338060253 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7efd940a32d0 0x7efd940a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:22.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.663+0000 7efda1ffb640 1 -- 172.21.15.148:0/3338060253 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7efd980efeb0 con 0x7efda4100a80 2024-09-19T07:10:22.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.664+0000 7efda3fff640 1 --2- 172.21.15.148:0/3338060253 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7efd940a32d0 0x7efd940a5790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7efda41991c0 tx=0x7efd9000b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:22.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.667+0000 7efda1ffb640 1 -- 172.21.15.148:0/3338060253 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7efd980bc430 con 0x7efda4100a80 2024-09-19T07:10:22.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.879+0000 7efdaaf91640 1 -- 172.21.15.148:0/3338060253 --> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efda4109050 con 0x7efd940a32d0 2024-09-19T07:10:22.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.888+0000 7efda1ffb640 1 -- 172.21.15.148:0/3338060253 <== mgr.14148 v2:172.21.15.148:6800/3007822654 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258719 (secure 0 0 0) 0x7efda4109050 con 0x7efd940a32d0 2024-09-19T07:10:22.891 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:10:22.892 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2024-09-19T07:10:22.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.891+0000 7efdaaf91640 1 -- 172.21.15.148:0/3338060253 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7efd940a32d0 msgr2=0x7efd940a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:22.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.891+0000 7efdaaf91640 1 --2- 172.21.15.148:0/3338060253 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7efd940a32d0 0x7efd940a5790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7efda41991c0 tx=0x7efd9000b390 comp rx=0 tx=0).stop 2024-09-19T07:10:22.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.892+0000 7efdaaf91640 1 -- 172.21.15.148:0/3338060253 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efda4100a80 msgr2=0x7efda4197060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:22.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.892+0000 7efdaaf91640 1 --2- 172.21.15.148:0/3338060253 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efda4100a80 0x7efda4197060 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7efd98009230 tx=0x7efd98004270 comp rx=0 tx=0).stop 2024-09-19T07:10:22.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.892+0000 7efdaaf91640 1 -- 172.21.15.148:0/3338060253 shutdown_connections 2024-09-19T07:10:22.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.892+0000 7efdaaf91640 1 --2- 172.21.15.148:0/3338060253 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7efd940a32d0 0x7efd940a5790 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:22.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.892+0000 7efdaaf91640 1 --2- 172.21.15.148:0/3338060253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efda4106a80 0x7efda4197ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:22.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.892+0000 7efdaaf91640 1 --2- 172.21.15.148:0/3338060253 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efda4101420 0x7efda41975a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:22.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.892+0000 7efdaaf91640 1 --2- 172.21.15.148:0/3338060253 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efda4100a80 0x7efda4197060 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:22.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.892+0000 7efdaaf91640 1 -- 172.21.15.148:0/3338060253 >> 172.21.15.148:0/3338060253 conn(0x7efda40fc7a0 msgr2=0x7efda40fcf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:22.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.892+0000 7efdaaf91640 1 -- 172.21.15.148:0/3338060253 shutdown_connections 2024-09-19T07:10:22.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:22.892+0000 7efdaaf91640 1 -- 172.21.15.148:0/3338060253 wait complete. 2024-09-19T07:10:23.544 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":302,"stamp":"2024-09-19T07:10:21.098384+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654762,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":464,"num_read_kb":345,"num_write":349,"num_write_kb":3051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1207683,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":279,"ondisk_log_size":279,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":382484,"kb_used_data":12396,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124559340,"statfs":{"total":1151940427776,"available":1151548764160,"internally_reserved":0,"allocated":12693504,"data_stored":7098366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":378713402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":40,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002724"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.173070+0000","last_change":"2024-09-19T07:09:18.926902+0000","last_active":"2024-09-19T07:09:38.173070+0000","last_peered":"2024-09-19T07:09:38.173070+0000","last_clean":"2024-09-19T07:09:38.173070+0000","last_became_active":"2024-09-19T07:09:18.926582+0000","last_became_peered":"2024-09-19T07:09:18.926582+0000","last_unstale":"2024-09-19T07:09:38.173070+0000","last_undegraded":"2024-09-19T07:09:38.173070+0000","last_fullsized":"2024-09-19T07:09:38.173070+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:37.875779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.178193+0000","last_change":"2024-09-19T07:09:18.934205+0000","last_active":"2024-09-19T07:09:38.178193+0000","last_peered":"2024-09-19T07:09:38.178193+0000","last_clean":"2024-09-19T07:09:38.178193+0000","last_became_active":"2024-09-19T07:09:18.933767+0000","last_became_peered":"2024-09-19T07:09:18.933767+0000","last_unstale":"2024-09-19T07:09:38.178193+0000","last_undegraded":"2024-09-19T07:09:38.178193+0000","last_fullsized":"2024-09-19T07:09:38.178193+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:10:45.391428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.177846+0000","last_change":"2024-09-19T07:09:18.922312+0000","last_active":"2024-09-19T07:09:38.177846+0000","last_peered":"2024-09-19T07:09:38.177846+0000","last_clean":"2024-09-19T07:09:38.177846+0000","last_became_active":"2024-09-19T07:09:18.921476+0000","last_became_peered":"2024-09-19T07:09:18.921476+0000","last_unstale":"2024-09-19T07:09:38.177846+0000","last_undegraded":"2024-09-19T07:09:38.177846+0000","last_fullsized":"2024-09-19T07:09:38.177846+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:29.470616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.217953+0000","last_change":"2024-09-19T07:09:18.938218+0000","last_active":"2024-09-19T07:09:38.217953+0000","last_peered":"2024-09-19T07:09:38.217953+0000","last_clean":"2024-09-19T07:09:38.217953+0000","last_became_active":"2024-09-19T07:09:18.937306+0000","last_became_peered":"2024-09-19T07:09:18.937306+0000","last_unstale":"2024-09-19T07:09:38.217953+0000","last_undegraded":"2024-09-19T07:09:38.217953+0000","last_fullsized":"2024-09-19T07:09:38.217953+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:54.146506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.176208+0000","last_change":"2024-09-19T07:09:18.925837+0000","last_active":"2024-09-19T07:09:38.176208+0000","last_peered":"2024-09-19T07:09:38.176208+0000","last_clean":"2024-09-19T07:09:38.176208+0000","last_became_active":"2024-09-19T07:09:18.925559+0000","last_became_peered":"2024-09-19T07:09:18.925559+0000","last_unstale":"2024-09-19T07:09:38.176208+0000","last_undegraded":"2024-09-19T07:09:38.176208+0000","last_fullsized":"2024-09-19T07:09:38.176208+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:15:58.348347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.172737+0000","last_change":"2024-09-19T07:09:18.938911+0000","last_active":"2024-09-19T07:09:38.172737+0000","last_peered":"2024-09-19T07:09:38.172737+0000","last_clean":"2024-09-19T07:09:38.172737+0000","last_became_active":"2024-09-19T07:09:18.938601+0000","last_became_peered":"2024-09-19T07:09:18.938601+0000","last_unstale":"2024-09-19T07:09:38.172737+0000","last_undegraded":"2024-09-19T07:09:38.172737+0000","last_fullsized":"2024-09-19T07:09:38.172737+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:34.517324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175176+0000","last_change":"2024-09-19T07:09:18.930253+0000","last_active":"2024-09-19T07:09:38.175176+0000","last_peered":"2024-09-19T07:09:38.175176+0000","last_clean":"2024-09-19T07:09:38.175176+0000","last_became_active":"2024-09-19T07:09:18.929927+0000","last_became_peered":"2024-09-19T07:09:18.929927+0000","last_unstale":"2024-09-19T07:09:38.175176+0000","last_undegraded":"2024-09-19T07:09:38.175176+0000","last_fullsized":"2024-09-19T07:09:38.175176+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:31:39.186230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.180634+0000","last_change":"2024-09-19T07:09:38.180197+0000","last_active":"2024-09-19T07:09:38.180634+0000","last_peered":"2024-09-19T07:09:38.180634+0000","last_clean":"2024-09-19T07:09:38.180634+0000","last_became_active":"2024-09-19T07:09:38.179767+0000","last_became_peered":"2024-09-19T07:09:38.179767+0000","last_unstale":"2024-09-19T07:09:38.180634+0000","last_undegraded":"2024-09-19T07:09:38.180634+0000","last_fullsized":"2024-09-19T07:09:38.180634+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:43.581181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.176298+0000","last_change":"2024-09-19T07:09:18.937100+0000","last_active":"2024-09-19T07:09:38.176298+0000","last_peered":"2024-09-19T07:09:38.176298+0000","last_clean":"2024-09-19T07:09:38.176298+0000","last_became_active":"2024-09-19T07:09:18.935151+0000","last_became_peered":"2024-09-19T07:09:18.935151+0000","last_unstale":"2024-09-19T07:09:38.176298+0000","last_undegraded":"2024-09-19T07:09:38.176298+0000","last_fullsized":"2024-09-19T07:09:38.176298+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:46:30.950667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.173253+0000","last_change":"2024-09-19T07:09:18.940119+0000","last_active":"2024-09-19T07:09:38.173253+0000","last_peered":"2024-09-19T07:09:38.173253+0000","last_clean":"2024-09-19T07:09:38.173253+0000","last_became_active":"2024-09-19T07:09:18.939703+0000","last_became_peered":"2024-09-19T07:09:18.939703+0000","last_unstale":"2024-09-19T07:09:38.173253+0000","last_undegraded":"2024-09-19T07:09:38.173253+0000","last_fullsized":"2024-09-19T07:09:38.173253+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:51:04.982727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175765+0000","last_change":"2024-09-19T07:09:18.939146+0000","last_active":"2024-09-19T07:09:38.175765+0000","last_peered":"2024-09-19T07:09:38.175765+0000","last_clean":"2024-09-19T07:09:38.175765+0000","last_became_active":"2024-09-19T07:09:18.936842+0000","last_became_peered":"2024-09-19T07:09:18.936842+0000","last_unstale":"2024-09-19T07:09:38.175765+0000","last_undegraded":"2024-09-19T07:09:38.175765+0000","last_fullsized":"2024-09-19T07:09:38.175765+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:32.713505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.179358+0000","last_change":"2024-09-19T07:09:38.178834+0000","last_active":"2024-09-19T07:09:38.179358+0000","last_peered":"2024-09-19T07:09:38.179358+0000","last_clean":"2024-09-19T07:09:38.179358+0000","last_became_active":"2024-09-19T07:09:38.178477+0000","last_became_peered":"2024-09-19T07:09:38.178477+0000","last_unstale":"2024-09-19T07:09:38.179358+0000","last_undegraded":"2024-09-19T07:09:38.179358+0000","last_fullsized":"2024-09-19T07:09:38.179358+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:04:44.524920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.392086+0000","last_change":"2024-09-19T07:09:18.935422+0000","last_active":"2024-09-19T07:09:38.392086+0000","last_peered":"2024-09-19T07:09:38.392086+0000","last_clean":"2024-09-19T07:09:38.392086+0000","last_became_active":"2024-09-19T07:09:18.934994+0000","last_became_peered":"2024-09-19T07:09:18.934994+0000","last_unstale":"2024-09-19T07:09:38.392086+0000","last_undegraded":"2024-09-19T07:09:38.392086+0000","last_fullsized":"2024-09-19T07:09:38.392086+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:37:30.751247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.177649+0000","last_change":"2024-09-19T07:09:18.933954+0000","last_active":"2024-09-19T07:09:38.177649+0000","last_peered":"2024-09-19T07:09:38.177649+0000","last_clean":"2024-09-19T07:09:38.177649+0000","last_became_active":"2024-09-19T07:09:18.933588+0000","last_became_peered":"2024-09-19T07:09:18.933588+0000","last_unstale":"2024-09-19T07:09:38.177649+0000","last_undegraded":"2024-09-19T07:09:38.177649+0000","last_fullsized":"2024-09-19T07:09:38.177649+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:10.161172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.177587+0000","last_change":"2024-09-19T07:09:18.932122+0000","last_active":"2024-09-19T07:09:38.177587+0000","last_peered":"2024-09-19T07:09:38.177587+0000","last_clean":"2024-09-19T07:09:38.177587+0000","last_became_active":"2024-09-19T07:09:18.931798+0000","last_became_peered":"2024-09-19T07:09:18.931798+0000","last_unstale":"2024-09-19T07:09:38.177587+0000","last_undegraded":"2024-09-19T07:09:38.177587+0000","last_fullsized":"2024-09-19T07:09:38.177587+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:44.776375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175320+0000","last_change":"2024-09-19T07:09:18.935632+0000","last_active":"2024-09-19T07:09:38.175320+0000","last_peered":"2024-09-19T07:09:38.175320+0000","last_clean":"2024-09-19T07:09:38.175320+0000","last_became_active":"2024-09-19T07:09:18.935174+0000","last_became_peered":"2024-09-19T07:09:18.935174+0000","last_unstale":"2024-09-19T07:09:38.175320+0000","last_undegraded":"2024-09-19T07:09:38.175320+0000","last_fullsized":"2024-09-19T07:09:38.175320+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:22.170777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.173065+0000","last_change":"2024-09-19T07:09:18.931836+0000","last_active":"2024-09-19T07:09:38.173065+0000","last_peered":"2024-09-19T07:09:38.173065+0000","last_clean":"2024-09-19T07:09:38.173065+0000","last_became_active":"2024-09-19T07:09:18.931564+0000","last_became_peered":"2024-09-19T07:09:18.931564+0000","last_unstale":"2024-09-19T07:09:38.173065+0000","last_undegraded":"2024-09-19T07:09:38.173065+0000","last_fullsized":"2024-09-19T07:09:38.173065+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:53.674584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.173640+0000","last_change":"2024-09-19T07:09:18.933210+0000","last_active":"2024-09-19T07:09:38.173640+0000","last_peered":"2024-09-19T07:09:38.173640+0000","last_clean":"2024-09-19T07:09:38.173640+0000","last_became_active":"2024-09-19T07:09:18.932894+0000","last_became_peered":"2024-09-19T07:09:18.932894+0000","last_unstale":"2024-09-19T07:09:38.173640+0000","last_undegraded":"2024-09-19T07:09:38.173640+0000","last_fullsized":"2024-09-19T07:09:38.173640+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:50:56.669801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175421+0000","last_change":"2024-09-19T07:09:18.925627+0000","last_active":"2024-09-19T07:09:38.175421+0000","last_peered":"2024-09-19T07:09:38.175421+0000","last_clean":"2024-09-19T07:09:38.175421+0000","last_became_active":"2024-09-19T07:09:18.925340+0000","last_became_peered":"2024-09-19T07:09:18.925340+0000","last_unstale":"2024-09-19T07:09:38.175421+0000","last_undegraded":"2024-09-19T07:09:38.175421+0000","last_fullsized":"2024-09-19T07:09:38.175421+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:29.544534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.172766+0000","last_change":"2024-09-19T07:09:18.936963+0000","last_active":"2024-09-19T07:09:38.172766+0000","last_peered":"2024-09-19T07:09:38.172766+0000","last_clean":"2024-09-19T07:09:38.172766+0000","last_became_active":"2024-09-19T07:09:18.936615+0000","last_became_peered":"2024-09-19T07:09:18.936615+0000","last_unstale":"2024-09-19T07:09:38.172766+0000","last_undegraded":"2024-09-19T07:09:38.172766+0000","last_fullsized":"2024-09-19T07:09:38.172766+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:13.036392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.392101+0000","last_change":"2024-09-19T07:09:18.932018+0000","last_active":"2024-09-19T07:09:38.392101+0000","last_peered":"2024-09-19T07:09:38.392101+0000","last_clean":"2024-09-19T07:09:38.392101+0000","last_became_active":"2024-09-19T07:09:18.931624+0000","last_became_peered":"2024-09-19T07:09:18.931624+0000","last_unstale":"2024-09-19T07:09:38.392101+0000","last_undegraded":"2024-09-19T07:09:38.392101+0000","last_fullsized":"2024-09-19T07:09:38.392101+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:53:05.585166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175898+0000","last_change":"2024-09-19T07:09:18.935474+0000","last_active":"2024-09-19T07:09:38.175898+0000","last_peered":"2024-09-19T07:09:38.175898+0000","last_clean":"2024-09-19T07:09:38.175898+0000","last_became_active":"2024-09-19T07:09:18.929018+0000","last_became_peered":"2024-09-19T07:09:18.929018+0000","last_unstale":"2024-09-19T07:09:38.175898+0000","last_undegraded":"2024-09-19T07:09:38.175898+0000","last_fullsized":"2024-09-19T07:09:38.175898+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:01.383024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.171441+0000","last_change":"2024-09-19T07:09:18.928733+0000","last_active":"2024-09-19T07:09:38.171441+0000","last_peered":"2024-09-19T07:09:38.171441+0000","last_clean":"2024-09-19T07:09:38.171441+0000","last_became_active":"2024-09-19T07:09:18.928431+0000","last_became_peered":"2024-09-19T07:09:18.928431+0000","last_unstale":"2024-09-19T07:09:38.171441+0000","last_undegraded":"2024-09-19T07:09:38.171441+0000","last_fullsized":"2024-09-19T07:09:38.171441+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:37.313958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.178508+0000","last_change":"2024-09-19T07:09:18.921268+0000","last_active":"2024-09-19T07:09:38.178508+0000","last_peered":"2024-09-19T07:09:38.178508+0000","last_clean":"2024-09-19T07:09:38.178508+0000","last_became_active":"2024-09-19T07:09:18.920482+0000","last_became_peered":"2024-09-19T07:09:18.920482+0000","last_unstale":"2024-09-19T07:09:38.178508+0000","last_undegraded":"2024-09-19T07:09:38.178508+0000","last_fullsized":"2024-09-19T07:09:38.178508+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:35.201826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.179136+0000","last_change":"2024-09-19T07:09:38.179136+0000","last_active":"2024-09-19T07:09:38.179136+0000","last_peered":"2024-09-19T07:09:38.179136+0000","last_clean":"2024-09-19T07:09:38.179136+0000","last_became_active":"2024-09-19T07:09:38.178746+0000","last_became_peered":"2024-09-19T07:09:38.178746+0000","last_unstale":"2024-09-19T07:09:38.179136+0000","last_undegraded":"2024-09-19T07:09:38.179136+0000","last_fullsized":"2024-09-19T07:09:38.179136+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:03.788114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.177288+0000","last_change":"2024-09-19T07:09:18.924099+0000","last_active":"2024-09-19T07:09:38.177288+0000","last_peered":"2024-09-19T07:09:38.177288+0000","last_clean":"2024-09-19T07:09:38.177288+0000","last_became_active":"2024-09-19T07:09:18.923772+0000","last_became_peered":"2024-09-19T07:09:18.923772+0000","last_unstale":"2024-09-19T07:09:38.177288+0000","last_undegraded":"2024-09-19T07:09:38.177288+0000","last_fullsized":"2024-09-19T07:09:38.177288+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:05:04.954087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.172932+0000","last_change":"2024-09-19T07:09:18.923391+0000","last_active":"2024-09-19T07:09:38.172932+0000","last_peered":"2024-09-19T07:09:38.172932+0000","last_clean":"2024-09-19T07:09:38.172932+0000","last_became_active":"2024-09-19T07:09:18.923085+0000","last_became_peered":"2024-09-19T07:09:18.923085+0000","last_unstale":"2024-09-19T07:09:38.172932+0000","last_undegraded":"2024-09-19T07:09:38.172932+0000","last_fullsized":"2024-09-19T07:09:38.172932+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:43:27.032400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.392065+0000","last_change":"2024-09-19T07:09:18.937188+0000","last_active":"2024-09-19T07:09:38.392065+0000","last_peered":"2024-09-19T07:09:38.392065+0000","last_clean":"2024-09-19T07:09:38.392065+0000","last_became_active":"2024-09-19T07:09:18.936866+0000","last_became_peered":"2024-09-19T07:09:18.936866+0000","last_unstale":"2024-09-19T07:09:38.392065+0000","last_undegraded":"2024-09-19T07:09:38.392065+0000","last_fullsized":"2024-09-19T07:09:38.392065+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:29:08.835307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.177927+0000","last_change":"2024-09-19T07:09:18.935170+0000","last_active":"2024-09-19T07:09:38.177927+0000","last_peered":"2024-09-19T07:09:38.177927+0000","last_clean":"2024-09-19T07:09:38.177927+0000","last_became_active":"2024-09-19T07:09:18.934356+0000","last_became_peered":"2024-09-19T07:09:18.934356+0000","last_unstale":"2024-09-19T07:09:38.177927+0000","last_undegraded":"2024-09-19T07:09:38.177927+0000","last_fullsized":"2024-09-19T07:09:38.177927+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:53.567392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175782+0000","last_change":"2024-09-19T07:09:18.922640+0000","last_active":"2024-09-19T07:09:38.175782+0000","last_peered":"2024-09-19T07:09:38.175782+0000","last_clean":"2024-09-19T07:09:38.175782+0000","last_became_active":"2024-09-19T07:09:18.922312+0000","last_became_peered":"2024-09-19T07:09:18.922312+0000","last_unstale":"2024-09-19T07:09:38.175782+0000","last_undegraded":"2024-09-19T07:09:38.175782+0000","last_fullsized":"2024-09-19T07:09:38.175782+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:50.868818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.176074+0000","last_change":"2024-09-19T07:09:18.934364+0000","last_active":"2024-09-19T07:09:38.176074+0000","last_peered":"2024-09-19T07:09:38.176074+0000","last_clean":"2024-09-19T07:09:38.176074+0000","last_became_active":"2024-09-19T07:09:18.933533+0000","last_became_peered":"2024-09-19T07:09:18.933533+0000","last_unstale":"2024-09-19T07:09:38.176074+0000","last_undegraded":"2024-09-19T07:09:38.176074+0000","last_fullsized":"2024-09-19T07:09:38.176074+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:54.175425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.172694+0000","last_change":"2024-09-19T07:09:18.927456+0000","last_active":"2024-09-19T07:09:38.172694+0000","last_peered":"2024-09-19T07:09:38.172694+0000","last_clean":"2024-09-19T07:09:38.172694+0000","last_became_active":"2024-09-19T07:09:18.927117+0000","last_became_peered":"2024-09-19T07:09:18.927117+0000","last_unstale":"2024-09-19T07:09:38.172694+0000","last_undegraded":"2024-09-19T07:09:38.172694+0000","last_fullsized":"2024-09-19T07:09:38.172694+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:08.885898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.176351+0000","last_change":"2024-09-19T07:09:18.926024+0000","last_active":"2024-09-19T07:09:38.176351+0000","last_peered":"2024-09-19T07:09:38.176351+0000","last_clean":"2024-09-19T07:09:38.176351+0000","last_became_active":"2024-09-19T07:09:18.925689+0000","last_became_peered":"2024-09-19T07:09:18.925689+0000","last_unstale":"2024-09-19T07:09:38.176351+0000","last_undegraded":"2024-09-19T07:09:38.176351+0000","last_fullsized":"2024-09-19T07:09:38.176351+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:09:08.178214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'6","reported_seq":80,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:10:16.059818+0000","last_change":"2024-09-19T07:09:16.915804+0000","last_active":"2024-09-19T07:10:16.059818+0000","last_peered":"2024-09-19T07:10:16.059818+0000","last_clean":"2024-09-19T07:10:16.059818+0000","last_became_active":"2024-09-19T07:09:16.915434+0000","last_became_peered":"2024-09-19T07:09:16.915434+0000","last_unstale":"2024-09-19T07:10:16.059818+0000","last_undegraded":"2024-09-19T07:10:16.059818+0000","last_fullsized":"2024-09-19T07:10:16.059818+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:57.230475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.176935+0000","last_change":"2024-09-19T07:09:18.932497+0000","last_active":"2024-09-19T07:09:38.176935+0000","last_peered":"2024-09-19T07:09:38.176935+0000","last_clean":"2024-09-19T07:09:38.176935+0000","last_became_active":"2024-09-19T07:09:18.932213+0000","last_became_peered":"2024-09-19T07:09:18.932213+0000","last_unstale":"2024-09-19T07:09:38.176935+0000","last_undegraded":"2024-09-19T07:09:38.176935+0000","last_fullsized":"2024-09-19T07:09:38.176935+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:10.299077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.172875+0000","last_change":"2024-09-19T07:09:16.910171+0000","last_active":"2024-09-19T07:09:38.172875+0000","last_peered":"2024-09-19T07:09:38.172875+0000","last_clean":"2024-09-19T07:09:38.172875+0000","last_became_active":"2024-09-19T07:09:16.909840+0000","last_became_peered":"2024-09-19T07:09:16.909840+0000","last_unstale":"2024-09-19T07:09:38.172875+0000","last_undegraded":"2024-09-19T07:09:38.172875+0000","last_fullsized":"2024-09-19T07:09:38.172875+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:35.448892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.391818+0000","last_change":"2024-09-19T07:09:16.911336+0000","last_active":"2024-09-19T07:09:38.391818+0000","last_peered":"2024-09-19T07:09:38.391818+0000","last_clean":"2024-09-19T07:09:38.391818+0000","last_became_active":"2024-09-19T07:09:16.911027+0000","last_became_peered":"2024-09-19T07:09:16.911027+0000","last_unstale":"2024-09-19T07:09:38.391818+0000","last_undegraded":"2024-09-19T07:09:38.391818+0000","last_fullsized":"2024-09-19T07:09:38.391818+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:37:50.698597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.171395+0000","last_change":"2024-09-19T07:09:18.927713+0000","last_active":"2024-09-19T07:09:38.171395+0000","last_peered":"2024-09-19T07:09:38.171395+0000","last_clean":"2024-09-19T07:09:38.171395+0000","last_became_active":"2024-09-19T07:09:18.927430+0000","last_became_peered":"2024-09-19T07:09:18.927430+0000","last_unstale":"2024-09-19T07:09:38.171395+0000","last_undegraded":"2024-09-19T07:09:38.171395+0000","last_fullsized":"2024-09-19T07:09:38.171395+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:15:07.707723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.178877+0000","last_change":"2024-09-19T07:09:16.912391+0000","last_active":"2024-09-19T07:09:38.178877+0000","last_peered":"2024-09-19T07:09:38.178877+0000","last_clean":"2024-09-19T07:09:38.178877+0000","last_became_active":"2024-09-19T07:09:16.912034+0000","last_became_peered":"2024-09-19T07:09:16.912034+0000","last_unstale":"2024-09-19T07:09:38.178877+0000","last_undegraded":"2024-09-19T07:09:38.178877+0000","last_fullsized":"2024-09-19T07:09:38.178877+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:18:45.226107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.173014+0000","last_change":"2024-09-19T07:09:18.929476+0000","last_active":"2024-09-19T07:09:38.173014+0000","last_peered":"2024-09-19T07:09:38.173014+0000","last_clean":"2024-09-19T07:09:38.173014+0000","last_became_active":"2024-09-19T07:09:18.929183+0000","last_became_peered":"2024-09-19T07:09:18.929183+0000","last_unstale":"2024-09-19T07:09:38.173014+0000","last_undegraded":"2024-09-19T07:09:38.173014+0000","last_fullsized":"2024-09-19T07:09:38.173014+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:19:38.827130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'3","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:10:19.063343+0000","last_change":"2024-09-19T07:09:16.913012+0000","last_active":"2024-09-19T07:10:19.063343+0000","last_peered":"2024-09-19T07:10:19.063343+0000","last_clean":"2024-09-19T07:10:19.063343+0000","last_became_active":"2024-09-19T07:09:16.912633+0000","last_became_peered":"2024-09-19T07:09:16.912633+0000","last_unstale":"2024-09-19T07:10:19.063343+0000","last_undegraded":"2024-09-19T07:10:19.063343+0000","last_fullsized":"2024-09-19T07:10:19.063343+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:21:39.669961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175677+0000","last_change":"2024-09-19T07:09:18.937323+0000","last_active":"2024-09-19T07:09:38.175677+0000","last_peered":"2024-09-19T07:09:38.175677+0000","last_clean":"2024-09-19T07:09:38.175677+0000","last_became_active":"2024-09-19T07:09:18.936762+0000","last_became_peered":"2024-09-19T07:09:18.936762+0000","last_unstale":"2024-09-19T07:09:38.175677+0000","last_undegraded":"2024-09-19T07:09:38.175677+0000","last_fullsized":"2024-09-19T07:09:38.175677+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:37.692290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.176072+0000","last_change":"2024-09-19T07:09:16.912167+0000","last_active":"2024-09-19T07:09:38.176072+0000","last_peered":"2024-09-19T07:09:38.176072+0000","last_clean":"2024-09-19T07:09:38.176072+0000","last_became_active":"2024-09-19T07:09:16.911840+0000","last_became_peered":"2024-09-19T07:09:16.911840+0000","last_unstale":"2024-09-19T07:09:38.176072+0000","last_undegraded":"2024-09-19T07:09:38.176072+0000","last_fullsized":"2024-09-19T07:09:38.176072+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:31.901906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.178050+0000","last_change":"2024-09-19T07:09:18.932239+0000","last_active":"2024-09-19T07:09:38.178050+0000","last_peered":"2024-09-19T07:09:38.178050+0000","last_clean":"2024-09-19T07:09:38.178050+0000","last_became_active":"2024-09-19T07:09:18.931820+0000","last_became_peered":"2024-09-19T07:09:18.931820+0000","last_unstale":"2024-09-19T07:09:38.178050+0000","last_undegraded":"2024-09-19T07:09:38.178050+0000","last_fullsized":"2024-09-19T07:09:38.178050+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:09.407524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.178561+0000","last_change":"2024-09-19T07:09:17.085077+0000","last_active":"2024-09-19T07:09:38.178561+0000","last_peered":"2024-09-19T07:09:38.178561+0000","last_clean":"2024-09-19T07:09:38.178561+0000","last_became_active":"2024-09-19T07:09:17.084457+0000","last_became_peered":"2024-09-19T07:09:17.084457+0000","last_unstale":"2024-09-19T07:09:38.178561+0000","last_undegraded":"2024-09-19T07:09:38.178561+0000","last_fullsized":"2024-09-19T07:09:38.178561+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:42.416193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175612+0000","last_change":"2024-09-19T07:09:18.939830+0000","last_active":"2024-09-19T07:09:38.175612+0000","last_peered":"2024-09-19T07:09:38.175612+0000","last_clean":"2024-09-19T07:09:38.175612+0000","last_became_active":"2024-09-19T07:09:18.939359+0000","last_became_peered":"2024-09-19T07:09:18.939359+0000","last_unstale":"2024-09-19T07:09:38.175612+0000","last_undegraded":"2024-09-19T07:09:38.175612+0000","last_fullsized":"2024-09-19T07:09:38.175612+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:24:46.241902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'28","reported_seq":180,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:10:19.291750+0000","last_change":"2024-09-19T07:09:38.227707+0000","last_active":"2024-09-19T07:10:19.291750+0000","last_peered":"2024-09-19T07:10:19.291750+0000","last_clean":"2024-09-19T07:10:19.291750+0000","last_became_active":"2024-09-19T07:09:38.219073+0000","last_became_peered":"2024-09-19T07:09:38.219073+0000","last_unstale":"2024-09-19T07:10:19.291750+0000","last_undegraded":"2024-09-19T07:10:19.291750+0000","last_fullsized":"2024-09-19T07:10:19.291750+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:46.035315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59764,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":109,"num_read_kb":107,"num_write":29,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":26947,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.176558+0000","last_change":"2024-09-19T07:09:18.929531+0000","last_active":"2024-09-19T07:09:38.176558+0000","last_peered":"2024-09-19T07:09:38.176558+0000","last_clean":"2024-09-19T07:09:38.176558+0000","last_became_active":"2024-09-19T07:09:18.929253+0000","last_became_peered":"2024-09-19T07:09:18.929253+0000","last_unstale":"2024-09-19T07:09:38.176558+0000","last_undegraded":"2024-09-19T07:09:38.176558+0000","last_fullsized":"2024-09-19T07:09:38.176558+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:10.635116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175337+0000","last_change":"2024-09-19T07:09:16.914964+0000","last_active":"2024-09-19T07:09:38.175337+0000","last_peered":"2024-09-19T07:09:38.175337+0000","last_clean":"2024-09-19T07:09:38.175337+0000","last_became_active":"2024-09-19T07:09:16.914540+0000","last_became_peered":"2024-09-19T07:09:16.914540+0000","last_unstale":"2024-09-19T07:09:38.175337+0000","last_undegraded":"2024-09-19T07:09:38.175337+0000","last_fullsized":"2024-09-19T07:09:38.175337+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:30.903046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.391882+0000","last_change":"2024-09-19T07:09:18.931709+0000","last_active":"2024-09-19T07:09:38.391882+0000","last_peered":"2024-09-19T07:09:38.391882+0000","last_clean":"2024-09-19T07:09:38.391882+0000","last_became_active":"2024-09-19T07:09:18.931345+0000","last_became_peered":"2024-09-19T07:09:18.931345+0000","last_unstale":"2024-09-19T07:09:38.391882+0000","last_undegraded":"2024-09-19T07:09:38.391882+0000","last_fullsized":"2024-09-19T07:09:38.391882+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:28.916820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.177361+0000","last_change":"2024-09-19T07:09:16.914055+0000","last_active":"2024-09-19T07:09:38.177361+0000","last_peered":"2024-09-19T07:09:38.177361+0000","last_clean":"2024-09-19T07:09:38.177361+0000","last_became_active":"2024-09-19T07:09:16.913589+0000","last_became_peered":"2024-09-19T07:09:16.913589+0000","last_unstale":"2024-09-19T07:09:38.177361+0000","last_undegraded":"2024-09-19T07:09:38.177361+0000","last_fullsized":"2024-09-19T07:09:38.177361+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:29:16.322059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175501+0000","last_change":"2024-09-19T07:09:18.934879+0000","last_active":"2024-09-19T07:09:38.175501+0000","last_peered":"2024-09-19T07:09:38.175501+0000","last_clean":"2024-09-19T07:09:38.175501+0000","last_became_active":"2024-09-19T07:09:18.934432+0000","last_became_peered":"2024-09-19T07:09:18.934432+0000","last_unstale":"2024-09-19T07:09:38.175501+0000","last_undegraded":"2024-09-19T07:09:38.175501+0000","last_fullsized":"2024-09-19T07:09:38.175501+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:25.782782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'4","reported_seq":80,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:10:18.062033+0000","last_change":"2024-09-19T07:09:16.909256+0000","last_active":"2024-09-19T07:10:18.062033+0000","last_peered":"2024-09-19T07:10:18.062033+0000","last_clean":"2024-09-19T07:10:18.062033+0000","last_became_active":"2024-09-19T07:09:16.908932+0000","last_became_peered":"2024-09-19T07:09:16.908932+0000","last_unstale":"2024-09-19T07:10:18.062033+0000","last_undegraded":"2024-09-19T07:10:18.062033+0000","last_fullsized":"2024-09-19T07:10:18.062033+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:28.344756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175202+0000","last_change":"2024-09-19T07:09:18.931844+0000","last_active":"2024-09-19T07:09:38.175202+0000","last_peered":"2024-09-19T07:09:38.175202+0000","last_clean":"2024-09-19T07:09:38.175202+0000","last_became_active":"2024-09-19T07:09:18.931516+0000","last_became_peered":"2024-09-19T07:09:18.931516+0000","last_unstale":"2024-09-19T07:09:38.175202+0000","last_undegraded":"2024-09-19T07:09:38.175202+0000","last_fullsized":"2024-09-19T07:09:38.175202+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:27:29.812144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.176125+0000","last_change":"2024-09-19T07:09:17.085252+0000","last_active":"2024-09-19T07:09:38.176125+0000","last_peered":"2024-09-19T07:09:38.176125+0000","last_clean":"2024-09-19T07:09:38.176125+0000","last_became_active":"2024-09-19T07:09:17.084907+0000","last_became_peered":"2024-09-19T07:09:17.084907+0000","last_unstale":"2024-09-19T07:09:38.176125+0000","last_undegraded":"2024-09-19T07:09:38.176125+0000","last_fullsized":"2024-09-19T07:09:38.176125+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:59:40.351181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.177112+0000","last_change":"2024-09-19T07:09:18.932491+0000","last_active":"2024-09-19T07:09:38.177112+0000","last_peered":"2024-09-19T07:09:38.177112+0000","last_clean":"2024-09-19T07:09:38.177112+0000","last_became_active":"2024-09-19T07:09:18.932159+0000","last_became_peered":"2024-09-19T07:09:18.932159+0000","last_unstale":"2024-09-19T07:09:38.177112+0000","last_undegraded":"2024-09-19T07:09:38.177112+0000","last_fullsized":"2024-09-19T07:09:38.177112+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:31.144130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.178704+0000","last_change":"2024-09-19T07:09:16.911012+0000","last_active":"2024-09-19T07:09:38.178704+0000","last_peered":"2024-09-19T07:09:38.178704+0000","last_clean":"2024-09-19T07:09:38.178704+0000","last_became_active":"2024-09-19T07:09:16.910618+0000","last_became_peered":"2024-09-19T07:09:16.910618+0000","last_unstale":"2024-09-19T07:09:38.178704+0000","last_undegraded":"2024-09-19T07:09:38.178704+0000","last_fullsized":"2024-09-19T07:09:38.178704+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:16.316680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.217870+0000","last_change":"2024-09-19T07:09:38.217870+0000","last_active":"2024-09-19T07:09:38.217870+0000","last_peered":"2024-09-19T07:09:38.217870+0000","last_clean":"2024-09-19T07:09:38.217870+0000","last_became_active":"2024-09-19T07:09:38.217585+0000","last_became_peered":"2024-09-19T07:09:38.217585+0000","last_unstale":"2024-09-19T07:09:38.217870+0000","last_undegraded":"2024-09-19T07:09:38.217870+0000","last_fullsized":"2024-09-19T07:09:38.217870+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:41.320705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.392249+0000","last_change":"2024-09-19T07:09:16.911644+0000","last_active":"2024-09-19T07:09:38.392249+0000","last_peered":"2024-09-19T07:09:38.392249+0000","last_clean":"2024-09-19T07:09:38.392249+0000","last_became_active":"2024-09-19T07:09:16.911368+0000","last_became_peered":"2024-09-19T07:09:16.911368+0000","last_unstale":"2024-09-19T07:09:38.392249+0000","last_undegraded":"2024-09-19T07:09:38.392249+0000","last_fullsized":"2024-09-19T07:09:38.392249+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:12.953466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.176202+0000","last_change":"2024-09-19T07:09:18.933667+0000","last_active":"2024-09-19T07:09:38.176202+0000","last_peered":"2024-09-19T07:09:38.176202+0000","last_clean":"2024-09-19T07:09:38.176202+0000","last_became_active":"2024-09-19T07:09:18.933288+0000","last_became_peered":"2024-09-19T07:09:18.933288+0000","last_unstale":"2024-09-19T07:09:38.176202+0000","last_undegraded":"2024-09-19T07:09:38.176202+0000","last_fullsized":"2024-09-19T07:09:38.176202+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:54:38.127799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.178634+0000","last_change":"2024-09-19T07:09:16.909722+0000","last_active":"2024-09-19T07:09:38.178634+0000","last_peered":"2024-09-19T07:09:38.178634+0000","last_clean":"2024-09-19T07:09:38.178634+0000","last_became_active":"2024-09-19T07:09:16.909394+0000","last_became_peered":"2024-09-19T07:09:16.909394+0000","last_unstale":"2024-09-19T07:09:38.178634+0000","last_undegraded":"2024-09-19T07:09:38.178634+0000","last_fullsized":"2024-09-19T07:09:38.178634+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:21:53.342710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175698+0000","last_change":"2024-09-19T07:09:18.929473+0000","last_active":"2024-09-19T07:09:38.175698+0000","last_peered":"2024-09-19T07:09:38.175698+0000","last_clean":"2024-09-19T07:09:38.175698+0000","last_became_active":"2024-09-19T07:09:18.929176+0000","last_became_peered":"2024-09-19T07:09:18.929176+0000","last_unstale":"2024-09-19T07:09:38.175698+0000","last_undegraded":"2024-09-19T07:09:38.175698+0000","last_fullsized":"2024-09-19T07:09:38.175698+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:32:30.409528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175529+0000","last_change":"2024-09-19T07:09:17.084868+0000","last_active":"2024-09-19T07:09:38.175529+0000","last_peered":"2024-09-19T07:09:38.175529+0000","last_clean":"2024-09-19T07:09:38.175529+0000","last_became_active":"2024-09-19T07:09:17.084448+0000","last_became_peered":"2024-09-19T07:09:17.084448+0000","last_unstale":"2024-09-19T07:09:38.175529+0000","last_undegraded":"2024-09-19T07:09:38.175529+0000","last_fullsized":"2024-09-19T07:09:38.175529+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:38.211697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175880+0000","last_change":"2024-09-19T07:09:18.938865+0000","last_active":"2024-09-19T07:09:38.175880+0000","last_peered":"2024-09-19T07:09:38.175880+0000","last_clean":"2024-09-19T07:09:38.175880+0000","last_became_active":"2024-09-19T07:09:18.936324+0000","last_became_peered":"2024-09-19T07:09:18.936324+0000","last_unstale":"2024-09-19T07:09:38.175880+0000","last_undegraded":"2024-09-19T07:09:38.175880+0000","last_fullsized":"2024-09-19T07:09:38.175880+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:29:51.081140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":342,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175329+0000","last_change":"2024-09-19T07:08:09.270850+0000","last_active":"2024-09-19T07:09:38.175329+0000","last_peered":"2024-09-19T07:09:38.175329+0000","last_clean":"2024-09-19T07:09:38.175329+0000","last_became_active":"2024-09-19T07:08:09.270308+0000","last_became_peered":"2024-09-19T07:08:09.270308+0000","last_unstale":"2024-09-19T07:09:38.175329+0000","last_undegraded":"2024-09-19T07:09:38.175329+0000","last_fullsized":"2024-09-19T07:09:38.175329+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:04:49.729632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:04:49.729632+0000","last_clean_scrub_stamp":"2024-09-19T07:04:49.729632+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:15.588732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.217622+0000","last_change":"2024-09-19T07:09:16.907648+0000","last_active":"2024-09-19T07:09:38.217622+0000","last_peered":"2024-09-19T07:09:38.217622+0000","last_clean":"2024-09-19T07:09:38.217622+0000","last_became_active":"2024-09-19T07:09:16.907363+0000","last_became_peered":"2024-09-19T07:09:16.907363+0000","last_unstale":"2024-09-19T07:09:38.217622+0000","last_undegraded":"2024-09-19T07:09:38.217622+0000","last_fullsized":"2024-09-19T07:09:38.217622+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:12:27.898493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.171872+0000","last_change":"2024-09-19T07:09:18.926008+0000","last_active":"2024-09-19T07:09:38.171872+0000","last_peered":"2024-09-19T07:09:38.171872+0000","last_clean":"2024-09-19T07:09:38.171872+0000","last_became_active":"2024-09-19T07:09:18.925689+0000","last_became_peered":"2024-09-19T07:09:18.925689+0000","last_unstale":"2024-09-19T07:09:38.171872+0000","last_undegraded":"2024-09-19T07:09:38.171872+0000","last_fullsized":"2024-09-19T07:09:38.171872+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:16:06.467934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175270+0000","last_change":"2024-09-19T07:09:16.911327+0000","last_active":"2024-09-19T07:09:38.175270+0000","last_peered":"2024-09-19T07:09:38.175270+0000","last_clean":"2024-09-19T07:09:38.175270+0000","last_became_active":"2024-09-19T07:09:16.911031+0000","last_became_peered":"2024-09-19T07:09:16.911031+0000","last_unstale":"2024-09-19T07:09:38.175270+0000","last_undegraded":"2024-09-19T07:09:38.175270+0000","last_fullsized":"2024-09-19T07:09:38.175270+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:03.307119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.391808+0000","last_change":"2024-09-19T07:09:18.933813+0000","last_active":"2024-09-19T07:09:38.391808+0000","last_peered":"2024-09-19T07:09:38.391808+0000","last_clean":"2024-09-19T07:09:38.391808+0000","last_became_active":"2024-09-19T07:09:18.933475+0000","last_became_peered":"2024-09-19T07:09:18.933475+0000","last_unstale":"2024-09-19T07:09:38.391808+0000","last_undegraded":"2024-09-19T07:09:38.391808+0000","last_fullsized":"2024-09-19T07:09:38.391808+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:34:09.149593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'4","reported_seq":75,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:10:16.058910+0000","last_change":"2024-09-19T07:09:17.084833+0000","last_active":"2024-09-19T07:10:16.058910+0000","last_peered":"2024-09-19T07:10:16.058910+0000","last_clean":"2024-09-19T07:10:16.058910+0000","last_became_active":"2024-09-19T07:09:17.084477+0000","last_became_peered":"2024-09-19T07:09:17.084477+0000","last_unstale":"2024-09-19T07:10:16.058910+0000","last_undegraded":"2024-09-19T07:10:16.058910+0000","last_fullsized":"2024-09-19T07:10:16.058910+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:17:50.962480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.178639+0000","last_change":"2024-09-19T07:09:18.935991+0000","last_active":"2024-09-19T07:09:38.178639+0000","last_peered":"2024-09-19T07:09:38.178639+0000","last_clean":"2024-09-19T07:09:38.178639+0000","last_became_active":"2024-09-19T07:09:18.935677+0000","last_became_peered":"2024-09-19T07:09:18.935677+0000","last_unstale":"2024-09-19T07:09:38.178639+0000","last_undegraded":"2024-09-19T07:09:38.178639+0000","last_fullsized":"2024-09-19T07:09:38.178639+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:45.550119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175650+0000","last_change":"2024-09-19T07:09:16.911755+0000","last_active":"2024-09-19T07:09:38.175650+0000","last_peered":"2024-09-19T07:09:38.175650+0000","last_clean":"2024-09-19T07:09:38.175650+0000","last_became_active":"2024-09-19T07:09:16.911211+0000","last_became_peered":"2024-09-19T07:09:16.911211+0000","last_unstale":"2024-09-19T07:09:38.175650+0000","last_undegraded":"2024-09-19T07:09:38.175650+0000","last_fullsized":"2024-09-19T07:09:38.175650+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:15.365423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.173027+0000","last_change":"2024-09-19T07:09:18.940282+0000","last_active":"2024-09-19T07:09:38.173027+0000","last_peered":"2024-09-19T07:09:38.173027+0000","last_clean":"2024-09-19T07:09:38.173027+0000","last_became_active":"2024-09-19T07:09:18.939918+0000","last_became_peered":"2024-09-19T07:09:18.939918+0000","last_unstale":"2024-09-19T07:09:38.173027+0000","last_undegraded":"2024-09-19T07:09:38.173027+0000","last_fullsized":"2024-09-19T07:09:38.173027+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:11.161676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.173522+0000","last_change":"2024-09-19T07:09:17.086103+0000","last_active":"2024-09-19T07:09:38.173522+0000","last_peered":"2024-09-19T07:09:38.173522+0000","last_clean":"2024-09-19T07:09:38.173522+0000","last_became_active":"2024-09-19T07:09:17.085805+0000","last_became_peered":"2024-09-19T07:09:17.085805+0000","last_unstale":"2024-09-19T07:09:38.173522+0000","last_undegraded":"2024-09-19T07:09:38.173522+0000","last_fullsized":"2024-09-19T07:09:38.173522+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:28.522487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"78'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.173192+0000","last_change":"2024-09-19T07:09:18.932603+0000","last_active":"2024-09-19T07:09:38.173192+0000","last_peered":"2024-09-19T07:09:38.173192+0000","last_clean":"2024-09-19T07:09:38.173192+0000","last_became_active":"2024-09-19T07:09:18.932309+0000","last_became_peered":"2024-09-19T07:09:18.932309+0000","last_unstale":"2024-09-19T07:09:38.173192+0000","last_undegraded":"2024-09-19T07:09:38.173192+0000","last_fullsized":"2024-09-19T07:09:38.173192+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:19.746024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.176846+0000","last_change":"2024-09-19T07:09:17.085287+0000","last_active":"2024-09-19T07:09:38.176846+0000","last_peered":"2024-09-19T07:09:38.176846+0000","last_clean":"2024-09-19T07:09:38.176846+0000","last_became_active":"2024-09-19T07:09:17.084964+0000","last_became_peered":"2024-09-19T07:09:17.084964+0000","last_unstale":"2024-09-19T07:09:38.176846+0000","last_undegraded":"2024-09-19T07:09:38.176846+0000","last_fullsized":"2024-09-19T07:09:38.176846+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:51:01.035344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.392115+0000","last_change":"2024-09-19T07:09:18.921623+0000","last_active":"2024-09-19T07:09:38.392115+0000","last_peered":"2024-09-19T07:09:38.392115+0000","last_clean":"2024-09-19T07:09:38.392115+0000","last_became_active":"2024-09-19T07:09:18.921321+0000","last_became_peered":"2024-09-19T07:09:18.921321+0000","last_unstale":"2024-09-19T07:09:38.392115+0000","last_undegraded":"2024-09-19T07:09:38.392115+0000","last_fullsized":"2024-09-19T07:09:38.392115+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:28:55.616889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'12","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:43.929523+0000","last_change":"2024-09-19T07:09:16.910251+0000","last_active":"2024-09-19T07:09:43.929523+0000","last_peered":"2024-09-19T07:09:43.929523+0000","last_clean":"2024-09-19T07:09:43.929523+0000","last_became_active":"2024-09-19T07:09:16.909821+0000","last_became_peered":"2024-09-19T07:09:16.909821+0000","last_unstale":"2024-09-19T07:09:43.929523+0000","last_undegraded":"2024-09-19T07:09:43.929523+0000","last_fullsized":"2024-09-19T07:09:43.929523+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:02.958557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.171648+0000","last_change":"2024-09-19T07:09:18.930831+0000","last_active":"2024-09-19T07:09:38.171648+0000","last_peered":"2024-09-19T07:09:38.171648+0000","last_clean":"2024-09-19T07:09:38.171648+0000","last_became_active":"2024-09-19T07:09:18.930475+0000","last_became_peered":"2024-09-19T07:09:18.930475+0000","last_unstale":"2024-09-19T07:09:38.171648+0000","last_undegraded":"2024-09-19T07:09:38.171648+0000","last_fullsized":"2024-09-19T07:09:38.171648+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:30.512246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.217761+0000","last_change":"2024-09-19T07:09:16.906666+0000","last_active":"2024-09-19T07:09:38.217761+0000","last_peered":"2024-09-19T07:09:38.217761+0000","last_clean":"2024-09-19T07:09:38.217761+0000","last_became_active":"2024-09-19T07:09:16.906369+0000","last_became_peered":"2024-09-19T07:09:16.906369+0000","last_unstale":"2024-09-19T07:09:38.217761+0000","last_undegraded":"2024-09-19T07:09:38.217761+0000","last_fullsized":"2024-09-19T07:09:38.217761+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:56.915089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.178077+0000","last_change":"2024-09-19T07:09:18.934942+0000","last_active":"2024-09-19T07:09:38.178077+0000","last_peered":"2024-09-19T07:09:38.178077+0000","last_clean":"2024-09-19T07:09:38.178077+0000","last_became_active":"2024-09-19T07:09:18.934595+0000","last_became_peered":"2024-09-19T07:09:18.934595+0000","last_unstale":"2024-09-19T07:09:38.178077+0000","last_undegraded":"2024-09-19T07:09:38.178077+0000","last_fullsized":"2024-09-19T07:09:38.178077+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:54.306541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.183567+0000","last_change":"2024-09-19T07:09:38.183567+0000","last_active":"2024-09-19T07:09:38.183567+0000","last_peered":"2024-09-19T07:09:38.183567+0000","last_clean":"2024-09-19T07:09:38.183567+0000","last_became_active":"2024-09-19T07:09:38.180778+0000","last_became_peered":"2024-09-19T07:09:38.180778+0000","last_unstale":"2024-09-19T07:09:38.183567+0000","last_undegraded":"2024-09-19T07:09:38.183567+0000","last_fullsized":"2024-09-19T07:09:38.183567+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:43.226551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.176289+0000","last_change":"2024-09-19T07:09:18.934457+0000","last_active":"2024-09-19T07:09:38.176289+0000","last_peered":"2024-09-19T07:09:38.176289+0000","last_clean":"2024-09-19T07:09:38.176289+0000","last_became_active":"2024-09-19T07:09:18.934126+0000","last_became_peered":"2024-09-19T07:09:18.934126+0000","last_unstale":"2024-09-19T07:09:38.176289+0000","last_undegraded":"2024-09-19T07:09:38.176289+0000","last_fullsized":"2024-09-19T07:09:38.176289+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:37:16.152335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.171956+0000","last_change":"2024-09-19T07:09:16.908457+0000","last_active":"2024-09-19T07:09:38.171956+0000","last_peered":"2024-09-19T07:09:38.171956+0000","last_clean":"2024-09-19T07:09:38.171956+0000","last_became_active":"2024-09-19T07:09:16.908128+0000","last_became_peered":"2024-09-19T07:09:16.908128+0000","last_unstale":"2024-09-19T07:09:38.171956+0000","last_undegraded":"2024-09-19T07:09:38.171956+0000","last_fullsized":"2024-09-19T07:09:38.171956+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:48:50.579301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.172762+0000","last_change":"2024-09-19T07:09:18.928763+0000","last_active":"2024-09-19T07:09:38.172762+0000","last_peered":"2024-09-19T07:09:38.172762+0000","last_clean":"2024-09-19T07:09:38.172762+0000","last_became_active":"2024-09-19T07:09:18.928231+0000","last_became_peered":"2024-09-19T07:09:18.928231+0000","last_unstale":"2024-09-19T07:09:38.172762+0000","last_undegraded":"2024-09-19T07:09:38.172762+0000","last_fullsized":"2024-09-19T07:09:38.172762+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:26.652378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175889+0000","last_change":"2024-09-19T07:09:16.913740+0000","last_active":"2024-09-19T07:09:38.175889+0000","last_peered":"2024-09-19T07:09:38.175889+0000","last_clean":"2024-09-19T07:09:38.175889+0000","last_became_active":"2024-09-19T07:09:16.912419+0000","last_became_peered":"2024-09-19T07:09:16.912419+0000","last_unstale":"2024-09-19T07:09:38.175889+0000","last_undegraded":"2024-09-19T07:09:38.175889+0000","last_fullsized":"2024-09-19T07:09:38.175889+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:16.658996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.171848+0000","last_change":"2024-09-19T07:09:18.930697+0000","last_active":"2024-09-19T07:09:38.171848+0000","last_peered":"2024-09-19T07:09:38.171848+0000","last_clean":"2024-09-19T07:09:38.171848+0000","last_became_active":"2024-09-19T07:09:18.930355+0000","last_became_peered":"2024-09-19T07:09:18.930355+0000","last_unstale":"2024-09-19T07:09:38.171848+0000","last_undegraded":"2024-09-19T07:09:38.171848+0000","last_fullsized":"2024-09-19T07:09:38.171848+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:07.217195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.184284+0000","last_change":"2024-09-19T07:09:38.183637+0000","last_active":"2024-09-19T07:09:38.184284+0000","last_peered":"2024-09-19T07:09:38.184284+0000","last_clean":"2024-09-19T07:09:38.184284+0000","last_became_active":"2024-09-19T07:09:38.178732+0000","last_became_peered":"2024-09-19T07:09:38.178732+0000","last_unstale":"2024-09-19T07:09:38.184284+0000","last_undegraded":"2024-09-19T07:09:38.184284+0000","last_fullsized":"2024-09-19T07:09:38.184284+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:14.287130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175530+0000","last_change":"2024-09-19T07:09:18.935120+0000","last_active":"2024-09-19T07:09:38.175530+0000","last_peered":"2024-09-19T07:09:38.175530+0000","last_clean":"2024-09-19T07:09:38.175530+0000","last_became_active":"2024-09-19T07:09:18.934227+0000","last_became_peered":"2024-09-19T07:09:18.934227+0000","last_unstale":"2024-09-19T07:09:38.175530+0000","last_undegraded":"2024-09-19T07:09:38.175530+0000","last_fullsized":"2024-09-19T07:09:38.175530+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:20.328983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.393512+0000","last_change":"2024-09-19T07:09:38.393512+0000","last_active":"2024-09-19T07:09:38.393512+0000","last_peered":"2024-09-19T07:09:38.393512+0000","last_clean":"2024-09-19T07:09:38.393512+0000","last_became_active":"2024-09-19T07:09:38.393200+0000","last_became_peered":"2024-09-19T07:09:38.393200+0000","last_unstale":"2024-09-19T07:09:38.393512+0000","last_undegraded":"2024-09-19T07:09:38.393512+0000","last_fullsized":"2024-09-19T07:09:38.393512+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:51.637520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.177004+0000","last_change":"2024-09-19T07:09:16.911129+0000","last_active":"2024-09-19T07:09:38.177004+0000","last_peered":"2024-09-19T07:09:38.177004+0000","last_clean":"2024-09-19T07:09:38.177004+0000","last_became_active":"2024-09-19T07:09:16.910583+0000","last_became_peered":"2024-09-19T07:09:16.910583+0000","last_unstale":"2024-09-19T07:09:38.177004+0000","last_undegraded":"2024-09-19T07:09:38.177004+0000","last_fullsized":"2024-09-19T07:09:38.177004+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:34:37.295838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175577+0000","last_change":"2024-09-19T07:09:18.928622+0000","last_active":"2024-09-19T07:09:38.175577+0000","last_peered":"2024-09-19T07:09:38.175577+0000","last_clean":"2024-09-19T07:09:38.175577+0000","last_became_active":"2024-09-19T07:09:18.928284+0000","last_became_peered":"2024-09-19T07:09:18.928284+0000","last_unstale":"2024-09-19T07:09:38.175577+0000","last_undegraded":"2024-09-19T07:09:38.175577+0000","last_fullsized":"2024-09-19T07:09:38.175577+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:37:46.358756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.176700+0000","last_change":"2024-09-19T07:09:16.916142+0000","last_active":"2024-09-19T07:09:38.176700+0000","last_peered":"2024-09-19T07:09:38.176700+0000","last_clean":"2024-09-19T07:09:38.176700+0000","last_became_active":"2024-09-19T07:09:16.915766+0000","last_became_peered":"2024-09-19T07:09:16.915766+0000","last_unstale":"2024-09-19T07:09:38.176700+0000","last_undegraded":"2024-09-19T07:09:38.176700+0000","last_fullsized":"2024-09-19T07:09:38.176700+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:38.136422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.177929+0000","last_change":"2024-09-19T07:09:18.921912+0000","last_active":"2024-09-19T07:09:38.177929+0000","last_peered":"2024-09-19T07:09:38.177929+0000","last_clean":"2024-09-19T07:09:38.177929+0000","last_became_active":"2024-09-19T07:09:18.921595+0000","last_became_peered":"2024-09-19T07:09:18.921595+0000","last_unstale":"2024-09-19T07:09:38.177929+0000","last_undegraded":"2024-09-19T07:09:38.177929+0000","last_fullsized":"2024-09-19T07:09:38.177929+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:53.899052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.171786+0000","last_change":"2024-09-19T07:09:17.084856+0000","last_active":"2024-09-19T07:09:38.171786+0000","last_peered":"2024-09-19T07:09:38.171786+0000","last_clean":"2024-09-19T07:09:38.171786+0000","last_became_active":"2024-09-19T07:09:17.084541+0000","last_became_peered":"2024-09-19T07:09:17.084541+0000","last_unstale":"2024-09-19T07:09:38.171786+0000","last_undegraded":"2024-09-19T07:09:38.171786+0000","last_fullsized":"2024-09-19T07:09:38.171786+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:05.978765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.171659+0000","last_change":"2024-09-19T07:09:18.923732+0000","last_active":"2024-09-19T07:09:38.171659+0000","last_peered":"2024-09-19T07:09:38.171659+0000","last_clean":"2024-09-19T07:09:38.171659+0000","last_became_active":"2024-09-19T07:09:18.923410+0000","last_became_peered":"2024-09-19T07:09:18.923410+0000","last_unstale":"2024-09-19T07:09:38.171659+0000","last_undegraded":"2024-09-19T07:09:38.171659+0000","last_fullsized":"2024-09-19T07:09:38.171659+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:01:20.208414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.173640+0000","last_change":"2024-09-19T07:09:16.910364+0000","last_active":"2024-09-19T07:09:38.173640+0000","last_peered":"2024-09-19T07:09:38.173640+0000","last_clean":"2024-09-19T07:09:38.173640+0000","last_became_active":"2024-09-19T07:09:16.909835+0000","last_became_peered":"2024-09-19T07:09:16.909835+0000","last_unstale":"2024-09-19T07:09:38.173640+0000","last_undegraded":"2024-09-19T07:09:38.173640+0000","last_fullsized":"2024-09-19T07:09:38.173640+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:05.198823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":328,"num_read_kb":226,"num_write":166,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":26947,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":192480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645338,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":876544,"data_stored":428422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874270,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32720,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712432,"statfs":{"total":95995035648,"available":95961530368,"internally_reserved":0,"allocated":1572864,"data_stored":1080060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037795,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":892928,"data_stored":428658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266728,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":892928,"data_stored":428578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495661,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32644,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712508,"statfs":{"total":95995035648,"available":95961608192,"internally_reserved":0,"allocated":1486848,"data_stored":1020903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659186,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32052,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713100,"statfs":{"total":95995035648,"available":95962214400,"internally_reserved":0,"allocated":880640,"data_stored":428047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888118,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32652,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712500,"statfs":{"total":95995035648,"available":95961600000,"internally_reserved":0,"allocated":1499136,"data_stored":1020194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018940,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32116,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713036,"statfs":{"total":95995035648,"available":95962148864,"internally_reserved":0,"allocated":954368,"data_stored":488641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247872,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":897024,"data_stored":428358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444102,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":897024,"data_stored":429583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607627,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":487604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":901120,"data_stored":429318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":60801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T07:10:23.550 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T07:10:23.811 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:10:24.188 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:24 smithi148 ceph-mon[31180]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:10:24.188 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:24 smithi148 ceph-mon[31180]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:10:24.188 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:24 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:10:24.189 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:24 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:10:24.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.271+0000 7ff151555640 1 -- 172.21.15.148:0/4220575877 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff14c1082e0 msgr2=0x7ff14c10ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:24.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.271+0000 7ff151555640 1 --2- 172.21.15.148:0/4220575877 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff14c1082e0 0x7ff14c10ec50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff144009cd0 tx=0x7ff14402a8e0 comp rx=0 tx=0).stop 2024-09-19T07:10:24.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.271+0000 7ff151555640 1 -- 172.21.15.148:0/4220575877 shutdown_connections 2024-09-19T07:10:24.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.271+0000 7ff151555640 1 --2- 172.21.15.148:0/4220575877 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff14c1082e0 0x7ff14c10ec50 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:24.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.271+0000 7ff151555640 1 --2- 172.21.15.148:0/4220575877 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff14c103760 0x7ff14c107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:24.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.271+0000 7ff151555640 1 --2- 172.21.15.148:0/4220575877 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff14c102db0 0x7ff14c103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:24.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.271+0000 7ff151555640 1 -- 172.21.15.148:0/4220575877 >> 172.21.15.148:0/4220575877 conn(0x7ff14c0fc7d0 msgr2=0x7ff14c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:24.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.271+0000 7ff151555640 1 -- 172.21.15.148:0/4220575877 shutdown_connections 2024-09-19T07:10:24.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.272+0000 7ff151555640 1 -- 172.21.15.148:0/4220575877 wait complete. 2024-09-19T07:10:24.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.272+0000 7ff151555640 1 Processor -- start 2024-09-19T07:10:24.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.272+0000 7ff151555640 1 -- start start 2024-09-19T07:10:24.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.273+0000 7ff151555640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff14c102db0 0x7ff14c1985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:24.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.273+0000 7ff151555640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff14c103760 0x7ff14c198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:24.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.273+0000 7ff151555640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff14c1082e0 0x7ff14c19ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:24.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.273+0000 7ff151555640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff14c112100 con 0x7ff14c1082e0 2024-09-19T07:10:24.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.273+0000 7ff151555640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff14c111f80 con 0x7ff14c103760 2024-09-19T07:10:24.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.273+0000 7ff151555640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff14c112280 con 0x7ff14c102db0 2024-09-19T07:10:24.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.273+0000 7ff14b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff14c1082e0 0x7ff14c19ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:24.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.273+0000 7ff14b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff14c1082e0 0x7ff14c19ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44694/0 (socket says 172.21.15.148:44694) 2024-09-19T07:10:24.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.273+0000 7ff14b7fe640 1 -- 172.21.15.148:0/2313938078 learned_addr learned my addr 172.21.15.148:0/2313938078 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:24.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.273+0000 7ff14affd640 1 --2- 172.21.15.148:0/2313938078 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff14c102db0 0x7ff14c1985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:24.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.273+0000 7ff14a7fc640 1 --2- 172.21.15.148:0/2313938078 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff14c103760 0x7ff14c198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:24.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.273+0000 7ff14b7fe640 1 -- 172.21.15.148:0/2313938078 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff14c102db0 msgr2=0x7ff14c1985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:24.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.273+0000 7ff14b7fe640 1 --2- 172.21.15.148:0/2313938078 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff14c102db0 0x7ff14c1985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:24.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.273+0000 7ff14b7fe640 1 -- 172.21.15.148:0/2313938078 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff14c103760 msgr2=0x7ff14c198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:24.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.273+0000 7ff14b7fe640 1 --2- 172.21.15.148:0/2313938078 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff14c103760 0x7ff14c198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:24.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.273+0000 7ff14b7fe640 1 -- 172.21.15.148:0/2313938078 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff14c19d550 con 0x7ff14c1082e0 2024-09-19T07:10:24.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.273+0000 7ff14a7fc640 1 --2- 172.21.15.148:0/2313938078 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff14c103760 0x7ff14c198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:10:24.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.273+0000 7ff14b7fe640 1 --2- 172.21.15.148:0/2313938078 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff14c1082e0 0x7ff14c19ce70 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff144005e30 tx=0x7ff144032b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:24.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.273+0000 7ff133fff640 1 -- 172.21.15.148:0/2313938078 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff144004240 con 0x7ff14c1082e0 2024-09-19T07:10:24.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.274+0000 7ff151555640 1 -- 172.21.15.148:0/2313938078 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff14c19d7e0 con 0x7ff14c1082e0 2024-09-19T07:10:24.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.274+0000 7ff133fff640 1 -- 172.21.15.148:0/2313938078 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff144003e20 con 0x7ff14c1082e0 2024-09-19T07:10:24.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.274+0000 7ff133fff640 1 -- 172.21.15.148:0/2313938078 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14403a400 con 0x7ff14c1082e0 2024-09-19T07:10:24.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.274+0000 7ff151555640 1 -- 172.21.15.148:0/2313938078 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff14c1a5120 con 0x7ff14c1082e0 2024-09-19T07:10:24.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.274+0000 7ff151555640 1 -- 172.21.15.148:0/2313938078 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff14c103190 con 0x7ff14c1082e0 2024-09-19T07:10:24.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.276+0000 7ff133fff640 1 -- 172.21.15.148:0/2313938078 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7ff1440306c0 con 0x7ff14c1082e0 2024-09-19T07:10:24.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.276+0000 7ff133fff640 1 --2- 172.21.15.148:0/2313938078 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff1340a32d0 0x7ff1340a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:24.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.277+0000 7ff14affd640 1 --2- 172.21.15.148:0/2313938078 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff1340a32d0 0x7ff1340a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:24.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.277+0000 7ff133fff640 1 -- 172.21.15.148:0/2313938078 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7ff14402e030 con 0x7ff14c1082e0 2024-09-19T07:10:24.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.277+0000 7ff14affd640 1 --2- 172.21.15.148:0/2313938078 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff1340a32d0 0x7ff1340a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff140005fd0 tx=0x7ff14000b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:24.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.280+0000 7ff133fff640 1 -- 172.21.15.148:0/2313938078 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff1440bdd20 con 0x7ff14c1082e0 2024-09-19T07:10:24.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.446+0000 7ff151555640 1 -- 172.21.15.148:0/2313938078 --> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff14c062630 con 0x7ff1340a32d0 2024-09-19T07:10:24.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.452+0000 7ff133fff640 1 -- 172.21.15.148:0/2313938078 <== mgr.14148 v2:172.21.15.148:6800/3007822654 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258719 (secure 0 0 0) 0x7ff14c062630 con 0x7ff1340a32d0 2024-09-19T07:10:24.457 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:10:24.459 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2024-09-19T07:10:24.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.455+0000 7ff151555640 1 -- 172.21.15.148:0/2313938078 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff1340a32d0 msgr2=0x7ff1340a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:24.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.455+0000 7ff151555640 1 --2- 172.21.15.148:0/2313938078 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff1340a32d0 0x7ff1340a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff140005fd0 tx=0x7ff14000b390 comp rx=0 tx=0).stop 2024-09-19T07:10:24.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.455+0000 7ff151555640 1 -- 172.21.15.148:0/2313938078 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff14c1082e0 msgr2=0x7ff14c19ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:24.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.455+0000 7ff151555640 1 --2- 172.21.15.148:0/2313938078 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff14c1082e0 0x7ff14c19ce70 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff144005e30 tx=0x7ff144032b50 comp rx=0 tx=0).stop 2024-09-19T07:10:24.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.455+0000 7ff151555640 1 -- 172.21.15.148:0/2313938078 shutdown_connections 2024-09-19T07:10:24.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.455+0000 7ff151555640 1 --2- 172.21.15.148:0/2313938078 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff1340a32d0 0x7ff1340a5790 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:24.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.455+0000 7ff151555640 1 --2- 172.21.15.148:0/2313938078 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff14c1082e0 0x7ff14c19ce70 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:24.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.455+0000 7ff151555640 1 --2- 172.21.15.148:0/2313938078 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff14c103760 0x7ff14c198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:24.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.455+0000 7ff151555640 1 --2- 172.21.15.148:0/2313938078 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff14c102db0 0x7ff14c1985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:24.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.455+0000 7ff151555640 1 -- 172.21.15.148:0/2313938078 >> 172.21.15.148:0/2313938078 conn(0x7ff14c0fc7d0 msgr2=0x7ff14c106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:24.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.456+0000 7ff151555640 1 -- 172.21.15.148:0/2313938078 shutdown_connections 2024-09-19T07:10:24.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:24.456+0000 7ff151555640 1 -- 172.21.15.148:0/2313938078 wait complete. 2024-09-19T07:10:24.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:24 smithi179 ceph-mon[35716]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:10:24.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:24 smithi179 ceph-mon[35716]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:10:24.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:24 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:10:24.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:24 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:10:24.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:24 smithi165 ceph-mon[35326]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:10:24.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:24 smithi165 ceph-mon[35326]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:10:24.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:24 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:10:24.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:24 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:10:25.154 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":303,"stamp":"2024-09-19T07:10:23.098831+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654762,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":474,"num_read_kb":350,"num_write":349,"num_write_kb":3051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1207683,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":279,"ondisk_log_size":279,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":382484,"kb_used_data":12396,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124559340,"statfs":{"total":1151940427776,"available":1151548764160,"internally_reserved":0,"allocated":12693504,"data_stored":7098366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":378713402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":35,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002612"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.173070+0000","last_change":"2024-09-19T07:09:18.926902+0000","last_active":"2024-09-19T07:09:38.173070+0000","last_peered":"2024-09-19T07:09:38.173070+0000","last_clean":"2024-09-19T07:09:38.173070+0000","last_became_active":"2024-09-19T07:09:18.926582+0000","last_became_peered":"2024-09-19T07:09:18.926582+0000","last_unstale":"2024-09-19T07:09:38.173070+0000","last_undegraded":"2024-09-19T07:09:38.173070+0000","last_fullsized":"2024-09-19T07:09:38.173070+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:37.875779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.178193+0000","last_change":"2024-09-19T07:09:18.934205+0000","last_active":"2024-09-19T07:09:38.178193+0000","last_peered":"2024-09-19T07:09:38.178193+0000","last_clean":"2024-09-19T07:09:38.178193+0000","last_became_active":"2024-09-19T07:09:18.933767+0000","last_became_peered":"2024-09-19T07:09:18.933767+0000","last_unstale":"2024-09-19T07:09:38.178193+0000","last_undegraded":"2024-09-19T07:09:38.178193+0000","last_fullsized":"2024-09-19T07:09:38.178193+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:10:45.391428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.177846+0000","last_change":"2024-09-19T07:09:18.922312+0000","last_active":"2024-09-19T07:09:38.177846+0000","last_peered":"2024-09-19T07:09:38.177846+0000","last_clean":"2024-09-19T07:09:38.177846+0000","last_became_active":"2024-09-19T07:09:18.921476+0000","last_became_peered":"2024-09-19T07:09:18.921476+0000","last_unstale":"2024-09-19T07:09:38.177846+0000","last_undegraded":"2024-09-19T07:09:38.177846+0000","last_fullsized":"2024-09-19T07:09:38.177846+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:29.470616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.217953+0000","last_change":"2024-09-19T07:09:18.938218+0000","last_active":"2024-09-19T07:09:38.217953+0000","last_peered":"2024-09-19T07:09:38.217953+0000","last_clean":"2024-09-19T07:09:38.217953+0000","last_became_active":"2024-09-19T07:09:18.937306+0000","last_became_peered":"2024-09-19T07:09:18.937306+0000","last_unstale":"2024-09-19T07:09:38.217953+0000","last_undegraded":"2024-09-19T07:09:38.217953+0000","last_fullsized":"2024-09-19T07:09:38.217953+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:54.146506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.176208+0000","last_change":"2024-09-19T07:09:18.925837+0000","last_active":"2024-09-19T07:09:38.176208+0000","last_peered":"2024-09-19T07:09:38.176208+0000","last_clean":"2024-09-19T07:09:38.176208+0000","last_became_active":"2024-09-19T07:09:18.925559+0000","last_became_peered":"2024-09-19T07:09:18.925559+0000","last_unstale":"2024-09-19T07:09:38.176208+0000","last_undegraded":"2024-09-19T07:09:38.176208+0000","last_fullsized":"2024-09-19T07:09:38.176208+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:15:58.348347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.172737+0000","last_change":"2024-09-19T07:09:18.938911+0000","last_active":"2024-09-19T07:09:38.172737+0000","last_peered":"2024-09-19T07:09:38.172737+0000","last_clean":"2024-09-19T07:09:38.172737+0000","last_became_active":"2024-09-19T07:09:18.938601+0000","last_became_peered":"2024-09-19T07:09:18.938601+0000","last_unstale":"2024-09-19T07:09:38.172737+0000","last_undegraded":"2024-09-19T07:09:38.172737+0000","last_fullsized":"2024-09-19T07:09:38.172737+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:34.517324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175176+0000","last_change":"2024-09-19T07:09:18.930253+0000","last_active":"2024-09-19T07:09:38.175176+0000","last_peered":"2024-09-19T07:09:38.175176+0000","last_clean":"2024-09-19T07:09:38.175176+0000","last_became_active":"2024-09-19T07:09:18.929927+0000","last_became_peered":"2024-09-19T07:09:18.929927+0000","last_unstale":"2024-09-19T07:09:38.175176+0000","last_undegraded":"2024-09-19T07:09:38.175176+0000","last_fullsized":"2024-09-19T07:09:38.175176+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:31:39.186230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.180634+0000","last_change":"2024-09-19T07:09:38.180197+0000","last_active":"2024-09-19T07:09:38.180634+0000","last_peered":"2024-09-19T07:09:38.180634+0000","last_clean":"2024-09-19T07:09:38.180634+0000","last_became_active":"2024-09-19T07:09:38.179767+0000","last_became_peered":"2024-09-19T07:09:38.179767+0000","last_unstale":"2024-09-19T07:09:38.180634+0000","last_undegraded":"2024-09-19T07:09:38.180634+0000","last_fullsized":"2024-09-19T07:09:38.180634+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:43.581181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.176298+0000","last_change":"2024-09-19T07:09:18.937100+0000","last_active":"2024-09-19T07:09:38.176298+0000","last_peered":"2024-09-19T07:09:38.176298+0000","last_clean":"2024-09-19T07:09:38.176298+0000","last_became_active":"2024-09-19T07:09:18.935151+0000","last_became_peered":"2024-09-19T07:09:18.935151+0000","last_unstale":"2024-09-19T07:09:38.176298+0000","last_undegraded":"2024-09-19T07:09:38.176298+0000","last_fullsized":"2024-09-19T07:09:38.176298+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:46:30.950667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.173253+0000","last_change":"2024-09-19T07:09:18.940119+0000","last_active":"2024-09-19T07:09:38.173253+0000","last_peered":"2024-09-19T07:09:38.173253+0000","last_clean":"2024-09-19T07:09:38.173253+0000","last_became_active":"2024-09-19T07:09:18.939703+0000","last_became_peered":"2024-09-19T07:09:18.939703+0000","last_unstale":"2024-09-19T07:09:38.173253+0000","last_undegraded":"2024-09-19T07:09:38.173253+0000","last_fullsized":"2024-09-19T07:09:38.173253+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:51:04.982727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175765+0000","last_change":"2024-09-19T07:09:18.939146+0000","last_active":"2024-09-19T07:09:38.175765+0000","last_peered":"2024-09-19T07:09:38.175765+0000","last_clean":"2024-09-19T07:09:38.175765+0000","last_became_active":"2024-09-19T07:09:18.936842+0000","last_became_peered":"2024-09-19T07:09:18.936842+0000","last_unstale":"2024-09-19T07:09:38.175765+0000","last_undegraded":"2024-09-19T07:09:38.175765+0000","last_fullsized":"2024-09-19T07:09:38.175765+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:32.713505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.179358+0000","last_change":"2024-09-19T07:09:38.178834+0000","last_active":"2024-09-19T07:09:38.179358+0000","last_peered":"2024-09-19T07:09:38.179358+0000","last_clean":"2024-09-19T07:09:38.179358+0000","last_became_active":"2024-09-19T07:09:38.178477+0000","last_became_peered":"2024-09-19T07:09:38.178477+0000","last_unstale":"2024-09-19T07:09:38.179358+0000","last_undegraded":"2024-09-19T07:09:38.179358+0000","last_fullsized":"2024-09-19T07:09:38.179358+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:04:44.524920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.392086+0000","last_change":"2024-09-19T07:09:18.935422+0000","last_active":"2024-09-19T07:09:38.392086+0000","last_peered":"2024-09-19T07:09:38.392086+0000","last_clean":"2024-09-19T07:09:38.392086+0000","last_became_active":"2024-09-19T07:09:18.934994+0000","last_became_peered":"2024-09-19T07:09:18.934994+0000","last_unstale":"2024-09-19T07:09:38.392086+0000","last_undegraded":"2024-09-19T07:09:38.392086+0000","last_fullsized":"2024-09-19T07:09:38.392086+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:37:30.751247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.177649+0000","last_change":"2024-09-19T07:09:18.933954+0000","last_active":"2024-09-19T07:09:38.177649+0000","last_peered":"2024-09-19T07:09:38.177649+0000","last_clean":"2024-09-19T07:09:38.177649+0000","last_became_active":"2024-09-19T07:09:18.933588+0000","last_became_peered":"2024-09-19T07:09:18.933588+0000","last_unstale":"2024-09-19T07:09:38.177649+0000","last_undegraded":"2024-09-19T07:09:38.177649+0000","last_fullsized":"2024-09-19T07:09:38.177649+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:10.161172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.177587+0000","last_change":"2024-09-19T07:09:18.932122+0000","last_active":"2024-09-19T07:09:38.177587+0000","last_peered":"2024-09-19T07:09:38.177587+0000","last_clean":"2024-09-19T07:09:38.177587+0000","last_became_active":"2024-09-19T07:09:18.931798+0000","last_became_peered":"2024-09-19T07:09:18.931798+0000","last_unstale":"2024-09-19T07:09:38.177587+0000","last_undegraded":"2024-09-19T07:09:38.177587+0000","last_fullsized":"2024-09-19T07:09:38.177587+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:44.776375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175320+0000","last_change":"2024-09-19T07:09:18.935632+0000","last_active":"2024-09-19T07:09:38.175320+0000","last_peered":"2024-09-19T07:09:38.175320+0000","last_clean":"2024-09-19T07:09:38.175320+0000","last_became_active":"2024-09-19T07:09:18.935174+0000","last_became_peered":"2024-09-19T07:09:18.935174+0000","last_unstale":"2024-09-19T07:09:38.175320+0000","last_undegraded":"2024-09-19T07:09:38.175320+0000","last_fullsized":"2024-09-19T07:09:38.175320+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:22.170777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.173065+0000","last_change":"2024-09-19T07:09:18.931836+0000","last_active":"2024-09-19T07:09:38.173065+0000","last_peered":"2024-09-19T07:09:38.173065+0000","last_clean":"2024-09-19T07:09:38.173065+0000","last_became_active":"2024-09-19T07:09:18.931564+0000","last_became_peered":"2024-09-19T07:09:18.931564+0000","last_unstale":"2024-09-19T07:09:38.173065+0000","last_undegraded":"2024-09-19T07:09:38.173065+0000","last_fullsized":"2024-09-19T07:09:38.173065+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:53.674584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.173640+0000","last_change":"2024-09-19T07:09:18.933210+0000","last_active":"2024-09-19T07:09:38.173640+0000","last_peered":"2024-09-19T07:09:38.173640+0000","last_clean":"2024-09-19T07:09:38.173640+0000","last_became_active":"2024-09-19T07:09:18.932894+0000","last_became_peered":"2024-09-19T07:09:18.932894+0000","last_unstale":"2024-09-19T07:09:38.173640+0000","last_undegraded":"2024-09-19T07:09:38.173640+0000","last_fullsized":"2024-09-19T07:09:38.173640+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:50:56.669801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175421+0000","last_change":"2024-09-19T07:09:18.925627+0000","last_active":"2024-09-19T07:09:38.175421+0000","last_peered":"2024-09-19T07:09:38.175421+0000","last_clean":"2024-09-19T07:09:38.175421+0000","last_became_active":"2024-09-19T07:09:18.925340+0000","last_became_peered":"2024-09-19T07:09:18.925340+0000","last_unstale":"2024-09-19T07:09:38.175421+0000","last_undegraded":"2024-09-19T07:09:38.175421+0000","last_fullsized":"2024-09-19T07:09:38.175421+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:29.544534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.172766+0000","last_change":"2024-09-19T07:09:18.936963+0000","last_active":"2024-09-19T07:09:38.172766+0000","last_peered":"2024-09-19T07:09:38.172766+0000","last_clean":"2024-09-19T07:09:38.172766+0000","last_became_active":"2024-09-19T07:09:18.936615+0000","last_became_peered":"2024-09-19T07:09:18.936615+0000","last_unstale":"2024-09-19T07:09:38.172766+0000","last_undegraded":"2024-09-19T07:09:38.172766+0000","last_fullsized":"2024-09-19T07:09:38.172766+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:13.036392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.392101+0000","last_change":"2024-09-19T07:09:18.932018+0000","last_active":"2024-09-19T07:09:38.392101+0000","last_peered":"2024-09-19T07:09:38.392101+0000","last_clean":"2024-09-19T07:09:38.392101+0000","last_became_active":"2024-09-19T07:09:18.931624+0000","last_became_peered":"2024-09-19T07:09:18.931624+0000","last_unstale":"2024-09-19T07:09:38.392101+0000","last_undegraded":"2024-09-19T07:09:38.392101+0000","last_fullsized":"2024-09-19T07:09:38.392101+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:53:05.585166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175898+0000","last_change":"2024-09-19T07:09:18.935474+0000","last_active":"2024-09-19T07:09:38.175898+0000","last_peered":"2024-09-19T07:09:38.175898+0000","last_clean":"2024-09-19T07:09:38.175898+0000","last_became_active":"2024-09-19T07:09:18.929018+0000","last_became_peered":"2024-09-19T07:09:18.929018+0000","last_unstale":"2024-09-19T07:09:38.175898+0000","last_undegraded":"2024-09-19T07:09:38.175898+0000","last_fullsized":"2024-09-19T07:09:38.175898+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:01.383024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.171441+0000","last_change":"2024-09-19T07:09:18.928733+0000","last_active":"2024-09-19T07:09:38.171441+0000","last_peered":"2024-09-19T07:09:38.171441+0000","last_clean":"2024-09-19T07:09:38.171441+0000","last_became_active":"2024-09-19T07:09:18.928431+0000","last_became_peered":"2024-09-19T07:09:18.928431+0000","last_unstale":"2024-09-19T07:09:38.171441+0000","last_undegraded":"2024-09-19T07:09:38.171441+0000","last_fullsized":"2024-09-19T07:09:38.171441+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:37.313958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.178508+0000","last_change":"2024-09-19T07:09:18.921268+0000","last_active":"2024-09-19T07:09:38.178508+0000","last_peered":"2024-09-19T07:09:38.178508+0000","last_clean":"2024-09-19T07:09:38.178508+0000","last_became_active":"2024-09-19T07:09:18.920482+0000","last_became_peered":"2024-09-19T07:09:18.920482+0000","last_unstale":"2024-09-19T07:09:38.178508+0000","last_undegraded":"2024-09-19T07:09:38.178508+0000","last_fullsized":"2024-09-19T07:09:38.178508+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:35.201826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.179136+0000","last_change":"2024-09-19T07:09:38.179136+0000","last_active":"2024-09-19T07:09:38.179136+0000","last_peered":"2024-09-19T07:09:38.179136+0000","last_clean":"2024-09-19T07:09:38.179136+0000","last_became_active":"2024-09-19T07:09:38.178746+0000","last_became_peered":"2024-09-19T07:09:38.178746+0000","last_unstale":"2024-09-19T07:09:38.179136+0000","last_undegraded":"2024-09-19T07:09:38.179136+0000","last_fullsized":"2024-09-19T07:09:38.179136+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:03.788114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.177288+0000","last_change":"2024-09-19T07:09:18.924099+0000","last_active":"2024-09-19T07:09:38.177288+0000","last_peered":"2024-09-19T07:09:38.177288+0000","last_clean":"2024-09-19T07:09:38.177288+0000","last_became_active":"2024-09-19T07:09:18.923772+0000","last_became_peered":"2024-09-19T07:09:18.923772+0000","last_unstale":"2024-09-19T07:09:38.177288+0000","last_undegraded":"2024-09-19T07:09:38.177288+0000","last_fullsized":"2024-09-19T07:09:38.177288+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:05:04.954087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.172932+0000","last_change":"2024-09-19T07:09:18.923391+0000","last_active":"2024-09-19T07:09:38.172932+0000","last_peered":"2024-09-19T07:09:38.172932+0000","last_clean":"2024-09-19T07:09:38.172932+0000","last_became_active":"2024-09-19T07:09:18.923085+0000","last_became_peered":"2024-09-19T07:09:18.923085+0000","last_unstale":"2024-09-19T07:09:38.172932+0000","last_undegraded":"2024-09-19T07:09:38.172932+0000","last_fullsized":"2024-09-19T07:09:38.172932+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:43:27.032400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.392065+0000","last_change":"2024-09-19T07:09:18.937188+0000","last_active":"2024-09-19T07:09:38.392065+0000","last_peered":"2024-09-19T07:09:38.392065+0000","last_clean":"2024-09-19T07:09:38.392065+0000","last_became_active":"2024-09-19T07:09:18.936866+0000","last_became_peered":"2024-09-19T07:09:18.936866+0000","last_unstale":"2024-09-19T07:09:38.392065+0000","last_undegraded":"2024-09-19T07:09:38.392065+0000","last_fullsized":"2024-09-19T07:09:38.392065+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:29:08.835307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.177927+0000","last_change":"2024-09-19T07:09:18.935170+0000","last_active":"2024-09-19T07:09:38.177927+0000","last_peered":"2024-09-19T07:09:38.177927+0000","last_clean":"2024-09-19T07:09:38.177927+0000","last_became_active":"2024-09-19T07:09:18.934356+0000","last_became_peered":"2024-09-19T07:09:18.934356+0000","last_unstale":"2024-09-19T07:09:38.177927+0000","last_undegraded":"2024-09-19T07:09:38.177927+0000","last_fullsized":"2024-09-19T07:09:38.177927+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:53.567392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175782+0000","last_change":"2024-09-19T07:09:18.922640+0000","last_active":"2024-09-19T07:09:38.175782+0000","last_peered":"2024-09-19T07:09:38.175782+0000","last_clean":"2024-09-19T07:09:38.175782+0000","last_became_active":"2024-09-19T07:09:18.922312+0000","last_became_peered":"2024-09-19T07:09:18.922312+0000","last_unstale":"2024-09-19T07:09:38.175782+0000","last_undegraded":"2024-09-19T07:09:38.175782+0000","last_fullsized":"2024-09-19T07:09:38.175782+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:50.868818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.176074+0000","last_change":"2024-09-19T07:09:18.934364+0000","last_active":"2024-09-19T07:09:38.176074+0000","last_peered":"2024-09-19T07:09:38.176074+0000","last_clean":"2024-09-19T07:09:38.176074+0000","last_became_active":"2024-09-19T07:09:18.933533+0000","last_became_peered":"2024-09-19T07:09:18.933533+0000","last_unstale":"2024-09-19T07:09:38.176074+0000","last_undegraded":"2024-09-19T07:09:38.176074+0000","last_fullsized":"2024-09-19T07:09:38.176074+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:54.175425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.172694+0000","last_change":"2024-09-19T07:09:18.927456+0000","last_active":"2024-09-19T07:09:38.172694+0000","last_peered":"2024-09-19T07:09:38.172694+0000","last_clean":"2024-09-19T07:09:38.172694+0000","last_became_active":"2024-09-19T07:09:18.927117+0000","last_became_peered":"2024-09-19T07:09:18.927117+0000","last_unstale":"2024-09-19T07:09:38.172694+0000","last_undegraded":"2024-09-19T07:09:38.172694+0000","last_fullsized":"2024-09-19T07:09:38.172694+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:08.885898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.176351+0000","last_change":"2024-09-19T07:09:18.926024+0000","last_active":"2024-09-19T07:09:38.176351+0000","last_peered":"2024-09-19T07:09:38.176351+0000","last_clean":"2024-09-19T07:09:38.176351+0000","last_became_active":"2024-09-19T07:09:18.925689+0000","last_became_peered":"2024-09-19T07:09:18.925689+0000","last_unstale":"2024-09-19T07:09:38.176351+0000","last_undegraded":"2024-09-19T07:09:38.176351+0000","last_fullsized":"2024-09-19T07:09:38.176351+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:09:08.178214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'6","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:10:21.066756+0000","last_change":"2024-09-19T07:09:16.915804+0000","last_active":"2024-09-19T07:10:21.066756+0000","last_peered":"2024-09-19T07:10:21.066756+0000","last_clean":"2024-09-19T07:10:21.066756+0000","last_became_active":"2024-09-19T07:09:16.915434+0000","last_became_peered":"2024-09-19T07:09:16.915434+0000","last_unstale":"2024-09-19T07:10:21.066756+0000","last_undegraded":"2024-09-19T07:10:21.066756+0000","last_fullsized":"2024-09-19T07:10:21.066756+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:57.230475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.176935+0000","last_change":"2024-09-19T07:09:18.932497+0000","last_active":"2024-09-19T07:09:38.176935+0000","last_peered":"2024-09-19T07:09:38.176935+0000","last_clean":"2024-09-19T07:09:38.176935+0000","last_became_active":"2024-09-19T07:09:18.932213+0000","last_became_peered":"2024-09-19T07:09:18.932213+0000","last_unstale":"2024-09-19T07:09:38.176935+0000","last_undegraded":"2024-09-19T07:09:38.176935+0000","last_fullsized":"2024-09-19T07:09:38.176935+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:10.299077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.172875+0000","last_change":"2024-09-19T07:09:16.910171+0000","last_active":"2024-09-19T07:09:38.172875+0000","last_peered":"2024-09-19T07:09:38.172875+0000","last_clean":"2024-09-19T07:09:38.172875+0000","last_became_active":"2024-09-19T07:09:16.909840+0000","last_became_peered":"2024-09-19T07:09:16.909840+0000","last_unstale":"2024-09-19T07:09:38.172875+0000","last_undegraded":"2024-09-19T07:09:38.172875+0000","last_fullsized":"2024-09-19T07:09:38.172875+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:35.448892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.391818+0000","last_change":"2024-09-19T07:09:16.911336+0000","last_active":"2024-09-19T07:09:38.391818+0000","last_peered":"2024-09-19T07:09:38.391818+0000","last_clean":"2024-09-19T07:09:38.391818+0000","last_became_active":"2024-09-19T07:09:16.911027+0000","last_became_peered":"2024-09-19T07:09:16.911027+0000","last_unstale":"2024-09-19T07:09:38.391818+0000","last_undegraded":"2024-09-19T07:09:38.391818+0000","last_fullsized":"2024-09-19T07:09:38.391818+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:37:50.698597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.171395+0000","last_change":"2024-09-19T07:09:18.927713+0000","last_active":"2024-09-19T07:09:38.171395+0000","last_peered":"2024-09-19T07:09:38.171395+0000","last_clean":"2024-09-19T07:09:38.171395+0000","last_became_active":"2024-09-19T07:09:18.927430+0000","last_became_peered":"2024-09-19T07:09:18.927430+0000","last_unstale":"2024-09-19T07:09:38.171395+0000","last_undegraded":"2024-09-19T07:09:38.171395+0000","last_fullsized":"2024-09-19T07:09:38.171395+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:15:07.707723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.178877+0000","last_change":"2024-09-19T07:09:16.912391+0000","last_active":"2024-09-19T07:09:38.178877+0000","last_peered":"2024-09-19T07:09:38.178877+0000","last_clean":"2024-09-19T07:09:38.178877+0000","last_became_active":"2024-09-19T07:09:16.912034+0000","last_became_peered":"2024-09-19T07:09:16.912034+0000","last_unstale":"2024-09-19T07:09:38.178877+0000","last_undegraded":"2024-09-19T07:09:38.178877+0000","last_fullsized":"2024-09-19T07:09:38.178877+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:18:45.226107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.173014+0000","last_change":"2024-09-19T07:09:18.929476+0000","last_active":"2024-09-19T07:09:38.173014+0000","last_peered":"2024-09-19T07:09:38.173014+0000","last_clean":"2024-09-19T07:09:38.173014+0000","last_became_active":"2024-09-19T07:09:18.929183+0000","last_became_peered":"2024-09-19T07:09:18.929183+0000","last_unstale":"2024-09-19T07:09:38.173014+0000","last_undegraded":"2024-09-19T07:09:38.173014+0000","last_fullsized":"2024-09-19T07:09:38.173014+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:19:38.827130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'3","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:10:19.063343+0000","last_change":"2024-09-19T07:09:16.913012+0000","last_active":"2024-09-19T07:10:19.063343+0000","last_peered":"2024-09-19T07:10:19.063343+0000","last_clean":"2024-09-19T07:10:19.063343+0000","last_became_active":"2024-09-19T07:09:16.912633+0000","last_became_peered":"2024-09-19T07:09:16.912633+0000","last_unstale":"2024-09-19T07:10:19.063343+0000","last_undegraded":"2024-09-19T07:10:19.063343+0000","last_fullsized":"2024-09-19T07:10:19.063343+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:21:39.669961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175677+0000","last_change":"2024-09-19T07:09:18.937323+0000","last_active":"2024-09-19T07:09:38.175677+0000","last_peered":"2024-09-19T07:09:38.175677+0000","last_clean":"2024-09-19T07:09:38.175677+0000","last_became_active":"2024-09-19T07:09:18.936762+0000","last_became_peered":"2024-09-19T07:09:18.936762+0000","last_unstale":"2024-09-19T07:09:38.175677+0000","last_undegraded":"2024-09-19T07:09:38.175677+0000","last_fullsized":"2024-09-19T07:09:38.175677+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:37.692290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.176072+0000","last_change":"2024-09-19T07:09:16.912167+0000","last_active":"2024-09-19T07:09:38.176072+0000","last_peered":"2024-09-19T07:09:38.176072+0000","last_clean":"2024-09-19T07:09:38.176072+0000","last_became_active":"2024-09-19T07:09:16.911840+0000","last_became_peered":"2024-09-19T07:09:16.911840+0000","last_unstale":"2024-09-19T07:09:38.176072+0000","last_undegraded":"2024-09-19T07:09:38.176072+0000","last_fullsized":"2024-09-19T07:09:38.176072+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:31.901906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.178050+0000","last_change":"2024-09-19T07:09:18.932239+0000","last_active":"2024-09-19T07:09:38.178050+0000","last_peered":"2024-09-19T07:09:38.178050+0000","last_clean":"2024-09-19T07:09:38.178050+0000","last_became_active":"2024-09-19T07:09:18.931820+0000","last_became_peered":"2024-09-19T07:09:18.931820+0000","last_unstale":"2024-09-19T07:09:38.178050+0000","last_undegraded":"2024-09-19T07:09:38.178050+0000","last_fullsized":"2024-09-19T07:09:38.178050+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:09.407524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.178561+0000","last_change":"2024-09-19T07:09:17.085077+0000","last_active":"2024-09-19T07:09:38.178561+0000","last_peered":"2024-09-19T07:09:38.178561+0000","last_clean":"2024-09-19T07:09:38.178561+0000","last_became_active":"2024-09-19T07:09:17.084457+0000","last_became_peered":"2024-09-19T07:09:17.084457+0000","last_unstale":"2024-09-19T07:09:38.178561+0000","last_undegraded":"2024-09-19T07:09:38.178561+0000","last_fullsized":"2024-09-19T07:09:38.178561+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:42.416193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175612+0000","last_change":"2024-09-19T07:09:18.939830+0000","last_active":"2024-09-19T07:09:38.175612+0000","last_peered":"2024-09-19T07:09:38.175612+0000","last_clean":"2024-09-19T07:09:38.175612+0000","last_became_active":"2024-09-19T07:09:18.939359+0000","last_became_peered":"2024-09-19T07:09:18.939359+0000","last_unstale":"2024-09-19T07:09:38.175612+0000","last_undegraded":"2024-09-19T07:09:38.175612+0000","last_fullsized":"2024-09-19T07:09:38.175612+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:24:46.241902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'28","reported_seq":180,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:10:19.291750+0000","last_change":"2024-09-19T07:09:38.227707+0000","last_active":"2024-09-19T07:10:19.291750+0000","last_peered":"2024-09-19T07:10:19.291750+0000","last_clean":"2024-09-19T07:10:19.291750+0000","last_became_active":"2024-09-19T07:09:38.219073+0000","last_became_peered":"2024-09-19T07:09:38.219073+0000","last_unstale":"2024-09-19T07:10:19.291750+0000","last_undegraded":"2024-09-19T07:10:19.291750+0000","last_fullsized":"2024-09-19T07:10:19.291750+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:46.035315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59764,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":109,"num_read_kb":107,"num_write":29,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":26947,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.176558+0000","last_change":"2024-09-19T07:09:18.929531+0000","last_active":"2024-09-19T07:09:38.176558+0000","last_peered":"2024-09-19T07:09:38.176558+0000","last_clean":"2024-09-19T07:09:38.176558+0000","last_became_active":"2024-09-19T07:09:18.929253+0000","last_became_peered":"2024-09-19T07:09:18.929253+0000","last_unstale":"2024-09-19T07:09:38.176558+0000","last_undegraded":"2024-09-19T07:09:38.176558+0000","last_fullsized":"2024-09-19T07:09:38.176558+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:10.635116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175337+0000","last_change":"2024-09-19T07:09:16.914964+0000","last_active":"2024-09-19T07:09:38.175337+0000","last_peered":"2024-09-19T07:09:38.175337+0000","last_clean":"2024-09-19T07:09:38.175337+0000","last_became_active":"2024-09-19T07:09:16.914540+0000","last_became_peered":"2024-09-19T07:09:16.914540+0000","last_unstale":"2024-09-19T07:09:38.175337+0000","last_undegraded":"2024-09-19T07:09:38.175337+0000","last_fullsized":"2024-09-19T07:09:38.175337+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:30.903046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.391882+0000","last_change":"2024-09-19T07:09:18.931709+0000","last_active":"2024-09-19T07:09:38.391882+0000","last_peered":"2024-09-19T07:09:38.391882+0000","last_clean":"2024-09-19T07:09:38.391882+0000","last_became_active":"2024-09-19T07:09:18.931345+0000","last_became_peered":"2024-09-19T07:09:18.931345+0000","last_unstale":"2024-09-19T07:09:38.391882+0000","last_undegraded":"2024-09-19T07:09:38.391882+0000","last_fullsized":"2024-09-19T07:09:38.391882+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:28.916820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.177361+0000","last_change":"2024-09-19T07:09:16.914055+0000","last_active":"2024-09-19T07:09:38.177361+0000","last_peered":"2024-09-19T07:09:38.177361+0000","last_clean":"2024-09-19T07:09:38.177361+0000","last_became_active":"2024-09-19T07:09:16.913589+0000","last_became_peered":"2024-09-19T07:09:16.913589+0000","last_unstale":"2024-09-19T07:09:38.177361+0000","last_undegraded":"2024-09-19T07:09:38.177361+0000","last_fullsized":"2024-09-19T07:09:38.177361+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:29:16.322059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175501+0000","last_change":"2024-09-19T07:09:18.934879+0000","last_active":"2024-09-19T07:09:38.175501+0000","last_peered":"2024-09-19T07:09:38.175501+0000","last_clean":"2024-09-19T07:09:38.175501+0000","last_became_active":"2024-09-19T07:09:18.934432+0000","last_became_peered":"2024-09-19T07:09:18.934432+0000","last_unstale":"2024-09-19T07:09:38.175501+0000","last_undegraded":"2024-09-19T07:09:38.175501+0000","last_fullsized":"2024-09-19T07:09:38.175501+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:25.782782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'4","reported_seq":80,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:10:18.062033+0000","last_change":"2024-09-19T07:09:16.909256+0000","last_active":"2024-09-19T07:10:18.062033+0000","last_peered":"2024-09-19T07:10:18.062033+0000","last_clean":"2024-09-19T07:10:18.062033+0000","last_became_active":"2024-09-19T07:09:16.908932+0000","last_became_peered":"2024-09-19T07:09:16.908932+0000","last_unstale":"2024-09-19T07:10:18.062033+0000","last_undegraded":"2024-09-19T07:10:18.062033+0000","last_fullsized":"2024-09-19T07:10:18.062033+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:28.344756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175202+0000","last_change":"2024-09-19T07:09:18.931844+0000","last_active":"2024-09-19T07:09:38.175202+0000","last_peered":"2024-09-19T07:09:38.175202+0000","last_clean":"2024-09-19T07:09:38.175202+0000","last_became_active":"2024-09-19T07:09:18.931516+0000","last_became_peered":"2024-09-19T07:09:18.931516+0000","last_unstale":"2024-09-19T07:09:38.175202+0000","last_undegraded":"2024-09-19T07:09:38.175202+0000","last_fullsized":"2024-09-19T07:09:38.175202+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:27:29.812144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.176125+0000","last_change":"2024-09-19T07:09:17.085252+0000","last_active":"2024-09-19T07:09:38.176125+0000","last_peered":"2024-09-19T07:09:38.176125+0000","last_clean":"2024-09-19T07:09:38.176125+0000","last_became_active":"2024-09-19T07:09:17.084907+0000","last_became_peered":"2024-09-19T07:09:17.084907+0000","last_unstale":"2024-09-19T07:09:38.176125+0000","last_undegraded":"2024-09-19T07:09:38.176125+0000","last_fullsized":"2024-09-19T07:09:38.176125+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:59:40.351181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.177112+0000","last_change":"2024-09-19T07:09:18.932491+0000","last_active":"2024-09-19T07:09:38.177112+0000","last_peered":"2024-09-19T07:09:38.177112+0000","last_clean":"2024-09-19T07:09:38.177112+0000","last_became_active":"2024-09-19T07:09:18.932159+0000","last_became_peered":"2024-09-19T07:09:18.932159+0000","last_unstale":"2024-09-19T07:09:38.177112+0000","last_undegraded":"2024-09-19T07:09:38.177112+0000","last_fullsized":"2024-09-19T07:09:38.177112+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:31.144130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.178704+0000","last_change":"2024-09-19T07:09:16.911012+0000","last_active":"2024-09-19T07:09:38.178704+0000","last_peered":"2024-09-19T07:09:38.178704+0000","last_clean":"2024-09-19T07:09:38.178704+0000","last_became_active":"2024-09-19T07:09:16.910618+0000","last_became_peered":"2024-09-19T07:09:16.910618+0000","last_unstale":"2024-09-19T07:09:38.178704+0000","last_undegraded":"2024-09-19T07:09:38.178704+0000","last_fullsized":"2024-09-19T07:09:38.178704+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:16.316680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.217870+0000","last_change":"2024-09-19T07:09:38.217870+0000","last_active":"2024-09-19T07:09:38.217870+0000","last_peered":"2024-09-19T07:09:38.217870+0000","last_clean":"2024-09-19T07:09:38.217870+0000","last_became_active":"2024-09-19T07:09:38.217585+0000","last_became_peered":"2024-09-19T07:09:38.217585+0000","last_unstale":"2024-09-19T07:09:38.217870+0000","last_undegraded":"2024-09-19T07:09:38.217870+0000","last_fullsized":"2024-09-19T07:09:38.217870+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:41.320705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.392249+0000","last_change":"2024-09-19T07:09:16.911644+0000","last_active":"2024-09-19T07:09:38.392249+0000","last_peered":"2024-09-19T07:09:38.392249+0000","last_clean":"2024-09-19T07:09:38.392249+0000","last_became_active":"2024-09-19T07:09:16.911368+0000","last_became_peered":"2024-09-19T07:09:16.911368+0000","last_unstale":"2024-09-19T07:09:38.392249+0000","last_undegraded":"2024-09-19T07:09:38.392249+0000","last_fullsized":"2024-09-19T07:09:38.392249+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:12.953466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.176202+0000","last_change":"2024-09-19T07:09:18.933667+0000","last_active":"2024-09-19T07:09:38.176202+0000","last_peered":"2024-09-19T07:09:38.176202+0000","last_clean":"2024-09-19T07:09:38.176202+0000","last_became_active":"2024-09-19T07:09:18.933288+0000","last_became_peered":"2024-09-19T07:09:18.933288+0000","last_unstale":"2024-09-19T07:09:38.176202+0000","last_undegraded":"2024-09-19T07:09:38.176202+0000","last_fullsized":"2024-09-19T07:09:38.176202+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:54:38.127799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.178634+0000","last_change":"2024-09-19T07:09:16.909722+0000","last_active":"2024-09-19T07:09:38.178634+0000","last_peered":"2024-09-19T07:09:38.178634+0000","last_clean":"2024-09-19T07:09:38.178634+0000","last_became_active":"2024-09-19T07:09:16.909394+0000","last_became_peered":"2024-09-19T07:09:16.909394+0000","last_unstale":"2024-09-19T07:09:38.178634+0000","last_undegraded":"2024-09-19T07:09:38.178634+0000","last_fullsized":"2024-09-19T07:09:38.178634+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:21:53.342710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175698+0000","last_change":"2024-09-19T07:09:18.929473+0000","last_active":"2024-09-19T07:09:38.175698+0000","last_peered":"2024-09-19T07:09:38.175698+0000","last_clean":"2024-09-19T07:09:38.175698+0000","last_became_active":"2024-09-19T07:09:18.929176+0000","last_became_peered":"2024-09-19T07:09:18.929176+0000","last_unstale":"2024-09-19T07:09:38.175698+0000","last_undegraded":"2024-09-19T07:09:38.175698+0000","last_fullsized":"2024-09-19T07:09:38.175698+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:32:30.409528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175529+0000","last_change":"2024-09-19T07:09:17.084868+0000","last_active":"2024-09-19T07:09:38.175529+0000","last_peered":"2024-09-19T07:09:38.175529+0000","last_clean":"2024-09-19T07:09:38.175529+0000","last_became_active":"2024-09-19T07:09:17.084448+0000","last_became_peered":"2024-09-19T07:09:17.084448+0000","last_unstale":"2024-09-19T07:09:38.175529+0000","last_undegraded":"2024-09-19T07:09:38.175529+0000","last_fullsized":"2024-09-19T07:09:38.175529+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:38.211697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175880+0000","last_change":"2024-09-19T07:09:18.938865+0000","last_active":"2024-09-19T07:09:38.175880+0000","last_peered":"2024-09-19T07:09:38.175880+0000","last_clean":"2024-09-19T07:09:38.175880+0000","last_became_active":"2024-09-19T07:09:18.936324+0000","last_became_peered":"2024-09-19T07:09:18.936324+0000","last_unstale":"2024-09-19T07:09:38.175880+0000","last_undegraded":"2024-09-19T07:09:38.175880+0000","last_fullsized":"2024-09-19T07:09:38.175880+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:29:51.081140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":342,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175329+0000","last_change":"2024-09-19T07:08:09.270850+0000","last_active":"2024-09-19T07:09:38.175329+0000","last_peered":"2024-09-19T07:09:38.175329+0000","last_clean":"2024-09-19T07:09:38.175329+0000","last_became_active":"2024-09-19T07:08:09.270308+0000","last_became_peered":"2024-09-19T07:08:09.270308+0000","last_unstale":"2024-09-19T07:09:38.175329+0000","last_undegraded":"2024-09-19T07:09:38.175329+0000","last_fullsized":"2024-09-19T07:09:38.175329+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:04:49.729632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:04:49.729632+0000","last_clean_scrub_stamp":"2024-09-19T07:04:49.729632+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:15.588732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.217622+0000","last_change":"2024-09-19T07:09:16.907648+0000","last_active":"2024-09-19T07:09:38.217622+0000","last_peered":"2024-09-19T07:09:38.217622+0000","last_clean":"2024-09-19T07:09:38.217622+0000","last_became_active":"2024-09-19T07:09:16.907363+0000","last_became_peered":"2024-09-19T07:09:16.907363+0000","last_unstale":"2024-09-19T07:09:38.217622+0000","last_undegraded":"2024-09-19T07:09:38.217622+0000","last_fullsized":"2024-09-19T07:09:38.217622+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:12:27.898493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.171872+0000","last_change":"2024-09-19T07:09:18.926008+0000","last_active":"2024-09-19T07:09:38.171872+0000","last_peered":"2024-09-19T07:09:38.171872+0000","last_clean":"2024-09-19T07:09:38.171872+0000","last_became_active":"2024-09-19T07:09:18.925689+0000","last_became_peered":"2024-09-19T07:09:18.925689+0000","last_unstale":"2024-09-19T07:09:38.171872+0000","last_undegraded":"2024-09-19T07:09:38.171872+0000","last_fullsized":"2024-09-19T07:09:38.171872+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:16:06.467934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175270+0000","last_change":"2024-09-19T07:09:16.911327+0000","last_active":"2024-09-19T07:09:38.175270+0000","last_peered":"2024-09-19T07:09:38.175270+0000","last_clean":"2024-09-19T07:09:38.175270+0000","last_became_active":"2024-09-19T07:09:16.911031+0000","last_became_peered":"2024-09-19T07:09:16.911031+0000","last_unstale":"2024-09-19T07:09:38.175270+0000","last_undegraded":"2024-09-19T07:09:38.175270+0000","last_fullsized":"2024-09-19T07:09:38.175270+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:03.307119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.391808+0000","last_change":"2024-09-19T07:09:18.933813+0000","last_active":"2024-09-19T07:09:38.391808+0000","last_peered":"2024-09-19T07:09:38.391808+0000","last_clean":"2024-09-19T07:09:38.391808+0000","last_became_active":"2024-09-19T07:09:18.933475+0000","last_became_peered":"2024-09-19T07:09:18.933475+0000","last_unstale":"2024-09-19T07:09:38.391808+0000","last_undegraded":"2024-09-19T07:09:38.391808+0000","last_fullsized":"2024-09-19T07:09:38.391808+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:34:09.149593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'4","reported_seq":80,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:10:21.065534+0000","last_change":"2024-09-19T07:09:17.084833+0000","last_active":"2024-09-19T07:10:21.065534+0000","last_peered":"2024-09-19T07:10:21.065534+0000","last_clean":"2024-09-19T07:10:21.065534+0000","last_became_active":"2024-09-19T07:09:17.084477+0000","last_became_peered":"2024-09-19T07:09:17.084477+0000","last_unstale":"2024-09-19T07:10:21.065534+0000","last_undegraded":"2024-09-19T07:10:21.065534+0000","last_fullsized":"2024-09-19T07:10:21.065534+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:17:50.962480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.178639+0000","last_change":"2024-09-19T07:09:18.935991+0000","last_active":"2024-09-19T07:09:38.178639+0000","last_peered":"2024-09-19T07:09:38.178639+0000","last_clean":"2024-09-19T07:09:38.178639+0000","last_became_active":"2024-09-19T07:09:18.935677+0000","last_became_peered":"2024-09-19T07:09:18.935677+0000","last_unstale":"2024-09-19T07:09:38.178639+0000","last_undegraded":"2024-09-19T07:09:38.178639+0000","last_fullsized":"2024-09-19T07:09:38.178639+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:45.550119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175650+0000","last_change":"2024-09-19T07:09:16.911755+0000","last_active":"2024-09-19T07:09:38.175650+0000","last_peered":"2024-09-19T07:09:38.175650+0000","last_clean":"2024-09-19T07:09:38.175650+0000","last_became_active":"2024-09-19T07:09:16.911211+0000","last_became_peered":"2024-09-19T07:09:16.911211+0000","last_unstale":"2024-09-19T07:09:38.175650+0000","last_undegraded":"2024-09-19T07:09:38.175650+0000","last_fullsized":"2024-09-19T07:09:38.175650+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:15.365423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.173027+0000","last_change":"2024-09-19T07:09:18.940282+0000","last_active":"2024-09-19T07:09:38.173027+0000","last_peered":"2024-09-19T07:09:38.173027+0000","last_clean":"2024-09-19T07:09:38.173027+0000","last_became_active":"2024-09-19T07:09:18.939918+0000","last_became_peered":"2024-09-19T07:09:18.939918+0000","last_unstale":"2024-09-19T07:09:38.173027+0000","last_undegraded":"2024-09-19T07:09:38.173027+0000","last_fullsized":"2024-09-19T07:09:38.173027+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:11.161676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.173522+0000","last_change":"2024-09-19T07:09:17.086103+0000","last_active":"2024-09-19T07:09:38.173522+0000","last_peered":"2024-09-19T07:09:38.173522+0000","last_clean":"2024-09-19T07:09:38.173522+0000","last_became_active":"2024-09-19T07:09:17.085805+0000","last_became_peered":"2024-09-19T07:09:17.085805+0000","last_unstale":"2024-09-19T07:09:38.173522+0000","last_undegraded":"2024-09-19T07:09:38.173522+0000","last_fullsized":"2024-09-19T07:09:38.173522+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:28.522487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"78'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.173192+0000","last_change":"2024-09-19T07:09:18.932603+0000","last_active":"2024-09-19T07:09:38.173192+0000","last_peered":"2024-09-19T07:09:38.173192+0000","last_clean":"2024-09-19T07:09:38.173192+0000","last_became_active":"2024-09-19T07:09:18.932309+0000","last_became_peered":"2024-09-19T07:09:18.932309+0000","last_unstale":"2024-09-19T07:09:38.173192+0000","last_undegraded":"2024-09-19T07:09:38.173192+0000","last_fullsized":"2024-09-19T07:09:38.173192+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:19.746024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.176846+0000","last_change":"2024-09-19T07:09:17.085287+0000","last_active":"2024-09-19T07:09:38.176846+0000","last_peered":"2024-09-19T07:09:38.176846+0000","last_clean":"2024-09-19T07:09:38.176846+0000","last_became_active":"2024-09-19T07:09:17.084964+0000","last_became_peered":"2024-09-19T07:09:17.084964+0000","last_unstale":"2024-09-19T07:09:38.176846+0000","last_undegraded":"2024-09-19T07:09:38.176846+0000","last_fullsized":"2024-09-19T07:09:38.176846+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:51:01.035344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.392115+0000","last_change":"2024-09-19T07:09:18.921623+0000","last_active":"2024-09-19T07:09:38.392115+0000","last_peered":"2024-09-19T07:09:38.392115+0000","last_clean":"2024-09-19T07:09:38.392115+0000","last_became_active":"2024-09-19T07:09:18.921321+0000","last_became_peered":"2024-09-19T07:09:18.921321+0000","last_unstale":"2024-09-19T07:09:38.392115+0000","last_undegraded":"2024-09-19T07:09:38.392115+0000","last_fullsized":"2024-09-19T07:09:38.392115+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:28:55.616889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'12","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:43.929523+0000","last_change":"2024-09-19T07:09:16.910251+0000","last_active":"2024-09-19T07:09:43.929523+0000","last_peered":"2024-09-19T07:09:43.929523+0000","last_clean":"2024-09-19T07:09:43.929523+0000","last_became_active":"2024-09-19T07:09:16.909821+0000","last_became_peered":"2024-09-19T07:09:16.909821+0000","last_unstale":"2024-09-19T07:09:43.929523+0000","last_undegraded":"2024-09-19T07:09:43.929523+0000","last_fullsized":"2024-09-19T07:09:43.929523+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:02.958557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.171648+0000","last_change":"2024-09-19T07:09:18.930831+0000","last_active":"2024-09-19T07:09:38.171648+0000","last_peered":"2024-09-19T07:09:38.171648+0000","last_clean":"2024-09-19T07:09:38.171648+0000","last_became_active":"2024-09-19T07:09:18.930475+0000","last_became_peered":"2024-09-19T07:09:18.930475+0000","last_unstale":"2024-09-19T07:09:38.171648+0000","last_undegraded":"2024-09-19T07:09:38.171648+0000","last_fullsized":"2024-09-19T07:09:38.171648+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:30.512246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.217761+0000","last_change":"2024-09-19T07:09:16.906666+0000","last_active":"2024-09-19T07:09:38.217761+0000","last_peered":"2024-09-19T07:09:38.217761+0000","last_clean":"2024-09-19T07:09:38.217761+0000","last_became_active":"2024-09-19T07:09:16.906369+0000","last_became_peered":"2024-09-19T07:09:16.906369+0000","last_unstale":"2024-09-19T07:09:38.217761+0000","last_undegraded":"2024-09-19T07:09:38.217761+0000","last_fullsized":"2024-09-19T07:09:38.217761+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:56.915089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.178077+0000","last_change":"2024-09-19T07:09:18.934942+0000","last_active":"2024-09-19T07:09:38.178077+0000","last_peered":"2024-09-19T07:09:38.178077+0000","last_clean":"2024-09-19T07:09:38.178077+0000","last_became_active":"2024-09-19T07:09:18.934595+0000","last_became_peered":"2024-09-19T07:09:18.934595+0000","last_unstale":"2024-09-19T07:09:38.178077+0000","last_undegraded":"2024-09-19T07:09:38.178077+0000","last_fullsized":"2024-09-19T07:09:38.178077+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:54.306541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.183567+0000","last_change":"2024-09-19T07:09:38.183567+0000","last_active":"2024-09-19T07:09:38.183567+0000","last_peered":"2024-09-19T07:09:38.183567+0000","last_clean":"2024-09-19T07:09:38.183567+0000","last_became_active":"2024-09-19T07:09:38.180778+0000","last_became_peered":"2024-09-19T07:09:38.180778+0000","last_unstale":"2024-09-19T07:09:38.183567+0000","last_undegraded":"2024-09-19T07:09:38.183567+0000","last_fullsized":"2024-09-19T07:09:38.183567+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:43.226551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.176289+0000","last_change":"2024-09-19T07:09:18.934457+0000","last_active":"2024-09-19T07:09:38.176289+0000","last_peered":"2024-09-19T07:09:38.176289+0000","last_clean":"2024-09-19T07:09:38.176289+0000","last_became_active":"2024-09-19T07:09:18.934126+0000","last_became_peered":"2024-09-19T07:09:18.934126+0000","last_unstale":"2024-09-19T07:09:38.176289+0000","last_undegraded":"2024-09-19T07:09:38.176289+0000","last_fullsized":"2024-09-19T07:09:38.176289+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:37:16.152335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.171956+0000","last_change":"2024-09-19T07:09:16.908457+0000","last_active":"2024-09-19T07:09:38.171956+0000","last_peered":"2024-09-19T07:09:38.171956+0000","last_clean":"2024-09-19T07:09:38.171956+0000","last_became_active":"2024-09-19T07:09:16.908128+0000","last_became_peered":"2024-09-19T07:09:16.908128+0000","last_unstale":"2024-09-19T07:09:38.171956+0000","last_undegraded":"2024-09-19T07:09:38.171956+0000","last_fullsized":"2024-09-19T07:09:38.171956+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:48:50.579301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.172762+0000","last_change":"2024-09-19T07:09:18.928763+0000","last_active":"2024-09-19T07:09:38.172762+0000","last_peered":"2024-09-19T07:09:38.172762+0000","last_clean":"2024-09-19T07:09:38.172762+0000","last_became_active":"2024-09-19T07:09:18.928231+0000","last_became_peered":"2024-09-19T07:09:18.928231+0000","last_unstale":"2024-09-19T07:09:38.172762+0000","last_undegraded":"2024-09-19T07:09:38.172762+0000","last_fullsized":"2024-09-19T07:09:38.172762+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:26.652378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175889+0000","last_change":"2024-09-19T07:09:16.913740+0000","last_active":"2024-09-19T07:09:38.175889+0000","last_peered":"2024-09-19T07:09:38.175889+0000","last_clean":"2024-09-19T07:09:38.175889+0000","last_became_active":"2024-09-19T07:09:16.912419+0000","last_became_peered":"2024-09-19T07:09:16.912419+0000","last_unstale":"2024-09-19T07:09:38.175889+0000","last_undegraded":"2024-09-19T07:09:38.175889+0000","last_fullsized":"2024-09-19T07:09:38.175889+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:16.658996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.171848+0000","last_change":"2024-09-19T07:09:18.930697+0000","last_active":"2024-09-19T07:09:38.171848+0000","last_peered":"2024-09-19T07:09:38.171848+0000","last_clean":"2024-09-19T07:09:38.171848+0000","last_became_active":"2024-09-19T07:09:18.930355+0000","last_became_peered":"2024-09-19T07:09:18.930355+0000","last_unstale":"2024-09-19T07:09:38.171848+0000","last_undegraded":"2024-09-19T07:09:38.171848+0000","last_fullsized":"2024-09-19T07:09:38.171848+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:07.217195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.184284+0000","last_change":"2024-09-19T07:09:38.183637+0000","last_active":"2024-09-19T07:09:38.184284+0000","last_peered":"2024-09-19T07:09:38.184284+0000","last_clean":"2024-09-19T07:09:38.184284+0000","last_became_active":"2024-09-19T07:09:38.178732+0000","last_became_peered":"2024-09-19T07:09:38.178732+0000","last_unstale":"2024-09-19T07:09:38.184284+0000","last_undegraded":"2024-09-19T07:09:38.184284+0000","last_fullsized":"2024-09-19T07:09:38.184284+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:14.287130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175530+0000","last_change":"2024-09-19T07:09:18.935120+0000","last_active":"2024-09-19T07:09:38.175530+0000","last_peered":"2024-09-19T07:09:38.175530+0000","last_clean":"2024-09-19T07:09:38.175530+0000","last_became_active":"2024-09-19T07:09:18.934227+0000","last_became_peered":"2024-09-19T07:09:18.934227+0000","last_unstale":"2024-09-19T07:09:38.175530+0000","last_undegraded":"2024-09-19T07:09:38.175530+0000","last_fullsized":"2024-09-19T07:09:38.175530+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:20.328983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.393512+0000","last_change":"2024-09-19T07:09:38.393512+0000","last_active":"2024-09-19T07:09:38.393512+0000","last_peered":"2024-09-19T07:09:38.393512+0000","last_clean":"2024-09-19T07:09:38.393512+0000","last_became_active":"2024-09-19T07:09:38.393200+0000","last_became_peered":"2024-09-19T07:09:38.393200+0000","last_unstale":"2024-09-19T07:09:38.393512+0000","last_undegraded":"2024-09-19T07:09:38.393512+0000","last_fullsized":"2024-09-19T07:09:38.393512+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:51.637520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.177004+0000","last_change":"2024-09-19T07:09:16.911129+0000","last_active":"2024-09-19T07:09:38.177004+0000","last_peered":"2024-09-19T07:09:38.177004+0000","last_clean":"2024-09-19T07:09:38.177004+0000","last_became_active":"2024-09-19T07:09:16.910583+0000","last_became_peered":"2024-09-19T07:09:16.910583+0000","last_unstale":"2024-09-19T07:09:38.177004+0000","last_undegraded":"2024-09-19T07:09:38.177004+0000","last_fullsized":"2024-09-19T07:09:38.177004+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:34:37.295838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.175577+0000","last_change":"2024-09-19T07:09:18.928622+0000","last_active":"2024-09-19T07:09:38.175577+0000","last_peered":"2024-09-19T07:09:38.175577+0000","last_clean":"2024-09-19T07:09:38.175577+0000","last_became_active":"2024-09-19T07:09:18.928284+0000","last_became_peered":"2024-09-19T07:09:18.928284+0000","last_unstale":"2024-09-19T07:09:38.175577+0000","last_undegraded":"2024-09-19T07:09:38.175577+0000","last_fullsized":"2024-09-19T07:09:38.175577+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:37:46.358756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.176700+0000","last_change":"2024-09-19T07:09:16.916142+0000","last_active":"2024-09-19T07:09:38.176700+0000","last_peered":"2024-09-19T07:09:38.176700+0000","last_clean":"2024-09-19T07:09:38.176700+0000","last_became_active":"2024-09-19T07:09:16.915766+0000","last_became_peered":"2024-09-19T07:09:16.915766+0000","last_unstale":"2024-09-19T07:09:38.176700+0000","last_undegraded":"2024-09-19T07:09:38.176700+0000","last_fullsized":"2024-09-19T07:09:38.176700+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:38.136422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.177929+0000","last_change":"2024-09-19T07:09:18.921912+0000","last_active":"2024-09-19T07:09:38.177929+0000","last_peered":"2024-09-19T07:09:38.177929+0000","last_clean":"2024-09-19T07:09:38.177929+0000","last_became_active":"2024-09-19T07:09:18.921595+0000","last_became_peered":"2024-09-19T07:09:18.921595+0000","last_unstale":"2024-09-19T07:09:38.177929+0000","last_undegraded":"2024-09-19T07:09:38.177929+0000","last_fullsized":"2024-09-19T07:09:38.177929+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:53.899052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.171786+0000","last_change":"2024-09-19T07:09:17.084856+0000","last_active":"2024-09-19T07:09:38.171786+0000","last_peered":"2024-09-19T07:09:38.171786+0000","last_clean":"2024-09-19T07:09:38.171786+0000","last_became_active":"2024-09-19T07:09:17.084541+0000","last_became_peered":"2024-09-19T07:09:17.084541+0000","last_unstale":"2024-09-19T07:09:38.171786+0000","last_undegraded":"2024-09-19T07:09:38.171786+0000","last_fullsized":"2024-09-19T07:09:38.171786+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:05.978765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.171659+0000","last_change":"2024-09-19T07:09:18.923732+0000","last_active":"2024-09-19T07:09:38.171659+0000","last_peered":"2024-09-19T07:09:38.171659+0000","last_clean":"2024-09-19T07:09:38.171659+0000","last_became_active":"2024-09-19T07:09:18.923410+0000","last_became_peered":"2024-09-19T07:09:18.923410+0000","last_unstale":"2024-09-19T07:09:38.171659+0000","last_undegraded":"2024-09-19T07:09:38.171659+0000","last_fullsized":"2024-09-19T07:09:38.171659+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:01:20.208414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:09:38.173640+0000","last_change":"2024-09-19T07:09:16.910364+0000","last_active":"2024-09-19T07:09:38.173640+0000","last_peered":"2024-09-19T07:09:38.173640+0000","last_clean":"2024-09-19T07:09:38.173640+0000","last_became_active":"2024-09-19T07:09:16.909835+0000","last_became_peered":"2024-09-19T07:09:16.909835+0000","last_unstale":"2024-09-19T07:09:38.173640+0000","last_undegraded":"2024-09-19T07:09:38.173640+0000","last_fullsized":"2024-09-19T07:09:38.173640+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:05.198823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":338,"num_read_kb":231,"num_write":166,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":26947,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":192480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645338,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":876544,"data_stored":428422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874270,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32720,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712432,"statfs":{"total":95995035648,"available":95961530368,"internally_reserved":0,"allocated":1572864,"data_stored":1080060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037796,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":892928,"data_stored":428658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266728,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":892928,"data_stored":428578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495661,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32644,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712508,"statfs":{"total":95995035648,"available":95961608192,"internally_reserved":0,"allocated":1486848,"data_stored":1020903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659187,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32052,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713100,"statfs":{"total":95995035648,"available":95962214400,"internally_reserved":0,"allocated":880640,"data_stored":428047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888119,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32652,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712500,"statfs":{"total":95995035648,"available":95961600000,"internally_reserved":0,"allocated":1499136,"data_stored":1020194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018940,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32116,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713036,"statfs":{"total":95995035648,"available":95962148864,"internally_reserved":0,"allocated":954368,"data_stored":488641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247873,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":897024,"data_stored":428358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444102,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":897024,"data_stored":429583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607627,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":487604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":901120,"data_stored":429318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":60801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T07:10:25.158 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T07:10:25.159 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-19T07:10:25.159 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-19T07:10:25.159 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-19T07:10:25.408 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:10:25.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:25 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:10:25.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:25 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:10:25.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:25 smithi179 ceph-mon[35716]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:10:25.529 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:25 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:10:25.529 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:25 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:10:25.529 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:25 smithi148 ceph-mon[31180]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:10:25.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:25 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:10:25.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:25 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:10:25.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:25 smithi165 ceph-mon[35326]: from='mgr.14148 172.21.15.148:0/110714268' entity='mgr.x' 2024-09-19T07:10:25.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:25.905+0000 7fe10a250640 1 -- 172.21.15.148:0/303596364 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe104103700 msgr2=0x7fe10410bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:25.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:25.905+0000 7fe10a250640 1 --2- 172.21.15.148:0/303596364 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe104103700 0x7fe10410bbf0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8009900 tx=0x7fe0f802a480 comp rx=0 tx=0).stop 2024-09-19T07:10:25.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:25.906+0000 7fe10a250640 1 -- 172.21.15.148:0/303596364 shutdown_connections 2024-09-19T07:10:25.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:25.906+0000 7fe10a250640 1 --2- 172.21.15.148:0/303596364 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe10410c180 0x7fe10410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:25.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:25.906+0000 7fe10a250640 1 --2- 172.21.15.148:0/303596364 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe104103700 0x7fe10410bbf0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:25.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:25.906+0000 7fe10a250640 1 --2- 172.21.15.148:0/303596364 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe104102de0 0x7fe1041031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:25.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:25.906+0000 7fe10a250640 1 -- 172.21.15.148:0/303596364 >> 172.21.15.148:0/303596364 conn(0x7fe1040fc7a0 msgr2=0x7fe1040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:25.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:25.906+0000 7fe10a250640 1 -- 172.21.15.148:0/303596364 shutdown_connections 2024-09-19T07:10:25.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:25.906+0000 7fe10a250640 1 -- 172.21.15.148:0/303596364 wait complete. 2024-09-19T07:10:25.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:25.906+0000 7fe10a250640 1 Processor -- start 2024-09-19T07:10:25.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:25.906+0000 7fe10a250640 1 -- start start 2024-09-19T07:10:25.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:25.907+0000 7fe10a250640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe104102de0 0x7fe104198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:25.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:25.907+0000 7fe10a250640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe104103700 0x7fe1041989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:25.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:25.907+0000 7fe10a250640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe10410c180 0x7fe10419cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:25.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:25.907+0000 7fe10a250640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe104111f70 con 0x7fe104103700 2024-09-19T07:10:25.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:25.907+0000 7fe10a250640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe104111df0 con 0x7fe104102de0 2024-09-19T07:10:25.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:25.907+0000 7fe10a250640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe1041120f0 con 0x7fe10410c180 2024-09-19T07:10:25.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:25.907+0000 7fe102ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe104103700 0x7fe1041989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:25.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:25.907+0000 7fe102ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe104103700 0x7fe1041989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44716/0 (socket says 172.21.15.148:44716) 2024-09-19T07:10:25.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:25.907+0000 7fe102ffd640 1 -- 172.21.15.148:0/3515457990 learned_addr learned my addr 172.21.15.148:0/3515457990 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:25.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:25.907+0000 7fe1037fe640 1 --2- 172.21.15.148:0/3515457990 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe104102de0 0x7fe104198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:25.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:25.907+0000 7fe103fff640 1 --2- 172.21.15.148:0/3515457990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe10410c180 0x7fe10419cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:25.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:25.907+0000 7fe102ffd640 1 -- 172.21.15.148:0/3515457990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe10410c180 msgr2=0x7fe10419cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:25.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:25.907+0000 7fe102ffd640 1 --2- 172.21.15.148:0/3515457990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe10410c180 0x7fe10419cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:25.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:25.907+0000 7fe102ffd640 1 -- 172.21.15.148:0/3515457990 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe104102de0 msgr2=0x7fe104198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:25.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:25.907+0000 7fe102ffd640 1 --2- 172.21.15.148:0/3515457990 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe104102de0 0x7fe104198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:25.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:25.907+0000 7fe102ffd640 1 -- 172.21.15.148:0/3515457990 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe10419d420 con 0x7fe104103700 2024-09-19T07:10:25.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:25.907+0000 7fe102ffd640 1 --2- 172.21.15.148:0/3515457990 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe104103700 0x7fe1041989b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8006010 tx=0x7fe0f80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:25.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:25.907+0000 7fe100ff9640 1 -- 172.21.15.148:0/3515457990 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f803f030 con 0x7fe104103700 2024-09-19T07:10:25.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:25.907+0000 7fe100ff9640 1 -- 172.21.15.148:0/3515457990 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe0f8003ce0 con 0x7fe104103700 2024-09-19T07:10:25.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:25.907+0000 7fe10a250640 1 -- 172.21.15.148:0/3515457990 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe10419d6b0 con 0x7fe104103700 2024-09-19T07:10:25.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:25.907+0000 7fe100ff9640 1 -- 172.21.15.148:0/3515457990 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f8035070 con 0x7fe104103700 2024-09-19T07:10:25.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:25.907+0000 7fe10a250640 1 -- 172.21.15.148:0/3515457990 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1041a4ff0 con 0x7fe104103700 2024-09-19T07:10:25.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:25.909+0000 7fe10a250640 1 -- 172.21.15.148:0/3515457990 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe10406afd0 con 0x7fe104103700 2024-09-19T07:10:25.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:25.909+0000 7fe100ff9640 1 -- 172.21.15.148:0/3515457990 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fe0f8042030 con 0x7fe104103700 2024-09-19T07:10:25.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:25.910+0000 7fe100ff9640 1 --2- 172.21.15.148:0/3515457990 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fe0ec0a32d0 0x7fe0ec0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:25.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:25.910+0000 7fe1037fe640 1 --2- 172.21.15.148:0/3515457990 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fe0ec0a32d0 0x7fe0ec0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:25.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:25.910+0000 7fe100ff9640 1 -- 172.21.15.148:0/3515457990 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7fe0f80f00a0 con 0x7fe104103700 2024-09-19T07:10:25.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:25.911+0000 7fe1037fe640 1 --2- 172.21.15.148:0/3515457990 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fe0ec0a32d0 0x7fe0ec0a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe0f40058c0 tx=0x7fe0f400a250 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:25.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:25.914+0000 7fe100ff9640 1 -- 172.21.15.148:0/3515457990 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe0f80bc6e0 con 0x7fe104103700 2024-09-19T07:10:26.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:26.119+0000 7fe10a250640 1 -- 172.21.15.148:0/3515457990 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe104107200 con 0x7fe104103700 2024-09-19T07:10:26.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:26.119+0000 7fe100ff9640 1 -- 172.21.15.148:0/3515457990 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fe0f80dc040 con 0x7fe104103700 2024-09-19T07:10:26.120 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:10:26.120 INFO:teuthology.orchestra.run.smithi148.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-19T07:10:26.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:26.121+0000 7fe10a250640 1 -- 172.21.15.148:0/3515457990 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fe0ec0a32d0 msgr2=0x7fe0ec0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:26.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:26.121+0000 7fe10a250640 1 --2- 172.21.15.148:0/3515457990 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fe0ec0a32d0 0x7fe0ec0a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe0f40058c0 tx=0x7fe0f400a250 comp rx=0 tx=0).stop 2024-09-19T07:10:26.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:26.121+0000 7fe10a250640 1 -- 172.21.15.148:0/3515457990 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe104103700 msgr2=0x7fe1041989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:26.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:26.121+0000 7fe10a250640 1 --2- 172.21.15.148:0/3515457990 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe104103700 0x7fe1041989b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8006010 tx=0x7fe0f80042f0 comp rx=0 tx=0).stop 2024-09-19T07:10:26.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:26.121+0000 7fe10a250640 1 -- 172.21.15.148:0/3515457990 shutdown_connections 2024-09-19T07:10:26.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:26.121+0000 7fe10a250640 1 --2- 172.21.15.148:0/3515457990 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fe0ec0a32d0 0x7fe0ec0a5790 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:26.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:26.121+0000 7fe10a250640 1 --2- 172.21.15.148:0/3515457990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe10410c180 0x7fe10419cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:26.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:26.121+0000 7fe10a250640 1 --2- 172.21.15.148:0/3515457990 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe104103700 0x7fe1041989b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:26.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:26.121+0000 7fe10a250640 1 --2- 172.21.15.148:0/3515457990 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe104102de0 0x7fe104198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:26.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:26.121+0000 7fe10a250640 1 -- 172.21.15.148:0/3515457990 >> 172.21.15.148:0/3515457990 conn(0x7fe1040fc7a0 msgr2=0x7fe1040fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:26.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:26.121+0000 7fe10a250640 1 -- 172.21.15.148:0/3515457990 shutdown_connections 2024-09-19T07:10:26.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:26.121+0000 7fe10a250640 1 -- 172.21.15.148:0/3515457990 wait complete. 2024-09-19T07:10:26.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:26 smithi179 ceph-mon[35716]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:10:26.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:26 smithi179 ceph-mon[35716]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T07:10:26.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:26 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/3515457990' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T07:10:26.562 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:26 smithi148 ceph-mon[31180]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:10:26.562 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:26 smithi148 ceph-mon[31180]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T07:10:26.563 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:26 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/3515457990' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T07:10:26.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:26 smithi165 ceph-mon[35326]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:10:26.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:26 smithi165 ceph-mon[35326]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T07:10:26.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:26 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/3515457990' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T07:10:26.787 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-19T07:10:26.787 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:10:27.035 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:10:27.420 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:27 smithi148 ceph-mon[31180]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:10:27.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.500+0000 7ff89080e640 1 -- 172.21.15.148:0/1037679746 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff88c102ef0 msgr2=0x7ff88c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:27.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.500+0000 7ff89080e640 1 --2- 172.21.15.148:0/1037679746 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff88c102ef0 0x7ff88c10da40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff87c009900 tx=0x7ff87c02a480 comp rx=0 tx=0).stop 2024-09-19T07:10:27.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.500+0000 7ff89080e640 1 -- 172.21.15.148:0/1037679746 shutdown_connections 2024-09-19T07:10:27.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.500+0000 7ff89080e640 1 --2- 172.21.15.148:0/1037679746 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff88c102ef0 0x7ff88c10da40 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:27.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.500+0000 7ff89080e640 1 --2- 172.21.15.148:0/1037679746 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff88c102570 0x7ff88c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:27.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.500+0000 7ff89080e640 1 --2- 172.21.15.148:0/1037679746 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff88c100e20 0x7ff88c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:27.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.500+0000 7ff89080e640 1 -- 172.21.15.148:0/1037679746 >> 172.21.15.148:0/1037679746 conn(0x7ff88c0fc7d0 msgr2=0x7ff88c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:27.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.500+0000 7ff89080e640 1 -- 172.21.15.148:0/1037679746 shutdown_connections 2024-09-19T07:10:27.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.500+0000 7ff89080e640 1 -- 172.21.15.148:0/1037679746 wait complete. 2024-09-19T07:10:27.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.500+0000 7ff89080e640 1 Processor -- start 2024-09-19T07:10:27.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.500+0000 7ff89080e640 1 -- start start 2024-09-19T07:10:27.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.501+0000 7ff89080e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff88c100e20 0x7ff88c1973e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:27.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.501+0000 7ff89080e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff88c102570 0x7ff88c197920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:27.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.501+0000 7ff89080e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff88c102ef0 0x7ff88c19bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:27.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.501+0000 7ff89080e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff88c110fa0 con 0x7ff88c102570 2024-09-19T07:10:27.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.501+0000 7ff89080e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff88c110e20 con 0x7ff88c100e20 2024-09-19T07:10:27.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.501+0000 7ff89080e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff88c111120 con 0x7ff88c102ef0 2024-09-19T07:10:27.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.501+0000 7ff889d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff88c102570 0x7ff88c197920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:27.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.501+0000 7ff889d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff88c102570 0x7ff88c197920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44734/0 (socket says 172.21.15.148:44734) 2024-09-19T07:10:27.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.501+0000 7ff889d9b640 1 -- 172.21.15.148:0/2267710349 learned_addr learned my addr 172.21.15.148:0/2267710349 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:27.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.501+0000 7ff88a59c640 1 --2- 172.21.15.148:0/2267710349 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff88c100e20 0x7ff88c1973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:27.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.501+0000 7ff88ad9d640 1 --2- 172.21.15.148:0/2267710349 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff88c102ef0 0x7ff88c19bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:27.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.501+0000 7ff889d9b640 1 -- 172.21.15.148:0/2267710349 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff88c102ef0 msgr2=0x7ff88c19bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:27.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.501+0000 7ff889d9b640 1 --2- 172.21.15.148:0/2267710349 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff88c102ef0 0x7ff88c19bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:27.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.501+0000 7ff889d9b640 1 -- 172.21.15.148:0/2267710349 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff88c100e20 msgr2=0x7ff88c1973e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:27.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.501+0000 7ff889d9b640 1 --2- 172.21.15.148:0/2267710349 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff88c100e20 0x7ff88c1973e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:27.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.501+0000 7ff889d9b640 1 -- 172.21.15.148:0/2267710349 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff88c19c390 con 0x7ff88c102570 2024-09-19T07:10:27.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.501+0000 7ff889d9b640 1 --2- 172.21.15.148:0/2267710349 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff88c102570 0x7ff88c197920 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff87400b4a0 tx=0x7ff87400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:27.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.501+0000 7ff8837fe640 1 -- 172.21.15.148:0/2267710349 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff874014070 con 0x7ff88c102570 2024-09-19T07:10:27.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.501+0000 7ff8837fe640 1 -- 172.21.15.148:0/2267710349 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff874010af0 con 0x7ff88c102570 2024-09-19T07:10:27.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.501+0000 7ff89080e640 1 -- 172.21.15.148:0/2267710349 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff88c19c680 con 0x7ff88c102570 2024-09-19T07:10:27.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.501+0000 7ff8837fe640 1 -- 172.21.15.148:0/2267710349 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff874017d10 con 0x7ff88c102570 2024-09-19T07:10:27.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.501+0000 7ff89080e640 1 -- 172.21.15.148:0/2267710349 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff88c1a3f60 con 0x7ff88c102570 2024-09-19T07:10:27.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.502+0000 7ff89080e640 1 -- 172.21.15.148:0/2267710349 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff88c101200 con 0x7ff88c102570 2024-09-19T07:10:27.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.504+0000 7ff8837fe640 1 -- 172.21.15.148:0/2267710349 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7ff874017070 con 0x7ff88c102570 2024-09-19T07:10:27.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.504+0000 7ff8837fe640 1 --2- 172.21.15.148:0/2267710349 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff8780a32d0 0x7ff8780a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:27.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.504+0000 7ff88a59c640 1 --2- 172.21.15.148:0/2267710349 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff8780a32d0 0x7ff8780a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:27.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.505+0000 7ff8837fe640 1 -- 172.21.15.148:0/2267710349 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7ff8740cf160 con 0x7ff88c102570 2024-09-19T07:10:27.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.505+0000 7ff88a59c640 1 --2- 172.21.15.148:0/2267710349 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff8780a32d0 0x7ff8780a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff884005fd0 tx=0x7ff884009760 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:27.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.507+0000 7ff8837fe640 1 -- 172.21.15.148:0/2267710349 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff87409be40 con 0x7ff88c102570 2024-09-19T07:10:27.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:27 smithi179 ceph-mon[35716]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:10:27.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:27 smithi165 ceph-mon[35326]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:10:27.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.707+0000 7ff89080e640 1 -- 172.21.15.148:0/2267710349 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff88c1a4130 con 0x7ff88c102570 2024-09-19T07:10:27.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.708+0000 7ff8837fe640 1 -- 172.21.15.148:0/2267710349 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11939 (secure 0 0 0) 0x7ff87409b740 con 0x7ff88c102570 2024-09-19T07:10:27.709 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:10:27.709 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":24,"btime":"2024-09-19T07:09:30:984194+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/4263868576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":4263868576},{"type":"v1","addr":"172.21.15.148:6841","nonce":4263868576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24383,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2146820965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2146820965},{"type":"v1","addr":"172.21.15.165:6835","nonce":2146820965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:09:19.543369+0000","modified":"2024-09-19T07:09:30.685034+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24457,"mds_1":24437,"mds_2":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/1566489108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1566489108},{"type":"v1","addr":"172.21.15.179:6835","nonce":1566489108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.165:6839/3993490234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":3993490234},{"type":"v1","addr":"172.21.15.165:6839","nonce":3993490234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24457,"qdb_cluster":[24436,24437,24457]},"id":1}]} 2024-09-19T07:10:27.709 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 24 2024-09-19T07:10:27.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.710+0000 7ff89080e640 1 -- 172.21.15.148:0/2267710349 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff8780a32d0 msgr2=0x7ff8780a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:27.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.710+0000 7ff89080e640 1 --2- 172.21.15.148:0/2267710349 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff8780a32d0 0x7ff8780a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff884005fd0 tx=0x7ff884009760 comp rx=0 tx=0).stop 2024-09-19T07:10:27.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.710+0000 7ff89080e640 1 -- 172.21.15.148:0/2267710349 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff88c102570 msgr2=0x7ff88c197920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:27.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.710+0000 7ff89080e640 1 --2- 172.21.15.148:0/2267710349 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff88c102570 0x7ff88c197920 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff87400b4a0 tx=0x7ff87400b960 comp rx=0 tx=0).stop 2024-09-19T07:10:27.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.710+0000 7ff89080e640 1 -- 172.21.15.148:0/2267710349 shutdown_connections 2024-09-19T07:10:27.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.710+0000 7ff89080e640 1 --2- 172.21.15.148:0/2267710349 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7ff8780a32d0 0x7ff8780a5790 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:27.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.711+0000 7ff89080e640 1 --2- 172.21.15.148:0/2267710349 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff88c102ef0 0x7ff88c19bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:27.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.711+0000 7ff89080e640 1 --2- 172.21.15.148:0/2267710349 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff88c102570 0x7ff88c197920 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:27.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.711+0000 7ff89080e640 1 --2- 172.21.15.148:0/2267710349 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff88c100e20 0x7ff88c1973e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:27.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.711+0000 7ff89080e640 1 -- 172.21.15.148:0/2267710349 >> 172.21.15.148:0/2267710349 conn(0x7ff88c0fc7d0 msgr2=0x7ff88c106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:27.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.711+0000 7ff89080e640 1 -- 172.21.15.148:0/2267710349 shutdown_connections 2024-09-19T07:10:27.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:27.711+0000 7ff89080e640 1 -- 172.21.15.148:0/2267710349 wait complete. 2024-09-19T07:10:28.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:28 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/2267710349' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:10:28.399 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:28 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/2267710349' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:10:28.428 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:10:28.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:28 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/2267710349' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:10:28.685 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:10:29.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.188+0000 7f0ac3122640 1 -- 172.21.15.148:0/3482366897 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0abc102d70 msgr2=0x7f0abc103150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:29.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.188+0000 7f0ac3122640 1 --2- 172.21.15.148:0/3482366897 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0abc102d70 0x7f0abc103150 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0009930 tx=0x7f0ab002a420 comp rx=0 tx=0).stop 2024-09-19T07:10:29.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.188+0000 7f0ac3122640 1 -- 172.21.15.148:0/3482366897 shutdown_connections 2024-09-19T07:10:29.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.188+0000 7f0ac3122640 1 --2- 172.21.15.148:0/3482366897 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0abc1082a0 0x7f0abc10ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:29.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.188+0000 7f0ac3122640 1 --2- 172.21.15.148:0/3482366897 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0abc103720 0x7f0abc107b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:29.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.188+0000 7f0ac3122640 1 --2- 172.21.15.148:0/3482366897 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0abc102d70 0x7f0abc103150 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:29.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.188+0000 7f0ac3122640 1 -- 172.21.15.148:0/3482366897 >> 172.21.15.148:0/3482366897 conn(0x7f0abc0fc7d0 msgr2=0x7f0abc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:29.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.188+0000 7f0ac3122640 1 -- 172.21.15.148:0/3482366897 shutdown_connections 2024-09-19T07:10:29.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.188+0000 7f0ac3122640 1 -- 172.21.15.148:0/3482366897 wait complete. 2024-09-19T07:10:29.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.188+0000 7f0ac3122640 1 Processor -- start 2024-09-19T07:10:29.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.188+0000 7f0ac3122640 1 -- start start 2024-09-19T07:10:29.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.188+0000 7f0ac3122640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0abc102d70 0x7f0abc198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:29.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.189+0000 7f0ac3122640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0abc103720 0x7f0abc198ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:29.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.189+0000 7f0ac3122640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0abc1082a0 0x7f0abc19cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:29.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.189+0000 7f0ac3122640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0abc112080 con 0x7f0abc1082a0 2024-09-19T07:10:29.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.189+0000 7f0ac3122640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0abc111f00 con 0x7f0abc103720 2024-09-19T07:10:29.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.189+0000 7f0ac3122640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0abc112200 con 0x7f0abc102d70 2024-09-19T07:10:29.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.189+0000 7f0ac16bf640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0abc1082a0 0x7f0abc19cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:29.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.189+0000 7f0ac16bf640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0abc1082a0 0x7f0abc19cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44744/0 (socket says 172.21.15.148:44744) 2024-09-19T07:10:29.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.189+0000 7f0ac16bf640 1 -- 172.21.15.148:0/3501533467 learned_addr learned my addr 172.21.15.148:0/3501533467 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:29.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.189+0000 7f0ac0ebe640 1 --2- 172.21.15.148:0/3501533467 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0abc102d70 0x7f0abc198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:29.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.189+0000 7f0abbfff640 1 --2- 172.21.15.148:0/3501533467 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0abc103720 0x7f0abc198ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:29.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.189+0000 7f0ac16bf640 1 -- 172.21.15.148:0/3501533467 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0abc102d70 msgr2=0x7f0abc198660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:29.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.189+0000 7f0ac16bf640 1 --2- 172.21.15.148:0/3501533467 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0abc102d70 0x7f0abc198660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:29.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.189+0000 7f0ac16bf640 1 -- 172.21.15.148:0/3501533467 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0abc103720 msgr2=0x7f0abc198ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:29.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.189+0000 7f0ac16bf640 1 --2- 172.21.15.148:0/3501533467 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0abc103720 0x7f0abc198ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:29.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.189+0000 7f0ac16bf640 1 -- 172.21.15.148:0/3501533467 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0abc19d610 con 0x7f0abc1082a0 2024-09-19T07:10:29.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.189+0000 7f0ac16bf640 1 --2- 172.21.15.148:0/3501533467 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0abc1082a0 0x7f0abc19cf30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0ab400cad0 tx=0x7f0ab400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:29.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.189+0000 7f0ab9ffb640 1 -- 172.21.15.148:0/3501533467 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab400ae20 con 0x7f0abc1082a0 2024-09-19T07:10:29.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.189+0000 7f0ac3122640 1 -- 172.21.15.148:0/3501533467 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0abc19d900 con 0x7f0abc1082a0 2024-09-19T07:10:29.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.189+0000 7f0ab9ffb640 1 -- 172.21.15.148:0/3501533467 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ab4005020 con 0x7f0abc1082a0 2024-09-19T07:10:29.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.189+0000 7f0ab9ffb640 1 -- 172.21.15.148:0/3501533467 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab400f6f0 con 0x7f0abc1082a0 2024-09-19T07:10:29.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.190+0000 7f0ac3122640 1 -- 172.21.15.148:0/3501533467 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0abc1a51e0 con 0x7f0abc1082a0 2024-09-19T07:10:29.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.190+0000 7f0ac3122640 1 -- 172.21.15.148:0/3501533467 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0abc06a810 con 0x7f0abc1082a0 2024-09-19T07:10:29.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.191+0000 7f0ab9ffb640 1 -- 172.21.15.148:0/3501533467 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f0ab40051d0 con 0x7f0abc1082a0 2024-09-19T07:10:29.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.192+0000 7f0ab9ffb640 1 --2- 172.21.15.148:0/3501533467 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f0aac0a32d0 0x7f0aac0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:29.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.192+0000 7f0ac0ebe640 1 --2- 172.21.15.148:0/3501533467 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f0aac0a32d0 0x7f0aac0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:29.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.192+0000 7f0ab9ffb640 1 -- 172.21.15.148:0/3501533467 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7f0ab40cfa70 con 0x7f0abc1082a0 2024-09-19T07:10:29.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.193+0000 7f0ac0ebe640 1 --2- 172.21.15.148:0/3501533467 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f0aac0a32d0 0x7f0aac0a5790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0009900 tx=0x7f0ab00058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:29.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.196+0000 7f0ab9ffb640 1 -- 172.21.15.148:0/3501533467 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0ab4014030 con 0x7f0abc1082a0 2024-09-19T07:10:29.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.401+0000 7f0ac3122640 1 -- 172.21.15.148:0/3501533467 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0abc10a230 con 0x7f0abc1082a0 2024-09-19T07:10:29.403 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:29 smithi148 ceph-mon[31180]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:10:29.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.402+0000 7f0ab9ffb640 1 -- 172.21.15.148:0/3501533467 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11939 (secure 0 0 0) 0x7f0ab409bf90 con 0x7f0abc1082a0 2024-09-19T07:10:29.404 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:10:29.404 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":24,"btime":"2024-09-19T07:09:30:984194+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/4263868576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":4263868576},{"type":"v1","addr":"172.21.15.148:6841","nonce":4263868576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24383,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2146820965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2146820965},{"type":"v1","addr":"172.21.15.165:6835","nonce":2146820965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:09:19.543369+0000","modified":"2024-09-19T07:09:30.685034+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24457,"mds_1":24437,"mds_2":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/1566489108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1566489108},{"type":"v1","addr":"172.21.15.179:6835","nonce":1566489108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.165:6839/3993490234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":3993490234},{"type":"v1","addr":"172.21.15.165:6839","nonce":3993490234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24457,"qdb_cluster":[24436,24437,24457]},"id":1}]} 2024-09-19T07:10:29.404 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 24 2024-09-19T07:10:29.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.405+0000 7f0ac3122640 1 -- 172.21.15.148:0/3501533467 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f0aac0a32d0 msgr2=0x7f0aac0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:29.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.405+0000 7f0ac3122640 1 --2- 172.21.15.148:0/3501533467 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f0aac0a32d0 0x7f0aac0a5790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0009900 tx=0x7f0ab00058d0 comp rx=0 tx=0).stop 2024-09-19T07:10:29.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.405+0000 7f0ac3122640 1 -- 172.21.15.148:0/3501533467 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0abc1082a0 msgr2=0x7f0abc19cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:29.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.405+0000 7f0ac3122640 1 --2- 172.21.15.148:0/3501533467 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0abc1082a0 0x7f0abc19cf30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0ab400cad0 tx=0x7f0ab400cf90 comp rx=0 tx=0).stop 2024-09-19T07:10:29.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.406+0000 7f0ac3122640 1 -- 172.21.15.148:0/3501533467 shutdown_connections 2024-09-19T07:10:29.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.406+0000 7f0ac3122640 1 --2- 172.21.15.148:0/3501533467 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f0aac0a32d0 0x7f0aac0a5790 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:29.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.406+0000 7f0ac3122640 1 --2- 172.21.15.148:0/3501533467 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0abc1082a0 0x7f0abc19cf30 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:29.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.406+0000 7f0ac3122640 1 --2- 172.21.15.148:0/3501533467 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0abc103720 0x7f0abc198ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:29.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.406+0000 7f0ac3122640 1 --2- 172.21.15.148:0/3501533467 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0abc102d70 0x7f0abc198660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:29.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.406+0000 7f0ac3122640 1 -- 172.21.15.148:0/3501533467 >> 172.21.15.148:0/3501533467 conn(0x7f0abc0fc7d0 msgr2=0x7f0abc105e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:29.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.406+0000 7f0ac3122640 1 -- 172.21.15.148:0/3501533467 shutdown_connections 2024-09-19T07:10:29.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:29.406+0000 7f0ac3122640 1 -- 172.21.15.148:0/3501533467 wait complete. 2024-09-19T07:10:29.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:29 smithi179 ceph-mon[35716]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:10:29.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:29 smithi165 ceph-mon[35326]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:10:30.010 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T07:10:30.261 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:10:30.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:30 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/3501533467' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:10:30.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:30 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/3501533467' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:10:30.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:30 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/3501533467' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:10:30.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.691+0000 7f8156830640 1 -- 172.21.15.148:0/1509013979 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f815010c180 msgr2=0x7f815010e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:30.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.691+0000 7f8156830640 1 --2- 172.21.15.148:0/1509013979 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f815010c180 0x7f815010e600 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8148009ca0 tx=0x7f814802a950 comp rx=0 tx=0).stop 2024-09-19T07:10:30.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.691+0000 7f8156830640 1 -- 172.21.15.148:0/1509013979 shutdown_connections 2024-09-19T07:10:30.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.691+0000 7f8156830640 1 --2- 172.21.15.148:0/1509013979 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f815010c180 0x7f815010e600 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:30.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.691+0000 7f8156830640 1 --2- 172.21.15.148:0/1509013979 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81501036c0 0x7f815010bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:30.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.691+0000 7f8156830640 1 --2- 172.21.15.148:0/1509013979 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8150102da0 0x7f8150103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:30.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.691+0000 7f8156830640 1 -- 172.21.15.148:0/1509013979 >> 172.21.15.148:0/1509013979 conn(0x7f81500fc7a0 msgr2=0x7f81500febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:30.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.691+0000 7f8156830640 1 -- 172.21.15.148:0/1509013979 shutdown_connections 2024-09-19T07:10:30.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.691+0000 7f8156830640 1 -- 172.21.15.148:0/1509013979 wait complete. 2024-09-19T07:10:30.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.692+0000 7f8156830640 1 Processor -- start 2024-09-19T07:10:30.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.692+0000 7f8156830640 1 -- start start 2024-09-19T07:10:30.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.692+0000 7f8156830640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8150102da0 0x7f8150198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:30.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.692+0000 7f8156830640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81501036c0 0x7f81501989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:30.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.692+0000 7f8156830640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f815010c180 0x7f815019cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:30.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.692+0000 7f8156830640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8150111fc0 con 0x7f815010c180 2024-09-19T07:10:30.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.692+0000 7f8156830640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8150111e40 con 0x7f8150102da0 2024-09-19T07:10:30.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.692+0000 7f8156830640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8150112140 con 0x7f81501036c0 2024-09-19T07:10:30.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.692+0000 7f8154dcd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f815010c180 0x7f815019cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:30.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.692+0000 7f8154dcd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f815010c180 0x7f815019cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44766/0 (socket says 172.21.15.148:44766) 2024-09-19T07:10:30.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.692+0000 7f8154dcd640 1 -- 172.21.15.148:0/570097160 learned_addr learned my addr 172.21.15.148:0/570097160 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:30.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.693+0000 7f814f7fe640 1 --2- 172.21.15.148:0/570097160 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81501036c0 0x7f81501989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:30.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.693+0000 7f814ffff640 1 --2- 172.21.15.148:0/570097160 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8150102da0 0x7f8150198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:30.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.693+0000 7f8154dcd640 1 -- 172.21.15.148:0/570097160 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81501036c0 msgr2=0x7f81501989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:30.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.693+0000 7f8154dcd640 1 --2- 172.21.15.148:0/570097160 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81501036c0 0x7f81501989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:30.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.693+0000 7f8154dcd640 1 -- 172.21.15.148:0/570097160 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8150102da0 msgr2=0x7f8150198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:30.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.693+0000 7f8154dcd640 1 --2- 172.21.15.148:0/570097160 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8150102da0 0x7f8150198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:30.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.693+0000 7f8154dcd640 1 -- 172.21.15.148:0/570097160 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f815019d410 con 0x7f815010c180 2024-09-19T07:10:30.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.693+0000 7f814ffff640 1 --2- 172.21.15.148:0/570097160 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8150102da0 0x7f8150198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:10:30.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.693+0000 7f8154dcd640 1 --2- 172.21.15.148:0/570097160 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f815010c180 0x7f815019cd30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8148006010 tx=0x7f814802f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:30.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.693+0000 7f814d7fa640 1 -- 172.21.15.148:0/570097160 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8148034040 con 0x7f815010c180 2024-09-19T07:10:30.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.693+0000 7f814d7fa640 1 -- 172.21.15.148:0/570097160 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8148003e00 con 0x7f815010c180 2024-09-19T07:10:30.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.693+0000 7f8156830640 1 -- 172.21.15.148:0/570097160 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f815019d6a0 con 0x7f815010c180 2024-09-19T07:10:30.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.693+0000 7f814d7fa640 1 -- 172.21.15.148:0/570097160 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81480456e0 con 0x7f815010c180 2024-09-19T07:10:30.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.693+0000 7f8156830640 1 -- 172.21.15.148:0/570097160 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81501a4fe0 con 0x7f815010c180 2024-09-19T07:10:30.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.694+0000 7f8156830640 1 -- 172.21.15.148:0/570097160 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f815006b010 con 0x7f815010c180 2024-09-19T07:10:30.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.695+0000 7f814d7fa640 1 -- 172.21.15.148:0/570097160 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f8148037020 con 0x7f815010c180 2024-09-19T07:10:30.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.696+0000 7f814d7fa640 1 --2- 172.21.15.148:0/570097160 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f81380a32d0 0x7f81380a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:30.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.696+0000 7f814ffff640 1 --2- 172.21.15.148:0/570097160 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f81380a32d0 0x7f81380a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:30.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.696+0000 7f814d7fa640 1 -- 172.21.15.148:0/570097160 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7f81480f0af0 con 0x7f815010c180 2024-09-19T07:10:30.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.696+0000 7f814ffff640 1 --2- 172.21.15.148:0/570097160 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f81380a32d0 0x7f81380a5790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8140006fd0 tx=0x7f8140008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:30.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.700+0000 7f814d7fa640 1 -- 172.21.15.148:0/570097160 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f81480bd7d0 con 0x7f815010c180 2024-09-19T07:10:30.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.869+0000 7f8156830640 1 -- 172.21.15.148:0/570097160 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8150107220 con 0x7f815010c180 2024-09-19T07:10:30.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.871+0000 7f814d7fa640 1 -- 172.21.15.148:0/570097160 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22807 (secure 0 0 0) 0x7f81480bd0d0 con 0x7f815010c180 2024-09-19T07:10:30.872 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:10:30.872 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":80,"fsid":"eae8a4a8-7654-11ef-bceb-c7b262605968","created":"2024-09-19T07:01:47.891210+0000","modified":"2024-09-19T07:09:38.168257+0000","last_up_change":"2024-09-19T07:08:30.785262+0000","last_in_change":"2024-09-19T07:08:07.001808+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:04:49.313270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T07:09:15.840600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T07:09:17.690782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7b854fad-d5a3-43e3-862e-7a0e8f243c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6803","nonce":512186330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6805","nonce":512186330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6809","nonce":512186330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6807","nonce":512186330}]},"public_addr":"172.21.15.148:6803/512186330","cluster_addr":"172.21.15.148:6805/512186330","heartbeat_back_addr":"172.21.15.148:6809/512186330","heartbeat_front_addr":"172.21.15.148:6807/512186330","state":["exists","up"]},{"osd":1,"uuid":"61b26278-f4db-40f0-97b9-c12a6ef1cd06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6801","nonce":2433984552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6803","nonce":2433984552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6807","nonce":2433984552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6805","nonce":2433984552}]},"public_addr":"172.21.15.165:6801/2433984552","cluster_addr":"172.21.15.165:6803/2433984552","heartbeat_back_addr":"172.21.15.165:6807/2433984552","heartbeat_front_addr":"172.21.15.165:6805/2433984552","state":["exists","up"]},{"osd":2,"uuid":"06620bbc-cdb5-4afc-8122-0bb3126630f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6801","nonce":3048365223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6803","nonce":3048365223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6807","nonce":3048365223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6805","nonce":3048365223}]},"public_addr":"172.21.15.179:6801/3048365223","cluster_addr":"172.21.15.179:6803/3048365223","heartbeat_back_addr":"172.21.15.179:6807/3048365223","heartbeat_front_addr":"172.21.15.179:6805/3048365223","state":["exists","up"]},{"osd":3,"uuid":"d7df45d4-5ef1-4f66-84a7-f61b8756c0c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6811","nonce":3662789091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6813","nonce":3662789091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6817","nonce":3662789091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6815","nonce":3662789091}]},"public_addr":"172.21.15.148:6811/3662789091","cluster_addr":"172.21.15.148:6813/3662789091","heartbeat_back_addr":"172.21.15.148:6817/3662789091","heartbeat_front_addr":"172.21.15.148:6815/3662789091","state":["exists","up"]},{"osd":4,"uuid":"5cfd359b-a8d2-4bdc-858f-087d26e0869c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6809","nonce":3082550323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6811","nonce":3082550323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6815","nonce":3082550323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6813","nonce":3082550323}]},"public_addr":"172.21.15.165:6809/3082550323","cluster_addr":"172.21.15.165:6811/3082550323","heartbeat_back_addr":"172.21.15.165:6815/3082550323","heartbeat_front_addr":"172.21.15.165:6813/3082550323","state":["exists","up"]},{"osd":5,"uuid":"8295e69b-87fe-4403-bb2e-d9dd42e2f398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6809","nonce":2125213751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6811","nonce":2125213751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6815","nonce":2125213751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6813","nonce":2125213751}]},"public_addr":"172.21.15.179:6809/2125213751","cluster_addr":"172.21.15.179:6811/2125213751","heartbeat_back_addr":"172.21.15.179:6815/2125213751","heartbeat_front_addr":"172.21.15.179:6813/2125213751","state":["exists","up"]},{"osd":6,"uuid":"4ce38d1a-06d3-4606-b00d-aa1ff977025f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6819","nonce":2178980310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6821","nonce":2178980310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6825","nonce":2178980310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6823","nonce":2178980310}]},"public_addr":"172.21.15.148:6819/2178980310","cluster_addr":"172.21.15.148:6821/2178980310","heartbeat_back_addr":"172.21.15.148:6825/2178980310","heartbeat_front_addr":"172.21.15.148:6823/2178980310","state":["exists","up"]},{"osd":7,"uuid":"9e68e2b2-9838-4ec0-b473-24f2434695ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6817","nonce":3961600099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6819","nonce":3961600099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6823","nonce":3961600099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6821","nonce":3961600099}]},"public_addr":"172.21.15.165:6817/3961600099","cluster_addr":"172.21.15.165:6819/3961600099","heartbeat_back_addr":"172.21.15.165:6823/3961600099","heartbeat_front_addr":"172.21.15.165:6821/3961600099","state":["exists","up"]},{"osd":8,"uuid":"297acce6-d3c7-4e1a-bf87-be093de51a6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6817","nonce":3642931467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6819","nonce":3642931467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6823","nonce":3642931467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6821","nonce":3642931467}]},"public_addr":"172.21.15.179:6817/3642931467","cluster_addr":"172.21.15.179:6819/3642931467","heartbeat_back_addr":"172.21.15.179:6823/3642931467","heartbeat_front_addr":"172.21.15.179:6821/3642931467","state":["exists","up"]},{"osd":9,"uuid":"ef488c5e-5353-4695-99dd-5b74ade436d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6827","nonce":3135409630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6829","nonce":3135409630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6833","nonce":3135409630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6831","nonce":3135409630}]},"public_addr":"172.21.15.148:6827/3135409630","cluster_addr":"172.21.15.148:6829/3135409630","heartbeat_back_addr":"172.21.15.148:6833/3135409630","heartbeat_front_addr":"172.21.15.148:6831/3135409630","state":["exists","up"]},{"osd":10,"uuid":"7a9f0379-1199-4266-910c-8d1d313d39e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6825","nonce":3554110731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6827","nonce":3554110731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6831","nonce":3554110731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6829","nonce":3554110731}]},"public_addr":"172.21.15.165:6825/3554110731","cluster_addr":"172.21.15.165:6827/3554110731","heartbeat_back_addr":"172.21.15.165:6831/3554110731","heartbeat_front_addr":"172.21.15.165:6829/3554110731","state":["exists","up"]},{"osd":11,"uuid":"eede97e9-5685-4603-806e-7078c6940536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6825","nonce":2026109940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6827","nonce":2026109940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6831","nonce":2026109940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6829","nonce":2026109940}]},"public_addr":"172.21.15.179:6825/2026109940","cluster_addr":"172.21.15.179:6827/2026109940","heartbeat_back_addr":"172.21.15.179:6831/2026109940","heartbeat_front_addr":"172.21.15.179:6829/2026109940","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:03:56.291685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:21.419682+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:46.377012+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:11.484234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:36.723101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:06:00.294617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:06:25.147230+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:06:49.318576+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:07:13.896399+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:07:38.930999+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:08:03.803463+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:08:28.731343+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.148:0/3534559227":"2024-09-20T07:02:37.007183+0000","172.21.15.148:0/1958388906":"2024-09-20T07:02:37.007183+0000","172.21.15.148:0/1922521135":"2024-09-20T07:02:37.007183+0000","172.21.15.148:6801/1949849385":"2024-09-20T07:02:37.007183+0000","172.21.15.148:6800/1949849385":"2024-09-20T07:02:37.007183+0000","172.21.15.148:6800/2161746152":"2024-09-20T07:02:14.557425+0000","172.21.15.148:6801/2161746152":"2024-09-20T07:02:14.557425+0000","172.21.15.148:0/1480486619":"2024-09-20T07:02:14.557425+0000","172.21.15.148:0/174481494":"2024-09-20T07:02:14.557425+0000","172.21.15.148:0/1114469409":"2024-09-20T07:02:14.557425+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T07:10:30.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.873+0000 7f8156830640 1 -- 172.21.15.148:0/570097160 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f81380a32d0 msgr2=0x7f81380a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:30.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.873+0000 7f8156830640 1 --2- 172.21.15.148:0/570097160 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f81380a32d0 0x7f81380a5790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8140006fd0 tx=0x7f8140008040 comp rx=0 tx=0).stop 2024-09-19T07:10:30.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.873+0000 7f8156830640 1 -- 172.21.15.148:0/570097160 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f815010c180 msgr2=0x7f815019cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:30.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.873+0000 7f8156830640 1 --2- 172.21.15.148:0/570097160 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f815010c180 0x7f815019cd30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8148006010 tx=0x7f814802f710 comp rx=0 tx=0).stop 2024-09-19T07:10:30.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.873+0000 7f8156830640 1 -- 172.21.15.148:0/570097160 shutdown_connections 2024-09-19T07:10:30.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.873+0000 7f8156830640 1 --2- 172.21.15.148:0/570097160 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f81380a32d0 0x7f81380a5790 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:30.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.873+0000 7f8156830640 1 --2- 172.21.15.148:0/570097160 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f815010c180 0x7f815019cd30 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:30.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.873+0000 7f8156830640 1 --2- 172.21.15.148:0/570097160 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81501036c0 0x7f81501989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:30.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.873+0000 7f8156830640 1 --2- 172.21.15.148:0/570097160 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8150102da0 0x7f8150198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:30.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.873+0000 7f8156830640 1 -- 172.21.15.148:0/570097160 >> 172.21.15.148:0/570097160 conn(0x7f81500fc7a0 msgr2=0x7f81500fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:30.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.873+0000 7f8156830640 1 -- 172.21.15.148:0/570097160 shutdown_connections 2024-09-19T07:10:30.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:30.873+0000 7f8156830640 1 -- 172.21.15.148:0/570097160 wait complete. 2024-09-19T07:10:31.499 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:31 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/570097160' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:10:31.499 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:31 smithi148 ceph-mon[31180]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:10:31.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:31 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/570097160' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:10:31.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:31 smithi179 ceph-mon[35716]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:10:31.527 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:10:31.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:31 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/570097160' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:10:31.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:31 smithi165 ceph-mon[35326]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:10:31.777 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:10:32.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.206+0000 7f02a99e7640 1 -- 172.21.15.148:0/4053097868 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02a4103660 msgr2=0x7f02a410bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:32.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.206+0000 7f02a99e7640 1 --2- 172.21.15.148:0/4053097868 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02a4103660 0x7f02a410bb50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0294009900 tx=0x7f029402a480 comp rx=0 tx=0).stop 2024-09-19T07:10:32.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.206+0000 7f02a99e7640 1 -- 172.21.15.148:0/4053097868 shutdown_connections 2024-09-19T07:10:32.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.206+0000 7f02a99e7640 1 --2- 172.21.15.148:0/4053097868 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02a410c170 0x7f02a410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:32.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.206+0000 7f02a99e7640 1 --2- 172.21.15.148:0/4053097868 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02a4103660 0x7f02a410bb50 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:32.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.206+0000 7f02a99e7640 1 --2- 172.21.15.148:0/4053097868 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f02a4102d40 0x7f02a4103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:32.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.206+0000 7f02a99e7640 1 -- 172.21.15.148:0/4053097868 >> 172.21.15.148:0/4053097868 conn(0x7f02a40fc7a0 msgr2=0x7f02a40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:32.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.206+0000 7f02a99e7640 1 -- 172.21.15.148:0/4053097868 shutdown_connections 2024-09-19T07:10:32.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.206+0000 7f02a99e7640 1 -- 172.21.15.148:0/4053097868 wait complete. 2024-09-19T07:10:32.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.207+0000 7f02a99e7640 1 Processor -- start 2024-09-19T07:10:32.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.207+0000 7f02a99e7640 1 -- start start 2024-09-19T07:10:32.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.207+0000 7f02a99e7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02a4102d40 0x7f02a41009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:32.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.207+0000 7f02a99e7640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f02a4103660 0x7f02a4100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:32.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.207+0000 7f02a99e7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02a410c170 0x7f02a4101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:32.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.207+0000 7f02a99e7640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f02a4112030 con 0x7f02a4102d40 2024-09-19T07:10:32.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.207+0000 7f02a99e7640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f02a4111eb0 con 0x7f02a4103660 2024-09-19T07:10:32.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.207+0000 7f02a99e7640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f02a41121b0 con 0x7f02a410c170 2024-09-19T07:10:32.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.207+0000 7f02a2ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02a4102d40 0x7f02a41009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:32.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.207+0000 7f02a2ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02a4102d40 0x7f02a41009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44780/0 (socket says 172.21.15.148:44780) 2024-09-19T07:10:32.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.207+0000 7f02a2ffd640 1 -- 172.21.15.148:0/748305925 learned_addr learned my addr 172.21.15.148:0/748305925 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:32.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.208+0000 7f02a37fe640 1 --2- 172.21.15.148:0/748305925 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02a410c170 0x7f02a4101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:32.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.208+0000 7f02a27fc640 1 --2- 172.21.15.148:0/748305925 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f02a4103660 0x7f02a4100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:32.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.208+0000 7f02a2ffd640 1 -- 172.21.15.148:0/748305925 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02a410c170 msgr2=0x7f02a4101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:32.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.208+0000 7f02a2ffd640 1 --2- 172.21.15.148:0/748305925 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02a410c170 0x7f02a4101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:32.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.208+0000 7f02a2ffd640 1 -- 172.21.15.148:0/748305925 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f02a4103660 msgr2=0x7f02a4100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:32.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.208+0000 7f02a2ffd640 1 --2- 172.21.15.148:0/748305925 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f02a4103660 0x7f02a4100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:32.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.208+0000 7f02a2ffd640 1 -- 172.21.15.148:0/748305925 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02a41a6a40 con 0x7f02a4102d40 2024-09-19T07:10:32.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.208+0000 7f02a27fc640 1 --2- 172.21.15.148:0/748305925 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f02a4103660 0x7f02a4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:10:32.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.208+0000 7f02a2ffd640 1 --2- 172.21.15.148:0/748305925 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02a4102d40 0x7f02a41009a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f028c00b4a0 tx=0x7f028c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:32.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.208+0000 7f02a89e5640 1 -- 172.21.15.148:0/748305925 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f028c014070 con 0x7f02a4102d40 2024-09-19T07:10:32.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.208+0000 7f02a89e5640 1 -- 172.21.15.148:0/748305925 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f028c010af0 con 0x7f02a4102d40 2024-09-19T07:10:32.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.208+0000 7f02a99e7640 1 -- 172.21.15.148:0/748305925 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02a41a6d30 con 0x7f02a4102d40 2024-09-19T07:10:32.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.208+0000 7f02a89e5640 1 -- 172.21.15.148:0/748305925 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f028c017d10 con 0x7f02a4102d40 2024-09-19T07:10:32.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.208+0000 7f02a99e7640 1 -- 172.21.15.148:0/748305925 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02a41a7210 con 0x7f02a4102d40 2024-09-19T07:10:32.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.209+0000 7f02a99e7640 1 -- 172.21.15.148:0/748305925 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02a41031a0 con 0x7f02a4102d40 2024-09-19T07:10:32.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.210+0000 7f02a89e5640 1 -- 172.21.15.148:0/748305925 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f028c017070 con 0x7f02a4102d40 2024-09-19T07:10:32.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.211+0000 7f02a89e5640 1 --2- 172.21.15.148:0/748305925 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f02900a32d0 0x7f02900a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:32.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.211+0000 7f02a89e5640 1 -- 172.21.15.148:0/748305925 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7f028c0cee00 con 0x7f02a4102d40 2024-09-19T07:10:32.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.211+0000 7f02a27fc640 1 --2- 172.21.15.148:0/748305925 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f02900a32d0 0x7f02900a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:32.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.212+0000 7f02a27fc640 1 --2- 172.21.15.148:0/748305925 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f02900a32d0 0x7f02900a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f02a4102430 tx=0x7f0294005a20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:32.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.215+0000 7f02a89e5640 1 -- 172.21.15.148:0/748305925 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f028c09ba80 con 0x7f02a4102d40 2024-09-19T07:10:32.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.416+0000 7f02a99e7640 1 -- 172.21.15.148:0/748305925 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f02a4106c50 con 0x7f02a4102d40 2024-09-19T07:10:32.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.416+0000 7f02a89e5640 1 -- 172.21.15.148:0/748305925 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11939 (secure 0 0 0) 0x7f028c09b380 con 0x7f02a4102d40 2024-09-19T07:10:32.418 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:10:32.418 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":24,"btime":"2024-09-19T07:09:30:984194+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/4263868576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":4263868576},{"type":"v1","addr":"172.21.15.148:6841","nonce":4263868576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24383,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2146820965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2146820965},{"type":"v1","addr":"172.21.15.165:6835","nonce":2146820965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:09:19.543369+0000","modified":"2024-09-19T07:09:30.685034+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24457,"mds_1":24437,"mds_2":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/1566489108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1566489108},{"type":"v1","addr":"172.21.15.179:6835","nonce":1566489108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.165:6839/3993490234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":3993490234},{"type":"v1","addr":"172.21.15.165:6839","nonce":3993490234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24457,"qdb_cluster":[24436,24437,24457]},"id":1}]} 2024-09-19T07:10:32.418 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 24 2024-09-19T07:10:32.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.418+0000 7f02a99e7640 1 -- 172.21.15.148:0/748305925 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f02900a32d0 msgr2=0x7f02900a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:32.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.418+0000 7f02a99e7640 1 --2- 172.21.15.148:0/748305925 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f02900a32d0 0x7f02900a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f02a4102430 tx=0x7f0294005a20 comp rx=0 tx=0).stop 2024-09-19T07:10:32.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.418+0000 7f02a99e7640 1 -- 172.21.15.148:0/748305925 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02a4102d40 msgr2=0x7f02a41009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:32.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.418+0000 7f02a99e7640 1 --2- 172.21.15.148:0/748305925 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02a4102d40 0x7f02a41009a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f028c00b4a0 tx=0x7f028c00b960 comp rx=0 tx=0).stop 2024-09-19T07:10:32.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.419+0000 7f02a99e7640 1 -- 172.21.15.148:0/748305925 shutdown_connections 2024-09-19T07:10:32.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.419+0000 7f02a99e7640 1 --2- 172.21.15.148:0/748305925 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f02900a32d0 0x7f02900a5790 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:32.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.419+0000 7f02a99e7640 1 --2- 172.21.15.148:0/748305925 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02a410c170 0x7f02a4101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:32.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.419+0000 7f02a99e7640 1 --2- 172.21.15.148:0/748305925 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f02a4103660 0x7f02a4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:32.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.419+0000 7f02a99e7640 1 --2- 172.21.15.148:0/748305925 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02a4102d40 0x7f02a41009a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:32.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.419+0000 7f02a99e7640 1 -- 172.21.15.148:0/748305925 >> 172.21.15.148:0/748305925 conn(0x7f02a40fc7a0 msgr2=0x7f02a40fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:32.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.419+0000 7f02a99e7640 1 -- 172.21.15.148:0/748305925 shutdown_connections 2024-09-19T07:10:32.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:32.419+0000 7f02a99e7640 1 -- 172.21.15.148:0/748305925 wait complete. 2024-09-19T07:10:32.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:32 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/748305925' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:10:32.773 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:32 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/748305925' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:10:32.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:32 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/748305925' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:10:33.069 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T07:09:19.543369+0000', 'modified': '2024-09-19T07:09:30.685034+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24457, 'mds_1': 24437, 'mds_2': 24436}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24410': {'gid': 24410, 'name': 'h', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.165:6837/3847988837', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.165:6836', 'nonce': 3847988837}, {'type': 'v1', 'addr': '172.21.15.165:6837', 'nonce': 3847988837}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24412': {'gid': 24412, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.179:6833/1289882987', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6832', 'nonce': 1289882987}, {'type': 'v1', 'addr': '172.21.15.179:6833', 'nonce': 1289882987}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24430': {'gid': 24430, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.179:6835/1566489108', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6834', 'nonce': 1566489108}, {'type': 'v1', 'addr': '172.21.15.179:6835', 'nonce': 1566489108}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24436': {'gid': 24436, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.179:6837/3827671241', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6836', 'nonce': 3827671241}, {'type': 'v1', 'addr': '172.21.15.179:6837', 'nonce': 3827671241}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24437': {'gid': 24437, 'name': 'b', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.165:6839/3993490234', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.165:6838', 'nonce': 3993490234}, {'type': 'v1', 'addr': '172.21.15.165:6839', 'nonce': 3993490234}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24457': {'gid': 24457, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.179:6839/2031305914', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6838', 'nonce': 2031305914}, {'type': 'v1', 'addr': '172.21.15.179:6839', 'nonce': 2031305914}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24457, 'qdb_cluster': [24436, 24437, 24457]} 2024-09-19T07:10:33.069 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-19T07:10:33.069 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph tell mds.c status 2024-09-19T07:10:33.318 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:10:33.719 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:33 smithi148 ceph-mon[31180]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:10:33.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:33 smithi179 ceph-mon[35716]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:10:33.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.798+0000 7f7feec91640 1 -- 172.21.15.148:0/2144854148 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7fe8100e20 msgr2=0x7f7fe8101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:33.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.798+0000 7f7feec91640 1 --2- 172.21.15.148:0/2144854148 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7fe8100e20 0x7f7fe8101200 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8009ca0 tx=0x7f7fd802a950 comp rx=0 tx=0).stop 2024-09-19T07:10:33.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.798+0000 7f7feec91640 1 -- 172.21.15.148:0/2144854148 shutdown_connections 2024-09-19T07:10:33.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.798+0000 7f7feec91640 1 --2- 172.21.15.148:0/2144854148 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7fe8102ef0 0x7f7fe810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:33.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.799+0000 7f7feec91640 1 --2- 172.21.15.148:0/2144854148 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fe8102570 0x7f7fe81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:33.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.799+0000 7f7feec91640 1 --2- 172.21.15.148:0/2144854148 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7fe8100e20 0x7f7fe8101200 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:33.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.799+0000 7f7feec91640 1 -- 172.21.15.148:0/2144854148 >> 172.21.15.148:0/2144854148 conn(0x7f7fe80fc7d0 msgr2=0x7f7fe80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:33.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.799+0000 7f7feec91640 1 -- 172.21.15.148:0/2144854148 shutdown_connections 2024-09-19T07:10:33.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.799+0000 7f7feec91640 1 -- 172.21.15.148:0/2144854148 wait complete. 2024-09-19T07:10:33.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.799+0000 7f7feec91640 1 Processor -- start 2024-09-19T07:10:33.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.799+0000 7f7feec91640 1 -- start start 2024-09-19T07:10:33.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.799+0000 7f7feec91640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7fe8100e20 0x7f7fe8199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:33.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.799+0000 7f7feec91640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7fe8102570 0x7f7fe81998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:33.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.799+0000 7f7feec91640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fe8102ef0 0x7f7fe81a43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:33.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.799+0000 7f7feec91640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe8110fa0 con 0x7f7fe8102570 2024-09-19T07:10:33.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.799+0000 7f7feec91640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe8110e20 con 0x7f7fe8100e20 2024-09-19T07:10:33.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.799+0000 7f7feec91640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe8111120 con 0x7f7fe8102ef0 2024-09-19T07:10:33.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.799+0000 7f7fe7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7fe8102570 0x7f7fe81998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:33.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.800+0000 7f7fe7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7fe8102570 0x7f7fe81998b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44792/0 (socket says 172.21.15.148:44792) 2024-09-19T07:10:33.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.800+0000 7f7fe7fff640 1 -- 172.21.15.148:0/2730860967 learned_addr learned my addr 172.21.15.148:0/2730860967 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:33.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.800+0000 7f7fed22e640 1 --2- 172.21.15.148:0/2730860967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fe8102ef0 0x7f7fe81a43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:33.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.800+0000 7f7feca2d640 1 --2- 172.21.15.148:0/2730860967 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7fe8100e20 0x7f7fe8199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:33.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.800+0000 7f7fe7fff640 1 -- 172.21.15.148:0/2730860967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fe8102ef0 msgr2=0x7f7fe81a43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:33.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.800+0000 7f7fe7fff640 1 --2- 172.21.15.148:0/2730860967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fe8102ef0 0x7f7fe81a43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:33.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.800+0000 7f7fe7fff640 1 -- 172.21.15.148:0/2730860967 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7fe8100e20 msgr2=0x7f7fe8199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:33.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.800+0000 7f7fe7fff640 1 --2- 172.21.15.148:0/2730860967 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7fe8100e20 0x7f7fe8199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:33.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.800+0000 7f7fe7fff640 1 -- 172.21.15.148:0/2730860967 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fe81a4930 con 0x7f7fe8102570 2024-09-19T07:10:33.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.800+0000 7f7fe7fff640 1 --2- 172.21.15.148:0/2730860967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7fe8102570 0x7f7fe81998b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7fd000b4a0 tx=0x7f7fd000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:33.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.800+0000 7f7fe5ffb640 1 -- 172.21.15.148:0/2730860967 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd0014070 con 0x7f7fe8102570 2024-09-19T07:10:33.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.800+0000 7f7fe5ffb640 1 -- 172.21.15.148:0/2730860967 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7fd0010af0 con 0x7f7fe8102570 2024-09-19T07:10:33.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.800+0000 7f7fe5ffb640 1 -- 172.21.15.148:0/2730860967 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd0017d10 con 0x7f7fe8102570 2024-09-19T07:10:33.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.800+0000 7f7feec91640 1 -- 172.21.15.148:0/2730860967 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fe81a4b00 con 0x7f7fe8102570 2024-09-19T07:10:33.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.800+0000 7f7feec91640 1 -- 172.21.15.148:0/2730860967 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fe81a4fc0 con 0x7f7fe8102570 2024-09-19T07:10:33.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.802+0000 7f7fe5ffb640 1 -- 172.21.15.148:0/2730860967 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f7fd0017070 con 0x7f7fe8102570 2024-09-19T07:10:33.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.803+0000 7f7ff106a740 1 Processor -- start 2024-09-19T07:10:33.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.803+0000 7f7ff106a740 1 -- start start 2024-09-19T07:10:33.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.803+0000 7f7fe5ffb640 1 --2- 172.21.15.148:0/2730860967 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f7fd40a32d0 0x7f7fd40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:33.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.803+0000 7f7fed22e640 1 --2- 172.21.15.148:0/2730860967 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f7fd40a32d0 0x7f7fd40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:33.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.803+0000 7f7ff106a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ab626b890 0x564ab626bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:33.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.803+0000 7f7ff106a740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564ab626c1b0 0x564ab627aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:33.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.803+0000 7f7ff106a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ab627afc0 0x564ab627d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:33.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.803+0000 7f7ff106a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x564ab61d2090 con 0x564ab626b890 2024-09-19T07:10:33.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.803+0000 7f7fe5ffb640 1 -- 172.21.15.148:0/2730860967 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7f7fd00ced70 con 0x7f7fe8102570 2024-09-19T07:10:33.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.803+0000 7f7ff106a740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x564ab6179a70 con 0x564ab626c1b0 2024-09-19T07:10:33.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.803+0000 7f7ff106a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564ab61ce050 con 0x564ab627afc0 2024-09-19T07:10:33.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.803+0000 7f7feca2d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ab626b890 0x564ab626bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:33.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.803+0000 7f7feca2d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ab626b890 0x564ab626bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44804/0 (socket says 172.21.15.148:44804) 2024-09-19T07:10:33.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.803+0000 7f7feca2d640 1 -- 172.21.15.148:0/1111666138 learned_addr learned my addr 172.21.15.148:0/1111666138 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:33.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.803+0000 7f7fe7fff640 1 --2- 172.21.15.148:0/1111666138 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564ab626c1b0 0x564ab627aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:33.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.804+0000 7f7fed22e640 1 --2- 172.21.15.148:0/1111666138 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ab627afc0 0x564ab627d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:33.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.804+0000 7f7feca2d640 1 -- 172.21.15.148:0/1111666138 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ab627afc0 msgr2=0x564ab627d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:10:33.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.804+0000 7f7feca2d640 1 --2- 172.21.15.148:0/1111666138 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ab627afc0 0x564ab627d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:33.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.804+0000 7f7fed22e640 1 --2- 172.21.15.148:0/2730860967 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f7fd40a32d0 0x7f7fd40a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7fe000ab50 tx=0x7f7fe000af50 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:33.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.804+0000 7f7feca2d640 1 -- 172.21.15.148:0/1111666138 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564ab626c1b0 msgr2=0x564ab627aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:10:33.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.804+0000 7f7feca2d640 1 --2- 172.21.15.148:0/1111666138 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564ab626c1b0 0x564ab627aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:33.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.804+0000 7f7feca2d640 1 -- 172.21.15.148:0/1111666138 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ab6186130 con 0x564ab626b890 2024-09-19T07:10:33.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.804+0000 7f7feca2d640 1 --2- 172.21.15.148:0/1111666138 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ab626b890 0x564ab626bc70 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8035000 tx=0x7f7fd802f930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54ba9fc97db7aa41 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:33.827 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.804+0000 7f7fdeffd640 1 -- 172.21.15.148:0/1111666138 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd8048070 con 0x564ab626b890 2024-09-19T07:10:33.827 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.804+0000 7f7fdeffd640 1 -- 172.21.15.148:0/1111666138 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7fd802fb90 con 0x564ab626b890 2024-09-19T07:10:33.827 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.804+0000 7f7fdeffd640 1 -- 172.21.15.148:0/1111666138 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd8034040 con 0x564ab626b890 2024-09-19T07:10:33.827 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.805+0000 7f7ff106a740 1 -- 172.21.15.148:0/1111666138 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ab626b890 msgr2=0x564ab626bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:33.827 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.805+0000 7f7ff106a740 1 --2- 172.21.15.148:0/1111666138 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ab626b890 0x564ab626bc70 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8035000 tx=0x7f7fd802f930 comp rx=0 tx=0).stop 2024-09-19T07:10:33.827 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.805+0000 7f7ff106a740 1 -- 172.21.15.148:0/1111666138 shutdown_connections 2024-09-19T07:10:33.827 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.805+0000 7f7ff106a740 1 --2- 172.21.15.148:0/1111666138 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ab627afc0 0x564ab627d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:33.827 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.805+0000 7f7ff106a740 1 --2- 172.21.15.148:0/1111666138 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564ab626c1b0 0x564ab627aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:33.827 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.805+0000 7f7ff106a740 1 --2- 172.21.15.148:0/1111666138 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ab626b890 0x564ab626bc70 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:33.827 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.805+0000 7f7ff106a740 1 -- 172.21.15.148:0/1111666138 >> 172.21.15.148:0/1111666138 conn(0x564ab6267f60 msgr2=0x564ab6268340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:33.827 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.805+0000 7f7ff106a740 1 -- 172.21.15.148:0/1111666138 shutdown_connections 2024-09-19T07:10:33.827 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.805+0000 7f7ff106a740 1 -- 172.21.15.148:0/1111666138 wait complete. 2024-09-19T07:10:33.827 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.805+0000 7f7ff106a740 1 -- start start 2024-09-19T07:10:33.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.805+0000 7f7ff106a740 1 Processor -- start 2024-09-19T07:10:33.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.806+0000 7f7ff106a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ab626b890 0x564ab627a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:33.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.806+0000 7f7ff106a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ab626c1b0 0x564ab6277b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:33.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.806+0000 7f7ff106a740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564ab627afc0 0x564ab62780b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:33.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.806+0000 7f7ff106a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x564ab627db30 con 0x564ab626b890 2024-09-19T07:10:33.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.806+0000 7f7ff106a740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x564ab618cf20 con 0x564ab627afc0 2024-09-19T07:10:33.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.806+0000 7f7ff106a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564ab627dcb0 con 0x564ab626c1b0 2024-09-19T07:10:33.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.806+0000 7f7ff106a740 10 client.0 _ll_register_callbacks cb 0x564ab6156030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:10:33.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.806+0000 7f7feca2d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ab626b890 0x564ab627a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:33.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.806+0000 7f7feca2d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ab626b890 0x564ab627a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44814/0 (socket says 172.21.15.148:44814) 2024-09-19T07:10:33.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.806+0000 7f7feca2d640 1 -- 172.21.15.148:0/139886499 learned_addr learned my addr 172.21.15.148:0/139886499 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:33.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.806+0000 7f7fe7fff640 1 --2- 172.21.15.148:0/139886499 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ab626c1b0 0x564ab6277b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:33.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.806+0000 7f7fed22e640 1 --2- 172.21.15.148:0/139886499 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564ab627afc0 0x564ab62780b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:33.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.806+0000 7f7feca2d640 1 -- 172.21.15.148:0/139886499 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ab626c1b0 msgr2=0x564ab6277b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:10:33.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.806+0000 7f7feca2d640 1 --2- 172.21.15.148:0/139886499 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ab626c1b0 0x564ab6277b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:33.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.806+0000 7f7feca2d640 1 -- 172.21.15.148:0/139886499 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564ab627afc0 msgr2=0x564ab62780b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:10:33.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.806+0000 7f7feca2d640 1 --2- 172.21.15.148:0/139886499 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564ab627afc0 0x564ab62780b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:33.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.806+0000 7f7feca2d640 1 -- 172.21.15.148:0/139886499 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ab5f432b0 con 0x564ab626b890 2024-09-19T07:10:33.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.806+0000 7f7feca2d640 1 --2- 172.21.15.148:0/139886499 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ab626b890 0x564ab627a7d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7fd80093a0 tx=0x7f7fd8003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31327e810f554a0d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:33.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.806+0000 7f7fc7fff640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:10:33.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.807+0000 7f7fc7fff640 1 -- 172.21.15.148:0/139886499 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd8048070 con 0x564ab626b890 2024-09-19T07:10:33.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.807+0000 7f7fc7fff640 1 -- 172.21.15.148:0/139886499 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7f7fd8004350 con 0x564ab626b890 2024-09-19T07:10:33.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.807+0000 7f7ff106a740 1 -- 172.21.15.148:0/139886499 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fd802fb90 con 0x564ab626b890 2024-09-19T07:10:33.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.807+0000 7f7fc7fff640 1 -- 172.21.15.148:0/139886499 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7fd8034040 con 0x564ab626b890 2024-09-19T07:10:33.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.807+0000 7f7ff106a740 10 client.14946 fetch_fsmap learned FSMap version 24 2024-09-19T07:10:33.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.807+0000 7f7ff106a740 1 -- 172.21.15.148:0/139886499 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564ab6289460 con 0x564ab626b890 2024-09-19T07:10:33.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.807+0000 7f7fc7fff640 1 -- 172.21.15.148:0/139886499 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7fd802fb90 con 0x564ab626b890 2024-09-19T07:10:33.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.807+0000 7f7fc7fff640 1 -- 172.21.15.148:0/139886499 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7fd8030920 con 0x564ab626b890 2024-09-19T07:10:33.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.807+0000 7f7ff106a740 10 client.14946 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:10:33.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.807+0000 7f7ff106a740 10 client.14946 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T07:10:33.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.807+0000 7f7ff106a740 20 client.14946 populate_metadata read hostname 'smithi148' 2024-09-19T07:10:33.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.807+0000 7f7ff106a740 1 --2- 172.21.15.148:0/139886499 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x564ab628a7b0 0x564ab628c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:33.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.807+0000 7f7ff106a740 4 client.14946 mds_command: new command op to 24436 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:10:33.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.807+0000 7f7ff106a740 1 -- 172.21.15.148:0/139886499 --> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ab61df600 con 0x564ab628a7b0 2024-09-19T07:10:33.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.808+0000 7f7fe7fff640 1 --2- 172.21.15.148:0/139886499 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x564ab628a7b0 0x564ab628c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:33.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.808+0000 7f7fc7fff640 10 client.14946 ms_handle_connect on v2:172.21.15.179:6836/3827671241 2024-09-19T07:10:33.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.808+0000 7f7fe7fff640 1 --2- 172.21.15.148:0/139886499 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x564ab628a7b0 0x564ab628c9a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f4d877668bafc46a server_cookie=b0a90edc937be3a3 in_seq=0 out_seq=0 2024-09-19T07:10:33.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.809+0000 7f7fc7fff640 1 -- 172.21.15.148:0/139886499 <== mds.2 v2:172.21.15.179:6836/3827671241 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564ab61df600 con 0x564ab628a7b0 2024-09-19T07:10:33.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.809+0000 7f7fc7fff640 10 client.14946 handle_command_reply: tid=0 2024-09-19T07:10:33.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.809+0000 7f7ff106a740 1 client.14946 shutdown 2024-09-19T07:10:33.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.809+0000 7f7ff106a740 1 -- 172.21.15.148:0/139886499 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ab626b890 msgr2=0x564ab627a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:33.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.809+0000 7f7ff106a740 1 --2- 172.21.15.148:0/139886499 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ab626b890 0x564ab627a7d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7fd80093a0 tx=0x7f7fd8003c20 comp rx=0 tx=0).stop 2024-09-19T07:10:33.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.809+0000 7f7ff106a740 1 -- 172.21.15.148:0/139886499 shutdown_connections 2024-09-19T07:10:33.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.809+0000 7f7ff106a740 1 --2- 172.21.15.148:0/139886499 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x564ab628a7b0 0x564ab628c9a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:33.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.809+0000 7f7ff106a740 1 --2- 172.21.15.148:0/139886499 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564ab627afc0 0x564ab62780b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:33.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.809+0000 7f7ff106a740 1 --2- 172.21.15.148:0/139886499 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ab626c1b0 0x564ab6277b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:33.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.809+0000 7f7ff106a740 1 --2- 172.21.15.148:0/139886499 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ab626b890 0x564ab627a7d0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:33.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.809+0000 7f7ff106a740 1 -- 172.21.15.148:0/139886499 >> 172.21.15.148:0/139886499 conn(0x564ab6267f60 msgr2=0x564ab626dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:33.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.809+0000 7f7fc7fff640 0 client.14946 ms_handle_reset on v2:172.21.15.179:6836/3827671241 2024-09-19T07:10:33.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.809+0000 7f7ff106a740 1 -- 172.21.15.148:0/139886499 shutdown_connections 2024-09-19T07:10:33.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.809+0000 7f7ff106a740 1 -- 172.21.15.148:0/139886499 wait complete. 2024-09-19T07:10:33.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.809+0000 7f7ff106a740 20 client.14946 trim_cache size 0 max 16384 2024-09-19T07:10:33.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.827+0000 7f7ff106a740 1 Processor -- start 2024-09-19T07:10:33.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.827+0000 7f7ff106a740 1 -- start start 2024-09-19T07:10:33.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.827+0000 7f7ff106a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ab626b890 0x564ab628c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:33.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.827+0000 7f7ff106a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ab626c1b0 0x564ab628bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:33.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.827+0000 7f7ff106a740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564ab627afc0 0x564ab628ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:33.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.827+0000 7f7ff106a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x564ab628ace0 con 0x564ab626b890 2024-09-19T07:10:33.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.827+0000 7f7ff106a740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x564ab628b3b0 con 0x564ab627afc0 2024-09-19T07:10:33.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.827+0000 7f7ff106a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564ab628ba80 con 0x564ab626c1b0 2024-09-19T07:10:33.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.827+0000 7f7feca2d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ab626b890 0x564ab628c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:33.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.827+0000 7f7feca2d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ab626b890 0x564ab628c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44818/0 (socket says 172.21.15.148:44818) 2024-09-19T07:10:33.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.827+0000 7f7feca2d640 1 -- 172.21.15.148:0/3360712836 learned_addr learned my addr 172.21.15.148:0/3360712836 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:33.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.828+0000 7f7feca2d640 1 -- 172.21.15.148:0/3360712836 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ab626c1b0 msgr2=0x564ab628bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:10:33.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.828+0000 7f7feca2d640 1 --2- 172.21.15.148:0/3360712836 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ab626c1b0 0x564ab628bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:33.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.828+0000 7f7feca2d640 1 -- 172.21.15.148:0/3360712836 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564ab627afc0 msgr2=0x564ab628ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:10:33.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.828+0000 7f7feca2d640 1 --2- 172.21.15.148:0/3360712836 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564ab627afc0 0x564ab628ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:33.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.828+0000 7f7feca2d640 1 -- 172.21.15.148:0/3360712836 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ab627ab40 con 0x564ab626b890 2024-09-19T07:10:33.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.828+0000 7f7feca2d640 1 --2- 172.21.15.148:0/3360712836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ab626b890 0x564ab628c9a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8003f20 tx=0x7f7fd8009c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8ff37a9f345d646 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:33.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.828+0000 7f7fde7fc640 1 -- 172.21.15.148:0/3360712836 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd805b030 con 0x564ab626b890 2024-09-19T07:10:33.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.828+0000 7f7fde7fc640 1 -- 172.21.15.148:0/3360712836 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7fd8003c90 con 0x564ab626b890 2024-09-19T07:10:33.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.828+0000 7f7fde7fc640 1 -- 172.21.15.148:0/3360712836 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd8048040 con 0x564ab626b890 2024-09-19T07:10:33.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.829+0000 7f7ff106a740 1 -- 172.21.15.148:0/3360712836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ab626b890 msgr2=0x564ab628c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:33.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.829+0000 7f7ff106a740 1 --2- 172.21.15.148:0/3360712836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ab626b890 0x564ab628c9a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8003f20 tx=0x7f7fd8009c60 comp rx=0 tx=0).stop 2024-09-19T07:10:33.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.829+0000 7f7ff106a740 1 -- 172.21.15.148:0/3360712836 shutdown_connections 2024-09-19T07:10:33.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.829+0000 7f7ff106a740 1 --2- 172.21.15.148:0/3360712836 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564ab627afc0 0x564ab628ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:33.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.829+0000 7f7ff106a740 1 --2- 172.21.15.148:0/3360712836 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ab626c1b0 0x564ab628bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:33.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.829+0000 7f7ff106a740 1 --2- 172.21.15.148:0/3360712836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ab626b890 0x564ab628c9a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:33.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.829+0000 7f7ff106a740 1 -- 172.21.15.148:0/3360712836 >> 172.21.15.148:0/3360712836 conn(0x564ab6267f60 msgr2=0x564ab6273240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:33.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.829+0000 7f7ff106a740 1 -- 172.21.15.148:0/3360712836 shutdown_connections 2024-09-19T07:10:33.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.829+0000 7f7ff106a740 1 -- 172.21.15.148:0/3360712836 wait complete. 2024-09-19T07:10:33.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.829+0000 7f7ff106a740 1 -- start start 2024-09-19T07:10:33.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.829+0000 7f7ff106a740 1 Processor -- start 2024-09-19T07:10:33.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.830+0000 7f7ff106a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ab626b890 0x564ab62741a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:33.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.830+0000 7f7ff106a740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564ab626c1b0 0x564ab62746e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:33.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.830+0000 7f7ff106a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ab627afc0 0x564ab6293bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:33.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.830+0000 7f7ff106a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x564ab628c820 con 0x564ab627afc0 2024-09-19T07:10:33.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.830+0000 7f7ff106a740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x564ab628c150 con 0x564ab626c1b0 2024-09-19T07:10:33.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.830+0000 7f7ff106a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564ab628cef0 con 0x564ab626b890 2024-09-19T07:10:33.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.830+0000 7f7ff106a740 10 client.0 _ll_register_callbacks cb 0x7f7fd8046070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:10:33.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.830+0000 7f7fed22e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ab627afc0 0x564ab6293bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:33.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.830+0000 7f7fed22e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ab627afc0 0x564ab6293bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44832/0 (socket says 172.21.15.148:44832) 2024-09-19T07:10:33.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.830+0000 7f7fed22e640 1 -- 172.21.15.148:0/3233849765 learned_addr learned my addr 172.21.15.148:0/3233849765 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:33.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.830+0000 7f7feca2d640 1 --2- 172.21.15.148:0/3233849765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ab626b890 0x564ab62741a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:33.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.830+0000 7f7fe7fff640 1 --2- 172.21.15.148:0/3233849765 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564ab626c1b0 0x564ab62746e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:33.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.830+0000 7f7fed22e640 1 -- 172.21.15.148:0/3233849765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ab626b890 msgr2=0x564ab62741a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:10:33.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.830+0000 7f7fed22e640 1 --2- 172.21.15.148:0/3233849765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ab626b890 0x564ab62741a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:33.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.830+0000 7f7fed22e640 1 -- 172.21.15.148:0/3233849765 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564ab626c1b0 msgr2=0x564ab62746e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:10:33.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.830+0000 7f7fed22e640 1 --2- 172.21.15.148:0/3233849765 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564ab626c1b0 0x564ab62746e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:33.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.830+0000 7f7fed22e640 1 -- 172.21.15.148:0/3233849765 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ab6274fe0 con 0x564ab627afc0 2024-09-19T07:10:33.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.830+0000 7f7fe7fff640 1 --2- 172.21.15.148:0/3233849765 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564ab626c1b0 0x564ab62746e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:10:33.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.830+0000 7f7fed22e640 1 --2- 172.21.15.148:0/3233849765 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ab627afc0 0x564ab6293bf0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7fe001dde0 tx=0x7f7fe0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=507f5f31f289739f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:33.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.830+0000 7f7fc7fff640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:10:33.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.830+0000 7f7fc7fff640 1 -- 172.21.15.148:0/3233849765 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe002b060 con 0x564ab627afc0 2024-09-19T07:10:33.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.830+0000 7f7fc7fff640 1 -- 172.21.15.148:0/3233849765 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7f7fe00263f0 con 0x564ab627afc0 2024-09-19T07:10:33.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.830+0000 7f7ff106a740 1 -- 172.21.15.148:0/3233849765 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564ab61d9b10 con 0x564ab627afc0 2024-09-19T07:10:33.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.831+0000 7f7fc7fff640 1 -- 172.21.15.148:0/3233849765 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7fe0018070 con 0x564ab627afc0 2024-09-19T07:10:33.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.831+0000 7f7ff106a740 10 client.14952 fetch_fsmap learned FSMap version 24 2024-09-19T07:10:33.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.831+0000 7f7ff106a740 1 -- 172.21.15.148:0/3233849765 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564ab6295260 con 0x564ab627afc0 2024-09-19T07:10:33.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.831+0000 7f7fc7fff640 1 -- 172.21.15.148:0/3233849765 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x564ab61d9b10 con 0x564ab627afc0 2024-09-19T07:10:33.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.831+0000 7f7fc7fff640 1 -- 172.21.15.148:0/3233849765 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7fe0025070 con 0x564ab627afc0 2024-09-19T07:10:33.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.831+0000 7f7ff106a740 10 client.14952 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:10:33.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.831+0000 7f7ff106a740 10 client.14952 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T07:10:33.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.831+0000 7f7ff106a740 20 client.14952 populate_metadata read hostname 'smithi148' 2024-09-19T07:10:33.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.831+0000 7f7ff106a740 1 --2- 172.21.15.148:0/3233849765 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x564ab62f9fd0 0x564ab62f8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:33.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.831+0000 7f7ff106a740 4 client.14952 mds_command: new command op to 24436 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T07:10:33.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.831+0000 7f7ff106a740 1 -- 172.21.15.148:0/3233849765 --> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] -- command(tid 0: {"prefix": "status"}) -- 0x564ab61560e0 con 0x564ab62f9fd0 2024-09-19T07:10:33.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.832+0000 7f7feca2d640 1 --2- 172.21.15.148:0/3233849765 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x564ab62f9fd0 0x564ab62f8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:33.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.832+0000 7f7fc7fff640 10 client.14952 ms_handle_connect on v2:172.21.15.179:6836/3827671241 2024-09-19T07:10:33.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.832+0000 7f7feca2d640 1 --2- 172.21.15.148:0/3233849765 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x564ab62f9fd0 0x564ab62f8ce0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ff0427f8d7ac95b server_cookie=ed443db0814eec08 in_seq=0 out_seq=0 2024-09-19T07:10:33.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.832+0000 7f7fc7fff640 1 -- 172.21.15.148:0/3233849765 <== mds.2 v2:172.21.15.179:6836/3827671241 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x564ab61560e0 con 0x564ab62f9fd0 2024-09-19T07:10:33.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.832+0000 7f7fc7fff640 10 client.14952 handle_command_reply: tid=0 2024-09-19T07:10:33.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.832+0000 7f7ff106a740 1 client.14952 shutdown 2024-09-19T07:10:33.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.832+0000 7f7ff106a740 1 -- 172.21.15.148:0/3233849765 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ab627afc0 msgr2=0x564ab6293bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:33.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.832+0000 7f7ff106a740 1 --2- 172.21.15.148:0/3233849765 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ab627afc0 0x564ab6293bf0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7fe001dde0 tx=0x7f7fe0004730 comp rx=0 tx=0).stop 2024-09-19T07:10:33.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.832+0000 7f7ff106a740 1 -- 172.21.15.148:0/3233849765 shutdown_connections 2024-09-19T07:10:33.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.832+0000 7f7ff106a740 1 --2- 172.21.15.148:0/3233849765 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x564ab62f9fd0 0x564ab62f8ce0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:33.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.832+0000 7f7ff106a740 1 --2- 172.21.15.148:0/3233849765 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564ab627afc0 0x564ab6293bf0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:33.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.832+0000 7f7ff106a740 1 --2- 172.21.15.148:0/3233849765 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564ab626c1b0 0x564ab62746e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:33.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.832+0000 7f7ff106a740 1 --2- 172.21.15.148:0/3233849765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ab626b890 0x564ab62741a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:33.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.832+0000 7f7ff106a740 1 -- 172.21.15.148:0/3233849765 >> 172.21.15.148:0/3233849765 conn(0x564ab6267f60 msgr2=0x564ab6273240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:33.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.832+0000 7f7fc7fff640 0 client.14952 ms_handle_reset on v2:172.21.15.179:6836/3827671241 2024-09-19T07:10:33.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.832+0000 7f7ff106a740 1 -- 172.21.15.148:0/3233849765 shutdown_connections 2024-09-19T07:10:33.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.832+0000 7f7ff106a740 1 -- 172.21.15.148:0/3233849765 wait complete. 2024-09-19T07:10:33.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.833+0000 7f7ff106a740 20 client.14952 trim_cache size 0 max 16384 2024-09-19T07:10:33.844 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:10:33.844 INFO:teuthology.orchestra.run.smithi148.stdout: "cluster_fsid": "eae8a4a8-7654-11ef-bceb-c7b262605968", 2024-09-19T07:10:33.844 INFO:teuthology.orchestra.run.smithi148.stdout: "whoami": 2, 2024-09-19T07:10:33.844 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 24436, 2024-09-19T07:10:33.845 INFO:teuthology.orchestra.run.smithi148.stdout: "want_state": "up:active", 2024-09-19T07:10:33.845 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "up:active", 2024-09-19T07:10:33.845 INFO:teuthology.orchestra.run.smithi148.stdout: "fs_name": "cephfs", 2024-09-19T07:10:33.845 INFO:teuthology.orchestra.run.smithi148.stdout: "rank_uptime": 65.855644611000002, 2024-09-19T07:10:33.845 INFO:teuthology.orchestra.run.smithi148.stdout: "mdsmap_epoch": 24, 2024-09-19T07:10:33.845 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch": 80, 2024-09-19T07:10:33.845 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch_barrier": 78, 2024-09-19T07:10:33.845 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 97.876179492999995 2024-09-19T07:10:33.845 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:10:33.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.833+0000 7f7feec91640 1 -- 172.21.15.148:0/2730860967 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f7fd40a32d0 msgr2=0x7f7fd40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:33.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.833+0000 7f7feec91640 1 --2- 172.21.15.148:0/2730860967 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f7fd40a32d0 0x7f7fd40a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7fe000ab50 tx=0x7f7fe000af50 comp rx=0 tx=0).stop 2024-09-19T07:10:33.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.833+0000 7f7feec91640 1 -- 172.21.15.148:0/2730860967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7fe8102570 msgr2=0x7f7fe81998b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:33.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.833+0000 7f7feec91640 1 --2- 172.21.15.148:0/2730860967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7fe8102570 0x7f7fe81998b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7fd000b4a0 tx=0x7f7fd000b960 comp rx=0 tx=0).stop 2024-09-19T07:10:33.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.833+0000 7f7feec91640 1 -- 172.21.15.148:0/2730860967 shutdown_connections 2024-09-19T07:10:33.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.833+0000 7f7feec91640 1 --2- 172.21.15.148:0/2730860967 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f7fd40a32d0 0x7f7fd40a5790 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:33.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.833+0000 7f7feec91640 1 --2- 172.21.15.148:0/2730860967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7fe8102ef0 0x7f7fe81a43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:33.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.833+0000 7f7feec91640 1 --2- 172.21.15.148:0/2730860967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7fe8102570 0x7f7fe81998b0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:33.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.833+0000 7f7feec91640 1 --2- 172.21.15.148:0/2730860967 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7fe8100e20 0x7f7fe8199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:33.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.833+0000 7f7feec91640 1 -- 172.21.15.148:0/2730860967 >> 172.21.15.148:0/2730860967 conn(0x7f7fe80fc7d0 msgr2=0x7f7fe80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:33.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.833+0000 7f7feec91640 1 -- 172.21.15.148:0/2730860967 shutdown_connections 2024-09-19T07:10:33.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:33.833+0000 7f7feec91640 1 -- 172.21.15.148:0/2730860967 wait complete. 2024-09-19T07:10:33.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:33 smithi165 ceph-mon[35326]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:10:34.533 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T07:10:34.782 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:10:35.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.272+0000 7f4e53517640 1 -- 172.21.15.148:0/3360520720 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e4c106a80 msgr2=0x7f4e4c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:35.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.272+0000 7f4e53517640 1 --2- 172.21.15.148:0/3360520720 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e4c106a80 0x7f4e4c106e60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4e44009930 tx=0x7f4e4402a420 comp rx=0 tx=0).stop 2024-09-19T07:10:35.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.272+0000 7f4e53517640 1 -- 172.21.15.148:0/3360520720 shutdown_connections 2024-09-19T07:10:35.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.272+0000 7f4e53517640 1 --2- 172.21.15.148:0/3360520720 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e4c101420 0x7f4e4c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:35.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.272+0000 7f4e53517640 1 --2- 172.21.15.148:0/3360520720 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e4c100a80 0x7f4e4c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:35.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.272+0000 7f4e53517640 1 --2- 172.21.15.148:0/3360520720 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e4c106a80 0x7f4e4c106e60 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:35.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.272+0000 7f4e53517640 1 -- 172.21.15.148:0/3360520720 >> 172.21.15.148:0/3360520720 conn(0x7f4e4c0fc7a0 msgr2=0x7f4e4c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:35.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.273+0000 7f4e53517640 1 -- 172.21.15.148:0/3360520720 shutdown_connections 2024-09-19T07:10:35.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.273+0000 7f4e53517640 1 -- 172.21.15.148:0/3360520720 wait complete. 2024-09-19T07:10:35.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.273+0000 7f4e53517640 1 Processor -- start 2024-09-19T07:10:35.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.273+0000 7f4e53517640 1 -- start start 2024-09-19T07:10:35.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.273+0000 7f4e53517640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e4c100a80 0x7f4e4c197360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:35.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.273+0000 7f4e53517640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e4c101420 0x7f4e4c1978a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:35.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.273+0000 7f4e53517640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e4c106a80 0x7f4e4c19bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:35.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.273+0000 7f4e53517640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4c110e40 con 0x7f4e4c100a80 2024-09-19T07:10:35.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.273+0000 7f4e53517640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4c110cc0 con 0x7f4e4c101420 2024-09-19T07:10:35.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.273+0000 7f4e53517640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4c110fc0 con 0x7f4e4c106a80 2024-09-19T07:10:35.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.273+0000 7f4e512b3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e4c100a80 0x7f4e4c197360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:35.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.273+0000 7f4e512b3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e4c100a80 0x7f4e4c197360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60202/0 (socket says 172.21.15.148:60202) 2024-09-19T07:10:35.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.273+0000 7f4e512b3640 1 -- 172.21.15.148:0/240237022 learned_addr learned my addr 172.21.15.148:0/240237022 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:35.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.274+0000 7f4e512b3640 1 -- 172.21.15.148:0/240237022 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e4c106a80 msgr2=0x7f4e4c19bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:35.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.274+0000 7f4e512b3640 1 --2- 172.21.15.148:0/240237022 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e4c106a80 0x7f4e4c19bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:35.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.274+0000 7f4e512b3640 1 -- 172.21.15.148:0/240237022 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e4c101420 msgr2=0x7f4e4c1978a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:35.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.274+0000 7f4e50ab2640 1 --2- 172.21.15.148:0/240237022 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e4c101420 0x7f4e4c1978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:35.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.274+0000 7f4e512b3640 1 --2- 172.21.15.148:0/240237022 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e4c101420 0x7f4e4c1978a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:35.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.274+0000 7f4e512b3640 1 -- 172.21.15.148:0/240237022 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e4c19c310 con 0x7f4e4c100a80 2024-09-19T07:10:35.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.274+0000 7f4e50ab2640 1 --2- 172.21.15.148:0/240237022 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e4c101420 0x7f4e4c1978a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:10:35.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.274+0000 7f4e512b3640 1 --2- 172.21.15.148:0/240237022 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e4c100a80 0x7f4e4c197360 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4e44009230 tx=0x7f4e44004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:35.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.274+0000 7f4e4a7fc640 1 -- 172.21.15.148:0/240237022 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e4403f030 con 0x7f4e4c100a80 2024-09-19T07:10:35.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.274+0000 7f4e4a7fc640 1 -- 172.21.15.148:0/240237022 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e44003ad0 con 0x7f4e4c100a80 2024-09-19T07:10:35.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.274+0000 7f4e53517640 1 -- 172.21.15.148:0/240237022 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e4c19c5a0 con 0x7f4e4c100a80 2024-09-19T07:10:35.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.274+0000 7f4e4a7fc640 1 -- 172.21.15.148:0/240237022 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e44035070 con 0x7f4e4c100a80 2024-09-19T07:10:35.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.274+0000 7f4e53517640 1 -- 172.21.15.148:0/240237022 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e4c1a3ee0 con 0x7f4e4c100a80 2024-09-19T07:10:35.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.276+0000 7f4e4a7fc640 1 -- 172.21.15.148:0/240237022 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f4e44042030 con 0x7f4e4c100a80 2024-09-19T07:10:35.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.277+0000 7f4e558f0740 1 Processor -- start 2024-09-19T07:10:35.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.277+0000 7f4e558f0740 1 -- start start 2024-09-19T07:10:35.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.277+0000 7f4e558f0740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555d0458f850 0x555d0458fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:35.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.277+0000 7f4e558f0740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555d04590170 0x555d0459c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:35.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.277+0000 7f4e558f0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d0459cdc0 0x555d0459f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:35.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.277+0000 7f4e558f0740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x555d044f6090 con 0x555d04590170 2024-09-19T07:10:35.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.277+0000 7f4e558f0740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x555d0449da70 con 0x555d0458f850 2024-09-19T07:10:35.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.277+0000 7f4e558f0740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x555d044f2050 con 0x555d0459cdc0 2024-09-19T07:10:35.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.277+0000 7f4e512b3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555d04590170 0x555d0459c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:35.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.277+0000 7f4e512b3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555d04590170 0x555d0459c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60210/0 (socket says 172.21.15.148:60210) 2024-09-19T07:10:35.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.277+0000 7f4e4a7fc640 1 --2- 172.21.15.148:0/240237022 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f4e340a32d0 0x7f4e340a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:35.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.277+0000 7f4e512b3640 1 -- 172.21.15.148:0/4213724906 learned_addr learned my addr 172.21.15.148:0/4213724906 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:35.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.277+0000 7f4e51ab4640 1 --2- 172.21.15.148:0/4213724906 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555d0458f850 0x555d0458fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:35.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.278+0000 7f4e51ab4640 1 --2- 172.21.15.148:0/240237022 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f4e340a32d0 0x7f4e340a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:35.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.278+0000 7f4e50ab2640 1 --2- 172.21.15.148:0/4213724906 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d0459cdc0 0x555d0459f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:35.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.278+0000 7f4e4a7fc640 1 -- 172.21.15.148:0/240237022 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7f4e440f0090 con 0x7f4e4c100a80 2024-09-19T07:10:35.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.278+0000 7f4e512b3640 1 -- 172.21.15.148:0/4213724906 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d0459cdc0 msgr2=0x555d0459f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:10:35.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.278+0000 7f4e512b3640 1 --2- 172.21.15.148:0/4213724906 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d0459cdc0 0x555d0459f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:35.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.278+0000 7f4e512b3640 1 -- 172.21.15.148:0/4213724906 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555d0458f850 msgr2=0x555d0458fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:10:35.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.278+0000 7f4e512b3640 1 --2- 172.21.15.148:0/4213724906 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555d0458f850 0x555d0458fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:35.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.278+0000 7f4e512b3640 1 -- 172.21.15.148:0/4213724906 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d044aa130 con 0x555d04590170 2024-09-19T07:10:35.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.278+0000 7f4e512b3640 1 --2- 172.21.15.148:0/4213724906 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555d04590170 0x555d0459c880 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4e440b8960 tx=0x7f4e44005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=926cfeae99d74bae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:35.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.278+0000 7f4e51ab4640 1 --2- 172.21.15.148:0/240237022 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f4e340a32d0 0x7f4e340a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c009fd0 tx=0x7f4e3c009800 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:35.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.278+0000 7f4e337fe640 1 -- 172.21.15.148:0/4213724906 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e44049070 con 0x555d04590170 2024-09-19T07:10:35.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.278+0000 7f4e337fe640 1 -- 172.21.15.148:0/4213724906 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e440c08b0 con 0x555d04590170 2024-09-19T07:10:35.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.278+0000 7f4e337fe640 1 -- 172.21.15.148:0/4213724906 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e440b8b70 con 0x555d04590170 2024-09-19T07:10:35.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.279+0000 7f4e558f0740 1 -- 172.21.15.148:0/4213724906 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555d04590170 msgr2=0x555d0459c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:35.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.279+0000 7f4e558f0740 1 --2- 172.21.15.148:0/4213724906 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555d04590170 0x555d0459c880 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4e440b8960 tx=0x7f4e44005e50 comp rx=0 tx=0).stop 2024-09-19T07:10:35.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.279+0000 7f4e558f0740 1 -- 172.21.15.148:0/4213724906 shutdown_connections 2024-09-19T07:10:35.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.279+0000 7f4e558f0740 1 --2- 172.21.15.148:0/4213724906 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d0459cdc0 0x555d0459f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:35.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.279+0000 7f4e558f0740 1 --2- 172.21.15.148:0/4213724906 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555d04590170 0x555d0459c880 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:35.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.279+0000 7f4e558f0740 1 --2- 172.21.15.148:0/4213724906 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555d0458f850 0x555d0458fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:35.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.279+0000 7f4e558f0740 1 -- 172.21.15.148:0/4213724906 >> 172.21.15.148:0/4213724906 conn(0x555d0458bf60 msgr2=0x555d0458c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:35.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.279+0000 7f4e558f0740 1 -- 172.21.15.148:0/4213724906 shutdown_connections 2024-09-19T07:10:35.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.279+0000 7f4e558f0740 1 -- 172.21.15.148:0/4213724906 wait complete. 2024-09-19T07:10:35.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.279+0000 7f4e558f0740 1 -- start start 2024-09-19T07:10:35.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.279+0000 7f4e558f0740 1 Processor -- start 2024-09-19T07:10:35.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.280+0000 7f4e558f0740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555d0458f850 0x555d0459c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:35.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.280+0000 7f4e558f0740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555d04590170 0x555d045999c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:35.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.280+0000 7f4e558f0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d0459cdc0 0x555d04599f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:35.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.280+0000 7f4e558f0740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x555d0459f7b0 con 0x555d04590170 2024-09-19T07:10:35.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.280+0000 7f4e558f0740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x555d044b0f20 con 0x555d0458f850 2024-09-19T07:10:35.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.280+0000 7f4e558f0740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x555d0459f930 con 0x555d0459cdc0 2024-09-19T07:10:35.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.280+0000 7f4e558f0740 10 client.0 _ll_register_callbacks cb 0x555d0447a030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:10:35.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.280+0000 7f4e50ab2640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555d04590170 0x555d045999c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:35.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.280+0000 7f4e50ab2640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555d04590170 0x555d045999c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60212/0 (socket says 172.21.15.148:60212) 2024-09-19T07:10:35.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.280+0000 7f4e50ab2640 1 -- 172.21.15.148:0/3835772416 learned_addr learned my addr 172.21.15.148:0/3835772416 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:35.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.280+0000 7f4e51ab4640 1 --2- 172.21.15.148:0/3835772416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d0459cdc0 0x555d04599f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:35.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.280+0000 7f4e512b3640 1 --2- 172.21.15.148:0/3835772416 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555d0458f850 0x555d0459c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:35.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.280+0000 7f4e50ab2640 1 -- 172.21.15.148:0/3835772416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d0459cdc0 msgr2=0x555d04599f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:10:35.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.280+0000 7f4e50ab2640 1 --2- 172.21.15.148:0/3835772416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d0459cdc0 0x555d04599f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:35.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.280+0000 7f4e50ab2640 1 -- 172.21.15.148:0/3835772416 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555d0458f850 msgr2=0x555d0459c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:10:35.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.280+0000 7f4e50ab2640 1 --2- 172.21.15.148:0/3835772416 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555d0458f850 0x555d0459c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:35.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.280+0000 7f4e50ab2640 1 -- 172.21.15.148:0/3835772416 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d042672b0 con 0x555d04590170 2024-09-19T07:10:35.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.280+0000 7f4e512b3640 1 --2- 172.21.15.148:0/3835772416 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555d0458f850 0x555d0459c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:10:35.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.281+0000 7f4e50ab2640 1 --2- 172.21.15.148:0/3835772416 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555d04590170 0x555d045999c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4e4000f670 tx=0x7f4e4000fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1f6c50cd82db28f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:35.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.281+0000 7f4e30ff9640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:10:35.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.281+0000 7f4e30ff9640 1 -- 172.21.15.148:0/3835772416 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e40016070 con 0x555d04590170 2024-09-19T07:10:35.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.281+0000 7f4e30ff9640 1 -- 172.21.15.148:0/3835772416 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7f4e4000bb00 con 0x555d04590170 2024-09-19T07:10:35.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.281+0000 7f4e558f0740 1 -- 172.21.15.148:0/3835772416 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e440c08b0 con 0x555d04590170 2024-09-19T07:10:35.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.281+0000 7f4e30ff9640 1 -- 172.21.15.148:0/3835772416 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4e4000bd00 con 0x555d04590170 2024-09-19T07:10:35.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.281+0000 7f4e558f0740 10 client.14964 fetch_fsmap learned FSMap version 24 2024-09-19T07:10:35.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.281+0000 7f4e558f0740 1 -- 172.21.15.148:0/3835772416 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555d045ab0e0 con 0x555d04590170 2024-09-19T07:10:35.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.281+0000 7f4e30ff9640 1 -- 172.21.15.148:0/3835772416 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e440c08b0 con 0x555d04590170 2024-09-19T07:10:35.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.281+0000 7f4e30ff9640 1 -- 172.21.15.148:0/3835772416 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f4e4001a520 con 0x555d04590170 2024-09-19T07:10:35.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.281+0000 7f4e558f0740 10 client.14964 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:10:35.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.281+0000 7f4e558f0740 10 client.14964 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T07:10:35.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.281+0000 7f4e558f0740 20 client.14964 populate_metadata read hostname 'smithi148' 2024-09-19T07:10:35.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.281+0000 7f4e558f0740 1 --2- 172.21.15.148:0/3835772416 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x555d045ad7a0 0x555d045aec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:35.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.281+0000 7f4e558f0740 4 client.14964 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:10:35.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.281+0000 7f4e558f0740 1 -- 172.21.15.148:0/3835772416 --> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555d04503600 con 0x555d045ad7a0 2024-09-19T07:10:35.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.281+0000 7f4e512b3640 1 --2- 172.21.15.148:0/3835772416 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x555d045ad7a0 0x555d045aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:35.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.282+0000 7f4e30ff9640 10 client.14964 ms_handle_connect on v2:172.21.15.165:6838/3993490234 2024-09-19T07:10:35.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.282+0000 7f4e512b3640 1 --2- 172.21.15.148:0/3835772416 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x555d045ad7a0 0x555d045aec10 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=996559723413db7d server_cookie=3154718d7884f14d in_seq=0 out_seq=0 2024-09-19T07:10:35.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.283+0000 7f4e30ff9640 1 -- 172.21.15.148:0/3835772416 <== mds.1 v2:172.21.15.165:6838/3993490234 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555d04503600 con 0x555d045ad7a0 2024-09-19T07:10:35.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.283+0000 7f4e30ff9640 10 client.14964 handle_command_reply: tid=0 2024-09-19T07:10:35.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.283+0000 7f4e558f0740 1 client.14964 shutdown 2024-09-19T07:10:35.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.283+0000 7f4e558f0740 1 -- 172.21.15.148:0/3835772416 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555d04590170 msgr2=0x555d045999c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:35.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.283+0000 7f4e558f0740 1 --2- 172.21.15.148:0/3835772416 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555d04590170 0x555d045999c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4e4000f670 tx=0x7f4e4000fb30 comp rx=0 tx=0).stop 2024-09-19T07:10:35.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.283+0000 7f4e558f0740 1 -- 172.21.15.148:0/3835772416 shutdown_connections 2024-09-19T07:10:35.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.283+0000 7f4e558f0740 1 --2- 172.21.15.148:0/3835772416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d0459cdc0 0x555d04599f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:35.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.283+0000 7f4e558f0740 1 --2- 172.21.15.148:0/3835772416 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555d04590170 0x555d045999c0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:35.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.283+0000 7f4e558f0740 1 --2- 172.21.15.148:0/3835772416 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x555d045ad7a0 0x555d045aec10 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:35.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.283+0000 7f4e558f0740 1 --2- 172.21.15.148:0/3835772416 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555d0458f850 0x555d0459c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:35.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.283+0000 7f4e30ff9640 0 client.14964 ms_handle_reset on v2:172.21.15.165:6838/3993490234 2024-09-19T07:10:35.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.283+0000 7f4e558f0740 1 -- 172.21.15.148:0/3835772416 >> 172.21.15.148:0/3835772416 conn(0x555d0458bf60 msgr2=0x555d04591be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:35.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.283+0000 7f4e558f0740 1 -- 172.21.15.148:0/3835772416 shutdown_connections 2024-09-19T07:10:35.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.283+0000 7f4e558f0740 1 -- 172.21.15.148:0/3835772416 wait complete. 2024-09-19T07:10:35.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.283+0000 7f4e558f0740 20 client.14964 trim_cache size 0 max 16384 2024-09-19T07:10:35.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.301+0000 7f4e558f0740 1 Processor -- start 2024-09-19T07:10:35.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.301+0000 7f4e558f0740 1 -- start start 2024-09-19T07:10:35.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.301+0000 7f4e558f0740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555d0458f850 0x555d045aec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:35.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.301+0000 7f4e558f0740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555d04590170 0x555d045a8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:35.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.301+0000 7f4e558f0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d0459cdc0 0x555d04596c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:35.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.301+0000 7f4e558f0740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x555d045acf50 con 0x555d0458f850 2024-09-19T07:10:35.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.301+0000 7f4e558f0740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x555d045ad620 con 0x555d04590170 2024-09-19T07:10:35.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.301+0000 7f4e558f0740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x555d045adcf0 con 0x555d0459cdc0 2024-09-19T07:10:35.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.301+0000 7f4e512b3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555d0458f850 0x555d045aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:35.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.301+0000 7f4e512b3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555d0458f850 0x555d045aec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60224/0 (socket says 172.21.15.148:60224) 2024-09-19T07:10:35.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.301+0000 7f4e512b3640 1 -- 172.21.15.148:0/506977387 learned_addr learned my addr 172.21.15.148:0/506977387 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:35.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.301+0000 7f4e51ab4640 1 --2- 172.21.15.148:0/506977387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d0459cdc0 0x555d04596c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:35.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.301+0000 7f4e512b3640 1 -- 172.21.15.148:0/506977387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d0459cdc0 msgr2=0x555d04596c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:10:35.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.301+0000 7f4e512b3640 1 --2- 172.21.15.148:0/506977387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d0459cdc0 0x555d04596c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:35.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.301+0000 7f4e512b3640 1 -- 172.21.15.148:0/506977387 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555d04590170 msgr2=0x555d045a8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:10:35.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.301+0000 7f4e512b3640 1 --2- 172.21.15.148:0/506977387 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555d04590170 0x555d045a8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:35.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.301+0000 7f4e512b3640 1 -- 172.21.15.148:0/506977387 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d045a8d40 con 0x555d0458f850 2024-09-19T07:10:35.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.301+0000 7f4e51ab4640 1 --2- 172.21.15.148:0/506977387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d0459cdc0 0x555d04596c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:10:35.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.302+0000 7f4e512b3640 1 --2- 172.21.15.148:0/506977387 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555d0458f850 0x555d045aec10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4e44009900 tx=0x7f4e44005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87b6c2ae4075a70c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:35.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.302+0000 7f4e32ffd640 1 -- 172.21.15.148:0/506977387 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e44049040 con 0x555d0458f850 2024-09-19T07:10:35.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.302+0000 7f4e32ffd640 1 -- 172.21.15.148:0/506977387 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e440c08b0 con 0x555d0458f850 2024-09-19T07:10:35.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.302+0000 7f4e32ffd640 1 -- 172.21.15.148:0/506977387 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e440b8b70 con 0x555d0458f850 2024-09-19T07:10:35.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.302+0000 7f4e558f0740 1 -- 172.21.15.148:0/506977387 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555d0458f850 msgr2=0x555d045aec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:35.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.302+0000 7f4e558f0740 1 --2- 172.21.15.148:0/506977387 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555d0458f850 0x555d045aec10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4e44009900 tx=0x7f4e44005c00 comp rx=0 tx=0).stop 2024-09-19T07:10:35.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.303+0000 7f4e558f0740 1 -- 172.21.15.148:0/506977387 shutdown_connections 2024-09-19T07:10:35.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.303+0000 7f4e558f0740 1 --2- 172.21.15.148:0/506977387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d0459cdc0 0x555d04596c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:35.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.303+0000 7f4e558f0740 1 --2- 172.21.15.148:0/506977387 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555d04590170 0x555d045a8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:35.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.303+0000 7f4e558f0740 1 --2- 172.21.15.148:0/506977387 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555d0458f850 0x555d045aec10 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:35.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.303+0000 7f4e558f0740 1 -- 172.21.15.148:0/506977387 >> 172.21.15.148:0/506977387 conn(0x555d0458bf60 msgr2=0x555d04595040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:35.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.303+0000 7f4e558f0740 1 -- 172.21.15.148:0/506977387 shutdown_connections 2024-09-19T07:10:35.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.303+0000 7f4e558f0740 1 -- 172.21.15.148:0/506977387 wait complete. 2024-09-19T07:10:35.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.303+0000 7f4e558f0740 1 -- start start 2024-09-19T07:10:35.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.303+0000 7f4e558f0740 1 Processor -- start 2024-09-19T07:10:35.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.303+0000 7f4e558f0740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555d0458f850 0x555d045917d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:35.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.303+0000 7f4e558f0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d04590170 0x555d04591d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:35.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.303+0000 7f4e558f0740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555d0459cdc0 0x555d04592250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:35.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.303+0000 7f4e558f0740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x555d045aea90 con 0x555d0458f850 2024-09-19T07:10:35.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.303+0000 7f4e558f0740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x555d045ae3c0 con 0x555d0459cdc0 2024-09-19T07:10:35.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.303+0000 7f4e558f0740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x555d045af160 con 0x555d04590170 2024-09-19T07:10:35.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.303+0000 7f4e558f0740 10 client.0 _ll_register_callbacks cb 0x7f4e4000d340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:10:35.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.303+0000 7f4e512b3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555d0458f850 0x555d045917d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:35.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.304+0000 7f4e512b3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555d0458f850 0x555d045917d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60228/0 (socket says 172.21.15.148:60228) 2024-09-19T07:10:35.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.304+0000 7f4e512b3640 1 -- 172.21.15.148:0/2730002632 learned_addr learned my addr 172.21.15.148:0/2730002632 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:35.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.304+0000 7f4e51ab4640 1 --2- 172.21.15.148:0/2730002632 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555d0459cdc0 0x555d04592250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:35.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.304+0000 7f4e50ab2640 1 --2- 172.21.15.148:0/2730002632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d04590170 0x555d04591d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:35.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.304+0000 7f4e512b3640 1 -- 172.21.15.148:0/2730002632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d04590170 msgr2=0x555d04591d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:10:35.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.304+0000 7f4e512b3640 1 --2- 172.21.15.148:0/2730002632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d04590170 0x555d04591d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:35.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.304+0000 7f4e512b3640 1 -- 172.21.15.148:0/2730002632 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555d0459cdc0 msgr2=0x555d04592250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:10:35.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.304+0000 7f4e512b3640 1 --2- 172.21.15.148:0/2730002632 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555d0459cdc0 0x555d04592250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:35.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.304+0000 7f4e512b3640 1 -- 172.21.15.148:0/2730002632 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d045b5ec0 con 0x555d0458f850 2024-09-19T07:10:35.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.304+0000 7f4e50ab2640 1 --2- 172.21.15.148:0/2730002632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d04590170 0x555d04591d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:10:35.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.304+0000 7f4e512b3640 1 --2- 172.21.15.148:0/2730002632 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555d0458f850 0x555d045917d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4e440c4c40 tx=0x7f4e44005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7380cb3c4b5dcb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:35.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.304+0000 7f4e30ff9640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:10:35.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.304+0000 7f4e30ff9640 1 -- 172.21.15.148:0/2730002632 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e44049040 con 0x555d0458f850 2024-09-19T07:10:35.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.304+0000 7f4e30ff9640 1 -- 172.21.15.148:0/2730002632 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7f4e4403b460 con 0x555d0458f850 2024-09-19T07:10:35.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.304+0000 7f4e558f0740 1 -- 172.21.15.148:0/2730002632 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e440c08b0 con 0x555d0458f850 2024-09-19T07:10:35.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.304+0000 7f4e30ff9640 1 -- 172.21.15.148:0/2730002632 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4e44003c80 con 0x555d0458f850 2024-09-19T07:10:35.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.304+0000 7f4e558f0740 10 client.14970 fetch_fsmap learned FSMap version 24 2024-09-19T07:10:35.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.304+0000 7f4e558f0740 1 -- 172.21.15.148:0/2730002632 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555d045b70d0 con 0x555d0458f850 2024-09-19T07:10:35.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.304+0000 7f4e30ff9640 1 -- 172.21.15.148:0/2730002632 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e440c08b0 con 0x555d0458f850 2024-09-19T07:10:35.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.305+0000 7f4e30ff9640 1 -- 172.21.15.148:0/2730002632 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f4e440ed0b0 con 0x555d0458f850 2024-09-19T07:10:35.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.305+0000 7f4e558f0740 10 client.14970 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:10:35.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.305+0000 7f4e558f0740 10 client.14970 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T07:10:35.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.305+0000 7f4e558f0740 20 client.14970 populate_metadata read hostname 'smithi148' 2024-09-19T07:10:35.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.305+0000 7f4e558f0740 1 --2- 172.21.15.148:0/2730002632 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x555d0461dd60 0x555d0461ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:35.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.305+0000 7f4e558f0740 4 client.14970 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T07:10:35.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.305+0000 7f4e558f0740 1 -- 172.21.15.148:0/2730002632 --> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] -- command(tid 0: {"prefix": "status"}) -- 0x555d044fdb10 con 0x555d0461dd60 2024-09-19T07:10:35.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.305+0000 7f4e50ab2640 1 --2- 172.21.15.148:0/2730002632 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x555d0461dd60 0x555d0461ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:35.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.305+0000 7f4e50ab2640 1 --2- 172.21.15.148:0/2730002632 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x555d0461dd60 0x555d0461ca70 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f8a6b6562f82c9b2 server_cookie=cf039e46b10d38b6 in_seq=0 out_seq=0 2024-09-19T07:10:35.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.305+0000 7f4e30ff9640 10 client.14970 ms_handle_connect on v2:172.21.15.165:6838/3993490234 2024-09-19T07:10:35.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.306+0000 7f4e30ff9640 1 -- 172.21.15.148:0/2730002632 <== mds.1 v2:172.21.15.165:6838/3993490234 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x555d044fdb10 con 0x555d0461dd60 2024-09-19T07:10:35.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.306+0000 7f4e30ff9640 10 client.14970 handle_command_reply: tid=0 2024-09-19T07:10:35.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.306+0000 7f4e558f0740 1 client.14970 shutdown 2024-09-19T07:10:35.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.306+0000 7f4e558f0740 1 -- 172.21.15.148:0/2730002632 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555d0458f850 msgr2=0x555d045917d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:35.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.306+0000 7f4e558f0740 1 --2- 172.21.15.148:0/2730002632 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555d0458f850 0x555d045917d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4e440c4c40 tx=0x7f4e44005e50 comp rx=0 tx=0).stop 2024-09-19T07:10:35.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.306+0000 7f4e558f0740 1 -- 172.21.15.148:0/2730002632 shutdown_connections 2024-09-19T07:10:35.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.306+0000 7f4e558f0740 1 --2- 172.21.15.148:0/2730002632 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x555d0461dd60 0x555d0461ca70 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:35.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.306+0000 7f4e558f0740 1 --2- 172.21.15.148:0/2730002632 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555d0459cdc0 0x555d04592250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:35.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.306+0000 7f4e558f0740 1 --2- 172.21.15.148:0/2730002632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555d04590170 0x555d04591d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:35.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.306+0000 7f4e30ff9640 0 client.14970 ms_handle_reset on v2:172.21.15.165:6838/3993490234 2024-09-19T07:10:35.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.306+0000 7f4e558f0740 1 --2- 172.21.15.148:0/2730002632 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555d0458f850 0x555d045917d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:35.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.306+0000 7f4e558f0740 1 -- 172.21.15.148:0/2730002632 >> 172.21.15.148:0/2730002632 conn(0x555d0458bf60 msgr2=0x555d04599280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:35.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.306+0000 7f4e558f0740 1 -- 172.21.15.148:0/2730002632 shutdown_connections 2024-09-19T07:10:35.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.306+0000 7f4e558f0740 1 -- 172.21.15.148:0/2730002632 wait complete. 2024-09-19T07:10:35.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.306+0000 7f4e558f0740 20 client.14970 trim_cache size 0 max 16384 2024-09-19T07:10:35.327 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:10:35.327 INFO:teuthology.orchestra.run.smithi148.stdout: "cluster_fsid": "eae8a4a8-7654-11ef-bceb-c7b262605968", 2024-09-19T07:10:35.327 INFO:teuthology.orchestra.run.smithi148.stdout: "whoami": 1, 2024-09-19T07:10:35.327 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 24437, 2024-09-19T07:10:35.327 INFO:teuthology.orchestra.run.smithi148.stdout: "want_state": "up:active", 2024-09-19T07:10:35.327 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "up:active", 2024-09-19T07:10:35.327 INFO:teuthology.orchestra.run.smithi148.stdout: "fs_name": "cephfs", 2024-09-19T07:10:35.327 INFO:teuthology.orchestra.run.smithi148.stdout: "rank_uptime": 68.341531490999998, 2024-09-19T07:10:35.328 INFO:teuthology.orchestra.run.smithi148.stdout: "mdsmap_epoch": 24, 2024-09-19T07:10:35.328 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch": 80, 2024-09-19T07:10:35.328 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch_barrier": 78, 2024-09-19T07:10:35.328 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 85.586720572999994 2024-09-19T07:10:35.328 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:10:35.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.306+0000 7f4e53517640 1 -- 172.21.15.148:0/240237022 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f4e340a32d0 msgr2=0x7f4e340a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:35.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.306+0000 7f4e53517640 1 --2- 172.21.15.148:0/240237022 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f4e340a32d0 0x7f4e340a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c009fd0 tx=0x7f4e3c009800 comp rx=0 tx=0).stop 2024-09-19T07:10:35.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.306+0000 7f4e53517640 1 -- 172.21.15.148:0/240237022 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e4c100a80 msgr2=0x7f4e4c197360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:35.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.306+0000 7f4e53517640 1 --2- 172.21.15.148:0/240237022 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e4c100a80 0x7f4e4c197360 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4e44009230 tx=0x7f4e44004270 comp rx=0 tx=0).stop 2024-09-19T07:10:35.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.306+0000 7f4e53517640 1 -- 172.21.15.148:0/240237022 shutdown_connections 2024-09-19T07:10:35.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.306+0000 7f4e53517640 1 --2- 172.21.15.148:0/240237022 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f4e340a32d0 0x7f4e340a5790 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:35.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.306+0000 7f4e53517640 1 --2- 172.21.15.148:0/240237022 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e4c106a80 0x7f4e4c19bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:35.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.306+0000 7f4e53517640 1 --2- 172.21.15.148:0/240237022 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e4c101420 0x7f4e4c1978a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:35.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.307+0000 7f4e53517640 1 --2- 172.21.15.148:0/240237022 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e4c100a80 0x7f4e4c197360 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:35.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.307+0000 7f4e53517640 1 -- 172.21.15.148:0/240237022 >> 172.21.15.148:0/240237022 conn(0x7f4e4c0fc7a0 msgr2=0x7f4e4c0fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:35.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.307+0000 7f4e53517640 1 -- 172.21.15.148:0/240237022 shutdown_connections 2024-09-19T07:10:35.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:35.307+0000 7f4e53517640 1 -- 172.21.15.148:0/240237022 wait complete. 2024-09-19T07:10:35.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:35 smithi179 ceph-mon[35716]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T07:10:35.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:35 smithi148 ceph-mon[31180]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T07:10:35.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:35 smithi165 ceph-mon[35326]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T07:10:35.991 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T07:10:36.235 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:10:36.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.729+0000 7f54d2b3e640 1 -- 172.21.15.148:0/1330478993 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54cc102d40 msgr2=0x7f54cc103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:36.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.729+0000 7f54d2b3e640 1 --2- 172.21.15.148:0/1330478993 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54cc102d40 0x7f54cc103120 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f54b4009900 tx=0x7f54b402a480 comp rx=0 tx=0).stop 2024-09-19T07:10:36.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.729+0000 7f54d2b3e640 1 -- 172.21.15.148:0/1330478993 shutdown_connections 2024-09-19T07:10:36.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.729+0000 7f54d2b3e640 1 --2- 172.21.15.148:0/1330478993 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f54cc10c170 0x7f54cc10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:36.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.729+0000 7f54d2b3e640 1 --2- 172.21.15.148:0/1330478993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54cc103660 0x7f54cc10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:36.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.729+0000 7f54d2b3e640 1 --2- 172.21.15.148:0/1330478993 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54cc102d40 0x7f54cc103120 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:36.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.729+0000 7f54d2b3e640 1 -- 172.21.15.148:0/1330478993 >> 172.21.15.148:0/1330478993 conn(0x7f54cc0fc7a0 msgr2=0x7f54cc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:36.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.729+0000 7f54d2b3e640 1 -- 172.21.15.148:0/1330478993 shutdown_connections 2024-09-19T07:10:36.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.729+0000 7f54d2b3e640 1 -- 172.21.15.148:0/1330478993 wait complete. 2024-09-19T07:10:36.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.730+0000 7f54d2b3e640 1 Processor -- start 2024-09-19T07:10:36.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.730+0000 7f54d2b3e640 1 -- start start 2024-09-19T07:10:36.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.730+0000 7f54d2b3e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f54cc102d40 0x7f54cc1009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:36.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.730+0000 7f54d2b3e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54cc103660 0x7f54cc100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:36.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.730+0000 7f54d2b3e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54cc10c170 0x7f54cc101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:36.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.730+0000 7f54d2b3e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f54cc111f70 con 0x7f54cc103660 2024-09-19T07:10:36.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.730+0000 7f54d2b3e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f54cc111df0 con 0x7f54cc102d40 2024-09-19T07:10:36.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.730+0000 7f54d2b3e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f54cc1120f0 con 0x7f54cc10c170 2024-09-19T07:10:36.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.730+0000 7f54cbfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54cc103660 0x7f54cc100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:36.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.730+0000 7f54cbfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54cc103660 0x7f54cc100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60250/0 (socket says 172.21.15.148:60250) 2024-09-19T07:10:36.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.730+0000 7f54cbfff640 1 -- 172.21.15.148:0/3486300422 learned_addr learned my addr 172.21.15.148:0/3486300422 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:36.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.730+0000 7f54d10db640 1 --2- 172.21.15.148:0/3486300422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54cc10c170 0x7f54cc101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:36.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.730+0000 7f54d08da640 1 --2- 172.21.15.148:0/3486300422 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f54cc102d40 0x7f54cc1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:36.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.730+0000 7f54cbfff640 1 -- 172.21.15.148:0/3486300422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54cc10c170 msgr2=0x7f54cc101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:36.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.730+0000 7f54cbfff640 1 --2- 172.21.15.148:0/3486300422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54cc10c170 0x7f54cc101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:36.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.730+0000 7f54cbfff640 1 -- 172.21.15.148:0/3486300422 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f54cc102d40 msgr2=0x7f54cc1009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:36.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.730+0000 7f54cbfff640 1 --2- 172.21.15.148:0/3486300422 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f54cc102d40 0x7f54cc1009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:36.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.730+0000 7f54cbfff640 1 -- 172.21.15.148:0/3486300422 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54cc1a68f0 con 0x7f54cc103660 2024-09-19T07:10:36.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.730+0000 7f54cbfff640 1 --2- 172.21.15.148:0/3486300422 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54cc103660 0x7f54cc100ee0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f54bc00e9d0 tx=0x7f54bc00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:36.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.730+0000 7f54c9ffb640 1 -- 172.21.15.148:0/3486300422 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54bc00cd80 con 0x7f54cc103660 2024-09-19T07:10:36.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.731+0000 7f54d2b3e640 1 -- 172.21.15.148:0/3486300422 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54cc1a6be0 con 0x7f54cc103660 2024-09-19T07:10:36.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.731+0000 7f54c9ffb640 1 -- 172.21.15.148:0/3486300422 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54bc005020 con 0x7f54cc103660 2024-09-19T07:10:36.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.731+0000 7f54c9ffb640 1 -- 172.21.15.148:0/3486300422 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54bc0116d0 con 0x7f54cc103660 2024-09-19T07:10:36.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.731+0000 7f54d2b3e640 1 -- 172.21.15.148:0/3486300422 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54cc1a70d0 con 0x7f54cc103660 2024-09-19T07:10:36.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.733+0000 7f54c9ffb640 1 -- 172.21.15.148:0/3486300422 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f54bc005560 con 0x7f54cc103660 2024-09-19T07:10:36.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.733+0000 7f54d4f17740 1 Processor -- start 2024-09-19T07:10:36.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.733+0000 7f54d4f17740 1 -- start start 2024-09-19T07:10:36.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.734+0000 7f54d4f17740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641a49f99d0 0x5641a49f9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:36.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.734+0000 7f54c9ffb640 1 --2- 172.21.15.148:0/3486300422 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f54b80a32d0 0x7f54b80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:36.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.734+0000 7f54d4f17740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5641a49fa2f0 0x5641a4a04670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:36.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.734+0000 7f54d4f17740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5641a4a04bb0 0x5641a4a06fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:36.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.734+0000 7f54d4f17740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5641a4960090 con 0x5641a4a04bb0 2024-09-19T07:10:36.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.734+0000 7f54d4f17740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5641a4907a70 con 0x5641a49fa2f0 2024-09-19T07:10:36.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.734+0000 7f54d4f17740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5641a495c050 con 0x5641a49f99d0 2024-09-19T07:10:36.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.734+0000 7f54d08da640 1 --2- 172.21.15.148:0/3486300422 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f54b80a32d0 0x7f54b80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:36.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.734+0000 7f54d10db640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5641a4a04bb0 0x5641a4a06fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:36.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.734+0000 7f54d10db640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5641a4a04bb0 0x5641a4a06fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60262/0 (socket says 172.21.15.148:60262) 2024-09-19T07:10:36.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.734+0000 7f54d10db640 1 -- 172.21.15.148:0/3479809099 learned_addr learned my addr 172.21.15.148:0/3479809099 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:36.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.734+0000 7f54c9ffb640 1 -- 172.21.15.148:0/3486300422 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7f54bc0cfd00 con 0x7f54cc103660 2024-09-19T07:10:36.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.734+0000 7f54cbfff640 1 --2- 172.21.15.148:0/3479809099 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5641a49fa2f0 0x5641a4a04670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:36.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.734+0000 7f54d10db640 1 --2- 172.21.15.148:0/3479809099 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641a49f99d0 0x5641a49f9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:36.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.734+0000 7f54d10db640 1 -- 172.21.15.148:0/3479809099 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641a49f99d0 msgr2=0x5641a49f9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:10:36.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.734+0000 7f54d10db640 1 --2- 172.21.15.148:0/3479809099 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641a49f99d0 0x5641a49f9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:36.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.734+0000 7f54d10db640 1 -- 172.21.15.148:0/3479809099 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5641a49fa2f0 msgr2=0x5641a4a04670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:10:36.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.734+0000 7f54d10db640 1 --2- 172.21.15.148:0/3479809099 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5641a49fa2f0 0x5641a4a04670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:36.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.734+0000 7f54d10db640 1 -- 172.21.15.148:0/3479809099 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641a4914130 con 0x5641a4a04bb0 2024-09-19T07:10:36.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.734+0000 7f54d08da640 1 --2- 172.21.15.148:0/3486300422 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f54b80a32d0 0x7f54b80a5790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f54b4005ab0 tx=0x7f54b4005a20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:36.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.734+0000 7f54d10db640 1 --2- 172.21.15.148:0/3479809099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5641a4a04bb0 0x5641a4a06fa0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f54c4012510 tx=0x7f54c400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ae3c4cc338c9a62 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:36.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.734+0000 7f54c2ffd640 1 -- 172.21.15.148:0/3479809099 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c4005220 con 0x5641a4a04bb0 2024-09-19T07:10:36.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.735+0000 7f54c2ffd640 1 -- 172.21.15.148:0/3479809099 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54c4004c80 con 0x5641a4a04bb0 2024-09-19T07:10:36.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.735+0000 7f54c2ffd640 1 -- 172.21.15.148:0/3479809099 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c40108c0 con 0x5641a4a04bb0 2024-09-19T07:10:36.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.735+0000 7f54d4f17740 1 -- 172.21.15.148:0/3479809099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5641a4a04bb0 msgr2=0x5641a4a06fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:36.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.735+0000 7f54d4f17740 1 --2- 172.21.15.148:0/3479809099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5641a4a04bb0 0x5641a4a06fa0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f54c4012510 tx=0x7f54c400b6d0 comp rx=0 tx=0).stop 2024-09-19T07:10:36.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.735+0000 7f54d4f17740 1 -- 172.21.15.148:0/3479809099 shutdown_connections 2024-09-19T07:10:36.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.735+0000 7f54d4f17740 1 --2- 172.21.15.148:0/3479809099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5641a4a04bb0 0x5641a4a06fa0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:36.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.735+0000 7f54d4f17740 1 --2- 172.21.15.148:0/3479809099 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5641a49fa2f0 0x5641a4a04670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:36.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.735+0000 7f54d4f17740 1 --2- 172.21.15.148:0/3479809099 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641a49f99d0 0x5641a49f9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:36.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.735+0000 7f54d4f17740 1 -- 172.21.15.148:0/3479809099 >> 172.21.15.148:0/3479809099 conn(0x5641a49f5f60 msgr2=0x5641a49f6340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:36.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.735+0000 7f54d4f17740 1 -- 172.21.15.148:0/3479809099 shutdown_connections 2024-09-19T07:10:36.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.735+0000 7f54d4f17740 1 -- 172.21.15.148:0/3479809099 wait complete. 2024-09-19T07:10:36.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.736+0000 7f54d4f17740 1 -- start start 2024-09-19T07:10:36.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.736+0000 7f54d4f17740 1 Processor -- start 2024-09-19T07:10:36.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.736+0000 7f54d4f17740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5641a49f99d0 0x5641a4a04400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:36.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.736+0000 7f54d4f17740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5641a49fa2f0 0x5641a4a01750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:36.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.736+0000 7f54d4f17740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641a4a04bb0 0x5641a4a01c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:36.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.736+0000 7f54d4f17740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5641a4a07780 con 0x5641a49f99d0 2024-09-19T07:10:36.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.736+0000 7f54d4f17740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5641a491af20 con 0x5641a49fa2f0 2024-09-19T07:10:36.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.736+0000 7f54d4f17740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5641a4a07900 con 0x5641a4a04bb0 2024-09-19T07:10:36.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.736+0000 7f54d4f17740 10 client.0 _ll_register_callbacks cb 0x5641a48e4030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:10:36.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.736+0000 7f54d08da640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5641a49f99d0 0x5641a4a04400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:36.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.736+0000 7f54d08da640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5641a49f99d0 0x5641a4a04400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60276/0 (socket says 172.21.15.148:60276) 2024-09-19T07:10:36.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.736+0000 7f54d08da640 1 -- 172.21.15.148:0/3051569778 learned_addr learned my addr 172.21.15.148:0/3051569778 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:36.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.737+0000 7f54d10db640 1 --2- 172.21.15.148:0/3051569778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641a4a04bb0 0x5641a4a01c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:36.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.737+0000 7f54d08da640 1 -- 172.21.15.148:0/3051569778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641a4a04bb0 msgr2=0x5641a4a01c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:10:36.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.737+0000 7f54d08da640 1 --2- 172.21.15.148:0/3051569778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641a4a04bb0 0x5641a4a01c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:36.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.737+0000 7f54d08da640 1 -- 172.21.15.148:0/3051569778 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5641a49fa2f0 msgr2=0x5641a4a01750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:10:36.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.737+0000 7f54cbfff640 1 --2- 172.21.15.148:0/3051569778 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5641a49fa2f0 0x5641a4a01750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:36.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.737+0000 7f54d08da640 1 --2- 172.21.15.148:0/3051569778 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5641a49fa2f0 0x5641a4a01750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:36.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.737+0000 7f54d08da640 1 -- 172.21.15.148:0/3051569778 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641a46d12b0 con 0x5641a49f99d0 2024-09-19T07:10:36.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.737+0000 7f54cbfff640 1 --2- 172.21.15.148:0/3051569778 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5641a49fa2f0 0x5641a4a01750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:10:36.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.737+0000 7f54d08da640 1 --2- 172.21.15.148:0/3051569778 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5641a49f99d0 0x5641a4a04400 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f54b4033000 tx=0x7f54b4009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d08c41a58e2610bf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:36.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.737+0000 7f54abfff640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:10:36.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.737+0000 7f54abfff640 1 -- 172.21.15.148:0/3051569778 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b404b020 con 0x5641a49f99d0 2024-09-19T07:10:36.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.737+0000 7f54abfff640 1 -- 172.21.15.148:0/3051569778 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7f54b4005260 con 0x5641a49f99d0 2024-09-19T07:10:36.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.737+0000 7f54d4f17740 1 -- 172.21.15.148:0/3051569778 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54c4004c80 con 0x5641a49f99d0 2024-09-19T07:10:36.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.737+0000 7f54abfff640 1 -- 172.21.15.148:0/3051569778 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f54b4035050 con 0x5641a49f99d0 2024-09-19T07:10:36.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.737+0000 7f54d4f17740 10 client.14982 fetch_fsmap learned FSMap version 24 2024-09-19T07:10:36.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.737+0000 7f54d4f17740 1 -- 172.21.15.148:0/3051569778 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5641a4a13050 con 0x5641a49f99d0 2024-09-19T07:10:36.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.737+0000 7f54abfff640 1 -- 172.21.15.148:0/3051569778 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54c4004c80 con 0x5641a49f99d0 2024-09-19T07:10:36.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.737+0000 7f54abfff640 1 -- 172.21.15.148:0/3051569778 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f54b4003680 con 0x5641a49f99d0 2024-09-19T07:10:36.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.738+0000 7f54d4f17740 10 client.14982 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:10:36.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.738+0000 7f54d4f17740 10 client.14982 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T07:10:36.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.738+0000 7f54d4f17740 20 client.14982 populate_metadata read hostname 'smithi148' 2024-09-19T07:10:36.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.738+0000 7f54d4f17740 1 --2- 172.21.15.148:0/3051569778 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5641a4a15640 0x5641a4a16ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:36.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.738+0000 7f54d4f17740 4 client.14982 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:10:36.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.738+0000 7f54d4f17740 1 -- 172.21.15.148:0/3051569778 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5641a496d600 con 0x5641a4a15640 2024-09-19T07:10:36.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.738+0000 7f54cbfff640 1 --2- 172.21.15.148:0/3051569778 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5641a4a15640 0x5641a4a16ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:36.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.738+0000 7f54abfff640 10 client.14982 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:10:36.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.738+0000 7f54cbfff640 1 --2- 172.21.15.148:0/3051569778 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5641a4a15640 0x5641a4a16ab0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af93c19b5ccb8c7 server_cookie=68b980c53285fd5 in_seq=0 out_seq=0 2024-09-19T07:10:36.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.739+0000 7f54abfff640 1 -- 172.21.15.148:0/3051569778 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5641a496d600 con 0x5641a4a15640 2024-09-19T07:10:36.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.739+0000 7f54abfff640 10 client.14982 handle_command_reply: tid=0 2024-09-19T07:10:36.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.739+0000 7f54d4f17740 1 client.14982 shutdown 2024-09-19T07:10:36.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.739+0000 7f54d4f17740 1 -- 172.21.15.148:0/3051569778 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5641a49f99d0 msgr2=0x5641a4a04400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:36.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.739+0000 7f54d4f17740 1 --2- 172.21.15.148:0/3051569778 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5641a49f99d0 0x5641a4a04400 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f54b4033000 tx=0x7f54b4009260 comp rx=0 tx=0).stop 2024-09-19T07:10:36.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.739+0000 7f54d4f17740 1 -- 172.21.15.148:0/3051569778 shutdown_connections 2024-09-19T07:10:36.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.739+0000 7f54d4f17740 1 --2- 172.21.15.148:0/3051569778 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5641a4a15640 0x5641a4a16ab0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:36.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.739+0000 7f54d4f17740 1 --2- 172.21.15.148:0/3051569778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641a4a04bb0 0x5641a4a01c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:36.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.739+0000 7f54d4f17740 1 --2- 172.21.15.148:0/3051569778 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5641a49fa2f0 0x5641a4a01750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:36.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.739+0000 7f54d4f17740 1 --2- 172.21.15.148:0/3051569778 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5641a49f99d0 0x5641a4a04400 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:36.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.739+0000 7f54abfff640 0 client.14982 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:10:36.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.739+0000 7f54d4f17740 1 -- 172.21.15.148:0/3051569778 >> 172.21.15.148:0/3051569778 conn(0x5641a49f5f60 msgr2=0x5641a49fbc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:36.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.739+0000 7f54d4f17740 1 -- 172.21.15.148:0/3051569778 shutdown_connections 2024-09-19T07:10:36.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.739+0000 7f54d4f17740 1 -- 172.21.15.148:0/3051569778 wait complete. 2024-09-19T07:10:36.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.739+0000 7f54d4f17740 20 client.14982 trim_cache size 0 max 16384 2024-09-19T07:10:36.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.757+0000 7f54d4f17740 1 Processor -- start 2024-09-19T07:10:36.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.757+0000 7f54d4f17740 1 -- start start 2024-09-19T07:10:36.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.757+0000 7f54d4f17740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5641a49f99d0 0x5641a4a16ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:36.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.757+0000 7f54d4f17740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5641a49fa2f0 0x5641a4a1ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:36.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.757+0000 7f54d4f17740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641a4a04bb0 0x5641a4a1f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:36.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.757+0000 7f54d4f17740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5641a4a14df0 con 0x5641a49f99d0 2024-09-19T07:10:36.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.757+0000 7f54d4f17740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5641a4a154c0 con 0x5641a49fa2f0 2024-09-19T07:10:36.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.757+0000 7f54d4f17740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5641a4a15b90 con 0x5641a4a04bb0 2024-09-19T07:10:36.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.757+0000 7f54d08da640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5641a49f99d0 0x5641a4a16ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:36.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.757+0000 7f54d08da640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5641a49f99d0 0x5641a4a16ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60278/0 (socket says 172.21.15.148:60278) 2024-09-19T07:10:36.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.757+0000 7f54d08da640 1 -- 172.21.15.148:0/286449898 learned_addr learned my addr 172.21.15.148:0/286449898 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:36.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.757+0000 7f54d10db640 1 --2- 172.21.15.148:0/286449898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641a4a04bb0 0x5641a4a1f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:36.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.757+0000 7f54d08da640 1 -- 172.21.15.148:0/286449898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641a4a04bb0 msgr2=0x5641a4a1f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:10:36.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.757+0000 7f54d08da640 1 --2- 172.21.15.148:0/286449898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641a4a04bb0 0x5641a4a1f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:36.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.757+0000 7f54d08da640 1 -- 172.21.15.148:0/286449898 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5641a49fa2f0 msgr2=0x5641a4a1ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:10:36.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.757+0000 7f54cbfff640 1 --2- 172.21.15.148:0/286449898 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5641a49fa2f0 0x5641a4a1ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:36.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.757+0000 7f54d08da640 1 --2- 172.21.15.148:0/286449898 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5641a49fa2f0 0x5641a4a1ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:36.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.757+0000 7f54d08da640 1 -- 172.21.15.148:0/286449898 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641a4a04770 con 0x5641a49f99d0 2024-09-19T07:10:36.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.757+0000 7f54d08da640 1 --2- 172.21.15.148:0/286449898 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5641a49f99d0 0x5641a4a16ab0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f54b402a9a0 tx=0x7f54b4032cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b900cfcce4aad10 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:36.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.758+0000 7f54c27fc640 1 -- 172.21.15.148:0/286449898 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b404b070 con 0x5641a49f99d0 2024-09-19T07:10:36.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.758+0000 7f54c27fc640 1 -- 172.21.15.148:0/286449898 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54b40035f0 con 0x5641a49f99d0 2024-09-19T07:10:36.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.758+0000 7f54c27fc640 1 -- 172.21.15.148:0/286449898 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b4047490 con 0x5641a49f99d0 2024-09-19T07:10:36.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.758+0000 7f54d4f17740 1 -- 172.21.15.148:0/286449898 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5641a49f99d0 msgr2=0x5641a4a16ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:36.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.758+0000 7f54d4f17740 1 --2- 172.21.15.148:0/286449898 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5641a49f99d0 0x5641a4a16ab0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f54b402a9a0 tx=0x7f54b4032cb0 comp rx=0 tx=0).stop 2024-09-19T07:10:36.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.758+0000 7f54d4f17740 1 -- 172.21.15.148:0/286449898 shutdown_connections 2024-09-19T07:10:36.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.758+0000 7f54d4f17740 1 --2- 172.21.15.148:0/286449898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641a4a04bb0 0x5641a4a1f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:36.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.758+0000 7f54d4f17740 1 --2- 172.21.15.148:0/286449898 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5641a49fa2f0 0x5641a4a1ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:36.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.758+0000 7f54d4f17740 1 --2- 172.21.15.148:0/286449898 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5641a49f99d0 0x5641a4a16ab0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:36.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.758+0000 7f54d4f17740 1 -- 172.21.15.148:0/286449898 >> 172.21.15.148:0/286449898 conn(0x5641a49f5f60 msgr2=0x5641a49fcd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:36.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.758+0000 7f54d4f17740 1 -- 172.21.15.148:0/286449898 shutdown_connections 2024-09-19T07:10:36.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.758+0000 7f54d4f17740 1 -- 172.21.15.148:0/286449898 wait complete. 2024-09-19T07:10:36.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.758+0000 7f54d4f17740 1 -- start start 2024-09-19T07:10:36.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.759+0000 7f54d4f17740 1 Processor -- start 2024-09-19T07:10:36.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.759+0000 7f54d4f17740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5641a49f99d0 0x5641a4a1f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:36.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.759+0000 7f54d4f17740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641a49fa2f0 0x5641a4a1a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:36.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.759+0000 7f54d4f17740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5641a4a04bb0 0x5641a4a1aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:36.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.759+0000 7f54d4f17740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5641a4a16930 con 0x5641a49f99d0 2024-09-19T07:10:36.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.759+0000 7f54d4f17740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5641a4a16260 con 0x5641a4a04bb0 2024-09-19T07:10:36.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.759+0000 7f54d4f17740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5641a4a17000 con 0x5641a49fa2f0 2024-09-19T07:10:36.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.759+0000 7f54d4f17740 10 client.0 _ll_register_callbacks cb 0x7f54b403f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:10:36.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.759+0000 7f54d08da640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5641a49f99d0 0x5641a4a1f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:36.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.759+0000 7f54d08da640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5641a49f99d0 0x5641a4a1f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60286/0 (socket says 172.21.15.148:60286) 2024-09-19T07:10:36.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.759+0000 7f54d08da640 1 -- 172.21.15.148:0/1964885666 learned_addr learned my addr 172.21.15.148:0/1964885666 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:36.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.759+0000 7f54cbfff640 1 --2- 172.21.15.148:0/1964885666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641a49fa2f0 0x5641a4a1a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:36.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.759+0000 7f54d10db640 1 --2- 172.21.15.148:0/1964885666 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5641a4a04bb0 0x5641a4a1aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:36.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.759+0000 7f54d08da640 1 -- 172.21.15.148:0/1964885666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641a49fa2f0 msgr2=0x5641a4a1a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:10:36.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.759+0000 7f54d08da640 1 --2- 172.21.15.148:0/1964885666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641a49fa2f0 0x5641a4a1a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:36.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.759+0000 7f54d08da640 1 -- 172.21.15.148:0/1964885666 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5641a4a04bb0 msgr2=0x5641a4a1aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:10:36.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.759+0000 7f54d08da640 1 --2- 172.21.15.148:0/1964885666 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5641a4a04bb0 0x5641a4a1aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:36.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.759+0000 7f54d08da640 1 -- 172.21.15.148:0/1964885666 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641a4a1af70 con 0x5641a49f99d0 2024-09-19T07:10:36.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.759+0000 7f54cbfff640 1 --2- 172.21.15.148:0/1964885666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641a49fa2f0 0x5641a4a1a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:10:36.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.760+0000 7f54d08da640 1 --2- 172.21.15.148:0/1964885666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5641a49f99d0 0x5641a4a1f1c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f54b40096c0 tx=0x7f54b4009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d2292a85d0b6037 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:36.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.760+0000 7f54abfff640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:10:36.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.760+0000 7f54abfff640 1 -- 172.21.15.148:0/1964885666 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b4069060 con 0x5641a49f99d0 2024-09-19T07:10:36.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.760+0000 7f54abfff640 1 -- 172.21.15.148:0/1964885666 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7f54b4005460 con 0x5641a49f99d0 2024-09-19T07:10:36.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.760+0000 7f54d4f17740 1 -- 172.21.15.148:0/1964885666 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54b40035f0 con 0x5641a49f99d0 2024-09-19T07:10:36.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.760+0000 7f54abfff640 1 -- 172.21.15.148:0/1964885666 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f54b404b040 con 0x5641a49f99d0 2024-09-19T07:10:36.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.760+0000 7f54d4f17740 10 client.14988 fetch_fsmap learned FSMap version 24 2024-09-19T07:10:36.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.760+0000 7f54d4f17740 1 -- 172.21.15.148:0/1964885666 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5641a4a7fa40 con 0x5641a49f99d0 2024-09-19T07:10:36.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.760+0000 7f54abfff640 1 -- 172.21.15.148:0/1964885666 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54b40035f0 con 0x5641a49f99d0 2024-09-19T07:10:36.782 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:10:36.782 INFO:teuthology.orchestra.run.smithi148.stdout: "cluster_fsid": "eae8a4a8-7654-11ef-bceb-c7b262605968", 2024-09-19T07:10:36.782 INFO:teuthology.orchestra.run.smithi148.stdout: "whoami": 0, 2024-09-19T07:10:36.782 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 24457, 2024-09-19T07:10:36.783 INFO:teuthology.orchestra.run.smithi148.stdout: "want_state": "up:active", 2024-09-19T07:10:36.783 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "up:active", 2024-09-19T07:10:36.783 INFO:teuthology.orchestra.run.smithi148.stdout: "fs_name": "cephfs", 2024-09-19T07:10:36.783 INFO:teuthology.orchestra.run.smithi148.stdout: "rank_uptime": 76.841938314999993, 2024-09-19T07:10:36.783 INFO:teuthology.orchestra.run.smithi148.stdout: "mdsmap_epoch": 24, 2024-09-19T07:10:36.783 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch": 80, 2024-09-19T07:10:36.783 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch_barrier": 78, 2024-09-19T07:10:36.783 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 95.700840006999996 2024-09-19T07:10:36.783 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:10:36.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.760+0000 7f54abfff640 1 -- 172.21.15.148:0/1964885666 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f54b405b4c0 con 0x5641a49f99d0 2024-09-19T07:10:36.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.760+0000 7f54d4f17740 10 client.14988 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:10:36.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.760+0000 7f54d4f17740 10 client.14988 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T07:10:36.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.760+0000 7f54d4f17740 20 client.14988 populate_metadata read hostname 'smithi148' 2024-09-19T07:10:36.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.760+0000 7f54d4f17740 1 --2- 172.21.15.148:0/1964885666 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5641a4a15640 0x5641a4a82f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:36.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.760+0000 7f54d4f17740 4 client.14988 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T07:10:36.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.760+0000 7f54d4f17740 1 -- 172.21.15.148:0/1964885666 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "status"}) -- 0x5641a4967b10 con 0x5641a4a15640 2024-09-19T07:10:36.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.760+0000 7f54cbfff640 1 --2- 172.21.15.148:0/1964885666 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5641a4a15640 0x5641a4a82f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:36.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.761+0000 7f54abfff640 10 client.14988 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:10:36.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.761+0000 7f54cbfff640 1 --2- 172.21.15.148:0/1964885666 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5641a4a15640 0x5641a4a82f10 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c086163cc426b8f5 server_cookie=fc5ddf047c4599cd in_seq=0 out_seq=0 2024-09-19T07:10:36.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.761+0000 7f54abfff640 1 -- 172.21.15.148:0/1964885666 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5641a4967b10 con 0x5641a4a15640 2024-09-19T07:10:36.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.761+0000 7f54abfff640 10 client.14988 handle_command_reply: tid=0 2024-09-19T07:10:36.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.761+0000 7f54d4f17740 1 client.14988 shutdown 2024-09-19T07:10:36.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.761+0000 7f54d4f17740 1 -- 172.21.15.148:0/1964885666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5641a49f99d0 msgr2=0x5641a4a1f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:36.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.761+0000 7f54d4f17740 1 --2- 172.21.15.148:0/1964885666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5641a49f99d0 0x5641a4a1f1c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f54b40096c0 tx=0x7f54b4009260 comp rx=0 tx=0).stop 2024-09-19T07:10:36.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.761+0000 7f54d4f17740 1 -- 172.21.15.148:0/1964885666 shutdown_connections 2024-09-19T07:10:36.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.761+0000 7f54d4f17740 1 --2- 172.21.15.148:0/1964885666 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5641a4a15640 0x5641a4a82f10 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:36.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.761+0000 7f54d4f17740 1 --2- 172.21.15.148:0/1964885666 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5641a4a04bb0 0x5641a4a1aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:36.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.761+0000 7f54d4f17740 1 --2- 172.21.15.148:0/1964885666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641a49fa2f0 0x5641a4a1a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:36.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.761+0000 7f54d4f17740 1 --2- 172.21.15.148:0/1964885666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5641a49f99d0 0x5641a4a1f1c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:36.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.761+0000 7f54abfff640 0 client.14988 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:10:36.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.761+0000 7f54d4f17740 1 -- 172.21.15.148:0/1964885666 >> 172.21.15.148:0/1964885666 conn(0x5641a49f5f60 msgr2=0x5641a49fb420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:36.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.761+0000 7f54d4f17740 1 -- 172.21.15.148:0/1964885666 shutdown_connections 2024-09-19T07:10:36.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.761+0000 7f54d4f17740 1 -- 172.21.15.148:0/1964885666 wait complete. 2024-09-19T07:10:36.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.762+0000 7f54d4f17740 20 client.14988 trim_cache size 0 max 16384 2024-09-19T07:10:36.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.762+0000 7f54d2b3e640 1 -- 172.21.15.148:0/3486300422 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f54b80a32d0 msgr2=0x7f54b80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:36.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.762+0000 7f54d2b3e640 1 --2- 172.21.15.148:0/3486300422 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f54b80a32d0 0x7f54b80a5790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f54b4005ab0 tx=0x7f54b4005a20 comp rx=0 tx=0).stop 2024-09-19T07:10:36.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.762+0000 7f54d2b3e640 1 -- 172.21.15.148:0/3486300422 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54cc103660 msgr2=0x7f54cc100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:36.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.762+0000 7f54d2b3e640 1 --2- 172.21.15.148:0/3486300422 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54cc103660 0x7f54cc100ee0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f54bc00e9d0 tx=0x7f54bc00ee90 comp rx=0 tx=0).stop 2024-09-19T07:10:36.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.762+0000 7f54d2b3e640 1 -- 172.21.15.148:0/3486300422 shutdown_connections 2024-09-19T07:10:36.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.762+0000 7f54d2b3e640 1 --2- 172.21.15.148:0/3486300422 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f54b80a32d0 0x7f54b80a5790 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:36.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.762+0000 7f54d2b3e640 1 --2- 172.21.15.148:0/3486300422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54cc10c170 0x7f54cc101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:36.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.762+0000 7f54d2b3e640 1 --2- 172.21.15.148:0/3486300422 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54cc103660 0x7f54cc100ee0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:36.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.762+0000 7f54d2b3e640 1 --2- 172.21.15.148:0/3486300422 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f54cc102d40 0x7f54cc1009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:36.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.762+0000 7f54d2b3e640 1 -- 172.21.15.148:0/3486300422 >> 172.21.15.148:0/3486300422 conn(0x7f54cc0fc7a0 msgr2=0x7f54cc0fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:36.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.762+0000 7f54d2b3e640 1 -- 172.21.15.148:0/3486300422 shutdown_connections 2024-09-19T07:10:36.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:36.762+0000 7f54d2b3e640 1 -- 172.21.15.148:0/3486300422 wait complete. 2024-09-19T07:10:37.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:37 smithi148 ceph-mon[31180]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:10:37.498 INFO:tasks.cephadm:Setup complete, yielding 2024-09-19T07:10:37.498 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T07:10:37.511 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi148.front.sepia.ceph.com 2024-09-19T07:10:37.512 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-19T07:10:37.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:37 smithi179 ceph-mon[35716]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:10:37.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:37 smithi165 ceph-mon[35326]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:10:37.760 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:10:38.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.213+0000 7f8d9158b640 1 -- 172.21.15.148:0/3524656915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d8c100d80 msgr2=0x7f8d8c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:38.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.213+0000 7f8d9158b640 1 --2- 172.21.15.148:0/3524656915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d8c100d80 0x7f8d8c101200 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8d74009900 tx=0x7f8d7402a410 comp rx=0 tx=0).stop 2024-09-19T07:10:38.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.213+0000 7f8d9158b640 1 -- 172.21.15.148:0/3524656915 shutdown_connections 2024-09-19T07:10:38.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.213+0000 7f8d9158b640 1 --2- 172.21.15.148:0/3524656915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d8c101740 0x7f8d8c108fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:38.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.213+0000 7f8d9158b640 1 --2- 172.21.15.148:0/3524656915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d8c100d80 0x7f8d8c101200 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:38.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.213+0000 7f8d9158b640 1 --2- 172.21.15.148:0/3524656915 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d8c102120 0x7f8d8c102520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:38.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.213+0000 7f8d9158b640 1 -- 172.21.15.148:0/3524656915 >> 172.21.15.148:0/3524656915 conn(0x7f8d8c0fba40 msgr2=0x7f8d8c0fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:38.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.213+0000 7f8d9158b640 1 -- 172.21.15.148:0/3524656915 shutdown_connections 2024-09-19T07:10:38.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.213+0000 7f8d9158b640 1 -- 172.21.15.148:0/3524656915 wait complete. 2024-09-19T07:10:38.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.213+0000 7f8d9158b640 1 Processor -- start 2024-09-19T07:10:38.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.213+0000 7f8d9158b640 1 -- start start 2024-09-19T07:10:38.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.214+0000 7f8d9158b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d8c100d80 0x7f8d8c198170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:38.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.214+0000 7f8d9158b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d8c101740 0x7f8d8c1986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:38.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.214+0000 7f8d9158b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d8c102120 0x7f8d8c19f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:38.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.214+0000 7f8d9158b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8d8c10d9c0 con 0x7f8d8c100d80 2024-09-19T07:10:38.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.214+0000 7f8d9158b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8d8c10d840 con 0x7f8d8c101740 2024-09-19T07:10:38.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.214+0000 7f8d9158b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8d8c10db40 con 0x7f8d8c102120 2024-09-19T07:10:38.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.214+0000 7f8d8affd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d8c100d80 0x7f8d8c198170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:38.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.214+0000 7f8d8affd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d8c100d80 0x7f8d8c198170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60312/0 (socket says 172.21.15.148:60312) 2024-09-19T07:10:38.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.214+0000 7f8d8affd640 1 -- 172.21.15.148:0/3952839370 learned_addr learned my addr 172.21.15.148:0/3952839370 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:38.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.214+0000 7f8d8b7fe640 1 --2- 172.21.15.148:0/3952839370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d8c102120 0x7f8d8c19f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:38.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.214+0000 7f8d83fff640 1 --2- 172.21.15.148:0/3952839370 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d8c101740 0x7f8d8c1986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:38.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.214+0000 7f8d8affd640 1 -- 172.21.15.148:0/3952839370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d8c102120 msgr2=0x7f8d8c19f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:38.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.214+0000 7f8d8affd640 1 --2- 172.21.15.148:0/3952839370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d8c102120 0x7f8d8c19f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:38.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.214+0000 7f8d8affd640 1 -- 172.21.15.148:0/3952839370 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d8c101740 msgr2=0x7f8d8c1986b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:38.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.214+0000 7f8d8affd640 1 --2- 172.21.15.148:0/3952839370 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d8c101740 0x7f8d8c1986b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:38.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.214+0000 7f8d8affd640 1 -- 172.21.15.148:0/3952839370 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d8c19fda0 con 0x7f8d8c100d80 2024-09-19T07:10:38.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.214+0000 7f8d83fff640 1 --2- 172.21.15.148:0/3952839370 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d8c101740 0x7f8d8c1986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:10:38.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.214+0000 7f8d8affd640 1 --2- 172.21.15.148:0/3952839370 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d8c100d80 0x7f8d8c198170 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c00b450 tx=0x7f8d7c00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:38.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.214+0000 7f8d88ff9640 1 -- 172.21.15.148:0/3952839370 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c015020 con 0x7f8d8c100d80 2024-09-19T07:10:38.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.214+0000 7f8d88ff9640 1 -- 172.21.15.148:0/3952839370 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d7c011d70 con 0x7f8d8c100d80 2024-09-19T07:10:38.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.214+0000 7f8d9158b640 1 -- 172.21.15.148:0/3952839370 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d8c1a0090 con 0x7f8d8c100d80 2024-09-19T07:10:38.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.214+0000 7f8d88ff9640 1 -- 172.21.15.148:0/3952839370 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c00f340 con 0x7f8d8c100d80 2024-09-19T07:10:38.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.214+0000 7f8d9158b640 1 -- 172.21.15.148:0/3952839370 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d8c1a0650 con 0x7f8d8c100d80 2024-09-19T07:10:38.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.215+0000 7f8d9158b640 1 -- 172.21.15.148:0/3952839370 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d8c1080a0 con 0x7f8d8c100d80 2024-09-19T07:10:38.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.216+0000 7f8d88ff9640 1 -- 172.21.15.148:0/3952839370 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f8d7c018020 con 0x7f8d8c100d80 2024-09-19T07:10:38.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.217+0000 7f8d88ff9640 1 --2- 172.21.15.148:0/3952839370 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f8d780a3300 0x7f8d780a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:38.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.217+0000 7f8d83fff640 1 --2- 172.21.15.148:0/3952839370 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f8d780a3300 0x7f8d780a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:38.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.217+0000 7f8d88ff9640 1 -- 172.21.15.148:0/3952839370 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7f8d7c0cf4a0 con 0x7f8d8c100d80 2024-09-19T07:10:38.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.218+0000 7f8d83fff640 1 --2- 172.21.15.148:0/3952839370 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f8d780a3300 0x7f8d780a57c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8d74000c00 tx=0x7f8d74009560 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:38.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.221+0000 7f8d88ff9640 1 -- 172.21.15.148:0/3952839370 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8d7c01f020 con 0x7f8d8c100d80 2024-09-19T07:10:38.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.404+0000 7f8d9158b640 1 -- 172.21.15.148:0/3952839370 --> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f8d8c062630 con 0x7f8d780a3300 2024-09-19T07:10:38.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.405+0000 7f8d88ff9640 1 -- 172.21.15.148:0/3952839370 <== mgr.14148 v2:172.21.15.148:6800/3007822654 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f8d8c062630 con 0x7f8d780a3300 2024-09-19T07:10:38.406 INFO:teuthology.orchestra.run.smithi148.stdout:Backend: cephadm 2024-09-19T07:10:38.406 INFO:teuthology.orchestra.run.smithi148.stdout:Available: Yes 2024-09-19T07:10:38.406 INFO:teuthology.orchestra.run.smithi148.stdout:Paused: No 2024-09-19T07:10:38.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.407+0000 7f8d9158b640 1 -- 172.21.15.148:0/3952839370 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f8d780a3300 msgr2=0x7f8d780a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:38.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.407+0000 7f8d9158b640 1 --2- 172.21.15.148:0/3952839370 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f8d780a3300 0x7f8d780a57c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8d74000c00 tx=0x7f8d74009560 comp rx=0 tx=0).stop 2024-09-19T07:10:38.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.407+0000 7f8d9158b640 1 -- 172.21.15.148:0/3952839370 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d8c100d80 msgr2=0x7f8d8c198170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:38.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.407+0000 7f8d9158b640 1 --2- 172.21.15.148:0/3952839370 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d8c100d80 0x7f8d8c198170 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c00b450 tx=0x7f8d7c00b910 comp rx=0 tx=0).stop 2024-09-19T07:10:38.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.407+0000 7f8d9158b640 1 -- 172.21.15.148:0/3952839370 shutdown_connections 2024-09-19T07:10:38.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.407+0000 7f8d9158b640 1 --2- 172.21.15.148:0/3952839370 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f8d780a3300 0x7f8d780a57c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:38.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.407+0000 7f8d9158b640 1 --2- 172.21.15.148:0/3952839370 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d8c102120 0x7f8d8c19f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:38.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.407+0000 7f8d9158b640 1 --2- 172.21.15.148:0/3952839370 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d8c101740 0x7f8d8c1986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:38.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.407+0000 7f8d9158b640 1 --2- 172.21.15.148:0/3952839370 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d8c100d80 0x7f8d8c198170 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:38.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.407+0000 7f8d9158b640 1 -- 172.21.15.148:0/3952839370 >> 172.21.15.148:0/3952839370 conn(0x7f8d8c0fba40 msgr2=0x7f8d8c105270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:38.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.407+0000 7f8d9158b640 1 -- 172.21.15.148:0/3952839370 shutdown_connections 2024-09-19T07:10:38.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:38.407+0000 7f8d9158b640 1 -- 172.21.15.148:0/3952839370 wait complete. 2024-09-19T07:10:39.140 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-19T07:10:39.390 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:10:39.511 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:39 smithi148 ceph-mon[31180]: from='client.14994 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:10:39.511 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:39 smithi148 ceph-mon[31180]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:10:39.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:39 smithi179 ceph-mon[35716]: from='client.14994 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:10:39.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:39 smithi179 ceph-mon[35716]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:10:39.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:39 smithi165 ceph-mon[35326]: from='client.14994 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:10:39.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:39 smithi165 ceph-mon[35326]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:10:39.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:39.894+0000 7fa6fabd3640 1 -- 172.21.15.148:0/2661219812 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6f4100ad0 msgr2=0x7fa6f4100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:39.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:39.894+0000 7fa6fabd3640 1 --2- 172.21.15.148:0/2661219812 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6f4100ad0 0x7fa6f4100ed0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa6e8009900 tx=0x7fa6e802a410 comp rx=0 tx=0).stop 2024-09-19T07:10:39.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:39.895+0000 7fa6fabd3640 1 -- 172.21.15.148:0/2661219812 shutdown_connections 2024-09-19T07:10:39.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:39.895+0000 7fa6fabd3640 1 --2- 172.21.15.148:0/2661219812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6f4102690 0x7fa6f4108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:39.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:39.895+0000 7fa6fabd3640 1 --2- 172.21.15.148:0/2661219812 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6f4101cd0 0x7fa6f4102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:39.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:39.895+0000 7fa6fabd3640 1 --2- 172.21.15.148:0/2661219812 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6f4100ad0 0x7fa6f4100ed0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:39.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:39.895+0000 7fa6fabd3640 1 -- 172.21.15.148:0/2661219812 >> 172.21.15.148:0/2661219812 conn(0x7fa6f40fc280 msgr2=0x7fa6f40fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:39.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:39.895+0000 7fa6fabd3640 1 -- 172.21.15.148:0/2661219812 shutdown_connections 2024-09-19T07:10:39.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:39.895+0000 7fa6fabd3640 1 -- 172.21.15.148:0/2661219812 wait complete. 2024-09-19T07:10:39.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:39.895+0000 7fa6fabd3640 1 Processor -- start 2024-09-19T07:10:39.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:39.895+0000 7fa6fabd3640 1 -- start start 2024-09-19T07:10:39.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:39.895+0000 7fa6fabd3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6f4100ad0 0x7fa6f4104a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:39.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:39.895+0000 7fa6fabd3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6f4101cd0 0x7fa6f41030b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:39.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:39.895+0000 7fa6fabd3640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6f4102690 0x7fa6f41035f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:39.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:39.895+0000 7fa6fabd3640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f410c7b0 con 0x7fa6f4100ad0 2024-09-19T07:10:39.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:39.895+0000 7fa6fabd3640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f410c630 con 0x7fa6f4102690 2024-09-19T07:10:39.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:39.895+0000 7fa6fabd3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f410c930 con 0x7fa6f4101cd0 2024-09-19T07:10:39.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:39.895+0000 7fa6f896f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6f4100ad0 0x7fa6f4104a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:39.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:39.895+0000 7fa6f896f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6f4100ad0 0x7fa6f4104a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60318/0 (socket says 172.21.15.148:60318) 2024-09-19T07:10:39.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:39.895+0000 7fa6f896f640 1 -- 172.21.15.148:0/2601139115 learned_addr learned my addr 172.21.15.148:0/2601139115 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:39.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:39.896+0000 7fa6f3fff640 1 --2- 172.21.15.148:0/2601139115 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6f4101cd0 0x7fa6f41030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:39.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:39.896+0000 7fa6f9170640 1 --2- 172.21.15.148:0/2601139115 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6f4102690 0x7fa6f41035f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:39.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:39.896+0000 7fa6f896f640 1 -- 172.21.15.148:0/2601139115 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6f4101cd0 msgr2=0x7fa6f41030b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:39.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:39.896+0000 7fa6f896f640 1 --2- 172.21.15.148:0/2601139115 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6f4101cd0 0x7fa6f41030b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:39.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:39.896+0000 7fa6f896f640 1 -- 172.21.15.148:0/2601139115 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6f4102690 msgr2=0x7fa6f41035f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:39.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:39.896+0000 7fa6f896f640 1 --2- 172.21.15.148:0/2601139115 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6f4102690 0x7fa6f41035f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:39.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:39.896+0000 7fa6f896f640 1 -- 172.21.15.148:0/2601139115 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6f4103eb0 con 0x7fa6f4100ad0 2024-09-19T07:10:39.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:39.896+0000 7fa6f9170640 1 --2- 172.21.15.148:0/2601139115 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6f4102690 0x7fa6f41035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:10:39.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:39.896+0000 7fa6f896f640 1 --2- 172.21.15.148:0/2601139115 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6f4100ad0 0x7fa6f4104a60 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa6e8031610 tx=0x7fa6e80043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:39.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:39.896+0000 7fa6f1ffb640 1 -- 172.21.15.148:0/2601139115 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e803f030 con 0x7fa6f4100ad0 2024-09-19T07:10:39.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:39.896+0000 7fa6f1ffb640 1 -- 172.21.15.148:0/2601139115 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6e8003ce0 con 0x7fa6f4100ad0 2024-09-19T07:10:39.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:39.896+0000 7fa6fabd3640 1 -- 172.21.15.148:0/2601139115 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6f41a2020 con 0x7fa6f4100ad0 2024-09-19T07:10:39.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:39.896+0000 7fa6f1ffb640 1 -- 172.21.15.148:0/2601139115 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e8035070 con 0x7fa6f4100ad0 2024-09-19T07:10:39.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:39.896+0000 7fa6fabd3640 1 -- 172.21.15.148:0/2601139115 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6f41a2550 con 0x7fa6f4100ad0 2024-09-19T07:10:39.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:39.897+0000 7fa6fabd3640 1 -- 172.21.15.148:0/2601139115 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6f41a2780 con 0x7fa6f4100ad0 2024-09-19T07:10:39.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:39.898+0000 7fa6f1ffb640 1 -- 172.21.15.148:0/2601139115 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fa6e8042030 con 0x7fa6f4100ad0 2024-09-19T07:10:39.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:39.899+0000 7fa6f1ffb640 1 --2- 172.21.15.148:0/2601139115 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fa6e40a32d0 0x7fa6e40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:39.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:39.899+0000 7fa6f3fff640 1 --2- 172.21.15.148:0/2601139115 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fa6e40a32d0 0x7fa6e40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:39.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:39.899+0000 7fa6f1ffb640 1 -- 172.21.15.148:0/2601139115 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7fa6e80f0380 con 0x7fa6f4100ad0 2024-09-19T07:10:39.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:39.900+0000 7fa6f3fff640 1 --2- 172.21.15.148:0/2601139115 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fa6e40a32d0 0x7fa6e40a5790 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa6f41047e0 tx=0x7fa6e0009110 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:39.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:39.902+0000 7fa6f1ffb640 1 -- 172.21.15.148:0/2601139115 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa6e80bcef0 con 0x7fa6f4100ad0 2024-09-19T07:10:40.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:40.079+0000 7fa6fabd3640 1 -- 172.21.15.148:0/2601139115 --> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fa6f406a6b0 con 0x7fa6e40a32d0 2024-09-19T07:10:40.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:40.093+0000 7fa6f1ffb640 1 -- 172.21.15.148:0/2601139115 <== mgr.14148 v2:172.21.15.148:6800/3007822654 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7fa6f406a6b0 con 0x7fa6e40a32d0 2024-09-19T07:10:40.094 INFO:teuthology.orchestra.run.smithi148.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T07:10:40.094 INFO:teuthology.orchestra.run.smithi148.stdout:mds.a smithi148 running (93s) 16s ago 92s 13.5M - 19.1.1-361-g2f599a46 d2baa855c067 7fa2e17b51b1 2024-09-19T07:10:40.094 INFO:teuthology.orchestra.run.smithi148.stdout:mds.b smithi165 running (90s) 23s ago 90s 17.8M - 19.1.1-361-g2f599a46 d2baa855c067 db467f6599bc 2024-09-19T07:10:40.094 INFO:teuthology.orchestra.run.smithi148.stdout:mds.c smithi179 running (104s) 23s ago 104s 20.5M - 19.1.1-361-g2f599a46 d2baa855c067 195696a9dfe2 2024-09-19T07:10:40.094 INFO:teuthology.orchestra.run.smithi148.stdout:mds.d smithi148 running (111s) 16s ago 111s 14.1M - 19.1.1-361-g2f599a46 d2baa855c067 bd659d4c6ecd 2024-09-19T07:10:40.094 INFO:teuthology.orchestra.run.smithi148.stdout:mds.e smithi165 running (109s) 23s ago 109s 13.7M - 19.1.1-361-g2f599a46 d2baa855c067 a7ec468e1ee2 2024-09-19T07:10:40.094 INFO:teuthology.orchestra.run.smithi148.stdout:mds.f smithi179 running (106s) 23s ago 106s 17.7M - 19.1.1-361-g2f599a46 d2baa855c067 967b3ea9b100 2024-09-19T07:10:40.094 INFO:teuthology.orchestra.run.smithi148.stdout:mds.g smithi148 running (96s) 16s ago 96s 15.6M - 19.1.1-361-g2f599a46 d2baa855c067 0244447b28e5 2024-09-19T07:10:40.094 INFO:teuthology.orchestra.run.smithi148.stdout:mds.h smithi165 running (101s) 23s ago 101s 20.5M - 19.1.1-361-g2f599a46 d2baa855c067 4a374e4fdd28 2024-09-19T07:10:40.094 INFO:teuthology.orchestra.run.smithi148.stdout:mds.i smithi179 running (99s) 23s ago 98s 26.6M - 19.1.1-361-g2f599a46 d2baa855c067 9b255789fa91 2024-09-19T07:10:40.094 INFO:teuthology.orchestra.run.smithi148.stdout:mds.j smithi148 running (115s) 16s ago 114s 16.5M - 19.1.1-361-g2f599a46 d2baa855c067 dd7931079e21 2024-09-19T07:10:40.095 INFO:teuthology.orchestra.run.smithi148.stdout:mds.k smithi165 running (118s) 23s ago 117s 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 76df50e44764 2024-09-19T07:10:40.095 INFO:teuthology.orchestra.run.smithi148.stdout:mds.l smithi179 running (2m) 23s ago 2m 16.2M - 19.1.1-361-g2f599a46 d2baa855c067 2c0b8b4f0308 2024-09-19T07:10:40.095 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.x smithi148 *:9283,8765 running (8m) 16s ago 8m 508M - 19.1.1-361-g2f599a46 d2baa855c067 f319d52d4e72 2024-09-19T07:10:40.095 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.y smithi165 *:8443,8765 running (7m) 23s ago 7m 442M - 19.1.1-361-g2f599a46 d2baa855c067 5462059cc1df 2024-09-19T07:10:40.095 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.z smithi179 *:8443,8765 running (7m) 23s ago 7m 443M - 19.1.1-361-g2f599a46 d2baa855c067 217ea58788b8 2024-09-19T07:10:40.095 INFO:teuthology.orchestra.run.smithi148.stdout:mon.a smithi148 running (8m) 16s ago 8m 50.7M 2048M 19.1.1-361-g2f599a46 d2baa855c067 7c0ab7162492 2024-09-19T07:10:40.095 INFO:teuthology.orchestra.run.smithi148.stdout:mon.b smithi165 running (7m) 23s ago 7m 39.7M 2048M 19.1.1-361-g2f599a46 d2baa855c067 a39d85e5c1ae 2024-09-19T07:10:40.095 INFO:teuthology.orchestra.run.smithi148.stdout:mon.c smithi179 running (7m) 23s ago 7m 42.7M 2048M 19.1.1-361-g2f599a46 d2baa855c067 1e64fd3b1713 2024-09-19T07:10:40.095 INFO:teuthology.orchestra.run.smithi148.stdout:osd.0 smithi148 running (6m) 16s ago 6m 55.0M 4272M 19.1.1-361-g2f599a46 d2baa855c067 0632d1a8a3bb 2024-09-19T07:10:40.095 INFO:teuthology.orchestra.run.smithi148.stdout:osd.1 smithi165 running (6m) 23s ago 6m 49.0M 4272M 19.1.1-361-g2f599a46 d2baa855c067 dc67c6584315 2024-09-19T07:10:40.095 INFO:teuthology.orchestra.run.smithi148.stdout:osd.2 smithi179 running (6m) 23s ago 6m 56.7M 4272M 19.1.1-361-g2f599a46 d2baa855c067 55cce6785ab9 2024-09-19T07:10:40.095 INFO:teuthology.orchestra.run.smithi148.stdout:osd.3 smithi148 running (5m) 16s ago 5m 55.0M 4272M 19.1.1-361-g2f599a46 d2baa855c067 037052b5c153 2024-09-19T07:10:40.095 INFO:teuthology.orchestra.run.smithi148.stdout:osd.4 smithi165 running (5m) 23s ago 5m 53.5M 4272M 19.1.1-361-g2f599a46 d2baa855c067 a4d4791ba24c 2024-09-19T07:10:40.096 INFO:teuthology.orchestra.run.smithi148.stdout:osd.5 smithi179 running (4m) 23s ago 4m 56.3M 4272M 19.1.1-361-g2f599a46 d2baa855c067 770b6efd1b0e 2024-09-19T07:10:40.096 INFO:teuthology.orchestra.run.smithi148.stdout:osd.6 smithi148 running (4m) 16s ago 4m 51.5M 4272M 19.1.1-361-g2f599a46 d2baa855c067 956c02145633 2024-09-19T07:10:40.096 INFO:teuthology.orchestra.run.smithi148.stdout:osd.7 smithi165 running (3m) 23s ago 3m 50.9M 4272M 19.1.1-361-g2f599a46 d2baa855c067 5ecd2bc5264d 2024-09-19T07:10:40.096 INFO:teuthology.orchestra.run.smithi148.stdout:osd.8 smithi179 running (3m) 23s ago 3m 54.7M 4272M 19.1.1-361-g2f599a46 d2baa855c067 315150e54c12 2024-09-19T07:10:40.096 INFO:teuthology.orchestra.run.smithi148.stdout:osd.9 smithi148 running (3m) 16s ago 3m 51.4M 4272M 19.1.1-361-g2f599a46 d2baa855c067 71f8f552c731 2024-09-19T07:10:40.096 INFO:teuthology.orchestra.run.smithi148.stdout:osd.10 smithi165 running (2m) 23s ago 2m 54.2M 4272M 19.1.1-361-g2f599a46 d2baa855c067 9ddbfcb0d27a 2024-09-19T07:10:40.096 INFO:teuthology.orchestra.run.smithi148.stdout:osd.11 smithi179 running (2m) 23s ago 2m 49.7M 4272M 19.1.1-361-g2f599a46 d2baa855c067 88eaa425856c 2024-09-19T07:10:40.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:40.095+0000 7fa6fabd3640 1 -- 172.21.15.148:0/2601139115 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fa6e40a32d0 msgr2=0x7fa6e40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:40.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:40.095+0000 7fa6fabd3640 1 --2- 172.21.15.148:0/2601139115 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fa6e40a32d0 0x7fa6e40a5790 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa6f41047e0 tx=0x7fa6e0009110 comp rx=0 tx=0).stop 2024-09-19T07:10:40.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:40.095+0000 7fa6fabd3640 1 -- 172.21.15.148:0/2601139115 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6f4100ad0 msgr2=0x7fa6f4104a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:40.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:40.095+0000 7fa6fabd3640 1 --2- 172.21.15.148:0/2601139115 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6f4100ad0 0x7fa6f4104a60 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa6e8031610 tx=0x7fa6e80043b0 comp rx=0 tx=0).stop 2024-09-19T07:10:40.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:40.096+0000 7fa6fabd3640 1 -- 172.21.15.148:0/2601139115 shutdown_connections 2024-09-19T07:10:40.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:40.096+0000 7fa6fabd3640 1 --2- 172.21.15.148:0/2601139115 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fa6e40a32d0 0x7fa6e40a5790 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:40.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:40.096+0000 7fa6fabd3640 1 --2- 172.21.15.148:0/2601139115 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6f4102690 0x7fa6f41035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:40.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:40.096+0000 7fa6fabd3640 1 --2- 172.21.15.148:0/2601139115 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6f4101cd0 0x7fa6f41030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:40.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:40.096+0000 7fa6fabd3640 1 --2- 172.21.15.148:0/2601139115 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6f4100ad0 0x7fa6f4104a60 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:40.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:40.096+0000 7fa6fabd3640 1 -- 172.21.15.148:0/2601139115 >> 172.21.15.148:0/2601139115 conn(0x7fa6f40fc280 msgr2=0x7fa6f4069fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:40.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:40.096+0000 7fa6fabd3640 1 -- 172.21.15.148:0/2601139115 shutdown_connections 2024-09-19T07:10:40.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:40.096+0000 7fa6fabd3640 1 -- 172.21.15.148:0/2601139115 wait complete. 2024-09-19T07:10:40.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:40 smithi148 ceph-mon[31180]: from='client.15000 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:10:40.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:40 smithi179 ceph-mon[35716]: from='client.15000 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:10:40.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:40 smithi165 ceph-mon[35326]: from='client.15000 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:10:40.786 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-19T07:10:41.037 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:10:41.446 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:41 smithi148 ceph-mon[31180]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:10:41.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:41 smithi179 ceph-mon[35716]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:10:41.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.526+0000 7fe02f72b640 1 -- 172.21.15.148:0/4252786041 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe028102e00 msgr2=0x7fe028103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:41.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.526+0000 7fe02f72b640 1 --2- 172.21.15.148:0/4252786041 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe028102e00 0x7fe028103280 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe018009900 tx=0x7fe01802a410 comp rx=0 tx=0).stop 2024-09-19T07:10:41.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.526+0000 7fe02f72b640 1 -- 172.21.15.148:0/4252786041 shutdown_connections 2024-09-19T07:10:41.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.526+0000 7fe02f72b640 1 --2- 172.21.15.148:0/4252786041 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe0281037c0 0x7fe02810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:41.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.526+0000 7fe02f72b640 1 --2- 172.21.15.148:0/4252786041 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe028102e00 0x7fe028103280 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:41.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.526+0000 7fe02f72b640 1 --2- 172.21.15.148:0/4252786041 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe028101c00 0x7fe028102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:41.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.526+0000 7fe02f72b640 1 -- 172.21.15.148:0/4252786041 >> 172.21.15.148:0/4252786041 conn(0x7fe0280fd390 msgr2=0x7fe0280ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:41.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.526+0000 7fe02f72b640 1 -- 172.21.15.148:0/4252786041 shutdown_connections 2024-09-19T07:10:41.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.526+0000 7fe02f72b640 1 -- 172.21.15.148:0/4252786041 wait complete. 2024-09-19T07:10:41.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.527+0000 7fe02f72b640 1 Processor -- start 2024-09-19T07:10:41.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.527+0000 7fe02f72b640 1 -- start start 2024-09-19T07:10:41.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.527+0000 7fe02f72b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe028101c00 0x7fe028197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:41.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.527+0000 7fe02f72b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe028102e00 0x7fe028198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:41.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.527+0000 7fe02f72b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0281037c0 0x7fe02819f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:41.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.527+0000 7fe02f72b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe02810d860 con 0x7fe028101c00 2024-09-19T07:10:41.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.527+0000 7fe02f72b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe02810d6e0 con 0x7fe028102e00 2024-09-19T07:10:41.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.527+0000 7fe02f72b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe02810d9e0 con 0x7fe0281037c0 2024-09-19T07:10:41.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.527+0000 7fe02d4c7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe028101c00 0x7fe028197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:41.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.528+0000 7fe02d4c7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe028101c00 0x7fe028197e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60340/0 (socket says 172.21.15.148:60340) 2024-09-19T07:10:41.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.528+0000 7fe02d4c7640 1 -- 172.21.15.148:0/3536174645 learned_addr learned my addr 172.21.15.148:0/3536174645 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:41.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.528+0000 7fe02dcc8640 1 --2- 172.21.15.148:0/3536174645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0281037c0 0x7fe02819f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:41.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.528+0000 7fe02ccc6640 1 --2- 172.21.15.148:0/3536174645 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe028102e00 0x7fe028198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:41.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.528+0000 7fe02d4c7640 1 -- 172.21.15.148:0/3536174645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0281037c0 msgr2=0x7fe02819f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:41.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.528+0000 7fe02d4c7640 1 --2- 172.21.15.148:0/3536174645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0281037c0 0x7fe02819f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:41.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.528+0000 7fe02d4c7640 1 -- 172.21.15.148:0/3536174645 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe028102e00 msgr2=0x7fe028198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:41.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.528+0000 7fe02d4c7640 1 --2- 172.21.15.148:0/3536174645 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe028102e00 0x7fe028198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:41.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.528+0000 7fe02d4c7640 1 -- 172.21.15.148:0/3536174645 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe02819fa50 con 0x7fe028101c00 2024-09-19T07:10:41.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.528+0000 7fe02d4c7640 1 --2- 172.21.15.148:0/3536174645 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe028101c00 0x7fe028197e20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe02400c970 tx=0x7fe02400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:41.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.528+0000 7fe01e7fc640 1 -- 172.21.15.148:0/3536174645 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe024007c10 con 0x7fe028101c00 2024-09-19T07:10:41.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.528+0000 7fe02f72b640 1 -- 172.21.15.148:0/3536174645 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe02819fd40 con 0x7fe028101c00 2024-09-19T07:10:41.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.528+0000 7fe01e7fc640 1 -- 172.21.15.148:0/3536174645 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe024007db0 con 0x7fe028101c00 2024-09-19T07:10:41.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.528+0000 7fe01e7fc640 1 -- 172.21.15.148:0/3536174645 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe02400f8a0 con 0x7fe028101c00 2024-09-19T07:10:41.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.528+0000 7fe02f72b640 1 -- 172.21.15.148:0/3536174645 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0281a01e0 con 0x7fe028101c00 2024-09-19T07:10:41.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.529+0000 7fe02f72b640 1 -- 172.21.15.148:0/3536174645 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe028108f30 con 0x7fe028101c00 2024-09-19T07:10:41.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.530+0000 7fe01e7fc640 1 -- 172.21.15.148:0/3536174645 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fe02400fa40 con 0x7fe028101c00 2024-09-19T07:10:41.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.531+0000 7fe01e7fc640 1 --2- 172.21.15.148:0/3536174645 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fe0140a3300 0x7fe0140a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:41.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.531+0000 7fe02ccc6640 1 --2- 172.21.15.148:0/3536174645 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fe0140a3300 0x7fe0140a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:41.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.531+0000 7fe01e7fc640 1 -- 172.21.15.148:0/3536174645 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7fe0240cffd0 con 0x7fe028101c00 2024-09-19T07:10:41.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.531+0000 7fe02ccc6640 1 --2- 172.21.15.148:0/3536174645 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fe0140a3300 0x7fe0140a57c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe018000c00 tx=0x7fe018031400 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:41.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.534+0000 7fe01e7fc640 1 -- 172.21.15.148:0/3536174645 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe02409cd60 con 0x7fe028101c00 2024-09-19T07:10:41.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:41 smithi165 ceph-mon[35326]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:10:41.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.716+0000 7fe02f72b640 1 -- 172.21.15.148:0/3536174645 --> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fe028062630 con 0x7fe0140a3300 2024-09-19T07:10:41.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.722+0000 7fe01e7fc640 1 -- 172.21.15.148:0/3536174645 <== mgr.14148 v2:172.21.15.148:6800/3007822654 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7fe028062630 con 0x7fe0140a3300 2024-09-19T07:10:41.723 INFO:teuthology.orchestra.run.smithi148.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-19T07:10:41.723 INFO:teuthology.orchestra.run.smithi148.stdout:mds.all 12/12 25s ago 2m smithi148=a;smithi148=d;smithi148=g;smithi148=j;smithi165=b;smithi165=e;smithi165=h;smithi165=k;smithi179=c;smithi179=f;smithi179=i;smithi179=l;count:12 2024-09-19T07:10:41.723 INFO:teuthology.orchestra.run.smithi148.stdout:mgr 3/3 25s ago 7m smithi148=x;smithi165=y;smithi179=z;count:3 2024-09-19T07:10:41.723 INFO:teuthology.orchestra.run.smithi148.stdout:mon 3/3 25s ago 7m smithi148:172.21.15.148=a;smithi165:172.21.15.165=b;smithi179:172.21.15.179=c;count:3 2024-09-19T07:10:41.723 INFO:teuthology.orchestra.run.smithi148.stdout:osd 12 25s ago - 2024-09-19T07:10:41.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.724+0000 7fe02f72b640 1 -- 172.21.15.148:0/3536174645 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fe0140a3300 msgr2=0x7fe0140a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:41.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.724+0000 7fe02f72b640 1 --2- 172.21.15.148:0/3536174645 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fe0140a3300 0x7fe0140a57c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe018000c00 tx=0x7fe018031400 comp rx=0 tx=0).stop 2024-09-19T07:10:41.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.724+0000 7fe02f72b640 1 -- 172.21.15.148:0/3536174645 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe028101c00 msgr2=0x7fe028197e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:41.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.724+0000 7fe02f72b640 1 --2- 172.21.15.148:0/3536174645 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe028101c00 0x7fe028197e20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe02400c970 tx=0x7fe02400ce30 comp rx=0 tx=0).stop 2024-09-19T07:10:41.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.724+0000 7fe02f72b640 1 -- 172.21.15.148:0/3536174645 shutdown_connections 2024-09-19T07:10:41.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.724+0000 7fe02f72b640 1 --2- 172.21.15.148:0/3536174645 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fe0140a3300 0x7fe0140a57c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:41.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.724+0000 7fe02f72b640 1 --2- 172.21.15.148:0/3536174645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0281037c0 0x7fe02819f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:41.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.724+0000 7fe02f72b640 1 --2- 172.21.15.148:0/3536174645 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe028102e00 0x7fe028198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:41.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.724+0000 7fe02f72b640 1 --2- 172.21.15.148:0/3536174645 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe028101c00 0x7fe028197e20 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:41.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.724+0000 7fe02f72b640 1 -- 172.21.15.148:0/3536174645 >> 172.21.15.148:0/3536174645 conn(0x7fe0280fd390 msgr2=0x7fe028106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:41.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.724+0000 7fe02f72b640 1 -- 172.21.15.148:0/3536174645 shutdown_connections 2024-09-19T07:10:41.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:41.724+0000 7fe02f72b640 1 -- 172.21.15.148:0/3536174645 wait complete. 2024-09-19T07:10:42.419 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:42 smithi148 ceph-mon[31180]: from='client.15006 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:10:42.447 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-19T07:10:42.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:42 smithi179 ceph-mon[35716]: from='client.15006 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:10:42.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:42 smithi165 ceph-mon[35326]: from='client.15006 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:10:42.697 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:10:43.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.135+0000 7f1c485b8640 1 -- 172.21.15.148:0/1564093189 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c40107900 msgr2=0x7f1c40109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:43.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.135+0000 7f1c485b8640 1 --2- 172.21.15.148:0/1564093189 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c40107900 0x7f1c40109d50 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1c38009ca0 tx=0x7f1c3802a8c0 comp rx=0 tx=0).stop 2024-09-19T07:10:43.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.136+0000 7f1c485b8640 1 -- 172.21.15.148:0/1564093189 shutdown_connections 2024-09-19T07:10:43.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.136+0000 7f1c485b8640 1 --2- 172.21.15.148:0/1564093189 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c40107900 0x7f1c40109d50 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:43.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.136+0000 7f1c485b8640 1 --2- 172.21.15.148:0/1564093189 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1c40104fd0 0x7f1c401073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:43.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.136+0000 7f1c485b8640 1 --2- 172.21.15.148:0/1564093189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c401026a0 0x7f1c40104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:43.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.136+0000 7f1c485b8640 1 -- 172.21.15.148:0/1564093189 >> 172.21.15.148:0/1564093189 conn(0x7f1c400fc2a0 msgr2=0x7f1c400fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:43.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.136+0000 7f1c485b8640 1 -- 172.21.15.148:0/1564093189 shutdown_connections 2024-09-19T07:10:43.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.136+0000 7f1c485b8640 1 -- 172.21.15.148:0/1564093189 wait complete. 2024-09-19T07:10:43.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.136+0000 7f1c485b8640 1 Processor -- start 2024-09-19T07:10:43.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.136+0000 7f1c485b8640 1 -- start start 2024-09-19T07:10:43.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.136+0000 7f1c485b8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c401026a0 0x7f1c40197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:43.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.136+0000 7f1c485b8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c40104fd0 0x7f1c40198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:43.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.137+0000 7f1c485b8640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1c40107900 0x7f1c4019f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:43.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.137+0000 7f1c485b8640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1c4010d910 con 0x7f1c401026a0 2024-09-19T07:10:43.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.137+0000 7f1c485b8640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1c4010d790 con 0x7f1c40107900 2024-09-19T07:10:43.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.137+0000 7f1c485b8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1c4010da90 con 0x7f1c40104fd0 2024-09-19T07:10:43.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.137+0000 7f1c46354640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c401026a0 0x7f1c40197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:43.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.137+0000 7f1c46354640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c401026a0 0x7f1c40197ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60346/0 (socket says 172.21.15.148:60346) 2024-09-19T07:10:43.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.137+0000 7f1c46354640 1 -- 172.21.15.148:0/514054747 learned_addr learned my addr 172.21.15.148:0/514054747 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:43.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.137+0000 7f1c45b53640 1 --2- 172.21.15.148:0/514054747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c40104fd0 0x7f1c40198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:43.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.137+0000 7f1c46b55640 1 --2- 172.21.15.148:0/514054747 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1c40107900 0x7f1c4019f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:43.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.137+0000 7f1c46354640 1 -- 172.21.15.148:0/514054747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c40104fd0 msgr2=0x7f1c40198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:43.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.137+0000 7f1c46354640 1 --2- 172.21.15.148:0/514054747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c40104fd0 0x7f1c40198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:43.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.137+0000 7f1c46354640 1 -- 172.21.15.148:0/514054747 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1c40107900 msgr2=0x7f1c4019f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:43.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.137+0000 7f1c46354640 1 --2- 172.21.15.148:0/514054747 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1c40107900 0x7f1c4019f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:43.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.137+0000 7f1c46354640 1 -- 172.21.15.148:0/514054747 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c4019fb10 con 0x7f1c401026a0 2024-09-19T07:10:43.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.137+0000 7f1c46b55640 1 --2- 172.21.15.148:0/514054747 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1c40107900 0x7f1c4019f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:10:43.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.137+0000 7f1c46354640 1 --2- 172.21.15.148:0/514054747 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c401026a0 0x7f1c40197ee0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c00c920 tx=0x7f1c3c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:43.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.137+0000 7f1c377fe640 1 -- 172.21.15.148:0/514054747 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c007c70 con 0x7f1c401026a0 2024-09-19T07:10:43.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.137+0000 7f1c485b8640 1 -- 172.21.15.148:0/514054747 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c4019fe00 con 0x7f1c401026a0 2024-09-19T07:10:43.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.137+0000 7f1c377fe640 1 -- 172.21.15.148:0/514054747 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c3c007e10 con 0x7f1c401026a0 2024-09-19T07:10:43.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.137+0000 7f1c377fe640 1 -- 172.21.15.148:0/514054747 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c018890 con 0x7f1c401026a0 2024-09-19T07:10:43.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.137+0000 7f1c485b8640 1 -- 172.21.15.148:0/514054747 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c401a02e0 con 0x7f1c401026a0 2024-09-19T07:10:43.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.138+0000 7f1c485b8640 1 -- 172.21.15.148:0/514054747 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c400fdd90 con 0x7f1c401026a0 2024-09-19T07:10:43.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.140+0000 7f1c377fe640 1 -- 172.21.15.148:0/514054747 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f1c3c018a30 con 0x7f1c401026a0 2024-09-19T07:10:43.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.140+0000 7f1c377fe640 1 --2- 172.21.15.148:0/514054747 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f1c2c0a3300 0x7f1c2c0a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:43.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.140+0000 7f1c45b53640 1 --2- 172.21.15.148:0/514054747 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f1c2c0a3300 0x7f1c2c0a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:43.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.140+0000 7f1c377fe640 1 -- 172.21.15.148:0/514054747 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7f1c3c0cfec0 con 0x7f1c401026a0 2024-09-19T07:10:43.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.141+0000 7f1c45b53640 1 --2- 172.21.15.148:0/514054747 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f1c2c0a3300 0x7f1c2c0a57c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1c40199400 tx=0x7f1c30008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:43.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.143+0000 7f1c377fe640 1 -- 172.21.15.148:0/514054747 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1c3c014030 con 0x7f1c401026a0 2024-09-19T07:10:43.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.318+0000 7f1c485b8640 1 -- 172.21.15.148:0/514054747 --> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f1c40062630 con 0x7f1c2c0a3300 2024-09-19T07:10:43.320 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:43 smithi148 ceph-mon[31180]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:10:43.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.320+0000 7f1c377fe640 1 -- 172.21.15.148:0/514054747 <== mgr.14148 v2:172.21.15.148:6800/3007822654 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f1c40062630 con 0x7f1c2c0a3300 2024-09-19T07:10:43.320 INFO:teuthology.orchestra.run.smithi148.stdout:HOST ADDR LABELS STATUS 2024-09-19T07:10:43.320 INFO:teuthology.orchestra.run.smithi148.stdout:smithi148 172.21.15.148 2024-09-19T07:10:43.321 INFO:teuthology.orchestra.run.smithi148.stdout:smithi165 172.21.15.165 2024-09-19T07:10:43.321 INFO:teuthology.orchestra.run.smithi148.stdout:smithi179 172.21.15.179 2024-09-19T07:10:43.321 INFO:teuthology.orchestra.run.smithi148.stdout:3 hosts in cluster 2024-09-19T07:10:43.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.322+0000 7f1c485b8640 1 -- 172.21.15.148:0/514054747 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f1c2c0a3300 msgr2=0x7f1c2c0a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:43.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.322+0000 7f1c485b8640 1 --2- 172.21.15.148:0/514054747 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f1c2c0a3300 0x7f1c2c0a57c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1c40199400 tx=0x7f1c30008040 comp rx=0 tx=0).stop 2024-09-19T07:10:43.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.322+0000 7f1c485b8640 1 -- 172.21.15.148:0/514054747 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c401026a0 msgr2=0x7f1c40197ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:43.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.322+0000 7f1c485b8640 1 --2- 172.21.15.148:0/514054747 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c401026a0 0x7f1c40197ee0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c00c920 tx=0x7f1c3c00cde0 comp rx=0 tx=0).stop 2024-09-19T07:10:43.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.322+0000 7f1c485b8640 1 -- 172.21.15.148:0/514054747 shutdown_connections 2024-09-19T07:10:43.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.322+0000 7f1c485b8640 1 --2- 172.21.15.148:0/514054747 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f1c2c0a3300 0x7f1c2c0a57c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:43.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.322+0000 7f1c485b8640 1 --2- 172.21.15.148:0/514054747 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1c40107900 0x7f1c4019f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:43.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.322+0000 7f1c485b8640 1 --2- 172.21.15.148:0/514054747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c40104fd0 0x7f1c40198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:43.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.322+0000 7f1c485b8640 1 --2- 172.21.15.148:0/514054747 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c401026a0 0x7f1c40197ee0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:43.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.322+0000 7f1c485b8640 1 -- 172.21.15.148:0/514054747 >> 172.21.15.148:0/514054747 conn(0x7f1c400fc2a0 msgr2=0x7f1c40102f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:43.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.322+0000 7f1c485b8640 1 -- 172.21.15.148:0/514054747 shutdown_connections 2024-09-19T07:10:43.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:43.322+0000 7f1c485b8640 1 -- 172.21.15.148:0/514054747 wait complete. 2024-09-19T07:10:43.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:43 smithi179 ceph-mon[35716]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:10:43.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:43 smithi165 ceph-mon[35326]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:10:43.954 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-19T07:10:44.202 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:10:44.482 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:44 smithi148 ceph-mon[31180]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:10:44.525 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:44 smithi179 ceph-mon[35716]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:10:44.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:44 smithi165 ceph-mon[35326]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:10:44.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.676+0000 7f22c4b2f640 1 -- 172.21.15.148:0/4160022940 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22c0101c00 msgr2=0x7f22c0102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:44.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.676+0000 7f22c4b2f640 1 --2- 172.21.15.148:0/4160022940 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22c0101c00 0x7f22c0102000 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f22b0009900 tx=0x7f22b002a410 comp rx=0 tx=0).stop 2024-09-19T07:10:44.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.676+0000 7f22c4b2f640 1 -- 172.21.15.148:0/4160022940 shutdown_connections 2024-09-19T07:10:44.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.676+0000 7f22c4b2f640 1 --2- 172.21.15.148:0/4160022940 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f22c01037c0 0x7f22c010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:44.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.676+0000 7f22c4b2f640 1 --2- 172.21.15.148:0/4160022940 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22c0102e00 0x7f22c0103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:44.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.676+0000 7f22c4b2f640 1 --2- 172.21.15.148:0/4160022940 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22c0101c00 0x7f22c0102000 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:44.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.676+0000 7f22c4b2f640 1 -- 172.21.15.148:0/4160022940 >> 172.21.15.148:0/4160022940 conn(0x7f22c00fd390 msgr2=0x7f22c00ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:44.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.676+0000 7f22c4b2f640 1 -- 172.21.15.148:0/4160022940 shutdown_connections 2024-09-19T07:10:44.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.676+0000 7f22c4b2f640 1 -- 172.21.15.148:0/4160022940 wait complete. 2024-09-19T07:10:44.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.677+0000 7f22c4b2f640 1 Processor -- start 2024-09-19T07:10:44.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.677+0000 7f22c4b2f640 1 -- start start 2024-09-19T07:10:44.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.677+0000 7f22c4b2f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f22c0101c00 0x7f22c0197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:44.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.677+0000 7f22c4b2f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22c0102e00 0x7f22c01984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:44.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.678+0000 7f22c4b2f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22c01037c0 0x7f22c019f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:44.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.678+0000 7f22c4b2f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f22c010d900 con 0x7f22c01037c0 2024-09-19T07:10:44.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.678+0000 7f22c4b2f640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f22c010d780 con 0x7f22c0101c00 2024-09-19T07:10:44.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.678+0000 7f22c4b2f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f22c010da80 con 0x7f22c0102e00 2024-09-19T07:10:44.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.678+0000 7f22bed9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22c01037c0 0x7f22c019f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:44.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.678+0000 7f22bed9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22c01037c0 0x7f22c019f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44880/0 (socket says 172.21.15.148:44880) 2024-09-19T07:10:44.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.678+0000 7f22bed9d640 1 -- 172.21.15.148:0/1300882968 learned_addr learned my addr 172.21.15.148:0/1300882968 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:44.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.678+0000 7f22b5d9b640 1 --2- 172.21.15.148:0/1300882968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22c0102e00 0x7f22c01984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:44.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.678+0000 7f22be59c640 1 --2- 172.21.15.148:0/1300882968 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f22c0101c00 0x7f22c0197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:44.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.678+0000 7f22bed9d640 1 -- 172.21.15.148:0/1300882968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22c0102e00 msgr2=0x7f22c01984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:44.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.678+0000 7f22bed9d640 1 --2- 172.21.15.148:0/1300882968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22c0102e00 0x7f22c01984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:44.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.678+0000 7f22bed9d640 1 -- 172.21.15.148:0/1300882968 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f22c0101c00 msgr2=0x7f22c0197f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:44.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.678+0000 7f22bed9d640 1 --2- 172.21.15.148:0/1300882968 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f22c0101c00 0x7f22c0197f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:44.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.678+0000 7f22bed9d640 1 -- 172.21.15.148:0/1300882968 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22c019fbc0 con 0x7f22c01037c0 2024-09-19T07:10:44.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.678+0000 7f22bed9d640 1 --2- 172.21.15.148:0/1300882968 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22c01037c0 0x7f22c019f550 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f22b800b970 tx=0x7f22b800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:44.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.678+0000 7f22b7fff640 1 -- 172.21.15.148:0/1300882968 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b8019070 con 0x7f22c01037c0 2024-09-19T07:10:44.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.678+0000 7f22c4b2f640 1 -- 172.21.15.148:0/1300882968 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22c019feb0 con 0x7f22c01037c0 2024-09-19T07:10:44.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.678+0000 7f22b7fff640 1 -- 172.21.15.148:0/1300882968 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22b800cb40 con 0x7f22c01037c0 2024-09-19T07:10:44.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.678+0000 7f22b7fff640 1 -- 172.21.15.148:0/1300882968 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b8007650 con 0x7f22c01037c0 2024-09-19T07:10:44.699 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.678+0000 7f22c4b2f640 1 -- 172.21.15.148:0/1300882968 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22c01a0390 con 0x7f22c01037c0 2024-09-19T07:10:44.699 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.680+0000 7f22c4b2f640 1 -- 172.21.15.148:0/1300882968 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22c0109070 con 0x7f22c01037c0 2024-09-19T07:10:44.699 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.681+0000 7f22b7fff640 1 -- 172.21.15.148:0/1300882968 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f22b801c070 con 0x7f22c01037c0 2024-09-19T07:10:44.699 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.681+0000 7f22b7fff640 1 --2- 172.21.15.148:0/1300882968 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f22ac0a3300 0x7f22ac0a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:44.699 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.681+0000 7f22be59c640 1 --2- 172.21.15.148:0/1300882968 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f22ac0a3300 0x7f22ac0a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:44.699 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.681+0000 7f22b7fff640 1 -- 172.21.15.148:0/1300882968 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7f22b80ceef0 con 0x7f22c01037c0 2024-09-19T07:10:44.699 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.682+0000 7f22be59c640 1 --2- 172.21.15.148:0/1300882968 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f22ac0a3300 0x7f22ac0a57c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f22b0005ab0 tx=0x7f22b0000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:44.699 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.686+0000 7f22b7fff640 1 -- 172.21.15.148:0/1300882968 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f22b809b580 con 0x7f22c01037c0 2024-09-19T07:10:44.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.864+0000 7f22c4b2f640 1 -- 172.21.15.148:0/1300882968 --> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f22c0062630 con 0x7f22ac0a3300 2024-09-19T07:10:44.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.865+0000 7f22b7fff640 1 -- 172.21.15.148:0/1300882968 <== mgr.14148 v2:172.21.15.148:6800/3007822654 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f22c0062630 con 0x7f22ac0a3300 2024-09-19T07:10:44.866 INFO:teuthology.orchestra.run.smithi148.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-19T07:10:44.866 INFO:teuthology.orchestra.run.smithi148.stdout:smithi148 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6233005G400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-19T07:10:44.867 INFO:teuthology.orchestra.run.smithi148.stdout:smithi165 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300CE400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-19T07:10:44.867 INFO:teuthology.orchestra.run.smithi148.stdout:smithi179 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6303009J400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-19T07:10:44.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.867+0000 7f22c4b2f640 1 -- 172.21.15.148:0/1300882968 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f22ac0a3300 msgr2=0x7f22ac0a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:44.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.867+0000 7f22c4b2f640 1 --2- 172.21.15.148:0/1300882968 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f22ac0a3300 0x7f22ac0a57c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f22b0005ab0 tx=0x7f22b0000bc0 comp rx=0 tx=0).stop 2024-09-19T07:10:44.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.867+0000 7f22c4b2f640 1 -- 172.21.15.148:0/1300882968 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22c01037c0 msgr2=0x7f22c019f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:44.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.867+0000 7f22c4b2f640 1 --2- 172.21.15.148:0/1300882968 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22c01037c0 0x7f22c019f550 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f22b800b970 tx=0x7f22b800be30 comp rx=0 tx=0).stop 2024-09-19T07:10:44.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.867+0000 7f22c4b2f640 1 -- 172.21.15.148:0/1300882968 shutdown_connections 2024-09-19T07:10:44.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.867+0000 7f22c4b2f640 1 --2- 172.21.15.148:0/1300882968 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f22ac0a3300 0x7f22ac0a57c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:44.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.867+0000 7f22c4b2f640 1 --2- 172.21.15.148:0/1300882968 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22c01037c0 0x7f22c019f550 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:44.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.867+0000 7f22c4b2f640 1 --2- 172.21.15.148:0/1300882968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22c0102e00 0x7f22c01984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:44.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.867+0000 7f22c4b2f640 1 --2- 172.21.15.148:0/1300882968 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f22c0101c00 0x7f22c0197f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:44.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.867+0000 7f22c4b2f640 1 -- 172.21.15.148:0/1300882968 >> 172.21.15.148:0/1300882968 conn(0x7f22c00fd390 msgr2=0x7f22c0106240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:44.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.868+0000 7f22c4b2f640 1 -- 172.21.15.148:0/1300882968 shutdown_connections 2024-09-19T07:10:44.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:44.868+0000 7f22c4b2f640 1 -- 172.21.15.148:0/1300882968 wait complete. 2024-09-19T07:10:45.491 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:45 smithi148 ceph-mon[31180]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:10:45.491 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:45 smithi148 ceph-mon[31180]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T07:10:45.519 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T07:10:45.529 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi148.front.sepia.ceph.com 2024-09-19T07:10:45.529 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-19T07:10:45.530 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:45 smithi179 ceph-mon[35716]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:10:45.530 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:45 smithi179 ceph-mon[35716]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T07:10:45.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:45 smithi165 ceph-mon[35326]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:10:45.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:45 smithi165 ceph-mon[35326]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T07:10:45.777 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:10:46.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.199+0000 7f4918b02640 1 -- 172.21.15.148:0/4061031592 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49141026d0 msgr2=0x7f4914108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:46.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.199+0000 7f4918b02640 1 --2- 172.21.15.148:0/4061031592 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49141026d0 0x7f4914108f60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f490c009ca0 tx=0x7f490c02a8c0 comp rx=0 tx=0).stop 2024-09-19T07:10:46.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.199+0000 7f4918b02640 1 -- 172.21.15.148:0/4061031592 shutdown_connections 2024-09-19T07:10:46.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.199+0000 7f4918b02640 1 --2- 172.21.15.148:0/4061031592 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49141026d0 0x7f4914108f60 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:46.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.199+0000 7f4918b02640 1 --2- 172.21.15.148:0/4061031592 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4914101d10 0x7f4914102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:46.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.199+0000 7f4918b02640 1 --2- 172.21.15.148:0/4061031592 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4914100b10 0x7f4914100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:46.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.199+0000 7f4918b02640 1 -- 172.21.15.148:0/4061031592 >> 172.21.15.148:0/4061031592 conn(0x7f49140fc2a0 msgr2=0x7f49140fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:46.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.199+0000 7f4918b02640 1 -- 172.21.15.148:0/4061031592 shutdown_connections 2024-09-19T07:10:46.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.199+0000 7f4918b02640 1 -- 172.21.15.148:0/4061031592 wait complete. 2024-09-19T07:10:46.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.200+0000 7f4918b02640 1 Processor -- start 2024-09-19T07:10:46.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.200+0000 7f4918b02640 1 -- start start 2024-09-19T07:10:46.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.201+0000 7f4918b02640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4914100b10 0x7f4914196da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:46.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.201+0000 7f4918b02640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4914101d10 0x7f49141972e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:46.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.201+0000 7f4918b02640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49141026d0 0x7f491419e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:46.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.201+0000 7f4918b02640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f491410c7e0 con 0x7f4914101d10 2024-09-19T07:10:46.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.201+0000 7f4918b02640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f491410c660 con 0x7f49141026d0 2024-09-19T07:10:46.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.201+0000 7f4918b02640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f491410c960 con 0x7f4914100b10 2024-09-19T07:10:46.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.201+0000 7f4911d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4914101d10 0x7f49141972e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:46.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.201+0000 7f4911d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4914101d10 0x7f49141972e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44894/0 (socket says 172.21.15.148:44894) 2024-09-19T07:10:46.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.201+0000 7f4911d9b640 1 -- 172.21.15.148:0/1014742175 learned_addr learned my addr 172.21.15.148:0/1014742175 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:46.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.201+0000 7f491259c640 1 --2- 172.21.15.148:0/1014742175 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4914100b10 0x7f4914196da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:46.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.201+0000 7f4912d9d640 1 --2- 172.21.15.148:0/1014742175 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49141026d0 0x7f491419e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:46.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.201+0000 7f4911d9b640 1 -- 172.21.15.148:0/1014742175 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4914100b10 msgr2=0x7f4914196da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:46.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.201+0000 7f4911d9b640 1 --2- 172.21.15.148:0/1014742175 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4914100b10 0x7f4914196da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:46.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.201+0000 7f4911d9b640 1 -- 172.21.15.148:0/1014742175 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49141026d0 msgr2=0x7f491419e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:46.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.201+0000 7f4911d9b640 1 --2- 172.21.15.148:0/1014742175 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49141026d0 0x7f491419e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:46.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.201+0000 7f4911d9b640 1 -- 172.21.15.148:0/1014742175 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f491419e9d0 con 0x7f4914101d10 2024-09-19T07:10:46.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.201+0000 7f4911d9b640 1 --2- 172.21.15.148:0/1014742175 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4914101d10 0x7f49141972e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4908009900 tx=0x7f4908009dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:46.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.201+0000 7f49037fe640 1 -- 172.21.15.148:0/1014742175 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f490800d030 con 0x7f4914101d10 2024-09-19T07:10:46.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.201+0000 7f4918b02640 1 -- 172.21.15.148:0/1014742175 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f491406a7f0 con 0x7f4914101d10 2024-09-19T07:10:46.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.201+0000 7f49037fe640 1 -- 172.21.15.148:0/1014742175 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f490800d1d0 con 0x7f4914101d10 2024-09-19T07:10:46.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.201+0000 7f49037fe640 1 -- 172.21.15.148:0/1014742175 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4908005280 con 0x7f4914101d10 2024-09-19T07:10:46.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.201+0000 7f4918b02640 1 -- 172.21.15.148:0/1014742175 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f491406ad30 con 0x7f4914101d10 2024-09-19T07:10:46.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.202+0000 7f4918b02640 1 -- 172.21.15.148:0/1014742175 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4914100f10 con 0x7f4914101d10 2024-09-19T07:10:46.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.203+0000 7f49037fe640 1 -- 172.21.15.148:0/1014742175 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f49080078f0 con 0x7f4914101d10 2024-09-19T07:10:46.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.204+0000 7f49037fe640 1 --2- 172.21.15.148:0/1014742175 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f48fc0a3300 0x7f48fc0a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:46.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.204+0000 7f491259c640 1 --2- 172.21.15.148:0/1014742175 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f48fc0a3300 0x7f48fc0a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:46.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.204+0000 7f49037fe640 1 -- 172.21.15.148:0/1014742175 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7f49080d0de0 con 0x7f4914101d10 2024-09-19T07:10:46.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.205+0000 7f491259c640 1 --2- 172.21.15.148:0/1014742175 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f48fc0a3300 0x7f48fc0a57c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4904005fd0 tx=0x7f490400b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:46.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.208+0000 7f49037fe640 1 -- 172.21.15.148:0/1014742175 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f490809d9b0 con 0x7f4914101d10 2024-09-19T07:10:46.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.409+0000 7f4918b02640 1 -- 172.21.15.148:0/1014742175 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f491419eba0 con 0x7f4914101d10 2024-09-19T07:10:46.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.409+0000 7f49037fe640 1 -- 172.21.15.148:0/1014742175 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+3105 (secure 0 0 0) 0x7f4908097e20 con 0x7f4914101d10 2024-09-19T07:10:46.410 INFO:teuthology.orchestra.run.smithi148.stdout:e24 2024-09-19T07:10:46.410 INFO:teuthology.orchestra.run.smithi148.stdout:btime 2024-09-19T07:09:30:984194+0000 2024-09-19T07:10:46.410 INFO:teuthology.orchestra.run.smithi148.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T07:10:46.410 INFO:teuthology.orchestra.run.smithi148.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T07:10:46.411 INFO:teuthology.orchestra.run.smithi148.stdout:legacy client fscid: 1 2024-09-19T07:10:46.411 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:10:46.411 INFO:teuthology.orchestra.run.smithi148.stdout:Filesystem 'cephfs' (1) 2024-09-19T07:10:46.411 INFO:teuthology.orchestra.run.smithi148.stdout:fs_name cephfs 2024-09-19T07:10:46.411 INFO:teuthology.orchestra.run.smithi148.stdout:epoch 24 2024-09-19T07:10:46.411 INFO:teuthology.orchestra.run.smithi148.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T07:10:46.411 INFO:teuthology.orchestra.run.smithi148.stdout:created 2024-09-19T07:09:19.543369+0000 2024-09-19T07:10:46.411 INFO:teuthology.orchestra.run.smithi148.stdout:modified 2024-09-19T07:09:30.685034+0000 2024-09-19T07:10:46.411 INFO:teuthology.orchestra.run.smithi148.stdout:tableserver 0 2024-09-19T07:10:46.411 INFO:teuthology.orchestra.run.smithi148.stdout:root 0 2024-09-19T07:10:46.411 INFO:teuthology.orchestra.run.smithi148.stdout:session_timeout 300 2024-09-19T07:10:46.411 INFO:teuthology.orchestra.run.smithi148.stdout:session_autoclose 300 2024-09-19T07:10:46.411 INFO:teuthology.orchestra.run.smithi148.stdout:max_file_size 1099511627776 2024-09-19T07:10:46.411 INFO:teuthology.orchestra.run.smithi148.stdout:max_xattr_size 65536 2024-09-19T07:10:46.412 INFO:teuthology.orchestra.run.smithi148.stdout:required_client_features {} 2024-09-19T07:10:46.412 INFO:teuthology.orchestra.run.smithi148.stdout:last_failure 0 2024-09-19T07:10:46.412 INFO:teuthology.orchestra.run.smithi148.stdout:last_failure_osd_epoch 0 2024-09-19T07:10:46.412 INFO:teuthology.orchestra.run.smithi148.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T07:10:46.412 INFO:teuthology.orchestra.run.smithi148.stdout:max_mds 3 2024-09-19T07:10:46.412 INFO:teuthology.orchestra.run.smithi148.stdout:in 0,1,2 2024-09-19T07:10:46.412 INFO:teuthology.orchestra.run.smithi148.stdout:up {0=24457,1=24437,2=24436} 2024-09-19T07:10:46.412 INFO:teuthology.orchestra.run.smithi148.stdout:failed 2024-09-19T07:10:46.412 INFO:teuthology.orchestra.run.smithi148.stdout:damaged 2024-09-19T07:10:46.412 INFO:teuthology.orchestra.run.smithi148.stdout:stopped 2024-09-19T07:10:46.412 INFO:teuthology.orchestra.run.smithi148.stdout:data_pools [3] 2024-09-19T07:10:46.412 INFO:teuthology.orchestra.run.smithi148.stdout:metadata_pool 2 2024-09-19T07:10:46.412 INFO:teuthology.orchestra.run.smithi148.stdout:inline_data disabled 2024-09-19T07:10:46.413 INFO:teuthology.orchestra.run.smithi148.stdout:balancer 2024-09-19T07:10:46.413 INFO:teuthology.orchestra.run.smithi148.stdout:bal_rank_mask -1 2024-09-19T07:10:46.413 INFO:teuthology.orchestra.run.smithi148.stdout:standby_count_wanted 0 2024-09-19T07:10:46.413 INFO:teuthology.orchestra.run.smithi148.stdout:qdb_cluster leader: 24457 members: 24436,24437,24457 2024-09-19T07:10:46.413 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.i{0:24457} state up:active seq 6 addr [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:10:46.413 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.f{0:24430} state up:standby-replay seq 1 addr [v2:172.21.15.179:6834/1566489108,v1:172.21.15.179:6835/1566489108] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:10:46.413 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.b{1:24437} state up:active seq 6 addr [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:10:46.413 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.l{1:24412} state up:standby-replay seq 1 addr [v2:172.21.15.179:6832/1289882987,v1:172.21.15.179:6833/1289882987] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:10:46.413 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.c{2:24436} state up:active seq 10 addr [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:10:46.413 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.h{2:24410} state up:standby-replay seq 1 addr [v2:172.21.15.165:6836/3847988837,v1:172.21.15.165:6837/3847988837] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:10:46.413 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:10:46.413 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:10:46.413 INFO:teuthology.orchestra.run.smithi148.stdout:Standby daemons: 2024-09-19T07:10:46.414 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:10:46.414 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.j{-1:14520} state up:standby seq 1 addr [v2:172.21.15.148:6834/1040309943,v1:172.21.15.148:6835/1040309943] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:10:46.414 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.d{-1:14532} state up:standby seq 1 addr [v2:172.21.15.148:6836/2835228384,v1:172.21.15.148:6837/2835228384] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:10:46.414 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.g{-1:14577} state up:standby seq 1 addr [v2:172.21.15.148:6838/2974467793,v1:172.21.15.148:6839/2974467793] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:10:46.414 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.a{-1:14589} state up:standby seq 1 addr [v2:172.21.15.148:6840/4263868576,v1:172.21.15.148:6841/4263868576] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:10:46.414 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.k{-1:24362} state up:standby seq 1 addr [v2:172.21.15.165:6832/1860818320,v1:172.21.15.165:6833/1860818320] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:10:46.414 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.e{-1:24383} state up:standby seq 1 addr [v2:172.21.15.165:6834/2146820965,v1:172.21.15.165:6835/2146820965] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:10:46.415 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 24 2024-09-19T07:10:46.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.411+0000 7f4918b02640 1 -- 172.21.15.148:0/1014742175 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f48fc0a3300 msgr2=0x7f48fc0a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:46.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.411+0000 7f4918b02640 1 --2- 172.21.15.148:0/1014742175 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f48fc0a3300 0x7f48fc0a57c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4904005fd0 tx=0x7f490400b390 comp rx=0 tx=0).stop 2024-09-19T07:10:46.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.411+0000 7f4918b02640 1 -- 172.21.15.148:0/1014742175 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4914101d10 msgr2=0x7f49141972e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:46.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.411+0000 7f4918b02640 1 --2- 172.21.15.148:0/1014742175 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4914101d10 0x7f49141972e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4908009900 tx=0x7f4908009dc0 comp rx=0 tx=0).stop 2024-09-19T07:10:46.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.411+0000 7f4918b02640 1 -- 172.21.15.148:0/1014742175 shutdown_connections 2024-09-19T07:10:46.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.411+0000 7f4918b02640 1 --2- 172.21.15.148:0/1014742175 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f48fc0a3300 0x7f48fc0a57c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:46.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.411+0000 7f4918b02640 1 --2- 172.21.15.148:0/1014742175 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49141026d0 0x7f491419e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:46.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.411+0000 7f4918b02640 1 --2- 172.21.15.148:0/1014742175 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4914101d10 0x7f49141972e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:46.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.411+0000 7f4918b02640 1 --2- 172.21.15.148:0/1014742175 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4914100b10 0x7f4914196da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:46.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.411+0000 7f4918b02640 1 -- 172.21.15.148:0/1014742175 >> 172.21.15.148:0/1014742175 conn(0x7f49140fc2a0 msgr2=0x7f4914105090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:46.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.411+0000 7f4918b02640 1 -- 172.21.15.148:0/1014742175 shutdown_connections 2024-09-19T07:10:46.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:46.411+0000 7f4918b02640 1 -- 172.21.15.148:0/1014742175 wait complete. 2024-09-19T07:10:46.730 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:46 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/1014742175' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T07:10:46.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:46 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/1014742175' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T07:10:46.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:46 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/1014742175' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T07:10:46.983 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-19T07:10:47.229 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:10:47.671 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:47 smithi148 ceph-mon[31180]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:10:47.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.670+0000 7f76a90d2640 1 -- 172.21.15.148:0/3072285397 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76a4101cd0 msgr2=0x7f76a4102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:47.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.670+0000 7f76a90d2640 1 --2- 172.21.15.148:0/3072285397 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76a4101cd0 0x7f76a4102150 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7694009900 tx=0x7f769402a410 comp rx=0 tx=0).stop 2024-09-19T07:10:47.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.670+0000 7f76a90d2640 1 -- 172.21.15.148:0/3072285397 shutdown_connections 2024-09-19T07:10:47.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.670+0000 7f76a90d2640 1 --2- 172.21.15.148:0/3072285397 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76a4102690 0x7f76a4108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:47.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.670+0000 7f76a90d2640 1 --2- 172.21.15.148:0/3072285397 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76a4101cd0 0x7f76a4102150 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:47.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.670+0000 7f76a90d2640 1 --2- 172.21.15.148:0/3072285397 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f76a4100ad0 0x7f76a4100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:47.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.670+0000 7f76a90d2640 1 -- 172.21.15.148:0/3072285397 >> 172.21.15.148:0/3072285397 conn(0x7f76a40fc280 msgr2=0x7f76a40fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:47.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.670+0000 7f76a90d2640 1 -- 172.21.15.148:0/3072285397 shutdown_connections 2024-09-19T07:10:47.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.670+0000 7f76a90d2640 1 -- 172.21.15.148:0/3072285397 wait complete. 2024-09-19T07:10:47.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.671+0000 7f76a90d2640 1 Processor -- start 2024-09-19T07:10:47.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.671+0000 7f76a90d2640 1 -- start start 2024-09-19T07:10:47.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.671+0000 7f76a90d2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76a4100ad0 0x7f76a4197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:47.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.671+0000 7f76a90d2640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76a4101cd0 0x7f76a4198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:47.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.671+0000 7f76a90d2640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f76a4102690 0x7f76a419f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:47.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.671+0000 7f76a90d2640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f76a410c750 con 0x7f76a4101cd0 2024-09-19T07:10:47.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.671+0000 7f76a90d2640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f76a410c5d0 con 0x7f76a4102690 2024-09-19T07:10:47.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.671+0000 7f76a90d2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f76a410c8d0 con 0x7f76a4100ad0 2024-09-19T07:10:47.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.671+0000 7f76a259c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76a4101cd0 0x7f76a4198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:47.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.671+0000 7f76a259c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76a4101cd0 0x7f76a4198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44912/0 (socket says 172.21.15.148:44912) 2024-09-19T07:10:47.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.671+0000 7f76a259c640 1 -- 172.21.15.148:0/2021213193 learned_addr learned my addr 172.21.15.148:0/2021213193 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:47.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.671+0000 7f76a259c640 1 -- 172.21.15.148:0/2021213193 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76a4100ad0 msgr2=0x7f76a4197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:47.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.671+0000 7f76a359e640 1 --2- 172.21.15.148:0/2021213193 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f76a4102690 0x7f76a419f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:47.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.672+0000 7f76a2d9d640 1 --2- 172.21.15.148:0/2021213193 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76a4100ad0 0x7f76a4197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:47.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.672+0000 7f76a259c640 1 --2- 172.21.15.148:0/2021213193 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76a4100ad0 0x7f76a4197f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:47.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.672+0000 7f76a259c640 1 -- 172.21.15.148:0/2021213193 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f76a4102690 msgr2=0x7f76a419f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:47.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.672+0000 7f76a259c640 1 --2- 172.21.15.148:0/2021213193 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f76a4102690 0x7f76a419f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:47.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.672+0000 7f76a259c640 1 -- 172.21.15.148:0/2021213193 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76a419fb50 con 0x7f76a4101cd0 2024-09-19T07:10:47.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.672+0000 7f76a359e640 1 --2- 172.21.15.148:0/2021213193 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f76a4102690 0x7f76a419f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:10:47.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.672+0000 7f76a259c640 1 --2- 172.21.15.148:0/2021213193 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76a4101cd0 0x7f76a4198460 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7694009230 tx=0x7f7694004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:47.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.672+0000 7f769bfff640 1 -- 172.21.15.148:0/2021213193 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f769403f030 con 0x7f76a4101cd0 2024-09-19T07:10:47.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.672+0000 7f76a90d2640 1 -- 172.21.15.148:0/2021213193 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76a419fde0 con 0x7f76a4101cd0 2024-09-19T07:10:47.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.672+0000 7f769bfff640 1 -- 172.21.15.148:0/2021213193 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7694003ce0 con 0x7f76a4101cd0 2024-09-19T07:10:47.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.672+0000 7f769bfff640 1 -- 172.21.15.148:0/2021213193 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7694035070 con 0x7f76a4101cd0 2024-09-19T07:10:47.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.672+0000 7f76a90d2640 1 -- 172.21.15.148:0/2021213193 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76a41a0240 con 0x7f76a4101cd0 2024-09-19T07:10:47.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.673+0000 7f76a90d2640 1 -- 172.21.15.148:0/2021213193 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76a41a0470 con 0x7f76a4101cd0 2024-09-19T07:10:47.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.674+0000 7f769bfff640 1 -- 172.21.15.148:0/2021213193 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f7694042030 con 0x7f76a4101cd0 2024-09-19T07:10:47.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.675+0000 7f769bfff640 1 --2- 172.21.15.148:0/2021213193 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f76900a3300 0x7f76900a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:47.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.675+0000 7f76a2d9d640 1 --2- 172.21.15.148:0/2021213193 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f76900a3300 0x7f76900a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:47.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.675+0000 7f769bfff640 1 -- 172.21.15.148:0/2021213193 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7f76940f0540 con 0x7f76a4101cd0 2024-09-19T07:10:47.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.675+0000 7f76a2d9d640 1 --2- 172.21.15.148:0/2021213193 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f76900a3300 0x7f76900a57c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f768c005fd0 tx=0x7f768c005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:47.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.678+0000 7f769bfff640 1 -- 172.21.15.148:0/2021213193 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f76940bd110 con 0x7f76a4101cd0 2024-09-19T07:10:47.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:47 smithi179 ceph-mon[35716]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:10:47.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.849+0000 7f76a90d2640 1 -- 172.21.15.148:0/2021213193 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f76a41a0800 con 0x7f76a4101cd0 2024-09-19T07:10:47.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.850+0000 7f769bfff640 1 -- 172.21.15.148:0/2021213193 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v80) ==== 56+0+5318 (secure 0 0 0) 0x7f76940bca10 con 0x7f76a4101cd0 2024-09-19T07:10:47.851 INFO:teuthology.orchestra.run.smithi148.stdout:epoch 80 2024-09-19T07:10:47.851 INFO:teuthology.orchestra.run.smithi148.stdout:fsid eae8a4a8-7654-11ef-bceb-c7b262605968 2024-09-19T07:10:47.851 INFO:teuthology.orchestra.run.smithi148.stdout:created 2024-09-19T07:01:47.891210+0000 2024-09-19T07:10:47.851 INFO:teuthology.orchestra.run.smithi148.stdout:modified 2024-09-19T07:09:38.168257+0000 2024-09-19T07:10:47.851 INFO:teuthology.orchestra.run.smithi148.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-19T07:10:47.851 INFO:teuthology.orchestra.run.smithi148.stdout:crush_version 26 2024-09-19T07:10:47.851 INFO:teuthology.orchestra.run.smithi148.stdout:full_ratio 0.95 2024-09-19T07:10:47.851 INFO:teuthology.orchestra.run.smithi148.stdout:backfillfull_ratio 0.9 2024-09-19T07:10:47.851 INFO:teuthology.orchestra.run.smithi148.stdout:nearfull_ratio 0.85 2024-09-19T07:10:47.851 INFO:teuthology.orchestra.run.smithi148.stdout:require_min_compat_client luminous 2024-09-19T07:10:47.851 INFO:teuthology.orchestra.run.smithi148.stdout:min_compat_client luminous 2024-09-19T07:10:47.852 INFO:teuthology.orchestra.run.smithi148.stdout:require_osd_release squid 2024-09-19T07:10:47.852 INFO:teuthology.orchestra.run.smithi148.stdout:stretch_mode_enabled false 2024-09-19T07:10:47.852 INFO:teuthology.orchestra.run.smithi148.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 20 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-19T07:10:47.852 INFO:teuthology.orchestra.run.smithi148.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 78 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-19T07:10:47.852 INFO:teuthology.orchestra.run.smithi148.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 78 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-19T07:10:47.852 INFO:teuthology.orchestra.run.smithi148.stdout:max_osd 12 2024-09-19T07:10:47.852 INFO:teuthology.orchestra.run.smithi148.stdout:osd.0 up in weight 1 up_from 8 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.148:6802/512186330,v1:172.21.15.148:6803/512186330] [v2:172.21.15.148:6804/512186330,v1:172.21.15.148:6805/512186330] exists,up 7b854fad-d5a3-43e3-862e-7a0e8f243c56 2024-09-19T07:10:47.852 INFO:teuthology.orchestra.run.smithi148.stdout:osd.1 up in weight 1 up_from 12 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.165:6800/2433984552,v1:172.21.15.165:6801/2433984552] [v2:172.21.15.165:6802/2433984552,v1:172.21.15.165:6803/2433984552] exists,up 61b26278-f4db-40f0-97b9-c12a6ef1cd06 2024-09-19T07:10:47.852 INFO:teuthology.orchestra.run.smithi148.stdout:osd.2 up in weight 1 up_from 17 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.179:6800/3048365223,v1:172.21.15.179:6801/3048365223] [v2:172.21.15.179:6802/3048365223,v1:172.21.15.179:6803/3048365223] exists,up 06620bbc-cdb5-4afc-8122-0bb3126630f1 2024-09-19T07:10:47.852 INFO:teuthology.orchestra.run.smithi148.stdout:osd.3 up in weight 1 up_from 23 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.148:6810/3662789091,v1:172.21.15.148:6811/3662789091] [v2:172.21.15.148:6812/3662789091,v1:172.21.15.148:6813/3662789091] exists,up d7df45d4-5ef1-4f66-84a7-f61b8756c0c5 2024-09-19T07:10:47.852 INFO:teuthology.orchestra.run.smithi148.stdout:osd.4 up in weight 1 up_from 30 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.165:6808/3082550323,v1:172.21.15.165:6809/3082550323] [v2:172.21.15.165:6810/3082550323,v1:172.21.15.165:6811/3082550323] exists,up 5cfd359b-a8d2-4bdc-858f-087d26e0869c 2024-09-19T07:10:47.853 INFO:teuthology.orchestra.run.smithi148.stdout:osd.5 up in weight 1 up_from 34 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.179:6808/2125213751,v1:172.21.15.179:6809/2125213751] [v2:172.21.15.179:6810/2125213751,v1:172.21.15.179:6811/2125213751] exists,up 8295e69b-87fe-4403-bb2e-d9dd42e2f398 2024-09-19T07:10:47.853 INFO:teuthology.orchestra.run.smithi148.stdout:osd.6 up in weight 1 up_from 41 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.148:6818/2178980310,v1:172.21.15.148:6819/2178980310] [v2:172.21.15.148:6820/2178980310,v1:172.21.15.148:6821/2178980310] exists,up 4ce38d1a-06d3-4606-b00d-aa1ff977025f 2024-09-19T07:10:47.853 INFO:teuthology.orchestra.run.smithi148.stdout:osd.7 up in weight 1 up_from 46 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.165:6816/3961600099,v1:172.21.15.165:6817/3961600099] [v2:172.21.15.165:6818/3961600099,v1:172.21.15.165:6819/3961600099] exists,up 9e68e2b2-9838-4ec0-b473-24f2434695ec 2024-09-19T07:10:47.853 INFO:teuthology.orchestra.run.smithi148.stdout:osd.8 up in weight 1 up_from 53 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.179:6816/3642931467,v1:172.21.15.179:6817/3642931467] [v2:172.21.15.179:6818/3642931467,v1:172.21.15.179:6819/3642931467] exists,up 297acce6-d3c7-4e1a-bf87-be093de51a6c 2024-09-19T07:10:47.853 INFO:teuthology.orchestra.run.smithi148.stdout:osd.9 up in weight 1 up_from 60 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.148:6826/3135409630,v1:172.21.15.148:6827/3135409630] [v2:172.21.15.148:6828/3135409630,v1:172.21.15.148:6829/3135409630] exists,up ef488c5e-5353-4695-99dd-5b74ade436d7 2024-09-19T07:10:47.853 INFO:teuthology.orchestra.run.smithi148.stdout:osd.10 up in weight 1 up_from 65 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.165:6824/3554110731,v1:172.21.15.165:6825/3554110731] [v2:172.21.15.165:6826/3554110731,v1:172.21.15.165:6827/3554110731] exists,up 7a9f0379-1199-4266-910c-8d1d313d39e4 2024-09-19T07:10:47.853 INFO:teuthology.orchestra.run.smithi148.stdout:osd.11 up in weight 1 up_from 72 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.179:6824/2026109940,v1:172.21.15.179:6825/2026109940] [v2:172.21.15.179:6826/2026109940,v1:172.21.15.179:6827/2026109940] exists,up eede97e9-5685-4603-806e-7078c6940536 2024-09-19T07:10:47.853 INFO:teuthology.orchestra.run.smithi148.stdout:pg_upmap_items 2.8 [2,11] 2024-09-19T07:10:47.853 INFO:teuthology.orchestra.run.smithi148.stdout:pg_upmap_items 2.b [8,11] 2024-09-19T07:10:47.853 INFO:teuthology.orchestra.run.smithi148.stdout:pg_upmap_items 2.14 [2,4] 2024-09-19T07:10:47.853 INFO:teuthology.orchestra.run.smithi148.stdout:pg_upmap_items 3.e [5,9] 2024-09-19T07:10:47.853 INFO:teuthology.orchestra.run.smithi148.stdout:pg_upmap_items 3.1d [4,6] 2024-09-19T07:10:47.854 INFO:teuthology.orchestra.run.smithi148.stdout:pg_upmap_items 3.27 [4,8] 2024-09-19T07:10:47.854 INFO:teuthology.orchestra.run.smithi148.stdout:pg_upmap_items 3.34 [4,9] 2024-09-19T07:10:47.854 INFO:teuthology.orchestra.run.smithi148.stdout:pg_upmap_items 3.38 [3,9] 2024-09-19T07:10:47.854 INFO:teuthology.orchestra.run.smithi148.stdout:blocklist 172.21.15.148:0/3534559227 expires 2024-09-20T07:02:37.007183+0000 2024-09-19T07:10:47.854 INFO:teuthology.orchestra.run.smithi148.stdout:blocklist 172.21.15.148:0/1958388906 expires 2024-09-20T07:02:37.007183+0000 2024-09-19T07:10:47.854 INFO:teuthology.orchestra.run.smithi148.stdout:blocklist 172.21.15.148:0/1922521135 expires 2024-09-20T07:02:37.007183+0000 2024-09-19T07:10:47.854 INFO:teuthology.orchestra.run.smithi148.stdout:blocklist 172.21.15.148:6801/1949849385 expires 2024-09-20T07:02:37.007183+0000 2024-09-19T07:10:47.854 INFO:teuthology.orchestra.run.smithi148.stdout:blocklist 172.21.15.148:6800/1949849385 expires 2024-09-20T07:02:37.007183+0000 2024-09-19T07:10:47.854 INFO:teuthology.orchestra.run.smithi148.stdout:blocklist 172.21.15.148:6800/2161746152 expires 2024-09-20T07:02:14.557425+0000 2024-09-19T07:10:47.854 INFO:teuthology.orchestra.run.smithi148.stdout:blocklist 172.21.15.148:6801/2161746152 expires 2024-09-20T07:02:14.557425+0000 2024-09-19T07:10:47.854 INFO:teuthology.orchestra.run.smithi148.stdout:blocklist 172.21.15.148:0/1480486619 expires 2024-09-20T07:02:14.557425+0000 2024-09-19T07:10:47.854 INFO:teuthology.orchestra.run.smithi148.stdout:blocklist 172.21.15.148:0/174481494 expires 2024-09-20T07:02:14.557425+0000 2024-09-19T07:10:47.854 INFO:teuthology.orchestra.run.smithi148.stdout:blocklist 172.21.15.148:0/1114469409 expires 2024-09-20T07:02:14.557425+0000 2024-09-19T07:10:47.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.852+0000 7f76a90d2640 1 -- 172.21.15.148:0/2021213193 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f76900a3300 msgr2=0x7f76900a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:47.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.852+0000 7f76a90d2640 1 --2- 172.21.15.148:0/2021213193 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f76900a3300 0x7f76900a57c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f768c005fd0 tx=0x7f768c005850 comp rx=0 tx=0).stop 2024-09-19T07:10:47.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.852+0000 7f76a90d2640 1 -- 172.21.15.148:0/2021213193 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76a4101cd0 msgr2=0x7f76a4198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:47.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.852+0000 7f76a90d2640 1 --2- 172.21.15.148:0/2021213193 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76a4101cd0 0x7f76a4198460 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7694009230 tx=0x7f7694004360 comp rx=0 tx=0).stop 2024-09-19T07:10:47.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.852+0000 7f76a90d2640 1 -- 172.21.15.148:0/2021213193 shutdown_connections 2024-09-19T07:10:47.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.852+0000 7f76a90d2640 1 --2- 172.21.15.148:0/2021213193 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f76900a3300 0x7f76900a57c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:47.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.852+0000 7f76a90d2640 1 --2- 172.21.15.148:0/2021213193 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f76a4102690 0x7f76a419f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:47.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.852+0000 7f76a90d2640 1 --2- 172.21.15.148:0/2021213193 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76a4101cd0 0x7f76a4198460 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:47.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.852+0000 7f76a90d2640 1 --2- 172.21.15.148:0/2021213193 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76a4100ad0 0x7f76a4197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:47.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.852+0000 7f76a90d2640 1 -- 172.21.15.148:0/2021213193 >> 172.21.15.148:0/2021213193 conn(0x7f76a40fc280 msgr2=0x7f76a4069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:47.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.852+0000 7f76a90d2640 1 -- 172.21.15.148:0/2021213193 shutdown_connections 2024-09-19T07:10:47.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:47.852+0000 7f76a90d2640 1 -- 172.21.15.148:0/2021213193 wait complete. 2024-09-19T07:10:47.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:47 smithi165 ceph-mon[35326]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:10:48.432 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-19T07:10:48.444 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:10:48.689 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:10:48.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:48 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/2021213193' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T07:10:48.811 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:48 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/2021213193' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T07:10:48.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:48 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/2021213193' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T07:10:49.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.183+0000 7f935c286640 1 -- 172.21.15.148:0/938838584 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9354106f00 msgr2=0x7f935410ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:49.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.183+0000 7f935c286640 1 --2- 172.21.15.148:0/938838584 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9354106f00 0x7f935410ea80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f934c009ca0 tx=0x7f934c02a8c0 comp rx=0 tx=0).stop 2024-09-19T07:10:49.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.183+0000 7f935c286640 1 -- 172.21.15.148:0/938838584 shutdown_connections 2024-09-19T07:10:49.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.183+0000 7f935c286640 1 --2- 172.21.15.148:0/938838584 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9354106f00 0x7f935410ea80 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:49.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.183+0000 7f935c286640 1 --2- 172.21.15.148:0/938838584 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9354102780 0x7f93541067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:49.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.183+0000 7f935c286640 1 --2- 172.21.15.148:0/938838584 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9354101dd0 0x7f93541021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:49.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.183+0000 7f935c286640 1 -- 172.21.15.148:0/938838584 >> 172.21.15.148:0/938838584 conn(0x7f93540fd8b0 msgr2=0x7f93540ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:49.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.183+0000 7f935c286640 1 -- 172.21.15.148:0/938838584 shutdown_connections 2024-09-19T07:10:49.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.183+0000 7f935c286640 1 -- 172.21.15.148:0/938838584 wait complete. 2024-09-19T07:10:49.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.184+0000 7f935c286640 1 Processor -- start 2024-09-19T07:10:49.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.184+0000 7f935c286640 1 -- start start 2024-09-19T07:10:49.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.184+0000 7f935c286640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9354101dd0 0x7f93540744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:49.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.184+0000 7f935c286640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9354102780 0x7f9354074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:49.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.184+0000 7f935c286640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9354106f00 0x7f9354074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:49.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.184+0000 7f935c286640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9354112000 con 0x7f9354101dd0 2024-09-19T07:10:49.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.184+0000 7f935c286640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9354111e80 con 0x7f9354102780 2024-09-19T07:10:49.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.184+0000 7f935c286640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9354112180 con 0x7f9354106f00 2024-09-19T07:10:49.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.184+0000 7f935a022640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9354101dd0 0x7f93540744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:49.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.184+0000 7f935a022640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9354101dd0 0x7f93540744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44924/0 (socket says 172.21.15.148:44924) 2024-09-19T07:10:49.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.184+0000 7f935a022640 1 -- 172.21.15.148:0/2521090528 learned_addr learned my addr 172.21.15.148:0/2521090528 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:49.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.184+0000 7f935a022640 1 -- 172.21.15.148:0/2521090528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9354106f00 msgr2=0x7f9354074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:49.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.184+0000 7f935a022640 1 --2- 172.21.15.148:0/2521090528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9354106f00 0x7f9354074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:49.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.184+0000 7f935a022640 1 -- 172.21.15.148:0/2521090528 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9354102780 msgr2=0x7f9354074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:49.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.184+0000 7f935a022640 1 --2- 172.21.15.148:0/2521090528 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9354102780 0x7f9354074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:49.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.184+0000 7f935a022640 1 -- 172.21.15.148:0/2521090528 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93541a6a20 con 0x7f9354101dd0 2024-09-19T07:10:49.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.184+0000 7f935a022640 1 --2- 172.21.15.148:0/2521090528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9354101dd0 0x7f93540744f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f935000b4a0 tx=0x7f935000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:49.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.184+0000 7f934b7fe640 1 -- 172.21.15.148:0/2521090528 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9350014070 con 0x7f9354101dd0 2024-09-19T07:10:49.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.185+0000 7f934b7fe640 1 -- 172.21.15.148:0/2521090528 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9350010af0 con 0x7f9354101dd0 2024-09-19T07:10:49.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.185+0000 7f935c286640 1 -- 172.21.15.148:0/2521090528 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93541a6d10 con 0x7f9354101dd0 2024-09-19T07:10:49.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.185+0000 7f934b7fe640 1 -- 172.21.15.148:0/2521090528 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9350017d10 con 0x7f9354101dd0 2024-09-19T07:10:49.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.185+0000 7f935c286640 1 -- 172.21.15.148:0/2521090528 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93541a71a0 con 0x7f9354101dd0 2024-09-19T07:10:49.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.186+0000 7f935c286640 1 -- 172.21.15.148:0/2521090528 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9354102230 con 0x7f9354101dd0 2024-09-19T07:10:49.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.187+0000 7f934b7fe640 1 -- 172.21.15.148:0/2521090528 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f9350017070 con 0x7f9354101dd0 2024-09-19T07:10:49.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.187+0000 7f934b7fe640 1 --2- 172.21.15.148:0/2521090528 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f93400a32d0 0x7f93400a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:49.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.187+0000 7f9359821640 1 --2- 172.21.15.148:0/2521090528 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f93400a32d0 0x7f93400a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:49.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.188+0000 7f934b7fe640 1 -- 172.21.15.148:0/2521090528 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7f93500cf1a0 con 0x7f9354101dd0 2024-09-19T07:10:49.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.188+0000 7f9359821640 1 --2- 172.21.15.148:0/2521090528 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f93400a32d0 0x7f93400a5790 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9354075f80 tx=0x7f9344006c90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:49.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.191+0000 7f934b7fe640 1 -- 172.21.15.148:0/2521090528 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f935009be80 con 0x7f9354101dd0 2024-09-19T07:10:49.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.394+0000 7f935c286640 1 -- 172.21.15.148:0/2521090528 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9354075a20 con 0x7f9354101dd0 2024-09-19T07:10:49.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.395+0000 7f934b7fe640 1 -- 172.21.15.148:0/2521090528 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11939 (secure 0 0 0) 0x7f935009b780 con 0x7f9354101dd0 2024-09-19T07:10:49.396 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:10:49.397 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":24,"btime":"2024-09-19T07:09:30:984194+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/4263868576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":4263868576},{"type":"v1","addr":"172.21.15.148:6841","nonce":4263868576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24383,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2146820965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2146820965},{"type":"v1","addr":"172.21.15.165:6835","nonce":2146820965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:09:19.543369+0000","modified":"2024-09-19T07:09:30.685034+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24457,"mds_1":24437,"mds_2":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/1566489108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1566489108},{"type":"v1","addr":"172.21.15.179:6835","nonce":1566489108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.165:6839/3993490234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":3993490234},{"type":"v1","addr":"172.21.15.165:6839","nonce":3993490234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24457,"qdb_cluster":[24436,24437,24457]},"id":1}]} 2024-09-19T07:10:49.397 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 24 2024-09-19T07:10:49.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.398+0000 7f935c286640 1 -- 172.21.15.148:0/2521090528 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f93400a32d0 msgr2=0x7f93400a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:49.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.398+0000 7f935c286640 1 --2- 172.21.15.148:0/2521090528 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f93400a32d0 0x7f93400a5790 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9354075f80 tx=0x7f9344006c90 comp rx=0 tx=0).stop 2024-09-19T07:10:49.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.398+0000 7f935c286640 1 -- 172.21.15.148:0/2521090528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9354101dd0 msgr2=0x7f93540744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:49.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.398+0000 7f935c286640 1 --2- 172.21.15.148:0/2521090528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9354101dd0 0x7f93540744f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f935000b4a0 tx=0x7f935000b960 comp rx=0 tx=0).stop 2024-09-19T07:10:49.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.398+0000 7f935c286640 1 -- 172.21.15.148:0/2521090528 shutdown_connections 2024-09-19T07:10:49.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.398+0000 7f935c286640 1 --2- 172.21.15.148:0/2521090528 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f93400a32d0 0x7f93400a5790 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:49.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.398+0000 7f935c286640 1 --2- 172.21.15.148:0/2521090528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9354106f00 0x7f9354074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:49.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.398+0000 7f935c286640 1 --2- 172.21.15.148:0/2521090528 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9354102780 0x7f9354074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:49.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.398+0000 7f935c286640 1 --2- 172.21.15.148:0/2521090528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9354101dd0 0x7f93540744f0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:49.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.398+0000 7f935c286640 1 -- 172.21.15.148:0/2521090528 >> 172.21.15.148:0/2521090528 conn(0x7f93540fd8b0 msgr2=0x7f93540fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:49.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.398+0000 7f935c286640 1 -- 172.21.15.148:0/2521090528 shutdown_connections 2024-09-19T07:10:49.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:49.398+0000 7f935c286640 1 -- 172.21.15.148:0/2521090528 wait complete. 2024-09-19T07:10:49.703 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:49 smithi148 ceph-mon[31180]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:10:49.703 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:49 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/2521090528' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:10:49.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:49 smithi179 ceph-mon[35716]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:10:49.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:49 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/2521090528' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:10:49.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:49 smithi165 ceph-mon[35326]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:10:49.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:49 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/2521090528' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:10:49.982 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:10:50.230 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:10:50.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.693+0000 7f4d38a82640 1 -- 172.21.15.148:0/543932546 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d34101420 msgr2=0x7f4d3410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:50.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.693+0000 7f4d38a82640 1 --2- 172.21.15.148:0/543932546 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d34101420 0x7f4d3410d950 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c009cd0 tx=0x7f4d2c02a8e0 comp rx=0 tx=0).stop 2024-09-19T07:10:50.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.694+0000 7f4d38a82640 1 -- 172.21.15.148:0/543932546 shutdown_connections 2024-09-19T07:10:50.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.694+0000 7f4d38a82640 1 --2- 172.21.15.148:0/543932546 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d34101420 0x7f4d3410d950 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:50.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.694+0000 7f4d38a82640 1 --2- 172.21.15.148:0/543932546 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4d34100a80 0x7f4d34100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:50.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.694+0000 7f4d38a82640 1 --2- 172.21.15.148:0/543932546 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d34106a80 0x7f4d34106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:50.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.694+0000 7f4d38a82640 1 -- 172.21.15.148:0/543932546 >> 172.21.15.148:0/543932546 conn(0x7f4d340fc7a0 msgr2=0x7f4d340febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:50.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.694+0000 7f4d38a82640 1 -- 172.21.15.148:0/543932546 shutdown_connections 2024-09-19T07:10:50.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.694+0000 7f4d38a82640 1 -- 172.21.15.148:0/543932546 wait complete. 2024-09-19T07:10:50.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.694+0000 7f4d38a82640 1 Processor -- start 2024-09-19T07:10:50.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.694+0000 7f4d38a82640 1 -- start start 2024-09-19T07:10:50.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.695+0000 7f4d38a82640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4d34100a80 0x7f4d341992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:50.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.695+0000 7f4d38a82640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d34101420 0x7f4d34199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:50.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.695+0000 7f4d38a82640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d34106a80 0x7f4d341a4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:50.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.695+0000 7f4d38a82640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4d34110ea0 con 0x7f4d34106a80 2024-09-19T07:10:50.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.695+0000 7f4d38a82640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4d34110d20 con 0x7f4d34100a80 2024-09-19T07:10:50.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.695+0000 7f4d38a82640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4d34111020 con 0x7f4d34101420 2024-09-19T07:10:50.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.695+0000 7f4d32d9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d34106a80 0x7f4d341a4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:50.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.695+0000 7f4d32d9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d34106a80 0x7f4d341a4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44928/0 (socket says 172.21.15.148:44928) 2024-09-19T07:10:50.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.695+0000 7f4d32d9d640 1 -- 172.21.15.148:0/2446118743 learned_addr learned my addr 172.21.15.148:0/2446118743 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:50.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.695+0000 7f4d31d9b640 1 --2- 172.21.15.148:0/2446118743 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d34101420 0x7f4d34199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:50.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.695+0000 7f4d3259c640 1 --2- 172.21.15.148:0/2446118743 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4d34100a80 0x7f4d341992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:50.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.695+0000 7f4d32d9d640 1 -- 172.21.15.148:0/2446118743 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d34101420 msgr2=0x7f4d34199810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:50.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.695+0000 7f4d32d9d640 1 --2- 172.21.15.148:0/2446118743 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d34101420 0x7f4d34199810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:50.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.695+0000 7f4d32d9d640 1 -- 172.21.15.148:0/2446118743 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4d34100a80 msgr2=0x7f4d341992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:50.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.695+0000 7f4d32d9d640 1 --2- 172.21.15.148:0/2446118743 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4d34100a80 0x7f4d341992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:50.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.695+0000 7f4d32d9d640 1 -- 172.21.15.148:0/2446118743 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d341a4890 con 0x7f4d34106a80 2024-09-19T07:10:50.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.695+0000 7f4d3259c640 1 --2- 172.21.15.148:0/2446118743 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4d34100a80 0x7f4d341992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:10:50.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.695+0000 7f4d32d9d640 1 --2- 172.21.15.148:0/2446118743 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d34106a80 0x7f4d341a4350 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c006010 tx=0x7f4d2c003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:50.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.695+0000 7f4d237fe640 1 -- 172.21.15.148:0/2446118743 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c004450 con 0x7f4d34106a80 2024-09-19T07:10:50.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.695+0000 7f4d38a82640 1 -- 172.21.15.148:0/2446118743 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d341a4a60 con 0x7f4d34106a80 2024-09-19T07:10:50.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.695+0000 7f4d237fe640 1 -- 172.21.15.148:0/2446118743 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d2c003e10 con 0x7f4d34106a80 2024-09-19T07:10:50.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.695+0000 7f4d237fe640 1 -- 172.21.15.148:0/2446118743 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c0466e0 con 0x7f4d34106a80 2024-09-19T07:10:50.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.696+0000 7f4d38a82640 1 -- 172.21.15.148:0/2446118743 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d341a4f10 con 0x7f4d34106a80 2024-09-19T07:10:50.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.696+0000 7f4d38a82640 1 -- 172.21.15.148:0/2446118743 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d34100ee0 con 0x7f4d34106a80 2024-09-19T07:10:50.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.698+0000 7f4d237fe640 1 -- 172.21.15.148:0/2446118743 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f4d2c0305a0 con 0x7f4d34106a80 2024-09-19T07:10:50.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.698+0000 7f4d237fe640 1 --2- 172.21.15.148:0/2446118743 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f4d1c0a32d0 0x7f4d1c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:50.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.698+0000 7f4d3259c640 1 --2- 172.21.15.148:0/2446118743 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f4d1c0a32d0 0x7f4d1c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:50.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.698+0000 7f4d237fe640 1 -- 172.21.15.148:0/2446118743 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7f4d2c02e030 con 0x7f4d34106a80 2024-09-19T07:10:50.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.699+0000 7f4d3259c640 1 --2- 172.21.15.148:0/2446118743 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f4d1c0a32d0 0x7f4d1c0a5790 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4d24009930 tx=0x7f4d24008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:50.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.702+0000 7f4d237fe640 1 -- 172.21.15.148:0/2446118743 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4d2c04b060 con 0x7f4d34106a80 2024-09-19T07:10:50.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.901+0000 7f4d38a82640 1 -- 172.21.15.148:0/2446118743 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4d341a5140 con 0x7f4d34106a80 2024-09-19T07:10:50.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.902+0000 7f4d237fe640 1 -- 172.21.15.148:0/2446118743 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11939 (secure 0 0 0) 0x7f4d2c0be010 con 0x7f4d34106a80 2024-09-19T07:10:50.903 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:10:50.903 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":24,"btime":"2024-09-19T07:09:30:984194+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/4263868576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":4263868576},{"type":"v1","addr":"172.21.15.148:6841","nonce":4263868576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24383,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2146820965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2146820965},{"type":"v1","addr":"172.21.15.165:6835","nonce":2146820965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:09:19.543369+0000","modified":"2024-09-19T07:09:30.685034+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24457,"mds_1":24437,"mds_2":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/1566489108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1566489108},{"type":"v1","addr":"172.21.15.179:6835","nonce":1566489108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.165:6839/3993490234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":3993490234},{"type":"v1","addr":"172.21.15.165:6839","nonce":3993490234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24457,"qdb_cluster":[24436,24437,24457]},"id":1}]} 2024-09-19T07:10:50.904 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 24 2024-09-19T07:10:50.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.904+0000 7f4d38a82640 1 -- 172.21.15.148:0/2446118743 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f4d1c0a32d0 msgr2=0x7f4d1c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:50.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.904+0000 7f4d38a82640 1 --2- 172.21.15.148:0/2446118743 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f4d1c0a32d0 0x7f4d1c0a5790 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4d24009930 tx=0x7f4d24008040 comp rx=0 tx=0).stop 2024-09-19T07:10:50.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.904+0000 7f4d38a82640 1 -- 172.21.15.148:0/2446118743 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d34106a80 msgr2=0x7f4d341a4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:50.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.904+0000 7f4d38a82640 1 --2- 172.21.15.148:0/2446118743 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d34106a80 0x7f4d341a4350 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c006010 tx=0x7f4d2c003c20 comp rx=0 tx=0).stop 2024-09-19T07:10:50.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.904+0000 7f4d38a82640 1 -- 172.21.15.148:0/2446118743 shutdown_connections 2024-09-19T07:10:50.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.904+0000 7f4d38a82640 1 --2- 172.21.15.148:0/2446118743 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f4d1c0a32d0 0x7f4d1c0a5790 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:50.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.904+0000 7f4d38a82640 1 --2- 172.21.15.148:0/2446118743 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d34106a80 0x7f4d341a4350 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:50.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.904+0000 7f4d38a82640 1 --2- 172.21.15.148:0/2446118743 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d34101420 0x7f4d34199810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:50.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.904+0000 7f4d38a82640 1 --2- 172.21.15.148:0/2446118743 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4d34100a80 0x7f4d341992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:50.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.904+0000 7f4d38a82640 1 -- 172.21.15.148:0/2446118743 >> 172.21.15.148:0/2446118743 conn(0x7f4d340fc7a0 msgr2=0x7f4d340fcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:50.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.904+0000 7f4d38a82640 1 -- 172.21.15.148:0/2446118743 shutdown_connections 2024-09-19T07:10:50.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:50.904+0000 7f4d38a82640 1 -- 172.21.15.148:0/2446118743 wait complete. 2024-09-19T07:10:51.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:50 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/2446118743' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:10:51.275 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:50 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/2446118743' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:10:51.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:50 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/2446118743' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:10:51.623 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T07:10:51.872 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:10:52.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:51 smithi179 ceph-mon[35716]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:10:52.305 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:51 smithi148 ceph-mon[31180]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:10:52.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:51 smithi165 ceph-mon[35326]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:10:52.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.384+0000 7fca0a4eb640 1 -- 172.21.15.148:0/2011046919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca0410c170 msgr2=0x7fca0410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:52.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.384+0000 7fca0a4eb640 1 --2- 172.21.15.148:0/2011046919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca0410c170 0x7fca0410e610 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009ca0 tx=0x7fc9fc02a950 comp rx=0 tx=0).stop 2024-09-19T07:10:52.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.384+0000 7fca0a4eb640 1 -- 172.21.15.148:0/2011046919 shutdown_connections 2024-09-19T07:10:52.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.384+0000 7fca0a4eb640 1 --2- 172.21.15.148:0/2011046919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca0410c170 0x7fca0410e610 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:52.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.384+0000 7fca0a4eb640 1 --2- 172.21.15.148:0/2011046919 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca04103660 0x7fca0410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:52.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.384+0000 7fca0a4eb640 1 --2- 172.21.15.148:0/2011046919 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca04102d40 0x7fca04103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:52.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.384+0000 7fca0a4eb640 1 -- 172.21.15.148:0/2011046919 >> 172.21.15.148:0/2011046919 conn(0x7fca040fc7a0 msgr2=0x7fca040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:52.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.384+0000 7fca0a4eb640 1 -- 172.21.15.148:0/2011046919 shutdown_connections 2024-09-19T07:10:52.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.385+0000 7fca0a4eb640 1 -- 172.21.15.148:0/2011046919 wait complete. 2024-09-19T07:10:52.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.385+0000 7fca0a4eb640 1 Processor -- start 2024-09-19T07:10:52.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.385+0000 7fca0a4eb640 1 -- start start 2024-09-19T07:10:52.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.386+0000 7fca0a4eb640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca04102d40 0x7fca041983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:52.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.386+0000 7fca0a4eb640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca04103660 0x7fca04198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:52.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.386+0000 7fca0a4eb640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca0410c170 0x7fca0419cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:52.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.386+0000 7fca0a4eb640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fca04111fb0 con 0x7fca0410c170 2024-09-19T07:10:52.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.386+0000 7fca0a4eb640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fca04111e30 con 0x7fca04102d40 2024-09-19T07:10:52.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.386+0000 7fca0a4eb640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fca04112130 con 0x7fca04103660 2024-09-19T07:10:52.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.386+0000 7fca08a88640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca0410c170 0x7fca0419cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:52.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.386+0000 7fca08a88640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca0410c170 0x7fca0419cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44952/0 (socket says 172.21.15.148:44952) 2024-09-19T07:10:52.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.386+0000 7fca08a88640 1 -- 172.21.15.148:0/3536244058 learned_addr learned my addr 172.21.15.148:0/3536244058 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:52.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.386+0000 7fca037fe640 1 --2- 172.21.15.148:0/3536244058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca04103660 0x7fca04198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:52.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.386+0000 7fca03fff640 1 --2- 172.21.15.148:0/3536244058 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca04102d40 0x7fca041983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:52.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.386+0000 7fca08a88640 1 -- 172.21.15.148:0/3536244058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca04103660 msgr2=0x7fca04198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:52.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.386+0000 7fca08a88640 1 --2- 172.21.15.148:0/3536244058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca04103660 0x7fca04198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:52.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.386+0000 7fca08a88640 1 -- 172.21.15.148:0/3536244058 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca04102d40 msgr2=0x7fca041983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:52.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.386+0000 7fca08a88640 1 --2- 172.21.15.148:0/3536244058 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca04102d40 0x7fca041983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:52.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.386+0000 7fca08a88640 1 -- 172.21.15.148:0/3536244058 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca0419d380 con 0x7fca0410c170 2024-09-19T07:10:52.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.386+0000 7fca03fff640 1 --2- 172.21.15.148:0/3536244058 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca04102d40 0x7fca041983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:10:52.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.386+0000 7fca08a88640 1 --2- 172.21.15.148:0/3536244058 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca0410c170 0x7fca0419cca0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc006010 tx=0x7fc9fc02f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:52.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.386+0000 7fca017fa640 1 -- 172.21.15.148:0/3536244058 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc034040 con 0x7fca0410c170 2024-09-19T07:10:52.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.387+0000 7fca017fa640 1 -- 172.21.15.148:0/3536244058 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9fc003e00 con 0x7fca0410c170 2024-09-19T07:10:52.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.387+0000 7fca0a4eb640 1 -- 172.21.15.148:0/3536244058 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca0419d610 con 0x7fca0410c170 2024-09-19T07:10:52.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.387+0000 7fca017fa640 1 -- 172.21.15.148:0/3536244058 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc0456e0 con 0x7fca0410c170 2024-09-19T07:10:52.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.387+0000 7fca0a4eb640 1 -- 172.21.15.148:0/3536244058 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca041a4f50 con 0x7fca0410c170 2024-09-19T07:10:52.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.388+0000 7fca0a4eb640 1 -- 172.21.15.148:0/3536244058 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca0406b070 con 0x7fca0410c170 2024-09-19T07:10:52.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.390+0000 7fca017fa640 1 -- 172.21.15.148:0/3536244058 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fc9fc037020 con 0x7fca0410c170 2024-09-19T07:10:52.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.390+0000 7fca017fa640 1 --2- 172.21.15.148:0/3536244058 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fc9f00a3350 0x7fc9f00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:52.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.390+0000 7fca03fff640 1 --2- 172.21.15.148:0/3536244058 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fc9f00a3350 0x7fc9f00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:52.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.390+0000 7fca017fa640 1 -- 172.21.15.148:0/3536244058 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7fc9fc0f0b80 con 0x7fca0410c170 2024-09-19T07:10:52.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.391+0000 7fca03fff640 1 --2- 172.21.15.148:0/3536244058 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fc9f00a3350 0x7fc9f00a5810 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc9f4006fd0 tx=0x7fc9f4008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:52.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.393+0000 7fca017fa640 1 -- 172.21.15.148:0/3536244058 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc9fc0bd860 con 0x7fca0410c170 2024-09-19T07:10:52.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.564+0000 7fca0a4eb640 1 -- 172.21.15.148:0/3536244058 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fca041a5120 con 0x7fca0410c170 2024-09-19T07:10:52.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.565+0000 7fca017fa640 1 -- 172.21.15.148:0/3536244058 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22807 (secure 0 0 0) 0x7fc9fc0bd160 con 0x7fca0410c170 2024-09-19T07:10:52.566 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:10:52.566 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":80,"fsid":"eae8a4a8-7654-11ef-bceb-c7b262605968","created":"2024-09-19T07:01:47.891210+0000","modified":"2024-09-19T07:09:38.168257+0000","last_up_change":"2024-09-19T07:08:30.785262+0000","last_in_change":"2024-09-19T07:08:07.001808+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:04:49.313270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T07:09:15.840600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T07:09:17.690782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7b854fad-d5a3-43e3-862e-7a0e8f243c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6803","nonce":512186330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6805","nonce":512186330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6809","nonce":512186330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6807","nonce":512186330}]},"public_addr":"172.21.15.148:6803/512186330","cluster_addr":"172.21.15.148:6805/512186330","heartbeat_back_addr":"172.21.15.148:6809/512186330","heartbeat_front_addr":"172.21.15.148:6807/512186330","state":["exists","up"]},{"osd":1,"uuid":"61b26278-f4db-40f0-97b9-c12a6ef1cd06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6801","nonce":2433984552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6803","nonce":2433984552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6807","nonce":2433984552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6805","nonce":2433984552}]},"public_addr":"172.21.15.165:6801/2433984552","cluster_addr":"172.21.15.165:6803/2433984552","heartbeat_back_addr":"172.21.15.165:6807/2433984552","heartbeat_front_addr":"172.21.15.165:6805/2433984552","state":["exists","up"]},{"osd":2,"uuid":"06620bbc-cdb5-4afc-8122-0bb3126630f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6801","nonce":3048365223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6803","nonce":3048365223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6807","nonce":3048365223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6805","nonce":3048365223}]},"public_addr":"172.21.15.179:6801/3048365223","cluster_addr":"172.21.15.179:6803/3048365223","heartbeat_back_addr":"172.21.15.179:6807/3048365223","heartbeat_front_addr":"172.21.15.179:6805/3048365223","state":["exists","up"]},{"osd":3,"uuid":"d7df45d4-5ef1-4f66-84a7-f61b8756c0c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6811","nonce":3662789091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6813","nonce":3662789091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6817","nonce":3662789091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6815","nonce":3662789091}]},"public_addr":"172.21.15.148:6811/3662789091","cluster_addr":"172.21.15.148:6813/3662789091","heartbeat_back_addr":"172.21.15.148:6817/3662789091","heartbeat_front_addr":"172.21.15.148:6815/3662789091","state":["exists","up"]},{"osd":4,"uuid":"5cfd359b-a8d2-4bdc-858f-087d26e0869c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6809","nonce":3082550323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6811","nonce":3082550323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6815","nonce":3082550323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6813","nonce":3082550323}]},"public_addr":"172.21.15.165:6809/3082550323","cluster_addr":"172.21.15.165:6811/3082550323","heartbeat_back_addr":"172.21.15.165:6815/3082550323","heartbeat_front_addr":"172.21.15.165:6813/3082550323","state":["exists","up"]},{"osd":5,"uuid":"8295e69b-87fe-4403-bb2e-d9dd42e2f398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6809","nonce":2125213751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6811","nonce":2125213751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6815","nonce":2125213751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6813","nonce":2125213751}]},"public_addr":"172.21.15.179:6809/2125213751","cluster_addr":"172.21.15.179:6811/2125213751","heartbeat_back_addr":"172.21.15.179:6815/2125213751","heartbeat_front_addr":"172.21.15.179:6813/2125213751","state":["exists","up"]},{"osd":6,"uuid":"4ce38d1a-06d3-4606-b00d-aa1ff977025f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6819","nonce":2178980310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6821","nonce":2178980310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6825","nonce":2178980310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6823","nonce":2178980310}]},"public_addr":"172.21.15.148:6819/2178980310","cluster_addr":"172.21.15.148:6821/2178980310","heartbeat_back_addr":"172.21.15.148:6825/2178980310","heartbeat_front_addr":"172.21.15.148:6823/2178980310","state":["exists","up"]},{"osd":7,"uuid":"9e68e2b2-9838-4ec0-b473-24f2434695ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6817","nonce":3961600099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6819","nonce":3961600099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6823","nonce":3961600099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6821","nonce":3961600099}]},"public_addr":"172.21.15.165:6817/3961600099","cluster_addr":"172.21.15.165:6819/3961600099","heartbeat_back_addr":"172.21.15.165:6823/3961600099","heartbeat_front_addr":"172.21.15.165:6821/3961600099","state":["exists","up"]},{"osd":8,"uuid":"297acce6-d3c7-4e1a-bf87-be093de51a6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6817","nonce":3642931467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6819","nonce":3642931467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6823","nonce":3642931467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6821","nonce":3642931467}]},"public_addr":"172.21.15.179:6817/3642931467","cluster_addr":"172.21.15.179:6819/3642931467","heartbeat_back_addr":"172.21.15.179:6823/3642931467","heartbeat_front_addr":"172.21.15.179:6821/3642931467","state":["exists","up"]},{"osd":9,"uuid":"ef488c5e-5353-4695-99dd-5b74ade436d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6827","nonce":3135409630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6829","nonce":3135409630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6833","nonce":3135409630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6831","nonce":3135409630}]},"public_addr":"172.21.15.148:6827/3135409630","cluster_addr":"172.21.15.148:6829/3135409630","heartbeat_back_addr":"172.21.15.148:6833/3135409630","heartbeat_front_addr":"172.21.15.148:6831/3135409630","state":["exists","up"]},{"osd":10,"uuid":"7a9f0379-1199-4266-910c-8d1d313d39e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6825","nonce":3554110731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6827","nonce":3554110731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6831","nonce":3554110731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6829","nonce":3554110731}]},"public_addr":"172.21.15.165:6825/3554110731","cluster_addr":"172.21.15.165:6827/3554110731","heartbeat_back_addr":"172.21.15.165:6831/3554110731","heartbeat_front_addr":"172.21.15.165:6829/3554110731","state":["exists","up"]},{"osd":11,"uuid":"eede97e9-5685-4603-806e-7078c6940536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6825","nonce":2026109940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6827","nonce":2026109940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6831","nonce":2026109940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6829","nonce":2026109940}]},"public_addr":"172.21.15.179:6825/2026109940","cluster_addr":"172.21.15.179:6827/2026109940","heartbeat_back_addr":"172.21.15.179:6831/2026109940","heartbeat_front_addr":"172.21.15.179:6829/2026109940","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:03:56.291685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:21.419682+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:46.377012+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:11.484234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:36.723101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:06:00.294617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:06:25.147230+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:06:49.318576+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:07:13.896399+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:07:38.930999+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:08:03.803463+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:08:28.731343+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.148:0/3534559227":"2024-09-20T07:02:37.007183+0000","172.21.15.148:0/1958388906":"2024-09-20T07:02:37.007183+0000","172.21.15.148:0/1922521135":"2024-09-20T07:02:37.007183+0000","172.21.15.148:6801/1949849385":"2024-09-20T07:02:37.007183+0000","172.21.15.148:6800/1949849385":"2024-09-20T07:02:37.007183+0000","172.21.15.148:6800/2161746152":"2024-09-20T07:02:14.557425+0000","172.21.15.148:6801/2161746152":"2024-09-20T07:02:14.557425+0000","172.21.15.148:0/1480486619":"2024-09-20T07:02:14.557425+0000","172.21.15.148:0/174481494":"2024-09-20T07:02:14.557425+0000","172.21.15.148:0/1114469409":"2024-09-20T07:02:14.557425+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T07:10:52.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.567+0000 7fca0a4eb640 1 -- 172.21.15.148:0/3536244058 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fc9f00a3350 msgr2=0x7fc9f00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:52.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.567+0000 7fca0a4eb640 1 --2- 172.21.15.148:0/3536244058 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fc9f00a3350 0x7fc9f00a5810 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc9f4006fd0 tx=0x7fc9f4008040 comp rx=0 tx=0).stop 2024-09-19T07:10:52.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.567+0000 7fca0a4eb640 1 -- 172.21.15.148:0/3536244058 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca0410c170 msgr2=0x7fca0419cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:52.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.568+0000 7fca0a4eb640 1 --2- 172.21.15.148:0/3536244058 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca0410c170 0x7fca0419cca0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc006010 tx=0x7fc9fc02f710 comp rx=0 tx=0).stop 2024-09-19T07:10:52.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.568+0000 7fca0a4eb640 1 -- 172.21.15.148:0/3536244058 shutdown_connections 2024-09-19T07:10:52.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.568+0000 7fca0a4eb640 1 --2- 172.21.15.148:0/3536244058 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fc9f00a3350 0x7fc9f00a5810 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:52.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.568+0000 7fca0a4eb640 1 --2- 172.21.15.148:0/3536244058 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca0410c170 0x7fca0419cca0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:52.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.568+0000 7fca0a4eb640 1 --2- 172.21.15.148:0/3536244058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca04103660 0x7fca04198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:52.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.568+0000 7fca0a4eb640 1 --2- 172.21.15.148:0/3536244058 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca04102d40 0x7fca041983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:52.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.568+0000 7fca0a4eb640 1 -- 172.21.15.148:0/3536244058 >> 172.21.15.148:0/3536244058 conn(0x7fca040fc7a0 msgr2=0x7fca040fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:52.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.568+0000 7fca0a4eb640 1 -- 172.21.15.148:0/3536244058 shutdown_connections 2024-09-19T07:10:52.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:52.568+0000 7fca0a4eb640 1 -- 172.21.15.148:0/3536244058 wait complete. 2024-09-19T07:10:53.139 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T07:09:19.543369+0000', 'modified': '2024-09-19T07:09:30.685034+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24457, 'mds_1': 24437, 'mds_2': 24436}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24410': {'gid': 24410, 'name': 'h', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.165:6837/3847988837', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.165:6836', 'nonce': 3847988837}, {'type': 'v1', 'addr': '172.21.15.165:6837', 'nonce': 3847988837}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24412': {'gid': 24412, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.179:6833/1289882987', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6832', 'nonce': 1289882987}, {'type': 'v1', 'addr': '172.21.15.179:6833', 'nonce': 1289882987}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24430': {'gid': 24430, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.179:6835/1566489108', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6834', 'nonce': 1566489108}, {'type': 'v1', 'addr': '172.21.15.179:6835', 'nonce': 1566489108}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24436': {'gid': 24436, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.179:6837/3827671241', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6836', 'nonce': 3827671241}, {'type': 'v1', 'addr': '172.21.15.179:6837', 'nonce': 3827671241}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24437': {'gid': 24437, 'name': 'b', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.165:6839/3993490234', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.165:6838', 'nonce': 3993490234}, {'type': 'v1', 'addr': '172.21.15.165:6839', 'nonce': 3993490234}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24457': {'gid': 24457, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.179:6839/2031305914', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6838', 'nonce': 2031305914}, {'type': 'v1', 'addr': '172.21.15.179:6839', 'nonce': 2031305914}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24457, 'qdb_cluster': [24436, 24437, 24457]} 2024-09-19T07:10:53.139 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-19T07:10:53.139 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph tell mds.c status 2024-09-19T07:10:53.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:52 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/3536244058' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:10:53.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:52 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/3536244058' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:10:53.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:52 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/3536244058' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:10:53.387 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:10:53.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.859+0000 7f041ffe8640 1 -- 172.21.15.148:0/2835995135 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0418102790 msgr2=0x7f04181067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:53.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.859+0000 7f041ffe8640 1 --2- 172.21.15.148:0/2835995135 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0418102790 0x7f04181067e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0408009900 tx=0x7f040802a410 comp rx=0 tx=0).stop 2024-09-19T07:10:53.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.859+0000 7f041ffe8640 1 -- 172.21.15.148:0/2835995135 shutdown_connections 2024-09-19T07:10:53.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.859+0000 7f041ffe8640 1 --2- 172.21.15.148:0/2835995135 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0418106f10 0x7f041810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:53.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.859+0000 7f041ffe8640 1 --2- 172.21.15.148:0/2835995135 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0418102790 0x7f04181067e0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:53.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.859+0000 7f041ffe8640 1 --2- 172.21.15.148:0/2835995135 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0418101de0 0x7f04181021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:53.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.859+0000 7f041ffe8640 1 -- 172.21.15.148:0/2835995135 >> 172.21.15.148:0/2835995135 conn(0x7f04180fd8c0 msgr2=0x7f04180ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:53.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.859+0000 7f041ffe8640 1 -- 172.21.15.148:0/2835995135 shutdown_connections 2024-09-19T07:10:53.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.859+0000 7f041ffe8640 1 -- 172.21.15.148:0/2835995135 wait complete. 2024-09-19T07:10:53.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.860+0000 7f041ffe8640 1 Processor -- start 2024-09-19T07:10:53.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.860+0000 7f041ffe8640 1 -- start start 2024-09-19T07:10:53.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.860+0000 7f041ffe8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0418101de0 0x7f0418198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:53.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.860+0000 7f041ffe8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0418102790 0x7f04181989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:53.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.860+0000 7f041ffe8640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0418106f10 0x7f041819cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:53.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.860+0000 7f041ffe8640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0418111f90 con 0x7f0418101de0 2024-09-19T07:10:53.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.860+0000 7f041ffe8640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0418111e10 con 0x7f0418106f10 2024-09-19T07:10:53.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.860+0000 7f041ffe8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0418112110 con 0x7f0418102790 2024-09-19T07:10:53.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.860+0000 7f041dd84640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0418101de0 0x7f0418198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:53.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.860+0000 7f041dd84640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0418101de0 0x7f0418198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44970/0 (socket says 172.21.15.148:44970) 2024-09-19T07:10:53.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.860+0000 7f041dd84640 1 -- 172.21.15.148:0/3083753242 learned_addr learned my addr 172.21.15.148:0/3083753242 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:53.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.860+0000 7f041d583640 1 --2- 172.21.15.148:0/3083753242 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0418102790 0x7f04181989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:53.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.860+0000 7f041dd84640 1 -- 172.21.15.148:0/3083753242 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0418102790 msgr2=0x7f04181989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:53.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.860+0000 7f041dd84640 1 --2- 172.21.15.148:0/3083753242 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0418102790 0x7f04181989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:53.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.860+0000 7f041dd84640 1 -- 172.21.15.148:0/3083753242 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0418106f10 msgr2=0x7f041819cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:53.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.860+0000 7f041dd84640 1 --2- 172.21.15.148:0/3083753242 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0418106f10 0x7f041819cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:53.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.860+0000 7f041dd84640 1 -- 172.21.15.148:0/3083753242 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f041819d420 con 0x7f0418101de0 2024-09-19T07:10:53.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.860+0000 7f041dd84640 1 --2- 172.21.15.148:0/3083753242 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0418101de0 0x7f0418198470 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f041400c890 tx=0x7f041400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:53.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.860+0000 7f040effd640 1 -- 172.21.15.148:0/3083753242 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0414004220 con 0x7f0418101de0 2024-09-19T07:10:53.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.861+0000 7f041ffe8640 1 -- 172.21.15.148:0/3083753242 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f041819d710 con 0x7f0418101de0 2024-09-19T07:10:53.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.861+0000 7f040effd640 1 -- 172.21.15.148:0/3083753242 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04140043c0 con 0x7f0418101de0 2024-09-19T07:10:53.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.861+0000 7f040effd640 1 -- 172.21.15.148:0/3083753242 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04140049e0 con 0x7f0418101de0 2024-09-19T07:10:53.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.861+0000 7f041ffe8640 1 -- 172.21.15.148:0/3083753242 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04181a4ff0 con 0x7f0418101de0 2024-09-19T07:10:53.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.863+0000 7f040effd640 1 -- 172.21.15.148:0/3083753242 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f04140079b0 con 0x7f0418101de0 2024-09-19T07:10:53.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.863+0000 7f04223c1740 1 Processor -- start 2024-09-19T07:10:53.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.863+0000 7f04223c1740 1 -- start start 2024-09-19T07:10:53.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.864+0000 7f04223c1740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d58145a9d0 0x55d58145adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:53.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.864+0000 7f04223c1740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d58145b2f0 0x55d581465670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:53.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.864+0000 7f04223c1740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d581465bb0 0x55d581467fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:53.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.864+0000 7f04223c1740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55d5813c1090 con 0x55d58145a9d0 2024-09-19T07:10:53.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.864+0000 7f04223c1740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55d581368a70 con 0x55d581465bb0 2024-09-19T07:10:53.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.864+0000 7f04223c1740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d5813bd050 con 0x55d58145b2f0 2024-09-19T07:10:53.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.864+0000 7f041e585640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d58145a9d0 0x55d58145adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:53.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.864+0000 7f040effd640 1 --2- 172.21.15.148:0/3083753242 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f04040a32d0 0x7f04040a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:53.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.864+0000 7f041dd84640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d58145b2f0 0x55d581465670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:53.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.864+0000 7f041e585640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d58145a9d0 0x55d58145adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44972/0 (socket says 172.21.15.148:44972) 2024-09-19T07:10:53.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.864+0000 7f041e585640 1 -- 172.21.15.148:0/3396238452 learned_addr learned my addr 172.21.15.148:0/3396238452 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:53.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.864+0000 7f041d583640 1 --2- 172.21.15.148:0/3396238452 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d581465bb0 0x55d581467fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:53.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.864+0000 7f041e585640 1 --2- 172.21.15.148:0/3083753242 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f04040a32d0 0x7f04040a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:53.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.864+0000 7f041e585640 1 -- 172.21.15.148:0/3396238452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d58145b2f0 msgr2=0x55d581465670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:10:53.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.864+0000 7f041e585640 1 --2- 172.21.15.148:0/3396238452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d58145b2f0 0x55d581465670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:53.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.864+0000 7f041e585640 1 -- 172.21.15.148:0/3396238452 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d581465bb0 msgr2=0x55d581467fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:10:53.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.864+0000 7f041e585640 1 --2- 172.21.15.148:0/3396238452 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d581465bb0 0x55d581467fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:53.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.864+0000 7f040effd640 1 -- 172.21.15.148:0/3083753242 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7f04140cfc00 con 0x7f0418101de0 2024-09-19T07:10:53.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.864+0000 7f041e585640 1 -- 172.21.15.148:0/3396238452 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d581375130 con 0x55d58145a9d0 2024-09-19T07:10:53.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.864+0000 7f041e585640 1 --2- 172.21.15.148:0/3396238452 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d58145a9d0 0x55d58145adb0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f04100126c0 tx=0x7f0410012b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f20abcb3f5ae7271 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:53.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.865+0000 7f0403fff640 1 -- 172.21.15.148:0/3396238452 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0410012050 con 0x55d58145a9d0 2024-09-19T07:10:53.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.865+0000 7f0403fff640 1 -- 172.21.15.148:0/3396238452 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0410013040 con 0x55d58145a9d0 2024-09-19T07:10:53.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.865+0000 7f0403fff640 1 -- 172.21.15.148:0/3396238452 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f041001b070 con 0x55d58145a9d0 2024-09-19T07:10:53.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.865+0000 7f04223c1740 1 -- 172.21.15.148:0/3396238452 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d58145a9d0 msgr2=0x55d58145adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:53.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.865+0000 7f041e585640 1 --2- 172.21.15.148:0/3083753242 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f04040a32d0 0x7f04040a5790 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f041001d000 tx=0x7f041001b000 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:53.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.865+0000 7f04223c1740 1 --2- 172.21.15.148:0/3396238452 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d58145a9d0 0x55d58145adb0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f04100126c0 tx=0x7f0410012b80 comp rx=0 tx=0).stop 2024-09-19T07:10:53.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.865+0000 7f04223c1740 1 -- 172.21.15.148:0/3396238452 shutdown_connections 2024-09-19T07:10:53.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.865+0000 7f04223c1740 1 --2- 172.21.15.148:0/3396238452 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d581465bb0 0x55d581467fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:53.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.865+0000 7f04223c1740 1 --2- 172.21.15.148:0/3396238452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d58145b2f0 0x55d581465670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:53.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.865+0000 7f04223c1740 1 --2- 172.21.15.148:0/3396238452 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d58145a9d0 0x55d58145adb0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:53.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.865+0000 7f04223c1740 1 -- 172.21.15.148:0/3396238452 >> 172.21.15.148:0/3396238452 conn(0x55d581456f60 msgr2=0x55d581457340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:53.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.865+0000 7f04223c1740 1 -- 172.21.15.148:0/3396238452 shutdown_connections 2024-09-19T07:10:53.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.866+0000 7f04223c1740 1 -- 172.21.15.148:0/3396238452 wait complete. 2024-09-19T07:10:53.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.866+0000 7f04223c1740 1 -- start start 2024-09-19T07:10:53.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.866+0000 7f04223c1740 1 Processor -- start 2024-09-19T07:10:53.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.866+0000 7f04223c1740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d58145a9d0 0x55d5814653e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:53.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.866+0000 7f04223c1740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d58145b2f0 0x55d581462730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:53.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.866+0000 7f04223c1740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d581465bb0 0x55d581462c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:53.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.866+0000 7f04223c1740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55d581468780 con 0x55d58145a9d0 2024-09-19T07:10:53.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.866+0000 7f04223c1740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55d58137bf20 con 0x55d58145b2f0 2024-09-19T07:10:53.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.866+0000 7f04223c1740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d581468900 con 0x55d581465bb0 2024-09-19T07:10:53.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.867+0000 7f04223c1740 10 client.0 _ll_register_callbacks cb 0x55d581345030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:10:53.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.867+0000 7f041dd84640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d58145a9d0 0x55d5814653e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:53.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.867+0000 7f041dd84640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d58145a9d0 0x55d5814653e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44978/0 (socket says 172.21.15.148:44978) 2024-09-19T07:10:53.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.867+0000 7f041dd84640 1 -- 172.21.15.148:0/3237986426 learned_addr learned my addr 172.21.15.148:0/3237986426 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:53.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.867+0000 7f041d583640 1 --2- 172.21.15.148:0/3237986426 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d58145b2f0 0x55d581462730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:53.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.867+0000 7f041e585640 1 --2- 172.21.15.148:0/3237986426 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d581465bb0 0x55d581462c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:53.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.867+0000 7f041dd84640 1 -- 172.21.15.148:0/3237986426 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d581465bb0 msgr2=0x55d581462c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:10:53.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.867+0000 7f041dd84640 1 --2- 172.21.15.148:0/3237986426 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d581465bb0 0x55d581462c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:53.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.867+0000 7f041dd84640 1 -- 172.21.15.148:0/3237986426 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d58145b2f0 msgr2=0x55d581462730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:10:53.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.867+0000 7f041dd84640 1 --2- 172.21.15.148:0/3237986426 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d58145b2f0 0x55d581462730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:53.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.867+0000 7f041dd84640 1 -- 172.21.15.148:0/3237986426 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5811322b0 con 0x55d58145a9d0 2024-09-19T07:10:53.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.867+0000 7f041d583640 1 --2- 172.21.15.148:0/3237986426 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d58145b2f0 0x55d581462730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:10:53.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.867+0000 7f041e585640 1 --2- 172.21.15.148:0/3237986426 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d581465bb0 0x55d581462c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:10:53.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.867+0000 7f041dd84640 1 --2- 172.21.15.148:0/3237986426 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d58145a9d0 0x55d5814653e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f041409bfb0 tx=0x7f04140054a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a52e4b206fd60f85 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:53.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.867+0000 7f04017fa640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:10:53.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.867+0000 7f04017fa640 1 -- 172.21.15.148:0/3237986426 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04140d3070 con 0x55d58145a9d0 2024-09-19T07:10:53.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.867+0000 7f04017fa640 1 -- 172.21.15.148:0/3237986426 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7f04140cd7b0 con 0x55d58145a9d0 2024-09-19T07:10:53.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.867+0000 7f04223c1740 1 -- 172.21.15.148:0/3237986426 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0410013040 con 0x55d58145a9d0 2024-09-19T07:10:53.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.867+0000 7f04017fa640 1 -- 172.21.15.148:0/3237986426 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f041401d040 con 0x55d58145a9d0 2024-09-19T07:10:53.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.867+0000 7f04223c1740 10 client.15060 fetch_fsmap learned FSMap version 24 2024-09-19T07:10:53.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.867+0000 7f04223c1740 1 -- 172.21.15.148:0/3237986426 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d581474030 con 0x55d58145a9d0 2024-09-19T07:10:53.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.867+0000 7f04017fa640 1 -- 172.21.15.148:0/3237986426 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0410013040 con 0x55d58145a9d0 2024-09-19T07:10:53.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.868+0000 7f04017fa640 1 -- 172.21.15.148:0/3237986426 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f041409c2d0 con 0x55d58145a9d0 2024-09-19T07:10:53.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.868+0000 7f04223c1740 10 client.15060 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:10:53.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.868+0000 7f04223c1740 10 client.15060 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T07:10:53.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.868+0000 7f04223c1740 20 client.15060 populate_metadata read hostname 'smithi148' 2024-09-19T07:10:53.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.868+0000 7f04223c1740 1 --2- 172.21.15.148:0/3237986426 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x55d581476610 0x55d581477a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:53.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.868+0000 7f04223c1740 4 client.15060 mds_command: new command op to 24436 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:10:53.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.868+0000 7f04223c1740 1 -- 172.21.15.148:0/3237986426 --> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d5813ce600 con 0x55d581476610 2024-09-19T07:10:53.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.868+0000 7f041d583640 1 --2- 172.21.15.148:0/3237986426 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x55d581476610 0x55d581477a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:53.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.868+0000 7f041d583640 1 --2- 172.21.15.148:0/3237986426 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x55d581476610 0x55d581477a80 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fc12e83b0a5126c1 server_cookie=c8b03d7fb26d63b3 in_seq=0 out_seq=0 2024-09-19T07:10:53.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.868+0000 7f04017fa640 10 client.15060 ms_handle_connect on v2:172.21.15.179:6836/3827671241 2024-09-19T07:10:53.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.869+0000 7f04017fa640 1 -- 172.21.15.148:0/3237986426 <== mds.2 v2:172.21.15.179:6836/3827671241 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d5813ce600 con 0x55d581476610 2024-09-19T07:10:53.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.869+0000 7f04017fa640 10 client.15060 handle_command_reply: tid=0 2024-09-19T07:10:53.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.869+0000 7f04223c1740 1 client.15060 shutdown 2024-09-19T07:10:53.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.869+0000 7f04223c1740 1 -- 172.21.15.148:0/3237986426 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d58145a9d0 msgr2=0x55d5814653e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:53.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.869+0000 7f04223c1740 1 --2- 172.21.15.148:0/3237986426 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d58145a9d0 0x55d5814653e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f041409bfb0 tx=0x7f04140054a0 comp rx=0 tx=0).stop 2024-09-19T07:10:53.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.869+0000 7f04223c1740 1 -- 172.21.15.148:0/3237986426 shutdown_connections 2024-09-19T07:10:53.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.869+0000 7f04223c1740 1 --2- 172.21.15.148:0/3237986426 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x55d581476610 0x55d581477a80 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:53.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.869+0000 7f04223c1740 1 --2- 172.21.15.148:0/3237986426 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d581465bb0 0x55d581462c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:53.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.869+0000 7f04223c1740 1 --2- 172.21.15.148:0/3237986426 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d58145b2f0 0x55d581462730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:53.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.869+0000 7f04223c1740 1 --2- 172.21.15.148:0/3237986426 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d58145a9d0 0x55d5814653e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:53.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.869+0000 7f04017fa640 0 client.15060 ms_handle_reset on v2:172.21.15.179:6836/3827671241 2024-09-19T07:10:53.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.869+0000 7f04223c1740 1 -- 172.21.15.148:0/3237986426 >> 172.21.15.148:0/3237986426 conn(0x55d581456f60 msgr2=0x55d58145cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:53.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.869+0000 7f04223c1740 1 -- 172.21.15.148:0/3237986426 shutdown_connections 2024-09-19T07:10:53.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.869+0000 7f04223c1740 1 -- 172.21.15.148:0/3237986426 wait complete. 2024-09-19T07:10:53.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.870+0000 7f04223c1740 20 client.15060 trim_cache size 0 max 16384 2024-09-19T07:10:53.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.887+0000 7f04223c1740 1 Processor -- start 2024-09-19T07:10:53.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.887+0000 7f04223c1740 1 -- start start 2024-09-19T07:10:53.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.887+0000 7f04223c1740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d58145a9d0 0x55d581475f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:53.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.887+0000 7f04223c1740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d58145b2f0 0x55d581477a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:53.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.887+0000 7f04223c1740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d581465bb0 0x55d581480150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:53.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.888+0000 7f04223c1740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55d581475dc0 con 0x55d58145b2f0 2024-09-19T07:10:53.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.888+0000 7f04223c1740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55d581476490 con 0x55d58145a9d0 2024-09-19T07:10:53.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.888+0000 7f04223c1740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d581476b60 con 0x55d581465bb0 2024-09-19T07:10:53.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.888+0000 7f041d583640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d58145b2f0 0x55d581477a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:53.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.888+0000 7f041d583640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d58145b2f0 0x55d581477a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44992/0 (socket says 172.21.15.148:44992) 2024-09-19T07:10:53.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.888+0000 7f041d583640 1 -- 172.21.15.148:0/792884408 learned_addr learned my addr 172.21.15.148:0/792884408 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:53.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.888+0000 7f041dd84640 1 --2- 172.21.15.148:0/792884408 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d58145a9d0 0x55d581475f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:53.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.888+0000 7f041d583640 1 -- 172.21.15.148:0/792884408 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d581465bb0 msgr2=0x55d581480150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:10:53.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.888+0000 7f041d583640 1 --2- 172.21.15.148:0/792884408 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d581465bb0 0x55d581480150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:53.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.888+0000 7f041d583640 1 -- 172.21.15.148:0/792884408 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d58145a9d0 msgr2=0x55d581475f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:10:53.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.888+0000 7f041d583640 1 --2- 172.21.15.148:0/792884408 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d58145a9d0 0x55d581475f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:53.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.888+0000 7f041d583640 1 -- 172.21.15.148:0/792884408 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d58145b120 con 0x55d58145b2f0 2024-09-19T07:10:53.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.888+0000 7f041d583640 1 --2- 172.21.15.148:0/792884408 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d58145b2f0 0x55d581477a80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f040802a930 tx=0x7f0408005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf4101e98cc81d03 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:53.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.888+0000 7f04037fe640 1 -- 172.21.15.148:0/792884408 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0408048070 con 0x55d58145b2f0 2024-09-19T07:10:53.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.888+0000 7f04037fe640 1 -- 172.21.15.148:0/792884408 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0408005500 con 0x55d58145b2f0 2024-09-19T07:10:53.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.888+0000 7f04037fe640 1 -- 172.21.15.148:0/792884408 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0408035040 con 0x55d58145b2f0 2024-09-19T07:10:53.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.889+0000 7f04223c1740 1 -- 172.21.15.148:0/792884408 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d58145b2f0 msgr2=0x55d581477a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:53.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.889+0000 7f04223c1740 1 --2- 172.21.15.148:0/792884408 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d58145b2f0 0x55d581477a80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f040802a930 tx=0x7f0408005a20 comp rx=0 tx=0).stop 2024-09-19T07:10:53.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.889+0000 7f04223c1740 1 -- 172.21.15.148:0/792884408 shutdown_connections 2024-09-19T07:10:53.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.889+0000 7f04223c1740 1 --2- 172.21.15.148:0/792884408 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d581465bb0 0x55d581480150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:53.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.889+0000 7f04223c1740 1 --2- 172.21.15.148:0/792884408 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d58145b2f0 0x55d581477a80 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:53.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.889+0000 7f04223c1740 1 --2- 172.21.15.148:0/792884408 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d58145a9d0 0x55d581475f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:53.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.889+0000 7f04223c1740 1 -- 172.21.15.148:0/792884408 >> 172.21.15.148:0/792884408 conn(0x55d581456f60 msgr2=0x55d581451ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:53.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.889+0000 7f04223c1740 1 -- 172.21.15.148:0/792884408 shutdown_connections 2024-09-19T07:10:53.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.889+0000 7f04223c1740 1 -- 172.21.15.148:0/792884408 wait complete. 2024-09-19T07:10:53.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.889+0000 7f04223c1740 1 -- start start 2024-09-19T07:10:53.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.889+0000 7f04223c1740 1 Processor -- start 2024-09-19T07:10:53.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.890+0000 7f04223c1740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d58145a9d0 0x55d5814795e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:53.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.890+0000 7f04223c1740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d58145b2f0 0x55d581479b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:53.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.890+0000 7f04223c1740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d581465bb0 0x55d5814dcd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:53.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.890+0000 7f04223c1740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55d581477900 con 0x55d581465bb0 2024-09-19T07:10:53.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.890+0000 7f04223c1740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55d581477230 con 0x55d58145b2f0 2024-09-19T07:10:53.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.890+0000 7f04223c1740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d581477fd0 con 0x55d58145a9d0 2024-09-19T07:10:53.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.890+0000 7f04223c1740 10 client.0 _ll_register_callbacks cb 0x7f0414004570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:10:53.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.890+0000 7f041e585640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d581465bb0 0x55d5814dcd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:53.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.890+0000 7f041e585640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d581465bb0 0x55d5814dcd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45002/0 (socket says 172.21.15.148:45002) 2024-09-19T07:10:53.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.890+0000 7f041e585640 1 -- 172.21.15.148:0/1653154997 learned_addr learned my addr 172.21.15.148:0/1653154997 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:53.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.890+0000 7f041d583640 1 --2- 172.21.15.148:0/1653154997 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d58145b2f0 0x55d581479b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:53.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.890+0000 7f041dd84640 1 --2- 172.21.15.148:0/1653154997 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d58145a9d0 0x55d5814795e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:53.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.890+0000 7f041e585640 1 -- 172.21.15.148:0/1653154997 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d58145a9d0 msgr2=0x55d5814795e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:10:53.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.890+0000 7f041e585640 1 --2- 172.21.15.148:0/1653154997 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d58145a9d0 0x55d5814795e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:53.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.890+0000 7f041e585640 1 -- 172.21.15.148:0/1653154997 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d58145b2f0 msgr2=0x55d581479b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:10:53.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.890+0000 7f041e585640 1 --2- 172.21.15.148:0/1653154997 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d58145b2f0 0x55d581479b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:53.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.890+0000 7f041e585640 1 -- 172.21.15.148:0/1653154997 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5814dd430 con 0x55d581465bb0 2024-09-19T07:10:53.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.890+0000 7f041dd84640 1 --2- 172.21.15.148:0/1653154997 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d58145a9d0 0x55d5814795e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:10:53.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.890+0000 7f041e585640 1 --2- 172.21.15.148:0/1653154997 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d581465bb0 0x55d5814dcd90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f0410014010 tx=0x7f041000ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8996751bc3ad62 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:53.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.890+0000 7f04017fa640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:10:53.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.891+0000 7f04017fa640 1 -- 172.21.15.148:0/1653154997 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0410012040 con 0x55d581465bb0 2024-09-19T07:10:53.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.891+0000 7f04223c1740 1 -- 172.21.15.148:0/1653154997 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0408005500 con 0x55d581465bb0 2024-09-19T07:10:53.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.891+0000 7f04017fa640 1 -- 172.21.15.148:0/1653154997 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7f0410020860 con 0x55d581465bb0 2024-09-19T07:10:53.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.891+0000 7f04017fa640 1 -- 172.21.15.148:0/1653154997 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0410020a60 con 0x55d581465bb0 2024-09-19T07:10:53.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.891+0000 7f04223c1740 10 client.15066 fetch_fsmap learned FSMap version 24 2024-09-19T07:10:53.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.891+0000 7f04223c1740 1 -- 172.21.15.148:0/1653154997 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d5814e47e0 con 0x55d581465bb0 2024-09-19T07:10:53.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.891+0000 7f04017fa640 1 -- 172.21.15.148:0/1653154997 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0408005500 con 0x55d581465bb0 2024-09-19T07:10:53.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.891+0000 7f04017fa640 1 -- 172.21.15.148:0/1653154997 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f0410034b20 con 0x55d581465bb0 2024-09-19T07:10:53.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.891+0000 7f04223c1740 10 client.15066 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:10:53.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.891+0000 7f04223c1740 10 client.15066 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T07:10:53.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.891+0000 7f04223c1740 20 client.15066 populate_metadata read hostname 'smithi148' 2024-09-19T07:10:53.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.891+0000 7f04223c1740 1 --2- 172.21.15.148:0/1653154997 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x55d5814e8fc0 0x55d5814e7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:53.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.891+0000 7f04223c1740 4 client.15066 mds_command: new command op to 24436 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T07:10:53.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.891+0000 7f04223c1740 1 -- 172.21.15.148:0/1653154997 --> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] -- command(tid 0: {"prefix": "status"}) -- 0x55d5813c8b10 con 0x55d5814e8fc0 2024-09-19T07:10:53.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.892+0000 7f041dd84640 1 --2- 172.21.15.148:0/1653154997 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x55d5814e8fc0 0x55d5814e7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:53.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.892+0000 7f04017fa640 10 client.15066 ms_handle_connect on v2:172.21.15.179:6836/3827671241 2024-09-19T07:10:53.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.892+0000 7f041dd84640 1 --2- 172.21.15.148:0/1653154997 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x55d5814e8fc0 0x55d5814e7cd0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c2a1778462d87049 server_cookie=c814d4677eb9ba24 in_seq=0 out_seq=0 2024-09-19T07:10:53.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.892+0000 7f04017fa640 1 -- 172.21.15.148:0/1653154997 <== mds.2 v2:172.21.15.179:6836/3827671241 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55d5813c8b10 con 0x55d5814e8fc0 2024-09-19T07:10:53.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.892+0000 7f04017fa640 10 client.15066 handle_command_reply: tid=0 2024-09-19T07:10:53.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.892+0000 7f04223c1740 1 client.15066 shutdown 2024-09-19T07:10:53.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.892+0000 7f04223c1740 1 -- 172.21.15.148:0/1653154997 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d581465bb0 msgr2=0x55d5814dcd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:53.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.892+0000 7f04223c1740 1 --2- 172.21.15.148:0/1653154997 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d581465bb0 0x55d5814dcd90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f0410014010 tx=0x7f041000ff70 comp rx=0 tx=0).stop 2024-09-19T07:10:53.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.892+0000 7f04223c1740 1 -- 172.21.15.148:0/1653154997 shutdown_connections 2024-09-19T07:10:53.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.892+0000 7f04223c1740 1 --2- 172.21.15.148:0/1653154997 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x55d5814e8fc0 0x55d5814e7cd0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:53.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.892+0000 7f04223c1740 1 --2- 172.21.15.148:0/1653154997 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d581465bb0 0x55d5814dcd90 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:53.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.892+0000 7f04223c1740 1 --2- 172.21.15.148:0/1653154997 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d58145b2f0 0x55d581479b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:53.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.892+0000 7f04223c1740 1 --2- 172.21.15.148:0/1653154997 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d58145a9d0 0x55d5814795e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:53.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.892+0000 7f04017fa640 0 client.15066 ms_handle_reset on v2:172.21.15.179:6836/3827671241 2024-09-19T07:10:53.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.892+0000 7f04223c1740 1 -- 172.21.15.148:0/1653154997 >> 172.21.15.148:0/1653154997 conn(0x55d581456f60 msgr2=0x55d581457340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:53.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.892+0000 7f04223c1740 1 -- 172.21.15.148:0/1653154997 shutdown_connections 2024-09-19T07:10:53.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.892+0000 7f04223c1740 1 -- 172.21.15.148:0/1653154997 wait complete. 2024-09-19T07:10:53.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.893+0000 7f04223c1740 20 client.15066 trim_cache size 0 max 16384 2024-09-19T07:10:53.908 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:10:53.909 INFO:teuthology.orchestra.run.smithi148.stdout: "cluster_fsid": "eae8a4a8-7654-11ef-bceb-c7b262605968", 2024-09-19T07:10:53.909 INFO:teuthology.orchestra.run.smithi148.stdout: "whoami": 2, 2024-09-19T07:10:53.909 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 24436, 2024-09-19T07:10:53.909 INFO:teuthology.orchestra.run.smithi148.stdout: "want_state": "up:active", 2024-09-19T07:10:53.909 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "up:active", 2024-09-19T07:10:53.909 INFO:teuthology.orchestra.run.smithi148.stdout: "fs_name": "cephfs", 2024-09-19T07:10:53.909 INFO:teuthology.orchestra.run.smithi148.stdout: "rank_uptime": 85.915611354000006, 2024-09-19T07:10:53.909 INFO:teuthology.orchestra.run.smithi148.stdout: "mdsmap_epoch": 24, 2024-09-19T07:10:53.909 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch": 80, 2024-09-19T07:10:53.909 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch_barrier": 78, 2024-09-19T07:10:53.909 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 117.93615435300001 2024-09-19T07:10:53.909 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:10:53.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.893+0000 7f041ffe8640 1 -- 172.21.15.148:0/3083753242 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f04040a32d0 msgr2=0x7f04040a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:53.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.893+0000 7f041ffe8640 1 --2- 172.21.15.148:0/3083753242 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f04040a32d0 0x7f04040a5790 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f041001d000 tx=0x7f041001b000 comp rx=0 tx=0).stop 2024-09-19T07:10:53.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.893+0000 7f041ffe8640 1 -- 172.21.15.148:0/3083753242 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0418101de0 msgr2=0x7f0418198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:53.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.893+0000 7f041ffe8640 1 --2- 172.21.15.148:0/3083753242 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0418101de0 0x7f0418198470 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f041400c890 tx=0x7f041400cd50 comp rx=0 tx=0).stop 2024-09-19T07:10:53.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.893+0000 7f041ffe8640 1 -- 172.21.15.148:0/3083753242 shutdown_connections 2024-09-19T07:10:53.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.893+0000 7f041ffe8640 1 --2- 172.21.15.148:0/3083753242 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f04040a32d0 0x7f04040a5790 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:53.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.893+0000 7f041ffe8640 1 --2- 172.21.15.148:0/3083753242 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0418106f10 0x7f041819cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:53.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.893+0000 7f041ffe8640 1 --2- 172.21.15.148:0/3083753242 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0418102790 0x7f04181989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:53.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.893+0000 7f041ffe8640 1 --2- 172.21.15.148:0/3083753242 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0418101de0 0x7f0418198470 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:53.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.893+0000 7f041ffe8640 1 -- 172.21.15.148:0/3083753242 >> 172.21.15.148:0/3083753242 conn(0x7f04180fd8c0 msgr2=0x7f04180fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:53.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.893+0000 7f041ffe8640 1 -- 172.21.15.148:0/3083753242 shutdown_connections 2024-09-19T07:10:53.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:53.893+0000 7f041ffe8640 1 -- 172.21.15.148:0/3083753242 wait complete. 2024-09-19T07:10:54.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:53 smithi148 ceph-mon[31180]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:10:54.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:53 smithi179 ceph-mon[35716]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:10:54.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:53 smithi165 ceph-mon[35326]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:10:54.586 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T07:10:54.834 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:10:55.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.332+0000 7fad4bfa4640 1 -- 172.21.15.148:0/3928945067 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad44102790 msgr2=0x7fad441067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:55.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.332+0000 7fad4bfa4640 1 --2- 172.21.15.148:0/3928945067 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad44102790 0x7fad441067e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fad34009900 tx=0x7fad3402a410 comp rx=0 tx=0).stop 2024-09-19T07:10:55.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.332+0000 7fad4bfa4640 1 -- 172.21.15.148:0/3928945067 shutdown_connections 2024-09-19T07:10:55.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.332+0000 7fad4bfa4640 1 --2- 172.21.15.148:0/3928945067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad44106f10 0x7fad4410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:55.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.332+0000 7fad4bfa4640 1 --2- 172.21.15.148:0/3928945067 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad44102790 0x7fad441067e0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:55.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.332+0000 7fad4bfa4640 1 --2- 172.21.15.148:0/3928945067 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fad44101de0 0x7fad441021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:55.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.332+0000 7fad4bfa4640 1 -- 172.21.15.148:0/3928945067 >> 172.21.15.148:0/3928945067 conn(0x7fad440fd8c0 msgr2=0x7fad440ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:55.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.332+0000 7fad4bfa4640 1 -- 172.21.15.148:0/3928945067 shutdown_connections 2024-09-19T07:10:55.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.332+0000 7fad4bfa4640 1 -- 172.21.15.148:0/3928945067 wait complete. 2024-09-19T07:10:55.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.333+0000 7fad4bfa4640 1 Processor -- start 2024-09-19T07:10:55.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.333+0000 7fad4bfa4640 1 -- start start 2024-09-19T07:10:55.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.333+0000 7fad4bfa4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad44101de0 0x7fad4419a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:55.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.333+0000 7fad4bfa4640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fad44102790 0x7fad4419ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:55.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.333+0000 7fad4bfa4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad44106f10 0x7fad4419efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:55.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.333+0000 7fad4bfa4640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fad44111f90 con 0x7fad44101de0 2024-09-19T07:10:55.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.333+0000 7fad4bfa4640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fad44111e10 con 0x7fad44102790 2024-09-19T07:10:55.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.333+0000 7fad4bfa4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fad44112110 con 0x7fad44106f10 2024-09-19T07:10:55.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.333+0000 7fad49d40640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad44101de0 0x7fad4419a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:55.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.333+0000 7fad49d40640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad44101de0 0x7fad4419a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43490/0 (socket says 172.21.15.148:43490) 2024-09-19T07:10:55.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.333+0000 7fad49d40640 1 -- 172.21.15.148:0/3561917095 learned_addr learned my addr 172.21.15.148:0/3561917095 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:55.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.333+0000 7fad4953f640 1 --2- 172.21.15.148:0/3561917095 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fad44102790 0x7fad4419ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:55.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.333+0000 7fad49d40640 1 -- 172.21.15.148:0/3561917095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad44106f10 msgr2=0x7fad4419efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:55.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.333+0000 7fad4a541640 1 --2- 172.21.15.148:0/3561917095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad44106f10 0x7fad4419efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:55.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.333+0000 7fad49d40640 1 --2- 172.21.15.148:0/3561917095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad44106f10 0x7fad4419efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:55.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.333+0000 7fad49d40640 1 -- 172.21.15.148:0/3561917095 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fad44102790 msgr2=0x7fad4419ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:55.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.333+0000 7fad49d40640 1 --2- 172.21.15.148:0/3561917095 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fad44102790 0x7fad4419ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:55.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.333+0000 7fad49d40640 1 -- 172.21.15.148:0/3561917095 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad4419f6a0 con 0x7fad44101de0 2024-09-19T07:10:55.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.333+0000 7fad4953f640 1 --2- 172.21.15.148:0/3561917095 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fad44102790 0x7fad4419ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:10:55.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.333+0000 7fad4a541640 1 --2- 172.21.15.148:0/3561917095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad44106f10 0x7fad4419efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:10:55.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.333+0000 7fad49d40640 1 --2- 172.21.15.148:0/3561917095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad44101de0 0x7fad4419a6f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fad4000c920 tx=0x7fad4000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:55.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.334+0000 7fad3affd640 1 -- 172.21.15.148:0/3561917095 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad40007c70 con 0x7fad44101de0 2024-09-19T07:10:55.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.334+0000 7fad3affd640 1 -- 172.21.15.148:0/3561917095 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad40007e10 con 0x7fad44101de0 2024-09-19T07:10:55.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.334+0000 7fad4bfa4640 1 -- 172.21.15.148:0/3561917095 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad4419f990 con 0x7fad44101de0 2024-09-19T07:10:55.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.334+0000 7fad3affd640 1 -- 172.21.15.148:0/3561917095 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad40018890 con 0x7fad44101de0 2024-09-19T07:10:55.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.334+0000 7fad4bfa4640 1 -- 172.21.15.148:0/3561917095 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad441a7270 con 0x7fad44101de0 2024-09-19T07:10:55.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.336+0000 7fad3affd640 1 -- 172.21.15.148:0/3561917095 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fad40018a70 con 0x7fad44101de0 2024-09-19T07:10:55.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.336+0000 7fad4e37d740 1 Processor -- start 2024-09-19T07:10:55.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.336+0000 7fad4e37d740 1 -- start start 2024-09-19T07:10:55.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.337+0000 7fad3affd640 1 --2- 172.21.15.148:0/3561917095 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fad300a32d0 0x7fad300a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:55.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.337+0000 7fad4e37d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56402491e9d0 0x56402491edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:55.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.337+0000 7fad4e37d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56402491f2f0 0x564024929670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:55.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.337+0000 7fad4e37d740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564024929bb0 0x56402492bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:55.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.337+0000 7fad4e37d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x564024885090 con 0x56402491e9d0 2024-09-19T07:10:55.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.337+0000 7fad4e37d740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56402482ca70 con 0x564024929bb0 2024-09-19T07:10:55.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.337+0000 7fad4e37d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564024881050 con 0x56402491f2f0 2024-09-19T07:10:55.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.337+0000 7fad49d40640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56402491e9d0 0x56402491edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:55.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.337+0000 7fad49d40640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56402491e9d0 0x56402491edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43500/0 (socket says 172.21.15.148:43500) 2024-09-19T07:10:55.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.337+0000 7fad49d40640 1 -- 172.21.15.148:0/2185717248 learned_addr learned my addr 172.21.15.148:0/2185717248 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:55.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.337+0000 7fad4a541640 1 --2- 172.21.15.148:0/3561917095 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fad300a32d0 0x7fad300a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:55.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.337+0000 7fad3affd640 1 -- 172.21.15.148:0/3561917095 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7fad400cfcf0 con 0x7fad44101de0 2024-09-19T07:10:55.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.337+0000 7fad4953f640 1 --2- 172.21.15.148:0/2185717248 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56402491f2f0 0x564024929670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:55.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.337+0000 7fad49d40640 1 -- 172.21.15.148:0/2185717248 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56402491f2f0 msgr2=0x564024929670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:10:55.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.337+0000 7fad49d40640 1 --2- 172.21.15.148:0/2185717248 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56402491f2f0 0x564024929670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:55.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.337+0000 7fad49d40640 1 -- 172.21.15.148:0/2185717248 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564024929bb0 msgr2=0x56402492bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:10:55.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.337+0000 7fad49d40640 1 --2- 172.21.15.148:0/2185717248 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564024929bb0 0x56402492bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:55.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.337+0000 7fad49d40640 1 -- 172.21.15.148:0/2185717248 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564024839130 con 0x56402491e9d0 2024-09-19T07:10:55.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.337+0000 7fad4a541640 1 --2- 172.21.15.148:0/3561917095 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fad300a32d0 0x7fad300a5790 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x56402491c2e0 tx=0x7fad3c00c690 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:55.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.337+0000 7fad49d40640 1 --2- 172.21.15.148:0/2185717248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56402491e9d0 0x56402491edb0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fad40098b30 tx=0x7fad40020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62d7752c533f1059 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:55.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.337+0000 7fad2ffff640 1 -- 172.21.15.148:0/2185717248 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad4009c860 con 0x56402491e9d0 2024-09-19T07:10:55.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.337+0000 7fad2ffff640 1 -- 172.21.15.148:0/2185717248 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad4000de20 con 0x56402491e9d0 2024-09-19T07:10:55.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.337+0000 7fad2ffff640 1 -- 172.21.15.148:0/2185717248 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad4000fb50 con 0x56402491e9d0 2024-09-19T07:10:55.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.338+0000 7fad4e37d740 1 -- 172.21.15.148:0/2185717248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56402491e9d0 msgr2=0x56402491edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:55.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.338+0000 7fad4e37d740 1 --2- 172.21.15.148:0/2185717248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56402491e9d0 0x56402491edb0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fad40098b30 tx=0x7fad40020000 comp rx=0 tx=0).stop 2024-09-19T07:10:55.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.338+0000 7fad4e37d740 1 -- 172.21.15.148:0/2185717248 shutdown_connections 2024-09-19T07:10:55.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.338+0000 7fad4e37d740 1 --2- 172.21.15.148:0/2185717248 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564024929bb0 0x56402492bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:55.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.338+0000 7fad4e37d740 1 --2- 172.21.15.148:0/2185717248 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56402491f2f0 0x564024929670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:55.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.338+0000 7fad4e37d740 1 --2- 172.21.15.148:0/2185717248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56402491e9d0 0x56402491edb0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:55.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.338+0000 7fad4e37d740 1 -- 172.21.15.148:0/2185717248 >> 172.21.15.148:0/2185717248 conn(0x56402491af60 msgr2=0x56402491b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:55.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.338+0000 7fad4e37d740 1 -- 172.21.15.148:0/2185717248 shutdown_connections 2024-09-19T07:10:55.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.338+0000 7fad4e37d740 1 -- 172.21.15.148:0/2185717248 wait complete. 2024-09-19T07:10:55.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.339+0000 7fad4e37d740 1 -- start start 2024-09-19T07:10:55.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.339+0000 7fad4e37d740 1 Processor -- start 2024-09-19T07:10:55.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.339+0000 7fad4e37d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56402491e9d0 0x564024929480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:55.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.339+0000 7fad4e37d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56402491f2f0 0x564024926820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:55.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.339+0000 7fad4e37d740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564024929bb0 0x564024926d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:55.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.339+0000 7fad4e37d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56402492c780 con 0x56402491f2f0 2024-09-19T07:10:55.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.339+0000 7fad4e37d740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56402483ff20 con 0x564024929bb0 2024-09-19T07:10:55.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.339+0000 7fad4e37d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56402492c900 con 0x56402491e9d0 2024-09-19T07:10:55.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.339+0000 7fad4e37d740 10 client.0 _ll_register_callbacks cb 0x564024809030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:10:55.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.339+0000 7fad4953f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56402491f2f0 0x564024926820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:55.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.339+0000 7fad4953f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56402491f2f0 0x564024926820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43510/0 (socket says 172.21.15.148:43510) 2024-09-19T07:10:55.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.339+0000 7fad4953f640 1 -- 172.21.15.148:0/194610992 learned_addr learned my addr 172.21.15.148:0/194610992 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:55.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.339+0000 7fad49d40640 1 --2- 172.21.15.148:0/194610992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56402491e9d0 0x564024929480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:55.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.339+0000 7fad4a541640 1 --2- 172.21.15.148:0/194610992 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564024929bb0 0x564024926d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:55.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.339+0000 7fad4953f640 1 -- 172.21.15.148:0/194610992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56402491e9d0 msgr2=0x564024929480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:10:55.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.339+0000 7fad4953f640 1 --2- 172.21.15.148:0/194610992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56402491e9d0 0x564024929480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:55.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.339+0000 7fad4953f640 1 -- 172.21.15.148:0/194610992 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564024929bb0 msgr2=0x564024926d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:10:55.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.339+0000 7fad4953f640 1 --2- 172.21.15.148:0/194610992 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564024929bb0 0x564024926d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:55.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.339+0000 7fad4953f640 1 -- 172.21.15.148:0/194610992 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640245f62b0 con 0x56402491f2f0 2024-09-19T07:10:55.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.340+0000 7fad4953f640 1 --2- 172.21.15.148:0/194610992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56402491f2f0 0x564024926820 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fad3402a930 tx=0x7fad340042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73c943baf5d80411 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:55.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.340+0000 7fad2d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:10:55.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.340+0000 7fad2d7fa640 1 -- 172.21.15.148:0/194610992 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad34035070 con 0x56402491f2f0 2024-09-19T07:10:55.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.340+0000 7fad2d7fa640 1 -- 172.21.15.148:0/194610992 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7fad34005220 con 0x56402491f2f0 2024-09-19T07:10:55.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.340+0000 7fad4e37d740 1 -- 172.21.15.148:0/194610992 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad4000de20 con 0x56402491f2f0 2024-09-19T07:10:55.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.340+0000 7fad2d7fa640 1 -- 172.21.15.148:0/194610992 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fad34005d50 con 0x56402491f2f0 2024-09-19T07:10:55.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.340+0000 7fad4e37d740 10 client.15078 fetch_fsmap learned FSMap version 24 2024-09-19T07:10:55.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.340+0000 7fad4e37d740 1 -- 172.21.15.148:0/194610992 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564024938100 con 0x56402491f2f0 2024-09-19T07:10:55.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.340+0000 7fad2d7fa640 1 -- 172.21.15.148:0/194610992 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad4000de20 con 0x56402491f2f0 2024-09-19T07:10:55.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.340+0000 7fad2d7fa640 1 -- 172.21.15.148:0/194610992 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fad34003850 con 0x56402491f2f0 2024-09-19T07:10:55.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.340+0000 7fad4e37d740 10 client.15078 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:10:55.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.340+0000 7fad4e37d740 10 client.15078 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T07:10:55.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.340+0000 7fad4e37d740 20 client.15078 populate_metadata read hostname 'smithi148' 2024-09-19T07:10:55.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.340+0000 7fad4e37d740 1 --2- 172.21.15.148:0/194610992 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x56402493a700 0x56402493bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:55.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.340+0000 7fad4e37d740 4 client.15078 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:10:55.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.340+0000 7fad4e37d740 1 -- 172.21.15.148:0/194610992 --> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564024892600 con 0x56402493a700 2024-09-19T07:10:55.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.341+0000 7fad49d40640 1 --2- 172.21.15.148:0/194610992 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x56402493a700 0x56402493bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:55.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.341+0000 7fad49d40640 1 --2- 172.21.15.148:0/194610992 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x56402493a700 0x56402493bb70 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dcd891fa2950d4ef server_cookie=bcd02d6b9b6e3416 in_seq=0 out_seq=0 2024-09-19T07:10:55.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.341+0000 7fad2d7fa640 10 client.15078 ms_handle_connect on v2:172.21.15.165:6838/3993490234 2024-09-19T07:10:55.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.342+0000 7fad2d7fa640 1 -- 172.21.15.148:0/194610992 <== mds.1 v2:172.21.15.165:6838/3993490234 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564024892600 con 0x56402493a700 2024-09-19T07:10:55.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.342+0000 7fad2d7fa640 10 client.15078 handle_command_reply: tid=0 2024-09-19T07:10:55.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.342+0000 7fad4e37d740 1 client.15078 shutdown 2024-09-19T07:10:55.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.342+0000 7fad4e37d740 1 -- 172.21.15.148:0/194610992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56402491f2f0 msgr2=0x564024926820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:55.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.342+0000 7fad4e37d740 1 --2- 172.21.15.148:0/194610992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56402491f2f0 0x564024926820 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fad3402a930 tx=0x7fad340042f0 comp rx=0 tx=0).stop 2024-09-19T07:10:55.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.342+0000 7fad4e37d740 1 -- 172.21.15.148:0/194610992 shutdown_connections 2024-09-19T07:10:55.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.342+0000 7fad4e37d740 1 --2- 172.21.15.148:0/194610992 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x56402493a700 0x56402493bb70 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:55.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.342+0000 7fad4e37d740 1 --2- 172.21.15.148:0/194610992 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564024929bb0 0x564024926d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:55.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.342+0000 7fad4e37d740 1 --2- 172.21.15.148:0/194610992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56402491f2f0 0x564024926820 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:55.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.342+0000 7fad4e37d740 1 --2- 172.21.15.148:0/194610992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56402491e9d0 0x564024929480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:55.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.342+0000 7fad2d7fa640 0 client.15078 ms_handle_reset on v2:172.21.15.165:6838/3993490234 2024-09-19T07:10:55.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.342+0000 7fad4e37d740 1 -- 172.21.15.148:0/194610992 >> 172.21.15.148:0/194610992 conn(0x56402491af60 msgr2=0x564024920c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:55.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.342+0000 7fad4e37d740 1 -- 172.21.15.148:0/194610992 shutdown_connections 2024-09-19T07:10:55.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.342+0000 7fad4e37d740 1 -- 172.21.15.148:0/194610992 wait complete. 2024-09-19T07:10:55.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.342+0000 7fad4e37d740 20 client.15078 trim_cache size 0 max 16384 2024-09-19T07:10:55.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.360+0000 7fad4e37d740 1 Processor -- start 2024-09-19T07:10:55.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.360+0000 7fad4e37d740 1 -- start start 2024-09-19T07:10:55.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.360+0000 7fad4e37d740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56402491e9d0 0x56402493b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:55.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.360+0000 7fad4e37d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56402491f2f0 0x56402491b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:55.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.360+0000 7fad4e37d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564024929bb0 0x564024943e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:55.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.360+0000 7fad4e37d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x564024939eb0 con 0x564024929bb0 2024-09-19T07:10:55.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.360+0000 7fad4e37d740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56402493a580 con 0x56402491e9d0 2024-09-19T07:10:55.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.360+0000 7fad4e37d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56402493ac50 con 0x56402491f2f0 2024-09-19T07:10:55.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.360+0000 7fad4a541640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564024929bb0 0x564024943e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:55.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.360+0000 7fad4a541640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564024929bb0 0x564024943e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43518/0 (socket says 172.21.15.148:43518) 2024-09-19T07:10:55.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.360+0000 7fad4a541640 1 -- 172.21.15.148:0/2060111704 learned_addr learned my addr 172.21.15.148:0/2060111704 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:55.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.360+0000 7fad49d40640 1 --2- 172.21.15.148:0/2060111704 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56402491e9d0 0x56402493b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:55.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.360+0000 7fad4a541640 1 -- 172.21.15.148:0/2060111704 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56402491f2f0 msgr2=0x56402491b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:10:55.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.360+0000 7fad4953f640 1 --2- 172.21.15.148:0/2060111704 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56402491f2f0 0x56402491b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:55.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.360+0000 7fad4a541640 1 --2- 172.21.15.148:0/2060111704 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56402491f2f0 0x56402491b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:55.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.360+0000 7fad4a541640 1 -- 172.21.15.148:0/2060111704 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56402491e9d0 msgr2=0x56402493b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:10:55.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.360+0000 7fad4a541640 1 --2- 172.21.15.148:0/2060111704 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56402491e9d0 0x56402493b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:55.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.360+0000 7fad4a541640 1 -- 172.21.15.148:0/2060111704 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56402491a7f0 con 0x564024929bb0 2024-09-19T07:10:55.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.360+0000 7fad49d40640 1 --2- 172.21.15.148:0/2060111704 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56402491e9d0 0x56402493b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:10:55.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.361+0000 7fad4953f640 1 --2- 172.21.15.148:0/2060111704 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56402491f2f0 0x56402491b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:10:55.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.361+0000 7fad4a541640 1 --2- 172.21.15.148:0/2060111704 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564024929bb0 0x564024943e50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fad3c00f520 tx=0x7fad3c00f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cceca625d570dbad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:55.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.361+0000 7fad2f7fe640 1 -- 172.21.15.148:0/2060111704 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad3c020070 con 0x564024929bb0 2024-09-19T07:10:55.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.361+0000 7fad2f7fe640 1 -- 172.21.15.148:0/2060111704 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad3c015040 con 0x564024929bb0 2024-09-19T07:10:55.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.361+0000 7fad2f7fe640 1 -- 172.21.15.148:0/2060111704 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad3c00e8e0 con 0x564024929bb0 2024-09-19T07:10:55.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.361+0000 7fad4e37d740 1 -- 172.21.15.148:0/2060111704 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564024929bb0 msgr2=0x564024943e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:55.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.361+0000 7fad4e37d740 1 --2- 172.21.15.148:0/2060111704 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564024929bb0 0x564024943e50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fad3c00f520 tx=0x7fad3c00f000 comp rx=0 tx=0).stop 2024-09-19T07:10:55.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.361+0000 7fad4e37d740 1 -- 172.21.15.148:0/2060111704 shutdown_connections 2024-09-19T07:10:55.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.361+0000 7fad4e37d740 1 --2- 172.21.15.148:0/2060111704 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564024929bb0 0x564024943e50 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:55.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.362+0000 7fad4e37d740 1 --2- 172.21.15.148:0/2060111704 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56402491f2f0 0x56402491b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:55.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.362+0000 7fad4e37d740 1 --2- 172.21.15.148:0/2060111704 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56402491e9d0 0x56402493b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:55.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.362+0000 7fad4e37d740 1 -- 172.21.15.148:0/2060111704 >> 172.21.15.148:0/2060111704 conn(0x56402491af60 msgr2=0x564024925910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:55.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.362+0000 7fad4e37d740 1 -- 172.21.15.148:0/2060111704 shutdown_connections 2024-09-19T07:10:55.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.362+0000 7fad4e37d740 1 -- 172.21.15.148:0/2060111704 wait complete. 2024-09-19T07:10:55.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.362+0000 7fad4e37d740 1 -- start start 2024-09-19T07:10:55.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.362+0000 7fad4e37d740 1 Processor -- start 2024-09-19T07:10:55.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.362+0000 7fad4e37d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56402491e9d0 0x564024944610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:55.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.362+0000 7fad4e37d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56402491f2f0 0x56402493f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:55.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.362+0000 7fad4e37d740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564024929bb0 0x56402493fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:55.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.362+0000 7fad4e37d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56402493b9f0 con 0x56402491e9d0 2024-09-19T07:10:55.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.362+0000 7fad4e37d740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56402493b320 con 0x564024929bb0 2024-09-19T07:10:55.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.362+0000 7fad4e37d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56402493c0c0 con 0x56402491f2f0 2024-09-19T07:10:55.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.362+0000 7fad4e37d740 10 client.0 _ll_register_callbacks cb 0x7fad34009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:10:55.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.362+0000 7fad49d40640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56402491e9d0 0x564024944610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:55.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.363+0000 7fad49d40640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56402491e9d0 0x564024944610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43530/0 (socket says 172.21.15.148:43530) 2024-09-19T07:10:55.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.363+0000 7fad49d40640 1 -- 172.21.15.148:0/2893666102 learned_addr learned my addr 172.21.15.148:0/2893666102 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:55.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.363+0000 7fad4a541640 1 --2- 172.21.15.148:0/2893666102 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564024929bb0 0x56402493fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:55.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.363+0000 7fad4953f640 1 --2- 172.21.15.148:0/2893666102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56402491f2f0 0x56402493f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:55.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.363+0000 7fad49d40640 1 -- 172.21.15.148:0/2893666102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56402491f2f0 msgr2=0x56402493f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:10:55.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.363+0000 7fad49d40640 1 --2- 172.21.15.148:0/2893666102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56402491f2f0 0x56402493f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:55.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.363+0000 7fad49d40640 1 -- 172.21.15.148:0/2893666102 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564024929bb0 msgr2=0x56402493fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:10:55.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.363+0000 7fad49d40640 1 --2- 172.21.15.148:0/2893666102 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564024929bb0 0x56402493fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:55.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.363+0000 7fad49d40640 1 -- 172.21.15.148:0/2893666102 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640249406d0 con 0x56402491e9d0 2024-09-19T07:10:55.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.363+0000 7fad4a541640 1 --2- 172.21.15.148:0/2893666102 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564024929bb0 0x56402493fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:10:55.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.363+0000 7fad49d40640 1 --2- 172.21.15.148:0/2893666102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56402491e9d0 0x564024944610 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fad4009c0f0 tx=0x7fad4009c060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=407d05ca1e1b5323 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:55.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.363+0000 7fad2d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:10:55.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.363+0000 7fad2d7fa640 1 -- 172.21.15.148:0/2893666102 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad4000de20 con 0x56402491e9d0 2024-09-19T07:10:55.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.363+0000 7fad2d7fa640 1 -- 172.21.15.148:0/2893666102 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7fad40018d60 con 0x56402491e9d0 2024-09-19T07:10:55.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.363+0000 7fad4e37d740 1 -- 172.21.15.148:0/2893666102 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad3c015040 con 0x56402491e9d0 2024-09-19T07:10:55.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.363+0000 7fad2d7fa640 1 -- 172.21.15.148:0/2893666102 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fad400b50a0 con 0x56402491e9d0 2024-09-19T07:10:55.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.363+0000 7fad4e37d740 10 client.15084 fetch_fsmap learned FSMap version 24 2024-09-19T07:10:55.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.363+0000 7fad4e37d740 1 -- 172.21.15.148:0/2893666102 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5640249a4e10 con 0x56402491e9d0 2024-09-19T07:10:55.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.363+0000 7fad2d7fa640 1 -- 172.21.15.148:0/2893666102 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad3c015040 con 0x56402491e9d0 2024-09-19T07:10:55.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.364+0000 7fad2d7fa640 1 -- 172.21.15.148:0/2893666102 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fad400987d0 con 0x56402491e9d0 2024-09-19T07:10:55.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.364+0000 7fad4e37d740 10 client.15084 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:10:55.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.364+0000 7fad4e37d740 10 client.15084 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T07:10:55.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.364+0000 7fad4e37d740 20 client.15084 populate_metadata read hostname 'smithi148' 2024-09-19T07:10:55.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.364+0000 7fad4e37d740 1 --2- 172.21.15.148:0/2893666102 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x5640249a9540 0x5640249a8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:55.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.364+0000 7fad4e37d740 4 client.15084 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T07:10:55.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.364+0000 7fad4e37d740 1 -- 172.21.15.148:0/2893666102 --> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] -- command(tid 0: {"prefix": "status"}) -- 0x56402488cb10 con 0x5640249a9540 2024-09-19T07:10:55.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.364+0000 7fad4953f640 1 --2- 172.21.15.148:0/2893666102 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x5640249a9540 0x5640249a8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:55.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.364+0000 7fad2d7fa640 10 client.15084 ms_handle_connect on v2:172.21.15.165:6838/3993490234 2024-09-19T07:10:55.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.364+0000 7fad4953f640 1 --2- 172.21.15.148:0/2893666102 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x5640249a9540 0x5640249a8250 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b3115684a24b94ab server_cookie=493a116461b0c643 in_seq=0 out_seq=0 2024-09-19T07:10:55.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.365+0000 7fad2d7fa640 1 -- 172.21.15.148:0/2893666102 <== mds.1 v2:172.21.15.165:6838/3993490234 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x56402488cb10 con 0x5640249a9540 2024-09-19T07:10:55.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.365+0000 7fad2d7fa640 10 client.15084 handle_command_reply: tid=0 2024-09-19T07:10:55.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.365+0000 7fad4e37d740 1 client.15084 shutdown 2024-09-19T07:10:55.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.365+0000 7fad4e37d740 1 -- 172.21.15.148:0/2893666102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56402491e9d0 msgr2=0x564024944610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:55.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.365+0000 7fad4e37d740 1 --2- 172.21.15.148:0/2893666102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56402491e9d0 0x564024944610 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fad4009c0f0 tx=0x7fad4009c060 comp rx=0 tx=0).stop 2024-09-19T07:10:55.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.365+0000 7fad4e37d740 1 -- 172.21.15.148:0/2893666102 shutdown_connections 2024-09-19T07:10:55.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.365+0000 7fad4e37d740 1 --2- 172.21.15.148:0/2893666102 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x5640249a9540 0x5640249a8250 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:55.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.365+0000 7fad4e37d740 1 --2- 172.21.15.148:0/2893666102 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564024929bb0 0x56402493fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:55.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.365+0000 7fad4e37d740 1 --2- 172.21.15.148:0/2893666102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56402491f2f0 0x56402493f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:55.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.365+0000 7fad2d7fa640 0 client.15084 ms_handle_reset on v2:172.21.15.165:6838/3993490234 2024-09-19T07:10:55.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.365+0000 7fad4e37d740 1 --2- 172.21.15.148:0/2893666102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56402491e9d0 0x564024944610 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:55.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.365+0000 7fad4e37d740 1 -- 172.21.15.148:0/2893666102 >> 172.21.15.148:0/2893666102 conn(0x56402491af60 msgr2=0x5640249197e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:55.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.365+0000 7fad4e37d740 1 -- 172.21.15.148:0/2893666102 shutdown_connections 2024-09-19T07:10:55.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.365+0000 7fad4e37d740 1 -- 172.21.15.148:0/2893666102 wait complete. 2024-09-19T07:10:55.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.365+0000 7fad4e37d740 20 client.15084 trim_cache size 0 max 16384 2024-09-19T07:10:55.387 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:10:55.387 INFO:teuthology.orchestra.run.smithi148.stdout: "cluster_fsid": "eae8a4a8-7654-11ef-bceb-c7b262605968", 2024-09-19T07:10:55.387 INFO:teuthology.orchestra.run.smithi148.stdout: "whoami": 1, 2024-09-19T07:10:55.387 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 24437, 2024-09-19T07:10:55.387 INFO:teuthology.orchestra.run.smithi148.stdout: "want_state": "up:active", 2024-09-19T07:10:55.387 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "up:active", 2024-09-19T07:10:55.387 INFO:teuthology.orchestra.run.smithi148.stdout: "fs_name": "cephfs", 2024-09-19T07:10:55.387 INFO:teuthology.orchestra.run.smithi148.stdout: "rank_uptime": 88.400562124999993, 2024-09-19T07:10:55.387 INFO:teuthology.orchestra.run.smithi148.stdout: "mdsmap_epoch": 24, 2024-09-19T07:10:55.387 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch": 80, 2024-09-19T07:10:55.387 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch_barrier": 78, 2024-09-19T07:10:55.387 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 105.64573335199999 2024-09-19T07:10:55.387 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:10:55.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.365+0000 7fad4bfa4640 1 -- 172.21.15.148:0/3561917095 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fad300a32d0 msgr2=0x7fad300a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:55.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.365+0000 7fad4bfa4640 1 --2- 172.21.15.148:0/3561917095 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fad300a32d0 0x7fad300a5790 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x56402491c2e0 tx=0x7fad3c00c690 comp rx=0 tx=0).stop 2024-09-19T07:10:55.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.365+0000 7fad4bfa4640 1 -- 172.21.15.148:0/3561917095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad44101de0 msgr2=0x7fad4419a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:55.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.365+0000 7fad4bfa4640 1 --2- 172.21.15.148:0/3561917095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad44101de0 0x7fad4419a6f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fad4000c920 tx=0x7fad4000cde0 comp rx=0 tx=0).stop 2024-09-19T07:10:55.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.365+0000 7fad4bfa4640 1 -- 172.21.15.148:0/3561917095 shutdown_connections 2024-09-19T07:10:55.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.365+0000 7fad4bfa4640 1 --2- 172.21.15.148:0/3561917095 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fad300a32d0 0x7fad300a5790 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:55.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.366+0000 7fad4bfa4640 1 --2- 172.21.15.148:0/3561917095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad44106f10 0x7fad4419efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:55.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.366+0000 7fad4bfa4640 1 --2- 172.21.15.148:0/3561917095 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fad44102790 0x7fad4419ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:55.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.366+0000 7fad4bfa4640 1 --2- 172.21.15.148:0/3561917095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad44101de0 0x7fad4419a6f0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:55.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.366+0000 7fad4bfa4640 1 -- 172.21.15.148:0/3561917095 >> 172.21.15.148:0/3561917095 conn(0x7fad440fd8c0 msgr2=0x7fad440ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:55.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.366+0000 7fad4bfa4640 1 -- 172.21.15.148:0/3561917095 shutdown_connections 2024-09-19T07:10:55.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:55.366+0000 7fad4bfa4640 1 -- 172.21.15.148:0/3561917095 wait complete. 2024-09-19T07:10:56.078 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T07:10:56.328 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:10:56.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:56 smithi148 ceph-mon[31180]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T07:10:56.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:56 smithi179 ceph-mon[35716]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T07:10:56.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:56 smithi165 ceph-mon[35326]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T07:10:56.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.754+0000 7f64692f4640 1 -- 172.21.15.148:0/2894780570 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6464102d90 msgr2=0x7f6464103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:56.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.754+0000 7f64692f4640 1 --2- 172.21.15.148:0/2894780570 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6464102d90 0x7f6464103170 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6454009930 tx=0x7f645402a420 comp rx=0 tx=0).stop 2024-09-19T07:10:56.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.754+0000 7f64692f4640 1 -- 172.21.15.148:0/2894780570 shutdown_connections 2024-09-19T07:10:56.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.754+0000 7f64692f4640 1 --2- 172.21.15.148:0/2894780570 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6464108290 0x7f646410ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:56.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.754+0000 7f64692f4640 1 --2- 172.21.15.148:0/2894780570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6464103740 0x7f6464107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:56.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.754+0000 7f64692f4640 1 --2- 172.21.15.148:0/2894780570 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6464102d90 0x7f6464103170 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:56.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.754+0000 7f64692f4640 1 -- 172.21.15.148:0/2894780570 >> 172.21.15.148:0/2894780570 conn(0x7f64640fc7d0 msgr2=0x7f64640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:56.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.755+0000 7f64692f4640 1 -- 172.21.15.148:0/2894780570 shutdown_connections 2024-09-19T07:10:56.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.755+0000 7f64692f4640 1 -- 172.21.15.148:0/2894780570 wait complete. 2024-09-19T07:10:56.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.755+0000 7f64692f4640 1 Processor -- start 2024-09-19T07:10:56.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.756+0000 7f64692f4640 1 -- start start 2024-09-19T07:10:56.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.756+0000 7f64692f4640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6464102d90 0x7f64641985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:56.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.756+0000 7f64692f4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6464103740 0x7f6464198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:56.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.756+0000 7f64692f4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6464108290 0x7f646419cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:56.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.756+0000 7f64692f4640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6464112090 con 0x7f6464108290 2024-09-19T07:10:56.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.756+0000 7f64692f4640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6464111f10 con 0x7f6464102d90 2024-09-19T07:10:56.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.756+0000 7f64692f4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6464112210 con 0x7f6464103740 2024-09-19T07:10:56.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.756+0000 7f64637fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6464108290 0x7f646419cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:56.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.756+0000 7f64637fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6464108290 0x7f646419cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43558/0 (socket says 172.21.15.148:43558) 2024-09-19T07:10:56.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.756+0000 7f64637fe640 1 -- 172.21.15.148:0/4176194502 learned_addr learned my addr 172.21.15.148:0/4176194502 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:56.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.756+0000 7f645a7fc640 1 --2- 172.21.15.148:0/4176194502 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6464103740 0x7f6464198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:56.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.756+0000 7f6462ffd640 1 --2- 172.21.15.148:0/4176194502 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6464102d90 0x7f64641985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:56.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.756+0000 7f64637fe640 1 -- 172.21.15.148:0/4176194502 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6464103740 msgr2=0x7f6464198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:56.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.756+0000 7f64637fe640 1 --2- 172.21.15.148:0/4176194502 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6464103740 0x7f6464198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:56.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.756+0000 7f64637fe640 1 -- 172.21.15.148:0/4176194502 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6464102d90 msgr2=0x7f64641985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:56.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.756+0000 7f64637fe640 1 --2- 172.21.15.148:0/4176194502 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6464102d90 0x7f64641985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:56.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.756+0000 7f64637fe640 1 -- 172.21.15.148:0/4176194502 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f646419d580 con 0x7f6464108290 2024-09-19T07:10:56.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.756+0000 7f6462ffd640 1 --2- 172.21.15.148:0/4176194502 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6464102d90 0x7f64641985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:10:56.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.756+0000 7f64637fe640 1 --2- 172.21.15.148:0/4176194502 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6464108290 0x7f646419cea0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f645c00eaa0 tx=0x7f645c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:56.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.756+0000 7f6460ff9640 1 -- 172.21.15.148:0/4176194502 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f645c00cdb0 con 0x7f6464108290 2024-09-19T07:10:56.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.757+0000 7f64692f4640 1 -- 172.21.15.148:0/4176194502 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f646419d870 con 0x7f6464108290 2024-09-19T07:10:56.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.757+0000 7f6460ff9640 1 -- 172.21.15.148:0/4176194502 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f645c005020 con 0x7f6464108290 2024-09-19T07:10:56.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.757+0000 7f6460ff9640 1 -- 172.21.15.148:0/4176194502 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f645c0116b0 con 0x7f6464108290 2024-09-19T07:10:56.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.757+0000 7f64692f4640 1 -- 172.21.15.148:0/4176194502 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64641a5150 con 0x7f6464108290 2024-09-19T07:10:56.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.759+0000 7f6460ff9640 1 -- 172.21.15.148:0/4176194502 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f645c005560 con 0x7f6464108290 2024-09-19T07:10:56.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.759+0000 7f646b6cd740 1 Processor -- start 2024-09-19T07:10:56.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.759+0000 7f646b6cd740 1 -- start start 2024-09-19T07:10:56.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.759+0000 7f6460ff9640 1 --2- 172.21.15.148:0/4176194502 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f64500a32d0 0x7f64500a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:56.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.760+0000 7f645a7fc640 1 --2- 172.21.15.148:0/4176194502 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f64500a32d0 0x7f64500a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:56.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.760+0000 7f6460ff9640 1 -- 172.21.15.148:0/4176194502 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7f645c0cfc80 con 0x7f6464108290 2024-09-19T07:10:56.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.760+0000 7f646b6cd740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5620a06808b0 0x5620a0680c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:56.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.760+0000 7f646b6cd740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5620a06811d0 0x5620a068fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:56.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.760+0000 7f646b6cd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5620a068ffc0 0x5620a06923b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:56.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.760+0000 7f646b6cd740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5620a05e7090 con 0x5620a06808b0 2024-09-19T07:10:56.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.760+0000 7f646b6cd740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5620a058ea70 con 0x5620a06811d0 2024-09-19T07:10:56.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.760+0000 7f646b6cd740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5620a05e3050 con 0x5620a068ffc0 2024-09-19T07:10:56.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.760+0000 7f6462ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5620a06808b0 0x5620a0680c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:56.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.760+0000 7f6462ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5620a06808b0 0x5620a0680c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43564/0 (socket says 172.21.15.148:43564) 2024-09-19T07:10:56.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.760+0000 7f6462ffd640 1 -- 172.21.15.148:0/4278760823 learned_addr learned my addr 172.21.15.148:0/4278760823 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:56.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.760+0000 7f64637fe640 1 --2- 172.21.15.148:0/4278760823 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5620a068ffc0 0x5620a06923b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:56.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.760+0000 7f645a7fc640 1 --2- 172.21.15.148:0/4278760823 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5620a06811d0 0x5620a068fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:56.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.760+0000 7f645a7fc640 1 --2- 172.21.15.148:0/4176194502 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f64500a32d0 0x7f64500a5790 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f64640fee00 tx=0x7f644c00b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:56.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.760+0000 7f6462ffd640 1 -- 172.21.15.148:0/4278760823 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5620a068ffc0 msgr2=0x5620a06923b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:10:56.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.760+0000 7f6462ffd640 1 --2- 172.21.15.148:0/4278760823 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5620a068ffc0 0x5620a06923b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:56.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.760+0000 7f6462ffd640 1 -- 172.21.15.148:0/4278760823 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5620a06811d0 msgr2=0x5620a068fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:10:56.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.760+0000 7f6462ffd640 1 --2- 172.21.15.148:0/4278760823 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5620a06811d0 0x5620a068fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:56.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.760+0000 7f6462ffd640 1 -- 172.21.15.148:0/4278760823 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620a059b130 con 0x5620a06808b0 2024-09-19T07:10:56.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.760+0000 7f645a7fc640 1 --2- 172.21.15.148:0/4278760823 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5620a06811d0 0x5620a068fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:10:56.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.760+0000 7f6462ffd640 1 --2- 172.21.15.148:0/4278760823 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5620a06808b0 0x5620a0680c90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6454009930 tx=0x7f6454032cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5628679c94b467b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:56.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.761+0000 7f64597fa640 1 -- 172.21.15.148:0/4278760823 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f645403f070 con 0x5620a06808b0 2024-09-19T07:10:56.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.761+0000 7f64597fa640 1 -- 172.21.15.148:0/4278760823 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f64540317b0 con 0x5620a06808b0 2024-09-19T07:10:56.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.761+0000 7f64597fa640 1 -- 172.21.15.148:0/4278760823 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6454035070 con 0x5620a06808b0 2024-09-19T07:10:56.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.761+0000 7f646b6cd740 1 -- 172.21.15.148:0/4278760823 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5620a06808b0 msgr2=0x5620a0680c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:56.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.761+0000 7f646b6cd740 1 --2- 172.21.15.148:0/4278760823 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5620a06808b0 0x5620a0680c90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6454009930 tx=0x7f6454032cb0 comp rx=0 tx=0).stop 2024-09-19T07:10:56.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.761+0000 7f646b6cd740 1 -- 172.21.15.148:0/4278760823 shutdown_connections 2024-09-19T07:10:56.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.761+0000 7f646b6cd740 1 --2- 172.21.15.148:0/4278760823 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5620a068ffc0 0x5620a06923b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:56.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.761+0000 7f646b6cd740 1 --2- 172.21.15.148:0/4278760823 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5620a06811d0 0x5620a068fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:56.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.761+0000 7f646b6cd740 1 --2- 172.21.15.148:0/4278760823 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5620a06808b0 0x5620a0680c90 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:56.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.761+0000 7f646b6cd740 1 -- 172.21.15.148:0/4278760823 >> 172.21.15.148:0/4278760823 conn(0x5620a067cf60 msgr2=0x5620a067d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:56.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.761+0000 7f646b6cd740 1 -- 172.21.15.148:0/4278760823 shutdown_connections 2024-09-19T07:10:56.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.762+0000 7f646b6cd740 1 -- 172.21.15.148:0/4278760823 wait complete. 2024-09-19T07:10:56.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.762+0000 7f646b6cd740 1 -- start start 2024-09-19T07:10:56.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.762+0000 7f646b6cd740 1 Processor -- start 2024-09-19T07:10:56.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.762+0000 7f646b6cd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5620a06808b0 0x5620a068f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:56.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.762+0000 7f646b6cd740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5620a06811d0 0x5620a068cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:56.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.762+0000 7f646b6cd740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5620a068ffc0 0x5620a068d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:56.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.762+0000 7f646b6cd740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5620a0692b90 con 0x5620a068ffc0 2024-09-19T07:10:56.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.762+0000 7f646b6cd740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5620a05a1f20 con 0x5620a06811d0 2024-09-19T07:10:56.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.762+0000 7f646b6cd740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5620a0692d10 con 0x5620a06808b0 2024-09-19T07:10:56.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.762+0000 7f646b6cd740 10 client.0 _ll_register_callbacks cb 0x5620a056b030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:10:56.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.762+0000 7f64637fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5620a068ffc0 0x5620a068d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:56.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.762+0000 7f64637fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5620a068ffc0 0x5620a068d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43574/0 (socket says 172.21.15.148:43574) 2024-09-19T07:10:56.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.762+0000 7f64637fe640 1 -- 172.21.15.148:0/2081262306 learned_addr learned my addr 172.21.15.148:0/2081262306 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:56.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.762+0000 7f6462ffd640 1 --2- 172.21.15.148:0/2081262306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5620a06808b0 0x5620a068f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:56.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.762+0000 7f645a7fc640 1 --2- 172.21.15.148:0/2081262306 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5620a06811d0 0x5620a068cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:56.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.763+0000 7f64637fe640 1 -- 172.21.15.148:0/2081262306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5620a06808b0 msgr2=0x5620a068f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:10:56.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.763+0000 7f64637fe640 1 --2- 172.21.15.148:0/2081262306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5620a06808b0 0x5620a068f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:56.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.763+0000 7f64637fe640 1 -- 172.21.15.148:0/2081262306 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5620a06811d0 msgr2=0x5620a068cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:10:56.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.763+0000 7f64637fe640 1 --2- 172.21.15.148:0/2081262306 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5620a06811d0 0x5620a068cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:56.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.763+0000 7f64637fe640 1 -- 172.21.15.148:0/2081262306 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620a03582b0 con 0x5620a068ffc0 2024-09-19T07:10:56.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.763+0000 7f64637fe640 1 --2- 172.21.15.148:0/2081262306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5620a068ffc0 0x5620a068d100 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f645c0985b0 tx=0x7f645c09c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=115ea1a57212bdcf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:56.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.763+0000 7f644a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:10:56.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.763+0000 7f644a7fc640 1 -- 172.21.15.148:0/2081262306 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f645c0b5060 con 0x5620a068ffc0 2024-09-19T07:10:56.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.763+0000 7f644a7fc640 1 -- 172.21.15.148:0/2081262306 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7f645c0bc0c0 con 0x5620a068ffc0 2024-09-19T07:10:56.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.763+0000 7f646b6cd740 1 -- 172.21.15.148:0/2081262306 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f64540317b0 con 0x5620a068ffc0 2024-09-19T07:10:56.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.763+0000 7f644a7fc640 1 -- 172.21.15.148:0/2081262306 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f645c01f040 con 0x5620a068ffc0 2024-09-19T07:10:56.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.763+0000 7f646b6cd740 10 client.15096 fetch_fsmap learned FSMap version 24 2024-09-19T07:10:56.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.763+0000 7f646b6cd740 1 -- 172.21.15.148:0/2081262306 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5620a069e540 con 0x5620a068ffc0 2024-09-19T07:10:56.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.763+0000 7f644a7fc640 1 -- 172.21.15.148:0/2081262306 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f64540317b0 con 0x5620a068ffc0 2024-09-19T07:10:56.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.763+0000 7f644a7fc640 1 -- 172.21.15.148:0/2081262306 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f645c00f040 con 0x5620a068ffc0 2024-09-19T07:10:56.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.763+0000 7f646b6cd740 10 client.15096 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:10:56.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.763+0000 7f646b6cd740 10 client.15096 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T07:10:56.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.764+0000 7f646b6cd740 20 client.15096 populate_metadata read hostname 'smithi148' 2024-09-19T07:10:56.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.764+0000 7f646b6cd740 1 --2- 172.21.15.148:0/2081262306 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5620a06a0bc0 0x5620a06a2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:56.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.764+0000 7f646b6cd740 4 client.15096 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:10:56.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.764+0000 7f646b6cd740 1 -- 172.21.15.148:0/2081262306 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5620a05f4600 con 0x5620a06a0bc0 2024-09-19T07:10:56.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.764+0000 7f6462ffd640 1 --2- 172.21.15.148:0/2081262306 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5620a06a0bc0 0x5620a06a2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:56.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.764+0000 7f644a7fc640 10 client.15096 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:10:56.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.764+0000 7f6462ffd640 1 --2- 172.21.15.148:0/2081262306 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5620a06a0bc0 0x5620a06a2030 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92013260512252b4 server_cookie=2c4351c0be4bd3d8 in_seq=0 out_seq=0 2024-09-19T07:10:56.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.765+0000 7f644a7fc640 1 -- 172.21.15.148:0/2081262306 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5620a05f4600 con 0x5620a06a0bc0 2024-09-19T07:10:56.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.765+0000 7f644a7fc640 10 client.15096 handle_command_reply: tid=0 2024-09-19T07:10:56.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.765+0000 7f646b6cd740 1 client.15096 shutdown 2024-09-19T07:10:56.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.765+0000 7f646b6cd740 1 -- 172.21.15.148:0/2081262306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5620a068ffc0 msgr2=0x5620a068d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:56.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.765+0000 7f646b6cd740 1 --2- 172.21.15.148:0/2081262306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5620a068ffc0 0x5620a068d100 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f645c0985b0 tx=0x7f645c09c990 comp rx=0 tx=0).stop 2024-09-19T07:10:56.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.765+0000 7f646b6cd740 1 -- 172.21.15.148:0/2081262306 shutdown_connections 2024-09-19T07:10:56.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.765+0000 7f646b6cd740 1 --2- 172.21.15.148:0/2081262306 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5620a06a0bc0 0x5620a06a2030 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:56.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.765+0000 7f646b6cd740 1 --2- 172.21.15.148:0/2081262306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5620a068ffc0 0x5620a068d100 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:56.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.765+0000 7f646b6cd740 1 --2- 172.21.15.148:0/2081262306 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5620a06811d0 0x5620a068cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:56.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.765+0000 7f644a7fc640 0 client.15096 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:10:56.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.765+0000 7f646b6cd740 1 --2- 172.21.15.148:0/2081262306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5620a06808b0 0x5620a068f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:56.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.765+0000 7f646b6cd740 1 -- 172.21.15.148:0/2081262306 >> 172.21.15.148:0/2081262306 conn(0x5620a067cf60 msgr2=0x5620a0682cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:56.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.766+0000 7f646b6cd740 1 -- 172.21.15.148:0/2081262306 shutdown_connections 2024-09-19T07:10:56.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.766+0000 7f646b6cd740 1 -- 172.21.15.148:0/2081262306 wait complete. 2024-09-19T07:10:56.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.766+0000 7f646b6cd740 20 client.15096 trim_cache size 0 max 16384 2024-09-19T07:10:56.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.783+0000 7f646b6cd740 1 Processor -- start 2024-09-19T07:10:56.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.783+0000 7f646b6cd740 1 -- start start 2024-09-19T07:10:56.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.784+0000 7f646b6cd740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5620a06808b0 0x5620a0689e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:56.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.784+0000 7f646b6cd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5620a06811d0 0x5620a068a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:56.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.784+0000 7f646b6cd740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5620a068ffc0 0x5620a06aa2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:56.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.784+0000 7f646b6cd740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5620a06a0370 con 0x5620a068ffc0 2024-09-19T07:10:56.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.784+0000 7f646b6cd740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5620a06a0a40 con 0x5620a06808b0 2024-09-19T07:10:56.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.784+0000 7f646b6cd740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5620a06a1110 con 0x5620a06811d0 2024-09-19T07:10:56.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.784+0000 7f64637fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5620a068ffc0 0x5620a06aa2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:56.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.784+0000 7f64637fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5620a068ffc0 0x5620a06aa2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43586/0 (socket says 172.21.15.148:43586) 2024-09-19T07:10:56.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.784+0000 7f64637fe640 1 -- 172.21.15.148:0/1640411013 learned_addr learned my addr 172.21.15.148:0/1640411013 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:56.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.784+0000 7f645a7fc640 1 --2- 172.21.15.148:0/1640411013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5620a06811d0 0x5620a068a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:56.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.784+0000 7f6462ffd640 1 --2- 172.21.15.148:0/1640411013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5620a06808b0 0x5620a0689e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:56.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.784+0000 7f64637fe640 1 -- 172.21.15.148:0/1640411013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5620a06811d0 msgr2=0x5620a068a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:10:56.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.784+0000 7f64637fe640 1 --2- 172.21.15.148:0/1640411013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5620a06811d0 0x5620a068a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:56.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.784+0000 7f64637fe640 1 -- 172.21.15.148:0/1640411013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5620a06808b0 msgr2=0x5620a0689e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:10:56.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.784+0000 7f64637fe640 1 --2- 172.21.15.148:0/1640411013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5620a06808b0 0x5620a0689e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:56.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.784+0000 7f64637fe640 1 -- 172.21.15.148:0/1640411013 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620a067ca00 con 0x5620a068ffc0 2024-09-19T07:10:56.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.784+0000 7f645a7fc640 1 --2- 172.21.15.148:0/1640411013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5620a06811d0 0x5620a068a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:10:56.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.784+0000 7f6462ffd640 1 --2- 172.21.15.148:0/1640411013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5620a06808b0 0x5620a0689e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:10:56.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.784+0000 7f64637fe640 1 --2- 172.21.15.148:0/1640411013 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5620a068ffc0 0x5620a06aa2e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f645c09c0e0 tx=0x7f645c0a4f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d47472b700634c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:56.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.784+0000 7f6458ff9640 1 -- 172.21.15.148:0/1640411013 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f645c0b5040 con 0x5620a068ffc0 2024-09-19T07:10:56.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.785+0000 7f6458ff9640 1 -- 172.21.15.148:0/1640411013 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f645c09b2c0 con 0x5620a068ffc0 2024-09-19T07:10:56.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.785+0000 7f6458ff9640 1 -- 172.21.15.148:0/1640411013 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f645c0a0170 con 0x5620a068ffc0 2024-09-19T07:10:56.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.785+0000 7f646b6cd740 1 -- 172.21.15.148:0/1640411013 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5620a068ffc0 msgr2=0x5620a06aa2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:56.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.785+0000 7f646b6cd740 1 --2- 172.21.15.148:0/1640411013 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5620a068ffc0 0x5620a06aa2e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f645c09c0e0 tx=0x7f645c0a4f40 comp rx=0 tx=0).stop 2024-09-19T07:10:56.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.786+0000 7f646b6cd740 1 -- 172.21.15.148:0/1640411013 shutdown_connections 2024-09-19T07:10:56.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.786+0000 7f646b6cd740 1 --2- 172.21.15.148:0/1640411013 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5620a068ffc0 0x5620a06aa2e0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:56.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.786+0000 7f646b6cd740 1 --2- 172.21.15.148:0/1640411013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5620a06811d0 0x5620a068a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:56.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.786+0000 7f646b6cd740 1 --2- 172.21.15.148:0/1640411013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5620a06808b0 0x5620a0689e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:56.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.786+0000 7f646b6cd740 1 -- 172.21.15.148:0/1640411013 >> 172.21.15.148:0/1640411013 conn(0x5620a067cf60 msgr2=0x5620a0677ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:56.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.786+0000 7f646b6cd740 1 -- 172.21.15.148:0/1640411013 shutdown_connections 2024-09-19T07:10:56.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.786+0000 7f646b6cd740 1 -- 172.21.15.148:0/1640411013 wait complete. 2024-09-19T07:10:56.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.786+0000 7f646b6cd740 1 -- start start 2024-09-19T07:10:56.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.786+0000 7f646b6cd740 1 Processor -- start 2024-09-19T07:10:56.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.786+0000 7f646b6cd740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5620a06808b0 0x5620a06aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:56.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.786+0000 7f646b6cd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5620a06811d0 0x5620a06aaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:56.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.786+0000 7f646b6cd740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5620a068ffc0 0x5620a06a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:56.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.786+0000 7f646b6cd740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5620a06a1eb0 con 0x5620a06808b0 2024-09-19T07:10:56.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.786+0000 7f646b6cd740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5620a06a17e0 con 0x5620a068ffc0 2024-09-19T07:10:56.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.786+0000 7f646b6cd740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5620a06a2580 con 0x5620a06811d0 2024-09-19T07:10:56.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.787+0000 7f646b6cd740 10 client.0 _ll_register_callbacks cb 0x7f645c09bab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:10:56.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.787+0000 7f6462ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5620a06808b0 0x5620a06aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:56.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.787+0000 7f6462ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5620a06808b0 0x5620a06aa530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43592/0 (socket says 172.21.15.148:43592) 2024-09-19T07:10:56.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.787+0000 7f6462ffd640 1 -- 172.21.15.148:0/3743772406 learned_addr learned my addr 172.21.15.148:0/3743772406 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:56.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.787+0000 7f64637fe640 1 --2- 172.21.15.148:0/3743772406 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5620a068ffc0 0x5620a06a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:56.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.787+0000 7f645a7fc640 1 --2- 172.21.15.148:0/3743772406 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5620a06811d0 0x5620a06aaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:56.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.787+0000 7f6462ffd640 1 -- 172.21.15.148:0/3743772406 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5620a06811d0 msgr2=0x5620a06aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:10:56.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.787+0000 7f6462ffd640 1 --2- 172.21.15.148:0/3743772406 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5620a06811d0 0x5620a06aaa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:56.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.787+0000 7f6462ffd640 1 -- 172.21.15.148:0/3743772406 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5620a068ffc0 msgr2=0x5620a06a38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:10:56.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.787+0000 7f6462ffd640 1 --2- 172.21.15.148:0/3743772406 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5620a068ffc0 0x5620a06a38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:56.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.787+0000 7f6462ffd640 1 -- 172.21.15.148:0/3743772406 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620a06a40f0 con 0x5620a06808b0 2024-09-19T07:10:56.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.787+0000 7f64637fe640 1 --2- 172.21.15.148:0/3743772406 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5620a068ffc0 0x5620a06a38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:10:56.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.787+0000 7f6462ffd640 1 --2- 172.21.15.148:0/3743772406 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5620a06808b0 0x5620a06aa530 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f645402a940 tx=0x7f6454031440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14289ac21aee5868 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:56.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.787+0000 7f644a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:10:56.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.787+0000 7f644a7fc640 1 -- 172.21.15.148:0/3743772406 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f645403f040 con 0x5620a06808b0 2024-09-19T07:10:56.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.787+0000 7f644a7fc640 1 -- 172.21.15.148:0/3743772406 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7f6454031630 con 0x5620a06808b0 2024-09-19T07:10:56.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.787+0000 7f646b6cd740 1 -- 172.21.15.148:0/3743772406 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f645c09b2c0 con 0x5620a06808b0 2024-09-19T07:10:56.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.787+0000 7f644a7fc640 1 -- 172.21.15.148:0/3743772406 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f645405e050 con 0x5620a06808b0 2024-09-19T07:10:56.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.787+0000 7f646b6cd740 10 client.15102 fetch_fsmap learned FSMap version 24 2024-09-19T07:10:56.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.787+0000 7f646b6cd740 1 -- 172.21.15.148:0/3743772406 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5620a06a8bd0 con 0x5620a06808b0 2024-09-19T07:10:56.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.788+0000 7f644a7fc640 1 -- 172.21.15.148:0/3743772406 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f645c09b2c0 con 0x5620a06808b0 2024-09-19T07:10:56.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.788+0000 7f644a7fc640 1 -- 172.21.15.148:0/3743772406 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f6454003a30 con 0x5620a06808b0 2024-09-19T07:10:56.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.788+0000 7f646b6cd740 10 client.15102 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:10:56.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.788+0000 7f646b6cd740 10 client.15102 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T07:10:56.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.788+0000 7f646b6cd740 20 client.15102 populate_metadata read hostname 'smithi148' 2024-09-19T07:10:56.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.788+0000 7f646b6cd740 1 --2- 172.21.15.148:0/3743772406 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5620a06a0bc0 0x5620a070e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:56.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.788+0000 7f646b6cd740 4 client.15102 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T07:10:56.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.788+0000 7f646b6cd740 1 -- 172.21.15.148:0/3743772406 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "status"}) -- 0x5620a05eeb10 con 0x5620a06a0bc0 2024-09-19T07:10:56.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.788+0000 7f645a7fc640 1 --2- 172.21.15.148:0/3743772406 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5620a06a0bc0 0x5620a070e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:56.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.789+0000 7f644a7fc640 10 client.15102 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:10:56.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.789+0000 7f645a7fc640 1 --2- 172.21.15.148:0/3743772406 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5620a06a0bc0 0x5620a070e270 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ea1424e7f8d0fea server_cookie=a2c2d0563ceeef00 in_seq=0 out_seq=0 2024-09-19T07:10:56.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.789+0000 7f644a7fc640 1 -- 172.21.15.148:0/3743772406 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5620a05eeb10 con 0x5620a06a0bc0 2024-09-19T07:10:56.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.789+0000 7f644a7fc640 10 client.15102 handle_command_reply: tid=0 2024-09-19T07:10:56.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.789+0000 7f646b6cd740 1 client.15102 shutdown 2024-09-19T07:10:56.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.789+0000 7f646b6cd740 1 -- 172.21.15.148:0/3743772406 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5620a06808b0 msgr2=0x5620a06aa530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:56.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.789+0000 7f646b6cd740 1 --2- 172.21.15.148:0/3743772406 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5620a06808b0 0x5620a06aa530 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f645402a940 tx=0x7f6454031440 comp rx=0 tx=0).stop 2024-09-19T07:10:56.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.789+0000 7f646b6cd740 1 -- 172.21.15.148:0/3743772406 shutdown_connections 2024-09-19T07:10:56.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.789+0000 7f646b6cd740 1 --2- 172.21.15.148:0/3743772406 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5620a06a0bc0 0x5620a070e270 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:56.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.789+0000 7f646b6cd740 1 --2- 172.21.15.148:0/3743772406 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5620a068ffc0 0x5620a06a38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:56.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.789+0000 7f644a7fc640 0 client.15102 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:10:56.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.789+0000 7f646b6cd740 1 --2- 172.21.15.148:0/3743772406 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5620a06811d0 0x5620a06aaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:56.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.789+0000 7f646b6cd740 1 --2- 172.21.15.148:0/3743772406 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5620a06808b0 0x5620a06aa530 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:56.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.789+0000 7f646b6cd740 1 -- 172.21.15.148:0/3743772406 >> 172.21.15.148:0/3743772406 conn(0x5620a067cf60 msgr2=0x5620a0687a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:56.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.789+0000 7f646b6cd740 1 -- 172.21.15.148:0/3743772406 shutdown_connections 2024-09-19T07:10:56.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.789+0000 7f646b6cd740 1 -- 172.21.15.148:0/3743772406 wait complete. 2024-09-19T07:10:56.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.790+0000 7f646b6cd740 20 client.15102 trim_cache size 0 max 16384 2024-09-19T07:10:56.816 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:10:56.816 INFO:teuthology.orchestra.run.smithi148.stdout: "cluster_fsid": "eae8a4a8-7654-11ef-bceb-c7b262605968", 2024-09-19T07:10:56.816 INFO:teuthology.orchestra.run.smithi148.stdout: "whoami": 0, 2024-09-19T07:10:56.817 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 24457, 2024-09-19T07:10:56.817 INFO:teuthology.orchestra.run.smithi148.stdout: "want_state": "up:active", 2024-09-19T07:10:56.817 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "up:active", 2024-09-19T07:10:56.817 INFO:teuthology.orchestra.run.smithi148.stdout: "fs_name": "cephfs", 2024-09-19T07:10:56.817 INFO:teuthology.orchestra.run.smithi148.stdout: "rank_uptime": 96.869841554999994, 2024-09-19T07:10:56.817 INFO:teuthology.orchestra.run.smithi148.stdout: "mdsmap_epoch": 24, 2024-09-19T07:10:56.817 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch": 80, 2024-09-19T07:10:56.817 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch_barrier": 78, 2024-09-19T07:10:56.817 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 115.72874280000001 2024-09-19T07:10:56.817 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:10:56.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.790+0000 7f64692f4640 1 -- 172.21.15.148:0/4176194502 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f64500a32d0 msgr2=0x7f64500a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:56.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.790+0000 7f64692f4640 1 --2- 172.21.15.148:0/4176194502 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f64500a32d0 0x7f64500a5790 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f64640fee00 tx=0x7f644c00b390 comp rx=0 tx=0).stop 2024-09-19T07:10:56.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.790+0000 7f64692f4640 1 -- 172.21.15.148:0/4176194502 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6464108290 msgr2=0x7f646419cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:56.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.790+0000 7f64692f4640 1 --2- 172.21.15.148:0/4176194502 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6464108290 0x7f646419cea0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f645c00eaa0 tx=0x7f645c00ef60 comp rx=0 tx=0).stop 2024-09-19T07:10:56.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.790+0000 7f64692f4640 1 -- 172.21.15.148:0/4176194502 shutdown_connections 2024-09-19T07:10:56.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.790+0000 7f64692f4640 1 --2- 172.21.15.148:0/4176194502 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7f64500a32d0 0x7f64500a5790 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:56.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.790+0000 7f64692f4640 1 --2- 172.21.15.148:0/4176194502 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6464108290 0x7f646419cea0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:56.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.790+0000 7f64692f4640 1 --2- 172.21.15.148:0/4176194502 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6464103740 0x7f6464198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:56.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.790+0000 7f64692f4640 1 --2- 172.21.15.148:0/4176194502 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6464102d90 0x7f64641985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:56.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.790+0000 7f64692f4640 1 -- 172.21.15.148:0/4176194502 >> 172.21.15.148:0/4176194502 conn(0x7f64640fc7d0 msgr2=0x7f6464106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:56.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.790+0000 7f64692f4640 1 -- 172.21.15.148:0/4176194502 shutdown_connections 2024-09-19T07:10:56.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:56.790+0000 7f64692f4640 1 -- 172.21.15.148:0/4176194502 wait complete. 2024-09-19T07:10:57.466 INFO:teuthology.run_tasks:Running task sequential... 2024-09-19T07:10:57.476 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-19T07:10:57.476 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-19T07:10:57.477 INFO:teuthology.task.print:Enabling mgr modules 2024-09-19T07:10:57.477 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-09-19T07:10:57.478 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T07:10:57.478 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi148.front.sepia.ceph.com 2024-09-19T07:10:57.478 DEBUG:teuthology.orchestra.run.smithi148:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-09-19T07:10:57.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:57.579+0000 7fbdca677640 1 -- 172.21.15.148:0/1550684831 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdc4101c60 msgr2=0x7fbdc41020e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:57.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:57.579+0000 7fbdca677640 1 --2- 172.21.15.148:0/1550684831 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdc4101c60 0x7fbdc41020e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fbdb8009900 tx=0x7fbdb802a410 comp rx=0 tx=0).stop 2024-09-19T07:10:57.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:57.579+0000 7fbdca677640 1 -- 172.21.15.148:0/1550684831 shutdown_connections 2024-09-19T07:10:57.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:57.579+0000 7fbdca677640 1 --2- 172.21.15.148:0/1550684831 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbdc4102620 0x7fbdc4108eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:57.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:57.579+0000 7fbdca677640 1 --2- 172.21.15.148:0/1550684831 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdc4101c60 0x7fbdc41020e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:57.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:57.579+0000 7fbdca677640 1 --2- 172.21.15.148:0/1550684831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdc4100a70 0x7fbdc4100e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:57.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:57.579+0000 7fbdca677640 1 -- 172.21.15.148:0/1550684831 >> 172.21.15.148:0/1550684831 conn(0x7fbdc40fc1f0 msgr2=0x7fbdc40fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:57.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:57.579+0000 7fbdca677640 1 -- 172.21.15.148:0/1550684831 shutdown_connections 2024-09-19T07:10:57.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:57.579+0000 7fbdca677640 1 -- 172.21.15.148:0/1550684831 wait complete. 2024-09-19T07:10:57.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:57.579+0000 7fbdca677640 1 Processor -- start 2024-09-19T07:10:57.584 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:57.580+0000 7fbdca677640 1 -- start start 2024-09-19T07:10:57.584 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:57.580+0000 7fbdca677640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbdc4100a70 0x7fbdc4197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:57.584 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:57.580+0000 7fbdca677640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdc4101c60 0x7fbdc4198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:57.584 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:57.580+0000 7fbdca677640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdc4102620 0x7fbdc419f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:57.584 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:57.580+0000 7fbdca677640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc410c720 con 0x7fbdc4102620 2024-09-19T07:10:57.584 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:57.580+0000 7fbdca677640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc410c5a0 con 0x7fbdc4100a70 2024-09-19T07:10:57.584 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:57.580+0000 7fbdca677640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc410c8a0 con 0x7fbdc4101c60 2024-09-19T07:10:57.584 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:57.580+0000 7fbdc8c14640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdc4102620 0x7fbdc419f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:57.584 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:57.580+0000 7fbdc8c14640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdc4102620 0x7fbdc419f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43610/0 (socket says 172.21.15.148:43610) 2024-09-19T07:10:57.584 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:57.580+0000 7fbdc8c14640 1 -- 172.21.15.148:0/1277968221 learned_addr learned my addr 172.21.15.148:0/1277968221 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:57.584 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:57.580+0000 7fbdc3fff640 1 --2- 172.21.15.148:0/1277968221 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbdc4100a70 0x7fbdc4197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:57.585 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:57.580+0000 7fbdc37fe640 1 --2- 172.21.15.148:0/1277968221 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdc4101c60 0x7fbdc4198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:57.585 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:57.580+0000 7fbdc8c14640 1 -- 172.21.15.148:0/1277968221 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdc4101c60 msgr2=0x7fbdc4198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:57.585 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:57.580+0000 7fbdc8c14640 1 --2- 172.21.15.148:0/1277968221 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdc4101c60 0x7fbdc4198310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:57.585 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:57.580+0000 7fbdc8c14640 1 -- 172.21.15.148:0/1277968221 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbdc4100a70 msgr2=0x7fbdc4197dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:57.585 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:57.580+0000 7fbdc8c14640 1 --2- 172.21.15.148:0/1277968221 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbdc4100a70 0x7fbdc4197dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:57.585 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:57.580+0000 7fbdc8c14640 1 -- 172.21.15.148:0/1277968221 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdc419f9f0 con 0x7fbdc4102620 2024-09-19T07:10:57.585 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:57.580+0000 7fbdc3fff640 1 --2- 172.21.15.148:0/1277968221 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbdc4100a70 0x7fbdc4197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:10:57.585 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:57.580+0000 7fbdc8c14640 1 --2- 172.21.15.148:0/1277968221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdc4102620 0x7fbdc419f380 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc00cce0 tx=0x7fbdbc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:57.585 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:57.581+0000 7fbdc17fa640 1 -- 172.21.15.148:0/1277968221 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc00f450 con 0x7fbdc4102620 2024-09-19T07:10:57.585 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:57.581+0000 7fbdc17fa640 1 -- 172.21.15.148:0/1277968221 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbdbc00fad0 con 0x7fbdc4102620 2024-09-19T07:10:57.585 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:57.581+0000 7fbdca677640 1 -- 172.21.15.148:0/1277968221 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdc419fce0 con 0x7fbdc4102620 2024-09-19T07:10:57.585 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:57.581+0000 7fbdc17fa640 1 -- 172.21.15.148:0/1277968221 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc018c10 con 0x7fbdc4102620 2024-09-19T07:10:57.585 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:57.581+0000 7fbdca677640 1 -- 172.21.15.148:0/1277968221 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdc41a0180 con 0x7fbdc4102620 2024-09-19T07:10:57.585 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:57.582+0000 7fbdca677640 1 -- 172.21.15.148:0/1277968221 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdc41a0410 con 0x7fbdc4102620 2024-09-19T07:10:57.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:57.583+0000 7fbdc17fa640 1 -- 172.21.15.148:0/1277968221 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fbdbc00f5f0 con 0x7fbdc4102620 2024-09-19T07:10:57.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:57.583+0000 7fbdc17fa640 1 --2- 172.21.15.148:0/1277968221 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fbdac0a3390 0x7fbdac0a5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:57.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:57.584+0000 7fbdc3fff640 1 --2- 172.21.15.148:0/1277968221 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fbdac0a3390 0x7fbdac0a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:57.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:57.584+0000 7fbdc17fa640 1 -- 172.21.15.148:0/1277968221 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7fbdbc0d0270 con 0x7fbdc4102620 2024-09-19T07:10:57.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:57.584+0000 7fbdc3fff640 1 --2- 172.21.15.148:0/1277968221 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fbdac0a3390 0x7fbdac0a5850 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4101ac0 tx=0x7fbdb400a560 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:57.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:57.587+0000 7fbdc17fa640 1 -- 172.21.15.148:0/1277968221 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbdbc014030 con 0x7fbdc4102620 2024-09-19T07:10:57.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:57.800+0000 7fbdca677640 1 -- 172.21.15.148:0/1277968221 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7fbdc41a0680 con 0x7fbdc4102620 2024-09-19T07:10:58.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:58.163+0000 7fbdc17fa640 1 -- 172.21.15.148:0/1277968221 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v18) ==== 92+0+0 (secure 0 0 0) 0x7fbdbc09ced0 con 0x7fbdc4102620 2024-09-19T07:10:58.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:58.166+0000 7fbdca677640 1 -- 172.21.15.148:0/1277968221 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fbdac0a3390 msgr2=0x7fbdac0a5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:58.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:58.166+0000 7fbdca677640 1 --2- 172.21.15.148:0/1277968221 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fbdac0a3390 0x7fbdac0a5850 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4101ac0 tx=0x7fbdb400a560 comp rx=0 tx=0).stop 2024-09-19T07:10:58.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:58.166+0000 7fbdca677640 1 -- 172.21.15.148:0/1277968221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdc4102620 msgr2=0x7fbdc419f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:58.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:58.166+0000 7fbdca677640 1 --2- 172.21.15.148:0/1277968221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdc4102620 0x7fbdc419f380 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc00cce0 tx=0x7fbdbc00a620 comp rx=0 tx=0).stop 2024-09-19T07:10:58.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:58.166+0000 7fbdca677640 1 -- 172.21.15.148:0/1277968221 shutdown_connections 2024-09-19T07:10:58.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:58.166+0000 7fbdca677640 1 --2- 172.21.15.148:0/1277968221 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7fbdac0a3390 0x7fbdac0a5850 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:58.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:58.166+0000 7fbdca677640 1 --2- 172.21.15.148:0/1277968221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdc4102620 0x7fbdc419f380 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:58.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:58.166+0000 7fbdca677640 1 --2- 172.21.15.148:0/1277968221 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdc4101c60 0x7fbdc4198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:58.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:58.166+0000 7fbdca677640 1 --2- 172.21.15.148:0/1277968221 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbdc4100a70 0x7fbdc4197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:58.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:58.166+0000 7fbdca677640 1 -- 172.21.15.148:0/1277968221 >> 172.21.15.148:0/1277968221 conn(0x7fbdc40fc1f0 msgr2=0x7fbdc40fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:58.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:58.166+0000 7fbdca677640 1 -- 172.21.15.148:0/1277968221 shutdown_connections 2024-09-19T07:10:58.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:58.166+0000 7fbdca677640 1 -- 172.21.15.148:0/1277968221 wait complete. 2024-09-19T07:10:58.184 INFO:teuthology.run_tasks:Running task kclient... 2024-09-19T07:10:58.210 INFO:tasks.kclient:Mounting kernel clients... 2024-09-19T07:10:58.210 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-19T07:10:58.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:10:58.211 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2024-09-19T07:10:58.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:10:58.228 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link delete ceph-brx 2024-09-19T07:10:58.296 INFO:teuthology.orchestra.run.smithi148.stderr:Cannot find device "ceph-brx" 2024-09-19T07:10:58.298 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:10:58.298 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'wsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-09-19T07:10:58.298 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T07:10:58.298 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T07:10:58.299 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-19T07:10:58.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:58 smithi179 ceph-mon[35716]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:10:58.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:58 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/1277968221' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-19T07:10:58.523 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:10:58 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: ignoring --setuser ceph since I am not root 2024-09-19T07:10:58.523 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:10:58 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: ignoring --setgroup ceph since I am not root 2024-09-19T07:10:58.523 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:10:58 smithi179 ceph-mgr[37517]: -- 172.21.15.179:0/1740204780 <== mon.1 v2:172.21.15.179:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5632461db0e0 con 0x5632461b9000 2024-09-19T07:10:58.523 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:10:58 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: 2024-09-19T07:10:58.320+0000 7fee5b8a3040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T07:10:58.523 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:10:58 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: 2024-09-19T07:10:58.377+0000 7fee5b8a3040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T07:10:58.523 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:58 smithi165 ceph-mon[35326]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:10:58.524 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:58 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/1277968221' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-19T07:10:58.524 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:10:58 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: ignoring --setuser ceph since I am not root 2024-09-19T07:10:58.524 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:10:58 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: ignoring --setgroup ceph since I am not root 2024-09-19T07:10:58.524 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:10:58 smithi165 ceph-mgr[36696]: -- 172.21.15.165:0/2055692340 <== mon.2 v2:172.21.15.165:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555b6616d0e0 con 0x555b6614b000 2024-09-19T07:10:58.524 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:10:58 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: 2024-09-19T07:10:58.317+0000 7f3423ecc040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T07:10:58.524 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:10:58 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: 2024-09-19T07:10:58.374+0000 7f3423ecc040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T07:10:58.525 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:10:58 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: 2024-09-19T07:10:58.522+0000 7f3423ecc040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T07:10:58.537 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:58 smithi148 ceph-mon[31180]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:10:58.538 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:58 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/1277968221' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-19T07:10:58.538 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:10:58 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: ignoring --setuser ceph since I am not root 2024-09-19T07:10:58.538 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:10:58 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: ignoring --setgroup ceph since I am not root 2024-09-19T07:10:58.538 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:10:58 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:10:58.320+0000 7f0f6d783040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T07:10:58.538 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:10:58 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:10:58.380+0000 7f0f6d783040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T07:10:58.538 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:10:58 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:10:58.536+0000 7f0f6d783040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T07:10:58.595 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:10:58.833 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:10:58 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:10:58.611+0000 7f0f6d783040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T07:10:58.833 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:10:58 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:10:58.765+0000 7f0f6d783040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:10:58.877 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:10:58 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: 2024-09-19T07:10:58.523+0000 7fee5b8a3040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T07:10:58.877 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:10:58 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: 2024-09-19T07:10:58.590+0000 7fee5b8a3040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T07:10:58.877 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:10:58 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: 2024-09-19T07:10:58.736+0000 7fee5b8a3040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:10:58.878 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:10:58 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: 2024-09-19T07:10:58.589+0000 7f3423ecc040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T07:10:58.878 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:10:58 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: 2024-09-19T07:10:58.736+0000 7f3423ecc040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:10:59.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.063+0000 7faefd5b3640 1 -- 172.21.15.148:0/3258288574 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faef81036e0 msgr2=0x7faef8107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:59.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.063+0000 7faefd5b3640 1 --2- 172.21.15.148:0/3258288574 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faef81036e0 0x7faef8107b90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7faeec009930 tx=0x7faeec02a420 comp rx=0 tx=0).stop 2024-09-19T07:10:59.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.063+0000 7faefd5b3640 1 -- 172.21.15.148:0/3258288574 shutdown_connections 2024-09-19T07:10:59.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.063+0000 7faefd5b3640 1 --2- 172.21.15.148:0/3258288574 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faef81082a0 0x7faef810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:59.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.063+0000 7faefd5b3640 1 --2- 172.21.15.148:0/3258288574 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faef81036e0 0x7faef8107b90 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:59.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.063+0000 7faefd5b3640 1 --2- 172.21.15.148:0/3258288574 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faef8102d30 0x7faef8103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:59.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.063+0000 7faefd5b3640 1 -- 172.21.15.148:0/3258288574 >> 172.21.15.148:0/3258288574 conn(0x7faef80fc7d0 msgr2=0x7faef80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:59.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.063+0000 7faefd5b3640 1 -- 172.21.15.148:0/3258288574 shutdown_connections 2024-09-19T07:10:59.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.064+0000 7faefd5b3640 1 -- 172.21.15.148:0/3258288574 wait complete. 2024-09-19T07:10:59.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.064+0000 7faefd5b3640 1 Processor -- start 2024-09-19T07:10:59.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.064+0000 7faefd5b3640 1 -- start start 2024-09-19T07:10:59.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.064+0000 7faefd5b3640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faef8102d30 0x7faef81985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:59.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.064+0000 7faefd5b3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faef81036e0 0x7faef8198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:59.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.064+0000 7faefd5b3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faef81082a0 0x7faef819ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:59.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.064+0000 7faefd5b3640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7faef81120a0 con 0x7faef81036e0 2024-09-19T07:10:59.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.064+0000 7faefd5b3640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7faef8111f20 con 0x7faef8102d30 2024-09-19T07:10:59.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.064+0000 7faefd5b3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7faef8112220 con 0x7faef81082a0 2024-09-19T07:10:59.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.065+0000 7faef67fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faef81036e0 0x7faef8198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:59.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.065+0000 7faef67fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faef81036e0 0x7faef8198b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43664/0 (socket says 172.21.15.148:43664) 2024-09-19T07:10:59.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.065+0000 7faef67fc640 1 -- 172.21.15.148:0/3590550171 learned_addr learned my addr 172.21.15.148:0/3590550171 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:10:59.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.065+0000 7faef6ffd640 1 --2- 172.21.15.148:0/3590550171 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faef8102d30 0x7faef81985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:59.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.065+0000 7faef77fe640 1 --2- 172.21.15.148:0/3590550171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faef81082a0 0x7faef819ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:10:59.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.065+0000 7faef67fc640 1 -- 172.21.15.148:0/3590550171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faef81082a0 msgr2=0x7faef819ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:59.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.065+0000 7faef67fc640 1 --2- 172.21.15.148:0/3590550171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faef81082a0 0x7faef819ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:59.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.065+0000 7faef67fc640 1 -- 172.21.15.148:0/3590550171 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faef8102d30 msgr2=0x7faef81985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:59.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.065+0000 7faef67fc640 1 --2- 172.21.15.148:0/3590550171 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faef8102d30 0x7faef81985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:59.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.065+0000 7faef67fc640 1 -- 172.21.15.148:0/3590550171 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faef819d590 con 0x7faef81036e0 2024-09-19T07:10:59.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.065+0000 7faef6ffd640 1 --2- 172.21.15.148:0/3590550171 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faef8102d30 0x7faef81985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:10:59.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.065+0000 7faef67fc640 1 --2- 172.21.15.148:0/3590550171 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faef81036e0 0x7faef8198b20 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7faeec005940 tx=0x7faeec031b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:10:59.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.065+0000 7faedffff640 1 -- 172.21.15.148:0/3590550171 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeec03f030 con 0x7faef81036e0 2024-09-19T07:10:59.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.065+0000 7faedffff640 1 -- 172.21.15.148:0/3590550171 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faeec0043d0 con 0x7faef81036e0 2024-09-19T07:10:59.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.065+0000 7faefd5b3640 1 -- 172.21.15.148:0/3590550171 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faef819d820 con 0x7faef81036e0 2024-09-19T07:10:59.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.065+0000 7faedffff640 1 -- 172.21.15.148:0/3590550171 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeec035070 con 0x7faef81036e0 2024-09-19T07:10:59.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.065+0000 7faefd5b3640 1 -- 172.21.15.148:0/3590550171 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faef81a5160 con 0x7faef81036e0 2024-09-19T07:10:59.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.066+0000 7faefd5b3640 1 -- 172.21.15.148:0/3590550171 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faef806a850 con 0x7faef81036e0 2024-09-19T07:10:59.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.067+0000 7faedffff640 1 -- 172.21.15.148:0/3590550171 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 18) ==== 138424+0+0 (secure 0 0 0) 0x7faeec042030 con 0x7faef81036e0 2024-09-19T07:10:59.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.068+0000 7faedffff640 1 --2- 172.21.15.148:0/3590550171 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7faee00a3320 0x7faee00a57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:10:59.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.068+0000 7faef6ffd640 1 -- 172.21.15.148:0/3590550171 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7faee00a3320 msgr2=0x7faee00a57e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:6800/3007822654 2024-09-19T07:10:59.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.068+0000 7faedffff640 1 -- 172.21.15.148:0/3590550171 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8211+0+0 (secure 0 0 0) 0x7faeec0efd20 con 0x7faef81036e0 2024-09-19T07:10:59.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.068+0000 7faef6ffd640 1 --2- 172.21.15.148:0/3590550171 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7faee00a3320 0x7faee00a57e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T07:10:59.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.072+0000 7faedffff640 1 -- 172.21.15.148:0/3590550171 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7faeec0bc2a0 con 0x7faef81036e0 2024-09-19T07:10:59.133 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:10:58 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: 2024-09-19T07:10:58.876+0000 7f3423ecc040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T07:10:59.179 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:10:58 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: 2024-09-19T07:10:58.876+0000 7fee5b8a3040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T07:10:59.180 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:10:58 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:10:58.913+0000 7f0f6d783040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T07:10:59.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.269+0000 7faef6ffd640 1 -- 172.21.15.148:0/3590550171 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7faee00a3320 msgr2=0x7faee00a57e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:6800/3007822654 2024-09-19T07:10:59.270 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.269+0000 7faef6ffd640 1 --2- 172.21.15.148:0/3590550171 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7faee00a3320 0x7faee00a57e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T07:10:59.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.287+0000 7faefd5b3640 1 -- 172.21.15.148:0/3590550171 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7faef810a2b0 con 0x7faef81036e0 2024-09-19T07:10:59.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.287+0000 7faedffff640 1 -- 172.21.15.148:0/3590550171 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) ==== 53+0+73 (secure 0 0 0) 0x7faeec0c05a0 con 0x7faef81036e0 2024-09-19T07:10:59.288 INFO:teuthology.orchestra.run.smithi148.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T07:10:59.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.289+0000 7faefd5b3640 1 -- 172.21.15.148:0/3590550171 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7faee00a3320 msgr2=0x7faee00a57e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T07:10:59.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.289+0000 7faefd5b3640 1 --2- 172.21.15.148:0/3590550171 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7faee00a3320 0x7faee00a57e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:59.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.290+0000 7faefd5b3640 1 -- 172.21.15.148:0/3590550171 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faef81036e0 msgr2=0x7faef8198b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:10:59.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.290+0000 7faefd5b3640 1 --2- 172.21.15.148:0/3590550171 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faef81036e0 0x7faef8198b20 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7faeec005940 tx=0x7faeec031b50 comp rx=0 tx=0).stop 2024-09-19T07:10:59.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.290+0000 7faefd5b3640 1 -- 172.21.15.148:0/3590550171 shutdown_connections 2024-09-19T07:10:59.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.290+0000 7faefd5b3640 1 --2- 172.21.15.148:0/3590550171 >> [v2:172.21.15.148:6800/3007822654,v1:172.21.15.148:6801/3007822654] conn(0x7faee00a3320 0x7faee00a57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:59.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.290+0000 7faefd5b3640 1 --2- 172.21.15.148:0/3590550171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faef81082a0 0x7faef819ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:59.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.290+0000 7faefd5b3640 1 --2- 172.21.15.148:0/3590550171 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faef81036e0 0x7faef8198b20 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:59.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.290+0000 7faefd5b3640 1 --2- 172.21.15.148:0/3590550171 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faef8102d30 0x7faef81985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:10:59.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.290+0000 7faefd5b3640 1 -- 172.21.15.148:0/3590550171 >> 172.21.15.148:0/3590550171 conn(0x7faef80fc7d0 msgr2=0x7faef8105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:10:59.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.290+0000 7faefd5b3640 1 -- 172.21.15.148:0/3590550171 shutdown_connections 2024-09-19T07:10:59.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:10:59.290+0000 7faefd5b3640 1 -- 172.21.15.148:0/3590550171 wait complete. 2024-09-19T07:10:59.436 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:59 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/1277968221' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-19T07:10:59.437 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:10:59 smithi179 ceph-mon[35716]: mgrmap e18: x(active, since 8m), standbys: y, z 2024-09-19T07:10:59.437 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:10:59 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: 2024-09-19T07:10:59.191+0000 7fee5b8a3040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T07:10:59.437 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:10:59 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: 2024-09-19T07:10:59.251+0000 7fee5b8a3040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T07:10:59.438 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:59 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/1277968221' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-19T07:10:59.438 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:10:59 smithi165 ceph-mon[35326]: mgrmap e18: x(active, since 8m), standbys: y, z 2024-09-19T07:10:59.439 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:10:59 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: 2024-09-19T07:10:59.192+0000 7f3423ecc040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T07:10:59.439 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:10:59 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: 2024-09-19T07:10:59.253+0000 7f3423ecc040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T07:10:59.509 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:10:59 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:10:59.241+0000 7f0f6d783040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T07:10:59.509 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:10:59 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:10:59.305+0000 7f0f6d783040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T07:10:59.509 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:59 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/1277968221' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-19T07:10:59.509 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:10:59 smithi148 ceph-mon[31180]: mgrmap e18: x(active, since 8m), standbys: y, z 2024-09-19T07:10:59.772 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:10:59 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: 2024-09-19T07:10:59.435+0000 7fee5b8a3040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T07:10:59.808 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:10:59 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:10:59.507+0000 7f0f6d783040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T07:10:59.884 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:10:59 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: 2024-09-19T07:10:59.437+0000 7f3423ecc040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T07:11:00.094 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T07:11:00.094 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T07:11:00.094 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2024-09-19T07:11:00.094 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T07:11:00.094 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T07:11:00.094 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T07:11:00.094 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T07:11:00.094 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T07:11:00.095 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T07:11:00.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:11:00.095 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2024-09-19T07:11:00.113 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T07:11:00.113 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T07:11:00.113 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T07:11:00.114 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2024-09-19T07:11:00.114 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2024-09-19T07:11:00.114 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2024-09-19T07:11:00.114 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T07:11:00.114 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2024-09-19T07:11:00.114 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2024-09-19T07:11:00.114 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T07:11:00.114 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2024-09-19T07:11:00.114 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2024-09-19T07:11:00.115 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T07:11:00.115 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2024-09-19T07:11:00.115 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T07:11:00.115 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2024-09-19T07:11:00.115 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-19T07:11:00.115 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 42240sec preferred_lft 42240sec 2024-09-19T07:11:00.115 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link noprefixroute 2024-09-19T07:11:00.115 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2024-09-19T07:11:00.116 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T07:11:00.116 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T07:11:00.116 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2024-09-19T07:11:00.116 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link add name ceph-brx type bridge 2024-09-19T07:11:00.116 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip addr flush dev ceph-brx 2024-09-19T07:11:00.116 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set ceph-brx up 2024-09-19T07:11:00.116 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T07:11:00.116 DEBUG:teuthology.orchestra.run.smithi148:> ') 2024-09-19T07:11:00.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T07:11:00.313 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:00 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/3590550171' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T07:11:00.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T07:11:00.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:11:00.333 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T07:11:00.360 INFO:teuthology.orchestra.run.smithi148.stdout:1 2024-09-19T07:11:00.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:11:00.363 DEBUG:teuthology.orchestra.run.smithi148:> route 2024-09-19T07:11:00.431 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2024-09-19T07:11:00.431 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T07:11:00.431 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T07:11:00.431 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T07:11:00.431 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T07:11:00.432 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T07:11:00.432 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2024-09-19T07:11:00.432 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T07:11:00.432 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T07:11:00.432 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T07:11:00.432 DEBUG:teuthology.orchestra.run.smithi148:> ') 2024-09-19T07:11:00.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T07:11:00.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:00 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/3590550171' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T07:11:00.522 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:11:00 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: 2024-09-19T07:11:00.317+0000 7fee5b8a3040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T07:11:00.522 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:11:00 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: 2024-09-19T07:11:00.384+0000 7fee5b8a3040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T07:11:00.583 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:11:00 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:11:00.467+0000 7f0f6d783040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T07:11:00.583 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:11:00 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:11:00.540+0000 7f0f6d783040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T07:11:00.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:00 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/3590550171' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T07:11:00.634 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:11:00 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: 2024-09-19T07:11:00.318+0000 7f3423ecc040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T07:11:00.634 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:11:00 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: 2024-09-19T07:11:00.385+0000 7f3423ecc040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T07:11:00.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T07:11:00.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:11:00.742 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2024-09-19T07:11:00.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:11:00.759 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list-id 2024-09-19T07:11:00.816 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T07:11:00.816 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2024-09-19T07:11:00.816 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T07:11:00.816 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-19T07:11:00.816 DEBUG:teuthology.orchestra.run.smithi148:> ') 2024-09-19T07:11:00.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T07:11:00.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T07:11:00.937 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-19T07:11:00.937 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T07:11:00.937 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2024-09-19T07:11:00.937 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-19T07:11:00.937 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T07:11:00.937 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-19T07:11:00.937 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-19T07:11:00.938 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-19T07:11:00.938 DEBUG:teuthology.orchestra.run.smithi148:> ') 2024-09-19T07:11:00.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T07:11:01.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T07:11:01.070 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T07:11:01.071 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2024-09-19T07:11:01.071 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2024-09-19T07:11:01.071 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T07:11:01.071 DEBUG:teuthology.orchestra.run.smithi148:> ') 2024-09-19T07:11:01.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T07:11:01.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T07:11:01.152 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T07:11:01.153 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T07:11:01.169 INFO:teuthology.orchestra.run.smithi148.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T07:11:01.169 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T07:11:01.169 DEBUG:teuthology.orchestra.run.smithi148:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T07:11:01.224 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-19T07:11:01.224 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-19T07:11:01.224 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f 2024-09-19T07:11:01.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:11:01.225 DEBUG:teuthology.orchestra.run.smithi148:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-19T07:11:01.334 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-19T07:11:01.335 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync". 2024-09-19T07:11:01.350 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:11:01 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: 2024-09-19T07:11:01.091+0000 7fee5b8a3040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T07:11:01.350 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:11:01 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: 2024-09-19T07:11:01.207+0000 7fee5b8a3040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T07:11:01.355 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:11:01 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: 2024-09-19T07:11:01.095+0000 7f3423ecc040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T07:11:01.355 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:11:01 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: 2024-09-19T07:11:01.212+0000 7f3423ecc040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T07:11:01.471 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-19T07:11:01.471 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync". 2024-09-19T07:11:01.472 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: resolved to: "172.21.15.148:3300,172.21.15.165:3300,172.21.15.179:3300" 2024-09-19T07:11:01.472 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: trying mount with new device syntax: 0@eae8a4a8-7654-11ef-bceb-c7b262605968.cephfs=/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f 2024-09-19T07:11:01.472 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync,name=0,key=0,mon_addr=172.21.15.148:3300/172.21.15.165:3300/172.21.15.179:3300" will pass to kernel 2024-09-19T07:11:01.472 INFO:teuthology.orchestra.run.smithi148.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-19T07:11:01.472 INFO:teuthology.orchestra.run.smithi148.stdout: You just mounted a file system that supports labels which does not 2024-09-19T07:11:01.472 INFO:teuthology.orchestra.run.smithi148.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-19T07:11:01.473 INFO:teuthology.orchestra.run.smithi148.stdout: applications will generate AVC messages and not be allowed access to 2024-09-19T07:11:01.473 INFO:teuthology.orchestra.run.smithi148.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-19T07:11:01.474 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-19T07:11:01.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:11:01.474 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T07:11:01.583 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:11:01 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:11:01.310+0000 7f0f6d783040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T07:11:01.583 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:11:01 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:11:01.433+0000 7f0f6d783040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T07:11:01.628 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:11:01 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: 2024-09-19T07:11:01.349+0000 7fee5b8a3040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:11:01.629 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:11:01 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: 2024-09-19T07:11:01.411+0000 7fee5b8a3040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T07:11:01.629 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:11:01 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: 2024-09-19T07:11:01.560+0000 7fee5b8a3040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T07:11:01.629 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:11:01 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: 2024-09-19T07:11:01.627+0000 7fee5b8a3040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T07:11:01.634 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:11:01 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: 2024-09-19T07:11:01.355+0000 7f3423ecc040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:11:01.634 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:11:01 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: 2024-09-19T07:11:01.416+0000 7f3423ecc040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T07:11:01.634 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:11:01 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: 2024-09-19T07:11:01.568+0000 7f3423ecc040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T07:11:01.865 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:11:01 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:11:01.583+0000 7f0f6d783040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:11:01.865 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:11:01 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:11:01.645+0000 7f0f6d783040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T07:11:01.865 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:11:01 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:11:01.795+0000 7f0f6d783040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T07:11:01.913 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:11:01 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: 2024-09-19T07:11:01.688+0000 7fee5b8a3040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T07:11:01.913 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:11:01 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: 2024-09-19T07:11:01.847+0000 7fee5b8a3040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T07:11:01.920 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:11:01 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: 2024-09-19T07:11:01.637+0000 7f3423ecc040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T07:11:01.920 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:11:01 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: 2024-09-19T07:11:01.697+0000 7f3423ecc040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T07:11:01.920 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:11:01 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: 2024-09-19T07:11:01.855+0000 7f3423ecc040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T07:11:01.921 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:11:01 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: 2024-09-19T07:11:01.919+0000 7f3423ecc040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T07:11:02.149 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:11:01 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:11:01.864+0000 7f0f6d783040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T07:11:02.149 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:11:01 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:11:01.924+0000 7f0f6d783040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T07:11:02.149 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:11:02 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:11:02.083+0000 7f0f6d783040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T07:11:02.179 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:11:01 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: 2024-09-19T07:11:01.912+0000 7fee5b8a3040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T07:11:02.179 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:11:01 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: 2024-09-19T07:11:01.978+0000 7fee5b8a3040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T07:11:02.179 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:11:02 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: 2024-09-19T07:11:02.060+0000 7fee5b8a3040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T07:11:02.179 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:11:02 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: 2024-09-19T07:11:02.118+0000 7fee5b8a3040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T07:11:02.188 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:11:01 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: 2024-09-19T07:11:01.986+0000 7f3423ecc040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T07:11:02.188 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:11:02 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: 2024-09-19T07:11:02.068+0000 7f3423ecc040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T07:11:02.188 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:11:02 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: 2024-09-19T07:11:02.128+0000 7f3423ecc040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T07:11:02.188 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:11:02 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: 2024-09-19T07:11:02.187+0000 7f3423ecc040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T07:11:02.417 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:11:02 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:11:02.148+0000 7f0f6d783040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T07:11:02.417 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:11:02 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:11:02.214+0000 7f0f6d783040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T07:11:02.417 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:11:02 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:11:02.297+0000 7f0f6d783040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T07:11:02.417 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:11:02 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:11:02.357+0000 7f0f6d783040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T07:11:02.522 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:11:02 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: 2024-09-19T07:11:02.178+0000 7fee5b8a3040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T07:11:02.833 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:11:02 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:11:02.416+0000 7f0f6d783040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T07:11:03.260 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T07:11:03.272 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:11:02 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z[37513]: 2024-09-19T07:11:02.967+0000 7fee5b8a3040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T07:11:03.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:03 smithi179 ceph-mon[35716]: Standby manager daemon z restarted 2024-09-19T07:11:03.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:03 smithi179 ceph-mon[35716]: Standby manager daemon z started 2024-09-19T07:11:03.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:03 smithi179 ceph-mon[35716]: from='mgr.? 172.21.15.179:0/1453393351' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T07:11:03.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:03 smithi179 ceph-mon[35716]: from='mgr.? 172.21.15.179:0/1453393351' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T07:11:03.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:03 smithi179 ceph-mon[35716]: from='mgr.? 172.21.15.179:0/1453393351' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T07:11:03.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:03 smithi179 ceph-mon[35716]: from='mgr.? 172.21.15.179:0/1453393351' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T07:11:03.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:03 smithi179 ceph-mon[35716]: Standby manager daemon y restarted 2024-09-19T07:11:03.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:03 smithi179 ceph-mon[35716]: Standby manager daemon y started 2024-09-19T07:11:03.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:03 smithi179 ceph-mon[35716]: from='mgr.? 172.21.15.165:0/2981461394' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T07:11:03.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:03 smithi179 ceph-mon[35716]: from='mgr.? 172.21.15.165:0/2981461394' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T07:11:03.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:03 smithi179 ceph-mon[35716]: from='mgr.? 172.21.15.165:0/2981461394' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T07:11:03.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:03 smithi179 ceph-mon[35716]: from='mgr.? 172.21.15.165:0/2981461394' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T07:11:03.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T07:11:03.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T07:11:03.327 INFO:teuthology.orchestra.run.smithi148.stdout:client24793 2024-09-19T07:11:03.328 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-19T07:11:03.328 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T07:11:03.333 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:11:03 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:11:03.218+0000 7f0f6d783040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T07:11:03.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:03 smithi148 ceph-mon[31180]: Standby manager daemon z restarted 2024-09-19T07:11:03.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:03 smithi148 ceph-mon[31180]: Standby manager daemon z started 2024-09-19T07:11:03.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:03 smithi148 ceph-mon[31180]: from='mgr.? 172.21.15.179:0/1453393351' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T07:11:03.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:03 smithi148 ceph-mon[31180]: from='mgr.? 172.21.15.179:0/1453393351' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T07:11:03.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:03 smithi148 ceph-mon[31180]: from='mgr.? 172.21.15.179:0/1453393351' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T07:11:03.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:03 smithi148 ceph-mon[31180]: from='mgr.? 172.21.15.179:0/1453393351' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T07:11:03.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:03 smithi148 ceph-mon[31180]: Standby manager daemon y restarted 2024-09-19T07:11:03.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:03 smithi148 ceph-mon[31180]: Standby manager daemon y started 2024-09-19T07:11:03.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:03 smithi148 ceph-mon[31180]: from='mgr.? 172.21.15.165:0/2981461394' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T07:11:03.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:03 smithi148 ceph-mon[31180]: from='mgr.? 172.21.15.165:0/2981461394' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T07:11:03.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:03 smithi148 ceph-mon[31180]: from='mgr.? 172.21.15.165:0/2981461394' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T07:11:03.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:03 smithi148 ceph-mon[31180]: from='mgr.? 172.21.15.165:0/2981461394' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T07:11:03.345 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T07:11:03.384 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:11:02 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y[36692]: 2024-09-19T07:11:02.983+0000 7f3423ecc040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T07:11:03.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:03 smithi165 ceph-mon[35326]: Standby manager daemon z restarted 2024-09-19T07:11:03.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:03 smithi165 ceph-mon[35326]: Standby manager daemon z started 2024-09-19T07:11:03.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:03 smithi165 ceph-mon[35326]: from='mgr.? 172.21.15.179:0/1453393351' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T07:11:03.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:03 smithi165 ceph-mon[35326]: from='mgr.? 172.21.15.179:0/1453393351' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T07:11:03.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:03 smithi165 ceph-mon[35326]: from='mgr.? 172.21.15.179:0/1453393351' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T07:11:03.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:03 smithi165 ceph-mon[35326]: from='mgr.? 172.21.15.179:0/1453393351' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T07:11:03.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:03 smithi165 ceph-mon[35326]: Standby manager daemon y restarted 2024-09-19T07:11:03.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:03 smithi165 ceph-mon[35326]: Standby manager daemon y started 2024-09-19T07:11:03.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:03 smithi165 ceph-mon[35326]: from='mgr.? 172.21.15.165:0/2981461394' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T07:11:03.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:03 smithi165 ceph-mon[35326]: from='mgr.? 172.21.15.165:0/2981461394' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T07:11:03.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:03 smithi165 ceph-mon[35326]: from='mgr.? 172.21.15.165:0/2981461394' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T07:11:03.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:03 smithi165 ceph-mon[35326]: from='mgr.? 172.21.15.165:0/2981461394' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T07:11:03.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T07:11:03.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T07:11:03.467 INFO:teuthology.orchestra.run.smithi148.stdout:client24793 2024-09-19T07:11:03.467 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T07:11:03.540 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T07:11:03.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T07:11:03.550 INFO:teuthology.orchestra.run.smithi148.stdout:client24793 2024-09-19T07:11:03.550 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968.client24793/status') 2024-09-19T07:11:03.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T07:11:03.617 INFO:teuthology.orchestra.run.smithi148.stdout:instance: client.24793 (3)172.21.15.148:0/3706247101 2024-09-19T07:11:03.617 INFO:teuthology.orchestra.run.smithi148.stdout:blocklisted: false 2024-09-19T07:11:03.617 INFO:teuthology.orchestra.run.smithi148.stderr:0+1 records in 2024-09-19T07:11:03.617 INFO:teuthology.orchestra.run.smithi148.stderr:0+1 records out 2024-09-19T07:11:03.617 INFO:teuthology.orchestra.run.smithi148.stderr:72 bytes copied, 2.3222e-05 s, 3.1 MB/s 2024-09-19T07:11:03.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T07:11:03.626 INFO:teuthology.run_tasks:Running task exec... 2024-09-19T07:11:03.635 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T07:11:03.636 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi148.front.sepia.ceph.com 2024-09-19T07:11:03.636 DEBUG:teuthology.orchestra.run.smithi148:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-19T07:11:03.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:03.739+0000 7f267f867640 1 -- 172.21.15.148:0/362609919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2678104ef0 msgr2=0x7f26781072e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:03.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:03.739+0000 7f267f867640 1 --2- 172.21.15.148:0/362609919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2678104ef0 0x7f26781072e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2668009900 tx=0x7f266802a410 comp rx=0 tx=0).stop 2024-09-19T07:11:03.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:03.739+0000 7f267f867640 1 -- 172.21.15.148:0/362609919 shutdown_connections 2024-09-19T07:11:03.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:03.739+0000 7f267f867640 1 --2- 172.21.15.148:0/362609919 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2678107820 0x7f2678109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:03.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:03.739+0000 7f267f867640 1 --2- 172.21.15.148:0/362609919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2678104ef0 0x7f26781072e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:03.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:03.739+0000 7f267f867640 1 --2- 172.21.15.148:0/362609919 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26781025c0 0x7f26781049b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:03.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:03.739+0000 7f267f867640 1 -- 172.21.15.148:0/362609919 >> 172.21.15.148:0/362609919 conn(0x7f26780fc1e0 msgr2=0x7f26780fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:03.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:03.739+0000 7f267f867640 1 -- 172.21.15.148:0/362609919 shutdown_connections 2024-09-19T07:11:03.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:03.739+0000 7f267f867640 1 -- 172.21.15.148:0/362609919 wait complete. 2024-09-19T07:11:03.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:03.740+0000 7f267f867640 1 Processor -- start 2024-09-19T07:11:03.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:03.740+0000 7f267f867640 1 -- start start 2024-09-19T07:11:03.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:03.740+0000 7f267f867640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26781025c0 0x7f267819a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:03.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:03.740+0000 7f267f867640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2678104ef0 0x7f267819a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:03.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:03.740+0000 7f267f867640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2678107820 0x7f26781a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:03.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:03.740+0000 7f267f867640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f267810d7d0 con 0x7f2678104ef0 2024-09-19T07:11:03.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:03.740+0000 7f267f867640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f267810d650 con 0x7f2678107820 2024-09-19T07:11:03.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:03.740+0000 7f267f867640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f267810d950 con 0x7f26781025c0 2024-09-19T07:11:03.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:03.740+0000 7f267ce02640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2678104ef0 0x7f267819a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:03.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:03.740+0000 7f267ce02640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2678104ef0 0x7f267819a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43808/0 (socket says 172.21.15.148:43808) 2024-09-19T07:11:03.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:03.740+0000 7f267ce02640 1 -- 172.21.15.148:0/2455600247 learned_addr learned my addr 172.21.15.148:0/2455600247 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:03.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:03.740+0000 7f267d603640 1 --2- 172.21.15.148:0/2455600247 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26781025c0 0x7f267819a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:03.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:03.740+0000 7f267de04640 1 --2- 172.21.15.148:0/2455600247 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2678107820 0x7f26781a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:03.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:03.740+0000 7f267ce02640 1 -- 172.21.15.148:0/2455600247 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26781025c0 msgr2=0x7f267819a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:03.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:03.740+0000 7f267ce02640 1 --2- 172.21.15.148:0/2455600247 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26781025c0 0x7f267819a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:03.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:03.740+0000 7f267ce02640 1 -- 172.21.15.148:0/2455600247 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2678107820 msgr2=0x7f26781a15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:03.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:03.740+0000 7f267ce02640 1 --2- 172.21.15.148:0/2455600247 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2678107820 0x7f26781a15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:03.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:03.740+0000 7f267ce02640 1 -- 172.21.15.148:0/2455600247 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26781a1c50 con 0x7f2678104ef0 2024-09-19T07:11:03.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:03.740+0000 7f267ce02640 1 --2- 172.21.15.148:0/2455600247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2678104ef0 0x7f267819a570 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f2668031610 tx=0x7f2668004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:03.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:03.741+0000 7f266e7fc640 1 -- 172.21.15.148:0/2455600247 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f266803f030 con 0x7f2678104ef0 2024-09-19T07:11:03.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:03.741+0000 7f266e7fc640 1 -- 172.21.15.148:0/2455600247 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2668003ad0 con 0x7f2678104ef0 2024-09-19T07:11:03.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:03.741+0000 7f267f867640 1 -- 172.21.15.148:0/2455600247 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26781a1ee0 con 0x7f2678104ef0 2024-09-19T07:11:03.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:03.741+0000 7f266e7fc640 1 -- 172.21.15.148:0/2455600247 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2668035070 con 0x7f2678104ef0 2024-09-19T07:11:03.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:03.741+0000 7f267f867640 1 -- 172.21.15.148:0/2455600247 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26781a2340 con 0x7f2678104ef0 2024-09-19T07:11:03.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:03.742+0000 7f267f867640 1 -- 172.21.15.148:0/2455600247 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2678109360 con 0x7f2678104ef0 2024-09-19T07:11:03.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:03.744+0000 7f266e7fc640 1 -- 172.21.15.148:0/2455600247 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 20) ==== 138040+0+0 (secure 0 0 0) 0x7f2668042030 con 0x7f2678104ef0 2024-09-19T07:11:03.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:03.745+0000 7f266e7fc640 1 -- 172.21.15.148:0/2455600247 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f26680efcb0 con 0x7f2678104ef0 2024-09-19T07:11:03.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:03.747+0000 7f266e7fc640 1 -- 172.21.15.148:0/2455600247 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f26680bc670 con 0x7f2678104ef0 2024-09-19T07:11:03.799 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:11:03 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:11:03.498+0000 7f0ed50d5640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:11:03.799 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:11:03 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:11:03.498+0000 7f0ed50d5640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:11:03.799 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:11:03 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:11:03.498+0000 7f0ed50d5640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:11:03.799 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:11:03 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:11:03.498+0000 7f0ed50d5640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:11:03.799 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:11:03 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:11:03.498+0000 7f0ed50d5640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:11:03.799 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:11:03 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:11:03.499+0000 7f0ed78da640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:11:03.799 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:11:03 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:11:03.499+0000 7f0ed78da640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:11:03.800 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:11:03 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:11:03.499+0000 7f0ed78da640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:11:03.800 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:11:03 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:11:03.499+0000 7f0ed78da640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:11:03.800 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:11:03 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:11:03.499+0000 7f0ed78da640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:11:03.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:03.968+0000 7f267f867640 1 -- 172.21.15.148:0/2455600247 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f267802d7c0 con 0x7f2678104ef0 2024-09-19T07:11:04.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-mon[31180]: mgrmap e19: x(active, since 8m), standbys: y, z 2024-09-19T07:11:04.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-mon[31180]: Active manager daemon x restarted 2024-09-19T07:11:04.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-mon[31180]: Activating manager daemon x 2024-09-19T07:11:04.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-mon[31180]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T07:11:04.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-mon[31180]: mgrmap e20: x(active, starting, since 0.0167764s), standbys: y, z 2024-09-19T07:11:04.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:11:04.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:11:04.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:11:04.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T07:11:04.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T07:11:04.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T07:11:04.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T07:11:04.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T07:11:04.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T07:11:04.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T07:11:04.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T07:11:04.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T07:11:04.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T07:11:04.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T07:11:04.086 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T07:11:04.086 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T07:11:04.086 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T07:11:04.086 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T07:11:04.086 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:11:04.086 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:11:04.086 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:11:04.086 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:11:04.086 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:11:04.086 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:11:04.086 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:11:04.086 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:11:04.087 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:11:04.087 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:11:04.087 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:11:04.087 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:11:04.087 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T07:11:04.087 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T07:11:04.087 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T07:11:04.087 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-mon[31180]: Manager daemon x is now available 2024-09-19T07:11:04.087 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:11:04.088 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T07:11:04.088 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T07:11:04.088 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/2455600247' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-19T07:11:04.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:04 smithi165 ceph-mon[35326]: mgrmap e19: x(active, since 8m), standbys: y, z 2024-09-19T07:11:04.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:04 smithi165 ceph-mon[35326]: Active manager daemon x restarted 2024-09-19T07:11:04.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:04 smithi165 ceph-mon[35326]: Activating manager daemon x 2024-09-19T07:11:04.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:04 smithi165 ceph-mon[35326]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T07:11:04.135 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:04 smithi165 ceph-mon[35326]: mgrmap e20: x(active, starting, since 0.0167764s), standbys: y, z 2024-09-19T07:11:04.135 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:04 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:11:04.135 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:04 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:11:04.135 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:04 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:11:04.135 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:04 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T07:11:04.135 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:04 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T07:11:04.135 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:04 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T07:11:04.135 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:04 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T07:11:04.135 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:04 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T07:11:04.135 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:04 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T07:11:04.135 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:04 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T07:11:04.135 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:04 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T07:11:04.135 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:04 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T07:11:04.136 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:04 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T07:11:04.136 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:04 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T07:11:04.136 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:04 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T07:11:04.136 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:04 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T07:11:04.136 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:04 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T07:11:04.136 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:04 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T07:11:04.136 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:04 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:11:04.136 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:04 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:11:04.136 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:04 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:11:04.136 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:04 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:11:04.136 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:04 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:11:04.136 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:04 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:11:04.136 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:04 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:11:04.137 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:04 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:11:04.137 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:04 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:11:04.137 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:04 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:11:04.137 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:04 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:11:04.137 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:04 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:11:04.137 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:04 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T07:11:04.137 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:04 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T07:11:04.137 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:04 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T07:11:04.137 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:04 smithi165 ceph-mon[35326]: Manager daemon x is now available 2024-09-19T07:11:04.137 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:04 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:11:04.137 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:04 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T07:11:04.137 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:04 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T07:11:04.137 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:04 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/2455600247' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-19T07:11:04.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.242+0000 7f266e7fc640 1 -- 172.21.15.148:0/2455600247 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 21) ==== 138167+0+0 (secure 0 0 0) 0x7f2668003c80 con 0x7f2678104ef0 2024-09-19T07:11:04.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.243+0000 7f266e7fc640 1 --2- 172.21.15.148:0/2455600247 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f26640aa060 0x7f26640ac450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:04.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.244+0000 7f267d603640 1 --2- 172.21.15.148:0/2455600247 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f26640aa060 0x7f26640ac450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:04.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.246+0000 7f266e7fc640 1 -- 172.21.15.148:0/2455600247 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v25) ==== 117+0+0 (secure 0 0 0) 0x7f26680a80e0 con 0x7f2678104ef0 2024-09-19T07:11:04.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.249+0000 7f267d603640 1 --2- 172.21.15.148:0/2455600247 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f26640aa060 0x7f26640ac450 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2674009bd0 tx=0x7f2674005f90 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:04.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.250+0000 7f267f867640 1 -- 172.21.15.148:0/2455600247 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f26640aa060 msgr2=0x7f26640ac450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:04.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.250+0000 7f267f867640 1 --2- 172.21.15.148:0/2455600247 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f26640aa060 0x7f26640ac450 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2674009bd0 tx=0x7f2674005f90 comp rx=0 tx=0).stop 2024-09-19T07:11:04.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.250+0000 7f267f867640 1 -- 172.21.15.148:0/2455600247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2678104ef0 msgr2=0x7f267819a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:04.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.250+0000 7f267f867640 1 --2- 172.21.15.148:0/2455600247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2678104ef0 0x7f267819a570 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f2668031610 tx=0x7f2668004270 comp rx=0 tx=0).stop 2024-09-19T07:11:04.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.250+0000 7f267f867640 1 -- 172.21.15.148:0/2455600247 shutdown_connections 2024-09-19T07:11:04.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.250+0000 7f267f867640 1 --2- 172.21.15.148:0/2455600247 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f26640aa060 0x7f26640ac450 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:04.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.250+0000 7f267f867640 1 --2- 172.21.15.148:0/2455600247 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2678107820 0x7f26781a15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:04.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.250+0000 7f267f867640 1 --2- 172.21.15.148:0/2455600247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2678104ef0 0x7f267819a570 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:04.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.250+0000 7f267f867640 1 --2- 172.21.15.148:0/2455600247 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26781025c0 0x7f267819a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:04.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.250+0000 7f267f867640 1 -- 172.21.15.148:0/2455600247 >> 172.21.15.148:0/2455600247 conn(0x7f26780fc1e0 msgr2=0x7f2678101ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:04.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.250+0000 7f267f867640 1 -- 172.21.15.148:0/2455600247 shutdown_connections 2024-09-19T07:11:04.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.250+0000 7f267f867640 1 -- 172.21.15.148:0/2455600247 wait complete. 2024-09-19T07:11:04.266 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-19T07:11:04.279 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-19T07:11:04.290 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T07:11:04.384 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:04 smithi179 ceph-mon[35716]: mgrmap e19: x(active, since 8m), standbys: y, z 2024-09-19T07:11:04.385 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:04 smithi179 ceph-mon[35716]: Active manager daemon x restarted 2024-09-19T07:11:04.385 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:04 smithi179 ceph-mon[35716]: Activating manager daemon x 2024-09-19T07:11:04.385 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:04 smithi179 ceph-mon[35716]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T07:11:04.385 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:04 smithi179 ceph-mon[35716]: mgrmap e20: x(active, starting, since 0.0167764s), standbys: y, z 2024-09-19T07:11:04.385 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:04 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:11:04.385 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:04 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:11:04.385 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:04 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:11:04.385 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:04 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T07:11:04.385 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:04 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T07:11:04.385 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:04 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T07:11:04.386 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:04 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T07:11:04.386 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:04 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T07:11:04.386 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:04 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T07:11:04.386 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:04 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T07:11:04.386 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:04 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T07:11:04.386 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:04 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T07:11:04.386 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:04 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T07:11:04.386 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:04 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T07:11:04.386 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:04 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T07:11:04.386 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:04 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T07:11:04.386 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:04 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T07:11:04.386 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:04 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T07:11:04.386 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:04 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:11:04.386 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:04 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:11:04.387 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:04 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:11:04.387 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:04 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:11:04.387 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:04 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:11:04.387 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:04 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:11:04.387 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:04 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:11:04.387 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:04 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:11:04.387 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:04 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:11:04.387 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:04 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:11:04.387 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:04 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:11:04.387 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:04 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:11:04.387 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:04 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T07:11:04.387 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:04 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T07:11:04.387 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:04 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T07:11:04.388 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:04 smithi179 ceph-mon[35716]: Manager daemon x is now available 2024-09-19T07:11:04.388 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:04 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:11:04.388 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:04 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T07:11:04.388 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:04 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T07:11:04.388 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:04 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/2455600247' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-19T07:11:04.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.391+0000 7f445cb76640 1 -- 172.21.15.148:0/874613064 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4458104f60 msgr2=0x7f4458107350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:04.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.391+0000 7f445cb76640 1 --2- 172.21.15.148:0/874613064 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4458104f60 0x7f4458107350 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f444c009900 tx=0x7f444c02a410 comp rx=0 tx=0).stop 2024-09-19T07:11:04.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.391+0000 7f445cb76640 1 -- 172.21.15.148:0/874613064 shutdown_connections 2024-09-19T07:11:04.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.391+0000 7f445cb76640 1 --2- 172.21.15.148:0/874613064 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4458107890 0x7f4458109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:04.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.391+0000 7f445cb76640 1 --2- 172.21.15.148:0/874613064 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4458104f60 0x7f4458107350 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:04.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.391+0000 7f445cb76640 1 --2- 172.21.15.148:0/874613064 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4458102630 0x7f4458104a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:04.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.391+0000 7f445cb76640 1 -- 172.21.15.148:0/874613064 >> 172.21.15.148:0/874613064 conn(0x7f44580fc170 msgr2=0x7f44580fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:04.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.391+0000 7f445cb76640 1 -- 172.21.15.148:0/874613064 shutdown_connections 2024-09-19T07:11:04.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.391+0000 7f445cb76640 1 -- 172.21.15.148:0/874613064 wait complete. 2024-09-19T07:11:04.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.392+0000 7f445cb76640 1 Processor -- start 2024-09-19T07:11:04.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.392+0000 7f445cb76640 1 -- start start 2024-09-19T07:11:04.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.392+0000 7f445cb76640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4458102630 0x7f4458197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:04.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.392+0000 7f445cb76640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4458104f60 0x7f4458198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:04.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.392+0000 7f445cb76640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4458107890 0x7f445819f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:04.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.392+0000 7f445cb76640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f445810d780 con 0x7f4458107890 2024-09-19T07:11:04.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.392+0000 7f445cb76640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f445810d600 con 0x7f4458102630 2024-09-19T07:11:04.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.392+0000 7f445cb76640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f445810d900 con 0x7f4458104f60 2024-09-19T07:11:04.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.392+0000 7f4456d9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4458107890 0x7f445819f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:04.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.392+0000 7f4456d9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4458107890 0x7f445819f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60632/0 (socket says 172.21.15.148:60632) 2024-09-19T07:11:04.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.392+0000 7f4455d9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4458104f60 0x7f4458198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:04.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.392+0000 7f4456d9d640 1 -- 172.21.15.148:0/1091983788 learned_addr learned my addr 172.21.15.148:0/1091983788 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:04.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.392+0000 7f445659c640 1 --2- 172.21.15.148:0/1091983788 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4458102630 0x7f4458197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:04.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.392+0000 7f4456d9d640 1 -- 172.21.15.148:0/1091983788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4458104f60 msgr2=0x7f4458198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:04.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.392+0000 7f4456d9d640 1 --2- 172.21.15.148:0/1091983788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4458104f60 0x7f4458198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:04.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.392+0000 7f4456d9d640 1 -- 172.21.15.148:0/1091983788 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4458102630 msgr2=0x7f4458197ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:04.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.392+0000 7f4456d9d640 1 --2- 172.21.15.148:0/1091983788 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4458102630 0x7f4458197ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:04.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.392+0000 7f4456d9d640 1 -- 172.21.15.148:0/1091983788 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f445819fae0 con 0x7f4458107890 2024-09-19T07:11:04.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.392+0000 7f445659c640 1 --2- 172.21.15.148:0/1091983788 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4458102630 0x7f4458197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:11:04.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.393+0000 7f4456d9d640 1 --2- 172.21.15.148:0/1091983788 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4458107890 0x7f445819f470 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f445000e9d0 tx=0x7f445000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:04.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.393+0000 7f44477fe640 1 -- 172.21.15.148:0/1091983788 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f445000cd80 con 0x7f4458107890 2024-09-19T07:11:04.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.393+0000 7f44477fe640 1 -- 172.21.15.148:0/1091983788 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4450005020 con 0x7f4458107890 2024-09-19T07:11:04.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.393+0000 7f445cb76640 1 -- 172.21.15.148:0/1091983788 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f445819fdd0 con 0x7f4458107890 2024-09-19T07:11:04.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.393+0000 7f44477fe640 1 -- 172.21.15.148:0/1091983788 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44500116d0 con 0x7f4458107890 2024-09-19T07:11:04.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.393+0000 7f445cb76640 1 -- 172.21.15.148:0/1091983788 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44581a0240 con 0x7f4458107890 2024-09-19T07:11:04.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.394+0000 7f445cb76640 1 -- 172.21.15.148:0/1091983788 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44580fdc60 con 0x7f4458107890 2024-09-19T07:11:04.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.395+0000 7f44477fe640 1 -- 172.21.15.148:0/1091983788 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 21) ==== 138167+0+0 (secure 0 0 0) 0x7f44500051d0 con 0x7f4458107890 2024-09-19T07:11:04.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.395+0000 7f44477fe640 1 --2- 172.21.15.148:0/1091983788 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f44400a3050 0x7f44400a5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:04.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.396+0000 7f445659c640 1 --2- 172.21.15.148:0/1091983788 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f44400a3050 0x7f44400a5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:04.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.396+0000 7f44477fe640 1 -- 172.21.15.148:0/1091983788 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f44500cfc10 con 0x7f4458107890 2024-09-19T07:11:04.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.396+0000 7f445659c640 1 --2- 172.21.15.148:0/1091983788 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f44400a3050 0x7f44400a5510 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4448009c20 tx=0x7f4448005f90 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:04.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.400+0000 7f44477fe640 1 -- 172.21.15.148:0/1091983788 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4450016030 con 0x7f4458107890 2024-09-19T07:11:04.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.579+0000 7f445cb76640 1 -- 172.21.15.148:0/1091983788 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4458062e90 con 0x7f4458107890 2024-09-19T07:11:04.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.581+0000 7f44477fe640 1 -- 172.21.15.148:0/1091983788 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+23254 (secure 0 0 0) 0x7f445009cb10 con 0x7f4458107890 2024-09-19T07:11:04.883 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:11:04.883 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":81,"fsid":"eae8a4a8-7654-11ef-bceb-c7b262605968","created":"2024-09-19T07:01:47.891210+0000","modified":"2024-09-19T07:11:03.220907+0000","last_up_change":"2024-09-19T07:08:30.785262+0000","last_in_change":"2024-09-19T07:08:07.001808+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:04:49.313270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T07:09:15.840600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T07:09:17.690782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7b854fad-d5a3-43e3-862e-7a0e8f243c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6803","nonce":512186330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6805","nonce":512186330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6809","nonce":512186330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6807","nonce":512186330}]},"public_addr":"172.21.15.148:6803/512186330","cluster_addr":"172.21.15.148:6805/512186330","heartbeat_back_addr":"172.21.15.148:6809/512186330","heartbeat_front_addr":"172.21.15.148:6807/512186330","state":["exists","up"]},{"osd":1,"uuid":"61b26278-f4db-40f0-97b9-c12a6ef1cd06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6801","nonce":2433984552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6803","nonce":2433984552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6807","nonce":2433984552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6805","nonce":2433984552}]},"public_addr":"172.21.15.165:6801/2433984552","cluster_addr":"172.21.15.165:6803/2433984552","heartbeat_back_addr":"172.21.15.165:6807/2433984552","heartbeat_front_addr":"172.21.15.165:6805/2433984552","state":["exists","up"]},{"osd":2,"uuid":"06620bbc-cdb5-4afc-8122-0bb3126630f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6801","nonce":3048365223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6803","nonce":3048365223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6807","nonce":3048365223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6805","nonce":3048365223}]},"public_addr":"172.21.15.179:6801/3048365223","cluster_addr":"172.21.15.179:6803/3048365223","heartbeat_back_addr":"172.21.15.179:6807/3048365223","heartbeat_front_addr":"172.21.15.179:6805/3048365223","state":["exists","up"]},{"osd":3,"uuid":"d7df45d4-5ef1-4f66-84a7-f61b8756c0c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6811","nonce":3662789091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6813","nonce":3662789091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6817","nonce":3662789091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6815","nonce":3662789091}]},"public_addr":"172.21.15.148:6811/3662789091","cluster_addr":"172.21.15.148:6813/3662789091","heartbeat_back_addr":"172.21.15.148:6817/3662789091","heartbeat_front_addr":"172.21.15.148:6815/3662789091","state":["exists","up"]},{"osd":4,"uuid":"5cfd359b-a8d2-4bdc-858f-087d26e0869c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6809","nonce":3082550323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6811","nonce":3082550323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6815","nonce":3082550323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6813","nonce":3082550323}]},"public_addr":"172.21.15.165:6809/3082550323","cluster_addr":"172.21.15.165:6811/3082550323","heartbeat_back_addr":"172.21.15.165:6815/3082550323","heartbeat_front_addr":"172.21.15.165:6813/3082550323","state":["exists","up"]},{"osd":5,"uuid":"8295e69b-87fe-4403-bb2e-d9dd42e2f398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6809","nonce":2125213751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6811","nonce":2125213751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6815","nonce":2125213751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6813","nonce":2125213751}]},"public_addr":"172.21.15.179:6809/2125213751","cluster_addr":"172.21.15.179:6811/2125213751","heartbeat_back_addr":"172.21.15.179:6815/2125213751","heartbeat_front_addr":"172.21.15.179:6813/2125213751","state":["exists","up"]},{"osd":6,"uuid":"4ce38d1a-06d3-4606-b00d-aa1ff977025f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6819","nonce":2178980310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6821","nonce":2178980310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6825","nonce":2178980310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6823","nonce":2178980310}]},"public_addr":"172.21.15.148:6819/2178980310","cluster_addr":"172.21.15.148:6821/2178980310","heartbeat_back_addr":"172.21.15.148:6825/2178980310","heartbeat_front_addr":"172.21.15.148:6823/2178980310","state":["exists","up"]},{"osd":7,"uuid":"9e68e2b2-9838-4ec0-b473-24f2434695ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6817","nonce":3961600099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6819","nonce":3961600099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6823","nonce":3961600099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6821","nonce":3961600099}]},"public_addr":"172.21.15.165:6817/3961600099","cluster_addr":"172.21.15.165:6819/3961600099","heartbeat_back_addr":"172.21.15.165:6823/3961600099","heartbeat_front_addr":"172.21.15.165:6821/3961600099","state":["exists","up"]},{"osd":8,"uuid":"297acce6-d3c7-4e1a-bf87-be093de51a6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6817","nonce":3642931467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6819","nonce":3642931467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6823","nonce":3642931467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6821","nonce":3642931467}]},"public_addr":"172.21.15.179:6817/3642931467","cluster_addr":"172.21.15.179:6819/3642931467","heartbeat_back_addr":"172.21.15.179:6823/3642931467","heartbeat_front_addr":"172.21.15.179:6821/3642931467","state":["exists","up"]},{"osd":9,"uuid":"ef488c5e-5353-4695-99dd-5b74ade436d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6827","nonce":3135409630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6829","nonce":3135409630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6833","nonce":3135409630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6831","nonce":3135409630}]},"public_addr":"172.21.15.148:6827/3135409630","cluster_addr":"172.21.15.148:6829/3135409630","heartbeat_back_addr":"172.21.15.148:6833/3135409630","heartbeat_front_addr":"172.21.15.148:6831/3135409630","state":["exists","up"]},{"osd":10,"uuid":"7a9f0379-1199-4266-910c-8d1d313d39e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6825","nonce":3554110731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6827","nonce":3554110731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6831","nonce":3554110731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6829","nonce":3554110731}]},"public_addr":"172.21.15.165:6825/3554110731","cluster_addr":"172.21.15.165:6827/3554110731","heartbeat_back_addr":"172.21.15.165:6831/3554110731","heartbeat_front_addr":"172.21.15.165:6829/3554110731","state":["exists","up"]},{"osd":11,"uuid":"eede97e9-5685-4603-806e-7078c6940536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6825","nonce":2026109940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6827","nonce":2026109940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6831","nonce":2026109940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6829","nonce":2026109940}]},"public_addr":"172.21.15.179:6825/2026109940","cluster_addr":"172.21.15.179:6827/2026109940","heartbeat_back_addr":"172.21.15.179:6831/2026109940","heartbeat_front_addr":"172.21.15.179:6829/2026109940","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:03:56.291685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:21.419682+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:46.377012+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:11.484234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:36.723101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:06:00.294617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:06:25.147230+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:06:49.318576+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:07:13.896399+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:07:38.930999+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:08:03.803463+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:08:28.731343+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.148:0/2510377205":"2024-09-20T07:11:03.220856+0000","172.21.15.148:0/1725756124":"2024-09-20T07:11:03.220856+0000","172.21.15.148:0/2638338746":"2024-09-20T07:11:03.220856+0000","172.21.15.148:0/174481494":"2024-09-20T07:02:14.557425+0000","172.21.15.148:0/3756905316":"2024-09-20T07:11:03.220856+0000","172.21.15.148:0/1480486619":"2024-09-20T07:02:14.557425+0000","172.21.15.148:6801/2161746152":"2024-09-20T07:02:14.557425+0000","172.21.15.148:6800/2161746152":"2024-09-20T07:02:14.557425+0000","172.21.15.148:6800/1949849385":"2024-09-20T07:02:37.007183+0000","172.21.15.148:0/1114469409":"2024-09-20T07:02:14.557425+0000","172.21.15.148:0/1922521135":"2024-09-20T07:02:37.007183+0000","172.21.15.148:6801/3007822654":"2024-09-20T07:11:03.220856+0000","172.21.15.148:0/1958388906":"2024-09-20T07:02:37.007183+0000","172.21.15.148:6801/1949849385":"2024-09-20T07:02:37.007183+0000","172.21.15.148:0/3534559227":"2024-09-20T07:02:37.007183+0000","172.21.15.148:0/1224758996":"2024-09-20T07:11:03.220856+0000","172.21.15.148:6800/3007822654":"2024-09-20T07:11:03.220856+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T07:11:04.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.583+0000 7f445cb76640 1 -- 172.21.15.148:0/1091983788 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f44400a3050 msgr2=0x7f44400a5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:04.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.583+0000 7f445cb76640 1 --2- 172.21.15.148:0/1091983788 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f44400a3050 0x7f44400a5510 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4448009c20 tx=0x7f4448005f90 comp rx=0 tx=0).stop 2024-09-19T07:11:04.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.583+0000 7f445cb76640 1 -- 172.21.15.148:0/1091983788 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4458107890 msgr2=0x7f445819f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:04.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.583+0000 7f445cb76640 1 --2- 172.21.15.148:0/1091983788 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4458107890 0x7f445819f470 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f445000e9d0 tx=0x7f445000ee90 comp rx=0 tx=0).stop 2024-09-19T07:11:04.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.583+0000 7f445cb76640 1 -- 172.21.15.148:0/1091983788 shutdown_connections 2024-09-19T07:11:04.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.583+0000 7f445cb76640 1 --2- 172.21.15.148:0/1091983788 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f44400a3050 0x7f44400a5510 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:04.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.583+0000 7f445cb76640 1 --2- 172.21.15.148:0/1091983788 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4458107890 0x7f445819f470 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:04.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.583+0000 7f445cb76640 1 --2- 172.21.15.148:0/1091983788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4458104f60 0x7f4458198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:04.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.583+0000 7f445cb76640 1 --2- 172.21.15.148:0/1091983788 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4458102630 0x7f4458197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:04.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.583+0000 7f445cb76640 1 -- 172.21.15.148:0/1091983788 >> 172.21.15.148:0/1091983788 conn(0x7f44580fc170 msgr2=0x7f4458103030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:04.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.583+0000 7f445cb76640 1 -- 172.21.15.148:0/1091983788 shutdown_connections 2024-09-19T07:11:04.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:04.583+0000 7f445cb76640 1 -- 172.21.15.148:0/1091983788 wait complete. 2024-09-19T07:11:04.886 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T07:04:49.313270+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T07:09:15.840600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T07:09:17.690782+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T07:11:04.886 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T07:11:04.910 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:11:04.712+0000 7f0ec0fae640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:07:11:04] ENGINE Error in HTTPServer.serve 2024-09-19T07:11:04.910 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: Traceback (most recent call last): 2024-09-19T07:11:04.910 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T07:11:04.910 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: self._connections.run(self.expiration_interval) 2024-09-19T07:11:04.910 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T07:11:04.910 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: self._run(expiration_interval) 2024-09-19T07:11:04.910 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T07:11:04.911 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T07:11:04.911 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T07:11:04.911 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T07:11:04.911 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T07:11:04.911 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: s = self.context.wrap_socket( 2024-09-19T07:11:04.911 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T07:11:04.911 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: return self.sslsocket_class._create( 2024-09-19T07:11:04.911 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T07:11:04.911 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: self.do_handshake() 2024-09-19T07:11:04.911 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T07:11:04.911 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: self._sslobj.do_handshake() 2024-09-19T07:11:04.911 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T07:11:04.911 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:11:04 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:11:05.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.009+0000 7f6a23566640 1 -- 172.21.15.148:0/3518714123 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a1c100b30 msgr2=0x7f6a1c100fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:05.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.009+0000 7f6a23566640 1 --2- 172.21.15.148:0/3518714123 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a1c100b30 0x7f6a1c100fb0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c009900 tx=0x7f6a0c02a410 comp rx=0 tx=0).stop 2024-09-19T07:11:05.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.009+0000 7f6a23566640 1 -- 172.21.15.148:0/3518714123 shutdown_connections 2024-09-19T07:11:05.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.009+0000 7f6a23566640 1 --2- 172.21.15.148:0/3518714123 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a1c1014f0 0x7f6a1c105d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:05.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.009+0000 7f6a23566640 1 --2- 172.21.15.148:0/3518714123 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a1c100b30 0x7f6a1c100fb0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:05.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.009+0000 7f6a23566640 1 --2- 172.21.15.148:0/3518714123 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6a1c0ffdd0 0x7f6a1c1001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:05.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.009+0000 7f6a23566640 1 -- 172.21.15.148:0/3518714123 >> 172.21.15.148:0/3518714123 conn(0x7f6a1c0fb910 msgr2=0x7f6a1c0fdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:05.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.009+0000 7f6a23566640 1 -- 172.21.15.148:0/3518714123 shutdown_connections 2024-09-19T07:11:05.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.009+0000 7f6a23566640 1 -- 172.21.15.148:0/3518714123 wait complete. 2024-09-19T07:11:05.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.009+0000 7f6a23566640 1 Processor -- start 2024-09-19T07:11:05.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.009+0000 7f6a23566640 1 -- start start 2024-09-19T07:11:05.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.010+0000 7f6a23566640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a1c0ffdd0 0x7f6a1c19e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:05.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.010+0000 7f6a23566640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a1c100b30 0x7f6a1c19e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:05.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.010+0000 7f6a23566640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6a1c1014f0 0x7f6a1c1a5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:05.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.010+0000 7f6a23566640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1c113e00 con 0x7f6a1c0ffdd0 2024-09-19T07:11:05.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.010+0000 7f6a23566640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1c113c80 con 0x7f6a1c1014f0 2024-09-19T07:11:05.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.010+0000 7f6a23566640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1c113f80 con 0x7f6a1c100b30 2024-09-19T07:11:05.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.010+0000 7f6a21302640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a1c0ffdd0 0x7f6a1c19e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:05.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.010+0000 7f6a20b01640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a1c100b30 0x7f6a1c19e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:05.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.010+0000 7f6a20b01640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a1c100b30 0x7f6a1c19e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:50076/0 (socket says 172.21.15.148:50076) 2024-09-19T07:11:05.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.010+0000 7f6a21302640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a1c0ffdd0 0x7f6a1c19e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60650/0 (socket says 172.21.15.148:60650) 2024-09-19T07:11:05.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.010+0000 7f6a20b01640 1 -- 172.21.15.148:0/1286788292 learned_addr learned my addr 172.21.15.148:0/1286788292 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:05.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.010+0000 7f6a21b03640 1 --2- 172.21.15.148:0/1286788292 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6a1c1014f0 0x7f6a1c1a5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:05.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.010+0000 7f6a20b01640 1 -- 172.21.15.148:0/1286788292 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6a1c1014f0 msgr2=0x7f6a1c1a5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:05.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.010+0000 7f6a20b01640 1 --2- 172.21.15.148:0/1286788292 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6a1c1014f0 0x7f6a1c1a5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:05.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.010+0000 7f6a20b01640 1 -- 172.21.15.148:0/1286788292 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a1c0ffdd0 msgr2=0x7f6a1c19e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:05.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.010+0000 7f6a20b01640 1 --2- 172.21.15.148:0/1286788292 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a1c0ffdd0 0x7f6a1c19e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:05.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.010+0000 7f6a20b01640 1 -- 172.21.15.148:0/1286788292 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a1c1a60d0 con 0x7f6a1c100b30 2024-09-19T07:11:05.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.010+0000 7f6a21302640 1 --2- 172.21.15.148:0/1286788292 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a1c0ffdd0 0x7f6a1c19e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:11:05.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.010+0000 7f6a20b01640 1 --2- 172.21.15.148:0/1286788292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a1c100b30 0x7f6a1c19e9f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c031610 tx=0x7f6a0c0043b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:05.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.011+0000 7f6a127fc640 1 -- 172.21.15.148:0/1286788292 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a0c03f030 con 0x7f6a1c100b30 2024-09-19T07:11:05.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.011+0000 7f6a127fc640 1 -- 172.21.15.148:0/1286788292 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a0c003ce0 con 0x7f6a1c100b30 2024-09-19T07:11:05.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.011+0000 7f6a23566640 1 -- 172.21.15.148:0/1286788292 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a1c1a6360 con 0x7f6a1c100b30 2024-09-19T07:11:05.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.011+0000 7f6a127fc640 1 -- 172.21.15.148:0/1286788292 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a0c035070 con 0x7f6a1c100b30 2024-09-19T07:11:05.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.011+0000 7f6a23566640 1 -- 172.21.15.148:0/1286788292 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a1c1a6850 con 0x7f6a1c100b30 2024-09-19T07:11:05.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.012+0000 7f6a23566640 1 -- 172.21.15.148:0/1286788292 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a1c1a6ab0 con 0x7f6a1c100b30 2024-09-19T07:11:05.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.013+0000 7f6a127fc640 1 -- 172.21.15.148:0/1286788292 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 21) ==== 138167+0+0 (secure 0 0 0) 0x7f6a0c042030 con 0x7f6a1c100b30 2024-09-19T07:11:05.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.013+0000 7f6a127fc640 1 --2- 172.21.15.148:0/1286788292 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f6a080a3050 0x7f6a080a5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:05.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.013+0000 7f6a21302640 1 --2- 172.21.15.148:0/1286788292 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f6a080a3050 0x7f6a080a5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:05.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.013+0000 7f6a127fc640 1 -- 172.21.15.148:0/1286788292 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f6a0c0efb10 con 0x7f6a1c100b30 2024-09-19T07:11:05.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.014+0000 7f6a21302640 1 --2- 172.21.15.148:0/1286788292 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f6a080a3050 0x7f6a080a5510 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6a18005d00 tx=0x7f6a1800b410 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:05.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.018+0000 7f6a127fc640 1 -- 172.21.15.148:0/1286788292 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6a0c0bc3c0 con 0x7f6a1c100b30 2024-09-19T07:11:05.201 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.200+0000 7f6a23566640 1 -- 172.21.15.148:0/1286788292 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6a1c1a6e40 con 0x7f6a1c100b30 2024-09-19T07:11:05.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.201+0000 7f6a127fc640 1 -- 172.21.15.148:0/1286788292 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7f6a1c1a6e40 con 0x7f6a1c100b30 2024-09-19T07:11:05.202 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 1 2024-09-19T07:11:05.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.203+0000 7f6a23566640 1 -- 172.21.15.148:0/1286788292 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f6a080a3050 msgr2=0x7f6a080a5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:05.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.203+0000 7f6a23566640 1 --2- 172.21.15.148:0/1286788292 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f6a080a3050 0x7f6a080a5510 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6a18005d00 tx=0x7f6a1800b410 comp rx=0 tx=0).stop 2024-09-19T07:11:05.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.203+0000 7f6a23566640 1 -- 172.21.15.148:0/1286788292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a1c100b30 msgr2=0x7f6a1c19e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:05.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.203+0000 7f6a23566640 1 --2- 172.21.15.148:0/1286788292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a1c100b30 0x7f6a1c19e9f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c031610 tx=0x7f6a0c0043b0 comp rx=0 tx=0).stop 2024-09-19T07:11:05.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.203+0000 7f6a23566640 1 -- 172.21.15.148:0/1286788292 shutdown_connections 2024-09-19T07:11:05.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.203+0000 7f6a23566640 1 --2- 172.21.15.148:0/1286788292 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f6a080a3050 0x7f6a080a5510 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:05.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.203+0000 7f6a23566640 1 --2- 172.21.15.148:0/1286788292 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6a1c1014f0 0x7f6a1c1a5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:05.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.203+0000 7f6a23566640 1 --2- 172.21.15.148:0/1286788292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a1c100b30 0x7f6a1c19e9f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:05.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.203+0000 7f6a23566640 1 --2- 172.21.15.148:0/1286788292 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a1c0ffdd0 0x7f6a1c19e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:05.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.203+0000 7f6a23566640 1 -- 172.21.15.148:0/1286788292 >> 172.21.15.148:0/1286788292 conn(0x7f6a1c0fb910 msgr2=0x7f6a1c0fc510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:05.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.203+0000 7f6a23566640 1 -- 172.21.15.148:0/1286788292 shutdown_connections 2024-09-19T07:11:05.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.203+0000 7f6a23566640 1 -- 172.21.15.148:0/1286788292 wait complete. 2024-09-19T07:11:05.216 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T07:11:05.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.374+0000 7efd59a01640 1 -- 172.21.15.148:0/1179686692 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd54103130 msgr2=0x7efd54103530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:05.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.374+0000 7efd59a01640 1 --2- 172.21.15.148:0/1179686692 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd54103130 0x7efd54103530 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7efd44009900 tx=0x7efd4402a410 comp rx=0 tx=0).stop 2024-09-19T07:11:05.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.374+0000 7efd59a01640 1 -- 172.21.15.148:0/1179686692 shutdown_connections 2024-09-19T07:11:05.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.374+0000 7efd59a01640 1 --2- 172.21.15.148:0/1179686692 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd54100560 0x7efd5410a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:05.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.374+0000 7efd59a01640 1 --2- 172.21.15.148:0/1179686692 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd540ffba0 0x7efd54100020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:05.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.374+0000 7efd59a01640 1 --2- 172.21.15.148:0/1179686692 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd54103130 0x7efd54103530 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:05.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.374+0000 7efd59a01640 1 -- 172.21.15.148:0/1179686692 >> 172.21.15.148:0/1179686692 conn(0x7efd540fb910 msgr2=0x7efd540fdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:05.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.374+0000 7efd59a01640 1 -- 172.21.15.148:0/1179686692 shutdown_connections 2024-09-19T07:11:05.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.374+0000 7efd59a01640 1 -- 172.21.15.148:0/1179686692 wait complete. 2024-09-19T07:11:05.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.375+0000 7efd59a01640 1 Processor -- start 2024-09-19T07:11:05.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.375+0000 7efd59a01640 1 -- start start 2024-09-19T07:11:05.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.375+0000 7efd59a01640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd540ffba0 0x7efd54197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:05.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.375+0000 7efd59a01640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd54100560 0x7efd54198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:05.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.375+0000 7efd59a01640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd54103130 0x7efd5419f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:05.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.375+0000 7efd59a01640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7efd5410d7a0 con 0x7efd54103130 2024-09-19T07:11:05.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.375+0000 7efd59a01640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7efd5410d620 con 0x7efd54100560 2024-09-19T07:11:05.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.375+0000 7efd59a01640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7efd5410d920 con 0x7efd540ffba0 2024-09-19T07:11:05.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.376+0000 7efd537fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd54103130 0x7efd5419f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:05.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.376+0000 7efd537fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd54103130 0x7efd5419f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60682/0 (socket says 172.21.15.148:60682) 2024-09-19T07:11:05.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.376+0000 7efd537fe640 1 -- 172.21.15.148:0/2695253372 learned_addr learned my addr 172.21.15.148:0/2695253372 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:05.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.376+0000 7efd527fc640 1 --2- 172.21.15.148:0/2695253372 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd54100560 0x7efd54198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:05.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.376+0000 7efd52ffd640 1 --2- 172.21.15.148:0/2695253372 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd540ffba0 0x7efd54197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:05.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.376+0000 7efd527fc640 1 -- 172.21.15.148:0/2695253372 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd540ffba0 msgr2=0x7efd54197ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:05.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.376+0000 7efd527fc640 1 --2- 172.21.15.148:0/2695253372 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd540ffba0 0x7efd54197ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:05.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.376+0000 7efd527fc640 1 -- 172.21.15.148:0/2695253372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd54103130 msgr2=0x7efd5419f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:05.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.376+0000 7efd527fc640 1 --2- 172.21.15.148:0/2695253372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd54103130 0x7efd5419f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:05.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.376+0000 7efd527fc640 1 -- 172.21.15.148:0/2695253372 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd5419fb10 con 0x7efd54100560 2024-09-19T07:11:05.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.376+0000 7efd527fc640 1 --2- 172.21.15.148:0/2695253372 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd54100560 0x7efd54198430 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efd4800c970 tx=0x7efd4800ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:05.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.376+0000 7efd589ff640 1 -- 172.21.15.148:0/2695253372 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd48007bb0 con 0x7efd54100560 2024-09-19T07:11:05.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.376+0000 7efd589ff640 1 -- 172.21.15.148:0/2695253372 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd48007d50 con 0x7efd54100560 2024-09-19T07:11:05.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.376+0000 7efd59a01640 1 -- 172.21.15.148:0/2695253372 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd5419fe00 con 0x7efd54100560 2024-09-19T07:11:05.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.376+0000 7efd589ff640 1 -- 172.21.15.148:0/2695253372 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd4800f450 con 0x7efd54100560 2024-09-19T07:11:05.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.376+0000 7efd59a01640 1 -- 172.21.15.148:0/2695253372 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd541a02c0 con 0x7efd54100560 2024-09-19T07:11:05.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.377+0000 7efd59a01640 1 -- 172.21.15.148:0/2695253372 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd54109160 con 0x7efd54100560 2024-09-19T07:11:05.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.378+0000 7efd589ff640 1 -- 172.21.15.148:0/2695253372 <== mon.2 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 22) ==== 138476+0+0 (secure 0 0 0) 0x7efd48004f30 con 0x7efd54100560 2024-09-19T07:11:05.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.379+0000 7efd589ff640 1 --2- 172.21.15.148:0/2695253372 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7efd3c0a3440 0x7efd3c0a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:05.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.379+0000 7efd52ffd640 1 --2- 172.21.15.148:0/2695253372 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7efd3c0a3440 0x7efd3c0a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:05.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.379+0000 7efd589ff640 1 -- 172.21.15.148:0/2695253372 <== mon.2 v2:172.21.15.165:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7efd480cf920 con 0x7efd54100560 2024-09-19T07:11:05.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.380+0000 7efd52ffd640 1 --2- 172.21.15.148:0/2695253372 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7efd3c0a3440 0x7efd3c0a5900 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7efd44006010 tx=0x7efd44000bc0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:05.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.383+0000 7efd589ff640 1 -- 172.21.15.148:0/2695253372 <== mon.2 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7efd48014030 con 0x7efd54100560 2024-09-19T07:11:05.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:05 smithi179 ceph-mon[35716]: mgrmap e21: x(active, since 1.0214s), standbys: y, z 2024-09-19T07:11:05.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:05 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/2455600247' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-19T07:11:05.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:05 smithi179 ceph-mon[35716]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:11:05.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:05 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/1091983788' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:11:05.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:05 smithi179 ceph-mon[35716]: [19/Sep/2024:07:11:04] ENGINE Bus STARTING 2024-09-19T07:11:05.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:05 smithi179 ceph-mon[35716]: [19/Sep/2024:07:11:04] ENGINE Serving on https://172.21.15.148:7150 2024-09-19T07:11:05.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:05 smithi179 ceph-mon[35716]: [19/Sep/2024:07:11:04] ENGINE Error in HTTPServer.serve 2024-09-19T07:11:05.523 INFO:journalctl@ceph.mon.c.smithi179.stdout: Traceback (most recent call last): 2024-09-19T07:11:05.523 INFO:journalctl@ceph.mon.c.smithi179.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T07:11:05.523 INFO:journalctl@ceph.mon.c.smithi179.stdout: self._connections.run(self.expiration_interval) 2024-09-19T07:11:05.523 INFO:journalctl@ceph.mon.c.smithi179.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T07:11:05.523 INFO:journalctl@ceph.mon.c.smithi179.stdout: self._run(expiration_interval) 2024-09-19T07:11:05.523 INFO:journalctl@ceph.mon.c.smithi179.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T07:11:05.523 INFO:journalctl@ceph.mon.c.smithi179.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T07:11:05.524 INFO:journalctl@ceph.mon.c.smithi179.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T07:11:05.524 INFO:journalctl@ceph.mon.c.smithi179.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T07:11:05.524 INFO:journalctl@ceph.mon.c.smithi179.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T07:11:05.524 INFO:journalctl@ceph.mon.c.smithi179.stdout: s = self.context.wrap_socket( 2024-09-19T07:11:05.524 INFO:journalctl@ceph.mon.c.smithi179.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T07:11:05.524 INFO:journalctl@ceph.mon.c.smithi179.stdout: return self.sslsocket_class._create( 2024-09-19T07:11:05.524 INFO:journalctl@ceph.mon.c.smithi179.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T07:11:05.524 INFO:journalctl@ceph.mon.c.smithi179.stdout: self.do_handshake() 2024-09-19T07:11:05.524 INFO:journalctl@ceph.mon.c.smithi179.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T07:11:05.524 INFO:journalctl@ceph.mon.c.smithi179.stdout: self._sslobj.do_handshake() 2024-09-19T07:11:05.524 INFO:journalctl@ceph.mon.c.smithi179.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T07:11:05.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:05 smithi179 ceph-mon[35716]: [19/Sep/2024:07:11:04] ENGINE Serving on http://172.21.15.148:8765 2024-09-19T07:11:05.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:05 smithi179 ceph-mon[35716]: [19/Sep/2024:07:11:04] ENGINE Bus STARTED 2024-09-19T07:11:05.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:05 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/1286788292' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T07:11:05.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.558+0000 7efd59a01640 1 -- 172.21.15.148:0/2695253372 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7efd5402d7c0 con 0x7efd54100560 2024-09-19T07:11:05.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.559+0000 7efd589ff640 1 -- 172.21.15.148:0/2695253372 <== mon.2 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v81) ==== 104+0+11 (secure 0 0 0) 0x7efd4809c310 con 0x7efd54100560 2024-09-19T07:11:05.560 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 32 2024-09-19T07:11:05.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.561+0000 7efd59a01640 1 -- 172.21.15.148:0/2695253372 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7efd3c0a3440 msgr2=0x7efd3c0a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:05.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.561+0000 7efd59a01640 1 --2- 172.21.15.148:0/2695253372 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7efd3c0a3440 0x7efd3c0a5900 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7efd44006010 tx=0x7efd44000bc0 comp rx=0 tx=0).stop 2024-09-19T07:11:05.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.561+0000 7efd59a01640 1 -- 172.21.15.148:0/2695253372 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd54100560 msgr2=0x7efd54198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:05.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.561+0000 7efd59a01640 1 --2- 172.21.15.148:0/2695253372 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd54100560 0x7efd54198430 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efd4800c970 tx=0x7efd4800ce30 comp rx=0 tx=0).stop 2024-09-19T07:11:05.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.561+0000 7efd59a01640 1 -- 172.21.15.148:0/2695253372 shutdown_connections 2024-09-19T07:11:05.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.561+0000 7efd59a01640 1 --2- 172.21.15.148:0/2695253372 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7efd3c0a3440 0x7efd3c0a5900 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:05.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.561+0000 7efd59a01640 1 --2- 172.21.15.148:0/2695253372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd54103130 0x7efd5419f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:05.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.561+0000 7efd59a01640 1 --2- 172.21.15.148:0/2695253372 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd54100560 0x7efd54198430 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:05.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.561+0000 7efd59a01640 1 --2- 172.21.15.148:0/2695253372 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd540ffba0 0x7efd54197ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:05.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.561+0000 7efd59a01640 1 -- 172.21.15.148:0/2695253372 >> 172.21.15.148:0/2695253372 conn(0x7efd540fb910 msgr2=0x7efd54106330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:05.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.561+0000 7efd59a01640 1 -- 172.21.15.148:0/2695253372 shutdown_connections 2024-09-19T07:11:05.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.561+0000 7efd59a01640 1 -- 172.21.15.148:0/2695253372 wait complete. 2024-09-19T07:11:05.573 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:05 smithi148 ceph-mon[31180]: mgrmap e21: x(active, since 1.0214s), standbys: y, z 2024-09-19T07:11:05.574 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:05 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/2455600247' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-19T07:11:05.574 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:05 smithi148 ceph-mon[31180]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:11:05.574 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:05 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/1091983788' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:11:05.574 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:05 smithi148 ceph-mon[31180]: [19/Sep/2024:07:11:04] ENGINE Bus STARTING 2024-09-19T07:11:05.574 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:05 smithi148 ceph-mon[31180]: [19/Sep/2024:07:11:04] ENGINE Serving on https://172.21.15.148:7150 2024-09-19T07:11:05.574 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:05 smithi148 ceph-mon[31180]: [19/Sep/2024:07:11:04] ENGINE Error in HTTPServer.serve 2024-09-19T07:11:05.574 INFO:journalctl@ceph.mon.a.smithi148.stdout: Traceback (most recent call last): 2024-09-19T07:11:05.574 INFO:journalctl@ceph.mon.a.smithi148.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T07:11:05.574 INFO:journalctl@ceph.mon.a.smithi148.stdout: self._connections.run(self.expiration_interval) 2024-09-19T07:11:05.574 INFO:journalctl@ceph.mon.a.smithi148.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T07:11:05.574 INFO:journalctl@ceph.mon.a.smithi148.stdout: self._run(expiration_interval) 2024-09-19T07:11:05.574 INFO:journalctl@ceph.mon.a.smithi148.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T07:11:05.575 INFO:journalctl@ceph.mon.a.smithi148.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T07:11:05.575 INFO:journalctl@ceph.mon.a.smithi148.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T07:11:05.575 INFO:journalctl@ceph.mon.a.smithi148.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T07:11:05.575 INFO:journalctl@ceph.mon.a.smithi148.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T07:11:05.575 INFO:journalctl@ceph.mon.a.smithi148.stdout: s = self.context.wrap_socket( 2024-09-19T07:11:05.575 INFO:journalctl@ceph.mon.a.smithi148.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T07:11:05.575 INFO:journalctl@ceph.mon.a.smithi148.stdout: return self.sslsocket_class._create( 2024-09-19T07:11:05.575 INFO:journalctl@ceph.mon.a.smithi148.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T07:11:05.575 INFO:journalctl@ceph.mon.a.smithi148.stdout: self.do_handshake() 2024-09-19T07:11:05.575 INFO:journalctl@ceph.mon.a.smithi148.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T07:11:05.575 INFO:journalctl@ceph.mon.a.smithi148.stdout: self._sslobj.do_handshake() 2024-09-19T07:11:05.575 INFO:journalctl@ceph.mon.a.smithi148.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T07:11:05.575 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:05 smithi148 ceph-mon[31180]: [19/Sep/2024:07:11:04] ENGINE Serving on http://172.21.15.148:8765 2024-09-19T07:11:05.575 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:05 smithi148 ceph-mon[31180]: [19/Sep/2024:07:11:04] ENGINE Bus STARTED 2024-09-19T07:11:05.576 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:05 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/1286788292' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T07:11:05.577 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T07:11:05.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:05 smithi165 ceph-mon[35326]: mgrmap e21: x(active, since 1.0214s), standbys: y, z 2024-09-19T07:11:05.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:05 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/2455600247' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-19T07:11:05.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:05 smithi165 ceph-mon[35326]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:11:05.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:05 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/1091983788' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:11:05.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:05 smithi165 ceph-mon[35326]: [19/Sep/2024:07:11:04] ENGINE Bus STARTING 2024-09-19T07:11:05.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:05 smithi165 ceph-mon[35326]: [19/Sep/2024:07:11:04] ENGINE Serving on https://172.21.15.148:7150 2024-09-19T07:11:05.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:05 smithi165 ceph-mon[35326]: [19/Sep/2024:07:11:04] ENGINE Error in HTTPServer.serve 2024-09-19T07:11:05.635 INFO:journalctl@ceph.mon.b.smithi165.stdout: Traceback (most recent call last): 2024-09-19T07:11:05.635 INFO:journalctl@ceph.mon.b.smithi165.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T07:11:05.635 INFO:journalctl@ceph.mon.b.smithi165.stdout: self._connections.run(self.expiration_interval) 2024-09-19T07:11:05.635 INFO:journalctl@ceph.mon.b.smithi165.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T07:11:05.635 INFO:journalctl@ceph.mon.b.smithi165.stdout: self._run(expiration_interval) 2024-09-19T07:11:05.635 INFO:journalctl@ceph.mon.b.smithi165.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T07:11:05.635 INFO:journalctl@ceph.mon.b.smithi165.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T07:11:05.636 INFO:journalctl@ceph.mon.b.smithi165.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T07:11:05.636 INFO:journalctl@ceph.mon.b.smithi165.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T07:11:05.636 INFO:journalctl@ceph.mon.b.smithi165.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T07:11:05.636 INFO:journalctl@ceph.mon.b.smithi165.stdout: s = self.context.wrap_socket( 2024-09-19T07:11:05.636 INFO:journalctl@ceph.mon.b.smithi165.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T07:11:05.637 INFO:journalctl@ceph.mon.b.smithi165.stdout: return self.sslsocket_class._create( 2024-09-19T07:11:05.637 INFO:journalctl@ceph.mon.b.smithi165.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T07:11:05.637 INFO:journalctl@ceph.mon.b.smithi165.stdout: self.do_handshake() 2024-09-19T07:11:05.637 INFO:journalctl@ceph.mon.b.smithi165.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T07:11:05.637 INFO:journalctl@ceph.mon.b.smithi165.stdout: self._sslobj.do_handshake() 2024-09-19T07:11:05.637 INFO:journalctl@ceph.mon.b.smithi165.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T07:11:05.638 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:05 smithi165 ceph-mon[35326]: [19/Sep/2024:07:11:04] ENGINE Serving on http://172.21.15.148:8765 2024-09-19T07:11:05.638 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:05 smithi165 ceph-mon[35326]: [19/Sep/2024:07:11:04] ENGINE Bus STARTED 2024-09-19T07:11:05.638 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:05 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/1286788292' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T07:11:05.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.688+0000 7fe29c7bd640 1 -- 172.21.15.148:0/1716532997 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe294100540 msgr2=0x7fe29410a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:05.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.688+0000 7fe29c7bd640 1 --2- 172.21.15.148:0/1716532997 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe294100540 0x7fe29410a0f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe28c009cd0 tx=0x7fe28c02a8e0 comp rx=0 tx=0).stop 2024-09-19T07:11:05.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.688+0000 7fe29c7bd640 1 -- 172.21.15.148:0/1716532997 shutdown_connections 2024-09-19T07:11:05.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.688+0000 7fe29c7bd640 1 --2- 172.21.15.148:0/1716532997 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe294100540 0x7fe29410a0f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:05.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.688+0000 7fe29c7bd640 1 --2- 172.21.15.148:0/1716532997 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2940ffb80 0x7fe294100000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:05.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.688+0000 7fe29c7bd640 1 --2- 172.21.15.148:0/1716532997 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe294103110 0x7fe294103510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:05.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.688+0000 7fe29c7bd640 1 -- 172.21.15.148:0/1716532997 >> 172.21.15.148:0/1716532997 conn(0x7fe2940fb910 msgr2=0x7fe2940fdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:05.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.688+0000 7fe29c7bd640 1 -- 172.21.15.148:0/1716532997 shutdown_connections 2024-09-19T07:11:05.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.688+0000 7fe29c7bd640 1 -- 172.21.15.148:0/1716532997 wait complete. 2024-09-19T07:11:05.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.689+0000 7fe29c7bd640 1 Processor -- start 2024-09-19T07:11:05.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.689+0000 7fe29c7bd640 1 -- start start 2024-09-19T07:11:05.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.689+0000 7fe29c7bd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2940ffb80 0x7fe294197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:05.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.689+0000 7fe29c7bd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe294100540 0x7fe2941983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:05.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.689+0000 7fe29c7bd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe294103110 0x7fe29419f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:05.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.689+0000 7fe29c7bd640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe29410d7b0 con 0x7fe294100540 2024-09-19T07:11:05.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.689+0000 7fe29c7bd640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe29410d630 con 0x7fe2940ffb80 2024-09-19T07:11:05.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.689+0000 7fe29c7bd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe29410d930 con 0x7fe294103110 2024-09-19T07:11:05.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.689+0000 7fe299d58640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe294100540 0x7fe2941983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:05.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.689+0000 7fe299d58640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe294100540 0x7fe2941983a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60702/0 (socket says 172.21.15.148:60702) 2024-09-19T07:11:05.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.689+0000 7fe299d58640 1 -- 172.21.15.148:0/4176710663 learned_addr learned my addr 172.21.15.148:0/4176710663 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:05.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.689+0000 7fe29a559640 1 --2- 172.21.15.148:0/4176710663 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2940ffb80 0x7fe294197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:05.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.689+0000 7fe29ad5a640 1 --2- 172.21.15.148:0/4176710663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe294103110 0x7fe29419f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:05.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.690+0000 7fe299d58640 1 -- 172.21.15.148:0/4176710663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe294103110 msgr2=0x7fe29419f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:05.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.690+0000 7fe299d58640 1 --2- 172.21.15.148:0/4176710663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe294103110 0x7fe29419f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:05.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.690+0000 7fe299d58640 1 -- 172.21.15.148:0/4176710663 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2940ffb80 msgr2=0x7fe294197e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:05.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.690+0000 7fe299d58640 1 --2- 172.21.15.148:0/4176710663 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2940ffb80 0x7fe294197e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:05.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.690+0000 7fe299d58640 1 -- 172.21.15.148:0/4176710663 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe29419fa80 con 0x7fe294100540 2024-09-19T07:11:05.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.690+0000 7fe299d58640 1 --2- 172.21.15.148:0/4176710663 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe294100540 0x7fe2941983a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe28400e9f0 tx=0x7fe28400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:05.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.690+0000 7fe28b7fe640 1 -- 172.21.15.148:0/4176710663 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28400cd80 con 0x7fe294100540 2024-09-19T07:11:05.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.690+0000 7fe28b7fe640 1 -- 172.21.15.148:0/4176710663 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe284005500 con 0x7fe294100540 2024-09-19T07:11:05.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.690+0000 7fe29c7bd640 1 -- 172.21.15.148:0/4176710663 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe29419fd70 con 0x7fe294100540 2024-09-19T07:11:05.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.690+0000 7fe28b7fe640 1 -- 172.21.15.148:0/4176710663 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe284010690 con 0x7fe294100540 2024-09-19T07:11:05.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.690+0000 7fe29c7bd640 1 -- 172.21.15.148:0/4176710663 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2941a0210 con 0x7fe294100540 2024-09-19T07:11:05.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.692+0000 7fe29c7bd640 1 -- 172.21.15.148:0/4176710663 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2941a04a0 con 0x7fe294100540 2024-09-19T07:11:05.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.693+0000 7fe28b7fe640 1 -- 172.21.15.148:0/4176710663 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 22) ==== 138476+0+0 (secure 0 0 0) 0x7fe2840046c0 con 0x7fe294100540 2024-09-19T07:11:05.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.693+0000 7fe28b7fe640 1 --2- 172.21.15.148:0/4176710663 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe2800a33c0 0x7fe2800a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:05.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.694+0000 7fe28b7fe640 1 -- 172.21.15.148:0/4176710663 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fe2840d0110 con 0x7fe294100540 2024-09-19T07:11:05.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.694+0000 7fe29a559640 1 --2- 172.21.15.148:0/4176710663 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe2800a33c0 0x7fe2800a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:05.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.694+0000 7fe29a559640 1 --2- 172.21.15.148:0/4176710663 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe2800a33c0 0x7fe2800a5880 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe2900095f0 tx=0x7fe290005f90 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:05.699 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.698+0000 7fe28b7fe640 1 -- 172.21.15.148:0/4176710663 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe28409cb00 con 0x7fe294100540 2024-09-19T07:11:05.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.891+0000 7fe29c7bd640 1 -- 172.21.15.148:0/4176710663 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe294108ac0 con 0x7fe294100540 2024-09-19T07:11:05.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.891+0000 7fe28b7fe640 1 -- 172.21.15.148:0/4176710663 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) ==== 100+0+11 (secure 0 0 0) 0x7fe28409c400 con 0x7fe294100540 2024-09-19T07:11:05.892 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 64 2024-09-19T07:11:05.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.893+0000 7fe29c7bd640 1 -- 172.21.15.148:0/4176710663 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe2800a33c0 msgr2=0x7fe2800a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:05.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.893+0000 7fe29c7bd640 1 --2- 172.21.15.148:0/4176710663 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe2800a33c0 0x7fe2800a5880 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe2900095f0 tx=0x7fe290005f90 comp rx=0 tx=0).stop 2024-09-19T07:11:05.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.893+0000 7fe29c7bd640 1 -- 172.21.15.148:0/4176710663 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe294100540 msgr2=0x7fe2941983a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:05.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.893+0000 7fe29c7bd640 1 --2- 172.21.15.148:0/4176710663 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe294100540 0x7fe2941983a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe28400e9f0 tx=0x7fe28400edf0 comp rx=0 tx=0).stop 2024-09-19T07:11:05.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.893+0000 7fe29c7bd640 1 -- 172.21.15.148:0/4176710663 shutdown_connections 2024-09-19T07:11:05.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.893+0000 7fe29c7bd640 1 --2- 172.21.15.148:0/4176710663 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe2800a33c0 0x7fe2800a5880 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:05.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.893+0000 7fe29c7bd640 1 --2- 172.21.15.148:0/4176710663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe294103110 0x7fe29419f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:05.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.893+0000 7fe29c7bd640 1 --2- 172.21.15.148:0/4176710663 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe294100540 0x7fe2941983a0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:05.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.893+0000 7fe29c7bd640 1 --2- 172.21.15.148:0/4176710663 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2940ffb80 0x7fe294197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:05.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.893+0000 7fe29c7bd640 1 -- 172.21.15.148:0/4176710663 >> 172.21.15.148:0/4176710663 conn(0x7fe2940fb910 msgr2=0x7fe2940fda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:05.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.893+0000 7fe29c7bd640 1 -- 172.21.15.148:0/4176710663 shutdown_connections 2024-09-19T07:11:05.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:05.893+0000 7fe29c7bd640 1 -- 172.21.15.148:0/4176710663 wait complete. 2024-09-19T07:11:05.905 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-19T07:11:05.905 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:11:06.163 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:11:06.510 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:06 smithi148 ceph-mon[31180]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:11:06.511 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:06 smithi148 ceph-mon[31180]: mgrmap e22: x(active, since 2s), standbys: y, z 2024-09-19T07:11:06.511 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:06 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:06.511 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:06 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:06.511 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:06 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:06.511 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:06 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:06.511 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:06 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:06.511 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:06 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:06.511 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:06 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/2695253372' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T07:11:06.511 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:06 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/4176710663' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T07:11:06.511 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:06 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:06.511 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:06 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:06.512 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:06 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:06.512 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:06 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:11:06.512 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:06 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:06.512 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:06 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:11:06.512 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:06 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:06.512 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:06 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:11:06.512 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:06 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:11:06.512 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:06 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:06.512 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:06 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:11:06.512 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:06 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:11:06.512 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:06 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:11:06.512 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:06 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:11:06.512 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:06 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:11:06.513 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:06 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:11:06.513 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:06 smithi148 ceph-mon[31180]: Adjusting osd_memory_target on smithi165 to 176.0M 2024-09-19T07:11:06.513 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:06 smithi148 ceph-mon[31180]: Adjusting osd_memory_target on smithi179 to 176.0M 2024-09-19T07:11:06.513 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:06 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:11:06.513 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:06 smithi148 ceph-mon[31180]: Unable to set osd_memory_target on smithi165 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-19T07:11:06.513 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:06 smithi148 ceph-mon[31180]: Unable to set osd_memory_target on smithi179 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-19T07:11:06.513 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:06 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:11:06.513 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:06 smithi148 ceph-mon[31180]: Adjusting osd_memory_target on smithi148 to 176.0M 2024-09-19T07:11:06.513 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:06 smithi148 ceph-mon[31180]: Unable to set osd_memory_target on smithi148 to 184579584: error parsing value: Value '184579584' is below minimum 939524096 2024-09-19T07:11:06.513 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:06 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:11:06.513 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:06 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:11:06.513 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:06 smithi148 ceph-mon[31180]: Updating smithi148:/etc/ceph/ceph.conf 2024-09-19T07:11:06.514 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:06 smithi148 ceph-mon[31180]: Updating smithi165:/etc/ceph/ceph.conf 2024-09-19T07:11:06.514 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:06 smithi148 ceph-mon[31180]: Updating smithi179:/etc/ceph/ceph.conf 2024-09-19T07:11:06.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:06 smithi179 ceph-mon[35716]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:11:06.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:06 smithi179 ceph-mon[35716]: mgrmap e22: x(active, since 2s), standbys: y, z 2024-09-19T07:11:06.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:06 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:06.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:06 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:06.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:06 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:06.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:06 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:06.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:06 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:06.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:06 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:06.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:06 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/2695253372' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T07:11:06.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:06 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/4176710663' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T07:11:06.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:06 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:06.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:06 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:06.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:06 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:06.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:06 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:11:06.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:06 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:06.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:06 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:11:06.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:06 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:06.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:06 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:11:06.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:06 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:11:06.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:06 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:06.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:06 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:11:06.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:06 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:11:06.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:06 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:11:06.525 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:06 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:11:06.525 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:06 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:11:06.525 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:06 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:11:06.525 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:06 smithi179 ceph-mon[35716]: Adjusting osd_memory_target on smithi165 to 176.0M 2024-09-19T07:11:06.525 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:06 smithi179 ceph-mon[35716]: Adjusting osd_memory_target on smithi179 to 176.0M 2024-09-19T07:11:06.525 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:06 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:11:06.525 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:06 smithi179 ceph-mon[35716]: Unable to set osd_memory_target on smithi165 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-19T07:11:06.525 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:06 smithi179 ceph-mon[35716]: Unable to set osd_memory_target on smithi179 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-19T07:11:06.525 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:06 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:11:06.525 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:06 smithi179 ceph-mon[35716]: Adjusting osd_memory_target on smithi148 to 176.0M 2024-09-19T07:11:06.525 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:06 smithi179 ceph-mon[35716]: Unable to set osd_memory_target on smithi148 to 184579584: error parsing value: Value '184579584' is below minimum 939524096 2024-09-19T07:11:06.525 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:06 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:11:06.525 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:06 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:11:06.525 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:06 smithi179 ceph-mon[35716]: Updating smithi148:/etc/ceph/ceph.conf 2024-09-19T07:11:06.526 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:06 smithi179 ceph-mon[35716]: Updating smithi165:/etc/ceph/ceph.conf 2024-09-19T07:11:06.526 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:06 smithi179 ceph-mon[35716]: Updating smithi179:/etc/ceph/ceph.conf 2024-09-19T07:11:06.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:06 smithi165 ceph-mon[35326]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:11:06.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:06 smithi165 ceph-mon[35326]: mgrmap e22: x(active, since 2s), standbys: y, z 2024-09-19T07:11:06.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:06 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:06.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:06 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:06.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:06 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:06.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:06 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:06.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:06 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:06.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:06 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:06.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:06 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/2695253372' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T07:11:06.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:06 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/4176710663' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T07:11:06.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:06 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:06.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:06 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:06.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:06 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:06.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:06 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:11:06.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:06 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:06.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:06 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:11:06.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:06 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:06.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:06 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:11:06.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:06 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:11:06.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:06 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:06.636 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:06 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:11:06.636 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:06 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:11:06.636 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:06 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:11:06.636 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:06 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:11:06.636 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:06 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:11:06.636 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:06 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:11:06.636 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:06 smithi165 ceph-mon[35326]: Adjusting osd_memory_target on smithi165 to 176.0M 2024-09-19T07:11:06.636 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:06 smithi165 ceph-mon[35326]: Adjusting osd_memory_target on smithi179 to 176.0M 2024-09-19T07:11:06.636 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:06 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:11:06.636 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:06 smithi165 ceph-mon[35326]: Unable to set osd_memory_target on smithi165 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-19T07:11:06.636 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:06 smithi165 ceph-mon[35326]: Unable to set osd_memory_target on smithi179 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-19T07:11:06.636 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:06 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:11:06.636 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:06 smithi165 ceph-mon[35326]: Adjusting osd_memory_target on smithi148 to 176.0M 2024-09-19T07:11:06.637 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:06 smithi165 ceph-mon[35326]: Unable to set osd_memory_target on smithi148 to 184579584: error parsing value: Value '184579584' is below minimum 939524096 2024-09-19T07:11:06.637 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:06 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:11:06.637 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:06 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:11:06.637 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:06 smithi165 ceph-mon[35326]: Updating smithi148:/etc/ceph/ceph.conf 2024-09-19T07:11:06.637 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:06 smithi165 ceph-mon[35326]: Updating smithi165:/etc/ceph/ceph.conf 2024-09-19T07:11:06.637 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:06 smithi165 ceph-mon[35326]: Updating smithi179:/etc/ceph/ceph.conf 2024-09-19T07:11:06.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.758+0000 7f8165294640 1 -- 172.21.15.148:0/4025467599 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8160106f20 msgr2=0x7f816010eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:06.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.758+0000 7f8165294640 1 --2- 172.21.15.148:0/4025467599 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8160106f20 0x7f816010eaa0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8158009ca0 tx=0x7f815802a8c0 comp rx=0 tx=0).stop 2024-09-19T07:11:06.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.758+0000 7f8165294640 1 -- 172.21.15.148:0/4025467599 shutdown_connections 2024-09-19T07:11:06.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.758+0000 7f8165294640 1 --2- 172.21.15.148:0/4025467599 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8160106f20 0x7f816010eaa0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:06.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.758+0000 7f8165294640 1 --2- 172.21.15.148:0/4025467599 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f81601027a0 0x7f81601067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:06.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.758+0000 7f8165294640 1 --2- 172.21.15.148:0/4025467599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8160101df0 0x7f81601021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:06.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.758+0000 7f8165294640 1 -- 172.21.15.148:0/4025467599 >> 172.21.15.148:0/4025467599 conn(0x7f81600fd8b0 msgr2=0x7f81600ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:06.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.758+0000 7f8165294640 1 -- 172.21.15.148:0/4025467599 shutdown_connections 2024-09-19T07:11:06.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.758+0000 7f8165294640 1 -- 172.21.15.148:0/4025467599 wait complete. 2024-09-19T07:11:06.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.759+0000 7f8165294640 1 Processor -- start 2024-09-19T07:11:06.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.759+0000 7f8165294640 1 -- start start 2024-09-19T07:11:06.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.760+0000 7f8165294640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8160101df0 0x7f816019a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:06.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.760+0000 7f8165294640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f81601027a0 0x7f816019aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:06.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.760+0000 7f8165294640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8160106f20 0x7f816019ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:06.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.760+0000 7f8165294640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8160111fd0 con 0x7f8160101df0 2024-09-19T07:11:06.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.760+0000 7f8165294640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8160111e50 con 0x7f81601027a0 2024-09-19T07:11:06.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.760+0000 7f8165294640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8160112150 con 0x7f8160106f20 2024-09-19T07:11:06.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.760+0000 7f815effd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8160101df0 0x7f816019a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:06.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.760+0000 7f815effd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8160101df0 0x7f816019a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60720/0 (socket says 172.21.15.148:60720) 2024-09-19T07:11:06.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.760+0000 7f815effd640 1 -- 172.21.15.148:0/1276528465 learned_addr learned my addr 172.21.15.148:0/1276528465 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:06.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.760+0000 7f815f7fe640 1 --2- 172.21.15.148:0/1276528465 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8160106f20 0x7f816019ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:06.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.760+0000 7f815e7fc640 1 --2- 172.21.15.148:0/1276528465 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f81601027a0 0x7f816019aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:06.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.760+0000 7f815effd640 1 -- 172.21.15.148:0/1276528465 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8160106f20 msgr2=0x7f816019ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:06.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.760+0000 7f815effd640 1 --2- 172.21.15.148:0/1276528465 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8160106f20 0x7f816019ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:06.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.760+0000 7f815effd640 1 -- 172.21.15.148:0/1276528465 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f81601027a0 msgr2=0x7f816019aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:06.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.760+0000 7f815effd640 1 --2- 172.21.15.148:0/1276528465 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f81601027a0 0x7f816019aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:06.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.760+0000 7f815effd640 1 -- 172.21.15.148:0/1276528465 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f816019f550 con 0x7f8160101df0 2024-09-19T07:11:06.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.760+0000 7f815f7fe640 1 --2- 172.21.15.148:0/1276528465 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8160106f20 0x7f816019ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:11:06.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.760+0000 7f815effd640 1 --2- 172.21.15.148:0/1276528465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8160101df0 0x7f816019a5a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f815000e9f0 tx=0x7f815000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:06.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.761+0000 7f8147fff640 1 -- 172.21.15.148:0/1276528465 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f815000ccc0 con 0x7f8160101df0 2024-09-19T07:11:06.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.761+0000 7f8165294640 1 -- 172.21.15.148:0/1276528465 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f816019f840 con 0x7f8160101df0 2024-09-19T07:11:06.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.761+0000 7f8147fff640 1 -- 172.21.15.148:0/1276528465 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f815000ce60 con 0x7f8160101df0 2024-09-19T07:11:06.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.761+0000 7f8147fff640 1 -- 172.21.15.148:0/1276528465 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8150010690 con 0x7f8160101df0 2024-09-19T07:11:06.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.761+0000 7f8165294640 1 -- 172.21.15.148:0/1276528465 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81601a7120 con 0x7f8160101df0 2024-09-19T07:11:06.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.762+0000 7f8165294640 1 -- 172.21.15.148:0/1276528465 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81601021d0 con 0x7f8160101df0 2024-09-19T07:11:06.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.763+0000 7f8147fff640 1 -- 172.21.15.148:0/1276528465 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 22) ==== 138476+0+0 (secure 0 0 0) 0x7f81500046c0 con 0x7f8160101df0 2024-09-19T07:11:06.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.764+0000 7f8147fff640 1 --2- 172.21.15.148:0/1276528465 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f81480a33b0 0x7f81480a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:06.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.764+0000 7f815e7fc640 1 --2- 172.21.15.148:0/1276528465 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f81480a33b0 0x7f81480a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:06.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.764+0000 7f8147fff640 1 -- 172.21.15.148:0/1276528465 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f81500d02e0 con 0x7f8160101df0 2024-09-19T07:11:06.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.764+0000 7f815e7fc640 1 --2- 172.21.15.148:0/1276528465 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f81480a33b0 0x7f81480a5870 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8160076480 tx=0x7f815400a2d0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:06.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.767+0000 7f8147fff640 1 -- 172.21.15.148:0/1276528465 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8150054210 con 0x7f8160101df0 2024-09-19T07:11:06.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.980+0000 7f8165294640 1 -- 172.21.15.148:0/1276528465 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f816019b900 con 0x7f8160101df0 2024-09-19T07:11:06.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.981+0000 7f8147fff640 1 -- 172.21.15.148:0/1276528465 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11939 (secure 0 0 0) 0x7f815009ccd0 con 0x7f8160101df0 2024-09-19T07:11:06.982 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:11:06.982 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":25,"btime":"2024-09-19T07:11:04:227331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/4263868576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":4263868576},{"type":"v1","addr":"172.21.15.148:6841","nonce":4263868576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24383,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2146820965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2146820965},{"type":"v1","addr":"172.21.15.165:6835","nonce":2146820965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:09:19.543369+0000","modified":"2024-09-19T07:11:03.969598+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24457,"mds_1":24437,"mds_2":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/1566489108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1566489108},{"type":"v1","addr":"172.21.15.179:6835","nonce":1566489108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.165:6839/3993490234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":3993490234},{"type":"v1","addr":"172.21.15.165:6839","nonce":3993490234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24457,"qdb_cluster":[24457,24437,24436]},"id":1}]} 2024-09-19T07:11:06.982 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 25 2024-09-19T07:11:06.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.983+0000 7f8165294640 1 -- 172.21.15.148:0/1276528465 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f81480a33b0 msgr2=0x7f81480a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:06.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.983+0000 7f8165294640 1 --2- 172.21.15.148:0/1276528465 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f81480a33b0 0x7f81480a5870 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8160076480 tx=0x7f815400a2d0 comp rx=0 tx=0).stop 2024-09-19T07:11:06.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.983+0000 7f8165294640 1 -- 172.21.15.148:0/1276528465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8160101df0 msgr2=0x7f816019a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:06.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.983+0000 7f8165294640 1 --2- 172.21.15.148:0/1276528465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8160101df0 0x7f816019a5a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f815000e9f0 tx=0x7f815000edf0 comp rx=0 tx=0).stop 2024-09-19T07:11:06.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.983+0000 7f8165294640 1 -- 172.21.15.148:0/1276528465 shutdown_connections 2024-09-19T07:11:06.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.983+0000 7f8165294640 1 --2- 172.21.15.148:0/1276528465 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f81480a33b0 0x7f81480a5870 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:06.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.983+0000 7f8165294640 1 --2- 172.21.15.148:0/1276528465 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8160106f20 0x7f816019ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:06.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.983+0000 7f8165294640 1 --2- 172.21.15.148:0/1276528465 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f81601027a0 0x7f816019aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:06.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.983+0000 7f8165294640 1 --2- 172.21.15.148:0/1276528465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8160101df0 0x7f816019a5a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:06.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.983+0000 7f8165294640 1 -- 172.21.15.148:0/1276528465 >> 172.21.15.148:0/1276528465 conn(0x7f81600fd8b0 msgr2=0x7f81600fe500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:06.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.983+0000 7f8165294640 1 -- 172.21.15.148:0/1276528465 shutdown_connections 2024-09-19T07:11:06.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:06.983+0000 7f8165294640 1 -- 172.21.15.148:0/1276528465 wait complete. 2024-09-19T07:11:07.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:07 smithi179 ceph-mon[35716]: Updating smithi148:/var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:11:07.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:07 smithi179 ceph-mon[35716]: Updating smithi179:/var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:11:07.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:07 smithi179 ceph-mon[35716]: Updating smithi165:/var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:11:07.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:07 smithi179 ceph-mon[35716]: Updating smithi179:/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:11:07.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:07 smithi179 ceph-mon[35716]: Updating smithi148:/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:11:07.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:07 smithi179 ceph-mon[35716]: Updating smithi165:/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:11:07.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:07 smithi179 ceph-mon[35716]: Updating smithi179:/var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T07:11:07.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:07 smithi179 ceph-mon[35716]: Updating smithi148:/var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T07:11:07.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:07 smithi179 ceph-mon[35716]: Updating smithi165:/var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T07:11:07.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:07 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/1276528465' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:11:07.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:07 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:07.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:07 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:07.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:07 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:07.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:07 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:07.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:07 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:07.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:07 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:07.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:07 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:07.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:07 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:11:07.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:07 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:11:07.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:07 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:11:07.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:07 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:07.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:07 smithi148 ceph-mon[31180]: Updating smithi148:/var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:11:07.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:07 smithi148 ceph-mon[31180]: Updating smithi179:/var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:11:07.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:07 smithi148 ceph-mon[31180]: Updating smithi165:/var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:11:07.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:07 smithi148 ceph-mon[31180]: Updating smithi179:/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:11:07.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:07 smithi148 ceph-mon[31180]: Updating smithi148:/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:11:07.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:07 smithi148 ceph-mon[31180]: Updating smithi165:/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:11:07.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:07 smithi148 ceph-mon[31180]: Updating smithi179:/var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T07:11:07.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:07 smithi148 ceph-mon[31180]: Updating smithi148:/var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T07:11:07.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:07 smithi148 ceph-mon[31180]: Updating smithi165:/var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T07:11:07.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:07 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/1276528465' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:11:07.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:07 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:07.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:07 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:07.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:07 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:07.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:07 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:07.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:07 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:07.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:07 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:07.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:07 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:07.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:07 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:11:07.585 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:07 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:11:07.585 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:07 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:11:07.585 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:07 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:07.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:07 smithi165 ceph-mon[35326]: Updating smithi148:/var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:11:07.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:07 smithi165 ceph-mon[35326]: Updating smithi179:/var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:11:07.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:07 smithi165 ceph-mon[35326]: Updating smithi165:/var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:11:07.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:07 smithi165 ceph-mon[35326]: Updating smithi179:/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:11:07.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:07 smithi165 ceph-mon[35326]: Updating smithi148:/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:11:07.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:07 smithi165 ceph-mon[35326]: Updating smithi165:/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:11:07.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:07 smithi165 ceph-mon[35326]: Updating smithi179:/var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T07:11:07.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:07 smithi165 ceph-mon[35326]: Updating smithi148:/var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T07:11:07.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:07 smithi165 ceph-mon[35326]: Updating smithi165:/var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T07:11:07.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:07 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/1276528465' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:11:07.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:07 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:07.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:07 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:07.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:07 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:07.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:07 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:07.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:07 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:07.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:07 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:07.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:07 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:07.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:07 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:11:07.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:07 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:11:07.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:07 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:11:07.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:07 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:07.775 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-19T07:11:07.775 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-19T07:11:07.775 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T07:11:07.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:07.876+0000 7f633a786640 1 -- 172.21.15.148:0/4230306811 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63341054f0 msgr2=0x7f633410d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:07.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:07.876+0000 7f633a786640 1 --2- 172.21.15.148:0/4230306811 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63341054f0 0x7f633410d040 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f632c00adb0 tx=0x7f632c02b7a0 comp rx=0 tx=0).stop 2024-09-19T07:11:07.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:07.876+0000 7f633a786640 1 -- 172.21.15.148:0/4230306811 shutdown_connections 2024-09-19T07:11:07.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:07.876+0000 7f633a786640 1 --2- 172.21.15.148:0/4230306811 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63341054f0 0x7f633410d040 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:07.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:07.876+0000 7f633a786640 1 --2- 172.21.15.148:0/4230306811 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6334100d50 0x7f6334104d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:07.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:07.876+0000 7f633a786640 1 --2- 172.21.15.148:0/4230306811 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63341003a0 0x7f6334100780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:07.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:07.876+0000 7f633a786640 1 -- 172.21.15.148:0/4230306811 >> 172.21.15.148:0/4230306811 conn(0x7f63340771e0 msgr2=0x7f63340fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:07.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:07.876+0000 7f633a786640 1 -- 172.21.15.148:0/4230306811 shutdown_connections 2024-09-19T07:11:07.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:07.876+0000 7f633a786640 1 -- 172.21.15.148:0/4230306811 wait complete. 2024-09-19T07:11:07.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:07.877+0000 7f633a786640 1 Processor -- start 2024-09-19T07:11:07.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:07.877+0000 7f633a786640 1 -- start start 2024-09-19T07:11:07.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:07.877+0000 7f633a786640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63341003a0 0x7f63341983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:07.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:07.877+0000 7f633a786640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63341054f0 0x7f6334198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:07.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:07.877+0000 7f633a786640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f633419cc90 0x7f633419d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:07.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:07.877+0000 7f633a786640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f633410fcd0 con 0x7f63341054f0 2024-09-19T07:11:07.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:07.877+0000 7f633a786640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f633410fb50 con 0x7f633419cc90 2024-09-19T07:11:07.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:07.877+0000 7f633a786640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f633410fe50 con 0x7f63341003a0 2024-09-19T07:11:07.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:07.877+0000 7f63337fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63341054f0 0x7f6334198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:07.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:07.877+0000 7f63337fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63341054f0 0x7f6334198910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60738/0 (socket says 172.21.15.148:60738) 2024-09-19T07:11:07.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:07.877+0000 7f63337fe640 1 -- 172.21.15.148:0/3527633959 learned_addr learned my addr 172.21.15.148:0/3527633959 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:07.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:07.877+0000 7f6338d23640 1 --2- 172.21.15.148:0/3527633959 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f633419cc90 0x7f633419d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:07.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:07.878+0000 7f6333fff640 1 --2- 172.21.15.148:0/3527633959 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63341003a0 0x7f63341983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:07.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:07.878+0000 7f63337fe640 1 -- 172.21.15.148:0/3527633959 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63341003a0 msgr2=0x7f63341983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:07.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:07.878+0000 7f63337fe640 1 --2- 172.21.15.148:0/3527633959 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63341003a0 0x7f63341983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:07.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:07.878+0000 7f63337fe640 1 -- 172.21.15.148:0/3527633959 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f633419cc90 msgr2=0x7f633419d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:07.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:07.878+0000 7f63337fe640 1 --2- 172.21.15.148:0/3527633959 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f633419cc90 0x7f633419d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:07.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:07.878+0000 7f63337fe640 1 -- 172.21.15.148:0/3527633959 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f633419d780 con 0x7f63341054f0 2024-09-19T07:11:07.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:07.878+0000 7f63337fe640 1 --2- 172.21.15.148:0/3527633959 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63341054f0 0x7f6334198910 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f632800e9c0 tx=0x7f632800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:07.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:07.878+0000 7f63317fa640 1 -- 172.21.15.148:0/3527633959 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632800cd80 con 0x7f63341054f0 2024-09-19T07:11:07.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:07.878+0000 7f63317fa640 1 -- 172.21.15.148:0/3527633959 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6328005500 con 0x7f63341054f0 2024-09-19T07:11:07.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:07.878+0000 7f633a786640 1 -- 172.21.15.148:0/3527633959 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f633419da70 con 0x7f63341054f0 2024-09-19T07:11:07.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:07.878+0000 7f63317fa640 1 -- 172.21.15.148:0/3527633959 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6328010690 con 0x7f63341054f0 2024-09-19T07:11:07.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:07.878+0000 7f633a786640 1 -- 172.21.15.148:0/3527633959 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63341a5250 con 0x7f63341054f0 2024-09-19T07:11:07.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:07.879+0000 7f633a786640 1 -- 172.21.15.148:0/3527633959 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6334100780 con 0x7f63341054f0 2024-09-19T07:11:07.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:07.880+0000 7f63317fa640 1 -- 172.21.15.148:0/3527633959 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 22) ==== 138476+0+0 (secure 0 0 0) 0x7f63280046c0 con 0x7f63341054f0 2024-09-19T07:11:07.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:07.881+0000 7f63317fa640 1 --2- 172.21.15.148:0/3527633959 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f631c0a3440 0x7f631c0a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:07.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:07.881+0000 7f6333fff640 1 --2- 172.21.15.148:0/3527633959 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f631c0a3440 0x7f631c0a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:07.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:07.881+0000 7f63317fa640 1 -- 172.21.15.148:0/3527633959 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f63280cff90 con 0x7f63341054f0 2024-09-19T07:11:07.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:07.881+0000 7f6333fff640 1 --2- 172.21.15.148:0/3527633959 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f631c0a3440 0x7f631c0a5900 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6324009bd0 tx=0x7f6324005f90 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:07.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:07.885+0000 7f63317fa640 1 -- 172.21.15.148:0/3527633959 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f632809c980 con 0x7f63341054f0 2024-09-19T07:11:08.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.047+0000 7f633a786640 1 -- 172.21.15.148:0/3527633959 --> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6334103c50 con 0x7f631c0a3440 2024-09-19T07:11:08.054 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.054+0000 7f63317fa640 1 -- 172.21.15.148:0/3527633959 <== mgr.15123 v2:172.21.15.148:6800/3902535850 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257894 (secure 0 0 0) 0x7f6334103c50 con 0x7f631c0a3440 2024-09-19T07:11:08.057 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:11:08.059 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2024-09-19T07:11:08.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.057+0000 7f633a786640 1 -- 172.21.15.148:0/3527633959 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f631c0a3440 msgr2=0x7f631c0a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:08.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.057+0000 7f633a786640 1 --2- 172.21.15.148:0/3527633959 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f631c0a3440 0x7f631c0a5900 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6324009bd0 tx=0x7f6324005f90 comp rx=0 tx=0).stop 2024-09-19T07:11:08.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.057+0000 7f633a786640 1 -- 172.21.15.148:0/3527633959 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63341054f0 msgr2=0x7f6334198910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:08.061 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.057+0000 7f633a786640 1 --2- 172.21.15.148:0/3527633959 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63341054f0 0x7f6334198910 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f632800e9c0 tx=0x7f632800ee80 comp rx=0 tx=0).stop 2024-09-19T07:11:08.061 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.057+0000 7f633a786640 1 -- 172.21.15.148:0/3527633959 shutdown_connections 2024-09-19T07:11:08.061 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.057+0000 7f633a786640 1 --2- 172.21.15.148:0/3527633959 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f631c0a3440 0x7f631c0a5900 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:08.061 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.057+0000 7f633a786640 1 --2- 172.21.15.148:0/3527633959 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f633419cc90 0x7f633419d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:08.061 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.057+0000 7f633a786640 1 --2- 172.21.15.148:0/3527633959 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63341054f0 0x7f6334198910 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:08.061 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.057+0000 7f633a786640 1 --2- 172.21.15.148:0/3527633959 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63341003a0 0x7f63341983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:08.061 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.057+0000 7f633a786640 1 -- 172.21.15.148:0/3527633959 >> 172.21.15.148:0/3527633959 conn(0x7f63340771e0 msgr2=0x7f6334103540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:08.061 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.057+0000 7f633a786640 1 -- 172.21.15.148:0/3527633959 shutdown_connections 2024-09-19T07:11:08.061 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.057+0000 7f633a786640 1 -- 172.21.15.148:0/3527633959 wait complete. 2024-09-19T07:11:08.069 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-09-19T07:11:07.248743+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1188456,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":832,"num_read_kb":569,"num_write":477,"num_write_kb":4379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1207683,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":868,"ondisk_log_size":868,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":387744,"kb_used_data":13440,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124554080,"statfs":{"total":1151940427776,"available":1151543377920,"internally_reserved":0,"allocated":13762560,"data_stored":8078373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":382973242},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,0,5,4,14,28],"upper_bound":64},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.996340"},"pg_stats":[{"pgid":"3.3f","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.279425+0000","last_change":"2024-09-19T07:09:18.926902+0000","last_active":"2024-09-19T07:11:03.279425+0000","last_peered":"2024-09-19T07:11:03.279425+0000","last_clean":"2024-09-19T07:11:03.279425+0000","last_became_active":"2024-09-19T07:09:18.926582+0000","last_became_peered":"2024-09-19T07:09:18.926582+0000","last_unstale":"2024-09-19T07:11:03.279425+0000","last_undegraded":"2024-09-19T07:11:03.279425+0000","last_fullsized":"2024-09-19T07:11:03.279425+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:37.875779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.283851+0000","last_change":"2024-09-19T07:09:18.934205+0000","last_active":"2024-09-19T07:11:03.283851+0000","last_peered":"2024-09-19T07:11:03.283851+0000","last_clean":"2024-09-19T07:11:03.283851+0000","last_became_active":"2024-09-19T07:09:18.933767+0000","last_became_peered":"2024-09-19T07:09:18.933767+0000","last_unstale":"2024-09-19T07:11:03.283851+0000","last_undegraded":"2024-09-19T07:11:03.283851+0000","last_fullsized":"2024-09-19T07:11:03.283851+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:10:45.391428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.284092+0000","last_change":"2024-09-19T07:09:18.922312+0000","last_active":"2024-09-19T07:11:03.284092+0000","last_peered":"2024-09-19T07:11:03.284092+0000","last_clean":"2024-09-19T07:11:03.284092+0000","last_became_active":"2024-09-19T07:09:18.921476+0000","last_became_peered":"2024-09-19T07:09:18.921476+0000","last_unstale":"2024-09-19T07:11:03.284092+0000","last_undegraded":"2024-09-19T07:11:03.284092+0000","last_fullsized":"2024-09-19T07:11:03.284092+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:29.470616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.269605+0000","last_change":"2024-09-19T07:09:18.938218+0000","last_active":"2024-09-19T07:11:03.269605+0000","last_peered":"2024-09-19T07:11:03.269605+0000","last_clean":"2024-09-19T07:11:03.269605+0000","last_became_active":"2024-09-19T07:09:18.937306+0000","last_became_peered":"2024-09-19T07:09:18.937306+0000","last_unstale":"2024-09-19T07:11:03.269605+0000","last_undegraded":"2024-09-19T07:11:03.269605+0000","last_fullsized":"2024-09-19T07:11:03.269605+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:54.146506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.274574+0000","last_change":"2024-09-19T07:09:18.925837+0000","last_active":"2024-09-19T07:11:03.274574+0000","last_peered":"2024-09-19T07:11:03.274574+0000","last_clean":"2024-09-19T07:11:03.274574+0000","last_became_active":"2024-09-19T07:09:18.925559+0000","last_became_peered":"2024-09-19T07:09:18.925559+0000","last_unstale":"2024-09-19T07:11:03.274574+0000","last_undegraded":"2024-09-19T07:11:03.274574+0000","last_fullsized":"2024-09-19T07:11:03.274574+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:15:58.348347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.267010+0000","last_change":"2024-09-19T07:09:18.938911+0000","last_active":"2024-09-19T07:11:03.267010+0000","last_peered":"2024-09-19T07:11:03.267010+0000","last_clean":"2024-09-19T07:11:03.267010+0000","last_became_active":"2024-09-19T07:09:18.938601+0000","last_became_peered":"2024-09-19T07:09:18.938601+0000","last_unstale":"2024-09-19T07:11:03.267010+0000","last_undegraded":"2024-09-19T07:11:03.267010+0000","last_fullsized":"2024-09-19T07:11:03.267010+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:34.517324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.274002+0000","last_change":"2024-09-19T07:09:18.930253+0000","last_active":"2024-09-19T07:11:03.274002+0000","last_peered":"2024-09-19T07:11:03.274002+0000","last_clean":"2024-09-19T07:11:03.274002+0000","last_became_active":"2024-09-19T07:09:18.929927+0000","last_became_peered":"2024-09-19T07:09:18.929927+0000","last_unstale":"2024-09-19T07:11:03.274002+0000","last_undegraded":"2024-09-19T07:11:03.274002+0000","last_fullsized":"2024-09-19T07:11:03.274002+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:31:39.186230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"81'9","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.269452+0000","last_change":"2024-09-19T07:09:38.180197+0000","last_active":"2024-09-19T07:11:03.269452+0000","last_peered":"2024-09-19T07:11:03.269452+0000","last_clean":"2024-09-19T07:11:03.269452+0000","last_became_active":"2024-09-19T07:09:38.179767+0000","last_became_peered":"2024-09-19T07:09:38.179767+0000","last_unstale":"2024-09-19T07:11:03.269452+0000","last_undegraded":"2024-09-19T07:11:03.269452+0000","last_fullsized":"2024-09-19T07:11:03.269452+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:43.581181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.275716+0000","last_change":"2024-09-19T07:09:18.937100+0000","last_active":"2024-09-19T07:11:03.275716+0000","last_peered":"2024-09-19T07:11:03.275716+0000","last_clean":"2024-09-19T07:11:03.275716+0000","last_became_active":"2024-09-19T07:09:18.935151+0000","last_became_peered":"2024-09-19T07:09:18.935151+0000","last_unstale":"2024-09-19T07:11:03.275716+0000","last_undegraded":"2024-09-19T07:11:03.275716+0000","last_fullsized":"2024-09-19T07:11:03.275716+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:46:30.950667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.273140+0000","last_change":"2024-09-19T07:09:18.940119+0000","last_active":"2024-09-19T07:11:03.273140+0000","last_peered":"2024-09-19T07:11:03.273140+0000","last_clean":"2024-09-19T07:11:03.273140+0000","last_became_active":"2024-09-19T07:09:18.939703+0000","last_became_peered":"2024-09-19T07:09:18.939703+0000","last_unstale":"2024-09-19T07:11:03.273140+0000","last_undegraded":"2024-09-19T07:11:03.273140+0000","last_fullsized":"2024-09-19T07:11:03.273140+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:51:04.982727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.276689+0000","last_change":"2024-09-19T07:09:18.939146+0000","last_active":"2024-09-19T07:11:03.276689+0000","last_peered":"2024-09-19T07:11:03.276689+0000","last_clean":"2024-09-19T07:11:03.276689+0000","last_became_active":"2024-09-19T07:09:18.936842+0000","last_became_peered":"2024-09-19T07:09:18.936842+0000","last_unstale":"2024-09-19T07:11:03.276689+0000","last_undegraded":"2024-09-19T07:11:03.276689+0000","last_fullsized":"2024-09-19T07:11:03.276689+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:32.713505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.265688+0000","last_change":"2024-09-19T07:09:38.178834+0000","last_active":"2024-09-19T07:11:03.265688+0000","last_peered":"2024-09-19T07:11:03.265688+0000","last_clean":"2024-09-19T07:11:03.265688+0000","last_became_active":"2024-09-19T07:09:38.178477+0000","last_became_peered":"2024-09-19T07:09:38.178477+0000","last_unstale":"2024-09-19T07:11:03.265688+0000","last_undegraded":"2024-09-19T07:11:03.265688+0000","last_fullsized":"2024-09-19T07:11:03.265688+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:04:44.524920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.285948+0000","last_change":"2024-09-19T07:09:18.935422+0000","last_active":"2024-09-19T07:11:03.285948+0000","last_peered":"2024-09-19T07:11:03.285948+0000","last_clean":"2024-09-19T07:11:03.285948+0000","last_became_active":"2024-09-19T07:09:18.934994+0000","last_became_peered":"2024-09-19T07:09:18.934994+0000","last_unstale":"2024-09-19T07:11:03.285948+0000","last_undegraded":"2024-09-19T07:11:03.285948+0000","last_fullsized":"2024-09-19T07:11:03.285948+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:37:30.751247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.283787+0000","last_change":"2024-09-19T07:09:18.933954+0000","last_active":"2024-09-19T07:11:03.283787+0000","last_peered":"2024-09-19T07:11:03.283787+0000","last_clean":"2024-09-19T07:11:03.283787+0000","last_became_active":"2024-09-19T07:09:18.933588+0000","last_became_peered":"2024-09-19T07:09:18.933588+0000","last_unstale":"2024-09-19T07:11:03.283787+0000","last_undegraded":"2024-09-19T07:11:03.283787+0000","last_fullsized":"2024-09-19T07:11:03.283787+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:10.161172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.283035+0000","last_change":"2024-09-19T07:09:18.932122+0000","last_active":"2024-09-19T07:11:03.283035+0000","last_peered":"2024-09-19T07:11:03.283035+0000","last_clean":"2024-09-19T07:11:03.283035+0000","last_became_active":"2024-09-19T07:09:18.931798+0000","last_became_peered":"2024-09-19T07:09:18.931798+0000","last_unstale":"2024-09-19T07:11:03.283035+0000","last_undegraded":"2024-09-19T07:11:03.283035+0000","last_fullsized":"2024-09-19T07:11:03.283035+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:44.776375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.261952+0000","last_change":"2024-09-19T07:09:18.935632+0000","last_active":"2024-09-19T07:11:03.261952+0000","last_peered":"2024-09-19T07:11:03.261952+0000","last_clean":"2024-09-19T07:11:03.261952+0000","last_became_active":"2024-09-19T07:09:18.935174+0000","last_became_peered":"2024-09-19T07:09:18.935174+0000","last_unstale":"2024-09-19T07:11:03.261952+0000","last_undegraded":"2024-09-19T07:11:03.261952+0000","last_fullsized":"2024-09-19T07:11:03.261952+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:22.170777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.279662+0000","last_change":"2024-09-19T07:09:18.931836+0000","last_active":"2024-09-19T07:11:03.279662+0000","last_peered":"2024-09-19T07:11:03.279662+0000","last_clean":"2024-09-19T07:11:03.279662+0000","last_became_active":"2024-09-19T07:09:18.931564+0000","last_became_peered":"2024-09-19T07:09:18.931564+0000","last_unstale":"2024-09-19T07:11:03.279662+0000","last_undegraded":"2024-09-19T07:11:03.279662+0000","last_fullsized":"2024-09-19T07:11:03.279662+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:53.674584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.263261+0000","last_change":"2024-09-19T07:09:18.933210+0000","last_active":"2024-09-19T07:11:03.263261+0000","last_peered":"2024-09-19T07:11:03.263261+0000","last_clean":"2024-09-19T07:11:03.263261+0000","last_became_active":"2024-09-19T07:09:18.932894+0000","last_became_peered":"2024-09-19T07:09:18.932894+0000","last_unstale":"2024-09-19T07:11:03.263261+0000","last_undegraded":"2024-09-19T07:11:03.263261+0000","last_fullsized":"2024-09-19T07:11:03.263261+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:50:56.669801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.281347+0000","last_change":"2024-09-19T07:09:18.925627+0000","last_active":"2024-09-19T07:11:03.281347+0000","last_peered":"2024-09-19T07:11:03.281347+0000","last_clean":"2024-09-19T07:11:03.281347+0000","last_became_active":"2024-09-19T07:09:18.925340+0000","last_became_peered":"2024-09-19T07:09:18.925340+0000","last_unstale":"2024-09-19T07:11:03.281347+0000","last_undegraded":"2024-09-19T07:11:03.281347+0000","last_fullsized":"2024-09-19T07:11:03.281347+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:29.544534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.275601+0000","last_change":"2024-09-19T07:09:18.936963+0000","last_active":"2024-09-19T07:11:03.275601+0000","last_peered":"2024-09-19T07:11:03.275601+0000","last_clean":"2024-09-19T07:11:03.275601+0000","last_became_active":"2024-09-19T07:09:18.936615+0000","last_became_peered":"2024-09-19T07:09:18.936615+0000","last_unstale":"2024-09-19T07:11:03.275601+0000","last_undegraded":"2024-09-19T07:11:03.275601+0000","last_fullsized":"2024-09-19T07:11:03.275601+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:13.036392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.285146+0000","last_change":"2024-09-19T07:09:18.932018+0000","last_active":"2024-09-19T07:11:03.285146+0000","last_peered":"2024-09-19T07:11:03.285146+0000","last_clean":"2024-09-19T07:11:03.285146+0000","last_became_active":"2024-09-19T07:09:18.931624+0000","last_became_peered":"2024-09-19T07:09:18.931624+0000","last_unstale":"2024-09-19T07:11:03.285146+0000","last_undegraded":"2024-09-19T07:11:03.285146+0000","last_fullsized":"2024-09-19T07:11:03.285146+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:53:05.585166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.265530+0000","last_change":"2024-09-19T07:09:18.935474+0000","last_active":"2024-09-19T07:11:03.265530+0000","last_peered":"2024-09-19T07:11:03.265530+0000","last_clean":"2024-09-19T07:11:03.265530+0000","last_became_active":"2024-09-19T07:09:18.929018+0000","last_became_peered":"2024-09-19T07:09:18.929018+0000","last_unstale":"2024-09-19T07:11:03.265530+0000","last_undegraded":"2024-09-19T07:11:03.265530+0000","last_fullsized":"2024-09-19T07:11:03.265530+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:01.383024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.276949+0000","last_change":"2024-09-19T07:09:18.928733+0000","last_active":"2024-09-19T07:11:03.276949+0000","last_peered":"2024-09-19T07:11:03.276949+0000","last_clean":"2024-09-19T07:11:03.276949+0000","last_became_active":"2024-09-19T07:09:18.928431+0000","last_became_peered":"2024-09-19T07:09:18.928431+0000","last_unstale":"2024-09-19T07:11:03.276949+0000","last_undegraded":"2024-09-19T07:11:03.276949+0000","last_fullsized":"2024-09-19T07:11:03.276949+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:37.313958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.268113+0000","last_change":"2024-09-19T07:09:18.921268+0000","last_active":"2024-09-19T07:11:03.268113+0000","last_peered":"2024-09-19T07:11:03.268113+0000","last_clean":"2024-09-19T07:11:03.268113+0000","last_became_active":"2024-09-19T07:09:18.920482+0000","last_became_peered":"2024-09-19T07:09:18.920482+0000","last_unstale":"2024-09-19T07:11:03.268113+0000","last_undegraded":"2024-09-19T07:11:03.268113+0000","last_fullsized":"2024-09-19T07:11:03.268113+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:35.201826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"81'2","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.269267+0000","last_change":"2024-09-19T07:09:38.179136+0000","last_active":"2024-09-19T07:11:03.269267+0000","last_peered":"2024-09-19T07:11:03.269267+0000","last_clean":"2024-09-19T07:11:03.269267+0000","last_became_active":"2024-09-19T07:09:38.178746+0000","last_became_peered":"2024-09-19T07:09:38.178746+0000","last_unstale":"2024-09-19T07:11:03.269267+0000","last_undegraded":"2024-09-19T07:11:03.269267+0000","last_fullsized":"2024-09-19T07:11:03.269267+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:03.788114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.280523+0000","last_change":"2024-09-19T07:09:18.924099+0000","last_active":"2024-09-19T07:11:03.280523+0000","last_peered":"2024-09-19T07:11:03.280523+0000","last_clean":"2024-09-19T07:11:03.280523+0000","last_became_active":"2024-09-19T07:09:18.923772+0000","last_became_peered":"2024-09-19T07:09:18.923772+0000","last_unstale":"2024-09-19T07:11:03.280523+0000","last_undegraded":"2024-09-19T07:11:03.280523+0000","last_fullsized":"2024-09-19T07:11:03.280523+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:05:04.954087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.271340+0000","last_change":"2024-09-19T07:09:18.923391+0000","last_active":"2024-09-19T07:11:03.271340+0000","last_peered":"2024-09-19T07:11:03.271340+0000","last_clean":"2024-09-19T07:11:03.271340+0000","last_became_active":"2024-09-19T07:09:18.923085+0000","last_became_peered":"2024-09-19T07:09:18.923085+0000","last_unstale":"2024-09-19T07:11:03.271340+0000","last_undegraded":"2024-09-19T07:11:03.271340+0000","last_fullsized":"2024-09-19T07:11:03.271340+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:43:27.032400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.283075+0000","last_change":"2024-09-19T07:09:18.937188+0000","last_active":"2024-09-19T07:11:03.283075+0000","last_peered":"2024-09-19T07:11:03.283075+0000","last_clean":"2024-09-19T07:11:03.283075+0000","last_became_active":"2024-09-19T07:09:18.936866+0000","last_became_peered":"2024-09-19T07:09:18.936866+0000","last_unstale":"2024-09-19T07:11:03.283075+0000","last_undegraded":"2024-09-19T07:11:03.283075+0000","last_fullsized":"2024-09-19T07:11:03.283075+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:29:08.835307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.284272+0000","last_change":"2024-09-19T07:09:18.935170+0000","last_active":"2024-09-19T07:11:03.284272+0000","last_peered":"2024-09-19T07:11:03.284272+0000","last_clean":"2024-09-19T07:11:03.284272+0000","last_became_active":"2024-09-19T07:09:18.934356+0000","last_became_peered":"2024-09-19T07:09:18.934356+0000","last_unstale":"2024-09-19T07:11:03.284272+0000","last_undegraded":"2024-09-19T07:11:03.284272+0000","last_fullsized":"2024-09-19T07:11:03.284272+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:53.567392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.285704+0000","last_change":"2024-09-19T07:09:18.922640+0000","last_active":"2024-09-19T07:11:03.285704+0000","last_peered":"2024-09-19T07:11:03.285704+0000","last_clean":"2024-09-19T07:11:03.285704+0000","last_became_active":"2024-09-19T07:09:18.922312+0000","last_became_peered":"2024-09-19T07:09:18.922312+0000","last_unstale":"2024-09-19T07:11:03.285704+0000","last_undegraded":"2024-09-19T07:11:03.285704+0000","last_fullsized":"2024-09-19T07:11:03.285704+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:50.868818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.280468+0000","last_change":"2024-09-19T07:09:18.934364+0000","last_active":"2024-09-19T07:11:03.280468+0000","last_peered":"2024-09-19T07:11:03.280468+0000","last_clean":"2024-09-19T07:11:03.280468+0000","last_became_active":"2024-09-19T07:09:18.933533+0000","last_became_peered":"2024-09-19T07:09:18.933533+0000","last_unstale":"2024-09-19T07:11:03.280468+0000","last_undegraded":"2024-09-19T07:11:03.280468+0000","last_fullsized":"2024-09-19T07:11:03.280468+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:54.175425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.274368+0000","last_change":"2024-09-19T07:09:18.927456+0000","last_active":"2024-09-19T07:11:03.274368+0000","last_peered":"2024-09-19T07:11:03.274368+0000","last_clean":"2024-09-19T07:11:03.274368+0000","last_became_active":"2024-09-19T07:09:18.927117+0000","last_became_peered":"2024-09-19T07:09:18.927117+0000","last_unstale":"2024-09-19T07:11:03.274368+0000","last_undegraded":"2024-09-19T07:11:03.274368+0000","last_fullsized":"2024-09-19T07:11:03.274368+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:08.885898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.271805+0000","last_change":"2024-09-19T07:09:18.926024+0000","last_active":"2024-09-19T07:11:03.271805+0000","last_peered":"2024-09-19T07:11:03.271805+0000","last_clean":"2024-09-19T07:11:03.271805+0000","last_became_active":"2024-09-19T07:09:18.925689+0000","last_became_peered":"2024-09-19T07:09:18.925689+0000","last_unstale":"2024-09-19T07:11:03.271805+0000","last_undegraded":"2024-09-19T07:11:03.271805+0000","last_fullsized":"2024-09-19T07:11:03.271805+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:09:08.178214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'10","reported_seq":135,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:04.129081+0000","last_change":"2024-09-19T07:09:16.915804+0000","last_active":"2024-09-19T07:11:04.129081+0000","last_peered":"2024-09-19T07:11:04.129081+0000","last_clean":"2024-09-19T07:11:04.129081+0000","last_became_active":"2024-09-19T07:09:16.915434+0000","last_became_peered":"2024-09-19T07:09:16.915434+0000","last_unstale":"2024-09-19T07:11:04.129081+0000","last_undegraded":"2024-09-19T07:11:04.129081+0000","last_fullsized":"2024-09-19T07:11:04.129081+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:57.230475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2250,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":5,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.271307+0000","last_change":"2024-09-19T07:09:18.932497+0000","last_active":"2024-09-19T07:11:03.271307+0000","last_peered":"2024-09-19T07:11:03.271307+0000","last_clean":"2024-09-19T07:11:03.271307+0000","last_became_active":"2024-09-19T07:09:18.932213+0000","last_became_peered":"2024-09-19T07:09:18.932213+0000","last_unstale":"2024-09-19T07:11:03.271307+0000","last_undegraded":"2024-09-19T07:11:03.271307+0000","last_fullsized":"2024-09-19T07:11:03.271307+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:10.299077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.233512+0000","last_change":"2024-09-19T07:09:16.910171+0000","last_active":"2024-09-19T07:11:03.233512+0000","last_peered":"2024-09-19T07:11:03.233512+0000","last_clean":"2024-09-19T07:11:03.233512+0000","last_became_active":"2024-09-19T07:09:16.909840+0000","last_became_peered":"2024-09-19T07:09:16.909840+0000","last_unstale":"2024-09-19T07:11:03.233512+0000","last_undegraded":"2024-09-19T07:11:03.233512+0000","last_fullsized":"2024-09-19T07:11:03.233512+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:35.448892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.229456+0000","last_change":"2024-09-19T07:09:16.911336+0000","last_active":"2024-09-19T07:11:03.229456+0000","last_peered":"2024-09-19T07:11:03.229456+0000","last_clean":"2024-09-19T07:11:03.229456+0000","last_became_active":"2024-09-19T07:09:16.911027+0000","last_became_peered":"2024-09-19T07:09:16.911027+0000","last_unstale":"2024-09-19T07:11:03.229456+0000","last_undegraded":"2024-09-19T07:11:03.229456+0000","last_fullsized":"2024-09-19T07:11:03.229456+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:37:50.698597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.278229+0000","last_change":"2024-09-19T07:09:18.927713+0000","last_active":"2024-09-19T07:11:03.278229+0000","last_peered":"2024-09-19T07:11:03.278229+0000","last_clean":"2024-09-19T07:11:03.278229+0000","last_became_active":"2024-09-19T07:09:18.927430+0000","last_became_peered":"2024-09-19T07:09:18.927430+0000","last_unstale":"2024-09-19T07:11:03.278229+0000","last_undegraded":"2024-09-19T07:11:03.278229+0000","last_fullsized":"2024-09-19T07:11:03.278229+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:15:07.707723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.236756+0000","last_change":"2024-09-19T07:09:16.912391+0000","last_active":"2024-09-19T07:11:03.236756+0000","last_peered":"2024-09-19T07:11:03.236756+0000","last_clean":"2024-09-19T07:11:03.236756+0000","last_became_active":"2024-09-19T07:09:16.912034+0000","last_became_peered":"2024-09-19T07:09:16.912034+0000","last_unstale":"2024-09-19T07:11:03.236756+0000","last_undegraded":"2024-09-19T07:11:03.236756+0000","last_fullsized":"2024-09-19T07:11:03.236756+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:18:45.226107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.269888+0000","last_change":"2024-09-19T07:09:18.929476+0000","last_active":"2024-09-19T07:11:03.269888+0000","last_peered":"2024-09-19T07:11:03.269888+0000","last_clean":"2024-09-19T07:11:03.269888+0000","last_became_active":"2024-09-19T07:09:18.929183+0000","last_became_peered":"2024-09-19T07:09:18.929183+0000","last_unstale":"2024-09-19T07:11:03.269888+0000","last_undegraded":"2024-09-19T07:11:03.269888+0000","last_fullsized":"2024-09-19T07:11:03.269888+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:19:38.827130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":124,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.233366+0000","last_change":"2024-09-19T07:09:16.913012+0000","last_active":"2024-09-19T07:11:03.233366+0000","last_peered":"2024-09-19T07:11:03.233366+0000","last_clean":"2024-09-19T07:11:03.233366+0000","last_became_active":"2024-09-19T07:09:16.912633+0000","last_became_peered":"2024-09-19T07:09:16.912633+0000","last_unstale":"2024-09-19T07:11:03.233366+0000","last_undegraded":"2024-09-19T07:11:03.233366+0000","last_fullsized":"2024-09-19T07:11:03.233366+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:21:39.669961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":96,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.262229+0000","last_change":"2024-09-19T07:09:18.937323+0000","last_active":"2024-09-19T07:11:03.262229+0000","last_peered":"2024-09-19T07:11:03.262229+0000","last_clean":"2024-09-19T07:11:03.262229+0000","last_became_active":"2024-09-19T07:09:18.936762+0000","last_became_peered":"2024-09-19T07:09:18.936762+0000","last_unstale":"2024-09-19T07:11:03.262229+0000","last_undegraded":"2024-09-19T07:11:03.262229+0000","last_fullsized":"2024-09-19T07:11:03.262229+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:37.692290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.234308+0000","last_change":"2024-09-19T07:09:16.912167+0000","last_active":"2024-09-19T07:11:03.234308+0000","last_peered":"2024-09-19T07:11:03.234308+0000","last_clean":"2024-09-19T07:11:03.234308+0000","last_became_active":"2024-09-19T07:09:16.911840+0000","last_became_peered":"2024-09-19T07:09:16.911840+0000","last_unstale":"2024-09-19T07:11:03.234308+0000","last_undegraded":"2024-09-19T07:11:03.234308+0000","last_fullsized":"2024-09-19T07:11:03.234308+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:31.901906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.283235+0000","last_change":"2024-09-19T07:09:18.932239+0000","last_active":"2024-09-19T07:11:03.283235+0000","last_peered":"2024-09-19T07:11:03.283235+0000","last_clean":"2024-09-19T07:11:03.283235+0000","last_became_active":"2024-09-19T07:09:18.931820+0000","last_became_peered":"2024-09-19T07:09:18.931820+0000","last_unstale":"2024-09-19T07:11:03.283235+0000","last_undegraded":"2024-09-19T07:11:03.283235+0000","last_fullsized":"2024-09-19T07:11:03.283235+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:09.407524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.236809+0000","last_change":"2024-09-19T07:09:17.085077+0000","last_active":"2024-09-19T07:11:03.236809+0000","last_peered":"2024-09-19T07:11:03.236809+0000","last_clean":"2024-09-19T07:11:03.236809+0000","last_became_active":"2024-09-19T07:09:17.084457+0000","last_became_peered":"2024-09-19T07:09:17.084457+0000","last_unstale":"2024-09-19T07:11:03.236809+0000","last_undegraded":"2024-09-19T07:11:03.236809+0000","last_fullsized":"2024-09-19T07:11:03.236809+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:42.416193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.276315+0000","last_change":"2024-09-19T07:09:18.939830+0000","last_active":"2024-09-19T07:11:03.276315+0000","last_peered":"2024-09-19T07:11:03.276315+0000","last_clean":"2024-09-19T07:11:03.276315+0000","last_became_active":"2024-09-19T07:09:18.939359+0000","last_became_peered":"2024-09-19T07:09:18.939359+0000","last_unstale":"2024-09-19T07:11:03.276315+0000","last_undegraded":"2024-09-19T07:11:03.276315+0000","last_fullsized":"2024-09-19T07:11:03.276315+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:24:46.241902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'34","reported_seq":278,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.510608+0000","last_change":"2024-09-19T07:09:38.227707+0000","last_active":"2024-09-19T07:11:03.510608+0000","last_peered":"2024-09-19T07:11:03.510608+0000","last_clean":"2024-09-19T07:11:03.510608+0000","last_became_active":"2024-09-19T07:09:38.219073+0000","last_became_peered":"2024-09-19T07:09:38.219073+0000","last_unstale":"2024-09-19T07:11:03.510608+0000","last_undegraded":"2024-09-19T07:11:03.510608+0000","last_fullsized":"2024-09-19T07:11:03.510608+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:46.035315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66480,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":199,"num_read_kb":158,"num_write":35,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":26947,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.270480+0000","last_change":"2024-09-19T07:09:18.929531+0000","last_active":"2024-09-19T07:11:03.270480+0000","last_peered":"2024-09-19T07:11:03.270480+0000","last_clean":"2024-09-19T07:11:03.270480+0000","last_became_active":"2024-09-19T07:09:18.929253+0000","last_became_peered":"2024-09-19T07:09:18.929253+0000","last_unstale":"2024-09-19T07:11:03.270480+0000","last_undegraded":"2024-09-19T07:11:03.270480+0000","last_fullsized":"2024-09-19T07:11:03.270480+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:10.635116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.238624+0000","last_change":"2024-09-19T07:09:16.914964+0000","last_active":"2024-09-19T07:11:03.238624+0000","last_peered":"2024-09-19T07:11:03.238624+0000","last_clean":"2024-09-19T07:11:03.238624+0000","last_became_active":"2024-09-19T07:09:16.914540+0000","last_became_peered":"2024-09-19T07:09:16.914540+0000","last_unstale":"2024-09-19T07:11:03.238624+0000","last_undegraded":"2024-09-19T07:11:03.238624+0000","last_fullsized":"2024-09-19T07:11:03.238624+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:30.903046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.284691+0000","last_change":"2024-09-19T07:09:18.931709+0000","last_active":"2024-09-19T07:11:03.284691+0000","last_peered":"2024-09-19T07:11:03.284691+0000","last_clean":"2024-09-19T07:11:03.284691+0000","last_became_active":"2024-09-19T07:09:18.931345+0000","last_became_peered":"2024-09-19T07:09:18.931345+0000","last_unstale":"2024-09-19T07:11:03.284691+0000","last_undegraded":"2024-09-19T07:11:03.284691+0000","last_fullsized":"2024-09-19T07:11:03.284691+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:28.916820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.236617+0000","last_change":"2024-09-19T07:09:16.914055+0000","last_active":"2024-09-19T07:11:03.236617+0000","last_peered":"2024-09-19T07:11:03.236617+0000","last_clean":"2024-09-19T07:11:03.236617+0000","last_became_active":"2024-09-19T07:09:16.913589+0000","last_became_peered":"2024-09-19T07:09:16.913589+0000","last_unstale":"2024-09-19T07:11:03.236617+0000","last_undegraded":"2024-09-19T07:11:03.236617+0000","last_fullsized":"2024-09-19T07:11:03.236617+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:29:16.322059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"81'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.285962+0000","last_change":"2024-09-19T07:09:18.934879+0000","last_active":"2024-09-19T07:11:03.285962+0000","last_peered":"2024-09-19T07:11:03.285962+0000","last_clean":"2024-09-19T07:11:03.285962+0000","last_became_active":"2024-09-19T07:09:18.934432+0000","last_became_peered":"2024-09-19T07:09:18.934432+0000","last_unstale":"2024-09-19T07:11:03.285962+0000","last_undegraded":"2024-09-19T07:11:03.285962+0000","last_fullsized":"2024-09-19T07:11:03.285962+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:25.782782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'7","reported_seq":131,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:04.128586+0000","last_change":"2024-09-19T07:09:16.909256+0000","last_active":"2024-09-19T07:11:04.128586+0000","last_peered":"2024-09-19T07:11:04.128586+0000","last_clean":"2024-09-19T07:11:04.128586+0000","last_became_active":"2024-09-19T07:09:16.908932+0000","last_became_peered":"2024-09-19T07:09:16.908932+0000","last_unstale":"2024-09-19T07:11:04.128586+0000","last_undegraded":"2024-09-19T07:11:04.128586+0000","last_fullsized":"2024-09-19T07:11:04.128586+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:28.344756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1908,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":5,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.270197+0000","last_change":"2024-09-19T07:09:18.931844+0000","last_active":"2024-09-19T07:11:03.270197+0000","last_peered":"2024-09-19T07:11:03.270197+0000","last_clean":"2024-09-19T07:11:03.270197+0000","last_became_active":"2024-09-19T07:09:18.931516+0000","last_became_peered":"2024-09-19T07:09:18.931516+0000","last_unstale":"2024-09-19T07:11:03.270197+0000","last_undegraded":"2024-09-19T07:11:03.270197+0000","last_fullsized":"2024-09-19T07:11:03.270197+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:27:29.812144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.247165+0000","last_change":"2024-09-19T07:09:17.085252+0000","last_active":"2024-09-19T07:11:03.247165+0000","last_peered":"2024-09-19T07:11:03.247165+0000","last_clean":"2024-09-19T07:11:03.247165+0000","last_became_active":"2024-09-19T07:09:17.084907+0000","last_became_peered":"2024-09-19T07:09:17.084907+0000","last_unstale":"2024-09-19T07:11:03.247165+0000","last_undegraded":"2024-09-19T07:11:03.247165+0000","last_fullsized":"2024-09-19T07:11:03.247165+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:59:40.351181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.269674+0000","last_change":"2024-09-19T07:09:18.932491+0000","last_active":"2024-09-19T07:11:03.269674+0000","last_peered":"2024-09-19T07:11:03.269674+0000","last_clean":"2024-09-19T07:11:03.269674+0000","last_became_active":"2024-09-19T07:09:18.932159+0000","last_became_peered":"2024-09-19T07:09:18.932159+0000","last_unstale":"2024-09-19T07:11:03.269674+0000","last_undegraded":"2024-09-19T07:11:03.269674+0000","last_fullsized":"2024-09-19T07:11:03.269674+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:31.144130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'3","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.247568+0000","last_change":"2024-09-19T07:09:16.911012+0000","last_active":"2024-09-19T07:11:03.247568+0000","last_peered":"2024-09-19T07:11:03.247568+0000","last_clean":"2024-09-19T07:11:03.247568+0000","last_became_active":"2024-09-19T07:09:16.910618+0000","last_became_peered":"2024-09-19T07:09:16.910618+0000","last_unstale":"2024-09-19T07:11:03.247568+0000","last_undegraded":"2024-09-19T07:11:03.247568+0000","last_fullsized":"2024-09-19T07:11:03.247568+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:16.316680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"81'5","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.267441+0000","last_change":"2024-09-19T07:09:38.217870+0000","last_active":"2024-09-19T07:11:03.267441+0000","last_peered":"2024-09-19T07:11:03.267441+0000","last_clean":"2024-09-19T07:11:03.267441+0000","last_became_active":"2024-09-19T07:09:38.217585+0000","last_became_peered":"2024-09-19T07:09:38.217585+0000","last_unstale":"2024-09-19T07:11:03.267441+0000","last_undegraded":"2024-09-19T07:11:03.267441+0000","last_fullsized":"2024-09-19T07:11:03.267441+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:41.320705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.229695+0000","last_change":"2024-09-19T07:09:16.911644+0000","last_active":"2024-09-19T07:11:03.229695+0000","last_peered":"2024-09-19T07:11:03.229695+0000","last_clean":"2024-09-19T07:11:03.229695+0000","last_became_active":"2024-09-19T07:09:16.911368+0000","last_became_peered":"2024-09-19T07:09:16.911368+0000","last_unstale":"2024-09-19T07:11:03.229695+0000","last_undegraded":"2024-09-19T07:11:03.229695+0000","last_fullsized":"2024-09-19T07:11:03.229695+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:12.953466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.274357+0000","last_change":"2024-09-19T07:09:18.933667+0000","last_active":"2024-09-19T07:11:03.274357+0000","last_peered":"2024-09-19T07:11:03.274357+0000","last_clean":"2024-09-19T07:11:03.274357+0000","last_became_active":"2024-09-19T07:09:18.933288+0000","last_became_peered":"2024-09-19T07:09:18.933288+0000","last_unstale":"2024-09-19T07:11:03.274357+0000","last_undegraded":"2024-09-19T07:11:03.274357+0000","last_fullsized":"2024-09-19T07:11:03.274357+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:54:38.127799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'39","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.462058+0000","last_change":"2024-09-19T07:09:16.909722+0000","last_active":"2024-09-19T07:11:03.462058+0000","last_peered":"2024-09-19T07:11:03.462058+0000","last_clean":"2024-09-19T07:11:03.462058+0000","last_became_active":"2024-09-19T07:09:16.909394+0000","last_became_peered":"2024-09-19T07:09:16.909394+0000","last_unstale":"2024-09-19T07:11:03.462058+0000","last_undegraded":"2024-09-19T07:11:03.462058+0000","last_fullsized":"2024-09-19T07:11:03.462058+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:21:53.342710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.269158+0000","last_change":"2024-09-19T07:09:18.929473+0000","last_active":"2024-09-19T07:11:03.269158+0000","last_peered":"2024-09-19T07:11:03.269158+0000","last_clean":"2024-09-19T07:11:03.269158+0000","last_became_active":"2024-09-19T07:09:18.929176+0000","last_became_peered":"2024-09-19T07:09:18.929176+0000","last_unstale":"2024-09-19T07:11:03.269158+0000","last_undegraded":"2024-09-19T07:11:03.269158+0000","last_fullsized":"2024-09-19T07:11:03.269158+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:32:30.409528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.238675+0000","last_change":"2024-09-19T07:09:17.084868+0000","last_active":"2024-09-19T07:11:03.238675+0000","last_peered":"2024-09-19T07:11:03.238675+0000","last_clean":"2024-09-19T07:11:03.238675+0000","last_became_active":"2024-09-19T07:09:17.084448+0000","last_became_peered":"2024-09-19T07:09:17.084448+0000","last_unstale":"2024-09-19T07:11:03.238675+0000","last_undegraded":"2024-09-19T07:11:03.238675+0000","last_fullsized":"2024-09-19T07:11:03.238675+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:38.211697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.276801+0000","last_change":"2024-09-19T07:09:18.938865+0000","last_active":"2024-09-19T07:11:03.276801+0000","last_peered":"2024-09-19T07:11:03.276801+0000","last_clean":"2024-09-19T07:11:03.276801+0000","last_became_active":"2024-09-19T07:09:18.936324+0000","last_became_peered":"2024-09-19T07:09:18.936324+0000","last_unstale":"2024-09-19T07:11:03.276801+0000","last_undegraded":"2024-09-19T07:11:03.276801+0000","last_fullsized":"2024-09-19T07:11:03.276801+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:29:51.081140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":345,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.234069+0000","last_change":"2024-09-19T07:08:09.270850+0000","last_active":"2024-09-19T07:11:03.234069+0000","last_peered":"2024-09-19T07:11:03.234069+0000","last_clean":"2024-09-19T07:11:03.234069+0000","last_became_active":"2024-09-19T07:08:09.270308+0000","last_became_peered":"2024-09-19T07:08:09.270308+0000","last_unstale":"2024-09-19T07:11:03.234069+0000","last_undegraded":"2024-09-19T07:11:03.234069+0000","last_fullsized":"2024-09-19T07:11:03.234069+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:04:49.729632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:04:49.729632+0000","last_clean_scrub_stamp":"2024-09-19T07:04:49.729632+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:15.588732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.231213+0000","last_change":"2024-09-19T07:09:16.907648+0000","last_active":"2024-09-19T07:11:03.231213+0000","last_peered":"2024-09-19T07:11:03.231213+0000","last_clean":"2024-09-19T07:11:03.231213+0000","last_became_active":"2024-09-19T07:09:16.907363+0000","last_became_peered":"2024-09-19T07:09:16.907363+0000","last_unstale":"2024-09-19T07:11:03.231213+0000","last_undegraded":"2024-09-19T07:11:03.231213+0000","last_fullsized":"2024-09-19T07:11:03.231213+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:12:27.898493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.275674+0000","last_change":"2024-09-19T07:09:18.926008+0000","last_active":"2024-09-19T07:11:03.275674+0000","last_peered":"2024-09-19T07:11:03.275674+0000","last_clean":"2024-09-19T07:11:03.275674+0000","last_became_active":"2024-09-19T07:09:18.925689+0000","last_became_peered":"2024-09-19T07:09:18.925689+0000","last_unstale":"2024-09-19T07:11:03.275674+0000","last_undegraded":"2024-09-19T07:11:03.275674+0000","last_fullsized":"2024-09-19T07:11:03.275674+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:16:06.467934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.233965+0000","last_change":"2024-09-19T07:09:16.911327+0000","last_active":"2024-09-19T07:11:03.233965+0000","last_peered":"2024-09-19T07:11:03.233965+0000","last_clean":"2024-09-19T07:11:03.233965+0000","last_became_active":"2024-09-19T07:09:16.911031+0000","last_became_peered":"2024-09-19T07:09:16.911031+0000","last_unstale":"2024-09-19T07:11:03.233965+0000","last_undegraded":"2024-09-19T07:11:03.233965+0000","last_fullsized":"2024-09-19T07:11:03.233965+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:03.307119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.280334+0000","last_change":"2024-09-19T07:09:18.933813+0000","last_active":"2024-09-19T07:11:03.280334+0000","last_peered":"2024-09-19T07:11:03.280334+0000","last_clean":"2024-09-19T07:11:03.280334+0000","last_became_active":"2024-09-19T07:09:18.933475+0000","last_became_peered":"2024-09-19T07:09:18.933475+0000","last_unstale":"2024-09-19T07:11:03.280334+0000","last_undegraded":"2024-09-19T07:11:03.280334+0000","last_fullsized":"2024-09-19T07:11:03.280334+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:34:09.149593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.231831+0000","last_change":"2024-09-19T07:09:17.084833+0000","last_active":"2024-09-19T07:11:03.231831+0000","last_peered":"2024-09-19T07:11:03.231831+0000","last_clean":"2024-09-19T07:11:03.231831+0000","last_became_active":"2024-09-19T07:09:17.084477+0000","last_became_peered":"2024-09-19T07:09:17.084477+0000","last_unstale":"2024-09-19T07:11:03.231831+0000","last_undegraded":"2024-09-19T07:11:03.231831+0000","last_fullsized":"2024-09-19T07:11:03.231831+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:17:50.962480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":96,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.281019+0000","last_change":"2024-09-19T07:09:18.935991+0000","last_active":"2024-09-19T07:11:03.281019+0000","last_peered":"2024-09-19T07:11:03.281019+0000","last_clean":"2024-09-19T07:11:03.281019+0000","last_became_active":"2024-09-19T07:09:18.935677+0000","last_became_peered":"2024-09-19T07:09:18.935677+0000","last_unstale":"2024-09-19T07:11:03.281019+0000","last_undegraded":"2024-09-19T07:11:03.281019+0000","last_fullsized":"2024-09-19T07:11:03.281019+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:45.550119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.234872+0000","last_change":"2024-09-19T07:09:16.911755+0000","last_active":"2024-09-19T07:11:03.234872+0000","last_peered":"2024-09-19T07:11:03.234872+0000","last_clean":"2024-09-19T07:11:03.234872+0000","last_became_active":"2024-09-19T07:09:16.911211+0000","last_became_peered":"2024-09-19T07:09:16.911211+0000","last_unstale":"2024-09-19T07:11:03.234872+0000","last_undegraded":"2024-09-19T07:11:03.234872+0000","last_fullsized":"2024-09-19T07:11:03.234872+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:15.365423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.265945+0000","last_change":"2024-09-19T07:09:18.940282+0000","last_active":"2024-09-19T07:11:03.265945+0000","last_peered":"2024-09-19T07:11:03.265945+0000","last_clean":"2024-09-19T07:11:03.265945+0000","last_became_active":"2024-09-19T07:09:18.939918+0000","last_became_peered":"2024-09-19T07:09:18.939918+0000","last_unstale":"2024-09-19T07:11:03.265945+0000","last_undegraded":"2024-09-19T07:11:03.265945+0000","last_fullsized":"2024-09-19T07:11:03.265945+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:11.161676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.242639+0000","last_change":"2024-09-19T07:09:17.086103+0000","last_active":"2024-09-19T07:11:03.242639+0000","last_peered":"2024-09-19T07:11:03.242639+0000","last_clean":"2024-09-19T07:11:03.242639+0000","last_became_active":"2024-09-19T07:09:17.085805+0000","last_became_peered":"2024-09-19T07:09:17.085805+0000","last_unstale":"2024-09-19T07:11:03.242639+0000","last_undegraded":"2024-09-19T07:11:03.242639+0000","last_fullsized":"2024-09-19T07:11:03.242639+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:28.522487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.284777+0000","last_change":"2024-09-19T07:09:18.932603+0000","last_active":"2024-09-19T07:11:03.284777+0000","last_peered":"2024-09-19T07:11:03.284777+0000","last_clean":"2024-09-19T07:11:03.284777+0000","last_became_active":"2024-09-19T07:09:18.932309+0000","last_became_peered":"2024-09-19T07:09:18.932309+0000","last_unstale":"2024-09-19T07:11:03.284777+0000","last_undegraded":"2024-09-19T07:11:03.284777+0000","last_fullsized":"2024-09-19T07:11:03.284777+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:19.746024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.245199+0000","last_change":"2024-09-19T07:09:17.085287+0000","last_active":"2024-09-19T07:11:03.245199+0000","last_peered":"2024-09-19T07:11:03.245199+0000","last_clean":"2024-09-19T07:11:03.245199+0000","last_became_active":"2024-09-19T07:09:17.084964+0000","last_became_peered":"2024-09-19T07:09:17.084964+0000","last_unstale":"2024-09-19T07:11:03.245199+0000","last_undegraded":"2024-09-19T07:11:03.245199+0000","last_fullsized":"2024-09-19T07:11:03.245199+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:51:01.035344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.287453+0000","last_change":"2024-09-19T07:09:18.921623+0000","last_active":"2024-09-19T07:11:03.287453+0000","last_peered":"2024-09-19T07:11:03.287453+0000","last_clean":"2024-09-19T07:11:03.287453+0000","last_became_active":"2024-09-19T07:09:18.921321+0000","last_became_peered":"2024-09-19T07:09:18.921321+0000","last_unstale":"2024-09-19T07:11:03.287453+0000","last_undegraded":"2024-09-19T07:11:03.287453+0000","last_fullsized":"2024-09-19T07:11:03.287453+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:28:55.616889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'47","reported_seq":94,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.468956+0000","last_change":"2024-09-19T07:09:16.910251+0000","last_active":"2024-09-19T07:11:03.468956+0000","last_peered":"2024-09-19T07:11:03.468956+0000","last_clean":"2024-09-19T07:11:03.468956+0000","last_became_active":"2024-09-19T07:09:16.909821+0000","last_became_peered":"2024-09-19T07:09:16.909821+0000","last_unstale":"2024-09-19T07:11:03.468956+0000","last_undegraded":"2024-09-19T07:11:03.468956+0000","last_fullsized":"2024-09-19T07:11:03.468956+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:02.958557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":86,"num_write_kb":839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.268601+0000","last_change":"2024-09-19T07:09:18.930831+0000","last_active":"2024-09-19T07:11:03.268601+0000","last_peered":"2024-09-19T07:11:03.268601+0000","last_clean":"2024-09-19T07:11:03.268601+0000","last_became_active":"2024-09-19T07:09:18.930475+0000","last_became_peered":"2024-09-19T07:09:18.930475+0000","last_unstale":"2024-09-19T07:11:03.268601+0000","last_undegraded":"2024-09-19T07:11:03.268601+0000","last_fullsized":"2024-09-19T07:11:03.268601+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:30.512246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.231362+0000","last_change":"2024-09-19T07:09:16.906666+0000","last_active":"2024-09-19T07:11:03.231362+0000","last_peered":"2024-09-19T07:11:03.231362+0000","last_clean":"2024-09-19T07:11:03.231362+0000","last_became_active":"2024-09-19T07:09:16.906369+0000","last_became_peered":"2024-09-19T07:09:16.906369+0000","last_unstale":"2024-09-19T07:11:03.231362+0000","last_undegraded":"2024-09-19T07:11:03.231362+0000","last_fullsized":"2024-09-19T07:11:03.231362+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:56.915089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.280797+0000","last_change":"2024-09-19T07:09:18.934942+0000","last_active":"2024-09-19T07:11:03.280797+0000","last_peered":"2024-09-19T07:11:03.280797+0000","last_clean":"2024-09-19T07:11:03.280797+0000","last_became_active":"2024-09-19T07:09:18.934595+0000","last_became_peered":"2024-09-19T07:09:18.934595+0000","last_unstale":"2024-09-19T07:11:03.280797+0000","last_undegraded":"2024-09-19T07:11:03.280797+0000","last_fullsized":"2024-09-19T07:11:03.280797+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:54.306541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.239116+0000","last_change":"2024-09-19T07:09:38.183567+0000","last_active":"2024-09-19T07:11:03.239116+0000","last_peered":"2024-09-19T07:11:03.239116+0000","last_clean":"2024-09-19T07:11:03.239116+0000","last_became_active":"2024-09-19T07:09:38.180778+0000","last_became_peered":"2024-09-19T07:09:38.180778+0000","last_unstale":"2024-09-19T07:11:03.239116+0000","last_undegraded":"2024-09-19T07:11:03.239116+0000","last_fullsized":"2024-09-19T07:11:03.239116+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:43.226551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"81'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.260607+0000","last_change":"2024-09-19T07:09:18.934457+0000","last_active":"2024-09-19T07:11:03.260607+0000","last_peered":"2024-09-19T07:11:03.260607+0000","last_clean":"2024-09-19T07:11:03.260607+0000","last_became_active":"2024-09-19T07:09:18.934126+0000","last_became_peered":"2024-09-19T07:09:18.934126+0000","last_unstale":"2024-09-19T07:11:03.260607+0000","last_undegraded":"2024-09-19T07:11:03.260607+0000","last_fullsized":"2024-09-19T07:11:03.260607+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:37:16.152335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.231606+0000","last_change":"2024-09-19T07:09:16.908457+0000","last_active":"2024-09-19T07:11:03.231606+0000","last_peered":"2024-09-19T07:11:03.231606+0000","last_clean":"2024-09-19T07:11:03.231606+0000","last_became_active":"2024-09-19T07:09:16.908128+0000","last_became_peered":"2024-09-19T07:09:16.908128+0000","last_unstale":"2024-09-19T07:11:03.231606+0000","last_undegraded":"2024-09-19T07:11:03.231606+0000","last_fullsized":"2024-09-19T07:11:03.231606+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:48:50.579301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.273932+0000","last_change":"2024-09-19T07:09:18.928763+0000","last_active":"2024-09-19T07:11:03.273932+0000","last_peered":"2024-09-19T07:11:03.273932+0000","last_clean":"2024-09-19T07:11:03.273932+0000","last_became_active":"2024-09-19T07:09:18.928231+0000","last_became_peered":"2024-09-19T07:09:18.928231+0000","last_unstale":"2024-09-19T07:11:03.273932+0000","last_undegraded":"2024-09-19T07:11:03.273932+0000","last_fullsized":"2024-09-19T07:11:03.273932+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:26.652378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.238773+0000","last_change":"2024-09-19T07:09:16.913740+0000","last_active":"2024-09-19T07:11:03.238773+0000","last_peered":"2024-09-19T07:11:03.238773+0000","last_clean":"2024-09-19T07:11:03.238773+0000","last_became_active":"2024-09-19T07:09:16.912419+0000","last_became_peered":"2024-09-19T07:09:16.912419+0000","last_unstale":"2024-09-19T07:11:03.238773+0000","last_undegraded":"2024-09-19T07:11:03.238773+0000","last_fullsized":"2024-09-19T07:11:03.238773+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:16.658996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.283782+0000","last_change":"2024-09-19T07:09:18.930697+0000","last_active":"2024-09-19T07:11:03.283782+0000","last_peered":"2024-09-19T07:11:03.283782+0000","last_clean":"2024-09-19T07:11:03.283782+0000","last_became_active":"2024-09-19T07:09:18.930355+0000","last_became_peered":"2024-09-19T07:09:18.930355+0000","last_unstale":"2024-09-19T07:11:03.283782+0000","last_undegraded":"2024-09-19T07:11:03.283782+0000","last_fullsized":"2024-09-19T07:11:03.283782+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:07.217195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.228781+0000","last_change":"2024-09-19T07:09:38.183637+0000","last_active":"2024-09-19T07:11:03.228781+0000","last_peered":"2024-09-19T07:11:03.228781+0000","last_clean":"2024-09-19T07:11:03.228781+0000","last_became_active":"2024-09-19T07:09:38.178732+0000","last_became_peered":"2024-09-19T07:09:38.178732+0000","last_unstale":"2024-09-19T07:11:03.228781+0000","last_undegraded":"2024-09-19T07:11:03.228781+0000","last_fullsized":"2024-09-19T07:11:03.228781+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:14.287130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.285232+0000","last_change":"2024-09-19T07:09:18.935120+0000","last_active":"2024-09-19T07:11:03.285232+0000","last_peered":"2024-09-19T07:11:03.285232+0000","last_clean":"2024-09-19T07:11:03.285232+0000","last_became_active":"2024-09-19T07:09:18.934227+0000","last_became_peered":"2024-09-19T07:09:18.934227+0000","last_unstale":"2024-09-19T07:11:03.285232+0000","last_undegraded":"2024-09-19T07:11:03.285232+0000","last_fullsized":"2024-09-19T07:11:03.285232+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:20.328983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"81'15","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.278695+0000","last_change":"2024-09-19T07:09:38.393512+0000","last_active":"2024-09-19T07:11:03.278695+0000","last_peered":"2024-09-19T07:11:03.278695+0000","last_clean":"2024-09-19T07:11:03.278695+0000","last_became_active":"2024-09-19T07:09:38.393200+0000","last_became_peered":"2024-09-19T07:09:38.393200+0000","last_unstale":"2024-09-19T07:11:03.278695+0000","last_undegraded":"2024-09-19T07:11:03.278695+0000","last_fullsized":"2024-09-19T07:11:03.278695+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:51.637520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.247033+0000","last_change":"2024-09-19T07:09:16.911129+0000","last_active":"2024-09-19T07:11:03.247033+0000","last_peered":"2024-09-19T07:11:03.247033+0000","last_clean":"2024-09-19T07:11:03.247033+0000","last_became_active":"2024-09-19T07:09:16.910583+0000","last_became_peered":"2024-09-19T07:09:16.910583+0000","last_unstale":"2024-09-19T07:11:03.247033+0000","last_undegraded":"2024-09-19T07:11:03.247033+0000","last_fullsized":"2024-09-19T07:11:03.247033+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:34:37.295838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.285042+0000","last_change":"2024-09-19T07:09:18.928622+0000","last_active":"2024-09-19T07:11:03.285042+0000","last_peered":"2024-09-19T07:11:03.285042+0000","last_clean":"2024-09-19T07:11:03.285042+0000","last_became_active":"2024-09-19T07:09:18.928284+0000","last_became_peered":"2024-09-19T07:09:18.928284+0000","last_unstale":"2024-09-19T07:11:03.285042+0000","last_undegraded":"2024-09-19T07:11:03.285042+0000","last_fullsized":"2024-09-19T07:11:03.285042+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:37:46.358756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.245062+0000","last_change":"2024-09-19T07:09:16.916142+0000","last_active":"2024-09-19T07:11:03.245062+0000","last_peered":"2024-09-19T07:11:03.245062+0000","last_clean":"2024-09-19T07:11:03.245062+0000","last_became_active":"2024-09-19T07:09:16.915766+0000","last_became_peered":"2024-09-19T07:09:16.915766+0000","last_unstale":"2024-09-19T07:11:03.245062+0000","last_undegraded":"2024-09-19T07:11:03.245062+0000","last_fullsized":"2024-09-19T07:11:03.245062+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:38.136422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.285015+0000","last_change":"2024-09-19T07:09:18.921912+0000","last_active":"2024-09-19T07:11:03.285015+0000","last_peered":"2024-09-19T07:11:03.285015+0000","last_clean":"2024-09-19T07:11:03.285015+0000","last_became_active":"2024-09-19T07:09:18.921595+0000","last_became_peered":"2024-09-19T07:09:18.921595+0000","last_unstale":"2024-09-19T07:11:03.285015+0000","last_undegraded":"2024-09-19T07:11:03.285015+0000","last_fullsized":"2024-09-19T07:11:03.285015+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:53.899052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.232279+0000","last_change":"2024-09-19T07:09:17.084856+0000","last_active":"2024-09-19T07:11:03.232279+0000","last_peered":"2024-09-19T07:11:03.232279+0000","last_clean":"2024-09-19T07:11:03.232279+0000","last_became_active":"2024-09-19T07:09:17.084541+0000","last_became_peered":"2024-09-19T07:09:17.084541+0000","last_unstale":"2024-09-19T07:11:03.232279+0000","last_undegraded":"2024-09-19T07:11:03.232279+0000","last_fullsized":"2024-09-19T07:11:03.232279+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:05.978765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.274355+0000","last_change":"2024-09-19T07:09:18.923732+0000","last_active":"2024-09-19T07:11:03.274355+0000","last_peered":"2024-09-19T07:11:03.274355+0000","last_clean":"2024-09-19T07:11:03.274355+0000","last_became_active":"2024-09-19T07:09:18.923410+0000","last_became_peered":"2024-09-19T07:09:18.923410+0000","last_unstale":"2024-09-19T07:11:03.274355+0000","last_undegraded":"2024-09-19T07:11:03.274355+0000","last_fullsized":"2024-09-19T07:11:03.274355+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:01:20.208414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.242373+0000","last_change":"2024-09-19T07:09:16.910364+0000","last_active":"2024-09-19T07:11:03.242373+0000","last_peered":"2024-09-19T07:11:03.242373+0000","last_clean":"2024-09-19T07:11:03.242373+0000","last_became_active":"2024-09-19T07:09:16.909835+0000","last_became_peered":"2024-09-19T07:09:16.909835+0000","last_unstale":"2024-09-19T07:11:03.242373+0000","last_undegraded":"2024-09-19T07:11:03.242373+0000","last_fullsized":"2024-09-19T07:11:03.242373+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:05.198823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":597854,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":696,"num_read_kb":450,"num_write":294,"num_write_kb":1439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":26947,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2027520,"data_stored":1793562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645346,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":892928,"data_stored":437435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,0,5,4,14,28],"upper_bound":64},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874278,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32936,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712216,"statfs":{"total":95995035648,"available":95961309184,"internally_reserved":0,"allocated":1732608,"data_stored":1228316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037804,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32460,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712692,"statfs":{"total":95995035648,"available":95961796608,"internally_reserved":0,"allocated":1302528,"data_stored":830887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266736,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36428,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708724,"statfs":{"total":95995035648,"available":95957733376,"internally_reserved":0,"allocated":1105920,"data_stored":634199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495669,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32656,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712496,"statfs":{"total":95995035648,"available":95961595904,"internally_reserved":0,"allocated":1503232,"data_stored":1032078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659195,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":897024,"data_stored":437060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888127,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32796,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712356,"statfs":{"total":95995035648,"available":95961452544,"internally_reserved":0,"allocated":1650688,"data_stored":1162042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018948,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":974848,"data_stored":503725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247881,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":913408,"data_stored":437371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444110,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":439831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607635,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":958464,"data_stored":497098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":917504,"data_stored":438331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":544768,"data_stored":525100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":134704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":4740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":393954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":200978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T07:11:08.073 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T07:11:08.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.208+0000 7f6286a1e640 1 -- 172.21.15.148:0/3598703196 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6280101aa0 msgr2=0x7f6280101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:08.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.208+0000 7f6286a1e640 1 --2- 172.21.15.148:0/3598703196 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6280101aa0 0x7f6280101f00 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6274009930 tx=0x7f627402a420 comp rx=0 tx=0).stop 2024-09-19T07:11:08.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.208+0000 7f6286a1e640 1 -- 172.21.15.148:0/3598703196 shutdown_connections 2024-09-19T07:11:08.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.208+0000 7f6286a1e640 1 --2- 172.21.15.148:0/3598703196 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6280102440 0x7f628010e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:08.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.208+0000 7f6286a1e640 1 --2- 172.21.15.148:0/3598703196 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6280101aa0 0x7f6280101f00 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:08.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.208+0000 7f6286a1e640 1 --2- 172.21.15.148:0/3598703196 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6280107ab0 0x7f6280107e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:08.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.208+0000 7f6286a1e640 1 -- 172.21.15.148:0/3598703196 >> 172.21.15.148:0/3598703196 conn(0x7f62800fd7c0 msgr2=0x7f62800ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:08.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.208+0000 7f6286a1e640 1 -- 172.21.15.148:0/3598703196 shutdown_connections 2024-09-19T07:11:08.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.208+0000 7f6286a1e640 1 -- 172.21.15.148:0/3598703196 wait complete. 2024-09-19T07:11:08.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.209+0000 7f6286a1e640 1 Processor -- start 2024-09-19T07:11:08.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.209+0000 7f6286a1e640 1 -- start start 2024-09-19T07:11:08.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.209+0000 7f6286a1e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6280101aa0 0x7f62800744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:08.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.209+0000 7f6286a1e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6280102440 0x7f6280074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:08.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.209+0000 7f6286a1e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6280107ab0 0x7f6280074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:08.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.209+0000 7f6286a1e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6280111eb0 con 0x7f6280102440 2024-09-19T07:11:08.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.209+0000 7f6286a1e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6280111d30 con 0x7f6280107ab0 2024-09-19T07:11:08.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.209+0000 7f6286a1e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6280112030 con 0x7f6280101aa0 2024-09-19T07:11:08.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.209+0000 7f627f7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6280102440 0x7f6280074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:08.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.209+0000 7f627f7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6280102440 0x7f6280074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60762/0 (socket says 172.21.15.148:60762) 2024-09-19T07:11:08.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.209+0000 7f627f7fe640 1 -- 172.21.15.148:0/298123417 learned_addr learned my addr 172.21.15.148:0/298123417 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:08.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.209+0000 7f6284fbb640 1 --2- 172.21.15.148:0/298123417 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6280107ab0 0x7f6280074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:08.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.210+0000 7f627f7fe640 1 -- 172.21.15.148:0/298123417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6280101aa0 msgr2=0x7f62800744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:08.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.210+0000 7f627ffff640 1 --2- 172.21.15.148:0/298123417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6280101aa0 0x7f62800744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:08.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.210+0000 7f627f7fe640 1 --2- 172.21.15.148:0/298123417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6280101aa0 0x7f62800744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:08.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.210+0000 7f627f7fe640 1 -- 172.21.15.148:0/298123417 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6280107ab0 msgr2=0x7f6280074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:08.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.210+0000 7f627f7fe640 1 --2- 172.21.15.148:0/298123417 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6280107ab0 0x7f6280074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:08.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.210+0000 7f627f7fe640 1 -- 172.21.15.148:0/298123417 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62801a68e0 con 0x7f6280102440 2024-09-19T07:11:08.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.210+0000 7f627f7fe640 1 --2- 172.21.15.148:0/298123417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6280102440 0x7f6280074a30 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f6274009230 tx=0x7f6274004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:08.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.210+0000 7f627d7fa640 1 -- 172.21.15.148:0/298123417 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f627403f030 con 0x7f6280102440 2024-09-19T07:11:08.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.210+0000 7f627d7fa640 1 -- 172.21.15.148:0/298123417 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6274003ad0 con 0x7f6280102440 2024-09-19T07:11:08.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.210+0000 7f627d7fa640 1 -- 172.21.15.148:0/298123417 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6274035070 con 0x7f6280102440 2024-09-19T07:11:08.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.210+0000 7f6286a1e640 1 -- 172.21.15.148:0/298123417 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62801a6b70 con 0x7f6280102440 2024-09-19T07:11:08.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.210+0000 7f6286a1e640 1 -- 172.21.15.148:0/298123417 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62801a70b0 con 0x7f6280102440 2024-09-19T07:11:08.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.211+0000 7f6286a1e640 1 -- 172.21.15.148:0/298123417 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6280101f00 con 0x7f6280102440 2024-09-19T07:11:08.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.212+0000 7f627d7fa640 1 -- 172.21.15.148:0/298123417 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 22) ==== 138476+0+0 (secure 0 0 0) 0x7f6274042030 con 0x7f6280102440 2024-09-19T07:11:08.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.213+0000 7f627d7fa640 1 --2- 172.21.15.148:0/298123417 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f62680a3440 0x7f62680a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:08.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.213+0000 7f627d7fa640 1 -- 172.21.15.148:0/298123417 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f62740f0560 con 0x7f6280102440 2024-09-19T07:11:08.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.213+0000 7f627ffff640 1 --2- 172.21.15.148:0/298123417 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f62680a3440 0x7f62680a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:08.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.213+0000 7f627ffff640 1 --2- 172.21.15.148:0/298123417 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f62680a3440 0x7f62680a5900 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f62700099e0 tx=0x7f6270005ed0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:08.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.216+0000 7f627d7fa640 1 -- 172.21.15.148:0/298123417 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f62740bcf50 con 0x7f6280102440 2024-09-19T07:11:08.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.235+0000 7f627d7fa640 1 -- 172.21.15.148:0/298123417 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f6274003c80 con 0x7f6280102440 2024-09-19T07:11:08.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.387+0000 7f6286a1e640 1 -- 172.21.15.148:0/298123417 --> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6280062630 con 0x7f62680a3440 2024-09-19T07:11:08.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.393+0000 7f627d7fa640 1 -- 172.21.15.148:0/298123417 <== mgr.15123 v2:172.21.15.148:6800/3902535850 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257894 (secure 0 0 0) 0x7f6280062630 con 0x7f62680a3440 2024-09-19T07:11:08.396 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:11:08.398 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2024-09-19T07:11:08.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.396+0000 7f6286a1e640 1 -- 172.21.15.148:0/298123417 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f62680a3440 msgr2=0x7f62680a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:08.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.396+0000 7f6286a1e640 1 --2- 172.21.15.148:0/298123417 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f62680a3440 0x7f62680a5900 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f62700099e0 tx=0x7f6270005ed0 comp rx=0 tx=0).stop 2024-09-19T07:11:08.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.396+0000 7f6286a1e640 1 -- 172.21.15.148:0/298123417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6280102440 msgr2=0x7f6280074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:08.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.396+0000 7f6286a1e640 1 --2- 172.21.15.148:0/298123417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6280102440 0x7f6280074a30 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f6274009230 tx=0x7f6274004270 comp rx=0 tx=0).stop 2024-09-19T07:11:08.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.396+0000 7f6286a1e640 1 -- 172.21.15.148:0/298123417 shutdown_connections 2024-09-19T07:11:08.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.396+0000 7f6286a1e640 1 --2- 172.21.15.148:0/298123417 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f62680a3440 0x7f62680a5900 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:08.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.396+0000 7f6286a1e640 1 --2- 172.21.15.148:0/298123417 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6280107ab0 0x7f6280074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:08.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.396+0000 7f6286a1e640 1 --2- 172.21.15.148:0/298123417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6280102440 0x7f6280074a30 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:08.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.396+0000 7f6286a1e640 1 --2- 172.21.15.148:0/298123417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6280101aa0 0x7f62800744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:08.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.396+0000 7f6286a1e640 1 -- 172.21.15.148:0/298123417 >> 172.21.15.148:0/298123417 conn(0x7f62800fd7c0 msgr2=0x7f62800fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:08.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.396+0000 7f6286a1e640 1 -- 172.21.15.148:0/298123417 shutdown_connections 2024-09-19T07:11:08.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.396+0000 7f6286a1e640 1 -- 172.21.15.148:0/298123417 wait complete. 2024-09-19T07:11:08.408 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-09-19T07:11:07.248743+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1188456,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":832,"num_read_kb":569,"num_write":477,"num_write_kb":4379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1207683,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":868,"ondisk_log_size":868,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":387744,"kb_used_data":13440,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124554080,"statfs":{"total":1151940427776,"available":1151543377920,"internally_reserved":0,"allocated":13762560,"data_stored":8078373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":382973242},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,0,5,4,14,28],"upper_bound":64},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.996340"},"pg_stats":[{"pgid":"3.3f","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.279425+0000","last_change":"2024-09-19T07:09:18.926902+0000","last_active":"2024-09-19T07:11:03.279425+0000","last_peered":"2024-09-19T07:11:03.279425+0000","last_clean":"2024-09-19T07:11:03.279425+0000","last_became_active":"2024-09-19T07:09:18.926582+0000","last_became_peered":"2024-09-19T07:09:18.926582+0000","last_unstale":"2024-09-19T07:11:03.279425+0000","last_undegraded":"2024-09-19T07:11:03.279425+0000","last_fullsized":"2024-09-19T07:11:03.279425+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:37.875779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.283851+0000","last_change":"2024-09-19T07:09:18.934205+0000","last_active":"2024-09-19T07:11:03.283851+0000","last_peered":"2024-09-19T07:11:03.283851+0000","last_clean":"2024-09-19T07:11:03.283851+0000","last_became_active":"2024-09-19T07:09:18.933767+0000","last_became_peered":"2024-09-19T07:09:18.933767+0000","last_unstale":"2024-09-19T07:11:03.283851+0000","last_undegraded":"2024-09-19T07:11:03.283851+0000","last_fullsized":"2024-09-19T07:11:03.283851+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:10:45.391428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.284092+0000","last_change":"2024-09-19T07:09:18.922312+0000","last_active":"2024-09-19T07:11:03.284092+0000","last_peered":"2024-09-19T07:11:03.284092+0000","last_clean":"2024-09-19T07:11:03.284092+0000","last_became_active":"2024-09-19T07:09:18.921476+0000","last_became_peered":"2024-09-19T07:09:18.921476+0000","last_unstale":"2024-09-19T07:11:03.284092+0000","last_undegraded":"2024-09-19T07:11:03.284092+0000","last_fullsized":"2024-09-19T07:11:03.284092+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:29.470616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.269605+0000","last_change":"2024-09-19T07:09:18.938218+0000","last_active":"2024-09-19T07:11:03.269605+0000","last_peered":"2024-09-19T07:11:03.269605+0000","last_clean":"2024-09-19T07:11:03.269605+0000","last_became_active":"2024-09-19T07:09:18.937306+0000","last_became_peered":"2024-09-19T07:09:18.937306+0000","last_unstale":"2024-09-19T07:11:03.269605+0000","last_undegraded":"2024-09-19T07:11:03.269605+0000","last_fullsized":"2024-09-19T07:11:03.269605+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:54.146506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.274574+0000","last_change":"2024-09-19T07:09:18.925837+0000","last_active":"2024-09-19T07:11:03.274574+0000","last_peered":"2024-09-19T07:11:03.274574+0000","last_clean":"2024-09-19T07:11:03.274574+0000","last_became_active":"2024-09-19T07:09:18.925559+0000","last_became_peered":"2024-09-19T07:09:18.925559+0000","last_unstale":"2024-09-19T07:11:03.274574+0000","last_undegraded":"2024-09-19T07:11:03.274574+0000","last_fullsized":"2024-09-19T07:11:03.274574+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:15:58.348347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.267010+0000","last_change":"2024-09-19T07:09:18.938911+0000","last_active":"2024-09-19T07:11:03.267010+0000","last_peered":"2024-09-19T07:11:03.267010+0000","last_clean":"2024-09-19T07:11:03.267010+0000","last_became_active":"2024-09-19T07:09:18.938601+0000","last_became_peered":"2024-09-19T07:09:18.938601+0000","last_unstale":"2024-09-19T07:11:03.267010+0000","last_undegraded":"2024-09-19T07:11:03.267010+0000","last_fullsized":"2024-09-19T07:11:03.267010+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:34.517324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.274002+0000","last_change":"2024-09-19T07:09:18.930253+0000","last_active":"2024-09-19T07:11:03.274002+0000","last_peered":"2024-09-19T07:11:03.274002+0000","last_clean":"2024-09-19T07:11:03.274002+0000","last_became_active":"2024-09-19T07:09:18.929927+0000","last_became_peered":"2024-09-19T07:09:18.929927+0000","last_unstale":"2024-09-19T07:11:03.274002+0000","last_undegraded":"2024-09-19T07:11:03.274002+0000","last_fullsized":"2024-09-19T07:11:03.274002+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:31:39.186230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"81'9","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.269452+0000","last_change":"2024-09-19T07:09:38.180197+0000","last_active":"2024-09-19T07:11:03.269452+0000","last_peered":"2024-09-19T07:11:03.269452+0000","last_clean":"2024-09-19T07:11:03.269452+0000","last_became_active":"2024-09-19T07:09:38.179767+0000","last_became_peered":"2024-09-19T07:09:38.179767+0000","last_unstale":"2024-09-19T07:11:03.269452+0000","last_undegraded":"2024-09-19T07:11:03.269452+0000","last_fullsized":"2024-09-19T07:11:03.269452+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:43.581181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.275716+0000","last_change":"2024-09-19T07:09:18.937100+0000","last_active":"2024-09-19T07:11:03.275716+0000","last_peered":"2024-09-19T07:11:03.275716+0000","last_clean":"2024-09-19T07:11:03.275716+0000","last_became_active":"2024-09-19T07:09:18.935151+0000","last_became_peered":"2024-09-19T07:09:18.935151+0000","last_unstale":"2024-09-19T07:11:03.275716+0000","last_undegraded":"2024-09-19T07:11:03.275716+0000","last_fullsized":"2024-09-19T07:11:03.275716+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:46:30.950667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.273140+0000","last_change":"2024-09-19T07:09:18.940119+0000","last_active":"2024-09-19T07:11:03.273140+0000","last_peered":"2024-09-19T07:11:03.273140+0000","last_clean":"2024-09-19T07:11:03.273140+0000","last_became_active":"2024-09-19T07:09:18.939703+0000","last_became_peered":"2024-09-19T07:09:18.939703+0000","last_unstale":"2024-09-19T07:11:03.273140+0000","last_undegraded":"2024-09-19T07:11:03.273140+0000","last_fullsized":"2024-09-19T07:11:03.273140+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:51:04.982727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.276689+0000","last_change":"2024-09-19T07:09:18.939146+0000","last_active":"2024-09-19T07:11:03.276689+0000","last_peered":"2024-09-19T07:11:03.276689+0000","last_clean":"2024-09-19T07:11:03.276689+0000","last_became_active":"2024-09-19T07:09:18.936842+0000","last_became_peered":"2024-09-19T07:09:18.936842+0000","last_unstale":"2024-09-19T07:11:03.276689+0000","last_undegraded":"2024-09-19T07:11:03.276689+0000","last_fullsized":"2024-09-19T07:11:03.276689+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:32.713505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.265688+0000","last_change":"2024-09-19T07:09:38.178834+0000","last_active":"2024-09-19T07:11:03.265688+0000","last_peered":"2024-09-19T07:11:03.265688+0000","last_clean":"2024-09-19T07:11:03.265688+0000","last_became_active":"2024-09-19T07:09:38.178477+0000","last_became_peered":"2024-09-19T07:09:38.178477+0000","last_unstale":"2024-09-19T07:11:03.265688+0000","last_undegraded":"2024-09-19T07:11:03.265688+0000","last_fullsized":"2024-09-19T07:11:03.265688+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:04:44.524920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.285948+0000","last_change":"2024-09-19T07:09:18.935422+0000","last_active":"2024-09-19T07:11:03.285948+0000","last_peered":"2024-09-19T07:11:03.285948+0000","last_clean":"2024-09-19T07:11:03.285948+0000","last_became_active":"2024-09-19T07:09:18.934994+0000","last_became_peered":"2024-09-19T07:09:18.934994+0000","last_unstale":"2024-09-19T07:11:03.285948+0000","last_undegraded":"2024-09-19T07:11:03.285948+0000","last_fullsized":"2024-09-19T07:11:03.285948+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:37:30.751247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.283787+0000","last_change":"2024-09-19T07:09:18.933954+0000","last_active":"2024-09-19T07:11:03.283787+0000","last_peered":"2024-09-19T07:11:03.283787+0000","last_clean":"2024-09-19T07:11:03.283787+0000","last_became_active":"2024-09-19T07:09:18.933588+0000","last_became_peered":"2024-09-19T07:09:18.933588+0000","last_unstale":"2024-09-19T07:11:03.283787+0000","last_undegraded":"2024-09-19T07:11:03.283787+0000","last_fullsized":"2024-09-19T07:11:03.283787+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:10.161172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.283035+0000","last_change":"2024-09-19T07:09:18.932122+0000","last_active":"2024-09-19T07:11:03.283035+0000","last_peered":"2024-09-19T07:11:03.283035+0000","last_clean":"2024-09-19T07:11:03.283035+0000","last_became_active":"2024-09-19T07:09:18.931798+0000","last_became_peered":"2024-09-19T07:09:18.931798+0000","last_unstale":"2024-09-19T07:11:03.283035+0000","last_undegraded":"2024-09-19T07:11:03.283035+0000","last_fullsized":"2024-09-19T07:11:03.283035+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:44.776375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.261952+0000","last_change":"2024-09-19T07:09:18.935632+0000","last_active":"2024-09-19T07:11:03.261952+0000","last_peered":"2024-09-19T07:11:03.261952+0000","last_clean":"2024-09-19T07:11:03.261952+0000","last_became_active":"2024-09-19T07:09:18.935174+0000","last_became_peered":"2024-09-19T07:09:18.935174+0000","last_unstale":"2024-09-19T07:11:03.261952+0000","last_undegraded":"2024-09-19T07:11:03.261952+0000","last_fullsized":"2024-09-19T07:11:03.261952+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:22.170777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.279662+0000","last_change":"2024-09-19T07:09:18.931836+0000","last_active":"2024-09-19T07:11:03.279662+0000","last_peered":"2024-09-19T07:11:03.279662+0000","last_clean":"2024-09-19T07:11:03.279662+0000","last_became_active":"2024-09-19T07:09:18.931564+0000","last_became_peered":"2024-09-19T07:09:18.931564+0000","last_unstale":"2024-09-19T07:11:03.279662+0000","last_undegraded":"2024-09-19T07:11:03.279662+0000","last_fullsized":"2024-09-19T07:11:03.279662+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:53.674584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.263261+0000","last_change":"2024-09-19T07:09:18.933210+0000","last_active":"2024-09-19T07:11:03.263261+0000","last_peered":"2024-09-19T07:11:03.263261+0000","last_clean":"2024-09-19T07:11:03.263261+0000","last_became_active":"2024-09-19T07:09:18.932894+0000","last_became_peered":"2024-09-19T07:09:18.932894+0000","last_unstale":"2024-09-19T07:11:03.263261+0000","last_undegraded":"2024-09-19T07:11:03.263261+0000","last_fullsized":"2024-09-19T07:11:03.263261+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:50:56.669801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.281347+0000","last_change":"2024-09-19T07:09:18.925627+0000","last_active":"2024-09-19T07:11:03.281347+0000","last_peered":"2024-09-19T07:11:03.281347+0000","last_clean":"2024-09-19T07:11:03.281347+0000","last_became_active":"2024-09-19T07:09:18.925340+0000","last_became_peered":"2024-09-19T07:09:18.925340+0000","last_unstale":"2024-09-19T07:11:03.281347+0000","last_undegraded":"2024-09-19T07:11:03.281347+0000","last_fullsized":"2024-09-19T07:11:03.281347+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:29.544534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.275601+0000","last_change":"2024-09-19T07:09:18.936963+0000","last_active":"2024-09-19T07:11:03.275601+0000","last_peered":"2024-09-19T07:11:03.275601+0000","last_clean":"2024-09-19T07:11:03.275601+0000","last_became_active":"2024-09-19T07:09:18.936615+0000","last_became_peered":"2024-09-19T07:09:18.936615+0000","last_unstale":"2024-09-19T07:11:03.275601+0000","last_undegraded":"2024-09-19T07:11:03.275601+0000","last_fullsized":"2024-09-19T07:11:03.275601+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:13.036392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.285146+0000","last_change":"2024-09-19T07:09:18.932018+0000","last_active":"2024-09-19T07:11:03.285146+0000","last_peered":"2024-09-19T07:11:03.285146+0000","last_clean":"2024-09-19T07:11:03.285146+0000","last_became_active":"2024-09-19T07:09:18.931624+0000","last_became_peered":"2024-09-19T07:09:18.931624+0000","last_unstale":"2024-09-19T07:11:03.285146+0000","last_undegraded":"2024-09-19T07:11:03.285146+0000","last_fullsized":"2024-09-19T07:11:03.285146+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:53:05.585166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.265530+0000","last_change":"2024-09-19T07:09:18.935474+0000","last_active":"2024-09-19T07:11:03.265530+0000","last_peered":"2024-09-19T07:11:03.265530+0000","last_clean":"2024-09-19T07:11:03.265530+0000","last_became_active":"2024-09-19T07:09:18.929018+0000","last_became_peered":"2024-09-19T07:09:18.929018+0000","last_unstale":"2024-09-19T07:11:03.265530+0000","last_undegraded":"2024-09-19T07:11:03.265530+0000","last_fullsized":"2024-09-19T07:11:03.265530+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:01.383024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.276949+0000","last_change":"2024-09-19T07:09:18.928733+0000","last_active":"2024-09-19T07:11:03.276949+0000","last_peered":"2024-09-19T07:11:03.276949+0000","last_clean":"2024-09-19T07:11:03.276949+0000","last_became_active":"2024-09-19T07:09:18.928431+0000","last_became_peered":"2024-09-19T07:09:18.928431+0000","last_unstale":"2024-09-19T07:11:03.276949+0000","last_undegraded":"2024-09-19T07:11:03.276949+0000","last_fullsized":"2024-09-19T07:11:03.276949+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:37.313958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.268113+0000","last_change":"2024-09-19T07:09:18.921268+0000","last_active":"2024-09-19T07:11:03.268113+0000","last_peered":"2024-09-19T07:11:03.268113+0000","last_clean":"2024-09-19T07:11:03.268113+0000","last_became_active":"2024-09-19T07:09:18.920482+0000","last_became_peered":"2024-09-19T07:09:18.920482+0000","last_unstale":"2024-09-19T07:11:03.268113+0000","last_undegraded":"2024-09-19T07:11:03.268113+0000","last_fullsized":"2024-09-19T07:11:03.268113+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:35.201826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"81'2","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.269267+0000","last_change":"2024-09-19T07:09:38.179136+0000","last_active":"2024-09-19T07:11:03.269267+0000","last_peered":"2024-09-19T07:11:03.269267+0000","last_clean":"2024-09-19T07:11:03.269267+0000","last_became_active":"2024-09-19T07:09:38.178746+0000","last_became_peered":"2024-09-19T07:09:38.178746+0000","last_unstale":"2024-09-19T07:11:03.269267+0000","last_undegraded":"2024-09-19T07:11:03.269267+0000","last_fullsized":"2024-09-19T07:11:03.269267+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:03.788114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.280523+0000","last_change":"2024-09-19T07:09:18.924099+0000","last_active":"2024-09-19T07:11:03.280523+0000","last_peered":"2024-09-19T07:11:03.280523+0000","last_clean":"2024-09-19T07:11:03.280523+0000","last_became_active":"2024-09-19T07:09:18.923772+0000","last_became_peered":"2024-09-19T07:09:18.923772+0000","last_unstale":"2024-09-19T07:11:03.280523+0000","last_undegraded":"2024-09-19T07:11:03.280523+0000","last_fullsized":"2024-09-19T07:11:03.280523+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:05:04.954087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.271340+0000","last_change":"2024-09-19T07:09:18.923391+0000","last_active":"2024-09-19T07:11:03.271340+0000","last_peered":"2024-09-19T07:11:03.271340+0000","last_clean":"2024-09-19T07:11:03.271340+0000","last_became_active":"2024-09-19T07:09:18.923085+0000","last_became_peered":"2024-09-19T07:09:18.923085+0000","last_unstale":"2024-09-19T07:11:03.271340+0000","last_undegraded":"2024-09-19T07:11:03.271340+0000","last_fullsized":"2024-09-19T07:11:03.271340+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:43:27.032400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.283075+0000","last_change":"2024-09-19T07:09:18.937188+0000","last_active":"2024-09-19T07:11:03.283075+0000","last_peered":"2024-09-19T07:11:03.283075+0000","last_clean":"2024-09-19T07:11:03.283075+0000","last_became_active":"2024-09-19T07:09:18.936866+0000","last_became_peered":"2024-09-19T07:09:18.936866+0000","last_unstale":"2024-09-19T07:11:03.283075+0000","last_undegraded":"2024-09-19T07:11:03.283075+0000","last_fullsized":"2024-09-19T07:11:03.283075+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:29:08.835307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.284272+0000","last_change":"2024-09-19T07:09:18.935170+0000","last_active":"2024-09-19T07:11:03.284272+0000","last_peered":"2024-09-19T07:11:03.284272+0000","last_clean":"2024-09-19T07:11:03.284272+0000","last_became_active":"2024-09-19T07:09:18.934356+0000","last_became_peered":"2024-09-19T07:09:18.934356+0000","last_unstale":"2024-09-19T07:11:03.284272+0000","last_undegraded":"2024-09-19T07:11:03.284272+0000","last_fullsized":"2024-09-19T07:11:03.284272+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:53.567392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.285704+0000","last_change":"2024-09-19T07:09:18.922640+0000","last_active":"2024-09-19T07:11:03.285704+0000","last_peered":"2024-09-19T07:11:03.285704+0000","last_clean":"2024-09-19T07:11:03.285704+0000","last_became_active":"2024-09-19T07:09:18.922312+0000","last_became_peered":"2024-09-19T07:09:18.922312+0000","last_unstale":"2024-09-19T07:11:03.285704+0000","last_undegraded":"2024-09-19T07:11:03.285704+0000","last_fullsized":"2024-09-19T07:11:03.285704+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:50.868818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.280468+0000","last_change":"2024-09-19T07:09:18.934364+0000","last_active":"2024-09-19T07:11:03.280468+0000","last_peered":"2024-09-19T07:11:03.280468+0000","last_clean":"2024-09-19T07:11:03.280468+0000","last_became_active":"2024-09-19T07:09:18.933533+0000","last_became_peered":"2024-09-19T07:09:18.933533+0000","last_unstale":"2024-09-19T07:11:03.280468+0000","last_undegraded":"2024-09-19T07:11:03.280468+0000","last_fullsized":"2024-09-19T07:11:03.280468+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:54.175425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.274368+0000","last_change":"2024-09-19T07:09:18.927456+0000","last_active":"2024-09-19T07:11:03.274368+0000","last_peered":"2024-09-19T07:11:03.274368+0000","last_clean":"2024-09-19T07:11:03.274368+0000","last_became_active":"2024-09-19T07:09:18.927117+0000","last_became_peered":"2024-09-19T07:09:18.927117+0000","last_unstale":"2024-09-19T07:11:03.274368+0000","last_undegraded":"2024-09-19T07:11:03.274368+0000","last_fullsized":"2024-09-19T07:11:03.274368+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:08.885898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.271805+0000","last_change":"2024-09-19T07:09:18.926024+0000","last_active":"2024-09-19T07:11:03.271805+0000","last_peered":"2024-09-19T07:11:03.271805+0000","last_clean":"2024-09-19T07:11:03.271805+0000","last_became_active":"2024-09-19T07:09:18.925689+0000","last_became_peered":"2024-09-19T07:09:18.925689+0000","last_unstale":"2024-09-19T07:11:03.271805+0000","last_undegraded":"2024-09-19T07:11:03.271805+0000","last_fullsized":"2024-09-19T07:11:03.271805+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:09:08.178214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'10","reported_seq":135,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:04.129081+0000","last_change":"2024-09-19T07:09:16.915804+0000","last_active":"2024-09-19T07:11:04.129081+0000","last_peered":"2024-09-19T07:11:04.129081+0000","last_clean":"2024-09-19T07:11:04.129081+0000","last_became_active":"2024-09-19T07:09:16.915434+0000","last_became_peered":"2024-09-19T07:09:16.915434+0000","last_unstale":"2024-09-19T07:11:04.129081+0000","last_undegraded":"2024-09-19T07:11:04.129081+0000","last_fullsized":"2024-09-19T07:11:04.129081+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:57.230475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2250,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":5,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.271307+0000","last_change":"2024-09-19T07:09:18.932497+0000","last_active":"2024-09-19T07:11:03.271307+0000","last_peered":"2024-09-19T07:11:03.271307+0000","last_clean":"2024-09-19T07:11:03.271307+0000","last_became_active":"2024-09-19T07:09:18.932213+0000","last_became_peered":"2024-09-19T07:09:18.932213+0000","last_unstale":"2024-09-19T07:11:03.271307+0000","last_undegraded":"2024-09-19T07:11:03.271307+0000","last_fullsized":"2024-09-19T07:11:03.271307+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:10.299077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.233512+0000","last_change":"2024-09-19T07:09:16.910171+0000","last_active":"2024-09-19T07:11:03.233512+0000","last_peered":"2024-09-19T07:11:03.233512+0000","last_clean":"2024-09-19T07:11:03.233512+0000","last_became_active":"2024-09-19T07:09:16.909840+0000","last_became_peered":"2024-09-19T07:09:16.909840+0000","last_unstale":"2024-09-19T07:11:03.233512+0000","last_undegraded":"2024-09-19T07:11:03.233512+0000","last_fullsized":"2024-09-19T07:11:03.233512+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:35.448892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.229456+0000","last_change":"2024-09-19T07:09:16.911336+0000","last_active":"2024-09-19T07:11:03.229456+0000","last_peered":"2024-09-19T07:11:03.229456+0000","last_clean":"2024-09-19T07:11:03.229456+0000","last_became_active":"2024-09-19T07:09:16.911027+0000","last_became_peered":"2024-09-19T07:09:16.911027+0000","last_unstale":"2024-09-19T07:11:03.229456+0000","last_undegraded":"2024-09-19T07:11:03.229456+0000","last_fullsized":"2024-09-19T07:11:03.229456+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:37:50.698597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.278229+0000","last_change":"2024-09-19T07:09:18.927713+0000","last_active":"2024-09-19T07:11:03.278229+0000","last_peered":"2024-09-19T07:11:03.278229+0000","last_clean":"2024-09-19T07:11:03.278229+0000","last_became_active":"2024-09-19T07:09:18.927430+0000","last_became_peered":"2024-09-19T07:09:18.927430+0000","last_unstale":"2024-09-19T07:11:03.278229+0000","last_undegraded":"2024-09-19T07:11:03.278229+0000","last_fullsized":"2024-09-19T07:11:03.278229+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:15:07.707723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.236756+0000","last_change":"2024-09-19T07:09:16.912391+0000","last_active":"2024-09-19T07:11:03.236756+0000","last_peered":"2024-09-19T07:11:03.236756+0000","last_clean":"2024-09-19T07:11:03.236756+0000","last_became_active":"2024-09-19T07:09:16.912034+0000","last_became_peered":"2024-09-19T07:09:16.912034+0000","last_unstale":"2024-09-19T07:11:03.236756+0000","last_undegraded":"2024-09-19T07:11:03.236756+0000","last_fullsized":"2024-09-19T07:11:03.236756+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:18:45.226107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.269888+0000","last_change":"2024-09-19T07:09:18.929476+0000","last_active":"2024-09-19T07:11:03.269888+0000","last_peered":"2024-09-19T07:11:03.269888+0000","last_clean":"2024-09-19T07:11:03.269888+0000","last_became_active":"2024-09-19T07:09:18.929183+0000","last_became_peered":"2024-09-19T07:09:18.929183+0000","last_unstale":"2024-09-19T07:11:03.269888+0000","last_undegraded":"2024-09-19T07:11:03.269888+0000","last_fullsized":"2024-09-19T07:11:03.269888+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:19:38.827130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":124,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.233366+0000","last_change":"2024-09-19T07:09:16.913012+0000","last_active":"2024-09-19T07:11:03.233366+0000","last_peered":"2024-09-19T07:11:03.233366+0000","last_clean":"2024-09-19T07:11:03.233366+0000","last_became_active":"2024-09-19T07:09:16.912633+0000","last_became_peered":"2024-09-19T07:09:16.912633+0000","last_unstale":"2024-09-19T07:11:03.233366+0000","last_undegraded":"2024-09-19T07:11:03.233366+0000","last_fullsized":"2024-09-19T07:11:03.233366+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:21:39.669961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":96,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.262229+0000","last_change":"2024-09-19T07:09:18.937323+0000","last_active":"2024-09-19T07:11:03.262229+0000","last_peered":"2024-09-19T07:11:03.262229+0000","last_clean":"2024-09-19T07:11:03.262229+0000","last_became_active":"2024-09-19T07:09:18.936762+0000","last_became_peered":"2024-09-19T07:09:18.936762+0000","last_unstale":"2024-09-19T07:11:03.262229+0000","last_undegraded":"2024-09-19T07:11:03.262229+0000","last_fullsized":"2024-09-19T07:11:03.262229+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:37.692290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.234308+0000","last_change":"2024-09-19T07:09:16.912167+0000","last_active":"2024-09-19T07:11:03.234308+0000","last_peered":"2024-09-19T07:11:03.234308+0000","last_clean":"2024-09-19T07:11:03.234308+0000","last_became_active":"2024-09-19T07:09:16.911840+0000","last_became_peered":"2024-09-19T07:09:16.911840+0000","last_unstale":"2024-09-19T07:11:03.234308+0000","last_undegraded":"2024-09-19T07:11:03.234308+0000","last_fullsized":"2024-09-19T07:11:03.234308+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:31.901906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.283235+0000","last_change":"2024-09-19T07:09:18.932239+0000","last_active":"2024-09-19T07:11:03.283235+0000","last_peered":"2024-09-19T07:11:03.283235+0000","last_clean":"2024-09-19T07:11:03.283235+0000","last_became_active":"2024-09-19T07:09:18.931820+0000","last_became_peered":"2024-09-19T07:09:18.931820+0000","last_unstale":"2024-09-19T07:11:03.283235+0000","last_undegraded":"2024-09-19T07:11:03.283235+0000","last_fullsized":"2024-09-19T07:11:03.283235+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:09.407524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.236809+0000","last_change":"2024-09-19T07:09:17.085077+0000","last_active":"2024-09-19T07:11:03.236809+0000","last_peered":"2024-09-19T07:11:03.236809+0000","last_clean":"2024-09-19T07:11:03.236809+0000","last_became_active":"2024-09-19T07:09:17.084457+0000","last_became_peered":"2024-09-19T07:09:17.084457+0000","last_unstale":"2024-09-19T07:11:03.236809+0000","last_undegraded":"2024-09-19T07:11:03.236809+0000","last_fullsized":"2024-09-19T07:11:03.236809+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:42.416193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.276315+0000","last_change":"2024-09-19T07:09:18.939830+0000","last_active":"2024-09-19T07:11:03.276315+0000","last_peered":"2024-09-19T07:11:03.276315+0000","last_clean":"2024-09-19T07:11:03.276315+0000","last_became_active":"2024-09-19T07:09:18.939359+0000","last_became_peered":"2024-09-19T07:09:18.939359+0000","last_unstale":"2024-09-19T07:11:03.276315+0000","last_undegraded":"2024-09-19T07:11:03.276315+0000","last_fullsized":"2024-09-19T07:11:03.276315+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:24:46.241902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'34","reported_seq":278,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.510608+0000","last_change":"2024-09-19T07:09:38.227707+0000","last_active":"2024-09-19T07:11:03.510608+0000","last_peered":"2024-09-19T07:11:03.510608+0000","last_clean":"2024-09-19T07:11:03.510608+0000","last_became_active":"2024-09-19T07:09:38.219073+0000","last_became_peered":"2024-09-19T07:09:38.219073+0000","last_unstale":"2024-09-19T07:11:03.510608+0000","last_undegraded":"2024-09-19T07:11:03.510608+0000","last_fullsized":"2024-09-19T07:11:03.510608+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:46.035315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66480,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":199,"num_read_kb":158,"num_write":35,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":26947,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.270480+0000","last_change":"2024-09-19T07:09:18.929531+0000","last_active":"2024-09-19T07:11:03.270480+0000","last_peered":"2024-09-19T07:11:03.270480+0000","last_clean":"2024-09-19T07:11:03.270480+0000","last_became_active":"2024-09-19T07:09:18.929253+0000","last_became_peered":"2024-09-19T07:09:18.929253+0000","last_unstale":"2024-09-19T07:11:03.270480+0000","last_undegraded":"2024-09-19T07:11:03.270480+0000","last_fullsized":"2024-09-19T07:11:03.270480+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:10.635116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.238624+0000","last_change":"2024-09-19T07:09:16.914964+0000","last_active":"2024-09-19T07:11:03.238624+0000","last_peered":"2024-09-19T07:11:03.238624+0000","last_clean":"2024-09-19T07:11:03.238624+0000","last_became_active":"2024-09-19T07:09:16.914540+0000","last_became_peered":"2024-09-19T07:09:16.914540+0000","last_unstale":"2024-09-19T07:11:03.238624+0000","last_undegraded":"2024-09-19T07:11:03.238624+0000","last_fullsized":"2024-09-19T07:11:03.238624+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:30.903046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.284691+0000","last_change":"2024-09-19T07:09:18.931709+0000","last_active":"2024-09-19T07:11:03.284691+0000","last_peered":"2024-09-19T07:11:03.284691+0000","last_clean":"2024-09-19T07:11:03.284691+0000","last_became_active":"2024-09-19T07:09:18.931345+0000","last_became_peered":"2024-09-19T07:09:18.931345+0000","last_unstale":"2024-09-19T07:11:03.284691+0000","last_undegraded":"2024-09-19T07:11:03.284691+0000","last_fullsized":"2024-09-19T07:11:03.284691+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:28.916820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.236617+0000","last_change":"2024-09-19T07:09:16.914055+0000","last_active":"2024-09-19T07:11:03.236617+0000","last_peered":"2024-09-19T07:11:03.236617+0000","last_clean":"2024-09-19T07:11:03.236617+0000","last_became_active":"2024-09-19T07:09:16.913589+0000","last_became_peered":"2024-09-19T07:09:16.913589+0000","last_unstale":"2024-09-19T07:11:03.236617+0000","last_undegraded":"2024-09-19T07:11:03.236617+0000","last_fullsized":"2024-09-19T07:11:03.236617+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:29:16.322059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"81'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.285962+0000","last_change":"2024-09-19T07:09:18.934879+0000","last_active":"2024-09-19T07:11:03.285962+0000","last_peered":"2024-09-19T07:11:03.285962+0000","last_clean":"2024-09-19T07:11:03.285962+0000","last_became_active":"2024-09-19T07:09:18.934432+0000","last_became_peered":"2024-09-19T07:09:18.934432+0000","last_unstale":"2024-09-19T07:11:03.285962+0000","last_undegraded":"2024-09-19T07:11:03.285962+0000","last_fullsized":"2024-09-19T07:11:03.285962+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:25.782782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'7","reported_seq":131,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:04.128586+0000","last_change":"2024-09-19T07:09:16.909256+0000","last_active":"2024-09-19T07:11:04.128586+0000","last_peered":"2024-09-19T07:11:04.128586+0000","last_clean":"2024-09-19T07:11:04.128586+0000","last_became_active":"2024-09-19T07:09:16.908932+0000","last_became_peered":"2024-09-19T07:09:16.908932+0000","last_unstale":"2024-09-19T07:11:04.128586+0000","last_undegraded":"2024-09-19T07:11:04.128586+0000","last_fullsized":"2024-09-19T07:11:04.128586+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:28.344756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1908,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":5,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.270197+0000","last_change":"2024-09-19T07:09:18.931844+0000","last_active":"2024-09-19T07:11:03.270197+0000","last_peered":"2024-09-19T07:11:03.270197+0000","last_clean":"2024-09-19T07:11:03.270197+0000","last_became_active":"2024-09-19T07:09:18.931516+0000","last_became_peered":"2024-09-19T07:09:18.931516+0000","last_unstale":"2024-09-19T07:11:03.270197+0000","last_undegraded":"2024-09-19T07:11:03.270197+0000","last_fullsized":"2024-09-19T07:11:03.270197+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:27:29.812144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.247165+0000","last_change":"2024-09-19T07:09:17.085252+0000","last_active":"2024-09-19T07:11:03.247165+0000","last_peered":"2024-09-19T07:11:03.247165+0000","last_clean":"2024-09-19T07:11:03.247165+0000","last_became_active":"2024-09-19T07:09:17.084907+0000","last_became_peered":"2024-09-19T07:09:17.084907+0000","last_unstale":"2024-09-19T07:11:03.247165+0000","last_undegraded":"2024-09-19T07:11:03.247165+0000","last_fullsized":"2024-09-19T07:11:03.247165+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:59:40.351181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.269674+0000","last_change":"2024-09-19T07:09:18.932491+0000","last_active":"2024-09-19T07:11:03.269674+0000","last_peered":"2024-09-19T07:11:03.269674+0000","last_clean":"2024-09-19T07:11:03.269674+0000","last_became_active":"2024-09-19T07:09:18.932159+0000","last_became_peered":"2024-09-19T07:09:18.932159+0000","last_unstale":"2024-09-19T07:11:03.269674+0000","last_undegraded":"2024-09-19T07:11:03.269674+0000","last_fullsized":"2024-09-19T07:11:03.269674+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:31.144130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'3","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.247568+0000","last_change":"2024-09-19T07:09:16.911012+0000","last_active":"2024-09-19T07:11:03.247568+0000","last_peered":"2024-09-19T07:11:03.247568+0000","last_clean":"2024-09-19T07:11:03.247568+0000","last_became_active":"2024-09-19T07:09:16.910618+0000","last_became_peered":"2024-09-19T07:09:16.910618+0000","last_unstale":"2024-09-19T07:11:03.247568+0000","last_undegraded":"2024-09-19T07:11:03.247568+0000","last_fullsized":"2024-09-19T07:11:03.247568+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:16.316680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"81'5","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.267441+0000","last_change":"2024-09-19T07:09:38.217870+0000","last_active":"2024-09-19T07:11:03.267441+0000","last_peered":"2024-09-19T07:11:03.267441+0000","last_clean":"2024-09-19T07:11:03.267441+0000","last_became_active":"2024-09-19T07:09:38.217585+0000","last_became_peered":"2024-09-19T07:09:38.217585+0000","last_unstale":"2024-09-19T07:11:03.267441+0000","last_undegraded":"2024-09-19T07:11:03.267441+0000","last_fullsized":"2024-09-19T07:11:03.267441+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:41.320705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.229695+0000","last_change":"2024-09-19T07:09:16.911644+0000","last_active":"2024-09-19T07:11:03.229695+0000","last_peered":"2024-09-19T07:11:03.229695+0000","last_clean":"2024-09-19T07:11:03.229695+0000","last_became_active":"2024-09-19T07:09:16.911368+0000","last_became_peered":"2024-09-19T07:09:16.911368+0000","last_unstale":"2024-09-19T07:11:03.229695+0000","last_undegraded":"2024-09-19T07:11:03.229695+0000","last_fullsized":"2024-09-19T07:11:03.229695+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:12.953466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.274357+0000","last_change":"2024-09-19T07:09:18.933667+0000","last_active":"2024-09-19T07:11:03.274357+0000","last_peered":"2024-09-19T07:11:03.274357+0000","last_clean":"2024-09-19T07:11:03.274357+0000","last_became_active":"2024-09-19T07:09:18.933288+0000","last_became_peered":"2024-09-19T07:09:18.933288+0000","last_unstale":"2024-09-19T07:11:03.274357+0000","last_undegraded":"2024-09-19T07:11:03.274357+0000","last_fullsized":"2024-09-19T07:11:03.274357+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:54:38.127799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'39","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.462058+0000","last_change":"2024-09-19T07:09:16.909722+0000","last_active":"2024-09-19T07:11:03.462058+0000","last_peered":"2024-09-19T07:11:03.462058+0000","last_clean":"2024-09-19T07:11:03.462058+0000","last_became_active":"2024-09-19T07:09:16.909394+0000","last_became_peered":"2024-09-19T07:09:16.909394+0000","last_unstale":"2024-09-19T07:11:03.462058+0000","last_undegraded":"2024-09-19T07:11:03.462058+0000","last_fullsized":"2024-09-19T07:11:03.462058+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:21:53.342710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.269158+0000","last_change":"2024-09-19T07:09:18.929473+0000","last_active":"2024-09-19T07:11:03.269158+0000","last_peered":"2024-09-19T07:11:03.269158+0000","last_clean":"2024-09-19T07:11:03.269158+0000","last_became_active":"2024-09-19T07:09:18.929176+0000","last_became_peered":"2024-09-19T07:09:18.929176+0000","last_unstale":"2024-09-19T07:11:03.269158+0000","last_undegraded":"2024-09-19T07:11:03.269158+0000","last_fullsized":"2024-09-19T07:11:03.269158+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:32:30.409528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.238675+0000","last_change":"2024-09-19T07:09:17.084868+0000","last_active":"2024-09-19T07:11:03.238675+0000","last_peered":"2024-09-19T07:11:03.238675+0000","last_clean":"2024-09-19T07:11:03.238675+0000","last_became_active":"2024-09-19T07:09:17.084448+0000","last_became_peered":"2024-09-19T07:09:17.084448+0000","last_unstale":"2024-09-19T07:11:03.238675+0000","last_undegraded":"2024-09-19T07:11:03.238675+0000","last_fullsized":"2024-09-19T07:11:03.238675+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:38.211697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.276801+0000","last_change":"2024-09-19T07:09:18.938865+0000","last_active":"2024-09-19T07:11:03.276801+0000","last_peered":"2024-09-19T07:11:03.276801+0000","last_clean":"2024-09-19T07:11:03.276801+0000","last_became_active":"2024-09-19T07:09:18.936324+0000","last_became_peered":"2024-09-19T07:09:18.936324+0000","last_unstale":"2024-09-19T07:11:03.276801+0000","last_undegraded":"2024-09-19T07:11:03.276801+0000","last_fullsized":"2024-09-19T07:11:03.276801+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:29:51.081140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":345,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.234069+0000","last_change":"2024-09-19T07:08:09.270850+0000","last_active":"2024-09-19T07:11:03.234069+0000","last_peered":"2024-09-19T07:11:03.234069+0000","last_clean":"2024-09-19T07:11:03.234069+0000","last_became_active":"2024-09-19T07:08:09.270308+0000","last_became_peered":"2024-09-19T07:08:09.270308+0000","last_unstale":"2024-09-19T07:11:03.234069+0000","last_undegraded":"2024-09-19T07:11:03.234069+0000","last_fullsized":"2024-09-19T07:11:03.234069+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:04:49.729632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:04:49.729632+0000","last_clean_scrub_stamp":"2024-09-19T07:04:49.729632+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:15.588732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.231213+0000","last_change":"2024-09-19T07:09:16.907648+0000","last_active":"2024-09-19T07:11:03.231213+0000","last_peered":"2024-09-19T07:11:03.231213+0000","last_clean":"2024-09-19T07:11:03.231213+0000","last_became_active":"2024-09-19T07:09:16.907363+0000","last_became_peered":"2024-09-19T07:09:16.907363+0000","last_unstale":"2024-09-19T07:11:03.231213+0000","last_undegraded":"2024-09-19T07:11:03.231213+0000","last_fullsized":"2024-09-19T07:11:03.231213+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:12:27.898493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.275674+0000","last_change":"2024-09-19T07:09:18.926008+0000","last_active":"2024-09-19T07:11:03.275674+0000","last_peered":"2024-09-19T07:11:03.275674+0000","last_clean":"2024-09-19T07:11:03.275674+0000","last_became_active":"2024-09-19T07:09:18.925689+0000","last_became_peered":"2024-09-19T07:09:18.925689+0000","last_unstale":"2024-09-19T07:11:03.275674+0000","last_undegraded":"2024-09-19T07:11:03.275674+0000","last_fullsized":"2024-09-19T07:11:03.275674+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:16:06.467934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.233965+0000","last_change":"2024-09-19T07:09:16.911327+0000","last_active":"2024-09-19T07:11:03.233965+0000","last_peered":"2024-09-19T07:11:03.233965+0000","last_clean":"2024-09-19T07:11:03.233965+0000","last_became_active":"2024-09-19T07:09:16.911031+0000","last_became_peered":"2024-09-19T07:09:16.911031+0000","last_unstale":"2024-09-19T07:11:03.233965+0000","last_undegraded":"2024-09-19T07:11:03.233965+0000","last_fullsized":"2024-09-19T07:11:03.233965+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:03.307119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.280334+0000","last_change":"2024-09-19T07:09:18.933813+0000","last_active":"2024-09-19T07:11:03.280334+0000","last_peered":"2024-09-19T07:11:03.280334+0000","last_clean":"2024-09-19T07:11:03.280334+0000","last_became_active":"2024-09-19T07:09:18.933475+0000","last_became_peered":"2024-09-19T07:09:18.933475+0000","last_unstale":"2024-09-19T07:11:03.280334+0000","last_undegraded":"2024-09-19T07:11:03.280334+0000","last_fullsized":"2024-09-19T07:11:03.280334+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:34:09.149593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.231831+0000","last_change":"2024-09-19T07:09:17.084833+0000","last_active":"2024-09-19T07:11:03.231831+0000","last_peered":"2024-09-19T07:11:03.231831+0000","last_clean":"2024-09-19T07:11:03.231831+0000","last_became_active":"2024-09-19T07:09:17.084477+0000","last_became_peered":"2024-09-19T07:09:17.084477+0000","last_unstale":"2024-09-19T07:11:03.231831+0000","last_undegraded":"2024-09-19T07:11:03.231831+0000","last_fullsized":"2024-09-19T07:11:03.231831+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:17:50.962480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":96,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.281019+0000","last_change":"2024-09-19T07:09:18.935991+0000","last_active":"2024-09-19T07:11:03.281019+0000","last_peered":"2024-09-19T07:11:03.281019+0000","last_clean":"2024-09-19T07:11:03.281019+0000","last_became_active":"2024-09-19T07:09:18.935677+0000","last_became_peered":"2024-09-19T07:09:18.935677+0000","last_unstale":"2024-09-19T07:11:03.281019+0000","last_undegraded":"2024-09-19T07:11:03.281019+0000","last_fullsized":"2024-09-19T07:11:03.281019+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:45.550119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.234872+0000","last_change":"2024-09-19T07:09:16.911755+0000","last_active":"2024-09-19T07:11:03.234872+0000","last_peered":"2024-09-19T07:11:03.234872+0000","last_clean":"2024-09-19T07:11:03.234872+0000","last_became_active":"2024-09-19T07:09:16.911211+0000","last_became_peered":"2024-09-19T07:09:16.911211+0000","last_unstale":"2024-09-19T07:11:03.234872+0000","last_undegraded":"2024-09-19T07:11:03.234872+0000","last_fullsized":"2024-09-19T07:11:03.234872+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:15.365423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.265945+0000","last_change":"2024-09-19T07:09:18.940282+0000","last_active":"2024-09-19T07:11:03.265945+0000","last_peered":"2024-09-19T07:11:03.265945+0000","last_clean":"2024-09-19T07:11:03.265945+0000","last_became_active":"2024-09-19T07:09:18.939918+0000","last_became_peered":"2024-09-19T07:09:18.939918+0000","last_unstale":"2024-09-19T07:11:03.265945+0000","last_undegraded":"2024-09-19T07:11:03.265945+0000","last_fullsized":"2024-09-19T07:11:03.265945+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:11.161676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.242639+0000","last_change":"2024-09-19T07:09:17.086103+0000","last_active":"2024-09-19T07:11:03.242639+0000","last_peered":"2024-09-19T07:11:03.242639+0000","last_clean":"2024-09-19T07:11:03.242639+0000","last_became_active":"2024-09-19T07:09:17.085805+0000","last_became_peered":"2024-09-19T07:09:17.085805+0000","last_unstale":"2024-09-19T07:11:03.242639+0000","last_undegraded":"2024-09-19T07:11:03.242639+0000","last_fullsized":"2024-09-19T07:11:03.242639+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:28.522487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.284777+0000","last_change":"2024-09-19T07:09:18.932603+0000","last_active":"2024-09-19T07:11:03.284777+0000","last_peered":"2024-09-19T07:11:03.284777+0000","last_clean":"2024-09-19T07:11:03.284777+0000","last_became_active":"2024-09-19T07:09:18.932309+0000","last_became_peered":"2024-09-19T07:09:18.932309+0000","last_unstale":"2024-09-19T07:11:03.284777+0000","last_undegraded":"2024-09-19T07:11:03.284777+0000","last_fullsized":"2024-09-19T07:11:03.284777+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:19.746024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.245199+0000","last_change":"2024-09-19T07:09:17.085287+0000","last_active":"2024-09-19T07:11:03.245199+0000","last_peered":"2024-09-19T07:11:03.245199+0000","last_clean":"2024-09-19T07:11:03.245199+0000","last_became_active":"2024-09-19T07:09:17.084964+0000","last_became_peered":"2024-09-19T07:09:17.084964+0000","last_unstale":"2024-09-19T07:11:03.245199+0000","last_undegraded":"2024-09-19T07:11:03.245199+0000","last_fullsized":"2024-09-19T07:11:03.245199+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:51:01.035344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.287453+0000","last_change":"2024-09-19T07:09:18.921623+0000","last_active":"2024-09-19T07:11:03.287453+0000","last_peered":"2024-09-19T07:11:03.287453+0000","last_clean":"2024-09-19T07:11:03.287453+0000","last_became_active":"2024-09-19T07:09:18.921321+0000","last_became_peered":"2024-09-19T07:09:18.921321+0000","last_unstale":"2024-09-19T07:11:03.287453+0000","last_undegraded":"2024-09-19T07:11:03.287453+0000","last_fullsized":"2024-09-19T07:11:03.287453+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:28:55.616889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'47","reported_seq":94,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.468956+0000","last_change":"2024-09-19T07:09:16.910251+0000","last_active":"2024-09-19T07:11:03.468956+0000","last_peered":"2024-09-19T07:11:03.468956+0000","last_clean":"2024-09-19T07:11:03.468956+0000","last_became_active":"2024-09-19T07:09:16.909821+0000","last_became_peered":"2024-09-19T07:09:16.909821+0000","last_unstale":"2024-09-19T07:11:03.468956+0000","last_undegraded":"2024-09-19T07:11:03.468956+0000","last_fullsized":"2024-09-19T07:11:03.468956+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:02.958557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":86,"num_write_kb":839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.268601+0000","last_change":"2024-09-19T07:09:18.930831+0000","last_active":"2024-09-19T07:11:03.268601+0000","last_peered":"2024-09-19T07:11:03.268601+0000","last_clean":"2024-09-19T07:11:03.268601+0000","last_became_active":"2024-09-19T07:09:18.930475+0000","last_became_peered":"2024-09-19T07:09:18.930475+0000","last_unstale":"2024-09-19T07:11:03.268601+0000","last_undegraded":"2024-09-19T07:11:03.268601+0000","last_fullsized":"2024-09-19T07:11:03.268601+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:30.512246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.231362+0000","last_change":"2024-09-19T07:09:16.906666+0000","last_active":"2024-09-19T07:11:03.231362+0000","last_peered":"2024-09-19T07:11:03.231362+0000","last_clean":"2024-09-19T07:11:03.231362+0000","last_became_active":"2024-09-19T07:09:16.906369+0000","last_became_peered":"2024-09-19T07:09:16.906369+0000","last_unstale":"2024-09-19T07:11:03.231362+0000","last_undegraded":"2024-09-19T07:11:03.231362+0000","last_fullsized":"2024-09-19T07:11:03.231362+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:56.915089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.280797+0000","last_change":"2024-09-19T07:09:18.934942+0000","last_active":"2024-09-19T07:11:03.280797+0000","last_peered":"2024-09-19T07:11:03.280797+0000","last_clean":"2024-09-19T07:11:03.280797+0000","last_became_active":"2024-09-19T07:09:18.934595+0000","last_became_peered":"2024-09-19T07:09:18.934595+0000","last_unstale":"2024-09-19T07:11:03.280797+0000","last_undegraded":"2024-09-19T07:11:03.280797+0000","last_fullsized":"2024-09-19T07:11:03.280797+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:54.306541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.239116+0000","last_change":"2024-09-19T07:09:38.183567+0000","last_active":"2024-09-19T07:11:03.239116+0000","last_peered":"2024-09-19T07:11:03.239116+0000","last_clean":"2024-09-19T07:11:03.239116+0000","last_became_active":"2024-09-19T07:09:38.180778+0000","last_became_peered":"2024-09-19T07:09:38.180778+0000","last_unstale":"2024-09-19T07:11:03.239116+0000","last_undegraded":"2024-09-19T07:11:03.239116+0000","last_fullsized":"2024-09-19T07:11:03.239116+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:43.226551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"81'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.260607+0000","last_change":"2024-09-19T07:09:18.934457+0000","last_active":"2024-09-19T07:11:03.260607+0000","last_peered":"2024-09-19T07:11:03.260607+0000","last_clean":"2024-09-19T07:11:03.260607+0000","last_became_active":"2024-09-19T07:09:18.934126+0000","last_became_peered":"2024-09-19T07:09:18.934126+0000","last_unstale":"2024-09-19T07:11:03.260607+0000","last_undegraded":"2024-09-19T07:11:03.260607+0000","last_fullsized":"2024-09-19T07:11:03.260607+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:37:16.152335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.231606+0000","last_change":"2024-09-19T07:09:16.908457+0000","last_active":"2024-09-19T07:11:03.231606+0000","last_peered":"2024-09-19T07:11:03.231606+0000","last_clean":"2024-09-19T07:11:03.231606+0000","last_became_active":"2024-09-19T07:09:16.908128+0000","last_became_peered":"2024-09-19T07:09:16.908128+0000","last_unstale":"2024-09-19T07:11:03.231606+0000","last_undegraded":"2024-09-19T07:11:03.231606+0000","last_fullsized":"2024-09-19T07:11:03.231606+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:48:50.579301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.273932+0000","last_change":"2024-09-19T07:09:18.928763+0000","last_active":"2024-09-19T07:11:03.273932+0000","last_peered":"2024-09-19T07:11:03.273932+0000","last_clean":"2024-09-19T07:11:03.273932+0000","last_became_active":"2024-09-19T07:09:18.928231+0000","last_became_peered":"2024-09-19T07:09:18.928231+0000","last_unstale":"2024-09-19T07:11:03.273932+0000","last_undegraded":"2024-09-19T07:11:03.273932+0000","last_fullsized":"2024-09-19T07:11:03.273932+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:26.652378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.238773+0000","last_change":"2024-09-19T07:09:16.913740+0000","last_active":"2024-09-19T07:11:03.238773+0000","last_peered":"2024-09-19T07:11:03.238773+0000","last_clean":"2024-09-19T07:11:03.238773+0000","last_became_active":"2024-09-19T07:09:16.912419+0000","last_became_peered":"2024-09-19T07:09:16.912419+0000","last_unstale":"2024-09-19T07:11:03.238773+0000","last_undegraded":"2024-09-19T07:11:03.238773+0000","last_fullsized":"2024-09-19T07:11:03.238773+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:16.658996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.283782+0000","last_change":"2024-09-19T07:09:18.930697+0000","last_active":"2024-09-19T07:11:03.283782+0000","last_peered":"2024-09-19T07:11:03.283782+0000","last_clean":"2024-09-19T07:11:03.283782+0000","last_became_active":"2024-09-19T07:09:18.930355+0000","last_became_peered":"2024-09-19T07:09:18.930355+0000","last_unstale":"2024-09-19T07:11:03.283782+0000","last_undegraded":"2024-09-19T07:11:03.283782+0000","last_fullsized":"2024-09-19T07:11:03.283782+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:07.217195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.228781+0000","last_change":"2024-09-19T07:09:38.183637+0000","last_active":"2024-09-19T07:11:03.228781+0000","last_peered":"2024-09-19T07:11:03.228781+0000","last_clean":"2024-09-19T07:11:03.228781+0000","last_became_active":"2024-09-19T07:09:38.178732+0000","last_became_peered":"2024-09-19T07:09:38.178732+0000","last_unstale":"2024-09-19T07:11:03.228781+0000","last_undegraded":"2024-09-19T07:11:03.228781+0000","last_fullsized":"2024-09-19T07:11:03.228781+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:14.287130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.285232+0000","last_change":"2024-09-19T07:09:18.935120+0000","last_active":"2024-09-19T07:11:03.285232+0000","last_peered":"2024-09-19T07:11:03.285232+0000","last_clean":"2024-09-19T07:11:03.285232+0000","last_became_active":"2024-09-19T07:09:18.934227+0000","last_became_peered":"2024-09-19T07:09:18.934227+0000","last_unstale":"2024-09-19T07:11:03.285232+0000","last_undegraded":"2024-09-19T07:11:03.285232+0000","last_fullsized":"2024-09-19T07:11:03.285232+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:20.328983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"81'15","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.278695+0000","last_change":"2024-09-19T07:09:38.393512+0000","last_active":"2024-09-19T07:11:03.278695+0000","last_peered":"2024-09-19T07:11:03.278695+0000","last_clean":"2024-09-19T07:11:03.278695+0000","last_became_active":"2024-09-19T07:09:38.393200+0000","last_became_peered":"2024-09-19T07:09:38.393200+0000","last_unstale":"2024-09-19T07:11:03.278695+0000","last_undegraded":"2024-09-19T07:11:03.278695+0000","last_fullsized":"2024-09-19T07:11:03.278695+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:51.637520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.247033+0000","last_change":"2024-09-19T07:09:16.911129+0000","last_active":"2024-09-19T07:11:03.247033+0000","last_peered":"2024-09-19T07:11:03.247033+0000","last_clean":"2024-09-19T07:11:03.247033+0000","last_became_active":"2024-09-19T07:09:16.910583+0000","last_became_peered":"2024-09-19T07:09:16.910583+0000","last_unstale":"2024-09-19T07:11:03.247033+0000","last_undegraded":"2024-09-19T07:11:03.247033+0000","last_fullsized":"2024-09-19T07:11:03.247033+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:34:37.295838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.285042+0000","last_change":"2024-09-19T07:09:18.928622+0000","last_active":"2024-09-19T07:11:03.285042+0000","last_peered":"2024-09-19T07:11:03.285042+0000","last_clean":"2024-09-19T07:11:03.285042+0000","last_became_active":"2024-09-19T07:09:18.928284+0000","last_became_peered":"2024-09-19T07:09:18.928284+0000","last_unstale":"2024-09-19T07:11:03.285042+0000","last_undegraded":"2024-09-19T07:11:03.285042+0000","last_fullsized":"2024-09-19T07:11:03.285042+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:37:46.358756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.245062+0000","last_change":"2024-09-19T07:09:16.916142+0000","last_active":"2024-09-19T07:11:03.245062+0000","last_peered":"2024-09-19T07:11:03.245062+0000","last_clean":"2024-09-19T07:11:03.245062+0000","last_became_active":"2024-09-19T07:09:16.915766+0000","last_became_peered":"2024-09-19T07:09:16.915766+0000","last_unstale":"2024-09-19T07:11:03.245062+0000","last_undegraded":"2024-09-19T07:11:03.245062+0000","last_fullsized":"2024-09-19T07:11:03.245062+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:38.136422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.285015+0000","last_change":"2024-09-19T07:09:18.921912+0000","last_active":"2024-09-19T07:11:03.285015+0000","last_peered":"2024-09-19T07:11:03.285015+0000","last_clean":"2024-09-19T07:11:03.285015+0000","last_became_active":"2024-09-19T07:09:18.921595+0000","last_became_peered":"2024-09-19T07:09:18.921595+0000","last_unstale":"2024-09-19T07:11:03.285015+0000","last_undegraded":"2024-09-19T07:11:03.285015+0000","last_fullsized":"2024-09-19T07:11:03.285015+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:53.899052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.232279+0000","last_change":"2024-09-19T07:09:17.084856+0000","last_active":"2024-09-19T07:11:03.232279+0000","last_peered":"2024-09-19T07:11:03.232279+0000","last_clean":"2024-09-19T07:11:03.232279+0000","last_became_active":"2024-09-19T07:09:17.084541+0000","last_became_peered":"2024-09-19T07:09:17.084541+0000","last_unstale":"2024-09-19T07:11:03.232279+0000","last_undegraded":"2024-09-19T07:11:03.232279+0000","last_fullsized":"2024-09-19T07:11:03.232279+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:05.978765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.274355+0000","last_change":"2024-09-19T07:09:18.923732+0000","last_active":"2024-09-19T07:11:03.274355+0000","last_peered":"2024-09-19T07:11:03.274355+0000","last_clean":"2024-09-19T07:11:03.274355+0000","last_became_active":"2024-09-19T07:09:18.923410+0000","last_became_peered":"2024-09-19T07:09:18.923410+0000","last_unstale":"2024-09-19T07:11:03.274355+0000","last_undegraded":"2024-09-19T07:11:03.274355+0000","last_fullsized":"2024-09-19T07:11:03.274355+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:01:20.208414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.242373+0000","last_change":"2024-09-19T07:09:16.910364+0000","last_active":"2024-09-19T07:11:03.242373+0000","last_peered":"2024-09-19T07:11:03.242373+0000","last_clean":"2024-09-19T07:11:03.242373+0000","last_became_active":"2024-09-19T07:09:16.909835+0000","last_became_peered":"2024-09-19T07:09:16.909835+0000","last_unstale":"2024-09-19T07:11:03.242373+0000","last_undegraded":"2024-09-19T07:11:03.242373+0000","last_fullsized":"2024-09-19T07:11:03.242373+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:05.198823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":597854,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":696,"num_read_kb":450,"num_write":294,"num_write_kb":1439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":26947,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2027520,"data_stored":1793562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645346,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":892928,"data_stored":437435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,0,5,4,14,28],"upper_bound":64},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874278,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32936,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712216,"statfs":{"total":95995035648,"available":95961309184,"internally_reserved":0,"allocated":1732608,"data_stored":1228316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037804,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32460,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712692,"statfs":{"total":95995035648,"available":95961796608,"internally_reserved":0,"allocated":1302528,"data_stored":830887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266736,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36428,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708724,"statfs":{"total":95995035648,"available":95957733376,"internally_reserved":0,"allocated":1105920,"data_stored":634199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495669,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32656,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712496,"statfs":{"total":95995035648,"available":95961595904,"internally_reserved":0,"allocated":1503232,"data_stored":1032078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659195,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":897024,"data_stored":437060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888127,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32796,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712356,"statfs":{"total":95995035648,"available":95961452544,"internally_reserved":0,"allocated":1650688,"data_stored":1162042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018948,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":974848,"data_stored":503725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247881,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":913408,"data_stored":437371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444110,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":439831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607635,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":958464,"data_stored":497098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":917504,"data_stored":438331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":544768,"data_stored":525100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":134704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":4740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":393954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":200978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T07:11:08.412 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-19T07:11:08.412 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T07:11:08.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.549+0000 7fc9c8b66640 1 -- 172.21.15.148:0/2267489715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9c4100d50 msgr2=0x7fc9c4104d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:08.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.549+0000 7fc9c8b66640 1 --2- 172.21.15.148:0/2267489715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9c4100d50 0x7fc9c4104d90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fc9b400adb0 tx=0x7fc9b402b7a0 comp rx=0 tx=0).stop 2024-09-19T07:11:08.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.549+0000 7fc9c8b66640 1 -- 172.21.15.148:0/2267489715 shutdown_connections 2024-09-19T07:11:08.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.549+0000 7fc9c8b66640 1 --2- 172.21.15.148:0/2267489715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9c41054f0 0x7fc9c410d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:08.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.549+0000 7fc9c8b66640 1 --2- 172.21.15.148:0/2267489715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9c4100d50 0x7fc9c4104d90 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:08.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.549+0000 7fc9c8b66640 1 --2- 172.21.15.148:0/2267489715 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9c41003a0 0x7fc9c4100780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:08.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.549+0000 7fc9c8b66640 1 -- 172.21.15.148:0/2267489715 >> 172.21.15.148:0/2267489715 conn(0x7fc9c40771e0 msgr2=0x7fc9c40fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:08.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.549+0000 7fc9c8b66640 1 -- 172.21.15.148:0/2267489715 shutdown_connections 2024-09-19T07:11:08.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.549+0000 7fc9c8b66640 1 -- 172.21.15.148:0/2267489715 wait complete. 2024-09-19T07:11:08.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.550+0000 7fc9c8b66640 1 Processor -- start 2024-09-19T07:11:08.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.550+0000 7fc9c8b66640 1 -- start start 2024-09-19T07:11:08.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.550+0000 7fc9c8b66640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9c41003a0 0x7fc9c4198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:08.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.550+0000 7fc9c8b66640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9c41054f0 0x7fc9c4198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:08.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.550+0000 7fc9c8b66640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9c419cd10 0x7fc9c419d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:08.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.550+0000 7fc9c8b66640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c410fcd0 con 0x7fc9c41003a0 2024-09-19T07:11:08.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.550+0000 7fc9c8b66640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c410fb50 con 0x7fc9c419cd10 2024-09-19T07:11:08.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.550+0000 7fc9c8b66640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c410fe50 con 0x7fc9c41054f0 2024-09-19T07:11:08.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.550+0000 7fc9c259c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9c41003a0 0x7fc9c4198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:08.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.550+0000 7fc9c259c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9c41003a0 0x7fc9c4198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60780/0 (socket says 172.21.15.148:60780) 2024-09-19T07:11:08.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.550+0000 7fc9c259c640 1 -- 172.21.15.148:0/783489071 learned_addr learned my addr 172.21.15.148:0/783489071 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:08.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.550+0000 7fc9c1d9b640 1 --2- 172.21.15.148:0/783489071 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9c41054f0 0x7fc9c4198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:08.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.550+0000 7fc9c259c640 1 -- 172.21.15.148:0/783489071 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9c41054f0 msgr2=0x7fc9c4198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:08.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.550+0000 7fc9c259c640 1 --2- 172.21.15.148:0/783489071 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9c41054f0 0x7fc9c4198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:08.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.550+0000 7fc9c259c640 1 -- 172.21.15.148:0/783489071 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9c419cd10 msgr2=0x7fc9c419d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:08.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.550+0000 7fc9c2d9d640 1 --2- 172.21.15.148:0/783489071 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9c419cd10 0x7fc9c419d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:08.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.550+0000 7fc9c259c640 1 --2- 172.21.15.148:0/783489071 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9c419cd10 0x7fc9c419d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:08.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.550+0000 7fc9c259c640 1 -- 172.21.15.148:0/783489071 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9c419d800 con 0x7fc9c41003a0 2024-09-19T07:11:08.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.550+0000 7fc9c2d9d640 1 --2- 172.21.15.148:0/783489071 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9c419cd10 0x7fc9c419d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:11:08.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.550+0000 7fc9c259c640 1 --2- 172.21.15.148:0/783489071 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9c41003a0 0x7fc9c4198450 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc9b800d950 tx=0x7fc9b800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:08.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.551+0000 7fc9b37fe640 1 -- 172.21.15.148:0/783489071 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b8017070 con 0x7fc9c41003a0 2024-09-19T07:11:08.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.551+0000 7fc9b37fe640 1 -- 172.21.15.148:0/783489071 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9b8009c30 con 0x7fc9c41003a0 2024-09-19T07:11:08.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.551+0000 7fc9c8b66640 1 -- 172.21.15.148:0/783489071 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9c419daf0 con 0x7fc9c41003a0 2024-09-19T07:11:08.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.551+0000 7fc9b37fe640 1 -- 172.21.15.148:0/783489071 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b800f6b0 con 0x7fc9c41003a0 2024-09-19T07:11:08.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.551+0000 7fc9c8b66640 1 -- 172.21.15.148:0/783489071 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9c41a5280 con 0x7fc9c41003a0 2024-09-19T07:11:08.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.552+0000 7fc9c8b66640 1 -- 172.21.15.148:0/783489071 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9c4100780 con 0x7fc9c41003a0 2024-09-19T07:11:08.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.553+0000 7fc9b37fe640 1 -- 172.21.15.148:0/783489071 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7fc9b80109d0 con 0x7fc9c41003a0 2024-09-19T07:11:08.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.553+0000 7fc9b37fe640 1 --2- 172.21.15.148:0/783489071 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc9ac0a3450 0x7fc9ac0a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:08.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.553+0000 7fc9c1d9b640 1 --2- 172.21.15.148:0/783489071 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc9ac0a3450 0x7fc9ac0a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:08.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.553+0000 7fc9b37fe640 1 -- 172.21.15.148:0/783489071 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fc9b80cfef0 con 0x7fc9c41003a0 2024-09-19T07:11:08.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.554+0000 7fc9c1d9b640 1 --2- 172.21.15.148:0/783489071 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc9ac0a3450 0x7fc9ac0a5910 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4006010 tx=0x7fc9b400a500 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:08.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.557+0000 7fc9b37fe640 1 -- 172.21.15.148:0/783489071 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc9b8009de0 con 0x7fc9c41003a0 2024-09-19T07:11:08.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.721+0000 7fc9c8b66640 1 -- 172.21.15.148:0/783489071 --> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc9c4100da0 con 0x7fc9ac0a3450 2024-09-19T07:11:08.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.727+0000 7fc9b37fe640 1 -- 172.21.15.148:0/783489071 <== mgr.15123 v2:172.21.15.148:6800/3902535850 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257894 (secure 0 0 0) 0x7fc9c4100da0 con 0x7fc9ac0a3450 2024-09-19T07:11:08.731 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:11:08.732 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2024-09-19T07:11:08.733 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.731+0000 7fc9c8b66640 1 -- 172.21.15.148:0/783489071 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc9ac0a3450 msgr2=0x7fc9ac0a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:08.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.731+0000 7fc9c8b66640 1 --2- 172.21.15.148:0/783489071 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc9ac0a3450 0x7fc9ac0a5910 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4006010 tx=0x7fc9b400a500 comp rx=0 tx=0).stop 2024-09-19T07:11:08.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.731+0000 7fc9c8b66640 1 -- 172.21.15.148:0/783489071 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9c41003a0 msgr2=0x7fc9c4198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:08.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.731+0000 7fc9c8b66640 1 --2- 172.21.15.148:0/783489071 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9c41003a0 0x7fc9c4198450 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc9b800d950 tx=0x7fc9b800de10 comp rx=0 tx=0).stop 2024-09-19T07:11:08.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.731+0000 7fc9c8b66640 1 -- 172.21.15.148:0/783489071 shutdown_connections 2024-09-19T07:11:08.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.731+0000 7fc9c8b66640 1 --2- 172.21.15.148:0/783489071 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc9ac0a3450 0x7fc9ac0a5910 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:08.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.731+0000 7fc9c8b66640 1 --2- 172.21.15.148:0/783489071 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9c419cd10 0x7fc9c419d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:08.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.731+0000 7fc9c8b66640 1 --2- 172.21.15.148:0/783489071 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9c41054f0 0x7fc9c4198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:08.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.731+0000 7fc9c8b66640 1 --2- 172.21.15.148:0/783489071 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9c41003a0 0x7fc9c4198450 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:08.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.731+0000 7fc9c8b66640 1 -- 172.21.15.148:0/783489071 >> 172.21.15.148:0/783489071 conn(0x7fc9c40771e0 msgr2=0x7fc9c41036a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:08.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.731+0000 7fc9c8b66640 1 -- 172.21.15.148:0/783489071 shutdown_connections 2024-09-19T07:11:08.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:08.731+0000 7fc9c8b66640 1 -- 172.21.15.148:0/783489071 wait complete. 2024-09-19T07:11:08.742 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-09-19T07:11:07.248743+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1188456,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":832,"num_read_kb":569,"num_write":477,"num_write_kb":4379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1207683,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":868,"ondisk_log_size":868,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":387744,"kb_used_data":13440,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124554080,"statfs":{"total":1151940427776,"available":1151543377920,"internally_reserved":0,"allocated":13762560,"data_stored":8078373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":382973242},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,0,5,4,14,28],"upper_bound":64},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.996340"},"pg_stats":[{"pgid":"3.3f","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.279425+0000","last_change":"2024-09-19T07:09:18.926902+0000","last_active":"2024-09-19T07:11:03.279425+0000","last_peered":"2024-09-19T07:11:03.279425+0000","last_clean":"2024-09-19T07:11:03.279425+0000","last_became_active":"2024-09-19T07:09:18.926582+0000","last_became_peered":"2024-09-19T07:09:18.926582+0000","last_unstale":"2024-09-19T07:11:03.279425+0000","last_undegraded":"2024-09-19T07:11:03.279425+0000","last_fullsized":"2024-09-19T07:11:03.279425+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:37.875779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.283851+0000","last_change":"2024-09-19T07:09:18.934205+0000","last_active":"2024-09-19T07:11:03.283851+0000","last_peered":"2024-09-19T07:11:03.283851+0000","last_clean":"2024-09-19T07:11:03.283851+0000","last_became_active":"2024-09-19T07:09:18.933767+0000","last_became_peered":"2024-09-19T07:09:18.933767+0000","last_unstale":"2024-09-19T07:11:03.283851+0000","last_undegraded":"2024-09-19T07:11:03.283851+0000","last_fullsized":"2024-09-19T07:11:03.283851+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:10:45.391428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.284092+0000","last_change":"2024-09-19T07:09:18.922312+0000","last_active":"2024-09-19T07:11:03.284092+0000","last_peered":"2024-09-19T07:11:03.284092+0000","last_clean":"2024-09-19T07:11:03.284092+0000","last_became_active":"2024-09-19T07:09:18.921476+0000","last_became_peered":"2024-09-19T07:09:18.921476+0000","last_unstale":"2024-09-19T07:11:03.284092+0000","last_undegraded":"2024-09-19T07:11:03.284092+0000","last_fullsized":"2024-09-19T07:11:03.284092+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:29.470616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.269605+0000","last_change":"2024-09-19T07:09:18.938218+0000","last_active":"2024-09-19T07:11:03.269605+0000","last_peered":"2024-09-19T07:11:03.269605+0000","last_clean":"2024-09-19T07:11:03.269605+0000","last_became_active":"2024-09-19T07:09:18.937306+0000","last_became_peered":"2024-09-19T07:09:18.937306+0000","last_unstale":"2024-09-19T07:11:03.269605+0000","last_undegraded":"2024-09-19T07:11:03.269605+0000","last_fullsized":"2024-09-19T07:11:03.269605+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:54.146506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.274574+0000","last_change":"2024-09-19T07:09:18.925837+0000","last_active":"2024-09-19T07:11:03.274574+0000","last_peered":"2024-09-19T07:11:03.274574+0000","last_clean":"2024-09-19T07:11:03.274574+0000","last_became_active":"2024-09-19T07:09:18.925559+0000","last_became_peered":"2024-09-19T07:09:18.925559+0000","last_unstale":"2024-09-19T07:11:03.274574+0000","last_undegraded":"2024-09-19T07:11:03.274574+0000","last_fullsized":"2024-09-19T07:11:03.274574+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:15:58.348347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.267010+0000","last_change":"2024-09-19T07:09:18.938911+0000","last_active":"2024-09-19T07:11:03.267010+0000","last_peered":"2024-09-19T07:11:03.267010+0000","last_clean":"2024-09-19T07:11:03.267010+0000","last_became_active":"2024-09-19T07:09:18.938601+0000","last_became_peered":"2024-09-19T07:09:18.938601+0000","last_unstale":"2024-09-19T07:11:03.267010+0000","last_undegraded":"2024-09-19T07:11:03.267010+0000","last_fullsized":"2024-09-19T07:11:03.267010+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:34.517324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.274002+0000","last_change":"2024-09-19T07:09:18.930253+0000","last_active":"2024-09-19T07:11:03.274002+0000","last_peered":"2024-09-19T07:11:03.274002+0000","last_clean":"2024-09-19T07:11:03.274002+0000","last_became_active":"2024-09-19T07:09:18.929927+0000","last_became_peered":"2024-09-19T07:09:18.929927+0000","last_unstale":"2024-09-19T07:11:03.274002+0000","last_undegraded":"2024-09-19T07:11:03.274002+0000","last_fullsized":"2024-09-19T07:11:03.274002+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:31:39.186230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"81'9","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.269452+0000","last_change":"2024-09-19T07:09:38.180197+0000","last_active":"2024-09-19T07:11:03.269452+0000","last_peered":"2024-09-19T07:11:03.269452+0000","last_clean":"2024-09-19T07:11:03.269452+0000","last_became_active":"2024-09-19T07:09:38.179767+0000","last_became_peered":"2024-09-19T07:09:38.179767+0000","last_unstale":"2024-09-19T07:11:03.269452+0000","last_undegraded":"2024-09-19T07:11:03.269452+0000","last_fullsized":"2024-09-19T07:11:03.269452+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:43.581181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.275716+0000","last_change":"2024-09-19T07:09:18.937100+0000","last_active":"2024-09-19T07:11:03.275716+0000","last_peered":"2024-09-19T07:11:03.275716+0000","last_clean":"2024-09-19T07:11:03.275716+0000","last_became_active":"2024-09-19T07:09:18.935151+0000","last_became_peered":"2024-09-19T07:09:18.935151+0000","last_unstale":"2024-09-19T07:11:03.275716+0000","last_undegraded":"2024-09-19T07:11:03.275716+0000","last_fullsized":"2024-09-19T07:11:03.275716+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:46:30.950667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.273140+0000","last_change":"2024-09-19T07:09:18.940119+0000","last_active":"2024-09-19T07:11:03.273140+0000","last_peered":"2024-09-19T07:11:03.273140+0000","last_clean":"2024-09-19T07:11:03.273140+0000","last_became_active":"2024-09-19T07:09:18.939703+0000","last_became_peered":"2024-09-19T07:09:18.939703+0000","last_unstale":"2024-09-19T07:11:03.273140+0000","last_undegraded":"2024-09-19T07:11:03.273140+0000","last_fullsized":"2024-09-19T07:11:03.273140+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:51:04.982727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.276689+0000","last_change":"2024-09-19T07:09:18.939146+0000","last_active":"2024-09-19T07:11:03.276689+0000","last_peered":"2024-09-19T07:11:03.276689+0000","last_clean":"2024-09-19T07:11:03.276689+0000","last_became_active":"2024-09-19T07:09:18.936842+0000","last_became_peered":"2024-09-19T07:09:18.936842+0000","last_unstale":"2024-09-19T07:11:03.276689+0000","last_undegraded":"2024-09-19T07:11:03.276689+0000","last_fullsized":"2024-09-19T07:11:03.276689+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:32.713505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.265688+0000","last_change":"2024-09-19T07:09:38.178834+0000","last_active":"2024-09-19T07:11:03.265688+0000","last_peered":"2024-09-19T07:11:03.265688+0000","last_clean":"2024-09-19T07:11:03.265688+0000","last_became_active":"2024-09-19T07:09:38.178477+0000","last_became_peered":"2024-09-19T07:09:38.178477+0000","last_unstale":"2024-09-19T07:11:03.265688+0000","last_undegraded":"2024-09-19T07:11:03.265688+0000","last_fullsized":"2024-09-19T07:11:03.265688+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:04:44.524920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.285948+0000","last_change":"2024-09-19T07:09:18.935422+0000","last_active":"2024-09-19T07:11:03.285948+0000","last_peered":"2024-09-19T07:11:03.285948+0000","last_clean":"2024-09-19T07:11:03.285948+0000","last_became_active":"2024-09-19T07:09:18.934994+0000","last_became_peered":"2024-09-19T07:09:18.934994+0000","last_unstale":"2024-09-19T07:11:03.285948+0000","last_undegraded":"2024-09-19T07:11:03.285948+0000","last_fullsized":"2024-09-19T07:11:03.285948+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:37:30.751247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.283787+0000","last_change":"2024-09-19T07:09:18.933954+0000","last_active":"2024-09-19T07:11:03.283787+0000","last_peered":"2024-09-19T07:11:03.283787+0000","last_clean":"2024-09-19T07:11:03.283787+0000","last_became_active":"2024-09-19T07:09:18.933588+0000","last_became_peered":"2024-09-19T07:09:18.933588+0000","last_unstale":"2024-09-19T07:11:03.283787+0000","last_undegraded":"2024-09-19T07:11:03.283787+0000","last_fullsized":"2024-09-19T07:11:03.283787+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:10.161172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.283035+0000","last_change":"2024-09-19T07:09:18.932122+0000","last_active":"2024-09-19T07:11:03.283035+0000","last_peered":"2024-09-19T07:11:03.283035+0000","last_clean":"2024-09-19T07:11:03.283035+0000","last_became_active":"2024-09-19T07:09:18.931798+0000","last_became_peered":"2024-09-19T07:09:18.931798+0000","last_unstale":"2024-09-19T07:11:03.283035+0000","last_undegraded":"2024-09-19T07:11:03.283035+0000","last_fullsized":"2024-09-19T07:11:03.283035+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:44.776375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.261952+0000","last_change":"2024-09-19T07:09:18.935632+0000","last_active":"2024-09-19T07:11:03.261952+0000","last_peered":"2024-09-19T07:11:03.261952+0000","last_clean":"2024-09-19T07:11:03.261952+0000","last_became_active":"2024-09-19T07:09:18.935174+0000","last_became_peered":"2024-09-19T07:09:18.935174+0000","last_unstale":"2024-09-19T07:11:03.261952+0000","last_undegraded":"2024-09-19T07:11:03.261952+0000","last_fullsized":"2024-09-19T07:11:03.261952+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:22.170777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.279662+0000","last_change":"2024-09-19T07:09:18.931836+0000","last_active":"2024-09-19T07:11:03.279662+0000","last_peered":"2024-09-19T07:11:03.279662+0000","last_clean":"2024-09-19T07:11:03.279662+0000","last_became_active":"2024-09-19T07:09:18.931564+0000","last_became_peered":"2024-09-19T07:09:18.931564+0000","last_unstale":"2024-09-19T07:11:03.279662+0000","last_undegraded":"2024-09-19T07:11:03.279662+0000","last_fullsized":"2024-09-19T07:11:03.279662+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:53.674584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.263261+0000","last_change":"2024-09-19T07:09:18.933210+0000","last_active":"2024-09-19T07:11:03.263261+0000","last_peered":"2024-09-19T07:11:03.263261+0000","last_clean":"2024-09-19T07:11:03.263261+0000","last_became_active":"2024-09-19T07:09:18.932894+0000","last_became_peered":"2024-09-19T07:09:18.932894+0000","last_unstale":"2024-09-19T07:11:03.263261+0000","last_undegraded":"2024-09-19T07:11:03.263261+0000","last_fullsized":"2024-09-19T07:11:03.263261+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:50:56.669801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.281347+0000","last_change":"2024-09-19T07:09:18.925627+0000","last_active":"2024-09-19T07:11:03.281347+0000","last_peered":"2024-09-19T07:11:03.281347+0000","last_clean":"2024-09-19T07:11:03.281347+0000","last_became_active":"2024-09-19T07:09:18.925340+0000","last_became_peered":"2024-09-19T07:09:18.925340+0000","last_unstale":"2024-09-19T07:11:03.281347+0000","last_undegraded":"2024-09-19T07:11:03.281347+0000","last_fullsized":"2024-09-19T07:11:03.281347+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:29.544534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.275601+0000","last_change":"2024-09-19T07:09:18.936963+0000","last_active":"2024-09-19T07:11:03.275601+0000","last_peered":"2024-09-19T07:11:03.275601+0000","last_clean":"2024-09-19T07:11:03.275601+0000","last_became_active":"2024-09-19T07:09:18.936615+0000","last_became_peered":"2024-09-19T07:09:18.936615+0000","last_unstale":"2024-09-19T07:11:03.275601+0000","last_undegraded":"2024-09-19T07:11:03.275601+0000","last_fullsized":"2024-09-19T07:11:03.275601+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:13.036392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.285146+0000","last_change":"2024-09-19T07:09:18.932018+0000","last_active":"2024-09-19T07:11:03.285146+0000","last_peered":"2024-09-19T07:11:03.285146+0000","last_clean":"2024-09-19T07:11:03.285146+0000","last_became_active":"2024-09-19T07:09:18.931624+0000","last_became_peered":"2024-09-19T07:09:18.931624+0000","last_unstale":"2024-09-19T07:11:03.285146+0000","last_undegraded":"2024-09-19T07:11:03.285146+0000","last_fullsized":"2024-09-19T07:11:03.285146+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:53:05.585166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.265530+0000","last_change":"2024-09-19T07:09:18.935474+0000","last_active":"2024-09-19T07:11:03.265530+0000","last_peered":"2024-09-19T07:11:03.265530+0000","last_clean":"2024-09-19T07:11:03.265530+0000","last_became_active":"2024-09-19T07:09:18.929018+0000","last_became_peered":"2024-09-19T07:09:18.929018+0000","last_unstale":"2024-09-19T07:11:03.265530+0000","last_undegraded":"2024-09-19T07:11:03.265530+0000","last_fullsized":"2024-09-19T07:11:03.265530+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:01.383024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.276949+0000","last_change":"2024-09-19T07:09:18.928733+0000","last_active":"2024-09-19T07:11:03.276949+0000","last_peered":"2024-09-19T07:11:03.276949+0000","last_clean":"2024-09-19T07:11:03.276949+0000","last_became_active":"2024-09-19T07:09:18.928431+0000","last_became_peered":"2024-09-19T07:09:18.928431+0000","last_unstale":"2024-09-19T07:11:03.276949+0000","last_undegraded":"2024-09-19T07:11:03.276949+0000","last_fullsized":"2024-09-19T07:11:03.276949+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:37.313958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.268113+0000","last_change":"2024-09-19T07:09:18.921268+0000","last_active":"2024-09-19T07:11:03.268113+0000","last_peered":"2024-09-19T07:11:03.268113+0000","last_clean":"2024-09-19T07:11:03.268113+0000","last_became_active":"2024-09-19T07:09:18.920482+0000","last_became_peered":"2024-09-19T07:09:18.920482+0000","last_unstale":"2024-09-19T07:11:03.268113+0000","last_undegraded":"2024-09-19T07:11:03.268113+0000","last_fullsized":"2024-09-19T07:11:03.268113+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:35.201826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"81'2","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.269267+0000","last_change":"2024-09-19T07:09:38.179136+0000","last_active":"2024-09-19T07:11:03.269267+0000","last_peered":"2024-09-19T07:11:03.269267+0000","last_clean":"2024-09-19T07:11:03.269267+0000","last_became_active":"2024-09-19T07:09:38.178746+0000","last_became_peered":"2024-09-19T07:09:38.178746+0000","last_unstale":"2024-09-19T07:11:03.269267+0000","last_undegraded":"2024-09-19T07:11:03.269267+0000","last_fullsized":"2024-09-19T07:11:03.269267+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:03.788114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.280523+0000","last_change":"2024-09-19T07:09:18.924099+0000","last_active":"2024-09-19T07:11:03.280523+0000","last_peered":"2024-09-19T07:11:03.280523+0000","last_clean":"2024-09-19T07:11:03.280523+0000","last_became_active":"2024-09-19T07:09:18.923772+0000","last_became_peered":"2024-09-19T07:09:18.923772+0000","last_unstale":"2024-09-19T07:11:03.280523+0000","last_undegraded":"2024-09-19T07:11:03.280523+0000","last_fullsized":"2024-09-19T07:11:03.280523+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:05:04.954087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.271340+0000","last_change":"2024-09-19T07:09:18.923391+0000","last_active":"2024-09-19T07:11:03.271340+0000","last_peered":"2024-09-19T07:11:03.271340+0000","last_clean":"2024-09-19T07:11:03.271340+0000","last_became_active":"2024-09-19T07:09:18.923085+0000","last_became_peered":"2024-09-19T07:09:18.923085+0000","last_unstale":"2024-09-19T07:11:03.271340+0000","last_undegraded":"2024-09-19T07:11:03.271340+0000","last_fullsized":"2024-09-19T07:11:03.271340+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:43:27.032400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.283075+0000","last_change":"2024-09-19T07:09:18.937188+0000","last_active":"2024-09-19T07:11:03.283075+0000","last_peered":"2024-09-19T07:11:03.283075+0000","last_clean":"2024-09-19T07:11:03.283075+0000","last_became_active":"2024-09-19T07:09:18.936866+0000","last_became_peered":"2024-09-19T07:09:18.936866+0000","last_unstale":"2024-09-19T07:11:03.283075+0000","last_undegraded":"2024-09-19T07:11:03.283075+0000","last_fullsized":"2024-09-19T07:11:03.283075+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:29:08.835307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.284272+0000","last_change":"2024-09-19T07:09:18.935170+0000","last_active":"2024-09-19T07:11:03.284272+0000","last_peered":"2024-09-19T07:11:03.284272+0000","last_clean":"2024-09-19T07:11:03.284272+0000","last_became_active":"2024-09-19T07:09:18.934356+0000","last_became_peered":"2024-09-19T07:09:18.934356+0000","last_unstale":"2024-09-19T07:11:03.284272+0000","last_undegraded":"2024-09-19T07:11:03.284272+0000","last_fullsized":"2024-09-19T07:11:03.284272+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:53.567392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.285704+0000","last_change":"2024-09-19T07:09:18.922640+0000","last_active":"2024-09-19T07:11:03.285704+0000","last_peered":"2024-09-19T07:11:03.285704+0000","last_clean":"2024-09-19T07:11:03.285704+0000","last_became_active":"2024-09-19T07:09:18.922312+0000","last_became_peered":"2024-09-19T07:09:18.922312+0000","last_unstale":"2024-09-19T07:11:03.285704+0000","last_undegraded":"2024-09-19T07:11:03.285704+0000","last_fullsized":"2024-09-19T07:11:03.285704+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:50.868818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.280468+0000","last_change":"2024-09-19T07:09:18.934364+0000","last_active":"2024-09-19T07:11:03.280468+0000","last_peered":"2024-09-19T07:11:03.280468+0000","last_clean":"2024-09-19T07:11:03.280468+0000","last_became_active":"2024-09-19T07:09:18.933533+0000","last_became_peered":"2024-09-19T07:09:18.933533+0000","last_unstale":"2024-09-19T07:11:03.280468+0000","last_undegraded":"2024-09-19T07:11:03.280468+0000","last_fullsized":"2024-09-19T07:11:03.280468+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:54.175425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.274368+0000","last_change":"2024-09-19T07:09:18.927456+0000","last_active":"2024-09-19T07:11:03.274368+0000","last_peered":"2024-09-19T07:11:03.274368+0000","last_clean":"2024-09-19T07:11:03.274368+0000","last_became_active":"2024-09-19T07:09:18.927117+0000","last_became_peered":"2024-09-19T07:09:18.927117+0000","last_unstale":"2024-09-19T07:11:03.274368+0000","last_undegraded":"2024-09-19T07:11:03.274368+0000","last_fullsized":"2024-09-19T07:11:03.274368+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:08.885898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.271805+0000","last_change":"2024-09-19T07:09:18.926024+0000","last_active":"2024-09-19T07:11:03.271805+0000","last_peered":"2024-09-19T07:11:03.271805+0000","last_clean":"2024-09-19T07:11:03.271805+0000","last_became_active":"2024-09-19T07:09:18.925689+0000","last_became_peered":"2024-09-19T07:09:18.925689+0000","last_unstale":"2024-09-19T07:11:03.271805+0000","last_undegraded":"2024-09-19T07:11:03.271805+0000","last_fullsized":"2024-09-19T07:11:03.271805+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:09:08.178214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'10","reported_seq":135,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:04.129081+0000","last_change":"2024-09-19T07:09:16.915804+0000","last_active":"2024-09-19T07:11:04.129081+0000","last_peered":"2024-09-19T07:11:04.129081+0000","last_clean":"2024-09-19T07:11:04.129081+0000","last_became_active":"2024-09-19T07:09:16.915434+0000","last_became_peered":"2024-09-19T07:09:16.915434+0000","last_unstale":"2024-09-19T07:11:04.129081+0000","last_undegraded":"2024-09-19T07:11:04.129081+0000","last_fullsized":"2024-09-19T07:11:04.129081+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:57.230475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2250,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":5,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.271307+0000","last_change":"2024-09-19T07:09:18.932497+0000","last_active":"2024-09-19T07:11:03.271307+0000","last_peered":"2024-09-19T07:11:03.271307+0000","last_clean":"2024-09-19T07:11:03.271307+0000","last_became_active":"2024-09-19T07:09:18.932213+0000","last_became_peered":"2024-09-19T07:09:18.932213+0000","last_unstale":"2024-09-19T07:11:03.271307+0000","last_undegraded":"2024-09-19T07:11:03.271307+0000","last_fullsized":"2024-09-19T07:11:03.271307+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:10.299077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.233512+0000","last_change":"2024-09-19T07:09:16.910171+0000","last_active":"2024-09-19T07:11:03.233512+0000","last_peered":"2024-09-19T07:11:03.233512+0000","last_clean":"2024-09-19T07:11:03.233512+0000","last_became_active":"2024-09-19T07:09:16.909840+0000","last_became_peered":"2024-09-19T07:09:16.909840+0000","last_unstale":"2024-09-19T07:11:03.233512+0000","last_undegraded":"2024-09-19T07:11:03.233512+0000","last_fullsized":"2024-09-19T07:11:03.233512+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:35.448892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.229456+0000","last_change":"2024-09-19T07:09:16.911336+0000","last_active":"2024-09-19T07:11:03.229456+0000","last_peered":"2024-09-19T07:11:03.229456+0000","last_clean":"2024-09-19T07:11:03.229456+0000","last_became_active":"2024-09-19T07:09:16.911027+0000","last_became_peered":"2024-09-19T07:09:16.911027+0000","last_unstale":"2024-09-19T07:11:03.229456+0000","last_undegraded":"2024-09-19T07:11:03.229456+0000","last_fullsized":"2024-09-19T07:11:03.229456+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:37:50.698597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.278229+0000","last_change":"2024-09-19T07:09:18.927713+0000","last_active":"2024-09-19T07:11:03.278229+0000","last_peered":"2024-09-19T07:11:03.278229+0000","last_clean":"2024-09-19T07:11:03.278229+0000","last_became_active":"2024-09-19T07:09:18.927430+0000","last_became_peered":"2024-09-19T07:09:18.927430+0000","last_unstale":"2024-09-19T07:11:03.278229+0000","last_undegraded":"2024-09-19T07:11:03.278229+0000","last_fullsized":"2024-09-19T07:11:03.278229+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:15:07.707723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.236756+0000","last_change":"2024-09-19T07:09:16.912391+0000","last_active":"2024-09-19T07:11:03.236756+0000","last_peered":"2024-09-19T07:11:03.236756+0000","last_clean":"2024-09-19T07:11:03.236756+0000","last_became_active":"2024-09-19T07:09:16.912034+0000","last_became_peered":"2024-09-19T07:09:16.912034+0000","last_unstale":"2024-09-19T07:11:03.236756+0000","last_undegraded":"2024-09-19T07:11:03.236756+0000","last_fullsized":"2024-09-19T07:11:03.236756+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:18:45.226107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.269888+0000","last_change":"2024-09-19T07:09:18.929476+0000","last_active":"2024-09-19T07:11:03.269888+0000","last_peered":"2024-09-19T07:11:03.269888+0000","last_clean":"2024-09-19T07:11:03.269888+0000","last_became_active":"2024-09-19T07:09:18.929183+0000","last_became_peered":"2024-09-19T07:09:18.929183+0000","last_unstale":"2024-09-19T07:11:03.269888+0000","last_undegraded":"2024-09-19T07:11:03.269888+0000","last_fullsized":"2024-09-19T07:11:03.269888+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:19:38.827130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":124,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.233366+0000","last_change":"2024-09-19T07:09:16.913012+0000","last_active":"2024-09-19T07:11:03.233366+0000","last_peered":"2024-09-19T07:11:03.233366+0000","last_clean":"2024-09-19T07:11:03.233366+0000","last_became_active":"2024-09-19T07:09:16.912633+0000","last_became_peered":"2024-09-19T07:09:16.912633+0000","last_unstale":"2024-09-19T07:11:03.233366+0000","last_undegraded":"2024-09-19T07:11:03.233366+0000","last_fullsized":"2024-09-19T07:11:03.233366+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:21:39.669961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":96,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.262229+0000","last_change":"2024-09-19T07:09:18.937323+0000","last_active":"2024-09-19T07:11:03.262229+0000","last_peered":"2024-09-19T07:11:03.262229+0000","last_clean":"2024-09-19T07:11:03.262229+0000","last_became_active":"2024-09-19T07:09:18.936762+0000","last_became_peered":"2024-09-19T07:09:18.936762+0000","last_unstale":"2024-09-19T07:11:03.262229+0000","last_undegraded":"2024-09-19T07:11:03.262229+0000","last_fullsized":"2024-09-19T07:11:03.262229+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:37.692290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.234308+0000","last_change":"2024-09-19T07:09:16.912167+0000","last_active":"2024-09-19T07:11:03.234308+0000","last_peered":"2024-09-19T07:11:03.234308+0000","last_clean":"2024-09-19T07:11:03.234308+0000","last_became_active":"2024-09-19T07:09:16.911840+0000","last_became_peered":"2024-09-19T07:09:16.911840+0000","last_unstale":"2024-09-19T07:11:03.234308+0000","last_undegraded":"2024-09-19T07:11:03.234308+0000","last_fullsized":"2024-09-19T07:11:03.234308+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:31.901906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.283235+0000","last_change":"2024-09-19T07:09:18.932239+0000","last_active":"2024-09-19T07:11:03.283235+0000","last_peered":"2024-09-19T07:11:03.283235+0000","last_clean":"2024-09-19T07:11:03.283235+0000","last_became_active":"2024-09-19T07:09:18.931820+0000","last_became_peered":"2024-09-19T07:09:18.931820+0000","last_unstale":"2024-09-19T07:11:03.283235+0000","last_undegraded":"2024-09-19T07:11:03.283235+0000","last_fullsized":"2024-09-19T07:11:03.283235+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:09.407524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.236809+0000","last_change":"2024-09-19T07:09:17.085077+0000","last_active":"2024-09-19T07:11:03.236809+0000","last_peered":"2024-09-19T07:11:03.236809+0000","last_clean":"2024-09-19T07:11:03.236809+0000","last_became_active":"2024-09-19T07:09:17.084457+0000","last_became_peered":"2024-09-19T07:09:17.084457+0000","last_unstale":"2024-09-19T07:11:03.236809+0000","last_undegraded":"2024-09-19T07:11:03.236809+0000","last_fullsized":"2024-09-19T07:11:03.236809+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:42.416193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.276315+0000","last_change":"2024-09-19T07:09:18.939830+0000","last_active":"2024-09-19T07:11:03.276315+0000","last_peered":"2024-09-19T07:11:03.276315+0000","last_clean":"2024-09-19T07:11:03.276315+0000","last_became_active":"2024-09-19T07:09:18.939359+0000","last_became_peered":"2024-09-19T07:09:18.939359+0000","last_unstale":"2024-09-19T07:11:03.276315+0000","last_undegraded":"2024-09-19T07:11:03.276315+0000","last_fullsized":"2024-09-19T07:11:03.276315+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:24:46.241902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'34","reported_seq":278,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.510608+0000","last_change":"2024-09-19T07:09:38.227707+0000","last_active":"2024-09-19T07:11:03.510608+0000","last_peered":"2024-09-19T07:11:03.510608+0000","last_clean":"2024-09-19T07:11:03.510608+0000","last_became_active":"2024-09-19T07:09:38.219073+0000","last_became_peered":"2024-09-19T07:09:38.219073+0000","last_unstale":"2024-09-19T07:11:03.510608+0000","last_undegraded":"2024-09-19T07:11:03.510608+0000","last_fullsized":"2024-09-19T07:11:03.510608+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:46.035315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66480,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":199,"num_read_kb":158,"num_write":35,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":26947,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.270480+0000","last_change":"2024-09-19T07:09:18.929531+0000","last_active":"2024-09-19T07:11:03.270480+0000","last_peered":"2024-09-19T07:11:03.270480+0000","last_clean":"2024-09-19T07:11:03.270480+0000","last_became_active":"2024-09-19T07:09:18.929253+0000","last_became_peered":"2024-09-19T07:09:18.929253+0000","last_unstale":"2024-09-19T07:11:03.270480+0000","last_undegraded":"2024-09-19T07:11:03.270480+0000","last_fullsized":"2024-09-19T07:11:03.270480+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:10.635116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.238624+0000","last_change":"2024-09-19T07:09:16.914964+0000","last_active":"2024-09-19T07:11:03.238624+0000","last_peered":"2024-09-19T07:11:03.238624+0000","last_clean":"2024-09-19T07:11:03.238624+0000","last_became_active":"2024-09-19T07:09:16.914540+0000","last_became_peered":"2024-09-19T07:09:16.914540+0000","last_unstale":"2024-09-19T07:11:03.238624+0000","last_undegraded":"2024-09-19T07:11:03.238624+0000","last_fullsized":"2024-09-19T07:11:03.238624+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:30.903046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.284691+0000","last_change":"2024-09-19T07:09:18.931709+0000","last_active":"2024-09-19T07:11:03.284691+0000","last_peered":"2024-09-19T07:11:03.284691+0000","last_clean":"2024-09-19T07:11:03.284691+0000","last_became_active":"2024-09-19T07:09:18.931345+0000","last_became_peered":"2024-09-19T07:09:18.931345+0000","last_unstale":"2024-09-19T07:11:03.284691+0000","last_undegraded":"2024-09-19T07:11:03.284691+0000","last_fullsized":"2024-09-19T07:11:03.284691+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:28.916820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.236617+0000","last_change":"2024-09-19T07:09:16.914055+0000","last_active":"2024-09-19T07:11:03.236617+0000","last_peered":"2024-09-19T07:11:03.236617+0000","last_clean":"2024-09-19T07:11:03.236617+0000","last_became_active":"2024-09-19T07:09:16.913589+0000","last_became_peered":"2024-09-19T07:09:16.913589+0000","last_unstale":"2024-09-19T07:11:03.236617+0000","last_undegraded":"2024-09-19T07:11:03.236617+0000","last_fullsized":"2024-09-19T07:11:03.236617+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:29:16.322059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"81'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.285962+0000","last_change":"2024-09-19T07:09:18.934879+0000","last_active":"2024-09-19T07:11:03.285962+0000","last_peered":"2024-09-19T07:11:03.285962+0000","last_clean":"2024-09-19T07:11:03.285962+0000","last_became_active":"2024-09-19T07:09:18.934432+0000","last_became_peered":"2024-09-19T07:09:18.934432+0000","last_unstale":"2024-09-19T07:11:03.285962+0000","last_undegraded":"2024-09-19T07:11:03.285962+0000","last_fullsized":"2024-09-19T07:11:03.285962+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:25.782782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'7","reported_seq":131,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:04.128586+0000","last_change":"2024-09-19T07:09:16.909256+0000","last_active":"2024-09-19T07:11:04.128586+0000","last_peered":"2024-09-19T07:11:04.128586+0000","last_clean":"2024-09-19T07:11:04.128586+0000","last_became_active":"2024-09-19T07:09:16.908932+0000","last_became_peered":"2024-09-19T07:09:16.908932+0000","last_unstale":"2024-09-19T07:11:04.128586+0000","last_undegraded":"2024-09-19T07:11:04.128586+0000","last_fullsized":"2024-09-19T07:11:04.128586+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:28.344756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1908,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":5,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.270197+0000","last_change":"2024-09-19T07:09:18.931844+0000","last_active":"2024-09-19T07:11:03.270197+0000","last_peered":"2024-09-19T07:11:03.270197+0000","last_clean":"2024-09-19T07:11:03.270197+0000","last_became_active":"2024-09-19T07:09:18.931516+0000","last_became_peered":"2024-09-19T07:09:18.931516+0000","last_unstale":"2024-09-19T07:11:03.270197+0000","last_undegraded":"2024-09-19T07:11:03.270197+0000","last_fullsized":"2024-09-19T07:11:03.270197+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:27:29.812144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.247165+0000","last_change":"2024-09-19T07:09:17.085252+0000","last_active":"2024-09-19T07:11:03.247165+0000","last_peered":"2024-09-19T07:11:03.247165+0000","last_clean":"2024-09-19T07:11:03.247165+0000","last_became_active":"2024-09-19T07:09:17.084907+0000","last_became_peered":"2024-09-19T07:09:17.084907+0000","last_unstale":"2024-09-19T07:11:03.247165+0000","last_undegraded":"2024-09-19T07:11:03.247165+0000","last_fullsized":"2024-09-19T07:11:03.247165+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:59:40.351181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.269674+0000","last_change":"2024-09-19T07:09:18.932491+0000","last_active":"2024-09-19T07:11:03.269674+0000","last_peered":"2024-09-19T07:11:03.269674+0000","last_clean":"2024-09-19T07:11:03.269674+0000","last_became_active":"2024-09-19T07:09:18.932159+0000","last_became_peered":"2024-09-19T07:09:18.932159+0000","last_unstale":"2024-09-19T07:11:03.269674+0000","last_undegraded":"2024-09-19T07:11:03.269674+0000","last_fullsized":"2024-09-19T07:11:03.269674+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:31.144130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'3","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.247568+0000","last_change":"2024-09-19T07:09:16.911012+0000","last_active":"2024-09-19T07:11:03.247568+0000","last_peered":"2024-09-19T07:11:03.247568+0000","last_clean":"2024-09-19T07:11:03.247568+0000","last_became_active":"2024-09-19T07:09:16.910618+0000","last_became_peered":"2024-09-19T07:09:16.910618+0000","last_unstale":"2024-09-19T07:11:03.247568+0000","last_undegraded":"2024-09-19T07:11:03.247568+0000","last_fullsized":"2024-09-19T07:11:03.247568+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:16.316680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"81'5","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.267441+0000","last_change":"2024-09-19T07:09:38.217870+0000","last_active":"2024-09-19T07:11:03.267441+0000","last_peered":"2024-09-19T07:11:03.267441+0000","last_clean":"2024-09-19T07:11:03.267441+0000","last_became_active":"2024-09-19T07:09:38.217585+0000","last_became_peered":"2024-09-19T07:09:38.217585+0000","last_unstale":"2024-09-19T07:11:03.267441+0000","last_undegraded":"2024-09-19T07:11:03.267441+0000","last_fullsized":"2024-09-19T07:11:03.267441+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:41.320705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.229695+0000","last_change":"2024-09-19T07:09:16.911644+0000","last_active":"2024-09-19T07:11:03.229695+0000","last_peered":"2024-09-19T07:11:03.229695+0000","last_clean":"2024-09-19T07:11:03.229695+0000","last_became_active":"2024-09-19T07:09:16.911368+0000","last_became_peered":"2024-09-19T07:09:16.911368+0000","last_unstale":"2024-09-19T07:11:03.229695+0000","last_undegraded":"2024-09-19T07:11:03.229695+0000","last_fullsized":"2024-09-19T07:11:03.229695+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:12.953466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.274357+0000","last_change":"2024-09-19T07:09:18.933667+0000","last_active":"2024-09-19T07:11:03.274357+0000","last_peered":"2024-09-19T07:11:03.274357+0000","last_clean":"2024-09-19T07:11:03.274357+0000","last_became_active":"2024-09-19T07:09:18.933288+0000","last_became_peered":"2024-09-19T07:09:18.933288+0000","last_unstale":"2024-09-19T07:11:03.274357+0000","last_undegraded":"2024-09-19T07:11:03.274357+0000","last_fullsized":"2024-09-19T07:11:03.274357+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:54:38.127799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'39","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.462058+0000","last_change":"2024-09-19T07:09:16.909722+0000","last_active":"2024-09-19T07:11:03.462058+0000","last_peered":"2024-09-19T07:11:03.462058+0000","last_clean":"2024-09-19T07:11:03.462058+0000","last_became_active":"2024-09-19T07:09:16.909394+0000","last_became_peered":"2024-09-19T07:09:16.909394+0000","last_unstale":"2024-09-19T07:11:03.462058+0000","last_undegraded":"2024-09-19T07:11:03.462058+0000","last_fullsized":"2024-09-19T07:11:03.462058+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:21:53.342710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.269158+0000","last_change":"2024-09-19T07:09:18.929473+0000","last_active":"2024-09-19T07:11:03.269158+0000","last_peered":"2024-09-19T07:11:03.269158+0000","last_clean":"2024-09-19T07:11:03.269158+0000","last_became_active":"2024-09-19T07:09:18.929176+0000","last_became_peered":"2024-09-19T07:09:18.929176+0000","last_unstale":"2024-09-19T07:11:03.269158+0000","last_undegraded":"2024-09-19T07:11:03.269158+0000","last_fullsized":"2024-09-19T07:11:03.269158+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:32:30.409528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.238675+0000","last_change":"2024-09-19T07:09:17.084868+0000","last_active":"2024-09-19T07:11:03.238675+0000","last_peered":"2024-09-19T07:11:03.238675+0000","last_clean":"2024-09-19T07:11:03.238675+0000","last_became_active":"2024-09-19T07:09:17.084448+0000","last_became_peered":"2024-09-19T07:09:17.084448+0000","last_unstale":"2024-09-19T07:11:03.238675+0000","last_undegraded":"2024-09-19T07:11:03.238675+0000","last_fullsized":"2024-09-19T07:11:03.238675+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:38.211697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.276801+0000","last_change":"2024-09-19T07:09:18.938865+0000","last_active":"2024-09-19T07:11:03.276801+0000","last_peered":"2024-09-19T07:11:03.276801+0000","last_clean":"2024-09-19T07:11:03.276801+0000","last_became_active":"2024-09-19T07:09:18.936324+0000","last_became_peered":"2024-09-19T07:09:18.936324+0000","last_unstale":"2024-09-19T07:11:03.276801+0000","last_undegraded":"2024-09-19T07:11:03.276801+0000","last_fullsized":"2024-09-19T07:11:03.276801+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:29:51.081140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":345,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.234069+0000","last_change":"2024-09-19T07:08:09.270850+0000","last_active":"2024-09-19T07:11:03.234069+0000","last_peered":"2024-09-19T07:11:03.234069+0000","last_clean":"2024-09-19T07:11:03.234069+0000","last_became_active":"2024-09-19T07:08:09.270308+0000","last_became_peered":"2024-09-19T07:08:09.270308+0000","last_unstale":"2024-09-19T07:11:03.234069+0000","last_undegraded":"2024-09-19T07:11:03.234069+0000","last_fullsized":"2024-09-19T07:11:03.234069+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:04:49.729632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:04:49.729632+0000","last_clean_scrub_stamp":"2024-09-19T07:04:49.729632+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:15.588732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.231213+0000","last_change":"2024-09-19T07:09:16.907648+0000","last_active":"2024-09-19T07:11:03.231213+0000","last_peered":"2024-09-19T07:11:03.231213+0000","last_clean":"2024-09-19T07:11:03.231213+0000","last_became_active":"2024-09-19T07:09:16.907363+0000","last_became_peered":"2024-09-19T07:09:16.907363+0000","last_unstale":"2024-09-19T07:11:03.231213+0000","last_undegraded":"2024-09-19T07:11:03.231213+0000","last_fullsized":"2024-09-19T07:11:03.231213+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:12:27.898493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.275674+0000","last_change":"2024-09-19T07:09:18.926008+0000","last_active":"2024-09-19T07:11:03.275674+0000","last_peered":"2024-09-19T07:11:03.275674+0000","last_clean":"2024-09-19T07:11:03.275674+0000","last_became_active":"2024-09-19T07:09:18.925689+0000","last_became_peered":"2024-09-19T07:09:18.925689+0000","last_unstale":"2024-09-19T07:11:03.275674+0000","last_undegraded":"2024-09-19T07:11:03.275674+0000","last_fullsized":"2024-09-19T07:11:03.275674+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:16:06.467934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.233965+0000","last_change":"2024-09-19T07:09:16.911327+0000","last_active":"2024-09-19T07:11:03.233965+0000","last_peered":"2024-09-19T07:11:03.233965+0000","last_clean":"2024-09-19T07:11:03.233965+0000","last_became_active":"2024-09-19T07:09:16.911031+0000","last_became_peered":"2024-09-19T07:09:16.911031+0000","last_unstale":"2024-09-19T07:11:03.233965+0000","last_undegraded":"2024-09-19T07:11:03.233965+0000","last_fullsized":"2024-09-19T07:11:03.233965+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:03.307119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.280334+0000","last_change":"2024-09-19T07:09:18.933813+0000","last_active":"2024-09-19T07:11:03.280334+0000","last_peered":"2024-09-19T07:11:03.280334+0000","last_clean":"2024-09-19T07:11:03.280334+0000","last_became_active":"2024-09-19T07:09:18.933475+0000","last_became_peered":"2024-09-19T07:09:18.933475+0000","last_unstale":"2024-09-19T07:11:03.280334+0000","last_undegraded":"2024-09-19T07:11:03.280334+0000","last_fullsized":"2024-09-19T07:11:03.280334+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:34:09.149593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.231831+0000","last_change":"2024-09-19T07:09:17.084833+0000","last_active":"2024-09-19T07:11:03.231831+0000","last_peered":"2024-09-19T07:11:03.231831+0000","last_clean":"2024-09-19T07:11:03.231831+0000","last_became_active":"2024-09-19T07:09:17.084477+0000","last_became_peered":"2024-09-19T07:09:17.084477+0000","last_unstale":"2024-09-19T07:11:03.231831+0000","last_undegraded":"2024-09-19T07:11:03.231831+0000","last_fullsized":"2024-09-19T07:11:03.231831+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:17:50.962480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":96,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.281019+0000","last_change":"2024-09-19T07:09:18.935991+0000","last_active":"2024-09-19T07:11:03.281019+0000","last_peered":"2024-09-19T07:11:03.281019+0000","last_clean":"2024-09-19T07:11:03.281019+0000","last_became_active":"2024-09-19T07:09:18.935677+0000","last_became_peered":"2024-09-19T07:09:18.935677+0000","last_unstale":"2024-09-19T07:11:03.281019+0000","last_undegraded":"2024-09-19T07:11:03.281019+0000","last_fullsized":"2024-09-19T07:11:03.281019+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:45.550119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.234872+0000","last_change":"2024-09-19T07:09:16.911755+0000","last_active":"2024-09-19T07:11:03.234872+0000","last_peered":"2024-09-19T07:11:03.234872+0000","last_clean":"2024-09-19T07:11:03.234872+0000","last_became_active":"2024-09-19T07:09:16.911211+0000","last_became_peered":"2024-09-19T07:09:16.911211+0000","last_unstale":"2024-09-19T07:11:03.234872+0000","last_undegraded":"2024-09-19T07:11:03.234872+0000","last_fullsized":"2024-09-19T07:11:03.234872+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:15.365423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.265945+0000","last_change":"2024-09-19T07:09:18.940282+0000","last_active":"2024-09-19T07:11:03.265945+0000","last_peered":"2024-09-19T07:11:03.265945+0000","last_clean":"2024-09-19T07:11:03.265945+0000","last_became_active":"2024-09-19T07:09:18.939918+0000","last_became_peered":"2024-09-19T07:09:18.939918+0000","last_unstale":"2024-09-19T07:11:03.265945+0000","last_undegraded":"2024-09-19T07:11:03.265945+0000","last_fullsized":"2024-09-19T07:11:03.265945+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:11.161676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.242639+0000","last_change":"2024-09-19T07:09:17.086103+0000","last_active":"2024-09-19T07:11:03.242639+0000","last_peered":"2024-09-19T07:11:03.242639+0000","last_clean":"2024-09-19T07:11:03.242639+0000","last_became_active":"2024-09-19T07:09:17.085805+0000","last_became_peered":"2024-09-19T07:09:17.085805+0000","last_unstale":"2024-09-19T07:11:03.242639+0000","last_undegraded":"2024-09-19T07:11:03.242639+0000","last_fullsized":"2024-09-19T07:11:03.242639+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:28.522487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.284777+0000","last_change":"2024-09-19T07:09:18.932603+0000","last_active":"2024-09-19T07:11:03.284777+0000","last_peered":"2024-09-19T07:11:03.284777+0000","last_clean":"2024-09-19T07:11:03.284777+0000","last_became_active":"2024-09-19T07:09:18.932309+0000","last_became_peered":"2024-09-19T07:09:18.932309+0000","last_unstale":"2024-09-19T07:11:03.284777+0000","last_undegraded":"2024-09-19T07:11:03.284777+0000","last_fullsized":"2024-09-19T07:11:03.284777+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:19.746024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.245199+0000","last_change":"2024-09-19T07:09:17.085287+0000","last_active":"2024-09-19T07:11:03.245199+0000","last_peered":"2024-09-19T07:11:03.245199+0000","last_clean":"2024-09-19T07:11:03.245199+0000","last_became_active":"2024-09-19T07:09:17.084964+0000","last_became_peered":"2024-09-19T07:09:17.084964+0000","last_unstale":"2024-09-19T07:11:03.245199+0000","last_undegraded":"2024-09-19T07:11:03.245199+0000","last_fullsized":"2024-09-19T07:11:03.245199+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:51:01.035344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.287453+0000","last_change":"2024-09-19T07:09:18.921623+0000","last_active":"2024-09-19T07:11:03.287453+0000","last_peered":"2024-09-19T07:11:03.287453+0000","last_clean":"2024-09-19T07:11:03.287453+0000","last_became_active":"2024-09-19T07:09:18.921321+0000","last_became_peered":"2024-09-19T07:09:18.921321+0000","last_unstale":"2024-09-19T07:11:03.287453+0000","last_undegraded":"2024-09-19T07:11:03.287453+0000","last_fullsized":"2024-09-19T07:11:03.287453+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:28:55.616889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'47","reported_seq":94,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.468956+0000","last_change":"2024-09-19T07:09:16.910251+0000","last_active":"2024-09-19T07:11:03.468956+0000","last_peered":"2024-09-19T07:11:03.468956+0000","last_clean":"2024-09-19T07:11:03.468956+0000","last_became_active":"2024-09-19T07:09:16.909821+0000","last_became_peered":"2024-09-19T07:09:16.909821+0000","last_unstale":"2024-09-19T07:11:03.468956+0000","last_undegraded":"2024-09-19T07:11:03.468956+0000","last_fullsized":"2024-09-19T07:11:03.468956+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:02.958557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":86,"num_write_kb":839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.268601+0000","last_change":"2024-09-19T07:09:18.930831+0000","last_active":"2024-09-19T07:11:03.268601+0000","last_peered":"2024-09-19T07:11:03.268601+0000","last_clean":"2024-09-19T07:11:03.268601+0000","last_became_active":"2024-09-19T07:09:18.930475+0000","last_became_peered":"2024-09-19T07:09:18.930475+0000","last_unstale":"2024-09-19T07:11:03.268601+0000","last_undegraded":"2024-09-19T07:11:03.268601+0000","last_fullsized":"2024-09-19T07:11:03.268601+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:30.512246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.231362+0000","last_change":"2024-09-19T07:09:16.906666+0000","last_active":"2024-09-19T07:11:03.231362+0000","last_peered":"2024-09-19T07:11:03.231362+0000","last_clean":"2024-09-19T07:11:03.231362+0000","last_became_active":"2024-09-19T07:09:16.906369+0000","last_became_peered":"2024-09-19T07:09:16.906369+0000","last_unstale":"2024-09-19T07:11:03.231362+0000","last_undegraded":"2024-09-19T07:11:03.231362+0000","last_fullsized":"2024-09-19T07:11:03.231362+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:56.915089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.280797+0000","last_change":"2024-09-19T07:09:18.934942+0000","last_active":"2024-09-19T07:11:03.280797+0000","last_peered":"2024-09-19T07:11:03.280797+0000","last_clean":"2024-09-19T07:11:03.280797+0000","last_became_active":"2024-09-19T07:09:18.934595+0000","last_became_peered":"2024-09-19T07:09:18.934595+0000","last_unstale":"2024-09-19T07:11:03.280797+0000","last_undegraded":"2024-09-19T07:11:03.280797+0000","last_fullsized":"2024-09-19T07:11:03.280797+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:54.306541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.239116+0000","last_change":"2024-09-19T07:09:38.183567+0000","last_active":"2024-09-19T07:11:03.239116+0000","last_peered":"2024-09-19T07:11:03.239116+0000","last_clean":"2024-09-19T07:11:03.239116+0000","last_became_active":"2024-09-19T07:09:38.180778+0000","last_became_peered":"2024-09-19T07:09:38.180778+0000","last_unstale":"2024-09-19T07:11:03.239116+0000","last_undegraded":"2024-09-19T07:11:03.239116+0000","last_fullsized":"2024-09-19T07:11:03.239116+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:43.226551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"81'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.260607+0000","last_change":"2024-09-19T07:09:18.934457+0000","last_active":"2024-09-19T07:11:03.260607+0000","last_peered":"2024-09-19T07:11:03.260607+0000","last_clean":"2024-09-19T07:11:03.260607+0000","last_became_active":"2024-09-19T07:09:18.934126+0000","last_became_peered":"2024-09-19T07:09:18.934126+0000","last_unstale":"2024-09-19T07:11:03.260607+0000","last_undegraded":"2024-09-19T07:11:03.260607+0000","last_fullsized":"2024-09-19T07:11:03.260607+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:37:16.152335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.231606+0000","last_change":"2024-09-19T07:09:16.908457+0000","last_active":"2024-09-19T07:11:03.231606+0000","last_peered":"2024-09-19T07:11:03.231606+0000","last_clean":"2024-09-19T07:11:03.231606+0000","last_became_active":"2024-09-19T07:09:16.908128+0000","last_became_peered":"2024-09-19T07:09:16.908128+0000","last_unstale":"2024-09-19T07:11:03.231606+0000","last_undegraded":"2024-09-19T07:11:03.231606+0000","last_fullsized":"2024-09-19T07:11:03.231606+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:48:50.579301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.273932+0000","last_change":"2024-09-19T07:09:18.928763+0000","last_active":"2024-09-19T07:11:03.273932+0000","last_peered":"2024-09-19T07:11:03.273932+0000","last_clean":"2024-09-19T07:11:03.273932+0000","last_became_active":"2024-09-19T07:09:18.928231+0000","last_became_peered":"2024-09-19T07:09:18.928231+0000","last_unstale":"2024-09-19T07:11:03.273932+0000","last_undegraded":"2024-09-19T07:11:03.273932+0000","last_fullsized":"2024-09-19T07:11:03.273932+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:26.652378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.238773+0000","last_change":"2024-09-19T07:09:16.913740+0000","last_active":"2024-09-19T07:11:03.238773+0000","last_peered":"2024-09-19T07:11:03.238773+0000","last_clean":"2024-09-19T07:11:03.238773+0000","last_became_active":"2024-09-19T07:09:16.912419+0000","last_became_peered":"2024-09-19T07:09:16.912419+0000","last_unstale":"2024-09-19T07:11:03.238773+0000","last_undegraded":"2024-09-19T07:11:03.238773+0000","last_fullsized":"2024-09-19T07:11:03.238773+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:16.658996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.283782+0000","last_change":"2024-09-19T07:09:18.930697+0000","last_active":"2024-09-19T07:11:03.283782+0000","last_peered":"2024-09-19T07:11:03.283782+0000","last_clean":"2024-09-19T07:11:03.283782+0000","last_became_active":"2024-09-19T07:09:18.930355+0000","last_became_peered":"2024-09-19T07:09:18.930355+0000","last_unstale":"2024-09-19T07:11:03.283782+0000","last_undegraded":"2024-09-19T07:11:03.283782+0000","last_fullsized":"2024-09-19T07:11:03.283782+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:07.217195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.228781+0000","last_change":"2024-09-19T07:09:38.183637+0000","last_active":"2024-09-19T07:11:03.228781+0000","last_peered":"2024-09-19T07:11:03.228781+0000","last_clean":"2024-09-19T07:11:03.228781+0000","last_became_active":"2024-09-19T07:09:38.178732+0000","last_became_peered":"2024-09-19T07:09:38.178732+0000","last_unstale":"2024-09-19T07:11:03.228781+0000","last_undegraded":"2024-09-19T07:11:03.228781+0000","last_fullsized":"2024-09-19T07:11:03.228781+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:14.287130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.285232+0000","last_change":"2024-09-19T07:09:18.935120+0000","last_active":"2024-09-19T07:11:03.285232+0000","last_peered":"2024-09-19T07:11:03.285232+0000","last_clean":"2024-09-19T07:11:03.285232+0000","last_became_active":"2024-09-19T07:09:18.934227+0000","last_became_peered":"2024-09-19T07:09:18.934227+0000","last_unstale":"2024-09-19T07:11:03.285232+0000","last_undegraded":"2024-09-19T07:11:03.285232+0000","last_fullsized":"2024-09-19T07:11:03.285232+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:20.328983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"81'15","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.278695+0000","last_change":"2024-09-19T07:09:38.393512+0000","last_active":"2024-09-19T07:11:03.278695+0000","last_peered":"2024-09-19T07:11:03.278695+0000","last_clean":"2024-09-19T07:11:03.278695+0000","last_became_active":"2024-09-19T07:09:38.393200+0000","last_became_peered":"2024-09-19T07:09:38.393200+0000","last_unstale":"2024-09-19T07:11:03.278695+0000","last_undegraded":"2024-09-19T07:11:03.278695+0000","last_fullsized":"2024-09-19T07:11:03.278695+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:51.637520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.247033+0000","last_change":"2024-09-19T07:09:16.911129+0000","last_active":"2024-09-19T07:11:03.247033+0000","last_peered":"2024-09-19T07:11:03.247033+0000","last_clean":"2024-09-19T07:11:03.247033+0000","last_became_active":"2024-09-19T07:09:16.910583+0000","last_became_peered":"2024-09-19T07:09:16.910583+0000","last_unstale":"2024-09-19T07:11:03.247033+0000","last_undegraded":"2024-09-19T07:11:03.247033+0000","last_fullsized":"2024-09-19T07:11:03.247033+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:34:37.295838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.285042+0000","last_change":"2024-09-19T07:09:18.928622+0000","last_active":"2024-09-19T07:11:03.285042+0000","last_peered":"2024-09-19T07:11:03.285042+0000","last_clean":"2024-09-19T07:11:03.285042+0000","last_became_active":"2024-09-19T07:09:18.928284+0000","last_became_peered":"2024-09-19T07:09:18.928284+0000","last_unstale":"2024-09-19T07:11:03.285042+0000","last_undegraded":"2024-09-19T07:11:03.285042+0000","last_fullsized":"2024-09-19T07:11:03.285042+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:37:46.358756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.245062+0000","last_change":"2024-09-19T07:09:16.916142+0000","last_active":"2024-09-19T07:11:03.245062+0000","last_peered":"2024-09-19T07:11:03.245062+0000","last_clean":"2024-09-19T07:11:03.245062+0000","last_became_active":"2024-09-19T07:09:16.915766+0000","last_became_peered":"2024-09-19T07:09:16.915766+0000","last_unstale":"2024-09-19T07:11:03.245062+0000","last_undegraded":"2024-09-19T07:11:03.245062+0000","last_fullsized":"2024-09-19T07:11:03.245062+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:38.136422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.285015+0000","last_change":"2024-09-19T07:09:18.921912+0000","last_active":"2024-09-19T07:11:03.285015+0000","last_peered":"2024-09-19T07:11:03.285015+0000","last_clean":"2024-09-19T07:11:03.285015+0000","last_became_active":"2024-09-19T07:09:18.921595+0000","last_became_peered":"2024-09-19T07:09:18.921595+0000","last_unstale":"2024-09-19T07:11:03.285015+0000","last_undegraded":"2024-09-19T07:11:03.285015+0000","last_fullsized":"2024-09-19T07:11:03.285015+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:53.899052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.232279+0000","last_change":"2024-09-19T07:09:17.084856+0000","last_active":"2024-09-19T07:11:03.232279+0000","last_peered":"2024-09-19T07:11:03.232279+0000","last_clean":"2024-09-19T07:11:03.232279+0000","last_became_active":"2024-09-19T07:09:17.084541+0000","last_became_peered":"2024-09-19T07:09:17.084541+0000","last_unstale":"2024-09-19T07:11:03.232279+0000","last_undegraded":"2024-09-19T07:11:03.232279+0000","last_fullsized":"2024-09-19T07:11:03.232279+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:05.978765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.274355+0000","last_change":"2024-09-19T07:09:18.923732+0000","last_active":"2024-09-19T07:11:03.274355+0000","last_peered":"2024-09-19T07:11:03.274355+0000","last_clean":"2024-09-19T07:11:03.274355+0000","last_became_active":"2024-09-19T07:09:18.923410+0000","last_became_peered":"2024-09-19T07:09:18.923410+0000","last_unstale":"2024-09-19T07:11:03.274355+0000","last_undegraded":"2024-09-19T07:11:03.274355+0000","last_fullsized":"2024-09-19T07:11:03.274355+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:01:20.208414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.242373+0000","last_change":"2024-09-19T07:09:16.910364+0000","last_active":"2024-09-19T07:11:03.242373+0000","last_peered":"2024-09-19T07:11:03.242373+0000","last_clean":"2024-09-19T07:11:03.242373+0000","last_became_active":"2024-09-19T07:09:16.909835+0000","last_became_peered":"2024-09-19T07:09:16.909835+0000","last_unstale":"2024-09-19T07:11:03.242373+0000","last_undegraded":"2024-09-19T07:11:03.242373+0000","last_fullsized":"2024-09-19T07:11:03.242373+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:05.198823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":597854,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":696,"num_read_kb":450,"num_write":294,"num_write_kb":1439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":26947,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2027520,"data_stored":1793562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645346,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":892928,"data_stored":437435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,0,5,4,14,28],"upper_bound":64},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874278,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32936,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712216,"statfs":{"total":95995035648,"available":95961309184,"internally_reserved":0,"allocated":1732608,"data_stored":1228316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037804,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32460,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712692,"statfs":{"total":95995035648,"available":95961796608,"internally_reserved":0,"allocated":1302528,"data_stored":830887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266736,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36428,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708724,"statfs":{"total":95995035648,"available":95957733376,"internally_reserved":0,"allocated":1105920,"data_stored":634199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495669,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32656,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712496,"statfs":{"total":95995035648,"available":95961595904,"internally_reserved":0,"allocated":1503232,"data_stored":1032078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659195,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":897024,"data_stored":437060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888127,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32796,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712356,"statfs":{"total":95995035648,"available":95961452544,"internally_reserved":0,"allocated":1650688,"data_stored":1162042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018948,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":974848,"data_stored":503725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247881,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":913408,"data_stored":437371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444110,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":439831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607635,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":958464,"data_stored":497098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":917504,"data_stored":438331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":544768,"data_stored":525100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":134704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":4740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":393954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":200978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T07:11:08.747 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:11:09.031 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:11:09.459 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:09 smithi148 ceph-mon[31180]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:11:09.460 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:09 smithi148 ceph-mon[31180]: from='client.15213 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:11:09.460 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:09 smithi148 ceph-mon[31180]: mgrmap e23: x(active, since 5s), standbys: y, z 2024-09-19T07:11:09.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:09 smithi179 ceph-mon[35716]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:11:09.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:09 smithi179 ceph-mon[35716]: from='client.15213 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:11:09.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:09 smithi179 ceph-mon[35716]: mgrmap e23: x(active, since 5s), standbys: y, z 2024-09-19T07:11:09.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.540+0000 7f0a603dc640 1 -- 172.21.15.148:0/3045678797 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a58102790 msgr2=0x7f0a581067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:09.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.540+0000 7f0a603dc640 1 --2- 172.21.15.148:0/3045678797 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a58102790 0x7f0a581067e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0a48009900 tx=0x7f0a4802a410 comp rx=0 tx=0).stop 2024-09-19T07:11:09.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.540+0000 7f0a603dc640 1 -- 172.21.15.148:0/3045678797 shutdown_connections 2024-09-19T07:11:09.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.540+0000 7f0a603dc640 1 --2- 172.21.15.148:0/3045678797 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a58106f10 0x7f0a5810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:09.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.540+0000 7f0a603dc640 1 --2- 172.21.15.148:0/3045678797 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a58102790 0x7f0a581067e0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:09.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.540+0000 7f0a603dc640 1 --2- 172.21.15.148:0/3045678797 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0a58101de0 0x7f0a581021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:09.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.540+0000 7f0a603dc640 1 -- 172.21.15.148:0/3045678797 >> 172.21.15.148:0/3045678797 conn(0x7f0a580fd8c0 msgr2=0x7f0a580ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:09.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.540+0000 7f0a603dc640 1 -- 172.21.15.148:0/3045678797 shutdown_connections 2024-09-19T07:11:09.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.540+0000 7f0a603dc640 1 -- 172.21.15.148:0/3045678797 wait complete. 2024-09-19T07:11:09.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.541+0000 7f0a603dc640 1 Processor -- start 2024-09-19T07:11:09.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.541+0000 7f0a603dc640 1 -- start start 2024-09-19T07:11:09.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.541+0000 7f0a603dc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a58101de0 0x7f0a58198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:09.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.541+0000 7f0a603dc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a58102790 0x7f0a581988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:09.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.541+0000 7f0a603dc640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0a58106f10 0x7f0a5819cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:09.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.541+0000 7f0a603dc640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0a58111f70 con 0x7f0a58101de0 2024-09-19T07:11:09.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.541+0000 7f0a603dc640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0a58111df0 con 0x7f0a58106f10 2024-09-19T07:11:09.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.541+0000 7f0a603dc640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0a581120f0 con 0x7f0a58102790 2024-09-19T07:11:09.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.541+0000 7f0a5e178640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a58101de0 0x7f0a58198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:09.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.541+0000 7f0a5e178640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a58101de0 0x7f0a58198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60784/0 (socket says 172.21.15.148:60784) 2024-09-19T07:11:09.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.541+0000 7f0a5e178640 1 -- 172.21.15.148:0/1476061968 learned_addr learned my addr 172.21.15.148:0/1476061968 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:09.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.541+0000 7f0a5d977640 1 --2- 172.21.15.148:0/1476061968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a58102790 0x7f0a581988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:09.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.541+0000 7f0a5e178640 1 -- 172.21.15.148:0/1476061968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a58102790 msgr2=0x7f0a581988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:09.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.541+0000 7f0a5e178640 1 --2- 172.21.15.148:0/1476061968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a58102790 0x7f0a581988a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:09.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.541+0000 7f0a5e979640 1 --2- 172.21.15.148:0/1476061968 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0a58106f10 0x7f0a5819cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:09.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.541+0000 7f0a5e178640 1 -- 172.21.15.148:0/1476061968 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0a58106f10 msgr2=0x7f0a5819cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:09.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.541+0000 7f0a5e178640 1 --2- 172.21.15.148:0/1476061968 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0a58106f10 0x7f0a5819cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:09.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.541+0000 7f0a5e178640 1 -- 172.21.15.148:0/1476061968 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a5819d310 con 0x7f0a58101de0 2024-09-19T07:11:09.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.542+0000 7f0a5e178640 1 --2- 172.21.15.148:0/1476061968 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a58101de0 0x7f0a58198360 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0a5400c920 tx=0x7f0a5400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:09.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.542+0000 7f0a4f7fe640 1 -- 172.21.15.148:0/1476061968 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a54007c70 con 0x7f0a58101de0 2024-09-19T07:11:09.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.542+0000 7f0a603dc640 1 -- 172.21.15.148:0/1476061968 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a5819d600 con 0x7f0a58101de0 2024-09-19T07:11:09.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.542+0000 7f0a4f7fe640 1 -- 172.21.15.148:0/1476061968 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a54007e10 con 0x7f0a58101de0 2024-09-19T07:11:09.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.542+0000 7f0a4f7fe640 1 -- 172.21.15.148:0/1476061968 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a54018890 con 0x7f0a58101de0 2024-09-19T07:11:09.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.542+0000 7f0a603dc640 1 -- 172.21.15.148:0/1476061968 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a581a4ee0 con 0x7f0a58101de0 2024-09-19T07:11:09.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.543+0000 7f0a603dc640 1 -- 172.21.15.148:0/1476061968 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a581021c0 con 0x7f0a58101de0 2024-09-19T07:11:09.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.544+0000 7f0a4f7fe640 1 -- 172.21.15.148:0/1476061968 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f0a54018a70 con 0x7f0a58101de0 2024-09-19T07:11:09.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.545+0000 7f0a4f7fe640 1 --2- 172.21.15.148:0/1476061968 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f0a440a3440 0x7f0a440a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:09.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.545+0000 7f0a5d977640 1 --2- 172.21.15.148:0/1476061968 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f0a440a3440 0x7f0a440a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:09.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.545+0000 7f0a4f7fe640 1 -- 172.21.15.148:0/1476061968 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f0a540d00b0 con 0x7f0a58101de0 2024-09-19T07:11:09.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.545+0000 7f0a5d977640 1 --2- 172.21.15.148:0/1476061968 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f0a440a3440 0x7f0a440a5900 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0a480096c0 tx=0x7f0a48000bc0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:09.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.549+0000 7f0a4f7fe640 1 -- 172.21.15.148:0/1476061968 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0a54014030 con 0x7f0a58101de0 2024-09-19T07:11:09.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:09 smithi165 ceph-mon[35326]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:11:09.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:09 smithi165 ceph-mon[35326]: from='client.15213 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:11:09.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:09 smithi165 ceph-mon[35326]: mgrmap e23: x(active, since 5s), standbys: y, z 2024-09-19T07:11:09.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.750+0000 7f0a603dc640 1 -- 172.21.15.148:0/1476061968 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0a581996c0 con 0x7f0a58101de0 2024-09-19T07:11:09.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.751+0000 7f0a4f7fe640 1 -- 172.21.15.148:0/1476061968 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11939 (secure 0 0 0) 0x7f0a5400de20 con 0x7f0a58101de0 2024-09-19T07:11:09.752 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:11:09.752 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":25,"btime":"2024-09-19T07:11:04:227331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/4263868576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":4263868576},{"type":"v1","addr":"172.21.15.148:6841","nonce":4263868576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24383,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2146820965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2146820965},{"type":"v1","addr":"172.21.15.165:6835","nonce":2146820965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:09:19.543369+0000","modified":"2024-09-19T07:11:03.969598+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24457,"mds_1":24437,"mds_2":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/1566489108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1566489108},{"type":"v1","addr":"172.21.15.179:6835","nonce":1566489108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.165:6839/3993490234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":3993490234},{"type":"v1","addr":"172.21.15.165:6839","nonce":3993490234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24457,"qdb_cluster":[24457,24437,24436]},"id":1}]} 2024-09-19T07:11:09.752 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 25 2024-09-19T07:11:09.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.753+0000 7f0a603dc640 1 -- 172.21.15.148:0/1476061968 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f0a440a3440 msgr2=0x7f0a440a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:09.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.753+0000 7f0a603dc640 1 --2- 172.21.15.148:0/1476061968 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f0a440a3440 0x7f0a440a5900 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0a480096c0 tx=0x7f0a48000bc0 comp rx=0 tx=0).stop 2024-09-19T07:11:09.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.753+0000 7f0a603dc640 1 -- 172.21.15.148:0/1476061968 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a58101de0 msgr2=0x7f0a58198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:09.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.753+0000 7f0a603dc640 1 --2- 172.21.15.148:0/1476061968 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a58101de0 0x7f0a58198360 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0a5400c920 tx=0x7f0a5400cde0 comp rx=0 tx=0).stop 2024-09-19T07:11:09.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.753+0000 7f0a603dc640 1 -- 172.21.15.148:0/1476061968 shutdown_connections 2024-09-19T07:11:09.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.753+0000 7f0a603dc640 1 --2- 172.21.15.148:0/1476061968 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f0a440a3440 0x7f0a440a5900 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:09.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.753+0000 7f0a603dc640 1 --2- 172.21.15.148:0/1476061968 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0a58106f10 0x7f0a5819cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:09.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.753+0000 7f0a603dc640 1 --2- 172.21.15.148:0/1476061968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a58102790 0x7f0a581988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:09.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.753+0000 7f0a603dc640 1 --2- 172.21.15.148:0/1476061968 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a58101de0 0x7f0a58198360 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:09.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.753+0000 7f0a603dc640 1 -- 172.21.15.148:0/1476061968 >> 172.21.15.148:0/1476061968 conn(0x7f0a580fd8c0 msgr2=0x7f0a580fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:09.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.754+0000 7f0a603dc640 1 -- 172.21.15.148:0/1476061968 shutdown_connections 2024-09-19T07:11:09.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:09.754+0000 7f0a603dc640 1 -- 172.21.15.148:0/1476061968 wait complete. 2024-09-19T07:11:10.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:10 smithi148 ceph-mon[31180]: from='client.15219 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:11:10.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:10 smithi148 ceph-mon[31180]: from='client.15225 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:11:10.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:10 smithi148 ceph-mon[31180]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-19T07:11:10.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:10 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/1476061968' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:11:10.442 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T07:11:10.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:10 smithi179 ceph-mon[35716]: from='client.15219 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:11:10.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:10 smithi179 ceph-mon[35716]: from='client.15225 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:11:10.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:10 smithi179 ceph-mon[35716]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-19T07:11:10.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:10 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/1476061968' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:11:10.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:10 smithi165 ceph-mon[35326]: from='client.15219 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:11:10.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:10 smithi165 ceph-mon[35326]: from='client.15225 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:11:10.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:10 smithi165 ceph-mon[35326]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-19T07:11:10.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:10 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/1476061968' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:11:10.697 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:11:11.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.171+0000 7f93ea201640 1 -- 172.21.15.148:0/135637796 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f93e4106f10 msgr2=0x7f93e410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:11.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.171+0000 7f93ea201640 1 --2- 172.21.15.148:0/135637796 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f93e4106f10 0x7f93e410ea90 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f93dc009ca0 tx=0x7f93dc02a8c0 comp rx=0 tx=0).stop 2024-09-19T07:11:11.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.171+0000 7f93ea201640 1 -- 172.21.15.148:0/135637796 shutdown_connections 2024-09-19T07:11:11.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.171+0000 7f93ea201640 1 --2- 172.21.15.148:0/135637796 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f93e4106f10 0x7f93e410ea90 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:11.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.171+0000 7f93ea201640 1 --2- 172.21.15.148:0/135637796 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f93e4102790 0x7f93e41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:11.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.171+0000 7f93ea201640 1 --2- 172.21.15.148:0/135637796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93e4101de0 0x7f93e41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:11.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.171+0000 7f93ea201640 1 -- 172.21.15.148:0/135637796 >> 172.21.15.148:0/135637796 conn(0x7f93e40fd8c0 msgr2=0x7f93e40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:11.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.171+0000 7f93ea201640 1 -- 172.21.15.148:0/135637796 shutdown_connections 2024-09-19T07:11:11.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.171+0000 7f93ea201640 1 -- 172.21.15.148:0/135637796 wait complete. 2024-09-19T07:11:11.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.172+0000 7f93ea201640 1 Processor -- start 2024-09-19T07:11:11.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.172+0000 7f93ea201640 1 -- start start 2024-09-19T07:11:11.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.172+0000 7f93ea201640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f93e4101de0 0x7f93e41983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:11.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.172+0000 7f93ea201640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93e4102790 0x7f93e4198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:11.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.172+0000 7f93ea201640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f93e4106f10 0x7f93e419ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:11.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.172+0000 7f93ea201640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f93e4111f70 con 0x7f93e4106f10 2024-09-19T07:11:11.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.172+0000 7f93ea201640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f93e4111df0 con 0x7f93e4101de0 2024-09-19T07:11:11.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.172+0000 7f93ea201640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f93e41120f0 con 0x7f93e4102790 2024-09-19T07:11:11.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.172+0000 7f93e3fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f93e4106f10 0x7f93e419ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:11.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.172+0000 7f93e3fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f93e4106f10 0x7f93e419ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60802/0 (socket says 172.21.15.148:60802) 2024-09-19T07:11:11.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.172+0000 7f93e3fff640 1 -- 172.21.15.148:0/1606223907 learned_addr learned my addr 172.21.15.148:0/1606223907 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:11.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.172+0000 7f93dbfff640 1 --2- 172.21.15.148:0/1606223907 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93e4102790 0x7f93e4198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:11.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.172+0000 7f93e37fe640 1 --2- 172.21.15.148:0/1606223907 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f93e4101de0 0x7f93e41983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:11.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.173+0000 7f93e3fff640 1 -- 172.21.15.148:0/1606223907 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93e4102790 msgr2=0x7f93e4198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:11.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.173+0000 7f93e3fff640 1 --2- 172.21.15.148:0/1606223907 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93e4102790 0x7f93e4198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:11.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.173+0000 7f93e3fff640 1 -- 172.21.15.148:0/1606223907 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f93e4101de0 msgr2=0x7f93e41983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:11.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.173+0000 7f93e3fff640 1 --2- 172.21.15.148:0/1606223907 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f93e4101de0 0x7f93e41983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:11.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.173+0000 7f93e3fff640 1 -- 172.21.15.148:0/1606223907 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93e419d3a0 con 0x7f93e4106f10 2024-09-19T07:11:11.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.173+0000 7f93e3fff640 1 --2- 172.21.15.148:0/1606223907 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f93e4106f10 0x7f93e419ccc0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f93dc031a20 tx=0x7f93dc031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:11.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.173+0000 7f93e17fa640 1 -- 172.21.15.148:0/1606223907 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93dc003c30 con 0x7f93e4106f10 2024-09-19T07:11:11.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.173+0000 7f93e17fa640 1 -- 172.21.15.148:0/1606223907 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93dc003dd0 con 0x7f93e4106f10 2024-09-19T07:11:11.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.173+0000 7f93ea201640 1 -- 172.21.15.148:0/1606223907 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93e419d630 con 0x7f93e4106f10 2024-09-19T07:11:11.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.173+0000 7f93e17fa640 1 -- 172.21.15.148:0/1606223907 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93dc02fcf0 con 0x7f93e4106f10 2024-09-19T07:11:11.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.173+0000 7f93ea201640 1 -- 172.21.15.148:0/1606223907 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93e41a4f70 con 0x7f93e4106f10 2024-09-19T07:11:11.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.175+0000 7f93ea201640 1 -- 172.21.15.148:0/1606223907 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93e41021c0 con 0x7f93e4106f10 2024-09-19T07:11:11.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.176+0000 7f93e17fa640 1 -- 172.21.15.148:0/1606223907 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f93dc004050 con 0x7f93e4106f10 2024-09-19T07:11:11.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.176+0000 7f93e17fa640 1 --2- 172.21.15.148:0/1606223907 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f93d00a34c0 0x7f93d00a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:11.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.176+0000 7f93e17fa640 1 -- 172.21.15.148:0/1606223907 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f93dc0f1060 con 0x7f93e4106f10 2024-09-19T07:11:11.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.176+0000 7f93e37fe640 1 --2- 172.21.15.148:0/1606223907 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f93d00a34c0 0x7f93d00a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:11.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.177+0000 7f93e37fe640 1 --2- 172.21.15.148:0/1606223907 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f93d00a34c0 0x7f93d00a5980 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f93d40058c0 tx=0x7f93d400a2d0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:11.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.180+0000 7f93e17fa640 1 -- 172.21.15.148:0/1606223907 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f93dc0bdb60 con 0x7f93e4106f10 2024-09-19T07:11:11.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.352+0000 7f93ea201640 1 -- 172.21.15.148:0/1606223907 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f93e410a1b0 con 0x7f93e4106f10 2024-09-19T07:11:11.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.353+0000 7f93e17fa640 1 -- 172.21.15.148:0/1606223907 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+23254 (secure 0 0 0) 0x7f93dc02fe90 con 0x7f93e4106f10 2024-09-19T07:11:11.354 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:11:11.354 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":81,"fsid":"eae8a4a8-7654-11ef-bceb-c7b262605968","created":"2024-09-19T07:01:47.891210+0000","modified":"2024-09-19T07:11:03.220907+0000","last_up_change":"2024-09-19T07:08:30.785262+0000","last_in_change":"2024-09-19T07:08:07.001808+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:04:49.313270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T07:09:15.840600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T07:09:17.690782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7b854fad-d5a3-43e3-862e-7a0e8f243c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6803","nonce":512186330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6805","nonce":512186330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6809","nonce":512186330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6807","nonce":512186330}]},"public_addr":"172.21.15.148:6803/512186330","cluster_addr":"172.21.15.148:6805/512186330","heartbeat_back_addr":"172.21.15.148:6809/512186330","heartbeat_front_addr":"172.21.15.148:6807/512186330","state":["exists","up"]},{"osd":1,"uuid":"61b26278-f4db-40f0-97b9-c12a6ef1cd06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6801","nonce":2433984552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6803","nonce":2433984552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6807","nonce":2433984552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6805","nonce":2433984552}]},"public_addr":"172.21.15.165:6801/2433984552","cluster_addr":"172.21.15.165:6803/2433984552","heartbeat_back_addr":"172.21.15.165:6807/2433984552","heartbeat_front_addr":"172.21.15.165:6805/2433984552","state":["exists","up"]},{"osd":2,"uuid":"06620bbc-cdb5-4afc-8122-0bb3126630f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6801","nonce":3048365223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6803","nonce":3048365223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6807","nonce":3048365223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6805","nonce":3048365223}]},"public_addr":"172.21.15.179:6801/3048365223","cluster_addr":"172.21.15.179:6803/3048365223","heartbeat_back_addr":"172.21.15.179:6807/3048365223","heartbeat_front_addr":"172.21.15.179:6805/3048365223","state":["exists","up"]},{"osd":3,"uuid":"d7df45d4-5ef1-4f66-84a7-f61b8756c0c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6811","nonce":3662789091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6813","nonce":3662789091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6817","nonce":3662789091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6815","nonce":3662789091}]},"public_addr":"172.21.15.148:6811/3662789091","cluster_addr":"172.21.15.148:6813/3662789091","heartbeat_back_addr":"172.21.15.148:6817/3662789091","heartbeat_front_addr":"172.21.15.148:6815/3662789091","state":["exists","up"]},{"osd":4,"uuid":"5cfd359b-a8d2-4bdc-858f-087d26e0869c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6809","nonce":3082550323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6811","nonce":3082550323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6815","nonce":3082550323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6813","nonce":3082550323}]},"public_addr":"172.21.15.165:6809/3082550323","cluster_addr":"172.21.15.165:6811/3082550323","heartbeat_back_addr":"172.21.15.165:6815/3082550323","heartbeat_front_addr":"172.21.15.165:6813/3082550323","state":["exists","up"]},{"osd":5,"uuid":"8295e69b-87fe-4403-bb2e-d9dd42e2f398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6809","nonce":2125213751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6811","nonce":2125213751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6815","nonce":2125213751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6813","nonce":2125213751}]},"public_addr":"172.21.15.179:6809/2125213751","cluster_addr":"172.21.15.179:6811/2125213751","heartbeat_back_addr":"172.21.15.179:6815/2125213751","heartbeat_front_addr":"172.21.15.179:6813/2125213751","state":["exists","up"]},{"osd":6,"uuid":"4ce38d1a-06d3-4606-b00d-aa1ff977025f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6819","nonce":2178980310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6821","nonce":2178980310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6825","nonce":2178980310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6823","nonce":2178980310}]},"public_addr":"172.21.15.148:6819/2178980310","cluster_addr":"172.21.15.148:6821/2178980310","heartbeat_back_addr":"172.21.15.148:6825/2178980310","heartbeat_front_addr":"172.21.15.148:6823/2178980310","state":["exists","up"]},{"osd":7,"uuid":"9e68e2b2-9838-4ec0-b473-24f2434695ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6817","nonce":3961600099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6819","nonce":3961600099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6823","nonce":3961600099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6821","nonce":3961600099}]},"public_addr":"172.21.15.165:6817/3961600099","cluster_addr":"172.21.15.165:6819/3961600099","heartbeat_back_addr":"172.21.15.165:6823/3961600099","heartbeat_front_addr":"172.21.15.165:6821/3961600099","state":["exists","up"]},{"osd":8,"uuid":"297acce6-d3c7-4e1a-bf87-be093de51a6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6817","nonce":3642931467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6819","nonce":3642931467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6823","nonce":3642931467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6821","nonce":3642931467}]},"public_addr":"172.21.15.179:6817/3642931467","cluster_addr":"172.21.15.179:6819/3642931467","heartbeat_back_addr":"172.21.15.179:6823/3642931467","heartbeat_front_addr":"172.21.15.179:6821/3642931467","state":["exists","up"]},{"osd":9,"uuid":"ef488c5e-5353-4695-99dd-5b74ade436d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6827","nonce":3135409630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6829","nonce":3135409630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6833","nonce":3135409630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6831","nonce":3135409630}]},"public_addr":"172.21.15.148:6827/3135409630","cluster_addr":"172.21.15.148:6829/3135409630","heartbeat_back_addr":"172.21.15.148:6833/3135409630","heartbeat_front_addr":"172.21.15.148:6831/3135409630","state":["exists","up"]},{"osd":10,"uuid":"7a9f0379-1199-4266-910c-8d1d313d39e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6825","nonce":3554110731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6827","nonce":3554110731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6831","nonce":3554110731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6829","nonce":3554110731}]},"public_addr":"172.21.15.165:6825/3554110731","cluster_addr":"172.21.15.165:6827/3554110731","heartbeat_back_addr":"172.21.15.165:6831/3554110731","heartbeat_front_addr":"172.21.15.165:6829/3554110731","state":["exists","up"]},{"osd":11,"uuid":"eede97e9-5685-4603-806e-7078c6940536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6825","nonce":2026109940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6827","nonce":2026109940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6831","nonce":2026109940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6829","nonce":2026109940}]},"public_addr":"172.21.15.179:6825/2026109940","cluster_addr":"172.21.15.179:6827/2026109940","heartbeat_back_addr":"172.21.15.179:6831/2026109940","heartbeat_front_addr":"172.21.15.179:6829/2026109940","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:03:56.291685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:21.419682+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:46.377012+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:11.484234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:36.723101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:06:00.294617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:06:25.147230+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:06:49.318576+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:07:13.896399+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:07:38.930999+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:08:03.803463+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:08:28.731343+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.148:0/2510377205":"2024-09-20T07:11:03.220856+0000","172.21.15.148:0/1725756124":"2024-09-20T07:11:03.220856+0000","172.21.15.148:0/2638338746":"2024-09-20T07:11:03.220856+0000","172.21.15.148:0/174481494":"2024-09-20T07:02:14.557425+0000","172.21.15.148:0/3756905316":"2024-09-20T07:11:03.220856+0000","172.21.15.148:0/1480486619":"2024-09-20T07:02:14.557425+0000","172.21.15.148:6801/2161746152":"2024-09-20T07:02:14.557425+0000","172.21.15.148:6800/2161746152":"2024-09-20T07:02:14.557425+0000","172.21.15.148:6800/1949849385":"2024-09-20T07:02:37.007183+0000","172.21.15.148:0/1114469409":"2024-09-20T07:02:14.557425+0000","172.21.15.148:0/1922521135":"2024-09-20T07:02:37.007183+0000","172.21.15.148:6801/3007822654":"2024-09-20T07:11:03.220856+0000","172.21.15.148:0/1958388906":"2024-09-20T07:02:37.007183+0000","172.21.15.148:6801/1949849385":"2024-09-20T07:02:37.007183+0000","172.21.15.148:0/3534559227":"2024-09-20T07:02:37.007183+0000","172.21.15.148:0/1224758996":"2024-09-20T07:11:03.220856+0000","172.21.15.148:6800/3007822654":"2024-09-20T07:11:03.220856+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T07:11:11.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.355+0000 7f93ea201640 1 -- 172.21.15.148:0/1606223907 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f93d00a34c0 msgr2=0x7f93d00a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:11.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.355+0000 7f93ea201640 1 --2- 172.21.15.148:0/1606223907 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f93d00a34c0 0x7f93d00a5980 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f93d40058c0 tx=0x7f93d400a2d0 comp rx=0 tx=0).stop 2024-09-19T07:11:11.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.355+0000 7f93ea201640 1 -- 172.21.15.148:0/1606223907 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f93e4106f10 msgr2=0x7f93e419ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:11.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.355+0000 7f93ea201640 1 --2- 172.21.15.148:0/1606223907 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f93e4106f10 0x7f93e419ccc0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f93dc031a20 tx=0x7f93dc031a50 comp rx=0 tx=0).stop 2024-09-19T07:11:11.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.355+0000 7f93ea201640 1 -- 172.21.15.148:0/1606223907 shutdown_connections 2024-09-19T07:11:11.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.355+0000 7f93ea201640 1 --2- 172.21.15.148:0/1606223907 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f93d00a34c0 0x7f93d00a5980 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:11.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.355+0000 7f93ea201640 1 --2- 172.21.15.148:0/1606223907 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f93e4106f10 0x7f93e419ccc0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:11.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.355+0000 7f93ea201640 1 --2- 172.21.15.148:0/1606223907 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93e4102790 0x7f93e4198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:11.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.355+0000 7f93ea201640 1 --2- 172.21.15.148:0/1606223907 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f93e4101de0 0x7f93e41983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:11.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.356+0000 7f93ea201640 1 -- 172.21.15.148:0/1606223907 >> 172.21.15.148:0/1606223907 conn(0x7f93e40fd8c0 msgr2=0x7f93e40feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:11.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.356+0000 7f93ea201640 1 -- 172.21.15.148:0/1606223907 shutdown_connections 2024-09-19T07:11:11.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:11.356+0000 7f93ea201640 1 -- 172.21.15.148:0/1606223907 wait complete. 2024-09-19T07:11:12.132 DEBUG:tasks.fwd_scrub:Yielding 2024-09-19T07:11:12.133 INFO:teuthology.run_tasks:Running task exec... 2024-09-19T07:11:12.142 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T07:11:12.143 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi148.front.sepia.ceph.com 2024-09-19T07:11:12.143 DEBUG:teuthology.orchestra.run.smithi148:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/log_level debug' 2024-09-19T07:11:12.143 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-19T07:11:12.144 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T07:11:12.144 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T07:11:12.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.249+0000 7fdfd1586640 1 -- 172.21.15.148:0/2094092715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfcc102c10 msgr2=0x7fdfcc102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:12.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.249+0000 7fdfd1586640 1 --2- 172.21.15.148:0/2094092715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfcc102c10 0x7fdfcc102ff0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc009900 tx=0x7fdfbc02a410 comp rx=0 tx=0).stop 2024-09-19T07:11:12.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.249+0000 7fdfd1586640 1 -- 172.21.15.148:0/2094092715 shutdown_connections 2024-09-19T07:11:12.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.249+0000 7fdfd1586640 1 --2- 172.21.15.148:0/2094092715 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdfcc10c110 0x7fdfcc10e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:12.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.249+0000 7fdfd1586640 1 --2- 172.21.15.148:0/2094092715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdfcc1035c0 0x7fdfcc10baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:12.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.249+0000 7fdfd1586640 1 --2- 172.21.15.148:0/2094092715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfcc102c10 0x7fdfcc102ff0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:12.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.249+0000 7fdfd1586640 1 -- 172.21.15.148:0/2094092715 >> 172.21.15.148:0/2094092715 conn(0x7fdfcc0fc6f0 msgr2=0x7fdfcc0feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:12.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.249+0000 7fdfd1586640 1 -- 172.21.15.148:0/2094092715 shutdown_connections 2024-09-19T07:11:12.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.249+0000 7fdfd1586640 1 -- 172.21.15.148:0/2094092715 wait complete. 2024-09-19T07:11:12.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.250+0000 7fdfd1586640 1 Processor -- start 2024-09-19T07:11:12.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.250+0000 7fdfd1586640 1 -- start start 2024-09-19T07:11:12.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.250+0000 7fdfd1586640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdfcc102c10 0x7fdfcc198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:12.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.250+0000 7fdfd1586640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdfcc1035c0 0x7fdfcc198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:12.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.250+0000 7fdfd1586640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfcc10c110 0x7fdfcc19cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:12.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.250+0000 7fdfd1586640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdfcc111ec0 con 0x7fdfcc10c110 2024-09-19T07:11:12.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.250+0000 7fdfd1586640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdfcc111d40 con 0x7fdfcc102c10 2024-09-19T07:11:12.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.250+0000 7fdfd1586640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdfcc112040 con 0x7fdfcc1035c0 2024-09-19T07:11:12.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.250+0000 7fdfcb7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfcc10c110 0x7fdfcc19cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:12.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.251+0000 7fdfcb7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfcc10c110 0x7fdfcc19cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60818/0 (socket says 172.21.15.148:60818) 2024-09-19T07:11:12.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.251+0000 7fdfcb7fe640 1 -- 172.21.15.148:0/766718080 learned_addr learned my addr 172.21.15.148:0/766718080 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:12.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.251+0000 7fdfcaffd640 1 --2- 172.21.15.148:0/766718080 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdfcc102c10 0x7fdfcc198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:12.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.251+0000 7fdfc3fff640 1 --2- 172.21.15.148:0/766718080 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdfcc1035c0 0x7fdfcc198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:12.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.251+0000 7fdfcb7fe640 1 -- 172.21.15.148:0/766718080 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdfcc1035c0 msgr2=0x7fdfcc198850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:12.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.251+0000 7fdfcb7fe640 1 --2- 172.21.15.148:0/766718080 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdfcc1035c0 0x7fdfcc198850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:12.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.251+0000 7fdfcb7fe640 1 -- 172.21.15.148:0/766718080 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdfcc102c10 msgr2=0x7fdfcc198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:12.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.251+0000 7fdfcb7fe640 1 --2- 172.21.15.148:0/766718080 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdfcc102c10 0x7fdfcc198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:12.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.251+0000 7fdfcb7fe640 1 -- 172.21.15.148:0/766718080 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfcc19d300 con 0x7fdfcc10c110 2024-09-19T07:11:12.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.251+0000 7fdfcaffd640 1 --2- 172.21.15.148:0/766718080 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdfcc102c10 0x7fdfcc198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:11:12.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.251+0000 7fdfc3fff640 1 --2- 172.21.15.148:0/766718080 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdfcc1035c0 0x7fdfcc198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:11:12.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.251+0000 7fdfcb7fe640 1 --2- 172.21.15.148:0/766718080 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfcc10c110 0x7fdfcc19cbd0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fdfc400eb10 tx=0x7fdfc400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:12.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.251+0000 7fdfc8ff9640 1 -- 172.21.15.148:0/766718080 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc4004b20 con 0x7fdfcc10c110 2024-09-19T07:11:12.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.251+0000 7fdfc8ff9640 1 -- 172.21.15.148:0/766718080 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdfc4004cc0 con 0x7fdfcc10c110 2024-09-19T07:11:12.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.251+0000 7fdfc8ff9640 1 -- 172.21.15.148:0/766718080 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc4010760 con 0x7fdfcc10c110 2024-09-19T07:11:12.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.251+0000 7fdfd1586640 1 -- 172.21.15.148:0/766718080 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfcc19d5f0 con 0x7fdfcc10c110 2024-09-19T07:11:12.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.251+0000 7fdfd1586640 1 -- 172.21.15.148:0/766718080 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfcc1a4e80 con 0x7fdfcc10c110 2024-09-19T07:11:12.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.252+0000 7fdfd1586640 1 -- 172.21.15.148:0/766718080 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfcc102ff0 con 0x7fdfcc10c110 2024-09-19T07:11:12.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.254+0000 7fdfc8ff9640 1 -- 172.21.15.148:0/766718080 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7fdfc4005020 con 0x7fdfcc10c110 2024-09-19T07:11:12.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.255+0000 7fdfc8ff9640 1 --2- 172.21.15.148:0/766718080 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fdfb80a3500 0x7fdfb80a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:12.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.255+0000 7fdfcaffd640 1 --2- 172.21.15.148:0/766718080 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fdfb80a3500 0x7fdfb80a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:12.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.255+0000 7fdfc8ff9640 1 -- 172.21.15.148:0/766718080 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fdfc40d0530 con 0x7fdfcc10c110 2024-09-19T07:11:12.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.256+0000 7fdfcaffd640 1 --2- 172.21.15.148:0/766718080 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fdfb80a3500 0x7fdfb80a59c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc005ab0 tx=0x7fdfbc005a20 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:12.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.260+0000 7fdfc8ff9640 1 -- 172.21.15.148:0/766718080 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdfc409cdb0 con 0x7fdfcc10c110 2024-09-19T07:11:12.403 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:11:12.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.443+0000 7fdfd1586640 1 -- 172.21.15.148:0/766718080 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7fdfcc1a5190 con 0x7fdfcc10c110 2024-09-19T07:11:12.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.447+0000 7fdfc8ff9640 1 -- 172.21.15.148:0/766718080 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v34)=0 v34) ==== 129+0+0 (secure 0 0 0) 0x7fdfc409c6b0 con 0x7fdfcc10c110 2024-09-19T07:11:12.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.450+0000 7fdfd1586640 1 -- 172.21.15.148:0/766718080 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fdfb80a3500 msgr2=0x7fdfb80a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:12.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.450+0000 7fdfd1586640 1 --2- 172.21.15.148:0/766718080 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fdfb80a3500 0x7fdfb80a59c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc005ab0 tx=0x7fdfbc005a20 comp rx=0 tx=0).stop 2024-09-19T07:11:12.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.450+0000 7fdfd1586640 1 -- 172.21.15.148:0/766718080 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfcc10c110 msgr2=0x7fdfcc19cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:12.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.450+0000 7fdfd1586640 1 --2- 172.21.15.148:0/766718080 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfcc10c110 0x7fdfcc19cbd0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fdfc400eb10 tx=0x7fdfc400c2d0 comp rx=0 tx=0).stop 2024-09-19T07:11:12.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.450+0000 7fdfd1586640 1 -- 172.21.15.148:0/766718080 shutdown_connections 2024-09-19T07:11:12.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.450+0000 7fdfd1586640 1 --2- 172.21.15.148:0/766718080 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fdfb80a3500 0x7fdfb80a59c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:12.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.450+0000 7fdfd1586640 1 --2- 172.21.15.148:0/766718080 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfcc10c110 0x7fdfcc19cbd0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:12.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.450+0000 7fdfd1586640 1 --2- 172.21.15.148:0/766718080 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdfcc1035c0 0x7fdfcc198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:12.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.450+0000 7fdfd1586640 1 --2- 172.21.15.148:0/766718080 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdfcc102c10 0x7fdfcc198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:12.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.450+0000 7fdfd1586640 1 -- 172.21.15.148:0/766718080 >> 172.21.15.148:0/766718080 conn(0x7fdfcc0fc6f0 msgr2=0x7fdfcc0fd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:12.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.450+0000 7fdfd1586640 1 -- 172.21.15.148:0/766718080 shutdown_connections 2024-09-19T07:11:12.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.450+0000 7fdfd1586640 1 -- 172.21.15.148:0/766718080 wait complete. 2024-09-19T07:11:12.462 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:12 smithi148 ceph-mon[31180]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 0 B/s wr, 21 op/s 2024-09-19T07:11:12.462 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:12 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/1606223907' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:11:12.464 DEBUG:teuthology.orchestra.run.smithi148:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-09-19T07:11:12.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.567+0000 7f0ecd3c4640 1 -- 172.21.15.148:0/3036422429 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ec8102c80 msgr2=0x7f0ec8103060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:12.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.567+0000 7f0ecd3c4640 1 --2- 172.21.15.148:0/3036422429 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ec8102c80 0x7f0ec8103060 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8009900 tx=0x7f0eb802a480 comp rx=0 tx=0).stop 2024-09-19T07:11:12.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.568+0000 7f0ecd3c4640 1 -- 172.21.15.148:0/3036422429 shutdown_connections 2024-09-19T07:11:12.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.568+0000 7f0ecd3c4640 1 --2- 172.21.15.148:0/3036422429 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0ec810c0d0 0x7f0ec810e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:12.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.568+0000 7f0ecd3c4640 1 --2- 172.21.15.148:0/3036422429 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ec81035a0 0x7f0ec810ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:12.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.568+0000 7f0ecd3c4640 1 --2- 172.21.15.148:0/3036422429 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ec8102c80 0x7f0ec8103060 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:12.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.568+0000 7f0ecd3c4640 1 -- 172.21.15.148:0/3036422429 >> 172.21.15.148:0/3036422429 conn(0x7f0ec8077990 msgr2=0x7f0ec80fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:12.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.568+0000 7f0ecd3c4640 1 -- 172.21.15.148:0/3036422429 shutdown_connections 2024-09-19T07:11:12.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.568+0000 7f0ecd3c4640 1 -- 172.21.15.148:0/3036422429 wait complete. 2024-09-19T07:11:12.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.568+0000 7f0ecd3c4640 1 Processor -- start 2024-09-19T07:11:12.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.568+0000 7f0ecd3c4640 1 -- start start 2024-09-19T07:11:12.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.568+0000 7f0ecd3c4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ec8102c80 0x7f0ec81983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:12.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.568+0000 7f0ecd3c4640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0ec81035a0 0x7f0ec8198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:12.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.568+0000 7f0ecd3c4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ec810c0d0 0x7f0ec819cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:12.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.568+0000 7f0ecd3c4640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec8111eb0 con 0x7f0ec8102c80 2024-09-19T07:11:12.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.568+0000 7f0ecd3c4640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec8111d30 con 0x7f0ec81035a0 2024-09-19T07:11:12.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.568+0000 7f0ecd3c4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec8112030 con 0x7f0ec810c0d0 2024-09-19T07:11:12.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.569+0000 7f0ec6ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ec8102c80 0x7f0ec81983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:12.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.569+0000 7f0ec6ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ec8102c80 0x7f0ec81983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60842/0 (socket says 172.21.15.148:60842) 2024-09-19T07:11:12.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.569+0000 7f0ec6ffd640 1 -- 172.21.15.148:0/1690082883 learned_addr learned my addr 172.21.15.148:0/1690082883 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:12.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.569+0000 7f0ec67fc640 1 --2- 172.21.15.148:0/1690082883 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0ec81035a0 0x7f0ec8198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:12.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.569+0000 7f0ec77fe640 1 --2- 172.21.15.148:0/1690082883 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ec810c0d0 0x7f0ec819cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:12.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.569+0000 7f0ec6ffd640 1 -- 172.21.15.148:0/1690082883 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ec810c0d0 msgr2=0x7f0ec819cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:12.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.569+0000 7f0ec6ffd640 1 --2- 172.21.15.148:0/1690082883 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ec810c0d0 0x7f0ec819cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:12.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.569+0000 7f0ec6ffd640 1 -- 172.21.15.148:0/1690082883 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0ec81035a0 msgr2=0x7f0ec8198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:12.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.569+0000 7f0ec6ffd640 1 --2- 172.21.15.148:0/1690082883 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0ec81035a0 0x7f0ec8198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:12.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.569+0000 7f0ec6ffd640 1 -- 172.21.15.148:0/1690082883 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ec819d3d0 con 0x7f0ec8102c80 2024-09-19T07:11:12.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.569+0000 7f0ec77fe640 1 --2- 172.21.15.148:0/1690082883 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ec810c0d0 0x7f0ec819cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:11:12.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.569+0000 7f0ec6ffd640 1 --2- 172.21.15.148:0/1690082883 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ec8102c80 0x7f0ec81983e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8006010 tx=0x7f0eb8004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:12.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.569+0000 7f0eaffff640 1 -- 172.21.15.148:0/1690082883 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb803f030 con 0x7f0ec8102c80 2024-09-19T07:11:12.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.569+0000 7f0eaffff640 1 -- 172.21.15.148:0/1690082883 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0eb8004440 con 0x7f0ec8102c80 2024-09-19T07:11:12.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.569+0000 7f0ecd3c4640 1 -- 172.21.15.148:0/1690082883 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ec819d660 con 0x7f0ec8102c80 2024-09-19T07:11:12.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.569+0000 7f0eaffff640 1 -- 172.21.15.148:0/1690082883 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb8035070 con 0x7f0ec8102c80 2024-09-19T07:11:12.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.569+0000 7f0ecd3c4640 1 -- 172.21.15.148:0/1690082883 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ec81a4f50 con 0x7f0ec8102c80 2024-09-19T07:11:12.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.570+0000 7f0ecd3c4640 1 -- 172.21.15.148:0/1690082883 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ec8103060 con 0x7f0ec8102c80 2024-09-19T07:11:12.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.571+0000 7f0eaffff640 1 -- 172.21.15.148:0/1690082883 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f0eb8042030 con 0x7f0ec8102c80 2024-09-19T07:11:12.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.572+0000 7f0eaffff640 1 --2- 172.21.15.148:0/1690082883 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f0eb00a3580 0x7f0eb00a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:12.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.572+0000 7f0ec67fc640 1 --2- 172.21.15.148:0/1690082883 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f0eb00a3580 0x7f0eb00a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:12.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.572+0000 7f0eaffff640 1 -- 172.21.15.148:0/1690082883 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f0eb80f0220 con 0x7f0ec8102c80 2024-09-19T07:11:12.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.573+0000 7f0ec67fc640 1 --2- 172.21.15.148:0/1690082883 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f0eb00a3580 0x7f0eb00a5a40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0ec810e4b0 tx=0x7f0ebc005f90 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:12.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.576+0000 7f0eaffff640 1 -- 172.21.15.148:0/1690082883 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0eb80bcaa0 con 0x7f0ec8102c80 2024-09-19T07:11:12.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:12 smithi165 ceph-mon[35326]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 0 B/s wr, 21 op/s 2024-09-19T07:11:12.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:12 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/1606223907' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:11:12.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.750+0000 7f0ecd3c4640 1 -- 172.21.15.148:0/1690082883 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f0ec81a5120 con 0x7f0ec8102c80 2024-09-19T07:11:12.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.754+0000 7f0eaffff640 1 -- 172.21.15.148:0/1690082883 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v35)=0 v35) ==== 138+0+0 (secure 0 0 0) 0x7f0eb80bc3a0 con 0x7f0ec8102c80 2024-09-19T07:11:12.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.756+0000 7f0ecd3c4640 1 -- 172.21.15.148:0/1690082883 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f0eb00a3580 msgr2=0x7f0eb00a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:12.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.756+0000 7f0ecd3c4640 1 --2- 172.21.15.148:0/1690082883 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f0eb00a3580 0x7f0eb00a5a40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0ec810e4b0 tx=0x7f0ebc005f90 comp rx=0 tx=0).stop 2024-09-19T07:11:12.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.756+0000 7f0ecd3c4640 1 -- 172.21.15.148:0/1690082883 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ec8102c80 msgr2=0x7f0ec81983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:12.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.756+0000 7f0ecd3c4640 1 --2- 172.21.15.148:0/1690082883 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ec8102c80 0x7f0ec81983e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8006010 tx=0x7f0eb8004040 comp rx=0 tx=0).stop 2024-09-19T07:11:12.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.756+0000 7f0ecd3c4640 1 -- 172.21.15.148:0/1690082883 shutdown_connections 2024-09-19T07:11:12.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.756+0000 7f0ecd3c4640 1 --2- 172.21.15.148:0/1690082883 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f0eb00a3580 0x7f0eb00a5a40 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:12.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.756+0000 7f0ecd3c4640 1 --2- 172.21.15.148:0/1690082883 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ec810c0d0 0x7f0ec819cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:12.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.756+0000 7f0ecd3c4640 1 --2- 172.21.15.148:0/1690082883 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0ec81035a0 0x7f0ec8198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:12.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.756+0000 7f0ecd3c4640 1 --2- 172.21.15.148:0/1690082883 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ec8102c80 0x7f0ec81983e0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:12.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.756+0000 7f0ecd3c4640 1 -- 172.21.15.148:0/1690082883 >> 172.21.15.148:0/1690082883 conn(0x7f0ec8077990 msgr2=0x7f0ec80fcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:12.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.756+0000 7f0ecd3c4640 1 -- 172.21.15.148:0/1690082883 shutdown_connections 2024-09-19T07:11:12.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.756+0000 7f0ecd3c4640 1 -- 172.21.15.148:0/1690082883 wait complete. 2024-09-19T07:11:12.770 DEBUG:teuthology.orchestra.run.smithi148:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-09-19T07:11:12.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:12 smithi179 ceph-mon[35716]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 0 B/s wr, 21 op/s 2024-09-19T07:11:12.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:12 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/1606223907' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:11:12.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.875+0000 7f496088d640 1 -- 172.21.15.148:0/3338052445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f495c1009f0 msgr2=0x7f495c100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:12.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.875+0000 7f496088d640 1 --2- 172.21.15.148:0/3338052445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f495c1009f0 0x7f495c100e50 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4950009930 tx=0x7f495002a420 comp rx=0 tx=0).stop 2024-09-19T07:11:12.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.875+0000 7f496088d640 1 -- 172.21.15.148:0/3338052445 shutdown_connections 2024-09-19T07:11:12.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.875+0000 7f496088d640 1 --2- 172.21.15.148:0/3338052445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f495c101390 0x7f495c10d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:12.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.875+0000 7f496088d640 1 --2- 172.21.15.148:0/3338052445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f495c1009f0 0x7f495c100e50 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:12.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.875+0000 7f496088d640 1 --2- 172.21.15.148:0/3338052445 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f495c106a00 0x7f495c106de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:12.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.875+0000 7f496088d640 1 -- 172.21.15.148:0/3338052445 >> 172.21.15.148:0/3338052445 conn(0x7f495c0fc6b0 msgr2=0x7f495c0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:12.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.875+0000 7f496088d640 1 -- 172.21.15.148:0/3338052445 shutdown_connections 2024-09-19T07:11:12.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.875+0000 7f496088d640 1 -- 172.21.15.148:0/3338052445 wait complete. 2024-09-19T07:11:12.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.876+0000 7f496088d640 1 Processor -- start 2024-09-19T07:11:12.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.876+0000 7f496088d640 1 -- start start 2024-09-19T07:11:12.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.876+0000 7f496088d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f495c1009f0 0x7f495c1991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:12.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.876+0000 7f496088d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f495c101390 0x7f495c1996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:12.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.876+0000 7f496088d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f495c106a00 0x7f495c1a4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:12.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.876+0000 7f496088d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f495c110e00 con 0x7f495c1009f0 2024-09-19T07:11:12.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.876+0000 7f496088d640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f495c110c80 con 0x7f495c106a00 2024-09-19T07:11:12.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.876+0000 7f496088d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f495c110f80 con 0x7f495c101390 2024-09-19T07:11:12.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.876+0000 7f495a59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f495c1009f0 0x7f495c1991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:12.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.876+0000 7f495a59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f495c1009f0 0x7f495c1991b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60866/0 (socket says 172.21.15.148:60866) 2024-09-19T07:11:12.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.876+0000 7f495a59c640 1 -- 172.21.15.148:0/4072670289 learned_addr learned my addr 172.21.15.148:0/4072670289 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:12.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.876+0000 7f4959d9b640 1 --2- 172.21.15.148:0/4072670289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f495c101390 0x7f495c1996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:12.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.876+0000 7f495ad9d640 1 --2- 172.21.15.148:0/4072670289 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f495c106a00 0x7f495c1a4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:12.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.876+0000 7f495a59c640 1 -- 172.21.15.148:0/4072670289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f495c101390 msgr2=0x7f495c1996f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:12.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.876+0000 7f495a59c640 1 --2- 172.21.15.148:0/4072670289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f495c101390 0x7f495c1996f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:12.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.876+0000 7f495a59c640 1 -- 172.21.15.148:0/4072670289 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f495c106a00 msgr2=0x7f495c1a4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:12.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.876+0000 7f495a59c640 1 --2- 172.21.15.148:0/4072670289 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f495c106a00 0x7f495c1a4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:12.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.876+0000 7f495a59c640 1 -- 172.21.15.148:0/4072670289 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f495c1a4770 con 0x7f495c1009f0 2024-09-19T07:11:12.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.876+0000 7f495ad9d640 1 --2- 172.21.15.148:0/4072670289 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f495c106a00 0x7f495c1a4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:11:12.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.876+0000 7f495a59c640 1 --2- 172.21.15.148:0/4072670289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f495c1009f0 0x7f495c1991b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f494c00c920 tx=0x7f494c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:12.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.877+0000 7f494b7fe640 1 -- 172.21.15.148:0/4072670289 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494c007c70 con 0x7f495c1009f0 2024-09-19T07:11:12.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.877+0000 7f494b7fe640 1 -- 172.21.15.148:0/4072670289 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f494c007e10 con 0x7f495c1009f0 2024-09-19T07:11:12.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.877+0000 7f496088d640 1 -- 172.21.15.148:0/4072670289 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f495c1a4940 con 0x7f495c1009f0 2024-09-19T07:11:12.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.877+0000 7f494b7fe640 1 -- 172.21.15.148:0/4072670289 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494c018890 con 0x7f495c1009f0 2024-09-19T07:11:12.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.877+0000 7f496088d640 1 -- 172.21.15.148:0/4072670289 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f495c1a4eb0 con 0x7f495c1009f0 2024-09-19T07:11:12.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.878+0000 7f496088d640 1 -- 172.21.15.148:0/4072670289 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f495c100e50 con 0x7f495c1009f0 2024-09-19T07:11:12.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.879+0000 7f494b7fe640 1 -- 172.21.15.148:0/4072670289 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f494c018a50 con 0x7f495c1009f0 2024-09-19T07:11:12.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.879+0000 7f494b7fe640 1 --2- 172.21.15.148:0/4072670289 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f49440a3580 0x7f49440a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:12.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.880+0000 7f4959d9b640 1 --2- 172.21.15.148:0/4072670289 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f49440a3580 0x7f49440a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:12.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.880+0000 7f494b7fe640 1 -- 172.21.15.148:0/4072670289 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f494c0d0240 con 0x7f495c1009f0 2024-09-19T07:11:12.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.880+0000 7f4959d9b640 1 --2- 172.21.15.148:0/4072670289 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f49440a3580 0x7f49440a5a40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4950000c00 tx=0x7f4950005a20 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:12.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.883+0000 7f494b7fe640 1 -- 172.21.15.148:0/4072670289 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f494c014030 con 0x7f495c1009f0 2024-09-19T07:11:12.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.976+0000 7f50f6e17640 1 -- 172.21.15.148:0/2839699516 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f50f0106f20 msgr2=0x7f50f010eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:12.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.976+0000 7f50f6e17640 1 --2- 172.21.15.148:0/2839699516 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f50f0106f20 0x7f50f010eaa0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f50e8009ca0 tx=0x7f50e802a8c0 comp rx=0 tx=0).stop 2024-09-19T07:11:12.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.977+0000 7f50f6e17640 1 -- 172.21.15.148:0/2839699516 shutdown_connections 2024-09-19T07:11:12.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.977+0000 7f50f6e17640 1 --2- 172.21.15.148:0/2839699516 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f50f0106f20 0x7f50f010eaa0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:12.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.977+0000 7f50f6e17640 1 --2- 172.21.15.148:0/2839699516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50f01027a0 0x7f50f01067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:12.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.977+0000 7f50f6e17640 1 --2- 172.21.15.148:0/2839699516 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f50f0101df0 0x7f50f01021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:12.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.977+0000 7f50f6e17640 1 -- 172.21.15.148:0/2839699516 >> 172.21.15.148:0/2839699516 conn(0x7f50f00fd8f0 msgr2=0x7f50f00ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:12.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.977+0000 7f50f6e17640 1 -- 172.21.15.148:0/2839699516 shutdown_connections 2024-09-19T07:11:12.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.977+0000 7f50f6e17640 1 -- 172.21.15.148:0/2839699516 wait complete. 2024-09-19T07:11:12.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.977+0000 7f50f6e17640 1 Processor -- start 2024-09-19T07:11:12.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.978+0000 7f50f6e17640 1 -- start start 2024-09-19T07:11:12.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.978+0000 7f50f6e17640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50f0101df0 0x7f50f0198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:12.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.978+0000 7f50f6e17640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f50f01027a0 0x7f50f01988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:12.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.978+0000 7f50f6e17640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f50f0106f20 0x7f50f019cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:12.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.978+0000 7f50f6e17640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f50f0111f80 con 0x7f50f0106f20 2024-09-19T07:11:12.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.978+0000 7f50f6e17640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f50f0111e00 con 0x7f50f01027a0 2024-09-19T07:11:12.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.978+0000 7f50f6e17640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f50f0112100 con 0x7f50f0101df0 2024-09-19T07:11:12.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.978+0000 7f50f53b4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f50f0106f20 0x7f50f019cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:12.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.978+0000 7f50f53b4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f50f0106f20 0x7f50f019cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60894/0 (socket says 172.21.15.148:60894) 2024-09-19T07:11:12.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.978+0000 7f50f53b4640 1 -- 172.21.15.148:0/2460555424 learned_addr learned my addr 172.21.15.148:0/2460555424 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:12.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.978+0000 7f50f4bb3640 1 --2- 172.21.15.148:0/2460555424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50f0101df0 0x7f50f0198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:12.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.978+0000 7f50effff640 1 --2- 172.21.15.148:0/2460555424 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f50f01027a0 0x7f50f01988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:12.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.978+0000 7f50f53b4640 1 -- 172.21.15.148:0/2460555424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50f0101df0 msgr2=0x7f50f0198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:12.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.978+0000 7f50f53b4640 1 --2- 172.21.15.148:0/2460555424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50f0101df0 0x7f50f0198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:12.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.978+0000 7f50f53b4640 1 -- 172.21.15.148:0/2460555424 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f50f01027a0 msgr2=0x7f50f01988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:12.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.978+0000 7f50f53b4640 1 --2- 172.21.15.148:0/2460555424 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f50f01027a0 0x7f50f01988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:12.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.978+0000 7f50f53b4640 1 -- 172.21.15.148:0/2460555424 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50f019d310 con 0x7f50f0106f20 2024-09-19T07:11:12.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.978+0000 7f50effff640 1 --2- 172.21.15.148:0/2460555424 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f50f01027a0 0x7f50f01988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:11:12.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.979+0000 7f50f53b4640 1 --2- 172.21.15.148:0/2460555424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f50f0106f20 0x7f50f019cc30 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f50e8031a20 tx=0x7f50e8031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:12.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.979+0000 7f50edffb640 1 -- 172.21.15.148:0/2460555424 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e8003c30 con 0x7f50f0106f20 2024-09-19T07:11:12.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.979+0000 7f50edffb640 1 -- 172.21.15.148:0/2460555424 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50e8003dd0 con 0x7f50f0106f20 2024-09-19T07:11:12.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.979+0000 7f50f6e17640 1 -- 172.21.15.148:0/2460555424 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50f019d5a0 con 0x7f50f0106f20 2024-09-19T07:11:12.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.979+0000 7f50edffb640 1 -- 172.21.15.148:0/2460555424 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e802fc40 con 0x7f50f0106f20 2024-09-19T07:11:12.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.979+0000 7f50f6e17640 1 -- 172.21.15.148:0/2460555424 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50f01a4ee0 con 0x7f50f0106f20 2024-09-19T07:11:12.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.982+0000 7f50edffb640 1 -- 172.21.15.148:0/2460555424 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f50e8004050 con 0x7f50f0106f20 2024-09-19T07:11:12.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.982+0000 7f50f91f0740 1 Processor -- start 2024-09-19T07:11:12.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.982+0000 7f50f91f0740 1 -- start start 2024-09-19T07:11:12.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.982+0000 7f50f91f0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556f72bcbb60 0x556f72bcbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:12.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.983+0000 7f50f91f0740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556f72bcc480 0x556f72bd6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:12.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.983+0000 7f50f91f0740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556f72bd6d40 0x556f72bd9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:12.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.983+0000 7f50f91f0740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x556f72b31280 con 0x556f72bcc480 2024-09-19T07:11:12.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.983+0000 7f50f91f0740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x556f72ad8b10 con 0x556f72bd6d40 2024-09-19T07:11:12.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.983+0000 7f50f91f0740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x556f72b2d240 con 0x556f72bcbb60 2024-09-19T07:11:12.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.983+0000 7f50f4bb3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556f72bcc480 0x556f72bd6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:12.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.983+0000 7f50f4bb3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556f72bcc480 0x556f72bd6800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60898/0 (socket says 172.21.15.148:60898) 2024-09-19T07:11:12.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.983+0000 7f50f4bb3640 1 -- 172.21.15.148:0/1911427243 learned_addr learned my addr 172.21.15.148:0/1911427243 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:12.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.983+0000 7f50effff640 1 --2- 172.21.15.148:0/1911427243 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556f72bcbb60 0x556f72bcbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:12.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.983+0000 7f50effff640 1 --2- 172.21.15.148:0/1911427243 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556f72bd6d40 0x556f72bd9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:12.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.983+0000 7f50edffb640 1 --2- 172.21.15.148:0/2460555424 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f50e00a34c0 0x7f50e00a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:12.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.983+0000 7f50effff640 1 -- 172.21.15.148:0/1911427243 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556f72bd6d40 msgr2=0x556f72bd9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:12.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.983+0000 7f50effff640 1 --2- 172.21.15.148:0/1911427243 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556f72bd6d40 0x556f72bd9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:12.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.983+0000 7f50effff640 1 -- 172.21.15.148:0/1911427243 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556f72bcc480 msgr2=0x556f72bd6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:12.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.983+0000 7f50edffb640 1 -- 172.21.15.148:0/2460555424 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f50e80f1000 con 0x7f50f0106f20 2024-09-19T07:11:12.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.983+0000 7f50effff640 1 --2- 172.21.15.148:0/1911427243 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556f72bcc480 0x556f72bd6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:12.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.983+0000 7f50effff640 1 -- 172.21.15.148:0/1911427243 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f72ae51f0 con 0x556f72bcbb60 2024-09-19T07:11:12.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.983+0000 7f50f53b4640 1 --2- 172.21.15.148:0/2460555424 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f50e00a34c0 0x7f50e00a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:12.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.983+0000 7f50f4bb3640 1 --2- 172.21.15.148:0/1911427243 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556f72bcc480 0x556f72bd6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:11:12.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.984+0000 7f50effff640 1 --2- 172.21.15.148:0/1911427243 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556f72bcbb60 0x556f72bcbf40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f50f01083b0 tx=0x7f50dc009600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2596ebaf183b578 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:12.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.984+0000 7f50daffd640 1 -- 172.21.15.148:0/1911427243 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50dc012cc0 con 0x556f72bcbb60 2024-09-19T07:11:12.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.984+0000 7f50f53b4640 1 --2- 172.21.15.148:0/2460555424 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f50e00a34c0 0x7f50e00a5980 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f50e80ee810 tx=0x7f50e802f4e0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:12.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.984+0000 7f50daffd640 1 -- 172.21.15.148:0/1911427243 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50dc005500 con 0x556f72bcbb60 2024-09-19T07:11:12.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.984+0000 7f50daffd640 1 -- 172.21.15.148:0/1911427243 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50dc0109f0 con 0x556f72bcbb60 2024-09-19T07:11:12.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.985+0000 7f50f91f0740 1 -- 172.21.15.148:0/1911427243 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556f72bcbb60 msgr2=0x556f72bcbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:12.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.985+0000 7f50f91f0740 1 --2- 172.21.15.148:0/1911427243 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556f72bcbb60 0x556f72bcbf40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f50f01083b0 tx=0x7f50dc009600 comp rx=0 tx=0).stop 2024-09-19T07:11:12.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.985+0000 7f50f91f0740 1 -- 172.21.15.148:0/1911427243 shutdown_connections 2024-09-19T07:11:12.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.985+0000 7f50f91f0740 1 --2- 172.21.15.148:0/1911427243 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556f72bd6d40 0x556f72bd9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:12.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.985+0000 7f50f91f0740 1 --2- 172.21.15.148:0/1911427243 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556f72bcc480 0x556f72bd6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:12.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.985+0000 7f50f91f0740 1 --2- 172.21.15.148:0/1911427243 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556f72bcbb60 0x556f72bcbf40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:12.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.985+0000 7f50f91f0740 1 -- 172.21.15.148:0/1911427243 >> 172.21.15.148:0/1911427243 conn(0x556f72bc80f0 msgr2=0x556f72bc84d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:12.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.985+0000 7f50f91f0740 1 -- 172.21.15.148:0/1911427243 shutdown_connections 2024-09-19T07:11:12.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.985+0000 7f50f91f0740 1 -- 172.21.15.148:0/1911427243 wait complete. 2024-09-19T07:11:12.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.985+0000 7f50f91f0740 1 -- start start 2024-09-19T07:11:12.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.986+0000 7f50f91f0740 1 Processor -- start 2024-09-19T07:11:12.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.986+0000 7f50f91f0740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556f72bcbb60 0x556f72bd3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:12.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.986+0000 7f50f91f0740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556f72bcc480 0x556f72bd4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:12.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.986+0000 7f50f91f0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556f72bd6d40 0x556f72bd4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:12.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.986+0000 7f50f91f0740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x556f72bddd20 con 0x556f72bcbb60 2024-09-19T07:11:12.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.986+0000 7f50f91f0740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x556f72aebf10 con 0x556f72bcc480 2024-09-19T07:11:12.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.986+0000 7f50f91f0740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x556f72bddea0 con 0x556f72bd6d40 2024-09-19T07:11:12.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.986+0000 7f50f91f0740 10 client.0 _ll_register_callbacks cb 0x556f72ab4a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:11:12.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.986+0000 7f50effff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556f72bcbb60 0x556f72bd3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:12.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.986+0000 7f50f4bb3640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556f72bcc480 0x556f72bd4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:12.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.986+0000 7f50effff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556f72bcbb60 0x556f72bd3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60900/0 (socket says 172.21.15.148:60900) 2024-09-19T07:11:12.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.986+0000 7f50effff640 1 -- 172.21.15.148:0/2718171289 learned_addr learned my addr 172.21.15.148:0/2718171289 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:12.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.987+0000 7f50effff640 1 --2- 172.21.15.148:0/2718171289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556f72bd6d40 0x556f72bd4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:12.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.987+0000 7f50effff640 1 -- 172.21.15.148:0/2718171289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556f72bd6d40 msgr2=0x556f72bd4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:12.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.987+0000 7f50effff640 1 --2- 172.21.15.148:0/2718171289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556f72bd6d40 0x556f72bd4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:12.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.987+0000 7f50effff640 1 -- 172.21.15.148:0/2718171289 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556f72bcc480 msgr2=0x556f72bd4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:12.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.987+0000 7f50effff640 1 --2- 172.21.15.148:0/2718171289 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556f72bcc480 0x556f72bd4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:12.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.987+0000 7f50effff640 1 -- 172.21.15.148:0/2718171289 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f728a26a0 con 0x556f72bcbb60 2024-09-19T07:11:12.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.987+0000 7f50effff640 1 --2- 172.21.15.148:0/2718171289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556f72bcbb60 0x556f72bd3d00 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f50dc009980 tx=0x7f50dc009910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5771fceb9b60fede server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:12.991 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.987+0000 7f50cffff640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:11:12.991 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.987+0000 7f50cffff640 1 -- 172.21.15.148:0/2718171289 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50dc028020 con 0x556f72bcbb60 2024-09-19T07:11:12.991 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.987+0000 7f50f91f0740 1 -- 172.21.15.148:0/2718171289 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50dc005500 con 0x556f72bcbb60 2024-09-19T07:11:12.991 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.987+0000 7f50cffff640 1 -- 172.21.15.148:0/2718171289 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f50dc005230 con 0x556f72bcbb60 2024-09-19T07:11:12.991 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.988+0000 7f50cffff640 1 -- 172.21.15.148:0/2718171289 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f50dc033050 con 0x556f72bcbb60 2024-09-19T07:11:12.991 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.988+0000 7f50f91f0740 10 client.15267 fetch_fsmap learned FSMap version 25 2024-09-19T07:11:12.991 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.988+0000 7f50f91f0740 1 -- 172.21.15.148:0/2718171289 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556f72be9a00 con 0x556f72bcbb60 2024-09-19T07:11:12.991 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.988+0000 7f50cffff640 1 -- 172.21.15.148:0/2718171289 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50dc005500 con 0x556f72bcbb60 2024-09-19T07:11:12.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.988+0000 7f50cffff640 1 -- 172.21.15.148:0/2718171289 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f50dc01f7b0 con 0x556f72bcbb60 2024-09-19T07:11:12.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.988+0000 7f50f91f0740 10 client.15267 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:11:12.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.988+0000 7f50f91f0740 10 client.15267 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:11:12.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.988+0000 7f50f91f0740 20 client.15267 populate_metadata read hostname 'smithi148' 2024-09-19T07:11:12.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.988+0000 7f50f91f0740 1 --2- 172.21.15.148:0/2718171289 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x556f72bead50 0x556f72bed140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:12.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.988+0000 7f50f91f0740 4 client.15267 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:11:12.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.988+0000 7f50f91f0740 1 -- 172.21.15.148:0/2718171289 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556f72b3e7f0 con 0x556f72bead50 2024-09-19T07:11:12.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.989+0000 7f50f4bb3640 1 --2- 172.21.15.148:0/2718171289 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x556f72bead50 0x556f72bed140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:12.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.989+0000 7f50f4bb3640 1 --2- 172.21.15.148:0/2718171289 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x556f72bead50 0x556f72bed140 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e349d06f79030a02 server_cookie=619e048393fe44e3 in_seq=0 out_seq=0 2024-09-19T07:11:12.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.989+0000 7f50cffff640 10 client.15267 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:11:12.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.990+0000 7f50cffff640 1 -- 172.21.15.148:0/2718171289 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556f72b3e7f0 con 0x556f72bead50 2024-09-19T07:11:12.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.990+0000 7f50cffff640 10 client.15267 handle_command_reply: tid=0 2024-09-19T07:11:12.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.990+0000 7f50f91f0740 1 client.15267 shutdown 2024-09-19T07:11:12.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.990+0000 7f50f91f0740 1 -- 172.21.15.148:0/2718171289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556f72bcbb60 msgr2=0x556f72bd3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:12.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.990+0000 7f50f91f0740 1 --2- 172.21.15.148:0/2718171289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556f72bcbb60 0x556f72bd3d00 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f50dc009980 tx=0x7f50dc009910 comp rx=0 tx=0).stop 2024-09-19T07:11:12.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.990+0000 7f50f91f0740 1 -- 172.21.15.148:0/2718171289 shutdown_connections 2024-09-19T07:11:12.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.990+0000 7f50f91f0740 1 --2- 172.21.15.148:0/2718171289 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x556f72bead50 0x556f72bed140 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:12.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.990+0000 7f50f91f0740 1 --2- 172.21.15.148:0/2718171289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556f72bd6d40 0x556f72bd4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:12.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.990+0000 7f50cffff640 0 client.15267 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:11:12.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.990+0000 7f50f91f0740 1 --2- 172.21.15.148:0/2718171289 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556f72bcc480 0x556f72bd4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:12.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.990+0000 7f50f91f0740 1 --2- 172.21.15.148:0/2718171289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556f72bcbb60 0x556f72bd3d00 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:12.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.990+0000 7f50f91f0740 1 -- 172.21.15.148:0/2718171289 >> 172.21.15.148:0/2718171289 conn(0x556f72bc80f0 msgr2=0x556f72bc7270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:12.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.990+0000 7f50f91f0740 1 -- 172.21.15.148:0/2718171289 shutdown_connections 2024-09-19T07:11:12.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.990+0000 7f50f91f0740 1 -- 172.21.15.148:0/2718171289 wait complete. 2024-09-19T07:11:12.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:12.990+0000 7f50f91f0740 20 client.15267 trim_cache size 0 max 16384 2024-09-19T07:11:13.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.007+0000 7f50f91f0740 1 Processor -- start 2024-09-19T07:11:13.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.007+0000 7f50f91f0740 1 -- start start 2024-09-19T07:11:13.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.008+0000 7f50f91f0740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556f72bcbb60 0x556f72bd5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:13.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.008+0000 7f50f91f0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556f72bcc480 0x556f72bf2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:13.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.008+0000 7f50f91f0740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556f72bd6d40 0x556f72bf2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:13.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.008+0000 7f50f91f0740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f50f01ade60 con 0x556f72bd6d40 2024-09-19T07:11:13.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.008+0000 7f50f91f0740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f50f01ab730 con 0x556f72bcbb60 2024-09-19T07:11:13.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.008+0000 7f50f91f0740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f50f01a9560 con 0x556f72bcc480 2024-09-19T07:11:13.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.008+0000 7f50effff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556f72bd6d40 0x556f72bf2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:13.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.008+0000 7f50effff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556f72bd6d40 0x556f72bf2dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60910/0 (socket says 172.21.15.148:60910) 2024-09-19T07:11:13.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.008+0000 7f50effff640 1 -- 172.21.15.148:0/2277187770 learned_addr learned my addr 172.21.15.148:0/2277187770 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:13.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.008+0000 7f50effff640 1 --2- 172.21.15.148:0/2277187770 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556f72bcbb60 0x556f72bd5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:13.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.008+0000 7f50f4bb3640 1 --2- 172.21.15.148:0/2277187770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556f72bcc480 0x556f72bf2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:13.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.008+0000 7f50effff640 1 -- 172.21.15.148:0/2277187770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556f72bcc480 msgr2=0x556f72bf2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:13.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.008+0000 7f50effff640 1 --2- 172.21.15.148:0/2277187770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556f72bcc480 0x556f72bf2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:13.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.008+0000 7f50effff640 1 -- 172.21.15.148:0/2277187770 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556f72bcbb60 msgr2=0x556f72bd5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:13.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.008+0000 7f50effff640 1 --2- 172.21.15.148:0/2277187770 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556f72bcbb60 0x556f72bd5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:13.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.008+0000 7f50effff640 1 -- 172.21.15.148:0/2277187770 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f72bcc2b0 con 0x556f72bd6d40 2024-09-19T07:11:13.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.008+0000 7f50effff640 1 --2- 172.21.15.148:0/2277187770 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556f72bd6d40 0x556f72bf2dc0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f50dc009df0 tx=0x7f50dc005f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d59ecf8a841f4925 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:13.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.008+0000 7f50da7fc640 1 -- 172.21.15.148:0/2277187770 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50dc028070 con 0x556f72bd6d40 2024-09-19T07:11:13.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.008+0000 7f50da7fc640 1 -- 172.21.15.148:0/2277187770 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50dc01f950 con 0x556f72bd6d40 2024-09-19T07:11:13.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.008+0000 7f50da7fc640 1 -- 172.21.15.148:0/2277187770 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50dc023070 con 0x556f72bd6d40 2024-09-19T07:11:13.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.009+0000 7f50f91f0740 1 -- 172.21.15.148:0/2277187770 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556f72bd6d40 msgr2=0x556f72bf2dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:13.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.009+0000 7f50f91f0740 1 --2- 172.21.15.148:0/2277187770 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556f72bd6d40 0x556f72bf2dc0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f50dc009df0 tx=0x7f50dc005f80 comp rx=0 tx=0).stop 2024-09-19T07:11:13.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.009+0000 7f50f91f0740 1 -- 172.21.15.148:0/2277187770 shutdown_connections 2024-09-19T07:11:13.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.009+0000 7f50f91f0740 1 --2- 172.21.15.148:0/2277187770 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556f72bd6d40 0x556f72bf2dc0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:13.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.009+0000 7f50f91f0740 1 --2- 172.21.15.148:0/2277187770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556f72bcc480 0x556f72bf2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:13.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.009+0000 7f50f91f0740 1 --2- 172.21.15.148:0/2277187770 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556f72bcbb60 0x556f72bd5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:13.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.009+0000 7f50f91f0740 1 -- 172.21.15.148:0/2277187770 >> 172.21.15.148:0/2277187770 conn(0x556f72bc80f0 msgr2=0x556f72bd2cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:13.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.009+0000 7f50f91f0740 1 -- 172.21.15.148:0/2277187770 shutdown_connections 2024-09-19T07:11:13.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.009+0000 7f50f91f0740 1 -- 172.21.15.148:0/2277187770 wait complete. 2024-09-19T07:11:13.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.009+0000 7f50f91f0740 1 -- start start 2024-09-19T07:11:13.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.010+0000 7f50f91f0740 1 Processor -- start 2024-09-19T07:11:13.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.010+0000 7f50f91f0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556f72bcbb60 0x556f72bdf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:13.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.010+0000 7f50f91f0740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556f72bcc480 0x556f72bdf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:13.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.010+0000 7f50f91f0740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556f72bd6d40 0x556f72c54850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:13.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.010+0000 7f50f91f0740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f50f01a9bf0 con 0x556f72bd6d40 2024-09-19T07:11:13.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.010+0000 7f50f91f0740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f50f01ab060 con 0x556f72bcc480 2024-09-19T07:11:13.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.010+0000 7f50f91f0740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f50f01aa2c0 con 0x556f72bcbb60 2024-09-19T07:11:13.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.010+0000 7f50f91f0740 10 client.0 _ll_register_callbacks cb 0x7f50e400c3f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:11:13.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.010+0000 7f50effff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556f72bd6d40 0x556f72c54850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:13.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.010+0000 7f50effff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556f72bd6d40 0x556f72c54850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60918/0 (socket says 172.21.15.148:60918) 2024-09-19T07:11:13.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.010+0000 7f50effff640 1 -- 172.21.15.148:0/2921011486 learned_addr learned my addr 172.21.15.148:0/2921011486 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:13.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.010+0000 7f50effff640 1 --2- 172.21.15.148:0/2921011486 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556f72bcbb60 0x556f72bdf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:13.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.010+0000 7f50f4bb3640 1 --2- 172.21.15.148:0/2921011486 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556f72bcc480 0x556f72bdf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:13.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.010+0000 7f50effff640 1 -- 172.21.15.148:0/2921011486 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556f72bcbb60 msgr2=0x556f72bdf2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:13.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.010+0000 7f50effff640 1 --2- 172.21.15.148:0/2921011486 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556f72bcbb60 0x556f72bdf2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:13.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.011+0000 7f50effff640 1 -- 172.21.15.148:0/2921011486 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556f72bcc480 msgr2=0x556f72bdf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:13.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.011+0000 7f50effff640 1 --2- 172.21.15.148:0/2921011486 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556f72bcc480 0x556f72bdf800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:13.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.011+0000 7f50effff640 1 -- 172.21.15.148:0/2921011486 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f72c54d90 con 0x556f72bd6d40 2024-09-19T07:11:13.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.011+0000 7f50effff640 1 --2- 172.21.15.148:0/2921011486 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556f72bd6d40 0x556f72c54850 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f50dc004cf0 tx=0x7f50dc017040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c149f2993687c1fb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:13.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.011+0000 7f50cffff640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:11:13.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.011+0000 7f50cffff640 1 -- 172.21.15.148:0/2921011486 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50dc028030 con 0x556f72bd6d40 2024-09-19T07:11:13.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.011+0000 7f50f91f0740 1 -- 172.21.15.148:0/2921011486 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50dc01f950 con 0x556f72bd6d40 2024-09-19T07:11:13.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.011+0000 7f50cffff640 1 -- 172.21.15.148:0/2921011486 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f50dc01f730 con 0x556f72bd6d40 2024-09-19T07:11:13.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.011+0000 7f50cffff640 1 -- 172.21.15.148:0/2921011486 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f50dc04b050 con 0x556f72bd6d40 2024-09-19T07:11:13.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.011+0000 7f50f91f0740 10 client.15273 fetch_fsmap learned FSMap version 25 2024-09-19T07:11:13.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.011+0000 7f50f91f0740 1 -- 172.21.15.148:0/2921011486 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556f72c55f50 con 0x556f72bd6d40 2024-09-19T07:11:13.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.011+0000 7f50cffff640 1 -- 172.21.15.148:0/2921011486 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50dc01f950 con 0x556f72bd6d40 2024-09-19T07:11:13.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.011+0000 7f50cffff640 1 -- 172.21.15.148:0/2921011486 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f50dc0377a0 con 0x556f72bd6d40 2024-09-19T07:11:13.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.011+0000 7f50f91f0740 10 client.15273 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:11:13.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.011+0000 7f50f91f0740 10 client.15273 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:11:13.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.011+0000 7f50f91f0740 20 client.15273 populate_metadata read hostname 'smithi148' 2024-09-19T07:11:13.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.011+0000 7f50f91f0740 1 --2- 172.21.15.148:0/2921011486 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x556f72bead50 0x556f72c585c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:13.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.012+0000 7f50f91f0740 4 client.15273 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T07:11:13.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.012+0000 7f50f91f0740 1 -- 172.21.15.148:0/2921011486 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x556f72b38d00 con 0x556f72bead50 2024-09-19T07:11:13.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.012+0000 7f50f4bb3640 1 --2- 172.21.15.148:0/2921011486 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x556f72bead50 0x556f72c585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:13.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.012+0000 7f50f4bb3640 1 --2- 172.21.15.148:0/2921011486 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x556f72bead50 0x556f72c585c0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8db0ceefef02fe42 server_cookie=ef8874b0112b92b6 in_seq=0 out_seq=0 2024-09-19T07:11:13.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.012+0000 7f50cffff640 10 client.15273 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:11:13.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.013+0000 7f50cffff640 1 -- 172.21.15.148:0/2921011486 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x556f72b38d00 con 0x556f72bead50 2024-09-19T07:11:13.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.013+0000 7f50cffff640 10 client.15273 handle_command_reply: tid=0 2024-09-19T07:11:13.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.013+0000 7f50f91f0740 1 client.15273 shutdown 2024-09-19T07:11:13.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.013+0000 7f50f91f0740 1 -- 172.21.15.148:0/2921011486 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556f72bd6d40 msgr2=0x556f72c54850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:13.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.013+0000 7f50f91f0740 1 --2- 172.21.15.148:0/2921011486 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556f72bd6d40 0x556f72c54850 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f50dc004cf0 tx=0x7f50dc017040 comp rx=0 tx=0).stop 2024-09-19T07:11:13.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.013+0000 7f50f91f0740 1 -- 172.21.15.148:0/2921011486 shutdown_connections 2024-09-19T07:11:13.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.013+0000 7f50f91f0740 1 --2- 172.21.15.148:0/2921011486 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x556f72bead50 0x556f72c585c0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:13.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.014+0000 7f50f91f0740 1 --2- 172.21.15.148:0/2921011486 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556f72bd6d40 0x556f72c54850 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:13.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.014+0000 7f50cffff640 0 client.15273 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:11:13.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.014+0000 7f50f91f0740 1 --2- 172.21.15.148:0/2921011486 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556f72bcc480 0x556f72bdf800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:13.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.014+0000 7f50f91f0740 1 --2- 172.21.15.148:0/2921011486 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556f72bcbb60 0x556f72bdf2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:13.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.014+0000 7f50f91f0740 1 -- 172.21.15.148:0/2921011486 >> 172.21.15.148:0/2921011486 conn(0x556f72bc80f0 msgr2=0x556f72bd3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:13.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.014+0000 7f50f91f0740 1 -- 172.21.15.148:0/2921011486 shutdown_connections 2024-09-19T07:11:13.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.014+0000 7f50f91f0740 1 -- 172.21.15.148:0/2921011486 wait complete. 2024-09-19T07:11:13.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.014+0000 7f50f91f0740 20 client.15273 trim_cache size 0 max 16384 2024-09-19T07:11:13.019 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:11:13.019 INFO:teuthology.orchestra.run.smithi148.stdout: "return_code": 0, 2024-09-19T07:11:13.019 INFO:teuthology.orchestra.run.smithi148.stdout: "scrub_tag": "766b04d1-8258-490b-869c-2b4a33340be4", 2024-09-19T07:11:13.020 INFO:teuthology.orchestra.run.smithi148.stdout: "mode": "asynchronous" 2024-09-19T07:11:13.020 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:11:13.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.014+0000 7f50f6e17640 1 -- 172.21.15.148:0/2460555424 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f50e00a34c0 msgr2=0x7f50e00a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:13.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.014+0000 7f50f6e17640 1 --2- 172.21.15.148:0/2460555424 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f50e00a34c0 0x7f50e00a5980 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f50e80ee810 tx=0x7f50e802f4e0 comp rx=0 tx=0).stop 2024-09-19T07:11:13.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.014+0000 7f50f6e17640 1 -- 172.21.15.148:0/2460555424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f50f0106f20 msgr2=0x7f50f019cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:13.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.014+0000 7f50f6e17640 1 --2- 172.21.15.148:0/2460555424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f50f0106f20 0x7f50f019cc30 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f50e8031a20 tx=0x7f50e8031a50 comp rx=0 tx=0).stop 2024-09-19T07:11:13.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.014+0000 7f50f6e17640 1 -- 172.21.15.148:0/2460555424 shutdown_connections 2024-09-19T07:11:13.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.014+0000 7f50f6e17640 1 --2- 172.21.15.148:0/2460555424 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f50e00a34c0 0x7f50e00a5980 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:13.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.014+0000 7f50f6e17640 1 --2- 172.21.15.148:0/2460555424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f50f0106f20 0x7f50f019cc30 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:13.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.014+0000 7f50f6e17640 1 --2- 172.21.15.148:0/2460555424 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f50f01027a0 0x7f50f01988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:13.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.014+0000 7f50f6e17640 1 --2- 172.21.15.148:0/2460555424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50f0101df0 0x7f50f0198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:13.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.014+0000 7f50f6e17640 1 -- 172.21.15.148:0/2460555424 >> 172.21.15.148:0/2460555424 conn(0x7f50f00fd8f0 msgr2=0x7f50f00febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:13.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.015+0000 7f50f6e17640 1 -- 172.21.15.148:0/2460555424 shutdown_connections 2024-09-19T07:11:13.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.015+0000 7f50f6e17640 1 -- 172.21.15.148:0/2460555424 wait complete. 2024-09-19T07:11:13.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.067+0000 7f496088d640 1 -- 172.21.15.148:0/4072670289 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f495c06a8f0 con 0x7f495c1009f0 2024-09-19T07:11:13.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.071+0000 7f494b7fe640 1 -- 172.21.15.148:0/4072670289 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v36)=0 v36) ==== 133+0+0 (secure 0 0 0) 0x7f494c00de20 con 0x7f495c1009f0 2024-09-19T07:11:13.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.074+0000 7f496088d640 1 -- 172.21.15.148:0/4072670289 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f49440a3580 msgr2=0x7f49440a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:13.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.074+0000 7f496088d640 1 --2- 172.21.15.148:0/4072670289 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f49440a3580 0x7f49440a5a40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4950000c00 tx=0x7f4950005a20 comp rx=0 tx=0).stop 2024-09-19T07:11:13.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.074+0000 7f496088d640 1 -- 172.21.15.148:0/4072670289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f495c1009f0 msgr2=0x7f495c1991b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:13.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.074+0000 7f496088d640 1 --2- 172.21.15.148:0/4072670289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f495c1009f0 0x7f495c1991b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f494c00c920 tx=0x7f494c00cde0 comp rx=0 tx=0).stop 2024-09-19T07:11:13.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.074+0000 7f496088d640 1 -- 172.21.15.148:0/4072670289 shutdown_connections 2024-09-19T07:11:13.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.074+0000 7f496088d640 1 --2- 172.21.15.148:0/4072670289 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f49440a3580 0x7f49440a5a40 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:13.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.074+0000 7f496088d640 1 --2- 172.21.15.148:0/4072670289 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f495c106a00 0x7f495c1a4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:13.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.074+0000 7f496088d640 1 --2- 172.21.15.148:0/4072670289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f495c101390 0x7f495c1996f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:13.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.074+0000 7f496088d640 1 --2- 172.21.15.148:0/4072670289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f495c1009f0 0x7f495c1991b0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:13.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.074+0000 7f496088d640 1 -- 172.21.15.148:0/4072670289 >> 172.21.15.148:0/4072670289 conn(0x7f495c0fc6b0 msgr2=0x7f495c0fcd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:13.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.074+0000 7f496088d640 1 -- 172.21.15.148:0/4072670289 shutdown_connections 2024-09-19T07:11:13.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.074+0000 7f496088d640 1 -- 172.21.15.148:0/4072670289 wait complete. 2024-09-19T07:11:13.087 DEBUG:teuthology.orchestra.run.smithi148:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-09-19T07:11:13.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.191+0000 7f9a9daac640 1 -- 172.21.15.148:0/1883155489 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a981009b0 msgr2=0x7f9a98100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:13.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.191+0000 7f9a9daac640 1 --2- 172.21.15.148:0/1883155489 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a981009b0 0x7f9a98100e10 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9a80009930 tx=0x7f9a8002a420 comp rx=0 tx=0).stop 2024-09-19T07:11:13.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.191+0000 7f9a9daac640 1 -- 172.21.15.148:0/1883155489 shutdown_connections 2024-09-19T07:11:13.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.191+0000 7f9a9daac640 1 --2- 172.21.15.148:0/1883155489 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a98101350 0x7f9a9810d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:13.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.191+0000 7f9a9daac640 1 --2- 172.21.15.148:0/1883155489 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a981009b0 0x7f9a98100e10 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:13.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.191+0000 7f9a9daac640 1 --2- 172.21.15.148:0/1883155489 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9a981069c0 0x7f9a98106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:13.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.192+0000 7f9a9daac640 1 -- 172.21.15.148:0/1883155489 >> 172.21.15.148:0/1883155489 conn(0x7f9a98077990 msgr2=0x7f9a980fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:13.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.192+0000 7f9a9daac640 1 -- 172.21.15.148:0/1883155489 shutdown_connections 2024-09-19T07:11:13.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.192+0000 7f9a9daac640 1 -- 172.21.15.148:0/1883155489 wait complete. 2024-09-19T07:11:13.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.192+0000 7f9a9daac640 1 Processor -- start 2024-09-19T07:11:13.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.192+0000 7f9a9daac640 1 -- start start 2024-09-19T07:11:13.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.193+0000 7f9a9daac640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a981009b0 0x7f9a981972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:13.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.193+0000 7f9a9daac640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9a98101350 0x7f9a981977e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:13.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.193+0000 7f9a9daac640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a981069c0 0x7f9a9819bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:13.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.193+0000 7f9a9daac640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9a98110e00 con 0x7f9a981069c0 2024-09-19T07:11:13.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.193+0000 7f9a9daac640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9a98110c80 con 0x7f9a98101350 2024-09-19T07:11:13.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.193+0000 7f9a9daac640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9a98110f80 con 0x7f9a981009b0 2024-09-19T07:11:13.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.193+0000 7f9a97fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a981069c0 0x7f9a9819bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:13.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.193+0000 7f9a97fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a981069c0 0x7f9a9819bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60932/0 (socket says 172.21.15.148:60932) 2024-09-19T07:11:13.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.193+0000 7f9a97fff640 1 -- 172.21.15.148:0/3216886933 learned_addr learned my addr 172.21.15.148:0/3216886933 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:13.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.193+0000 7f9a8effd640 1 --2- 172.21.15.148:0/3216886933 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9a98101350 0x7f9a981977e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:13.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.193+0000 7f9a977fe640 1 --2- 172.21.15.148:0/3216886933 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a981009b0 0x7f9a981972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:13.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.193+0000 7f9a97fff640 1 -- 172.21.15.148:0/3216886933 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a981009b0 msgr2=0x7f9a981972a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:13.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.193+0000 7f9a97fff640 1 --2- 172.21.15.148:0/3216886933 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a981009b0 0x7f9a981972a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:13.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.193+0000 7f9a97fff640 1 -- 172.21.15.148:0/3216886933 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9a98101350 msgr2=0x7f9a981977e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:13.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.193+0000 7f9a97fff640 1 --2- 172.21.15.148:0/3216886933 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9a98101350 0x7f9a981977e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:13.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.193+0000 7f9a97fff640 1 -- 172.21.15.148:0/3216886933 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a9819c290 con 0x7f9a981069c0 2024-09-19T07:11:13.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.193+0000 7f9a97fff640 1 --2- 172.21.15.148:0/3216886933 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a981069c0 0x7f9a9819bb60 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f9a9000eaa0 tx=0x7f9a9000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:13.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.193+0000 7f9a957fa640 1 -- 172.21.15.148:0/3216886933 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a9000cdb0 con 0x7f9a981069c0 2024-09-19T07:11:13.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.193+0000 7f9a957fa640 1 -- 172.21.15.148:0/3216886933 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a90005020 con 0x7f9a981069c0 2024-09-19T07:11:13.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.193+0000 7f9a9daac640 1 -- 172.21.15.148:0/3216886933 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a9819c580 con 0x7f9a981069c0 2024-09-19T07:11:13.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.193+0000 7f9a957fa640 1 -- 172.21.15.148:0/3216886933 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a900116b0 con 0x7f9a981069c0 2024-09-19T07:11:13.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.193+0000 7f9a9daac640 1 -- 172.21.15.148:0/3216886933 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a981a3e10 con 0x7f9a981069c0 2024-09-19T07:11:13.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.194+0000 7f9a9daac640 1 -- 172.21.15.148:0/3216886933 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a98100e10 con 0x7f9a981069c0 2024-09-19T07:11:13.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.195+0000 7f9a957fa640 1 -- 172.21.15.148:0/3216886933 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f9a90005560 con 0x7f9a981069c0 2024-09-19T07:11:13.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.196+0000 7f9a957fa640 1 --2- 172.21.15.148:0/3216886933 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f9a840a3500 0x7f9a840a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:13.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.196+0000 7f9a977fe640 1 --2- 172.21.15.148:0/3216886933 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f9a840a3500 0x7f9a840a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:13.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.196+0000 7f9a957fa640 1 -- 172.21.15.148:0/3216886933 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f9a900d0050 con 0x7f9a981069c0 2024-09-19T07:11:13.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.197+0000 7f9a977fe640 1 --2- 172.21.15.148:0/3216886933 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f9a840a3500 0x7f9a840a59c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9a8800bb60 tx=0x7f9a8800b390 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:13.201 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.200+0000 7f9a957fa640 1 -- 172.21.15.148:0/3216886933 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9a90016030 con 0x7f9a981069c0 2024-09-19T07:11:13.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.399+0000 7f9a9daac640 1 -- 172.21.15.148:0/3216886933 --> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f9a98062630 con 0x7f9a840a3500 2024-09-19T07:11:13.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.466+0000 7f9a957fa640 1 -- 172.21.15.148:0/3216886933 <== mgr.15123 v2:172.21.15.148:6800/3902535850 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f9a98062630 con 0x7f9a840a3500 2024-09-19T07:11:13.467 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule set for path / 2024-09-19T07:11:13.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.468+0000 7f9a9daac640 1 -- 172.21.15.148:0/3216886933 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f9a840a3500 msgr2=0x7f9a840a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:13.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.468+0000 7f9a9daac640 1 --2- 172.21.15.148:0/3216886933 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f9a840a3500 0x7f9a840a59c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9a8800bb60 tx=0x7f9a8800b390 comp rx=0 tx=0).stop 2024-09-19T07:11:13.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.468+0000 7f9a9daac640 1 -- 172.21.15.148:0/3216886933 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a981069c0 msgr2=0x7f9a9819bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:13.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.468+0000 7f9a9daac640 1 --2- 172.21.15.148:0/3216886933 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a981069c0 0x7f9a9819bb60 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f9a9000eaa0 tx=0x7f9a9000ef60 comp rx=0 tx=0).stop 2024-09-19T07:11:13.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.468+0000 7f9a9daac640 1 -- 172.21.15.148:0/3216886933 shutdown_connections 2024-09-19T07:11:13.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.468+0000 7f9a9daac640 1 --2- 172.21.15.148:0/3216886933 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f9a840a3500 0x7f9a840a59c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:13.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.468+0000 7f9a9daac640 1 --2- 172.21.15.148:0/3216886933 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a981069c0 0x7f9a9819bb60 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:13.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.468+0000 7f9a9daac640 1 --2- 172.21.15.148:0/3216886933 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9a98101350 0x7f9a981977e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:13.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.468+0000 7f9a9daac640 1 --2- 172.21.15.148:0/3216886933 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a981009b0 0x7f9a981972a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:13.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.468+0000 7f9a9daac640 1 -- 172.21.15.148:0/3216886933 >> 172.21.15.148:0/3216886933 conn(0x7f9a98077990 msgr2=0x7f9a98103860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:13.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.468+0000 7f9a9daac640 1 -- 172.21.15.148:0/3216886933 shutdown_connections 2024-09-19T07:11:13.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.468+0000 7f9a9daac640 1 -- 172.21.15.148:0/3216886933 wait complete. 2024-09-19T07:11:13.480 DEBUG:teuthology.orchestra.run.smithi148:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-09-19T07:11:13.585 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.584+0000 7fc0c26d7640 1 -- 172.21.15.148:0/773066220 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0bc101390 msgr2=0x7fc0bc10d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:13.585 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.584+0000 7fc0c26d7640 1 --2- 172.21.15.148:0/773066220 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0bc101390 0x7fc0bc10d8c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4009cd0 tx=0x7fc0b402a8e0 comp rx=0 tx=0).stop 2024-09-19T07:11:13.585 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.584+0000 7fc0c26d7640 1 -- 172.21.15.148:0/773066220 shutdown_connections 2024-09-19T07:11:13.585 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.584+0000 7fc0c26d7640 1 --2- 172.21.15.148:0/773066220 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0bc101390 0x7fc0bc10d8c0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:13.585 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.584+0000 7fc0c26d7640 1 --2- 172.21.15.148:0/773066220 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0bc1009f0 0x7fc0bc100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:13.585 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.584+0000 7fc0c26d7640 1 --2- 172.21.15.148:0/773066220 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc0bc106a00 0x7fc0bc106de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:13.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.584+0000 7fc0c26d7640 1 -- 172.21.15.148:0/773066220 >> 172.21.15.148:0/773066220 conn(0x7fc0bc0fc6b0 msgr2=0x7fc0bc0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:13.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.584+0000 7fc0c26d7640 1 -- 172.21.15.148:0/773066220 shutdown_connections 2024-09-19T07:11:13.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.584+0000 7fc0c26d7640 1 -- 172.21.15.148:0/773066220 wait complete. 2024-09-19T07:11:13.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.584+0000 7fc0c26d7640 1 Processor -- start 2024-09-19T07:11:13.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.584+0000 7fc0c26d7640 1 -- start start 2024-09-19T07:11:13.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.585+0000 7fc0c26d7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0bc1009f0 0x7fc0bc1991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:13.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.585+0000 7fc0c26d7640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc0bc101390 0x7fc0bc1996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:13.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.585+0000 7fc0c26d7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0bc106a00 0x7fc0bc1a4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:13.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.585+0000 7fc0c26d7640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc0bc110e40 con 0x7fc0bc1009f0 2024-09-19T07:11:13.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.585+0000 7fc0c26d7640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc0bc110cc0 con 0x7fc0bc101390 2024-09-19T07:11:13.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.585+0000 7fc0c26d7640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc0bc110fc0 con 0x7fc0bc106a00 2024-09-19T07:11:13.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.585+0000 7fc0bbfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0bc1009f0 0x7fc0bc1991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:13.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.585+0000 7fc0bbfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0bc1009f0 0x7fc0bc1991b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60950/0 (socket says 172.21.15.148:60950) 2024-09-19T07:11:13.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.585+0000 7fc0bbfff640 1 -- 172.21.15.148:0/1519483210 learned_addr learned my addr 172.21.15.148:0/1519483210 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:13.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.585+0000 7fc0c0c74640 1 --2- 172.21.15.148:0/1519483210 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0bc106a00 0x7fc0bc1a4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:13.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.585+0000 7fc0bb7fe640 1 --2- 172.21.15.148:0/1519483210 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc0bc101390 0x7fc0bc1996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:13.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.585+0000 7fc0bbfff640 1 -- 172.21.15.148:0/1519483210 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0bc106a00 msgr2=0x7fc0bc1a4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:13.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.585+0000 7fc0bbfff640 1 --2- 172.21.15.148:0/1519483210 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0bc106a00 0x7fc0bc1a4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:13.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.585+0000 7fc0bbfff640 1 -- 172.21.15.148:0/1519483210 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc0bc101390 msgr2=0x7fc0bc1996f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:13.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.585+0000 7fc0bbfff640 1 --2- 172.21.15.148:0/1519483210 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc0bc101390 0x7fc0bc1996f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:13.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.585+0000 7fc0bbfff640 1 -- 172.21.15.148:0/1519483210 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0bc1a4770 con 0x7fc0bc1009f0 2024-09-19T07:11:13.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.585+0000 7fc0bb7fe640 1 --2- 172.21.15.148:0/1519483210 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc0bc101390 0x7fc0bc1996f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:11:13.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.585+0000 7fc0bbfff640 1 --2- 172.21.15.148:0/1519483210 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0bc1009f0 0x7fc0bc1991b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac00e9f0 tx=0x7fc0ac00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:13.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.585+0000 7fc0b97fa640 1 -- 172.21.15.148:0/1519483210 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac00cd80 con 0x7fc0bc1009f0 2024-09-19T07:11:13.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.586+0000 7fc0b97fa640 1 -- 172.21.15.148:0/1519483210 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0ac010910 con 0x7fc0bc1009f0 2024-09-19T07:11:13.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.586+0000 7fc0c26d7640 1 -- 172.21.15.148:0/1519483210 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0bc1a4940 con 0x7fc0bc1009f0 2024-09-19T07:11:13.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.586+0000 7fc0b97fa640 1 -- 172.21.15.148:0/1519483210 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac018990 con 0x7fc0bc1009f0 2024-09-19T07:11:13.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.586+0000 7fc0c26d7640 1 -- 172.21.15.148:0/1519483210 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0bc1a4e60 con 0x7fc0bc1009f0 2024-09-19T07:11:13.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.587+0000 7fc0c26d7640 1 -- 172.21.15.148:0/1519483210 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0bc100e50 con 0x7fc0bc1009f0 2024-09-19T07:11:13.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.588+0000 7fc0b97fa640 1 -- 172.21.15.148:0/1519483210 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7fc0ac010ac0 con 0x7fc0bc1009f0 2024-09-19T07:11:13.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.588+0000 7fc0b97fa640 1 --2- 172.21.15.148:0/1519483210 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc0a80a3500 0x7fc0a80a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:13.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.588+0000 7fc0bb7fe640 1 --2- 172.21.15.148:0/1519483210 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc0a80a3500 0x7fc0a80a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:13.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.589+0000 7fc0b97fa640 1 -- 172.21.15.148:0/1519483210 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fc0ac0d05b0 con 0x7fc0bc1009f0 2024-09-19T07:11:13.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.589+0000 7fc0bb7fe640 1 --2- 172.21.15.148:0/1519483210 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc0a80a3500 0x7fc0a80a59c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc06ae50 tx=0x7fc0a4005e50 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:13.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.592+0000 7fc0b97fa640 1 -- 172.21.15.148:0/1519483210 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc0ac09ce30 con 0x7fc0bc1009f0 2024-09-19T07:11:13.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:13 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/766718080' entity='client.admin' 2024-09-19T07:11:13.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:13 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:11:13.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:13 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:11:13.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:13 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:11:13.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:13 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:13.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:13 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/1690082883' entity='client.admin' 2024-09-19T07:11:13.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:13 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:11:13.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:13 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:11:13.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:13 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:11:13.774 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:13 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:13.774 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:13 smithi179 ceph-mon[35716]: scrub queued for path: / 2024-09-19T07:11:13.774 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:13 smithi179 ceph-mon[35716]: scrub summary: idle+waiting paths [/] 2024-09-19T07:11:13.774 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:13 smithi179 ceph-mon[35716]: scrub summary: active paths [/] 2024-09-19T07:11:13.774 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:13 smithi179 ceph-mon[35716]: scrub summary: idle+waiting paths [/] 2024-09-19T07:11:13.774 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:13 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/4072670289' entity='client.admin' 2024-09-19T07:11:13.774 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:13 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:11:13.774 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:13 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:11:13.774 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:13 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:11:13.774 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:13 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:13.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.781+0000 7fc0c26d7640 1 -- 172.21.15.148:0/1519483210 --> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7fc0bc0fd460 con 0x7fc0a80a3500 2024-09-19T07:11:13.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:13 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/766718080' entity='client.admin' 2024-09-19T07:11:13.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:13 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:11:13.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:13 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:11:13.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:13 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:11:13.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:13 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:13.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:13 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/1690082883' entity='client.admin' 2024-09-19T07:11:13.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:13 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:11:13.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:13 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:11:13.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:13 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:11:13.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:13 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:13.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:13 smithi148 ceph-mon[31180]: scrub queued for path: / 2024-09-19T07:11:13.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:13 smithi148 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-19T07:11:13.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:13 smithi148 ceph-mon[31180]: scrub summary: active paths [/] 2024-09-19T07:11:13.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:13 smithi148 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-19T07:11:13.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:13 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/4072670289' entity='client.admin' 2024-09-19T07:11:13.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:13 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:11:13.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:13 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:11:13.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:13 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:11:13.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:13 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:13.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.836+0000 7fc0b97fa640 1 -- 172.21.15.148:0/1519483210 <== mgr.15123 v2:172.21.15.148:6800/3902535850 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7fc0bc0fd460 con 0x7fc0a80a3500 2024-09-19T07:11:13.837 INFO:teuthology.orchestra.run.smithi148.stdout:Retention added to path / 2024-09-19T07:11:13.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.839+0000 7fc0c26d7640 1 -- 172.21.15.148:0/1519483210 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc0a80a3500 msgr2=0x7fc0a80a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:13.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.839+0000 7fc0c26d7640 1 --2- 172.21.15.148:0/1519483210 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc0a80a3500 0x7fc0a80a59c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc06ae50 tx=0x7fc0a4005e50 comp rx=0 tx=0).stop 2024-09-19T07:11:13.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.839+0000 7fc0c26d7640 1 -- 172.21.15.148:0/1519483210 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0bc1009f0 msgr2=0x7fc0bc1991b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:13.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.839+0000 7fc0c26d7640 1 --2- 172.21.15.148:0/1519483210 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0bc1009f0 0x7fc0bc1991b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac00e9f0 tx=0x7fc0ac00eeb0 comp rx=0 tx=0).stop 2024-09-19T07:11:13.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.839+0000 7fc0c26d7640 1 -- 172.21.15.148:0/1519483210 shutdown_connections 2024-09-19T07:11:13.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.839+0000 7fc0c26d7640 1 --2- 172.21.15.148:0/1519483210 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc0a80a3500 0x7fc0a80a59c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:13.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.839+0000 7fc0c26d7640 1 --2- 172.21.15.148:0/1519483210 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0bc106a00 0x7fc0bc1a4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:13.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.839+0000 7fc0c26d7640 1 --2- 172.21.15.148:0/1519483210 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc0bc101390 0x7fc0bc1996f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:13.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.839+0000 7fc0c26d7640 1 --2- 172.21.15.148:0/1519483210 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0bc1009f0 0x7fc0bc1991b0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:13.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.839+0000 7fc0c26d7640 1 -- 172.21.15.148:0/1519483210 >> 172.21.15.148:0/1519483210 conn(0x7fc0bc0fc6b0 msgr2=0x7fc0bc0fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:13.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.839+0000 7fc0c26d7640 1 -- 172.21.15.148:0/1519483210 shutdown_connections 2024-09-19T07:11:13.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.839+0000 7fc0c26d7640 1 -- 172.21.15.148:0/1519483210 wait complete. 2024-09-19T07:11:13.852 DEBUG:teuthology.orchestra.run.smithi148:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-19T07:11:13.869 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T07:11:13.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:13 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/766718080' entity='client.admin' 2024-09-19T07:11:13.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:13 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:11:13.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:13 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:11:13.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:13 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:11:13.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:13 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:13.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:13 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/1690082883' entity='client.admin' 2024-09-19T07:11:13.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:13 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:11:13.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:13 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:11:13.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:13 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:11:13.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:13 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:13.885 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:13 smithi165 ceph-mon[35326]: scrub queued for path: / 2024-09-19T07:11:13.885 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:13 smithi165 ceph-mon[35326]: scrub summary: idle+waiting paths [/] 2024-09-19T07:11:13.885 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:13 smithi165 ceph-mon[35326]: scrub summary: active paths [/] 2024-09-19T07:11:13.885 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:13 smithi165 ceph-mon[35326]: scrub summary: idle+waiting paths [/] 2024-09-19T07:11:13.885 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:13 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/4072670289' entity='client.admin' 2024-09-19T07:11:13.885 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:13 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:11:13.885 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:13 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:11:13.885 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:13 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:11:13.885 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:13 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:11:13.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.955+0000 7fe7a58a4640 1 -- 172.21.15.148:0/2226049149 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7a0102470 msgr2=0x7fe7a010e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:13.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.955+0000 7fe7a58a4640 1 --2- 172.21.15.148:0/2226049149 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7a0102470 0x7fe7a010e9a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fe798009cd0 tx=0x7fe79802a8e0 comp rx=0 tx=0).stop 2024-09-19T07:11:13.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.955+0000 7fe7a58a4640 1 -- 172.21.15.148:0/2226049149 shutdown_connections 2024-09-19T07:11:13.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.955+0000 7fe7a58a4640 1 --2- 172.21.15.148:0/2226049149 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7a0102470 0x7fe7a010e9a0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:13.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.955+0000 7fe7a58a4640 1 --2- 172.21.15.148:0/2226049149 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7a0101ad0 0x7fe7a0101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:13.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.955+0000 7fe7a58a4640 1 --2- 172.21.15.148:0/2226049149 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe7a0107b70 0x7fe7a0107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:13.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.955+0000 7fe7a58a4640 1 -- 172.21.15.148:0/2226049149 >> 172.21.15.148:0/2226049149 conn(0x7fe7a00fd7d0 msgr2=0x7fe7a00ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:13.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.955+0000 7fe7a58a4640 1 -- 172.21.15.148:0/2226049149 shutdown_connections 2024-09-19T07:11:13.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.955+0000 7fe7a58a4640 1 -- 172.21.15.148:0/2226049149 wait complete. 2024-09-19T07:11:13.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.956+0000 7fe7a58a4640 1 Processor -- start 2024-09-19T07:11:13.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.956+0000 7fe7a58a4640 1 -- start start 2024-09-19T07:11:13.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.956+0000 7fe7a58a4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7a0101ad0 0x7fe7a0198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:13.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.956+0000 7fe7a58a4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7a0102470 0x7fe7a0198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:13.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.956+0000 7fe7a58a4640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe7a0107b70 0x7fe7a019cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:13.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.956+0000 7fe7a58a4640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a0111ee0 con 0x7fe7a0102470 2024-09-19T07:11:13.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.956+0000 7fe7a58a4640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a0111d60 con 0x7fe7a0107b70 2024-09-19T07:11:13.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.956+0000 7fe7a58a4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a0112060 con 0x7fe7a0101ad0 2024-09-19T07:11:13.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.956+0000 7fe79e7fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7a0102470 0x7fe7a0198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:13.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.956+0000 7fe79e7fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7a0102470 0x7fe7a0198850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60968/0 (socket says 172.21.15.148:60968) 2024-09-19T07:11:13.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.956+0000 7fe79e7fc640 1 -- 172.21.15.148:0/2541802888 learned_addr learned my addr 172.21.15.148:0/2541802888 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:13.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.956+0000 7fe79effd640 1 --2- 172.21.15.148:0/2541802888 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7a0101ad0 0x7fe7a0198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:13.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.956+0000 7fe79f7fe640 1 --2- 172.21.15.148:0/2541802888 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe7a0107b70 0x7fe7a019cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:13.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.956+0000 7fe79e7fc640 1 -- 172.21.15.148:0/2541802888 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7a0101ad0 msgr2=0x7fe7a0198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:13.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.956+0000 7fe79e7fc640 1 --2- 172.21.15.148:0/2541802888 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7a0101ad0 0x7fe7a0198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:13.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.956+0000 7fe79e7fc640 1 -- 172.21.15.148:0/2541802888 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe7a0107b70 msgr2=0x7fe7a019cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:13.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.956+0000 7fe79e7fc640 1 --2- 172.21.15.148:0/2541802888 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe7a0107b70 0x7fe7a019cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:13.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.956+0000 7fe79e7fc640 1 -- 172.21.15.148:0/2541802888 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7a019d300 con 0x7fe7a0102470 2024-09-19T07:11:13.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.956+0000 7fe79f7fe640 1 --2- 172.21.15.148:0/2541802888 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe7a0107b70 0x7fe7a019cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:11:13.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.957+0000 7fe79e7fc640 1 --2- 172.21.15.148:0/2541802888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7a0102470 0x7fe7a0198850 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe79400c920 tx=0x7fe79400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:13.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.957+0000 7fe7a48a2640 1 -- 172.21.15.148:0/2541802888 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe794007c70 con 0x7fe7a0102470 2024-09-19T07:11:13.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.957+0000 7fe7a48a2640 1 -- 172.21.15.148:0/2541802888 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe794007e10 con 0x7fe7a0102470 2024-09-19T07:11:13.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.957+0000 7fe7a58a4640 1 -- 172.21.15.148:0/2541802888 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7a019d5f0 con 0x7fe7a0102470 2024-09-19T07:11:13.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.957+0000 7fe7a48a2640 1 -- 172.21.15.148:0/2541802888 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe794018890 con 0x7fe7a0102470 2024-09-19T07:11:13.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.957+0000 7fe7a58a4640 1 -- 172.21.15.148:0/2541802888 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7a01a4e80 con 0x7fe7a0102470 2024-09-19T07:11:13.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.958+0000 7fe7a58a4640 1 -- 172.21.15.148:0/2541802888 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7a0101f30 con 0x7fe7a0102470 2024-09-19T07:11:13.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.959+0000 7fe7a48a2640 1 -- 172.21.15.148:0/2541802888 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7fe794018a70 con 0x7fe7a0102470 2024-09-19T07:11:13.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.960+0000 7fe7a48a2640 1 --2- 172.21.15.148:0/2541802888 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe7880a3500 0x7fe7880a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:13.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.960+0000 7fe7a48a2640 1 -- 172.21.15.148:0/2541802888 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fe7940d0000 con 0x7fe7a0102470 2024-09-19T07:11:13.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.960+0000 7fe79effd640 1 --2- 172.21.15.148:0/2541802888 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe7880a3500 0x7fe7880a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:13.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.960+0000 7fe79effd640 1 --2- 172.21.15.148:0/2541802888 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe7880a3500 0x7fe7880a59c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe7900058c0 tx=0x7fe79000a2d0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:13.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:13.964+0000 7fe7a48a2640 1 -- 172.21.15.148:0/2541802888 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe794014030 con 0x7fe7a0102470 2024-09-19T07:11:14.164 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:11:14.168 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.167+0000 7fe7a58a4640 1 -- 172.21.15.148:0/2541802888 --> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7fe7a00fe360 con 0x7fe7880a3500 2024-09-19T07:11:14.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.174+0000 7fe7a48a2640 1 -- 172.21.15.148:0/2541802888 <== mgr.15123 v2:172.21.15.148:6800/3902535850 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7fe7a00fe360 con 0x7fe7880a3500 2024-09-19T07:11:14.175 INFO:teuthology.orchestra.run.smithi148.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-19T00:00:00", "created": "2024-09-19T07:11:13", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-09-19T07:11:14.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.176+0000 7fe7a58a4640 1 -- 172.21.15.148:0/2541802888 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe7880a3500 msgr2=0x7fe7880a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:14.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.177+0000 7fe7a58a4640 1 --2- 172.21.15.148:0/2541802888 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe7880a3500 0x7fe7880a59c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe7900058c0 tx=0x7fe79000a2d0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.177+0000 7fe7a58a4640 1 -- 172.21.15.148:0/2541802888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7a0102470 msgr2=0x7fe7a0198850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:14.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.177+0000 7fe7a58a4640 1 --2- 172.21.15.148:0/2541802888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7a0102470 0x7fe7a0198850 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe79400c920 tx=0x7fe79400cde0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.177+0000 7fe7a58a4640 1 -- 172.21.15.148:0/2541802888 shutdown_connections 2024-09-19T07:11:14.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.177+0000 7fe7a58a4640 1 --2- 172.21.15.148:0/2541802888 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe7880a3500 0x7fe7880a59c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.177+0000 7fe7a58a4640 1 --2- 172.21.15.148:0/2541802888 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe7a0107b70 0x7fe7a019cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.177+0000 7fe7a58a4640 1 --2- 172.21.15.148:0/2541802888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7a0102470 0x7fe7a0198850 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.177+0000 7fe7a58a4640 1 --2- 172.21.15.148:0/2541802888 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7a0101ad0 0x7fe7a0198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.177+0000 7fe7a58a4640 1 -- 172.21.15.148:0/2541802888 >> 172.21.15.148:0/2541802888 conn(0x7fe7a00fd7d0 msgr2=0x7fe7a00fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:14.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.177+0000 7fe7a58a4640 1 -- 172.21.15.148:0/2541802888 shutdown_connections 2024-09-19T07:11:14.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.177+0000 7fe7a58a4640 1 -- 172.21.15.148:0/2541802888 wait complete. 2024-09-19T07:11:14.190 DEBUG:teuthology.orchestra.run.smithi148:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-19T07:11:14.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.293+0000 7f1b15fc4640 1 -- 172.21.15.148:0/1928752686 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b10101370 msgr2=0x7f1b1010d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:14.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.293+0000 7f1b15fc4640 1 --2- 172.21.15.148:0/1928752686 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b10101370 0x7f1b1010d8a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1b08009cd0 tx=0x7f1b0802a8e0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.293+0000 7f1b15fc4640 1 -- 172.21.15.148:0/1928752686 shutdown_connections 2024-09-19T07:11:14.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.293+0000 7f1b15fc4640 1 --2- 172.21.15.148:0/1928752686 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b10101370 0x7f1b1010d8a0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.293+0000 7f1b15fc4640 1 --2- 172.21.15.148:0/1928752686 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b101009d0 0x7f1b10100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.293+0000 7f1b15fc4640 1 --2- 172.21.15.148:0/1928752686 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b101069e0 0x7f1b10106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.293+0000 7f1b15fc4640 1 -- 172.21.15.148:0/1928752686 >> 172.21.15.148:0/1928752686 conn(0x7f1b100fc6f0 msgr2=0x7f1b100feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:14.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.293+0000 7f1b15fc4640 1 -- 172.21.15.148:0/1928752686 shutdown_connections 2024-09-19T07:11:14.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.293+0000 7f1b15fc4640 1 -- 172.21.15.148:0/1928752686 wait complete. 2024-09-19T07:11:14.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.294+0000 7f1b15fc4640 1 Processor -- start 2024-09-19T07:11:14.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.294+0000 7f1b15fc4640 1 -- start start 2024-09-19T07:11:14.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.294+0000 7f1b15fc4640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b101009d0 0x7f1b10198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:14.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.294+0000 7f1b15fc4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b10101370 0x7f1b101988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:14.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.294+0000 7f1b15fc4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b101069e0 0x7f1b1019cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:14.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.294+0000 7f1b15fc4640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1b10111f80 con 0x7f1b101069e0 2024-09-19T07:11:14.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.294+0000 7f1b15fc4640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1b10111e00 con 0x7f1b101009d0 2024-09-19T07:11:14.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.294+0000 7f1b15fc4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1b10112100 con 0x7f1b10101370 2024-09-19T07:11:14.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.294+0000 7f1b0ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b101069e0 0x7f1b1019cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:14.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.294+0000 7f1b0ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b101069e0 0x7f1b1019cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51242/0 (socket says 172.21.15.148:51242) 2024-09-19T07:11:14.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.294+0000 7f1b0ffff640 1 -- 172.21.15.148:0/490388867 learned_addr learned my addr 172.21.15.148:0/490388867 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:14.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.294+0000 7f1b0effd640 1 --2- 172.21.15.148:0/490388867 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b10101370 0x7f1b101988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:14.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.295+0000 7f1b0f7fe640 1 --2- 172.21.15.148:0/490388867 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b101009d0 0x7f1b10198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:14.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.295+0000 7f1b0ffff640 1 -- 172.21.15.148:0/490388867 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b10101370 msgr2=0x7f1b101988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:14.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.295+0000 7f1b0ffff640 1 --2- 172.21.15.148:0/490388867 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b10101370 0x7f1b101988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.295+0000 7f1b0ffff640 1 -- 172.21.15.148:0/490388867 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b101009d0 msgr2=0x7f1b10198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:14.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.295+0000 7f1b0ffff640 1 --2- 172.21.15.148:0/490388867 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b101009d0 0x7f1b10198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.295+0000 7f1b0ffff640 1 -- 172.21.15.148:0/490388867 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b1019d360 con 0x7f1b101069e0 2024-09-19T07:11:14.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.295+0000 7f1b0ffff640 1 --2- 172.21.15.148:0/490388867 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b101069e0 0x7f1b1019cc30 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f1b08033040 tx=0x7f1b08003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:14.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.295+0000 7f1b0cff9640 1 -- 172.21.15.148:0/490388867 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b08004040 con 0x7f1b101069e0 2024-09-19T07:11:14.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.295+0000 7f1b15fc4640 1 -- 172.21.15.148:0/490388867 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b1019d5f0 con 0x7f1b101069e0 2024-09-19T07:11:14.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.295+0000 7f1b0cff9640 1 -- 172.21.15.148:0/490388867 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b080046c0 con 0x7f1b101069e0 2024-09-19T07:11:14.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.295+0000 7f1b0cff9640 1 -- 172.21.15.148:0/490388867 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b08030eb0 con 0x7f1b101069e0 2024-09-19T07:11:14.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.295+0000 7f1b15fc4640 1 -- 172.21.15.148:0/490388867 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b101a4ee0 con 0x7f1b101069e0 2024-09-19T07:11:14.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.296+0000 7f1b15fc4640 1 -- 172.21.15.148:0/490388867 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b10102110 con 0x7f1b101069e0 2024-09-19T07:11:14.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.297+0000 7f1b0cff9640 1 -- 172.21.15.148:0/490388867 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f1b080041e0 con 0x7f1b101069e0 2024-09-19T07:11:14.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.298+0000 7f1b0cff9640 1 --2- 172.21.15.148:0/490388867 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f1af80a3500 0x7f1af80a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:14.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.298+0000 7f1b0f7fe640 1 --2- 172.21.15.148:0/490388867 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f1af80a3500 0x7f1af80a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:14.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.298+0000 7f1b0cff9640 1 -- 172.21.15.148:0/490388867 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f1b0802e030 con 0x7f1b101069e0 2024-09-19T07:11:14.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.298+0000 7f1b0f7fe640 1 --2- 172.21.15.148:0/490388867 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f1af80a3500 0x7f1af80a59c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1b00005fd0 tx=0x7f1b00005850 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:14.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.302+0000 7f1b0cff9640 1 -- 172.21.15.148:0/490388867 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1b080bd7f0 con 0x7f1b101069e0 2024-09-19T07:11:14.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.496+0000 7f1b15fc4640 1 -- 172.21.15.148:0/490388867 --> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f1b100fd260 con 0x7f1af80a3500 2024-09-19T07:11:14.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.503+0000 7f1b0cff9640 1 -- 172.21.15.148:0/490388867 <== mgr.15123 v2:172.21.15.148:6800/3902535850 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f1b100fd260 con 0x7f1af80a3500 2024-09-19T07:11:14.504 INFO:teuthology.orchestra.run.smithi148.stdout:/ 1m 6m3h 2024-09-19T07:11:14.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.505+0000 7f1b15fc4640 1 -- 172.21.15.148:0/490388867 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f1af80a3500 msgr2=0x7f1af80a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:14.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.505+0000 7f1b15fc4640 1 --2- 172.21.15.148:0/490388867 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f1af80a3500 0x7f1af80a59c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1b00005fd0 tx=0x7f1b00005850 comp rx=0 tx=0).stop 2024-09-19T07:11:14.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.505+0000 7f1b15fc4640 1 -- 172.21.15.148:0/490388867 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b101069e0 msgr2=0x7f1b1019cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:14.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.505+0000 7f1b15fc4640 1 --2- 172.21.15.148:0/490388867 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b101069e0 0x7f1b1019cc30 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f1b08033040 tx=0x7f1b08003970 comp rx=0 tx=0).stop 2024-09-19T07:11:14.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.506+0000 7f1b15fc4640 1 -- 172.21.15.148:0/490388867 shutdown_connections 2024-09-19T07:11:14.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.506+0000 7f1b15fc4640 1 --2- 172.21.15.148:0/490388867 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f1af80a3500 0x7f1af80a59c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.506+0000 7f1b15fc4640 1 --2- 172.21.15.148:0/490388867 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b101069e0 0x7f1b1019cc30 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.506+0000 7f1b15fc4640 1 --2- 172.21.15.148:0/490388867 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b10101370 0x7f1b101988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.506+0000 7f1b15fc4640 1 --2- 172.21.15.148:0/490388867 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b101009d0 0x7f1b10198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.506+0000 7f1b15fc4640 1 -- 172.21.15.148:0/490388867 >> 172.21.15.148:0/490388867 conn(0x7f1b100fc6f0 msgr2=0x7f1b100fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:14.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.506+0000 7f1b15fc4640 1 -- 172.21.15.148:0/490388867 shutdown_connections 2024-09-19T07:11:14.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.506+0000 7f1b15fc4640 1 -- 172.21.15.148:0/490388867 wait complete. 2024-09-19T07:11:14.518 DEBUG:teuthology.orchestra.run.smithi148:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-09-19T07:11:14.546 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-19T07:11:14.560 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-19T07:11:14.572 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi148.front.sepia.ceph.com 2024-09-19T07:11:14.572 DEBUG:teuthology.orchestra.run.smithi148:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-19T07:11:14.588 INFO:teuthology.run_tasks:Running task quiescer... 2024-09-19T07:11:14.602 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T07:11:14.603 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T07:11:14.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.676+0000 7f7b21245640 1 -- 172.21.15.148:0/2494300441 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b1c102d90 msgr2=0x7f7b1c103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:14.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.676+0000 7f7b21245640 1 --2- 172.21.15.148:0/2494300441 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b1c102d90 0x7f7b1c103170 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c009930 tx=0x7f7b0c02a420 comp rx=0 tx=0).stop 2024-09-19T07:11:14.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.676+0000 7f7b21245640 1 -- 172.21.15.148:0/2494300441 shutdown_connections 2024-09-19T07:11:14.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.676+0000 7f7b21245640 1 --2- 172.21.15.148:0/2494300441 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7b1c108290 0x7f7b1c10ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.676+0000 7f7b21245640 1 --2- 172.21.15.148:0/2494300441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b1c103740 0x7f7b1c107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.676+0000 7f7b21245640 1 --2- 172.21.15.148:0/2494300441 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b1c102d90 0x7f7b1c103170 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.676+0000 7f7b21245640 1 -- 172.21.15.148:0/2494300441 >> 172.21.15.148:0/2494300441 conn(0x7f7b1c0fc7d0 msgr2=0x7f7b1c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:14.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.676+0000 7f7b21245640 1 -- 172.21.15.148:0/2494300441 shutdown_connections 2024-09-19T07:11:14.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.676+0000 7f7b21245640 1 -- 172.21.15.148:0/2494300441 wait complete. 2024-09-19T07:11:14.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.677+0000 7f7b21245640 1 Processor -- start 2024-09-19T07:11:14.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.677+0000 7f7b21245640 1 -- start start 2024-09-19T07:11:14.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.677+0000 7f7b21245640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b1c102d90 0x7f7b1c198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:14.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.677+0000 7f7b21245640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7b1c103740 0x7f7b1c198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:14.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.677+0000 7f7b21245640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b1c108290 0x7f7b1c19cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:14.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.677+0000 7f7b21245640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c1120d0 con 0x7f7b1c108290 2024-09-19T07:11:14.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.677+0000 7f7b21245640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c111f50 con 0x7f7b1c103740 2024-09-19T07:11:14.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.677+0000 7f7b21245640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c112250 con 0x7f7b1c102d90 2024-09-19T07:11:14.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.678+0000 7f7b1b59e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b1c108290 0x7f7b1c19cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:14.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.678+0000 7f7b1a59c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7b1c103740 0x7f7b1c198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:14.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.678+0000 7f7b1b59e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b1c108290 0x7f7b1c19cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51260/0 (socket says 172.21.15.148:51260) 2024-09-19T07:11:14.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.678+0000 7f7b1b59e640 1 -- 172.21.15.148:0/179918787 learned_addr learned my addr 172.21.15.148:0/179918787 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:14.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.678+0000 7f7b1ad9d640 1 --2- 172.21.15.148:0/179918787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b1c102d90 0x7f7b1c198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:14.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.678+0000 7f7b1b59e640 1 -- 172.21.15.148:0/179918787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b1c102d90 msgr2=0x7f7b1c198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:14.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.678+0000 7f7b1b59e640 1 --2- 172.21.15.148:0/179918787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b1c102d90 0x7f7b1c198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.678+0000 7f7b1b59e640 1 -- 172.21.15.148:0/179918787 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7b1c103740 msgr2=0x7f7b1c198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:14.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.678+0000 7f7b1b59e640 1 --2- 172.21.15.148:0/179918787 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7b1c103740 0x7f7b1c198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.678+0000 7f7b1b59e640 1 -- 172.21.15.148:0/179918787 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b1c19d5f0 con 0x7f7b1c108290 2024-09-19T07:11:14.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.678+0000 7f7b1b59e640 1 --2- 172.21.15.148:0/179918787 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b1c108290 0x7f7b1c19cf10 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f7b1400cad0 tx=0x7f7b1400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:14.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.678+0000 7f7b03fff640 1 -- 172.21.15.148:0/179918787 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1400ad60 con 0x7f7b1c108290 2024-09-19T07:11:14.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.678+0000 7f7b03fff640 1 -- 172.21.15.148:0/179918787 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b14005020 con 0x7f7b1c108290 2024-09-19T07:11:14.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.679+0000 7f7b21245640 1 -- 172.21.15.148:0/179918787 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b1c19d8e0 con 0x7f7b1c108290 2024-09-19T07:11:14.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.679+0000 7f7b03fff640 1 -- 172.21.15.148:0/179918787 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1400f6b0 con 0x7f7b1c108290 2024-09-19T07:11:14.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.679+0000 7f7b21245640 1 -- 172.21.15.148:0/179918787 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b1c1a51c0 con 0x7f7b1c108290 2024-09-19T07:11:14.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.681+0000 7f7b03fff640 1 -- 172.21.15.148:0/179918787 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f7b1400f850 con 0x7f7b1c108290 2024-09-19T07:11:14.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.681+0000 7f7b2361e740 1 Processor -- start 2024-09-19T07:11:14.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.681+0000 7f7b2361e740 1 -- start start 2024-09-19T07:11:14.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.681+0000 7f7b2361e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd4350e4a0 0x55fd4350e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:14.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.681+0000 7f7b2361e740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fd4350edc0 0x55fd43519140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:14.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.681+0000 7f7b2361e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fd43519680 0x55fd4351ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:14.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.681+0000 7f7b2361e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55fd434742e0 con 0x55fd4350e4a0 2024-09-19T07:11:14.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.681+0000 7f7b2361e740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55fd4341bce0 con 0x55fd4350edc0 2024-09-19T07:11:14.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.681+0000 7f7b2361e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55fd434702a0 con 0x55fd43519680 2024-09-19T07:11:14.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.682+0000 7f7b1a59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd4350e4a0 0x55fd4350e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:14.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.682+0000 7f7b1a59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd4350e4a0 0x55fd4350e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51262/0 (socket says 172.21.15.148:51262) 2024-09-19T07:11:14.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.682+0000 7f7b1a59c640 1 -- 172.21.15.148:0/2169665469 learned_addr learned my addr 172.21.15.148:0/2169665469 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:14.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.682+0000 7f7b1ad9d640 1 --2- 172.21.15.148:0/2169665469 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fd4350edc0 0x55fd43519140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:14.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.682+0000 7f7b1a59c640 1 --2- 172.21.15.148:0/2169665469 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fd43519680 0x55fd4351ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:14.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.682+0000 7f7b03fff640 1 --2- 172.21.15.148:0/179918787 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f7b040a34c0 0x7f7b040a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:14.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.682+0000 7f7b1a59c640 1 -- 172.21.15.148:0/2169665469 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fd43519680 msgr2=0x55fd4351ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:14.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.682+0000 7f7b1a59c640 1 --2- 172.21.15.148:0/2169665469 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fd43519680 0x55fd4351ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.682+0000 7f7b1a59c640 1 -- 172.21.15.148:0/2169665469 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fd4350edc0 msgr2=0x55fd43519140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:14.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.682+0000 7f7b1a59c640 1 --2- 172.21.15.148:0/2169665469 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fd4350edc0 0x55fd43519140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.682+0000 7f7b1a59c640 1 -- 172.21.15.148:0/2169665469 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd43400440 con 0x55fd4350e4a0 2024-09-19T07:11:14.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.682+0000 7f7b1ad9d640 1 --2- 172.21.15.148:0/2169665469 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fd4350edc0 0x55fd43519140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:11:14.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.682+0000 7f7b1b59e640 1 --2- 172.21.15.148:0/179918787 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f7b040a34c0 0x7f7b040a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:14.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.682+0000 7f7b1a59c640 1 --2- 172.21.15.148:0/2169665469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd4350e4a0 0x55fd4350e880 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f7b10009f00 tx=0x7f7b10009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86a8e2bc58da1403 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:14.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.682+0000 7f7b03fff640 1 -- 172.21.15.148:0/179918787 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f7b140cfe50 con 0x7f7b1c108290 2024-09-19T07:11:14.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.682+0000 7f7b017fa640 1 -- 172.21.15.148:0/2169665469 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b10017610 con 0x55fd4350e4a0 2024-09-19T07:11:14.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.682+0000 7f7b017fa640 1 -- 172.21.15.148:0/2169665469 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b1001c070 con 0x55fd4350e4a0 2024-09-19T07:11:14.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.682+0000 7f7b017fa640 1 -- 172.21.15.148:0/2169665469 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b10015910 con 0x55fd4350e4a0 2024-09-19T07:11:14.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.683+0000 7f7b2361e740 1 -- 172.21.15.148:0/2169665469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd4350e4a0 msgr2=0x55fd4350e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:14.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.683+0000 7f7b1b59e640 1 --2- 172.21.15.148:0/179918787 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f7b040a34c0 0x7f7b040a5980 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7b140cd510 tx=0x7f7b14097bf0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:14.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.683+0000 7f7b2361e740 1 --2- 172.21.15.148:0/2169665469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd4350e4a0 0x55fd4350e880 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f7b10009f00 tx=0x7f7b10009570 comp rx=0 tx=0).stop 2024-09-19T07:11:14.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.683+0000 7f7b2361e740 1 -- 172.21.15.148:0/2169665469 shutdown_connections 2024-09-19T07:11:14.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.683+0000 7f7b2361e740 1 --2- 172.21.15.148:0/2169665469 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fd43519680 0x55fd4351ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.683+0000 7f7b2361e740 1 --2- 172.21.15.148:0/2169665469 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fd4350edc0 0x55fd43519140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.683+0000 7f7b2361e740 1 --2- 172.21.15.148:0/2169665469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd4350e4a0 0x55fd4350e880 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.683+0000 7f7b2361e740 1 -- 172.21.15.148:0/2169665469 >> 172.21.15.148:0/2169665469 conn(0x55fd4350aa30 msgr2=0x55fd4350ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:14.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.683+0000 7f7b2361e740 1 -- 172.21.15.148:0/2169665469 shutdown_connections 2024-09-19T07:11:14.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.683+0000 7f7b2361e740 1 -- 172.21.15.148:0/2169665469 wait complete. 2024-09-19T07:11:14.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.684+0000 7f7b2361e740 1 -- start start 2024-09-19T07:11:14.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.684+0000 7f7b2361e740 1 Processor -- start 2024-09-19T07:11:14.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.684+0000 7f7b2361e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fd4350e4a0 0x55fd43519030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:14.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.684+0000 7f7b2361e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd4350edc0 0x55fd435162e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:14.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.684+0000 7f7b2361e740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fd43519680 0x55fd43516880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:14.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.684+0000 7f7b2361e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55fd4351c250 con 0x55fd4350edc0 2024-09-19T07:11:14.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.684+0000 7f7b2361e740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55fd4342f050 con 0x55fd43519680 2024-09-19T07:11:14.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.684+0000 7f7b2361e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55fd4351c3d0 con 0x55fd4350e4a0 2024-09-19T07:11:14.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.684+0000 7f7b2361e740 10 client.0 _ll_register_callbacks cb 0x55fd4346f160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:11:14.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.684+0000 7f7b1ad9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd4350edc0 0x55fd435162e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:14.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.684+0000 7f7b1ad9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd4350edc0 0x55fd435162e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51272/0 (socket says 172.21.15.148:51272) 2024-09-19T07:11:14.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.684+0000 7f7b1a59c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fd4350e4a0 0x55fd43519030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:14.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.684+0000 7f7b1ad9d640 1 -- 172.21.15.148:0/484366973 learned_addr learned my addr 172.21.15.148:0/484366973 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:14.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.685+0000 7f7b1a59c640 1 --2- 172.21.15.148:0/484366973 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fd43519680 0x55fd43516880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:14.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.685+0000 7f7b1ad9d640 1 -- 172.21.15.148:0/484366973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fd4350e4a0 msgr2=0x55fd43519030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:14.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.685+0000 7f7b1ad9d640 1 --2- 172.21.15.148:0/484366973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fd4350e4a0 0x55fd43519030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.685+0000 7f7b1ad9d640 1 -- 172.21.15.148:0/484366973 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fd43519680 msgr2=0x55fd43516880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:14.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.685+0000 7f7b1ad9d640 1 --2- 172.21.15.148:0/484366973 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fd43519680 0x55fd43516880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.685+0000 7f7b1ad9d640 1 -- 172.21.15.148:0/484366973 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd431e53c0 con 0x55fd4350edc0 2024-09-19T07:11:14.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.685+0000 7f7b1ad9d640 1 --2- 172.21.15.148:0/484366973 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd4350edc0 0x55fd435162e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c02a940 tx=0x7f7b0c0319a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f9c562c634b7981 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:14.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.685+0000 7f7afeff5640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:11:14.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.685+0000 7f7afeff5640 1 -- 172.21.15.148:0/484366973 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c035040 con 0x55fd4350edc0 2024-09-19T07:11:14.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.685+0000 7f7afeff5640 1 -- 172.21.15.148:0/484366973 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f7b0c004300 con 0x55fd4350edc0 2024-09-19T07:11:14.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.685+0000 7f7b2361e740 1 -- 172.21.15.148:0/484366973 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b1001c070 con 0x55fd4350edc0 2024-09-19T07:11:14.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.685+0000 7f7afeff5640 1 -- 172.21.15.148:0/484366973 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7b0c0035f0 con 0x55fd4350edc0 2024-09-19T07:11:14.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.685+0000 7f7b2361e740 10 client.15309 fetch_fsmap learned FSMap version 25 2024-09-19T07:11:14.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.685+0000 7f7b2361e740 1 -- 172.21.15.148:0/484366973 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55fd43527c60 con 0x55fd4350edc0 2024-09-19T07:11:14.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.685+0000 7f7afeff5640 1 -- 172.21.15.148:0/484366973 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b1001c070 con 0x55fd4350edc0 2024-09-19T07:11:14.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.685+0000 7f7afeff5640 1 -- 172.21.15.148:0/484366973 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7b0c03c7e0 con 0x55fd4350edc0 2024-09-19T07:11:14.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.685+0000 7f7b2361e740 10 client.15309 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:11:14.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.685+0000 7f7b2361e740 10 client.15309 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:11:14.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.686+0000 7f7b2361e740 20 client.15309 populate_metadata read hostname 'smithi148' 2024-09-19T07:11:14.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.686+0000 7f7b2361e740 1 --2- 172.21.15.148:0/484366973 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55fd43529170 0x55fd4352b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:14.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.686+0000 7f7b2361e740 4 client.15309 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:11:14.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.686+0000 7f7b2361e740 1 -- 172.21.15.148:0/484366973 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd43481850 con 0x55fd43529170 2024-09-19T07:11:14.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.686+0000 7f7b1a59c640 1 --2- 172.21.15.148:0/484366973 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55fd43529170 0x55fd4352b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:14.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.686+0000 7f7b1a59c640 1 --2- 172.21.15.148:0/484366973 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55fd43529170 0x55fd4352b5b0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5016043e6ac1b0c server_cookie=ebd16fe7d6d1d517 in_seq=0 out_seq=0 2024-09-19T07:11:14.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.686+0000 7f7afeff5640 10 client.15309 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:11:14.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.687+0000 7f7afeff5640 1 -- 172.21.15.148:0/484366973 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fd43481850 con 0x55fd43529170 2024-09-19T07:11:14.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.687+0000 7f7afeff5640 10 client.15309 handle_command_reply: tid=0 2024-09-19T07:11:14.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.687+0000 7f7b2361e740 1 client.15309 shutdown 2024-09-19T07:11:14.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.687+0000 7f7b2361e740 1 -- 172.21.15.148:0/484366973 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd4350edc0 msgr2=0x55fd435162e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:14.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.687+0000 7f7b2361e740 1 --2- 172.21.15.148:0/484366973 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd4350edc0 0x55fd435162e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c02a940 tx=0x7f7b0c0319a0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.687+0000 7f7b2361e740 1 -- 172.21.15.148:0/484366973 shutdown_connections 2024-09-19T07:11:14.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.687+0000 7f7b2361e740 1 --2- 172.21.15.148:0/484366973 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55fd43529170 0x55fd4352b5b0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.687+0000 7f7b2361e740 1 --2- 172.21.15.148:0/484366973 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fd43519680 0x55fd43516880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.687+0000 7f7b2361e740 1 --2- 172.21.15.148:0/484366973 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd4350edc0 0x55fd435162e0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.687+0000 7f7b2361e740 1 --2- 172.21.15.148:0/484366973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fd4350e4a0 0x55fd43519030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.687+0000 7f7b2361e740 1 -- 172.21.15.148:0/484366973 >> 172.21.15.148:0/484366973 conn(0x55fd4350aa30 msgr2=0x55fd43510760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:14.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.687+0000 7f7afeff5640 0 client.15309 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:11:14.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.687+0000 7f7b2361e740 1 -- 172.21.15.148:0/484366973 shutdown_connections 2024-09-19T07:11:14.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.687+0000 7f7b2361e740 1 -- 172.21.15.148:0/484366973 wait complete. 2024-09-19T07:11:14.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.687+0000 7f7b2361e740 20 client.15309 trim_cache size 0 max 16384 2024-09-19T07:11:14.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.704+0000 7f7b2361e740 1 Processor -- start 2024-09-19T07:11:14.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.704+0000 7f7b2361e740 1 -- start start 2024-09-19T07:11:14.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.705+0000 7f7b2361e740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fd4350e4a0 0x55fd435254b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:14.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.705+0000 7f7b2361e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fd4350edc0 0x55fd43530e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:14.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.705+0000 7f7b2361e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd43519680 0x55fd435313c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:14.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.705+0000 7f7b2361e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c1b0210 con 0x55fd43519680 2024-09-19T07:11:14.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.705+0000 7f7b2361e740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c1adae0 con 0x55fd4350e4a0 2024-09-19T07:11:14.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.705+0000 7f7b2361e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c1ab910 con 0x55fd4350edc0 2024-09-19T07:11:14.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.705+0000 7f7b1a59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd43519680 0x55fd435313c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:14.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.705+0000 7f7b1a59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd43519680 0x55fd435313c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51282/0 (socket says 172.21.15.148:51282) 2024-09-19T07:11:14.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.705+0000 7f7b1a59c640 1 -- 172.21.15.148:0/2659583661 learned_addr learned my addr 172.21.15.148:0/2659583661 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:14.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.705+0000 7f7b1a59c640 1 --2- 172.21.15.148:0/2659583661 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fd4350e4a0 0x55fd435254b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:14.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.705+0000 7f7b1ad9d640 1 --2- 172.21.15.148:0/2659583661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fd4350edc0 0x55fd43530e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:14.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.705+0000 7f7b1a59c640 1 -- 172.21.15.148:0/2659583661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fd4350edc0 msgr2=0x55fd43530e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:14.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.705+0000 7f7b1a59c640 1 --2- 172.21.15.148:0/2659583661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fd4350edc0 0x55fd43530e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.705+0000 7f7b1a59c640 1 -- 172.21.15.148:0/2659583661 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fd4350e4a0 msgr2=0x55fd435254b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:14.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.705+0000 7f7b1a59c640 1 --2- 172.21.15.148:0/2659583661 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fd4350e4a0 0x55fd435254b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.705+0000 7f7b1a59c640 1 -- 172.21.15.148:0/2659583661 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd4351ba70 con 0x55fd43519680 2024-09-19T07:11:14.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.705+0000 7f7b1a59c640 1 --2- 172.21.15.148:0/2659583661 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd43519680 0x55fd435313c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x55fd4350ba90 tx=0x7f7b100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36e49bf6d9e53601 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:14.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.706+0000 7f7b00ff9640 1 -- 172.21.15.148:0/2659583661 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b10015850 con 0x55fd43519680 2024-09-19T07:11:14.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.706+0000 7f7b00ff9640 1 -- 172.21.15.148:0/2659583661 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b1001c050 con 0x55fd43519680 2024-09-19T07:11:14.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.706+0000 7f7b00ff9640 1 -- 172.21.15.148:0/2659583661 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b10017c00 con 0x55fd43519680 2024-09-19T07:11:14.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.706+0000 7f7b2361e740 1 -- 172.21.15.148:0/2659583661 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd43519680 msgr2=0x55fd435313c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:14.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.706+0000 7f7b2361e740 1 --2- 172.21.15.148:0/2659583661 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd43519680 0x55fd435313c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x55fd4350ba90 tx=0x7f7b100046c0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.706+0000 7f7b2361e740 1 -- 172.21.15.148:0/2659583661 shutdown_connections 2024-09-19T07:11:14.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.706+0000 7f7b2361e740 1 --2- 172.21.15.148:0/2659583661 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd43519680 0x55fd435313c0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.706+0000 7f7b2361e740 1 --2- 172.21.15.148:0/2659583661 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fd4350edc0 0x55fd43530e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.706+0000 7f7b2361e740 1 --2- 172.21.15.148:0/2659583661 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fd4350e4a0 0x55fd435254b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.706+0000 7f7b2361e740 1 -- 172.21.15.148:0/2659583661 >> 172.21.15.148:0/2659583661 conn(0x55fd4350aa30 msgr2=0x55fd435153d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:14.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.707+0000 7f7b2361e740 1 -- 172.21.15.148:0/2659583661 shutdown_connections 2024-09-19T07:11:14.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.707+0000 7f7b2361e740 1 -- 172.21.15.148:0/2659583661 wait complete. 2024-09-19T07:11:14.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.707+0000 7f7b2361e740 1 -- start start 2024-09-19T07:11:14.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.707+0000 7f7b2361e740 1 Processor -- start 2024-09-19T07:11:14.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.707+0000 7f7b2361e740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fd4350e4a0 0x55fd4358f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:14.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.707+0000 7f7b2361e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd4350edc0 0x55fd4358f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:14.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.707+0000 7f7b2361e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fd43519680 0x55fd43521620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:14.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.707+0000 7f7b2361e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c1abfa0 con 0x55fd4350edc0 2024-09-19T07:11:14.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.707+0000 7f7b2361e740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c1ad410 con 0x55fd4350e4a0 2024-09-19T07:11:14.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.707+0000 7f7b2361e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c1ac670 con 0x55fd43519680 2024-09-19T07:11:14.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.707+0000 7f7b2361e740 10 client.0 _ll_register_callbacks cb 0x7f7b0c005d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:11:14.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.707+0000 7f7b1ad9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd4350edc0 0x55fd4358f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:14.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.707+0000 7f7b1ad9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd4350edc0 0x55fd4358f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51294/0 (socket says 172.21.15.148:51294) 2024-09-19T07:11:14.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.707+0000 7f7b1ad9d640 1 -- 172.21.15.148:0/3260949215 learned_addr learned my addr 172.21.15.148:0/3260949215 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:14.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.707+0000 7f7b1a59c640 1 --2- 172.21.15.148:0/3260949215 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fd4350e4a0 0x55fd4358f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:14.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.708+0000 7f7b1a59c640 1 --2- 172.21.15.148:0/3260949215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fd43519680 0x55fd43521620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:14.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.708+0000 7f7b1ad9d640 1 -- 172.21.15.148:0/3260949215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fd43519680 msgr2=0x55fd43521620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:14.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.708+0000 7f7b1ad9d640 1 --2- 172.21.15.148:0/3260949215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fd43519680 0x55fd43521620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.708+0000 7f7b1ad9d640 1 -- 172.21.15.148:0/3260949215 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fd4350e4a0 msgr2=0x55fd4358f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:14.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.708+0000 7f7b1ad9d640 1 --2- 172.21.15.148:0/3260949215 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fd4350e4a0 0x55fd4358f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.708+0000 7f7b1ad9d640 1 -- 172.21.15.148:0/3260949215 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd43521b60 con 0x55fd4350edc0 2024-09-19T07:11:14.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.708+0000 7f7b1a59c640 1 --2- 172.21.15.148:0/3260949215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fd43519680 0x55fd43521620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:11:14.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.708+0000 7f7b1ad9d640 1 --2- 172.21.15.148:0/3260949215 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd4350edc0 0x55fd4358f550 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x55fd43517920 tx=0x7f7b0c02aae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5892630182fbc462 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:14.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.708+0000 7f7afeff5640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:11:14.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.708+0000 7f7afeff5640 1 -- 172.21.15.148:0/3260949215 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c035070 con 0x55fd4350edc0 2024-09-19T07:11:14.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.708+0000 7f7afeff5640 1 -- 172.21.15.148:0/3260949215 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f7b0c03c440 con 0x55fd4350edc0 2024-09-19T07:11:14.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.708+0000 7f7b2361e740 1 -- 172.21.15.148:0/3260949215 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b1001c050 con 0x55fd4350edc0 2024-09-19T07:11:14.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.708+0000 7f7afeff5640 1 -- 172.21.15.148:0/3260949215 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7b0c03c640 con 0x55fd4350edc0 2024-09-19T07:11:14.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.708+0000 7f7b2361e740 10 client.15315 fetch_fsmap learned FSMap version 25 2024-09-19T07:11:14.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.708+0000 7f7b2361e740 1 -- 172.21.15.148:0/3260949215 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55fd435134c0 con 0x55fd4350edc0 2024-09-19T07:11:14.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.708+0000 7f7afeff5640 1 -- 172.21.15.148:0/3260949215 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b1001c050 con 0x55fd4350edc0 2024-09-19T07:11:14.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.709+0000 7f7afeff5640 1 -- 172.21.15.148:0/3260949215 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7b0c045690 con 0x55fd4350edc0 2024-09-19T07:11:14.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.709+0000 7f7b2361e740 10 client.15315 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:11:14.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.709+0000 7f7b2361e740 10 client.15315 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:11:14.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.709+0000 7f7b2361e740 20 client.15315 populate_metadata read hostname 'smithi148' 2024-09-19T07:11:14.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.709+0000 7f7b2361e740 1 --2- 172.21.15.148:0/3260949215 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55fd43598370 0x55fd4359a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:14.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.709+0000 7f7b2361e740 4 client.15315 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T07:11:14.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.709+0000 7f7b2361e740 1 -- 172.21.15.148:0/3260949215 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fd4347bd60 con 0x55fd43598370 2024-09-19T07:11:14.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.709+0000 7f7b1a59c640 1 --2- 172.21.15.148:0/3260949215 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55fd43598370 0x55fd4359a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:14.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.710+0000 7f7afeff5640 10 client.15315 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:11:14.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.710+0000 7f7b1a59c640 1 --2- 172.21.15.148:0/3260949215 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55fd43598370 0x55fd4359a760 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88550f24ef58a715 server_cookie=b775f8ce666e6091 in_seq=0 out_seq=0 2024-09-19T07:11:14.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.710+0000 7f7afeff5640 1 -- 172.21.15.148:0/3260949215 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55fd4347bd60 con 0x55fd43598370 2024-09-19T07:11:14.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.710+0000 7f7afeff5640 10 client.15315 handle_command_reply: tid=0 2024-09-19T07:11:14.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.710+0000 7f7b2361e740 1 client.15315 shutdown 2024-09-19T07:11:14.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.710+0000 7f7b2361e740 1 -- 172.21.15.148:0/3260949215 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd4350edc0 msgr2=0x55fd4358f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:14.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.710+0000 7f7b2361e740 1 --2- 172.21.15.148:0/3260949215 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd4350edc0 0x55fd4358f550 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x55fd43517920 tx=0x7f7b0c02aae0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.710+0000 7f7b2361e740 1 -- 172.21.15.148:0/3260949215 shutdown_connections 2024-09-19T07:11:14.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.710+0000 7f7b2361e740 1 --2- 172.21.15.148:0/3260949215 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55fd43598370 0x55fd4359a760 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.710+0000 7f7b2361e740 1 --2- 172.21.15.148:0/3260949215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fd43519680 0x55fd43521620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.710+0000 7f7b2361e740 1 --2- 172.21.15.148:0/3260949215 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd4350edc0 0x55fd4358f550 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.710+0000 7f7b2361e740 1 --2- 172.21.15.148:0/3260949215 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fd4350e4a0 0x55fd4358f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.710+0000 7f7b2361e740 1 -- 172.21.15.148:0/3260949215 >> 172.21.15.148:0/3260949215 conn(0x55fd4350aa30 msgr2=0x55fd43517b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:14.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.710+0000 7f7afeff5640 0 client.15315 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:11:14.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.710+0000 7f7b2361e740 1 -- 172.21.15.148:0/3260949215 shutdown_connections 2024-09-19T07:11:14.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.710+0000 7f7b2361e740 1 -- 172.21.15.148:0/3260949215 wait complete. 2024-09-19T07:11:14.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.711+0000 7f7b2361e740 20 client.15315 trim_cache size 0 max 16384 2024-09-19T07:11:14.728 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:11:14.728 INFO:teuthology.orchestra.run.smithi148.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T07:11:14.728 INFO:teuthology.orchestra.run.smithi148.stdout: "scrubs": { 2024-09-19T07:11:14.728 INFO:teuthology.orchestra.run.smithi148.stdout: "766b04d1-8258-490b-869c-2b4a33340be4": { 2024-09-19T07:11:14.728 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/", 2024-09-19T07:11:14.728 INFO:teuthology.orchestra.run.smithi148.stdout: "tag": "766b04d1-8258-490b-869c-2b4a33340be4", 2024-09-19T07:11:14.728 INFO:teuthology.orchestra.run.smithi148.stdout: "options": "recursive,force" 2024-09-19T07:11:14.728 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:11:14.728 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:11:14.728 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:11:14.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.711+0000 7f7b21245640 1 -- 172.21.15.148:0/179918787 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f7b040a34c0 msgr2=0x7f7b040a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:14.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.711+0000 7f7b21245640 1 --2- 172.21.15.148:0/179918787 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f7b040a34c0 0x7f7b040a5980 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7b140cd510 tx=0x7f7b14097bf0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.711+0000 7f7b21245640 1 -- 172.21.15.148:0/179918787 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b1c108290 msgr2=0x7f7b1c19cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:14.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.711+0000 7f7b21245640 1 --2- 172.21.15.148:0/179918787 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b1c108290 0x7f7b1c19cf10 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f7b1400cad0 tx=0x7f7b1400ced0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.711+0000 7f7b21245640 1 -- 172.21.15.148:0/179918787 shutdown_connections 2024-09-19T07:11:14.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.711+0000 7f7b21245640 1 --2- 172.21.15.148:0/179918787 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f7b040a34c0 0x7f7b040a5980 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.711+0000 7f7b21245640 1 --2- 172.21.15.148:0/179918787 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b1c108290 0x7f7b1c19cf10 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.711+0000 7f7b21245640 1 --2- 172.21.15.148:0/179918787 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7b1c103740 0x7f7b1c198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.711+0000 7f7b21245640 1 --2- 172.21.15.148:0/179918787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b1c102d90 0x7f7b1c198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:14.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.711+0000 7f7b21245640 1 -- 172.21.15.148:0/179918787 >> 172.21.15.148:0/179918787 conn(0x7f7b1c0fc7d0 msgr2=0x7f7b1c105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:14.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.711+0000 7f7b21245640 1 -- 172.21.15.148:0/179918787 shutdown_connections 2024-09-19T07:11:14.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:14.712+0000 7f7b21245640 1 -- 172.21.15.148:0/179918787 wait complete. 2024-09-19T07:11:15.283 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:15 smithi148 ceph-mon[31180]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 0 B/s wr, 16 op/s 2024-09-19T07:11:15.283 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:15 smithi148 ceph-mon[31180]: from='client.15279 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:11:15.283 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:15 smithi148 ceph-mon[31180]: from='client.15285 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:11:15.283 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:15 smithi148 ceph-mon[31180]: from='client.15291 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:11:15.309 INFO:tasks.cephfs.filesystem:scrub status for tag:766b04d1-8258-490b-869c-2b4a33340be4 - {'path': '/', 'tag': '766b04d1-8258-490b-869c-2b4a33340be4', 'options': 'recursive,force'} 2024-09-19T07:11:15.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:15 smithi165 ceph-mon[35326]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 0 B/s wr, 16 op/s 2024-09-19T07:11:15.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:15 smithi165 ceph-mon[35326]: from='client.15279 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:11:15.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:15 smithi165 ceph-mon[35326]: from='client.15285 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:11:15.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:15 smithi165 ceph-mon[35326]: from='client.15291 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:11:15.419 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:11:15.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:15 smithi179 ceph-mon[35716]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 0 B/s wr, 16 op/s 2024-09-19T07:11:15.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:15 smithi179 ceph-mon[35716]: from='client.15279 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:11:15.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:15 smithi179 ceph-mon[35716]: from='client.15285 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:11:15.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:15 smithi179 ceph-mon[35716]: from='client.15291 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:11:15.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:15.864+0000 7fdbc696b640 1 -- 172.21.15.148:0/473655784 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbc0103660 msgr2=0x7fdbc010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:15.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:15.864+0000 7fdbc696b640 1 --2- 172.21.15.148:0/473655784 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbc0103660 0x7fdbc010bb50 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fdba8009900 tx=0x7fdba802a480 comp rx=0 tx=0).stop 2024-09-19T07:11:15.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:15.864+0000 7fdbc696b640 1 -- 172.21.15.148:0/473655784 shutdown_connections 2024-09-19T07:11:15.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:15.864+0000 7fdbc696b640 1 --2- 172.21.15.148:0/473655784 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdbc010c170 0x7fdbc010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:15.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:15.864+0000 7fdbc696b640 1 --2- 172.21.15.148:0/473655784 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbc0103660 0x7fdbc010bb50 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:15.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:15.864+0000 7fdbc696b640 1 --2- 172.21.15.148:0/473655784 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbc0102d40 0x7fdbc0103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:15.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:15.864+0000 7fdbc696b640 1 -- 172.21.15.148:0/473655784 >> 172.21.15.148:0/473655784 conn(0x7fdbc00fc7a0 msgr2=0x7fdbc00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:15.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:15.865+0000 7fdbc696b640 1 -- 172.21.15.148:0/473655784 shutdown_connections 2024-09-19T07:11:15.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:15.865+0000 7fdbc696b640 1 -- 172.21.15.148:0/473655784 wait complete. 2024-09-19T07:11:15.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:15.865+0000 7fdbc696b640 1 Processor -- start 2024-09-19T07:11:15.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:15.865+0000 7fdbc696b640 1 -- start start 2024-09-19T07:11:15.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:15.865+0000 7fdbc696b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdbc0102d40 0x7fdbc0198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:15.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:15.865+0000 7fdbc696b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbc0103660 0x7fdbc01989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:15.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:15.865+0000 7fdbc696b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbc010c170 0x7fdbc019cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:15.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:15.865+0000 7fdbc696b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc0111fb0 con 0x7fdbc010c170 2024-09-19T07:11:15.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:15.865+0000 7fdbc696b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc0111e30 con 0x7fdbc0102d40 2024-09-19T07:11:15.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:15.865+0000 7fdbc696b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc0112130 con 0x7fdbc0103660 2024-09-19T07:11:15.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:15.866+0000 7fdbc4f08640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbc010c170 0x7fdbc019cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:15.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:15.866+0000 7fdbc4f08640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbc010c170 0x7fdbc019cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51324/0 (socket says 172.21.15.148:51324) 2024-09-19T07:11:15.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:15.866+0000 7fdbc4f08640 1 -- 172.21.15.148:0/3651552332 learned_addr learned my addr 172.21.15.148:0/3651552332 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:15.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:15.866+0000 7fdbbf7fe640 1 --2- 172.21.15.148:0/3651552332 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbc0103660 0x7fdbc01989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:15.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:15.866+0000 7fdbbffff640 1 --2- 172.21.15.148:0/3651552332 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdbc0102d40 0x7fdbc0198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:15.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:15.866+0000 7fdbc4f08640 1 -- 172.21.15.148:0/3651552332 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbc0103660 msgr2=0x7fdbc01989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:15.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:15.866+0000 7fdbc4f08640 1 --2- 172.21.15.148:0/3651552332 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbc0103660 0x7fdbc01989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:15.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:15.866+0000 7fdbc4f08640 1 -- 172.21.15.148:0/3651552332 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdbc0102d40 msgr2=0x7fdbc0198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:15.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:15.866+0000 7fdbc4f08640 1 --2- 172.21.15.148:0/3651552332 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdbc0102d40 0x7fdbc0198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:15.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:15.866+0000 7fdbc4f08640 1 -- 172.21.15.148:0/3651552332 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbc019d410 con 0x7fdbc010c170 2024-09-19T07:11:15.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:15.866+0000 7fdbc4f08640 1 --2- 172.21.15.148:0/3651552332 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbc010c170 0x7fdbc019cd30 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fdbb800cce0 tx=0x7fdbb800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:15.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:15.866+0000 7fdbbd7fa640 1 -- 172.21.15.148:0/3651552332 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb800f450 con 0x7fdbc010c170 2024-09-19T07:11:15.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:15.866+0000 7fdbbd7fa640 1 -- 172.21.15.148:0/3651552332 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbb800fad0 con 0x7fdbc010c170 2024-09-19T07:11:15.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:15.866+0000 7fdbc696b640 1 -- 172.21.15.148:0/3651552332 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbc019d700 con 0x7fdbc010c170 2024-09-19T07:11:15.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:15.866+0000 7fdbbd7fa640 1 -- 172.21.15.148:0/3651552332 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb8018c10 con 0x7fdbc010c170 2024-09-19T07:11:15.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:15.866+0000 7fdbc696b640 1 -- 172.21.15.148:0/3651552332 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbc01a4fe0 con 0x7fdbc010c170 2024-09-19T07:11:15.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:15.867+0000 7fdbc696b640 1 -- 172.21.15.148:0/3651552332 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbc0103120 con 0x7fdbc010c170 2024-09-19T07:11:15.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:15.868+0000 7fdbbd7fa640 1 -- 172.21.15.148:0/3651552332 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7fdbb800f5f0 con 0x7fdbc010c170 2024-09-19T07:11:15.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:15.869+0000 7fdbbd7fa640 1 --2- 172.21.15.148:0/3651552332 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fdbac0a3440 0x7fdbac0a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:15.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:15.869+0000 7fdbbffff640 1 --2- 172.21.15.148:0/3651552332 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fdbac0a3440 0x7fdbac0a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:15.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:15.869+0000 7fdbbd7fa640 1 -- 172.21.15.148:0/3651552332 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fdbb80d0620 con 0x7fdbc010c170 2024-09-19T07:11:15.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:15.870+0000 7fdbbffff640 1 --2- 172.21.15.148:0/3651552332 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fdbac0a3440 0x7fdbac0a5900 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdbb0009890 tx=0x7fdbb0008040 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:15.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:15.873+0000 7fdbbd7fa640 1 -- 172.21.15.148:0/3651552332 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdbb8014030 con 0x7fdbc010c170 2024-09-19T07:11:16.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:16.040+0000 7fdbc696b640 1 -- 172.21.15.148:0/3651552332 --> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdbc0062630 con 0x7fdbac0a3440 2024-09-19T07:11:16.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:16.046+0000 7fdbbd7fa640 1 -- 172.21.15.148:0/3651552332 <== mgr.15123 v2:172.21.15.148:6800/3902535850 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257761 (secure 0 0 0) 0x7fdbc0062630 con 0x7fdbac0a3440 2024-09-19T07:11:16.049 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:11:16.050 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2024-09-19T07:11:16.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:16.049+0000 7fdbc696b640 1 -- 172.21.15.148:0/3651552332 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fdbac0a3440 msgr2=0x7fdbac0a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:16.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:16.049+0000 7fdbc696b640 1 --2- 172.21.15.148:0/3651552332 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fdbac0a3440 0x7fdbac0a5900 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdbb0009890 tx=0x7fdbb0008040 comp rx=0 tx=0).stop 2024-09-19T07:11:16.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:16.050+0000 7fdbc696b640 1 -- 172.21.15.148:0/3651552332 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbc010c170 msgr2=0x7fdbc019cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:16.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:16.050+0000 7fdbc696b640 1 --2- 172.21.15.148:0/3651552332 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbc010c170 0x7fdbc019cd30 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fdbb800cce0 tx=0x7fdbb800a620 comp rx=0 tx=0).stop 2024-09-19T07:11:16.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:16.050+0000 7fdbc696b640 1 -- 172.21.15.148:0/3651552332 shutdown_connections 2024-09-19T07:11:16.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:16.050+0000 7fdbc696b640 1 --2- 172.21.15.148:0/3651552332 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fdbac0a3440 0x7fdbac0a5900 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:16.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:16.050+0000 7fdbc696b640 1 --2- 172.21.15.148:0/3651552332 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdbc010c170 0x7fdbc019cd30 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:16.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:16.050+0000 7fdbc696b640 1 --2- 172.21.15.148:0/3651552332 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbc0103660 0x7fdbc01989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:16.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:16.050+0000 7fdbc696b640 1 --2- 172.21.15.148:0/3651552332 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdbc0102d40 0x7fdbc0198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:16.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:16.050+0000 7fdbc696b640 1 -- 172.21.15.148:0/3651552332 >> 172.21.15.148:0/3651552332 conn(0x7fdbc00fc7a0 msgr2=0x7fdbc00fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:16.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:16.050+0000 7fdbc696b640 1 -- 172.21.15.148:0/3651552332 shutdown_connections 2024-09-19T07:11:16.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:16.050+0000 7fdbc696b640 1 -- 172.21.15.148:0/3651552332 wait complete. 2024-09-19T07:11:16.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:16 smithi148 ceph-mon[31180]: from='client.15297 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:11:16.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:16 smithi165 ceph-mon[35326]: from='client.15297 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:11:16.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:16 smithi179 ceph-mon[35716]: from='client.15297 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:11:16.806 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":9,"stamp":"2024-09-19T07:11:15.250489+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1385088,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":1238,"num_read_kb":1033,"num_write":619,"num_write_kb":5293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1207683,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":956,"ondisk_log_size":956,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":388896,"kb_used_data":14544,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124552928,"statfs":{"total":1151940427776,"available":1151542198272,"internally_reserved":0,"allocated":14893056,"data_stored":9200868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":382973242},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":196632,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":406,"num_read_kb":464,"num_write":142,"num_write_kb":914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.998086"},"pg_stats":[{"pgid":"3.3f","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.279425+0000","last_change":"2024-09-19T07:09:18.926902+0000","last_active":"2024-09-19T07:11:03.279425+0000","last_peered":"2024-09-19T07:11:03.279425+0000","last_clean":"2024-09-19T07:11:03.279425+0000","last_became_active":"2024-09-19T07:09:18.926582+0000","last_became_peered":"2024-09-19T07:09:18.926582+0000","last_unstale":"2024-09-19T07:11:03.279425+0000","last_undegraded":"2024-09-19T07:11:03.279425+0000","last_fullsized":"2024-09-19T07:11:03.279425+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:37.875779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.283851+0000","last_change":"2024-09-19T07:09:18.934205+0000","last_active":"2024-09-19T07:11:03.283851+0000","last_peered":"2024-09-19T07:11:03.283851+0000","last_clean":"2024-09-19T07:11:03.283851+0000","last_became_active":"2024-09-19T07:09:18.933767+0000","last_became_peered":"2024-09-19T07:09:18.933767+0000","last_unstale":"2024-09-19T07:11:03.283851+0000","last_undegraded":"2024-09-19T07:11:03.283851+0000","last_fullsized":"2024-09-19T07:11:03.283851+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:10:45.391428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.284092+0000","last_change":"2024-09-19T07:09:18.922312+0000","last_active":"2024-09-19T07:11:03.284092+0000","last_peered":"2024-09-19T07:11:03.284092+0000","last_clean":"2024-09-19T07:11:03.284092+0000","last_became_active":"2024-09-19T07:09:18.921476+0000","last_became_peered":"2024-09-19T07:09:18.921476+0000","last_unstale":"2024-09-19T07:11:03.284092+0000","last_undegraded":"2024-09-19T07:11:03.284092+0000","last_fullsized":"2024-09-19T07:11:03.284092+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:29.470616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.269605+0000","last_change":"2024-09-19T07:09:18.938218+0000","last_active":"2024-09-19T07:11:03.269605+0000","last_peered":"2024-09-19T07:11:03.269605+0000","last_clean":"2024-09-19T07:11:03.269605+0000","last_became_active":"2024-09-19T07:09:18.937306+0000","last_became_peered":"2024-09-19T07:09:18.937306+0000","last_unstale":"2024-09-19T07:11:03.269605+0000","last_undegraded":"2024-09-19T07:11:03.269605+0000","last_fullsized":"2024-09-19T07:11:03.269605+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:54.146506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.274574+0000","last_change":"2024-09-19T07:09:18.925837+0000","last_active":"2024-09-19T07:11:03.274574+0000","last_peered":"2024-09-19T07:11:03.274574+0000","last_clean":"2024-09-19T07:11:03.274574+0000","last_became_active":"2024-09-19T07:09:18.925559+0000","last_became_peered":"2024-09-19T07:09:18.925559+0000","last_unstale":"2024-09-19T07:11:03.274574+0000","last_undegraded":"2024-09-19T07:11:03.274574+0000","last_fullsized":"2024-09-19T07:11:03.274574+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:15:58.348347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.267010+0000","last_change":"2024-09-19T07:09:18.938911+0000","last_active":"2024-09-19T07:11:03.267010+0000","last_peered":"2024-09-19T07:11:03.267010+0000","last_clean":"2024-09-19T07:11:03.267010+0000","last_became_active":"2024-09-19T07:09:18.938601+0000","last_became_peered":"2024-09-19T07:09:18.938601+0000","last_unstale":"2024-09-19T07:11:03.267010+0000","last_undegraded":"2024-09-19T07:11:03.267010+0000","last_fullsized":"2024-09-19T07:11:03.267010+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:34.517324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.274002+0000","last_change":"2024-09-19T07:09:18.930253+0000","last_active":"2024-09-19T07:11:03.274002+0000","last_peered":"2024-09-19T07:11:03.274002+0000","last_clean":"2024-09-19T07:11:03.274002+0000","last_became_active":"2024-09-19T07:09:18.929927+0000","last_became_peered":"2024-09-19T07:09:18.929927+0000","last_unstale":"2024-09-19T07:11:03.274002+0000","last_undegraded":"2024-09-19T07:11:03.274002+0000","last_fullsized":"2024-09-19T07:11:03.274002+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:31:39.186230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"81'9","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.269452+0000","last_change":"2024-09-19T07:09:38.180197+0000","last_active":"2024-09-19T07:11:03.269452+0000","last_peered":"2024-09-19T07:11:03.269452+0000","last_clean":"2024-09-19T07:11:03.269452+0000","last_became_active":"2024-09-19T07:09:38.179767+0000","last_became_peered":"2024-09-19T07:09:38.179767+0000","last_unstale":"2024-09-19T07:11:03.269452+0000","last_undegraded":"2024-09-19T07:11:03.269452+0000","last_fullsized":"2024-09-19T07:11:03.269452+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:43.581181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.275716+0000","last_change":"2024-09-19T07:09:18.937100+0000","last_active":"2024-09-19T07:11:03.275716+0000","last_peered":"2024-09-19T07:11:03.275716+0000","last_clean":"2024-09-19T07:11:03.275716+0000","last_became_active":"2024-09-19T07:09:18.935151+0000","last_became_peered":"2024-09-19T07:09:18.935151+0000","last_unstale":"2024-09-19T07:11:03.275716+0000","last_undegraded":"2024-09-19T07:11:03.275716+0000","last_fullsized":"2024-09-19T07:11:03.275716+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:46:30.950667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.273140+0000","last_change":"2024-09-19T07:09:18.940119+0000","last_active":"2024-09-19T07:11:03.273140+0000","last_peered":"2024-09-19T07:11:03.273140+0000","last_clean":"2024-09-19T07:11:03.273140+0000","last_became_active":"2024-09-19T07:09:18.939703+0000","last_became_peered":"2024-09-19T07:09:18.939703+0000","last_unstale":"2024-09-19T07:11:03.273140+0000","last_undegraded":"2024-09-19T07:11:03.273140+0000","last_fullsized":"2024-09-19T07:11:03.273140+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:51:04.982727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.276689+0000","last_change":"2024-09-19T07:09:18.939146+0000","last_active":"2024-09-19T07:11:03.276689+0000","last_peered":"2024-09-19T07:11:03.276689+0000","last_clean":"2024-09-19T07:11:03.276689+0000","last_became_active":"2024-09-19T07:09:18.936842+0000","last_became_peered":"2024-09-19T07:09:18.936842+0000","last_unstale":"2024-09-19T07:11:03.276689+0000","last_undegraded":"2024-09-19T07:11:03.276689+0000","last_fullsized":"2024-09-19T07:11:03.276689+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:32.713505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.265688+0000","last_change":"2024-09-19T07:09:38.178834+0000","last_active":"2024-09-19T07:11:03.265688+0000","last_peered":"2024-09-19T07:11:03.265688+0000","last_clean":"2024-09-19T07:11:03.265688+0000","last_became_active":"2024-09-19T07:09:38.178477+0000","last_became_peered":"2024-09-19T07:09:38.178477+0000","last_unstale":"2024-09-19T07:11:03.265688+0000","last_undegraded":"2024-09-19T07:11:03.265688+0000","last_fullsized":"2024-09-19T07:11:03.265688+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:04:44.524920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.285948+0000","last_change":"2024-09-19T07:09:18.935422+0000","last_active":"2024-09-19T07:11:03.285948+0000","last_peered":"2024-09-19T07:11:03.285948+0000","last_clean":"2024-09-19T07:11:03.285948+0000","last_became_active":"2024-09-19T07:09:18.934994+0000","last_became_peered":"2024-09-19T07:09:18.934994+0000","last_unstale":"2024-09-19T07:11:03.285948+0000","last_undegraded":"2024-09-19T07:11:03.285948+0000","last_fullsized":"2024-09-19T07:11:03.285948+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:37:30.751247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.283787+0000","last_change":"2024-09-19T07:09:18.933954+0000","last_active":"2024-09-19T07:11:03.283787+0000","last_peered":"2024-09-19T07:11:03.283787+0000","last_clean":"2024-09-19T07:11:03.283787+0000","last_became_active":"2024-09-19T07:09:18.933588+0000","last_became_peered":"2024-09-19T07:09:18.933588+0000","last_unstale":"2024-09-19T07:11:03.283787+0000","last_undegraded":"2024-09-19T07:11:03.283787+0000","last_fullsized":"2024-09-19T07:11:03.283787+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:10.161172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.283035+0000","last_change":"2024-09-19T07:09:18.932122+0000","last_active":"2024-09-19T07:11:03.283035+0000","last_peered":"2024-09-19T07:11:03.283035+0000","last_clean":"2024-09-19T07:11:03.283035+0000","last_became_active":"2024-09-19T07:09:18.931798+0000","last_became_peered":"2024-09-19T07:09:18.931798+0000","last_unstale":"2024-09-19T07:11:03.283035+0000","last_undegraded":"2024-09-19T07:11:03.283035+0000","last_fullsized":"2024-09-19T07:11:03.283035+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:44.776375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.261952+0000","last_change":"2024-09-19T07:09:18.935632+0000","last_active":"2024-09-19T07:11:03.261952+0000","last_peered":"2024-09-19T07:11:03.261952+0000","last_clean":"2024-09-19T07:11:03.261952+0000","last_became_active":"2024-09-19T07:09:18.935174+0000","last_became_peered":"2024-09-19T07:09:18.935174+0000","last_unstale":"2024-09-19T07:11:03.261952+0000","last_undegraded":"2024-09-19T07:11:03.261952+0000","last_fullsized":"2024-09-19T07:11:03.261952+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:22.170777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.279662+0000","last_change":"2024-09-19T07:09:18.931836+0000","last_active":"2024-09-19T07:11:03.279662+0000","last_peered":"2024-09-19T07:11:03.279662+0000","last_clean":"2024-09-19T07:11:03.279662+0000","last_became_active":"2024-09-19T07:09:18.931564+0000","last_became_peered":"2024-09-19T07:09:18.931564+0000","last_unstale":"2024-09-19T07:11:03.279662+0000","last_undegraded":"2024-09-19T07:11:03.279662+0000","last_fullsized":"2024-09-19T07:11:03.279662+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:53.674584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.263261+0000","last_change":"2024-09-19T07:09:18.933210+0000","last_active":"2024-09-19T07:11:03.263261+0000","last_peered":"2024-09-19T07:11:03.263261+0000","last_clean":"2024-09-19T07:11:03.263261+0000","last_became_active":"2024-09-19T07:09:18.932894+0000","last_became_peered":"2024-09-19T07:09:18.932894+0000","last_unstale":"2024-09-19T07:11:03.263261+0000","last_undegraded":"2024-09-19T07:11:03.263261+0000","last_fullsized":"2024-09-19T07:11:03.263261+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:50:56.669801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.281347+0000","last_change":"2024-09-19T07:09:18.925627+0000","last_active":"2024-09-19T07:11:03.281347+0000","last_peered":"2024-09-19T07:11:03.281347+0000","last_clean":"2024-09-19T07:11:03.281347+0000","last_became_active":"2024-09-19T07:09:18.925340+0000","last_became_peered":"2024-09-19T07:09:18.925340+0000","last_unstale":"2024-09-19T07:11:03.281347+0000","last_undegraded":"2024-09-19T07:11:03.281347+0000","last_fullsized":"2024-09-19T07:11:03.281347+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:29.544534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.275601+0000","last_change":"2024-09-19T07:09:18.936963+0000","last_active":"2024-09-19T07:11:03.275601+0000","last_peered":"2024-09-19T07:11:03.275601+0000","last_clean":"2024-09-19T07:11:03.275601+0000","last_became_active":"2024-09-19T07:09:18.936615+0000","last_became_peered":"2024-09-19T07:09:18.936615+0000","last_unstale":"2024-09-19T07:11:03.275601+0000","last_undegraded":"2024-09-19T07:11:03.275601+0000","last_fullsized":"2024-09-19T07:11:03.275601+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:13.036392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.285146+0000","last_change":"2024-09-19T07:09:18.932018+0000","last_active":"2024-09-19T07:11:03.285146+0000","last_peered":"2024-09-19T07:11:03.285146+0000","last_clean":"2024-09-19T07:11:03.285146+0000","last_became_active":"2024-09-19T07:09:18.931624+0000","last_became_peered":"2024-09-19T07:09:18.931624+0000","last_unstale":"2024-09-19T07:11:03.285146+0000","last_undegraded":"2024-09-19T07:11:03.285146+0000","last_fullsized":"2024-09-19T07:11:03.285146+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:53:05.585166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.265530+0000","last_change":"2024-09-19T07:09:18.935474+0000","last_active":"2024-09-19T07:11:03.265530+0000","last_peered":"2024-09-19T07:11:03.265530+0000","last_clean":"2024-09-19T07:11:03.265530+0000","last_became_active":"2024-09-19T07:09:18.929018+0000","last_became_peered":"2024-09-19T07:09:18.929018+0000","last_unstale":"2024-09-19T07:11:03.265530+0000","last_undegraded":"2024-09-19T07:11:03.265530+0000","last_fullsized":"2024-09-19T07:11:03.265530+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:01.383024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.276949+0000","last_change":"2024-09-19T07:09:18.928733+0000","last_active":"2024-09-19T07:11:03.276949+0000","last_peered":"2024-09-19T07:11:03.276949+0000","last_clean":"2024-09-19T07:11:03.276949+0000","last_became_active":"2024-09-19T07:09:18.928431+0000","last_became_peered":"2024-09-19T07:09:18.928431+0000","last_unstale":"2024-09-19T07:11:03.276949+0000","last_undegraded":"2024-09-19T07:11:03.276949+0000","last_fullsized":"2024-09-19T07:11:03.276949+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:37.313958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.268113+0000","last_change":"2024-09-19T07:09:18.921268+0000","last_active":"2024-09-19T07:11:03.268113+0000","last_peered":"2024-09-19T07:11:03.268113+0000","last_clean":"2024-09-19T07:11:03.268113+0000","last_became_active":"2024-09-19T07:09:18.920482+0000","last_became_peered":"2024-09-19T07:09:18.920482+0000","last_unstale":"2024-09-19T07:11:03.268113+0000","last_undegraded":"2024-09-19T07:11:03.268113+0000","last_fullsized":"2024-09-19T07:11:03.268113+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:35.201826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"81'2","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.269267+0000","last_change":"2024-09-19T07:09:38.179136+0000","last_active":"2024-09-19T07:11:03.269267+0000","last_peered":"2024-09-19T07:11:03.269267+0000","last_clean":"2024-09-19T07:11:03.269267+0000","last_became_active":"2024-09-19T07:09:38.178746+0000","last_became_peered":"2024-09-19T07:09:38.178746+0000","last_unstale":"2024-09-19T07:11:03.269267+0000","last_undegraded":"2024-09-19T07:11:03.269267+0000","last_fullsized":"2024-09-19T07:11:03.269267+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:03.788114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.280523+0000","last_change":"2024-09-19T07:09:18.924099+0000","last_active":"2024-09-19T07:11:03.280523+0000","last_peered":"2024-09-19T07:11:03.280523+0000","last_clean":"2024-09-19T07:11:03.280523+0000","last_became_active":"2024-09-19T07:09:18.923772+0000","last_became_peered":"2024-09-19T07:09:18.923772+0000","last_unstale":"2024-09-19T07:11:03.280523+0000","last_undegraded":"2024-09-19T07:11:03.280523+0000","last_fullsized":"2024-09-19T07:11:03.280523+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:05:04.954087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.271340+0000","last_change":"2024-09-19T07:09:18.923391+0000","last_active":"2024-09-19T07:11:03.271340+0000","last_peered":"2024-09-19T07:11:03.271340+0000","last_clean":"2024-09-19T07:11:03.271340+0000","last_became_active":"2024-09-19T07:09:18.923085+0000","last_became_peered":"2024-09-19T07:09:18.923085+0000","last_unstale":"2024-09-19T07:11:03.271340+0000","last_undegraded":"2024-09-19T07:11:03.271340+0000","last_fullsized":"2024-09-19T07:11:03.271340+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:43:27.032400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.283075+0000","last_change":"2024-09-19T07:09:18.937188+0000","last_active":"2024-09-19T07:11:03.283075+0000","last_peered":"2024-09-19T07:11:03.283075+0000","last_clean":"2024-09-19T07:11:03.283075+0000","last_became_active":"2024-09-19T07:09:18.936866+0000","last_became_peered":"2024-09-19T07:09:18.936866+0000","last_unstale":"2024-09-19T07:11:03.283075+0000","last_undegraded":"2024-09-19T07:11:03.283075+0000","last_fullsized":"2024-09-19T07:11:03.283075+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:29:08.835307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.284272+0000","last_change":"2024-09-19T07:09:18.935170+0000","last_active":"2024-09-19T07:11:03.284272+0000","last_peered":"2024-09-19T07:11:03.284272+0000","last_clean":"2024-09-19T07:11:03.284272+0000","last_became_active":"2024-09-19T07:09:18.934356+0000","last_became_peered":"2024-09-19T07:09:18.934356+0000","last_unstale":"2024-09-19T07:11:03.284272+0000","last_undegraded":"2024-09-19T07:11:03.284272+0000","last_fullsized":"2024-09-19T07:11:03.284272+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:53.567392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.285704+0000","last_change":"2024-09-19T07:09:18.922640+0000","last_active":"2024-09-19T07:11:03.285704+0000","last_peered":"2024-09-19T07:11:03.285704+0000","last_clean":"2024-09-19T07:11:03.285704+0000","last_became_active":"2024-09-19T07:09:18.922312+0000","last_became_peered":"2024-09-19T07:09:18.922312+0000","last_unstale":"2024-09-19T07:11:03.285704+0000","last_undegraded":"2024-09-19T07:11:03.285704+0000","last_fullsized":"2024-09-19T07:11:03.285704+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:50.868818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.280468+0000","last_change":"2024-09-19T07:09:18.934364+0000","last_active":"2024-09-19T07:11:03.280468+0000","last_peered":"2024-09-19T07:11:03.280468+0000","last_clean":"2024-09-19T07:11:03.280468+0000","last_became_active":"2024-09-19T07:09:18.933533+0000","last_became_peered":"2024-09-19T07:09:18.933533+0000","last_unstale":"2024-09-19T07:11:03.280468+0000","last_undegraded":"2024-09-19T07:11:03.280468+0000","last_fullsized":"2024-09-19T07:11:03.280468+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:54.175425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.274368+0000","last_change":"2024-09-19T07:09:18.927456+0000","last_active":"2024-09-19T07:11:03.274368+0000","last_peered":"2024-09-19T07:11:03.274368+0000","last_clean":"2024-09-19T07:11:03.274368+0000","last_became_active":"2024-09-19T07:09:18.927117+0000","last_became_peered":"2024-09-19T07:09:18.927117+0000","last_unstale":"2024-09-19T07:11:03.274368+0000","last_undegraded":"2024-09-19T07:11:03.274368+0000","last_fullsized":"2024-09-19T07:11:03.274368+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:08.885898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.271805+0000","last_change":"2024-09-19T07:09:18.926024+0000","last_active":"2024-09-19T07:11:03.271805+0000","last_peered":"2024-09-19T07:11:03.271805+0000","last_clean":"2024-09-19T07:11:03.271805+0000","last_became_active":"2024-09-19T07:09:18.925689+0000","last_became_peered":"2024-09-19T07:09:18.925689+0000","last_unstale":"2024-09-19T07:11:03.271805+0000","last_undegraded":"2024-09-19T07:11:03.271805+0000","last_fullsized":"2024-09-19T07:11:03.271805+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:09:08.178214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'10","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:13.142527+0000","last_change":"2024-09-19T07:09:16.915804+0000","last_active":"2024-09-19T07:11:13.142527+0000","last_peered":"2024-09-19T07:11:13.142527+0000","last_clean":"2024-09-19T07:11:13.142527+0000","last_became_active":"2024-09-19T07:09:16.915434+0000","last_became_peered":"2024-09-19T07:09:16.915434+0000","last_unstale":"2024-09-19T07:11:13.142527+0000","last_undegraded":"2024-09-19T07:11:13.142527+0000","last_fullsized":"2024-09-19T07:11:13.142527+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:57.230475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2250,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":5,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.271307+0000","last_change":"2024-09-19T07:09:18.932497+0000","last_active":"2024-09-19T07:11:03.271307+0000","last_peered":"2024-09-19T07:11:03.271307+0000","last_clean":"2024-09-19T07:11:03.271307+0000","last_became_active":"2024-09-19T07:09:18.932213+0000","last_became_peered":"2024-09-19T07:09:18.932213+0000","last_unstale":"2024-09-19T07:11:03.271307+0000","last_undegraded":"2024-09-19T07:11:03.271307+0000","last_fullsized":"2024-09-19T07:11:03.271307+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:10.299077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.233512+0000","last_change":"2024-09-19T07:09:16.910171+0000","last_active":"2024-09-19T07:11:03.233512+0000","last_peered":"2024-09-19T07:11:03.233512+0000","last_clean":"2024-09-19T07:11:03.233512+0000","last_became_active":"2024-09-19T07:09:16.909840+0000","last_became_peered":"2024-09-19T07:09:16.909840+0000","last_unstale":"2024-09-19T07:11:03.233512+0000","last_undegraded":"2024-09-19T07:11:03.233512+0000","last_fullsized":"2024-09-19T07:11:03.233512+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:35.448892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.229456+0000","last_change":"2024-09-19T07:09:16.911336+0000","last_active":"2024-09-19T07:11:03.229456+0000","last_peered":"2024-09-19T07:11:03.229456+0000","last_clean":"2024-09-19T07:11:03.229456+0000","last_became_active":"2024-09-19T07:09:16.911027+0000","last_became_peered":"2024-09-19T07:09:16.911027+0000","last_unstale":"2024-09-19T07:11:03.229456+0000","last_undegraded":"2024-09-19T07:11:03.229456+0000","last_fullsized":"2024-09-19T07:11:03.229456+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:37:50.698597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.278229+0000","last_change":"2024-09-19T07:09:18.927713+0000","last_active":"2024-09-19T07:11:03.278229+0000","last_peered":"2024-09-19T07:11:03.278229+0000","last_clean":"2024-09-19T07:11:03.278229+0000","last_became_active":"2024-09-19T07:09:18.927430+0000","last_became_peered":"2024-09-19T07:09:18.927430+0000","last_unstale":"2024-09-19T07:11:03.278229+0000","last_undegraded":"2024-09-19T07:11:03.278229+0000","last_fullsized":"2024-09-19T07:11:03.278229+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:15:07.707723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.236756+0000","last_change":"2024-09-19T07:09:16.912391+0000","last_active":"2024-09-19T07:11:03.236756+0000","last_peered":"2024-09-19T07:11:03.236756+0000","last_clean":"2024-09-19T07:11:03.236756+0000","last_became_active":"2024-09-19T07:09:16.912034+0000","last_became_peered":"2024-09-19T07:09:16.912034+0000","last_unstale":"2024-09-19T07:11:03.236756+0000","last_undegraded":"2024-09-19T07:11:03.236756+0000","last_fullsized":"2024-09-19T07:11:03.236756+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:18:45.226107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.269888+0000","last_change":"2024-09-19T07:09:18.929476+0000","last_active":"2024-09-19T07:11:03.269888+0000","last_peered":"2024-09-19T07:11:03.269888+0000","last_clean":"2024-09-19T07:11:03.269888+0000","last_became_active":"2024-09-19T07:09:18.929183+0000","last_became_peered":"2024-09-19T07:09:18.929183+0000","last_unstale":"2024-09-19T07:11:03.269888+0000","last_undegraded":"2024-09-19T07:11:03.269888+0000","last_fullsized":"2024-09-19T07:11:03.269888+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:19:38.827130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:13.141960+0000","last_change":"2024-09-19T07:09:16.913012+0000","last_active":"2024-09-19T07:11:13.141960+0000","last_peered":"2024-09-19T07:11:13.141960+0000","last_clean":"2024-09-19T07:11:13.141960+0000","last_became_active":"2024-09-19T07:09:16.912633+0000","last_became_peered":"2024-09-19T07:09:16.912633+0000","last_unstale":"2024-09-19T07:11:13.141960+0000","last_undegraded":"2024-09-19T07:11:13.141960+0000","last_fullsized":"2024-09-19T07:11:13.141960+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:21:39.669961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.262229+0000","last_change":"2024-09-19T07:09:18.937323+0000","last_active":"2024-09-19T07:11:03.262229+0000","last_peered":"2024-09-19T07:11:03.262229+0000","last_clean":"2024-09-19T07:11:03.262229+0000","last_became_active":"2024-09-19T07:09:18.936762+0000","last_became_peered":"2024-09-19T07:09:18.936762+0000","last_unstale":"2024-09-19T07:11:03.262229+0000","last_undegraded":"2024-09-19T07:11:03.262229+0000","last_fullsized":"2024-09-19T07:11:03.262229+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:37.692290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.234308+0000","last_change":"2024-09-19T07:09:16.912167+0000","last_active":"2024-09-19T07:11:03.234308+0000","last_peered":"2024-09-19T07:11:03.234308+0000","last_clean":"2024-09-19T07:11:03.234308+0000","last_became_active":"2024-09-19T07:09:16.911840+0000","last_became_peered":"2024-09-19T07:09:16.911840+0000","last_unstale":"2024-09-19T07:11:03.234308+0000","last_undegraded":"2024-09-19T07:11:03.234308+0000","last_fullsized":"2024-09-19T07:11:03.234308+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:31.901906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.283235+0000","last_change":"2024-09-19T07:09:18.932239+0000","last_active":"2024-09-19T07:11:03.283235+0000","last_peered":"2024-09-19T07:11:03.283235+0000","last_clean":"2024-09-19T07:11:03.283235+0000","last_became_active":"2024-09-19T07:09:18.931820+0000","last_became_peered":"2024-09-19T07:09:18.931820+0000","last_unstale":"2024-09-19T07:11:03.283235+0000","last_undegraded":"2024-09-19T07:11:03.283235+0000","last_fullsized":"2024-09-19T07:11:03.283235+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:09.407524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.236809+0000","last_change":"2024-09-19T07:09:17.085077+0000","last_active":"2024-09-19T07:11:03.236809+0000","last_peered":"2024-09-19T07:11:03.236809+0000","last_clean":"2024-09-19T07:11:03.236809+0000","last_became_active":"2024-09-19T07:09:17.084457+0000","last_became_peered":"2024-09-19T07:09:17.084457+0000","last_unstale":"2024-09-19T07:11:03.236809+0000","last_undegraded":"2024-09-19T07:11:03.236809+0000","last_fullsized":"2024-09-19T07:11:03.236809+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:42.416193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.276315+0000","last_change":"2024-09-19T07:09:18.939830+0000","last_active":"2024-09-19T07:11:03.276315+0000","last_peered":"2024-09-19T07:11:03.276315+0000","last_clean":"2024-09-19T07:11:03.276315+0000","last_became_active":"2024-09-19T07:09:18.939359+0000","last_became_peered":"2024-09-19T07:09:18.939359+0000","last_unstale":"2024-09-19T07:11:03.276315+0000","last_undegraded":"2024-09-19T07:11:03.276315+0000","last_fullsized":"2024-09-19T07:11:03.276315+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:24:46.241902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'34","reported_seq":300,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:13.373459+0000","last_change":"2024-09-19T07:09:38.227707+0000","last_active":"2024-09-19T07:11:13.373459+0000","last_peered":"2024-09-19T07:11:13.373459+0000","last_clean":"2024-09-19T07:11:13.373459+0000","last_became_active":"2024-09-19T07:09:38.219073+0000","last_became_peered":"2024-09-19T07:09:38.219073+0000","last_unstale":"2024-09-19T07:11:13.373459+0000","last_undegraded":"2024-09-19T07:11:13.373459+0000","last_fullsized":"2024-09-19T07:11:13.373459+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:46.035315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66480,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":221,"num_read_kb":170,"num_write":35,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":26947,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.270480+0000","last_change":"2024-09-19T07:09:18.929531+0000","last_active":"2024-09-19T07:11:03.270480+0000","last_peered":"2024-09-19T07:11:03.270480+0000","last_clean":"2024-09-19T07:11:03.270480+0000","last_became_active":"2024-09-19T07:09:18.929253+0000","last_became_peered":"2024-09-19T07:09:18.929253+0000","last_unstale":"2024-09-19T07:11:03.270480+0000","last_undegraded":"2024-09-19T07:11:03.270480+0000","last_fullsized":"2024-09-19T07:11:03.270480+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:10.635116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.238624+0000","last_change":"2024-09-19T07:09:16.914964+0000","last_active":"2024-09-19T07:11:03.238624+0000","last_peered":"2024-09-19T07:11:03.238624+0000","last_clean":"2024-09-19T07:11:03.238624+0000","last_became_active":"2024-09-19T07:09:16.914540+0000","last_became_peered":"2024-09-19T07:09:16.914540+0000","last_unstale":"2024-09-19T07:11:03.238624+0000","last_undegraded":"2024-09-19T07:11:03.238624+0000","last_fullsized":"2024-09-19T07:11:03.238624+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:30.903046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.284691+0000","last_change":"2024-09-19T07:09:18.931709+0000","last_active":"2024-09-19T07:11:03.284691+0000","last_peered":"2024-09-19T07:11:03.284691+0000","last_clean":"2024-09-19T07:11:03.284691+0000","last_became_active":"2024-09-19T07:09:18.931345+0000","last_became_peered":"2024-09-19T07:09:18.931345+0000","last_unstale":"2024-09-19T07:11:03.284691+0000","last_undegraded":"2024-09-19T07:11:03.284691+0000","last_fullsized":"2024-09-19T07:11:03.284691+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:28.916820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.236617+0000","last_change":"2024-09-19T07:09:16.914055+0000","last_active":"2024-09-19T07:11:03.236617+0000","last_peered":"2024-09-19T07:11:03.236617+0000","last_clean":"2024-09-19T07:11:03.236617+0000","last_became_active":"2024-09-19T07:09:16.913589+0000","last_became_peered":"2024-09-19T07:09:16.913589+0000","last_unstale":"2024-09-19T07:11:03.236617+0000","last_undegraded":"2024-09-19T07:11:03.236617+0000","last_fullsized":"2024-09-19T07:11:03.236617+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:29:16.322059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"81'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.285962+0000","last_change":"2024-09-19T07:09:18.934879+0000","last_active":"2024-09-19T07:11:03.285962+0000","last_peered":"2024-09-19T07:11:03.285962+0000","last_clean":"2024-09-19T07:11:03.285962+0000","last_became_active":"2024-09-19T07:09:18.934432+0000","last_became_peered":"2024-09-19T07:09:18.934432+0000","last_unstale":"2024-09-19T07:11:03.285962+0000","last_undegraded":"2024-09-19T07:11:03.285962+0000","last_fullsized":"2024-09-19T07:11:03.285962+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:25.782782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'7","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:13.141564+0000","last_change":"2024-09-19T07:09:16.909256+0000","last_active":"2024-09-19T07:11:13.141564+0000","last_peered":"2024-09-19T07:11:13.141564+0000","last_clean":"2024-09-19T07:11:13.141564+0000","last_became_active":"2024-09-19T07:09:16.908932+0000","last_became_peered":"2024-09-19T07:09:16.908932+0000","last_unstale":"2024-09-19T07:11:13.141564+0000","last_undegraded":"2024-09-19T07:11:13.141564+0000","last_fullsized":"2024-09-19T07:11:13.141564+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:28.344756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1908,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":5,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.270197+0000","last_change":"2024-09-19T07:09:18.931844+0000","last_active":"2024-09-19T07:11:03.270197+0000","last_peered":"2024-09-19T07:11:03.270197+0000","last_clean":"2024-09-19T07:11:03.270197+0000","last_became_active":"2024-09-19T07:09:18.931516+0000","last_became_peered":"2024-09-19T07:09:18.931516+0000","last_unstale":"2024-09-19T07:11:03.270197+0000","last_undegraded":"2024-09-19T07:11:03.270197+0000","last_fullsized":"2024-09-19T07:11:03.270197+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:27:29.812144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.247165+0000","last_change":"2024-09-19T07:09:17.085252+0000","last_active":"2024-09-19T07:11:03.247165+0000","last_peered":"2024-09-19T07:11:03.247165+0000","last_clean":"2024-09-19T07:11:03.247165+0000","last_became_active":"2024-09-19T07:09:17.084907+0000","last_became_peered":"2024-09-19T07:09:17.084907+0000","last_unstale":"2024-09-19T07:11:03.247165+0000","last_undegraded":"2024-09-19T07:11:03.247165+0000","last_fullsized":"2024-09-19T07:11:03.247165+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:59:40.351181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.269674+0000","last_change":"2024-09-19T07:09:18.932491+0000","last_active":"2024-09-19T07:11:03.269674+0000","last_peered":"2024-09-19T07:11:03.269674+0000","last_clean":"2024-09-19T07:11:03.269674+0000","last_became_active":"2024-09-19T07:09:18.932159+0000","last_became_peered":"2024-09-19T07:09:18.932159+0000","last_unstale":"2024-09-19T07:11:03.269674+0000","last_undegraded":"2024-09-19T07:11:03.269674+0000","last_fullsized":"2024-09-19T07:11:03.269674+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:31.144130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'3","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.247568+0000","last_change":"2024-09-19T07:09:16.911012+0000","last_active":"2024-09-19T07:11:03.247568+0000","last_peered":"2024-09-19T07:11:03.247568+0000","last_clean":"2024-09-19T07:11:03.247568+0000","last_became_active":"2024-09-19T07:09:16.910618+0000","last_became_peered":"2024-09-19T07:09:16.910618+0000","last_unstale":"2024-09-19T07:11:03.247568+0000","last_undegraded":"2024-09-19T07:11:03.247568+0000","last_fullsized":"2024-09-19T07:11:03.247568+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:16.316680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"81'5","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.267441+0000","last_change":"2024-09-19T07:09:38.217870+0000","last_active":"2024-09-19T07:11:03.267441+0000","last_peered":"2024-09-19T07:11:03.267441+0000","last_clean":"2024-09-19T07:11:03.267441+0000","last_became_active":"2024-09-19T07:09:38.217585+0000","last_became_peered":"2024-09-19T07:09:38.217585+0000","last_unstale":"2024-09-19T07:11:03.267441+0000","last_undegraded":"2024-09-19T07:11:03.267441+0000","last_fullsized":"2024-09-19T07:11:03.267441+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:41.320705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.229695+0000","last_change":"2024-09-19T07:09:16.911644+0000","last_active":"2024-09-19T07:11:03.229695+0000","last_peered":"2024-09-19T07:11:03.229695+0000","last_clean":"2024-09-19T07:11:03.229695+0000","last_became_active":"2024-09-19T07:09:16.911368+0000","last_became_peered":"2024-09-19T07:09:16.911368+0000","last_unstale":"2024-09-19T07:11:03.229695+0000","last_undegraded":"2024-09-19T07:11:03.229695+0000","last_fullsized":"2024-09-19T07:11:03.229695+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:12.953466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.274357+0000","last_change":"2024-09-19T07:09:18.933667+0000","last_active":"2024-09-19T07:11:03.274357+0000","last_peered":"2024-09-19T07:11:03.274357+0000","last_clean":"2024-09-19T07:11:03.274357+0000","last_became_active":"2024-09-19T07:09:18.933288+0000","last_became_peered":"2024-09-19T07:09:18.933288+0000","last_unstale":"2024-09-19T07:11:03.274357+0000","last_undegraded":"2024-09-19T07:11:03.274357+0000","last_fullsized":"2024-09-19T07:11:03.274357+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:54:38.127799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'65","reported_seq":119,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:13.835505+0000","last_change":"2024-09-19T07:09:16.909722+0000","last_active":"2024-09-19T07:11:13.835505+0000","last_peered":"2024-09-19T07:11:13.835505+0000","last_clean":"2024-09-19T07:11:13.835505+0000","last_became_active":"2024-09-19T07:09:16.909394+0000","last_became_peered":"2024-09-19T07:09:16.909394+0000","last_unstale":"2024-09-19T07:11:13.835505+0000","last_undegraded":"2024-09-19T07:11:13.835505+0000","last_fullsized":"2024-09-19T07:11:13.835505+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:21:53.342710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":32,"num_write":76,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.269158+0000","last_change":"2024-09-19T07:09:18.929473+0000","last_active":"2024-09-19T07:11:03.269158+0000","last_peered":"2024-09-19T07:11:03.269158+0000","last_clean":"2024-09-19T07:11:03.269158+0000","last_became_active":"2024-09-19T07:09:18.929176+0000","last_became_peered":"2024-09-19T07:09:18.929176+0000","last_unstale":"2024-09-19T07:11:03.269158+0000","last_undegraded":"2024-09-19T07:11:03.269158+0000","last_fullsized":"2024-09-19T07:11:03.269158+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:32:30.409528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.238675+0000","last_change":"2024-09-19T07:09:17.084868+0000","last_active":"2024-09-19T07:11:03.238675+0000","last_peered":"2024-09-19T07:11:03.238675+0000","last_clean":"2024-09-19T07:11:03.238675+0000","last_became_active":"2024-09-19T07:09:17.084448+0000","last_became_peered":"2024-09-19T07:09:17.084448+0000","last_unstale":"2024-09-19T07:11:03.238675+0000","last_undegraded":"2024-09-19T07:11:03.238675+0000","last_fullsized":"2024-09-19T07:11:03.238675+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:38.211697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.276801+0000","last_change":"2024-09-19T07:09:18.938865+0000","last_active":"2024-09-19T07:11:03.276801+0000","last_peered":"2024-09-19T07:11:03.276801+0000","last_clean":"2024-09-19T07:11:03.276801+0000","last_became_active":"2024-09-19T07:09:18.936324+0000","last_became_peered":"2024-09-19T07:09:18.936324+0000","last_unstale":"2024-09-19T07:11:03.276801+0000","last_undegraded":"2024-09-19T07:11:03.276801+0000","last_fullsized":"2024-09-19T07:11:03.276801+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:29:51.081140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"81'148","reported_seq":389,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:05.365523+0000","last_change":"2024-09-19T07:08:09.270850+0000","last_active":"2024-09-19T07:11:05.365523+0000","last_peered":"2024-09-19T07:11:05.365523+0000","last_clean":"2024-09-19T07:11:05.365523+0000","last_became_active":"2024-09-19T07:08:09.270308+0000","last_became_peered":"2024-09-19T07:08:09.270308+0000","last_unstale":"2024-09-19T07:11:05.365523+0000","last_undegraded":"2024-09-19T07:11:05.365523+0000","last_fullsized":"2024-09-19T07:11:05.365523+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:04:49.729632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:04:49.729632+0000","last_clean_scrub_stamp":"2024-09-19T07:04:49.729632+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:15.588732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.231213+0000","last_change":"2024-09-19T07:09:16.907648+0000","last_active":"2024-09-19T07:11:03.231213+0000","last_peered":"2024-09-19T07:11:03.231213+0000","last_clean":"2024-09-19T07:11:03.231213+0000","last_became_active":"2024-09-19T07:09:16.907363+0000","last_became_peered":"2024-09-19T07:09:16.907363+0000","last_unstale":"2024-09-19T07:11:03.231213+0000","last_undegraded":"2024-09-19T07:11:03.231213+0000","last_fullsized":"2024-09-19T07:11:03.231213+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:12:27.898493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.275674+0000","last_change":"2024-09-19T07:09:18.926008+0000","last_active":"2024-09-19T07:11:03.275674+0000","last_peered":"2024-09-19T07:11:03.275674+0000","last_clean":"2024-09-19T07:11:03.275674+0000","last_became_active":"2024-09-19T07:09:18.925689+0000","last_became_peered":"2024-09-19T07:09:18.925689+0000","last_unstale":"2024-09-19T07:11:03.275674+0000","last_undegraded":"2024-09-19T07:11:03.275674+0000","last_fullsized":"2024-09-19T07:11:03.275674+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:16:06.467934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.233965+0000","last_change":"2024-09-19T07:09:16.911327+0000","last_active":"2024-09-19T07:11:03.233965+0000","last_peered":"2024-09-19T07:11:03.233965+0000","last_clean":"2024-09-19T07:11:03.233965+0000","last_became_active":"2024-09-19T07:09:16.911031+0000","last_became_peered":"2024-09-19T07:09:16.911031+0000","last_unstale":"2024-09-19T07:11:03.233965+0000","last_undegraded":"2024-09-19T07:11:03.233965+0000","last_fullsized":"2024-09-19T07:11:03.233965+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:03.307119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.280334+0000","last_change":"2024-09-19T07:09:18.933813+0000","last_active":"2024-09-19T07:11:03.280334+0000","last_peered":"2024-09-19T07:11:03.280334+0000","last_clean":"2024-09-19T07:11:03.280334+0000","last_became_active":"2024-09-19T07:09:18.933475+0000","last_became_peered":"2024-09-19T07:09:18.933475+0000","last_unstale":"2024-09-19T07:11:03.280334+0000","last_undegraded":"2024-09-19T07:11:03.280334+0000","last_fullsized":"2024-09-19T07:11:03.280334+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:34:09.149593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":135,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:13.141050+0000","last_change":"2024-09-19T07:09:17.084833+0000","last_active":"2024-09-19T07:11:13.141050+0000","last_peered":"2024-09-19T07:11:13.141050+0000","last_clean":"2024-09-19T07:11:13.141050+0000","last_became_active":"2024-09-19T07:09:17.084477+0000","last_became_peered":"2024-09-19T07:09:17.084477+0000","last_unstale":"2024-09-19T07:11:13.141050+0000","last_undegraded":"2024-09-19T07:11:13.141050+0000","last_fullsized":"2024-09-19T07:11:13.141050+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:17:50.962480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.281019+0000","last_change":"2024-09-19T07:09:18.935991+0000","last_active":"2024-09-19T07:11:03.281019+0000","last_peered":"2024-09-19T07:11:03.281019+0000","last_clean":"2024-09-19T07:11:03.281019+0000","last_became_active":"2024-09-19T07:09:18.935677+0000","last_became_peered":"2024-09-19T07:09:18.935677+0000","last_unstale":"2024-09-19T07:11:03.281019+0000","last_undegraded":"2024-09-19T07:11:03.281019+0000","last_fullsized":"2024-09-19T07:11:03.281019+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:45.550119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.234872+0000","last_change":"2024-09-19T07:09:16.911755+0000","last_active":"2024-09-19T07:11:03.234872+0000","last_peered":"2024-09-19T07:11:03.234872+0000","last_clean":"2024-09-19T07:11:03.234872+0000","last_became_active":"2024-09-19T07:09:16.911211+0000","last_became_peered":"2024-09-19T07:09:16.911211+0000","last_unstale":"2024-09-19T07:11:03.234872+0000","last_undegraded":"2024-09-19T07:11:03.234872+0000","last_fullsized":"2024-09-19T07:11:03.234872+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:15.365423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.265945+0000","last_change":"2024-09-19T07:09:18.940282+0000","last_active":"2024-09-19T07:11:03.265945+0000","last_peered":"2024-09-19T07:11:03.265945+0000","last_clean":"2024-09-19T07:11:03.265945+0000","last_became_active":"2024-09-19T07:09:18.939918+0000","last_became_peered":"2024-09-19T07:09:18.939918+0000","last_unstale":"2024-09-19T07:11:03.265945+0000","last_undegraded":"2024-09-19T07:11:03.265945+0000","last_fullsized":"2024-09-19T07:11:03.265945+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:11.161676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.242639+0000","last_change":"2024-09-19T07:09:17.086103+0000","last_active":"2024-09-19T07:11:03.242639+0000","last_peered":"2024-09-19T07:11:03.242639+0000","last_clean":"2024-09-19T07:11:03.242639+0000","last_became_active":"2024-09-19T07:09:17.085805+0000","last_became_peered":"2024-09-19T07:09:17.085805+0000","last_unstale":"2024-09-19T07:11:03.242639+0000","last_undegraded":"2024-09-19T07:11:03.242639+0000","last_fullsized":"2024-09-19T07:11:03.242639+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:28.522487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.284777+0000","last_change":"2024-09-19T07:09:18.932603+0000","last_active":"2024-09-19T07:11:03.284777+0000","last_peered":"2024-09-19T07:11:03.284777+0000","last_clean":"2024-09-19T07:11:03.284777+0000","last_became_active":"2024-09-19T07:09:18.932309+0000","last_became_peered":"2024-09-19T07:09:18.932309+0000","last_unstale":"2024-09-19T07:11:03.284777+0000","last_undegraded":"2024-09-19T07:11:03.284777+0000","last_fullsized":"2024-09-19T07:11:03.284777+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:19.746024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.245199+0000","last_change":"2024-09-19T07:09:17.085287+0000","last_active":"2024-09-19T07:11:03.245199+0000","last_peered":"2024-09-19T07:11:03.245199+0000","last_clean":"2024-09-19T07:11:03.245199+0000","last_became_active":"2024-09-19T07:09:17.084964+0000","last_became_peered":"2024-09-19T07:09:17.084964+0000","last_unstale":"2024-09-19T07:11:03.245199+0000","last_undegraded":"2024-09-19T07:11:03.245199+0000","last_fullsized":"2024-09-19T07:11:03.245199+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:51:01.035344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.287453+0000","last_change":"2024-09-19T07:09:18.921623+0000","last_active":"2024-09-19T07:11:03.287453+0000","last_peered":"2024-09-19T07:11:03.287453+0000","last_clean":"2024-09-19T07:11:03.287453+0000","last_became_active":"2024-09-19T07:09:18.921321+0000","last_became_peered":"2024-09-19T07:09:18.921321+0000","last_unstale":"2024-09-19T07:11:03.287453+0000","last_undegraded":"2024-09-19T07:11:03.287453+0000","last_fullsized":"2024-09-19T07:11:03.287453+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:28:55.616889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'98","reported_seq":211,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:14.173650+0000","last_change":"2024-09-19T07:09:16.910251+0000","last_active":"2024-09-19T07:11:14.173650+0000","last_peered":"2024-09-19T07:11:14.173650+0000","last_clean":"2024-09-19T07:11:14.173650+0000","last_became_active":"2024-09-19T07:09:16.909821+0000","last_became_peered":"2024-09-19T07:09:16.909821+0000","last_unstale":"2024-09-19T07:11:14.173650+0000","last_undegraded":"2024-09-19T07:11:14.173650+0000","last_fullsized":"2024-09-19T07:11:14.173650+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:02.958557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":302,"num_read_kb":268,"num_write":181,"num_write_kb":1287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.268601+0000","last_change":"2024-09-19T07:09:18.930831+0000","last_active":"2024-09-19T07:11:03.268601+0000","last_peered":"2024-09-19T07:11:03.268601+0000","last_clean":"2024-09-19T07:11:03.268601+0000","last_became_active":"2024-09-19T07:09:18.930475+0000","last_became_peered":"2024-09-19T07:09:18.930475+0000","last_unstale":"2024-09-19T07:11:03.268601+0000","last_undegraded":"2024-09-19T07:11:03.268601+0000","last_fullsized":"2024-09-19T07:11:03.268601+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:30.512246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.231362+0000","last_change":"2024-09-19T07:09:16.906666+0000","last_active":"2024-09-19T07:11:03.231362+0000","last_peered":"2024-09-19T07:11:03.231362+0000","last_clean":"2024-09-19T07:11:03.231362+0000","last_became_active":"2024-09-19T07:09:16.906369+0000","last_became_peered":"2024-09-19T07:09:16.906369+0000","last_unstale":"2024-09-19T07:11:03.231362+0000","last_undegraded":"2024-09-19T07:11:03.231362+0000","last_fullsized":"2024-09-19T07:11:03.231362+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:56.915089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.280797+0000","last_change":"2024-09-19T07:09:18.934942+0000","last_active":"2024-09-19T07:11:03.280797+0000","last_peered":"2024-09-19T07:11:03.280797+0000","last_clean":"2024-09-19T07:11:03.280797+0000","last_became_active":"2024-09-19T07:09:18.934595+0000","last_became_peered":"2024-09-19T07:09:18.934595+0000","last_unstale":"2024-09-19T07:11:03.280797+0000","last_undegraded":"2024-09-19T07:11:03.280797+0000","last_fullsized":"2024-09-19T07:11:03.280797+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:54.306541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.239116+0000","last_change":"2024-09-19T07:09:38.183567+0000","last_active":"2024-09-19T07:11:03.239116+0000","last_peered":"2024-09-19T07:11:03.239116+0000","last_clean":"2024-09-19T07:11:03.239116+0000","last_became_active":"2024-09-19T07:09:38.180778+0000","last_became_peered":"2024-09-19T07:09:38.180778+0000","last_unstale":"2024-09-19T07:11:03.239116+0000","last_undegraded":"2024-09-19T07:11:03.239116+0000","last_fullsized":"2024-09-19T07:11:03.239116+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:43.226551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"81'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.260607+0000","last_change":"2024-09-19T07:09:18.934457+0000","last_active":"2024-09-19T07:11:03.260607+0000","last_peered":"2024-09-19T07:11:03.260607+0000","last_clean":"2024-09-19T07:11:03.260607+0000","last_became_active":"2024-09-19T07:09:18.934126+0000","last_became_peered":"2024-09-19T07:09:18.934126+0000","last_unstale":"2024-09-19T07:11:03.260607+0000","last_undegraded":"2024-09-19T07:11:03.260607+0000","last_fullsized":"2024-09-19T07:11:03.260607+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:37:16.152335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.231606+0000","last_change":"2024-09-19T07:09:16.908457+0000","last_active":"2024-09-19T07:11:03.231606+0000","last_peered":"2024-09-19T07:11:03.231606+0000","last_clean":"2024-09-19T07:11:03.231606+0000","last_became_active":"2024-09-19T07:09:16.908128+0000","last_became_peered":"2024-09-19T07:09:16.908128+0000","last_unstale":"2024-09-19T07:11:03.231606+0000","last_undegraded":"2024-09-19T07:11:03.231606+0000","last_fullsized":"2024-09-19T07:11:03.231606+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:48:50.579301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.273932+0000","last_change":"2024-09-19T07:09:18.928763+0000","last_active":"2024-09-19T07:11:03.273932+0000","last_peered":"2024-09-19T07:11:03.273932+0000","last_clean":"2024-09-19T07:11:03.273932+0000","last_became_active":"2024-09-19T07:09:18.928231+0000","last_became_peered":"2024-09-19T07:09:18.928231+0000","last_unstale":"2024-09-19T07:11:03.273932+0000","last_undegraded":"2024-09-19T07:11:03.273932+0000","last_fullsized":"2024-09-19T07:11:03.273932+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:26.652378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.238773+0000","last_change":"2024-09-19T07:09:16.913740+0000","last_active":"2024-09-19T07:11:03.238773+0000","last_peered":"2024-09-19T07:11:03.238773+0000","last_clean":"2024-09-19T07:11:03.238773+0000","last_became_active":"2024-09-19T07:09:16.912419+0000","last_became_peered":"2024-09-19T07:09:16.912419+0000","last_unstale":"2024-09-19T07:11:03.238773+0000","last_undegraded":"2024-09-19T07:11:03.238773+0000","last_fullsized":"2024-09-19T07:11:03.238773+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:16.658996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.283782+0000","last_change":"2024-09-19T07:09:18.930697+0000","last_active":"2024-09-19T07:11:03.283782+0000","last_peered":"2024-09-19T07:11:03.283782+0000","last_clean":"2024-09-19T07:11:03.283782+0000","last_became_active":"2024-09-19T07:09:18.930355+0000","last_became_peered":"2024-09-19T07:09:18.930355+0000","last_unstale":"2024-09-19T07:11:03.283782+0000","last_undegraded":"2024-09-19T07:11:03.283782+0000","last_fullsized":"2024-09-19T07:11:03.283782+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:07.217195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.228781+0000","last_change":"2024-09-19T07:09:38.183637+0000","last_active":"2024-09-19T07:11:03.228781+0000","last_peered":"2024-09-19T07:11:03.228781+0000","last_clean":"2024-09-19T07:11:03.228781+0000","last_became_active":"2024-09-19T07:09:38.178732+0000","last_became_peered":"2024-09-19T07:09:38.178732+0000","last_unstale":"2024-09-19T07:11:03.228781+0000","last_undegraded":"2024-09-19T07:11:03.228781+0000","last_fullsized":"2024-09-19T07:11:03.228781+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:14.287130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.285232+0000","last_change":"2024-09-19T07:09:18.935120+0000","last_active":"2024-09-19T07:11:03.285232+0000","last_peered":"2024-09-19T07:11:03.285232+0000","last_clean":"2024-09-19T07:11:03.285232+0000","last_became_active":"2024-09-19T07:09:18.934227+0000","last_became_peered":"2024-09-19T07:09:18.934227+0000","last_unstale":"2024-09-19T07:11:03.285232+0000","last_undegraded":"2024-09-19T07:11:03.285232+0000","last_fullsized":"2024-09-19T07:11:03.285232+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:20.328983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"81'15","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.278695+0000","last_change":"2024-09-19T07:09:38.393512+0000","last_active":"2024-09-19T07:11:03.278695+0000","last_peered":"2024-09-19T07:11:03.278695+0000","last_clean":"2024-09-19T07:11:03.278695+0000","last_became_active":"2024-09-19T07:09:38.393200+0000","last_became_peered":"2024-09-19T07:09:38.393200+0000","last_unstale":"2024-09-19T07:11:03.278695+0000","last_undegraded":"2024-09-19T07:11:03.278695+0000","last_fullsized":"2024-09-19T07:11:03.278695+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:51.637520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.247033+0000","last_change":"2024-09-19T07:09:16.911129+0000","last_active":"2024-09-19T07:11:03.247033+0000","last_peered":"2024-09-19T07:11:03.247033+0000","last_clean":"2024-09-19T07:11:03.247033+0000","last_became_active":"2024-09-19T07:09:16.910583+0000","last_became_peered":"2024-09-19T07:09:16.910583+0000","last_unstale":"2024-09-19T07:11:03.247033+0000","last_undegraded":"2024-09-19T07:11:03.247033+0000","last_fullsized":"2024-09-19T07:11:03.247033+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:34:37.295838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.285042+0000","last_change":"2024-09-19T07:09:18.928622+0000","last_active":"2024-09-19T07:11:03.285042+0000","last_peered":"2024-09-19T07:11:03.285042+0000","last_clean":"2024-09-19T07:11:03.285042+0000","last_became_active":"2024-09-19T07:09:18.928284+0000","last_became_peered":"2024-09-19T07:09:18.928284+0000","last_unstale":"2024-09-19T07:11:03.285042+0000","last_undegraded":"2024-09-19T07:11:03.285042+0000","last_fullsized":"2024-09-19T07:11:03.285042+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:37:46.358756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.245062+0000","last_change":"2024-09-19T07:09:16.916142+0000","last_active":"2024-09-19T07:11:03.245062+0000","last_peered":"2024-09-19T07:11:03.245062+0000","last_clean":"2024-09-19T07:11:03.245062+0000","last_became_active":"2024-09-19T07:09:16.915766+0000","last_became_peered":"2024-09-19T07:09:16.915766+0000","last_unstale":"2024-09-19T07:11:03.245062+0000","last_undegraded":"2024-09-19T07:11:03.245062+0000","last_fullsized":"2024-09-19T07:11:03.245062+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:38.136422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.285015+0000","last_change":"2024-09-19T07:09:18.921912+0000","last_active":"2024-09-19T07:11:03.285015+0000","last_peered":"2024-09-19T07:11:03.285015+0000","last_clean":"2024-09-19T07:11:03.285015+0000","last_became_active":"2024-09-19T07:09:18.921595+0000","last_became_peered":"2024-09-19T07:09:18.921595+0000","last_unstale":"2024-09-19T07:11:03.285015+0000","last_undegraded":"2024-09-19T07:11:03.285015+0000","last_fullsized":"2024-09-19T07:11:03.285015+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:53.899052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.232279+0000","last_change":"2024-09-19T07:09:17.084856+0000","last_active":"2024-09-19T07:11:03.232279+0000","last_peered":"2024-09-19T07:11:03.232279+0000","last_clean":"2024-09-19T07:11:03.232279+0000","last_became_active":"2024-09-19T07:09:17.084541+0000","last_became_peered":"2024-09-19T07:09:17.084541+0000","last_unstale":"2024-09-19T07:11:03.232279+0000","last_undegraded":"2024-09-19T07:11:03.232279+0000","last_fullsized":"2024-09-19T07:11:03.232279+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:05.978765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.274355+0000","last_change":"2024-09-19T07:09:18.923732+0000","last_active":"2024-09-19T07:11:03.274355+0000","last_peered":"2024-09-19T07:11:03.274355+0000","last_clean":"2024-09-19T07:11:03.274355+0000","last_became_active":"2024-09-19T07:09:18.923410+0000","last_became_peered":"2024-09-19T07:09:18.923410+0000","last_unstale":"2024-09-19T07:11:03.274355+0000","last_undegraded":"2024-09-19T07:11:03.274355+0000","last_fullsized":"2024-09-19T07:11:03.274355+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:01:20.208414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.242422+0000","last_change":"2024-09-19T07:09:16.910364+0000","last_active":"2024-09-19T07:11:03.242422+0000","last_peered":"2024-09-19T07:11:03.242422+0000","last_clean":"2024-09-19T07:11:03.242422+0000","last_became_active":"2024-09-19T07:09:16.909835+0000","last_became_peered":"2024-09-19T07:09:16.909835+0000","last_unstale":"2024-09-19T07:11:03.242422+0000","last_undegraded":"2024-09-19T07:11:03.242422+0000","last_fullsized":"2024-09-19T07:11:03.242422+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:05.198823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":794486,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":1001,"num_read_kb":703,"num_write":416,"num_write_kb":2353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":26947,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2617344,"data_stored":2383458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":306,"ondisk_log_size":306,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645348,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":892928,"data_stored":437435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874280,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":33188,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93711964,"statfs":{"total":95995035648,"available":95961051136,"internally_reserved":0,"allocated":1929216,"data_stored":1424948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037806,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32456,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712696,"statfs":{"total":95995035648,"available":95961800704,"internally_reserved":0,"allocated":1302528,"data_stored":830887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266738,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36616,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708536,"statfs":{"total":95995035648,"available":95957540864,"internally_reserved":0,"allocated":1302528,"data_stored":830807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495671,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32656,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712496,"statfs":{"total":95995035648,"available":95961595904,"internally_reserved":0,"allocated":1503232,"data_stored":1032078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659197,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":897024,"data_stored":437060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888129,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32988,"kb_used_data":1804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712164,"statfs":{"total":95995035648,"available":95961255936,"internally_reserved":0,"allocated":1847296,"data_stored":1358674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018950,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":978944,"data_stored":505297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247883,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32592,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712560,"statfs":{"total":95995035648,"available":95961661440,"internally_reserved":0,"allocated":1441792,"data_stored":962187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444112,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":439831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607637,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":966656,"data_stored":503333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":917504,"data_stored":438331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":741376,"data_stored":721732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":360448,"data_stored":331336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":4740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":393954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":397610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T07:11:16.811 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T07:11:17.059 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:11:17.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:17 smithi165 ceph-mon[35326]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 83 KiB/s wr, 49 op/s 2024-09-19T07:11:17.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:17 smithi165 ceph-mon[35326]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:11:17.498 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:17 smithi148 ceph-mon[31180]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 83 KiB/s wr, 49 op/s 2024-09-19T07:11:17.498 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:17 smithi148 ceph-mon[31180]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:11:17.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:17 smithi179 ceph-mon[35716]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 83 KiB/s wr, 49 op/s 2024-09-19T07:11:17.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:17 smithi179 ceph-mon[35716]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:11:17.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.575+0000 7f9b2c169640 1 -- 172.21.15.148:0/2889577468 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b24106f10 msgr2=0x7f9b2410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:17.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.575+0000 7f9b2c169640 1 --2- 172.21.15.148:0/2889577468 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b24106f10 0x7f9b2410ea90 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c009ca0 tx=0x7f9b1c02a8c0 comp rx=0 tx=0).stop 2024-09-19T07:11:17.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.575+0000 7f9b2c169640 1 -- 172.21.15.148:0/2889577468 shutdown_connections 2024-09-19T07:11:17.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.575+0000 7f9b2c169640 1 --2- 172.21.15.148:0/2889577468 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b24106f10 0x7f9b2410ea90 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:17.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.575+0000 7f9b2c169640 1 --2- 172.21.15.148:0/2889577468 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b24102790 0x7f9b241067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:17.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.575+0000 7f9b2c169640 1 --2- 172.21.15.148:0/2889577468 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9b24101de0 0x7f9b241021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:17.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.575+0000 7f9b2c169640 1 -- 172.21.15.148:0/2889577468 >> 172.21.15.148:0/2889577468 conn(0x7f9b240fd8c0 msgr2=0x7f9b240ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:17.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.576+0000 7f9b2c169640 1 -- 172.21.15.148:0/2889577468 shutdown_connections 2024-09-19T07:11:17.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.576+0000 7f9b2c169640 1 -- 172.21.15.148:0/2889577468 wait complete. 2024-09-19T07:11:17.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.576+0000 7f9b2c169640 1 Processor -- start 2024-09-19T07:11:17.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.576+0000 7f9b2c169640 1 -- start start 2024-09-19T07:11:17.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.576+0000 7f9b2c169640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b24101de0 0x7f9b240744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:17.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.576+0000 7f9b2c169640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9b24102790 0x7f9b24074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:17.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.576+0000 7f9b2c169640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b24106f10 0x7f9b24074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:17.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.576+0000 7f9b2c169640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9b24111f70 con 0x7f9b24101de0 2024-09-19T07:11:17.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.576+0000 7f9b2c169640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9b24111df0 con 0x7f9b24102790 2024-09-19T07:11:17.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.576+0000 7f9b2c169640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9b241120f0 con 0x7f9b24106f10 2024-09-19T07:11:17.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.576+0000 7f9b29f05640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b24101de0 0x7f9b240744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:17.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.576+0000 7f9b29f05640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b24101de0 0x7f9b240744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51344/0 (socket says 172.21.15.148:51344) 2024-09-19T07:11:17.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.576+0000 7f9b29f05640 1 -- 172.21.15.148:0/915710778 learned_addr learned my addr 172.21.15.148:0/915710778 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:17.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.577+0000 7f9b29704640 1 --2- 172.21.15.148:0/915710778 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9b24102790 0x7f9b24074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:17.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.577+0000 7f9b29f05640 1 -- 172.21.15.148:0/915710778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b24106f10 msgr2=0x7f9b24074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:17.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.577+0000 7f9b2a706640 1 --2- 172.21.15.148:0/915710778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b24106f10 0x7f9b24074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:17.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.577+0000 7f9b29f05640 1 --2- 172.21.15.148:0/915710778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b24106f10 0x7f9b24074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:17.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.577+0000 7f9b29f05640 1 -- 172.21.15.148:0/915710778 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9b24102790 msgr2=0x7f9b24074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:17.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.577+0000 7f9b29f05640 1 --2- 172.21.15.148:0/915710778 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9b24102790 0x7f9b24074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:17.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.577+0000 7f9b29f05640 1 -- 172.21.15.148:0/915710778 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b241a67f0 con 0x7f9b24101de0 2024-09-19T07:11:17.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.577+0000 7f9b29704640 1 --2- 172.21.15.148:0/915710778 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9b24102790 0x7f9b24074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:11:17.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.577+0000 7f9b2a706640 1 --2- 172.21.15.148:0/915710778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b24106f10 0x7f9b24074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:11:17.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.577+0000 7f9b29f05640 1 --2- 172.21.15.148:0/915710778 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b24101de0 0x7f9b240744f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9b2000c920 tx=0x7f9b2000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:17.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.577+0000 7f9b1affd640 1 -- 172.21.15.148:0/915710778 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b20007c70 con 0x7f9b24101de0 2024-09-19T07:11:17.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.577+0000 7f9b2c169640 1 -- 172.21.15.148:0/915710778 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b241a6ae0 con 0x7f9b24101de0 2024-09-19T07:11:17.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.577+0000 7f9b1affd640 1 -- 172.21.15.148:0/915710778 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b20007e10 con 0x7f9b24101de0 2024-09-19T07:11:17.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.577+0000 7f9b1affd640 1 -- 172.21.15.148:0/915710778 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b20018890 con 0x7f9b24101de0 2024-09-19T07:11:17.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.577+0000 7f9b2c169640 1 -- 172.21.15.148:0/915710778 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b241a7070 con 0x7f9b24101de0 2024-09-19T07:11:17.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.578+0000 7f9b2c169640 1 -- 172.21.15.148:0/915710778 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b241021c0 con 0x7f9b24101de0 2024-09-19T07:11:17.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.579+0000 7f9b1affd640 1 -- 172.21.15.148:0/915710778 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f9b20018a70 con 0x7f9b24101de0 2024-09-19T07:11:17.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.580+0000 7f9b1affd640 1 --2- 172.21.15.148:0/915710778 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f9b100a3440 0x7f9b100a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:17.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.580+0000 7f9b29704640 1 --2- 172.21.15.148:0/915710778 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f9b100a3440 0x7f9b100a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:17.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.580+0000 7f9b1affd640 1 -- 172.21.15.148:0/915710778 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f9b200d00b0 con 0x7f9b24101de0 2024-09-19T07:11:17.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.580+0000 7f9b29704640 1 --2- 172.21.15.148:0/915710778 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f9b100a3440 0x7f9b100a5900 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9b24075f80 tx=0x7f9b14005cb0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:17.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.584+0000 7f9b1affd640 1 -- 172.21.15.148:0/915710778 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9b20014030 con 0x7f9b24101de0 2024-09-19T07:11:17.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.749+0000 7f9b2c169640 1 -- 172.21.15.148:0/915710778 --> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9b2410a160 con 0x7f9b100a3440 2024-09-19T07:11:17.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.756+0000 7f9b1affd640 1 -- 172.21.15.148:0/915710778 <== mgr.15123 v2:172.21.15.148:6800/3902535850 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257762 (secure 0 0 0) 0x7f9b1400d990 con 0x7f9b100a3440 2024-09-19T07:11:17.759 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:11:17.760 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2024-09-19T07:11:17.762 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.760+0000 7f9b2c169640 1 -- 172.21.15.148:0/915710778 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f9b100a3440 msgr2=0x7f9b100a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:17.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.760+0000 7f9b2c169640 1 --2- 172.21.15.148:0/915710778 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f9b100a3440 0x7f9b100a5900 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9b24075f80 tx=0x7f9b14005cb0 comp rx=0 tx=0).stop 2024-09-19T07:11:17.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.760+0000 7f9b2c169640 1 -- 172.21.15.148:0/915710778 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b24101de0 msgr2=0x7f9b240744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:17.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.760+0000 7f9b2c169640 1 --2- 172.21.15.148:0/915710778 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b24101de0 0x7f9b240744f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9b2000c920 tx=0x7f9b2000cde0 comp rx=0 tx=0).stop 2024-09-19T07:11:17.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.760+0000 7f9b2c169640 1 -- 172.21.15.148:0/915710778 shutdown_connections 2024-09-19T07:11:17.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.760+0000 7f9b2c169640 1 --2- 172.21.15.148:0/915710778 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f9b100a3440 0x7f9b100a5900 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:17.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.760+0000 7f9b2c169640 1 --2- 172.21.15.148:0/915710778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b24106f10 0x7f9b24074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:17.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.760+0000 7f9b2c169640 1 --2- 172.21.15.148:0/915710778 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9b24102790 0x7f9b24074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:17.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.760+0000 7f9b2c169640 1 --2- 172.21.15.148:0/915710778 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b24101de0 0x7f9b240744f0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:17.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.760+0000 7f9b2c169640 1 -- 172.21.15.148:0/915710778 >> 172.21.15.148:0/915710778 conn(0x7f9b240fd8c0 msgr2=0x7f9b240febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:17.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.760+0000 7f9b2c169640 1 -- 172.21.15.148:0/915710778 shutdown_connections 2024-09-19T07:11:17.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:17.760+0000 7f9b2c169640 1 -- 172.21.15.148:0/915710778 wait complete. 2024-09-19T07:11:18.447 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2024-09-19T07:11:17.251114+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1385088,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":1238,"num_read_kb":1033,"num_write":619,"num_write_kb":5293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1207683,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":956,"ondisk_log_size":956,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":388896,"kb_used_data":14544,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124552928,"statfs":{"total":1151940427776,"available":1151542198272,"internally_reserved":0,"allocated":14893056,"data_stored":9200868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":382973242},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":196632,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":406,"num_read_kb":464,"num_write":142,"num_write_kb":914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002786"},"pg_stats":[{"pgid":"3.3f","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.279425+0000","last_change":"2024-09-19T07:09:18.926902+0000","last_active":"2024-09-19T07:11:03.279425+0000","last_peered":"2024-09-19T07:11:03.279425+0000","last_clean":"2024-09-19T07:11:03.279425+0000","last_became_active":"2024-09-19T07:09:18.926582+0000","last_became_peered":"2024-09-19T07:09:18.926582+0000","last_unstale":"2024-09-19T07:11:03.279425+0000","last_undegraded":"2024-09-19T07:11:03.279425+0000","last_fullsized":"2024-09-19T07:11:03.279425+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:37.875779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.283851+0000","last_change":"2024-09-19T07:09:18.934205+0000","last_active":"2024-09-19T07:11:03.283851+0000","last_peered":"2024-09-19T07:11:03.283851+0000","last_clean":"2024-09-19T07:11:03.283851+0000","last_became_active":"2024-09-19T07:09:18.933767+0000","last_became_peered":"2024-09-19T07:09:18.933767+0000","last_unstale":"2024-09-19T07:11:03.283851+0000","last_undegraded":"2024-09-19T07:11:03.283851+0000","last_fullsized":"2024-09-19T07:11:03.283851+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:10:45.391428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.284092+0000","last_change":"2024-09-19T07:09:18.922312+0000","last_active":"2024-09-19T07:11:03.284092+0000","last_peered":"2024-09-19T07:11:03.284092+0000","last_clean":"2024-09-19T07:11:03.284092+0000","last_became_active":"2024-09-19T07:09:18.921476+0000","last_became_peered":"2024-09-19T07:09:18.921476+0000","last_unstale":"2024-09-19T07:11:03.284092+0000","last_undegraded":"2024-09-19T07:11:03.284092+0000","last_fullsized":"2024-09-19T07:11:03.284092+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:29.470616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.269605+0000","last_change":"2024-09-19T07:09:18.938218+0000","last_active":"2024-09-19T07:11:03.269605+0000","last_peered":"2024-09-19T07:11:03.269605+0000","last_clean":"2024-09-19T07:11:03.269605+0000","last_became_active":"2024-09-19T07:09:18.937306+0000","last_became_peered":"2024-09-19T07:09:18.937306+0000","last_unstale":"2024-09-19T07:11:03.269605+0000","last_undegraded":"2024-09-19T07:11:03.269605+0000","last_fullsized":"2024-09-19T07:11:03.269605+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:54.146506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.274574+0000","last_change":"2024-09-19T07:09:18.925837+0000","last_active":"2024-09-19T07:11:03.274574+0000","last_peered":"2024-09-19T07:11:03.274574+0000","last_clean":"2024-09-19T07:11:03.274574+0000","last_became_active":"2024-09-19T07:09:18.925559+0000","last_became_peered":"2024-09-19T07:09:18.925559+0000","last_unstale":"2024-09-19T07:11:03.274574+0000","last_undegraded":"2024-09-19T07:11:03.274574+0000","last_fullsized":"2024-09-19T07:11:03.274574+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:15:58.348347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.267010+0000","last_change":"2024-09-19T07:09:18.938911+0000","last_active":"2024-09-19T07:11:03.267010+0000","last_peered":"2024-09-19T07:11:03.267010+0000","last_clean":"2024-09-19T07:11:03.267010+0000","last_became_active":"2024-09-19T07:09:18.938601+0000","last_became_peered":"2024-09-19T07:09:18.938601+0000","last_unstale":"2024-09-19T07:11:03.267010+0000","last_undegraded":"2024-09-19T07:11:03.267010+0000","last_fullsized":"2024-09-19T07:11:03.267010+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:34.517324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.274002+0000","last_change":"2024-09-19T07:09:18.930253+0000","last_active":"2024-09-19T07:11:03.274002+0000","last_peered":"2024-09-19T07:11:03.274002+0000","last_clean":"2024-09-19T07:11:03.274002+0000","last_became_active":"2024-09-19T07:09:18.929927+0000","last_became_peered":"2024-09-19T07:09:18.929927+0000","last_unstale":"2024-09-19T07:11:03.274002+0000","last_undegraded":"2024-09-19T07:11:03.274002+0000","last_fullsized":"2024-09-19T07:11:03.274002+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:31:39.186230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"81'9","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.269452+0000","last_change":"2024-09-19T07:09:38.180197+0000","last_active":"2024-09-19T07:11:03.269452+0000","last_peered":"2024-09-19T07:11:03.269452+0000","last_clean":"2024-09-19T07:11:03.269452+0000","last_became_active":"2024-09-19T07:09:38.179767+0000","last_became_peered":"2024-09-19T07:09:38.179767+0000","last_unstale":"2024-09-19T07:11:03.269452+0000","last_undegraded":"2024-09-19T07:11:03.269452+0000","last_fullsized":"2024-09-19T07:11:03.269452+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:43.581181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.275716+0000","last_change":"2024-09-19T07:09:18.937100+0000","last_active":"2024-09-19T07:11:03.275716+0000","last_peered":"2024-09-19T07:11:03.275716+0000","last_clean":"2024-09-19T07:11:03.275716+0000","last_became_active":"2024-09-19T07:09:18.935151+0000","last_became_peered":"2024-09-19T07:09:18.935151+0000","last_unstale":"2024-09-19T07:11:03.275716+0000","last_undegraded":"2024-09-19T07:11:03.275716+0000","last_fullsized":"2024-09-19T07:11:03.275716+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:46:30.950667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.273140+0000","last_change":"2024-09-19T07:09:18.940119+0000","last_active":"2024-09-19T07:11:03.273140+0000","last_peered":"2024-09-19T07:11:03.273140+0000","last_clean":"2024-09-19T07:11:03.273140+0000","last_became_active":"2024-09-19T07:09:18.939703+0000","last_became_peered":"2024-09-19T07:09:18.939703+0000","last_unstale":"2024-09-19T07:11:03.273140+0000","last_undegraded":"2024-09-19T07:11:03.273140+0000","last_fullsized":"2024-09-19T07:11:03.273140+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:51:04.982727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.276689+0000","last_change":"2024-09-19T07:09:18.939146+0000","last_active":"2024-09-19T07:11:03.276689+0000","last_peered":"2024-09-19T07:11:03.276689+0000","last_clean":"2024-09-19T07:11:03.276689+0000","last_became_active":"2024-09-19T07:09:18.936842+0000","last_became_peered":"2024-09-19T07:09:18.936842+0000","last_unstale":"2024-09-19T07:11:03.276689+0000","last_undegraded":"2024-09-19T07:11:03.276689+0000","last_fullsized":"2024-09-19T07:11:03.276689+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:32.713505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.265688+0000","last_change":"2024-09-19T07:09:38.178834+0000","last_active":"2024-09-19T07:11:03.265688+0000","last_peered":"2024-09-19T07:11:03.265688+0000","last_clean":"2024-09-19T07:11:03.265688+0000","last_became_active":"2024-09-19T07:09:38.178477+0000","last_became_peered":"2024-09-19T07:09:38.178477+0000","last_unstale":"2024-09-19T07:11:03.265688+0000","last_undegraded":"2024-09-19T07:11:03.265688+0000","last_fullsized":"2024-09-19T07:11:03.265688+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:04:44.524920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.285948+0000","last_change":"2024-09-19T07:09:18.935422+0000","last_active":"2024-09-19T07:11:03.285948+0000","last_peered":"2024-09-19T07:11:03.285948+0000","last_clean":"2024-09-19T07:11:03.285948+0000","last_became_active":"2024-09-19T07:09:18.934994+0000","last_became_peered":"2024-09-19T07:09:18.934994+0000","last_unstale":"2024-09-19T07:11:03.285948+0000","last_undegraded":"2024-09-19T07:11:03.285948+0000","last_fullsized":"2024-09-19T07:11:03.285948+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:37:30.751247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.283787+0000","last_change":"2024-09-19T07:09:18.933954+0000","last_active":"2024-09-19T07:11:03.283787+0000","last_peered":"2024-09-19T07:11:03.283787+0000","last_clean":"2024-09-19T07:11:03.283787+0000","last_became_active":"2024-09-19T07:09:18.933588+0000","last_became_peered":"2024-09-19T07:09:18.933588+0000","last_unstale":"2024-09-19T07:11:03.283787+0000","last_undegraded":"2024-09-19T07:11:03.283787+0000","last_fullsized":"2024-09-19T07:11:03.283787+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:10.161172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.283035+0000","last_change":"2024-09-19T07:09:18.932122+0000","last_active":"2024-09-19T07:11:03.283035+0000","last_peered":"2024-09-19T07:11:03.283035+0000","last_clean":"2024-09-19T07:11:03.283035+0000","last_became_active":"2024-09-19T07:09:18.931798+0000","last_became_peered":"2024-09-19T07:09:18.931798+0000","last_unstale":"2024-09-19T07:11:03.283035+0000","last_undegraded":"2024-09-19T07:11:03.283035+0000","last_fullsized":"2024-09-19T07:11:03.283035+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:44.776375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.261952+0000","last_change":"2024-09-19T07:09:18.935632+0000","last_active":"2024-09-19T07:11:03.261952+0000","last_peered":"2024-09-19T07:11:03.261952+0000","last_clean":"2024-09-19T07:11:03.261952+0000","last_became_active":"2024-09-19T07:09:18.935174+0000","last_became_peered":"2024-09-19T07:09:18.935174+0000","last_unstale":"2024-09-19T07:11:03.261952+0000","last_undegraded":"2024-09-19T07:11:03.261952+0000","last_fullsized":"2024-09-19T07:11:03.261952+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:22.170777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.279662+0000","last_change":"2024-09-19T07:09:18.931836+0000","last_active":"2024-09-19T07:11:03.279662+0000","last_peered":"2024-09-19T07:11:03.279662+0000","last_clean":"2024-09-19T07:11:03.279662+0000","last_became_active":"2024-09-19T07:09:18.931564+0000","last_became_peered":"2024-09-19T07:09:18.931564+0000","last_unstale":"2024-09-19T07:11:03.279662+0000","last_undegraded":"2024-09-19T07:11:03.279662+0000","last_fullsized":"2024-09-19T07:11:03.279662+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:53.674584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.263261+0000","last_change":"2024-09-19T07:09:18.933210+0000","last_active":"2024-09-19T07:11:03.263261+0000","last_peered":"2024-09-19T07:11:03.263261+0000","last_clean":"2024-09-19T07:11:03.263261+0000","last_became_active":"2024-09-19T07:09:18.932894+0000","last_became_peered":"2024-09-19T07:09:18.932894+0000","last_unstale":"2024-09-19T07:11:03.263261+0000","last_undegraded":"2024-09-19T07:11:03.263261+0000","last_fullsized":"2024-09-19T07:11:03.263261+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:50:56.669801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.281347+0000","last_change":"2024-09-19T07:09:18.925627+0000","last_active":"2024-09-19T07:11:03.281347+0000","last_peered":"2024-09-19T07:11:03.281347+0000","last_clean":"2024-09-19T07:11:03.281347+0000","last_became_active":"2024-09-19T07:09:18.925340+0000","last_became_peered":"2024-09-19T07:09:18.925340+0000","last_unstale":"2024-09-19T07:11:03.281347+0000","last_undegraded":"2024-09-19T07:11:03.281347+0000","last_fullsized":"2024-09-19T07:11:03.281347+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:29.544534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.275601+0000","last_change":"2024-09-19T07:09:18.936963+0000","last_active":"2024-09-19T07:11:03.275601+0000","last_peered":"2024-09-19T07:11:03.275601+0000","last_clean":"2024-09-19T07:11:03.275601+0000","last_became_active":"2024-09-19T07:09:18.936615+0000","last_became_peered":"2024-09-19T07:09:18.936615+0000","last_unstale":"2024-09-19T07:11:03.275601+0000","last_undegraded":"2024-09-19T07:11:03.275601+0000","last_fullsized":"2024-09-19T07:11:03.275601+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:13.036392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.285146+0000","last_change":"2024-09-19T07:09:18.932018+0000","last_active":"2024-09-19T07:11:03.285146+0000","last_peered":"2024-09-19T07:11:03.285146+0000","last_clean":"2024-09-19T07:11:03.285146+0000","last_became_active":"2024-09-19T07:09:18.931624+0000","last_became_peered":"2024-09-19T07:09:18.931624+0000","last_unstale":"2024-09-19T07:11:03.285146+0000","last_undegraded":"2024-09-19T07:11:03.285146+0000","last_fullsized":"2024-09-19T07:11:03.285146+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:53:05.585166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.265530+0000","last_change":"2024-09-19T07:09:18.935474+0000","last_active":"2024-09-19T07:11:03.265530+0000","last_peered":"2024-09-19T07:11:03.265530+0000","last_clean":"2024-09-19T07:11:03.265530+0000","last_became_active":"2024-09-19T07:09:18.929018+0000","last_became_peered":"2024-09-19T07:09:18.929018+0000","last_unstale":"2024-09-19T07:11:03.265530+0000","last_undegraded":"2024-09-19T07:11:03.265530+0000","last_fullsized":"2024-09-19T07:11:03.265530+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:01.383024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.276949+0000","last_change":"2024-09-19T07:09:18.928733+0000","last_active":"2024-09-19T07:11:03.276949+0000","last_peered":"2024-09-19T07:11:03.276949+0000","last_clean":"2024-09-19T07:11:03.276949+0000","last_became_active":"2024-09-19T07:09:18.928431+0000","last_became_peered":"2024-09-19T07:09:18.928431+0000","last_unstale":"2024-09-19T07:11:03.276949+0000","last_undegraded":"2024-09-19T07:11:03.276949+0000","last_fullsized":"2024-09-19T07:11:03.276949+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:37.313958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.268113+0000","last_change":"2024-09-19T07:09:18.921268+0000","last_active":"2024-09-19T07:11:03.268113+0000","last_peered":"2024-09-19T07:11:03.268113+0000","last_clean":"2024-09-19T07:11:03.268113+0000","last_became_active":"2024-09-19T07:09:18.920482+0000","last_became_peered":"2024-09-19T07:09:18.920482+0000","last_unstale":"2024-09-19T07:11:03.268113+0000","last_undegraded":"2024-09-19T07:11:03.268113+0000","last_fullsized":"2024-09-19T07:11:03.268113+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:35.201826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"81'2","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.269267+0000","last_change":"2024-09-19T07:09:38.179136+0000","last_active":"2024-09-19T07:11:03.269267+0000","last_peered":"2024-09-19T07:11:03.269267+0000","last_clean":"2024-09-19T07:11:03.269267+0000","last_became_active":"2024-09-19T07:09:38.178746+0000","last_became_peered":"2024-09-19T07:09:38.178746+0000","last_unstale":"2024-09-19T07:11:03.269267+0000","last_undegraded":"2024-09-19T07:11:03.269267+0000","last_fullsized":"2024-09-19T07:11:03.269267+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:03.788114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.280523+0000","last_change":"2024-09-19T07:09:18.924099+0000","last_active":"2024-09-19T07:11:03.280523+0000","last_peered":"2024-09-19T07:11:03.280523+0000","last_clean":"2024-09-19T07:11:03.280523+0000","last_became_active":"2024-09-19T07:09:18.923772+0000","last_became_peered":"2024-09-19T07:09:18.923772+0000","last_unstale":"2024-09-19T07:11:03.280523+0000","last_undegraded":"2024-09-19T07:11:03.280523+0000","last_fullsized":"2024-09-19T07:11:03.280523+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:05:04.954087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.271340+0000","last_change":"2024-09-19T07:09:18.923391+0000","last_active":"2024-09-19T07:11:03.271340+0000","last_peered":"2024-09-19T07:11:03.271340+0000","last_clean":"2024-09-19T07:11:03.271340+0000","last_became_active":"2024-09-19T07:09:18.923085+0000","last_became_peered":"2024-09-19T07:09:18.923085+0000","last_unstale":"2024-09-19T07:11:03.271340+0000","last_undegraded":"2024-09-19T07:11:03.271340+0000","last_fullsized":"2024-09-19T07:11:03.271340+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:43:27.032400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.283075+0000","last_change":"2024-09-19T07:09:18.937188+0000","last_active":"2024-09-19T07:11:03.283075+0000","last_peered":"2024-09-19T07:11:03.283075+0000","last_clean":"2024-09-19T07:11:03.283075+0000","last_became_active":"2024-09-19T07:09:18.936866+0000","last_became_peered":"2024-09-19T07:09:18.936866+0000","last_unstale":"2024-09-19T07:11:03.283075+0000","last_undegraded":"2024-09-19T07:11:03.283075+0000","last_fullsized":"2024-09-19T07:11:03.283075+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:29:08.835307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.284272+0000","last_change":"2024-09-19T07:09:18.935170+0000","last_active":"2024-09-19T07:11:03.284272+0000","last_peered":"2024-09-19T07:11:03.284272+0000","last_clean":"2024-09-19T07:11:03.284272+0000","last_became_active":"2024-09-19T07:09:18.934356+0000","last_became_peered":"2024-09-19T07:09:18.934356+0000","last_unstale":"2024-09-19T07:11:03.284272+0000","last_undegraded":"2024-09-19T07:11:03.284272+0000","last_fullsized":"2024-09-19T07:11:03.284272+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:53.567392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.285704+0000","last_change":"2024-09-19T07:09:18.922640+0000","last_active":"2024-09-19T07:11:03.285704+0000","last_peered":"2024-09-19T07:11:03.285704+0000","last_clean":"2024-09-19T07:11:03.285704+0000","last_became_active":"2024-09-19T07:09:18.922312+0000","last_became_peered":"2024-09-19T07:09:18.922312+0000","last_unstale":"2024-09-19T07:11:03.285704+0000","last_undegraded":"2024-09-19T07:11:03.285704+0000","last_fullsized":"2024-09-19T07:11:03.285704+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:50.868818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.280468+0000","last_change":"2024-09-19T07:09:18.934364+0000","last_active":"2024-09-19T07:11:03.280468+0000","last_peered":"2024-09-19T07:11:03.280468+0000","last_clean":"2024-09-19T07:11:03.280468+0000","last_became_active":"2024-09-19T07:09:18.933533+0000","last_became_peered":"2024-09-19T07:09:18.933533+0000","last_unstale":"2024-09-19T07:11:03.280468+0000","last_undegraded":"2024-09-19T07:11:03.280468+0000","last_fullsized":"2024-09-19T07:11:03.280468+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:54.175425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.274368+0000","last_change":"2024-09-19T07:09:18.927456+0000","last_active":"2024-09-19T07:11:03.274368+0000","last_peered":"2024-09-19T07:11:03.274368+0000","last_clean":"2024-09-19T07:11:03.274368+0000","last_became_active":"2024-09-19T07:09:18.927117+0000","last_became_peered":"2024-09-19T07:09:18.927117+0000","last_unstale":"2024-09-19T07:11:03.274368+0000","last_undegraded":"2024-09-19T07:11:03.274368+0000","last_fullsized":"2024-09-19T07:11:03.274368+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:08.885898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.271805+0000","last_change":"2024-09-19T07:09:18.926024+0000","last_active":"2024-09-19T07:11:03.271805+0000","last_peered":"2024-09-19T07:11:03.271805+0000","last_clean":"2024-09-19T07:11:03.271805+0000","last_became_active":"2024-09-19T07:09:18.925689+0000","last_became_peered":"2024-09-19T07:09:18.925689+0000","last_unstale":"2024-09-19T07:11:03.271805+0000","last_undegraded":"2024-09-19T07:11:03.271805+0000","last_fullsized":"2024-09-19T07:11:03.271805+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:09:08.178214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'10","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:13.142527+0000","last_change":"2024-09-19T07:09:16.915804+0000","last_active":"2024-09-19T07:11:13.142527+0000","last_peered":"2024-09-19T07:11:13.142527+0000","last_clean":"2024-09-19T07:11:13.142527+0000","last_became_active":"2024-09-19T07:09:16.915434+0000","last_became_peered":"2024-09-19T07:09:16.915434+0000","last_unstale":"2024-09-19T07:11:13.142527+0000","last_undegraded":"2024-09-19T07:11:13.142527+0000","last_fullsized":"2024-09-19T07:11:13.142527+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:57.230475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2250,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":5,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.271307+0000","last_change":"2024-09-19T07:09:18.932497+0000","last_active":"2024-09-19T07:11:03.271307+0000","last_peered":"2024-09-19T07:11:03.271307+0000","last_clean":"2024-09-19T07:11:03.271307+0000","last_became_active":"2024-09-19T07:09:18.932213+0000","last_became_peered":"2024-09-19T07:09:18.932213+0000","last_unstale":"2024-09-19T07:11:03.271307+0000","last_undegraded":"2024-09-19T07:11:03.271307+0000","last_fullsized":"2024-09-19T07:11:03.271307+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:10.299077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.233512+0000","last_change":"2024-09-19T07:09:16.910171+0000","last_active":"2024-09-19T07:11:03.233512+0000","last_peered":"2024-09-19T07:11:03.233512+0000","last_clean":"2024-09-19T07:11:03.233512+0000","last_became_active":"2024-09-19T07:09:16.909840+0000","last_became_peered":"2024-09-19T07:09:16.909840+0000","last_unstale":"2024-09-19T07:11:03.233512+0000","last_undegraded":"2024-09-19T07:11:03.233512+0000","last_fullsized":"2024-09-19T07:11:03.233512+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:35.448892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.229456+0000","last_change":"2024-09-19T07:09:16.911336+0000","last_active":"2024-09-19T07:11:03.229456+0000","last_peered":"2024-09-19T07:11:03.229456+0000","last_clean":"2024-09-19T07:11:03.229456+0000","last_became_active":"2024-09-19T07:09:16.911027+0000","last_became_peered":"2024-09-19T07:09:16.911027+0000","last_unstale":"2024-09-19T07:11:03.229456+0000","last_undegraded":"2024-09-19T07:11:03.229456+0000","last_fullsized":"2024-09-19T07:11:03.229456+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:37:50.698597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.278229+0000","last_change":"2024-09-19T07:09:18.927713+0000","last_active":"2024-09-19T07:11:03.278229+0000","last_peered":"2024-09-19T07:11:03.278229+0000","last_clean":"2024-09-19T07:11:03.278229+0000","last_became_active":"2024-09-19T07:09:18.927430+0000","last_became_peered":"2024-09-19T07:09:18.927430+0000","last_unstale":"2024-09-19T07:11:03.278229+0000","last_undegraded":"2024-09-19T07:11:03.278229+0000","last_fullsized":"2024-09-19T07:11:03.278229+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:15:07.707723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.236756+0000","last_change":"2024-09-19T07:09:16.912391+0000","last_active":"2024-09-19T07:11:03.236756+0000","last_peered":"2024-09-19T07:11:03.236756+0000","last_clean":"2024-09-19T07:11:03.236756+0000","last_became_active":"2024-09-19T07:09:16.912034+0000","last_became_peered":"2024-09-19T07:09:16.912034+0000","last_unstale":"2024-09-19T07:11:03.236756+0000","last_undegraded":"2024-09-19T07:11:03.236756+0000","last_fullsized":"2024-09-19T07:11:03.236756+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:18:45.226107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.269888+0000","last_change":"2024-09-19T07:09:18.929476+0000","last_active":"2024-09-19T07:11:03.269888+0000","last_peered":"2024-09-19T07:11:03.269888+0000","last_clean":"2024-09-19T07:11:03.269888+0000","last_became_active":"2024-09-19T07:09:18.929183+0000","last_became_peered":"2024-09-19T07:09:18.929183+0000","last_unstale":"2024-09-19T07:11:03.269888+0000","last_undegraded":"2024-09-19T07:11:03.269888+0000","last_fullsized":"2024-09-19T07:11:03.269888+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:19:38.827130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:13.141960+0000","last_change":"2024-09-19T07:09:16.913012+0000","last_active":"2024-09-19T07:11:13.141960+0000","last_peered":"2024-09-19T07:11:13.141960+0000","last_clean":"2024-09-19T07:11:13.141960+0000","last_became_active":"2024-09-19T07:09:16.912633+0000","last_became_peered":"2024-09-19T07:09:16.912633+0000","last_unstale":"2024-09-19T07:11:13.141960+0000","last_undegraded":"2024-09-19T07:11:13.141960+0000","last_fullsized":"2024-09-19T07:11:13.141960+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:21:39.669961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.262229+0000","last_change":"2024-09-19T07:09:18.937323+0000","last_active":"2024-09-19T07:11:03.262229+0000","last_peered":"2024-09-19T07:11:03.262229+0000","last_clean":"2024-09-19T07:11:03.262229+0000","last_became_active":"2024-09-19T07:09:18.936762+0000","last_became_peered":"2024-09-19T07:09:18.936762+0000","last_unstale":"2024-09-19T07:11:03.262229+0000","last_undegraded":"2024-09-19T07:11:03.262229+0000","last_fullsized":"2024-09-19T07:11:03.262229+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:37.692290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.234308+0000","last_change":"2024-09-19T07:09:16.912167+0000","last_active":"2024-09-19T07:11:03.234308+0000","last_peered":"2024-09-19T07:11:03.234308+0000","last_clean":"2024-09-19T07:11:03.234308+0000","last_became_active":"2024-09-19T07:09:16.911840+0000","last_became_peered":"2024-09-19T07:09:16.911840+0000","last_unstale":"2024-09-19T07:11:03.234308+0000","last_undegraded":"2024-09-19T07:11:03.234308+0000","last_fullsized":"2024-09-19T07:11:03.234308+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:31.901906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.283235+0000","last_change":"2024-09-19T07:09:18.932239+0000","last_active":"2024-09-19T07:11:03.283235+0000","last_peered":"2024-09-19T07:11:03.283235+0000","last_clean":"2024-09-19T07:11:03.283235+0000","last_became_active":"2024-09-19T07:09:18.931820+0000","last_became_peered":"2024-09-19T07:09:18.931820+0000","last_unstale":"2024-09-19T07:11:03.283235+0000","last_undegraded":"2024-09-19T07:11:03.283235+0000","last_fullsized":"2024-09-19T07:11:03.283235+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:09.407524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.236809+0000","last_change":"2024-09-19T07:09:17.085077+0000","last_active":"2024-09-19T07:11:03.236809+0000","last_peered":"2024-09-19T07:11:03.236809+0000","last_clean":"2024-09-19T07:11:03.236809+0000","last_became_active":"2024-09-19T07:09:17.084457+0000","last_became_peered":"2024-09-19T07:09:17.084457+0000","last_unstale":"2024-09-19T07:11:03.236809+0000","last_undegraded":"2024-09-19T07:11:03.236809+0000","last_fullsized":"2024-09-19T07:11:03.236809+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:42.416193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.276315+0000","last_change":"2024-09-19T07:09:18.939830+0000","last_active":"2024-09-19T07:11:03.276315+0000","last_peered":"2024-09-19T07:11:03.276315+0000","last_clean":"2024-09-19T07:11:03.276315+0000","last_became_active":"2024-09-19T07:09:18.939359+0000","last_became_peered":"2024-09-19T07:09:18.939359+0000","last_unstale":"2024-09-19T07:11:03.276315+0000","last_undegraded":"2024-09-19T07:11:03.276315+0000","last_fullsized":"2024-09-19T07:11:03.276315+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:24:46.241902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'34","reported_seq":300,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:13.373459+0000","last_change":"2024-09-19T07:09:38.227707+0000","last_active":"2024-09-19T07:11:13.373459+0000","last_peered":"2024-09-19T07:11:13.373459+0000","last_clean":"2024-09-19T07:11:13.373459+0000","last_became_active":"2024-09-19T07:09:38.219073+0000","last_became_peered":"2024-09-19T07:09:38.219073+0000","last_unstale":"2024-09-19T07:11:13.373459+0000","last_undegraded":"2024-09-19T07:11:13.373459+0000","last_fullsized":"2024-09-19T07:11:13.373459+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:46.035315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66480,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":221,"num_read_kb":170,"num_write":35,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":26947,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.270480+0000","last_change":"2024-09-19T07:09:18.929531+0000","last_active":"2024-09-19T07:11:03.270480+0000","last_peered":"2024-09-19T07:11:03.270480+0000","last_clean":"2024-09-19T07:11:03.270480+0000","last_became_active":"2024-09-19T07:09:18.929253+0000","last_became_peered":"2024-09-19T07:09:18.929253+0000","last_unstale":"2024-09-19T07:11:03.270480+0000","last_undegraded":"2024-09-19T07:11:03.270480+0000","last_fullsized":"2024-09-19T07:11:03.270480+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:10.635116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.238624+0000","last_change":"2024-09-19T07:09:16.914964+0000","last_active":"2024-09-19T07:11:03.238624+0000","last_peered":"2024-09-19T07:11:03.238624+0000","last_clean":"2024-09-19T07:11:03.238624+0000","last_became_active":"2024-09-19T07:09:16.914540+0000","last_became_peered":"2024-09-19T07:09:16.914540+0000","last_unstale":"2024-09-19T07:11:03.238624+0000","last_undegraded":"2024-09-19T07:11:03.238624+0000","last_fullsized":"2024-09-19T07:11:03.238624+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:30.903046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.284691+0000","last_change":"2024-09-19T07:09:18.931709+0000","last_active":"2024-09-19T07:11:03.284691+0000","last_peered":"2024-09-19T07:11:03.284691+0000","last_clean":"2024-09-19T07:11:03.284691+0000","last_became_active":"2024-09-19T07:09:18.931345+0000","last_became_peered":"2024-09-19T07:09:18.931345+0000","last_unstale":"2024-09-19T07:11:03.284691+0000","last_undegraded":"2024-09-19T07:11:03.284691+0000","last_fullsized":"2024-09-19T07:11:03.284691+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:28.916820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.236617+0000","last_change":"2024-09-19T07:09:16.914055+0000","last_active":"2024-09-19T07:11:03.236617+0000","last_peered":"2024-09-19T07:11:03.236617+0000","last_clean":"2024-09-19T07:11:03.236617+0000","last_became_active":"2024-09-19T07:09:16.913589+0000","last_became_peered":"2024-09-19T07:09:16.913589+0000","last_unstale":"2024-09-19T07:11:03.236617+0000","last_undegraded":"2024-09-19T07:11:03.236617+0000","last_fullsized":"2024-09-19T07:11:03.236617+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:29:16.322059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"81'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.285962+0000","last_change":"2024-09-19T07:09:18.934879+0000","last_active":"2024-09-19T07:11:03.285962+0000","last_peered":"2024-09-19T07:11:03.285962+0000","last_clean":"2024-09-19T07:11:03.285962+0000","last_became_active":"2024-09-19T07:09:18.934432+0000","last_became_peered":"2024-09-19T07:09:18.934432+0000","last_unstale":"2024-09-19T07:11:03.285962+0000","last_undegraded":"2024-09-19T07:11:03.285962+0000","last_fullsized":"2024-09-19T07:11:03.285962+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:25.782782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'7","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:13.141564+0000","last_change":"2024-09-19T07:09:16.909256+0000","last_active":"2024-09-19T07:11:13.141564+0000","last_peered":"2024-09-19T07:11:13.141564+0000","last_clean":"2024-09-19T07:11:13.141564+0000","last_became_active":"2024-09-19T07:09:16.908932+0000","last_became_peered":"2024-09-19T07:09:16.908932+0000","last_unstale":"2024-09-19T07:11:13.141564+0000","last_undegraded":"2024-09-19T07:11:13.141564+0000","last_fullsized":"2024-09-19T07:11:13.141564+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:28.344756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1908,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":5,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.270197+0000","last_change":"2024-09-19T07:09:18.931844+0000","last_active":"2024-09-19T07:11:03.270197+0000","last_peered":"2024-09-19T07:11:03.270197+0000","last_clean":"2024-09-19T07:11:03.270197+0000","last_became_active":"2024-09-19T07:09:18.931516+0000","last_became_peered":"2024-09-19T07:09:18.931516+0000","last_unstale":"2024-09-19T07:11:03.270197+0000","last_undegraded":"2024-09-19T07:11:03.270197+0000","last_fullsized":"2024-09-19T07:11:03.270197+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:27:29.812144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.247165+0000","last_change":"2024-09-19T07:09:17.085252+0000","last_active":"2024-09-19T07:11:03.247165+0000","last_peered":"2024-09-19T07:11:03.247165+0000","last_clean":"2024-09-19T07:11:03.247165+0000","last_became_active":"2024-09-19T07:09:17.084907+0000","last_became_peered":"2024-09-19T07:09:17.084907+0000","last_unstale":"2024-09-19T07:11:03.247165+0000","last_undegraded":"2024-09-19T07:11:03.247165+0000","last_fullsized":"2024-09-19T07:11:03.247165+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:59:40.351181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.269674+0000","last_change":"2024-09-19T07:09:18.932491+0000","last_active":"2024-09-19T07:11:03.269674+0000","last_peered":"2024-09-19T07:11:03.269674+0000","last_clean":"2024-09-19T07:11:03.269674+0000","last_became_active":"2024-09-19T07:09:18.932159+0000","last_became_peered":"2024-09-19T07:09:18.932159+0000","last_unstale":"2024-09-19T07:11:03.269674+0000","last_undegraded":"2024-09-19T07:11:03.269674+0000","last_fullsized":"2024-09-19T07:11:03.269674+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:31.144130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'3","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.247568+0000","last_change":"2024-09-19T07:09:16.911012+0000","last_active":"2024-09-19T07:11:03.247568+0000","last_peered":"2024-09-19T07:11:03.247568+0000","last_clean":"2024-09-19T07:11:03.247568+0000","last_became_active":"2024-09-19T07:09:16.910618+0000","last_became_peered":"2024-09-19T07:09:16.910618+0000","last_unstale":"2024-09-19T07:11:03.247568+0000","last_undegraded":"2024-09-19T07:11:03.247568+0000","last_fullsized":"2024-09-19T07:11:03.247568+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:16.316680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"81'5","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.267441+0000","last_change":"2024-09-19T07:09:38.217870+0000","last_active":"2024-09-19T07:11:03.267441+0000","last_peered":"2024-09-19T07:11:03.267441+0000","last_clean":"2024-09-19T07:11:03.267441+0000","last_became_active":"2024-09-19T07:09:38.217585+0000","last_became_peered":"2024-09-19T07:09:38.217585+0000","last_unstale":"2024-09-19T07:11:03.267441+0000","last_undegraded":"2024-09-19T07:11:03.267441+0000","last_fullsized":"2024-09-19T07:11:03.267441+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:41.320705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.229695+0000","last_change":"2024-09-19T07:09:16.911644+0000","last_active":"2024-09-19T07:11:03.229695+0000","last_peered":"2024-09-19T07:11:03.229695+0000","last_clean":"2024-09-19T07:11:03.229695+0000","last_became_active":"2024-09-19T07:09:16.911368+0000","last_became_peered":"2024-09-19T07:09:16.911368+0000","last_unstale":"2024-09-19T07:11:03.229695+0000","last_undegraded":"2024-09-19T07:11:03.229695+0000","last_fullsized":"2024-09-19T07:11:03.229695+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:12.953466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.274357+0000","last_change":"2024-09-19T07:09:18.933667+0000","last_active":"2024-09-19T07:11:03.274357+0000","last_peered":"2024-09-19T07:11:03.274357+0000","last_clean":"2024-09-19T07:11:03.274357+0000","last_became_active":"2024-09-19T07:09:18.933288+0000","last_became_peered":"2024-09-19T07:09:18.933288+0000","last_unstale":"2024-09-19T07:11:03.274357+0000","last_undegraded":"2024-09-19T07:11:03.274357+0000","last_fullsized":"2024-09-19T07:11:03.274357+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:54:38.127799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'65","reported_seq":119,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:13.835505+0000","last_change":"2024-09-19T07:09:16.909722+0000","last_active":"2024-09-19T07:11:13.835505+0000","last_peered":"2024-09-19T07:11:13.835505+0000","last_clean":"2024-09-19T07:11:13.835505+0000","last_became_active":"2024-09-19T07:09:16.909394+0000","last_became_peered":"2024-09-19T07:09:16.909394+0000","last_unstale":"2024-09-19T07:11:13.835505+0000","last_undegraded":"2024-09-19T07:11:13.835505+0000","last_fullsized":"2024-09-19T07:11:13.835505+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:21:53.342710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":32,"num_write":76,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.269158+0000","last_change":"2024-09-19T07:09:18.929473+0000","last_active":"2024-09-19T07:11:03.269158+0000","last_peered":"2024-09-19T07:11:03.269158+0000","last_clean":"2024-09-19T07:11:03.269158+0000","last_became_active":"2024-09-19T07:09:18.929176+0000","last_became_peered":"2024-09-19T07:09:18.929176+0000","last_unstale":"2024-09-19T07:11:03.269158+0000","last_undegraded":"2024-09-19T07:11:03.269158+0000","last_fullsized":"2024-09-19T07:11:03.269158+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:32:30.409528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.238675+0000","last_change":"2024-09-19T07:09:17.084868+0000","last_active":"2024-09-19T07:11:03.238675+0000","last_peered":"2024-09-19T07:11:03.238675+0000","last_clean":"2024-09-19T07:11:03.238675+0000","last_became_active":"2024-09-19T07:09:17.084448+0000","last_became_peered":"2024-09-19T07:09:17.084448+0000","last_unstale":"2024-09-19T07:11:03.238675+0000","last_undegraded":"2024-09-19T07:11:03.238675+0000","last_fullsized":"2024-09-19T07:11:03.238675+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:38.211697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.276801+0000","last_change":"2024-09-19T07:09:18.938865+0000","last_active":"2024-09-19T07:11:03.276801+0000","last_peered":"2024-09-19T07:11:03.276801+0000","last_clean":"2024-09-19T07:11:03.276801+0000","last_became_active":"2024-09-19T07:09:18.936324+0000","last_became_peered":"2024-09-19T07:09:18.936324+0000","last_unstale":"2024-09-19T07:11:03.276801+0000","last_undegraded":"2024-09-19T07:11:03.276801+0000","last_fullsized":"2024-09-19T07:11:03.276801+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:29:51.081140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"81'148","reported_seq":389,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:05.365523+0000","last_change":"2024-09-19T07:08:09.270850+0000","last_active":"2024-09-19T07:11:05.365523+0000","last_peered":"2024-09-19T07:11:05.365523+0000","last_clean":"2024-09-19T07:11:05.365523+0000","last_became_active":"2024-09-19T07:08:09.270308+0000","last_became_peered":"2024-09-19T07:08:09.270308+0000","last_unstale":"2024-09-19T07:11:05.365523+0000","last_undegraded":"2024-09-19T07:11:05.365523+0000","last_fullsized":"2024-09-19T07:11:05.365523+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:04:49.729632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:04:49.729632+0000","last_clean_scrub_stamp":"2024-09-19T07:04:49.729632+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:15.588732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.231213+0000","last_change":"2024-09-19T07:09:16.907648+0000","last_active":"2024-09-19T07:11:03.231213+0000","last_peered":"2024-09-19T07:11:03.231213+0000","last_clean":"2024-09-19T07:11:03.231213+0000","last_became_active":"2024-09-19T07:09:16.907363+0000","last_became_peered":"2024-09-19T07:09:16.907363+0000","last_unstale":"2024-09-19T07:11:03.231213+0000","last_undegraded":"2024-09-19T07:11:03.231213+0000","last_fullsized":"2024-09-19T07:11:03.231213+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:12:27.898493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.275674+0000","last_change":"2024-09-19T07:09:18.926008+0000","last_active":"2024-09-19T07:11:03.275674+0000","last_peered":"2024-09-19T07:11:03.275674+0000","last_clean":"2024-09-19T07:11:03.275674+0000","last_became_active":"2024-09-19T07:09:18.925689+0000","last_became_peered":"2024-09-19T07:09:18.925689+0000","last_unstale":"2024-09-19T07:11:03.275674+0000","last_undegraded":"2024-09-19T07:11:03.275674+0000","last_fullsized":"2024-09-19T07:11:03.275674+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:16:06.467934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.233965+0000","last_change":"2024-09-19T07:09:16.911327+0000","last_active":"2024-09-19T07:11:03.233965+0000","last_peered":"2024-09-19T07:11:03.233965+0000","last_clean":"2024-09-19T07:11:03.233965+0000","last_became_active":"2024-09-19T07:09:16.911031+0000","last_became_peered":"2024-09-19T07:09:16.911031+0000","last_unstale":"2024-09-19T07:11:03.233965+0000","last_undegraded":"2024-09-19T07:11:03.233965+0000","last_fullsized":"2024-09-19T07:11:03.233965+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:03.307119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.280334+0000","last_change":"2024-09-19T07:09:18.933813+0000","last_active":"2024-09-19T07:11:03.280334+0000","last_peered":"2024-09-19T07:11:03.280334+0000","last_clean":"2024-09-19T07:11:03.280334+0000","last_became_active":"2024-09-19T07:09:18.933475+0000","last_became_peered":"2024-09-19T07:09:18.933475+0000","last_unstale":"2024-09-19T07:11:03.280334+0000","last_undegraded":"2024-09-19T07:11:03.280334+0000","last_fullsized":"2024-09-19T07:11:03.280334+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:34:09.149593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":135,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:13.141050+0000","last_change":"2024-09-19T07:09:17.084833+0000","last_active":"2024-09-19T07:11:13.141050+0000","last_peered":"2024-09-19T07:11:13.141050+0000","last_clean":"2024-09-19T07:11:13.141050+0000","last_became_active":"2024-09-19T07:09:17.084477+0000","last_became_peered":"2024-09-19T07:09:17.084477+0000","last_unstale":"2024-09-19T07:11:13.141050+0000","last_undegraded":"2024-09-19T07:11:13.141050+0000","last_fullsized":"2024-09-19T07:11:13.141050+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:17:50.962480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.281019+0000","last_change":"2024-09-19T07:09:18.935991+0000","last_active":"2024-09-19T07:11:03.281019+0000","last_peered":"2024-09-19T07:11:03.281019+0000","last_clean":"2024-09-19T07:11:03.281019+0000","last_became_active":"2024-09-19T07:09:18.935677+0000","last_became_peered":"2024-09-19T07:09:18.935677+0000","last_unstale":"2024-09-19T07:11:03.281019+0000","last_undegraded":"2024-09-19T07:11:03.281019+0000","last_fullsized":"2024-09-19T07:11:03.281019+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:45.550119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.234872+0000","last_change":"2024-09-19T07:09:16.911755+0000","last_active":"2024-09-19T07:11:03.234872+0000","last_peered":"2024-09-19T07:11:03.234872+0000","last_clean":"2024-09-19T07:11:03.234872+0000","last_became_active":"2024-09-19T07:09:16.911211+0000","last_became_peered":"2024-09-19T07:09:16.911211+0000","last_unstale":"2024-09-19T07:11:03.234872+0000","last_undegraded":"2024-09-19T07:11:03.234872+0000","last_fullsized":"2024-09-19T07:11:03.234872+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:15.365423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.265945+0000","last_change":"2024-09-19T07:09:18.940282+0000","last_active":"2024-09-19T07:11:03.265945+0000","last_peered":"2024-09-19T07:11:03.265945+0000","last_clean":"2024-09-19T07:11:03.265945+0000","last_became_active":"2024-09-19T07:09:18.939918+0000","last_became_peered":"2024-09-19T07:09:18.939918+0000","last_unstale":"2024-09-19T07:11:03.265945+0000","last_undegraded":"2024-09-19T07:11:03.265945+0000","last_fullsized":"2024-09-19T07:11:03.265945+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:11.161676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.242639+0000","last_change":"2024-09-19T07:09:17.086103+0000","last_active":"2024-09-19T07:11:03.242639+0000","last_peered":"2024-09-19T07:11:03.242639+0000","last_clean":"2024-09-19T07:11:03.242639+0000","last_became_active":"2024-09-19T07:09:17.085805+0000","last_became_peered":"2024-09-19T07:09:17.085805+0000","last_unstale":"2024-09-19T07:11:03.242639+0000","last_undegraded":"2024-09-19T07:11:03.242639+0000","last_fullsized":"2024-09-19T07:11:03.242639+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:28.522487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.284777+0000","last_change":"2024-09-19T07:09:18.932603+0000","last_active":"2024-09-19T07:11:03.284777+0000","last_peered":"2024-09-19T07:11:03.284777+0000","last_clean":"2024-09-19T07:11:03.284777+0000","last_became_active":"2024-09-19T07:09:18.932309+0000","last_became_peered":"2024-09-19T07:09:18.932309+0000","last_unstale":"2024-09-19T07:11:03.284777+0000","last_undegraded":"2024-09-19T07:11:03.284777+0000","last_fullsized":"2024-09-19T07:11:03.284777+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:19.746024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.245199+0000","last_change":"2024-09-19T07:09:17.085287+0000","last_active":"2024-09-19T07:11:03.245199+0000","last_peered":"2024-09-19T07:11:03.245199+0000","last_clean":"2024-09-19T07:11:03.245199+0000","last_became_active":"2024-09-19T07:09:17.084964+0000","last_became_peered":"2024-09-19T07:09:17.084964+0000","last_unstale":"2024-09-19T07:11:03.245199+0000","last_undegraded":"2024-09-19T07:11:03.245199+0000","last_fullsized":"2024-09-19T07:11:03.245199+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:51:01.035344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.287453+0000","last_change":"2024-09-19T07:09:18.921623+0000","last_active":"2024-09-19T07:11:03.287453+0000","last_peered":"2024-09-19T07:11:03.287453+0000","last_clean":"2024-09-19T07:11:03.287453+0000","last_became_active":"2024-09-19T07:09:18.921321+0000","last_became_peered":"2024-09-19T07:09:18.921321+0000","last_unstale":"2024-09-19T07:11:03.287453+0000","last_undegraded":"2024-09-19T07:11:03.287453+0000","last_fullsized":"2024-09-19T07:11:03.287453+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:28:55.616889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'98","reported_seq":211,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:14.173650+0000","last_change":"2024-09-19T07:09:16.910251+0000","last_active":"2024-09-19T07:11:14.173650+0000","last_peered":"2024-09-19T07:11:14.173650+0000","last_clean":"2024-09-19T07:11:14.173650+0000","last_became_active":"2024-09-19T07:09:16.909821+0000","last_became_peered":"2024-09-19T07:09:16.909821+0000","last_unstale":"2024-09-19T07:11:14.173650+0000","last_undegraded":"2024-09-19T07:11:14.173650+0000","last_fullsized":"2024-09-19T07:11:14.173650+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:02.958557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":302,"num_read_kb":268,"num_write":181,"num_write_kb":1287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.268601+0000","last_change":"2024-09-19T07:09:18.930831+0000","last_active":"2024-09-19T07:11:03.268601+0000","last_peered":"2024-09-19T07:11:03.268601+0000","last_clean":"2024-09-19T07:11:03.268601+0000","last_became_active":"2024-09-19T07:09:18.930475+0000","last_became_peered":"2024-09-19T07:09:18.930475+0000","last_unstale":"2024-09-19T07:11:03.268601+0000","last_undegraded":"2024-09-19T07:11:03.268601+0000","last_fullsized":"2024-09-19T07:11:03.268601+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:30.512246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.231362+0000","last_change":"2024-09-19T07:09:16.906666+0000","last_active":"2024-09-19T07:11:03.231362+0000","last_peered":"2024-09-19T07:11:03.231362+0000","last_clean":"2024-09-19T07:11:03.231362+0000","last_became_active":"2024-09-19T07:09:16.906369+0000","last_became_peered":"2024-09-19T07:09:16.906369+0000","last_unstale":"2024-09-19T07:11:03.231362+0000","last_undegraded":"2024-09-19T07:11:03.231362+0000","last_fullsized":"2024-09-19T07:11:03.231362+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:56.915089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.280797+0000","last_change":"2024-09-19T07:09:18.934942+0000","last_active":"2024-09-19T07:11:03.280797+0000","last_peered":"2024-09-19T07:11:03.280797+0000","last_clean":"2024-09-19T07:11:03.280797+0000","last_became_active":"2024-09-19T07:09:18.934595+0000","last_became_peered":"2024-09-19T07:09:18.934595+0000","last_unstale":"2024-09-19T07:11:03.280797+0000","last_undegraded":"2024-09-19T07:11:03.280797+0000","last_fullsized":"2024-09-19T07:11:03.280797+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:54.306541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.239116+0000","last_change":"2024-09-19T07:09:38.183567+0000","last_active":"2024-09-19T07:11:03.239116+0000","last_peered":"2024-09-19T07:11:03.239116+0000","last_clean":"2024-09-19T07:11:03.239116+0000","last_became_active":"2024-09-19T07:09:38.180778+0000","last_became_peered":"2024-09-19T07:09:38.180778+0000","last_unstale":"2024-09-19T07:11:03.239116+0000","last_undegraded":"2024-09-19T07:11:03.239116+0000","last_fullsized":"2024-09-19T07:11:03.239116+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:43.226551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"81'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.260607+0000","last_change":"2024-09-19T07:09:18.934457+0000","last_active":"2024-09-19T07:11:03.260607+0000","last_peered":"2024-09-19T07:11:03.260607+0000","last_clean":"2024-09-19T07:11:03.260607+0000","last_became_active":"2024-09-19T07:09:18.934126+0000","last_became_peered":"2024-09-19T07:09:18.934126+0000","last_unstale":"2024-09-19T07:11:03.260607+0000","last_undegraded":"2024-09-19T07:11:03.260607+0000","last_fullsized":"2024-09-19T07:11:03.260607+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:37:16.152335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.231606+0000","last_change":"2024-09-19T07:09:16.908457+0000","last_active":"2024-09-19T07:11:03.231606+0000","last_peered":"2024-09-19T07:11:03.231606+0000","last_clean":"2024-09-19T07:11:03.231606+0000","last_became_active":"2024-09-19T07:09:16.908128+0000","last_became_peered":"2024-09-19T07:09:16.908128+0000","last_unstale":"2024-09-19T07:11:03.231606+0000","last_undegraded":"2024-09-19T07:11:03.231606+0000","last_fullsized":"2024-09-19T07:11:03.231606+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:48:50.579301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.273932+0000","last_change":"2024-09-19T07:09:18.928763+0000","last_active":"2024-09-19T07:11:03.273932+0000","last_peered":"2024-09-19T07:11:03.273932+0000","last_clean":"2024-09-19T07:11:03.273932+0000","last_became_active":"2024-09-19T07:09:18.928231+0000","last_became_peered":"2024-09-19T07:09:18.928231+0000","last_unstale":"2024-09-19T07:11:03.273932+0000","last_undegraded":"2024-09-19T07:11:03.273932+0000","last_fullsized":"2024-09-19T07:11:03.273932+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:26.652378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.238773+0000","last_change":"2024-09-19T07:09:16.913740+0000","last_active":"2024-09-19T07:11:03.238773+0000","last_peered":"2024-09-19T07:11:03.238773+0000","last_clean":"2024-09-19T07:11:03.238773+0000","last_became_active":"2024-09-19T07:09:16.912419+0000","last_became_peered":"2024-09-19T07:09:16.912419+0000","last_unstale":"2024-09-19T07:11:03.238773+0000","last_undegraded":"2024-09-19T07:11:03.238773+0000","last_fullsized":"2024-09-19T07:11:03.238773+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:16.658996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.283782+0000","last_change":"2024-09-19T07:09:18.930697+0000","last_active":"2024-09-19T07:11:03.283782+0000","last_peered":"2024-09-19T07:11:03.283782+0000","last_clean":"2024-09-19T07:11:03.283782+0000","last_became_active":"2024-09-19T07:09:18.930355+0000","last_became_peered":"2024-09-19T07:09:18.930355+0000","last_unstale":"2024-09-19T07:11:03.283782+0000","last_undegraded":"2024-09-19T07:11:03.283782+0000","last_fullsized":"2024-09-19T07:11:03.283782+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:07.217195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.228781+0000","last_change":"2024-09-19T07:09:38.183637+0000","last_active":"2024-09-19T07:11:03.228781+0000","last_peered":"2024-09-19T07:11:03.228781+0000","last_clean":"2024-09-19T07:11:03.228781+0000","last_became_active":"2024-09-19T07:09:38.178732+0000","last_became_peered":"2024-09-19T07:09:38.178732+0000","last_unstale":"2024-09-19T07:11:03.228781+0000","last_undegraded":"2024-09-19T07:11:03.228781+0000","last_fullsized":"2024-09-19T07:11:03.228781+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:14.287130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.285232+0000","last_change":"2024-09-19T07:09:18.935120+0000","last_active":"2024-09-19T07:11:03.285232+0000","last_peered":"2024-09-19T07:11:03.285232+0000","last_clean":"2024-09-19T07:11:03.285232+0000","last_became_active":"2024-09-19T07:09:18.934227+0000","last_became_peered":"2024-09-19T07:09:18.934227+0000","last_unstale":"2024-09-19T07:11:03.285232+0000","last_undegraded":"2024-09-19T07:11:03.285232+0000","last_fullsized":"2024-09-19T07:11:03.285232+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:20.328983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"81'15","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.278695+0000","last_change":"2024-09-19T07:09:38.393512+0000","last_active":"2024-09-19T07:11:03.278695+0000","last_peered":"2024-09-19T07:11:03.278695+0000","last_clean":"2024-09-19T07:11:03.278695+0000","last_became_active":"2024-09-19T07:09:38.393200+0000","last_became_peered":"2024-09-19T07:09:38.393200+0000","last_unstale":"2024-09-19T07:11:03.278695+0000","last_undegraded":"2024-09-19T07:11:03.278695+0000","last_fullsized":"2024-09-19T07:11:03.278695+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:51.637520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.247033+0000","last_change":"2024-09-19T07:09:16.911129+0000","last_active":"2024-09-19T07:11:03.247033+0000","last_peered":"2024-09-19T07:11:03.247033+0000","last_clean":"2024-09-19T07:11:03.247033+0000","last_became_active":"2024-09-19T07:09:16.910583+0000","last_became_peered":"2024-09-19T07:09:16.910583+0000","last_unstale":"2024-09-19T07:11:03.247033+0000","last_undegraded":"2024-09-19T07:11:03.247033+0000","last_fullsized":"2024-09-19T07:11:03.247033+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:34:37.295838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.285042+0000","last_change":"2024-09-19T07:09:18.928622+0000","last_active":"2024-09-19T07:11:03.285042+0000","last_peered":"2024-09-19T07:11:03.285042+0000","last_clean":"2024-09-19T07:11:03.285042+0000","last_became_active":"2024-09-19T07:09:18.928284+0000","last_became_peered":"2024-09-19T07:09:18.928284+0000","last_unstale":"2024-09-19T07:11:03.285042+0000","last_undegraded":"2024-09-19T07:11:03.285042+0000","last_fullsized":"2024-09-19T07:11:03.285042+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:37:46.358756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.245062+0000","last_change":"2024-09-19T07:09:16.916142+0000","last_active":"2024-09-19T07:11:03.245062+0000","last_peered":"2024-09-19T07:11:03.245062+0000","last_clean":"2024-09-19T07:11:03.245062+0000","last_became_active":"2024-09-19T07:09:16.915766+0000","last_became_peered":"2024-09-19T07:09:16.915766+0000","last_unstale":"2024-09-19T07:11:03.245062+0000","last_undegraded":"2024-09-19T07:11:03.245062+0000","last_fullsized":"2024-09-19T07:11:03.245062+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:38.136422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.285015+0000","last_change":"2024-09-19T07:09:18.921912+0000","last_active":"2024-09-19T07:11:03.285015+0000","last_peered":"2024-09-19T07:11:03.285015+0000","last_clean":"2024-09-19T07:11:03.285015+0000","last_became_active":"2024-09-19T07:09:18.921595+0000","last_became_peered":"2024-09-19T07:09:18.921595+0000","last_unstale":"2024-09-19T07:11:03.285015+0000","last_undegraded":"2024-09-19T07:11:03.285015+0000","last_fullsized":"2024-09-19T07:11:03.285015+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:53.899052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.232279+0000","last_change":"2024-09-19T07:09:17.084856+0000","last_active":"2024-09-19T07:11:03.232279+0000","last_peered":"2024-09-19T07:11:03.232279+0000","last_clean":"2024-09-19T07:11:03.232279+0000","last_became_active":"2024-09-19T07:09:17.084541+0000","last_became_peered":"2024-09-19T07:09:17.084541+0000","last_unstale":"2024-09-19T07:11:03.232279+0000","last_undegraded":"2024-09-19T07:11:03.232279+0000","last_fullsized":"2024-09-19T07:11:03.232279+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:05.978765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.274355+0000","last_change":"2024-09-19T07:09:18.923732+0000","last_active":"2024-09-19T07:11:03.274355+0000","last_peered":"2024-09-19T07:11:03.274355+0000","last_clean":"2024-09-19T07:11:03.274355+0000","last_became_active":"2024-09-19T07:09:18.923410+0000","last_became_peered":"2024-09-19T07:09:18.923410+0000","last_unstale":"2024-09-19T07:11:03.274355+0000","last_undegraded":"2024-09-19T07:11:03.274355+0000","last_fullsized":"2024-09-19T07:11:03.274355+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:01:20.208414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.242422+0000","last_change":"2024-09-19T07:09:16.910364+0000","last_active":"2024-09-19T07:11:03.242422+0000","last_peered":"2024-09-19T07:11:03.242422+0000","last_clean":"2024-09-19T07:11:03.242422+0000","last_became_active":"2024-09-19T07:09:16.909835+0000","last_became_peered":"2024-09-19T07:09:16.909835+0000","last_unstale":"2024-09-19T07:11:03.242422+0000","last_undegraded":"2024-09-19T07:11:03.242422+0000","last_fullsized":"2024-09-19T07:11:03.242422+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:05.198823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":794486,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":1001,"num_read_kb":703,"num_write":416,"num_write_kb":2353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":26947,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2617344,"data_stored":2383458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":306,"ondisk_log_size":306,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645348,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":892928,"data_stored":437435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874280,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":33188,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93711964,"statfs":{"total":95995035648,"available":95961051136,"internally_reserved":0,"allocated":1929216,"data_stored":1424948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037806,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32456,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712696,"statfs":{"total":95995035648,"available":95961800704,"internally_reserved":0,"allocated":1302528,"data_stored":830887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266738,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36616,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708536,"statfs":{"total":95995035648,"available":95957540864,"internally_reserved":0,"allocated":1302528,"data_stored":830807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495671,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32656,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712496,"statfs":{"total":95995035648,"available":95961595904,"internally_reserved":0,"allocated":1503232,"data_stored":1032078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659197,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":897024,"data_stored":437060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888129,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32988,"kb_used_data":1804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712164,"statfs":{"total":95995035648,"available":95961255936,"internally_reserved":0,"allocated":1847296,"data_stored":1358674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018950,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":978944,"data_stored":505297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247883,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32592,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712560,"statfs":{"total":95995035648,"available":95961661440,"internally_reserved":0,"allocated":1441792,"data_stored":962187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444112,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":439831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607637,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":966656,"data_stored":503333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":917504,"data_stored":438331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":741376,"data_stored":721732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":360448,"data_stored":331336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":4740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":393954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":397610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T07:11:18.451 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T07:11:18.452 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T07:11:18.698 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:11:19.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.211+0000 7f267030a640 1 -- 172.21.15.148:0/239884760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2668102570 msgr2=0x7f26681029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:19.232 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.211+0000 7f267030a640 1 --2- 172.21.15.148:0/239884760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2668102570 0x7f26681029b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f265c009900 tx=0x7f265c02a480 comp rx=0 tx=0).stop 2024-09-19T07:11:19.232 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.211+0000 7f267030a640 1 -- 172.21.15.148:0/239884760 shutdown_connections 2024-09-19T07:11:19.232 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.211+0000 7f267030a640 1 --2- 172.21.15.148:0/239884760 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2668102ef0 0x7f266810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:19.232 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.211+0000 7f267030a640 1 --2- 172.21.15.148:0/239884760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2668102570 0x7f26681029b0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:19.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.211+0000 7f267030a640 1 --2- 172.21.15.148:0/239884760 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2668100e20 0x7f2668101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:19.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.211+0000 7f267030a640 1 -- 172.21.15.148:0/239884760 >> 172.21.15.148:0/239884760 conn(0x7f26680fc7d0 msgr2=0x7f26680febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:19.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.211+0000 7f267030a640 1 -- 172.21.15.148:0/239884760 shutdown_connections 2024-09-19T07:11:19.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.211+0000 7f267030a640 1 -- 172.21.15.148:0/239884760 wait complete. 2024-09-19T07:11:19.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.211+0000 7f267030a640 1 Processor -- start 2024-09-19T07:11:19.234 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.212+0000 7f267030a640 1 -- start start 2024-09-19T07:11:19.234 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.212+0000 7f267030a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2668100e20 0x7f26681984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:19.234 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.212+0000 7f267030a640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2668102570 0x7f2668198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:19.234 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.212+0000 7f267030a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2668102ef0 0x7f266819cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:19.234 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.212+0000 7f267030a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2668110f80 con 0x7f2668100e20 2024-09-19T07:11:19.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.212+0000 7f267030a640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2668110e00 con 0x7f2668102570 2024-09-19T07:11:19.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.212+0000 7f267030a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2668111100 con 0x7f2668102ef0 2024-09-19T07:11:19.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.212+0000 7f266e0a6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2668100e20 0x7f26681984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:19.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.212+0000 7f266e0a6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2668100e20 0x7f26681984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51354/0 (socket says 172.21.15.148:51354) 2024-09-19T07:11:19.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.212+0000 7f266e0a6640 1 -- 172.21.15.148:0/1746816882 learned_addr learned my addr 172.21.15.148:0/1746816882 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:19.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.212+0000 7f266e8a7640 1 --2- 172.21.15.148:0/1746816882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2668102ef0 0x7f266819cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:19.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.212+0000 7f266d8a5640 1 --2- 172.21.15.148:0/1746816882 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2668102570 0x7f2668198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:19.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.212+0000 7f266e0a6640 1 -- 172.21.15.148:0/1746816882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2668102ef0 msgr2=0x7f266819cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:19.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.212+0000 7f266e0a6640 1 --2- 172.21.15.148:0/1746816882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2668102ef0 0x7f266819cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:19.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.212+0000 7f266e0a6640 1 -- 172.21.15.148:0/1746816882 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2668102570 msgr2=0x7f2668198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:19.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.212+0000 7f266e0a6640 1 --2- 172.21.15.148:0/1746816882 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2668102570 0x7f2668198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:19.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.212+0000 7f266e0a6640 1 -- 172.21.15.148:0/1746816882 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f266819d4a0 con 0x7f2668100e20 2024-09-19T07:11:19.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.212+0000 7f266e8a7640 1 --2- 172.21.15.148:0/1746816882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2668102ef0 0x7f266819cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:11:19.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.212+0000 7f266d8a5640 1 --2- 172.21.15.148:0/1746816882 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2668102570 0x7f2668198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:11:19.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.212+0000 7f266e0a6640 1 --2- 172.21.15.148:0/1746816882 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2668100e20 0x7f26681984f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f265800eb90 tx=0x7f265800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:19.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.213+0000 7f26677fe640 1 -- 172.21.15.148:0/1746816882 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2658004d20 con 0x7f2668100e20 2024-09-19T07:11:19.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.213+0000 7f26677fe640 1 -- 172.21.15.148:0/1746816882 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f265800ee90 con 0x7f2668100e20 2024-09-19T07:11:19.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.213+0000 7f267030a640 1 -- 172.21.15.148:0/1746816882 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f266819d790 con 0x7f2668100e20 2024-09-19T07:11:19.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.213+0000 7f26677fe640 1 -- 172.21.15.148:0/1746816882 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2658010830 con 0x7f2668100e20 2024-09-19T07:11:19.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.213+0000 7f267030a640 1 -- 172.21.15.148:0/1746816882 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26681a5070 con 0x7f2668100e20 2024-09-19T07:11:19.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.214+0000 7f267030a640 1 -- 172.21.15.148:0/1746816882 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2668101200 con 0x7f2668100e20 2024-09-19T07:11:19.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.215+0000 7f26677fe640 1 -- 172.21.15.148:0/1746816882 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f2658005020 con 0x7f2668100e20 2024-09-19T07:11:19.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.215+0000 7f26677fe640 1 --2- 172.21.15.148:0/1746816882 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f26500a3440 0x7f26500a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:19.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.215+0000 7f266d8a5640 1 --2- 172.21.15.148:0/1746816882 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f26500a3440 0x7f26500a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:19.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.215+0000 7f26677fe640 1 -- 172.21.15.148:0/1746816882 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f26580d0680 con 0x7f2668100e20 2024-09-19T07:11:19.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.216+0000 7f266d8a5640 1 --2- 172.21.15.148:0/1746816882 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f26500a3440 0x7f26500a5900 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f265c000c00 tx=0x7f265c004100 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:19.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.220+0000 7f26677fe640 1 -- 172.21.15.148:0/1746816882 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f265809cf00 con 0x7f2668100e20 2024-09-19T07:11:19.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:19 smithi165 ceph-mon[35326]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 76 KiB/s wr, 45 op/s 2024-09-19T07:11:19.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:19 smithi165 ceph-mon[35326]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:11:19.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.386+0000 7f267030a640 1 -- 172.21.15.148:0/1746816882 --> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2668106f10 con 0x7f26500a3440 2024-09-19T07:11:19.387 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:19 smithi148 ceph-mon[31180]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 76 KiB/s wr, 45 op/s 2024-09-19T07:11:19.387 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:19 smithi148 ceph-mon[31180]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:11:19.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.392+0000 7f26677fe640 1 -- 172.21.15.148:0/1746816882 <== mgr.15123 v2:172.21.15.148:6800/3902535850 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257764 (secure 0 0 0) 0x7f2668106f10 con 0x7f26500a3440 2024-09-19T07:11:19.396 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:11:19.397 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2024-09-19T07:11:19.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.396+0000 7f267030a640 1 -- 172.21.15.148:0/1746816882 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f26500a3440 msgr2=0x7f26500a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:19.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.396+0000 7f267030a640 1 --2- 172.21.15.148:0/1746816882 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f26500a3440 0x7f26500a5900 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f265c000c00 tx=0x7f265c004100 comp rx=0 tx=0).stop 2024-09-19T07:11:19.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.396+0000 7f267030a640 1 -- 172.21.15.148:0/1746816882 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2668100e20 msgr2=0x7f26681984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:19.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.396+0000 7f267030a640 1 --2- 172.21.15.148:0/1746816882 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2668100e20 0x7f26681984f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f265800eb90 tx=0x7f265800c6a0 comp rx=0 tx=0).stop 2024-09-19T07:11:19.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.396+0000 7f267030a640 1 -- 172.21.15.148:0/1746816882 shutdown_connections 2024-09-19T07:11:19.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.396+0000 7f267030a640 1 --2- 172.21.15.148:0/1746816882 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f26500a3440 0x7f26500a5900 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:19.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.396+0000 7f267030a640 1 --2- 172.21.15.148:0/1746816882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2668102ef0 0x7f266819cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:19.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.396+0000 7f267030a640 1 --2- 172.21.15.148:0/1746816882 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2668102570 0x7f2668198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:19.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.396+0000 7f267030a640 1 --2- 172.21.15.148:0/1746816882 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2668100e20 0x7f26681984f0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:19.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.396+0000 7f267030a640 1 -- 172.21.15.148:0/1746816882 >> 172.21.15.148:0/1746816882 conn(0x7f26680fc7d0 msgr2=0x7f2668069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:19.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.396+0000 7f267030a640 1 -- 172.21.15.148:0/1746816882 shutdown_connections 2024-09-19T07:11:19.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:19.396+0000 7f267030a640 1 -- 172.21.15.148:0/1746816882 wait complete. 2024-09-19T07:11:19.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:19 smithi179 ceph-mon[35716]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 76 KiB/s wr, 45 op/s 2024-09-19T07:11:19.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:19 smithi179 ceph-mon[35716]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:11:19.997 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-09-19T07:11:19.251537+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1385088,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":1279,"num_read_kb":1058,"num_write":623,"num_write_kb":5293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1207683,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":958,"ondisk_log_size":958,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":389328,"kb_used_data":14736,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124552496,"statfs":{"total":1151940427776,"available":1151541755904,"internally_reserved":0,"allocated":15089664,"data_stored":9397500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":382973242},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":196632,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":447,"num_read_kb":489,"num_write":146,"num_write_kb":914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002794"},"pg_stats":[{"pgid":"3.3f","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.279425+0000","last_change":"2024-09-19T07:09:18.926902+0000","last_active":"2024-09-19T07:11:03.279425+0000","last_peered":"2024-09-19T07:11:03.279425+0000","last_clean":"2024-09-19T07:11:03.279425+0000","last_became_active":"2024-09-19T07:09:18.926582+0000","last_became_peered":"2024-09-19T07:09:18.926582+0000","last_unstale":"2024-09-19T07:11:03.279425+0000","last_undegraded":"2024-09-19T07:11:03.279425+0000","last_fullsized":"2024-09-19T07:11:03.279425+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:37.875779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.283851+0000","last_change":"2024-09-19T07:09:18.934205+0000","last_active":"2024-09-19T07:11:03.283851+0000","last_peered":"2024-09-19T07:11:03.283851+0000","last_clean":"2024-09-19T07:11:03.283851+0000","last_became_active":"2024-09-19T07:09:18.933767+0000","last_became_peered":"2024-09-19T07:09:18.933767+0000","last_unstale":"2024-09-19T07:11:03.283851+0000","last_undegraded":"2024-09-19T07:11:03.283851+0000","last_fullsized":"2024-09-19T07:11:03.283851+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:10:45.391428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.284092+0000","last_change":"2024-09-19T07:09:18.922312+0000","last_active":"2024-09-19T07:11:03.284092+0000","last_peered":"2024-09-19T07:11:03.284092+0000","last_clean":"2024-09-19T07:11:03.284092+0000","last_became_active":"2024-09-19T07:09:18.921476+0000","last_became_peered":"2024-09-19T07:09:18.921476+0000","last_unstale":"2024-09-19T07:11:03.284092+0000","last_undegraded":"2024-09-19T07:11:03.284092+0000","last_fullsized":"2024-09-19T07:11:03.284092+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:29.470616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.269706+0000","last_change":"2024-09-19T07:09:18.938218+0000","last_active":"2024-09-19T07:11:03.269706+0000","last_peered":"2024-09-19T07:11:03.269706+0000","last_clean":"2024-09-19T07:11:03.269706+0000","last_became_active":"2024-09-19T07:09:18.937306+0000","last_became_peered":"2024-09-19T07:09:18.937306+0000","last_unstale":"2024-09-19T07:11:03.269706+0000","last_undegraded":"2024-09-19T07:11:03.269706+0000","last_fullsized":"2024-09-19T07:11:03.269706+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:54.146506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.274574+0000","last_change":"2024-09-19T07:09:18.925837+0000","last_active":"2024-09-19T07:11:03.274574+0000","last_peered":"2024-09-19T07:11:03.274574+0000","last_clean":"2024-09-19T07:11:03.274574+0000","last_became_active":"2024-09-19T07:09:18.925559+0000","last_became_peered":"2024-09-19T07:09:18.925559+0000","last_unstale":"2024-09-19T07:11:03.274574+0000","last_undegraded":"2024-09-19T07:11:03.274574+0000","last_fullsized":"2024-09-19T07:11:03.274574+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:15:58.348347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.267010+0000","last_change":"2024-09-19T07:09:18.938911+0000","last_active":"2024-09-19T07:11:03.267010+0000","last_peered":"2024-09-19T07:11:03.267010+0000","last_clean":"2024-09-19T07:11:03.267010+0000","last_became_active":"2024-09-19T07:09:18.938601+0000","last_became_peered":"2024-09-19T07:09:18.938601+0000","last_unstale":"2024-09-19T07:11:03.267010+0000","last_undegraded":"2024-09-19T07:11:03.267010+0000","last_fullsized":"2024-09-19T07:11:03.267010+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:34.517324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.274002+0000","last_change":"2024-09-19T07:09:18.930253+0000","last_active":"2024-09-19T07:11:03.274002+0000","last_peered":"2024-09-19T07:11:03.274002+0000","last_clean":"2024-09-19T07:11:03.274002+0000","last_became_active":"2024-09-19T07:09:18.929927+0000","last_became_peered":"2024-09-19T07:09:18.929927+0000","last_unstale":"2024-09-19T07:11:03.274002+0000","last_undegraded":"2024-09-19T07:11:03.274002+0000","last_fullsized":"2024-09-19T07:11:03.274002+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:31:39.186230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"81'9","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.269452+0000","last_change":"2024-09-19T07:09:38.180197+0000","last_active":"2024-09-19T07:11:03.269452+0000","last_peered":"2024-09-19T07:11:03.269452+0000","last_clean":"2024-09-19T07:11:03.269452+0000","last_became_active":"2024-09-19T07:09:38.179767+0000","last_became_peered":"2024-09-19T07:09:38.179767+0000","last_unstale":"2024-09-19T07:11:03.269452+0000","last_undegraded":"2024-09-19T07:11:03.269452+0000","last_fullsized":"2024-09-19T07:11:03.269452+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:43.581181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.275716+0000","last_change":"2024-09-19T07:09:18.937100+0000","last_active":"2024-09-19T07:11:03.275716+0000","last_peered":"2024-09-19T07:11:03.275716+0000","last_clean":"2024-09-19T07:11:03.275716+0000","last_became_active":"2024-09-19T07:09:18.935151+0000","last_became_peered":"2024-09-19T07:09:18.935151+0000","last_unstale":"2024-09-19T07:11:03.275716+0000","last_undegraded":"2024-09-19T07:11:03.275716+0000","last_fullsized":"2024-09-19T07:11:03.275716+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:46:30.950667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.273140+0000","last_change":"2024-09-19T07:09:18.940119+0000","last_active":"2024-09-19T07:11:03.273140+0000","last_peered":"2024-09-19T07:11:03.273140+0000","last_clean":"2024-09-19T07:11:03.273140+0000","last_became_active":"2024-09-19T07:09:18.939703+0000","last_became_peered":"2024-09-19T07:09:18.939703+0000","last_unstale":"2024-09-19T07:11:03.273140+0000","last_undegraded":"2024-09-19T07:11:03.273140+0000","last_fullsized":"2024-09-19T07:11:03.273140+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:51:04.982727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.276689+0000","last_change":"2024-09-19T07:09:18.939146+0000","last_active":"2024-09-19T07:11:03.276689+0000","last_peered":"2024-09-19T07:11:03.276689+0000","last_clean":"2024-09-19T07:11:03.276689+0000","last_became_active":"2024-09-19T07:09:18.936842+0000","last_became_peered":"2024-09-19T07:09:18.936842+0000","last_unstale":"2024-09-19T07:11:03.276689+0000","last_undegraded":"2024-09-19T07:11:03.276689+0000","last_fullsized":"2024-09-19T07:11:03.276689+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:32.713505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.265688+0000","last_change":"2024-09-19T07:09:38.178834+0000","last_active":"2024-09-19T07:11:03.265688+0000","last_peered":"2024-09-19T07:11:03.265688+0000","last_clean":"2024-09-19T07:11:03.265688+0000","last_became_active":"2024-09-19T07:09:38.178477+0000","last_became_peered":"2024-09-19T07:09:38.178477+0000","last_unstale":"2024-09-19T07:11:03.265688+0000","last_undegraded":"2024-09-19T07:11:03.265688+0000","last_fullsized":"2024-09-19T07:11:03.265688+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:04:44.524920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.285948+0000","last_change":"2024-09-19T07:09:18.935422+0000","last_active":"2024-09-19T07:11:03.285948+0000","last_peered":"2024-09-19T07:11:03.285948+0000","last_clean":"2024-09-19T07:11:03.285948+0000","last_became_active":"2024-09-19T07:09:18.934994+0000","last_became_peered":"2024-09-19T07:09:18.934994+0000","last_unstale":"2024-09-19T07:11:03.285948+0000","last_undegraded":"2024-09-19T07:11:03.285948+0000","last_fullsized":"2024-09-19T07:11:03.285948+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:37:30.751247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.283787+0000","last_change":"2024-09-19T07:09:18.933954+0000","last_active":"2024-09-19T07:11:03.283787+0000","last_peered":"2024-09-19T07:11:03.283787+0000","last_clean":"2024-09-19T07:11:03.283787+0000","last_became_active":"2024-09-19T07:09:18.933588+0000","last_became_peered":"2024-09-19T07:09:18.933588+0000","last_unstale":"2024-09-19T07:11:03.283787+0000","last_undegraded":"2024-09-19T07:11:03.283787+0000","last_fullsized":"2024-09-19T07:11:03.283787+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:10.161172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.283035+0000","last_change":"2024-09-19T07:09:18.932122+0000","last_active":"2024-09-19T07:11:03.283035+0000","last_peered":"2024-09-19T07:11:03.283035+0000","last_clean":"2024-09-19T07:11:03.283035+0000","last_became_active":"2024-09-19T07:09:18.931798+0000","last_became_peered":"2024-09-19T07:09:18.931798+0000","last_unstale":"2024-09-19T07:11:03.283035+0000","last_undegraded":"2024-09-19T07:11:03.283035+0000","last_fullsized":"2024-09-19T07:11:03.283035+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:44.776375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.261952+0000","last_change":"2024-09-19T07:09:18.935632+0000","last_active":"2024-09-19T07:11:03.261952+0000","last_peered":"2024-09-19T07:11:03.261952+0000","last_clean":"2024-09-19T07:11:03.261952+0000","last_became_active":"2024-09-19T07:09:18.935174+0000","last_became_peered":"2024-09-19T07:09:18.935174+0000","last_unstale":"2024-09-19T07:11:03.261952+0000","last_undegraded":"2024-09-19T07:11:03.261952+0000","last_fullsized":"2024-09-19T07:11:03.261952+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:22.170777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.279662+0000","last_change":"2024-09-19T07:09:18.931836+0000","last_active":"2024-09-19T07:11:03.279662+0000","last_peered":"2024-09-19T07:11:03.279662+0000","last_clean":"2024-09-19T07:11:03.279662+0000","last_became_active":"2024-09-19T07:09:18.931564+0000","last_became_peered":"2024-09-19T07:09:18.931564+0000","last_unstale":"2024-09-19T07:11:03.279662+0000","last_undegraded":"2024-09-19T07:11:03.279662+0000","last_fullsized":"2024-09-19T07:11:03.279662+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:53.674584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.263261+0000","last_change":"2024-09-19T07:09:18.933210+0000","last_active":"2024-09-19T07:11:03.263261+0000","last_peered":"2024-09-19T07:11:03.263261+0000","last_clean":"2024-09-19T07:11:03.263261+0000","last_became_active":"2024-09-19T07:09:18.932894+0000","last_became_peered":"2024-09-19T07:09:18.932894+0000","last_unstale":"2024-09-19T07:11:03.263261+0000","last_undegraded":"2024-09-19T07:11:03.263261+0000","last_fullsized":"2024-09-19T07:11:03.263261+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:50:56.669801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.281347+0000","last_change":"2024-09-19T07:09:18.925627+0000","last_active":"2024-09-19T07:11:03.281347+0000","last_peered":"2024-09-19T07:11:03.281347+0000","last_clean":"2024-09-19T07:11:03.281347+0000","last_became_active":"2024-09-19T07:09:18.925340+0000","last_became_peered":"2024-09-19T07:09:18.925340+0000","last_unstale":"2024-09-19T07:11:03.281347+0000","last_undegraded":"2024-09-19T07:11:03.281347+0000","last_fullsized":"2024-09-19T07:11:03.281347+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:29.544534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.275601+0000","last_change":"2024-09-19T07:09:18.936963+0000","last_active":"2024-09-19T07:11:03.275601+0000","last_peered":"2024-09-19T07:11:03.275601+0000","last_clean":"2024-09-19T07:11:03.275601+0000","last_became_active":"2024-09-19T07:09:18.936615+0000","last_became_peered":"2024-09-19T07:09:18.936615+0000","last_unstale":"2024-09-19T07:11:03.275601+0000","last_undegraded":"2024-09-19T07:11:03.275601+0000","last_fullsized":"2024-09-19T07:11:03.275601+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:13.036392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.285146+0000","last_change":"2024-09-19T07:09:18.932018+0000","last_active":"2024-09-19T07:11:03.285146+0000","last_peered":"2024-09-19T07:11:03.285146+0000","last_clean":"2024-09-19T07:11:03.285146+0000","last_became_active":"2024-09-19T07:09:18.931624+0000","last_became_peered":"2024-09-19T07:09:18.931624+0000","last_unstale":"2024-09-19T07:11:03.285146+0000","last_undegraded":"2024-09-19T07:11:03.285146+0000","last_fullsized":"2024-09-19T07:11:03.285146+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:53:05.585166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.265530+0000","last_change":"2024-09-19T07:09:18.935474+0000","last_active":"2024-09-19T07:11:03.265530+0000","last_peered":"2024-09-19T07:11:03.265530+0000","last_clean":"2024-09-19T07:11:03.265530+0000","last_became_active":"2024-09-19T07:09:18.929018+0000","last_became_peered":"2024-09-19T07:09:18.929018+0000","last_unstale":"2024-09-19T07:11:03.265530+0000","last_undegraded":"2024-09-19T07:11:03.265530+0000","last_fullsized":"2024-09-19T07:11:03.265530+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:01.383024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.276949+0000","last_change":"2024-09-19T07:09:18.928733+0000","last_active":"2024-09-19T07:11:03.276949+0000","last_peered":"2024-09-19T07:11:03.276949+0000","last_clean":"2024-09-19T07:11:03.276949+0000","last_became_active":"2024-09-19T07:09:18.928431+0000","last_became_peered":"2024-09-19T07:09:18.928431+0000","last_unstale":"2024-09-19T07:11:03.276949+0000","last_undegraded":"2024-09-19T07:11:03.276949+0000","last_fullsized":"2024-09-19T07:11:03.276949+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:37.313958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.268113+0000","last_change":"2024-09-19T07:09:18.921268+0000","last_active":"2024-09-19T07:11:03.268113+0000","last_peered":"2024-09-19T07:11:03.268113+0000","last_clean":"2024-09-19T07:11:03.268113+0000","last_became_active":"2024-09-19T07:09:18.920482+0000","last_became_peered":"2024-09-19T07:09:18.920482+0000","last_unstale":"2024-09-19T07:11:03.268113+0000","last_undegraded":"2024-09-19T07:11:03.268113+0000","last_fullsized":"2024-09-19T07:11:03.268113+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:35.201826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"81'2","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.269267+0000","last_change":"2024-09-19T07:09:38.179136+0000","last_active":"2024-09-19T07:11:03.269267+0000","last_peered":"2024-09-19T07:11:03.269267+0000","last_clean":"2024-09-19T07:11:03.269267+0000","last_became_active":"2024-09-19T07:09:38.178746+0000","last_became_peered":"2024-09-19T07:09:38.178746+0000","last_unstale":"2024-09-19T07:11:03.269267+0000","last_undegraded":"2024-09-19T07:11:03.269267+0000","last_fullsized":"2024-09-19T07:11:03.269267+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:03.788114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.280523+0000","last_change":"2024-09-19T07:09:18.924099+0000","last_active":"2024-09-19T07:11:03.280523+0000","last_peered":"2024-09-19T07:11:03.280523+0000","last_clean":"2024-09-19T07:11:03.280523+0000","last_became_active":"2024-09-19T07:09:18.923772+0000","last_became_peered":"2024-09-19T07:09:18.923772+0000","last_unstale":"2024-09-19T07:11:03.280523+0000","last_undegraded":"2024-09-19T07:11:03.280523+0000","last_fullsized":"2024-09-19T07:11:03.280523+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:05:04.954087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.271340+0000","last_change":"2024-09-19T07:09:18.923391+0000","last_active":"2024-09-19T07:11:03.271340+0000","last_peered":"2024-09-19T07:11:03.271340+0000","last_clean":"2024-09-19T07:11:03.271340+0000","last_became_active":"2024-09-19T07:09:18.923085+0000","last_became_peered":"2024-09-19T07:09:18.923085+0000","last_unstale":"2024-09-19T07:11:03.271340+0000","last_undegraded":"2024-09-19T07:11:03.271340+0000","last_fullsized":"2024-09-19T07:11:03.271340+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:43:27.032400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.283075+0000","last_change":"2024-09-19T07:09:18.937188+0000","last_active":"2024-09-19T07:11:03.283075+0000","last_peered":"2024-09-19T07:11:03.283075+0000","last_clean":"2024-09-19T07:11:03.283075+0000","last_became_active":"2024-09-19T07:09:18.936866+0000","last_became_peered":"2024-09-19T07:09:18.936866+0000","last_unstale":"2024-09-19T07:11:03.283075+0000","last_undegraded":"2024-09-19T07:11:03.283075+0000","last_fullsized":"2024-09-19T07:11:03.283075+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:29:08.835307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.284272+0000","last_change":"2024-09-19T07:09:18.935170+0000","last_active":"2024-09-19T07:11:03.284272+0000","last_peered":"2024-09-19T07:11:03.284272+0000","last_clean":"2024-09-19T07:11:03.284272+0000","last_became_active":"2024-09-19T07:09:18.934356+0000","last_became_peered":"2024-09-19T07:09:18.934356+0000","last_unstale":"2024-09-19T07:11:03.284272+0000","last_undegraded":"2024-09-19T07:11:03.284272+0000","last_fullsized":"2024-09-19T07:11:03.284272+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:53.567392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.285704+0000","last_change":"2024-09-19T07:09:18.922640+0000","last_active":"2024-09-19T07:11:03.285704+0000","last_peered":"2024-09-19T07:11:03.285704+0000","last_clean":"2024-09-19T07:11:03.285704+0000","last_became_active":"2024-09-19T07:09:18.922312+0000","last_became_peered":"2024-09-19T07:09:18.922312+0000","last_unstale":"2024-09-19T07:11:03.285704+0000","last_undegraded":"2024-09-19T07:11:03.285704+0000","last_fullsized":"2024-09-19T07:11:03.285704+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:50.868818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.280468+0000","last_change":"2024-09-19T07:09:18.934364+0000","last_active":"2024-09-19T07:11:03.280468+0000","last_peered":"2024-09-19T07:11:03.280468+0000","last_clean":"2024-09-19T07:11:03.280468+0000","last_became_active":"2024-09-19T07:09:18.933533+0000","last_became_peered":"2024-09-19T07:09:18.933533+0000","last_unstale":"2024-09-19T07:11:03.280468+0000","last_undegraded":"2024-09-19T07:11:03.280468+0000","last_fullsized":"2024-09-19T07:11:03.280468+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:54.175425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.274368+0000","last_change":"2024-09-19T07:09:18.927456+0000","last_active":"2024-09-19T07:11:03.274368+0000","last_peered":"2024-09-19T07:11:03.274368+0000","last_clean":"2024-09-19T07:11:03.274368+0000","last_became_active":"2024-09-19T07:09:18.927117+0000","last_became_peered":"2024-09-19T07:09:18.927117+0000","last_unstale":"2024-09-19T07:11:03.274368+0000","last_undegraded":"2024-09-19T07:11:03.274368+0000","last_fullsized":"2024-09-19T07:11:03.274368+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:08.885898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.271805+0000","last_change":"2024-09-19T07:09:18.926024+0000","last_active":"2024-09-19T07:11:03.271805+0000","last_peered":"2024-09-19T07:11:03.271805+0000","last_clean":"2024-09-19T07:11:03.271805+0000","last_became_active":"2024-09-19T07:09:18.925689+0000","last_became_peered":"2024-09-19T07:09:18.925689+0000","last_unstale":"2024-09-19T07:11:03.271805+0000","last_undegraded":"2024-09-19T07:11:03.271805+0000","last_fullsized":"2024-09-19T07:11:03.271805+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:09:08.178214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'10","reported_seq":150,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:18.150142+0000","last_change":"2024-09-19T07:09:16.915804+0000","last_active":"2024-09-19T07:11:18.150142+0000","last_peered":"2024-09-19T07:11:18.150142+0000","last_clean":"2024-09-19T07:11:18.150142+0000","last_became_active":"2024-09-19T07:09:16.915434+0000","last_became_peered":"2024-09-19T07:09:16.915434+0000","last_unstale":"2024-09-19T07:11:18.150142+0000","last_undegraded":"2024-09-19T07:11:18.150142+0000","last_fullsized":"2024-09-19T07:11:18.150142+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:57.230475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2250,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":5,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.271307+0000","last_change":"2024-09-19T07:09:18.932497+0000","last_active":"2024-09-19T07:11:03.271307+0000","last_peered":"2024-09-19T07:11:03.271307+0000","last_clean":"2024-09-19T07:11:03.271307+0000","last_became_active":"2024-09-19T07:09:18.932213+0000","last_became_peered":"2024-09-19T07:09:18.932213+0000","last_unstale":"2024-09-19T07:11:03.271307+0000","last_undegraded":"2024-09-19T07:11:03.271307+0000","last_fullsized":"2024-09-19T07:11:03.271307+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:10.299077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.233512+0000","last_change":"2024-09-19T07:09:16.910171+0000","last_active":"2024-09-19T07:11:03.233512+0000","last_peered":"2024-09-19T07:11:03.233512+0000","last_clean":"2024-09-19T07:11:03.233512+0000","last_became_active":"2024-09-19T07:09:16.909840+0000","last_became_peered":"2024-09-19T07:09:16.909840+0000","last_unstale":"2024-09-19T07:11:03.233512+0000","last_undegraded":"2024-09-19T07:11:03.233512+0000","last_fullsized":"2024-09-19T07:11:03.233512+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:35.448892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.229456+0000","last_change":"2024-09-19T07:09:16.911336+0000","last_active":"2024-09-19T07:11:03.229456+0000","last_peered":"2024-09-19T07:11:03.229456+0000","last_clean":"2024-09-19T07:11:03.229456+0000","last_became_active":"2024-09-19T07:09:16.911027+0000","last_became_peered":"2024-09-19T07:09:16.911027+0000","last_unstale":"2024-09-19T07:11:03.229456+0000","last_undegraded":"2024-09-19T07:11:03.229456+0000","last_fullsized":"2024-09-19T07:11:03.229456+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:37:50.698597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.278229+0000","last_change":"2024-09-19T07:09:18.927713+0000","last_active":"2024-09-19T07:11:03.278229+0000","last_peered":"2024-09-19T07:11:03.278229+0000","last_clean":"2024-09-19T07:11:03.278229+0000","last_became_active":"2024-09-19T07:09:18.927430+0000","last_became_peered":"2024-09-19T07:09:18.927430+0000","last_unstale":"2024-09-19T07:11:03.278229+0000","last_undegraded":"2024-09-19T07:11:03.278229+0000","last_fullsized":"2024-09-19T07:11:03.278229+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:15:07.707723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.236756+0000","last_change":"2024-09-19T07:09:16.912391+0000","last_active":"2024-09-19T07:11:03.236756+0000","last_peered":"2024-09-19T07:11:03.236756+0000","last_clean":"2024-09-19T07:11:03.236756+0000","last_became_active":"2024-09-19T07:09:16.912034+0000","last_became_peered":"2024-09-19T07:09:16.912034+0000","last_unstale":"2024-09-19T07:11:03.236756+0000","last_undegraded":"2024-09-19T07:11:03.236756+0000","last_fullsized":"2024-09-19T07:11:03.236756+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:18:45.226107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.269888+0000","last_change":"2024-09-19T07:09:18.929476+0000","last_active":"2024-09-19T07:11:03.269888+0000","last_peered":"2024-09-19T07:11:03.269888+0000","last_clean":"2024-09-19T07:11:03.269888+0000","last_became_active":"2024-09-19T07:09:18.929183+0000","last_became_peered":"2024-09-19T07:09:18.929183+0000","last_unstale":"2024-09-19T07:11:03.269888+0000","last_undegraded":"2024-09-19T07:11:03.269888+0000","last_fullsized":"2024-09-19T07:11:03.269888+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:19:38.827130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:18.149576+0000","last_change":"2024-09-19T07:09:16.913012+0000","last_active":"2024-09-19T07:11:18.149576+0000","last_peered":"2024-09-19T07:11:18.149576+0000","last_clean":"2024-09-19T07:11:18.149576+0000","last_became_active":"2024-09-19T07:09:16.912633+0000","last_became_peered":"2024-09-19T07:09:16.912633+0000","last_unstale":"2024-09-19T07:11:18.149576+0000","last_undegraded":"2024-09-19T07:11:18.149576+0000","last_fullsized":"2024-09-19T07:11:18.149576+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:21:39.669961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":111,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.262229+0000","last_change":"2024-09-19T07:09:18.937323+0000","last_active":"2024-09-19T07:11:03.262229+0000","last_peered":"2024-09-19T07:11:03.262229+0000","last_clean":"2024-09-19T07:11:03.262229+0000","last_became_active":"2024-09-19T07:09:18.936762+0000","last_became_peered":"2024-09-19T07:09:18.936762+0000","last_unstale":"2024-09-19T07:11:03.262229+0000","last_undegraded":"2024-09-19T07:11:03.262229+0000","last_fullsized":"2024-09-19T07:11:03.262229+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:37.692290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.234308+0000","last_change":"2024-09-19T07:09:16.912167+0000","last_active":"2024-09-19T07:11:03.234308+0000","last_peered":"2024-09-19T07:11:03.234308+0000","last_clean":"2024-09-19T07:11:03.234308+0000","last_became_active":"2024-09-19T07:09:16.911840+0000","last_became_peered":"2024-09-19T07:09:16.911840+0000","last_unstale":"2024-09-19T07:11:03.234308+0000","last_undegraded":"2024-09-19T07:11:03.234308+0000","last_fullsized":"2024-09-19T07:11:03.234308+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:31.901906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.283235+0000","last_change":"2024-09-19T07:09:18.932239+0000","last_active":"2024-09-19T07:11:03.283235+0000","last_peered":"2024-09-19T07:11:03.283235+0000","last_clean":"2024-09-19T07:11:03.283235+0000","last_became_active":"2024-09-19T07:09:18.931820+0000","last_became_peered":"2024-09-19T07:09:18.931820+0000","last_unstale":"2024-09-19T07:11:03.283235+0000","last_undegraded":"2024-09-19T07:11:03.283235+0000","last_fullsized":"2024-09-19T07:11:03.283235+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:09.407524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.236809+0000","last_change":"2024-09-19T07:09:17.085077+0000","last_active":"2024-09-19T07:11:03.236809+0000","last_peered":"2024-09-19T07:11:03.236809+0000","last_clean":"2024-09-19T07:11:03.236809+0000","last_became_active":"2024-09-19T07:09:17.084457+0000","last_became_peered":"2024-09-19T07:09:17.084457+0000","last_unstale":"2024-09-19T07:11:03.236809+0000","last_undegraded":"2024-09-19T07:11:03.236809+0000","last_fullsized":"2024-09-19T07:11:03.236809+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:42.416193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.276315+0000","last_change":"2024-09-19T07:09:18.939830+0000","last_active":"2024-09-19T07:11:03.276315+0000","last_peered":"2024-09-19T07:11:03.276315+0000","last_clean":"2024-09-19T07:11:03.276315+0000","last_became_active":"2024-09-19T07:09:18.939359+0000","last_became_peered":"2024-09-19T07:09:18.939359+0000","last_unstale":"2024-09-19T07:11:03.276315+0000","last_undegraded":"2024-09-19T07:11:03.276315+0000","last_fullsized":"2024-09-19T07:11:03.276315+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:24:46.241902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'34","reported_seq":310,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:18.380251+0000","last_change":"2024-09-19T07:09:38.227707+0000","last_active":"2024-09-19T07:11:18.380251+0000","last_peered":"2024-09-19T07:11:18.380251+0000","last_clean":"2024-09-19T07:11:18.380251+0000","last_became_active":"2024-09-19T07:09:38.219073+0000","last_became_peered":"2024-09-19T07:09:38.219073+0000","last_unstale":"2024-09-19T07:11:18.380251+0000","last_undegraded":"2024-09-19T07:11:18.380251+0000","last_fullsized":"2024-09-19T07:11:18.380251+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:46.035315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66480,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":231,"num_read_kb":175,"num_write":35,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":26947,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.270480+0000","last_change":"2024-09-19T07:09:18.929531+0000","last_active":"2024-09-19T07:11:03.270480+0000","last_peered":"2024-09-19T07:11:03.270480+0000","last_clean":"2024-09-19T07:11:03.270480+0000","last_became_active":"2024-09-19T07:09:18.929253+0000","last_became_peered":"2024-09-19T07:09:18.929253+0000","last_unstale":"2024-09-19T07:11:03.270480+0000","last_undegraded":"2024-09-19T07:11:03.270480+0000","last_fullsized":"2024-09-19T07:11:03.270480+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:10.635116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.238624+0000","last_change":"2024-09-19T07:09:16.914964+0000","last_active":"2024-09-19T07:11:03.238624+0000","last_peered":"2024-09-19T07:11:03.238624+0000","last_clean":"2024-09-19T07:11:03.238624+0000","last_became_active":"2024-09-19T07:09:16.914540+0000","last_became_peered":"2024-09-19T07:09:16.914540+0000","last_unstale":"2024-09-19T07:11:03.238624+0000","last_undegraded":"2024-09-19T07:11:03.238624+0000","last_fullsized":"2024-09-19T07:11:03.238624+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:30.903046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.284691+0000","last_change":"2024-09-19T07:09:18.931709+0000","last_active":"2024-09-19T07:11:03.284691+0000","last_peered":"2024-09-19T07:11:03.284691+0000","last_clean":"2024-09-19T07:11:03.284691+0000","last_became_active":"2024-09-19T07:09:18.931345+0000","last_became_peered":"2024-09-19T07:09:18.931345+0000","last_unstale":"2024-09-19T07:11:03.284691+0000","last_undegraded":"2024-09-19T07:11:03.284691+0000","last_fullsized":"2024-09-19T07:11:03.284691+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:28.916820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.236617+0000","last_change":"2024-09-19T07:09:16.914055+0000","last_active":"2024-09-19T07:11:03.236617+0000","last_peered":"2024-09-19T07:11:03.236617+0000","last_clean":"2024-09-19T07:11:03.236617+0000","last_became_active":"2024-09-19T07:09:16.913589+0000","last_became_peered":"2024-09-19T07:09:16.913589+0000","last_unstale":"2024-09-19T07:11:03.236617+0000","last_undegraded":"2024-09-19T07:11:03.236617+0000","last_fullsized":"2024-09-19T07:11:03.236617+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:29:16.322059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"81'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.285962+0000","last_change":"2024-09-19T07:09:18.934879+0000","last_active":"2024-09-19T07:11:03.285962+0000","last_peered":"2024-09-19T07:11:03.285962+0000","last_clean":"2024-09-19T07:11:03.285962+0000","last_became_active":"2024-09-19T07:09:18.934432+0000","last_became_peered":"2024-09-19T07:09:18.934432+0000","last_unstale":"2024-09-19T07:11:03.285962+0000","last_undegraded":"2024-09-19T07:11:03.285962+0000","last_fullsized":"2024-09-19T07:11:03.285962+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:25.782782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'7","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:18.149334+0000","last_change":"2024-09-19T07:09:16.909256+0000","last_active":"2024-09-19T07:11:18.149334+0000","last_peered":"2024-09-19T07:11:18.149334+0000","last_clean":"2024-09-19T07:11:18.149334+0000","last_became_active":"2024-09-19T07:09:16.908932+0000","last_became_peered":"2024-09-19T07:09:16.908932+0000","last_unstale":"2024-09-19T07:11:18.149334+0000","last_undegraded":"2024-09-19T07:11:18.149334+0000","last_fullsized":"2024-09-19T07:11:18.149334+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:28.344756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1908,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":5,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.270197+0000","last_change":"2024-09-19T07:09:18.931844+0000","last_active":"2024-09-19T07:11:03.270197+0000","last_peered":"2024-09-19T07:11:03.270197+0000","last_clean":"2024-09-19T07:11:03.270197+0000","last_became_active":"2024-09-19T07:09:18.931516+0000","last_became_peered":"2024-09-19T07:09:18.931516+0000","last_unstale":"2024-09-19T07:11:03.270197+0000","last_undegraded":"2024-09-19T07:11:03.270197+0000","last_fullsized":"2024-09-19T07:11:03.270197+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:27:29.812144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.247165+0000","last_change":"2024-09-19T07:09:17.085252+0000","last_active":"2024-09-19T07:11:03.247165+0000","last_peered":"2024-09-19T07:11:03.247165+0000","last_clean":"2024-09-19T07:11:03.247165+0000","last_became_active":"2024-09-19T07:09:17.084907+0000","last_became_peered":"2024-09-19T07:09:17.084907+0000","last_unstale":"2024-09-19T07:11:03.247165+0000","last_undegraded":"2024-09-19T07:11:03.247165+0000","last_fullsized":"2024-09-19T07:11:03.247165+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:59:40.351181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.269674+0000","last_change":"2024-09-19T07:09:18.932491+0000","last_active":"2024-09-19T07:11:03.269674+0000","last_peered":"2024-09-19T07:11:03.269674+0000","last_clean":"2024-09-19T07:11:03.269674+0000","last_became_active":"2024-09-19T07:09:18.932159+0000","last_became_peered":"2024-09-19T07:09:18.932159+0000","last_unstale":"2024-09-19T07:11:03.269674+0000","last_undegraded":"2024-09-19T07:11:03.269674+0000","last_fullsized":"2024-09-19T07:11:03.269674+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:31.144130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'3","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.247568+0000","last_change":"2024-09-19T07:09:16.911012+0000","last_active":"2024-09-19T07:11:03.247568+0000","last_peered":"2024-09-19T07:11:03.247568+0000","last_clean":"2024-09-19T07:11:03.247568+0000","last_became_active":"2024-09-19T07:09:16.910618+0000","last_became_peered":"2024-09-19T07:09:16.910618+0000","last_unstale":"2024-09-19T07:11:03.247568+0000","last_undegraded":"2024-09-19T07:11:03.247568+0000","last_fullsized":"2024-09-19T07:11:03.247568+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:16.316680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"81'5","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.267441+0000","last_change":"2024-09-19T07:09:38.217870+0000","last_active":"2024-09-19T07:11:03.267441+0000","last_peered":"2024-09-19T07:11:03.267441+0000","last_clean":"2024-09-19T07:11:03.267441+0000","last_became_active":"2024-09-19T07:09:38.217585+0000","last_became_peered":"2024-09-19T07:09:38.217585+0000","last_unstale":"2024-09-19T07:11:03.267441+0000","last_undegraded":"2024-09-19T07:11:03.267441+0000","last_fullsized":"2024-09-19T07:11:03.267441+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:41.320705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.229695+0000","last_change":"2024-09-19T07:09:16.911644+0000","last_active":"2024-09-19T07:11:03.229695+0000","last_peered":"2024-09-19T07:11:03.229695+0000","last_clean":"2024-09-19T07:11:03.229695+0000","last_became_active":"2024-09-19T07:09:16.911368+0000","last_became_peered":"2024-09-19T07:09:16.911368+0000","last_unstale":"2024-09-19T07:11:03.229695+0000","last_undegraded":"2024-09-19T07:11:03.229695+0000","last_fullsized":"2024-09-19T07:11:03.229695+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:12.953466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.274357+0000","last_change":"2024-09-19T07:09:18.933667+0000","last_active":"2024-09-19T07:11:03.274357+0000","last_peered":"2024-09-19T07:11:03.274357+0000","last_clean":"2024-09-19T07:11:03.274357+0000","last_became_active":"2024-09-19T07:09:18.933288+0000","last_became_peered":"2024-09-19T07:09:18.933288+0000","last_unstale":"2024-09-19T07:11:03.274357+0000","last_undegraded":"2024-09-19T07:11:03.274357+0000","last_fullsized":"2024-09-19T07:11:03.274357+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:54:38.127799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'65","reported_seq":120,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:14.173274+0000","last_change":"2024-09-19T07:09:16.909722+0000","last_active":"2024-09-19T07:11:14.173274+0000","last_peered":"2024-09-19T07:11:14.173274+0000","last_clean":"2024-09-19T07:11:14.173274+0000","last_became_active":"2024-09-19T07:09:16.909394+0000","last_became_peered":"2024-09-19T07:09:16.909394+0000","last_unstale":"2024-09-19T07:11:14.173274+0000","last_undegraded":"2024-09-19T07:11:14.173274+0000","last_fullsized":"2024-09-19T07:11:14.173274+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:21:53.342710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":33,"num_write":76,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.269158+0000","last_change":"2024-09-19T07:09:18.929473+0000","last_active":"2024-09-19T07:11:03.269158+0000","last_peered":"2024-09-19T07:11:03.269158+0000","last_clean":"2024-09-19T07:11:03.269158+0000","last_became_active":"2024-09-19T07:09:18.929176+0000","last_became_peered":"2024-09-19T07:09:18.929176+0000","last_unstale":"2024-09-19T07:11:03.269158+0000","last_undegraded":"2024-09-19T07:11:03.269158+0000","last_fullsized":"2024-09-19T07:11:03.269158+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:32:30.409528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.238675+0000","last_change":"2024-09-19T07:09:17.084868+0000","last_active":"2024-09-19T07:11:03.238675+0000","last_peered":"2024-09-19T07:11:03.238675+0000","last_clean":"2024-09-19T07:11:03.238675+0000","last_became_active":"2024-09-19T07:09:17.084448+0000","last_became_peered":"2024-09-19T07:09:17.084448+0000","last_unstale":"2024-09-19T07:11:03.238675+0000","last_undegraded":"2024-09-19T07:11:03.238675+0000","last_fullsized":"2024-09-19T07:11:03.238675+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:38.211697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.276801+0000","last_change":"2024-09-19T07:09:18.938865+0000","last_active":"2024-09-19T07:11:03.276801+0000","last_peered":"2024-09-19T07:11:03.276801+0000","last_clean":"2024-09-19T07:11:03.276801+0000","last_became_active":"2024-09-19T07:09:18.936324+0000","last_became_peered":"2024-09-19T07:09:18.936324+0000","last_unstale":"2024-09-19T07:11:03.276801+0000","last_undegraded":"2024-09-19T07:11:03.276801+0000","last_fullsized":"2024-09-19T07:11:03.276801+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:29:51.081140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"81'148","reported_seq":389,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:05.365523+0000","last_change":"2024-09-19T07:08:09.270850+0000","last_active":"2024-09-19T07:11:05.365523+0000","last_peered":"2024-09-19T07:11:05.365523+0000","last_clean":"2024-09-19T07:11:05.365523+0000","last_became_active":"2024-09-19T07:08:09.270308+0000","last_became_peered":"2024-09-19T07:08:09.270308+0000","last_unstale":"2024-09-19T07:11:05.365523+0000","last_undegraded":"2024-09-19T07:11:05.365523+0000","last_fullsized":"2024-09-19T07:11:05.365523+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:04:49.729632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:04:49.729632+0000","last_clean_scrub_stamp":"2024-09-19T07:04:49.729632+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:15.588732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.231213+0000","last_change":"2024-09-19T07:09:16.907648+0000","last_active":"2024-09-19T07:11:03.231213+0000","last_peered":"2024-09-19T07:11:03.231213+0000","last_clean":"2024-09-19T07:11:03.231213+0000","last_became_active":"2024-09-19T07:09:16.907363+0000","last_became_peered":"2024-09-19T07:09:16.907363+0000","last_unstale":"2024-09-19T07:11:03.231213+0000","last_undegraded":"2024-09-19T07:11:03.231213+0000","last_fullsized":"2024-09-19T07:11:03.231213+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:12:27.898493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.275674+0000","last_change":"2024-09-19T07:09:18.926008+0000","last_active":"2024-09-19T07:11:03.275674+0000","last_peered":"2024-09-19T07:11:03.275674+0000","last_clean":"2024-09-19T07:11:03.275674+0000","last_became_active":"2024-09-19T07:09:18.925689+0000","last_became_peered":"2024-09-19T07:09:18.925689+0000","last_unstale":"2024-09-19T07:11:03.275674+0000","last_undegraded":"2024-09-19T07:11:03.275674+0000","last_fullsized":"2024-09-19T07:11:03.275674+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:16:06.467934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.233965+0000","last_change":"2024-09-19T07:09:16.911327+0000","last_active":"2024-09-19T07:11:03.233965+0000","last_peered":"2024-09-19T07:11:03.233965+0000","last_clean":"2024-09-19T07:11:03.233965+0000","last_became_active":"2024-09-19T07:09:16.911031+0000","last_became_peered":"2024-09-19T07:09:16.911031+0000","last_unstale":"2024-09-19T07:11:03.233965+0000","last_undegraded":"2024-09-19T07:11:03.233965+0000","last_fullsized":"2024-09-19T07:11:03.233965+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:03.307119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.280334+0000","last_change":"2024-09-19T07:09:18.933813+0000","last_active":"2024-09-19T07:11:03.280334+0000","last_peered":"2024-09-19T07:11:03.280334+0000","last_clean":"2024-09-19T07:11:03.280334+0000","last_became_active":"2024-09-19T07:09:18.933475+0000","last_became_peered":"2024-09-19T07:09:18.933475+0000","last_unstale":"2024-09-19T07:11:03.280334+0000","last_undegraded":"2024-09-19T07:11:03.280334+0000","last_fullsized":"2024-09-19T07:11:03.280334+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:34:09.149593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:19.150124+0000","last_change":"2024-09-19T07:09:17.084833+0000","last_active":"2024-09-19T07:11:19.150124+0000","last_peered":"2024-09-19T07:11:19.150124+0000","last_clean":"2024-09-19T07:11:19.150124+0000","last_became_active":"2024-09-19T07:09:17.084477+0000","last_became_peered":"2024-09-19T07:09:17.084477+0000","last_unstale":"2024-09-19T07:11:19.150124+0000","last_undegraded":"2024-09-19T07:11:19.150124+0000","last_fullsized":"2024-09-19T07:11:19.150124+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:17:50.962480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":111,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.281019+0000","last_change":"2024-09-19T07:09:18.935991+0000","last_active":"2024-09-19T07:11:03.281019+0000","last_peered":"2024-09-19T07:11:03.281019+0000","last_clean":"2024-09-19T07:11:03.281019+0000","last_became_active":"2024-09-19T07:09:18.935677+0000","last_became_peered":"2024-09-19T07:09:18.935677+0000","last_unstale":"2024-09-19T07:11:03.281019+0000","last_undegraded":"2024-09-19T07:11:03.281019+0000","last_fullsized":"2024-09-19T07:11:03.281019+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:45.550119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.234872+0000","last_change":"2024-09-19T07:09:16.911755+0000","last_active":"2024-09-19T07:11:03.234872+0000","last_peered":"2024-09-19T07:11:03.234872+0000","last_clean":"2024-09-19T07:11:03.234872+0000","last_became_active":"2024-09-19T07:09:16.911211+0000","last_became_peered":"2024-09-19T07:09:16.911211+0000","last_unstale":"2024-09-19T07:11:03.234872+0000","last_undegraded":"2024-09-19T07:11:03.234872+0000","last_fullsized":"2024-09-19T07:11:03.234872+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:15.365423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.265945+0000","last_change":"2024-09-19T07:09:18.940282+0000","last_active":"2024-09-19T07:11:03.265945+0000","last_peered":"2024-09-19T07:11:03.265945+0000","last_clean":"2024-09-19T07:11:03.265945+0000","last_became_active":"2024-09-19T07:09:18.939918+0000","last_became_peered":"2024-09-19T07:09:18.939918+0000","last_unstale":"2024-09-19T07:11:03.265945+0000","last_undegraded":"2024-09-19T07:11:03.265945+0000","last_fullsized":"2024-09-19T07:11:03.265945+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:11.161676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.242639+0000","last_change":"2024-09-19T07:09:17.086103+0000","last_active":"2024-09-19T07:11:03.242639+0000","last_peered":"2024-09-19T07:11:03.242639+0000","last_clean":"2024-09-19T07:11:03.242639+0000","last_became_active":"2024-09-19T07:09:17.085805+0000","last_became_peered":"2024-09-19T07:09:17.085805+0000","last_unstale":"2024-09-19T07:11:03.242639+0000","last_undegraded":"2024-09-19T07:11:03.242639+0000","last_fullsized":"2024-09-19T07:11:03.242639+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:28.522487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.284777+0000","last_change":"2024-09-19T07:09:18.932603+0000","last_active":"2024-09-19T07:11:03.284777+0000","last_peered":"2024-09-19T07:11:03.284777+0000","last_clean":"2024-09-19T07:11:03.284777+0000","last_became_active":"2024-09-19T07:09:18.932309+0000","last_became_peered":"2024-09-19T07:09:18.932309+0000","last_unstale":"2024-09-19T07:11:03.284777+0000","last_undegraded":"2024-09-19T07:11:03.284777+0000","last_fullsized":"2024-09-19T07:11:03.284777+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:19.746024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.245199+0000","last_change":"2024-09-19T07:09:17.085287+0000","last_active":"2024-09-19T07:11:03.245199+0000","last_peered":"2024-09-19T07:11:03.245199+0000","last_clean":"2024-09-19T07:11:03.245199+0000","last_became_active":"2024-09-19T07:09:17.084964+0000","last_became_peered":"2024-09-19T07:09:17.084964+0000","last_unstale":"2024-09-19T07:11:03.245199+0000","last_undegraded":"2024-09-19T07:11:03.245199+0000","last_fullsized":"2024-09-19T07:11:03.245199+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:51:01.035344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.287453+0000","last_change":"2024-09-19T07:09:18.921623+0000","last_active":"2024-09-19T07:11:03.287453+0000","last_peered":"2024-09-19T07:11:03.287453+0000","last_clean":"2024-09-19T07:11:03.287453+0000","last_became_active":"2024-09-19T07:09:18.921321+0000","last_became_peered":"2024-09-19T07:09:18.921321+0000","last_unstale":"2024-09-19T07:11:03.287453+0000","last_undegraded":"2024-09-19T07:11:03.287453+0000","last_fullsized":"2024-09-19T07:11:03.287453+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:28:55.616889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'100","reported_seq":216,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:14.502716+0000","last_change":"2024-09-19T07:09:16.910251+0000","last_active":"2024-09-19T07:11:14.502716+0000","last_peered":"2024-09-19T07:11:14.502716+0000","last_clean":"2024-09-19T07:11:14.502716+0000","last_became_active":"2024-09-19T07:09:16.909821+0000","last_became_peered":"2024-09-19T07:09:16.909821+0000","last_unstale":"2024-09-19T07:11:14.502716+0000","last_undegraded":"2024-09-19T07:11:14.502716+0000","last_fullsized":"2024-09-19T07:11:14.502716+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:02.958557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":312,"num_read_kb":277,"num_write":185,"num_write_kb":1287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.268601+0000","last_change":"2024-09-19T07:09:18.930831+0000","last_active":"2024-09-19T07:11:03.268601+0000","last_peered":"2024-09-19T07:11:03.268601+0000","last_clean":"2024-09-19T07:11:03.268601+0000","last_became_active":"2024-09-19T07:09:18.930475+0000","last_became_peered":"2024-09-19T07:09:18.930475+0000","last_unstale":"2024-09-19T07:11:03.268601+0000","last_undegraded":"2024-09-19T07:11:03.268601+0000","last_fullsized":"2024-09-19T07:11:03.268601+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:30.512246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.231362+0000","last_change":"2024-09-19T07:09:16.906666+0000","last_active":"2024-09-19T07:11:03.231362+0000","last_peered":"2024-09-19T07:11:03.231362+0000","last_clean":"2024-09-19T07:11:03.231362+0000","last_became_active":"2024-09-19T07:09:16.906369+0000","last_became_peered":"2024-09-19T07:09:16.906369+0000","last_unstale":"2024-09-19T07:11:03.231362+0000","last_undegraded":"2024-09-19T07:11:03.231362+0000","last_fullsized":"2024-09-19T07:11:03.231362+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:56.915089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.280797+0000","last_change":"2024-09-19T07:09:18.934942+0000","last_active":"2024-09-19T07:11:03.280797+0000","last_peered":"2024-09-19T07:11:03.280797+0000","last_clean":"2024-09-19T07:11:03.280797+0000","last_became_active":"2024-09-19T07:09:18.934595+0000","last_became_peered":"2024-09-19T07:09:18.934595+0000","last_unstale":"2024-09-19T07:11:03.280797+0000","last_undegraded":"2024-09-19T07:11:03.280797+0000","last_fullsized":"2024-09-19T07:11:03.280797+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:54.306541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.239116+0000","last_change":"2024-09-19T07:09:38.183567+0000","last_active":"2024-09-19T07:11:03.239116+0000","last_peered":"2024-09-19T07:11:03.239116+0000","last_clean":"2024-09-19T07:11:03.239116+0000","last_became_active":"2024-09-19T07:09:38.180778+0000","last_became_peered":"2024-09-19T07:09:38.180778+0000","last_unstale":"2024-09-19T07:11:03.239116+0000","last_undegraded":"2024-09-19T07:11:03.239116+0000","last_fullsized":"2024-09-19T07:11:03.239116+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:43.226551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"81'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.260607+0000","last_change":"2024-09-19T07:09:18.934457+0000","last_active":"2024-09-19T07:11:03.260607+0000","last_peered":"2024-09-19T07:11:03.260607+0000","last_clean":"2024-09-19T07:11:03.260607+0000","last_became_active":"2024-09-19T07:09:18.934126+0000","last_became_peered":"2024-09-19T07:09:18.934126+0000","last_unstale":"2024-09-19T07:11:03.260607+0000","last_undegraded":"2024-09-19T07:11:03.260607+0000","last_fullsized":"2024-09-19T07:11:03.260607+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:37:16.152335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.231606+0000","last_change":"2024-09-19T07:09:16.908457+0000","last_active":"2024-09-19T07:11:03.231606+0000","last_peered":"2024-09-19T07:11:03.231606+0000","last_clean":"2024-09-19T07:11:03.231606+0000","last_became_active":"2024-09-19T07:09:16.908128+0000","last_became_peered":"2024-09-19T07:09:16.908128+0000","last_unstale":"2024-09-19T07:11:03.231606+0000","last_undegraded":"2024-09-19T07:11:03.231606+0000","last_fullsized":"2024-09-19T07:11:03.231606+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:48:50.579301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.273932+0000","last_change":"2024-09-19T07:09:18.928763+0000","last_active":"2024-09-19T07:11:03.273932+0000","last_peered":"2024-09-19T07:11:03.273932+0000","last_clean":"2024-09-19T07:11:03.273932+0000","last_became_active":"2024-09-19T07:09:18.928231+0000","last_became_peered":"2024-09-19T07:09:18.928231+0000","last_unstale":"2024-09-19T07:11:03.273932+0000","last_undegraded":"2024-09-19T07:11:03.273932+0000","last_fullsized":"2024-09-19T07:11:03.273932+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:26.652378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.238773+0000","last_change":"2024-09-19T07:09:16.913740+0000","last_active":"2024-09-19T07:11:03.238773+0000","last_peered":"2024-09-19T07:11:03.238773+0000","last_clean":"2024-09-19T07:11:03.238773+0000","last_became_active":"2024-09-19T07:09:16.912419+0000","last_became_peered":"2024-09-19T07:09:16.912419+0000","last_unstale":"2024-09-19T07:11:03.238773+0000","last_undegraded":"2024-09-19T07:11:03.238773+0000","last_fullsized":"2024-09-19T07:11:03.238773+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:16.658996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.283782+0000","last_change":"2024-09-19T07:09:18.930697+0000","last_active":"2024-09-19T07:11:03.283782+0000","last_peered":"2024-09-19T07:11:03.283782+0000","last_clean":"2024-09-19T07:11:03.283782+0000","last_became_active":"2024-09-19T07:09:18.930355+0000","last_became_peered":"2024-09-19T07:09:18.930355+0000","last_unstale":"2024-09-19T07:11:03.283782+0000","last_undegraded":"2024-09-19T07:11:03.283782+0000","last_fullsized":"2024-09-19T07:11:03.283782+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:07.217195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.228781+0000","last_change":"2024-09-19T07:09:38.183637+0000","last_active":"2024-09-19T07:11:03.228781+0000","last_peered":"2024-09-19T07:11:03.228781+0000","last_clean":"2024-09-19T07:11:03.228781+0000","last_became_active":"2024-09-19T07:09:38.178732+0000","last_became_peered":"2024-09-19T07:09:38.178732+0000","last_unstale":"2024-09-19T07:11:03.228781+0000","last_undegraded":"2024-09-19T07:11:03.228781+0000","last_fullsized":"2024-09-19T07:11:03.228781+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:14.287130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.285232+0000","last_change":"2024-09-19T07:09:18.935120+0000","last_active":"2024-09-19T07:11:03.285232+0000","last_peered":"2024-09-19T07:11:03.285232+0000","last_clean":"2024-09-19T07:11:03.285232+0000","last_became_active":"2024-09-19T07:09:18.934227+0000","last_became_peered":"2024-09-19T07:09:18.934227+0000","last_unstale":"2024-09-19T07:11:03.285232+0000","last_undegraded":"2024-09-19T07:11:03.285232+0000","last_fullsized":"2024-09-19T07:11:03.285232+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:20.328983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"81'15","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.278695+0000","last_change":"2024-09-19T07:09:38.393512+0000","last_active":"2024-09-19T07:11:03.278695+0000","last_peered":"2024-09-19T07:11:03.278695+0000","last_clean":"2024-09-19T07:11:03.278695+0000","last_became_active":"2024-09-19T07:09:38.393200+0000","last_became_peered":"2024-09-19T07:09:38.393200+0000","last_unstale":"2024-09-19T07:11:03.278695+0000","last_undegraded":"2024-09-19T07:11:03.278695+0000","last_fullsized":"2024-09-19T07:11:03.278695+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:51.637520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.247033+0000","last_change":"2024-09-19T07:09:16.911129+0000","last_active":"2024-09-19T07:11:03.247033+0000","last_peered":"2024-09-19T07:11:03.247033+0000","last_clean":"2024-09-19T07:11:03.247033+0000","last_became_active":"2024-09-19T07:09:16.910583+0000","last_became_peered":"2024-09-19T07:09:16.910583+0000","last_unstale":"2024-09-19T07:11:03.247033+0000","last_undegraded":"2024-09-19T07:11:03.247033+0000","last_fullsized":"2024-09-19T07:11:03.247033+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:34:37.295838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.285042+0000","last_change":"2024-09-19T07:09:18.928622+0000","last_active":"2024-09-19T07:11:03.285042+0000","last_peered":"2024-09-19T07:11:03.285042+0000","last_clean":"2024-09-19T07:11:03.285042+0000","last_became_active":"2024-09-19T07:09:18.928284+0000","last_became_peered":"2024-09-19T07:09:18.928284+0000","last_unstale":"2024-09-19T07:11:03.285042+0000","last_undegraded":"2024-09-19T07:11:03.285042+0000","last_fullsized":"2024-09-19T07:11:03.285042+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:37:46.358756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.245062+0000","last_change":"2024-09-19T07:09:16.916142+0000","last_active":"2024-09-19T07:11:03.245062+0000","last_peered":"2024-09-19T07:11:03.245062+0000","last_clean":"2024-09-19T07:11:03.245062+0000","last_became_active":"2024-09-19T07:09:16.915766+0000","last_became_peered":"2024-09-19T07:09:16.915766+0000","last_unstale":"2024-09-19T07:11:03.245062+0000","last_undegraded":"2024-09-19T07:11:03.245062+0000","last_fullsized":"2024-09-19T07:11:03.245062+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:38.136422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.285015+0000","last_change":"2024-09-19T07:09:18.921912+0000","last_active":"2024-09-19T07:11:03.285015+0000","last_peered":"2024-09-19T07:11:03.285015+0000","last_clean":"2024-09-19T07:11:03.285015+0000","last_became_active":"2024-09-19T07:09:18.921595+0000","last_became_peered":"2024-09-19T07:09:18.921595+0000","last_unstale":"2024-09-19T07:11:03.285015+0000","last_undegraded":"2024-09-19T07:11:03.285015+0000","last_fullsized":"2024-09-19T07:11:03.285015+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:53.899052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.232331+0000","last_change":"2024-09-19T07:09:17.084856+0000","last_active":"2024-09-19T07:11:03.232331+0000","last_peered":"2024-09-19T07:11:03.232331+0000","last_clean":"2024-09-19T07:11:03.232331+0000","last_became_active":"2024-09-19T07:09:17.084541+0000","last_became_peered":"2024-09-19T07:09:17.084541+0000","last_unstale":"2024-09-19T07:11:03.232331+0000","last_undegraded":"2024-09-19T07:11:03.232331+0000","last_fullsized":"2024-09-19T07:11:03.232331+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:05.978765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"81'5","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:03.274504+0000","last_change":"2024-09-19T07:09:18.923732+0000","last_active":"2024-09-19T07:11:03.274504+0000","last_peered":"2024-09-19T07:11:03.274504+0000","last_clean":"2024-09-19T07:11:03.274504+0000","last_became_active":"2024-09-19T07:09:18.923410+0000","last_became_peered":"2024-09-19T07:09:18.923410+0000","last_unstale":"2024-09-19T07:11:03.274504+0000","last_undegraded":"2024-09-19T07:11:03.274504+0000","last_fullsized":"2024-09-19T07:11:03.274504+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:17.898633+0000","last_clean_scrub_stamp":"2024-09-19T07:09:17.898633+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:01:20.208414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:11:13.014423+0000","last_change":"2024-09-19T07:09:16.910364+0000","last_active":"2024-09-19T07:11:13.014423+0000","last_peered":"2024-09-19T07:11:13.014423+0000","last_clean":"2024-09-19T07:11:13.014423+0000","last_became_active":"2024-09-19T07:09:16.909835+0000","last_became_peered":"2024-09-19T07:09:16.909835+0000","last_unstale":"2024-09-19T07:11:13.014423+0000","last_undegraded":"2024-09-19T07:11:13.014423+0000","last_fullsized":"2024-09-19T07:11:13.014423+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:09:15.890772+0000","last_clean_scrub_stamp":"2024-09-19T07:09:15.890772+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:05.198823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":794486,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":1042,"num_read_kb":728,"num_write":420,"num_write_kb":2353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":26947,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2617344,"data_stored":2383458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":308,"ondisk_log_size":308,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645349,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":892928,"data_stored":437435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874281,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":33188,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93711964,"statfs":{"total":95995035648,"available":95961051136,"internally_reserved":0,"allocated":1929216,"data_stored":1424948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037807,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32456,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712696,"statfs":{"total":95995035648,"available":95961800704,"internally_reserved":0,"allocated":1302528,"data_stored":830887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266739,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36616,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708536,"statfs":{"total":95995035648,"available":95957540864,"internally_reserved":0,"allocated":1302528,"data_stored":830807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495672,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32656,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712496,"statfs":{"total":95995035648,"available":95961595904,"internally_reserved":0,"allocated":1503232,"data_stored":1032078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659198,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":897024,"data_stored":437060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888130,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":33108,"kb_used_data":1804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712044,"statfs":{"total":95995035648,"available":95961133056,"internally_reserved":0,"allocated":1847296,"data_stored":1358674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018951,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":978944,"data_stored":505297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247884,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32904,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712248,"statfs":{"total":95995035648,"available":95961341952,"internally_reserved":0,"allocated":1638400,"data_stored":1158819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444113,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":439831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607638,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":966656,"data_stored":503333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":917504,"data_stored":438331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":741376,"data_stored":721732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":360448,"data_stored":331336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":4740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":393954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":397610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T07:11:20.001 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:11:20.251 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:11:20.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.759+0000 7f9ebd8ca640 1 -- 172.21.15.148:0/903266254 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9eb8102d40 msgr2=0x7f9eb8103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:20.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.759+0000 7f9ebd8ca640 1 --2- 172.21.15.148:0/903266254 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9eb8102d40 0x7f9eb8103120 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8009ca0 tx=0x7f9ea802a950 comp rx=0 tx=0).stop 2024-09-19T07:11:20.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.760+0000 7f9ebd8ca640 1 -- 172.21.15.148:0/903266254 shutdown_connections 2024-09-19T07:11:20.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.760+0000 7f9ebd8ca640 1 --2- 172.21.15.148:0/903266254 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9eb810c170 0x7f9eb810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:20.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.760+0000 7f9ebd8ca640 1 --2- 172.21.15.148:0/903266254 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9eb8103660 0x7f9eb810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:20.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.760+0000 7f9ebd8ca640 1 --2- 172.21.15.148:0/903266254 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9eb8102d40 0x7f9eb8103120 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:20.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.760+0000 7f9ebd8ca640 1 -- 172.21.15.148:0/903266254 >> 172.21.15.148:0/903266254 conn(0x7f9eb80fc7a0 msgr2=0x7f9eb80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:20.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.760+0000 7f9ebd8ca640 1 -- 172.21.15.148:0/903266254 shutdown_connections 2024-09-19T07:11:20.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.760+0000 7f9ebd8ca640 1 -- 172.21.15.148:0/903266254 wait complete. 2024-09-19T07:11:20.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.760+0000 7f9ebd8ca640 1 Processor -- start 2024-09-19T07:11:20.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.761+0000 7f9ebd8ca640 1 -- start start 2024-09-19T07:11:20.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.761+0000 7f9ebd8ca640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9eb8102d40 0x7f9eb8198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:20.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.761+0000 7f9ebd8ca640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9eb8103660 0x7f9eb8198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:20.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.761+0000 7f9ebd8ca640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9eb810c170 0x7f9eb819ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:20.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.761+0000 7f9ebd8ca640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb8111f70 con 0x7f9eb8103660 2024-09-19T07:11:20.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.761+0000 7f9ebd8ca640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb8111df0 con 0x7f9eb8102d40 2024-09-19T07:11:20.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.761+0000 7f9ebd8ca640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb81120f0 con 0x7f9eb810c170 2024-09-19T07:11:20.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.761+0000 7f9eb67fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9eb8103660 0x7f9eb8198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:20.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.761+0000 7f9eb67fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9eb8103660 0x7f9eb8198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51370/0 (socket says 172.21.15.148:51370) 2024-09-19T07:11:20.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.761+0000 7f9eb67fc640 1 -- 172.21.15.148:0/2369842935 learned_addr learned my addr 172.21.15.148:0/2369842935 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:20.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.761+0000 7f9eb77fe640 1 --2- 172.21.15.148:0/2369842935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9eb810c170 0x7f9eb819ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:20.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.761+0000 7f9eb6ffd640 1 --2- 172.21.15.148:0/2369842935 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9eb8102d40 0x7f9eb8198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:20.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.761+0000 7f9eb67fc640 1 -- 172.21.15.148:0/2369842935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9eb810c170 msgr2=0x7f9eb819ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:20.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.761+0000 7f9eb67fc640 1 --2- 172.21.15.148:0/2369842935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9eb810c170 0x7f9eb819ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:20.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.761+0000 7f9eb67fc640 1 -- 172.21.15.148:0/2369842935 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9eb8102d40 msgr2=0x7f9eb8198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:20.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.761+0000 7f9eb67fc640 1 --2- 172.21.15.148:0/2369842935 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9eb8102d40 0x7f9eb8198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:20.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.761+0000 7f9eb67fc640 1 -- 172.21.15.148:0/2369842935 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eb819d3d0 con 0x7f9eb8103660 2024-09-19T07:11:20.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.761+0000 7f9eb6ffd640 1 --2- 172.21.15.148:0/2369842935 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9eb8102d40 0x7f9eb8198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:11:20.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.761+0000 7f9eb67fc640 1 --2- 172.21.15.148:0/2369842935 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9eb8103660 0x7f9eb8198960 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9eac00e9f0 tx=0x7f9eac00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:20.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.762+0000 7f9ebc8c8640 1 -- 172.21.15.148:0/2369842935 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eac00ccc0 con 0x7f9eb8103660 2024-09-19T07:11:20.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.762+0000 7f9ebd8ca640 1 -- 172.21.15.148:0/2369842935 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9eb819d6c0 con 0x7f9eb8103660 2024-09-19T07:11:20.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.762+0000 7f9ebc8c8640 1 -- 172.21.15.148:0/2369842935 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9eac010910 con 0x7f9eb8103660 2024-09-19T07:11:20.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.762+0000 7f9ebc8c8640 1 -- 172.21.15.148:0/2369842935 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eac018920 con 0x7f9eb8103660 2024-09-19T07:11:20.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.762+0000 7f9ebd8ca640 1 -- 172.21.15.148:0/2369842935 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9eb81a4fa0 con 0x7f9eb8103660 2024-09-19T07:11:20.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.763+0000 7f9ebd8ca640 1 -- 172.21.15.148:0/2369842935 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9eb8103120 con 0x7f9eb8103660 2024-09-19T07:11:20.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.764+0000 7f9ebc8c8640 1 -- 172.21.15.148:0/2369842935 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f9eac010430 con 0x7f9eb8103660 2024-09-19T07:11:20.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.765+0000 7f9ebc8c8640 1 --2- 172.21.15.148:0/2369842935 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f9ea00a3440 0x7f9ea00a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:20.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.765+0000 7f9eb6ffd640 1 --2- 172.21.15.148:0/2369842935 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f9ea00a3440 0x7f9ea00a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:20.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.765+0000 7f9ebc8c8640 1 -- 172.21.15.148:0/2369842935 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f9eac0d0690 con 0x7f9eb8103660 2024-09-19T07:11:20.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.765+0000 7f9eb6ffd640 1 --2- 172.21.15.148:0/2369842935 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f9ea00a3440 0x7f9ea00a5900 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8005cc0 tx=0x7f9ea8005c30 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:20.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.768+0000 7f9ebc8c8640 1 -- 172.21.15.148:0/2369842935 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9eac09ced0 con 0x7f9eb8103660 2024-09-19T07:11:20.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.970+0000 7f9ebd8ca640 1 -- 172.21.15.148:0/2369842935 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9eb8199780 con 0x7f9eb8103660 2024-09-19T07:11:20.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.970+0000 7f9ebc8c8640 1 -- 172.21.15.148:0/2369842935 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11939 (secure 0 0 0) 0x7f9eb8199780 con 0x7f9eb8103660 2024-09-19T07:11:20.972 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:11:20.972 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 25 2024-09-19T07:11:20.972 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":25,"btime":"2024-09-19T07:11:04:227331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/4263868576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":4263868576},{"type":"v1","addr":"172.21.15.148:6841","nonce":4263868576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24383,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2146820965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2146820965},{"type":"v1","addr":"172.21.15.165:6835","nonce":2146820965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:09:19.543369+0000","modified":"2024-09-19T07:11:03.969598+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24457,"mds_1":24437,"mds_2":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/1566489108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1566489108},{"type":"v1","addr":"172.21.15.179:6835","nonce":1566489108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.165:6839/3993490234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":3993490234},{"type":"v1","addr":"172.21.15.165:6839","nonce":3993490234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24457,"qdb_cluster":[24457,24437,24436]},"id":1}]} 2024-09-19T07:11:20.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.972+0000 7f9ebd8ca640 1 -- 172.21.15.148:0/2369842935 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f9ea00a3440 msgr2=0x7f9ea00a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:20.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.972+0000 7f9ebd8ca640 1 --2- 172.21.15.148:0/2369842935 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f9ea00a3440 0x7f9ea00a5900 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8005cc0 tx=0x7f9ea8005c30 comp rx=0 tx=0).stop 2024-09-19T07:11:20.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.972+0000 7f9ebd8ca640 1 -- 172.21.15.148:0/2369842935 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9eb8103660 msgr2=0x7f9eb8198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:20.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.972+0000 7f9ebd8ca640 1 --2- 172.21.15.148:0/2369842935 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9eb8103660 0x7f9eb8198960 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9eac00e9f0 tx=0x7f9eac00eeb0 comp rx=0 tx=0).stop 2024-09-19T07:11:20.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.972+0000 7f9ebd8ca640 1 -- 172.21.15.148:0/2369842935 shutdown_connections 2024-09-19T07:11:20.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.972+0000 7f9ebd8ca640 1 --2- 172.21.15.148:0/2369842935 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f9ea00a3440 0x7f9ea00a5900 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:20.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.972+0000 7f9ebd8ca640 1 --2- 172.21.15.148:0/2369842935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9eb810c170 0x7f9eb819ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:20.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.972+0000 7f9ebd8ca640 1 --2- 172.21.15.148:0/2369842935 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9eb8103660 0x7f9eb8198960 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:20.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.972+0000 7f9ebd8ca640 1 --2- 172.21.15.148:0/2369842935 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9eb8102d40 0x7f9eb8198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:20.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.972+0000 7f9ebd8ca640 1 -- 172.21.15.148:0/2369842935 >> 172.21.15.148:0/2369842935 conn(0x7f9eb80fc7a0 msgr2=0x7f9eb80fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:20.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.973+0000 7f9ebd8ca640 1 -- 172.21.15.148:0/2369842935 shutdown_connections 2024-09-19T07:11:20.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:20.973+0000 7f9ebd8ca640 1 -- 172.21.15.148:0/2369842935 wait complete. 2024-09-19T07:11:21.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:21 smithi148 ceph-mon[31180]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 76 KiB/s wr, 49 op/s 2024-09-19T07:11:21.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:21 smithi148 ceph-mon[31180]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:11:21.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:21 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/2369842935' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:11:21.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:21 smithi165 ceph-mon[35326]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 76 KiB/s wr, 49 op/s 2024-09-19T07:11:21.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:21 smithi165 ceph-mon[35326]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:11:21.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:21 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/2369842935' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:11:21.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:21 smithi179 ceph-mon[35716]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 76 KiB/s wr, 49 op/s 2024-09-19T07:11:21.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:21 smithi179 ceph-mon[35716]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:11:21.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:21 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/2369842935' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:11:21.755 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:11:22.000 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:11:22.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.475+0000 7f71acf73640 1 -- 172.21.15.148:0/2153810060 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71a8105bf0 msgr2=0x7f71a8105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:22.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.475+0000 7f71acf73640 1 --2- 172.21.15.148:0/2153810060 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71a8105bf0 0x7f71a8105fd0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f719c009900 tx=0x7f719c02a410 comp rx=0 tx=0).stop 2024-09-19T07:11:22.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.475+0000 7f71acf73640 1 -- 172.21.15.148:0/2153810060 shutdown_connections 2024-09-19T07:11:22.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.475+0000 7f71acf73640 1 --2- 172.21.15.148:0/2153810060 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71a8102110 0x7f71a810d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:22.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.475+0000 7f71acf73640 1 --2- 172.21.15.148:0/2153810060 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f71a8101790 0x7f71a8101bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:22.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.475+0000 7f71acf73640 1 --2- 172.21.15.148:0/2153810060 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71a8105bf0 0x7f71a8105fd0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:22.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.475+0000 7f71acf73640 1 -- 172.21.15.148:0/2153810060 >> 172.21.15.148:0/2153810060 conn(0x7f71a8077210 msgr2=0x7f71a8077620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:22.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.475+0000 7f71acf73640 1 -- 172.21.15.148:0/2153810060 shutdown_connections 2024-09-19T07:11:22.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.475+0000 7f71acf73640 1 -- 172.21.15.148:0/2153810060 wait complete. 2024-09-19T07:11:22.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.476+0000 7f71acf73640 1 Processor -- start 2024-09-19T07:11:22.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.476+0000 7f71acf73640 1 -- start start 2024-09-19T07:11:22.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.476+0000 7f71acf73640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71a8101790 0x7f71a8198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:22.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.476+0000 7f71acf73640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f71a8102110 0x7f71a81988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:22.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.476+0000 7f71acf73640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71a8105bf0 0x7f71a819cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:22.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.476+0000 7f71acf73640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f71a8110ea0 con 0x7f71a8105bf0 2024-09-19T07:11:22.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.476+0000 7f71acf73640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f71a8110d20 con 0x7f71a8102110 2024-09-19T07:11:22.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.476+0000 7f71acf73640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f71a8111020 con 0x7f71a8101790 2024-09-19T07:11:22.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.476+0000 7f71a6d9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71a8105bf0 0x7f71a819cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:22.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.476+0000 7f71a6d9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71a8105bf0 0x7f71a819cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51388/0 (socket says 172.21.15.148:51388) 2024-09-19T07:11:22.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.476+0000 7f71a6d9d640 1 -- 172.21.15.148:0/2145602492 learned_addr learned my addr 172.21.15.148:0/2145602492 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:22.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.476+0000 7f71a659c640 1 --2- 172.21.15.148:0/2145602492 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71a8101790 0x7f71a8198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:22.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.476+0000 7f71a5d9b640 1 --2- 172.21.15.148:0/2145602492 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f71a8102110 0x7f71a81988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:22.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.476+0000 7f71a6d9d640 1 -- 172.21.15.148:0/2145602492 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71a8101790 msgr2=0x7f71a8198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:22.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.476+0000 7f71a6d9d640 1 --2- 172.21.15.148:0/2145602492 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71a8101790 0x7f71a8198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:22.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.476+0000 7f71a6d9d640 1 -- 172.21.15.148:0/2145602492 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f71a8102110 msgr2=0x7f71a81988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:22.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.476+0000 7f71a6d9d640 1 --2- 172.21.15.148:0/2145602492 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f71a8102110 0x7f71a81988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:22.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.477+0000 7f71a6d9d640 1 -- 172.21.15.148:0/2145602492 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71a819d330 con 0x7f71a8105bf0 2024-09-19T07:11:22.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.477+0000 7f71a6d9d640 1 --2- 172.21.15.148:0/2145602492 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71a8105bf0 0x7f71a819cc50 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f71a000cad0 tx=0x7f71a000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:22.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.477+0000 7f71977fe640 1 -- 172.21.15.148:0/2145602492 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a000ae20 con 0x7f71a8105bf0 2024-09-19T07:11:22.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.477+0000 7f71977fe640 1 -- 172.21.15.148:0/2145602492 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71a0005020 con 0x7f71a8105bf0 2024-09-19T07:11:22.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.477+0000 7f71acf73640 1 -- 172.21.15.148:0/2145602492 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71a819d620 con 0x7f71a8105bf0 2024-09-19T07:11:22.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.477+0000 7f71977fe640 1 -- 172.21.15.148:0/2145602492 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a000f6f0 con 0x7f71a8105bf0 2024-09-19T07:11:22.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.477+0000 7f71acf73640 1 -- 172.21.15.148:0/2145602492 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71a81a4f00 con 0x7f71a8105bf0 2024-09-19T07:11:22.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.478+0000 7f71acf73640 1 -- 172.21.15.148:0/2145602492 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71a8101bd0 con 0x7f71a8105bf0 2024-09-19T07:11:22.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.479+0000 7f71977fe640 1 -- 172.21.15.148:0/2145602492 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f71a00051d0 con 0x7f71a8105bf0 2024-09-19T07:11:22.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.480+0000 7f71977fe640 1 --2- 172.21.15.148:0/2145602492 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f71900a3440 0x7f71900a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:22.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.480+0000 7f71a659c640 1 --2- 172.21.15.148:0/2145602492 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f71900a3440 0x7f71900a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:22.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.480+0000 7f71977fe640 1 -- 172.21.15.148:0/2145602492 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f71a00d0210 con 0x7f71a8105bf0 2024-09-19T07:11:22.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.480+0000 7f71a659c640 1 --2- 172.21.15.148:0/2145602492 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f71900a3440 0x7f71900a5900 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f719c000c00 tx=0x7f719c0058d0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:22.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.484+0000 7f71977fe640 1 -- 172.21.15.148:0/2145602492 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f71a0014030 con 0x7f71a8105bf0 2024-09-19T07:11:22.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.684+0000 7f71acf73640 1 -- 172.21.15.148:0/2145602492 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f71a8109970 con 0x7f71a8105bf0 2024-09-19T07:11:22.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.685+0000 7f71977fe640 1 -- 172.21.15.148:0/2145602492 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11939 (secure 0 0 0) 0x7f71a009ca90 con 0x7f71a8105bf0 2024-09-19T07:11:22.686 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:11:22.686 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":25,"btime":"2024-09-19T07:11:04:227331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/4263868576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":4263868576},{"type":"v1","addr":"172.21.15.148:6841","nonce":4263868576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24383,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2146820965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2146820965},{"type":"v1","addr":"172.21.15.165:6835","nonce":2146820965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:09:19.543369+0000","modified":"2024-09-19T07:11:03.969598+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24457,"mds_1":24437,"mds_2":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/1566489108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1566489108},{"type":"v1","addr":"172.21.15.179:6835","nonce":1566489108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.165:6839/3993490234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":3993490234},{"type":"v1","addr":"172.21.15.165:6839","nonce":3993490234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24457,"qdb_cluster":[24457,24437,24436]},"id":1}]} 2024-09-19T07:11:22.686 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 25 2024-09-19T07:11:22.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.687+0000 7f71acf73640 1 -- 172.21.15.148:0/2145602492 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f71900a3440 msgr2=0x7f71900a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:22.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.687+0000 7f71acf73640 1 --2- 172.21.15.148:0/2145602492 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f71900a3440 0x7f71900a5900 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f719c000c00 tx=0x7f719c0058d0 comp rx=0 tx=0).stop 2024-09-19T07:11:22.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.687+0000 7f71acf73640 1 -- 172.21.15.148:0/2145602492 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71a8105bf0 msgr2=0x7f71a819cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:22.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.687+0000 7f71acf73640 1 --2- 172.21.15.148:0/2145602492 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71a8105bf0 0x7f71a819cc50 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f71a000cad0 tx=0x7f71a000cf90 comp rx=0 tx=0).stop 2024-09-19T07:11:22.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.687+0000 7f71acf73640 1 -- 172.21.15.148:0/2145602492 shutdown_connections 2024-09-19T07:11:22.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.687+0000 7f71acf73640 1 --2- 172.21.15.148:0/2145602492 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f71900a3440 0x7f71900a5900 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:22.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.687+0000 7f71acf73640 1 --2- 172.21.15.148:0/2145602492 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71a8105bf0 0x7f71a819cc50 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:22.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.687+0000 7f71acf73640 1 --2- 172.21.15.148:0/2145602492 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f71a8102110 0x7f71a81988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:22.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.687+0000 7f71acf73640 1 --2- 172.21.15.148:0/2145602492 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71a8101790 0x7f71a8198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:22.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.687+0000 7f71acf73640 1 -- 172.21.15.148:0/2145602492 >> 172.21.15.148:0/2145602492 conn(0x7f71a8077210 msgr2=0x7f71a80ff9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:22.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.687+0000 7f71acf73640 1 -- 172.21.15.148:0/2145602492 shutdown_connections 2024-09-19T07:11:22.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:22.687+0000 7f71acf73640 1 -- 172.21.15.148:0/2145602492 wait complete. 2024-09-19T07:11:23.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:23 smithi148 ceph-mon[31180]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 76 KiB/s wr, 46 op/s 2024-09-19T07:11:23.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:23 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/2145602492' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:11:23.374 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T07:11:23.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:23 smithi165 ceph-mon[35326]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 76 KiB/s wr, 46 op/s 2024-09-19T07:11:23.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:23 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/2145602492' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:11:23.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:23 smithi179 ceph-mon[35716]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 76 KiB/s wr, 46 op/s 2024-09-19T07:11:23.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:23 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/2145602492' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:11:23.623 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:11:24.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.119+0000 7f7174f33640 1 -- 172.21.15.148:0/267231709 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f717010c170 msgr2=0x7f717010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:24.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.119+0000 7f7174f33640 1 --2- 172.21.15.148:0/267231709 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f717010c170 0x7f717010e610 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7168009ca0 tx=0x7f716802a950 comp rx=0 tx=0).stop 2024-09-19T07:11:24.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.119+0000 7f7174f33640 1 -- 172.21.15.148:0/267231709 shutdown_connections 2024-09-19T07:11:24.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.119+0000 7f7174f33640 1 --2- 172.21.15.148:0/267231709 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f717010c170 0x7f717010e610 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:24.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.119+0000 7f7174f33640 1 --2- 172.21.15.148:0/267231709 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7170103660 0x7f717010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:24.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.119+0000 7f7174f33640 1 --2- 172.21.15.148:0/267231709 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7170102d40 0x7f7170103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:24.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.119+0000 7f7174f33640 1 -- 172.21.15.148:0/267231709 >> 172.21.15.148:0/267231709 conn(0x7f71700fc7a0 msgr2=0x7f71700febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:24.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.119+0000 7f7174f33640 1 -- 172.21.15.148:0/267231709 shutdown_connections 2024-09-19T07:11:24.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.119+0000 7f7174f33640 1 -- 172.21.15.148:0/267231709 wait complete. 2024-09-19T07:11:24.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.120+0000 7f7174f33640 1 Processor -- start 2024-09-19T07:11:24.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.120+0000 7f7174f33640 1 -- start start 2024-09-19T07:11:24.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.120+0000 7f7174f33640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7170102d40 0x7f7170198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:24.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.120+0000 7f7174f33640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7170103660 0x7f71701988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:24.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.120+0000 7f7174f33640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f717010c170 0x7f717019cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:24.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.121+0000 7f7174f33640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7170111fc0 con 0x7f7170102d40 2024-09-19T07:11:24.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.121+0000 7f7174f33640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7170111e40 con 0x7f7170103660 2024-09-19T07:11:24.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.121+0000 7f7174f33640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7170112140 con 0x7f717010c170 2024-09-19T07:11:24.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.121+0000 7f716e59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7170102d40 0x7f7170198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:24.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.121+0000 7f716e59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7170102d40 0x7f7170198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51408/0 (socket says 172.21.15.148:51408) 2024-09-19T07:11:24.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.121+0000 7f716e59c640 1 -- 172.21.15.148:0/50726023 learned_addr learned my addr 172.21.15.148:0/50726023 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:24.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.121+0000 7f716dd9b640 1 --2- 172.21.15.148:0/50726023 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7170103660 0x7f71701988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:24.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.121+0000 7f716ed9d640 1 --2- 172.21.15.148:0/50726023 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f717010c170 0x7f717019cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:24.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.121+0000 7f716e59c640 1 -- 172.21.15.148:0/50726023 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f717010c170 msgr2=0x7f717019cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:24.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.121+0000 7f716e59c640 1 --2- 172.21.15.148:0/50726023 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f717010c170 0x7f717019cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:24.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.121+0000 7f716e59c640 1 -- 172.21.15.148:0/50726023 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7170103660 msgr2=0x7f71701988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:24.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.121+0000 7f716e59c640 1 --2- 172.21.15.148:0/50726023 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7170103660 0x7f71701988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:24.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.121+0000 7f716e59c640 1 -- 172.21.15.148:0/50726023 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f717019d330 con 0x7f7170102d40 2024-09-19T07:11:24.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.121+0000 7f716e59c640 1 --2- 172.21.15.148:0/50726023 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7170102d40 0x7f7170198380 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f716000c890 tx=0x7f716000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:24.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.121+0000 7f715f7fe640 1 -- 172.21.15.148:0/50726023 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7160004220 con 0x7f7170102d40 2024-09-19T07:11:24.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.121+0000 7f7174f33640 1 -- 172.21.15.148:0/50726023 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f717019d620 con 0x7f7170102d40 2024-09-19T07:11:24.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.121+0000 7f715f7fe640 1 -- 172.21.15.148:0/50726023 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71600043c0 con 0x7f7170102d40 2024-09-19T07:11:24.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.121+0000 7f715f7fe640 1 -- 172.21.15.148:0/50726023 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7160004a00 con 0x7f7170102d40 2024-09-19T07:11:24.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.121+0000 7f7174f33640 1 -- 172.21.15.148:0/50726023 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71701a4f00 con 0x7f7170102d40 2024-09-19T07:11:24.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.122+0000 7f7174f33640 1 -- 172.21.15.148:0/50726023 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7170103120 con 0x7f7170102d40 2024-09-19T07:11:24.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.123+0000 7f715f7fe640 1 -- 172.21.15.148:0/50726023 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f71600079b0 con 0x7f7170102d40 2024-09-19T07:11:24.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.124+0000 7f715f7fe640 1 --2- 172.21.15.148:0/50726023 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f71580a3440 0x7f71580a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:24.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.124+0000 7f716dd9b640 1 --2- 172.21.15.148:0/50726023 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f71580a3440 0x7f71580a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:24.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.124+0000 7f715f7fe640 1 -- 172.21.15.148:0/50726023 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f71600cfc60 con 0x7f7170102d40 2024-09-19T07:11:24.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.125+0000 7f716dd9b640 1 --2- 172.21.15.148:0/50726023 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f71580a3440 0x7f71580a5900 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7164005fd0 tx=0x7f7164005f60 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:24.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.128+0000 7f715f7fe640 1 -- 172.21.15.148:0/50726023 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7160014030 con 0x7f7170102d40 2024-09-19T07:11:24.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.296+0000 7f7174f33640 1 -- 172.21.15.148:0/50726023 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f71701a5160 con 0x7f7170102d40 2024-09-19T07:11:24.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.298+0000 7f715f7fe640 1 -- 172.21.15.148:0/50726023 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+23254 (secure 0 0 0) 0x7f716009c4e0 con 0x7f7170102d40 2024-09-19T07:11:24.299 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:11:24.299 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":81,"fsid":"eae8a4a8-7654-11ef-bceb-c7b262605968","created":"2024-09-19T07:01:47.891210+0000","modified":"2024-09-19T07:11:03.220907+0000","last_up_change":"2024-09-19T07:08:30.785262+0000","last_in_change":"2024-09-19T07:08:07.001808+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:04:49.313270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T07:09:15.840600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T07:09:17.690782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7b854fad-d5a3-43e3-862e-7a0e8f243c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6803","nonce":512186330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6805","nonce":512186330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6809","nonce":512186330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6807","nonce":512186330}]},"public_addr":"172.21.15.148:6803/512186330","cluster_addr":"172.21.15.148:6805/512186330","heartbeat_back_addr":"172.21.15.148:6809/512186330","heartbeat_front_addr":"172.21.15.148:6807/512186330","state":["exists","up"]},{"osd":1,"uuid":"61b26278-f4db-40f0-97b9-c12a6ef1cd06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6801","nonce":2433984552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6803","nonce":2433984552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6807","nonce":2433984552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6805","nonce":2433984552}]},"public_addr":"172.21.15.165:6801/2433984552","cluster_addr":"172.21.15.165:6803/2433984552","heartbeat_back_addr":"172.21.15.165:6807/2433984552","heartbeat_front_addr":"172.21.15.165:6805/2433984552","state":["exists","up"]},{"osd":2,"uuid":"06620bbc-cdb5-4afc-8122-0bb3126630f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6801","nonce":3048365223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6803","nonce":3048365223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6807","nonce":3048365223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6805","nonce":3048365223}]},"public_addr":"172.21.15.179:6801/3048365223","cluster_addr":"172.21.15.179:6803/3048365223","heartbeat_back_addr":"172.21.15.179:6807/3048365223","heartbeat_front_addr":"172.21.15.179:6805/3048365223","state":["exists","up"]},{"osd":3,"uuid":"d7df45d4-5ef1-4f66-84a7-f61b8756c0c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6811","nonce":3662789091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6813","nonce":3662789091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6817","nonce":3662789091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6815","nonce":3662789091}]},"public_addr":"172.21.15.148:6811/3662789091","cluster_addr":"172.21.15.148:6813/3662789091","heartbeat_back_addr":"172.21.15.148:6817/3662789091","heartbeat_front_addr":"172.21.15.148:6815/3662789091","state":["exists","up"]},{"osd":4,"uuid":"5cfd359b-a8d2-4bdc-858f-087d26e0869c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6809","nonce":3082550323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6811","nonce":3082550323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6815","nonce":3082550323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6813","nonce":3082550323}]},"public_addr":"172.21.15.165:6809/3082550323","cluster_addr":"172.21.15.165:6811/3082550323","heartbeat_back_addr":"172.21.15.165:6815/3082550323","heartbeat_front_addr":"172.21.15.165:6813/3082550323","state":["exists","up"]},{"osd":5,"uuid":"8295e69b-87fe-4403-bb2e-d9dd42e2f398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6809","nonce":2125213751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6811","nonce":2125213751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6815","nonce":2125213751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6813","nonce":2125213751}]},"public_addr":"172.21.15.179:6809/2125213751","cluster_addr":"172.21.15.179:6811/2125213751","heartbeat_back_addr":"172.21.15.179:6815/2125213751","heartbeat_front_addr":"172.21.15.179:6813/2125213751","state":["exists","up"]},{"osd":6,"uuid":"4ce38d1a-06d3-4606-b00d-aa1ff977025f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6819","nonce":2178980310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6821","nonce":2178980310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6825","nonce":2178980310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6823","nonce":2178980310}]},"public_addr":"172.21.15.148:6819/2178980310","cluster_addr":"172.21.15.148:6821/2178980310","heartbeat_back_addr":"172.21.15.148:6825/2178980310","heartbeat_front_addr":"172.21.15.148:6823/2178980310","state":["exists","up"]},{"osd":7,"uuid":"9e68e2b2-9838-4ec0-b473-24f2434695ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6817","nonce":3961600099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6819","nonce":3961600099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6823","nonce":3961600099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6821","nonce":3961600099}]},"public_addr":"172.21.15.165:6817/3961600099","cluster_addr":"172.21.15.165:6819/3961600099","heartbeat_back_addr":"172.21.15.165:6823/3961600099","heartbeat_front_addr":"172.21.15.165:6821/3961600099","state":["exists","up"]},{"osd":8,"uuid":"297acce6-d3c7-4e1a-bf87-be093de51a6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6817","nonce":3642931467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6819","nonce":3642931467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6823","nonce":3642931467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6821","nonce":3642931467}]},"public_addr":"172.21.15.179:6817/3642931467","cluster_addr":"172.21.15.179:6819/3642931467","heartbeat_back_addr":"172.21.15.179:6823/3642931467","heartbeat_front_addr":"172.21.15.179:6821/3642931467","state":["exists","up"]},{"osd":9,"uuid":"ef488c5e-5353-4695-99dd-5b74ade436d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6827","nonce":3135409630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6829","nonce":3135409630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6833","nonce":3135409630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6831","nonce":3135409630}]},"public_addr":"172.21.15.148:6827/3135409630","cluster_addr":"172.21.15.148:6829/3135409630","heartbeat_back_addr":"172.21.15.148:6833/3135409630","heartbeat_front_addr":"172.21.15.148:6831/3135409630","state":["exists","up"]},{"osd":10,"uuid":"7a9f0379-1199-4266-910c-8d1d313d39e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6825","nonce":3554110731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6827","nonce":3554110731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6831","nonce":3554110731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6829","nonce":3554110731}]},"public_addr":"172.21.15.165:6825/3554110731","cluster_addr":"172.21.15.165:6827/3554110731","heartbeat_back_addr":"172.21.15.165:6831/3554110731","heartbeat_front_addr":"172.21.15.165:6829/3554110731","state":["exists","up"]},{"osd":11,"uuid":"eede97e9-5685-4603-806e-7078c6940536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6825","nonce":2026109940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6827","nonce":2026109940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6831","nonce":2026109940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6829","nonce":2026109940}]},"public_addr":"172.21.15.179:6825/2026109940","cluster_addr":"172.21.15.179:6827/2026109940","heartbeat_back_addr":"172.21.15.179:6831/2026109940","heartbeat_front_addr":"172.21.15.179:6829/2026109940","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:03:56.291685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:21.419682+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:46.377012+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:11.484234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:36.723101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:06:00.294617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:06:25.147230+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:06:49.318576+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:07:13.896399+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:07:38.930999+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:08:03.803463+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:08:28.731343+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.148:0/2510377205":"2024-09-20T07:11:03.220856+0000","172.21.15.148:0/1725756124":"2024-09-20T07:11:03.220856+0000","172.21.15.148:0/2638338746":"2024-09-20T07:11:03.220856+0000","172.21.15.148:0/174481494":"2024-09-20T07:02:14.557425+0000","172.21.15.148:0/3756905316":"2024-09-20T07:11:03.220856+0000","172.21.15.148:0/1480486619":"2024-09-20T07:02:14.557425+0000","172.21.15.148:6801/2161746152":"2024-09-20T07:02:14.557425+0000","172.21.15.148:6800/2161746152":"2024-09-20T07:02:14.557425+0000","172.21.15.148:6800/1949849385":"2024-09-20T07:02:37.007183+0000","172.21.15.148:0/1114469409":"2024-09-20T07:02:14.557425+0000","172.21.15.148:0/1922521135":"2024-09-20T07:02:37.007183+0000","172.21.15.148:6801/3007822654":"2024-09-20T07:11:03.220856+0000","172.21.15.148:0/1958388906":"2024-09-20T07:02:37.007183+0000","172.21.15.148:6801/1949849385":"2024-09-20T07:02:37.007183+0000","172.21.15.148:0/3534559227":"2024-09-20T07:02:37.007183+0000","172.21.15.148:0/1224758996":"2024-09-20T07:11:03.220856+0000","172.21.15.148:6800/3007822654":"2024-09-20T07:11:03.220856+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T07:11:24.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.300+0000 7f7174f33640 1 -- 172.21.15.148:0/50726023 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f71580a3440 msgr2=0x7f71580a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:24.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.300+0000 7f7174f33640 1 --2- 172.21.15.148:0/50726023 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f71580a3440 0x7f71580a5900 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7164005fd0 tx=0x7f7164005f60 comp rx=0 tx=0).stop 2024-09-19T07:11:24.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.300+0000 7f7174f33640 1 -- 172.21.15.148:0/50726023 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7170102d40 msgr2=0x7f7170198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:24.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.300+0000 7f7174f33640 1 --2- 172.21.15.148:0/50726023 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7170102d40 0x7f7170198380 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f716000c890 tx=0x7f716000cd50 comp rx=0 tx=0).stop 2024-09-19T07:11:24.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.300+0000 7f7174f33640 1 -- 172.21.15.148:0/50726023 shutdown_connections 2024-09-19T07:11:24.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.300+0000 7f7174f33640 1 --2- 172.21.15.148:0/50726023 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f71580a3440 0x7f71580a5900 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:24.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.300+0000 7f7174f33640 1 --2- 172.21.15.148:0/50726023 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f717010c170 0x7f717019cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:24.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.300+0000 7f7174f33640 1 --2- 172.21.15.148:0/50726023 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7170103660 0x7f71701988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:24.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.300+0000 7f7174f33640 1 --2- 172.21.15.148:0/50726023 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7170102d40 0x7f7170198380 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:24.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.300+0000 7f7174f33640 1 -- 172.21.15.148:0/50726023 >> 172.21.15.148:0/50726023 conn(0x7f71700fc7a0 msgr2=0x7f71700fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:24.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.300+0000 7f7174f33640 1 -- 172.21.15.148:0/50726023 shutdown_connections 2024-09-19T07:11:24.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:24.301+0000 7f7174f33640 1 -- 172.21.15.148:0/50726023 wait complete. 2024-09-19T07:11:25.070 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-09-19T07:11:25.326 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:11:25.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:25 smithi148 ceph-mon[31180]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 76 KiB/s wr, 36 op/s 2024-09-19T07:11:25.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:25 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/50726023' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:11:25.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:25 smithi165 ceph-mon[35326]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 76 KiB/s wr, 36 op/s 2024-09-19T07:11:25.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:25 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/50726023' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:11:25.525 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:25 smithi179 ceph-mon[35716]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 76 KiB/s wr, 36 op/s 2024-09-19T07:11:25.526 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:25 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/50726023' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:11:26.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:26 smithi165 ceph-mon[35326]: scrub summary: idle 2024-09-19T07:11:26.495 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:26 smithi148 ceph-mon[31180]: scrub summary: idle 2024-09-19T07:11:26.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:26 smithi179 ceph-mon[35716]: scrub summary: idle 2024-09-19T07:11:26.523 INFO:teuthology.orchestra.run.smithi148.stdout:{"run_dir":"/var/run/ceph"} 2024-09-19T07:11:26.523 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-09-19T07:11:26.524 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 1747 2024-09-19T07:11:26.524 DEBUG:tasks.quiescer:Yielding 2024-09-19T07:11:26.524 INFO:teuthology.run_tasks:Running task workunit... 2024-09-19T07:11:26.540 INFO:tasks.workunit:Pulling workunits from ref 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T07:11:26.541 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-19T07:11:26.541 INFO:tasks.workunit:timeout=3h 2024-09-19T07:11:26.541 INFO:tasks.workunit:cleanup=True 2024-09-19T07:11:26.541 DEBUG:teuthology.orchestra.run.smithi148:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-19T07:11:26.542 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:11:26.558 INFO:teuthology.orchestra.run.smithi148.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-19T07:11:26.558 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-19T07:11:26.558 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-19T07:11:26.558 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:11:26.558 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-19T07:11:26.558 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-09-19 07:09:37.643854319 +0000 2024-09-19T07:11:26.558 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-09-19 07:09:37.643854319 +0000 2024-09-19T07:11:26.558 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-09-19 07:11:03.251406238 +0000 2024-09-19T07:11:26.558 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2024-09-19 07:09:37.643854319 +0000 2024-09-19T07:11:26.559 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-19T07:11:26.559 DEBUG:teuthology.orchestra.run.smithi148:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-19T07:11:26.632 DEBUG:teuthology.orchestra.run.smithi148:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T07:11:26.688 INFO:tasks.workunit.client.0.smithi148.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-19T07:11:26.796 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:11:27.248 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:27 smithi148 ceph-mon[31180]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 76 KiB/s wr, 39 op/s 2024-09-19T07:11:27.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.328+0000 7fc3bf525640 1 -- 172.21.15.148:0/183570195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3b8102db0 msgr2=0x7fc3b8103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:27.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.328+0000 7fc3bf525640 1 --2- 172.21.15.148:0/183570195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3b8102db0 0x7fc3b8103190 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4009930 tx=0x7fc3b402a420 comp rx=0 tx=0).stop 2024-09-19T07:11:27.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.328+0000 7fc3bf525640 1 -- 172.21.15.148:0/183570195 shutdown_connections 2024-09-19T07:11:27.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.328+0000 7fc3bf525640 1 --2- 172.21.15.148:0/183570195 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3b81082e0 0x7fc3b810ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:27.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.328+0000 7fc3bf525640 1 --2- 172.21.15.148:0/183570195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3b8103760 0x7fc3b8107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:27.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.328+0000 7fc3bf525640 1 --2- 172.21.15.148:0/183570195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3b8102db0 0x7fc3b8103190 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:27.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.328+0000 7fc3bf525640 1 -- 172.21.15.148:0/183570195 >> 172.21.15.148:0/183570195 conn(0x7fc3b80fc7d0 msgr2=0x7fc3b80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:27.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.328+0000 7fc3bf525640 1 -- 172.21.15.148:0/183570195 shutdown_connections 2024-09-19T07:11:27.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.328+0000 7fc3bf525640 1 -- 172.21.15.148:0/183570195 wait complete. 2024-09-19T07:11:27.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.329+0000 7fc3bf525640 1 Processor -- start 2024-09-19T07:11:27.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.329+0000 7fc3bf525640 1 -- start start 2024-09-19T07:11:27.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.329+0000 7fc3bf525640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3b8102db0 0x7fc3b81985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:27.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.329+0000 7fc3bf525640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3b8103760 0x7fc3b8198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:27.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.330+0000 7fc3bf525640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3b81082e0 0x7fc3b819cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:27.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.330+0000 7fc3bf525640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b81120b0 con 0x7fc3b8102db0 2024-09-19T07:11:27.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.330+0000 7fc3bd2c1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3b8102db0 0x7fc3b81985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:27.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.330+0000 7fc3bf525640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b8111f30 con 0x7fc3b8103760 2024-09-19T07:11:27.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.330+0000 7fc3bf525640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b8112230 con 0x7fc3b81082e0 2024-09-19T07:11:27.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.330+0000 7fc3bd2c1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3b8102db0 0x7fc3b81985d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34954/0 (socket says 172.21.15.148:34954) 2024-09-19T07:11:27.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.330+0000 7fc3bd2c1640 1 -- 172.21.15.148:0/3779368429 learned_addr learned my addr 172.21.15.148:0/3779368429 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:27.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.330+0000 7fc3bcac0640 1 --2- 172.21.15.148:0/3779368429 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3b8103760 0x7fc3b8198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:27.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.330+0000 7fc3bdac2640 1 --2- 172.21.15.148:0/3779368429 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3b81082e0 0x7fc3b819cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:27.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.330+0000 7fc3bd2c1640 1 -- 172.21.15.148:0/3779368429 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3b81082e0 msgr2=0x7fc3b819cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:27.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.330+0000 7fc3bd2c1640 1 --2- 172.21.15.148:0/3779368429 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3b81082e0 0x7fc3b819cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:27.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.330+0000 7fc3bd2c1640 1 -- 172.21.15.148:0/3779368429 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3b8103760 msgr2=0x7fc3b8198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:27.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.330+0000 7fc3bd2c1640 1 --2- 172.21.15.148:0/3779368429 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3b8103760 0x7fc3b8198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:27.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.330+0000 7fc3bd2c1640 1 -- 172.21.15.148:0/3779368429 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3b819d580 con 0x7fc3b8102db0 2024-09-19T07:11:27.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.330+0000 7fc3bdac2640 1 --2- 172.21.15.148:0/3779368429 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3b81082e0 0x7fc3b819cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:11:27.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.330+0000 7fc3bd2c1640 1 --2- 172.21.15.148:0/3779368429 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3b8102db0 0x7fc3b81985d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4004770 tx=0x7fc3b4003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:27.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.330+0000 7fc3ae7fc640 1 -- 172.21.15.148:0/3779368429 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b403f070 con 0x7fc3b8102db0 2024-09-19T07:11:27.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.330+0000 7fc3ae7fc640 1 -- 172.21.15.148:0/3779368429 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3b4031c20 con 0x7fc3b8102db0 2024-09-19T07:11:27.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.330+0000 7fc3ae7fc640 1 -- 172.21.15.148:0/3779368429 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b4035030 con 0x7fc3b8102db0 2024-09-19T07:11:27.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.330+0000 7fc3bf525640 1 -- 172.21.15.148:0/3779368429 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3b819d810 con 0x7fc3b8102db0 2024-09-19T07:11:27.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.330+0000 7fc3bf525640 1 -- 172.21.15.148:0/3779368429 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3b81a5150 con 0x7fc3b8102db0 2024-09-19T07:11:27.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.331+0000 7fc3bf525640 1 -- 172.21.15.148:0/3779368429 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3b8103190 con 0x7fc3b8102db0 2024-09-19T07:11:27.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.333+0000 7fc3ae7fc640 1 -- 172.21.15.148:0/3779368429 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7fc3b4042070 con 0x7fc3b8102db0 2024-09-19T07:11:27.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.334+0000 7fc3ae7fc640 1 --2- 172.21.15.148:0/3779368429 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc3a40a34c0 0x7fc3a40a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:27.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.334+0000 7fc3bcac0640 1 --2- 172.21.15.148:0/3779368429 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc3a40a34c0 0x7fc3a40a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:27.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.334+0000 7fc3ae7fc640 1 -- 172.21.15.148:0/3779368429 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fc3b40f0ea0 con 0x7fc3b8102db0 2024-09-19T07:11:27.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.334+0000 7fc3bcac0640 1 --2- 172.21.15.148:0/3779368429 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc3a40a34c0 0x7fc3a40a5980 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80fee60 tx=0x7fc3a8005f90 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:27.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.340+0000 7fc3ae7fc640 1 -- 172.21.15.148:0/3779368429 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc3b40bd720 con 0x7fc3b8102db0 2024-09-19T07:11:27.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:27 smithi165 ceph-mon[35326]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 76 KiB/s wr, 39 op/s 2024-09-19T07:11:27.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:27 smithi179 ceph-mon[35716]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 76 KiB/s wr, 39 op/s 2024-09-19T07:11:27.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.546+0000 7fc3bf525640 1 -- 172.21.15.148:0/3779368429 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc3b810a2c0 con 0x7fc3b8102db0 2024-09-19T07:11:27.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.546+0000 7fc3ae7fc640 1 -- 172.21.15.148:0/3779368429 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11939 (secure 0 0 0) 0x7fc3b40bd020 con 0x7fc3b8102db0 2024-09-19T07:11:27.547 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:11:27.548 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":25,"btime":"2024-09-19T07:11:04:227331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/4263868576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":4263868576},{"type":"v1","addr":"172.21.15.148:6841","nonce":4263868576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24383,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2146820965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2146820965},{"type":"v1","addr":"172.21.15.165:6835","nonce":2146820965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:09:19.543369+0000","modified":"2024-09-19T07:11:03.969598+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24457,"mds_1":24437,"mds_2":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/1566489108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1566489108},{"type":"v1","addr":"172.21.15.179:6835","nonce":1566489108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.165:6839/3993490234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":3993490234},{"type":"v1","addr":"172.21.15.165:6839","nonce":3993490234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24457,"qdb_cluster":[24457,24437,24436]},"id":1}]} 2024-09-19T07:11:27.548 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 25 2024-09-19T07:11:27.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.548+0000 7fc3bf525640 1 -- 172.21.15.148:0/3779368429 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc3a40a34c0 msgr2=0x7fc3a40a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:27.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.548+0000 7fc3bf525640 1 --2- 172.21.15.148:0/3779368429 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc3a40a34c0 0x7fc3a40a5980 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80fee60 tx=0x7fc3a8005f90 comp rx=0 tx=0).stop 2024-09-19T07:11:27.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.548+0000 7fc3bf525640 1 -- 172.21.15.148:0/3779368429 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3b8102db0 msgr2=0x7fc3b81985d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:27.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.548+0000 7fc3bf525640 1 --2- 172.21.15.148:0/3779368429 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3b8102db0 0x7fc3b81985d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4004770 tx=0x7fc3b4003b90 comp rx=0 tx=0).stop 2024-09-19T07:11:27.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.549+0000 7fc3bf525640 1 -- 172.21.15.148:0/3779368429 shutdown_connections 2024-09-19T07:11:27.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.549+0000 7fc3bf525640 1 --2- 172.21.15.148:0/3779368429 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc3a40a34c0 0x7fc3a40a5980 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:27.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.549+0000 7fc3bf525640 1 --2- 172.21.15.148:0/3779368429 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3b81082e0 0x7fc3b819cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:27.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.549+0000 7fc3bf525640 1 --2- 172.21.15.148:0/3779368429 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3b8103760 0x7fc3b8198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:27.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.549+0000 7fc3bf525640 1 --2- 172.21.15.148:0/3779368429 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3b8102db0 0x7fc3b81985d0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:27.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.549+0000 7fc3bf525640 1 -- 172.21.15.148:0/3779368429 >> 172.21.15.148:0/3779368429 conn(0x7fc3b80fc7d0 msgr2=0x7fc3b8105d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:27.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.549+0000 7fc3bf525640 1 -- 172.21.15.148:0/3779368429 shutdown_connections 2024-09-19T07:11:27.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:27.549+0000 7fc3bf525640 1 -- 172.21.15.148:0/3779368429 wait complete. 2024-09-19T07:11:27.719 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.716+0000 7f4c44280640 1 -- 172.21.15.148:0/1849317746 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c3c1009d0 msgr2=0x7f4c3c100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:27.720 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.716+0000 7f4c44280640 1 --2- 172.21.15.148:0/1849317746 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c3c1009d0 0x7f4c3c100e30 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f4c38009930 tx=0x7f4c3802a420 comp rx=0 tx=0).stop 2024-09-19T07:11:27.720 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.716+0000 7f4c44280640 1 -- 172.21.15.148:0/1849317746 shutdown_connections 2024-09-19T07:11:27.720 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.716+0000 7f4c44280640 1 --2- 172.21.15.148:0/1849317746 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c3c101370 0x7f4c3c10d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:27.720 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.716+0000 7f4c44280640 1 --2- 172.21.15.148:0/1849317746 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c3c1009d0 0x7f4c3c100e30 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:27.720 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.716+0000 7f4c44280640 1 --2- 172.21.15.148:0/1849317746 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c3c1069e0 0x7f4c3c106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:27.720 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.716+0000 7f4c44280640 1 -- 172.21.15.148:0/1849317746 >> 172.21.15.148:0/1849317746 conn(0x7f4c3c0fc6f0 msgr2=0x7f4c3c0feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:27.720 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.716+0000 7f4c44280640 1 -- 172.21.15.148:0/1849317746 shutdown_connections 2024-09-19T07:11:27.721 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.716+0000 7f4c44280640 1 -- 172.21.15.148:0/1849317746 wait complete. 2024-09-19T07:11:27.721 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.717+0000 7f4c44280640 1 Processor -- start 2024-09-19T07:11:27.721 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.717+0000 7f4c44280640 1 -- start start 2024-09-19T07:11:27.721 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.717+0000 7f4c44280640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c3c1009d0 0x7f4c3c198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:27.721 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.717+0000 7f4c44280640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c3c101370 0x7f4c3c198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:27.721 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.717+0000 7f4c44280640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c3c1069e0 0x7f4c3c19cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:27.721 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.717+0000 7f4c44280640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4c3c110e20 con 0x7f4c3c101370 2024-09-19T07:11:27.721 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.717+0000 7f4c44280640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4c3c110ca0 con 0x7f4c3c1009d0 2024-09-19T07:11:27.721 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.717+0000 7f4c44280640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4c3c110fa0 con 0x7f4c3c1069e0 2024-09-19T07:11:27.721 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.717+0000 7f4c4181b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c3c101370 0x7f4c3c198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:27.722 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.717+0000 7f4c4181b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c3c101370 0x7f4c3c198880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34974/0 (socket says 172.21.15.148:34974) 2024-09-19T07:11:27.722 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.717+0000 7f4c4181b640 1 -- 172.21.15.148:0/3808971748 learned_addr learned my addr 172.21.15.148:0/3808971748 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:27.722 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.717+0000 7f4c4201c640 1 --2- 172.21.15.148:0/3808971748 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c3c1009d0 0x7f4c3c198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:27.722 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.717+0000 7f4c4281d640 1 --2- 172.21.15.148:0/3808971748 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c3c1069e0 0x7f4c3c19cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:27.722 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.717+0000 7f4c4181b640 1 -- 172.21.15.148:0/3808971748 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c3c1069e0 msgr2=0x7f4c3c19cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:27.722 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.717+0000 7f4c4181b640 1 --2- 172.21.15.148:0/3808971748 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c3c1069e0 0x7f4c3c19cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:27.722 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.717+0000 7f4c4181b640 1 -- 172.21.15.148:0/3808971748 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c3c1009d0 msgr2=0x7f4c3c198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:27.722 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.717+0000 7f4c4181b640 1 --2- 172.21.15.148:0/3808971748 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c3c1009d0 0x7f4c3c198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:27.722 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.717+0000 7f4c4181b640 1 -- 172.21.15.148:0/3808971748 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c3c19d330 con 0x7f4c3c101370 2024-09-19T07:11:27.723 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.717+0000 7f4c4281d640 1 --2- 172.21.15.148:0/3808971748 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c3c1069e0 0x7f4c3c19cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:11:27.723 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.717+0000 7f4c4201c640 1 --2- 172.21.15.148:0/3808971748 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c3c1009d0 0x7f4c3c198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:11:27.723 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.717+0000 7f4c4181b640 1 --2- 172.21.15.148:0/3808971748 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c3c101370 0x7f4c3c198880 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4c38009a50 tx=0x7f4c38004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:27.723 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.718+0000 7f4c2f7fe640 1 -- 172.21.15.148:0/3808971748 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c3803f030 con 0x7f4c3c101370 2024-09-19T07:11:27.723 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.718+0000 7f4c44280640 1 -- 172.21.15.148:0/3808971748 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c3c19d5c0 con 0x7f4c3c101370 2024-09-19T07:11:27.723 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.718+0000 7f4c2f7fe640 1 -- 172.21.15.148:0/3808971748 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c38003ce0 con 0x7f4c3c101370 2024-09-19T07:11:27.723 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.718+0000 7f4c2f7fe640 1 -- 172.21.15.148:0/3808971748 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c38035070 con 0x7f4c3c101370 2024-09-19T07:11:27.723 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.718+0000 7f4c44280640 1 -- 172.21.15.148:0/3808971748 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c3c1a4eb0 con 0x7f4c3c101370 2024-09-19T07:11:27.732 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.720+0000 7f4c2f7fe640 1 -- 172.21.15.148:0/3808971748 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f4c38042030 con 0x7f4c3c101370 2024-09-19T07:11:27.732 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.720+0000 7f4c47014740 1 Processor -- start 2024-09-19T07:11:27.732 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.720+0000 7f4c47014740 1 -- start start 2024-09-19T07:11:27.732 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.721+0000 7f4c47014740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562081055af0 0x562081055ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:27.733 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.721+0000 7f4c47014740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562081056410 0x562081060770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:27.733 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.721+0000 7f4c47014740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562081060cb0 0x5620810630a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:27.733 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.721+0000 7f4c47014740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x562080fba2f0 con 0x562081060cb0 2024-09-19T07:11:27.733 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.721+0000 7f4c47014740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x562080f62270 con 0x562081055af0 2024-09-19T07:11:27.733 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.721+0000 7f4c47014740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x562080fb62b0 con 0x562081056410 2024-09-19T07:11:27.733 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.721+0000 7f4c2f7fe640 1 --2- 172.21.15.148:0/3808971748 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f4c280a3500 0x7f4c280a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:27.733 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.721+0000 7f4c4181b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562081060cb0 0x5620810630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:27.733 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.721+0000 7f4c4201c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562081056410 0x562081060770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:27.733 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.721+0000 7f4c4281d640 1 --2- 172.21.15.148:0/3808971748 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f4c280a3500 0x7f4c280a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:27.734 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.721+0000 7f4c4181b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562081060cb0 0x5620810630a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34988/0 (socket says 172.21.15.148:34988) 2024-09-19T07:11:27.734 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.721+0000 7f4c4181b640 1 -- 172.21.15.148:0/1097161759 learned_addr learned my addr 172.21.15.148:0/1097161759 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:27.734 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.721+0000 7f4c4281d640 1 --2- 172.21.15.148:0/1097161759 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562081055af0 0x562081055ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:27.734 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.721+0000 7f4c2f7fe640 1 -- 172.21.15.148:0/3808971748 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f4c380f04f0 con 0x7f4c3c101370 2024-09-19T07:11:27.734 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.721+0000 7f4c4181b640 1 -- 172.21.15.148:0/1097161759 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562081056410 msgr2=0x562081060770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:27.734 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.721+0000 7f4c4181b640 1 --2- 172.21.15.148:0/1097161759 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562081056410 0x562081060770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:27.734 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.721+0000 7f4c4181b640 1 -- 172.21.15.148:0/1097161759 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562081055af0 msgr2=0x562081055ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:27.734 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.721+0000 7f4c4181b640 1 --2- 172.21.15.148:0/1097161759 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562081055af0 0x562081055ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:27.734 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.721+0000 7f4c4181b640 1 -- 172.21.15.148:0/1097161759 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562080f61340 con 0x562081060cb0 2024-09-19T07:11:27.734 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.721+0000 7f4c4281d640 1 --2- 172.21.15.148:0/3808971748 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f4c280a3500 0x7f4c280a59c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4c34005fd0 tx=0x7f4c3400ad30 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:27.734 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.721+0000 7f4c4181b640 1 --2- 172.21.15.148:0/1097161759 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562081060cb0 0x5620810630a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4c38031550 tx=0x7f4c3808f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a370dabdfeaacea server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:27.735 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.722+0000 7f4c2cbfe640 1 -- 172.21.15.148:0/1097161759 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c38049040 con 0x562081060cb0 2024-09-19T07:11:27.735 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.722+0000 7f4c2cbfe640 1 -- 172.21.15.148:0/1097161759 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c380b4e50 con 0x562081060cb0 2024-09-19T07:11:27.735 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.722+0000 7f4c2cbfe640 1 -- 172.21.15.148:0/1097161759 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c380c52e0 con 0x562081060cb0 2024-09-19T07:11:27.735 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.722+0000 7f4c47014740 1 -- 172.21.15.148:0/1097161759 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562081060cb0 msgr2=0x5620810630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:27.735 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.722+0000 7f4c47014740 1 --2- 172.21.15.148:0/1097161759 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562081060cb0 0x5620810630a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4c38031550 tx=0x7f4c3808f4a0 comp rx=0 tx=0).stop 2024-09-19T07:11:27.735 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.722+0000 7f4c47014740 1 -- 172.21.15.148:0/1097161759 shutdown_connections 2024-09-19T07:11:27.735 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.722+0000 7f4c47014740 1 --2- 172.21.15.148:0/1097161759 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562081060cb0 0x5620810630a0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:27.735 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.722+0000 7f4c47014740 1 --2- 172.21.15.148:0/1097161759 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562081056410 0x562081060770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:27.735 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.722+0000 7f4c47014740 1 --2- 172.21.15.148:0/1097161759 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562081055af0 0x562081055ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:27.735 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.722+0000 7f4c47014740 1 -- 172.21.15.148:0/1097161759 >> 172.21.15.148:0/1097161759 conn(0x562081052060 msgr2=0x562081052440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:27.736 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.722+0000 7f4c47014740 1 -- 172.21.15.148:0/1097161759 shutdown_connections 2024-09-19T07:11:27.736 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.722+0000 7f4c47014740 1 -- 172.21.15.148:0/1097161759 wait complete. 2024-09-19T07:11:27.736 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.723+0000 7f4c47014740 1 -- start start 2024-09-19T07:11:27.736 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.723+0000 7f4c47014740 1 Processor -- start 2024-09-19T07:11:27.736 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.723+0000 7f4c47014740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562081055af0 0x56208105db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:27.736 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.723+0000 7f4c47014740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562081056410 0x56208105e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:27.736 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.723+0000 7f4c47014740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562081060cb0 0x56208105e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:27.736 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.723+0000 7f4c47014740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x562081063640 con 0x562081060cb0 2024-09-19T07:11:27.736 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.723+0000 7f4c47014740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x562080f43290 con 0x562081056410 2024-09-19T07:11:27.736 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.723+0000 7f4c47014740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5620810637c0 con 0x562081055af0 2024-09-19T07:11:27.737 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.723+0000 7f4c47014740 10 client.0 _ll_register_callbacks cb 0x562080f74140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:11:27.737 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.723+0000 7f4c4281d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562081060cb0 0x56208105e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:27.737 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.723+0000 7f4c4281d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562081060cb0 0x56208105e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34992/0 (socket says 172.21.15.148:34992) 2024-09-19T07:11:27.737 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.723+0000 7f4c4281d640 1 -- 172.21.15.148:0/3551205827 learned_addr learned my addr 172.21.15.148:0/3551205827 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:27.737 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.723+0000 7f4c4181b640 1 --2- 172.21.15.148:0/3551205827 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562081056410 0x56208105e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:27.737 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.723+0000 7f4c4201c640 1 --2- 172.21.15.148:0/3551205827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562081055af0 0x56208105db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:27.737 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.723+0000 7f4c4281d640 1 -- 172.21.15.148:0/3551205827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562081055af0 msgr2=0x56208105db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:27.737 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.723+0000 7f4c4281d640 1 --2- 172.21.15.148:0/3551205827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562081055af0 0x56208105db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:27.737 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.724+0000 7f4c4281d640 1 -- 172.21.15.148:0/3551205827 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562081056410 msgr2=0x56208105e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:27.737 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.724+0000 7f4c4281d640 1 --2- 172.21.15.148:0/3551205827 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562081056410 0x56208105e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:27.737 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.724+0000 7f4c4281d640 1 -- 172.21.15.148:0/3551205827 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562080ccd210 con 0x562081060cb0 2024-09-19T07:11:27.738 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.724+0000 7f4c4281d640 1 --2- 172.21.15.148:0/3551205827 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562081060cb0 0x56208105e610 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4c3400ff60 tx=0x7f4c34005f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9355405e3697597d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:27.738 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.724+0000 7f4c25ffb640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:11:27.738 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.724+0000 7f4c25ffb640 1 -- 172.21.15.148:0/3551205827 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c3401f800 con 0x562081060cb0 2024-09-19T07:11:27.738 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.724+0000 7f4c25ffb640 1 -- 172.21.15.148:0/3551205827 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f4c3401f9a0 con 0x562081060cb0 2024-09-19T07:11:27.738 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.724+0000 7f4c47014740 1 -- 172.21.15.148:0/3551205827 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c380b4e50 con 0x562081060cb0 2024-09-19T07:11:27.738 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.724+0000 7f4c25ffb640 1 -- 172.21.15.148:0/3551205827 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4c3401ee50 con 0x562081060cb0 2024-09-19T07:11:27.738 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.724+0000 7f4c47014740 10 client.15369 fetch_fsmap learned FSMap version 25 2024-09-19T07:11:27.738 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.724+0000 7f4c47014740 1 -- 172.21.15.148:0/3551205827 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562080d99620 con 0x562081060cb0 2024-09-19T07:11:27.738 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.724+0000 7f4c25ffb640 1 -- 172.21.15.148:0/3551205827 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c380b4e50 con 0x562081060cb0 2024-09-19T07:11:27.738 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.724+0000 7f4c25ffb640 1 -- 172.21.15.148:0/3551205827 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4c3402ac90 con 0x562081060cb0 2024-09-19T07:11:27.739 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.724+0000 7f4c47014740 10 client.15369 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:11:27.739 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.724+0000 7f4c47014740 10 client.15369 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:11:27.739 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.724+0000 7f4c47014740 20 client.15369 populate_metadata read hostname 'smithi148' 2024-09-19T07:11:27.739 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.724+0000 7f4c47014740 1 --2- 172.21.15.148:0/3551205827 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x562081070930 0x562081072d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:27.739 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.724+0000 7f4c47014740 4 client.15369 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:11:27.739 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.724+0000 7f4c47014740 1 -- 172.21.15.148:0/3551205827 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562080fc7a20 con 0x562081070930 2024-09-19T07:11:27.739 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.725+0000 7f4c4201c640 1 --2- 172.21.15.148:0/3551205827 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x562081070930 0x562081072d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:27.739 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.725+0000 7f4c25ffb640 10 client.15369 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:11:27.739 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.725+0000 7f4c4201c640 1 --2- 172.21.15.148:0/3551205827 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x562081070930 0x562081072d20 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a04aa398874d0531 server_cookie=df46956da8e1f150 in_seq=0 out_seq=0 2024-09-19T07:11:27.739 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.726+0000 7f4c25ffb640 1 -- 172.21.15.148:0/3551205827 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562080fc7a20 con 0x562081070930 2024-09-19T07:11:27.739 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.726+0000 7f4c25ffb640 10 client.15369 handle_command_reply: tid=0 2024-09-19T07:11:27.740 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.726+0000 7f4c47014740 1 client.15369 shutdown 2024-09-19T07:11:27.740 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.726+0000 7f4c47014740 1 -- 172.21.15.148:0/3551205827 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562081060cb0 msgr2=0x56208105e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:27.740 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.726+0000 7f4c47014740 1 --2- 172.21.15.148:0/3551205827 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562081060cb0 0x56208105e610 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4c3400ff60 tx=0x7f4c34005f40 comp rx=0 tx=0).stop 2024-09-19T07:11:27.740 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.726+0000 7f4c47014740 1 -- 172.21.15.148:0/3551205827 shutdown_connections 2024-09-19T07:11:27.740 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.726+0000 7f4c47014740 1 --2- 172.21.15.148:0/3551205827 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x562081070930 0x562081072d20 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:27.740 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.726+0000 7f4c47014740 1 --2- 172.21.15.148:0/3551205827 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562081060cb0 0x56208105e610 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:27.740 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.726+0000 7f4c25ffb640 0 client.15369 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:11:27.740 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.726+0000 7f4c47014740 1 --2- 172.21.15.148:0/3551205827 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562081056410 0x56208105e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:27.740 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.726+0000 7f4c47014740 1 --2- 172.21.15.148:0/3551205827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562081055af0 0x56208105db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:27.740 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.726+0000 7f4c47014740 1 -- 172.21.15.148:0/3551205827 >> 172.21.15.148:0/3551205827 conn(0x562081052060 msgr2=0x562081057d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:27.740 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.726+0000 7f4c47014740 1 -- 172.21.15.148:0/3551205827 shutdown_connections 2024-09-19T07:11:27.741 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.726+0000 7f4c47014740 1 -- 172.21.15.148:0/3551205827 wait complete. 2024-09-19T07:11:27.741 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.726+0000 7f4c47014740 20 client.15369 trim_cache size 0 max 16384 2024-09-19T07:11:27.746 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.740+0000 7f4c47014740 1 Processor -- start 2024-09-19T07:11:27.746 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.740+0000 7f4c47014740 1 -- start start 2024-09-19T07:11:27.746 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.741+0000 7f4c47014740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562081055af0 0x56208105fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:27.746 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.741+0000 7f4c47014740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562081056410 0x56208105e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:27.746 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.741+0000 7f4c47014740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562081060cb0 0x562081078630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:27.746 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.741+0000 7f4c47014740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4c3c1aff30 con 0x562081055af0 2024-09-19T07:11:27.746 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.741+0000 7f4c47014740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4c3c1ad800 con 0x562081060cb0 2024-09-19T07:11:27.746 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.741+0000 7f4c47014740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4c3c1ab630 con 0x562081056410 2024-09-19T07:11:27.746 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.741+0000 7f4c4201c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562081055af0 0x56208105fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:27.747 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.741+0000 7f4c4201c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562081055af0 0x56208105fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35008/0 (socket says 172.21.15.148:35008) 2024-09-19T07:11:27.747 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.741+0000 7f4c4201c640 1 -- 172.21.15.148:0/1933915336 learned_addr learned my addr 172.21.15.148:0/1933915336 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:27.747 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.741+0000 7f4c4281d640 1 --2- 172.21.15.148:0/1933915336 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562081060cb0 0x562081078630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:27.747 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.741+0000 7f4c4201c640 1 -- 172.21.15.148:0/1933915336 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562081056410 msgr2=0x56208105e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:27.747 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.741+0000 7f4c4201c640 1 --2- 172.21.15.148:0/1933915336 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562081056410 0x56208105e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:27.747 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.741+0000 7f4c4201c640 1 -- 172.21.15.148:0/1933915336 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562081060cb0 msgr2=0x562081078630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:27.747 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.741+0000 7f4c4201c640 1 --2- 172.21.15.148:0/1933915336 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562081060cb0 0x562081078630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:27.747 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.741+0000 7f4c4201c640 1 -- 172.21.15.148:0/1933915336 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620810733a0 con 0x562081055af0 2024-09-19T07:11:27.747 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.741+0000 7f4c4281d640 1 --2- 172.21.15.148:0/1933915336 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562081060cb0 0x562081078630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:11:27.747 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.741+0000 7f4c4201c640 1 --2- 172.21.15.148:0/1933915336 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562081055af0 0x56208105fec0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x5620810735d0 tx=0x7f4c3000c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49e4dc0d78c4188 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:27.747 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.741+0000 7f4c27fff640 1 -- 172.21.15.148:0/1933915336 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c3001e070 con 0x562081055af0 2024-09-19T07:11:27.747 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.741+0000 7f4c27fff640 1 -- 172.21.15.148:0/1933915336 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c30004e00 con 0x562081055af0 2024-09-19T07:11:27.748 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.741+0000 7f4c27fff640 1 -- 172.21.15.148:0/1933915336 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c30011440 con 0x562081055af0 2024-09-19T07:11:27.748 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.742+0000 7f4c47014740 1 -- 172.21.15.148:0/1933915336 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562081055af0 msgr2=0x56208105fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:27.748 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.742+0000 7f4c47014740 1 --2- 172.21.15.148:0/1933915336 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562081055af0 0x56208105fec0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x5620810735d0 tx=0x7f4c3000c480 comp rx=0 tx=0).stop 2024-09-19T07:11:27.748 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.742+0000 7f4c47014740 1 -- 172.21.15.148:0/1933915336 shutdown_connections 2024-09-19T07:11:27.748 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.742+0000 7f4c47014740 1 --2- 172.21.15.148:0/1933915336 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562081060cb0 0x562081078630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:27.748 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.742+0000 7f4c47014740 1 --2- 172.21.15.148:0/1933915336 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562081056410 0x56208105e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:27.748 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.742+0000 7f4c47014740 1 --2- 172.21.15.148:0/1933915336 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562081055af0 0x56208105fec0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:27.748 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.742+0000 7f4c47014740 1 -- 172.21.15.148:0/1933915336 >> 172.21.15.148:0/1933915336 conn(0x562081052060 msgr2=0x5620810511c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:27.748 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.742+0000 7f4c47014740 1 -- 172.21.15.148:0/1933915336 shutdown_connections 2024-09-19T07:11:27.748 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.742+0000 7f4c47014740 1 -- 172.21.15.148:0/1933915336 wait complete. 2024-09-19T07:11:27.748 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.742+0000 7f4c47014740 1 -- start start 2024-09-19T07:11:27.749 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.742+0000 7f4c47014740 1 Processor -- start 2024-09-19T07:11:27.749 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.742+0000 7f4c47014740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562081055af0 0x562081068c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:27.749 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.742+0000 7f4c47014740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562081056410 0x562081069140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:27.749 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.742+0000 7f4c47014740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562081060cb0 0x5620810659e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:27.749 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.742+0000 7f4c47014740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4c3c1abcc0 con 0x562081056410 2024-09-19T07:11:27.749 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.742+0000 7f4c47014740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4c3c1ad130 con 0x562081055af0 2024-09-19T07:11:27.749 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.742+0000 7f4c47014740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4c3c1ac390 con 0x562081060cb0 2024-09-19T07:11:27.749 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.743+0000 7f4c4181b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562081056410 0x562081069140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:27.749 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.743+0000 7f4c47014740 10 client.0 _ll_register_callbacks cb 0x7f4c3400fc30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:11:27.749 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.743+0000 7f4c4181b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562081056410 0x562081069140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35020/0 (socket says 172.21.15.148:35020) 2024-09-19T07:11:27.749 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.743+0000 7f4c4181b640 1 -- 172.21.15.148:0/1054426685 learned_addr learned my addr 172.21.15.148:0/1054426685 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:27.749 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.743+0000 7f4c4201c640 1 --2- 172.21.15.148:0/1054426685 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562081055af0 0x562081068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:27.750 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.743+0000 7f4c4281d640 1 --2- 172.21.15.148:0/1054426685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562081060cb0 0x5620810659e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:27.750 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.743+0000 7f4c4181b640 1 -- 172.21.15.148:0/1054426685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562081060cb0 msgr2=0x5620810659e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:27.750 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.743+0000 7f4c4181b640 1 --2- 172.21.15.148:0/1054426685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562081060cb0 0x5620810659e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:27.750 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.743+0000 7f4c4181b640 1 -- 172.21.15.148:0/1054426685 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562081055af0 msgr2=0x562081068c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:27.750 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.743+0000 7f4c4181b640 1 --2- 172.21.15.148:0/1054426685 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562081055af0 0x562081068c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:27.750 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.743+0000 7f4c4181b640 1 -- 172.21.15.148:0/1054426685 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562081055920 con 0x562081056410 2024-09-19T07:11:27.750 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.743+0000 7f4c4181b640 1 --2- 172.21.15.148:0/1054426685 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562081056410 0x562081069140 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f4c380b8ad0 tx=0x7f4c3802a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d0a8eeb0c319b15 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:27.750 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.743+0000 7f4c25ffb640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:11:27.750 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.743+0000 7f4c25ffb640 1 -- 172.21.15.148:0/1054426685 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c380d4030 con 0x562081056410 2024-09-19T07:11:27.750 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.743+0000 7f4c25ffb640 1 -- 172.21.15.148:0/1054426685 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f4c3803bd00 con 0x562081056410 2024-09-19T07:11:27.750 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.743+0000 7f4c47014740 1 -- 172.21.15.148:0/1054426685 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c30004e00 con 0x562081056410 2024-09-19T07:11:27.750 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.743+0000 7f4c25ffb640 1 -- 172.21.15.148:0/1054426685 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4c38049040 con 0x562081056410 2024-09-19T07:11:27.751 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.743+0000 7f4c47014740 10 client.15375 fetch_fsmap learned FSMap version 25 2024-09-19T07:11:27.751 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.743+0000 7f4c47014740 1 -- 172.21.15.148:0/1054426685 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5620810dbd50 con 0x562081056410 2024-09-19T07:11:27.751 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.743+0000 7f4c25ffb640 1 -- 172.21.15.148:0/1054426685 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c30004e00 con 0x562081056410 2024-09-19T07:11:27.751 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.744+0000 7f4c25ffb640 1 -- 172.21.15.148:0/1054426685 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4c380b8ce0 con 0x562081056410 2024-09-19T07:11:27.751 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.744+0000 7f4c47014740 10 client.15375 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:11:27.751 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.744+0000 7f4c47014740 10 client.15375 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:11:27.751 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.744+0000 7f4c47014740 20 client.15375 populate_metadata read hostname 'smithi148' 2024-09-19T07:11:27.751 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.744+0000 7f4c47014740 1 --2- 172.21.15.148:0/1054426685 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5620810dc390 0x5620810de7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:27.751 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.744+0000 7f4c47014740 4 client.15375 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:11:27.751 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.744+0000 7f4c47014740 1 -- 172.21.15.148:0/1054426685 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562080fc1d70 con 0x5620810dc390 2024-09-19T07:11:27.751 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.744+0000 7f4c4201c640 1 --2- 172.21.15.148:0/1054426685 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5620810dc390 0x5620810de7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:27.752 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.744+0000 7f4c25ffb640 10 client.15375 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:11:27.752 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.744+0000 7f4c4201c640 1 --2- 172.21.15.148:0/1054426685 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5620810dc390 0x5620810de7b0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d96bf91419aeab4a server_cookie=cd2846f6e9f84b54 in_seq=0 out_seq=0 2024-09-19T07:11:27.757 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.755+0000 7f4c25ffb640 1 -- 172.21.15.148:0/1054426685 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562080fc1d70 con 0x5620810dc390 2024-09-19T07:11:27.757 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.755+0000 7f4c25ffb640 10 client.15375 handle_command_reply: tid=0 2024-09-19T07:11:27.757 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.755+0000 7f4c47014740 1 client.15375 shutdown 2024-09-19T07:11:27.757 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.756+0000 7f4c47014740 1 -- 172.21.15.148:0/1054426685 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562081056410 msgr2=0x562081069140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:27.759 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.756+0000 7f4c47014740 1 --2- 172.21.15.148:0/1054426685 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562081056410 0x562081069140 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f4c380b8ad0 tx=0x7f4c3802a420 comp rx=0 tx=0).stop 2024-09-19T07:11:27.759 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.756+0000 7f4c47014740 1 -- 172.21.15.148:0/1054426685 shutdown_connections 2024-09-19T07:11:27.759 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.756+0000 7f4c47014740 1 --2- 172.21.15.148:0/1054426685 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5620810dc390 0x5620810de7b0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:27.759 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.756+0000 7f4c47014740 1 --2- 172.21.15.148:0/1054426685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562081060cb0 0x5620810659e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:27.759 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.756+0000 7f4c25ffb640 0 client.15375 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:11:27.759 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.756+0000 7f4c47014740 1 --2- 172.21.15.148:0/1054426685 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562081056410 0x562081069140 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:27.759 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.756+0000 7f4c47014740 1 --2- 172.21.15.148:0/1054426685 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562081055af0 0x562081068c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:27.759 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.756+0000 7f4c47014740 1 -- 172.21.15.148:0/1054426685 >> 172.21.15.148:0/1054426685 conn(0x562081052060 msgr2=0x5620810509a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:27.759 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.756+0000 7f4c47014740 1 -- 172.21.15.148:0/1054426685 shutdown_connections 2024-09-19T07:11:27.760 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.756+0000 7f4c47014740 1 -- 172.21.15.148:0/1054426685 wait complete. 2024-09-19T07:11:27.760 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.756+0000 7f4c47014740 20 client.15375 trim_cache size 0 max 16384 2024-09-19T07:11:27.760 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:11:27.760 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:11:27.760 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:11:27.760 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:11:27.761 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.756+0000 7f4c44280640 1 -- 172.21.15.148:0/3808971748 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f4c280a3500 msgr2=0x7f4c280a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:27.762 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.756+0000 7f4c44280640 1 --2- 172.21.15.148:0/3808971748 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f4c280a3500 0x7f4c280a59c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4c34005fd0 tx=0x7f4c3400ad30 comp rx=0 tx=0).stop 2024-09-19T07:11:27.762 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.756+0000 7f4c44280640 1 -- 172.21.15.148:0/3808971748 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c3c101370 msgr2=0x7f4c3c198880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:27.762 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.756+0000 7f4c44280640 1 --2- 172.21.15.148:0/3808971748 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c3c101370 0x7f4c3c198880 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4c38009a50 tx=0x7f4c38004270 comp rx=0 tx=0).stop 2024-09-19T07:11:27.762 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.756+0000 7f4c44280640 1 -- 172.21.15.148:0/3808971748 shutdown_connections 2024-09-19T07:11:27.762 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.756+0000 7f4c44280640 1 --2- 172.21.15.148:0/3808971748 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f4c280a3500 0x7f4c280a59c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:27.762 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.756+0000 7f4c44280640 1 --2- 172.21.15.148:0/3808971748 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c3c1069e0 0x7f4c3c19cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:27.762 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.756+0000 7f4c44280640 1 --2- 172.21.15.148:0/3808971748 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4c3c101370 0x7f4c3c198880 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:27.762 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.756+0000 7f4c44280640 1 --2- 172.21.15.148:0/3808971748 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c3c1009d0 0x7f4c3c198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:27.762 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.756+0000 7f4c44280640 1 -- 172.21.15.148:0/3808971748 >> 172.21.15.148:0/3808971748 conn(0x7f4c3c0fc6f0 msgr2=0x7f4c3c06a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:27.762 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.757+0000 7f4c44280640 1 -- 172.21.15.148:0/3808971748 shutdown_connections 2024-09-19T07:11:27.763 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:27.757+0000 7f4c44280640 1 -- 172.21.15.148:0/3808971748 wait complete. 2024-09-19T07:11:28.189 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 306, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': True}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T07:09:19.543369+0000', 'modified': '2024-09-19T07:11:03.969598+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24457, 'mds_1': 24437, 'mds_2': 24436}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24410': {'gid': 24410, 'name': 'h', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.165:6837/3847988837', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.165:6836', 'nonce': 3847988837}, {'type': 'v1', 'addr': '172.21.15.165:6837', 'nonce': 3847988837}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24412': {'gid': 24412, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.179:6833/1289882987', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6832', 'nonce': 1289882987}, {'type': 'v1', 'addr': '172.21.15.179:6833', 'nonce': 1289882987}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24430': {'gid': 24430, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.179:6835/1566489108', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6834', 'nonce': 1566489108}, {'type': 'v1', 'addr': '172.21.15.179:6835', 'nonce': 1566489108}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24436': {'gid': 24436, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.179:6837/3827671241', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6836', 'nonce': 3827671241}, {'type': 'v1', 'addr': '172.21.15.179:6837', 'nonce': 3827671241}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24437': {'gid': 24437, 'name': 'b', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.165:6839/3993490234', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.165:6838', 'nonce': 3993490234}, {'type': 'v1', 'addr': '172.21.15.165:6839', 'nonce': 3993490234}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24457': {'gid': 24457, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.179:6839/2031305914', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6838', 'nonce': 2031305914}, {'type': 'v1', 'addr': '172.21.15.179:6839', 'nonce': 2031305914}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24457, 'qdb_cluster': [24457, 24437, 24436]} 2024-09-19T07:11:28.190 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-19T07:11:28.190 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph tell mds.c status 2024-09-19T07:11:28.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:28 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/3779368429' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:11:28.478 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:11:28.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:28 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/3779368429' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:11:28.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:28 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/3779368429' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:11:29.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.044+0000 7f244bc58640 1 -- 172.21.15.148:0/1475256273 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2444101df0 msgr2=0x7f24441021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:29.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.044+0000 7f244bc58640 1 --2- 172.21.15.148:0/1475256273 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2444101df0 0x7f24441021d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2440009900 tx=0x7f244002a410 comp rx=0 tx=0).stop 2024-09-19T07:11:29.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.044+0000 7f244bc58640 1 -- 172.21.15.148:0/1475256273 shutdown_connections 2024-09-19T07:11:29.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.044+0000 7f244bc58640 1 --2- 172.21.15.148:0/1475256273 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2444106f20 0x7f244410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:29.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.044+0000 7f244bc58640 1 --2- 172.21.15.148:0/1475256273 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24441027a0 0x7f24441067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:29.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.044+0000 7f244bc58640 1 --2- 172.21.15.148:0/1475256273 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2444101df0 0x7f24441021d0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:29.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.044+0000 7f244bc58640 1 -- 172.21.15.148:0/1475256273 >> 172.21.15.148:0/1475256273 conn(0x7f24440fd8f0 msgr2=0x7f24440ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:29.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.044+0000 7f244bc58640 1 -- 172.21.15.148:0/1475256273 shutdown_connections 2024-09-19T07:11:29.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.044+0000 7f244bc58640 1 -- 172.21.15.148:0/1475256273 wait complete. 2024-09-19T07:11:29.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.045+0000 7f244bc58640 1 Processor -- start 2024-09-19T07:11:29.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.045+0000 7f244bc58640 1 -- start start 2024-09-19T07:11:29.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.045+0000 7f244bc58640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2444101df0 0x7f24441985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:29.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.045+0000 7f244bc58640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24441027a0 0x7f2444198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:29.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.045+0000 7f244bc58640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2444106f20 0x7f244419ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:29.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.045+0000 7f244bc58640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2444112020 con 0x7f24441027a0 2024-09-19T07:11:29.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.045+0000 7f244bc58640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2444111ea0 con 0x7f2444101df0 2024-09-19T07:11:29.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.045+0000 7f244bc58640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f24441121a0 con 0x7f2444106f20 2024-09-19T07:11:29.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.045+0000 7f24491f3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24441027a0 0x7f2444198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:29.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.045+0000 7f24491f3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24441027a0 0x7f2444198ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35044/0 (socket says 172.21.15.148:35044) 2024-09-19T07:11:29.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.045+0000 7f24491f3640 1 -- 172.21.15.148:0/2461722928 learned_addr learned my addr 172.21.15.148:0/2461722928 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:29.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.046+0000 7f24499f4640 1 --2- 172.21.15.148:0/2461722928 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2444101df0 0x7f24441985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:29.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.046+0000 7f244a1f5640 1 --2- 172.21.15.148:0/2461722928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2444106f20 0x7f244419ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:29.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.046+0000 7f24491f3640 1 -- 172.21.15.148:0/2461722928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2444106f20 msgr2=0x7f244419ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:29.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.046+0000 7f24491f3640 1 --2- 172.21.15.148:0/2461722928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2444106f20 0x7f244419ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:29.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.046+0000 7f24491f3640 1 -- 172.21.15.148:0/2461722928 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2444101df0 msgr2=0x7f24441985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:29.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.046+0000 7f24491f3640 1 --2- 172.21.15.148:0/2461722928 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2444101df0 0x7f24441985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:29.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.046+0000 7f24491f3640 1 -- 172.21.15.148:0/2461722928 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f244419d550 con 0x7f24441027a0 2024-09-19T07:11:29.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.046+0000 7f244a1f5640 1 --2- 172.21.15.148:0/2461722928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2444106f20 0x7f244419ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:11:29.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.046+0000 7f24491f3640 1 --2- 172.21.15.148:0/2461722928 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24441027a0 0x7f2444198ae0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f243800b4a0 tx=0x7f243800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:29.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.046+0000 7f2436ffd640 1 -- 172.21.15.148:0/2461722928 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2438014070 con 0x7f24441027a0 2024-09-19T07:11:29.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.046+0000 7f2436ffd640 1 -- 172.21.15.148:0/2461722928 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2438010af0 con 0x7f24441027a0 2024-09-19T07:11:29.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.046+0000 7f244bc58640 1 -- 172.21.15.148:0/2461722928 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f244419d840 con 0x7f24441027a0 2024-09-19T07:11:29.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.046+0000 7f2436ffd640 1 -- 172.21.15.148:0/2461722928 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2438017d10 con 0x7f24441027a0 2024-09-19T07:11:29.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.046+0000 7f244bc58640 1 -- 172.21.15.148:0/2461722928 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24441a5120 con 0x7f24441027a0 2024-09-19T07:11:29.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.048+0000 7f2436ffd640 1 -- 172.21.15.148:0/2461722928 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f2438017070 con 0x7f24441027a0 2024-09-19T07:11:29.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.048+0000 7f244e031740 1 Processor -- start 2024-09-19T07:11:29.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.049+0000 7f244e031740 1 -- start start 2024-09-19T07:11:29.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.049+0000 7f244e031740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559ed352f9d0 0x559ed352fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:29.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.049+0000 7f244e031740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559ed35302f0 0x559ed353a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:29.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.049+0000 7f244e031740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559ed353abb0 0x559ed353cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:29.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.049+0000 7f244e031740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x559ed3496090 con 0x559ed352f9d0 2024-09-19T07:11:29.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.049+0000 7f244e031740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x559ed343da70 con 0x559ed35302f0 2024-09-19T07:11:29.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.049+0000 7f244e031740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x559ed3492050 con 0x559ed353abb0 2024-09-19T07:11:29.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.049+0000 7f244a1f5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559ed352f9d0 0x559ed352fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:29.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.049+0000 7f244a1f5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559ed352f9d0 0x559ed352fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35060/0 (socket says 172.21.15.148:35060) 2024-09-19T07:11:29.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.049+0000 7f244a1f5640 1 -- 172.21.15.148:0/3759069512 learned_addr learned my addr 172.21.15.148:0/3759069512 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:29.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.049+0000 7f2436ffd640 1 --2- 172.21.15.148:0/2461722928 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f24300a34c0 0x7f24300a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:29.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.049+0000 7f24499f4640 1 --2- 172.21.15.148:0/3759069512 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559ed35302f0 0x559ed353a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:29.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.049+0000 7f24491f3640 1 --2- 172.21.15.148:0/3759069512 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559ed353abb0 0x559ed353cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:29.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.049+0000 7f244a1f5640 1 -- 172.21.15.148:0/3759069512 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559ed353abb0 msgr2=0x559ed353cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:29.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.049+0000 7f244a1f5640 1 --2- 172.21.15.148:0/3759069512 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559ed353abb0 0x559ed353cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:29.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.049+0000 7f244a1f5640 1 -- 172.21.15.148:0/3759069512 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559ed35302f0 msgr2=0x559ed353a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:29.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.049+0000 7f244a1f5640 1 --2- 172.21.15.148:0/3759069512 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559ed35302f0 0x559ed353a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:29.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.049+0000 7f244a1f5640 1 -- 172.21.15.148:0/3759069512 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ed344a130 con 0x559ed352f9d0 2024-09-19T07:11:29.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.049+0000 7f24499f4640 1 --2- 172.21.15.148:0/3759069512 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559ed35302f0 0x559ed353a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:11:29.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.049+0000 7f24491f3640 1 --2- 172.21.15.148:0/3759069512 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559ed353abb0 0x559ed353cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:11:29.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.049+0000 7f2436ffd640 1 -- 172.21.15.148:0/2461722928 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f24380cf1b0 con 0x7f24441027a0 2024-09-19T07:11:29.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.049+0000 7f244a1f5640 1 --2- 172.21.15.148:0/2461722928 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f24300a34c0 0x7f24300a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:29.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.050+0000 7f244a1f5640 1 --2- 172.21.15.148:0/3759069512 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559ed352f9d0 0x559ed352fdb0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f243c00c370 tx=0x7f243c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33f9510e1a8c50a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:29.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.050+0000 7f242ffff640 1 -- 172.21.15.148:0/3759069512 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243c016070 con 0x559ed352f9d0 2024-09-19T07:11:29.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.050+0000 7f242ffff640 1 -- 172.21.15.148:0/3759069512 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f243c011d00 con 0x559ed352f9d0 2024-09-19T07:11:29.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.050+0000 7f242ffff640 1 -- 172.21.15.148:0/3759069512 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243c01cc80 con 0x559ed352f9d0 2024-09-19T07:11:29.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.050+0000 7f244e031740 1 -- 172.21.15.148:0/3759069512 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559ed352f9d0 msgr2=0x559ed352fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:29.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.051+0000 7f244e031740 1 --2- 172.21.15.148:0/3759069512 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559ed352f9d0 0x559ed352fdb0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f243c00c370 tx=0x7f243c00c830 comp rx=0 tx=0).stop 2024-09-19T07:11:29.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.050+0000 7f244a1f5640 1 --2- 172.21.15.148:0/2461722928 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f24300a34c0 0x7f24300a5980 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f243c01d000 tx=0x7f243c01e000 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:29.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.051+0000 7f244e031740 1 -- 172.21.15.148:0/3759069512 shutdown_connections 2024-09-19T07:11:29.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.051+0000 7f244e031740 1 --2- 172.21.15.148:0/3759069512 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559ed353abb0 0x559ed353cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:29.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.051+0000 7f244e031740 1 --2- 172.21.15.148:0/3759069512 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559ed35302f0 0x559ed353a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:29.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.051+0000 7f244e031740 1 --2- 172.21.15.148:0/3759069512 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559ed352f9d0 0x559ed352fdb0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:29.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.051+0000 7f244e031740 1 -- 172.21.15.148:0/3759069512 >> 172.21.15.148:0/3759069512 conn(0x559ed352bf60 msgr2=0x559ed352c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:29.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.051+0000 7f244e031740 1 -- 172.21.15.148:0/3759069512 shutdown_connections 2024-09-19T07:11:29.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.051+0000 7f244e031740 1 -- 172.21.15.148:0/3759069512 wait complete. 2024-09-19T07:11:29.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.051+0000 7f244e031740 1 -- start start 2024-09-19T07:11:29.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.051+0000 7f244e031740 1 Processor -- start 2024-09-19T07:11:29.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.051+0000 7f244e031740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559ed352f9d0 0x559ed353a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:29.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.051+0000 7f244e031740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559ed35302f0 0x559ed35377e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:29.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.052+0000 7f244e031740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559ed353abb0 0x559ed3537d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:29.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.052+0000 7f244e031740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x559ed353d780 con 0x559ed35302f0 2024-09-19T07:11:29.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.052+0000 7f244e031740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x559ed3450f20 con 0x559ed353abb0 2024-09-19T07:11:29.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.052+0000 7f244e031740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x559ed353d900 con 0x559ed352f9d0 2024-09-19T07:11:29.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.052+0000 7f244e031740 10 client.0 _ll_register_callbacks cb 0x559ed341a030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:11:29.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.052+0000 7f24491f3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559ed35302f0 0x559ed35377e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:29.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.052+0000 7f24491f3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559ed35302f0 0x559ed35377e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35074/0 (socket says 172.21.15.148:35074) 2024-09-19T07:11:29.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.052+0000 7f24491f3640 1 -- 172.21.15.148:0/1076899401 learned_addr learned my addr 172.21.15.148:0/1076899401 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:29.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.052+0000 7f24499f4640 1 --2- 172.21.15.148:0/1076899401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559ed352f9d0 0x559ed353a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:29.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.052+0000 7f244a1f5640 1 --2- 172.21.15.148:0/1076899401 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559ed353abb0 0x559ed3537d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:29.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.052+0000 7f24491f3640 1 -- 172.21.15.148:0/1076899401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559ed352f9d0 msgr2=0x559ed353a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:29.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.052+0000 7f24491f3640 1 --2- 172.21.15.148:0/1076899401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559ed352f9d0 0x559ed353a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:29.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.052+0000 7f24491f3640 1 -- 172.21.15.148:0/1076899401 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559ed353abb0 msgr2=0x559ed3537d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:29.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.052+0000 7f24491f3640 1 --2- 172.21.15.148:0/1076899401 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559ed353abb0 0x559ed3537d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:29.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.052+0000 7f24491f3640 1 -- 172.21.15.148:0/1076899401 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ed32072b0 con 0x559ed35302f0 2024-09-19T07:11:29.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.052+0000 7f24491f3640 1 --2- 172.21.15.148:0/1076899401 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559ed35302f0 0x559ed35377e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2438097e10 tx=0x7f243809aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a0570c3ce474100 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:29.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.052+0000 7f242d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:11:29.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.052+0000 7f242d7fa640 1 -- 172.21.15.148:0/1076899401 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243801e070 con 0x559ed35302f0 2024-09-19T07:11:29.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.052+0000 7f242d7fa640 1 -- 172.21.15.148:0/1076899401 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f2438010ca0 con 0x559ed35302f0 2024-09-19T07:11:29.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.052+0000 7f244e031740 1 -- 172.21.15.148:0/1076899401 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f243c011d00 con 0x559ed35302f0 2024-09-19T07:11:29.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.052+0000 7f242d7fa640 1 -- 172.21.15.148:0/1076899401 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f24380a40b0 con 0x559ed35302f0 2024-09-19T07:11:29.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.052+0000 7f244e031740 10 client.15387 fetch_fsmap learned FSMap version 25 2024-09-19T07:11:29.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.052+0000 7f244e031740 1 -- 172.21.15.148:0/1076899401 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559ed35490f0 con 0x559ed35302f0 2024-09-19T07:11:29.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.053+0000 7f242d7fa640 1 -- 172.21.15.148:0/1076899401 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f243c011d00 con 0x559ed35302f0 2024-09-19T07:11:29.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.053+0000 7f242d7fa640 1 -- 172.21.15.148:0/1076899401 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f24380a8030 con 0x559ed35302f0 2024-09-19T07:11:29.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.053+0000 7f244e031740 10 client.15387 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:11:29.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.053+0000 7f244e031740 10 client.15387 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T07:11:29.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.053+0000 7f244e031740 20 client.15387 populate_metadata read hostname 'smithi148' 2024-09-19T07:11:29.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.053+0000 7f244e031740 1 --2- 172.21.15.148:0/1076899401 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x559ed354b6a0 0x559ed354cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:29.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.053+0000 7f244e031740 4 client.15387 mds_command: new command op to 24436 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:11:29.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.053+0000 7f244e031740 1 -- 172.21.15.148:0/1076899401 --> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559ed34a3600 con 0x559ed354b6a0 2024-09-19T07:11:29.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.053+0000 7f24499f4640 1 --2- 172.21.15.148:0/1076899401 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x559ed354b6a0 0x559ed354cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:29.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.054+0000 7f242d7fa640 10 client.15387 ms_handle_connect on v2:172.21.15.179:6836/3827671241 2024-09-19T07:11:29.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.054+0000 7f24499f4640 1 --2- 172.21.15.148:0/1076899401 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x559ed354b6a0 0x559ed354cb10 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=832fb6675623c0e1 server_cookie=391f31407938fc09 in_seq=0 out_seq=0 2024-09-19T07:11:29.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.054+0000 7f242d7fa640 1 -- 172.21.15.148:0/1076899401 <== mds.2 v2:172.21.15.179:6836/3827671241 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559ed34a3600 con 0x559ed354b6a0 2024-09-19T07:11:29.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.054+0000 7f242d7fa640 10 client.15387 handle_command_reply: tid=0 2024-09-19T07:11:29.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.054+0000 7f244e031740 1 client.15387 shutdown 2024-09-19T07:11:29.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.054+0000 7f244e031740 1 -- 172.21.15.148:0/1076899401 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559ed35302f0 msgr2=0x559ed35377e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:29.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.054+0000 7f244e031740 1 --2- 172.21.15.148:0/1076899401 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559ed35302f0 0x559ed35377e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2438097e10 tx=0x7f243809aea0 comp rx=0 tx=0).stop 2024-09-19T07:11:29.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.054+0000 7f244e031740 1 -- 172.21.15.148:0/1076899401 shutdown_connections 2024-09-19T07:11:29.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.054+0000 7f244e031740 1 --2- 172.21.15.148:0/1076899401 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x559ed354b6a0 0x559ed354cb10 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:29.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.054+0000 7f244e031740 1 --2- 172.21.15.148:0/1076899401 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559ed353abb0 0x559ed3537d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:29.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.054+0000 7f244e031740 1 --2- 172.21.15.148:0/1076899401 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559ed35302f0 0x559ed35377e0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:29.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.054+0000 7f242d7fa640 0 client.15387 ms_handle_reset on v2:172.21.15.179:6836/3827671241 2024-09-19T07:11:29.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.054+0000 7f244e031740 1 --2- 172.21.15.148:0/1076899401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559ed352f9d0 0x559ed353a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:29.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.054+0000 7f244e031740 1 -- 172.21.15.148:0/1076899401 >> 172.21.15.148:0/1076899401 conn(0x559ed352bf60 msgr2=0x559ed3531c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:29.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.055+0000 7f244e031740 1 -- 172.21.15.148:0/1076899401 shutdown_connections 2024-09-19T07:11:29.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.055+0000 7f244e031740 1 -- 172.21.15.148:0/1076899401 wait complete. 2024-09-19T07:11:29.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.055+0000 7f244e031740 20 client.15387 trim_cache size 0 max 16384 2024-09-19T07:11:29.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.072+0000 7f244e031740 1 Processor -- start 2024-09-19T07:11:29.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.072+0000 7f244e031740 1 -- start start 2024-09-19T07:11:29.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.072+0000 7f244e031740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559ed352f9d0 0x559ed354cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:29.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.073+0000 7f244e031740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559ed35302f0 0x559ed35551e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:29.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.073+0000 7f244e031740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559ed353abb0 0x559ed35377a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:29.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.073+0000 7f244e031740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x559ed354ae50 con 0x559ed35302f0 2024-09-19T07:11:29.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.073+0000 7f244e031740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x559ed354b520 con 0x559ed353abb0 2024-09-19T07:11:29.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.073+0000 7f244e031740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x559ed354bbf0 con 0x559ed352f9d0 2024-09-19T07:11:29.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.073+0000 7f24491f3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559ed35302f0 0x559ed35551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:29.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.073+0000 7f24491f3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559ed35302f0 0x559ed35551e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35084/0 (socket says 172.21.15.148:35084) 2024-09-19T07:11:29.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.073+0000 7f24491f3640 1 -- 172.21.15.148:0/2236333854 learned_addr learned my addr 172.21.15.148:0/2236333854 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:29.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.073+0000 7f24499f4640 1 --2- 172.21.15.148:0/2236333854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559ed352f9d0 0x559ed354cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:29.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.073+0000 7f24491f3640 1 -- 172.21.15.148:0/2236333854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559ed352f9d0 msgr2=0x559ed354cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:29.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.073+0000 7f244a1f5640 1 --2- 172.21.15.148:0/2236333854 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559ed353abb0 0x559ed35377a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:29.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.073+0000 7f24491f3640 1 --2- 172.21.15.148:0/2236333854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559ed352f9d0 0x559ed354cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:29.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.073+0000 7f24491f3640 1 -- 172.21.15.148:0/2236333854 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559ed353abb0 msgr2=0x559ed35377a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:29.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.073+0000 7f24491f3640 1 --2- 172.21.15.148:0/2236333854 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559ed353abb0 0x559ed35377a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:29.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.073+0000 7f24491f3640 1 -- 172.21.15.148:0/2236333854 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ed353a0b0 con 0x559ed35302f0 2024-09-19T07:11:29.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.073+0000 7f24499f4640 1 --2- 172.21.15.148:0/2236333854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559ed352f9d0 0x559ed354cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:11:29.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.073+0000 7f244a1f5640 1 --2- 172.21.15.148:0/2236333854 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559ed353abb0 0x559ed35377a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:11:29.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.073+0000 7f24491f3640 1 --2- 172.21.15.148:0/2236333854 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559ed35302f0 0x559ed35551e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f243809af10 tx=0x7f24380047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de9503e31813ff11 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:29.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.073+0000 7f242f7fe640 1 -- 172.21.15.148:0/2236333854 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243801e070 con 0x559ed35302f0 2024-09-19T07:11:29.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.073+0000 7f242f7fe640 1 -- 172.21.15.148:0/2236333854 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2438097ab0 con 0x559ed35302f0 2024-09-19T07:11:29.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.073+0000 7f242f7fe640 1 -- 172.21.15.148:0/2236333854 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24380cca70 con 0x559ed35302f0 2024-09-19T07:11:29.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.074+0000 7f244e031740 1 -- 172.21.15.148:0/2236333854 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559ed35302f0 msgr2=0x559ed35551e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:29.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.074+0000 7f244e031740 1 --2- 172.21.15.148:0/2236333854 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559ed35302f0 0x559ed35551e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f243809af10 tx=0x7f24380047d0 comp rx=0 tx=0).stop 2024-09-19T07:11:29.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.074+0000 7f244e031740 1 -- 172.21.15.148:0/2236333854 shutdown_connections 2024-09-19T07:11:29.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.074+0000 7f244e031740 1 --2- 172.21.15.148:0/2236333854 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559ed353abb0 0x559ed35377a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:29.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.074+0000 7f244e031740 1 --2- 172.21.15.148:0/2236333854 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559ed35302f0 0x559ed35551e0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:29.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.074+0000 7f244e031740 1 --2- 172.21.15.148:0/2236333854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559ed352f9d0 0x559ed354cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:29.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.074+0000 7f244e031740 1 -- 172.21.15.148:0/2236333854 >> 172.21.15.148:0/2236333854 conn(0x559ed352bf60 msgr2=0x559ed3526ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:29.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.074+0000 7f244e031740 1 -- 172.21.15.148:0/2236333854 shutdown_connections 2024-09-19T07:11:29.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.074+0000 7f244e031740 1 -- 172.21.15.148:0/2236333854 wait complete. 2024-09-19T07:11:29.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.074+0000 7f244e031740 1 -- start start 2024-09-19T07:11:29.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.075+0000 7f244e031740 1 Processor -- start 2024-09-19T07:11:29.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.075+0000 7f244e031740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559ed352f9d0 0x559ed35b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:29.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.075+0000 7f244e031740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559ed35302f0 0x559ed35b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:29.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.075+0000 7f244e031740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559ed353abb0 0x559ed354e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:29.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.075+0000 7f244e031740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x559ed354c990 con 0x559ed352f9d0 2024-09-19T07:11:29.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.075+0000 7f244e031740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x559ed354c2c0 con 0x559ed35302f0 2024-09-19T07:11:29.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.075+0000 7f244e031740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x559ed354d060 con 0x559ed353abb0 2024-09-19T07:11:29.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.075+0000 7f244e031740 10 client.0 _ll_register_callbacks cb 0x7f24380cc7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:11:29.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.075+0000 7f24499f4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559ed352f9d0 0x559ed35b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:29.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.075+0000 7f24499f4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559ed352f9d0 0x559ed35b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35098/0 (socket says 172.21.15.148:35098) 2024-09-19T07:11:29.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.075+0000 7f24499f4640 1 -- 172.21.15.148:0/3766038787 learned_addr learned my addr 172.21.15.148:0/3766038787 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:29.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.075+0000 7f24491f3640 1 --2- 172.21.15.148:0/3766038787 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559ed35302f0 0x559ed35b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:29.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.075+0000 7f24499f4640 1 -- 172.21.15.148:0/3766038787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559ed353abb0 msgr2=0x559ed354e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:29.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.075+0000 7f24499f4640 1 --2- 172.21.15.148:0/3766038787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559ed353abb0 0x559ed354e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:29.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.075+0000 7f24499f4640 1 -- 172.21.15.148:0/3766038787 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559ed35302f0 msgr2=0x559ed35b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:29.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.075+0000 7f24499f4640 1 --2- 172.21.15.148:0/3766038787 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559ed35302f0 0x559ed35b1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:29.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.075+0000 7f24499f4640 1 -- 172.21.15.148:0/3766038787 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ed354ee70 con 0x559ed352f9d0 2024-09-19T07:11:29.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.075+0000 7f24491f3640 1 --2- 172.21.15.148:0/3766038787 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559ed35302f0 0x559ed35b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:11:29.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.076+0000 7f24499f4640 1 --2- 172.21.15.148:0/3766038787 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559ed352f9d0 0x559ed35b1130 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f2440005940 tx=0x7f2440031850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c8bfd264303fab1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:29.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.076+0000 7f242d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:11:29.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.076+0000 7f242d7fa640 1 -- 172.21.15.148:0/3766038787 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244004b070 con 0x559ed352f9d0 2024-09-19T07:11:29.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.076+0000 7f242d7fa640 1 -- 172.21.15.148:0/3766038787 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f2440004450 con 0x559ed352f9d0 2024-09-19T07:11:29.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.076+0000 7f244e031740 1 -- 172.21.15.148:0/3766038787 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2438097ab0 con 0x559ed352f9d0 2024-09-19T07:11:29.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.076+0000 7f242d7fa640 1 -- 172.21.15.148:0/3766038787 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2440056050 con 0x559ed352f9d0 2024-09-19T07:11:29.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.076+0000 7f244e031740 10 client.15393 fetch_fsmap learned FSMap version 25 2024-09-19T07:11:29.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.076+0000 7f244e031740 1 -- 172.21.15.148:0/3766038787 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559ed35b99d0 con 0x559ed352f9d0 2024-09-19T07:11:29.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.076+0000 7f242d7fa640 1 -- 172.21.15.148:0/3766038787 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2438097ab0 con 0x559ed352f9d0 2024-09-19T07:11:29.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.076+0000 7f242d7fa640 1 -- 172.21.15.148:0/3766038787 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2440004cc0 con 0x559ed352f9d0 2024-09-19T07:11:29.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.076+0000 7f244e031740 10 client.15393 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:11:29.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.076+0000 7f244e031740 10 client.15393 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T07:11:29.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.076+0000 7f244e031740 20 client.15393 populate_metadata read hostname 'smithi148' 2024-09-19T07:11:29.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.076+0000 7f244e031740 1 --2- 172.21.15.148:0/3766038787 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x559ed35be640 0x559ed35bd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:29.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.076+0000 7f244e031740 4 client.15393 mds_command: new command op to 24436 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T07:11:29.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.076+0000 7f244e031740 1 -- 172.21.15.148:0/3766038787 --> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] -- command(tid 0: {"prefix": "status"}) -- 0x559ed349db10 con 0x559ed35be640 2024-09-19T07:11:29.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.077+0000 7f24491f3640 1 --2- 172.21.15.148:0/3766038787 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x559ed35be640 0x559ed35bd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:29.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.077+0000 7f242d7fa640 10 client.15393 ms_handle_connect on v2:172.21.15.179:6836/3827671241 2024-09-19T07:11:29.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.077+0000 7f24491f3640 1 --2- 172.21.15.148:0/3766038787 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x559ed35be640 0x559ed35bd350 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=458d4dc9e9a7e6af server_cookie=91849f2d6dccac76 in_seq=0 out_seq=0 2024-09-19T07:11:29.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.077+0000 7f242d7fa640 1 -- 172.21.15.148:0/3766038787 <== mds.2 v2:172.21.15.179:6836/3827671241 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x559ed349db10 con 0x559ed35be640 2024-09-19T07:11:29.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.077+0000 7f242d7fa640 10 client.15393 handle_command_reply: tid=0 2024-09-19T07:11:29.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.077+0000 7f244e031740 1 client.15393 shutdown 2024-09-19T07:11:29.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.077+0000 7f244e031740 1 -- 172.21.15.148:0/3766038787 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559ed352f9d0 msgr2=0x559ed35b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:29.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.077+0000 7f244e031740 1 --2- 172.21.15.148:0/3766038787 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559ed352f9d0 0x559ed35b1130 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f2440005940 tx=0x7f2440031850 comp rx=0 tx=0).stop 2024-09-19T07:11:29.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.077+0000 7f244e031740 1 -- 172.21.15.148:0/3766038787 shutdown_connections 2024-09-19T07:11:29.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.077+0000 7f244e031740 1 --2- 172.21.15.148:0/3766038787 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x559ed35be640 0x559ed35bd350 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:29.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.077+0000 7f244e031740 1 --2- 172.21.15.148:0/3766038787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559ed353abb0 0x559ed354e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:29.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.077+0000 7f244e031740 1 --2- 172.21.15.148:0/3766038787 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559ed35302f0 0x559ed35b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:29.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.077+0000 7f242d7fa640 0 client.15393 ms_handle_reset on v2:172.21.15.179:6836/3827671241 2024-09-19T07:11:29.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.077+0000 7f244e031740 1 --2- 172.21.15.148:0/3766038787 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559ed352f9d0 0x559ed35b1130 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:29.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.078+0000 7f244e031740 1 -- 172.21.15.148:0/3766038787 >> 172.21.15.148:0/3766038787 conn(0x559ed352bf60 msgr2=0x559ed35377a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:29.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.078+0000 7f244e031740 1 -- 172.21.15.148:0/3766038787 shutdown_connections 2024-09-19T07:11:29.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.078+0000 7f244e031740 1 -- 172.21.15.148:0/3766038787 wait complete. 2024-09-19T07:11:29.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.078+0000 7f244e031740 20 client.15393 trim_cache size 0 max 16384 2024-09-19T07:11:29.087 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:11:29.087 INFO:teuthology.orchestra.run.smithi148.stdout: "cluster_fsid": "eae8a4a8-7654-11ef-bceb-c7b262605968", 2024-09-19T07:11:29.087 INFO:teuthology.orchestra.run.smithi148.stdout: "whoami": 2, 2024-09-19T07:11:29.088 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 24436, 2024-09-19T07:11:29.088 INFO:teuthology.orchestra.run.smithi148.stdout: "want_state": "up:active", 2024-09-19T07:11:29.088 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "up:active", 2024-09-19T07:11:29.088 INFO:teuthology.orchestra.run.smithi148.stdout: "fs_name": "cephfs", 2024-09-19T07:11:29.088 INFO:teuthology.orchestra.run.smithi148.stdout: "rank_uptime": 121.100818813, 2024-09-19T07:11:29.088 INFO:teuthology.orchestra.run.smithi148.stdout: "mdsmap_epoch": 25, 2024-09-19T07:11:29.088 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch": 81, 2024-09-19T07:11:29.088 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch_barrier": 81, 2024-09-19T07:11:29.088 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 153.12135082899999 2024-09-19T07:11:29.088 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:11:29.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.078+0000 7f244bc58640 1 -- 172.21.15.148:0/2461722928 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f24300a34c0 msgr2=0x7f24300a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:29.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.078+0000 7f244bc58640 1 --2- 172.21.15.148:0/2461722928 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f24300a34c0 0x7f24300a5980 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f243c01d000 tx=0x7f243c01e000 comp rx=0 tx=0).stop 2024-09-19T07:11:29.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.078+0000 7f244bc58640 1 -- 172.21.15.148:0/2461722928 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24441027a0 msgr2=0x7f2444198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:29.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.078+0000 7f244bc58640 1 --2- 172.21.15.148:0/2461722928 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24441027a0 0x7f2444198ae0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f243800b4a0 tx=0x7f243800b960 comp rx=0 tx=0).stop 2024-09-19T07:11:29.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.078+0000 7f244bc58640 1 -- 172.21.15.148:0/2461722928 shutdown_connections 2024-09-19T07:11:29.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.078+0000 7f244bc58640 1 --2- 172.21.15.148:0/2461722928 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f24300a34c0 0x7f24300a5980 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:29.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.078+0000 7f244bc58640 1 --2- 172.21.15.148:0/2461722928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2444106f20 0x7f244419ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:29.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.078+0000 7f244bc58640 1 --2- 172.21.15.148:0/2461722928 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24441027a0 0x7f2444198ae0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:29.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.078+0000 7f244bc58640 1 --2- 172.21.15.148:0/2461722928 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2444101df0 0x7f24441985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:29.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.078+0000 7f244bc58640 1 -- 172.21.15.148:0/2461722928 >> 172.21.15.148:0/2461722928 conn(0x7f24440fd8f0 msgr2=0x7f24440fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:29.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.078+0000 7f244bc58640 1 -- 172.21.15.148:0/2461722928 shutdown_connections 2024-09-19T07:11:29.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:29.078+0000 7f244bc58640 1 -- 172.21.15.148:0/2461722928 wait complete. 2024-09-19T07:11:29.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:29 smithi148 ceph-mon[31180]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-19T07:11:29.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:29 smithi165 ceph-mon[35326]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-19T07:11:29.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:29 smithi179 ceph-mon[35716]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-19T07:11:29.818 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T07:11:30.068 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:11:30.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.577+0000 7f28f378f640 1 -- 172.21.15.148:0/121947623 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28ec102790 msgr2=0x7f28ec1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:30.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.577+0000 7f28f378f640 1 --2- 172.21.15.148:0/121947623 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28ec102790 0x7f28ec1067e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f28dc009900 tx=0x7f28dc02a410 comp rx=0 tx=0).stop 2024-09-19T07:11:30.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.577+0000 7f28f378f640 1 -- 172.21.15.148:0/121947623 shutdown_connections 2024-09-19T07:11:30.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.577+0000 7f28f378f640 1 --2- 172.21.15.148:0/121947623 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f28ec106f10 0x7f28ec10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:30.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.577+0000 7f28f378f640 1 --2- 172.21.15.148:0/121947623 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28ec102790 0x7f28ec1067e0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:30.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.577+0000 7f28f378f640 1 --2- 172.21.15.148:0/121947623 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28ec101de0 0x7f28ec1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:30.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.577+0000 7f28f378f640 1 -- 172.21.15.148:0/121947623 >> 172.21.15.148:0/121947623 conn(0x7f28ec0fd8c0 msgr2=0x7f28ec0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:30.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.577+0000 7f28f378f640 1 -- 172.21.15.148:0/121947623 shutdown_connections 2024-09-19T07:11:30.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.577+0000 7f28f378f640 1 -- 172.21.15.148:0/121947623 wait complete. 2024-09-19T07:11:30.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.578+0000 7f28f378f640 1 Processor -- start 2024-09-19T07:11:30.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.578+0000 7f28f378f640 1 -- start start 2024-09-19T07:11:30.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.578+0000 7f28f378f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28ec101de0 0x7f28ec1983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:30.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.578+0000 7f28f378f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28ec102790 0x7f28ec1988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:30.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.578+0000 7f28f378f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f28ec106f10 0x7f28ec19cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:30.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.578+0000 7f28f378f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f28ec111f70 con 0x7f28ec101de0 2024-09-19T07:11:30.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.578+0000 7f28f378f640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f28ec111df0 con 0x7f28ec106f10 2024-09-19T07:11:30.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.578+0000 7f28f378f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f28ec1120f0 con 0x7f28ec102790 2024-09-19T07:11:30.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.578+0000 7f28f152b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28ec101de0 0x7f28ec1983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:30.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.578+0000 7f28f152b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28ec101de0 0x7f28ec1983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35114/0 (socket says 172.21.15.148:35114) 2024-09-19T07:11:30.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.578+0000 7f28f152b640 1 -- 172.21.15.148:0/884291296 learned_addr learned my addr 172.21.15.148:0/884291296 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:30.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.579+0000 7f28f1d2c640 1 --2- 172.21.15.148:0/884291296 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f28ec106f10 0x7f28ec19cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:30.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.579+0000 7f28f0d2a640 1 --2- 172.21.15.148:0/884291296 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28ec102790 0x7f28ec1988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:30.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.579+0000 7f28f152b640 1 -- 172.21.15.148:0/884291296 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28ec102790 msgr2=0x7f28ec1988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:30.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.579+0000 7f28f152b640 1 --2- 172.21.15.148:0/884291296 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28ec102790 0x7f28ec1988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:30.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.579+0000 7f28f152b640 1 -- 172.21.15.148:0/884291296 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f28ec106f10 msgr2=0x7f28ec19cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:30.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.579+0000 7f28f152b640 1 --2- 172.21.15.148:0/884291296 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f28ec106f10 0x7f28ec19cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:30.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.579+0000 7f28f152b640 1 -- 172.21.15.148:0/884291296 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28ec19d360 con 0x7f28ec101de0 2024-09-19T07:11:30.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.579+0000 7f28f1d2c640 1 --2- 172.21.15.148:0/884291296 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f28ec106f10 0x7f28ec19cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:11:30.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.579+0000 7f28f0d2a640 1 --2- 172.21.15.148:0/884291296 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28ec102790 0x7f28ec1988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:11:30.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.579+0000 7f28f152b640 1 --2- 172.21.15.148:0/884291296 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28ec101de0 0x7f28ec1983b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f28e800c890 tx=0x7f28e800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:30.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.579+0000 7f28e27fc640 1 -- 172.21.15.148:0/884291296 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e8004220 con 0x7f28ec101de0 2024-09-19T07:11:30.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.579+0000 7f28e27fc640 1 -- 172.21.15.148:0/884291296 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28e80043c0 con 0x7f28ec101de0 2024-09-19T07:11:30.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.579+0000 7f28e27fc640 1 -- 172.21.15.148:0/884291296 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e80049e0 con 0x7f28ec101de0 2024-09-19T07:11:30.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.579+0000 7f28f378f640 1 -- 172.21.15.148:0/884291296 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28ec19d650 con 0x7f28ec101de0 2024-09-19T07:11:30.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.579+0000 7f28f378f640 1 -- 172.21.15.148:0/884291296 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28ec1a4f30 con 0x7f28ec101de0 2024-09-19T07:11:30.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.581+0000 7f28e27fc640 1 -- 172.21.15.148:0/884291296 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f28e80079b0 con 0x7f28ec101de0 2024-09-19T07:11:30.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.582+0000 7f28f5b68740 1 Processor -- start 2024-09-19T07:11:30.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.582+0000 7f28f5b68740 1 -- start start 2024-09-19T07:11:30.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.582+0000 7f28f5b68740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ad2fc8d890 0x55ad2fc8dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:30.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.582+0000 7f28f5b68740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ad2fc8e1b0 0x55ad2fc9ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:30.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.582+0000 7f28f5b68740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ad2fc9cfc0 0x55ad2fc9f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:30.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.582+0000 7f28f5b68740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55ad2fbf4090 con 0x55ad2fc9cfc0 2024-09-19T07:11:30.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.582+0000 7f28f5b68740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ad2fb9ba70 con 0x55ad2fc8d890 2024-09-19T07:11:30.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.582+0000 7f28f5b68740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ad2fbf0050 con 0x55ad2fc8e1b0 2024-09-19T07:11:30.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.582+0000 7f28f0d2a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ad2fc9cfc0 0x55ad2fc9f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:30.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.582+0000 7f28f0d2a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ad2fc9cfc0 0x55ad2fc9f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35118/0 (socket says 172.21.15.148:35118) 2024-09-19T07:11:30.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.582+0000 7f28f0d2a640 1 -- 172.21.15.148:0/4276747235 learned_addr learned my addr 172.21.15.148:0/4276747235 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:30.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.582+0000 7f28e27fc640 1 --2- 172.21.15.148:0/884291296 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f28d80a34c0 0x7f28d80a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:30.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.583+0000 7f28f1d2c640 1 --2- 172.21.15.148:0/4276747235 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ad2fc8d890 0x55ad2fc8dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:30.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.583+0000 7f28f1d2c640 1 --2- 172.21.15.148:0/884291296 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f28d80a34c0 0x7f28d80a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:30.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.583+0000 7f28f0d2a640 1 -- 172.21.15.148:0/4276747235 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ad2fc8e1b0 msgr2=0x55ad2fc9ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:30.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.583+0000 7f28e27fc640 1 -- 172.21.15.148:0/884291296 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f28e80cffc0 con 0x7f28ec101de0 2024-09-19T07:11:30.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.583+0000 7f28f152b640 1 --2- 172.21.15.148:0/4276747235 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ad2fc8e1b0 0x55ad2fc9ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:30.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.583+0000 7f28f0d2a640 1 --2- 172.21.15.148:0/4276747235 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ad2fc8e1b0 0x55ad2fc9ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:30.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.583+0000 7f28f0d2a640 1 -- 172.21.15.148:0/4276747235 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ad2fc8d890 msgr2=0x55ad2fc8dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:30.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.583+0000 7f28f0d2a640 1 --2- 172.21.15.148:0/4276747235 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ad2fc8d890 0x55ad2fc8dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:30.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.583+0000 7f28f0d2a640 1 -- 172.21.15.148:0/4276747235 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad2fba8130 con 0x55ad2fc9cfc0 2024-09-19T07:11:30.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.583+0000 7f28f1d2c640 1 --2- 172.21.15.148:0/4276747235 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ad2fc8d890 0x55ad2fc8dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:11:30.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.583+0000 7f28f152b640 1 --2- 172.21.15.148:0/4276747235 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ad2fc8e1b0 0x55ad2fc9ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:11:30.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.583+0000 7f28f0d2a640 1 --2- 172.21.15.148:0/4276747235 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ad2fc9cfc0 0x55ad2fc9f3b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f28dc005ab0 tx=0x7f28dc009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c31362f94f435f90 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:30.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.583+0000 7f28f1d2c640 1 --2- 172.21.15.148:0/884291296 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f28d80a34c0 0x7f28d80a5980 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f28e400afd0 tx=0x7f28e4005f90 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:30.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.583+0000 7f28d77fe640 1 -- 172.21.15.148:0/4276747235 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28dc03f070 con 0x55ad2fc9cfc0 2024-09-19T07:11:30.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.583+0000 7f28d77fe640 1 -- 172.21.15.148:0/4276747235 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28dc0317b0 con 0x55ad2fc9cfc0 2024-09-19T07:11:30.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.583+0000 7f28d77fe640 1 -- 172.21.15.148:0/4276747235 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28dc035070 con 0x55ad2fc9cfc0 2024-09-19T07:11:30.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.584+0000 7f28f5b68740 1 -- 172.21.15.148:0/4276747235 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ad2fc9cfc0 msgr2=0x55ad2fc9f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:30.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.584+0000 7f28f5b68740 1 --2- 172.21.15.148:0/4276747235 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ad2fc9cfc0 0x55ad2fc9f3b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f28dc005ab0 tx=0x7f28dc009680 comp rx=0 tx=0).stop 2024-09-19T07:11:30.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.584+0000 7f28f5b68740 1 -- 172.21.15.148:0/4276747235 shutdown_connections 2024-09-19T07:11:30.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.584+0000 7f28f5b68740 1 --2- 172.21.15.148:0/4276747235 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ad2fc9cfc0 0x55ad2fc9f3b0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:30.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.584+0000 7f28f5b68740 1 --2- 172.21.15.148:0/4276747235 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ad2fc8e1b0 0x55ad2fc9ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:30.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.584+0000 7f28f5b68740 1 --2- 172.21.15.148:0/4276747235 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ad2fc8d890 0x55ad2fc8dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:30.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.584+0000 7f28f5b68740 1 -- 172.21.15.148:0/4276747235 >> 172.21.15.148:0/4276747235 conn(0x55ad2fc89f60 msgr2=0x55ad2fc8a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:30.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.584+0000 7f28f5b68740 1 -- 172.21.15.148:0/4276747235 shutdown_connections 2024-09-19T07:11:30.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.584+0000 7f28f5b68740 1 -- 172.21.15.148:0/4276747235 wait complete. 2024-09-19T07:11:30.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.584+0000 7f28f5b68740 1 -- start start 2024-09-19T07:11:30.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.584+0000 7f28f5b68740 1 Processor -- start 2024-09-19T07:11:30.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.585+0000 7f28f5b68740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ad2fc8d890 0x55ad2fc9c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:30.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.585+0000 7f28f5b68740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ad2fc8e1b0 0x55ad2fc99b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:30.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.585+0000 7f28f5b68740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ad2fc9cfc0 0x55ad2fc9a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:30.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.585+0000 7f28f5b68740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55ad2fc9fb30 con 0x55ad2fc8e1b0 2024-09-19T07:11:30.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.585+0000 7f28f5b68740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ad2fbaef20 con 0x55ad2fc8d890 2024-09-19T07:11:30.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.585+0000 7f28f5b68740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ad2fc9fcb0 con 0x55ad2fc9cfc0 2024-09-19T07:11:30.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.585+0000 7f28f5b68740 10 client.0 _ll_register_callbacks cb 0x55ad2fb78030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:11:30.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.585+0000 7f28f0d2a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ad2fc8e1b0 0x55ad2fc99b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:30.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.585+0000 7f28f0d2a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ad2fc8e1b0 0x55ad2fc99b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35132/0 (socket says 172.21.15.148:35132) 2024-09-19T07:11:30.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.585+0000 7f28f0d2a640 1 -- 172.21.15.148:0/915839935 learned_addr learned my addr 172.21.15.148:0/915839935 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:30.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.585+0000 7f28f152b640 1 --2- 172.21.15.148:0/915839935 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ad2fc8d890 0x55ad2fc9c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:30.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.585+0000 7f28f1d2c640 1 --2- 172.21.15.148:0/915839935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ad2fc9cfc0 0x55ad2fc9a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:30.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.585+0000 7f28f0d2a640 1 -- 172.21.15.148:0/915839935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ad2fc9cfc0 msgr2=0x55ad2fc9a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:30.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.585+0000 7f28f0d2a640 1 --2- 172.21.15.148:0/915839935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ad2fc9cfc0 0x55ad2fc9a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:30.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.585+0000 7f28f0d2a640 1 -- 172.21.15.148:0/915839935 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ad2fc8d890 msgr2=0x55ad2fc9c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:30.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.585+0000 7f28f0d2a640 1 --2- 172.21.15.148:0/915839935 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ad2fc8d890 0x55ad2fc9c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:30.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.585+0000 7f28f0d2a640 1 -- 172.21.15.148:0/915839935 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad2f9652b0 con 0x55ad2fc8e1b0 2024-09-19T07:11:30.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.585+0000 7f28f1d2c640 1 --2- 172.21.15.148:0/915839935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ad2fc9cfc0 0x55ad2fc9a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:11:30.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.585+0000 7f28f0d2a640 1 --2- 172.21.15.148:0/915839935 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ad2fc8e1b0 0x55ad2fc99b80 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f28dc02a450 tx=0x7f28dc02ab10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=215b3c70544d6de3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:30.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.585+0000 7f28d4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:11:30.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.586+0000 7f28d4ff9640 1 -- 172.21.15.148:0/915839935 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28dc03f070 con 0x55ad2fc8e1b0 2024-09-19T07:11:30.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.586+0000 7f28d4ff9640 1 -- 172.21.15.148:0/915839935 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f28dc004240 con 0x55ad2fc8e1b0 2024-09-19T07:11:30.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.586+0000 7f28f5b68740 1 -- 172.21.15.148:0/915839935 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28dc0317b0 con 0x55ad2fc8e1b0 2024-09-19T07:11:30.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.586+0000 7f28d4ff9640 1 -- 172.21.15.148:0/915839935 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f28dc035040 con 0x55ad2fc8e1b0 2024-09-19T07:11:30.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.586+0000 7f28f5b68740 10 client.15405 fetch_fsmap learned FSMap version 25 2024-09-19T07:11:30.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.586+0000 7f28f5b68740 1 -- 172.21.15.148:0/915839935 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ad2fcab3d0 con 0x55ad2fc8e1b0 2024-09-19T07:11:30.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.586+0000 7f28d4ff9640 1 -- 172.21.15.148:0/915839935 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28dc0317b0 con 0x55ad2fc8e1b0 2024-09-19T07:11:30.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.586+0000 7f28d4ff9640 1 -- 172.21.15.148:0/915839935 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f28dc004860 con 0x55ad2fc8e1b0 2024-09-19T07:11:30.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.586+0000 7f28f5b68740 10 client.15405 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:11:30.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.586+0000 7f28f5b68740 10 client.15405 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T07:11:30.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.586+0000 7f28f5b68740 20 client.15405 populate_metadata read hostname 'smithi148' 2024-09-19T07:11:30.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.586+0000 7f28f5b68740 1 --2- 172.21.15.148:0/915839935 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x55ad2fcad530 0x55ad2fcae9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:30.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.586+0000 7f28f5b68740 4 client.15405 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:11:30.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.586+0000 7f28f5b68740 1 -- 172.21.15.148:0/915839935 --> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ad2fc01600 con 0x55ad2fcad530 2024-09-19T07:11:30.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.587+0000 7f28f152b640 1 --2- 172.21.15.148:0/915839935 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x55ad2fcad530 0x55ad2fcae9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:30.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.587+0000 7f28f152b640 1 --2- 172.21.15.148:0/915839935 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x55ad2fcad530 0x55ad2fcae9a0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=88fb7a85c8661324 server_cookie=b86e02461af9449a in_seq=0 out_seq=0 2024-09-19T07:11:30.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.587+0000 7f28d4ff9640 10 client.15405 ms_handle_connect on v2:172.21.15.165:6838/3993490234 2024-09-19T07:11:30.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.588+0000 7f28d4ff9640 1 -- 172.21.15.148:0/915839935 <== mds.1 v2:172.21.15.165:6838/3993490234 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ad2fc01600 con 0x55ad2fcad530 2024-09-19T07:11:30.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.588+0000 7f28d4ff9640 10 client.15405 handle_command_reply: tid=0 2024-09-19T07:11:30.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.588+0000 7f28f5b68740 1 client.15405 shutdown 2024-09-19T07:11:30.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.588+0000 7f28f5b68740 1 -- 172.21.15.148:0/915839935 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ad2fc8e1b0 msgr2=0x55ad2fc99b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:30.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.588+0000 7f28f5b68740 1 --2- 172.21.15.148:0/915839935 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ad2fc8e1b0 0x55ad2fc99b80 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f28dc02a450 tx=0x7f28dc02ab10 comp rx=0 tx=0).stop 2024-09-19T07:11:30.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.588+0000 7f28f5b68740 1 -- 172.21.15.148:0/915839935 shutdown_connections 2024-09-19T07:11:30.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.588+0000 7f28f5b68740 1 --2- 172.21.15.148:0/915839935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ad2fc9cfc0 0x55ad2fc9a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:30.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.588+0000 7f28f5b68740 1 --2- 172.21.15.148:0/915839935 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ad2fc8e1b0 0x55ad2fc99b80 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:30.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.588+0000 7f28f5b68740 1 --2- 172.21.15.148:0/915839935 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x55ad2fcad530 0x55ad2fcae9a0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:30.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.588+0000 7f28f5b68740 1 --2- 172.21.15.148:0/915839935 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ad2fc8d890 0x55ad2fc9c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:30.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.588+0000 7f28f5b68740 1 -- 172.21.15.148:0/915839935 >> 172.21.15.148:0/915839935 conn(0x55ad2fc89f60 msgr2=0x55ad2fc8fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:30.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.588+0000 7f28d4ff9640 0 client.15405 ms_handle_reset on v2:172.21.15.165:6838/3993490234 2024-09-19T07:11:30.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.588+0000 7f28f5b68740 1 -- 172.21.15.148:0/915839935 shutdown_connections 2024-09-19T07:11:30.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.588+0000 7f28f5b68740 1 -- 172.21.15.148:0/915839935 wait complete. 2024-09-19T07:11:30.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.588+0000 7f28f5b68740 20 client.15405 trim_cache size 0 max 16384 2024-09-19T07:11:30.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.606+0000 7f28f5b68740 1 Processor -- start 2024-09-19T07:11:30.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.606+0000 7f28f5b68740 1 -- start start 2024-09-19T07:11:30.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.606+0000 7f28f5b68740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ad2fc8d890 0x55ad2fca9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:30.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.606+0000 7f28f5b68740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ad2fc8e1b0 0x55ad2fc84ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:30.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.606+0000 7f28f5b68740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ad2fc9cfc0 0x55ad2fc96de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:30.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.606+0000 7f28f5b68740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55ad2fcacce0 con 0x55ad2fc8e1b0 2024-09-19T07:11:30.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.606+0000 7f28f5b68740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ad2fcad3b0 con 0x55ad2fc8d890 2024-09-19T07:11:30.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.606+0000 7f28f5b68740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ad2fcada80 con 0x55ad2fc9cfc0 2024-09-19T07:11:30.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.606+0000 7f28f0d2a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ad2fc8e1b0 0x55ad2fc84ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:30.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.606+0000 7f28f0d2a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ad2fc8e1b0 0x55ad2fc84ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35140/0 (socket says 172.21.15.148:35140) 2024-09-19T07:11:30.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.606+0000 7f28f0d2a640 1 -- 172.21.15.148:0/3931341324 learned_addr learned my addr 172.21.15.148:0/3931341324 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:30.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.606+0000 7f28f152b640 1 --2- 172.21.15.148:0/3931341324 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ad2fc8d890 0x55ad2fca9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:30.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.606+0000 7f28f0d2a640 1 -- 172.21.15.148:0/3931341324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ad2fc9cfc0 msgr2=0x55ad2fc96de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:30.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.606+0000 7f28f0d2a640 1 --2- 172.21.15.148:0/3931341324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ad2fc9cfc0 0x55ad2fc96de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:30.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.606+0000 7f28f0d2a640 1 -- 172.21.15.148:0/3931341324 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ad2fc8d890 msgr2=0x55ad2fca9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:30.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.606+0000 7f28f0d2a640 1 --2- 172.21.15.148:0/3931341324 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ad2fc8d890 0x55ad2fca9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:30.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.606+0000 7f28f0d2a640 1 -- 172.21.15.148:0/3931341324 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad2fc9cba0 con 0x55ad2fc8e1b0 2024-09-19T07:11:30.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.607+0000 7f28f0d2a640 1 --2- 172.21.15.148:0/3931341324 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ad2fc8e1b0 0x55ad2fc84ce0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f28dc0092a0 tx=0x7f28dc005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eb330c871c40ac8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:30.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.607+0000 7f28d6ffd640 1 -- 172.21.15.148:0/3931341324 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28dc05b070 con 0x55ad2fc8e1b0 2024-09-19T07:11:30.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.607+0000 7f28d6ffd640 1 -- 172.21.15.148:0/3931341324 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28dc048030 con 0x55ad2fc8e1b0 2024-09-19T07:11:30.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.607+0000 7f28d6ffd640 1 -- 172.21.15.148:0/3931341324 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28dc03f040 con 0x55ad2fc8e1b0 2024-09-19T07:11:30.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.607+0000 7f28f5b68740 1 -- 172.21.15.148:0/3931341324 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ad2fc8e1b0 msgr2=0x55ad2fc84ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:30.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.607+0000 7f28f5b68740 1 --2- 172.21.15.148:0/3931341324 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ad2fc8e1b0 0x55ad2fc84ce0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f28dc0092a0 tx=0x7f28dc005fd0 comp rx=0 tx=0).stop 2024-09-19T07:11:30.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.608+0000 7f28f5b68740 1 -- 172.21.15.148:0/3931341324 shutdown_connections 2024-09-19T07:11:30.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.608+0000 7f28f5b68740 1 --2- 172.21.15.148:0/3931341324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ad2fc9cfc0 0x55ad2fc96de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:30.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.608+0000 7f28f5b68740 1 --2- 172.21.15.148:0/3931341324 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ad2fc8e1b0 0x55ad2fc84ce0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:30.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.608+0000 7f28f5b68740 1 --2- 172.21.15.148:0/3931341324 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ad2fc8d890 0x55ad2fca9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:30.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.608+0000 7f28f5b68740 1 -- 172.21.15.148:0/3931341324 >> 172.21.15.148:0/3931341324 conn(0x55ad2fc89f60 msgr2=0x55ad2fc95240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:30.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.608+0000 7f28f5b68740 1 -- 172.21.15.148:0/3931341324 shutdown_connections 2024-09-19T07:11:30.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.608+0000 7f28f5b68740 1 -- 172.21.15.148:0/3931341324 wait complete. 2024-09-19T07:11:30.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.608+0000 7f28f5b68740 1 -- start start 2024-09-19T07:11:30.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.608+0000 7f28f5b68740 1 Processor -- start 2024-09-19T07:11:30.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.608+0000 7f28f5b68740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ad2fc8d890 0x55ad2fcb6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:30.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.608+0000 7f28f5b68740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ad2fc8e1b0 0x55ad2fcb73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:30.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.608+0000 7f28f5b68740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ad2fc9cfc0 0x55ad2fcb0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:30.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.608+0000 7f28f5b68740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55ad2fcae820 con 0x55ad2fc8e1b0 2024-09-19T07:11:30.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.608+0000 7f28f5b68740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ad2fcae150 con 0x55ad2fc9cfc0 2024-09-19T07:11:30.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.608+0000 7f28f5b68740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ad2fcaeef0 con 0x55ad2fc8d890 2024-09-19T07:11:30.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.609+0000 7f28f5b68740 10 client.0 _ll_register_callbacks cb 0x7f28dc032cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:11:30.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.609+0000 7f28f0d2a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ad2fc8e1b0 0x55ad2fcb73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:30.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.609+0000 7f28f0d2a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ad2fc8e1b0 0x55ad2fcb73d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35146/0 (socket says 172.21.15.148:35146) 2024-09-19T07:11:30.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.609+0000 7f28f0d2a640 1 -- 172.21.15.148:0/1481727981 learned_addr learned my addr 172.21.15.148:0/1481727981 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:30.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.609+0000 7f28f152b640 1 --2- 172.21.15.148:0/1481727981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ad2fc8d890 0x55ad2fcb6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:30.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.609+0000 7f28f0d2a640 1 -- 172.21.15.148:0/1481727981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ad2fc8d890 msgr2=0x55ad2fcb6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:30.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.609+0000 7f28f0d2a640 1 --2- 172.21.15.148:0/1481727981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ad2fc8d890 0x55ad2fcb6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:30.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.609+0000 7f28f0d2a640 1 -- 172.21.15.148:0/1481727981 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ad2fc9cfc0 msgr2=0x55ad2fcb0320 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T07:11:30.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.609+0000 7f28f0d2a640 1 --2- 172.21.15.148:0/1481727981 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ad2fc9cfc0 0x55ad2fcb0320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:30.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.609+0000 7f28f0d2a640 1 -- 172.21.15.148:0/1481727981 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad2fcb0ba0 con 0x55ad2fc8e1b0 2024-09-19T07:11:30.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.609+0000 7f28f0d2a640 1 --2- 172.21.15.148:0/1481727981 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ad2fc8e1b0 0x55ad2fcb73d0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f28dc02a450 tx=0x7f28dc004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f84f8c747bfbace server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:30.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.609+0000 7f28d4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:11:30.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.609+0000 7f28d4ff9640 1 -- 172.21.15.148:0/1481727981 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28dc05b070 con 0x55ad2fc8e1b0 2024-09-19T07:11:30.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.609+0000 7f28d4ff9640 1 -- 172.21.15.148:0/1481727981 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f28dc004fd0 con 0x55ad2fc8e1b0 2024-09-19T07:11:30.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.609+0000 7f28f5b68740 1 -- 172.21.15.148:0/1481727981 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28dc048030 con 0x55ad2fc8e1b0 2024-09-19T07:11:30.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.610+0000 7f28d4ff9640 1 -- 172.21.15.148:0/1481727981 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f28dc03f040 con 0x55ad2fc8e1b0 2024-09-19T07:11:30.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.610+0000 7f28f5b68740 10 client.15411 fetch_fsmap learned FSMap version 25 2024-09-19T07:11:30.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.610+0000 7f28f5b68740 1 -- 172.21.15.148:0/1481727981 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ad2fcb54d0 con 0x55ad2fc8e1b0 2024-09-19T07:11:30.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.610+0000 7f28d4ff9640 1 -- 172.21.15.148:0/1481727981 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28dc048030 con 0x55ad2fc8e1b0 2024-09-19T07:11:30.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.610+0000 7f28d4ff9640 1 -- 172.21.15.148:0/1481727981 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f28dc003b20 con 0x55ad2fc8e1b0 2024-09-19T07:11:30.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.610+0000 7f28f5b68740 10 client.15411 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:11:30.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.610+0000 7f28f5b68740 10 client.15411 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T07:11:30.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.610+0000 7f28f5b68740 20 client.15411 populate_metadata read hostname 'smithi148' 2024-09-19T07:11:30.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.610+0000 7f28f5b68740 1 --2- 172.21.15.148:0/1481727981 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x55ad2fd1bf10 0x55ad2fd1ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:30.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.610+0000 7f28f5b68740 4 client.15411 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T07:11:30.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.610+0000 7f28f5b68740 1 -- 172.21.15.148:0/1481727981 --> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] -- command(tid 0: {"prefix": "status"}) -- 0x55ad2fbfbb10 con 0x55ad2fd1bf10 2024-09-19T07:11:30.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.610+0000 7f28f152b640 1 --2- 172.21.15.148:0/1481727981 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x55ad2fd1bf10 0x55ad2fd1ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:30.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.611+0000 7f28f152b640 1 --2- 172.21.15.148:0/1481727981 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x55ad2fd1bf10 0x55ad2fd1ac20 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=efb1e589d1e5bfe5 server_cookie=ed0ad0bf0df5d97e in_seq=0 out_seq=0 2024-09-19T07:11:30.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.611+0000 7f28d4ff9640 10 client.15411 ms_handle_connect on v2:172.21.15.165:6838/3993490234 2024-09-19T07:11:30.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.611+0000 7f28d4ff9640 1 -- 172.21.15.148:0/1481727981 <== mds.1 v2:172.21.15.165:6838/3993490234 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55ad2fbfbb10 con 0x55ad2fd1bf10 2024-09-19T07:11:30.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.611+0000 7f28d4ff9640 10 client.15411 handle_command_reply: tid=0 2024-09-19T07:11:30.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.611+0000 7f28f5b68740 1 client.15411 shutdown 2024-09-19T07:11:30.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.611+0000 7f28f5b68740 1 -- 172.21.15.148:0/1481727981 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ad2fc8e1b0 msgr2=0x55ad2fcb73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:30.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.611+0000 7f28f5b68740 1 --2- 172.21.15.148:0/1481727981 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ad2fc8e1b0 0x55ad2fcb73d0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f28dc02a450 tx=0x7f28dc004040 comp rx=0 tx=0).stop 2024-09-19T07:11:30.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.611+0000 7f28f5b68740 1 -- 172.21.15.148:0/1481727981 shutdown_connections 2024-09-19T07:11:30.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.611+0000 7f28f5b68740 1 --2- 172.21.15.148:0/1481727981 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x55ad2fd1bf10 0x55ad2fd1ac20 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:30.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.611+0000 7f28d4ff9640 0 client.15411 ms_handle_reset on v2:172.21.15.165:6838/3993490234 2024-09-19T07:11:30.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.611+0000 7f28f5b68740 1 --2- 172.21.15.148:0/1481727981 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ad2fc9cfc0 0x55ad2fcb0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:30.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.611+0000 7f28f5b68740 1 --2- 172.21.15.148:0/1481727981 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ad2fc8e1b0 0x55ad2fcb73d0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:30.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.611+0000 7f28f5b68740 1 --2- 172.21.15.148:0/1481727981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ad2fc8d890 0x55ad2fcb6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:30.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.611+0000 7f28f5b68740 1 -- 172.21.15.148:0/1481727981 >> 172.21.15.148:0/1481727981 conn(0x55ad2fc89f60 msgr2=0x55ad2fc95240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:30.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.611+0000 7f28f5b68740 1 -- 172.21.15.148:0/1481727981 shutdown_connections 2024-09-19T07:11:30.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.611+0000 7f28f5b68740 1 -- 172.21.15.148:0/1481727981 wait complete. 2024-09-19T07:11:30.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.612+0000 7f28f5b68740 20 client.15411 trim_cache size 0 max 16384 2024-09-19T07:11:30.617 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:11:30.617 INFO:teuthology.orchestra.run.smithi148.stdout: "cluster_fsid": "eae8a4a8-7654-11ef-bceb-c7b262605968", 2024-09-19T07:11:30.617 INFO:teuthology.orchestra.run.smithi148.stdout: "whoami": 1, 2024-09-19T07:11:30.617 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 24437, 2024-09-19T07:11:30.617 INFO:teuthology.orchestra.run.smithi148.stdout: "want_state": "up:active", 2024-09-19T07:11:30.617 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "up:active", 2024-09-19T07:11:30.617 INFO:teuthology.orchestra.run.smithi148.stdout: "fs_name": "cephfs", 2024-09-19T07:11:30.617 INFO:teuthology.orchestra.run.smithi148.stdout: "rank_uptime": 123.647059774, 2024-09-19T07:11:30.618 INFO:teuthology.orchestra.run.smithi148.stdout: "mdsmap_epoch": 25, 2024-09-19T07:11:30.618 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch": 81, 2024-09-19T07:11:30.618 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch_barrier": 81, 2024-09-19T07:11:30.618 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 140.892222164 2024-09-19T07:11:30.618 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:11:30.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.612+0000 7f28f378f640 1 -- 172.21.15.148:0/884291296 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f28d80a34c0 msgr2=0x7f28d80a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:30.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.612+0000 7f28f378f640 1 --2- 172.21.15.148:0/884291296 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f28d80a34c0 0x7f28d80a5980 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f28e400afd0 tx=0x7f28e4005f90 comp rx=0 tx=0).stop 2024-09-19T07:11:30.619 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.612+0000 7f28f378f640 1 -- 172.21.15.148:0/884291296 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28ec101de0 msgr2=0x7f28ec1983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:30.619 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.612+0000 7f28f378f640 1 --2- 172.21.15.148:0/884291296 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28ec101de0 0x7f28ec1983b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f28e800c890 tx=0x7f28e800cd50 comp rx=0 tx=0).stop 2024-09-19T07:11:30.619 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.612+0000 7f28f378f640 1 -- 172.21.15.148:0/884291296 shutdown_connections 2024-09-19T07:11:30.619 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.612+0000 7f28f378f640 1 --2- 172.21.15.148:0/884291296 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f28d80a34c0 0x7f28d80a5980 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:30.619 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.612+0000 7f28f378f640 1 --2- 172.21.15.148:0/884291296 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f28ec106f10 0x7f28ec19cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:30.619 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.612+0000 7f28f378f640 1 --2- 172.21.15.148:0/884291296 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28ec102790 0x7f28ec1988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:30.619 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.612+0000 7f28f378f640 1 --2- 172.21.15.148:0/884291296 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28ec101de0 0x7f28ec1983b0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:30.619 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.612+0000 7f28f378f640 1 -- 172.21.15.148:0/884291296 >> 172.21.15.148:0/884291296 conn(0x7f28ec0fd8c0 msgr2=0x7f28ec0fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:30.619 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.612+0000 7f28f378f640 1 -- 172.21.15.148:0/884291296 shutdown_connections 2024-09-19T07:11:30.619 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:30.612+0000 7f28f378f640 1 -- 172.21.15.148:0/884291296 wait complete. 2024-09-19T07:11:31.277 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:31 smithi148 ceph-mon[31180]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.9 KiB/s wr, 14 op/s 2024-09-19T07:11:31.304 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T07:11:31.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:31 smithi165 ceph-mon[35326]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.9 KiB/s wr, 14 op/s 2024-09-19T07:11:31.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:31 smithi179 ceph-mon[35716]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.9 KiB/s wr, 14 op/s 2024-09-19T07:11:31.563 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:11:32.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.030+0000 7fc975852640 1 -- 172.21.15.148:0/3324932059 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc970106f20 msgr2=0x7fc97010eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:32.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.030+0000 7fc975852640 1 --2- 172.21.15.148:0/3324932059 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc970106f20 0x7fc97010eaa0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fc968009ca0 tx=0x7fc96802a8c0 comp rx=0 tx=0).stop 2024-09-19T07:11:32.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.030+0000 7fc975852640 1 -- 172.21.15.148:0/3324932059 shutdown_connections 2024-09-19T07:11:32.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.030+0000 7fc975852640 1 --2- 172.21.15.148:0/3324932059 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc970106f20 0x7fc97010eaa0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:32.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.030+0000 7fc975852640 1 --2- 172.21.15.148:0/3324932059 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9701027a0 0x7fc9701067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:32.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.030+0000 7fc975852640 1 --2- 172.21.15.148:0/3324932059 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc970101df0 0x7fc9701021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:32.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.030+0000 7fc975852640 1 -- 172.21.15.148:0/3324932059 >> 172.21.15.148:0/3324932059 conn(0x7fc9700fd8b0 msgr2=0x7fc9700ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:32.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.030+0000 7fc975852640 1 -- 172.21.15.148:0/3324932059 shutdown_connections 2024-09-19T07:11:32.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.030+0000 7fc975852640 1 -- 172.21.15.148:0/3324932059 wait complete. 2024-09-19T07:11:32.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.031+0000 7fc975852640 1 Processor -- start 2024-09-19T07:11:32.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.031+0000 7fc975852640 1 -- start start 2024-09-19T07:11:32.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.031+0000 7fc975852640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc970101df0 0x7fc9701983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:32.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.031+0000 7fc975852640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9701027a0 0x7fc9701988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:32.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.031+0000 7fc975852640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc970106f20 0x7fc97019cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:32.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.031+0000 7fc975852640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc970111f80 con 0x7fc970101df0 2024-09-19T07:11:32.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.031+0000 7fc975852640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc970111e00 con 0x7fc9701027a0 2024-09-19T07:11:32.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.031+0000 7fc975852640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc970112100 con 0x7fc970106f20 2024-09-19T07:11:32.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.031+0000 7fc96effd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc970101df0 0x7fc9701983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:32.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.031+0000 7fc96effd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc970101df0 0x7fc9701983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35164/0 (socket says 172.21.15.148:35164) 2024-09-19T07:11:32.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.031+0000 7fc96effd640 1 -- 172.21.15.148:0/1991179014 learned_addr learned my addr 172.21.15.148:0/1991179014 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:32.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.032+0000 7fc96e7fc640 1 --2- 172.21.15.148:0/1991179014 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9701027a0 0x7fc9701988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:32.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.032+0000 7fc96f7fe640 1 --2- 172.21.15.148:0/1991179014 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc970106f20 0x7fc97019cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:32.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.032+0000 7fc96effd640 1 -- 172.21.15.148:0/1991179014 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc970106f20 msgr2=0x7fc97019cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:32.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.032+0000 7fc96effd640 1 --2- 172.21.15.148:0/1991179014 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc970106f20 0x7fc97019cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:32.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.032+0000 7fc96effd640 1 -- 172.21.15.148:0/1991179014 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9701027a0 msgr2=0x7fc9701988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:32.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.032+0000 7fc96effd640 1 --2- 172.21.15.148:0/1991179014 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9701027a0 0x7fc9701988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:32.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.032+0000 7fc96effd640 1 -- 172.21.15.148:0/1991179014 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc97019d360 con 0x7fc970101df0 2024-09-19T07:11:32.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.032+0000 7fc96effd640 1 --2- 172.21.15.148:0/1991179014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc970101df0 0x7fc9701983b0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fc96000d950 tx=0x7fc96000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:32.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.032+0000 7fc974850640 1 -- 172.21.15.148:0/1991179014 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc960017070 con 0x7fc970101df0 2024-09-19T07:11:32.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.032+0000 7fc974850640 1 -- 172.21.15.148:0/1991179014 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc960009c30 con 0x7fc970101df0 2024-09-19T07:11:32.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.032+0000 7fc975852640 1 -- 172.21.15.148:0/1991179014 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc97019d650 con 0x7fc970101df0 2024-09-19T07:11:32.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.032+0000 7fc974850640 1 -- 172.21.15.148:0/1991179014 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96000f6b0 con 0x7fc970101df0 2024-09-19T07:11:32.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.032+0000 7fc975852640 1 -- 172.21.15.148:0/1991179014 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9701a4f30 con 0x7fc970101df0 2024-09-19T07:11:32.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.035+0000 7fc974850640 1 -- 172.21.15.148:0/1991179014 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7fc9600109d0 con 0x7fc970101df0 2024-09-19T07:11:32.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.035+0000 7fc977c2b740 1 Processor -- start 2024-09-19T07:11:32.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.035+0000 7fc977c2b740 1 -- start start 2024-09-19T07:11:32.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.035+0000 7fc977c2b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ed34d4d9d0 0x55ed34d4ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:32.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.035+0000 7fc977c2b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed34d4e2f0 0x55ed34d58670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:32.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.035+0000 7fc977c2b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed34d58bb0 0x55ed34d5afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:32.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.035+0000 7fc977c2b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55ed34cb4090 con 0x55ed34d58bb0 2024-09-19T07:11:32.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.035+0000 7fc977c2b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ed34c5ba70 con 0x55ed34d4e2f0 2024-09-19T07:11:32.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.035+0000 7fc977c2b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ed34cb0050 con 0x55ed34d4d9d0 2024-09-19T07:11:32.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.035+0000 7fc96e7fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed34d58bb0 0x55ed34d5afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:32.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.035+0000 7fc974850640 1 --2- 172.21.15.148:0/1991179014 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc9580a3440 0x7fc9580a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:32.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.035+0000 7fc96e7fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed34d58bb0 0x55ed34d5afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35180/0 (socket says 172.21.15.148:35180) 2024-09-19T07:11:32.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.035+0000 7fc96f7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ed34d4d9d0 0x55ed34d4ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:32.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.035+0000 7fc96e7fc640 1 -- 172.21.15.148:0/3613736068 learned_addr learned my addr 172.21.15.148:0/3613736068 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:32.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.036+0000 7fc96effd640 1 --2- 172.21.15.148:0/3613736068 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed34d4e2f0 0x55ed34d58670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:32.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.036+0000 7fc96f7fe640 1 --2- 172.21.15.148:0/1991179014 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc9580a3440 0x7fc9580a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:32.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.036+0000 7fc96e7fc640 1 -- 172.21.15.148:0/3613736068 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ed34d4d9d0 msgr2=0x55ed34d4ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:32.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.036+0000 7fc96e7fc640 1 --2- 172.21.15.148:0/3613736068 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ed34d4d9d0 0x55ed34d4ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:32.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.036+0000 7fc96e7fc640 1 -- 172.21.15.148:0/3613736068 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed34d4e2f0 msgr2=0x55ed34d58670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:32.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.036+0000 7fc96e7fc640 1 --2- 172.21.15.148:0/3613736068 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed34d4e2f0 0x55ed34d58670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:32.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.036+0000 7fc96e7fc640 1 -- 172.21.15.148:0/3613736068 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed34c68130 con 0x55ed34d58bb0 2024-09-19T07:11:32.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.036+0000 7fc974850640 1 -- 172.21.15.148:0/1991179014 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fc9600cfb40 con 0x7fc970101df0 2024-09-19T07:11:32.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.036+0000 7fc96e7fc640 1 --2- 172.21.15.148:0/3613736068 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed34d58bb0 0x55ed34d5afa0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc96400ab60 tx=0x7fc96400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6feee384197c0b37 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:32.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.036+0000 7fc96f7fe640 1 --2- 172.21.15.148:0/1991179014 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc9580a3440 0x7fc9580a5900 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc968009430 tx=0x7fc96802a8c0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:32.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.036+0000 7fc955ffb640 1 -- 172.21.15.148:0/3613736068 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96401d070 con 0x55ed34d58bb0 2024-09-19T07:11:32.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.036+0000 7fc955ffb640 1 -- 172.21.15.148:0/3613736068 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc964018b20 con 0x55ed34d58bb0 2024-09-19T07:11:32.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.036+0000 7fc955ffb640 1 -- 172.21.15.148:0/3613736068 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc964010b70 con 0x55ed34d58bb0 2024-09-19T07:11:32.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.037+0000 7fc977c2b740 1 -- 172.21.15.148:0/3613736068 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed34d58bb0 msgr2=0x55ed34d5afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:32.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.037+0000 7fc977c2b740 1 --2- 172.21.15.148:0/3613736068 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed34d58bb0 0x55ed34d5afa0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc96400ab60 tx=0x7fc96400f790 comp rx=0 tx=0).stop 2024-09-19T07:11:32.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.037+0000 7fc977c2b740 1 -- 172.21.15.148:0/3613736068 shutdown_connections 2024-09-19T07:11:32.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.037+0000 7fc977c2b740 1 --2- 172.21.15.148:0/3613736068 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed34d58bb0 0x55ed34d5afa0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:32.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.037+0000 7fc977c2b740 1 --2- 172.21.15.148:0/3613736068 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed34d4e2f0 0x55ed34d58670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:32.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.037+0000 7fc977c2b740 1 --2- 172.21.15.148:0/3613736068 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ed34d4d9d0 0x55ed34d4ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:32.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.037+0000 7fc977c2b740 1 -- 172.21.15.148:0/3613736068 >> 172.21.15.148:0/3613736068 conn(0x55ed34d49f60 msgr2=0x55ed34d4a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:32.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.037+0000 7fc977c2b740 1 -- 172.21.15.148:0/3613736068 shutdown_connections 2024-09-19T07:11:32.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.037+0000 7fc977c2b740 1 -- 172.21.15.148:0/3613736068 wait complete. 2024-09-19T07:11:32.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.038+0000 7fc977c2b740 1 -- start start 2024-09-19T07:11:32.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.038+0000 7fc977c2b740 1 Processor -- start 2024-09-19T07:11:32.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.038+0000 7fc977c2b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ed34d4d9d0 0x55ed34d58390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:32.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.038+0000 7fc977c2b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed34d4e2f0 0x55ed34d556e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:32.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.038+0000 7fc977c2b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed34d58bb0 0x55ed34d55c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:32.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.038+0000 7fc977c2b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55ed34d5b780 con 0x55ed34d4e2f0 2024-09-19T07:11:32.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.038+0000 7fc977c2b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ed34c6ef20 con 0x55ed34d58bb0 2024-09-19T07:11:32.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.038+0000 7fc977c2b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ed34d5b900 con 0x55ed34d4d9d0 2024-09-19T07:11:32.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.038+0000 7fc977c2b740 10 client.0 _ll_register_callbacks cb 0x55ed34c38030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:11:32.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.038+0000 7fc96f7fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed34d58bb0 0x55ed34d55c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:32.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.038+0000 7fc96f7fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed34d58bb0 0x55ed34d55c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:37394/0 (socket says 172.21.15.148:37394) 2024-09-19T07:11:32.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.038+0000 7fc96f7fe640 1 -- 172.21.15.148:0/1502627063 learned_addr learned my addr 172.21.15.148:0/1502627063 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:32.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.038+0000 7fc96e7fc640 1 --2- 172.21.15.148:0/1502627063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed34d4e2f0 0x55ed34d556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:32.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.038+0000 7fc96effd640 1 --2- 172.21.15.148:0/1502627063 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ed34d4d9d0 0x55ed34d58390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:32.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.039+0000 7fc96f7fe640 1 -- 172.21.15.148:0/1502627063 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ed34d4d9d0 msgr2=0x55ed34d58390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:32.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.039+0000 7fc96f7fe640 1 --2- 172.21.15.148:0/1502627063 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ed34d4d9d0 0x55ed34d58390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:32.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.039+0000 7fc96f7fe640 1 -- 172.21.15.148:0/1502627063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed34d4e2f0 msgr2=0x55ed34d556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:32.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.039+0000 7fc96f7fe640 1 --2- 172.21.15.148:0/1502627063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed34d4e2f0 0x55ed34d556e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:32.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.039+0000 7fc96f7fe640 1 -- 172.21.15.148:0/1502627063 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed34a252b0 con 0x55ed34d58bb0 2024-09-19T07:11:32.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.039+0000 7fc96e7fc640 1 --2- 172.21.15.148:0/1502627063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed34d4e2f0 0x55ed34d556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:11:32.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.039+0000 7fc96f7fe640 1 --2- 172.21.15.148:0/1502627063 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed34d58bb0 0x55ed34d55c20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc968035000 tx=0x7fc9680095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce3b2249dfa72b6c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:32.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.039+0000 7fc94effd640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-19T07:11:32.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.039+0000 7fc94effd640 1 -- 172.21.15.148:0/1502627063 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96804e070 con 0x55ed34d58bb0 2024-09-19T07:11:32.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.039+0000 7fc977c2b740 1 -- 172.21.15.148:0/1502627063 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc964018b20 con 0x55ed34d58bb0 2024-09-19T07:11:32.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.039+0000 7fc94effd640 1 -- 172.21.15.148:0/1502627063 <== mon.2 v2:172.21.15.165:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fc96802f610 con 0x55ed34d58bb0 2024-09-19T07:11:32.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.039+0000 7fc94effd640 1 -- 172.21.15.148:0/1502627063 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc96802f810 con 0x55ed34d58bb0 2024-09-19T07:11:32.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.039+0000 7fc977c2b740 10 client.24932 fetch_fsmap learned FSMap version 25 2024-09-19T07:11:32.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.039+0000 7fc977c2b740 1 -- 172.21.15.148:0/1502627063 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ed34d6f7f0 con 0x55ed34d58bb0 2024-09-19T07:11:32.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.040+0000 7fc94effd640 1 -- 172.21.15.148:0/1502627063 <== mon.2 v2:172.21.15.165:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc964018b20 con 0x55ed34d58bb0 2024-09-19T07:11:32.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.040+0000 7fc94effd640 1 -- 172.21.15.148:0/1502627063 <== mon.2 v2:172.21.15.165:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc968049040 con 0x55ed34d58bb0 2024-09-19T07:11:32.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.040+0000 7fc977c2b740 10 client.24932 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:11:32.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.040+0000 7fc977c2b740 10 client.24932 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T07:11:32.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.040+0000 7fc977c2b740 20 client.24932 populate_metadata read hostname 'smithi148' 2024-09-19T07:11:32.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.040+0000 7fc977c2b740 1 --2- 172.21.15.148:0/1502627063 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ed34d71e50 0x55ed34d732c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:32.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.040+0000 7fc977c2b740 4 client.24932 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:11:32.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.040+0000 7fc977c2b740 1 -- 172.21.15.148:0/1502627063 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ed34cc1600 con 0x55ed34d71e50 2024-09-19T07:11:32.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.040+0000 7fc96effd640 1 --2- 172.21.15.148:0/1502627063 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ed34d71e50 0x55ed34d732c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:32.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.041+0000 7fc96effd640 1 --2- 172.21.15.148:0/1502627063 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ed34d71e50 0x55ed34d732c0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bbf1e1331a58a6 server_cookie=ecbb4532c28e9d0f in_seq=0 out_seq=0 2024-09-19T07:11:32.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.041+0000 7fc94effd640 10 client.24932 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:11:32.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.041+0000 7fc94effd640 1 -- 172.21.15.148:0/1502627063 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ed34cc1600 con 0x55ed34d71e50 2024-09-19T07:11:32.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.041+0000 7fc94effd640 10 client.24932 handle_command_reply: tid=0 2024-09-19T07:11:32.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.041+0000 7fc977c2b740 1 client.24932 shutdown 2024-09-19T07:11:32.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.042+0000 7fc977c2b740 1 -- 172.21.15.148:0/1502627063 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed34d58bb0 msgr2=0x55ed34d55c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:32.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.042+0000 7fc977c2b740 1 --2- 172.21.15.148:0/1502627063 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed34d58bb0 0x55ed34d55c20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc968035000 tx=0x7fc9680095c0 comp rx=0 tx=0).stop 2024-09-19T07:11:32.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.042+0000 7fc977c2b740 1 -- 172.21.15.148:0/1502627063 shutdown_connections 2024-09-19T07:11:32.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.042+0000 7fc977c2b740 1 --2- 172.21.15.148:0/1502627063 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ed34d71e50 0x55ed34d732c0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:32.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.042+0000 7fc977c2b740 1 --2- 172.21.15.148:0/1502627063 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed34d58bb0 0x55ed34d55c20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:32.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.042+0000 7fc977c2b740 1 --2- 172.21.15.148:0/1502627063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed34d4e2f0 0x55ed34d556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:32.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.042+0000 7fc977c2b740 1 --2- 172.21.15.148:0/1502627063 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ed34d4d9d0 0x55ed34d58390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:32.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.042+0000 7fc94effd640 0 client.24932 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:11:32.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.042+0000 7fc977c2b740 1 -- 172.21.15.148:0/1502627063 >> 172.21.15.148:0/1502627063 conn(0x55ed34d49f60 msgr2=0x55ed34d4fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:32.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.042+0000 7fc977c2b740 1 -- 172.21.15.148:0/1502627063 shutdown_connections 2024-09-19T07:11:32.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.042+0000 7fc977c2b740 1 -- 172.21.15.148:0/1502627063 wait complete. 2024-09-19T07:11:32.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.042+0000 7fc977c2b740 20 client.24932 trim_cache size 0 max 16384 2024-09-19T07:11:32.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.060+0000 7fc977c2b740 1 Processor -- start 2024-09-19T07:11:32.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.060+0000 7fc977c2b740 1 -- start start 2024-09-19T07:11:32.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.060+0000 7fc977c2b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed34d4d9d0 0x55ed34d732c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:32.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.060+0000 7fc977c2b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ed34d4e2f0 0x55ed34d44ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:32.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.060+0000 7fc977c2b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed34d58bb0 0x55ed34d50c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:32.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.060+0000 7fc977c2b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55ed34d71600 con 0x55ed34d58bb0 2024-09-19T07:11:32.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.060+0000 7fc977c2b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ed34d71cd0 con 0x55ed34d4d9d0 2024-09-19T07:11:32.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.060+0000 7fc977c2b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ed34d723a0 con 0x55ed34d4e2f0 2024-09-19T07:11:32.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.060+0000 7fc96f7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed34d58bb0 0x55ed34d50c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:32.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.060+0000 7fc96f7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed34d58bb0 0x55ed34d50c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35190/0 (socket says 172.21.15.148:35190) 2024-09-19T07:11:32.063 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.060+0000 7fc96f7fe640 1 -- 172.21.15.148:0/4053588388 learned_addr learned my addr 172.21.15.148:0/4053588388 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:32.063 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.060+0000 7fc96effd640 1 --2- 172.21.15.148:0/4053588388 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed34d4d9d0 0x55ed34d732c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:32.063 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.061+0000 7fc96e7fc640 1 --2- 172.21.15.148:0/4053588388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ed34d4e2f0 0x55ed34d44ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:32.063 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.061+0000 7fc96effd640 1 -- 172.21.15.148:0/4053588388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ed34d4e2f0 msgr2=0x55ed34d44ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:32.063 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.061+0000 7fc96effd640 1 --2- 172.21.15.148:0/4053588388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ed34d4e2f0 0x55ed34d44ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:32.063 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.061+0000 7fc96effd640 1 -- 172.21.15.148:0/4053588388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed34d58bb0 msgr2=0x55ed34d50c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:32.063 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.061+0000 7fc96effd640 1 --2- 172.21.15.148:0/4053588388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed34d58bb0 0x55ed34d50c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:32.063 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.061+0000 7fc96effd640 1 -- 172.21.15.148:0/4053588388 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed34d54690 con 0x55ed34d4d9d0 2024-09-19T07:11:32.063 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.061+0000 7fc96f7fe640 1 --2- 172.21.15.148:0/4053588388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed34d58bb0 0x55ed34d50c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:11:32.063 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.061+0000 7fc96effd640 1 --2- 172.21.15.148:0/4053588388 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed34d4d9d0 0x55ed34d732c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc9600cd1e0 tx=0x7fc96006eaf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=360193d0eb19681c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:32.063 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.061+0000 7fc9557fa640 1 -- 172.21.15.148:0/4053588388 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc960020040 con 0x55ed34d4d9d0 2024-09-19T07:11:32.063 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.061+0000 7fc9557fa640 1 -- 172.21.15.148:0/4053588388 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9600a4930 con 0x55ed34d4d9d0 2024-09-19T07:11:32.063 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.061+0000 7fc9557fa640 1 -- 172.21.15.148:0/4053588388 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9600cd6f0 con 0x55ed34d4d9d0 2024-09-19T07:11:32.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.062+0000 7fc977c2b740 1 -- 172.21.15.148:0/4053588388 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed34d4d9d0 msgr2=0x55ed34d732c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:32.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.062+0000 7fc977c2b740 1 --2- 172.21.15.148:0/4053588388 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed34d4d9d0 0x55ed34d732c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc9600cd1e0 tx=0x7fc96006eaf0 comp rx=0 tx=0).stop 2024-09-19T07:11:32.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.062+0000 7fc977c2b740 1 -- 172.21.15.148:0/4053588388 shutdown_connections 2024-09-19T07:11:32.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.062+0000 7fc977c2b740 1 --2- 172.21.15.148:0/4053588388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed34d58bb0 0x55ed34d50c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:32.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.062+0000 7fc977c2b740 1 --2- 172.21.15.148:0/4053588388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ed34d4e2f0 0x55ed34d44ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:32.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.062+0000 7fc977c2b740 1 --2- 172.21.15.148:0/4053588388 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed34d4d9d0 0x55ed34d732c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:32.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.062+0000 7fc977c2b740 1 -- 172.21.15.148:0/4053588388 >> 172.21.15.148:0/4053588388 conn(0x55ed34d49f60 msgr2=0x55ed34d50580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:32.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.062+0000 7fc977c2b740 1 -- 172.21.15.148:0/4053588388 shutdown_connections 2024-09-19T07:11:32.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.062+0000 7fc977c2b740 1 -- 172.21.15.148:0/4053588388 wait complete. 2024-09-19T07:11:32.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.063+0000 7fc977c2b740 1 -- start start 2024-09-19T07:11:32.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.063+0000 7fc977c2b740 1 Processor -- start 2024-09-19T07:11:32.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.063+0000 7fc977c2b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ed34d4d9d0 0x55ed34d7bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:32.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.063+0000 7fc977c2b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed34d4e2f0 0x55ed34d74f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:32.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.063+0000 7fc977c2b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed34d58bb0 0x55ed34d75440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:32.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.063+0000 7fc977c2b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55ed34d73140 con 0x55ed34d4e2f0 2024-09-19T07:11:32.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.063+0000 7fc977c2b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ed34d72a70 con 0x55ed34d58bb0 2024-09-19T07:11:32.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.063+0000 7fc977c2b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ed34d73810 con 0x55ed34d4d9d0 2024-09-19T07:11:32.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.063+0000 7fc96e7fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed34d4e2f0 0x55ed34d74f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:32.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.064+0000 7fc96e7fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed34d4e2f0 0x55ed34d74f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35202/0 (socket says 172.21.15.148:35202) 2024-09-19T07:11:32.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.064+0000 7fc96e7fc640 1 -- 172.21.15.148:0/1918822805 learned_addr learned my addr 172.21.15.148:0/1918822805 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:32.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.064+0000 7fc977c2b740 10 client.0 _ll_register_callbacks cb 0x7fc968003d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:11:32.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.064+0000 7fc96effd640 1 --2- 172.21.15.148:0/1918822805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ed34d4d9d0 0x55ed34d7bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:32.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.064+0000 7fc96f7fe640 1 --2- 172.21.15.148:0/1918822805 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed34d58bb0 0x55ed34d75440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:32.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.064+0000 7fc96e7fc640 1 -- 172.21.15.148:0/1918822805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ed34d4d9d0 msgr2=0x55ed34d7bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:32.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.064+0000 7fc96e7fc640 1 --2- 172.21.15.148:0/1918822805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ed34d4d9d0 0x55ed34d7bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:32.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.064+0000 7fc96e7fc640 1 -- 172.21.15.148:0/1918822805 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed34d58bb0 msgr2=0x55ed34d75440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:32.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.064+0000 7fc96e7fc640 1 --2- 172.21.15.148:0/1918822805 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed34d58bb0 0x55ed34d75440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:32.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.064+0000 7fc96e7fc640 1 -- 172.21.15.148:0/1918822805 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed34d4e120 con 0x55ed34d4e2f0 2024-09-19T07:11:32.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.064+0000 7fc96e7fc640 1 --2- 172.21.15.148:0/1918822805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed34d4e2f0 0x55ed34d74f00 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fc96400ab60 tx=0x7fc964005750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43eb2972f8312082 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:32.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.064+0000 7fc94effd640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:11:32.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.064+0000 7fc94effd640 1 -- 172.21.15.148:0/1918822805 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc964028030 con 0x55ed34d4e2f0 2024-09-19T07:11:32.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.064+0000 7fc94effd640 1 -- 172.21.15.148:0/1918822805 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fc964004660 con 0x55ed34d4e2f0 2024-09-19T07:11:32.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.064+0000 7fc977c2b740 1 -- 172.21.15.148:0/1918822805 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9600a4930 con 0x55ed34d4e2f0 2024-09-19T07:11:32.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.064+0000 7fc94effd640 1 -- 172.21.15.148:0/1918822805 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc96401d040 con 0x55ed34d4e2f0 2024-09-19T07:11:32.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.064+0000 7fc977c2b740 10 client.15429 fetch_fsmap learned FSMap version 25 2024-09-19T07:11:32.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.064+0000 7fc977c2b740 1 -- 172.21.15.148:0/1918822805 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ed34d7a4b0 con 0x55ed34d4e2f0 2024-09-19T07:11:32.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.065+0000 7fc94effd640 1 -- 172.21.15.148:0/1918822805 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9600a4930 con 0x55ed34d4e2f0 2024-09-19T07:11:32.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.065+0000 7fc94effd640 1 -- 172.21.15.148:0/1918822805 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc964023040 con 0x55ed34d4e2f0 2024-09-19T07:11:32.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.065+0000 7fc977c2b740 10 client.15429 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:11:32.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.065+0000 7fc977c2b740 10 client.15429 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T07:11:32.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.065+0000 7fc977c2b740 20 client.15429 populate_metadata read hostname 'smithi148' 2024-09-19T07:11:32.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.065+0000 7fc977c2b740 1 --2- 172.21.15.148:0/1918822805 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ed34de0b40 0x55ed34ddf850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:32.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.065+0000 7fc977c2b740 4 client.15429 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T07:11:32.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.065+0000 7fc977c2b740 1 -- 172.21.15.148:0/1918822805 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "status"}) -- 0x55ed34cbbb10 con 0x55ed34de0b40 2024-09-19T07:11:32.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.065+0000 7fc96effd640 1 --2- 172.21.15.148:0/1918822805 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ed34de0b40 0x55ed34ddf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:32.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.066+0000 7fc94effd640 10 client.15429 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:11:32.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.066+0000 7fc96effd640 1 --2- 172.21.15.148:0/1918822805 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ed34de0b40 0x55ed34ddf850 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f46beb69e0ad593 server_cookie=2b2773cc29a98c88 in_seq=0 out_seq=0 2024-09-19T07:11:32.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.066+0000 7fc94effd640 1 -- 172.21.15.148:0/1918822805 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55ed34cbbb10 con 0x55ed34de0b40 2024-09-19T07:11:32.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.066+0000 7fc94effd640 10 client.15429 handle_command_reply: tid=0 2024-09-19T07:11:32.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.066+0000 7fc977c2b740 1 client.15429 shutdown 2024-09-19T07:11:32.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.066+0000 7fc977c2b740 1 -- 172.21.15.148:0/1918822805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed34d4e2f0 msgr2=0x55ed34d74f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:32.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.066+0000 7fc977c2b740 1 --2- 172.21.15.148:0/1918822805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed34d4e2f0 0x55ed34d74f00 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fc96400ab60 tx=0x7fc964005750 comp rx=0 tx=0).stop 2024-09-19T07:11:32.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.066+0000 7fc977c2b740 1 -- 172.21.15.148:0/1918822805 shutdown_connections 2024-09-19T07:11:32.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.066+0000 7fc977c2b740 1 --2- 172.21.15.148:0/1918822805 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ed34de0b40 0x55ed34ddf850 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:32.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.066+0000 7fc977c2b740 1 --2- 172.21.15.148:0/1918822805 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed34d58bb0 0x55ed34d75440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:32.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.066+0000 7fc977c2b740 1 --2- 172.21.15.148:0/1918822805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed34d4e2f0 0x55ed34d74f00 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:32.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.066+0000 7fc977c2b740 1 --2- 172.21.15.148:0/1918822805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ed34d4d9d0 0x55ed34d7bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:32.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.066+0000 7fc977c2b740 1 -- 172.21.15.148:0/1918822805 >> 172.21.15.148:0/1918822805 conn(0x55ed34d49f60 msgr2=0x55ed34d50d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:32.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.066+0000 7fc94effd640 0 client.15429 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:11:32.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.066+0000 7fc977c2b740 1 -- 172.21.15.148:0/1918822805 shutdown_connections 2024-09-19T07:11:32.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.066+0000 7fc977c2b740 1 -- 172.21.15.148:0/1918822805 wait complete. 2024-09-19T07:11:32.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.066+0000 7fc977c2b740 20 client.15429 trim_cache size 0 max 16384 2024-09-19T07:11:32.072 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:11:32.072 INFO:teuthology.orchestra.run.smithi148.stdout: "cluster_fsid": "eae8a4a8-7654-11ef-bceb-c7b262605968", 2024-09-19T07:11:32.072 INFO:teuthology.orchestra.run.smithi148.stdout: "whoami": 0, 2024-09-19T07:11:32.072 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 24457, 2024-09-19T07:11:32.072 INFO:teuthology.orchestra.run.smithi148.stdout: "want_state": "up:active", 2024-09-19T07:11:32.072 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "up:active", 2024-09-19T07:11:32.072 INFO:teuthology.orchestra.run.smithi148.stdout: "fs_name": "cephfs", 2024-09-19T07:11:32.072 INFO:teuthology.orchestra.run.smithi148.stdout: "rank_uptime": 132.14661007199999, 2024-09-19T07:11:32.072 INFO:teuthology.orchestra.run.smithi148.stdout: "mdsmap_epoch": 25, 2024-09-19T07:11:32.073 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch": 81, 2024-09-19T07:11:32.073 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch_barrier": 81, 2024-09-19T07:11:32.073 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 151.00551142800001 2024-09-19T07:11:32.073 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:11:32.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.067+0000 7fc975852640 1 -- 172.21.15.148:0/1991179014 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc9580a3440 msgr2=0x7fc9580a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:32.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.067+0000 7fc975852640 1 --2- 172.21.15.148:0/1991179014 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc9580a3440 0x7fc9580a5900 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc968009430 tx=0x7fc96802a8c0 comp rx=0 tx=0).stop 2024-09-19T07:11:32.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.067+0000 7fc975852640 1 -- 172.21.15.148:0/1991179014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc970101df0 msgr2=0x7fc9701983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:32.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.067+0000 7fc975852640 1 --2- 172.21.15.148:0/1991179014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc970101df0 0x7fc9701983b0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fc96000d950 tx=0x7fc96000de10 comp rx=0 tx=0).stop 2024-09-19T07:11:32.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.067+0000 7fc975852640 1 -- 172.21.15.148:0/1991179014 shutdown_connections 2024-09-19T07:11:32.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.067+0000 7fc975852640 1 --2- 172.21.15.148:0/1991179014 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc9580a3440 0x7fc9580a5900 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:32.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.067+0000 7fc975852640 1 --2- 172.21.15.148:0/1991179014 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc970106f20 0x7fc97019cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:32.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.067+0000 7fc975852640 1 --2- 172.21.15.148:0/1991179014 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9701027a0 0x7fc9701988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:32.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.067+0000 7fc975852640 1 --2- 172.21.15.148:0/1991179014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc970101df0 0x7fc9701983b0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:32.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.067+0000 7fc975852640 1 -- 172.21.15.148:0/1991179014 >> 172.21.15.148:0/1991179014 conn(0x7fc9700fd8b0 msgr2=0x7fc9700feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:32.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.067+0000 7fc975852640 1 -- 172.21.15.148:0/1991179014 shutdown_connections 2024-09-19T07:11:32.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:32.067+0000 7fc975852640 1 -- 172.21.15.148:0/1991179014 wait complete. 2024-09-19T07:11:32.781 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-09-19T07:11:33.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:33 smithi165 ceph-mon[35326]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-09-19T07:11:33.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:33 smithi179 ceph-mon[35716]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-09-19T07:11:33.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:33 smithi148 ceph-mon[31180]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-09-19T07:11:35.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:35 smithi165 ceph-mon[35326]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-09-19T07:11:35.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:35 smithi179 ceph-mon[35716]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-09-19T07:11:35.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:35 smithi148 ceph-mon[31180]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-09-19T07:11:37.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:37 smithi179 ceph-mon[35716]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.9 KiB/s wr, 12 op/s 2024-09-19T07:11:37.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:37 smithi148 ceph-mon[31180]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.9 KiB/s wr, 12 op/s 2024-09-19T07:11:37.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:37 smithi165 ceph-mon[35326]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.9 KiB/s wr, 12 op/s 2024-09-19T07:11:39.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:39 smithi179 ceph-mon[35716]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-09-19T07:11:39.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:39 smithi148 ceph-mon[31180]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-09-19T07:11:39.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:39 smithi165 ceph-mon[35326]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-09-19T07:11:40.857 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.855+0000 7f5bb8ae6640 1 -- 172.21.15.148:0/1933919379 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bb4106a00 msgr2=0x7f5bb4106de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:40.857 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.855+0000 7f5bb8ae6640 1 --2- 172.21.15.148:0/1933919379 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bb4106a00 0x7f5bb4106de0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4009930 tx=0x7f5ba402a420 comp rx=0 tx=0).stop 2024-09-19T07:11:40.857 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.855+0000 7f5bb8ae6640 1 -- 172.21.15.148:0/1933919379 shutdown_connections 2024-09-19T07:11:40.857 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.855+0000 7f5bb8ae6640 1 --2- 172.21.15.148:0/1933919379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bb4101390 0x7f5bb410d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:40.857 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.855+0000 7f5bb8ae6640 1 --2- 172.21.15.148:0/1933919379 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5bb41009f0 0x7f5bb4100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:40.857 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.855+0000 7f5bb8ae6640 1 --2- 172.21.15.148:0/1933919379 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bb4106a00 0x7f5bb4106de0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:40.857 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.855+0000 7f5bb8ae6640 1 -- 172.21.15.148:0/1933919379 >> 172.21.15.148:0/1933919379 conn(0x7f5bb40fc6b0 msgr2=0x7f5bb40fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:40.857 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.855+0000 7f5bb8ae6640 1 -- 172.21.15.148:0/1933919379 shutdown_connections 2024-09-19T07:11:40.857 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.856+0000 7f5bb8ae6640 1 -- 172.21.15.148:0/1933919379 wait complete. 2024-09-19T07:11:40.859 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.856+0000 7f5bb8ae6640 1 Processor -- start 2024-09-19T07:11:40.859 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.856+0000 7f5bb8ae6640 1 -- start start 2024-09-19T07:11:40.860 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.857+0000 7f5bb8ae6640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5bb41009f0 0x7f5bb410e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:40.860 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.857+0000 7f5bb8ae6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bb4101390 0x7f5bb410e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:40.860 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.857+0000 7f5bb8ae6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bb4106a00 0x7f5bb410edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:40.860 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.857+0000 7f5bb8ae6640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb4111f30 con 0x7f5bb4106a00 2024-09-19T07:11:40.860 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.857+0000 7f5bb8ae6640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb4111db0 con 0x7f5bb41009f0 2024-09-19T07:11:40.860 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.857+0000 7f5bb8ae6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb41120b0 con 0x7f5bb4101390 2024-09-19T07:11:40.860 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.857+0000 7f5bb2d9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bb4106a00 0x7f5bb410edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:40.860 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.857+0000 7f5bb2d9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bb4106a00 0x7f5bb410edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48278/0 (socket says 172.21.15.148:48278) 2024-09-19T07:11:40.860 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.857+0000 7f5bb2d9d640 1 -- 172.21.15.148:0/288694274 learned_addr learned my addr 172.21.15.148:0/288694274 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:40.860 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.857+0000 7f5bb1d9b640 1 --2- 172.21.15.148:0/288694274 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bb4101390 0x7f5bb410e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:40.860 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.857+0000 7f5bb259c640 1 --2- 172.21.15.148:0/288694274 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5bb41009f0 0x7f5bb410e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:40.860 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.857+0000 7f5bb2d9d640 1 -- 172.21.15.148:0/288694274 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bb4101390 msgr2=0x7f5bb410e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:40.860 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.857+0000 7f5bb2d9d640 1 --2- 172.21.15.148:0/288694274 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bb4101390 0x7f5bb410e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:40.861 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.857+0000 7f5bb2d9d640 1 -- 172.21.15.148:0/288694274 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5bb41009f0 msgr2=0x7f5bb410e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:40.861 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.857+0000 7f5bb2d9d640 1 --2- 172.21.15.148:0/288694274 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5bb41009f0 0x7f5bb410e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:40.861 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.857+0000 7f5bb2d9d640 1 -- 172.21.15.148:0/288694274 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bb41a6880 con 0x7f5bb4106a00 2024-09-19T07:11:40.861 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.857+0000 7f5bb2d9d640 1 --2- 172.21.15.148:0/288694274 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bb4106a00 0x7f5bb410edd0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5bac00eaa0 tx=0x7f5bac00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:40.861 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.857+0000 7f5ba37fe640 1 -- 172.21.15.148:0/288694274 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bac00cdb0 con 0x7f5bb4106a00 2024-09-19T07:11:40.861 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.857+0000 7f5ba37fe640 1 -- 172.21.15.148:0/288694274 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5bac005020 con 0x7f5bb4106a00 2024-09-19T07:11:40.861 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.857+0000 7f5bb8ae6640 1 -- 172.21.15.148:0/288694274 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bb41a6b70 con 0x7f5bb4106a00 2024-09-19T07:11:40.861 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.857+0000 7f5ba37fe640 1 -- 172.21.15.148:0/288694274 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bac0116b0 con 0x7f5bb4106a00 2024-09-19T07:11:40.861 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.857+0000 7f5bb8ae6640 1 -- 172.21.15.148:0/288694274 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bb41a70c0 con 0x7f5bb4106a00 2024-09-19T07:11:40.866 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.860+0000 7f5ba37fe640 1 -- 172.21.15.148:0/288694274 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f5bac005560 con 0x7f5bb4106a00 2024-09-19T07:11:40.866 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.860+0000 7f5bbb87f740 1 Processor -- start 2024-09-19T07:11:40.866 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.860+0000 7f5bbb87f740 1 -- start start 2024-09-19T07:11:40.866 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.860+0000 7f5bbb87f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x565449d42af0 0x565449d42ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:40.866 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.860+0000 7f5bbb87f740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565449d43410 0x565449d4d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:40.866 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.861+0000 7f5bbb87f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565449d4dcb0 0x565449d500a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:40.867 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.861+0000 7f5bbb87f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x565449ca72f0 con 0x565449d42af0 2024-09-19T07:11:40.867 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.861+0000 7f5bbb87f740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x565449c4f270 con 0x565449d43410 2024-09-19T07:11:40.867 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.861+0000 7f5bbb87f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x565449ca32b0 con 0x565449d4dcb0 2024-09-19T07:11:40.867 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.861+0000 7f5bb1d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x565449d42af0 0x565449d42ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:40.867 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.861+0000 7f5bb1d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x565449d42af0 0x565449d42ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48284/0 (socket says 172.21.15.148:48284) 2024-09-19T07:11:40.867 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.861+0000 7f5bb1d9b640 1 -- 172.21.15.148:0/4245921194 learned_addr learned my addr 172.21.15.148:0/4245921194 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:40.867 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.861+0000 7f5bb259c640 1 --2- 172.21.15.148:0/4245921194 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565449d43410 0x565449d4d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:40.867 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.861+0000 7f5bb1d9b640 1 --2- 172.21.15.148:0/4245921194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565449d4dcb0 0x565449d500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:40.867 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.861+0000 7f5bb1d9b640 1 -- 172.21.15.148:0/4245921194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565449d4dcb0 msgr2=0x565449d500a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:40.867 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.861+0000 7f5bb1d9b640 1 --2- 172.21.15.148:0/4245921194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565449d4dcb0 0x565449d500a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:40.867 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.861+0000 7f5bb1d9b640 1 -- 172.21.15.148:0/4245921194 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565449d43410 msgr2=0x565449d4d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:40.867 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.861+0000 7f5bb1d9b640 1 --2- 172.21.15.148:0/4245921194 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565449d43410 0x565449d4d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:40.867 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.861+0000 7f5bb1d9b640 1 -- 172.21.15.148:0/4245921194 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565449c4e340 con 0x565449d42af0 2024-09-19T07:11:40.868 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.861+0000 7f5ba37fe640 1 --2- 172.21.15.148:0/288694274 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f5b9c0a3500 0x7f5b9c0a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:40.868 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.861+0000 7f5bb259c640 1 --2- 172.21.15.148:0/288694274 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f5b9c0a3500 0x7f5b9c0a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:40.868 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.861+0000 7f5bb1d9b640 1 --2- 172.21.15.148:0/4245921194 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x565449d42af0 0x565449d42ed0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8012790 tx=0x7f5ba800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17b07786262d3db server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:40.868 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.861+0000 7f5ba37fe640 1 -- 172.21.15.148:0/288694274 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f5bac0d0020 con 0x7f5bb4106a00 2024-09-19T07:11:40.868 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.861+0000 7f5ba0ff9640 1 -- 172.21.15.148:0/4245921194 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba8010770 con 0x565449d42af0 2024-09-19T07:11:40.868 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.862+0000 7f5ba0ff9640 1 -- 172.21.15.148:0/4245921194 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ba8010df0 con 0x565449d42af0 2024-09-19T07:11:40.868 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.862+0000 7f5ba0ff9640 1 -- 172.21.15.148:0/4245921194 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba801fc50 con 0x565449d42af0 2024-09-19T07:11:40.868 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.862+0000 7f5bb259c640 1 --2- 172.21.15.148:0/288694274 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f5b9c0a3500 0x7f5b9c0a59c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4009900 tx=0x7f5ba40058d0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:40.868 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.862+0000 7f5bbb87f740 1 -- 172.21.15.148:0/4245921194 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x565449d42af0 msgr2=0x565449d42ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:40.868 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.862+0000 7f5bbb87f740 1 --2- 172.21.15.148:0/4245921194 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x565449d42af0 0x565449d42ed0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8012790 tx=0x7f5ba800b840 comp rx=0 tx=0).stop 2024-09-19T07:11:40.868 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.862+0000 7f5bbb87f740 1 -- 172.21.15.148:0/4245921194 shutdown_connections 2024-09-19T07:11:40.868 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.862+0000 7f5bbb87f740 1 --2- 172.21.15.148:0/4245921194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565449d4dcb0 0x565449d500a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:40.869 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.862+0000 7f5bbb87f740 1 --2- 172.21.15.148:0/4245921194 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565449d43410 0x565449d4d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:40.869 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.862+0000 7f5bbb87f740 1 --2- 172.21.15.148:0/4245921194 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x565449d42af0 0x565449d42ed0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:40.869 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.862+0000 7f5bbb87f740 1 -- 172.21.15.148:0/4245921194 >> 172.21.15.148:0/4245921194 conn(0x565449d3f060 msgr2=0x565449d3f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:40.869 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.863+0000 7f5bbb87f740 1 -- 172.21.15.148:0/4245921194 shutdown_connections 2024-09-19T07:11:40.869 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.863+0000 7f5bbb87f740 1 -- 172.21.15.148:0/4245921194 wait complete. 2024-09-19T07:11:40.869 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.863+0000 7f5bbb87f740 1 -- start start 2024-09-19T07:11:40.869 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.863+0000 7f5bbb87f740 1 Processor -- start 2024-09-19T07:11:40.869 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.863+0000 7f5bbb87f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x565449d42af0 0x565449d4ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:40.869 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.863+0000 7f5bbb87f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565449d43410 0x565449d4b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:40.869 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.863+0000 7f5bbb87f740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565449d4dcb0 0x565449d4b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:40.869 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.863+0000 7f5bbb87f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x565449d50880 con 0x565449d42af0 2024-09-19T07:11:40.869 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.863+0000 7f5bbb87f740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x565449c30290 con 0x565449d4dcb0 2024-09-19T07:11:40.869 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.863+0000 7f5bbb87f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x565449d50a00 con 0x565449d43410 2024-09-19T07:11:40.869 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.863+0000 7f5bbb87f740 10 client.0 _ll_register_callbacks cb 0x565449c61140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:11:40.870 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.863+0000 7f5bb259c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x565449d42af0 0x565449d4ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:40.870 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.863+0000 7f5bb259c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x565449d42af0 0x565449d4ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48296/0 (socket says 172.21.15.148:48296) 2024-09-19T07:11:40.870 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.863+0000 7f5bb259c640 1 -- 172.21.15.148:0/1540615576 learned_addr learned my addr 172.21.15.148:0/1540615576 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:40.870 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.863+0000 7f5bb2d9d640 1 --2- 172.21.15.148:0/1540615576 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565449d4dcb0 0x565449d4b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:40.870 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.863+0000 7f5bb1d9b640 1 --2- 172.21.15.148:0/1540615576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565449d43410 0x565449d4b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:40.870 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.864+0000 7f5bb259c640 1 -- 172.21.15.148:0/1540615576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565449d43410 msgr2=0x565449d4b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:40.870 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.864+0000 7f5bb259c640 1 --2- 172.21.15.148:0/1540615576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565449d43410 0x565449d4b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:40.870 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.864+0000 7f5bb259c640 1 -- 172.21.15.148:0/1540615576 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565449d4dcb0 msgr2=0x565449d4b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:40.870 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.864+0000 7f5bb259c640 1 --2- 172.21.15.148:0/1540615576 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565449d4dcb0 0x565449d4b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:40.870 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.864+0000 7f5bb259c640 1 -- 172.21.15.148:0/1540615576 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654499ba210 con 0x565449d42af0 2024-09-19T07:11:40.870 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.864+0000 7f5bb259c640 1 --2- 172.21.15.148:0/1540615576 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x565449d42af0 0x565449d4ab60 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4009930 tx=0x7f5ba4009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68c5b8cff6bb8fd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:40.870 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.864+0000 7f5b99ffb640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:11:40.870 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.864+0000 7f5b99ffb640 1 -- 172.21.15.148:0/1540615576 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba404e070 con 0x565449d42af0 2024-09-19T07:11:40.871 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.864+0000 7f5b99ffb640 1 -- 172.21.15.148:0/1540615576 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f5ba4003cc0 con 0x565449d42af0 2024-09-19T07:11:40.871 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.864+0000 7f5bbb87f740 1 -- 172.21.15.148:0/1540615576 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ba8010df0 con 0x565449d42af0 2024-09-19T07:11:40.871 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.864+0000 7f5b99ffb640 1 -- 172.21.15.148:0/1540615576 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5ba405a050 con 0x565449d42af0 2024-09-19T07:11:40.871 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.864+0000 7f5bbb87f740 10 client.15441 fetch_fsmap learned FSMap version 25 2024-09-19T07:11:40.871 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.864+0000 7f5bbb87f740 1 -- 172.21.15.148:0/1540615576 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x565449a86620 con 0x565449d42af0 2024-09-19T07:11:40.871 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.864+0000 7f5b99ffb640 1 -- 172.21.15.148:0/1540615576 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ba8010df0 con 0x565449d42af0 2024-09-19T07:11:40.871 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.865+0000 7f5b99ffb640 1 -- 172.21.15.148:0/1540615576 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5ba403d570 con 0x565449d42af0 2024-09-19T07:11:40.871 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.865+0000 7f5bbb87f740 10 client.15441 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:11:40.871 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.865+0000 7f5bbb87f740 10 client.15441 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:11:40.871 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.865+0000 7f5bbb87f740 20 client.15441 populate_metadata read hostname 'smithi148' 2024-09-19T07:11:40.871 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.865+0000 7f5bbb87f740 1 --2- 172.21.15.148:0/1540615576 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x565449d5dbc0 0x565449d5fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:40.871 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.865+0000 7f5bbb87f740 4 client.15441 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:11:40.871 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.865+0000 7f5bbb87f740 1 -- 172.21.15.148:0/1540615576 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565449cb4a20 con 0x565449d5dbc0 2024-09-19T07:11:40.871 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.865+0000 7f5bb1d9b640 1 --2- 172.21.15.148:0/1540615576 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x565449d5dbc0 0x565449d5fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:40.872 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.865+0000 7f5b99ffb640 10 client.15441 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:11:40.872 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.865+0000 7f5bb1d9b640 1 --2- 172.21.15.148:0/1540615576 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x565449d5dbc0 0x565449d5fff0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=329030a1e691abfe server_cookie=530b11952b33afd9 in_seq=0 out_seq=0 2024-09-19T07:11:40.873 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.866+0000 7f5b99ffb640 1 -- 172.21.15.148:0/1540615576 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x565449cb4a20 con 0x565449d5dbc0 2024-09-19T07:11:40.873 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.866+0000 7f5b99ffb640 10 client.15441 handle_command_reply: tid=0 2024-09-19T07:11:40.873 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.866+0000 7f5bbb87f740 1 client.15441 shutdown 2024-09-19T07:11:40.873 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.866+0000 7f5bbb87f740 1 -- 172.21.15.148:0/1540615576 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x565449d42af0 msgr2=0x565449d4ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:40.873 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.866+0000 7f5bbb87f740 1 --2- 172.21.15.148:0/1540615576 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x565449d42af0 0x565449d4ab60 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4009930 tx=0x7f5ba4009260 comp rx=0 tx=0).stop 2024-09-19T07:11:40.873 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.866+0000 7f5bbb87f740 1 -- 172.21.15.148:0/1540615576 shutdown_connections 2024-09-19T07:11:40.873 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.866+0000 7f5bbb87f740 1 --2- 172.21.15.148:0/1540615576 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x565449d5dbc0 0x565449d5fff0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:40.873 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.866+0000 7f5bbb87f740 1 --2- 172.21.15.148:0/1540615576 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565449d4dcb0 0x565449d4b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:40.873 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.866+0000 7f5bbb87f740 1 --2- 172.21.15.148:0/1540615576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565449d43410 0x565449d4b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:40.873 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.866+0000 7f5b99ffb640 0 client.15441 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:11:40.874 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.866+0000 7f5bbb87f740 1 --2- 172.21.15.148:0/1540615576 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x565449d42af0 0x565449d4ab60 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:40.874 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.866+0000 7f5bbb87f740 1 -- 172.21.15.148:0/1540615576 >> 172.21.15.148:0/1540615576 conn(0x565449d3f060 msgr2=0x565449d44dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:40.874 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.867+0000 7f5bbb87f740 1 -- 172.21.15.148:0/1540615576 shutdown_connections 2024-09-19T07:11:40.874 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.867+0000 7f5bbb87f740 1 -- 172.21.15.148:0/1540615576 wait complete. 2024-09-19T07:11:40.874 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.867+0000 7f5bbb87f740 20 client.15441 trim_cache size 0 max 16384 2024-09-19T07:11:40.886 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.881+0000 7f5bbb87f740 1 Processor -- start 2024-09-19T07:11:40.886 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.881+0000 7f5bbb87f740 1 -- start start 2024-09-19T07:11:40.886 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.881+0000 7f5bbb87f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565449d42af0 0x565449d4b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:40.886 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.881+0000 7f5bbb87f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x565449d43410 0x565449d65900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:40.886 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.881+0000 7f5bbb87f740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565449d4dcb0 0x565449d65e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:40.886 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.881+0000 7f5bbb87f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb41b2320 con 0x565449d43410 2024-09-19T07:11:40.886 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.881+0000 7f5bbb87f740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb41afbf0 con 0x565449d4dcb0 2024-09-19T07:11:40.887 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.881+0000 7f5bbb87f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb41ada20 con 0x565449d42af0 2024-09-19T07:11:40.887 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.881+0000 7f5bb1d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x565449d43410 0x565449d65900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:40.887 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.881+0000 7f5bb1d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x565449d43410 0x565449d65900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48298/0 (socket says 172.21.15.148:48298) 2024-09-19T07:11:40.887 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.881+0000 7f5bb1d9b640 1 -- 172.21.15.148:0/2894994516 learned_addr learned my addr 172.21.15.148:0/2894994516 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:40.887 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.881+0000 7f5bb2d9d640 1 --2- 172.21.15.148:0/2894994516 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565449d4dcb0 0x565449d65e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:40.887 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.881+0000 7f5bb259c640 1 --2- 172.21.15.148:0/2894994516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565449d42af0 0x565449d4b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:40.887 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.881+0000 7f5bb1d9b640 1 -- 172.21.15.148:0/2894994516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565449d42af0 msgr2=0x565449d4b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:40.887 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.881+0000 7f5bb1d9b640 1 --2- 172.21.15.148:0/2894994516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565449d42af0 0x565449d4b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:40.887 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.881+0000 7f5bb1d9b640 1 -- 172.21.15.148:0/2894994516 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565449d4dcb0 msgr2=0x565449d65e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:40.887 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.881+0000 7f5bb1d9b640 1 --2- 172.21.15.148:0/2894994516 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565449d4dcb0 0x565449d65e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:40.887 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.881+0000 7f5bb1d9b640 1 -- 172.21.15.148:0/2894994516 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565449d43240 con 0x565449d43410 2024-09-19T07:11:40.887 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.881+0000 7f5bb259c640 1 --2- 172.21.15.148:0/2894994516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565449d42af0 0x565449d4b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:11:40.887 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.882+0000 7f5bb1d9b640 1 --2- 172.21.15.148:0/2894994516 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x565449d43410 0x565449d65900 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8011010 tx=0x7f5ba8021040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2e85749fbd7d447 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:40.888 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.882+0000 7f5b9bfff640 1 -- 172.21.15.148:0/2894994516 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba802d070 con 0x565449d43410 2024-09-19T07:11:40.888 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.882+0000 7f5b9bfff640 1 -- 172.21.15.148:0/2894994516 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ba801fcf0 con 0x565449d43410 2024-09-19T07:11:40.888 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.882+0000 7f5b9bfff640 1 -- 172.21.15.148:0/2894994516 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba8005310 con 0x565449d43410 2024-09-19T07:11:40.888 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.882+0000 7f5bbb87f740 1 -- 172.21.15.148:0/2894994516 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x565449d43410 msgr2=0x565449d65900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:40.888 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.882+0000 7f5bbb87f740 1 --2- 172.21.15.148:0/2894994516 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x565449d43410 0x565449d65900 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8011010 tx=0x7f5ba8021040 comp rx=0 tx=0).stop 2024-09-19T07:11:40.888 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.882+0000 7f5bbb87f740 1 -- 172.21.15.148:0/2894994516 shutdown_connections 2024-09-19T07:11:40.888 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.882+0000 7f5bbb87f740 1 --2- 172.21.15.148:0/2894994516 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565449d4dcb0 0x565449d65e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:40.888 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.882+0000 7f5bbb87f740 1 --2- 172.21.15.148:0/2894994516 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x565449d43410 0x565449d65900 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:40.888 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.882+0000 7f5bbb87f740 1 --2- 172.21.15.148:0/2894994516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565449d42af0 0x565449d4b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:40.888 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.882+0000 7f5bbb87f740 1 -- 172.21.15.148:0/2894994516 >> 172.21.15.148:0/2894994516 conn(0x565449d3f060 msgr2=0x565449d4cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:40.888 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.882+0000 7f5bbb87f740 1 -- 172.21.15.148:0/2894994516 shutdown_connections 2024-09-19T07:11:40.888 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.882+0000 7f5bbb87f740 1 -- 172.21.15.148:0/2894994516 wait complete. 2024-09-19T07:11:40.888 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.883+0000 7f5bbb87f740 1 -- start start 2024-09-19T07:11:40.889 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.883+0000 7f5bbb87f740 1 Processor -- start 2024-09-19T07:11:40.889 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.883+0000 7f5bbb87f740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565449d42af0 0x565449d56150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:40.889 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.883+0000 7f5bbb87f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565449d43410 0x565449d514c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:40.889 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.883+0000 7f5bbb87f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x565449d4dcb0 0x565449d51a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:40.889 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.883+0000 7f5bbb87f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb41ae0b0 con 0x565449d4dcb0 2024-09-19T07:11:40.889 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.883+0000 7f5bbb87f740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb41af520 con 0x565449d42af0 2024-09-19T07:11:40.889 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.883+0000 7f5bbb87f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb41ae780 con 0x565449d43410 2024-09-19T07:11:40.889 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.883+0000 7f5bbb87f740 10 client.0 _ll_register_callbacks cb 0x7f5ba4005df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:11:40.889 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.883+0000 7f5bb2d9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x565449d4dcb0 0x565449d51a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:40.889 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.883+0000 7f5bb2d9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x565449d4dcb0 0x565449d51a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48300/0 (socket says 172.21.15.148:48300) 2024-09-19T07:11:40.889 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.883+0000 7f5bb2d9d640 1 -- 172.21.15.148:0/3609822184 learned_addr learned my addr 172.21.15.148:0/3609822184 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:40.889 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.883+0000 7f5bb1d9b640 1 --2- 172.21.15.148:0/3609822184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565449d43410 0x565449d514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:40.890 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.883+0000 7f5bb259c640 1 --2- 172.21.15.148:0/3609822184 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565449d42af0 0x565449d56150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:40.890 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.883+0000 7f5bb2d9d640 1 -- 172.21.15.148:0/3609822184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565449d43410 msgr2=0x565449d514c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:40.890 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.883+0000 7f5bb2d9d640 1 --2- 172.21.15.148:0/3609822184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565449d43410 0x565449d514c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:40.890 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.883+0000 7f5bb2d9d640 1 -- 172.21.15.148:0/3609822184 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565449d42af0 msgr2=0x565449d56150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:40.890 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.883+0000 7f5bb2d9d640 1 --2- 172.21.15.148:0/3609822184 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565449d42af0 0x565449d56150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:40.890 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.883+0000 7f5bb2d9d640 1 -- 172.21.15.148:0/3609822184 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565449d51f70 con 0x565449d4dcb0 2024-09-19T07:11:40.890 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.883+0000 7f5bb1d9b640 1 --2- 172.21.15.148:0/3609822184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565449d43410 0x565449d514c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:11:40.890 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.884+0000 7f5bb2d9d640 1 --2- 172.21.15.148:0/3609822184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x565449d4dcb0 0x565449d51a00 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5bac09bf10 tx=0x7f5bac09c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24ae23a336935f0a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:40.890 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.884+0000 7f5b99ffb640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:11:40.890 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.884+0000 7f5b99ffb640 1 -- 172.21.15.148:0/3609822184 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bac0b5060 con 0x565449d4dcb0 2024-09-19T07:11:40.890 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.884+0000 7f5b99ffb640 1 -- 172.21.15.148:0/3609822184 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f5bac0bc0b0 con 0x565449d4dcb0 2024-09-19T07:11:40.890 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.884+0000 7f5bbb87f740 1 -- 172.21.15.148:0/3609822184 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ba801fcf0 con 0x565449d4dcb0 2024-09-19T07:11:40.890 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.884+0000 7f5b99ffb640 1 -- 172.21.15.148:0/3609822184 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5bac01f070 con 0x565449d4dcb0 2024-09-19T07:11:40.891 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.884+0000 7f5bbb87f740 10 client.15447 fetch_fsmap learned FSMap version 25 2024-09-19T07:11:40.891 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.884+0000 7f5bbb87f740 1 -- 172.21.15.148:0/3609822184 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x565449dc8610 con 0x565449d4dcb0 2024-09-19T07:11:40.891 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.884+0000 7f5b99ffb640 1 -- 172.21.15.148:0/3609822184 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ba801fcf0 con 0x565449d4dcb0 2024-09-19T07:11:40.891 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.884+0000 7f5b99ffb640 1 -- 172.21.15.148:0/3609822184 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5bac00f040 con 0x565449d4dcb0 2024-09-19T07:11:40.891 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.884+0000 7f5bbb87f740 10 client.15447 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:11:40.891 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.884+0000 7f5bbb87f740 10 client.15447 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:11:40.891 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.884+0000 7f5bbb87f740 20 client.15447 populate_metadata read hostname 'smithi148' 2024-09-19T07:11:40.891 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.884+0000 7f5bbb87f740 1 --2- 172.21.15.148:0/3609822184 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x565449dc8e50 0x565449dcb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:40.891 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.884+0000 7f5bbb87f740 4 client.15447 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:11:40.891 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.884+0000 7f5bbb87f740 1 -- 172.21.15.148:0/3609822184 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x565449caed70 con 0x565449dc8e50 2024-09-19T07:11:40.891 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.884+0000 7f5bb259c640 1 --2- 172.21.15.148:0/3609822184 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x565449dc8e50 0x565449dcb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:40.891 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.885+0000 7f5b99ffb640 10 client.15447 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:11:40.891 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.885+0000 7f5bb259c640 1 --2- 172.21.15.148:0/3609822184 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x565449dc8e50 0x565449dcb270 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=856b3b31f04c06da server_cookie=85e3d423496b8fff in_seq=0 out_seq=0 2024-09-19T07:11:40.893 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.892+0000 7f5b99ffb640 1 -- 172.21.15.148:0/3609822184 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x565449caed70 con 0x565449dc8e50 2024-09-19T07:11:40.894 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.892+0000 7f5b99ffb640 10 client.15447 handle_command_reply: tid=0 2024-09-19T07:11:40.894 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.892+0000 7f5bbb87f740 1 client.15447 shutdown 2024-09-19T07:11:40.894 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.892+0000 7f5bbb87f740 1 -- 172.21.15.148:0/3609822184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x565449d4dcb0 msgr2=0x565449d51a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:40.894 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.892+0000 7f5bbb87f740 1 --2- 172.21.15.148:0/3609822184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x565449d4dcb0 0x565449d51a00 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5bac09bf10 tx=0x7f5bac09c340 comp rx=0 tx=0).stop 2024-09-19T07:11:40.894 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.892+0000 7f5bbb87f740 1 -- 172.21.15.148:0/3609822184 shutdown_connections 2024-09-19T07:11:40.894 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.892+0000 7f5bbb87f740 1 --2- 172.21.15.148:0/3609822184 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x565449dc8e50 0x565449dcb270 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:40.894 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.892+0000 7f5bbb87f740 1 --2- 172.21.15.148:0/3609822184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x565449d4dcb0 0x565449d51a00 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:40.894 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.892+0000 7f5b99ffb640 0 client.15447 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:11:40.894 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.892+0000 7f5bbb87f740 1 --2- 172.21.15.148:0/3609822184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565449d43410 0x565449d514c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:40.894 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.893+0000 7f5bbb87f740 1 --2- 172.21.15.148:0/3609822184 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565449d42af0 0x565449d56150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:40.894 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.893+0000 7f5bbb87f740 1 -- 172.21.15.148:0/3609822184 >> 172.21.15.148:0/3609822184 conn(0x565449d3f060 msgr2=0x565449d48fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:40.894 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.893+0000 7f5bbb87f740 1 -- 172.21.15.148:0/3609822184 shutdown_connections 2024-09-19T07:11:40.894 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.893+0000 7f5bbb87f740 1 -- 172.21.15.148:0/3609822184 wait complete. 2024-09-19T07:11:40.895 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.893+0000 7f5bbb87f740 20 client.15447 trim_cache size 0 max 16384 2024-09-19T07:11:40.895 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:11:40.895 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:11:40.895 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:11:40.895 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:11:40.896 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.893+0000 7f5bb8ae6640 1 -- 172.21.15.148:0/288694274 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f5b9c0a3500 msgr2=0x7f5b9c0a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:40.896 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.893+0000 7f5bb8ae6640 1 --2- 172.21.15.148:0/288694274 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f5b9c0a3500 0x7f5b9c0a59c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4009900 tx=0x7f5ba40058d0 comp rx=0 tx=0).stop 2024-09-19T07:11:40.896 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.893+0000 7f5bb8ae6640 1 -- 172.21.15.148:0/288694274 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bb4106a00 msgr2=0x7f5bb410edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:40.896 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.893+0000 7f5bb8ae6640 1 --2- 172.21.15.148:0/288694274 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bb4106a00 0x7f5bb410edd0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5bac00eaa0 tx=0x7f5bac00ef60 comp rx=0 tx=0).stop 2024-09-19T07:11:40.896 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.893+0000 7f5bb8ae6640 1 -- 172.21.15.148:0/288694274 shutdown_connections 2024-09-19T07:11:40.896 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.893+0000 7f5bb8ae6640 1 --2- 172.21.15.148:0/288694274 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f5b9c0a3500 0x7f5b9c0a59c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:40.896 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.893+0000 7f5bb8ae6640 1 --2- 172.21.15.148:0/288694274 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bb4106a00 0x7f5bb410edd0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:40.897 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.893+0000 7f5bb8ae6640 1 --2- 172.21.15.148:0/288694274 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bb4101390 0x7f5bb410e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:40.897 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.893+0000 7f5bb8ae6640 1 --2- 172.21.15.148:0/288694274 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5bb41009f0 0x7f5bb410e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:40.897 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.893+0000 7f5bb8ae6640 1 -- 172.21.15.148:0/288694274 >> 172.21.15.148:0/288694274 conn(0x7f5bb40fc6b0 msgr2=0x7f5bb40fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:40.897 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.893+0000 7f5bb8ae6640 1 -- 172.21.15.148:0/288694274 shutdown_connections 2024-09-19T07:11:40.897 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:40.893+0000 7f5bb8ae6640 1 -- 172.21.15.148:0/288694274 wait complete. 2024-09-19T07:11:41.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:41 smithi179 ceph-mon[35716]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.9 KiB/s wr, 12 op/s 2024-09-19T07:11:41.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:41 smithi148 ceph-mon[31180]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.9 KiB/s wr, 12 op/s 2024-09-19T07:11:41.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:41 smithi165 ceph-mon[35326]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.9 KiB/s wr, 12 op/s 2024-09-19T07:11:43.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:43 smithi179 ceph-mon[35716]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:11:43.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:43 smithi148 ceph-mon[31180]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:11:43.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:43 smithi165 ceph-mon[35326]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:11:45.311 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T07:11:45.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:45 smithi179 ceph-mon[35716]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:11:45.578 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:11:45.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:45 smithi148 ceph-mon[31180]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:11:45.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:45 smithi165 ceph-mon[35326]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:11:46.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.090+0000 7fd2adde5640 1 -- 172.21.15.148:0/1247107189 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2a8106f10 msgr2=0x7fd2a810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:46.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.090+0000 7fd2adde5640 1 --2- 172.21.15.148:0/1247107189 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2a8106f10 0x7fd2a810ea90 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0009ca0 tx=0x7fd2a002a8c0 comp rx=0 tx=0).stop 2024-09-19T07:11:46.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.090+0000 7fd2adde5640 1 -- 172.21.15.148:0/1247107189 shutdown_connections 2024-09-19T07:11:46.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.090+0000 7fd2adde5640 1 --2- 172.21.15.148:0/1247107189 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2a8106f10 0x7fd2a810ea90 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:46.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.090+0000 7fd2adde5640 1 --2- 172.21.15.148:0/1247107189 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2a8102790 0x7fd2a81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:46.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.090+0000 7fd2adde5640 1 --2- 172.21.15.148:0/1247107189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2a8101de0 0x7fd2a81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:46.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.090+0000 7fd2adde5640 1 -- 172.21.15.148:0/1247107189 >> 172.21.15.148:0/1247107189 conn(0x7fd2a80fd8e0 msgr2=0x7fd2a80ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:46.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.090+0000 7fd2adde5640 1 -- 172.21.15.148:0/1247107189 shutdown_connections 2024-09-19T07:11:46.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.090+0000 7fd2adde5640 1 -- 172.21.15.148:0/1247107189 wait complete. 2024-09-19T07:11:46.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.090+0000 7fd2adde5640 1 Processor -- start 2024-09-19T07:11:46.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.091+0000 7fd2adde5640 1 -- start start 2024-09-19T07:11:46.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.091+0000 7fd2adde5640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2a8101de0 0x7fd2a81983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:46.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.091+0000 7fd2adde5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2a8102790 0x7fd2a8198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:46.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.091+0000 7fd2adde5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2a8106f10 0x7fd2a819cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:46.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.091+0000 7fd2adde5640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a8111f90 con 0x7fd2a8102790 2024-09-19T07:11:46.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.091+0000 7fd2adde5640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a8111e10 con 0x7fd2a8101de0 2024-09-19T07:11:46.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.091+0000 7fd2adde5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a8112110 con 0x7fd2a8106f10 2024-09-19T07:11:46.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.091+0000 7fd29ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2a8102790 0x7fd2a8198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:46.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.091+0000 7fd29ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2a8102790 0x7fd2a8198910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48488/0 (socket says 172.21.15.148:48488) 2024-09-19T07:11:46.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.091+0000 7fd29ffff640 1 -- 172.21.15.148:0/3961842244 learned_addr learned my addr 172.21.15.148:0/3961842244 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:46.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.091+0000 7fd2a77fe640 1 --2- 172.21.15.148:0/3961842244 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2a8101de0 0x7fd2a81983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:46.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.091+0000 7fd2a7fff640 1 --2- 172.21.15.148:0/3961842244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2a8106f10 0x7fd2a819cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:46.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.091+0000 7fd29ffff640 1 -- 172.21.15.148:0/3961842244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2a8106f10 msgr2=0x7fd2a819cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:46.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.091+0000 7fd29ffff640 1 --2- 172.21.15.148:0/3961842244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2a8106f10 0x7fd2a819cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:46.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.091+0000 7fd29ffff640 1 -- 172.21.15.148:0/3961842244 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2a8101de0 msgr2=0x7fd2a81983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:46.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.091+0000 7fd29ffff640 1 --2- 172.21.15.148:0/3961842244 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2a8101de0 0x7fd2a81983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:46.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.091+0000 7fd29ffff640 1 -- 172.21.15.148:0/3961842244 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2a819d380 con 0x7fd2a8102790 2024-09-19T07:11:46.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.091+0000 7fd2a77fe640 1 --2- 172.21.15.148:0/3961842244 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2a8101de0 0x7fd2a81983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:11:46.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.091+0000 7fd29ffff640 1 --2- 172.21.15.148:0/3961842244 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2a8102790 0x7fd2a8198910 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fd29000b4a0 tx=0x7fd29000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:46.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.091+0000 7fd2a57fa640 1 -- 172.21.15.148:0/3961842244 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd290014070 con 0x7fd2a8102790 2024-09-19T07:11:46.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.092+0000 7fd2a57fa640 1 -- 172.21.15.148:0/3961842244 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd290010af0 con 0x7fd2a8102790 2024-09-19T07:11:46.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.092+0000 7fd2adde5640 1 -- 172.21.15.148:0/3961842244 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2a819d670 con 0x7fd2a8102790 2024-09-19T07:11:46.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.092+0000 7fd2a57fa640 1 -- 172.21.15.148:0/3961842244 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd290017d10 con 0x7fd2a8102790 2024-09-19T07:11:46.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.092+0000 7fd2adde5640 1 -- 172.21.15.148:0/3961842244 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2a81a4f50 con 0x7fd2a8102790 2024-09-19T07:11:46.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.094+0000 7fd2a57fa640 1 -- 172.21.15.148:0/3961842244 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7fd290017070 con 0x7fd2a8102790 2024-09-19T07:11:46.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.094+0000 7fd2b01be740 1 Processor -- start 2024-09-19T07:11:46.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.094+0000 7fd2b01be740 1 -- start start 2024-09-19T07:11:46.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.095+0000 7fd2b01be740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5617551474a0 0x561755147880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:46.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.095+0000 7fd2b01be740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561755147dc0 0x561755152140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:46.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.095+0000 7fd2b01be740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561755152680 0x561755154a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:46.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.095+0000 7fd2b01be740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5617550ad2e0 con 0x5617551474a0 2024-09-19T07:11:46.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.095+0000 7fd2b01be740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x561755054ce0 con 0x561755147dc0 2024-09-19T07:11:46.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.095+0000 7fd2b01be740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5617550a92a0 con 0x561755152680 2024-09-19T07:11:46.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.095+0000 7fd2a7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5617551474a0 0x561755147880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:46.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.095+0000 7fd2a57fa640 1 --2- 172.21.15.148:0/3961842244 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fd2940a3440 0x7fd2940a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:46.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.095+0000 7fd2a7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5617551474a0 0x561755147880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48494/0 (socket says 172.21.15.148:48494) 2024-09-19T07:11:46.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.095+0000 7fd2a7fff640 1 -- 172.21.15.148:0/3736020198 learned_addr learned my addr 172.21.15.148:0/3736020198 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:46.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.095+0000 7fd2a77fe640 1 --2- 172.21.15.148:0/3736020198 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561755147dc0 0x561755152140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:46.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.095+0000 7fd29ffff640 1 --2- 172.21.15.148:0/3736020198 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561755152680 0x561755154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:46.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.095+0000 7fd2a7fff640 1 --2- 172.21.15.148:0/3961842244 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fd2940a3440 0x7fd2940a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:46.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.095+0000 7fd2a57fa640 1 -- 172.21.15.148:0/3961842244 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fd2900cf220 con 0x7fd2a8102790 2024-09-19T07:11:46.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.095+0000 7fd2a77fe640 1 -- 172.21.15.148:0/3736020198 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561755152680 msgr2=0x561755154a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:46.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.095+0000 7fd2a77fe640 1 --2- 172.21.15.148:0/3736020198 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561755152680 0x561755154a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:46.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.095+0000 7fd2a77fe640 1 -- 172.21.15.148:0/3736020198 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5617551474a0 msgr2=0x561755147880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:46.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.095+0000 7fd2a77fe640 1 --2- 172.21.15.148:0/3736020198 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5617551474a0 0x561755147880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:46.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.095+0000 7fd2a77fe640 1 -- 172.21.15.148:0/3736020198 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561755039440 con 0x561755147dc0 2024-09-19T07:11:46.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.095+0000 7fd2a7fff640 1 --2- 172.21.15.148:0/3736020198 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5617551474a0 0x561755147880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:11:46.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.096+0000 7fd2a77fe640 1 --2- 172.21.15.148:0/3736020198 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561755147dc0 0x561755152140 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd298008b80 tx=0x7fd29800e720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e217f0719b1584b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:46.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.096+0000 7fd2a7fff640 1 --2- 172.21.15.148:0/3961842244 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fd2940a3440 0x7fd2940a5900 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0031f80 tx=0x7fd2a002a8c0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:46.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.096+0000 7fd29dffb640 1 -- 172.21.15.148:0/3736020198 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd298014070 con 0x561755147dc0 2024-09-19T07:11:46.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.096+0000 7fd29dffb640 1 -- 172.21.15.148:0/3736020198 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2980047a0 con 0x561755147dc0 2024-09-19T07:11:46.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.096+0000 7fd29dffb640 1 -- 172.21.15.148:0/3736020198 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd298010650 con 0x561755147dc0 2024-09-19T07:11:46.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.096+0000 7fd2b01be740 1 -- 172.21.15.148:0/3736020198 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561755147dc0 msgr2=0x561755152140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:46.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.096+0000 7fd2b01be740 1 --2- 172.21.15.148:0/3736020198 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561755147dc0 0x561755152140 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd298008b80 tx=0x7fd29800e720 comp rx=0 tx=0).stop 2024-09-19T07:11:46.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.097+0000 7fd2b01be740 1 -- 172.21.15.148:0/3736020198 shutdown_connections 2024-09-19T07:11:46.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.097+0000 7fd2b01be740 1 --2- 172.21.15.148:0/3736020198 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561755152680 0x561755154a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:46.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.097+0000 7fd2b01be740 1 --2- 172.21.15.148:0/3736020198 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561755147dc0 0x561755152140 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:46.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.097+0000 7fd2b01be740 1 --2- 172.21.15.148:0/3736020198 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5617551474a0 0x561755147880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:46.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.097+0000 7fd2b01be740 1 -- 172.21.15.148:0/3736020198 >> 172.21.15.148:0/3736020198 conn(0x561755143a30 msgr2=0x561755143e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:46.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.097+0000 7fd2b01be740 1 -- 172.21.15.148:0/3736020198 shutdown_connections 2024-09-19T07:11:46.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.097+0000 7fd2b01be740 1 -- 172.21.15.148:0/3736020198 wait complete. 2024-09-19T07:11:46.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.097+0000 7fd2b01be740 1 -- start start 2024-09-19T07:11:46.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.097+0000 7fd2b01be740 1 Processor -- start 2024-09-19T07:11:46.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.098+0000 7fd2b01be740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617551474a0 0x561755151f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:46.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.098+0000 7fd2b01be740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561755147dc0 0x56175514f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:46.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.098+0000 7fd2b01be740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561755152680 0x56175514f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:46.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.098+0000 7fd2b01be740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x561755155250 con 0x561755152680 2024-09-19T07:11:46.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.098+0000 7fd2b01be740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x561755068050 con 0x561755147dc0 2024-09-19T07:11:46.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.098+0000 7fd2b01be740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5617551553d0 con 0x5617551474a0 2024-09-19T07:11:46.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.098+0000 7fd2b01be740 10 client.0 _ll_register_callbacks cb 0x5617550a8160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:11:46.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.098+0000 7fd2a7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561755152680 0x56175514f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:46.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.098+0000 7fd2a7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561755152680 0x56175514f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48502/0 (socket says 172.21.15.148:48502) 2024-09-19T07:11:46.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.098+0000 7fd2a7fff640 1 -- 172.21.15.148:0/745728049 learned_addr learned my addr 172.21.15.148:0/745728049 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:46.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.098+0000 7fd29ffff640 1 --2- 172.21.15.148:0/745728049 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561755147dc0 0x56175514f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:46.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.098+0000 7fd2a77fe640 1 --2- 172.21.15.148:0/745728049 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617551474a0 0x561755151f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:46.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.098+0000 7fd2a7fff640 1 -- 172.21.15.148:0/745728049 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617551474a0 msgr2=0x561755151f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:46.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.098+0000 7fd2a7fff640 1 --2- 172.21.15.148:0/745728049 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617551474a0 0x561755151f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:46.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.098+0000 7fd2a7fff640 1 -- 172.21.15.148:0/745728049 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561755147dc0 msgr2=0x56175514f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:46.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.098+0000 7fd2a7fff640 1 --2- 172.21.15.148:0/745728049 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561755147dc0 0x56175514f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:46.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.098+0000 7fd2a7fff640 1 -- 172.21.15.148:0/745728049 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561754e1e3c0 con 0x561755152680 2024-09-19T07:11:46.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.098+0000 7fd2a77fe640 1 --2- 172.21.15.148:0/745728049 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617551474a0 0x561755151f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:11:46.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.098+0000 7fd2a7fff640 1 --2- 172.21.15.148:0/745728049 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561755152680 0x56175514f740 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0006010 tx=0x7fd2a00095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=398171b3dc9ab851 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:46.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.098+0000 7fd286ffd640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:11:46.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.098+0000 7fd286ffd640 1 -- 172.21.15.148:0/745728049 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a004e070 con 0x561755152680 2024-09-19T07:11:46.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.099+0000 7fd286ffd640 1 -- 172.21.15.148:0/745728049 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fd2a002f610 con 0x561755152680 2024-09-19T07:11:46.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.099+0000 7fd2b01be740 1 -- 172.21.15.148:0/745728049 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2980047a0 con 0x561755152680 2024-09-19T07:11:46.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.099+0000 7fd286ffd640 1 -- 172.21.15.148:0/745728049 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd2a0004b40 con 0x561755152680 2024-09-19T07:11:46.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.099+0000 7fd2b01be740 10 client.15459 fetch_fsmap learned FSMap version 25 2024-09-19T07:11:46.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.099+0000 7fd2b01be740 1 -- 172.21.15.148:0/745728049 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561755160ba0 con 0x561755152680 2024-09-19T07:11:46.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.099+0000 7fd286ffd640 1 -- 172.21.15.148:0/745728049 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2980047a0 con 0x561755152680 2024-09-19T07:11:46.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.099+0000 7fd286ffd640 1 -- 172.21.15.148:0/745728049 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd2a0049040 con 0x561755152680 2024-09-19T07:11:46.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.099+0000 7fd2b01be740 10 client.15459 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:11:46.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.099+0000 7fd2b01be740 10 client.15459 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:11:46.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.099+0000 7fd2b01be740 20 client.15459 populate_metadata read hostname 'smithi148' 2024-09-19T07:11:46.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.099+0000 7fd2b01be740 1 --2- 172.21.15.148:0/745728049 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561755161fb0 0x561755164420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:46.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.099+0000 7fd2b01be740 4 client.15459 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:11:46.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.099+0000 7fd2b01be740 1 -- 172.21.15.148:0/745728049 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5617550ba850 con 0x561755161fb0 2024-09-19T07:11:46.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.100+0000 7fd2a77fe640 1 --2- 172.21.15.148:0/745728049 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561755161fb0 0x561755164420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:46.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.100+0000 7fd2a77fe640 1 --2- 172.21.15.148:0/745728049 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561755161fb0 0x561755164420 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7aef723510a9e8aa server_cookie=b70ccae77589e65f in_seq=0 out_seq=0 2024-09-19T07:11:46.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.100+0000 7fd286ffd640 10 client.15459 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:11:46.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.101+0000 7fd286ffd640 1 -- 172.21.15.148:0/745728049 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5617550ba850 con 0x561755161fb0 2024-09-19T07:11:46.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.101+0000 7fd286ffd640 10 client.15459 handle_command_reply: tid=0 2024-09-19T07:11:46.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.101+0000 7fd2b01be740 1 client.15459 shutdown 2024-09-19T07:11:46.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.101+0000 7fd2b01be740 1 -- 172.21.15.148:0/745728049 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561755152680 msgr2=0x56175514f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:46.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.101+0000 7fd2b01be740 1 --2- 172.21.15.148:0/745728049 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561755152680 0x56175514f740 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0006010 tx=0x7fd2a00095c0 comp rx=0 tx=0).stop 2024-09-19T07:11:46.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.101+0000 7fd2b01be740 1 -- 172.21.15.148:0/745728049 shutdown_connections 2024-09-19T07:11:46.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.101+0000 7fd2b01be740 1 --2- 172.21.15.148:0/745728049 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561755161fb0 0x561755164420 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:46.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.101+0000 7fd286ffd640 0 client.15459 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:11:46.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.101+0000 7fd2b01be740 1 --2- 172.21.15.148:0/745728049 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561755152680 0x56175514f740 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:46.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.101+0000 7fd2b01be740 1 --2- 172.21.15.148:0/745728049 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561755147dc0 0x56175514f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:46.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.101+0000 7fd2b01be740 1 --2- 172.21.15.148:0/745728049 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617551474a0 0x561755151f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:46.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.101+0000 7fd2b01be740 1 -- 172.21.15.148:0/745728049 >> 172.21.15.148:0/745728049 conn(0x561755143a30 msgr2=0x561755149760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:46.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.101+0000 7fd2b01be740 1 -- 172.21.15.148:0/745728049 shutdown_connections 2024-09-19T07:11:46.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.101+0000 7fd2b01be740 1 -- 172.21.15.148:0/745728049 wait complete. 2024-09-19T07:11:46.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.101+0000 7fd2b01be740 20 client.15459 trim_cache size 0 max 16384 2024-09-19T07:11:46.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.118+0000 7fd2b01be740 1 Processor -- start 2024-09-19T07:11:46.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.118+0000 7fd2b01be740 1 -- start start 2024-09-19T07:11:46.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.118+0000 7fd2b01be740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561755143a30 0x56175515e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:46.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.118+0000 7fd2b01be740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617551474a0 0x56175514f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:46.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.118+0000 7fd2b01be740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561755147dc0 0x56175514a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:46.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.119+0000 7fd2b01be740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a81b0200 con 0x561755147dc0 2024-09-19T07:11:46.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.119+0000 7fd2b01be740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a81adad0 con 0x561755143a30 2024-09-19T07:11:46.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.119+0000 7fd2b01be740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a81ab900 con 0x5617551474a0 2024-09-19T07:11:46.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.119+0000 7fd2a7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561755147dc0 0x56175514a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:46.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.119+0000 7fd2a7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561755147dc0 0x56175514a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48504/0 (socket says 172.21.15.148:48504) 2024-09-19T07:11:46.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.119+0000 7fd2a7fff640 1 -- 172.21.15.148:0/2482585621 learned_addr learned my addr 172.21.15.148:0/2482585621 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:46.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.119+0000 7fd2a77fe640 1 --2- 172.21.15.148:0/2482585621 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561755143a30 0x56175515e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:46.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.119+0000 7fd29ffff640 1 --2- 172.21.15.148:0/2482585621 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617551474a0 0x56175514f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:46.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.119+0000 7fd2a7fff640 1 -- 172.21.15.148:0/2482585621 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617551474a0 msgr2=0x56175514f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:46.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.119+0000 7fd2a7fff640 1 --2- 172.21.15.148:0/2482585621 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617551474a0 0x56175514f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:46.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.119+0000 7fd2a7fff640 1 -- 172.21.15.148:0/2482585621 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561755143a30 msgr2=0x56175515e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:46.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.119+0000 7fd2a7fff640 1 --2- 172.21.15.148:0/2482585621 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561755143a30 0x56175515e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:46.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.119+0000 7fd2a7fff640 1 -- 172.21.15.148:0/2482585621 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561755143860 con 0x561755147dc0 2024-09-19T07:11:46.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.119+0000 7fd2a7fff640 1 --2- 172.21.15.148:0/2482585621 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561755147dc0 0x56175514a7a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fd2a002ade0 tx=0x7fd2a0004990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaca5c9bebe65c11 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:46.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.119+0000 7fd29d7fa640 1 -- 172.21.15.148:0/2482585621 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a004e040 con 0x561755147dc0 2024-09-19T07:11:46.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.119+0000 7fd29d7fa640 1 -- 172.21.15.148:0/2482585621 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2a0036040 con 0x561755147dc0 2024-09-19T07:11:46.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.119+0000 7fd29d7fa640 1 -- 172.21.15.148:0/2482585621 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a002fd30 con 0x561755147dc0 2024-09-19T07:11:46.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.120+0000 7fd2b01be740 1 -- 172.21.15.148:0/2482585621 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561755147dc0 msgr2=0x56175514a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:46.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.120+0000 7fd2b01be740 1 --2- 172.21.15.148:0/2482585621 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561755147dc0 0x56175514a7a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fd2a002ade0 tx=0x7fd2a0004990 comp rx=0 tx=0).stop 2024-09-19T07:11:46.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.120+0000 7fd2b01be740 1 -- 172.21.15.148:0/2482585621 shutdown_connections 2024-09-19T07:11:46.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.120+0000 7fd2b01be740 1 --2- 172.21.15.148:0/2482585621 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561755147dc0 0x56175514a7a0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:46.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.120+0000 7fd2b01be740 1 --2- 172.21.15.148:0/2482585621 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617551474a0 0x56175514f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:46.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.120+0000 7fd2b01be740 1 --2- 172.21.15.148:0/2482585621 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561755143a30 0x56175515e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:46.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.120+0000 7fd2b01be740 1 -- 172.21.15.148:0/2482585621 >> 172.21.15.148:0/2482585621 conn(0x56175514f8a0 msgr2=0x56175514a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:46.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.120+0000 7fd2b01be740 1 -- 172.21.15.148:0/2482585621 shutdown_connections 2024-09-19T07:11:46.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.120+0000 7fd2b01be740 1 -- 172.21.15.148:0/2482585621 wait complete. 2024-09-19T07:11:46.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.121+0000 7fd2b01be740 1 -- start start 2024-09-19T07:11:46.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.121+0000 7fd2b01be740 1 Processor -- start 2024-09-19T07:11:46.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.121+0000 7fd2b01be740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561755143a30 0x56175515a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:46.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.121+0000 7fd2b01be740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617551474a0 0x56175515ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:46.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.121+0000 7fd2b01be740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561755147dc0 0x5617551c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:46.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.121+0000 7fd2b01be740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a81abf90 con 0x561755143a30 2024-09-19T07:11:46.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.121+0000 7fd2b01be740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a81ad400 con 0x561755147dc0 2024-09-19T07:11:46.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.121+0000 7fd2b01be740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a81ac660 con 0x5617551474a0 2024-09-19T07:11:46.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.121+0000 7fd2b01be740 10 client.0 _ll_register_callbacks cb 0x7fd2a0031bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:11:46.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.121+0000 7fd2a77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561755143a30 0x56175515a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:46.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.122+0000 7fd2a77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561755143a30 0x56175515a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48506/0 (socket says 172.21.15.148:48506) 2024-09-19T07:11:46.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.122+0000 7fd2a77fe640 1 -- 172.21.15.148:0/1644211589 learned_addr learned my addr 172.21.15.148:0/1644211589 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:46.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.122+0000 7fd2a7fff640 1 --2- 172.21.15.148:0/1644211589 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561755147dc0 0x5617551c5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:46.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.122+0000 7fd29ffff640 1 --2- 172.21.15.148:0/1644211589 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617551474a0 0x56175515ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:46.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.122+0000 7fd2a7fff640 1 -- 172.21.15.148:0/1644211589 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617551474a0 msgr2=0x56175515ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:46.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.122+0000 7fd2a7fff640 1 --2- 172.21.15.148:0/1644211589 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617551474a0 0x56175515ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:46.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.122+0000 7fd2a7fff640 1 -- 172.21.15.148:0/1644211589 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561755143a30 msgr2=0x56175515a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:46.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.122+0000 7fd2a7fff640 1 --2- 172.21.15.148:0/1644211589 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561755143a30 0x56175515a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:46.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.122+0000 7fd2a7fff640 1 -- 172.21.15.148:0/1644211589 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617551446c0 con 0x561755147dc0 2024-09-19T07:11:46.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.122+0000 7fd2a77fe640 1 --2- 172.21.15.148:0/1644211589 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561755143a30 0x56175515a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:11:46.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.122+0000 7fd2a7fff640 1 --2- 172.21.15.148:0/1644211589 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561755147dc0 0x5617551c5fc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd2a00308a0 tx=0x7fd2a002f840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2bbc3b51f6e623 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:46.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.122+0000 7fd286ffd640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-19T07:11:46.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.122+0000 7fd286ffd640 1 -- 172.21.15.148:0/1644211589 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a004e040 con 0x561755147dc0 2024-09-19T07:11:46.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.122+0000 7fd286ffd640 1 -- 172.21.15.148:0/1644211589 <== mon.2 v2:172.21.15.165:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fd2a002fc40 con 0x561755147dc0 2024-09-19T07:11:46.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.122+0000 7fd2b01be740 1 -- 172.21.15.148:0/1644211589 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2a0036040 con 0x561755147dc0 2024-09-19T07:11:46.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.123+0000 7fd286ffd640 1 -- 172.21.15.148:0/1644211589 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd2a00047e0 con 0x561755147dc0 2024-09-19T07:11:46.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.123+0000 7fd2b01be740 10 client.24968 fetch_fsmap learned FSMap version 25 2024-09-19T07:11:46.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.123+0000 7fd2b01be740 1 -- 172.21.15.148:0/1644211589 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5617551d17a0 con 0x561755147dc0 2024-09-19T07:11:46.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.123+0000 7fd286ffd640 1 -- 172.21.15.148:0/1644211589 <== mon.2 v2:172.21.15.165:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2a0036040 con 0x561755147dc0 2024-09-19T07:11:46.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.123+0000 7fd286ffd640 1 -- 172.21.15.148:0/1644211589 <== mon.2 v2:172.21.15.165:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd2a006d050 con 0x561755147dc0 2024-09-19T07:11:46.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.123+0000 7fd2b01be740 10 client.24968 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:11:46.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.123+0000 7fd2b01be740 10 client.24968 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:11:46.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.123+0000 7fd2b01be740 20 client.24968 populate_metadata read hostname 'smithi148' 2024-09-19T07:11:46.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.123+0000 7fd2b01be740 1 --2- 172.21.15.148:0/1644211589 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561755152680 0x5617551d3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:46.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.123+0000 7fd2b01be740 4 client.24968 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T07:11:46.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.123+0000 7fd2b01be740 1 -- 172.21.15.148:0/1644211589 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5617550b4d60 con 0x561755152680 2024-09-19T07:11:46.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.123+0000 7fd2a77fe640 1 --2- 172.21.15.148:0/1644211589 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561755152680 0x5617551d3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:46.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.124+0000 7fd286ffd640 10 client.24968 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:11:46.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.124+0000 7fd2a77fe640 1 --2- 172.21.15.148:0/1644211589 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561755152680 0x5617551d3dc0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8967225efe68e4f2 server_cookie=ead6ff4366c91709 in_seq=0 out_seq=0 2024-09-19T07:11:46.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.124+0000 7fd286ffd640 1 -- 172.21.15.148:0/1644211589 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5617550b4d60 con 0x561755152680 2024-09-19T07:11:46.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.124+0000 7fd286ffd640 10 client.24968 handle_command_reply: tid=0 2024-09-19T07:11:46.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.124+0000 7fd2b01be740 1 client.24968 shutdown 2024-09-19T07:11:46.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.124+0000 7fd2b01be740 1 -- 172.21.15.148:0/1644211589 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561755147dc0 msgr2=0x5617551c5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:46.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.124+0000 7fd2b01be740 1 --2- 172.21.15.148:0/1644211589 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561755147dc0 0x5617551c5fc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd2a00308a0 tx=0x7fd2a002f840 comp rx=0 tx=0).stop 2024-09-19T07:11:46.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.124+0000 7fd2b01be740 1 -- 172.21.15.148:0/1644211589 shutdown_connections 2024-09-19T07:11:46.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.124+0000 7fd2b01be740 1 --2- 172.21.15.148:0/1644211589 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561755152680 0x5617551d3dc0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:46.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.124+0000 7fd2b01be740 1 --2- 172.21.15.148:0/1644211589 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561755147dc0 0x5617551c5fc0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:46.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.124+0000 7fd2b01be740 1 --2- 172.21.15.148:0/1644211589 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617551474a0 0x56175515ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:46.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.124+0000 7fd2b01be740 1 --2- 172.21.15.148:0/1644211589 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561755143a30 0x56175515a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:46.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.124+0000 7fd2b01be740 1 -- 172.21.15.148:0/1644211589 >> 172.21.15.148:0/1644211589 conn(0x56175514f8a0 msgr2=0x561755151280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:46.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.124+0000 7fd286ffd640 0 client.24968 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:11:46.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.124+0000 7fd2b01be740 1 -- 172.21.15.148:0/1644211589 shutdown_connections 2024-09-19T07:11:46.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.124+0000 7fd2b01be740 1 -- 172.21.15.148:0/1644211589 wait complete. 2024-09-19T07:11:46.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.124+0000 7fd2b01be740 20 client.24968 trim_cache size 0 max 16384 2024-09-19T07:11:46.138 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:11:46.138 INFO:teuthology.orchestra.run.smithi148.stdout: "status": "no active scrubs running", 2024-09-19T07:11:46.139 INFO:teuthology.orchestra.run.smithi148.stdout: "scrubs": {} 2024-09-19T07:11:46.139 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:11:46.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.125+0000 7fd2adde5640 1 -- 172.21.15.148:0/3961842244 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fd2940a3440 msgr2=0x7fd2940a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:46.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.125+0000 7fd2adde5640 1 --2- 172.21.15.148:0/3961842244 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fd2940a3440 0x7fd2940a5900 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0031f80 tx=0x7fd2a002a8c0 comp rx=0 tx=0).stop 2024-09-19T07:11:46.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.125+0000 7fd2adde5640 1 -- 172.21.15.148:0/3961842244 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2a8102790 msgr2=0x7fd2a8198910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:46.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.125+0000 7fd2adde5640 1 --2- 172.21.15.148:0/3961842244 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2a8102790 0x7fd2a8198910 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fd29000b4a0 tx=0x7fd29000b960 comp rx=0 tx=0).stop 2024-09-19T07:11:46.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.125+0000 7fd2adde5640 1 -- 172.21.15.148:0/3961842244 shutdown_connections 2024-09-19T07:11:46.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.125+0000 7fd2adde5640 1 --2- 172.21.15.148:0/3961842244 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fd2940a3440 0x7fd2940a5900 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:46.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.125+0000 7fd2adde5640 1 --2- 172.21.15.148:0/3961842244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2a8106f10 0x7fd2a819cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:46.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.125+0000 7fd2adde5640 1 --2- 172.21.15.148:0/3961842244 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2a8102790 0x7fd2a8198910 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:46.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.125+0000 7fd2adde5640 1 --2- 172.21.15.148:0/3961842244 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2a8101de0 0x7fd2a81983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:46.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.125+0000 7fd2adde5640 1 -- 172.21.15.148:0/3961842244 >> 172.21.15.148:0/3961842244 conn(0x7fd2a80fd8e0 msgr2=0x7fd2a80fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:46.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.125+0000 7fd2adde5640 1 -- 172.21.15.148:0/3961842244 shutdown_connections 2024-09-19T07:11:46.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:46.125+0000 7fd2adde5640 1 -- 172.21.15.148:0/3961842244 wait complete. 2024-09-19T07:11:46.812 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T07:11:46.812 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:11:47.066 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:11:47.504 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:47 smithi148 ceph-mon[31180]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-19T07:11:47.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:47 smithi179 ceph-mon[35716]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-19T07:11:47.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.586+0000 7f3b5ed20640 1 -- 172.21.15.148:0/2872683283 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b581036e0 msgr2=0x7f3b58107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:47.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.586+0000 7f3b5ed20640 1 --2- 172.21.15.148:0/2872683283 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b581036e0 0x7f3b58107b90 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f3b44009930 tx=0x7f3b4402a420 comp rx=0 tx=0).stop 2024-09-19T07:11:47.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.586+0000 7f3b5ed20640 1 -- 172.21.15.148:0/2872683283 shutdown_connections 2024-09-19T07:11:47.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.586+0000 7f3b5ed20640 1 --2- 172.21.15.148:0/2872683283 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b581082a0 0x7f3b5810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:47.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.586+0000 7f3b5ed20640 1 --2- 172.21.15.148:0/2872683283 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b581036e0 0x7f3b58107b90 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:47.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.586+0000 7f3b5ed20640 1 --2- 172.21.15.148:0/2872683283 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b58102d30 0x7f3b58103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:47.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.586+0000 7f3b5ed20640 1 -- 172.21.15.148:0/2872683283 >> 172.21.15.148:0/2872683283 conn(0x7f3b580fc7d0 msgr2=0x7f3b580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:47.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.587+0000 7f3b5ed20640 1 -- 172.21.15.148:0/2872683283 shutdown_connections 2024-09-19T07:11:47.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.587+0000 7f3b5ed20640 1 -- 172.21.15.148:0/2872683283 wait complete. 2024-09-19T07:11:47.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.587+0000 7f3b5ed20640 1 Processor -- start 2024-09-19T07:11:47.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.587+0000 7f3b5ed20640 1 -- start start 2024-09-19T07:11:47.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.587+0000 7f3b5ed20640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b58102d30 0x7f3b58198700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:47.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.587+0000 7f3b5ed20640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b581036e0 0x7f3b58198c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:47.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.587+0000 7f3b5ed20640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b581082a0 0x7f3b5819cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:47.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.587+0000 7f3b5ed20640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3b58112140 con 0x7f3b58102d30 2024-09-19T07:11:47.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.587+0000 7f3b5ed20640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3b58111fc0 con 0x7f3b581082a0 2024-09-19T07:11:47.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.587+0000 7f3b5ed20640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3b581122c0 con 0x7f3b581036e0 2024-09-19T07:11:47.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.587+0000 7f3b5cabc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b58102d30 0x7f3b58198700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:47.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.587+0000 7f3b5cabc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b58102d30 0x7f3b58198700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48526/0 (socket says 172.21.15.148:48526) 2024-09-19T07:11:47.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.587+0000 7f3b5cabc640 1 -- 172.21.15.148:0/604346976 learned_addr learned my addr 172.21.15.148:0/604346976 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:47.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.588+0000 7f3b5d2bd640 1 --2- 172.21.15.148:0/604346976 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b581082a0 0x7f3b5819cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:47.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.588+0000 7f3b57fff640 1 --2- 172.21.15.148:0/604346976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b581036e0 0x7f3b58198c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:47.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.588+0000 7f3b5cabc640 1 -- 172.21.15.148:0/604346976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b581036e0 msgr2=0x7f3b58198c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:47.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.588+0000 7f3b5cabc640 1 --2- 172.21.15.148:0/604346976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b581036e0 0x7f3b58198c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:47.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.588+0000 7f3b5cabc640 1 -- 172.21.15.148:0/604346976 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b581082a0 msgr2=0x7f3b5819cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:47.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.588+0000 7f3b5cabc640 1 --2- 172.21.15.148:0/604346976 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b581082a0 0x7f3b5819cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:47.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.588+0000 7f3b5cabc640 1 -- 172.21.15.148:0/604346976 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b5819d6b0 con 0x7f3b58102d30 2024-09-19T07:11:47.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.588+0000 7f3b57fff640 1 --2- 172.21.15.148:0/604346976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b581036e0 0x7f3b58198c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:11:47.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.588+0000 7f3b5cabc640 1 --2- 172.21.15.148:0/604346976 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b58102d30 0x7f3b58198700 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c00b4a0 tx=0x7f3b4c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:47.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.588+0000 7f3b55ffb640 1 -- 172.21.15.148:0/604346976 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c014070 con 0x7f3b58102d30 2024-09-19T07:11:47.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.588+0000 7f3b55ffb640 1 -- 172.21.15.148:0/604346976 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b4c010af0 con 0x7f3b58102d30 2024-09-19T07:11:47.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.588+0000 7f3b5ed20640 1 -- 172.21.15.148:0/604346976 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b5819d9a0 con 0x7f3b58102d30 2024-09-19T07:11:47.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.589+0000 7f3b55ffb640 1 -- 172.21.15.148:0/604346976 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c017d10 con 0x7f3b58102d30 2024-09-19T07:11:47.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.589+0000 7f3b5ed20640 1 -- 172.21.15.148:0/604346976 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b581a5280 con 0x7f3b58102d30 2024-09-19T07:11:47.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.590+0000 7f3b5ed20640 1 -- 172.21.15.148:0/604346976 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b5806a850 con 0x7f3b58102d30 2024-09-19T07:11:47.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.591+0000 7f3b55ffb640 1 -- 172.21.15.148:0/604346976 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f3b4c017070 con 0x7f3b58102d30 2024-09-19T07:11:47.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.591+0000 7f3b55ffb640 1 --2- 172.21.15.148:0/604346976 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f3b480a34c0 0x7f3b480a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:47.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.591+0000 7f3b57fff640 1 --2- 172.21.15.148:0/604346976 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f3b480a34c0 0x7f3b480a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:47.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.591+0000 7f3b55ffb640 1 -- 172.21.15.148:0/604346976 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f3b4c0cf140 con 0x7f3b58102d30 2024-09-19T07:11:47.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.592+0000 7f3b57fff640 1 --2- 172.21.15.148:0/604346976 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f3b480a34c0 0x7f3b480a5980 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3b4402a940 tx=0x7f3b44032d50 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:47.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.596+0000 7f3b55ffb640 1 -- 172.21.15.148:0/604346976 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3b4c09bad0 con 0x7f3b58102d30 2024-09-19T07:11:47.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:47 smithi165 ceph-mon[35326]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-19T07:11:47.783 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 11.2 2024-09-19T07:11:47.783 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:11:47.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.817+0000 7f3b5ed20640 1 -- 172.21.15.148:0/604346976 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3b5810a2b0 con 0x7f3b58102d30 2024-09-19T07:11:47.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.818+0000 7f3b55ffb640 1 -- 172.21.15.148:0/604346976 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11939 (secure 0 0 0) 0x7f3b4c09b3d0 con 0x7f3b58102d30 2024-09-19T07:11:47.820 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:11:47.820 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":25,"btime":"2024-09-19T07:11:04:227331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/4263868576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":4263868576},{"type":"v1","addr":"172.21.15.148:6841","nonce":4263868576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24383,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2146820965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2146820965},{"type":"v1","addr":"172.21.15.165:6835","nonce":2146820965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:09:19.543369+0000","modified":"2024-09-19T07:11:03.969598+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24457,"mds_1":24437,"mds_2":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/1566489108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1566489108},{"type":"v1","addr":"172.21.15.179:6835","nonce":1566489108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.165:6839/3993490234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":3993490234},{"type":"v1","addr":"172.21.15.165:6839","nonce":3993490234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24457,"qdb_cluster":[24457,24437,24436]},"id":1}]} 2024-09-19T07:11:47.820 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 25 2024-09-19T07:11:47.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.821+0000 7f3b5ed20640 1 -- 172.21.15.148:0/604346976 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f3b480a34c0 msgr2=0x7f3b480a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:47.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.821+0000 7f3b5ed20640 1 --2- 172.21.15.148:0/604346976 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f3b480a34c0 0x7f3b480a5980 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3b4402a940 tx=0x7f3b44032d50 comp rx=0 tx=0).stop 2024-09-19T07:11:47.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.821+0000 7f3b5ed20640 1 -- 172.21.15.148:0/604346976 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b58102d30 msgr2=0x7f3b58198700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:47.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.821+0000 7f3b5ed20640 1 --2- 172.21.15.148:0/604346976 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b58102d30 0x7f3b58198700 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c00b4a0 tx=0x7f3b4c00b960 comp rx=0 tx=0).stop 2024-09-19T07:11:47.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.821+0000 7f3b5ed20640 1 -- 172.21.15.148:0/604346976 shutdown_connections 2024-09-19T07:11:47.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.821+0000 7f3b5ed20640 1 --2- 172.21.15.148:0/604346976 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f3b480a34c0 0x7f3b480a5980 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:47.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.821+0000 7f3b5ed20640 1 --2- 172.21.15.148:0/604346976 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b581082a0 0x7f3b5819cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:47.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.821+0000 7f3b5ed20640 1 --2- 172.21.15.148:0/604346976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b581036e0 0x7f3b58198c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:47.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.821+0000 7f3b5ed20640 1 --2- 172.21.15.148:0/604346976 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b58102d30 0x7f3b58198700 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:47.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.821+0000 7f3b5ed20640 1 -- 172.21.15.148:0/604346976 >> 172.21.15.148:0/604346976 conn(0x7f3b580fc7d0 msgr2=0x7f3b58105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:47.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.821+0000 7f3b5ed20640 1 -- 172.21.15.148:0/604346976 shutdown_connections 2024-09-19T07:11:47.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:47.821+0000 7f3b5ed20640 1 -- 172.21.15.148:0/604346976 wait complete. 2024-09-19T07:11:48.467 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:48 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/604346976' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:11:48.501 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T07:11:48.516 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:11:48.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:48 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/604346976' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:11:48.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:48 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/604346976' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:11:49.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.035+0000 7f9862cd1640 1 -- 172.21.15.148:0/3535878822 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f985c102ef0 msgr2=0x7f985c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:49.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.035+0000 7f9862cd1640 1 --2- 172.21.15.148:0/3535878822 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f985c102ef0 0x7f985c10da40 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f9854009ca0 tx=0x7f985402a950 comp rx=0 tx=0).stop 2024-09-19T07:11:49.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.036+0000 7f9862cd1640 1 -- 172.21.15.148:0/3535878822 shutdown_connections 2024-09-19T07:11:49.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.036+0000 7f9862cd1640 1 --2- 172.21.15.148:0/3535878822 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f985c102ef0 0x7f985c10da40 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:49.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.036+0000 7f9862cd1640 1 --2- 172.21.15.148:0/3535878822 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f985c102570 0x7f985c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:49.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.036+0000 7f9862cd1640 1 --2- 172.21.15.148:0/3535878822 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f985c100e20 0x7f985c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:49.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.036+0000 7f9862cd1640 1 -- 172.21.15.148:0/3535878822 >> 172.21.15.148:0/3535878822 conn(0x7f985c0fc7d0 msgr2=0x7f985c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:49.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.036+0000 7f9862cd1640 1 -- 172.21.15.148:0/3535878822 shutdown_connections 2024-09-19T07:11:49.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.036+0000 7f9862cd1640 1 -- 172.21.15.148:0/3535878822 wait complete. 2024-09-19T07:11:49.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.036+0000 7f9862cd1640 1 Processor -- start 2024-09-19T07:11:49.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.036+0000 7f9862cd1640 1 -- start start 2024-09-19T07:11:49.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.036+0000 7f9862cd1640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f985c100e20 0x7f985c199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:49.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.036+0000 7f9862cd1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f985c102570 0x7f985c199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:49.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.036+0000 7f9862cd1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f985c102ef0 0x7f985c1a4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:49.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.036+0000 7f9862cd1640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f985c110fa0 con 0x7f985c102570 2024-09-19T07:11:49.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.037+0000 7f9862cd1640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f985c110e20 con 0x7f985c100e20 2024-09-19T07:11:49.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.037+0000 7f9862cd1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f985c111120 con 0x7f985c102ef0 2024-09-19T07:11:49.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.037+0000 7f985bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f985c102570 0x7f985c199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:49.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.037+0000 7f985bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f985c102570 0x7f985c199850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48552/0 (socket says 172.21.15.148:48552) 2024-09-19T07:11:49.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.037+0000 7f985bfff640 1 -- 172.21.15.148:0/2626015001 learned_addr learned my addr 172.21.15.148:0/2626015001 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:49.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.037+0000 7f9860a6d640 1 --2- 172.21.15.148:0/2626015001 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f985c100e20 0x7f985c199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:49.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.037+0000 7f986126e640 1 --2- 172.21.15.148:0/2626015001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f985c102ef0 0x7f985c1a4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:49.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.037+0000 7f985bfff640 1 -- 172.21.15.148:0/2626015001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f985c102ef0 msgr2=0x7f985c1a4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:49.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.037+0000 7f985bfff640 1 --2- 172.21.15.148:0/2626015001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f985c102ef0 0x7f985c1a4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:49.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.037+0000 7f985bfff640 1 -- 172.21.15.148:0/2626015001 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f985c100e20 msgr2=0x7f985c199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:49.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.037+0000 7f985bfff640 1 --2- 172.21.15.148:0/2626015001 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f985c100e20 0x7f985c199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:49.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.037+0000 7f985bfff640 1 -- 172.21.15.148:0/2626015001 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f985c1a48d0 con 0x7f985c102570 2024-09-19T07:11:49.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.037+0000 7f986126e640 1 --2- 172.21.15.148:0/2626015001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f985c102ef0 0x7f985c1a4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:11:49.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.037+0000 7f9860a6d640 1 --2- 172.21.15.148:0/2626015001 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f985c100e20 0x7f985c199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:11:49.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.037+0000 7f985bfff640 1 --2- 172.21.15.148:0/2626015001 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f985c102570 0x7f985c199850 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f984800b4a0 tx=0x7f984800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:49.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.037+0000 7f9859ffb640 1 -- 172.21.15.148:0/2626015001 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9848014070 con 0x7f985c102570 2024-09-19T07:11:49.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.037+0000 7f9862cd1640 1 -- 172.21.15.148:0/2626015001 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f985c1a4aa0 con 0x7f985c102570 2024-09-19T07:11:49.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.037+0000 7f9859ffb640 1 -- 172.21.15.148:0/2626015001 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9848010af0 con 0x7f985c102570 2024-09-19T07:11:49.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.037+0000 7f9859ffb640 1 -- 172.21.15.148:0/2626015001 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9848017d10 con 0x7f985c102570 2024-09-19T07:11:49.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.038+0000 7f9862cd1640 1 -- 172.21.15.148:0/2626015001 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f985c1a4fe0 con 0x7f985c102570 2024-09-19T07:11:49.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.039+0000 7f9862cd1640 1 -- 172.21.15.148:0/2626015001 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f985c101200 con 0x7f985c102570 2024-09-19T07:11:49.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.040+0000 7f9859ffb640 1 -- 172.21.15.148:0/2626015001 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f9848017070 con 0x7f985c102570 2024-09-19T07:11:49.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.041+0000 7f9859ffb640 1 --2- 172.21.15.148:0/2626015001 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f984c0a3440 0x7f984c0a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:49.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.041+0000 7f9860a6d640 1 --2- 172.21.15.148:0/2626015001 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f984c0a3440 0x7f984c0a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:49.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.041+0000 7f9859ffb640 1 -- 172.21.15.148:0/2626015001 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f98480cf1e0 con 0x7f985c102570 2024-09-19T07:11:49.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.042+0000 7f9860a6d640 1 --2- 172.21.15.148:0/2626015001 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f984c0a3440 0x7f984c0a5900 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9850009fc0 tx=0x7f9850005f90 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:49.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.045+0000 7f9859ffb640 1 -- 172.21.15.148:0/2626015001 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f984809bb70 con 0x7f985c102570 2024-09-19T07:11:49.118 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:11:49.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.274+0000 7f9862cd1640 1 -- 172.21.15.148:0/2626015001 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f985c06a5a0 con 0x7f985c102570 2024-09-19T07:11:49.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.275+0000 7f9859ffb640 1 -- 172.21.15.148:0/2626015001 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11939 (secure 0 0 0) 0x7f984809b470 con 0x7f985c102570 2024-09-19T07:11:49.276 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:11:49.276 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":25,"btime":"2024-09-19T07:11:04:227331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/4263868576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":4263868576},{"type":"v1","addr":"172.21.15.148:6841","nonce":4263868576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24383,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2146820965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2146820965},{"type":"v1","addr":"172.21.15.165:6835","nonce":2146820965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:09:19.543369+0000","modified":"2024-09-19T07:11:03.969598+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24457,"mds_1":24437,"mds_2":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/1566489108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1566489108},{"type":"v1","addr":"172.21.15.179:6835","nonce":1566489108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.165:6839/3993490234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":3993490234},{"type":"v1","addr":"172.21.15.165:6839","nonce":3993490234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24457,"qdb_cluster":[24457,24437,24436]},"id":1}]} 2024-09-19T07:11:49.276 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 25 2024-09-19T07:11:49.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.277+0000 7f9862cd1640 1 -- 172.21.15.148:0/2626015001 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f984c0a3440 msgr2=0x7f984c0a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:49.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.277+0000 7f9862cd1640 1 --2- 172.21.15.148:0/2626015001 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f984c0a3440 0x7f984c0a5900 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9850009fc0 tx=0x7f9850005f90 comp rx=0 tx=0).stop 2024-09-19T07:11:49.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.277+0000 7f9862cd1640 1 -- 172.21.15.148:0/2626015001 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f985c102570 msgr2=0x7f985c199850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:49.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.277+0000 7f9862cd1640 1 --2- 172.21.15.148:0/2626015001 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f985c102570 0x7f985c199850 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f984800b4a0 tx=0x7f984800b960 comp rx=0 tx=0).stop 2024-09-19T07:11:49.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.278+0000 7f9862cd1640 1 -- 172.21.15.148:0/2626015001 shutdown_connections 2024-09-19T07:11:49.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.278+0000 7f9862cd1640 1 --2- 172.21.15.148:0/2626015001 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f984c0a3440 0x7f984c0a5900 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:49.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.278+0000 7f9862cd1640 1 --2- 172.21.15.148:0/2626015001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f985c102ef0 0x7f985c1a4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:49.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.278+0000 7f9862cd1640 1 --2- 172.21.15.148:0/2626015001 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f985c102570 0x7f985c199850 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:49.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.278+0000 7f9862cd1640 1 --2- 172.21.15.148:0/2626015001 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f985c100e20 0x7f985c199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:49.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.278+0000 7f9862cd1640 1 -- 172.21.15.148:0/2626015001 >> 172.21.15.148:0/2626015001 conn(0x7f985c0fc7d0 msgr2=0x7f985c106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:49.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.278+0000 7f9862cd1640 1 -- 172.21.15.148:0/2626015001 shutdown_connections 2024-09-19T07:11:49.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:49.278+0000 7f9862cd1640 1 -- 172.21.15.148:0/2626015001 wait complete. 2024-09-19T07:11:49.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:49 smithi148 ceph-mon[31180]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-19T07:11:49.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:49 smithi179 ceph-mon[35716]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-19T07:11:49.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:49 smithi165 ceph-mon[35326]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-19T07:11:50.033 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24457 quiesce db / --timeout 90 --expiration 131.2 --await-for 45.0' 2024-09-19T07:11:50.033 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24457 quiesce db / --timeout 90 --expiration 131.2 --await-for 45.0 2024-09-19T07:11:50.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.274+0000 7fda11caf640 1 -- 172.21.15.148:0/89165024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda0c102d30 msgr2=0x7fda0c103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:50.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.274+0000 7fda11caf640 1 --2- 172.21.15.148:0/89165024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda0c102d30 0x7fda0c103110 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc009930 tx=0x7fd9fc02a420 comp rx=0 tx=0).stop 2024-09-19T07:11:50.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.274+0000 7fda11caf640 1 -- 172.21.15.148:0/89165024 shutdown_connections 2024-09-19T07:11:50.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.274+0000 7fda11caf640 1 --2- 172.21.15.148:0/89165024 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda0c1082a0 0x7fda0c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:50.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.274+0000 7fda11caf640 1 --2- 172.21.15.148:0/89165024 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda0c1036e0 0x7fda0c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:50.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.274+0000 7fda11caf640 1 --2- 172.21.15.148:0/89165024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda0c102d30 0x7fda0c103110 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:50.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.274+0000 7fda11caf640 1 -- 172.21.15.148:0/89165024 >> 172.21.15.148:0/89165024 conn(0x7fda0c0fc7d0 msgr2=0x7fda0c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:50.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.274+0000 7fda11caf640 1 -- 172.21.15.148:0/89165024 shutdown_connections 2024-09-19T07:11:50.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.274+0000 7fda11caf640 1 -- 172.21.15.148:0/89165024 wait complete. 2024-09-19T07:11:50.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.275+0000 7fda11caf640 1 Processor -- start 2024-09-19T07:11:50.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.275+0000 7fda11caf640 1 -- start start 2024-09-19T07:11:50.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.275+0000 7fda11caf640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda0c102d30 0x7fda0c198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:50.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.275+0000 7fda11caf640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda0c1036e0 0x7fda0c198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:50.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.275+0000 7fda11caf640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda0c1082a0 0x7fda0c19cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:50.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.275+0000 7fda11caf640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fda0c112120 con 0x7fda0c1082a0 2024-09-19T07:11:50.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.275+0000 7fda11caf640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fda0c111fa0 con 0x7fda0c1036e0 2024-09-19T07:11:50.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.275+0000 7fda11caf640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fda0c1122a0 con 0x7fda0c102d30 2024-09-19T07:11:50.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.275+0000 7fda0b7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda0c102d30 0x7fda0c198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:50.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.275+0000 7fda0bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda0c1082a0 0x7fda0c19cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:50.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.275+0000 7fda0b7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda0c102d30 0x7fda0c198620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:35632/0 (socket says 172.21.15.148:35632) 2024-09-19T07:11:50.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.275+0000 7fda0b7fe640 1 -- 172.21.15.148:0/235307000 learned_addr learned my addr 172.21.15.148:0/235307000 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:50.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.275+0000 7fda0affd640 1 --2- 172.21.15.148:0/235307000 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda0c1036e0 0x7fda0c198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:50.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.276+0000 7fda0b7fe640 1 -- 172.21.15.148:0/235307000 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda0c1036e0 msgr2=0x7fda0c198b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:50.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.276+0000 7fda0b7fe640 1 --2- 172.21.15.148:0/235307000 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda0c1036e0 0x7fda0c198b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:50.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.276+0000 7fda0b7fe640 1 -- 172.21.15.148:0/235307000 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda0c1082a0 msgr2=0x7fda0c19cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:50.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.276+0000 7fda0b7fe640 1 --2- 172.21.15.148:0/235307000 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda0c1082a0 0x7fda0c19cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:50.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.276+0000 7fda0b7fe640 1 -- 172.21.15.148:0/235307000 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda0c19d5d0 con 0x7fda0c102d30 2024-09-19T07:11:50.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.276+0000 7fda0bfff640 1 --2- 172.21.15.148:0/235307000 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda0c1082a0 0x7fda0c19cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:11:50.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.276+0000 7fda0b7fe640 1 --2- 172.21.15.148:0/235307000 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda0c102d30 0x7fda0c198620 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc009230 tx=0x7fd9fc004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:50.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.276+0000 7fda08ff9640 1 -- 172.21.15.148:0/235307000 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc03f030 con 0x7fda0c102d30 2024-09-19T07:11:50.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.276+0000 7fda08ff9640 1 -- 172.21.15.148:0/235307000 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9fc003ad0 con 0x7fda0c102d30 2024-09-19T07:11:50.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.276+0000 7fda08ff9640 1 -- 172.21.15.148:0/235307000 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc035070 con 0x7fda0c102d30 2024-09-19T07:11:50.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.276+0000 7fda11caf640 1 -- 172.21.15.148:0/235307000 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda0c19d860 con 0x7fda0c102d30 2024-09-19T07:11:50.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.276+0000 7fda11caf640 1 -- 172.21.15.148:0/235307000 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda0c1a51a0 con 0x7fda0c102d30 2024-09-19T07:11:50.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.279+0000 7fda14088740 1 Processor -- start 2024-09-19T07:11:50.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.279+0000 7fda08ff9640 1 -- 172.21.15.148:0/235307000 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7fd9fc042030 con 0x7fda0c102d30 2024-09-19T07:11:50.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.279+0000 7fda14088740 1 -- start start 2024-09-19T07:11:50.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.279+0000 7fda14088740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557932a61b40 0x557932a60090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:50.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.279+0000 7fda14088740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557932a605d0 0x557932a60a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:50.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.279+0000 7fda14088740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557932a6f780 0x557932a71b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:50.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.279+0000 7fda14088740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5579329c62f0 con 0x557932a6f780 2024-09-19T07:11:50.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.279+0000 7fda14088740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55793296dcf0 con 0x557932a61b40 2024-09-19T07:11:50.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.279+0000 7fda14088740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5579329c22b0 con 0x557932a605d0 2024-09-19T07:11:50.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.280+0000 7fda0affd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557932a6f780 0x557932a71b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:50.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.280+0000 7fda0bfff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557932a61b40 0x557932a60090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:50.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.280+0000 7fda0affd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557932a6f780 0x557932a71b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48586/0 (socket says 172.21.15.148:48586) 2024-09-19T07:11:50.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.280+0000 7fda0affd640 1 -- 172.21.15.148:0/3271077049 learned_addr learned my addr 172.21.15.148:0/3271077049 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:50.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.280+0000 7fda0affd640 1 -- 172.21.15.148:0/3271077049 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557932a605d0 msgr2=0x557932a60a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:50.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.280+0000 7fda08ff9640 1 --2- 172.21.15.148:0/235307000 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fd9f40a3440 0x7fd9f40a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:50.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.280+0000 7fda0b7fe640 1 --2- 172.21.15.148:0/3271077049 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557932a605d0 0x557932a60a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:50.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.280+0000 7fda0affd640 1 --2- 172.21.15.148:0/3271077049 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557932a605d0 0x557932a60a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:50.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.280+0000 7fda0affd640 1 -- 172.21.15.148:0/3271077049 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557932a61b40 msgr2=0x557932a60090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:50.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.280+0000 7fda0affd640 1 --2- 172.21.15.148:0/3271077049 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557932a61b40 0x557932a60090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:50.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.280+0000 7fda0affd640 1 -- 172.21.15.148:0/3271077049 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579329523a0 con 0x557932a6f780 2024-09-19T07:11:50.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.280+0000 7fda0bfff640 1 --2- 172.21.15.148:0/3271077049 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557932a61b40 0x557932a60090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:11:50.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.280+0000 7fda0b7fe640 1 --2- 172.21.15.148:0/3271077049 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557932a605d0 0x557932a60a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:11:50.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.280+0000 7fda0affd640 1 --2- 172.21.15.148:0/3271077049 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557932a6f780 0x557932a71b70 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fda00009c20 tx=0x7fda00011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed75ffa805f2a446 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:50.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.280+0000 7fda0bfff640 1 --2- 172.21.15.148:0/235307000 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fd9f40a3440 0x7fd9f40a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:50.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.281+0000 7fd9f1ffb640 1 -- 172.21.15.148:0/3271077049 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda00004230 con 0x557932a6f780 2024-09-19T07:11:50.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.281+0000 7fd9f1ffb640 1 -- 172.21.15.148:0/3271077049 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda000043d0 con 0x557932a6f780 2024-09-19T07:11:50.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.281+0000 7fd9f1ffb640 1 -- 172.21.15.148:0/3271077049 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda000197b0 con 0x557932a6f780 2024-09-19T07:11:50.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.281+0000 7fda08ff9640 1 -- 172.21.15.148:0/235307000 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fd9fc0f0420 con 0x7fda0c102d30 2024-09-19T07:11:50.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.281+0000 7fda14088740 1 -- 172.21.15.148:0/3271077049 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557932a6f780 msgr2=0x557932a71b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:50.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.281+0000 7fda0bfff640 1 --2- 172.21.15.148:0/235307000 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fd9f40a3440 0x7fd9f40a5900 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fda0400aa20 tx=0x7fda04004b50 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:50.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.281+0000 7fda14088740 1 --2- 172.21.15.148:0/3271077049 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557932a6f780 0x557932a71b70 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fda00009c20 tx=0x7fda00011810 comp rx=0 tx=0).stop 2024-09-19T07:11:50.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.282+0000 7fda14088740 1 -- 172.21.15.148:0/3271077049 shutdown_connections 2024-09-19T07:11:50.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.282+0000 7fda14088740 1 --2- 172.21.15.148:0/3271077049 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557932a6f780 0x557932a71b70 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:50.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.282+0000 7fda14088740 1 --2- 172.21.15.148:0/3271077049 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557932a605d0 0x557932a60a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:50.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.282+0000 7fda14088740 1 --2- 172.21.15.148:0/3271077049 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557932a61b40 0x557932a60090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:50.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.282+0000 7fda14088740 1 -- 172.21.15.148:0/3271077049 >> 172.21.15.148:0/3271077049 conn(0x557932a29310 msgr2=0x557932a5cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:50.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.282+0000 7fda14088740 1 -- 172.21.15.148:0/3271077049 shutdown_connections 2024-09-19T07:11:50.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.282+0000 7fda14088740 1 -- 172.21.15.148:0/3271077049 wait complete. 2024-09-19T07:11:50.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.282+0000 7fda14088740 1 -- start start 2024-09-19T07:11:50.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.282+0000 7fda14088740 1 Processor -- start 2024-09-19T07:11:50.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.282+0000 7fda14088740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557932a605d0 0x557932a6ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:50.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.282+0000 7fda14088740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557932a61b40 0x557932a6c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:50.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.282+0000 7fda14088740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557932a6f780 0x557932a6c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:50.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.282+0000 7fda14088740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x557932a72480 con 0x557932a61b40 2024-09-19T07:11:50.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.282+0000 7fda14088740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x557932981060 con 0x557932a605d0 2024-09-19T07:11:50.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.282+0000 7fda14088740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x557932a72600 con 0x557932a6f780 2024-09-19T07:11:50.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.283+0000 7fda14088740 10 client.0 _ll_register_callbacks cb 0x5579326d48c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:11:50.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.283+0000 7fda0bfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557932a6f780 0x557932a6c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:50.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.283+0000 7fda0affd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557932a61b40 0x557932a6c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:50.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.283+0000 7fda0bfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557932a6f780 0x557932a6c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:35640/0 (socket says 172.21.15.148:35640) 2024-09-19T07:11:50.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.283+0000 7fda0affd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557932a61b40 0x557932a6c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48600/0 (socket says 172.21.15.148:48600) 2024-09-19T07:11:50.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.283+0000 7fda0bfff640 1 -- 172.21.15.148:0/478384086 learned_addr learned my addr 172.21.15.148:0/478384086 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:50.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.283+0000 7fda0b7fe640 1 --2- 172.21.15.148:0/478384086 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557932a605d0 0x557932a6ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:50.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.283+0000 7fda0bfff640 1 -- 172.21.15.148:0/478384086 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557932a605d0 msgr2=0x557932a6ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:50.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.283+0000 7fda0bfff640 1 --2- 172.21.15.148:0/478384086 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557932a605d0 0x557932a6ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:50.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.283+0000 7fda0bfff640 1 -- 172.21.15.148:0/478384086 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557932a61b40 msgr2=0x557932a6c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:50.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.283+0000 7fda0bfff640 1 --2- 172.21.15.148:0/478384086 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557932a61b40 0x557932a6c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:50.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.283+0000 7fda0bfff640 1 -- 172.21.15.148:0/478384086 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579327373c0 con 0x557932a6f780 2024-09-19T07:11:50.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.283+0000 7fda0bfff640 1 --2- 172.21.15.148:0/478384086 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557932a6f780 0x557932a6c960 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fda04007eb0 tx=0x7fda0400d040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eff081286da0d776 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:50.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.283+0000 7fd9eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-19T07:11:50.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.283+0000 7fd9eaffd640 1 -- 172.21.15.148:0/478384086 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda04017e10 con 0x557932a6f780 2024-09-19T07:11:50.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.284+0000 7fd9eaffd640 1 -- 172.21.15.148:0/478384086 <== mon.1 v2:172.21.15.179:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fda040225c0 con 0x557932a6f780 2024-09-19T07:11:50.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.284+0000 7fda14088740 1 -- 172.21.15.148:0/478384086 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda000043d0 con 0x557932a6f780 2024-09-19T07:11:50.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.284+0000 7fd9eaffd640 1 -- 172.21.15.148:0/478384086 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fda040227c0 con 0x557932a6f780 2024-09-19T07:11:50.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.284+0000 7fda14088740 10 client.25042 fetch_fsmap learned FSMap version 25 2024-09-19T07:11:50.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.284+0000 7fda14088740 1 -- 172.21.15.148:0/478384086 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557932a822f0 con 0x557932a6f780 2024-09-19T07:11:50.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.284+0000 7fd9eaffd640 1 -- 172.21.15.148:0/478384086 <== mon.1 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda000043d0 con 0x557932a6f780 2024-09-19T07:11:50.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.284+0000 7fd9eaffd640 1 -- 172.21.15.148:0/478384086 <== mon.1 v2:172.21.15.179:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fda04023b50 con 0x557932a6f780 2024-09-19T07:11:50.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.284+0000 7fda14088740 10 client.25042 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:11:50.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.284+0000 7fda14088740 10 client.25042 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T07:11:50.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.284+0000 7fda14088740 20 client.25042 populate_metadata read hostname 'smithi148' 2024-09-19T07:11:50.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.284+0000 7fda14088740 1 --2- 172.21.15.148:0/478384086 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x557932a83800 0x557932a85c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:50.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.284+0000 7fda14088740 4 client.25042 mds_command: new command op to 24436 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:11:50.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.284+0000 7fda14088740 1 -- 172.21.15.148:0/478384086 --> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5579329d3860 con 0x557932a83800 2024-09-19T07:11:50.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.284+0000 7fda0b7fe640 1 --2- 172.21.15.148:0/478384086 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x557932a83800 0x557932a85c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:50.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.285+0000 7fd9eaffd640 10 client.25042 ms_handle_connect on v2:172.21.15.179:6836/3827671241 2024-09-19T07:11:50.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.285+0000 7fda0b7fe640 1 --2- 172.21.15.148:0/478384086 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x557932a83800 0x557932a85c70 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=646c144e55a377cc server_cookie=e5b240a49ca1aea in_seq=0 out_seq=0 2024-09-19T07:11:50.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.285+0000 7fd9eaffd640 1 -- 172.21.15.148:0/478384086 <== mds.2 v2:172.21.15.179:6836/3827671241 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5579329d3860 con 0x557932a83800 2024-09-19T07:11:50.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.285+0000 7fd9eaffd640 10 client.25042 handle_command_reply: tid=0 2024-09-19T07:11:50.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.286+0000 7fda14088740 1 client.25042 shutdown 2024-09-19T07:11:50.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.286+0000 7fda14088740 1 -- 172.21.15.148:0/478384086 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557932a6f780 msgr2=0x557932a6c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:50.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.286+0000 7fda14088740 1 --2- 172.21.15.148:0/478384086 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557932a6f780 0x557932a6c960 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fda04007eb0 tx=0x7fda0400d040 comp rx=0 tx=0).stop 2024-09-19T07:11:50.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.286+0000 7fda14088740 1 -- 172.21.15.148:0/478384086 shutdown_connections 2024-09-19T07:11:50.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.286+0000 7fda14088740 1 --2- 172.21.15.148:0/478384086 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x557932a83800 0x557932a85c70 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:50.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.286+0000 7fda14088740 1 --2- 172.21.15.148:0/478384086 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557932a6f780 0x557932a6c960 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:50.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.286+0000 7fda14088740 1 --2- 172.21.15.148:0/478384086 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557932a61b40 0x557932a6c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:50.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.286+0000 7fda14088740 1 --2- 172.21.15.148:0/478384086 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557932a605d0 0x557932a6ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:50.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.286+0000 7fda14088740 1 -- 172.21.15.148:0/478384086 >> 172.21.15.148:0/478384086 conn(0x557932a29310 msgr2=0x557932a62960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:50.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.286+0000 7fd9eaffd640 0 client.25042 ms_handle_reset on v2:172.21.15.179:6836/3827671241 2024-09-19T07:11:50.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.286+0000 7fda14088740 1 -- 172.21.15.148:0/478384086 shutdown_connections 2024-09-19T07:11:50.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.286+0000 7fda14088740 1 -- 172.21.15.148:0/478384086 wait complete. 2024-09-19T07:11:50.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.286+0000 7fda14088740 20 client.25042 trim_cache size 0 max 16384 2024-09-19T07:11:50.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.302+0000 7fda14088740 1 Processor -- start 2024-09-19T07:11:50.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.303+0000 7fda14088740 1 -- start start 2024-09-19T07:11:50.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.303+0000 7fda14088740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557932a605d0 0x557932a6e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:50.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.303+0000 7fda14088740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557932a61b40 0x557932a8b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:50.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.303+0000 7fda14088740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557932a6f780 0x557932a8ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:50.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.303+0000 7fda14088740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fda0c1adee0 con 0x557932a605d0 2024-09-19T07:11:50.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.303+0000 7fda14088740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fda0c1ab7b0 con 0x557932a6f780 2024-09-19T07:11:50.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.303+0000 7fda14088740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fda0c1a9600 con 0x557932a61b40 2024-09-19T07:11:50.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.303+0000 7fda0b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557932a605d0 0x557932a6e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:50.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.303+0000 7fda0b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557932a605d0 0x557932a6e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48606/0 (socket says 172.21.15.148:48606) 2024-09-19T07:11:50.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.303+0000 7fda0b7fe640 1 -- 172.21.15.148:0/3558337195 learned_addr learned my addr 172.21.15.148:0/3558337195 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:50.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.303+0000 7fda0bfff640 1 --2- 172.21.15.148:0/3558337195 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557932a6f780 0x557932a8ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:50.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.303+0000 7fda0b7fe640 1 -- 172.21.15.148:0/3558337195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557932a61b40 msgr2=0x557932a8b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:50.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.303+0000 7fda0affd640 1 --2- 172.21.15.148:0/3558337195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557932a61b40 0x557932a8b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:50.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.303+0000 7fda0b7fe640 1 --2- 172.21.15.148:0/3558337195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557932a61b40 0x557932a8b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:50.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.303+0000 7fda0b7fe640 1 -- 172.21.15.148:0/3558337195 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557932a6f780 msgr2=0x557932a8ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:50.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.303+0000 7fda0b7fe640 1 --2- 172.21.15.148:0/3558337195 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557932a6f780 0x557932a8ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:50.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.303+0000 7fda0b7fe640 1 -- 172.21.15.148:0/3558337195 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557932a63120 con 0x557932a605d0 2024-09-19T07:11:50.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.303+0000 7fda0bfff640 1 --2- 172.21.15.148:0/3558337195 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557932a6f780 0x557932a8ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:11:50.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.304+0000 7fda0b7fe640 1 --2- 172.21.15.148:0/3558337195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557932a605d0 0x557932a6e390 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc0b8ab0 tx=0x7fd9fc0dc7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8cccf37b94058f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:50.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.304+0000 7fd9f17fa640 1 -- 172.21.15.148:0/3558337195 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc049040 con 0x557932a605d0 2024-09-19T07:11:50.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.304+0000 7fd9f17fa640 1 -- 172.21.15.148:0/3558337195 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9fc0a4070 con 0x557932a605d0 2024-09-19T07:11:50.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.304+0000 7fd9f17fa640 1 -- 172.21.15.148:0/3558337195 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc0b8cc0 con 0x557932a605d0 2024-09-19T07:11:50.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.305+0000 7fda14088740 1 -- 172.21.15.148:0/3558337195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557932a605d0 msgr2=0x557932a6e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:50.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.305+0000 7fda14088740 1 --2- 172.21.15.148:0/3558337195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557932a605d0 0x557932a6e390 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc0b8ab0 tx=0x7fd9fc0dc7d0 comp rx=0 tx=0).stop 2024-09-19T07:11:50.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.305+0000 7fda14088740 1 -- 172.21.15.148:0/3558337195 shutdown_connections 2024-09-19T07:11:50.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.305+0000 7fda14088740 1 --2- 172.21.15.148:0/3558337195 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557932a6f780 0x557932a8ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:50.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.305+0000 7fda14088740 1 --2- 172.21.15.148:0/3558337195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557932a61b40 0x557932a8b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:50.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.305+0000 7fda14088740 1 --2- 172.21.15.148:0/3558337195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557932a605d0 0x557932a6e390 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:50.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.305+0000 7fda14088740 1 -- 172.21.15.148:0/3558337195 >> 172.21.15.148:0/3558337195 conn(0x557932a29310 msgr2=0x557932a6dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:50.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.305+0000 7fda14088740 1 -- 172.21.15.148:0/3558337195 shutdown_connections 2024-09-19T07:11:50.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.305+0000 7fda14088740 1 -- 172.21.15.148:0/3558337195 wait complete. 2024-09-19T07:11:50.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.305+0000 7fda14088740 1 -- start start 2024-09-19T07:11:50.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.306+0000 7fda14088740 1 Processor -- start 2024-09-19T07:11:50.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.306+0000 7fda14088740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557932a605d0 0x557932a80ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:50.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.306+0000 7fda14088740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557932a61b40 0x557932a7be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:50.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.306+0000 7fda14088740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557932a6f780 0x557932a7c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:50.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.306+0000 7fda14088740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fda0c1a9c70 con 0x557932a605d0 2024-09-19T07:11:50.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.306+0000 7fda14088740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fda0c1ab0e0 con 0x557932a61b40 2024-09-19T07:11:50.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.306+0000 7fda14088740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fda0c1aa340 con 0x557932a6f780 2024-09-19T07:11:50.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.306+0000 7fda14088740 10 client.0 _ll_register_callbacks cb 0x7fda0400a400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:11:50.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.306+0000 7fda0bfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557932a6f780 0x557932a7c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:50.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.306+0000 7fda0b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557932a605d0 0x557932a80ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:50.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.306+0000 7fda0bfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557932a6f780 0x557932a7c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:35654/0 (socket says 172.21.15.148:35654) 2024-09-19T07:11:50.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.306+0000 7fda0bfff640 1 -- 172.21.15.148:0/3655824537 learned_addr learned my addr 172.21.15.148:0/3655824537 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:50.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.306+0000 7fda0affd640 1 --2- 172.21.15.148:0/3655824537 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557932a61b40 0x557932a7be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:50.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.307+0000 7fda0bfff640 1 -- 172.21.15.148:0/3655824537 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557932a61b40 msgr2=0x557932a7be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:50.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.307+0000 7fda0bfff640 1 --2- 172.21.15.148:0/3655824537 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557932a61b40 0x557932a7be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:50.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.307+0000 7fda0bfff640 1 -- 172.21.15.148:0/3655824537 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557932a605d0 msgr2=0x557932a80ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:50.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.307+0000 7fda0bfff640 1 --2- 172.21.15.148:0/3655824537 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557932a605d0 0x557932a80ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:50.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.307+0000 7fda0bfff640 1 -- 172.21.15.148:0/3655824537 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557932a7cc20 con 0x557932a6f780 2024-09-19T07:11:50.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.307+0000 7fda0b7fe640 1 --2- 172.21.15.148:0/3655824537 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557932a605d0 0x557932a80ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:11:50.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.307+0000 7fda0bfff640 1 --2- 172.21.15.148:0/3655824537 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557932a6f780 0x557932a7c3f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fda04007140 tx=0x7fda04022b70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1189f1e4a8e63c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:50.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.307+0000 7fd9eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-19T07:11:50.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.307+0000 7fd9eaffd640 1 -- 172.21.15.148:0/3655824537 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda040225c0 con 0x557932a6f780 2024-09-19T07:11:50.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.307+0000 7fd9eaffd640 1 -- 172.21.15.148:0/3655824537 <== mon.1 v2:172.21.15.179:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fda0402c8a0 con 0x557932a6f780 2024-09-19T07:11:50.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.307+0000 7fda14088740 1 -- 172.21.15.148:0/3655824537 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9fc0a4070 con 0x557932a6f780 2024-09-19T07:11:50.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.307+0000 7fd9eaffd640 1 -- 172.21.15.148:0/3655824537 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fda0402caa0 con 0x557932a6f780 2024-09-19T07:11:50.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.307+0000 7fda14088740 10 client.25045 fetch_fsmap learned FSMap version 25 2024-09-19T07:11:50.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.307+0000 7fda14088740 1 -- 172.21.15.148:0/3655824537 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557932aee5f0 con 0x557932a6f780 2024-09-19T07:11:50.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.308+0000 7fd9eaffd640 1 -- 172.21.15.148:0/3655824537 <== mon.1 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9fc0a4070 con 0x557932a6f780 2024-09-19T07:11:50.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.308+0000 7fd9eaffd640 1 -- 172.21.15.148:0/3655824537 <== mon.1 v2:172.21.15.179:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fda04036430 con 0x557932a6f780 2024-09-19T07:11:50.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.308+0000 7fda14088740 10 client.25045 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:11:50.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.308+0000 7fda14088740 10 client.25045 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T07:11:50.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.308+0000 7fda14088740 20 client.25045 populate_metadata read hostname 'smithi148' 2024-09-19T07:11:50.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.308+0000 7fda14088740 1 --2- 172.21.15.148:0/3655824537 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x557932aeecf0 0x557932af1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:50.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.308+0000 7fda14088740 4 client.25045 mds_command: new command op to 24436 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:11:50.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.308+0000 7fda14088740 1 -- 172.21.15.148:0/3655824537 --> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5579329cdd70 con 0x557932aeecf0 2024-09-19T07:11:50.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.308+0000 7fda0b7fe640 1 --2- 172.21.15.148:0/3655824537 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x557932aeecf0 0x557932af1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:50.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.308+0000 7fd9eaffd640 10 client.25045 ms_handle_connect on v2:172.21.15.179:6836/3827671241 2024-09-19T07:11:50.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.308+0000 7fda0b7fe640 1 --2- 172.21.15.148:0/3655824537 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x557932aeecf0 0x557932af1110 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=149f019c53c9e38b server_cookie=8acd29301b63d1cb in_seq=0 out_seq=0 2024-09-19T07:11:50.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.309+0000 7fd9eaffd640 1 -- 172.21.15.148:0/3655824537 <== mds.2 v2:172.21.15.179:6836/3827671241 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5579329cdd70 con 0x557932aeecf0 2024-09-19T07:11:50.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.309+0000 7fd9eaffd640 10 client.25045 handle_command_reply: tid=0 2024-09-19T07:11:50.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.309+0000 7fda14088740 1 client.25045 shutdown 2024-09-19T07:11:50.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.309+0000 7fda14088740 1 -- 172.21.15.148:0/3655824537 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557932a6f780 msgr2=0x557932a7c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:50.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.309+0000 7fda14088740 1 --2- 172.21.15.148:0/3655824537 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557932a6f780 0x557932a7c3f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fda04007140 tx=0x7fda04022b70 comp rx=0 tx=0).stop 2024-09-19T07:11:50.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.309+0000 7fda14088740 1 -- 172.21.15.148:0/3655824537 shutdown_connections 2024-09-19T07:11:50.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.309+0000 7fda14088740 1 --2- 172.21.15.148:0/3655824537 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x557932aeecf0 0x557932af1110 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:50.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.309+0000 7fda14088740 1 --2- 172.21.15.148:0/3655824537 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557932a6f780 0x557932a7c3f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:50.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.309+0000 7fda14088740 1 --2- 172.21.15.148:0/3655824537 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557932a61b40 0x557932a7be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:50.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.309+0000 7fda14088740 1 --2- 172.21.15.148:0/3655824537 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557932a605d0 0x557932a80ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:50.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.309+0000 7fd9eaffd640 0 client.25045 ms_handle_reset on v2:172.21.15.179:6836/3827671241 2024-09-19T07:11:50.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.309+0000 7fda14088740 1 -- 172.21.15.148:0/3655824537 >> 172.21.15.148:0/3655824537 conn(0x557932a29310 msgr2=0x557932a62930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:50.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.309+0000 7fda14088740 1 -- 172.21.15.148:0/3655824537 shutdown_connections 2024-09-19T07:11:50.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.309+0000 7fda14088740 1 -- 172.21.15.148:0/3655824537 wait complete. 2024-09-19T07:11:50.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.309+0000 7fda14088740 20 client.25045 trim_cache size 0 max 16384 2024-09-19T07:11:50.318 INFO:teuthology.orchestra.run.smithi148.stdout:[] 2024-09-19T07:11:50.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.310+0000 7fda11caf640 1 -- 172.21.15.148:0/235307000 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fd9f40a3440 msgr2=0x7fd9f40a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:50.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.310+0000 7fda11caf640 1 --2- 172.21.15.148:0/235307000 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fd9f40a3440 0x7fd9f40a5900 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fda0400aa20 tx=0x7fda04004b50 comp rx=0 tx=0).stop 2024-09-19T07:11:50.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.310+0000 7fda11caf640 1 -- 172.21.15.148:0/235307000 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda0c102d30 msgr2=0x7fda0c198620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:50.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.310+0000 7fda11caf640 1 --2- 172.21.15.148:0/235307000 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda0c102d30 0x7fda0c198620 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc009230 tx=0x7fd9fc004270 comp rx=0 tx=0).stop 2024-09-19T07:11:50.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.310+0000 7fda11caf640 1 -- 172.21.15.148:0/235307000 shutdown_connections 2024-09-19T07:11:50.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.310+0000 7fda11caf640 1 --2- 172.21.15.148:0/235307000 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fd9f40a3440 0x7fd9f40a5900 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:50.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.310+0000 7fda11caf640 1 --2- 172.21.15.148:0/235307000 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda0c1082a0 0x7fda0c19cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:50.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.310+0000 7fda11caf640 1 --2- 172.21.15.148:0/235307000 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda0c1036e0 0x7fda0c198b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:50.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.311+0000 7fda11caf640 1 --2- 172.21.15.148:0/235307000 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda0c102d30 0x7fda0c198620 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:50.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.311+0000 7fda11caf640 1 -- 172.21.15.148:0/235307000 >> 172.21.15.148:0/235307000 conn(0x7fda0c0fc7d0 msgr2=0x7fda0c105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:50.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.311+0000 7fda11caf640 1 -- 172.21.15.148:0/235307000 shutdown_connections 2024-09-19T07:11:50.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:50.311+0000 7fda11caf640 1 -- 172.21.15.148:0/235307000 wait complete. 2024-09-19T07:11:50.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:50 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/2626015001' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:11:50.536 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:11:50.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:50 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/2626015001' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:11:50.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:50 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/2626015001' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:11:51.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:51 smithi179 ceph-mon[35716]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-19T07:11:51.586 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:51 smithi148 ceph-mon[31180]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-19T07:11:51.640 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:51 smithi165 ceph-mon[35326]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-19T07:11:52.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:52 smithi179 ceph-mon[35716]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-19T07:11:52.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:52 smithi148 ceph-mon[31180]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-19T07:11:52.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:52 smithi165 ceph-mon[35326]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-19T07:11:53.989 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.986+0000 7f3dc75e4640 1 -- 172.21.15.148:0/1094486986 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3dc0101ad0 msgr2=0x7f3dc0101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:53.989 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.986+0000 7f3dc75e4640 1 --2- 172.21.15.148:0/1094486986 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3dc0101ad0 0x7f3dc0101f30 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f3db0009930 tx=0x7f3db002a420 comp rx=0 tx=0).stop 2024-09-19T07:11:53.989 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.986+0000 7f3dc75e4640 1 -- 172.21.15.148:0/1094486986 shutdown_connections 2024-09-19T07:11:53.989 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.986+0000 7f3dc75e4640 1 --2- 172.21.15.148:0/1094486986 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dc0102470 0x7f3dc010e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:53.989 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.986+0000 7f3dc75e4640 1 --2- 172.21.15.148:0/1094486986 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3dc0101ad0 0x7f3dc0101f30 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:53.989 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.986+0000 7f3dc75e4640 1 --2- 172.21.15.148:0/1094486986 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3dc0107b70 0x7f3dc0107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:53.989 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.986+0000 7f3dc75e4640 1 -- 172.21.15.148:0/1094486986 >> 172.21.15.148:0/1094486986 conn(0x7f3dc00fd7d0 msgr2=0x7f3dc00ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:53.989 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.986+0000 7f3dc75e4640 1 -- 172.21.15.148:0/1094486986 shutdown_connections 2024-09-19T07:11:53.989 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.986+0000 7f3dc75e4640 1 -- 172.21.15.148:0/1094486986 wait complete. 2024-09-19T07:11:53.989 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.986+0000 7f3dc75e4640 1 Processor -- start 2024-09-19T07:11:53.990 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.987+0000 7f3dc75e4640 1 -- start start 2024-09-19T07:11:53.990 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.987+0000 7f3dc75e4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3dc0101ad0 0x7f3dc01983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:53.990 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.987+0000 7f3dc75e4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dc0102470 0x7f3dc01988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:53.990 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.987+0000 7f3dc75e4640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3dc0107b70 0x7f3dc019cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:53.990 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.987+0000 7f3dc75e4640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc0111ee0 con 0x7f3dc0101ad0 2024-09-19T07:11:53.990 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.987+0000 7f3dc75e4640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc0111d60 con 0x7f3dc0107b70 2024-09-19T07:11:53.990 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.987+0000 7f3dc75e4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc0112060 con 0x7f3dc0102470 2024-09-19T07:11:53.990 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.987+0000 7f3dc5380640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3dc0101ad0 0x7f3dc01983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:53.990 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.987+0000 7f3dc5380640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3dc0101ad0 0x7f3dc01983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48672/0 (socket says 172.21.15.148:48672) 2024-09-19T07:11:53.990 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.987+0000 7f3dc5380640 1 -- 172.21.15.148:0/3428542776 learned_addr learned my addr 172.21.15.148:0/3428542776 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:53.990 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.987+0000 7f3dc5b81640 1 --2- 172.21.15.148:0/3428542776 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3dc0107b70 0x7f3dc019cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:53.990 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.987+0000 7f3dc4b7f640 1 --2- 172.21.15.148:0/3428542776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dc0102470 0x7f3dc01988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:53.990 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.987+0000 7f3dc5380640 1 -- 172.21.15.148:0/3428542776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dc0102470 msgr2=0x7f3dc01988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:53.990 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.987+0000 7f3dc5380640 1 --2- 172.21.15.148:0/3428542776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dc0102470 0x7f3dc01988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:53.991 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.987+0000 7f3dc5380640 1 -- 172.21.15.148:0/3428542776 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3dc0107b70 msgr2=0x7f3dc019cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:53.991 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.987+0000 7f3dc5380640 1 --2- 172.21.15.148:0/3428542776 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3dc0107b70 0x7f3dc019cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:53.991 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.987+0000 7f3dc5380640 1 -- 172.21.15.148:0/3428542776 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dc019d3a0 con 0x7f3dc0101ad0 2024-09-19T07:11:53.991 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.987+0000 7f3dc5380640 1 --2- 172.21.15.148:0/3428542776 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3dc0101ad0 0x7f3dc01983b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc00e9f0 tx=0x7f3dbc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:53.991 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.987+0000 7f3db67fc640 1 -- 172.21.15.148:0/3428542776 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc00cd80 con 0x7f3dc0101ad0 2024-09-19T07:11:53.991 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.987+0000 7f3dc75e4640 1 -- 172.21.15.148:0/3428542776 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dc019d690 con 0x7f3dc0101ad0 2024-09-19T07:11:53.991 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.987+0000 7f3db67fc640 1 -- 172.21.15.148:0/3428542776 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3dbc010910 con 0x7f3dc0101ad0 2024-09-19T07:11:53.991 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.988+0000 7f3db67fc640 1 -- 172.21.15.148:0/3428542776 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc0188f0 con 0x7f3dc0101ad0 2024-09-19T07:11:53.991 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.988+0000 7f3dc75e4640 1 -- 172.21.15.148:0/3428542776 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dc01a4f20 con 0x7f3dc0101ad0 2024-09-19T07:11:53.994 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.990+0000 7f3db67fc640 1 -- 172.21.15.148:0/3428542776 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f3dbc010ac0 con 0x7f3dc0101ad0 2024-09-19T07:11:53.994 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.991+0000 7f3dca455740 1 Processor -- start 2024-09-19T07:11:53.994 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.991+0000 7f3dca455740 1 -- start start 2024-09-19T07:11:53.994 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.991+0000 7f3dca455740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55643c885af0 0x55643c885ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:53.994 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.991+0000 7f3db67fc640 1 --2- 172.21.15.148:0/3428542776 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f3dac0a3500 0x7f3dac0a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:53.994 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.991+0000 7f3dca455740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55643c886410 0x55643c890770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:53.994 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.991+0000 7f3dca455740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55643c890cb0 0x55643c8930a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:53.994 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.991+0000 7f3dca455740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55643c7ea2f0 con 0x55643c886410 2024-09-19T07:11:53.994 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.991+0000 7f3dca455740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55643c792270 con 0x55643c885af0 2024-09-19T07:11:53.994 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.991+0000 7f3dca455740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55643c7e62b0 con 0x55643c890cb0 2024-09-19T07:11:53.994 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.991+0000 7f3dc4b7f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55643c886410 0x55643c890770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:53.995 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.991+0000 7f3dc5380640 1 --2- 172.21.15.148:0/3428542776 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f3dac0a3500 0x7f3dac0a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:53.995 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.991+0000 7f3dc4b7f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55643c886410 0x55643c890770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48682/0 (socket says 172.21.15.148:48682) 2024-09-19T07:11:53.995 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.991+0000 7f3dc4b7f640 1 -- 172.21.15.148:0/411114961 learned_addr learned my addr 172.21.15.148:0/411114961 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:53.995 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.991+0000 7f3db67fc640 1 -- 172.21.15.148:0/3428542776 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f3dbc0d0350 con 0x7f3dc0101ad0 2024-09-19T07:11:53.995 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.991+0000 7f3dc5b81640 1 --2- 172.21.15.148:0/411114961 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55643c890cb0 0x55643c8930a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:53.995 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.991+0000 7f3dc5b81640 1 --2- 172.21.15.148:0/411114961 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55643c885af0 0x55643c885ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:53.995 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.991+0000 7f3dc4b7f640 1 -- 172.21.15.148:0/411114961 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55643c890cb0 msgr2=0x55643c8930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:53.995 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.991+0000 7f3dc4b7f640 1 --2- 172.21.15.148:0/411114961 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55643c890cb0 0x55643c8930a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:53.995 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.992+0000 7f3dc4b7f640 1 -- 172.21.15.148:0/411114961 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55643c885af0 msgr2=0x55643c885ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:53.995 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.992+0000 7f3dc4b7f640 1 --2- 172.21.15.148:0/411114961 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55643c885af0 0x55643c885ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:53.995 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.992+0000 7f3dc4b7f640 1 -- 172.21.15.148:0/411114961 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55643c791340 con 0x55643c886410 2024-09-19T07:11:53.995 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.992+0000 7f3dc5b81640 1 --2- 172.21.15.148:0/411114961 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55643c885af0 0x55643c885ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:11:53.995 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.992+0000 7f3dc4b7f640 1 --2- 172.21.15.148:0/411114961 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55643c886410 0x55643c890770 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f3db0009930 tx=0x7f3db0032c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecd0f20ce04663cf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:53.996 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.992+0000 7f3dc5380640 1 --2- 172.21.15.148:0/3428542776 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f3dac0a3500 0x7f3dac0a59c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc0cda50 tx=0x7f3dbc098040 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:53.996 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.992+0000 7f3dab7fe640 1 -- 172.21.15.148:0/411114961 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db0035050 con 0x55643c886410 2024-09-19T07:11:53.996 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.992+0000 7f3dab7fe640 1 -- 172.21.15.148:0/411114961 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3db0032e20 con 0x55643c886410 2024-09-19T07:11:53.996 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.992+0000 7f3dab7fe640 1 -- 172.21.15.148:0/411114961 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db0005650 con 0x55643c886410 2024-09-19T07:11:53.996 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.993+0000 7f3dca455740 1 -- 172.21.15.148:0/411114961 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55643c886410 msgr2=0x55643c890770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:53.996 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.993+0000 7f3dca455740 1 --2- 172.21.15.148:0/411114961 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55643c886410 0x55643c890770 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f3db0009930 tx=0x7f3db0032c30 comp rx=0 tx=0).stop 2024-09-19T07:11:53.996 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.993+0000 7f3dca455740 1 -- 172.21.15.148:0/411114961 shutdown_connections 2024-09-19T07:11:53.996 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.993+0000 7f3dca455740 1 --2- 172.21.15.148:0/411114961 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55643c890cb0 0x55643c8930a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:53.996 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.993+0000 7f3dca455740 1 --2- 172.21.15.148:0/411114961 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55643c886410 0x55643c890770 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:53.996 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.993+0000 7f3dca455740 1 --2- 172.21.15.148:0/411114961 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55643c885af0 0x55643c885ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:53.996 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.993+0000 7f3dca455740 1 -- 172.21.15.148:0/411114961 >> 172.21.15.148:0/411114961 conn(0x55643c882060 msgr2=0x55643c882440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:53.996 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.993+0000 7f3dca455740 1 -- 172.21.15.148:0/411114961 shutdown_connections 2024-09-19T07:11:53.996 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.993+0000 7f3dca455740 1 -- 172.21.15.148:0/411114961 wait complete. 2024-09-19T07:11:53.997 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.993+0000 7f3dca455740 1 -- start start 2024-09-19T07:11:53.997 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.993+0000 7f3dca455740 1 Processor -- start 2024-09-19T07:11:54.000 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.994+0000 7f3dca455740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55643c885af0 0x55643c88db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:54.000 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.994+0000 7f3dca455740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55643c886410 0x55643c88e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:54.000 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.994+0000 7f3dca455740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55643c890cb0 0x55643c88e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:54.000 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.994+0000 7f3dca455740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55643c893880 con 0x55643c885af0 2024-09-19T07:11:54.001 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.994+0000 7f3dca455740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55643c773290 con 0x55643c890cb0 2024-09-19T07:11:54.001 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.994+0000 7f3dca455740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55643c893a00 con 0x55643c886410 2024-09-19T07:11:54.001 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.994+0000 7f3dc5b81640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55643c885af0 0x55643c88db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:54.001 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.994+0000 7f3dc4b7f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55643c886410 0x55643c88e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:54.001 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.994+0000 7f3dca455740 10 client.0 _ll_register_callbacks cb 0x55643c7a4140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:11:54.001 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.994+0000 7f3dc4b7f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55643c886410 0x55643c88e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:35756/0 (socket says 172.21.15.148:35756) 2024-09-19T07:11:54.001 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.994+0000 7f3dc4b7f640 1 -- 172.21.15.148:0/1595009844 learned_addr learned my addr 172.21.15.148:0/1595009844 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:54.001 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.994+0000 7f3dc5b81640 1 --2- 172.21.15.148:0/1595009844 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55643c890cb0 0x55643c88e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:54.001 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.994+0000 7f3dc4b7f640 1 -- 172.21.15.148:0/1595009844 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55643c890cb0 msgr2=0x55643c88e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:54.001 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.994+0000 7f3dc4b7f640 1 --2- 172.21.15.148:0/1595009844 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55643c890cb0 0x55643c88e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.001 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.994+0000 7f3dc4b7f640 1 -- 172.21.15.148:0/1595009844 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55643c885af0 msgr2=0x55643c88db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:54.001 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.994+0000 7f3dc4b7f640 1 --2- 172.21.15.148:0/1595009844 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55643c885af0 0x55643c88db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.001 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.994+0000 7f3dc4b7f640 1 -- 172.21.15.148:0/1595009844 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55643c4fd210 con 0x55643c886410 2024-09-19T07:11:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.994+0000 7f3dc5b81640 1 --2- 172.21.15.148:0/1595009844 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55643c885af0 0x55643c88db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:11:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.995+0000 7f3dc4b7f640 1 --2- 172.21.15.148:0/1595009844 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55643c886410 0x55643c88e0a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3db00096c0 tx=0x7f3db0031930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97aa42f4f77d20ef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.995+0000 7f3da8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-19T07:11:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.995+0000 7f3da8ff9640 1 -- 172.21.15.148:0/1595009844 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db0004450 con 0x55643c886410 2024-09-19T07:11:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.995+0000 7f3dca455740 1 -- 172.21.15.148:0/1595009844 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3db0032e20 con 0x55643c886410 2024-09-19T07:11:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.995+0000 7f3da8ff9640 1 -- 172.21.15.148:0/1595009844 <== mon.1 v2:172.21.15.179:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f3db003c750 con 0x55643c886410 2024-09-19T07:11:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.995+0000 7f3da8ff9640 1 -- 172.21.15.148:0/1595009844 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3db0035020 con 0x55643c886410 2024-09-19T07:11:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.995+0000 7f3dca455740 10 client.25060 fetch_fsmap learned FSMap version 25 2024-09-19T07:11:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.995+0000 7f3dca455740 1 -- 172.21.15.148:0/1595009844 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55643c5c9620 con 0x55643c886410 2024-09-19T07:11:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.995+0000 7f3da8ff9640 1 -- 172.21.15.148:0/1595009844 <== mon.1 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3db0032e20 con 0x55643c886410 2024-09-19T07:11:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.995+0000 7f3da8ff9640 1 -- 172.21.15.148:0/1595009844 <== mon.1 v2:172.21.15.179:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3db0003b80 con 0x55643c886410 2024-09-19T07:11:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.995+0000 7f3dca455740 10 client.25060 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:11:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.995+0000 7f3dca455740 10 client.25060 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:11:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.995+0000 7f3dca455740 20 client.25060 populate_metadata read hostname 'smithi148' 2024-09-19T07:11:54.003 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.996+0000 7f3dca455740 1 --2- 172.21.15.148:0/1595009844 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55643c8a0a80 0x55643c8a2e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:54.003 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.996+0000 7f3dca455740 4 client.25060 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:11:54.003 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.996+0000 7f3dca455740 1 -- 172.21.15.148:0/1595009844 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55643c7f7a20 con 0x55643c8a0a80 2024-09-19T07:11:54.003 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.996+0000 7f3dc5b81640 1 --2- 172.21.15.148:0/1595009844 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55643c8a0a80 0x55643c8a2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:54.003 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.996+0000 7f3da8ff9640 10 client.25060 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:11:54.003 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.996+0000 7f3dc5b81640 1 --2- 172.21.15.148:0/1595009844 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55643c8a0a80 0x55643c8a2e70 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9996ddce191ef0a2 server_cookie=66f4d57c8c061d57 in_seq=0 out_seq=0 2024-09-19T07:11:54.003 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.997+0000 7f3da8ff9640 1 -- 172.21.15.148:0/1595009844 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55643c7f7a20 con 0x55643c8a0a80 2024-09-19T07:11:54.003 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.997+0000 7f3da8ff9640 10 client.25060 handle_command_reply: tid=0 2024-09-19T07:11:54.003 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.997+0000 7f3dca455740 1 client.25060 shutdown 2024-09-19T07:11:54.003 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.997+0000 7f3dca455740 1 -- 172.21.15.148:0/1595009844 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55643c886410 msgr2=0x55643c88e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:54.003 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.997+0000 7f3dca455740 1 --2- 172.21.15.148:0/1595009844 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55643c886410 0x55643c88e0a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3db00096c0 tx=0x7f3db0031930 comp rx=0 tx=0).stop 2024-09-19T07:11:54.003 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.997+0000 7f3dca455740 1 -- 172.21.15.148:0/1595009844 shutdown_connections 2024-09-19T07:11:54.004 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.997+0000 7f3dca455740 1 --2- 172.21.15.148:0/1595009844 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55643c8a0a80 0x55643c8a2e70 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.004 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.997+0000 7f3dca455740 1 --2- 172.21.15.148:0/1595009844 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55643c890cb0 0x55643c88e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.004 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.997+0000 7f3dca455740 1 --2- 172.21.15.148:0/1595009844 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55643c886410 0x55643c88e0a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.004 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.997+0000 7f3dca455740 1 --2- 172.21.15.148:0/1595009844 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55643c885af0 0x55643c88db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.004 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.997+0000 7f3da8ff9640 0 client.25060 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:11:54.004 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.997+0000 7f3dca455740 1 -- 172.21.15.148:0/1595009844 >> 172.21.15.148:0/1595009844 conn(0x55643c882060 msgr2=0x55643c887dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:54.004 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.997+0000 7f3dca455740 1 -- 172.21.15.148:0/1595009844 shutdown_connections 2024-09-19T07:11:54.004 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.997+0000 7f3dca455740 1 -- 172.21.15.148:0/1595009844 wait complete. 2024-09-19T07:11:54.004 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:53.997+0000 7f3dca455740 20 client.25060 trim_cache size 0 max 16384 2024-09-19T07:11:54.014 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.012+0000 7f3dca455740 1 Processor -- start 2024-09-19T07:11:54.014 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.012+0000 7f3dca455740 1 -- start start 2024-09-19T07:11:54.014 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.012+0000 7f3dca455740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55643c885af0 0x55643c88e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:54.014 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.012+0000 7f3dca455740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55643c886410 0x55643c8a84d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:54.014 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.012+0000 7f3dca455740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55643c890cb0 0x55643c8a8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:54.014 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.012+0000 7f3dca455740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc01adf30 con 0x55643c885af0 2024-09-19T07:11:54.014 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.012+0000 7f3dca455740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc01ab800 con 0x55643c886410 2024-09-19T07:11:54.014 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.012+0000 7f3dca455740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc01a9650 con 0x55643c890cb0 2024-09-19T07:11:54.014 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.012+0000 7f3dc5b81640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55643c885af0 0x55643c88e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:54.014 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.012+0000 7f3dc5b81640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55643c885af0 0x55643c88e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48698/0 (socket says 172.21.15.148:48698) 2024-09-19T07:11:54.014 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.012+0000 7f3dc5b81640 1 -- 172.21.15.148:0/3224221588 learned_addr learned my addr 172.21.15.148:0/3224221588 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:54.015 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.012+0000 7f3dc4b7f640 1 --2- 172.21.15.148:0/3224221588 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55643c886410 0x55643c8a84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:54.015 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.012+0000 7f3dc5b81640 1 --2- 172.21.15.148:0/3224221588 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55643c890cb0 0x55643c8a8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:54.015 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.012+0000 7f3dc5b81640 1 -- 172.21.15.148:0/3224221588 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55643c890cb0 msgr2=0x55643c8a8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:54.015 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.012+0000 7f3dc5b81640 1 --2- 172.21.15.148:0/3224221588 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55643c890cb0 0x55643c8a8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.015 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.012+0000 7f3dc5b81640 1 -- 172.21.15.148:0/3224221588 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55643c886410 msgr2=0x55643c8a84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:54.015 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.012+0000 7f3dc5b81640 1 --2- 172.21.15.148:0/3224221588 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55643c886410 0x55643c8a84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.015 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.012+0000 7f3dc5b81640 1 -- 172.21.15.148:0/3224221588 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55643c881b00 con 0x55643c885af0 2024-09-19T07:11:54.015 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.013+0000 7f3dc4b7f640 1 --2- 172.21.15.148:0/3224221588 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55643c886410 0x55643c8a84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:11:54.015 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.013+0000 7f3dc5b81640 1 --2- 172.21.15.148:0/3224221588 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55643c885af0 0x55643c88e410 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f3db800e610 tx=0x7f3db8005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc672e75429d6381 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:54.015 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.013+0000 7f3daaffd640 1 -- 172.21.15.148:0/3224221588 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db8026040 con 0x55643c885af0 2024-09-19T07:11:54.015 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.013+0000 7f3daaffd640 1 -- 172.21.15.148:0/3224221588 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3db8003970 con 0x55643c885af0 2024-09-19T07:11:54.015 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.013+0000 7f3daaffd640 1 -- 172.21.15.148:0/3224221588 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db8022b50 con 0x55643c885af0 2024-09-19T07:11:54.019 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.014+0000 7f3dca455740 1 -- 172.21.15.148:0/3224221588 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55643c885af0 msgr2=0x55643c88e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:54.019 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.014+0000 7f3dca455740 1 --2- 172.21.15.148:0/3224221588 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55643c885af0 0x55643c88e410 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f3db800e610 tx=0x7f3db8005bd0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.019 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.014+0000 7f3dca455740 1 -- 172.21.15.148:0/3224221588 shutdown_connections 2024-09-19T07:11:54.019 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.014+0000 7f3dca455740 1 --2- 172.21.15.148:0/3224221588 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55643c890cb0 0x55643c8a8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.019 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.014+0000 7f3dca455740 1 --2- 172.21.15.148:0/3224221588 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55643c886410 0x55643c8a84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.019 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.014+0000 7f3dca455740 1 --2- 172.21.15.148:0/3224221588 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55643c885af0 0x55643c88e410 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.019 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.014+0000 7f3dca455740 1 -- 172.21.15.148:0/3224221588 >> 172.21.15.148:0/3224221588 conn(0x55643c882060 msgr2=0x55643c88fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:54.019 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.014+0000 7f3dca455740 1 -- 172.21.15.148:0/3224221588 shutdown_connections 2024-09-19T07:11:54.019 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.014+0000 7f3dca455740 1 -- 172.21.15.148:0/3224221588 wait complete. 2024-09-19T07:11:54.019 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.014+0000 7f3dca455740 1 -- start start 2024-09-19T07:11:54.019 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.014+0000 7f3dca455740 1 Processor -- start 2024-09-19T07:11:54.020 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.015+0000 7f3dca455740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55643c885af0 0x55643c899040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:54.020 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.015+0000 7f3dca455740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55643c886410 0x55643c899580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:54.020 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.015+0000 7f3dca455740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55643c890cb0 0x55643c88a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:54.020 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.015+0000 7f3dca455740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc01a9cc0 con 0x55643c890cb0 2024-09-19T07:11:54.020 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.015+0000 7f3dca455740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc01ab130 con 0x55643c885af0 2024-09-19T07:11:54.020 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.015+0000 7f3dca455740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc01aa390 con 0x55643c886410 2024-09-19T07:11:54.020 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.015+0000 7f3dca455740 10 client.0 _ll_register_callbacks cb 0x7f3db0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:11:54.020 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.015+0000 7f3dc5b81640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55643c890cb0 0x55643c88a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:54.020 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.015+0000 7f3dc5b81640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55643c890cb0 0x55643c88a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48708/0 (socket says 172.21.15.148:48708) 2024-09-19T07:11:54.020 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.015+0000 7f3dc5b81640 1 -- 172.21.15.148:0/3354596480 learned_addr learned my addr 172.21.15.148:0/3354596480 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:54.020 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.015+0000 7f3dc4b7f640 1 --2- 172.21.15.148:0/3354596480 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55643c886410 0x55643c899580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:54.020 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.015+0000 7f3dc5b81640 1 --2- 172.21.15.148:0/3354596480 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55643c885af0 0x55643c899040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:54.020 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.015+0000 7f3dc5b81640 1 -- 172.21.15.148:0/3354596480 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55643c886410 msgr2=0x55643c899580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:54.021 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.015+0000 7f3dc5b81640 1 --2- 172.21.15.148:0/3354596480 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55643c886410 0x55643c899580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.021 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.015+0000 7f3dc5b81640 1 -- 172.21.15.148:0/3354596480 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55643c885af0 msgr2=0x55643c899040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:54.021 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.015+0000 7f3dc5b81640 1 --2- 172.21.15.148:0/3354596480 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55643c885af0 0x55643c899040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.021 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.015+0000 7f3dc5b81640 1 -- 172.21.15.148:0/3354596480 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55643c88af00 con 0x55643c890cb0 2024-09-19T07:11:54.021 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.015+0000 7f3dc4b7f640 1 --2- 172.21.15.148:0/3354596480 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55643c886410 0x55643c899580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:11:54.021 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.015+0000 7f3dc5b81640 1 --2- 172.21.15.148:0/3354596480 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55643c890cb0 0x55643c88a6d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f3db800afd0 tx=0x7f3db8022730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cbf9b7c5bf613d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:54.021 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.015+0000 7f3da8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:11:54.021 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.015+0000 7f3da8ff9640 1 -- 172.21.15.148:0/3354596480 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db8004a40 con 0x55643c890cb0 2024-09-19T07:11:54.021 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.015+0000 7f3da8ff9640 1 -- 172.21.15.148:0/3354596480 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f3db8004be0 con 0x55643c890cb0 2024-09-19T07:11:54.021 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.016+0000 7f3dca455740 1 -- 172.21.15.148:0/3354596480 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3db8003970 con 0x55643c890cb0 2024-09-19T07:11:54.021 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.016+0000 7f3da8ff9640 1 -- 172.21.15.148:0/3354596480 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3db8004de0 con 0x55643c890cb0 2024-09-19T07:11:54.021 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.016+0000 7f3dca455740 10 client.15531 fetch_fsmap learned FSMap version 25 2024-09-19T07:11:54.021 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.016+0000 7f3dca455740 1 -- 172.21.15.148:0/3354596480 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55643c90b110 con 0x55643c890cb0 2024-09-19T07:11:54.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.016+0000 7f3da8ff9640 1 -- 172.21.15.148:0/3354596480 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3db8003970 con 0x55643c890cb0 2024-09-19T07:11:54.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.016+0000 7f3da8ff9640 1 -- 172.21.15.148:0/3354596480 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3db80055e0 con 0x55643c890cb0 2024-09-19T07:11:54.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.016+0000 7f3dca455740 10 client.15531 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:11:54.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.016+0000 7f3dca455740 10 client.15531 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:11:54.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.016+0000 7f3dca455740 20 client.15531 populate_metadata read hostname 'smithi148' 2024-09-19T07:11:54.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.016+0000 7f3dca455740 1 --2- 172.21.15.148:0/3354596480 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55643c90b740 0x55643c90db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:54.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.016+0000 7f3dca455740 4 client.15531 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:11:54.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.016+0000 7f3dca455740 1 -- 172.21.15.148:0/3354596480 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55643c7f1d70 con 0x55643c90b740 2024-09-19T07:11:54.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.016+0000 7f3dc4b7f640 1 --2- 172.21.15.148:0/3354596480 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55643c90b740 0x55643c90db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:54.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.017+0000 7f3da8ff9640 10 client.15531 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:11:54.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.017+0000 7f3dc4b7f640 1 --2- 172.21.15.148:0/3354596480 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55643c90b740 0x55643c90db60 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27c330c360608d73 server_cookie=908ea9d2ca266fd1 in_seq=0 out_seq=0 2024-09-19T07:11:54.026 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.024+0000 7f3da8ff9640 1 -- 172.21.15.148:0/3354596480 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55643c7f1d70 con 0x55643c90b740 2024-09-19T07:11:54.026 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.024+0000 7f3da8ff9640 10 client.15531 handle_command_reply: tid=0 2024-09-19T07:11:54.026 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.024+0000 7f3dca455740 1 client.15531 shutdown 2024-09-19T07:11:54.026 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.024+0000 7f3dca455740 1 -- 172.21.15.148:0/3354596480 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55643c890cb0 msgr2=0x55643c88a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:54.026 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.024+0000 7f3dca455740 1 --2- 172.21.15.148:0/3354596480 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55643c890cb0 0x55643c88a6d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f3db800afd0 tx=0x7f3db8022730 comp rx=0 tx=0).stop 2024-09-19T07:11:54.026 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.024+0000 7f3dca455740 1 -- 172.21.15.148:0/3354596480 shutdown_connections 2024-09-19T07:11:54.026 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.024+0000 7f3dca455740 1 --2- 172.21.15.148:0/3354596480 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55643c90b740 0x55643c90db60 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.026 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.024+0000 7f3dca455740 1 --2- 172.21.15.148:0/3354596480 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55643c890cb0 0x55643c88a6d0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.026 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.024+0000 7f3dca455740 1 --2- 172.21.15.148:0/3354596480 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55643c886410 0x55643c899580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.026 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.024+0000 7f3dca455740 1 --2- 172.21.15.148:0/3354596480 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55643c885af0 0x55643c899040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.026 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.024+0000 7f3dca455740 1 -- 172.21.15.148:0/3354596480 >> 172.21.15.148:0/3354596480 conn(0x55643c882060 msgr2=0x55643c887d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:54.026 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.024+0000 7f3da8ff9640 0 client.15531 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:11:54.027 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.025+0000 7f3dca455740 1 -- 172.21.15.148:0/3354596480 shutdown_connections 2024-09-19T07:11:54.027 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.025+0000 7f3dca455740 1 -- 172.21.15.148:0/3354596480 wait complete. 2024-09-19T07:11:54.027 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.025+0000 7f3dca455740 20 client.15531 trim_cache size 0 max 16384 2024-09-19T07:11:54.027 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:11:54.027 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:11:54.027 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:11:54.027 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:11:54.028 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.025+0000 7f3dc75e4640 1 -- 172.21.15.148:0/3428542776 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f3dac0a3500 msgr2=0x7f3dac0a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:54.028 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.025+0000 7f3dc75e4640 1 --2- 172.21.15.148:0/3428542776 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f3dac0a3500 0x7f3dac0a59c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc0cda50 tx=0x7f3dbc098040 comp rx=0 tx=0).stop 2024-09-19T07:11:54.028 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.025+0000 7f3dc75e4640 1 -- 172.21.15.148:0/3428542776 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3dc0101ad0 msgr2=0x7f3dc01983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:54.028 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.025+0000 7f3dc75e4640 1 --2- 172.21.15.148:0/3428542776 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3dc0101ad0 0x7f3dc01983b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc00e9f0 tx=0x7f3dbc00eeb0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.028 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.025+0000 7f3dc75e4640 1 -- 172.21.15.148:0/3428542776 shutdown_connections 2024-09-19T07:11:54.029 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.025+0000 7f3dc75e4640 1 --2- 172.21.15.148:0/3428542776 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f3dac0a3500 0x7f3dac0a59c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.029 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.025+0000 7f3dc75e4640 1 --2- 172.21.15.148:0/3428542776 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3dc0107b70 0x7f3dc019cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.029 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.025+0000 7f3dc75e4640 1 --2- 172.21.15.148:0/3428542776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dc0102470 0x7f3dc01988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.029 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.025+0000 7f3dc75e4640 1 --2- 172.21.15.148:0/3428542776 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3dc0101ad0 0x7f3dc01983b0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.029 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.025+0000 7f3dc75e4640 1 -- 172.21.15.148:0/3428542776 >> 172.21.15.148:0/3428542776 conn(0x7f3dc00fd7d0 msgr2=0x7f3dc00fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:54.029 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.026+0000 7f3dc75e4640 1 -- 172.21.15.148:0/3428542776 shutdown_connections 2024-09-19T07:11:54.029 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:11:54.026+0000 7f3dc75e4640 1 -- 172.21.15.148:0/3428542776 wait complete. 2024-09-19T07:11:54.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.622+0000 7f983e080640 1 -- 172.21.15.148:0/2677027304 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9838101e10 msgr2=0x7f98381021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:54.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.622+0000 7f983e080640 1 --2- 172.21.15.148:0/2677027304 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9838101e10 0x7f98381021f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f9828009900 tx=0x7f982802a410 comp rx=0 tx=0).stop 2024-09-19T07:11:54.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.622+0000 7f983e080640 1 -- 172.21.15.148:0/2677027304 shutdown_connections 2024-09-19T07:11:54.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.622+0000 7f983e080640 1 --2- 172.21.15.148:0/2677027304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9838106f40 0x7f983810eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.622+0000 7f983e080640 1 --2- 172.21.15.148:0/2677027304 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f98381027c0 0x7f9838106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.622+0000 7f983e080640 1 --2- 172.21.15.148:0/2677027304 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9838101e10 0x7f98381021f0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.622+0000 7f983e080640 1 -- 172.21.15.148:0/2677027304 >> 172.21.15.148:0/2677027304 conn(0x7f98380fd8d0 msgr2=0x7f98380ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:54.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.622+0000 7f983e080640 1 -- 172.21.15.148:0/2677027304 shutdown_connections 2024-09-19T07:11:54.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.622+0000 7f983e080640 1 -- 172.21.15.148:0/2677027304 wait complete. 2024-09-19T07:11:54.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.623+0000 7f983e080640 1 Processor -- start 2024-09-19T07:11:54.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.623+0000 7f983e080640 1 -- start start 2024-09-19T07:11:54.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.623+0000 7f983e080640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9838101e10 0x7f98380744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:54.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.623+0000 7f983e080640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98381027c0 0x7f9838074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:54.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.623+0000 7f983e080640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9838106f40 0x7f9838074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:54.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.623+0000 7f983e080640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9838112040 con 0x7f9838106f40 2024-09-19T07:11:54.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.623+0000 7f983e080640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9838111ec0 con 0x7f9838101e10 2024-09-19T07:11:54.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.623+0000 7f983e080640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f98381121c0 con 0x7f98381027c0 2024-09-19T07:11:54.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.623+0000 7f9837fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9838106f40 0x7f9838074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:54.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.623+0000 7f9837fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9838106f40 0x7f9838074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48630/0 (socket says 172.21.15.148:48630) 2024-09-19T07:11:54.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.623+0000 7f9837fff640 1 -- 172.21.15.148:0/2186763807 learned_addr learned my addr 172.21.15.148:0/2186763807 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:54.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.623+0000 7f982ffff640 1 --2- 172.21.15.148:0/2186763807 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98381027c0 0x7f9838074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:54.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.623+0000 7f98377fe640 1 --2- 172.21.15.148:0/2186763807 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9838101e10 0x7f98380744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:54.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.623+0000 7f9837fff640 1 -- 172.21.15.148:0/2186763807 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98381027c0 msgr2=0x7f9838074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:54.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.623+0000 7f9837fff640 1 --2- 172.21.15.148:0/2186763807 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98381027c0 0x7f9838074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.623+0000 7f9837fff640 1 -- 172.21.15.148:0/2186763807 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9838101e10 msgr2=0x7f98380744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:54.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.623+0000 7f9837fff640 1 --2- 172.21.15.148:0/2186763807 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9838101e10 0x7f98380744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.623+0000 7f9837fff640 1 -- 172.21.15.148:0/2186763807 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98381a6a60 con 0x7f9838106f40 2024-09-19T07:11:54.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.623+0000 7f98377fe640 1 --2- 172.21.15.148:0/2186763807 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9838101e10 0x7f98380744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:11:54.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.624+0000 7f9837fff640 1 --2- 172.21.15.148:0/2186763807 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9838106f40 0x7f9838074f70 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f983000b970 tx=0x7f983000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:54.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.624+0000 7f98357fa640 1 -- 172.21.15.148:0/2186763807 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9830019070 con 0x7f9838106f40 2024-09-19T07:11:54.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.624+0000 7f983e080640 1 -- 172.21.15.148:0/2186763807 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98381a6d50 con 0x7f9838106f40 2024-09-19T07:11:54.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.624+0000 7f98357fa640 1 -- 172.21.15.148:0/2186763807 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9830014440 con 0x7f9838106f40 2024-09-19T07:11:54.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.624+0000 7f98357fa640 1 -- 172.21.15.148:0/2186763807 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98300075d0 con 0x7f9838106f40 2024-09-19T07:11:54.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.624+0000 7f983e080640 1 -- 172.21.15.148:0/2186763807 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98381a7240 con 0x7f9838106f40 2024-09-19T07:11:54.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.626+0000 7f98357fa640 1 -- 172.21.15.148:0/2186763807 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f983001c070 con 0x7f9838106f40 2024-09-19T07:11:54.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.627+0000 7f98357fa640 1 --2- 172.21.15.148:0/2186763807 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f98240a3440 0x7f98240a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:54.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.627+0000 7f98377fe640 1 --2- 172.21.15.148:0/2186763807 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f98240a3440 0x7f98240a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:54.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.627+0000 7f98357fa640 1 -- 172.21.15.148:0/2186763807 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f98300cf3e0 con 0x7f9838106f40 2024-09-19T07:11:54.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.627+0000 7f98377fe640 1 --2- 172.21.15.148:0/2186763807 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f98240a3440 0x7f98240a5900 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9828005ab0 tx=0x7f9828005a20 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:54.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.627+0000 7f9840459740 1 Processor -- start 2024-09-19T07:11:54.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.627+0000 7f9840459740 1 -- start start 2024-09-19T07:11:54.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.628+0000 7f9840459740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e7aa9ef760 0x55e7aa9efb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:54.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.628+0000 7f9840459740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7aa9f0080 0x55e7aa9fa400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:54.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.628+0000 7f9840459740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7aa9fa940 0x55e7aa9fcd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:54.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.628+0000 7f9840459740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55e7aa9552a0 con 0x55e7aa9fa940 2024-09-19T07:11:54.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.628+0000 7f9840459740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55e7aa8fcb10 con 0x55e7aa9f0080 2024-09-19T07:11:54.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.628+0000 7f9840459740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55e7aa951260 con 0x55e7aa9ef760 2024-09-19T07:11:54.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.628+0000 7f9837fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7aa9fa940 0x55e7aa9fcd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:54.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.628+0000 7f9837fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7aa9fa940 0x55e7aa9fcd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48644/0 (socket says 172.21.15.148:48644) 2024-09-19T07:11:54.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.628+0000 7f9837fff640 1 -- 172.21.15.148:0/2354090827 learned_addr learned my addr 172.21.15.148:0/2354090827 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:54.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.628+0000 7f982ffff640 1 --2- 172.21.15.148:0/2354090827 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7aa9f0080 0x55e7aa9fa400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:54.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.628+0000 7f98377fe640 1 --2- 172.21.15.148:0/2354090827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e7aa9ef760 0x55e7aa9efb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:54.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.628+0000 7f9837fff640 1 -- 172.21.15.148:0/2354090827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e7aa9ef760 msgr2=0x55e7aa9efb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:54.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.628+0000 7f9837fff640 1 --2- 172.21.15.148:0/2354090827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e7aa9ef760 0x55e7aa9efb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.628+0000 7f9837fff640 1 -- 172.21.15.148:0/2354090827 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7aa9f0080 msgr2=0x55e7aa9fa400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:54.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.628+0000 7f9837fff640 1 --2- 172.21.15.148:0/2354090827 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7aa9f0080 0x55e7aa9fa400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.628+0000 7f9837fff640 1 -- 172.21.15.148:0/2354090827 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7aa6c6b90 con 0x55e7aa9fa940 2024-09-19T07:11:54.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.628+0000 7f9837fff640 1 --2- 172.21.15.148:0/2354090827 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7aa9fa940 0x55e7aa9fcd30 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f9830098040 tx=0x7f983009bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=408cfacfcd19f74a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:54.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.628+0000 7f982dffb640 1 -- 172.21.15.148:0/2354090827 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98300a42e0 con 0x55e7aa9fa940 2024-09-19T07:11:54.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.629+0000 7f982dffb640 1 -- 172.21.15.148:0/2354090827 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9830099970 con 0x55e7aa9fa940 2024-09-19T07:11:54.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.629+0000 7f982dffb640 1 -- 172.21.15.148:0/2354090827 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98300ccd30 con 0x55e7aa9fa940 2024-09-19T07:11:54.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.629+0000 7f9840459740 1 -- 172.21.15.148:0/2354090827 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7aa9fa940 msgr2=0x55e7aa9fcd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:54.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.629+0000 7f9840459740 1 --2- 172.21.15.148:0/2354090827 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7aa9fa940 0x55e7aa9fcd30 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f9830098040 tx=0x7f983009bd70 comp rx=0 tx=0).stop 2024-09-19T07:11:54.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.629+0000 7f9840459740 1 -- 172.21.15.148:0/2354090827 shutdown_connections 2024-09-19T07:11:54.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.629+0000 7f9840459740 1 --2- 172.21.15.148:0/2354090827 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7aa9fa940 0x55e7aa9fcd30 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.629+0000 7f9840459740 1 --2- 172.21.15.148:0/2354090827 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7aa9f0080 0x55e7aa9fa400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.629+0000 7f9840459740 1 --2- 172.21.15.148:0/2354090827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e7aa9ef760 0x55e7aa9efb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.629+0000 7f9840459740 1 -- 172.21.15.148:0/2354090827 >> 172.21.15.148:0/2354090827 conn(0x55e7aa9ebcf0 msgr2=0x55e7aa9ec0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:54.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.629+0000 7f9840459740 1 -- 172.21.15.148:0/2354090827 shutdown_connections 2024-09-19T07:11:54.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.629+0000 7f9840459740 1 -- 172.21.15.148:0/2354090827 wait complete. 2024-09-19T07:11:54.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.630+0000 7f9840459740 1 -- start start 2024-09-19T07:11:54.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.630+0000 7f9840459740 1 Processor -- start 2024-09-19T07:11:54.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.630+0000 7f9840459740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7aa9ef760 0x55e7aa9f7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:54.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.630+0000 7f9840459740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e7aa9f0080 0x55e7aa9f7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:54.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.630+0000 7f9840459740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7aa9fa940 0x55e7aa9f82b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:54.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.630+0000 7f9840459740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55e7aa9fd510 con 0x55e7aa9ef760 2024-09-19T07:11:54.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.630+0000 7f9840459740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55e7aa8dd6e0 con 0x55e7aa9fa940 2024-09-19T07:11:54.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.630+0000 7f9840459740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55e7aa9fd690 con 0x55e7aa9f0080 2024-09-19T07:11:54.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.630+0000 7f9840459740 10 client.0 _ll_register_callbacks cb 0x55e7aa901a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:11:54.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.630+0000 7f98377fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7aa9ef760 0x55e7aa9f7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:54.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.630+0000 7f98377fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7aa9ef760 0x55e7aa9f7830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48654/0 (socket says 172.21.15.148:48654) 2024-09-19T07:11:54.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.630+0000 7f98377fe640 1 -- 172.21.15.148:0/1412355270 learned_addr learned my addr 172.21.15.148:0/1412355270 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:54.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.631+0000 7f9837fff640 1 --2- 172.21.15.148:0/1412355270 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7aa9fa940 0x55e7aa9f82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:54.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.631+0000 7f982ffff640 1 --2- 172.21.15.148:0/1412355270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e7aa9f0080 0x55e7aa9f7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:54.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.631+0000 7f98377fe640 1 -- 172.21.15.148:0/1412355270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e7aa9f0080 msgr2=0x55e7aa9f7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:54.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.631+0000 7f98377fe640 1 --2- 172.21.15.148:0/1412355270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e7aa9f0080 0x55e7aa9f7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.631+0000 7f98377fe640 1 -- 172.21.15.148:0/1412355270 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7aa9fa940 msgr2=0x55e7aa9f82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:54.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.631+0000 7f98377fe640 1 --2- 172.21.15.148:0/1412355270 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7aa9fa940 0x55e7aa9f82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.631+0000 7f98377fe640 1 -- 172.21.15.148:0/1412355270 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7aaa06a00 con 0x55e7aa9ef760 2024-09-19T07:11:54.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.631+0000 7f982ffff640 1 --2- 172.21.15.148:0/1412355270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e7aa9f0080 0x55e7aa9f7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:11:54.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.631+0000 7f98377fe640 1 --2- 172.21.15.148:0/1412355270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7aa9ef760 0x55e7aa9f7830 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f9828031a00 tx=0x7f9828009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97bea6c3ec74e7da server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:54.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.631+0000 7f9816ffd640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:11:54.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.631+0000 7f9816ffd640 1 -- 172.21.15.148:0/1412355270 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982804d070 con 0x55e7aa9ef760 2024-09-19T07:11:54.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.631+0000 7f9816ffd640 1 -- 172.21.15.148:0/1412355270 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f98280035f0 con 0x55e7aa9ef760 2024-09-19T07:11:54.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.631+0000 7f9840459740 1 -- 172.21.15.148:0/1412355270 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9830099970 con 0x55e7aa9ef760 2024-09-19T07:11:54.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.631+0000 7f9816ffd640 1 -- 172.21.15.148:0/1412355270 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9828059050 con 0x55e7aa9ef760 2024-09-19T07:11:54.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.631+0000 7f9840459740 10 client.15507 fetch_fsmap learned FSMap version 25 2024-09-19T07:11:54.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.632+0000 7f9840459740 1 -- 172.21.15.148:0/1412355270 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e7aaa09390 con 0x55e7aa9ef760 2024-09-19T07:11:54.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.632+0000 7f9816ffd640 1 -- 172.21.15.148:0/1412355270 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9830099970 con 0x55e7aa9ef760 2024-09-19T07:11:54.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.632+0000 7f9816ffd640 1 -- 172.21.15.148:0/1412355270 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f98280499f0 con 0x55e7aa9ef760 2024-09-19T07:11:54.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.632+0000 7f9840459740 10 client.15507 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:11:54.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.632+0000 7f9840459740 10 client.15507 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:11:54.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.632+0000 7f9840459740 20 client.15507 populate_metadata read hostname 'smithi148' 2024-09-19T07:11:54.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.632+0000 7f9840459740 1 --2- 172.21.15.148:0/1412355270 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e7aaa0a7f0 0x55e7aaa0ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:54.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.632+0000 7f9840459740 4 client.15507 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:11:54.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.632+0000 7f9840459740 1 -- 172.21.15.148:0/1412355270 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e7aa9629d0 con 0x55e7aaa0a7f0 2024-09-19T07:11:54.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.632+0000 7f982ffff640 1 --2- 172.21.15.148:0/1412355270 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e7aaa0a7f0 0x55e7aaa0ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:54.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.633+0000 7f9816ffd640 10 client.15507 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:11:54.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.633+0000 7f982ffff640 1 --2- 172.21.15.148:0/1412355270 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e7aaa0a7f0 0x55e7aaa0ccb0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf8d35fbc174b295 server_cookie=9264acd4558d14a2 in_seq=0 out_seq=0 2024-09-19T07:11:54.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.633+0000 7f9816ffd640 1 -- 172.21.15.148:0/1412355270 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e7aa9629d0 con 0x55e7aaa0a7f0 2024-09-19T07:11:54.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.633+0000 7f9816ffd640 10 client.15507 handle_command_reply: tid=0 2024-09-19T07:11:54.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.633+0000 7f9840459740 1 client.15507 shutdown 2024-09-19T07:11:54.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.634+0000 7f9840459740 1 -- 172.21.15.148:0/1412355270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7aa9ef760 msgr2=0x55e7aa9f7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:54.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.634+0000 7f9840459740 1 --2- 172.21.15.148:0/1412355270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7aa9ef760 0x55e7aa9f7830 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f9828031a00 tx=0x7f9828009260 comp rx=0 tx=0).stop 2024-09-19T07:11:54.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.634+0000 7f9840459740 1 -- 172.21.15.148:0/1412355270 shutdown_connections 2024-09-19T07:11:54.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.634+0000 7f9840459740 1 --2- 172.21.15.148:0/1412355270 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e7aaa0a7f0 0x55e7aaa0ccb0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.634+0000 7f9840459740 1 --2- 172.21.15.148:0/1412355270 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7aa9fa940 0x55e7aa9f82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.634+0000 7f9840459740 1 --2- 172.21.15.148:0/1412355270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e7aa9f0080 0x55e7aa9f7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.634+0000 7f9840459740 1 --2- 172.21.15.148:0/1412355270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7aa9ef760 0x55e7aa9f7830 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.634+0000 7f9816ffd640 0 client.15507 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:11:54.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.634+0000 7f9840459740 1 -- 172.21.15.148:0/1412355270 >> 172.21.15.148:0/1412355270 conn(0x55e7aa9ebcf0 msgr2=0x55e7aa9eae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:54.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.634+0000 7f9840459740 1 -- 172.21.15.148:0/1412355270 shutdown_connections 2024-09-19T07:11:54.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.634+0000 7f9840459740 1 -- 172.21.15.148:0/1412355270 wait complete. 2024-09-19T07:11:54.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.634+0000 7f9840459740 20 client.15507 trim_cache size 0 max 16384 2024-09-19T07:11:54.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.654+0000 7f9840459740 1 Processor -- start 2024-09-19T07:11:54.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.654+0000 7f9840459740 1 -- start start 2024-09-19T07:11:54.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.654+0000 7f9840459740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e7aa9ef760 0x55e7aaa12580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:54.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.654+0000 7f9840459740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7aa9f0080 0x55e7aaa12ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:54.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.654+0000 7f9840459740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7aa9fa940 0x55e7aa9f4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:54.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.654+0000 7f9840459740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f98381b24b0 con 0x55e7aa9f0080 2024-09-19T07:11:54.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.654+0000 7f9840459740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f98381afd80 con 0x55e7aa9fa940 2024-09-19T07:11:54.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.654+0000 7f9840459740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f98381adbb0 con 0x55e7aa9ef760 2024-09-19T07:11:54.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.654+0000 7f982ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7aa9f0080 0x55e7aaa12ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:54.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.655+0000 7f982ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7aa9f0080 0x55e7aaa12ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48658/0 (socket says 172.21.15.148:48658) 2024-09-19T07:11:54.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.655+0000 7f982ffff640 1 -- 172.21.15.148:0/614502294 learned_addr learned my addr 172.21.15.148:0/614502294 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:54.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.655+0000 7f9837fff640 1 --2- 172.21.15.148:0/614502294 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7aa9fa940 0x55e7aa9f4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:54.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.655+0000 7f98377fe640 1 --2- 172.21.15.148:0/614502294 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e7aa9ef760 0x55e7aaa12580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:54.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.655+0000 7f982ffff640 1 -- 172.21.15.148:0/614502294 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e7aa9ef760 msgr2=0x55e7aaa12580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:54.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.655+0000 7f982ffff640 1 --2- 172.21.15.148:0/614502294 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e7aa9ef760 0x55e7aaa12580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.655+0000 7f982ffff640 1 -- 172.21.15.148:0/614502294 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7aa9fa940 msgr2=0x55e7aa9f4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:54.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.655+0000 7f982ffff640 1 --2- 172.21.15.148:0/614502294 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7aa9fa940 0x55e7aa9f4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.655+0000 7f982ffff640 1 -- 172.21.15.148:0/614502294 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7aa9e7260 con 0x55e7aa9f0080 2024-09-19T07:11:54.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.655+0000 7f98377fe640 1 --2- 172.21.15.148:0/614502294 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e7aa9ef760 0x55e7aaa12580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:11:54.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.655+0000 7f982ffff640 1 --2- 172.21.15.148:0/614502294 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7aa9f0080 0x55e7aaa12ac0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f9820009330 tx=0x7f9820008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b5a5c1bc54268cf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:54.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.655+0000 7f982d7fa640 1 -- 172.21.15.148:0/614502294 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9820021070 con 0x55e7aa9f0080 2024-09-19T07:11:54.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.655+0000 7f982d7fa640 1 -- 172.21.15.148:0/614502294 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9820016e30 con 0x55e7aa9f0080 2024-09-19T07:11:54.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.655+0000 7f982d7fa640 1 -- 172.21.15.148:0/614502294 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9820015740 con 0x55e7aa9f0080 2024-09-19T07:11:54.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.656+0000 7f9840459740 1 -- 172.21.15.148:0/614502294 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7aa9f0080 msgr2=0x55e7aaa12ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:54.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.656+0000 7f9840459740 1 --2- 172.21.15.148:0/614502294 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7aa9f0080 0x55e7aaa12ac0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f9820009330 tx=0x7f9820008040 comp rx=0 tx=0).stop 2024-09-19T07:11:54.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.656+0000 7f9840459740 1 -- 172.21.15.148:0/614502294 shutdown_connections 2024-09-19T07:11:54.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.656+0000 7f9840459740 1 --2- 172.21.15.148:0/614502294 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7aa9fa940 0x55e7aa9f4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.656+0000 7f9840459740 1 --2- 172.21.15.148:0/614502294 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7aa9f0080 0x55e7aaa12ac0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.656+0000 7f9840459740 1 --2- 172.21.15.148:0/614502294 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e7aa9ef760 0x55e7aaa12580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.656+0000 7f9840459740 1 -- 172.21.15.148:0/614502294 >> 172.21.15.148:0/614502294 conn(0x55e7aa9ebcf0 msgr2=0x55e7aa9f98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:54.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.656+0000 7f9840459740 1 -- 172.21.15.148:0/614502294 shutdown_connections 2024-09-19T07:11:54.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.656+0000 7f9840459740 1 -- 172.21.15.148:0/614502294 wait complete. 2024-09-19T07:11:54.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.656+0000 7f9840459740 1 -- start start 2024-09-19T07:11:54.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.657+0000 7f9840459740 1 Processor -- start 2024-09-19T07:11:54.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.657+0000 7f9840459740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7aa9ef760 0x55e7aaa02c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:54.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.657+0000 7f9840459740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7aa9f0080 0x55e7aaa03140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:54.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.657+0000 7f9840459740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e7aa9fa940 0x55e7aa9ff9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:54.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.657+0000 7f9840459740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f98381ae240 con 0x55e7aa9ef760 2024-09-19T07:11:54.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.657+0000 7f9840459740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f98381af6b0 con 0x55e7aa9f0080 2024-09-19T07:11:54.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.657+0000 7f9840459740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f98381ae910 con 0x55e7aa9fa940 2024-09-19T07:11:54.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.657+0000 7f9840459740 10 client.0 _ll_register_callbacks cb 0x7f98280318c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:11:54.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.657+0000 7f98377fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7aa9ef760 0x55e7aaa02c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:54.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.657+0000 7f98377fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7aa9ef760 0x55e7aaa02c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48660/0 (socket says 172.21.15.148:48660) 2024-09-19T07:11:54.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.657+0000 7f98377fe640 1 -- 172.21.15.148:0/3298102156 learned_addr learned my addr 172.21.15.148:0/3298102156 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:54.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.657+0000 7f982ffff640 1 --2- 172.21.15.148:0/3298102156 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7aa9f0080 0x55e7aaa03140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:54.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.657+0000 7f9837fff640 1 --2- 172.21.15.148:0/3298102156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e7aa9fa940 0x55e7aa9ff9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:54.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.657+0000 7f98377fe640 1 -- 172.21.15.148:0/3298102156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e7aa9fa940 msgr2=0x55e7aa9ff9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:54.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.657+0000 7f98377fe640 1 --2- 172.21.15.148:0/3298102156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e7aa9fa940 0x55e7aa9ff9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.657+0000 7f98377fe640 1 -- 172.21.15.148:0/3298102156 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7aa9f0080 msgr2=0x55e7aaa03140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:54.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.657+0000 7f98377fe640 1 --2- 172.21.15.148:0/3298102156 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7aa9f0080 0x55e7aaa03140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.657+0000 7f98377fe640 1 -- 172.21.15.148:0/3298102156 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7aaa001d0 con 0x55e7aa9ef760 2024-09-19T07:11:54.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.658+0000 7f98377fe640 1 --2- 172.21.15.148:0/3298102156 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7aa9ef760 0x55e7aaa02c00 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f9828049dc0 tx=0x7f98280097c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42df03a37354c14e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:54.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.658+0000 7f9816ffd640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:11:54.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.658+0000 7f9816ffd640 1 -- 172.21.15.148:0/3298102156 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9828062060 con 0x55e7aa9ef760 2024-09-19T07:11:54.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.658+0000 7f9816ffd640 1 -- 172.21.15.148:0/3298102156 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f9828049ab0 con 0x55e7aa9ef760 2024-09-19T07:11:54.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.658+0000 7f9840459740 1 -- 172.21.15.148:0/3298102156 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9820016e30 con 0x55e7aa9ef760 2024-09-19T07:11:54.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.658+0000 7f9816ffd640 1 -- 172.21.15.148:0/3298102156 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f982804d040 con 0x55e7aa9ef760 2024-09-19T07:11:54.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.658+0000 7f9840459740 10 client.15513 fetch_fsmap learned FSMap version 25 2024-09-19T07:11:54.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.658+0000 7f9840459740 1 -- 172.21.15.148:0/3298102156 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e7aaa760d0 con 0x55e7aa9ef760 2024-09-19T07:11:54.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.658+0000 7f9816ffd640 1 -- 172.21.15.148:0/3298102156 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9820016e30 con 0x55e7aa9ef760 2024-09-19T07:11:54.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.658+0000 7f9816ffd640 1 -- 172.21.15.148:0/3298102156 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f98280525d0 con 0x55e7aa9ef760 2024-09-19T07:11:54.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.658+0000 7f9840459740 10 client.15513 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:11:54.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.658+0000 7f9840459740 10 client.15513 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:11:54.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.658+0000 7f9840459740 20 client.15513 populate_metadata read hostname 'smithi148' 2024-09-19T07:11:54.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.658+0000 7f9840459740 1 --2- 172.21.15.148:0/3298102156 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e7aaa76890 0x55e7aaa78cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:54.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.658+0000 7f9840459740 4 client.15513 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 131.2, "await_for": 45.0}] 2024-09-19T07:11:54.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.658+0000 7f9840459740 1 -- 172.21.15.148:0/3298102156 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 131.2, "await_for": 45.0}) -- 0x55e7aa95cd20 con 0x55e7aaa76890 2024-09-19T07:11:54.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.659+0000 7f982ffff640 1 --2- 172.21.15.148:0/3298102156 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e7aaa76890 0x55e7aaa78cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:54.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.659+0000 7f982ffff640 1 --2- 172.21.15.148:0/3298102156 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e7aaa76890 0x55e7aaa78cb0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2af11c03cb0892db server_cookie=f87d3651e7017aba in_seq=0 out_seq=0 2024-09-19T07:11:54.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.659+0000 7f9816ffd640 10 client.15513 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:11:54.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.672+0000 7f9816ffd640 1 -- 172.21.15.148:0/3298102156 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55e7aa95cd20 con 0x55e7aaa76890 2024-09-19T07:11:54.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.672+0000 7f9816ffd640 10 client.15513 handle_command_reply: tid=0 2024-09-19T07:11:54.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.672+0000 7f9840459740 1 client.15513 shutdown 2024-09-19T07:11:54.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.672+0000 7f9840459740 1 -- 172.21.15.148:0/3298102156 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7aa9ef760 msgr2=0x55e7aaa02c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:54.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.672+0000 7f9840459740 1 --2- 172.21.15.148:0/3298102156 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7aa9ef760 0x55e7aaa02c00 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f9828049dc0 tx=0x7f98280097c0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.673+0000 7f9840459740 1 -- 172.21.15.148:0/3298102156 shutdown_connections 2024-09-19T07:11:54.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.673+0000 7f9840459740 1 --2- 172.21.15.148:0/3298102156 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e7aaa76890 0x55e7aaa78cb0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.673+0000 7f9840459740 1 --2- 172.21.15.148:0/3298102156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e7aa9fa940 0x55e7aa9ff9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.673+0000 7f9840459740 1 --2- 172.21.15.148:0/3298102156 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7aa9f0080 0x55e7aaa03140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.673+0000 7f9840459740 1 --2- 172.21.15.148:0/3298102156 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7aa9ef760 0x55e7aaa02c00 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.673+0000 7f9816ffd640 0 client.15513 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:11:54.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.673+0000 7f9840459740 1 -- 172.21.15.148:0/3298102156 >> 172.21.15.148:0/3298102156 conn(0x55e7aa9ebcf0 msgr2=0x55e7aa9f11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:54.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.673+0000 7f9840459740 1 -- 172.21.15.148:0/3298102156 shutdown_connections 2024-09-19T07:11:54.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.673+0000 7f9840459740 1 -- 172.21.15.148:0/3298102156 wait complete. 2024-09-19T07:11:54.539 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:11:54.540 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 25, 2024-09-19T07:11:54.540 INFO:teuthology.orchestra.run.smithi148.stdout: "leader": 24457, 2024-09-19T07:11:54.540 INFO:teuthology.orchestra.run.smithi148.stdout: "set_version": 2, 2024-09-19T07:11:54.540 INFO:teuthology.orchestra.run.smithi148.stdout: "sets": { 2024-09-19T07:11:54.540 INFO:teuthology.orchestra.run.smithi148.stdout: "15c8d75c": { 2024-09-19T07:11:54.540 INFO:teuthology.orchestra.run.smithi148.stdout: "version": 2, 2024-09-19T07:11:54.540 INFO:teuthology.orchestra.run.smithi148.stdout: "age_ref": 0.0, 2024-09-19T07:11:54.540 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:11:54.540 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "QUIESCED", 2024-09-19T07:11:54.540 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:11:54.540 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:11:54.540 INFO:teuthology.orchestra.run.smithi148.stdout: "timeout": 90.0, 2024-09-19T07:11:54.541 INFO:teuthology.orchestra.run.smithi148.stdout: "expiration": 131.2, 2024-09-19T07:11:54.541 INFO:teuthology.orchestra.run.smithi148.stdout: "members": { 2024-09-19T07:11:54.541 INFO:teuthology.orchestra.run.smithi148.stdout: "file:/": { 2024-09-19T07:11:54.541 INFO:teuthology.orchestra.run.smithi148.stdout: "excluded": false, 2024-09-19T07:11:54.541 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:11:54.541 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "QUIESCED", 2024-09-19T07:11:54.541 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:11:54.541 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:11:54.541 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:11:54.541 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:11:54.541 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:11:54.541 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:11:54.541 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:11:54.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.673+0000 7f9840459740 20 client.15513 trim_cache size 0 max 16384 2024-09-19T07:11:54.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.673+0000 7f983e080640 1 -- 172.21.15.148:0/2186763807 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f98240a3440 msgr2=0x7f98240a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:54.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.673+0000 7f983e080640 1 --2- 172.21.15.148:0/2186763807 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f98240a3440 0x7f98240a5900 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9828005ab0 tx=0x7f9828005a20 comp rx=0 tx=0).stop 2024-09-19T07:11:54.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.673+0000 7f983e080640 1 -- 172.21.15.148:0/2186763807 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9838106f40 msgr2=0x7f9838074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:54.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.673+0000 7f983e080640 1 --2- 172.21.15.148:0/2186763807 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9838106f40 0x7f9838074f70 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f983000b970 tx=0x7f983000bd70 comp rx=0 tx=0).stop 2024-09-19T07:11:54.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.674+0000 7f983e080640 1 -- 172.21.15.148:0/2186763807 shutdown_connections 2024-09-19T07:11:54.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.674+0000 7f983e080640 1 --2- 172.21.15.148:0/2186763807 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f98240a3440 0x7f98240a5900 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.674+0000 7f983e080640 1 --2- 172.21.15.148:0/2186763807 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9838106f40 0x7f9838074f70 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.674+0000 7f983e080640 1 --2- 172.21.15.148:0/2186763807 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98381027c0 0x7f9838074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.674+0000 7f983e080640 1 --2- 172.21.15.148:0/2186763807 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9838101e10 0x7f98380744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:54.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.674+0000 7f983e080640 1 -- 172.21.15.148:0/2186763807 >> 172.21.15.148:0/2186763807 conn(0x7f98380fd8d0 msgr2=0x7f98380fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:54.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.674+0000 7f983e080640 1 -- 172.21.15.148:0/2186763807 shutdown_connections 2024-09-19T07:11:54.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:53.674+0000 7f983e080640 1 -- 172.21.15.148:0/2186763807 wait complete. 2024-09-19T07:11:54.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:54 smithi148 ceph-mon[31180]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-19T07:11:54.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:54 smithi165 ceph-mon[35326]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-19T07:11:54.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:54 smithi179 ceph-mon[35716]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-19T07:11:55.605 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T07:11:56.109 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '15c8d75c', quiesce took 8.3 seconds. Will release after: 2.8999999999999986 2024-09-19T07:11:56.209 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:11:56.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:56 smithi148 ceph-mon[31180]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.9 KiB/s wr, 10 op/s 2024-09-19T07:11:56.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:56 smithi165 ceph-mon[35326]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.9 KiB/s wr, 10 op/s 2024-09-19T07:11:56.733 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.704+0000 7fa7c052d640 1 -- 172.21.15.148:0/1670278296 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7b81036e0 msgr2=0x7fa7b8107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:56.733 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.704+0000 7fa7c052d640 1 --2- 172.21.15.148:0/1670278296 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7b81036e0 0x7fa7b8107b90 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fa7a8009930 tx=0x7fa7a802a420 comp rx=0 tx=0).stop 2024-09-19T07:11:56.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.704+0000 7fa7c052d640 1 -- 172.21.15.148:0/1670278296 shutdown_connections 2024-09-19T07:11:56.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.704+0000 7fa7c052d640 1 --2- 172.21.15.148:0/1670278296 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7b81082a0 0x7fa7b810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:56.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.704+0000 7fa7c052d640 1 --2- 172.21.15.148:0/1670278296 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7b81036e0 0x7fa7b8107b90 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:56.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.704+0000 7fa7c052d640 1 --2- 172.21.15.148:0/1670278296 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7b8102d30 0x7fa7b8103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:56.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.704+0000 7fa7c052d640 1 -- 172.21.15.148:0/1670278296 >> 172.21.15.148:0/1670278296 conn(0x7fa7b80fc7d0 msgr2=0x7fa7b80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:56.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.704+0000 7fa7c052d640 1 -- 172.21.15.148:0/1670278296 shutdown_connections 2024-09-19T07:11:56.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.704+0000 7fa7c052d640 1 -- 172.21.15.148:0/1670278296 wait complete. 2024-09-19T07:11:56.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.705+0000 7fa7c052d640 1 Processor -- start 2024-09-19T07:11:56.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.705+0000 7fa7c052d640 1 -- start start 2024-09-19T07:11:56.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.705+0000 7fa7c052d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7b8102d30 0x7fa7b8198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:56.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.705+0000 7fa7c052d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7b81036e0 0x7fa7b8198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:56.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.705+0000 7fa7c052d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7b81082a0 0x7fa7b819ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:56.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.705+0000 7fa7c052d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b81120a0 con 0x7fa7b81082a0 2024-09-19T07:11:56.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.705+0000 7fa7c052d640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b8111f20 con 0x7fa7b81036e0 2024-09-19T07:11:56.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.705+0000 7fa7c052d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b8112220 con 0x7fa7b8102d30 2024-09-19T07:11:56.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.705+0000 7fa7beaca640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7b81082a0 0x7fa7b819ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:56.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.705+0000 7fa7beaca640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7b81082a0 0x7fa7b819ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47324/0 (socket says 172.21.15.148:47324) 2024-09-19T07:11:56.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.705+0000 7fa7beaca640 1 -- 172.21.15.148:0/3635244293 learned_addr learned my addr 172.21.15.148:0/3635244293 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:56.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.705+0000 7fa7bdac8640 1 --2- 172.21.15.148:0/3635244293 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7b81036e0 0x7fa7b8198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:56.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.705+0000 7fa7be2c9640 1 --2- 172.21.15.148:0/3635244293 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7b8102d30 0x7fa7b8198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:56.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.706+0000 7fa7beaca640 1 -- 172.21.15.148:0/3635244293 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7b8102d30 msgr2=0x7fa7b8198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:56.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.706+0000 7fa7beaca640 1 --2- 172.21.15.148:0/3635244293 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7b8102d30 0x7fa7b8198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:56.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.706+0000 7fa7beaca640 1 -- 172.21.15.148:0/3635244293 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7b81036e0 msgr2=0x7fa7b8198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:56.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.706+0000 7fa7beaca640 1 --2- 172.21.15.148:0/3635244293 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7b81036e0 0x7fa7b8198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:56.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.706+0000 7fa7beaca640 1 -- 172.21.15.148:0/3635244293 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7b819d530 con 0x7fa7b81082a0 2024-09-19T07:11:56.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.706+0000 7fa7beaca640 1 --2- 172.21.15.148:0/3635244293 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7b81082a0 0x7fa7b819ce50 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fa7b000cce0 tx=0x7fa7b000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:56.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.706+0000 7fa7af7fe640 1 -- 172.21.15.148:0/3635244293 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b000f450 con 0x7fa7b81082a0 2024-09-19T07:11:56.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.706+0000 7fa7af7fe640 1 -- 172.21.15.148:0/3635244293 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7b000fad0 con 0x7fa7b81082a0 2024-09-19T07:11:56.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.706+0000 7fa7af7fe640 1 -- 172.21.15.148:0/3635244293 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b0018c10 con 0x7fa7b81082a0 2024-09-19T07:11:56.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.707+0000 7fa7c052d640 1 -- 172.21.15.148:0/3635244293 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7b819d820 con 0x7fa7b81082a0 2024-09-19T07:11:56.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.707+0000 7fa7c052d640 1 -- 172.21.15.148:0/3635244293 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7b81a5100 con 0x7fa7b81082a0 2024-09-19T07:11:56.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.710+0000 7fa7c2906740 1 Processor -- start 2024-09-19T07:11:56.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.710+0000 7fa7af7fe640 1 -- 172.21.15.148:0/3635244293 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7fa7b000f5f0 con 0x7fa7b81082a0 2024-09-19T07:11:56.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.711+0000 7fa7c2906740 1 -- start start 2024-09-19T07:11:56.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.711+0000 7fa7c2906740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c19913b40 0x557c19912090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:56.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.711+0000 7fa7c2906740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c199125d0 0x557c19912a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:56.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.711+0000 7fa7c2906740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c19921780 0x557c19923b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:56.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.711+0000 7fa7c2906740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x557c198782f0 con 0x557c19921780 2024-09-19T07:11:56.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.711+0000 7fa7c2906740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x557c1981fcf0 con 0x557c19913b40 2024-09-19T07:11:56.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.711+0000 7fa7c2906740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x557c198742b0 con 0x557c199125d0 2024-09-19T07:11:56.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.711+0000 7fa7bdac8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c19921780 0x557c19923b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:56.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.711+0000 7fa7bdac8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c19921780 0x557c19923b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47340/0 (socket says 172.21.15.148:47340) 2024-09-19T07:11:56.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.711+0000 7fa7bdac8640 1 -- 172.21.15.148:0/312618069 learned_addr learned my addr 172.21.15.148:0/312618069 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:56.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.711+0000 7fa7be2c9640 1 --2- 172.21.15.148:0/312618069 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c199125d0 0x557c19912a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:56.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.711+0000 7fa7bdac8640 1 --2- 172.21.15.148:0/312618069 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c19913b40 0x557c19912090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:56.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.712+0000 7fa7af7fe640 1 --2- 172.21.15.148:0/3635244293 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fa7a40a34c0 0x7fa7a40a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:56.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.712+0000 7fa7be2c9640 1 -- 172.21.15.148:0/312618069 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c19913b40 msgr2=0x557c19912090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:56.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.712+0000 7fa7be2c9640 1 --2- 172.21.15.148:0/312618069 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c19913b40 0x557c19912090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:56.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.712+0000 7fa7be2c9640 1 -- 172.21.15.148:0/312618069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c19921780 msgr2=0x557c19923b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:56.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.712+0000 7fa7be2c9640 1 --2- 172.21.15.148:0/312618069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c19921780 0x557c19923b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:56.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.712+0000 7fa7be2c9640 1 -- 172.21.15.148:0/312618069 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c198043a0 con 0x557c199125d0 2024-09-19T07:11:56.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.712+0000 7fa7af7fe640 1 -- 172.21.15.148:0/3635244293 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fa7b00d0590 con 0x7fa7b81082a0 2024-09-19T07:11:56.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.712+0000 7fa7be2c9640 1 --2- 172.21.15.148:0/312618069 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c199125d0 0x557c19912a10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4004630 tx=0x7fa7b400bb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9c8fa320c23fc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:56.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.712+0000 7fa7beaca640 1 --2- 172.21.15.148:0/3635244293 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fa7a40a34c0 0x7fa7a40a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:56.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.712+0000 7fa7acff9640 1 -- 172.21.15.148:0/312618069 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b4003b50 con 0x557c199125d0 2024-09-19T07:11:56.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.712+0000 7fa7acff9640 1 -- 172.21.15.148:0/312618069 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7b4015070 con 0x557c199125d0 2024-09-19T07:11:56.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.712+0000 7fa7acff9640 1 -- 172.21.15.148:0/312618069 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b4004d10 con 0x557c199125d0 2024-09-19T07:11:56.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.713+0000 7fa7c2906740 1 -- 172.21.15.148:0/312618069 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c199125d0 msgr2=0x557c19912a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:56.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.713+0000 7fa7beaca640 1 --2- 172.21.15.148:0/3635244293 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fa7a40a34c0 0x7fa7a40a5980 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa7b00cdc90 tx=0x7fa7b000af30 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:56.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.713+0000 7fa7c2906740 1 --2- 172.21.15.148:0/312618069 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c199125d0 0x557c19912a10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4004630 tx=0x7fa7b400bb20 comp rx=0 tx=0).stop 2024-09-19T07:11:56.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.713+0000 7fa7c2906740 1 -- 172.21.15.148:0/312618069 shutdown_connections 2024-09-19T07:11:56.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.713+0000 7fa7c2906740 1 --2- 172.21.15.148:0/312618069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c19921780 0x557c19923b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:56.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.713+0000 7fa7c2906740 1 --2- 172.21.15.148:0/312618069 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c199125d0 0x557c19912a10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:56.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.713+0000 7fa7c2906740 1 --2- 172.21.15.148:0/312618069 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c19913b40 0x557c19912090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:56.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.713+0000 7fa7c2906740 1 -- 172.21.15.148:0/312618069 >> 172.21.15.148:0/312618069 conn(0x557c198db310 msgr2=0x557c1990ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:56.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.713+0000 7fa7c2906740 1 -- 172.21.15.148:0/312618069 shutdown_connections 2024-09-19T07:11:56.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.713+0000 7fa7c2906740 1 -- 172.21.15.148:0/312618069 wait complete. 2024-09-19T07:11:56.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.714+0000 7fa7c2906740 1 -- start start 2024-09-19T07:11:56.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.714+0000 7fa7c2906740 1 Processor -- start 2024-09-19T07:11:56.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.714+0000 7fa7c2906740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c199125d0 0x557c199211b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:56.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.714+0000 7fa7c2906740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c19913b40 0x557c1991e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:56.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.714+0000 7fa7c2906740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c19921780 0x557c1991ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:56.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.714+0000 7fa7c2906740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x557c19924480 con 0x557c199125d0 2024-09-19T07:11:56.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.714+0000 7fa7c2906740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x557c19833060 con 0x557c19921780 2024-09-19T07:11:56.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.714+0000 7fa7c2906740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x557c19924600 con 0x557c19913b40 2024-09-19T07:11:56.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.714+0000 7fa7c2906740 10 client.0 _ll_register_callbacks cb 0x557c195868c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:11:56.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.714+0000 7fa7bdac8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c199125d0 0x557c199211b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:56.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.714+0000 7fa7bdac8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c199125d0 0x557c199211b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47356/0 (socket says 172.21.15.148:47356) 2024-09-19T07:11:56.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.714+0000 7fa7bdac8640 1 -- 172.21.15.148:0/3561783159 learned_addr learned my addr 172.21.15.148:0/3561783159 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:56.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.714+0000 7fa7be2c9640 1 --2- 172.21.15.148:0/3561783159 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c19913b40 0x557c1991e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:56.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.715+0000 7fa7bdac8640 1 -- 172.21.15.148:0/3561783159 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c19913b40 msgr2=0x557c1991e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:56.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.715+0000 7fa7bdac8640 1 --2- 172.21.15.148:0/3561783159 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c19913b40 0x557c1991e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:56.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.715+0000 7fa7bdac8640 1 -- 172.21.15.148:0/3561783159 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c19921780 msgr2=0x557c1991ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:56.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.715+0000 7fa7bdac8640 1 --2- 172.21.15.148:0/3561783159 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c19921780 0x557c1991ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:56.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.715+0000 7fa7bdac8640 1 -- 172.21.15.148:0/3561783159 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c195e93c0 con 0x557c199125d0 2024-09-19T07:11:56.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.715+0000 7fa7bdac8640 1 --2- 172.21.15.148:0/3561783159 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c199125d0 0x557c199211b0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fa7a8009230 tx=0x7fa7a8009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe7ddad3f75ecf9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:56.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.715+0000 7fa7a1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:11:56.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.715+0000 7fa7a1ffb640 1 -- 172.21.15.148:0/3561783159 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a8035040 con 0x557c199125d0 2024-09-19T07:11:56.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.715+0000 7fa7c2906740 1 -- 172.21.15.148:0/3561783159 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7b4015070 con 0x557c199125d0 2024-09-19T07:11:56.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.715+0000 7fa7a1ffb640 1 -- 172.21.15.148:0/3561783159 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fa7a8004450 con 0x557c199125d0 2024-09-19T07:11:56.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.715+0000 7fa7a1ffb640 1 -- 172.21.15.148:0/3561783159 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa7a80035f0 con 0x557c199125d0 2024-09-19T07:11:56.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.715+0000 7fa7c2906740 10 client.15543 fetch_fsmap learned FSMap version 25 2024-09-19T07:11:56.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.715+0000 7fa7c2906740 1 -- 172.21.15.148:0/3561783159 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557c1992ffb0 con 0x557c199125d0 2024-09-19T07:11:56.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.716+0000 7fa7a1ffb640 1 -- 172.21.15.148:0/3561783159 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7b4015070 con 0x557c199125d0 2024-09-19T07:11:56.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.716+0000 7fa7a1ffb640 1 -- 172.21.15.148:0/3561783159 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa7a8053900 con 0x557c199125d0 2024-09-19T07:11:56.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.716+0000 7fa7c2906740 10 client.15543 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:11:56.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.716+0000 7fa7c2906740 10 client.15543 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T07:11:56.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.716+0000 7fa7c2906740 20 client.15543 populate_metadata read hostname 'smithi148' 2024-09-19T07:11:56.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.716+0000 7fa7c2906740 1 --2- 172.21.15.148:0/3561783159 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x557c199313c0 0x557c199337b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:56.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.716+0000 7fa7c2906740 4 client.15543 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:11:56.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.716+0000 7fa7c2906740 1 -- 172.21.15.148:0/3561783159 --> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c19885860 con 0x557c199313c0 2024-09-19T07:11:56.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.716+0000 7fa7be2c9640 1 --2- 172.21.15.148:0/3561783159 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x557c199313c0 0x557c199337b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:56.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.717+0000 7fa7be2c9640 1 --2- 172.21.15.148:0/3561783159 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x557c199313c0 0x557c199337b0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f33de3847b545d71 server_cookie=1202beb39c614e83 in_seq=0 out_seq=0 2024-09-19T07:11:56.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.717+0000 7fa7a1ffb640 10 client.15543 ms_handle_connect on v2:172.21.15.165:6838/3993490234 2024-09-19T07:11:56.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.717+0000 7fa7a1ffb640 1 -- 172.21.15.148:0/3561783159 <== mds.1 v2:172.21.15.165:6838/3993490234 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557c19885860 con 0x557c199313c0 2024-09-19T07:11:56.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.717+0000 7fa7a1ffb640 10 client.15543 handle_command_reply: tid=0 2024-09-19T07:11:56.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.717+0000 7fa7c2906740 1 client.15543 shutdown 2024-09-19T07:11:56.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.718+0000 7fa7c2906740 1 -- 172.21.15.148:0/3561783159 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c199125d0 msgr2=0x557c199211b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:56.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.718+0000 7fa7c2906740 1 --2- 172.21.15.148:0/3561783159 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c199125d0 0x557c199211b0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fa7a8009230 tx=0x7fa7a8009580 comp rx=0 tx=0).stop 2024-09-19T07:11:56.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.718+0000 7fa7c2906740 1 -- 172.21.15.148:0/3561783159 shutdown_connections 2024-09-19T07:11:56.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.718+0000 7fa7c2906740 1 --2- 172.21.15.148:0/3561783159 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x557c199313c0 0x557c199337b0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:56.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.718+0000 7fa7c2906740 1 --2- 172.21.15.148:0/3561783159 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c19921780 0x557c1991ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:56.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.718+0000 7fa7c2906740 1 --2- 172.21.15.148:0/3561783159 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c19913b40 0x557c1991e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:56.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.718+0000 7fa7c2906740 1 --2- 172.21.15.148:0/3561783159 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c199125d0 0x557c199211b0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:56.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.718+0000 7fa7c2906740 1 -- 172.21.15.148:0/3561783159 >> 172.21.15.148:0/3561783159 conn(0x557c198db310 msgr2=0x557c19914960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:56.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.718+0000 7fa7a1ffb640 0 client.15543 ms_handle_reset on v2:172.21.15.165:6838/3993490234 2024-09-19T07:11:56.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.718+0000 7fa7c2906740 1 -- 172.21.15.148:0/3561783159 shutdown_connections 2024-09-19T07:11:56.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.718+0000 7fa7c2906740 1 -- 172.21.15.148:0/3561783159 wait complete. 2024-09-19T07:11:56.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.718+0000 7fa7c2906740 20 client.15543 trim_cache size 0 max 16384 2024-09-19T07:11:56.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.736+0000 7fa7c2906740 1 Processor -- start 2024-09-19T07:11:56.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.736+0000 7fa7c2906740 1 -- start start 2024-09-19T07:11:56.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.736+0000 7fa7c2906740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c19913b40 0x557c1990dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:56.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.736+0000 7fa7c2906740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c19921780 0x557c1990e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:56.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.736+0000 7fa7c2906740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c1990ef20 0x557c19938fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:56.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.736+0000 7fa7c2906740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b81adec0 con 0x557c19913b40 2024-09-19T07:11:56.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.736+0000 7fa7c2906740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b81ab790 con 0x557c19921780 2024-09-19T07:11:56.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.736+0000 7fa7c2906740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b81a95c0 con 0x557c1990ef20 2024-09-19T07:11:56.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.736+0000 7fa7bdac8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c19913b40 0x557c1990dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:56.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.736+0000 7fa7bdac8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c19913b40 0x557c1990dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47364/0 (socket says 172.21.15.148:47364) 2024-09-19T07:11:56.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.736+0000 7fa7bdac8640 1 -- 172.21.15.148:0/2385765070 learned_addr learned my addr 172.21.15.148:0/2385765070 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:56.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.736+0000 7fa7be2c9640 1 --2- 172.21.15.148:0/2385765070 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c19921780 0x557c1990e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:56.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.736+0000 7fa7bdac8640 1 -- 172.21.15.148:0/2385765070 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c1990ef20 msgr2=0x557c19938fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:56.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.736+0000 7fa7bdac8640 1 --2- 172.21.15.148:0/2385765070 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c1990ef20 0x557c19938fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:56.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.736+0000 7fa7bdac8640 1 -- 172.21.15.148:0/2385765070 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c19921780 msgr2=0x557c1990e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:56.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.736+0000 7fa7bdac8640 1 --2- 172.21.15.148:0/2385765070 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c19921780 0x557c1990e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:56.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.736+0000 7fa7bdac8640 1 -- 172.21.15.148:0/2385765070 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c1991c9b0 con 0x557c19913b40 2024-09-19T07:11:56.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.737+0000 7fa7bdac8640 1 --2- 172.21.15.148:0/2385765070 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c19913b40 0x557c1990dc10 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fa7a8009850 tx=0x7fa7a80315f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f7781139f9aa8d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:56.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.737+0000 7fa7a3fff640 1 -- 172.21.15.148:0/2385765070 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a8041070 con 0x557c19913b40 2024-09-19T07:11:56.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.737+0000 7fa7a3fff640 1 -- 172.21.15.148:0/2385765070 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7a8004450 con 0x557c19913b40 2024-09-19T07:11:56.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.737+0000 7fa7a3fff640 1 -- 172.21.15.148:0/2385765070 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a8035040 con 0x557c19913b40 2024-09-19T07:11:56.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.738+0000 7fa7c2906740 1 -- 172.21.15.148:0/2385765070 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c19913b40 msgr2=0x557c1990dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:56.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.738+0000 7fa7c2906740 1 --2- 172.21.15.148:0/2385765070 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c19913b40 0x557c1990dc10 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fa7a8009850 tx=0x7fa7a80315f0 comp rx=0 tx=0).stop 2024-09-19T07:11:56.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.738+0000 7fa7c2906740 1 -- 172.21.15.148:0/2385765070 shutdown_connections 2024-09-19T07:11:56.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.738+0000 7fa7c2906740 1 --2- 172.21.15.148:0/2385765070 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c1990ef20 0x557c19938fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:56.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.738+0000 7fa7c2906740 1 --2- 172.21.15.148:0/2385765070 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c19921780 0x557c1990e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:56.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.738+0000 7fa7c2906740 1 --2- 172.21.15.148:0/2385765070 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c19913b40 0x557c1990dc10 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:56.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.738+0000 7fa7c2906740 1 -- 172.21.15.148:0/2385765070 >> 172.21.15.148:0/2385765070 conn(0x557c198db310 msgr2=0x557c1990d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:56.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.738+0000 7fa7c2906740 1 -- 172.21.15.148:0/2385765070 shutdown_connections 2024-09-19T07:11:56.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.738+0000 7fa7c2906740 1 -- 172.21.15.148:0/2385765070 wait complete. 2024-09-19T07:11:56.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.738+0000 7fa7c2906740 1 -- start start 2024-09-19T07:11:56.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.738+0000 7fa7c2906740 1 Processor -- start 2024-09-19T07:11:56.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.739+0000 7fa7c2906740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c1990ef20 0x557c19925dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:56.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.739+0000 7fa7c2906740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c19913b40 0x557c19926300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:56.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.739+0000 7fa7c2906740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c19921780 0x557c1999af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:56.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.739+0000 7fa7c2906740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b81a9c50 con 0x557c1990ef20 2024-09-19T07:11:56.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.739+0000 7fa7c2906740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b81ab0c0 con 0x557c19921780 2024-09-19T07:11:56.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.739+0000 7fa7c2906740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b81aa320 con 0x557c19913b40 2024-09-19T07:11:56.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.739+0000 7fa7c2906740 10 client.0 _ll_register_callbacks cb 0x7fa7a80316a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:11:56.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.739+0000 7fa7bdac8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c1990ef20 0x557c19925dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:56.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.739+0000 7fa7bdac8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c1990ef20 0x557c19925dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47376/0 (socket says 172.21.15.148:47376) 2024-09-19T07:11:56.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.739+0000 7fa7bdac8640 1 -- 172.21.15.148:0/1284003911 learned_addr learned my addr 172.21.15.148:0/1284003911 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:56.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.739+0000 7fa7bdac8640 1 --2- 172.21.15.148:0/1284003911 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c19921780 0x557c1999af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:56.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.739+0000 7fa7bdac8640 1 -- 172.21.15.148:0/1284003911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c19913b40 msgr2=0x557c19926300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:56.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.739+0000 7fa7bdac8640 1 --2- 172.21.15.148:0/1284003911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c19913b40 0x557c19926300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:56.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.739+0000 7fa7bdac8640 1 -- 172.21.15.148:0/1284003911 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c19921780 msgr2=0x557c1999af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:56.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.739+0000 7fa7bdac8640 1 --2- 172.21.15.148:0/1284003911 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c19921780 0x557c1999af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:56.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.739+0000 7fa7bdac8640 1 -- 172.21.15.148:0/1284003911 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c1999b530 con 0x557c1990ef20 2024-09-19T07:11:56.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.740+0000 7fa7bdac8640 1 --2- 172.21.15.148:0/1284003911 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c1990ef20 0x557c19925dc0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fa7a8053f70 tx=0x7fa7a802a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=833e4302cc4bf863 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:56.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.740+0000 7fa7a1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:11:56.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.740+0000 7fa7a1ffb640 1 -- 172.21.15.148:0/1284003911 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a8041040 con 0x557c1990ef20 2024-09-19T07:11:56.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.740+0000 7fa7a1ffb640 1 -- 172.21.15.148:0/1284003911 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fa7a8003830 con 0x557c1990ef20 2024-09-19T07:11:56.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.740+0000 7fa7c2906740 1 -- 172.21.15.148:0/1284003911 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7a8004450 con 0x557c1990ef20 2024-09-19T07:11:56.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.740+0000 7fa7a1ffb640 1 -- 172.21.15.148:0/1284003911 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa7a8003a30 con 0x557c1990ef20 2024-09-19T07:11:56.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.740+0000 7fa7c2906740 10 client.15549 fetch_fsmap learned FSMap version 25 2024-09-19T07:11:56.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.740+0000 7fa7c2906740 1 -- 172.21.15.148:0/1284003911 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557c1999c7f0 con 0x557c1990ef20 2024-09-19T07:11:56.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.740+0000 7fa7a1ffb640 1 -- 172.21.15.148:0/1284003911 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7a8053950 con 0x557c1990ef20 2024-09-19T07:11:56.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.741+0000 7fa7a1ffb640 1 -- 172.21.15.148:0/1284003911 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa7a8004a40 con 0x557c1990ef20 2024-09-19T07:11:56.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.741+0000 7fa7c2906740 10 client.15549 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:11:56.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.741+0000 7fa7c2906740 10 client.15549 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T07:11:56.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.741+0000 7fa7c2906740 20 client.15549 populate_metadata read hostname 'smithi148' 2024-09-19T07:11:56.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.741+0000 7fa7c2906740 1 --2- 172.21.15.148:0/1284003911 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x557c1999cda0 0x557c1999f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:56.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.741+0000 7fa7c2906740 4 client.15549 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:11:56.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.741+0000 7fa7c2906740 1 -- 172.21.15.148:0/1284003911 --> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fa7a8004450 con 0x557c1999cda0 2024-09-19T07:11:56.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.741+0000 7fa7be2c9640 1 --2- 172.21.15.148:0/1284003911 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x557c1999cda0 0x557c1999f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:56.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.742+0000 7fa7a1ffb640 10 client.15549 ms_handle_connect on v2:172.21.15.165:6838/3993490234 2024-09-19T07:11:56.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.742+0000 7fa7be2c9640 1 --2- 172.21.15.148:0/1284003911 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x557c1999cda0 0x557c1999f190 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ba168d5b54dd7b05 server_cookie=3cbc7dd882e2ebae in_seq=0 out_seq=0 2024-09-19T07:11:56.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.742+0000 7fa7a1ffb640 1 -- 172.21.15.148:0/1284003911 <== mds.1 v2:172.21.15.165:6838/3993490234 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fa7a8004450 con 0x557c1999cda0 2024-09-19T07:11:56.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.742+0000 7fa7a1ffb640 10 client.15549 handle_command_reply: tid=0 2024-09-19T07:11:56.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.742+0000 7fa7c2906740 1 client.15549 shutdown 2024-09-19T07:11:56.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.742+0000 7fa7c2906740 1 -- 172.21.15.148:0/1284003911 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c1990ef20 msgr2=0x557c19925dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:56.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.742+0000 7fa7c2906740 1 --2- 172.21.15.148:0/1284003911 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c1990ef20 0x557c19925dc0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fa7a8053f70 tx=0x7fa7a802a420 comp rx=0 tx=0).stop 2024-09-19T07:11:56.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.742+0000 7fa7c2906740 1 -- 172.21.15.148:0/1284003911 shutdown_connections 2024-09-19T07:11:56.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.742+0000 7fa7c2906740 1 --2- 172.21.15.148:0/1284003911 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x557c1999cda0 0x557c1999f190 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:56.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.742+0000 7fa7c2906740 1 --2- 172.21.15.148:0/1284003911 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c19921780 0x557c1999af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:56.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.742+0000 7fa7c2906740 1 --2- 172.21.15.148:0/1284003911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c19913b40 0x557c19926300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:56.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.742+0000 7fa7a1ffb640 0 client.15549 ms_handle_reset on v2:172.21.15.165:6838/3993490234 2024-09-19T07:11:56.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.742+0000 7fa7c2906740 1 --2- 172.21.15.148:0/1284003911 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c1990ef20 0x557c19925dc0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:56.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.742+0000 7fa7c2906740 1 -- 172.21.15.148:0/1284003911 >> 172.21.15.148:0/1284003911 conn(0x557c198db310 msgr2=0x557c19914930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:56.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.742+0000 7fa7c2906740 1 -- 172.21.15.148:0/1284003911 shutdown_connections 2024-09-19T07:11:56.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.742+0000 7fa7c2906740 1 -- 172.21.15.148:0/1284003911 wait complete. 2024-09-19T07:11:56.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.743+0000 7fa7c2906740 20 client.15549 trim_cache size 0 max 16384 2024-09-19T07:11:56.755 INFO:teuthology.orchestra.run.smithi148.stdout:[] 2024-09-19T07:11:56.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.743+0000 7fa7c052d640 1 -- 172.21.15.148:0/3635244293 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fa7a40a34c0 msgr2=0x7fa7a40a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:56.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.743+0000 7fa7c052d640 1 --2- 172.21.15.148:0/3635244293 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fa7a40a34c0 0x7fa7a40a5980 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa7b00cdc90 tx=0x7fa7b000af30 comp rx=0 tx=0).stop 2024-09-19T07:11:56.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.743+0000 7fa7c052d640 1 -- 172.21.15.148:0/3635244293 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7b81082a0 msgr2=0x7fa7b819ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:56.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.743+0000 7fa7c052d640 1 --2- 172.21.15.148:0/3635244293 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7b81082a0 0x7fa7b819ce50 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fa7b000cce0 tx=0x7fa7b000a620 comp rx=0 tx=0).stop 2024-09-19T07:11:56.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.743+0000 7fa7c052d640 1 -- 172.21.15.148:0/3635244293 shutdown_connections 2024-09-19T07:11:56.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.743+0000 7fa7c052d640 1 --2- 172.21.15.148:0/3635244293 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fa7a40a34c0 0x7fa7a40a5980 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:56.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.743+0000 7fa7c052d640 1 --2- 172.21.15.148:0/3635244293 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7b81082a0 0x7fa7b819ce50 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:56.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.743+0000 7fa7c052d640 1 --2- 172.21.15.148:0/3635244293 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7b81036e0 0x7fa7b8198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:56.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.743+0000 7fa7c052d640 1 --2- 172.21.15.148:0/3635244293 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7b8102d30 0x7fa7b8198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:56.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.743+0000 7fa7c052d640 1 -- 172.21.15.148:0/3635244293 >> 172.21.15.148:0/3635244293 conn(0x7fa7b80fc7d0 msgr2=0x7fa7b8105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:56.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.744+0000 7fa7c052d640 1 -- 172.21.15.148:0/3635244293 shutdown_connections 2024-09-19T07:11:56.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:56.744+0000 7fa7c052d640 1 -- 172.21.15.148:0/3635244293 wait complete. 2024-09-19T07:11:56.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:56 smithi179 ceph-mon[35716]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.9 KiB/s wr, 10 op/s 2024-09-19T07:11:57.482 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T07:11:57.803 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:11:58.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.311+0000 7ff6d301d640 1 -- 172.21.15.148:0/1717655547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6cc102d30 msgr2=0x7ff6cc103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:58.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.311+0000 7ff6d301d640 1 --2- 172.21.15.148:0/1717655547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6cc102d30 0x7ff6cc103110 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0009930 tx=0x7ff6c002a420 comp rx=0 tx=0).stop 2024-09-19T07:11:58.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.312+0000 7ff6d301d640 1 -- 172.21.15.148:0/1717655547 shutdown_connections 2024-09-19T07:11:58.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.312+0000 7ff6d301d640 1 --2- 172.21.15.148:0/1717655547 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6cc1082a0 0x7ff6cc10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:58.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.312+0000 7ff6d301d640 1 --2- 172.21.15.148:0/1717655547 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6cc1036e0 0x7ff6cc107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:58.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.312+0000 7ff6d301d640 1 --2- 172.21.15.148:0/1717655547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6cc102d30 0x7ff6cc103110 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:58.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.312+0000 7ff6d301d640 1 -- 172.21.15.148:0/1717655547 >> 172.21.15.148:0/1717655547 conn(0x7ff6cc0fc7d0 msgr2=0x7ff6cc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:58.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.312+0000 7ff6d301d640 1 -- 172.21.15.148:0/1717655547 shutdown_connections 2024-09-19T07:11:58.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.312+0000 7ff6d301d640 1 -- 172.21.15.148:0/1717655547 wait complete. 2024-09-19T07:11:58.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.313+0000 7ff6d301d640 1 Processor -- start 2024-09-19T07:11:58.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.313+0000 7ff6d301d640 1 -- start start 2024-09-19T07:11:58.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.313+0000 7ff6d301d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6cc102d30 0x7ff6cc1985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:58.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.313+0000 7ff6d301d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6cc1036e0 0x7ff6cc198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:58.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.313+0000 7ff6d301d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6cc1082a0 0x7ff6cc19ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:58.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.313+0000 7ff6d301d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff6cc1120a0 con 0x7ff6cc1082a0 2024-09-19T07:11:58.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.313+0000 7ff6d301d640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff6cc111f20 con 0x7ff6cc1036e0 2024-09-19T07:11:58.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.313+0000 7ff6d301d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff6cc112220 con 0x7ff6cc102d30 2024-09-19T07:11:58.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.313+0000 7ff6d15ba640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6cc1082a0 0x7ff6cc19ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:58.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.313+0000 7ff6d15ba640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6cc1082a0 0x7ff6cc19ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47394/0 (socket says 172.21.15.148:47394) 2024-09-19T07:11:58.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.313+0000 7ff6d15ba640 1 -- 172.21.15.148:0/2773752146 learned_addr learned my addr 172.21.15.148:0/2773752146 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:58.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.314+0000 7ff6cbfff640 1 --2- 172.21.15.148:0/2773752146 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6cc1036e0 0x7ff6cc198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:58.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.314+0000 7ff6d15ba640 1 -- 172.21.15.148:0/2773752146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6cc102d30 msgr2=0x7ff6cc1985e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T07:11:58.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.314+0000 7ff6d15ba640 1 --2- 172.21.15.148:0/2773752146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6cc102d30 0x7ff6cc1985e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:58.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.314+0000 7ff6d15ba640 1 -- 172.21.15.148:0/2773752146 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6cc1036e0 msgr2=0x7ff6cc198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:58.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.314+0000 7ff6d15ba640 1 --2- 172.21.15.148:0/2773752146 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6cc1036e0 0x7ff6cc198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:58.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.314+0000 7ff6d15ba640 1 -- 172.21.15.148:0/2773752146 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6cc19d590 con 0x7ff6cc1082a0 2024-09-19T07:11:58.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.314+0000 7ff6cbfff640 1 --2- 172.21.15.148:0/2773752146 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6cc1036e0 0x7ff6cc198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:11:58.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.314+0000 7ff6d15ba640 1 --2- 172.21.15.148:0/2773752146 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6cc1082a0 0x7ff6cc19ceb0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ff6c400eb10 tx=0x7ff6c400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:58.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.314+0000 7ff6c9ffb640 1 -- 172.21.15.148:0/2773752146 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c4004b20 con 0x7ff6cc1082a0 2024-09-19T07:11:58.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.314+0000 7ff6c9ffb640 1 -- 172.21.15.148:0/2773752146 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6c4004cc0 con 0x7ff6cc1082a0 2024-09-19T07:11:58.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.314+0000 7ff6d301d640 1 -- 172.21.15.148:0/2773752146 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6cc19d880 con 0x7ff6cc1082a0 2024-09-19T07:11:58.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.314+0000 7ff6c9ffb640 1 -- 172.21.15.148:0/2773752146 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c4010760 con 0x7ff6cc1082a0 2024-09-19T07:11:58.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.315+0000 7ff6d301d640 1 -- 172.21.15.148:0/2773752146 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6cc1a5160 con 0x7ff6cc1082a0 2024-09-19T07:11:58.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.317+0000 7ff6c9ffb640 1 -- 172.21.15.148:0/2773752146 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7ff6c4005020 con 0x7ff6cc1082a0 2024-09-19T07:11:58.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.318+0000 7ff6d53f6740 1 Processor -- start 2024-09-19T07:11:58.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.318+0000 7ff6c9ffb640 1 --2- 172.21.15.148:0/2773752146 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7ff6bc0a34c0 0x7ff6bc0a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:58.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.318+0000 7ff6d53f6740 1 -- start start 2024-09-19T07:11:58.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.318+0000 7ff6cbfff640 1 --2- 172.21.15.148:0/2773752146 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7ff6bc0a34c0 0x7ff6bc0a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:58.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.318+0000 7ff6c9ffb640 1 -- 172.21.15.148:0/2773752146 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7ff6c40d0500 con 0x7ff6cc1082a0 2024-09-19T07:11:58.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.319+0000 7ff6d53f6740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e9c2b8b40 0x560e9c2b7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:58.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.319+0000 7ff6d53f6740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560e9c2b75d0 0x560e9c2b7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:58.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.319+0000 7ff6d53f6740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560e9c2c6780 0x560e9c2c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:58.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.319+0000 7ff6d53f6740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x560e9c21d2f0 con 0x560e9c2c6780 2024-09-19T07:11:58.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.319+0000 7ff6d53f6740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x560e9c1c4cf0 con 0x560e9c2b8b40 2024-09-19T07:11:58.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.319+0000 7ff6d53f6740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x560e9c2192b0 con 0x560e9c2b75d0 2024-09-19T07:11:58.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.319+0000 7ff6cbfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560e9c2b75d0 0x560e9c2b7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:58.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.319+0000 7ff6cbfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560e9c2b75d0 0x560e9c2b7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:39454/0 (socket says 172.21.15.148:39454) 2024-09-19T07:11:58.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.319+0000 7ff6cbfff640 1 -- 172.21.15.148:0/3564443967 learned_addr learned my addr 172.21.15.148:0/3564443967 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:58.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.319+0000 7ff6d15ba640 1 --2- 172.21.15.148:0/3564443967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560e9c2c6780 0x560e9c2c8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:58.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.319+0000 7ff6cbfff640 1 --2- 172.21.15.148:0/2773752146 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7ff6bc0a34c0 0x7ff6bc0a5980 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff6b80058c0 tx=0x7ff6b800f730 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:58.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.319+0000 7ff6d0db9640 1 --2- 172.21.15.148:0/3564443967 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e9c2b8b40 0x560e9c2b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:58.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.319+0000 7ff6cbfff640 1 -- 172.21.15.148:0/3564443967 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e9c2b8b40 msgr2=0x560e9c2b7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:58.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.319+0000 7ff6cbfff640 1 --2- 172.21.15.148:0/3564443967 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e9c2b8b40 0x560e9c2b7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:58.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.319+0000 7ff6cbfff640 1 -- 172.21.15.148:0/3564443967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560e9c2c6780 msgr2=0x560e9c2c8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:58.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.320+0000 7ff6cbfff640 1 --2- 172.21.15.148:0/3564443967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560e9c2c6780 0x560e9c2c8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:58.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.320+0000 7ff6cbfff640 1 -- 172.21.15.148:0/3564443967 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e9c1a93a0 con 0x560e9c2b75d0 2024-09-19T07:11:58.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.320+0000 7ff6d15ba640 1 --2- 172.21.15.148:0/3564443967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560e9c2c6780 0x560e9c2c8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:11:58.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.320+0000 7ff6cbfff640 1 --2- 172.21.15.148:0/3564443967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560e9c2b75d0 0x560e9c2b7a10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff6b80124a0 tx=0x7ff6b801a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89fa5a367e8a5054 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:58.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.320+0000 7ff6b6ffd640 1 -- 172.21.15.148:0/3564443967 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b801d620 con 0x560e9c2b75d0 2024-09-19T07:11:58.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.320+0000 7ff6b6ffd640 1 -- 172.21.15.148:0/3564443967 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6b801dca0 con 0x560e9c2b75d0 2024-09-19T07:11:58.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.320+0000 7ff6b6ffd640 1 -- 172.21.15.148:0/3564443967 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b8010d90 con 0x560e9c2b75d0 2024-09-19T07:11:58.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.321+0000 7ff6d53f6740 1 -- 172.21.15.148:0/3564443967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560e9c2b75d0 msgr2=0x560e9c2b7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:58.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.321+0000 7ff6d53f6740 1 --2- 172.21.15.148:0/3564443967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560e9c2b75d0 0x560e9c2b7a10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff6b80124a0 tx=0x7ff6b801a000 comp rx=0 tx=0).stop 2024-09-19T07:11:58.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.321+0000 7ff6d53f6740 1 -- 172.21.15.148:0/3564443967 shutdown_connections 2024-09-19T07:11:58.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.321+0000 7ff6d53f6740 1 --2- 172.21.15.148:0/3564443967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560e9c2c6780 0x560e9c2c8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:58.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.321+0000 7ff6d53f6740 1 --2- 172.21.15.148:0/3564443967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560e9c2b75d0 0x560e9c2b7a10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:58.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.321+0000 7ff6d53f6740 1 --2- 172.21.15.148:0/3564443967 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e9c2b8b40 0x560e9c2b7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:58.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.321+0000 7ff6d53f6740 1 -- 172.21.15.148:0/3564443967 >> 172.21.15.148:0/3564443967 conn(0x560e9c280310 msgr2=0x560e9c2b3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:58.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.321+0000 7ff6d53f6740 1 -- 172.21.15.148:0/3564443967 shutdown_connections 2024-09-19T07:11:58.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.321+0000 7ff6d53f6740 1 -- 172.21.15.148:0/3564443967 wait complete. 2024-09-19T07:11:58.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.322+0000 7ff6d53f6740 1 -- start start 2024-09-19T07:11:58.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.322+0000 7ff6d53f6740 1 Processor -- start 2024-09-19T07:11:58.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.322+0000 7ff6d53f6740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560e9c2b75d0 0x560e9c2c61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:58.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.322+0000 7ff6d53f6740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560e9c2b8b40 0x560e9c2c3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:58.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.322+0000 7ff6d53f6740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e9c2c6780 0x560e9c2c3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:58.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.322+0000 7ff6d53f6740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x560e9c2c9480 con 0x560e9c2b8b40 2024-09-19T07:11:58.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.322+0000 7ff6d53f6740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x560e9c1d8060 con 0x560e9c2c6780 2024-09-19T07:11:58.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.322+0000 7ff6d53f6740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x560e9c2c9600 con 0x560e9c2b75d0 2024-09-19T07:11:58.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.322+0000 7ff6cbfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560e9c2b8b40 0x560e9c2c3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:58.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.322+0000 7ff6d53f6740 10 client.0 _ll_register_callbacks cb 0x560e9bf2b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:11:58.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.322+0000 7ff6cbfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560e9c2b8b40 0x560e9c2c3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47408/0 (socket says 172.21.15.148:47408) 2024-09-19T07:11:58.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.322+0000 7ff6cbfff640 1 -- 172.21.15.148:0/1331368444 learned_addr learned my addr 172.21.15.148:0/1331368444 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:58.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.323+0000 7ff6d15ba640 1 --2- 172.21.15.148:0/1331368444 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e9c2c6780 0x560e9c2c3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:58.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.323+0000 7ff6d0db9640 1 --2- 172.21.15.148:0/1331368444 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560e9c2b75d0 0x560e9c2c61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:58.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.323+0000 7ff6cbfff640 1 -- 172.21.15.148:0/1331368444 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560e9c2b75d0 msgr2=0x560e9c2c61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:58.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.323+0000 7ff6cbfff640 1 --2- 172.21.15.148:0/1331368444 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560e9c2b75d0 0x560e9c2c61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:58.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.323+0000 7ff6cbfff640 1 -- 172.21.15.148:0/1331368444 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e9c2c6780 msgr2=0x560e9c2c3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:58.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.323+0000 7ff6cbfff640 1 --2- 172.21.15.148:0/1331368444 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e9c2c6780 0x560e9c2c3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:58.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.323+0000 7ff6cbfff640 1 -- 172.21.15.148:0/1331368444 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e9bf8e3c0 con 0x560e9c2b8b40 2024-09-19T07:11:58.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.323+0000 7ff6cbfff640 1 --2- 172.21.15.148:0/1331368444 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560e9c2b8b40 0x560e9c2c3480 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7ff6b800fff0 tx=0x7ff6b8010600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c31ea8d0174294c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:58.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.323+0000 7ff6abfff640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:11:58.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.323+0000 7ff6abfff640 1 -- 172.21.15.148:0/1331368444 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b8010d20 con 0x560e9c2b8b40 2024-09-19T07:11:58.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.324+0000 7ff6abfff640 1 -- 172.21.15.148:0/1331368444 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7ff6b801d420 con 0x560e9c2b8b40 2024-09-19T07:11:58.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.324+0000 7ff6d53f6740 1 -- 172.21.15.148:0/1331368444 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6b801dca0 con 0x560e9c2b8b40 2024-09-19T07:11:58.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.324+0000 7ff6abfff640 1 -- 172.21.15.148:0/1331368444 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff6b803c050 con 0x560e9c2b8b40 2024-09-19T07:11:58.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.324+0000 7ff6d53f6740 10 client.15561 fetch_fsmap learned FSMap version 25 2024-09-19T07:11:58.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.324+0000 7ff6d53f6740 1 -- 172.21.15.148:0/1331368444 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560e9c2d4f90 con 0x560e9c2b8b40 2024-09-19T07:11:58.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.324+0000 7ff6abfff640 1 -- 172.21.15.148:0/1331368444 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6b801dca0 con 0x560e9c2b8b40 2024-09-19T07:11:58.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.324+0000 7ff6abfff640 1 -- 172.21.15.148:0/1331368444 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff6b802e880 con 0x560e9c2b8b40 2024-09-19T07:11:58.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.324+0000 7ff6d53f6740 10 client.15561 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:11:58.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.324+0000 7ff6d53f6740 10 client.15561 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:11:58.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.324+0000 7ff6d53f6740 20 client.15561 populate_metadata read hostname 'smithi148' 2024-09-19T07:11:58.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.324+0000 7ff6d53f6740 1 --2- 172.21.15.148:0/1331368444 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x560e9c2d6390 0x560e9c2d8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:58.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.324+0000 7ff6d53f6740 4 client.15561 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:11:58.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.324+0000 7ff6d53f6740 1 -- 172.21.15.148:0/1331368444 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560e9c22a860 con 0x560e9c2d6390 2024-09-19T07:11:58.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.325+0000 7ff6d0db9640 1 --2- 172.21.15.148:0/1331368444 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x560e9c2d6390 0x560e9c2d8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:58.336 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.325+0000 7ff6d0db9640 1 --2- 172.21.15.148:0/1331368444 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x560e9c2d6390 0x560e9c2d8780 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92ccb6693086d779 server_cookie=a89a035a8c3f01cb in_seq=0 out_seq=0 2024-09-19T07:11:58.336 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.325+0000 7ff6abfff640 10 client.15561 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:11:58.336 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.326+0000 7ff6abfff640 1 -- 172.21.15.148:0/1331368444 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560e9c22a860 con 0x560e9c2d6390 2024-09-19T07:11:58.336 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.326+0000 7ff6abfff640 10 client.15561 handle_command_reply: tid=0 2024-09-19T07:11:58.336 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.326+0000 7ff6d53f6740 1 client.15561 shutdown 2024-09-19T07:11:58.336 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.326+0000 7ff6d53f6740 1 -- 172.21.15.148:0/1331368444 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560e9c2b8b40 msgr2=0x560e9c2c3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:58.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.326+0000 7ff6d53f6740 1 --2- 172.21.15.148:0/1331368444 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560e9c2b8b40 0x560e9c2c3480 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7ff6b800fff0 tx=0x7ff6b8010600 comp rx=0 tx=0).stop 2024-09-19T07:11:58.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.327+0000 7ff6d53f6740 1 -- 172.21.15.148:0/1331368444 shutdown_connections 2024-09-19T07:11:58.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.327+0000 7ff6d53f6740 1 --2- 172.21.15.148:0/1331368444 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x560e9c2d6390 0x560e9c2d8780 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:58.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.327+0000 7ff6d53f6740 1 --2- 172.21.15.148:0/1331368444 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e9c2c6780 0x560e9c2c3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:58.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.327+0000 7ff6abfff640 0 client.15561 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:11:58.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.327+0000 7ff6d53f6740 1 --2- 172.21.15.148:0/1331368444 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560e9c2b8b40 0x560e9c2c3480 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:58.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.327+0000 7ff6d53f6740 1 --2- 172.21.15.148:0/1331368444 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560e9c2b75d0 0x560e9c2c61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:58.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.327+0000 7ff6d53f6740 1 -- 172.21.15.148:0/1331368444 >> 172.21.15.148:0/1331368444 conn(0x560e9c280310 msgr2=0x560e9c2b9960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:58.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.327+0000 7ff6d53f6740 1 -- 172.21.15.148:0/1331368444 shutdown_connections 2024-09-19T07:11:58.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.327+0000 7ff6d53f6740 1 -- 172.21.15.148:0/1331368444 wait complete. 2024-09-19T07:11:58.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.327+0000 7ff6d53f6740 20 client.15561 trim_cache size 0 max 16384 2024-09-19T07:11:58.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.351+0000 7ff6d53f6740 1 Processor -- start 2024-09-19T07:11:58.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.351+0000 7ff6d53f6740 1 -- start start 2024-09-19T07:11:58.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.352+0000 7ff6d53f6740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e9c2b75d0 0x560e9c2b3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:58.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.352+0000 7ff6d53f6740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560e9c2c6780 0x560e9c2c2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:58.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.352+0000 7ff6d53f6740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560e9c2d6390 0x560e9c2ddd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:58.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.352+0000 7ff6d53f6740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff6cc1adff0 con 0x560e9c2c6780 2024-09-19T07:11:58.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.352+0000 7ff6d53f6740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff6cc1ab8c0 con 0x560e9c2b75d0 2024-09-19T07:11:58.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.352+0000 7ff6d53f6740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff6cc1a96f0 con 0x560e9c2d6390 2024-09-19T07:11:58.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.352+0000 7ff6cbfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560e9c2c6780 0x560e9c2c2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:58.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.352+0000 7ff6cbfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560e9c2c6780 0x560e9c2c2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47416/0 (socket says 172.21.15.148:47416) 2024-09-19T07:11:58.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.352+0000 7ff6cbfff640 1 -- 172.21.15.148:0/2766972892 learned_addr learned my addr 172.21.15.148:0/2766972892 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:58.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.352+0000 7ff6cbfff640 1 -- 172.21.15.148:0/2766972892 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560e9c2d6390 msgr2=0x560e9c2ddd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:58.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.352+0000 7ff6cbfff640 1 --2- 172.21.15.148:0/2766972892 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560e9c2d6390 0x560e9c2ddd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:58.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.352+0000 7ff6cbfff640 1 -- 172.21.15.148:0/2766972892 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e9c2b75d0 msgr2=0x560e9c2b3d70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T07:11:58.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.352+0000 7ff6cbfff640 1 --2- 172.21.15.148:0/2766972892 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e9c2b75d0 0x560e9c2b3d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:58.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.352+0000 7ff6cbfff640 1 -- 172.21.15.148:0/2766972892 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e9c2b4960 con 0x560e9c2c6780 2024-09-19T07:11:58.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.353+0000 7ff6cbfff640 1 --2- 172.21.15.148:0/2766972892 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560e9c2c6780 0x560e9c2c2330 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8005890 tx=0x7ff6b800bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=777070448ff5440f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:58.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.353+0000 7ff6b67fc640 1 -- 172.21.15.148:0/2766972892 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b8010870 con 0x560e9c2c6780 2024-09-19T07:11:58.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.353+0000 7ff6b67fc640 1 -- 172.21.15.148:0/2766972892 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6b8033070 con 0x560e9c2c6780 2024-09-19T07:11:58.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.353+0000 7ff6b67fc640 1 -- 172.21.15.148:0/2766972892 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b8012040 con 0x560e9c2c6780 2024-09-19T07:11:58.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.354+0000 7ff6d53f6740 1 -- 172.21.15.148:0/2766972892 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560e9c2c6780 msgr2=0x560e9c2c2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:58.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.354+0000 7ff6d53f6740 1 --2- 172.21.15.148:0/2766972892 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560e9c2c6780 0x560e9c2c2330 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8005890 tx=0x7ff6b800bfd0 comp rx=0 tx=0).stop 2024-09-19T07:11:58.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.354+0000 7ff6d53f6740 1 -- 172.21.15.148:0/2766972892 shutdown_connections 2024-09-19T07:11:58.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.354+0000 7ff6d53f6740 1 --2- 172.21.15.148:0/2766972892 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560e9c2d6390 0x560e9c2ddd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:58.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.354+0000 7ff6d53f6740 1 --2- 172.21.15.148:0/2766972892 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560e9c2c6780 0x560e9c2c2330 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:58.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.354+0000 7ff6d53f6740 1 --2- 172.21.15.148:0/2766972892 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e9c2b75d0 0x560e9c2b3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:58.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.354+0000 7ff6d53f6740 1 -- 172.21.15.148:0/2766972892 >> 172.21.15.148:0/2766972892 conn(0x560e9c280310 msgr2=0x560e9c2c1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:58.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.354+0000 7ff6d53f6740 1 -- 172.21.15.148:0/2766972892 shutdown_connections 2024-09-19T07:11:58.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.354+0000 7ff6d53f6740 1 -- 172.21.15.148:0/2766972892 wait complete. 2024-09-19T07:11:58.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.354+0000 7ff6d53f6740 1 -- start start 2024-09-19T07:11:58.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.354+0000 7ff6d53f6740 1 Processor -- start 2024-09-19T07:11:58.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.355+0000 7ff6d53f6740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560e9c2b75d0 0x560e9c2ba900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:58.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.355+0000 7ff6d53f6740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e9c2c6780 0x560e9c2bae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:58.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.355+0000 7ff6d53f6740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560e9c2d6390 0x560e9c2bb380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:58.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.355+0000 7ff6d53f6740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff6cc1a9d80 con 0x560e9c2d6390 2024-09-19T07:11:58.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.355+0000 7ff6d53f6740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff6cc1ab1f0 con 0x560e9c2c6780 2024-09-19T07:11:58.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.355+0000 7ff6d53f6740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff6cc1aa450 con 0x560e9c2b75d0 2024-09-19T07:11:58.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.355+0000 7ff6d53f6740 10 client.0 _ll_register_callbacks cb 0x7ff6c40cda30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:11:58.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.355+0000 7ff6d15ba640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560e9c2d6390 0x560e9c2bb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:58.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.355+0000 7ff6d15ba640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560e9c2d6390 0x560e9c2bb380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47420/0 (socket says 172.21.15.148:47420) 2024-09-19T07:11:58.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.355+0000 7ff6d15ba640 1 -- 172.21.15.148:0/495001531 learned_addr learned my addr 172.21.15.148:0/495001531 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:58.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.355+0000 7ff6d0db9640 1 --2- 172.21.15.148:0/495001531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560e9c2b75d0 0x560e9c2ba900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:58.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.355+0000 7ff6cbfff640 1 --2- 172.21.15.148:0/495001531 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e9c2c6780 0x560e9c2bae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:58.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.355+0000 7ff6d15ba640 1 -- 172.21.15.148:0/495001531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560e9c2b75d0 msgr2=0x560e9c2ba900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:58.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.355+0000 7ff6d15ba640 1 --2- 172.21.15.148:0/495001531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560e9c2b75d0 0x560e9c2ba900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:58.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.355+0000 7ff6d15ba640 1 -- 172.21.15.148:0/495001531 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e9c2c6780 msgr2=0x560e9c2bae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:11:58.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.355+0000 7ff6d15ba640 1 --2- 172.21.15.148:0/495001531 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e9c2c6780 0x560e9c2bae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:58.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.355+0000 7ff6d15ba640 1 -- 172.21.15.148:0/495001531 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e9c2cdaf0 con 0x560e9c2d6390 2024-09-19T07:11:58.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.356+0000 7ff6d15ba640 1 --2- 172.21.15.148:0/495001531 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560e9c2d6390 0x560e9c2bb380 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ff6c40a4dc0 tx=0x7ff6c409c280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c93c78049ce85db5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:58.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.356+0000 7ff6abfff640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:11:58.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.356+0000 7ff6abfff640 1 -- 172.21.15.148:0/495001531 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c40ce050 con 0x560e9c2d6390 2024-09-19T07:11:58.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.356+0000 7ff6abfff640 1 -- 172.21.15.148:0/495001531 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7ff6c409c8e0 con 0x560e9c2d6390 2024-09-19T07:11:58.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.356+0000 7ff6d53f6740 1 -- 172.21.15.148:0/495001531 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6b8033070 con 0x560e9c2d6390 2024-09-19T07:11:58.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.356+0000 7ff6abfff640 1 -- 172.21.15.148:0/495001531 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff6c409c680 con 0x560e9c2d6390 2024-09-19T07:11:58.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.356+0000 7ff6d53f6740 10 client.15567 fetch_fsmap learned FSMap version 25 2024-09-19T07:11:58.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.356+0000 7ff6d53f6740 1 -- 172.21.15.148:0/495001531 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560e9c2cee50 con 0x560e9c2d6390 2024-09-19T07:11:58.366 INFO:teuthology.orchestra.run.smithi148.stdout:[] 2024-09-19T07:11:58.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.356+0000 7ff6abfff640 1 -- 172.21.15.148:0/495001531 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6b8033070 con 0x560e9c2d6390 2024-09-19T07:11:58.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.357+0000 7ff6abfff640 1 -- 172.21.15.148:0/495001531 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff6c40a4e60 con 0x560e9c2d6390 2024-09-19T07:11:58.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.357+0000 7ff6d53f6740 10 client.15567 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:11:58.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.357+0000 7ff6d53f6740 10 client.15567 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:11:58.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.357+0000 7ff6d53f6740 20 client.15567 populate_metadata read hostname 'smithi148' 2024-09-19T07:11:58.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.357+0000 7ff6d53f6740 1 --2- 172.21.15.148:0/495001531 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x560e9c345540 0x560e9c347930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:58.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.357+0000 7ff6d53f6740 4 client.15567 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:11:58.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.357+0000 7ff6d53f6740 1 -- 172.21.15.148:0/495001531 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560e9c224d70 con 0x560e9c345540 2024-09-19T07:11:58.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.358+0000 7ff6d0db9640 1 --2- 172.21.15.148:0/495001531 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x560e9c345540 0x560e9c347930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:58.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.358+0000 7ff6d0db9640 1 --2- 172.21.15.148:0/495001531 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x560e9c345540 0x560e9c347930 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7f68e27f806ed2a server_cookie=fcc34b7880164fbd in_seq=0 out_seq=0 2024-09-19T07:11:58.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.358+0000 7ff6abfff640 10 client.15567 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:11:58.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.358+0000 7ff6abfff640 1 -- 172.21.15.148:0/495001531 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560e9c224d70 con 0x560e9c345540 2024-09-19T07:11:58.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.358+0000 7ff6abfff640 10 client.15567 handle_command_reply: tid=0 2024-09-19T07:11:58.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.358+0000 7ff6d53f6740 1 client.15567 shutdown 2024-09-19T07:11:58.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.358+0000 7ff6d53f6740 1 -- 172.21.15.148:0/495001531 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560e9c2d6390 msgr2=0x560e9c2bb380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:58.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.358+0000 7ff6d53f6740 1 --2- 172.21.15.148:0/495001531 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560e9c2d6390 0x560e9c2bb380 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ff6c40a4dc0 tx=0x7ff6c409c280 comp rx=0 tx=0).stop 2024-09-19T07:11:58.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.358+0000 7ff6d53f6740 1 -- 172.21.15.148:0/495001531 shutdown_connections 2024-09-19T07:11:58.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.358+0000 7ff6d53f6740 1 --2- 172.21.15.148:0/495001531 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x560e9c345540 0x560e9c347930 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:58.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.358+0000 7ff6d53f6740 1 --2- 172.21.15.148:0/495001531 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560e9c2d6390 0x560e9c2bb380 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:58.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.358+0000 7ff6d53f6740 1 --2- 172.21.15.148:0/495001531 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e9c2c6780 0x560e9c2bae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:58.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.358+0000 7ff6d53f6740 1 --2- 172.21.15.148:0/495001531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560e9c2b75d0 0x560e9c2ba900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:58.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.358+0000 7ff6d53f6740 1 -- 172.21.15.148:0/495001531 >> 172.21.15.148:0/495001531 conn(0x560e9c280310 msgr2=0x560e9c2d1710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:58.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.358+0000 7ff6abfff640 0 client.15567 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:11:58.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.359+0000 7ff6d53f6740 1 -- 172.21.15.148:0/495001531 shutdown_connections 2024-09-19T07:11:58.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.359+0000 7ff6d53f6740 1 -- 172.21.15.148:0/495001531 wait complete. 2024-09-19T07:11:58.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.359+0000 7ff6d53f6740 20 client.15567 trim_cache size 0 max 16384 2024-09-19T07:11:58.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.359+0000 7ff6d301d640 1 -- 172.21.15.148:0/2773752146 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7ff6bc0a34c0 msgr2=0x7ff6bc0a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:58.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.359+0000 7ff6d301d640 1 --2- 172.21.15.148:0/2773752146 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7ff6bc0a34c0 0x7ff6bc0a5980 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff6b80058c0 tx=0x7ff6b800f730 comp rx=0 tx=0).stop 2024-09-19T07:11:58.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.359+0000 7ff6d301d640 1 -- 172.21.15.148:0/2773752146 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6cc1082a0 msgr2=0x7ff6cc19ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:58.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.359+0000 7ff6d301d640 1 --2- 172.21.15.148:0/2773752146 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6cc1082a0 0x7ff6cc19ceb0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ff6c400eb10 tx=0x7ff6c400c2d0 comp rx=0 tx=0).stop 2024-09-19T07:11:58.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.359+0000 7ff6d301d640 1 -- 172.21.15.148:0/2773752146 shutdown_connections 2024-09-19T07:11:58.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.359+0000 7ff6d301d640 1 --2- 172.21.15.148:0/2773752146 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7ff6bc0a34c0 0x7ff6bc0a5980 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:58.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.359+0000 7ff6d301d640 1 --2- 172.21.15.148:0/2773752146 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6cc1082a0 0x7ff6cc19ceb0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:58.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.359+0000 7ff6d301d640 1 --2- 172.21.15.148:0/2773752146 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6cc1036e0 0x7ff6cc198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:58.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.359+0000 7ff6d301d640 1 --2- 172.21.15.148:0/2773752146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6cc102d30 0x7ff6cc1985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:58.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.359+0000 7ff6d301d640 1 -- 172.21.15.148:0/2773752146 >> 172.21.15.148:0/2773752146 conn(0x7ff6cc0fc7d0 msgr2=0x7ff6cc105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:58.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.360+0000 7ff6d301d640 1 -- 172.21.15.148:0/2773752146 shutdown_connections 2024-09-19T07:11:58.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:58.360+0000 7ff6d301d640 1 -- 172.21.15.148:0/2773752146 wait complete. 2024-09-19T07:11:58.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:11:58 smithi148 ceph-mon[31180]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-19T07:11:58.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:11:58 smithi165 ceph-mon[35326]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-19T07:11:58.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:11:58 smithi179 ceph-mon[35716]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-19T07:11:59.010 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:11:59.316 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:11:59.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:59.821+0000 7f8703d22640 1 -- 172.21.15.148:0/831613374 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86fc100a70 msgr2=0x7f86fc100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:59.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:59.821+0000 7f8703d22640 1 --2- 172.21.15.148:0/831613374 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86fc100a70 0x7f86fc100ed0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f86ec009930 tx=0x7f86ec02a420 comp rx=0 tx=0).stop 2024-09-19T07:11:59.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:59.821+0000 7f8703d22640 1 -- 172.21.15.148:0/831613374 shutdown_connections 2024-09-19T07:11:59.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:59.821+0000 7f8703d22640 1 --2- 172.21.15.148:0/831613374 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86fc101410 0x7f86fc10d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:59.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:59.821+0000 7f8703d22640 1 --2- 172.21.15.148:0/831613374 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86fc100a70 0x7f86fc100ed0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:59.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:59.821+0000 7f8703d22640 1 --2- 172.21.15.148:0/831613374 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86fc106a70 0x7f86fc106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:59.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:59.821+0000 7f8703d22640 1 -- 172.21.15.148:0/831613374 >> 172.21.15.148:0/831613374 conn(0x7f86fc0fc790 msgr2=0x7f86fc0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:11:59.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:59.821+0000 7f8703d22640 1 -- 172.21.15.148:0/831613374 shutdown_connections 2024-09-19T07:11:59.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:59.821+0000 7f8703d22640 1 -- 172.21.15.148:0/831613374 wait complete. 2024-09-19T07:11:59.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:59.822+0000 7f8703d22640 1 Processor -- start 2024-09-19T07:11:59.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:59.822+0000 7f8703d22640 1 -- start start 2024-09-19T07:11:59.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:59.822+0000 7f8703d22640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86fc100a70 0x7f86fc199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:59.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:59.823+0000 7f8703d22640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86fc101410 0x7f86fc199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:59.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:59.823+0000 7f8703d22640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86fc106a70 0x7f86fc1a43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:59.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:59.823+0000 7f8703d22640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f86fc110e70 con 0x7f86fc106a70 2024-09-19T07:11:59.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:59.823+0000 7f8703d22640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f86fc110cf0 con 0x7f86fc101410 2024-09-19T07:11:59.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:59.823+0000 7f8703d22640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f86fc110ff0 con 0x7f86fc100a70 2024-09-19T07:11:59.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:59.823+0000 7f87022bf640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86fc106a70 0x7f86fc1a43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:59.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:59.823+0000 7f87022bf640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86fc106a70 0x7f86fc1a43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47430/0 (socket says 172.21.15.148:47430) 2024-09-19T07:11:59.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:59.823+0000 7f87022bf640 1 -- 172.21.15.148:0/4062519435 learned_addr learned my addr 172.21.15.148:0/4062519435 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:11:59.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:59.823+0000 7f8701abe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86fc100a70 0x7f86fc199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:59.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:59.823+0000 7f87012bd640 1 --2- 172.21.15.148:0/4062519435 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86fc101410 0x7f86fc199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:59.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:59.823+0000 7f87022bf640 1 -- 172.21.15.148:0/4062519435 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86fc100a70 msgr2=0x7f86fc199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:59.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:59.823+0000 7f87022bf640 1 --2- 172.21.15.148:0/4062519435 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86fc100a70 0x7f86fc199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:59.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:59.823+0000 7f87022bf640 1 -- 172.21.15.148:0/4062519435 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86fc101410 msgr2=0x7f86fc199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:11:59.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:59.823+0000 7f87022bf640 1 --2- 172.21.15.148:0/4062519435 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86fc101410 0x7f86fc199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:11:59.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:59.823+0000 7f87022bf640 1 -- 172.21.15.148:0/4062519435 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86fc1a4900 con 0x7f86fc106a70 2024-09-19T07:11:59.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:59.823+0000 7f87022bf640 1 --2- 172.21.15.148:0/4062519435 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86fc106a70 0x7f86fc1a43c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f86f4016fd0 tx=0x7f86f400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:59.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:59.824+0000 7f86f2ffd640 1 -- 172.21.15.148:0/4062519435 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f4004b20 con 0x7f86fc106a70 2024-09-19T07:11:59.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:59.824+0000 7f86f2ffd640 1 -- 172.21.15.148:0/4062519435 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86f4004cc0 con 0x7f86fc106a70 2024-09-19T07:11:59.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:59.824+0000 7f86f2ffd640 1 -- 172.21.15.148:0/4062519435 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f4005580 con 0x7f86fc106a70 2024-09-19T07:11:59.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:59.824+0000 7f8703d22640 1 -- 172.21.15.148:0/4062519435 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86fc197130 con 0x7f86fc106a70 2024-09-19T07:11:59.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:59.824+0000 7f8703d22640 1 -- 172.21.15.148:0/4062519435 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86fc1975f0 con 0x7f86fc106a70 2024-09-19T07:11:59.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:59.825+0000 7f8703d22640 1 -- 172.21.15.148:0/4062519435 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86fc1021b0 con 0x7f86fc106a70 2024-09-19T07:11:59.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:59.827+0000 7f86f2ffd640 1 -- 172.21.15.148:0/4062519435 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f86f4005720 con 0x7f86fc106a70 2024-09-19T07:11:59.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:59.828+0000 7f86f2ffd640 1 --2- 172.21.15.148:0/4062519435 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f86e80a34c0 0x7f86e80a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:11:59.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:59.828+0000 7f8701abe640 1 --2- 172.21.15.148:0/4062519435 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f86e80a34c0 0x7f86e80a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:11:59.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:59.828+0000 7f86f2ffd640 1 -- 172.21.15.148:0/4062519435 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f86f40d7e50 con 0x7f86fc106a70 2024-09-19T07:11:59.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:59.829+0000 7f8701abe640 1 --2- 172.21.15.148:0/4062519435 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f86e80a34c0 0x7f86e80a5980 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f86f8005fd0 tx=0x7f86f8011040 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:11:59.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:11:59.832+0000 7f86f2ffd640 1 -- 172.21.15.148:0/4062519435 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f86f40a4110 con 0x7f86fc106a70 2024-09-19T07:12:00.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:00.076+0000 7f8703d22640 1 -- 172.21.15.148:0/4062519435 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f86fc108fe0 con 0x7f86fc106a70 2024-09-19T07:12:00.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:00.077+0000 7f86f2ffd640 1 -- 172.21.15.148:0/4062519435 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11939 (secure 0 0 0) 0x7f86f40a8410 con 0x7f86fc106a70 2024-09-19T07:12:00.078 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:12:00.078 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":25,"btime":"2024-09-19T07:11:04:227331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/4263868576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":4263868576},{"type":"v1","addr":"172.21.15.148:6841","nonce":4263868576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24383,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2146820965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2146820965},{"type":"v1","addr":"172.21.15.165:6835","nonce":2146820965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:09:19.543369+0000","modified":"2024-09-19T07:11:03.969598+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24457,"mds_1":24437,"mds_2":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/1566489108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1566489108},{"type":"v1","addr":"172.21.15.179:6835","nonce":1566489108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.165:6839/3993490234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":3993490234},{"type":"v1","addr":"172.21.15.165:6839","nonce":3993490234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24457,"qdb_cluster":[24457,24437,24436]},"id":1}]} 2024-09-19T07:12:00.078 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 25 2024-09-19T07:12:00.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:00.079+0000 7f8703d22640 1 -- 172.21.15.148:0/4062519435 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f86e80a34c0 msgr2=0x7f86e80a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:00.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:00.079+0000 7f8703d22640 1 --2- 172.21.15.148:0/4062519435 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f86e80a34c0 0x7f86e80a5980 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f86f8005fd0 tx=0x7f86f8011040 comp rx=0 tx=0).stop 2024-09-19T07:12:00.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:00.079+0000 7f8703d22640 1 -- 172.21.15.148:0/4062519435 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86fc106a70 msgr2=0x7f86fc1a43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:00.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:00.079+0000 7f8703d22640 1 --2- 172.21.15.148:0/4062519435 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86fc106a70 0x7f86fc1a43c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f86f4016fd0 tx=0x7f86f400c940 comp rx=0 tx=0).stop 2024-09-19T07:12:00.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:00.079+0000 7f8703d22640 1 -- 172.21.15.148:0/4062519435 shutdown_connections 2024-09-19T07:12:00.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:00.079+0000 7f8703d22640 1 --2- 172.21.15.148:0/4062519435 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f86e80a34c0 0x7f86e80a5980 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:00.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:00.079+0000 7f8703d22640 1 --2- 172.21.15.148:0/4062519435 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86fc106a70 0x7f86fc1a43c0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:00.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:00.079+0000 7f8703d22640 1 --2- 172.21.15.148:0/4062519435 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86fc101410 0x7f86fc199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:00.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:00.079+0000 7f8703d22640 1 --2- 172.21.15.148:0/4062519435 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86fc100a70 0x7f86fc199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:00.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:00.079+0000 7f8703d22640 1 -- 172.21.15.148:0/4062519435 >> 172.21.15.148:0/4062519435 conn(0x7f86fc0fc790 msgr2=0x7f86fc0fd120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:00.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:00.080+0000 7f8703d22640 1 -- 172.21.15.148:0/4062519435 shutdown_connections 2024-09-19T07:12:00.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:00.080+0000 7f8703d22640 1 -- 172.21.15.148:0/4062519435 wait complete. 2024-09-19T07:12:00.085 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T07:12:00.085 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T07:12:00.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:00 smithi148 ceph-mon[31180]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-09-19T07:12:00.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:00 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/4062519435' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:12:00.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:00 smithi179 ceph-mon[35716]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-09-19T07:12:00.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:00 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/4062519435' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:12:00.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:00 smithi165 ceph-mon[35326]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-09-19T07:12:00.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:00 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/4062519435' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:12:00.758 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24457 quiesce db --set-id 15c8d75c --release --await' 2024-09-19T07:12:00.759 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24457 quiesce db --set-id 15c8d75c --release --await 2024-09-19T07:12:00.875 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:12:01.009 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:12:00 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:12:00.851+0000 7f0eb164f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:12:01.009 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:12:00 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:12:00.851+0000 7f0eb164f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:12:01.010 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:12:00 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:12:00.851+0000 7f0eb164f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:12:01.010 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:12:00 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:12:00.851+0000 7f0eb164f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:12:01.010 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:12:00 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:12:00.851+0000 7f0eb164f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:12:01.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.475+0000 7fe3f8d6f640 1 -- 172.21.15.148:0/759345008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3f4100e20 msgr2=0x7fe3f4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:01.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.475+0000 7fe3f8d6f640 1 --2- 172.21.15.148:0/759345008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3f4100e20 0x7fe3f4101200 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8009900 tx=0x7fe3e802a480 comp rx=0 tx=0).stop 2024-09-19T07:12:01.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.475+0000 7fe3f8d6f640 1 -- 172.21.15.148:0/759345008 shutdown_connections 2024-09-19T07:12:01.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.475+0000 7fe3f8d6f640 1 --2- 172.21.15.148:0/759345008 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3f4102ef0 0x7fe3f410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:01.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.475+0000 7fe3f8d6f640 1 --2- 172.21.15.148:0/759345008 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3f4102570 0x7fe3f41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:01.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.475+0000 7fe3f8d6f640 1 --2- 172.21.15.148:0/759345008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3f4100e20 0x7fe3f4101200 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:01.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.475+0000 7fe3f8d6f640 1 -- 172.21.15.148:0/759345008 >> 172.21.15.148:0/759345008 conn(0x7fe3f40fc7d0 msgr2=0x7fe3f40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:01.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.477+0000 7fe3f8d6f640 1 -- 172.21.15.148:0/759345008 shutdown_connections 2024-09-19T07:12:01.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.477+0000 7fe3f8d6f640 1 -- 172.21.15.148:0/759345008 wait complete. 2024-09-19T07:12:01.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.478+0000 7fe3f8d6f640 1 Processor -- start 2024-09-19T07:12:01.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.478+0000 7fe3f8d6f640 1 -- start start 2024-09-19T07:12:01.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.479+0000 7fe3f8d6f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3f4100e20 0x7fe3f4107a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:01.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.479+0000 7fe3f8d6f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3f4102570 0x7fe3f4107f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:01.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.479+0000 7fe3f8d6f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3f4102ef0 0x7fe3f41084d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:01.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.479+0000 7fe3f8d6f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f410fe80 con 0x7fe3f4100e20 2024-09-19T07:12:01.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.479+0000 7fe3f8d6f640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f410fd00 con 0x7fe3f4102ef0 2024-09-19T07:12:01.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.479+0000 7fe3f8d6f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f4110000 con 0x7fe3f4102570 2024-09-19T07:12:01.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.479+0000 7fe3f259c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3f4100e20 0x7fe3f4107a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:01.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.479+0000 7fe3f259c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3f4100e20 0x7fe3f4107a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47462/0 (socket says 172.21.15.148:47462) 2024-09-19T07:12:01.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.479+0000 7fe3f259c640 1 -- 172.21.15.148:0/2057886577 learned_addr learned my addr 172.21.15.148:0/2057886577 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:01.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.479+0000 7fe3f1d9b640 1 --2- 172.21.15.148:0/2057886577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3f4102570 0x7fe3f4107f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:01.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.479+0000 7fe3f2d9d640 1 --2- 172.21.15.148:0/2057886577 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3f4102ef0 0x7fe3f41084d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:01.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.480+0000 7fe3f259c640 1 -- 172.21.15.148:0/2057886577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3f4102570 msgr2=0x7fe3f4107f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:01.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.480+0000 7fe3f259c640 1 --2- 172.21.15.148:0/2057886577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3f4102570 0x7fe3f4107f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:01.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.480+0000 7fe3f259c640 1 -- 172.21.15.148:0/2057886577 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3f4102ef0 msgr2=0x7fe3f41084d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:01.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.480+0000 7fe3f259c640 1 --2- 172.21.15.148:0/2057886577 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3f4102ef0 0x7fe3f41084d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:01.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.480+0000 7fe3f259c640 1 -- 172.21.15.148:0/2057886577 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3f41aade0 con 0x7fe3f4100e20 2024-09-19T07:12:01.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.480+0000 7fe3f259c640 1 --2- 172.21.15.148:0/2057886577 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3f4100e20 0x7fe3f4107a50 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8006010 tx=0x7fe3e8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:01.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.480+0000 7fe3e37fe640 1 -- 172.21.15.148:0/2057886577 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e803f070 con 0x7fe3f4100e20 2024-09-19T07:12:01.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.480+0000 7fe3f8d6f640 1 -- 172.21.15.148:0/2057886577 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3f41ab070 con 0x7fe3f4100e20 2024-09-19T07:12:01.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.480+0000 7fe3f8d6f640 1 -- 172.21.15.148:0/2057886577 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3f41ab5a0 con 0x7fe3f4100e20 2024-09-19T07:12:01.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.481+0000 7fe3e37fe640 1 -- 172.21.15.148:0/2057886577 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3e8031c20 con 0x7fe3f4100e20 2024-09-19T07:12:01.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.481+0000 7fe3e37fe640 1 -- 172.21.15.148:0/2057886577 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e8035030 con 0x7fe3f4100e20 2024-09-19T07:12:01.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.484+0000 7fe3fb148740 1 Processor -- start 2024-09-19T07:12:01.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.484+0000 7fe3fb148740 1 -- start start 2024-09-19T07:12:01.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.484+0000 7fe3e37fe640 1 -- 172.21.15.148:0/2057886577 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 24) ==== 138589+0+0 (secure 0 0 0) 0x7fe3e8042070 con 0x7fe3f4100e20 2024-09-19T07:12:01.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.485+0000 7fe3fb148740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a09fc00b60 0x55a09fc00f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:01.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.485+0000 7fe3fb148740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a09fc01480 0x55a09fc0b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:01.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.485+0000 7fe3fb148740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a09fc0bd40 0x55a09fc0e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:01.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.485+0000 7fe3fb148740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55a09fb66280 con 0x55a09fc00b60 2024-09-19T07:12:01.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.485+0000 7fe3fb148740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55a09fb0db10 con 0x55a09fc01480 2024-09-19T07:12:01.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.485+0000 7fe3fb148740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a09fb62240 con 0x55a09fc0bd40 2024-09-19T07:12:01.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.485+0000 7fe3f2d9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a09fc00b60 0x55a09fc00f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:01.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.485+0000 7fe3f2d9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a09fc00b60 0x55a09fc00f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47476/0 (socket says 172.21.15.148:47476) 2024-09-19T07:12:01.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.485+0000 7fe3f2d9d640 1 -- 172.21.15.148:0/1153779525 learned_addr learned my addr 172.21.15.148:0/1153779525 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:01.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.485+0000 7fe3f259c640 1 --2- 172.21.15.148:0/1153779525 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a09fc01480 0x55a09fc0b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:01.490 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.486+0000 7fe3f2d9d640 1 -- 172.21.15.148:0/1153779525 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a09fc0bd40 msgr2=0x55a09fc0e130 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T07:12:01.490 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.486+0000 7fe3f2d9d640 1 --2- 172.21.15.148:0/1153779525 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a09fc0bd40 0x55a09fc0e130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:01.490 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.486+0000 7fe3f2d9d640 1 -- 172.21.15.148:0/1153779525 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a09fc01480 msgr2=0x55a09fc0b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:01.490 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.486+0000 7fe3f2d9d640 1 --2- 172.21.15.148:0/1153779525 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a09fc01480 0x55a09fc0b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:01.490 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.486+0000 7fe3f2d9d640 1 -- 172.21.15.148:0/1153779525 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a09fb1a1f0 con 0x55a09fc00b60 2024-09-19T07:12:01.490 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.486+0000 7fe3f2d9d640 1 --2- 172.21.15.148:0/1153779525 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a09fc00b60 0x55a09fc00f40 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec009f10 tx=0x7fe3ec00d6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8773b6375db32761 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:01.490 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.487+0000 7fe3e37fe640 1 --2- 172.21.15.148:0/2057886577 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe3dc0a3550 0x7fe3dc0a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:01.490 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.487+0000 7fe3e37fe640 1 -- 172.21.15.148:0/2057886577 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fe3e80f0580 con 0x7fe3f4100e20 2024-09-19T07:12:01.490 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.486+0000 7fe3e0ff9640 1 -- 172.21.15.148:0/1153779525 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec01b070 con 0x55a09fc00b60 2024-09-19T07:12:01.490 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.488+0000 7fe3f259c640 1 --2- 172.21.15.148:0/2057886577 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe3dc0a3550 0x7fe3dc0a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:01.490 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.488+0000 7fe3e0ff9640 1 -- 172.21.15.148:0/1153779525 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3ec0168f0 con 0x55a09fc00b60 2024-09-19T07:12:01.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.489+0000 7fe3e0ff9640 1 -- 172.21.15.148:0/1153779525 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec014810 con 0x55a09fc00b60 2024-09-19T07:12:01.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.489+0000 7fe3fb148740 1 -- 172.21.15.148:0/1153779525 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a09fc00b60 msgr2=0x55a09fc00f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:01.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.489+0000 7fe3fb148740 1 --2- 172.21.15.148:0/1153779525 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a09fc00b60 0x55a09fc00f40 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec009f10 tx=0x7fe3ec00d6b0 comp rx=0 tx=0).stop 2024-09-19T07:12:01.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.489+0000 7fe3f259c640 1 --2- 172.21.15.148:0/2057886577 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe3dc0a3550 0x7fe3dc0a5a10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe3e80edbc0 tx=0x7fe3e8031eb0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:01.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.490+0000 7fe3fb148740 1 -- 172.21.15.148:0/1153779525 shutdown_connections 2024-09-19T07:12:01.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.490+0000 7fe3fb148740 1 --2- 172.21.15.148:0/1153779525 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a09fc0bd40 0x55a09fc0e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:01.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.490+0000 7fe3fb148740 1 --2- 172.21.15.148:0/1153779525 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a09fc01480 0x55a09fc0b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:01.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.490+0000 7fe3fb148740 1 --2- 172.21.15.148:0/1153779525 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a09fc00b60 0x55a09fc00f40 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:01.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.490+0000 7fe3fb148740 1 -- 172.21.15.148:0/1153779525 >> 172.21.15.148:0/1153779525 conn(0x55a09fbfd0f0 msgr2=0x55a09fbfd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:01.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.490+0000 7fe3fb148740 1 -- 172.21.15.148:0/1153779525 shutdown_connections 2024-09-19T07:12:01.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.490+0000 7fe3fb148740 1 -- 172.21.15.148:0/1153779525 wait complete. 2024-09-19T07:12:01.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.491+0000 7fe3fb148740 1 -- start start 2024-09-19T07:12:01.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.491+0000 7fe3fb148740 1 Processor -- start 2024-09-19T07:12:01.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.492+0000 7fe3fb148740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a09fc00b60 0x55a09fc0b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:01.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.492+0000 7fe3fb148740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a09fc01480 0x55a09fc08b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:01.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.492+0000 7fe3fb148740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a09fc0bd40 0x55a09fc092e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:01.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.492+0000 7fe3fb148740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55a09fc0e960 con 0x55a09fc0bd40 2024-09-19T07:12:01.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.492+0000 7fe3fb148740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55a09fb20f10 con 0x55a09fc00b60 2024-09-19T07:12:01.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.492+0000 7fe3fb148740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a09fc0eae0 con 0x55a09fc01480 2024-09-19T07:12:01.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.492+0000 7fe3f2d9d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a09fc00b60 0x55a09fc0b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:01.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.492+0000 7fe3f2d9d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a09fc00b60 0x55a09fc0b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:56188/0 (socket says 172.21.15.148:56188) 2024-09-19T07:12:01.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.492+0000 7fe3f2d9d640 1 -- 172.21.15.148:0/1976482559 learned_addr learned my addr 172.21.15.148:0/1976482559 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:01.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.492+0000 7fe3f2d9d640 1 --2- 172.21.15.148:0/1976482559 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a09fc0bd40 0x55a09fc092e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:01.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.492+0000 7fe3f2d9d640 1 -- 172.21.15.148:0/1976482559 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a09fc01480 msgr2=0x55a09fc08b50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T07:12:01.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.492+0000 7fe3f2d9d640 1 --2- 172.21.15.148:0/1976482559 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a09fc01480 0x55a09fc08b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:01.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.492+0000 7fe3f2d9d640 1 -- 172.21.15.148:0/1976482559 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a09fc0bd40 msgr2=0x55a09fc092e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:01.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.492+0000 7fe3f2d9d640 1 --2- 172.21.15.148:0/1976482559 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a09fc0bd40 0x55a09fc092e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:01.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.492+0000 7fe3f2d9d640 1 -- 172.21.15.148:0/1976482559 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a09f8d76a0 con 0x55a09fc00b60 2024-09-19T07:12:01.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.493+0000 7fe3f2d9d640 1 --2- 172.21.15.148:0/1976482559 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a09fc00b60 0x55a09fc0b800 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec005c40 tx=0x7fe3ec005bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb7f7a8a6e921fa5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:01.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.493+0000 7fe3fb148740 10 client.0 _ll_register_callbacks cb 0x55a09fae9a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:12:01.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.493+0000 7fe3fb148740 1 -- 172.21.15.148:0/1976482559 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3ec0168f0 con 0x55a09fc00b60 2024-09-19T07:12:01.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.493+0000 7fe3d9ffb640 10 client.25070 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-19T07:12:01.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.493+0000 7fe3d9ffb640 1 -- 172.21.15.148:0/1976482559 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec02a060 con 0x55a09fc00b60 2024-09-19T07:12:01.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.493+0000 7fe3d9ffb640 1 -- 172.21.15.148:0/1976482559 <== mon.2 v2:172.21.15.165:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fe3ec004a40 con 0x55a09fc00b60 2024-09-19T07:12:01.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.493+0000 7fe3d9ffb640 1 -- 172.21.15.148:0/1976482559 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe3ec01b040 con 0x55a09fc00b60 2024-09-19T07:12:01.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.493+0000 7fe3fb148740 10 client.25070 fetch_fsmap learned FSMap version 25 2024-09-19T07:12:01.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.493+0000 7fe3fb148740 1 -- 172.21.15.148:0/1976482559 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({fsmap=25}) -- 0x55a09fc1a390 con 0x55a09fc00b60 2024-09-19T07:12:01.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.494+0000 7fe3d9ffb640 1 -- 172.21.15.148:0/1976482559 <== mon.2 v2:172.21.15.165:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe3ec004c60 con 0x55a09fc00b60 2024-09-19T07:12:01.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.494+0000 7fe3fb148740 10 client.25070 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:12:01.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.494+0000 7fe3fb148740 10 client.25070 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:12:01.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.494+0000 7fe3fb148740 20 client.25070 populate_metadata read hostname 'smithi148' 2024-09-19T07:12:01.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.494+0000 7fe3fb148740 1 --2- 172.21.15.148:0/1976482559 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55a09fc1b6e0 0x55a09fc1dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:01.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.494+0000 7fe3fb148740 4 client.25070 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:12:01.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.494+0000 7fe3fb148740 1 -- 172.21.15.148:0/1976482559 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a09fb737f0 con 0x55a09fc1b6e0 2024-09-19T07:12:01.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.494+0000 7fe3f1d9b640 1 --2- 172.21.15.148:0/1976482559 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55a09fc1b6e0 0x55a09fc1dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:01.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.495+0000 7fe3d9ffb640 10 client.25070 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:01.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.495+0000 7fe3f1d9b640 1 --2- 172.21.15.148:0/1976482559 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55a09fc1b6e0 0x55a09fc1dad0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85845c7c53988457 server_cookie=43d37be2d3880324 in_seq=0 out_seq=0 2024-09-19T07:12:01.501 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.496+0000 7fe3d9ffb640 1 -- 172.21.15.148:0/1976482559 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a09fb737f0 con 0x55a09fc1b6e0 2024-09-19T07:12:01.501 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.496+0000 7fe3d9ffb640 10 client.25070 handle_command_reply: tid=0 2024-09-19T07:12:01.501 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.496+0000 7fe3fb148740 1 client.25070 shutdown 2024-09-19T07:12:01.501 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.496+0000 7fe3fb148740 1 -- 172.21.15.148:0/1976482559 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a09fc00b60 msgr2=0x55a09fc0b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:01.501 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.496+0000 7fe3fb148740 1 --2- 172.21.15.148:0/1976482559 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a09fc00b60 0x55a09fc0b800 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec005c40 tx=0x7fe3ec005bd0 comp rx=0 tx=0).stop 2024-09-19T07:12:01.501 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.496+0000 7fe3fb148740 1 -- 172.21.15.148:0/1976482559 shutdown_connections 2024-09-19T07:12:01.501 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.496+0000 7fe3fb148740 1 --2- 172.21.15.148:0/1976482559 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55a09fc1b6e0 0x55a09fc1dad0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:01.501 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.496+0000 7fe3d9ffb640 0 client.25070 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:01.501 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.496+0000 7fe3fb148740 1 --2- 172.21.15.148:0/1976482559 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a09fc0bd40 0x55a09fc092e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:01.501 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.496+0000 7fe3fb148740 1 --2- 172.21.15.148:0/1976482559 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a09fc01480 0x55a09fc08b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:01.501 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.496+0000 7fe3fb148740 1 --2- 172.21.15.148:0/1976482559 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a09fc00b60 0x55a09fc0b800 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:01.501 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.496+0000 7fe3fb148740 1 -- 172.21.15.148:0/1976482559 >> 172.21.15.148:0/1976482559 conn(0x55a09fbfd0f0 msgr2=0x55a09fbfc270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:01.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.496+0000 7fe3fb148740 1 -- 172.21.15.148:0/1976482559 shutdown_connections 2024-09-19T07:12:01.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.496+0000 7fe3fb148740 1 -- 172.21.15.148:0/1976482559 wait complete. 2024-09-19T07:12:01.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.496+0000 7fe3fb148740 20 client.25070 trim_cache size 0 max 16384 2024-09-19T07:12:01.519 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:12:01.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.527+0000 7fe3fb148740 1 Processor -- start 2024-09-19T07:12:01.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.528+0000 7fe3fb148740 1 -- start start 2024-09-19T07:12:01.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.528+0000 7fe3fb148740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a09fc00b60 0x55a09fc07b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:01.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.528+0000 7fe3fb148740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a09fc01480 0x55a09fc23210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:01.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.528+0000 7fe3fb148740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a09fc0bd40 0x55a09fc23750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:01.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.528+0000 7fe3fb148740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d4010f70 con 0x55a09fc00b60 2024-09-19T07:12:01.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.528+0000 7fe3fb148740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d400e840 con 0x55a09fc01480 2024-09-19T07:12:01.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.528+0000 7fe3fb148740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d400c670 con 0x55a09fc0bd40 2024-09-19T07:12:01.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.528+0000 7fe3f2d9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a09fc00b60 0x55a09fc07b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:01.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.528+0000 7fe3f2d9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a09fc00b60 0x55a09fc07b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47486/0 (socket says 172.21.15.148:47486) 2024-09-19T07:12:01.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.528+0000 7fe3f2d9d640 1 -- 172.21.15.148:0/3209200054 learned_addr learned my addr 172.21.15.148:0/3209200054 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:01.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.528+0000 7fe3f2d9d640 1 --2- 172.21.15.148:0/3209200054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a09fc0bd40 0x55a09fc23750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:01.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.528+0000 7fe3f1d9b640 1 --2- 172.21.15.148:0/3209200054 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a09fc01480 0x55a09fc23210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:01.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.529+0000 7fe3f2d9d640 1 -- 172.21.15.148:0/3209200054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a09fc0bd40 msgr2=0x55a09fc23750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:01.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.529+0000 7fe3f2d9d640 1 --2- 172.21.15.148:0/3209200054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a09fc0bd40 0x55a09fc23750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:01.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.529+0000 7fe3f2d9d640 1 -- 172.21.15.148:0/3209200054 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a09fc01480 msgr2=0x55a09fc23210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:01.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.529+0000 7fe3f2d9d640 1 --2- 172.21.15.148:0/3209200054 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a09fc01480 0x55a09fc23210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:01.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.529+0000 7fe3f2d9d640 1 -- 172.21.15.148:0/3209200054 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a09fbf8830 con 0x55a09fc00b60 2024-09-19T07:12:01.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.529+0000 7fe3f1d9b640 1 --2- 172.21.15.148:0/3209200054 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a09fc01480 0x55a09fc23210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:12:01.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.529+0000 7fe3f2d9d640 1 --2- 172.21.15.148:0/3209200054 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a09fc00b60 0x55a09fc07b30 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec009f10 tx=0x7fe3ec010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7a1974b452427e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:01.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.529+0000 7fe3dbfff640 1 -- 172.21.15.148:0/3209200054 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec004ac0 con 0x55a09fc00b60 2024-09-19T07:12:01.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.529+0000 7fe3dbfff640 1 -- 172.21.15.148:0/3209200054 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3ec0168f0 con 0x55a09fc00b60 2024-09-19T07:12:01.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.529+0000 7fe3dbfff640 1 -- 172.21.15.148:0/3209200054 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec0146b0 con 0x55a09fc00b60 2024-09-19T07:12:01.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.530+0000 7fe3fb148740 1 -- 172.21.15.148:0/3209200054 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a09fc00b60 msgr2=0x55a09fc07b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:01.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.530+0000 7fe3fb148740 1 --2- 172.21.15.148:0/3209200054 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a09fc00b60 0x55a09fc07b30 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec009f10 tx=0x7fe3ec010000 comp rx=0 tx=0).stop 2024-09-19T07:12:01.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.530+0000 7fe3fb148740 1 -- 172.21.15.148:0/3209200054 shutdown_connections 2024-09-19T07:12:01.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.530+0000 7fe3fb148740 1 --2- 172.21.15.148:0/3209200054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a09fc0bd40 0x55a09fc23750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:01.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.530+0000 7fe3fb148740 1 --2- 172.21.15.148:0/3209200054 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a09fc01480 0x55a09fc23210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:01.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.530+0000 7fe3fb148740 1 --2- 172.21.15.148:0/3209200054 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a09fc00b60 0x55a09fc07b30 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:01.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.530+0000 7fe3fb148740 1 -- 172.21.15.148:0/3209200054 >> 172.21.15.148:0/3209200054 conn(0x55a09fbfd0f0 msgr2=0x55a09fc07420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:01.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.530+0000 7fe3fb148740 1 -- 172.21.15.148:0/3209200054 shutdown_connections 2024-09-19T07:12:01.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.530+0000 7fe3fb148740 1 -- 172.21.15.148:0/3209200054 wait complete. 2024-09-19T07:12:01.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.531+0000 7fe3fb148740 1 -- start start 2024-09-19T07:12:01.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.531+0000 7fe3fb148740 1 Processor -- start 2024-09-19T07:12:01.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.531+0000 7fe3fb148740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a09fc00b60 0x55a09fc142e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:01.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.531+0000 7fe3fb148740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a09fc01480 0x55a09fc0f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:01.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.532+0000 7fe3fb148740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a09fc0bd40 0x55a09fc0fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:01.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.532+0000 7fe3f2d9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a09fc00b60 0x55a09fc142e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:01.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.532+0000 7fe3f2d9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a09fc00b60 0x55a09fc142e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:39568/0 (socket says 172.21.15.148:39568) 2024-09-19T07:12:01.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.532+0000 7fe3f2d9d640 1 -- 172.21.15.148:0/1077501600 learned_addr learned my addr 172.21.15.148:0/1077501600 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:01.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.532+0000 7fe3f1d9b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a09fc01480 0x55a09fc0f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:01.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.532+0000 7fe3fb148740 1 -- 172.21.15.148:0/1077501600 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d400cd00 con 0x55a09fc0bd40 2024-09-19T07:12:01.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.532+0000 7fe3fb148740 1 -- 172.21.15.148:0/1077501600 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d400e170 con 0x55a09fc01480 2024-09-19T07:12:01.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.532+0000 7fe3fb148740 1 -- 172.21.15.148:0/1077501600 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d400d3d0 con 0x55a09fc00b60 2024-09-19T07:12:01.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.532+0000 7fe3f2d9d640 1 --2- 172.21.15.148:0/1077501600 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a09fc0bd40 0x55a09fc0fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:01.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.532+0000 7fe3f2d9d640 1 -- 172.21.15.148:0/1077501600 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a09fc01480 msgr2=0x55a09fc0f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:01.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.532+0000 7fe3f2d9d640 1 --2- 172.21.15.148:0/1077501600 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a09fc01480 0x55a09fc0f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:01.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.532+0000 7fe3f2d9d640 1 -- 172.21.15.148:0/1077501600 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a09fc0bd40 msgr2=0x55a09fc0fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:01.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.532+0000 7fe3f2d9d640 1 --2- 172.21.15.148:0/1077501600 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a09fc0bd40 0x55a09fc0fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:01.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.532+0000 7fe3f2d9d640 1 -- 172.21.15.148:0/1077501600 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a09fc10160 con 0x55a09fc00b60 2024-09-19T07:12:01.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.533+0000 7fe3f2d9d640 1 --2- 172.21.15.148:0/1077501600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a09fc00b60 0x55a09fc142e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec016b40 tx=0x7fe3ec016aa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec6c937266d9fb3f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:01.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.533+0000 7fe3d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-19T07:12:01.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.533+0000 7fe3fb148740 10 client.0 _ll_register_callbacks cb 0x7fe3ec019070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:12:01.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.533+0000 7fe3d9ffb640 1 -- 172.21.15.148:0/1077501600 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec025700 con 0x55a09fc00b60 2024-09-19T07:12:01.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.533+0000 7fe3d9ffb640 1 -- 172.21.15.148:0/1077501600 <== mon.1 v2:172.21.15.179:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fe3ec0258a0 con 0x55a09fc00b60 2024-09-19T07:12:01.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.533+0000 7fe3fb148740 1 -- 172.21.15.148:0/1077501600 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3ec0168f0 con 0x55a09fc00b60 2024-09-19T07:12:01.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.533+0000 7fe3d9ffb640 1 -- 172.21.15.148:0/1077501600 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe3ec025aa0 con 0x55a09fc00b60 2024-09-19T07:12:01.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.533+0000 7fe3fb148740 10 client.25111 fetch_fsmap learned FSMap version 25 2024-09-19T07:12:01.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.533+0000 7fe3fb148740 1 -- 172.21.15.148:0/1077501600 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({fsmap=25}) -- 0x55a09fc85c20 con 0x55a09fc00b60 2024-09-19T07:12:01.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.534+0000 7fe3d9ffb640 1 -- 172.21.15.148:0/1077501600 <== mon.1 v2:172.21.15.179:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe3ec0146b0 con 0x55a09fc00b60 2024-09-19T07:12:01.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.534+0000 7fe3fb148740 10 client.25111 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:12:01.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.534+0000 7fe3fb148740 10 client.25111 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:12:01.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.534+0000 7fe3fb148740 20 client.25111 populate_metadata read hostname 'smithi148' 2024-09-19T07:12:01.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.534+0000 7fe3fb148740 1 --2- 172.21.15.148:0/1077501600 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55a09fc1b6e0 0x55a09fc883a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:01.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.534+0000 7fe3fb148740 4 client.25111 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T07:12:01.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.534+0000 7fe3fb148740 1 -- 172.21.15.148:0/1077501600 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a09fb6dd00 con 0x55a09fc1b6e0 2024-09-19T07:12:01.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.534+0000 7fe3f1d9b640 1 --2- 172.21.15.148:0/1077501600 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55a09fc1b6e0 0x55a09fc883a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:01.541 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.535+0000 7fe3d9ffb640 10 client.25111 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:01.541 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.535+0000 7fe3f1d9b640 1 --2- 172.21.15.148:0/1077501600 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55a09fc1b6e0 0x55a09fc883a0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f5f6efb07613972 server_cookie=8918fb89e9f2ac10 in_seq=0 out_seq=0 2024-09-19T07:12:01.541 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.536+0000 7fe3d9ffb640 1 -- 172.21.15.148:0/1077501600 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a09fb6dd00 con 0x55a09fc1b6e0 2024-09-19T07:12:01.541 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.536+0000 7fe3d9ffb640 10 client.25111 handle_command_reply: tid=0 2024-09-19T07:12:01.541 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.536+0000 7fe3fb148740 1 client.25111 shutdown 2024-09-19T07:12:01.541 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.536+0000 7fe3fb148740 1 -- 172.21.15.148:0/1077501600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a09fc00b60 msgr2=0x55a09fc142e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:01.541 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.536+0000 7fe3fb148740 1 --2- 172.21.15.148:0/1077501600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a09fc00b60 0x55a09fc142e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec016b40 tx=0x7fe3ec016aa0 comp rx=0 tx=0).stop 2024-09-19T07:12:01.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.536+0000 7fe3fb148740 1 -- 172.21.15.148:0/1077501600 shutdown_connections 2024-09-19T07:12:01.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.536+0000 7fe3fb148740 1 --2- 172.21.15.148:0/1077501600 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55a09fc1b6e0 0x55a09fc883a0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:01.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.536+0000 7fe3d9ffb640 0 client.25111 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:01.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.536+0000 7fe3fb148740 1 --2- 172.21.15.148:0/1077501600 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a09fc0bd40 0x55a09fc0fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:01.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.536+0000 7fe3fb148740 1 --2- 172.21.15.148:0/1077501600 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a09fc01480 0x55a09fc0f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:01.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.536+0000 7fe3fb148740 1 --2- 172.21.15.148:0/1077501600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a09fc00b60 0x55a09fc142e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:01.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.536+0000 7fe3fb148740 1 -- 172.21.15.148:0/1077501600 >> 172.21.15.148:0/1077501600 conn(0x55a09fbfd0f0 msgr2=0x55a09fc07c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:01.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.536+0000 7fe3fb148740 1 -- 172.21.15.148:0/1077501600 shutdown_connections 2024-09-19T07:12:01.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.537+0000 7fe3fb148740 1 -- 172.21.15.148:0/1077501600 wait complete. 2024-09-19T07:12:01.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.537+0000 7fe3fb148740 20 client.25111 trim_cache size 0 max 16384 2024-09-19T07:12:01.542 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:12:01.543 INFO:teuthology.orchestra.run.smithi148.stdout: "return_code": 0, 2024-09-19T07:12:01.543 INFO:teuthology.orchestra.run.smithi148.stdout: "scrub_tag": "eb316b70-566f-4da5-87d3-ce9ecb4497f6", 2024-09-19T07:12:01.543 INFO:teuthology.orchestra.run.smithi148.stdout: "mode": "asynchronous" 2024-09-19T07:12:01.543 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:12:01.543 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.537+0000 7fe3f8d6f640 1 -- 172.21.15.148:0/2057886577 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe3dc0a3550 msgr2=0x7fe3dc0a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:01.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.537+0000 7fe3f8d6f640 1 --2- 172.21.15.148:0/2057886577 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe3dc0a3550 0x7fe3dc0a5a10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe3e80edbc0 tx=0x7fe3e8031eb0 comp rx=0 tx=0).stop 2024-09-19T07:12:01.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.537+0000 7fe3f8d6f640 1 -- 172.21.15.148:0/2057886577 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3f4100e20 msgr2=0x7fe3f4107a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:01.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.537+0000 7fe3f8d6f640 1 --2- 172.21.15.148:0/2057886577 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3f4100e20 0x7fe3f4107a50 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8006010 tx=0x7fe3e8003c10 comp rx=0 tx=0).stop 2024-09-19T07:12:01.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.538+0000 7fe3f8d6f640 1 -- 172.21.15.148:0/2057886577 shutdown_connections 2024-09-19T07:12:01.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.538+0000 7fe3f8d6f640 1 --2- 172.21.15.148:0/2057886577 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe3dc0a3550 0x7fe3dc0a5a10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:01.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.538+0000 7fe3f8d6f640 1 --2- 172.21.15.148:0/2057886577 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3f4102ef0 0x7fe3f41084d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:01.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.538+0000 7fe3f8d6f640 1 --2- 172.21.15.148:0/2057886577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3f4102570 0x7fe3f4107f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:01.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.538+0000 7fe3f8d6f640 1 --2- 172.21.15.148:0/2057886577 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3f4100e20 0x7fe3f4107a50 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:01.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.538+0000 7fe3f8d6f640 1 -- 172.21.15.148:0/2057886577 >> 172.21.15.148:0/2057886577 conn(0x7fe3f40fc7d0 msgr2=0x7fe3f4105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:01.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.538+0000 7fe3f8d6f640 1 -- 172.21.15.148:0/2057886577 shutdown_connections 2024-09-19T07:12:01.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:01.538+0000 7fe3f8d6f640 1 -- 172.21.15.148:0/2057886577 wait complete. 2024-09-19T07:12:02.330 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:02 smithi148 ceph-mon[31180]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-19T07:12:02.330 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:02 smithi148 ceph-mon[31180]: mgrmap e24: x(active, since 58s), standbys: y, z 2024-09-19T07:12:02.330 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:02 smithi148 ceph-mon[31180]: scrub queued for path: / 2024-09-19T07:12:02.331 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:02 smithi148 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-19T07:12:02.331 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:02 smithi148 ceph-mon[31180]: scrub summary: active paths [/] 2024-09-19T07:12:02.331 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:02 smithi148 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-19T07:12:02.565 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T07:12:02.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:02 smithi165 ceph-mon[35326]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-19T07:12:02.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:02 smithi165 ceph-mon[35326]: mgrmap e24: x(active, since 58s), standbys: y, z 2024-09-19T07:12:02.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:02 smithi165 ceph-mon[35326]: scrub queued for path: / 2024-09-19T07:12:02.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:02 smithi165 ceph-mon[35326]: scrub summary: idle+waiting paths [/] 2024-09-19T07:12:02.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:02 smithi165 ceph-mon[35326]: scrub summary: active paths [/] 2024-09-19T07:12:02.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:02 smithi165 ceph-mon[35326]: scrub summary: idle+waiting paths [/] 2024-09-19T07:12:02.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:02 smithi179 ceph-mon[35716]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-19T07:12:02.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:02 smithi179 ceph-mon[35716]: mgrmap e24: x(active, since 58s), standbys: y, z 2024-09-19T07:12:02.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:02 smithi179 ceph-mon[35716]: scrub queued for path: / 2024-09-19T07:12:02.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:02 smithi179 ceph-mon[35716]: scrub summary: idle+waiting paths [/] 2024-09-19T07:12:02.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:02 smithi179 ceph-mon[35716]: scrub summary: active paths [/] 2024-09-19T07:12:02.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:02 smithi179 ceph-mon[35716]: scrub summary: idle+waiting paths [/] 2024-09-19T07:12:02.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.792+0000 7fc201e16640 1 -- 172.21.15.148:0/1120305195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1fc1082a0 msgr2=0x7fc1fc10ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:02.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.792+0000 7fc201e16640 1 --2- 172.21.15.148:0/1120305195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1fc1082a0 0x7fc1fc10ec40 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4009cd0 tx=0x7fc1f402a8e0 comp rx=0 tx=0).stop 2024-09-19T07:12:02.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.793+0000 7fc201e16640 1 -- 172.21.15.148:0/1120305195 shutdown_connections 2024-09-19T07:12:02.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.793+0000 7fc201e16640 1 --2- 172.21.15.148:0/1120305195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1fc1082a0 0x7fc1fc10ec40 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:02.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.793+0000 7fc201e16640 1 --2- 172.21.15.148:0/1120305195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1fc1036e0 0x7fc1fc107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:02.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.793+0000 7fc201e16640 1 --2- 172.21.15.148:0/1120305195 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc1fc102d30 0x7fc1fc103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:02.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.793+0000 7fc201e16640 1 -- 172.21.15.148:0/1120305195 >> 172.21.15.148:0/1120305195 conn(0x7fc1fc0fc7d0 msgr2=0x7fc1fc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:02.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.793+0000 7fc201e16640 1 -- 172.21.15.148:0/1120305195 shutdown_connections 2024-09-19T07:12:02.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.793+0000 7fc201e16640 1 -- 172.21.15.148:0/1120305195 wait complete. 2024-09-19T07:12:02.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.794+0000 7fc201e16640 1 Processor -- start 2024-09-19T07:12:02.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.794+0000 7fc201e16640 1 -- start start 2024-09-19T07:12:02.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.795+0000 7fc201e16640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1fc102d30 0x7fc1fc198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:02.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.795+0000 7fc201e16640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1fc1036e0 0x7fc1fc198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:02.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.795+0000 7fc201e16640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc1fc1082a0 0x7fc1fc19ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:02.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.795+0000 7fc1fb7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1fc102d30 0x7fc1fc198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:02.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.795+0000 7fc1fb7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1fc102d30 0x7fc1fc198560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:39584/0 (socket says 172.21.15.148:39584) 2024-09-19T07:12:02.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.795+0000 7fc1faffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1fc1036e0 0x7fc1fc198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:02.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.795+0000 7fc1faffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1fc1036e0 0x7fc1fc198aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47504/0 (socket says 172.21.15.148:47504) 2024-09-19T07:12:02.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.795+0000 7fc1fb7fe640 1 -- 172.21.15.148:0/2199660260 learned_addr learned my addr 172.21.15.148:0/2199660260 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:02.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.795+0000 7fc201e16640 1 -- 172.21.15.148:0/2199660260 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc1fc1120a0 con 0x7fc1fc1036e0 2024-09-19T07:12:02.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.795+0000 7fc201e16640 1 -- 172.21.15.148:0/2199660260 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc1fc111f20 con 0x7fc1fc1082a0 2024-09-19T07:12:02.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.795+0000 7fc201e16640 1 -- 172.21.15.148:0/2199660260 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc1fc112220 con 0x7fc1fc102d30 2024-09-19T07:12:02.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.796+0000 7fc1fbfff640 1 --2- 172.21.15.148:0/2199660260 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc1fc1082a0 0x7fc1fc19ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:02.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.796+0000 7fc1faffd640 1 -- 172.21.15.148:0/2199660260 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1fc102d30 msgr2=0x7fc1fc198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:02.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.796+0000 7fc1faffd640 1 --2- 172.21.15.148:0/2199660260 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1fc102d30 0x7fc1fc198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:02.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.796+0000 7fc1faffd640 1 -- 172.21.15.148:0/2199660260 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc1fc1082a0 msgr2=0x7fc1fc19ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:02.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.796+0000 7fc1faffd640 1 --2- 172.21.15.148:0/2199660260 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc1fc1082a0 0x7fc1fc19ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:02.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.796+0000 7fc1faffd640 1 -- 172.21.15.148:0/2199660260 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1fc19d510 con 0x7fc1fc1036e0 2024-09-19T07:12:02.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.796+0000 7fc1fbfff640 1 --2- 172.21.15.148:0/2199660260 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc1fc1082a0 0x7fc1fc19ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:12:02.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.796+0000 7fc1fb7fe640 1 --2- 172.21.15.148:0/2199660260 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1fc102d30 0x7fc1fc198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:12:02.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.796+0000 7fc1faffd640 1 --2- 172.21.15.148:0/2199660260 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1fc1036e0 0x7fc1fc198aa0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc0697d0 tx=0x7fc1f000ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:02.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.797+0000 7fc1f8ff9640 1 -- 172.21.15.148:0/2199660260 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f000cc30 con 0x7fc1fc1036e0 2024-09-19T07:12:02.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.797+0000 7fc1f8ff9640 1 -- 172.21.15.148:0/2199660260 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1f000cdd0 con 0x7fc1fc1036e0 2024-09-19T07:12:02.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.797+0000 7fc1f8ff9640 1 -- 172.21.15.148:0/2199660260 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f0004a20 con 0x7fc1fc1036e0 2024-09-19T07:12:02.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.797+0000 7fc201e16640 1 -- 172.21.15.148:0/2199660260 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1fc19d800 con 0x7fc1fc1036e0 2024-09-19T07:12:02.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.797+0000 7fc201e16640 1 -- 172.21.15.148:0/2199660260 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1fc1008c0 con 0x7fc1fc1036e0 2024-09-19T07:12:02.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.801+0000 7fc1f8ff9640 1 -- 172.21.15.148:0/2199660260 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 24) ==== 138589+0+0 (secure 0 0 0) 0x7fc1f0004bc0 con 0x7fc1fc1036e0 2024-09-19T07:12:02.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.801+0000 7fc2041ef740 1 Processor -- start 2024-09-19T07:12:02.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.801+0000 7fc2041ef740 1 -- start start 2024-09-19T07:12:02.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.801+0000 7fc2041ef740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5654659ca870 0x5654659cac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:02.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.801+0000 7fc2041ef740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5654659cb190 0x5654659d5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:02.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.801+0000 7fc2041ef740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654659d5a50 0x5654659d7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:02.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.801+0000 7fc2041ef740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x565465927620 con 0x5654659ca870 2024-09-19T07:12:02.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.801+0000 7fc2041ef740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5654658cee50 con 0x5654659cb190 2024-09-19T07:12:02.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.801+0000 7fc2041ef740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5654659235e0 con 0x5654659d5a50 2024-09-19T07:12:02.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.802+0000 7fc1fbfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5654659ca870 0x5654659cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:02.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.802+0000 7fc1fbfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5654659ca870 0x5654659cac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47508/0 (socket says 172.21.15.148:47508) 2024-09-19T07:12:02.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.802+0000 7fc1fbfff640 1 -- 172.21.15.148:0/4241254498 learned_addr learned my addr 172.21.15.148:0/4241254498 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:02.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.802+0000 7fc1faffd640 1 --2- 172.21.15.148:0/4241254498 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654659d5a50 0x5654659d7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:02.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.802+0000 7fc1fb7fe640 1 --2- 172.21.15.148:0/4241254498 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5654659cb190 0x5654659d5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:02.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.803+0000 7fc1fbfff640 1 -- 172.21.15.148:0/4241254498 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654659d5a50 msgr2=0x5654659d7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:02.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.803+0000 7fc1fbfff640 1 --2- 172.21.15.148:0/4241254498 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654659d5a50 0x5654659d7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:02.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.803+0000 7fc1fbfff640 1 -- 172.21.15.148:0/4241254498 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5654659cb190 msgr2=0x5654659d5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:02.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.803+0000 7fc1fbfff640 1 --2- 172.21.15.148:0/4241254498 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5654659cb190 0x5654659d5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:02.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.803+0000 7fc1fbfff640 1 -- 172.21.15.148:0/4241254498 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654658bfd40 con 0x5654659ca870 2024-09-19T07:12:02.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.803+0000 7fc1fbfff640 1 --2- 172.21.15.148:0/4241254498 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5654659ca870 0x5654659cac50 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4035000 tx=0x7fc1f4009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5b2947e279ed21c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:02.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.803+0000 7fc1f8ff9640 1 --2- 172.21.15.148:0/2199660260 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc1e40a3620 0x7fc1e40a5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:02.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.803+0000 7fc1e1ffb640 1 -- 172.21.15.148:0/4241254498 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f4048070 con 0x5654659ca870 2024-09-19T07:12:02.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.803+0000 7fc1f8ff9640 1 -- 172.21.15.148:0/2199660260 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fc1f00cfe80 con 0x7fc1fc1036e0 2024-09-19T07:12:02.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.804+0000 7fc1e1ffb640 1 -- 172.21.15.148:0/4241254498 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1f4036070 con 0x5654659ca870 2024-09-19T07:12:02.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.804+0000 7fc1e1ffb640 1 -- 172.21.15.148:0/4241254498 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f40305a0 con 0x5654659ca870 2024-09-19T07:12:02.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.804+0000 7fc1fb7fe640 1 --2- 172.21.15.148:0/2199660260 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc1e40a3620 0x7fc1e40a5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:02.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.805+0000 7fc2041ef740 1 -- 172.21.15.148:0/4241254498 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5654659ca870 msgr2=0x5654659cac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:02.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.805+0000 7fc2041ef740 1 --2- 172.21.15.148:0/4241254498 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5654659ca870 0x5654659cac50 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4035000 tx=0x7fc1f4009a20 comp rx=0 tx=0).stop 2024-09-19T07:12:02.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.805+0000 7fc2041ef740 1 -- 172.21.15.148:0/4241254498 shutdown_connections 2024-09-19T07:12:02.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.805+0000 7fc2041ef740 1 --2- 172.21.15.148:0/4241254498 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654659d5a50 0x5654659d7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:02.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.805+0000 7fc2041ef740 1 --2- 172.21.15.148:0/4241254498 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5654659cb190 0x5654659d5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:02.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.805+0000 7fc2041ef740 1 --2- 172.21.15.148:0/4241254498 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5654659ca870 0x5654659cac50 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:02.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.805+0000 7fc2041ef740 1 -- 172.21.15.148:0/4241254498 >> 172.21.15.148:0/4241254498 conn(0x5654659c6e00 msgr2=0x5654659c71e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:02.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.805+0000 7fc1fb7fe640 1 --2- 172.21.15.148:0/2199660260 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc1e40a3620 0x7fc1e40a5ae0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x5654659c7c60 tx=0x7fc1ec00a380 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:02.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.805+0000 7fc2041ef740 1 -- 172.21.15.148:0/4241254498 shutdown_connections 2024-09-19T07:12:02.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.805+0000 7fc2041ef740 1 -- 172.21.15.148:0/4241254498 wait complete. 2024-09-19T07:12:02.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.806+0000 7fc2041ef740 1 -- start start 2024-09-19T07:12:02.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.806+0000 7fc2041ef740 1 Processor -- start 2024-09-19T07:12:02.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.806+0000 7fc2041ef740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654659ca870 0x5654659d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:02.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.806+0000 7fc2041ef740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5654659cb190 0x5654659d2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:02.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.806+0000 7fc2041ef740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5654659d5a50 0x5654659d3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:02.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.806+0000 7fc2041ef740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5654659d8620 con 0x5654659d5a50 2024-09-19T07:12:02.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.806+0000 7fc2041ef740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5654658aff10 con 0x5654659cb190 2024-09-19T07:12:02.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.806+0000 7fc2041ef740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5654659d87a0 con 0x5654659ca870 2024-09-19T07:12:02.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.806+0000 7fc2041ef740 10 client.0 _ll_register_callbacks cb 0x5654658d3db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:12:02.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.807+0000 7fc1fbfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5654659d5a50 0x5654659d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:02.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.807+0000 7fc1faffd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5654659cb190 0x5654659d2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:02.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.807+0000 7fc1fbfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5654659d5a50 0x5654659d3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47510/0 (socket says 172.21.15.148:47510) 2024-09-19T07:12:02.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.807+0000 7fc1fbfff640 1 -- 172.21.15.148:0/918223920 learned_addr learned my addr 172.21.15.148:0/918223920 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:02.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.807+0000 7fc1faffd640 1 -- 172.21.15.148:0/918223920 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654659ca870 msgr2=0x5654659d2990 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T07:12:02.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.807+0000 7fc1faffd640 1 --2- 172.21.15.148:0/918223920 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654659ca870 0x5654659d2990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:02.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.807+0000 7fc1faffd640 1 -- 172.21.15.148:0/918223920 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5654659d5a50 msgr2=0x5654659d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:02.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.807+0000 7fc1faffd640 1 --2- 172.21.15.148:0/918223920 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5654659d5a50 0x5654659d3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:02.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.807+0000 7fc1faffd640 1 -- 172.21.15.148:0/918223920 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565465636580 con 0x5654659cb190 2024-09-19T07:12:02.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.807+0000 7fc1faffd640 1 --2- 172.21.15.148:0/918223920 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5654659cb190 0x5654659d2ed0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc1f00cd460 tx=0x7fc1f00d34a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=736f43f24df07a40 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:02.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.807+0000 7fc1daffd640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-19T07:12:02.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.807+0000 7fc1daffd640 1 -- 172.21.15.148:0/918223920 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f001c070 con 0x5654659cb190 2024-09-19T07:12:02.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.807+0000 7fc1daffd640 1 -- 172.21.15.148:0/918223920 <== mon.2 v2:172.21.15.165:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fc1f00a4700 con 0x5654659cb190 2024-09-19T07:12:02.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.808+0000 7fc2041ef740 1 -- 172.21.15.148:0/918223920 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1f4036070 con 0x5654659cb190 2024-09-19T07:12:02.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.808+0000 7fc1daffd640 1 -- 172.21.15.148:0/918223920 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc1f009ba60 con 0x5654659cb190 2024-09-19T07:12:02.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.808+0000 7fc2041ef740 10 client.25085 fetch_fsmap learned FSMap version 25 2024-09-19T07:12:02.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.808+0000 7fc2041ef740 1 -- 172.21.15.148:0/918223920 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x565465700960 con 0x5654659cb190 2024-09-19T07:12:02.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.808+0000 7fc1daffd640 1 -- 172.21.15.148:0/918223920 <== mon.2 v2:172.21.15.165:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1f4036070 con 0x5654659cb190 2024-09-19T07:12:02.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.808+0000 7fc1daffd640 1 -- 172.21.15.148:0/918223920 <== mon.2 v2:172.21.15.165:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc1f00bab60 con 0x5654659cb190 2024-09-19T07:12:02.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.808+0000 7fc2041ef740 10 client.25085 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:12:02.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.808+0000 7fc2041ef740 10 client.25085 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:12:02.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.808+0000 7fc2041ef740 20 client.25085 populate_metadata read hostname 'smithi148' 2024-09-19T07:12:02.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.808+0000 7fc2041ef740 1 --2- 172.21.15.148:0/918223920 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5654659e56c0 0x5654659e7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:02.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.808+0000 7fc2041ef740 4 client.25085 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:12:02.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.808+0000 7fc2041ef740 1 -- 172.21.15.148:0/918223920 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565465934b90 con 0x5654659e56c0 2024-09-19T07:12:02.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.809+0000 7fc1fb7fe640 1 --2- 172.21.15.148:0/918223920 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5654659e56c0 0x5654659e7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:02.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.809+0000 7fc1fb7fe640 1 --2- 172.21.15.148:0/918223920 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5654659e56c0 0x5654659e7b30 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=733f6392c04a084 server_cookie=c8ee446f81e83553 in_seq=0 out_seq=0 2024-09-19T07:12:02.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.809+0000 7fc1daffd640 10 client.25085 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:02.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.810+0000 7fc1daffd640 1 -- 172.21.15.148:0/918223920 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x565465934b90 con 0x5654659e56c0 2024-09-19T07:12:02.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.810+0000 7fc1daffd640 10 client.25085 handle_command_reply: tid=0 2024-09-19T07:12:02.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.810+0000 7fc2041ef740 1 client.25085 shutdown 2024-09-19T07:12:02.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.811+0000 7fc2041ef740 1 -- 172.21.15.148:0/918223920 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5654659cb190 msgr2=0x5654659d2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:02.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.811+0000 7fc2041ef740 1 --2- 172.21.15.148:0/918223920 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5654659cb190 0x5654659d2ed0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc1f00cd460 tx=0x7fc1f00d34a0 comp rx=0 tx=0).stop 2024-09-19T07:12:02.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.811+0000 7fc2041ef740 1 -- 172.21.15.148:0/918223920 shutdown_connections 2024-09-19T07:12:02.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.811+0000 7fc2041ef740 1 --2- 172.21.15.148:0/918223920 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5654659e56c0 0x5654659e7b30 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:02.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.811+0000 7fc1daffd640 0 client.25085 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:02.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.811+0000 7fc2041ef740 1 --2- 172.21.15.148:0/918223920 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5654659d5a50 0x5654659d3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:02.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.811+0000 7fc2041ef740 1 --2- 172.21.15.148:0/918223920 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5654659cb190 0x5654659d2ed0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:02.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.811+0000 7fc2041ef740 1 --2- 172.21.15.148:0/918223920 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654659ca870 0x5654659d2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:02.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.811+0000 7fc2041ef740 1 -- 172.21.15.148:0/918223920 >> 172.21.15.148:0/918223920 conn(0x5654659c6e00 msgr2=0x5654659bd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:02.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.811+0000 7fc2041ef740 1 -- 172.21.15.148:0/918223920 shutdown_connections 2024-09-19T07:12:02.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.811+0000 7fc2041ef740 1 -- 172.21.15.148:0/918223920 wait complete. 2024-09-19T07:12:02.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.811+0000 7fc2041ef740 20 client.25085 trim_cache size 0 max 16384 2024-09-19T07:12:02.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.833+0000 7fc2041ef740 1 Processor -- start 2024-09-19T07:12:02.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.833+0000 7fc2041ef740 1 -- start start 2024-09-19T07:12:02.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.834+0000 7fc2041ef740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5654659ca870 0x5654659cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:02.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.834+0000 7fc2041ef740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5654659cb190 0x5654659bd640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:02.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.834+0000 7fc2041ef740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654659d5a50 0x5654659ed400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:02.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.834+0000 7fc2041ef740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc1fc1ade50 con 0x5654659ca870 2024-09-19T07:12:02.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.834+0000 7fc2041ef740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc1fc1ab720 con 0x5654659cb190 2024-09-19T07:12:02.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.834+0000 7fc2041ef740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc1fc1a9550 con 0x5654659d5a50 2024-09-19T07:12:02.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.834+0000 7fc1fb7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5654659ca870 0x5654659cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:02.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.834+0000 7fc1faffd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5654659cb190 0x5654659bd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:02.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.834+0000 7fc1fb7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5654659ca870 0x5654659cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47514/0 (socket says 172.21.15.148:47514) 2024-09-19T07:12:02.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.834+0000 7fc1fb7fe640 1 -- 172.21.15.148:0/3264897753 learned_addr learned my addr 172.21.15.148:0/3264897753 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:02.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.834+0000 7fc1fbfff640 1 --2- 172.21.15.148:0/3264897753 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654659d5a50 0x5654659ed400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:02.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.834+0000 7fc1fb7fe640 1 -- 172.21.15.148:0/3264897753 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654659d5a50 msgr2=0x5654659ed400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:02.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.834+0000 7fc1fb7fe640 1 --2- 172.21.15.148:0/3264897753 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654659d5a50 0x5654659ed400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:02.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.834+0000 7fc1fb7fe640 1 -- 172.21.15.148:0/3264897753 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5654659cb190 msgr2=0x5654659bd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:02.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.834+0000 7fc1fb7fe640 1 --2- 172.21.15.148:0/3264897753 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5654659cb190 0x5654659bd640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:02.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.834+0000 7fc1fb7fe640 1 -- 172.21.15.148:0/3264897753 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654659c6c30 con 0x5654659ca870 2024-09-19T07:12:02.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.835+0000 7fc1fb7fe640 1 --2- 172.21.15.148:0/3264897753 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5654659ca870 0x5654659cd320 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec00afd0 tx=0x7fc1ec015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c8e03c58cfcdf2f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:02.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.835+0000 7fc1fbfff640 1 --2- 172.21.15.148:0/3264897753 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654659d5a50 0x5654659ed400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:12:02.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.835+0000 7fc1faffd640 1 --2- 172.21.15.148:0/3264897753 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5654659cb190 0x5654659bd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:12:02.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.835+0000 7fc1e17fa640 1 -- 172.21.15.148:0/3264897753 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec010e80 con 0x5654659ca870 2024-09-19T07:12:02.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.835+0000 7fc1e17fa640 1 -- 172.21.15.148:0/3264897753 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1ec02d070 con 0x5654659ca870 2024-09-19T07:12:02.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.835+0000 7fc1e17fa640 1 -- 172.21.15.148:0/3264897753 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec028c20 con 0x5654659ca870 2024-09-19T07:12:02.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.836+0000 7fc2041ef740 1 -- 172.21.15.148:0/3264897753 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5654659ca870 msgr2=0x5654659cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:02.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.836+0000 7fc2041ef740 1 --2- 172.21.15.148:0/3264897753 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5654659ca870 0x5654659cd320 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec00afd0 tx=0x7fc1ec015000 comp rx=0 tx=0).stop 2024-09-19T07:12:02.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.836+0000 7fc2041ef740 1 -- 172.21.15.148:0/3264897753 shutdown_connections 2024-09-19T07:12:02.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.836+0000 7fc2041ef740 1 --2- 172.21.15.148:0/3264897753 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654659d5a50 0x5654659ed400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:02.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.836+0000 7fc2041ef740 1 --2- 172.21.15.148:0/3264897753 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5654659cb190 0x5654659bd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:02.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.836+0000 7fc2041ef740 1 --2- 172.21.15.148:0/3264897753 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5654659ca870 0x5654659cd320 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:02.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.836+0000 7fc2041ef740 1 -- 172.21.15.148:0/3264897753 >> 172.21.15.148:0/3264897753 conn(0x5654659c6e00 msgr2=0x5654659bcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:02.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.836+0000 7fc2041ef740 1 -- 172.21.15.148:0/3264897753 shutdown_connections 2024-09-19T07:12:02.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.836+0000 7fc2041ef740 1 -- 172.21.15.148:0/3264897753 wait complete. 2024-09-19T07:12:02.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.837+0000 7fc2041ef740 1 -- start start 2024-09-19T07:12:02.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.837+0000 7fc2041ef740 1 Processor -- start 2024-09-19T07:12:02.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.837+0000 7fc2041ef740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5654659ca870 0x5654659ddbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:02.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.837+0000 7fc2041ef740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654659cb190 0x5654659de110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:02.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.837+0000 7fc2041ef740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5654659d5a50 0x5654659da9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:02.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.837+0000 7fc2041ef740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc1fc1a9be0 con 0x5654659ca870 2024-09-19T07:12:02.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.837+0000 7fc2041ef740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc1fc1ab050 con 0x5654659d5a50 2024-09-19T07:12:02.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.837+0000 7fc2041ef740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc1fc1aa2b0 con 0x5654659cb190 2024-09-19T07:12:02.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.837+0000 7fc2041ef740 10 client.0 _ll_register_callbacks cb 0x7fc1f0005410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:12:02.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.838+0000 7fc1fb7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5654659ca870 0x5654659ddbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:02.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.838+0000 7fc1fb7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5654659ca870 0x5654659ddbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47524/0 (socket says 172.21.15.148:47524) 2024-09-19T07:12:02.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.838+0000 7fc1fb7fe640 1 -- 172.21.15.148:0/167921137 learned_addr learned my addr 172.21.15.148:0/167921137 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:02.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.838+0000 7fc1faffd640 1 --2- 172.21.15.148:0/167921137 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654659cb190 0x5654659de110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:02.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.838+0000 7fc1fbfff640 1 --2- 172.21.15.148:0/167921137 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5654659d5a50 0x5654659da9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:02.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.838+0000 7fc1fbfff640 1 -- 172.21.15.148:0/167921137 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654659cb190 msgr2=0x5654659de110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:02.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.838+0000 7fc1fbfff640 1 --2- 172.21.15.148:0/167921137 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654659cb190 0x5654659de110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:02.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.838+0000 7fc1fbfff640 1 -- 172.21.15.148:0/167921137 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5654659ca870 msgr2=0x5654659ddbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:02.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.838+0000 7fc1fbfff640 1 --2- 172.21.15.148:0/167921137 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5654659ca870 0x5654659ddbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:02.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.838+0000 7fc1fbfff640 1 -- 172.21.15.148:0/167921137 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654659db100 con 0x5654659d5a50 2024-09-19T07:12:02.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.839+0000 7fc1fbfff640 1 --2- 172.21.15.148:0/167921137 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5654659d5a50 0x5654659da9c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4006010 tx=0x7fc1f40044f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=926c0c119d6ad34b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:02.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.839+0000 7fc1daffd640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-19T07:12:02.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.839+0000 7fc1daffd640 1 -- 172.21.15.148:0/167921137 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f4053060 con 0x5654659d5a50 2024-09-19T07:12:02.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.839+0000 7fc1daffd640 1 -- 172.21.15.148:0/167921137 <== mon.2 v2:172.21.15.165:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fc1f40307a0 con 0x5654659d5a50 2024-09-19T07:12:02.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.840+0000 7fc2041ef740 1 -- 172.21.15.148:0/167921137 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1ec02d070 con 0x5654659d5a50 2024-09-19T07:12:02.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.840+0000 7fc1daffd640 1 -- 172.21.15.148:0/167921137 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc1f4048040 con 0x5654659d5a50 2024-09-19T07:12:02.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.840+0000 7fc2041ef740 10 client.25091 fetch_fsmap learned FSMap version 25 2024-09-19T07:12:02.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.840+0000 7fc2041ef740 1 -- 172.21.15.148:0/167921137 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x565465a50dd0 con 0x5654659d5a50 2024-09-19T07:12:02.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.840+0000 7fc1daffd640 1 -- 172.21.15.148:0/167921137 <== mon.2 v2:172.21.15.165:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1ec02d070 con 0x5654659d5a50 2024-09-19T07:12:02.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.841+0000 7fc1daffd640 1 -- 172.21.15.148:0/167921137 <== mon.2 v2:172.21.15.165:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc1f404b070 con 0x5654659d5a50 2024-09-19T07:12:02.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.841+0000 7fc2041ef740 10 client.25091 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:12:02.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.841+0000 7fc2041ef740 10 client.25091 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:12:02.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.841+0000 7fc2041ef740 20 client.25091 populate_metadata read hostname 'smithi148' 2024-09-19T07:12:02.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.841+0000 7fc2041ef740 1 --2- 172.21.15.148:0/167921137 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5654659e56c0 0x565465a53010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:02.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.841+0000 7fc2041ef740 4 client.25091 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "15c8d75c", "release": true, "await": true}] 2024-09-19T07:12:02.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.841+0000 7fc2041ef740 1 -- 172.21.15.148:0/167921137 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "quiesce db", "set_id": "15c8d75c", "release": true, "await": true}) -- 0x56546592f0a0 con 0x5654659e56c0 2024-09-19T07:12:02.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.842+0000 7fc1fb7fe640 1 --2- 172.21.15.148:0/167921137 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5654659e56c0 0x565465a53010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:02.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.842+0000 7fc1fb7fe640 1 --2- 172.21.15.148:0/167921137 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5654659e56c0 0x565465a53010 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ea371825e56f514 server_cookie=13472a4dfd3879f9 in_seq=0 out_seq=0 2024-09-19T07:12:02.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.842+0000 7fc1daffd640 10 client.25091 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:02.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.844+0000 7fc1daffd640 1 -- 172.21.15.148:0/167921137 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x56546592f0a0 con 0x5654659e56c0 2024-09-19T07:12:02.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.844+0000 7fc1daffd640 10 client.25091 handle_command_reply: tid=0 2024-09-19T07:12:02.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.844+0000 7fc2041ef740 1 client.25091 shutdown 2024-09-19T07:12:02.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.845+0000 7fc2041ef740 1 -- 172.21.15.148:0/167921137 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5654659d5a50 msgr2=0x5654659da9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:02.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.845+0000 7fc2041ef740 1 --2- 172.21.15.148:0/167921137 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5654659d5a50 0x5654659da9c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4006010 tx=0x7fc1f40044f0 comp rx=0 tx=0).stop 2024-09-19T07:12:02.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.845+0000 7fc2041ef740 1 -- 172.21.15.148:0/167921137 shutdown_connections 2024-09-19T07:12:02.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.845+0000 7fc2041ef740 1 --2- 172.21.15.148:0/167921137 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5654659e56c0 0x565465a53010 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:02.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.845+0000 7fc1daffd640 0 client.25091 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:02.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.845+0000 7fc2041ef740 1 --2- 172.21.15.148:0/167921137 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5654659d5a50 0x5654659da9c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:02.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.845+0000 7fc2041ef740 1 --2- 172.21.15.148:0/167921137 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654659cb190 0x5654659de110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:02.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.845+0000 7fc2041ef740 1 --2- 172.21.15.148:0/167921137 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5654659ca870 0x5654659ddbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:02.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.845+0000 7fc2041ef740 1 -- 172.21.15.148:0/167921137 >> 172.21.15.148:0/167921137 conn(0x5654659c6e00 msgr2=0x5654659bd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:02.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.846+0000 7fc2041ef740 1 -- 172.21.15.148:0/167921137 shutdown_connections 2024-09-19T07:12:02.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.846+0000 7fc2041ef740 1 -- 172.21.15.148:0/167921137 wait complete. 2024-09-19T07:12:02.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.846+0000 7fc2041ef740 20 client.25091 trim_cache size 0 max 16384 2024-09-19T07:12:02.848 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:12:02.848 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 25, 2024-09-19T07:12:02.848 INFO:teuthology.orchestra.run.smithi148.stdout: "leader": 24457, 2024-09-19T07:12:02.848 INFO:teuthology.orchestra.run.smithi148.stdout: "set_version": 4, 2024-09-19T07:12:02.848 INFO:teuthology.orchestra.run.smithi148.stdout: "sets": { 2024-09-19T07:12:02.848 INFO:teuthology.orchestra.run.smithi148.stdout: "15c8d75c": { 2024-09-19T07:12:02.848 INFO:teuthology.orchestra.run.smithi148.stdout: "version": 4, 2024-09-19T07:12:02.848 INFO:teuthology.orchestra.run.smithi148.stdout: "age_ref": 0.0, 2024-09-19T07:12:02.849 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:12:02.849 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RELEASED", 2024-09-19T07:12:02.849 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:12:02.849 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:12:02.849 INFO:teuthology.orchestra.run.smithi148.stdout: "timeout": 90.0, 2024-09-19T07:12:02.849 INFO:teuthology.orchestra.run.smithi148.stdout: "expiration": 131.2, 2024-09-19T07:12:02.849 INFO:teuthology.orchestra.run.smithi148.stdout: "members": { 2024-09-19T07:12:02.849 INFO:teuthology.orchestra.run.smithi148.stdout: "file:/": { 2024-09-19T07:12:02.849 INFO:teuthology.orchestra.run.smithi148.stdout: "excluded": false, 2024-09-19T07:12:02.849 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:12:02.849 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RELEASED", 2024-09-19T07:12:02.849 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:12:02.849 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:12:02.849 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:12:02.850 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:12:02.850 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:12:02.850 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:12:02.850 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:12:02.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.847+0000 7fc201e16640 1 -- 172.21.15.148:0/2199660260 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc1e40a3620 msgr2=0x7fc1e40a5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:02.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.847+0000 7fc201e16640 1 --2- 172.21.15.148:0/2199660260 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc1e40a3620 0x7fc1e40a5ae0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x5654659c7c60 tx=0x7fc1ec00a380 comp rx=0 tx=0).stop 2024-09-19T07:12:02.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.847+0000 7fc201e16640 1 -- 172.21.15.148:0/2199660260 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1fc1036e0 msgr2=0x7fc1fc198aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:02.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.847+0000 7fc201e16640 1 --2- 172.21.15.148:0/2199660260 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1fc1036e0 0x7fc1fc198aa0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc0697d0 tx=0x7fc1f000ef90 comp rx=0 tx=0).stop 2024-09-19T07:12:02.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.847+0000 7fc201e16640 1 -- 172.21.15.148:0/2199660260 shutdown_connections 2024-09-19T07:12:02.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.847+0000 7fc201e16640 1 --2- 172.21.15.148:0/2199660260 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc1e40a3620 0x7fc1e40a5ae0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:02.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.847+0000 7fc201e16640 1 --2- 172.21.15.148:0/2199660260 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc1fc1082a0 0x7fc1fc19ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:02.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.847+0000 7fc201e16640 1 --2- 172.21.15.148:0/2199660260 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1fc1036e0 0x7fc1fc198aa0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:02.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.847+0000 7fc201e16640 1 --2- 172.21.15.148:0/2199660260 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1fc102d30 0x7fc1fc198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:02.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.847+0000 7fc201e16640 1 -- 172.21.15.148:0/2199660260 >> 172.21.15.148:0/2199660260 conn(0x7fc1fc0fc7d0 msgr2=0x7fc1fc106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:02.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.847+0000 7fc201e16640 1 -- 172.21.15.148:0/2199660260 shutdown_connections 2024-09-19T07:12:02.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:02.847+0000 7fc201e16640 1 -- 172.21.15.148:0/2199660260 wait complete. 2024-09-19T07:12:03.114 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:12:03.601 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '15c8d75c', total seconds elapsed: 15.8 2024-09-19T07:12:04.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.071+0000 7f86b8b87640 1 -- 172.21.15.148:0/2291851752 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86b4101df0 msgr2=0x7f86b41021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:04.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.071+0000 7f86b8b87640 1 --2- 172.21.15.148:0/2291851752 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86b4101df0 0x7f86b41021d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f86a4009900 tx=0x7f86a402a410 comp rx=0 tx=0).stop 2024-09-19T07:12:04.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.071+0000 7f86b8b87640 1 -- 172.21.15.148:0/2291851752 shutdown_connections 2024-09-19T07:12:04.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.071+0000 7f86b8b87640 1 --2- 172.21.15.148:0/2291851752 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86b4106f20 0x7f86b410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:04.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.071+0000 7f86b8b87640 1 --2- 172.21.15.148:0/2291851752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86b41027a0 0x7f86b41067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:04.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.071+0000 7f86b8b87640 1 --2- 172.21.15.148:0/2291851752 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86b4101df0 0x7f86b41021d0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:04.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.071+0000 7f86b8b87640 1 -- 172.21.15.148:0/2291851752 >> 172.21.15.148:0/2291851752 conn(0x7f86b40fd8f0 msgr2=0x7f86b40ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:04.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.071+0000 7f86b8b87640 1 -- 172.21.15.148:0/2291851752 shutdown_connections 2024-09-19T07:12:04.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.071+0000 7f86b8b87640 1 -- 172.21.15.148:0/2291851752 wait complete. 2024-09-19T07:12:04.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.072+0000 7f86b8b87640 1 Processor -- start 2024-09-19T07:12:04.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.072+0000 7f86b8b87640 1 -- start start 2024-09-19T07:12:04.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.072+0000 7f86b8b87640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86b4101df0 0x7f86b419a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:04.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.072+0000 7f86b8b87640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86b41027a0 0x7f86b419abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:04.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.072+0000 7f86b8b87640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86b4106f20 0x7f86b419ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:04.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.072+0000 7f86b8b87640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f86b4111fd0 con 0x7f86b4106f20 2024-09-19T07:12:04.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.072+0000 7f86b8b87640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f86b4111e50 con 0x7f86b4101df0 2024-09-19T07:12:04.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.072+0000 7f86b8b87640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f86b4112150 con 0x7f86b41027a0 2024-09-19T07:12:04.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.072+0000 7f86b2d9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86b4106f20 0x7f86b419ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:04.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.072+0000 7f86b2d9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86b4106f20 0x7f86b419ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47544/0 (socket says 172.21.15.148:47544) 2024-09-19T07:12:04.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.072+0000 7f86b2d9d640 1 -- 172.21.15.148:0/2596612847 learned_addr learned my addr 172.21.15.148:0/2596612847 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:04.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.072+0000 7f86b259c640 1 --2- 172.21.15.148:0/2596612847 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86b4101df0 0x7f86b419a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:04.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.073+0000 7f86b2d9d640 1 -- 172.21.15.148:0/2596612847 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86b41027a0 msgr2=0x7f86b419abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:04.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.073+0000 7f86b2d9d640 1 --2- 172.21.15.148:0/2596612847 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86b41027a0 0x7f86b419abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:04.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.073+0000 7f86b2d9d640 1 -- 172.21.15.148:0/2596612847 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86b4101df0 msgr2=0x7f86b419a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:04.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.073+0000 7f86b2d9d640 1 --2- 172.21.15.148:0/2596612847 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86b4101df0 0x7f86b419a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:04.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.073+0000 7f86b2d9d640 1 -- 172.21.15.148:0/2596612847 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86b419f620 con 0x7f86b4106f20 2024-09-19T07:12:04.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.073+0000 7f86b259c640 1 --2- 172.21.15.148:0/2596612847 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86b4101df0 0x7f86b419a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:12:04.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.073+0000 7f86b2d9d640 1 --2- 172.21.15.148:0/2596612847 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86b4106f20 0x7f86b419ef40 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f86ac00cce0 tx=0x7f86ac00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:04.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.073+0000 7f86a37fe640 1 -- 172.21.15.148:0/2596612847 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ac00f450 con 0x7f86b4106f20 2024-09-19T07:12:04.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.073+0000 7f86a37fe640 1 -- 172.21.15.148:0/2596612847 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86ac00fad0 con 0x7f86b4106f20 2024-09-19T07:12:04.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.073+0000 7f86a37fe640 1 -- 172.21.15.148:0/2596612847 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ac018c10 con 0x7f86b4106f20 2024-09-19T07:12:04.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.073+0000 7f86b8b87640 1 -- 172.21.15.148:0/2596612847 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86b419f910 con 0x7f86b4106f20 2024-09-19T07:12:04.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.073+0000 7f86b8b87640 1 -- 172.21.15.148:0/2596612847 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86b41a71f0 con 0x7f86b4106f20 2024-09-19T07:12:04.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.076+0000 7f86baf60740 1 Processor -- start 2024-09-19T07:12:04.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.077+0000 7f86a37fe640 1 -- 172.21.15.148:0/2596612847 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 24) ==== 138589+0+0 (secure 0 0 0) 0x7f86ac00f5f0 con 0x7f86b4106f20 2024-09-19T07:12:04.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.077+0000 7f86baf60740 1 -- start start 2024-09-19T07:12:04.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.077+0000 7f86baf60740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5630ab3904a0 0x5630ab390880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:04.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.077+0000 7f86baf60740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5630ab390dc0 0x5630ab39b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:04.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.077+0000 7f86baf60740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5630ab39b680 0x5630ab39da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:04.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.077+0000 7f86baf60740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5630ab2f62e0 con 0x5630ab390dc0 2024-09-19T07:12:04.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.077+0000 7f86baf60740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5630ab29dce0 con 0x5630ab39b680 2024-09-19T07:12:04.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.077+0000 7f86baf60740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5630ab2f22a0 con 0x5630ab3904a0 2024-09-19T07:12:04.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.077+0000 7f86b259c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5630ab390dc0 0x5630ab39b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:04.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.077+0000 7f86b1d9b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5630ab39b680 0x5630ab39da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:04.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.077+0000 7f86b1d9b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5630ab39b680 0x5630ab39da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:56268/0 (socket says 172.21.15.148:56268) 2024-09-19T07:12:04.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.077+0000 7f86b1d9b640 1 -- 172.21.15.148:0/338696006 learned_addr learned my addr 172.21.15.148:0/338696006 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:04.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.078+0000 7f86b1d9b640 1 --2- 172.21.15.148:0/338696006 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5630ab3904a0 0x5630ab390880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:04.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.078+0000 7f86a37fe640 1 --2- 172.21.15.148:0/2596612847 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f869c0a35d0 0x7f869c0a5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:04.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.078+0000 7f86b1d9b640 1 -- 172.21.15.148:0/338696006 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5630ab3904a0 msgr2=0x5630ab390880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:04.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.078+0000 7f86b1d9b640 1 --2- 172.21.15.148:0/338696006 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5630ab3904a0 0x5630ab390880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:04.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.078+0000 7f86b1d9b640 1 -- 172.21.15.148:0/338696006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5630ab390dc0 msgr2=0x5630ab39b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:04.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.078+0000 7f86b1d9b640 1 --2- 172.21.15.148:0/338696006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5630ab390dc0 0x5630ab39b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:04.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.078+0000 7f86b1d9b640 1 -- 172.21.15.148:0/338696006 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630ab282440 con 0x5630ab39b680 2024-09-19T07:12:04.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.078+0000 7f86b2d9d640 1 --2- 172.21.15.148:0/2596612847 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f869c0a35d0 0x7f869c0a5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:04.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.078+0000 7f86b259c640 1 --2- 172.21.15.148:0/338696006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5630ab390dc0 0x5630ab39b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:12:04.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.078+0000 7f86a37fe640 1 -- 172.21.15.148:0/2596612847 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f86ac0d0630 con 0x7f86b4106f20 2024-09-19T07:12:04.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.078+0000 7f86b1d9b640 1 --2- 172.21.15.148:0/338696006 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5630ab39b680 0x5630ab39da70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f86a80127b0 tx=0x7f86a800d3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67344e9f995c0ab6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:04.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.078+0000 7f86a0ff9640 1 -- 172.21.15.148:0/338696006 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a8005020 con 0x5630ab39b680 2024-09-19T07:12:04.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.079+0000 7f86a0ff9640 1 -- 172.21.15.148:0/338696006 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86a80047a0 con 0x5630ab39b680 2024-09-19T07:12:04.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.079+0000 7f86a0ff9640 1 -- 172.21.15.148:0/338696006 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a800a980 con 0x5630ab39b680 2024-09-19T07:12:04.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.079+0000 7f86baf60740 1 -- 172.21.15.148:0/338696006 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5630ab39b680 msgr2=0x5630ab39da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:04.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.079+0000 7f86baf60740 1 --2- 172.21.15.148:0/338696006 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5630ab39b680 0x5630ab39da70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f86a80127b0 tx=0x7f86a800d3c0 comp rx=0 tx=0).stop 2024-09-19T07:12:04.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.079+0000 7f86b2d9d640 1 --2- 172.21.15.148:0/2596612847 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f869c0a35d0 0x7f869c0a5a90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f86ac0cdc30 tx=0x7f86ac091b20 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:04.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.079+0000 7f86baf60740 1 -- 172.21.15.148:0/338696006 shutdown_connections 2024-09-19T07:12:04.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.079+0000 7f86baf60740 1 --2- 172.21.15.148:0/338696006 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5630ab39b680 0x5630ab39da70 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:04.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.079+0000 7f86baf60740 1 --2- 172.21.15.148:0/338696006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5630ab390dc0 0x5630ab39b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:04.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.079+0000 7f86baf60740 1 --2- 172.21.15.148:0/338696006 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5630ab3904a0 0x5630ab390880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:04.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.079+0000 7f86baf60740 1 -- 172.21.15.148:0/338696006 >> 172.21.15.148:0/338696006 conn(0x5630ab38ca30 msgr2=0x5630ab38ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:04.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.080+0000 7f86baf60740 1 -- 172.21.15.148:0/338696006 shutdown_connections 2024-09-19T07:12:04.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.080+0000 7f86baf60740 1 -- 172.21.15.148:0/338696006 wait complete. 2024-09-19T07:12:04.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.080+0000 7f86baf60740 1 -- start start 2024-09-19T07:12:04.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.080+0000 7f86baf60740 1 Processor -- start 2024-09-19T07:12:04.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.080+0000 7f86baf60740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5630ab3904a0 0x5630ab39b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:04.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.081+0000 7f86baf60740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5630ab390dc0 0x5630ab398300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:04.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.081+0000 7f86baf60740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5630ab39b680 0x5630ab3988f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:04.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.081+0000 7f86baf60740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5630ab39e250 con 0x5630ab39b680 2024-09-19T07:12:04.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.081+0000 7f86baf60740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5630ab2b1050 con 0x5630ab390dc0 2024-09-19T07:12:04.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.081+0000 7f86baf60740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5630ab39e3d0 con 0x5630ab3904a0 2024-09-19T07:12:04.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.081+0000 7f86baf60740 10 client.0 _ll_register_callbacks cb 0x5630ab2f1160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:12:04.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.081+0000 7f86b1d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5630ab39b680 0x5630ab3988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:04.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.081+0000 7f86b259c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5630ab390dc0 0x5630ab398300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:04.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.081+0000 7f86b259c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5630ab390dc0 0x5630ab398300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:56280/0 (socket says 172.21.15.148:56280) 2024-09-19T07:12:04.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.081+0000 7f86b259c640 1 -- 172.21.15.148:0/4212878232 learned_addr learned my addr 172.21.15.148:0/4212878232 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:04.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.081+0000 7f86b1d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5630ab39b680 0x5630ab3988f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47558/0 (socket says 172.21.15.148:47558) 2024-09-19T07:12:04.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.081+0000 7f86b259c640 1 -- 172.21.15.148:0/4212878232 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5630ab3904a0 msgr2=0x5630ab39b050 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T07:12:04.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.081+0000 7f86b259c640 1 --2- 172.21.15.148:0/4212878232 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5630ab3904a0 0x5630ab39b050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:04.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.081+0000 7f86b259c640 1 -- 172.21.15.148:0/4212878232 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5630ab39b680 msgr2=0x5630ab3988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:04.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.081+0000 7f86b259c640 1 --2- 172.21.15.148:0/4212878232 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5630ab39b680 0x5630ab3988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:04.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.081+0000 7f86b259c640 1 -- 172.21.15.148:0/4212878232 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630ab0673c0 con 0x5630ab390dc0 2024-09-19T07:12:04.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.081+0000 7f86b1d9b640 1 --2- 172.21.15.148:0/4212878232 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5630ab39b680 0x5630ab3988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:12:04.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.082+0000 7f86b259c640 1 --2- 172.21.15.148:0/4212878232 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5630ab390dc0 0x5630ab398300 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f86a4009900 tx=0x7f86a4004570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bddaa552c3d012ed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:04.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.082+0000 7f8699ffb640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-19T07:12:04.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.082+0000 7f8699ffb640 1 -- 172.21.15.148:0/4212878232 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a404f060 con 0x5630ab390dc0 2024-09-19T07:12:04.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.082+0000 7f86baf60740 1 -- 172.21.15.148:0/4212878232 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86a80047a0 con 0x5630ab390dc0 2024-09-19T07:12:04.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.082+0000 7f8699ffb640 1 -- 172.21.15.148:0/4212878232 <== mon.2 v2:172.21.15.165:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f86a4005450 con 0x5630ab390dc0 2024-09-19T07:12:04.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.082+0000 7f8699ffb640 1 -- 172.21.15.148:0/4212878232 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f86a4035070 con 0x5630ab390dc0 2024-09-19T07:12:04.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.082+0000 7f86baf60740 10 client.25100 fetch_fsmap learned FSMap version 25 2024-09-19T07:12:04.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.082+0000 7f86baf60740 1 -- 172.21.15.148:0/4212878232 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5630ab3a9cd0 con 0x5630ab390dc0 2024-09-19T07:12:04.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.082+0000 7f8699ffb640 1 -- 172.21.15.148:0/4212878232 <== mon.2 v2:172.21.15.165:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86a80047a0 con 0x5630ab390dc0 2024-09-19T07:12:04.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.083+0000 7f8699ffb640 1 -- 172.21.15.148:0/4212878232 <== mon.2 v2:172.21.15.165:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f86a4049030 con 0x5630ab390dc0 2024-09-19T07:12:04.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.083+0000 7f86baf60740 10 client.25100 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:12:04.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.083+0000 7f86baf60740 10 client.25100 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:12:04.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.083+0000 7f86baf60740 20 client.25100 populate_metadata read hostname 'smithi148' 2024-09-19T07:12:04.105 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.083+0000 7f86baf60740 1 --2- 172.21.15.148:0/4212878232 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5630ab3ab550 0x5630ab3ada10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:04.105 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.083+0000 7f86baf60740 4 client.25100 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:12:04.105 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.083+0000 7f86baf60740 1 -- 172.21.15.148:0/4212878232 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5630ab303850 con 0x5630ab3ab550 2024-09-19T07:12:04.105 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.083+0000 7f86b1d9b640 1 --2- 172.21.15.148:0/4212878232 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5630ab3ab550 0x5630ab3ada10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:04.105 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.084+0000 7f8699ffb640 10 client.25100 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:04.105 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.084+0000 7f86b1d9b640 1 --2- 172.21.15.148:0/4212878232 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5630ab3ab550 0x5630ab3ada10 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52385a9b1aa8dcbd server_cookie=646e24096448b4dc in_seq=0 out_seq=0 2024-09-19T07:12:04.105 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.084+0000 7f8699ffb640 1 -- 172.21.15.148:0/4212878232 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5630ab303850 con 0x5630ab3ab550 2024-09-19T07:12:04.105 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.084+0000 7f8699ffb640 10 client.25100 handle_command_reply: tid=0 2024-09-19T07:12:04.105 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.084+0000 7f86baf60740 1 client.25100 shutdown 2024-09-19T07:12:04.105 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.085+0000 7f86baf60740 1 -- 172.21.15.148:0/4212878232 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5630ab390dc0 msgr2=0x5630ab398300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:04.105 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.085+0000 7f86baf60740 1 --2- 172.21.15.148:0/4212878232 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5630ab390dc0 0x5630ab398300 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f86a4009900 tx=0x7f86a4004570 comp rx=0 tx=0).stop 2024-09-19T07:12:04.105 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.085+0000 7f86baf60740 1 -- 172.21.15.148:0/4212878232 shutdown_connections 2024-09-19T07:12:04.105 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.085+0000 7f86baf60740 1 --2- 172.21.15.148:0/4212878232 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5630ab3ab550 0x5630ab3ada10 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:04.105 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.085+0000 7f86baf60740 1 --2- 172.21.15.148:0/4212878232 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5630ab39b680 0x5630ab3988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:04.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.085+0000 7f86baf60740 1 --2- 172.21.15.148:0/4212878232 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5630ab390dc0 0x5630ab398300 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:04.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.085+0000 7f86baf60740 1 --2- 172.21.15.148:0/4212878232 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5630ab3904a0 0x5630ab39b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:04.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.085+0000 7f86baf60740 1 -- 172.21.15.148:0/4212878232 >> 172.21.15.148:0/4212878232 conn(0x5630ab38ca30 msgr2=0x5630ab392760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:04.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.085+0000 7f8699ffb640 0 client.25100 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:04.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.085+0000 7f86baf60740 1 -- 172.21.15.148:0/4212878232 shutdown_connections 2024-09-19T07:12:04.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.085+0000 7f86baf60740 1 -- 172.21.15.148:0/4212878232 wait complete. 2024-09-19T07:12:04.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.085+0000 7f86baf60740 20 client.25100 trim_cache size 0 max 16384 2024-09-19T07:12:04.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.103+0000 7f86baf60740 1 Processor -- start 2024-09-19T07:12:04.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.103+0000 7f86baf60740 1 -- start start 2024-09-19T07:12:04.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.103+0000 7f86baf60740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5630ab3904a0 0x5630ab3a74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:04.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.103+0000 7f86baf60740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5630ab390dc0 0x5630ab396bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:04.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.103+0000 7f86baf60740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5630ab39b680 0x5630ab3937f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:04.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.104+0000 7f86b1d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5630ab39b680 0x5630ab3937f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:04.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.104+0000 7f86b259c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5630ab390dc0 0x5630ab396bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:04.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.104+0000 7f86b259c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5630ab390dc0 0x5630ab396bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:39664/0 (socket says 172.21.15.148:39664) 2024-09-19T07:12:04.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.104+0000 7f86b1d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5630ab39b680 0x5630ab3937f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47560/0 (socket says 172.21.15.148:47560) 2024-09-19T07:12:04.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.104+0000 7f86b259c640 1 -- 172.21.15.148:0/3847298733 learned_addr learned my addr 172.21.15.148:0/3847298733 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:04.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.104+0000 7f86baf60740 1 -- 172.21.15.148:0/3847298733 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f86b41adea0 con 0x5630ab39b680 2024-09-19T07:12:04.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.104+0000 7f86baf60740 1 -- 172.21.15.148:0/3847298733 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f86b41ab770 con 0x5630ab3904a0 2024-09-19T07:12:04.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.104+0000 7f86baf60740 1 -- 172.21.15.148:0/3847298733 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f86b41a95e0 con 0x5630ab390dc0 2024-09-19T07:12:04.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.105+0000 7f86b1d9b640 1 -- 172.21.15.148:0/3847298733 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5630ab390dc0 msgr2=0x5630ab396bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:04.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.105+0000 7f86b1d9b640 1 --2- 172.21.15.148:0/3847298733 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5630ab390dc0 0x5630ab396bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:04.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.105+0000 7f86b1d9b640 1 -- 172.21.15.148:0/3847298733 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5630ab3904a0 msgr2=0x5630ab3a74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:04.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.105+0000 7f86b1d9b640 1 --2- 172.21.15.148:0/3847298733 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5630ab3904a0 0x5630ab3a74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:04.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.105+0000 7f86b1d9b640 1 -- 172.21.15.148:0/3847298733 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630ab3972b0 con 0x5630ab39b680 2024-09-19T07:12:04.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.105+0000 7f86b1d9b640 1 --2- 172.21.15.148:0/3847298733 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5630ab39b680 0x5630ab3937f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f86a8005d00 tx=0x7f86a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16df37a65600a2be server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:04.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.106+0000 7f869bfff640 1 -- 172.21.15.148:0/3847298733 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a802e070 con 0x5630ab39b680 2024-09-19T07:12:04.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.106+0000 7f869bfff640 1 -- 172.21.15.148:0/3847298733 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86a800ab90 con 0x5630ab39b680 2024-09-19T07:12:04.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.106+0000 7f869bfff640 1 -- 172.21.15.148:0/3847298733 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a8003850 con 0x5630ab39b680 2024-09-19T07:12:04.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.107+0000 7f86baf60740 1 -- 172.21.15.148:0/3847298733 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5630ab39b680 msgr2=0x5630ab3937f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:04.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.107+0000 7f86baf60740 1 --2- 172.21.15.148:0/3847298733 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5630ab39b680 0x5630ab3937f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f86a8005d00 tx=0x7f86a80046c0 comp rx=0 tx=0).stop 2024-09-19T07:12:04.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.107+0000 7f86baf60740 1 -- 172.21.15.148:0/3847298733 shutdown_connections 2024-09-19T07:12:04.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.107+0000 7f86baf60740 1 --2- 172.21.15.148:0/3847298733 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5630ab39b680 0x5630ab3937f0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:04.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.107+0000 7f86baf60740 1 --2- 172.21.15.148:0/3847298733 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5630ab390dc0 0x5630ab396bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:04.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.107+0000 7f86baf60740 1 --2- 172.21.15.148:0/3847298733 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5630ab3904a0 0x5630ab3a74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:04.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.107+0000 7f86baf60740 1 -- 172.21.15.148:0/3847298733 >> 172.21.15.148:0/3847298733 conn(0x5630ab38ca30 msgr2=0x5630ab3930e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:04.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.107+0000 7f86baf60740 1 -- 172.21.15.148:0/3847298733 shutdown_connections 2024-09-19T07:12:04.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.107+0000 7f86baf60740 1 -- 172.21.15.148:0/3847298733 wait complete. 2024-09-19T07:12:04.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.108+0000 7f86baf60740 1 -- start start 2024-09-19T07:12:04.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.108+0000 7f86baf60740 1 Processor -- start 2024-09-19T07:12:04.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.109+0000 7f86baf60740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5630ab3904a0 0x5630ab39ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:04.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.109+0000 7f86b1d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5630ab3904a0 0x5630ab39ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:04.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.109+0000 7f86b1d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5630ab3904a0 0x5630ab39ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47562/0 (socket says 172.21.15.148:47562) 2024-09-19T07:12:04.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.109+0000 7f86b1d9b640 1 -- 172.21.15.148:0/2470752102 learned_addr learned my addr 172.21.15.148:0/2470752102 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:04.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.109+0000 7f86baf60740 1 --2- 172.21.15.148:0/2470752102 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5630ab390dc0 0x5630ab39f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:04.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.109+0000 7f86baf60740 1 --2- 172.21.15.148:0/2470752102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5630ab39b680 0x5630ab4142a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:04.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.109+0000 7f86baf60740 1 -- 172.21.15.148:0/2470752102 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f86b41a9c30 con 0x5630ab3904a0 2024-09-19T07:12:04.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.110+0000 7f86baf60740 1 -- 172.21.15.148:0/2470752102 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f86b41ab0a0 con 0x5630ab390dc0 2024-09-19T07:12:04.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.110+0000 7f86baf60740 1 -- 172.21.15.148:0/2470752102 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f86b41aa300 con 0x5630ab39b680 2024-09-19T07:12:04.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.110+0000 7f86b259c640 1 --2- 172.21.15.148:0/2470752102 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5630ab390dc0 0x5630ab39f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:04.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.110+0000 7f86b259c640 1 -- 172.21.15.148:0/2470752102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5630ab39b680 msgr2=0x5630ab4142a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:04.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.110+0000 7f86b259c640 1 --2- 172.21.15.148:0/2470752102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5630ab39b680 0x5630ab4142a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:04.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.110+0000 7f86b259c640 1 -- 172.21.15.148:0/2470752102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5630ab3904a0 msgr2=0x5630ab39ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:04.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.110+0000 7f86b259c640 1 --2- 172.21.15.148:0/2470752102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5630ab3904a0 0x5630ab39ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:04.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.110+0000 7f86b259c640 1 -- 172.21.15.148:0/2470752102 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630ab390bf0 con 0x5630ab390dc0 2024-09-19T07:12:04.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.110+0000 7f86b1d9b640 1 --2- 172.21.15.148:0/2470752102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5630ab3904a0 0x5630ab39ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:12:04.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.110+0000 7f86baf60740 10 client.0 _ll_register_callbacks cb 0x7f86a4004180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:12:04.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.110+0000 7f86b259c640 1 --2- 172.21.15.148:0/2470752102 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5630ab390dc0 0x5630ab39f2a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f86a4000c00 tx=0x7f86a4003820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c120d905a28fe2ae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:04.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.110+0000 7f86baf60740 1 -- 172.21.15.148:0/2470752102 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86a800ab90 con 0x5630ab390dc0 2024-09-19T07:12:04.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.110+0000 7f8699ffb640 10 client.25103 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-19T07:12:04.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.110+0000 7f8699ffb640 1 -- 172.21.15.148:0/2470752102 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a404f040 con 0x5630ab390dc0 2024-09-19T07:12:04.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.111+0000 7f8699ffb640 1 -- 172.21.15.148:0/2470752102 <== mon.2 v2:172.21.15.165:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f86a40316a0 con 0x5630ab390dc0 2024-09-19T07:12:04.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.111+0000 7f8699ffb640 1 -- 172.21.15.148:0/2470752102 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f86a4031900 con 0x5630ab390dc0 2024-09-19T07:12:04.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.111+0000 7f86baf60740 10 client.25103 fetch_fsmap learned FSMap version 25 2024-09-19T07:12:04.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.111+0000 7f86baf60740 1 -- 172.21.15.148:0/2470752102 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({fsmap=25}) -- 0x5630ab398c60 con 0x5630ab390dc0 2024-09-19T07:12:04.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.111+0000 7f8699ffb640 1 -- 172.21.15.148:0/2470752102 <== mon.2 v2:172.21.15.165:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f86a4049070 con 0x5630ab390dc0 2024-09-19T07:12:04.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.111+0000 7f86baf60740 10 client.25103 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:12:04.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.112+0000 7f86baf60740 10 client.25103 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:12:04.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.112+0000 7f86baf60740 20 client.25103 populate_metadata read hostname 'smithi148' 2024-09-19T07:12:04.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.112+0000 7f86baf60740 1 --2- 172.21.15.148:0/2470752102 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5630ab415d80 0x5630ab4181a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:04.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.112+0000 7f86baf60740 4 client.25103 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T07:12:04.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.112+0000 7f86baf60740 1 -- 172.21.15.148:0/2470752102 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f86a800ab90 con 0x5630ab415d80 2024-09-19T07:12:04.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.112+0000 7f86b1d9b640 1 --2- 172.21.15.148:0/2470752102 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5630ab415d80 0x5630ab4181a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:04.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.113+0000 7f8699ffb640 10 client.25103 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:04.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.113+0000 7f86b1d9b640 1 --2- 172.21.15.148:0/2470752102 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5630ab415d80 0x5630ab4181a0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc57fd33780359c5 server_cookie=c1af7fd84b29d399 in_seq=0 out_seq=0 2024-09-19T07:12:04.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.113+0000 7f8699ffb640 1 -- 172.21.15.148:0/2470752102 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7f86a800ab90 con 0x5630ab415d80 2024-09-19T07:12:04.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.113+0000 7f8699ffb640 10 client.25103 handle_command_reply: tid=0 2024-09-19T07:12:04.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.113+0000 7f86baf60740 1 client.25103 shutdown 2024-09-19T07:12:04.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.113+0000 7f86baf60740 1 -- 172.21.15.148:0/2470752102 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5630ab390dc0 msgr2=0x5630ab39f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:04.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.113+0000 7f86baf60740 1 --2- 172.21.15.148:0/2470752102 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5630ab390dc0 0x5630ab39f2a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f86a4000c00 tx=0x7f86a4003820 comp rx=0 tx=0).stop 2024-09-19T07:12:04.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.113+0000 7f86baf60740 1 -- 172.21.15.148:0/2470752102 shutdown_connections 2024-09-19T07:12:04.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.113+0000 7f86baf60740 1 --2- 172.21.15.148:0/2470752102 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5630ab415d80 0x5630ab4181a0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:04.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.113+0000 7f8699ffb640 0 client.25103 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:04.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.113+0000 7f86baf60740 1 --2- 172.21.15.148:0/2470752102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5630ab39b680 0x5630ab4142a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:04.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.113+0000 7f86baf60740 1 --2- 172.21.15.148:0/2470752102 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5630ab390dc0 0x5630ab39f2a0 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f86a4000c00 tx=0x7f86a4003820 comp rx=0 tx=0).stop 2024-09-19T07:12:04.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.113+0000 7f86baf60740 1 --2- 172.21.15.148:0/2470752102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5630ab3904a0 0x5630ab39ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:04.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.113+0000 7f86baf60740 1 -- 172.21.15.148:0/2470752102 >> 172.21.15.148:0/2470752102 conn(0x5630ab38ca30 msgr2=0x5630ab38b350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:04.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.114+0000 7f86baf60740 1 -- 172.21.15.148:0/2470752102 shutdown_connections 2024-09-19T07:12:04.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.114+0000 7f86baf60740 1 -- 172.21.15.148:0/2470752102 wait complete. 2024-09-19T07:12:04.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.114+0000 7f86baf60740 20 client.25103 trim_cache size 0 max 16384 2024-09-19T07:12:04.118 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:12:04.119 INFO:teuthology.orchestra.run.smithi148.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T07:12:04.119 INFO:teuthology.orchestra.run.smithi148.stdout: "scrubs": { 2024-09-19T07:12:04.119 INFO:teuthology.orchestra.run.smithi148.stdout: "eb316b70-566f-4da5-87d3-ce9ecb4497f6": { 2024-09-19T07:12:04.119 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/", 2024-09-19T07:12:04.119 INFO:teuthology.orchestra.run.smithi148.stdout: "tag": "eb316b70-566f-4da5-87d3-ce9ecb4497f6", 2024-09-19T07:12:04.119 INFO:teuthology.orchestra.run.smithi148.stdout: "options": "recursive,force" 2024-09-19T07:12:04.119 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:12:04.119 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:12:04.119 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:12:04.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.115+0000 7f86b8b87640 1 -- 172.21.15.148:0/2596612847 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f869c0a35d0 msgr2=0x7f869c0a5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:04.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.115+0000 7f86b8b87640 1 --2- 172.21.15.148:0/2596612847 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f869c0a35d0 0x7f869c0a5a90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f86ac0cdc30 tx=0x7f86ac091b20 comp rx=0 tx=0).stop 2024-09-19T07:12:04.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.115+0000 7f86b8b87640 1 -- 172.21.15.148:0/2596612847 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86b4106f20 msgr2=0x7f86b419ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:04.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.115+0000 7f86b8b87640 1 --2- 172.21.15.148:0/2596612847 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86b4106f20 0x7f86b419ef40 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f86ac00cce0 tx=0x7f86ac00a620 comp rx=0 tx=0).stop 2024-09-19T07:12:04.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.115+0000 7f86b8b87640 1 -- 172.21.15.148:0/2596612847 shutdown_connections 2024-09-19T07:12:04.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.115+0000 7f86b8b87640 1 --2- 172.21.15.148:0/2596612847 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f869c0a35d0 0x7f869c0a5a90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:04.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.115+0000 7f86b8b87640 1 --2- 172.21.15.148:0/2596612847 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86b4106f20 0x7f86b419ef40 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:04.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.115+0000 7f86b8b87640 1 --2- 172.21.15.148:0/2596612847 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86b41027a0 0x7f86b419abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:04.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.115+0000 7f86b8b87640 1 --2- 172.21.15.148:0/2596612847 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86b4101df0 0x7f86b419a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:04.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.115+0000 7f86b8b87640 1 -- 172.21.15.148:0/2596612847 >> 172.21.15.148:0/2596612847 conn(0x7f86b40fd8f0 msgr2=0x7f86b40febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:04.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.115+0000 7f86b8b87640 1 -- 172.21.15.148:0/2596612847 shutdown_connections 2024-09-19T07:12:04.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:04.116+0000 7f86b8b87640 1 -- 172.21.15.148:0/2596612847 wait complete. 2024-09-19T07:12:04.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:04 smithi148 ceph-mon[31180]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-19T07:12:04.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:04 smithi165 ceph-mon[35326]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-19T07:12:04.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:04 smithi179 ceph-mon[35716]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-19T07:12:04.870 INFO:tasks.cephfs.filesystem:scrub status for tag:eb316b70-566f-4da5-87d3-ce9ecb4497f6 - {'path': '/', 'tag': 'eb316b70-566f-4da5-87d3-ce9ecb4497f6', 'options': 'recursive,force'} 2024-09-19T07:12:06.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:06 smithi165 ceph-mon[35326]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 25 op/s 2024-09-19T07:12:06.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:06 smithi165 ceph-mon[35326]: scrub summary: idle 2024-09-19T07:12:06.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:06 smithi179 ceph-mon[35716]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 25 op/s 2024-09-19T07:12:06.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:06 smithi179 ceph-mon[35716]: scrub summary: idle 2024-09-19T07:12:06.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:06 smithi148 ceph-mon[31180]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 25 op/s 2024-09-19T07:12:06.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:06 smithi148 ceph-mon[31180]: scrub summary: idle 2024-09-19T07:12:07.160 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.158+0000 7f23e13be640 1 -- 172.21.15.148:0/3120065325 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23dc100490 msgr2=0x7f23dc100870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:07.160 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.158+0000 7f23e13be640 1 --2- 172.21.15.148:0/3120065325 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23dc100490 0x7f23dc100870 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f23cc009930 tx=0x7f23cc02a420 comp rx=0 tx=0).stop 2024-09-19T07:12:07.160 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.159+0000 7f23e13be640 1 -- 172.21.15.148:0/3120065325 shutdown_connections 2024-09-19T07:12:07.160 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.159+0000 7f23e13be640 1 --2- 172.21.15.148:0/3120065325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23dc1026f0 0x7f23dc10d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:07.160 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.159+0000 7f23e13be640 1 --2- 172.21.15.148:0/3120065325 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f23dc101d70 0x7f23dc1021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:07.160 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.159+0000 7f23e13be640 1 --2- 172.21.15.148:0/3120065325 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23dc100490 0x7f23dc100870 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:07.160 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.159+0000 7f23e13be640 1 -- 172.21.15.148:0/3120065325 >> 172.21.15.148:0/3120065325 conn(0x7f23dc0770f0 msgr2=0x7f23dc0fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:07.161 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.159+0000 7f23e13be640 1 -- 172.21.15.148:0/3120065325 shutdown_connections 2024-09-19T07:12:07.161 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.159+0000 7f23e13be640 1 -- 172.21.15.148:0/3120065325 wait complete. 2024-09-19T07:12:07.161 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.160+0000 7f23e13be640 1 Processor -- start 2024-09-19T07:12:07.163 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.160+0000 7f23e13be640 1 -- start start 2024-09-19T07:12:07.163 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.160+0000 7f23e13be640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23dc100490 0x7f23dc1983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:07.163 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.160+0000 7f23e13be640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23dc101d70 0x7f23dc198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:07.163 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.160+0000 7f23e13be640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f23dc1026f0 0x7f23dc19ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:07.163 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.160+0000 7f23e13be640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f23dc110f30 con 0x7f23dc100490 2024-09-19T07:12:07.163 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.160+0000 7f23e13be640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f23dc110db0 con 0x7f23dc1026f0 2024-09-19T07:12:07.163 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.160+0000 7f23e13be640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f23dc1110b0 con 0x7f23dc101d70 2024-09-19T07:12:07.163 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.160+0000 7f23daffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23dc100490 0x7f23dc1983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:07.163 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.160+0000 7f23daffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23dc100490 0x7f23dc1983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58540/0 (socket says 172.21.15.148:58540) 2024-09-19T07:12:07.163 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.160+0000 7f23daffd640 1 -- 172.21.15.148:0/316646916 learned_addr learned my addr 172.21.15.148:0/316646916 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:07.163 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.160+0000 7f23da7fc640 1 --2- 172.21.15.148:0/316646916 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23dc101d70 0x7f23dc198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:07.163 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.160+0000 7f23db7fe640 1 --2- 172.21.15.148:0/316646916 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f23dc1026f0 0x7f23dc19ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:07.164 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.161+0000 7f23da7fc640 1 -- 172.21.15.148:0/316646916 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f23dc1026f0 msgr2=0x7f23dc19ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:07.164 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.161+0000 7f23da7fc640 1 --2- 172.21.15.148:0/316646916 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f23dc1026f0 0x7f23dc19ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:07.164 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.161+0000 7f23da7fc640 1 -- 172.21.15.148:0/316646916 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23dc100490 msgr2=0x7f23dc1983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:07.164 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.161+0000 7f23da7fc640 1 --2- 172.21.15.148:0/316646916 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23dc100490 0x7f23dc1983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:07.164 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.161+0000 7f23da7fc640 1 -- 172.21.15.148:0/316646916 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23dc19d3e0 con 0x7f23dc101d70 2024-09-19T07:12:07.164 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.161+0000 7f23daffd640 1 --2- 172.21.15.148:0/316646916 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23dc100490 0x7f23dc1983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:12:07.164 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.161+0000 7f23da7fc640 1 --2- 172.21.15.148:0/316646916 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23dc101d70 0x7f23dc198930 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f23d0005fd0 tx=0x7f23d000dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:07.164 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.161+0000 7f23c3fff640 1 -- 172.21.15.148:0/316646916 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d0009c30 con 0x7f23dc101d70 2024-09-19T07:12:07.164 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.161+0000 7f23e13be640 1 -- 172.21.15.148:0/316646916 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23dc19d6d0 con 0x7f23dc101d70 2024-09-19T07:12:07.164 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.161+0000 7f23c3fff640 1 -- 172.21.15.148:0/316646916 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23d0009dd0 con 0x7f23dc101d70 2024-09-19T07:12:07.164 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.161+0000 7f23c3fff640 1 -- 172.21.15.148:0/316646916 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d0010460 con 0x7f23dc101d70 2024-09-19T07:12:07.164 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.161+0000 7f23e13be640 1 -- 172.21.15.148:0/316646916 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23dc0fc470 con 0x7f23dc101d70 2024-09-19T07:12:07.165 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.165+0000 7f23e4230740 1 Processor -- start 2024-09-19T07:12:07.165 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.165+0000 7f23e4230740 1 -- start start 2024-09-19T07:12:07.166 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.165+0000 7f23c3fff640 1 -- 172.21.15.148:0/316646916 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 24) ==== 138589+0+0 (secure 0 0 0) 0x7f23d0003ef0 con 0x7f23dc101d70 2024-09-19T07:12:07.166 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.165+0000 7f23e4230740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55630245aaf0 0x55630245aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:07.166 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.165+0000 7f23e4230740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55630245b410 0x556302465770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:07.166 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.165+0000 7f23e4230740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556302465cb0 0x5563024680a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:07.166 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.165+0000 7f23e4230740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5563023bf2f0 con 0x55630245aaf0 2024-09-19T07:12:07.166 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.165+0000 7f23e4230740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x556302367270 con 0x556302465cb0 2024-09-19T07:12:07.166 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.165+0000 7f23e4230740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5563023bb2b0 con 0x55630245b410 2024-09-19T07:12:07.167 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.165+0000 7f23db7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55630245aaf0 0x55630245aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:07.167 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.165+0000 7f23db7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55630245aaf0 0x55630245aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58556/0 (socket says 172.21.15.148:58556) 2024-09-19T07:12:07.167 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.165+0000 7f23db7fe640 1 -- 172.21.15.148:0/1294636464 learned_addr learned my addr 172.21.15.148:0/1294636464 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:07.167 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.165+0000 7f23daffd640 1 --2- 172.21.15.148:0/1294636464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55630245b410 0x556302465770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:07.167 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.165+0000 7f23da7fc640 1 --2- 172.21.15.148:0/1294636464 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556302465cb0 0x5563024680a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.165+0000 7f23db7fe640 1 -- 172.21.15.148:0/1294636464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55630245b410 msgr2=0x556302465770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.165+0000 7f23db7fe640 1 --2- 172.21.15.148:0/1294636464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55630245b410 0x556302465770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.165+0000 7f23db7fe640 1 -- 172.21.15.148:0/1294636464 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556302465cb0 msgr2=0x5563024680a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.165+0000 7f23db7fe640 1 --2- 172.21.15.148:0/1294636464 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556302465cb0 0x5563024680a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.166+0000 7f23db7fe640 1 -- 172.21.15.148:0/1294636464 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556302366340 con 0x55630245aaf0 2024-09-19T07:12:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.166+0000 7f23da7fc640 1 --2- 172.21.15.148:0/1294636464 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556302465cb0 0x5563024680a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:12:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.166+0000 7f23db7fe640 1 --2- 172.21.15.148:0/1294636464 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55630245aaf0 0x55630245aed0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f23d4009f50 tx=0x7f23d40118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df96fbba6478a93f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.166+0000 7f23c17fa640 1 -- 172.21.15.148:0/1294636464 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d4004d20 con 0x55630245aaf0 2024-09-19T07:12:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.166+0000 7f23c17fa640 1 -- 172.21.15.148:0/1294636464 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23d4004050 con 0x55630245aaf0 2024-09-19T07:12:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.166+0000 7f23c3fff640 1 --2- 172.21.15.148:0/316646916 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f23c40a3600 0x7f23c40a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.167+0000 7f23c17fa640 1 -- 172.21.15.148:0/1294636464 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d4005220 con 0x55630245aaf0 2024-09-19T07:12:07.169 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.167+0000 7f23daffd640 1 --2- 172.21.15.148:0/316646916 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f23c40a3600 0x7f23c40a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:07.169 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.167+0000 7f23c3fff640 1 -- 172.21.15.148:0/316646916 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f23d00cfad0 con 0x7f23dc101d70 2024-09-19T07:12:07.173 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.167+0000 7f23e4230740 1 -- 172.21.15.148:0/1294636464 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55630245aaf0 msgr2=0x55630245aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:07.173 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.167+0000 7f23e4230740 1 --2- 172.21.15.148:0/1294636464 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55630245aaf0 0x55630245aed0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f23d4009f50 tx=0x7f23d40118d0 comp rx=0 tx=0).stop 2024-09-19T07:12:07.173 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.167+0000 7f23e4230740 1 -- 172.21.15.148:0/1294636464 shutdown_connections 2024-09-19T07:12:07.173 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.167+0000 7f23e4230740 1 --2- 172.21.15.148:0/1294636464 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556302465cb0 0x5563024680a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:07.173 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.167+0000 7f23e4230740 1 --2- 172.21.15.148:0/1294636464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55630245b410 0x556302465770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:07.173 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.167+0000 7f23e4230740 1 --2- 172.21.15.148:0/1294636464 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55630245aaf0 0x55630245aed0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:07.173 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.167+0000 7f23e4230740 1 -- 172.21.15.148:0/1294636464 >> 172.21.15.148:0/1294636464 conn(0x556302457060 msgr2=0x556302457440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:07.173 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.167+0000 7f23e4230740 1 -- 172.21.15.148:0/1294636464 shutdown_connections 2024-09-19T07:12:07.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.167+0000 7f23daffd640 1 --2- 172.21.15.148:0/316646916 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f23c40a3600 0x7f23c40a5ac0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x556302457ec0 tx=0x7f23cc031510 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:07.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.167+0000 7f23e4230740 1 -- 172.21.15.148:0/1294636464 wait complete. 2024-09-19T07:12:07.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.168+0000 7f23e4230740 1 -- start start 2024-09-19T07:12:07.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.168+0000 7f23e4230740 1 Processor -- start 2024-09-19T07:12:07.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.168+0000 7f23e4230740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55630245aaf0 0x556302462a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:07.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.168+0000 7f23e4230740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55630245b410 0x556302462fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:07.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.168+0000 7f23e4230740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556302465cb0 0x556302463510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:07.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.168+0000 7f23daffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55630245aaf0 0x556302462a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:07.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.168+0000 7f23daffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55630245aaf0 0x556302462a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58564/0 (socket says 172.21.15.148:58564) 2024-09-19T07:12:07.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.169+0000 7f23daffd640 1 -- 172.21.15.148:0/4235968633 learned_addr learned my addr 172.21.15.148:0/4235968633 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:07.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.169+0000 7f23e4230740 1 -- 172.21.15.148:0/4235968633 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5563024688d0 con 0x55630245aaf0 2024-09-19T07:12:07.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.169+0000 7f23da7fc640 1 --2- 172.21.15.148:0/4235968633 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55630245b410 0x556302462fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:07.175 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.169+0000 7f23e4230740 1 -- 172.21.15.148:0/4235968633 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x556302348290 con 0x556302465cb0 2024-09-19T07:12:07.175 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.169+0000 7f23db7fe640 1 --2- 172.21.15.148:0/4235968633 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556302465cb0 0x556302463510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:07.175 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.169+0000 7f23e4230740 1 -- 172.21.15.148:0/4235968633 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x556302468a50 con 0x55630245b410 2024-09-19T07:12:07.175 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.169+0000 7f23e4230740 10 client.0 _ll_register_callbacks cb 0x556302379140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:12:07.175 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.169+0000 7f23daffd640 1 -- 172.21.15.148:0/4235968633 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55630245b410 msgr2=0x556302462fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:07.175 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.169+0000 7f23daffd640 1 --2- 172.21.15.148:0/4235968633 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55630245b410 0x556302462fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:07.175 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.169+0000 7f23daffd640 1 -- 172.21.15.148:0/4235968633 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556302465cb0 msgr2=0x556302463510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:07.175 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.169+0000 7f23daffd640 1 --2- 172.21.15.148:0/4235968633 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556302465cb0 0x556302463510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:07.175 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.169+0000 7f23daffd640 1 -- 172.21.15.148:0/4235968633 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563020d2210 con 0x55630245aaf0 2024-09-19T07:12:07.175 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.169+0000 7f23e4230740 1 -- 172.21.15.148:0/4235968633 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23d4004050 con 0x55630245aaf0 2024-09-19T07:12:07.175 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.169+0000 7f23daffd640 1 --2- 172.21.15.148:0/4235968633 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55630245aaf0 0x556302462a90 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f23cc005620 tx=0x7f23cc009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=564a4d07f6e6bb6c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:07.175 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.169+0000 7f23beff5640 10 client.15642 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:12:07.175 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.170+0000 7f23beff5640 1 -- 172.21.15.148:0/4235968633 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23cc035040 con 0x55630245aaf0 2024-09-19T07:12:07.175 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.170+0000 7f23beff5640 1 -- 172.21.15.148:0/4235968633 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f23cc0317b0 con 0x55630245aaf0 2024-09-19T07:12:07.176 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.170+0000 7f23beff5640 1 -- 172.21.15.148:0/4235968633 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f23cc0319b0 con 0x55630245aaf0 2024-09-19T07:12:07.176 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.170+0000 7f23e4230740 10 client.15642 fetch_fsmap learned FSMap version 25 2024-09-19T07:12:07.176 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.170+0000 7f23e4230740 1 -- 172.21.15.148:0/4235968633 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({fsmap=25}) -- 0x55630219e620 con 0x55630245aaf0 2024-09-19T07:12:07.176 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.170+0000 7f23beff5640 1 -- 172.21.15.148:0/4235968633 <== mon.0 v2:172.21.15.148:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f23cc044030 con 0x55630245aaf0 2024-09-19T07:12:07.176 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.170+0000 7f23e4230740 10 client.15642 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:12:07.176 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.170+0000 7f23e4230740 10 client.15642 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:12:07.176 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.170+0000 7f23e4230740 20 client.15642 populate_metadata read hostname 'smithi148' 2024-09-19T07:12:07.176 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.170+0000 7f23e4230740 1 --2- 172.21.15.148:0/4235968633 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5563024758e0 0x556302477cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:07.176 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.170+0000 7f23e4230740 4 client.15642 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:12:07.176 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.170+0000 7f23e4230740 1 -- 172.21.15.148:0/4235968633 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5563023cca20 con 0x5563024758e0 2024-09-19T07:12:07.176 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.171+0000 7f23da7fc640 1 --2- 172.21.15.148:0/4235968633 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5563024758e0 0x556302477cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:07.176 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.171+0000 7f23beff5640 10 client.15642 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:07.176 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.171+0000 7f23da7fc640 1 --2- 172.21.15.148:0/4235968633 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5563024758e0 0x556302477cf0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96bdd9cbb956bf23 server_cookie=b1006cab61bdeed3 in_seq=0 out_seq=0 2024-09-19T07:12:07.176 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.172+0000 7f23beff5640 1 -- 172.21.15.148:0/4235968633 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5563023cca20 con 0x5563024758e0 2024-09-19T07:12:07.177 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.172+0000 7f23beff5640 10 client.15642 handle_command_reply: tid=0 2024-09-19T07:12:07.177 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.172+0000 7f23e4230740 1 client.15642 shutdown 2024-09-19T07:12:07.177 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.172+0000 7f23e4230740 1 -- 172.21.15.148:0/4235968633 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55630245aaf0 msgr2=0x556302462a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:07.177 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.172+0000 7f23e4230740 1 --2- 172.21.15.148:0/4235968633 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55630245aaf0 0x556302462a90 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f23cc005620 tx=0x7f23cc009260 comp rx=0 tx=0).stop 2024-09-19T07:12:07.177 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.172+0000 7f23e4230740 1 -- 172.21.15.148:0/4235968633 shutdown_connections 2024-09-19T07:12:07.177 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.172+0000 7f23e4230740 1 --2- 172.21.15.148:0/4235968633 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5563024758e0 0x556302477cf0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:07.177 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.172+0000 7f23e4230740 1 --2- 172.21.15.148:0/4235968633 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556302465cb0 0x556302463510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:07.177 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.172+0000 7f23e4230740 1 --2- 172.21.15.148:0/4235968633 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55630245b410 0x556302462fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:07.177 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.172+0000 7f23e4230740 1 --2- 172.21.15.148:0/4235968633 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55630245aaf0 0x556302462a90 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:07.177 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.172+0000 7f23beff5640 0 client.15642 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:07.177 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.172+0000 7f23e4230740 1 -- 172.21.15.148:0/4235968633 >> 172.21.15.148:0/4235968633 conn(0x556302457060 msgr2=0x5563024561c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:07.178 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.172+0000 7f23e4230740 1 -- 172.21.15.148:0/4235968633 shutdown_connections 2024-09-19T07:12:07.178 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.172+0000 7f23e4230740 1 -- 172.21.15.148:0/4235968633 wait complete. 2024-09-19T07:12:07.178 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.172+0000 7f23e4230740 20 client.15642 trim_cache size 0 max 16384 2024-09-19T07:12:07.187 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.186+0000 7f23e4230740 1 Processor -- start 2024-09-19T07:12:07.187 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.186+0000 7f23e4230740 1 -- start start 2024-09-19T07:12:07.187 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.186+0000 7f23e4230740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55630245aaf0 0x556302461a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:07.187 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.186+0000 7f23e4230740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55630245b410 0x556302463340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:07.188 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.186+0000 7f23e4230740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556302465cb0 0x55630247d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:07.188 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.186+0000 7f23e4230740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f23dc1b2210 con 0x556302465cb0 2024-09-19T07:12:07.188 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.186+0000 7f23e4230740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f23dc1afae0 con 0x55630245b410 2024-09-19T07:12:07.188 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.186+0000 7f23e4230740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f23dc1ad910 con 0x55630245aaf0 2024-09-19T07:12:07.188 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.187+0000 7f23db7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556302465cb0 0x55630247d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:07.188 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.187+0000 7f23db7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556302465cb0 0x55630247d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58568/0 (socket says 172.21.15.148:58568) 2024-09-19T07:12:07.188 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.187+0000 7f23db7fe640 1 -- 172.21.15.148:0/932782968 learned_addr learned my addr 172.21.15.148:0/932782968 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:07.191 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.187+0000 7f23da7fc640 1 --2- 172.21.15.148:0/932782968 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55630245b410 0x556302463340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:07.191 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.187+0000 7f23db7fe640 1 -- 172.21.15.148:0/932782968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55630245aaf0 msgr2=0x556302461a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:07.192 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.187+0000 7f23daffd640 1 --2- 172.21.15.148:0/932782968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55630245aaf0 0x556302461a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:07.192 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.187+0000 7f23db7fe640 1 --2- 172.21.15.148:0/932782968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55630245aaf0 0x556302461a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:07.192 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.187+0000 7f23db7fe640 1 -- 172.21.15.148:0/932782968 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55630245b410 msgr2=0x556302463340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:07.192 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.187+0000 7f23db7fe640 1 --2- 172.21.15.148:0/932782968 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55630245b410 0x556302463340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:07.192 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.187+0000 7f23db7fe640 1 -- 172.21.15.148:0/932782968 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563024655e0 con 0x556302465cb0 2024-09-19T07:12:07.192 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.187+0000 7f23daffd640 1 --2- 172.21.15.148:0/932782968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55630245aaf0 0x556302461a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:12:07.192 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.187+0000 7f23db7fe640 1 --2- 172.21.15.148:0/932782968 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556302465cb0 0x55630247d600 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f23d4006010 tx=0x7f23d4009c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9da2404997cee0a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:07.192 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.187+0000 7f23c0ff9640 1 -- 172.21.15.148:0/932782968 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d4003d30 con 0x556302465cb0 2024-09-19T07:12:07.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.187+0000 7f23c0ff9640 1 -- 172.21.15.148:0/932782968 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23d400f480 con 0x556302465cb0 2024-09-19T07:12:07.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.188+0000 7f23c0ff9640 1 -- 172.21.15.148:0/932782968 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d4019650 con 0x556302465cb0 2024-09-19T07:12:07.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.188+0000 7f23e4230740 1 -- 172.21.15.148:0/932782968 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556302465cb0 msgr2=0x55630247d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:07.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.188+0000 7f23e4230740 1 --2- 172.21.15.148:0/932782968 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556302465cb0 0x55630247d600 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f23d4006010 tx=0x7f23d4009c40 comp rx=0 tx=0).stop 2024-09-19T07:12:07.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.188+0000 7f23e4230740 1 -- 172.21.15.148:0/932782968 shutdown_connections 2024-09-19T07:12:07.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.188+0000 7f23e4230740 1 --2- 172.21.15.148:0/932782968 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556302465cb0 0x55630247d600 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:07.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.188+0000 7f23e4230740 1 --2- 172.21.15.148:0/932782968 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55630245b410 0x556302463340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:07.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.188+0000 7f23e4230740 1 --2- 172.21.15.148:0/932782968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55630245aaf0 0x556302461a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:07.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.188+0000 7f23e4230740 1 -- 172.21.15.148:0/932782968 >> 172.21.15.148:0/932782968 conn(0x556302457060 msgr2=0x556302461360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:07.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.188+0000 7f23e4230740 1 -- 172.21.15.148:0/932782968 shutdown_connections 2024-09-19T07:12:07.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.188+0000 7f23e4230740 1 -- 172.21.15.148:0/932782968 wait complete. 2024-09-19T07:12:07.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.189+0000 7f23e4230740 1 -- start start 2024-09-19T07:12:07.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.189+0000 7f23e4230740 1 Processor -- start 2024-09-19T07:12:07.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.189+0000 7f23e4230740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55630245aaf0 0x556302469a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:07.194 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.189+0000 7f23e4230740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55630245b410 0x556302469f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:07.194 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.189+0000 7f23e4230740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556302465cb0 0x55630246a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:07.194 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.189+0000 7f23e4230740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f23dc1adfa0 con 0x55630245b410 2024-09-19T07:12:07.194 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.189+0000 7f23e4230740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f23dc1af410 con 0x55630245aaf0 2024-09-19T07:12:07.194 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.189+0000 7f23e4230740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f23dc1ae670 con 0x556302465cb0 2024-09-19T07:12:07.194 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.189+0000 7f23e4230740 10 client.0 _ll_register_callbacks cb 0x7f23cc0050c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:12:07.194 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.189+0000 7f23da7fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55630245b410 0x556302469f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:07.194 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.189+0000 7f23da7fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55630245b410 0x556302469f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58574/0 (socket says 172.21.15.148:58574) 2024-09-19T07:12:07.194 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.189+0000 7f23da7fc640 1 -- 172.21.15.148:0/3832060268 learned_addr learned my addr 172.21.15.148:0/3832060268 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:07.194 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.189+0000 7f23daffd640 1 --2- 172.21.15.148:0/3832060268 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55630245aaf0 0x556302469a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:07.194 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.189+0000 7f23db7fe640 1 --2- 172.21.15.148:0/3832060268 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556302465cb0 0x55630246a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:07.194 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.189+0000 7f23da7fc640 1 -- 172.21.15.148:0/3832060268 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556302465cb0 msgr2=0x55630246a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:07.194 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.189+0000 7f23da7fc640 1 --2- 172.21.15.148:0/3832060268 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556302465cb0 0x55630246a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:07.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.189+0000 7f23da7fc640 1 -- 172.21.15.148:0/3832060268 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55630245aaf0 msgr2=0x556302469a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:07.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.189+0000 7f23da7fc640 1 --2- 172.21.15.148:0/3832060268 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55630245aaf0 0x556302469a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:07.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.189+0000 7f23da7fc640 1 -- 172.21.15.148:0/3832060268 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563024df5d0 con 0x55630245b410 2024-09-19T07:12:07.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.189+0000 7f23db7fe640 1 --2- 172.21.15.148:0/3832060268 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556302465cb0 0x55630246a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:12:07.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.190+0000 7f23da7fc640 1 --2- 172.21.15.148:0/3832060268 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55630245b410 0x556302469f60 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f23d009bbb0 tx=0x7f23d0086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dab7749d19dc6aa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:07.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.190+0000 7f23beff5640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:12:07.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.190+0000 7f23beff5640 1 -- 172.21.15.148:0/3832060268 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d0020040 con 0x55630245b410 2024-09-19T07:12:07.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.190+0000 7f23e4230740 1 -- 172.21.15.148:0/3832060268 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23d400f480 con 0x55630245b410 2024-09-19T07:12:07.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.190+0000 7f23beff5640 1 -- 172.21.15.148:0/3832060268 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f23d0098290 con 0x55630245b410 2024-09-19T07:12:07.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.190+0000 7f23beff5640 1 -- 172.21.15.148:0/3832060268 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f23d00ba300 con 0x55630245b410 2024-09-19T07:12:07.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.190+0000 7f23e4230740 10 client.15648 fetch_fsmap learned FSMap version 25 2024-09-19T07:12:07.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.190+0000 7f23e4230740 1 -- 172.21.15.148:0/3832060268 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5563024e0830 con 0x55630245b410 2024-09-19T07:12:07.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.190+0000 7f23beff5640 1 -- 172.21.15.148:0/3832060268 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23d400f480 con 0x55630245b410 2024-09-19T07:12:07.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.190+0000 7f23beff5640 1 -- 172.21.15.148:0/3832060268 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f23d00cd390 con 0x55630245b410 2024-09-19T07:12:07.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.190+0000 7f23e4230740 10 client.15648 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:12:07.196 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.190+0000 7f23e4230740 10 client.15648 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:12:07.196 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.190+0000 7f23e4230740 20 client.15648 populate_metadata read hostname 'smithi148' 2024-09-19T07:12:07.196 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.190+0000 7f23e4230740 1 --2- 172.21.15.148:0/3832060268 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5563024e0fb0 0x5563024e33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:07.196 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.190+0000 7f23e4230740 4 client.15648 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:12:07.196 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.190+0000 7f23e4230740 1 -- 172.21.15.148:0/3832060268 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5563023c6d70 con 0x5563024e0fb0 2024-09-19T07:12:07.196 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.191+0000 7f23daffd640 1 --2- 172.21.15.148:0/3832060268 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5563024e0fb0 0x5563024e33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:07.196 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.191+0000 7f23beff5640 10 client.15648 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:07.196 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.191+0000 7f23daffd640 1 --2- 172.21.15.148:0/3832060268 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5563024e0fb0 0x5563024e33d0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28c793a1ea3d3ff5 server_cookie=9994d9e39088cf57 in_seq=0 out_seq=0 2024-09-19T07:12:07.198 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.197+0000 7f23beff5640 1 -- 172.21.15.148:0/3832060268 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5563023c6d70 con 0x5563024e0fb0 2024-09-19T07:12:07.198 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.197+0000 7f23beff5640 10 client.15648 handle_command_reply: tid=0 2024-09-19T07:12:07.198 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.197+0000 7f23e4230740 1 client.15648 shutdown 2024-09-19T07:12:07.199 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.197+0000 7f23e4230740 1 -- 172.21.15.148:0/3832060268 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55630245b410 msgr2=0x556302469f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:07.199 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.197+0000 7f23e4230740 1 --2- 172.21.15.148:0/3832060268 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55630245b410 0x556302469f60 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f23d009bbb0 tx=0x7f23d0086040 comp rx=0 tx=0).stop 2024-09-19T07:12:07.199 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.197+0000 7f23e4230740 1 -- 172.21.15.148:0/3832060268 shutdown_connections 2024-09-19T07:12:07.199 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.197+0000 7f23e4230740 1 --2- 172.21.15.148:0/3832060268 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5563024e0fb0 0x5563024e33d0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:07.199 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.197+0000 7f23beff5640 0 client.15648 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:07.199 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.197+0000 7f23e4230740 1 --2- 172.21.15.148:0/3832060268 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556302465cb0 0x55630246a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:07.199 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.197+0000 7f23e4230740 1 --2- 172.21.15.148:0/3832060268 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55630245b410 0x556302469f60 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:07.199 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.197+0000 7f23e4230740 1 --2- 172.21.15.148:0/3832060268 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55630245aaf0 0x556302469a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:07.199 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.197+0000 7f23e4230740 1 -- 172.21.15.148:0/3832060268 >> 172.21.15.148:0/3832060268 conn(0x556302457060 msgr2=0x5563024561c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:07.200 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.198+0000 7f23e4230740 1 -- 172.21.15.148:0/3832060268 shutdown_connections 2024-09-19T07:12:07.200 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.198+0000 7f23e4230740 1 -- 172.21.15.148:0/3832060268 wait complete. 2024-09-19T07:12:07.200 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.198+0000 7f23e4230740 20 client.15648 trim_cache size 0 max 16384 2024-09-19T07:12:07.200 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:12:07.200 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:12:07.200 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:12:07.200 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:12:07.201 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.198+0000 7f23e13be640 1 -- 172.21.15.148:0/316646916 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f23c40a3600 msgr2=0x7f23c40a5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:07.201 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.198+0000 7f23e13be640 1 --2- 172.21.15.148:0/316646916 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f23c40a3600 0x7f23c40a5ac0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x556302457ec0 tx=0x7f23cc031510 comp rx=0 tx=0).stop 2024-09-19T07:12:07.201 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.198+0000 7f23e13be640 1 -- 172.21.15.148:0/316646916 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23dc101d70 msgr2=0x7f23dc198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:07.201 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.198+0000 7f23e13be640 1 --2- 172.21.15.148:0/316646916 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23dc101d70 0x7f23dc198930 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f23d0005fd0 tx=0x7f23d000dde0 comp rx=0 tx=0).stop 2024-09-19T07:12:07.201 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.198+0000 7f23e13be640 1 -- 172.21.15.148:0/316646916 shutdown_connections 2024-09-19T07:12:07.201 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.198+0000 7f23e13be640 1 --2- 172.21.15.148:0/316646916 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f23c40a3600 0x7f23c40a5ac0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:07.201 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.198+0000 7f23e13be640 1 --2- 172.21.15.148:0/316646916 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f23dc1026f0 0x7f23dc19ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:07.201 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.198+0000 7f23e13be640 1 --2- 172.21.15.148:0/316646916 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23dc101d70 0x7f23dc198930 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:07.202 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.198+0000 7f23e13be640 1 --2- 172.21.15.148:0/316646916 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23dc100490 0x7f23dc1983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:07.202 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.198+0000 7f23e13be640 1 -- 172.21.15.148:0/316646916 >> 172.21.15.148:0/316646916 conn(0x7f23dc0770f0 msgr2=0x7f23dc10dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:07.202 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.199+0000 7f23e13be640 1 -- 172.21.15.148:0/316646916 shutdown_connections 2024-09-19T07:12:07.202 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:07.199+0000 7f23e13be640 1 -- 172.21.15.148:0/316646916 wait complete. 2024-09-19T07:12:08.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:08 smithi165 ceph-mon[35326]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-19T07:12:08.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:08 smithi179 ceph-mon[35716]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-19T07:12:08.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:08 smithi148 ceph-mon[31180]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-19T07:12:10.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:10 smithi165 ceph-mon[35326]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-19T07:12:10.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:10 smithi179 ceph-mon[35716]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-19T07:12:10.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:10 smithi148 ceph-mon[31180]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-19T07:12:12.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:12 smithi148 ceph-mon[31180]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-19T07:12:12.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:12 smithi165 ceph-mon[35326]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-19T07:12:12.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:12 smithi179 ceph-mon[35716]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-19T07:12:13.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:13 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:12:13.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:13 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:12:13.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:13 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:12:14.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:14 smithi165 ceph-mon[35326]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-19T07:12:14.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:14 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:12:14.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:14 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:12:14.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:14 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:12:14.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:14 smithi179 ceph-mon[35716]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-19T07:12:14.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:14 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:12:14.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:14 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:12:14.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:14 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:12:14.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:14 smithi148 ceph-mon[31180]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-19T07:12:14.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:14 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:12:14.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:14 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:12:14.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:14 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:12:16.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:16 smithi165 ceph-mon[35326]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-19T07:12:16.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:16 smithi179 ceph-mon[35716]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-19T07:12:16.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:16 smithi148 ceph-mon[31180]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-19T07:12:18.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:18 smithi165 ceph-mon[35326]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-19T07:12:18.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:18 smithi179 ceph-mon[35716]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-19T07:12:18.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:18 smithi148 ceph-mon[31180]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-19T07:12:20.329 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.328+0000 7fb5eeed0640 1 -- 172.21.15.148:0/2373125532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5e8101ad0 msgr2=0x7fb5e8101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:20.330 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.328+0000 7fb5eeed0640 1 --2- 172.21.15.148:0/2373125532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5e8101ad0 0x7fb5e8101f30 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fb5d8009930 tx=0x7fb5d802a420 comp rx=0 tx=0).stop 2024-09-19T07:12:20.330 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.328+0000 7fb5eeed0640 1 -- 172.21.15.148:0/2373125532 shutdown_connections 2024-09-19T07:12:20.330 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.328+0000 7fb5eeed0640 1 --2- 172.21.15.148:0/2373125532 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb5e8102470 0x7fb5e810e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:20.330 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.329+0000 7fb5eeed0640 1 --2- 172.21.15.148:0/2373125532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5e8101ad0 0x7fb5e8101f30 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:20.330 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.329+0000 7fb5eeed0640 1 --2- 172.21.15.148:0/2373125532 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5e8107b70 0x7fb5e8107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:20.330 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.329+0000 7fb5eeed0640 1 -- 172.21.15.148:0/2373125532 >> 172.21.15.148:0/2373125532 conn(0x7fb5e80fd7d0 msgr2=0x7fb5e80ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:20.330 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.329+0000 7fb5eeed0640 1 -- 172.21.15.148:0/2373125532 shutdown_connections 2024-09-19T07:12:20.330 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.329+0000 7fb5eeed0640 1 -- 172.21.15.148:0/2373125532 wait complete. 2024-09-19T07:12:20.332 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.329+0000 7fb5eeed0640 1 Processor -- start 2024-09-19T07:12:20.333 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.329+0000 7fb5eeed0640 1 -- start start 2024-09-19T07:12:20.333 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.330+0000 7fb5eeed0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5e8101ad0 0x7fb5e81983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:20.333 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.330+0000 7fb5eeed0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5e8102470 0x7fb5e81988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:20.333 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.330+0000 7fb5eeed0640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb5e8107b70 0x7fb5e819cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:20.333 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.330+0000 7fb5ecc6c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5e8101ad0 0x7fb5e81983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:20.333 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.330+0000 7fb5ecc6c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5e8101ad0 0x7fb5e81983a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54798/0 (socket says 172.21.15.148:54798) 2024-09-19T07:12:20.333 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.330+0000 7fb5eeed0640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e8111f30 con 0x7fb5e8101ad0 2024-09-19T07:12:20.333 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.330+0000 7fb5ecc6c640 1 -- 172.21.15.148:0/1837139575 learned_addr learned my addr 172.21.15.148:0/1837139575 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:20.333 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.330+0000 7fb5eeed0640 1 -- 172.21.15.148:0/1837139575 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e8111db0 con 0x7fb5e8107b70 2024-09-19T07:12:20.333 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.330+0000 7fb5eeed0640 1 -- 172.21.15.148:0/1837139575 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e81120b0 con 0x7fb5e8102470 2024-09-19T07:12:20.333 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.330+0000 7fb5dffff640 1 --2- 172.21.15.148:0/1837139575 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5e8102470 0x7fb5e81988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:20.333 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.330+0000 7fb5ed46d640 1 --2- 172.21.15.148:0/1837139575 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb5e8107b70 0x7fb5e819cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:20.333 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.330+0000 7fb5ecc6c640 1 -- 172.21.15.148:0/1837139575 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5e8102470 msgr2=0x7fb5e81988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:20.334 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.330+0000 7fb5ecc6c640 1 --2- 172.21.15.148:0/1837139575 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5e8102470 0x7fb5e81988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:20.334 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.330+0000 7fb5ecc6c640 1 -- 172.21.15.148:0/1837139575 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb5e8107b70 msgr2=0x7fb5e819cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:20.334 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.330+0000 7fb5ecc6c640 1 --2- 172.21.15.148:0/1837139575 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb5e8107b70 0x7fb5e819cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:20.334 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.330+0000 7fb5ecc6c640 1 -- 172.21.15.148:0/1837139575 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5e819d390 con 0x7fb5e8101ad0 2024-09-19T07:12:20.334 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.331+0000 7fb5ecc6c640 1 --2- 172.21.15.148:0/1837139575 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5e8101ad0 0x7fb5e81983a0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fb5e400c890 tx=0x7fb5e400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:20.334 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.331+0000 7fb5ddffb640 1 -- 172.21.15.148:0/1837139575 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e4004220 con 0x7fb5e8101ad0 2024-09-19T07:12:20.334 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.331+0000 7fb5ddffb640 1 -- 172.21.15.148:0/1837139575 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5e40043c0 con 0x7fb5e8101ad0 2024-09-19T07:12:20.334 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.332+0000 7fb5ddffb640 1 -- 172.21.15.148:0/1837139575 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e40049e0 con 0x7fb5e8101ad0 2024-09-19T07:12:20.334 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.332+0000 7fb5eeed0640 1 -- 172.21.15.148:0/1837139575 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5e819d680 con 0x7fb5e8101ad0 2024-09-19T07:12:20.335 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.332+0000 7fb5eeed0640 1 -- 172.21.15.148:0/1837139575 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5e81a4f10 con 0x7fb5e8101ad0 2024-09-19T07:12:20.335 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.335+0000 7fb5ddffb640 1 -- 172.21.15.148:0/1837139575 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 24) ==== 138589+0+0 (secure 0 0 0) 0x7fb5e40079b0 con 0x7fb5e8101ad0 2024-09-19T07:12:20.337 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.336+0000 7fb5f1c69740 1 Processor -- start 2024-09-19T07:12:20.337 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.336+0000 7fb5f1c69740 1 -- start start 2024-09-19T07:12:20.337 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.336+0000 7fb5ddffb640 1 --2- 172.21.15.148:0/1837139575 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fb5d00a34f0 0x7fb5d00a59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:20.337 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.336+0000 7fb5f1c69740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c26149af0 0x557c26149ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:20.337 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.336+0000 7fb5f1c69740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c2614a410 0x557c26154770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:20.337 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.336+0000 7fb5f1c69740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c26154cb0 0x557c261570a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:20.338 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.336+0000 7fb5f1c69740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x557c260ae2f0 con 0x557c26149af0 2024-09-19T07:12:20.338 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.336+0000 7fb5f1c69740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x557c26056270 con 0x557c26154cb0 2024-09-19T07:12:20.338 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.336+0000 7fb5f1c69740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x557c260aa2b0 con 0x557c2614a410 2024-09-19T07:12:20.338 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.336+0000 7fb5ed46d640 1 --2- 172.21.15.148:0/1837139575 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fb5d00a34f0 0x7fb5d00a59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:20.338 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.336+0000 7fb5ddffb640 1 -- 172.21.15.148:0/1837139575 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fb5e40cfe90 con 0x7fb5e8101ad0 2024-09-19T07:12:20.338 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.336+0000 7fb5dffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c2614a410 0x557c26154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:20.338 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.336+0000 7fb5dffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c2614a410 0x557c26154770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:35520/0 (socket says 172.21.15.148:35520) 2024-09-19T07:12:20.338 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.336+0000 7fb5dffff640 1 -- 172.21.15.148:0/2489235296 learned_addr learned my addr 172.21.15.148:0/2489235296 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:20.338 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.336+0000 7fb5ecc6c640 1 --2- 172.21.15.148:0/2489235296 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c26149af0 0x557c26149ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:20.338 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.337+0000 7fb5dffff640 1 -- 172.21.15.148:0/2489235296 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c26154cb0 msgr2=0x557c261570a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T07:12:20.338 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.337+0000 7fb5dffff640 1 --2- 172.21.15.148:0/2489235296 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c26154cb0 0x557c261570a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:20.338 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.337+0000 7fb5dffff640 1 -- 172.21.15.148:0/2489235296 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c26149af0 msgr2=0x557c26149ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:20.338 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.337+0000 7fb5dffff640 1 --2- 172.21.15.148:0/2489235296 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c26149af0 0x557c26149ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:20.339 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.337+0000 7fb5dffff640 1 -- 172.21.15.148:0/2489235296 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c26055340 con 0x557c2614a410 2024-09-19T07:12:20.341 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.337+0000 7fb5ecc6c640 1 --2- 172.21.15.148:0/2489235296 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c26149af0 0x557c26149ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:12:20.341 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.337+0000 7fb5ed46d640 1 --2- 172.21.15.148:0/1837139575 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fb5d00a34f0 0x7fb5d00a59b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0005fd0 tx=0x7fb5e0009520 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:20.341 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.337+0000 7fb5dffff640 1 --2- 172.21.15.148:0/2489235296 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c2614a410 0x557c26154770 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb5d8009930 tx=0x7fb5d8004180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e863373af1f4e890 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:20.341 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.337+0000 7fb5ceffd640 1 -- 172.21.15.148:0/2489235296 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d8035040 con 0x557c2614a410 2024-09-19T07:12:20.341 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.337+0000 7fb5ceffd640 1 -- 172.21.15.148:0/2489235296 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5d8005520 con 0x557c2614a410 2024-09-19T07:12:20.341 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.337+0000 7fb5ceffd640 1 -- 172.21.15.148:0/2489235296 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d8003850 con 0x557c2614a410 2024-09-19T07:12:20.341 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.338+0000 7fb5f1c69740 1 -- 172.21.15.148:0/2489235296 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c2614a410 msgr2=0x557c26154770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:20.341 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.338+0000 7fb5f1c69740 1 --2- 172.21.15.148:0/2489235296 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c2614a410 0x557c26154770 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb5d8009930 tx=0x7fb5d8004180 comp rx=0 tx=0).stop 2024-09-19T07:12:20.342 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.338+0000 7fb5f1c69740 1 -- 172.21.15.148:0/2489235296 shutdown_connections 2024-09-19T07:12:20.342 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.338+0000 7fb5f1c69740 1 --2- 172.21.15.148:0/2489235296 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c26154cb0 0x557c261570a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:20.342 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.338+0000 7fb5f1c69740 1 --2- 172.21.15.148:0/2489235296 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c2614a410 0x557c26154770 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:20.342 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.338+0000 7fb5f1c69740 1 --2- 172.21.15.148:0/2489235296 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c26149af0 0x557c26149ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:20.342 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.338+0000 7fb5f1c69740 1 -- 172.21.15.148:0/2489235296 >> 172.21.15.148:0/2489235296 conn(0x557c26146060 msgr2=0x557c26146440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:20.342 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.338+0000 7fb5f1c69740 1 -- 172.21.15.148:0/2489235296 shutdown_connections 2024-09-19T07:12:20.342 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.338+0000 7fb5f1c69740 1 -- 172.21.15.148:0/2489235296 wait complete. 2024-09-19T07:12:20.342 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.339+0000 7fb5f1c69740 1 -- start start 2024-09-19T07:12:20.342 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.339+0000 7fb5f1c69740 1 Processor -- start 2024-09-19T07:12:20.342 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.340+0000 7fb5f1c69740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c26149af0 0x557c26151c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:20.342 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.340+0000 7fb5f1c69740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c2614a410 0x557c26152140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:20.343 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.340+0000 7fb5f1c69740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c26154cb0 0x557c26152680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:20.343 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.340+0000 7fb5f1c69740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x557c2615bc90 con 0x557c2614a410 2024-09-19T07:12:20.343 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.340+0000 7fb5f1c69740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x557c26037290 con 0x557c26154cb0 2024-09-19T07:12:20.343 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.340+0000 7fb5f1c69740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x557c2615be10 con 0x557c26149af0 2024-09-19T07:12:20.343 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.340+0000 7fb5dffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c2614a410 0x557c26152140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:20.343 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.340+0000 7fb5dffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c2614a410 0x557c26152140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54822/0 (socket says 172.21.15.148:54822) 2024-09-19T07:12:20.343 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.340+0000 7fb5dffff640 1 -- 172.21.15.148:0/1396684699 learned_addr learned my addr 172.21.15.148:0/1396684699 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:20.343 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.340+0000 7fb5f1c69740 10 client.0 _ll_register_callbacks cb 0x557c26068140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:12:20.343 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.340+0000 7fb5ed46d640 1 --2- 172.21.15.148:0/1396684699 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c26154cb0 0x557c26152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:20.343 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.340+0000 7fb5ecc6c640 1 --2- 172.21.15.148:0/1396684699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c26149af0 0x557c26151c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:20.343 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.340+0000 7fb5dffff640 1 -- 172.21.15.148:0/1396684699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c26149af0 msgr2=0x557c26151c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:20.344 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.340+0000 7fb5dffff640 1 --2- 172.21.15.148:0/1396684699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c26149af0 0x557c26151c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:20.344 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.340+0000 7fb5dffff640 1 -- 172.21.15.148:0/1396684699 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c26154cb0 msgr2=0x557c26152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:20.344 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.340+0000 7fb5dffff640 1 --2- 172.21.15.148:0/1396684699 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c26154cb0 0x557c26152680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:20.344 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.340+0000 7fb5dffff640 1 -- 172.21.15.148:0/1396684699 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c25dc1210 con 0x557c2614a410 2024-09-19T07:12:20.344 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.340+0000 7fb5ed46d640 1 --2- 172.21.15.148:0/1396684699 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c26154cb0 0x557c26152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:12:20.344 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.340+0000 7fb5f1c69740 1 -- 172.21.15.148:0/1396684699 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5d8005520 con 0x557c2614a410 2024-09-19T07:12:20.344 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.340+0000 7fb5dffff640 1 --2- 172.21.15.148:0/1396684699 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c2614a410 0x557c26152140 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fb5d8031550 tx=0x7fb5d802a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96f53d50a1465128 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:20.344 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.340+0000 7fb5c7fff640 10 client.15660 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:12:20.346 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.341+0000 7fb5c7fff640 1 -- 172.21.15.148:0/1396684699 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d8052060 con 0x557c2614a410 2024-09-19T07:12:20.346 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.341+0000 7fb5c7fff640 1 -- 172.21.15.148:0/1396684699 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fb5d8004ed0 con 0x557c2614a410 2024-09-19T07:12:20.346 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.341+0000 7fb5c7fff640 1 -- 172.21.15.148:0/1396684699 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb5d8035050 con 0x557c2614a410 2024-09-19T07:12:20.347 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.341+0000 7fb5f1c69740 10 client.15660 fetch_fsmap learned FSMap version 25 2024-09-19T07:12:20.347 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.341+0000 7fb5f1c69740 1 -- 172.21.15.148:0/1396684699 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({fsmap=25}) -- 0x557c25e8d620 con 0x557c2614a410 2024-09-19T07:12:20.347 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.341+0000 7fb5c7fff640 1 -- 172.21.15.148:0/1396684699 <== mon.0 v2:172.21.15.148:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb5d80050f0 con 0x557c2614a410 2024-09-19T07:12:20.347 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.341+0000 7fb5f1c69740 10 client.15660 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:12:20.347 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.341+0000 7fb5f1c69740 10 client.15660 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:12:20.347 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.341+0000 7fb5f1c69740 20 client.15660 populate_metadata read hostname 'smithi148' 2024-09-19T07:12:20.347 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.341+0000 7fb5f1c69740 1 --2- 172.21.15.148:0/1396684699 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x557c261690b0 0x557c2616b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:20.347 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.341+0000 7fb5f1c69740 4 client.15660 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:12:20.347 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.341+0000 7fb5f1c69740 1 -- 172.21.15.148:0/1396684699 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c260bba20 con 0x557c261690b0 2024-09-19T07:12:20.347 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.342+0000 7fb5ecc6c640 1 --2- 172.21.15.148:0/1396684699 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x557c261690b0 0x557c2616b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:20.347 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.342+0000 7fb5ecc6c640 1 --2- 172.21.15.148:0/1396684699 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x557c261690b0 0x557c2616b4d0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d410725d374a518b server_cookie=486483395c356a54 in_seq=0 out_seq=0 2024-09-19T07:12:20.347 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.342+0000 7fb5c7fff640 10 client.15660 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:20.347 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.343+0000 7fb5c7fff640 1 -- 172.21.15.148:0/1396684699 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557c260bba20 con 0x557c261690b0 2024-09-19T07:12:20.347 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.343+0000 7fb5c7fff640 10 client.15660 handle_command_reply: tid=0 2024-09-19T07:12:20.348 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.343+0000 7fb5f1c69740 1 client.15660 shutdown 2024-09-19T07:12:20.348 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.343+0000 7fb5f1c69740 1 -- 172.21.15.148:0/1396684699 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c2614a410 msgr2=0x557c26152140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:20.348 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.343+0000 7fb5f1c69740 1 --2- 172.21.15.148:0/1396684699 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c2614a410 0x557c26152140 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fb5d8031550 tx=0x7fb5d802a420 comp rx=0 tx=0).stop 2024-09-19T07:12:20.348 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.343+0000 7fb5f1c69740 1 -- 172.21.15.148:0/1396684699 shutdown_connections 2024-09-19T07:12:20.348 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.343+0000 7fb5f1c69740 1 --2- 172.21.15.148:0/1396684699 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x557c261690b0 0x557c2616b4d0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:20.348 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.343+0000 7fb5f1c69740 1 --2- 172.21.15.148:0/1396684699 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c26154cb0 0x557c26152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:20.348 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.343+0000 7fb5f1c69740 1 --2- 172.21.15.148:0/1396684699 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c2614a410 0x557c26152140 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:20.348 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.343+0000 7fb5f1c69740 1 --2- 172.21.15.148:0/1396684699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c26149af0 0x557c26151c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:20.348 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.343+0000 7fb5f1c69740 1 -- 172.21.15.148:0/1396684699 >> 172.21.15.148:0/1396684699 conn(0x557c26146060 msgr2=0x557c2614bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:20.348 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.343+0000 7fb5c7fff640 0 client.15660 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:20.348 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.343+0000 7fb5f1c69740 1 -- 172.21.15.148:0/1396684699 shutdown_connections 2024-09-19T07:12:20.348 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.343+0000 7fb5f1c69740 1 -- 172.21.15.148:0/1396684699 wait complete. 2024-09-19T07:12:20.348 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.343+0000 7fb5f1c69740 20 client.15660 trim_cache size 0 max 16384 2024-09-19T07:12:20.362 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.360+0000 7fb5f1c69740 1 Processor -- start 2024-09-19T07:12:20.363 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.360+0000 7fb5f1c69740 1 -- start start 2024-09-19T07:12:20.363 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.360+0000 7fb5f1c69740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c26149af0 0x557c261524b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:20.363 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.360+0000 7fb5f1c69740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c2614a410 0x557c26153b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:20.363 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.360+0000 7fb5f1c69740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c26154cb0 0x557c26170da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:20.363 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.360+0000 7fb5f1c69740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e81adc80 con 0x557c26154cb0 2024-09-19T07:12:20.363 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.361+0000 7fb5f1c69740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e81ab550 con 0x557c26149af0 2024-09-19T07:12:20.363 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.361+0000 7fb5f1c69740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e81a93a0 con 0x557c2614a410 2024-09-19T07:12:20.363 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.361+0000 7fb5ecc6c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c26149af0 0x557c261524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:20.363 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.361+0000 7fb5ed46d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c26154cb0 0x557c26170da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:20.363 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.361+0000 7fb5ed46d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c26154cb0 0x557c26170da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54826/0 (socket says 172.21.15.148:54826) 2024-09-19T07:12:20.363 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.361+0000 7fb5ecc6c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c26149af0 0x557c261524b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:33874/0 (socket says 172.21.15.148:33874) 2024-09-19T07:12:20.363 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.361+0000 7fb5ed46d640 1 -- 172.21.15.148:0/2608637279 learned_addr learned my addr 172.21.15.148:0/2608637279 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.361+0000 7fb5dffff640 1 --2- 172.21.15.148:0/2608637279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c2614a410 0x557c26153b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.361+0000 7fb5dffff640 1 -- 172.21.15.148:0/2608637279 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c26149af0 msgr2=0x557c261524b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.361+0000 7fb5dffff640 1 --2- 172.21.15.148:0/2608637279 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c26149af0 0x557c261524b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.361+0000 7fb5dffff640 1 -- 172.21.15.148:0/2608637279 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c26154cb0 msgr2=0x557c26170da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.361+0000 7fb5dffff640 1 --2- 172.21.15.148:0/2608637279 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c26154cb0 0x557c26170da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.361+0000 7fb5dffff640 1 -- 172.21.15.148:0/2608637279 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c26149870 con 0x557c2614a410 2024-09-19T07:12:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.361+0000 7fb5ed46d640 1 --2- 172.21.15.148:0/2608637279 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c26154cb0 0x557c26170da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:12:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.361+0000 7fb5dffff640 1 --2- 172.21.15.148:0/2608637279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c2614a410 0x557c26153b70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x557c261531b0 tx=0x7fb5d804a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46d72c8c96001560 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.361+0000 7fb5ce7fc640 1 -- 172.21.15.148:0/2608637279 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d8004fa0 con 0x557c2614a410 2024-09-19T07:12:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.361+0000 7fb5ce7fc640 1 -- 172.21.15.148:0/2608637279 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5d8005520 con 0x557c2614a410 2024-09-19T07:12:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.361+0000 7fb5ce7fc640 1 -- 172.21.15.148:0/2608637279 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d80035f0 con 0x557c2614a410 2024-09-19T07:12:20.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.362+0000 7fb5f1c69740 1 -- 172.21.15.148:0/2608637279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c2614a410 msgr2=0x557c26153b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:20.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.362+0000 7fb5f1c69740 1 --2- 172.21.15.148:0/2608637279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c2614a410 0x557c26153b70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x557c261531b0 tx=0x7fb5d804a000 comp rx=0 tx=0).stop 2024-09-19T07:12:20.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.362+0000 7fb5f1c69740 1 -- 172.21.15.148:0/2608637279 shutdown_connections 2024-09-19T07:12:20.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.362+0000 7fb5f1c69740 1 --2- 172.21.15.148:0/2608637279 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c26154cb0 0x557c26170da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:20.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.362+0000 7fb5f1c69740 1 --2- 172.21.15.148:0/2608637279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c2614a410 0x557c26153b70 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:20.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.362+0000 7fb5f1c69740 1 --2- 172.21.15.148:0/2608637279 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c26149af0 0x557c261524b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:20.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.362+0000 7fb5f1c69740 1 -- 172.21.15.148:0/2608637279 >> 172.21.15.148:0/2608637279 conn(0x557c26146060 msgr2=0x557c26153460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:20.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.362+0000 7fb5f1c69740 1 -- 172.21.15.148:0/2608637279 shutdown_connections 2024-09-19T07:12:20.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.362+0000 7fb5f1c69740 1 -- 172.21.15.148:0/2608637279 wait complete. 2024-09-19T07:12:20.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.362+0000 7fb5f1c69740 1 -- start start 2024-09-19T07:12:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.363+0000 7fb5f1c69740 1 Processor -- start 2024-09-19T07:12:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.363+0000 7fb5f1c69740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c26149af0 0x557c261619e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.363+0000 7fb5f1c69740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c2614a410 0x557c2615c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.363+0000 7fb5f1c69740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c26154cb0 0x557c2615c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.363+0000 7fb5f1c69740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e81a9a10 con 0x557c26149af0 2024-09-19T07:12:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.363+0000 7fb5f1c69740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e81aae80 con 0x557c2614a410 2024-09-19T07:12:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.363+0000 7fb5f1c69740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e81aa0e0 con 0x557c26154cb0 2024-09-19T07:12:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.363+0000 7fb5f1c69740 10 client.0 _ll_register_callbacks cb 0x7fb5e4005300 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:12:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.363+0000 7fb5ecc6c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c26149af0 0x557c261619e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.363+0000 7fb5ecc6c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c26149af0 0x557c261619e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54838/0 (socket says 172.21.15.148:54838) 2024-09-19T07:12:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.363+0000 7fb5ecc6c640 1 -- 172.21.15.148:0/333156003 learned_addr learned my addr 172.21.15.148:0/333156003 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.363+0000 7fb5dffff640 1 --2- 172.21.15.148:0/333156003 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c2614a410 0x557c2615c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:20.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.363+0000 7fb5ed46d640 1 --2- 172.21.15.148:0/333156003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c26154cb0 0x557c2615c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:20.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.364+0000 7fb5ecc6c640 1 -- 172.21.15.148:0/333156003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c26154cb0 msgr2=0x557c2615c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:20.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.364+0000 7fb5ecc6c640 1 --2- 172.21.15.148:0/333156003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c26154cb0 0x557c2615c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:20.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.364+0000 7fb5ecc6c640 1 -- 172.21.15.148:0/333156003 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c2614a410 msgr2=0x557c2615c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:20.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.364+0000 7fb5ecc6c640 1 --2- 172.21.15.148:0/333156003 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c2614a410 0x557c2615c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:20.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.364+0000 7fb5ecc6c640 1 -- 172.21.15.148:0/333156003 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c261d1d60 con 0x557c26149af0 2024-09-19T07:12:20.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.364+0000 7fb5ed46d640 1 --2- 172.21.15.148:0/333156003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c26154cb0 0x557c2615c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:12:20.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.364+0000 7fb5ecc6c640 1 --2- 172.21.15.148:0/333156003 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c26149af0 0x557c261619e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4098350 tx=0x7fb5e4004700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adf921e4465e378c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:20.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.364+0000 7fb5c7fff640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:12:20.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.364+0000 7fb5c7fff640 1 -- 172.21.15.148:0/333156003 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e409bef0 con 0x557c26149af0 2024-09-19T07:12:20.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.364+0000 7fb5c7fff640 1 -- 172.21.15.148:0/333156003 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fb5e4007ca0 con 0x557c26149af0 2024-09-19T07:12:20.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.364+0000 7fb5f1c69740 1 -- 172.21.15.148:0/333156003 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5d8005520 con 0x557c26149af0 2024-09-19T07:12:20.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.364+0000 7fb5c7fff640 1 -- 172.21.15.148:0/333156003 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb5e40a02a0 con 0x557c26149af0 2024-09-19T07:12:20.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.364+0000 7fb5f1c69740 10 client.15666 fetch_fsmap learned FSMap version 25 2024-09-19T07:12:20.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.364+0000 7fb5f1c69740 1 -- 172.21.15.148:0/333156003 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557c261d2f70 con 0x557c26149af0 2024-09-19T07:12:20.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.364+0000 7fb5c7fff640 1 -- 172.21.15.148:0/333156003 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5d8005520 con 0x557c26149af0 2024-09-19T07:12:20.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.365+0000 7fb5c7fff640 1 -- 172.21.15.148:0/333156003 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb5e4011b20 con 0x557c26149af0 2024-09-19T07:12:20.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.365+0000 7fb5f1c69740 10 client.15666 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:12:20.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.365+0000 7fb5f1c69740 10 client.15666 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:12:20.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.365+0000 7fb5f1c69740 20 client.15666 populate_metadata read hostname 'smithi148' 2024-09-19T07:12:20.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.365+0000 7fb5f1c69740 1 --2- 172.21.15.148:0/333156003 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x557c261d3730 0x557c261d5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:20.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.365+0000 7fb5f1c69740 4 client.15666 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:12:20.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.365+0000 7fb5f1c69740 1 -- 172.21.15.148:0/333156003 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557c260b5d70 con 0x557c261d3730 2024-09-19T07:12:20.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.365+0000 7fb5dffff640 1 --2- 172.21.15.148:0/333156003 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x557c261d3730 0x557c261d5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:20.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.365+0000 7fb5dffff640 1 --2- 172.21.15.148:0/333156003 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x557c261d3730 0x557c261d5b20 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44e6053c1f2c849d server_cookie=4b3f24e29021e4c1 in_seq=0 out_seq=0 2024-09-19T07:12:20.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.365+0000 7fb5c7fff640 10 client.15666 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:20.372 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.369+0000 7fb5c7fff640 1 -- 172.21.15.148:0/333156003 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557c260b5d70 con 0x557c261d3730 2024-09-19T07:12:20.373 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.369+0000 7fb5c7fff640 10 client.15666 handle_command_reply: tid=0 2024-09-19T07:12:20.373 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.369+0000 7fb5f1c69740 1 client.15666 shutdown 2024-09-19T07:12:20.373 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.369+0000 7fb5f1c69740 1 -- 172.21.15.148:0/333156003 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c26149af0 msgr2=0x557c261619e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:20.373 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.369+0000 7fb5f1c69740 1 --2- 172.21.15.148:0/333156003 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c26149af0 0x557c261619e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4098350 tx=0x7fb5e4004700 comp rx=0 tx=0).stop 2024-09-19T07:12:20.373 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.370+0000 7fb5f1c69740 1 -- 172.21.15.148:0/333156003 shutdown_connections 2024-09-19T07:12:20.373 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.370+0000 7fb5f1c69740 1 --2- 172.21.15.148:0/333156003 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x557c261d3730 0x557c261d5b20 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:20.373 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.370+0000 7fb5f1c69740 1 --2- 172.21.15.148:0/333156003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557c26154cb0 0x557c2615c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:20.373 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.370+0000 7fb5c7fff640 0 client.15666 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:20.373 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.370+0000 7fb5f1c69740 1 --2- 172.21.15.148:0/333156003 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c2614a410 0x557c2615c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:20.373 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.370+0000 7fb5f1c69740 1 --2- 172.21.15.148:0/333156003 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557c26149af0 0x557c261619e0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:20.373 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.370+0000 7fb5f1c69740 1 -- 172.21.15.148:0/333156003 >> 172.21.15.148:0/333156003 conn(0x557c26146060 msgr2=0x557c26153460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:20.373 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.370+0000 7fb5f1c69740 1 -- 172.21.15.148:0/333156003 shutdown_connections 2024-09-19T07:12:20.373 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.370+0000 7fb5f1c69740 1 -- 172.21.15.148:0/333156003 wait complete. 2024-09-19T07:12:20.374 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.370+0000 7fb5f1c69740 20 client.15666 trim_cache size 0 max 16384 2024-09-19T07:12:20.374 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:12:20.374 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:12:20.374 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:12:20.374 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:12:20.375 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.370+0000 7fb5eeed0640 1 -- 172.21.15.148:0/1837139575 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fb5d00a34f0 msgr2=0x7fb5d00a59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:20.375 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.370+0000 7fb5eeed0640 1 --2- 172.21.15.148:0/1837139575 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fb5d00a34f0 0x7fb5d00a59b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0005fd0 tx=0x7fb5e0009520 comp rx=0 tx=0).stop 2024-09-19T07:12:20.375 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.370+0000 7fb5eeed0640 1 -- 172.21.15.148:0/1837139575 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5e8101ad0 msgr2=0x7fb5e81983a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:20.375 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.370+0000 7fb5eeed0640 1 --2- 172.21.15.148:0/1837139575 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5e8101ad0 0x7fb5e81983a0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fb5e400c890 tx=0x7fb5e400cd50 comp rx=0 tx=0).stop 2024-09-19T07:12:20.375 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.370+0000 7fb5eeed0640 1 -- 172.21.15.148:0/1837139575 shutdown_connections 2024-09-19T07:12:20.375 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.370+0000 7fb5eeed0640 1 --2- 172.21.15.148:0/1837139575 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fb5d00a34f0 0x7fb5d00a59b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:20.375 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.370+0000 7fb5eeed0640 1 --2- 172.21.15.148:0/1837139575 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb5e8107b70 0x7fb5e819cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:20.375 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.370+0000 7fb5eeed0640 1 --2- 172.21.15.148:0/1837139575 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5e8102470 0x7fb5e81988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:20.376 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.370+0000 7fb5eeed0640 1 --2- 172.21.15.148:0/1837139575 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5e8101ad0 0x7fb5e81983a0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:20.376 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.371+0000 7fb5eeed0640 1 -- 172.21.15.148:0/1837139575 >> 172.21.15.148:0/1837139575 conn(0x7fb5e80fd7d0 msgr2=0x7fb5e80fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:20.376 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.371+0000 7fb5eeed0640 1 -- 172.21.15.148:0/1837139575 shutdown_connections 2024-09-19T07:12:20.376 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:20.371+0000 7fb5eeed0640 1 -- 172.21.15.148:0/1837139575 wait complete. 2024-09-19T07:12:20.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:20 smithi165 ceph-mon[35326]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-19T07:12:20.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:20 smithi179 ceph-mon[35716]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-19T07:12:20.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:20 smithi148 ceph-mon[31180]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-19T07:12:22.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:22 smithi165 ceph-mon[35326]: pgmap v42: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:12:22.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:22 smithi179 ceph-mon[35716]: pgmap v42: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:12:22.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:22 smithi148 ceph-mon[31180]: pgmap v42: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:12:24.401 INFO:tasks.quiescer.fs.[cephfs]:Total duration (40.7) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T07:12:24.402 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.35 2024-09-19T07:12:24.402 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:12:24.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:24 smithi165 ceph-mon[35326]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:12:24.667 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:12:24.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:24 smithi179 ceph-mon[35716]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:12:24.788 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:24 smithi148 ceph-mon[31180]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:12:24.865 INFO:tasks.workunit.client.0.smithi148.stderr:Updating files: 95% (12261/12896) Updating files: 96% (12381/12896) Updating files: 97% (12510/12896) Updating files: 98% (12639/12896) Updating files: 99% (12768/12896) Updating files: 100% (12896/12896) Updating files: 100% (12896/12896), done. 2024-09-19T07:12:25.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.246+0000 7fe926869640 1 -- 172.21.15.148:0/3951134739 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe920100e20 msgr2=0x7fe920101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:25.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.246+0000 7fe926869640 1 --2- 172.21.15.148:0/3951134739 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe920100e20 0x7fe920101200 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fe910009900 tx=0x7fe91002a480 comp rx=0 tx=0).stop 2024-09-19T07:12:25.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.246+0000 7fe926869640 1 -- 172.21.15.148:0/3951134739 shutdown_connections 2024-09-19T07:12:25.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.246+0000 7fe926869640 1 --2- 172.21.15.148:0/3951134739 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe920102ef0 0x7fe92010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:25.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.246+0000 7fe926869640 1 --2- 172.21.15.148:0/3951134739 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe920102570 0x7fe9201029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:25.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.246+0000 7fe926869640 1 --2- 172.21.15.148:0/3951134739 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe920100e20 0x7fe920101200 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:25.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.246+0000 7fe926869640 1 -- 172.21.15.148:0/3951134739 >> 172.21.15.148:0/3951134739 conn(0x7fe9200fc7d0 msgr2=0x7fe9200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:25.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.246+0000 7fe926869640 1 -- 172.21.15.148:0/3951134739 shutdown_connections 2024-09-19T07:12:25.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.246+0000 7fe926869640 1 -- 172.21.15.148:0/3951134739 wait complete. 2024-09-19T07:12:25.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.247+0000 7fe926869640 1 Processor -- start 2024-09-19T07:12:25.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.247+0000 7fe926869640 1 -- start start 2024-09-19T07:12:25.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.247+0000 7fe926869640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe920100e20 0x7fe9201984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:25.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.247+0000 7fe926869640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe920102570 0x7fe920198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:25.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.247+0000 7fe926869640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe920102ef0 0x7fe92019cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:25.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.247+0000 7fe926869640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe920110f80 con 0x7fe920100e20 2024-09-19T07:12:25.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.247+0000 7fe926869640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe920110e00 con 0x7fe920102ef0 2024-09-19T07:12:25.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.247+0000 7fe926869640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe920111100 con 0x7fe920102570 2024-09-19T07:12:25.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.247+0000 7fe91ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe920100e20 0x7fe9201984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:25.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.247+0000 7fe91ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe920100e20 0x7fe9201984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60814/0 (socket says 172.21.15.148:60814) 2024-09-19T07:12:25.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.247+0000 7fe91ffff640 1 -- 172.21.15.148:0/2644126932 learned_addr learned my addr 172.21.15.148:0/2644126932 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:25.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.247+0000 7fe917fff640 1 --2- 172.21.15.148:0/2644126932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe920102570 0x7fe920198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:25.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.248+0000 7fe924e06640 1 --2- 172.21.15.148:0/2644126932 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe920102ef0 0x7fe92019cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:25.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.248+0000 7fe91ffff640 1 -- 172.21.15.148:0/2644126932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe920102570 msgr2=0x7fe920198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:25.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.248+0000 7fe91ffff640 1 --2- 172.21.15.148:0/2644126932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe920102570 0x7fe920198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:25.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.248+0000 7fe91ffff640 1 -- 172.21.15.148:0/2644126932 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe920102ef0 msgr2=0x7fe92019cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:25.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.248+0000 7fe91ffff640 1 --2- 172.21.15.148:0/2644126932 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe920102ef0 0x7fe92019cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:25.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.248+0000 7fe91ffff640 1 -- 172.21.15.148:0/2644126932 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe92019d470 con 0x7fe920100e20 2024-09-19T07:12:25.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.248+0000 7fe91ffff640 1 --2- 172.21.15.148:0/2644126932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe920100e20 0x7fe9201984c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fe910006010 tx=0x7fe910003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:25.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.248+0000 7fe91dffb640 1 -- 172.21.15.148:0/2644126932 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91003f070 con 0x7fe920100e20 2024-09-19T07:12:25.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.248+0000 7fe926869640 1 -- 172.21.15.148:0/2644126932 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe92019d700 con 0x7fe920100e20 2024-09-19T07:12:25.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.248+0000 7fe91dffb640 1 -- 172.21.15.148:0/2644126932 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe910031c30 con 0x7fe920100e20 2024-09-19T07:12:25.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.248+0000 7fe91dffb640 1 -- 172.21.15.148:0/2644126932 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe910035030 con 0x7fe920100e20 2024-09-19T07:12:25.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.248+0000 7fe926869640 1 -- 172.21.15.148:0/2644126932 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9201a5040 con 0x7fe920100e20 2024-09-19T07:12:25.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.249+0000 7fe926869640 1 -- 172.21.15.148:0/2644126932 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe920101200 con 0x7fe920100e20 2024-09-19T07:12:25.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.250+0000 7fe91dffb640 1 -- 172.21.15.148:0/2644126932 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 24) ==== 138589+0+0 (secure 0 0 0) 0x7fe910042070 con 0x7fe920100e20 2024-09-19T07:12:25.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.251+0000 7fe91dffb640 1 --2- 172.21.15.148:0/2644126932 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe90c0a34d0 0x7fe90c0a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:25.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.251+0000 7fe91dffb640 1 -- 172.21.15.148:0/2644126932 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fe9100f0640 con 0x7fe920100e20 2024-09-19T07:12:25.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.251+0000 7fe917fff640 1 --2- 172.21.15.148:0/2644126932 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe90c0a34d0 0x7fe90c0a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:25.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.252+0000 7fe917fff640 1 --2- 172.21.15.148:0/2644126932 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe90c0a34d0 0x7fe90c0a5990 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe920105200 tx=0x7fe90800a2d0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:25.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.255+0000 7fe91dffb640 1 -- 172.21.15.148:0/2644126932 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe9100bce70 con 0x7fe920100e20 2024-09-19T07:12:25.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.465+0000 7fe926869640 1 -- 172.21.15.148:0/2644126932 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe92010a0a0 con 0x7fe920100e20 2024-09-19T07:12:25.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.466+0000 7fe91dffb640 1 -- 172.21.15.148:0/2644126932 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11939 (secure 0 0 0) 0x7fe910031de0 con 0x7fe920100e20 2024-09-19T07:12:25.467 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:12:25.467 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":25,"btime":"2024-09-19T07:11:04:227331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/4263868576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":4263868576},{"type":"v1","addr":"172.21.15.148:6841","nonce":4263868576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24383,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2146820965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2146820965},{"type":"v1","addr":"172.21.15.165:6835","nonce":2146820965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:09:19.543369+0000","modified":"2024-09-19T07:11:03.969598+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24457,"mds_1":24437,"mds_2":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/1566489108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1566489108},{"type":"v1","addr":"172.21.15.179:6835","nonce":1566489108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.165:6839/3993490234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":3993490234},{"type":"v1","addr":"172.21.15.165:6839","nonce":3993490234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24457,"qdb_cluster":[24457,24437,24436]},"id":1}]} 2024-09-19T07:12:25.467 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 25 2024-09-19T07:12:25.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.469+0000 7fe926869640 1 -- 172.21.15.148:0/2644126932 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe90c0a34d0 msgr2=0x7fe90c0a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:25.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.469+0000 7fe926869640 1 --2- 172.21.15.148:0/2644126932 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe90c0a34d0 0x7fe90c0a5990 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe920105200 tx=0x7fe90800a2d0 comp rx=0 tx=0).stop 2024-09-19T07:12:25.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.469+0000 7fe926869640 1 -- 172.21.15.148:0/2644126932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe920100e20 msgr2=0x7fe9201984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:25.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.469+0000 7fe926869640 1 --2- 172.21.15.148:0/2644126932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe920100e20 0x7fe9201984c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fe910006010 tx=0x7fe910003c10 comp rx=0 tx=0).stop 2024-09-19T07:12:25.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.469+0000 7fe926869640 1 -- 172.21.15.148:0/2644126932 shutdown_connections 2024-09-19T07:12:25.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.469+0000 7fe926869640 1 --2- 172.21.15.148:0/2644126932 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe90c0a34d0 0x7fe90c0a5990 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:25.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.469+0000 7fe926869640 1 --2- 172.21.15.148:0/2644126932 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe920102ef0 0x7fe92019cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:25.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.469+0000 7fe926869640 1 --2- 172.21.15.148:0/2644126932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe920102570 0x7fe920198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:25.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.469+0000 7fe926869640 1 --2- 172.21.15.148:0/2644126932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe920100e20 0x7fe9201984c0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:25.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.469+0000 7fe926869640 1 -- 172.21.15.148:0/2644126932 >> 172.21.15.148:0/2644126932 conn(0x7fe9200fc7d0 msgr2=0x7fe92006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:25.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.469+0000 7fe926869640 1 -- 172.21.15.148:0/2644126932 shutdown_connections 2024-09-19T07:12:25.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:25.469+0000 7fe926869640 1 -- 172.21.15.148:0/2644126932 wait complete. 2024-09-19T07:12:25.795 INFO:tasks.workunit.client.0.smithi148.stderr:Note: switching to '6fad5dd73c93545e52f57f681e140a9c3529c11e'. 2024-09-19T07:12:25.795 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-19T07:12:25.795 INFO:tasks.workunit.client.0.smithi148.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T07:12:25.795 INFO:tasks.workunit.client.0.smithi148.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T07:12:25.795 INFO:tasks.workunit.client.0.smithi148.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T07:12:25.795 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-19T07:12:25.795 INFO:tasks.workunit.client.0.smithi148.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T07:12:25.796 INFO:tasks.workunit.client.0.smithi148.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T07:12:25.796 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-19T07:12:25.796 INFO:tasks.workunit.client.0.smithi148.stderr: git switch -c 2024-09-19T07:12:25.796 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-19T07:12:25.796 INFO:tasks.workunit.client.0.smithi148.stderr:Or undo this operation with: 2024-09-19T07:12:25.796 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-19T07:12:25.796 INFO:tasks.workunit.client.0.smithi148.stderr: git switch - 2024-09-19T07:12:25.796 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-19T07:12:25.796 INFO:tasks.workunit.client.0.smithi148.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T07:12:25.796 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-19T07:12:25.796 INFO:tasks.workunit.client.0.smithi148.stderr:HEAD is now at 6fad5dd73c9 Merge pull request #59812 from neha-ojha/wip-rtd-squid 2024-09-19T07:12:25.800 DEBUG:teuthology.orchestra.run.smithi148:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-19T07:12:25.900 INFO:tasks.workunit.client.0.smithi148.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-19T07:12:25.902 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T07:12:25.902 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-19T07:12:26.452 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24457 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0' 2024-09-19T07:12:26.453 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24457 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0 2024-09-19T07:12:26.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:26 smithi165 ceph-mon[35326]: pgmap v44: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T07:12:26.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:26 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/2644126932' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:12:26.707 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:12:26.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:26 smithi179 ceph-mon[35716]: pgmap v44: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T07:12:26.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:26 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/2644126932' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:12:26.827 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:26 smithi148 ceph-mon[31180]: pgmap v44: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T07:12:26.827 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:26 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/2644126932' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:12:27.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.239+0000 7f1eed44a640 1 -- 172.21.15.148:0/2915673115 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ee81036c0 msgr2=0x7f1ee810bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:27.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.239+0000 7f1eed44a640 1 --2- 172.21.15.148:0/2915673115 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ee81036c0 0x7f1ee810bbb0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f1ed8009900 tx=0x7f1ed802a480 comp rx=0 tx=0).stop 2024-09-19T07:12:27.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.239+0000 7f1eed44a640 1 -- 172.21.15.148:0/2915673115 shutdown_connections 2024-09-19T07:12:27.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.239+0000 7f1eed44a640 1 --2- 172.21.15.148:0/2915673115 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ee810c180 0x7f1ee810e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:27.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.239+0000 7f1eed44a640 1 --2- 172.21.15.148:0/2915673115 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ee81036c0 0x7f1ee810bbb0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:27.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.239+0000 7f1eed44a640 1 --2- 172.21.15.148:0/2915673115 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ee8102da0 0x7f1ee8103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:27.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.239+0000 7f1eed44a640 1 -- 172.21.15.148:0/2915673115 >> 172.21.15.148:0/2915673115 conn(0x7f1ee80fc7a0 msgr2=0x7f1ee80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:27.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.239+0000 7f1eed44a640 1 -- 172.21.15.148:0/2915673115 shutdown_connections 2024-09-19T07:12:27.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.239+0000 7f1eed44a640 1 -- 172.21.15.148:0/2915673115 wait complete. 2024-09-19T07:12:27.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.239+0000 7f1eed44a640 1 Processor -- start 2024-09-19T07:12:27.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.239+0000 7f1eed44a640 1 -- start start 2024-09-19T07:12:27.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.240+0000 7f1eed44a640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ee8102da0 0x7f1ee8198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:27.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.240+0000 7f1eed44a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ee81036c0 0x7f1ee81989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:27.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.240+0000 7f1eed44a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ee810c180 0x7f1ee819cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:27.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.240+0000 7f1eed44a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee8111f60 con 0x7f1ee810c180 2024-09-19T07:12:27.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.240+0000 7f1eed44a640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee8111de0 con 0x7f1ee8102da0 2024-09-19T07:12:27.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.240+0000 7f1eed44a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee81120e0 con 0x7f1ee81036c0 2024-09-19T07:12:27.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.240+0000 7f1ee77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ee810c180 0x7f1ee819cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:27.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.240+0000 7f1ee77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ee810c180 0x7f1ee819cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60820/0 (socket says 172.21.15.148:60820) 2024-09-19T07:12:27.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.240+0000 7f1ee77fe640 1 -- 172.21.15.148:0/302561845 learned_addr learned my addr 172.21.15.148:0/302561845 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:27.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.240+0000 7f1ee6ffd640 1 --2- 172.21.15.148:0/302561845 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ee8102da0 0x7f1ee8198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:27.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.240+0000 7f1edffff640 1 --2- 172.21.15.148:0/302561845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ee81036c0 0x7f1ee81989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:27.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.240+0000 7f1ee77fe640 1 -- 172.21.15.148:0/302561845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ee81036c0 msgr2=0x7f1ee81989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:27.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.240+0000 7f1ee77fe640 1 --2- 172.21.15.148:0/302561845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ee81036c0 0x7f1ee81989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:27.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.240+0000 7f1ee77fe640 1 -- 172.21.15.148:0/302561845 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ee8102da0 msgr2=0x7f1ee8198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:27.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.240+0000 7f1ee77fe640 1 --2- 172.21.15.148:0/302561845 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ee8102da0 0x7f1ee8198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:27.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.240+0000 7f1ee77fe640 1 -- 172.21.15.148:0/302561845 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ee819d410 con 0x7f1ee810c180 2024-09-19T07:12:27.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.240+0000 7f1ee77fe640 1 --2- 172.21.15.148:0/302561845 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ee810c180 0x7f1ee819cd30 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f1ee000eaa0 tx=0x7f1ee000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:27.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.240+0000 7f1ee4ff9640 1 -- 172.21.15.148:0/302561845 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee0004d20 con 0x7f1ee810c180 2024-09-19T07:12:27.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.240+0000 7f1eed44a640 1 -- 172.21.15.148:0/302561845 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ee819d700 con 0x7f1ee810c180 2024-09-19T07:12:27.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.240+0000 7f1ee4ff9640 1 -- 172.21.15.148:0/302561845 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ee0005020 con 0x7f1ee810c180 2024-09-19T07:12:27.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.240+0000 7f1ee4ff9640 1 -- 172.21.15.148:0/302561845 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee00116d0 con 0x7f1ee810c180 2024-09-19T07:12:27.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.240+0000 7f1eed44a640 1 -- 172.21.15.148:0/302561845 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ee81a4fe0 con 0x7f1ee810c180 2024-09-19T07:12:27.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.242+0000 7f1ee4ff9640 1 -- 172.21.15.148:0/302561845 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 24) ==== 138589+0+0 (secure 0 0 0) 0x7f1ee00051d0 con 0x7f1ee810c180 2024-09-19T07:12:27.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.243+0000 7f1eef823740 1 Processor -- start 2024-09-19T07:12:27.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.243+0000 7f1eef823740 1 -- start start 2024-09-19T07:12:27.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.243+0000 7f1ee4ff9640 1 --2- 172.21.15.148:0/302561845 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f1ed40a34d0 0x7f1ed40a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:27.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.243+0000 7f1eef823740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b98972850 0x558b98972c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:27.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.243+0000 7f1eef823740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b98973170 0x558b9897d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:27.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.243+0000 7f1eef823740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b9897da30 0x558b9897fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:27.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.243+0000 7f1eef823740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x558b988d7160 con 0x558b98973170 2024-09-19T07:12:27.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.243+0000 7f1eef823740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x558b9887e720 con 0x558b98972850 2024-09-19T07:12:27.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.243+0000 7f1eef823740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x558b988d3120 con 0x558b9897da30 2024-09-19T07:12:27.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.244+0000 7f1edffff640 1 --2- 172.21.15.148:0/302561845 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f1ed40a34d0 0x7f1ed40a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:27.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.244+0000 7f1ee4ff9640 1 -- 172.21.15.148:0/302561845 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f1ee00d00d0 con 0x7f1ee810c180 2024-09-19T07:12:27.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.244+0000 7f1ee6ffd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b98972850 0x558b98972c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:27.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.244+0000 7f1ee6ffd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b98972850 0x558b98972c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:51030/0 (socket says 172.21.15.148:51030) 2024-09-19T07:12:27.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.244+0000 7f1ee6ffd640 1 -- 172.21.15.148:0/1290425377 learned_addr learned my addr 172.21.15.148:0/1290425377 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:27.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.244+0000 7f1edffff640 1 --2- 172.21.15.148:0/1290425377 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b98973170 0x558b9897d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:27.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.244+0000 7f1ee77fe640 1 --2- 172.21.15.148:0/1290425377 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b9897da30 0x558b9897fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:27.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.244+0000 7f1ee6ffd640 1 -- 172.21.15.148:0/1290425377 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b9897da30 msgr2=0x558b9897fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:27.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.244+0000 7f1ee6ffd640 1 --2- 172.21.15.148:0/1290425377 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b9897da30 0x558b9897fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:27.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.244+0000 7f1ee6ffd640 1 -- 172.21.15.148:0/1290425377 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b98973170 msgr2=0x558b9897d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:27.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.244+0000 7f1ee6ffd640 1 --2- 172.21.15.148:0/1290425377 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b98973170 0x558b9897d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:27.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.244+0000 7f1ee6ffd640 1 -- 172.21.15.148:0/1290425377 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b98648ba0 con 0x558b98972850 2024-09-19T07:12:27.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.244+0000 7f1edffff640 1 --2- 172.21.15.148:0/302561845 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f1ed40a34d0 0x7f1ed40a5990 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1ed8009230 tx=0x7f1ed8005e60 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:27.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.244+0000 7f1ee6ffd640 1 --2- 172.21.15.148:0/1290425377 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b98972850 0x558b98972c30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1ed000ad00 tx=0x7f1ed000f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e1e69d564f4916a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:27.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.244+0000 7f1edd7fa640 1 -- 172.21.15.148:0/1290425377 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed001d070 con 0x558b98972850 2024-09-19T07:12:27.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.244+0000 7f1edd7fa640 1 -- 172.21.15.148:0/1290425377 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ed0018b20 con 0x558b98972850 2024-09-19T07:12:27.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.244+0000 7f1edd7fa640 1 -- 172.21.15.148:0/1290425377 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed0010b80 con 0x558b98972850 2024-09-19T07:12:27.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.245+0000 7f1eef823740 1 -- 172.21.15.148:0/1290425377 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b98972850 msgr2=0x558b98972c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:27.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.245+0000 7f1eef823740 1 --2- 172.21.15.148:0/1290425377 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b98972850 0x558b98972c30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1ed000ad00 tx=0x7f1ed000f790 comp rx=0 tx=0).stop 2024-09-19T07:12:27.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.245+0000 7f1eef823740 1 -- 172.21.15.148:0/1290425377 shutdown_connections 2024-09-19T07:12:27.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.245+0000 7f1eef823740 1 --2- 172.21.15.148:0/1290425377 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b9897da30 0x558b9897fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:27.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.245+0000 7f1eef823740 1 --2- 172.21.15.148:0/1290425377 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b98973170 0x558b9897d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:27.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.245+0000 7f1eef823740 1 --2- 172.21.15.148:0/1290425377 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b98972850 0x558b98972c30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:27.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.245+0000 7f1eef823740 1 -- 172.21.15.148:0/1290425377 >> 172.21.15.148:0/1290425377 conn(0x558b9896ede0 msgr2=0x558b9896f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:27.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.245+0000 7f1eef823740 1 -- 172.21.15.148:0/1290425377 shutdown_connections 2024-09-19T07:12:27.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.245+0000 7f1eef823740 1 -- 172.21.15.148:0/1290425377 wait complete. 2024-09-19T07:12:27.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.246+0000 7f1eef823740 1 -- start start 2024-09-19T07:12:27.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.246+0000 7f1eef823740 1 Processor -- start 2024-09-19T07:12:27.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.246+0000 7f1eef823740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b98972850 0x558b9897a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:27.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.246+0000 7f1eef823740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b98973170 0x558b9897ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:27.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.246+0000 7f1eef823740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b9897da30 0x558b9897b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:27.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.246+0000 7f1eef823740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x558b98980600 con 0x558b98972850 2024-09-19T07:12:27.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.246+0000 7f1eef823740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x558b9885f900 con 0x558b98973170 2024-09-19T07:12:27.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.246+0000 7f1eef823740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x558b98980780 con 0x558b9897da30 2024-09-19T07:12:27.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.246+0000 7f1eef823740 10 client.0 _ll_register_callbacks cb 0x558b9885d780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:12:27.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.246+0000 7f1ee6ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b98972850 0x558b9897a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:27.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.246+0000 7f1ee6ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b98972850 0x558b9897a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60834/0 (socket says 172.21.15.148:60834) 2024-09-19T07:12:27.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.246+0000 7f1ee6ffd640 1 -- 172.21.15.148:0/3560699117 learned_addr learned my addr 172.21.15.148:0/3560699117 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:27.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.246+0000 7f1ee77fe640 1 --2- 172.21.15.148:0/3560699117 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b9897da30 0x558b9897b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:27.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.246+0000 7f1edffff640 1 --2- 172.21.15.148:0/3560699117 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b98973170 0x558b9897ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:27.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.246+0000 7f1ee6ffd640 1 -- 172.21.15.148:0/3560699117 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b9897da30 msgr2=0x558b9897b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:27.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.246+0000 7f1ee6ffd640 1 --2- 172.21.15.148:0/3560699117 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b9897da30 0x558b9897b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:27.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.246+0000 7f1ee6ffd640 1 -- 172.21.15.148:0/3560699117 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b98973170 msgr2=0x558b9897ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:27.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.246+0000 7f1ee6ffd640 1 --2- 172.21.15.148:0/3560699117 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b98973170 0x558b9897ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:27.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.246+0000 7f1ee6ffd640 1 -- 172.21.15.148:0/3560699117 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b9889fc50 con 0x558b98972850 2024-09-19T07:12:27.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.247+0000 7f1ee6ffd640 1 --2- 172.21.15.148:0/3560699117 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b98972850 0x558b9897a8d0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f1ed001b040 tx=0x7f1ed0019f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21112d8b5945f065 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:27.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.247+0000 7f1ece7fc640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:12:27.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.247+0000 7f1ece7fc640 1 -- 172.21.15.148:0/3560699117 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed001d040 con 0x558b98972850 2024-09-19T07:12:27.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.247+0000 7f1ece7fc640 1 -- 172.21.15.148:0/3560699117 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f1ed0018640 con 0x558b98972850 2024-09-19T07:12:27.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.247+0000 7f1eef823740 1 -- 172.21.15.148:0/3560699117 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ed0018b20 con 0x558b98972850 2024-09-19T07:12:27.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.247+0000 7f1ece7fc640 1 -- 172.21.15.148:0/3560699117 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1ed0031050 con 0x558b98972850 2024-09-19T07:12:27.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.247+0000 7f1eef823740 10 client.15684 fetch_fsmap learned FSMap version 25 2024-09-19T07:12:27.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.247+0000 7f1eef823740 1 -- 172.21.15.148:0/3560699117 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558b9898c260 con 0x558b98972850 2024-09-19T07:12:27.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.247+0000 7f1ece7fc640 1 -- 172.21.15.148:0/3560699117 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ed0028070 con 0x558b98972850 2024-09-19T07:12:27.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.248+0000 7f1ece7fc640 1 -- 172.21.15.148:0/3560699117 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1ed0020030 con 0x558b98972850 2024-09-19T07:12:27.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.248+0000 7f1eef823740 10 client.15684 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:12:27.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.248+0000 7f1eef823740 10 client.15684 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:12:27.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.248+0000 7f1eef823740 20 client.15684 populate_metadata read hostname 'smithi148' 2024-09-19T07:12:27.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.248+0000 7f1eef823740 1 --2- 172.21.15.148:0/3560699117 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x558b9898d6c0 0x558b9898fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:27.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.248+0000 7f1eef823740 4 client.15684 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:12:27.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.248+0000 7f1eef823740 1 -- 172.21.15.148:0/3560699117 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f1ed0018b20 con 0x558b9898d6c0 2024-09-19T07:12:27.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.248+0000 7f1edffff640 1 --2- 172.21.15.148:0/3560699117 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x558b9898d6c0 0x558b9898fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:27.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.249+0000 7f1edffff640 1 --2- 172.21.15.148:0/3560699117 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x558b9898d6c0 0x558b9898fab0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44f57b210cf8c7df server_cookie=7d82a13ba0461855 in_seq=0 out_seq=0 2024-09-19T07:12:27.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.249+0000 7f1ece7fc640 10 client.15684 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:27.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.249+0000 7f1ece7fc640 1 -- 172.21.15.148:0/3560699117 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f1ed0018b20 con 0x558b9898d6c0 2024-09-19T07:12:27.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.249+0000 7f1ece7fc640 10 client.15684 handle_command_reply: tid=0 2024-09-19T07:12:27.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.249+0000 7f1eef823740 1 client.15684 shutdown 2024-09-19T07:12:27.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.250+0000 7f1eef823740 1 -- 172.21.15.148:0/3560699117 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b98972850 msgr2=0x558b9897a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:27.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.250+0000 7f1eef823740 1 --2- 172.21.15.148:0/3560699117 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b98972850 0x558b9897a8d0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f1ed001b040 tx=0x7f1ed0019f10 comp rx=0 tx=0).stop 2024-09-19T07:12:27.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.250+0000 7f1eef823740 1 -- 172.21.15.148:0/3560699117 shutdown_connections 2024-09-19T07:12:27.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.250+0000 7f1eef823740 1 --2- 172.21.15.148:0/3560699117 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x558b9898d6c0 0x558b9898fab0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:27.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.250+0000 7f1eef823740 1 --2- 172.21.15.148:0/3560699117 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b9897da30 0x558b9897b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:27.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.250+0000 7f1eef823740 1 --2- 172.21.15.148:0/3560699117 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b98973170 0x558b9897ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:27.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.250+0000 7f1eef823740 1 --2- 172.21.15.148:0/3560699117 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b98972850 0x558b9897a8d0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:27.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.250+0000 7f1eef823740 1 -- 172.21.15.148:0/3560699117 >> 172.21.15.148:0/3560699117 conn(0x558b9896ede0 msgr2=0x558b98974b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:27.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.250+0000 7f1ece7fc640 0 client.15684 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:27.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.250+0000 7f1eef823740 1 -- 172.21.15.148:0/3560699117 shutdown_connections 2024-09-19T07:12:27.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.250+0000 7f1eef823740 1 -- 172.21.15.148:0/3560699117 wait complete. 2024-09-19T07:12:27.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.250+0000 7f1eef823740 20 client.15684 trim_cache size 0 max 16384 2024-09-19T07:12:27.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.267+0000 7f1eef823740 1 Processor -- start 2024-09-19T07:12:27.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.267+0000 7f1eef823740 1 -- start start 2024-09-19T07:12:27.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.267+0000 7f1eef823740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b98973170 0x558b98975e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:27.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.267+0000 7f1eef823740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b9897da30 0x558b989749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:27.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.267+0000 7f1eef823740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b98974ef0 0x558b989950e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:27.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.267+0000 7f1eef823740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee81b0100 con 0x558b98974ef0 2024-09-19T07:12:27.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.267+0000 7f1eef823740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee81ad9d0 con 0x558b9897da30 2024-09-19T07:12:27.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.267+0000 7f1eef823740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee81ab800 con 0x558b98973170 2024-09-19T07:12:27.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.267+0000 7f1ee77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b98974ef0 0x558b989950e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:27.270 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.267+0000 7f1ee77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b98974ef0 0x558b989950e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60848/0 (socket says 172.21.15.148:60848) 2024-09-19T07:12:27.270 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.267+0000 7f1ee77fe640 1 -- 172.21.15.148:0/1112254864 learned_addr learned my addr 172.21.15.148:0/1112254864 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:27.270 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.267+0000 7f1ee6ffd640 1 --2- 172.21.15.148:0/1112254864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b98973170 0x558b98975e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:27.270 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.267+0000 7f1ee77fe640 1 -- 172.21.15.148:0/1112254864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b98973170 msgr2=0x558b98975e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:27.270 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.267+0000 7f1ee77fe640 1 --2- 172.21.15.148:0/1112254864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b98973170 0x558b98975e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:27.270 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.267+0000 7f1ee77fe640 1 -- 172.21.15.148:0/1112254864 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b9897da30 msgr2=0x558b989749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:27.270 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.267+0000 7f1ee77fe640 1 --2- 172.21.15.148:0/1112254864 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b9897da30 0x558b989749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:27.270 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.268+0000 7f1ee77fe640 1 -- 172.21.15.148:0/1112254864 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b9896e880 con 0x558b98974ef0 2024-09-19T07:12:27.270 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.268+0000 7f1ee77fe640 1 --2- 172.21.15.148:0/1112254864 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b98974ef0 0x558b989950e0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f1ee0098b40 tx=0x7f1ee0098410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24477c94916aa8f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:27.270 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.268+0000 7f1edcff9640 1 -- 172.21.15.148:0/1112254864 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee001f040 con 0x558b98974ef0 2024-09-19T07:12:27.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.268+0000 7f1edcff9640 1 -- 172.21.15.148:0/1112254864 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ee0079140 con 0x558b98974ef0 2024-09-19T07:12:27.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.268+0000 7f1edcff9640 1 -- 172.21.15.148:0/1112254864 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee000fd30 con 0x558b98974ef0 2024-09-19T07:12:27.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.269+0000 7f1eef823740 1 -- 172.21.15.148:0/1112254864 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b98974ef0 msgr2=0x558b989950e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:27.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.269+0000 7f1eef823740 1 --2- 172.21.15.148:0/1112254864 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b98974ef0 0x558b989950e0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f1ee0098b40 tx=0x7f1ee0098410 comp rx=0 tx=0).stop 2024-09-19T07:12:27.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.269+0000 7f1eef823740 1 -- 172.21.15.148:0/1112254864 shutdown_connections 2024-09-19T07:12:27.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.269+0000 7f1eef823740 1 --2- 172.21.15.148:0/1112254864 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b98974ef0 0x558b989950e0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:27.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.269+0000 7f1eef823740 1 --2- 172.21.15.148:0/1112254864 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b9897da30 0x558b989749b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:27.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.269+0000 7f1eef823740 1 --2- 172.21.15.148:0/1112254864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b98973170 0x558b98975e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:27.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.269+0000 7f1eef823740 1 -- 172.21.15.148:0/1112254864 >> 172.21.15.148:0/1112254864 conn(0x558b9896ede0 msgr2=0x558b989742a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:27.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.269+0000 7f1eef823740 1 -- 172.21.15.148:0/1112254864 shutdown_connections 2024-09-19T07:12:27.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.269+0000 7f1eef823740 1 -- 172.21.15.148:0/1112254864 wait complete. 2024-09-19T07:12:27.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.269+0000 7f1eef823740 1 -- start start 2024-09-19T07:12:27.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.269+0000 7f1eef823740 1 Processor -- start 2024-09-19T07:12:27.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.269+0000 7f1eef823740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b98973170 0x558b989817d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:27.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.269+0000 7f1eef823740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b98974ef0 0x558b98981d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:27.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.269+0000 7f1eef823740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b9897da30 0x558b98982250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:27.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.269+0000 7f1eef823740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee81abe90 con 0x558b9897da30 2024-09-19T07:12:27.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.269+0000 7f1eef823740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee81ad300 con 0x558b98973170 2024-09-19T07:12:27.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.269+0000 7f1eef823740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee81ac560 con 0x558b98974ef0 2024-09-19T07:12:27.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.269+0000 7f1eef823740 10 client.0 _ll_register_callbacks cb 0x7f1ed001b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:12:27.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.269+0000 7f1ee77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b9897da30 0x558b98982250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:27.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.269+0000 7f1ee77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b9897da30 0x558b98982250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60860/0 (socket says 172.21.15.148:60860) 2024-09-19T07:12:27.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.270+0000 7f1ee77fe640 1 -- 172.21.15.148:0/1163148079 learned_addr learned my addr 172.21.15.148:0/1163148079 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:27.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.270+0000 7f1edffff640 1 --2- 172.21.15.148:0/1163148079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b98974ef0 0x558b98981d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:27.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.270+0000 7f1ee6ffd640 1 --2- 172.21.15.148:0/1163148079 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b98973170 0x558b989817d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:27.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.270+0000 7f1ee77fe640 1 -- 172.21.15.148:0/1163148079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b98974ef0 msgr2=0x558b98981d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:27.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.270+0000 7f1ee77fe640 1 --2- 172.21.15.148:0/1163148079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b98974ef0 0x558b98981d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:27.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.270+0000 7f1ee77fe640 1 -- 172.21.15.148:0/1163148079 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b98973170 msgr2=0x558b989817d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:27.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.270+0000 7f1ee77fe640 1 --2- 172.21.15.148:0/1163148079 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b98973170 0x558b989817d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:27.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.270+0000 7f1ee77fe640 1 -- 172.21.15.148:0/1163148079 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b989f7160 con 0x558b9897da30 2024-09-19T07:12:27.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.270+0000 7f1ee6ffd640 1 --2- 172.21.15.148:0/1163148079 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b98973170 0x558b989817d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:12:27.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.270+0000 7f1ee77fe640 1 --2- 172.21.15.148:0/1163148079 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b9897da30 0x558b98982250 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f1ee00d00a0 tx=0x7f1ee000c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5633862d48c0eee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:27.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.270+0000 7f1ece7fc640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:12:27.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.270+0000 7f1ece7fc640 1 -- 172.21.15.148:0/1163148079 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee00b4020 con 0x558b9897da30 2024-09-19T07:12:27.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.270+0000 7f1ece7fc640 1 -- 172.21.15.148:0/1163148079 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f1ee00bc0c0 con 0x558b9897da30 2024-09-19T07:12:27.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.270+0000 7f1eef823740 1 -- 172.21.15.148:0/1163148079 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ee0079140 con 0x558b9897da30 2024-09-19T07:12:27.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.270+0000 7f1ece7fc640 1 -- 172.21.15.148:0/1163148079 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1ee001f070 con 0x558b9897da30 2024-09-19T07:12:27.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.270+0000 7f1eef823740 10 client.15690 fetch_fsmap learned FSMap version 25 2024-09-19T07:12:27.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.270+0000 7f1eef823740 1 -- 172.21.15.148:0/1163148079 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558b989f8420 con 0x558b9897da30 2024-09-19T07:12:27.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.270+0000 7f1ece7fc640 1 -- 172.21.15.148:0/1163148079 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ee0079140 con 0x558b9897da30 2024-09-19T07:12:27.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.271+0000 7f1ece7fc640 1 -- 172.21.15.148:0/1163148079 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1ee0096ce0 con 0x558b9897da30 2024-09-19T07:12:27.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.271+0000 7f1eef823740 10 client.15690 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:12:27.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.271+0000 7f1eef823740 10 client.15690 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:12:27.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.271+0000 7f1eef823740 20 client.15690 populate_metadata read hostname 'smithi148' 2024-09-19T07:12:27.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.271+0000 7f1eef823740 1 --2- 172.21.15.148:0/1163148079 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x558b989f8ba0 0x558b989fafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:27.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.271+0000 7f1eef823740 4 client.15690 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}] 2024-09-19T07:12:27.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.271+0000 7f1eef823740 1 -- 172.21.15.148:0/1163148079 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}) -- 0x558b988e4890 con 0x558b989f8ba0 2024-09-19T07:12:27.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.271+0000 7f1ee6ffd640 1 --2- 172.21.15.148:0/1163148079 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x558b989f8ba0 0x558b989fafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:27.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.271+0000 7f1ece7fc640 10 client.15690 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:27.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.271+0000 7f1ee6ffd640 1 --2- 172.21.15.148:0/1163148079 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x558b989f8ba0 0x558b989fafc0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba3a0106034d29f2 server_cookie=3a943f274b2c374e in_seq=0 out_seq=0 2024-09-19T07:12:27.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.278+0000 7f1ece7fc640 1 -- 172.21.15.148:0/1163148079 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x558b988e4890 con 0x558b989f8ba0 2024-09-19T07:12:27.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.278+0000 7f1ece7fc640 10 client.15690 handle_command_reply: tid=0 2024-09-19T07:12:27.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.278+0000 7f1eef823740 1 client.15690 shutdown 2024-09-19T07:12:27.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.278+0000 7f1eef823740 1 -- 172.21.15.148:0/1163148079 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b9897da30 msgr2=0x558b98982250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:27.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.278+0000 7f1eef823740 1 --2- 172.21.15.148:0/1163148079 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b9897da30 0x558b98982250 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f1ee00d00a0 tx=0x7f1ee000c740 comp rx=0 tx=0).stop 2024-09-19T07:12:27.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.278+0000 7f1eef823740 1 -- 172.21.15.148:0/1163148079 shutdown_connections 2024-09-19T07:12:27.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.278+0000 7f1eef823740 1 --2- 172.21.15.148:0/1163148079 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x558b989f8ba0 0x558b989fafc0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:27.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.278+0000 7f1eef823740 1 --2- 172.21.15.148:0/1163148079 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b9897da30 0x558b98982250 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:27.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.278+0000 7f1eef823740 1 --2- 172.21.15.148:0/1163148079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b98974ef0 0x558b98981d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:27.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.278+0000 7f1eef823740 1 --2- 172.21.15.148:0/1163148079 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b98973170 0x558b989817d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:27.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.278+0000 7f1ece7fc640 0 client.15690 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:27.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.278+0000 7f1eef823740 1 -- 172.21.15.148:0/1163148079 >> 172.21.15.148:0/1163148079 conn(0x558b9896ede0 msgr2=0x558b9897a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:27.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.278+0000 7f1eef823740 1 -- 172.21.15.148:0/1163148079 shutdown_connections 2024-09-19T07:12:27.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.278+0000 7f1eef823740 1 -- 172.21.15.148:0/1163148079 wait complete. 2024-09-19T07:12:27.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.278+0000 7f1eef823740 20 client.15690 trim_cache size 0 max 16384 2024-09-19T07:12:27.285 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:12:27.285 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 25, 2024-09-19T07:12:27.285 INFO:teuthology.orchestra.run.smithi148.stdout: "leader": 24457, 2024-09-19T07:12:27.285 INFO:teuthology.orchestra.run.smithi148.stdout: "set_version": 6, 2024-09-19T07:12:27.285 INFO:teuthology.orchestra.run.smithi148.stdout: "sets": { 2024-09-19T07:12:27.285 INFO:teuthology.orchestra.run.smithi148.stdout: "edfd46a9": { 2024-09-19T07:12:27.286 INFO:teuthology.orchestra.run.smithi148.stdout: "version": 6, 2024-09-19T07:12:27.286 INFO:teuthology.orchestra.run.smithi148.stdout: "age_ref": 0.0, 2024-09-19T07:12:27.286 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:12:27.286 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "QUIESCED", 2024-09-19T07:12:27.286 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:12:27.286 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:12:27.286 INFO:teuthology.orchestra.run.smithi148.stdout: "timeout": 90.0, 2024-09-19T07:12:27.286 INFO:teuthology.orchestra.run.smithi148.stdout: "expiration": 140.3, 2024-09-19T07:12:27.286 INFO:teuthology.orchestra.run.smithi148.stdout: "members": { 2024-09-19T07:12:27.286 INFO:teuthology.orchestra.run.smithi148.stdout: "file:/": { 2024-09-19T07:12:27.286 INFO:teuthology.orchestra.run.smithi148.stdout: "excluded": false, 2024-09-19T07:12:27.287 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:12:27.287 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "QUIESCED", 2024-09-19T07:12:27.287 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:12:27.287 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:12:27.287 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:12:27.287 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:12:27.287 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:12:27.287 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:12:27.287 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:12:27.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.279+0000 7f1eed44a640 1 -- 172.21.15.148:0/302561845 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f1ed40a34d0 msgr2=0x7f1ed40a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:27.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.279+0000 7f1eed44a640 1 --2- 172.21.15.148:0/302561845 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f1ed40a34d0 0x7f1ed40a5990 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1ed8009230 tx=0x7f1ed8005e60 comp rx=0 tx=0).stop 2024-09-19T07:12:27.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.279+0000 7f1eed44a640 1 -- 172.21.15.148:0/302561845 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ee810c180 msgr2=0x7f1ee819cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:27.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.279+0000 7f1eed44a640 1 --2- 172.21.15.148:0/302561845 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ee810c180 0x7f1ee819cd30 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f1ee000eaa0 tx=0x7f1ee000eea0 comp rx=0 tx=0).stop 2024-09-19T07:12:27.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.279+0000 7f1eed44a640 1 -- 172.21.15.148:0/302561845 shutdown_connections 2024-09-19T07:12:27.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.279+0000 7f1eed44a640 1 --2- 172.21.15.148:0/302561845 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f1ed40a34d0 0x7f1ed40a5990 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:27.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.279+0000 7f1eed44a640 1 --2- 172.21.15.148:0/302561845 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ee810c180 0x7f1ee819cd30 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:27.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.279+0000 7f1eed44a640 1 --2- 172.21.15.148:0/302561845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ee81036c0 0x7f1ee81989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:27.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.279+0000 7f1eed44a640 1 --2- 172.21.15.148:0/302561845 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ee8102da0 0x7f1ee8198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:27.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.279+0000 7f1eed44a640 1 -- 172.21.15.148:0/302561845 >> 172.21.15.148:0/302561845 conn(0x7f1ee80fc7a0 msgr2=0x7f1ee80fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:27.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.279+0000 7f1eed44a640 1 -- 172.21.15.148:0/302561845 shutdown_connections 2024-09-19T07:12:27.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:27.279+0000 7f1eed44a640 1 -- 172.21.15.148:0/302561845 wait complete. 2024-09-19T07:12:27.504 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-19T07:12:27.596 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-19T07:12:27.635 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T07:12:27.637 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T07:12:27.637 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-19T07:12:27.682 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T07:12:27.685 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-19T07:12:27.685 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-19T07:12:27.702 INFO:tasks.workunit:Running workunits matching suites/blogbench.sh on client.0... 2024-09-19T07:12:27.704 INFO:tasks.workunit:Running workunit suites/blogbench.sh... 2024-09-19T07:12:27.704 DEBUG:teuthology.orchestra.run.smithi148:workunit test suites/blogbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6fad5dd73c93545e52f57f681e140a9c3529c11e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/blogbench.sh 2024-09-19T07:12:28.190 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'edfd46a9', quiesce took 3.8 seconds. Will release after: 16.55 2024-09-19T07:12:28.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:28 smithi148 ceph-mon[31180]: pgmap v45: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T07:12:28.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:28 smithi165 ceph-mon[35326]: pgmap v45: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T07:12:28.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:28 smithi179 ceph-mon[35716]: pgmap v45: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T07:12:30.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:30 smithi165 ceph-mon[35326]: pgmap v46: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-19T07:12:30.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:30 smithi179 ceph-mon[35716]: pgmap v46: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-19T07:12:30.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:30 smithi148 ceph-mon[31180]: pgmap v46: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-19T07:12:32.631 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:32 smithi148 ceph-mon[31180]: pgmap v47: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-19T07:12:32.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:32 smithi165 ceph-mon[35326]: pgmap v47: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-19T07:12:32.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:32 smithi179 ceph-mon[35716]: pgmap v47: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-19T07:12:33.464 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.463+0000 7f47fd568640 1 -- 172.21.15.148:0/2812258909 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47f8100850 msgr2=0x7f47f8100c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:33.464 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.463+0000 7f47fd568640 1 --2- 172.21.15.148:0/2812258909 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47f8100850 0x7f47f8100c30 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f47e8009930 tx=0x7f47e802a420 comp rx=0 tx=0).stop 2024-09-19T07:12:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.463+0000 7f47fd568640 1 -- 172.21.15.148:0/2812258909 shutdown_connections 2024-09-19T07:12:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.463+0000 7f47fd568640 1 --2- 172.21.15.148:0/2812258909 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47f8108110 0x7f47f810ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.463+0000 7f47fd568640 1 --2- 172.21.15.148:0/2812258909 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f47f8101200 0x7f47f81079b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.463+0000 7f47fd568640 1 --2- 172.21.15.148:0/2812258909 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47f8100850 0x7f47f8100c30 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.463+0000 7f47fd568640 1 -- 172.21.15.148:0/2812258909 >> 172.21.15.148:0/2812258909 conn(0x7f47f8075db0 msgr2=0x7f47f80761c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.463+0000 7f47fd568640 1 -- 172.21.15.148:0/2812258909 shutdown_connections 2024-09-19T07:12:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.463+0000 7f47fd568640 1 -- 172.21.15.148:0/2812258909 wait complete. 2024-09-19T07:12:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.464+0000 7f47fd568640 1 Processor -- start 2024-09-19T07:12:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.464+0000 7f47fd568640 1 -- start start 2024-09-19T07:12:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.464+0000 7f47fd568640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47f8100850 0x7f47f81017c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.464+0000 7f47fd568640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f47f8108110 0x7f47f8101d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.464+0000 7f47fd568640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47f8102240 0x7f47f81a64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.464+0000 7f47fd568640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f47f8111f10 con 0x7f47f8102240 2024-09-19T07:12:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.464+0000 7f47fd568640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f47f8111d90 con 0x7f47f8108110 2024-09-19T07:12:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.464+0000 7f47fd568640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f47f8112090 con 0x7f47f8100850 2024-09-19T07:12:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.464+0000 7f47f77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47f8102240 0x7f47f81a64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.464+0000 7f47f77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47f8102240 0x7f47f81a64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60876/0 (socket says 172.21.15.148:60876) 2024-09-19T07:12:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.464+0000 7f47f77fe640 1 -- 172.21.15.148:0/3263288202 learned_addr learned my addr 172.21.15.148:0/3263288202 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.464+0000 7f47f6ffd640 1 --2- 172.21.15.148:0/3263288202 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47f8100850 0x7f47f81017c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.464+0000 7f47f67fc640 1 --2- 172.21.15.148:0/3263288202 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f47f8108110 0x7f47f8101d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:33.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.464+0000 7f47f77fe640 1 -- 172.21.15.148:0/3263288202 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47f8100850 msgr2=0x7f47f81017c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:33.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.464+0000 7f47f77fe640 1 --2- 172.21.15.148:0/3263288202 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47f8100850 0x7f47f81017c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:33.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.464+0000 7f47f77fe640 1 -- 172.21.15.148:0/3263288202 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f47f8108110 msgr2=0x7f47f8101d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:33.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.464+0000 7f47f77fe640 1 --2- 172.21.15.148:0/3263288202 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f47f8108110 0x7f47f8101d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:33.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.464+0000 7f47f77fe640 1 -- 172.21.15.148:0/3263288202 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f81a6bd0 con 0x7f47f8102240 2024-09-19T07:12:33.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.465+0000 7f47f77fe640 1 --2- 172.21.15.148:0/3263288202 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47f8102240 0x7f47f81a64d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f47f000eb10 tx=0x7f47f000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:33.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.465+0000 7f47effff640 1 -- 172.21.15.148:0/3263288202 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f0004b20 con 0x7f47f8102240 2024-09-19T07:12:33.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.465+0000 7f47effff640 1 -- 172.21.15.148:0/3263288202 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47f0004cc0 con 0x7f47f8102240 2024-09-19T07:12:33.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.465+0000 7f47fd568640 1 -- 172.21.15.148:0/3263288202 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47f81a6ec0 con 0x7f47f8102240 2024-09-19T07:12:33.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.465+0000 7f47effff640 1 -- 172.21.15.148:0/3263288202 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f0010760 con 0x7f47f8102240 2024-09-19T07:12:33.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.465+0000 7f47fd568640 1 -- 172.21.15.148:0/3263288202 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47f81a73e0 con 0x7f47f8102240 2024-09-19T07:12:33.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.467+0000 7f47effff640 1 -- 172.21.15.148:0/3263288202 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 24) ==== 138589+0+0 (secure 0 0 0) 0x7f47f0005020 con 0x7f47f8102240 2024-09-19T07:12:33.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.467+0000 7f48003da740 1 Processor -- start 2024-09-19T07:12:33.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.468+0000 7f48003da740 1 -- start start 2024-09-19T07:12:33.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.468+0000 7f48003da740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56500edabaf0 0x56500edabed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:33.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.468+0000 7f48003da740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56500edac410 0x56500edb6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:33.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.468+0000 7f48003da740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56500edb6cb0 0x56500edb90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:33.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.468+0000 7f48003da740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56500ed102f0 con 0x56500edac410 2024-09-19T07:12:33.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.468+0000 7f48003da740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56500ecb8270 con 0x56500edabaf0 2024-09-19T07:12:33.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.468+0000 7f48003da740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56500ed0c2b0 con 0x56500edb6cb0 2024-09-19T07:12:33.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.468+0000 7f47f6ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56500edac410 0x56500edb6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:33.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.468+0000 7f47effff640 1 --2- 172.21.15.148:0/3263288202 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f47e40a35b0 0x7f47e40a5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:33.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.468+0000 7f47f6ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56500edac410 0x56500edb6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60886/0 (socket says 172.21.15.148:60886) 2024-09-19T07:12:33.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.468+0000 7f47f6ffd640 1 -- 172.21.15.148:0/3647849852 learned_addr learned my addr 172.21.15.148:0/3647849852 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:33.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.468+0000 7f47f67fc640 1 --2- 172.21.15.148:0/3647849852 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56500edb6cb0 0x56500edb90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:33.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.468+0000 7f47f77fe640 1 --2- 172.21.15.148:0/3263288202 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f47e40a35b0 0x7f47e40a5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:33.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.468+0000 7f47f67fc640 1 --2- 172.21.15.148:0/3647849852 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56500edabaf0 0x56500edabed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:33.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.469+0000 7f47f6ffd640 1 -- 172.21.15.148:0/3647849852 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56500edb6cb0 msgr2=0x56500edb90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:33.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.469+0000 7f47f6ffd640 1 --2- 172.21.15.148:0/3647849852 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56500edb6cb0 0x56500edb90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:33.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.469+0000 7f47f6ffd640 1 -- 172.21.15.148:0/3647849852 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56500edabaf0 msgr2=0x56500edabed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:33.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.469+0000 7f47f6ffd640 1 --2- 172.21.15.148:0/3647849852 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56500edabaf0 0x56500edabed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:33.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.469+0000 7f47effff640 1 -- 172.21.15.148:0/3263288202 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f47f00d0530 con 0x7f47f8102240 2024-09-19T07:12:33.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.469+0000 7f47f6ffd640 1 -- 172.21.15.148:0/3647849852 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56500ecb7340 con 0x56500edac410 2024-09-19T07:12:33.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.469+0000 7f47f67fc640 1 --2- 172.21.15.148:0/3647849852 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56500edabaf0 0x56500edabed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:12:33.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.469+0000 7f47f6ffd640 1 --2- 172.21.15.148:0/3647849852 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56500edac410 0x56500edb6770 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f47e8009930 tx=0x7f47e8005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86d9aaa05d3fd70 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:33.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.469+0000 7f47f77fe640 1 --2- 172.21.15.148:0/3263288202 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f47e40a35b0 0x7f47e40a5a70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f47f00cdb30 tx=0x7f47f0005b40 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:33.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.469+0000 7f47ed7fa640 1 -- 172.21.15.148:0/3647849852 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e8040070 con 0x56500edac410 2024-09-19T07:12:33.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.469+0000 7f47ed7fa640 1 -- 172.21.15.148:0/3647849852 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47e80319f0 con 0x56500edac410 2024-09-19T07:12:33.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.469+0000 7f47ed7fa640 1 -- 172.21.15.148:0/3647849852 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e8035040 con 0x56500edac410 2024-09-19T07:12:33.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.470+0000 7f48003da740 1 -- 172.21.15.148:0/3647849852 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56500edac410 msgr2=0x56500edb6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:33.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.470+0000 7f48003da740 1 --2- 172.21.15.148:0/3647849852 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56500edac410 0x56500edb6770 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f47e8009930 tx=0x7f47e8005e80 comp rx=0 tx=0).stop 2024-09-19T07:12:33.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.470+0000 7f48003da740 1 -- 172.21.15.148:0/3647849852 shutdown_connections 2024-09-19T07:12:33.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.470+0000 7f48003da740 1 --2- 172.21.15.148:0/3647849852 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56500edb6cb0 0x56500edb90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:33.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.470+0000 7f48003da740 1 --2- 172.21.15.148:0/3647849852 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56500edac410 0x56500edb6770 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:33.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.470+0000 7f48003da740 1 --2- 172.21.15.148:0/3647849852 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56500edabaf0 0x56500edabed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:33.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.470+0000 7f48003da740 1 -- 172.21.15.148:0/3647849852 >> 172.21.15.148:0/3647849852 conn(0x56500eda8060 msgr2=0x56500eda8440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:33.480 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.470+0000 7f48003da740 1 -- 172.21.15.148:0/3647849852 shutdown_connections 2024-09-19T07:12:33.480 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.470+0000 7f48003da740 1 -- 172.21.15.148:0/3647849852 wait complete. 2024-09-19T07:12:33.480 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.470+0000 7f48003da740 1 -- start start 2024-09-19T07:12:33.480 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.470+0000 7f48003da740 1 Processor -- start 2024-09-19T07:12:33.480 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.471+0000 7f48003da740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56500edabaf0 0x56500edb3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:33.480 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.471+0000 7f48003da740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56500edac410 0x56500edb40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:33.480 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.471+0000 7f48003da740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56500edb6cb0 0x56500edb45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:33.480 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.471+0000 7f48003da740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56500edb9880 con 0x56500edabaf0 2024-09-19T07:12:33.480 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.471+0000 7f48003da740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56500ec99290 con 0x56500edb6cb0 2024-09-19T07:12:33.480 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.471+0000 7f48003da740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56500edb9a00 con 0x56500edac410 2024-09-19T07:12:33.480 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.471+0000 7f48003da740 10 client.0 _ll_register_callbacks cb 0x56500ecca140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:12:33.480 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.471+0000 7f47f67fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56500edabaf0 0x56500edb3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:33.481 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.471+0000 7f47f67fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56500edabaf0 0x56500edb3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60894/0 (socket says 172.21.15.148:60894) 2024-09-19T07:12:33.481 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.471+0000 7f47f67fc640 1 -- 172.21.15.148:0/870771210 learned_addr learned my addr 172.21.15.148:0/870771210 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:33.481 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.471+0000 7f47f6ffd640 1 --2- 172.21.15.148:0/870771210 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56500edac410 0x56500edb40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:33.481 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.471+0000 7f47f67fc640 1 --2- 172.21.15.148:0/870771210 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56500edb6cb0 0x56500edb45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:33.481 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.471+0000 7f47f67fc640 1 -- 172.21.15.148:0/870771210 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56500edac410 msgr2=0x56500edb40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:33.481 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.471+0000 7f47f67fc640 1 --2- 172.21.15.148:0/870771210 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56500edac410 0x56500edb40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:33.481 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.471+0000 7f47f67fc640 1 -- 172.21.15.148:0/870771210 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56500edb6cb0 msgr2=0x56500edb45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:33.481 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.471+0000 7f47f67fc640 1 --2- 172.21.15.148:0/870771210 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56500edb6cb0 0x56500edb45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:33.481 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.471+0000 7f47f67fc640 1 -- 172.21.15.148:0/870771210 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56500ea23210 con 0x56500edabaf0 2024-09-19T07:12:33.481 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.471+0000 7f47f67fc640 1 --2- 172.21.15.148:0/870771210 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56500edabaf0 0x56500edb3b60 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f47e0013a60 tx=0x7f47e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63025a16d2c93bce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:33.481 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.471+0000 7f47de7fc640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:12:33.481 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.471+0000 7f47de7fc640 1 -- 172.21.15.148:0/870771210 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e0011e10 con 0x56500edabaf0 2024-09-19T07:12:33.481 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.471+0000 7f47de7fc640 1 -- 172.21.15.148:0/870771210 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f47e0005020 con 0x56500edabaf0 2024-09-19T07:12:33.482 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.471+0000 7f48003da740 1 -- 172.21.15.148:0/870771210 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47e80319f0 con 0x56500edabaf0 2024-09-19T07:12:33.482 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.471+0000 7f47de7fc640 1 -- 172.21.15.148:0/870771210 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f47e0005220 con 0x56500edabaf0 2024-09-19T07:12:33.482 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.472+0000 7f48003da740 10 client.15702 fetch_fsmap learned FSMap version 25 2024-09-19T07:12:33.482 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.472+0000 7f48003da740 1 -- 172.21.15.148:0/870771210 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56500eaef620 con 0x56500edabaf0 2024-09-19T07:12:33.482 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.472+0000 7f47de7fc640 1 -- 172.21.15.148:0/870771210 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47e80319f0 con 0x56500edabaf0 2024-09-19T07:12:33.482 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.472+0000 7f47de7fc640 1 -- 172.21.15.148:0/870771210 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f47e001d030 con 0x56500edabaf0 2024-09-19T07:12:33.482 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.472+0000 7f48003da740 10 client.15702 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:12:33.482 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.472+0000 7f48003da740 10 client.15702 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:12:33.482 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.472+0000 7f48003da740 20 client.15702 populate_metadata read hostname 'smithi148' 2024-09-19T07:12:33.482 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.472+0000 7f48003da740 1 --2- 172.21.15.148:0/870771210 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56500edc6ba0 0x56500edc8f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:33.482 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.472+0000 7f48003da740 4 client.15702 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:12:33.482 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.472+0000 7f48003da740 1 -- 172.21.15.148:0/870771210 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56500ed1da20 con 0x56500edc6ba0 2024-09-19T07:12:33.482 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.472+0000 7f47f6ffd640 1 --2- 172.21.15.148:0/870771210 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56500edc6ba0 0x56500edc8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:33.482 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.473+0000 7f47de7fc640 10 client.15702 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:33.483 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.473+0000 7f47f6ffd640 1 --2- 172.21.15.148:0/870771210 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56500edc6ba0 0x56500edc8f90 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de6cac4de7992d30 server_cookie=444f7dbdec539df1 in_seq=0 out_seq=0 2024-09-19T07:12:33.483 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.473+0000 7f47de7fc640 1 -- 172.21.15.148:0/870771210 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56500ed1da20 con 0x56500edc6ba0 2024-09-19T07:12:33.483 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.473+0000 7f47de7fc640 10 client.15702 handle_command_reply: tid=0 2024-09-19T07:12:33.483 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.473+0000 7f48003da740 1 client.15702 shutdown 2024-09-19T07:12:33.483 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.473+0000 7f48003da740 1 -- 172.21.15.148:0/870771210 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56500edabaf0 msgr2=0x56500edb3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:33.483 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.473+0000 7f48003da740 1 --2- 172.21.15.148:0/870771210 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56500edabaf0 0x56500edb3b60 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f47e0013a60 tx=0x7f47e00046c0 comp rx=0 tx=0).stop 2024-09-19T07:12:33.483 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.473+0000 7f48003da740 1 -- 172.21.15.148:0/870771210 shutdown_connections 2024-09-19T07:12:33.483 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.473+0000 7f48003da740 1 --2- 172.21.15.148:0/870771210 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56500edc6ba0 0x56500edc8f90 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:33.483 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.473+0000 7f48003da740 1 --2- 172.21.15.148:0/870771210 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56500edb6cb0 0x56500edb45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:33.483 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.473+0000 7f47de7fc640 0 client.15702 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:33.483 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.473+0000 7f48003da740 1 --2- 172.21.15.148:0/870771210 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56500edac410 0x56500edb40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:33.483 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.473+0000 7f48003da740 1 --2- 172.21.15.148:0/870771210 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56500edabaf0 0x56500edb3b60 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:33.483 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.473+0000 7f48003da740 1 -- 172.21.15.148:0/870771210 >> 172.21.15.148:0/870771210 conn(0x56500eda8060 msgr2=0x56500edaddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:33.484 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.473+0000 7f48003da740 1 -- 172.21.15.148:0/870771210 shutdown_connections 2024-09-19T07:12:33.484 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.474+0000 7f48003da740 1 -- 172.21.15.148:0/870771210 wait complete. 2024-09-19T07:12:33.484 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.474+0000 7f48003da740 20 client.15702 trim_cache size 0 max 16384 2024-09-19T07:12:33.489 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.488+0000 7f48003da740 1 Processor -- start 2024-09-19T07:12:33.489 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.488+0000 7f48003da740 1 -- start start 2024-09-19T07:12:33.490 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.489+0000 7f48003da740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56500edabaf0 0x56500edb4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:33.490 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.489+0000 7f48003da740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56500edac410 0x56500edce810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:33.490 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.489+0000 7f48003da740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56500edb6cb0 0x56500edced50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:33.491 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.489+0000 7f48003da740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f47f81b2210 con 0x56500edabaf0 2024-09-19T07:12:33.491 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.489+0000 7f48003da740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f47f81afae0 con 0x56500edb6cb0 2024-09-19T07:12:33.491 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.489+0000 7f48003da740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f47f81ad910 con 0x56500edac410 2024-09-19T07:12:33.491 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.489+0000 7f47f67fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56500edabaf0 0x56500edb4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:33.491 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.489+0000 7f47f67fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56500edabaf0 0x56500edb4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60904/0 (socket says 172.21.15.148:60904) 2024-09-19T07:12:33.491 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.489+0000 7f47f67fc640 1 -- 172.21.15.148:0/336246566 learned_addr learned my addr 172.21.15.148:0/336246566 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:33.491 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.489+0000 7f47f6ffd640 1 --2- 172.21.15.148:0/336246566 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56500edac410 0x56500edce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:33.491 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.489+0000 7f47f67fc640 1 --2- 172.21.15.148:0/336246566 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56500edb6cb0 0x56500edced50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:33.491 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.489+0000 7f47f67fc640 1 -- 172.21.15.148:0/336246566 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56500edac410 msgr2=0x56500edce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:33.491 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.489+0000 7f47f67fc640 1 --2- 172.21.15.148:0/336246566 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56500edac410 0x56500edce810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:33.491 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.489+0000 7f47f67fc640 1 -- 172.21.15.148:0/336246566 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56500edb6cb0 msgr2=0x56500edced50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:33.491 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.489+0000 7f47f67fc640 1 --2- 172.21.15.148:0/336246566 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56500edb6cb0 0x56500edced50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:33.491 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.489+0000 7f47f67fc640 1 -- 172.21.15.148:0/336246566 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56500edab920 con 0x56500edabaf0 2024-09-19T07:12:33.491 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.490+0000 7f47f67fc640 1 --2- 172.21.15.148:0/336246566 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56500edabaf0 0x56500edb4410 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f47e000d790 tx=0x7f47e000d6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48d37e9246e89d80 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:33.492 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.490+0000 7f47ecff9640 1 -- 172.21.15.148:0/336246566 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e002d070 con 0x56500edabaf0 2024-09-19T07:12:33.492 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.490+0000 7f47ecff9640 1 -- 172.21.15.148:0/336246566 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47e00276a0 con 0x56500edabaf0 2024-09-19T07:12:33.492 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.490+0000 7f47ecff9640 1 -- 172.21.15.148:0/336246566 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e0027b40 con 0x56500edabaf0 2024-09-19T07:12:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.491+0000 7f48003da740 1 -- 172.21.15.148:0/336246566 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56500edabaf0 msgr2=0x56500edb4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.491+0000 7f48003da740 1 --2- 172.21.15.148:0/336246566 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56500edabaf0 0x56500edb4410 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f47e000d790 tx=0x7f47e000d6e0 comp rx=0 tx=0).stop 2024-09-19T07:12:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.491+0000 7f48003da740 1 -- 172.21.15.148:0/336246566 shutdown_connections 2024-09-19T07:12:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.491+0000 7f48003da740 1 --2- 172.21.15.148:0/336246566 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56500edb6cb0 0x56500edced50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.491+0000 7f48003da740 1 --2- 172.21.15.148:0/336246566 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56500edac410 0x56500edce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.491+0000 7f48003da740 1 --2- 172.21.15.148:0/336246566 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56500edabaf0 0x56500edb4410 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.491+0000 7f48003da740 1 -- 172.21.15.148:0/336246566 >> 172.21.15.148:0/336246566 conn(0x56500eda8060 msgr2=0x56500edb5be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.491+0000 7f48003da740 1 -- 172.21.15.148:0/336246566 shutdown_connections 2024-09-19T07:12:33.496 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.491+0000 7f48003da740 1 -- 172.21.15.148:0/336246566 wait complete. 2024-09-19T07:12:33.496 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.491+0000 7f48003da740 1 -- start start 2024-09-19T07:12:33.496 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.491+0000 7f48003da740 1 Processor -- start 2024-09-19T07:12:33.496 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.491+0000 7f48003da740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56500edabaf0 0x56500edbf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:33.496 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.491+0000 7f48003da740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56500edac410 0x56500edba7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:33.496 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.491+0000 7f48003da740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56500edb6cb0 0x56500edbad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:33.496 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.491+0000 7f48003da740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f47f81adfa0 con 0x56500edac410 2024-09-19T07:12:33.496 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.491+0000 7f48003da740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f47f81af410 con 0x56500edabaf0 2024-09-19T07:12:33.496 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.491+0000 7f48003da740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f47f81ae670 con 0x56500edb6cb0 2024-09-19T07:12:33.496 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.491+0000 7f48003da740 10 client.0 _ll_register_callbacks cb 0x7f47e000d8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:12:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.492+0000 7f47f6ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56500edac410 0x56500edba7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.492+0000 7f47f6ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56500edac410 0x56500edba7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60910/0 (socket says 172.21.15.148:60910) 2024-09-19T07:12:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.492+0000 7f47f6ffd640 1 -- 172.21.15.148:0/2804123108 learned_addr learned my addr 172.21.15.148:0/2804123108 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.492+0000 7f47f67fc640 1 --2- 172.21.15.148:0/2804123108 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56500edabaf0 0x56500edbf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.492+0000 7f47f67fc640 1 --2- 172.21.15.148:0/2804123108 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56500edb6cb0 0x56500edbad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.492+0000 7f47f6ffd640 1 -- 172.21.15.148:0/2804123108 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56500edb6cb0 msgr2=0x56500edbad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.492+0000 7f47f6ffd640 1 --2- 172.21.15.148:0/2804123108 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56500edb6cb0 0x56500edbad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.492+0000 7f47f6ffd640 1 -- 172.21.15.148:0/2804123108 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56500edabaf0 msgr2=0x56500edbf4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.492+0000 7f47f6ffd640 1 --2- 172.21.15.148:0/2804123108 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56500edabaf0 0x56500edbf4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.492+0000 7f47f6ffd640 1 -- 172.21.15.148:0/2804123108 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56500eda32d0 con 0x56500edac410 2024-09-19T07:12:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.492+0000 7f47f67fc640 1 --2- 172.21.15.148:0/2804123108 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56500edabaf0 0x56500edbf4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:12:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.492+0000 7f47f6ffd640 1 --2- 172.21.15.148:0/2804123108 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56500edac410 0x56500edba7d0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f47e8000c00 tx=0x7f47e8031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5f4eeebef129c0d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.492+0000 7f47de7fc640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:12:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.492+0000 7f47de7fc640 1 -- 172.21.15.148:0/2804123108 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e8053020 con 0x56500edac410 2024-09-19T07:12:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.492+0000 7f47de7fc640 1 -- 172.21.15.148:0/2804123108 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f47e8004450 con 0x56500edac410 2024-09-19T07:12:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.492+0000 7f48003da740 1 -- 172.21.15.148:0/2804123108 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47e00276a0 con 0x56500edac410 2024-09-19T07:12:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.492+0000 7f47de7fc640 1 -- 172.21.15.148:0/2804123108 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f47e805e050 con 0x56500edac410 2024-09-19T07:12:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.492+0000 7f48003da740 10 client.15708 fetch_fsmap learned FSMap version 25 2024-09-19T07:12:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.492+0000 7f48003da740 1 -- 172.21.15.148:0/2804123108 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56500eda7e90 con 0x56500edac410 2024-09-19T07:12:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.493+0000 7f47de7fc640 1 -- 172.21.15.148:0/2804123108 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47e00276a0 con 0x56500edac410 2024-09-19T07:12:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.493+0000 7f47de7fc640 1 -- 172.21.15.148:0/2804123108 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f47e804f6f0 con 0x56500edac410 2024-09-19T07:12:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.493+0000 7f48003da740 10 client.15708 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:12:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.493+0000 7f48003da740 10 client.15708 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:12:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.493+0000 7f48003da740 20 client.15708 populate_metadata read hostname 'smithi148' 2024-09-19T07:12:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.493+0000 7f48003da740 1 --2- 172.21.15.148:0/2804123108 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56500ee31980 0x56500ee33d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.493+0000 7f48003da740 4 client.15708 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:12:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.493+0000 7f48003da740 1 -- 172.21.15.148:0/2804123108 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56500ed17d70 con 0x56500ee31980 2024-09-19T07:12:33.499 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.493+0000 7f47f67fc640 1 --2- 172.21.15.148:0/2804123108 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56500ee31980 0x56500ee33d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:33.499 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.493+0000 7f47de7fc640 10 client.15708 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:33.499 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.493+0000 7f47f67fc640 1 --2- 172.21.15.148:0/2804123108 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56500ee31980 0x56500ee33d70 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4724db176cc5aade server_cookie=1bd5a1a7dd7a10c4 in_seq=0 out_seq=0 2024-09-19T07:12:33.501 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.500+0000 7f47de7fc640 1 -- 172.21.15.148:0/2804123108 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56500ed17d70 con 0x56500ee31980 2024-09-19T07:12:33.501 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.500+0000 7f47de7fc640 10 client.15708 handle_command_reply: tid=0 2024-09-19T07:12:33.501 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.500+0000 7f48003da740 1 client.15708 shutdown 2024-09-19T07:12:33.501 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.500+0000 7f48003da740 1 -- 172.21.15.148:0/2804123108 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56500edac410 msgr2=0x56500edba7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:33.501 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.500+0000 7f48003da740 1 --2- 172.21.15.148:0/2804123108 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56500edac410 0x56500edba7d0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f47e8000c00 tx=0x7f47e8031400 comp rx=0 tx=0).stop 2024-09-19T07:12:33.501 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.500+0000 7f48003da740 1 -- 172.21.15.148:0/2804123108 shutdown_connections 2024-09-19T07:12:33.501 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.500+0000 7f48003da740 1 --2- 172.21.15.148:0/2804123108 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56500ee31980 0x56500ee33d70 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:33.501 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.500+0000 7f48003da740 1 --2- 172.21.15.148:0/2804123108 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56500edb6cb0 0x56500edbad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:33.501 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.500+0000 7f48003da740 1 --2- 172.21.15.148:0/2804123108 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56500edac410 0x56500edba7d0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:33.502 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.500+0000 7f48003da740 1 --2- 172.21.15.148:0/2804123108 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56500edabaf0 0x56500edbf4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:33.502 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.500+0000 7f47de7fc640 0 client.15708 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:33.502 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.500+0000 7f48003da740 1 -- 172.21.15.148:0/2804123108 >> 172.21.15.148:0/2804123108 conn(0x56500eda8060 msgr2=0x56500eda69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:33.502 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.500+0000 7f48003da740 1 -- 172.21.15.148:0/2804123108 shutdown_connections 2024-09-19T07:12:33.502 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.500+0000 7f48003da740 1 -- 172.21.15.148:0/2804123108 wait complete. 2024-09-19T07:12:33.502 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.500+0000 7f48003da740 20 client.15708 trim_cache size 0 max 16384 2024-09-19T07:12:33.502 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:12:33.502 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:12:33.502 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:12:33.502 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:12:33.503 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.501+0000 7f47fd568640 1 -- 172.21.15.148:0/3263288202 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f47e40a35b0 msgr2=0x7f47e40a5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:33.503 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.501+0000 7f47fd568640 1 --2- 172.21.15.148:0/3263288202 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f47e40a35b0 0x7f47e40a5a70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f47f00cdb30 tx=0x7f47f0005b40 comp rx=0 tx=0).stop 2024-09-19T07:12:33.503 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.501+0000 7f47fd568640 1 -- 172.21.15.148:0/3263288202 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47f8102240 msgr2=0x7f47f81a64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:33.503 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.501+0000 7f47fd568640 1 --2- 172.21.15.148:0/3263288202 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47f8102240 0x7f47f81a64d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f47f000eb10 tx=0x7f47f000c2d0 comp rx=0 tx=0).stop 2024-09-19T07:12:33.504 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.501+0000 7f47fd568640 1 -- 172.21.15.148:0/3263288202 shutdown_connections 2024-09-19T07:12:33.504 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.501+0000 7f47fd568640 1 --2- 172.21.15.148:0/3263288202 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f47e40a35b0 0x7f47e40a5a70 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:33.504 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.501+0000 7f47fd568640 1 --2- 172.21.15.148:0/3263288202 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47f8102240 0x7f47f81a64d0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:33.504 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.501+0000 7f47fd568640 1 --2- 172.21.15.148:0/3263288202 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f47f8108110 0x7f47f8101d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:33.504 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.501+0000 7f47fd568640 1 --2- 172.21.15.148:0/3263288202 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47f8100850 0x7f47f81017c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:33.504 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.501+0000 7f47fd568640 1 -- 172.21.15.148:0/3263288202 >> 172.21.15.148:0/3263288202 conn(0x7f47f8075db0 msgr2=0x7f47f80ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:33.504 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.501+0000 7f47fd568640 1 -- 172.21.15.148:0/3263288202 shutdown_connections 2024-09-19T07:12:33.504 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:33.501+0000 7f47fd568640 1 -- 172.21.15.148:0/3263288202 wait complete. 2024-09-19T07:12:34.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:34 smithi165 ceph-mon[35326]: pgmap v48: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-19T07:12:34.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:34 smithi179 ceph-mon[35716]: pgmap v48: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-19T07:12:34.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:34 smithi148 ceph-mon[31180]: pgmap v48: 97 pgs: 97 active+clean; 1.3 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-19T07:12:34.871 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T07:12:35.135 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:12:35.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.620+0000 7fd2f0362640 1 -- 172.21.15.148:0/1954663579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2e8106a80 msgr2=0x7fd2e8106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:35.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.620+0000 7fd2f0362640 1 --2- 172.21.15.148:0/1954663579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2e8106a80 0x7fd2e8106e60 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4009930 tx=0x7fd2e402a420 comp rx=0 tx=0).stop 2024-09-19T07:12:35.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.620+0000 7fd2f0362640 1 -- 172.21.15.148:0/1954663579 shutdown_connections 2024-09-19T07:12:35.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.620+0000 7fd2f0362640 1 --2- 172.21.15.148:0/1954663579 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2e8101420 0x7fd2e810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:35.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.620+0000 7fd2f0362640 1 --2- 172.21.15.148:0/1954663579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2e8100a80 0x7fd2e8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:35.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.620+0000 7fd2f0362640 1 --2- 172.21.15.148:0/1954663579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2e8106a80 0x7fd2e8106e60 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:35.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.620+0000 7fd2f0362640 1 -- 172.21.15.148:0/1954663579 >> 172.21.15.148:0/1954663579 conn(0x7fd2e80fc7a0 msgr2=0x7fd2e80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:35.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.620+0000 7fd2f0362640 1 -- 172.21.15.148:0/1954663579 shutdown_connections 2024-09-19T07:12:35.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.620+0000 7fd2f0362640 1 -- 172.21.15.148:0/1954663579 wait complete. 2024-09-19T07:12:35.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.621+0000 7fd2f0362640 1 Processor -- start 2024-09-19T07:12:35.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.621+0000 7fd2f0362640 1 -- start start 2024-09-19T07:12:35.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.621+0000 7fd2f0362640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2e8100a80 0x7fd2e8197380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:35.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.621+0000 7fd2f0362640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2e8101420 0x7fd2e81978c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:35.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.621+0000 7fd2f0362640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2e8106a80 0x7fd2e819bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:35.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.621+0000 7fd2f0362640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e8110e80 con 0x7fd2e8100a80 2024-09-19T07:12:35.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.621+0000 7fd2f0362640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e8110d00 con 0x7fd2e8101420 2024-09-19T07:12:35.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.621+0000 7fd2f0362640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e8111000 con 0x7fd2e8106a80 2024-09-19T07:12:35.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.621+0000 7fd2ee0fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2e8100a80 0x7fd2e8197380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:35.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.621+0000 7fd2ee0fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2e8100a80 0x7fd2e8197380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39564/0 (socket says 172.21.15.148:39564) 2024-09-19T07:12:35.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.621+0000 7fd2ee0fe640 1 -- 172.21.15.148:0/2370724308 learned_addr learned my addr 172.21.15.148:0/2370724308 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:35.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.621+0000 7fd2ee8ff640 1 --2- 172.21.15.148:0/2370724308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2e8106a80 0x7fd2e819bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:35.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.622+0000 7fd2ed8fd640 1 --2- 172.21.15.148:0/2370724308 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2e8101420 0x7fd2e81978c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:35.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.622+0000 7fd2ee0fe640 1 -- 172.21.15.148:0/2370724308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2e8106a80 msgr2=0x7fd2e819bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:35.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.622+0000 7fd2ee0fe640 1 --2- 172.21.15.148:0/2370724308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2e8106a80 0x7fd2e819bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:35.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.622+0000 7fd2ee0fe640 1 -- 172.21.15.148:0/2370724308 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2e8101420 msgr2=0x7fd2e81978c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:35.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.622+0000 7fd2ee0fe640 1 --2- 172.21.15.148:0/2370724308 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2e8101420 0x7fd2e81978c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:35.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.622+0000 7fd2ee0fe640 1 -- 172.21.15.148:0/2370724308 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2e819c330 con 0x7fd2e8100a80 2024-09-19T07:12:35.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.622+0000 7fd2ed8fd640 1 --2- 172.21.15.148:0/2370724308 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2e8101420 0x7fd2e81978c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:12:35.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.622+0000 7fd2ee0fe640 1 --2- 172.21.15.148:0/2370724308 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2e8100a80 0x7fd2e8197380 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4009230 tx=0x7fd2e4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:35.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.622+0000 7fd2df7fe640 1 -- 172.21.15.148:0/2370724308 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e4046070 con 0x7fd2e8100a80 2024-09-19T07:12:35.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.622+0000 7fd2df7fe640 1 -- 172.21.15.148:0/2370724308 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2e4003ad0 con 0x7fd2e8100a80 2024-09-19T07:12:35.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.622+0000 7fd2f0362640 1 -- 172.21.15.148:0/2370724308 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2e819c5c0 con 0x7fd2e8100a80 2024-09-19T07:12:35.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.622+0000 7fd2df7fe640 1 -- 172.21.15.148:0/2370724308 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e4035050 con 0x7fd2e8100a80 2024-09-19T07:12:35.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.622+0000 7fd2f0362640 1 -- 172.21.15.148:0/2370724308 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2e806a790 con 0x7fd2e8100a80 2024-09-19T07:12:35.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.625+0000 7fd2df7fe640 1 -- 172.21.15.148:0/2370724308 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fd2e4049070 con 0x7fd2e8100a80 2024-09-19T07:12:35.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.625+0000 7fd2f273b740 1 Processor -- start 2024-09-19T07:12:35.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.625+0000 7fd2f273b740 1 -- start start 2024-09-19T07:12:35.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.626+0000 7fd2f273b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d13e2c14a0 0x55d13e2c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:35.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.626+0000 7fd2f273b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d13e2c1dc0 0x55d13e2cc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:35.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.626+0000 7fd2f273b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d13e2cc680 0x55d13e2cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:35.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.626+0000 7fd2f273b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55d13e2272e0 con 0x55d13e2cc680 2024-09-19T07:12:35.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.626+0000 7fd2f273b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55d13e1cece0 con 0x55d13e2c14a0 2024-09-19T07:12:35.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.626+0000 7fd2f273b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d13e2232a0 con 0x55d13e2c1dc0 2024-09-19T07:12:35.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.626+0000 7fd2ed8fd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d13e2cc680 0x55d13e2cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:35.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.626+0000 7fd2ee0fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d13e2c1dc0 0x55d13e2cc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:35.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.626+0000 7fd2ed8fd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d13e2cc680 0x55d13e2cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39578/0 (socket says 172.21.15.148:39578) 2024-09-19T07:12:35.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.626+0000 7fd2ed8fd640 1 -- 172.21.15.148:0/2547466848 learned_addr learned my addr 172.21.15.148:0/2547466848 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:35.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.626+0000 7fd2ee8ff640 1 --2- 172.21.15.148:0/2547466848 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d13e2c14a0 0x55d13e2c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:35.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.626+0000 7fd2df7fe640 1 --2- 172.21.15.148:0/2370724308 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fd2d40a33b0 0x7fd2d40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:35.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.626+0000 7fd2ed8fd640 1 -- 172.21.15.148:0/2547466848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d13e2c1dc0 msgr2=0x55d13e2cc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:35.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.626+0000 7fd2ed8fd640 1 --2- 172.21.15.148:0/2547466848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d13e2c1dc0 0x55d13e2cc140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:35.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.626+0000 7fd2ed8fd640 1 -- 172.21.15.148:0/2547466848 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d13e2c14a0 msgr2=0x55d13e2c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:35.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.626+0000 7fd2ed8fd640 1 --2- 172.21.15.148:0/2547466848 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d13e2c14a0 0x55d13e2c1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:35.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.626+0000 7fd2ed8fd640 1 -- 172.21.15.148:0/2547466848 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d13e1b3440 con 0x55d13e2cc680 2024-09-19T07:12:35.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.626+0000 7fd2ee8ff640 1 --2- 172.21.15.148:0/2370724308 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fd2d40a33b0 0x7fd2d40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:35.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.626+0000 7fd2df7fe640 1 -- 172.21.15.148:0/2370724308 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fd2e40f18c0 con 0x7fd2e8100a80 2024-09-19T07:12:35.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.626+0000 7fd2ed8fd640 1 --2- 172.21.15.148:0/2547466848 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d13e2cc680 0x55d13e2cea70 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd2d800bd30 tx=0x7fd2d800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37d0c5f2f7a54dcb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:35.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.627+0000 7fd2dcdea640 1 -- 172.21.15.148:0/2547466848 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8015070 con 0x55d13e2cc680 2024-09-19T07:12:35.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.627+0000 7fd2dcdea640 1 -- 172.21.15.148:0/2547466848 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2d800be20 con 0x55d13e2cc680 2024-09-19T07:12:35.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.627+0000 7fd2dcdea640 1 -- 172.21.15.148:0/2547466848 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8011a10 con 0x55d13e2cc680 2024-09-19T07:12:35.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.627+0000 7fd2f273b740 1 -- 172.21.15.148:0/2547466848 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d13e2cc680 msgr2=0x55d13e2cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:35.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.627+0000 7fd2ee8ff640 1 --2- 172.21.15.148:0/2370724308 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fd2d40a33b0 0x7fd2d40a5870 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0005fd0 tx=0x7fd2e0004a40 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:35.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.627+0000 7fd2f273b740 1 --2- 172.21.15.148:0/2547466848 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d13e2cc680 0x55d13e2cea70 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd2d800bd30 tx=0x7fd2d800f730 comp rx=0 tx=0).stop 2024-09-19T07:12:35.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.627+0000 7fd2f273b740 1 -- 172.21.15.148:0/2547466848 shutdown_connections 2024-09-19T07:12:35.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.627+0000 7fd2f273b740 1 --2- 172.21.15.148:0/2547466848 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d13e2cc680 0x55d13e2cea70 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:35.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.627+0000 7fd2f273b740 1 --2- 172.21.15.148:0/2547466848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d13e2c1dc0 0x55d13e2cc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:35.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.627+0000 7fd2f273b740 1 --2- 172.21.15.148:0/2547466848 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d13e2c14a0 0x55d13e2c1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:35.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.627+0000 7fd2f273b740 1 -- 172.21.15.148:0/2547466848 >> 172.21.15.148:0/2547466848 conn(0x55d13e2bda30 msgr2=0x55d13e2bde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:35.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.627+0000 7fd2f273b740 1 -- 172.21.15.148:0/2547466848 shutdown_connections 2024-09-19T07:12:35.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.627+0000 7fd2f273b740 1 -- 172.21.15.148:0/2547466848 wait complete. 2024-09-19T07:12:35.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.628+0000 7fd2f273b740 1 -- start start 2024-09-19T07:12:35.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.628+0000 7fd2f273b740 1 Processor -- start 2024-09-19T07:12:35.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.628+0000 7fd2f273b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d13e2c14a0 0x55d13e2cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:35.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.628+0000 7fd2f273b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d13e2c1dc0 0x55d13e2c9200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:35.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.628+0000 7fd2f273b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d13e2cc680 0x55d13e2c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:35.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.628+0000 7fd2f273b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55d13e2cf250 con 0x55d13e2cc680 2024-09-19T07:12:35.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.628+0000 7fd2f273b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55d13e1e2050 con 0x55d13e2c1dc0 2024-09-19T07:12:35.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.628+0000 7fd2f273b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d13e2cf3d0 con 0x55d13e2c14a0 2024-09-19T07:12:35.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.628+0000 7fd2f273b740 10 client.0 _ll_register_callbacks cb 0x55d13e222160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:12:35.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.628+0000 7fd2ee8ff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d13e2cc680 0x55d13e2c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:35.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.628+0000 7fd2ee8ff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d13e2cc680 0x55d13e2c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39582/0 (socket says 172.21.15.148:39582) 2024-09-19T07:12:35.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.628+0000 7fd2ee8ff640 1 -- 172.21.15.148:0/3608575747 learned_addr learned my addr 172.21.15.148:0/3608575747 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:35.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.629+0000 7fd2ed8fd640 1 --2- 172.21.15.148:0/3608575747 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d13e2c1dc0 0x55d13e2c9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:35.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.629+0000 7fd2ee0fe640 1 --2- 172.21.15.148:0/3608575747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d13e2c14a0 0x55d13e2cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:35.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.629+0000 7fd2ee8ff640 1 -- 172.21.15.148:0/3608575747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d13e2c14a0 msgr2=0x55d13e2cbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:35.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.629+0000 7fd2ee8ff640 1 --2- 172.21.15.148:0/3608575747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d13e2c14a0 0x55d13e2cbf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:35.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.629+0000 7fd2ee8ff640 1 -- 172.21.15.148:0/3608575747 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d13e2c1dc0 msgr2=0x55d13e2c9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:35.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.629+0000 7fd2ee8ff640 1 --2- 172.21.15.148:0/3608575747 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d13e2c1dc0 0x55d13e2c9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:35.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.629+0000 7fd2ee8ff640 1 -- 172.21.15.148:0/3608575747 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d13df983c0 con 0x55d13e2cc680 2024-09-19T07:12:35.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.629+0000 7fd2ee8ff640 1 --2- 172.21.15.148:0/3608575747 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d13e2cc680 0x55d13e2c9740 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd2e00126f0 tx=0x7fd2e0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11663ded593ec2a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:35.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.629+0000 7fd2d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:12:35.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.629+0000 7fd2d1ffb640 1 -- 172.21.15.148:0/3608575747 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e00107d0 con 0x55d13e2cc680 2024-09-19T07:12:35.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.629+0000 7fd2d1ffb640 1 -- 172.21.15.148:0/3608575747 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fd2e0010970 con 0x55d13e2cc680 2024-09-19T07:12:35.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.629+0000 7fd2f273b740 1 -- 172.21.15.148:0/3608575747 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2d800be20 con 0x55d13e2cc680 2024-09-19T07:12:35.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.629+0000 7fd2d1ffb640 1 -- 172.21.15.148:0/3608575747 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd2e0030050 con 0x55d13e2cc680 2024-09-19T07:12:35.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.629+0000 7fd2f273b740 10 client.15720 fetch_fsmap learned FSMap version 25 2024-09-19T07:12:35.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.629+0000 7fd2f273b740 1 -- 172.21.15.148:0/3608575747 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d13e2dac50 con 0x55d13e2cc680 2024-09-19T07:12:35.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.629+0000 7fd2d1ffb640 1 -- 172.21.15.148:0/3608575747 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2d800be20 con 0x55d13e2cc680 2024-09-19T07:12:35.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.630+0000 7fd2d1ffb640 1 -- 172.21.15.148:0/3608575747 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd2e000f040 con 0x55d13e2cc680 2024-09-19T07:12:35.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.630+0000 7fd2f273b740 10 client.15720 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:12:35.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.630+0000 7fd2f273b740 10 client.15720 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:12:35.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.630+0000 7fd2f273b740 20 client.15720 populate_metadata read hostname 'smithi148' 2024-09-19T07:12:35.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.630+0000 7fd2f273b740 1 --2- 172.21.15.148:0/3608575747 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55d13e2dc110 0x55d13e2de5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:35.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.630+0000 7fd2f273b740 4 client.15720 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:12:35.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.630+0000 7fd2f273b740 1 -- 172.21.15.148:0/3608575747 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d13e234850 con 0x55d13e2dc110 2024-09-19T07:12:35.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.630+0000 7fd2ee0fe640 1 --2- 172.21.15.148:0/3608575747 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55d13e2dc110 0x55d13e2de5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:35.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.630+0000 7fd2ee0fe640 1 --2- 172.21.15.148:0/3608575747 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55d13e2dc110 0x55d13e2de5b0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be31a00adf40b476 server_cookie=f760658055d1e887 in_seq=0 out_seq=0 2024-09-19T07:12:35.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.630+0000 7fd2d1ffb640 10 client.15720 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:35.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.631+0000 7fd2d1ffb640 1 -- 172.21.15.148:0/3608575747 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d13e234850 con 0x55d13e2dc110 2024-09-19T07:12:35.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.631+0000 7fd2d1ffb640 10 client.15720 handle_command_reply: tid=0 2024-09-19T07:12:35.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.631+0000 7fd2f273b740 1 client.15720 shutdown 2024-09-19T07:12:35.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.631+0000 7fd2f273b740 1 -- 172.21.15.148:0/3608575747 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d13e2cc680 msgr2=0x55d13e2c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:35.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.631+0000 7fd2f273b740 1 --2- 172.21.15.148:0/3608575747 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d13e2cc680 0x55d13e2c9740 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd2e00126f0 tx=0x7fd2e0004ab0 comp rx=0 tx=0).stop 2024-09-19T07:12:35.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.631+0000 7fd2f273b740 1 -- 172.21.15.148:0/3608575747 shutdown_connections 2024-09-19T07:12:35.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.631+0000 7fd2f273b740 1 --2- 172.21.15.148:0/3608575747 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55d13e2dc110 0x55d13e2de5b0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:35.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.631+0000 7fd2d1ffb640 0 client.15720 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:35.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.631+0000 7fd2f273b740 1 --2- 172.21.15.148:0/3608575747 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d13e2cc680 0x55d13e2c9740 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:35.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.631+0000 7fd2f273b740 1 --2- 172.21.15.148:0/3608575747 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d13e2c1dc0 0x55d13e2c9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:35.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.631+0000 7fd2f273b740 1 --2- 172.21.15.148:0/3608575747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d13e2c14a0 0x55d13e2cbf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:35.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.631+0000 7fd2f273b740 1 -- 172.21.15.148:0/3608575747 >> 172.21.15.148:0/3608575747 conn(0x55d13e2bda30 msgr2=0x55d13e2c3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:35.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.631+0000 7fd2f273b740 1 -- 172.21.15.148:0/3608575747 shutdown_connections 2024-09-19T07:12:35.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.631+0000 7fd2f273b740 1 -- 172.21.15.148:0/3608575747 wait complete. 2024-09-19T07:12:35.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.631+0000 7fd2f273b740 20 client.15720 trim_cache size 0 max 16384 2024-09-19T07:12:35.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.648+0000 7fd2f273b740 1 Processor -- start 2024-09-19T07:12:35.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.648+0000 7fd2f273b740 1 -- start start 2024-09-19T07:12:35.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.648+0000 7fd2f273b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d13e2bda30 0x55d13e2d84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:35.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.648+0000 7fd2f273b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d13e2c14a0 0x55d13e2c4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:35.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.648+0000 7fd2f273b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d13e2c1dc0 0x55d13e2e3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:35.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.648+0000 7fd2f273b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e81addf0 con 0x55d13e2bda30 2024-09-19T07:12:35.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.648+0000 7fd2f273b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e81ab6c0 con 0x55d13e2c1dc0 2024-09-19T07:12:35.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.648+0000 7fd2f273b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e81a94f0 con 0x55d13e2c14a0 2024-09-19T07:12:35.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.648+0000 7fd2ee0fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d13e2bda30 0x55d13e2d84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:35.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.648+0000 7fd2ee0fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d13e2bda30 0x55d13e2d84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39598/0 (socket says 172.21.15.148:39598) 2024-09-19T07:12:35.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.648+0000 7fd2ee0fe640 1 -- 172.21.15.148:0/2412575867 learned_addr learned my addr 172.21.15.148:0/2412575867 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:35.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.649+0000 7fd2ee8ff640 1 --2- 172.21.15.148:0/2412575867 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d13e2c1dc0 0x55d13e2e3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:35.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.649+0000 7fd2ed8fd640 1 --2- 172.21.15.148:0/2412575867 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d13e2c14a0 0x55d13e2c4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:35.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.649+0000 7fd2ee0fe640 1 -- 172.21.15.148:0/2412575867 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d13e2c14a0 msgr2=0x55d13e2c4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:35.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.649+0000 7fd2ee0fe640 1 --2- 172.21.15.148:0/2412575867 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d13e2c14a0 0x55d13e2c4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:35.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.649+0000 7fd2ee0fe640 1 -- 172.21.15.148:0/2412575867 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d13e2c1dc0 msgr2=0x55d13e2e3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:35.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.649+0000 7fd2ee0fe640 1 --2- 172.21.15.148:0/2412575867 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d13e2c1dc0 0x55d13e2e3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:35.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.649+0000 7fd2ee0fe640 1 -- 172.21.15.148:0/2412575867 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d13e2beba0 con 0x55d13e2bda30 2024-09-19T07:12:35.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.649+0000 7fd2ed8fd640 1 --2- 172.21.15.148:0/2412575867 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d13e2c14a0 0x55d13e2c4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:12:35.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.649+0000 7fd2ee8ff640 1 --2- 172.21.15.148:0/2412575867 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d13e2c1dc0 0x55d13e2e3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:12:35.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.649+0000 7fd2ee0fe640 1 --2- 172.21.15.148:0/2412575867 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d13e2bda30 0x55d13e2d84b0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fd2e40ba580 tx=0x7fd2e40f7530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6710dc216b867826 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:35.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.649+0000 7fd2d3fff640 1 -- 172.21.15.148:0/2412575867 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e40bd6f0 con 0x55d13e2bda30 2024-09-19T07:12:35.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.649+0000 7fd2d3fff640 1 -- 172.21.15.148:0/2412575867 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2e40be2b0 con 0x55d13e2bda30 2024-09-19T07:12:35.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.649+0000 7fd2d3fff640 1 -- 172.21.15.148:0/2412575867 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e40bd510 con 0x55d13e2bda30 2024-09-19T07:12:35.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.650+0000 7fd2f273b740 1 -- 172.21.15.148:0/2412575867 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d13e2bda30 msgr2=0x55d13e2d84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:35.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.650+0000 7fd2f273b740 1 --2- 172.21.15.148:0/2412575867 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d13e2bda30 0x55d13e2d84b0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fd2e40ba580 tx=0x7fd2e40f7530 comp rx=0 tx=0).stop 2024-09-19T07:12:35.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.650+0000 7fd2f273b740 1 -- 172.21.15.148:0/2412575867 shutdown_connections 2024-09-19T07:12:35.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.650+0000 7fd2f273b740 1 --2- 172.21.15.148:0/2412575867 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d13e2c1dc0 0x55d13e2e3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:35.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.650+0000 7fd2f273b740 1 --2- 172.21.15.148:0/2412575867 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d13e2c14a0 0x55d13e2c4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:35.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.650+0000 7fd2f273b740 1 --2- 172.21.15.148:0/2412575867 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d13e2bda30 0x55d13e2d84b0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:35.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.650+0000 7fd2f273b740 1 -- 172.21.15.148:0/2412575867 >> 172.21.15.148:0/2412575867 conn(0x55d13e2c98a0 msgr2=0x55d13e2c4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:35.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.650+0000 7fd2f273b740 1 -- 172.21.15.148:0/2412575867 shutdown_connections 2024-09-19T07:12:35.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.650+0000 7fd2f273b740 1 -- 172.21.15.148:0/2412575867 wait complete. 2024-09-19T07:12:35.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.650+0000 7fd2f273b740 1 -- start start 2024-09-19T07:12:35.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.650+0000 7fd2f273b740 1 Processor -- start 2024-09-19T07:12:35.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.650+0000 7fd2f273b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d13e2bda30 0x55d13e2d4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:35.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.650+0000 7fd2f273b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d13e2c14a0 0x55d13e2d0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:35.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.650+0000 7fd2f273b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d13e2c1dc0 0x55d13e2d0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:35.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.650+0000 7fd2f273b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e81a9b80 con 0x55d13e2c14a0 2024-09-19T07:12:35.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.650+0000 7fd2f273b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e81aaff0 con 0x55d13e2bda30 2024-09-19T07:12:35.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.650+0000 7fd2f273b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e81aa250 con 0x55d13e2c1dc0 2024-09-19T07:12:35.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.650+0000 7fd2f273b740 10 client.0 _ll_register_callbacks cb 0x7fd2e0004860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:12:35.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.650+0000 7fd2ed8fd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d13e2c14a0 0x55d13e2d0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:35.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.650+0000 7fd2ed8fd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d13e2c14a0 0x55d13e2d0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39600/0 (socket says 172.21.15.148:39600) 2024-09-19T07:12:35.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.650+0000 7fd2ed8fd640 1 -- 172.21.15.148:0/1607269996 learned_addr learned my addr 172.21.15.148:0/1607269996 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:35.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.650+0000 7fd2ee8ff640 1 --2- 172.21.15.148:0/1607269996 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d13e2c1dc0 0x55d13e2d0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:35.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.651+0000 7fd2ee0fe640 1 --2- 172.21.15.148:0/1607269996 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d13e2bda30 0x55d13e2d4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:35.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.651+0000 7fd2ed8fd640 1 -- 172.21.15.148:0/1607269996 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d13e2c1dc0 msgr2=0x55d13e2d0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:35.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.651+0000 7fd2ed8fd640 1 --2- 172.21.15.148:0/1607269996 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d13e2c1dc0 0x55d13e2d0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:35.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.651+0000 7fd2ed8fd640 1 -- 172.21.15.148:0/1607269996 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d13e2bda30 msgr2=0x55d13e2d4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:35.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.651+0000 7fd2ed8fd640 1 --2- 172.21.15.148:0/1607269996 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d13e2bda30 0x55d13e2d4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:35.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.651+0000 7fd2ed8fd640 1 -- 172.21.15.148:0/1607269996 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d13e2d0ec0 con 0x55d13e2c14a0 2024-09-19T07:12:35.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.651+0000 7fd2ee8ff640 1 --2- 172.21.15.148:0/1607269996 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d13e2c1dc0 0x55d13e2d0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:12:35.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.651+0000 7fd2ed8fd640 1 --2- 172.21.15.148:0/1607269996 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d13e2c14a0 0x55d13e2d0130 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fd2d800b450 tx=0x7fd2d800ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f481eac8a8b64465 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:35.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.651+0000 7fd2d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:12:35.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.651+0000 7fd2d1ffb640 1 -- 172.21.15.148:0/1607269996 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8015040 con 0x55d13e2c14a0 2024-09-19T07:12:35.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.651+0000 7fd2d1ffb640 1 -- 172.21.15.148:0/1607269996 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fd2d8005450 con 0x55d13e2c14a0 2024-09-19T07:12:35.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.651+0000 7fd2f273b740 1 -- 172.21.15.148:0/1607269996 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2e40be2b0 con 0x55d13e2c14a0 2024-09-19T07:12:35.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.651+0000 7fd2d1ffb640 1 -- 172.21.15.148:0/1607269996 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd2d8032050 con 0x55d13e2c14a0 2024-09-19T07:12:35.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.651+0000 7fd2f273b740 10 client.15726 fetch_fsmap learned FSMap version 25 2024-09-19T07:12:35.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.651+0000 7fd2f273b740 1 -- 172.21.15.148:0/1607269996 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d13e346ee0 con 0x55d13e2c14a0 2024-09-19T07:12:35.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.651+0000 7fd2d1ffb640 1 -- 172.21.15.148:0/1607269996 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2e40be2b0 con 0x55d13e2c14a0 2024-09-19T07:12:35.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.652+0000 7fd2d1ffb640 1 -- 172.21.15.148:0/1607269996 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd2d80117f0 con 0x55d13e2c14a0 2024-09-19T07:12:35.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.652+0000 7fd2f273b740 10 client.15726 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:12:35.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.652+0000 7fd2f273b740 10 client.15726 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:12:35.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.652+0000 7fd2f273b740 20 client.15726 populate_metadata read hostname 'smithi148' 2024-09-19T07:12:35.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.652+0000 7fd2f273b740 1 --2- 172.21.15.148:0/1607269996 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55d13e2cc680 0x55d13e3493e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:35.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.652+0000 7fd2f273b740 4 client.15726 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T07:12:35.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.652+0000 7fd2f273b740 1 -- 172.21.15.148:0/1607269996 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d13e22ed60 con 0x55d13e2cc680 2024-09-19T07:12:35.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.652+0000 7fd2ee0fe640 1 --2- 172.21.15.148:0/1607269996 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55d13e2cc680 0x55d13e3493e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:35.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.652+0000 7fd2d1ffb640 10 client.15726 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:35.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.652+0000 7fd2ee0fe640 1 --2- 172.21.15.148:0/1607269996 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55d13e2cc680 0x55d13e3493e0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=500bd939b3968fd3 server_cookie=42a15c97d507953c in_seq=0 out_seq=0 2024-09-19T07:12:35.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.652+0000 7fd2d1ffb640 1 -- 172.21.15.148:0/1607269996 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55d13e22ed60 con 0x55d13e2cc680 2024-09-19T07:12:35.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.652+0000 7fd2d1ffb640 10 client.15726 handle_command_reply: tid=0 2024-09-19T07:12:35.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.652+0000 7fd2f273b740 1 client.15726 shutdown 2024-09-19T07:12:35.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.653+0000 7fd2f273b740 1 -- 172.21.15.148:0/1607269996 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d13e2c14a0 msgr2=0x55d13e2d0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:35.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.653+0000 7fd2f273b740 1 --2- 172.21.15.148:0/1607269996 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d13e2c14a0 0x55d13e2d0130 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fd2d800b450 tx=0x7fd2d800ba70 comp rx=0 tx=0).stop 2024-09-19T07:12:35.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.653+0000 7fd2f273b740 1 -- 172.21.15.148:0/1607269996 shutdown_connections 2024-09-19T07:12:35.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.653+0000 7fd2f273b740 1 --2- 172.21.15.148:0/1607269996 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55d13e2cc680 0x55d13e3493e0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:35.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.653+0000 7fd2f273b740 1 --2- 172.21.15.148:0/1607269996 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d13e2c1dc0 0x55d13e2d0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:35.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.653+0000 7fd2f273b740 1 --2- 172.21.15.148:0/1607269996 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d13e2c14a0 0x55d13e2d0130 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:35.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.653+0000 7fd2f273b740 1 --2- 172.21.15.148:0/1607269996 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d13e2bda30 0x55d13e2d4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:35.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.653+0000 7fd2f273b740 1 -- 172.21.15.148:0/1607269996 >> 172.21.15.148:0/1607269996 conn(0x55d13e2c98a0 msgr2=0x55d13e2cb280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:35.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.653+0000 7fd2d1ffb640 0 client.15726 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:35.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.653+0000 7fd2f273b740 1 -- 172.21.15.148:0/1607269996 shutdown_connections 2024-09-19T07:12:35.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.653+0000 7fd2f273b740 1 -- 172.21.15.148:0/1607269996 wait complete. 2024-09-19T07:12:35.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.653+0000 7fd2f273b740 20 client.15726 trim_cache size 0 max 16384 2024-09-19T07:12:35.665 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:12:35.666 INFO:teuthology.orchestra.run.smithi148.stdout: "status": "no active scrubs running", 2024-09-19T07:12:35.666 INFO:teuthology.orchestra.run.smithi148.stdout: "scrubs": {} 2024-09-19T07:12:35.666 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:12:35.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.653+0000 7fd2f0362640 1 -- 172.21.15.148:0/2370724308 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fd2d40a33b0 msgr2=0x7fd2d40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:35.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.653+0000 7fd2f0362640 1 --2- 172.21.15.148:0/2370724308 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fd2d40a33b0 0x7fd2d40a5870 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0005fd0 tx=0x7fd2e0004a40 comp rx=0 tx=0).stop 2024-09-19T07:12:35.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.653+0000 7fd2f0362640 1 -- 172.21.15.148:0/2370724308 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2e8100a80 msgr2=0x7fd2e8197380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:35.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.653+0000 7fd2f0362640 1 --2- 172.21.15.148:0/2370724308 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2e8100a80 0x7fd2e8197380 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4009230 tx=0x7fd2e4004270 comp rx=0 tx=0).stop 2024-09-19T07:12:35.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.653+0000 7fd2f0362640 1 -- 172.21.15.148:0/2370724308 shutdown_connections 2024-09-19T07:12:35.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.653+0000 7fd2f0362640 1 --2- 172.21.15.148:0/2370724308 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fd2d40a33b0 0x7fd2d40a5870 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:35.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.653+0000 7fd2f0362640 1 --2- 172.21.15.148:0/2370724308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2e8106a80 0x7fd2e819bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:35.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.653+0000 7fd2f0362640 1 --2- 172.21.15.148:0/2370724308 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2e8101420 0x7fd2e81978c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:35.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.653+0000 7fd2f0362640 1 --2- 172.21.15.148:0/2370724308 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2e8100a80 0x7fd2e8197380 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:35.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.653+0000 7fd2f0362640 1 -- 172.21.15.148:0/2370724308 >> 172.21.15.148:0/2370724308 conn(0x7fd2e80fc7a0 msgr2=0x7fd2e80fcfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:35.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.653+0000 7fd2f0362640 1 -- 172.21.15.148:0/2370724308 shutdown_connections 2024-09-19T07:12:35.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:35.653+0000 7fd2f0362640 1 -- 172.21.15.148:0/2370724308 wait complete. 2024-09-19T07:12:36.358 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T07:12:36.358 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:12:36.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:36 smithi148 ceph-mon[31180]: pgmap v49: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-09-19T07:12:36.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:36 smithi148 ceph-mon[31180]: mgrmap e25: x(active, since 92s), standbys: y, z 2024-09-19T07:12:36.607 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:12:36.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:36 smithi165 ceph-mon[35326]: pgmap v49: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-09-19T07:12:36.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:36 smithi165 ceph-mon[35326]: mgrmap e25: x(active, since 92s), standbys: y, z 2024-09-19T07:12:36.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:36 smithi179 ceph-mon[35716]: pgmap v49: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-09-19T07:12:36.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:36 smithi179 ceph-mon[35716]: mgrmap e25: x(active, since 92s), standbys: y, z 2024-09-19T07:12:37.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.078+0000 7f60ee0a2640 1 -- 172.21.15.148:0/808977337 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60e8100e20 msgr2=0x7f60e8101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:37.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.078+0000 7f60ee0a2640 1 --2- 172.21.15.148:0/808977337 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60e8100e20 0x7f60e8101200 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f60d8009900 tx=0x7f60d802a480 comp rx=0 tx=0).stop 2024-09-19T07:12:37.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.078+0000 7f60ee0a2640 1 -- 172.21.15.148:0/808977337 shutdown_connections 2024-09-19T07:12:37.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.078+0000 7f60ee0a2640 1 --2- 172.21.15.148:0/808977337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60e8102ef0 0x7f60e810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:37.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.078+0000 7f60ee0a2640 1 --2- 172.21.15.148:0/808977337 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f60e8102570 0x7f60e81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:37.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.078+0000 7f60ee0a2640 1 --2- 172.21.15.148:0/808977337 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60e8100e20 0x7f60e8101200 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:37.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.078+0000 7f60ee0a2640 1 -- 172.21.15.148:0/808977337 >> 172.21.15.148:0/808977337 conn(0x7f60e80fc7d0 msgr2=0x7f60e80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:37.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.078+0000 7f60ee0a2640 1 -- 172.21.15.148:0/808977337 shutdown_connections 2024-09-19T07:12:37.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.078+0000 7f60ee0a2640 1 -- 172.21.15.148:0/808977337 wait complete. 2024-09-19T07:12:37.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.078+0000 7f60ee0a2640 1 Processor -- start 2024-09-19T07:12:37.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.079+0000 7f60ee0a2640 1 -- start start 2024-09-19T07:12:37.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.079+0000 7f60ee0a2640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f60e8100e20 0x7f60e8199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:37.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.079+0000 7f60ee0a2640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60e8102570 0x7f60e81998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:37.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.079+0000 7f60ee0a2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60e8102ef0 0x7f60e81a43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:37.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.079+0000 7f60ee0a2640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f60e8110f50 con 0x7f60e8102570 2024-09-19T07:12:37.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.079+0000 7f60ee0a2640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f60e8110dd0 con 0x7f60e8100e20 2024-09-19T07:12:37.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.079+0000 7f60ee0a2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f60e81110d0 con 0x7f60e8102ef0 2024-09-19T07:12:37.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.079+0000 7f60dffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60e8102570 0x7f60e81998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:37.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.079+0000 7f60dffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60e8102570 0x7f60e81998a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39628/0 (socket says 172.21.15.148:39628) 2024-09-19T07:12:37.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.079+0000 7f60dffff640 1 -- 172.21.15.148:0/178515420 learned_addr learned my addr 172.21.15.148:0/178515420 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:37.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.079+0000 7f60e77fe640 1 --2- 172.21.15.148:0/178515420 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f60e8100e20 0x7f60e8199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:37.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.079+0000 7f60e7fff640 1 --2- 172.21.15.148:0/178515420 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60e8102ef0 0x7f60e81a43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:37.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.079+0000 7f60dffff640 1 -- 172.21.15.148:0/178515420 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60e8102ef0 msgr2=0x7f60e81a43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:37.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.079+0000 7f60dffff640 1 --2- 172.21.15.148:0/178515420 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60e8102ef0 0x7f60e81a43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:37.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.079+0000 7f60dffff640 1 -- 172.21.15.148:0/178515420 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f60e8100e20 msgr2=0x7f60e8199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:37.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.079+0000 7f60dffff640 1 --2- 172.21.15.148:0/178515420 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f60e8100e20 0x7f60e8199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:37.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.079+0000 7f60dffff640 1 -- 172.21.15.148:0/178515420 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60e81a4920 con 0x7f60e8102570 2024-09-19T07:12:37.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.079+0000 7f60e7fff640 1 --2- 172.21.15.148:0/178515420 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60e8102ef0 0x7f60e81a43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:12:37.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.079+0000 7f60dffff640 1 --2- 172.21.15.148:0/178515420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60e8102570 0x7f60e81998a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f60d000d950 tx=0x7f60d000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:37.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.079+0000 7f60e57fa640 1 -- 172.21.15.148:0/178515420 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d0017070 con 0x7f60e8102570 2024-09-19T07:12:37.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.079+0000 7f60e57fa640 1 -- 172.21.15.148:0/178515420 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60d0009c30 con 0x7f60e8102570 2024-09-19T07:12:37.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.079+0000 7f60ee0a2640 1 -- 172.21.15.148:0/178515420 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60e81a4af0 con 0x7f60e8102570 2024-09-19T07:12:37.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.079+0000 7f60e57fa640 1 -- 172.21.15.148:0/178515420 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d000f6b0 con 0x7f60e8102570 2024-09-19T07:12:37.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.080+0000 7f60ee0a2640 1 -- 172.21.15.148:0/178515420 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60e81a5080 con 0x7f60e8102570 2024-09-19T07:12:37.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.081+0000 7f60ee0a2640 1 -- 172.21.15.148:0/178515420 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60e8101200 con 0x7f60e8102570 2024-09-19T07:12:37.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.082+0000 7f60e57fa640 1 -- 172.21.15.148:0/178515420 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f60d00109d0 con 0x7f60e8102570 2024-09-19T07:12:37.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.082+0000 7f60e57fa640 1 --2- 172.21.15.148:0/178515420 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f60d40a3430 0x7f60d40a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:37.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.082+0000 7f60e77fe640 1 --2- 172.21.15.148:0/178515420 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f60d40a3430 0x7f60d40a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:37.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.082+0000 7f60e57fa640 1 -- 172.21.15.148:0/178515420 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f60d00cf990 con 0x7f60e8102570 2024-09-19T07:12:37.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.083+0000 7f60e77fe640 1 --2- 172.21.15.148:0/178515420 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f60d40a3430 0x7f60d40a58f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f60d8005ab0 tx=0x7f60d8005a20 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:37.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.086+0000 7f60e57fa640 1 -- 172.21.15.148:0/178515420 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f60d0009de0 con 0x7f60e8102570 2024-09-19T07:12:37.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.289+0000 7f60ee0a2640 1 -- 172.21.15.148:0/178515420 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f60e8109090 con 0x7f60e8102570 2024-09-19T07:12:37.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.290+0000 7f60e57fa640 1 -- 172.21.15.148:0/178515420 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11939 (secure 0 0 0) 0x7f60d009c340 con 0x7f60e8102570 2024-09-19T07:12:37.291 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:12:37.291 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":25,"btime":"2024-09-19T07:11:04:227331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/4263868576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":4263868576},{"type":"v1","addr":"172.21.15.148:6841","nonce":4263868576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24383,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2146820965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2146820965},{"type":"v1","addr":"172.21.15.165:6835","nonce":2146820965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:09:19.543369+0000","modified":"2024-09-19T07:11:03.969598+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24457,"mds_1":24437,"mds_2":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/1566489108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1566489108},{"type":"v1","addr":"172.21.15.179:6835","nonce":1566489108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.165:6839/3993490234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":3993490234},{"type":"v1","addr":"172.21.15.165:6839","nonce":3993490234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24457,"qdb_cluster":[24457,24437,24436]},"id":1}]} 2024-09-19T07:12:37.292 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 25 2024-09-19T07:12:37.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.293+0000 7f60ee0a2640 1 -- 172.21.15.148:0/178515420 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f60d40a3430 msgr2=0x7f60d40a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:37.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.293+0000 7f60ee0a2640 1 --2- 172.21.15.148:0/178515420 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f60d40a3430 0x7f60d40a58f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f60d8005ab0 tx=0x7f60d8005a20 comp rx=0 tx=0).stop 2024-09-19T07:12:37.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.293+0000 7f60ee0a2640 1 -- 172.21.15.148:0/178515420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60e8102570 msgr2=0x7f60e81998a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:37.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.293+0000 7f60ee0a2640 1 --2- 172.21.15.148:0/178515420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60e8102570 0x7f60e81998a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f60d000d950 tx=0x7f60d000de10 comp rx=0 tx=0).stop 2024-09-19T07:12:37.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.293+0000 7f60ee0a2640 1 -- 172.21.15.148:0/178515420 shutdown_connections 2024-09-19T07:12:37.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.293+0000 7f60ee0a2640 1 --2- 172.21.15.148:0/178515420 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f60d40a3430 0x7f60d40a58f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:37.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.293+0000 7f60ee0a2640 1 --2- 172.21.15.148:0/178515420 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60e8102ef0 0x7f60e81a43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:37.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.293+0000 7f60ee0a2640 1 --2- 172.21.15.148:0/178515420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60e8102570 0x7f60e81998a0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:37.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.293+0000 7f60ee0a2640 1 --2- 172.21.15.148:0/178515420 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f60e8100e20 0x7f60e8199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:37.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.293+0000 7f60ee0a2640 1 -- 172.21.15.148:0/178515420 >> 172.21.15.148:0/178515420 conn(0x7f60e80fc7d0 msgr2=0x7f60e80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:37.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.293+0000 7f60ee0a2640 1 -- 172.21.15.148:0/178515420 shutdown_connections 2024-09-19T07:12:37.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:37.293+0000 7f60ee0a2640 1 -- 172.21.15.148:0/178515420 wait complete. 2024-09-19T07:12:37.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:37 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/178515420' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:12:37.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:37 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/178515420' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:12:37.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:37 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/178515420' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:12:38.010 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T07:12:38.259 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:12:38.671 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:38 smithi148 ceph-mon[31180]: pgmap v50: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-19T07:12:38.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:38 smithi179 ceph-mon[35716]: pgmap v50: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-19T07:12:38.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.752+0000 7f8cc88b1640 1 -- 172.21.15.148:0/730288306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8cc4106f10 msgr2=0x7f8cc410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:38.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.752+0000 7f8cc88b1640 1 --2- 172.21.15.148:0/730288306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8cc4106f10 0x7f8cc410ea90 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc009ca0 tx=0x7f8cbc02a8c0 comp rx=0 tx=0).stop 2024-09-19T07:12:38.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.753+0000 7f8cc88b1640 1 -- 172.21.15.148:0/730288306 shutdown_connections 2024-09-19T07:12:38.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.753+0000 7f8cc88b1640 1 --2- 172.21.15.148:0/730288306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8cc4106f10 0x7f8cc410ea90 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:38.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.753+0000 7f8cc88b1640 1 --2- 172.21.15.148:0/730288306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8cc4102790 0x7f8cc41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:38.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.753+0000 7f8cc88b1640 1 --2- 172.21.15.148:0/730288306 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8cc4101de0 0x7f8cc41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:38.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.753+0000 7f8cc88b1640 1 -- 172.21.15.148:0/730288306 >> 172.21.15.148:0/730288306 conn(0x7f8cc40fd8c0 msgr2=0x7f8cc40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:38.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.753+0000 7f8cc88b1640 1 -- 172.21.15.148:0/730288306 shutdown_connections 2024-09-19T07:12:38.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.753+0000 7f8cc88b1640 1 -- 172.21.15.148:0/730288306 wait complete. 2024-09-19T07:12:38.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.753+0000 7f8cc88b1640 1 Processor -- start 2024-09-19T07:12:38.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.754+0000 7f8cc88b1640 1 -- start start 2024-09-19T07:12:38.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.754+0000 7f8cc88b1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8cc4101de0 0x7f8cc4198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:38.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.754+0000 7f8cc88b1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8cc4102790 0x7f8cc4198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:38.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.754+0000 7f8cc88b1640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8cc4106f10 0x7f8cc419cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:38.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.754+0000 7f8cc88b1640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc4111f70 con 0x7f8cc4101de0 2024-09-19T07:12:38.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.754+0000 7f8cc88b1640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc4111df0 con 0x7f8cc4106f10 2024-09-19T07:12:38.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.754+0000 7f8cc88b1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc41120f0 con 0x7f8cc4102790 2024-09-19T07:12:38.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.754+0000 7f8cc259c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8cc4101de0 0x7f8cc4198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:38.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.754+0000 7f8cc259c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8cc4101de0 0x7f8cc4198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39634/0 (socket says 172.21.15.148:39634) 2024-09-19T07:12:38.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.754+0000 7f8cc259c640 1 -- 172.21.15.148:0/2516680134 learned_addr learned my addr 172.21.15.148:0/2516680134 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:38.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.754+0000 7f8cc1d9b640 1 --2- 172.21.15.148:0/2516680134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8cc4102790 0x7f8cc4198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:38.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.754+0000 7f8cc2d9d640 1 --2- 172.21.15.148:0/2516680134 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8cc4106f10 0x7f8cc419cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:38.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.754+0000 7f8cc259c640 1 -- 172.21.15.148:0/2516680134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8cc4102790 msgr2=0x7f8cc4198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:38.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.754+0000 7f8cc259c640 1 --2- 172.21.15.148:0/2516680134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8cc4102790 0x7f8cc4198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:38.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.754+0000 7f8cc259c640 1 -- 172.21.15.148:0/2516680134 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8cc4106f10 msgr2=0x7f8cc419cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:38.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.754+0000 7f8cc259c640 1 --2- 172.21.15.148:0/2516680134 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8cc4106f10 0x7f8cc419cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:38.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.754+0000 7f8cc259c640 1 -- 172.21.15.148:0/2516680134 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cc419d3c0 con 0x7f8cc4101de0 2024-09-19T07:12:38.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.754+0000 7f8cc1d9b640 1 --2- 172.21.15.148:0/2516680134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8cc4102790 0x7f8cc4198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:12:38.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.754+0000 7f8cc259c640 1 --2- 172.21.15.148:0/2516680134 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8cc4101de0 0x7f8cc4198410 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f8cb400d950 tx=0x7f8cb400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:38.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.755+0000 7f8cb37fe640 1 -- 172.21.15.148:0/2516680134 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb4017070 con 0x7f8cc4101de0 2024-09-19T07:12:38.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.755+0000 7f8cb37fe640 1 -- 172.21.15.148:0/2516680134 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8cb4009c30 con 0x7f8cc4101de0 2024-09-19T07:12:38.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.755+0000 7f8cc88b1640 1 -- 172.21.15.148:0/2516680134 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cc419d6b0 con 0x7f8cc4101de0 2024-09-19T07:12:38.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.755+0000 7f8cb37fe640 1 -- 172.21.15.148:0/2516680134 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb400f6b0 con 0x7f8cc4101de0 2024-09-19T07:12:38.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.755+0000 7f8cc88b1640 1 -- 172.21.15.148:0/2516680134 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cc41a4f90 con 0x7f8cc4101de0 2024-09-19T07:12:38.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.757+0000 7f8cb37fe640 1 -- 172.21.15.148:0/2516680134 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f8cb40109d0 con 0x7f8cc4101de0 2024-09-19T07:12:38.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.757+0000 7f8ccac8a740 1 Processor -- start 2024-09-19T07:12:38.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.757+0000 7f8ccac8a740 1 -- start start 2024-09-19T07:12:38.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.758+0000 7f8cb37fe640 1 --2- 172.21.15.148:0/2516680134 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f8cac0a33b0 0x7f8cac0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:38.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.758+0000 7f8ccac8a740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1ce99eb40 0x55f1ce99d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:38.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.758+0000 7f8ccac8a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1ce99d5d0 0x55f1ce99da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:38.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.758+0000 7f8ccac8a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1ce9a8370 0x55f1ce9aa760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:38.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.758+0000 7f8ccac8a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55f1ce9032f0 con 0x55f1ce99d5d0 2024-09-19T07:12:38.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.758+0000 7f8ccac8a740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55f1ce8aacf0 con 0x55f1ce99eb40 2024-09-19T07:12:38.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.758+0000 7f8ccac8a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f1ce8ff2b0 con 0x55f1ce9a8370 2024-09-19T07:12:38.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.758+0000 7f8cb37fe640 1 -- 172.21.15.148:0/2516680134 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f8cb40cfa50 con 0x7f8cc4101de0 2024-09-19T07:12:38.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.758+0000 7f8cc1d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1ce99d5d0 0x55f1ce99da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:38.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.758+0000 7f8cc1d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1ce99d5d0 0x55f1ce99da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39644/0 (socket says 172.21.15.148:39644) 2024-09-19T07:12:38.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.758+0000 7f8cc1d9b640 1 -- 172.21.15.148:0/818973878 learned_addr learned my addr 172.21.15.148:0/818973878 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:38.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.758+0000 7f8cc259c640 1 --2- 172.21.15.148:0/818973878 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1ce99eb40 0x55f1ce99d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:38.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.758+0000 7f8cc2d9d640 1 --2- 172.21.15.148:0/818973878 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1ce9a8370 0x55f1ce9aa760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:38.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.758+0000 7f8cc2d9d640 1 --2- 172.21.15.148:0/2516680134 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f8cac0a33b0 0x7f8cac0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:38.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.758+0000 7f8cc1d9b640 1 -- 172.21.15.148:0/818973878 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1ce9a8370 msgr2=0x55f1ce9aa760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:38.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.758+0000 7f8cc1d9b640 1 --2- 172.21.15.148:0/818973878 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1ce9a8370 0x55f1ce9aa760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:38.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.758+0000 7f8cc1d9b640 1 -- 172.21.15.148:0/818973878 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1ce99eb40 msgr2=0x55f1ce99d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:38.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.758+0000 7f8cc1d9b640 1 --2- 172.21.15.148:0/818973878 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1ce99eb40 0x55f1ce99d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:38.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.758+0000 7f8cc1d9b640 1 -- 172.21.15.148:0/818973878 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1ce88f3a0 con 0x55f1ce99d5d0 2024-09-19T07:12:38.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.758+0000 7f8cc1d9b640 1 --2- 172.21.15.148:0/818973878 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1ce99d5d0 0x55f1ce99da10 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f8cb800bcb0 tx=0x7f8cb800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de705913ca127070 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:38.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.759+0000 7f8cb0ff9640 1 -- 172.21.15.148:0/818973878 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb8015070 con 0x55f1ce99d5d0 2024-09-19T07:12:38.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.759+0000 7f8cc2d9d640 1 --2- 172.21.15.148:0/2516680134 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f8cac0a33b0 0x7f8cac0a5870 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x55f1ce99e070 tx=0x7f8cbc03f040 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:38.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.759+0000 7f8cb0ff9640 1 -- 172.21.15.148:0/818973878 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8cb8005500 con 0x55f1ce99d5d0 2024-09-19T07:12:38.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.759+0000 7f8cb0ff9640 1 -- 172.21.15.148:0/818973878 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb80116a0 con 0x55f1ce99d5d0 2024-09-19T07:12:38.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.759+0000 7f8ccac8a740 1 -- 172.21.15.148:0/818973878 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1ce99d5d0 msgr2=0x55f1ce99da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:38.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.759+0000 7f8ccac8a740 1 --2- 172.21.15.148:0/818973878 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1ce99d5d0 0x55f1ce99da10 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f8cb800bcb0 tx=0x7f8cb800f730 comp rx=0 tx=0).stop 2024-09-19T07:12:38.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.759+0000 7f8ccac8a740 1 -- 172.21.15.148:0/818973878 shutdown_connections 2024-09-19T07:12:38.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.759+0000 7f8ccac8a740 1 --2- 172.21.15.148:0/818973878 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1ce9a8370 0x55f1ce9aa760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:38.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.759+0000 7f8ccac8a740 1 --2- 172.21.15.148:0/818973878 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1ce99d5d0 0x55f1ce99da10 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:38.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.759+0000 7f8ccac8a740 1 --2- 172.21.15.148:0/818973878 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1ce99eb40 0x55f1ce99d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:38.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.759+0000 7f8ccac8a740 1 -- 172.21.15.148:0/818973878 >> 172.21.15.148:0/818973878 conn(0x55f1ce966310 msgr2=0x55f1ce999c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:38.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.759+0000 7f8ccac8a740 1 -- 172.21.15.148:0/818973878 shutdown_connections 2024-09-19T07:12:38.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.759+0000 7f8ccac8a740 1 -- 172.21.15.148:0/818973878 wait complete. 2024-09-19T07:12:38.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.760+0000 7f8ccac8a740 1 -- start start 2024-09-19T07:12:38.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.760+0000 7f8ccac8a740 1 Processor -- start 2024-09-19T07:12:38.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.760+0000 7f8ccac8a740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1ce99d5d0 0x55f1ce9a7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:38.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.760+0000 7f8ccac8a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1ce99eb40 0x55f1ce9a5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:38.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.760+0000 7f8ccac8a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1ce9a8370 0x55f1ce9a5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:38.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.760+0000 7f8ccac8a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55f1ce9ab070 con 0x55f1ce9a8370 2024-09-19T07:12:38.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.760+0000 7f8ccac8a740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55f1ce8be060 con 0x55f1ce99d5d0 2024-09-19T07:12:38.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.760+0000 7f8ccac8a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f1ce9ab1f0 con 0x55f1ce99eb40 2024-09-19T07:12:38.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.760+0000 7f8ccac8a740 10 client.0 _ll_register_callbacks cb 0x55f1ce6118c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:12:38.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.760+0000 7f8cc2d9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1ce9a8370 0x55f1ce9a5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:38.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.760+0000 7f8cc2d9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1ce9a8370 0x55f1ce9a5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39654/0 (socket says 172.21.15.148:39654) 2024-09-19T07:12:38.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.760+0000 7f8cc2d9d640 1 -- 172.21.15.148:0/3069304839 learned_addr learned my addr 172.21.15.148:0/3069304839 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:38.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.760+0000 7f8cc1d9b640 1 --2- 172.21.15.148:0/3069304839 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1ce99eb40 0x55f1ce9a5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:38.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.760+0000 7f8cc259c640 1 --2- 172.21.15.148:0/3069304839 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1ce99d5d0 0x55f1ce9a7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:38.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.760+0000 7f8cc2d9d640 1 -- 172.21.15.148:0/3069304839 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1ce99eb40 msgr2=0x55f1ce9a5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:38.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.760+0000 7f8cc2d9d640 1 --2- 172.21.15.148:0/3069304839 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1ce99eb40 0x55f1ce9a5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:38.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.760+0000 7f8cc2d9d640 1 -- 172.21.15.148:0/3069304839 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1ce99d5d0 msgr2=0x55f1ce9a7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:38.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.760+0000 7f8cc2d9d640 1 --2- 172.21.15.148:0/3069304839 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1ce99d5d0 0x55f1ce9a7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:38.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.760+0000 7f8cc2d9d640 1 -- 172.21.15.148:0/3069304839 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1ce6743c0 con 0x55f1ce9a8370 2024-09-19T07:12:38.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.760+0000 7f8cc259c640 1 --2- 172.21.15.148:0/3069304839 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1ce99d5d0 0x55f1ce9a7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:12:38.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.761+0000 7f8cc2d9d640 1 --2- 172.21.15.148:0/3069304839 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1ce9a8370 0x55f1ce9a5610 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc009ca0 tx=0x7f8cbc02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b42ca035eae4b79d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:38.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.761+0000 7f8ca9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:12:38.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.761+0000 7f8ca9ffb640 1 -- 172.21.15.148:0/3069304839 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc054060 con 0x55f1ce9a8370 2024-09-19T07:12:38.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.761+0000 7f8ccac8a740 1 -- 172.21.15.148:0/3069304839 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8cb8005500 con 0x55f1ce9a8370 2024-09-19T07:12:38.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.761+0000 7f8ca9ffb640 1 -- 172.21.15.148:0/3069304839 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f8cbc0305c0 con 0x55f1ce9a8370 2024-09-19T07:12:38.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.761+0000 7f8ca9ffb640 1 -- 172.21.15.148:0/3069304839 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8cbc0307c0 con 0x55f1ce9a8370 2024-09-19T07:12:38.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.761+0000 7f8ccac8a740 10 client.15744 fetch_fsmap learned FSMap version 25 2024-09-19T07:12:38.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.761+0000 7f8ccac8a740 1 -- 172.21.15.148:0/3069304839 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f1ce9b6b40 con 0x55f1ce9a8370 2024-09-19T07:12:38.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.761+0000 7f8ca9ffb640 1 -- 172.21.15.148:0/3069304839 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8cb8005500 con 0x55f1ce9a8370 2024-09-19T07:12:38.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.761+0000 7f8ca9ffb640 1 -- 172.21.15.148:0/3069304839 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8cbc04e030 con 0x55f1ce9a8370 2024-09-19T07:12:38.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.761+0000 7f8ccac8a740 10 client.15744 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:12:38.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.761+0000 7f8ccac8a740 10 client.15744 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T07:12:38.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.761+0000 7f8ccac8a740 20 client.15744 populate_metadata read hostname 'smithi148' 2024-09-19T07:12:38.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.761+0000 7f8ccac8a740 1 --2- 172.21.15.148:0/3069304839 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x55f1ce9b7f80 0x55f1ce9ba3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:38.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.761+0000 7f8ccac8a740 4 client.15744 mds_command: new command op to 24436 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:12:38.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.761+0000 7f8ccac8a740 1 -- 172.21.15.148:0/3069304839 --> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f1ce910860 con 0x55f1ce9b7f80 2024-09-19T07:12:38.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.762+0000 7f8cc259c640 1 --2- 172.21.15.148:0/3069304839 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x55f1ce9b7f80 0x55f1ce9ba3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:38.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.762+0000 7f8cc259c640 1 --2- 172.21.15.148:0/3069304839 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x55f1ce9b7f80 0x55f1ce9ba3d0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9a1fec30e319c2cd server_cookie=6f0ac6dc9ce20b62 in_seq=0 out_seq=0 2024-09-19T07:12:38.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.762+0000 7f8ca9ffb640 10 client.15744 ms_handle_connect on v2:172.21.15.179:6836/3827671241 2024-09-19T07:12:38.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.763+0000 7f8ca9ffb640 1 -- 172.21.15.148:0/3069304839 <== mds.2 v2:172.21.15.179:6836/3827671241 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f1ce910860 con 0x55f1ce9b7f80 2024-09-19T07:12:38.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.763+0000 7f8ca9ffb640 10 client.15744 handle_command_reply: tid=0 2024-09-19T07:12:38.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.763+0000 7f8ccac8a740 1 client.15744 shutdown 2024-09-19T07:12:38.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.763+0000 7f8ccac8a740 1 -- 172.21.15.148:0/3069304839 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1ce9a8370 msgr2=0x55f1ce9a5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:38.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.763+0000 7f8ccac8a740 1 --2- 172.21.15.148:0/3069304839 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1ce9a8370 0x55f1ce9a5610 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc009ca0 tx=0x7f8cbc02a8c0 comp rx=0 tx=0).stop 2024-09-19T07:12:38.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.763+0000 7f8ccac8a740 1 -- 172.21.15.148:0/3069304839 shutdown_connections 2024-09-19T07:12:38.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.763+0000 7f8ccac8a740 1 --2- 172.21.15.148:0/3069304839 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x55f1ce9b7f80 0x55f1ce9ba3d0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:38.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.763+0000 7f8ccac8a740 1 --2- 172.21.15.148:0/3069304839 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1ce9a8370 0x55f1ce9a5610 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:38.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.763+0000 7f8ca9ffb640 0 client.15744 ms_handle_reset on v2:172.21.15.179:6836/3827671241 2024-09-19T07:12:38.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.763+0000 7f8ccac8a740 1 --2- 172.21.15.148:0/3069304839 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1ce99eb40 0x55f1ce9a5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:38.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.763+0000 7f8ccac8a740 1 --2- 172.21.15.148:0/3069304839 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1ce99d5d0 0x55f1ce9a7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:38.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.763+0000 7f8ccac8a740 1 -- 172.21.15.148:0/3069304839 >> 172.21.15.148:0/3069304839 conn(0x55f1ce966310 msgr2=0x55f1ce99f930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:38.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.763+0000 7f8ccac8a740 1 -- 172.21.15.148:0/3069304839 shutdown_connections 2024-09-19T07:12:38.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.763+0000 7f8ccac8a740 1 -- 172.21.15.148:0/3069304839 wait complete. 2024-09-19T07:12:38.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.763+0000 7f8ccac8a740 20 client.15744 trim_cache size 0 max 16384 2024-09-19T07:12:38.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.776+0000 7f8ccac8a740 1 Processor -- start 2024-09-19T07:12:38.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.776+0000 7f8ccac8a740 1 -- start start 2024-09-19T07:12:38.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.776+0000 7f8ccac8a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1ce99d5d0 0x55f1ce9b4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:38.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.776+0000 7f8ccac8a740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1ce99eb40 0x55f1ce999700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:38.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.776+0000 7f8ccac8a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1ce9a8370 0x55f1ce999c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:38.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.776+0000 7f8ccac8a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc41b01b0 con 0x55f1ce99d5d0 2024-09-19T07:12:38.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.776+0000 7f8ccac8a740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc41ada80 con 0x55f1ce99eb40 2024-09-19T07:12:38.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.776+0000 7f8ccac8a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc41ab8b0 con 0x55f1ce9a8370 2024-09-19T07:12:38.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.776+0000 7f8cc259c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1ce99d5d0 0x55f1ce9b4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:38.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.776+0000 7f8cc259c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1ce99d5d0 0x55f1ce9b4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39664/0 (socket says 172.21.15.148:39664) 2024-09-19T07:12:38.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.776+0000 7f8cc259c640 1 -- 172.21.15.148:0/3990720981 learned_addr learned my addr 172.21.15.148:0/3990720981 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:38.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.776+0000 7f8cc2d9d640 1 --2- 172.21.15.148:0/3990720981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1ce9a8370 0x55f1ce999c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:38.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.776+0000 7f8cc259c640 1 -- 172.21.15.148:0/3990720981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1ce9a8370 msgr2=0x55f1ce999c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:38.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.776+0000 7f8cc259c640 1 --2- 172.21.15.148:0/3990720981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1ce9a8370 0x55f1ce999c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:38.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.776+0000 7f8cc259c640 1 -- 172.21.15.148:0/3990720981 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1ce99eb40 msgr2=0x55f1ce999700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:38.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.776+0000 7f8cc259c640 1 --2- 172.21.15.148:0/3990720981 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1ce99eb40 0x55f1ce999700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:38.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.776+0000 7f8cc259c640 1 -- 172.21.15.148:0/3990720981 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1ce99a180 con 0x55f1ce99d5d0 2024-09-19T07:12:38.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.776+0000 7f8cc2d9d640 1 --2- 172.21.15.148:0/3990720981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1ce9a8370 0x55f1ce999c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:12:38.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.776+0000 7f8cc259c640 1 --2- 172.21.15.148:0/3990720981 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1ce99d5d0 0x55f1ce9b4340 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f8cb409bc90 tx=0x7f8cb4086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=410f7a9bba384cc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:38.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.777+0000 7f8cabfff640 1 -- 172.21.15.148:0/3990720981 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb4020040 con 0x55f1ce99d5d0 2024-09-19T07:12:38.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.777+0000 7f8cabfff640 1 -- 172.21.15.148:0/3990720981 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8cb40a4970 con 0x55f1ce99d5d0 2024-09-19T07:12:38.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.777+0000 7f8cabfff640 1 -- 172.21.15.148:0/3990720981 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb40a44e0 con 0x55f1ce99d5d0 2024-09-19T07:12:38.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.777+0000 7f8ccac8a740 1 -- 172.21.15.148:0/3990720981 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1ce99d5d0 msgr2=0x55f1ce9b4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:38.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.777+0000 7f8ccac8a740 1 --2- 172.21.15.148:0/3990720981 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1ce99d5d0 0x55f1ce9b4340 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f8cb409bc90 tx=0x7f8cb4086040 comp rx=0 tx=0).stop 2024-09-19T07:12:38.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.777+0000 7f8ccac8a740 1 -- 172.21.15.148:0/3990720981 shutdown_connections 2024-09-19T07:12:38.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.777+0000 7f8ccac8a740 1 --2- 172.21.15.148:0/3990720981 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1ce9a8370 0x55f1ce999c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:38.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.777+0000 7f8ccac8a740 1 --2- 172.21.15.148:0/3990720981 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1ce99eb40 0x55f1ce999700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:38.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.777+0000 7f8ccac8a740 1 --2- 172.21.15.148:0/3990720981 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1ce99d5d0 0x55f1ce9b4340 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:38.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.777+0000 7f8ccac8a740 1 -- 172.21.15.148:0/3990720981 >> 172.21.15.148:0/3990720981 conn(0x55f1ce966310 msgr2=0x55f1ce9a4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:38.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.777+0000 7f8ccac8a740 1 -- 172.21.15.148:0/3990720981 shutdown_connections 2024-09-19T07:12:38.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.777+0000 7f8ccac8a740 1 -- 172.21.15.148:0/3990720981 wait complete. 2024-09-19T07:12:38.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.778+0000 7f8ccac8a740 1 -- start start 2024-09-19T07:12:38.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.778+0000 7f8ccac8a740 1 Processor -- start 2024-09-19T07:12:38.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.778+0000 7f8ccac8a740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1ce99d5d0 0x55f1ce9b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:38.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.778+0000 7f8ccac8a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1ce99eb40 0x55f1ce9a1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:38.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.778+0000 7f8ccac8a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1ce9a8370 0x55f1ce9a2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:38.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.778+0000 7f8ccac8a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc41abf40 con 0x55f1ce9a8370 2024-09-19T07:12:38.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.778+0000 7f8ccac8a740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc41ad3b0 con 0x55f1ce99d5d0 2024-09-19T07:12:38.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.778+0000 7f8ccac8a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc41ac610 con 0x55f1ce99eb40 2024-09-19T07:12:38.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.778+0000 7f8ccac8a740 10 client.0 _ll_register_callbacks cb 0x7f8cbc009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:12:38.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.778+0000 7f8cc2d9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1ce9a8370 0x55f1ce9a2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:38.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.778+0000 7f8cc2d9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1ce9a8370 0x55f1ce9a2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39666/0 (socket says 172.21.15.148:39666) 2024-09-19T07:12:38.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.778+0000 7f8cc2d9d640 1 -- 172.21.15.148:0/702926232 learned_addr learned my addr 172.21.15.148:0/702926232 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:38.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.778+0000 7f8cc1d9b640 1 --2- 172.21.15.148:0/702926232 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1ce99eb40 0x55f1ce9a1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:38.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.778+0000 7f8cc259c640 1 --2- 172.21.15.148:0/702926232 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1ce99d5d0 0x55f1ce9b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:38.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.778+0000 7f8cc2d9d640 1 -- 172.21.15.148:0/702926232 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1ce99eb40 msgr2=0x55f1ce9a1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:38.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.778+0000 7f8cc2d9d640 1 --2- 172.21.15.148:0/702926232 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1ce99eb40 0x55f1ce9a1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:38.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.778+0000 7f8cc2d9d640 1 -- 172.21.15.148:0/702926232 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1ce99d5d0 msgr2=0x55f1ce9b0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:38.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.778+0000 7f8cc2d9d640 1 --2- 172.21.15.148:0/702926232 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1ce99d5d0 0x55f1ce9b0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:38.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.778+0000 7f8cc2d9d640 1 -- 172.21.15.148:0/702926232 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1ce9a2c80 con 0x55f1ce9a8370 2024-09-19T07:12:38.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.778+0000 7f8cc1d9b640 1 --2- 172.21.15.148:0/702926232 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1ce99eb40 0x55f1ce9a1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:12:38.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.778+0000 7f8cc2d9d640 1 --2- 172.21.15.148:0/702926232 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1ce9a8370 0x55f1ce9a2450 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc02ade0 tx=0x7f8cbc004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=441dfa6787cea4e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:38.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.778+0000 7f8ca9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:12:38.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.779+0000 7f8ca9ffb640 1 -- 172.21.15.148:0/702926232 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc030b70 con 0x55f1ce9a8370 2024-09-19T07:12:38.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.779+0000 7f8ca9ffb640 1 -- 172.21.15.148:0/702926232 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f8cbc030d10 con 0x55f1ce9a8370 2024-09-19T07:12:38.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.779+0000 7f8ccac8a740 1 -- 172.21.15.148:0/702926232 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8cb40a4970 con 0x55f1ce9a8370 2024-09-19T07:12:38.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.779+0000 7f8ca9ffb640 1 -- 172.21.15.148:0/702926232 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8cbc054020 con 0x55f1ce9a8370 2024-09-19T07:12:38.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.779+0000 7f8ccac8a740 10 client.15750 fetch_fsmap learned FSMap version 25 2024-09-19T07:12:38.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.779+0000 7f8ccac8a740 1 -- 172.21.15.148:0/702926232 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f1cea22d50 con 0x55f1ce9a8370 2024-09-19T07:12:38.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.779+0000 7f8ca9ffb640 1 -- 172.21.15.148:0/702926232 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8cb40a4970 con 0x55f1ce9a8370 2024-09-19T07:12:38.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.779+0000 7f8ca9ffb640 1 -- 172.21.15.148:0/702926232 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8cbc060070 con 0x55f1ce9a8370 2024-09-19T07:12:38.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.779+0000 7f8ccac8a740 10 client.15750 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:12:38.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.779+0000 7f8ccac8a740 10 client.15750 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T07:12:38.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.779+0000 7f8ccac8a740 20 client.15750 populate_metadata read hostname 'smithi148' 2024-09-19T07:12:38.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.779+0000 7f8ccac8a740 1 --2- 172.21.15.148:0/702926232 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x55f1ce9b7f80 0x55f1cea254b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:38.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.779+0000 7f8ccac8a740 4 client.15750 mds_command: new command op to 24436 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:12:38.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.779+0000 7f8ccac8a740 1 -- 172.21.15.148:0/702926232 --> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f1ce90ad70 con 0x55f1ce9b7f80 2024-09-19T07:12:38.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.779+0000 7f8cc259c640 1 --2- 172.21.15.148:0/702926232 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x55f1ce9b7f80 0x55f1cea254b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:38.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.780+0000 7f8cc259c640 1 --2- 172.21.15.148:0/702926232 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x55f1ce9b7f80 0x55f1cea254b0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b440396ef7f72d2b server_cookie=5f7a413428b61f36 in_seq=0 out_seq=0 2024-09-19T07:12:38.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.780+0000 7f8ca9ffb640 10 client.15750 ms_handle_connect on v2:172.21.15.179:6836/3827671241 2024-09-19T07:12:38.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.780+0000 7f8ca9ffb640 1 -- 172.21.15.148:0/702926232 <== mds.2 v2:172.21.15.179:6836/3827671241 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f1ce90ad70 con 0x55f1ce9b7f80 2024-09-19T07:12:38.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.780+0000 7f8ca9ffb640 10 client.15750 handle_command_reply: tid=0 2024-09-19T07:12:38.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.780+0000 7f8ccac8a740 1 client.15750 shutdown 2024-09-19T07:12:38.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.780+0000 7f8ccac8a740 1 -- 172.21.15.148:0/702926232 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1ce9a8370 msgr2=0x55f1ce9a2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:38.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.780+0000 7f8ccac8a740 1 --2- 172.21.15.148:0/702926232 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1ce9a8370 0x55f1ce9a2450 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc02ade0 tx=0x7f8cbc004f90 comp rx=0 tx=0).stop 2024-09-19T07:12:38.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.780+0000 7f8ccac8a740 1 -- 172.21.15.148:0/702926232 shutdown_connections 2024-09-19T07:12:38.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.780+0000 7f8ccac8a740 1 --2- 172.21.15.148:0/702926232 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x55f1ce9b7f80 0x55f1cea254b0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:38.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.780+0000 7f8ccac8a740 1 --2- 172.21.15.148:0/702926232 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1ce9a8370 0x55f1ce9a2450 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:38.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.780+0000 7f8ccac8a740 1 --2- 172.21.15.148:0/702926232 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1ce99eb40 0x55f1ce9a1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:38.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.780+0000 7f8ca9ffb640 0 client.15750 ms_handle_reset on v2:172.21.15.179:6836/3827671241 2024-09-19T07:12:38.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.780+0000 7f8ccac8a740 1 --2- 172.21.15.148:0/702926232 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1ce99d5d0 0x55f1ce9b0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:38.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.780+0000 7f8ccac8a740 1 -- 172.21.15.148:0/702926232 >> 172.21.15.148:0/702926232 conn(0x55f1ce966310 msgr2=0x55f1ce9a4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:38.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.780+0000 7f8ccac8a740 1 -- 172.21.15.148:0/702926232 shutdown_connections 2024-09-19T07:12:38.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.780+0000 7f8ccac8a740 1 -- 172.21.15.148:0/702926232 wait complete. 2024-09-19T07:12:38.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.780+0000 7f8ccac8a740 20 client.15750 trim_cache size 0 max 16384 2024-09-19T07:12:38.802 INFO:teuthology.orchestra.run.smithi148.stdout:[] 2024-09-19T07:12:38.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.781+0000 7f8cc88b1640 1 -- 172.21.15.148:0/2516680134 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f8cac0a33b0 msgr2=0x7f8cac0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:38.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.781+0000 7f8cc88b1640 1 --2- 172.21.15.148:0/2516680134 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f8cac0a33b0 0x7f8cac0a5870 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x55f1ce99e070 tx=0x7f8cbc03f040 comp rx=0 tx=0).stop 2024-09-19T07:12:38.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.781+0000 7f8cc88b1640 1 -- 172.21.15.148:0/2516680134 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8cc4101de0 msgr2=0x7f8cc4198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:38.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.781+0000 7f8cc88b1640 1 --2- 172.21.15.148:0/2516680134 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8cc4101de0 0x7f8cc4198410 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f8cb400d950 tx=0x7f8cb400de10 comp rx=0 tx=0).stop 2024-09-19T07:12:38.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.781+0000 7f8cc88b1640 1 -- 172.21.15.148:0/2516680134 shutdown_connections 2024-09-19T07:12:38.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.781+0000 7f8cc88b1640 1 --2- 172.21.15.148:0/2516680134 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f8cac0a33b0 0x7f8cac0a5870 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:38.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.781+0000 7f8cc88b1640 1 --2- 172.21.15.148:0/2516680134 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8cc4106f10 0x7f8cc419cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:38.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.781+0000 7f8cc88b1640 1 --2- 172.21.15.148:0/2516680134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8cc4102790 0x7f8cc4198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:38.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.781+0000 7f8cc88b1640 1 --2- 172.21.15.148:0/2516680134 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8cc4101de0 0x7f8cc4198410 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:38.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.781+0000 7f8cc88b1640 1 -- 172.21.15.148:0/2516680134 >> 172.21.15.148:0/2516680134 conn(0x7f8cc40fd8c0 msgr2=0x7f8cc40feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:38.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.781+0000 7f8cc88b1640 1 -- 172.21.15.148:0/2516680134 shutdown_connections 2024-09-19T07:12:38.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:38.781+0000 7f8cc88b1640 1 -- 172.21.15.148:0/2516680134 wait complete. 2024-09-19T07:12:38.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:38 smithi165 ceph-mon[35326]: pgmap v50: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-19T07:12:39.576 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T07:12:39.824 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:12:40.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.317+0000 7f656a46d640 1 -- 172.21.15.148:0/3441497982 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6564102570 msgr2=0x7f65641029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:40.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.317+0000 7f656a46d640 1 --2- 172.21.15.148:0/3441497982 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6564102570 0x7f65641029b0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f6558009900 tx=0x7f655802a480 comp rx=0 tx=0).stop 2024-09-19T07:12:40.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.317+0000 7f656a46d640 1 -- 172.21.15.148:0/3441497982 shutdown_connections 2024-09-19T07:12:40.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.317+0000 7f656a46d640 1 --2- 172.21.15.148:0/3441497982 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6564102ef0 0x7f656410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:40.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.317+0000 7f656a46d640 1 --2- 172.21.15.148:0/3441497982 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6564102570 0x7f65641029b0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:40.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.317+0000 7f656a46d640 1 --2- 172.21.15.148:0/3441497982 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6564100e20 0x7f6564101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:40.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.317+0000 7f656a46d640 1 -- 172.21.15.148:0/3441497982 >> 172.21.15.148:0/3441497982 conn(0x7f65640fc7d0 msgr2=0x7f65640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:40.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.317+0000 7f656a46d640 1 -- 172.21.15.148:0/3441497982 shutdown_connections 2024-09-19T07:12:40.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.317+0000 7f656a46d640 1 -- 172.21.15.148:0/3441497982 wait complete. 2024-09-19T07:12:40.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.318+0000 7f656a46d640 1 Processor -- start 2024-09-19T07:12:40.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.318+0000 7f656a46d640 1 -- start start 2024-09-19T07:12:40.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.319+0000 7f656a46d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6564100e20 0x7f65641973e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:40.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.319+0000 7f656a46d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6564102570 0x7f6564197920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:40.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.319+0000 7f656a46d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6564102ef0 0x7f656419bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:40.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.319+0000 7f656a46d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6564110f80 con 0x7f6564102ef0 2024-09-19T07:12:40.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.319+0000 7f656a46d640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6564110e00 con 0x7f6564102570 2024-09-19T07:12:40.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.319+0000 7f656a46d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6564111100 con 0x7f6564100e20 2024-09-19T07:12:40.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.319+0000 7f6568a0a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6564102ef0 0x7f656419bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:40.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.319+0000 7f6568a0a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6564102ef0 0x7f656419bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39696/0 (socket says 172.21.15.148:39696) 2024-09-19T07:12:40.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.319+0000 7f6568a0a640 1 -- 172.21.15.148:0/3077304360 learned_addr learned my addr 172.21.15.148:0/3077304360 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:40.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.319+0000 7f6563fff640 1 --2- 172.21.15.148:0/3077304360 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6564100e20 0x7f65641973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:40.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.319+0000 7f65637fe640 1 --2- 172.21.15.148:0/3077304360 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6564102570 0x7f6564197920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:40.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.319+0000 7f6568a0a640 1 -- 172.21.15.148:0/3077304360 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6564100e20 msgr2=0x7f65641973e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:40.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.319+0000 7f6568a0a640 1 --2- 172.21.15.148:0/3077304360 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6564100e20 0x7f65641973e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:40.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.319+0000 7f6568a0a640 1 -- 172.21.15.148:0/3077304360 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6564102570 msgr2=0x7f6564197920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:40.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.319+0000 7f6568a0a640 1 --2- 172.21.15.148:0/3077304360 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6564102570 0x7f6564197920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:40.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.319+0000 7f6568a0a640 1 -- 172.21.15.148:0/3077304360 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f656419c390 con 0x7f6564102ef0 2024-09-19T07:12:40.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.319+0000 7f65637fe640 1 --2- 172.21.15.148:0/3077304360 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6564102570 0x7f6564197920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:12:40.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.319+0000 7f6568a0a640 1 --2- 172.21.15.148:0/3077304360 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6564102ef0 0x7f656419bcb0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f655c00cad0 tx=0x7f655c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:40.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.319+0000 7f65617fa640 1 -- 172.21.15.148:0/3077304360 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f655c00ae20 con 0x7f6564102ef0 2024-09-19T07:12:40.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.319+0000 7f656a46d640 1 -- 172.21.15.148:0/3077304360 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f656419c680 con 0x7f6564102ef0 2024-09-19T07:12:40.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.319+0000 7f65617fa640 1 -- 172.21.15.148:0/3077304360 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f655c005020 con 0x7f6564102ef0 2024-09-19T07:12:40.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.319+0000 7f65617fa640 1 -- 172.21.15.148:0/3077304360 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f655c00f6b0 con 0x7f6564102ef0 2024-09-19T07:12:40.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.320+0000 7f656a46d640 1 -- 172.21.15.148:0/3077304360 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65641a3f60 con 0x7f6564102ef0 2024-09-19T07:12:40.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.322+0000 7f65617fa640 1 -- 172.21.15.148:0/3077304360 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f655c0051d0 con 0x7f6564102ef0 2024-09-19T07:12:40.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.322+0000 7f656c846740 1 Processor -- start 2024-09-19T07:12:40.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.322+0000 7f656c846740 1 -- start start 2024-09-19T07:12:40.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.322+0000 7f65617fa640 1 --2- 172.21.15.148:0/3077304360 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f654c0a33b0 0x7f654c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:40.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.322+0000 7f656c846740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5adcbdb40 0x55b5adcbc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:40.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.322+0000 7f656c846740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b5adcbc5d0 0x55b5adcbca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:40.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.322+0000 7f656c846740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5adcc7370 0x55b5adcc9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:40.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.322+0000 7f656c846740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55b5adc222f0 con 0x55b5adcbdb40 2024-09-19T07:12:40.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.322+0000 7f656c846740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55b5adbc9cf0 con 0x55b5adcbc5d0 2024-09-19T07:12:40.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.322+0000 7f656c846740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55b5adc1e2b0 con 0x55b5adcc7370 2024-09-19T07:12:40.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.322+0000 7f6563fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5adcbdb40 0x55b5adcbc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:40.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.322+0000 7f65617fa640 1 -- 172.21.15.148:0/3077304360 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f655c0d00a0 con 0x7f6564102ef0 2024-09-19T07:12:40.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.322+0000 7f6563fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5adcbdb40 0x55b5adcbc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39700/0 (socket says 172.21.15.148:39700) 2024-09-19T07:12:40.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.322+0000 7f6563fff640 1 -- 172.21.15.148:0/100724282 learned_addr learned my addr 172.21.15.148:0/100724282 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:40.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.322+0000 7f65637fe640 1 --2- 172.21.15.148:0/3077304360 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f654c0a33b0 0x7f654c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:40.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.323+0000 7f65637fe640 1 --2- 172.21.15.148:0/100724282 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b5adcbc5d0 0x55b5adcbca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:40.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.323+0000 7f6568a0a640 1 --2- 172.21.15.148:0/100724282 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5adcc7370 0x55b5adcc9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:40.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.323+0000 7f6563fff640 1 -- 172.21.15.148:0/100724282 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5adcc7370 msgr2=0x55b5adcc9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:40.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.323+0000 7f6563fff640 1 --2- 172.21.15.148:0/100724282 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5adcc7370 0x55b5adcc9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:40.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.323+0000 7f6563fff640 1 -- 172.21.15.148:0/100724282 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b5adcbc5d0 msgr2=0x55b5adcbca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:40.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.323+0000 7f6563fff640 1 --2- 172.21.15.148:0/100724282 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b5adcbc5d0 0x55b5adcbca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:40.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.323+0000 7f6563fff640 1 -- 172.21.15.148:0/100724282 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5adbae3a0 con 0x55b5adcbdb40 2024-09-19T07:12:40.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.323+0000 7f6568a0a640 1 --2- 172.21.15.148:0/100724282 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5adcc7370 0x55b5adcc9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:12:40.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.323+0000 7f65637fe640 1 --2- 172.21.15.148:0/3077304360 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f654c0a33b0 0x7f654c0a5870 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f65640fec10 tx=0x7f6558005a20 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:40.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.323+0000 7f6563fff640 1 --2- 172.21.15.148:0/100724282 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5adcbdb40 0x55b5adcbc090 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f655400bd10 tx=0x7f65540107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42069beaf7b35b9b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:40.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.323+0000 7f654a7fc640 1 -- 172.21.15.148:0/100724282 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6554004030 con 0x55b5adcbdb40 2024-09-19T07:12:40.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.323+0000 7f654a7fc640 1 -- 172.21.15.148:0/100724282 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65540041d0 con 0x55b5adcbdb40 2024-09-19T07:12:40.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.323+0000 7f654a7fc640 1 -- 172.21.15.148:0/100724282 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6554011840 con 0x55b5adcbdb40 2024-09-19T07:12:40.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.324+0000 7f656c846740 1 -- 172.21.15.148:0/100724282 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5adcbdb40 msgr2=0x55b5adcbc090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:40.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.324+0000 7f656c846740 1 --2- 172.21.15.148:0/100724282 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5adcbdb40 0x55b5adcbc090 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f655400bd10 tx=0x7f65540107a0 comp rx=0 tx=0).stop 2024-09-19T07:12:40.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.324+0000 7f656c846740 1 -- 172.21.15.148:0/100724282 shutdown_connections 2024-09-19T07:12:40.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.324+0000 7f656c846740 1 --2- 172.21.15.148:0/100724282 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5adcc7370 0x55b5adcc9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:40.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.324+0000 7f656c846740 1 --2- 172.21.15.148:0/100724282 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b5adcbc5d0 0x55b5adcbca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:40.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.324+0000 7f656c846740 1 --2- 172.21.15.148:0/100724282 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5adcbdb40 0x55b5adcbc090 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:40.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.324+0000 7f656c846740 1 -- 172.21.15.148:0/100724282 >> 172.21.15.148:0/100724282 conn(0x55b5adc85310 msgr2=0x55b5adcb8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:40.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.324+0000 7f656c846740 1 -- 172.21.15.148:0/100724282 shutdown_connections 2024-09-19T07:12:40.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.324+0000 7f656c846740 1 -- 172.21.15.148:0/100724282 wait complete. 2024-09-19T07:12:40.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.324+0000 7f656c846740 1 -- start start 2024-09-19T07:12:40.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.324+0000 7f656c846740 1 Processor -- start 2024-09-19T07:12:40.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.325+0000 7f656c846740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5adcbc5d0 0x55b5adcc2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:40.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.325+0000 7f656c846740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b5adcbdb40 0x55b5adcc29b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:40.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.325+0000 7f656c846740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5adcc7370 0x55b5adcc2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:40.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.325+0000 7f656c846740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55b5adcc9f30 con 0x55b5adcbc5d0 2024-09-19T07:12:40.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.325+0000 7f656c846740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55b5adbdd060 con 0x55b5adcbdb40 2024-09-19T07:12:40.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.325+0000 7f656c846740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55b5adcca0b0 con 0x55b5adcc7370 2024-09-19T07:12:40.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.325+0000 7f656c846740 10 client.0 _ll_register_callbacks cb 0x55b5ad9308c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:12:40.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.325+0000 7f6563fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5adcbc5d0 0x55b5adcc2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:40.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.325+0000 7f6563fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5adcbc5d0 0x55b5adcc2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39714/0 (socket says 172.21.15.148:39714) 2024-09-19T07:12:40.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.325+0000 7f6563fff640 1 -- 172.21.15.148:0/1713408621 learned_addr learned my addr 172.21.15.148:0/1713408621 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:40.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.325+0000 7f6568a0a640 1 --2- 172.21.15.148:0/1713408621 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5adcc7370 0x55b5adcc2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:40.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.325+0000 7f65637fe640 1 --2- 172.21.15.148:0/1713408621 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b5adcbdb40 0x55b5adcc29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:40.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.325+0000 7f6563fff640 1 -- 172.21.15.148:0/1713408621 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5adcc7370 msgr2=0x55b5adcc2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:40.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.325+0000 7f6563fff640 1 --2- 172.21.15.148:0/1713408621 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5adcc7370 0x55b5adcc2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:40.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.325+0000 7f6563fff640 1 -- 172.21.15.148:0/1713408621 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b5adcbdb40 msgr2=0x55b5adcc29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:40.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.325+0000 7f6563fff640 1 --2- 172.21.15.148:0/1713408621 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b5adcbdb40 0x55b5adcc29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:40.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.325+0000 7f6563fff640 1 -- 172.21.15.148:0/1713408621 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5ad9933c0 con 0x55b5adcbc5d0 2024-09-19T07:12:40.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.325+0000 7f65637fe640 1 --2- 172.21.15.148:0/1713408621 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b5adcbdb40 0x55b5adcc29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:12:40.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.325+0000 7f6568a0a640 1 --2- 172.21.15.148:0/1713408621 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5adcc7370 0x55b5adcc2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:12:40.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.325+0000 7f6563fff640 1 --2- 172.21.15.148:0/1713408621 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5adcbc5d0 0x55b5adcc2470 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f6554006010 tx=0x7f65540058f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49f131074bd01377 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:40.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.325+0000 7f65437fe640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:12:40.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.326+0000 7f65437fe640 1 -- 172.21.15.148:0/1713408621 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6554029060 con 0x55b5adcbc5d0 2024-09-19T07:12:40.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.326+0000 7f65437fe640 1 -- 172.21.15.148:0/1713408621 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f6554004380 con 0x55b5adcbc5d0 2024-09-19T07:12:40.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.326+0000 7f656c846740 1 -- 172.21.15.148:0/1713408621 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65540041d0 con 0x55b5adcbc5d0 2024-09-19T07:12:40.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.326+0000 7f65437fe640 1 -- 172.21.15.148:0/1713408621 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f65540035f0 con 0x55b5adcbc5d0 2024-09-19T07:12:40.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.326+0000 7f656c846740 10 client.15762 fetch_fsmap learned FSMap version 25 2024-09-19T07:12:40.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.326+0000 7f656c846740 1 -- 172.21.15.148:0/1713408621 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b5adcd5a70 con 0x55b5adcbc5d0 2024-09-19T07:12:40.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.326+0000 7f65437fe640 1 -- 172.21.15.148:0/1713408621 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65540041d0 con 0x55b5adcbc5d0 2024-09-19T07:12:40.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.326+0000 7f65437fe640 1 -- 172.21.15.148:0/1713408621 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6554004700 con 0x55b5adcbc5d0 2024-09-19T07:12:40.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.326+0000 7f656c846740 10 client.15762 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:12:40.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.326+0000 7f656c846740 10 client.15762 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T07:12:40.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.326+0000 7f656c846740 20 client.15762 populate_metadata read hostname 'smithi148' 2024-09-19T07:12:40.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.326+0000 7f656c846740 1 --2- 172.21.15.148:0/1713408621 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x55b5adcd6e70 0x55b5adcd9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:40.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.326+0000 7f656c846740 4 client.15762 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:12:40.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.326+0000 7f656c846740 1 -- 172.21.15.148:0/1713408621 --> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b5adc2f860 con 0x55b5adcd6e70 2024-09-19T07:12:40.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.327+0000 7f65637fe640 1 --2- 172.21.15.148:0/1713408621 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x55b5adcd6e70 0x55b5adcd9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:40.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.327+0000 7f65437fe640 10 client.15762 ms_handle_connect on v2:172.21.15.165:6838/3993490234 2024-09-19T07:12:40.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.327+0000 7f65637fe640 1 --2- 172.21.15.148:0/1713408621 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x55b5adcd6e70 0x55b5adcd9260 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4ce692cbb7c5e6cd server_cookie=b390679d4cc65168 in_seq=0 out_seq=0 2024-09-19T07:12:40.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.328+0000 7f65437fe640 1 -- 172.21.15.148:0/1713408621 <== mds.1 v2:172.21.15.165:6838/3993490234 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b5adc2f860 con 0x55b5adcd6e70 2024-09-19T07:12:40.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.328+0000 7f65437fe640 10 client.15762 handle_command_reply: tid=0 2024-09-19T07:12:40.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.328+0000 7f656c846740 1 client.15762 shutdown 2024-09-19T07:12:40.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.328+0000 7f656c846740 1 -- 172.21.15.148:0/1713408621 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5adcbc5d0 msgr2=0x55b5adcc2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:40.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.328+0000 7f656c846740 1 --2- 172.21.15.148:0/1713408621 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5adcbc5d0 0x55b5adcc2470 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f6554006010 tx=0x7f65540058f0 comp rx=0 tx=0).stop 2024-09-19T07:12:40.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.328+0000 7f656c846740 1 -- 172.21.15.148:0/1713408621 shutdown_connections 2024-09-19T07:12:40.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.328+0000 7f656c846740 1 --2- 172.21.15.148:0/1713408621 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5adcc7370 0x55b5adcc2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:40.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.328+0000 7f656c846740 1 --2- 172.21.15.148:0/1713408621 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x55b5adcd6e70 0x55b5adcd9260 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:40.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.328+0000 7f656c846740 1 --2- 172.21.15.148:0/1713408621 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b5adcbdb40 0x55b5adcc29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:40.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.328+0000 7f656c846740 1 --2- 172.21.15.148:0/1713408621 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5adcbc5d0 0x55b5adcc2470 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:40.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.328+0000 7f65437fe640 0 client.15762 ms_handle_reset on v2:172.21.15.165:6838/3993490234 2024-09-19T07:12:40.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.328+0000 7f656c846740 1 -- 172.21.15.148:0/1713408621 >> 172.21.15.148:0/1713408621 conn(0x55b5adc85310 msgr2=0x55b5adcbe960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:40.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.328+0000 7f656c846740 1 -- 172.21.15.148:0/1713408621 shutdown_connections 2024-09-19T07:12:40.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.328+0000 7f656c846740 1 -- 172.21.15.148:0/1713408621 wait complete. 2024-09-19T07:12:40.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.328+0000 7f656c846740 20 client.15762 trim_cache size 0 max 16384 2024-09-19T07:12:40.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.341+0000 7f656c846740 1 Processor -- start 2024-09-19T07:12:40.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.341+0000 7f656c846740 1 -- start start 2024-09-19T07:12:40.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.341+0000 7f656c846740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5adcbc5d0 0x55b5adccb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:40.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.341+0000 7f656c846740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5adcbdb40 0x55b5adccb850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:40.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.341+0000 7f656c846740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b5adcc7370 0x55b5adcd2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:40.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.341+0000 7f656c846740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f65641ae000 con 0x55b5adcbc5d0 2024-09-19T07:12:40.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.341+0000 7f656c846740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f65641ab8d0 con 0x55b5adcc7370 2024-09-19T07:12:40.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.341+0000 7f656c846740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f65641a9700 con 0x55b5adcbdb40 2024-09-19T07:12:40.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.342+0000 7f6563fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5adcbc5d0 0x55b5adccb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:40.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.342+0000 7f6563fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5adcbc5d0 0x55b5adccb310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39730/0 (socket says 172.21.15.148:39730) 2024-09-19T07:12:40.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.342+0000 7f6563fff640 1 -- 172.21.15.148:0/1312632061 learned_addr learned my addr 172.21.15.148:0/1312632061 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:40.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.342+0000 7f65637fe640 1 --2- 172.21.15.148:0/1312632061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5adcbdb40 0x55b5adccb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:40.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.342+0000 7f6563fff640 1 -- 172.21.15.148:0/1312632061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5adcbdb40 msgr2=0x55b5adccb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:40.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.342+0000 7f6563fff640 1 --2- 172.21.15.148:0/1312632061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5adcbdb40 0x55b5adccb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:40.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.342+0000 7f6563fff640 1 -- 172.21.15.148:0/1312632061 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b5adcc7370 msgr2=0x55b5adcd2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:40.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.342+0000 7f6563fff640 1 --2- 172.21.15.148:0/1312632061 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b5adcc7370 0x55b5adcd2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:40.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.342+0000 7f6563fff640 1 -- 172.21.15.148:0/1312632061 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5adcc37f0 con 0x55b5adcbc5d0 2024-09-19T07:12:40.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.342+0000 7f65637fe640 1 --2- 172.21.15.148:0/1312632061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5adcbdb40 0x55b5adccb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:12:40.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.342+0000 7f6563fff640 1 --2- 172.21.15.148:0/1312632061 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5adcbc5d0 0x55b5adccb310 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f655400b7d0 tx=0x7f655400b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a96b16dcc5cfde9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:40.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.342+0000 7f6549ffb640 1 -- 172.21.15.148:0/1312632061 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6554029030 con 0x55b5adcbc5d0 2024-09-19T07:12:40.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.342+0000 7f6549ffb640 1 -- 172.21.15.148:0/1312632061 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6554003c70 con 0x55b5adcbc5d0 2024-09-19T07:12:40.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.342+0000 7f6549ffb640 1 -- 172.21.15.148:0/1312632061 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6554004400 con 0x55b5adcbc5d0 2024-09-19T07:12:40.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.343+0000 7f656c846740 1 -- 172.21.15.148:0/1312632061 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5adcbc5d0 msgr2=0x55b5adccb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:40.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.343+0000 7f656c846740 1 --2- 172.21.15.148:0/1312632061 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5adcbc5d0 0x55b5adccb310 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f655400b7d0 tx=0x7f655400b390 comp rx=0 tx=0).stop 2024-09-19T07:12:40.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.343+0000 7f656c846740 1 -- 172.21.15.148:0/1312632061 shutdown_connections 2024-09-19T07:12:40.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.343+0000 7f656c846740 1 --2- 172.21.15.148:0/1312632061 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b5adcc7370 0x55b5adcd2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:40.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.343+0000 7f656c846740 1 --2- 172.21.15.148:0/1312632061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5adcbdb40 0x55b5adccb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:40.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.343+0000 7f656c846740 1 --2- 172.21.15.148:0/1312632061 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5adcbc5d0 0x55b5adccb310 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:40.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.343+0000 7f656c846740 1 -- 172.21.15.148:0/1312632061 >> 172.21.15.148:0/1312632061 conn(0x55b5adc85310 msgr2=0x55b5adcc2c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:40.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.343+0000 7f656c846740 1 -- 172.21.15.148:0/1312632061 shutdown_connections 2024-09-19T07:12:40.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.343+0000 7f656c846740 1 -- 172.21.15.148:0/1312632061 wait complete. 2024-09-19T07:12:40.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.344+0000 7f656c846740 1 -- start start 2024-09-19T07:12:40.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.344+0000 7f656c846740 1 Processor -- start 2024-09-19T07:12:40.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.344+0000 7f656c846740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5adcbc5d0 0x55b5adcbe6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:40.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.344+0000 7f656c846740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5adcbdb40 0x55b5adcbebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:40.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.344+0000 7f656c846740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b5adcc7370 0x55b5adcbf130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:40.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.344+0000 7f656c846740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f65641a9d90 con 0x55b5adcbc5d0 2024-09-19T07:12:40.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.344+0000 7f656c846740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f65641ab200 con 0x55b5adcc7370 2024-09-19T07:12:40.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.344+0000 7f656c846740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f65641aa460 con 0x55b5adcbdb40 2024-09-19T07:12:40.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.344+0000 7f656c846740 10 client.0 _ll_register_callbacks cb 0x7f655400bb60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:12:40.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.344+0000 7f6563fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5adcbc5d0 0x55b5adcbe6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:40.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.344+0000 7f6563fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5adcbc5d0 0x55b5adcbe6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39746/0 (socket says 172.21.15.148:39746) 2024-09-19T07:12:40.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.344+0000 7f6563fff640 1 -- 172.21.15.148:0/136959994 learned_addr learned my addr 172.21.15.148:0/136959994 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:40.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.344+0000 7f65637fe640 1 --2- 172.21.15.148:0/136959994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5adcbdb40 0x55b5adcbebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:40.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.344+0000 7f6563fff640 1 -- 172.21.15.148:0/136959994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5adcbdb40 msgr2=0x55b5adcbebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:40.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.345+0000 7f6563fff640 1 --2- 172.21.15.148:0/136959994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5adcbdb40 0x55b5adcbebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:40.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.345+0000 7f6563fff640 1 -- 172.21.15.148:0/136959994 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b5adcc7370 msgr2=0x55b5adcbf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:40.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.345+0000 7f6568a0a640 1 --2- 172.21.15.148:0/136959994 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b5adcc7370 0x55b5adcbf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:40.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.345+0000 7f6563fff640 1 --2- 172.21.15.148:0/136959994 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b5adcc7370 0x55b5adcbf130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:40.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.345+0000 7f6563fff640 1 -- 172.21.15.148:0/136959994 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5adcd20e0 con 0x55b5adcbc5d0 2024-09-19T07:12:40.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.345+0000 7f6568a0a640 1 --2- 172.21.15.148:0/136959994 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b5adcc7370 0x55b5adcbf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:12:40.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.345+0000 7f6563fff640 1 --2- 172.21.15.148:0/136959994 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5adcbc5d0 0x55b5adcbe6b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f6554003a40 tx=0x7f6554003e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd5785c124c1cfe8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:40.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.345+0000 7f65437fe640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:12:40.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.345+0000 7f65437fe640 1 -- 172.21.15.148:0/136959994 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f655403a070 con 0x55b5adcbc5d0 2024-09-19T07:12:40.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.345+0000 7f65437fe640 1 -- 172.21.15.148:0/136959994 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f6554011930 con 0x55b5adcbc5d0 2024-09-19T07:12:40.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.345+0000 7f656c846740 1 -- 172.21.15.148:0/136959994 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6554003c70 con 0x55b5adcbc5d0 2024-09-19T07:12:40.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.345+0000 7f65437fe640 1 -- 172.21.15.148:0/136959994 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6554046050 con 0x55b5adcbc5d0 2024-09-19T07:12:40.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.345+0000 7f656c846740 10 client.15768 fetch_fsmap learned FSMap version 25 2024-09-19T07:12:40.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.345+0000 7f656c846740 1 -- 172.21.15.148:0/136959994 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b5add4a320 con 0x55b5adcbc5d0 2024-09-19T07:12:40.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.345+0000 7f65437fe640 1 -- 172.21.15.148:0/136959994 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6554003c70 con 0x55b5adcbc5d0 2024-09-19T07:12:40.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.346+0000 7f65437fe640 1 -- 172.21.15.148:0/136959994 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6554004dd0 con 0x55b5adcbc5d0 2024-09-19T07:12:40.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.346+0000 7f656c846740 10 client.15768 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:12:40.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.346+0000 7f656c846740 10 client.15768 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T07:12:40.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.346+0000 7f656c846740 20 client.15768 populate_metadata read hostname 'smithi148' 2024-09-19T07:12:40.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.346+0000 7f656c846740 1 --2- 172.21.15.148:0/136959994 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x55b5add4aa90 0x55b5add4ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:40.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.346+0000 7f656c846740 4 client.15768 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:12:40.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.346+0000 7f656c846740 1 -- 172.21.15.148:0/136959994 --> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b5adc29d70 con 0x55b5add4aa90 2024-09-19T07:12:40.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.346+0000 7f65637fe640 1 --2- 172.21.15.148:0/136959994 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x55b5add4aa90 0x55b5add4ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:40.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.346+0000 7f65437fe640 10 client.15768 ms_handle_connect on v2:172.21.15.165:6838/3993490234 2024-09-19T07:12:40.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.346+0000 7f65637fe640 1 --2- 172.21.15.148:0/136959994 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x55b5add4aa90 0x55b5add4ceb0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=15ac444beabef9da server_cookie=6728d28b358baf3d in_seq=0 out_seq=0 2024-09-19T07:12:40.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.346+0000 7f65437fe640 1 -- 172.21.15.148:0/136959994 <== mds.1 v2:172.21.15.165:6838/3993490234 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b5adc29d70 con 0x55b5add4aa90 2024-09-19T07:12:40.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.346+0000 7f65437fe640 10 client.15768 handle_command_reply: tid=0 2024-09-19T07:12:40.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.346+0000 7f656c846740 1 client.15768 shutdown 2024-09-19T07:12:40.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.347+0000 7f656c846740 1 -- 172.21.15.148:0/136959994 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5adcbc5d0 msgr2=0x55b5adcbe6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:40.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.347+0000 7f656c846740 1 --2- 172.21.15.148:0/136959994 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5adcbc5d0 0x55b5adcbe6b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f6554003a40 tx=0x7f6554003e20 comp rx=0 tx=0).stop 2024-09-19T07:12:40.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.347+0000 7f656c846740 1 -- 172.21.15.148:0/136959994 shutdown_connections 2024-09-19T07:12:40.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.347+0000 7f656c846740 1 --2- 172.21.15.148:0/136959994 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x55b5add4aa90 0x55b5add4ceb0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:40.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.347+0000 7f656c846740 1 --2- 172.21.15.148:0/136959994 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b5adcc7370 0x55b5adcbf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:40.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.347+0000 7f656c846740 1 --2- 172.21.15.148:0/136959994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b5adcbdb40 0x55b5adcbebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:40.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.347+0000 7f65437fe640 0 client.15768 ms_handle_reset on v2:172.21.15.165:6838/3993490234 2024-09-19T07:12:40.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.347+0000 7f656c846740 1 --2- 172.21.15.148:0/136959994 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b5adcbc5d0 0x55b5adcbe6b0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:40.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.347+0000 7f656c846740 1 -- 172.21.15.148:0/136959994 >> 172.21.15.148:0/136959994 conn(0x55b5adc85310 msgr2=0x55b5adcc22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:40.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.347+0000 7f656c846740 1 -- 172.21.15.148:0/136959994 shutdown_connections 2024-09-19T07:12:40.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.347+0000 7f656c846740 1 -- 172.21.15.148:0/136959994 wait complete. 2024-09-19T07:12:40.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.347+0000 7f656c846740 20 client.15768 trim_cache size 0 max 16384 2024-09-19T07:12:40.367 INFO:teuthology.orchestra.run.smithi148.stdout:[] 2024-09-19T07:12:40.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.347+0000 7f656a46d640 1 -- 172.21.15.148:0/3077304360 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f654c0a33b0 msgr2=0x7f654c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:40.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.347+0000 7f656a46d640 1 --2- 172.21.15.148:0/3077304360 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f654c0a33b0 0x7f654c0a5870 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f65640fec10 tx=0x7f6558005a20 comp rx=0 tx=0).stop 2024-09-19T07:12:40.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.347+0000 7f656a46d640 1 -- 172.21.15.148:0/3077304360 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6564102ef0 msgr2=0x7f656419bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:40.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.347+0000 7f656a46d640 1 --2- 172.21.15.148:0/3077304360 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6564102ef0 0x7f656419bcb0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f655c00cad0 tx=0x7f655c00cf90 comp rx=0 tx=0).stop 2024-09-19T07:12:40.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.347+0000 7f656a46d640 1 -- 172.21.15.148:0/3077304360 shutdown_connections 2024-09-19T07:12:40.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.347+0000 7f656a46d640 1 --2- 172.21.15.148:0/3077304360 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f654c0a33b0 0x7f654c0a5870 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:40.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.347+0000 7f656a46d640 1 --2- 172.21.15.148:0/3077304360 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6564102ef0 0x7f656419bcb0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:40.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.347+0000 7f656a46d640 1 --2- 172.21.15.148:0/3077304360 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6564102570 0x7f6564197920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:40.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.347+0000 7f656a46d640 1 --2- 172.21.15.148:0/3077304360 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6564100e20 0x7f65641973e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:40.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.347+0000 7f656a46d640 1 -- 172.21.15.148:0/3077304360 >> 172.21.15.148:0/3077304360 conn(0x7f65640fc7d0 msgr2=0x7f6564106910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:40.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.347+0000 7f656a46d640 1 -- 172.21.15.148:0/3077304360 shutdown_connections 2024-09-19T07:12:40.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:40.348+0000 7f656a46d640 1 -- 172.21.15.148:0/3077304360 wait complete. 2024-09-19T07:12:40.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:40 smithi148 ceph-mon[31180]: pgmap v51: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-09-19T07:12:40.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:40 smithi179 ceph-mon[35716]: pgmap v51: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-09-19T07:12:40.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:40 smithi165 ceph-mon[35326]: pgmap v51: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-09-19T07:12:41.024 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T07:12:41.268 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:12:41.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.738+0000 7f4a0e72c640 1 -- 172.21.15.148:0/2120382846 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4a08106a80 msgr2=0x7f4a08106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:41.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.738+0000 7f4a0e72c640 1 --2- 172.21.15.148:0/2120382846 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4a08106a80 0x7f4a08106e60 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f49f8009930 tx=0x7f49f802a420 comp rx=0 tx=0).stop 2024-09-19T07:12:41.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.738+0000 7f4a0e72c640 1 -- 172.21.15.148:0/2120382846 shutdown_connections 2024-09-19T07:12:41.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.738+0000 7f4a0e72c640 1 --2- 172.21.15.148:0/2120382846 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4a08101420 0x7f4a0810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:41.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.738+0000 7f4a0e72c640 1 --2- 172.21.15.148:0/2120382846 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a08100a80 0x7f4a08100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:41.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.738+0000 7f4a0e72c640 1 --2- 172.21.15.148:0/2120382846 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4a08106a80 0x7f4a08106e60 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:41.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.738+0000 7f4a0e72c640 1 -- 172.21.15.148:0/2120382846 >> 172.21.15.148:0/2120382846 conn(0x7f4a080fc7a0 msgr2=0x7f4a080febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:41.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.739+0000 7f4a0e72c640 1 -- 172.21.15.148:0/2120382846 shutdown_connections 2024-09-19T07:12:41.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.739+0000 7f4a0e72c640 1 -- 172.21.15.148:0/2120382846 wait complete. 2024-09-19T07:12:41.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.739+0000 7f4a0e72c640 1 Processor -- start 2024-09-19T07:12:41.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.739+0000 7f4a0e72c640 1 -- start start 2024-09-19T07:12:41.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.739+0000 7f4a0e72c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a08100a80 0x7f4a08197090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:41.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.739+0000 7f4a0e72c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4a08101420 0x7f4a081975d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:41.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.739+0000 7f4a0e72c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4a08106a80 0x7f4a08197b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:41.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.739+0000 7f4a0e72c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4a08110e40 con 0x7f4a08106a80 2024-09-19T07:12:41.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.739+0000 7f4a0e72c640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4a08110cc0 con 0x7f4a08101420 2024-09-19T07:12:41.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.739+0000 7f4a0e72c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4a08110fc0 con 0x7f4a08100a80 2024-09-19T07:12:41.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.739+0000 7f4a0ccc9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4a08106a80 0x7f4a08197b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:41.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.740+0000 7f4a0ccc9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4a08106a80 0x7f4a08197b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39770/0 (socket says 172.21.15.148:39770) 2024-09-19T07:12:41.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.740+0000 7f4a0ccc9640 1 -- 172.21.15.148:0/2565323177 learned_addr learned my addr 172.21.15.148:0/2565323177 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:41.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.740+0000 7f4a07fff640 1 --2- 172.21.15.148:0/2565323177 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a08100a80 0x7f4a08197090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:41.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.740+0000 7f49fffff640 1 --2- 172.21.15.148:0/2565323177 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4a08101420 0x7f4a081975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:41.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.740+0000 7f4a0ccc9640 1 -- 172.21.15.148:0/2565323177 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a08100a80 msgr2=0x7f4a08197090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:41.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.740+0000 7f4a0ccc9640 1 --2- 172.21.15.148:0/2565323177 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a08100a80 0x7f4a08197090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:41.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.740+0000 7f4a0ccc9640 1 -- 172.21.15.148:0/2565323177 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4a08101420 msgr2=0x7f4a081975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:41.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.740+0000 7f4a0ccc9640 1 --2- 172.21.15.148:0/2565323177 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4a08101420 0x7f4a081975d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:41.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.740+0000 7f4a0ccc9640 1 -- 172.21.15.148:0/2565323177 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a081a6900 con 0x7f4a08106a80 2024-09-19T07:12:41.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.740+0000 7f49fffff640 1 --2- 172.21.15.148:0/2565323177 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4a08101420 0x7f4a081975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:12:41.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.740+0000 7f4a0ccc9640 1 --2- 172.21.15.148:0/2565323177 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4a08106a80 0x7f4a08197b10 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f4a0000eaa0 tx=0x7f4a0000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:41.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.740+0000 7f4a05ffb640 1 -- 172.21.15.148:0/2565323177 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a0000cdb0 con 0x7f4a08106a80 2024-09-19T07:12:41.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.740+0000 7f4a0e72c640 1 -- 172.21.15.148:0/2565323177 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a081a6bf0 con 0x7f4a08106a80 2024-09-19T07:12:41.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.740+0000 7f4a05ffb640 1 -- 172.21.15.148:0/2565323177 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a00005020 con 0x7f4a08106a80 2024-09-19T07:12:41.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.740+0000 7f4a05ffb640 1 -- 172.21.15.148:0/2565323177 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a000116b0 con 0x7f4a08106a80 2024-09-19T07:12:41.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.740+0000 7f4a0e72c640 1 -- 172.21.15.148:0/2565323177 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a081a70e0 con 0x7f4a08106a80 2024-09-19T07:12:41.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.743+0000 7f4a10b05740 1 Processor -- start 2024-09-19T07:12:41.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.743+0000 7f4a05ffb640 1 -- 172.21.15.148:0/2565323177 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f4a00005560 con 0x7f4a08106a80 2024-09-19T07:12:41.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.743+0000 7f4a10b05740 1 -- start start 2024-09-19T07:12:41.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.744+0000 7f4a10b05740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cac613b40 0x561cac612090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:41.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.744+0000 7f4a10b05740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561cac6125d0 0x561cac612a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:41.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.744+0000 7f4a10b05740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561cac61d370 0x561cac61f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:41.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.744+0000 7f4a10b05740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x561cac5782f0 con 0x561cac613b40 2024-09-19T07:12:41.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.744+0000 7f4a10b05740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x561cac51fcf0 con 0x561cac6125d0 2024-09-19T07:12:41.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.744+0000 7f4a10b05740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x561cac5742b0 con 0x561cac61d370 2024-09-19T07:12:41.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.744+0000 7f49fffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cac613b40 0x561cac612090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:41.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.744+0000 7f49fffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cac613b40 0x561cac612090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39782/0 (socket says 172.21.15.148:39782) 2024-09-19T07:12:41.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.744+0000 7f49fffff640 1 -- 172.21.15.148:0/3639142883 learned_addr learned my addr 172.21.15.148:0/3639142883 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:41.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.744+0000 7f4a07fff640 1 --2- 172.21.15.148:0/3639142883 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561cac6125d0 0x561cac612a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:41.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.744+0000 7f49fffff640 1 -- 172.21.15.148:0/3639142883 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561cac61d370 msgr2=0x561cac61f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:41.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.744+0000 7f49fffff640 1 --2- 172.21.15.148:0/3639142883 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561cac61d370 0x561cac61f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:41.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.744+0000 7f4a05ffb640 1 --2- 172.21.15.148:0/2565323177 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f49f40a33b0 0x7f49f40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:41.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.744+0000 7f49fffff640 1 -- 172.21.15.148:0/3639142883 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561cac6125d0 msgr2=0x561cac612a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:41.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.744+0000 7f49fffff640 1 --2- 172.21.15.148:0/3639142883 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561cac6125d0 0x561cac612a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:41.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.744+0000 7f49fffff640 1 -- 172.21.15.148:0/3639142883 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cac5043a0 con 0x561cac613b40 2024-09-19T07:12:41.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.744+0000 7f4a07fff640 1 --2- 172.21.15.148:0/3639142883 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561cac6125d0 0x561cac612a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:12:41.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.744+0000 7f4a0ccc9640 1 --2- 172.21.15.148:0/2565323177 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f49f40a33b0 0x7f49f40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:41.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.744+0000 7f49fffff640 1 --2- 172.21.15.148:0/3639142883 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cac613b40 0x561cac612090 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f49f0008cc0 tx=0x7f49f0010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9afb6f54f6a91816 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:41.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.744+0000 7f4a05ffb640 1 -- 172.21.15.148:0/2565323177 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f4a000cff20 con 0x7f4a08106a80 2024-09-19T07:12:41.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.745+0000 7f49fe7fc640 1 -- 172.21.15.148:0/3639142883 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f0016070 con 0x561cac613b40 2024-09-19T07:12:41.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.745+0000 7f49fe7fc640 1 -- 172.21.15.148:0/3639142883 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f49f0005700 con 0x561cac613b40 2024-09-19T07:12:41.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.745+0000 7f49fe7fc640 1 -- 172.21.15.148:0/3639142883 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f0012770 con 0x561cac613b40 2024-09-19T07:12:41.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.745+0000 7f4a10b05740 1 -- 172.21.15.148:0/3639142883 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cac613b40 msgr2=0x561cac612090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:41.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.745+0000 7f4a0ccc9640 1 --2- 172.21.15.148:0/2565323177 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f49f40a33b0 0x7f49f40a5870 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4a00098620 tx=0x7f4a000a0040 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:41.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.745+0000 7f4a10b05740 1 --2- 172.21.15.148:0/3639142883 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cac613b40 0x561cac612090 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f49f0008cc0 tx=0x7f49f0010740 comp rx=0 tx=0).stop 2024-09-19T07:12:41.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.745+0000 7f4a10b05740 1 -- 172.21.15.148:0/3639142883 shutdown_connections 2024-09-19T07:12:41.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.745+0000 7f4a10b05740 1 --2- 172.21.15.148:0/3639142883 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561cac61d370 0x561cac61f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:41.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.745+0000 7f4a10b05740 1 --2- 172.21.15.148:0/3639142883 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561cac6125d0 0x561cac612a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:41.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.745+0000 7f4a10b05740 1 --2- 172.21.15.148:0/3639142883 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cac613b40 0x561cac612090 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:41.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.745+0000 7f4a10b05740 1 -- 172.21.15.148:0/3639142883 >> 172.21.15.148:0/3639142883 conn(0x561cac5db310 msgr2=0x561cac60ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:41.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.745+0000 7f4a10b05740 1 -- 172.21.15.148:0/3639142883 shutdown_connections 2024-09-19T07:12:41.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.745+0000 7f4a10b05740 1 -- 172.21.15.148:0/3639142883 wait complete. 2024-09-19T07:12:41.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.746+0000 7f4a10b05740 1 -- start start 2024-09-19T07:12:41.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.746+0000 7f4a10b05740 1 Processor -- start 2024-09-19T07:12:41.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.746+0000 7f4a10b05740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561cac6125d0 0x561cac61cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:41.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.746+0000 7f4a10b05740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561cac613b40 0x561cac619fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:41.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.746+0000 7f4a10b05740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cac61d370 0x561cac61a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:41.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.746+0000 7f4a10b05740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x561cac620070 con 0x561cac61d370 2024-09-19T07:12:41.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.746+0000 7f4a10b05740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x561cac533060 con 0x561cac6125d0 2024-09-19T07:12:41.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.746+0000 7f4a10b05740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x561cac6201f0 con 0x561cac613b40 2024-09-19T07:12:41.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.746+0000 7f4a10b05740 10 client.0 _ll_register_callbacks cb 0x561cac2868c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:12:41.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.747+0000 7f49fffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cac61d370 0x561cac61a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:41.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.747+0000 7f49fffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cac61d370 0x561cac61a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39796/0 (socket says 172.21.15.148:39796) 2024-09-19T07:12:41.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.747+0000 7f49fffff640 1 -- 172.21.15.148:0/620402181 learned_addr learned my addr 172.21.15.148:0/620402181 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:41.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.747+0000 7f4a07fff640 1 --2- 172.21.15.148:0/620402181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561cac613b40 0x561cac619fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:41.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.747+0000 7f49fffff640 1 --2- 172.21.15.148:0/620402181 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561cac6125d0 0x561cac61cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:41.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.747+0000 7f49fffff640 1 -- 172.21.15.148:0/620402181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561cac613b40 msgr2=0x561cac619fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:41.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.747+0000 7f49fffff640 1 --2- 172.21.15.148:0/620402181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561cac613b40 0x561cac619fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:41.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.747+0000 7f49fffff640 1 -- 172.21.15.148:0/620402181 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561cac6125d0 msgr2=0x561cac61cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:41.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.747+0000 7f49fffff640 1 --2- 172.21.15.148:0/620402181 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561cac6125d0 0x561cac61cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:41.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.747+0000 7f49fffff640 1 -- 172.21.15.148:0/620402181 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cac2e93c0 con 0x561cac61d370 2024-09-19T07:12:41.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.747+0000 7f49fffff640 1 --2- 172.21.15.148:0/620402181 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cac61d370 0x561cac61a5d0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f49f0010c40 tx=0x7f49f0004ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d42a72c10d17ea0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:41.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.747+0000 7f49e77fe640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:12:41.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.747+0000 7f49e77fe640 1 -- 172.21.15.148:0/620402181 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f001e020 con 0x561cac61d370 2024-09-19T07:12:41.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.747+0000 7f49e77fe640 1 -- 172.21.15.148:0/620402181 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f49f00124f0 con 0x561cac61d370 2024-09-19T07:12:41.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.747+0000 7f4a10b05740 1 -- 172.21.15.148:0/620402181 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49f0005700 con 0x561cac61d370 2024-09-19T07:12:41.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.747+0000 7f49e77fe640 1 -- 172.21.15.148:0/620402181 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f49f0016070 con 0x561cac61d370 2024-09-19T07:12:41.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.747+0000 7f4a10b05740 10 client.15780 fetch_fsmap learned FSMap version 25 2024-09-19T07:12:41.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.748+0000 7f4a10b05740 1 -- 172.21.15.148:0/620402181 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561cac62ba70 con 0x561cac61d370 2024-09-19T07:12:41.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.748+0000 7f49e77fe640 1 -- 172.21.15.148:0/620402181 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f49f0005700 con 0x561cac61d370 2024-09-19T07:12:41.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.748+0000 7f49e77fe640 1 -- 172.21.15.148:0/620402181 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f49f001a6a0 con 0x561cac61d370 2024-09-19T07:12:41.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.748+0000 7f4a10b05740 10 client.15780 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:12:41.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.748+0000 7f4a10b05740 10 client.15780 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:12:41.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.748+0000 7f4a10b05740 20 client.15780 populate_metadata read hostname 'smithi148' 2024-09-19T07:12:41.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.748+0000 7f4a10b05740 1 --2- 172.21.15.148:0/620402181 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561cac62ce80 0x561cac62f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:41.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.748+0000 7f4a10b05740 4 client.15780 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:12:41.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.748+0000 7f4a10b05740 1 -- 172.21.15.148:0/620402181 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561cac585860 con 0x561cac62ce80 2024-09-19T07:12:41.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.748+0000 7f4a07fff640 1 --2- 172.21.15.148:0/620402181 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561cac62ce80 0x561cac62f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:41.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.749+0000 7f49e77fe640 10 client.15780 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:41.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.749+0000 7f4a07fff640 1 --2- 172.21.15.148:0/620402181 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561cac62ce80 0x561cac62f270 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e4d37e665edceec server_cookie=5911c23a5587765f in_seq=0 out_seq=0 2024-09-19T07:12:41.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.749+0000 7f49e77fe640 1 -- 172.21.15.148:0/620402181 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561cac585860 con 0x561cac62ce80 2024-09-19T07:12:41.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.749+0000 7f49e77fe640 10 client.15780 handle_command_reply: tid=0 2024-09-19T07:12:41.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.749+0000 7f4a10b05740 1 client.15780 shutdown 2024-09-19T07:12:41.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.749+0000 7f4a10b05740 1 -- 172.21.15.148:0/620402181 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cac61d370 msgr2=0x561cac61a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:41.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.749+0000 7f4a10b05740 1 --2- 172.21.15.148:0/620402181 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cac61d370 0x561cac61a5d0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f49f0010c40 tx=0x7f49f0004ea0 comp rx=0 tx=0).stop 2024-09-19T07:12:41.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.750+0000 7f4a10b05740 1 -- 172.21.15.148:0/620402181 shutdown_connections 2024-09-19T07:12:41.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.750+0000 7f4a10b05740 1 --2- 172.21.15.148:0/620402181 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561cac62ce80 0x561cac62f270 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:41.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.750+0000 7f4a10b05740 1 --2- 172.21.15.148:0/620402181 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cac61d370 0x561cac61a5d0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:41.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.750+0000 7f4a10b05740 1 --2- 172.21.15.148:0/620402181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561cac613b40 0x561cac619fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:41.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.750+0000 7f49e77fe640 0 client.15780 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:41.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.750+0000 7f4a10b05740 1 --2- 172.21.15.148:0/620402181 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561cac6125d0 0x561cac61cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:41.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.750+0000 7f4a10b05740 1 -- 172.21.15.148:0/620402181 >> 172.21.15.148:0/620402181 conn(0x561cac5db310 msgr2=0x561cac614930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:41.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.750+0000 7f4a10b05740 1 -- 172.21.15.148:0/620402181 shutdown_connections 2024-09-19T07:12:41.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.750+0000 7f4a10b05740 1 -- 172.21.15.148:0/620402181 wait complete. 2024-09-19T07:12:41.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.750+0000 7f4a10b05740 20 client.15780 trim_cache size 0 max 16384 2024-09-19T07:12:41.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.762+0000 7f4a10b05740 1 Processor -- start 2024-09-19T07:12:41.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.763+0000 7f4a10b05740 1 -- start start 2024-09-19T07:12:41.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.763+0000 7f4a10b05740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561cac6125d0 0x561cac629340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:41.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.763+0000 7f4a10b05740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561cac613b40 0x561cac615120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:41.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.763+0000 7f4a10b05740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cac61d370 0x561cac615660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:41.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.763+0000 7f4a10b05740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4a081b23d0 con 0x561cac61d370 2024-09-19T07:12:41.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.763+0000 7f4a10b05740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4a081afca0 con 0x561cac6125d0 2024-09-19T07:12:41.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.763+0000 7f4a10b05740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4a081adad0 con 0x561cac613b40 2024-09-19T07:12:41.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.763+0000 7f49fffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cac61d370 0x561cac615660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:41.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.763+0000 7f49fffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cac61d370 0x561cac615660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39800/0 (socket says 172.21.15.148:39800) 2024-09-19T07:12:41.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.763+0000 7f49fffff640 1 -- 172.21.15.148:0/3711243043 learned_addr learned my addr 172.21.15.148:0/3711243043 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:41.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.763+0000 7f49fffff640 1 -- 172.21.15.148:0/3711243043 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561cac613b40 msgr2=0x561cac615120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:41.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.763+0000 7f4a07fff640 1 --2- 172.21.15.148:0/3711243043 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561cac613b40 0x561cac615120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:41.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.763+0000 7f49fffff640 1 --2- 172.21.15.148:0/3711243043 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561cac613b40 0x561cac615120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:41.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.763+0000 7f49fffff640 1 -- 172.21.15.148:0/3711243043 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561cac6125d0 msgr2=0x561cac629340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:41.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.763+0000 7f49fffff640 1 --2- 172.21.15.148:0/3711243043 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561cac6125d0 0x561cac629340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:41.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.763+0000 7f49fffff640 1 -- 172.21.15.148:0/3711243043 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cac60f960 con 0x561cac61d370 2024-09-19T07:12:41.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.763+0000 7f49fffff640 1 --2- 172.21.15.148:0/3711243043 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cac61d370 0x561cac615660 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f49f0004f90 tx=0x7f49f0010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73f2c869c0bdebd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:41.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.764+0000 7f49fdffb640 1 -- 172.21.15.148:0/3711243043 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f001e070 con 0x561cac61d370 2024-09-19T07:12:41.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.764+0000 7f49fdffb640 1 -- 172.21.15.148:0/3711243043 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f49f001a8e0 con 0x561cac61d370 2024-09-19T07:12:41.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.764+0000 7f49fdffb640 1 -- 172.21.15.148:0/3711243043 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f00126e0 con 0x561cac61d370 2024-09-19T07:12:41.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.764+0000 7f4a10b05740 1 -- 172.21.15.148:0/3711243043 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cac61d370 msgr2=0x561cac615660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:41.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.764+0000 7f4a10b05740 1 --2- 172.21.15.148:0/3711243043 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cac61d370 0x561cac615660 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f49f0004f90 tx=0x7f49f0010740 comp rx=0 tx=0).stop 2024-09-19T07:12:41.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.764+0000 7f4a10b05740 1 -- 172.21.15.148:0/3711243043 shutdown_connections 2024-09-19T07:12:41.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.764+0000 7f4a10b05740 1 --2- 172.21.15.148:0/3711243043 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cac61d370 0x561cac615660 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:41.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.764+0000 7f4a10b05740 1 --2- 172.21.15.148:0/3711243043 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561cac613b40 0x561cac615120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:41.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.764+0000 7f4a10b05740 1 --2- 172.21.15.148:0/3711243043 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561cac6125d0 0x561cac629340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:41.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.764+0000 7f4a10b05740 1 -- 172.21.15.148:0/3711243043 >> 172.21.15.148:0/3711243043 conn(0x561cac5db310 msgr2=0x561cac6190d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:41.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.764+0000 7f4a10b05740 1 -- 172.21.15.148:0/3711243043 shutdown_connections 2024-09-19T07:12:41.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.764+0000 7f4a10b05740 1 -- 172.21.15.148:0/3711243043 wait complete. 2024-09-19T07:12:41.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.765+0000 7f4a10b05740 1 -- start start 2024-09-19T07:12:41.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.765+0000 7f4a10b05740 1 Processor -- start 2024-09-19T07:12:41.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.765+0000 7f4a10b05740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561cac6125d0 0x561cac625d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:41.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.765+0000 7f4a10b05740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561cac613b40 0x561cac621060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:41.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.765+0000 7f4a10b05740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cac61d370 0x561cac621670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:41.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.765+0000 7f4a10b05740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4a081ae160 con 0x561cac61d370 2024-09-19T07:12:41.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.765+0000 7f4a10b05740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4a081af5d0 con 0x561cac613b40 2024-09-19T07:12:41.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.765+0000 7f4a10b05740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4a081ae830 con 0x561cac6125d0 2024-09-19T07:12:41.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.765+0000 7f4a10b05740 10 client.0 _ll_register_callbacks cb 0x7f49f0008bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:12:41.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.765+0000 7f49fffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cac61d370 0x561cac621670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:41.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.765+0000 7f49fffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cac61d370 0x561cac621670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39810/0 (socket says 172.21.15.148:39810) 2024-09-19T07:12:41.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.765+0000 7f49fffff640 1 -- 172.21.15.148:0/4045650410 learned_addr learned my addr 172.21.15.148:0/4045650410 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:41.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.765+0000 7f49fffff640 1 --2- 172.21.15.148:0/4045650410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561cac6125d0 0x561cac625d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:41.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.765+0000 7f4a07fff640 1 --2- 172.21.15.148:0/4045650410 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561cac613b40 0x561cac621060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:41.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.766+0000 7f49fffff640 1 -- 172.21.15.148:0/4045650410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561cac6125d0 msgr2=0x561cac625d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:41.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.766+0000 7f49fffff640 1 --2- 172.21.15.148:0/4045650410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561cac6125d0 0x561cac625d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:41.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.766+0000 7f49fffff640 1 -- 172.21.15.148:0/4045650410 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561cac613b40 msgr2=0x561cac621060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:41.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.766+0000 7f49fffff640 1 --2- 172.21.15.148:0/4045650410 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561cac613b40 0x561cac621060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:41.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.766+0000 7f49fffff640 1 -- 172.21.15.148:0/4045650410 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cac621ea0 con 0x561cac61d370 2024-09-19T07:12:41.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.766+0000 7f49fffff640 1 --2- 172.21.15.148:0/4045650410 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cac61d370 0x561cac621670 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f49f001ac90 tx=0x7f49f0024040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be474b267c133cff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:41.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.766+0000 7f49e77fe640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:12:41.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.766+0000 7f49e77fe640 1 -- 172.21.15.148:0/4045650410 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f001e070 con 0x561cac61d370 2024-09-19T07:12:41.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.766+0000 7f49e77fe640 1 -- 172.21.15.148:0/4045650410 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f49f001a610 con 0x561cac61d370 2024-09-19T07:12:41.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.766+0000 7f4a10b05740 1 -- 172.21.15.148:0/4045650410 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561cac57fd70 con 0x561cac61d370 2024-09-19T07:12:41.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.766+0000 7f49e77fe640 1 -- 172.21.15.148:0/4045650410 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f49f0008960 con 0x561cac61d370 2024-09-19T07:12:41.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.766+0000 7f4a10b05740 10 client.15786 fetch_fsmap learned FSMap version 25 2024-09-19T07:12:41.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.766+0000 7f4a10b05740 1 -- 172.21.15.148:0/4045650410 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561cac697ab0 con 0x561cac61d370 2024-09-19T07:12:41.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.766+0000 7f49e77fe640 1 -- 172.21.15.148:0/4045650410 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x561cac57fd70 con 0x561cac61d370 2024-09-19T07:12:41.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.767+0000 7f49e77fe640 1 -- 172.21.15.148:0/4045650410 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f49f0037850 con 0x561cac61d370 2024-09-19T07:12:41.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.767+0000 7f4a10b05740 10 client.15786 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:12:41.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.767+0000 7f4a10b05740 10 client.15786 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:12:41.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.767+0000 7f4a10b05740 20 client.15786 populate_metadata read hostname 'smithi148' 2024-09-19T07:12:41.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.767+0000 7f4a10b05740 1 --2- 172.21.15.148:0/4045650410 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561cac6980b0 0x561cac69a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:41.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.767+0000 7f4a10b05740 4 client.15786 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:12:41.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.767+0000 7f4a10b05740 1 -- 172.21.15.148:0/4045650410 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561cac4fc170 con 0x561cac6980b0 2024-09-19T07:12:41.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.767+0000 7f4a07fff640 1 --2- 172.21.15.148:0/4045650410 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561cac6980b0 0x561cac69a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:41.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.767+0000 7f4a07fff640 1 --2- 172.21.15.148:0/4045650410 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561cac6980b0 0x561cac69a4a0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a7cc812e274e17f server_cookie=7b1aec9d5cdec48c in_seq=0 out_seq=0 2024-09-19T07:12:41.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.767+0000 7f49e77fe640 10 client.15786 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:41.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.767+0000 7f49e77fe640 1 -- 172.21.15.148:0/4045650410 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561cac4fc170 con 0x561cac6980b0 2024-09-19T07:12:41.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.767+0000 7f49e77fe640 10 client.15786 handle_command_reply: tid=0 2024-09-19T07:12:41.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.767+0000 7f4a10b05740 1 client.15786 shutdown 2024-09-19T07:12:41.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.768+0000 7f4a10b05740 1 -- 172.21.15.148:0/4045650410 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cac61d370 msgr2=0x561cac621670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:41.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.768+0000 7f4a10b05740 1 --2- 172.21.15.148:0/4045650410 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cac61d370 0x561cac621670 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f49f001ac90 tx=0x7f49f0024040 comp rx=0 tx=0).stop 2024-09-19T07:12:41.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.768+0000 7f4a10b05740 1 -- 172.21.15.148:0/4045650410 shutdown_connections 2024-09-19T07:12:41.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.768+0000 7f4a10b05740 1 --2- 172.21.15.148:0/4045650410 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561cac6980b0 0x561cac69a4a0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:41.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.768+0000 7f4a10b05740 1 --2- 172.21.15.148:0/4045650410 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cac61d370 0x561cac621670 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:41.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.768+0000 7f49e77fe640 0 client.15786 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:41.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.768+0000 7f4a10b05740 1 --2- 172.21.15.148:0/4045650410 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561cac613b40 0x561cac621060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:41.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.768+0000 7f4a10b05740 1 --2- 172.21.15.148:0/4045650410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561cac6125d0 0x561cac625d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:41.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.768+0000 7f4a10b05740 1 -- 172.21.15.148:0/4045650410 >> 172.21.15.148:0/4045650410 conn(0x561cac5db310 msgr2=0x561cac60d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:41.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.768+0000 7f4a10b05740 1 -- 172.21.15.148:0/4045650410 shutdown_connections 2024-09-19T07:12:41.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.768+0000 7f4a10b05740 1 -- 172.21.15.148:0/4045650410 wait complete. 2024-09-19T07:12:41.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.768+0000 7f4a10b05740 20 client.15786 trim_cache size 0 max 16384 2024-09-19T07:12:41.774 INFO:teuthology.orchestra.run.smithi148.stdout:[] 2024-09-19T07:12:41.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.768+0000 7f4a0e72c640 1 -- 172.21.15.148:0/2565323177 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f49f40a33b0 msgr2=0x7f49f40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:41.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.768+0000 7f4a0e72c640 1 --2- 172.21.15.148:0/2565323177 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f49f40a33b0 0x7f49f40a5870 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4a00098620 tx=0x7f4a000a0040 comp rx=0 tx=0).stop 2024-09-19T07:12:41.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.768+0000 7f4a0e72c640 1 -- 172.21.15.148:0/2565323177 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4a08106a80 msgr2=0x7f4a08197b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:41.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.768+0000 7f4a0e72c640 1 --2- 172.21.15.148:0/2565323177 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4a08106a80 0x7f4a08197b10 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f4a0000eaa0 tx=0x7f4a0000ef60 comp rx=0 tx=0).stop 2024-09-19T07:12:41.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.768+0000 7f4a0e72c640 1 -- 172.21.15.148:0/2565323177 shutdown_connections 2024-09-19T07:12:41.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.768+0000 7f4a0e72c640 1 --2- 172.21.15.148:0/2565323177 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f49f40a33b0 0x7f49f40a5870 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:41.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.768+0000 7f4a0e72c640 1 --2- 172.21.15.148:0/2565323177 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4a08106a80 0x7f4a08197b10 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:41.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.768+0000 7f4a0e72c640 1 --2- 172.21.15.148:0/2565323177 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4a08101420 0x7f4a081975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:41.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.768+0000 7f4a0e72c640 1 --2- 172.21.15.148:0/2565323177 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a08100a80 0x7f4a08197090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:41.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.768+0000 7f4a0e72c640 1 -- 172.21.15.148:0/2565323177 >> 172.21.15.148:0/2565323177 conn(0x7f4a080fc7a0 msgr2=0x7f4a080fd050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:41.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.769+0000 7f4a0e72c640 1 -- 172.21.15.148:0/2565323177 shutdown_connections 2024-09-19T07:12:41.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:41.769+0000 7f4a0e72c640 1 -- 172.21.15.148:0/2565323177 wait complete. 2024-09-19T07:12:42.513 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:42 smithi148 ceph-mon[31180]: pgmap v52: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-09-19T07:12:42.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:42 smithi179 ceph-mon[35716]: pgmap v52: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-09-19T07:12:42.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:42 smithi165 ceph-mon[35326]: pgmap v52: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-09-19T07:12:43.547 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T07:12:43.548 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T07:12:43.809 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:12:44.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.284+0000 7efebf450640 1 -- 172.21.15.148:0/214023625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efeb810c1a0 msgr2=0x7efeb810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:44.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.284+0000 7efebf450640 1 --2- 172.21.15.148:0/214023625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efeb810c1a0 0x7efeb810e610 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7efeb0009ca0 tx=0x7efeb002a950 comp rx=0 tx=0).stop 2024-09-19T07:12:44.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.284+0000 7efebf450640 1 -- 172.21.15.148:0/214023625 shutdown_connections 2024-09-19T07:12:44.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.284+0000 7efebf450640 1 --2- 172.21.15.148:0/214023625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efeb810c1a0 0x7efeb810e610 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:44.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.284+0000 7efebf450640 1 --2- 172.21.15.148:0/214023625 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efeb81036e0 0x7efeb810bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:44.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.284+0000 7efebf450640 1 --2- 172.21.15.148:0/214023625 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efeb8102dc0 0x7efeb81031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:44.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.284+0000 7efebf450640 1 -- 172.21.15.148:0/214023625 >> 172.21.15.148:0/214023625 conn(0x7efeb80fc7a0 msgr2=0x7efeb80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:44.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.284+0000 7efebf450640 1 -- 172.21.15.148:0/214023625 shutdown_connections 2024-09-19T07:12:44.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.284+0000 7efebf450640 1 -- 172.21.15.148:0/214023625 wait complete. 2024-09-19T07:12:44.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.285+0000 7efebf450640 1 Processor -- start 2024-09-19T07:12:44.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.285+0000 7efebf450640 1 -- start start 2024-09-19T07:12:44.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.285+0000 7efebf450640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efeb8102dc0 0x7efeb8198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:44.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.285+0000 7efebf450640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efeb81036e0 0x7efeb8198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:44.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.285+0000 7efebf450640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efeb810c1a0 0x7efeb819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:44.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.285+0000 7efebf450640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7efeb8111f70 con 0x7efeb8102dc0 2024-09-19T07:12:44.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.285+0000 7efebf450640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7efeb8111df0 con 0x7efeb81036e0 2024-09-19T07:12:44.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.285+0000 7efebf450640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7efeb81120f0 con 0x7efeb810c1a0 2024-09-19T07:12:44.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.285+0000 7efebd1ec640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efeb8102dc0 0x7efeb8198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:44.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.285+0000 7efebd1ec640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efeb8102dc0 0x7efeb8198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58040/0 (socket says 172.21.15.148:58040) 2024-09-19T07:12:44.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.285+0000 7efebd1ec640 1 -- 172.21.15.148:0/3926699485 learned_addr learned my addr 172.21.15.148:0/3926699485 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:44.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.285+0000 7efebd9ed640 1 --2- 172.21.15.148:0/3926699485 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efeb810c1a0 0x7efeb819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:44.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.285+0000 7efebc9eb640 1 --2- 172.21.15.148:0/3926699485 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efeb81036e0 0x7efeb8198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:44.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.286+0000 7efebd1ec640 1 -- 172.21.15.148:0/3926699485 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efeb810c1a0 msgr2=0x7efeb819cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:44.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.286+0000 7efebd1ec640 1 --2- 172.21.15.148:0/3926699485 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efeb810c1a0 0x7efeb819cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:44.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.286+0000 7efebd1ec640 1 -- 172.21.15.148:0/3926699485 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efeb81036e0 msgr2=0x7efeb8198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:44.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.286+0000 7efebd1ec640 1 --2- 172.21.15.148:0/3926699485 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efeb81036e0 0x7efeb8198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:44.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.286+0000 7efebd1ec640 1 -- 172.21.15.148:0/3926699485 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeb819d400 con 0x7efeb8102dc0 2024-09-19T07:12:44.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.286+0000 7efebc9eb640 1 --2- 172.21.15.148:0/3926699485 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efeb81036e0 0x7efeb8198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:12:44.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.286+0000 7efebd1ec640 1 --2- 172.21.15.148:0/3926699485 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efeb8102dc0 0x7efeb8198450 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7efeb400d770 tx=0x7efeb400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:44.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.286+0000 7efeae7fc640 1 -- 172.21.15.148:0/3926699485 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb4017070 con 0x7efeb8102dc0 2024-09-19T07:12:44.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.286+0000 7efeae7fc640 1 -- 172.21.15.148:0/3926699485 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efeb4005500 con 0x7efeb8102dc0 2024-09-19T07:12:44.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.286+0000 7efeae7fc640 1 -- 172.21.15.148:0/3926699485 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb4004e00 con 0x7efeb8102dc0 2024-09-19T07:12:44.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.286+0000 7efebf450640 1 -- 172.21.15.148:0/3926699485 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efeb819d6f0 con 0x7efeb8102dc0 2024-09-19T07:12:44.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.286+0000 7efebf450640 1 -- 172.21.15.148:0/3926699485 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efeb81a4fd0 con 0x7efeb8102dc0 2024-09-19T07:12:44.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.288+0000 7efeae7fc640 1 -- 172.21.15.148:0/3926699485 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7efeb4004fa0 con 0x7efeb8102dc0 2024-09-19T07:12:44.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.289+0000 7efec1829740 1 Processor -- start 2024-09-19T07:12:44.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.289+0000 7efec1829740 1 -- start start 2024-09-19T07:12:44.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.289+0000 7efeae7fc640 1 --2- 172.21.15.148:0/3926699485 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7efea40a3430 0x7efea40a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:44.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.289+0000 7efec1829740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5648d566cb60 0x5648d566cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:44.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.289+0000 7efec1829740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5648d566d480 0x5648d5677800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:44.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.289+0000 7efec1829740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5648d5677d40 0x5648d567a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:44.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.289+0000 7efec1829740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5648d55d2280 con 0x5648d5677d40 2024-09-19T07:12:44.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.289+0000 7efec1829740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5648d5579b10 con 0x5648d566cb60 2024-09-19T07:12:44.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.289+0000 7efec1829740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5648d55ce240 con 0x5648d566d480 2024-09-19T07:12:44.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.289+0000 7efebd9ed640 1 --2- 172.21.15.148:0/3926699485 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7efea40a3430 0x7efea40a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:44.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.289+0000 7efebc9eb640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5648d566d480 0x5648d5677800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:44.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.289+0000 7efebd9ed640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5648d5677d40 0x5648d567a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:44.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.289+0000 7efebc9eb640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5648d566d480 0x5648d5677800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:54160/0 (socket says 172.21.15.148:54160) 2024-09-19T07:12:44.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.289+0000 7efebc9eb640 1 -- 172.21.15.148:0/3047616434 learned_addr learned my addr 172.21.15.148:0/3047616434 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:44.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.289+0000 7efeae7fc640 1 -- 172.21.15.148:0/3926699485 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7efeb40cf720 con 0x7efeb8102dc0 2024-09-19T07:12:44.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.290+0000 7efebd1ec640 1 --2- 172.21.15.148:0/3047616434 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5648d566cb60 0x5648d566cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:44.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.290+0000 7efebc9eb640 1 -- 172.21.15.148:0/3047616434 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5648d566cb60 msgr2=0x5648d566cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:44.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.290+0000 7efebc9eb640 1 --2- 172.21.15.148:0/3047616434 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5648d566cb60 0x5648d566cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:44.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.290+0000 7efebc9eb640 1 -- 172.21.15.148:0/3047616434 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5648d5677d40 msgr2=0x5648d567a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:44.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.290+0000 7efebc9eb640 1 --2- 172.21.15.148:0/3047616434 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5648d5677d40 0x5648d567a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:44.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.290+0000 7efebc9eb640 1 -- 172.21.15.148:0/3047616434 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648d55861f0 con 0x5648d566d480 2024-09-19T07:12:44.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.290+0000 7efebd1ec640 1 --2- 172.21.15.148:0/3047616434 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5648d566cb60 0x5648d566cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:12:44.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.290+0000 7efebd9ed640 1 --2- 172.21.15.148:0/3926699485 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7efea40a3430 0x7efea40a58f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7efeb0030040 tx=0x7efeb002ffd0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:44.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.290+0000 7efebc9eb640 1 --2- 172.21.15.148:0/3047616434 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5648d566d480 0x5648d5677800 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efea8009c50 tx=0x7efea8010740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=122d3f89e8985030 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:44.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.290+0000 7efea37fe640 1 -- 172.21.15.148:0/3047616434 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea8004030 con 0x5648d566d480 2024-09-19T07:12:44.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.290+0000 7efea37fe640 1 -- 172.21.15.148:0/3047616434 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efea80041d0 con 0x5648d566d480 2024-09-19T07:12:44.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.290+0000 7efea37fe640 1 -- 172.21.15.148:0/3047616434 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea80126b0 con 0x5648d566d480 2024-09-19T07:12:44.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.291+0000 7efec1829740 1 -- 172.21.15.148:0/3047616434 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5648d566d480 msgr2=0x5648d5677800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:44.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.291+0000 7efec1829740 1 --2- 172.21.15.148:0/3047616434 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5648d566d480 0x5648d5677800 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efea8009c50 tx=0x7efea8010740 comp rx=0 tx=0).stop 2024-09-19T07:12:44.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.291+0000 7efec1829740 1 -- 172.21.15.148:0/3047616434 shutdown_connections 2024-09-19T07:12:44.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.291+0000 7efec1829740 1 --2- 172.21.15.148:0/3047616434 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5648d5677d40 0x5648d567a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:44.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.291+0000 7efec1829740 1 --2- 172.21.15.148:0/3047616434 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5648d566d480 0x5648d5677800 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:44.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.291+0000 7efec1829740 1 --2- 172.21.15.148:0/3047616434 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5648d566cb60 0x5648d566cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:44.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.291+0000 7efec1829740 1 -- 172.21.15.148:0/3047616434 >> 172.21.15.148:0/3047616434 conn(0x5648d56690f0 msgr2=0x5648d56694d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:44.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.291+0000 7efec1829740 1 -- 172.21.15.148:0/3047616434 shutdown_connections 2024-09-19T07:12:44.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.291+0000 7efec1829740 1 -- 172.21.15.148:0/3047616434 wait complete. 2024-09-19T07:12:44.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.291+0000 7efec1829740 1 -- start start 2024-09-19T07:12:44.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.292+0000 7efec1829740 1 Processor -- start 2024-09-19T07:12:44.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.292+0000 7efec1829740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5648d566cb60 0x5648d5674be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:44.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.292+0000 7efec1829740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5648d566d480 0x5648d5675120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:44.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.292+0000 7efec1829740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5648d5677d40 0x5648d5675660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:44.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.292+0000 7efec1829740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5648d567a910 con 0x5648d5677d40 2024-09-19T07:12:44.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.292+0000 7efec1829740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5648d558cf10 con 0x5648d566d480 2024-09-19T07:12:44.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.292+0000 7efec1829740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5648d567aa90 con 0x5648d566cb60 2024-09-19T07:12:44.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.292+0000 7efec1829740 10 client.0 _ll_register_callbacks cb 0x5648d5555a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:12:44.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.292+0000 7efebd9ed640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5648d5677d40 0x5648d5675660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:44.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.292+0000 7efebd9ed640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5648d5677d40 0x5648d5675660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58050/0 (socket says 172.21.15.148:58050) 2024-09-19T07:12:44.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.292+0000 7efebd9ed640 1 -- 172.21.15.148:0/537323958 learned_addr learned my addr 172.21.15.148:0/537323958 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:44.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.292+0000 7efebd1ec640 1 --2- 172.21.15.148:0/537323958 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5648d566cb60 0x5648d5674be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:44.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.292+0000 7efebc9eb640 1 --2- 172.21.15.148:0/537323958 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5648d566d480 0x5648d5675120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:44.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.292+0000 7efebd9ed640 1 -- 172.21.15.148:0/537323958 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5648d566cb60 msgr2=0x5648d5674be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:44.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.292+0000 7efebd9ed640 1 --2- 172.21.15.148:0/537323958 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5648d566cb60 0x5648d5674be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:44.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.292+0000 7efebd9ed640 1 -- 172.21.15.148:0/537323958 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5648d566d480 msgr2=0x5648d5675120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:44.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.292+0000 7efebd9ed640 1 --2- 172.21.15.148:0/537323958 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5648d566d480 0x5648d5675120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:44.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.292+0000 7efebd9ed640 1 -- 172.21.15.148:0/537323958 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648d53436a0 con 0x5648d5677d40 2024-09-19T07:12:44.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.292+0000 7efebc9eb640 1 --2- 172.21.15.148:0/537323958 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5648d566d480 0x5648d5675120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:12:44.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.293+0000 7efebd9ed640 1 --2- 172.21.15.148:0/537323958 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5648d5677d40 0x5648d5675660 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7efeb0009a10 tx=0x7efeb0005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70e99a17ad624d5b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:44.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.293+0000 7efea0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:12:44.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.293+0000 7efea0ff9640 1 -- 172.21.15.148:0/537323958 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb004e030 con 0x5648d5677d40 2024-09-19T07:12:44.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.293+0000 7efea0ff9640 1 -- 172.21.15.148:0/537323958 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7efeb0045070 con 0x5648d5677d40 2024-09-19T07:12:44.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.293+0000 7efec1829740 1 -- 172.21.15.148:0/537323958 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efea80041d0 con 0x5648d5677d40 2024-09-19T07:12:44.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.293+0000 7efea0ff9640 1 -- 172.21.15.148:0/537323958 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7efeb0034040 con 0x5648d5677d40 2024-09-19T07:12:44.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.293+0000 7efec1829740 10 client.15798 fetch_fsmap learned FSMap version 25 2024-09-19T07:12:44.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.293+0000 7efec1829740 1 -- 172.21.15.148:0/537323958 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5648d56864e0 con 0x5648d5677d40 2024-09-19T07:12:44.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.293+0000 7efea0ff9640 1 -- 172.21.15.148:0/537323958 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efea80041d0 con 0x5648d5677d40 2024-09-19T07:12:44.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.293+0000 7efea0ff9640 1 -- 172.21.15.148:0/537323958 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7efeb0005190 con 0x5648d5677d40 2024-09-19T07:12:44.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.293+0000 7efec1829740 10 client.15798 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:12:44.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.293+0000 7efec1829740 10 client.15798 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:12:44.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.293+0000 7efec1829740 20 client.15798 populate_metadata read hostname 'smithi148' 2024-09-19T07:12:44.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.293+0000 7efec1829740 1 --2- 172.21.15.148:0/537323958 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5648d5687940 0x5648d5689d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:44.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.293+0000 7efec1829740 4 client.15798 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:12:44.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.293+0000 7efec1829740 1 -- 172.21.15.148:0/537323958 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5648d55df7f0 con 0x5648d5687940 2024-09-19T07:12:44.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.294+0000 7efebd1ec640 1 --2- 172.21.15.148:0/537323958 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5648d5687940 0x5648d5689d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:44.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.294+0000 7efea0ff9640 10 client.15798 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:44.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.294+0000 7efebd1ec640 1 --2- 172.21.15.148:0/537323958 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5648d5687940 0x5648d5689d90 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db699226f251a5d3 server_cookie=b432ebcea5659b38 in_seq=0 out_seq=0 2024-09-19T07:12:44.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.295+0000 7efea0ff9640 1 -- 172.21.15.148:0/537323958 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5648d55df7f0 con 0x5648d5687940 2024-09-19T07:12:44.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.295+0000 7efea0ff9640 10 client.15798 handle_command_reply: tid=0 2024-09-19T07:12:44.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.295+0000 7efec1829740 1 client.15798 shutdown 2024-09-19T07:12:44.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.295+0000 7efec1829740 1 -- 172.21.15.148:0/537323958 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5648d5677d40 msgr2=0x5648d5675660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:44.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.295+0000 7efec1829740 1 --2- 172.21.15.148:0/537323958 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5648d5677d40 0x5648d5675660 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7efeb0009a10 tx=0x7efeb0005c50 comp rx=0 tx=0).stop 2024-09-19T07:12:44.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.295+0000 7efec1829740 1 -- 172.21.15.148:0/537323958 shutdown_connections 2024-09-19T07:12:44.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.295+0000 7efec1829740 1 --2- 172.21.15.148:0/537323958 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5648d5687940 0x5648d5689d90 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:44.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.295+0000 7efec1829740 1 --2- 172.21.15.148:0/537323958 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5648d5677d40 0x5648d5675660 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:44.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.295+0000 7efec1829740 1 --2- 172.21.15.148:0/537323958 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5648d566d480 0x5648d5675120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:44.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.295+0000 7efec1829740 1 --2- 172.21.15.148:0/537323958 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5648d566cb60 0x5648d5674be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:44.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.295+0000 7efea0ff9640 0 client.15798 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:44.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.295+0000 7efec1829740 1 -- 172.21.15.148:0/537323958 >> 172.21.15.148:0/537323958 conn(0x5648d56690f0 msgr2=0x5648d5668270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:44.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.295+0000 7efec1829740 1 -- 172.21.15.148:0/537323958 shutdown_connections 2024-09-19T07:12:44.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.295+0000 7efec1829740 1 -- 172.21.15.148:0/537323958 wait complete. 2024-09-19T07:12:44.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.295+0000 7efec1829740 20 client.15798 trim_cache size 0 max 16384 2024-09-19T07:12:44.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.312+0000 7efec1829740 1 Processor -- start 2024-09-19T07:12:44.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.312+0000 7efec1829740 1 -- start start 2024-09-19T07:12:44.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.312+0000 7efec1829740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5648d566cb60 0x5648d5674390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:44.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.312+0000 7efec1829740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5648d566d480 0x5648d568f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:44.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.312+0000 7efec1829740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5648d5677d40 0x5648d568fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:44.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.312+0000 7efec1829740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7efeb81b01a0 con 0x5648d566cb60 2024-09-19T07:12:44.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.312+0000 7efec1829740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7efeb81ada70 con 0x5648d5677d40 2024-09-19T07:12:44.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.312+0000 7efec1829740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7efeb81ab8a0 con 0x5648d566d480 2024-09-19T07:12:44.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.312+0000 7efebd1ec640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5648d566cb60 0x5648d5674390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:44.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.312+0000 7efebd1ec640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5648d566cb60 0x5648d5674390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58058/0 (socket says 172.21.15.148:58058) 2024-09-19T07:12:44.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.312+0000 7efebd1ec640 1 -- 172.21.15.148:0/2353732195 learned_addr learned my addr 172.21.15.148:0/2353732195 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:44.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.313+0000 7efebd9ed640 1 --2- 172.21.15.148:0/2353732195 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5648d5677d40 0x5648d568fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:44.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.313+0000 7efebd1ec640 1 -- 172.21.15.148:0/2353732195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5648d566d480 msgr2=0x5648d568f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:44.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.313+0000 7efebd1ec640 1 --2- 172.21.15.148:0/2353732195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5648d566d480 0x5648d568f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:44.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.313+0000 7efebd1ec640 1 -- 172.21.15.148:0/2353732195 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5648d5677d40 msgr2=0x5648d568fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:44.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.313+0000 7efebd1ec640 1 --2- 172.21.15.148:0/2353732195 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5648d5677d40 0x5648d568fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:44.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.313+0000 7efebd1ec640 1 -- 172.21.15.148:0/2353732195 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648d566d2b0 con 0x5648d566cb60 2024-09-19T07:12:44.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.313+0000 7efebd9ed640 1 --2- 172.21.15.148:0/2353732195 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5648d5677d40 0x5648d568fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:12:44.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.313+0000 7efebd1ec640 1 --2- 172.21.15.148:0/2353732195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5648d566cb60 0x5648d5674390 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7efeb4097e30 tx=0x7efeb4097550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e068251c29264a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:44.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.313+0000 7efea2ffd640 1 -- 172.21.15.148:0/2353732195 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb40b4070 con 0x5648d566cb60 2024-09-19T07:12:44.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.313+0000 7efea2ffd640 1 -- 172.21.15.148:0/2353732195 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efeb40ae2e0 con 0x5648d566cb60 2024-09-19T07:12:44.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.313+0000 7efea2ffd640 1 -- 172.21.15.148:0/2353732195 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb4020040 con 0x5648d566cb60 2024-09-19T07:12:44.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.314+0000 7efec1829740 1 -- 172.21.15.148:0/2353732195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5648d566cb60 msgr2=0x5648d5674390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:44.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.314+0000 7efec1829740 1 --2- 172.21.15.148:0/2353732195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5648d566cb60 0x5648d5674390 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7efeb4097e30 tx=0x7efeb4097550 comp rx=0 tx=0).stop 2024-09-19T07:12:44.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.314+0000 7efec1829740 1 -- 172.21.15.148:0/2353732195 shutdown_connections 2024-09-19T07:12:44.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.314+0000 7efec1829740 1 --2- 172.21.15.148:0/2353732195 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5648d5677d40 0x5648d568fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:44.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.314+0000 7efec1829740 1 --2- 172.21.15.148:0/2353732195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5648d566d480 0x5648d568f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:44.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.314+0000 7efec1829740 1 --2- 172.21.15.148:0/2353732195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5648d566cb60 0x5648d5674390 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:44.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.314+0000 7efec1829740 1 -- 172.21.15.148:0/2353732195 >> 172.21.15.148:0/2353732195 conn(0x5648d56690f0 msgr2=0x5648d5668270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:44.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.314+0000 7efec1829740 1 -- 172.21.15.148:0/2353732195 shutdown_connections 2024-09-19T07:12:44.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.314+0000 7efec1829740 1 -- 172.21.15.148:0/2353732195 wait complete. 2024-09-19T07:12:44.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.314+0000 7efec1829740 1 -- start start 2024-09-19T07:12:44.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.314+0000 7efec1829740 1 Processor -- start 2024-09-19T07:12:44.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.314+0000 7efec1829740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5648d566cb60 0x5648d567bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:44.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.315+0000 7efec1829740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5648d566d480 0x5648d567c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:44.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.315+0000 7efec1829740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5648d5677d40 0x5648d567c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:44.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.315+0000 7efec1829740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7efeb81abf30 con 0x5648d566d480 2024-09-19T07:12:44.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.315+0000 7efec1829740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7efeb81ad3a0 con 0x5648d5677d40 2024-09-19T07:12:44.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.315+0000 7efec1829740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7efeb81ac600 con 0x5648d566cb60 2024-09-19T07:12:44.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.315+0000 7efec1829740 10 client.0 _ll_register_callbacks cb 0x7efeb0005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:12:44.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.315+0000 7efebc9eb640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5648d566d480 0x5648d567c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:44.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.315+0000 7efebc9eb640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5648d566d480 0x5648d567c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58060/0 (socket says 172.21.15.148:58060) 2024-09-19T07:12:44.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.315+0000 7efebc9eb640 1 -- 172.21.15.148:0/2640799187 learned_addr learned my addr 172.21.15.148:0/2640799187 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:44.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.315+0000 7efebd1ec640 1 --2- 172.21.15.148:0/2640799187 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5648d566cb60 0x5648d567bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:44.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.315+0000 7efebc9eb640 1 -- 172.21.15.148:0/2640799187 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5648d566cb60 msgr2=0x5648d567bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:44.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.315+0000 7efebc9eb640 1 --2- 172.21.15.148:0/2640799187 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5648d566cb60 0x5648d567bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:44.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.315+0000 7efebc9eb640 1 -- 172.21.15.148:0/2640799187 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5648d5677d40 msgr2=0x5648d567c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:44.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.315+0000 7efebc9eb640 1 --2- 172.21.15.148:0/2640799187 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5648d5677d40 0x5648d567c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:44.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.315+0000 7efebc9eb640 1 -- 172.21.15.148:0/2640799187 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648d56f18d0 con 0x5648d566d480 2024-09-19T07:12:44.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.315+0000 7efebc9eb640 1 --2- 172.21.15.148:0/2640799187 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5648d566d480 0x5648d567c230 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7efea8009c50 tx=0x7efea8005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62af7447cf39e0a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:44.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.315+0000 7efea0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:12:44.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.315+0000 7efea0ff9640 1 -- 172.21.15.148:0/2640799187 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea802a060 con 0x5648d566d480 2024-09-19T07:12:44.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.315+0000 7efea0ff9640 1 -- 172.21.15.148:0/2640799187 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7efea80035f0 con 0x5648d566d480 2024-09-19T07:12:44.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.315+0000 7efec1829740 1 -- 172.21.15.148:0/2640799187 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efeb40ae2e0 con 0x5648d566d480 2024-09-19T07:12:44.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.315+0000 7efea0ff9640 1 -- 172.21.15.148:0/2640799187 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7efea80037f0 con 0x5648d566d480 2024-09-19T07:12:44.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.315+0000 7efec1829740 10 client.15804 fetch_fsmap learned FSMap version 25 2024-09-19T07:12:44.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.315+0000 7efec1829740 1 -- 172.21.15.148:0/2640799187 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5648d56f2b80 con 0x5648d566d480 2024-09-19T07:12:44.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.316+0000 7efea0ff9640 1 -- 172.21.15.148:0/2640799187 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efeb40ae2e0 con 0x5648d566d480 2024-09-19T07:12:44.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.316+0000 7efea0ff9640 1 -- 172.21.15.148:0/2640799187 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7efea800f040 con 0x5648d566d480 2024-09-19T07:12:44.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.316+0000 7efec1829740 10 client.15804 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:12:44.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.316+0000 7efec1829740 10 client.15804 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:12:44.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.316+0000 7efec1829740 20 client.15804 populate_metadata read hostname 'smithi148' 2024-09-19T07:12:44.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.316+0000 7efec1829740 1 --2- 172.21.15.148:0/2640799187 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5648d56f2f20 0x5648d56f5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:44.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.316+0000 7efec1829740 4 client.15804 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T07:12:44.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.316+0000 7efec1829740 1 -- 172.21.15.148:0/2640799187 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5648d55d9d00 con 0x5648d56f2f20 2024-09-19T07:12:44.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.316+0000 7efebd1ec640 1 --2- 172.21.15.148:0/2640799187 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5648d56f2f20 0x5648d56f5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:44.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.316+0000 7efebd1ec640 1 --2- 172.21.15.148:0/2640799187 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5648d56f2f20 0x5648d56f5310 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b471f2867816ae6 server_cookie=413d986e60cfa350 in_seq=0 out_seq=0 2024-09-19T07:12:44.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.316+0000 7efea0ff9640 10 client.15804 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:44.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.317+0000 7efea0ff9640 1 -- 172.21.15.148:0/2640799187 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5648d55d9d00 con 0x5648d56f2f20 2024-09-19T07:12:44.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.317+0000 7efea0ff9640 10 client.15804 handle_command_reply: tid=0 2024-09-19T07:12:44.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.317+0000 7efec1829740 1 client.15804 shutdown 2024-09-19T07:12:44.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.318+0000 7efec1829740 1 -- 172.21.15.148:0/2640799187 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5648d566d480 msgr2=0x5648d567c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:44.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.318+0000 7efec1829740 1 --2- 172.21.15.148:0/2640799187 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5648d566d480 0x5648d567c230 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7efea8009c50 tx=0x7efea8005710 comp rx=0 tx=0).stop 2024-09-19T07:12:44.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.318+0000 7efec1829740 1 -- 172.21.15.148:0/2640799187 shutdown_connections 2024-09-19T07:12:44.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.318+0000 7efec1829740 1 --2- 172.21.15.148:0/2640799187 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5648d56f2f20 0x5648d56f5310 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:44.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.318+0000 7efec1829740 1 --2- 172.21.15.148:0/2640799187 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5648d5677d40 0x5648d567c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:44.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.318+0000 7efea0ff9640 0 client.15804 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:44.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.318+0000 7efec1829740 1 --2- 172.21.15.148:0/2640799187 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5648d566d480 0x5648d567c230 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:44.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.318+0000 7efec1829740 1 --2- 172.21.15.148:0/2640799187 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5648d566cb60 0x5648d567bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:44.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.318+0000 7efec1829740 1 -- 172.21.15.148:0/2640799187 >> 172.21.15.148:0/2640799187 conn(0x5648d56690f0 msgr2=0x5648d5674ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:44.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.318+0000 7efec1829740 1 -- 172.21.15.148:0/2640799187 shutdown_connections 2024-09-19T07:12:44.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.318+0000 7efec1829740 1 -- 172.21.15.148:0/2640799187 wait complete. 2024-09-19T07:12:44.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.318+0000 7efec1829740 20 client.15804 trim_cache size 0 max 16384 2024-09-19T07:12:44.325 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:12:44.325 INFO:teuthology.orchestra.run.smithi148.stdout: "return_code": 0, 2024-09-19T07:12:44.325 INFO:teuthology.orchestra.run.smithi148.stdout: "scrub_tag": "1fc453dd-14a9-4811-9805-d7b068adcc93", 2024-09-19T07:12:44.325 INFO:teuthology.orchestra.run.smithi148.stdout: "mode": "asynchronous" 2024-09-19T07:12:44.325 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:12:44.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.318+0000 7efebf450640 1 -- 172.21.15.148:0/3926699485 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7efea40a3430 msgr2=0x7efea40a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:44.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.318+0000 7efebf450640 1 --2- 172.21.15.148:0/3926699485 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7efea40a3430 0x7efea40a58f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7efeb0030040 tx=0x7efeb002ffd0 comp rx=0 tx=0).stop 2024-09-19T07:12:44.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.318+0000 7efebf450640 1 -- 172.21.15.148:0/3926699485 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efeb8102dc0 msgr2=0x7efeb8198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:44.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.318+0000 7efebf450640 1 --2- 172.21.15.148:0/3926699485 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efeb8102dc0 0x7efeb8198450 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7efeb400d770 tx=0x7efeb400dc30 comp rx=0 tx=0).stop 2024-09-19T07:12:44.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.319+0000 7efebf450640 1 -- 172.21.15.148:0/3926699485 shutdown_connections 2024-09-19T07:12:44.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.319+0000 7efebf450640 1 --2- 172.21.15.148:0/3926699485 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7efea40a3430 0x7efea40a58f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:44.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.319+0000 7efebf450640 1 --2- 172.21.15.148:0/3926699485 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efeb810c1a0 0x7efeb819cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:44.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.319+0000 7efebf450640 1 --2- 172.21.15.148:0/3926699485 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efeb81036e0 0x7efeb8198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:44.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.319+0000 7efebf450640 1 --2- 172.21.15.148:0/3926699485 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efeb8102dc0 0x7efeb8198450 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:44.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.319+0000 7efebf450640 1 -- 172.21.15.148:0/3926699485 >> 172.21.15.148:0/3926699485 conn(0x7efeb80fc7a0 msgr2=0x7efeb80fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:44.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.319+0000 7efebf450640 1 -- 172.21.15.148:0/3926699485 shutdown_connections 2024-09-19T07:12:44.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:44.319+0000 7efebf450640 1 -- 172.21.15.148:0/3926699485 wait complete. 2024-09-19T07:12:44.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:44 smithi148 ceph-mon[31180]: pgmap v53: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-09-19T07:12:44.741 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:12:44.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:44 smithi179 ceph-mon[35716]: pgmap v53: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-09-19T07:12:44.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:44 smithi165 ceph-mon[35326]: pgmap v53: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-09-19T07:12:45.088 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T07:12:45.126 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:12:45.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.587+0000 7fe3218f9640 1 -- 172.21.15.148:0/2504839609 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe31c102ef0 msgr2=0x7fe31c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:45.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.587+0000 7fe3218f9640 1 --2- 172.21.15.148:0/2504839609 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe31c102ef0 0x7fe31c10da40 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fe314009900 tx=0x7fe31402a480 comp rx=0 tx=0).stop 2024-09-19T07:12:45.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.587+0000 7fe3218f9640 1 -- 172.21.15.148:0/2504839609 shutdown_connections 2024-09-19T07:12:45.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.587+0000 7fe3218f9640 1 --2- 172.21.15.148:0/2504839609 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe31c102ef0 0x7fe31c10da40 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:45.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.587+0000 7fe3218f9640 1 --2- 172.21.15.148:0/2504839609 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe31c102570 0x7fe31c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:45.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.587+0000 7fe3218f9640 1 --2- 172.21.15.148:0/2504839609 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe31c100e20 0x7fe31c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:45.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.587+0000 7fe3218f9640 1 -- 172.21.15.148:0/2504839609 >> 172.21.15.148:0/2504839609 conn(0x7fe31c0fc7d0 msgr2=0x7fe31c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:45.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.587+0000 7fe3218f9640 1 -- 172.21.15.148:0/2504839609 shutdown_connections 2024-09-19T07:12:45.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.587+0000 7fe3218f9640 1 -- 172.21.15.148:0/2504839609 wait complete. 2024-09-19T07:12:45.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.587+0000 7fe3218f9640 1 Processor -- start 2024-09-19T07:12:45.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.588+0000 7fe3218f9640 1 -- start start 2024-09-19T07:12:45.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.588+0000 7fe3218f9640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe31c100e20 0x7fe31c1993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:45.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.588+0000 7fe3218f9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe31c102570 0x7fe31c1998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:45.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.588+0000 7fe3218f9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe31c102ef0 0x7fe31c199e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:45.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.588+0000 7fe3218f9640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe31c110f80 con 0x7fe31c102570 2024-09-19T07:12:45.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.588+0000 7fe3218f9640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe31c110e00 con 0x7fe31c100e20 2024-09-19T07:12:45.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.588+0000 7fe3218f9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe31c111100 con 0x7fe31c102ef0 2024-09-19T07:12:45.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.588+0000 7fe31a7fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe31c102570 0x7fe31c1998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:45.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.588+0000 7fe31a7fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe31c102570 0x7fe31c1998f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58070/0 (socket says 172.21.15.148:58070) 2024-09-19T07:12:45.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.588+0000 7fe31a7fc640 1 -- 172.21.15.148:0/3255775898 learned_addr learned my addr 172.21.15.148:0/3255775898 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:45.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.588+0000 7fe31affd640 1 --2- 172.21.15.148:0/3255775898 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe31c100e20 0x7fe31c1993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:45.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.588+0000 7fe31b7fe640 1 --2- 172.21.15.148:0/3255775898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe31c102ef0 0x7fe31c199e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:45.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.588+0000 7fe31a7fc640 1 -- 172.21.15.148:0/3255775898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe31c102ef0 msgr2=0x7fe31c199e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:45.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.588+0000 7fe31a7fc640 1 --2- 172.21.15.148:0/3255775898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe31c102ef0 0x7fe31c199e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:45.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.588+0000 7fe31a7fc640 1 -- 172.21.15.148:0/3255775898 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe31c100e20 msgr2=0x7fe31c1993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:45.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.588+0000 7fe31a7fc640 1 --2- 172.21.15.148:0/3255775898 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe31c100e20 0x7fe31c1993b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:45.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.588+0000 7fe31a7fc640 1 -- 172.21.15.148:0/3255775898 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe31c1a47b0 con 0x7fe31c102570 2024-09-19T07:12:45.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.588+0000 7fe31a7fc640 1 --2- 172.21.15.148:0/3255775898 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe31c102570 0x7fe31c1998f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe30c00d950 tx=0x7fe30c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:45.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.588+0000 7fe3208f7640 1 -- 172.21.15.148:0/3255775898 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30c017070 con 0x7fe31c102570 2024-09-19T07:12:45.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.589+0000 7fe3208f7640 1 -- 172.21.15.148:0/3255775898 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe30c009c30 con 0x7fe31c102570 2024-09-19T07:12:45.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.589+0000 7fe3218f9640 1 -- 172.21.15.148:0/3255775898 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe31c1a4aa0 con 0x7fe31c102570 2024-09-19T07:12:45.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.589+0000 7fe3208f7640 1 -- 172.21.15.148:0/3255775898 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30c00f6b0 con 0x7fe31c102570 2024-09-19T07:12:45.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.589+0000 7fe3218f9640 1 -- 172.21.15.148:0/3255775898 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe31c1a4fe0 con 0x7fe31c102570 2024-09-19T07:12:45.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.590+0000 7fe3218f9640 1 -- 172.21.15.148:0/3255775898 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe31c101200 con 0x7fe31c102570 2024-09-19T07:12:45.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.591+0000 7fe3208f7640 1 -- 172.21.15.148:0/3255775898 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fe30c0109d0 con 0x7fe31c102570 2024-09-19T07:12:45.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.591+0000 7fe3208f7640 1 --2- 172.21.15.148:0/3255775898 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe3040a33b0 0x7fe3040a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:45.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.592+0000 7fe31affd640 1 --2- 172.21.15.148:0/3255775898 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe3040a33b0 0x7fe3040a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:45.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.592+0000 7fe3208f7640 1 -- 172.21.15.148:0/3255775898 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fe30c0cf800 con 0x7fe31c102570 2024-09-19T07:12:45.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.592+0000 7fe31affd640 1 --2- 172.21.15.148:0/3255775898 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe3040a33b0 0x7fe3040a5870 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe310005c40 tx=0x7fe31000a590 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:45.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.596+0000 7fe3208f7640 1 -- 172.21.15.148:0/3255775898 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe30c009de0 con 0x7fe31c102570 2024-09-19T07:12:45.628 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:12:45.724 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:45 smithi148 ceph-mon[31180]: scrub queued for path: / 2024-09-19T07:12:45.724 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:45 smithi148 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-19T07:12:45.724 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:45 smithi148 ceph-mon[31180]: scrub summary: active paths [/] 2024-09-19T07:12:45.724 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:45 smithi148 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-19T07:12:45.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:45 smithi179 ceph-mon[35716]: scrub queued for path: / 2024-09-19T07:12:45.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:45 smithi179 ceph-mon[35716]: scrub summary: idle+waiting paths [/] 2024-09-19T07:12:45.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:45 smithi179 ceph-mon[35716]: scrub summary: active paths [/] 2024-09-19T07:12:45.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:45 smithi179 ceph-mon[35716]: scrub summary: idle+waiting paths [/] 2024-09-19T07:12:45.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.811+0000 7fe3218f9640 1 -- 172.21.15.148:0/3255775898 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe31c109090 con 0x7fe31c102570 2024-09-19T07:12:45.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.811+0000 7fe3208f7640 1 -- 172.21.15.148:0/3255775898 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11939 (secure 0 0 0) 0x7fe30c09bba0 con 0x7fe31c102570 2024-09-19T07:12:45.812 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:12:45.812 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":25,"btime":"2024-09-19T07:11:04:227331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/4263868576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":4263868576},{"type":"v1","addr":"172.21.15.148:6841","nonce":4263868576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24383,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2146820965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2146820965},{"type":"v1","addr":"172.21.15.165:6835","nonce":2146820965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:09:19.543369+0000","modified":"2024-09-19T07:11:03.969598+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24457,"mds_1":24437,"mds_2":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/1566489108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1566489108},{"type":"v1","addr":"172.21.15.179:6835","nonce":1566489108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.165:6839/3993490234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":3993490234},{"type":"v1","addr":"172.21.15.165:6839","nonce":3993490234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24457,"qdb_cluster":[24457,24437,24436]},"id":1}]} 2024-09-19T07:12:45.813 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 25 2024-09-19T07:12:45.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.814+0000 7fe3218f9640 1 -- 172.21.15.148:0/3255775898 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe3040a33b0 msgr2=0x7fe3040a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:45.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.814+0000 7fe3218f9640 1 --2- 172.21.15.148:0/3255775898 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe3040a33b0 0x7fe3040a5870 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe310005c40 tx=0x7fe31000a590 comp rx=0 tx=0).stop 2024-09-19T07:12:45.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.814+0000 7fe3218f9640 1 -- 172.21.15.148:0/3255775898 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe31c102570 msgr2=0x7fe31c1998f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:45.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.814+0000 7fe3218f9640 1 --2- 172.21.15.148:0/3255775898 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe31c102570 0x7fe31c1998f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe30c00d950 tx=0x7fe30c00de10 comp rx=0 tx=0).stop 2024-09-19T07:12:45.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.814+0000 7fe3218f9640 1 -- 172.21.15.148:0/3255775898 shutdown_connections 2024-09-19T07:12:45.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.814+0000 7fe3218f9640 1 --2- 172.21.15.148:0/3255775898 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe3040a33b0 0x7fe3040a5870 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:45.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.814+0000 7fe3218f9640 1 --2- 172.21.15.148:0/3255775898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe31c102ef0 0x7fe31c199e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:45.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.814+0000 7fe3218f9640 1 --2- 172.21.15.148:0/3255775898 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe31c102570 0x7fe31c1998f0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:45.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.814+0000 7fe3218f9640 1 --2- 172.21.15.148:0/3255775898 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe31c100e20 0x7fe31c1993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:45.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.814+0000 7fe3218f9640 1 -- 172.21.15.148:0/3255775898 >> 172.21.15.148:0/3255775898 conn(0x7fe31c0fc7d0 msgr2=0x7fe31c1068d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:45.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.814+0000 7fe3218f9640 1 -- 172.21.15.148:0/3255775898 shutdown_connections 2024-09-19T07:12:45.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:45.814+0000 7fe3218f9640 1 -- 172.21.15.148:0/3255775898 wait complete. 2024-09-19T07:12:45.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:45 smithi165 ceph-mon[35326]: scrub queued for path: / 2024-09-19T07:12:45.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:45 smithi165 ceph-mon[35326]: scrub summary: idle+waiting paths [/] 2024-09-19T07:12:45.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:45 smithi165 ceph-mon[35326]: scrub summary: active paths [/] 2024-09-19T07:12:45.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:45 smithi165 ceph-mon[35326]: scrub summary: idle+waiting paths [/] 2024-09-19T07:12:46.526 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24457 quiesce db --set-id edfd46a9 --release --await' 2024-09-19T07:12:46.527 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24457 quiesce db --set-id edfd46a9 --release --await 2024-09-19T07:12:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.591+0000 7fa4afbe4640 1 -- 172.21.15.148:0/3392680803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4a81069c0 msgr2=0x7fa4a8106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.591+0000 7fa4afbe4640 1 --2- 172.21.15.148:0/3392680803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4a81069c0 0x7fa4a8106da0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fa4a4009930 tx=0x7fa4a402a420 comp rx=0 tx=0).stop 2024-09-19T07:12:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.591+0000 7fa4afbe4640 1 -- 172.21.15.148:0/3392680803 shutdown_connections 2024-09-19T07:12:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.591+0000 7fa4afbe4640 1 --2- 172.21.15.148:0/3392680803 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4a8101350 0x7fa4a810d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.591+0000 7fa4afbe4640 1 --2- 172.21.15.148:0/3392680803 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4a81009b0 0x7fa4a8100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.591+0000 7fa4afbe4640 1 --2- 172.21.15.148:0/3392680803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4a81069c0 0x7fa4a8106da0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.591+0000 7fa4afbe4640 1 -- 172.21.15.148:0/3392680803 >> 172.21.15.148:0/3392680803 conn(0x7fa4a8077990 msgr2=0x7fa4a80fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.591+0000 7fa4afbe4640 1 -- 172.21.15.148:0/3392680803 shutdown_connections 2024-09-19T07:12:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.591+0000 7fa4afbe4640 1 -- 172.21.15.148:0/3392680803 wait complete. 2024-09-19T07:12:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.591+0000 7fa4afbe4640 1 Processor -- start 2024-09-19T07:12:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.591+0000 7fa4afbe4640 1 -- start start 2024-09-19T07:12:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.592+0000 7fa4afbe4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4a81009b0 0x7fa4a8198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:46.595 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.592+0000 7fa4afbe4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4a8101350 0x7fa4a81988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:46.595 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.592+0000 7fa4afbe4640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4a81069c0 0x7fa4a819cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:46.595 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.592+0000 7fa4afbe4640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a8110e50 con 0x7fa4a8101350 2024-09-19T07:12:46.595 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.592+0000 7fa4afbe4640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a8110cd0 con 0x7fa4a81069c0 2024-09-19T07:12:46.595 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.592+0000 7fa4afbe4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a8110fd0 con 0x7fa4a81009b0 2024-09-19T07:12:46.595 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.592+0000 7fa4ad17f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4a8101350 0x7fa4a81988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:46.595 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.592+0000 7fa4ad17f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4a8101350 0x7fa4a81988c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58078/0 (socket says 172.21.15.148:58078) 2024-09-19T07:12:46.595 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.592+0000 7fa4ad17f640 1 -- 172.21.15.148:0/1410392075 learned_addr learned my addr 172.21.15.148:0/1410392075 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:46.595 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.592+0000 7fa4ad980640 1 --2- 172.21.15.148:0/1410392075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4a81009b0 0x7fa4a8198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:46.595 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.592+0000 7fa4ae181640 1 --2- 172.21.15.148:0/1410392075 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4a81069c0 0x7fa4a819cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:46.596 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.592+0000 7fa4ad17f640 1 -- 172.21.15.148:0/1410392075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4a81009b0 msgr2=0x7fa4a8198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:46.596 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.592+0000 7fa4ad17f640 1 --2- 172.21.15.148:0/1410392075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4a81009b0 0x7fa4a8198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.596 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.592+0000 7fa4ad17f640 1 -- 172.21.15.148:0/1410392075 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4a81069c0 msgr2=0x7fa4a819cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:46.596 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.592+0000 7fa4ad17f640 1 --2- 172.21.15.148:0/1410392075 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4a81069c0 0x7fa4a819cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.596 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.592+0000 7fa4ad17f640 1 -- 172.21.15.148:0/1410392075 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4a819d370 con 0x7fa4a8101350 2024-09-19T07:12:46.596 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.592+0000 7fa4ae181640 1 --2- 172.21.15.148:0/1410392075 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4a81069c0 0x7fa4a819cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:12:46.596 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.592+0000 7fa4ad17f640 1 --2- 172.21.15.148:0/1410392075 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4a8101350 0x7fa4a81988c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fa49800e9f0 tx=0x7fa49800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:46.596 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.592+0000 7fa49effd640 1 -- 172.21.15.148:0/1410392075 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa49800cd80 con 0x7fa4a8101350 2024-09-19T07:12:46.596 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.592+0000 7fa49effd640 1 -- 172.21.15.148:0/1410392075 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa498005500 con 0x7fa4a8101350 2024-09-19T07:12:46.596 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.592+0000 7fa4afbe4640 1 -- 172.21.15.148:0/1410392075 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4a819d660 con 0x7fa4a8101350 2024-09-19T07:12:46.596 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.592+0000 7fa49effd640 1 -- 172.21.15.148:0/1410392075 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa498010690 con 0x7fa4a8101350 2024-09-19T07:12:46.596 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.592+0000 7fa4afbe4640 1 -- 172.21.15.148:0/1410392075 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4a81a4ef0 con 0x7fa4a8101350 2024-09-19T07:12:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.595+0000 7fa49effd640 1 -- 172.21.15.148:0/1410392075 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fa4980046c0 con 0x7fa4a8101350 2024-09-19T07:12:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.595+0000 7fa4b2a56740 1 Processor -- start 2024-09-19T07:12:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.596+0000 7fa4b2a56740 1 -- start start 2024-09-19T07:12:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.596+0000 7fa4b2a56740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e058a72af0 0x55e058a72ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.596+0000 7fa4b2a56740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e058a73410 0x55e058a7d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.596+0000 7fa4b2a56740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e058a7dcb0 0x55e058a800a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.596+0000 7fa4b2a56740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55e0589d72f0 con 0x55e058a72af0 2024-09-19T07:12:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.596+0000 7fa4b2a56740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55e05897f270 con 0x55e058a7dcb0 2024-09-19T07:12:46.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.596+0000 7fa4b2a56740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55e0589d32b0 con 0x55e058a73410 2024-09-19T07:12:46.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.596+0000 7fa49effd640 1 --2- 172.21.15.148:0/1410392075 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fa4940a3460 0x7fa4940a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:46.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.596+0000 7fa4ae181640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e058a72af0 0x55e058a72ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:46.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.596+0000 7fa4ad17f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e058a7dcb0 0x55e058a800a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:46.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.596+0000 7fa4ae181640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e058a72af0 0x55e058a72ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58088/0 (socket says 172.21.15.148:58088) 2024-09-19T07:12:46.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.596+0000 7fa4ae181640 1 -- 172.21.15.148:0/2484191326 learned_addr learned my addr 172.21.15.148:0/2484191326 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:46.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.596+0000 7fa4ae181640 1 --2- 172.21.15.148:0/1410392075 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fa4940a3460 0x7fa4940a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:46.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.596+0000 7fa49effd640 1 -- 172.21.15.148:0/1410392075 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fa4980d01e0 con 0x7fa4a8101350 2024-09-19T07:12:46.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.596+0000 7fa4ad980640 1 --2- 172.21.15.148:0/2484191326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e058a73410 0x55e058a7d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:46.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.596+0000 7fa4ae181640 1 -- 172.21.15.148:0/2484191326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e058a73410 msgr2=0x55e058a7d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:46.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.596+0000 7fa4ae181640 1 --2- 172.21.15.148:0/2484191326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e058a73410 0x55e058a7d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.596+0000 7fa4ae181640 1 -- 172.21.15.148:0/2484191326 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e058a7dcb0 msgr2=0x55e058a800a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:46.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.596+0000 7fa4ae181640 1 --2- 172.21.15.148:0/2484191326 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e058a7dcb0 0x55e058a800a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.596+0000 7fa4ae181640 1 -- 172.21.15.148:0/2484191326 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e05897e340 con 0x55e058a72af0 2024-09-19T07:12:46.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.596+0000 7fa4ad17f640 1 --2- 172.21.15.148:0/2484191326 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e058a7dcb0 0x55e058a800a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:12:46.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.596+0000 7fa4ad980640 1 --2- 172.21.15.148:0/2484191326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e058a73410 0x55e058a7d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:12:46.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.597+0000 7fa4ae181640 1 --2- 172.21.15.148:0/2484191326 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e058a72af0 0x55e058a72ed0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0014ea0 tx=0x7fa4a0014f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6a7e831585d8d6c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:46.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.597+0000 7fa4ae181640 1 --2- 172.21.15.148:0/1410392075 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fa4940a3460 0x7fa4940a5920 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0011c40 tx=0x7fa4a001c000 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:46.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.597+0000 7fa493fff640 1 -- 172.21.15.148:0/2484191326 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a0022070 con 0x55e058a72af0 2024-09-19T07:12:46.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.597+0000 7fa493fff640 1 -- 172.21.15.148:0/2484191326 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4a0003e50 con 0x55e058a72af0 2024-09-19T07:12:46.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.597+0000 7fa493fff640 1 -- 172.21.15.148:0/2484191326 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a0004290 con 0x55e058a72af0 2024-09-19T07:12:46.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.598+0000 7fa4b2a56740 1 -- 172.21.15.148:0/2484191326 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e058a72af0 msgr2=0x55e058a72ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:46.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.598+0000 7fa4b2a56740 1 --2- 172.21.15.148:0/2484191326 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e058a72af0 0x55e058a72ed0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0014ea0 tx=0x7fa4a0014f90 comp rx=0 tx=0).stop 2024-09-19T07:12:46.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.598+0000 7fa4b2a56740 1 -- 172.21.15.148:0/2484191326 shutdown_connections 2024-09-19T07:12:46.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.598+0000 7fa4b2a56740 1 --2- 172.21.15.148:0/2484191326 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e058a7dcb0 0x55e058a800a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.598+0000 7fa4b2a56740 1 --2- 172.21.15.148:0/2484191326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e058a73410 0x55e058a7d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.598+0000 7fa4b2a56740 1 --2- 172.21.15.148:0/2484191326 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e058a72af0 0x55e058a72ed0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.598+0000 7fa4b2a56740 1 -- 172.21.15.148:0/2484191326 >> 172.21.15.148:0/2484191326 conn(0x55e058a6f060 msgr2=0x55e058a6f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:46.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.598+0000 7fa4b2a56740 1 -- 172.21.15.148:0/2484191326 shutdown_connections 2024-09-19T07:12:46.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.598+0000 7fa4b2a56740 1 -- 172.21.15.148:0/2484191326 wait complete. 2024-09-19T07:12:46.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.598+0000 7fa4b2a56740 1 -- start start 2024-09-19T07:12:46.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.598+0000 7fa4b2a56740 1 Processor -- start 2024-09-19T07:12:46.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.599+0000 7fa4b2a56740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e058a72af0 0x55e058a7ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:46.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.599+0000 7fa4b2a56740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e058a73410 0x55e058a7b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:46.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.599+0000 7fa4b2a56740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e058a7dcb0 0x55e058a7b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:46.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.599+0000 7fa4b2a56740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55e058a80880 con 0x55e058a7dcb0 2024-09-19T07:12:46.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.599+0000 7fa4b2a56740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55e058960290 con 0x55e058a72af0 2024-09-19T07:12:46.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.599+0000 7fa4b2a56740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55e058a80a00 con 0x55e058a73410 2024-09-19T07:12:46.607 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.599+0000 7fa4b2a56740 10 client.0 _ll_register_callbacks cb 0x55e058991140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:12:46.607 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.599+0000 7fa4ae181640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e058a7dcb0 0x55e058a7b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:46.607 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.599+0000 7fa4ae181640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e058a7dcb0 0x55e058a7b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58094/0 (socket says 172.21.15.148:58094) 2024-09-19T07:12:46.607 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.599+0000 7fa4ae181640 1 -- 172.21.15.148:0/1498647909 learned_addr learned my addr 172.21.15.148:0/1498647909 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:46.607 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.599+0000 7fa4ad17f640 1 --2- 172.21.15.148:0/1498647909 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e058a73410 0x55e058a7b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:46.607 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.599+0000 7fa4ad980640 1 --2- 172.21.15.148:0/1498647909 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e058a72af0 0x55e058a7ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:46.607 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.599+0000 7fa4ae181640 1 -- 172.21.15.148:0/1498647909 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e058a73410 msgr2=0x55e058a7b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:46.607 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.599+0000 7fa4ae181640 1 --2- 172.21.15.148:0/1498647909 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e058a73410 0x55e058a7b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.607 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.599+0000 7fa4ae181640 1 -- 172.21.15.148:0/1498647909 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e058a72af0 msgr2=0x55e058a7ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:46.607 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.599+0000 7fa4ae181640 1 --2- 172.21.15.148:0/1498647909 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e058a72af0 0x55e058a7ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.607 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.599+0000 7fa4ae181640 1 -- 172.21.15.148:0/1498647909 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0586ea210 con 0x55e058a7dcb0 2024-09-19T07:12:46.607 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.599+0000 7fa4ae181640 1 --2- 172.21.15.148:0/1498647909 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e058a7dcb0 0x55e058a7b680 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0006010 tx=0x7fa4a0003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3aec461df05afd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:46.607 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.599+0000 7fa4917fa640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:12:46.608 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.599+0000 7fa4917fa640 1 -- 172.21.15.148:0/1498647909 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a002b070 con 0x55e058a7dcb0 2024-09-19T07:12:46.608 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.599+0000 7fa4917fa640 1 -- 172.21.15.148:0/1498647909 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fa4a0005b70 con 0x55e058a7dcb0 2024-09-19T07:12:46.608 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.599+0000 7fa4b2a56740 1 -- 172.21.15.148:0/1498647909 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4a0003e50 con 0x55e058a7dcb0 2024-09-19T07:12:46.608 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.600+0000 7fa4917fa640 1 -- 172.21.15.148:0/1498647909 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa4a0037050 con 0x55e058a7dcb0 2024-09-19T07:12:46.608 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.600+0000 7fa4b2a56740 10 client.15822 fetch_fsmap learned FSMap version 25 2024-09-19T07:12:46.608 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.600+0000 7fa4b2a56740 1 -- 172.21.15.148:0/1498647909 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e0587b6620 con 0x55e058a7dcb0 2024-09-19T07:12:46.608 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.600+0000 7fa4917fa640 1 -- 172.21.15.148:0/1498647909 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4a0003e50 con 0x55e058a7dcb0 2024-09-19T07:12:46.608 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.600+0000 7fa4917fa640 1 -- 172.21.15.148:0/1498647909 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa4a001d070 con 0x55e058a7dcb0 2024-09-19T07:12:46.608 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.600+0000 7fa4b2a56740 10 client.15822 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:12:46.608 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.600+0000 7fa4b2a56740 10 client.15822 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:12:46.608 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.600+0000 7fa4b2a56740 20 client.15822 populate_metadata read hostname 'smithi148' 2024-09-19T07:12:46.608 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.600+0000 7fa4b2a56740 1 --2- 172.21.15.148:0/1498647909 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e058a8dc20 0x55e058a90010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:46.608 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.600+0000 7fa4b2a56740 4 client.15822 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:12:46.608 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.600+0000 7fa4b2a56740 1 -- 172.21.15.148:0/1498647909 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e0589e4a20 con 0x55e058a8dc20 2024-09-19T07:12:46.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.600+0000 7fa4ad980640 1 --2- 172.21.15.148:0/1498647909 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e058a8dc20 0x55e058a90010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:46.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.601+0000 7fa4917fa640 10 client.15822 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:46.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.601+0000 7fa4ad980640 1 --2- 172.21.15.148:0/1498647909 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e058a8dc20 0x55e058a90010 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c15a6a0d2873e0f server_cookie=58fd476ad4c3c7cf in_seq=0 out_seq=0 2024-09-19T07:12:46.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.601+0000 7fa4917fa640 1 -- 172.21.15.148:0/1498647909 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e0589e4a20 con 0x55e058a8dc20 2024-09-19T07:12:46.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.601+0000 7fa4917fa640 10 client.15822 handle_command_reply: tid=0 2024-09-19T07:12:46.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.601+0000 7fa4b2a56740 1 client.15822 shutdown 2024-09-19T07:12:46.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.602+0000 7fa4b2a56740 1 -- 172.21.15.148:0/1498647909 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e058a7dcb0 msgr2=0x55e058a7b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:46.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.602+0000 7fa4b2a56740 1 --2- 172.21.15.148:0/1498647909 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e058a7dcb0 0x55e058a7b680 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0006010 tx=0x7fa4a0003c20 comp rx=0 tx=0).stop 2024-09-19T07:12:46.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.602+0000 7fa4b2a56740 1 -- 172.21.15.148:0/1498647909 shutdown_connections 2024-09-19T07:12:46.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.602+0000 7fa4b2a56740 1 --2- 172.21.15.148:0/1498647909 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e058a8dc20 0x55e058a90010 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.602+0000 7fa4b2a56740 1 --2- 172.21.15.148:0/1498647909 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e058a7dcb0 0x55e058a7b680 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.602+0000 7fa4917fa640 0 client.15822 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:46.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.602+0000 7fa4b2a56740 1 --2- 172.21.15.148:0/1498647909 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e058a73410 0x55e058a7b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.602+0000 7fa4b2a56740 1 --2- 172.21.15.148:0/1498647909 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e058a72af0 0x55e058a7ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.602+0000 7fa4b2a56740 1 -- 172.21.15.148:0/1498647909 >> 172.21.15.148:0/1498647909 conn(0x55e058a6f060 msgr2=0x55e058a74d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:46.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.602+0000 7fa4b2a56740 1 -- 172.21.15.148:0/1498647909 shutdown_connections 2024-09-19T07:12:46.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.602+0000 7fa4b2a56740 1 -- 172.21.15.148:0/1498647909 wait complete. 2024-09-19T07:12:46.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.602+0000 7fa4b2a56740 20 client.15822 trim_cache size 0 max 16384 2024-09-19T07:12:46.633 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.630+0000 7fa4b2a56740 1 Processor -- start 2024-09-19T07:12:46.633 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.630+0000 7fa4b2a56740 1 -- start start 2024-09-19T07:12:46.633 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.630+0000 7fa4b2a56740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e058a72af0 0x55e058a75560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:46.633 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.630+0000 7fa4b2a56740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e058a73410 0x55e058a7b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:46.633 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.630+0000 7fa4b2a56740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e058a7dcb0 0x55e058a95640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:46.633 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.630+0000 7fa4b2a56740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a81b0110 con 0x55e058a7dcb0 2024-09-19T07:12:46.633 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.630+0000 7fa4b2a56740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a81ad9e0 con 0x55e058a73410 2024-09-19T07:12:46.633 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.630+0000 7fa4b2a56740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a81ab810 con 0x55e058a72af0 2024-09-19T07:12:46.633 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.630+0000 7fa4ae181640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e058a7dcb0 0x55e058a95640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:46.633 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.630+0000 7fa4ae181640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e058a7dcb0 0x55e058a95640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58096/0 (socket says 172.21.15.148:58096) 2024-09-19T07:12:46.634 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.630+0000 7fa4ae181640 1 -- 172.21.15.148:0/2918067846 learned_addr learned my addr 172.21.15.148:0/2918067846 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:46.634 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.630+0000 7fa4ad980640 1 --2- 172.21.15.148:0/2918067846 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e058a72af0 0x55e058a75560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:46.634 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.631+0000 7fa4ae181640 1 -- 172.21.15.148:0/2918067846 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e058a72af0 msgr2=0x55e058a75560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:46.634 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.631+0000 7fa4ae181640 1 --2- 172.21.15.148:0/2918067846 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e058a72af0 0x55e058a75560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.634 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.631+0000 7fa4ae181640 1 -- 172.21.15.148:0/2918067846 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e058a73410 msgr2=0x55e058a7b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:46.634 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.631+0000 7fa4ad17f640 1 --2- 172.21.15.148:0/2918067846 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e058a73410 0x55e058a7b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:46.634 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.631+0000 7fa4ae181640 1 --2- 172.21.15.148:0/2918067846 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e058a73410 0x55e058a7b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.634 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.631+0000 7fa4ae181640 1 -- 172.21.15.148:0/2918067846 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e058a70110 con 0x55e058a7dcb0 2024-09-19T07:12:46.634 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.631+0000 7fa4ae181640 1 --2- 172.21.15.148:0/2918067846 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e058a7dcb0 0x55e058a95640 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0014400 tx=0x7fa4a00092f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=598763d8a93c4a29 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:46.634 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.631+0000 7fa4937fe640 1 -- 172.21.15.148:0/2918067846 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a002b040 con 0x55e058a7dcb0 2024-09-19T07:12:46.634 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.631+0000 7fa4937fe640 1 -- 172.21.15.148:0/2918067846 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4a00147f0 con 0x55e058a7dcb0 2024-09-19T07:12:46.634 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.631+0000 7fa4937fe640 1 -- 172.21.15.148:0/2918067846 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a0022030 con 0x55e058a7dcb0 2024-09-19T07:12:46.634 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.632+0000 7fa4b2a56740 1 -- 172.21.15.148:0/2918067846 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e058a7dcb0 msgr2=0x55e058a95640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:46.635 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.632+0000 7fa4b2a56740 1 --2- 172.21.15.148:0/2918067846 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e058a7dcb0 0x55e058a95640 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0014400 tx=0x7fa4a00092f0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.635 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.632+0000 7fa4b2a56740 1 -- 172.21.15.148:0/2918067846 shutdown_connections 2024-09-19T07:12:46.635 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.632+0000 7fa4b2a56740 1 --2- 172.21.15.148:0/2918067846 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e058a7dcb0 0x55e058a95640 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.635 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.632+0000 7fa4b2a56740 1 --2- 172.21.15.148:0/2918067846 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e058a73410 0x55e058a7b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.635 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.632+0000 7fa4b2a56740 1 --2- 172.21.15.148:0/2918067846 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e058a72af0 0x55e058a75560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.635 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.632+0000 7fa4b2a56740 1 -- 172.21.15.148:0/2918067846 >> 172.21.15.148:0/2918067846 conn(0x55e058a6f060 msgr2=0x55e058a7cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:46.635 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.632+0000 7fa4b2a56740 1 -- 172.21.15.148:0/2918067846 shutdown_connections 2024-09-19T07:12:46.635 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.632+0000 7fa4b2a56740 1 -- 172.21.15.148:0/2918067846 wait complete. 2024-09-19T07:12:46.635 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.632+0000 7fa4b2a56740 1 -- start start 2024-09-19T07:12:46.635 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.632+0000 7fa4b2a56740 1 Processor -- start 2024-09-19T07:12:46.638 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.633+0000 7fa4b2a56740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e058a72af0 0x55e058a86410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:46.638 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.633+0000 7fa4b2a56740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e058a73410 0x55e058a77bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:46.638 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.633+0000 7fa4b2a56740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e058a7dcb0 0x55e058a78100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:46.638 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.633+0000 7fa4b2a56740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a81abea0 con 0x55e058a72af0 2024-09-19T07:12:46.638 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.633+0000 7fa4b2a56740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a81ad310 con 0x55e058a73410 2024-09-19T07:12:46.638 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.633+0000 7fa4b2a56740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a81ac570 con 0x55e058a7dcb0 2024-09-19T07:12:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.633+0000 7fa4b2a56740 10 client.0 _ll_register_callbacks cb 0x7fa49800cf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:12:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.633+0000 7fa4ad980640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e058a72af0 0x55e058a86410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.633+0000 7fa4ad980640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e058a72af0 0x55e058a86410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58104/0 (socket says 172.21.15.148:58104) 2024-09-19T07:12:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.633+0000 7fa4ad980640 1 -- 172.21.15.148:0/1400455826 learned_addr learned my addr 172.21.15.148:0/1400455826 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.633+0000 7fa4ae181640 1 --2- 172.21.15.148:0/1400455826 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e058a7dcb0 0x55e058a78100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.633+0000 7fa4ad17f640 1 --2- 172.21.15.148:0/1400455826 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e058a73410 0x55e058a77bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.633+0000 7fa4ad980640 1 -- 172.21.15.148:0/1400455826 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e058a7dcb0 msgr2=0x55e058a78100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.633+0000 7fa4ad980640 1 --2- 172.21.15.148:0/1400455826 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e058a7dcb0 0x55e058a78100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.633+0000 7fa4ad980640 1 -- 172.21.15.148:0/1400455826 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e058a73410 msgr2=0x55e058a77bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.633+0000 7fa4ad980640 1 --2- 172.21.15.148:0/1400455826 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e058a73410 0x55e058a77bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.633+0000 7fa4ad980640 1 -- 172.21.15.148:0/1400455826 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e058a6a2d0 con 0x55e058a72af0 2024-09-19T07:12:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.633+0000 7fa4ad980640 1 --2- 172.21.15.148:0/1400455826 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e058a72af0 0x55e058a86410 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fa4a4031550 tx=0x7fa4a4004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a433b5c5ed1d79b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.633+0000 7fa4917fa640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:12:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.633+0000 7fa4917fa640 1 -- 172.21.15.148:0/1400455826 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a4035040 con 0x55e058a72af0 2024-09-19T07:12:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.633+0000 7fa4917fa640 1 -- 172.21.15.148:0/1400455826 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fa4a4005450 con 0x55e058a72af0 2024-09-19T07:12:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.633+0000 7fa4b2a56740 1 -- 172.21.15.148:0/1400455826 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4a00147f0 con 0x55e058a72af0 2024-09-19T07:12:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.633+0000 7fa4917fa640 1 -- 172.21.15.148:0/1400455826 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa4a4054050 con 0x55e058a72af0 2024-09-19T07:12:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.633+0000 7fa4b2a56740 10 client.15828 fetch_fsmap learned FSMap version 25 2024-09-19T07:12:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.633+0000 7fa4b2a56740 1 -- 172.21.15.148:0/1400455826 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e058a6fcf0 con 0x55e058a72af0 2024-09-19T07:12:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.634+0000 7fa4917fa640 1 -- 172.21.15.148:0/1400455826 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4a00147f0 con 0x55e058a72af0 2024-09-19T07:12:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.634+0000 7fa4917fa640 1 -- 172.21.15.148:0/1400455826 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa4a40316d0 con 0x55e058a72af0 2024-09-19T07:12:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.634+0000 7fa4b2a56740 10 client.15828 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:12:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.634+0000 7fa4b2a56740 10 client.15828 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:12:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.634+0000 7fa4b2a56740 20 client.15828 populate_metadata read hostname 'smithi148' 2024-09-19T07:12:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.634+0000 7fa4b2a56740 1 --2- 172.21.15.148:0/1400455826 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e058af8a20 0x55e058afae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.634+0000 7fa4b2a56740 4 client.15828 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:12:46.641 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.634+0000 7fa4b2a56740 1 -- 172.21.15.148:0/1400455826 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e0589ded70 con 0x55e058af8a20 2024-09-19T07:12:46.641 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.634+0000 7fa4ad17f640 1 --2- 172.21.15.148:0/1400455826 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e058af8a20 0x55e058afae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:46.641 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.634+0000 7fa4917fa640 10 client.15828 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:46.641 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.634+0000 7fa4ad17f640 1 --2- 172.21.15.148:0/1400455826 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e058af8a20 0x55e058afae30 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d9cd29b8f1b7798 server_cookie=4df34ed389ac5a31 in_seq=0 out_seq=0 2024-09-19T07:12:46.642 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.638+0000 7fa4917fa640 1 -- 172.21.15.148:0/1400455826 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e0589ded70 con 0x55e058af8a20 2024-09-19T07:12:46.642 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.638+0000 7fa4917fa640 10 client.15828 handle_command_reply: tid=0 2024-09-19T07:12:46.642 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.638+0000 7fa4b2a56740 1 client.15828 shutdown 2024-09-19T07:12:46.642 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.638+0000 7fa4b2a56740 1 -- 172.21.15.148:0/1400455826 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e058a72af0 msgr2=0x55e058a86410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:46.642 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.638+0000 7fa4b2a56740 1 --2- 172.21.15.148:0/1400455826 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e058a72af0 0x55e058a86410 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fa4a4031550 tx=0x7fa4a4004290 comp rx=0 tx=0).stop 2024-09-19T07:12:46.642 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.639+0000 7fa4b2a56740 1 -- 172.21.15.148:0/1400455826 shutdown_connections 2024-09-19T07:12:46.642 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.639+0000 7fa4b2a56740 1 --2- 172.21.15.148:0/1400455826 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e058af8a20 0x55e058afae30 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.643 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.639+0000 7fa4b2a56740 1 --2- 172.21.15.148:0/1400455826 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e058a7dcb0 0x55e058a78100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.643 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.639+0000 7fa4917fa640 0 client.15828 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:46.643 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.639+0000 7fa4b2a56740 1 --2- 172.21.15.148:0/1400455826 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e058a73410 0x55e058a77bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.643 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.639+0000 7fa4b2a56740 1 --2- 172.21.15.148:0/1400455826 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e058a72af0 0x55e058a86410 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.643 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.639+0000 7fa4b2a56740 1 -- 172.21.15.148:0/1400455826 >> 172.21.15.148:0/1400455826 conn(0x55e058a6f060 msgr2=0x55e058a6d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:46.643 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.639+0000 7fa4b2a56740 1 -- 172.21.15.148:0/1400455826 shutdown_connections 2024-09-19T07:12:46.643 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.639+0000 7fa4b2a56740 1 -- 172.21.15.148:0/1400455826 wait complete. 2024-09-19T07:12:46.643 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.639+0000 7fa4b2a56740 20 client.15828 trim_cache size 0 max 16384 2024-09-19T07:12:46.643 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:12:46.643 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:12:46.643 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:12:46.644 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:12:46.644 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.639+0000 7fa4afbe4640 1 -- 172.21.15.148:0/1410392075 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fa4940a3460 msgr2=0x7fa4940a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:46.644 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.639+0000 7fa4afbe4640 1 --2- 172.21.15.148:0/1410392075 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fa4940a3460 0x7fa4940a5920 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0011c40 tx=0x7fa4a001c000 comp rx=0 tx=0).stop 2024-09-19T07:12:46.645 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.639+0000 7fa4afbe4640 1 -- 172.21.15.148:0/1410392075 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4a8101350 msgr2=0x7fa4a81988c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:46.645 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.639+0000 7fa4afbe4640 1 --2- 172.21.15.148:0/1410392075 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4a8101350 0x7fa4a81988c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fa49800e9f0 tx=0x7fa49800edf0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.645 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.639+0000 7fa4afbe4640 1 -- 172.21.15.148:0/1410392075 shutdown_connections 2024-09-19T07:12:46.645 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.639+0000 7fa4afbe4640 1 --2- 172.21.15.148:0/1410392075 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fa4940a3460 0x7fa4940a5920 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.645 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.639+0000 7fa4afbe4640 1 --2- 172.21.15.148:0/1410392075 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4a81069c0 0x7fa4a819cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.645 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.639+0000 7fa4afbe4640 1 --2- 172.21.15.148:0/1410392075 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4a8101350 0x7fa4a81988c0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.645 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.639+0000 7fa4afbe4640 1 --2- 172.21.15.148:0/1410392075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4a81009b0 0x7fa4a8198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.645 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.639+0000 7fa4afbe4640 1 -- 172.21.15.148:0/1410392075 >> 172.21.15.148:0/1410392075 conn(0x7fa4a8077990 msgr2=0x7fa4a80ff140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:46.645 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.639+0000 7fa4afbe4640 1 -- 172.21.15.148:0/1410392075 shutdown_connections 2024-09-19T07:12:46.645 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:46.640+0000 7fa4afbe4640 1 -- 172.21.15.148:0/1410392075 wait complete. 2024-09-19T07:12:46.707 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:46 smithi148 ceph-mon[31180]: pgmap v54: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-09-19T07:12:46.707 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:46 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/3255775898' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:12:46.707 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:46 smithi148 ceph-mon[31180]: scrub summary: idle 2024-09-19T07:12:46.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:46 smithi179 ceph-mon[35716]: pgmap v54: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-09-19T07:12:46.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:46 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/3255775898' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:12:46.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:46 smithi179 ceph-mon[35716]: scrub summary: idle 2024-09-19T07:12:46.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.790+0000 7fcda2d64640 1 -- 172.21.15.148:0/2076998204 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd9c102570 msgr2=0x7fcd9c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:46.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.790+0000 7fcda2d64640 1 --2- 172.21.15.148:0/2076998204 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd9c102570 0x7fcd9c1029b0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fcd88009900 tx=0x7fcd8802a480 comp rx=0 tx=0).stop 2024-09-19T07:12:46.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.790+0000 7fcda2d64640 1 -- 172.21.15.148:0/2076998204 shutdown_connections 2024-09-19T07:12:46.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.790+0000 7fcda2d64640 1 --2- 172.21.15.148:0/2076998204 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcd9c102ef0 0x7fcd9c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.790+0000 7fcda2d64640 1 --2- 172.21.15.148:0/2076998204 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd9c102570 0x7fcd9c1029b0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.790+0000 7fcda2d64640 1 --2- 172.21.15.148:0/2076998204 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd9c100e20 0x7fcd9c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.790+0000 7fcda2d64640 1 -- 172.21.15.148:0/2076998204 >> 172.21.15.148:0/2076998204 conn(0x7fcd9c0fc7d0 msgr2=0x7fcd9c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:46.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.790+0000 7fcda2d64640 1 -- 172.21.15.148:0/2076998204 shutdown_connections 2024-09-19T07:12:46.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.790+0000 7fcda2d64640 1 -- 172.21.15.148:0/2076998204 wait complete. 2024-09-19T07:12:46.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.790+0000 7fcda2d64640 1 Processor -- start 2024-09-19T07:12:46.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.790+0000 7fcda2d64640 1 -- start start 2024-09-19T07:12:46.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.791+0000 7fcda2d64640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd9c100e20 0x7fcd9c199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:46.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.791+0000 7fcda2d64640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd9c102570 0x7fcd9c1998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:46.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.791+0000 7fcda2d64640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcd9c102ef0 0x7fcd9c1a4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:46.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.791+0000 7fcda2d64640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fcd9c110f80 con 0x7fcd9c102570 2024-09-19T07:12:46.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.791+0000 7fcda2d64640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcd9c110e00 con 0x7fcd9c102ef0 2024-09-19T07:12:46.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.791+0000 7fcda2d64640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcd9c111100 con 0x7fcd9c100e20 2024-09-19T07:12:46.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.791+0000 7fcd9bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd9c102570 0x7fcd9c1998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:46.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.791+0000 7fcd9bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd9c102570 0x7fcd9c1998d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58130/0 (socket says 172.21.15.148:58130) 2024-09-19T07:12:46.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.791+0000 7fcd9bfff640 1 -- 172.21.15.148:0/1991672343 learned_addr learned my addr 172.21.15.148:0/1991672343 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:46.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.791+0000 7fcda0b00640 1 --2- 172.21.15.148:0/1991672343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd9c100e20 0x7fcd9c199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:46.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.791+0000 7fcda1301640 1 --2- 172.21.15.148:0/1991672343 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcd9c102ef0 0x7fcd9c1a4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:46.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.791+0000 7fcd9bfff640 1 -- 172.21.15.148:0/1991672343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd9c100e20 msgr2=0x7fcd9c199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:46.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.791+0000 7fcd9bfff640 1 --2- 172.21.15.148:0/1991672343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd9c100e20 0x7fcd9c199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.791+0000 7fcd9bfff640 1 -- 172.21.15.148:0/1991672343 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcd9c102ef0 msgr2=0x7fcd9c1a4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:46.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.791+0000 7fcd9bfff640 1 --2- 172.21.15.148:0/1991672343 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcd9c102ef0 0x7fcd9c1a4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.791+0000 7fcd9bfff640 1 -- 172.21.15.148:0/1991672343 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd9c1a4950 con 0x7fcd9c102570 2024-09-19T07:12:46.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.791+0000 7fcd9bfff640 1 --2- 172.21.15.148:0/1991672343 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd9c102570 0x7fcd9c1998d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fcd88006010 tx=0x7fcd88003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:46.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.792+0000 7fcd99ffb640 1 -- 172.21.15.148:0/1991672343 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd8803f070 con 0x7fcd9c102570 2024-09-19T07:12:46.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.792+0000 7fcd99ffb640 1 -- 172.21.15.148:0/1991672343 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd88031c30 con 0x7fcd9c102570 2024-09-19T07:12:46.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.792+0000 7fcda2d64640 1 -- 172.21.15.148:0/1991672343 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd9c1a4b20 con 0x7fcd9c102570 2024-09-19T07:12:46.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.792+0000 7fcd99ffb640 1 -- 172.21.15.148:0/1991672343 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd88035030 con 0x7fcd9c102570 2024-09-19T07:12:46.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.792+0000 7fcda2d64640 1 -- 172.21.15.148:0/1991672343 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd9c1a4f70 con 0x7fcd9c102570 2024-09-19T07:12:46.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.794+0000 7fcd99ffb640 1 -- 172.21.15.148:0/1991672343 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fcd88042070 con 0x7fcd9c102570 2024-09-19T07:12:46.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.794+0000 7fcda513d740 1 Processor -- start 2024-09-19T07:12:46.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.794+0000 7fcda513d740 1 -- start start 2024-09-19T07:12:46.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.794+0000 7fcd99ffb640 1 --2- 172.21.15.148:0/1991672343 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fcd8c0a33b0 0x7fcd8c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:46.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.794+0000 7fcda513d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5594c36604a0 0x5594c3660880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:46.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.795+0000 7fcda513d740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5594c3660dc0 0x5594c366b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:46.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.795+0000 7fcda513d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5594c366b680 0x5594c366da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:46.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.795+0000 7fcda513d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5594c35c62e0 con 0x5594c36604a0 2024-09-19T07:12:46.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.795+0000 7fcda513d740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5594c356dce0 con 0x5594c3660dc0 2024-09-19T07:12:46.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.795+0000 7fcda513d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5594c35c22a0 con 0x5594c366b680 2024-09-19T07:12:46.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.795+0000 7fcda0b00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5594c36604a0 0x5594c3660880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:46.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.795+0000 7fcda1301640 1 --2- 172.21.15.148:0/1991672343 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fcd8c0a33b0 0x7fcd8c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:46.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.795+0000 7fcd9bfff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5594c3660dc0 0x5594c366b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:46.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.795+0000 7fcda0b00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5594c36604a0 0x5594c3660880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58140/0 (socket says 172.21.15.148:58140) 2024-09-19T07:12:46.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.795+0000 7fcda0b00640 1 -- 172.21.15.148:0/1028528678 learned_addr learned my addr 172.21.15.148:0/1028528678 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:46.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.795+0000 7fcd99ffb640 1 -- 172.21.15.148:0/1991672343 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fcd880f0570 con 0x7fcd9c102570 2024-09-19T07:12:46.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.795+0000 7fcda1301640 1 --2- 172.21.15.148:0/1028528678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5594c366b680 0x5594c366da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:46.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.795+0000 7fcda0b00640 1 -- 172.21.15.148:0/1028528678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5594c366b680 msgr2=0x5594c366da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:46.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.795+0000 7fcda0b00640 1 --2- 172.21.15.148:0/1028528678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5594c366b680 0x5594c366da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.795+0000 7fcda0b00640 1 -- 172.21.15.148:0/1028528678 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5594c3660dc0 msgr2=0x5594c366b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:46.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.795+0000 7fcda0b00640 1 --2- 172.21.15.148:0/1028528678 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5594c3660dc0 0x5594c366b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.795+0000 7fcda0b00640 1 -- 172.21.15.148:0/1028528678 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594c3552440 con 0x5594c36604a0 2024-09-19T07:12:46.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.795+0000 7fcda1301640 1 --2- 172.21.15.148:0/1991672343 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fcd8c0a33b0 0x7fcd8c0a5870 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcd9400afd0 tx=0x7fcd9400ac80 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:46.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.795+0000 7fcda0b00640 1 --2- 172.21.15.148:0/1028528678 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5594c36604a0 0x5594c3660880 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fcd9000bd10 tx=0x7fcd900107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d33dfbd247caeb85 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:46.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.795+0000 7fcd86ffd640 1 -- 172.21.15.148:0/1028528678 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd90004030 con 0x5594c36604a0 2024-09-19T07:12:46.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.796+0000 7fcd86ffd640 1 -- 172.21.15.148:0/1028528678 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd900041d0 con 0x5594c36604a0 2024-09-19T07:12:46.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.796+0000 7fcd86ffd640 1 -- 172.21.15.148:0/1028528678 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd900117c0 con 0x5594c36604a0 2024-09-19T07:12:46.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.796+0000 7fcda513d740 1 -- 172.21.15.148:0/1028528678 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5594c36604a0 msgr2=0x5594c3660880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:46.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.796+0000 7fcda513d740 1 --2- 172.21.15.148:0/1028528678 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5594c36604a0 0x5594c3660880 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fcd9000bd10 tx=0x7fcd900107a0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.796+0000 7fcda513d740 1 -- 172.21.15.148:0/1028528678 shutdown_connections 2024-09-19T07:12:46.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.796+0000 7fcda513d740 1 --2- 172.21.15.148:0/1028528678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5594c366b680 0x5594c366da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.796+0000 7fcda513d740 1 --2- 172.21.15.148:0/1028528678 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5594c3660dc0 0x5594c366b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.796+0000 7fcda513d740 1 --2- 172.21.15.148:0/1028528678 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5594c36604a0 0x5594c3660880 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.796+0000 7fcda513d740 1 -- 172.21.15.148:0/1028528678 >> 172.21.15.148:0/1028528678 conn(0x5594c365ca30 msgr2=0x5594c365ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:46.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.796+0000 7fcda513d740 1 -- 172.21.15.148:0/1028528678 shutdown_connections 2024-09-19T07:12:46.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.796+0000 7fcda513d740 1 -- 172.21.15.148:0/1028528678 wait complete. 2024-09-19T07:12:46.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.797+0000 7fcda513d740 1 -- start start 2024-09-19T07:12:46.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.797+0000 7fcda513d740 1 Processor -- start 2024-09-19T07:12:46.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.797+0000 7fcda513d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5594c36604a0 0x5594c366afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:46.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.797+0000 7fcda513d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5594c3660dc0 0x5594c3668270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:46.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.797+0000 7fcda513d740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5594c366b680 0x5594c36687b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:46.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.797+0000 7fcda513d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5594c366e250 con 0x5594c3660dc0 2024-09-19T07:12:46.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.797+0000 7fcda513d740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5594c3581050 con 0x5594c366b680 2024-09-19T07:12:46.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.797+0000 7fcda513d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5594c366e3d0 con 0x5594c36604a0 2024-09-19T07:12:46.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.797+0000 7fcda513d740 10 client.0 _ll_register_callbacks cb 0x5594c35c1160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:12:46.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.797+0000 7fcd9bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5594c3660dc0 0x5594c3668270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:46.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.797+0000 7fcd9bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5594c3660dc0 0x5594c3668270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58146/0 (socket says 172.21.15.148:58146) 2024-09-19T07:12:46.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.797+0000 7fcd9bfff640 1 -- 172.21.15.148:0/3898462447 learned_addr learned my addr 172.21.15.148:0/3898462447 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:46.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.797+0000 7fcda1301640 1 --2- 172.21.15.148:0/3898462447 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5594c366b680 0x5594c36687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:46.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.797+0000 7fcda0b00640 1 --2- 172.21.15.148:0/3898462447 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5594c36604a0 0x5594c366afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:46.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.797+0000 7fcd9bfff640 1 -- 172.21.15.148:0/3898462447 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5594c36604a0 msgr2=0x5594c366afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:46.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.797+0000 7fcd9bfff640 1 --2- 172.21.15.148:0/3898462447 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5594c36604a0 0x5594c366afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.797+0000 7fcd9bfff640 1 -- 172.21.15.148:0/3898462447 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5594c366b680 msgr2=0x5594c36687b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:46.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.797+0000 7fcd9bfff640 1 --2- 172.21.15.148:0/3898462447 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5594c366b680 0x5594c36687b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.797+0000 7fcd9bfff640 1 -- 172.21.15.148:0/3898462447 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594c33373c0 con 0x5594c3660dc0 2024-09-19T07:12:46.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.797+0000 7fcda0b00640 1 --2- 172.21.15.148:0/3898462447 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5594c36604a0 0x5594c366afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:12:46.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.798+0000 7fcd9bfff640 1 --2- 172.21.15.148:0/3898462447 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5594c3660dc0 0x5594c3668270 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fcd880edd30 tx=0x7fcd8802a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=581c03df4e15de15 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:46.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.798+0000 7fcd7bfff640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:12:46.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.798+0000 7fcd7bfff640 1 -- 172.21.15.148:0/3898462447 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd88049070 con 0x5594c3660dc0 2024-09-19T07:12:46.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.798+0000 7fcd7bfff640 1 -- 172.21.15.148:0/3898462447 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fcd880b8ed0 con 0x5594c3660dc0 2024-09-19T07:12:46.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.798+0000 7fcda513d740 1 -- 172.21.15.148:0/3898462447 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd900041d0 con 0x5594c3660dc0 2024-09-19T07:12:46.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.798+0000 7fcd7bfff640 1 -- 172.21.15.148:0/3898462447 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fcd880cf3a0 con 0x5594c3660dc0 2024-09-19T07:12:46.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.798+0000 7fcda513d740 10 client.15840 fetch_fsmap learned FSMap version 25 2024-09-19T07:12:46.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.798+0000 7fcda513d740 1 -- 172.21.15.148:0/3898462447 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5594c3679c00 con 0x5594c3660dc0 2024-09-19T07:12:46.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.798+0000 7fcd7bfff640 1 -- 172.21.15.148:0/3898462447 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd900041d0 con 0x5594c3660dc0 2024-09-19T07:12:46.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.798+0000 7fcd7bfff640 1 -- 172.21.15.148:0/3898462447 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fcd880edf50 con 0x5594c3660dc0 2024-09-19T07:12:46.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.798+0000 7fcda513d740 10 client.15840 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:12:46.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.798+0000 7fcda513d740 10 client.15840 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:12:46.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.798+0000 7fcda513d740 20 client.15840 populate_metadata read hostname 'smithi148' 2024-09-19T07:12:46.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.798+0000 7fcda513d740 1 --2- 172.21.15.148:0/3898462447 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5594c367b0b0 0x5594c367d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:46.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.798+0000 7fcda513d740 4 client.15840 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:12:46.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.798+0000 7fcda513d740 1 -- 172.21.15.148:0/3898462447 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5594c35d3850 con 0x5594c367b0b0 2024-09-19T07:12:46.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.799+0000 7fcda0b00640 1 --2- 172.21.15.148:0/3898462447 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5594c367b0b0 0x5594c367d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:46.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.799+0000 7fcda0b00640 1 --2- 172.21.15.148:0/3898462447 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5594c367b0b0 0x5594c367d500 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b69606c78ce14b1 server_cookie=31ba1b369bb9778f in_seq=0 out_seq=0 2024-09-19T07:12:46.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.799+0000 7fcd7bfff640 10 client.15840 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:46.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.800+0000 7fcd7bfff640 1 -- 172.21.15.148:0/3898462447 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5594c35d3850 con 0x5594c367b0b0 2024-09-19T07:12:46.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.800+0000 7fcd7bfff640 10 client.15840 handle_command_reply: tid=0 2024-09-19T07:12:46.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.800+0000 7fcda513d740 1 client.15840 shutdown 2024-09-19T07:12:46.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.800+0000 7fcda513d740 1 -- 172.21.15.148:0/3898462447 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5594c3660dc0 msgr2=0x5594c3668270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:46.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.800+0000 7fcda513d740 1 --2- 172.21.15.148:0/3898462447 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5594c3660dc0 0x5594c3668270 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fcd880edd30 tx=0x7fcd8802a480 comp rx=0 tx=0).stop 2024-09-19T07:12:46.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.800+0000 7fcda513d740 1 -- 172.21.15.148:0/3898462447 shutdown_connections 2024-09-19T07:12:46.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.800+0000 7fcda513d740 1 --2- 172.21.15.148:0/3898462447 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5594c367b0b0 0x5594c367d500 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.800+0000 7fcda513d740 1 --2- 172.21.15.148:0/3898462447 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5594c366b680 0x5594c36687b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.800+0000 7fcda513d740 1 --2- 172.21.15.148:0/3898462447 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5594c3660dc0 0x5594c3668270 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.800+0000 7fcd7bfff640 0 client.15840 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:46.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.800+0000 7fcda513d740 1 --2- 172.21.15.148:0/3898462447 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5594c36604a0 0x5594c366afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.800+0000 7fcda513d740 1 -- 172.21.15.148:0/3898462447 >> 172.21.15.148:0/3898462447 conn(0x5594c365ca30 msgr2=0x5594c3662760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:46.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.800+0000 7fcda513d740 1 -- 172.21.15.148:0/3898462447 shutdown_connections 2024-09-19T07:12:46.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.800+0000 7fcda513d740 1 -- 172.21.15.148:0/3898462447 wait complete. 2024-09-19T07:12:46.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.800+0000 7fcda513d740 20 client.15840 trim_cache size 0 max 16384 2024-09-19T07:12:46.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.817+0000 7fcda513d740 1 Processor -- start 2024-09-19T07:12:46.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.817+0000 7fcda513d740 1 -- start start 2024-09-19T07:12:46.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.817+0000 7fcda513d740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5594c36604a0 0x5594c366a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:46.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.817+0000 7fcda513d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5594c3660dc0 0x5594c3682e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:46.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.817+0000 7fcda513d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5594c366b680 0x5594c3683350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:46.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.817+0000 7fcda513d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fcd9c1b0080 con 0x5594c366b680 2024-09-19T07:12:46.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.817+0000 7fcda513d740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcd9c1ad950 con 0x5594c36604a0 2024-09-19T07:12:46.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.817+0000 7fcda513d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcd9c1ab7c0 con 0x5594c3660dc0 2024-09-19T07:12:46.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.817+0000 7fcda1301640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5594c366b680 0x5594c3683350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:46.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.817+0000 7fcda1301640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5594c366b680 0x5594c3683350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58156/0 (socket says 172.21.15.148:58156) 2024-09-19T07:12:46.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.817+0000 7fcda1301640 1 -- 172.21.15.148:0/2236465486 learned_addr learned my addr 172.21.15.148:0/2236465486 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:46.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.817+0000 7fcda0b00640 1 --2- 172.21.15.148:0/2236465486 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5594c36604a0 0x5594c366a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:46.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.817+0000 7fcd9bfff640 1 --2- 172.21.15.148:0/2236465486 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5594c3660dc0 0x5594c3682e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:46.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.817+0000 7fcda1301640 1 -- 172.21.15.148:0/2236465486 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5594c3660dc0 msgr2=0x5594c3682e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:46.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.817+0000 7fcda1301640 1 --2- 172.21.15.148:0/2236465486 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5594c3660dc0 0x5594c3682e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.818+0000 7fcda1301640 1 -- 172.21.15.148:0/2236465486 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5594c36604a0 msgr2=0x5594c366a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:46.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.818+0000 7fcda1301640 1 --2- 172.21.15.148:0/2236465486 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5594c36604a0 0x5594c366a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.818+0000 7fcda1301640 1 -- 172.21.15.148:0/2236465486 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594c36667c0 con 0x5594c366b680 2024-09-19T07:12:46.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.818+0000 7fcda1301640 1 --2- 172.21.15.148:0/2236465486 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5594c366b680 0x5594c3683350 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fcd94013260 tx=0x7fcd9401d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afecaffbf87b947d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:46.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.818+0000 7fcd867fc640 1 -- 172.21.15.148:0/2236465486 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd94012b80 con 0x5594c366b680 2024-09-19T07:12:46.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.818+0000 7fcd867fc640 1 -- 172.21.15.148:0/2236465486 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd94010e90 con 0x5594c366b680 2024-09-19T07:12:46.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.818+0000 7fcd867fc640 1 -- 172.21.15.148:0/2236465486 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd940046c0 con 0x5594c366b680 2024-09-19T07:12:46.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.818+0000 7fcda513d740 1 -- 172.21.15.148:0/2236465486 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5594c366b680 msgr2=0x5594c3683350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:46.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.819+0000 7fcda513d740 1 --2- 172.21.15.148:0/2236465486 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5594c366b680 0x5594c3683350 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fcd94013260 tx=0x7fcd9401d000 comp rx=0 tx=0).stop 2024-09-19T07:12:46.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.819+0000 7fcda513d740 1 -- 172.21.15.148:0/2236465486 shutdown_connections 2024-09-19T07:12:46.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.819+0000 7fcda513d740 1 --2- 172.21.15.148:0/2236465486 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5594c366b680 0x5594c3683350 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.819+0000 7fcda513d740 1 --2- 172.21.15.148:0/2236465486 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5594c3660dc0 0x5594c3682e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.819+0000 7fcda513d740 1 --2- 172.21.15.148:0/2236465486 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5594c36604a0 0x5594c366a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.819+0000 7fcda513d740 1 -- 172.21.15.148:0/2236465486 >> 172.21.15.148:0/2236465486 conn(0x5594c365ca30 msgr2=0x5594c3669ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:46.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.819+0000 7fcda513d740 1 -- 172.21.15.148:0/2236465486 shutdown_connections 2024-09-19T07:12:46.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.819+0000 7fcda513d740 1 -- 172.21.15.148:0/2236465486 wait complete. 2024-09-19T07:12:46.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.819+0000 7fcda513d740 1 -- start start 2024-09-19T07:12:46.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.819+0000 7fcda513d740 1 Processor -- start 2024-09-19T07:12:46.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.819+0000 7fcda513d740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5594c36604a0 0x5594c3671330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:46.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.819+0000 7fcda513d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5594c3660dc0 0x5594c3671870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:46.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.819+0000 7fcda513d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5594c366b680 0x5594c3671db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:46.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.819+0000 7fcda513d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fcd9c1abe10 con 0x5594c366b680 2024-09-19T07:12:46.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.819+0000 7fcda513d740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcd9c1ad280 con 0x5594c36604a0 2024-09-19T07:12:46.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.819+0000 7fcda513d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcd9c1ac4e0 con 0x5594c3660dc0 2024-09-19T07:12:46.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.820+0000 7fcda513d740 10 client.0 _ll_register_callbacks cb 0x7fcd88046f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:12:46.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.820+0000 7fcda1301640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5594c366b680 0x5594c3671db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:46.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.820+0000 7fcda0b00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5594c36604a0 0x5594c3671330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:46.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.820+0000 7fcda1301640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5594c366b680 0x5594c3671db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58160/0 (socket says 172.21.15.148:58160) 2024-09-19T07:12:46.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.820+0000 7fcda0b00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5594c36604a0 0x5594c3671330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:36190/0 (socket says 172.21.15.148:36190) 2024-09-19T07:12:46.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.820+0000 7fcda1301640 1 -- 172.21.15.148:0/1703001234 learned_addr learned my addr 172.21.15.148:0/1703001234 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:46.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.820+0000 7fcd9bfff640 1 --2- 172.21.15.148:0/1703001234 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5594c3660dc0 0x5594c3671870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:46.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.820+0000 7fcda1301640 1 -- 172.21.15.148:0/1703001234 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5594c3660dc0 msgr2=0x5594c3671870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:46.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.820+0000 7fcda1301640 1 --2- 172.21.15.148:0/1703001234 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5594c3660dc0 0x5594c3671870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.820+0000 7fcda1301640 1 -- 172.21.15.148:0/1703001234 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5594c36604a0 msgr2=0x5594c3671330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:46.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.820+0000 7fcda1301640 1 --2- 172.21.15.148:0/1703001234 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5594c36604a0 0x5594c3671330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.820+0000 7fcda1301640 1 -- 172.21.15.148:0/1703001234 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594c36e4df0 con 0x5594c366b680 2024-09-19T07:12:46.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.820+0000 7fcda0b00640 1 --2- 172.21.15.148:0/1703001234 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5594c36604a0 0x5594c3671330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:12:46.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.820+0000 7fcda1301640 1 --2- 172.21.15.148:0/1703001234 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5594c366b680 0x5594c3671db0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fcd940042a0 tx=0x7fcd94003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16068cbbb7eb063 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:46.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.820+0000 7fcd7bfff640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:12:46.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.820+0000 7fcd7bfff640 1 -- 172.21.15.148:0/1703001234 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd94003f20 con 0x5594c366b680 2024-09-19T07:12:46.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.820+0000 7fcda513d740 1 -- 172.21.15.148:0/1703001234 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd94010e90 con 0x5594c366b680 2024-09-19T07:12:46.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.820+0000 7fcd7bfff640 1 -- 172.21.15.148:0/1703001234 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fcd94004a40 con 0x5594c366b680 2024-09-19T07:12:46.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.820+0000 7fcd7bfff640 1 -- 172.21.15.148:0/1703001234 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fcd94004c40 con 0x5594c366b680 2024-09-19T07:12:46.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.820+0000 7fcda513d740 10 client.15846 fetch_fsmap learned FSMap version 25 2024-09-19T07:12:46.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.820+0000 7fcda513d740 1 -- 172.21.15.148:0/1703001234 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5594c36e6080 con 0x5594c366b680 2024-09-19T07:12:46.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.821+0000 7fcd7bfff640 1 -- 172.21.15.148:0/1703001234 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd94010e90 con 0x5594c366b680 2024-09-19T07:12:46.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.821+0000 7fcd7bfff640 1 -- 172.21.15.148:0/1703001234 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fcd94028070 con 0x5594c366b680 2024-09-19T07:12:46.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.821+0000 7fcda513d740 10 client.15846 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:12:46.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.821+0000 7fcda513d740 10 client.15846 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:12:46.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.821+0000 7fcda513d740 20 client.15846 populate_metadata read hostname 'smithi148' 2024-09-19T07:12:46.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.821+0000 7fcda513d740 1 --2- 172.21.15.148:0/1703001234 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5594c36e6740 0x5594c36e8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:46.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.821+0000 7fcda513d740 4 client.15846 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T07:12:46.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.821+0000 7fcda513d740 1 -- 172.21.15.148:0/1703001234 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5594c35cdd60 con 0x5594c36e6740 2024-09-19T07:12:46.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.821+0000 7fcda0b00640 1 --2- 172.21.15.148:0/1703001234 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5594c36e6740 0x5594c36e8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:46.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.821+0000 7fcda0b00640 1 --2- 172.21.15.148:0/1703001234 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5594c36e6740 0x5594c36e8b60 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f5d80d789f638ad server_cookie=18142dacc935155c in_seq=0 out_seq=0 2024-09-19T07:12:46.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.821+0000 7fcd7bfff640 10 client.15846 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:46.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.822+0000 7fcd7bfff640 1 -- 172.21.15.148:0/1703001234 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5594c35cdd60 con 0x5594c36e6740 2024-09-19T07:12:46.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.822+0000 7fcd7bfff640 10 client.15846 handle_command_reply: tid=0 2024-09-19T07:12:46.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.822+0000 7fcda513d740 1 client.15846 shutdown 2024-09-19T07:12:46.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.822+0000 7fcda513d740 1 -- 172.21.15.148:0/1703001234 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5594c366b680 msgr2=0x5594c3671db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:46.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.822+0000 7fcda513d740 1 --2- 172.21.15.148:0/1703001234 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5594c366b680 0x5594c3671db0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fcd940042a0 tx=0x7fcd94003ba0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.822+0000 7fcda513d740 1 -- 172.21.15.148:0/1703001234 shutdown_connections 2024-09-19T07:12:46.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.822+0000 7fcda513d740 1 --2- 172.21.15.148:0/1703001234 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5594c36e6740 0x5594c36e8b60 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.822+0000 7fcda513d740 1 --2- 172.21.15.148:0/1703001234 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5594c366b680 0x5594c3671db0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.822+0000 7fcda513d740 1 --2- 172.21.15.148:0/1703001234 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5594c3660dc0 0x5594c3671870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.822+0000 7fcda513d740 1 --2- 172.21.15.148:0/1703001234 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5594c36604a0 0x5594c3671330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.822+0000 7fcda513d740 1 -- 172.21.15.148:0/1703001234 >> 172.21.15.148:0/1703001234 conn(0x5594c365ca30 msgr2=0x5594c366a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:46.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.822+0000 7fcd7bfff640 0 client.15846 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:46.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.822+0000 7fcda513d740 1 -- 172.21.15.148:0/1703001234 shutdown_connections 2024-09-19T07:12:46.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.822+0000 7fcda513d740 1 -- 172.21.15.148:0/1703001234 wait complete. 2024-09-19T07:12:46.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.822+0000 7fcda513d740 20 client.15846 trim_cache size 0 max 16384 2024-09-19T07:12:46.837 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:12:46.837 INFO:teuthology.orchestra.run.smithi148.stdout: "status": "no active scrubs running", 2024-09-19T07:12:46.837 INFO:teuthology.orchestra.run.smithi148.stdout: "scrubs": {} 2024-09-19T07:12:46.837 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:12:46.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.823+0000 7fcda2d64640 1 -- 172.21.15.148:0/1991672343 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fcd8c0a33b0 msgr2=0x7fcd8c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:46.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.823+0000 7fcda2d64640 1 --2- 172.21.15.148:0/1991672343 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fcd8c0a33b0 0x7fcd8c0a5870 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcd9400afd0 tx=0x7fcd9400ac80 comp rx=0 tx=0).stop 2024-09-19T07:12:46.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.823+0000 7fcda2d64640 1 -- 172.21.15.148:0/1991672343 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd9c102570 msgr2=0x7fcd9c1998d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:46.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.823+0000 7fcda2d64640 1 --2- 172.21.15.148:0/1991672343 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd9c102570 0x7fcd9c1998d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fcd88006010 tx=0x7fcd88003c10 comp rx=0 tx=0).stop 2024-09-19T07:12:46.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.823+0000 7fcda2d64640 1 -- 172.21.15.148:0/1991672343 shutdown_connections 2024-09-19T07:12:46.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.823+0000 7fcda2d64640 1 --2- 172.21.15.148:0/1991672343 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fcd8c0a33b0 0x7fcd8c0a5870 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.823+0000 7fcda2d64640 1 --2- 172.21.15.148:0/1991672343 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcd9c102ef0 0x7fcd9c1a4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.823+0000 7fcda2d64640 1 --2- 172.21.15.148:0/1991672343 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd9c102570 0x7fcd9c1998d0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.823+0000 7fcda2d64640 1 --2- 172.21.15.148:0/1991672343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd9c100e20 0x7fcd9c199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:46.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.823+0000 7fcda2d64640 1 -- 172.21.15.148:0/1991672343 >> 172.21.15.148:0/1991672343 conn(0x7fcd9c0fc7d0 msgr2=0x7fcd9c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:46.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.823+0000 7fcda2d64640 1 -- 172.21.15.148:0/1991672343 shutdown_connections 2024-09-19T07:12:46.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:46.823+0000 7fcda2d64640 1 -- 172.21.15.148:0/1991672343 wait complete. 2024-09-19T07:12:46.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:46 smithi165 ceph-mon[35326]: pgmap v54: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-09-19T07:12:46.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:46 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/3255775898' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:12:46.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:46 smithi165 ceph-mon[35326]: scrub summary: idle 2024-09-19T07:12:47.580 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T07:12:47.581 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:12:47.654 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:12:48.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.144+0000 7f61de55e640 1 -- 172.21.15.148:0/33359513 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61d8102d30 msgr2=0x7f61d8103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:48.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.144+0000 7f61de55e640 1 --2- 172.21.15.148:0/33359513 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61d8102d30 0x7f61d8103110 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f61c8009930 tx=0x7f61c802a420 comp rx=0 tx=0).stop 2024-09-19T07:12:48.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.144+0000 7f61de55e640 1 -- 172.21.15.148:0/33359513 shutdown_connections 2024-09-19T07:12:48.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.144+0000 7f61de55e640 1 --2- 172.21.15.148:0/33359513 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f61d81082a0 0x7f61d810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:48.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.144+0000 7f61de55e640 1 --2- 172.21.15.148:0/33359513 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61d81036e0 0x7f61d8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:48.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.144+0000 7f61de55e640 1 --2- 172.21.15.148:0/33359513 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61d8102d30 0x7f61d8103110 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:48.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.144+0000 7f61de55e640 1 -- 172.21.15.148:0/33359513 >> 172.21.15.148:0/33359513 conn(0x7f61d80fc7d0 msgr2=0x7f61d80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:48.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.144+0000 7f61de55e640 1 -- 172.21.15.148:0/33359513 shutdown_connections 2024-09-19T07:12:48.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.144+0000 7f61de55e640 1 -- 172.21.15.148:0/33359513 wait complete. 2024-09-19T07:12:48.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.145+0000 7f61de55e640 1 Processor -- start 2024-09-19T07:12:48.147 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.145+0000 7f61de55e640 1 -- start start 2024-09-19T07:12:48.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.145+0000 7f61de55e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61d8102d30 0x7f61d8100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:48.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.145+0000 7f61de55e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f61d81036e0 0x7f61d8100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:48.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.145+0000 7f61de55e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61d81082a0 0x7f61d8101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:48.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.145+0000 7f61de55e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f61d81120a0 con 0x7f61d8102d30 2024-09-19T07:12:48.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.145+0000 7f61de55e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f61d8111f20 con 0x7f61d81036e0 2024-09-19T07:12:48.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.145+0000 7f61de55e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f61d8112220 con 0x7f61d81082a0 2024-09-19T07:12:48.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.145+0000 7f61d7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61d8102d30 0x7f61d8100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:48.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.146+0000 7f61d7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61d8102d30 0x7f61d8100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58180/0 (socket says 172.21.15.148:58180) 2024-09-19T07:12:48.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.146+0000 7f61d7fff640 1 -- 172.21.15.148:0/3893450299 learned_addr learned my addr 172.21.15.148:0/3893450299 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:48.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.146+0000 7f61cffff640 1 --2- 172.21.15.148:0/3893450299 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f61d81036e0 0x7f61d8100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:48.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.146+0000 7f61dcafb640 1 --2- 172.21.15.148:0/3893450299 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61d81082a0 0x7f61d8101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:48.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.146+0000 7f61d7fff640 1 -- 172.21.15.148:0/3893450299 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61d81082a0 msgr2=0x7f61d8101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:48.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.146+0000 7f61d7fff640 1 --2- 172.21.15.148:0/3893450299 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61d81082a0 0x7f61d8101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:48.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.146+0000 7f61d7fff640 1 -- 172.21.15.148:0/3893450299 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f61d81036e0 msgr2=0x7f61d8100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:48.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.146+0000 7f61d7fff640 1 --2- 172.21.15.148:0/3893450299 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f61d81036e0 0x7f61d8100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:48.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.146+0000 7f61d7fff640 1 -- 172.21.15.148:0/3893450299 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61d81a6a00 con 0x7f61d8102d30 2024-09-19T07:12:48.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.146+0000 7f61d7fff640 1 --2- 172.21.15.148:0/3893450299 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61d8102d30 0x7f61d8100990 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f61c8009230 tx=0x7f61c8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:48.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.146+0000 7f61d5ffb640 1 -- 172.21.15.148:0/3893450299 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c803f030 con 0x7f61d8102d30 2024-09-19T07:12:48.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.146+0000 7f61d5ffb640 1 -- 172.21.15.148:0/3893450299 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61c8003ad0 con 0x7f61d8102d30 2024-09-19T07:12:48.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.146+0000 7f61de55e640 1 -- 172.21.15.148:0/3893450299 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61d81a6c90 con 0x7f61d8102d30 2024-09-19T07:12:48.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.146+0000 7f61de55e640 1 -- 172.21.15.148:0/3893450299 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61d81a7170 con 0x7f61d8102d30 2024-09-19T07:12:48.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.146+0000 7f61d5ffb640 1 -- 172.21.15.148:0/3893450299 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c8035070 con 0x7f61d8102d30 2024-09-19T07:12:48.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.149+0000 7f61d5ffb640 1 -- 172.21.15.148:0/3893450299 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f61c8042030 con 0x7f61d8102d30 2024-09-19T07:12:48.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.149+0000 7f61e0937740 1 Processor -- start 2024-09-19T07:12:48.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.149+0000 7f61e0937740 1 -- start start 2024-09-19T07:12:48.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.150+0000 7f61e0937740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56511a25f060 0x56511a25f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:48.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.150+0000 7f61e0937740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56511a25f980 0x56511a269d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:48.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.150+0000 7f61e0937740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56511a26a240 0x56511a26c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:48.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.150+0000 7f61e0937740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56511a1c4620 con 0x56511a26a240 2024-09-19T07:12:48.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.150+0000 7f61e0937740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56511a16be50 con 0x56511a25f060 2024-09-19T07:12:48.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.150+0000 7f61e0937740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56511a1c05e0 con 0x56511a25f980 2024-09-19T07:12:48.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.150+0000 7f61d5ffb640 1 --2- 172.21.15.148:0/3893450299 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f61c40a33b0 0x7f61c40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:48.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.150+0000 7f61cffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56511a26a240 0x56511a26c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:48.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.150+0000 7f61dcafb640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56511a25f060 0x56511a25f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:48.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.150+0000 7f61cffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56511a26a240 0x56511a26c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58182/0 (socket says 172.21.15.148:58182) 2024-09-19T07:12:48.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.150+0000 7f61dcafb640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56511a25f060 0x56511a25f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:36220/0 (socket says 172.21.15.148:36220) 2024-09-19T07:12:48.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.150+0000 7f61cffff640 1 -- 172.21.15.148:0/2069951734 learned_addr learned my addr 172.21.15.148:0/2069951734 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:48.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.150+0000 7f61dcafb640 1 --2- 172.21.15.148:0/3893450299 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f61c40a33b0 0x7f61c40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:48.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.150+0000 7f61d7fff640 1 --2- 172.21.15.148:0/2069951734 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56511a25f980 0x56511a269d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:48.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.150+0000 7f61d5ffb640 1 -- 172.21.15.148:0/3893450299 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f61c80f0160 con 0x7f61d8102d30 2024-09-19T07:12:48.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.150+0000 7f61cffff640 1 -- 172.21.15.148:0/2069951734 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56511a25f980 msgr2=0x56511a269d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:48.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.150+0000 7f61cffff640 1 --2- 172.21.15.148:0/2069951734 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56511a25f980 0x56511a269d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:48.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.150+0000 7f61cffff640 1 -- 172.21.15.148:0/2069951734 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56511a25f060 msgr2=0x56511a25f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:48.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.150+0000 7f61cffff640 1 --2- 172.21.15.148:0/2069951734 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56511a25f060 0x56511a25f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:48.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.150+0000 7f61cffff640 1 -- 172.21.15.148:0/2069951734 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56511a15cd40 con 0x56511a26a240 2024-09-19T07:12:48.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.151+0000 7f61cffff640 1 --2- 172.21.15.148:0/2069951734 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56511a26a240 0x56511a26c630 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f61c000b690 tx=0x7f61c000bb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adb694e024f86820 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:48.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.151+0000 7f61ce7fc640 1 -- 172.21.15.148:0/2069951734 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c0003bd0 con 0x56511a26a240 2024-09-19T07:12:48.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.151+0000 7f61dcafb640 1 --2- 172.21.15.148:0/3893450299 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f61c40a33b0 0x7f61c40a5870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f61d00077f0 tx=0x7f61d0007520 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:48.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.151+0000 7f61ce7fc640 1 -- 172.21.15.148:0/2069951734 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61c0015070 con 0x56511a26a240 2024-09-19T07:12:48.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.151+0000 7f61ce7fc640 1 -- 172.21.15.148:0/2069951734 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c0004e20 con 0x56511a26a240 2024-09-19T07:12:48.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.152+0000 7f61e0937740 1 -- 172.21.15.148:0/2069951734 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56511a26a240 msgr2=0x56511a26c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:48.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.152+0000 7f61e0937740 1 --2- 172.21.15.148:0/2069951734 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56511a26a240 0x56511a26c630 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f61c000b690 tx=0x7f61c000bb50 comp rx=0 tx=0).stop 2024-09-19T07:12:48.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.152+0000 7f61e0937740 1 -- 172.21.15.148:0/2069951734 shutdown_connections 2024-09-19T07:12:48.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.152+0000 7f61e0937740 1 --2- 172.21.15.148:0/2069951734 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56511a26a240 0x56511a26c630 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:48.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.152+0000 7f61e0937740 1 --2- 172.21.15.148:0/2069951734 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56511a25f980 0x56511a269d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:48.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.152+0000 7f61e0937740 1 --2- 172.21.15.148:0/2069951734 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56511a25f060 0x56511a25f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:48.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.152+0000 7f61e0937740 1 -- 172.21.15.148:0/2069951734 >> 172.21.15.148:0/2069951734 conn(0x56511a25b5f0 msgr2=0x56511a25b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:48.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.152+0000 7f61e0937740 1 -- 172.21.15.148:0/2069951734 shutdown_connections 2024-09-19T07:12:48.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.152+0000 7f61e0937740 1 -- 172.21.15.148:0/2069951734 wait complete. 2024-09-19T07:12:48.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.152+0000 7f61e0937740 1 -- start start 2024-09-19T07:12:48.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.153+0000 7f61e0937740 1 Processor -- start 2024-09-19T07:12:48.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.153+0000 7f61e0937740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56511a25f060 0x56511a2670d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:48.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.153+0000 7f61e0937740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56511a25f980 0x56511a267610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:48.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.153+0000 7f61e0937740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56511a26a240 0x56511a267b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:48.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.153+0000 7f61e0937740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56511a26ce10 con 0x56511a25f060 2024-09-19T07:12:48.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.153+0000 7f61e0937740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56511a14cf10 con 0x56511a25f980 2024-09-19T07:12:48.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.153+0000 7f61e0937740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56511a26cf90 con 0x56511a26a240 2024-09-19T07:12:48.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.153+0000 7f61e0937740 10 client.0 _ll_register_callbacks cb 0x56511a170db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:12:48.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.153+0000 7f61d7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56511a25f060 0x56511a2670d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:48.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.153+0000 7f61d7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56511a25f060 0x56511a2670d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58190/0 (socket says 172.21.15.148:58190) 2024-09-19T07:12:48.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.153+0000 7f61d7fff640 1 -- 172.21.15.148:0/1228440063 learned_addr learned my addr 172.21.15.148:0/1228440063 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:48.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.153+0000 7f61dcafb640 1 --2- 172.21.15.148:0/1228440063 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56511a26a240 0x56511a267b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:48.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.153+0000 7f61cffff640 1 --2- 172.21.15.148:0/1228440063 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56511a25f980 0x56511a267610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:48.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.153+0000 7f61d7fff640 1 -- 172.21.15.148:0/1228440063 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56511a26a240 msgr2=0x56511a267b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:48.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.153+0000 7f61d7fff640 1 --2- 172.21.15.148:0/1228440063 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56511a26a240 0x56511a267b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:48.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.153+0000 7f61d7fff640 1 -- 172.21.15.148:0/1228440063 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56511a25f980 msgr2=0x56511a267610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:48.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.153+0000 7f61d7fff640 1 --2- 172.21.15.148:0/1228440063 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56511a25f980 0x56511a267610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:48.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.153+0000 7f61d7fff640 1 -- 172.21.15.148:0/1228440063 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565119ed3580 con 0x56511a25f060 2024-09-19T07:12:48.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.154+0000 7f61d7fff640 1 --2- 172.21.15.148:0/1228440063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56511a25f060 0x56511a2670d0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f61c80bc200 tx=0x7f61c8086ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=796f2ced7e2249f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:48.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.154+0000 7f61b77fe640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:12:48.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.154+0000 7f61b77fe640 1 -- 172.21.15.148:0/1228440063 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c8049040 con 0x56511a25f060 2024-09-19T07:12:48.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.154+0000 7f61b77fe640 1 -- 172.21.15.148:0/1228440063 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f61c80b8b70 con 0x56511a25f060 2024-09-19T07:12:48.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.154+0000 7f61e0937740 1 -- 172.21.15.148:0/1228440063 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61c0015070 con 0x56511a25f060 2024-09-19T07:12:48.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.154+0000 7f61b77fe640 1 -- 172.21.15.148:0/1228440063 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f61c80bbe60 con 0x56511a25f060 2024-09-19T07:12:48.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.154+0000 7f61e0937740 10 client.15858 fetch_fsmap learned FSMap version 25 2024-09-19T07:12:48.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.154+0000 7f61e0937740 1 -- 172.21.15.148:0/1228440063 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x565119f9d960 con 0x56511a25f060 2024-09-19T07:12:48.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.154+0000 7f61b77fe640 1 -- 172.21.15.148:0/1228440063 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61c0015070 con 0x56511a25f060 2024-09-19T07:12:48.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.154+0000 7f61b77fe640 1 -- 172.21.15.148:0/1228440063 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f61c803bc70 con 0x56511a25f060 2024-09-19T07:12:48.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.154+0000 7f61e0937740 10 client.15858 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:12:48.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.154+0000 7f61e0937740 10 client.15858 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:12:48.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.155+0000 7f61e0937740 20 client.15858 populate_metadata read hostname 'smithi148' 2024-09-19T07:12:48.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.155+0000 7f61e0937740 1 --2- 172.21.15.148:0/1228440063 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56511a279bd0 0x56511a27c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:48.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.155+0000 7f61e0937740 4 client.15858 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:12:48.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.155+0000 7f61e0937740 1 -- 172.21.15.148:0/1228440063 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56511a1d1b90 con 0x56511a279bd0 2024-09-19T07:12:48.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.155+0000 7f61cffff640 1 --2- 172.21.15.148:0/1228440063 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56511a279bd0 0x56511a27c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:48.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.155+0000 7f61cffff640 1 --2- 172.21.15.148:0/1228440063 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56511a279bd0 0x56511a27c040 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84454073ac020f1b server_cookie=10379b09246c136 in_seq=0 out_seq=0 2024-09-19T07:12:48.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.155+0000 7f61b77fe640 10 client.15858 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:48.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.156+0000 7f61b77fe640 1 -- 172.21.15.148:0/1228440063 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56511a1d1b90 con 0x56511a279bd0 2024-09-19T07:12:48.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.156+0000 7f61b77fe640 10 client.15858 handle_command_reply: tid=0 2024-09-19T07:12:48.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.156+0000 7f61e0937740 1 client.15858 shutdown 2024-09-19T07:12:48.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.156+0000 7f61e0937740 1 -- 172.21.15.148:0/1228440063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56511a25f060 msgr2=0x56511a2670d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:48.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.156+0000 7f61e0937740 1 --2- 172.21.15.148:0/1228440063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56511a25f060 0x56511a2670d0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f61c80bc200 tx=0x7f61c8086ef0 comp rx=0 tx=0).stop 2024-09-19T07:12:48.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.156+0000 7f61e0937740 1 -- 172.21.15.148:0/1228440063 shutdown_connections 2024-09-19T07:12:48.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.156+0000 7f61e0937740 1 --2- 172.21.15.148:0/1228440063 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56511a279bd0 0x56511a27c040 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:48.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.156+0000 7f61e0937740 1 --2- 172.21.15.148:0/1228440063 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56511a26a240 0x56511a267b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:48.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.156+0000 7f61b77fe640 0 client.15858 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:48.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.156+0000 7f61e0937740 1 --2- 172.21.15.148:0/1228440063 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56511a25f980 0x56511a267610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:48.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.156+0000 7f61e0937740 1 --2- 172.21.15.148:0/1228440063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56511a25f060 0x56511a2670d0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:48.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.156+0000 7f61e0937740 1 -- 172.21.15.148:0/1228440063 >> 172.21.15.148:0/1228440063 conn(0x56511a25b5f0 msgr2=0x56511a2612d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:48.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.156+0000 7f61e0937740 1 -- 172.21.15.148:0/1228440063 shutdown_connections 2024-09-19T07:12:48.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.157+0000 7f61e0937740 1 -- 172.21.15.148:0/1228440063 wait complete. 2024-09-19T07:12:48.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.157+0000 7f61e0937740 20 client.15858 trim_cache size 0 max 16384 2024-09-19T07:12:48.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.175+0000 7f61e0937740 1 Processor -- start 2024-09-19T07:12:48.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.175+0000 7f61e0937740 1 -- start start 2024-09-19T07:12:48.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.176+0000 7f61e0937740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56511a25f060 0x56511a25b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:48.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.176+0000 7f61e0937740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56511a25f980 0x56511a2611c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:48.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.176+0000 7f61e0937740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56511a26a240 0x56511a281900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:48.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.176+0000 7f61e0937740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f61d81ae030 con 0x56511a25f060 2024-09-19T07:12:48.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.176+0000 7f61e0937740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f61d81ab900 con 0x56511a25f980 2024-09-19T07:12:48.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.176+0000 7f61e0937740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f61d81a9750 con 0x56511a26a240 2024-09-19T07:12:48.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.176+0000 7f61d7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56511a25f060 0x56511a25b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:48.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.176+0000 7f61d7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56511a25f060 0x56511a25b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58202/0 (socket says 172.21.15.148:58202) 2024-09-19T07:12:48.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.176+0000 7f61d7fff640 1 -- 172.21.15.148:0/95238097 learned_addr learned my addr 172.21.15.148:0/95238097 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:48.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.176+0000 7f61dcafb640 1 --2- 172.21.15.148:0/95238097 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56511a26a240 0x56511a281900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:48.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.176+0000 7f61cffff640 1 --2- 172.21.15.148:0/95238097 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56511a25f980 0x56511a2611c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:48.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.176+0000 7f61d7fff640 1 -- 172.21.15.148:0/95238097 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56511a26a240 msgr2=0x56511a281900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:48.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.176+0000 7f61d7fff640 1 --2- 172.21.15.148:0/95238097 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56511a26a240 0x56511a281900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:48.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.176+0000 7f61d7fff640 1 -- 172.21.15.148:0/95238097 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56511a25f980 msgr2=0x56511a2611c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:48.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.176+0000 7f61d7fff640 1 --2- 172.21.15.148:0/95238097 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56511a25f980 0x56511a2611c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:48.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.176+0000 7f61d7fff640 1 -- 172.21.15.148:0/95238097 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56511a269010 con 0x56511a25f060 2024-09-19T07:12:48.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.176+0000 7f61d7fff640 1 --2- 172.21.15.148:0/95238097 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56511a25f060 0x56511a25b9d0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f61c8000c00 tx=0x7f61c80045f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca0302ac6f406b11 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:48.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.177+0000 7f61cdffb640 1 -- 172.21.15.148:0/95238097 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c8049070 con 0x56511a25f060 2024-09-19T07:12:48.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.177+0000 7f61cdffb640 1 -- 172.21.15.148:0/95238097 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61c80c0800 con 0x56511a25f060 2024-09-19T07:12:48.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.177+0000 7f61cdffb640 1 -- 172.21.15.148:0/95238097 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c80b8c90 con 0x56511a25f060 2024-09-19T07:12:48.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.177+0000 7f61e0937740 1 -- 172.21.15.148:0/95238097 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56511a25f060 msgr2=0x56511a25b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:48.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.177+0000 7f61e0937740 1 --2- 172.21.15.148:0/95238097 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56511a25f060 0x56511a25b9d0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f61c8000c00 tx=0x7f61c80045f0 comp rx=0 tx=0).stop 2024-09-19T07:12:48.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.177+0000 7f61e0937740 1 -- 172.21.15.148:0/95238097 shutdown_connections 2024-09-19T07:12:48.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.177+0000 7f61e0937740 1 --2- 172.21.15.148:0/95238097 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56511a26a240 0x56511a281900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:48.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.177+0000 7f61e0937740 1 --2- 172.21.15.148:0/95238097 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56511a25f980 0x56511a2611c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:48.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.177+0000 7f61e0937740 1 --2- 172.21.15.148:0/95238097 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56511a25f060 0x56511a25b9d0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:48.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.177+0000 7f61e0937740 1 -- 172.21.15.148:0/95238097 >> 172.21.15.148:0/95238097 conn(0x56511a25b5f0 msgr2=0x56511a260ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:48.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.177+0000 7f61e0937740 1 -- 172.21.15.148:0/95238097 shutdown_connections 2024-09-19T07:12:48.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.177+0000 7f61e0937740 1 -- 172.21.15.148:0/95238097 wait complete. 2024-09-19T07:12:48.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.178+0000 7f61e0937740 1 -- start start 2024-09-19T07:12:48.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.178+0000 7f61e0937740 1 Processor -- start 2024-09-19T07:12:48.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.178+0000 7f61e0937740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56511a25f060 0x56511a272630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:48.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.178+0000 7f61e0937740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56511a25f980 0x56511a26e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:48.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.178+0000 7f61e0937740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56511a26a240 0x56511a26eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:48.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.178+0000 7f61e0937740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f61d81a9dc0 con 0x56511a25f060 2024-09-19T07:12:48.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.178+0000 7f61e0937740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f61d81ab230 con 0x56511a25f980 2024-09-19T07:12:48.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.178+0000 7f61e0937740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f61d81aa490 con 0x56511a26a240 2024-09-19T07:12:48.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.178+0000 7f61e0937740 10 client.0 _ll_register_callbacks cb 0x7f61c80b80e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:12:48.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.178+0000 7f61d7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56511a25f060 0x56511a272630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:48.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.178+0000 7f61d7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56511a25f060 0x56511a272630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58214/0 (socket says 172.21.15.148:58214) 2024-09-19T07:12:48.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.178+0000 7f61d7fff640 1 -- 172.21.15.148:0/1652591172 learned_addr learned my addr 172.21.15.148:0/1652591172 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:48.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.179+0000 7f61cffff640 1 --2- 172.21.15.148:0/1652591172 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56511a25f980 0x56511a26e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:48.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.179+0000 7f61dcafb640 1 --2- 172.21.15.148:0/1652591172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56511a26a240 0x56511a26eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:48.182 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:12:48.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.179+0000 7f61d7fff640 1 -- 172.21.15.148:0/1652591172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56511a26a240 msgr2=0x56511a26eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:48.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.179+0000 7f61d7fff640 1 --2- 172.21.15.148:0/1652591172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56511a26a240 0x56511a26eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:48.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.179+0000 7f61d7fff640 1 -- 172.21.15.148:0/1652591172 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56511a25f980 msgr2=0x56511a26e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:48.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.179+0000 7f61d7fff640 1 --2- 172.21.15.148:0/1652591172 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56511a25f980 0x56511a26e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:48.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.179+0000 7f61d7fff640 1 -- 172.21.15.148:0/1652591172 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56511a26f3f0 con 0x56511a25f060 2024-09-19T07:12:48.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.179+0000 7f61d7fff640 1 --2- 172.21.15.148:0/1652591172 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56511a25f060 0x56511a272630 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f61c8009340 tx=0x7f61c80b87a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4909bbad97db5a2b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:48.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.179+0000 7f61b77fe640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:12:48.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.179+0000 7f61b77fe640 1 -- 172.21.15.148:0/1652591172 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c8049070 con 0x56511a25f060 2024-09-19T07:12:48.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.179+0000 7f61b77fe640 1 -- 172.21.15.148:0/1652591172 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f61c803bc70 con 0x56511a25f060 2024-09-19T07:12:48.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.179+0000 7f61e0937740 1 -- 172.21.15.148:0/1652591172 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61c80c0800 con 0x56511a25f060 2024-09-19T07:12:48.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.179+0000 7f61b77fe640 1 -- 172.21.15.148:0/1652591172 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f61c80b8c70 con 0x56511a25f060 2024-09-19T07:12:48.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.179+0000 7f61e0937740 10 client.15864 fetch_fsmap learned FSMap version 25 2024-09-19T07:12:48.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.179+0000 7f61e0937740 1 -- 172.21.15.148:0/1652591172 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56511a26f3f0 con 0x56511a25f060 2024-09-19T07:12:48.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.180+0000 7f61b77fe640 1 -- 172.21.15.148:0/1652591172 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61c80c0800 con 0x56511a25f060 2024-09-19T07:12:48.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.180+0000 7f61b77fe640 1 -- 172.21.15.148:0/1652591172 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f61c80c4d30 con 0x56511a25f060 2024-09-19T07:12:48.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.180+0000 7f61e0937740 10 client.15864 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:12:48.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.180+0000 7f61e0937740 10 client.15864 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:12:48.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.180+0000 7f61e0937740 20 client.15864 populate_metadata read hostname 'smithi148' 2024-09-19T07:12:48.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.180+0000 7f61e0937740 1 --2- 172.21.15.148:0/1652591172 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56511a279bd0 0x56511a2e78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:48.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.180+0000 7f61e0937740 4 client.15864 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "edfd46a9", "release": true, "await": true}] 2024-09-19T07:12:48.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.180+0000 7f61e0937740 1 -- 172.21.15.148:0/1652591172 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "quiesce db", "set_id": "edfd46a9", "release": true, "await": true}) -- 0x56511a1cc0a0 con 0x56511a279bd0 2024-09-19T07:12:48.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.181+0000 7f61cffff640 1 --2- 172.21.15.148:0/1652591172 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56511a279bd0 0x56511a2e78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:48.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.181+0000 7f61cffff640 1 --2- 172.21.15.148:0/1652591172 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56511a279bd0 0x56511a2e78c0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9c48bbe06560ec9 server_cookie=100022a3b1c3ffd3 in_seq=0 out_seq=0 2024-09-19T07:12:48.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.181+0000 7f61b77fe640 10 client.15864 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:48.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.184+0000 7f61b77fe640 1 -- 172.21.15.148:0/1652591172 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x56511a1cc0a0 con 0x56511a279bd0 2024-09-19T07:12:48.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.184+0000 7f61b77fe640 10 client.15864 handle_command_reply: tid=0 2024-09-19T07:12:48.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.184+0000 7f61e0937740 1 client.15864 shutdown 2024-09-19T07:12:48.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.184+0000 7f61e0937740 1 -- 172.21.15.148:0/1652591172 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56511a25f060 msgr2=0x56511a272630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:48.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.184+0000 7f61e0937740 1 --2- 172.21.15.148:0/1652591172 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56511a25f060 0x56511a272630 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f61c8009340 tx=0x7f61c80b87a0 comp rx=0 tx=0).stop 2024-09-19T07:12:48.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.184+0000 7f61e0937740 1 -- 172.21.15.148:0/1652591172 shutdown_connections 2024-09-19T07:12:48.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.184+0000 7f61e0937740 1 --2- 172.21.15.148:0/1652591172 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56511a279bd0 0x56511a2e78c0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:48.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.184+0000 7f61e0937740 1 --2- 172.21.15.148:0/1652591172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56511a26a240 0x56511a26eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:48.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.184+0000 7f61e0937740 1 --2- 172.21.15.148:0/1652591172 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56511a25f980 0x56511a26e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:48.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.184+0000 7f61b77fe640 0 client.15864 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:48.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.184+0000 7f61e0937740 1 --2- 172.21.15.148:0/1652591172 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56511a25f060 0x56511a272630 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:48.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.184+0000 7f61e0937740 1 -- 172.21.15.148:0/1652591172 >> 172.21.15.148:0/1652591172 conn(0x56511a25b5f0 msgr2=0x56511a25a750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:48.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.185+0000 7f61e0937740 1 -- 172.21.15.148:0/1652591172 shutdown_connections 2024-09-19T07:12:48.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.185+0000 7f61e0937740 1 -- 172.21.15.148:0/1652591172 wait complete. 2024-09-19T07:12:48.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.185+0000 7f61e0937740 20 client.15864 trim_cache size 0 max 16384 2024-09-19T07:12:48.188 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:12:48.188 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 25, 2024-09-19T07:12:48.188 INFO:teuthology.orchestra.run.smithi148.stdout: "leader": 24457, 2024-09-19T07:12:48.189 INFO:teuthology.orchestra.run.smithi148.stdout: "set_version": 8, 2024-09-19T07:12:48.189 INFO:teuthology.orchestra.run.smithi148.stdout: "sets": { 2024-09-19T07:12:48.189 INFO:teuthology.orchestra.run.smithi148.stdout: "edfd46a9": { 2024-09-19T07:12:48.189 INFO:teuthology.orchestra.run.smithi148.stdout: "version": 8, 2024-09-19T07:12:48.189 INFO:teuthology.orchestra.run.smithi148.stdout: "age_ref": 0.0, 2024-09-19T07:12:48.189 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:12:48.189 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RELEASED", 2024-09-19T07:12:48.189 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:12:48.189 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:12:48.189 INFO:teuthology.orchestra.run.smithi148.stdout: "timeout": 90.0, 2024-09-19T07:12:48.189 INFO:teuthology.orchestra.run.smithi148.stdout: "expiration": 140.3, 2024-09-19T07:12:48.189 INFO:teuthology.orchestra.run.smithi148.stdout: "members": { 2024-09-19T07:12:48.189 INFO:teuthology.orchestra.run.smithi148.stdout: "file:/": { 2024-09-19T07:12:48.189 INFO:teuthology.orchestra.run.smithi148.stdout: "excluded": false, 2024-09-19T07:12:48.190 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:12:48.190 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RELEASED", 2024-09-19T07:12:48.190 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:12:48.190 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:12:48.190 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:12:48.190 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:12:48.190 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:12:48.190 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:12:48.190 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:12:48.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.186+0000 7f61de55e640 1 -- 172.21.15.148:0/3893450299 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f61c40a33b0 msgr2=0x7f61c40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:48.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.186+0000 7f61de55e640 1 --2- 172.21.15.148:0/3893450299 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f61c40a33b0 0x7f61c40a5870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f61d00077f0 tx=0x7f61d0007520 comp rx=0 tx=0).stop 2024-09-19T07:12:48.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.186+0000 7f61de55e640 1 -- 172.21.15.148:0/3893450299 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61d8102d30 msgr2=0x7f61d8100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:48.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.186+0000 7f61de55e640 1 --2- 172.21.15.148:0/3893450299 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61d8102d30 0x7f61d8100990 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f61c8009230 tx=0x7f61c8004270 comp rx=0 tx=0).stop 2024-09-19T07:12:48.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.186+0000 7f61de55e640 1 -- 172.21.15.148:0/3893450299 shutdown_connections 2024-09-19T07:12:48.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.186+0000 7f61de55e640 1 --2- 172.21.15.148:0/3893450299 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f61c40a33b0 0x7f61c40a5870 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:48.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.186+0000 7f61de55e640 1 --2- 172.21.15.148:0/3893450299 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61d81082a0 0x7f61d8101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:48.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.186+0000 7f61de55e640 1 --2- 172.21.15.148:0/3893450299 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f61d81036e0 0x7f61d8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:48.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.186+0000 7f61de55e640 1 --2- 172.21.15.148:0/3893450299 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61d8102d30 0x7f61d8100990 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:48.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.186+0000 7f61de55e640 1 -- 172.21.15.148:0/3893450299 >> 172.21.15.148:0/3893450299 conn(0x7f61d80fc7d0 msgr2=0x7f61d8105d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:48.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.186+0000 7f61de55e640 1 -- 172.21.15.148:0/3893450299 shutdown_connections 2024-09-19T07:12:48.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.186+0000 7f61de55e640 1 -- 172.21.15.148:0/3893450299 wait complete. 2024-09-19T07:12:48.192 INFO:tasks.workunit.client.0.smithi148.stdout:getting blogbench 2024-09-19T07:12:48.192 INFO:tasks.workunit.client.0.smithi148.stderr:+ echo 'getting blogbench' 2024-09-19T07:12:48.192 INFO:tasks.workunit.client.0.smithi148.stderr:+ wget http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2024-09-19T07:12:48.275 INFO:tasks.workunit.client.0.smithi148.stderr:--2024-09-19 07:12:48-- http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2024-09-19T07:12:48.275 INFO:tasks.workunit.client.0.smithi148.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-09-19T07:12:48.349 INFO:tasks.workunit.client.0.smithi148.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-09-19T07:12:48.423 INFO:tasks.workunit.client.0.smithi148.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-19T07:12:48.424 INFO:tasks.workunit.client.0.smithi148.stderr:Length: 103355 (101K) [application/octet-stream] 2024-09-19T07:12:48.424 INFO:tasks.workunit.client.0.smithi148.stderr:Saving to: ‘blogbench-1.0.tar.bz2’ 2024-09-19T07:12:48.427 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-19T07:12:48.525 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:48 smithi148 ceph-mon[31180]: pgmap v55: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:12:48.572 INFO:tasks.workunit.client.0.smithi148.stderr: 0K .......... .......... .......... .......... .......... 49% 341K 0s 2024-09-19T07:12:48.650 INFO:tasks.workunit.client.0.smithi148.stderr: 50K .......... .......... .......... .......... .......... 99% 637K 0s 2024-09-19T07:12:48.650 INFO:tasks.workunit.client.0.smithi148.stderr: 100K 100% 1.74T=0.2s 2024-09-19T07:12:48.650 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-19T07:12:48.650 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-19 07:12:48 (449 KB/s) - ‘blogbench-1.0.tar.bz2’ saved [103355/103355] 2024-09-19T07:12:48.650 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-19T07:12:48.651 INFO:tasks.workunit.client.0.smithi148.stderr:+ tar -xvf blogbench-1.0.tar.bz2 2024-09-19T07:12:48.686 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:48 smithi165 ceph-mon[35326]: pgmap v55: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:12:48.771 INFO:tasks.workunit.client.0.smithi148.stdout:blogbench-1.0/ 2024-09-19T07:12:48.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:48 smithi179 ceph-mon[35716]: pgmap v55: 97 pgs: 97 active+clean; 1.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:12:48.772 INFO:tasks.workunit.client.0.smithi148.stdout:blogbench-1.0/m4/ 2024-09-19T07:12:48.773 INFO:tasks.workunit.client.0.smithi148.stdout:blogbench-1.0/m4/acx_pthread.m4 2024-09-19T07:12:48.774 INFO:tasks.workunit.client.0.smithi148.stdout:blogbench-1.0/man/ 2024-09-19T07:12:48.775 INFO:tasks.workunit.client.0.smithi148.stdout:blogbench-1.0/man/blogbench.8 2024-09-19T07:12:48.776 INFO:tasks.workunit.client.0.smithi148.stdout:blogbench-1.0/man/Makefile.am 2024-09-19T07:12:48.777 INFO:tasks.workunit.client.0.smithi148.stdout:blogbench-1.0/man/Makefile.in 2024-09-19T07:12:48.778 INFO:tasks.workunit.client.0.smithi148.stdout:blogbench-1.0/src/ 2024-09-19T07:12:48.779 INFO:tasks.workunit.client.0.smithi148.stdout:blogbench-1.0/src/mysnprintf.c 2024-09-19T07:12:48.780 INFO:tasks.workunit.client.0.smithi148.stdout:blogbench-1.0/src/mysnprintf.h 2024-09-19T07:12:48.780 INFO:tasks.workunit.client.0.smithi148.stdout:blogbench-1.0/src/blogbench.c 2024-09-19T07:12:48.781 INFO:tasks.workunit.client.0.smithi148.stdout:blogbench-1.0/src/blogbench.h 2024-09-19T07:12:48.782 INFO:tasks.workunit.client.0.smithi148.stdout:blogbench-1.0/src/fakesnprintf.c 2024-09-19T07:12:48.783 INFO:tasks.workunit.client.0.smithi148.stdout:blogbench-1.0/src/fakesnprintf.h 2024-09-19T07:12:48.784 INFO:tasks.workunit.client.0.smithi148.stdout:blogbench-1.0/src/blogbench_p.h 2024-09-19T07:12:48.784 INFO:tasks.workunit.client.0.smithi148.stdout:blogbench-1.0/src/bsd-getopt_long.c 2024-09-19T07:12:48.785 INFO:tasks.workunit.client.0.smithi148.stdout:blogbench-1.0/src/bsd-getopt_long.h 2024-09-19T07:12:48.786 INFO:tasks.workunit.client.0.smithi148.stdout:blogbench-1.0/src/Makefile.am 2024-09-19T07:12:48.787 INFO:tasks.workunit.client.0.smithi148.stdout:blogbench-1.0/src/Makefile.in 2024-09-19T07:12:48.787 INFO:tasks.workunit.client.0.smithi148.stdout:blogbench-1.0/src/process.c 2024-09-19T07:12:48.788 INFO:tasks.workunit.client.0.smithi148.stdout:blogbench-1.0/src/globals.h 2024-09-19T07:12:48.789 INFO:tasks.workunit.client.0.smithi148.stdout:blogbench-1.0/src/commenter.c 2024-09-19T07:12:48.790 INFO:tasks.workunit.client.0.smithi148.stdout:blogbench-1.0/src/rewriter.c 2024-09-19T07:12:48.791 INFO:tasks.workunit.client.0.smithi148.stdout:blogbench-1.0/src/reader.c 2024-09-19T07:12:48.791 INFO:tasks.workunit.client.0.smithi148.stdout:blogbench-1.0/src/writer.c 2024-09-19T07:12:48.792 INFO:tasks.workunit.client.0.smithi148.stdout:blogbench-1.0/src/helpers.c 2024-09-19T07:12:48.793 INFO:tasks.workunit.client.0.smithi148.stdout:blogbench-1.0/NEWS 2024-09-19T07:12:48.794 INFO:tasks.workunit.client.0.smithi148.stdout:blogbench-1.0/compile 2024-09-19T07:12:48.794 INFO:tasks.workunit.client.0.smithi148.stdout:blogbench-1.0/depcomp 2024-09-19T07:12:48.795 INFO:tasks.workunit.client.0.smithi148.stdout:blogbench-1.0/aclocal.m4 2024-09-19T07:12:48.796 INFO:tasks.workunit.client.0.smithi148.stdout:blogbench-1.0/README 2024-09-19T07:12:48.796 INFO:tasks.workunit.client.0.smithi148.stdout:blogbench-1.0/configure 2024-09-19T07:12:48.800 INFO:tasks.workunit.client.0.smithi148.stdout:blogbench-1.0/configure.ac 2024-09-19T07:12:48.801 INFO:tasks.workunit.client.0.smithi148.stdout:blogbench-1.0/config.guess 2024-09-19T07:12:48.802 INFO:tasks.workunit.client.0.smithi148.stdout:blogbench-1.0/install-sh 2024-09-19T07:12:48.803 INFO:tasks.workunit.client.0.smithi148.stdout:blogbench-1.0/config.sub 2024-09-19T07:12:48.804 INFO:tasks.workunit.client.0.smithi148.stdout:blogbench-1.0/missing 2024-09-19T07:12:48.804 INFO:tasks.workunit.client.0.smithi148.stdout:blogbench-1.0/mkinstalldirs 2024-09-19T07:12:48.805 INFO:tasks.workunit.client.0.smithi148.stdout:blogbench-1.0/Makefile.am 2024-09-19T07:12:48.806 INFO:tasks.workunit.client.0.smithi148.stdout:blogbench-1.0/Makefile.in 2024-09-19T07:12:48.807 INFO:tasks.workunit.client.0.smithi148.stdout:blogbench-1.0/config.h.in 2024-09-19T07:12:48.807 INFO:tasks.workunit.client.0.smithi148.stdout:blogbench-1.0/AUTHORS 2024-09-19T07:12:48.808 INFO:tasks.workunit.client.0.smithi148.stdout:blogbench-1.0/INSTALL 2024-09-19T07:12:48.809 INFO:tasks.workunit.client.0.smithi148.stdout:blogbench-1.0/ChangeLog 2024-09-19T07:12:48.810 INFO:tasks.workunit.client.0.smithi148.stdout:blogbench-1.0/COPYING 2024-09-19T07:12:48.811 INFO:tasks.workunit.client.0.smithi148.stderr:+ cd blogbench-1.0/ 2024-09-19T07:12:48.811 INFO:tasks.workunit.client.0.smithi148.stderr:+ echo 'making blogbench' 2024-09-19T07:12:48.811 INFO:tasks.workunit.client.0.smithi148.stdout:making blogbench 2024-09-19T07:12:48.811 INFO:tasks.workunit.client.0.smithi148.stderr:+ ./configure 2024-09-19T07:12:48.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.860+0000 7fa895293640 1 -- 172.21.15.148:0/2621494532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa890102ef0 msgr2=0x7fa89010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:48.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.860+0000 7fa895293640 1 --2- 172.21.15.148:0/2621494532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa890102ef0 0x7fa89010da40 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fa888009ca0 tx=0x7fa88802a950 comp rx=0 tx=0).stop 2024-09-19T07:12:48.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.860+0000 7fa895293640 1 -- 172.21.15.148:0/2621494532 shutdown_connections 2024-09-19T07:12:48.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.860+0000 7fa895293640 1 --2- 172.21.15.148:0/2621494532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa890102ef0 0x7fa89010da40 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:48.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.860+0000 7fa895293640 1 --2- 172.21.15.148:0/2621494532 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa890102570 0x7fa8901029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:48.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.860+0000 7fa895293640 1 --2- 172.21.15.148:0/2621494532 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa890100e20 0x7fa890101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:48.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.860+0000 7fa895293640 1 -- 172.21.15.148:0/2621494532 >> 172.21.15.148:0/2621494532 conn(0x7fa8900fc7d0 msgr2=0x7fa8900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:48.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.860+0000 7fa895293640 1 -- 172.21.15.148:0/2621494532 shutdown_connections 2024-09-19T07:12:48.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.860+0000 7fa895293640 1 -- 172.21.15.148:0/2621494532 wait complete. 2024-09-19T07:12:48.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.861+0000 7fa895293640 1 Processor -- start 2024-09-19T07:12:48.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.861+0000 7fa895293640 1 -- start start 2024-09-19T07:12:48.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.861+0000 7fa895293640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa890100e20 0x7fa8901991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:48.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.861+0000 7fa895293640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa890102570 0x7fa8901996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:48.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.861+0000 7fa895293640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa890102ef0 0x7fa8901a4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:48.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.861+0000 7fa895293640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa890110f80 con 0x7fa890102ef0 2024-09-19T07:12:48.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.861+0000 7fa895293640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa890110e00 con 0x7fa890102570 2024-09-19T07:12:48.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.861+0000 7fa895293640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa890111100 con 0x7fa890100e20 2024-09-19T07:12:48.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.862+0000 7fa88f7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa890102ef0 0x7fa8901a4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:48.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.862+0000 7fa88f7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa890102ef0 0x7fa8901a4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58228/0 (socket says 172.21.15.148:58228) 2024-09-19T07:12:48.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.862+0000 7fa88f7fe640 1 -- 172.21.15.148:0/2614694232 learned_addr learned my addr 172.21.15.148:0/2614694232 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:48.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.862+0000 7fa88effd640 1 --2- 172.21.15.148:0/2614694232 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa890100e20 0x7fa8901991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:48.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.862+0000 7fa88e7fc640 1 --2- 172.21.15.148:0/2614694232 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa890102570 0x7fa8901996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:48.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.862+0000 7fa88f7fe640 1 -- 172.21.15.148:0/2614694232 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa890100e20 msgr2=0x7fa8901991a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:48.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.862+0000 7fa88f7fe640 1 --2- 172.21.15.148:0/2614694232 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa890100e20 0x7fa8901991a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:48.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.862+0000 7fa88f7fe640 1 -- 172.21.15.148:0/2614694232 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa890102570 msgr2=0x7fa8901996e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:48.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.862+0000 7fa88f7fe640 1 --2- 172.21.15.148:0/2614694232 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa890102570 0x7fa8901996e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:48.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.862+0000 7fa88f7fe640 1 -- 172.21.15.148:0/2614694232 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8901a4760 con 0x7fa890102ef0 2024-09-19T07:12:48.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.862+0000 7fa88effd640 1 --2- 172.21.15.148:0/2614694232 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa890100e20 0x7fa8901991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:12:48.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.862+0000 7fa88f7fe640 1 --2- 172.21.15.148:0/2614694232 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa890102ef0 0x7fa8901a4220 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fa888006010 tx=0x7fa88802f6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:48.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.862+0000 7fa877fff640 1 -- 172.21.15.148:0/2614694232 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa888034040 con 0x7fa890102ef0 2024-09-19T07:12:48.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.862+0000 7fa895293640 1 -- 172.21.15.148:0/2614694232 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8901a4930 con 0x7fa890102ef0 2024-09-19T07:12:48.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.862+0000 7fa877fff640 1 -- 172.21.15.148:0/2614694232 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa888003e00 con 0x7fa890102ef0 2024-09-19T07:12:48.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.862+0000 7fa877fff640 1 -- 172.21.15.148:0/2614694232 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa888045480 con 0x7fa890102ef0 2024-09-19T07:12:48.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.862+0000 7fa895293640 1 -- 172.21.15.148:0/2614694232 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8901a4de0 con 0x7fa890102ef0 2024-09-19T07:12:48.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.863+0000 7fa895293640 1 -- 172.21.15.148:0/2614694232 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa890101200 con 0x7fa890102ef0 2024-09-19T07:12:48.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.865+0000 7fa877fff640 1 -- 172.21.15.148:0/2614694232 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fa888037020 con 0x7fa890102ef0 2024-09-19T07:12:48.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.865+0000 7fa877fff640 1 --2- 172.21.15.148:0/2614694232 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fa8780a33b0 0x7fa8780a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:48.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.865+0000 7fa88effd640 1 --2- 172.21.15.148:0/2614694232 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fa8780a33b0 0x7fa8780a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:48.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.866+0000 7fa877fff640 1 -- 172.21.15.148:0/2614694232 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fa8880f0dd0 con 0x7fa890102ef0 2024-09-19T07:12:48.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.866+0000 7fa88effd640 1 --2- 172.21.15.148:0/2614694232 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fa8780a33b0 0x7fa8780a5870 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa88000abe0 tx=0x7fa88000a5c0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:48.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:48.868+0000 7fa877fff640 1 -- 172.21.15.148:0/2614694232 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa8880bd960 con 0x7fa890102ef0 2024-09-19T07:12:48.943 INFO:tasks.workunit.client.0.smithi148.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-19T07:12:49.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:49.078+0000 7fa895293640 1 -- 172.21.15.148:0/2614694232 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa8901a5010 con 0x7fa890102ef0 2024-09-19T07:12:49.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:49.079+0000 7fa877fff640 1 -- 172.21.15.148:0/2614694232 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11939 (secure 0 0 0) 0x7fa8880bd260 con 0x7fa890102ef0 2024-09-19T07:12:49.081 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:12:49.081 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":25,"btime":"2024-09-19T07:11:04:227331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/4263868576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":4263868576},{"type":"v1","addr":"172.21.15.148:6841","nonce":4263868576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24383,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2146820965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2146820965},{"type":"v1","addr":"172.21.15.165:6835","nonce":2146820965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:09:19.543369+0000","modified":"2024-09-19T07:11:03.969598+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24457,"mds_1":24437,"mds_2":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/1566489108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1566489108},{"type":"v1","addr":"172.21.15.179:6835","nonce":1566489108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.165:6839/3993490234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":3993490234},{"type":"v1","addr":"172.21.15.165:6839","nonce":3993490234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24457,"qdb_cluster":[24457,24437,24436]},"id":1}]} 2024-09-19T07:12:49.081 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 25 2024-09-19T07:12:49.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:49.081+0000 7fa895293640 1 -- 172.21.15.148:0/2614694232 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fa8780a33b0 msgr2=0x7fa8780a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:49.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:49.081+0000 7fa895293640 1 --2- 172.21.15.148:0/2614694232 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fa8780a33b0 0x7fa8780a5870 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa88000abe0 tx=0x7fa88000a5c0 comp rx=0 tx=0).stop 2024-09-19T07:12:49.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:49.081+0000 7fa895293640 1 -- 172.21.15.148:0/2614694232 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa890102ef0 msgr2=0x7fa8901a4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:49.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:49.081+0000 7fa895293640 1 --2- 172.21.15.148:0/2614694232 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa890102ef0 0x7fa8901a4220 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fa888006010 tx=0x7fa88802f6f0 comp rx=0 tx=0).stop 2024-09-19T07:12:49.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:49.081+0000 7fa895293640 1 -- 172.21.15.148:0/2614694232 shutdown_connections 2024-09-19T07:12:49.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:49.081+0000 7fa895293640 1 --2- 172.21.15.148:0/2614694232 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fa8780a33b0 0x7fa8780a5870 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:49.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:49.081+0000 7fa895293640 1 --2- 172.21.15.148:0/2614694232 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa890102ef0 0x7fa8901a4220 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:49.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:49.081+0000 7fa895293640 1 --2- 172.21.15.148:0/2614694232 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa890102570 0x7fa8901996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:49.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:49.081+0000 7fa895293640 1 --2- 172.21.15.148:0/2614694232 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa890100e20 0x7fa8901991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:49.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:49.081+0000 7fa895293640 1 -- 172.21.15.148:0/2614694232 >> 172.21.15.148:0/2614694232 conn(0x7fa8900fc7d0 msgr2=0x7fa890105780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:49.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:49.082+0000 7fa895293640 1 -- 172.21.15.148:0/2614694232 shutdown_connections 2024-09-19T07:12:49.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:49.082+0000 7fa895293640 1 -- 172.21.15.148:0/2614694232 wait complete. 2024-09-19T07:12:49.326 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'edfd46a9', total seconds elapsed: 24.9 2024-09-19T07:12:49.327 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.35 2024-09-19T07:12:49.327 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:12:49.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:49 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/2614694232' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:12:49.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:49 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/2614694232' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:12:49.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:49 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/2614694232' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:12:49.950 INFO:tasks.workunit.client.0.smithi148.stdout:checking whether build environment is sane... yes 2024-09-19T07:12:49.959 INFO:tasks.workunit.client.0.smithi148.stdout:checking for gawk... gawk 2024-09-19T07:12:49.966 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T07:12:49.973 INFO:tasks.workunit.client.0.smithi148.stdout:checking whether make sets $(MAKE)... yes 2024-09-19T07:12:50.000 INFO:tasks.workunit.client.0.smithi148.stdout:checking for gcc... gcc 2024-09-19T07:12:50.049 INFO:tasks.workunit.client.0.smithi148.stdout:checking for C compiler default output file name... a.out 2024-09-19T07:12:50.050 INFO:tasks.workunit.client.0.smithi148.stdout:checking whether the C compiler works... yes 2024-09-19T07:12:50.053 INFO:tasks.workunit.client.0.smithi148.stdout:checking whether we are cross compiling... no 2024-09-19T07:12:50.055 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:12:50.090 INFO:tasks.workunit.client.0.smithi148.stdout:checking for suffix of executables... 2024-09-19T07:12:50.132 INFO:tasks.workunit.client.0.smithi148.stdout:checking for suffix of object files... o 2024-09-19T07:12:50.165 INFO:tasks.workunit.client.0.smithi148.stdout:checking whether we are using the GNU C compiler... yes 2024-09-19T07:12:50.197 INFO:tasks.workunit.client.0.smithi148.stdout:checking whether gcc accepts -g... yes 2024-09-19T07:12:50.408 INFO:tasks.workunit.client.0.smithi148.stdout:checking for gcc option to accept ANSI C... none needed 2024-09-19T07:12:50.460 INFO:tasks.workunit.client.0.smithi148.stdout:checking for style of include used by make... GNU 2024-09-19T07:12:50.566 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:50 smithi148 ceph-mon[31180]: pgmap v56: 97 pgs: 97 active+clean; 1.5 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 11 KiB/s wr, 9 op/s 2024-09-19T07:12:50.572 INFO:tasks.workunit.client.0.smithi148.stdout:checking dependency style of gcc... gcc3 2024-09-19T07:12:50.572 INFO:tasks.workunit.client.0.smithi148.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-19T07:12:50.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.644+0000 7f6a402ed640 1 -- 172.21.15.148:0/2815549592 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a38101e10 msgr2=0x7f6a381021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:50.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.644+0000 7f6a402ed640 1 --2- 172.21.15.148:0/2815549592 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a38101e10 0x7f6a381021f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f6a34009900 tx=0x7f6a3402a410 comp rx=0 tx=0).stop 2024-09-19T07:12:50.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.645+0000 7f6a402ed640 1 -- 172.21.15.148:0/2815549592 shutdown_connections 2024-09-19T07:12:50.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.645+0000 7f6a402ed640 1 --2- 172.21.15.148:0/2815549592 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6a38106f40 0x7f6a3810eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:50.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.645+0000 7f6a402ed640 1 --2- 172.21.15.148:0/2815549592 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a381027c0 0x7f6a38106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:50.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.645+0000 7f6a402ed640 1 --2- 172.21.15.148:0/2815549592 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a38101e10 0x7f6a381021f0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:50.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.645+0000 7f6a402ed640 1 -- 172.21.15.148:0/2815549592 >> 172.21.15.148:0/2815549592 conn(0x7f6a380fd8d0 msgr2=0x7f6a380ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:50.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.645+0000 7f6a402ed640 1 -- 172.21.15.148:0/2815549592 shutdown_connections 2024-09-19T07:12:50.666 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.645+0000 7f6a402ed640 1 -- 172.21.15.148:0/2815549592 wait complete. 2024-09-19T07:12:50.666 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.645+0000 7f6a402ed640 1 Processor -- start 2024-09-19T07:12:50.666 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.645+0000 7f6a402ed640 1 -- start start 2024-09-19T07:12:50.666 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.645+0000 7f6a402ed640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a38101e10 0x7f6a381984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:50.666 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.645+0000 7f6a402ed640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a381027c0 0x7f6a38198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:50.666 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.645+0000 7f6a402ed640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6a38106f40 0x7f6a3819cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:50.666 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.645+0000 7f6a402ed640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6a38111fe0 con 0x7f6a38101e10 2024-09-19T07:12:50.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.645+0000 7f6a402ed640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6a38111e60 con 0x7f6a38106f40 2024-09-19T07:12:50.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.645+0000 7f6a402ed640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6a38112160 con 0x7f6a381027c0 2024-09-19T07:12:50.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.645+0000 7f6a3e089640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a38101e10 0x7f6a381984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:50.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.646+0000 7f6a3e089640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a38101e10 0x7f6a381984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58246/0 (socket says 172.21.15.148:58246) 2024-09-19T07:12:50.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.646+0000 7f6a3e089640 1 -- 172.21.15.148:0/2759891260 learned_addr learned my addr 172.21.15.148:0/2759891260 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:50.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.646+0000 7f6a3d888640 1 --2- 172.21.15.148:0/2759891260 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a381027c0 0x7f6a38198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:50.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.646+0000 7f6a3e88a640 1 --2- 172.21.15.148:0/2759891260 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6a38106f40 0x7f6a3819cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:50.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.646+0000 7f6a3e089640 1 -- 172.21.15.148:0/2759891260 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a381027c0 msgr2=0x7f6a38198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:50.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.646+0000 7f6a3e089640 1 --2- 172.21.15.148:0/2759891260 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a381027c0 0x7f6a38198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:50.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.646+0000 7f6a3e089640 1 -- 172.21.15.148:0/2759891260 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6a38106f40 msgr2=0x7f6a3819cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:50.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.646+0000 7f6a3e089640 1 --2- 172.21.15.148:0/2759891260 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6a38106f40 0x7f6a3819cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:50.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.646+0000 7f6a3e089640 1 -- 172.21.15.148:0/2759891260 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a3819d490 con 0x7f6a38101e10 2024-09-19T07:12:50.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.646+0000 7f6a3e089640 1 --2- 172.21.15.148:0/2759891260 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a38101e10 0x7f6a381984e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f6a34006010 tx=0x7f6a340042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:50.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.646+0000 7f6a2f7fe640 1 -- 172.21.15.148:0/2759891260 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3403f030 con 0x7f6a38101e10 2024-09-19T07:12:50.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.646+0000 7f6a402ed640 1 -- 172.21.15.148:0/2759891260 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a3819d720 con 0x7f6a38101e10 2024-09-19T07:12:50.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.646+0000 7f6a2f7fe640 1 -- 172.21.15.148:0/2759891260 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a34003ce0 con 0x7f6a38101e10 2024-09-19T07:12:50.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.646+0000 7f6a2f7fe640 1 -- 172.21.15.148:0/2759891260 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a34035070 con 0x7f6a38101e10 2024-09-19T07:12:50.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.646+0000 7f6a402ed640 1 -- 172.21.15.148:0/2759891260 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a381a5060 con 0x7f6a38101e10 2024-09-19T07:12:50.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.647+0000 7f6a402ed640 1 -- 172.21.15.148:0/2759891260 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a381032f0 con 0x7f6a38101e10 2024-09-19T07:12:50.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.648+0000 7f6a2f7fe640 1 -- 172.21.15.148:0/2759891260 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f6a34042030 con 0x7f6a38101e10 2024-09-19T07:12:50.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.649+0000 7f6a2f7fe640 1 --2- 172.21.15.148:0/2759891260 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f6a240a33b0 0x7f6a240a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:50.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.649+0000 7f6a3d888640 1 --2- 172.21.15.148:0/2759891260 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f6a240a33b0 0x7f6a240a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:50.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.649+0000 7f6a2f7fe640 1 -- 172.21.15.148:0/2759891260 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f6a340f02f0 con 0x7f6a38101e10 2024-09-19T07:12:50.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.649+0000 7f6a3d888640 1 --2- 172.21.15.148:0/2759891260 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f6a240a33b0 0x7f6a240a5870 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6a380ff7b0 tx=0x7f6a28005f90 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:50.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.653+0000 7f6a2f7fe640 1 -- 172.21.15.148:0/2759891260 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6a340bcda0 con 0x7f6a38101e10 2024-09-19T07:12:50.673 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:50 smithi179 ceph-mon[35716]: pgmap v56: 97 pgs: 97 active+clean; 1.5 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 11 KiB/s wr, 9 op/s 2024-09-19T07:12:50.709 INFO:tasks.workunit.client.0.smithi148.stdout:checking how to run the C preprocessor... gcc -E 2024-09-19T07:12:50.750 INFO:tasks.workunit.client.0.smithi148.stdout:checking for egrep... grep -E 2024-09-19T07:12:50.759 INFO:tasks.workunit.client.0.smithi148.stdout:checking for AIX... no 2024-09-19T07:12:50.761 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:12:50.823 INFO:tasks.workunit.client.0.smithi148.stdout:checking for library containing strerror... none required 2024-09-19T07:12:50.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.872+0000 7f6a402ed640 1 -- 172.21.15.148:0/2759891260 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6a3810a120 con 0x7f6a38101e10 2024-09-19T07:12:50.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.873+0000 7f6a2f7fe640 1 -- 172.21.15.148:0/2759891260 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11939 (secure 0 0 0) 0x7f6a340bc6a0 con 0x7f6a38101e10 2024-09-19T07:12:50.874 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:12:50.874 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":25,"btime":"2024-09-19T07:11:04:227331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/4263868576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":4263868576},{"type":"v1","addr":"172.21.15.148:6841","nonce":4263868576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24383,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2146820965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2146820965},{"type":"v1","addr":"172.21.15.165:6835","nonce":2146820965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:09:19.543369+0000","modified":"2024-09-19T07:11:03.969598+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24457,"mds_1":24437,"mds_2":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/1566489108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1566489108},{"type":"v1","addr":"172.21.15.179:6835","nonce":1566489108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.165:6839/3993490234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":3993490234},{"type":"v1","addr":"172.21.15.165:6839","nonce":3993490234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24457,"qdb_cluster":[24457,24437,24436]},"id":1}]} 2024-09-19T07:12:50.875 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 25 2024-09-19T07:12:50.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.875+0000 7f6a402ed640 1 -- 172.21.15.148:0/2759891260 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f6a240a33b0 msgr2=0x7f6a240a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:50.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.875+0000 7f6a402ed640 1 --2- 172.21.15.148:0/2759891260 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f6a240a33b0 0x7f6a240a5870 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6a380ff7b0 tx=0x7f6a28005f90 comp rx=0 tx=0).stop 2024-09-19T07:12:50.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.875+0000 7f6a402ed640 1 -- 172.21.15.148:0/2759891260 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a38101e10 msgr2=0x7f6a381984e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:50.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.875+0000 7f6a402ed640 1 --2- 172.21.15.148:0/2759891260 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a38101e10 0x7f6a381984e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f6a34006010 tx=0x7f6a340042f0 comp rx=0 tx=0).stop 2024-09-19T07:12:50.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.876+0000 7f6a402ed640 1 -- 172.21.15.148:0/2759891260 shutdown_connections 2024-09-19T07:12:50.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.876+0000 7f6a402ed640 1 --2- 172.21.15.148:0/2759891260 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f6a240a33b0 0x7f6a240a5870 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:50.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.876+0000 7f6a402ed640 1 --2- 172.21.15.148:0/2759891260 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6a38106f40 0x7f6a3819cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:50.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.876+0000 7f6a402ed640 1 --2- 172.21.15.148:0/2759891260 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a381027c0 0x7f6a38198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:50.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.876+0000 7f6a402ed640 1 --2- 172.21.15.148:0/2759891260 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a38101e10 0x7f6a381984e0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:50.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.876+0000 7f6a402ed640 1 -- 172.21.15.148:0/2759891260 >> 172.21.15.148:0/2759891260 conn(0x7f6a380fd8d0 msgr2=0x7f6a380fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:50.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.876+0000 7f6a402ed640 1 -- 172.21.15.148:0/2759891260 shutdown_connections 2024-09-19T07:12:50.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:50.876+0000 7f6a402ed640 1 -- 172.21.15.148:0/2759891260 wait complete. 2024-09-19T07:12:50.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:50 smithi165 ceph-mon[35326]: pgmap v56: 97 pgs: 97 active+clean; 1.5 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 11 KiB/s wr, 9 op/s 2024-09-19T07:12:51.014 INFO:tasks.workunit.client.0.smithi148.stdout:checking for ANSI C header files... yes 2024-09-19T07:12:51.077 INFO:tasks.workunit.client.0.smithi148.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-19T07:12:51.126 INFO:tasks.workunit.client.0.smithi148.stdout:checking for sys/types.h... yes 2024-09-19T07:12:51.182 INFO:tasks.workunit.client.0.smithi148.stdout:checking for sys/stat.h... yes 2024-09-19T07:12:51.233 INFO:tasks.workunit.client.0.smithi148.stdout:checking for stdlib.h... yes 2024-09-19T07:12:51.283 INFO:tasks.workunit.client.0.smithi148.stdout:checking for string.h... yes 2024-09-19T07:12:51.332 INFO:tasks.workunit.client.0.smithi148.stdout:checking for memory.h... yes 2024-09-19T07:12:51.379 INFO:tasks.workunit.client.0.smithi148.stdout:checking for strings.h... yes 2024-09-19T07:12:51.443 INFO:tasks.workunit.client.0.smithi148.stdout:checking for inttypes.h... yes 2024-09-19T07:12:51.497 INFO:tasks.workunit.client.0.smithi148.stdout:checking for stdint.h... yes 2024-09-19T07:12:51.562 INFO:tasks.workunit.client.0.smithi148.stdout:checking for unistd.h... yes 2024-09-19T07:12:51.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.530+0000 7f7d0961e640 1 -- 172.21.15.148:0/2590577836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d04102d40 msgr2=0x7f7d04103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:51.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.530+0000 7f7d0961e640 1 --2- 172.21.15.148:0/2590577836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d04102d40 0x7f7d04103120 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f7cf8009900 tx=0x7f7cf802a480 comp rx=0 tx=0).stop 2024-09-19T07:12:51.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.530+0000 7f7d0961e640 1 -- 172.21.15.148:0/2590577836 shutdown_connections 2024-09-19T07:12:51.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.530+0000 7f7d0961e640 1 --2- 172.21.15.148:0/2590577836 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d0410c170 0x7f7d0410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:51.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.530+0000 7f7d0961e640 1 --2- 172.21.15.148:0/2590577836 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7d04103660 0x7f7d0410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:51.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.530+0000 7f7d0961e640 1 --2- 172.21.15.148:0/2590577836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d04102d40 0x7f7d04103120 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:51.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.530+0000 7f7d0961e640 1 -- 172.21.15.148:0/2590577836 >> 172.21.15.148:0/2590577836 conn(0x7f7d040fc7a0 msgr2=0x7f7d040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:51.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.530+0000 7f7d0961e640 1 -- 172.21.15.148:0/2590577836 shutdown_connections 2024-09-19T07:12:51.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.530+0000 7f7d0961e640 1 -- 172.21.15.148:0/2590577836 wait complete. 2024-09-19T07:12:51.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.530+0000 7f7d0961e640 1 Processor -- start 2024-09-19T07:12:51.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.531+0000 7f7d0961e640 1 -- start start 2024-09-19T07:12:51.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.531+0000 7f7d0961e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d04102d40 0x7f7d041009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:51.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.531+0000 7f7d0961e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d04103660 0x7f7d04100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:51.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.531+0000 7f7d0961e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7d0410c170 0x7f7d04101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:51.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.531+0000 7f7d0961e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7d04111f70 con 0x7f7d04102d40 2024-09-19T07:12:51.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.531+0000 7f7d0961e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7d04111df0 con 0x7f7d0410c170 2024-09-19T07:12:51.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.531+0000 7f7d0961e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7d041120f0 con 0x7f7d04103660 2024-09-19T07:12:51.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.531+0000 7f7d02ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d04102d40 0x7f7d041009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:51.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.531+0000 7f7d02ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d04102d40 0x7f7d041009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58252/0 (socket says 172.21.15.148:58252) 2024-09-19T07:12:51.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.531+0000 7f7d02ffd640 1 -- 172.21.15.148:0/4002087977 learned_addr learned my addr 172.21.15.148:0/4002087977 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:51.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.531+0000 7f7d027fc640 1 --2- 172.21.15.148:0/4002087977 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d04103660 0x7f7d04100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:51.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.531+0000 7f7d037fe640 1 --2- 172.21.15.148:0/4002087977 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7d0410c170 0x7f7d04101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:51.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.531+0000 7f7d02ffd640 1 -- 172.21.15.148:0/4002087977 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d04103660 msgr2=0x7f7d04100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:51.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.531+0000 7f7d02ffd640 1 --2- 172.21.15.148:0/4002087977 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d04103660 0x7f7d04100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:51.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.531+0000 7f7d02ffd640 1 -- 172.21.15.148:0/4002087977 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7d0410c170 msgr2=0x7f7d04101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:51.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.531+0000 7f7d02ffd640 1 --2- 172.21.15.148:0/4002087977 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7d0410c170 0x7f7d04101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:51.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.531+0000 7f7d02ffd640 1 -- 172.21.15.148:0/4002087977 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d041a68c0 con 0x7f7d04102d40 2024-09-19T07:12:51.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.532+0000 7f7d02ffd640 1 --2- 172.21.15.148:0/4002087977 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d04102d40 0x7f7d041009a0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f7cf8006010 tx=0x7f7cf80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:51.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.532+0000 7f7cebfff640 1 -- 172.21.15.148:0/4002087977 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf803f030 con 0x7f7d04102d40 2024-09-19T07:12:51.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.532+0000 7f7cebfff640 1 -- 172.21.15.148:0/4002087977 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7cf8003ce0 con 0x7f7d04102d40 2024-09-19T07:12:51.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.532+0000 7f7d0961e640 1 -- 172.21.15.148:0/4002087977 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d041a6b50 con 0x7f7d04102d40 2024-09-19T07:12:51.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.532+0000 7f7d0961e640 1 -- 172.21.15.148:0/4002087977 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d041a7030 con 0x7f7d04102d40 2024-09-19T07:12:51.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.532+0000 7f7cebfff640 1 -- 172.21.15.148:0/4002087977 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf8035070 con 0x7f7d04102d40 2024-09-19T07:12:51.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.534+0000 7f7cebfff640 1 -- 172.21.15.148:0/4002087977 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f7cf8042030 con 0x7f7d04102d40 2024-09-19T07:12:51.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.535+0000 7f7d0b9f7740 1 Processor -- start 2024-09-19T07:12:51.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.535+0000 7f7d0b9f7740 1 -- start start 2024-09-19T07:12:51.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.535+0000 7f7cebfff640 1 --2- 172.21.15.148:0/4002087977 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f7cec0a33b0 0x7f7cec0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:51.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.535+0000 7f7d0b9f7740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1baa42b40 0x55f1baa41090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:51.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.535+0000 7f7d0b9f7740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1baa415d0 0x55f1baa41a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:51.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.535+0000 7f7d037fe640 1 --2- 172.21.15.148:0/4002087977 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f7cec0a33b0 0x7f7cec0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:51.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.535+0000 7f7d0b9f7740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1baa4c370 0x55f1baa4e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:51.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.535+0000 7f7d0b9f7740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55f1ba9a72f0 con 0x55f1baa415d0 2024-09-19T07:12:51.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.535+0000 7f7d0b9f7740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55f1ba94ecf0 con 0x55f1baa4c370 2024-09-19T07:12:51.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.535+0000 7f7d0b9f7740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f1ba9a32b0 con 0x55f1baa42b40 2024-09-19T07:12:51.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.535+0000 7f7cebfff640 1 -- 172.21.15.148:0/4002087977 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f7cf80f0140 con 0x7f7d04102d40 2024-09-19T07:12:51.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.535+0000 7f7d027fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1baa415d0 0x55f1baa41a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:51.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.535+0000 7f7d037fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1baa4c370 0x55f1baa4e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:51.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.535+0000 7f7d037fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1baa4c370 0x55f1baa4e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:36328/0 (socket says 172.21.15.148:36328) 2024-09-19T07:12:51.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.535+0000 7f7d037fe640 1 -- 172.21.15.148:0/1378767674 learned_addr learned my addr 172.21.15.148:0/1378767674 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:51.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.536+0000 7f7d02ffd640 1 --2- 172.21.15.148:0/1378767674 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1baa42b40 0x55f1baa41090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:51.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.536+0000 7f7d037fe640 1 --2- 172.21.15.148:0/4002087977 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f7cec0a33b0 0x7f7cec0a5870 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc0137b0 tx=0x7f7cfc013bb0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:51.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.536+0000 7f7d037fe640 1 -- 172.21.15.148:0/1378767674 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1baa42b40 msgr2=0x55f1baa41090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:51.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.536+0000 7f7d037fe640 1 --2- 172.21.15.148:0/1378767674 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1baa42b40 0x55f1baa41090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:51.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.536+0000 7f7d037fe640 1 -- 172.21.15.148:0/1378767674 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1baa415d0 msgr2=0x55f1baa41a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:51.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.536+0000 7f7d037fe640 1 --2- 172.21.15.148:0/1378767674 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1baa415d0 0x55f1baa41a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:51.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.536+0000 7f7d037fe640 1 -- 172.21.15.148:0/1378767674 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1ba9333a0 con 0x55f1baa4c370 2024-09-19T07:12:51.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.536+0000 7f7d02ffd640 1 --2- 172.21.15.148:0/1378767674 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1baa42b40 0x55f1baa41090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:12:51.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.536+0000 7f7d037fe640 1 --2- 172.21.15.148:0/1378767674 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1baa4c370 0x55f1baa4e760 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc00f790 tx=0x7f7cfc020000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5051b60187c2b9eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:51.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.536+0000 7f7ce97fa640 1 -- 172.21.15.148:0/1378767674 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc020e00 con 0x55f1baa4c370 2024-09-19T07:12:51.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.536+0000 7f7ce97fa640 1 -- 172.21.15.148:0/1378767674 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7cfc024070 con 0x55f1baa4c370 2024-09-19T07:12:51.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.536+0000 7f7ce97fa640 1 -- 172.21.15.148:0/1378767674 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc004290 con 0x55f1baa4c370 2024-09-19T07:12:51.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.537+0000 7f7d0b9f7740 1 -- 172.21.15.148:0/1378767674 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1baa4c370 msgr2=0x55f1baa4e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:51.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.537+0000 7f7d0b9f7740 1 --2- 172.21.15.148:0/1378767674 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1baa4c370 0x55f1baa4e760 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc00f790 tx=0x7f7cfc020000 comp rx=0 tx=0).stop 2024-09-19T07:12:51.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.537+0000 7f7d0b9f7740 1 -- 172.21.15.148:0/1378767674 shutdown_connections 2024-09-19T07:12:51.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.537+0000 7f7d0b9f7740 1 --2- 172.21.15.148:0/1378767674 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1baa4c370 0x55f1baa4e760 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:51.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.537+0000 7f7d0b9f7740 1 --2- 172.21.15.148:0/1378767674 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1baa415d0 0x55f1baa41a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:51.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.537+0000 7f7d0b9f7740 1 --2- 172.21.15.148:0/1378767674 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1baa42b40 0x55f1baa41090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:51.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.537+0000 7f7d0b9f7740 1 -- 172.21.15.148:0/1378767674 >> 172.21.15.148:0/1378767674 conn(0x55f1baa0a310 msgr2=0x55f1baa3dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:51.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.537+0000 7f7d0b9f7740 1 -- 172.21.15.148:0/1378767674 shutdown_connections 2024-09-19T07:12:51.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.537+0000 7f7d0b9f7740 1 -- 172.21.15.148:0/1378767674 wait complete. 2024-09-19T07:12:51.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.537+0000 7f7d0b9f7740 1 -- start start 2024-09-19T07:12:51.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.537+0000 7f7d0b9f7740 1 Processor -- start 2024-09-19T07:12:51.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.538+0000 7f7d0b9f7740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1baa415d0 0x55f1baa4bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:51.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.538+0000 7f7d0b9f7740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1baa42b40 0x55f1baa48fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:51.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.538+0000 7f7d0b9f7740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1baa4c370 0x55f1baa49560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:51.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.538+0000 7f7d0b9f7740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55f1baa4f010 con 0x55f1baa415d0 2024-09-19T07:12:51.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.538+0000 7f7d0b9f7740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55f1ba962060 con 0x55f1baa42b40 2024-09-19T07:12:51.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.538+0000 7f7d0b9f7740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f1baa4f190 con 0x55f1baa4c370 2024-09-19T07:12:51.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.538+0000 7f7d0b9f7740 10 client.0 _ll_register_callbacks cb 0x55f1ba6b58c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:12:51.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.538+0000 7f7d02ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1baa415d0 0x55f1baa4bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:51.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.538+0000 7f7d02ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1baa415d0 0x55f1baa4bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58274/0 (socket says 172.21.15.148:58274) 2024-09-19T07:12:51.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.538+0000 7f7d02ffd640 1 -- 172.21.15.148:0/2968917544 learned_addr learned my addr 172.21.15.148:0/2968917544 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:51.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.538+0000 7f7d027fc640 1 --2- 172.21.15.148:0/2968917544 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1baa42b40 0x55f1baa48fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:51.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.538+0000 7f7d037fe640 1 --2- 172.21.15.148:0/2968917544 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1baa4c370 0x55f1baa49560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:51.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.538+0000 7f7d02ffd640 1 -- 172.21.15.148:0/2968917544 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1baa4c370 msgr2=0x55f1baa49560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:51.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.538+0000 7f7d02ffd640 1 --2- 172.21.15.148:0/2968917544 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1baa4c370 0x55f1baa49560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:51.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.538+0000 7f7d02ffd640 1 -- 172.21.15.148:0/2968917544 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1baa42b40 msgr2=0x55f1baa48fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:51.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.538+0000 7f7d02ffd640 1 --2- 172.21.15.148:0/2968917544 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1baa42b40 0x55f1baa48fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:51.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.538+0000 7f7d02ffd640 1 -- 172.21.15.148:0/2968917544 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1ba7183c0 con 0x55f1baa415d0 2024-09-19T07:12:51.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.538+0000 7f7d037fe640 1 --2- 172.21.15.148:0/2968917544 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1baa4c370 0x55f1baa49560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:12:51.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.538+0000 7f7d02ffd640 1 --2- 172.21.15.148:0/2968917544 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1baa415d0 0x55f1baa4bd10 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f7cf80b8110 tx=0x7f7cf80b86d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d0e96df5d6c5a90 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:51.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.538+0000 7f7ce6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:12:51.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.538+0000 7f7ce6ff5640 1 -- 172.21.15.148:0/2968917544 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf80d4020 con 0x55f1baa415d0 2024-09-19T07:12:51.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.538+0000 7f7ce6ff5640 1 -- 172.21.15.148:0/2968917544 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f7cf80d5220 con 0x55f1baa415d0 2024-09-19T07:12:51.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.538+0000 7f7d0b9f7740 1 -- 172.21.15.148:0/2968917544 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7cfc024070 con 0x55f1baa415d0 2024-09-19T07:12:51.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.539+0000 7f7ce6ff5640 1 -- 172.21.15.148:0/2968917544 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7cf80bbd90 con 0x55f1baa415d0 2024-09-19T07:12:51.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.539+0000 7f7d0b9f7740 10 client.15888 fetch_fsmap learned FSMap version 25 2024-09-19T07:12:51.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.539+0000 7f7d0b9f7740 1 -- 172.21.15.148:0/2968917544 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f1baa5aac0 con 0x55f1baa415d0 2024-09-19T07:12:51.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.539+0000 7f7ce6ff5640 1 -- 172.21.15.148:0/2968917544 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7cfc024070 con 0x55f1baa415d0 2024-09-19T07:12:51.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.539+0000 7f7ce6ff5640 1 -- 172.21.15.148:0/2968917544 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7cf80c6030 con 0x55f1baa415d0 2024-09-19T07:12:51.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.539+0000 7f7d0b9f7740 10 client.15888 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:12:51.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.539+0000 7f7d0b9f7740 10 client.15888 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T07:12:51.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.539+0000 7f7d0b9f7740 20 client.15888 populate_metadata read hostname 'smithi148' 2024-09-19T07:12:51.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.539+0000 7f7d0b9f7740 1 --2- 172.21.15.148:0/2968917544 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x55f1baa5beb0 0x55f1baa5e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:51.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.539+0000 7f7d0b9f7740 4 client.15888 mds_command: new command op to 24436 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:12:51.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.539+0000 7f7d0b9f7740 1 -- 172.21.15.148:0/2968917544 --> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f1ba9b4860 con 0x55f1baa5beb0 2024-09-19T07:12:51.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.539+0000 7f7d027fc640 1 --2- 172.21.15.148:0/2968917544 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x55f1baa5beb0 0x55f1baa5e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:51.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.539+0000 7f7d027fc640 1 --2- 172.21.15.148:0/2968917544 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x55f1baa5beb0 0x55f1baa5e2c0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f3c53188df5d38c9 server_cookie=688c17cfe8b0059c in_seq=0 out_seq=0 2024-09-19T07:12:51.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.539+0000 7f7ce6ff5640 10 client.15888 ms_handle_connect on v2:172.21.15.179:6836/3827671241 2024-09-19T07:12:51.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.540+0000 7f7ce6ff5640 1 -- 172.21.15.148:0/2968917544 <== mds.2 v2:172.21.15.179:6836/3827671241 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f1ba9b4860 con 0x55f1baa5beb0 2024-09-19T07:12:51.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.540+0000 7f7ce6ff5640 10 client.15888 handle_command_reply: tid=0 2024-09-19T07:12:51.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.540+0000 7f7d0b9f7740 1 client.15888 shutdown 2024-09-19T07:12:51.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.540+0000 7f7d0b9f7740 1 -- 172.21.15.148:0/2968917544 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1baa415d0 msgr2=0x55f1baa4bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:51.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.540+0000 7f7d0b9f7740 1 --2- 172.21.15.148:0/2968917544 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1baa415d0 0x55f1baa4bd10 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f7cf80b8110 tx=0x7f7cf80b86d0 comp rx=0 tx=0).stop 2024-09-19T07:12:51.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.540+0000 7f7d0b9f7740 1 -- 172.21.15.148:0/2968917544 shutdown_connections 2024-09-19T07:12:51.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.540+0000 7f7d0b9f7740 1 --2- 172.21.15.148:0/2968917544 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x55f1baa5beb0 0x55f1baa5e2c0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:51.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.540+0000 7f7d0b9f7740 1 --2- 172.21.15.148:0/2968917544 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1baa4c370 0x55f1baa49560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:51.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.540+0000 7f7d0b9f7740 1 --2- 172.21.15.148:0/2968917544 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1baa42b40 0x55f1baa48fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:51.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.540+0000 7f7ce6ff5640 0 client.15888 ms_handle_reset on v2:172.21.15.179:6836/3827671241 2024-09-19T07:12:51.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.540+0000 7f7d0b9f7740 1 --2- 172.21.15.148:0/2968917544 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1baa415d0 0x55f1baa4bd10 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:51.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.540+0000 7f7d0b9f7740 1 -- 172.21.15.148:0/2968917544 >> 172.21.15.148:0/2968917544 conn(0x55f1baa0a310 msgr2=0x55f1baa43930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:51.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.540+0000 7f7d0b9f7740 1 -- 172.21.15.148:0/2968917544 shutdown_connections 2024-09-19T07:12:51.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.540+0000 7f7d0b9f7740 1 -- 172.21.15.148:0/2968917544 wait complete. 2024-09-19T07:12:51.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.540+0000 7f7d0b9f7740 20 client.15888 trim_cache size 0 max 16384 2024-09-19T07:12:51.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.553+0000 7f7d0b9f7740 1 Processor -- start 2024-09-19T07:12:51.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.553+0000 7f7d0b9f7740 1 -- start start 2024-09-19T07:12:51.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.553+0000 7f7d0b9f7740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1baa415d0 0x55f1baa3de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:51.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.553+0000 7f7d0b9f7740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1baa42b40 0x55f1baa58310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:51.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.553+0000 7f7d0b9f7740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1baa4c370 0x55f1baa63bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:51.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.553+0000 7f7d0b9f7740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7d041b2320 con 0x55f1baa4c370 2024-09-19T07:12:51.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.553+0000 7f7d0b9f7740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7d041afbf0 con 0x55f1baa415d0 2024-09-19T07:12:51.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.553+0000 7f7d0b9f7740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7d041ada20 con 0x55f1baa42b40 2024-09-19T07:12:51.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.553+0000 7f7d037fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1baa4c370 0x55f1baa63bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:51.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.553+0000 7f7d027fc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1baa42b40 0x55f1baa58310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:51.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.553+0000 7f7d037fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1baa4c370 0x55f1baa63bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58282/0 (socket says 172.21.15.148:58282) 2024-09-19T07:12:51.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.553+0000 7f7d037fe640 1 -- 172.21.15.148:0/3969738462 learned_addr learned my addr 172.21.15.148:0/3969738462 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:51.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.554+0000 7f7d02ffd640 1 --2- 172.21.15.148:0/3969738462 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1baa415d0 0x55f1baa3de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:51.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.554+0000 7f7d027fc640 1 -- 172.21.15.148:0/3969738462 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1baa415d0 msgr2=0x55f1baa3de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:51.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.554+0000 7f7d027fc640 1 --2- 172.21.15.148:0/3969738462 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1baa415d0 0x55f1baa3de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:51.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.554+0000 7f7d027fc640 1 -- 172.21.15.148:0/3969738462 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1baa4c370 msgr2=0x55f1baa63bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:51.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.554+0000 7f7d027fc640 1 --2- 172.21.15.148:0/3969738462 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1baa4c370 0x55f1baa63bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:51.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.554+0000 7f7d027fc640 1 -- 172.21.15.148:0/3969738462 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1baa5e940 con 0x55f1baa42b40 2024-09-19T07:12:51.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.554+0000 7f7d027fc640 1 --2- 172.21.15.148:0/3969738462 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1baa42b40 0x55f1baa58310 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x55f1baa5eb70 tx=0x7f7cf40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52f9411008595a55 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:51.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.554+0000 7f7ce8ff9640 1 -- 172.21.15.148:0/3969738462 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf4003d60 con 0x55f1baa42b40 2024-09-19T07:12:51.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.554+0000 7f7ce8ff9640 1 -- 172.21.15.148:0/3969738462 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7cf4005500 con 0x55f1baa42b40 2024-09-19T07:12:51.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.554+0000 7f7ce8ff9640 1 -- 172.21.15.148:0/3969738462 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf40116a0 con 0x55f1baa42b40 2024-09-19T07:12:51.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.555+0000 7f7d0b9f7740 1 -- 172.21.15.148:0/3969738462 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1baa42b40 msgr2=0x55f1baa58310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:51.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.555+0000 7f7d0b9f7740 1 --2- 172.21.15.148:0/3969738462 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1baa42b40 0x55f1baa58310 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x55f1baa5eb70 tx=0x7f7cf40046c0 comp rx=0 tx=0).stop 2024-09-19T07:12:51.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.555+0000 7f7d0b9f7740 1 -- 172.21.15.148:0/3969738462 shutdown_connections 2024-09-19T07:12:51.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.555+0000 7f7d0b9f7740 1 --2- 172.21.15.148:0/3969738462 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1baa4c370 0x55f1baa63bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:51.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.555+0000 7f7d0b9f7740 1 --2- 172.21.15.148:0/3969738462 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1baa42b40 0x55f1baa58310 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:51.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.555+0000 7f7d0b9f7740 1 --2- 172.21.15.148:0/3969738462 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1baa415d0 0x55f1baa3de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:51.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.555+0000 7f7d0b9f7740 1 -- 172.21.15.148:0/3969738462 >> 172.21.15.148:0/3969738462 conn(0x55f1baa0a310 msgr2=0x55f1baa3d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:51.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.555+0000 7f7d0b9f7740 1 -- 172.21.15.148:0/3969738462 shutdown_connections 2024-09-19T07:12:51.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.555+0000 7f7d0b9f7740 1 -- 172.21.15.148:0/3969738462 wait complete. 2024-09-19T07:12:51.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.555+0000 7f7d0b9f7740 1 -- start start 2024-09-19T07:12:51.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.555+0000 7f7d0b9f7740 1 Processor -- start 2024-09-19T07:12:51.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.556+0000 7f7d0b9f7740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1baa415d0 0x55f1baa54480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:51.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.556+0000 7f7d0b9f7740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1baa42b40 0x55f1baa549c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:51.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.556+0000 7f7d0b9f7740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1baa4c370 0x55f1baa51450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:51.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.556+0000 7f7d0b9f7740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7d041ae0b0 con 0x55f1baa4c370 2024-09-19T07:12:51.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.556+0000 7f7d0b9f7740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7d041af520 con 0x55f1baa415d0 2024-09-19T07:12:51.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.556+0000 7f7d0b9f7740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7d041ae780 con 0x55f1baa42b40 2024-09-19T07:12:51.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.556+0000 7f7d0b9f7740 10 client.0 _ll_register_callbacks cb 0x7f7cf80044e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:12:51.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.556+0000 7f7d037fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1baa4c370 0x55f1baa51450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:51.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.556+0000 7f7d037fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1baa4c370 0x55f1baa51450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58286/0 (socket says 172.21.15.148:58286) 2024-09-19T07:12:51.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.556+0000 7f7d037fe640 1 -- 172.21.15.148:0/266927298 learned_addr learned my addr 172.21.15.148:0/266927298 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:51.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.556+0000 7f7d027fc640 1 --2- 172.21.15.148:0/266927298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1baa42b40 0x55f1baa549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:51.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.556+0000 7f7d02ffd640 1 --2- 172.21.15.148:0/266927298 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1baa415d0 0x55f1baa54480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:51.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.556+0000 7f7d037fe640 1 -- 172.21.15.148:0/266927298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1baa42b40 msgr2=0x55f1baa549c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:51.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.556+0000 7f7d037fe640 1 --2- 172.21.15.148:0/266927298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1baa42b40 0x55f1baa549c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:51.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.556+0000 7f7d037fe640 1 -- 172.21.15.148:0/266927298 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1baa415d0 msgr2=0x55f1baa54480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:51.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.556+0000 7f7d037fe640 1 --2- 172.21.15.148:0/266927298 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1baa415d0 0x55f1baa54480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:51.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.556+0000 7f7d037fe640 1 -- 172.21.15.148:0/266927298 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1baa3c310 con 0x55f1baa4c370 2024-09-19T07:12:51.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.556+0000 7f7d02ffd640 1 --2- 172.21.15.148:0/266927298 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1baa415d0 0x55f1baa54480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:12:51.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.556+0000 7f7d037fe640 1 --2- 172.21.15.148:0/266927298 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1baa4c370 0x55f1baa51450 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc0122d0 tx=0x7f7cfc012300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eaf467bafbc4562 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:51.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.556+0000 7f7ce6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:12:51.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.556+0000 7f7ce6ff5640 1 -- 172.21.15.148:0/266927298 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc020e00 con 0x55f1baa4c370 2024-09-19T07:12:51.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.556+0000 7f7ce6ff5640 1 -- 172.21.15.148:0/266927298 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f7cfc003b80 con 0x55f1baa4c370 2024-09-19T07:12:51.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.556+0000 7f7d0b9f7740 1 -- 172.21.15.148:0/266927298 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7cf4005500 con 0x55f1baa4c370 2024-09-19T07:12:51.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.556+0000 7f7ce6ff5640 1 -- 172.21.15.148:0/266927298 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7cfc038050 con 0x55f1baa4c370 2024-09-19T07:12:51.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.556+0000 7f7d0b9f7740 10 client.15894 fetch_fsmap learned FSMap version 25 2024-09-19T07:12:51.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.556+0000 7f7d0b9f7740 1 -- 172.21.15.148:0/266927298 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f1baac7090 con 0x55f1baa4c370 2024-09-19T07:12:51.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.557+0000 7f7ce6ff5640 1 -- 172.21.15.148:0/266927298 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7cf4005500 con 0x55f1baa4c370 2024-09-19T07:12:51.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.557+0000 7f7ce6ff5640 1 -- 172.21.15.148:0/266927298 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7cfc029040 con 0x55f1baa4c370 2024-09-19T07:12:51.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.557+0000 7f7d0b9f7740 10 client.15894 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:12:51.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.557+0000 7f7d0b9f7740 10 client.15894 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T07:12:51.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.557+0000 7f7d0b9f7740 20 client.15894 populate_metadata read hostname 'smithi148' 2024-09-19T07:12:51.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.557+0000 7f7d0b9f7740 1 --2- 172.21.15.148:0/266927298 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x55f1baac7580 0x55f1baac99a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:51.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.557+0000 7f7d0b9f7740 4 client.15894 mds_command: new command op to 24436 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:12:51.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.557+0000 7f7d0b9f7740 1 -- 172.21.15.148:0/266927298 --> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f1ba9aed70 con 0x55f1baac7580 2024-09-19T07:12:51.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.557+0000 7f7d02ffd640 1 --2- 172.21.15.148:0/266927298 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x55f1baac7580 0x55f1baac99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:51.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.557+0000 7f7ce6ff5640 10 client.15894 ms_handle_connect on v2:172.21.15.179:6836/3827671241 2024-09-19T07:12:51.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.557+0000 7f7d02ffd640 1 --2- 172.21.15.148:0/266927298 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x55f1baac7580 0x55f1baac99a0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1ed1071fdf11d083 server_cookie=53a36c44cda67ab in_seq=0 out_seq=0 2024-09-19T07:12:51.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.558+0000 7f7ce6ff5640 1 -- 172.21.15.148:0/266927298 <== mds.2 v2:172.21.15.179:6836/3827671241 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f1ba9aed70 con 0x55f1baac7580 2024-09-19T07:12:51.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.558+0000 7f7ce6ff5640 10 client.15894 handle_command_reply: tid=0 2024-09-19T07:12:51.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.558+0000 7f7d0b9f7740 1 client.15894 shutdown 2024-09-19T07:12:51.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.558+0000 7f7d0b9f7740 1 -- 172.21.15.148:0/266927298 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1baa4c370 msgr2=0x55f1baa51450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:51.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.558+0000 7f7d0b9f7740 1 --2- 172.21.15.148:0/266927298 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1baa4c370 0x55f1baa51450 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc0122d0 tx=0x7f7cfc012300 comp rx=0 tx=0).stop 2024-09-19T07:12:51.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.558+0000 7f7d0b9f7740 1 -- 172.21.15.148:0/266927298 shutdown_connections 2024-09-19T07:12:51.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.558+0000 7f7d0b9f7740 1 --2- 172.21.15.148:0/266927298 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x55f1baac7580 0x55f1baac99a0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:51.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.558+0000 7f7d0b9f7740 1 --2- 172.21.15.148:0/266927298 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f1baa4c370 0x55f1baa51450 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:51.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.558+0000 7f7ce6ff5640 0 client.15894 ms_handle_reset on v2:172.21.15.179:6836/3827671241 2024-09-19T07:12:51.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.558+0000 7f7d0b9f7740 1 --2- 172.21.15.148:0/266927298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1baa42b40 0x55f1baa549c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:51.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.558+0000 7f7d0b9f7740 1 --2- 172.21.15.148:0/266927298 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1baa415d0 0x55f1baa54480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:51.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.558+0000 7f7d0b9f7740 1 -- 172.21.15.148:0/266927298 >> 172.21.15.148:0/266927298 conn(0x55f1baa0a310 msgr2=0x55f1baa43110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:51.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.558+0000 7f7d0b9f7740 1 -- 172.21.15.148:0/266927298 shutdown_connections 2024-09-19T07:12:51.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.558+0000 7f7d0b9f7740 1 -- 172.21.15.148:0/266927298 wait complete. 2024-09-19T07:12:51.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.558+0000 7f7d0b9f7740 20 client.15894 trim_cache size 0 max 16384 2024-09-19T07:12:51.582 INFO:teuthology.orchestra.run.smithi148.stdout:[] 2024-09-19T07:12:51.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.558+0000 7f7d0961e640 1 -- 172.21.15.148:0/4002087977 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f7cec0a33b0 msgr2=0x7f7cec0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:51.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.558+0000 7f7d0961e640 1 --2- 172.21.15.148:0/4002087977 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f7cec0a33b0 0x7f7cec0a5870 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc0137b0 tx=0x7f7cfc013bb0 comp rx=0 tx=0).stop 2024-09-19T07:12:51.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.558+0000 7f7d0961e640 1 -- 172.21.15.148:0/4002087977 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d04102d40 msgr2=0x7f7d041009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:51.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.558+0000 7f7d0961e640 1 --2- 172.21.15.148:0/4002087977 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d04102d40 0x7f7d041009a0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f7cf8006010 tx=0x7f7cf80042f0 comp rx=0 tx=0).stop 2024-09-19T07:12:51.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.558+0000 7f7d0961e640 1 -- 172.21.15.148:0/4002087977 shutdown_connections 2024-09-19T07:12:51.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.558+0000 7f7d0961e640 1 --2- 172.21.15.148:0/4002087977 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f7cec0a33b0 0x7f7cec0a5870 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:51.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.558+0000 7f7d0961e640 1 --2- 172.21.15.148:0/4002087977 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7d0410c170 0x7f7d04101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:51.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.558+0000 7f7d0961e640 1 --2- 172.21.15.148:0/4002087977 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d04103660 0x7f7d04100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:51.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.558+0000 7f7d0961e640 1 --2- 172.21.15.148:0/4002087977 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d04102d40 0x7f7d041009a0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:51.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.558+0000 7f7d0961e640 1 -- 172.21.15.148:0/4002087977 >> 172.21.15.148:0/4002087977 conn(0x7f7d040fc7a0 msgr2=0x7f7d040fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:51.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.559+0000 7f7d0961e640 1 -- 172.21.15.148:0/4002087977 shutdown_connections 2024-09-19T07:12:51.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:51.559+0000 7f7d0961e640 1 -- 172.21.15.148:0/4002087977 wait complete. 2024-09-19T07:12:51.584 INFO:tasks.workunit.client.0.smithi148.stdout:checking for memory.h... (cached) yes 2024-09-19T07:12:51.584 INFO:tasks.workunit.client.0.smithi148.stdout:checking for strings.h... (cached) yes 2024-09-19T07:12:51.585 INFO:tasks.workunit.client.0.smithi148.stdout:checking for unistd.h... (cached) yes 2024-09-19T07:12:51.643 INFO:tasks.workunit.client.0.smithi148.stdout:checking locale.h usability... yes 2024-09-19T07:12:51.662 INFO:tasks.workunit.client.0.smithi148.stdout:checking locale.h presence... yes 2024-09-19T07:12:51.662 INFO:tasks.workunit.client.0.smithi148.stdout:checking for locale.h... yes 2024-09-19T07:12:51.676 INFO:tasks.workunit.client.0.smithi148.stdout:checking for stdlib.h... (cached) yes 2024-09-19T07:12:51.681 INFO:tasks.workunit.client.0.smithi148.stdout:checking for string.h... (cached) yes 2024-09-19T07:12:51.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:51 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/2759891260' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:12:51.807 INFO:tasks.workunit.client.0.smithi148.stdout:checking sys/socket.h usability... yes 2024-09-19T07:12:51.828 INFO:tasks.workunit.client.0.smithi148.stdout:checking sys/socket.h presence... yes 2024-09-19T07:12:51.829 INFO:tasks.workunit.client.0.smithi148.stdout:checking for sys/socket.h... yes 2024-09-19T07:12:51.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:51 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/2759891260' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:12:51.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:51 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/2759891260' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:12:51.894 INFO:tasks.workunit.client.0.smithi148.stdout:checking sys/time.h usability... yes 2024-09-19T07:12:51.913 INFO:tasks.workunit.client.0.smithi148.stdout:checking sys/time.h presence... yes 2024-09-19T07:12:51.914 INFO:tasks.workunit.client.0.smithi148.stdout:checking for sys/time.h... yes 2024-09-19T07:12:51.979 INFO:tasks.workunit.client.0.smithi148.stdout:checking fcntl.h usability... yes 2024-09-19T07:12:52.000 INFO:tasks.workunit.client.0.smithi148.stdout:checking fcntl.h presence... yes 2024-09-19T07:12:52.001 INFO:tasks.workunit.client.0.smithi148.stdout:checking for fcntl.h... yes 2024-09-19T07:12:52.089 INFO:tasks.workunit.client.0.smithi148.stdout:checking sys/fcntl.h usability... yes 2024-09-19T07:12:52.108 INFO:tasks.workunit.client.0.smithi148.stdout:checking sys/fcntl.h presence... yes 2024-09-19T07:12:52.109 INFO:tasks.workunit.client.0.smithi148.stdout:checking for sys/fcntl.h... yes 2024-09-19T07:12:52.401 INFO:tasks.workunit.client.0.smithi148.stdout:checking sys/param.h usability... yes 2024-09-19T07:12:52.423 INFO:tasks.workunit.client.0.smithi148.stdout:checking sys/param.h presence... yes 2024-09-19T07:12:52.424 INFO:tasks.workunit.client.0.smithi148.stdout:checking for sys/param.h... yes 2024-09-19T07:12:52.434 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T07:12:52.469 INFO:tasks.workunit.client.0.smithi148.stdout:checking ioctl.h usability... no 2024-09-19T07:12:52.489 INFO:tasks.workunit.client.0.smithi148.stdout:checking ioctl.h presence... no 2024-09-19T07:12:52.489 INFO:tasks.workunit.client.0.smithi148.stdout:checking for ioctl.h... no 2024-09-19T07:12:52.541 INFO:tasks.workunit.client.0.smithi148.stdout:checking sys/ioctl.h usability... yes 2024-09-19T07:12:52.560 INFO:tasks.workunit.client.0.smithi148.stdout:checking sys/ioctl.h presence... yes 2024-09-19T07:12:52.561 INFO:tasks.workunit.client.0.smithi148.stdout:checking for sys/ioctl.h... yes 2024-09-19T07:12:52.617 INFO:tasks.workunit.client.0.smithi148.stdout:checking return type of signal handlers... void 2024-09-19T07:12:52.661 INFO:tasks.workunit.client.0.smithi148.stdout:checking for size_t... yes 2024-09-19T07:12:52.696 INFO:tasks.workunit.client.0.smithi148.stdout:checking for dev_t... yes 2024-09-19T07:12:52.739 INFO:tasks.workunit.client.0.smithi148.stdout:checking for short... yes 2024-09-19T07:12:52.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:52 smithi179 ceph-mon[35716]: pgmap v57: 97 pgs: 97 active+clean; 1.5 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-09-19T07:12:52.814 INFO:tasks.workunit.client.0.smithi148.stdout:checking size of short... 2 2024-09-19T07:12:52.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:52 smithi148 ceph-mon[31180]: pgmap v57: 97 pgs: 97 active+clean; 1.5 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-09-19T07:12:52.857 INFO:tasks.workunit.client.0.smithi148.stdout:checking for int... yes 2024-09-19T07:12:52.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:52 smithi165 ceph-mon[35326]: pgmap v57: 97 pgs: 97 active+clean; 1.5 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-09-19T07:12:52.924 INFO:tasks.workunit.client.0.smithi148.stdout:checking size of int... 4 2024-09-19T07:12:52.986 INFO:tasks.workunit.client.0.smithi148.stdout:checking for long... yes 2024-09-19T07:12:53.022 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24457 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0' 2024-09-19T07:12:53.022 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24457 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0 2024-09-19T07:12:53.060 INFO:tasks.workunit.client.0.smithi148.stdout:checking size of long... 8 2024-09-19T07:12:53.110 INFO:tasks.workunit.client.0.smithi148.stdout:checking for long long... yes 2024-09-19T07:12:53.138 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:12:53.181 INFO:tasks.workunit.client.0.smithi148.stdout:checking size of long long... 8 2024-09-19T07:12:53.222 INFO:tasks.workunit.client.0.smithi148.stdout:checking for ssize_t... yes 2024-09-19T07:12:53.262 INFO:tasks.workunit.client.0.smithi148.stdout:checking for sig_atomic_t... yes 2024-09-19T07:12:53.387 INFO:tasks.workunit.client.0.smithi148.stdout:checking whether gcc needs -traditional... no 2024-09-19T07:12:53.423 INFO:tasks.workunit.client.0.smithi148.stdout:checking for an ANSI C-conforming const... yes 2024-09-19T07:12:53.447 INFO:tasks.workunit.client.0.smithi148.stdout:checking for inline... inline 2024-09-19T07:12:53.522 INFO:tasks.workunit.client.0.smithi148.stdout:checking for working alloca.h... yes 2024-09-19T07:12:53.588 INFO:tasks.workunit.client.0.smithi148.stdout:checking for alloca... yes 2024-09-19T07:12:53.666 INFO:tasks.workunit.client.0.smithi148.stdout:checking for working memcmp... yes 2024-09-19T07:12:53.735 INFO:tasks.workunit.client.0.smithi148.stdout:checking for strftime... yes 2024-09-19T07:12:53.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.688+0000 7f2780d71640 1 -- 172.21.15.148:0/1171973392 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f277c102d30 msgr2=0x7f277c103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:53.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.688+0000 7f2780d71640 1 --2- 172.21.15.148:0/1171973392 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f277c102d30 0x7f277c103110 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f276c009930 tx=0x7f276c02a440 comp rx=0 tx=0).stop 2024-09-19T07:12:53.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.688+0000 7f2780d71640 1 -- 172.21.15.148:0/1171973392 shutdown_connections 2024-09-19T07:12:53.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.688+0000 7f2780d71640 1 --2- 172.21.15.148:0/1171973392 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f277c1082a0 0x7f277c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:53.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.688+0000 7f2780d71640 1 --2- 172.21.15.148:0/1171973392 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f277c1036e0 0x7f277c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:53.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.688+0000 7f2780d71640 1 --2- 172.21.15.148:0/1171973392 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f277c102d30 0x7f277c103110 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:53.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.688+0000 7f2780d71640 1 -- 172.21.15.148:0/1171973392 >> 172.21.15.148:0/1171973392 conn(0x7f277c0fc7d0 msgr2=0x7f277c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:53.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.688+0000 7f2780d71640 1 -- 172.21.15.148:0/1171973392 shutdown_connections 2024-09-19T07:12:53.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.688+0000 7f2780d71640 1 -- 172.21.15.148:0/1171973392 wait complete. 2024-09-19T07:12:53.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.689+0000 7f2780d71640 1 Processor -- start 2024-09-19T07:12:53.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.689+0000 7f2780d71640 1 -- start start 2024-09-19T07:12:53.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.689+0000 7f2780d71640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f277c102d30 0x7f277c198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:53.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.689+0000 7f2780d71640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f277c1036e0 0x7f277c198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:53.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.689+0000 7f2780d71640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f277c1082a0 0x7f277c19cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:53.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.690+0000 7f2780d71640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f277c112100 con 0x7f277c102d30 2024-09-19T07:12:53.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.690+0000 7f2780d71640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f277c111f80 con 0x7f277c1036e0 2024-09-19T07:12:53.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.690+0000 7f2780d71640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f277c112280 con 0x7f277c1082a0 2024-09-19T07:12:53.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.690+0000 7f277a59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f277c102d30 0x7f277c198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:53.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.690+0000 7f277a59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f277c102d30 0x7f277c198620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58316/0 (socket says 172.21.15.148:58316) 2024-09-19T07:12:53.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.690+0000 7f277a59c640 1 -- 172.21.15.148:0/3528952983 learned_addr learned my addr 172.21.15.148:0/3528952983 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:53.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.690+0000 7f277ad9d640 1 --2- 172.21.15.148:0/3528952983 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f277c1082a0 0x7f277c19cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:53.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.690+0000 7f2779d9b640 1 --2- 172.21.15.148:0/3528952983 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f277c1036e0 0x7f277c198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:53.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.690+0000 7f277ad9d640 1 -- 172.21.15.148:0/3528952983 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f277c1036e0 msgr2=0x7f277c198b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:53.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.690+0000 7f277ad9d640 1 --2- 172.21.15.148:0/3528952983 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f277c1036e0 0x7f277c198b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:53.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.690+0000 7f277ad9d640 1 -- 172.21.15.148:0/3528952983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f277c102d30 msgr2=0x7f277c198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:53.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.690+0000 7f277ad9d640 1 --2- 172.21.15.148:0/3528952983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f277c102d30 0x7f277c198620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:53.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.690+0000 7f277ad9d640 1 -- 172.21.15.148:0/3528952983 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f277c19d5d0 con 0x7f277c1082a0 2024-09-19T07:12:53.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.690+0000 7f277a59c640 1 --2- 172.21.15.148:0/3528952983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f277c102d30 0x7f277c198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:12:53.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.690+0000 7f277ad9d640 1 --2- 172.21.15.148:0/3528952983 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f277c1082a0 0x7f277c19cef0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2774009fd0 tx=0x7f277400ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:53.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.690+0000 7f276b7fe640 1 -- 172.21.15.148:0/3528952983 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277400cd60 con 0x7f277c1082a0 2024-09-19T07:12:53.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.690+0000 7f2780d71640 1 -- 172.21.15.148:0/3528952983 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f277c19d8c0 con 0x7f277c1082a0 2024-09-19T07:12:53.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.690+0000 7f276b7fe640 1 -- 172.21.15.148:0/3528952983 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2774005020 con 0x7f277c1082a0 2024-09-19T07:12:53.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.690+0000 7f276b7fe640 1 -- 172.21.15.148:0/3528952983 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2774010690 con 0x7f277c1082a0 2024-09-19T07:12:53.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.691+0000 7f2780d71640 1 -- 172.21.15.148:0/3528952983 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f277c1a51a0 con 0x7f277c1082a0 2024-09-19T07:12:53.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.693+0000 7f276b7fe640 1 -- 172.21.15.148:0/3528952983 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f2774005540 con 0x7f277c1082a0 2024-09-19T07:12:53.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.694+0000 7f278314a740 1 Processor -- start 2024-09-19T07:12:53.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.694+0000 7f278314a740 1 -- start start 2024-09-19T07:12:53.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.694+0000 7f278314a740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55848db1eb40 0x55848db1d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:53.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.694+0000 7f278314a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55848db1d5d0 0x55848db1da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:53.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.694+0000 7f278314a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55848db2c780 0x55848db2eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:53.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.694+0000 7f278314a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55848da832f0 con 0x55848db1d5d0 2024-09-19T07:12:53.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.694+0000 7f278314a740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55848da2acf0 con 0x55848db1eb40 2024-09-19T07:12:53.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.694+0000 7f278314a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55848da7f2b0 con 0x55848db2c780 2024-09-19T07:12:53.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.694+0000 7f276b7fe640 1 --2- 172.21.15.148:0/3528952983 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f27640a33b0 0x7f27640a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:53.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.694+0000 7f277a59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55848db1d5d0 0x55848db1da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:53.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.694+0000 7f277a59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55848db1d5d0 0x55848db1da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58322/0 (socket says 172.21.15.148:58322) 2024-09-19T07:12:53.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.694+0000 7f277a59c640 1 -- 172.21.15.148:0/2695210700 learned_addr learned my addr 172.21.15.148:0/2695210700 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:53.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.695+0000 7f277ad9d640 1 --2- 172.21.15.148:0/3528952983 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f27640a33b0 0x7f27640a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:53.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.695+0000 7f2779d9b640 1 --2- 172.21.15.148:0/2695210700 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55848db1eb40 0x55848db1d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:53.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.695+0000 7f2779d9b640 1 --2- 172.21.15.148:0/2695210700 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55848db2c780 0x55848db2eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:53.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.695+0000 7f276b7fe640 1 -- 172.21.15.148:0/3528952983 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f27740d0360 con 0x7f277c1082a0 2024-09-19T07:12:53.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.695+0000 7f277a59c640 1 -- 172.21.15.148:0/2695210700 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55848db2c780 msgr2=0x55848db2eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:53.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.695+0000 7f277a59c640 1 --2- 172.21.15.148:0/2695210700 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55848db2c780 0x55848db2eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:53.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.695+0000 7f277a59c640 1 -- 172.21.15.148:0/2695210700 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55848db1eb40 msgr2=0x55848db1d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:53.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.695+0000 7f277a59c640 1 --2- 172.21.15.148:0/2695210700 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55848db1eb40 0x55848db1d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:53.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.695+0000 7f277a59c640 1 -- 172.21.15.148:0/2695210700 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55848da0f3a0 con 0x55848db1d5d0 2024-09-19T07:12:53.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.695+0000 7f2779d9b640 1 --2- 172.21.15.148:0/2695210700 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55848db2c780 0x55848db2eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:12:53.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.695+0000 7f277a59c640 1 --2- 172.21.15.148:0/2695210700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55848db1d5d0 0x55848db1da10 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f276c006010 tx=0x7f276c031660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb54bc8a82fd3379 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:53.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.695+0000 7f277ad9d640 1 --2- 172.21.15.148:0/3528952983 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f27640a33b0 0x7f27640a5870 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2774098ab0 tx=0x7f2774091ae0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:53.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.695+0000 7f2768ff9640 1 -- 172.21.15.148:0/2695210700 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276c035040 con 0x55848db1d5d0 2024-09-19T07:12:53.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.695+0000 7f2768ff9640 1 -- 172.21.15.148:0/2695210700 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f276c0035f0 con 0x55848db1d5d0 2024-09-19T07:12:53.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.695+0000 7f2768ff9640 1 -- 172.21.15.148:0/2695210700 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276c03c640 con 0x55848db1d5d0 2024-09-19T07:12:53.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.696+0000 7f278314a740 1 -- 172.21.15.148:0/2695210700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55848db1d5d0 msgr2=0x55848db1da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:53.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.696+0000 7f278314a740 1 --2- 172.21.15.148:0/2695210700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55848db1d5d0 0x55848db1da10 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f276c006010 tx=0x7f276c031660 comp rx=0 tx=0).stop 2024-09-19T07:12:53.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.696+0000 7f278314a740 1 -- 172.21.15.148:0/2695210700 shutdown_connections 2024-09-19T07:12:53.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.696+0000 7f278314a740 1 --2- 172.21.15.148:0/2695210700 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55848db2c780 0x55848db2eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:53.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.696+0000 7f278314a740 1 --2- 172.21.15.148:0/2695210700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55848db1d5d0 0x55848db1da10 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:53.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.696+0000 7f278314a740 1 --2- 172.21.15.148:0/2695210700 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55848db1eb40 0x55848db1d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:53.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.696+0000 7f278314a740 1 -- 172.21.15.148:0/2695210700 >> 172.21.15.148:0/2695210700 conn(0x55848dae6310 msgr2=0x55848db19c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:53.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.696+0000 7f278314a740 1 -- 172.21.15.148:0/2695210700 shutdown_connections 2024-09-19T07:12:53.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.696+0000 7f278314a740 1 -- 172.21.15.148:0/2695210700 wait complete. 2024-09-19T07:12:53.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.697+0000 7f278314a740 1 -- start start 2024-09-19T07:12:53.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.697+0000 7f278314a740 1 Processor -- start 2024-09-19T07:12:53.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.697+0000 7f278314a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55848db1d5d0 0x55848db2c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:53.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.697+0000 7f278314a740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55848db1eb40 0x55848db293a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:53.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.697+0000 7f278314a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55848db2c780 0x55848db29900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:53.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.697+0000 7f278314a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55848db2f420 con 0x55848db2c780 2024-09-19T07:12:53.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.697+0000 7f278314a740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55848da3e060 con 0x55848db1eb40 2024-09-19T07:12:53.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.697+0000 7f278314a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55848db2f5a0 con 0x55848db1d5d0 2024-09-19T07:12:53.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.697+0000 7f278314a740 10 client.0 _ll_register_callbacks cb 0x55848d7918c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:12:53.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.697+0000 7f2779d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55848db2c780 0x55848db29900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:53.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.697+0000 7f2779d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55848db2c780 0x55848db29900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58336/0 (socket says 172.21.15.148:58336) 2024-09-19T07:12:53.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.697+0000 7f2779d9b640 1 -- 172.21.15.148:0/49222920 learned_addr learned my addr 172.21.15.148:0/49222920 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:53.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.697+0000 7f2779d9b640 1 --2- 172.21.15.148:0/49222920 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55848db1d5d0 0x55848db2c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:53.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.697+0000 7f277a59c640 1 --2- 172.21.15.148:0/49222920 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55848db1eb40 0x55848db293a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:53.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.697+0000 7f2779d9b640 1 -- 172.21.15.148:0/49222920 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55848db1d5d0 msgr2=0x55848db2c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:53.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.697+0000 7f2779d9b640 1 --2- 172.21.15.148:0/49222920 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55848db1d5d0 0x55848db2c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:53.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.697+0000 7f2779d9b640 1 -- 172.21.15.148:0/49222920 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55848db1eb40 msgr2=0x55848db293a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:53.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.697+0000 7f2779d9b640 1 --2- 172.21.15.148:0/49222920 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55848db1eb40 0x55848db293a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:53.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.697+0000 7f2779d9b640 1 -- 172.21.15.148:0/49222920 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55848d7f43c0 con 0x55848db2c780 2024-09-19T07:12:53.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.697+0000 7f277a59c640 1 --2- 172.21.15.148:0/49222920 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55848db1eb40 0x55848db293a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:12:53.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.698+0000 7f2779d9b640 1 --2- 172.21.15.148:0/49222920 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55848db2c780 0x55848db29900 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f2770018c40 tx=0x7f27700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b94aed58e732ec0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:53.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.698+0000 7f2761ffb640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:12:53.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.698+0000 7f2761ffb640 1 -- 172.21.15.148:0/49222920 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2770013c30 con 0x55848db2c780 2024-09-19T07:12:53.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.698+0000 7f2761ffb640 1 -- 172.21.15.148:0/49222920 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f2770013dd0 con 0x55848db2c780 2024-09-19T07:12:53.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.698+0000 7f278314a740 1 -- 172.21.15.148:0/49222920 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f276c0035f0 con 0x55848db2c780 2024-09-19T07:12:53.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.698+0000 7f2761ffb640 1 -- 172.21.15.148:0/49222920 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f27700059c0 con 0x55848db2c780 2024-09-19T07:12:53.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.698+0000 7f278314a740 10 client.15906 fetch_fsmap learned FSMap version 25 2024-09-19T07:12:53.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.698+0000 7f278314a740 1 -- 172.21.15.148:0/49222920 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55848db3ae90 con 0x55848db2c780 2024-09-19T07:12:53.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.698+0000 7f2761ffb640 1 -- 172.21.15.148:0/49222920 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f276c0035f0 con 0x55848db2c780 2024-09-19T07:12:53.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.698+0000 7f2761ffb640 1 -- 172.21.15.148:0/49222920 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2770022070 con 0x55848db2c780 2024-09-19T07:12:53.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.698+0000 7f278314a740 10 client.15906 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:12:53.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.698+0000 7f278314a740 10 client.15906 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T07:12:53.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.698+0000 7f278314a740 20 client.15906 populate_metadata read hostname 'smithi148' 2024-09-19T07:12:53.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.698+0000 7f278314a740 1 --2- 172.21.15.148:0/49222920 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x55848db3c2f0 0x55848db3e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:53.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.698+0000 7f278314a740 4 client.15906 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:12:53.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.698+0000 7f278314a740 1 -- 172.21.15.148:0/49222920 --> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55848da90860 con 0x55848db3c2f0 2024-09-19T07:12:53.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.699+0000 7f277a59c640 1 --2- 172.21.15.148:0/49222920 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x55848db3c2f0 0x55848db3e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:53.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.699+0000 7f2761ffb640 10 client.15906 ms_handle_connect on v2:172.21.15.165:6838/3993490234 2024-09-19T07:12:53.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.699+0000 7f277a59c640 1 --2- 172.21.15.148:0/49222920 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x55848db3c2f0 0x55848db3e750 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=425cca04aa33fd78 server_cookie=2ab186e52f6633 in_seq=0 out_seq=0 2024-09-19T07:12:53.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.700+0000 7f2761ffb640 1 -- 172.21.15.148:0/49222920 <== mds.1 v2:172.21.15.165:6838/3993490234 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55848da90860 con 0x55848db3c2f0 2024-09-19T07:12:53.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.700+0000 7f2761ffb640 10 client.15906 handle_command_reply: tid=0 2024-09-19T07:12:53.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.700+0000 7f278314a740 1 client.15906 shutdown 2024-09-19T07:12:53.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.700+0000 7f278314a740 1 -- 172.21.15.148:0/49222920 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55848db2c780 msgr2=0x55848db29900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:53.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.700+0000 7f278314a740 1 --2- 172.21.15.148:0/49222920 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55848db2c780 0x55848db29900 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f2770018c40 tx=0x7f27700046c0 comp rx=0 tx=0).stop 2024-09-19T07:12:53.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.700+0000 7f278314a740 1 -- 172.21.15.148:0/49222920 shutdown_connections 2024-09-19T07:12:53.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.700+0000 7f278314a740 1 --2- 172.21.15.148:0/49222920 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55848db2c780 0x55848db29900 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:53.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.700+0000 7f278314a740 1 --2- 172.21.15.148:0/49222920 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x55848db3c2f0 0x55848db3e750 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:53.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.700+0000 7f278314a740 1 --2- 172.21.15.148:0/49222920 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55848db1eb40 0x55848db293a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:53.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.700+0000 7f278314a740 1 --2- 172.21.15.148:0/49222920 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55848db1d5d0 0x55848db2c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:53.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.700+0000 7f278314a740 1 -- 172.21.15.148:0/49222920 >> 172.21.15.148:0/49222920 conn(0x55848dae6310 msgr2=0x55848db1f930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:53.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.700+0000 7f2761ffb640 0 client.15906 ms_handle_reset on v2:172.21.15.165:6838/3993490234 2024-09-19T07:12:53.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.700+0000 7f278314a740 1 -- 172.21.15.148:0/49222920 shutdown_connections 2024-09-19T07:12:53.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.700+0000 7f278314a740 1 -- 172.21.15.148:0/49222920 wait complete. 2024-09-19T07:12:53.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.700+0000 7f278314a740 20 client.15906 trim_cache size 0 max 16384 2024-09-19T07:12:53.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.713+0000 7f278314a740 1 Processor -- start 2024-09-19T07:12:53.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.713+0000 7f278314a740 1 -- start start 2024-09-19T07:12:53.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.713+0000 7f278314a740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55848db1d5d0 0x55848db19e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:53.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.713+0000 7f278314a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55848db1eb40 0x55848db386c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:53.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.713+0000 7f278314a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55848db2c780 0x55848db44020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:53.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.713+0000 7f278314a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f277c1ae030 con 0x55848db1eb40 2024-09-19T07:12:53.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.713+0000 7f278314a740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f277c1ab900 con 0x55848db1d5d0 2024-09-19T07:12:53.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.713+0000 7f278314a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f277c1a9730 con 0x55848db2c780 2024-09-19T07:12:53.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.713+0000 7f277a59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55848db1eb40 0x55848db386c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:53.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.713+0000 7f277a59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55848db1eb40 0x55848db386c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58344/0 (socket says 172.21.15.148:58344) 2024-09-19T07:12:53.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.713+0000 7f277a59c640 1 -- 172.21.15.148:0/3372354684 learned_addr learned my addr 172.21.15.148:0/3372354684 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:53.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.714+0000 7f2779d9b640 1 --2- 172.21.15.148:0/3372354684 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55848db1d5d0 0x55848db19e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:53.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.714+0000 7f277a59c640 1 -- 172.21.15.148:0/3372354684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55848db2c780 msgr2=0x55848db44020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:53.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.714+0000 7f277a59c640 1 --2- 172.21.15.148:0/3372354684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55848db2c780 0x55848db44020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:53.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.714+0000 7f277a59c640 1 -- 172.21.15.148:0/3372354684 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55848db1d5d0 msgr2=0x55848db19e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:53.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.714+0000 7f277a59c640 1 --2- 172.21.15.148:0/3372354684 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55848db1d5d0 0x55848db19e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:53.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.714+0000 7f277a59c640 1 -- 172.21.15.148:0/3372354684 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55848db18310 con 0x55848db1eb40 2024-09-19T07:12:53.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.714+0000 7f277a59c640 1 --2- 172.21.15.148:0/3372354684 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55848db1eb40 0x55848db386c0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f276c005b90 tx=0x7f276c02a440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d363809b05ab71a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:53.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.714+0000 7f2763fff640 1 -- 172.21.15.148:0/3372354684 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276c035040 con 0x55848db1eb40 2024-09-19T07:12:53.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.714+0000 7f2763fff640 1 -- 172.21.15.148:0/3372354684 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f276c004240 con 0x55848db1eb40 2024-09-19T07:12:53.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.714+0000 7f2763fff640 1 -- 172.21.15.148:0/3372354684 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276c004770 con 0x55848db1eb40 2024-09-19T07:12:53.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.715+0000 7f278314a740 1 -- 172.21.15.148:0/3372354684 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55848db1eb40 msgr2=0x55848db386c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:53.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.715+0000 7f278314a740 1 --2- 172.21.15.148:0/3372354684 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55848db1eb40 0x55848db386c0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f276c005b90 tx=0x7f276c02a440 comp rx=0 tx=0).stop 2024-09-19T07:12:53.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.715+0000 7f278314a740 1 -- 172.21.15.148:0/3372354684 shutdown_connections 2024-09-19T07:12:53.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.715+0000 7f278314a740 1 --2- 172.21.15.148:0/3372354684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55848db2c780 0x55848db44020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:53.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.715+0000 7f278314a740 1 --2- 172.21.15.148:0/3372354684 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55848db1eb40 0x55848db386c0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:53.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.715+0000 7f278314a740 1 --2- 172.21.15.148:0/3372354684 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55848db1d5d0 0x55848db19e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:53.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.715+0000 7f278314a740 1 -- 172.21.15.148:0/3372354684 >> 172.21.15.148:0/3372354684 conn(0x55848dae6310 msgr2=0x55848db19700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:53.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.715+0000 7f278314a740 1 -- 172.21.15.148:0/3372354684 shutdown_connections 2024-09-19T07:12:53.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.715+0000 7f278314a740 1 -- 172.21.15.148:0/3372354684 wait complete. 2024-09-19T07:12:53.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.715+0000 7f278314a740 1 -- start start 2024-09-19T07:12:53.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.715+0000 7f278314a740 1 Processor -- start 2024-09-19T07:12:53.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.715+0000 7f278314a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55848db1d5d0 0x55848db34830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:53.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.715+0000 7f278314a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55848db1eb40 0x55848db34d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:53.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.715+0000 7f278314a740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55848db2c780 0x55848db259d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:53.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.715+0000 7f278314a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f277c1a9dc0 con 0x55848db1eb40 2024-09-19T07:12:53.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.715+0000 7f278314a740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f277c1ab230 con 0x55848db2c780 2024-09-19T07:12:53.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.715+0000 7f278314a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f277c1aa490 con 0x55848db1d5d0 2024-09-19T07:12:53.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.715+0000 7f278314a740 10 client.0 _ll_register_callbacks cb 0x7f2770009bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:12:53.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.716+0000 7f277a59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55848db1eb40 0x55848db34d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:53.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.716+0000 7f277a59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55848db1eb40 0x55848db34d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58348/0 (socket says 172.21.15.148:58348) 2024-09-19T07:12:53.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.716+0000 7f277a59c640 1 -- 172.21.15.148:0/2776553556 learned_addr learned my addr 172.21.15.148:0/2776553556 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:53.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.716+0000 7f2779d9b640 1 --2- 172.21.15.148:0/2776553556 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55848db2c780 0x55848db259d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:53.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.716+0000 7f2779d9b640 1 --2- 172.21.15.148:0/2776553556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55848db1d5d0 0x55848db34830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:53.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.716+0000 7f277a59c640 1 -- 172.21.15.148:0/2776553556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55848db1d5d0 msgr2=0x55848db34830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:53.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.716+0000 7f277a59c640 1 --2- 172.21.15.148:0/2776553556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55848db1d5d0 0x55848db34830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:53.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.716+0000 7f277a59c640 1 -- 172.21.15.148:0/2776553556 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55848db2c780 msgr2=0x55848db259d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:53.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.716+0000 7f277a59c640 1 --2- 172.21.15.148:0/2776553556 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55848db2c780 0x55848db259d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:53.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.716+0000 7f277a59c640 1 -- 172.21.15.148:0/2776553556 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55848db26010 con 0x55848db1eb40 2024-09-19T07:12:53.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.716+0000 7f2779d9b640 1 --2- 172.21.15.148:0/2776553556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55848db1d5d0 0x55848db34830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:12:53.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.716+0000 7f277a59c640 1 --2- 172.21.15.148:0/2776553556 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55848db1eb40 0x55848db34d70 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f276c005d80 tx=0x7f276c005a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dc73fd2f143c8f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:53.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.716+0000 7f2761ffb640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:12:53.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.716+0000 7f2761ffb640 1 -- 172.21.15.148:0/2776553556 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276c035070 con 0x55848db1eb40 2024-09-19T07:12:53.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.716+0000 7f2761ffb640 1 -- 172.21.15.148:0/2776553556 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f276c0053f0 con 0x55848db1eb40 2024-09-19T07:12:53.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.716+0000 7f278314a740 1 -- 172.21.15.148:0/2776553556 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f276c004240 con 0x55848db1eb40 2024-09-19T07:12:53.755 INFO:teuthology.orchestra.run.smithi148.stdout:[] 2024-09-19T07:12:53.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.716+0000 7f2761ffb640 1 -- 172.21.15.148:0/2776553556 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f276c0055f0 con 0x55848db1eb40 2024-09-19T07:12:53.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.716+0000 7f278314a740 10 client.15912 fetch_fsmap learned FSMap version 25 2024-09-19T07:12:53.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.716+0000 7f278314a740 1 -- 172.21.15.148:0/2776553556 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55848dba68f0 con 0x55848db1eb40 2024-09-19T07:12:53.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.716+0000 7f2761ffb640 1 -- 172.21.15.148:0/2776553556 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f276c004240 con 0x55848db1eb40 2024-09-19T07:12:53.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.717+0000 7f2761ffb640 1 -- 172.21.15.148:0/2776553556 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f276c003ca0 con 0x55848db1eb40 2024-09-19T07:12:53.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.717+0000 7f278314a740 10 client.15912 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:12:53.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.717+0000 7f278314a740 10 client.15912 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T07:12:53.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.717+0000 7f278314a740 20 client.15912 populate_metadata read hostname 'smithi148' 2024-09-19T07:12:53.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.717+0000 7f278314a740 1 --2- 172.21.15.148:0/2776553556 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x55848dba6b10 0x55848dba8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:53.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.717+0000 7f278314a740 4 client.15912 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:12:53.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.717+0000 7f278314a740 1 -- 172.21.15.148:0/2776553556 --> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55848da8ad70 con 0x55848dba6b10 2024-09-19T07:12:53.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.717+0000 7f2779d9b640 1 --2- 172.21.15.148:0/2776553556 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x55848dba6b10 0x55848dba8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:53.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.717+0000 7f2779d9b640 1 --2- 172.21.15.148:0/2776553556 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x55848dba6b10 0x55848dba8f00 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=57c06c07d4e8b2ec server_cookie=db1871d0d7524aa4 in_seq=0 out_seq=0 2024-09-19T07:12:53.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.717+0000 7f2761ffb640 10 client.15912 ms_handle_connect on v2:172.21.15.165:6838/3993490234 2024-09-19T07:12:53.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.717+0000 7f2761ffb640 1 -- 172.21.15.148:0/2776553556 <== mds.1 v2:172.21.15.165:6838/3993490234 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55848da8ad70 con 0x55848dba6b10 2024-09-19T07:12:53.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.717+0000 7f2761ffb640 10 client.15912 handle_command_reply: tid=0 2024-09-19T07:12:53.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.717+0000 7f278314a740 1 client.15912 shutdown 2024-09-19T07:12:53.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.718+0000 7f278314a740 1 -- 172.21.15.148:0/2776553556 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55848db1eb40 msgr2=0x55848db34d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:53.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.718+0000 7f278314a740 1 --2- 172.21.15.148:0/2776553556 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55848db1eb40 0x55848db34d70 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f276c005d80 tx=0x7f276c005a40 comp rx=0 tx=0).stop 2024-09-19T07:12:53.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.718+0000 7f278314a740 1 -- 172.21.15.148:0/2776553556 shutdown_connections 2024-09-19T07:12:53.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.718+0000 7f278314a740 1 --2- 172.21.15.148:0/2776553556 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x55848dba6b10 0x55848dba8f00 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:53.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.718+0000 7f278314a740 1 --2- 172.21.15.148:0/2776553556 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55848db2c780 0x55848db259d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:53.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.718+0000 7f278314a740 1 --2- 172.21.15.148:0/2776553556 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55848db1eb40 0x55848db34d70 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:53.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.718+0000 7f2761ffb640 0 client.15912 ms_handle_reset on v2:172.21.15.165:6838/3993490234 2024-09-19T07:12:53.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.718+0000 7f278314a740 1 --2- 172.21.15.148:0/2776553556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55848db1d5d0 0x55848db34830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:53.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.718+0000 7f278314a740 1 -- 172.21.15.148:0/2776553556 >> 172.21.15.148:0/2776553556 conn(0x55848dae6310 msgr2=0x55848db2ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:53.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.718+0000 7f278314a740 1 -- 172.21.15.148:0/2776553556 shutdown_connections 2024-09-19T07:12:53.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.718+0000 7f278314a740 1 -- 172.21.15.148:0/2776553556 wait complete. 2024-09-19T07:12:53.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.718+0000 7f278314a740 20 client.15912 trim_cache size 0 max 16384 2024-09-19T07:12:53.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.718+0000 7f2780d71640 1 -- 172.21.15.148:0/3528952983 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f27640a33b0 msgr2=0x7f27640a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:53.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.718+0000 7f2780d71640 1 --2- 172.21.15.148:0/3528952983 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f27640a33b0 0x7f27640a5870 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2774098ab0 tx=0x7f2774091ae0 comp rx=0 tx=0).stop 2024-09-19T07:12:53.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.718+0000 7f2780d71640 1 -- 172.21.15.148:0/3528952983 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f277c1082a0 msgr2=0x7f277c19cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:53.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.718+0000 7f2780d71640 1 --2- 172.21.15.148:0/3528952983 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f277c1082a0 0x7f277c19cef0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2774009fd0 tx=0x7f277400ee50 comp rx=0 tx=0).stop 2024-09-19T07:12:53.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.718+0000 7f2780d71640 1 -- 172.21.15.148:0/3528952983 shutdown_connections 2024-09-19T07:12:53.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.718+0000 7f2780d71640 1 --2- 172.21.15.148:0/3528952983 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f27640a33b0 0x7f27640a5870 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:53.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.718+0000 7f2780d71640 1 --2- 172.21.15.148:0/3528952983 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f277c1082a0 0x7f277c19cef0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:53.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.718+0000 7f2780d71640 1 --2- 172.21.15.148:0/3528952983 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f277c1036e0 0x7f277c198b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:53.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.718+0000 7f2780d71640 1 --2- 172.21.15.148:0/3528952983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f277c102d30 0x7f277c198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:53.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.718+0000 7f2780d71640 1 -- 172.21.15.148:0/3528952983 >> 172.21.15.148:0/3528952983 conn(0x7f277c0fc7d0 msgr2=0x7f277c105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:53.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.718+0000 7f2780d71640 1 -- 172.21.15.148:0/3528952983 shutdown_connections 2024-09-19T07:12:53.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:53.718+0000 7f2780d71640 1 -- 172.21.15.148:0/3528952983 wait complete. 2024-09-19T07:12:53.817 INFO:tasks.workunit.client.0.smithi148.stdout:checking whether lstat dereferences a symlink specified with a trailing slash... yes 2024-09-19T07:12:53.876 INFO:tasks.workunit.client.0.smithi148.stdout:checking whether stat accepts an empty string... no 2024-09-19T07:12:53.930 INFO:tasks.workunit.client.0.smithi148.stdout:checking for vprintf... yes 2024-09-19T07:12:53.989 INFO:tasks.workunit.client.0.smithi148.stdout:checking for _doprnt... no 2024-09-19T07:12:54.011 INFO:tasks.workunit.client.0.smithi148.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-19T07:12:54.023 INFO:tasks.workunit.client.0.smithi148.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-19T07:12:54.098 INFO:tasks.workunit.client.0.smithi148.stdout:checking for the pthreads library -lpthreads... no 2024-09-19T07:12:54.149 INFO:tasks.workunit.client.0.smithi148.stdout:checking whether pthreads work without any flags... yes 2024-09-19T07:12:54.195 INFO:tasks.workunit.client.0.smithi148.stdout:checking for joinable pthread attribute... PTHREAD_CREATE_JOINABLE 2024-09-19T07:12:54.195 INFO:tasks.workunit.client.0.smithi148.stdout:checking if more special flags are required for pthreads... no 2024-09-19T07:12:54.195 INFO:tasks.workunit.client.0.smithi148.stdout:checking for cc_r... gcc 2024-09-19T07:12:54.279 INFO:tasks.workunit.client.0.smithi148.stdout:checking for setrlimit... yes 2024-09-19T07:12:54.345 INFO:tasks.workunit.client.0.smithi148.stdout:checking for setproctitle... no 2024-09-19T07:12:54.406 INFO:tasks.workunit.client.0.smithi148.stdout:checking for getopt_long... yes 2024-09-19T07:12:54.478 INFO:tasks.workunit.client.0.smithi148.stdout:checking for strtoull... yes 2024-09-19T07:12:54.537 INFO:tasks.workunit.client.0.smithi148.stdout:checking for strtoq... yes 2024-09-19T07:12:54.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:54 smithi148 ceph-mon[31180]: pgmap v58: 97 pgs: 97 active+clean; 1.5 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-09-19T07:12:54.613 INFO:tasks.workunit.client.0.smithi148.stdout:checking for snprintf... yes 2024-09-19T07:12:54.655 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T07:12:54.677 INFO:tasks.workunit.client.0.smithi148.stdout:checking for vsnprintf... yes 2024-09-19T07:12:54.740 INFO:tasks.workunit.client.0.smithi148.stdout:checking for vfprintf... yes 2024-09-19T07:12:54.740 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:12:54.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:54 smithi179 ceph-mon[35716]: pgmap v58: 97 pgs: 97 active+clean; 1.5 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-09-19T07:12:54.819 INFO:tasks.workunit.client.0.smithi148.stdout:checking for gethostname... yes 2024-09-19T07:12:54.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:54 smithi165 ceph-mon[35326]: pgmap v58: 97 pgs: 97 active+clean; 1.5 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-09-19T07:12:54.889 INFO:tasks.workunit.client.0.smithi148.stdout:checking for setlocale... yes 2024-09-19T07:12:54.961 INFO:tasks.workunit.client.0.smithi148.stdout:checking for sync... yes 2024-09-19T07:12:55.029 INFO:tasks.workunit.client.0.smithi148.stdout:checking whether snprintf is C99 conformant... done 2024-09-19T07:12:55.040 INFO:tasks.workunit.client.0.smithi148.stdout:configure: creating ./config.status 2024-09-19T07:12:55.213 INFO:tasks.workunit.client.0.smithi148.stdout:config.status: creating Makefile 2024-09-19T07:12:55.229 INFO:tasks.workunit.client.0.smithi148.stdout:config.status: creating src/Makefile 2024-09-19T07:12:55.248 INFO:tasks.workunit.client.0.smithi148.stdout:config.status: creating man/Makefile 2024-09-19T07:12:55.261 INFO:tasks.workunit.client.0.smithi148.stdout:config.status: creating config.h 2024-09-19T07:12:55.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.287+0000 7f2ed2704640 1 -- 172.21.15.148:0/2283266196 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ecc10c190 msgr2=0x7f2ecc10e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:55.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.287+0000 7f2ed2704640 1 --2- 172.21.15.148:0/2283266196 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ecc10c190 0x7f2ecc10e620 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4009ca0 tx=0x7f2ec402a950 comp rx=0 tx=0).stop 2024-09-19T07:12:55.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.287+0000 7f2ed2704640 1 -- 172.21.15.148:0/2283266196 shutdown_connections 2024-09-19T07:12:55.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.287+0000 7f2ed2704640 1 --2- 172.21.15.148:0/2283266196 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ecc10c190 0x7f2ecc10e620 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:55.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.287+0000 7f2ed2704640 1 --2- 172.21.15.148:0/2283266196 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ecc103710 0x7f2ecc10bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:55.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.287+0000 7f2ed2704640 1 --2- 172.21.15.148:0/2283266196 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2ecc102df0 0x7f2ecc1031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:55.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.287+0000 7f2ed2704640 1 -- 172.21.15.148:0/2283266196 >> 172.21.15.148:0/2283266196 conn(0x7f2ecc0fc7d0 msgr2=0x7f2ecc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:55.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.287+0000 7f2ed2704640 1 -- 172.21.15.148:0/2283266196 shutdown_connections 2024-09-19T07:12:55.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.287+0000 7f2ed2704640 1 -- 172.21.15.148:0/2283266196 wait complete. 2024-09-19T07:12:55.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.288+0000 7f2ed2704640 1 Processor -- start 2024-09-19T07:12:55.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.288+0000 7f2ed2704640 1 -- start start 2024-09-19T07:12:55.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.288+0000 7f2ed2704640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ecc102df0 0x7f2ecc1983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:55.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.288+0000 7f2ed2704640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ecc103710 0x7f2ecc198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:55.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.288+0000 7f2ed2704640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2ecc10c190 0x7f2ecc19cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:55.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.288+0000 7f2ed2704640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2ecc111f40 con 0x7f2ecc102df0 2024-09-19T07:12:55.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.288+0000 7f2ed2704640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2ecc111dc0 con 0x7f2ecc10c190 2024-09-19T07:12:55.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.288+0000 7f2ed2704640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2ecc1120c0 con 0x7f2ecc103710 2024-09-19T07:12:55.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.288+0000 7f2ecbfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ecc102df0 0x7f2ecc1983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:55.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.288+0000 7f2ecbfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ecc102df0 0x7f2ecc1983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50592/0 (socket says 172.21.15.148:50592) 2024-09-19T07:12:55.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.288+0000 7f2ecb7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ecc103710 0x7f2ecc198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:55.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.288+0000 7f2ecbfff640 1 -- 172.21.15.148:0/2950533759 learned_addr learned my addr 172.21.15.148:0/2950533759 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:55.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.288+0000 7f2ed0ca1640 1 --2- 172.21.15.148:0/2950533759 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2ecc10c190 0x7f2ecc19cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:55.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.289+0000 7f2ecb7fe640 1 -- 172.21.15.148:0/2950533759 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2ecc10c190 msgr2=0x7f2ecc19cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:55.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.289+0000 7f2ecb7fe640 1 --2- 172.21.15.148:0/2950533759 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2ecc10c190 0x7f2ecc19cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:55.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.289+0000 7f2ecb7fe640 1 -- 172.21.15.148:0/2950533759 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ecc102df0 msgr2=0x7f2ecc1983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:55.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.289+0000 7f2ecb7fe640 1 --2- 172.21.15.148:0/2950533759 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ecc102df0 0x7f2ecc1983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:55.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.289+0000 7f2ecb7fe640 1 -- 172.21.15.148:0/2950533759 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ecc19d370 con 0x7f2ecc103710 2024-09-19T07:12:55.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.289+0000 7f2ecb7fe640 1 --2- 172.21.15.148:0/2950533759 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ecc103710 0x7f2ecc198900 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2eb400e9f0 tx=0x7f2eb400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:55.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.289+0000 7f2ec97fa640 1 -- 172.21.15.148:0/2950533759 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb400ccc0 con 0x7f2ecc103710 2024-09-19T07:12:55.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.289+0000 7f2ed2704640 1 -- 172.21.15.148:0/2950533759 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ecc19d660 con 0x7f2ecc103710 2024-09-19T07:12:55.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.289+0000 7f2ec97fa640 1 -- 172.21.15.148:0/2950533759 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2eb4010910 con 0x7f2ecc103710 2024-09-19T07:12:55.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.289+0000 7f2ec97fa640 1 -- 172.21.15.148:0/2950533759 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb4018960 con 0x7f2ecc103710 2024-09-19T07:12:55.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.289+0000 7f2ed2704640 1 -- 172.21.15.148:0/2950533759 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ecc1a4f40 con 0x7f2ecc103710 2024-09-19T07:12:55.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.292+0000 7f2ec97fa640 1 -- 172.21.15.148:0/2950533759 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f2eb4018b00 con 0x7f2ecc103710 2024-09-19T07:12:55.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.292+0000 7f2ed4add740 1 Processor -- start 2024-09-19T07:12:55.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.292+0000 7f2ed4add740 1 -- start start 2024-09-19T07:12:55.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.292+0000 7f2ed4add740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb2fa69710 0x55fb2fa69af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:55.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.292+0000 7f2ed4add740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb2fa6a030 0x55fb2fa78900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:55.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.292+0000 7f2ed4add740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb2fa78e40 0x55fb2fa7b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:55.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.292+0000 7f2ed4add740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55fb2f9ce160 con 0x55fb2fa78e40 2024-09-19T07:12:55.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.292+0000 7f2ed4add740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55fb2f975720 con 0x55fb2fa6a030 2024-09-19T07:12:55.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.292+0000 7f2ed4add740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55fb2f9ca120 con 0x55fb2fa69710 2024-09-19T07:12:55.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.292+0000 7f2ecb7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb2fa78e40 0x55fb2fa7b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:55.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.292+0000 7f2ed0ca1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb2fa69710 0x55fb2fa69af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:55.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.292+0000 7f2ed0ca1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb2fa69710 0x55fb2fa69af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:39332/0 (socket says 172.21.15.148:39332) 2024-09-19T07:12:55.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.292+0000 7f2ed0ca1640 1 -- 172.21.15.148:0/1900668502 learned_addr learned my addr 172.21.15.148:0/1900668502 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:55.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.292+0000 7f2ecbfff640 1 --2- 172.21.15.148:0/1900668502 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb2fa6a030 0x55fb2fa78900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:55.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.293+0000 7f2ed0ca1640 1 -- 172.21.15.148:0/1900668502 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb2fa6a030 msgr2=0x55fb2fa78900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:55.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.293+0000 7f2ed0ca1640 1 --2- 172.21.15.148:0/1900668502 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb2fa6a030 0x55fb2fa78900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:55.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.293+0000 7f2ed0ca1640 1 -- 172.21.15.148:0/1900668502 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb2fa78e40 msgr2=0x55fb2fa7b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:55.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.293+0000 7f2ed0ca1640 1 --2- 172.21.15.148:0/1900668502 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb2fa78e40 0x55fb2fa7b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:55.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.293+0000 7f2ed0ca1640 1 -- 172.21.15.148:0/1900668502 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb2f73fba0 con 0x55fb2fa69710 2024-09-19T07:12:55.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.293+0000 7f2ec97fa640 1 --2- 172.21.15.148:0/2950533759 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f2eb80a33b0 0x7f2eb80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:55.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.293+0000 7f2ecbfff640 1 --2- 172.21.15.148:0/2950533759 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f2eb80a33b0 0x7f2eb80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:55.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.293+0000 7f2ed0ca1640 1 --2- 172.21.15.148:0/1900668502 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb2fa69710 0x55fb2fa69af0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4035000 tx=0x7f2ec40093e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74d434c25c5a11c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:55.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.293+0000 7f2ec97fa640 1 -- 172.21.15.148:0/2950533759 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f2eb40d00b0 con 0x7f2ecc103710 2024-09-19T07:12:55.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.293+0000 7f2ec27fc640 1 -- 172.21.15.148:0/1900668502 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec4034040 con 0x55fb2fa69710 2024-09-19T07:12:55.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.293+0000 7f2ec27fc640 1 -- 172.21.15.148:0/1900668502 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ec402f940 con 0x55fb2fa69710 2024-09-19T07:12:55.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.293+0000 7f2ec27fc640 1 -- 172.21.15.148:0/1900668502 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec40042a0 con 0x55fb2fa69710 2024-09-19T07:12:55.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.294+0000 7f2ed4add740 1 -- 172.21.15.148:0/1900668502 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb2fa69710 msgr2=0x55fb2fa69af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:55.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.294+0000 7f2ecbfff640 1 --2- 172.21.15.148:0/2950533759 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f2eb80a33b0 0x7f2eb80a5870 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc009620 tx=0x7f2ebc005f90 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:55.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.294+0000 7f2ed4add740 1 --2- 172.21.15.148:0/1900668502 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb2fa69710 0x55fb2fa69af0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4035000 tx=0x7f2ec40093e0 comp rx=0 tx=0).stop 2024-09-19T07:12:55.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.294+0000 7f2ed4add740 1 -- 172.21.15.148:0/1900668502 shutdown_connections 2024-09-19T07:12:55.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.294+0000 7f2ed4add740 1 --2- 172.21.15.148:0/1900668502 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb2fa78e40 0x55fb2fa7b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:55.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.294+0000 7f2ed4add740 1 --2- 172.21.15.148:0/1900668502 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb2fa6a030 0x55fb2fa78900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:55.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.294+0000 7f2ed4add740 1 --2- 172.21.15.148:0/1900668502 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb2fa69710 0x55fb2fa69af0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:55.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.294+0000 7f2ed4add740 1 -- 172.21.15.148:0/1900668502 >> 172.21.15.148:0/1900668502 conn(0x55fb2fa65de0 msgr2=0x55fb2fa661c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:55.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.294+0000 7f2ed4add740 1 -- 172.21.15.148:0/1900668502 shutdown_connections 2024-09-19T07:12:55.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.294+0000 7f2ed4add740 1 -- 172.21.15.148:0/1900668502 wait complete. 2024-09-19T07:12:55.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.294+0000 7f2ed4add740 1 -- start start 2024-09-19T07:12:55.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.295+0000 7f2ed4add740 1 Processor -- start 2024-09-19T07:12:55.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.295+0000 7f2ed4add740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb2fa69710 0x55fb2fa75dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:55.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.295+0000 7f2ed4add740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb2fa6a030 0x55fb2fa76300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:55.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.295+0000 7f2ed4add740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb2fa78e40 0x55fb2fa76840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:55.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.295+0000 7f2ed4add740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55fb2fa7b9b0 con 0x55fb2fa6a030 2024-09-19T07:12:55.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.295+0000 7f2ed4add740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55fb2f956900 con 0x55fb2fa69710 2024-09-19T07:12:55.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.295+0000 7f2ed4add740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55fb2fa7bb30 con 0x55fb2fa78e40 2024-09-19T07:12:55.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.295+0000 7f2ed4add740 10 client.0 _ll_register_callbacks cb 0x55fb2f954780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:12:55.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.295+0000 7f2ecb7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb2fa6a030 0x55fb2fa76300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:55.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.295+0000 7f2ed0ca1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb2fa78e40 0x55fb2fa76840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:55.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.295+0000 7f2ecb7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb2fa6a030 0x55fb2fa76300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50612/0 (socket says 172.21.15.148:50612) 2024-09-19T07:12:55.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.295+0000 7f2ecb7fe640 1 -- 172.21.15.148:0/1230175686 learned_addr learned my addr 172.21.15.148:0/1230175686 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:55.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.295+0000 7f2ecbfff640 1 --2- 172.21.15.148:0/1230175686 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb2fa69710 0x55fb2fa75dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:55.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.295+0000 7f2ecb7fe640 1 -- 172.21.15.148:0/1230175686 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb2fa78e40 msgr2=0x55fb2fa76840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:55.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.295+0000 7f2ecb7fe640 1 --2- 172.21.15.148:0/1230175686 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb2fa78e40 0x55fb2fa76840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:55.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.295+0000 7f2ecb7fe640 1 -- 172.21.15.148:0/1230175686 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb2fa69710 msgr2=0x55fb2fa75dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:55.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.295+0000 7f2ecb7fe640 1 --2- 172.21.15.148:0/1230175686 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb2fa69710 0x55fb2fa75dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:55.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.295+0000 7f2ecb7fe640 1 -- 172.21.15.148:0/1230175686 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb2f996c50 con 0x55fb2fa6a030 2024-09-19T07:12:55.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.295+0000 7f2ed0ca1640 1 --2- 172.21.15.148:0/1230175686 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb2fa78e40 0x55fb2fa76840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:12:55.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.295+0000 7f2ecb7fe640 1 --2- 172.21.15.148:0/1230175686 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb2fa6a030 0x55fb2fa76300 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f2eb400c6a0 tx=0x7f2eb40d36d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32e047a4f97edc2e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:55.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.295+0000 7f2eab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:12:55.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.296+0000 7f2eab7fe640 1 -- 172.21.15.148:0/1230175686 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb409c220 con 0x55fb2fa6a030 2024-09-19T07:12:55.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.296+0000 7f2eab7fe640 1 -- 172.21.15.148:0/1230175686 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f2eb40cda90 con 0x55fb2fa6a030 2024-09-19T07:12:55.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.296+0000 7f2ed4add740 1 -- 172.21.15.148:0/1230175686 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ec402f940 con 0x55fb2fa6a030 2024-09-19T07:12:55.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.296+0000 7f2eab7fe640 1 -- 172.21.15.148:0/1230175686 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2eb409bdb0 con 0x55fb2fa6a030 2024-09-19T07:12:55.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.296+0000 7f2ed4add740 10 client.15924 fetch_fsmap learned FSMap version 25 2024-09-19T07:12:55.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.296+0000 7f2ed4add740 1 -- 172.21.15.148:0/1230175686 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55fb2fa87720 con 0x55fb2fa6a030 2024-09-19T07:12:55.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.296+0000 7f2eab7fe640 1 -- 172.21.15.148:0/1230175686 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ec402f940 con 0x55fb2fa6a030 2024-09-19T07:12:55.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.296+0000 7f2eab7fe640 1 -- 172.21.15.148:0/1230175686 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2eb40d2070 con 0x55fb2fa6a030 2024-09-19T07:12:55.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.296+0000 7f2ed4add740 10 client.15924 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:12:55.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.296+0000 7f2ed4add740 10 client.15924 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:12:55.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.296+0000 7f2ed4add740 20 client.15924 populate_metadata read hostname 'smithi148' 2024-09-19T07:12:55.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.296+0000 7f2ed4add740 1 --2- 172.21.15.148:0/1230175686 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55fb2fa88c30 0x55fb2fa8b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:55.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.296+0000 7f2ed4add740 4 client.15924 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:12:55.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.296+0000 7f2ed4add740 1 -- 172.21.15.148:0/1230175686 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fb2f9db890 con 0x55fb2fa88c30 2024-09-19T07:12:55.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.296+0000 7f2ecbfff640 1 --2- 172.21.15.148:0/1230175686 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55fb2fa88c30 0x55fb2fa8b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:55.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.297+0000 7f2ecbfff640 1 --2- 172.21.15.148:0/1230175686 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55fb2fa88c30 0x55fb2fa8b020 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46d146da0fc15841 server_cookie=76b69cc84305ad79 in_seq=0 out_seq=0 2024-09-19T07:12:55.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.297+0000 7f2eab7fe640 10 client.15924 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:55.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.298+0000 7f2eab7fe640 1 -- 172.21.15.148:0/1230175686 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fb2f9db890 con 0x55fb2fa88c30 2024-09-19T07:12:55.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.298+0000 7f2eab7fe640 10 client.15924 handle_command_reply: tid=0 2024-09-19T07:12:55.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.298+0000 7f2ed4add740 1 client.15924 shutdown 2024-09-19T07:12:55.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.298+0000 7f2ed4add740 1 -- 172.21.15.148:0/1230175686 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb2fa6a030 msgr2=0x55fb2fa76300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:55.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.298+0000 7f2ed4add740 1 --2- 172.21.15.148:0/1230175686 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb2fa6a030 0x55fb2fa76300 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f2eb400c6a0 tx=0x7f2eb40d36d0 comp rx=0 tx=0).stop 2024-09-19T07:12:55.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.298+0000 7f2ed4add740 1 -- 172.21.15.148:0/1230175686 shutdown_connections 2024-09-19T07:12:55.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.298+0000 7f2ed4add740 1 --2- 172.21.15.148:0/1230175686 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55fb2fa88c30 0x55fb2fa8b020 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:55.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.298+0000 7f2eab7fe640 0 client.15924 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:55.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.298+0000 7f2ed4add740 1 --2- 172.21.15.148:0/1230175686 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb2fa78e40 0x55fb2fa76840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:55.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.298+0000 7f2ed4add740 1 --2- 172.21.15.148:0/1230175686 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb2fa6a030 0x55fb2fa76300 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:55.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.298+0000 7f2ed4add740 1 --2- 172.21.15.148:0/1230175686 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb2fa69710 0x55fb2fa75dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:55.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.298+0000 7f2ed4add740 1 -- 172.21.15.148:0/1230175686 >> 172.21.15.148:0/1230175686 conn(0x55fb2fa65de0 msgr2=0x55fb2fa6bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:55.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.298+0000 7f2ed4add740 1 -- 172.21.15.148:0/1230175686 shutdown_connections 2024-09-19T07:12:55.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.298+0000 7f2ed4add740 1 -- 172.21.15.148:0/1230175686 wait complete. 2024-09-19T07:12:55.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.299+0000 7f2ed4add740 20 client.15924 trim_cache size 0 max 16384 2024-09-19T07:12:55.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.315+0000 7f2ed4add740 1 Processor -- start 2024-09-19T07:12:55.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.315+0000 7f2ed4add740 1 -- start start 2024-09-19T07:12:55.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.315+0000 7f2ed4add740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb2fa69710 0x55fb2fa908d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:55.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.315+0000 7f2ed4add740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb2fa6a030 0x55fb2fa90e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:55.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.315+0000 7f2ed4add740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb2fa78e40 0x55fb2fa6b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:55.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.316+0000 7f2ed4add740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2ecc1adf20 con 0x55fb2fa69710 2024-09-19T07:12:55.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.316+0000 7f2ed4add740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2ecc1ab7f0 con 0x55fb2fa78e40 2024-09-19T07:12:55.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.316+0000 7f2ed4add740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2ecc1a9620 con 0x55fb2fa6a030 2024-09-19T07:12:55.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.316+0000 7f2ecbfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb2fa69710 0x55fb2fa908d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:55.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.316+0000 7f2ecbfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb2fa69710 0x55fb2fa908d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50616/0 (socket says 172.21.15.148:50616) 2024-09-19T07:12:55.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.316+0000 7f2ecbfff640 1 -- 172.21.15.148:0/43965026 learned_addr learned my addr 172.21.15.148:0/43965026 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:55.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.316+0000 7f2ecb7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb2fa6a030 0x55fb2fa90e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:55.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.316+0000 7f2ed0ca1640 1 --2- 172.21.15.148:0/43965026 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb2fa78e40 0x55fb2fa6b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:55.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.316+0000 7f2ecbfff640 1 -- 172.21.15.148:0/43965026 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb2fa6a030 msgr2=0x55fb2fa90e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:55.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.316+0000 7f2ecbfff640 1 --2- 172.21.15.148:0/43965026 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb2fa6a030 0x55fb2fa90e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:55.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.316+0000 7f2ecbfff640 1 -- 172.21.15.148:0/43965026 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb2fa78e40 msgr2=0x55fb2fa6b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:55.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.316+0000 7f2ecbfff640 1 --2- 172.21.15.148:0/43965026 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb2fa78e40 0x55fb2fa6b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:55.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.316+0000 7f2ecbfff640 1 -- 172.21.15.148:0/43965026 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb2fa8b390 con 0x55fb2fa69710 2024-09-19T07:12:55.319 INFO:tasks.workunit.client.0.smithi148.stdout:config.status: executing depfiles commands 2024-09-19T07:12:55.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.316+0000 7f2ecb7fe640 1 --2- 172.21.15.148:0/43965026 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb2fa6a030 0x55fb2fa90e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:12:55.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.316+0000 7f2ed0ca1640 1 --2- 172.21.15.148:0/43965026 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb2fa78e40 0x55fb2fa6b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:12:55.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.316+0000 7f2ecbfff640 1 --2- 172.21.15.148:0/43965026 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb2fa69710 0x55fb2fa908d0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc009c70 tx=0x7f2ebc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a015dcf3768b5ff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:55.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.316+0000 7f2ec1ffb640 1 -- 172.21.15.148:0/43965026 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc003af0 con 0x55fb2fa69710 2024-09-19T07:12:55.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.316+0000 7f2ec1ffb640 1 -- 172.21.15.148:0/43965026 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ebc005500 con 0x55fb2fa69710 2024-09-19T07:12:55.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.316+0000 7f2ec1ffb640 1 -- 172.21.15.148:0/43965026 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc02b430 con 0x55fb2fa69710 2024-09-19T07:12:55.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.317+0000 7f2ed4add740 1 -- 172.21.15.148:0/43965026 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb2fa69710 msgr2=0x55fb2fa908d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:55.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.317+0000 7f2ed4add740 1 --2- 172.21.15.148:0/43965026 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb2fa69710 0x55fb2fa908d0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc009c70 tx=0x7f2ebc017000 comp rx=0 tx=0).stop 2024-09-19T07:12:55.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.317+0000 7f2ed4add740 1 -- 172.21.15.148:0/43965026 shutdown_connections 2024-09-19T07:12:55.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.317+0000 7f2ed4add740 1 --2- 172.21.15.148:0/43965026 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb2fa78e40 0x55fb2fa6b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:55.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.317+0000 7f2ed4add740 1 --2- 172.21.15.148:0/43965026 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb2fa6a030 0x55fb2fa90e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:55.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.317+0000 7f2ed4add740 1 --2- 172.21.15.148:0/43965026 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb2fa69710 0x55fb2fa908d0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:55.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.317+0000 7f2ed4add740 1 -- 172.21.15.148:0/43965026 >> 172.21.15.148:0/43965026 conn(0x55fb2fa65de0 msgr2=0x55fb2fa74ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:55.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.317+0000 7f2ed4add740 1 -- 172.21.15.148:0/43965026 shutdown_connections 2024-09-19T07:12:55.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.317+0000 7f2ed4add740 1 -- 172.21.15.148:0/43965026 wait complete. 2024-09-19T07:12:55.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.318+0000 7f2ed4add740 1 -- start start 2024-09-19T07:12:55.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.318+0000 7f2ed4add740 1 Processor -- start 2024-09-19T07:12:55.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.318+0000 7f2ed4add740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb2fa69710 0x55fb2fa72de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:55.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.318+0000 7f2ed4add740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb2fa6a030 0x55fb2fa73320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:55.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.318+0000 7f2ed4add740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb2fa78e40 0x55fb2fa73860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:55.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.318+0000 7f2ed4add740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2ecc1a9cb0 con 0x55fb2fa69710 2024-09-19T07:12:55.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.318+0000 7f2ed4add740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2ecc1ab120 con 0x55fb2fa6a030 2024-09-19T07:12:55.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.318+0000 7f2ed4add740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2ecc1aa380 con 0x55fb2fa78e40 2024-09-19T07:12:55.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.318+0000 7f2ed4add740 10 client.0 _ll_register_callbacks cb 0x7f2eb40d3890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:12:55.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.318+0000 7f2ecbfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb2fa69710 0x55fb2fa72de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:55.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.318+0000 7f2ecbfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb2fa69710 0x55fb2fa72de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50620/0 (socket says 172.21.15.148:50620) 2024-09-19T07:12:55.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.318+0000 7f2ecbfff640 1 -- 172.21.15.148:0/4264973119 learned_addr learned my addr 172.21.15.148:0/4264973119 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:55.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.319+0000 7f2ecb7fe640 1 --2- 172.21.15.148:0/4264973119 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb2fa6a030 0x55fb2fa73320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:55.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.319+0000 7f2ed0ca1640 1 --2- 172.21.15.148:0/4264973119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb2fa78e40 0x55fb2fa73860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:55.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.319+0000 7f2ecbfff640 1 -- 172.21.15.148:0/4264973119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb2fa78e40 msgr2=0x55fb2fa73860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:55.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.319+0000 7f2ecbfff640 1 --2- 172.21.15.148:0/4264973119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb2fa78e40 0x55fb2fa73860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:55.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.319+0000 7f2ecbfff640 1 -- 172.21.15.148:0/4264973119 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb2fa6a030 msgr2=0x55fb2fa73320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:55.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.319+0000 7f2ecbfff640 1 --2- 172.21.15.148:0/4264973119 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb2fa6a030 0x55fb2fa73320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:55.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.319+0000 7f2ecbfff640 1 -- 172.21.15.148:0/4264973119 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb2faf28a0 con 0x55fb2fa69710 2024-09-19T07:12:55.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.319+0000 7f2ecbfff640 1 --2- 172.21.15.148:0/4264973119 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb2fa69710 0x55fb2fa72de0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc0039c0 tx=0x7f2ebc005730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7ff20987d70e3a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:55.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.319+0000 7f2eab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:12:55.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.319+0000 7f2eab7fe640 1 -- 172.21.15.148:0/4264973119 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc003cf0 con 0x55fb2fa69710 2024-09-19T07:12:55.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.319+0000 7f2eab7fe640 1 -- 172.21.15.148:0/4264973119 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f2ebc004bf0 con 0x55fb2fa69710 2024-09-19T07:12:55.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.319+0000 7f2ed4add740 1 -- 172.21.15.148:0/4264973119 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ebc005500 con 0x55fb2fa69710 2024-09-19T07:12:55.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.319+0000 7f2eab7fe640 1 -- 172.21.15.148:0/4264973119 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2ebc004df0 con 0x55fb2fa69710 2024-09-19T07:12:55.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.319+0000 7f2ed4add740 10 client.15930 fetch_fsmap learned FSMap version 25 2024-09-19T07:12:55.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.319+0000 7f2ed4add740 1 -- 172.21.15.148:0/4264973119 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55fb2faf3b40 con 0x55fb2fa69710 2024-09-19T07:12:55.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.320+0000 7f2eab7fe640 1 -- 172.21.15.148:0/4264973119 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ebc005500 con 0x55fb2fa69710 2024-09-19T07:12:55.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.320+0000 7f2eab7fe640 1 -- 172.21.15.148:0/4264973119 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2ebc02ba00 con 0x55fb2fa69710 2024-09-19T07:12:55.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.320+0000 7f2ed4add740 10 client.15930 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:12:55.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.320+0000 7f2ed4add740 10 client.15930 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:12:55.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.320+0000 7f2ed4add740 20 client.15930 populate_metadata read hostname 'smithi148' 2024-09-19T07:12:55.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.320+0000 7f2ed4add740 1 --2- 172.21.15.148:0/4264973119 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55fb2fa88c30 0x55fb2faf6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:55.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.320+0000 7f2ed4add740 4 client.15930 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}] 2024-09-19T07:12:55.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.320+0000 7f2ed4add740 1 -- 172.21.15.148:0/4264973119 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}) -- 0x55fb2f9d5be0 con 0x55fb2fa88c30 2024-09-19T07:12:55.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.320+0000 7f2ecb7fe640 1 --2- 172.21.15.148:0/4264973119 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55fb2fa88c30 0x55fb2faf6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:55.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.320+0000 7f2ecb7fe640 1 --2- 172.21.15.148:0/4264973119 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55fb2fa88c30 0x55fb2faf6250 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6fb9321810564a8 server_cookie=e0f39b07aec35f8c in_seq=0 out_seq=0 2024-09-19T07:12:55.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.320+0000 7f2eab7fe640 10 client.15930 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:55.382 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:12:55.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.398+0000 7f2eab7fe640 1 -- 172.21.15.148:0/4264973119 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55fb2f9d5be0 con 0x55fb2fa88c30 2024-09-19T07:12:55.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.398+0000 7f2eab7fe640 10 client.15930 handle_command_reply: tid=0 2024-09-19T07:12:55.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.398+0000 7f2ed4add740 1 client.15930 shutdown 2024-09-19T07:12:55.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.398+0000 7f2ed4add740 1 -- 172.21.15.148:0/4264973119 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb2fa69710 msgr2=0x55fb2fa72de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:55.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.398+0000 7f2ed4add740 1 --2- 172.21.15.148:0/4264973119 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb2fa69710 0x55fb2fa72de0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc0039c0 tx=0x7f2ebc005730 comp rx=0 tx=0).stop 2024-09-19T07:12:55.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.398+0000 7f2ed4add740 1 -- 172.21.15.148:0/4264973119 shutdown_connections 2024-09-19T07:12:55.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.399+0000 7f2ed4add740 1 --2- 172.21.15.148:0/4264973119 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55fb2fa88c30 0x55fb2faf6250 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:55.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.399+0000 7f2ed4add740 1 --2- 172.21.15.148:0/4264973119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb2fa78e40 0x55fb2fa73860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:55.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.399+0000 7f2ed4add740 1 --2- 172.21.15.148:0/4264973119 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb2fa6a030 0x55fb2fa73320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:55.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.399+0000 7f2ed4add740 1 --2- 172.21.15.148:0/4264973119 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb2fa69710 0x55fb2fa72de0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:55.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.399+0000 7f2eab7fe640 0 client.15930 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:55.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.399+0000 7f2ed4add740 1 -- 172.21.15.148:0/4264973119 >> 172.21.15.148:0/4264973119 conn(0x55fb2fa65de0 msgr2=0x55fb2fa77620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:55.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.399+0000 7f2ed4add740 1 -- 172.21.15.148:0/4264973119 shutdown_connections 2024-09-19T07:12:55.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.399+0000 7f2ed4add740 1 -- 172.21.15.148:0/4264973119 wait complete. 2024-09-19T07:12:55.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.399+0000 7f2ed4add740 20 client.15930 trim_cache size 0 max 16384 2024-09-19T07:12:55.401 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:12:55.401 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 25, 2024-09-19T07:12:55.401 INFO:teuthology.orchestra.run.smithi148.stdout: "leader": 24457, 2024-09-19T07:12:55.402 INFO:teuthology.orchestra.run.smithi148.stdout: "set_version": 10, 2024-09-19T07:12:55.402 INFO:teuthology.orchestra.run.smithi148.stdout: "sets": { 2024-09-19T07:12:55.402 INFO:teuthology.orchestra.run.smithi148.stdout: "c09a2bc7": { 2024-09-19T07:12:55.402 INFO:teuthology.orchestra.run.smithi148.stdout: "version": 10, 2024-09-19T07:12:55.402 INFO:teuthology.orchestra.run.smithi148.stdout: "age_ref": 0.0, 2024-09-19T07:12:55.402 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:12:55.402 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "QUIESCED", 2024-09-19T07:12:55.402 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:12:55.402 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:12:55.402 INFO:teuthology.orchestra.run.smithi148.stdout: "timeout": 90.0, 2024-09-19T07:12:55.402 INFO:teuthology.orchestra.run.smithi148.stdout: "expiration": 140.3, 2024-09-19T07:12:55.402 INFO:teuthology.orchestra.run.smithi148.stdout: "members": { 2024-09-19T07:12:55.402 INFO:teuthology.orchestra.run.smithi148.stdout: "file:/": { 2024-09-19T07:12:55.402 INFO:teuthology.orchestra.run.smithi148.stdout: "excluded": false, 2024-09-19T07:12:55.403 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:12:55.403 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "QUIESCED", 2024-09-19T07:12:55.403 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:12:55.403 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:12:55.403 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:12:55.403 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:12:55.403 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:12:55.403 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:12:55.403 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:12:55.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.399+0000 7f2ed2704640 1 -- 172.21.15.148:0/2950533759 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f2eb80a33b0 msgr2=0x7f2eb80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:55.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.399+0000 7f2ed2704640 1 --2- 172.21.15.148:0/2950533759 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f2eb80a33b0 0x7f2eb80a5870 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc009620 tx=0x7f2ebc005f90 comp rx=0 tx=0).stop 2024-09-19T07:12:55.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.399+0000 7f2ed2704640 1 -- 172.21.15.148:0/2950533759 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ecc103710 msgr2=0x7f2ecc198900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:55.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.399+0000 7f2ed2704640 1 --2- 172.21.15.148:0/2950533759 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ecc103710 0x7f2ecc198900 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2eb400e9f0 tx=0x7f2eb400eeb0 comp rx=0 tx=0).stop 2024-09-19T07:12:55.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.400+0000 7f2ed2704640 1 -- 172.21.15.148:0/2950533759 shutdown_connections 2024-09-19T07:12:55.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.400+0000 7f2ed2704640 1 --2- 172.21.15.148:0/2950533759 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f2eb80a33b0 0x7f2eb80a5870 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:55.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.400+0000 7f2ed2704640 1 --2- 172.21.15.148:0/2950533759 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2ecc10c190 0x7f2ecc19cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:55.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.400+0000 7f2ed2704640 1 --2- 172.21.15.148:0/2950533759 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ecc103710 0x7f2ecc198900 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:55.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.400+0000 7f2ed2704640 1 --2- 172.21.15.148:0/2950533759 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ecc102df0 0x7f2ecc1983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:55.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.400+0000 7f2ed2704640 1 -- 172.21.15.148:0/2950533759 >> 172.21.15.148:0/2950533759 conn(0x7f2ecc0fc7d0 msgr2=0x7f2ecc0fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:55.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.400+0000 7f2ed2704640 1 -- 172.21.15.148:0/2950533759 shutdown_connections 2024-09-19T07:12:55.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:55.400+0000 7f2ed2704640 1 -- 172.21.15.148:0/2950533759 wait complete. 2024-09-19T07:12:56.454 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'c09a2bc7', quiesce took 7.1 seconds. Will release after: 13.250000000000002 2024-09-19T07:12:56.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:56 smithi179 ceph-mon[35716]: pgmap v59: 97 pgs: 97 active+clean; 4.2 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 286 KiB/s wr, 40 op/s 2024-09-19T07:12:56.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:56 smithi148 ceph-mon[31180]: pgmap v59: 97 pgs: 97 active+clean; 4.2 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 286 KiB/s wr, 40 op/s 2024-09-19T07:12:56.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.624+0000 7fc4217a5640 1 -- 172.21.15.148:0/1200335884 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc41c102ef0 msgr2=0x7fc41c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:56.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.624+0000 7fc4217a5640 1 --2- 172.21.15.148:0/1200335884 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc41c102ef0 0x7fc41c10da40 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fc414009ca0 tx=0x7fc41402a950 comp rx=0 tx=0).stop 2024-09-19T07:12:56.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.624+0000 7fc4217a5640 1 -- 172.21.15.148:0/1200335884 shutdown_connections 2024-09-19T07:12:56.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.624+0000 7fc4217a5640 1 --2- 172.21.15.148:0/1200335884 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc41c102ef0 0x7fc41c10da40 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:56.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.624+0000 7fc4217a5640 1 --2- 172.21.15.148:0/1200335884 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc41c102570 0x7fc41c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:56.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.624+0000 7fc4217a5640 1 --2- 172.21.15.148:0/1200335884 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc41c100e20 0x7fc41c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:56.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.624+0000 7fc4217a5640 1 -- 172.21.15.148:0/1200335884 >> 172.21.15.148:0/1200335884 conn(0x7fc41c0fc7d0 msgr2=0x7fc41c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:56.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.624+0000 7fc4217a5640 1 -- 172.21.15.148:0/1200335884 shutdown_connections 2024-09-19T07:12:56.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.624+0000 7fc4217a5640 1 -- 172.21.15.148:0/1200335884 wait complete. 2024-09-19T07:12:56.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.625+0000 7fc4217a5640 1 Processor -- start 2024-09-19T07:12:56.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.625+0000 7fc4217a5640 1 -- start start 2024-09-19T07:12:56.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.625+0000 7fc4217a5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc41c100e20 0x7fc41c197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:56.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.625+0000 7fc4217a5640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc41c102570 0x7fc41c197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:56.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.625+0000 7fc4217a5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc41c102ef0 0x7fc41c19bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:56.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.625+0000 7fc4217a5640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc41c110f80 con 0x7fc41c100e20 2024-09-19T07:12:56.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.625+0000 7fc4217a5640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc41c110e00 con 0x7fc41c102570 2024-09-19T07:12:56.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.625+0000 7fc4217a5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc41c111100 con 0x7fc41c102ef0 2024-09-19T07:12:56.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.625+0000 7fc41affd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc41c100e20 0x7fc41c197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:56.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.625+0000 7fc41affd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc41c100e20 0x7fc41c197300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50626/0 (socket says 172.21.15.148:50626) 2024-09-19T07:12:56.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.625+0000 7fc41affd640 1 -- 172.21.15.148:0/1848702937 learned_addr learned my addr 172.21.15.148:0/1848702937 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:56.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.625+0000 7fc41b7fe640 1 --2- 172.21.15.148:0/1848702937 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc41c102ef0 0x7fc41c19bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:56.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.625+0000 7fc413fff640 1 --2- 172.21.15.148:0/1848702937 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc41c102570 0x7fc41c197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:56.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.625+0000 7fc41affd640 1 -- 172.21.15.148:0/1848702937 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc41c102ef0 msgr2=0x7fc41c19bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:56.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.625+0000 7fc41affd640 1 --2- 172.21.15.148:0/1848702937 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc41c102ef0 0x7fc41c19bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:56.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.625+0000 7fc41affd640 1 -- 172.21.15.148:0/1848702937 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc41c102570 msgr2=0x7fc41c197840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:56.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.625+0000 7fc41affd640 1 --2- 172.21.15.148:0/1848702937 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc41c102570 0x7fc41c197840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:56.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.625+0000 7fc41affd640 1 -- 172.21.15.148:0/1848702937 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc41c19c2b0 con 0x7fc41c100e20 2024-09-19T07:12:56.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.625+0000 7fc413fff640 1 --2- 172.21.15.148:0/1848702937 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc41c102570 0x7fc41c197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:12:56.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.625+0000 7fc41affd640 1 --2- 172.21.15.148:0/1848702937 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc41c100e20 0x7fc41c197300 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc40c00e9f0 tx=0x7fc40c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:56.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.626+0000 7fc418ff9640 1 -- 172.21.15.148:0/1848702937 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40c00cd80 con 0x7fc41c100e20 2024-09-19T07:12:56.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.626+0000 7fc418ff9640 1 -- 172.21.15.148:0/1848702937 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc40c010910 con 0x7fc41c100e20 2024-09-19T07:12:56.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.626+0000 7fc4217a5640 1 -- 172.21.15.148:0/1848702937 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc41c19c5a0 con 0x7fc41c100e20 2024-09-19T07:12:56.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.626+0000 7fc418ff9640 1 -- 172.21.15.148:0/1848702937 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40c018990 con 0x7fc41c100e20 2024-09-19T07:12:56.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.626+0000 7fc4217a5640 1 -- 172.21.15.148:0/1848702937 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc41c1a3e80 con 0x7fc41c100e20 2024-09-19T07:12:56.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.628+0000 7fc418ff9640 1 -- 172.21.15.148:0/1848702937 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fc40c010ac0 con 0x7fc41c100e20 2024-09-19T07:12:56.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.628+0000 7fc423b7e740 1 Processor -- start 2024-09-19T07:12:56.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.628+0000 7fc423b7e740 1 -- start start 2024-09-19T07:12:56.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.629+0000 7fc423b7e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cadec6b40 0x558cadec5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:56.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.629+0000 7fc423b7e740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558cadec55d0 0x558cadec5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:56.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.629+0000 7fc423b7e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558caded2580 0x558caded4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:56.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.629+0000 7fc423b7e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x558cade2b2f0 con 0x558cadec6b40 2024-09-19T07:12:56.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.629+0000 7fc423b7e740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x558caddd2cf0 con 0x558cadec55d0 2024-09-19T07:12:56.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.629+0000 7fc423b7e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x558cade272b0 con 0x558caded2580 2024-09-19T07:12:56.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.629+0000 7fc41b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cadec6b40 0x558cadec5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:56.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.629+0000 7fc41b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cadec6b40 0x558cadec5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50636/0 (socket says 172.21.15.148:50636) 2024-09-19T07:12:56.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.629+0000 7fc41b7fe640 1 -- 172.21.15.148:0/4199841577 learned_addr learned my addr 172.21.15.148:0/4199841577 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:56.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.629+0000 7fc413fff640 1 --2- 172.21.15.148:0/4199841577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558caded2580 0x558caded4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:56.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.629+0000 7fc418ff9640 1 --2- 172.21.15.148:0/1848702937 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc4080a33b0 0x7fc4080a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:56.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.629+0000 7fc41affd640 1 --2- 172.21.15.148:0/4199841577 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558cadec55d0 0x558cadec5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:56.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.629+0000 7fc41b7fe640 1 -- 172.21.15.148:0/4199841577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558caded2580 msgr2=0x558caded4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:56.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.629+0000 7fc41b7fe640 1 --2- 172.21.15.148:0/4199841577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558caded2580 0x558caded4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:56.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.629+0000 7fc41b7fe640 1 -- 172.21.15.148:0/4199841577 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558cadec55d0 msgr2=0x558cadec5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:56.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.629+0000 7fc41b7fe640 1 --2- 172.21.15.148:0/4199841577 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558cadec55d0 0x558cadec5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:56.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.629+0000 7fc41b7fe640 1 -- 172.21.15.148:0/4199841577 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558caddb73a0 con 0x558cadec6b40 2024-09-19T07:12:56.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.629+0000 7fc41affd640 1 --2- 172.21.15.148:0/4199841577 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558cadec55d0 0x558cadec5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:12:56.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.629+0000 7fc418ff9640 1 -- 172.21.15.148:0/1848702937 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fc40c0d00d0 con 0x7fc41c100e20 2024-09-19T07:12:56.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.629+0000 7fc41b7fe640 1 --2- 172.21.15.148:0/1848702937 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc4080a33b0 0x7fc4080a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:56.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.629+0000 7fc41b7fe640 1 --2- 172.21.15.148:0/4199841577 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cadec6b40 0x558cadec5090 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fc414035000 tx=0x7fc4140098f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b3b50de79890277 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:56.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.629+0000 7fc4117fa640 1 -- 172.21.15.148:0/4199841577 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc414034040 con 0x558cadec6b40 2024-09-19T07:12:56.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.630+0000 7fc4117fa640 1 -- 172.21.15.148:0/4199841577 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc414003cb0 con 0x558cadec6b40 2024-09-19T07:12:56.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.630+0000 7fc4117fa640 1 -- 172.21.15.148:0/4199841577 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc414046770 con 0x558cadec6b40 2024-09-19T07:12:56.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.630+0000 7fc41b7fe640 1 --2- 172.21.15.148:0/1848702937 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc4080a33b0 0x7fc4080a5870 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc41404d000 tx=0x7fc41404a000 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:56.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.630+0000 7fc423b7e740 1 -- 172.21.15.148:0/4199841577 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cadec6b40 msgr2=0x558cadec5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:56.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.630+0000 7fc423b7e740 1 --2- 172.21.15.148:0/4199841577 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cadec6b40 0x558cadec5090 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fc414035000 tx=0x7fc4140098f0 comp rx=0 tx=0).stop 2024-09-19T07:12:56.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.630+0000 7fc423b7e740 1 -- 172.21.15.148:0/4199841577 shutdown_connections 2024-09-19T07:12:56.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.630+0000 7fc423b7e740 1 --2- 172.21.15.148:0/4199841577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558caded2580 0x558caded4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:56.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.630+0000 7fc423b7e740 1 --2- 172.21.15.148:0/4199841577 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558cadec55d0 0x558cadec5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:56.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.630+0000 7fc423b7e740 1 --2- 172.21.15.148:0/4199841577 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cadec6b40 0x558cadec5090 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:56.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.630+0000 7fc423b7e740 1 -- 172.21.15.148:0/4199841577 >> 172.21.15.148:0/4199841577 conn(0x558cade8e310 msgr2=0x558cadec1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:56.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.630+0000 7fc423b7e740 1 -- 172.21.15.148:0/4199841577 shutdown_connections 2024-09-19T07:12:56.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.630+0000 7fc423b7e740 1 -- 172.21.15.148:0/4199841577 wait complete. 2024-09-19T07:12:56.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.631+0000 7fc423b7e740 1 -- start start 2024-09-19T07:12:56.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.631+0000 7fc423b7e740 1 Processor -- start 2024-09-19T07:12:56.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.631+0000 7fc423b7e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558cadec55d0 0x558caded1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:56.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.631+0000 7fc423b7e740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558cadec6b40 0x558cadecf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:56.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.631+0000 7fc423b7e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558caded2580 0x558cadecf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:56.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.631+0000 7fc423b7e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x558caded5280 con 0x558caded2580 2024-09-19T07:12:56.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.631+0000 7fc423b7e740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x558cadde6060 con 0x558cadec6b40 2024-09-19T07:12:56.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.631+0000 7fc423b7e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x558caded5400 con 0x558cadec55d0 2024-09-19T07:12:56.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.631+0000 7fc423b7e740 10 client.0 _ll_register_callbacks cb 0x558cadb398c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:12:56.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.631+0000 7fc41b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558caded2580 0x558cadecf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:56.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.631+0000 7fc41b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558caded2580 0x558cadecf7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50638/0 (socket says 172.21.15.148:50638) 2024-09-19T07:12:56.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.631+0000 7fc41b7fe640 1 -- 172.21.15.148:0/3581882890 learned_addr learned my addr 172.21.15.148:0/3581882890 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:56.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.631+0000 7fc41affd640 1 --2- 172.21.15.148:0/3581882890 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558cadec55d0 0x558caded1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:56.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.631+0000 7fc413fff640 1 --2- 172.21.15.148:0/3581882890 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558cadec6b40 0x558cadecf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:56.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.632+0000 7fc41b7fe640 1 -- 172.21.15.148:0/3581882890 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558cadec55d0 msgr2=0x558caded1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:56.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.632+0000 7fc41b7fe640 1 --2- 172.21.15.148:0/3581882890 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558cadec55d0 0x558caded1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:56.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.632+0000 7fc41b7fe640 1 -- 172.21.15.148:0/3581882890 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558cadec6b40 msgr2=0x558cadecf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:56.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.632+0000 7fc41b7fe640 1 --2- 172.21.15.148:0/3581882890 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558cadec6b40 0x558cadecf210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:56.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.632+0000 7fc41b7fe640 1 -- 172.21.15.148:0/3581882890 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558cadb9c3c0 con 0x558caded2580 2024-09-19T07:12:56.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.632+0000 7fc41affd640 1 --2- 172.21.15.148:0/3581882890 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558cadec55d0 0x558caded1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:12:56.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.632+0000 7fc413fff640 1 --2- 172.21.15.148:0/3581882890 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558cadec6b40 0x558cadecf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:12:56.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.632+0000 7fc41b7fe640 1 --2- 172.21.15.148:0/3581882890 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558caded2580 0x558cadecf7e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fc414005e30 tx=0x7fc414004860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d9f845230d2d763 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:56.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.632+0000 7fc4027fc640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:12:56.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.632+0000 7fc4027fc640 1 -- 172.21.15.148:0/3581882890 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc41405a060 con 0x558caded2580 2024-09-19T07:12:56.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.632+0000 7fc4027fc640 1 -- 172.21.15.148:0/3581882890 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fc414004040 con 0x558caded2580 2024-09-19T07:12:56.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.632+0000 7fc423b7e740 1 -- 172.21.15.148:0/3581882890 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc414003cb0 con 0x558caded2580 2024-09-19T07:12:56.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.632+0000 7fc4027fc640 1 -- 172.21.15.148:0/3581882890 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc414004280 con 0x558caded2580 2024-09-19T07:12:56.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.632+0000 7fc423b7e740 10 client.15942 fetch_fsmap learned FSMap version 25 2024-09-19T07:12:56.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.632+0000 7fc423b7e740 1 -- 172.21.15.148:0/3581882890 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558caded5280 con 0x558caded2580 2024-09-19T07:12:56.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.632+0000 7fc4027fc640 1 -- 172.21.15.148:0/3581882890 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc414003cb0 con 0x558caded2580 2024-09-19T07:12:56.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.632+0000 7fc4027fc640 1 -- 172.21.15.148:0/3581882890 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc414030aa0 con 0x558caded2580 2024-09-19T07:12:56.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.632+0000 7fc423b7e740 10 client.15942 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:12:56.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.632+0000 7fc423b7e740 10 client.15942 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:12:56.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.633+0000 7fc423b7e740 20 client.15942 populate_metadata read hostname 'smithi148' 2024-09-19T07:12:56.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.633+0000 7fc423b7e740 1 --2- 172.21.15.148:0/3581882890 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x558cadee1e20 0x558cadee4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:56.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.633+0000 7fc423b7e740 4 client.15942 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:12:56.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.633+0000 7fc423b7e740 1 -- 172.21.15.148:0/3581882890 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558cade38860 con 0x558cadee1e20 2024-09-19T07:12:56.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.633+0000 7fc41affd640 1 --2- 172.21.15.148:0/3581882890 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x558cadee1e20 0x558cadee4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:56.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.633+0000 7fc4027fc640 10 client.15942 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:56.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.633+0000 7fc41affd640 1 --2- 172.21.15.148:0/3581882890 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x558cadee1e20 0x558cadee4210 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6495aa7da9b46cc server_cookie=3aefaa5aad748f0f in_seq=0 out_seq=0 2024-09-19T07:12:56.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.634+0000 7fc4027fc640 1 -- 172.21.15.148:0/3581882890 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558cade38860 con 0x558cadee1e20 2024-09-19T07:12:56.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.634+0000 7fc4027fc640 10 client.15942 handle_command_reply: tid=0 2024-09-19T07:12:56.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.634+0000 7fc423b7e740 1 client.15942 shutdown 2024-09-19T07:12:56.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.634+0000 7fc423b7e740 1 -- 172.21.15.148:0/3581882890 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558caded2580 msgr2=0x558cadecf7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:56.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.634+0000 7fc423b7e740 1 --2- 172.21.15.148:0/3581882890 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558caded2580 0x558cadecf7e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fc414005e30 tx=0x7fc414004860 comp rx=0 tx=0).stop 2024-09-19T07:12:56.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.634+0000 7fc423b7e740 1 -- 172.21.15.148:0/3581882890 shutdown_connections 2024-09-19T07:12:56.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.634+0000 7fc423b7e740 1 --2- 172.21.15.148:0/3581882890 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x558cadee1e20 0x558cadee4210 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:56.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.634+0000 7fc423b7e740 1 --2- 172.21.15.148:0/3581882890 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558caded2580 0x558cadecf7e0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:56.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.634+0000 7fc423b7e740 1 --2- 172.21.15.148:0/3581882890 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558cadec6b40 0x558cadecf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:56.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.634+0000 7fc4027fc640 0 client.15942 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:56.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.634+0000 7fc423b7e740 1 --2- 172.21.15.148:0/3581882890 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558cadec55d0 0x558caded1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:56.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.634+0000 7fc423b7e740 1 -- 172.21.15.148:0/3581882890 >> 172.21.15.148:0/3581882890 conn(0x558cade8e310 msgr2=0x558cadec7930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:56.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.634+0000 7fc423b7e740 1 -- 172.21.15.148:0/3581882890 shutdown_connections 2024-09-19T07:12:56.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.634+0000 7fc423b7e740 1 -- 172.21.15.148:0/3581882890 wait complete. 2024-09-19T07:12:56.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.634+0000 7fc423b7e740 20 client.15942 trim_cache size 0 max 16384 2024-09-19T07:12:56.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.647+0000 7fc423b7e740 1 Processor -- start 2024-09-19T07:12:56.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.647+0000 7fc423b7e740 1 -- start start 2024-09-19T07:12:56.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.647+0000 7fc423b7e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cadec55d0 0x558cadec1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:56.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.647+0000 7fc423b7e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558cadec6b40 0x558cadede550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:56.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.647+0000 7fc423b7e740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558caded2580 0x558cadee9a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:56.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.647+0000 7fc423b7e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc41c1ade40 con 0x558cadec55d0 2024-09-19T07:12:56.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.647+0000 7fc423b7e740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc41c1ab710 con 0x558caded2580 2024-09-19T07:12:56.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.647+0000 7fc423b7e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc41c1a9540 con 0x558cadec6b40 2024-09-19T07:12:56.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.647+0000 7fc41affd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cadec55d0 0x558cadec1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:56.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.647+0000 7fc41affd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cadec55d0 0x558cadec1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50644/0 (socket says 172.21.15.148:50644) 2024-09-19T07:12:56.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.647+0000 7fc41affd640 1 -- 172.21.15.148:0/1877092930 learned_addr learned my addr 172.21.15.148:0/1877092930 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:56.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.647+0000 7fc41b7fe640 1 --2- 172.21.15.148:0/1877092930 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558caded2580 0x558cadee9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:56.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.648+0000 7fc413fff640 1 --2- 172.21.15.148:0/1877092930 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558cadec6b40 0x558cadede550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:56.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.648+0000 7fc41affd640 1 -- 172.21.15.148:0/1877092930 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558cadec6b40 msgr2=0x558cadede550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:56.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.648+0000 7fc41affd640 1 --2- 172.21.15.148:0/1877092930 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558cadec6b40 0x558cadede550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:56.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.648+0000 7fc41affd640 1 -- 172.21.15.148:0/1877092930 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558caded2580 msgr2=0x558cadee9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:56.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.648+0000 7fc41affd640 1 --2- 172.21.15.148:0/1877092930 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558caded2580 0x558cadee9a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:56.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.648+0000 7fc41affd640 1 -- 172.21.15.148:0/1877092930 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cadecd760 con 0x558cadec55d0 2024-09-19T07:12:56.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.648+0000 7fc41affd640 1 --2- 172.21.15.148:0/1877092930 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cadec55d0 0x558cadec1d70 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fc40c00e9c0 tx=0x7fc40c06e200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66e29f47b50552f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:56.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.648+0000 7fc410ff9640 1 -- 172.21.15.148:0/1877092930 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40c09a6c0 con 0x558cadec55d0 2024-09-19T07:12:56.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.648+0000 7fc410ff9640 1 -- 172.21.15.148:0/1877092930 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc40c098a30 con 0x558cadec55d0 2024-09-19T07:12:56.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.648+0000 7fc410ff9640 1 -- 172.21.15.148:0/1877092930 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40c018b30 con 0x558cadec55d0 2024-09-19T07:12:56.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.649+0000 7fc423b7e740 1 -- 172.21.15.148:0/1877092930 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cadec55d0 msgr2=0x558cadec1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:56.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.649+0000 7fc423b7e740 1 --2- 172.21.15.148:0/1877092930 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cadec55d0 0x558cadec1d70 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fc40c00e9c0 tx=0x7fc40c06e200 comp rx=0 tx=0).stop 2024-09-19T07:12:56.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.649+0000 7fc423b7e740 1 -- 172.21.15.148:0/1877092930 shutdown_connections 2024-09-19T07:12:56.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.649+0000 7fc423b7e740 1 --2- 172.21.15.148:0/1877092930 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558caded2580 0x558cadee9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:56.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.649+0000 7fc423b7e740 1 --2- 172.21.15.148:0/1877092930 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558cadec6b40 0x558cadede550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:56.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.649+0000 7fc423b7e740 1 --2- 172.21.15.148:0/1877092930 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558cadec55d0 0x558cadec1d70 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:56.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.649+0000 7fc423b7e740 1 -- 172.21.15.148:0/1877092930 >> 172.21.15.148:0/1877092930 conn(0x558cade8e310 msgr2=0x558cadece300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:56.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.649+0000 7fc423b7e740 1 -- 172.21.15.148:0/1877092930 shutdown_connections 2024-09-19T07:12:56.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.649+0000 7fc423b7e740 1 -- 172.21.15.148:0/1877092930 wait complete. 2024-09-19T07:12:56.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.649+0000 7fc423b7e740 1 -- start start 2024-09-19T07:12:56.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.649+0000 7fc423b7e740 1 Processor -- start 2024-09-19T07:12:56.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.649+0000 7fc423b7e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558cadec55d0 0x558cadeda970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:56.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.649+0000 7fc423b7e740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558cadec6b40 0x558cadedaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:56.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.649+0000 7fc423b7e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558caded2580 0x558cadecbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:56.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.649+0000 7fc423b7e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc41c1a9bd0 con 0x558caded2580 2024-09-19T07:12:56.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.649+0000 7fc423b7e740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc41c1ab040 con 0x558cadec6b40 2024-09-19T07:12:56.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.649+0000 7fc423b7e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc41c1aa2a0 con 0x558cadec55d0 2024-09-19T07:12:56.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.649+0000 7fc423b7e740 10 client.0 _ll_register_callbacks cb 0x7fc404008390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:12:56.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.650+0000 7fc41b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558caded2580 0x558cadecbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:56.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.650+0000 7fc41b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558caded2580 0x558cadecbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50650/0 (socket says 172.21.15.148:50650) 2024-09-19T07:12:56.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.650+0000 7fc41b7fe640 1 -- 172.21.15.148:0/1254548024 learned_addr learned my addr 172.21.15.148:0/1254548024 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:56.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.650+0000 7fc413fff640 1 --2- 172.21.15.148:0/1254548024 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558cadec6b40 0x558cadedaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:56.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.650+0000 7fc41affd640 1 --2- 172.21.15.148:0/1254548024 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558cadec55d0 0x558cadeda970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:56.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.650+0000 7fc41b7fe640 1 -- 172.21.15.148:0/1254548024 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558cadec55d0 msgr2=0x558cadeda970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:56.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.650+0000 7fc41b7fe640 1 --2- 172.21.15.148:0/1254548024 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558cadec55d0 0x558cadeda970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:56.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.650+0000 7fc41b7fe640 1 -- 172.21.15.148:0/1254548024 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558cadec6b40 msgr2=0x558cadedaeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:56.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.650+0000 7fc41b7fe640 1 --2- 172.21.15.148:0/1254548024 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558cadec6b40 0x558cadedaeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:56.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.650+0000 7fc41b7fe640 1 -- 172.21.15.148:0/1254548024 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558cadecc4b0 con 0x558caded2580 2024-09-19T07:12:56.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.650+0000 7fc41b7fe640 1 --2- 172.21.15.148:0/1254548024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558caded2580 0x558cadecbcb0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fc414009ca0 tx=0x7fc414004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5af353634e036927 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:56.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.650+0000 7fc4027fc640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:12:56.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.650+0000 7fc4027fc640 1 -- 172.21.15.148:0/1254548024 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc41405a050 con 0x558caded2580 2024-09-19T07:12:56.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.650+0000 7fc4027fc640 1 -- 172.21.15.148:0/1254548024 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fc414004620 con 0x558caded2580 2024-09-19T07:12:56.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.650+0000 7fc423b7e740 1 -- 172.21.15.148:0/1254548024 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc40c098a30 con 0x558caded2580 2024-09-19T07:12:56.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.650+0000 7fc4027fc640 1 -- 172.21.15.148:0/1254548024 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc41402fb30 con 0x558caded2580 2024-09-19T07:12:56.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.650+0000 7fc423b7e740 10 client.15948 fetch_fsmap learned FSMap version 25 2024-09-19T07:12:56.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.650+0000 7fc423b7e740 1 -- 172.21.15.148:0/1254548024 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558cadf4c5e0 con 0x558caded2580 2024-09-19T07:12:56.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.650+0000 7fc4027fc640 1 -- 172.21.15.148:0/1254548024 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc40c098a30 con 0x558caded2580 2024-09-19T07:12:56.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.651+0000 7fc4027fc640 1 -- 172.21.15.148:0/1254548024 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc414004b40 con 0x558caded2580 2024-09-19T07:12:56.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.651+0000 7fc423b7e740 10 client.15948 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:12:56.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.651+0000 7fc423b7e740 10 client.15948 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:12:56.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.651+0000 7fc423b7e740 20 client.15948 populate_metadata read hostname 'smithi148' 2024-09-19T07:12:56.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.651+0000 7fc423b7e740 1 --2- 172.21.15.148:0/1254548024 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x558cadf4cd00 0x558cadf4f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:56.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.651+0000 7fc423b7e740 4 client.15948 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:12:56.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.651+0000 7fc423b7e740 1 -- 172.21.15.148:0/1254548024 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558cade32d70 con 0x558cadf4cd00 2024-09-19T07:12:56.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.651+0000 7fc41affd640 1 --2- 172.21.15.148:0/1254548024 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x558cadf4cd00 0x558cadf4f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:56.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.651+0000 7fc4027fc640 10 client.15948 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:56.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.651+0000 7fc41affd640 1 --2- 172.21.15.148:0/1254548024 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x558cadf4cd00 0x558cadf4f120 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86f48b1e25e2e6a5 server_cookie=6b7e7d73ccc41464 in_seq=0 out_seq=0 2024-09-19T07:12:56.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.651+0000 7fc4027fc640 1 -- 172.21.15.148:0/1254548024 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558cade32d70 con 0x558cadf4cd00 2024-09-19T07:12:56.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.651+0000 7fc4027fc640 10 client.15948 handle_command_reply: tid=0 2024-09-19T07:12:56.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.651+0000 7fc423b7e740 1 client.15948 shutdown 2024-09-19T07:12:56.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.652+0000 7fc423b7e740 1 -- 172.21.15.148:0/1254548024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558caded2580 msgr2=0x558cadecbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:56.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.652+0000 7fc423b7e740 1 --2- 172.21.15.148:0/1254548024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558caded2580 0x558cadecbcb0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fc414009ca0 tx=0x7fc414004a40 comp rx=0 tx=0).stop 2024-09-19T07:12:56.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.652+0000 7fc423b7e740 1 -- 172.21.15.148:0/1254548024 shutdown_connections 2024-09-19T07:12:56.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.652+0000 7fc423b7e740 1 --2- 172.21.15.148:0/1254548024 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x558cadf4cd00 0x558cadf4f120 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:56.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.652+0000 7fc423b7e740 1 --2- 172.21.15.148:0/1254548024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558caded2580 0x558cadecbcb0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:56.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.652+0000 7fc4027fc640 0 client.15948 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:56.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.652+0000 7fc423b7e740 1 --2- 172.21.15.148:0/1254548024 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558cadec6b40 0x558cadedaeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:56.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.652+0000 7fc423b7e740 1 --2- 172.21.15.148:0/1254548024 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558cadec55d0 0x558cadeda970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:56.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.652+0000 7fc423b7e740 1 -- 172.21.15.148:0/1254548024 >> 172.21.15.148:0/1254548024 conn(0x558cade8e310 msgr2=0x558caded0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:56.895 INFO:teuthology.orchestra.run.smithi148.stdout:[] 2024-09-19T07:12:56.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.652+0000 7fc423b7e740 1 -- 172.21.15.148:0/1254548024 shutdown_connections 2024-09-19T07:12:56.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.652+0000 7fc423b7e740 1 -- 172.21.15.148:0/1254548024 wait complete. 2024-09-19T07:12:56.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.652+0000 7fc423b7e740 20 client.15948 trim_cache size 0 max 16384 2024-09-19T07:12:56.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.652+0000 7fc4217a5640 1 -- 172.21.15.148:0/1848702937 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc4080a33b0 msgr2=0x7fc4080a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:56.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.652+0000 7fc4217a5640 1 --2- 172.21.15.148:0/1848702937 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc4080a33b0 0x7fc4080a5870 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc41404d000 tx=0x7fc41404a000 comp rx=0 tx=0).stop 2024-09-19T07:12:56.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.652+0000 7fc4217a5640 1 -- 172.21.15.148:0/1848702937 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc41c100e20 msgr2=0x7fc41c197300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:56.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.652+0000 7fc4217a5640 1 --2- 172.21.15.148:0/1848702937 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc41c100e20 0x7fc41c197300 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc40c00e9f0 tx=0x7fc40c00eeb0 comp rx=0 tx=0).stop 2024-09-19T07:12:56.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.652+0000 7fc4217a5640 1 -- 172.21.15.148:0/1848702937 shutdown_connections 2024-09-19T07:12:56.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.652+0000 7fc4217a5640 1 --2- 172.21.15.148:0/1848702937 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc4080a33b0 0x7fc4080a5870 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:56.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.652+0000 7fc4217a5640 1 --2- 172.21.15.148:0/1848702937 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc41c102ef0 0x7fc41c19bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:56.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.652+0000 7fc4217a5640 1 --2- 172.21.15.148:0/1848702937 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc41c102570 0x7fc41c197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:56.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.652+0000 7fc4217a5640 1 --2- 172.21.15.148:0/1848702937 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc41c100e20 0x7fc41c197300 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:56.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.652+0000 7fc4217a5640 1 -- 172.21.15.148:0/1848702937 >> 172.21.15.148:0/1848702937 conn(0x7fc41c0fc7d0 msgr2=0x7fc41c1067c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:56.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.652+0000 7fc4217a5640 1 -- 172.21.15.148:0/1848702937 shutdown_connections 2024-09-19T07:12:56.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:12:56.653+0000 7fc4217a5640 1 -- 172.21.15.148:0/1848702937 wait complete. 2024-09-19T07:12:56.897 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:56 smithi165 ceph-mon[35326]: pgmap v59: 97 pgs: 97 active+clean; 4.2 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 286 KiB/s wr, 40 op/s 2024-09-19T07:12:58.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:12:58 smithi179 ceph-mon[35716]: pgmap v60: 97 pgs: 97 active+clean; 4.2 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 286 KiB/s wr, 37 op/s 2024-09-19T07:12:58.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:12:58 smithi148 ceph-mon[31180]: pgmap v60: 97 pgs: 97 active+clean; 4.2 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 286 KiB/s wr, 37 op/s 2024-09-19T07:12:58.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:12:58 smithi165 ceph-mon[35326]: pgmap v60: 97 pgs: 97 active+clean; 4.2 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 286 KiB/s wr, 37 op/s 2024-09-19T07:12:59.734 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.733+0000 7f4019e2e640 1 -- 172.21.15.148:0/2670061648 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4014102d10 msgr2=0x7f40141030f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:59.734 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.733+0000 7f4019e2e640 1 --2- 172.21.15.148:0/2670061648 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4014102d10 0x7f40141030f0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f4004009900 tx=0x7f400402a480 comp rx=0 tx=0).stop 2024-09-19T07:12:59.734 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.733+0000 7f4019e2e640 1 -- 172.21.15.148:0/2670061648 shutdown_connections 2024-09-19T07:12:59.734 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.733+0000 7f4019e2e640 1 --2- 172.21.15.148:0/2670061648 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f401410c0e0 0x7f401410e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:59.735 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.733+0000 7f4019e2e640 1 --2- 172.21.15.148:0/2670061648 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4014103630 0x7f401410bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:59.735 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.733+0000 7f4019e2e640 1 --2- 172.21.15.148:0/2670061648 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4014102d10 0x7f40141030f0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:59.735 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.733+0000 7f4019e2e640 1 -- 172.21.15.148:0/2670061648 >> 172.21.15.148:0/2670061648 conn(0x7f40140fc6c0 msgr2=0x7f40140feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:59.735 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.733+0000 7f4019e2e640 1 -- 172.21.15.148:0/2670061648 shutdown_connections 2024-09-19T07:12:59.735 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.733+0000 7f4019e2e640 1 -- 172.21.15.148:0/2670061648 wait complete. 2024-09-19T07:12:59.735 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.733+0000 7f4019e2e640 1 Processor -- start 2024-09-19T07:12:59.737 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.734+0000 7f4019e2e640 1 -- start start 2024-09-19T07:12:59.737 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.734+0000 7f4019e2e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4014102d10 0x7f40141982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:59.737 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.734+0000 7f4019e2e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4014103630 0x7f40141987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:59.738 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.734+0000 7f4019e2e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f401410c0e0 0x7f401419cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:59.738 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.734+0000 7f4019e2e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4014111ee0 con 0x7f401410c0e0 2024-09-19T07:12:59.738 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.734+0000 7f4019e2e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4014111d60 con 0x7f4014103630 2024-09-19T07:12:59.738 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.734+0000 7f4019e2e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4014112060 con 0x7f4014102d10 2024-09-19T07:12:59.738 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.734+0000 7f4013fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f401410c0e0 0x7f401419cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:59.738 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.734+0000 7f4013fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f401410c0e0 0x7f401419cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50672/0 (socket says 172.21.15.148:50672) 2024-09-19T07:12:59.738 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.734+0000 7f4013fff640 1 -- 172.21.15.148:0/1705262772 learned_addr learned my addr 172.21.15.148:0/1705262772 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:59.738 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.734+0000 7f40137fe640 1 --2- 172.21.15.148:0/1705262772 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4014102d10 0x7f40141982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:59.738 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.734+0000 7f4013fff640 1 -- 172.21.15.148:0/1705262772 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4014102d10 msgr2=0x7f40141982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:59.738 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.734+0000 7f4013fff640 1 --2- 172.21.15.148:0/1705262772 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4014102d10 0x7f40141982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:59.738 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.734+0000 7f4013fff640 1 -- 172.21.15.148:0/1705262772 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4014103630 msgr2=0x7f40141987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:59.738 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.734+0000 7f4012ffd640 1 --2- 172.21.15.148:0/1705262772 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4014103630 0x7f40141987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:59.738 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.734+0000 7f4013fff640 1 --2- 172.21.15.148:0/1705262772 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4014103630 0x7f40141987f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:59.739 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.734+0000 7f4013fff640 1 -- 172.21.15.148:0/1705262772 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f401419d2a0 con 0x7f401410c0e0 2024-09-19T07:12:59.739 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.735+0000 7f4013fff640 1 --2- 172.21.15.148:0/1705262772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f401410c0e0 0x7f401419cb70 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f400c00cce0 tx=0x7f400c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:59.739 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.735+0000 7f4010ff9640 1 -- 172.21.15.148:0/1705262772 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400c00f450 con 0x7f401410c0e0 2024-09-19T07:12:59.739 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.735+0000 7f4010ff9640 1 -- 172.21.15.148:0/1705262772 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f400c00fad0 con 0x7f401410c0e0 2024-09-19T07:12:59.739 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.735+0000 7f4010ff9640 1 -- 172.21.15.148:0/1705262772 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400c018c10 con 0x7f401410c0e0 2024-09-19T07:12:59.739 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.735+0000 7f4019e2e640 1 -- 172.21.15.148:0/1705262772 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f401419d590 con 0x7f401410c0e0 2024-09-19T07:12:59.739 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.735+0000 7f4019e2e640 1 -- 172.21.15.148:0/1705262772 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40141a4e20 con 0x7f401410c0e0 2024-09-19T07:12:59.748 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.737+0000 7f4010ff9640 1 -- 172.21.15.148:0/1705262772 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f400c00f5f0 con 0x7f401410c0e0 2024-09-19T07:12:59.749 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.737+0000 7f401cbcc740 1 Processor -- start 2024-09-19T07:12:59.749 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.738+0000 7f401cbcc740 1 -- start start 2024-09-19T07:12:59.749 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.738+0000 7f401cbcc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559200cb3af0 0x559200cb3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:59.749 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.738+0000 7f401cbcc740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559200cb4410 0x559200cbe770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:59.750 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.738+0000 7f401cbcc740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559200cbecb0 0x559200cc10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:59.750 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.738+0000 7f401cbcc740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x559200c182f0 con 0x559200cb4410 2024-09-19T07:12:59.750 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.738+0000 7f401cbcc740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x559200bc0270 con 0x559200cbecb0 2024-09-19T07:12:59.750 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.738+0000 7f401cbcc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x559200c142b0 con 0x559200cb3af0 2024-09-19T07:12:59.750 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.738+0000 7f40137fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559200cb4410 0x559200cbe770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:59.750 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.738+0000 7f40137fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559200cb4410 0x559200cbe770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50674/0 (socket says 172.21.15.148:50674) 2024-09-19T07:12:59.751 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.738+0000 7f4010ff9640 1 --2- 172.21.15.148:0/1705262772 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f3ffc0a34e0 0x7f3ffc0a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:59.751 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.738+0000 7f40137fe640 1 -- 172.21.15.148:0/2301070033 learned_addr learned my addr 172.21.15.148:0/2301070033 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:59.751 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.738+0000 7f4012ffd640 1 --2- 172.21.15.148:0/2301070033 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559200cbecb0 0x559200cc10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:59.751 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.738+0000 7f4013fff640 1 --2- 172.21.15.148:0/1705262772 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f3ffc0a34e0 0x7f3ffc0a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:59.751 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.738+0000 7f4012ffd640 1 --2- 172.21.15.148:0/2301070033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559200cb3af0 0x559200cb3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:59.752 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.738+0000 7f40137fe640 1 -- 172.21.15.148:0/2301070033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559200cb3af0 msgr2=0x559200cb3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:59.752 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.738+0000 7f40137fe640 1 --2- 172.21.15.148:0/2301070033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559200cb3af0 0x559200cb3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:59.752 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.738+0000 7f40137fe640 1 -- 172.21.15.148:0/2301070033 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559200cbecb0 msgr2=0x559200cc10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:59.752 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.738+0000 7f40137fe640 1 --2- 172.21.15.148:0/2301070033 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559200cbecb0 0x559200cc10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:59.752 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.738+0000 7f40137fe640 1 -- 172.21.15.148:0/2301070033 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559200bbf340 con 0x559200cb4410 2024-09-19T07:12:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.738+0000 7f4010ff9640 1 -- 172.21.15.148:0/1705262772 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f400c0d03c0 con 0x7f401410c0e0 2024-09-19T07:12:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.739+0000 7f40137fe640 1 --2- 172.21.15.148:0/2301070033 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559200cb4410 0x559200cbe770 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f4004033000 tx=0x7f4004032ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cfbee0e4ba6a843 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.739+0000 7f4013fff640 1 --2- 172.21.15.148:0/1705262772 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f3ffc0a34e0 0x7f3ffc0a59a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f400c09c370 tx=0x7f400c06e3f0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.739+0000 7f3ff9ffb640 1 -- 172.21.15.148:0/2301070033 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400403f070 con 0x559200cb4410 2024-09-19T07:12:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.739+0000 7f3ff9ffb640 1 -- 172.21.15.148:0/2301070033 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4004032e40 con 0x559200cb4410 2024-09-19T07:12:59.754 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.739+0000 7f3ff9ffb640 1 -- 172.21.15.148:0/2301070033 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4004035070 con 0x559200cb4410 2024-09-19T07:12:59.754 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.739+0000 7f401cbcc740 1 -- 172.21.15.148:0/2301070033 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559200cb4410 msgr2=0x559200cbe770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:59.754 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.739+0000 7f401cbcc740 1 --2- 172.21.15.148:0/2301070033 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559200cb4410 0x559200cbe770 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f4004033000 tx=0x7f4004032ca0 comp rx=0 tx=0).stop 2024-09-19T07:12:59.754 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.739+0000 7f401cbcc740 1 -- 172.21.15.148:0/2301070033 shutdown_connections 2024-09-19T07:12:59.754 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.739+0000 7f401cbcc740 1 --2- 172.21.15.148:0/2301070033 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559200cbecb0 0x559200cc10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:59.754 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.739+0000 7f401cbcc740 1 --2- 172.21.15.148:0/2301070033 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559200cb4410 0x559200cbe770 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:59.755 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.739+0000 7f401cbcc740 1 --2- 172.21.15.148:0/2301070033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559200cb3af0 0x559200cb3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:59.755 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.739+0000 7f401cbcc740 1 -- 172.21.15.148:0/2301070033 >> 172.21.15.148:0/2301070033 conn(0x559200cb0060 msgr2=0x559200cb0440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:59.755 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.740+0000 7f401cbcc740 1 -- 172.21.15.148:0/2301070033 shutdown_connections 2024-09-19T07:12:59.755 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.740+0000 7f401cbcc740 1 -- 172.21.15.148:0/2301070033 wait complete. 2024-09-19T07:12:59.755 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.740+0000 7f401cbcc740 1 -- start start 2024-09-19T07:12:59.755 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.740+0000 7f401cbcc740 1 Processor -- start 2024-09-19T07:12:59.756 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.740+0000 7f401cbcc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559200cb3af0 0x559200cbbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:59.756 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.740+0000 7f401cbcc740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559200cb4410 0x559200cbc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:59.756 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.740+0000 7f401cbcc740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559200cbecb0 0x559200cbc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:59.756 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.740+0000 7f401cbcc740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x559200cc1880 con 0x559200cbecb0 2024-09-19T07:12:59.756 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.740+0000 7f401cbcc740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x559200ba1290 con 0x559200cb4410 2024-09-19T07:12:59.757 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.740+0000 7f401cbcc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x559200cc1a00 con 0x559200cb3af0 2024-09-19T07:12:59.757 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.740+0000 7f401cbcc740 10 client.0 _ll_register_callbacks cb 0x559200bd2140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:12:59.757 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.741+0000 7f4012ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559200cbecb0 0x559200cbc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:59.757 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.741+0000 7f4012ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559200cbecb0 0x559200cbc610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50676/0 (socket says 172.21.15.148:50676) 2024-09-19T07:12:59.757 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.741+0000 7f4012ffd640 1 -- 172.21.15.148:0/358823263 learned_addr learned my addr 172.21.15.148:0/358823263 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:59.757 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.741+0000 7f40137fe640 1 --2- 172.21.15.148:0/358823263 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559200cb4410 0x559200cbc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:59.758 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.741+0000 7f4012ffd640 1 -- 172.21.15.148:0/358823263 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559200cb3af0 msgr2=0x559200cbbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:59.758 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.741+0000 7f4012ffd640 1 --2- 172.21.15.148:0/358823263 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559200cb3af0 0x559200cbbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:59.758 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.741+0000 7f4012ffd640 1 -- 172.21.15.148:0/358823263 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559200cb4410 msgr2=0x559200cbc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:59.758 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.741+0000 7f4012ffd640 1 --2- 172.21.15.148:0/358823263 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559200cb4410 0x559200cbc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:59.758 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.741+0000 7f4012ffd640 1 -- 172.21.15.148:0/358823263 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55920092b210 con 0x559200cbecb0 2024-09-19T07:12:59.759 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.741+0000 7f4012ffd640 1 --2- 172.21.15.148:0/358823263 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559200cbecb0 0x559200cbc610 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f4008012760 tx=0x7f4008012c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=385a4c6bff361852 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:59.759 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.741+0000 7f3ff2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:12:59.759 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.741+0000 7f3ff2ffd640 1 -- 172.21.15.148:0/358823263 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4008010d20 con 0x559200cbecb0 2024-09-19T07:12:59.759 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.741+0000 7f3ff2ffd640 1 -- 172.21.15.148:0/358823263 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f400801c3f0 con 0x559200cbecb0 2024-09-19T07:12:59.759 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.741+0000 7f401cbcc740 1 -- 172.21.15.148:0/358823263 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559200c25a20 con 0x559200cbecb0 2024-09-19T07:12:59.760 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.741+0000 7f3ff2ffd640 1 -- 172.21.15.148:0/358823263 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f40080047c0 con 0x559200cbecb0 2024-09-19T07:12:59.760 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.741+0000 7f401cbcc740 10 client.15960 fetch_fsmap learned FSMap version 25 2024-09-19T07:12:59.760 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.741+0000 7f401cbcc740 1 -- 172.21.15.148:0/358823263 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5592009f7620 con 0x559200cbecb0 2024-09-19T07:12:59.760 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.741+0000 7f3ff2ffd640 1 -- 172.21.15.148:0/358823263 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x559200c25a20 con 0x559200cbecb0 2024-09-19T07:12:59.760 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.742+0000 7f3ff2ffd640 1 -- 172.21.15.148:0/358823263 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f400801b030 con 0x559200cbecb0 2024-09-19T07:12:59.761 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.742+0000 7f401cbcc740 10 client.15960 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:12:59.761 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.742+0000 7f401cbcc740 10 client.15960 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:12:59.761 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.742+0000 7f401cbcc740 20 client.15960 populate_metadata read hostname 'smithi148' 2024-09-19T07:12:59.761 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.742+0000 7f401cbcc740 1 --2- 172.21.15.148:0/358823263 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x559200ccec30 0x559200cd1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:59.761 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.742+0000 7f401cbcc740 4 client.15960 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:12:59.762 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.742+0000 7f401cbcc740 1 -- 172.21.15.148:0/358823263 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559200c1fd70 con 0x559200ccec30 2024-09-19T07:12:59.762 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.742+0000 7f40137fe640 1 --2- 172.21.15.148:0/358823263 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x559200ccec30 0x559200cd1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:59.762 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.742+0000 7f3ff2ffd640 10 client.15960 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:59.762 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.742+0000 7f40137fe640 1 --2- 172.21.15.148:0/358823263 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x559200ccec30 0x559200cd1020 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0102c968b836a9 server_cookie=db16bf17f85ff628 in_seq=0 out_seq=0 2024-09-19T07:12:59.762 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.743+0000 7f3ff2ffd640 1 -- 172.21.15.148:0/358823263 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559200c1fd70 con 0x559200ccec30 2024-09-19T07:12:59.763 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.743+0000 7f3ff2ffd640 10 client.15960 handle_command_reply: tid=0 2024-09-19T07:12:59.763 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.743+0000 7f401cbcc740 1 client.15960 shutdown 2024-09-19T07:12:59.763 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.743+0000 7f401cbcc740 1 -- 172.21.15.148:0/358823263 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559200cbecb0 msgr2=0x559200cbc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:59.763 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.743+0000 7f401cbcc740 1 --2- 172.21.15.148:0/358823263 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559200cbecb0 0x559200cbc610 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f4008012760 tx=0x7f4008012c20 comp rx=0 tx=0).stop 2024-09-19T07:12:59.763 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.743+0000 7f401cbcc740 1 -- 172.21.15.148:0/358823263 shutdown_connections 2024-09-19T07:12:59.763 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.743+0000 7f401cbcc740 1 --2- 172.21.15.148:0/358823263 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x559200ccec30 0x559200cd1020 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:59.764 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.743+0000 7f401cbcc740 1 --2- 172.21.15.148:0/358823263 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559200cbecb0 0x559200cbc610 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:59.764 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.743+0000 7f401cbcc740 1 --2- 172.21.15.148:0/358823263 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559200cb4410 0x559200cbc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:59.764 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.743+0000 7f3ff2ffd640 0 client.15960 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:59.764 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.743+0000 7f401cbcc740 1 --2- 172.21.15.148:0/358823263 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559200cb3af0 0x559200cbbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:59.764 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.743+0000 7f401cbcc740 1 -- 172.21.15.148:0/358823263 >> 172.21.15.148:0/358823263 conn(0x559200cb0060 msgr2=0x559200cb5d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:59.765 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.743+0000 7f401cbcc740 1 -- 172.21.15.148:0/358823263 shutdown_connections 2024-09-19T07:12:59.765 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.743+0000 7f401cbcc740 1 -- 172.21.15.148:0/358823263 wait complete. 2024-09-19T07:12:59.765 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.743+0000 7f401cbcc740 20 client.15960 trim_cache size 0 max 16384 2024-09-19T07:12:59.773 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.758+0000 7f401cbcc740 1 Processor -- start 2024-09-19T07:12:59.773 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.758+0000 7f401cbcc740 1 -- start start 2024-09-19T07:12:59.773 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.758+0000 7f401cbcc740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559200cb3af0 0x559200cbc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:59.773 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.758+0000 7f401cbcc740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559200cb4410 0x559200cbc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:59.773 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.758+0000 7f401cbcc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559200cbecb0 0x559200cd6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:59.774 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.758+0000 7f401cbcc740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f40141aff10 con 0x559200cb4410 2024-09-19T07:12:59.774 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.758+0000 7f401cbcc740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f40141ad7e0 con 0x559200cb3af0 2024-09-19T07:12:59.774 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.758+0000 7f401cbcc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f40141ab610 con 0x559200cbecb0 2024-09-19T07:12:59.774 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.758+0000 7f40137fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559200cb4410 0x559200cbc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:59.774 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.758+0000 7f40137fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559200cb4410 0x559200cbc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50678/0 (socket says 172.21.15.148:50678) 2024-09-19T07:12:59.774 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.758+0000 7f40137fe640 1 -- 172.21.15.148:0/1442494048 learned_addr learned my addr 172.21.15.148:0/1442494048 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:59.774 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.758+0000 7f4012ffd640 1 --2- 172.21.15.148:0/1442494048 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559200cb3af0 0x559200cbc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:59.774 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.758+0000 7f40137fe640 1 -- 172.21.15.148:0/1442494048 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559200cbecb0 msgr2=0x559200cd6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:59.774 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.758+0000 7f40137fe640 1 --2- 172.21.15.148:0/1442494048 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559200cbecb0 0x559200cd6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:59.774 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.758+0000 7f40137fe640 1 -- 172.21.15.148:0/1442494048 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559200cb3af0 msgr2=0x559200cbc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:59.774 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.758+0000 7f40137fe640 1 --2- 172.21.15.148:0/1442494048 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559200cb3af0 0x559200cbc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:59.774 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.758+0000 7f40137fe640 1 -- 172.21.15.148:0/1442494048 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559200cb6940 con 0x559200cb4410 2024-09-19T07:12:59.775 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.758+0000 7f4012ffd640 1 --2- 172.21.15.148:0/1442494048 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559200cb3af0 0x559200cbc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:12:59.775 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.758+0000 7f40137fe640 1 --2- 172.21.15.148:0/1442494048 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559200cb4410 0x559200cbc600 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f4004009900 tx=0x7f40040053a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1816f390b545f547 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:59.775 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.758+0000 7f3ff97fa640 1 -- 172.21.15.148:0/1442494048 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400403f040 con 0x559200cb4410 2024-09-19T07:12:59.775 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.759+0000 7f3ff97fa640 1 -- 172.21.15.148:0/1442494048 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40040035f0 con 0x559200cb4410 2024-09-19T07:12:59.775 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.759+0000 7f3ff97fa640 1 -- 172.21.15.148:0/1442494048 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4004035040 con 0x559200cb4410 2024-09-19T07:12:59.775 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.759+0000 7f401cbcc740 1 -- 172.21.15.148:0/1442494048 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559200cb4410 msgr2=0x559200cbc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:59.775 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.759+0000 7f401cbcc740 1 --2- 172.21.15.148:0/1442494048 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559200cb4410 0x559200cbc600 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f4004009900 tx=0x7f40040053a0 comp rx=0 tx=0).stop 2024-09-19T07:12:59.775 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.759+0000 7f401cbcc740 1 -- 172.21.15.148:0/1442494048 shutdown_connections 2024-09-19T07:12:59.775 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.759+0000 7f401cbcc740 1 --2- 172.21.15.148:0/1442494048 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559200cbecb0 0x559200cd6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:59.775 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.759+0000 7f401cbcc740 1 --2- 172.21.15.148:0/1442494048 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559200cb4410 0x559200cbc600 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:59.775 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.759+0000 7f401cbcc740 1 --2- 172.21.15.148:0/1442494048 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559200cb3af0 0x559200cbc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:59.775 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.759+0000 7f401cbcc740 1 -- 172.21.15.148:0/1442494048 >> 172.21.15.148:0/1442494048 conn(0x559200cb0060 msgr2=0x559200cbdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:59.775 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.759+0000 7f401cbcc740 1 -- 172.21.15.148:0/1442494048 shutdown_connections 2024-09-19T07:12:59.776 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.759+0000 7f401cbcc740 1 -- 172.21.15.148:0/1442494048 wait complete. 2024-09-19T07:12:59.776 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.759+0000 7f401cbcc740 1 -- start start 2024-09-19T07:12:59.776 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.760+0000 7f401cbcc740 1 Processor -- start 2024-09-19T07:12:59.776 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.760+0000 7f401cbcc740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559200cb3af0 0x559200cc7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:59.776 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.760+0000 7f401cbcc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559200cb4410 0x559200cc2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:59.776 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.760+0000 7f401cbcc740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559200cbecb0 0x559200cc2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:59.776 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.760+0000 7f401cbcc740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f40141abca0 con 0x559200cb3af0 2024-09-19T07:12:59.776 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.760+0000 7f401cbcc740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f40141ad110 con 0x559200cbecb0 2024-09-19T07:12:59.776 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.760+0000 7f401cbcc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f40141ac370 con 0x559200cb4410 2024-09-19T07:12:59.776 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.760+0000 7f401cbcc740 10 client.0 _ll_register_callbacks cb 0x7f400800e770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:12:59.776 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.760+0000 7f4012ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559200cb3af0 0x559200cc7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:59.776 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.760+0000 7f4012ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559200cb3af0 0x559200cc7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50690/0 (socket says 172.21.15.148:50690) 2024-09-19T07:12:59.777 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.760+0000 7f4012ffd640 1 -- 172.21.15.148:0/2873666650 learned_addr learned my addr 172.21.15.148:0/2873666650 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:12:59.777 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.760+0000 7f4012ffd640 1 -- 172.21.15.148:0/2873666650 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559200cb4410 msgr2=0x559200cc2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:59.777 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.760+0000 7f4012ffd640 1 --2- 172.21.15.148:0/2873666650 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559200cb4410 0x559200cc2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:59.777 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.760+0000 7f4012ffd640 1 -- 172.21.15.148:0/2873666650 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559200cbecb0 msgr2=0x559200cc2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:12:59.777 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.760+0000 7f4012ffd640 1 --2- 172.21.15.148:0/2873666650 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559200cbecb0 0x559200cc2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:59.777 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.760+0000 7f4012ffd640 1 -- 172.21.15.148:0/2873666650 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559200cc2eb0 con 0x559200cb3af0 2024-09-19T07:12:59.777 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.760+0000 7f4012ffd640 1 --2- 172.21.15.148:0/2873666650 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559200cb3af0 0x559200cc7110 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f4008005fd0 tx=0x7f4008010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f80a2a6ae6a8d47e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:59.777 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.760+0000 7f3ff2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:12:59.777 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.761+0000 7f3ff2ffd640 1 -- 172.21.15.148:0/2873666650 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400801c8b0 con 0x559200cb3af0 2024-09-19T07:12:59.777 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.761+0000 7f3ff2ffd640 1 -- 172.21.15.148:0/2873666650 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f400800ec90 con 0x559200cb3af0 2024-09-19T07:12:59.777 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.761+0000 7f401cbcc740 1 -- 172.21.15.148:0/2873666650 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40040035f0 con 0x559200cb3af0 2024-09-19T07:12:59.777 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.761+0000 7f3ff2ffd640 1 -- 172.21.15.148:0/2873666650 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f400801ccb0 con 0x559200cb3af0 2024-09-19T07:12:59.778 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.761+0000 7f401cbcc740 10 client.15966 fetch_fsmap learned FSMap version 25 2024-09-19T07:12:59.778 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.761+0000 7f401cbcc740 1 -- 172.21.15.148:0/2873666650 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559200d3d8c0 con 0x559200cb3af0 2024-09-19T07:12:59.778 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.761+0000 7f3ff2ffd640 1 -- 172.21.15.148:0/2873666650 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40040035f0 con 0x559200cb3af0 2024-09-19T07:12:59.778 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.761+0000 7f3ff2ffd640 1 -- 172.21.15.148:0/2873666650 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f400802d030 con 0x559200cb3af0 2024-09-19T07:12:59.778 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.761+0000 7f401cbcc740 10 client.15966 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:12:59.778 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.761+0000 7f401cbcc740 10 client.15966 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:12:59.778 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.761+0000 7f401cbcc740 20 client.15966 populate_metadata read hostname 'smithi148' 2024-09-19T07:12:59.778 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.761+0000 7f401cbcc740 1 --2- 172.21.15.148:0/2873666650 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x559200d3e0a0 0x559200d404c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:59.778 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.761+0000 7f401cbcc740 4 client.15966 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:12:59.778 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.761+0000 7f401cbcc740 1 -- 172.21.15.148:0/2873666650 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559200b9c900 con 0x559200d3e0a0 2024-09-19T07:12:59.778 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.761+0000 7f40137fe640 1 --2- 172.21.15.148:0/2873666650 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x559200d3e0a0 0x559200d404c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:59.778 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.762+0000 7f3ff2ffd640 10 client.15966 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:59.778 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.762+0000 7f40137fe640 1 --2- 172.21.15.148:0/2873666650 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x559200d3e0a0 0x559200d404c0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5650805824f38092 server_cookie=61f5ed4829841b8a in_seq=0 out_seq=0 2024-09-19T07:12:59.805 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.803+0000 7f3ff2ffd640 1 -- 172.21.15.148:0/2873666650 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559200b9c900 con 0x559200d3e0a0 2024-09-19T07:12:59.805 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.803+0000 7f3ff2ffd640 10 client.15966 handle_command_reply: tid=0 2024-09-19T07:12:59.805 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.803+0000 7f401cbcc740 1 client.15966 shutdown 2024-09-19T07:12:59.805 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.803+0000 7f401cbcc740 1 -- 172.21.15.148:0/2873666650 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559200cb3af0 msgr2=0x559200cc7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:59.805 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.803+0000 7f401cbcc740 1 --2- 172.21.15.148:0/2873666650 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559200cb3af0 0x559200cc7110 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f4008005fd0 tx=0x7f4008010d50 comp rx=0 tx=0).stop 2024-09-19T07:12:59.805 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.803+0000 7f401cbcc740 1 -- 172.21.15.148:0/2873666650 shutdown_connections 2024-09-19T07:12:59.805 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.803+0000 7f401cbcc740 1 --2- 172.21.15.148:0/2873666650 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x559200d3e0a0 0x559200d404c0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:59.805 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.803+0000 7f401cbcc740 1 --2- 172.21.15.148:0/2873666650 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559200cbecb0 0x559200cc2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:59.805 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.803+0000 7f401cbcc740 1 --2- 172.21.15.148:0/2873666650 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559200cb4410 0x559200cc2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:59.806 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.803+0000 7f3ff2ffd640 0 client.15966 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:12:59.806 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.803+0000 7f401cbcc740 1 --2- 172.21.15.148:0/2873666650 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559200cb3af0 0x559200cc7110 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:59.806 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.803+0000 7f401cbcc740 1 -- 172.21.15.148:0/2873666650 >> 172.21.15.148:0/2873666650 conn(0x559200cb0060 msgr2=0x559200cb5520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:59.806 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.803+0000 7f401cbcc740 1 -- 172.21.15.148:0/2873666650 shutdown_connections 2024-09-19T07:12:59.806 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.803+0000 7f401cbcc740 1 -- 172.21.15.148:0/2873666650 wait complete. 2024-09-19T07:12:59.806 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.803+0000 7f401cbcc740 20 client.15966 trim_cache size 0 max 16384 2024-09-19T07:12:59.806 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:12:59.806 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:12:59.806 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:12:59.806 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:12:59.807 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.804+0000 7f4019e2e640 1 -- 172.21.15.148:0/1705262772 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f3ffc0a34e0 msgr2=0x7f3ffc0a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:59.807 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.804+0000 7f4019e2e640 1 --2- 172.21.15.148:0/1705262772 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f3ffc0a34e0 0x7f3ffc0a59a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f400c09c370 tx=0x7f400c06e3f0 comp rx=0 tx=0).stop 2024-09-19T07:12:59.807 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.804+0000 7f4019e2e640 1 -- 172.21.15.148:0/1705262772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f401410c0e0 msgr2=0x7f401419cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:59.807 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.804+0000 7f4019e2e640 1 --2- 172.21.15.148:0/1705262772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f401410c0e0 0x7f401419cb70 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f400c00cce0 tx=0x7f400c00a620 comp rx=0 tx=0).stop 2024-09-19T07:12:59.808 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.804+0000 7f4019e2e640 1 -- 172.21.15.148:0/1705262772 shutdown_connections 2024-09-19T07:12:59.808 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.804+0000 7f4019e2e640 1 --2- 172.21.15.148:0/1705262772 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f3ffc0a34e0 0x7f3ffc0a59a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:59.808 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.804+0000 7f4019e2e640 1 --2- 172.21.15.148:0/1705262772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f401410c0e0 0x7f401419cb70 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:59.808 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.804+0000 7f4019e2e640 1 --2- 172.21.15.148:0/1705262772 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4014103630 0x7f40141987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:59.808 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.804+0000 7f4019e2e640 1 --2- 172.21.15.148:0/1705262772 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4014102d10 0x7f40141982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:59.808 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.804+0000 7f4019e2e640 1 -- 172.21.15.148:0/1705262772 >> 172.21.15.148:0/1705262772 conn(0x7f40140fc6c0 msgr2=0x7f40140fd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:59.808 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.804+0000 7f4019e2e640 1 -- 172.21.15.148:0/1705262772 shutdown_connections 2024-09-19T07:12:59.808 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:12:59.804+0000 7f4019e2e640 1 -- 172.21.15.148:0/1705262772 wait complete. 2024-09-19T07:13:00.569 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T07:13:00.569 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T07:13:00.734 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:00 smithi148 ceph-mon[31180]: pgmap v61: 97 pgs: 97 active+clean; 4.9 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 345 KiB/s wr, 49 op/s 2024-09-19T07:13:00.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:00 smithi179 ceph-mon[35716]: pgmap v61: 97 pgs: 97 active+clean; 4.9 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 345 KiB/s wr, 49 op/s 2024-09-19T07:13:00.827 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:13:00.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:00 smithi165 ceph-mon[35326]: pgmap v61: 97 pgs: 97 active+clean; 4.9 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 345 KiB/s wr, 49 op/s 2024-09-19T07:13:01.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.357+0000 7fbaa2329640 1 -- 172.21.15.148:0/3389460214 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba9c103670 msgr2=0x7fba9c10bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:01.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.357+0000 7fbaa2329640 1 --2- 172.21.15.148:0/3389460214 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba9c103670 0x7fba9c10bb60 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fba90009900 tx=0x7fba9002a480 comp rx=0 tx=0).stop 2024-09-19T07:13:01.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.357+0000 7fbaa2329640 1 -- 172.21.15.148:0/3389460214 shutdown_connections 2024-09-19T07:13:01.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.357+0000 7fbaa2329640 1 --2- 172.21.15.148:0/3389460214 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba9c10c180 0x7fba9c10e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:01.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.357+0000 7fbaa2329640 1 --2- 172.21.15.148:0/3389460214 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba9c103670 0x7fba9c10bb60 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:01.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.357+0000 7fbaa2329640 1 --2- 172.21.15.148:0/3389460214 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba9c102d50 0x7fba9c103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:01.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.357+0000 7fbaa2329640 1 -- 172.21.15.148:0/3389460214 >> 172.21.15.148:0/3389460214 conn(0x7fba9c0fc7d0 msgr2=0x7fba9c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:01.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.357+0000 7fbaa2329640 1 -- 172.21.15.148:0/3389460214 shutdown_connections 2024-09-19T07:13:01.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.357+0000 7fbaa2329640 1 -- 172.21.15.148:0/3389460214 wait complete. 2024-09-19T07:13:01.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.357+0000 7fbaa2329640 1 Processor -- start 2024-09-19T07:13:01.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.358+0000 7fbaa2329640 1 -- start start 2024-09-19T07:13:01.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.358+0000 7fbaa2329640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba9c102d50 0x7fba9c19a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:01.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.358+0000 7fbaa2329640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba9c103670 0x7fba9c19ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:01.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.358+0000 7fbaa2329640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba9c10c180 0x7fba9c19ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:01.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.358+0000 7fbaa2329640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fba9c111f80 con 0x7fba9c10c180 2024-09-19T07:13:01.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.358+0000 7fbaa2329640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fba9c111e00 con 0x7fba9c103670 2024-09-19T07:13:01.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.358+0000 7fbaa2329640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fba9c112100 con 0x7fba9c102d50 2024-09-19T07:13:01.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.358+0000 7fbaa08c6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba9c10c180 0x7fba9c19ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:01.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.358+0000 7fbaa08c6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba9c10c180 0x7fba9c19ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50706/0 (socket says 172.21.15.148:50706) 2024-09-19T07:13:01.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.358+0000 7fba9bfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba9c102d50 0x7fba9c19a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:01.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.358+0000 7fbaa08c6640 1 -- 172.21.15.148:0/1669623484 learned_addr learned my addr 172.21.15.148:0/1669623484 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:01.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.358+0000 7fba9b7fe640 1 --2- 172.21.15.148:0/1669623484 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba9c103670 0x7fba9c19ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:01.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.359+0000 7fba9bfff640 1 -- 172.21.15.148:0/1669623484 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba9c103670 msgr2=0x7fba9c19ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:01.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.359+0000 7fba9bfff640 1 --2- 172.21.15.148:0/1669623484 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba9c103670 0x7fba9c19ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:01.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.359+0000 7fba9bfff640 1 -- 172.21.15.148:0/1669623484 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba9c10c180 msgr2=0x7fba9c19ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:01.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.359+0000 7fba9bfff640 1 --2- 172.21.15.148:0/1669623484 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba9c10c180 0x7fba9c19ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:01.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.359+0000 7fba9bfff640 1 -- 172.21.15.148:0/1669623484 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba9c19f5f0 con 0x7fba9c102d50 2024-09-19T07:13:01.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.359+0000 7fba9b7fe640 1 --2- 172.21.15.148:0/1669623484 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba9c103670 0x7fba9c19ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:13:01.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.359+0000 7fbaa08c6640 1 --2- 172.21.15.148:0/1669623484 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba9c10c180 0x7fba9c19ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:13:01.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.359+0000 7fba9bfff640 1 --2- 172.21.15.148:0/1669623484 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba9c102d50 0x7fba9c19a640 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fba8c00e9f0 tx=0x7fba8c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:01.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.359+0000 7fba997fa640 1 -- 172.21.15.148:0/1669623484 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba8c00ccc0 con 0x7fba9c102d50 2024-09-19T07:13:01.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.359+0000 7fbaa2329640 1 -- 172.21.15.148:0/1669623484 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba9c19f8e0 con 0x7fba9c102d50 2024-09-19T07:13:01.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.359+0000 7fba997fa640 1 -- 172.21.15.148:0/1669623484 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba8c005020 con 0x7fba9c102d50 2024-09-19T07:13:01.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.359+0000 7fbaa2329640 1 -- 172.21.15.148:0/1669623484 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba9c1a71c0 con 0x7fba9c102d50 2024-09-19T07:13:01.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.359+0000 7fba997fa640 1 -- 172.21.15.148:0/1669623484 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba8c0049e0 con 0x7fba9c102d50 2024-09-19T07:13:01.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.362+0000 7fba997fa640 1 -- 172.21.15.148:0/1669623484 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fba8c005560 con 0x7fba9c102d50 2024-09-19T07:13:01.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.362+0000 7fba997fa640 1 --2- 172.21.15.148:0/1669623484 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fba840a33b0 0x7fba840a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:01.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.362+0000 7fba9b7fe640 1 --2- 172.21.15.148:0/1669623484 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fba840a33b0 0x7fba840a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:01.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.362+0000 7fba997fa640 1 -- 172.21.15.148:0/1669623484 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fba8c0cfd60 con 0x7fba9c102d50 2024-09-19T07:13:01.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.363+0000 7fbaa4702740 1 Processor -- start 2024-09-19T07:13:01.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.363+0000 7fba9b7fe640 1 --2- 172.21.15.148:0/1669623484 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fba840a33b0 0x7fba840a5870 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fba9c0fec10 tx=0x7fba90005a20 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:01.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.363+0000 7fbaa4702740 1 -- start start 2024-09-19T07:13:01.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.363+0000 7fbaa4702740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5618f6dadb60 0x5618f6dadf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:01.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.363+0000 7fbaa4702740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5618f6dae480 0x5618f6db8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:01.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.363+0000 7fbaa4702740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618f6db8d40 0x5618f6dbb130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:01.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.363+0000 7fbaa4702740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5618f6d13280 con 0x5618f6db8d40 2024-09-19T07:13:01.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.363+0000 7fbaa4702740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5618f6cbab10 con 0x5618f6dadb60 2024-09-19T07:13:01.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.363+0000 7fbaa4702740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5618f6d0f240 con 0x5618f6dae480 2024-09-19T07:13:01.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.363+0000 7fbaa08c6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618f6db8d40 0x5618f6dbb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:01.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.363+0000 7fbaa08c6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618f6db8d40 0x5618f6dbb130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50712/0 (socket says 172.21.15.148:50712) 2024-09-19T07:13:01.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.363+0000 7fbaa08c6640 1 -- 172.21.15.148:0/3781715704 learned_addr learned my addr 172.21.15.148:0/3781715704 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:01.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.363+0000 7fba9b7fe640 1 --2- 172.21.15.148:0/3781715704 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5618f6dae480 0x5618f6db8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:01.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.363+0000 7fba9bfff640 1 --2- 172.21.15.148:0/3781715704 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5618f6dadb60 0x5618f6dadf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:01.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.363+0000 7fbaa08c6640 1 -- 172.21.15.148:0/3781715704 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5618f6dae480 msgr2=0x5618f6db8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:01.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.363+0000 7fbaa08c6640 1 --2- 172.21.15.148:0/3781715704 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5618f6dae480 0x5618f6db8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:01.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.363+0000 7fbaa08c6640 1 -- 172.21.15.148:0/3781715704 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5618f6dadb60 msgr2=0x5618f6dadf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:01.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.363+0000 7fbaa08c6640 1 --2- 172.21.15.148:0/3781715704 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5618f6dadb60 0x5618f6dadf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:01.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.363+0000 7fbaa08c6640 1 -- 172.21.15.148:0/3781715704 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618f6cc71f0 con 0x5618f6db8d40 2024-09-19T07:13:01.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.363+0000 7fba9bfff640 1 --2- 172.21.15.148:0/3781715704 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5618f6dadb60 0x5618f6dadf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:13:01.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.364+0000 7fbaa08c6640 1 --2- 172.21.15.148:0/3781715704 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618f6db8d40 0x5618f6dbb130 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fba94011850 tx=0x7fba94011d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de1803ea7cf59596 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:01.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.364+0000 7fba827fc640 1 -- 172.21.15.148:0/3781715704 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba94011330 con 0x5618f6db8d40 2024-09-19T07:13:01.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.364+0000 7fba827fc640 1 -- 172.21.15.148:0/3781715704 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba9400fe80 con 0x5618f6db8d40 2024-09-19T07:13:01.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.365+0000 7fba827fc640 1 -- 172.21.15.148:0/3781715704 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba940193e0 con 0x5618f6db8d40 2024-09-19T07:13:01.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.365+0000 7fbaa4702740 1 -- 172.21.15.148:0/3781715704 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618f6db8d40 msgr2=0x5618f6dbb130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:01.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.365+0000 7fbaa4702740 1 --2- 172.21.15.148:0/3781715704 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618f6db8d40 0x5618f6dbb130 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fba94011850 tx=0x7fba94011d10 comp rx=0 tx=0).stop 2024-09-19T07:13:01.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.365+0000 7fbaa4702740 1 -- 172.21.15.148:0/3781715704 shutdown_connections 2024-09-19T07:13:01.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.365+0000 7fbaa4702740 1 --2- 172.21.15.148:0/3781715704 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618f6db8d40 0x5618f6dbb130 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:01.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.365+0000 7fbaa4702740 1 --2- 172.21.15.148:0/3781715704 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5618f6dae480 0x5618f6db8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:01.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.365+0000 7fbaa4702740 1 --2- 172.21.15.148:0/3781715704 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5618f6dadb60 0x5618f6dadf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:01.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.365+0000 7fbaa4702740 1 -- 172.21.15.148:0/3781715704 >> 172.21.15.148:0/3781715704 conn(0x5618f6daa0f0 msgr2=0x5618f6daa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:01.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.365+0000 7fbaa4702740 1 -- 172.21.15.148:0/3781715704 shutdown_connections 2024-09-19T07:13:01.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.365+0000 7fbaa4702740 1 -- 172.21.15.148:0/3781715704 wait complete. 2024-09-19T07:13:01.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.365+0000 7fbaa4702740 1 -- start start 2024-09-19T07:13:01.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.366+0000 7fbaa4702740 1 Processor -- start 2024-09-19T07:13:01.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.366+0000 7fbaa4702740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5618f6dadb60 0x5618f6db8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:01.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.366+0000 7fbaa4702740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618f6dae480 0x5618f6db5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:01.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.366+0000 7fbaa4702740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5618f6db8d40 0x5618f6db6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:01.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.366+0000 7fbaa4702740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5618f6dbb960 con 0x5618f6dae480 2024-09-19T07:13:01.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.366+0000 7fbaa4702740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5618f6ccdf10 con 0x5618f6db8d40 2024-09-19T07:13:01.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.366+0000 7fbaa4702740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5618f6dbbae0 con 0x5618f6dadb60 2024-09-19T07:13:01.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.366+0000 7fbaa4702740 10 client.0 _ll_register_callbacks cb 0x5618f6c96a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:13:01.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.366+0000 7fba9b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618f6dae480 0x5618f6db5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:01.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.366+0000 7fba9b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618f6dae480 0x5618f6db5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50728/0 (socket says 172.21.15.148:50728) 2024-09-19T07:13:01.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.366+0000 7fba9b7fe640 1 -- 172.21.15.148:0/1415789516 learned_addr learned my addr 172.21.15.148:0/1415789516 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:01.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.366+0000 7fba9bfff640 1 --2- 172.21.15.148:0/1415789516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5618f6dadb60 0x5618f6db8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:01.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.366+0000 7fbaa08c6640 1 --2- 172.21.15.148:0/1415789516 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5618f6db8d40 0x5618f6db6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:01.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.367+0000 7fba9b7fe640 1 -- 172.21.15.148:0/1415789516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5618f6dadb60 msgr2=0x5618f6db8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:01.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.367+0000 7fba9b7fe640 1 --2- 172.21.15.148:0/1415789516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5618f6dadb60 0x5618f6db8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:01.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.367+0000 7fba9b7fe640 1 -- 172.21.15.148:0/1415789516 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5618f6db8d40 msgr2=0x5618f6db6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:01.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.367+0000 7fba9b7fe640 1 --2- 172.21.15.148:0/1415789516 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5618f6db8d40 0x5618f6db6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:01.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.367+0000 7fba9b7fe640 1 -- 172.21.15.148:0/1415789516 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618f6a846a0 con 0x5618f6dae480 2024-09-19T07:13:01.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.367+0000 7fba9bfff640 1 --2- 172.21.15.148:0/1415789516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5618f6dadb60 0x5618f6db8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:13:01.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.367+0000 7fba9b7fe640 1 --2- 172.21.15.148:0/1415789516 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618f6dae480 0x5618f6db5ad0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fba90009900 tx=0x7fba90009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=700a2b4d971ae812 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:01.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.367+0000 7fba7b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:13:01.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.367+0000 7fba7b7fe640 1 -- 172.21.15.148:0/1415789516 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba90035050 con 0x5618f6dae480 2024-09-19T07:13:01.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.367+0000 7fba7b7fe640 1 -- 172.21.15.148:0/1415789516 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fba90005310 con 0x5618f6dae480 2024-09-19T07:13:01.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.367+0000 7fbaa4702740 1 -- 172.21.15.148:0/1415789516 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5618f6d207f0 con 0x5618f6dae480 2024-09-19T07:13:01.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.367+0000 7fba7b7fe640 1 -- 172.21.15.148:0/1415789516 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fba90005510 con 0x5618f6dae480 2024-09-19T07:13:01.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.367+0000 7fbaa4702740 10 client.15978 fetch_fsmap learned FSMap version 25 2024-09-19T07:13:01.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.367+0000 7fbaa4702740 1 -- 172.21.15.148:0/1415789516 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5618f6dc7460 con 0x5618f6dae480 2024-09-19T07:13:01.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.367+0000 7fba7b7fe640 1 -- 172.21.15.148:0/1415789516 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5618f6d207f0 con 0x5618f6dae480 2024-09-19T07:13:01.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.367+0000 7fba7b7fe640 1 -- 172.21.15.148:0/1415789516 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fba90003890 con 0x5618f6dae480 2024-09-19T07:13:01.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.368+0000 7fbaa4702740 10 client.15978 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:13:01.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.368+0000 7fbaa4702740 10 client.15978 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:13:01.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.368+0000 7fbaa4702740 20 client.15978 populate_metadata read hostname 'smithi148' 2024-09-19T07:13:01.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.368+0000 7fbaa4702740 1 --2- 172.21.15.148:0/1415789516 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5618f6dc8870 0x5618f6dcacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:01.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.368+0000 7fbaa4702740 4 client.15978 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:13:01.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.368+0000 7fbaa4702740 1 -- 172.21.15.148:0/1415789516 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5618f6d1ad00 con 0x5618f6dc8870 2024-09-19T07:13:01.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.368+0000 7fba9bfff640 1 --2- 172.21.15.148:0/1415789516 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5618f6dc8870 0x5618f6dcacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:01.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.368+0000 7fba9bfff640 1 --2- 172.21.15.148:0/1415789516 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5618f6dc8870 0x5618f6dcacc0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=421273bd0a907601 server_cookie=1f2ab5ffdd7afd9f in_seq=0 out_seq=0 2024-09-19T07:13:01.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.368+0000 7fba7b7fe640 10 client.15978 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:13:01.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.369+0000 7fba7b7fe640 1 -- 172.21.15.148:0/1415789516 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5618f6d1ad00 con 0x5618f6dc8870 2024-09-19T07:13:01.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.369+0000 7fba7b7fe640 10 client.15978 handle_command_reply: tid=0 2024-09-19T07:13:01.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.369+0000 7fbaa4702740 1 client.15978 shutdown 2024-09-19T07:13:01.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.369+0000 7fbaa4702740 1 -- 172.21.15.148:0/1415789516 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618f6dae480 msgr2=0x5618f6db5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:01.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.369+0000 7fbaa4702740 1 --2- 172.21.15.148:0/1415789516 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618f6dae480 0x5618f6db5ad0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fba90009900 tx=0x7fba90009260 comp rx=0 tx=0).stop 2024-09-19T07:13:01.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.369+0000 7fbaa4702740 1 -- 172.21.15.148:0/1415789516 shutdown_connections 2024-09-19T07:13:01.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.369+0000 7fbaa4702740 1 --2- 172.21.15.148:0/1415789516 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5618f6dc8870 0x5618f6dcacc0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:01.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.369+0000 7fbaa4702740 1 --2- 172.21.15.148:0/1415789516 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5618f6db8d40 0x5618f6db6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:01.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.369+0000 7fbaa4702740 1 --2- 172.21.15.148:0/1415789516 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618f6dae480 0x5618f6db5ad0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:01.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.369+0000 7fbaa4702740 1 --2- 172.21.15.148:0/1415789516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5618f6dadb60 0x5618f6db8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:01.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.369+0000 7fba7b7fe640 0 client.15978 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:13:01.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.369+0000 7fbaa4702740 1 -- 172.21.15.148:0/1415789516 >> 172.21.15.148:0/1415789516 conn(0x5618f6daa0f0 msgr2=0x5618f6da9270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:01.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.369+0000 7fbaa4702740 1 -- 172.21.15.148:0/1415789516 shutdown_connections 2024-09-19T07:13:01.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.369+0000 7fbaa4702740 1 -- 172.21.15.148:0/1415789516 wait complete. 2024-09-19T07:13:01.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.370+0000 7fbaa4702740 20 client.15978 trim_cache size 0 max 16384 2024-09-19T07:13:01.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.400+0000 7fbaa4702740 1 Processor -- start 2024-09-19T07:13:01.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.400+0000 7fbaa4702740 1 -- start start 2024-09-19T07:13:01.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.401+0000 7fbaa4702740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5618f6dadb60 0x5618f6db43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:01.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.401+0000 7fbaa4702740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5618f6dae480 0x5618f6db48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:01.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.401+0000 7fbaa4702740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618f6db8d40 0x5618f6dd0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:01.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.401+0000 7fbaa4702740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fba9c1b23f0 con 0x5618f6db8d40 2024-09-19T07:13:01.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.401+0000 7fbaa4702740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fba9c1afcc0 con 0x5618f6dadb60 2024-09-19T07:13:01.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.401+0000 7fbaa4702740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fba9c1adaf0 con 0x5618f6dae480 2024-09-19T07:13:01.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.401+0000 7fbaa08c6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618f6db8d40 0x5618f6dd0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:01.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.401+0000 7fbaa08c6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618f6db8d40 0x5618f6dd0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50730/0 (socket says 172.21.15.148:50730) 2024-09-19T07:13:01.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.401+0000 7fbaa08c6640 1 -- 172.21.15.148:0/2283742181 learned_addr learned my addr 172.21.15.148:0/2283742181 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:01.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.401+0000 7fba9bfff640 1 --2- 172.21.15.148:0/2283742181 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5618f6dadb60 0x5618f6db43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:01.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.401+0000 7fba9b7fe640 1 --2- 172.21.15.148:0/2283742181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5618f6dae480 0x5618f6db48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:01.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.401+0000 7fbaa08c6640 1 -- 172.21.15.148:0/2283742181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5618f6dae480 msgr2=0x5618f6db48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:01.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.401+0000 7fbaa08c6640 1 --2- 172.21.15.148:0/2283742181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5618f6dae480 0x5618f6db48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:01.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.401+0000 7fbaa08c6640 1 -- 172.21.15.148:0/2283742181 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5618f6dadb60 msgr2=0x5618f6db43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:01.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.401+0000 7fbaa08c6640 1 --2- 172.21.15.148:0/2283742181 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5618f6dadb60 0x5618f6db43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:01.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.401+0000 7fbaa08c6640 1 -- 172.21.15.148:0/2283742181 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618f6dae2b0 con 0x5618f6db8d40 2024-09-19T07:13:01.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.401+0000 7fbaa08c6640 1 --2- 172.21.15.148:0/2283742181 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618f6db8d40 0x5618f6dd0590 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fba94011850 tx=0x7fba94010ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1136966c68c1542c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:01.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.402+0000 7fba81ffb640 1 -- 172.21.15.148:0/2283742181 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba9401f040 con 0x5618f6db8d40 2024-09-19T07:13:01.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.402+0000 7fba81ffb640 1 -- 172.21.15.148:0/2283742181 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba9402a070 con 0x5618f6db8d40 2024-09-19T07:13:01.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.402+0000 7fba81ffb640 1 -- 172.21.15.148:0/2283742181 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba94010430 con 0x5618f6db8d40 2024-09-19T07:13:01.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.402+0000 7fbaa4702740 1 -- 172.21.15.148:0/2283742181 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618f6db8d40 msgr2=0x5618f6dd0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:01.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.402+0000 7fbaa4702740 1 --2- 172.21.15.148:0/2283742181 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618f6db8d40 0x5618f6dd0590 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fba94011850 tx=0x7fba94010ce0 comp rx=0 tx=0).stop 2024-09-19T07:13:01.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.402+0000 7fbaa4702740 1 -- 172.21.15.148:0/2283742181 shutdown_connections 2024-09-19T07:13:01.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.402+0000 7fbaa4702740 1 --2- 172.21.15.148:0/2283742181 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618f6db8d40 0x5618f6dd0590 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:01.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.402+0000 7fbaa4702740 1 --2- 172.21.15.148:0/2283742181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5618f6dae480 0x5618f6db48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:01.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.402+0000 7fbaa4702740 1 --2- 172.21.15.148:0/2283742181 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5618f6dadb60 0x5618f6db43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:01.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.402+0000 7fbaa4702740 1 -- 172.21.15.148:0/2283742181 >> 172.21.15.148:0/2283742181 conn(0x5618f6daa0f0 msgr2=0x5618f6db0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:01.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.403+0000 7fbaa4702740 1 -- 172.21.15.148:0/2283742181 shutdown_connections 2024-09-19T07:13:01.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.403+0000 7fbaa4702740 1 -- 172.21.15.148:0/2283742181 wait complete. 2024-09-19T07:13:01.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.403+0000 7fbaa4702740 1 -- start start 2024-09-19T07:13:01.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.403+0000 7fbaa4702740 1 Processor -- start 2024-09-19T07:13:01.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.403+0000 7fbaa4702740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5618f6dadb60 0x5618f6dc13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:01.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.403+0000 7fbaa4702740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5618f6dae480 0x5618f6db2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:01.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.403+0000 7fbaa4702740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618f6db8d40 0x5618f6db2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:01.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.403+0000 7fbaa4702740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fba9c1ae180 con 0x5618f6db8d40 2024-09-19T07:13:01.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.403+0000 7fbaa4702740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fba9c1af5f0 con 0x5618f6dadb60 2024-09-19T07:13:01.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.403+0000 7fbaa4702740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fba9c1ae850 con 0x5618f6dae480 2024-09-19T07:13:01.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.403+0000 7fbaa4702740 10 client.0 _ll_register_callbacks cb 0x7fba8c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:13:01.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.404+0000 7fbaa08c6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618f6db8d40 0x5618f6db2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:01.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.404+0000 7fbaa08c6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618f6db8d40 0x5618f6db2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50736/0 (socket says 172.21.15.148:50736) 2024-09-19T07:13:01.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.404+0000 7fbaa08c6640 1 -- 172.21.15.148:0/2471352227 learned_addr learned my addr 172.21.15.148:0/2471352227 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:01.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.404+0000 7fba9bfff640 1 --2- 172.21.15.148:0/2471352227 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5618f6dadb60 0x5618f6dc13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:01.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.404+0000 7fba9b7fe640 1 --2- 172.21.15.148:0/2471352227 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5618f6dae480 0x5618f6db2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:01.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.404+0000 7fbaa08c6640 1 -- 172.21.15.148:0/2471352227 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5618f6dae480 msgr2=0x5618f6db2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:01.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.404+0000 7fbaa08c6640 1 --2- 172.21.15.148:0/2471352227 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5618f6dae480 0x5618f6db2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:01.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.404+0000 7fbaa08c6640 1 -- 172.21.15.148:0/2471352227 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5618f6dadb60 msgr2=0x5618f6dc13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:01.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.404+0000 7fbaa08c6640 1 --2- 172.21.15.148:0/2471352227 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5618f6dadb60 0x5618f6dc13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:01.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.404+0000 7fbaa08c6640 1 -- 172.21.15.148:0/2471352227 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618f6db33c0 con 0x5618f6db8d40 2024-09-19T07:13:01.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.404+0000 7fba9bfff640 1 --2- 172.21.15.148:0/2471352227 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5618f6dadb60 0x5618f6dc13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:13:01.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.404+0000 7fbaa08c6640 1 --2- 172.21.15.148:0/2471352227 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618f6db8d40 0x5618f6db2c80 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fba94014040 tx=0x7fba94009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25113409849a9091 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:01.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.404+0000 7fba7b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:13:01.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.404+0000 7fba7b7fe640 1 -- 172.21.15.148:0/2471352227 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba94032070 con 0x5618f6db8d40 2024-09-19T07:13:01.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.404+0000 7fba7b7fe640 1 -- 172.21.15.148:0/2471352227 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fba94011130 con 0x5618f6db8d40 2024-09-19T07:13:01.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.404+0000 7fbaa4702740 1 -- 172.21.15.148:0/2471352227 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba9402a070 con 0x5618f6db8d40 2024-09-19T07:13:01.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.404+0000 7fba7b7fe640 1 -- 172.21.15.148:0/2471352227 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fba9403e050 con 0x5618f6db8d40 2024-09-19T07:13:01.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.404+0000 7fbaa4702740 10 client.15984 fetch_fsmap learned FSMap version 25 2024-09-19T07:13:01.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.404+0000 7fbaa4702740 1 -- 172.21.15.148:0/2471352227 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5618f6e33560 con 0x5618f6db8d40 2024-09-19T07:13:01.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.405+0000 7fba7b7fe640 1 -- 172.21.15.148:0/2471352227 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba9402a070 con 0x5618f6db8d40 2024-09-19T07:13:01.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.405+0000 7fba7b7fe640 1 -- 172.21.15.148:0/2471352227 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fba94018070 con 0x5618f6db8d40 2024-09-19T07:13:01.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.405+0000 7fbaa4702740 10 client.15984 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:13:01.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.405+0000 7fbaa4702740 10 client.15984 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:13:01.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.405+0000 7fbaa4702740 20 client.15984 populate_metadata read hostname 'smithi148' 2024-09-19T07:13:01.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.405+0000 7fbaa4702740 1 --2- 172.21.15.148:0/2471352227 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5618f6e339d0 0x5618f6e35dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:01.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.405+0000 7fbaa4702740 4 client.15984 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T07:13:01.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.405+0000 7fbaa4702740 1 -- 172.21.15.148:0/2471352227 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5618f6c97110 con 0x5618f6e339d0 2024-09-19T07:13:01.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.405+0000 7fba9bfff640 1 --2- 172.21.15.148:0/2471352227 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5618f6e339d0 0x5618f6e35dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:01.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.405+0000 7fba9bfff640 1 --2- 172.21.15.148:0/2471352227 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5618f6e339d0 0x5618f6e35dc0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6de174b82212717 server_cookie=4f77b264b8e456a9 in_seq=0 out_seq=0 2024-09-19T07:13:01.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.405+0000 7fba7b7fe640 10 client.15984 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:13:01.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.406+0000 7fba7b7fe640 1 -- 172.21.15.148:0/2471352227 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5618f6c97110 con 0x5618f6e339d0 2024-09-19T07:13:01.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.406+0000 7fba7b7fe640 10 client.15984 handle_command_reply: tid=0 2024-09-19T07:13:01.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.406+0000 7fbaa4702740 1 client.15984 shutdown 2024-09-19T07:13:01.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.407+0000 7fbaa4702740 1 -- 172.21.15.148:0/2471352227 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618f6db8d40 msgr2=0x5618f6db2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:01.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.407+0000 7fbaa4702740 1 --2- 172.21.15.148:0/2471352227 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618f6db8d40 0x5618f6db2c80 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fba94014040 tx=0x7fba94009750 comp rx=0 tx=0).stop 2024-09-19T07:13:01.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.407+0000 7fbaa4702740 1 -- 172.21.15.148:0/2471352227 shutdown_connections 2024-09-19T07:13:01.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.407+0000 7fbaa4702740 1 --2- 172.21.15.148:0/2471352227 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5618f6e339d0 0x5618f6e35dc0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:01.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.407+0000 7fbaa4702740 1 --2- 172.21.15.148:0/2471352227 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618f6db8d40 0x5618f6db2c80 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:01.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.407+0000 7fbaa4702740 1 --2- 172.21.15.148:0/2471352227 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5618f6dae480 0x5618f6db2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:01.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.407+0000 7fbaa4702740 1 --2- 172.21.15.148:0/2471352227 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5618f6dadb60 0x5618f6dc13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:01.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.407+0000 7fbaa4702740 1 -- 172.21.15.148:0/2471352227 >> 172.21.15.148:0/2471352227 conn(0x5618f6daa0f0 msgr2=0x5618f6da8a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:01.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.407+0000 7fba7b7fe640 0 client.15984 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:13:01.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.407+0000 7fbaa4702740 1 -- 172.21.15.148:0/2471352227 shutdown_connections 2024-09-19T07:13:01.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.407+0000 7fbaa4702740 1 -- 172.21.15.148:0/2471352227 wait complete. 2024-09-19T07:13:01.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.407+0000 7fbaa4702740 20 client.15984 trim_cache size 0 max 16384 2024-09-19T07:13:01.413 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:13:01.413 INFO:teuthology.orchestra.run.smithi148.stdout: "return_code": 0, 2024-09-19T07:13:01.413 INFO:teuthology.orchestra.run.smithi148.stdout: "scrub_tag": "9a0c20ff-b09f-43f6-a57a-8c092ecbf7a1", 2024-09-19T07:13:01.413 INFO:teuthology.orchestra.run.smithi148.stdout: "mode": "asynchronous" 2024-09-19T07:13:01.413 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:13:01.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.408+0000 7fbaa2329640 1 -- 172.21.15.148:0/1669623484 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fba840a33b0 msgr2=0x7fba840a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:01.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.408+0000 7fbaa2329640 1 --2- 172.21.15.148:0/1669623484 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fba840a33b0 0x7fba840a5870 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fba9c0fec10 tx=0x7fba90005a20 comp rx=0 tx=0).stop 2024-09-19T07:13:01.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.408+0000 7fbaa2329640 1 -- 172.21.15.148:0/1669623484 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba9c102d50 msgr2=0x7fba9c19a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:01.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.408+0000 7fbaa2329640 1 --2- 172.21.15.148:0/1669623484 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba9c102d50 0x7fba9c19a640 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fba8c00e9f0 tx=0x7fba8c00eeb0 comp rx=0 tx=0).stop 2024-09-19T07:13:01.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.408+0000 7fbaa2329640 1 -- 172.21.15.148:0/1669623484 shutdown_connections 2024-09-19T07:13:01.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.408+0000 7fbaa2329640 1 --2- 172.21.15.148:0/1669623484 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fba840a33b0 0x7fba840a5870 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:01.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.408+0000 7fbaa2329640 1 --2- 172.21.15.148:0/1669623484 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba9c10c180 0x7fba9c19ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:01.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.408+0000 7fbaa2329640 1 --2- 172.21.15.148:0/1669623484 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba9c103670 0x7fba9c19ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:01.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.408+0000 7fbaa2329640 1 --2- 172.21.15.148:0/1669623484 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba9c102d50 0x7fba9c19a640 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:01.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.408+0000 7fbaa2329640 1 -- 172.21.15.148:0/1669623484 >> 172.21.15.148:0/1669623484 conn(0x7fba9c0fc7d0 msgr2=0x7fba9c10d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:01.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.408+0000 7fbaa2329640 1 -- 172.21.15.148:0/1669623484 shutdown_connections 2024-09-19T07:13:01.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:01.408+0000 7fbaa2329640 1 -- 172.21.15.148:0/1669623484 wait complete. 2024-09-19T07:13:02.075 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T07:13:02.326 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:13:02.693 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:02 smithi148 ceph-mon[31180]: pgmap v62: 97 pgs: 97 active+clean; 4.9 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 333 KiB/s wr, 44 op/s 2024-09-19T07:13:02.693 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:02 smithi148 ceph-mon[31180]: scrub queued for path: / 2024-09-19T07:13:02.693 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:02 smithi148 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:02.693 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:02 smithi148 ceph-mon[31180]: scrub summary: active paths [/] 2024-09-19T07:13:02.693 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:02 smithi148 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:02.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:02 smithi179 ceph-mon[35716]: pgmap v62: 97 pgs: 97 active+clean; 4.9 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 333 KiB/s wr, 44 op/s 2024-09-19T07:13:02.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:02 smithi179 ceph-mon[35716]: scrub queued for path: / 2024-09-19T07:13:02.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:02 smithi179 ceph-mon[35716]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:02.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:02 smithi179 ceph-mon[35716]: scrub summary: active paths [/] 2024-09-19T07:13:02.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:02 smithi179 ceph-mon[35716]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:02.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.775+0000 7fd02948e640 1 -- 172.21.15.148:0/2192353427 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd024106ba0 msgr2=0x7fd024106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:02.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.775+0000 7fd02948e640 1 --2- 172.21.15.148:0/2192353427 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd024106ba0 0x7fd024106f80 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fd014009ca0 tx=0x7fd01402a8c0 comp rx=0 tx=0).stop 2024-09-19T07:13:02.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.775+0000 7fd02948e640 1 -- 172.21.15.148:0/2192353427 shutdown_connections 2024-09-19T07:13:02.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.775+0000 7fd02948e640 1 --2- 172.21.15.148:0/2192353427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd024100a70 0x7fd02410ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:02.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.775+0000 7fd02948e640 1 --2- 172.21.15.148:0/2192353427 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd0241000d0 0x7fd024100530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:02.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.775+0000 7fd02948e640 1 --2- 172.21.15.148:0/2192353427 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd024106ba0 0x7fd024106f80 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:02.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.775+0000 7fd02948e640 1 -- 172.21.15.148:0/2192353427 >> 172.21.15.148:0/2192353427 conn(0x7fd024077210 msgr2=0x7fd0240fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:02.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.775+0000 7fd02948e640 1 -- 172.21.15.148:0/2192353427 shutdown_connections 2024-09-19T07:13:02.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.775+0000 7fd02948e640 1 -- 172.21.15.148:0/2192353427 wait complete. 2024-09-19T07:13:02.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.776+0000 7fd02948e640 1 Processor -- start 2024-09-19T07:13:02.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.776+0000 7fd02948e640 1 -- start start 2024-09-19T07:13:02.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.776+0000 7fd02948e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0241000d0 0x7fd0241984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:02.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.776+0000 7fd02948e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd024100a70 0x7fd024198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:02.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.776+0000 7fd02948e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd024106ba0 0x7fd02419cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:02.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.776+0000 7fd02948e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd024112090 con 0x7fd0241000d0 2024-09-19T07:13:02.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.776+0000 7fd02948e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd024111f10 con 0x7fd024106ba0 2024-09-19T07:13:02.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.776+0000 7fd02948e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd024112210 con 0x7fd024100a70 2024-09-19T07:13:02.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.776+0000 7fd022ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0241000d0 0x7fd0241984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:02.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.776+0000 7fd022ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0241000d0 0x7fd0241984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50758/0 (socket says 172.21.15.148:50758) 2024-09-19T07:13:02.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.776+0000 7fd022ffd640 1 -- 172.21.15.148:0/2806555602 learned_addr learned my addr 172.21.15.148:0/2806555602 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:02.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.777+0000 7fd0227fc640 1 --2- 172.21.15.148:0/2806555602 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd024100a70 0x7fd024198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:02.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.777+0000 7fd0237fe640 1 --2- 172.21.15.148:0/2806555602 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd024106ba0 0x7fd02419cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:02.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.777+0000 7fd022ffd640 1 -- 172.21.15.148:0/2806555602 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd024100a70 msgr2=0x7fd024198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:02.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.777+0000 7fd022ffd640 1 --2- 172.21.15.148:0/2806555602 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd024100a70 0x7fd024198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:02.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.777+0000 7fd022ffd640 1 -- 172.21.15.148:0/2806555602 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd024106ba0 msgr2=0x7fd02419cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:02.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.777+0000 7fd022ffd640 1 --2- 172.21.15.148:0/2806555602 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd024106ba0 0x7fd02419cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:02.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.777+0000 7fd022ffd640 1 -- 172.21.15.148:0/2806555602 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd02419d4a0 con 0x7fd0241000d0 2024-09-19T07:13:02.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.777+0000 7fd022ffd640 1 --2- 172.21.15.148:0/2806555602 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0241000d0 0x7fd0241984f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fd014006010 tx=0x7fd014003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:02.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.777+0000 7fd01bfff640 1 -- 172.21.15.148:0/2806555602 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd014031650 con 0x7fd0241000d0 2024-09-19T07:13:02.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.777+0000 7fd01bfff640 1 -- 172.21.15.148:0/2806555602 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0140317f0 con 0x7fd0241000d0 2024-09-19T07:13:02.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.777+0000 7fd02948e640 1 -- 172.21.15.148:0/2806555602 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd02419d730 con 0x7fd0241000d0 2024-09-19T07:13:02.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.777+0000 7fd01bfff640 1 -- 172.21.15.148:0/2806555602 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd014030bb0 con 0x7fd0241000d0 2024-09-19T07:13:02.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.777+0000 7fd02948e640 1 -- 172.21.15.148:0/2806555602 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0241a5070 con 0x7fd0241000d0 2024-09-19T07:13:02.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.779+0000 7fd01bfff640 1 -- 172.21.15.148:0/2806555602 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fd014004690 con 0x7fd0241000d0 2024-09-19T07:13:02.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.779+0000 7fd02b867740 1 Processor -- start 2024-09-19T07:13:02.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.779+0000 7fd02b867740 1 -- start start 2024-09-19T07:13:02.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.780+0000 7fd02b867740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e9a49b74a0 0x55e9a49b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:02.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.780+0000 7fd02b867740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e9a49b7dc0 0x55e9a49c2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:02.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.780+0000 7fd02b867740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e9a49c2680 0x55e9a49c4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:02.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.780+0000 7fd02b867740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55e9a491d2e0 con 0x55e9a49b7dc0 2024-09-19T07:13:02.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.780+0000 7fd02b867740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55e9a48c4ce0 con 0x55e9a49c2680 2024-09-19T07:13:02.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.780+0000 7fd02b867740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55e9a49192a0 con 0x55e9a49b74a0 2024-09-19T07:13:02.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.780+0000 7fd022ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e9a49b7dc0 0x55e9a49c2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:02.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.780+0000 7fd022ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e9a49b7dc0 0x55e9a49c2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50760/0 (socket says 172.21.15.148:50760) 2024-09-19T07:13:02.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.780+0000 7fd022ffd640 1 -- 172.21.15.148:0/1420761513 learned_addr learned my addr 172.21.15.148:0/1420761513 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:02.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.780+0000 7fd0237fe640 1 --2- 172.21.15.148:0/1420761513 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e9a49b74a0 0x55e9a49b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:02.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.780+0000 7fd01bfff640 1 --2- 172.21.15.148:0/2806555602 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fd0100a3430 0x7fd0100a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:02.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.780+0000 7fd0227fc640 1 --2- 172.21.15.148:0/1420761513 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e9a49c2680 0x55e9a49c4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:02.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.780+0000 7fd0237fe640 1 --2- 172.21.15.148:0/2806555602 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fd0100a3430 0x7fd0100a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:02.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.780+0000 7fd022ffd640 1 -- 172.21.15.148:0/1420761513 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e9a49b74a0 msgr2=0x55e9a49b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:02.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.780+0000 7fd022ffd640 1 --2- 172.21.15.148:0/1420761513 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e9a49b74a0 0x55e9a49b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:02.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.780+0000 7fd022ffd640 1 -- 172.21.15.148:0/1420761513 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e9a49c2680 msgr2=0x55e9a49c4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:02.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.780+0000 7fd022ffd640 1 --2- 172.21.15.148:0/1420761513 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e9a49c2680 0x55e9a49c4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:02.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.780+0000 7fd022ffd640 1 -- 172.21.15.148:0/1420761513 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9a48a9440 con 0x55e9a49b7dc0 2024-09-19T07:13:02.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.781+0000 7fd01bfff640 1 -- 172.21.15.148:0/2806555602 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fd0140f10e0 con 0x7fd0241000d0 2024-09-19T07:13:02.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.781+0000 7fd022ffd640 1 --2- 172.21.15.148:0/1420761513 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e9a49b7dc0 0x55e9a49c2140 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fd0140ee890 tx=0x7fd01404e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=176170929ec5db7b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:02.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.781+0000 7fd0237fe640 1 --2- 172.21.15.148:0/2806555602 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fd0100a3430 0x7fd0100a58f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd01c015500 tx=0x7fd01c004730 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:02.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.781+0000 7fd0197fa640 1 -- 172.21.15.148:0/1420761513 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0140bd340 con 0x55e9a49b7dc0 2024-09-19T07:13:02.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.781+0000 7fd0197fa640 1 -- 172.21.15.148:0/1420761513 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0140751f0 con 0x55e9a49b7dc0 2024-09-19T07:13:02.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.781+0000 7fd0197fa640 1 -- 172.21.15.148:0/1420761513 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd014074ff0 con 0x55e9a49b7dc0 2024-09-19T07:13:02.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.782+0000 7fd02b867740 1 -- 172.21.15.148:0/1420761513 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e9a49b7dc0 msgr2=0x55e9a49c2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:02.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.782+0000 7fd02b867740 1 --2- 172.21.15.148:0/1420761513 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e9a49b7dc0 0x55e9a49c2140 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fd0140ee890 tx=0x7fd01404e000 comp rx=0 tx=0).stop 2024-09-19T07:13:02.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.782+0000 7fd02b867740 1 -- 172.21.15.148:0/1420761513 shutdown_connections 2024-09-19T07:13:02.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.782+0000 7fd02b867740 1 --2- 172.21.15.148:0/1420761513 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e9a49c2680 0x55e9a49c4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:02.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.782+0000 7fd02b867740 1 --2- 172.21.15.148:0/1420761513 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e9a49b7dc0 0x55e9a49c2140 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:02.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.782+0000 7fd02b867740 1 --2- 172.21.15.148:0/1420761513 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e9a49b74a0 0x55e9a49b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:02.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.782+0000 7fd02b867740 1 -- 172.21.15.148:0/1420761513 >> 172.21.15.148:0/1420761513 conn(0x55e9a49b3a30 msgr2=0x55e9a49b3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:02.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.782+0000 7fd02b867740 1 -- 172.21.15.148:0/1420761513 shutdown_connections 2024-09-19T07:13:02.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.782+0000 7fd02b867740 1 -- 172.21.15.148:0/1420761513 wait complete. 2024-09-19T07:13:02.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.782+0000 7fd02b867740 1 -- start start 2024-09-19T07:13:02.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.782+0000 7fd02b867740 1 Processor -- start 2024-09-19T07:13:02.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.782+0000 7fd02b867740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e9a49b74a0 0x55e9a49c1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:02.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.782+0000 7fd02b867740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e9a49b7dc0 0x55e9a49bf250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:02.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.782+0000 7fd02b867740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e9a49c2680 0x55e9a49bf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:02.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.782+0000 7fd02b867740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55e9a491d2e0 con 0x55e9a49b7dc0 2024-09-19T07:13:02.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.782+0000 7fd02b867740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55e9a48d8050 con 0x55e9a49b74a0 2024-09-19T07:13:02.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.782+0000 7fd02b867740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55e9a49c5010 con 0x55e9a49c2680 2024-09-19T07:13:02.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.782+0000 7fd02b867740 10 client.0 _ll_register_callbacks cb 0x55e9a4918160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:13:02.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.782+0000 7fd0227fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e9a49b7dc0 0x55e9a49bf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:02.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.782+0000 7fd0227fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e9a49b7dc0 0x55e9a49bf250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50768/0 (socket says 172.21.15.148:50768) 2024-09-19T07:13:02.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.782+0000 7fd0227fc640 1 -- 172.21.15.148:0/3228592715 learned_addr learned my addr 172.21.15.148:0/3228592715 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:02.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.783+0000 7fd0237fe640 1 --2- 172.21.15.148:0/3228592715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e9a49c2680 0x55e9a49bf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:02.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.783+0000 7fd022ffd640 1 --2- 172.21.15.148:0/3228592715 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e9a49b74a0 0x55e9a49c1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:02.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.783+0000 7fd0227fc640 1 -- 172.21.15.148:0/3228592715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e9a49c2680 msgr2=0x55e9a49bf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:02.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.783+0000 7fd0227fc640 1 --2- 172.21.15.148:0/3228592715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e9a49c2680 0x55e9a49bf790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:02.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.783+0000 7fd0227fc640 1 -- 172.21.15.148:0/3228592715 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e9a49b74a0 msgr2=0x55e9a49c1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:02.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.783+0000 7fd0227fc640 1 --2- 172.21.15.148:0/3228592715 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e9a49b74a0 0x55e9a49c1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:02.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.783+0000 7fd0227fc640 1 -- 172.21.15.148:0/3228592715 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9a468e3c0 con 0x55e9a49b7dc0 2024-09-19T07:13:02.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.783+0000 7fd0227fc640 1 --2- 172.21.15.148:0/3228592715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e9a49b7dc0 0x55e9a49bf250 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fd00c00af80 tx=0x7fd00c00f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98b9f141cc36eb48 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:02.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.783+0000 7fd00a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:13:02.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.783+0000 7fd00a7fc640 1 -- 172.21.15.148:0/3228592715 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd00c005220 con 0x55e9a49b7dc0 2024-09-19T07:13:02.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.783+0000 7fd00a7fc640 1 -- 172.21.15.148:0/3228592715 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fd00c0053c0 con 0x55e9a49b7dc0 2024-09-19T07:13:02.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.783+0000 7fd02b867740 1 -- 172.21.15.148:0/3228592715 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e9a492a850 con 0x55e9a49b7dc0 2024-09-19T07:13:02.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.783+0000 7fd00a7fc640 1 -- 172.21.15.148:0/3228592715 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd00c0055c0 con 0x55e9a49b7dc0 2024-09-19T07:13:02.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.783+0000 7fd02b867740 10 client.15996 fetch_fsmap learned FSMap version 25 2024-09-19T07:13:02.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.783+0000 7fd02b867740 1 -- 172.21.15.148:0/3228592715 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e9a49d07e0 con 0x55e9a49b7dc0 2024-09-19T07:13:02.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.784+0000 7fd00a7fc640 1 -- 172.21.15.148:0/3228592715 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55e9a492a850 con 0x55e9a49b7dc0 2024-09-19T07:13:02.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.784+0000 7fd00a7fc640 1 -- 172.21.15.148:0/3228592715 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd00c011c70 con 0x55e9a49b7dc0 2024-09-19T07:13:02.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.784+0000 7fd02b867740 10 client.15996 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:13:02.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.784+0000 7fd02b867740 10 client.15996 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:13:02.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.784+0000 7fd02b867740 20 client.15996 populate_metadata read hostname 'smithi148' 2024-09-19T07:13:02.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.784+0000 7fd02b867740 1 --2- 172.21.15.148:0/3228592715 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e9a49d1cf0 0x55e9a49d4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:02.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.784+0000 7fd02b867740 4 client.15996 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:13:02.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.784+0000 7fd02b867740 1 -- 172.21.15.148:0/3228592715 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e9a4924d60 con 0x55e9a49d1cf0 2024-09-19T07:13:02.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.784+0000 7fd022ffd640 1 --2- 172.21.15.148:0/3228592715 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e9a49d1cf0 0x55e9a49d4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:02.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.784+0000 7fd022ffd640 1 --2- 172.21.15.148:0/3228592715 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e9a49d1cf0 0x55e9a49d4170 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3fad1e55febe2a5 server_cookie=3ba4651edd44d870 in_seq=0 out_seq=0 2024-09-19T07:13:02.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.784+0000 7fd00a7fc640 10 client.15996 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:13:02.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.785+0000 7fd00a7fc640 1 -- 172.21.15.148:0/3228592715 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e9a4924d60 con 0x55e9a49d1cf0 2024-09-19T07:13:02.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.785+0000 7fd00a7fc640 10 client.15996 handle_command_reply: tid=0 2024-09-19T07:13:02.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.785+0000 7fd02b867740 1 client.15996 shutdown 2024-09-19T07:13:02.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.785+0000 7fd02b867740 1 -- 172.21.15.148:0/3228592715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e9a49b7dc0 msgr2=0x55e9a49bf250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:02.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.785+0000 7fd02b867740 1 --2- 172.21.15.148:0/3228592715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e9a49b7dc0 0x55e9a49bf250 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fd00c00af80 tx=0x7fd00c00f7f0 comp rx=0 tx=0).stop 2024-09-19T07:13:02.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.785+0000 7fd02b867740 1 -- 172.21.15.148:0/3228592715 shutdown_connections 2024-09-19T07:13:02.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.785+0000 7fd02b867740 1 --2- 172.21.15.148:0/3228592715 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e9a49d1cf0 0x55e9a49d4170 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:02.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.785+0000 7fd02b867740 1 --2- 172.21.15.148:0/3228592715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e9a49c2680 0x55e9a49bf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:02.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.785+0000 7fd02b867740 1 --2- 172.21.15.148:0/3228592715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e9a49b7dc0 0x55e9a49bf250 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:02.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.785+0000 7fd00a7fc640 0 client.15996 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:13:02.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.785+0000 7fd02b867740 1 --2- 172.21.15.148:0/3228592715 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e9a49b74a0 0x55e9a49c1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:02.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.785+0000 7fd02b867740 1 -- 172.21.15.148:0/3228592715 >> 172.21.15.148:0/3228592715 conn(0x55e9a49b3a30 msgr2=0x55e9a49b9760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:02.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.785+0000 7fd02b867740 1 -- 172.21.15.148:0/3228592715 shutdown_connections 2024-09-19T07:13:02.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.785+0000 7fd02b867740 1 -- 172.21.15.148:0/3228592715 wait complete. 2024-09-19T07:13:02.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.785+0000 7fd02b867740 20 client.15996 trim_cache size 0 max 16384 2024-09-19T07:13:02.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.802+0000 7fd02b867740 1 Processor -- start 2024-09-19T07:13:02.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.802+0000 7fd02b867740 1 -- start start 2024-09-19T07:13:02.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.803+0000 7fd02b867740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e9a49b74a0 0x55e9a49ce020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:02.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.803+0000 7fd02b867740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e9a49b7dc0 0x55e9a49d9a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:02.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.803+0000 7fd02b867740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e9a49c2680 0x55e9a49d9f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:02.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.803+0000 7fd02b867740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd0241b0100 con 0x55e9a49b7dc0 2024-09-19T07:13:02.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.803+0000 7fd02b867740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd0241ad9d0 con 0x55e9a49c2680 2024-09-19T07:13:02.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.803+0000 7fd02b867740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd0241ab800 con 0x55e9a49b74a0 2024-09-19T07:13:02.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.803+0000 7fd0227fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e9a49b7dc0 0x55e9a49d9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:02.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.803+0000 7fd0227fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e9a49b7dc0 0x55e9a49d9a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50770/0 (socket says 172.21.15.148:50770) 2024-09-19T07:13:02.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.803+0000 7fd0227fc640 1 -- 172.21.15.148:0/687264036 learned_addr learned my addr 172.21.15.148:0/687264036 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:02.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.803+0000 7fd0227fc640 1 -- 172.21.15.148:0/687264036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e9a49b74a0 msgr2=0x55e9a49ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:02.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.803+0000 7fd0227fc640 1 --2- 172.21.15.148:0/687264036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e9a49b74a0 0x55e9a49ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:02.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.803+0000 7fd0237fe640 1 --2- 172.21.15.148:0/687264036 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e9a49c2680 0x55e9a49d9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:02.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.803+0000 7fd0227fc640 1 -- 172.21.15.148:0/687264036 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e9a49c2680 msgr2=0x55e9a49d9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:02.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.803+0000 7fd0227fc640 1 --2- 172.21.15.148:0/687264036 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e9a49c2680 0x55e9a49d9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:02.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.803+0000 7fd0227fc640 1 -- 172.21.15.148:0/687264036 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9a49c1bc0 con 0x55e9a49b7dc0 2024-09-19T07:13:02.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.803+0000 7fd0237fe640 1 --2- 172.21.15.148:0/687264036 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e9a49c2680 0x55e9a49d9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:13:02.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.803+0000 7fd0227fc640 1 --2- 172.21.15.148:0/687264036 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e9a49b7dc0 0x55e9a49d9a40 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fd00c0058c0 tx=0x7fd00c005e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbcb87cf8f57d203 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:02.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.804+0000 7fd018ff9640 1 -- 172.21.15.148:0/687264036 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd00c026040 con 0x55e9a49b7dc0 2024-09-19T07:13:02.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.804+0000 7fd018ff9640 1 -- 172.21.15.148:0/687264036 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd00c019670 con 0x55e9a49b7dc0 2024-09-19T07:13:02.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.804+0000 7fd018ff9640 1 -- 172.21.15.148:0/687264036 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd00c011970 con 0x55e9a49b7dc0 2024-09-19T07:13:02.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.804+0000 7fd02b867740 1 -- 172.21.15.148:0/687264036 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e9a49b7dc0 msgr2=0x55e9a49d9a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:02.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.804+0000 7fd02b867740 1 --2- 172.21.15.148:0/687264036 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e9a49b7dc0 0x55e9a49d9a40 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fd00c0058c0 tx=0x7fd00c005e40 comp rx=0 tx=0).stop 2024-09-19T07:13:02.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.804+0000 7fd02b867740 1 -- 172.21.15.148:0/687264036 shutdown_connections 2024-09-19T07:13:02.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.804+0000 7fd02b867740 1 --2- 172.21.15.148:0/687264036 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e9a49c2680 0x55e9a49d9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:02.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.804+0000 7fd02b867740 1 --2- 172.21.15.148:0/687264036 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e9a49b7dc0 0x55e9a49d9a40 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:02.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.804+0000 7fd02b867740 1 --2- 172.21.15.148:0/687264036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e9a49b74a0 0x55e9a49ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:02.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.804+0000 7fd02b867740 1 -- 172.21.15.148:0/687264036 >> 172.21.15.148:0/687264036 conn(0x55e9a49b3a30 msgr2=0x55e9a49c12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:02.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.804+0000 7fd02b867740 1 -- 172.21.15.148:0/687264036 shutdown_connections 2024-09-19T07:13:02.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.804+0000 7fd02b867740 1 -- 172.21.15.148:0/687264036 wait complete. 2024-09-19T07:13:02.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.805+0000 7fd02b867740 1 -- start start 2024-09-19T07:13:02.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.805+0000 7fd02b867740 1 Processor -- start 2024-09-19T07:13:02.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.805+0000 7fd02b867740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e9a49b74a0 0x55e9a49ca8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:02.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.805+0000 7fd02b867740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e9a49b7dc0 0x55e9a49c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:02.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.805+0000 7fd02b867740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e9a49c2680 0x55e9a49c6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:02.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.805+0000 7fd02b867740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd0241abe90 con 0x55e9a49b7dc0 2024-09-19T07:13:02.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.805+0000 7fd02b867740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd0241ad300 con 0x55e9a49b74a0 2024-09-19T07:13:02.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.805+0000 7fd02b867740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd0241ac560 con 0x55e9a49c2680 2024-09-19T07:13:02.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.805+0000 7fd02b867740 10 client.0 _ll_register_callbacks cb 0x7fd00c00a310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:13:02.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.805+0000 7fd0227fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e9a49b7dc0 0x55e9a49c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:02.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.805+0000 7fd0227fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e9a49b7dc0 0x55e9a49c5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50786/0 (socket says 172.21.15.148:50786) 2024-09-19T07:13:02.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.805+0000 7fd0227fc640 1 -- 172.21.15.148:0/3386178653 learned_addr learned my addr 172.21.15.148:0/3386178653 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:02.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.805+0000 7fd022ffd640 1 --2- 172.21.15.148:0/3386178653 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e9a49b74a0 0x55e9a49ca8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:02.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.805+0000 7fd0237fe640 1 --2- 172.21.15.148:0/3386178653 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e9a49c2680 0x55e9a49c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:02.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.805+0000 7fd0227fc640 1 -- 172.21.15.148:0/3386178653 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e9a49c2680 msgr2=0x55e9a49c6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:02.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.805+0000 7fd0227fc640 1 --2- 172.21.15.148:0/3386178653 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e9a49c2680 0x55e9a49c6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:02.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.805+0000 7fd0227fc640 1 -- 172.21.15.148:0/3386178653 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e9a49b74a0 msgr2=0x55e9a49ca8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:02.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.805+0000 7fd0227fc640 1 --2- 172.21.15.148:0/3386178653 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e9a49b74a0 0x55e9a49ca8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:02.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.805+0000 7fd0227fc640 1 -- 172.21.15.148:0/3386178653 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9a49c6960 con 0x55e9a49b7dc0 2024-09-19T07:13:02.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.806+0000 7fd0227fc640 1 --2- 172.21.15.148:0/3386178653 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e9a49b7dc0 0x55e9a49c5bf0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fd00c000c00 tx=0x7fd00c004350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a24782950080b1b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:02.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.806+0000 7fd00a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:13:02.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.806+0000 7fd00a7fc640 1 -- 172.21.15.148:0/3386178653 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd00c038020 con 0x55e9a49b7dc0 2024-09-19T07:13:02.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.806+0000 7fd00a7fc640 1 -- 172.21.15.148:0/3386178653 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fd00c019a30 con 0x55e9a49b7dc0 2024-09-19T07:13:02.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.806+0000 7fd02b867740 1 -- 172.21.15.148:0/3386178653 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd00c019670 con 0x55e9a49b7dc0 2024-09-19T07:13:02.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.806+0000 7fd00a7fc640 1 -- 172.21.15.148:0/3386178653 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd00c043050 con 0x55e9a49b7dc0 2024-09-19T07:13:02.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.806+0000 7fd02b867740 10 client.16002 fetch_fsmap learned FSMap version 25 2024-09-19T07:13:02.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.806+0000 7fd02b867740 1 -- 172.21.15.148:0/3386178653 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e9a4a3c980 con 0x55e9a49b7dc0 2024-09-19T07:13:02.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.806+0000 7fd00a7fc640 1 -- 172.21.15.148:0/3386178653 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd00c019670 con 0x55e9a49b7dc0 2024-09-19T07:13:02.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.806+0000 7fd00a7fc640 1 -- 172.21.15.148:0/3386178653 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd00c003680 con 0x55e9a49b7dc0 2024-09-19T07:13:02.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.806+0000 7fd02b867740 10 client.16002 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:13:02.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.806+0000 7fd02b867740 10 client.16002 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:13:02.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.806+0000 7fd02b867740 20 client.16002 populate_metadata read hostname 'smithi148' 2024-09-19T07:13:02.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.806+0000 7fd02b867740 1 --2- 172.21.15.148:0/3386178653 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e9a4a3cfb0 0x55e9a4a3f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:02.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.806+0000 7fd02b867740 4 client.16002 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T07:13:02.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.806+0000 7fd02b867740 1 -- 172.21.15.148:0/3386178653 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e9a48a1210 con 0x55e9a4a3cfb0 2024-09-19T07:13:02.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.807+0000 7fd022ffd640 1 --2- 172.21.15.148:0/3386178653 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e9a4a3cfb0 0x55e9a4a3f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:02.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.807+0000 7fd00a7fc640 10 client.16002 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:13:02.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.807+0000 7fd022ffd640 1 --2- 172.21.15.148:0/3386178653 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e9a4a3cfb0 0x55e9a4a3f3d0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa8db1f86f0b6e79 server_cookie=48abba66e207e7ea in_seq=0 out_seq=0 2024-09-19T07:13:02.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.807+0000 7fd00a7fc640 1 -- 172.21.15.148:0/3386178653 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55e9a48a1210 con 0x55e9a4a3cfb0 2024-09-19T07:13:02.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.807+0000 7fd00a7fc640 10 client.16002 handle_command_reply: tid=0 2024-09-19T07:13:02.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.807+0000 7fd02b867740 1 client.16002 shutdown 2024-09-19T07:13:02.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.807+0000 7fd02b867740 1 -- 172.21.15.148:0/3386178653 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e9a49b7dc0 msgr2=0x55e9a49c5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:02.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.807+0000 7fd02b867740 1 --2- 172.21.15.148:0/3386178653 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e9a49b7dc0 0x55e9a49c5bf0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fd00c000c00 tx=0x7fd00c004350 comp rx=0 tx=0).stop 2024-09-19T07:13:02.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.807+0000 7fd02b867740 1 -- 172.21.15.148:0/3386178653 shutdown_connections 2024-09-19T07:13:02.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.807+0000 7fd02b867740 1 --2- 172.21.15.148:0/3386178653 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e9a4a3cfb0 0x55e9a4a3f3d0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:02.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.807+0000 7fd02b867740 1 --2- 172.21.15.148:0/3386178653 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e9a49c2680 0x55e9a49c6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:02.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.807+0000 7fd02b867740 1 --2- 172.21.15.148:0/3386178653 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e9a49b7dc0 0x55e9a49c5bf0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:02.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.807+0000 7fd02b867740 1 --2- 172.21.15.148:0/3386178653 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e9a49b74a0 0x55e9a49ca8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:02.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.807+0000 7fd02b867740 1 -- 172.21.15.148:0/3386178653 >> 172.21.15.148:0/3386178653 conn(0x55e9a49b3a30 msgr2=0x55e9a49bd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:02.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.807+0000 7fd00a7fc640 0 client.16002 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:13:02.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.808+0000 7fd02b867740 1 -- 172.21.15.148:0/3386178653 shutdown_connections 2024-09-19T07:13:02.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.808+0000 7fd02b867740 1 -- 172.21.15.148:0/3386178653 wait complete. 2024-09-19T07:13:02.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.808+0000 7fd02b867740 20 client.16002 trim_cache size 0 max 16384 2024-09-19T07:13:02.826 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:13:02.826 INFO:teuthology.orchestra.run.smithi148.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T07:13:02.826 INFO:teuthology.orchestra.run.smithi148.stdout: "scrubs": { 2024-09-19T07:13:02.826 INFO:teuthology.orchestra.run.smithi148.stdout: "9a0c20ff-b09f-43f6-a57a-8c092ecbf7a1": { 2024-09-19T07:13:02.826 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/", 2024-09-19T07:13:02.826 INFO:teuthology.orchestra.run.smithi148.stdout: "tag": "9a0c20ff-b09f-43f6-a57a-8c092ecbf7a1", 2024-09-19T07:13:02.826 INFO:teuthology.orchestra.run.smithi148.stdout: "options": "recursive,force" 2024-09-19T07:13:02.826 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:13:02.826 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:13:02.826 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:13:02.827 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.808+0000 7fd02948e640 1 -- 172.21.15.148:0/2806555602 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fd0100a3430 msgr2=0x7fd0100a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:02.827 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.808+0000 7fd02948e640 1 --2- 172.21.15.148:0/2806555602 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fd0100a3430 0x7fd0100a58f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd01c015500 tx=0x7fd01c004730 comp rx=0 tx=0).stop 2024-09-19T07:13:02.827 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.808+0000 7fd02948e640 1 -- 172.21.15.148:0/2806555602 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0241000d0 msgr2=0x7fd0241984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:02.827 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.808+0000 7fd02948e640 1 --2- 172.21.15.148:0/2806555602 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0241000d0 0x7fd0241984f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fd014006010 tx=0x7fd014003f10 comp rx=0 tx=0).stop 2024-09-19T07:13:02.827 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.808+0000 7fd02948e640 1 -- 172.21.15.148:0/2806555602 shutdown_connections 2024-09-19T07:13:02.827 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.808+0000 7fd02948e640 1 --2- 172.21.15.148:0/2806555602 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fd0100a3430 0x7fd0100a58f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:02.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.808+0000 7fd02948e640 1 --2- 172.21.15.148:0/2806555602 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd024106ba0 0x7fd02419cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:02.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.808+0000 7fd02948e640 1 --2- 172.21.15.148:0/2806555602 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd024100a70 0x7fd024198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:02.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.808+0000 7fd02948e640 1 --2- 172.21.15.148:0/2806555602 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0241000d0 0x7fd0241984f0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:02.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.808+0000 7fd02948e640 1 -- 172.21.15.148:0/2806555602 >> 172.21.15.148:0/2806555602 conn(0x7fd024077210 msgr2=0x7fd024104c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:02.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.808+0000 7fd02948e640 1 -- 172.21.15.148:0/2806555602 shutdown_connections 2024-09-19T07:13:02.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:02.808+0000 7fd02948e640 1 -- 172.21.15.148:0/2806555602 wait complete. 2024-09-19T07:13:02.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:02 smithi165 ceph-mon[35326]: pgmap v62: 97 pgs: 97 active+clean; 4.9 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 333 KiB/s wr, 44 op/s 2024-09-19T07:13:02.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:02 smithi165 ceph-mon[35326]: scrub queued for path: / 2024-09-19T07:13:02.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:02 smithi165 ceph-mon[35326]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:02.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:02 smithi165 ceph-mon[35326]: scrub summary: active paths [/] 2024-09-19T07:13:02.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:02 smithi165 ceph-mon[35326]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:03.592 INFO:tasks.cephfs.filesystem:scrub status for tag:9a0c20ff-b09f-43f6-a57a-8c092ecbf7a1 - {'path': '/', 'tag': '9a0c20ff-b09f-43f6-a57a-8c092ecbf7a1', 'options': 'recursive,force'} 2024-09-19T07:13:04.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:04 smithi179 ceph-mon[35716]: pgmap v63: 97 pgs: 97 active+clean; 4.9 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 333 KiB/s wr, 44 op/s 2024-09-19T07:13:04.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:04 smithi148 ceph-mon[31180]: pgmap v63: 97 pgs: 97 active+clean; 4.9 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 333 KiB/s wr, 44 op/s 2024-09-19T07:13:04.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:04 smithi165 ceph-mon[35326]: pgmap v63: 97 pgs: 97 active+clean; 4.9 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 333 KiB/s wr, 44 op/s 2024-09-19T07:13:06.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:06 smithi179 ceph-mon[35716]: pgmap v64: 97 pgs: 97 active+clean; 5.5 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 421 KiB/s wr, 103 op/s 2024-09-19T07:13:06.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:06 smithi179 ceph-mon[35716]: scrub summary: idle 2024-09-19T07:13:06.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:06 smithi148 ceph-mon[31180]: pgmap v64: 97 pgs: 97 active+clean; 5.5 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 421 KiB/s wr, 103 op/s 2024-09-19T07:13:06.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:06 smithi148 ceph-mon[31180]: scrub summary: idle 2024-09-19T07:13:06.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:06 smithi165 ceph-mon[35326]: pgmap v64: 97 pgs: 97 active+clean; 5.5 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 421 KiB/s wr, 103 op/s 2024-09-19T07:13:06.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:06 smithi165 ceph-mon[35326]: scrub summary: idle 2024-09-19T07:13:08.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:08 smithi179 ceph-mon[35716]: pgmap v65: 97 pgs: 97 active+clean; 5.5 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 147 KiB/s wr, 69 op/s 2024-09-19T07:13:08.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:08 smithi148 ceph-mon[31180]: pgmap v65: 97 pgs: 97 active+clean; 5.5 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 147 KiB/s wr, 69 op/s 2024-09-19T07:13:08.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:08 smithi165 ceph-mon[35326]: pgmap v65: 97 pgs: 97 active+clean; 5.5 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 147 KiB/s wr, 69 op/s 2024-09-19T07:13:09.705 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:13:09.969 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:13:10.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.440+0000 7f361ce11640 1 -- 172.21.15.148:0/2894215563 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3618101420 msgr2=0x7f361810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:10.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.440+0000 7f361ce11640 1 --2- 172.21.15.148:0/2894215563 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3618101420 0x7f361810d950 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f3610009cd0 tx=0x7f361002a8e0 comp rx=0 tx=0).stop 2024-09-19T07:13:10.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.440+0000 7f361ce11640 1 -- 172.21.15.148:0/2894215563 shutdown_connections 2024-09-19T07:13:10.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.440+0000 7f361ce11640 1 --2- 172.21.15.148:0/2894215563 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3618101420 0x7f361810d950 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:10.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.440+0000 7f361ce11640 1 --2- 172.21.15.148:0/2894215563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3618100a80 0x7f3618100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:10.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.440+0000 7f361ce11640 1 --2- 172.21.15.148:0/2894215563 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3618106a80 0x7f3618106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:10.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.440+0000 7f361ce11640 1 -- 172.21.15.148:0/2894215563 >> 172.21.15.148:0/2894215563 conn(0x7f36180fc7a0 msgr2=0x7f36180febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:10.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.440+0000 7f361ce11640 1 -- 172.21.15.148:0/2894215563 shutdown_connections 2024-09-19T07:13:10.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.440+0000 7f361ce11640 1 -- 172.21.15.148:0/2894215563 wait complete. 2024-09-19T07:13:10.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.441+0000 7f361ce11640 1 Processor -- start 2024-09-19T07:13:10.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.441+0000 7f361ce11640 1 -- start start 2024-09-19T07:13:10.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.441+0000 7f361ce11640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3618100a80 0x7f3618197380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:10.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.441+0000 7f361ce11640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3618101420 0x7f36181978c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:10.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.441+0000 7f361ce11640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3618106a80 0x7f361819bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:10.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.441+0000 7f361ce11640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3618110ea0 con 0x7f3618101420 2024-09-19T07:13:10.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.441+0000 7f361ce11640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3618110d20 con 0x7f3618106a80 2024-09-19T07:13:10.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.441+0000 7f361ce11640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3618111020 con 0x7f3618100a80 2024-09-19T07:13:10.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.441+0000 7f3615d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3618101420 0x7f36181978c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:10.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.441+0000 7f3615d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3618101420 0x7f36181978c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52826/0 (socket says 172.21.15.148:52826) 2024-09-19T07:13:10.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.441+0000 7f3615d9b640 1 -- 172.21.15.148:0/4112926449 learned_addr learned my addr 172.21.15.148:0/4112926449 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:10.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.441+0000 7f3615d9b640 1 -- 172.21.15.148:0/4112926449 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3618100a80 msgr2=0x7f3618197380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:10.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.441+0000 7f361659c640 1 --2- 172.21.15.148:0/4112926449 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3618100a80 0x7f3618197380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:10.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.441+0000 7f3615d9b640 1 --2- 172.21.15.148:0/4112926449 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3618100a80 0x7f3618197380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:10.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.441+0000 7f3616d9d640 1 --2- 172.21.15.148:0/4112926449 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3618106a80 0x7f361819bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:10.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.441+0000 7f3615d9b640 1 -- 172.21.15.148:0/4112926449 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3618106a80 msgr2=0x7f361819bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:10.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.441+0000 7f3615d9b640 1 --2- 172.21.15.148:0/4112926449 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3618106a80 0x7f361819bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:10.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.441+0000 7f3615d9b640 1 -- 172.21.15.148:0/4112926449 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f361819c330 con 0x7f3618101420 2024-09-19T07:13:10.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.442+0000 7f3615d9b640 1 --2- 172.21.15.148:0/4112926449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3618101420 0x7f36181978c0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f360c00b4a0 tx=0x7f360c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:10.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.442+0000 7f36077fe640 1 -- 172.21.15.148:0/4112926449 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f360c014070 con 0x7f3618101420 2024-09-19T07:13:10.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.442+0000 7f361ce11640 1 -- 172.21.15.148:0/4112926449 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f361819c620 con 0x7f3618101420 2024-09-19T07:13:10.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.442+0000 7f36077fe640 1 -- 172.21.15.148:0/4112926449 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f360c010af0 con 0x7f3618101420 2024-09-19T07:13:10.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.442+0000 7f36077fe640 1 -- 172.21.15.148:0/4112926449 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f360c017d10 con 0x7f3618101420 2024-09-19T07:13:10.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.442+0000 7f361ce11640 1 -- 172.21.15.148:0/4112926449 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36181a3f00 con 0x7f3618101420 2024-09-19T07:13:10.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.443+0000 7f361ce11640 1 -- 172.21.15.148:0/4112926449 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3618100ee0 con 0x7f3618101420 2024-09-19T07:13:10.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.444+0000 7f36077fe640 1 -- 172.21.15.148:0/4112926449 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f360c017070 con 0x7f3618101420 2024-09-19T07:13:10.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.445+0000 7f36077fe640 1 --2- 172.21.15.148:0/4112926449 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f36000a33b0 0x7f36000a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:10.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.445+0000 7f361659c640 1 --2- 172.21.15.148:0/4112926449 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f36000a33b0 0x7f36000a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:10.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.445+0000 7f36077fe640 1 -- 172.21.15.148:0/4112926449 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f360c0cf430 con 0x7f3618101420 2024-09-19T07:13:10.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.445+0000 7f361659c640 1 --2- 172.21.15.148:0/4112926449 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f36000a33b0 0x7f36000a5870 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f36080058c0 tx=0x7f3608005c60 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:10.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.448+0000 7f36077fe640 1 -- 172.21.15.148:0/4112926449 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f360c09bf30 con 0x7f3618101420 2024-09-19T07:13:10.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.651+0000 7f361ce11640 1 -- 172.21.15.148:0/4112926449 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f361802d7c0 con 0x7f3618101420 2024-09-19T07:13:10.652 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:10 smithi148 ceph-mon[31180]: pgmap v66: 97 pgs: 97 active+clean; 5.2 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 166 KiB/s wr, 78 op/s 2024-09-19T07:13:10.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.651+0000 7f36077fe640 1 -- 172.21.15.148:0/4112926449 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11939 (secure 0 0 0) 0x7f360c09b830 con 0x7f3618101420 2024-09-19T07:13:10.653 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:13:10.654 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":25,"btime":"2024-09-19T07:11:04:227331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/4263868576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":4263868576},{"type":"v1","addr":"172.21.15.148:6841","nonce":4263868576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24383,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2146820965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2146820965},{"type":"v1","addr":"172.21.15.165:6835","nonce":2146820965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:09:19.543369+0000","modified":"2024-09-19T07:11:03.969598+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24457,"mds_1":24437,"mds_2":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/1566489108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1566489108},{"type":"v1","addr":"172.21.15.179:6835","nonce":1566489108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.165:6839/3993490234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":3993490234},{"type":"v1","addr":"172.21.15.165:6839","nonce":3993490234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24457,"qdb_cluster":[24457,24437,24436]},"id":1}]} 2024-09-19T07:13:10.654 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 25 2024-09-19T07:13:10.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.655+0000 7f361ce11640 1 -- 172.21.15.148:0/4112926449 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f36000a33b0 msgr2=0x7f36000a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:10.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.655+0000 7f361ce11640 1 --2- 172.21.15.148:0/4112926449 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f36000a33b0 0x7f36000a5870 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f36080058c0 tx=0x7f3608005c60 comp rx=0 tx=0).stop 2024-09-19T07:13:10.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.655+0000 7f361ce11640 1 -- 172.21.15.148:0/4112926449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3618101420 msgr2=0x7f36181978c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:10.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.655+0000 7f361ce11640 1 --2- 172.21.15.148:0/4112926449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3618101420 0x7f36181978c0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f360c00b4a0 tx=0x7f360c00b960 comp rx=0 tx=0).stop 2024-09-19T07:13:10.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.655+0000 7f361ce11640 1 -- 172.21.15.148:0/4112926449 shutdown_connections 2024-09-19T07:13:10.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.655+0000 7f361ce11640 1 --2- 172.21.15.148:0/4112926449 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f36000a33b0 0x7f36000a5870 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:10.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.655+0000 7f361ce11640 1 --2- 172.21.15.148:0/4112926449 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3618106a80 0x7f361819bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:10.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.655+0000 7f361ce11640 1 --2- 172.21.15.148:0/4112926449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3618101420 0x7f36181978c0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:10.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.655+0000 7f361ce11640 1 --2- 172.21.15.148:0/4112926449 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3618100a80 0x7f3618197380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:10.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.655+0000 7f361ce11640 1 -- 172.21.15.148:0/4112926449 >> 172.21.15.148:0/4112926449 conn(0x7f36180fc7a0 msgr2=0x7f36180fcf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:10.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.655+0000 7f361ce11640 1 -- 172.21.15.148:0/4112926449 shutdown_connections 2024-09-19T07:13:10.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:10.655+0000 7f361ce11640 1 -- 172.21.15.148:0/4112926449 wait complete. 2024-09-19T07:13:10.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:10 smithi179 ceph-mon[35716]: pgmap v66: 97 pgs: 97 active+clean; 5.2 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 166 KiB/s wr, 78 op/s 2024-09-19T07:13:10.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:10 smithi165 ceph-mon[35326]: pgmap v66: 97 pgs: 97 active+clean; 5.2 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 166 KiB/s wr, 78 op/s 2024-09-19T07:13:11.311 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24457 quiesce db --set-id c09a2bc7 --release --await' 2024-09-19T07:13:11.311 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24457 quiesce db --set-id c09a2bc7 --release --await 2024-09-19T07:13:11.560 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:13:11.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:11 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/4112926449' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:13:11.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:11 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/4112926449' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:13:11.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:11 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/4112926449' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:13:12.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.071+0000 7f2d20bd1640 1 -- 172.21.15.148:0/3785681869 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d1c102790 msgr2=0x7f2d1c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:12.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.071+0000 7f2d20bd1640 1 --2- 172.21.15.148:0/3785681869 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d1c102790 0x7f2d1c1067e0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f2d04009900 tx=0x7f2d0402a410 comp rx=0 tx=0).stop 2024-09-19T07:13:12.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.071+0000 7f2d20bd1640 1 -- 172.21.15.148:0/3785681869 shutdown_connections 2024-09-19T07:13:12.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.071+0000 7f2d20bd1640 1 --2- 172.21.15.148:0/3785681869 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2d1c106f10 0x7f2d1c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.071+0000 7f2d20bd1640 1 --2- 172.21.15.148:0/3785681869 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d1c102790 0x7f2d1c1067e0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.071+0000 7f2d20bd1640 1 --2- 172.21.15.148:0/3785681869 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d1c101de0 0x7f2d1c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.071+0000 7f2d20bd1640 1 -- 172.21.15.148:0/3785681869 >> 172.21.15.148:0/3785681869 conn(0x7f2d1c0fd8c0 msgr2=0x7f2d1c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:12.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.071+0000 7f2d20bd1640 1 -- 172.21.15.148:0/3785681869 shutdown_connections 2024-09-19T07:13:12.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.071+0000 7f2d20bd1640 1 -- 172.21.15.148:0/3785681869 wait complete. 2024-09-19T07:13:12.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.072+0000 7f2d20bd1640 1 Processor -- start 2024-09-19T07:13:12.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.072+0000 7f2d20bd1640 1 -- start start 2024-09-19T07:13:12.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.072+0000 7f2d20bd1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d1c101de0 0x7f2d1c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:12.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.072+0000 7f2d20bd1640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2d1c102790 0x7f2d1c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:12.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.072+0000 7f2d20bd1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d1c106f10 0x7f2d1c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:12.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.072+0000 7f2d20bd1640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1c111f70 con 0x7f2d1c101de0 2024-09-19T07:13:12.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.072+0000 7f2d20bd1640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1c111df0 con 0x7f2d1c102790 2024-09-19T07:13:12.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.072+0000 7f2d20bd1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1c1120f0 con 0x7f2d1c106f10 2024-09-19T07:13:12.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.072+0000 7f2d1a59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d1c101de0 0x7f2d1c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:12.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.072+0000 7f2d1a59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d1c101de0 0x7f2d1c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52854/0 (socket says 172.21.15.148:52854) 2024-09-19T07:13:12.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.072+0000 7f2d1a59c640 1 -- 172.21.15.148:0/446736498 learned_addr learned my addr 172.21.15.148:0/446736498 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:12.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.073+0000 7f2d13fff640 1 --2- 172.21.15.148:0/446736498 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2d1c102790 0x7f2d1c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:12.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.073+0000 7f2d1ad9d640 1 --2- 172.21.15.148:0/446736498 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d1c106f10 0x7f2d1c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:12.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.073+0000 7f2d1a59c640 1 -- 172.21.15.148:0/446736498 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d1c106f10 msgr2=0x7f2d1c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:12.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.073+0000 7f2d1a59c640 1 --2- 172.21.15.148:0/446736498 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d1c106f10 0x7f2d1c074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.073+0000 7f2d1a59c640 1 -- 172.21.15.148:0/446736498 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2d1c102790 msgr2=0x7f2d1c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:12.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.073+0000 7f2d1a59c640 1 --2- 172.21.15.148:0/446736498 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2d1c102790 0x7f2d1c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.073+0000 7f2d1a59c640 1 -- 172.21.15.148:0/446736498 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d1c1a69b0 con 0x7f2d1c101de0 2024-09-19T07:13:12.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.073+0000 7f2d13fff640 1 --2- 172.21.15.148:0/446736498 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2d1c102790 0x7f2d1c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:13:12.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.073+0000 7f2d1a59c640 1 --2- 172.21.15.148:0/446736498 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d1c101de0 0x7f2d1c0744f0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c00c970 tx=0x7f2d0c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:12.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.073+0000 7f2d137fe640 1 -- 172.21.15.148:0/446736498 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c007bb0 con 0x7f2d1c101de0 2024-09-19T07:13:12.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.073+0000 7f2d20bd1640 1 -- 172.21.15.148:0/446736498 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d1c1a6ca0 con 0x7f2d1c101de0 2024-09-19T07:13:12.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.073+0000 7f2d137fe640 1 -- 172.21.15.148:0/446736498 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d0c007d50 con 0x7f2d1c101de0 2024-09-19T07:13:12.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.073+0000 7f2d137fe640 1 -- 172.21.15.148:0/446736498 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c00f450 con 0x7f2d1c101de0 2024-09-19T07:13:12.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.073+0000 7f2d20bd1640 1 -- 172.21.15.148:0/446736498 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d1c1a7190 con 0x7f2d1c101de0 2024-09-19T07:13:12.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.075+0000 7f2d137fe640 1 -- 172.21.15.148:0/446736498 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f2d0c005020 con 0x7f2d1c101de0 2024-09-19T07:13:12.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.076+0000 7f2d22faa740 1 Processor -- start 2024-09-19T07:13:12.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.076+0000 7f2d22faa740 1 -- start start 2024-09-19T07:13:12.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.076+0000 7f2d22faa740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac1bd6b060 0x55ac1bd6b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:12.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.076+0000 7f2d22faa740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac1bd6b980 0x55ac1bd75d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:12.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.076+0000 7f2d22faa740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ac1bd76240 0x55ac1bd78630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:12.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.076+0000 7f2d22faa740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55ac1bcd0620 con 0x55ac1bd6b060 2024-09-19T07:13:12.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.076+0000 7f2d22faa740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ac1bc77e50 con 0x55ac1bd76240 2024-09-19T07:13:12.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.076+0000 7f2d22faa740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ac1bccc5e0 con 0x55ac1bd6b980 2024-09-19T07:13:12.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.076+0000 7f2d1ad9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac1bd6b060 0x55ac1bd6b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:12.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.076+0000 7f2d1ad9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac1bd6b060 0x55ac1bd6b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52866/0 (socket says 172.21.15.148:52866) 2024-09-19T07:13:12.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.076+0000 7f2d1ad9d640 1 -- 172.21.15.148:0/192210146 learned_addr learned my addr 172.21.15.148:0/192210146 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:12.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.076+0000 7f2d137fe640 1 --2- 172.21.15.148:0/446736498 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f2d080a33b0 0x7f2d080a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:12.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.076+0000 7f2d13fff640 1 --2- 172.21.15.148:0/192210146 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ac1bd76240 0x55ac1bd78630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:12.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.077+0000 7f2d1ad9d640 1 -- 172.21.15.148:0/192210146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac1bd6b980 msgr2=0x55ac1bd75d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:12.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.077+0000 7f2d1ad9d640 1 --2- 172.21.15.148:0/192210146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac1bd6b980 0x55ac1bd75d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.077+0000 7f2d1ad9d640 1 -- 172.21.15.148:0/192210146 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ac1bd76240 msgr2=0x55ac1bd78630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:12.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.077+0000 7f2d1ad9d640 1 --2- 172.21.15.148:0/192210146 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ac1bd76240 0x55ac1bd78630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.077+0000 7f2d1ad9d640 1 -- 172.21.15.148:0/192210146 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac1bc68d40 con 0x55ac1bd6b060 2024-09-19T07:13:12.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.077+0000 7f2d13fff640 1 --2- 172.21.15.148:0/192210146 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ac1bd76240 0x55ac1bd78630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:13:12.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.077+0000 7f2d137fe640 1 -- 172.21.15.148:0/446736498 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f2d0c0cfbf0 con 0x7f2d1c101de0 2024-09-19T07:13:12.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.077+0000 7f2d1ad9d640 1 --2- 172.21.15.148:0/446736498 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f2d080a33b0 0x7f2d080a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:12.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.077+0000 7f2d1ad9d640 1 --2- 172.21.15.148:0/192210146 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac1bd6b060 0x55ac1bd6b440 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f2d14008e00 tx=0x7f2d1400d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=550989db764e89c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:12.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.077+0000 7f2d10ff9640 1 -- 172.21.15.148:0/192210146 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d14011dc0 con 0x55ac1bd6b060 2024-09-19T07:13:12.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.077+0000 7f2d10ff9640 1 -- 172.21.15.148:0/192210146 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d1401adc0 con 0x55ac1bd6b060 2024-09-19T07:13:12.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.077+0000 7f2d10ff9640 1 -- 172.21.15.148:0/192210146 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d14019b10 con 0x55ac1bd6b060 2024-09-19T07:13:12.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.077+0000 7f2d1ad9d640 1 --2- 172.21.15.148:0/446736498 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f2d080a33b0 0x7f2d080a5870 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2d1401e000 tx=0x7f2d1401f000 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:12.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.078+0000 7f2d22faa740 1 -- 172.21.15.148:0/192210146 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac1bd6b060 msgr2=0x55ac1bd6b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:12.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.078+0000 7f2d22faa740 1 --2- 172.21.15.148:0/192210146 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac1bd6b060 0x55ac1bd6b440 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f2d14008e00 tx=0x7f2d1400d710 comp rx=0 tx=0).stop 2024-09-19T07:13:12.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.078+0000 7f2d22faa740 1 -- 172.21.15.148:0/192210146 shutdown_connections 2024-09-19T07:13:12.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.078+0000 7f2d22faa740 1 --2- 172.21.15.148:0/192210146 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ac1bd76240 0x55ac1bd78630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.078+0000 7f2d22faa740 1 --2- 172.21.15.148:0/192210146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac1bd6b980 0x55ac1bd75d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.078+0000 7f2d22faa740 1 --2- 172.21.15.148:0/192210146 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac1bd6b060 0x55ac1bd6b440 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.078+0000 7f2d22faa740 1 -- 172.21.15.148:0/192210146 >> 172.21.15.148:0/192210146 conn(0x55ac1bd675f0 msgr2=0x55ac1bd679d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:12.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.078+0000 7f2d22faa740 1 -- 172.21.15.148:0/192210146 shutdown_connections 2024-09-19T07:13:12.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.078+0000 7f2d22faa740 1 -- 172.21.15.148:0/192210146 wait complete. 2024-09-19T07:13:12.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.078+0000 7f2d22faa740 1 -- start start 2024-09-19T07:13:12.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.078+0000 7f2d22faa740 1 Processor -- start 2024-09-19T07:13:12.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.079+0000 7f2d22faa740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ac1bd6b060 0x55ac1bd731d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:12.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.079+0000 7f2d22faa740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac1bd6b980 0x55ac1bd73710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:12.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.079+0000 7f2d22faa740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac1bd76240 0x55ac1bd73c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:12.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.079+0000 7f2d22faa740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55ac1bd78e10 con 0x55ac1bd6b980 2024-09-19T07:13:12.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.079+0000 7f2d22faa740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ac1bc58f10 con 0x55ac1bd6b060 2024-09-19T07:13:12.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.079+0000 7f2d22faa740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ac1bd78f90 con 0x55ac1bd76240 2024-09-19T07:13:12.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.079+0000 7f2d22faa740 10 client.0 _ll_register_callbacks cb 0x55ac1bc7cdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:13:12.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.079+0000 7f2d13fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac1bd6b980 0x55ac1bd73710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:12.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.079+0000 7f2d13fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac1bd6b980 0x55ac1bd73710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52870/0 (socket says 172.21.15.148:52870) 2024-09-19T07:13:12.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.079+0000 7f2d13fff640 1 -- 172.21.15.148:0/3787844290 learned_addr learned my addr 172.21.15.148:0/3787844290 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:12.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.079+0000 7f2d1a59c640 1 --2- 172.21.15.148:0/3787844290 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ac1bd6b060 0x55ac1bd731d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:12.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.079+0000 7f2d1ad9d640 1 --2- 172.21.15.148:0/3787844290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac1bd76240 0x55ac1bd73c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:12.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.079+0000 7f2d13fff640 1 -- 172.21.15.148:0/3787844290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac1bd76240 msgr2=0x55ac1bd73c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:12.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.079+0000 7f2d13fff640 1 --2- 172.21.15.148:0/3787844290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac1bd76240 0x55ac1bd73c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.079+0000 7f2d13fff640 1 -- 172.21.15.148:0/3787844290 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ac1bd6b060 msgr2=0x55ac1bd731d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:12.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.079+0000 7f2d13fff640 1 --2- 172.21.15.148:0/3787844290 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ac1bd6b060 0x55ac1bd731d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.079+0000 7f2d13fff640 1 -- 172.21.15.148:0/3787844290 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac1b9df580 con 0x55ac1bd6b980 2024-09-19T07:13:12.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.079+0000 7f2d1a59c640 1 --2- 172.21.15.148:0/3787844290 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ac1bd6b060 0x55ac1bd731d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:13:12.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.079+0000 7f2d13fff640 1 --2- 172.21.15.148:0/3787844290 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac1bd6b980 0x55ac1bd73710 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f2d0402a930 tx=0x7f2d040042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90fac9083d5fd637 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:12.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.079+0000 7f2d01ffb640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:13:12.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.079+0000 7f2d01ffb640 1 -- 172.21.15.148:0/3787844290 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d04035070 con 0x55ac1bd6b980 2024-09-19T07:13:12.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.079+0000 7f2d22faa740 1 -- 172.21.15.148:0/3787844290 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d1401adc0 con 0x55ac1bd6b980 2024-09-19T07:13:12.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.079+0000 7f2d01ffb640 1 -- 172.21.15.148:0/3787844290 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f2d040037f0 con 0x55ac1bd6b980 2024-09-19T07:13:12.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.080+0000 7f2d01ffb640 1 -- 172.21.15.148:0/3787844290 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2d040044e0 con 0x55ac1bd6b980 2024-09-19T07:13:12.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.080+0000 7f2d22faa740 10 client.16020 fetch_fsmap learned FSMap version 25 2024-09-19T07:13:12.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.080+0000 7f2d22faa740 1 -- 172.21.15.148:0/3787844290 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ac1baa9960 con 0x55ac1bd6b980 2024-09-19T07:13:12.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.080+0000 7f2d01ffb640 1 -- 172.21.15.148:0/3787844290 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d1401adc0 con 0x55ac1bd6b980 2024-09-19T07:13:12.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.080+0000 7f2d01ffb640 1 -- 172.21.15.148:0/3787844290 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2d04044be0 con 0x55ac1bd6b980 2024-09-19T07:13:12.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.080+0000 7f2d22faa740 10 client.16020 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:13:12.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.080+0000 7f2d22faa740 10 client.16020 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:13:12.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.080+0000 7f2d22faa740 20 client.16020 populate_metadata read hostname 'smithi148' 2024-09-19T07:13:12.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.080+0000 7f2d22faa740 1 --2- 172.21.15.148:0/3787844290 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ac1bd85e50 0x55ac1bd88240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:12.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.080+0000 7f2d22faa740 4 client.16020 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:13:12.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.080+0000 7f2d22faa740 1 -- 172.21.15.148:0/3787844290 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ac1bcddb90 con 0x55ac1bd85e50 2024-09-19T07:13:12.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.080+0000 7f2d1a59c640 1 --2- 172.21.15.148:0/3787844290 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ac1bd85e50 0x55ac1bd88240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:12.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.081+0000 7f2d01ffb640 10 client.16020 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:13:12.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.081+0000 7f2d1a59c640 1 --2- 172.21.15.148:0/3787844290 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ac1bd85e50 0x55ac1bd88240 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9bea0820d3d1a803 server_cookie=e2462d3fd1744d17 in_seq=0 out_seq=0 2024-09-19T07:13:12.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.081+0000 7f2d01ffb640 1 -- 172.21.15.148:0/3787844290 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ac1bcddb90 con 0x55ac1bd85e50 2024-09-19T07:13:12.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.081+0000 7f2d01ffb640 10 client.16020 handle_command_reply: tid=0 2024-09-19T07:13:12.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.081+0000 7f2d22faa740 1 client.16020 shutdown 2024-09-19T07:13:12.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.081+0000 7f2d22faa740 1 -- 172.21.15.148:0/3787844290 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac1bd6b980 msgr2=0x55ac1bd73710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:12.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.081+0000 7f2d22faa740 1 --2- 172.21.15.148:0/3787844290 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac1bd6b980 0x55ac1bd73710 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f2d0402a930 tx=0x7f2d040042f0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.081+0000 7f2d22faa740 1 -- 172.21.15.148:0/3787844290 shutdown_connections 2024-09-19T07:13:12.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.082+0000 7f2d22faa740 1 --2- 172.21.15.148:0/3787844290 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ac1bd85e50 0x55ac1bd88240 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.082+0000 7f2d22faa740 1 --2- 172.21.15.148:0/3787844290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac1bd76240 0x55ac1bd73c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.082+0000 7f2d01ffb640 0 client.16020 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:13:12.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.082+0000 7f2d22faa740 1 --2- 172.21.15.148:0/3787844290 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac1bd6b980 0x55ac1bd73710 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.082+0000 7f2d22faa740 1 --2- 172.21.15.148:0/3787844290 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ac1bd6b060 0x55ac1bd731d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.082+0000 7f2d22faa740 1 -- 172.21.15.148:0/3787844290 >> 172.21.15.148:0/3787844290 conn(0x55ac1bd675f0 msgr2=0x55ac1bd6d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:12.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.082+0000 7f2d22faa740 1 -- 172.21.15.148:0/3787844290 shutdown_connections 2024-09-19T07:13:12.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.082+0000 7f2d22faa740 1 -- 172.21.15.148:0/3787844290 wait complete. 2024-09-19T07:13:12.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.082+0000 7f2d22faa740 20 client.16020 trim_cache size 0 max 16384 2024-09-19T07:13:12.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.098+0000 7f2d22faa740 1 Processor -- start 2024-09-19T07:13:12.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.098+0000 7f2d22faa740 1 -- start start 2024-09-19T07:13:12.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.099+0000 7f2d22faa740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac1bd6b060 0x55ac1bd66640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:12.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.099+0000 7f2d22faa740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac1bd6b980 0x55ac1bd8db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:12.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.099+0000 7f2d22faa740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ac1bd76240 0x55ac1bd8e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:12.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.099+0000 7f2d22faa740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1c1b2260 con 0x55ac1bd6b980 2024-09-19T07:13:12.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.099+0000 7f2d22faa740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1c1afb30 con 0x55ac1bd76240 2024-09-19T07:13:12.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.099+0000 7f2d22faa740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1c1ad960 con 0x55ac1bd6b060 2024-09-19T07:13:12.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.099+0000 7f2d13fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac1bd6b980 0x55ac1bd8db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:12.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.099+0000 7f2d13fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac1bd6b980 0x55ac1bd8db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52882/0 (socket says 172.21.15.148:52882) 2024-09-19T07:13:12.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.099+0000 7f2d13fff640 1 -- 172.21.15.148:0/3990901505 learned_addr learned my addr 172.21.15.148:0/3990901505 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:12.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.099+0000 7f2d1a59c640 1 --2- 172.21.15.148:0/3990901505 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac1bd6b060 0x55ac1bd66640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:12.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.099+0000 7f2d1ad9d640 1 --2- 172.21.15.148:0/3990901505 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ac1bd76240 0x55ac1bd8e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:12.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.099+0000 7f2d13fff640 1 -- 172.21.15.148:0/3990901505 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac1bd6b060 msgr2=0x55ac1bd66640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:12.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.099+0000 7f2d13fff640 1 --2- 172.21.15.148:0/3990901505 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac1bd6b060 0x55ac1bd66640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.099+0000 7f2d13fff640 1 -- 172.21.15.148:0/3990901505 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ac1bd76240 msgr2=0x55ac1bd8e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:12.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.099+0000 7f2d13fff640 1 --2- 172.21.15.148:0/3990901505 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ac1bd76240 0x55ac1bd8e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.099+0000 7f2d13fff640 1 -- 172.21.15.148:0/3990901505 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac1bd6ade0 con 0x55ac1bd6b980 2024-09-19T07:13:12.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.099+0000 7f2d1a59c640 1 --2- 172.21.15.148:0/3990901505 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac1bd6b060 0x55ac1bd66640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:13:12.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.099+0000 7f2d13fff640 1 --2- 172.21.15.148:0/3990901505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac1bd6b980 0x55ac1bd8db10 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f2d04009850 tx=0x7f2d04005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b927e8e471b90aaa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:12.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.099+0000 7f2d03fff640 1 -- 172.21.15.148:0/3990901505 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d04035040 con 0x55ac1bd6b980 2024-09-19T07:13:12.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.099+0000 7f2d03fff640 1 -- 172.21.15.148:0/3990901505 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d04005500 con 0x55ac1bd6b980 2024-09-19T07:13:12.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.099+0000 7f2d03fff640 1 -- 172.21.15.148:0/3990901505 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d04004b20 con 0x55ac1bd6b980 2024-09-19T07:13:12.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.100+0000 7f2d22faa740 1 -- 172.21.15.148:0/3990901505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac1bd6b980 msgr2=0x55ac1bd8db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:12.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.100+0000 7f2d22faa740 1 --2- 172.21.15.148:0/3990901505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac1bd6b980 0x55ac1bd8db10 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f2d04009850 tx=0x7f2d04005e80 comp rx=0 tx=0).stop 2024-09-19T07:13:12.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.100+0000 7f2d22faa740 1 -- 172.21.15.148:0/3990901505 shutdown_connections 2024-09-19T07:13:12.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.100+0000 7f2d22faa740 1 --2- 172.21.15.148:0/3990901505 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ac1bd76240 0x55ac1bd8e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.100+0000 7f2d22faa740 1 --2- 172.21.15.148:0/3990901505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac1bd6b980 0x55ac1bd8db10 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.100+0000 7f2d22faa740 1 --2- 172.21.15.148:0/3990901505 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac1bd6b060 0x55ac1bd66640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.100+0000 7f2d22faa740 1 -- 172.21.15.148:0/3990901505 >> 172.21.15.148:0/3990901505 conn(0x55ac1bd675f0 msgr2=0x55ac1bd65f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:12.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.100+0000 7f2d22faa740 1 -- 172.21.15.148:0/3990901505 shutdown_connections 2024-09-19T07:13:12.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.100+0000 7f2d22faa740 1 -- 172.21.15.148:0/3990901505 wait complete. 2024-09-19T07:13:12.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.101+0000 7f2d22faa740 1 -- start start 2024-09-19T07:13:12.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.101+0000 7f2d22faa740 1 Processor -- start 2024-09-19T07:13:12.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.101+0000 7f2d22faa740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac1bd6b060 0x55ac1bd7e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:12.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.101+0000 7f2d22faa740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac1bd6b980 0x55ac1bd7e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:12.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.101+0000 7f2d22faa740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ac1bd76240 0x55ac1bd7b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:12.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.101+0000 7f2d22faa740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1c1adff0 con 0x55ac1bd6b980 2024-09-19T07:13:12.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.101+0000 7f2d22faa740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1c1af460 con 0x55ac1bd76240 2024-09-19T07:13:12.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.101+0000 7f2d22faa740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1c1ae6c0 con 0x55ac1bd6b060 2024-09-19T07:13:12.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.101+0000 7f2d22faa740 10 client.0 _ll_register_callbacks cb 0x7f2d04031ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:13:12.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.101+0000 7f2d13fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac1bd6b980 0x55ac1bd7e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:12.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.101+0000 7f2d13fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac1bd6b980 0x55ac1bd7e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52892/0 (socket says 172.21.15.148:52892) 2024-09-19T07:13:12.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.101+0000 7f2d13fff640 1 -- 172.21.15.148:0/2721617803 learned_addr learned my addr 172.21.15.148:0/2721617803 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:12.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.101+0000 7f2d1a59c640 1 --2- 172.21.15.148:0/2721617803 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac1bd6b060 0x55ac1bd7e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:12.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.101+0000 7f2d1ad9d640 1 --2- 172.21.15.148:0/2721617803 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ac1bd76240 0x55ac1bd7b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:12.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.101+0000 7f2d13fff640 1 -- 172.21.15.148:0/2721617803 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac1bd6b060 msgr2=0x55ac1bd7e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:12.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.101+0000 7f2d13fff640 1 --2- 172.21.15.148:0/2721617803 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac1bd6b060 0x55ac1bd7e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.101+0000 7f2d13fff640 1 -- 172.21.15.148:0/2721617803 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ac1bd76240 msgr2=0x55ac1bd7b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:12.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.101+0000 7f2d13fff640 1 --2- 172.21.15.148:0/2721617803 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ac1bd76240 0x55ac1bd7b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.101+0000 7f2d13fff640 1 -- 172.21.15.148:0/2721617803 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac1bd7b9b0 con 0x55ac1bd6b980 2024-09-19T07:13:12.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.101+0000 7f2d1a59c640 1 --2- 172.21.15.148:0/2721617803 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac1bd6b060 0x55ac1bd7e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:13:12.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.102+0000 7f2d13fff640 1 --2- 172.21.15.148:0/2721617803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac1bd6b980 0x55ac1bd7e900 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f2d0402a450 tx=0x7f2d0403bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f8197ee0c3568d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:12.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.102+0000 7f2d01ffb640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:13:12.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.102+0000 7f2d01ffb640 1 -- 172.21.15.148:0/2721617803 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d04035050 con 0x55ac1bd6b980 2024-09-19T07:13:12.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.102+0000 7f2d01ffb640 1 -- 172.21.15.148:0/2721617803 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f2d040046c0 con 0x55ac1bd6b980 2024-09-19T07:13:12.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.102+0000 7f2d22faa740 1 -- 172.21.15.148:0/2721617803 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d04005500 con 0x55ac1bd6b980 2024-09-19T07:13:12.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.102+0000 7f2d01ffb640 1 -- 172.21.15.148:0/2721617803 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2d040042f0 con 0x55ac1bd6b980 2024-09-19T07:13:12.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.102+0000 7f2d22faa740 10 client.16026 fetch_fsmap learned FSMap version 25 2024-09-19T07:13:12.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.102+0000 7f2d22faa740 1 -- 172.21.15.148:0/2721617803 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ac1bdf15b0 con 0x55ac1bd6b980 2024-09-19T07:13:12.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.102+0000 7f2d01ffb640 1 -- 172.21.15.148:0/2721617803 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d04005500 con 0x55ac1bd6b980 2024-09-19T07:13:12.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.102+0000 7f2d01ffb640 1 -- 172.21.15.148:0/2721617803 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2d04003a00 con 0x55ac1bd6b980 2024-09-19T07:13:12.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.102+0000 7f2d22faa740 10 client.16026 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:13:12.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.102+0000 7f2d22faa740 10 client.16026 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:13:12.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.102+0000 7f2d22faa740 20 client.16026 populate_metadata read hostname 'smithi148' 2024-09-19T07:13:12.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.102+0000 7f2d22faa740 1 --2- 172.21.15.148:0/2721617803 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ac1bdf1c90 0x55ac1bdf40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:12.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.102+0000 7f2d22faa740 4 client.16026 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "c09a2bc7", "release": true, "await": true}] 2024-09-19T07:13:12.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.102+0000 7f2d22faa740 1 -- 172.21.15.148:0/2721617803 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "quiesce db", "set_id": "c09a2bc7", "release": true, "await": true}) -- 0x55ac1bcd80a0 con 0x55ac1bdf1c90 2024-09-19T07:13:12.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.103+0000 7f2d1a59c640 1 --2- 172.21.15.148:0/2721617803 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ac1bdf1c90 0x55ac1bdf40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:12.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.103+0000 7f2d01ffb640 10 client.16026 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:13:12.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.103+0000 7f2d1a59c640 1 --2- 172.21.15.148:0/2721617803 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ac1bdf1c90 0x55ac1bdf40b0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8cb79d76a2a983a3 server_cookie=db330f4dfd9ac7e1 in_seq=0 out_seq=0 2024-09-19T07:13:12.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.109+0000 7f2d01ffb640 1 -- 172.21.15.148:0/2721617803 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55ac1bcd80a0 con 0x55ac1bdf1c90 2024-09-19T07:13:12.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.109+0000 7f2d01ffb640 10 client.16026 handle_command_reply: tid=0 2024-09-19T07:13:12.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.109+0000 7f2d22faa740 1 client.16026 shutdown 2024-09-19T07:13:12.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.110+0000 7f2d22faa740 1 -- 172.21.15.148:0/2721617803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac1bd6b980 msgr2=0x55ac1bd7e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:12.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.110+0000 7f2d22faa740 1 --2- 172.21.15.148:0/2721617803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac1bd6b980 0x55ac1bd7e900 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f2d0402a450 tx=0x7f2d0403bd70 comp rx=0 tx=0).stop 2024-09-19T07:13:12.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.110+0000 7f2d22faa740 1 -- 172.21.15.148:0/2721617803 shutdown_connections 2024-09-19T07:13:12.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.110+0000 7f2d22faa740 1 --2- 172.21.15.148:0/2721617803 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ac1bdf1c90 0x55ac1bdf40b0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.110+0000 7f2d22faa740 1 --2- 172.21.15.148:0/2721617803 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ac1bd76240 0x55ac1bd7b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.110+0000 7f2d22faa740 1 --2- 172.21.15.148:0/2721617803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac1bd6b980 0x55ac1bd7e900 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.110+0000 7f2d22faa740 1 --2- 172.21.15.148:0/2721617803 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac1bd6b060 0x55ac1bd7e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.110+0000 7f2d01ffb640 0 client.16026 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:13:12.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.110+0000 7f2d22faa740 1 -- 172.21.15.148:0/2721617803 >> 172.21.15.148:0/2721617803 conn(0x55ac1bd675f0 msgr2=0x55ac1bd66750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:12.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.110+0000 7f2d22faa740 1 -- 172.21.15.148:0/2721617803 shutdown_connections 2024-09-19T07:13:12.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.110+0000 7f2d22faa740 1 -- 172.21.15.148:0/2721617803 wait complete. 2024-09-19T07:13:12.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.110+0000 7f2d22faa740 20 client.16026 trim_cache size 0 max 16384 2024-09-19T07:13:12.119 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:13:12.119 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 25, 2024-09-19T07:13:12.119 INFO:teuthology.orchestra.run.smithi148.stdout: "leader": 24457, 2024-09-19T07:13:12.119 INFO:teuthology.orchestra.run.smithi148.stdout: "set_version": 12, 2024-09-19T07:13:12.119 INFO:teuthology.orchestra.run.smithi148.stdout: "sets": { 2024-09-19T07:13:12.119 INFO:teuthology.orchestra.run.smithi148.stdout: "c09a2bc7": { 2024-09-19T07:13:12.119 INFO:teuthology.orchestra.run.smithi148.stdout: "version": 12, 2024-09-19T07:13:12.119 INFO:teuthology.orchestra.run.smithi148.stdout: "age_ref": 0.0, 2024-09-19T07:13:12.119 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:13:12.119 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RELEASED", 2024-09-19T07:13:12.119 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:13:12.119 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:13:12.120 INFO:teuthology.orchestra.run.smithi148.stdout: "timeout": 90.0, 2024-09-19T07:13:12.120 INFO:teuthology.orchestra.run.smithi148.stdout: "expiration": 140.3, 2024-09-19T07:13:12.120 INFO:teuthology.orchestra.run.smithi148.stdout: "members": { 2024-09-19T07:13:12.120 INFO:teuthology.orchestra.run.smithi148.stdout: "file:/": { 2024-09-19T07:13:12.120 INFO:teuthology.orchestra.run.smithi148.stdout: "excluded": false, 2024-09-19T07:13:12.120 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:13:12.120 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RELEASED", 2024-09-19T07:13:12.121 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:13:12.121 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:13:12.121 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:13:12.121 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:13:12.121 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:13:12.121 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:13:12.121 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:13:12.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.110+0000 7f2d20bd1640 1 -- 172.21.15.148:0/446736498 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f2d080a33b0 msgr2=0x7f2d080a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:12.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.110+0000 7f2d20bd1640 1 --2- 172.21.15.148:0/446736498 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f2d080a33b0 0x7f2d080a5870 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2d1401e000 tx=0x7f2d1401f000 comp rx=0 tx=0).stop 2024-09-19T07:13:12.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.110+0000 7f2d20bd1640 1 -- 172.21.15.148:0/446736498 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d1c101de0 msgr2=0x7f2d1c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:12.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.110+0000 7f2d20bd1640 1 --2- 172.21.15.148:0/446736498 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d1c101de0 0x7f2d1c0744f0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c00c970 tx=0x7f2d0c00ce30 comp rx=0 tx=0).stop 2024-09-19T07:13:12.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.110+0000 7f2d20bd1640 1 -- 172.21.15.148:0/446736498 shutdown_connections 2024-09-19T07:13:12.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.110+0000 7f2d20bd1640 1 --2- 172.21.15.148:0/446736498 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f2d080a33b0 0x7f2d080a5870 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.110+0000 7f2d20bd1640 1 --2- 172.21.15.148:0/446736498 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d1c106f10 0x7f2d1c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.110+0000 7f2d20bd1640 1 --2- 172.21.15.148:0/446736498 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2d1c102790 0x7f2d1c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.110+0000 7f2d20bd1640 1 --2- 172.21.15.148:0/446736498 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d1c101de0 0x7f2d1c0744f0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.110+0000 7f2d20bd1640 1 -- 172.21.15.148:0/446736498 >> 172.21.15.148:0/446736498 conn(0x7f2d1c0fd8c0 msgr2=0x7f2d1c0fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:12.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.111+0000 7f2d20bd1640 1 -- 172.21.15.148:0/446736498 shutdown_connections 2024-09-19T07:13:12.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:12.111+0000 7f2d20bd1640 1 -- 172.21.15.148:0/446736498 wait complete. 2024-09-19T07:13:12.235 INFO:tasks.workunit.client.0.smithi148.stderr:+ make 2024-09-19T07:13:12.248 INFO:tasks.workunit.client.0.smithi148.stdout:make all-recursive 2024-09-19T07:13:12.250 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-19T07:13:12.252 INFO:tasks.workunit.client.0.smithi148.stdout:Making all in src 2024-09-19T07:13:12.256 INFO:tasks.workunit.client.0.smithi148.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2024-09-19T07:13:12.256 INFO:tasks.workunit.client.0.smithi148.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT blogbench.o -MD -MP -MF ".deps/blogbench.Tpo" -c -o blogbench.o blogbench.c; \ 2024-09-19T07:13:12.256 INFO:tasks.workunit.client.0.smithi148.stdout:then mv -f ".deps/blogbench.Tpo" ".deps/blogbench.Po"; else rm -f ".deps/blogbench.Tpo"; exit 1; fi 2024-09-19T07:13:12.403 INFO:tasks.workunit.client.0.smithi148.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT process.o -MD -MP -MF ".deps/process.Tpo" -c -o process.o process.c; \ 2024-09-19T07:13:12.404 INFO:tasks.workunit.client.0.smithi148.stdout:then mv -f ".deps/process.Tpo" ".deps/process.Po"; else rm -f ".deps/process.Tpo"; exit 1; fi 2024-09-19T07:13:12.490 INFO:tasks.workunit.client.0.smithi148.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT writer.o -MD -MP -MF ".deps/writer.Tpo" -c -o writer.o writer.c; \ 2024-09-19T07:13:12.490 INFO:tasks.workunit.client.0.smithi148.stdout:then mv -f ".deps/writer.Tpo" ".deps/writer.Po"; else rm -f ".deps/writer.Tpo"; exit 1; fi 2024-09-19T07:13:12.542 INFO:tasks.workunit.client.0.smithi148.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT rewriter.o -MD -MP -MF ".deps/rewriter.Tpo" -c -o rewriter.o rewriter.c; \ 2024-09-19T07:13:12.542 INFO:tasks.workunit.client.0.smithi148.stdout:then mv -f ".deps/rewriter.Tpo" ".deps/rewriter.Po"; else rm -f ".deps/rewriter.Tpo"; exit 1; fi 2024-09-19T07:13:12.596 INFO:tasks.workunit.client.0.smithi148.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT reader.o -MD -MP -MF ".deps/reader.Tpo" -c -o reader.o reader.c; \ 2024-09-19T07:13:12.596 INFO:tasks.workunit.client.0.smithi148.stdout:then mv -f ".deps/reader.Tpo" ".deps/reader.Po"; else rm -f ".deps/reader.Tpo"; exit 1; fi 2024-09-19T07:13:12.647 INFO:tasks.workunit.client.0.smithi148.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT commenter.o -MD -MP -MF ".deps/commenter.Tpo" -c -o commenter.o commenter.c; \ 2024-09-19T07:13:12.647 INFO:tasks.workunit.client.0.smithi148.stdout:then mv -f ".deps/commenter.Tpo" ".deps/commenter.Po"; else rm -f ".deps/commenter.Tpo"; exit 1; fi 2024-09-19T07:13:12.695 INFO:tasks.workunit.client.0.smithi148.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT helpers.o -MD -MP -MF ".deps/helpers.Tpo" -c -o helpers.o helpers.c; \ 2024-09-19T07:13:12.695 INFO:tasks.workunit.client.0.smithi148.stdout:then mv -f ".deps/helpers.Tpo" ".deps/helpers.Po"; else rm -f ".deps/helpers.Tpo"; exit 1; fi 2024-09-19T07:13:12.701 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:12 smithi148 ceph-mon[31180]: pgmap v67: 97 pgs: 97 active+clean; 5.2 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 107 KiB/s wr, 67 op/s 2024-09-19T07:13:12.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:12 smithi179 ceph-mon[35716]: pgmap v67: 97 pgs: 97 active+clean; 5.2 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 107 KiB/s wr, 67 op/s 2024-09-19T07:13:12.785 INFO:tasks.workunit.client.0.smithi148.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT bsd-getopt_long.o -MD -MP -MF ".deps/bsd-getopt_long.Tpo" -c -o bsd-getopt_long.o bsd-getopt_long.c; \ 2024-09-19T07:13:12.785 INFO:tasks.workunit.client.0.smithi148.stdout:then mv -f ".deps/bsd-getopt_long.Tpo" ".deps/bsd-getopt_long.Po"; else rm -f ".deps/bsd-getopt_long.Tpo"; exit 1; fi 2024-09-19T07:13:12.820 INFO:tasks.workunit.client.0.smithi148.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT fakesnprintf.o -MD -MP -MF ".deps/fakesnprintf.Tpo" -c -o fakesnprintf.o fakesnprintf.c; \ 2024-09-19T07:13:12.820 INFO:tasks.workunit.client.0.smithi148.stdout:then mv -f ".deps/fakesnprintf.Tpo" ".deps/fakesnprintf.Po"; else rm -f ".deps/fakesnprintf.Tpo"; exit 1; fi 2024-09-19T07:13:12.863 INFO:tasks.workunit.client.0.smithi148.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT mysnprintf.o -MD -MP -MF ".deps/mysnprintf.Tpo" -c -o mysnprintf.o mysnprintf.c; \ 2024-09-19T07:13:12.864 INFO:tasks.workunit.client.0.smithi148.stdout:then mv -f ".deps/mysnprintf.Tpo" ".deps/mysnprintf.Po"; else rm -f ".deps/mysnprintf.Tpo"; exit 1; fi 2024-09-19T07:13:12.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:12 smithi165 ceph-mon[35326]: pgmap v67: 97 pgs: 97 active+clean; 5.2 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 107 KiB/s wr, 67 op/s 2024-09-19T07:13:12.898 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.894+0000 7effbe477640 1 -- 172.21.15.148:0/4254609440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effb8101370 msgr2=0x7effb810d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:12.898 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.894+0000 7effbe477640 1 --2- 172.21.15.148:0/4254609440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effb8101370 0x7effb810d8a0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7effb0009cd0 tx=0x7effb002a8e0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.898 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.894+0000 7effbe477640 1 -- 172.21.15.148:0/4254609440 shutdown_connections 2024-09-19T07:13:12.898 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.894+0000 7effbe477640 1 --2- 172.21.15.148:0/4254609440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effb8101370 0x7effb810d8a0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.898 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.894+0000 7effbe477640 1 --2- 172.21.15.148:0/4254609440 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7effb81009d0 0x7effb8100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.898 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.894+0000 7effbe477640 1 --2- 172.21.15.148:0/4254609440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effb81069e0 0x7effb8106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.898 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.895+0000 7effbe477640 1 -- 172.21.15.148:0/4254609440 >> 172.21.15.148:0/4254609440 conn(0x7effb80fc6b0 msgr2=0x7effb80fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:12.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.895+0000 7effbe477640 1 -- 172.21.15.148:0/4254609440 shutdown_connections 2024-09-19T07:13:12.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.895+0000 7effbe477640 1 -- 172.21.15.148:0/4254609440 wait complete. 2024-09-19T07:13:12.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.895+0000 7effbe477640 1 Processor -- start 2024-09-19T07:13:12.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.895+0000 7effbe477640 1 -- start start 2024-09-19T07:13:12.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.896+0000 7effbe477640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7effb81009d0 0x7effb8196f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:12.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.896+0000 7effbe477640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effb8101370 0x7effb81974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:12.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.896+0000 7effbe477640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effb81069e0 0x7effb8197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:12.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.896+0000 7effbe477640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7effb8110e20 con 0x7effb81069e0 2024-09-19T07:13:12.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.896+0000 7effbe477640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7effb8110ca0 con 0x7effb81009d0 2024-09-19T07:13:12.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.896+0000 7effbe477640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7effb8110fa0 con 0x7effb8101370 2024-09-19T07:13:12.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.896+0000 7effbca14640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effb81069e0 0x7effb8197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:12.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.896+0000 7effb77fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effb8101370 0x7effb81974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:12.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.896+0000 7effbca14640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effb81069e0 0x7effb8197a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52916/0 (socket says 172.21.15.148:52916) 2024-09-19T07:13:12.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.896+0000 7effb77fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effb8101370 0x7effb81974c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:53436/0 (socket says 172.21.15.148:53436) 2024-09-19T07:13:12.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.896+0000 7effbca14640 1 -- 172.21.15.148:0/984436416 learned_addr learned my addr 172.21.15.148:0/984436416 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:12.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.896+0000 7effb7fff640 1 --2- 172.21.15.148:0/984436416 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7effb81009d0 0x7effb8196f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:12.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.896+0000 7effb77fe640 1 -- 172.21.15.148:0/984436416 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7effb81009d0 msgr2=0x7effb8196f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:12.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.896+0000 7effb77fe640 1 --2- 172.21.15.148:0/984436416 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7effb81009d0 0x7effb8196f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.896+0000 7effb77fe640 1 -- 172.21.15.148:0/984436416 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effb81069e0 msgr2=0x7effb8197a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:12.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.896+0000 7effb77fe640 1 --2- 172.21.15.148:0/984436416 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effb81069e0 0x7effb8197a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.896+0000 7effb77fe640 1 -- 172.21.15.148:0/984436416 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb81a67f0 con 0x7effb8101370 2024-09-19T07:13:12.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.896+0000 7effbca14640 1 --2- 172.21.15.148:0/984436416 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effb81069e0 0x7effb8197a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:13:12.901 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.896+0000 7effb77fe640 1 --2- 172.21.15.148:0/984436416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effb8101370 0x7effb81974c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7effac005fd0 tx=0x7effac00dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:12.901 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.897+0000 7effb57fa640 1 -- 172.21.15.148:0/984436416 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effac009c30 con 0x7effb8101370 2024-09-19T07:13:12.901 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.897+0000 7effbe477640 1 -- 172.21.15.148:0/984436416 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effb81a6ae0 con 0x7effb8101370 2024-09-19T07:13:12.901 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.897+0000 7effb57fa640 1 -- 172.21.15.148:0/984436416 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7effac009dd0 con 0x7effb8101370 2024-09-19T07:13:12.901 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.897+0000 7effb57fa640 1 -- 172.21.15.148:0/984436416 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effac010460 con 0x7effb8101370 2024-09-19T07:13:12.901 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.897+0000 7effbe477640 1 -- 172.21.15.148:0/984436416 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effb81a7030 con 0x7effb8101370 2024-09-19T07:13:12.902 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.899+0000 7effc1213740 1 Processor -- start 2024-09-19T07:13:12.902 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.899+0000 7effb57fa640 1 -- 172.21.15.148:0/984436416 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7effac003f50 con 0x7effb8101370 2024-09-19T07:13:12.903 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.899+0000 7effc1213740 1 -- start start 2024-09-19T07:13:12.903 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.899+0000 7effc1213740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633420eaaf0 0x5633420eaed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:12.903 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.899+0000 7effc1213740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633420eb410 0x5633420f5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:12.903 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.899+0000 7effc1213740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633420f5cb0 0x5633420f80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:12.903 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.899+0000 7effc1213740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56334204f2f0 con 0x5633420f5cb0 2024-09-19T07:13:12.903 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.899+0000 7effc1213740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x563341ff7270 con 0x5633420eb410 2024-09-19T07:13:12.903 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.899+0000 7effc1213740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56334204b2b0 con 0x5633420eaaf0 2024-09-19T07:13:12.903 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.900+0000 7effbca14640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633420eaaf0 0x5633420eaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:12.903 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.900+0000 7effbca14640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633420eaaf0 0x5633420eaed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:53452/0 (socket says 172.21.15.148:53452) 2024-09-19T07:13:12.903 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.900+0000 7effbca14640 1 -- 172.21.15.148:0/2715145458 learned_addr learned my addr 172.21.15.148:0/2715145458 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:12.903 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.900+0000 7effb77fe640 1 --2- 172.21.15.148:0/2715145458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633420f5cb0 0x5633420f80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:12.903 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.900+0000 7effb7fff640 1 --2- 172.21.15.148:0/2715145458 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633420eb410 0x5633420f5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:12.904 INFO:tasks.workunit.client.0.smithi148.stdout:gcc -g -O2 -o blogbench blogbench.o process.o writer.o rewriter.o reader.o commenter.o helpers.o bsd-getopt_long.o fakesnprintf.o mysnprintf.o 2024-09-19T07:13:12.909 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.900+0000 7effb57fa640 1 --2- 172.21.15.148:0/984436416 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7effa00a3460 0x7effa00a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:12.909 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.900+0000 7effb7fff640 1 -- 172.21.15.148:0/2715145458 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633420eaaf0 msgr2=0x5633420eaed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:12.909 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.900+0000 7effb7fff640 1 --2- 172.21.15.148:0/2715145458 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633420eaaf0 0x5633420eaed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.909 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.900+0000 7effb7fff640 1 -- 172.21.15.148:0/2715145458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633420f5cb0 msgr2=0x5633420f80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:12.909 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.900+0000 7effb7fff640 1 --2- 172.21.15.148:0/2715145458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633420f5cb0 0x5633420f80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.909 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.900+0000 7effb7fff640 1 -- 172.21.15.148:0/2715145458 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563341ff6340 con 0x5633420eb410 2024-09-19T07:13:12.909 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.900+0000 7effbca14640 1 --2- 172.21.15.148:0/2715145458 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633420eaaf0 0x5633420eaed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:13:12.909 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.900+0000 7effb57fa640 1 -- 172.21.15.148:0/984436416 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7effac0cf890 con 0x7effb8101370 2024-09-19T07:13:12.909 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.900+0000 7effbca14640 1 --2- 172.21.15.148:0/984436416 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7effa00a3460 0x7effa00a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:12.909 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.900+0000 7effb7fff640 1 --2- 172.21.15.148:0/2715145458 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633420eb410 0x5633420f5770 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7effa8009c20 tx=0x7effa8011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a6bc7eb8a771264 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:12.909 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.901+0000 7eff9e7fc640 1 -- 172.21.15.148:0/2715145458 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa8004050 con 0x5633420eb410 2024-09-19T07:13:12.910 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.901+0000 7effbca14640 1 --2- 172.21.15.148:0/984436416 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7effa00a3460 0x7effa00a5920 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7effb0031860 tx=0x7effb00095c0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:12.910 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.901+0000 7eff9e7fc640 1 -- 172.21.15.148:0/2715145458 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7effa8005500 con 0x5633420eb410 2024-09-19T07:13:12.910 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.901+0000 7eff9e7fc640 1 -- 172.21.15.148:0/2715145458 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa8004e00 con 0x5633420eb410 2024-09-19T07:13:12.910 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.902+0000 7effc1213740 1 -- 172.21.15.148:0/2715145458 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633420eb410 msgr2=0x5633420f5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:12.910 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.902+0000 7effc1213740 1 --2- 172.21.15.148:0/2715145458 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633420eb410 0x5633420f5770 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7effa8009c20 tx=0x7effa8011810 comp rx=0 tx=0).stop 2024-09-19T07:13:12.910 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.902+0000 7effc1213740 1 -- 172.21.15.148:0/2715145458 shutdown_connections 2024-09-19T07:13:12.910 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.902+0000 7effc1213740 1 --2- 172.21.15.148:0/2715145458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633420f5cb0 0x5633420f80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.910 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.902+0000 7effc1213740 1 --2- 172.21.15.148:0/2715145458 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633420eb410 0x5633420f5770 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.910 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.902+0000 7effc1213740 1 --2- 172.21.15.148:0/2715145458 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633420eaaf0 0x5633420eaed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.910 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.902+0000 7effc1213740 1 -- 172.21.15.148:0/2715145458 >> 172.21.15.148:0/2715145458 conn(0x5633420e7060 msgr2=0x5633420e7440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:12.911 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.902+0000 7effc1213740 1 -- 172.21.15.148:0/2715145458 shutdown_connections 2024-09-19T07:13:12.911 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.902+0000 7effc1213740 1 -- 172.21.15.148:0/2715145458 wait complete. 2024-09-19T07:13:12.911 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.902+0000 7effc1213740 1 -- start start 2024-09-19T07:13:12.911 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.903+0000 7effc1213740 1 Processor -- start 2024-09-19T07:13:12.911 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.903+0000 7effc1213740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633420eaaf0 0x5633420f2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:12.911 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.903+0000 7effc1213740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633420eb410 0x5633420f3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:12.911 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.903+0000 7effc1213740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633420f5cb0 0x5633420f3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:12.911 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.903+0000 7effc1213740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5633420f8880 con 0x5633420f5cb0 2024-09-19T07:13:12.911 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.903+0000 7effc1213740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x563341fd8290 con 0x5633420eaaf0 2024-09-19T07:13:12.911 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.903+0000 7effc1213740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5633420f8a00 con 0x5633420eb410 2024-09-19T07:13:12.911 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.903+0000 7effc1213740 10 client.0 _ll_register_callbacks cb 0x563342009140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:13:12.912 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.903+0000 7effbca14640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633420f5cb0 0x5633420f3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:12.912 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.903+0000 7effbca14640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633420f5cb0 0x5633420f3640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52928/0 (socket says 172.21.15.148:52928) 2024-09-19T07:13:12.912 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.903+0000 7effbca14640 1 -- 172.21.15.148:0/187390322 learned_addr learned my addr 172.21.15.148:0/187390322 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:12.912 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.903+0000 7effb7fff640 1 --2- 172.21.15.148:0/187390322 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633420eaaf0 0x5633420f2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:12.912 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.903+0000 7effb77fe640 1 --2- 172.21.15.148:0/187390322 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633420eb410 0x5633420f3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:12.912 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.904+0000 7effb7fff640 1 -- 172.21.15.148:0/187390322 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633420eb410 msgr2=0x5633420f3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:12.912 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.904+0000 7effb7fff640 1 --2- 172.21.15.148:0/187390322 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633420eb410 0x5633420f3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.912 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.904+0000 7effb7fff640 1 -- 172.21.15.148:0/187390322 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633420f5cb0 msgr2=0x5633420f3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:12.912 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.904+0000 7effb7fff640 1 --2- 172.21.15.148:0/187390322 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633420f5cb0 0x5633420f3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.912 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.904+0000 7effb7fff640 1 -- 172.21.15.148:0/187390322 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563341d62210 con 0x5633420eaaf0 2024-09-19T07:13:12.912 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.904+0000 7effbca14640 1 --2- 172.21.15.148:0/187390322 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633420f5cb0 0x5633420f3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:13:12.912 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.904+0000 7effb7fff640 1 --2- 172.21.15.148:0/187390322 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633420eaaf0 0x5633420f2bc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7effa801b040 tx=0x7effa80056b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ff934d7c415377b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:12.912 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.904+0000 7eff977fe640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-19T07:13:12.913 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.904+0000 7eff977fe640 1 -- 172.21.15.148:0/187390322 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa8004d80 con 0x5633420eaaf0 2024-09-19T07:13:12.913 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.904+0000 7eff977fe640 1 -- 172.21.15.148:0/187390322 <== mon.2 v2:172.21.15.165:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7effa8004f20 con 0x5633420eaaf0 2024-09-19T07:13:12.913 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.904+0000 7effc1213740 1 -- 172.21.15.148:0/187390322 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7effa8005500 con 0x5633420eaaf0 2024-09-19T07:13:12.913 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.904+0000 7eff977fe640 1 -- 172.21.15.148:0/187390322 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7effa8033050 con 0x5633420eaaf0 2024-09-19T07:13:12.913 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.904+0000 7effc1213740 10 client.25394 fetch_fsmap learned FSMap version 25 2024-09-19T07:13:12.913 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.904+0000 7effc1213740 1 -- 172.21.15.148:0/187390322 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563341e2e620 con 0x5633420eaaf0 2024-09-19T07:13:12.913 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.904+0000 7eff977fe640 1 -- 172.21.15.148:0/187390322 <== mon.2 v2:172.21.15.165:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7effa8005500 con 0x5633420eaaf0 2024-09-19T07:13:12.913 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.905+0000 7eff977fe640 1 -- 172.21.15.148:0/187390322 <== mon.2 v2:172.21.15.165:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7effa802e440 con 0x5633420eaaf0 2024-09-19T07:13:12.913 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.905+0000 7effc1213740 10 client.25394 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:13:12.913 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.905+0000 7effc1213740 10 client.25394 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:13:12.913 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.905+0000 7effc1213740 20 client.25394 populate_metadata read hostname 'smithi148' 2024-09-19T07:13:12.913 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.905+0000 7effc1213740 1 --2- 172.21.15.148:0/187390322 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x563342105b60 0x563342107f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:12.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.905+0000 7effc1213740 4 client.25394 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:13:12.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.905+0000 7effc1213740 1 -- 172.21.15.148:0/187390322 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56334205ca20 con 0x563342105b60 2024-09-19T07:13:12.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.905+0000 7effb77fe640 1 --2- 172.21.15.148:0/187390322 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x563342105b60 0x563342107f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:12.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.905+0000 7eff977fe640 10 client.25394 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:13:12.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.905+0000 7effb77fe640 1 --2- 172.21.15.148:0/187390322 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x563342105b60 0x563342107f50 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8690f02a90cd815c server_cookie=168997d9ec7acbc9 in_seq=0 out_seq=0 2024-09-19T07:13:12.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.906+0000 7eff977fe640 1 -- 172.21.15.148:0/187390322 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56334205ca20 con 0x563342105b60 2024-09-19T07:13:12.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.906+0000 7eff977fe640 10 client.25394 handle_command_reply: tid=0 2024-09-19T07:13:12.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.906+0000 7effc1213740 1 client.25394 shutdown 2024-09-19T07:13:12.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.906+0000 7effc1213740 1 -- 172.21.15.148:0/187390322 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633420eaaf0 msgr2=0x5633420f2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:12.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.906+0000 7effc1213740 1 --2- 172.21.15.148:0/187390322 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633420eaaf0 0x5633420f2bc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7effa801b040 tx=0x7effa80056b0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.906+0000 7effc1213740 1 -- 172.21.15.148:0/187390322 shutdown_connections 2024-09-19T07:13:12.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.906+0000 7effc1213740 1 --2- 172.21.15.148:0/187390322 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x563342105b60 0x563342107f50 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.906+0000 7effc1213740 1 --2- 172.21.15.148:0/187390322 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633420f5cb0 0x5633420f3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.906+0000 7eff977fe640 0 client.25394 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:13:12.915 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.906+0000 7effc1213740 1 --2- 172.21.15.148:0/187390322 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633420eb410 0x5633420f3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.915 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.906+0000 7effc1213740 1 --2- 172.21.15.148:0/187390322 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633420eaaf0 0x5633420f2bc0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.915 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.906+0000 7effc1213740 1 -- 172.21.15.148:0/187390322 >> 172.21.15.148:0/187390322 conn(0x5633420e7060 msgr2=0x5633420ecd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:12.915 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.906+0000 7effc1213740 1 -- 172.21.15.148:0/187390322 shutdown_connections 2024-09-19T07:13:12.915 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.906+0000 7effc1213740 1 -- 172.21.15.148:0/187390322 wait complete. 2024-09-19T07:13:12.915 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.906+0000 7effc1213740 20 client.25394 trim_cache size 0 max 16384 2024-09-19T07:13:12.920 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'c09a2bc7', total seconds elapsed: 23.6 2024-09-19T07:13:12.926 INFO:tasks.workunit.client.0.smithi148.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2024-09-19T07:13:12.926 INFO:tasks.workunit.client.0.smithi148.stdout:Making all in man 2024-09-19T07:13:12.928 INFO:tasks.workunit.client.0.smithi148.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2024-09-19T07:13:12.928 INFO:tasks.workunit.client.0.smithi148.stdout:make[2]: Nothing to be done for 'all'. 2024-09-19T07:13:12.928 INFO:tasks.workunit.client.0.smithi148.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2024-09-19T07:13:12.929 INFO:tasks.workunit.client.0.smithi148.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-19T07:13:12.931 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.930+0000 7effc1213740 1 Processor -- start 2024-09-19T07:13:12.931 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.930+0000 7effc1213740 1 -- start start 2024-09-19T07:13:12.931 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.930+0000 7effc1213740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633420eaaf0 0x5633420f4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:12.931 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.930+0000 7effc1213740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633420eb410 0x5633420f3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:12.931 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.930+0000 7effc1213740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633420f5cb0 0x56334210d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:12.931 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.930+0000 7effc1213740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7effb81b2320 con 0x5633420eaaf0 2024-09-19T07:13:12.931 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.930+0000 7effc1213740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7effb81afbf0 con 0x5633420f5cb0 2024-09-19T07:13:12.932 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.930+0000 7effc1213740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7effb81ada20 con 0x5633420eb410 2024-09-19T07:13:12.932 INFO:tasks.workunit.client.0.smithi148.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-19T07:13:12.933 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.930+0000 7effb7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633420eaaf0 0x5633420f4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:12.933 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.930+0000 7effb7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633420eaaf0 0x5633420f4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52938/0 (socket says 172.21.15.148:52938) 2024-09-19T07:13:12.933 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.930+0000 7effb7fff640 1 -- 172.21.15.148:0/1735535802 learned_addr learned my addr 172.21.15.148:0/1735535802 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:12.933 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.930+0000 7effb77fe640 1 --2- 172.21.15.148:0/1735535802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633420eb410 0x5633420f3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:12.934 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.930+0000 7effbca14640 1 --2- 172.21.15.148:0/1735535802 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633420f5cb0 0x56334210d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:12.934 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-19T07:13:12.934 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.930+0000 7effb7fff640 1 -- 172.21.15.148:0/1735535802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633420eb410 msgr2=0x5633420f3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:12.934 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.930+0000 7effb7fff640 1 --2- 172.21.15.148:0/1735535802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633420eb410 0x5633420f3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.934 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.930+0000 7effb7fff640 1 -- 172.21.15.148:0/1735535802 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633420f5cb0 msgr2=0x56334210d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:12.935 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.930+0000 7effb7fff640 1 --2- 172.21.15.148:0/1735535802 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633420f5cb0 0x56334210d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.935 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.931+0000 7effb7fff640 1 -- 172.21.15.148:0/1735535802 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633420ec000 con 0x5633420eaaf0 2024-09-19T07:13:12.935 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.931+0000 7effbca14640 1 --2- 172.21.15.148:0/1735535802 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633420f5cb0 0x56334210d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:13:12.935 INFO:tasks.workunit.client.0.smithi148.stderr:+ cd src 2024-09-19T07:13:12.936 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.931+0000 7effb7fff640 1 --2- 172.21.15.148:0/1735535802 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633420eaaf0 0x5633420f4b30 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7effa80059b0 tx=0x7effa8005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bd29593cd6c6429 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:12.936 INFO:tasks.workunit.client.0.smithi148.stderr:+ mkdir blogtest_in 2024-09-19T07:13:12.937 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.931+0000 7eff9dffb640 1 -- 172.21.15.148:0/1735535802 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa802e440 con 0x5633420eaaf0 2024-09-19T07:13:12.937 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.931+0000 7eff9dffb640 1 -- 172.21.15.148:0/1735535802 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7effa802e5e0 con 0x5633420eaaf0 2024-09-19T07:13:12.937 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.931+0000 7eff9dffb640 1 -- 172.21.15.148:0/1735535802 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa8004960 con 0x5633420eaaf0 2024-09-19T07:13:12.938 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.932+0000 7effc1213740 1 -- 172.21.15.148:0/1735535802 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633420eaaf0 msgr2=0x5633420f4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:12.938 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.932+0000 7effc1213740 1 --2- 172.21.15.148:0/1735535802 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633420eaaf0 0x5633420f4b30 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7effa80059b0 tx=0x7effa8005720 comp rx=0 tx=0).stop 2024-09-19T07:13:12.938 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.932+0000 7effc1213740 1 -- 172.21.15.148:0/1735535802 shutdown_connections 2024-09-19T07:13:12.938 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.932+0000 7effc1213740 1 --2- 172.21.15.148:0/1735535802 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633420f5cb0 0x56334210d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.938 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.932+0000 7effc1213740 1 --2- 172.21.15.148:0/1735535802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633420eb410 0x5633420f3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.938 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.932+0000 7effc1213740 1 --2- 172.21.15.148:0/1735535802 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633420eaaf0 0x5633420f4b30 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.938 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.932+0000 7effc1213740 1 -- 172.21.15.148:0/1735535802 >> 172.21.15.148:0/1735535802 conn(0x5633420e7060 msgr2=0x5633420f4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:12.938 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.932+0000 7effc1213740 1 -- 172.21.15.148:0/1735535802 shutdown_connections 2024-09-19T07:13:12.938 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.932+0000 7effc1213740 1 -- 172.21.15.148:0/1735535802 wait complete. 2024-09-19T07:13:12.938 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.932+0000 7effc1213740 1 -- start start 2024-09-19T07:13:12.938 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.932+0000 7effc1213740 1 Processor -- start 2024-09-19T07:13:12.939 INFO:tasks.workunit.client.0.smithi148.stderr:+ echo 'running blogbench' 2024-09-19T07:13:12.939 INFO:tasks.workunit.client.0.smithi148.stdout:running blogbench 2024-09-19T07:13:12.939 INFO:tasks.workunit.client.0.smithi148.stderr:+ ./blogbench -d blogtest_in 2024-09-19T07:13:12.940 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.933+0000 7effc1213740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633420eaaf0 0x5633421687c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:12.940 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.933+0000 7effc1213740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633420eb410 0x563342168d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:12.940 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.933+0000 7effc1213740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633420f5cb0 0x5633420fd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:12.940 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.933+0000 7effc1213740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7effb81ae0b0 con 0x5633420eb410 2024-09-19T07:13:12.941 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.933+0000 7effc1213740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7effb81af520 con 0x5633420f5cb0 2024-09-19T07:13:12.941 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.933+0000 7effc1213740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7effb81ae780 con 0x5633420eaaf0 2024-09-19T07:13:12.941 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.933+0000 7effc1213740 10 client.0 _ll_register_callbacks cb 0x7effac0d5400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:13:12.941 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.933+0000 7effb77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633420eb410 0x563342168d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:12.941 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.933+0000 7effb7fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633420eaaf0 0x5633421687c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:12.941 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.933+0000 7effb7fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633420eaaf0 0x5633421687c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:53476/0 (socket says 172.21.15.148:53476) 2024-09-19T07:13:12.941 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.933+0000 7effb77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633420eb410 0x563342168d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52950/0 (socket says 172.21.15.148:52950) 2024-09-19T07:13:12.941 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.933+0000 7effb7fff640 1 -- 172.21.15.148:0/3402493335 learned_addr learned my addr 172.21.15.148:0/3402493335 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:12.941 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.933+0000 7effbca14640 1 --2- 172.21.15.148:0/3402493335 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633420f5cb0 0x5633420fd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:12.941 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.933+0000 7effb7fff640 1 -- 172.21.15.148:0/3402493335 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633420f5cb0 msgr2=0x5633420fd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:12.942 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.933+0000 7effb7fff640 1 --2- 172.21.15.148:0/3402493335 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633420f5cb0 0x5633420fd9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.942 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.933+0000 7effb7fff640 1 -- 172.21.15.148:0/3402493335 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633420eb410 msgr2=0x563342168d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:12.942 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.933+0000 7effb7fff640 1 --2- 172.21.15.148:0/3402493335 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633420eb410 0x563342168d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.942 INFO:tasks.workunit.client.0.smithi148.stdout: 2024-09-19T07:13:12.942 INFO:tasks.workunit.client.0.smithi148.stdout:Frequency = 10 secs 2024-09-19T07:13:12.942 INFO:tasks.workunit.client.0.smithi148.stdout:Scratch dir = [blogtest_in] 2024-09-19T07:13:12.944 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.933+0000 7effb7fff640 1 -- 172.21.15.148:0/3402493335 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633420fe040 con 0x5633420eaaf0 2024-09-19T07:13:12.944 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.933+0000 7effb77fe640 1 --2- 172.21.15.148:0/3402493335 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633420eb410 0x563342168d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:13:12.944 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.933+0000 7effb7fff640 1 --2- 172.21.15.148:0/3402493335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633420eaaf0 0x5633421687c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7effa80058c0 tx=0x7effa8004620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85934a45fb979ecb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:12.944 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.933+0000 7eff977fe640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-19T07:13:12.944 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.933+0000 7eff977fe640 1 -- 172.21.15.148:0/3402493335 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa80035f0 con 0x5633420eaaf0 2024-09-19T07:13:12.944 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.933+0000 7eff977fe640 1 -- 172.21.15.148:0/3402493335 <== mon.1 v2:172.21.15.179:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7effa8003790 con 0x5633420eaaf0 2024-09-19T07:13:12.944 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.933+0000 7effc1213740 1 -- 172.21.15.148:0/3402493335 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7effa802e5e0 con 0x5633420eaaf0 2024-09-19T07:13:12.945 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.934+0000 7eff977fe640 1 -- 172.21.15.148:0/3402493335 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7effa8003990 con 0x5633420eaaf0 2024-09-19T07:13:12.945 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.934+0000 7effc1213740 10 client.25453 fetch_fsmap learned FSMap version 25 2024-09-19T07:13:12.945 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.934+0000 7effc1213740 1 -- 172.21.15.148:0/3402493335 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563342170050 con 0x5633420eaaf0 2024-09-19T07:13:12.945 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.934+0000 7eff977fe640 1 -- 172.21.15.148:0/3402493335 <== mon.1 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7effa802e5e0 con 0x5633420eaaf0 2024-09-19T07:13:12.945 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.934+0000 7eff977fe640 1 -- 172.21.15.148:0/3402493335 <== mon.1 v2:172.21.15.179:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7effa8019b60 con 0x5633420eaaf0 2024-09-19T07:13:12.945 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.935+0000 7effc1213740 10 client.25453 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:13:12.945 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.935+0000 7effc1213740 10 client.25453 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:13:12.945 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.935+0000 7effc1213740 20 client.25453 populate_metadata read hostname 'smithi148' 2024-09-19T07:13:12.945 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.935+0000 7effc1213740 1 --2- 172.21.15.148:0/3402493335 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x563342170660 0x563342172a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:12.945 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.935+0000 7effc1213740 4 client.25453 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:13:12.945 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.935+0000 7effc1213740 1 -- 172.21.15.148:0/3402493335 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563342056d70 con 0x563342170660 2024-09-19T07:13:12.945 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.937+0000 7effb77fe640 1 --2- 172.21.15.148:0/3402493335 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x563342170660 0x563342172a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:12.945 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.938+0000 7eff977fe640 10 client.25453 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:13:12.946 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.938+0000 7effb77fe640 1 --2- 172.21.15.148:0/3402493335 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x563342170660 0x563342172a80 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84ae74d8a03ae3b9 server_cookie=7440a81930b7635d in_seq=0 out_seq=0 2024-09-19T07:13:12.982 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.981+0000 7eff977fe640 1 -- 172.21.15.148:0/3402493335 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563342056d70 con 0x563342170660 2024-09-19T07:13:12.982 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.981+0000 7eff977fe640 10 client.25453 handle_command_reply: tid=0 2024-09-19T07:13:12.982 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.981+0000 7effc1213740 1 client.25453 shutdown 2024-09-19T07:13:12.982 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.981+0000 7effc1213740 1 -- 172.21.15.148:0/3402493335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633420eaaf0 msgr2=0x5633421687c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:12.982 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.981+0000 7effc1213740 1 --2- 172.21.15.148:0/3402493335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633420eaaf0 0x5633421687c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7effa80058c0 tx=0x7effa8004620 comp rx=0 tx=0).stop 2024-09-19T07:13:12.982 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.981+0000 7effc1213740 1 -- 172.21.15.148:0/3402493335 shutdown_connections 2024-09-19T07:13:12.983 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.981+0000 7effc1213740 1 --2- 172.21.15.148:0/3402493335 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x563342170660 0x563342172a80 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.983 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.981+0000 7effc1213740 1 --2- 172.21.15.148:0/3402493335 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633420f5cb0 0x5633420fd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.983 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.981+0000 7eff977fe640 0 client.25453 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:13:12.983 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.981+0000 7effc1213740 1 --2- 172.21.15.148:0/3402493335 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633420eb410 0x563342168d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.983 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.981+0000 7effc1213740 1 --2- 172.21.15.148:0/3402493335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633420eaaf0 0x5633421687c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.983 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.981+0000 7effc1213740 1 -- 172.21.15.148:0/3402493335 >> 172.21.15.148:0/3402493335 conn(0x5633420e7060 msgr2=0x5633420ecd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:12.983 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.981+0000 7effc1213740 1 -- 172.21.15.148:0/3402493335 shutdown_connections 2024-09-19T07:13:12.983 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.981+0000 7effc1213740 1 -- 172.21.15.148:0/3402493335 wait complete. 2024-09-19T07:13:12.983 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.981+0000 7effc1213740 20 client.25453 trim_cache size 0 max 16384 2024-09-19T07:13:12.983 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:13:12.984 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:13:12.984 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:13:12.984 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:13:12.984 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.982+0000 7effbe477640 1 -- 172.21.15.148:0/984436416 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7effa00a3460 msgr2=0x7effa00a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:12.985 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.982+0000 7effbe477640 1 --2- 172.21.15.148:0/984436416 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7effa00a3460 0x7effa00a5920 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7effb0031860 tx=0x7effb00095c0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.985 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.982+0000 7effbe477640 1 -- 172.21.15.148:0/984436416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effb8101370 msgr2=0x7effb81974c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:12.985 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.982+0000 7effbe477640 1 --2- 172.21.15.148:0/984436416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effb8101370 0x7effb81974c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7effac005fd0 tx=0x7effac00dde0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.985 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.982+0000 7effbe477640 1 -- 172.21.15.148:0/984436416 shutdown_connections 2024-09-19T07:13:12.985 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.982+0000 7effbe477640 1 --2- 172.21.15.148:0/984436416 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7effa00a3460 0x7effa00a5920 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.985 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.982+0000 7effbe477640 1 --2- 172.21.15.148:0/984436416 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effb81069e0 0x7effb8197a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.985 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.982+0000 7effbe477640 1 --2- 172.21.15.148:0/984436416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effb8101370 0x7effb81974c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.985 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.982+0000 7effbe477640 1 --2- 172.21.15.148:0/984436416 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7effb81009d0 0x7effb8196f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:12.985 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.982+0000 7effbe477640 1 -- 172.21.15.148:0/984436416 >> 172.21.15.148:0/984436416 conn(0x7effb80fc6b0 msgr2=0x7effb80fdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:12.985 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.982+0000 7effbe477640 1 -- 172.21.15.148:0/984436416 shutdown_connections 2024-09-19T07:13:12.985 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:12.982+0000 7effbe477640 1 -- 172.21.15.148:0/984436416 wait complete. 2024-09-19T07:13:13.191 INFO:tasks.workunit.client.0.smithi148.stdout:Spawning 3 writers... 2024-09-19T07:13:13.191 INFO:tasks.workunit.client.0.smithi148.stdout:Spawning 1 rewriters... 2024-09-19T07:13:13.191 INFO:tasks.workunit.client.0.smithi148.stdout:Spawning 5 commenters... 2024-09-19T07:13:13.191 INFO:tasks.workunit.client.0.smithi148.stdout:Spawning 100 readers... 2024-09-19T07:13:13.193 INFO:tasks.workunit.client.0.smithi148.stdout:Benchmarking for 30 iterations. 2024-09-19T07:13:13.193 INFO:tasks.workunit.client.0.smithi148.stdout:The test will run during 5 minutes. 2024-09-19T07:13:13.193 INFO:tasks.workunit.client.0.smithi148.stdout: 2024-09-19T07:13:13.193 INFO:tasks.workunit.client.0.smithi148.stdout: Nb blogs R articles W articles R pictures W pictures R comments W comments 2024-09-19T07:13:14.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:14 smithi179 ceph-mon[35716]: pgmap v68: 97 pgs: 97 active+clean; 5.2 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 107 KiB/s wr, 67 op/s 2024-09-19T07:13:14.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:14 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:13:14.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:14 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:13:14.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:14 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:13:14.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:14 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:13:14.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:14 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:13:14.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:14 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:13:14.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:14 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:13:14.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:14 smithi148 ceph-mon[31180]: pgmap v68: 97 pgs: 97 active+clean; 5.2 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 107 KiB/s wr, 67 op/s 2024-09-19T07:13:14.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:14 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:13:14.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:14 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:13:14.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:14 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:13:14.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:14 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:13:14.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:14 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:13:14.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:14 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:13:14.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:14 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:13:14.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:14 smithi165 ceph-mon[35326]: pgmap v68: 97 pgs: 97 active+clean; 5.2 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 107 KiB/s wr, 67 op/s 2024-09-19T07:13:14.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:14 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:13:14.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:14 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:13:14.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:14 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:13:14.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:14 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:13:14.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:14 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:13:14.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:14 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:13:14.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:14 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:13:15.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:15 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:13:15.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:15 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:13:15.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:15 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:13:15.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:15 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:13:15.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:15 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:13:15.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:15 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:13:15.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:15 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:13:15.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:15 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:13:15.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:15 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:13:16.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:16 smithi165 ceph-mon[35326]: pgmap v69: 97 pgs: 97 active+clean; 8.1 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 360 KiB/s wr, 89 op/s 2024-09-19T07:13:17.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:16 smithi179 ceph-mon[35716]: pgmap v69: 97 pgs: 97 active+clean; 8.1 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 360 KiB/s wr, 89 op/s 2024-09-19T07:13:17.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:16 smithi148 ceph-mon[31180]: pgmap v69: 97 pgs: 97 active+clean; 8.1 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 360 KiB/s wr, 89 op/s 2024-09-19T07:13:18.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:18 smithi165 ceph-mon[35326]: pgmap v70: 97 pgs: 97 active+clean; 8.1 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 272 KiB/s wr, 30 op/s 2024-09-19T07:13:19.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:18 smithi179 ceph-mon[35716]: pgmap v70: 97 pgs: 97 active+clean; 8.1 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 272 KiB/s wr, 30 op/s 2024-09-19T07:13:19.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:18 smithi148 ceph-mon[31180]: pgmap v70: 97 pgs: 97 active+clean; 8.1 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 272 KiB/s wr, 30 op/s 2024-09-19T07:13:20.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:20 smithi148 ceph-mon[31180]: pgmap v71: 97 pgs: 97 active+clean; 45 MiB data, 508 MiB used, 1.0 TiB / 1.0 TiB avail; 899 KiB/s rd, 3.5 MiB/s wr, 194 op/s 2024-09-19T07:13:20.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:20 smithi165 ceph-mon[35326]: pgmap v71: 97 pgs: 97 active+clean; 45 MiB data, 508 MiB used, 1.0 TiB / 1.0 TiB avail; 899 KiB/s rd, 3.5 MiB/s wr, 194 op/s 2024-09-19T07:13:21.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:20 smithi179 ceph-mon[35716]: pgmap v71: 97 pgs: 97 active+clean; 45 MiB data, 508 MiB used, 1.0 TiB / 1.0 TiB avail; 899 KiB/s rd, 3.5 MiB/s wr, 194 op/s 2024-09-19T07:13:22.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:22 smithi165 ceph-mon[35326]: pgmap v72: 97 pgs: 97 active+clean; 45 MiB data, 508 MiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 3.5 MiB/s wr, 185 op/s 2024-09-19T07:13:22.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:22 smithi165 ceph-mon[35326]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:13:23.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:22 smithi179 ceph-mon[35716]: pgmap v72: 97 pgs: 97 active+clean; 45 MiB data, 508 MiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 3.5 MiB/s wr, 185 op/s 2024-09-19T07:13:23.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:22 smithi179 ceph-mon[35716]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:13:23.088 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:22 smithi148 ceph-mon[31180]: pgmap v72: 97 pgs: 97 active+clean; 45 MiB data, 508 MiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 3.5 MiB/s wr, 185 op/s 2024-09-19T07:13:23.088 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:22 smithi148 ceph-mon[31180]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:13:23.193 INFO:tasks.workunit.client.0.smithi148.stdout: 18 89244 1003 51680 971 17534 933 2024-09-19T07:13:24.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:24 smithi165 ceph-mon[35326]: pgmap v73: 97 pgs: 97 active+clean; 45 MiB data, 508 MiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 3.5 MiB/s wr, 185 op/s 2024-09-19T07:13:25.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:24 smithi179 ceph-mon[35716]: pgmap v73: 97 pgs: 97 active+clean; 45 MiB data, 508 MiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 3.5 MiB/s wr, 185 op/s 2024-09-19T07:13:25.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:24 smithi148 ceph-mon[31180]: pgmap v73: 97 pgs: 97 active+clean; 45 MiB data, 508 MiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 3.5 MiB/s wr, 185 op/s 2024-09-19T07:13:26.100 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.099+0000 7f8d3fdbd640 1 -- 172.21.15.148:0/2581188656 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d381029b0 msgr2=0x7f8d38102d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:26.100 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.099+0000 7f8d3fdbd640 1 --2- 172.21.15.148:0/2581188656 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d381029b0 0x7f8d38102d90 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f8d30009900 tx=0x7f8d3002a410 comp rx=0 tx=0).stop 2024-09-19T07:13:26.101 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.099+0000 7f8d3fdbd640 1 -- 172.21.15.148:0/2581188656 shutdown_connections 2024-09-19T07:13:26.101 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.099+0000 7f8d3fdbd640 1 --2- 172.21.15.148:0/2581188656 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d38101a30 0x7f8d3810d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:26.101 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.099+0000 7f8d3fdbd640 1 --2- 172.21.15.148:0/2581188656 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d38101070 0x7f8d381014f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:26.101 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.099+0000 7f8d3fdbd640 1 --2- 172.21.15.148:0/2581188656 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d381029b0 0x7f8d38102d90 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:26.101 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.099+0000 7f8d3fdbd640 1 -- 172.21.15.148:0/2581188656 >> 172.21.15.148:0/2581188656 conn(0x7f8d380770f0 msgr2=0x7f8d380fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:26.101 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.099+0000 7f8d3fdbd640 1 -- 172.21.15.148:0/2581188656 shutdown_connections 2024-09-19T07:13:26.101 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.099+0000 7f8d3fdbd640 1 -- 172.21.15.148:0/2581188656 wait complete. 2024-09-19T07:13:26.101 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.100+0000 7f8d3fdbd640 1 Processor -- start 2024-09-19T07:13:26.102 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.100+0000 7f8d3fdbd640 1 -- start start 2024-09-19T07:13:26.102 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.101+0000 7f8d3fdbd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d38101070 0x7f8d381105e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:26.103 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.101+0000 7f8d3fdbd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d38101a30 0x7f8d38110b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:26.103 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.101+0000 7f8d3fdbd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d381029b0 0x7f8d38111060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:26.103 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.101+0000 7f8d3fdbd640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8d38100970 con 0x7f8d38101070 2024-09-19T07:13:26.103 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.101+0000 7f8d3fdbd640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8d381007f0 con 0x7f8d381029b0 2024-09-19T07:13:26.103 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.101+0000 7f8d3fdbd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8d38100af0 con 0x7f8d38101a30 2024-09-19T07:13:26.103 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.101+0000 7f8d3e35a640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d381029b0 0x7f8d38111060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:26.103 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.101+0000 7f8d3e35a640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d381029b0 0x7f8d38111060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:52330/0 (socket says 172.21.15.148:52330) 2024-09-19T07:13:26.103 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.101+0000 7f8d3e35a640 1 -- 172.21.15.148:0/81623000 learned_addr learned my addr 172.21.15.148:0/81623000 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:26.103 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.101+0000 7f8d3d358640 1 --2- 172.21.15.148:0/81623000 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d38101a30 0x7f8d38110b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:26.103 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.102+0000 7f8d3e35a640 1 -- 172.21.15.148:0/81623000 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d38101a30 msgr2=0x7f8d38110b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:26.103 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.102+0000 7f8d3e35a640 1 --2- 172.21.15.148:0/81623000 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d38101a30 0x7f8d38110b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:26.104 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.102+0000 7f8d3e35a640 1 -- 172.21.15.148:0/81623000 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d38101070 msgr2=0x7f8d381105e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:26.104 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.102+0000 7f8d3e35a640 1 --2- 172.21.15.148:0/81623000 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d38101070 0x7f8d381105e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:26.104 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.102+0000 7f8d3e35a640 1 -- 172.21.15.148:0/81623000 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d381aadc0 con 0x7f8d381029b0 2024-09-19T07:13:26.104 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.102+0000 7f8d3d358640 1 --2- 172.21.15.148:0/81623000 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d38101a30 0x7f8d38110b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:13:26.104 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.102+0000 7f8d3e35a640 1 --2- 172.21.15.148:0/81623000 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d381029b0 0x7f8d38111060 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8d2800e970 tx=0x7f8d2800ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:26.106 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.102+0000 7f8d36ffd640 1 -- 172.21.15.148:0/81623000 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2800ccc0 con 0x7f8d381029b0 2024-09-19T07:13:26.106 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.102+0000 7f8d36ffd640 1 -- 172.21.15.148:0/81623000 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d2800ce60 con 0x7f8d381029b0 2024-09-19T07:13:26.106 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.102+0000 7f8d36ffd640 1 -- 172.21.15.148:0/81623000 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d28010490 con 0x7f8d381029b0 2024-09-19T07:13:26.106 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.103+0000 7f8d3fdbd640 1 -- 172.21.15.148:0/81623000 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d381aaff0 con 0x7f8d381029b0 2024-09-19T07:13:26.107 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.103+0000 7f8d3fdbd640 1 -- 172.21.15.148:0/81623000 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d381ab540 con 0x7f8d381029b0 2024-09-19T07:13:26.108 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.106+0000 7f8d36ffd640 1 -- 172.21.15.148:0/81623000 <== mon.2 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f8d28010630 con 0x7f8d381029b0 2024-09-19T07:13:26.109 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.106+0000 7f8d42c35740 1 Processor -- start 2024-09-19T07:13:26.109 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.106+0000 7f8d42c35740 1 -- start start 2024-09-19T07:13:26.109 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.106+0000 7f8d42c35740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5652ed436af0 0x5652ed436ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:26.109 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.106+0000 7f8d42c35740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5652ed437410 0x5652ed441770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:26.109 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.106+0000 7f8d42c35740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652ed441cb0 0x5652ed4440a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:26.109 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.106+0000 7f8d42c35740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5652ed39b2f0 con 0x5652ed437410 2024-09-19T07:13:26.109 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.106+0000 7f8d42c35740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5652ed343270 con 0x5652ed436af0 2024-09-19T07:13:26.109 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.106+0000 7f8d42c35740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5652ed3972b0 con 0x5652ed441cb0 2024-09-19T07:13:26.110 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.107+0000 7f8d3d358640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5652ed436af0 0x5652ed436ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:26.110 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.107+0000 7f8d36ffd640 1 --2- 172.21.15.148:0/81623000 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f8d200a34e0 0x7f8d200a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:26.110 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.107+0000 7f8d3db59640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5652ed437410 0x5652ed441770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:26.110 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.107+0000 7f8d3d358640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5652ed436af0 0x5652ed436ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:52338/0 (socket says 172.21.15.148:52338) 2024-09-19T07:13:26.110 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.107+0000 7f8d3d358640 1 -- 172.21.15.148:0/2553174009 learned_addr learned my addr 172.21.15.148:0/2553174009 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:26.110 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.107+0000 7f8d3d358640 1 --2- 172.21.15.148:0/2553174009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652ed441cb0 0x5652ed4440a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:26.110 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.107+0000 7f8d3e35a640 1 --2- 172.21.15.148:0/81623000 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f8d200a34e0 0x7f8d200a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:26.110 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.107+0000 7f8d3d358640 1 -- 172.21.15.148:0/2553174009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652ed441cb0 msgr2=0x5652ed4440a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:26.110 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.107+0000 7f8d3d358640 1 --2- 172.21.15.148:0/2553174009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652ed441cb0 0x5652ed4440a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:26.110 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.107+0000 7f8d3d358640 1 -- 172.21.15.148:0/2553174009 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5652ed437410 msgr2=0x5652ed441770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:26.110 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.107+0000 7f8d3d358640 1 --2- 172.21.15.148:0/2553174009 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5652ed437410 0x5652ed441770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:26.110 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.107+0000 7f8d3d358640 1 -- 172.21.15.148:0/2553174009 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652ed342340 con 0x5652ed436af0 2024-09-19T07:13:26.111 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.107+0000 7f8d36ffd640 1 -- 172.21.15.148:0/81623000 <== mon.2 v2:172.21.15.165:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f8d280d0200 con 0x7f8d381029b0 2024-09-19T07:13:26.111 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.107+0000 7f8d3d358640 1 --2- 172.21.15.148:0/2553174009 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5652ed436af0 0x5652ed436ed0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c012b60 tx=0x7f8d2c009a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a5e55b2c5217692 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:26.111 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.107+0000 7f8d1ffff640 1 -- 172.21.15.148:0/2553174009 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c012c50 con 0x5652ed436af0 2024-09-19T07:13:26.111 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.107+0000 7f8d3e35a640 1 --2- 172.21.15.148:0/81623000 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f8d200a34e0 0x7f8d200a59a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8d2800e940 tx=0x7f8d28007ca0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:26.111 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.107+0000 7f8d1ffff640 1 -- 172.21.15.148:0/2553174009 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d2c012df0 con 0x5652ed436af0 2024-09-19T07:13:26.111 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.107+0000 7f8d1ffff640 1 -- 172.21.15.148:0/2553174009 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c004290 con 0x5652ed436af0 2024-09-19T07:13:26.111 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.108+0000 7f8d42c35740 1 -- 172.21.15.148:0/2553174009 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5652ed436af0 msgr2=0x5652ed436ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:26.111 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.108+0000 7f8d42c35740 1 --2- 172.21.15.148:0/2553174009 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5652ed436af0 0x5652ed436ed0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c012b60 tx=0x7f8d2c009a90 comp rx=0 tx=0).stop 2024-09-19T07:13:26.115 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.108+0000 7f8d42c35740 1 -- 172.21.15.148:0/2553174009 shutdown_connections 2024-09-19T07:13:26.115 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.108+0000 7f8d42c35740 1 --2- 172.21.15.148:0/2553174009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652ed441cb0 0x5652ed4440a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:26.115 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.108+0000 7f8d42c35740 1 --2- 172.21.15.148:0/2553174009 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5652ed437410 0x5652ed441770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:26.115 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.108+0000 7f8d42c35740 1 --2- 172.21.15.148:0/2553174009 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5652ed436af0 0x5652ed436ed0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:26.115 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.108+0000 7f8d42c35740 1 -- 172.21.15.148:0/2553174009 >> 172.21.15.148:0/2553174009 conn(0x5652ed433060 msgr2=0x5652ed433440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:26.115 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.108+0000 7f8d42c35740 1 -- 172.21.15.148:0/2553174009 shutdown_connections 2024-09-19T07:13:26.115 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.108+0000 7f8d42c35740 1 -- 172.21.15.148:0/2553174009 wait complete. 2024-09-19T07:13:26.115 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.109+0000 7f8d42c35740 1 -- start start 2024-09-19T07:13:26.116 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.109+0000 7f8d42c35740 1 Processor -- start 2024-09-19T07:13:26.116 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.109+0000 7f8d42c35740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5652ed436af0 0x5652ed43ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:26.116 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.109+0000 7f8d42c35740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652ed437410 0x5652ed43f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:26.116 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.109+0000 7f8d42c35740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5652ed441cb0 0x5652ed43f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:26.116 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.109+0000 7f8d42c35740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5652ed444880 con 0x5652ed436af0 2024-09-19T07:13:26.116 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.109+0000 7f8d42c35740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5652ed324290 con 0x5652ed441cb0 2024-09-19T07:13:26.116 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.109+0000 7f8d42c35740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5652ed444a00 con 0x5652ed437410 2024-09-19T07:13:26.116 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.109+0000 7f8d3d358640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5652ed436af0 0x5652ed43ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:26.116 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.109+0000 7f8d3d358640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5652ed436af0 0x5652ed43ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37370/0 (socket says 172.21.15.148:37370) 2024-09-19T07:13:26.116 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.109+0000 7f8d3d358640 1 -- 172.21.15.148:0/2436054863 learned_addr learned my addr 172.21.15.148:0/2436054863 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:26.116 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.109+0000 7f8d3db59640 1 --2- 172.21.15.148:0/2436054863 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652ed437410 0x5652ed43f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:26.116 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.109+0000 7f8d42c35740 10 client.0 _ll_register_callbacks cb 0x5652ed355140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:13:26.116 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.110+0000 7f8d3d358640 1 --2- 172.21.15.148:0/2436054863 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5652ed441cb0 0x5652ed43f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:26.117 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.110+0000 7f8d3d358640 1 -- 172.21.15.148:0/2436054863 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652ed437410 msgr2=0x5652ed43f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:26.117 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.110+0000 7f8d3d358640 1 --2- 172.21.15.148:0/2436054863 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652ed437410 0x5652ed43f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:26.117 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.110+0000 7f8d3d358640 1 -- 172.21.15.148:0/2436054863 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5652ed441cb0 msgr2=0x5652ed43f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:26.117 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.110+0000 7f8d3d358640 1 --2- 172.21.15.148:0/2436054863 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5652ed441cb0 0x5652ed43f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:26.117 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.110+0000 7f8d3d358640 1 -- 172.21.15.148:0/2436054863 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652ed0ae210 con 0x5652ed436af0 2024-09-19T07:13:26.117 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.110+0000 7f8d3db59640 1 --2- 172.21.15.148:0/2436054863 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652ed437410 0x5652ed43f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:13:26.117 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.110+0000 7f8d3d358640 1 --2- 172.21.15.148:0/2436054863 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5652ed436af0 0x5652ed43ec10 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c003db0 tx=0x7f8d2c003e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45700e3969ac954c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:26.117 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.110+0000 7f8d1d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:13:26.117 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.110+0000 7f8d1d7fa640 1 -- 172.21.15.148:0/2436054863 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c02b060 con 0x5652ed436af0 2024-09-19T07:13:26.117 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.110+0000 7f8d1d7fa640 1 -- 172.21.15.148:0/2436054863 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f8d2c004d10 con 0x5652ed436af0 2024-09-19T07:13:26.118 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.110+0000 7f8d42c35740 1 -- 172.21.15.148:0/2436054863 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d2c012df0 con 0x5652ed436af0 2024-09-19T07:13:26.118 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.110+0000 7f8d1d7fa640 1 -- 172.21.15.148:0/2436054863 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8d2c003f10 con 0x5652ed436af0 2024-09-19T07:13:26.118 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.110+0000 7f8d42c35740 10 client.16053 fetch_fsmap learned FSMap version 26 2024-09-19T07:13:26.118 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.110+0000 7f8d42c35740 1 -- 172.21.15.148:0/2436054863 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5652ed17a620 con 0x5652ed436af0 2024-09-19T07:13:26.118 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.110+0000 7f8d1d7fa640 1 -- 172.21.15.148:0/2436054863 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d2c012df0 con 0x5652ed436af0 2024-09-19T07:13:26.118 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.111+0000 7f8d1d7fa640 1 -- 172.21.15.148:0/2436054863 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f8d2c005410 con 0x5652ed436af0 2024-09-19T07:13:26.118 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.111+0000 7f8d42c35740 10 client.16053 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T07:13:26.118 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.111+0000 7f8d42c35740 10 client.16053 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:13:26.118 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.111+0000 7f8d42c35740 20 client.16053 populate_metadata read hostname 'smithi148' 2024-09-19T07:13:26.118 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.111+0000 7f8d42c35740 1 --2- 172.21.15.148:0/2436054863 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5652ed451ac0 0x5652ed453eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:26.118 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.111+0000 7f8d42c35740 4 client.16053 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:13:26.118 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.111+0000 7f8d42c35740 1 -- 172.21.15.148:0/2436054863 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5652ed3a8a20 con 0x5652ed451ac0 2024-09-19T07:13:26.118 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.111+0000 7f8d3db59640 1 --2- 172.21.15.148:0/2436054863 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5652ed451ac0 0x5652ed453eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:26.119 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.111+0000 7f8d1d7fa640 10 client.16053 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:13:26.119 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.111+0000 7f8d3db59640 1 --2- 172.21.15.148:0/2436054863 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5652ed451ac0 0x5652ed453eb0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=edb3ae53a828e498 server_cookie=ff9c9f3608c2c196 in_seq=0 out_seq=0 2024-09-19T07:13:26.120 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.114+0000 7f8d1d7fa640 1 -- 172.21.15.148:0/2436054863 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5652ed3a8a20 con 0x5652ed451ac0 2024-09-19T07:13:26.120 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.114+0000 7f8d1d7fa640 10 client.16053 handle_command_reply: tid=0 2024-09-19T07:13:26.120 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.115+0000 7f8d42c35740 1 client.16053 shutdown 2024-09-19T07:13:26.120 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.115+0000 7f8d42c35740 1 -- 172.21.15.148:0/2436054863 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5652ed436af0 msgr2=0x5652ed43ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:26.121 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.115+0000 7f8d42c35740 1 --2- 172.21.15.148:0/2436054863 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5652ed436af0 0x5652ed43ec10 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c003db0 tx=0x7f8d2c003e30 comp rx=0 tx=0).stop 2024-09-19T07:13:26.121 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.115+0000 7f8d42c35740 1 -- 172.21.15.148:0/2436054863 shutdown_connections 2024-09-19T07:13:26.121 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.115+0000 7f8d42c35740 1 --2- 172.21.15.148:0/2436054863 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5652ed451ac0 0x5652ed453eb0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:26.121 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.115+0000 7f8d42c35740 1 --2- 172.21.15.148:0/2436054863 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5652ed441cb0 0x5652ed43f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:26.121 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.115+0000 7f8d42c35740 1 --2- 172.21.15.148:0/2436054863 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652ed437410 0x5652ed43f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:26.121 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.115+0000 7f8d42c35740 1 --2- 172.21.15.148:0/2436054863 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5652ed436af0 0x5652ed43ec10 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:26.121 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.115+0000 7f8d1d7fa640 0 client.16053 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:13:26.121 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.115+0000 7f8d42c35740 1 -- 172.21.15.148:0/2436054863 >> 172.21.15.148:0/2436054863 conn(0x5652ed433060 msgr2=0x5652ed438dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:26.121 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.115+0000 7f8d42c35740 1 -- 172.21.15.148:0/2436054863 shutdown_connections 2024-09-19T07:13:26.121 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.115+0000 7f8d42c35740 1 -- 172.21.15.148:0/2436054863 wait complete. 2024-09-19T07:13:26.121 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.115+0000 7f8d42c35740 20 client.16053 trim_cache size 0 max 16384 2024-09-19T07:13:26.137 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.129+0000 7f8d42c35740 1 Processor -- start 2024-09-19T07:13:26.137 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.129+0000 7f8d42c35740 1 -- start start 2024-09-19T07:13:26.137 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.130+0000 7f8d42c35740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652ed436af0 0x5652ed43f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:26.137 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.130+0000 7f8d42c35740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5652ed437410 0x5652ed43f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:26.137 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.130+0000 7f8d42c35740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5652ed441cb0 0x5652ed4595d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:26.137 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.130+0000 7f8d42c35740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8d381b6730 con 0x5652ed437410 2024-09-19T07:13:26.138 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.130+0000 7f8d42c35740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8d381b4000 con 0x5652ed441cb0 2024-09-19T07:13:26.138 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.130+0000 7f8d42c35740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8d381b1e30 con 0x5652ed436af0 2024-09-19T07:13:26.138 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.130+0000 7f8d3db59640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5652ed437410 0x5652ed43f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:26.138 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.130+0000 7f8d3db59640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5652ed437410 0x5652ed43f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37382/0 (socket says 172.21.15.148:37382) 2024-09-19T07:13:26.138 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.130+0000 7f8d3db59640 1 -- 172.21.15.148:0/2952954430 learned_addr learned my addr 172.21.15.148:0/2952954430 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:26.138 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.130+0000 7f8d3d358640 1 --2- 172.21.15.148:0/2952954430 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652ed436af0 0x5652ed43f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:26.138 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.130+0000 7f8d3d358640 1 --2- 172.21.15.148:0/2952954430 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5652ed441cb0 0x5652ed4595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:26.138 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.130+0000 7f8d3db59640 1 -- 172.21.15.148:0/2952954430 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652ed436af0 msgr2=0x5652ed43f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:26.139 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.130+0000 7f8d3db59640 1 --2- 172.21.15.148:0/2952954430 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652ed436af0 0x5652ed43f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:26.139 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.130+0000 7f8d3db59640 1 -- 172.21.15.148:0/2952954430 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5652ed441cb0 msgr2=0x5652ed4595d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:26.139 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.130+0000 7f8d3db59640 1 --2- 172.21.15.148:0/2952954430 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5652ed441cb0 0x5652ed4595d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:26.139 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.130+0000 7f8d3db59640 1 -- 172.21.15.148:0/2952954430 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652ed441760 con 0x5652ed437410 2024-09-19T07:13:26.139 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.130+0000 7f8d3db59640 1 --2- 172.21.15.148:0/2952954430 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5652ed437410 0x5652ed43f680 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f8d30009900 tx=0x7f8d30000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcfa085992904da5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:26.139 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.130+0000 7f8d1f7fe640 1 -- 172.21.15.148:0/2952954430 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d3004b070 con 0x5652ed437410 2024-09-19T07:13:26.139 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.130+0000 7f8d1f7fe640 1 -- 172.21.15.148:0/2952954430 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d30005520 con 0x5652ed437410 2024-09-19T07:13:26.140 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.130+0000 7f8d1f7fe640 1 -- 172.21.15.148:0/2952954430 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d30035040 con 0x5652ed437410 2024-09-19T07:13:26.140 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.131+0000 7f8d42c35740 1 -- 172.21.15.148:0/2952954430 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5652ed437410 msgr2=0x5652ed43f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:26.140 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.131+0000 7f8d42c35740 1 --2- 172.21.15.148:0/2952954430 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5652ed437410 0x5652ed43f680 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f8d30009900 tx=0x7f8d30000bc0 comp rx=0 tx=0).stop 2024-09-19T07:13:26.140 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.131+0000 7f8d42c35740 1 -- 172.21.15.148:0/2952954430 shutdown_connections 2024-09-19T07:13:26.140 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.131+0000 7f8d42c35740 1 --2- 172.21.15.148:0/2952954430 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5652ed441cb0 0x5652ed4595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:26.140 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.131+0000 7f8d42c35740 1 --2- 172.21.15.148:0/2952954430 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5652ed437410 0x5652ed43f680 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:26.140 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.131+0000 7f8d42c35740 1 --2- 172.21.15.148:0/2952954430 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652ed436af0 0x5652ed43f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:26.140 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.131+0000 7f8d42c35740 1 -- 172.21.15.148:0/2952954430 >> 172.21.15.148:0/2952954430 conn(0x5652ed433060 msgr2=0x5652ed440c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:26.140 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.131+0000 7f8d42c35740 1 -- 172.21.15.148:0/2952954430 shutdown_connections 2024-09-19T07:13:26.140 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.131+0000 7f8d42c35740 1 -- 172.21.15.148:0/2952954430 wait complete. 2024-09-19T07:13:26.140 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.131+0000 7f8d42c35740 1 -- start start 2024-09-19T07:13:26.140 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.132+0000 7f8d42c35740 1 Processor -- start 2024-09-19T07:13:26.141 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.132+0000 7f8d42c35740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652ed436af0 0x5652ed445210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:26.141 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.132+0000 7f8d42c35740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5652ed437410 0x5652ed445750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:26.141 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.132+0000 7f8d42c35740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5652ed441cb0 0x5652ed4ba590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:26.141 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.132+0000 7f8d42c35740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8d381b24c0 con 0x5652ed437410 2024-09-19T07:13:26.141 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.132+0000 7f8d42c35740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8d381b3930 con 0x5652ed441cb0 2024-09-19T07:13:26.141 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.132+0000 7f8d42c35740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8d381b2b90 con 0x5652ed436af0 2024-09-19T07:13:26.141 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.132+0000 7f8d42c35740 10 client.0 _ll_register_callbacks cb 0x7f8d28005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:13:26.141 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.132+0000 7f8d3db59640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5652ed437410 0x5652ed445750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:26.141 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.132+0000 7f8d3db59640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5652ed437410 0x5652ed445750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37384/0 (socket says 172.21.15.148:37384) 2024-09-19T07:13:26.141 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.132+0000 7f8d3d358640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652ed436af0 0x5652ed445210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:26.141 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.132+0000 7f8d3db59640 1 -- 172.21.15.148:0/4286785495 learned_addr learned my addr 172.21.15.148:0/4286785495 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:26.141 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.132+0000 7f8d3d358640 1 --2- 172.21.15.148:0/4286785495 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5652ed441cb0 0x5652ed4ba590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:26.141 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.133+0000 7f8d3d358640 1 -- 172.21.15.148:0/4286785495 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5652ed441cb0 msgr2=0x5652ed4ba590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:26.142 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.133+0000 7f8d3d358640 1 --2- 172.21.15.148:0/4286785495 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5652ed441cb0 0x5652ed4ba590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:26.142 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.133+0000 7f8d3d358640 1 -- 172.21.15.148:0/4286785495 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5652ed437410 msgr2=0x5652ed445750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:26.142 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.133+0000 7f8d3d358640 1 --2- 172.21.15.148:0/4286785495 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5652ed437410 0x5652ed445750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:26.142 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.133+0000 7f8d3d358640 1 -- 172.21.15.148:0/4286785495 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652ed4baad0 con 0x5652ed436af0 2024-09-19T07:13:26.142 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.133+0000 7f8d3d358640 1 --2- 172.21.15.148:0/4286785495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652ed436af0 0x5652ed445210 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c002230 tx=0x7f8d2c003e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72662582d6ba9e75 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:26.142 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.133+0000 7f8d1d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-19T07:13:26.142 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.133+0000 7f8d1d7fa640 1 -- 172.21.15.148:0/4286785495 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c02b040 con 0x5652ed436af0 2024-09-19T07:13:26.142 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.133+0000 7f8d1d7fa640 1 -- 172.21.15.148:0/4286785495 <== mon.1 v2:172.21.15.179:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f8d2c004d10 con 0x5652ed436af0 2024-09-19T07:13:26.142 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.133+0000 7f8d42c35740 1 -- 172.21.15.148:0/4286785495 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d30005520 con 0x5652ed436af0 2024-09-19T07:13:26.142 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.133+0000 7f8d1d7fa640 1 -- 172.21.15.148:0/4286785495 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8d2c0055f0 con 0x5652ed436af0 2024-09-19T07:13:26.143 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.133+0000 7f8d42c35740 10 client.25471 fetch_fsmap learned FSMap version 26 2024-09-19T07:13:26.143 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.133+0000 7f8d42c35740 1 -- 172.21.15.148:0/4286785495 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5652ed4bbde0 con 0x5652ed436af0 2024-09-19T07:13:26.143 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.133+0000 7f8d1d7fa640 1 -- 172.21.15.148:0/4286785495 <== mon.1 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d30005520 con 0x5652ed436af0 2024-09-19T07:13:26.143 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.134+0000 7f8d1d7fa640 1 -- 172.21.15.148:0/4286785495 <== mon.1 v2:172.21.15.179:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f8d2c01e690 con 0x5652ed436af0 2024-09-19T07:13:26.143 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.134+0000 7f8d42c35740 10 client.25471 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T07:13:26.143 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.134+0000 7f8d42c35740 10 client.25471 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:13:26.143 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.134+0000 7f8d42c35740 20 client.25471 populate_metadata read hostname 'smithi148' 2024-09-19T07:13:26.143 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.134+0000 7f8d42c35740 1 --2- 172.21.15.148:0/4286785495 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5652ed4bc3d0 0x5652ed4be7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:26.143 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.134+0000 7f8d42c35740 4 client.25471 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:13:26.143 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.134+0000 7f8d42c35740 1 -- 172.21.15.148:0/4286785495 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5652ed3a2d70 con 0x5652ed4bc3d0 2024-09-19T07:13:26.143 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.134+0000 7f8d3db59640 1 --2- 172.21.15.148:0/4286785495 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5652ed4bc3d0 0x5652ed4be7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:26.143 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.134+0000 7f8d1d7fa640 10 client.25471 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:13:26.143 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:26.134+0000 7f8d3db59640 1 --2- 172.21.15.148:0/4286785495 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5652ed4bc3d0 0x5652ed4be7f0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea191b87845c0dee server_cookie=bbc78c5c6484b60b in_seq=0 out_seq=0 2024-09-19T07:13:26.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:26 smithi165 ceph-mon[35326]: pgmap v74: 97 pgs: 97 active+clean; 54 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.5 MiB/s wr, 243 op/s 2024-09-19T07:13:27.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:26 smithi179 ceph-mon[35716]: pgmap v74: 97 pgs: 97 active+clean; 54 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.5 MiB/s wr, 243 op/s 2024-09-19T07:13:27.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:26 smithi148 ceph-mon[31180]: pgmap v74: 97 pgs: 97 active+clean; 54 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.5 MiB/s wr, 243 op/s 2024-09-19T07:13:27.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:27 smithi165 ceph-mon[35326]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:13:28.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:27 smithi179 ceph-mon[35716]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:13:28.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:27 smithi148 ceph-mon[31180]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:13:28.767 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:13:28.768 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:13:28.768 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:13:28.768 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:13:28.768 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:28.764+0000 7f8d1d7fa640 1 -- 172.21.15.148:0/4286785495 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5652ed3a2d70 con 0x5652ed4bc3d0 2024-09-19T07:13:28.768 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:28.764+0000 7f8d1d7fa640 10 client.25471 handle_command_reply: tid=0 2024-09-19T07:13:28.768 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:28.764+0000 7f8d42c35740 1 client.25471 shutdown 2024-09-19T07:13:28.768 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:28.765+0000 7f8d42c35740 1 -- 172.21.15.148:0/4286785495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652ed436af0 msgr2=0x5652ed445210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:28.768 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:28.765+0000 7f8d42c35740 1 --2- 172.21.15.148:0/4286785495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652ed436af0 0x5652ed445210 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c002230 tx=0x7f8d2c003e30 comp rx=0 tx=0).stop 2024-09-19T07:13:28.769 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:28.765+0000 7f8d42c35740 1 -- 172.21.15.148:0/4286785495 shutdown_connections 2024-09-19T07:13:28.769 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:28.765+0000 7f8d42c35740 1 --2- 172.21.15.148:0/4286785495 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5652ed4bc3d0 0x5652ed4be7f0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:28.769 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:28.765+0000 7f8d42c35740 1 --2- 172.21.15.148:0/4286785495 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5652ed441cb0 0x5652ed4ba590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:28.769 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:28.765+0000 7f8d42c35740 1 --2- 172.21.15.148:0/4286785495 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5652ed437410 0x5652ed445750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:28.769 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:28.765+0000 7f8d1d7fa640 0 client.25471 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:13:28.769 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:28.765+0000 7f8d42c35740 1 --2- 172.21.15.148:0/4286785495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5652ed436af0 0x5652ed445210 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:28.769 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:28.765+0000 7f8d42c35740 1 -- 172.21.15.148:0/4286785495 >> 172.21.15.148:0/4286785495 conn(0x5652ed433060 msgr2=0x5652ed438540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:28.769 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:28.765+0000 7f8d42c35740 1 -- 172.21.15.148:0/4286785495 shutdown_connections 2024-09-19T07:13:28.769 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:28.765+0000 7f8d42c35740 1 -- 172.21.15.148:0/4286785495 wait complete. 2024-09-19T07:13:28.770 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:28.765+0000 7f8d42c35740 20 client.25471 trim_cache size 0 max 16384 2024-09-19T07:13:28.770 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:28.766+0000 7f8d3fdbd640 1 -- 172.21.15.148:0/81623000 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f8d200a34e0 msgr2=0x7f8d200a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:28.770 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:28.766+0000 7f8d3fdbd640 1 --2- 172.21.15.148:0/81623000 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f8d200a34e0 0x7f8d200a59a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8d2800e940 tx=0x7f8d28007ca0 comp rx=0 tx=0).stop 2024-09-19T07:13:28.770 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:28.766+0000 7f8d3fdbd640 1 -- 172.21.15.148:0/81623000 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d381029b0 msgr2=0x7f8d38111060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:28.770 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:28.766+0000 7f8d3fdbd640 1 --2- 172.21.15.148:0/81623000 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d381029b0 0x7f8d38111060 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8d2800e970 tx=0x7f8d2800ed70 comp rx=0 tx=0).stop 2024-09-19T07:13:28.770 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:28.766+0000 7f8d3fdbd640 1 -- 172.21.15.148:0/81623000 shutdown_connections 2024-09-19T07:13:28.770 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:28.766+0000 7f8d3fdbd640 1 --2- 172.21.15.148:0/81623000 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f8d200a34e0 0x7f8d200a59a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:28.770 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:28.766+0000 7f8d3fdbd640 1 --2- 172.21.15.148:0/81623000 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d381029b0 0x7f8d38111060 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:28.770 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:28.766+0000 7f8d3fdbd640 1 --2- 172.21.15.148:0/81623000 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d38101a30 0x7f8d38110b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:28.770 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:28.766+0000 7f8d3fdbd640 1 --2- 172.21.15.148:0/81623000 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d38101070 0x7f8d381105e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:28.771 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:28.766+0000 7f8d3fdbd640 1 -- 172.21.15.148:0/81623000 >> 172.21.15.148:0/81623000 conn(0x7f8d380770f0 msgr2=0x7f8d381049f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:28.771 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:28.767+0000 7f8d3fdbd640 1 -- 172.21.15.148:0/81623000 shutdown_connections 2024-09-19T07:13:28.771 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:28.767+0000 7f8d3fdbd640 1 -- 172.21.15.148:0/81623000 wait complete. 2024-09-19T07:13:29.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:28 smithi179 ceph-mon[35716]: pgmap v75: 97 pgs: 97 active+clean; 54 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.3 MiB/s wr, 221 op/s 2024-09-19T07:13:29.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:28 smithi148 ceph-mon[31180]: pgmap v75: 97 pgs: 97 active+clean; 54 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.3 MiB/s wr, 221 op/s 2024-09-19T07:13:29.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:28 smithi165 ceph-mon[35326]: pgmap v75: 97 pgs: 97 active+clean; 54 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.3 MiB/s wr, 221 op/s 2024-09-19T07:13:30.523 INFO:journalctl@ceph.mds.f.smithi179.stdout:Sep 19 07:13:30 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-f[65676]: *** Caught signal (Segmentation fault) ** 2024-09-19T07:13:30.523 INFO:journalctl@ceph.mds.f.smithi179.stdout:Sep 19 07:13:30 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-f[65676]: in thread 7f8f9b45f640 thread_name:MR_Finisher 2024-09-19T07:13:30.523 INFO:journalctl@ceph.mds.f.smithi179.stdout:Sep 19 07:13:30 smithi179 podman[69707]: 2024-09-19 07:13:30.113947109 +0000 UTC m=+0.028112855 container died 967b3ea9b100138984eb08e98f0a43ab992202ec3249d8c604891e700b7cf7f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-f, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:13:31.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:30 smithi179 ceph-mon[35716]: pgmap v76: 97 pgs: 97 active+clean; 35 MiB data, 585 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.2 MiB/s wr, 813 op/s 2024-09-19T07:13:31.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:30 smithi148 ceph-mon[31180]: pgmap v76: 97 pgs: 97 active+clean; 35 MiB data, 585 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.2 MiB/s wr, 813 op/s 2024-09-19T07:13:31.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:30 smithi165 ceph-mon[35326]: pgmap v76: 97 pgs: 97 active+clean; 35 MiB data, 585 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.2 MiB/s wr, 813 op/s 2024-09-19T07:13:33.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:32 smithi179 ceph-mon[35716]: pgmap v77: 97 pgs: 97 active+clean; 35 MiB data, 585 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 650 op/s 2024-09-19T07:13:33.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:32 smithi148 ceph-mon[31180]: pgmap v77: 97 pgs: 97 active+clean; 35 MiB data, 585 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 650 op/s 2024-09-19T07:13:33.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:32 smithi165 ceph-mon[35326]: pgmap v77: 97 pgs: 97 active+clean; 35 MiB data, 585 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 650 op/s 2024-09-19T07:13:33.193 INFO:tasks.workunit.client.0.smithi148.stdout: 36 502885 779 354467 871 91751 1393 2024-09-19T07:13:33.593 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T07:13:33.944 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:13:34.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.512+0000 7fbb00f1c640 1 -- 172.21.15.148:0/1916849688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbafc100e20 msgr2=0x7fbafc101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:34.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.512+0000 7fbb00f1c640 1 --2- 172.21.15.148:0/1916849688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbafc100e20 0x7fbafc101200 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fbaec009900 tx=0x7fbaec02a480 comp rx=0 tx=0).stop 2024-09-19T07:13:34.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.512+0000 7fbb00f1c640 1 -- 172.21.15.148:0/1916849688 shutdown_connections 2024-09-19T07:13:34.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.512+0000 7fbb00f1c640 1 --2- 172.21.15.148:0/1916849688 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbafc102ef0 0x7fbafc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:34.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.512+0000 7fbb00f1c640 1 --2- 172.21.15.148:0/1916849688 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbafc102570 0x7fbafc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:34.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.512+0000 7fbb00f1c640 1 --2- 172.21.15.148:0/1916849688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbafc100e20 0x7fbafc101200 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:34.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.512+0000 7fbb00f1c640 1 -- 172.21.15.148:0/1916849688 >> 172.21.15.148:0/1916849688 conn(0x7fbafc0fc7d0 msgr2=0x7fbafc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:34.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.512+0000 7fbb00f1c640 1 -- 172.21.15.148:0/1916849688 shutdown_connections 2024-09-19T07:13:34.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.512+0000 7fbb00f1c640 1 -- 172.21.15.148:0/1916849688 wait complete. 2024-09-19T07:13:34.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.513+0000 7fbb00f1c640 1 Processor -- start 2024-09-19T07:13:34.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.513+0000 7fbb00f1c640 1 -- start start 2024-09-19T07:13:34.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.513+0000 7fbb00f1c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbafc100e20 0x7fbafc1993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:34.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.513+0000 7fbb00f1c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbafc102570 0x7fbafc199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:34.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.513+0000 7fbb00f1c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbafc102ef0 0x7fbafc1a4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:34.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.513+0000 7fbb00f1c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbafc110f80 con 0x7fbafc102ef0 2024-09-19T07:13:34.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.513+0000 7fbb00f1c640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbafc110e00 con 0x7fbafc100e20 2024-09-19T07:13:34.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.513+0000 7fbb00f1c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbafc111100 con 0x7fbafc102570 2024-09-19T07:13:34.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.513+0000 7fbafad9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbafc102ef0 0x7fbafc1a4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:34.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.513+0000 7fbafa59c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbafc100e20 0x7fbafc1993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:34.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.513+0000 7fbaf3fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbafc102570 0x7fbafc199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:34.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.513+0000 7fbafad9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbafc102ef0 0x7fbafc1a4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42926/0 (socket says 172.21.15.148:42926) 2024-09-19T07:13:34.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.513+0000 7fbaf3fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbafc102570 0x7fbafc199910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:41142/0 (socket says 172.21.15.148:41142) 2024-09-19T07:13:34.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.513+0000 7fbafad9d640 1 -- 172.21.15.148:0/3841913481 learned_addr learned my addr 172.21.15.148:0/3841913481 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:34.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.514+0000 7fbafa59c640 1 -- 172.21.15.148:0/3841913481 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbafc102570 msgr2=0x7fbafc199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:34.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.514+0000 7fbafa59c640 1 --2- 172.21.15.148:0/3841913481 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbafc102570 0x7fbafc199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:34.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.514+0000 7fbafa59c640 1 -- 172.21.15.148:0/3841913481 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbafc102ef0 msgr2=0x7fbafc1a4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:34.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.514+0000 7fbafa59c640 1 --2- 172.21.15.148:0/3841913481 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbafc102ef0 0x7fbafc1a4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:34.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.514+0000 7fbafa59c640 1 -- 172.21.15.148:0/3841913481 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbafc1a4990 con 0x7fbafc100e20 2024-09-19T07:13:34.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.514+0000 7fbafad9d640 1 --2- 172.21.15.148:0/3841913481 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbafc102ef0 0x7fbafc1a4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:13:34.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.514+0000 7fbafa59c640 1 --2- 172.21.15.148:0/3841913481 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbafc100e20 0x7fbafc1993d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbaec005940 tx=0x7fbaec003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:34.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.514+0000 7fbaf37fe640 1 -- 172.21.15.148:0/3841913481 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaec03f070 con 0x7fbafc100e20 2024-09-19T07:13:34.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.514+0000 7fbb00f1c640 1 -- 172.21.15.148:0/3841913481 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbafc1a4b60 con 0x7fbafc100e20 2024-09-19T07:13:34.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.514+0000 7fbaf37fe640 1 -- 172.21.15.148:0/3841913481 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbaec031c30 con 0x7fbafc100e20 2024-09-19T07:13:34.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.514+0000 7fbaf37fe640 1 -- 172.21.15.148:0/3841913481 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaec035030 con 0x7fbafc100e20 2024-09-19T07:13:34.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.514+0000 7fbb00f1c640 1 -- 172.21.15.148:0/3841913481 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbafc1a4fc0 con 0x7fbafc100e20 2024-09-19T07:13:34.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.516+0000 7fbaf37fe640 1 -- 172.21.15.148:0/3841913481 <== mon.2 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fbaec042070 con 0x7fbafc100e20 2024-09-19T07:13:34.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.517+0000 7fbb032f5740 1 Processor -- start 2024-09-19T07:13:34.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.517+0000 7fbb032f5740 1 -- start start 2024-09-19T07:13:34.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.517+0000 7fbb032f5740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591d0c574a0 0x5591d0c57880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:34.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.517+0000 7fbb032f5740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5591d0c57dc0 0x5591d0c62140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:34.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.517+0000 7fbb032f5740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591d0c62680 0x5591d0c64a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:34.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.517+0000 7fbb032f5740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5591d0bbd2e0 con 0x5591d0c574a0 2024-09-19T07:13:34.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.517+0000 7fbb032f5740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5591d0b64ce0 con 0x5591d0c57dc0 2024-09-19T07:13:34.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.517+0000 7fbb032f5740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5591d0bb92a0 con 0x5591d0c62680 2024-09-19T07:13:34.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.517+0000 7fbafad9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591d0c574a0 0x5591d0c57880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:34.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.517+0000 7fbafad9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591d0c574a0 0x5591d0c57880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42940/0 (socket says 172.21.15.148:42940) 2024-09-19T07:13:34.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.517+0000 7fbafad9d640 1 -- 172.21.15.148:0/2014496079 learned_addr learned my addr 172.21.15.148:0/2014496079 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:34.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.517+0000 7fbaf3fff640 1 --2- 172.21.15.148:0/2014496079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591d0c62680 0x5591d0c64a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:34.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.517+0000 7fbaf37fe640 1 --2- 172.21.15.148:0/3841913481 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fbae80a33b0 0x7fbae80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:34.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.517+0000 7fbafa59c640 1 --2- 172.21.15.148:0/2014496079 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5591d0c57dc0 0x5591d0c62140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:34.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.518+0000 7fbafad9d640 1 -- 172.21.15.148:0/2014496079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591d0c62680 msgr2=0x5591d0c64a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:34.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.518+0000 7fbafad9d640 1 --2- 172.21.15.148:0/2014496079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591d0c62680 0x5591d0c64a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:34.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.518+0000 7fbafad9d640 1 -- 172.21.15.148:0/2014496079 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5591d0c57dc0 msgr2=0x5591d0c62140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:34.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.518+0000 7fbafad9d640 1 --2- 172.21.15.148:0/2014496079 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5591d0c57dc0 0x5591d0c62140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:34.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.518+0000 7fbafad9d640 1 -- 172.21.15.148:0/2014496079 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591d0b49440 con 0x5591d0c574a0 2024-09-19T07:13:34.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.518+0000 7fbaf37fe640 1 -- 172.21.15.148:0/3841913481 <== mon.2 v2:172.21.15.165:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fbaec0f0270 con 0x7fbafc100e20 2024-09-19T07:13:34.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.518+0000 7fbafad9d640 1 --2- 172.21.15.148:0/3841913481 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fbae80a33b0 0x7fbae80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:34.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.518+0000 7fbafad9d640 1 --2- 172.21.15.148:0/2014496079 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591d0c574a0 0x5591d0c57880 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fbaf40119d0 tx=0x7fbaf4011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73a6d214cbbb37f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:34.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.518+0000 7fbaf0ff9640 1 -- 172.21.15.148:0/2014496079 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf4017070 con 0x5591d0c574a0 2024-09-19T07:13:34.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.518+0000 7fbaf0ff9640 1 -- 172.21.15.148:0/2014496079 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbaf4010910 con 0x5591d0c574a0 2024-09-19T07:13:34.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.518+0000 7fbafad9d640 1 --2- 172.21.15.148:0/3841913481 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fbae80a33b0 0x7fbae80a5870 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4023000 tx=0x7fbaf4024000 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:34.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.518+0000 7fbaf0ff9640 1 -- 172.21.15.148:0/2014496079 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf400e5d0 con 0x5591d0c574a0 2024-09-19T07:13:34.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.519+0000 7fbb032f5740 1 -- 172.21.15.148:0/2014496079 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591d0c574a0 msgr2=0x5591d0c57880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:34.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.519+0000 7fbb032f5740 1 --2- 172.21.15.148:0/2014496079 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591d0c574a0 0x5591d0c57880 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fbaf40119d0 tx=0x7fbaf4011e90 comp rx=0 tx=0).stop 2024-09-19T07:13:34.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.519+0000 7fbb032f5740 1 -- 172.21.15.148:0/2014496079 shutdown_connections 2024-09-19T07:13:34.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.519+0000 7fbb032f5740 1 --2- 172.21.15.148:0/2014496079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591d0c62680 0x5591d0c64a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:34.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.519+0000 7fbb032f5740 1 --2- 172.21.15.148:0/2014496079 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5591d0c57dc0 0x5591d0c62140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:34.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.519+0000 7fbb032f5740 1 --2- 172.21.15.148:0/2014496079 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591d0c574a0 0x5591d0c57880 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:34.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.519+0000 7fbb032f5740 1 -- 172.21.15.148:0/2014496079 >> 172.21.15.148:0/2014496079 conn(0x5591d0c53a30 msgr2=0x5591d0c53e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:34.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.519+0000 7fbb032f5740 1 -- 172.21.15.148:0/2014496079 shutdown_connections 2024-09-19T07:13:34.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.519+0000 7fbb032f5740 1 -- 172.21.15.148:0/2014496079 wait complete. 2024-09-19T07:13:34.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.519+0000 7fbb032f5740 1 -- start start 2024-09-19T07:13:34.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.520+0000 7fbb032f5740 1 Processor -- start 2024-09-19T07:13:34.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.520+0000 7fbb032f5740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591d0c574a0 0x5591d0c61e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:34.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.520+0000 7fbb032f5740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5591d0c57dc0 0x5591d0c5f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:34.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.520+0000 7fbb032f5740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591d0c62680 0x5591d0c5f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:34.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.520+0000 7fbb032f5740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5591d0c652a0 con 0x5591d0c574a0 2024-09-19T07:13:34.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.520+0000 7fbb032f5740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5591d0b78050 con 0x5591d0c57dc0 2024-09-19T07:13:34.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.520+0000 7fbb032f5740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5591d0c65420 con 0x5591d0c62680 2024-09-19T07:13:34.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.520+0000 7fbb032f5740 10 client.0 _ll_register_callbacks cb 0x5591d0bb8160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:13:34.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.520+0000 7fbafa59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591d0c574a0 0x5591d0c61e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:34.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.520+0000 7fbafa59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591d0c574a0 0x5591d0c61e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42942/0 (socket says 172.21.15.148:42942) 2024-09-19T07:13:34.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.520+0000 7fbafa59c640 1 -- 172.21.15.148:0/1120487328 learned_addr learned my addr 172.21.15.148:0/1120487328 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:34.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.520+0000 7fbafad9d640 1 --2- 172.21.15.148:0/1120487328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591d0c62680 0x5591d0c5f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:34.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.520+0000 7fbaf3fff640 1 --2- 172.21.15.148:0/1120487328 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5591d0c57dc0 0x5591d0c5f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:34.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.520+0000 7fbafa59c640 1 -- 172.21.15.148:0/1120487328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591d0c62680 msgr2=0x5591d0c5f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:34.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.520+0000 7fbafa59c640 1 --2- 172.21.15.148:0/1120487328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591d0c62680 0x5591d0c5f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:34.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.520+0000 7fbafa59c640 1 -- 172.21.15.148:0/1120487328 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5591d0c57dc0 msgr2=0x5591d0c5f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:34.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.520+0000 7fbafa59c640 1 --2- 172.21.15.148:0/1120487328 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5591d0c57dc0 0x5591d0c5f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:34.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.520+0000 7fbafa59c640 1 -- 172.21.15.148:0/1120487328 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591d092e3c0 con 0x5591d0c574a0 2024-09-19T07:13:34.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.520+0000 7fbafa59c640 1 --2- 172.21.15.148:0/1120487328 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591d0c574a0 0x5591d0c61e90 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fbaec0b82f0 tx=0x7fbaec02a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22c5ad44b4ceca44 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:34.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.520+0000 7fbae1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:13:34.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.521+0000 7fbae1ffb640 1 -- 172.21.15.148:0/1120487328 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaec049030 con 0x5591d0c574a0 2024-09-19T07:13:34.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.521+0000 7fbae1ffb640 1 -- 172.21.15.148:0/1120487328 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fbaec0edc50 con 0x5591d0c574a0 2024-09-19T07:13:34.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.521+0000 7fbb032f5740 1 -- 172.21.15.148:0/1120487328 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbaf4010910 con 0x5591d0c574a0 2024-09-19T07:13:34.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.521+0000 7fbae1ffb640 1 -- 172.21.15.148:0/1120487328 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbaec0ede50 con 0x5591d0c574a0 2024-09-19T07:13:34.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.521+0000 7fbb032f5740 10 client.16071 fetch_fsmap learned FSMap version 27 2024-09-19T07:13:34.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.521+0000 7fbb032f5740 1 -- 172.21.15.148:0/1120487328 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5591d0c70b30 con 0x5591d0c574a0 2024-09-19T07:13:34.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.521+0000 7fbae1ffb640 1 -- 172.21.15.148:0/1120487328 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbaf4010910 con 0x5591d0c574a0 2024-09-19T07:13:34.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.521+0000 7fbae1ffb640 1 -- 172.21.15.148:0/1120487328 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fbaec0c4d40 con 0x5591d0c574a0 2024-09-19T07:13:34.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.521+0000 7fbb032f5740 10 client.16071 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T07:13:34.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.521+0000 7fbb032f5740 10 client.16071 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:13:34.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.521+0000 7fbb032f5740 20 client.16071 populate_metadata read hostname 'smithi148' 2024-09-19T07:13:34.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.521+0000 7fbb032f5740 1 --2- 172.21.15.148:0/1120487328 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5591d0c71d00 0x5591d0c74130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:34.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.521+0000 7fbb032f5740 4 client.16071 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:13:34.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.521+0000 7fbb032f5740 1 -- 172.21.15.148:0/1120487328 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5591d0bca850 con 0x5591d0c71d00 2024-09-19T07:13:34.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.522+0000 7fbaf3fff640 1 --2- 172.21.15.148:0/1120487328 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5591d0c71d00 0x5591d0c74130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:34.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.522+0000 7fbae1ffb640 10 client.16071 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:13:34.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.522+0000 7fbaf3fff640 1 --2- 172.21.15.148:0/1120487328 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5591d0c71d00 0x5591d0c74130 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58a46e0b43d91359 server_cookie=a531b6a9b0da4022 in_seq=0 out_seq=0 2024-09-19T07:13:34.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.523+0000 7fbae1ffb640 1 -- 172.21.15.148:0/1120487328 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5591d0bca850 con 0x5591d0c71d00 2024-09-19T07:13:34.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.523+0000 7fbae1ffb640 10 client.16071 handle_command_reply: tid=0 2024-09-19T07:13:34.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.523+0000 7fbb032f5740 1 client.16071 shutdown 2024-09-19T07:13:34.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.523+0000 7fbb032f5740 1 -- 172.21.15.148:0/1120487328 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591d0c574a0 msgr2=0x5591d0c61e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:34.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.523+0000 7fbb032f5740 1 --2- 172.21.15.148:0/1120487328 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591d0c574a0 0x5591d0c61e90 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fbaec0b82f0 tx=0x7fbaec02a480 comp rx=0 tx=0).stop 2024-09-19T07:13:34.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.524+0000 7fbb032f5740 1 -- 172.21.15.148:0/1120487328 shutdown_connections 2024-09-19T07:13:34.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.524+0000 7fbb032f5740 1 --2- 172.21.15.148:0/1120487328 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5591d0c71d00 0x5591d0c74130 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:34.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.524+0000 7fbb032f5740 1 --2- 172.21.15.148:0/1120487328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591d0c62680 0x5591d0c5f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:34.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.524+0000 7fbae1ffb640 0 client.16071 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:13:34.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.524+0000 7fbb032f5740 1 --2- 172.21.15.148:0/1120487328 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5591d0c57dc0 0x5591d0c5f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:34.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.524+0000 7fbb032f5740 1 --2- 172.21.15.148:0/1120487328 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591d0c574a0 0x5591d0c61e90 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:34.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.524+0000 7fbb032f5740 1 -- 172.21.15.148:0/1120487328 >> 172.21.15.148:0/1120487328 conn(0x5591d0c53a30 msgr2=0x5591d0c59760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:34.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.524+0000 7fbb032f5740 1 -- 172.21.15.148:0/1120487328 shutdown_connections 2024-09-19T07:13:34.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.524+0000 7fbb032f5740 1 -- 172.21.15.148:0/1120487328 wait complete. 2024-09-19T07:13:34.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.524+0000 7fbb032f5740 20 client.16071 trim_cache size 0 max 16384 2024-09-19T07:13:34.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.541+0000 7fbb032f5740 1 Processor -- start 2024-09-19T07:13:34.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.554+0000 7fbb032f5740 1 -- start start 2024-09-19T07:13:34.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.554+0000 7fbb032f5740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5591d0c574a0 0x5591d0c52a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:34.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.554+0000 7fbb032f5740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591d0c57dc0 0x5591d0c79a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:34.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.554+0000 7fbb032f5740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591d0c62680 0x5591d0c79f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:34.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.554+0000 7fbafa59c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5591d0c574a0 0x5591d0c52a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:34.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.554+0000 7fbafa59c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5591d0c574a0 0x5591d0c52a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:45184/0 (socket says 172.21.15.148:45184) 2024-09-19T07:13:34.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.555+0000 7fbafad9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591d0c62680 0x5591d0c79f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:34.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.555+0000 7fbafa59c640 1 -- 172.21.15.148:0/1955106414 learned_addr learned my addr 172.21.15.148:0/1955106414 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:34.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.555+0000 7fbb032f5740 1 -- 172.21.15.148:0/1955106414 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbafc1adf20 con 0x5591d0c62680 2024-09-19T07:13:34.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.555+0000 7fbb032f5740 1 -- 172.21.15.148:0/1955106414 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbafc1ab7f0 con 0x5591d0c574a0 2024-09-19T07:13:34.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.555+0000 7fbb032f5740 1 -- 172.21.15.148:0/1955106414 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbafc1a9640 con 0x5591d0c57dc0 2024-09-19T07:13:34.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.555+0000 7fbaf3fff640 1 --2- 172.21.15.148:0/1955106414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591d0c57dc0 0x5591d0c79a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:34.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.555+0000 7fbafa59c640 1 -- 172.21.15.148:0/1955106414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591d0c57dc0 msgr2=0x5591d0c79a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:34.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.555+0000 7fbafa59c640 1 --2- 172.21.15.148:0/1955106414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591d0c57dc0 0x5591d0c79a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:34.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.555+0000 7fbafa59c640 1 -- 172.21.15.148:0/1955106414 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591d0c62680 msgr2=0x5591d0c79f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:34.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.555+0000 7fbafa59c640 1 --2- 172.21.15.148:0/1955106414 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591d0c62680 0x5591d0c79f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:34.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.555+0000 7fbafa59c640 1 -- 172.21.15.148:0/1955106414 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591d0c53860 con 0x5591d0c574a0 2024-09-19T07:13:34.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.555+0000 7fbafa59c640 1 --2- 172.21.15.148:0/1955106414 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5591d0c574a0 0x5591d0c52a60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbaec0bc5a0 tx=0x7fbaec0edab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22ffe53d9047637a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:34.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.556+0000 7fbae3fff640 1 -- 172.21.15.148:0/1955106414 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaec0c51d0 con 0x5591d0c574a0 2024-09-19T07:13:34.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.556+0000 7fbae3fff640 1 -- 172.21.15.148:0/1955106414 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbaec0f0070 con 0x5591d0c574a0 2024-09-19T07:13:34.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.556+0000 7fbae3fff640 1 -- 172.21.15.148:0/1955106414 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaec0b8360 con 0x5591d0c574a0 2024-09-19T07:13:34.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.557+0000 7fbb032f5740 1 -- 172.21.15.148:0/1955106414 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5591d0c574a0 msgr2=0x5591d0c52a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:34.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.557+0000 7fbb032f5740 1 --2- 172.21.15.148:0/1955106414 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5591d0c574a0 0x5591d0c52a60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbaec0bc5a0 tx=0x7fbaec0edab0 comp rx=0 tx=0).stop 2024-09-19T07:13:34.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.557+0000 7fbb032f5740 1 -- 172.21.15.148:0/1955106414 shutdown_connections 2024-09-19T07:13:34.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.557+0000 7fbb032f5740 1 --2- 172.21.15.148:0/1955106414 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591d0c62680 0x5591d0c79f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:34.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.557+0000 7fbb032f5740 1 --2- 172.21.15.148:0/1955106414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591d0c57dc0 0x5591d0c79a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:34.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.557+0000 7fbb032f5740 1 --2- 172.21.15.148:0/1955106414 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5591d0c574a0 0x5591d0c52a60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:34.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.557+0000 7fbb032f5740 1 -- 172.21.15.148:0/1955106414 >> 172.21.15.148:0/1955106414 conn(0x5591d0c53a30 msgr2=0x5591d0c52350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:34.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.557+0000 7fbb032f5740 1 -- 172.21.15.148:0/1955106414 shutdown_connections 2024-09-19T07:13:34.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.557+0000 7fbb032f5740 1 -- 172.21.15.148:0/1955106414 wait complete. 2024-09-19T07:13:34.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.558+0000 7fbb032f5740 1 -- start start 2024-09-19T07:13:34.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.558+0000 7fbb032f5740 1 Processor -- start 2024-09-19T07:13:34.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.558+0000 7fbb032f5740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5591d0c574a0 0x5591d0c6aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:34.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.558+0000 7fbb032f5740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591d0c57dc0 0x5591d0c67e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:34.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.558+0000 7fbb032f5740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591d0c62680 0x5591d0c68370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:34.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.558+0000 7fbaf3fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591d0c57dc0 0x5591d0c67e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:34.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.558+0000 7fbafa59c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5591d0c574a0 0x5591d0c6aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:34.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.558+0000 7fbaf3fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591d0c57dc0 0x5591d0c67e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:41178/0 (socket says 172.21.15.148:41178) 2024-09-19T07:13:34.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.558+0000 7fbaf3fff640 1 -- 172.21.15.148:0/1258526440 learned_addr learned my addr 172.21.15.148:0/1258526440 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:34.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.558+0000 7fbb032f5740 1 -- 172.21.15.148:0/1258526440 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbafc1a9cb0 con 0x5591d0c62680 2024-09-19T07:13:34.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.558+0000 7fbafad9d640 1 --2- 172.21.15.148:0/1258526440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591d0c62680 0x5591d0c68370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:34.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.558+0000 7fbb032f5740 1 -- 172.21.15.148:0/1258526440 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbafc1ab120 con 0x5591d0c574a0 2024-09-19T07:13:34.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.558+0000 7fbb032f5740 1 -- 172.21.15.148:0/1258526440 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbafc1aa380 con 0x5591d0c57dc0 2024-09-19T07:13:34.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.558+0000 7fbb032f5740 10 client.0 _ll_register_callbacks cb 0x7fbaec005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:13:34.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.559+0000 7fbafa59c640 1 -- 172.21.15.148:0/1258526440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591d0c57dc0 msgr2=0x5591d0c67e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:34.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.559+0000 7fbafa59c640 1 --2- 172.21.15.148:0/1258526440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591d0c57dc0 0x5591d0c67e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:34.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.559+0000 7fbafa59c640 1 -- 172.21.15.148:0/1258526440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591d0c62680 msgr2=0x5591d0c68370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:34.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.559+0000 7fbafa59c640 1 --2- 172.21.15.148:0/1258526440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591d0c62680 0x5591d0c68370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:34.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.559+0000 7fbafa59c640 1 -- 172.21.15.148:0/1258526440 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591d0c688b0 con 0x5591d0c574a0 2024-09-19T07:13:34.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.559+0000 7fbafa59c640 1 --2- 172.21.15.148:0/1258526440 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5591d0c574a0 0x5591d0c6aae0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbaec0b8fe0 tx=0x7fbaec0edf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e09fb50da7d3f6f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:34.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.559+0000 7fbae1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-19T07:13:34.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.559+0000 7fbae1ffb640 1 -- 172.21.15.148:0/1258526440 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaec0c0910 con 0x5591d0c574a0 2024-09-19T07:13:34.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.559+0000 7fbae1ffb640 1 -- 172.21.15.148:0/1258526440 <== mon.2 v2:172.21.15.165:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fbaec0b8360 con 0x5591d0c574a0 2024-09-19T07:13:34.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.559+0000 7fbb032f5740 1 -- 172.21.15.148:0/1258526440 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbaec0f0070 con 0x5591d0c574a0 2024-09-19T07:13:34.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.559+0000 7fbae1ffb640 1 -- 172.21.15.148:0/1258526440 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbaec0bbc90 con 0x5591d0c574a0 2024-09-19T07:13:34.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.559+0000 7fbb032f5740 10 client.25433 fetch_fsmap learned FSMap version 27 2024-09-19T07:13:34.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.559+0000 7fbb032f5740 1 -- 172.21.15.148:0/1258526440 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5591d0c688b0 con 0x5591d0c574a0 2024-09-19T07:13:34.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.560+0000 7fbae1ffb640 1 -- 172.21.15.148:0/1258526440 <== mon.2 v2:172.21.15.165:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbaec0f0070 con 0x5591d0c574a0 2024-09-19T07:13:34.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.560+0000 7fbae1ffb640 1 -- 172.21.15.148:0/1258526440 <== mon.2 v2:172.21.15.165:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fbaec0c1aa0 con 0x5591d0c574a0 2024-09-19T07:13:34.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.561+0000 7fbb032f5740 10 client.25433 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T07:13:34.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.561+0000 7fbb032f5740 10 client.25433 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:13:34.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.561+0000 7fbb032f5740 20 client.25433 populate_metadata read hostname 'smithi148' 2024-09-19T07:13:34.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.561+0000 7fbb032f5740 1 --2- 172.21.15.148:0/1258526440 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5591d0c71d00 0x5591d0cdea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:34.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.561+0000 7fbb032f5740 4 client.25433 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T07:13:34.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.561+0000 7fbb032f5740 1 -- 172.21.15.148:0/1258526440 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5591d0bc4d60 con 0x5591d0c71d00 2024-09-19T07:13:34.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.561+0000 7fbaf3fff640 1 --2- 172.21.15.148:0/1258526440 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5591d0c71d00 0x5591d0cdea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:34.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.561+0000 7fbaf3fff640 1 --2- 172.21.15.148:0/1258526440 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5591d0c71d00 0x5591d0cdea40 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7e730d1d6d20a79 server_cookie=d0b94034216a919e in_seq=0 out_seq=0 2024-09-19T07:13:34.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.561+0000 7fbae1ffb640 10 client.25433 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:13:34.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.563+0000 7fbae1ffb640 1 -- 172.21.15.148:0/1258526440 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5591d0bc4d60 con 0x5591d0c71d00 2024-09-19T07:13:34.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.563+0000 7fbae1ffb640 10 client.25433 handle_command_reply: tid=0 2024-09-19T07:13:34.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.563+0000 7fbb032f5740 1 client.25433 shutdown 2024-09-19T07:13:34.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.564+0000 7fbb032f5740 1 -- 172.21.15.148:0/1258526440 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5591d0c574a0 msgr2=0x5591d0c6aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:34.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.564+0000 7fbb032f5740 1 --2- 172.21.15.148:0/1258526440 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5591d0c574a0 0x5591d0c6aae0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbaec0b8fe0 tx=0x7fbaec0edf00 comp rx=0 tx=0).stop 2024-09-19T07:13:34.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.564+0000 7fbb032f5740 1 -- 172.21.15.148:0/1258526440 shutdown_connections 2024-09-19T07:13:34.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.564+0000 7fbb032f5740 1 --2- 172.21.15.148:0/1258526440 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5591d0c71d00 0x5591d0cdea40 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:34.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.564+0000 7fbae1ffb640 0 client.25433 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:13:34.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.564+0000 7fbb032f5740 1 --2- 172.21.15.148:0/1258526440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591d0c62680 0x5591d0c68370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:34.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.564+0000 7fbb032f5740 1 --2- 172.21.15.148:0/1258526440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5591d0c57dc0 0x5591d0c67e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:34.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.564+0000 7fbb032f5740 1 --2- 172.21.15.148:0/1258526440 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5591d0c574a0 0x5591d0c6aae0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:34.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.564+0000 7fbb032f5740 1 -- 172.21.15.148:0/1258526440 >> 172.21.15.148:0/1258526440 conn(0x5591d0c53a30 msgr2=0x5591d0c52b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:34.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.564+0000 7fbb032f5740 1 -- 172.21.15.148:0/1258526440 shutdown_connections 2024-09-19T07:13:34.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.564+0000 7fbb032f5740 1 -- 172.21.15.148:0/1258526440 wait complete. 2024-09-19T07:13:34.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.564+0000 7fbb032f5740 20 client.25433 trim_cache size 0 max 16384 2024-09-19T07:13:34.567 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:13:34.567 INFO:teuthology.orchestra.run.smithi148.stdout: "status": "no active scrubs running", 2024-09-19T07:13:34.567 INFO:teuthology.orchestra.run.smithi148.stdout: "scrubs": {} 2024-09-19T07:13:34.567 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:13:34.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.565+0000 7fbb00f1c640 1 -- 172.21.15.148:0/3841913481 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fbae80a33b0 msgr2=0x7fbae80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:34.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.565+0000 7fbb00f1c640 1 --2- 172.21.15.148:0/3841913481 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fbae80a33b0 0x7fbae80a5870 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4023000 tx=0x7fbaf4024000 comp rx=0 tx=0).stop 2024-09-19T07:13:34.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.565+0000 7fbb00f1c640 1 -- 172.21.15.148:0/3841913481 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbafc100e20 msgr2=0x7fbafc1993d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:34.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.565+0000 7fbb00f1c640 1 --2- 172.21.15.148:0/3841913481 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbafc100e20 0x7fbafc1993d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbaec005940 tx=0x7fbaec003c10 comp rx=0 tx=0).stop 2024-09-19T07:13:34.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.565+0000 7fbb00f1c640 1 -- 172.21.15.148:0/3841913481 shutdown_connections 2024-09-19T07:13:34.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.565+0000 7fbb00f1c640 1 --2- 172.21.15.148:0/3841913481 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fbae80a33b0 0x7fbae80a5870 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:34.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.565+0000 7fbb00f1c640 1 --2- 172.21.15.148:0/3841913481 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbafc102ef0 0x7fbafc1a4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:34.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.565+0000 7fbb00f1c640 1 --2- 172.21.15.148:0/3841913481 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbafc102570 0x7fbafc199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:34.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.565+0000 7fbb00f1c640 1 --2- 172.21.15.148:0/3841913481 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbafc100e20 0x7fbafc1993d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:34.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.565+0000 7fbb00f1c640 1 -- 172.21.15.148:0/3841913481 >> 172.21.15.148:0/3841913481 conn(0x7fbafc0fc7d0 msgr2=0x7fbafc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:34.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.565+0000 7fbb00f1c640 1 -- 172.21.15.148:0/3841913481 shutdown_connections 2024-09-19T07:13:34.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:34.565+0000 7fbb00f1c640 1 -- 172.21.15.148:0/3841913481 wait complete. 2024-09-19T07:13:34.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:34 smithi148 ceph-mon[31180]: pgmap v78: 97 pgs: 97 active+clean; 35 MiB data, 585 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 650 op/s 2024-09-19T07:13:35.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:34 smithi179 ceph-mon[35716]: pgmap v78: 97 pgs: 97 active+clean; 35 MiB data, 585 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 650 op/s 2024-09-19T07:13:35.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:34 smithi165 ceph-mon[35326]: pgmap v78: 97 pgs: 97 active+clean; 35 MiB data, 585 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 650 op/s 2024-09-19T07:13:35.474 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T07:13:35.475 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:13:35.870 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:13:35.988 INFO:journalctl@ceph.mds.f.smithi179.stdout:Sep 19 07:13:35 smithi179 podman[69707]: 2024-09-19 07:13:35.705835689 +0000 UTC m=+5.620001423 container remove 967b3ea9b100138984eb08e98f0a43ab992202ec3249d8c604891e700b7cf7f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-f, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-19T07:13:35.988 INFO:journalctl@ceph.mds.f.smithi179.stdout:Sep 19 07:13:35 smithi179 systemd[1]: ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mds.f.service: Main process exited, code=exited, status=139/n/a 2024-09-19T07:13:36.272 INFO:journalctl@ceph.mds.f.smithi179.stdout:Sep 19 07:13:35 smithi179 systemd[1]: ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mds.f.service: Failed with result 'exit-code'. 2024-09-19T07:13:36.272 INFO:journalctl@ceph.mds.f.smithi179.stdout:Sep 19 07:13:35 smithi179 systemd[1]: ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mds.f.service: Consumed 3.565s CPU time. 2024-09-19T07:13:36.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.406+0000 7f2cd8b89640 1 -- 172.21.15.148:0/3487105739 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2cd4103660 msgr2=0x7f2cd410bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:36.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.406+0000 7f2cd8b89640 1 --2- 172.21.15.148:0/3487105739 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2cd4103660 0x7f2cd410bb50 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8009900 tx=0x7f2cc802a480 comp rx=0 tx=0).stop 2024-09-19T07:13:36.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.406+0000 7f2cd8b89640 1 -- 172.21.15.148:0/3487105739 shutdown_connections 2024-09-19T07:13:36.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.406+0000 7f2cd8b89640 1 --2- 172.21.15.148:0/3487105739 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cd410c170 0x7f2cd410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:36.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.406+0000 7f2cd8b89640 1 --2- 172.21.15.148:0/3487105739 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2cd4103660 0x7f2cd410bb50 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:36.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.406+0000 7f2cd8b89640 1 --2- 172.21.15.148:0/3487105739 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2cd4102d40 0x7f2cd4103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:36.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.406+0000 7f2cd8b89640 1 -- 172.21.15.148:0/3487105739 >> 172.21.15.148:0/3487105739 conn(0x7f2cd40fc7a0 msgr2=0x7f2cd40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:36.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.406+0000 7f2cd8b89640 1 -- 172.21.15.148:0/3487105739 shutdown_connections 2024-09-19T07:13:36.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.406+0000 7f2cd8b89640 1 -- 172.21.15.148:0/3487105739 wait complete. 2024-09-19T07:13:36.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.407+0000 7f2cd8b89640 1 Processor -- start 2024-09-19T07:13:36.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.407+0000 7f2cd8b89640 1 -- start start 2024-09-19T07:13:36.421 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.407+0000 7f2cd8b89640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2cd4102d40 0x7f2cd41984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:36.421 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.407+0000 7f2cd8b89640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2cd4103660 0x7f2cd4198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:36.421 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.407+0000 7f2cd8b89640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cd410c170 0x7f2cd419cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:36.421 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.407+0000 7f2cd8b89640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd4111f70 con 0x7f2cd4103660 2024-09-19T07:13:36.421 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.407+0000 7f2cd8b89640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd4111df0 con 0x7f2cd4102d40 2024-09-19T07:13:36.421 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.407+0000 7f2cd8b89640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd41120f0 con 0x7f2cd410c170 2024-09-19T07:13:36.421 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.408+0000 7f2cd1d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2cd4103660 0x7f2cd4198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:36.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.408+0000 7f2cd259c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2cd4102d40 0x7f2cd41984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:36.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.408+0000 7f2cd1d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2cd4103660 0x7f2cd4198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42976/0 (socket says 172.21.15.148:42976) 2024-09-19T07:13:36.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.408+0000 7f2cd259c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2cd4102d40 0x7f2cd41984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:45212/0 (socket says 172.21.15.148:45212) 2024-09-19T07:13:36.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.408+0000 7f2cd1d9b640 1 -- 172.21.15.148:0/2959190759 learned_addr learned my addr 172.21.15.148:0/2959190759 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:36.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.408+0000 7f2cd2d9d640 1 --2- 172.21.15.148:0/2959190759 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cd410c170 0x7f2cd419cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:36.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.408+0000 7f2cd1d9b640 1 -- 172.21.15.148:0/2959190759 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cd410c170 msgr2=0x7f2cd419cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:36.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.408+0000 7f2cd1d9b640 1 --2- 172.21.15.148:0/2959190759 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cd410c170 0x7f2cd419cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:36.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.408+0000 7f2cd1d9b640 1 -- 172.21.15.148:0/2959190759 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2cd4102d40 msgr2=0x7f2cd41984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:36.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.408+0000 7f2cd1d9b640 1 --2- 172.21.15.148:0/2959190759 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2cd4102d40 0x7f2cd41984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:36.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.408+0000 7f2cd1d9b640 1 -- 172.21.15.148:0/2959190759 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cd419d480 con 0x7f2cd4103660 2024-09-19T07:13:36.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.408+0000 7f2cd1d9b640 1 --2- 172.21.15.148:0/2959190759 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2cd4103660 0x7f2cd4198a10 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8006010 tx=0x7f2cc8004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:36.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.408+0000 7f2cc37fe640 1 -- 172.21.15.148:0/2959190759 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc803f030 con 0x7f2cd4103660 2024-09-19T07:13:36.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.408+0000 7f2cc37fe640 1 -- 172.21.15.148:0/2959190759 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cc8004440 con 0x7f2cd4103660 2024-09-19T07:13:36.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.408+0000 7f2cc37fe640 1 -- 172.21.15.148:0/2959190759 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc8035070 con 0x7f2cd4103660 2024-09-19T07:13:36.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.408+0000 7f2cd8b89640 1 -- 172.21.15.148:0/2959190759 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cd419d710 con 0x7f2cd4103660 2024-09-19T07:13:36.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.408+0000 7f2cd8b89640 1 -- 172.21.15.148:0/2959190759 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cd419dba0 con 0x7f2cd4103660 2024-09-19T07:13:36.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.410+0000 7f2cd8b89640 1 -- 172.21.15.148:0/2959190759 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cd4103120 con 0x7f2cd4103660 2024-09-19T07:13:36.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.410+0000 7f2cc37fe640 1 -- 172.21.15.148:0/2959190759 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f2cc8042030 con 0x7f2cd4103660 2024-09-19T07:13:36.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.411+0000 7f2cc37fe640 1 --2- 172.21.15.148:0/2959190759 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f2cbc0a3430 0x7f2cbc0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:36.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.411+0000 7f2cc37fe640 1 -- 172.21.15.148:0/2959190759 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f2cc80effd0 con 0x7f2cd4103660 2024-09-19T07:13:36.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.411+0000 7f2cd259c640 1 --2- 172.21.15.148:0/2959190759 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f2cbc0a3430 0x7f2cbc0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:36.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.412+0000 7f2cd259c640 1 --2- 172.21.15.148:0/2959190759 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f2cbc0a3430 0x7f2cbc0a58f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc007ec0 tx=0x7f2ccc0075b0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:36.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.415+0000 7f2cc37fe640 1 -- 172.21.15.148:0/2959190759 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2cc80bc370 con 0x7f2cd4103660 2024-09-19T07:13:36.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.639+0000 7f2cd8b89640 1 -- 172.21.15.148:0/2959190759 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2cd41071e0 con 0x7f2cd4103660 2024-09-19T07:13:36.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.640+0000 7f2cc37fe640 1 -- 172.21.15.148:0/2959190759 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11942 (secure 0 0 0) 0x7f2cc80c0670 con 0x7f2cd4103660 2024-09-19T07:13:36.641 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:13:36.641 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":27,"btime":"2024-09-19T07:13:26:620446+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/4263868576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":4263868576},{"type":"v1","addr":"172.21.15.148:6841","nonce":4263868576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24383,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2146820965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2146820965},{"type":"v1","addr":"172.21.15.165:6835","nonce":2146820965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:09:19.543369+0000","modified":"2024-09-19T07:13:26.071712+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24457,"mds_1":24437,"mds_2":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6835/1566489108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1566489108},{"type":"v1","addr":"172.21.15.179:6835","nonce":1566489108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.165:6839/3993490234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":3993490234},{"type":"v1","addr":"172.21.15.165:6839","nonce":3993490234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24457,"qdb_cluster":[24457,24437,24436]},"id":1}]} 2024-09-19T07:13:36.641 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 27 2024-09-19T07:13:36.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.642+0000 7f2cd8b89640 1 -- 172.21.15.148:0/2959190759 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f2cbc0a3430 msgr2=0x7f2cbc0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:36.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.642+0000 7f2cd8b89640 1 --2- 172.21.15.148:0/2959190759 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f2cbc0a3430 0x7f2cbc0a58f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc007ec0 tx=0x7f2ccc0075b0 comp rx=0 tx=0).stop 2024-09-19T07:13:36.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.642+0000 7f2cd8b89640 1 -- 172.21.15.148:0/2959190759 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2cd4103660 msgr2=0x7f2cd4198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:36.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.642+0000 7f2cd8b89640 1 --2- 172.21.15.148:0/2959190759 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2cd4103660 0x7f2cd4198a10 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8006010 tx=0x7f2cc8004040 comp rx=0 tx=0).stop 2024-09-19T07:13:36.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.642+0000 7f2cd8b89640 1 -- 172.21.15.148:0/2959190759 shutdown_connections 2024-09-19T07:13:36.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.642+0000 7f2cd8b89640 1 --2- 172.21.15.148:0/2959190759 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f2cbc0a3430 0x7f2cbc0a58f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:36.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.642+0000 7f2cd8b89640 1 --2- 172.21.15.148:0/2959190759 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2cd410c170 0x7f2cd419cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:36.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.642+0000 7f2cd8b89640 1 --2- 172.21.15.148:0/2959190759 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2cd4103660 0x7f2cd4198a10 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:36.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.642+0000 7f2cd8b89640 1 --2- 172.21.15.148:0/2959190759 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2cd4102d40 0x7f2cd41984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:36.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.642+0000 7f2cd8b89640 1 -- 172.21.15.148:0/2959190759 >> 172.21.15.148:0/2959190759 conn(0x7f2cd40fc7a0 msgr2=0x7f2cd40fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:36.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.642+0000 7f2cd8b89640 1 -- 172.21.15.148:0/2959190759 shutdown_connections 2024-09-19T07:13:36.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:36.642+0000 7f2cd8b89640 1 -- 172.21.15.148:0/2959190759 wait complete. 2024-09-19T07:13:36.964 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:36 smithi148 ceph-mon[31180]: pgmap v79: 97 pgs: 97 active+clean; 44 MiB data, 558 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.9 MiB/s wr, 693 op/s 2024-09-19T07:13:36.965 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:36 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/2959190759' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:13:37.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:36 smithi179 ceph-mon[35716]: pgmap v79: 97 pgs: 97 active+clean; 44 MiB data, 558 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.9 MiB/s wr, 693 op/s 2024-09-19T07:13:37.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:36 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/2959190759' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:13:37.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:36 smithi165 ceph-mon[35326]: pgmap v79: 97 pgs: 97 active+clean; 44 MiB data, 558 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.9 MiB/s wr, 693 op/s 2024-09-19T07:13:37.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:36 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/2959190759' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:13:37.302 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T07:13:37.568 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:13:38.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.013+0000 7f582f222640 1 -- 172.21.15.148:0/3004334419 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58281027a0 msgr2=0x7f58281067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:38.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.013+0000 7f582f222640 1 --2- 172.21.15.148:0/3004334419 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58281027a0 0x7f58281067f0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f5814009900 tx=0x7f581402a410 comp rx=0 tx=0).stop 2024-09-19T07:13:38.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.013+0000 7f582f222640 1 -- 172.21.15.148:0/3004334419 shutdown_connections 2024-09-19T07:13:38.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.013+0000 7f582f222640 1 --2- 172.21.15.148:0/3004334419 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5828106f20 0x7f582810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:38.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.013+0000 7f582f222640 1 --2- 172.21.15.148:0/3004334419 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58281027a0 0x7f58281067f0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:38.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.013+0000 7f582f222640 1 --2- 172.21.15.148:0/3004334419 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5828101df0 0x7f58281021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:38.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.013+0000 7f582f222640 1 -- 172.21.15.148:0/3004334419 >> 172.21.15.148:0/3004334419 conn(0x7f58280fd8f0 msgr2=0x7f58280ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:38.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.013+0000 7f582f222640 1 -- 172.21.15.148:0/3004334419 shutdown_connections 2024-09-19T07:13:38.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.013+0000 7f582f222640 1 -- 172.21.15.148:0/3004334419 wait complete. 2024-09-19T07:13:38.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.013+0000 7f582f222640 1 Processor -- start 2024-09-19T07:13:38.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.014+0000 7f582f222640 1 -- start start 2024-09-19T07:13:38.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.014+0000 7f582f222640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5828101df0 0x7f5828198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:38.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.014+0000 7f582f222640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58281027a0 0x7f5828198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:38.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.014+0000 7f582f222640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5828106f20 0x7f582819ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:38.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.014+0000 7f582f222640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5828111f80 con 0x7f5828101df0 2024-09-19T07:13:38.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.014+0000 7f582f222640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5828111e00 con 0x7f58281027a0 2024-09-19T07:13:38.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.014+0000 7f582f222640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5828112100 con 0x7f5828106f20 2024-09-19T07:13:38.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.014+0000 7f582cfbe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5828101df0 0x7f5828198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:38.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.014+0000 7f582cfbe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5828101df0 0x7f5828198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42990/0 (socket says 172.21.15.148:42990) 2024-09-19T07:13:38.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.014+0000 7f582cfbe640 1 -- 172.21.15.148:0/250162567 learned_addr learned my addr 172.21.15.148:0/250162567 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:38.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.014+0000 7f582d7bf640 1 --2- 172.21.15.148:0/250162567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5828106f20 0x7f582819ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:38.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.014+0000 7f5827fff640 1 --2- 172.21.15.148:0/250162567 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58281027a0 0x7f5828198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:38.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.014+0000 7f582cfbe640 1 -- 172.21.15.148:0/250162567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5828106f20 msgr2=0x7f582819ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:38.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.014+0000 7f582cfbe640 1 --2- 172.21.15.148:0/250162567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5828106f20 0x7f582819ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:38.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.014+0000 7f582cfbe640 1 -- 172.21.15.148:0/250162567 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58281027a0 msgr2=0x7f5828198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:38.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.014+0000 7f582cfbe640 1 --2- 172.21.15.148:0/250162567 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58281027a0 0x7f5828198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:38.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.014+0000 7f582cfbe640 1 -- 172.21.15.148:0/250162567 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f582819d530 con 0x7f5828101df0 2024-09-19T07:13:38.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.014+0000 7f5827fff640 1 --2- 172.21.15.148:0/250162567 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58281027a0 0x7f5828198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:13:38.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.014+0000 7f582d7bf640 1 --2- 172.21.15.148:0/250162567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5828106f20 0x7f582819ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:13:38.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.014+0000 7f582cfbe640 1 --2- 172.21.15.148:0/250162567 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5828101df0 0x7f5828198580 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f581c00e9f0 tx=0x7f581c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:38.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.015+0000 7f5825ffb640 1 -- 172.21.15.148:0/250162567 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f581c00cd80 con 0x7f5828101df0 2024-09-19T07:13:38.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.015+0000 7f582f222640 1 -- 172.21.15.148:0/250162567 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f582819d820 con 0x7f5828101df0 2024-09-19T07:13:38.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.015+0000 7f5825ffb640 1 -- 172.21.15.148:0/250162567 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f581c005500 con 0x7f5828101df0 2024-09-19T07:13:38.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.015+0000 7f5825ffb640 1 -- 172.21.15.148:0/250162567 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f581c010690 con 0x7f5828101df0 2024-09-19T07:13:38.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.015+0000 7f582f222640 1 -- 172.21.15.148:0/250162567 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58281a5100 con 0x7f5828101df0 2024-09-19T07:13:38.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.018+0000 7f5825ffb640 1 -- 172.21.15.148:0/250162567 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f581c0046c0 con 0x7f5828101df0 2024-09-19T07:13:38.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.018+0000 7f58315fb740 1 Processor -- start 2024-09-19T07:13:38.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.018+0000 7f58315fb740 1 -- start start 2024-09-19T07:13:38.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.018+0000 7f58315fb740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ffbc24eb40 0x55ffbc24d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:38.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.018+0000 7f58315fb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ffbc24d5d0 0x55ffbc24da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:38.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.018+0000 7f58315fb740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ffbc258370 0x55ffbc25a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:38.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.018+0000 7f58315fb740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55ffbc1b32f0 con 0x55ffbc258370 2024-09-19T07:13:38.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.018+0000 7f58315fb740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ffbc15acf0 con 0x55ffbc24eb40 2024-09-19T07:13:38.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.018+0000 7f58315fb740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ffbc1af2b0 con 0x55ffbc24d5d0 2024-09-19T07:13:38.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.019+0000 7f582d7bf640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ffbc24eb40 0x55ffbc24d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:38.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.019+0000 7f582cfbe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ffbc24d5d0 0x55ffbc24da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:38.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.019+0000 7f582d7bf640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ffbc24eb40 0x55ffbc24d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:45234/0 (socket says 172.21.15.148:45234) 2024-09-19T07:13:38.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.019+0000 7f582d7bf640 1 -- 172.21.15.148:0/1729647143 learned_addr learned my addr 172.21.15.148:0/1729647143 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:38.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.019+0000 7f5827fff640 1 --2- 172.21.15.148:0/1729647143 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ffbc258370 0x55ffbc25a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:38.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.019+0000 7f582d7bf640 1 -- 172.21.15.148:0/1729647143 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ffbc24d5d0 msgr2=0x55ffbc24da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:38.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.019+0000 7f582d7bf640 1 --2- 172.21.15.148:0/1729647143 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ffbc24d5d0 0x55ffbc24da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:38.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.019+0000 7f582d7bf640 1 -- 172.21.15.148:0/1729647143 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ffbc258370 msgr2=0x55ffbc25a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:38.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.019+0000 7f5825ffb640 1 --2- 172.21.15.148:0/250162567 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f58180a3430 0x7f58180a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:38.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.019+0000 7f582cfbe640 1 --2- 172.21.15.148:0/250162567 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f58180a3430 0x7f58180a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:38.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.019+0000 7f582d7bf640 1 --2- 172.21.15.148:0/1729647143 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ffbc258370 0x55ffbc25a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:38.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.019+0000 7f5825ffb640 1 -- 172.21.15.148:0/250162567 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f581c0d0140 con 0x7f5828101df0 2024-09-19T07:13:38.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.019+0000 7f582d7bf640 1 -- 172.21.15.148:0/1729647143 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffbc13f3a0 con 0x55ffbc24eb40 2024-09-19T07:13:38.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.019+0000 7f5827fff640 1 --2- 172.21.15.148:0/1729647143 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ffbc258370 0x55ffbc25a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:13:38.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.020+0000 7f582d7bf640 1 --2- 172.21.15.148:0/1729647143 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ffbc24eb40 0x55ffbc24d090 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5820011790 tx=0x7f5820011c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=587ec21271f4f238 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:38.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.020+0000 7f582cfbe640 1 --2- 172.21.15.148:0/250162567 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f58180a3430 0x7f58180a58f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x55ffbc24aac0 tx=0x7f581c0d3c30 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:38.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.020+0000 7f5812ffd640 1 -- 172.21.15.148:0/1729647143 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5820003c30 con 0x55ffbc24eb40 2024-09-19T07:13:38.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.020+0000 7f5812ffd640 1 -- 172.21.15.148:0/1729647143 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f582000fe80 con 0x55ffbc24eb40 2024-09-19T07:13:38.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.020+0000 7f5812ffd640 1 -- 172.21.15.148:0/1729647143 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58200193e0 con 0x55ffbc24eb40 2024-09-19T07:13:38.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.020+0000 7f58315fb740 1 -- 172.21.15.148:0/1729647143 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ffbc24eb40 msgr2=0x55ffbc24d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:38.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.020+0000 7f58315fb740 1 --2- 172.21.15.148:0/1729647143 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ffbc24eb40 0x55ffbc24d090 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5820011790 tx=0x7f5820011c50 comp rx=0 tx=0).stop 2024-09-19T07:13:38.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.021+0000 7f58315fb740 1 -- 172.21.15.148:0/1729647143 shutdown_connections 2024-09-19T07:13:38.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.021+0000 7f58315fb740 1 --2- 172.21.15.148:0/1729647143 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ffbc258370 0x55ffbc25a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:38.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.021+0000 7f58315fb740 1 --2- 172.21.15.148:0/1729647143 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ffbc24d5d0 0x55ffbc24da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:38.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.021+0000 7f58315fb740 1 --2- 172.21.15.148:0/1729647143 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ffbc24eb40 0x55ffbc24d090 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:38.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.021+0000 7f58315fb740 1 -- 172.21.15.148:0/1729647143 >> 172.21.15.148:0/1729647143 conn(0x55ffbc216310 msgr2=0x55ffbc249c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:38.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.021+0000 7f58315fb740 1 -- 172.21.15.148:0/1729647143 shutdown_connections 2024-09-19T07:13:38.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.021+0000 7f58315fb740 1 -- 172.21.15.148:0/1729647143 wait complete. 2024-09-19T07:13:38.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.021+0000 7f58315fb740 1 -- start start 2024-09-19T07:13:38.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.021+0000 7f58315fb740 1 Processor -- start 2024-09-19T07:13:38.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.021+0000 7f58315fb740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ffbc24d5d0 0x55ffbc257ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:38.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.021+0000 7f58315fb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ffbc24eb40 0x55ffbc254f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:38.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.021+0000 7f58315fb740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ffbc258370 0x55ffbc2554f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:38.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.021+0000 7f58315fb740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55ffbc25f480 con 0x55ffbc258370 2024-09-19T07:13:38.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.022+0000 7f58315fb740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ffbc16e060 con 0x55ffbc24d5d0 2024-09-19T07:13:38.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.022+0000 7f58315fb740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ffbc25f600 con 0x55ffbc24eb40 2024-09-19T07:13:38.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.022+0000 7f58315fb740 10 client.0 _ll_register_callbacks cb 0x55ffbbec18c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:13:38.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.022+0000 7f582d7bf640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ffbc258370 0x55ffbc2554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:38.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.022+0000 7f5827fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ffbc24eb40 0x55ffbc254f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:38.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.022+0000 7f582d7bf640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ffbc258370 0x55ffbc2554f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43010/0 (socket says 172.21.15.148:43010) 2024-09-19T07:13:38.027 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.022+0000 7f582d7bf640 1 -- 172.21.15.148:0/2607432753 learned_addr learned my addr 172.21.15.148:0/2607432753 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:38.027 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.022+0000 7f582d7bf640 1 --2- 172.21.15.148:0/2607432753 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ffbc24d5d0 0x55ffbc257ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:38.029 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.022+0000 7f5827fff640 1 -- 172.21.15.148:0/2607432753 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ffbc24d5d0 msgr2=0x55ffbc257ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:38.029 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.022+0000 7f5827fff640 1 --2- 172.21.15.148:0/2607432753 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ffbc24d5d0 0x55ffbc257ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:38.029 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.022+0000 7f5827fff640 1 -- 172.21.15.148:0/2607432753 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ffbc258370 msgr2=0x55ffbc2554f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:38.029 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.022+0000 7f5827fff640 1 --2- 172.21.15.148:0/2607432753 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ffbc258370 0x55ffbc2554f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:38.029 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.022+0000 7f5827fff640 1 -- 172.21.15.148:0/2607432753 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffbbf243c0 con 0x55ffbc24eb40 2024-09-19T07:13:38.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.022+0000 7f582d7bf640 1 --2- 172.21.15.148:0/2607432753 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ffbc258370 0x55ffbc2554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:13:38.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.022+0000 7f5827fff640 1 --2- 172.21.15.148:0/2607432753 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ffbc24eb40 0x55ffbc254f90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5814009230 tx=0x7f5814031860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=417e71d3a2cd6b6a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:38.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.022+0000 7f5807fff640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-19T07:13:38.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.022+0000 7f5807fff640 1 -- 172.21.15.148:0/2607432753 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f581403f070 con 0x55ffbc24eb40 2024-09-19T07:13:38.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.022+0000 7f58315fb740 1 -- 172.21.15.148:0/2607432753 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ffbc1c0860 con 0x55ffbc24eb40 2024-09-19T07:13:38.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.022+0000 7f5807fff640 1 -- 172.21.15.148:0/2607432753 <== mon.1 v2:172.21.15.179:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f5814004450 con 0x55ffbc24eb40 2024-09-19T07:13:38.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.023+0000 7f5807fff640 1 -- 172.21.15.148:0/2607432753 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5814035070 con 0x55ffbc24eb40 2024-09-19T07:13:38.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.023+0000 7f58315fb740 10 client.25507 fetch_fsmap learned FSMap version 27 2024-09-19T07:13:38.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.023+0000 7f58315fb740 1 -- 172.21.15.148:0/2607432753 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ffbc26ae50 con 0x55ffbc24eb40 2024-09-19T07:13:38.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.023+0000 7f5807fff640 1 -- 172.21.15.148:0/2607432753 <== mon.1 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55ffbc1c0860 con 0x55ffbc24eb40 2024-09-19T07:13:38.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.023+0000 7f5807fff640 1 -- 172.21.15.148:0/2607432753 <== mon.1 v2:172.21.15.179:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f5814004a30 con 0x55ffbc24eb40 2024-09-19T07:13:38.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.023+0000 7f58315fb740 10 client.25507 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T07:13:38.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.023+0000 7f58315fb740 10 client.25507 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T07:13:38.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.023+0000 7f58315fb740 20 client.25507 populate_metadata read hostname 'smithi148' 2024-09-19T07:13:38.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.023+0000 7f58315fb740 1 --2- 172.21.15.148:0/2607432753 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x55ffbc26c260 0x55ffbc26e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:38.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.023+0000 7f58315fb740 4 client.25507 mds_command: new command op to 24436 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:13:38.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.023+0000 7f58315fb740 1 -- 172.21.15.148:0/2607432753 --> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ffbc1bad70 con 0x55ffbc26c260 2024-09-19T07:13:38.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.023+0000 7f582d7bf640 1 --2- 172.21.15.148:0/2607432753 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x55ffbc26c260 0x55ffbc26e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:38.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.024+0000 7f5807fff640 10 client.25507 ms_handle_connect on v2:172.21.15.179:6836/3827671241 2024-09-19T07:13:38.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.024+0000 7f582d7bf640 1 --2- 172.21.15.148:0/2607432753 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x55ffbc26c260 0x55ffbc26e650 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ab28dc07626c7c5 server_cookie=fd1ebd8ae5e4c0f4 in_seq=0 out_seq=0 2024-09-19T07:13:38.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.026+0000 7f5807fff640 1 -- 172.21.15.148:0/2607432753 <== mds.2 v2:172.21.15.179:6836/3827671241 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ffbc1bad70 con 0x55ffbc26c260 2024-09-19T07:13:38.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.026+0000 7f5807fff640 10 client.25507 handle_command_reply: tid=0 2024-09-19T07:13:38.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.026+0000 7f58315fb740 1 client.25507 shutdown 2024-09-19T07:13:38.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.026+0000 7f58315fb740 1 -- 172.21.15.148:0/2607432753 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ffbc24eb40 msgr2=0x55ffbc254f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:38.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.026+0000 7f58315fb740 1 --2- 172.21.15.148:0/2607432753 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ffbc24eb40 0x55ffbc254f90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5814009230 tx=0x7f5814031860 comp rx=0 tx=0).stop 2024-09-19T07:13:38.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.026+0000 7f58315fb740 1 -- 172.21.15.148:0/2607432753 shutdown_connections 2024-09-19T07:13:38.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.026+0000 7f58315fb740 1 --2- 172.21.15.148:0/2607432753 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x55ffbc26c260 0x55ffbc26e650 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:38.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.026+0000 7f58315fb740 1 --2- 172.21.15.148:0/2607432753 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ffbc258370 0x55ffbc2554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:38.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.026+0000 7f5807fff640 0 client.25507 ms_handle_reset on v2:172.21.15.179:6836/3827671241 2024-09-19T07:13:38.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.026+0000 7f58315fb740 1 --2- 172.21.15.148:0/2607432753 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ffbc24eb40 0x55ffbc254f90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:38.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.026+0000 7f58315fb740 1 --2- 172.21.15.148:0/2607432753 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ffbc24d5d0 0x55ffbc257ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:38.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.026+0000 7f58315fb740 1 -- 172.21.15.148:0/2607432753 >> 172.21.15.148:0/2607432753 conn(0x55ffbc216310 msgr2=0x55ffbc24f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:38.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.026+0000 7f58315fb740 1 -- 172.21.15.148:0/2607432753 shutdown_connections 2024-09-19T07:13:38.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.026+0000 7f58315fb740 1 -- 172.21.15.148:0/2607432753 wait complete. 2024-09-19T07:13:38.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.026+0000 7f58315fb740 20 client.25507 trim_cache size 0 max 16384 2024-09-19T07:13:38.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.040+0000 7f58315fb740 1 Processor -- start 2024-09-19T07:13:38.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.040+0000 7f58315fb740 1 -- start start 2024-09-19T07:13:38.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.041+0000 7f58315fb740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ffbc24d5d0 0x55ffbc268720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:38.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.041+0000 7f58315fb740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ffbc24eb40 0x55ffbc250120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:38.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.041+0000 7f58315fb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ffbc258370 0x55ffbc250660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:38.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.041+0000 7f58315fb740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f58281adf30 con 0x55ffbc24d5d0 2024-09-19T07:13:38.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.041+0000 7f58315fb740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f58281ab800 con 0x55ffbc24eb40 2024-09-19T07:13:38.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.041+0000 7f58315fb740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f58281a9630 con 0x55ffbc258370 2024-09-19T07:13:38.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.041+0000 7f582d7bf640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ffbc24d5d0 0x55ffbc268720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:38.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.041+0000 7f582d7bf640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ffbc24d5d0 0x55ffbc268720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43016/0 (socket says 172.21.15.148:43016) 2024-09-19T07:13:38.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.041+0000 7f582d7bf640 1 -- 172.21.15.148:0/1882042374 learned_addr learned my addr 172.21.15.148:0/1882042374 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:38.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.041+0000 7f582d7bf640 1 --2- 172.21.15.148:0/1882042374 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ffbc258370 0x55ffbc250660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:38.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.041+0000 7f5827fff640 1 --2- 172.21.15.148:0/1882042374 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ffbc24eb40 0x55ffbc250120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:38.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.041+0000 7f582d7bf640 1 -- 172.21.15.148:0/1882042374 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ffbc258370 msgr2=0x55ffbc250660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:38.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.041+0000 7f582d7bf640 1 --2- 172.21.15.148:0/1882042374 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ffbc258370 0x55ffbc250660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:38.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.041+0000 7f582d7bf640 1 -- 172.21.15.148:0/1882042374 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ffbc24eb40 msgr2=0x55ffbc250120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:38.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.041+0000 7f582d7bf640 1 --2- 172.21.15.148:0/1882042374 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ffbc24eb40 0x55ffbc250120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:38.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.041+0000 7f582d7bf640 1 -- 172.21.15.148:0/1882042374 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffbc250ba0 con 0x55ffbc24d5d0 2024-09-19T07:13:38.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.041+0000 7f5827fff640 1 --2- 172.21.15.148:0/1882042374 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ffbc24eb40 0x55ffbc250120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:13:38.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.041+0000 7f582d7bf640 1 --2- 172.21.15.148:0/1882042374 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ffbc24d5d0 0x55ffbc268720 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f58200045a0 tx=0x7f5820009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f0c89fe443f7d58 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:38.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.041+0000 7f58127fc640 1 -- 172.21.15.148:0/1882042374 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f582002e070 con 0x55ffbc24d5d0 2024-09-19T07:13:38.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.041+0000 7f58127fc640 1 -- 172.21.15.148:0/1882042374 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58200041d0 con 0x55ffbc24d5d0 2024-09-19T07:13:38.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.041+0000 7f58127fc640 1 -- 172.21.15.148:0/1882042374 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f582001abd0 con 0x55ffbc24d5d0 2024-09-19T07:13:38.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.042+0000 7f58315fb740 1 -- 172.21.15.148:0/1882042374 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ffbc24d5d0 msgr2=0x55ffbc268720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:38.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.042+0000 7f58315fb740 1 --2- 172.21.15.148:0/1882042374 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ffbc24d5d0 0x55ffbc268720 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f58200045a0 tx=0x7f5820009500 comp rx=0 tx=0).stop 2024-09-19T07:13:38.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.042+0000 7f58315fb740 1 -- 172.21.15.148:0/1882042374 shutdown_connections 2024-09-19T07:13:38.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.042+0000 7f58315fb740 1 --2- 172.21.15.148:0/1882042374 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ffbc258370 0x55ffbc250660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:38.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.042+0000 7f58315fb740 1 --2- 172.21.15.148:0/1882042374 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ffbc24eb40 0x55ffbc250120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:38.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.042+0000 7f58315fb740 1 --2- 172.21.15.148:0/1882042374 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ffbc24d5d0 0x55ffbc268720 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:38.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.042+0000 7f58315fb740 1 -- 172.21.15.148:0/1882042374 >> 172.21.15.148:0/1882042374 conn(0x55ffbc216310 msgr2=0x55ffbc254080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:38.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.042+0000 7f58315fb740 1 -- 172.21.15.148:0/1882042374 shutdown_connections 2024-09-19T07:13:38.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.042+0000 7f58315fb740 1 -- 172.21.15.148:0/1882042374 wait complete. 2024-09-19T07:13:38.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.043+0000 7f58315fb740 1 -- start start 2024-09-19T07:13:38.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.043+0000 7f58315fb740 1 Processor -- start 2024-09-19T07:13:38.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.043+0000 7f58315fb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ffbc24d5d0 0x55ffbc264a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:38.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.043+0000 7f58315fb740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ffbc24eb40 0x55ffbc264fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:38.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.043+0000 7f58315fb740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ffbc258370 0x55ffbc2517c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:38.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.043+0000 7f58315fb740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f58281a9cc0 con 0x55ffbc24eb40 2024-09-19T07:13:38.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.043+0000 7f58315fb740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f58281ab130 con 0x55ffbc258370 2024-09-19T07:13:38.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.043+0000 7f58315fb740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f58281aa390 con 0x55ffbc24d5d0 2024-09-19T07:13:38.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.043+0000 7f58315fb740 10 client.0 _ll_register_callbacks cb 0x7f58200093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:13:38.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.043+0000 7f5827fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ffbc24eb40 0x55ffbc264fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:38.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.043+0000 7f582d7bf640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ffbc24d5d0 0x55ffbc264a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:38.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.043+0000 7f5827fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ffbc24eb40 0x55ffbc264fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43028/0 (socket says 172.21.15.148:43028) 2024-09-19T07:13:38.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.043+0000 7f5827fff640 1 -- 172.21.15.148:0/3892315649 learned_addr learned my addr 172.21.15.148:0/3892315649 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:38.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.043+0000 7f582d7bf640 1 --2- 172.21.15.148:0/3892315649 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ffbc258370 0x55ffbc2517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:38.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.044+0000 7f5827fff640 1 -- 172.21.15.148:0/3892315649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ffbc24d5d0 msgr2=0x55ffbc264a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:38.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.044+0000 7f5827fff640 1 --2- 172.21.15.148:0/3892315649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ffbc24d5d0 0x55ffbc264a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:38.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.044+0000 7f5827fff640 1 -- 172.21.15.148:0/3892315649 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ffbc258370 msgr2=0x55ffbc2517c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:38.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.044+0000 7f5827fff640 1 --2- 172.21.15.148:0/3892315649 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ffbc258370 0x55ffbc2517c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:38.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.044+0000 7f5827fff640 1 -- 172.21.15.148:0/3892315649 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffbc251fa0 con 0x55ffbc24eb40 2024-09-19T07:13:38.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.044+0000 7f5827fff640 1 --2- 172.21.15.148:0/3892315649 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ffbc24eb40 0x55ffbc264fb0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f5814006010 tx=0x7f5814003880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b10e89099e5dabe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:38.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.044+0000 7f5807fff640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:13:38.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.044+0000 7f5807fff640 1 -- 172.21.15.148:0/3892315649 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f581403f050 con 0x55ffbc24eb40 2024-09-19T07:13:38.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.044+0000 7f5807fff640 1 -- 172.21.15.148:0/3892315649 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f5814003df0 con 0x55ffbc24eb40 2024-09-19T07:13:38.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.044+0000 7f58315fb740 1 -- 172.21.15.148:0/3892315649 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58200041d0 con 0x55ffbc24eb40 2024-09-19T07:13:38.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.044+0000 7f5807fff640 1 -- 172.21.15.148:0/3892315649 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5814005d50 con 0x55ffbc24eb40 2024-09-19T07:13:38.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.044+0000 7f58315fb740 10 client.16098 fetch_fsmap learned FSMap version 27 2024-09-19T07:13:38.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.044+0000 7f58315fb740 1 -- 172.21.15.148:0/3892315649 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ffbc2d6900 con 0x55ffbc24eb40 2024-09-19T07:13:38.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.044+0000 7f5807fff640 1 -- 172.21.15.148:0/3892315649 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58200041d0 con 0x55ffbc24eb40 2024-09-19T07:13:38.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.045+0000 7f5807fff640 1 -- 172.21.15.148:0/3892315649 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f5814005300 con 0x55ffbc24eb40 2024-09-19T07:13:38.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.045+0000 7f58315fb740 10 client.16098 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T07:13:38.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.045+0000 7f58315fb740 10 client.16098 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T07:13:38.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.045+0000 7f58315fb740 20 client.16098 populate_metadata read hostname 'smithi148' 2024-09-19T07:13:38.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.045+0000 7f58315fb740 1 --2- 172.21.15.148:0/3892315649 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x55ffbc26c260 0x55ffbc2d9060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:38.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.045+0000 7f58315fb740 4 client.16098 mds_command: new command op to 24436 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:13:38.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.045+0000 7f58315fb740 1 -- 172.21.15.148:0/3892315649 --> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ffbc137170 con 0x55ffbc26c260 2024-09-19T07:13:38.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.045+0000 7f582d7bf640 1 --2- 172.21.15.148:0/3892315649 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x55ffbc26c260 0x55ffbc2d9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:38.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.045+0000 7f582d7bf640 1 --2- 172.21.15.148:0/3892315649 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x55ffbc26c260 0x55ffbc2d9060 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8ab0afdb0112401c server_cookie=a7f98b66c07a789e in_seq=0 out_seq=0 2024-09-19T07:13:38.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.045+0000 7f5807fff640 10 client.16098 ms_handle_connect on v2:172.21.15.179:6836/3827671241 2024-09-19T07:13:38.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.047+0000 7f5807fff640 1 -- 172.21.15.148:0/3892315649 <== mds.2 v2:172.21.15.179:6836/3827671241 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ffbc137170 con 0x55ffbc26c260 2024-09-19T07:13:38.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.047+0000 7f5807fff640 10 client.16098 handle_command_reply: tid=0 2024-09-19T07:13:38.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.047+0000 7f58315fb740 1 client.16098 shutdown 2024-09-19T07:13:38.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.047+0000 7f58315fb740 1 -- 172.21.15.148:0/3892315649 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ffbc24eb40 msgr2=0x55ffbc264fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:38.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.047+0000 7f58315fb740 1 --2- 172.21.15.148:0/3892315649 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ffbc24eb40 0x55ffbc264fb0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f5814006010 tx=0x7f5814003880 comp rx=0 tx=0).stop 2024-09-19T07:13:38.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.047+0000 7f58315fb740 1 -- 172.21.15.148:0/3892315649 shutdown_connections 2024-09-19T07:13:38.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.047+0000 7f58315fb740 1 --2- 172.21.15.148:0/3892315649 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x55ffbc26c260 0x55ffbc2d9060 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:38.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.047+0000 7f58315fb740 1 --2- 172.21.15.148:0/3892315649 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ffbc258370 0x55ffbc2517c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:38.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.047+0000 7f58315fb740 1 --2- 172.21.15.148:0/3892315649 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ffbc24eb40 0x55ffbc264fb0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:38.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.047+0000 7f58315fb740 1 --2- 172.21.15.148:0/3892315649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ffbc24d5d0 0x55ffbc264a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:38.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.047+0000 7f5807fff640 0 client.16098 ms_handle_reset on v2:172.21.15.179:6836/3827671241 2024-09-19T07:13:38.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.047+0000 7f58315fb740 1 -- 172.21.15.148:0/3892315649 >> 172.21.15.148:0/3892315649 conn(0x55ffbc216310 msgr2=0x55ffbc2567f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:38.054 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.047+0000 7f58315fb740 1 -- 172.21.15.148:0/3892315649 shutdown_connections 2024-09-19T07:13:38.054 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.047+0000 7f58315fb740 1 -- 172.21.15.148:0/3892315649 wait complete. 2024-09-19T07:13:38.054 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.047+0000 7f58315fb740 20 client.16098 trim_cache size 0 max 16384 2024-09-19T07:13:38.054 INFO:teuthology.orchestra.run.smithi148.stdout:[] 2024-09-19T07:13:38.055 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.048+0000 7f582f222640 1 -- 172.21.15.148:0/250162567 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f58180a3430 msgr2=0x7f58180a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:38.055 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.048+0000 7f582f222640 1 --2- 172.21.15.148:0/250162567 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f58180a3430 0x7f58180a58f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x55ffbc24aac0 tx=0x7f581c0d3c30 comp rx=0 tx=0).stop 2024-09-19T07:13:38.055 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.048+0000 7f582f222640 1 -- 172.21.15.148:0/250162567 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5828101df0 msgr2=0x7f5828198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:38.055 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.048+0000 7f582f222640 1 --2- 172.21.15.148:0/250162567 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5828101df0 0x7f5828198580 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f581c00e9f0 tx=0x7f581c00edf0 comp rx=0 tx=0).stop 2024-09-19T07:13:38.055 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.048+0000 7f582f222640 1 -- 172.21.15.148:0/250162567 shutdown_connections 2024-09-19T07:13:38.055 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.048+0000 7f582f222640 1 --2- 172.21.15.148:0/250162567 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f58180a3430 0x7f58180a58f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:38.055 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.048+0000 7f582f222640 1 --2- 172.21.15.148:0/250162567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5828106f20 0x7f582819ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:38.055 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.048+0000 7f582f222640 1 --2- 172.21.15.148:0/250162567 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58281027a0 0x7f5828198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:38.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.048+0000 7f582f222640 1 --2- 172.21.15.148:0/250162567 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5828101df0 0x7f5828198580 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:38.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.048+0000 7f582f222640 1 -- 172.21.15.148:0/250162567 >> 172.21.15.148:0/250162567 conn(0x7f58280fd8f0 msgr2=0x7f58280fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:38.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.048+0000 7f582f222640 1 -- 172.21.15.148:0/250162567 shutdown_connections 2024-09-19T07:13:38.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:38.048+0000 7f582f222640 1 -- 172.21.15.148:0/250162567 wait complete. 2024-09-19T07:13:38.990 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:38 smithi148 ceph-mon[31180]: pgmap v80: 97 pgs: 97 active+clean; 44 MiB data, 558 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.8 MiB/s wr, 635 op/s 2024-09-19T07:13:39.019 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T07:13:39.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:38 smithi179 ceph-mon[35716]: pgmap v80: 97 pgs: 97 active+clean; 44 MiB data, 558 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.8 MiB/s wr, 635 op/s 2024-09-19T07:13:39.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:38 smithi165 ceph-mon[35326]: pgmap v80: 97 pgs: 97 active+clean; 44 MiB data, 558 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.8 MiB/s wr, 635 op/s 2024-09-19T07:13:39.468 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:13:40.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.055+0000 7ff6e6853640 1 -- 172.21.15.148:0/4014592327 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6e0102790 msgr2=0x7ff6e01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:40.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.055+0000 7ff6e6853640 1 --2- 172.21.15.148:0/4014592327 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6e0102790 0x7ff6e01067e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4009900 tx=0x7ff6d402a410 comp rx=0 tx=0).stop 2024-09-19T07:13:40.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.056+0000 7ff6e6853640 1 -- 172.21.15.148:0/4014592327 shutdown_connections 2024-09-19T07:13:40.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.056+0000 7ff6e6853640 1 --2- 172.21.15.148:0/4014592327 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6e0106f10 0x7ff6e010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:40.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.056+0000 7ff6e6853640 1 --2- 172.21.15.148:0/4014592327 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6e0102790 0x7ff6e01067e0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:40.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.056+0000 7ff6e6853640 1 --2- 172.21.15.148:0/4014592327 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6e0101de0 0x7ff6e01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:40.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.056+0000 7ff6e6853640 1 -- 172.21.15.148:0/4014592327 >> 172.21.15.148:0/4014592327 conn(0x7ff6e00fd8e0 msgr2=0x7ff6e00ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:40.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.056+0000 7ff6e6853640 1 -- 172.21.15.148:0/4014592327 shutdown_connections 2024-09-19T07:13:40.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.056+0000 7ff6e6853640 1 -- 172.21.15.148:0/4014592327 wait complete. 2024-09-19T07:13:40.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.056+0000 7ff6e6853640 1 Processor -- start 2024-09-19T07:13:40.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.056+0000 7ff6e6853640 1 -- start start 2024-09-19T07:13:40.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.057+0000 7ff6e6853640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6e0101de0 0x7ff6e019a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:40.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.057+0000 7ff6e6853640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6e0102790 0x7ff6e019abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:40.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.057+0000 7ff6e6853640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6e0106f10 0x7ff6e019ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:40.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.057+0000 7ff6e6853640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e0111f30 con 0x7ff6e0102790 2024-09-19T07:13:40.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.057+0000 7ff6e6853640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e0111db0 con 0x7ff6e0101de0 2024-09-19T07:13:40.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.057+0000 7ff6e6853640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e01120b0 con 0x7ff6e0106f10 2024-09-19T07:13:40.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.057+0000 7ff6e4df0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6e0106f10 0x7ff6e019ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:40.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.057+0000 7ff6e4df0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6e0106f10 0x7ff6e019ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:41290/0 (socket says 172.21.15.148:41290) 2024-09-19T07:13:40.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.057+0000 7ff6e4df0640 1 -- 172.21.15.148:0/3082296028 learned_addr learned my addr 172.21.15.148:0/3082296028 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:40.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.057+0000 7ff6df7fe640 1 --2- 172.21.15.148:0/3082296028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6e0102790 0x7ff6e019abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:40.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.058+0000 7ff6dffff640 1 --2- 172.21.15.148:0/3082296028 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6e0101de0 0x7ff6e019a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:40.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.058+0000 7ff6e4df0640 1 -- 172.21.15.148:0/3082296028 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6e0101de0 msgr2=0x7ff6e019a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:40.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.058+0000 7ff6e4df0640 1 --2- 172.21.15.148:0/3082296028 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6e0101de0 0x7ff6e019a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:40.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.058+0000 7ff6e4df0640 1 -- 172.21.15.148:0/3082296028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6e0102790 msgr2=0x7ff6e019abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:40.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.058+0000 7ff6e4df0640 1 --2- 172.21.15.148:0/3082296028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6e0102790 0x7ff6e019abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:40.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.058+0000 7ff6e4df0640 1 -- 172.21.15.148:0/3082296028 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6e019f620 con 0x7ff6e0106f10 2024-09-19T07:13:40.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.058+0000 7ff6e4df0640 1 --2- 172.21.15.148:0/3082296028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6e0106f10 0x7ff6e019ef40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff6d800eb10 tx=0x7ff6d800c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:40.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.058+0000 7ff6dffff640 1 --2- 172.21.15.148:0/3082296028 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6e0101de0 0x7ff6e019a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:13:40.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.058+0000 7ff6dd7fa640 1 -- 172.21.15.148:0/3082296028 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d8004b20 con 0x7ff6e0106f10 2024-09-19T07:13:40.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.058+0000 7ff6dd7fa640 1 -- 172.21.15.148:0/3082296028 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6d8004cc0 con 0x7ff6e0106f10 2024-09-19T07:13:40.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.058+0000 7ff6dd7fa640 1 -- 172.21.15.148:0/3082296028 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d80107b0 con 0x7ff6e0106f10 2024-09-19T07:13:40.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.059+0000 7ff6e6853640 1 -- 172.21.15.148:0/3082296028 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6e019f910 con 0x7ff6e0106f10 2024-09-19T07:13:40.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.059+0000 7ff6e6853640 1 -- 172.21.15.148:0/3082296028 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6e019fd70 con 0x7ff6e0106f10 2024-09-19T07:13:40.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.061+0000 7ff6dd7fa640 1 -- 172.21.15.148:0/3082296028 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7ff6d8005000 con 0x7ff6e0106f10 2024-09-19T07:13:40.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.062+0000 7ff6e8c2c740 1 Processor -- start 2024-09-19T07:13:40.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.062+0000 7ff6e8c2c740 1 -- start start 2024-09-19T07:13:40.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.062+0000 7ff6e8c2c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f66e7dab40 0x55f66e7d9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:40.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.062+0000 7ff6e8c2c740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f66e7d95d0 0x55f66e7d9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:40.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.062+0000 7ff6e8c2c740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f66e7e4370 0x55f66e7e6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:40.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.062+0000 7ff6e8c2c740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55f66e73f2f0 con 0x55f66e7d95d0 2024-09-19T07:13:40.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.062+0000 7ff6e8c2c740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55f66e6e6cf0 con 0x55f66e7e4370 2024-09-19T07:13:40.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.062+0000 7ff6e8c2c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f66e73b2b0 con 0x55f66e7dab40 2024-09-19T07:13:40.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.062+0000 7ff6df7fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f66e7e4370 0x55f66e7e6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:40.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.062+0000 7ff6df7fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f66e7e4370 0x55f66e7e6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:45310/0 (socket says 172.21.15.148:45310) 2024-09-19T07:13:40.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.062+0000 7ff6df7fe640 1 -- 172.21.15.148:0/1098835396 learned_addr learned my addr 172.21.15.148:0/1098835396 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:40.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.062+0000 7ff6dffff640 1 --2- 172.21.15.148:0/1098835396 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f66e7d95d0 0x55f66e7d9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:40.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.062+0000 7ff6df7fe640 1 --2- 172.21.15.148:0/1098835396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f66e7dab40 0x55f66e7d9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:40.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.063+0000 7ff6df7fe640 1 -- 172.21.15.148:0/1098835396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f66e7dab40 msgr2=0x55f66e7d9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:40.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.063+0000 7ff6df7fe640 1 --2- 172.21.15.148:0/1098835396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f66e7dab40 0x55f66e7d9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:40.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.063+0000 7ff6df7fe640 1 -- 172.21.15.148:0/1098835396 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f66e7d95d0 msgr2=0x55f66e7d9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:40.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.063+0000 7ff6df7fe640 1 --2- 172.21.15.148:0/1098835396 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f66e7d95d0 0x55f66e7d9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:40.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.063+0000 7ff6dd7fa640 1 --2- 172.21.15.148:0/3082296028 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7ff6c80a3500 0x7ff6c80a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:40.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.063+0000 7ff6dffff640 1 --2- 172.21.15.148:0/3082296028 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7ff6c80a3500 0x7ff6c80a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:40.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.063+0000 7ff6dd7fa640 1 -- 172.21.15.148:0/3082296028 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7ff6d80d0220 con 0x7ff6e0106f10 2024-09-19T07:13:40.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.063+0000 7ff6df7fe640 1 -- 172.21.15.148:0/1098835396 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f66e6cb3a0 con 0x55f66e7e4370 2024-09-19T07:13:40.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.063+0000 7ff6df7fe640 1 --2- 172.21.15.148:0/1098835396 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f66e7e4370 0x55f66e7e6760 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4031550 tx=0x7ff6d40314e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d09809fc99127ef1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:40.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.063+0000 7ff6c67fc640 1 -- 172.21.15.148:0/1098835396 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4035070 con 0x55f66e7e4370 2024-09-19T07:13:40.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.063+0000 7ff6c67fc640 1 -- 172.21.15.148:0/1098835396 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6d4005020 con 0x55f66e7e4370 2024-09-19T07:13:40.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.064+0000 7ff6c67fc640 1 -- 172.21.15.148:0/1098835396 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4004a00 con 0x55f66e7e4370 2024-09-19T07:13:40.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.064+0000 7ff6e8c2c740 1 -- 172.21.15.148:0/1098835396 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f66e7e4370 msgr2=0x55f66e7e6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:40.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.064+0000 7ff6e8c2c740 1 --2- 172.21.15.148:0/1098835396 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f66e7e4370 0x55f66e7e6760 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4031550 tx=0x7ff6d40314e0 comp rx=0 tx=0).stop 2024-09-19T07:13:40.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.064+0000 7ff6dffff640 1 --2- 172.21.15.148:0/3082296028 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7ff6c80a3500 0x7ff6c80a59c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0005fd0 tx=0x7ff6d00094a0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:40.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.064+0000 7ff6e8c2c740 1 -- 172.21.15.148:0/1098835396 shutdown_connections 2024-09-19T07:13:40.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.064+0000 7ff6e8c2c740 1 --2- 172.21.15.148:0/1098835396 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f66e7e4370 0x55f66e7e6760 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:40.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.064+0000 7ff6e8c2c740 1 --2- 172.21.15.148:0/1098835396 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f66e7d95d0 0x55f66e7d9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:40.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.064+0000 7ff6e8c2c740 1 --2- 172.21.15.148:0/1098835396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f66e7dab40 0x55f66e7d9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:40.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.064+0000 7ff6e8c2c740 1 -- 172.21.15.148:0/1098835396 >> 172.21.15.148:0/1098835396 conn(0x55f66e7a2310 msgr2=0x55f66e7d5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:40.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.064+0000 7ff6e8c2c740 1 -- 172.21.15.148:0/1098835396 shutdown_connections 2024-09-19T07:13:40.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.064+0000 7ff6e8c2c740 1 -- 172.21.15.148:0/1098835396 wait complete. 2024-09-19T07:13:40.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.065+0000 7ff6e8c2c740 1 -- start start 2024-09-19T07:13:40.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.065+0000 7ff6e8c2c740 1 Processor -- start 2024-09-19T07:13:40.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.065+0000 7ff6e8c2c740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f66e7d95d0 0x55f66e7e3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:40.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.065+0000 7ff6e8c2c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f66e7dab40 0x55f66e7e1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:40.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.065+0000 7ff6e8c2c740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f66e7e4370 0x55f66e7e15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:40.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.066+0000 7ff6e8c2c740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55f66e7e7010 con 0x55f66e7e4370 2024-09-19T07:13:40.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.066+0000 7ff6e8c2c740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55f66e6fa060 con 0x55f66e7d95d0 2024-09-19T07:13:40.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.066+0000 7ff6e8c2c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f66e7e7190 con 0x55f66e7dab40 2024-09-19T07:13:40.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.066+0000 7ff6e4df0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f66e7e4370 0x55f66e7e15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:40.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.066+0000 7ff6dffff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f66e7d95d0 0x55f66e7e3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:40.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.066+0000 7ff6dffff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f66e7d95d0 0x55f66e7e3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:45320/0 (socket says 172.21.15.148:45320) 2024-09-19T07:13:40.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.066+0000 7ff6dffff640 1 -- 172.21.15.148:0/1981432235 learned_addr learned my addr 172.21.15.148:0/1981432235 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:40.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.066+0000 7ff6df7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f66e7dab40 0x55f66e7e1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:40.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.066+0000 7ff6e8c2c740 10 client.0 _ll_register_callbacks cb 0x55f66e44d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:13:40.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.066+0000 7ff6df7fe640 1 -- 172.21.15.148:0/1981432235 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f66e7d95d0 msgr2=0x55f66e7e3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:40.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.066+0000 7ff6df7fe640 1 --2- 172.21.15.148:0/1981432235 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f66e7d95d0 0x55f66e7e3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:40.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.066+0000 7ff6df7fe640 1 -- 172.21.15.148:0/1981432235 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f66e7e4370 msgr2=0x55f66e7e15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:40.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.066+0000 7ff6df7fe640 1 --2- 172.21.15.148:0/1981432235 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f66e7e4370 0x55f66e7e15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:40.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.066+0000 7ff6df7fe640 1 -- 172.21.15.148:0/1981432235 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f66e4b03c0 con 0x55f66e7dab40 2024-09-19T07:13:40.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.066+0000 7ff6df7fe640 1 --2- 172.21.15.148:0/1981432235 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f66e7dab40 0x55f66e7e1000 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff6d402a930 tx=0x7ff6d4031b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83028601a94fd2dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:40.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.066+0000 7ff6bf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-19T07:13:40.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.067+0000 7ff6bf7fe640 1 -- 172.21.15.148:0/1981432235 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d404e070 con 0x55f66e7dab40 2024-09-19T07:13:40.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.067+0000 7ff6e8c2c740 1 -- 172.21.15.148:0/1981432235 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6d4005020 con 0x55f66e7dab40 2024-09-19T07:13:40.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.067+0000 7ff6bf7fe640 1 -- 172.21.15.148:0/1981432235 <== mon.1 v2:172.21.15.179:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7ff6d4004750 con 0x55f66e7dab40 2024-09-19T07:13:40.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.067+0000 7ff6bf7fe640 1 -- 172.21.15.148:0/1981432235 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff6d405a050 con 0x55f66e7dab40 2024-09-19T07:13:40.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.067+0000 7ff6e8c2c740 10 client.25525 fetch_fsmap learned FSMap version 27 2024-09-19T07:13:40.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.067+0000 7ff6e8c2c740 1 -- 172.21.15.148:0/1981432235 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f66e7e7010 con 0x55f66e7dab40 2024-09-19T07:13:40.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.067+0000 7ff6bf7fe640 1 -- 172.21.15.148:0/1981432235 <== mon.1 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6d4005020 con 0x55f66e7dab40 2024-09-19T07:13:40.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.068+0000 7ff6bf7fe640 1 -- 172.21.15.148:0/1981432235 <== mon.1 v2:172.21.15.179:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7ff6d403d980 con 0x55f66e7dab40 2024-09-19T07:13:40.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.068+0000 7ff6e8c2c740 10 client.25525 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T07:13:40.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.068+0000 7ff6e8c2c740 10 client.25525 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T07:13:40.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.068+0000 7ff6e8c2c740 20 client.25525 populate_metadata read hostname 'smithi148' 2024-09-19T07:13:40.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.068+0000 7ff6e8c2c740 1 --2- 172.21.15.148:0/1981432235 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x55f66e7f3bd0 0x55f66e7f5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:40.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.068+0000 7ff6e8c2c740 4 client.25525 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:13:40.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.068+0000 7ff6e8c2c740 1 -- 172.21.15.148:0/1981432235 --> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f66e74c860 con 0x55f66e7f3bd0 2024-09-19T07:13:40.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.068+0000 7ff6dffff640 1 --2- 172.21.15.148:0/1981432235 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x55f66e7f3bd0 0x55f66e7f5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:40.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.069+0000 7ff6bf7fe640 10 client.25525 ms_handle_connect on v2:172.21.15.165:6838/3993490234 2024-09-19T07:13:40.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.069+0000 7ff6dffff640 1 --2- 172.21.15.148:0/1981432235 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x55f66e7f3bd0 0x55f66e7f5fc0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=51f4fc1d8dd553b1 server_cookie=e9bb008fc15b59dd in_seq=0 out_seq=0 2024-09-19T07:13:40.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.070+0000 7ff6bf7fe640 1 -- 172.21.15.148:0/1981432235 <== mds.1 v2:172.21.15.165:6838/3993490234 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f66e74c860 con 0x55f66e7f3bd0 2024-09-19T07:13:40.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.070+0000 7ff6bf7fe640 10 client.25525 handle_command_reply: tid=0 2024-09-19T07:13:40.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.070+0000 7ff6e8c2c740 1 client.25525 shutdown 2024-09-19T07:13:40.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.070+0000 7ff6e8c2c740 1 -- 172.21.15.148:0/1981432235 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f66e7dab40 msgr2=0x55f66e7e1000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:40.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.070+0000 7ff6e8c2c740 1 --2- 172.21.15.148:0/1981432235 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f66e7dab40 0x55f66e7e1000 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff6d402a930 tx=0x7ff6d4031b50 comp rx=0 tx=0).stop 2024-09-19T07:13:40.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.070+0000 7ff6e8c2c740 1 -- 172.21.15.148:0/1981432235 shutdown_connections 2024-09-19T07:13:40.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.070+0000 7ff6e8c2c740 1 --2- 172.21.15.148:0/1981432235 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f66e7e4370 0x55f66e7e15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:40.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.070+0000 7ff6e8c2c740 1 --2- 172.21.15.148:0/1981432235 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f66e7dab40 0x55f66e7e1000 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:40.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.070+0000 7ff6e8c2c740 1 --2- 172.21.15.148:0/1981432235 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x55f66e7f3bd0 0x55f66e7f5fc0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:40.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.070+0000 7ff6e8c2c740 1 --2- 172.21.15.148:0/1981432235 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f66e7d95d0 0x55f66e7e3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:40.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.070+0000 7ff6e8c2c740 1 -- 172.21.15.148:0/1981432235 >> 172.21.15.148:0/1981432235 conn(0x55f66e7a2310 msgr2=0x55f66e7db960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:40.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.070+0000 7ff6bf7fe640 0 client.25525 ms_handle_reset on v2:172.21.15.165:6838/3993490234 2024-09-19T07:13:40.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.070+0000 7ff6e8c2c740 1 -- 172.21.15.148:0/1981432235 shutdown_connections 2024-09-19T07:13:40.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.071+0000 7ff6e8c2c740 1 -- 172.21.15.148:0/1981432235 wait complete. 2024-09-19T07:13:40.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.071+0000 7ff6e8c2c740 20 client.25525 trim_cache size 0 max 16384 2024-09-19T07:13:40.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.085+0000 7ff6e8c2c740 1 Processor -- start 2024-09-19T07:13:40.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.085+0000 7ff6e8c2c740 1 -- start start 2024-09-19T07:13:40.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.086+0000 7ff6e8c2c740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f66e7d95d0 0x55f66e7f02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:40.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.086+0000 7ff6e8c2c740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f66e7dab40 0x55f66e7d5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:40.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.086+0000 7ff6e8c2c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f66e7e4370 0x55f66e7fb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:40.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.086+0000 7ff6e8c2c740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e01b2340 con 0x55f66e7dab40 2024-09-19T07:13:40.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.086+0000 7ff6e8c2c740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e01afc10 con 0x55f66e7d95d0 2024-09-19T07:13:40.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.086+0000 7ff6e8c2c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e01ada40 con 0x55f66e7e4370 2024-09-19T07:13:40.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.086+0000 7ff6df7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f66e7dab40 0x55f66e7d5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:40.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.086+0000 7ff6dffff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f66e7d95d0 0x55f66e7f02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:40.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.086+0000 7ff6e4df0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f66e7e4370 0x55f66e7fb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:40.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.086+0000 7ff6dffff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f66e7d95d0 0x55f66e7f02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:45336/0 (socket says 172.21.15.148:45336) 2024-09-19T07:13:40.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.086+0000 7ff6dffff640 1 -- 172.21.15.148:0/1672345537 learned_addr learned my addr 172.21.15.148:0/1672345537 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:40.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.086+0000 7ff6df7fe640 1 -- 172.21.15.148:0/1672345537 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f66e7e4370 msgr2=0x55f66e7fb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:40.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.086+0000 7ff6df7fe640 1 --2- 172.21.15.148:0/1672345537 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f66e7e4370 0x55f66e7fb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:40.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.086+0000 7ff6df7fe640 1 -- 172.21.15.148:0/1672345537 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f66e7d95d0 msgr2=0x55f66e7f02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:40.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.086+0000 7ff6df7fe640 1 --2- 172.21.15.148:0/1672345537 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f66e7d95d0 0x55f66e7f02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:40.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.086+0000 7ff6df7fe640 1 -- 172.21.15.148:0/1672345537 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f66e7d5de0 con 0x55f66e7dab40 2024-09-19T07:13:40.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.086+0000 7ff6dffff640 1 --2- 172.21.15.148:0/1672345537 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f66e7d95d0 0x55f66e7f02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:13:40.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.087+0000 7ff6df7fe640 1 --2- 172.21.15.148:0/1672345537 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f66e7dab40 0x55f66e7d5700 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x55f66e7e25b0 tx=0x7ff6d4005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ce6874231db348e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:40.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.087+0000 7ff6c5ffb640 1 -- 172.21.15.148:0/1672345537 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d404e040 con 0x55f66e7dab40 2024-09-19T07:13:40.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.087+0000 7ff6c5ffb640 1 -- 172.21.15.148:0/1672345537 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6d4005020 con 0x55f66e7dab40 2024-09-19T07:13:40.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.087+0000 7ff6c5ffb640 1 -- 172.21.15.148:0/1672345537 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4035030 con 0x55f66e7dab40 2024-09-19T07:13:40.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.087+0000 7ff6e8c2c740 1 -- 172.21.15.148:0/1672345537 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f66e7dab40 msgr2=0x55f66e7d5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:40.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.087+0000 7ff6e8c2c740 1 --2- 172.21.15.148:0/1672345537 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f66e7dab40 0x55f66e7d5700 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x55f66e7e25b0 tx=0x7ff6d4005dd0 comp rx=0 tx=0).stop 2024-09-19T07:13:40.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.088+0000 7ff6e8c2c740 1 -- 172.21.15.148:0/1672345537 shutdown_connections 2024-09-19T07:13:40.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.088+0000 7ff6e8c2c740 1 --2- 172.21.15.148:0/1672345537 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f66e7e4370 0x55f66e7fb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:40.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.088+0000 7ff6e8c2c740 1 --2- 172.21.15.148:0/1672345537 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f66e7dab40 0x55f66e7d5700 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:40.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.088+0000 7ff6e8c2c740 1 --2- 172.21.15.148:0/1672345537 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f66e7d95d0 0x55f66e7f02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:40.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.088+0000 7ff6e8c2c740 1 -- 172.21.15.148:0/1672345537 >> 172.21.15.148:0/1672345537 conn(0x55f66e7a2310 msgr2=0x55f66e7d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:40.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.088+0000 7ff6e8c2c740 1 -- 172.21.15.148:0/1672345537 shutdown_connections 2024-09-19T07:13:40.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.088+0000 7ff6e8c2c740 1 -- 172.21.15.148:0/1672345537 wait complete. 2024-09-19T07:13:40.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.088+0000 7ff6e8c2c740 1 -- start start 2024-09-19T07:13:40.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.088+0000 7ff6e8c2c740 1 Processor -- start 2024-09-19T07:13:40.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.089+0000 7ff6e8c2c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f66e7d95d0 0x55f66e7ec9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:40.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.089+0000 7ff6e8c2c740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f66e7dab40 0x55f66e7ddc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:40.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.089+0000 7ff6e8c2c740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f66e7e4370 0x55f66e7de140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:40.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.089+0000 7ff6dffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f66e7d95d0 0x55f66e7ec9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:40.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.089+0000 7ff6dffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f66e7d95d0 0x55f66e7ec9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:41328/0 (socket says 172.21.15.148:41328) 2024-09-19T07:13:40.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.089+0000 7ff6df7fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f66e7dab40 0x55f66e7ddc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:40.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.089+0000 7ff6df7fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f66e7dab40 0x55f66e7ddc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:45348/0 (socket says 172.21.15.148:45348) 2024-09-19T07:13:40.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.089+0000 7ff6e4df0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f66e7e4370 0x55f66e7de140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:40.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.089+0000 7ff6e4df0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f66e7e4370 0x55f66e7de140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43078/0 (socket says 172.21.15.148:43078) 2024-09-19T07:13:40.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.089+0000 7ff6dffff640 1 -- 172.21.15.148:0/898481933 learned_addr learned my addr 172.21.15.148:0/898481933 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:40.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.089+0000 7ff6e8c2c740 1 -- 172.21.15.148:0/898481933 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e01ae0d0 con 0x55f66e7e4370 2024-09-19T07:13:40.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.089+0000 7ff6e8c2c740 1 -- 172.21.15.148:0/898481933 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e01af540 con 0x55f66e7dab40 2024-09-19T07:13:40.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.089+0000 7ff6e8c2c740 1 -- 172.21.15.148:0/898481933 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e01ae7a0 con 0x55f66e7d95d0 2024-09-19T07:13:40.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.090+0000 7ff6df7fe640 1 -- 172.21.15.148:0/898481933 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f66e7d95d0 msgr2=0x55f66e7ec9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:40.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.090+0000 7ff6df7fe640 1 --2- 172.21.15.148:0/898481933 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f66e7d95d0 0x55f66e7ec9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:40.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.090+0000 7ff6df7fe640 1 -- 172.21.15.148:0/898481933 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f66e7e4370 msgr2=0x55f66e7de140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:40.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.090+0000 7ff6e8c2c740 10 client.0 _ll_register_callbacks cb 0x7ff6d0009340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:13:40.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.090+0000 7ff6df7fe640 1 --2- 172.21.15.148:0/898481933 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f66e7e4370 0x55f66e7de140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:40.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.090+0000 7ff6df7fe640 1 -- 172.21.15.148:0/898481933 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f66e7da790 con 0x55f66e7dab40 2024-09-19T07:13:40.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.090+0000 7ff6dffff640 1 --2- 172.21.15.148:0/898481933 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f66e7d95d0 0x55f66e7ec9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:13:40.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.090+0000 7ff6e8c2c740 1 -- 172.21.15.148:0/898481933 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6d4005020 con 0x55f66e7dab40 2024-09-19T07:13:40.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.090+0000 7ff6e4df0640 1 --2- 172.21.15.148:0/898481933 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f66e7e4370 0x55f66e7de140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:13:40.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.090+0000 7ff6df7fe640 1 --2- 172.21.15.148:0/898481933 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f66e7dab40 0x55f66e7ddc00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff6d40058f0 tx=0x7ff6d402ab90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=338416c77bd7644f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:40.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.090+0000 7ff6bf7fe640 10 client.25469 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-19T07:13:40.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.090+0000 7ff6bf7fe640 1 -- 172.21.15.148:0/898481933 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4062070 con 0x55f66e7dab40 2024-09-19T07:13:40.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.090+0000 7ff6bf7fe640 1 -- 172.21.15.148:0/898481933 <== mon.2 v2:172.21.15.165:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7ff6d40053e0 con 0x55f66e7dab40 2024-09-19T07:13:40.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.090+0000 7ff6bf7fe640 1 -- 172.21.15.148:0/898481933 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff6d4035040 con 0x55f66e7dab40 2024-09-19T07:13:40.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.091+0000 7ff6e8c2c740 10 client.25469 fetch_fsmap learned FSMap version 27 2024-09-19T07:13:40.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.091+0000 7ff6e8c2c740 1 -- 172.21.15.148:0/898481933 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({fsmap=27}) -- 0x55f66e85e380 con 0x55f66e7dab40 2024-09-19T07:13:40.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.091+0000 7ff6bf7fe640 1 -- 172.21.15.148:0/898481933 <== mon.2 v2:172.21.15.165:3300/0 4 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7ff6d40046c0 con 0x55f66e7dab40 2024-09-19T07:13:40.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.091+0000 7ff6e8c2c740 10 client.25469 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T07:13:40.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.091+0000 7ff6e8c2c740 10 client.25469 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T07:13:40.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.091+0000 7ff6e8c2c740 20 client.25469 populate_metadata read hostname 'smithi148' 2024-09-19T07:13:40.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.092+0000 7ff6e8c2c740 1 --2- 172.21.15.148:0/898481933 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x55f66e85e710 0x55f66e860b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:40.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.092+0000 7ff6e8c2c740 4 client.25469 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:13:40.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.092+0000 7ff6e8c2c740 1 -- 172.21.15.148:0/898481933 --> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f66e746d70 con 0x55f66e85e710 2024-09-19T07:13:40.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.092+0000 7ff6dffff640 1 --2- 172.21.15.148:0/898481933 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x55f66e85e710 0x55f66e860b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:40.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.092+0000 7ff6bf7fe640 10 client.25469 ms_handle_connect on v2:172.21.15.165:6838/3993490234 2024-09-19T07:13:40.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.092+0000 7ff6dffff640 1 --2- 172.21.15.148:0/898481933 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x55f66e85e710 0x55f66e860b00 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=12c6c653a4f2638c server_cookie=7f063fb4ea69d3dc in_seq=0 out_seq=0 2024-09-19T07:13:40.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.093+0000 7ff6bf7fe640 1 -- 172.21.15.148:0/898481933 <== mds.1 v2:172.21.15.165:6838/3993490234 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f66e746d70 con 0x55f66e85e710 2024-09-19T07:13:40.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.094+0000 7ff6bf7fe640 10 client.25469 handle_command_reply: tid=0 2024-09-19T07:13:40.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.094+0000 7ff6e8c2c740 1 client.25469 shutdown 2024-09-19T07:13:40.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.094+0000 7ff6e8c2c740 1 -- 172.21.15.148:0/898481933 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f66e7dab40 msgr2=0x55f66e7ddc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:40.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.094+0000 7ff6e8c2c740 1 --2- 172.21.15.148:0/898481933 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f66e7dab40 0x55f66e7ddc00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff6d40058f0 tx=0x7ff6d402ab90 comp rx=0 tx=0).stop 2024-09-19T07:13:40.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.094+0000 7ff6e8c2c740 1 -- 172.21.15.148:0/898481933 shutdown_connections 2024-09-19T07:13:40.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.094+0000 7ff6e8c2c740 1 --2- 172.21.15.148:0/898481933 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f66e7e4370 0x55f66e7de140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:40.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.094+0000 7ff6e8c2c740 1 --2- 172.21.15.148:0/898481933 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x55f66e85e710 0x55f66e860b00 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:40.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.094+0000 7ff6e8c2c740 1 --2- 172.21.15.148:0/898481933 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f66e7dab40 0x55f66e7ddc00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:40.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.094+0000 7ff6e8c2c740 1 --2- 172.21.15.148:0/898481933 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f66e7d95d0 0x55f66e7ec9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:40.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.094+0000 7ff6bf7fe640 0 client.25469 ms_handle_reset on v2:172.21.15.165:6838/3993490234 2024-09-19T07:13:40.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.094+0000 7ff6e8c2c740 1 -- 172.21.15.148:0/898481933 >> 172.21.15.148:0/898481933 conn(0x55f66e7a2310 msgr2=0x55f66e7d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:40.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.095+0000 7ff6e8c2c740 1 -- 172.21.15.148:0/898481933 shutdown_connections 2024-09-19T07:13:40.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.095+0000 7ff6e8c2c740 1 -- 172.21.15.148:0/898481933 wait complete. 2024-09-19T07:13:40.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.095+0000 7ff6e8c2c740 20 client.25469 trim_cache size 0 max 16384 2024-09-19T07:13:40.099 INFO:teuthology.orchestra.run.smithi148.stdout:[] 2024-09-19T07:13:40.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.096+0000 7ff6e6853640 1 -- 172.21.15.148:0/3082296028 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7ff6c80a3500 msgr2=0x7ff6c80a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:40.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.096+0000 7ff6e6853640 1 --2- 172.21.15.148:0/3082296028 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7ff6c80a3500 0x7ff6c80a59c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0005fd0 tx=0x7ff6d00094a0 comp rx=0 tx=0).stop 2024-09-19T07:13:40.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.096+0000 7ff6e6853640 1 -- 172.21.15.148:0/3082296028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6e0106f10 msgr2=0x7ff6e019ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:40.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.096+0000 7ff6e6853640 1 --2- 172.21.15.148:0/3082296028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6e0106f10 0x7ff6e019ef40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff6d800eb10 tx=0x7ff6d800c2d0 comp rx=0 tx=0).stop 2024-09-19T07:13:40.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.096+0000 7ff6e6853640 1 -- 172.21.15.148:0/3082296028 shutdown_connections 2024-09-19T07:13:40.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.096+0000 7ff6e6853640 1 --2- 172.21.15.148:0/3082296028 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7ff6c80a3500 0x7ff6c80a59c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:40.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.096+0000 7ff6e6853640 1 --2- 172.21.15.148:0/3082296028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6e0106f10 0x7ff6e019ef40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:40.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.096+0000 7ff6e6853640 1 --2- 172.21.15.148:0/3082296028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6e0102790 0x7ff6e019abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:40.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.096+0000 7ff6e6853640 1 --2- 172.21.15.148:0/3082296028 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6e0101de0 0x7ff6e019a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:40.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.096+0000 7ff6e6853640 1 -- 172.21.15.148:0/3082296028 >> 172.21.15.148:0/3082296028 conn(0x7ff6e00fd8e0 msgr2=0x7ff6e00fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:40.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.096+0000 7ff6e6853640 1 -- 172.21.15.148:0/3082296028 shutdown_connections 2024-09-19T07:13:40.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:40.096+0000 7ff6e6853640 1 -- 172.21.15.148:0/3082296028 wait complete. 2024-09-19T07:13:40.789 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T07:13:41.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:40 smithi179 ceph-mon[35716]: pgmap v81: 97 pgs: 97 active+clean; 47 MiB data, 559 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 653 op/s 2024-09-19T07:13:41.053 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:13:41.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:40 smithi148 ceph-mon[31180]: pgmap v81: 97 pgs: 97 active+clean; 47 MiB data, 559 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 653 op/s 2024-09-19T07:13:41.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:40 smithi165 ceph-mon[35326]: pgmap v81: 97 pgs: 97 active+clean; 47 MiB data, 559 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 653 op/s 2024-09-19T07:13:41.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.539+0000 7fc261951640 1 -- 172.21.15.148:0/224646378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc25c100a80 msgr2=0x7fc25c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:41.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.539+0000 7fc261951640 1 --2- 172.21.15.148:0/224646378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc25c100a80 0x7fc25c100ee0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fc244009930 tx=0x7fc24402a420 comp rx=0 tx=0).stop 2024-09-19T07:13:41.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.539+0000 7fc261951640 1 -- 172.21.15.148:0/224646378 shutdown_connections 2024-09-19T07:13:41.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.539+0000 7fc261951640 1 --2- 172.21.15.148:0/224646378 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc25c101420 0x7fc25c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.539+0000 7fc261951640 1 --2- 172.21.15.148:0/224646378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc25c100a80 0x7fc25c100ee0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.539+0000 7fc261951640 1 --2- 172.21.15.148:0/224646378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc25c106a80 0x7fc25c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.539+0000 7fc261951640 1 -- 172.21.15.148:0/224646378 >> 172.21.15.148:0/224646378 conn(0x7fc25c0fc7a0 msgr2=0x7fc25c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:41.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.539+0000 7fc261951640 1 -- 172.21.15.148:0/224646378 shutdown_connections 2024-09-19T07:13:41.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.539+0000 7fc261951640 1 -- 172.21.15.148:0/224646378 wait complete. 2024-09-19T07:13:41.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.539+0000 7fc261951640 1 Processor -- start 2024-09-19T07:13:41.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.540+0000 7fc261951640 1 -- start start 2024-09-19T07:13:41.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.540+0000 7fc261951640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc25c100a80 0x7fc25c19a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:41.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.540+0000 7fc261951640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc25c101420 0x7fc25c19abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:41.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.540+0000 7fc261951640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc25c106a80 0x7fc25c19ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:41.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.540+0000 7fc261951640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc25c110e80 con 0x7fc25c101420 2024-09-19T07:13:41.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.540+0000 7fc261951640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc25c110d00 con 0x7fc25c100a80 2024-09-19T07:13:41.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.540+0000 7fc261951640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc25c111000 con 0x7fc25c106a80 2024-09-19T07:13:41.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.540+0000 7fc25a7fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc25c101420 0x7fc25c19abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:41.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.540+0000 7fc25affd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc25c100a80 0x7fc25c19a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:41.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.540+0000 7fc25a7fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc25c101420 0x7fc25c19abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43104/0 (socket says 172.21.15.148:43104) 2024-09-19T07:13:41.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.540+0000 7fc25affd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc25c100a80 0x7fc25c19a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:45370/0 (socket says 172.21.15.148:45370) 2024-09-19T07:13:41.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.540+0000 7fc25a7fc640 1 -- 172.21.15.148:0/585369689 learned_addr learned my addr 172.21.15.148:0/585369689 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:41.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.540+0000 7fc25b7fe640 1 --2- 172.21.15.148:0/585369689 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc25c106a80 0x7fc25c19ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:41.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.540+0000 7fc25a7fc640 1 -- 172.21.15.148:0/585369689 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc25c106a80 msgr2=0x7fc25c19ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:41.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.540+0000 7fc25a7fc640 1 --2- 172.21.15.148:0/585369689 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc25c106a80 0x7fc25c19ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.540+0000 7fc25a7fc640 1 -- 172.21.15.148:0/585369689 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc25c100a80 msgr2=0x7fc25c19a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:41.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.540+0000 7fc25a7fc640 1 --2- 172.21.15.148:0/585369689 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc25c100a80 0x7fc25c19a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.540+0000 7fc25a7fc640 1 -- 172.21.15.148:0/585369689 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc25c19f630 con 0x7fc25c101420 2024-09-19T07:13:41.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.540+0000 7fc25affd640 1 --2- 172.21.15.148:0/585369689 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc25c100a80 0x7fc25c19a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:13:41.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.540+0000 7fc25b7fe640 1 --2- 172.21.15.148:0/585369689 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc25c106a80 0x7fc25c19ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:13:41.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.541+0000 7fc25a7fc640 1 --2- 172.21.15.148:0/585369689 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc25c101420 0x7fc25c19abc0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fc244009230 tx=0x7fc244004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:41.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.541+0000 7fc26094f640 1 -- 172.21.15.148:0/585369689 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24403f030 con 0x7fc25c101420 2024-09-19T07:13:41.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.541+0000 7fc261951640 1 -- 172.21.15.148:0/585369689 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc25c19f8c0 con 0x7fc25c101420 2024-09-19T07:13:41.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.541+0000 7fc26094f640 1 -- 172.21.15.148:0/585369689 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc244003ad0 con 0x7fc25c101420 2024-09-19T07:13:41.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.541+0000 7fc26094f640 1 -- 172.21.15.148:0/585369689 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc244035070 con 0x7fc25c101420 2024-09-19T07:13:41.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.541+0000 7fc261951640 1 -- 172.21.15.148:0/585369689 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc25c1a7200 con 0x7fc25c101420 2024-09-19T07:13:41.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.543+0000 7fc26094f640 1 -- 172.21.15.148:0/585369689 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fc244042030 con 0x7fc25c101420 2024-09-19T07:13:41.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.543+0000 7fc263d2a740 1 Processor -- start 2024-09-19T07:13:41.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.543+0000 7fc263d2a740 1 -- start start 2024-09-19T07:13:41.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.544+0000 7fc263d2a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55827a06cb40 0x55827a06b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:41.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.544+0000 7fc263d2a740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55827a06b5d0 0x55827a06ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:41.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.544+0000 7fc263d2a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55827a076370 0x55827a078760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:41.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.544+0000 7fc263d2a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x558279fd12f0 con 0x55827a076370 2024-09-19T07:13:41.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.544+0000 7fc263d2a740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x558279f78cf0 con 0x55827a06b5d0 2024-09-19T07:13:41.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.544+0000 7fc263d2a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x558279fcd2b0 con 0x55827a06cb40 2024-09-19T07:13:41.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.544+0000 7fc26094f640 1 --2- 172.21.15.148:0/585369689 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc2480a33b0 0x7fc2480a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:41.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.544+0000 7fc25b7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55827a06cb40 0x55827a06b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:41.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.544+0000 7fc25b7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55827a06cb40 0x55827a06b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:41356/0 (socket says 172.21.15.148:41356) 2024-09-19T07:13:41.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.544+0000 7fc25a7fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55827a076370 0x55827a078760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:41.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.544+0000 7fc25b7fe640 1 -- 172.21.15.148:0/2571054643 learned_addr learned my addr 172.21.15.148:0/2571054643 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:41.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.544+0000 7fc25affd640 1 --2- 172.21.15.148:0/2571054643 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55827a06b5d0 0x55827a06ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:41.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.544+0000 7fc25b7fe640 1 --2- 172.21.15.148:0/585369689 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc2480a33b0 0x7fc2480a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:41.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.544+0000 7fc25b7fe640 1 -- 172.21.15.148:0/2571054643 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55827a06b5d0 msgr2=0x55827a06ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:41.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.544+0000 7fc25b7fe640 1 --2- 172.21.15.148:0/2571054643 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55827a06b5d0 0x55827a06ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.544+0000 7fc25b7fe640 1 -- 172.21.15.148:0/2571054643 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55827a076370 msgr2=0x55827a078760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:41.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.544+0000 7fc25b7fe640 1 --2- 172.21.15.148:0/2571054643 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55827a076370 0x55827a078760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.544+0000 7fc25b7fe640 1 -- 172.21.15.148:0/2571054643 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558279f5d3a0 con 0x55827a06cb40 2024-09-19T07:13:41.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.544+0000 7fc26094f640 1 -- 172.21.15.148:0/585369689 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fc2440f0280 con 0x7fc25c101420 2024-09-19T07:13:41.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.544+0000 7fc25affd640 1 --2- 172.21.15.148:0/2571054643 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55827a06b5d0 0x55827a06ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:13:41.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.544+0000 7fc25b7fe640 1 --2- 172.21.15.148:0/2571054643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55827a06cb40 0x55827a06b090 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc24c012e90 tx=0x7fc24c00e780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6dba1ec5f58dae7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:41.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.544+0000 7fc251ffb640 1 -- 172.21.15.148:0/2571054643 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24c003e00 con 0x55827a06cb40 2024-09-19T07:13:41.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.544+0000 7fc251ffb640 1 -- 172.21.15.148:0/2571054643 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc24c01e470 con 0x55827a06cb40 2024-09-19T07:13:41.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.544+0000 7fc251ffb640 1 -- 172.21.15.148:0/2571054643 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24c00d6d0 con 0x55827a06cb40 2024-09-19T07:13:41.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.545+0000 7fc263d2a740 1 -- 172.21.15.148:0/2571054643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55827a06cb40 msgr2=0x55827a06b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:41.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.545+0000 7fc263d2a740 1 --2- 172.21.15.148:0/2571054643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55827a06cb40 0x55827a06b090 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc24c012e90 tx=0x7fc24c00e780 comp rx=0 tx=0).stop 2024-09-19T07:13:41.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.545+0000 7fc25b7fe640 1 --2- 172.21.15.148:0/585369689 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc2480a33b0 0x7fc2480a5870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc24c021000 tx=0x7fc24c020000 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:41.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.545+0000 7fc263d2a740 1 -- 172.21.15.148:0/2571054643 shutdown_connections 2024-09-19T07:13:41.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.545+0000 7fc263d2a740 1 --2- 172.21.15.148:0/2571054643 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55827a076370 0x55827a078760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.545+0000 7fc263d2a740 1 --2- 172.21.15.148:0/2571054643 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55827a06b5d0 0x55827a06ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.545+0000 7fc263d2a740 1 --2- 172.21.15.148:0/2571054643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55827a06cb40 0x55827a06b090 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.545+0000 7fc263d2a740 1 -- 172.21.15.148:0/2571054643 >> 172.21.15.148:0/2571054643 conn(0x55827a034310 msgr2=0x55827a067c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:41.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.545+0000 7fc263d2a740 1 -- 172.21.15.148:0/2571054643 shutdown_connections 2024-09-19T07:13:41.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.545+0000 7fc263d2a740 1 -- 172.21.15.148:0/2571054643 wait complete. 2024-09-19T07:13:41.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.546+0000 7fc263d2a740 1 -- start start 2024-09-19T07:13:41.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.546+0000 7fc263d2a740 1 Processor -- start 2024-09-19T07:13:41.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.546+0000 7fc263d2a740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55827a06b5d0 0x55827a075d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:41.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.546+0000 7fc263d2a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55827a06cb40 0x55827a072fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:41.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.546+0000 7fc263d2a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55827a076370 0x55827a073530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:41.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.546+0000 7fc263d2a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55827a079070 con 0x55827a06cb40 2024-09-19T07:13:41.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.546+0000 7fc263d2a740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x558279f8c060 con 0x55827a06b5d0 2024-09-19T07:13:41.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.546+0000 7fc263d2a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55827a0791f0 con 0x55827a076370 2024-09-19T07:13:41.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.546+0000 7fc263d2a740 10 client.0 _ll_register_callbacks cb 0x558279cdf8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:13:41.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.546+0000 7fc25a7fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55827a06cb40 0x55827a072fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:41.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.546+0000 7fc25b7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55827a076370 0x55827a073530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:41.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.546+0000 7fc25a7fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55827a06cb40 0x55827a072fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43124/0 (socket says 172.21.15.148:43124) 2024-09-19T07:13:41.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.546+0000 7fc25a7fc640 1 -- 172.21.15.148:0/3946618104 learned_addr learned my addr 172.21.15.148:0/3946618104 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:41.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.547+0000 7fc25affd640 1 --2- 172.21.15.148:0/3946618104 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55827a06b5d0 0x55827a075d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:41.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.547+0000 7fc25b7fe640 1 -- 172.21.15.148:0/3946618104 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55827a06b5d0 msgr2=0x55827a075d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:41.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.547+0000 7fc25b7fe640 1 --2- 172.21.15.148:0/3946618104 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55827a06b5d0 0x55827a075d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.547+0000 7fc25b7fe640 1 -- 172.21.15.148:0/3946618104 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55827a06cb40 msgr2=0x55827a072fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:41.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.547+0000 7fc25b7fe640 1 --2- 172.21.15.148:0/3946618104 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55827a06cb40 0x55827a072fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.547+0000 7fc25b7fe640 1 -- 172.21.15.148:0/3946618104 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558279d423c0 con 0x55827a076370 2024-09-19T07:13:41.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.547+0000 7fc25a7fc640 1 --2- 172.21.15.148:0/3946618104 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55827a06cb40 0x55827a072fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:13:41.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.547+0000 7fc25affd640 1 --2- 172.21.15.148:0/3946618104 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55827a06b5d0 0x55827a075d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:13:41.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.547+0000 7fc25b7fe640 1 --2- 172.21.15.148:0/3946618104 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55827a076370 0x55827a073530 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc24c012e60 tx=0x7fc24c0128c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e854f316a108ff3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:41.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.547+0000 7fc23affd640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-19T07:13:41.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.547+0000 7fc23affd640 1 -- 172.21.15.148:0/3946618104 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24c00d680 con 0x55827a076370 2024-09-19T07:13:41.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.547+0000 7fc263d2a740 1 -- 172.21.15.148:0/3946618104 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc24c01e470 con 0x55827a076370 2024-09-19T07:13:41.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.547+0000 7fc23affd640 1 -- 172.21.15.148:0/3946618104 <== mon.1 v2:172.21.15.179:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fc24c023040 con 0x55827a076370 2024-09-19T07:13:41.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.547+0000 7fc23affd640 1 -- 172.21.15.148:0/3946618104 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc24c01e620 con 0x55827a076370 2024-09-19T07:13:41.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.547+0000 7fc263d2a740 10 client.25543 fetch_fsmap learned FSMap version 27 2024-09-19T07:13:41.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.547+0000 7fc263d2a740 1 -- 172.21.15.148:0/3946618104 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55827a084af0 con 0x55827a076370 2024-09-19T07:13:41.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.548+0000 7fc23affd640 1 -- 172.21.15.148:0/3946618104 <== mon.1 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc24c01e470 con 0x55827a076370 2024-09-19T07:13:41.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.548+0000 7fc23affd640 1 -- 172.21.15.148:0/3946618104 <== mon.1 v2:172.21.15.179:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fc24c005170 con 0x55827a076370 2024-09-19T07:13:41.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.548+0000 7fc263d2a740 10 client.25543 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T07:13:41.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.548+0000 7fc263d2a740 10 client.25543 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:13:41.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.548+0000 7fc263d2a740 20 client.25543 populate_metadata read hostname 'smithi148' 2024-09-19T07:13:41.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.548+0000 7fc263d2a740 1 --2- 172.21.15.148:0/3946618104 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55827a085f00 0x55827a0882f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:41.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.548+0000 7fc263d2a740 4 client.25543 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:13:41.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.548+0000 7fc263d2a740 1 -- 172.21.15.148:0/3946618104 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558279fde860 con 0x55827a085f00 2024-09-19T07:13:41.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.548+0000 7fc25affd640 1 --2- 172.21.15.148:0/3946618104 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55827a085f00 0x55827a0882f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:41.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.548+0000 7fc25affd640 1 --2- 172.21.15.148:0/3946618104 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55827a085f00 0x55827a0882f0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f67faa5a95175ca4 server_cookie=4aa32f2f145203be in_seq=0 out_seq=0 2024-09-19T07:13:41.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.548+0000 7fc23affd640 10 client.25543 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:13:41.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.556+0000 7fc23affd640 1 -- 172.21.15.148:0/3946618104 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558279fde860 con 0x55827a085f00 2024-09-19T07:13:41.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.556+0000 7fc23affd640 10 client.25543 handle_command_reply: tid=0 2024-09-19T07:13:41.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.556+0000 7fc263d2a740 1 client.25543 shutdown 2024-09-19T07:13:41.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.556+0000 7fc263d2a740 1 -- 172.21.15.148:0/3946618104 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55827a076370 msgr2=0x55827a073530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:41.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.556+0000 7fc263d2a740 1 --2- 172.21.15.148:0/3946618104 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55827a076370 0x55827a073530 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc24c012e60 tx=0x7fc24c0128c0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.556+0000 7fc263d2a740 1 -- 172.21.15.148:0/3946618104 shutdown_connections 2024-09-19T07:13:41.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.556+0000 7fc263d2a740 1 --2- 172.21.15.148:0/3946618104 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55827a085f00 0x55827a0882f0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.556+0000 7fc263d2a740 1 --2- 172.21.15.148:0/3946618104 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55827a076370 0x55827a073530 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.556+0000 7fc263d2a740 1 --2- 172.21.15.148:0/3946618104 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55827a06cb40 0x55827a072fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.556+0000 7fc263d2a740 1 --2- 172.21.15.148:0/3946618104 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55827a06b5d0 0x55827a075d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.556+0000 7fc263d2a740 1 -- 172.21.15.148:0/3946618104 >> 172.21.15.148:0/3946618104 conn(0x55827a034310 msgr2=0x55827a06d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:41.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.556+0000 7fc23affd640 0 client.25543 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:13:41.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.556+0000 7fc263d2a740 1 -- 172.21.15.148:0/3946618104 shutdown_connections 2024-09-19T07:13:41.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.556+0000 7fc263d2a740 1 -- 172.21.15.148:0/3946618104 wait complete. 2024-09-19T07:13:41.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.556+0000 7fc263d2a740 20 client.25543 trim_cache size 0 max 16384 2024-09-19T07:13:41.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.569+0000 7fc263d2a740 1 Processor -- start 2024-09-19T07:13:41.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.569+0000 7fc263d2a740 1 -- start start 2024-09-19T07:13:41.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.569+0000 7fc263d2a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55827a06b5d0 0x55827a082310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:41.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.569+0000 7fc263d2a740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55827a06cb40 0x55827a06e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:41.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.569+0000 7fc263d2a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55827a076370 0x55827a06e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:41.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.569+0000 7fc263d2a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc25c1b22b0 con 0x55827a06b5d0 2024-09-19T07:13:41.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.569+0000 7fc263d2a740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc25c1afb80 con 0x55827a06cb40 2024-09-19T07:13:41.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.569+0000 7fc263d2a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc25c1ad9b0 con 0x55827a076370 2024-09-19T07:13:41.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.570+0000 7fc25affd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55827a06b5d0 0x55827a082310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:41.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.570+0000 7fc25affd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55827a06b5d0 0x55827a082310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43140/0 (socket says 172.21.15.148:43140) 2024-09-19T07:13:41.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.570+0000 7fc25a7fc640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55827a06cb40 0x55827a06e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:41.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.570+0000 7fc25affd640 1 -- 172.21.15.148:0/1766377521 learned_addr learned my addr 172.21.15.148:0/1766377521 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:41.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.570+0000 7fc25b7fe640 1 --2- 172.21.15.148:0/1766377521 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55827a076370 0x55827a06e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:41.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.570+0000 7fc25affd640 1 -- 172.21.15.148:0/1766377521 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55827a076370 msgr2=0x55827a06e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:41.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.570+0000 7fc25affd640 1 --2- 172.21.15.148:0/1766377521 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55827a076370 0x55827a06e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.570+0000 7fc25affd640 1 -- 172.21.15.148:0/1766377521 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55827a06cb40 msgr2=0x55827a06e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:41.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.570+0000 7fc25affd640 1 --2- 172.21.15.148:0/1766377521 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55827a06cb40 0x55827a06e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.570+0000 7fc25affd640 1 -- 172.21.15.148:0/1766377521 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55827a071500 con 0x55827a06b5d0 2024-09-19T07:13:41.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.570+0000 7fc25a7fc640 1 --2- 172.21.15.148:0/1766377521 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55827a06cb40 0x55827a06e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:13:41.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.570+0000 7fc25affd640 1 --2- 172.21.15.148:0/1766377521 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55827a06b5d0 0x55827a082310 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fc254009fd0 tx=0x7fc254005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f0bfb905b3373d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:41.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.570+0000 7fc2517fa640 1 -- 172.21.15.148:0/1766377521 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc254004030 con 0x55827a06b5d0 2024-09-19T07:13:41.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.570+0000 7fc2517fa640 1 -- 172.21.15.148:0/1766377521 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc25400fd20 con 0x55827a06b5d0 2024-09-19T07:13:41.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.570+0000 7fc2517fa640 1 -- 172.21.15.148:0/1766377521 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc254003be0 con 0x55827a06b5d0 2024-09-19T07:13:41.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.571+0000 7fc263d2a740 1 -- 172.21.15.148:0/1766377521 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55827a06b5d0 msgr2=0x55827a082310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:41.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.571+0000 7fc263d2a740 1 --2- 172.21.15.148:0/1766377521 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55827a06b5d0 0x55827a082310 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fc254009fd0 tx=0x7fc254005f90 comp rx=0 tx=0).stop 2024-09-19T07:13:41.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.571+0000 7fc263d2a740 1 -- 172.21.15.148:0/1766377521 shutdown_connections 2024-09-19T07:13:41.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.571+0000 7fc263d2a740 1 --2- 172.21.15.148:0/1766377521 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55827a076370 0x55827a06e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.571+0000 7fc263d2a740 1 --2- 172.21.15.148:0/1766377521 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55827a06cb40 0x55827a06e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.571+0000 7fc263d2a740 1 --2- 172.21.15.148:0/1766377521 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55827a06b5d0 0x55827a082310 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.571+0000 7fc263d2a740 1 -- 172.21.15.148:0/1766377521 >> 172.21.15.148:0/1766377521 conn(0x55827a034310 msgr2=0x55827a072f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:41.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.571+0000 7fc263d2a740 1 -- 172.21.15.148:0/1766377521 shutdown_connections 2024-09-19T07:13:41.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.571+0000 7fc263d2a740 1 -- 172.21.15.148:0/1766377521 wait complete. 2024-09-19T07:13:41.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.571+0000 7fc263d2a740 1 -- start start 2024-09-19T07:13:41.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.572+0000 7fc263d2a740 1 Processor -- start 2024-09-19T07:13:41.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.572+0000 7fc263d2a740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55827a06b5d0 0x55827a07eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:41.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.572+0000 7fc263d2a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55827a06cb40 0x55827a079440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:41.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.572+0000 7fc263d2a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55827a076370 0x55827a079980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:41.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.572+0000 7fc263d2a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc25c1ae040 con 0x55827a06cb40 2024-09-19T07:13:41.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.572+0000 7fc263d2a740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc25c1af4b0 con 0x55827a06b5d0 2024-09-19T07:13:41.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.572+0000 7fc263d2a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc25c1ae710 con 0x55827a076370 2024-09-19T07:13:41.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.572+0000 7fc263d2a740 10 client.0 _ll_register_callbacks cb 0x7fc2440bc160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:13:41.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.572+0000 7fc25a7fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55827a06cb40 0x55827a079440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:41.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.572+0000 7fc25b7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55827a076370 0x55827a079980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:41.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.572+0000 7fc25a7fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55827a06cb40 0x55827a079440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43154/0 (socket says 172.21.15.148:43154) 2024-09-19T07:13:41.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.572+0000 7fc25b7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55827a076370 0x55827a079980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:41386/0 (socket says 172.21.15.148:41386) 2024-09-19T07:13:41.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.572+0000 7fc25a7fc640 1 -- 172.21.15.148:0/2200293392 learned_addr learned my addr 172.21.15.148:0/2200293392 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:41.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.572+0000 7fc25affd640 1 --2- 172.21.15.148:0/2200293392 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55827a06b5d0 0x55827a07eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:41.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.572+0000 7fc25b7fe640 1 -- 172.21.15.148:0/2200293392 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55827a06b5d0 msgr2=0x55827a07eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:41.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.572+0000 7fc25b7fe640 1 --2- 172.21.15.148:0/2200293392 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55827a06b5d0 0x55827a07eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.572+0000 7fc25b7fe640 1 -- 172.21.15.148:0/2200293392 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55827a06cb40 msgr2=0x55827a079440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:41.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.572+0000 7fc25b7fe640 1 --2- 172.21.15.148:0/2200293392 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55827a06cb40 0x55827a079440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.572+0000 7fc25b7fe640 1 -- 172.21.15.148:0/2200293392 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55827a07a070 con 0x55827a076370 2024-09-19T07:13:41.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.572+0000 7fc25a7fc640 1 --2- 172.21.15.148:0/2200293392 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55827a06cb40 0x55827a079440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:13:41.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.572+0000 7fc25b7fe640 1 --2- 172.21.15.148:0/2200293392 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55827a076370 0x55827a079980 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc24c0056d0 tx=0x7fc24c01e9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce377f64823ea491 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:41.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.572+0000 7fc23affd640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-19T07:13:41.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.573+0000 7fc23affd640 1 -- 172.21.15.148:0/2200293392 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24c03e040 con 0x55827a076370 2024-09-19T07:13:41.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.573+0000 7fc23affd640 1 -- 172.21.15.148:0/2200293392 <== mon.1 v2:172.21.15.179:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fc24c023070 con 0x55827a076370 2024-09-19T07:13:41.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.573+0000 7fc263d2a740 1 -- 172.21.15.148:0/2200293392 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc25400fd20 con 0x55827a076370 2024-09-19T07:13:41.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.573+0000 7fc23affd640 1 -- 172.21.15.148:0/2200293392 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc24c01e470 con 0x55827a076370 2024-09-19T07:13:41.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.573+0000 7fc263d2a740 10 client.25549 fetch_fsmap learned FSMap version 27 2024-09-19T07:13:41.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.573+0000 7fc263d2a740 1 -- 172.21.15.148:0/2200293392 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55827a0ef950 con 0x55827a076370 2024-09-19T07:13:41.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.573+0000 7fc23affd640 1 -- 172.21.15.148:0/2200293392 <== mon.1 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc25400fd20 con 0x55827a076370 2024-09-19T07:13:41.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.573+0000 7fc23affd640 1 -- 172.21.15.148:0/2200293392 <== mon.1 v2:172.21.15.179:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fc24c005030 con 0x55827a076370 2024-09-19T07:13:41.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.573+0000 7fc263d2a740 10 client.25549 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T07:13:41.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.573+0000 7fc263d2a740 10 client.25549 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:13:41.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.573+0000 7fc263d2a740 20 client.25549 populate_metadata read hostname 'smithi148' 2024-09-19T07:13:41.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.573+0000 7fc263d2a740 1 --2- 172.21.15.148:0/2200293392 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55827a0f0070 0x55827a0f2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:41.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.573+0000 7fc263d2a740 4 client.25549 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:13:41.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.573+0000 7fc263d2a740 1 -- 172.21.15.148:0/2200293392 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558279fd8d70 con 0x55827a0f0070 2024-09-19T07:13:41.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.574+0000 7fc25affd640 1 --2- 172.21.15.148:0/2200293392 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55827a0f0070 0x55827a0f2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:41.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.574+0000 7fc25affd640 1 --2- 172.21.15.148:0/2200293392 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55827a0f0070 0x55827a0f2490 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=adb2596c7952dca server_cookie=3c746a040be77277 in_seq=0 out_seq=0 2024-09-19T07:13:41.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.574+0000 7fc23affd640 10 client.25549 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:13:41.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.575+0000 7fc23affd640 1 -- 172.21.15.148:0/2200293392 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558279fd8d70 con 0x55827a0f0070 2024-09-19T07:13:41.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.575+0000 7fc23affd640 10 client.25549 handle_command_reply: tid=0 2024-09-19T07:13:41.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.575+0000 7fc263d2a740 1 client.25549 shutdown 2024-09-19T07:13:41.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.575+0000 7fc263d2a740 1 -- 172.21.15.148:0/2200293392 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55827a076370 msgr2=0x55827a079980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:41.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.575+0000 7fc263d2a740 1 --2- 172.21.15.148:0/2200293392 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55827a076370 0x55827a079980 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc24c0056d0 tx=0x7fc24c01e9f0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.575+0000 7fc263d2a740 1 -- 172.21.15.148:0/2200293392 shutdown_connections 2024-09-19T07:13:41.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.575+0000 7fc263d2a740 1 --2- 172.21.15.148:0/2200293392 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55827a0f0070 0x55827a0f2490 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.575+0000 7fc263d2a740 1 --2- 172.21.15.148:0/2200293392 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55827a076370 0x55827a079980 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.575+0000 7fc263d2a740 1 --2- 172.21.15.148:0/2200293392 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55827a06cb40 0x55827a079440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.575+0000 7fc23affd640 0 client.25549 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:13:41.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.575+0000 7fc263d2a740 1 --2- 172.21.15.148:0/2200293392 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55827a06b5d0 0x55827a07eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.575+0000 7fc263d2a740 1 -- 172.21.15.148:0/2200293392 >> 172.21.15.148:0/2200293392 conn(0x55827a034310 msgr2=0x55827a071880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:41.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.575+0000 7fc263d2a740 1 -- 172.21.15.148:0/2200293392 shutdown_connections 2024-09-19T07:13:41.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.575+0000 7fc263d2a740 1 -- 172.21.15.148:0/2200293392 wait complete. 2024-09-19T07:13:41.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.575+0000 7fc263d2a740 20 client.25549 trim_cache size 0 max 16384 2024-09-19T07:13:41.581 INFO:teuthology.orchestra.run.smithi148.stdout:[] 2024-09-19T07:13:41.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.576+0000 7fc261951640 1 -- 172.21.15.148:0/585369689 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc2480a33b0 msgr2=0x7fc2480a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:41.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.576+0000 7fc261951640 1 --2- 172.21.15.148:0/585369689 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc2480a33b0 0x7fc2480a5870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc24c021000 tx=0x7fc24c020000 comp rx=0 tx=0).stop 2024-09-19T07:13:41.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.576+0000 7fc261951640 1 -- 172.21.15.148:0/585369689 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc25c101420 msgr2=0x7fc25c19abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:41.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.576+0000 7fc261951640 1 --2- 172.21.15.148:0/585369689 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc25c101420 0x7fc25c19abc0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fc244009230 tx=0x7fc244004270 comp rx=0 tx=0).stop 2024-09-19T07:13:41.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.576+0000 7fc261951640 1 -- 172.21.15.148:0/585369689 shutdown_connections 2024-09-19T07:13:41.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.576+0000 7fc261951640 1 --2- 172.21.15.148:0/585369689 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc2480a33b0 0x7fc2480a5870 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.576+0000 7fc261951640 1 --2- 172.21.15.148:0/585369689 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc25c106a80 0x7fc25c19ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.576+0000 7fc261951640 1 --2- 172.21.15.148:0/585369689 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc25c101420 0x7fc25c19abc0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.576+0000 7fc261951640 1 --2- 172.21.15.148:0/585369689 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc25c100a80 0x7fc25c19a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.576+0000 7fc261951640 1 -- 172.21.15.148:0/585369689 >> 172.21.15.148:0/585369689 conn(0x7fc25c0fc7a0 msgr2=0x7fc25c06a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:41.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.576+0000 7fc261951640 1 -- 172.21.15.148:0/585369689 shutdown_connections 2024-09-19T07:13:41.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:41.576+0000 7fc261951640 1 -- 172.21.15.148:0/585369689 wait complete. 2024-09-19T07:13:41.872 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.870+0000 7f9baffc4640 1 -- 172.21.15.148:0/4149293838 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ba8101350 msgr2=0x7f9ba810d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:41.873 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.870+0000 7f9baffc4640 1 --2- 172.21.15.148:0/4149293838 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ba8101350 0x7f9ba810d880 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f9ba0009cd0 tx=0x7f9ba002a8e0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.873 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.870+0000 7f9baffc4640 1 -- 172.21.15.148:0/4149293838 shutdown_connections 2024-09-19T07:13:41.873 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.870+0000 7f9baffc4640 1 --2- 172.21.15.148:0/4149293838 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ba8101350 0x7f9ba810d880 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.873 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.870+0000 7f9baffc4640 1 --2- 172.21.15.148:0/4149293838 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ba81009b0 0x7f9ba8100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.873 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.870+0000 7f9baffc4640 1 --2- 172.21.15.148:0/4149293838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ba81069c0 0x7f9ba8106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.873 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.870+0000 7f9baffc4640 1 -- 172.21.15.148:0/4149293838 >> 172.21.15.148:0/4149293838 conn(0x7f9ba8077990 msgr2=0x7f9ba80fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:41.873 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.870+0000 7f9baffc4640 1 -- 172.21.15.148:0/4149293838 shutdown_connections 2024-09-19T07:13:41.873 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.870+0000 7f9baffc4640 1 -- 172.21.15.148:0/4149293838 wait complete. 2024-09-19T07:13:41.873 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.870+0000 7f9baffc4640 1 Processor -- start 2024-09-19T07:13:41.873 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.870+0000 7f9baffc4640 1 -- start start 2024-09-19T07:13:41.873 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.871+0000 7f9baffc4640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ba81009b0 0x7f9ba8198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:41.874 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.871+0000 7f9baffc4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ba8101350 0x7f9ba8198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:41.874 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.871+0000 7f9baffc4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ba81069c0 0x7f9ba819cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:41.874 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.871+0000 7f9baffc4640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba8110e00 con 0x7f9ba81069c0 2024-09-19T07:13:41.874 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.871+0000 7f9badd60640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ba81009b0 0x7f9ba8198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:41.874 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.871+0000 7f9badd60640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ba81009b0 0x7f9ba8198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:45422/0 (socket says 172.21.15.148:45422) 2024-09-19T07:13:41.874 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.871+0000 7f9badd60640 1 -- 172.21.15.148:0/593977098 learned_addr learned my addr 172.21.15.148:0/593977098 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:41.874 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.871+0000 7f9baffc4640 1 -- 172.21.15.148:0/593977098 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba8110c80 con 0x7f9ba81009b0 2024-09-19T07:13:41.874 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.871+0000 7f9baffc4640 1 -- 172.21.15.148:0/593977098 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba8110f80 con 0x7f9ba8101350 2024-09-19T07:13:41.874 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.871+0000 7f9bae561640 1 --2- 172.21.15.148:0/593977098 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ba81069c0 0x7f9ba819cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:41.874 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.871+0000 7f9bad55f640 1 --2- 172.21.15.148:0/593977098 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ba8101350 0x7f9ba8198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:41.874 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.871+0000 7f9badd60640 1 -- 172.21.15.148:0/593977098 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ba8101350 msgr2=0x7f9ba8198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:41.875 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.871+0000 7f9badd60640 1 --2- 172.21.15.148:0/593977098 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ba8101350 0x7f9ba8198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.875 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.871+0000 7f9badd60640 1 -- 172.21.15.148:0/593977098 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ba81069c0 msgr2=0x7f9ba819cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:41.875 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.871+0000 7f9badd60640 1 --2- 172.21.15.148:0/593977098 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ba81069c0 0x7f9ba819cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.875 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.871+0000 7f9badd60640 1 -- 172.21.15.148:0/593977098 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ba819d300 con 0x7f9ba81009b0 2024-09-19T07:13:41.875 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.871+0000 7f9bae561640 1 --2- 172.21.15.148:0/593977098 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ba81069c0 0x7f9ba819cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:13:41.875 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.871+0000 7f9badd60640 1 --2- 172.21.15.148:0/593977098 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ba81009b0 0x7f9ba8198340 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9ba400ea20 tx=0x7f9ba400ee20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:41.875 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.872+0000 7f9b9effd640 1 -- 172.21.15.148:0/593977098 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ba400cd80 con 0x7f9ba81009b0 2024-09-19T07:13:41.875 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.872+0000 7f9b9effd640 1 -- 172.21.15.148:0/593977098 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ba4005500 con 0x7f9ba81009b0 2024-09-19T07:13:41.875 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.872+0000 7f9baffc4640 1 -- 172.21.15.148:0/593977098 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ba819d5f0 con 0x7f9ba81009b0 2024-09-19T07:13:41.875 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.872+0000 7f9b9effd640 1 -- 172.21.15.148:0/593977098 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ba4010690 con 0x7f9ba81009b0 2024-09-19T07:13:41.875 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.872+0000 7f9baffc4640 1 -- 172.21.15.148:0/593977098 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ba80fcd10 con 0x7f9ba81009b0 2024-09-19T07:13:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.875+0000 7f9bb2e3b740 1 Processor -- start 2024-09-19T07:13:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.875+0000 7f9bb2e3b740 1 -- start start 2024-09-19T07:13:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.875+0000 7f9b9effd640 1 -- 172.21.15.148:0/593977098 <== mon.2 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f9ba40046c0 con 0x7f9ba81009b0 2024-09-19T07:13:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.875+0000 7f9bb2e3b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a559336af0 0x55a559336ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.875+0000 7f9bb2e3b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a559337410 0x55a559341770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.875+0000 7f9bb2e3b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a559341cb0 0x55a5593440a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:41.878 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.875+0000 7f9bb2e3b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55a55929b2f0 con 0x55a559337410 2024-09-19T07:13:41.878 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.875+0000 7f9bb2e3b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55a559243270 con 0x55a559336af0 2024-09-19T07:13:41.878 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.875+0000 7f9bb2e3b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a5592972b0 con 0x55a559341cb0 2024-09-19T07:13:41.878 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.876+0000 7f9badd60640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a559337410 0x55a559341770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:41.878 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.876+0000 7f9bae561640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a559336af0 0x55a559336ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:41.878 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.876+0000 7f9bad55f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a559341cb0 0x55a5593440a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:41.878 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.876+0000 7f9badd60640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a559337410 0x55a559341770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43188/0 (socket says 172.21.15.148:43188) 2024-09-19T07:13:41.878 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.876+0000 7f9badd60640 1 -- 172.21.15.148:0/2409423294 learned_addr learned my addr 172.21.15.148:0/2409423294 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:41.878 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.876+0000 7f9bae561640 1 -- 172.21.15.148:0/2409423294 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a559341cb0 msgr2=0x55a5593440a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:41.878 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.876+0000 7f9bae561640 1 --2- 172.21.15.148:0/2409423294 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a559341cb0 0x55a5593440a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.878 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.876+0000 7f9bae561640 1 -- 172.21.15.148:0/2409423294 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a559337410 msgr2=0x55a559341770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:41.878 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.876+0000 7f9bae561640 1 --2- 172.21.15.148:0/2409423294 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a559337410 0x55a559341770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.878 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.876+0000 7f9bae561640 1 -- 172.21.15.148:0/2409423294 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a559242340 con 0x55a559336af0 2024-09-19T07:13:41.878 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.876+0000 7f9bae561640 1 --2- 172.21.15.148:0/2409423294 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a559336af0 0x55a559336ed0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9ba0009ca0 tx=0x7f9ba0009a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90dda34c4aa3b9c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:41.879 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.876+0000 7f9b9effd640 1 --2- 172.21.15.148:0/593977098 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f9b940a3460 0x7f9b940a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:41.879 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.876+0000 7f9badd60640 1 --2- 172.21.15.148:0/593977098 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f9b940a3460 0x7f9b940a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:41.879 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.876+0000 7f9b93fff640 1 -- 172.21.15.148:0/2409423294 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ba0048070 con 0x55a559336af0 2024-09-19T07:13:41.879 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.876+0000 7f9b93fff640 1 -- 172.21.15.148:0/2409423294 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ba0036070 con 0x55a559336af0 2024-09-19T07:13:41.879 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.876+0000 7f9b93fff640 1 -- 172.21.15.148:0/2409423294 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ba0004660 con 0x55a559336af0 2024-09-19T07:13:41.879 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.876+0000 7f9b9effd640 1 -- 172.21.15.148:0/593977098 <== mon.2 v2:172.21.15.165:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f9ba40d0020 con 0x7f9ba81009b0 2024-09-19T07:13:41.880 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.877+0000 7f9bb2e3b740 1 -- 172.21.15.148:0/2409423294 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a559336af0 msgr2=0x55a559336ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:41.880 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.877+0000 7f9badd60640 1 --2- 172.21.15.148:0/593977098 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f9b940a3460 0x7f9b940a5920 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4004be0 tx=0x7f9ba40d3b10 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:41.880 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.877+0000 7f9bb2e3b740 1 --2- 172.21.15.148:0/2409423294 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a559336af0 0x55a559336ed0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9ba0009ca0 tx=0x7f9ba0009a20 comp rx=0 tx=0).stop 2024-09-19T07:13:41.880 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.877+0000 7f9bb2e3b740 1 -- 172.21.15.148:0/2409423294 shutdown_connections 2024-09-19T07:13:41.880 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.877+0000 7f9bb2e3b740 1 --2- 172.21.15.148:0/2409423294 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a559341cb0 0x55a5593440a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.880 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.877+0000 7f9bb2e3b740 1 --2- 172.21.15.148:0/2409423294 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a559337410 0x55a559341770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.880 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.877+0000 7f9bb2e3b740 1 --2- 172.21.15.148:0/2409423294 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a559336af0 0x55a559336ed0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.880 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.877+0000 7f9bb2e3b740 1 -- 172.21.15.148:0/2409423294 >> 172.21.15.148:0/2409423294 conn(0x55a559333060 msgr2=0x55a559333440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:41.880 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.877+0000 7f9bb2e3b740 1 -- 172.21.15.148:0/2409423294 shutdown_connections 2024-09-19T07:13:41.881 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.877+0000 7f9bb2e3b740 1 -- 172.21.15.148:0/2409423294 wait complete. 2024-09-19T07:13:41.881 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.878+0000 7f9bb2e3b740 1 -- start start 2024-09-19T07:13:41.881 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.878+0000 7f9bb2e3b740 1 Processor -- start 2024-09-19T07:13:41.881 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.880+0000 7f9bb2e3b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a559336af0 0x55a55933eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:41.881 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.880+0000 7f9bb2e3b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a559337410 0x55a55933f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:41.881 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.880+0000 7f9bb2e3b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a559341cb0 0x55a55933f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:41.881 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.880+0000 7f9bb2e3b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55a559344880 con 0x55a559336af0 2024-09-19T07:13:41.881 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.880+0000 7f9bb2e3b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55a559224290 con 0x55a559337410 2024-09-19T07:13:41.881 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.880+0000 7f9bb2e3b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a559344a00 con 0x55a559341cb0 2024-09-19T07:13:41.882 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.880+0000 7f9bb2e3b740 10 client.0 _ll_register_callbacks cb 0x55a559255140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:13:41.882 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.881+0000 7f9bae561640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a559341cb0 0x55a55933f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:41.882 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.881+0000 7f9bae561640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a559336af0 0x55a55933eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:41.882 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.881+0000 7f9bae561640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a559336af0 0x55a55933eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43200/0 (socket says 172.21.15.148:43200) 2024-09-19T07:13:41.883 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.881+0000 7f9bae561640 1 -- 172.21.15.148:0/797872079 learned_addr learned my addr 172.21.15.148:0/797872079 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:41.883 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.881+0000 7f9bae561640 1 -- 172.21.15.148:0/797872079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a559341cb0 msgr2=0x55a55933f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:41.883 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.881+0000 7f9bae561640 1 --2- 172.21.15.148:0/797872079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a559341cb0 0x55a55933f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.883 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.881+0000 7f9bae561640 1 -- 172.21.15.148:0/797872079 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a559337410 msgr2=0x55a55933f0d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T07:13:41.883 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.881+0000 7f9bae561640 1 --2- 172.21.15.148:0/797872079 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a559337410 0x55a55933f0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.883 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.881+0000 7f9bae561640 1 -- 172.21.15.148:0/797872079 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a558fae210 con 0x55a559336af0 2024-09-19T07:13:41.883 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.882+0000 7f9bae561640 1 --2- 172.21.15.148:0/797872079 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a559336af0 0x55a55933eb90 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f9ba0005c20 tx=0x7f9ba002a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dd1f4360ea9e217 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:41.883 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.882+0000 7f9b917fa640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:13:41.884 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.882+0000 7f9b917fa640 1 -- 172.21.15.148:0/797872079 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ba0051070 con 0x55a559336af0 2024-09-19T07:13:41.884 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.882+0000 7f9b917fa640 1 -- 172.21.15.148:0/797872079 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f9ba0003970 con 0x55a559336af0 2024-09-19T07:13:41.884 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.882+0000 7f9bb2e3b740 1 -- 172.21.15.148:0/797872079 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ba0036070 con 0x55a559336af0 2024-09-19T07:13:41.886 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.885+0000 7f9b917fa640 1 -- 172.21.15.148:0/797872079 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9ba0048040 con 0x55a559336af0 2024-09-19T07:13:41.886 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.885+0000 7f9bb2e3b740 10 client.16146 fetch_fsmap learned FSMap version 27 2024-09-19T07:13:41.886 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.885+0000 7f9bb2e3b740 1 -- 172.21.15.148:0/797872079 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a55907a620 con 0x55a559336af0 2024-09-19T07:13:41.947 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.946+0000 7f9b917fa640 1 -- 172.21.15.148:0/797872079 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ba0036070 con 0x55a559336af0 2024-09-19T07:13:41.947 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.947+0000 7f9b917fa640 1 -- 172.21.15.148:0/797872079 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f9ba0042030 con 0x55a559336af0 2024-09-19T07:13:41.948 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.947+0000 7f9bb2e3b740 10 client.16146 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T07:13:41.948 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.947+0000 7f9bb2e3b740 10 client.16146 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:13:41.948 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.947+0000 7f9bb2e3b740 20 client.16146 populate_metadata read hostname 'smithi148' 2024-09-19T07:13:41.948 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.947+0000 7f9bb2e3b740 1 --2- 172.21.15.148:0/797872079 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55a55935a290 0x55a55935c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:41.948 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.947+0000 7f9bb2e3b740 4 client.16146 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:13:41.948 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.947+0000 7f9bb2e3b740 1 -- 172.21.15.148:0/797872079 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a5592a8a20 con 0x55a55935a290 2024-09-19T07:13:41.949 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.948+0000 7f9bad55f640 1 --2- 172.21.15.148:0/797872079 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55a55935a290 0x55a55935c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:41.950 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.949+0000 7f9bad55f640 1 --2- 172.21.15.148:0/797872079 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55a55935a290 0x55a55935c680 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10ce51636f49c427 server_cookie=d2a49d2f2009f26 in_seq=0 out_seq=0 2024-09-19T07:13:41.950 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.950+0000 7f9b917fa640 10 client.16146 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:13:41.958 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.957+0000 7f9b917fa640 1 -- 172.21.15.148:0/797872079 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a5592a8a20 con 0x55a55935a290 2024-09-19T07:13:41.958 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.957+0000 7f9b917fa640 10 client.16146 handle_command_reply: tid=0 2024-09-19T07:13:41.958 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.957+0000 7f9bb2e3b740 1 client.16146 shutdown 2024-09-19T07:13:41.958 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.957+0000 7f9bb2e3b740 1 -- 172.21.15.148:0/797872079 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a559336af0 msgr2=0x55a55933eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:41.958 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.957+0000 7f9bb2e3b740 1 --2- 172.21.15.148:0/797872079 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a559336af0 0x55a55933eb90 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f9ba0005c20 tx=0x7f9ba002a8e0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.959 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.957+0000 7f9bb2e3b740 1 -- 172.21.15.148:0/797872079 shutdown_connections 2024-09-19T07:13:41.959 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.957+0000 7f9bb2e3b740 1 --2- 172.21.15.148:0/797872079 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55a55935a290 0x55a55935c680 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.959 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.957+0000 7f9bb2e3b740 1 --2- 172.21.15.148:0/797872079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a559341cb0 0x55a55933f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.959 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.957+0000 7f9bb2e3b740 1 --2- 172.21.15.148:0/797872079 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a559337410 0x55a55933f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.959 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.957+0000 7f9bb2e3b740 1 --2- 172.21.15.148:0/797872079 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a559336af0 0x55a55933eb90 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.959 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.957+0000 7f9bb2e3b740 1 -- 172.21.15.148:0/797872079 >> 172.21.15.148:0/797872079 conn(0x55a559333060 msgr2=0x55a559338dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:41.959 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.958+0000 7f9b917fa640 0 client.16146 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:13:41.959 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.958+0000 7f9bb2e3b740 1 -- 172.21.15.148:0/797872079 shutdown_connections 2024-09-19T07:13:41.959 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.958+0000 7f9bb2e3b740 1 -- 172.21.15.148:0/797872079 wait complete. 2024-09-19T07:13:41.959 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:41.958+0000 7f9bb2e3b740 20 client.16146 trim_cache size 0 max 16384 2024-09-19T07:13:42.034 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.033+0000 7f9bb2e3b740 1 Processor -- start 2024-09-19T07:13:42.034 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.033+0000 7f9bb2e3b740 1 -- start start 2024-09-19T07:13:42.035 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.033+0000 7f9bb2e3b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a559336af0 0x55a559361c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:42.035 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.034+0000 7f9bb2e3b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a559337410 0x55a559362190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:42.036 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.034+0000 7f9bb2e3b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a559341cb0 0x55a5593319a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:42.036 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.034+0000 7f9bb2e3b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba81adf50 con 0x55a559337410 2024-09-19T07:13:42.036 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.034+0000 7f9bb2e3b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba81ab820 con 0x55a559341cb0 2024-09-19T07:13:42.036 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.034+0000 7f9bb2e3b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba81a9650 con 0x55a559336af0 2024-09-19T07:13:42.036 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.034+0000 7f9bae561640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a559336af0 0x55a559361c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:42.036 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.034+0000 7f9bae561640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a559336af0 0x55a559361c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:41430/0 (socket says 172.21.15.148:41430) 2024-09-19T07:13:42.036 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.034+0000 7f9bae561640 1 -- 172.21.15.148:0/3593379782 learned_addr learned my addr 172.21.15.148:0/3593379782 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:42.036 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.034+0000 7f9bae561640 1 --2- 172.21.15.148:0/3593379782 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a559341cb0 0x55a5593319a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:42.036 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.034+0000 7f9bad55f640 1 --2- 172.21.15.148:0/3593379782 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a559337410 0x55a559362190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:42.036 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.034+0000 7f9bae561640 1 -- 172.21.15.148:0/3593379782 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a559341cb0 msgr2=0x55a5593319a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:42.036 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.034+0000 7f9bae561640 1 --2- 172.21.15.148:0/3593379782 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a559341cb0 0x55a5593319a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:42.036 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.034+0000 7f9bae561640 1 -- 172.21.15.148:0/3593379782 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a559337410 msgr2=0x55a559362190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:42.036 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.034+0000 7f9bae561640 1 --2- 172.21.15.148:0/3593379782 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a559337410 0x55a559362190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:42.037 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.034+0000 7f9bae561640 1 -- 172.21.15.148:0/3593379782 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a559337200 con 0x55a559336af0 2024-09-19T07:13:42.037 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.034+0000 7f9bad55f640 1 --2- 172.21.15.148:0/3593379782 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a559337410 0x55a559362190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:13:42.037 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.035+0000 7f9bae561640 1 --2- 172.21.15.148:0/3593379782 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a559336af0 0x55a559361c50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9ba0031970 tx=0x7f9ba0009a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6261992861d1a0f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:42.037 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.035+0000 7f9b937fe640 1 -- 172.21.15.148:0/3593379782 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ba0051070 con 0x55a559336af0 2024-09-19T07:13:42.037 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.035+0000 7f9b937fe640 1 -- 172.21.15.148:0/3593379782 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ba0036040 con 0x55a559336af0 2024-09-19T07:13:42.037 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.035+0000 7f9b937fe640 1 -- 172.21.15.148:0/3593379782 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ba0003970 con 0x55a559336af0 2024-09-19T07:13:42.037 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.036+0000 7f9bb2e3b740 1 -- 172.21.15.148:0/3593379782 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a559336af0 msgr2=0x55a559361c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:42.037 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.036+0000 7f9bb2e3b740 1 --2- 172.21.15.148:0/3593379782 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a559336af0 0x55a559361c50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9ba0031970 tx=0x7f9ba0009a20 comp rx=0 tx=0).stop 2024-09-19T07:13:42.042 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.041+0000 7f9bb2e3b740 1 -- 172.21.15.148:0/3593379782 shutdown_connections 2024-09-19T07:13:42.042 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.041+0000 7f9bb2e3b740 1 --2- 172.21.15.148:0/3593379782 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a559341cb0 0x55a5593319a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:42.042 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.041+0000 7f9bb2e3b740 1 --2- 172.21.15.148:0/3593379782 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a559337410 0x55a559362190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:42.042 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.041+0000 7f9bb2e3b740 1 --2- 172.21.15.148:0/3593379782 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a559336af0 0x55a559361c50 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:42.043 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.041+0000 7f9bb2e3b740 1 -- 172.21.15.148:0/3593379782 >> 172.21.15.148:0/3593379782 conn(0x55a559333060 msgr2=0x55a559339e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:42.043 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.042+0000 7f9bb2e3b740 1 -- 172.21.15.148:0/3593379782 shutdown_connections 2024-09-19T07:13:42.043 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.042+0000 7f9bb2e3b740 1 -- 172.21.15.148:0/3593379782 wait complete. 2024-09-19T07:13:42.043 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.042+0000 7f9bb2e3b740 1 -- start start 2024-09-19T07:13:42.043 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.042+0000 7f9bb2e3b740 1 Processor -- start 2024-09-19T07:13:42.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.043+0000 7f9bb2e3b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a559336af0 0x55a559352a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:42.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.043+0000 7f9bb2e3b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a559337410 0x55a55934dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:42.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.043+0000 7f9bb2e3b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a559341cb0 0x55a55934e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:42.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.043+0000 7f9bb2e3b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba81a9ce0 con 0x55a559337410 2024-09-19T07:13:42.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.043+0000 7f9bb2e3b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba81ab150 con 0x55a559336af0 2024-09-19T07:13:42.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.043+0000 7f9bb2e3b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba81aa3b0 con 0x55a559341cb0 2024-09-19T07:13:42.045 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.043+0000 7f9bb2e3b740 10 client.0 _ll_register_callbacks cb 0x7f9ba0046070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:13:42.045 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.043+0000 7f9bad55f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a559337410 0x55a55934dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:42.045 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.044+0000 7f9bae561640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a559341cb0 0x55a55934e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:42.045 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.044+0000 7f9bae561640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a559336af0 0x55a559352a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:42.045 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.044+0000 7f9bae561640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a559341cb0 0x55a55934e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:41440/0 (socket says 172.21.15.148:41440) 2024-09-19T07:13:42.045 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.044+0000 7f9bae561640 1 -- 172.21.15.148:0/110411974 learned_addr learned my addr 172.21.15.148:0/110411974 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:42.045 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.044+0000 7f9bad55f640 1 -- 172.21.15.148:0/110411974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a559341cb0 msgr2=0x55a55934e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:42.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.044+0000 7f9bad55f640 1 --2- 172.21.15.148:0/110411974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a559341cb0 0x55a55934e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:42.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.045+0000 7f9bad55f640 1 -- 172.21.15.148:0/110411974 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a559336af0 msgr2=0x55a559352a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:42.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.045+0000 7f9bad55f640 1 --2- 172.21.15.148:0/110411974 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a559336af0 0x55a559352a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:42.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.045+0000 7f9bad55f640 1 -- 172.21.15.148:0/110411974 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a55934e840 con 0x55a559337410 2024-09-19T07:13:42.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.045+0000 7f9bad55f640 1 --2- 172.21.15.148:0/110411974 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a559337410 0x55a55934dd40 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x55a55933e400 tx=0x7f9b98010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee84c64be3ddfcc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:42.062 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.062+0000 7f9b917fa640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:13:42.062 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.062+0000 7f9b917fa640 1 -- 172.21.15.148:0/110411974 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b98004250 con 0x55a559337410 2024-09-19T07:13:42.063 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.062+0000 7f9bb2e3b740 1 -- 172.21.15.148:0/110411974 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ba0036040 con 0x55a559337410 2024-09-19T07:13:42.063 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.063+0000 7f9b917fa640 1 -- 172.21.15.148:0/110411974 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f9b980043f0 con 0x55a559337410 2024-09-19T07:13:42.063 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.063+0000 7f9b917fa640 1 -- 172.21.15.148:0/110411974 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9b9802a050 con 0x55a559337410 2024-09-19T07:13:42.064 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.063+0000 7f9bb2e3b740 10 client.16149 fetch_fsmap learned FSMap version 27 2024-09-19T07:13:42.064 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.063+0000 7f9bb2e3b740 1 -- 172.21.15.148:0/110411974 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a559345a60 con 0x55a559337410 2024-09-19T07:13:42.064 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.064+0000 7f9b917fa640 1 -- 172.21.15.148:0/110411974 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ba0036040 con 0x55a559337410 2024-09-19T07:13:42.065 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.064+0000 7f9b917fa640 1 -- 172.21.15.148:0/110411974 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f9b98025030 con 0x55a559337410 2024-09-19T07:13:42.065 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.064+0000 7f9bb2e3b740 10 client.16149 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T07:13:42.065 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.064+0000 7f9bb2e3b740 10 client.16149 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:13:42.065 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.064+0000 7f9bb2e3b740 20 client.16149 populate_metadata read hostname 'smithi148' 2024-09-19T07:13:42.065 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.064+0000 7f9bb2e3b740 1 --2- 172.21.15.148:0/110411974 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55a559346270 0x55a559348690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:42.065 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.064+0000 7f9bb2e3b740 4 client.16149 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:13:42.065 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.064+0000 7f9bb2e3b740 1 -- 172.21.15.148:0/110411974 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a5592a2d70 con 0x55a559346270 2024-09-19T07:13:42.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.064+0000 7f9bae561640 1 --2- 172.21.15.148:0/110411974 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55a559346270 0x55a559348690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:42.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.065+0000 7f9b917fa640 10 client.16149 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:13:42.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:42.065+0000 7f9bae561640 1 --2- 172.21.15.148:0/110411974 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55a559346270 0x55a559348690 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=324a7549238af8fc server_cookie=f295c9db459b76eb in_seq=0 out_seq=0 2024-09-19T07:13:43.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:42 smithi179 ceph-mon[35716]: pgmap v82: 97 pgs: 97 active+clean; 93 MiB data, 603 MiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 5.1 MiB/s wr, 253 op/s 2024-09-19T07:13:43.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:42 smithi148 ceph-mon[31180]: pgmap v82: 97 pgs: 97 active+clean; 93 MiB data, 603 MiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 5.1 MiB/s wr, 253 op/s 2024-09-19T07:13:43.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:42 smithi165 ceph-mon[35326]: pgmap v82: 97 pgs: 97 active+clean; 93 MiB data, 603 MiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 5.1 MiB/s wr, 253 op/s 2024-09-19T07:13:43.193 INFO:tasks.workunit.client.0.smithi148.stdout: 44 393711 605 247492 584 117616 1160 2024-09-19T07:13:43.276 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:43.274+0000 7f9b917fa640 1 -- 172.21.15.148:0/110411974 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a5592a2d70 con 0x55a559346270 2024-09-19T07:13:43.276 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:43.274+0000 7f9b917fa640 10 client.16149 handle_command_reply: tid=0 2024-09-19T07:13:43.276 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:43.274+0000 7f9bb2e3b740 1 client.16149 shutdown 2024-09-19T07:13:43.276 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:43.275+0000 7f9bb2e3b740 1 -- 172.21.15.148:0/110411974 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a559337410 msgr2=0x55a55934dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:43.276 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:43.275+0000 7f9bb2e3b740 1 --2- 172.21.15.148:0/110411974 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a559337410 0x55a55934dd40 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x55a55933e400 tx=0x7f9b98010800 comp rx=0 tx=0).stop 2024-09-19T07:13:43.276 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:43.275+0000 7f9bb2e3b740 1 -- 172.21.15.148:0/110411974 shutdown_connections 2024-09-19T07:13:43.276 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:43.275+0000 7f9bb2e3b740 1 --2- 172.21.15.148:0/110411974 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55a559346270 0x55a559348690 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:43.277 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:43.275+0000 7f9bb2e3b740 1 --2- 172.21.15.148:0/110411974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a559341cb0 0x55a55934e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:43.277 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:43.275+0000 7f9bb2e3b740 1 --2- 172.21.15.148:0/110411974 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a559337410 0x55a55934dd40 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:43.277 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:43.275+0000 7f9b917fa640 0 client.16149 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:13:43.277 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:43.275+0000 7f9bb2e3b740 1 --2- 172.21.15.148:0/110411974 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a559336af0 0x55a559352a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:43.277 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:43.275+0000 7f9bb2e3b740 1 -- 172.21.15.148:0/110411974 >> 172.21.15.148:0/110411974 conn(0x55a559333060 msgr2=0x55a5593319a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:43.277 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:43.275+0000 7f9bb2e3b740 1 -- 172.21.15.148:0/110411974 shutdown_connections 2024-09-19T07:13:43.277 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:43.275+0000 7f9bb2e3b740 1 -- 172.21.15.148:0/110411974 wait complete. 2024-09-19T07:13:43.277 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:43.275+0000 7f9bb2e3b740 20 client.16149 trim_cache size 0 max 16384 2024-09-19T07:13:43.277 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:13:43.278 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:13:43.278 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:13:43.278 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:13:43.278 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:43.276+0000 7f9baffc4640 1 -- 172.21.15.148:0/593977098 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f9b940a3460 msgr2=0x7f9b940a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:43.278 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:43.276+0000 7f9baffc4640 1 --2- 172.21.15.148:0/593977098 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f9b940a3460 0x7f9b940a5920 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4004be0 tx=0x7f9ba40d3b10 comp rx=0 tx=0).stop 2024-09-19T07:13:43.278 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:43.276+0000 7f9baffc4640 1 -- 172.21.15.148:0/593977098 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ba81009b0 msgr2=0x7f9ba8198340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:43.279 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:43.276+0000 7f9baffc4640 1 --2- 172.21.15.148:0/593977098 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ba81009b0 0x7f9ba8198340 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9ba400ea20 tx=0x7f9ba400ee20 comp rx=0 tx=0).stop 2024-09-19T07:13:43.279 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:43.276+0000 7f9baffc4640 1 -- 172.21.15.148:0/593977098 shutdown_connections 2024-09-19T07:13:43.279 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:43.276+0000 7f9baffc4640 1 --2- 172.21.15.148:0/593977098 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f9b940a3460 0x7f9b940a5920 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:43.279 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:43.276+0000 7f9baffc4640 1 --2- 172.21.15.148:0/593977098 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ba81069c0 0x7f9ba819cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:43.279 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:43.276+0000 7f9baffc4640 1 --2- 172.21.15.148:0/593977098 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ba8101350 0x7f9ba8198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:43.279 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:43.276+0000 7f9baffc4640 1 --2- 172.21.15.148:0/593977098 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ba81009b0 0x7f9ba8198340 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:43.279 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:43.276+0000 7f9baffc4640 1 -- 172.21.15.148:0/593977098 >> 172.21.15.148:0/593977098 conn(0x7f9ba8077990 msgr2=0x7f9ba8069a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:43.279 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:43.276+0000 7f9baffc4640 1 -- 172.21.15.148:0/593977098 shutdown_connections 2024-09-19T07:13:43.279 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:43.276+0000 7f9baffc4640 1 -- 172.21.15.148:0/593977098 wait complete. 2024-09-19T07:13:43.413 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T07:13:43.414 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T07:13:43.675 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:13:44.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.189+0000 7f9a83614640 1 -- 172.21.15.148:0/1015585365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a7c103740 msgr2=0x7f9a7c107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:44.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.189+0000 7f9a83614640 1 --2- 172.21.15.148:0/1015585365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a7c103740 0x7f9a7c107b80 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c009930 tx=0x7f9a6c02a420 comp rx=0 tx=0).stop 2024-09-19T07:13:44.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.189+0000 7f9a83614640 1 -- 172.21.15.148:0/1015585365 shutdown_connections 2024-09-19T07:13:44.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.189+0000 7f9a83614640 1 --2- 172.21.15.148:0/1015585365 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9a7c108290 0x7f9a7c10ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:44.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.189+0000 7f9a83614640 1 --2- 172.21.15.148:0/1015585365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a7c103740 0x7f9a7c107b80 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:44.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.189+0000 7f9a83614640 1 --2- 172.21.15.148:0/1015585365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a7c102d90 0x7f9a7c103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:44.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.189+0000 7f9a83614640 1 -- 172.21.15.148:0/1015585365 >> 172.21.15.148:0/1015585365 conn(0x7f9a7c0fc7d0 msgr2=0x7f9a7c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:44.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.189+0000 7f9a83614640 1 -- 172.21.15.148:0/1015585365 shutdown_connections 2024-09-19T07:13:44.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.189+0000 7f9a83614640 1 -- 172.21.15.148:0/1015585365 wait complete. 2024-09-19T07:13:44.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.189+0000 7f9a83614640 1 Processor -- start 2024-09-19T07:13:44.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.190+0000 7f9a83614640 1 -- start start 2024-09-19T07:13:44.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.190+0000 7f9a83614640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9a7c102d90 0x7f9a7c198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:44.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.190+0000 7f9a83614640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a7c103740 0x7f9a7c198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:44.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.190+0000 7f9a83614640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a7c108290 0x7f9a7c19cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:44.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.190+0000 7f9a83614640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7c112090 con 0x7f9a7c103740 2024-09-19T07:13:44.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.190+0000 7f9a83614640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7c111f10 con 0x7f9a7c102d90 2024-09-19T07:13:44.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.190+0000 7f9a83614640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7c112210 con 0x7f9a7c108290 2024-09-19T07:13:44.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.190+0000 7f9a813b0640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9a7c102d90 0x7f9a7c198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:44.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.190+0000 7f9a813b0640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9a7c102d90 0x7f9a7c198610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:43766/0 (socket says 172.21.15.148:43766) 2024-09-19T07:13:44.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.190+0000 7f9a813b0640 1 -- 172.21.15.148:0/3587520596 learned_addr learned my addr 172.21.15.148:0/3587520596 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:44.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.190+0000 7f9a80baf640 1 --2- 172.21.15.148:0/3587520596 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a7c103740 0x7f9a7c198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:44.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.190+0000 7f9a81bb1640 1 --2- 172.21.15.148:0/3587520596 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a7c108290 0x7f9a7c19cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:44.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.191+0000 7f9a80baf640 1 -- 172.21.15.148:0/3587520596 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a7c108290 msgr2=0x7f9a7c19cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:44.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.191+0000 7f9a80baf640 1 --2- 172.21.15.148:0/3587520596 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a7c108290 0x7f9a7c19cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:44.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.191+0000 7f9a80baf640 1 -- 172.21.15.148:0/3587520596 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9a7c102d90 msgr2=0x7f9a7c198610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:44.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.191+0000 7f9a80baf640 1 --2- 172.21.15.148:0/3587520596 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9a7c102d90 0x7f9a7c198610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:44.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.191+0000 7f9a80baf640 1 -- 172.21.15.148:0/3587520596 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a7c19d5c0 con 0x7f9a7c103740 2024-09-19T07:13:44.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.191+0000 7f9a813b0640 1 --2- 172.21.15.148:0/3587520596 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9a7c102d90 0x7f9a7c198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:13:44.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.191+0000 7f9a81bb1640 1 --2- 172.21.15.148:0/3587520596 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a7c108290 0x7f9a7c19cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:13:44.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.191+0000 7f9a80baf640 1 --2- 172.21.15.148:0/3587520596 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a7c103740 0x7f9a7c198b50 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c009230 tx=0x7f9a6c0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:44.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.191+0000 7f9a727fc640 1 -- 172.21.15.148:0/3587520596 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c03f070 con 0x7f9a7c103740 2024-09-19T07:13:44.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.191+0000 7f9a83614640 1 -- 172.21.15.148:0/3587520596 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a7c19d850 con 0x7f9a7c103740 2024-09-19T07:13:44.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.191+0000 7f9a727fc640 1 -- 172.21.15.148:0/3587520596 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a6c0044c0 con 0x7f9a7c103740 2024-09-19T07:13:44.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.191+0000 7f9a727fc640 1 -- 172.21.15.148:0/3587520596 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c035070 con 0x7f9a7c103740 2024-09-19T07:13:44.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.191+0000 7f9a83614640 1 -- 172.21.15.148:0/3587520596 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a7c1a5190 con 0x7f9a7c103740 2024-09-19T07:13:44.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.193+0000 7f9a727fc640 1 -- 172.21.15.148:0/3587520596 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f9a6c03b460 con 0x7f9a7c103740 2024-09-19T07:13:44.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.194+0000 7f9a859ed740 1 Processor -- start 2024-09-19T07:13:44.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.194+0000 7f9a859ed740 1 -- start start 2024-09-19T07:13:44.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.194+0000 7f9a727fc640 1 --2- 172.21.15.148:0/3587520596 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f9a680a33b0 0x7f9a680a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:44.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.194+0000 7f9a859ed740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5653b578ff70 0x5653b5790350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:44.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.194+0000 7f9a859ed740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5653b5790890 0x5653b579ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:44.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.194+0000 7f9a859ed740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5653b579b150 0x5653b579d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:44.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.194+0000 7f9a859ed740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5653b56f1280 con 0x5653b579b150 2024-09-19T07:13:44.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.194+0000 7f9a859ed740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5653b5698b10 con 0x5653b578ff70 2024-09-19T07:13:44.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.194+0000 7f9a859ed740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5653b56ed240 con 0x5653b5790890 2024-09-19T07:13:44.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.195+0000 7f9a727fc640 1 -- 172.21.15.148:0/3587520596 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f9a6c0f0250 con 0x7f9a7c103740 2024-09-19T07:13:44.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.195+0000 7f9a81bb1640 1 --2- 172.21.15.148:0/3587520596 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f9a680a33b0 0x7f9a680a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:44.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.195+0000 7f9a813b0640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5653b578ff70 0x5653b5790350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:44.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.195+0000 7f9a813b0640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5653b578ff70 0x5653b5790350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:43772/0 (socket says 172.21.15.148:43772) 2024-09-19T07:13:44.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.195+0000 7f9a80baf640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5653b5790890 0x5653b579ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:44.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.195+0000 7f9a813b0640 1 -- 172.21.15.148:0/3053966581 learned_addr learned my addr 172.21.15.148:0/3053966581 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:44.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.195+0000 7f9a81bb1640 1 --2- 172.21.15.148:0/3053966581 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5653b579b150 0x5653b579d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:44.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.195+0000 7f9a80baf640 1 -- 172.21.15.148:0/3053966581 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5653b578ff70 msgr2=0x5653b5790350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:44.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.195+0000 7f9a80baf640 1 --2- 172.21.15.148:0/3053966581 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5653b578ff70 0x5653b5790350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:44.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.195+0000 7f9a80baf640 1 -- 172.21.15.148:0/3053966581 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5653b579b150 msgr2=0x5653b579d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:44.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.195+0000 7f9a80baf640 1 --2- 172.21.15.148:0/3053966581 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5653b579b150 0x5653b579d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:44.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.195+0000 7f9a80baf640 1 -- 172.21.15.148:0/3053966581 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653b56a51f0 con 0x5653b5790890 2024-09-19T07:13:44.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.195+0000 7f9a81bb1640 1 --2- 172.21.15.148:0/3053966581 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5653b579b150 0x5653b579d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:13:44.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.195+0000 7f9a813b0640 1 --2- 172.21.15.148:0/3053966581 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5653b578ff70 0x5653b5790350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:13:44.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.195+0000 7f9a80baf640 1 --2- 172.21.15.148:0/3053966581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5653b5790890 0x5653b579ac10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c0ed9b0 tx=0x7f9a6c0bbea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=841c0de10b387918 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:44.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.195+0000 7f9a81bb1640 1 --2- 172.21.15.148:0/3587520596 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f9a680a33b0 0x7f9a680a5870 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x5653b578d880 tx=0x7f9a74009570 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:44.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.195+0000 7f9a677fe640 1 -- 172.21.15.148:0/3053966581 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c048070 con 0x5653b5790890 2024-09-19T07:13:44.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.196+0000 7f9a677fe640 1 -- 172.21.15.148:0/3053966581 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a6c0dc040 con 0x5653b5790890 2024-09-19T07:13:44.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.196+0000 7f9a677fe640 1 -- 172.21.15.148:0/3053966581 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c085870 con 0x5653b5790890 2024-09-19T07:13:44.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.196+0000 7f9a859ed740 1 -- 172.21.15.148:0/3053966581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5653b5790890 msgr2=0x5653b579ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:44.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.196+0000 7f9a859ed740 1 --2- 172.21.15.148:0/3053966581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5653b5790890 0x5653b579ac10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c0ed9b0 tx=0x7f9a6c0bbea0 comp rx=0 tx=0).stop 2024-09-19T07:13:44.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.196+0000 7f9a859ed740 1 -- 172.21.15.148:0/3053966581 shutdown_connections 2024-09-19T07:13:44.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.196+0000 7f9a859ed740 1 --2- 172.21.15.148:0/3053966581 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5653b579b150 0x5653b579d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:44.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.196+0000 7f9a859ed740 1 --2- 172.21.15.148:0/3053966581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5653b5790890 0x5653b579ac10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:44.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.196+0000 7f9a859ed740 1 --2- 172.21.15.148:0/3053966581 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5653b578ff70 0x5653b5790350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:44.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.196+0000 7f9a859ed740 1 -- 172.21.15.148:0/3053966581 >> 172.21.15.148:0/3053966581 conn(0x5653b578c500 msgr2=0x5653b578c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:44.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.196+0000 7f9a859ed740 1 -- 172.21.15.148:0/3053966581 shutdown_connections 2024-09-19T07:13:44.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.196+0000 7f9a859ed740 1 -- 172.21.15.148:0/3053966581 wait complete. 2024-09-19T07:13:44.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.197+0000 7f9a859ed740 1 -- start start 2024-09-19T07:13:44.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.197+0000 7f9a859ed740 1 Processor -- start 2024-09-19T07:13:44.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.197+0000 7f9a859ed740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5653b578ff70 0x5653b57940a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:44.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.197+0000 7f9a859ed740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5653b5790890 0x5653b57945e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:44.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.197+0000 7f9a859ed740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5653b579b150 0x5653b5794b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:44.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.197+0000 7f9a859ed740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5653b5787ac0 con 0x5653b5790890 2024-09-19T07:13:44.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.197+0000 7f9a859ed740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5653b56abf10 con 0x5653b578ff70 2024-09-19T07:13:44.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.197+0000 7f9a859ed740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5653b5787c40 con 0x5653b579b150 2024-09-19T07:13:44.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.197+0000 7f9a859ed740 10 client.0 _ll_register_callbacks cb 0x5653b5674a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:13:44.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.197+0000 7f9a813b0640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5653b578ff70 0x5653b57940a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:44.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.197+0000 7f9a80baf640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5653b5790890 0x5653b57945e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:44.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.197+0000 7f9a813b0640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5653b578ff70 0x5653b57940a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:43782/0 (socket says 172.21.15.148:43782) 2024-09-19T07:13:44.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.197+0000 7f9a813b0640 1 -- 172.21.15.148:0/209831705 learned_addr learned my addr 172.21.15.148:0/209831705 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:44.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.197+0000 7f9a81bb1640 1 --2- 172.21.15.148:0/209831705 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5653b579b150 0x5653b5794b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:44.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.198+0000 7f9a813b0640 1 -- 172.21.15.148:0/209831705 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5653b579b150 msgr2=0x5653b5794b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:44.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.198+0000 7f9a813b0640 1 --2- 172.21.15.148:0/209831705 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5653b579b150 0x5653b5794b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:44.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.198+0000 7f9a813b0640 1 -- 172.21.15.148:0/209831705 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5653b5790890 msgr2=0x5653b57945e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:44.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.198+0000 7f9a813b0640 1 --2- 172.21.15.148:0/209831705 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5653b5790890 0x5653b57945e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:44.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.198+0000 7f9a813b0640 1 -- 172.21.15.148:0/209831705 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653b54626a0 con 0x5653b578ff70 2024-09-19T07:13:44.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.198+0000 7f9a813b0640 1 --2- 172.21.15.148:0/209831705 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5653b578ff70 0x5653b57940a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9a7800fc60 tx=0x7f9a7800e780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ed2527ee9042d29 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:44.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.199+0000 7f9a64ff9640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-19T07:13:44.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.199+0000 7f9a64ff9640 1 -- 172.21.15.148:0/209831705 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a78029060 con 0x5653b578ff70 2024-09-19T07:13:44.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.199+0000 7f9a64ff9640 1 -- 172.21.15.148:0/209831705 <== mon.2 v2:172.21.15.165:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f9a78024650 con 0x5653b578ff70 2024-09-19T07:13:44.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.199+0000 7f9a859ed740 1 -- 172.21.15.148:0/209831705 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a6c0dc040 con 0x5653b578ff70 2024-09-19T07:13:44.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.200+0000 7f9a64ff9640 1 -- 172.21.15.148:0/209831705 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9a78020070 con 0x5653b578ff70 2024-09-19T07:13:44.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.200+0000 7f9a859ed740 10 client.25514 fetch_fsmap learned FSMap version 27 2024-09-19T07:13:44.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.201+0000 7f9a859ed740 1 -- 172.21.15.148:0/209831705 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5653b57a5350 con 0x5653b578ff70 2024-09-19T07:13:44.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.201+0000 7f9a64ff9640 1 -- 172.21.15.148:0/209831705 <== mon.2 v2:172.21.15.165:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a6c0dc040 con 0x5653b578ff70 2024-09-19T07:13:44.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.201+0000 7f9a64ff9640 1 -- 172.21.15.148:0/209831705 <== mon.2 v2:172.21.15.165:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f9a78023880 con 0x5653b578ff70 2024-09-19T07:13:44.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.201+0000 7f9a859ed740 10 client.25514 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T07:13:44.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.201+0000 7f9a859ed740 10 client.25514 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:13:44.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.201+0000 7f9a859ed740 20 client.25514 populate_metadata read hostname 'smithi148' 2024-09-19T07:13:44.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.201+0000 7f9a859ed740 1 --2- 172.21.15.148:0/209831705 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5653b57a6760 0x5653b57a8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:44.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.201+0000 7f9a859ed740 4 client.25514 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:13:44.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.201+0000 7f9a859ed740 1 -- 172.21.15.148:0/209831705 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5653b56fe7f0 con 0x5653b57a6760 2024-09-19T07:13:44.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.202+0000 7f9a80baf640 1 --2- 172.21.15.148:0/209831705 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5653b57a6760 0x5653b57a8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:44.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.206+0000 7f9a80baf640 1 --2- 172.21.15.148:0/209831705 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5653b57a6760 0x5653b57a8bb0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=807a5acbbfd7340 server_cookie=2bbebcdd3fc85f0d in_seq=0 out_seq=0 2024-09-19T07:13:44.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.206+0000 7f9a64ff9640 10 client.25514 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:13:44.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.211+0000 7f9a64ff9640 1 -- 172.21.15.148:0/209831705 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5653b56fe7f0 con 0x5653b57a6760 2024-09-19T07:13:44.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.211+0000 7f9a64ff9640 10 client.25514 handle_command_reply: tid=0 2024-09-19T07:13:44.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.211+0000 7f9a859ed740 1 client.25514 shutdown 2024-09-19T07:13:44.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.214+0000 7f9a859ed740 1 -- 172.21.15.148:0/209831705 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5653b578ff70 msgr2=0x5653b57940a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:44.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.214+0000 7f9a859ed740 1 --2- 172.21.15.148:0/209831705 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5653b578ff70 0x5653b57940a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9a7800fc60 tx=0x7f9a7800e780 comp rx=0 tx=0).stop 2024-09-19T07:13:44.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.215+0000 7f9a859ed740 1 -- 172.21.15.148:0/209831705 shutdown_connections 2024-09-19T07:13:44.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.215+0000 7f9a859ed740 1 --2- 172.21.15.148:0/209831705 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5653b57a6760 0x5653b57a8bb0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:44.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.215+0000 7f9a859ed740 1 --2- 172.21.15.148:0/209831705 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5653b579b150 0x5653b5794b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:44.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.215+0000 7f9a859ed740 1 --2- 172.21.15.148:0/209831705 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5653b5790890 0x5653b57945e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:44.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.215+0000 7f9a859ed740 1 --2- 172.21.15.148:0/209831705 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5653b578ff70 0x5653b57940a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:44.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.215+0000 7f9a859ed740 1 -- 172.21.15.148:0/209831705 >> 172.21.15.148:0/209831705 conn(0x5653b578c500 msgr2=0x5653b5787270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:44.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.215+0000 7f9a64ff9640 0 client.25514 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:13:44.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.215+0000 7f9a859ed740 1 -- 172.21.15.148:0/209831705 shutdown_connections 2024-09-19T07:13:44.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.215+0000 7f9a859ed740 1 -- 172.21.15.148:0/209831705 wait complete. 2024-09-19T07:13:44.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.215+0000 7f9a859ed740 20 client.25514 trim_cache size 0 max 16384 2024-09-19T07:13:44.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.253+0000 7f9a859ed740 1 Processor -- start 2024-09-19T07:13:44.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.253+0000 7f9a859ed740 1 -- start start 2024-09-19T07:13:44.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.254+0000 7f9a859ed740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5653b578ff70 0x5653b5787270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:44.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.254+0000 7f9a859ed740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5653b5790890 0x5653b5794970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:44.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.254+0000 7f9a859ed740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5653b579b150 0x5653b57ae480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:44.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.254+0000 7f9a859ed740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7c1ae010 con 0x5653b5790890 2024-09-19T07:13:44.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.254+0000 7f9a859ed740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7c1ab8e0 con 0x5653b578ff70 2024-09-19T07:13:44.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.254+0000 7f9a859ed740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7c1a9750 con 0x5653b579b150 2024-09-19T07:13:44.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.254+0000 7f9a81bb1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5653b579b150 0x5653b57ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:44.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.254+0000 7f9a80baf640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5653b5790890 0x5653b5794970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:44.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.254+0000 7f9a80baf640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5653b5790890 0x5653b5794970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53998/0 (socket says 172.21.15.148:53998) 2024-09-19T07:13:44.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.254+0000 7f9a80baf640 1 -- 172.21.15.148:0/2663715053 learned_addr learned my addr 172.21.15.148:0/2663715053 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:44.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.254+0000 7f9a813b0640 1 --2- 172.21.15.148:0/2663715053 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5653b578ff70 0x5653b5787270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:44.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.255+0000 7f9a81bb1640 1 -- 172.21.15.148:0/2663715053 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5653b578ff70 msgr2=0x5653b5787270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:44.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.255+0000 7f9a81bb1640 1 --2- 172.21.15.148:0/2663715053 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5653b578ff70 0x5653b5787270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:44.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.255+0000 7f9a81bb1640 1 -- 172.21.15.148:0/2663715053 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5653b5790890 msgr2=0x5653b5794970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:44.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.255+0000 7f9a81bb1640 1 --2- 172.21.15.148:0/2663715053 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5653b5790890 0x5653b5794970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:44.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.255+0000 7f9a81bb1640 1 -- 172.21.15.148:0/2663715053 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653b57906c0 con 0x5653b579b150 2024-09-19T07:13:44.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.256+0000 7f9a81bb1640 1 --2- 172.21.15.148:0/2663715053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5653b579b150 0x5653b57ae480 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9a74009370 tx=0x7f9a74009240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db3a0d7b13b18990 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:44.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.256+0000 7f9a66ffd640 1 -- 172.21.15.148:0/2663715053 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a7400fe60 con 0x5653b579b150 2024-09-19T07:13:44.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.256+0000 7f9a66ffd640 1 -- 172.21.15.148:0/2663715053 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a740140f0 con 0x5653b579b150 2024-09-19T07:13:44.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.256+0000 7f9a66ffd640 1 -- 172.21.15.148:0/2663715053 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a74005380 con 0x5653b579b150 2024-09-19T07:13:44.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.257+0000 7f9a859ed740 1 -- 172.21.15.148:0/2663715053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5653b579b150 msgr2=0x5653b57ae480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:44.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.257+0000 7f9a859ed740 1 --2- 172.21.15.148:0/2663715053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5653b579b150 0x5653b57ae480 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9a74009370 tx=0x7f9a74009240 comp rx=0 tx=0).stop 2024-09-19T07:13:44.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.257+0000 7f9a859ed740 1 -- 172.21.15.148:0/2663715053 shutdown_connections 2024-09-19T07:13:44.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.257+0000 7f9a859ed740 1 --2- 172.21.15.148:0/2663715053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5653b579b150 0x5653b57ae480 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:44.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.257+0000 7f9a859ed740 1 --2- 172.21.15.148:0/2663715053 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5653b5790890 0x5653b5794970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:44.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.257+0000 7f9a859ed740 1 --2- 172.21.15.148:0/2663715053 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5653b578ff70 0x5653b5787270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:44.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.257+0000 7f9a859ed740 1 -- 172.21.15.148:0/2663715053 >> 172.21.15.148:0/2663715053 conn(0x5653b578c500 msgr2=0x5653b5793220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:44.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.258+0000 7f9a859ed740 1 -- 172.21.15.148:0/2663715053 shutdown_connections 2024-09-19T07:13:44.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.258+0000 7f9a859ed740 1 -- 172.21.15.148:0/2663715053 wait complete. 2024-09-19T07:13:44.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.259+0000 7f9a859ed740 1 -- start start 2024-09-19T07:13:44.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.259+0000 7f9a859ed740 1 Processor -- start 2024-09-19T07:13:44.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.260+0000 7f9a859ed740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5653b578ff70 0x5653b57a34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:44.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.260+0000 7f9a859ed740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5653b5790890 0x5653b579e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:44.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.260+0000 7f9a859ed740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5653b579b150 0x5653b579ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:44.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.260+0000 7f9a859ed740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7c1a9da0 con 0x5653b5790890 2024-09-19T07:13:44.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.260+0000 7f9a859ed740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7c1ab210 con 0x5653b578ff70 2024-09-19T07:13:44.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.260+0000 7f9a859ed740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7c1aa470 con 0x5653b579b150 2024-09-19T07:13:44.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.260+0000 7f9a859ed740 10 client.0 _ll_register_callbacks cb 0x7f9a78009da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:13:44.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.260+0000 7f9a81bb1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5653b579b150 0x5653b579ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:44.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.260+0000 7f9a81bb1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5653b579b150 0x5653b579ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:48638/0 (socket says 172.21.15.148:48638) 2024-09-19T07:13:44.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.260+0000 7f9a81bb1640 1 -- 172.21.15.148:0/3320367206 learned_addr learned my addr 172.21.15.148:0/3320367206 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:44.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.260+0000 7f9a813b0640 1 --2- 172.21.15.148:0/3320367206 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5653b578ff70 0x5653b57a34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:44.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.261+0000 7f9a80baf640 1 --2- 172.21.15.148:0/3320367206 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5653b5790890 0x5653b579e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:44.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.261+0000 7f9a81bb1640 1 -- 172.21.15.148:0/3320367206 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5653b578ff70 msgr2=0x5653b57a34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:44.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.261+0000 7f9a81bb1640 1 --2- 172.21.15.148:0/3320367206 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5653b578ff70 0x5653b57a34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:44.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.261+0000 7f9a81bb1640 1 -- 172.21.15.148:0/3320367206 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5653b5790890 msgr2=0x5653b579e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:44.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.261+0000 7f9a81bb1640 1 --2- 172.21.15.148:0/3320367206 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5653b5790890 0x5653b579e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:44.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.261+0000 7f9a81bb1640 1 -- 172.21.15.148:0/3320367206 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653b579f600 con 0x5653b579b150 2024-09-19T07:13:44.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.261+0000 7f9a80baf640 1 --2- 172.21.15.148:0/3320367206 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5653b5790890 0x5653b579e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:13:44.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.262+0000 7f9a81bb1640 1 --2- 172.21.15.148:0/3320367206 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5653b579b150 0x5653b579ee00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9a74004c50 tx=0x7f9a74004c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4766f3f25298a9ca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:44.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.262+0000 7f9a64ff9640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-19T07:13:44.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.265+0000 7f9a64ff9640 1 -- 172.21.15.148:0/3320367206 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a74036020 con 0x5653b579b150 2024-09-19T07:13:44.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.265+0000 7f9a859ed740 1 -- 172.21.15.148:0/3320367206 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a740140f0 con 0x5653b579b150 2024-09-19T07:13:44.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.266+0000 7f9a64ff9640 1 -- 172.21.15.148:0/3320367206 <== mon.1 v2:172.21.15.179:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f9a74005250 con 0x5653b579b150 2024-09-19T07:13:44.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.266+0000 7f9a64ff9640 1 -- 172.21.15.148:0/3320367206 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9a74041050 con 0x5653b579b150 2024-09-19T07:13:44.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.266+0000 7f9a859ed740 10 client.25582 fetch_fsmap learned FSMap version 27 2024-09-19T07:13:44.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.266+0000 7f9a859ed740 1 -- 172.21.15.148:0/3320367206 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5653b5811570 con 0x5653b579b150 2024-09-19T07:13:44.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.267+0000 7f9a64ff9640 1 -- 172.21.15.148:0/3320367206 <== mon.1 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a740140f0 con 0x5653b579b150 2024-09-19T07:13:44.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.268+0000 7f9a64ff9640 1 -- 172.21.15.148:0/3320367206 <== mon.1 v2:172.21.15.179:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f9a7401f450 con 0x5653b579b150 2024-09-19T07:13:44.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.268+0000 7f9a859ed740 10 client.25582 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T07:13:44.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.268+0000 7f9a859ed740 10 client.25582 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:13:44.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.268+0000 7f9a859ed740 20 client.25582 populate_metadata read hostname 'smithi148' 2024-09-19T07:13:44.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.268+0000 7f9a859ed740 1 --2- 172.21.15.148:0/3320367206 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5653b5811cc0 0x5653b58140e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:44.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.268+0000 7f9a859ed740 4 client.25582 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T07:13:44.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.268+0000 7f9a859ed740 1 -- 172.21.15.148:0/3320367206 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5653b57a8f40 con 0x5653b5811cc0 2024-09-19T07:13:44.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.268+0000 7f9a813b0640 1 --2- 172.21.15.148:0/3320367206 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5653b5811cc0 0x5653b58140e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:44.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.269+0000 7f9a813b0640 1 --2- 172.21.15.148:0/3320367206 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5653b5811cc0 0x5653b58140e0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ada8966f77cc027 server_cookie=df531392110b156a in_seq=0 out_seq=0 2024-09-19T07:13:44.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.269+0000 7f9a64ff9640 10 client.25582 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:13:44.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.273+0000 7f9a64ff9640 1 -- 172.21.15.148:0/3320367206 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5653b57a8f40 con 0x5653b5811cc0 2024-09-19T07:13:44.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.273+0000 7f9a64ff9640 10 client.25582 handle_command_reply: tid=0 2024-09-19T07:13:44.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.273+0000 7f9a859ed740 1 client.25582 shutdown 2024-09-19T07:13:44.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.274+0000 7f9a859ed740 1 -- 172.21.15.148:0/3320367206 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5653b579b150 msgr2=0x5653b579ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:44.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.274+0000 7f9a859ed740 1 --2- 172.21.15.148:0/3320367206 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5653b579b150 0x5653b579ee00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9a74004c50 tx=0x7f9a74004c80 comp rx=0 tx=0).stop 2024-09-19T07:13:44.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.275+0000 7f9a859ed740 1 -- 172.21.15.148:0/3320367206 shutdown_connections 2024-09-19T07:13:44.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.275+0000 7f9a859ed740 1 --2- 172.21.15.148:0/3320367206 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5653b5811cc0 0x5653b58140e0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:44.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.275+0000 7f9a859ed740 1 --2- 172.21.15.148:0/3320367206 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5653b579b150 0x5653b579ee00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:44.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.275+0000 7f9a859ed740 1 --2- 172.21.15.148:0/3320367206 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5653b5790890 0x5653b579e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:44.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.275+0000 7f9a859ed740 1 --2- 172.21.15.148:0/3320367206 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5653b578ff70 0x5653b57a34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:44.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.275+0000 7f9a64ff9640 0 client.25582 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:13:44.305 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:13:44.305 INFO:teuthology.orchestra.run.smithi148.stdout: "return_code": 0, 2024-09-19T07:13:44.305 INFO:teuthology.orchestra.run.smithi148.stdout: "scrub_tag": "b3915a2a-00bd-4db1-af26-9326d1b8231b", 2024-09-19T07:13:44.305 INFO:teuthology.orchestra.run.smithi148.stdout: "mode": "asynchronous" 2024-09-19T07:13:44.305 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:13:44.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.275+0000 7f9a859ed740 1 -- 172.21.15.148:0/3320367206 >> 172.21.15.148:0/3320367206 conn(0x5653b578c500 msgr2=0x5653b57976d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:44.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.275+0000 7f9a859ed740 1 -- 172.21.15.148:0/3320367206 shutdown_connections 2024-09-19T07:13:44.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.275+0000 7f9a859ed740 1 -- 172.21.15.148:0/3320367206 wait complete. 2024-09-19T07:13:44.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.276+0000 7f9a859ed740 20 client.25582 trim_cache size 0 max 16384 2024-09-19T07:13:44.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.277+0000 7f9a83614640 1 -- 172.21.15.148:0/3587520596 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f9a680a33b0 msgr2=0x7f9a680a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:44.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.277+0000 7f9a83614640 1 --2- 172.21.15.148:0/3587520596 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f9a680a33b0 0x7f9a680a5870 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x5653b578d880 tx=0x7f9a74009570 comp rx=0 tx=0).stop 2024-09-19T07:13:44.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.277+0000 7f9a83614640 1 -- 172.21.15.148:0/3587520596 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a7c103740 msgr2=0x7f9a7c198b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:44.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.277+0000 7f9a83614640 1 --2- 172.21.15.148:0/3587520596 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a7c103740 0x7f9a7c198b50 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c009230 tx=0x7f9a6c0040c0 comp rx=0 tx=0).stop 2024-09-19T07:13:44.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.277+0000 7f9a83614640 1 -- 172.21.15.148:0/3587520596 shutdown_connections 2024-09-19T07:13:44.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.277+0000 7f9a83614640 1 --2- 172.21.15.148:0/3587520596 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f9a680a33b0 0x7f9a680a5870 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:44.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.277+0000 7f9a83614640 1 --2- 172.21.15.148:0/3587520596 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a7c108290 0x7f9a7c19cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:44.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.277+0000 7f9a83614640 1 --2- 172.21.15.148:0/3587520596 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a7c103740 0x7f9a7c198b50 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:44.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.277+0000 7f9a83614640 1 --2- 172.21.15.148:0/3587520596 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9a7c102d90 0x7f9a7c198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:44.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.278+0000 7f9a83614640 1 -- 172.21.15.148:0/3587520596 >> 172.21.15.148:0/3587520596 conn(0x7f9a7c0fc7d0 msgr2=0x7f9a7c105e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:44.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.278+0000 7f9a83614640 1 -- 172.21.15.148:0/3587520596 shutdown_connections 2024-09-19T07:13:44.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:44.279+0000 7f9a83614640 1 -- 172.21.15.148:0/3587520596 wait complete. 2024-09-19T07:13:44.618 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.345+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000372 [3,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/man/Makefile auth v41 ap=1 s=10056 n(v0 rc2024-09-19T07:12:55.258699+0000 b10056 1=1+0) caps={24793=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb109a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000372:[<0x10000000204/Makefile v33>,<0x10000000201/man v1994>,<0x10000000006/blogbench-1.0 v1771>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v18>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v34>,<0x10000000001/sv_1 v58>,<0x10000000000/qa v49>,<0x1/volumes v46>]//[]","memoryvalue":"(3)0x10000000372:[<0x10000000204/Makefile v41>,<0x10000000201/man v2008>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.618 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.345+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000205 [3,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/man/blogbench.8 auth v35 ap=1 s=964 n(v0 rc2005-02-11T20:16:59.000000+0000 b964 1=1+0) caps={24793=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb109ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000205:[<0x10000000204/blogbench.8 v35>,<0x10000000201/man v1994>,<0x10000000006/blogbench-1.0 v1771>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v18>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v34>,<0x10000000001/sv_1 v58>,<0x10000000000/qa v49>,<0x1/volumes v46>]//[]","memoryvalue":"(3)0x10000000205:[<0x10000000204/blogbench.8 v35>,<0x10000000201/man v2008>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.618 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.477+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000206 [3,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/man/Makefile.am auth v37 ap=1 s=55 n(v0 rc2024-09-19T07:12:48.776855+0000 b55 1=1+0) caps={24793=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb1098580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000206:[<0x10000000204/Makefile.am v37>,<0x10000000201/man v1994>,<0x10000000006/blogbench-1.0 v1771>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v18>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v34>,<0x10000000001/sv_1 v58>,<0x10000000000/qa v49>,<0x1/volumes v46>]//[]","memoryvalue":"(3)0x10000000206:[<0x10000000204/Makefile.am v37>,<0x10000000201/man v2008>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.618 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.547+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000207 [3,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/man/Makefile.in auth v39 ap=1 s=9817 n(v0 rc2024-09-19T07:12:48.777855+0000 b9817 1=1+0) caps={24793=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb109b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000207:[<0x10000000204/Makefile.in v39>,<0x10000000201/man v1994>,<0x10000000006/blogbench-1.0 v1771>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v18>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v34>,<0x10000000001/sv_1 v58>,<0x10000000000/qa v49>,<0x1/volumes v46>]//[]","memoryvalue":"(3)0x10000000207:[<0x10000000204/Makefile.in v39>,<0x10000000201/man v2008>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.618 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.586+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000203 [3,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/m4/acx_pthread.m4 auth v6 ap=1 s=9243 n(v0 rc2024-09-19T07:12:48.774856+0000 b9243 1=1+0) caps={24793=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb1098000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000203:[<0x10000000202/acx_pthread.m4 v6>,<0x10000000201/m4 v1980>,<0x10000000006/blogbench-1.0 v1771>,<0x10000000005/tmp v25>,<0x100000001fb/client.0 v18>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v34>,<0x10000000001/sv_1 v58>,<0x10000000000/qa v49>,<0x1/volumes v46>]//[]","memoryvalue":"(3)0x10000000203:[<0x10000000202/acx_pthread.m4 v6>,<0x10000000201/m4 v1980>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.618 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.616+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011bf [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-18.jpg auth v578 ap=1 s=53465 n(v0 rc2024-09-19T07:13:25.123977+0000 b53465 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@6},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1718c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011bf:[<0x1000000108c/picture-18.jpg v322>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011bf:[<0x1000000108c/picture-18.jpg v578>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.619 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.616+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011cb [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-13.jpg auth v546 ap=1 s=18380 n(v0 rc2024-09-19T07:13:25.165976+0000 b18380 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@6},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1718680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011cb:[<0x1000000108c/picture-13.jpg v352>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011cb:[<0x1000000108c/picture-13.jpg v546>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.619 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.616+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010cf [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-18.xml auth v620 ap=1 s=22109 n(v0 rc2024-09-19T07:13:24.425994+0000 b22109 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@6},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1719180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010cf:[<0x1000000108c/article-18.xml v70>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010cf:[<0x1000000108c/article-18.xml v620>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.619 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.617+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011bc [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-19.jpg auth v542 ap=1 s=56973 n(v0 rc2024-09-19T07:13:25.114977+0000 b56973 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@6},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1719700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011bc:[<0x1000000108c/picture-19.jpg v316>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011bc:[<0x1000000108c/picture-19.jpg v542>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.619 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.617+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000109c [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-27.xml auth v530 ap=1 s=25124 n(v0 rc2024-09-19T07:13:24.333996+0000 b25124 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@6},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1718100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000109c:[<0x1000000108c/article-27.xml v16>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000109c:[<0x1000000108c/article-27.xml v530>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.619 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.617+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011de [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-4.jpg auth v564 ap=1 s=26914 n(v0 rc2024-09-19T07:13:25.231975+0000 b26914 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@4},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1717b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011de:[<0x1000000108c/picture-4.jpg v406>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011de:[<0x1000000108c/picture-4.jpg v564>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.619 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.617+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001178 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-35.jpg auth v562 ap=1 s=28391 n(v0 rc2024-09-19T07:13:24.869983+0000 b28391 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1717600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001178:[<0x1000000108c/picture-35.jpg v220>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001178:[<0x1000000108c/picture-35.jpg v562>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-mon[35326]: pgmap v83: 97 pgs: 97 active+clean; 93 MiB data, 603 MiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 5.1 MiB/s wr, 253 op/s 2024-09-19T07:13:44.890 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.617+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011e3 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-2.jpg auth v556 ap=1 s=29463 n(v0 rc2024-09-19T07:13:25.244974+0000 b29463 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@4},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1717080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011e3:[<0x1000000108c/picture-2.jpg v418>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011e3:[<0x1000000108c/picture-2.jpg v556>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.890 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.617+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010c4 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-20.xml auth v508 ap=1 s=21621 n(v0 rc2024-09-19T07:13:24.404994+0000 b21621 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@6},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb11ca000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010c4:[<0x1000000108c/article-20.xml v58>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010c4:[<0x1000000108c/article-20.xml v508>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.890 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.617+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011c9 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-14.jpg auth v544 ap=1 s=48989 n(v0 rc2024-09-19T07:13:25.156976+0000 b48989 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@6},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb11ca580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011c9:[<0x1000000108c/picture-14.jpg v346>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011c9:[<0x1000000108c/picture-14.jpg v544>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.890 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.618+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011d7 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-7.jpg auth v572 ap=1 s=53936 n(v0 rc2024-09-19T07:13:25.205975+0000 b53936 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@5},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb11cab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011d7:[<0x1000000108c/picture-7.jpg v388>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011d7:[<0x1000000108c/picture-7.jpg v572>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.890 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.618+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011d3 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-9.jpg auth v510 ap=1 s=34778 n(v0 rc2024-09-19T07:13:25.191975+0000 b34778 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@5},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb11cb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011d3:[<0x1000000108c/picture-9.jpg v376>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011d3:[<0x1000000108c/picture-9.jpg v510>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.891 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.618+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011d1 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-10.jpg auth v608 ap=1 s=18819 n(v0 rc2024-09-19T07:13:25.185976+0000 b18819 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@5},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb11cb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011d1:[<0x1000000108c/picture-10.jpg v370>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011d1:[<0x1000000108c/picture-10.jpg v608>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.891 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.618+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011e7 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-1.jpg auth v554 ap=1 s=60517 n(v0 rc2024-09-19T07:13:25.257974+0000 b60517 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb11cbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011e7:[<0x1000000108c/picture-1.jpg v424>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011e7:[<0x1000000108c/picture-1.jpg v554>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.891 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.618+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010fb [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-9.xml auth v634 ap=1 s=26989 n(v0 rc2024-09-19T07:13:24.505992+0000 b26989 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@5},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb11cc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010fb:[<0x1000000108c/article-9.xml v124>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010fb:[<0x1000000108c/article-9.xml v634>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.891 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.618+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011da [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-6.jpg auth v580 ap=1 s=39487 n(v0 rc2024-09-19T07:13:25.215975+0000 b39487 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@5},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb11cc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011da:[<0x1000000108c/picture-6.jpg v394>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011da:[<0x1000000108c/picture-6.jpg v580>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.891 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.618+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010ae [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-24.xml auth v584 ap=1 s=18513 n(v0 rc2024-09-19T07:13:24.365995+0000 b18513 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@6},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb11ccc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010ae:[<0x1000000108c/article-24.xml v34>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010ae:[<0x1000000108c/article-24.xml v584>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.891 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.619+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011a2 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-28.jpg auth v502 ap=1 s=29958 n(v0 rc2024-09-19T07:13:25.018980+0000 b29958 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@6},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb11cd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011a2:[<0x1000000108c/picture-28.jpg v262>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011a2:[<0x1000000108c/picture-28.jpg v502>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.891 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.619+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001165 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-37.jpg auth v612 ap=1 s=64397 n(v0 rc2024-09-19T07:13:24.810985+0000 b64397 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb11cd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001165:[<0x1000000108c/picture-37.jpg v208>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001165:[<0x1000000108c/picture-37.jpg v612>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.891 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.619+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011c1 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-17.jpg auth v598 ap=1 s=44892 n(v0 rc2024-09-19T07:13:25.128977+0000 b44892 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@6},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb11d4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011c1:[<0x1000000108c/picture-17.jpg v328>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011c1:[<0x1000000108c/picture-17.jpg v598>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.891 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.619+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011ae [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-24.jpg auth v516 ap=1 s=14497 n(v0 rc2024-09-19T07:13:25.061979+0000 b14497 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@6},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb11d4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011ae:[<0x1000000108c/picture-24.jpg v286>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011ae:[<0x1000000108c/picture-24.jpg v516>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.891 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.619+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000111e [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-3.xml auth v512 ap=1 s=28011 n(v0 rc2024-09-19T07:13:24.571990+0000 b28011 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@4},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb11d4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000111e:[<0x1000000108c/article-3.xml v160>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000111e:[<0x1000000108c/article-3.xml v512>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.891 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.619+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001184 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-33.jpg auth v616 ap=1 s=34892 n(v0 rc2024-09-19T07:13:24.913982+0000 b34892 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb11d5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001184:[<0x1000000108c/picture-33.jpg v232>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001184:[<0x1000000108c/picture-33.jpg v616>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.892 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.619+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000110b [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-7.xml auth v582 ap=1 s=14588 n(v0 rc2024-09-19T07:13:24.536991+0000 b14588 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@5},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb11d5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000110b:[<0x1000000108c/article-7.xml v136>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000110b:[<0x1000000108c/article-7.xml v582>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.892 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.620+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001130 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-42.jpg auth v534 ap=1 s=33901 n(v0 rc2024-09-19T07:13:24.619989+0000 b33901 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb11d5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001130:[<0x1000000108c/picture-42.jpg v178>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001130:[<0x1000000108c/picture-42.jpg v534>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.892 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.620+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000114c [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-39.jpg auth v506 ap=1 s=14790 n(v0 rc2024-09-19T07:13:24.711987+0000 b14790 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb11d6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000114c:[<0x1000000108c/picture-39.jpg v196>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000114c:[<0x1000000108c/picture-39.jpg v506>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.892 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.620+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011ab [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-25.jpg auth v524 ap=1 s=13499 n(v0 rc2024-09-19T07:13:25.052979+0000 b13499 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@6},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb11d6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011ab:[<0x1000000108c/picture-25.jpg v280>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011ab:[<0x1000000108c/picture-25.jpg v524>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.892 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.621+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001103 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-8.xml auth v540 ap=1 s=13041 n(v0 rc2024-09-19T07:13:24.528991+0000 b13041 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@5},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb11d6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001103:[<0x1000000108c/article-8.xml v130>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001103:[<0x1000000108c/article-8.xml v540>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.892 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.621+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000119a [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-31.jpg auth v576 ap=1 s=33783 n(v0 rc2024-09-19T07:13:24.988980+0000 b33783 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb11d7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000119a:[<0x1000000108c/picture-31.jpg v244>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000119a:[<0x1000000108c/picture-31.jpg v576>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.892 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.621+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011d5 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-8.jpg auth v610 ap=1 s=50576 n(v0 rc2024-09-19T07:13:25.199975+0000 b50576 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@5},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb11d7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011d5:[<0x1000000108c/picture-8.jpg v382>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011d5:[<0x1000000108c/picture-8.jpg v610>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.892 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.621+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010bd [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-21.xml auth v588 ap=1 s=1269 n(v0 rc2024-09-19T07:13:24.395995+0000 b1269 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@6},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1598580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010bd:[<0x1000000108c/article-21.xml v52>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010bd:[<0x1000000108c/article-21.xml v588>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.892 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.621+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000110f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-6.xml auth v558 ap=1 s=10416 n(v0 rc2024-09-19T07:13:24.543991+0000 b10416 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@5},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1599080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000110f:[<0x1000000108c/article-6.xml v142>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000110f:[<0x1000000108c/article-6.xml v558>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.892 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.622+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001124 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-2.xml auth v590 ap=1 s=2960 n(v0 rc2024-09-19T07:13:24.582990+0000 b2960 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@4},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1599600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001124:[<0x1000000108c/article-2.xml v166>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001124:[<0x1000000108c/article-2.xml v590>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.892 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.622+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010e8 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-13.xml auth v532 ap=1 s=28875 n(v0 rc2024-09-19T07:13:24.469993+0000 b28875 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@6},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1598b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010e8:[<0x1000000108c/article-13.xml v100>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010e8:[<0x1000000108c/article-13.xml v532>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.893 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.622+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011a0 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-29.jpg auth v538 ap=1 s=49159 n(v0 rc2024-09-19T07:13:25.009980+0000 b49159 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@6},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1599b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011a0:[<0x1000000108c/picture-29.jpg v256>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011a0:[<0x1000000108c/picture-29.jpg v538>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.893 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.622+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011dc [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-5.jpg auth v570 ap=1 s=50161 n(v0 rc2024-09-19T07:13:25.225975+0000 b50161 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@5},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb159a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011dc:[<0x1000000108c/picture-5.jpg v400>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011dc:[<0x1000000108c/picture-5.jpg v570>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.893 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.622+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001096 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-28.xml auth v522 ap=1 s=27107 n(v0 rc2024-09-19T07:13:24.322996+0000 b27107 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@6},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb159a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001096:[<0x1000000108c/article-28.xml v10>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001096:[<0x1000000108c/article-28.xml v522>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.893 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.622+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011e0 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-3.jpg auth v504 ap=1 s=22625 n(v0 rc2024-09-19T07:13:25.238974+0000 b22625 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@4},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb159ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011e0:[<0x1000000108c/picture-3.jpg v412>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011e0:[<0x1000000108c/picture-3.jpg v504>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.893 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.622+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011a9 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-26.jpg auth v618 ap=1 s=35426 n(v0 rc2024-09-19T07:13:25.042979+0000 b35426 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@6},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1598000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011a9:[<0x1000000108c/picture-26.jpg v274>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011a9:[<0x1000000108c/picture-26.jpg v618>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.893 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.623+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001113 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-5.xml auth v638 ap=1 s=28651 n(v0 rc2024-09-19T07:13:24.552991+0000 b28651 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@5},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb159b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001113:[<0x1000000108c/article-5.xml v148>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001113:[<0x1000000108c/article-5.xml v638>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.893 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.623+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011cf [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-11.jpg auth v614 ap=1 s=53608 n(v0 rc2024-09-19T07:13:25.179976+0000 b53608 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@6},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb159b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011cf:[<0x1000000108c/picture-11.jpg v364>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011cf:[<0x1000000108c/picture-11.jpg v614>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.893 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.623+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000108f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-29.xml auth v550 ap=1 s=20601 n(v0 rc2024-09-19T07:13:24.314997+0000 b20601 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@6},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15a6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000108f:[<0x1000000108c/article-29.xml v4>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000108f:[<0x1000000108c/article-29.xml v550>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.894 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.623+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001142 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-40.jpg auth v626 ap=1 s=15445 n(v0 rc2024-09-19T07:13:24.667988+0000 b15445 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15a6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001142:[<0x1000000108c/picture-40.jpg v190>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001142:[<0x1000000108c/picture-40.jpg v626>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.894 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.623+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010e1 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-14.xml auth v528 ap=1 s=2249 n(v0 rc2024-09-19T07:13:24.461993+0000 b2249 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@6},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15a7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010e1:[<0x1000000108c/article-14.xml v94>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010e1:[<0x1000000108c/article-14.xml v528>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.894 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.623+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010b8 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-22.xml auth v632 ap=1 s=22509 n(v0 rc2024-09-19T07:13:24.385995+0000 b22509 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@6},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15a6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010b8:[<0x1000000108c/article-22.xml v46>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010b8:[<0x1000000108c/article-22.xml v632>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.894 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.624+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011b1 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-23.jpg auth v624 ap=1 s=42703 n(v0 rc2024-09-19T07:13:25.076978+0000 b42703 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@6},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15a7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011b1:[<0x1000000108c/picture-23.jpg v292>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011b1:[<0x1000000108c/picture-23.jpg v624>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.894 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.624+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010f0 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-11.xml auth v604 ap=1 s=6950 n(v0 rc2024-09-19T07:13:24.489992+0000 b6950 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@6},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15a8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010f0:[<0x1000000108c/article-11.xml v112>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010f0:[<0x1000000108c/article-11.xml v604>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.894 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.624+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010d8 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-16.xml auth v592 ap=1 s=21650 n(v0 rc2024-09-19T07:13:24.444993+0000 b21650 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@6},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15a8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010d8:[<0x1000000108c/article-16.xml v82>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010d8:[<0x1000000108c/article-16.xml v592>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.894 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.624+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010a1 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-26.xml auth v552 ap=1 s=9850 n(v0 rc2024-09-19T07:13:24.344996+0000 b9850 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@6},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15a9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010a1:[<0x1000000108c/article-26.xml v22>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010a1:[<0x1000000108c/article-26.xml v552>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.894 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.625+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001139 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-41.jpg auth v548 ap=1 s=52004 n(v0 rc2024-09-19T07:13:24.645989+0000 b52004 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15a7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001139:[<0x1000000108c/picture-41.jpg v184>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001139:[<0x1000000108c/picture-41.jpg v548>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.894 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.625+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011c7 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-15.jpg auth v596 ap=1 s=17343 n(v0 rc2024-09-19T07:13:25.147977+0000 b17343 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@6},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15a9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011c7:[<0x1000000108c/picture-15.jpg v340>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011c7:[<0x1000000108c/picture-15.jpg v596>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.894 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.625+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011b4 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-22.jpg auth v628 ap=1 s=26465 n(v0 rc2024-09-19T07:13:25.086978+0000 b26465 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@6},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15a8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011b4:[<0x1000000108c/picture-22.jpg v298>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011b4:[<0x1000000108c/picture-22.jpg v628>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.894 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.625+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010f7 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-10.xml auth v514 ap=1 s=17824 n(v0 rc2024-09-19T07:13:24.496992+0000 b17824 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@6},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15b2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010f7:[<0x1000000108c/article-10.xml v118>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010f7:[<0x1000000108c/article-10.xml v514>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.894 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.625+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011cd [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-12.jpg auth v622 ap=1 s=11189 n(v0 rc2024-09-19T07:13:25.173976+0000 b11189 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@6},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15b2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011cd:[<0x1000000108c/picture-12.jpg v358>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011cd:[<0x1000000108c/picture-12.jpg v622>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.895 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.625+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001119 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-4.xml auth v586 ap=1 s=25779 n(v0 rc2024-09-19T07:13:24.561991+0000 b25779 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@4},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15b2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001119:[<0x1000000108c/article-4.xml v154>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001119:[<0x1000000108c/article-4.xml v586>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.895 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.625+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010a8 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-25.xml auth v500 ap=1 s=19518 n(v0 rc2024-09-19T07:13:24.355996+0000 b19518 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@6},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15b3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010a8:[<0x1000000108c/article-25.xml v28>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010a8:[<0x1000000108c/article-25.xml v500>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.895 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.626+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011b7 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-21.jpg auth v526 ap=1 s=12666 n(v0 rc2024-09-19T07:13:25.092978+0000 b12666 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@6},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15b3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011b7:[<0x1000000108c/picture-21.jpg v304>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011b7:[<0x1000000108c/picture-21.jpg v526>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.895 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.626+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000119d [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-30.jpg auth v594 ap=1 s=25179 n(v0 rc2024-09-19T07:13:24.995980+0000 b25179 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@6},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15b3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000119d:[<0x1000000108c/picture-30.jpg v250>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000119d:[<0x1000000108c/picture-30.jpg v594>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.895 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.626+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010de [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-15.xml auth v518 ap=1 s=8014 n(v0 rc2024-09-19T07:13:24.451993+0000 b8014 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@6},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15b4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010de:[<0x1000000108c/article-15.xml v88>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010de:[<0x1000000108c/article-15.xml v518>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.895 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.626+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000116c [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-36.jpg auth v520 ap=1 s=13211 n(v0 rc2024-09-19T07:13:24.837984+0000 b13211 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15b4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000116c:[<0x1000000108c/picture-36.jpg v214>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000116c:[<0x1000000108c/picture-36.jpg v520>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.895 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.626+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010c8 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-19.xml auth v536 ap=1 s=23729 n(v0 rc2024-09-19T07:13:24.415994+0000 b23729 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@6},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15b4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010c8:[<0x1000000108c/article-19.xml v64>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010c8:[<0x1000000108c/article-19.xml v536>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.895 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.627+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011ba [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-20.jpg auth v640 ap=1 s=62499 n(v0 rc2024-09-19T07:13:25.105978+0000 b62499 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@6},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15b5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011ba:[<0x1000000108c/picture-20.jpg v310>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011ba:[<0x1000000108c/picture-20.jpg v640>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.895 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.627+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001158 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-38.jpg auth v636 ap=1 s=16459 n(v0 rc2024-09-19T07:13:24.766986+0000 b16459 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15b5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001158:[<0x1000000108c/picture-38.jpg v202>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001158:[<0x1000000108c/picture-38.jpg v636>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.895 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.746+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011a5 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-27.jpg auth v574 ap=1 s=35779 n(v0 rc2024-09-19T07:13:25.029979+0000 b35779 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@6},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb178a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011a5:[<0x1000000108c/picture-27.jpg v268>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011a5:[<0x1000000108c/picture-27.jpg v574>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.895 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.746+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010ed [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-12.xml auth v566 ap=1 s=2526 n(v0 rc2024-09-19T07:13:24.478993+0000 b2526 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@6},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb178a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010ed:[<0x1000000108c/article-12.xml v106>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010ed:[<0x1000000108c/article-12.xml v566>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.896 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.746+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000112a [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-1.xml auth v560 ap=1 s=29287 n(v0 rc2024-09-19T07:13:24.593990+0000 b29287 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@4},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb178ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000112a:[<0x1000000108c/article-1.xml v172>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000112a:[<0x1000000108c/article-1.xml v560>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.896 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.746+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000117e [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-34.jpg auth v630 ap=1 s=46522 n(v0 rc2024-09-19T07:13:24.888983+0000 b46522 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb178b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000117e:[<0x1000000108c/picture-34.jpg v226>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000117e:[<0x1000000108c/picture-34.jpg v630>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.896 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.746+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011c4 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-16.jpg auth v606 ap=1 s=38747 n(v0 rc2024-09-19T07:13:25.138977+0000 b38747 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@6},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb178b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011c4:[<0x1000000108c/picture-16.jpg v334>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011c4:[<0x1000000108c/picture-16.jpg v606>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.896 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.746+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010b3 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-23.xml auth v600 ap=1 s=30338 n(v0 rc2024-09-19T07:13:24.374995+0000 b30338 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@6},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb178bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010b3:[<0x1000000108c/article-23.xml v40>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010b3:[<0x1000000108c/article-23.xml v600>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.896 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.746+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010d4 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-17.xml auth v602 ap=1 s=23929 n(v0 rc2024-09-19T07:13:24.435994+0000 b23929 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@6},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb178c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010d4:[<0x1000000108c/article-17.xml v76>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010d4:[<0x1000000108c/article-17.xml v602>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.896 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.746+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000118a [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-32.jpg auth v568 ap=1 s=52612 n(v0 rc2024-09-19T07:13:24.959981+0000 b52612 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb178c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000118a:[<0x1000000108c/picture-32.jpg v238>,<0x10000000399/blog-22 v27152>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000118a:[<0x1000000108c/picture-32.jpg v568>,<0x10000000399/blog-22 v43746>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.896 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.747+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000de2 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-2.jpg auth v1168 ap=1 s=29183 n(v0 rc2024-09-19T07:13:22.311045+0000 b29183 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb163bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000de2:[<0x10000000da6/picture-2.jpg v118>,<0x10000000399/blog-16 v26918>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000de2:[<0x10000000da6/picture-2.jpg v1168>,<0x10000000399/blog-16 v43752>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.896 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.752+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dcf [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-92.jpg auth v1186 ap=1 s=62713 n(v0 rc2024-09-19T07:13:22.258046+0000 b62713 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb14e2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dcf:[<0x10000000da6/picture-92.jpg v84>,<0x10000000399/blog-16 v26918>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000dcf:[<0x10000000da6/picture-92.jpg v1186>,<0x10000000399/blog-16 v43752>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.896 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.752+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dbb [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-9.xml auth v1276 ap=1 s=20034 n(v0 rc2024-09-19T07:13:22.200048+0000 b20034 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15ba100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dbb:[<0x10000000da6/article-9.xml v46>,<0x10000000399/blog-16 v26918>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000dbb:[<0x10000000da6/article-9.xml v1276>,<0x10000000399/blog-16 v43752>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.897 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.753+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dd2 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-3.xml auth v1164 ap=1 s=30853 n(v0 rc2024-09-19T07:13:22.262046+0000 b30853 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb14e2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dd2:[<0x10000000da6/article-3.xml v88>,<0x10000000399/blog-16 v26918>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000dd2:[<0x10000000da6/article-3.xml v1164>,<0x10000000399/blog-16 v43752>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.897 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.753+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dc1 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-7.xml auth v1216 ap=1 s=4254 n(v0 rc2024-09-19T07:13:22.216047+0000 b4254 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb14e3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dc1:[<0x10000000da6/article-7.xml v58>,<0x10000000399/blog-16 v26918>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000dc1:[<0x10000000da6/article-7.xml v1216>,<0x10000000399/blog-16 v43752>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.897 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.753+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dbe [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-8.xml auth v1176 ap=1 s=26995 n(v0 rc2024-09-19T07:13:22.207047+0000 b26995 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb14e4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dbe:[<0x10000000da6/article-8.xml v52>,<0x10000000399/blog-16 v26918>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000dbe:[<0x10000000da6/article-8.xml v1176>,<0x10000000399/blog-16 v43752>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.897 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.754+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dae [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-13.xml auth v1154 ap=1 s=12946 n(v0 rc2024-09-19T07:13:22.166048+0000 b12946 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb14ee580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dae:[<0x10000000da6/article-13.xml v22>,<0x10000000399/blog-16 v26918>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000dae:[<0x10000000da6/article-13.xml v1154>,<0x10000000399/blog-16 v43752>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.897 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.754+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dc4 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-6.xml auth v1160 ap=1 s=11656 n(v0 rc2024-09-19T07:13:22.223047+0000 b11656 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb14ef600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dc4:[<0x10000000da6/article-6.xml v64>,<0x10000000399/blog-16 v26918>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000dc4:[<0x10000000da6/article-6.xml v1160>,<0x10000000399/blog-16 v43752>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.897 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.754+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dd6 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-2.xml auth v1298 ap=1 s=1741 n(v0 rc2024-09-19T07:13:22.277046+0000 b1741 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb14efb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dd6:[<0x10000000da6/article-2.xml v100>,<0x10000000399/blog-16 v26918>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000dd6:[<0x10000000da6/article-2.xml v1298>,<0x10000000399/blog-16 v43752>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.897 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.755+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dd4 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-56.xml auth v1158 ap=1 s=1258 n(v0 rc2024-09-19T07:13:22.273046+0000 b1258 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb14f1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dd4:[<0x10000000da6/article-56.xml v96>,<0x10000000399/blog-16 v26918>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000dd4:[<0x10000000da6/article-56.xml v1158>,<0x10000000399/blog-16 v43752>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.898 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.757+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ddf [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-3.jpg auth v1150 ap=1 s=16935 n(v0 rc2024-09-19T07:13:22.303045+0000 b16935 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb165a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ddf:[<0x10000000da6/picture-3.jpg v112>,<0x10000000399/blog-16 v26918>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ddf:[<0x10000000da6/picture-3.jpg v1150>,<0x10000000399/blog-16 v43752>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.898 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.757+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dc8 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-5.xml auth v1174 ap=1 s=9054 n(v0 rc2024-09-19T07:13:22.237047+0000 b9054 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb165b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dc8:[<0x10000000da6/article-5.xml v70>,<0x10000000399/blog-16 v26918>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000dc8:[<0x10000000da6/article-5.xml v1174>,<0x10000000399/blog-16 v43752>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.898 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.758+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dac [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-14.xml auth v1218 ap=1 s=6122 n(v0 rc2024-09-19T07:13:22.162048+0000 b6122 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb166ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dac:[<0x10000000da6/article-14.xml v16>,<0x10000000399/blog-16 v26918>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000dac:[<0x10000000da6/article-14.xml v1218>,<0x10000000399/blog-16 v43752>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.898 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.758+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000db4 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-11.xml auth v1210 ap=1 s=12322 n(v0 rc2024-09-19T07:13:22.180048+0000 b12322 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb166b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000db4:[<0x10000000da6/article-11.xml v34>,<0x10000000399/blog-16 v26918>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000db4:[<0x10000000da6/article-11.xml v1210>,<0x10000000399/blog-16 v43752>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.898 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.759+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000da8 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-16.xml auth v1152 ap=1 s=17696 n(v0 rc2024-09-19T07:13:22.150049+0000 b17696 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb166c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000da8:[<0x10000000da6/article-16.xml v4>,<0x10000000399/blog-16 v26918>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000da8:[<0x10000000da6/article-16.xml v1152>,<0x10000000399/blog-16 v43752>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.898 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.759+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000db8 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-10.xml auth v1162 ap=1 s=28011 n(v0 rc2024-09-19T07:13:22.190048+0000 b28011 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb166c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000db8:[<0x10000000da6/article-10.xml v40>,<0x10000000399/blog-16 v26918>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000db8:[<0x10000000da6/article-10.xml v1162>,<0x10000000399/blog-16 v43752>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.898 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.759+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dcc [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-4.xml auth v1156 ap=1 s=25352 n(v0 rc2024-09-19T07:13:22.251046+0000 b25352 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb166d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dcc:[<0x10000000da6/article-4.xml v78>,<0x10000000399/blog-16 v26918>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000dcc:[<0x10000000da6/article-4.xml v1156>,<0x10000000399/blog-16 v43752>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.898 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.759+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000daa [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-15.xml auth v1220 ap=1 s=29405 n(v0 rc2024-09-19T07:13:22.154049+0000 b29405 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1677600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000daa:[<0x10000000da6/article-15.xml v10>,<0x10000000399/blog-16 v26918>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000daa:[<0x10000000da6/article-15.xml v1220>,<0x10000000399/blog-16 v43752>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.898 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.761+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000db0 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-12.xml auth v1166 ap=1 s=20178 n(v0 rc2024-09-19T07:13:22.172048+0000 b20178 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1683080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000db0:[<0x10000000da6/article-12.xml v28>,<0x10000000399/blog-16 v26918>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000db0:[<0x10000000da6/article-12.xml v1166>,<0x10000000399/blog-16 v43752>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:44.898 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:44.761+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ddb [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-1.xml auth v1188 ap=1 s=21932 n(v0 rc2024-09-19T07:13:22.295045+0000 b21932 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1683600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ddb:[<0x10000000da6/article-1.xml v106>,<0x10000000399/blog-16 v26918>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ddb:[<0x10000000da6/article-1.xml v1188>,<0x10000000399/blog-16 v43752>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-mon[35716]: pgmap v83: 97 pgs: 97 active+clean; 93 MiB data, 603 MiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 5.1 MiB/s wr, 253 op/s 2024-09-19T07:13:45.035 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.620+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000063e [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-64.xml auth v1061 ap=1 s=32678 n(v0 rc2024-09-19T07:13:15.200217+0000 b32678 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ab5ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000063e:[<0x10000000615/article-64.xml v1061>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000063e:[<0x10000000615/article-64.xml v1061>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.036 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.620+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011b5 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-13.xml auth v1653 ap=1 s=2904 n(v0 rc2024-09-19T07:13:25.090978+0000 b2904 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ab5f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011b5:[<0x10000000615/comment-13.xml v1604>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011b5:[<0x10000000615/comment-13.xml v1653>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.036 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.620+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001175 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-21.xml auth v1659 ap=1 s=2935 n(v0 rc2024-09-19T07:13:24.851984+0000 b2935 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ab5f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001175:[<0x10000000615/comment-21.xml v1576>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001175:[<0x10000000615/comment-21.xml v1659>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.036 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.620+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001146 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-26.xml auth v1649 ap=1 s=8595 n(v0 rc2024-09-19T07:13:24.683988+0000 b8595 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ac0c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001146:[<0x10000000615/comment-26.xml v1558>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001146:[<0x10000000615/comment-26.xml v1649>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.036 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.620+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000622 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-75.xml auth v1049 ap=1 s=30513 n(v0 rc2024-09-19T07:13:15.112219+0000 b30513 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac0c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000622:[<0x10000000615/article-75.xml v1049>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000622:[<0x10000000615/article-75.xml v1049>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.036 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.620+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000692 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-37.xml auth v1073 ap=1 s=30893 n(v0 rc2024-09-19T07:13:15.434211+0000 b30893 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac0cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000692:[<0x10000000615/article-37.xml v1073>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000692:[<0x10000000615/article-37.xml v1073>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.036 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.621+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000073e [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-27.jpg auth v1123 ap=1 s=43984 n(v0 rc2024-09-19T07:13:15.940199+0000 b43984 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac0d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000073e:[<0x10000000615/picture-27.jpg v1123>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000073e:[<0x10000000615/picture-27.jpg v1123>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.036 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.621+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000626 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-73.xml auth v1091 ap=1 s=3320 n(v0 rc2024-09-19T07:13:15.125219+0000 b3320 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac0d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000626:[<0x10000000615/article-73.xml v1091>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000626:[<0x10000000615/article-73.xml v1091>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.036 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.621+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000068c [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-39.xml auth v1017 ap=1 s=27956 n(v0 rc2024-09-19T07:13:15.418211+0000 b27956 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac0db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000068c:[<0x10000000615/article-39.xml v1017>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000068c:[<0x10000000615/article-39.xml v1017>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.036 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.621+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000694 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-36.xml auth v1155 ap=1 s=26414 n(v0 rc2024-09-19T07:13:15.443211+0000 b26414 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac0e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000694:[<0x10000000615/article-36.xml v1155>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000694:[<0x10000000615/article-36.xml v1155>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.036 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.622+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000072e [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-1.xml auth{0=1} v1628 ap=1 s=31194 n(v0 rc2024-09-19T07:13:15.911200+0000 b31194 1=1+0) caps={24793=pAsLsXsFscr/pFscr@4} mcw={0=Fscr} | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c35ac0ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000072e:[<0x10000000615/article-1.xml v1193>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000072e:[<0x10000000615/article-1.xml v1628>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.037 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.622+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006e3 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-12.xml auth v983 ap=1 s=1510 n(v0 rc2024-09-19T07:13:15.654206+0000 b1510 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac0e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006e3:[<0x10000000615/article-12.xml v983>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000006e3:[<0x10000000615/article-12.xml v983>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.037 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.622+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001126 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-30.xml auth v1645 ap=1 s=8787 n(v0 rc2024-09-19T07:13:24.585990+0000 b8787 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ac0f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001126:[<0x10000000615/comment-30.xml v1540>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001126:[<0x10000000615/comment-30.xml v1645>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.037 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.623+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001190 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-18.xml auth v1663 ap=1 s=6490 n(v0 rc2024-09-19T07:13:24.945981+0000 b6490 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ac16000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001190:[<0x10000000615/comment-18.xml v1591>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001190:[<0x10000000615/comment-18.xml v1663>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.037 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.623+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007fa [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-16.jpg auth v1111 ap=1 s=14549 n(v0 rc2024-09-19T07:13:16.481186+0000 b14549 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@5},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac16b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007fa:[<0x10000000615/picture-16.jpg v1111>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000007fa:[<0x10000000615/picture-16.jpg v1111>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.037 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.624+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000639 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-66.xml auth v1131 ap=1 s=2667 n(v0 rc2024-09-19T07:13:15.178217+0000 b2667 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac16580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000639:[<0x10000000615/article-66.xml v1131>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000639:[<0x10000000615/article-66.xml v1131>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.037 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.624+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f02 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-87.xml auth v1651 ap=1 s=4690 n(v0 rc2024-09-19T07:13:23.144025+0000 b4690 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ac18100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f02:[<0x10000000615/comment-87.xml v1322>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f02:[<0x10000000615/comment-87.xml v1651>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.037 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.624+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001052 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-49.xml auth v1641 ap=1 s=2061 n(v0 rc2024-09-19T07:13:24.177000+0000 b2061 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ac17b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001052:[<0x10000000615/comment-49.xml v1474>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001052:[<0x10000000615/comment-49.xml v1641>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.037 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.624+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010a6 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-42.xml auth v1647 ap=1 s=8053 n(v0 rc2024-09-19T07:13:24.362995+0000 b8053 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ac18680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010a6:[<0x10000000615/comment-42.xml v1511>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010a6:[<0x10000000615/comment-42.xml v1647>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.037 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.625+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ffb [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-65.xml auth v1657 ap=1 s=4583 n(v0 rc2024-09-19T07:13:23.882007+0000 b4583 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ac18c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ffb:[<0x10000000615/comment-65.xml v1417>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ffb:[<0x10000000615/comment-65.xml v1657>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.037 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.625+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011c6 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-12.xml auth v1661 ap=1 s=6507 n(v0 rc2024-09-19T07:13:25.206975+0000 b6507 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ac17600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011c6:[<0x10000000615/comment-12.xml v1611>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011c6:[<0x10000000615/comment-12.xml v1661>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.037 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.625+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006c1 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-23.xml auth v1027 ap=1 s=27753 n(v0 rc2024-09-19T07:13:15.567208+0000 b27753 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac19180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006c1:[<0x10000000615/article-23.xml v1027>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000006c1:[<0x10000000615/article-23.xml v1027>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.038 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.625+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009b5 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-100.xml auth v1109 ap=1 s=10237 n(v0 rc2024-09-19T07:13:17.810154+0000 b10237 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24793 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac19700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009b5:[<0x10000000615/comment-100.xml v1109>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000009b5:[<0x10000000615/comment-100.xml v1109>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.038 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.625+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000644 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-63.xml auth v1167 ap=1 s=15380 n(v0 rc2024-09-19T07:13:15.210217+0000 b15380 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac24580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000644:[<0x10000000615/article-63.xml v1167>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000644:[<0x10000000615/article-63.xml v1167>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.038 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.626+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000103b [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-51.xml auth v1655 ap=1 s=5420 n(v0 rc2024-09-19T07:13:24.133001+0000 b5420 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ac24b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000103b:[<0x10000000615/comment-51.xml v1467>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000103b:[<0x10000000615/comment-51.xml v1655>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.038 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.626+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000629 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-72.xml auth v1165 ap=1 s=28842 n(v0 rc2024-09-19T07:13:15.131218+0000 b28842 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad95180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000629:[<0x10000000615/article-72.xml v1165>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000629:[<0x10000000615/article-72.xml v1165>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.038 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.626+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000078a [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-21.jpg auth v1033 ap=1 s=12614 n(v0 rc2024-09-19T07:13:16.143194+0000 b12614 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@5},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad95700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000078a:[<0x10000000615/picture-21.jpg v1033>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000078a:[<0x10000000615/picture-21.jpg v1033>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.038 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.626+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000698 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-35.xml auth v949 ap=1 s=30509 n(v0 rc2024-09-19T07:13:15.450211+0000 b30509 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ae70000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000698:[<0x10000000615/article-35.xml v949>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000698:[<0x10000000615/article-35.xml v949>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.038 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.627+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fd4 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-73.xml auth v1659 ap=1 s=9970 n(v0 rc2024-09-19T07:13:23.749010+0000 b9970 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae70580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fd4:[<0x10000000615/comment-73.xml v1385>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000fd4:[<0x10000000615/comment-73.xml v1659>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.038 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.627+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dc7 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-96.xml auth v1667 ap=1 s=6838 n(v0 rc2024-09-19T07:13:22.259046+0000 b6838 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae71600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dc7:[<0x10000000615/comment-96.xml v1248>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000dc7:[<0x10000000615/comment-96.xml v1667>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.038 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.627+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001013 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-60.xml auth v1647 ap=1 s=9992 n(v0 rc2024-09-19T07:13:23.955005+0000 b9992 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae70b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001013:[<0x10000000615/comment-60.xml v1437>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001013:[<0x10000000615/comment-60.xml v1647>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.038 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.627+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fb1 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-78.xml auth v1653 ap=1 s=5014 n(v0 rc2024-09-19T07:13:23.645013+0000 b5014 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae71080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fb1:[<0x10000000615/comment-78.xml v1369>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000fb1:[<0x10000000615/comment-78.xml v1653>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.038 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.627+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000689 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-40.xml auth v1147 ap=1 s=30441 n(v0 rc2024-09-19T07:13:15.410212+0000 b30441 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ae71b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000689:[<0x10000000615/article-40.xml v1147>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000689:[<0x10000000615/article-40.xml v1147>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.039 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.627+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ef3 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-88.xml auth v1643 ap=1 s=7455 n(v0 rc2024-09-19T07:13:23.110026+0000 b7455 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae72100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ef3:[<0x10000000615/comment-88.xml v1308>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ef3:[<0x10000000615/comment-88.xml v1643>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.039 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.628+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006da [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-15.xml auth v1113 ap=1 s=12357 n(v0 rc2024-09-19T07:13:15.629206+0000 b12357 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ae72680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006da:[<0x10000000615/article-15.xml v1113>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000006da:[<0x10000000615/article-15.xml v1113>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.039 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.628+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f9f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-79.xml auth v1641 ap=1 s=6698 n(v0 rc2024-09-19T07:13:23.611013+0000 b6698 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae72c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f9f:[<0x10000000615/comment-79.xml v1364>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f9f:[<0x10000000615/comment-79.xml v1641>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.039 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.628+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010c2 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-40.xml auth v1663 ap=1 s=8792 n(v0 rc2024-09-19T07:13:24.409994+0000 b8792 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae73180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010c2:[<0x10000000615/comment-40.xml v1513>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010c2:[<0x10000000615/comment-40.xml v1663>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.039 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.628+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010cb [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-39.xml auth v1665 ap=1 s=2817 n(v0 rc2024-09-19T07:13:24.424994+0000 b2817 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae7c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010cb:[<0x10000000615/comment-39.xml v1518>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010cb:[<0x10000000615/comment-39.xml v1665>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.039 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.628+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f0a [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-86.xml auth v1639 ap=1 s=9813 n(v0 rc2024-09-19T07:13:23.201023+0000 b9813 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae7c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f0a:[<0x10000000615/comment-86.xml v1310>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f0a:[<0x10000000615/comment-86.xml v1639>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.039 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.629+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010f9 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-33.xml auth v1657 ap=1 s=6030 n(v0 rc2024-09-19T07:13:24.513992+0000 b6030 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae73700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010f9:[<0x10000000615/comment-33.xml v1527>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010f9:[<0x10000000615/comment-33.xml v1657>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.039 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.629+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006ce [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-19.xml auth v1187 ap=1 s=21294 n(v0 rc2024-09-19T07:13:15.596207+0000 b21294 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@5},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ae7cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006ce:[<0x10000000615/article-19.xml v1187>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000006ce:[<0x10000000615/article-19.xml v1187>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.039 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.630+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000079a [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-20.jpg auth v957 ap=1 s=48612 n(v0 rc2024-09-19T07:13:16.205192+0000 b48612 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@5},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ae7d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000079a:[<0x10000000615/picture-20.jpg v957>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000079a:[<0x10000000615/picture-20.jpg v957>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.039 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.630+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f71 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-82.xml auth v1645 ap=1 s=7280 n(v0 rc2024-09-19T07:13:23.540015+0000 b7280 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae7d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f71:[<0x10000000615/comment-82.xml v1344>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f71:[<0x10000000615/comment-82.xml v1645>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.039 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.631+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001107 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-32.xml auth v1655 ap=1 s=6835 n(v0 rc2024-09-19T07:13:24.551991+0000 b6835 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae7db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001107:[<0x10000000615/comment-32.xml v1532>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001107:[<0x10000000615/comment-32.xml v1655>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.039 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.631+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001007 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-63.xml auth v1661 ap=1 s=8736 n(v0 rc2024-09-19T07:13:23.916006+0000 b8736 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae7e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001007:[<0x10000000615/comment-63.xml v1430>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001007:[<0x10000000615/comment-63.xml v1661>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.040 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.632+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000102b [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-54.xml auth v1651 ap=1 s=7538 n(v0 rc2024-09-19T07:13:24.052003+0000 b7538 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae7e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000102b:[<0x10000000615/comment-54.xml v1454>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000102b:[<0x10000000615/comment-54.xml v1651>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.040 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.632+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f41 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-42.xml auth v1649 ap=1 s=6276 n(v0 rc2024-09-19T07:13:23.501016+0000 b6276 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae7ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f41:[<0x10000000615/article-42.xml v1334>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f41:[<0x10000000615/article-42.xml v1649>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.040 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.632+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e97 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-91.xml auth v1637 ap=1 s=3173 n(v0 rc2024-09-19T07:13:22.860032+0000 b3173 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae7f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e97:[<0x10000000615/comment-91.xml v1269>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000e97:[<0x10000000615/comment-91.xml v1637>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.040 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.633+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f81 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-81.xml auth v1639 ap=1 s=9657 n(v0 rc2024-09-19T07:13:23.562015+0000 b9657 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ac25b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f81:[<0x10000000615/comment-81.xml v1351>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f81:[<0x10000000615/comment-81.xml v1639>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.040 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.633+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012ab [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-10.xml auth v1645 ap=1 s=7564 n(v0 rc2024-09-19T07:13:25.916958+0000 b7564 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ac26100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012ab:[<0x10000000615/comment-10.xml v1597>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000012ab:[<0x10000000615/comment-10.xml v1645>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.040 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.633+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dee [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-3.jpg auth{0=1} v1625 ap=1 s=30759 n(v0 rc2024-09-19T07:13:22.420042+0000 b30759 1=1+0) caps={24793=pAsLsXsFscr/pFscr@4} mcw={0=Fscr} | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c35ac26680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dee:[<0x10000000615/picture-3.jpg v1263>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000dee:[<0x10000000615/picture-3.jpg v1625>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.040 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.633+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000102f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-53.xml auth v1653 ap=1 s=9720 n(v0 rc2024-09-19T07:13:24.059003+0000 b9720 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ac26c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000102f:[<0x10000000615/comment-53.xml v1452>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000102f:[<0x10000000615/comment-53.xml v1653>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.041 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.633+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008e7 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-11.jpg auth v1105 ap=1 s=24057 n(v0 rc2024-09-19T07:13:17.205168+0000 b24057 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac46000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008e7:[<0x10000000615/picture-11.jpg v1105>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000008e7:[<0x10000000615/picture-11.jpg v1105>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.041 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.634+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f1b [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-85.xml auth v1647 ap=1 s=7629 n(v0 rc2024-09-19T07:13:23.270022+0000 b7629 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ac27700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f1b:[<0x10000000615/comment-85.xml v1329>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f1b:[<0x10000000615/comment-85.xml v1647>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.041 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.634+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000070a [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-5.xml auth v1097 ap=1 s=20933 n(v0 rc2024-09-19T07:13:15.777203+0000 b20933 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac46580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000070a:[<0x10000000615/article-5.xml v1097>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000070a:[<0x10000000615/article-5.xml v1097>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.041 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.634+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000069a [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-34.xml auth v1107 ap=1 s=24734 n(v0 rc2024-09-19T07:13:15.459211+0000 b24734 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac46b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000069a:[<0x10000000615/article-34.xml v1107>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000069a:[<0x10000000615/article-34.xml v1107>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.041 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.634+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010eb [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-35.xml auth v1635 ap=1 s=9309 n(v0 rc2024-09-19T07:13:24.482993+0000 b9309 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ac47080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010eb:[<0x10000000615/comment-35.xml v1527>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010eb:[<0x10000000615/comment-35.xml v1635>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.041 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.634+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001136 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-28.xml auth v1649 ap=1 s=9846 n(v0 rc2024-09-19T07:13:24.642989+0000 b9846 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ac47600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001136:[<0x10000000615/comment-28.xml v1550>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001136:[<0x10000000615/comment-28.xml v1649>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.041 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.635+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000617 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-81.xml auth v1087 ap=1 s=28506 n(v0 rc2024-09-19T07:13:15.081220+0000 b28506 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac48100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000617:[<0x10000000615/article-81.xml v1087>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000617:[<0x10000000615/article-81.xml v1087>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.041 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.635+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000101f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-57.xml auth v1631 ap=1 s=9794 n(v0 rc2024-09-19T07:13:24.001004+0000 b9794 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ac47b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000101f:[<0x10000000615/comment-57.xml v1439>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000101f:[<0x10000000615/comment-57.xml v1631>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.041 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.635+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006a9 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-29.xml auth v981 ap=1 s=14683 n(v0 rc2024-09-19T07:13:15.500210+0000 b14683 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac48c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006a9:[<0x10000000615/article-29.xml v981>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000006a9:[<0x10000000615/article-29.xml v981>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.041 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.672+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000061c [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-78.xml auth v1069 ap=1 s=4170 n(v0 rc2024-09-19T07:13:15.097219+0000 b4170 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac48680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000061c:[<0x10000000615/article-78.xml v1069>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000061c:[<0x10000000615/article-78.xml v1069>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.041 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.672+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000064d [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-60.xml auth v993 ap=1 s=24060 n(v0 rc2024-09-19T07:13:15.244216+0000 b24060 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac49180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000064d:[<0x10000000615/article-60.xml v993>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000064d:[<0x10000000615/article-60.xml v993>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.042 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.672+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000100f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-61.xml auth v1651 ap=1 s=7834 n(v0 rc2024-09-19T07:13:23.947005+0000 b7834 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ac49700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000100f:[<0x10000000615/comment-61.xml v1434>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000100f:[<0x10000000615/comment-61.xml v1651>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.042 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.672+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006c5 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-22.xml auth v955 ap=1 s=9735 n(v0 rc2024-09-19T07:13:15.574208+0000 b9735 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac50000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006c5:[<0x10000000615/article-22.xml v955>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000006c5:[<0x10000000615/article-22.xml v955>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.042 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.672+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010d2 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-38.xml auth v1629 ap=1 s=2271 n(v0 rc2024-09-19T07:13:24.437994+0000 b2271 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ac50580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010d2:[<0x10000000615/comment-38.xml v1517>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010d2:[<0x10000000615/comment-38.xml v1629>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.042 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.672+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fef [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-68.xml auth v1633 ap=1 s=5103 n(v0 rc2024-09-19T07:13:23.840008+0000 b5103 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ac50b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fef:[<0x10000000615/comment-68.xml v1400>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000fef:[<0x10000000615/comment-68.xml v1633>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.042 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.673+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000066d [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-49.xml auth v1065 ap=1 s=24964 n(v0 rc2024-09-19T07:13:15.341213+0000 b24964 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac51080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000066d:[<0x10000000615/article-49.xml v1065>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000066d:[<0x10000000615/article-49.xml v1065>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.042 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.673+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f95 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-80.xml auth v1641 ap=1 s=3773 n(v0 rc2024-09-19T07:13:23.590014+0000 b3773 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ac51b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f95:[<0x10000000615/comment-80.xml v1360>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f95:[<0x10000000615/comment-80.xml v1641>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.042 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.673+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000116f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-22.xml auth v1679 ap=1 s=5786 n(v0 rc2024-09-19T07:13:24.829984+0000 b5786 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ad1f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000116f:[<0x10000000615/comment-22.xml v1570>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000116f:[<0x10000000615/comment-22.xml v1679>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.042 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.673+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001085 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-44.xml auth v1677 ap=1 s=5711 n(v0 rc2024-09-19T07:13:24.307997+0000 b5711 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ad2c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001085:[<0x10000000615/comment-44.xml v1489>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001085:[<0x10000000615/comment-44.xml v1677>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.042 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.674+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000067f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-43.xml auth v999 ap=1 s=12738 n(v0 rc2024-09-19T07:13:15.387212+0000 b12738 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad2cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000067f:[<0x10000000615/article-43.xml v999>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000067f:[<0x10000000615/article-43.xml v999>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.042 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.674+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000069e [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-33.xml auth v1143 ap=1 s=4704 n(v0 rc2024-09-19T07:13:15.466210+0000 b4704 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad2d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000069e:[<0x10000000615/article-33.xml v1143>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000069e:[<0x10000000615/article-33.xml v1143>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.042 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.674+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e3f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-93.xml auth v1655 ap=1 s=3079 n(v0 rc2024-09-19T07:13:22.596038+0000 b3079 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ad2d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e3f:[<0x10000000615/comment-93.xml v1275>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000e3f:[<0x10000000615/comment-93.xml v1655>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.042 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.674+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a90 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-5.jpg auth v1647 ap=1 s=61138 n(v0 rc2024-09-19T07:13:22.167048+0000 b61138 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ad2db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a90:[<0x10000000615/picture-5.jpg v1243>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000a90:[<0x10000000615/picture-5.jpg v1647>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.043 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.674+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fbb [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-76.xml auth v1671 ap=1 s=4416 n(v0 rc2024-09-19T07:13:23.667012+0000 b4416 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ad2e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fbb:[<0x10000000615/comment-76.xml v1378>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000fbb:[<0x10000000615/comment-76.xml v1671>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.043 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.674+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000113d [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-27.xml auth v1675 ap=1 s=2095 n(v0 rc2024-09-19T07:13:24.657988+0000 b2095 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ad2e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000113d:[<0x10000000615/comment-27.xml v1554>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000113d:[<0x10000000615/comment-27.xml v1675>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.043 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.674+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000656 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-57.xml auth v969 ap=1 s=15859 n(v0 rc2024-09-19T07:13:15.277215+0000 b15859 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad2ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000656:[<0x10000000615/article-57.xml v969>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000656:[<0x10000000615/article-57.xml v969>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.043 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.675+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ff7 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-66.xml auth v1649 ap=1 s=7520 n(v0 rc2024-09-19T07:13:23.864007+0000 b7520 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ad2f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ff7:[<0x10000000615/comment-66.xml v1411>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ff7:[<0x10000000615/comment-66.xml v1649>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.043 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.675+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001036 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-52.xml auth v1673 ap=1 s=4165 n(v0 rc2024-09-19T07:13:24.087002+0000 b4165 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ad2f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001036:[<0x10000000615/comment-52.xml v1458>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001036:[<0x10000000615/comment-52.xml v1673>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.043 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.675+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000061a [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-79.xml auth v1221 ap=1 s=22317 n(v0 rc2024-09-19T07:13:15.092219+0000 b22317 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad36580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000061a:[<0x10000000615/article-79.xml v1221>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000061a:[<0x10000000615/article-79.xml v1221>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.043 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.675+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011a6 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-15.xml auth v1667 ap=1 s=2737 n(v0 rc2024-09-19T07:13:25.032979+0000 b2737 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ad36b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011a6:[<0x10000000615/comment-15.xml v1585>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011a6:[<0x10000000615/comment-15.xml v1667>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.043 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.675+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000652 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-58.xml auth v1089 ap=1 s=1027 n(v0 rc2024-09-19T07:13:15.267215+0000 b1027 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad37080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000652:[<0x10000000615/article-58.xml v1089>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000652:[<0x10000000615/article-58.xml v1089>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.044 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.675+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001094 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-43.xml auth v1651 ap=1 s=2093 n(v0 rc2024-09-19T07:13:24.332996+0000 b2093 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ad37b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001094:[<0x10000000615/comment-43.xml v1495>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001094:[<0x10000000615/comment-43.xml v1651>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.044 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.676+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000662 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-53.xml auth v1159 ap=1 s=13594 n(v0 rc2024-09-19T07:13:15.307214+0000 b13594 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad37600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000662:[<0x10000000615/article-53.xml v1159>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000662:[<0x10000000615/article-53.xml v1159>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.044 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.676+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001195 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-17.xml auth v1665 ap=1 s=6361 n(v0 rc2024-09-19T07:13:24.967981+0000 b6361 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ad38100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001195:[<0x10000000615/comment-17.xml v1580>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001195:[<0x10000000615/comment-17.xml v1665>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.044 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.676+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006ae [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-28.xml auth v1093 ap=1 s=29609 n(v0 rc2024-09-19T07:13:15.509209+0000 b29609 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@4},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad38680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006ae:[<0x10000000615/article-28.xml v1093>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000006ae:[<0x10000000615/article-28.xml v1093>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.044 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.676+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012b4 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-9.xml auth v1659 ap=1 s=3434 n(v0 rc2024-09-19T07:13:25.942957+0000 b3434 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ad38c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012b4:[<0x10000000615/comment-9.xml v1606>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000012b4:[<0x10000000615/comment-9.xml v1659>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.044 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.676+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009d2 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-99.xml auth v1209 ap=1 s=9862 n(v0 rc2024-09-19T07:13:18.397139+0000 b9862 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24793 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad39700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009d2:[<0x10000000615/comment-99.xml v1209>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000009d2:[<0x10000000615/comment-99.xml v1209>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.044 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.677+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001079 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-45.xml auth v1663 ap=1 s=9017 n(v0 rc2024-09-19T07:13:24.281997+0000 b9017 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ad3e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001079:[<0x10000000615/comment-45.xml v1482>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001079:[<0x10000000615/comment-45.xml v1663>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.044 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.677+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f29 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-84.xml auth v1661 ap=1 s=9702 n(v0 rc2024-09-19T07:13:23.330020+0000 b9702 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ad3e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f29:[<0x10000000615/comment-84.xml v1329>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f29:[<0x10000000615/comment-84.xml v1661>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.045 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.677+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000065b [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-55.xml auth v1039 ap=1 s=13173 n(v0 rc2024-09-19T07:13:15.293215+0000 b13173 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35b01db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000065b:[<0x10000000615/article-55.xml v1039>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000065b:[<0x10000000615/article-55.xml v1039>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.045 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.677+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000074f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-25.jpg auth v1115 ap=1 s=58826 n(v0 rc2024-09-19T07:13:15.973198+0000 b58826 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@5},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35b01e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000074f:[<0x10000000615/picture-25.jpg v1115>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000074f:[<0x10000000615/picture-25.jpg v1115>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.045 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.677+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a6f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-97.xml auth v1630 ap=1 s=9399 n(v0 rc2024-09-19T07:13:19.556111+0000 b9399 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=24793 | importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35b01e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a6f:[<0x10000000615/comment-97.xml v1237>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000a6f:[<0x10000000615/comment-97.xml v1630>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.045 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.678+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006f8 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-8.xml auth{0=1} v1079 ap=1 s=16313 n(v0 rc2024-09-19T07:13:15.717204+0000 b16313 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=24793 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c35b01ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006f8:[<0x10000000615/article-8.xml v1079>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000006f8:[<0x10000000615/article-8.xml v1079>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.045 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.678+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001063 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-47.xml auth v1638 ap=1 s=4398 n(v0 rc2024-09-19T07:13:24.229999+0000 b4398 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35b01f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001063:[<0x10000000615/comment-47.xml v1462>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001063:[<0x10000000615/comment-47.xml v1638>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.045 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.678+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001070 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-46.xml auth v1652 ap=1 s=8157 n(v0 rc2024-09-19T07:13:24.265998+0000 b8157 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35b01f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001070:[<0x10000000615/comment-46.xml v1467>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001070:[<0x10000000615/comment-46.xml v1652>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.045 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.678+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007b1 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-68.xml auth v1047 ap=1 s=31874 n(v0 rc2024-09-19T07:13:16.281191+0000 b31874 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35b028000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007b1:[<0x10000000615/article-68.xml v1047>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000007b1:[<0x10000000615/article-68.xml v1047>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.045 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.678+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fe1 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-70.xml auth v1636 ap=1 s=9879 n(v0 rc2024-09-19T07:13:23.801009+0000 b9879 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35b028580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fe1:[<0x10000000615/comment-70.xml v1405>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000fe1:[<0x10000000615/comment-70.xml v1636>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.045 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.678+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000620 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-76.xml auth v977 ap=1 s=8631 n(v0 rc2024-09-19T07:13:15.106219+0000 b8631 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35b028b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000620:[<0x10000000615/article-76.xml v977>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000620:[<0x10000000615/article-76.xml v977>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.045 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.678+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009b8 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-8.jpg auth{0=1} v1137 ap=1 s=54476 n(v0 rc2024-09-19T07:13:17.867152+0000 b54476 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=24793 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c35b029080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009b8:[<0x10000000615/picture-8.jpg v1137>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000009b8:[<0x10000000615/picture-8.jpg v1137>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.045 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.679+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000747 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-26.jpg auth v997 ap=1 s=52038 n(v0 rc2024-09-19T07:13:15.951199+0000 b52038 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35b029600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000747:[<0x10000000615/picture-26.jpg v997>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000747:[<0x10000000615/picture-26.jpg v997>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.046 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.679+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a56 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-98.xml auth v965 ap=1 s=6359 n(v0 rc2024-09-19T07:13:18.457138+0000 b6359 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24793 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35b029b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a56:[<0x10000000615/comment-98.xml v965>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000a56:[<0x10000000615/comment-98.xml v965>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.046 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.679+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006a0 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-32.xml auth v1157 ap=1 s=31627 n(v0 rc2024-09-19T07:13:15.475210+0000 b31627 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35b02a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006a0:[<0x10000000615/article-32.xml v1157>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000006a0:[<0x10000000615/article-32.xml v1157>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.046 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.679+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f3d [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-83.xml auth v1634 ap=1 s=4694 n(v0 rc2024-09-19T07:13:23.489016+0000 b4694 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35b02a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f3d:[<0x10000000615/comment-83.xml v1341>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f3d:[<0x10000000615/comment-83.xml v1634>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.046 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.679+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fec [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-69.xml auth v1660 ap=1 s=5818 n(v0 rc2024-09-19T07:13:23.819008+0000 b5818 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35b02ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fec:[<0x10000000615/comment-69.xml v1410>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000fec:[<0x10000000615/comment-69.xml v1660>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.046 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.679+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ef0 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-89.xml auth v1656 ap=1 s=6214 n(v0 rc2024-09-19T07:13:23.073026+0000 b6214 1=1+0) caps={24793=pFc/Fc@2} | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35b032000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ef0:[<0x10000000615/comment-89.xml v1307>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ef0:[<0x10000000615/comment-89.xml v1656>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.046 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.680+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006c8 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-21.xml auth v1217 ap=1 s=5426 n(v0 rc2024-09-19T07:13:15.581208+0000 b5426 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@5},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35b02b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006c8:[<0x10000000615/article-21.xml v1217>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000006c8:[<0x10000000615/article-21.xml v1217>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.046 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.680+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006a7 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-30.xml auth v1085 ap=1 s=20274 n(v0 rc2024-09-19T07:13:15.489210+0000 b20274 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35b02b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006a7:[<0x10000000615/article-30.xml v1085>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000006a7:[<0x10000000615/article-30.xml v1085>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.046 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.680+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fcf [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-74.xml auth v1658 ap=1 s=5443 n(v0 rc2024-09-19T07:13:23.734010+0000 b5443 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35b032580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fcf:[<0x10000000615/comment-74.xml v1387>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000fcf:[<0x10000000615/comment-74.xml v1658>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.046 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.680+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010e4 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-36.xml auth v1632 ap=1 s=8775 n(v0 rc2024-09-19T07:13:24.467993+0000 b8775 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35b032b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010e4:[<0x10000000615/comment-36.xml v1526>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010e4:[<0x10000000615/comment-36.xml v1632>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.046 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.680+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006e0 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-13.xml auth{0=1} v1622 ap=1 s=8576 n(v0 rc2024-09-19T07:13:15.645206+0000 b8576 1=1+0) caps={24793=pAsLsXsFscr/pFscr@4} mcw={0=Fscr} | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c35b033080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006e0:[<0x10000000615/article-13.xml v1029>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000006e0:[<0x10000000615/article-13.xml v1622>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.046 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.681+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001001 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-64.xml auth v1644 ap=1 s=6377 n(v0 rc2024-09-19T07:13:23.898007+0000 b6377 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35b033600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001001:[<0x10000000615/comment-64.xml v1420>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001001:[<0x10000000615/comment-64.xml v1644>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.046 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.681+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fd8 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-72.xml auth v1640 ap=1 s=6463 n(v0 rc2024-09-19T07:13:23.762010+0000 b6463 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35b033b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fd8:[<0x10000000615/comment-72.xml v1394>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000fd8:[<0x10000000615/comment-72.xml v1640>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.047 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.681+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000066b [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-50.xml auth v971 ap=1 s=21444 n(v0 rc2024-09-19T07:13:15.330214+0000 b21444 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35b034680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000066b:[<0x10000000615/article-50.xml v971>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000066b:[<0x10000000615/article-50.xml v971>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.047 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.681+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f86 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-6.xml auth{0=1} v1648 ap=1 s=4944 n(v0 rc2024-09-19T07:13:23.569014+0000 b4944 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@2},l=24793 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c35b034c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f86:[<0x10000000615/article-6.xml v1347>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f86:[<0x10000000615/article-6.xml v1648>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.047 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.681+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000722 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-2.xml auth{0=1} v1095 ap=1 s=28833 n(v0 rc2024-09-19T07:13:15.888200+0000 b28833 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=24793 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c35b035180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000722:[<0x10000000615/article-2.xml v1095>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000722:[<0x10000000615/article-2.xml v1095>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.047 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.682+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011af [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-14.xml auth v1654 ap=1 s=8987 n(v0 rc2024-09-19T07:13:25.065978+0000 b8987 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35b035700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011af:[<0x10000000615/comment-14.xml v1589>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011af:[<0x10000000615/comment-14.xml v1654>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.047 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.682+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ff3 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-67.xml auth v1642 ap=1 s=2922 n(v0 rc2024-09-19T07:13:23.853008+0000 b2922 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35b040000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ff3:[<0x10000000615/comment-67.xml v1415>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ff3:[<0x10000000615/comment-67.xml v1642>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.047 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.682+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001186 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-19.xml auth v1650 ap=1 s=9178 n(v0 rc2024-09-19T07:13:24.914982+0000 b9178 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35b040580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001186:[<0x10000000615/comment-19.xml v1584>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001186:[<0x10000000615/comment-19.xml v1650>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.047 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.682+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000659 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-56.xml auth v1169 ap=1 s=11963 n(v0 rc2024-09-19T07:13:15.284215+0000 b11963 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35b040b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000659:[<0x10000000615/article-56.xml v1169>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000659:[<0x10000000615/article-56.xml v1169>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.047 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.682+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000619 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-80.xml auth v937 ap=1 s=20704 n(v0 rc2024-09-19T07:13:15.086220+0000 b20704 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ace3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000619:[<0x10000000615/article-80.xml v937>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000619:[<0x10000000615/article-80.xml v937>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.047 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.682+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010db [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-37.xml auth v1636 ap=1 s=10205 n(v0 rc2024-09-19T07:13:24.449993+0000 b10205 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ace4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010db:[<0x10000000615/comment-37.xml v1522>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010db:[<0x10000000615/comment-37.xml v1636>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.048 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.682+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fdd [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-71.xml auth v1642 ap=1 s=4134 n(v0 rc2024-09-19T07:13:23.782009+0000 b4134 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ace4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fdd:[<0x10000000615/comment-71.xml v1388>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000fdd:[<0x10000000615/comment-71.xml v1642>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.048 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.683+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008f7 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-10.jpg auth v1075 ap=1 s=21831 n(v0 rc2024-09-19T07:13:17.249167+0000 b21831 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ace4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008f7:[<0x10000000615/picture-10.jpg v1075>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000008f7:[<0x10000000615/picture-10.jpg v1075>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.048 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.683+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000de8 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-95.xml auth v1630 ap=1 s=2413 n(v0 rc2024-09-19T07:13:22.350044+0000 b2413 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ace5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000de8:[<0x10000000615/comment-95.xml v1261>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000de8:[<0x10000000615/comment-95.xml v1630>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.048 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.683+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e56 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-1.jpg auth{0=1} v1620 ap=1 s=12774 n(v0 rc2024-09-19T07:13:22.756034+0000 b12774 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@2},l=24793 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c35ace5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e56:[<0x10000000615/picture-1.jpg v1277>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000e56:[<0x10000000615/picture-1.jpg v1620>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.048 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.683+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000119b [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-16.xml auth v1628 ap=1 s=7989 n(v0 rc2024-09-19T07:13:24.992980+0000 b7989 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ad14000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000119b:[<0x10000000615/comment-16.xml v1597>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000119b:[<0x10000000615/comment-16.xml v1628>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.048 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.683+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006f2 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-9.xml auth v1059 ap=1 s=25304 n(v0 rc2024-09-19T07:13:15.698205+0000 b25304 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad14580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006f2:[<0x10000000615/article-9.xml v1059>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000006f2:[<0x10000000615/article-9.xml v1059>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.048 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.683+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fa2 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-44.xml auth v1632 ap=1 s=26414 n(v0 rc2024-09-19T07:13:23.615013+0000 b26414 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ad14b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fa2:[<0x10000000615/article-44.xml v1362>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000fa2:[<0x10000000615/article-44.xml v1632>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.048 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.683+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a60 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-6.jpg auth v1149 ap=1 s=28519 n(v0 rc2024-09-19T07:13:18.489137+0000 b28519 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad15080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a60:[<0x10000000615/picture-6.jpg v1149>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000a60:[<0x10000000615/picture-6.jpg v1149>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.048 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.684+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000063a [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-65.xml auth v987 ap=1 s=26340 n(v0 rc2024-09-19T07:13:15.183217+0000 b26340 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad15b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000063a:[<0x10000000615/article-65.xml v987>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000063a:[<0x10000000615/article-65.xml v987>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.048 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.684+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007c1 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-99.xml auth v1181 ap=1 s=6539 n(v0 rc2024-09-19T07:13:16.314190+0000 b6539 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24793 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad15600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007c1:[<0x10000000615/article-99.xml v1181>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000007c1:[<0x10000000615/article-99.xml v1181>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.048 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.684+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000101b [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-58.xml auth v1638 ap=1 s=7541 n(v0 rc2024-09-19T07:13:23.987004+0000 b7541 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ad16100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000101b:[<0x10000000615/comment-58.xml v1429>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000101b:[<0x10000000615/comment-58.xml v1638>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.049 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.684+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000647 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-62.xml auth v991 ap=1 s=19404 n(v0 rc2024-09-19T07:13:15.222216+0000 b19404 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad16680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000647:[<0x10000000615/article-62.xml v991>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000647:[<0x10000000615/article-62.xml v991>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.049 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.684+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006be [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-24.xml auth v995 ap=1 s=29823 n(v0 rc2024-09-19T07:13:15.555208+0000 b29823 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@5},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad17180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006be:[<0x10000000615/article-24.xml v995>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000006be:[<0x10000000615/article-24.xml v995>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.049 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.684+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001027 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-55.xml auth v1640 ap=1 s=4005 n(v0 rc2024-09-19T07:13:24.042003+0000 b4005 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ad16c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001027:[<0x10000000615/comment-55.xml v1441>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001027:[<0x10000000615/comment-55.xml v1640>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.049 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.685+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010f3 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-34.xml auth v1644 ap=1 s=4908 n(v0 rc2024-09-19T07:13:24.494992+0000 b4908 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ad17700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010f3:[<0x10000000615/comment-34.xml v1533>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010f3:[<0x10000000615/comment-34.xml v1644>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.049 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.685+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000114f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-25.xml auth v1626 ap=1 s=10017 n(v0 rc2024-09-19T07:13:24.714987+0000 b10017 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ad1c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000114f:[<0x10000000615/comment-25.xml v1562>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000114f:[<0x10000000615/comment-25.xml v1626>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.049 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.685+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010b1 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-41.xml auth v1634 ap=1 s=4324 n(v0 rc2024-09-19T07:13:24.378995+0000 b4324 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ad1c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010b1:[<0x10000000615/comment-41.xml v1513>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010b1:[<0x10000000615/comment-41.xml v1634>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.049 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.685+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000637 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-67.xml auth v959 ap=1 s=8486 n(v0 rc2024-09-19T07:13:15.171217+0000 b8486 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad1cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000637:[<0x10000000615/article-67.xml v959>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000637:[<0x10000000615/article-67.xml v959>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.049 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.685+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fc0 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-75.xml auth v1624 ap=1 s=3061 n(v0 rc2024-09-19T07:13:23.690012+0000 b3061 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ad1d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fc0:[<0x10000000615/comment-75.xml v1385>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000fc0:[<0x10000000615/comment-75.xml v1624>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.049 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.685+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007e3 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-17.jpg auth v989 ap=1 s=25045 n(v0 rc2024-09-19T07:13:16.417187+0000 b25045 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad1d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007e3:[<0x10000000615/picture-17.jpg v989>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000007e3:[<0x10000000615/picture-17.jpg v989>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.049 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.686+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000071a [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-3.xml auth{0=1} v1616 ap=1 s=19044 n(v0 rc2024-09-19T07:13:15.834201+0000 b19044 1=1+0) caps={24793=pAsLsXsFscr/pFscr@4} mcw={0=Fscr} | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c35ad1db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000071a:[<0x10000000615/article-3.xml v1023>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000071a:[<0x10000000615/article-3.xml v1616>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.049 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.686+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000759 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-24.jpg auth v973 ap=1 s=44127 n(v0 rc2024-09-19T07:13:16.001197+0000 b44127 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@4},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad1e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000759:[<0x10000000615/picture-24.jpg v973>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000759:[<0x10000000615/picture-24.jpg v973>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.050 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.686+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006fe [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-7.xml auth v1045 ap=1 s=3182 n(v0 rc2024-09-19T07:13:15.739204+0000 b3182 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad1e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006fe:[<0x10000000615/article-7.xml v1045>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000006fe:[<0x10000000615/article-7.xml v1045>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.050 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.686+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001164 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-23.xml auth v1622 ap=1 s=9270 n(v0 rc2024-09-19T07:13:24.789985+0000 b9270 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ad1ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001164:[<0x10000000615/comment-23.xml v1572>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001164:[<0x10000000615/comment-23.xml v1622>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.050 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.686+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000115c [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-24.xml auth v1646 ap=1 s=6068 n(v0 rc2024-09-19T07:13:24.760986+0000 b6068 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ad1f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000115c:[<0x10000000615/comment-24.xml v1567>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000115c:[<0x10000000615/comment-24.xml v1646>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.050 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.686+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000650 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-59.xml auth v1013 ap=1 s=24294 n(v0 rc2024-09-19T07:13:15.254215+0000 b24294 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ae1ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000650:[<0x10000000615/article-59.xml v1013>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000650:[<0x10000000615/article-59.xml v1013>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.050 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.687+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000833 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-13.jpg auth v1021 ap=1 s=48301 n(v0 rc2024-09-19T07:13:16.600183+0000 b48301 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ae1b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000833:[<0x10000000615/picture-13.jpg v1021>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000833:[<0x10000000615/picture-13.jpg v1021>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.050 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.687+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001021 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-56.xml auth v1653 ap=1 s=5567 n(v0 rc2024-09-19T07:13:24.024004+0000 b5567 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae1b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001021:[<0x10000000615/comment-56.xml v1433>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001021:[<0x10000000615/comment-56.xml v1653>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.050 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.687+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000624 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-74.xml auth v1077 ap=1 s=21128 n(v0 rc2024-09-19T07:13:15.118219+0000 b21128 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ab5c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000624:[<0x10000000615/article-74.xml v1077>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000624:[<0x10000000615/article-74.xml v1077>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.050 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.687+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007c8 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-18.jpg auth v1135 ap=1 s=11551 n(v0 rc2024-09-19T07:13:16.337189+0000 b11551 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@5},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ab5cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007c8:[<0x10000000615/picture-18.jpg v1135>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000007c8:[<0x10000000615/picture-18.jpg v1135>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.050 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.687+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006d1 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-18.xml auth v1189 ap=1 s=2313 n(v0 rc2024-09-19T07:13:15.606207+0000 b2313 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@5},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ae2e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006d1:[<0x10000000615/article-18.xml v1189>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000006d1:[<0x10000000615/article-18.xml v1189>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.050 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.687+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007ae [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-19.jpg auth v1173 ap=1 s=37468 n(v0 rc2024-09-19T07:13:16.268191+0000 b37468 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@5},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ae2eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007ae:[<0x10000000615/picture-19.jpg v1173>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000007ae:[<0x10000000615/picture-19.jpg v1173>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.050 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.688+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000667 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-51.xml auth v1053 ap=1 s=22732 n(v0 rc2024-09-19T07:13:15.323214+0000 b22732 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ae2f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000667:[<0x10000000615/article-51.xml v1053>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000667:[<0x10000000615/article-51.xml v1053>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.050 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.688+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000112d [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-29.xml auth v1651 ap=1 s=6566 n(v0 rc2024-09-19T07:13:24.615989+0000 b6566 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae2f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000112d:[<0x10000000615/comment-29.xml v1548>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000112d:[<0x10000000615/comment-29.xml v1651>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.051 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.688+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006b3 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-27.xml auth v1009 ap=1 s=25686 n(v0 rc2024-09-19T07:13:15.520209+0000 b25686 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@5},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ae2fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006b3:[<0x10000000615/article-27.xml v1009>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000006b3:[<0x10000000615/article-27.xml v1009>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.051 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.688+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dd0 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-4.jpg auth{0=1} v1643 ap=1 s=21991 n(v0 rc2024-09-19T07:13:22.293045+0000 b21991 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@2},l=24793 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c35ae30100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dd0:[<0x10000000615/picture-4.jpg v1253>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000dd0:[<0x10000000615/picture-4.jpg v1643>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.051 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.688+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e19 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-2.jpg auth{0=1} v1645 ap=1 s=22605 n(v0 rc2024-09-19T07:13:22.583038+0000 b22605 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@2},l=24793 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c35ae30680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e19:[<0x10000000615/picture-2.jpg v1266>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000e19:[<0x10000000615/picture-2.jpg v1645>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.051 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.689+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006ca [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-20.xml auth v967 ap=1 s=29812 n(v0 rc2024-09-19T07:13:15.589207+0000 b29812 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@5},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ae31180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006ca:[<0x10000000615/article-20.xml v967>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000006ca:[<0x10000000615/article-20.xml v967>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.051 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.689+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000064a [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-61.xml auth v1037 ap=1 s=11250 n(v0 rc2024-09-19T07:13:15.232216+0000 b11250 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ae40580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000064a:[<0x10000000615/article-61.xml v1037>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000064a:[<0x10000000615/article-61.xml v1037>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.051 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.689+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000685 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-41.xml auth v1171 ap=1 s=25789 n(v0 rc2024-09-19T07:13:15.403212+0000 b25789 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ae40b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000685:[<0x10000000615/article-41.xml v1171>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000685:[<0x10000000615/article-41.xml v1171>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.051 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.689+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000679 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-45.xml auth v1005 ap=1 s=5119 n(v0 rc2024-09-19T07:13:15.371213+0000 b5119 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ae41080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000679:[<0x10000000615/article-45.xml v1005>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000679:[<0x10000000615/article-45.xml v1005>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.051 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.689+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000632 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-69.xml auth v1145 ap=1 s=2485 n(v0 rc2024-09-19T07:13:15.158218+0000 b2485 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ae41600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000632:[<0x10000000615/article-69.xml v1145>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000632:[<0x10000000615/article-69.xml v1145>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.051 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.690+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e09 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-94.xml auth v1639 ap=1 s=2871 n(v0 rc2024-09-19T07:13:22.436042+0000 b2871 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae41b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e09:[<0x10000000615/comment-94.xml v1261>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000e09:[<0x10000000615/comment-94.xml v1639>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.051 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.690+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a4e [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-7.jpg auth{0=1} v1632 ap=1 s=58724 n(v0 rc2024-09-19T07:13:18.437139+0000 b58724 1=1+0) caps={24793=pAsLsXsFscr/pFscr@4} mcw={0=Fscr} | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c35ae42100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a4e:[<0x10000000615/picture-7.jpg v1203>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000a4e:[<0x10000000615/picture-7.jpg v1632>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.051 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.690+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006a3 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-31.xml auth v979 ap=1 s=24648 n(v0 rc2024-09-19T07:13:15.482210+0000 b24648 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ae42680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006a3:[<0x10000000615/article-31.xml v979>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000006a3:[<0x10000000615/article-31.xml v979>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.052 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.691+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011e5 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-11.xml auth v1647 ap=1 s=6576 n(v0 rc2024-09-19T07:13:25.256974+0000 b6576 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae43180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011e5:[<0x10000000615/comment-11.xml v1585>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011e5:[<0x10000000615/comment-11.xml v1647>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.052 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.691+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001181 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-20.xml auth v1649 ap=1 s=5427 n(v0 rc2024-09-19T07:13:24.891983+0000 b5427 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae43700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001181:[<0x10000000615/comment-20.xml v1580>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001181:[<0x10000000615/comment-20.xml v1649>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.052 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.691+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ed3 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-13.jpg auth v424 ap=1 s=28154 n(v0 rc2024-09-19T07:13:22.992028+0000 b28154 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae7f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ed3:[<0x10000000e7a/picture-13.jpg v208>,<0x10000000399/blog-19 v28810>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ed3:[<0x10000000e7a/picture-13.jpg v424>,<0x10000000399/blog-19 v54954>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.052 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.691+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e99 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-18.xml auth v378 ap=1 s=14326 n(v0 rc2024-09-19T07:13:22.848032+0000 b14326 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af02000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e99:[<0x10000000e7a/article-18.xml v76>,<0x10000000399/blog-19 v28810>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000e99:[<0x10000000e7a/article-18.xml v378>,<0x10000000399/blog-19 v54954>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.052 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.692+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e83 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-27.xml auth v470 ap=1 s=18784 n(v0 rc2024-09-19T07:13:22.788033+0000 b18784 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af02580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e83:[<0x10000000e7a/article-27.xml v22>,<0x10000000399/blog-19 v28810>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000e83:[<0x10000000e7a/article-27.xml v470>,<0x10000000399/blog-19 v54954>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.052 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.692+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ee8 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-4.jpg auth v376 ap=1 s=25188 n(v0 rc2024-09-19T07:13:23.052027+0000 b25188 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af02b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ee8:[<0x10000000e7a/picture-4.jpg v262>,<0x10000000399/blog-19 v28810>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ee8:[<0x10000000e7a/picture-4.jpg v376>,<0x10000000399/blog-19 v54954>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.052 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.692+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000eef [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-2.jpg auth v384 ap=1 s=16136 n(v0 rc2024-09-19T07:13:23.072026+0000 b16136 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af03080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000eef:[<0x10000000e7a/picture-2.jpg v274>,<0x10000000399/blog-19 v28810>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000eef:[<0x10000000e7a/picture-2.jpg v384>,<0x10000000399/blog-19 v54954>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.052 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.692+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e94 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-20.xml auth v412 ap=1 s=9298 n(v0 rc2024-09-19T07:13:22.834032+0000 b9298 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af03600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e94:[<0x10000000e7a/article-20.xml v64>,<0x10000000399/blog-19 v28810>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000e94:[<0x10000000e7a/article-20.xml v412>,<0x10000000399/blog-19 v54954>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.052 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.693+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ed1 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-14.jpg auth v408 ap=1 s=52920 n(v0 rc2024-09-19T07:13:22.986029+0000 b52920 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af03b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ed1:[<0x10000000e7a/picture-14.jpg v202>,<0x10000000399/blog-19 v28810>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ed1:[<0x10000000e7a/picture-14.jpg v408>,<0x10000000399/blog-19 v54954>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.052 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.693+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ee1 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-7.jpg auth v396 ap=1 s=13147 n(v0 rc2024-09-19T07:13:23.032027+0000 b13147 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af04100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ee1:[<0x10000000e7a/picture-7.jpg v244>,<0x10000000399/blog-19 v28810>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ee1:[<0x10000000e7a/picture-7.jpg v396>,<0x10000000399/blog-19 v54954>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.053 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.693+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000edc [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-9.jpg auth v468 ap=1 s=12399 n(v0 rc2024-09-19T07:13:23.019028+0000 b12399 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af04680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000edc:[<0x10000000e7a/picture-9.jpg v232>,<0x10000000399/blog-19 v28810>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000edc:[<0x10000000e7a/picture-9.jpg v468>,<0x10000000399/blog-19 v54954>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.053 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.693+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ef2 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-1.jpg auth v374 ap=1 s=38267 n(v0 rc2024-09-19T07:13:23.099026+0000 b38267 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af05180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ef2:[<0x10000000e7a/picture-1.jpg v280>,<0x10000000399/blog-19 v28810>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ef2:[<0x10000000e7a/picture-1.jpg v374>,<0x10000000399/blog-19 v54954>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.053 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.694+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000eb4 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-9.xml auth v414 ap=1 s=32754 n(v0 rc2024-09-19T07:13:22.907030+0000 b32754 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af05700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000eb4:[<0x10000000e7a/article-9.xml v130>,<0x10000000399/blog-19 v28810>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000eb4:[<0x10000000e7a/article-9.xml v414>,<0x10000000399/blog-19 v54954>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.053 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.694+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ee3 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-6.jpg auth v410 ap=1 s=35283 n(v0 rc2024-09-19T07:13:23.038027+0000 b35283 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af0e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ee3:[<0x10000000e7a/picture-6.jpg v250>,<0x10000000399/blog-19 v28810>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ee3:[<0x10000000e7a/picture-6.jpg v410>,<0x10000000399/blog-19 v54954>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.053 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.694+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e8a [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-24.xml auth v436 ap=1 s=6065 n(v0 rc2024-09-19T07:13:22.807033+0000 b6065 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af0e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e8a:[<0x10000000e7a/article-24.xml v40>,<0x10000000399/blog-19 v28810>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000e8a:[<0x10000000e7a/article-24.xml v436>,<0x10000000399/blog-19 v54954>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.053 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.694+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012e0 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-92.jpg auth v456 ap=1 s=12322 n(v0 rc2024-09-19T07:13:26.092954+0000 b12322 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af0eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012e0:[<0x10000000e7a/picture-92.jpg v286>,<0x10000000399/blog-19 v28810>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000012e0:[<0x10000000e7a/picture-92.jpg v456>,<0x10000000399/blog-19 v54954>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.053 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.695+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ec9 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-17.jpg auth v442 ap=1 s=28873 n(v0 rc2024-09-19T07:13:22.965029+0000 b28873 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af0f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ec9:[<0x10000000e7a/picture-17.jpg v184>,<0x10000000399/blog-19 v28810>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ec9:[<0x10000000e7a/picture-17.jpg v442>,<0x10000000399/blog-19 v54954>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.053 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.695+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ec2 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-3.xml auth v390 ap=1 s=12609 n(v0 rc2024-09-19T07:13:22.946030+0000 b12609 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af0f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ec2:[<0x10000000e7a/article-3.xml v166>,<0x10000000399/blog-19 v28810>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ec2:[<0x10000000e7a/article-3.xml v390>,<0x10000000399/blog-19 v54954>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.053 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.695+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000eb9 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-7.xml auth v416 ap=1 s=24123 n(v0 rc2024-09-19T07:13:22.920030+0000 b24123 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af0fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000eb9:[<0x10000000e7a/article-7.xml v142>,<0x10000000399/blog-19 v28810>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000eb9:[<0x10000000e7a/article-7.xml v416>,<0x10000000399/blog-19 v54954>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.054 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.695+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000eb6 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-8.xml auth v458 ap=1 s=31625 n(v0 rc2024-09-19T07:13:22.913030+0000 b31625 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af10100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000eb6:[<0x10000000e7a/article-8.xml v136>,<0x10000000399/blog-19 v28810>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000eb6:[<0x10000000e7a/article-8.xml v458>,<0x10000000399/blog-19 v54954>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.054 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.696+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000edf [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-8.jpg auth v394 ap=1 s=60137 n(v0 rc2024-09-19T07:13:23.025028+0000 b60137 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af10680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000edf:[<0x10000000e7a/picture-8.jpg v238>,<0x10000000399/blog-19 v28810>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000edf:[<0x10000000e7a/picture-8.jpg v394>,<0x10000000399/blog-19 v54954>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.054 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.696+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e7c [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-30.xml auth v370 ap=1 s=21516 n(v0 rc2024-09-19T07:13:22.768034+0000 b21516 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af11180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e7c:[<0x10000000e7a/article-30.xml v4>,<0x10000000399/blog-19 v28810>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000e7c:[<0x10000000e7a/article-30.xml v370>,<0x10000000399/blog-19 v54954>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.054 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.697+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000eab [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-13.xml auth v398 ap=1 s=22932 n(v0 rc2024-09-19T07:13:22.881031+0000 b22932 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af11700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000eab:[<0x10000000e7a/article-13.xml v106>,<0x10000000399/blog-19 v28810>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000eab:[<0x10000000e7a/article-13.xml v398>,<0x10000000399/blog-19 v54954>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.054 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.697+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ebb [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-6.xml auth v466 ap=1 s=10827 n(v0 rc2024-09-19T07:13:22.926030+0000 b10827 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af18000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ebb:[<0x10000000e7a/article-6.xml v148>,<0x10000000399/blog-19 v28810>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ebb:[<0x10000000e7a/article-6.xml v466>,<0x10000000399/blog-19 v54954>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.054 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.698+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ec5 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-2.xml auth v402 ap=1 s=22132 n(v0 rc2024-09-19T07:13:22.952029+0000 b22132 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af18580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ec5:[<0x10000000e7a/article-2.xml v172>,<0x10000000399/blog-19 v28810>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ec5:[<0x10000000e7a/article-2.xml v402>,<0x10000000399/blog-19 v54954>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.054 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.698+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ee6 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-5.jpg auth v382 ap=1 s=65404 n(v0 rc2024-09-19T07:13:23.045027+0000 b65404 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af18b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ee6:[<0x10000000e7a/picture-5.jpg v256>,<0x10000000399/blog-19 v28810>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ee6:[<0x10000000e7a/picture-5.jpg v382>,<0x10000000399/blog-19 v54954>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.054 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.699+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e81 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-28.xml auth v400 ap=1 s=30731 n(v0 rc2024-09-19T07:13:22.782033+0000 b30731 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af19080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e81:[<0x10000000e7a/article-28.xml v16>,<0x10000000399/blog-19 v28810>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000e81:[<0x10000000e7a/article-28.xml v400>,<0x10000000399/blog-19 v54954>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.054 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.700+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000eeb [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-3.jpg auth v404 ap=1 s=36943 n(v0 rc2024-09-19T07:13:23.062027+0000 b36943 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af19600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000eeb:[<0x10000000e7a/picture-3.jpg v268>,<0x10000000399/blog-19 v28810>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000eeb:[<0x10000000e7a/picture-3.jpg v404>,<0x10000000399/blog-19 v54954>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.054 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.700+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ed8 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-11.jpg auth v392 ap=1 s=64174 n(v0 rc2024-09-19T07:13:23.006028+0000 b64174 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af19b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ed8:[<0x10000000e7a/picture-11.jpg v220>,<0x10000000399/blog-19 v28810>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ed8:[<0x10000000e7a/picture-11.jpg v392>,<0x10000000399/blog-19 v54954>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.054 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.701+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ebe [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-5.xml auth v372 ap=1 s=21200 n(v0 rc2024-09-19T07:13:22.933030+0000 b21200 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af1a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ebe:[<0x10000000e7a/article-5.xml v154>,<0x10000000399/blog-19 v28810>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ebe:[<0x10000000e7a/article-5.xml v372>,<0x10000000399/blog-19 v54954>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.054 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.701+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e7e [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-29.xml auth v438 ap=1 s=27156 n(v0 rc2024-09-19T07:13:22.775034+0000 b27156 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af1a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e7e:[<0x10000000e7a/article-29.xml v10>,<0x10000000399/blog-19 v28810>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000e7e:[<0x10000000e7a/article-29.xml v438>,<0x10000000399/blog-19 v54954>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.055 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.752+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000081c [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-14.jpg auth v1219 ap=1 s=34419 n(v0 rc2024-09-19T07:13:16.560184+0000 b34419 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@5},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ae31700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000081c:[<0x10000000615/picture-14.jpg v1219>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000081c:[<0x10000000615/picture-14.jpg v1219>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.055 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.752+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000062f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-70.xml auth v1201 ap=1 s=13113 n(v0 rc2024-09-19T07:13:15.149218+0000 b13113 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ae30c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000062f:[<0x10000000615/article-70.xml v1201>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000062f:[<0x10000000615/article-70.xml v1201>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.055 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.752+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e74 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-92.xml auth v1641 ap=1 s=7103 n(v0 rc2024-09-19T07:13:22.744034+0000 b7103 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae40000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e74:[<0x10000000615/comment-92.xml v1283>,<0x10000000399/blog-4 v29384>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000e74:[<0x10000000615/comment-92.xml v1641>,<0x10000000399/blog-4 v54956>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.055 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.752+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e91 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-21.xml auth v406 ap=1 s=7352 n(v0 rc2024-09-19T07:13:22.827032+0000 b7352 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af10c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e91:[<0x10000000e7a/article-21.xml v58>,<0x10000000399/blog-19 v28810>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000e91:[<0x10000000e7a/article-21.xml v406>,<0x10000000399/blog-19 v54954>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.055 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.753+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e8f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-22.xml auth v446 ap=1 s=30266 n(v0 rc2024-09-19T07:13:22.821033+0000 b30266 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af1ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e8f:[<0x10000000e7a/article-22.xml v52>,<0x10000000399/blog-19 v28810>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000e8f:[<0x10000000e7a/article-22.xml v446>,<0x10000000399/blog-19 v54954>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.055 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.753+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ea7 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-14.xml auth v388 ap=1 s=2896 n(v0 rc2024-09-19T07:13:22.872031+0000 b2896 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af1b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ea7:[<0x10000000e7a/article-14.xml v100>,<0x10000000399/blog-19 v28810>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ea7:[<0x10000000e7a/article-14.xml v388>,<0x10000000399/blog-19 v54954>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.055 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.753+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012e6 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-71.xml auth v450 ap=1 s=31607 n(v0 rc2024-09-19T07:13:26.119953+0000 b31607 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af1b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012e6:[<0x10000000e7a/article-71.xml v292>,<0x10000000399/blog-19 v28810>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000012e6:[<0x10000000e7a/article-71.xml v450>,<0x10000000399/blog-19 v54954>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.055 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.753+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000eaf [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-11.xml auth v460 ap=1 s=15220 n(v0 rc2024-09-19T07:13:22.894031+0000 b15220 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af24000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000eaf:[<0x10000000e7a/article-11.xml v118>,<0x10000000399/blog-19 v28810>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000eaf:[<0x10000000e7a/article-11.xml v460>,<0x10000000399/blog-19 v54954>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.055 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.753+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ea0 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-16.xml auth v448 ap=1 s=18784 n(v0 rc2024-09-19T07:13:22.859032+0000 b18784 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af24580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ea0:[<0x10000000e7a/article-16.xml v88>,<0x10000000399/blog-19 v28810>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ea0:[<0x10000000e7a/article-16.xml v448>,<0x10000000399/blog-19 v54954>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.055 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.754+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e85 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-26.xml auth v434 ap=1 s=8555 n(v0 rc2024-09-19T07:13:22.794033+0000 b8555 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af24b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e85:[<0x10000000e7a/article-26.xml v28>,<0x10000000399/blog-19 v28810>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000e85:[<0x10000000e7a/article-26.xml v434>,<0x10000000399/blog-19 v54954>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.055 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.754+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ece [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-15.jpg auth v430 ap=1 s=17138 n(v0 rc2024-09-19T07:13:22.979029+0000 b17138 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af25080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ece:[<0x10000000e7a/picture-15.jpg v196>,<0x10000000399/blog-19 v28810>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ece:[<0x10000000e7a/picture-15.jpg v430>,<0x10000000399/blog-19 v54954>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.056 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.754+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000eb2 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-10.xml auth v440 ap=1 s=9970 n(v0 rc2024-09-19T07:13:22.900031+0000 b9970 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af25600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000eb2:[<0x10000000e7a/article-10.xml v124>,<0x10000000399/blog-19 v28810>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000eb2:[<0x10000000e7a/article-10.xml v440>,<0x10000000399/blog-19 v54954>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.056 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.754+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ed5 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-12.jpg auth v380 ap=1 s=32626 n(v0 rc2024-09-19T07:13:22.999028+0000 b32626 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af25b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ed5:[<0x10000000e7a/picture-12.jpg v214>,<0x10000000399/blog-19 v28810>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ed5:[<0x10000000e7a/picture-12.jpg v380>,<0x10000000399/blog-19 v54954>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.056 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.754+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ec0 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-4.xml auth v444 ap=1 s=31456 n(v0 rc2024-09-19T07:13:22.939030+0000 b31456 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af26100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ec0:[<0x10000000e7a/article-4.xml v160>,<0x10000000399/blog-19 v28810>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ec0:[<0x10000000e7a/article-4.xml v444>,<0x10000000399/blog-19 v54954>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.056 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.754+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e88 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-25.xml auth v428 ap=1 s=26326 n(v0 rc2024-09-19T07:13:22.801033+0000 b26326 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af26680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e88:[<0x10000000e7a/article-25.xml v34>,<0x10000000399/blog-19 v28810>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000e88:[<0x10000000e7a/article-25.xml v428>,<0x10000000399/blog-19 v54954>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.056 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.755+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e96 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-19.xml auth v432 ap=1 s=9269 n(v0 rc2024-09-19T07:13:22.841032+0000 b9269 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af27180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e96:[<0x10000000e7a/article-19.xml v70>,<0x10000000399/blog-19 v28810>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000e96:[<0x10000000e7a/article-19.xml v432>,<0x10000000399/blog-19 v54954>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.056 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.756+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ead [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-12.xml auth v422 ap=1 s=11122 n(v0 rc2024-09-19T07:13:22.887031+0000 b11122 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af27700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ead:[<0x10000000e7a/article-12.xml v112>,<0x10000000399/blog-19 v28810>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ead:[<0x10000000e7a/article-12.xml v422>,<0x10000000399/blog-19 v54954>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.056 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.756+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ec7 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-1.xml auth v454 ap=1 s=23121 n(v0 rc2024-09-19T07:13:22.958029+0000 b23121 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af30000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ec7:[<0x10000000e7a/article-1.xml v178>,<0x10000000399/blog-19 v28810>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ec7:[<0x10000000e7a/article-1.xml v454>,<0x10000000399/blog-19 v54954>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.056 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.756+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ecc [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-16.jpg auth v472 ap=1 s=25137 n(v0 rc2024-09-19T07:13:22.972029+0000 b25137 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af30580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ecc:[<0x10000000e7a/picture-16.jpg v190>,<0x10000000399/blog-19 v28810>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ecc:[<0x10000000e7a/picture-16.jpg v472>,<0x10000000399/blog-19 v54954>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.056 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.756+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e9c [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-17.xml auth v420 ap=1 s=16174 n(v0 rc2024-09-19T07:13:22.854032+0000 b16174 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af31080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e9c:[<0x10000000e7a/article-17.xml v82>,<0x10000000399/blog-19 v28810>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000e9c:[<0x10000000e7a/article-17.xml v420>,<0x10000000399/blog-19 v54954>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.056 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:44.756+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e8d [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-23.xml auth v464 ap=1 s=8779 n(v0 rc2024-09-19T07:13:22.814033+0000 b8779 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af30b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e8d:[<0x10000000e7a/article-23.xml v46>,<0x10000000399/blog-19 v28810>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000e8d:[<0x10000000e7a/article-23.xml v464>,<0x10000000399/blog-19 v54954>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:44 smithi148 ceph-mon[31180]: pgmap v83: 97 pgs: 97 active+clean; 93 MiB data, 603 MiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 5.1 MiB/s wr, 253 op/s 2024-09-19T07:13:45.669 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.417+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012cd [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-27.jpg auth v1327 ap=1 s=33688 n(v0 rc2024-09-19T07:13:26.018956+0000 b33688 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35afb5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012cd:[<0x100000011eb/picture-27.jpg v376>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000012cd:[<0x100000011eb/picture-27.jpg v1327>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.669 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.417+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000127b [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-52.jpg auth v1331 ap=1 s=55347 n(v0 rc2024-09-19T07:13:25.759962+0000 b55347 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35afb6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000127b:[<0x100000011eb/picture-52.jpg v226>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000127b:[<0x100000011eb/picture-52.jpg v1331>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.669 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.418+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011ed [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-1.xml auth v1357 ap=1 s=23285 n(v0 rc2024-09-19T07:13:25.280973+0000 b23285 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35afb6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011ed:[<0x100000011eb/article-1.xml v4>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011ed:[<0x100000011eb/article-1.xml v1357>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.670 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.418+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012b5 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-34.jpg auth v1329 ap=1 s=40047 n(v0 rc2024-09-19T07:13:25.937958+0000 b40047 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35afb6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012b5:[<0x100000011eb/picture-34.jpg v334>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000012b5:[<0x100000011eb/picture-34.jpg v1329>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.670 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: scrub queued for path: / 2024-09-19T07:13:45.670 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:45.671 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: scrub summary: active paths [/] 2024-09-19T07:13:45.671 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: scrub summary: active paths [/] 2024-09-19T07:13:45.671 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000372 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/man/Makefile) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.671 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000205 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/man/blogbench.8) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.671 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000206 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/man/Makefile.am) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.671 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000207 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/man/Makefile.in) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.671 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000203 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/m4/acx_pthread.m4) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.671 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:45.671 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: scrub summary: active paths [/] 2024-09-19T07:13:45.671 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: scrub summary: active paths [/] 2024-09-19T07:13:45.672 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:45.672 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: scrub summary: active paths [/] 2024-09-19T07:13:45.672 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011bf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-18.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.672 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011cb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-13.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.672 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010cf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-18.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.672 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011bc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-19.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.672 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000109c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-27.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.672 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011de (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-4.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.672 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001178 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-35.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.672 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011e3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-2.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.672 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010c4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-20.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.673 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.418+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001276 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-53.jpg auth v1333 ap=1 s=30632 n(v0 rc2024-09-19T07:13:25.743962+0000 b30632 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35afb7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001276:[<0x100000011eb/picture-53.jpg v220>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001276:[<0x100000011eb/picture-53.jpg v1333>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.673 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.419+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000123d [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-67.jpg auth v1321 ap=1 s=38397 n(v0 rc2024-09-19T07:13:25.544967+0000 b38397 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35afb7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000123d:[<0x100000011eb/picture-67.jpg v136>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000123d:[<0x100000011eb/picture-67.jpg v1321>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.673 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.419+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000121e [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-74.jpg auth v1337 ap=1 s=61364 n(v0 rc2024-09-19T07:13:25.441969+0000 b61364 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35afc2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000121e:[<0x100000011eb/picture-74.jpg v94>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000121e:[<0x100000011eb/picture-74.jpg v1337>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.673 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011c9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-14.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.673 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011d7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-7.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.673 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011d3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-9.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.673 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011d1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-10.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.673 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011e7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-1.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.673 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010fb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-9.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.674 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011da (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-6.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.691 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.420+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001215 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-76.jpg auth v1355 ap=1 s=48114 n(v0 rc2024-09-19T07:13:25.420970+0000 b48114 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35afc2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001215:[<0x100000011eb/picture-76.jpg v82>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001215:[<0x100000011eb/picture-76.jpg v1355>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.691 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.420+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012bc [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-32.jpg auth v1345 ap=1 s=55242 n(v0 rc2024-09-19T07:13:25.960957+0000 b55242 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35afc3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012bc:[<0x100000011eb/picture-32.jpg v346>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000012bc:[<0x100000011eb/picture-32.jpg v1345>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.691 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.420+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001288 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-48.jpg auth v1343 ap=1 s=58047 n(v0 rc2024-09-19T07:13:25.806961+0000 b58047 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35afc3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001288:[<0x100000011eb/picture-48.jpg v250>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001288:[<0x100000011eb/picture-48.jpg v1343>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.691 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.421+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012e7 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-21.jpg auth v1355 ap=1 s=14437 n(v0 rc2024-09-19T07:13:26.124953+0000 b14437 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35afa7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012e7:[<0x100000011eb/picture-21.jpg v412>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000012e7:[<0x100000011eb/picture-21.jpg v1355>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.691 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.421+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001223 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-73.jpg auth v1317 ap=1 s=58473 n(v0 rc2024-09-19T07:13:25.453969+0000 b58473 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35afa6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001223:[<0x100000011eb/picture-73.jpg v100>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001223:[<0x100000011eb/picture-73.jpg v1317>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.692 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.422+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000121b [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-75.jpg auth v1321 ap=1 s=24220 n(v0 rc2024-09-19T07:13:25.429970+0000 b24220 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35afa7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000121b:[<0x100000011eb/picture-75.jpg v88>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000121b:[<0x100000011eb/picture-75.jpg v1321>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.692 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.423+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012ad [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-36.jpg auth v1319 ap=1 s=48891 n(v0 rc2024-09-19T07:13:25.912958+0000 b48891 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35afb4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012ad:[<0x100000011eb/picture-36.jpg v322>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000012ad:[<0x100000011eb/picture-36.jpg v1319>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.692 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.423+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001297 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-43.jpg auth v1323 ap=1 s=28629 n(v0 rc2024-09-19T07:13:25.847960+0000 b28629 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35afb4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001297:[<0x100000011eb/picture-43.jpg v280>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001297:[<0x100000011eb/picture-43.jpg v1323>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.692 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.424+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012a6 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-38.jpg auth v1325 ap=1 s=62262 n(v0 rc2024-09-19T07:13:25.891959+0000 b62262 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35afb5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012a6:[<0x100000011eb/picture-38.jpg v310>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000012a6:[<0x100000011eb/picture-38.jpg v1325>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.692 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.424+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012dd [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-23.jpg auth v1308 ap=1 s=57294 n(v0 rc2024-09-19T07:13:26.078954+0000 b57294 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af95600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012dd:[<0x100000011eb/picture-23.jpg v400>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000012dd:[<0x100000011eb/picture-23.jpg v1308>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.692 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.425+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000120c [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-79.jpg auth v1286 ap=1 s=38100 n(v0 rc2024-09-19T07:13:25.388971+0000 b38100 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af95b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000120c:[<0x100000011eb/picture-79.jpg v64>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000120c:[<0x100000011eb/picture-79.jpg v1286>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.692 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.425+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001291 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-45.jpg auth v1310 ap=1 s=34890 n(v0 rc2024-09-19T07:13:25.830960+0000 b34890 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af96100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001291:[<0x100000011eb/picture-45.jpg v268>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001291:[<0x100000011eb/picture-45.jpg v1310>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.692 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.425+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000129d [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-41.jpg auth v1288 ap=1 s=52809 n(v0 rc2024-09-19T07:13:25.864959+0000 b52809 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af96680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000129d:[<0x100000011eb/picture-41.jpg v292>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000129d:[<0x100000011eb/picture-41.jpg v1288>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.693 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.425+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000125a [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-60.jpg auth v1292 ap=1 s=38421 n(v0 rc2024-09-19T07:13:25.628965+0000 b38421 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af96c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000125a:[<0x100000011eb/picture-60.jpg v178>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000125a:[<0x100000011eb/picture-60.jpg v1292>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.697 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.426+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001243 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-66.jpg auth v1306 ap=1 s=44268 n(v0 rc2024-09-19T07:13:25.554967+0000 b44268 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af97180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001243:[<0x100000011eb/picture-66.jpg v142>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001243:[<0x100000011eb/picture-66.jpg v1306>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.698 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.426+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001208 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-80.jpg auth v1280 ap=1 s=47176 n(v0 rc2024-09-19T07:13:25.378971+0000 b47176 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af97700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001208:[<0x100000011eb/picture-80.jpg v58>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001208:[<0x100000011eb/picture-80.jpg v1280>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.698 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.426+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012e2 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-22.jpg auth v1290 ap=1 s=8931 n(v0 rc2024-09-19T07:13:26.096954+0000 b8931 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35afa4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012e2:[<0x100000011eb/picture-22.jpg v406>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000012e2:[<0x100000011eb/picture-22.jpg v1290>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.698 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.427+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000126a [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-56.jpg auth v1274 ap=1 s=17298 n(v0 rc2024-09-19T07:13:25.684964+0000 b17298 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35afa4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000126a:[<0x100000011eb/picture-56.jpg v202>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000126a:[<0x100000011eb/picture-56.jpg v1274>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.698 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.427+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000128b [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-47.jpg auth v1282 ap=1 s=30594 n(v0 rc2024-09-19T07:13:25.816960+0000 b30594 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35afa5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000128b:[<0x100000011eb/picture-47.jpg v256>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000128b:[<0x100000011eb/picture-47.jpg v1282>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.698 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.427+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001294 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-44.jpg auth v1304 ap=1 s=62807 n(v0 rc2024-09-19T07:13:25.838960+0000 b62807 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35afa5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001294:[<0x100000011eb/picture-44.jpg v274>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001294:[<0x100000011eb/picture-44.jpg v1304>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.698 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.428+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001227 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-72.jpg auth v1294 ap=1 s=18380 n(v0 rc2024-09-19T07:13:25.465969+0000 b18380 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35afa6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001227:[<0x100000011eb/picture-72.jpg v106>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001227:[<0x100000011eb/picture-72.jpg v1294>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.698 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.428+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000125f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-59.jpg auth v1272 ap=1 s=24684 n(v0 rc2024-09-19T07:13:25.640965+0000 b24684 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35afa6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000125f:[<0x100000011eb/picture-59.jpg v184>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000125f:[<0x100000011eb/picture-59.jpg v1272>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.698 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.429+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000126e [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-55.jpg auth v1320 ap=1 s=52171 n(v0 rc2024-09-19T07:13:25.704963+0000 b52171 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af8c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000126e:[<0x100000011eb/picture-55.jpg v208>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000126e:[<0x100000011eb/picture-55.jpg v1320>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.699 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.430+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000122f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-70.jpg auth v1300 ap=1 s=33293 n(v0 rc2024-09-19T07:13:25.488968+0000 b33293 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af8d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000122f:[<0x100000011eb/picture-70.jpg v118>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000122f:[<0x100000011eb/picture-70.jpg v1300>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.699 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.430+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000122b [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-71.jpg auth v1302 ap=1 s=27249 n(v0 rc2024-09-19T07:13:25.476969+0000 b27249 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af8d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000122b:[<0x100000011eb/picture-71.jpg v112>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000122b:[<0x100000011eb/picture-71.jpg v1302>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.699 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.431+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000124f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-63.jpg auth v1336 ap=1 s=16346 n(v0 rc2024-09-19T07:13:25.590966+0000 b16346 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af94000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000124f:[<0x100000011eb/picture-63.jpg v160>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000124f:[<0x100000011eb/picture-63.jpg v1336>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.699 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.431+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012a0 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-40.jpg auth v1328 ap=1 s=9085 n(v0 rc2024-09-19T07:13:25.873959+0000 b9085 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af94580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012a0:[<0x100000011eb/picture-40.jpg v298>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000012a0:[<0x100000011eb/picture-40.jpg v1328>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.699 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.431+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011f3 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-87.jpg auth v1304 ap=1 s=18472 n(v0 rc2024-09-19T07:13:25.298973+0000 b18472 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af94b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011f3:[<0x100000011eb/picture-87.jpg v16>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011f3:[<0x100000011eb/picture-87.jpg v1304>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.699 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.432+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011fb [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-84.jpg auth v1314 ap=1 s=46435 n(v0 rc2024-09-19T07:13:25.333972+0000 b46435 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af95080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011fb:[<0x100000011eb/picture-84.jpg v34>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011fb:[<0x100000011eb/picture-84.jpg v1314>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.700 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.433+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011f6 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-86.jpg auth v1311 ap=1 s=24991 n(v0 rc2024-09-19T07:13:25.308973+0000 b24991 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af7e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011f6:[<0x100000011eb/picture-86.jpg v22>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011f6:[<0x100000011eb/picture-86.jpg v1311>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.700 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.433+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001205 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-81.jpg auth v1317 ap=1 s=47519 n(v0 rc2024-09-19T07:13:25.365971+0000 b47519 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af7e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001205:[<0x100000011eb/picture-81.jpg v52>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001205:[<0x100000011eb/picture-81.jpg v1317>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.700 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.434+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001282 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-50.jpg auth v1321 ap=1 s=45587 n(v0 rc2024-09-19T07:13:25.786961+0000 b45587 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af7f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001282:[<0x100000011eb/picture-50.jpg v238>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001282:[<0x100000011eb/picture-50.jpg v1321>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.700 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.434+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001262 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-58.jpg auth v1357 ap=1 s=55311 n(v0 rc2024-09-19T07:13:25.653964+0000 b55311 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af7f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001262:[<0x100000011eb/picture-58.jpg v190>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001262:[<0x100000011eb/picture-58.jpg v1357>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.700 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.435+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001247 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-65.jpg auth v1319 ap=1 s=44109 n(v0 rc2024-09-19T07:13:25.567966+0000 b44109 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af8a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001247:[<0x100000011eb/picture-65.jpg v148>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001247:[<0x100000011eb/picture-65.jpg v1319>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.700 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.435+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001213 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-77.jpg auth v1313 ap=1 s=52127 n(v0 rc2024-09-19T07:13:25.407970+0000 b52127 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af8a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001213:[<0x100000011eb/picture-77.jpg v76>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001213:[<0x100000011eb/picture-77.jpg v1313>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.700 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.436+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001234 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-69.jpg auth v1315 ap=1 s=47542 n(v0 rc2024-09-19T07:13:25.500968+0000 b47542 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af8ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001234:[<0x100000011eb/picture-69.jpg v124>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001234:[<0x100000011eb/picture-69.jpg v1315>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.700 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.436+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000127e [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-51.jpg auth v1351 ap=1 s=53044 n(v0 rc2024-09-19T07:13:25.776961+0000 b53044 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af8b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000127e:[<0x100000011eb/picture-51.jpg v232>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000127e:[<0x100000011eb/picture-51.jpg v1351>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.700 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.436+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001253 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-62.jpg auth v1355 ap=1 s=61298 n(v0 rc2024-09-19T07:13:25.603966+0000 b61298 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af8b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001253:[<0x100000011eb/picture-62.jpg v166>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001253:[<0x100000011eb/picture-62.jpg v1355>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.701 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.437+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000128e [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-46.jpg auth v1325 ap=1 s=26840 n(v0 rc2024-09-19T07:13:25.824960+0000 b26840 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af8bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000128e:[<0x100000011eb/picture-46.jpg v262>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000128e:[<0x100000011eb/picture-46.jpg v1325>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.701 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.437+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012d5 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-25.jpg auth v1345 ap=1 s=23337 n(v0 rc2024-09-19T07:13:26.047955+0000 b23337 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af6f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012d5:[<0x100000011eb/picture-25.jpg v388>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000012d5:[<0x100000011eb/picture-25.jpg v1345>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.701 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.438+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012bf [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-31.jpg auth v1307 ap=1 s=48540 n(v0 rc2024-09-19T07:13:25.968957+0000 b48540 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af6f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012bf:[<0x100000011eb/picture-31.jpg v352>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000012bf:[<0x100000011eb/picture-31.jpg v1307>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.701 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.438+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001285 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-49.jpg auth v1331 ap=1 s=50514 n(v0 rc2024-09-19T07:13:25.797961+0000 b50514 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af7c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001285:[<0x100000011eb/picture-49.jpg v244>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001285:[<0x100000011eb/picture-49.jpg v1331>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.701 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.439+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011f0 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-88.jpg auth v1347 ap=1 s=28275 n(v0 rc2024-09-19T07:13:25.288973+0000 b28275 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af7cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011f0:[<0x100000011eb/picture-88.jpg v10>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011f0:[<0x100000011eb/picture-88.jpg v1347>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.701 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.439+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012d1 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-26.jpg auth v1303 ap=1 s=10871 n(v0 rc2024-09-19T07:13:26.034955+0000 b10871 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af7d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012d1:[<0x100000011eb/picture-26.jpg v382>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000012d1:[<0x100000011eb/picture-26.jpg v1303>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.701 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.441+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001273 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-54.jpg auth v1317 ap=1 s=21738 n(v0 rc2024-09-19T07:13:25.724963+0000 b21738 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af7d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001273:[<0x100000011eb/picture-54.jpg v214>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001273:[<0x100000011eb/picture-54.jpg v1317>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.701 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.441+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012c5 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-29.jpg auth v1305 ap=1 s=44781 n(v0 rc2024-09-19T07:13:25.989956+0000 b44781 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af7db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012c5:[<0x100000011eb/picture-29.jpg v364>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000012c5:[<0x100000011eb/picture-29.jpg v1305>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.702 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.441+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000124b [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-64.jpg auth v1358 ap=1 s=9987 n(v0 rc2024-09-19T07:13:25.579966+0000 b9987 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af61b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000124b:[<0x100000011eb/picture-64.jpg v154>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000124b:[<0x100000011eb/picture-64.jpg v1358>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.702 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.442+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011ff [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-83.jpg auth v1318 ap=1 s=47487 n(v0 rc2024-09-19T07:13:25.345972+0000 b47487 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af62c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011ff:[<0x100000011eb/picture-83.jpg v40>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011ff:[<0x100000011eb/picture-83.jpg v1318>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.702 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.443+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012c9 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-28.jpg auth v1316 ap=1 s=58892 n(v0 rc2024-09-19T07:13:26.004956+0000 b58892 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af63700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012c9:[<0x100000011eb/picture-28.jpg v370>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000012c9:[<0x100000011eb/picture-28.jpg v1316>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.702 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.444+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012a9 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-37.jpg auth v1348 ap=1 s=35944 n(v0 rc2024-09-19T07:13:25.900958+0000 b35944 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af6c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012a9:[<0x100000011eb/picture-37.jpg v316>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000012a9:[<0x100000011eb/picture-37.jpg v1348>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.702 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.444+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011f8 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-85.jpg auth v1322 ap=1 s=8442 n(v0 rc2024-09-19T07:13:25.321972+0000 b8442 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af6cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011f8:[<0x100000011eb/picture-85.jpg v28>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011f8:[<0x100000011eb/picture-85.jpg v1322>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.702 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.445+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012d9 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-24.jpg auth v1310 ap=1 s=14956 n(v0 rc2024-09-19T07:13:26.060955+0000 b14956 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af6d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012d9:[<0x100000011eb/picture-24.jpg v394>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000012d9:[<0x100000011eb/picture-24.jpg v1310>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.702 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.445+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001267 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-57.jpg auth v1334 ap=1 s=40474 n(v0 rc2024-09-19T07:13:25.666964+0000 b40474 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af6db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001267:[<0x100000011eb/picture-57.jpg v196>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001267:[<0x100000011eb/picture-57.jpg v1334>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.703 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.445+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012b9 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-33.jpg auth v1320 ap=1 s=24544 n(v0 rc2024-09-19T07:13:25.950957+0000 b24544 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af6d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012b9:[<0x100000011eb/picture-33.jpg v340>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000012b9:[<0x100000011eb/picture-33.jpg v1320>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.703 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.445+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000129a [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-42.jpg auth v1336 ap=1 s=60643 n(v0 rc2024-09-19T07:13:25.856959+0000 b60643 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af6e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000129a:[<0x100000011eb/picture-42.jpg v286>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000129a:[<0x100000011eb/picture-42.jpg v1336>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.703 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.445+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001236 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-68.jpg auth v1330 ap=1 s=23045 n(v0 rc2024-09-19T07:13:25.518968+0000 b23045 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af6e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001236:[<0x100000011eb/picture-68.jpg v130>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001236:[<0x100000011eb/picture-68.jpg v1330>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.703 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.446+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012a3 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-39.jpg auth v1332 ap=1 s=38025 n(v0 rc2024-09-19T07:13:25.882959+0000 b38025 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af6ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012a3:[<0x100000011eb/picture-39.jpg v304>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000012a3:[<0x100000011eb/picture-39.jpg v1332>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.703 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.447+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001201 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-82.jpg auth v1319 ap=1 s=38598 n(v0 rc2024-09-19T07:13:25.356972+0000 b38598 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af32680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001201:[<0x100000011eb/picture-82.jpg v46>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001201:[<0x100000011eb/picture-82.jpg v1319>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.704 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.447+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012b1 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-35.jpg auth v1337 ap=1 s=48968 n(v0 rc2024-09-19T07:13:25.925958+0000 b48968 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af33180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012b1:[<0x100000011eb/picture-35.jpg v328>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000012b1:[<0x100000011eb/picture-35.jpg v1337>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.704 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.448+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000120f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-78.jpg auth v1323 ap=1 s=42848 n(v0 rc2024-09-19T07:13:25.398970+0000 b42848 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af60000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000120f:[<0x100000011eb/picture-78.jpg v70>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000120f:[<0x100000011eb/picture-78.jpg v1323>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.704 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.448+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001257 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-61.jpg auth v1315 ap=1 s=25397 n(v0 rc2024-09-19T07:13:25.614965+0000 b25397 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35af60b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001257:[<0x100000011eb/picture-61.jpg v172>,<0x10000000399/blog-25 v29464>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001257:[<0x100000011eb/picture-61.jpg v1315>,<0x10000000399/blog-25 v45750>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.704 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.590+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011df [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-18.jpg auth v1017 ap=1 s=53030 n(v0 rc2024-09-19T07:13:25.232974+0000 b53030 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae58c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011df:[<0x100000011be/picture-18.jpg v88>,<0x10000000399/blog-24 v29614>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011df:[<0x100000011be/picture-18.jpg v1017>,<0x10000000399/blog-24 v45744>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.704 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.591+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011dd [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-19.jpg auth v1083 ap=1 s=44290 n(v0 rc2024-09-19T07:13:25.226975+0000 b44290 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae59700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011dd:[<0x100000011be/picture-19.jpg v82>,<0x10000000399/blog-24 v29614>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011dd:[<0x100000011be/picture-19.jpg v1083>,<0x10000000399/blog-24 v45744>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.705 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.591+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011ee [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-13.jpg auth v1049 ap=1 s=19278 n(v0 rc2024-09-19T07:13:25.286973+0000 b19278 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae58680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011ee:[<0x100000011be/picture-13.jpg v118>,<0x10000000399/blog-24 v29614>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011ee:[<0x100000011be/picture-13.jpg v1049>,<0x10000000399/blog-24 v45744>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.705 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.591+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000121c [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-4.jpg auth v1001 ap=1 s=56351 n(v0 rc2024-09-19T07:13:25.431970+0000 b56351 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae82580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000121c:[<0x100000011be/picture-4.jpg v172>,<0x10000000399/blog-24 v29614>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000121c:[<0x100000011be/picture-4.jpg v1001>,<0x10000000399/blog-24 v45744>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.705 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.592+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001224 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-2.jpg auth v1087 ap=1 s=27336 n(v0 rc2024-09-19T07:13:25.454969+0000 b27336 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae82b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001224:[<0x100000011be/picture-2.jpg v184>,<0x10000000399/blog-24 v29614>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001224:[<0x100000011be/picture-2.jpg v1087>,<0x10000000399/blog-24 v45744>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.705 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.592+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011ec [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-14.jpg auth v1045 ap=1 s=63654 n(v0 rc2024-09-19T07:13:25.273973+0000 b63654 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae83080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011ec:[<0x100000011be/picture-14.jpg v112>,<0x10000000399/blog-24 v29614>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011ec:[<0x100000011be/picture-14.jpg v1045>,<0x10000000399/blog-24 v45744>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.705 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.592+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000120d [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-7.jpg auth v1075 ap=1 s=21964 n(v0 rc2024-09-19T07:13:25.399970+0000 b21964 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae83600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000120d:[<0x100000011be/picture-7.jpg v154>,<0x10000000399/blog-24 v29614>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000120d:[<0x100000011be/picture-7.jpg v1075>,<0x10000000399/blog-24 v45744>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.706 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.592+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001200 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-9.jpg auth v1009 ap=1 s=56659 n(v0 rc2024-09-19T07:13:25.357971+0000 b56659 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae83b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001200:[<0x100000011be/picture-9.jpg v142>,<0x10000000399/blog-24 v29614>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001200:[<0x100000011be/picture-9.jpg v1009>,<0x10000000399/blog-24 v45744>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.706 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.593+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011f9 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-10.jpg auth v1007 ap=1 s=27323 n(v0 rc2024-09-19T07:13:25.327972+0000 b27323 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae85180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011f9:[<0x100000011be/picture-10.jpg v136>,<0x10000000399/blog-24 v29614>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011f9:[<0x100000011be/picture-10.jpg v1007>,<0x10000000399/blog-24 v45744>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.706 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.593+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001228 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-1.jpg auth v1081 ap=1 s=23068 n(v0 rc2024-09-19T07:13:25.466969+0000 b23068 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae85700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001228:[<0x100000011be/picture-1.jpg v190>,<0x10000000399/blog-24 v29614>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001228:[<0x100000011be/picture-1.jpg v1081>,<0x10000000399/blog-24 v45744>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.706 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.593+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011ca [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-9.xml auth v1047 ap=1 s=10963 n(v0 rc2024-09-19T07:13:25.158976+0000 b10963 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae8c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011ca:[<0x100000011be/article-9.xml v28>,<0x10000000399/blog-24 v29614>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011ca:[<0x100000011be/article-9.xml v1047>,<0x10000000399/blog-24 v45744>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.706 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.593+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001214 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-6.jpg auth v1065 ap=1 s=23186 n(v0 rc2024-09-19T07:13:25.408970+0000 b23186 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae8cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001214:[<0x100000011be/picture-6.jpg v160>,<0x10000000399/blog-24 v29614>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001214:[<0x100000011be/picture-6.jpg v1065>,<0x10000000399/blog-24 v45744>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.707 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.594+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011e1 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-17.jpg auth v1101 ap=1 s=9767 n(v0 rc2024-09-19T07:13:25.239974+0000 b9767 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae8e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011e1:[<0x100000011be/picture-17.jpg v94>,<0x10000000399/blog-24 v29614>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011e1:[<0x100000011be/picture-17.jpg v1101>,<0x10000000399/blog-24 v45744>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.707 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.594+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011d6 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-3.xml auth v1099 ap=1 s=21797 n(v0 rc2024-09-19T07:13:25.200975+0000 b21797 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae8e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011d6:[<0x100000011be/article-3.xml v64>,<0x10000000399/blog-24 v29614>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011d6:[<0x100000011be/article-3.xml v1099>,<0x10000000399/blog-24 v45744>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.707 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.594+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011ce [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-7.xml auth v1015 ap=1 s=2184 n(v0 rc2024-09-19T07:13:25.174976+0000 b2184 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae8ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011ce:[<0x100000011be/article-7.xml v40>,<0x10000000399/blog-24 v29614>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011ce:[<0x100000011be/article-7.xml v1015>,<0x10000000399/blog-24 v45744>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.707 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.595+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001207 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-8.jpg auth v1011 ap=1 s=59869 n(v0 rc2024-09-19T07:13:25.380971+0000 b59869 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae9a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001207:[<0x100000011be/picture-8.jpg v148>,<0x10000000399/blog-24 v29614>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001207:[<0x100000011be/picture-8.jpg v1011>,<0x10000000399/blog-24 v45744>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.707 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.595+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011cc [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-8.xml auth v1091 ap=1 s=22469 n(v0 rc2024-09-19T07:13:25.167976+0000 b22469 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae9a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011cc:[<0x100000011be/article-8.xml v34>,<0x10000000399/blog-24 v29614>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011cc:[<0x100000011be/article-8.xml v1091>,<0x10000000399/blog-24 v45744>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.707 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.595+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011c0 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-13.xml auth v1019 ap=1 s=29731 n(v0 rc2024-09-19T07:13:25.123977+0000 b29731 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae9b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011c0:[<0x100000011be/article-13.xml v4>,<0x10000000399/blog-24 v29614>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011c0:[<0x100000011be/article-13.xml v1019>,<0x10000000399/blog-24 v45744>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.708 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.596+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011d0 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-6.xml auth v1031 ap=1 s=4476 n(v0 rc2024-09-19T07:13:25.180976+0000 b4476 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae9bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011d0:[<0x100000011be/article-6.xml v46>,<0x10000000399/blog-24 v29614>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011d0:[<0x100000011be/article-6.xml v1031>,<0x10000000399/blog-24 v45744>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.708 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.596+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011d8 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-2.xml auth v1005 ap=1 s=31476 n(v0 rc2024-09-19T07:13:25.205975+0000 b31476 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae9c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011d8:[<0x100000011be/article-2.xml v70>,<0x10000000399/blog-24 v29614>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011d8:[<0x100000011be/article-2.xml v1005>,<0x10000000399/blog-24 v45744>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.708 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.597+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001216 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-5.jpg auth v1115 ap=1 s=13070 n(v0 rc2024-09-19T07:13:25.422970+0000 b13070 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35aea6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001216:[<0x100000011be/picture-5.jpg v166>,<0x10000000399/blog-24 v29614>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001216:[<0x100000011be/picture-5.jpg v1115>,<0x10000000399/blog-24 v45744>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.708 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.598+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000121f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-3.jpg auth v1055 ap=1 s=17093 n(v0 rc2024-09-19T07:13:25.443969+0000 b17093 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35aea9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000121f:[<0x100000011be/picture-3.jpg v178>,<0x10000000399/blog-24 v29614>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000121f:[<0x100000011be/picture-3.jpg v1055>,<0x10000000399/blog-24 v45744>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.708 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.598+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011f5 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-11.jpg auth v1063 ap=1 s=58249 n(v0 rc2024-09-19T07:13:25.305973+0000 b58249 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35aeb2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011f5:[<0x100000011be/picture-11.jpg v130>,<0x10000000399/blog-24 v29614>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011f5:[<0x100000011be/picture-11.jpg v1063>,<0x10000000399/blog-24 v45744>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.709 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.598+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011d2 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-5.xml auth v1003 ap=1 s=28774 n(v0 rc2024-09-19T07:13:25.186976+0000 b28774 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35aeb2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011d2:[<0x100000011be/article-5.xml v52>,<0x10000000399/blog-24 v29614>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011d2:[<0x100000011be/article-5.xml v1003>,<0x10000000399/blog-24 v45744>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.709 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.599+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011c5 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-11.xml auth v1051 ap=1 s=14588 n(v0 rc2024-09-19T07:13:25.140977+0000 b14588 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35aeb4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011c5:[<0x100000011be/article-11.xml v16>,<0x10000000399/blog-24 v29614>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011c5:[<0x100000011be/article-11.xml v1051>,<0x10000000399/blog-24 v45744>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.709 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.599+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011e8 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-15.jpg auth v1129 ap=1 s=30576 n(v0 rc2024-09-19T07:13:25.258974+0000 b30576 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35aeb4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011e8:[<0x100000011be/picture-15.jpg v106>,<0x10000000399/blog-24 v29614>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011e8:[<0x100000011be/picture-15.jpg v1129>,<0x10000000399/blog-24 v45744>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.709 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.599+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011c8 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-10.xml auth v1117 ap=1 s=5410 n(v0 rc2024-09-19T07:13:25.148977+0000 b5410 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35aeb5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011c8:[<0x100000011be/article-10.xml v22>,<0x10000000399/blog-24 v29614>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011c8:[<0x100000011be/article-10.xml v1117>,<0x10000000399/blog-24 v45744>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.709 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.599+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011f2 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-12.jpg auth v1061 ap=1 s=36730 n(v0 rc2024-09-19T07:13:25.294973+0000 b36730 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35aeb5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011f2:[<0x100000011be/picture-12.jpg v124>,<0x10000000399/blog-24 v29614>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011f2:[<0x100000011be/picture-12.jpg v1061>,<0x10000000399/blog-24 v45744>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.709 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.600+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011d4 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-4.xml auth v1035 ap=1 s=27768 n(v0 rc2024-09-19T07:13:25.192975+0000 b27768 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35aec6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011d4:[<0x100000011be/article-4.xml v58>,<0x10000000399/blog-24 v29614>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011d4:[<0x100000011be/article-4.xml v1035>,<0x10000000399/blog-24 v45744>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.710 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.601+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011c2 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-12.xml auth v1119 ap=1 s=20144 n(v0 rc2024-09-19T07:13:25.129977+0000 b20144 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35aec9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011c2:[<0x100000011be/article-12.xml v10>,<0x10000000399/blog-24 v29614>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011c2:[<0x100000011be/article-12.xml v1119>,<0x10000000399/blog-24 v45744>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.710 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.601+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011db [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-1.xml auth v1029 ap=1 s=17924 n(v0 rc2024-09-19T07:13:25.216975+0000 b17924 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35aed2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011db:[<0x100000011be/article-1.xml v76>,<0x10000000399/blog-24 v29614>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011db:[<0x100000011be/article-1.xml v1029>,<0x10000000399/blog-24 v45744>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.710 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.602+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011e4 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-16.jpg auth v1123 ap=1 s=38619 n(v0 rc2024-09-19T07:13:25.246974+0000 b38619 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35aed3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011e4:[<0x100000011be/picture-16.jpg v100>,<0x10000000399/blog-24 v29614>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011e4:[<0x100000011be/picture-16.jpg v1123>,<0x10000000399/blog-24 v45744>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.710 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.654+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007c4 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-37.xml auth v698 ap=1 s=11240 n(v0 rc2024-09-19T07:13:16.305190+0000 b11240 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35acd5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007c4:[<0x100000006f1/article-37.xml v698>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000007c4:[<0x100000006f1/article-37.xml v698>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.710 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.654+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000719 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-75.xml auth v726 ap=1 s=31507 n(v0 rc2024-09-19T07:13:15.820202+0000 b31507 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35acd4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000719:[<0x100000006f1/article-75.xml v726>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000719:[<0x100000006f1/article-75.xml v726>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.711 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.656+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007bb [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-39.xml auth v684 ap=1 s=15912 n(v0 rc2024-09-19T07:13:16.278191+0000 b15912 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35acd5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007bb:[<0x100000006f1/article-39.xml v684>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000007bb:[<0x100000006f1/article-39.xml v684>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.711 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.656+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000725 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-73.xml auth v656 ap=1 s=18103 n(v0 rc2024-09-19T07:13:15.868201+0000 b18103 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35acd5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000725:[<0x100000006f1/article-73.xml v656>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000725:[<0x100000006f1/article-73.xml v656>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.711 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.656+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007c9 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-36.xml auth v624 ap=1 s=31348 n(v0 rc2024-09-19T07:13:16.318190+0000 b31348 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35acd6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007c9:[<0x100000006f1/article-36.xml v624>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000007c9:[<0x100000006f1/article-36.xml v624>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.711 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.657+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000835 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-12.xml auth v750 ap=1 s=18513 n(v0 rc2024-09-19T07:13:16.588183+0000 b18513 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35acd6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000835:[<0x100000006f1/article-12.xml v750>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000835:[<0x100000006f1/article-12.xml v750>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.711 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.657+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000085f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-1.xml auth v646 ap=1 s=9890 n(v0 rc2024-09-19T07:13:16.692181+0000 b9890 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35acd6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000085f:[<0x100000006f1/article-1.xml v646>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000085f:[<0x100000006f1/article-1.xml v646>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.711 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.657+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000074e [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-66.xml auth v672 ap=1 s=31719 n(v0 rc2024-09-19T07:13:15.965198+0000 b31719 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35acd7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000074e:[<0x100000006f1/article-66.xml v672>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000074e:[<0x100000006f1/article-66.xml v672>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.711 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.658+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000863 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-16.jpg auth v654 ap=1 s=14962 n(v0 rc2024-09-19T07:13:16.704180+0000 b14962 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35acd7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000863:[<0x100000006f1/picture-16.jpg v654>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000863:[<0x100000006f1/picture-16.jpg v654>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.711 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.658+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000070d [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-77.xml auth v662 ap=1 s=17182 n(v0 rc2024-09-19T07:13:15.782203+0000 b17182 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ace2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000070d:[<0x100000006f1/article-77.xml v662>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000070d:[<0x100000006f1/article-77.xml v662>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.712 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.658+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000809 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-23.xml auth v616 ap=1 s=29839 n(v0 rc2024-09-19T07:13:16.496185+0000 b29839 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ace2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000809:[<0x100000006f1/article-23.xml v616>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000809:[<0x100000006f1/article-23.xml v616>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.712 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.658+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000822 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-17.xml auth v586 ap=1 s=10526 n(v0 rc2024-09-19T07:13:16.555184+0000 b10526 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ace2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000822:[<0x100000006f1/article-17.xml v586>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000822:[<0x100000006f1/article-17.xml v586>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.712 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.659+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000075b [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-63.xml auth v774 ap=1 s=6193 n(v0 rc2024-09-19T07:13:15.992198+0000 b6193 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ace3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000075b:[<0x100000006f1/article-63.xml v774>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000075b:[<0x100000006f1/article-63.xml v774>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.712 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.659+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000072b [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-72.xml auth v740 ap=1 s=25708 n(v0 rc2024-09-19T07:13:15.894200+0000 b25708 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35accc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000072b:[<0x100000006f1/article-72.xml v740>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000072b:[<0x100000006f1/article-72.xml v740>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.712 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.659+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007ce [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-35.xml auth v678 ap=1 s=28649 n(v0 rc2024-09-19T07:13:16.332189+0000 b28649 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35accc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007ce:[<0x100000006f1/article-35.xml v678>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000007ce:[<0x100000006f1/article-35.xml v678>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.712 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.659+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007b6 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-40.xml auth v764 ap=1 s=7446 n(v0 rc2024-09-19T07:13:16.265191+0000 b7446 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35acccc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007b6:[<0x100000006f1/article-40.xml v764>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000007b6:[<0x100000006f1/article-40.xml v764>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.712 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.659+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000082a [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-15.xml auth v710 ap=1 s=11982 n(v0 rc2024-09-19T07:13:16.568184+0000 b11982 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35accd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000082a:[<0x100000006f1/article-15.xml v710>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000082a:[<0x100000006f1/article-15.xml v710>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.712 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.660+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000081a [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-19.xml auth v756 ap=1 s=7742 n(v0 rc2024-09-19T07:13:16.542184+0000 b7742 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35accd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000081a:[<0x100000006f1/article-19.xml v756>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000081a:[<0x100000006f1/article-19.xml v756>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.712 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.660+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000082d [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-14.xml auth v638 ap=1 s=6527 n(v0 rc2024-09-19T07:13:16.575184+0000 b6527 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35acbeb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000082d:[<0x100000006f1/article-14.xml v638>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000082d:[<0x100000006f1/article-14.xml v638>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.712 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.660+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007ac [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-42.xml auth v744 ap=1 s=28909 n(v0 rc2024-09-19T07:13:16.239192+0000 b28909 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35acd4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007ac:[<0x100000006f1/article-42.xml v744>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000007ac:[<0x100000006f1/article-42.xml v744>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.712 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.660+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000079b [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-46.xml auth v636 ap=1 s=25751 n(v0 rc2024-09-19T07:13:16.187193+0000 b25751 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35acbf080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000079b:[<0x100000006f1/article-46.xml v636>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000079b:[<0x100000006f1/article-46.xml v636>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.713 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.661+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000797 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-47.xml auth v716 ap=1 s=11397 n(v0 rc2024-09-19T07:13:16.178193+0000 b11397 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35acbf600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000797:[<0x100000006f1/article-47.xml v716>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000797:[<0x100000006f1/article-47.xml v716>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.713 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.661+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000731 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-71.xml auth v694 ap=1 s=25127 n(v0 rc2024-09-19T07:13:15.909200+0000 b25127 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35acbfb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000731:[<0x100000006f1/article-71.xml v694>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000731:[<0x100000006f1/article-71.xml v694>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.713 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.661+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000839 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-11.xml auth v590 ap=1 s=29742 n(v0 rc2024-09-19T07:13:16.595183+0000 b29742 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35acc0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000839:[<0x100000006f1/article-11.xml v590>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000839:[<0x100000006f1/article-11.xml v590>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.713 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.661+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000827 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-16.xml auth v680 ap=1 s=9892 n(v0 rc2024-09-19T07:13:16.562184+0000 b9892 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35acc0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000827:[<0x100000006f1/article-16.xml v680>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000827:[<0x100000006f1/article-16.xml v680>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.713 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.661+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007fc [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-26.xml auth v704 ap=1 s=22783 n(v0 rc2024-09-19T07:13:16.457186+0000 b22783 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35acc1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007fc:[<0x100000006f1/article-26.xml v704>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000007fc:[<0x100000006f1/article-26.xml v704>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.713 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.661+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000077d [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-54.xml auth v592 ap=1 s=27694 n(v0 rc2024-09-19T07:13:16.067196+0000 b27694 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35acc0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000077d:[<0x100000006f1/article-54.xml v592>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000077d:[<0x100000006f1/article-54.xml v592>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.713 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.662+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000867 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-15.jpg auth v664 ap=1 s=52648 n(v0 rc2024-09-19T07:13:16.715180+0000 b52648 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35acc1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000867:[<0x100000006f1/picture-15.jpg v664>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000867:[<0x100000006f1/picture-15.jpg v664>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.713 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.662+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000083d [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-10.xml auth v626 ap=1 s=8405 n(v0 rc2024-09-19T07:13:16.602183+0000 b8405 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35acca000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000083d:[<0x100000006f1/article-10.xml v626>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000083d:[<0x100000006f1/article-10.xml v626>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.713 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.662+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000873 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-12.jpg auth v700 ap=1 s=27643 n(v0 rc2024-09-19T07:13:16.749179+0000 b27643 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35acca580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000873:[<0x100000006f1/picture-12.jpg v700>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000873:[<0x100000006f1/picture-12.jpg v700>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.714 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.663+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000853 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-4.xml auth v644 ap=1 s=31580 n(v0 rc2024-09-19T07:13:16.660181+0000 b31580 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35accb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000853:[<0x100000006f1/article-4.xml v644>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000853:[<0x100000006f1/article-4.xml v644>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.714 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.663+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007bf [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-38.xml auth v752 ap=1 s=2017 n(v0 rc2024-09-19T07:13:16.292190+0000 b2017 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35accbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007bf:[<0x100000006f1/article-38.xml v752>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000007bf:[<0x100000006f1/article-38.xml v752>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.714 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.664+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000801 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-25.xml auth v706 ap=1 s=15111 n(v0 rc2024-09-19T07:13:16.470186+0000 b15111 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35accb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000801:[<0x100000006f1/article-25.xml v706>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000801:[<0x100000006f1/article-25.xml v706>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.715 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.664+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000897 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-3.jpg auth v712 ap=1 s=53991 n(v0 rc2024-09-19T07:13:16.867176+0000 b53991 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35acb1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000897:[<0x100000006f1/picture-3.jpg v712>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000897:[<0x100000006f1/picture-3.jpg v712>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.715 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.664+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000877 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-11.jpg auth v688 ap=1 s=22814 n(v0 rc2024-09-19T07:13:16.760179+0000 b22814 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35acb1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000877:[<0x100000006f1/picture-11.jpg v688>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000877:[<0x100000006f1/picture-11.jpg v688>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.715 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.664+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000850 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-5.xml auth v766 ap=1 s=32181 n(v0 rc2024-09-19T07:13:16.653182+0000 b32181 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35acb1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000850:[<0x100000006f1/article-5.xml v766>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000850:[<0x100000006f1/article-5.xml v766>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.715 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.665+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007d4 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-34.xml auth v736 ap=1 s=14487 n(v0 rc2024-09-19T07:13:16.347189+0000 b14487 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35acb2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007d4:[<0x100000006f1/article-34.xml v736>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000007d4:[<0x100000006f1/article-34.xml v736>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.715 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.665+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006f5 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-81.xml auth v642 ap=1 s=25438 n(v0 rc2024-09-19T07:13:15.704205+0000 b25438 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35acb2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006f5:[<0x100000006f1/article-81.xml v642>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000006f5:[<0x100000006f1/article-81.xml v642>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.716 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.665+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000707 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-78.xml auth v660 ap=1 s=23827 n(v0 rc2024-09-19T07:13:15.764203+0000 b23827 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35acb2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000707:[<0x100000006f1/article-78.xml v660>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000707:[<0x100000006f1/article-78.xml v660>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.716 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.665+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007ed [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-29.xml auth v604 ap=1 s=22648 n(v0 rc2024-09-19T07:13:16.420187+0000 b22648 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35acb3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007ed:[<0x100000006f1/article-29.xml v604>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000007ed:[<0x100000006f1/article-29.xml v604>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.716 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.665+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000766 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-60.xml auth v758 ap=1 s=30317 n(v0 rc2024-09-19T07:13:16.017197+0000 b30317 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35acb3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000766:[<0x100000006f1/article-60.xml v758>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000766:[<0x100000006f1/article-60.xml v758>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.716 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.665+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000080f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-22.xml auth v730 ap=1 s=11492 n(v0 rc2024-09-19T07:13:16.509185+0000 b11492 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35acbe000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000080f:[<0x100000006f1/article-22.xml v730>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000080f:[<0x100000006f1/article-22.xml v730>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.716 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.666+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000790 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-49.xml auth v652 ap=1 s=22763 n(v0 rc2024-09-19T07:13:16.149194+0000 b22763 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35acbe580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000790:[<0x100000006f1/article-49.xml v652>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000790:[<0x100000006f1/article-49.xml v652>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.716 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.666+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007a7 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-43.xml auth v608 ap=1 s=19428 n(v0 rc2024-09-19T07:13:16.227192+0000 b19428 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35aca9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007a7:[<0x100000006f1/article-43.xml v608>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000007a7:[<0x100000006f1/article-43.xml v608>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.717 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.666+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007d9 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-33.xml auth v668 ap=1 s=17539 n(v0 rc2024-09-19T07:13:16.362189+0000 b17539 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35acaa100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007d9:[<0x100000006f1/article-33.xml v668>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000007d9:[<0x100000006f1/article-33.xml v668>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.717 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.667+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000088f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-5.jpg auth v602 ap=1 s=26628 n(v0 rc2024-09-19T07:13:16.839177+0000 b26628 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35acaa680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000088f:[<0x100000006f1/picture-5.jpg v602>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000088f:[<0x100000006f1/picture-5.jpg v602>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.717 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.667+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000771 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-57.xml auth v612 ap=1 s=8446 n(v0 rc2024-09-19T07:13:16.041196+0000 b8446 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35acaac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000771:[<0x100000006f1/article-57.xml v612>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000771:[<0x100000006f1/article-57.xml v612>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.717 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.667+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000701 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-79.xml auth v718 ap=1 s=8258 n(v0 rc2024-09-19T07:13:15.745204+0000 b8258 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35acab180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000701:[<0x100000006f1/article-79.xml v718>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000701:[<0x100000006f1/article-79.xml v718>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.717 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.667+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000076e [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-58.xml auth v762 ap=1 s=14310 n(v0 rc2024-09-19T07:13:16.033197+0000 b14310 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35acab700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000076e:[<0x100000006f1/article-58.xml v762>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000076e:[<0x100000006f1/article-58.xml v762>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.717 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.668+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000781 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-53.xml auth v770 ap=1 s=15939 n(v0 rc2024-09-19T07:13:16.084195+0000 b15939 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35acb0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000781:[<0x100000006f1/article-53.xml v770>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000781:[<0x100000006f1/article-53.xml v770>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.717 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.668+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007f1 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-28.xml auth v754 ap=1 s=30545 n(v0 rc2024-09-19T07:13:16.432187+0000 b30545 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35acb0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007f1:[<0x100000006f1/article-28.xml v754>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000007f1:[<0x100000006f1/article-28.xml v754>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.717 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.668+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000784 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-52.xml auth v658 ap=1 s=27363 n(v0 rc2024-09-19T07:13:16.100195+0000 b27363 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35acb0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000784:[<0x100000006f1/article-52.xml v658>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000784:[<0x100000006f1/article-52.xml v658>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.717 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.668+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000779 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-55.xml auth v772 ap=1 s=11531 n(v0 rc2024-09-19T07:13:16.059196+0000 b11531 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac99080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000779:[<0x100000006f1/article-55.xml v772>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000779:[<0x100000006f1/article-55.xml v772>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.717 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.669+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000844 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-8.xml auth v630 ap=1 s=31697 n(v0 rc2024-09-19T07:13:16.624182+0000 b31697 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac99600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000844:[<0x100000006f1/article-8.xml v630>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000844:[<0x100000006f1/article-8.xml v630>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.717 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.669+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000743 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-68.xml auth v594 ap=1 s=12964 n(v0 rc2024-09-19T07:13:15.944199+0000 b12964 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac99b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000743:[<0x100000006f1/article-68.xml v594>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000743:[<0x100000006f1/article-68.xml v594>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.717 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.669+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000713 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-76.xml auth v606 ap=1 s=26022 n(v0 rc2024-09-19T07:13:15.801202+0000 b26022 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac9a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000713:[<0x100000006f1/article-76.xml v606>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000713:[<0x100000006f1/article-76.xml v606>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.718 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.669+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000883 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-8.jpg auth v596 ap=1 s=33183 n(v0 rc2024-09-19T07:13:16.799178+0000 b33183 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac9a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000883:[<0x100000006f1/picture-8.jpg v596>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000883:[<0x100000006f1/picture-8.jpg v596>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.718 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.669+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007e0 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-32.xml auth v760 ap=1 s=6314 n(v0 rc2024-09-19T07:13:16.379188+0000 b6314 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac9ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007e0:[<0x100000006f1/article-32.xml v760>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000007e0:[<0x100000006f1/article-32.xml v760>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.718 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.669+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007e9 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-30.xml auth v692 ap=1 s=17866 n(v0 rc2024-09-19T07:13:16.407188+0000 b17866 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac9b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007e9:[<0x100000006f1/article-30.xml v692>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000007e9:[<0x100000006f1/article-30.xml v692>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.718 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.670+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000814 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-21.xml auth v738 ap=1 s=24052 n(v0 rc2024-09-19T07:13:16.521185+0000 b24052 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac9b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000814:[<0x100000006f1/article-21.xml v738>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000814:[<0x100000006f1/article-21.xml v738>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.718 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.670+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000831 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-13.xml auth v682 ap=1 s=25565 n(v0 rc2024-09-19T07:13:16.582183+0000 b25565 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35aca8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000831:[<0x100000006f1/article-13.xml v682>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000831:[<0x100000006f1/article-13.xml v682>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.718 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.670+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000078d [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-50.xml auth v676 ap=1 s=2368 n(v0 rc2024-09-19T07:13:16.132194+0000 b2368 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35aca8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000078d:[<0x100000006f1/article-50.xml v676>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000078d:[<0x100000006f1/article-50.xml v676>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.718 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.670+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000085b [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-2.xml auth v674 ap=1 s=21421 n(v0 rc2024-09-19T07:13:16.681181+0000 b21421 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35aca9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000085b:[<0x100000006f1/article-2.xml v674>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000085b:[<0x100000006f1/article-2.xml v674>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.718 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.670+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000084c [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-6.xml auth v728 ap=1 s=1694 n(v0 rc2024-09-19T07:13:16.646182+0000 b1694 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35aca8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000084c:[<0x100000006f1/article-6.xml v728>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000084c:[<0x100000006f1/article-6.xml v728>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.718 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.671+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000775 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-56.xml auth v598 ap=1 s=13447 n(v0 rc2024-09-19T07:13:16.051196+0000 b13447 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35aca9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000775:[<0x100000006f1/article-56.xml v598>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000775:[<0x100000006f1/article-56.xml v598>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.718 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.671+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006fb [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-80.xml auth v628 ap=1 s=11601 n(v0 rc2024-09-19T07:13:15.723204+0000 b11601 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac90b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006fb:[<0x100000006f1/article-80.xml v628>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000006fb:[<0x100000006f1/article-80.xml v628>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.718 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.671+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000089f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-1.jpg auth v732 ap=1 s=24269 n(v0 rc2024-09-19T07:13:16.894176+0000 b24269 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac91600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000089f:[<0x100000006f1/picture-1.jpg v732>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000089f:[<0x100000006f1/picture-1.jpg v732>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.718 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.671+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000087b [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-10.jpg auth v648 ap=1 s=48843 n(v0 rc2024-09-19T07:13:16.771179+0000 b48843 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac91080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000087b:[<0x100000006f1/picture-10.jpg v648>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000087b:[<0x100000006f1/picture-10.jpg v648>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.719 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.671+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000840 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-9.xml auth v768 ap=1 s=13182 n(v0 rc2024-09-19T07:13:16.614183+0000 b13182 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac91b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000840:[<0x100000006f1/article-9.xml v768>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000840:[<0x100000006f1/article-9.xml v768>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.719 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.672+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007a3 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-44.xml auth v742 ap=1 s=12498 n(v0 rc2024-09-19T07:13:16.214192+0000 b12498 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac92100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007a3:[<0x100000006f1/article-44.xml v742>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000007a3:[<0x100000006f1/article-44.xml v742>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.719 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.672+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000088b [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-6.jpg auth v690 ap=1 s=43481 n(v0 rc2024-09-19T07:13:16.826177+0000 b43481 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac92680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000088b:[<0x100000006f1/picture-6.jpg v690>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000088b:[<0x100000006f1/picture-6.jpg v690>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.719 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.672+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000753 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-65.xml auth v622 ap=1 s=14352 n(v0 rc2024-09-19T07:13:15.975198+0000 b14352 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac92c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000753:[<0x100000006f1/article-65.xml v622>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000753:[<0x100000006f1/article-65.xml v622>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.719 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.672+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000805 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-24.xml auth v686 ap=1 s=19425 n(v0 rc2024-09-19T07:13:16.483186+0000 b19425 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac93700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000805:[<0x100000006f1/article-24.xml v686>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000805:[<0x100000006f1/article-24.xml v686>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.719 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.672+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000075e [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-62.xml auth v720 ap=1 s=10610 n(v0 rc2024-09-19T07:13:16.000197+0000 b10610 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac93180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000075e:[<0x100000006f1/article-62.xml v720>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000075e:[<0x100000006f1/article-62.xml v720>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.719 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.673+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000857 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-3.xml auth v600 ap=1 s=3768 n(v0 rc2024-09-19T07:13:16.670181+0000 b3768 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac98580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000857:[<0x100000006f1/article-3.xml v600>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000857:[<0x100000006f1/article-3.xml v600>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.719 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.673+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000848 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-7.xml auth v640 ap=1 s=3547 n(v0 rc2024-09-19T07:13:16.636182+0000 b3547 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac98b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000848:[<0x100000006f1/article-7.xml v640>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000848:[<0x100000006f1/article-7.xml v640>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.719 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.673+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000769 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-59.xml auth v588 ap=1 s=16094 n(v0 rc2024-09-19T07:13:16.025197+0000 b16094 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac52100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000769:[<0x100000006f1/article-59.xml v588>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000769:[<0x100000006f1/article-59.xml v588>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.719 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.673+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000086f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-13.jpg auth v610 ap=1 s=44406 n(v0 rc2024-09-19T07:13:16.738180+0000 b44406 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac52680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000086f:[<0x100000006f1/picture-13.jpg v610>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000086f:[<0x100000006f1/picture-13.jpg v610>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.719 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.674+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000071f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-74.xml auth v650 ap=1 s=12963 n(v0 rc2024-09-19T07:13:15.839201+0000 b12963 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac52c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000071f:[<0x100000006f1/article-74.xml v650>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000071f:[<0x100000006f1/article-74.xml v650>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.719 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.674+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000081e [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-18.xml auth v708 ap=1 s=3088 n(v0 rc2024-09-19T07:13:16.549184+0000 b3088 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac53180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000081e:[<0x100000006f1/article-18.xml v708>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000081e:[<0x100000006f1/article-18.xml v708>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.720 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.674+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000788 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-51.xml auth v584 ap=1 s=22211 n(v0 rc2024-09-19T07:13:16.117195+0000 b22211 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac53700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000788:[<0x100000006f1/article-51.xml v584>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000788:[<0x100000006f1/article-51.xml v584>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.720 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.674+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007f7 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-27.xml auth v734 ap=1 s=12384 n(v0 rc2024-09-19T07:13:16.445187+0000 b12384 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac84000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007f7:[<0x100000006f1/article-27.xml v734>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000007f7:[<0x100000006f1/article-27.xml v734>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.720 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.674+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000893 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-4.jpg auth v748 ap=1 s=18082 n(v0 rc2024-09-19T07:13:16.853177+0000 b18082 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac84580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000893:[<0x100000006f1/picture-4.jpg v748>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000893:[<0x100000006f1/picture-4.jpg v748>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.720 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.675+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000089b [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-2.jpg auth v620 ap=1 s=52339 n(v0 rc2024-09-19T07:13:16.880176+0000 b52339 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac84b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000089b:[<0x100000006f1/picture-2.jpg v620>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000089b:[<0x100000006f1/picture-2.jpg v620>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.720 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.675+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000737 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-70.xml auth v632 ap=1 s=10090 n(v0 rc2024-09-19T07:13:15.920199+0000 b10090 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac85080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000737:[<0x100000006f1/article-70.xml v632>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000737:[<0x100000006f1/article-70.xml v632>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.720 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.675+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000817 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-20.xml auth v618 ap=1 s=27447 n(v0 rc2024-09-19T07:13:16.533185+0000 b27447 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac85600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000817:[<0x100000006f1/article-20.xml v618>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000817:[<0x100000006f1/article-20.xml v618>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.720 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.675+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000086b [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-14.jpg auth v696 ap=1 s=48878 n(v0 rc2024-09-19T07:13:16.726180+0000 b48878 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac85b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000086b:[<0x100000006f1/picture-14.jpg v696>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000086b:[<0x100000006f1/picture-14.jpg v696>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.720 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.675+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000762 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-61.xml auth v722 ap=1 s=11293 n(v0 rc2024-09-19T07:13:16.009197+0000 b11293 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac86100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000762:[<0x100000006f1/article-61.xml v722>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000762:[<0x100000006f1/article-61.xml v722>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.720 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.675+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007b2 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-41.xml auth v666 ap=1 s=27319 n(v0 rc2024-09-19T07:13:16.252191+0000 b27319 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac86680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007b2:[<0x100000006f1/article-41.xml v666>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000007b2:[<0x100000006f1/article-41.xml v666>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.720 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.676+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000079f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-45.xml auth v724 ap=1 s=25499 n(v0 rc2024-09-19T07:13:16.202193+0000 b25499 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac86c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000079f:[<0x100000006f1/article-45.xml v724>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000079f:[<0x100000006f1/article-45.xml v724>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.720 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.676+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000073d [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-69.xml auth v634 ap=1 s=7452 n(v0 rc2024-09-19T07:13:15.932199+0000 b7452 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac87180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000073d:[<0x100000006f1/article-69.xml v634>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000073d:[<0x100000006f1/article-69.xml v634>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.721 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.677+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000887 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-7.jpg auth v776 ap=1 s=38396 n(v0 rc2024-09-19T07:13:16.812178+0000 b38396 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac87700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000887:[<0x100000006f1/picture-7.jpg v776>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000887:[<0x100000006f1/picture-7.jpg v776>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.721 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.677+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007e5 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-31.xml auth v746 ap=1 s=27911 n(v0 rc2024-09-19T07:13:16.394188+0000 b27911 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac90000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007e5:[<0x100000006f1/article-31.xml v746>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000007e5:[<0x100000006f1/article-31.xml v746>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.721 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.677+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000087f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-9.jpg auth v614 ap=1 s=13995 n(v0 rc2024-09-19T07:13:16.785178+0000 b13995 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac90580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000087f:[<0x100000006f1/picture-9.jpg v614>,<0x10000000399/blog-6 v14796>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000087f:[<0x100000006f1/picture-9.jpg v614>,<0x10000000399/blog-6 v54994>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.721 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.677+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ad9 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-13.jpg auth v516 ap=1 s=35834 n(v0 rc2024-09-19T07:13:19.719108+0000 b35834 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35adac100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ad9:[<0x10000000a37/picture-13.jpg v374>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ad9:[<0x10000000a37/picture-13.jpg v516>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.721 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.678+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000aca [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-18.jpg auth v556 ap=1 s=52841 n(v0 rc2024-09-19T07:13:19.686108+0000 b52841 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35adac680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000aca:[<0x10000000a37/picture-18.jpg v344>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000aca:[<0x10000000a37/picture-18.jpg v556>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.721 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.678+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a79 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-18.xml auth v208 ap=1 s=6919 n(v0 rc2024-09-19T07:13:18.549136+0000 b6919 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35adacc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a79:[<0x10000000a37/article-18.xml v208>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000a79:[<0x10000000a37/article-18.xml v208>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.721 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.678+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ac7 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-19.jpg auth v580 ap=1 s=35494 n(v0 rc2024-09-19T07:13:19.679108+0000 b35494 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35adad180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ac7:[<0x10000000a37/picture-19.jpg v338>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ac7:[<0x10000000a37/picture-19.jpg v580>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.721 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.678+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a5f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-27.xml auth v168 ap=1 s=26497 n(v0 rc2024-09-19T07:13:18.448138+0000 b26497 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35adad700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a5f:[<0x10000000a37/article-27.xml v168>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000a5f:[<0x10000000a37/article-27.xml v168>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.721 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.678+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000af4 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-4.jpg auth v528 ap=1 s=17390 n(v0 rc2024-09-19T07:13:19.802106+0000 b17390 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35add2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000af4:[<0x10000000a37/picture-4.jpg v428>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000af4:[<0x10000000a37/picture-4.jpg v528>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.721 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.679+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000afa [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-2.jpg auth v588 ap=1 s=18922 n(v0 rc2024-09-19T07:13:19.817105+0000 b18922 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35add2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000afa:[<0x10000000a37/picture-2.jpg v440>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000afa:[<0x10000000a37/picture-2.jpg v588>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.721 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.679+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a74 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-20.xml auth v196 ap=1 s=14001 n(v0 rc2024-09-19T07:13:18.533136+0000 b14001 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35add2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a74:[<0x10000000a37/article-20.xml v196>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000a74:[<0x10000000a37/article-20.xml v196>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.721 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.679+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ad6 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-14.jpg auth v554 ap=1 s=10256 n(v0 rc2024-09-19T07:13:19.712108+0000 b10256 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35add3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ad6:[<0x10000000a37/picture-14.jpg v368>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ad6:[<0x10000000a37/picture-14.jpg v554>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.722 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.679+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000aeb [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-7.jpg auth v586 ap=1 s=35036 n(v0 rc2024-09-19T07:13:19.770106+0000 b35036 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35add3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000aeb:[<0x10000000a37/picture-7.jpg v410>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000aeb:[<0x10000000a37/picture-7.jpg v586>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.722 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.679+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a50 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-31.xml auth v188 ap=1 s=8527 n(v0 rc2024-09-19T07:13:18.386140+0000 b8527 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35add3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a50:[<0x10000000a37/article-31.xml v188>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000a50:[<0x10000000a37/article-31.xml v188>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.722 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.679+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ae5 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-9.jpg auth v578 ap=1 s=22722 n(v0 rc2024-09-19T07:13:19.749107+0000 b22722 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35add4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ae5:[<0x10000000a37/picture-9.jpg v398>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ae5:[<0x10000000a37/picture-9.jpg v578>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.722 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.680+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ae2 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-10.jpg auth v544 ap=1 s=9892 n(v0 rc2024-09-19T07:13:19.739107+0000 b9892 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35add4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ae2:[<0x10000000a37/picture-10.jpg v392>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ae2:[<0x10000000a37/picture-10.jpg v544>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.722 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.680+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000afd [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-1.jpg auth v582 ap=1 s=41953 n(v0 rc2024-09-19T07:13:19.824105+0000 b41953 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35add4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000afd:[<0x10000000a37/picture-1.jpg v446>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000afd:[<0x10000000a37/picture-1.jpg v582>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.722 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.680+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a91 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-9.xml auth v530 ap=1 s=18313 n(v0 rc2024-09-19T07:13:19.554112+0000 b18313 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35add5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a91:[<0x10000000a37/article-9.xml v230>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000a91:[<0x10000000a37/article-9.xml v530>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.722 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.680+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000aee [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-6.jpg auth v560 ap=1 s=23512 n(v0 rc2024-09-19T07:13:19.781106+0000 b23512 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35add5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000aee:[<0x10000000a37/picture-6.jpg v416>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000aee:[<0x10000000a37/picture-6.jpg v560>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.722 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.680+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a69 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-24.xml auth v216 ap=1 s=5071 n(v0 rc2024-09-19T07:13:18.487137+0000 b5071 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ade0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a69:[<0x10000000a37/article-24.xml v216>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000a69:[<0x10000000a37/article-24.xml v216>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.722 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.680+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000aac [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-28.jpg auth v564 ap=1 s=60612 n(v0 rc2024-09-19T07:13:19.619110+0000 b60612 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ade0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000aac:[<0x10000000a37/picture-28.jpg v284>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000aac:[<0x10000000a37/picture-28.jpg v564>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.722 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.681+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ab8 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-24.jpg auth v538 ap=1 s=43834 n(v0 rc2024-09-19T07:13:19.646109+0000 b43834 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ade1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ab8:[<0x10000000a37/picture-24.jpg v308>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ab8:[<0x10000000a37/picture-24.jpg v538>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.722 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.681+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000acd [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-17.jpg auth v558 ap=1 s=10291 n(v0 rc2024-09-19T07:13:19.692108+0000 b10291 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ade0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000acd:[<0x10000000a37/picture-17.jpg v350>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000acd:[<0x10000000a37/picture-17.jpg v558>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.723 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.681+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000aa3 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-3.xml auth v568 ap=1 s=6058 n(v0 rc2024-09-19T07:13:19.599110+0000 b6058 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ade1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000aa3:[<0x10000000a37/article-3.xml v266>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000aa3:[<0x10000000a37/article-3.xml v568>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.723 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.681+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a98 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-7.xml auth v552 ap=1 s=10336 n(v0 rc2024-09-19T07:13:19.573111+0000 b10336 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ade1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a98:[<0x10000000a37/article-7.xml v242>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000a98:[<0x10000000a37/article-7.xml v552>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.723 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.681+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ab5 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-25.jpg auth v536 ap=1 s=9047 n(v0 rc2024-09-19T07:13:19.639109+0000 b9047 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ade2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ab5:[<0x10000000a37/picture-25.jpg v302>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ab5:[<0x10000000a37/picture-25.jpg v536>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.723 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.681+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a95 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-8.xml auth v520 ap=1 s=4362 n(v0 rc2024-09-19T07:13:19.564111+0000 b4362 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ade2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a95:[<0x10000000a37/article-8.xml v236>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000a95:[<0x10000000a37/article-8.xml v520>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.723 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.681+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ddd [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-68.xml auth v584 ap=1 s=5742 n(v0 rc2024-09-19T07:13:22.300045+0000 b5742 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ade2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ddd:[<0x10000000a37/article-68.xml v459>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ddd:[<0x10000000a37/article-68.xml v584>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.723 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.682+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ae8 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-8.jpg auth v542 ap=1 s=19845 n(v0 rc2024-09-19T07:13:19.760107+0000 b19845 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ade3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ae8:[<0x10000000a37/picture-8.jpg v404>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ae8:[<0x10000000a37/picture-8.jpg v542>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.724 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.682+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dd9 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-26.jpg auth v576 ap=1 s=17049 n(v0 rc2024-09-19T07:13:22.291045+0000 b17049 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ade3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dd9:[<0x10000000a37/picture-26.jpg v452>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000dd9:[<0x10000000a37/picture-26.jpg v576>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.724 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.682+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a4c [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-32.xml auth v172 ap=1 s=15671 n(v0 rc2024-09-19T07:13:18.371140+0000 b15671 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35adea000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a4c:[<0x10000000a37/article-32.xml v172>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000a4c:[<0x10000000a37/article-32.xml v172>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.724 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.682+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a71 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-21.xml auth v194 ap=1 s=28364 n(v0 rc2024-09-19T07:13:18.523136+0000 b28364 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35adea580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a71:[<0x10000000a37/article-21.xml v194>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000a71:[<0x10000000a37/article-21.xml v194>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.724 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.682+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a54 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-30.xml auth v206 ap=1 s=10884 n(v0 rc2024-09-19T07:13:18.402139+0000 b10884 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35adeab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a54:[<0x10000000a37/article-30.xml v206>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000a54:[<0x10000000a37/article-30.xml v206>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.724 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.683+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a85 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-13.xml auth v210 ap=1 s=20584 n(v0 rc2024-09-19T07:13:18.614134+0000 b20584 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35adeb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a85:[<0x10000000a37/article-13.xml v210>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000a85:[<0x10000000a37/article-13.xml v210>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.724 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.683+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a9b [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-6.xml auth v526 ap=1 s=23551 n(v0 rc2024-09-19T07:13:19.579111+0000 b23551 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35adeb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a9b:[<0x10000000a37/article-6.xml v248>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000a9b:[<0x10000000a37/article-6.xml v526>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.725 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.683+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000aa6 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-2.xml auth v590 ap=1 s=11663 n(v0 rc2024-09-19T07:13:19.605110+0000 b11663 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35adebb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000aa6:[<0x10000000a37/article-2.xml v272>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000aa6:[<0x10000000a37/article-2.xml v590>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.725 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.683+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a49 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-33.xml auth v212 ap=1 s=10472 n(v0 rc2024-09-19T07:13:18.355140+0000 b10472 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35adec100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a49:[<0x10000000a37/article-33.xml v212>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000a49:[<0x10000000a37/article-33.xml v212>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.725 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.683+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000af1 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-5.jpg auth v546 ap=1 s=36222 n(v0 rc2024-09-19T07:13:19.791106+0000 b36222 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35adec680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000af1:[<0x10000000a37/picture-5.jpg v422>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000af1:[<0x10000000a37/picture-5.jpg v546>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.725 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.683+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a5b [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-28.xml auth v186 ap=1 s=20785 n(v0 rc2024-09-19T07:13:18.435139+0000 b20785 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35adecc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a5b:[<0x10000000a37/article-28.xml v186>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000a5b:[<0x10000000a37/article-28.xml v186>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.725 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.684+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000af7 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-3.jpg auth v524 ap=1 s=50488 n(v0 rc2024-09-19T07:13:19.811105+0000 b50488 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35aded180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000af7:[<0x10000000a37/picture-3.jpg v434>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000af7:[<0x10000000a37/picture-3.jpg v524>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.725 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.684+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000adf [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-11.jpg auth v574 ap=1 s=42245 n(v0 rc2024-09-19T07:13:19.732107+0000 b42245 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35aded700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000adf:[<0x10000000a37/picture-11.jpg v386>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000adf:[<0x10000000a37/picture-11.jpg v574>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.726 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.684+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a45 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-34.xml auth v174 ap=1 s=23446 n(v0 rc2024-09-19T07:13:18.341141+0000 b23446 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35adfa580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a45:[<0x10000000a37/article-34.xml v174>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000a45:[<0x10000000a37/article-34.xml v174>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.726 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.684+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a58 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-29.xml auth v204 ap=1 s=31328 n(v0 rc2024-09-19T07:13:18.418139+0000 b31328 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35adfab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a58:[<0x10000000a37/article-29.xml v204>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000a58:[<0x10000000a37/article-29.xml v204>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.726 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.684+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000abb [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-23.jpg auth v562 ap=1 s=17348 n(v0 rc2024-09-19T07:13:19.652109+0000 b17348 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35adfb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000abb:[<0x10000000a37/picture-23.jpg v314>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000abb:[<0x10000000a37/picture-23.jpg v562>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.726 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.685+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000abe [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-22.jpg auth v534 ap=1 s=39675 n(v0 rc2024-09-19T07:13:19.659109+0000 b39675 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35adfc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000abe:[<0x10000000a37/picture-22.jpg v320>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000abe:[<0x10000000a37/picture-22.jpg v534>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.726 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.685+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a89 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-11.xml auth v522 ap=1 s=12422 n(v0 rc2024-09-19T07:13:18.748131+0000 b12422 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35adfc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a89:[<0x10000000a37/article-11.xml v178>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000a89:[<0x10000000a37/article-11.xml v522>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.727 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.685+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a7e [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-16.xml auth v166 ap=1 s=26733 n(v0 rc2024-09-19T07:13:18.570135+0000 b26733 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35adfcc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a7e:[<0x10000000a37/article-16.xml v166>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000a7e:[<0x10000000a37/article-16.xml v166>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.727 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.685+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a63 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-26.xml auth v182 ap=1 s=24907 n(v0 rc2024-09-19T07:13:18.462138+0000 b24907 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35adfd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a63:[<0x10000000a37/article-26.xml v182>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000a63:[<0x10000000a37/article-26.xml v182>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.727 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.685+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ad3 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-15.jpg auth v572 ap=1 s=21930 n(v0 rc2024-09-19T07:13:19.705108+0000 b21930 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35adfd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ad3:[<0x10000000a37/picture-15.jpg v362>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ad3:[<0x10000000a37/picture-15.jpg v572>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.727 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.685+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a8e [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-10.xml auth v518 ap=1 s=1373 n(v0 rc2024-09-19T07:13:19.514112+0000 b1373 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae06000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a8e:[<0x10000000a37/article-10.xml v224>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000a8e:[<0x10000000a37/article-10.xml v518>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.727 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.686+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000adc [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-12.jpg auth v570 ap=1 s=28323 n(v0 rc2024-09-19T07:13:19.726107+0000 b28323 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae06580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000adc:[<0x10000000a37/picture-12.jpg v380>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000adc:[<0x10000000a37/picture-12.jpg v570>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.727 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.686+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000aa0 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-4.xml auth v566 ap=1 s=18960 n(v0 rc2024-09-19T07:13:19.592111+0000 b18960 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae06b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000aa0:[<0x10000000a37/article-4.xml v260>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000aa0:[<0x10000000a37/article-4.xml v566>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.728 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.686+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a66 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-25.xml auth v184 ap=1 s=5716 n(v0 rc2024-09-19T07:13:18.475138+0000 b5716 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ae07080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a66:[<0x10000000a37/article-25.xml v184>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000a66:[<0x10000000a37/article-25.xml v184>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.728 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.686+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a39 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-38.xml auth v214 ap=1 s=29635 n(v0 rc2024-09-19T07:13:18.297142+0000 b29635 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ae07600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a39:[<0x10000000a37/article-38.xml v214>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000a39:[<0x10000000a37/article-38.xml v214>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.728 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.687+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ac1 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-21.jpg auth v550 ap=1 s=34469 n(v0 rc2024-09-19T07:13:19.666109+0000 b34469 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae07b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ac1:[<0x10000000a37/picture-21.jpg v326>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ac1:[<0x10000000a37/picture-21.jpg v550>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.728 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.687+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a42 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-35.xml auth v190 ap=1 s=4605 n(v0 rc2024-09-19T07:13:18.328141+0000 b4605 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ae08100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a42:[<0x10000000a37/article-35.xml v190>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000a42:[<0x10000000a37/article-35.xml v190>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.728 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.687+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a80 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-15.xml auth v170 ap=1 s=6370 n(v0 rc2024-09-19T07:13:18.581135+0000 b6370 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ae08680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a80:[<0x10000000a37/article-15.xml v170>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000a80:[<0x10000000a37/article-15.xml v170>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.728 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.687+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a76 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-19.xml auth v176 ap=1 s=10895 n(v0 rc2024-09-19T07:13:18.541136+0000 b10895 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ae08c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a76:[<0x10000000a37/article-19.xml v176>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000a76:[<0x10000000a37/article-19.xml v176>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.729 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.687+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ac4 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-20.jpg auth v532 ap=1 s=30772 n(v0 rc2024-09-19T07:13:19.672109+0000 b30772 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae09180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ac4:[<0x10000000a37/picture-20.jpg v332>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ac4:[<0x10000000a37/picture-20.jpg v532>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.729 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.688+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000aaf [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-27.jpg auth v548 ap=1 s=54316 n(v0 rc2024-09-19T07:13:19.626110+0000 b54316 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae18000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000aaf:[<0x10000000a37/picture-27.jpg v290>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000aaf:[<0x10000000a37/picture-27.jpg v548>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.729 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.688+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a3c [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-37.xml auth v202 ap=1 s=17888 n(v0 rc2024-09-19T07:13:18.307142+0000 b17888 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ae09700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a3c:[<0x10000000a37/article-37.xml v202>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000a3c:[<0x10000000a37/article-37.xml v202>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.729 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.688+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a3f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-36.xml auth v198 ap=1 s=8443 n(v0 rc2024-09-19T07:13:18.317141+0000 b8443 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ae18580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a3f:[<0x10000000a37/article-36.xml v198>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000a3f:[<0x10000000a37/article-36.xml v198>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.729 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.688+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a87 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-12.xml auth v514 ap=1 s=32179 n(v0 rc2024-09-19T07:13:18.648133+0000 b32179 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae18b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a87:[<0x10000000a37/article-12.xml v160>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000a87:[<0x10000000a37/article-12.xml v514>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.729 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.688+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000aa9 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-1.xml auth v540 ap=1 s=5746 n(v0 rc2024-09-19T07:13:19.612110+0000 b5746 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae19080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000aa9:[<0x10000000a37/article-1.xml v278>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000aa9:[<0x10000000a37/article-1.xml v540>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.730 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.689+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a6b [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-23.xml auth v192 ap=1 s=32346 n(v0 rc2024-09-19T07:13:18.500137+0000 b32346 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ae19b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a6b:[<0x10000000a37/article-23.xml v192>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000a6b:[<0x10000000a37/article-23.xml v192>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.730 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.689+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a7b [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-17.xml auth v218 ap=1 s=29847 n(v0 rc2024-09-19T07:13:18.559136+0000 b29847 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ae1a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a7b:[<0x10000000a37/article-17.xml v218>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000a7b:[<0x10000000a37/article-17.xml v218>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: scrub queued for path: / 2024-09-19T07:13:45.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:45.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: scrub summary: active paths [/] 2024-09-19T07:13:45.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: scrub summary: active paths [/] 2024-09-19T07:13:45.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000372 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/man/Makefile) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000205 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/man/blogbench.8) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000206 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/man/Makefile.am) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000207 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/man/Makefile.in) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.835 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000203 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/m4/acx_pthread.m4) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.835 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:45.835 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: scrub summary: active paths [/] 2024-09-19T07:13:45.835 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: scrub summary: active paths [/] 2024-09-19T07:13:45.835 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:45.835 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: scrub summary: active paths [/] 2024-09-19T07:13:45.835 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011bf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-18.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.835 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011cb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-13.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.835 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010cf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-18.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.835 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011bc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-19.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.835 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000109c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-27.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.836 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011de (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-4.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.836 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001178 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-35.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.836 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011e3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-2.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.836 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010c4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-20.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.836 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011c9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-14.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.836 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011d7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-7.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.836 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011d3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-9.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.837 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011d1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-10.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.837 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011e7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-1.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.837 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010fb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-9.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.837 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011da (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-6.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.837 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010ae (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-24.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.837 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011a2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-28.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.838 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001165 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-37.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.838 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011c1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-17.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.838 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011ae (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-24.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.838 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000111e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-3.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.838 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001184 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-33.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.838 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000110b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-7.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.839 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000063e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-64.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.843 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011b5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-13.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.843 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001175 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-21.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.843 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001146 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-26.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.843 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001130 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-42.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.843 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000114c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-39.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.844 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000622 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-75.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.844 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011ab (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-25.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.844 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000692 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-37.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.844 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001103 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-8.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.844 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000073e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-27.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.845 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000119a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-31.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.845 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000626 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-73.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.845 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011d5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-8.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.845 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000068c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-39.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.845 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010bd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-21.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.845 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000110f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-6.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.846 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000694 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-36.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.846 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001124 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-2.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.846 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010e8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-13.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.846 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000072e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-1.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.846 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011a0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-29.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.847 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011dc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-5.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.847 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000006e3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-12.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.847 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001096 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-28.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.847 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011e0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-3.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.847 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011a9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-26.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.847 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001126 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-30.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.848 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001113 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-5.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.848 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001190 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-18.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.848 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011cf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-11.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.848 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000007fa (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-16.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.848 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000108f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-29.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.848 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001142 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-40.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.849 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010e1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-14.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.849 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010b8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-22.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.849 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011b1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-23.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.849 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000639 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-66.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.849 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010f0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-11.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.850 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010d8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-16.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.850 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f02 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-87.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.850 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010a1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-26.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.850 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001052 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-49.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.850 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001139 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-41.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.850 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010a6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-42.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.851 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011c7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-15.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.851 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ffb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-65.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.851 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011b4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-22.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.851 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010f7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-10.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.851 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011c6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-12.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.851 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011cd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-12.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.851 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000006c1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-23.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.852 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001119 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-4.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.852 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000009b5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-100.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.852 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010a8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-25.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.852 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000644 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-63.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.852 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011b7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-21.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.853 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000103b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-51.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.853 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000119d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-30.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.853 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010de (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-15.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.853 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000116c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-36.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.853 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000629 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-72.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.853 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010c8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-19.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.853 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000078a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-21.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.854 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000698 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-35.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.854 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011ba (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-20.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.854 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000fd4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-73.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.854 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001158 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-38.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.854 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000dc7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-96.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.854 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001013 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-60.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.855 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000fb1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-78.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.855 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000689 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-40.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.855 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ef3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-88.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.855 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000006da (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-15.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.855 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f9f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-79.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.855 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010c2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-40.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.855 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010cb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-39.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.855 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f0a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-86.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.855 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010f9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-33.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.856 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000006ce (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-19.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.856 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000079a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-20.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.856 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f71 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-82.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.856 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001107 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-32.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.856 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001007 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-63.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.856 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000102b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-54.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.856 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f41 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-42.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.856 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000e97 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-91.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.856 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f81 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-81.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.856 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000012ab (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-10.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.857 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000dee (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.857 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000102f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-53.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.857 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000008e7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-11.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.857 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f1b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-85.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.857 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000070a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-5.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.857 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000069a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-34.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.857 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010eb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-35.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.857 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001136 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-28.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.857 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000617 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-81.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.857 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000101f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-57.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.857 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000006a9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-29.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.857 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000061c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-78.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.857 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000064d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-60.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.858 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000100f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-61.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.858 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000006c5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-22.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.858 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010d2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-38.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.858 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000fef (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-68.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.858 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000066d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-49.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.858 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f95 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-80.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.858 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000116f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-22.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.858 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001085 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-44.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.858 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000067f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-43.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.858 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000069e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-33.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.858 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000e3f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-93.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.858 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000a90 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-5.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.858 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000fbb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-76.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.858 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000113d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-27.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.859 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000656 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-57.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.859 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ff7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-66.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.859 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001036 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-52.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.859 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000061a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-79.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.859 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011a6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-15.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.859 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000652 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-58.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.859 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001094 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-43.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.859 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000662 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-53.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.859 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001195 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-17.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.859 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000006ae (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-28.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.860 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000012b4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-9.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.860 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000009d2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-99.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.860 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001079 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-45.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.860 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f29 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-84.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.860 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000065b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-55.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.860 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000074f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-25.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.860 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000a6f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-97.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.861 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000006f8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-8.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.861 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001063 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-47.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.861 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001070 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-46.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.861 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000007b1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-68.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.861 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000fe1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-70.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.861 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000620 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-76.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.861 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000009b8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-8.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.861 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000747 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-26.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.861 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000a56 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-98.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.861 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000006a0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-32.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.861 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f3d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-83.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.862 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000fec (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-69.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.862 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ef0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-89.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.862 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000006c8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-21.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.862 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000006a7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-30.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.862 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000fcf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-74.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.862 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010e4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-36.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.862 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000006e0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-13.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.862 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001001 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-64.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.862 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000fd8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-72.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.862 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000066b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-50.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.862 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f86 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-6.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.862 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000722 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-2.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011af (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-14.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ff3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-67.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001186 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-19.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000659 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-56.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000619 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-80.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010db (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-37.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000fdd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-71.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000008f7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-10.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000de8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-95.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000e56 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000119b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-16.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000006f2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-9.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000fa2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-44.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000a60 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-6.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000063a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-65.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000007c1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-99.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000101b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-58.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000647 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-62.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000006be (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-24.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001027 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-55.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010f3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-34.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000114f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-25.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010b1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-41.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000637 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-67.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.865 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000fc0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-75.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.865 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000007e3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-17.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.865 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000071a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-3.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.865 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000759 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-24.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.865 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000006fe (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-7.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.865 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001164 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-23.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.865 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000115c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-24.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.865 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000650 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-59.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.865 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000833 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-13.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.865 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001021 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-56.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.865 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000624 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-74.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.866 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000007c8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-18.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.866 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000006d1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-18.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.866 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000007ae (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-19.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.866 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000667 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-51.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.866 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000112d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-29.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.866 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000006b3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-27.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.866 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000dd0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-4.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.866 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000e19 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.866 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000006ca (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-20.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.866 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000064a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-61.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.866 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000685 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-41.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.867 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000679 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-45.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.867 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000632 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-69.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.867 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000e09 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-94.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.867 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000a4e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-7.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.867 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000006a3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-31.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.867 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011e5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-11.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.867 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001181 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-20.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.867 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ed3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-13.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.867 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000e99 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-18.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.868 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000e83 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-27.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.868 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ee8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-4.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.868 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000eef (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.868 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000e94 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-20.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.868 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ed1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-14.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.868 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ee1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-7.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.868 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000edc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-9.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.868 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ef2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.868 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000eb4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-9.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.868 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ee3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-6.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.869 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000e8a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-24.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.869 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000012e0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-92.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.869 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ec9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-17.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.869 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ec2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-3.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.869 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000eb9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-7.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.869 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000eb6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-8.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.869 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000edf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-8.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.869 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000e7c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-30.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.869 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000eab (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-13.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.869 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ebb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-6.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.870 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ec5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-2.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.870 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ee6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-5.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.870 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000e81 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-28.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.870 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000eeb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.870 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ed8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-11.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.870 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ebe (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-5.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.870 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000e7e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-29.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.870 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011a5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-27.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.870 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010ed (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-12.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.870 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000112a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-1.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.870 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000117e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-34.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.871 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011c4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-16.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.871 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010b3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-23.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.871 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010d4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-17.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.871 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000118a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-32.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.871 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000de2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-2.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.871 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000081c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-14.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.871 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000062f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-70.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.871 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000dcf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-92.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.872 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000dbb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-9.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.872 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000e74 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-92.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.872 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000e91 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-21.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.872 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000e8f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-22.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.872 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000dd2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-3.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.872 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ea7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-14.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.872 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000dc1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-7.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.872 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000012e6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-71.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.872 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000dbe (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-8.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.872 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000eaf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-11.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.872 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ea0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-16.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.872 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000e85 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-26.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.872 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ece (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-15.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.873 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000dae (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-13.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.873 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000eb2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-10.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.873 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000dc4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-6.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.873 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ed5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-12.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.873 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000dd6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-2.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.874 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ec0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-4.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.874 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000e88 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-25.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.874 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000dd4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-56.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.874 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000e96 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-19.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.874 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ead (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-12.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.874 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ec7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-1.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.874 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ecc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-16.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.875 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000e9c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-17.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.875 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000e8d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-23.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.875 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:45.875 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ddf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-3.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.875 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:45 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000dc8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-5.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.877 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.595+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008c7 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-64.xml auth v663 ap=1 s=8274 n(v0 rc2024-09-19T07:13:17.055172+0000 b8274 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@21},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb1446100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008c7:[<0x100000008a3/article-64.xml v663>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000008c7:[<0x100000008a3/article-64.xml v663>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.878 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.595+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000093b [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-37.xml auth v557 ap=1 s=22449 n(v0 rc2024-09-19T07:13:17.414163+0000 b22449 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@24},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb1447700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000093b:[<0x100000008a3/article-37.xml v557>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000093b:[<0x100000008a3/article-37.xml v557>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.878 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.596+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008a4 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-73.xml auth v653 ap=1 s=10628 n(v0 rc2024-09-19T07:13:16.915175+0000 b10628 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@36},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb1452000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008a4:[<0x100000008a3/article-73.xml v653>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000008a4:[<0x100000008a3/article-73.xml v653>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.878 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.596+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000933 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-39.xml auth v631 ap=1 s=20868 n(v0 rc2024-09-19T07:13:17.385164+0000 b20868 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@43},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb1452580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000933:[<0x100000008a3/article-39.xml v631>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000933:[<0x100000008a3/article-39.xml v631>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.878 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: scrub queued for path: / 2024-09-19T07:13:45.878 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:45.878 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: scrub summary: active paths [/] 2024-09-19T07:13:45.879 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: scrub summary: active paths [/] 2024-09-19T07:13:45.879 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000372 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/man/Makefile) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.879 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000205 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/man/blogbench.8) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.879 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000206 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/man/Makefile.am) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.879 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000207 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/man/Makefile.in) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.879 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000203 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/m4/acx_pthread.m4) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.879 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:45.879 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: scrub summary: active paths [/] 2024-09-19T07:13:45.879 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: scrub summary: active paths [/] 2024-09-19T07:13:45.879 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:45.879 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: scrub summary: active paths [/] 2024-09-19T07:13:45.879 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011bf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-18.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.879 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011cb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-13.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.880 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010cf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-18.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.880 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011bc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-19.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.880 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000109c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-27.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.880 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011de (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-4.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.880 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001178 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-35.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.880 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011e3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-2.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.880 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010c4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-20.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.881 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.596+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000093e [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-36.xml auth v715 ap=1 s=27109 n(v0 rc2024-09-19T07:13:17.425163+0000 b27109 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@39},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb1452b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000093e:[<0x100000008a3/article-36.xml v715>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000093e:[<0x100000008a3/article-36.xml v715>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.881 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.596+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000987 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-12.xml auth v651 ap=1 s=32621 n(v0 rc2024-09-19T07:13:17.620158+0000 b32621 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@27},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb1453080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000987:[<0x100000008a3/article-12.xml v651>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000987:[<0x100000008a3/article-12.xml v651>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.881 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.596+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009a5 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-1.xml auth v587 ap=1 s=19835 n(v0 rc2024-09-19T07:13:17.733156+0000 b19835 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@23},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb1453600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009a5:[<0x100000008a3/article-1.xml v587>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000009a5:[<0x100000008a3/article-1.xml v587>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.881 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.597+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008bf [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-66.xml auth v643 ap=1 s=25435 n(v0 rc2024-09-19T07:13:17.022173+0000 b25435 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@45},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb1454c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008bf:[<0x100000008a3/article-66.xml v643>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000008bf:[<0x100000008a3/article-66.xml v643>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.881 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.597+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009a7 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-16.jpg auth v687 ap=1 s=52384 n(v0 rc2024-09-19T07:13:17.739155+0000 b52384 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@28},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb1455180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009a7:[<0x100000008a3/picture-16.jpg v687>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000009a7:[<0x100000008a3/picture-16.jpg v687>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.882 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011c9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-14.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.882 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011d7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-7.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.882 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011d3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-9.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.882 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011d1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-10.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.882 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011e7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-1.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.882 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010fb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-9.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.882 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011da (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-6.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.882 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010ae (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-24.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011a2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-28.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001165 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-37.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011c1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-17.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011ae (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-24.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000111e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-3.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001184 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-33.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000110b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-7.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000063e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-64.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.884 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.597+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000966 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-23.xml auth v635 ap=1 s=12343 n(v0 rc2024-09-19T07:13:17.531160+0000 b12343 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@27},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb1462580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000966:[<0x100000008a3/article-23.xml v635>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000966:[<0x100000008a3/article-23.xml v635>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.884 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.597+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001163 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-42.xml auth v1671 ap=1 s=5733 n(v0 rc2024-09-19T07:13:24.798985+0000 b5733 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@17},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1462000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001163:[<0x100000008a3/comment-42.xml v831>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001163:[<0x100000008a3/comment-42.xml v1671>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.884 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.597+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008cb [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-63.xml auth v697 ap=1 s=23864 n(v0 rc2024-09-19T07:13:17.068172+0000 b23864 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb1463080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008cb:[<0x100000008a3/article-63.xml v697>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000008cb:[<0x100000008a3/article-63.xml v697>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.884 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.598+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000978 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-17.xml auth v725 ap=1 s=30962 n(v0 rc2024-09-19T07:13:17.578159+0000 b30962 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@28},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb1462b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000978:[<0x100000008a3/article-17.xml v725>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000978:[<0x100000008a3/article-17.xml v725>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.884 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.598+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008a8 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-72.xml auth v707 ap=1 s=22805 n(v0 rc2024-09-19T07:13:16.932175+0000 b22805 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@45},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb1436100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008a8:[<0x100000008a3/article-72.xml v707>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000008a8:[<0x100000008a3/article-72.xml v707>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011b5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-13.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001175 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-21.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.885 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001146 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-26.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.885 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001130 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-42.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.885 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000114c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-39.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.885 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000622 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-75.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.885 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011ab (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-25.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.885 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000692 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-37.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.886 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001103 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-8.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.886 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000073e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-27.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.886 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000119a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-31.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.886 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000626 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-73.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.886 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011d5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-8.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.886 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000068c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-39.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.887 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010bd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-21.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.887 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000110f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-6.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.887 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000694 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-36.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.887 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.599+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000942 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-35.xml auth v611 ap=1 s=26377 n(v0 rc2024-09-19T07:13:17.437163+0000 b26377 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@38},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb1436680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000942:[<0x100000008a3/article-35.xml v611>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000942:[<0x100000008a3/article-35.xml v611>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.887 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.600+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000092f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-40.xml auth v601 ap=1 s=23374 n(v0 rc2024-09-19T07:13:17.371164+0000 b23374 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@40},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb1437180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000092f:[<0x100000008a3/article-40.xml v601>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000092f:[<0x100000008a3/article-40.xml v601>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.888 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001124 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-2.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.888 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010e8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-13.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.888 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000072e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-1.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.888 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011a0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-29.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.888 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011dc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-5.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.888 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000006e3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-12.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.888 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001096 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-28.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.888 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011e0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-3.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.889 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011a9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-26.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.889 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001126 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-30.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.889 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001113 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-5.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.889 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001190 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-18.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.889 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011cf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-11.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.889 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000007fa (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-16.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.889 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000108f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-29.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.889 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001142 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-40.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.889 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010e1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-14.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.889 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010b8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-22.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.889 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011b1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-23.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.889 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000639 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-66.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.890 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010f0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-11.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.890 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010d8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-16.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.890 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f02 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-87.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.890 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010a1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-26.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.890 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001052 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-49.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.890 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001139 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-41.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.890 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010a6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-42.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.890 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011c7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-15.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.891 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ffb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-65.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.891 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011b4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-22.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.891 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010f7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-10.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.891 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011c6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-12.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.891 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011cd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-12.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.892 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.601+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000097e [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-15.xml auth v569 ap=1 s=1084 n(v0 rc2024-09-19T07:13:17.595159+0000 b1084 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@27},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb1437700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000097e:[<0x100000008a3/article-15.xml v569>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000097e:[<0x100000008a3/article-15.xml v569>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.892 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.601+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001173 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-40.xml auth v1665 ap=1 s=2780 n(v0 rc2024-09-19T07:13:24.849984+0000 b2780 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@17},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1444000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001173:[<0x100000008a3/comment-40.xml v853>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001173:[<0x100000008a3/comment-40.xml v1665>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.892 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.601+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000117a [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-39.xml auth v1661 ap=1 s=8315 n(v0 rc2024-09-19T07:13:24.868983+0000 b8315 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@17},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1444b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000117a:[<0x100000008a3/comment-39.xml v861>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000117a:[<0x100000008a3/comment-39.xml v1661>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.892 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.601+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000972 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-19.xml auth v567 ap=1 s=23876 n(v0 rc2024-09-19T07:13:17.560160+0000 b23876 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@28},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb1445080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000972:[<0x100000008a3/article-19.xml v567>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000972:[<0x100000008a3/article-19.xml v567>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.892 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.601+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000928 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-42.xml auth v603 ap=1 s=4967 n(v0 rc2024-09-19T07:13:17.343165+0000 b4967 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@38},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb1445b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000928:[<0x100000008a3/article-42.xml v603>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000928:[<0x100000008a3/article-42.xml v603>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.892 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.602+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000918 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-46.xml auth v637 ap=1 s=21623 n(v0 rc2024-09-19T07:13:17.289166+0000 b21623 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@38},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb1422b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000918:[<0x100000008a3/article-46.xml v637>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000918:[<0x100000008a3/article-46.xml v637>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.892 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.602+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000981 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-14.xml auth v647 ap=1 s=25562 n(v0 rc2024-09-19T07:13:17.603159+0000 b25562 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@27},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb1422580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000981:[<0x100000008a3/article-14.xml v647>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000981:[<0x100000008a3/article-14.xml v647>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.893 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.602+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000912 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-47.xml auth v713 ap=1 s=14242 n(v0 rc2024-09-19T07:13:17.280166+0000 b14242 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@44},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb1423080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000912:[<0x100000008a3/article-47.xml v713>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000912:[<0x100000008a3/article-47.xml v713>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.893 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.602+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008ac [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-71.xml auth v681 ap=1 s=8303 n(v0 rc2024-09-19T07:13:16.947175+0000 b8303 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@51},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb1423600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008ac:[<0x100000008a3/article-71.xml v681>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000008ac:[<0x100000008a3/article-71.xml v681>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.893 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000006c1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-23.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.893 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001119 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-4.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.893 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000009b5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-100.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.893 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010a8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-25.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.893 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000644 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-63.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.893 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011b7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-21.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.893 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000103b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-51.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.893 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000119d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-30.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.894 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010de (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-15.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.894 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000116c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-36.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.894 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000629 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-72.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.894 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010c8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-19.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.894 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000078a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-21.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.894 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000698 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-35.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.894 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011ba (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-20.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.894 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000fd4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-73.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.895 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.602+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000098a [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-11.xml auth v701 ap=1 s=1776 n(v0 rc2024-09-19T07:13:17.629158+0000 b1776 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@27},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb1423b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000098a:[<0x100000008a3/article-11.xml v701>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000098a:[<0x100000008a3/article-11.xml v701>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.895 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.602+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000097b [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-16.xml auth v615 ap=1 s=27795 n(v0 rc2024-09-19T07:13:17.586159+0000 b27795 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@28},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb1424100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000097b:[<0x100000008a3/article-16.xml v615>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000097b:[<0x100000008a3/article-16.xml v615>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.895 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.602+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008f1 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-54.xml auth v555 ap=1 s=18777 n(v0 rc2024-09-19T07:13:17.203168+0000 b18777 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@48},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb1424680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008f1:[<0x100000008a3/article-54.xml v555>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000008f1:[<0x100000008a3/article-54.xml v555>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.895 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.602+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000095d [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-26.xml auth v685 ap=1 s=25819 n(v0 rc2024-09-19T07:13:17.509161+0000 b25819 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@33},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb1424c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000095d:[<0x100000008a3/article-26.xml v685>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000095d:[<0x100000008a3/article-26.xml v685>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.895 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.603+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009a8 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-15.jpg auth v695 ap=1 s=44660 n(v0 rc2024-09-19T07:13:17.743155+0000 b44660 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@27},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb1425180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009a8:[<0x100000008a3/picture-15.jpg v695>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000009a8:[<0x100000008a3/picture-15.jpg v695>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.896 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.603+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000098d [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-10.xml auth v691 ap=1 s=29880 n(v0 rc2024-09-19T07:13:17.638158+0000 b29880 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@25},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb1425700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000098d:[<0x100000008a3/article-10.xml v691>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000098d:[<0x100000008a3/article-10.xml v691>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.896 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.603+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009ab [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-12.jpg auth v711 ap=1 s=30066 n(v0 rc2024-09-19T07:13:17.753155+0000 b30066 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@27},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb1434000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009ab:[<0x100000008a3/picture-12.jpg v711>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000009ab:[<0x100000008a3/picture-12.jpg v711>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.896 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001158 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-38.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.896 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000dc7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-96.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.896 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001013 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-60.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.897 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000fb1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-78.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.897 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000689 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-40.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.897 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ef3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-88.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.901 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000006da (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-15.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.901 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f9f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-79.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.901 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010c2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-40.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.901 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010cb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-39.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.901 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f0a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-86.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.901 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010f9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-33.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.901 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000006ce (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-19.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.901 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000079a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-20.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.901 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f71 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-82.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.901 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001107 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-32.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.901 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001007 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-63.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.902 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.603+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000090d [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-48.xml auth v673 ap=1 s=16159 n(v0 rc2024-09-19T07:13:17.272167+0000 b16159 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@43},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb1434580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000090d:[<0x100000008a3/article-48.xml v673>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000090d:[<0x100000008a3/article-48.xml v673>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.903 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.603+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000099f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-4.xml auth v703 ap=1 s=9383 n(v0 rc2024-09-19T07:13:17.704156+0000 b9383 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@23},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb1434b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000099f:[<0x100000008a3/article-4.xml v703>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000099f:[<0x100000008a3/article-4.xml v703>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.903 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.603+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000960 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-25.xml auth v571 ap=1 s=15728 n(v0 rc2024-09-19T07:13:17.516161+0000 b15728 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@38},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb1435080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000960:[<0x100000008a3/article-25.xml v571>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000960:[<0x100000008a3/article-25.xml v571>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.903 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.603+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000936 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-38.xml auth v639 ap=1 s=11728 n(v0 rc2024-09-19T07:13:17.399164+0000 b11728 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@42},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb1435600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000936:[<0x100000008a3/article-38.xml v639>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000936:[<0x100000008a3/article-38.xml v639>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.903 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.604+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009b7 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-3.jpg auth v579 ap=1 s=34308 n(v0 rc2024-09-19T07:13:17.795154+0000 b34308 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@23},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb1405700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009b7:[<0x100000008a3/picture-3.jpg v579>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000009b7:[<0x100000008a3/picture-3.jpg v579>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.903 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.604+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009ac [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-11.jpg auth v671 ap=1 s=11075 n(v0 rc2024-09-19T07:13:17.757155+0000 b11075 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@25},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb1410580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009ac:[<0x100000008a3/picture-11.jpg v671>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000009ac:[<0x100000008a3/picture-11.jpg v671>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.903 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.604+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000099c [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-5.xml auth v623 ap=1 s=25710 n(v0 rc2024-09-19T07:13:17.692157+0000 b25710 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@24},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb1410b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000099c:[<0x100000008a3/article-5.xml v623>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000099c:[<0x100000008a3/article-5.xml v623>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.904 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000102b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-54.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.904 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f41 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-42.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.904 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000e97 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-91.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.904 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f81 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-81.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.904 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000012ab (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-10.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.904 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000dee (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.904 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000102f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-53.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.905 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000008e7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-11.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.905 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f1b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-85.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.905 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000070a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-5.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.905 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000069a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-34.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.905 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010eb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-35.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.905 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001136 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-28.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.905 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000617 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-81.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.905 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000101f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-57.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.905 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000006a9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-29.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.906 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.604+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000945 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-34.xml auth v583 ap=1 s=26988 n(v0 rc2024-09-19T07:13:17.448162+0000 b26988 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@30},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb1411080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000945:[<0x100000008a3/article-34.xml v583>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000945:[<0x100000008a3/article-34.xml v583>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.906 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.605+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000954 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-29.xml auth v559 ap=1 s=25898 n(v0 rc2024-09-19T07:13:17.486162+0000 b25898 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@34},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb1412100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000954:[<0x100000008a3/article-29.xml v559>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000954:[<0x100000008a3/article-29.xml v559>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.906 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.605+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008d7 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-60.xml auth v609 ap=1 s=10164 n(v0 rc2024-09-19T07:13:17.111171+0000 b10164 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@5},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb1412680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008d7:[<0x100000008a3/article-60.xml v609>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000008d7:[<0x100000008a3/article-60.xml v609>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.906 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.605+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000969 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-22.xml auth v677 ap=1 s=19310 n(v0 rc2024-09-19T07:13:17.538160+0000 b19310 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@28},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb1412c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000969:[<0x100000008a3/article-22.xml v677>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000969:[<0x100000008a3/article-22.xml v677>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.906 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.605+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011fc [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-38.xml auth v1663 ap=1 s=8343 n(v0 rc2024-09-19T07:13:25.344972+0000 b8343 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@17},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1413180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011fc:[<0x100000008a3/comment-38.xml v875>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011fc:[<0x100000008a3/comment-38.xml v1663>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.907 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000061c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-78.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.907 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000064d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-60.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.907 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000100f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-61.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.907 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000006c5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-22.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.907 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010d2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-38.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.907 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000fef (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-68.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.907 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000066d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-49.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.907 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f95 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-80.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.907 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000116f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-22.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.907 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001085 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-44.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.907 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000067f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-43.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.907 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000069e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-33.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.908 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000e3f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-93.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.908 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000a90 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-5.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.908 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000fbb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-76.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.908 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000113d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-27.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.908 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000656 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-57.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.909 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.605+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000909 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-49.xml auth v629 ap=1 s=6394 n(v0 rc2024-09-19T07:13:17.263167+0000 b6394 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@44},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb1413700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000909:[<0x100000008a3/article-49.xml v629>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000909:[<0x100000008a3/article-49.xml v629>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.909 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.606+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001155 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-44.xml auth v1668 ap=1 s=4212 n(v0 rc2024-09-19T07:13:24.743986+0000 b4212 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@17},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb13f5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001155:[<0x100000008a3/comment-44.xml v811>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001155:[<0x100000008a3/comment-44.xml v1668>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.909 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.606+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000924 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-43.xml auth v575 ap=1 s=28392 n(v0 rc2024-09-19T07:13:17.328165+0000 b28392 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@40},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb13f6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000924:[<0x100000008a3/article-43.xml v575>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000924:[<0x100000008a3/article-43.xml v575>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.909 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.606+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000948 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-33.xml auth v683 ap=1 s=7154 n(v0 rc2024-09-19T07:13:17.457162+0000 b7154 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@38},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb13f6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000948:[<0x100000008a3/article-33.xml v683>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000948:[<0x100000008a3/article-33.xml v683>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.909 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.606+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009b4 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-5.jpg auth v627 ap=1 s=14665 n(v0 rc2024-09-19T07:13:17.782154+0000 b14665 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@24},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb13f6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009b4:[<0x100000008a3/picture-5.jpg v627>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000009b4:[<0x100000008a3/picture-5.jpg v627>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.909 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.606+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008e4 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-57.xml auth v705 ap=1 s=18460 n(v0 rc2024-09-19T07:13:17.155170+0000 b18460 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@20},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb13f7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008e4:[<0x100000008a3/article-57.xml v705>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000008e4:[<0x100000008a3/article-57.xml v705>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.909 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.607+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008e0 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-58.xml auth v699 ap=1 s=20862 n(v0 rc2024-09-19T07:13:17.138170+0000 b20862 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@12},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb1402b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008e0:[<0x100000008a3/article-58.xml v699>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000008e0:[<0x100000008a3/article-58.xml v699>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.910 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ff7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-66.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.910 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001036 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-52.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.910 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000061a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-79.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.910 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011a6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-15.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.910 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000652 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-58.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.910 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001094 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-43.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.910 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000662 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-53.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.910 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001195 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-17.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.910 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000006ae (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-28.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.910 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000012b4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-9.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.910 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000009d2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-99.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.910 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001079 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-45.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.911 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f29 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-84.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.911 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000065b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-55.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.911 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000074f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-25.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.911 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000a6f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-97.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.911 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.607+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008f6 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-53.xml auth v565 ap=1 s=29394 n(v0 rc2024-09-19T07:13:17.219168+0000 b29394 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@40},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb1403080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008f6:[<0x100000008a3/article-53.xml v565>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000008f6:[<0x100000008a3/article-53.xml v565>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.911 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.607+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000115d [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-43.xml auth v1660 ap=1 s=5088 n(v0 rc2024-09-19T07:13:24.771986+0000 b5088 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@17},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1403600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000115d:[<0x100000008a3/comment-43.xml v819>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000115d:[<0x100000008a3/comment-43.xml v1660>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.911 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000006f8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-8.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.912 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001063 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-47.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.912 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001070 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-46.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.912 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000007b1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-68.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.912 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000fe1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-70.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.912 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000620 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-76.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.912 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000009b8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-8.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.912 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000747 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-26.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.912 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000a56 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-98.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.912 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000006a0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-32.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.912 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f3d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-83.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.912 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000fec (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-69.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.912 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ef0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-89.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.912 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000006c8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-21.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.913 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000006a7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-30.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.913 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000fcf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-74.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.913 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010e4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-36.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.913 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.607+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000957 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-28.xml auth v679 ap=1 s=1927 n(v0 rc2024-09-19T07:13:17.494161+0000 b1927 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@31},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb1404100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000957:[<0x100000008a3/article-28.xml v679>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000957:[<0x100000008a3/article-28.xml v679>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.913 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.607+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009c6 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-55.xml auth v607 ap=1 s=24116 n(v0 rc2024-09-19T07:13:17.845153+0000 b24116 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@29},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb13dd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009c6:[<0x100000008a3/article-55.xml v607>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000009c6:[<0x100000008a3/article-55.xml v607>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.913 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.607+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008fc [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-52.xml auth v593 ap=1 s=11070 n(v0 rc2024-09-19T07:13:17.235168+0000 b11070 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@43},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb1404c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008fc:[<0x100000008a3/article-52.xml v593>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000008fc:[<0x100000008a3/article-52.xml v593>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.913 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.608+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000993 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-8.xml auth v717 ap=1 s=29334 n(v0 rc2024-09-19T07:13:17.656157+0000 b29334 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@25},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb13dd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000993:[<0x100000008a3/article-8.xml v717>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000993:[<0x100000008a3/article-8.xml v717>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.913 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.608+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008b8 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-68.xml auth v573 ap=1 s=7461 n(v0 rc2024-09-19T07:13:16.989174+0000 b7461 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@41},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb13e8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008b8:[<0x100000008a3/article-68.xml v573>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000008b8:[<0x100000008a3/article-68.xml v573>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.914 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000006e0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-13.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.914 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001001 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-64.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.914 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000fd8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-72.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.914 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000066b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-50.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.914 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f86 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-6.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.914 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000722 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-2.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.914 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011af (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-14.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.914 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ff3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-67.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.914 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001186 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-19.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.914 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000659 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-56.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.915 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000619 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-80.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.915 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010db (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-37.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.915 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000fdd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-71.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.915 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000008f7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-10.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.915 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000de8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-95.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.915 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000e56 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.916 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.608+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009af [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-8.jpg auth v625 ap=1 s=42333 n(v0 rc2024-09-19T07:13:17.767155+0000 b42333 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@25},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb13e8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009af:[<0x100000008a3/picture-8.jpg v625>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000009af:[<0x100000008a3/picture-8.jpg v625>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.916 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.609+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000094b [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-32.xml auth v723 ap=1 s=12648 n(v0 rc2024-09-19T07:13:17.464162+0000 b12648 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@33},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb13e8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000094b:[<0x100000008a3/article-32.xml v723>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000094b:[<0x100000008a3/article-32.xml v723>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.916 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.609+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000096c [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-21.xml auth v655 ap=1 s=31512 n(v0 rc2024-09-19T07:13:17.546160+0000 b31512 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@27},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb13e9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000096c:[<0x100000008a3/article-21.xml v655>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000096c:[<0x100000008a3/article-21.xml v655>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.916 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.609+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000951 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-30.xml auth v665 ap=1 s=7990 n(v0 rc2024-09-19T07:13:17.479162+0000 b7990 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@35},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb13e9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000951:[<0x100000008a3/article-30.xml v665>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000951:[<0x100000008a3/article-30.xml v665>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.916 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.609+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000120b [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-36.xml auth v1657 ap=1 s=4660 n(v0 rc2024-09-19T07:13:25.391971+0000 b4660 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@17},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb13e9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000120b:[<0x100000008a3/comment-36.xml v909>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000120b:[<0x100000008a3/comment-36.xml v1657>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.916 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000119b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-16.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.917 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000006f2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-9.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.917 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000fa2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-44.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.917 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000a60 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-6.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.917 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000063a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-65.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.917 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000007c1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-99.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.917 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000101b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-58.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.917 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000647 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-62.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.917 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000006be (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-24.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.917 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001027 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-55.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.917 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010f3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-34.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.917 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000114f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-25.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.917 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010b1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-41.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.917 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000637 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-67.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.918 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000fc0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-75.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.918 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000007e3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-17.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.918 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000071a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-3.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.919 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T07:13:45.919 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.609+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000984 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-13.xml auth v721 ap=1 s=21211 n(v0 rc2024-09-19T07:13:17.612158+0000 b21211 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@27},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb13ea100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000984:[<0x100000008a3/article-13.xml v721>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000984:[<0x100000008a3/article-13.xml v721>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.919 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.609+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000905 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-50.xml auth v595 ap=1 s=9977 n(v0 rc2024-09-19T07:13:17.254167+0000 b9977 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@44},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb13eac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000905:[<0x100000008a3/article-50.xml v595>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000905:[<0x100000008a3/article-50.xml v595>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.919 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.609+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000999 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-6.xml auth v605 ap=1 s=3838 n(v0 rc2024-09-19T07:13:17.679157+0000 b3838 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@24},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb13eb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000999:[<0x100000008a3/article-6.xml v605>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000999:[<0x100000008a3/article-6.xml v605>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.919 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.610+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009a3 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-2.xml auth v641 ap=1 s=11052 n(v0 rc2024-09-19T07:13:17.724156+0000 b11052 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@23},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb13eb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009a3:[<0x100000008a3/article-2.xml v641>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000009a3:[<0x100000008a3/article-2.xml v641>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.920 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000759 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-24.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.920 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000006fe (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-7.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.920 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001164 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-23.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.920 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000115c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-24.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.920 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000650 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-59.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.920 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000833 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-13.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.920 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001021 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-56.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.920 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000624 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-74.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.920 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000007c8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-18.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.920 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000006d1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-18.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.921 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000007ae (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-19.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.921 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000667 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-51.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.921 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000112d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-29.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.921 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000006b3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-27.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.921 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000dd0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-4.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.921 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000e19 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.921 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.610+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008e9 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-56.xml auth v659 ap=1 s=26754 n(v0 rc2024-09-19T07:13:17.172169+0000 b26754 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@40},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb13f4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008e9:[<0x100000008a3/article-56.xml v659>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000008e9:[<0x100000008a3/article-56.xml v659>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.921 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.610+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001204 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-37.xml auth v1666 ap=1 s=6598 n(v0 rc2024-09-19T07:13:25.369971+0000 b6598 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@17},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb13ce580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001204:[<0x100000008a3/comment-37.xml v894>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001204:[<0x100000008a3/comment-37.xml v1666>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.922 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.610+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009ad [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-10.jpg auth v585 ap=1 s=35586 n(v0 rc2024-09-19T07:13:17.760155+0000 b35586 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@25},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb13ceb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009ad:[<0x100000008a3/picture-10.jpg v585>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000009ad:[<0x100000008a3/picture-10.jpg v585>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.922 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.610+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009bc [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-1.jpg auth{0=1} v1628 ap=1 s=61319 n(v0 rc2024-09-19T07:13:17.808154+0000 b61319 1=1+0) caps={24793=pAsLsXsFscr/pFscr@4} mcw={0=Fscr} | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x561fb13cf080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009bc:[<0x100000008a3/picture-1.jpg v719>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000009bc:[<0x100000008a3/picture-1.jpg v1628>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.922 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.611+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000990 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-9.xml auth v693 ap=1 s=23669 n(v0 rc2024-09-19T07:13:17.647158+0000 b23669 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@25},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb13cfb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000990:[<0x100000008a3/article-9.xml v693>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000990:[<0x100000008a3/article-9.xml v693>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.922 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000006ca (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-20.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.922 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000064a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-61.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.922 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000685 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-41.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.922 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000679 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-45.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.922 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000632 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-69.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.922 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000e09 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-94.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.922 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000a4e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-7.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.923 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000006a3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-31.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.923 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011e5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-11.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.923 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001181 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-20.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.923 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ed3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-13.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.923 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000e99 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-18.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.923 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000e83 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-27.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.923 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ee8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-4.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.923 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000eef (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.923 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000e94 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-20.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.923 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ed1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-14.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.924 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.611+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000920 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-44.xml auth v597 ap=1 s=20096 n(v0 rc2024-09-19T07:13:17.315166+0000 b20096 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@43},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb13d0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000920:[<0x100000008a3/article-44.xml v597>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000920:[<0x100000008a3/article-44.xml v597>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.924 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.611+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009b2 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-6.jpg auth v657 ap=1 s=13960 n(v0 rc2024-09-19T07:13:17.776154+0000 b13960 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@24},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb13d0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009b2:[<0x100000008a3/picture-6.jpg v657>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000009b2:[<0x100000008a3/picture-6.jpg v657>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.924 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.611+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008c3 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-65.xml auth v619 ap=1 s=19977 n(v0 rc2024-09-19T07:13:17.041172+0000 b19977 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@45},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb13d0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008c3:[<0x100000008a3/article-65.xml v619>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000008c3:[<0x100000008a3/article-65.xml v619>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.924 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.611+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000963 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-24.xml auth v661 ap=1 s=20433 n(v0 rc2024-09-19T07:13:17.524161+0000 b20433 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@26},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb13d1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000963:[<0x100000008a3/article-24.xml v661>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000963:[<0x100000008a3/article-24.xml v661>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.924 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.611+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008cf [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-62.xml auth v599 ap=1 s=19313 n(v0 rc2024-09-19T07:13:17.081171+0000 b19313 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb13d1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008cf:[<0x100000008a3/article-62.xml v599>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000008cf:[<0x100000008a3/article-62.xml v599>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.925 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ee1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-7.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.925 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000edc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-9.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.925 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ef2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.925 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000eb4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-9.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.925 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ee3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-6.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.925 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000e8a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-24.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.925 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000012e0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-92.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.925 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ec9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-17.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.925 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ec2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-3.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.925 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000eb9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-7.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.926 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000eb6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-8.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.926 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000edf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-8.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.926 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000e7c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-30.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.926 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000eab (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-13.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.926 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ebb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-6.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.926 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ec5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-2.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.927 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.612+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001169 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-41.xml auth v1676 ap=1 s=6354 n(v0 rc2024-09-19T07:13:24.823984+0000 b6354 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@17},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb13dab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001169:[<0x100000008a3/comment-41.xml v841>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001169:[<0x100000008a3/comment-41.xml v1676>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.927 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.612+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008bb [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-67.xml auth v553 ap=1 s=31487 n(v0 rc2024-09-19T07:13:17.005173+0000 b31487 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@41},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb13db080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008bb:[<0x100000008a3/article-67.xml v553>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000008bb:[<0x100000008a3/article-67.xml v553>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.927 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.612+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009a6 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-17.jpg auth v589 ap=1 s=52251 n(v0 rc2024-09-19T07:13:17.736155+0000 b52251 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@28},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb13db600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009a6:[<0x100000008a3/picture-17.jpg v589>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000009a6:[<0x100000008a3/picture-17.jpg v589>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.927 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.612+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009a1 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-3.xml auth v613 ap=1 s=14974 n(v0 rc2024-09-19T07:13:17.715156+0000 b14974 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@23},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb13dbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009a1:[<0x100000008a3/article-3.xml v613>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000009a1:[<0x100000008a3/article-3.xml v613>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.927 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ee6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-5.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.927 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000e81 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-28.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.927 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000eeb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.928 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ed8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-11.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.928 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ebe (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-5.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.928 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000e7e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-29.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.928 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011a5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-27.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.928 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010ed (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-12.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.928 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000112a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-1.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.928 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000117e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-34.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.928 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011c4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-16.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.928 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010b3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-23.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.928 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010d4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-17.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.928 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000118a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-32.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.928 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000de2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-2.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.928 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000081c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-14.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.929 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000062f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-70.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.929 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.612+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000996 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-7.xml auth v563 ap=1 s=17284 n(v0 rc2024-09-19T07:13:17.667157+0000 b17284 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@24},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb13dc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000996:[<0x100000008a3/article-7.xml v563>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000996:[<0x100000008a3/article-7.xml v563>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.929 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.613+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008db [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-59.xml auth v551 ap=1 s=14972 n(v0 rc2024-09-19T07:13:17.124170+0000 b14972 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@5},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb1360680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008db:[<0x100000008a3/article-59.xml v551>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000008db:[<0x100000008a3/article-59.xml v551>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.929 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.613+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009aa [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-13.jpg auth v577 ap=1 s=16728 n(v0 rc2024-09-19T07:13:17.750155+0000 b16728 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@27},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb1360c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009aa:[<0x100000008a3/picture-13.jpg v577>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000009aa:[<0x100000008a3/picture-13.jpg v577>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.929 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.613+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000975 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-18.xml auth v621 ap=1 s=24460 n(v0 rc2024-09-19T07:13:17.569159+0000 b24460 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@28},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb1361180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000975:[<0x100000008a3/article-18.xml v621>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000975:[<0x100000008a3/article-18.xml v621>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.929 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.613+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000900 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-51.xml auth v633 ap=1 s=24496 n(v0 rc2024-09-19T07:13:17.244167+0000 b24496 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@44},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb139a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000900:[<0x100000008a3/article-51.xml v633>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000900:[<0x100000008a3/article-51.xml v633>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.930 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000dcf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-92.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.930 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000dbb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-9.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.930 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000e74 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-92.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.930 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000e91 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-21.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.930 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000e8f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-22.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.930 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000dd2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-3.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.930 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ea7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-14.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.930 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000dc1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-7.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.930 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000012e6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-71.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.930 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000dbe (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-8.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.930 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000eaf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-11.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.930 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ea0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-16.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.931 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000e85 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-26.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.931 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ece (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-15.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.931 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000dae (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-13.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.931 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000eb2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-10.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.931 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.613+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000095a [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-27.xml auth v675 ap=1 s=5969 n(v0 rc2024-09-19T07:13:17.502161+0000 b5969 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@38},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb139ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000095a:[<0x100000008a3/article-27.xml v675>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000095a:[<0x100000008a3/article-27.xml v675>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.931 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.613+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009b6 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-4.jpg auth v729 ap=1 s=44528 n(v0 rc2024-09-19T07:13:17.788154+0000 b44528 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@23},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb139b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009b6:[<0x100000008a3/picture-4.jpg v729>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000009b6:[<0x100000008a3/picture-4.jpg v729>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.931 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000dc4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-6.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.931 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ed5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-12.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.932 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000dd6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-2.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.932 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ec0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-4.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.932 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000e88 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-25.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.932 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000dd4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-56.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.932 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000e96 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-19.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.932 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ead (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-12.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.932 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ec7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-1.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.932 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ecc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-16.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.932 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000e9c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-17.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.932 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000e8d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-23.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:45.932 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:45.932 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ddf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-3.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.932 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000dc8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-5.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:45.947 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.614+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009b9 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-2.jpg auth v667 ap=1 s=44271 n(v0 rc2024-09-19T07:13:17.801154+0000 b44271 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@23},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb139b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009b9:[<0x100000008a3/picture-2.jpg v667>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000009b9:[<0x100000008a3/picture-2.jpg v667>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.947 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.614+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000096f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-20.xml auth v669 ap=1 s=27288 n(v0 rc2024-09-19T07:13:17.553160+0000 b27288 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@27},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb13c2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000096f:[<0x100000008a3/article-20.xml v669>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000096f:[<0x100000008a3/article-20.xml v669>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.948 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.614+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008b0 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-70.xml auth v591 ap=1 s=3386 n(v0 rc2024-09-19T07:13:16.960174+0000 b3386 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@39},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb13c2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008b0:[<0x100000008a3/article-70.xml v591>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000008b0:[<0x100000008a3/article-70.xml v591>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.948 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.614+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009a9 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-14.jpg auth v645 ap=1 s=53606 n(v0 rc2024-09-19T07:13:17.746155+0000 b53606 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@27},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb13c2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009a9:[<0x100000008a3/picture-14.jpg v645>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000009a9:[<0x100000008a3/picture-14.jpg v645>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.948 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.614+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000092c [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-41.xml auth v561 ap=1 s=28847 n(v0 rc2024-09-19T07:13:17.357165+0000 b28847 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@44},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb13c3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000092c:[<0x100000008a3/article-41.xml v561>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000092c:[<0x100000008a3/article-41.xml v561>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.948 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.614+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008d3 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-61.xml auth v649 ap=1 s=3738 n(v0 rc2024-09-19T07:13:17.094171+0000 b3738 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb13c3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008d3:[<0x100000008a3/article-61.xml v649>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000008d3:[<0x100000008a3/article-61.xml v649>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.948 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.614+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008b4 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-69.xml auth v709 ap=1 s=22237 n(v0 rc2024-09-19T07:13:16.975174+0000 b22237 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@49},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb13c4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008b4:[<0x100000008a3/article-69.xml v709>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000008b4:[<0x100000008a3/article-69.xml v709>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.948 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.614+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000091c [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-45.xml auth v689 ap=1 s=29325 n(v0 rc2024-09-19T07:13:17.300166+0000 b29325 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@30},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb13c3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000091c:[<0x100000008a3/article-45.xml v689>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000091c:[<0x100000008a3/article-45.xml v689>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.948 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.614+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009b1 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-7.jpg auth v727 ap=1 s=44812 n(v0 rc2024-09-19T07:13:17.771155+0000 b44812 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@24},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb13c4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009b1:[<0x100000008a3/picture-7.jpg v727>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000009b1:[<0x100000008a3/picture-7.jpg v727>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.948 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.615+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000094e [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-31.xml auth v581 ap=1 s=18973 n(v0 rc2024-09-19T07:13:17.471162+0000 b18973 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@28},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb13c4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000094e:[<0x100000008a3/article-31.xml v581>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000094e:[<0x100000008a3/article-31.xml v581>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.948 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.615+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009ae [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-9.jpg auth v617 ap=1 s=33249 n(v0 rc2024-09-19T07:13:17.764155+0000 b33249 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@25},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561fb13c5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009ae:[<0x100000008a3/picture-9.jpg v617>,<0x10000000399/blog-8 v29580>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000009ae:[<0x100000008a3/picture-9.jpg v617>,<0x10000000399/blog-8 v61408>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.948 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.653+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ef8 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-64.xml auth v993 ap=1 s=18330 n(v0 rc2024-09-19T07:13:23.108026+0000 b18330 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@49},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb133fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ef8:[<0x10000000ef7/article-64.xml v4>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ef8:[<0x10000000ef7/article-64.xml v993>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.949 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.655+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000101e [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-27.jpg auth v1003 ap=1 s=28608 n(v0 rc2024-09-19T07:13:23.995004+0000 b28608 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@42},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1340680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000101e:[<0x10000000ef7/picture-27.jpg v682>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000101e:[<0x10000000ef7/picture-27.jpg v1003>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.949 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.655+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f45 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-39.xml auth v991 ap=1 s=2966 n(v0 rc2024-09-19T07:13:23.352020+0000 b2966 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@47},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1340c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f45:[<0x10000000ef7/article-39.xml v154>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f45:[<0x10000000ef7/article-39.xml v991>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.949 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.655+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f4c [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-36.xml auth v981 ap=1 s=23481 n(v0 rc2024-09-19T07:13:23.371019+0000 b23481 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@46},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1341180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f4c:[<0x10000000ef7/article-36.xml v172>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f4c:[<0x10000000ef7/article-36.xml v981>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.949 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.656+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f97 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-12.xml auth v1011 ap=1 s=22585 n(v0 rc2024-09-19T07:13:23.585014+0000 b22585 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@37},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1341700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f97:[<0x10000000ef7/article-12.xml v316>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f97:[<0x10000000ef7/article-12.xml v1011>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.949 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.656+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000feb [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-52.jpg auth v989 ap=1 s=37676 n(v0 rc2024-09-19T07:13:23.818008+0000 b37676 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@48},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1350000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000feb:[<0x10000000ef7/picture-52.jpg v532>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000feb:[<0x10000000ef7/picture-52.jpg v989>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.949 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.657+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fba [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-1.xml auth v1001 ap=1 s=4704 n(v0 rc2024-09-19T07:13:23.665012+0000 b4704 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@17},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1350580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fba:[<0x10000000ef7/article-1.xml v382>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000fba:[<0x10000000ef7/article-1.xml v1001>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.949 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.657+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001010 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-34.jpg auth v979 ap=1 s=54034 n(v0 rc2024-09-19T07:13:23.941006+0000 b54034 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@46},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1350b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001010:[<0x10000000ef7/picture-34.jpg v640>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001010:[<0x10000000ef7/picture-34.jpg v979>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.949 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.658+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fe8 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-53.jpg auth v995 ap=1 s=60709 n(v0 rc2024-09-19T07:13:23.809009+0000 b60709 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@48},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1351080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fe8:[<0x10000000ef7/picture-53.jpg v526>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000fe8:[<0x10000000ef7/picture-53.jpg v995>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.949 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.658+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fcc [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-67.jpg auth v999 ap=1 s=64404 n(v0 rc2024-09-19T07:13:23.728011+0000 b64404 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1351600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fcc:[<0x10000000ef7/picture-67.jpg v442>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000fcc:[<0x10000000ef7/picture-67.jpg v999>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.949 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.659+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001038 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-16.jpg auth v1005 ap=1 s=28651 n(v0 rc2024-09-19T07:13:24.091002+0000 b28651 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@38},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1351b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001038:[<0x10000000ef7/picture-16.jpg v748>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001038:[<0x10000000ef7/picture-16.jpg v1005>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.949 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.659+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fc2 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-74.jpg auth v987 ap=1 s=34785 n(v0 rc2024-09-19T07:13:23.687012+0000 b34785 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1352100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fc2:[<0x10000000ef7/picture-74.jpg v400>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000fc2:[<0x10000000ef7/picture-74.jpg v987>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.950 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.659+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f6c [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-23.xml auth v977 ap=1 s=13201 n(v0 rc2024-09-19T07:13:23.485016+0000 b13201 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@42},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1352680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f6c:[<0x10000000ef7/article-23.xml v250>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f6c:[<0x10000000ef7/article-23.xml v977>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.950 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.660+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fbc [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-76.jpg auth v1013 ap=1 s=28218 n(v0 rc2024-09-19T07:13:23.672012+0000 b28218 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1353180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fbc:[<0x10000000ef7/picture-76.jpg v388>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000fbc:[<0x10000000ef7/picture-76.jpg v1013>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.950 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.660+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001014 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-32.jpg auth v997 ap=1 s=8755 n(v0 rc2024-09-19T07:13:23.954005+0000 b8755 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@43},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1353700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001014:[<0x10000000ef7/picture-32.jpg v652>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001014:[<0x10000000ef7/picture-32.jpg v997>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.950 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.660+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000efa [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-63.xml auth v983 ap=1 s=1712 n(v0 rc2024-09-19T07:13:23.113025+0000 b1712 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@49},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb135e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000efa:[<0x10000000ef7/article-63.xml v10>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000efa:[<0x10000000ef7/article-63.xml v983>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.950 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.660+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f83 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-17.xml auth v1009 ap=1 s=2084 n(v0 rc2024-09-19T07:13:23.551015+0000 b2084 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@40},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1352c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f83:[<0x10000000ef7/article-17.xml v286>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f83:[<0x10000000ef7/article-17.xml v1009>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.950 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.660+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ff4 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-48.jpg auth v985 ap=1 s=33872 n(v0 rc2024-09-19T07:13:23.852008+0000 b33872 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@48},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb135e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ff4:[<0x10000000ef7/picture-48.jpg v556>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ff4:[<0x10000000ef7/picture-48.jpg v985>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.950 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.660+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fc3 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-73.jpg auth v992 ap=1 s=35791 n(v0 rc2024-09-19T07:13:23.699011+0000 b35791 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1331080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fc3:[<0x10000000ef7/picture-73.jpg v406>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000fc3:[<0x10000000ef7/picture-73.jpg v992>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.950 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.661+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000102a [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-21.jpg auth v984 ap=1 s=9054 n(v0 rc2024-09-19T07:13:24.047003+0000 b9054 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@41},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1331600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000102a:[<0x10000000ef7/picture-21.jpg v718>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000102a:[<0x10000000ef7/picture-21.jpg v984>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.950 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.661+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fbf [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-75.jpg auth v986 ap=1 s=16967 n(v0 rc2024-09-19T07:13:23.682012+0000 b16967 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1332100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fbf:[<0x10000000ef7/picture-75.jpg v394>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000fbf:[<0x10000000ef7/picture-75.jpg v986>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.950 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.661+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f42 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-40.xml auth v988 ap=1 s=24118 n(v0 rc2024-09-19T07:13:23.345020+0000 b24118 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@48},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1332680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f42:[<0x10000000ef7/article-40.xml v148>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f42:[<0x10000000ef7/article-40.xml v988>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.951 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.661+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f8b [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-15.xml auth v976 ap=1 s=26570 n(v0 rc2024-09-19T07:13:23.563015+0000 b26570 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@38},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1333180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f8b:[<0x10000000ef7/article-15.xml v298>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f8b:[<0x10000000ef7/article-15.xml v976>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.951 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.661+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001018 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-30.jpg auth v998 ap=1 s=9517 n(v0 rc2024-09-19T07:13:23.967005+0000 b9517 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@43},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1332c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001018:[<0x10000000ef7/picture-30.jpg v664>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001018:[<0x10000000ef7/picture-30.jpg v998>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.951 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.662+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000100c [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-36.jpg auth v980 ap=1 s=60324 n(v0 rc2024-09-19T07:13:23.928006+0000 b60324 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@46},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1333700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000100c:[<0x10000000ef7/picture-36.jpg v628>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000100c:[<0x10000000ef7/picture-36.jpg v980>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.951 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.662+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ffe [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-43.jpg auth v994 ap=1 s=10973 n(v0 rc2024-09-19T07:13:23.883007+0000 b10973 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@48},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb133e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ffe:[<0x10000000ef7/picture-43.jpg v586>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ffe:[<0x10000000ef7/picture-43.jpg v994>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.951 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.662+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000102c [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-20.jpg auth v982 ap=1 s=30403 n(v0 rc2024-09-19T07:13:24.051003+0000 b30403 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@40},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb133eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000102c:[<0x10000000ef7/picture-20.jpg v724>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000102c:[<0x10000000ef7/picture-20.jpg v982>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.951 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.662+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f3b [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-42.xml auth v990 ap=1 s=25320 n(v0 rc2024-09-19T07:13:23.332020+0000 b25320 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@48},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb133f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f3b:[<0x10000000ef7/article-42.xml v136>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f3b:[<0x10000000ef7/article-42.xml v990>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.951 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.662+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f7b [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-19.xml auth v996 ap=1 s=25702 n(v0 rc2024-09-19T07:13:23.538015+0000 b25702 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@40},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb133e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f7b:[<0x10000000ef7/article-19.xml v274>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f7b:[<0x10000000ef7/article-19.xml v996>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.951 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.663+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001008 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-38.jpg auth v978 ap=1 s=16448 n(v0 rc2024-09-19T07:13:23.915006+0000 b16448 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@47},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb133f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001008:[<0x10000000ef7/picture-38.jpg v616>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001008:[<0x10000000ef7/picture-38.jpg v978>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.951 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.663+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001026 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-23.jpg auth v989 ap=1 s=45377 n(v0 rc2024-09-19T07:13:24.028003+0000 b45377 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@42},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb0c78000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001026:[<0x10000000ef7/picture-23.jpg v706>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001026:[<0x10000000ef7/picture-23.jpg v989>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.951 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.663+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f8f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-14.xml auth v965 ap=1 s=28695 n(v0 rc2024-09-19T07:13:23.570014+0000 b28695 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@37},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb0c78580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f8f:[<0x10000000ef7/article-14.xml v304>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f8f:[<0x10000000ef7/article-14.xml v965>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.951 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.663+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ffa [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-45.jpg auth v991 ap=1 s=34661 n(v0 rc2024-09-19T07:13:23.872007+0000 b34661 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@48},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb0c78b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ffa:[<0x10000000ef7/picture-45.jpg v574>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ffa:[<0x10000000ef7/picture-45.jpg v991>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.952 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.663+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001002 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-41.jpg auth v945 ap=1 s=10287 n(v0 rc2024-09-19T07:13:23.897007+0000 b10287 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@48},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb0c79080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001002:[<0x10000000ef7/picture-41.jpg v598>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001002:[<0x10000000ef7/picture-41.jpg v945>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.952 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.664+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f2f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-46.xml auth v943 ap=1 s=1281 n(v0 rc2024-09-19T07:13:23.302021+0000 b1281 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@48},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb0c79b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f2f:[<0x10000000ef7/article-46.xml v112>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f2f:[<0x10000000ef7/article-46.xml v943>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.952 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.665+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fd7 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-60.jpg auth v949 ap=1 s=29214 n(v0 rc2024-09-19T07:13:23.761010+0000 b29214 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@49},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb0c79600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fd7:[<0x10000000ef7/picture-60.jpg v484>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000fd7:[<0x10000000ef7/picture-60.jpg v949>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.952 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.665+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fcd [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-66.jpg auth v947 ap=1 s=33828 n(v0 rc2024-09-19T07:13:23.730011+0000 b33828 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb0c7a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fcd:[<0x10000000ef7/picture-66.jpg v448>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000fcd:[<0x10000000ef7/picture-66.jpg v947>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.952 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.665+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f2d [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-47.xml auth v975 ap=1 s=21700 n(v0 rc2024-09-19T07:13:23.296021+0000 b21700 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@48},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb0c7a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f2d:[<0x10000000ef7/article-47.xml v106>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f2d:[<0x10000000ef7/article-47.xml v975>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.952 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.666+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001028 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-22.jpg auth v971 ap=1 s=16193 n(v0 rc2024-09-19T07:13:24.039003+0000 b16193 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@41},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb0c7ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001028:[<0x10000000ef7/picture-22.jpg v712>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001028:[<0x10000000ef7/picture-22.jpg v971>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.952 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.666+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f9c [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-11.xml auth v983 ap=1 s=29237 n(v0 rc2024-09-19T07:13:23.591014+0000 b29237 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@37},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb0c7b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f9c:[<0x10000000ef7/article-11.xml v322>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f9c:[<0x10000000ef7/article-11.xml v983>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.952 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.666+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f19 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-54.xml auth v951 ap=1 s=15672 n(v0 rc2024-09-19T07:13:23.231023+0000 b15672 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@49},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb0c82000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f19:[<0x10000000ef7/article-54.xml v64>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f19:[<0x10000000ef7/article-54.xml v951>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.952 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.666+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f87 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-16.xml auth v985 ap=1 s=8760 n(v0 rc2024-09-19T07:13:23.557015+0000 b8760 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@39},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb0c7b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f87:[<0x10000000ef7/article-16.xml v292>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f87:[<0x10000000ef7/article-16.xml v985>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.952 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.667+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f64 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-26.xml auth v969 ap=1 s=19831 n(v0 rc2024-09-19T07:13:23.454017+0000 b19831 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@42},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb0c82580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f64:[<0x10000000ef7/article-26.xml v232>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f64:[<0x10000000ef7/article-26.xml v969>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.952 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.667+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000103c [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-15.jpg auth v979 ap=1 s=16917 n(v0 rc2024-09-19T07:13:24.109001+0000 b16917 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@37},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb0c82b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000103c:[<0x10000000ef7/picture-15.jpg v754>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000103c:[<0x10000000ef7/picture-15.jpg v979>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.953 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.667+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fdf [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-56.jpg auth v981 ap=1 s=18641 n(v0 rc2024-09-19T07:13:23.783009+0000 b18641 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@48},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb0c83080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fdf:[<0x10000000ef7/picture-56.jpg v508>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000fdf:[<0x10000000ef7/picture-56.jpg v981>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.953 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.667+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ff6 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-47.jpg auth v955 ap=1 s=51246 n(v0 rc2024-09-19T07:13:23.859007+0000 b51246 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@48},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb0c83600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ff6:[<0x10000000ef7/picture-47.jpg v562>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ff6:[<0x10000000ef7/picture-47.jpg v955>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.953 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.667+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fa0 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-10.xml auth v973 ap=1 s=18336 n(v0 rc2024-09-19T07:13:23.598014+0000 b18336 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@37},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb0c83b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fa0:[<0x10000000ef7/article-10.xml v328>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000fa0:[<0x10000000ef7/article-10.xml v973>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.953 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.667+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000104a [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-12.jpg auth v961 ap=1 s=47800 n(v0 rc2024-09-19T07:13:24.148001+0000 b47800 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@37},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb0c84100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000104a:[<0x10000000ef7/picture-12.jpg v772>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000104a:[<0x10000000ef7/picture-12.jpg v961>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.953 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.668+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ffc [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-44.jpg auth v957 ap=1 s=14410 n(v0 rc2024-09-19T07:13:23.877007+0000 b14410 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@48},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb0c84680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ffc:[<0x10000000ef7/picture-44.jpg v580>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ffc:[<0x10000000ef7/picture-44.jpg v957>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.953 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.668+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fb4 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-4.xml auth v977 ap=1 s=8274 n(v0 rc2024-09-19T07:13:23.649013+0000 b8274 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@37},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb0c85180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fb4:[<0x10000000ef7/article-4.xml v364>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000fb4:[<0x10000000ef7/article-4.xml v977>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.953 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.668+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f67 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-25.xml auth v963 ap=1 s=1483 n(v0 rc2024-09-19T07:13:23.463017+0000 b1483 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@42},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb0c85700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f67:[<0x10000000ef7/article-25.xml v238>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f67:[<0x10000000ef7/article-25.xml v963>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.953 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.668+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fd9 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-59.jpg auth v987 ap=1 s=42631 n(v0 rc2024-09-19T07:13:23.766010+0000 b42631 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@49},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1330580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fd9:[<0x10000000ef7/picture-59.jpg v490>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000fd9:[<0x10000000ef7/picture-59.jpg v987>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.953 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.668+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fc5 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-72.jpg auth v967 ap=1 s=32792 n(v0 rc2024-09-19T07:13:23.706011+0000 b32792 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1330000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fc5:[<0x10000000ef7/picture-72.jpg v412>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000fc5:[<0x10000000ef7/picture-72.jpg v967>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.953 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.669+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f48 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-38.xml auth v953 ap=1 s=22846 n(v0 rc2024-09-19T07:13:23.358020+0000 b22846 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@47},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1330b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f48:[<0x10000000ef7/article-38.xml v160>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f48:[<0x10000000ef7/article-38.xml v953>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.954 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.669+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000107a [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-3.jpg auth v981 ap=1 s=55160 n(v0 rc2024-09-19T07:13:24.277997+0000 b55160 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@36},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb121f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000107a:[<0x10000000ef7/picture-3.jpg v826>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000107a:[<0x10000000ef7/picture-3.jpg v981>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.954 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.669+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fe2 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-55.jpg auth v979 ap=1 s=17581 n(v0 rc2024-09-19T07:13:23.791009+0000 b17581 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@49},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb121f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fe2:[<0x10000000ef7/picture-55.jpg v514>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000fe2:[<0x10000000ef7/picture-55.jpg v979>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.954 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.669+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000104f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-11.jpg auth v971 ap=1 s=10040 n(v0 rc2024-09-19T07:13:24.163000+0000 b10040 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@37},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb0f7e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000104f:[<0x10000000ef7/picture-11.jpg v778>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000104f:[<0x10000000ef7/picture-11.jpg v971>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.954 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.670+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fc9 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-70.jpg auth v987 ap=1 s=21156 n(v0 rc2024-09-19T07:13:23.719011+0000 b21156 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb0f7e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fc9:[<0x10000000ef7/picture-70.jpg v424>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000fc9:[<0x10000000ef7/picture-70.jpg v987>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.954 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.670+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fb3 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-5.xml auth v967 ap=1 s=20146 n(v0 rc2024-09-19T07:13:23.643013+0000 b20146 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@37},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb0f7eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fb3:[<0x10000000ef7/article-5.xml v358>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000fb3:[<0x10000000ef7/article-5.xml v967>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.954 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.670+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f51 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-34.xml auth v977 ap=1 s=10110 n(v0 rc2024-09-19T07:13:23.387019+0000 b10110 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@46},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb0f7f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f51:[<0x10000000ef7/article-34.xml v184>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f51:[<0x10000000ef7/article-34.xml v977>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.954 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.670+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fc7 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-71.jpg auth v985 ap=1 s=13131 n(v0 rc2024-09-19T07:13:23.713011+0000 b13131 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb0f7f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fc7:[<0x10000000ef7/picture-71.jpg v418>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000fc7:[<0x10000000ef7/picture-71.jpg v985>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.954 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.671+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f5d [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-29.xml auth v975 ap=1 s=16272 n(v0 rc2024-09-19T07:13:23.426018+0000 b16272 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@43},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb0f7fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f5d:[<0x10000000ef7/article-29.xml v214>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f5d:[<0x10000000ef7/article-29.xml v975>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.954 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.671+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f03 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-60.xml auth v973 ap=1 s=17577 n(v0 rc2024-09-19T07:13:23.154024+0000 b17577 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@49},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb0f80100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f03:[<0x10000000ef7/article-60.xml v28>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f03:[<0x10000000ef7/article-60.xml v973>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.954 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.671+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fd1 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-63.jpg auth v983 ap=1 s=46709 n(v0 rc2024-09-19T07:13:23.741010+0000 b46709 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@49},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb0f80680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fd1:[<0x10000000ef7/picture-63.jpg v466>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000fd1:[<0x10000000ef7/picture-63.jpg v983>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.954 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.671+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001004 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-40.jpg auth v969 ap=1 s=21765 n(v0 rc2024-09-19T07:13:23.903006+0000 b21765 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@48},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb0f80c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001004:[<0x10000000ef7/picture-40.jpg v604>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001004:[<0x10000000ef7/picture-40.jpg v969>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.955 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.671+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f6f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-22.xml auth v965 ap=1 s=13901 n(v0 rc2024-09-19T07:13:23.499016+0000 b13901 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@41},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb0f81180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f6f:[<0x10000000ef7/article-22.xml v256>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f6f:[<0x10000000ef7/article-22.xml v965>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.955 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.672+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f27 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-49.xml auth v963 ap=1 s=12181 n(v0 rc2024-09-19T07:13:23.273022+0000 b12181 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@48},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb0f81700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f27:[<0x10000000ef7/article-49.xml v94>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f27:[<0x10000000ef7/article-49.xml v963>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.955 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.672+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f37 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-43.xml auth v976 ap=1 s=10391 n(v0 rc2024-09-19T07:13:23.322020+0000 b10391 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@48},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1109b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f37:[<0x10000000ef7/article-43.xml v130>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f37:[<0x10000000ef7/article-43.xml v976>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.955 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.672+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f53 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-33.xml auth v994 ap=1 s=27421 n(v0 rc2024-09-19T07:13:23.392019+0000 b27421 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@46},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb110a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f53:[<0x10000000ef7/article-33.xml v190>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f53:[<0x10000000ef7/article-33.xml v994>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.955 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.672+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000106e [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-5.jpg auth v996 ap=1 s=16860 n(v0 rc2024-09-19T07:13:24.257998+0000 b16860 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@37},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb110a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000106e:[<0x10000000ef7/picture-5.jpg v814>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000106e:[<0x10000000ef7/picture-5.jpg v996>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.955 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.673+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ff0 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-50.jpg auth v978 ap=1 s=47469 n(v0 rc2024-09-19T07:13:23.839008+0000 b47469 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@48},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb110ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ff0:[<0x10000000ef7/picture-50.jpg v544>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ff0:[<0x10000000ef7/picture-50.jpg v978>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.955 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.673+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fdb [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-58.jpg auth v986 ap=1 s=16347 n(v0 rc2024-09-19T07:13:23.772010+0000 b16347 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@49},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb110b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fdb:[<0x10000000ef7/picture-58.jpg v496>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000fdb:[<0x10000000ef7/picture-58.jpg v986>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.955 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.673+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f0f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-57.xml auth v972 ap=1 s=16379 n(v0 rc2024-09-19T07:13:23.196023+0000 b16379 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@49},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb110b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f0f:[<0x10000000ef7/article-57.xml v46>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f0f:[<0x10000000ef7/article-57.xml v972>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.955 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.674+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fce [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-65.jpg auth v980 ap=1 s=39452 n(v0 rc2024-09-19T07:13:23.733011+0000 b39452 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@49},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb121c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fce:[<0x10000000ef7/picture-65.jpg v454>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000fce:[<0x10000000ef7/picture-65.jpg v980>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.955 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.674+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f0b [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-58.xml auth v988 ap=1 s=27854 n(v0 rc2024-09-19T07:13:23.183024+0000 b27854 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@49},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb121c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f0b:[<0x10000000ef7/article-58.xml v40>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f0b:[<0x10000000ef7/article-58.xml v988>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.955 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.674+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f1c [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-53.xml auth v998 ap=1 s=6557 n(v0 rc2024-09-19T07:13:23.239022+0000 b6557 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@48},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb121cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f1c:[<0x10000000ef7/article-53.xml v70>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f1c:[<0x10000000ef7/article-53.xml v998>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.955 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.675+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f60 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-28.xml auth v990 ap=1 s=2447 n(v0 rc2024-09-19T07:13:23.435018+0000 b2447 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@42},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb121d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f60:[<0x10000000ef7/article-28.xml v220>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f60:[<0x10000000ef7/article-28.xml v990>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.956 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.675+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f1f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-52.xml auth v992 ap=1 s=13881 n(v0 rc2024-09-19T07:13:23.244022+0000 b13881 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@48},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb121d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f1f:[<0x10000000ef7/article-52.xml v76>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f1f:[<0x10000000ef7/article-52.xml v992>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.956 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.675+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fca [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-69.jpg auth v984 ap=1 s=42398 n(v0 rc2024-09-19T07:13:23.723011+0000 b42398 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb121db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fca:[<0x10000000ef7/picture-69.jpg v430>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000fca:[<0x10000000ef7/picture-69.jpg v984>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.956 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.675+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fee [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-51.jpg auth v982 ap=1 s=47123 n(v0 rc2024-09-19T07:13:23.833008+0000 b47123 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@48},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb121e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fee:[<0x10000000ef7/picture-51.jpg v538>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000fee:[<0x10000000ef7/picture-51.jpg v982>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.956 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.675+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fd3 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-62.jpg auth v1000 ap=1 s=24691 n(v0 rc2024-09-19T07:13:23.747010+0000 b24691 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@49},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb121e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fd3:[<0x10000000ef7/picture-62.jpg v472>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000fd3:[<0x10000000ef7/picture-62.jpg v1000>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.956 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.676+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ff8 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-46.jpg auth v974 ap=1 s=21578 n(v0 rc2024-09-19T07:13:23.865007+0000 b21578 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@48},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb121ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ff8:[<0x10000000ef7/picture-46.jpg v568>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ff8:[<0x10000000ef7/picture-46.jpg v974>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.956 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.676+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fa8 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-8.xml auth v970 ap=1 s=12786 n(v0 rc2024-09-19T07:13:23.612013+0000 b12786 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@37},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1236580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fa8:[<0x10000000ef7/article-8.xml v340>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000fa8:[<0x10000000ef7/article-8.xml v970>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.956 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.677+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001022 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-25.jpg auth v986 ap=1 s=20601 n(v0 rc2024-09-19T07:13:24.013004+0000 b20601 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@42},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1236000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001022:[<0x10000000ef7/picture-25.jpg v694>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001022:[<0x10000000ef7/picture-25.jpg v986>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.956 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.677+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001016 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-31.jpg auth v976 ap=1 s=15173 n(v0 rc2024-09-19T07:13:23.961005+0000 b15173 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@43},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1236b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001016:[<0x10000000ef7/picture-31.jpg v658>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001016:[<0x10000000ef7/picture-31.jpg v976>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.956 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.677+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ff2 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-49.jpg auth v974 ap=1 s=43878 n(v0 rc2024-09-19T07:13:23.847008+0000 b43878 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@48},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1237080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ff2:[<0x10000000ef7/picture-49.jpg v550>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ff2:[<0x10000000ef7/picture-49.jpg v974>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.956 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.678+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000105f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-8.jpg auth v984 ap=1 s=31768 n(v0 rc2024-09-19T07:13:24.209999+0000 b31768 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@37},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1237600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000105f:[<0x10000000ef7/picture-8.jpg v796>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000105f:[<0x10000000ef7/picture-8.jpg v984>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.956 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.678+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001020 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-26.jpg auth v972 ap=1 s=15220 n(v0 rc2024-09-19T07:13:24.002004+0000 b15220 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@42},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1237b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001020:[<0x10000000ef7/picture-26.jpg v688>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001020:[<0x10000000ef7/picture-26.jpg v972>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.957 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.678+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f56 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-32.xml auth v980 ap=1 s=23297 n(v0 rc2024-09-19T07:13:23.399019+0000 b23297 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@44},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1238100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f56:[<0x10000000ef7/article-32.xml v196>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f56:[<0x10000000ef7/article-32.xml v980>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.957 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.678+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f72 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-21.xml auth v990 ap=1 s=18826 n(v0 rc2024-09-19T07:13:23.510016+0000 b18826 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@41},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1238680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f72:[<0x10000000ef7/article-21.xml v262>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f72:[<0x10000000ef7/article-21.xml v990>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.957 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.678+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f5b [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-30.xml auth v1000 ap=1 s=11909 n(v0 rc2024-09-19T07:13:23.416018+0000 b11909 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@43},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1238c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f5b:[<0x10000000ef7/article-30.xml v208>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f5b:[<0x10000000ef7/article-30.xml v1000>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.957 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.679+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f93 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-13.xml auth v968 ap=1 s=15466 n(v0 rc2024-09-19T07:13:23.578014+0000 b15466 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@37},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1239180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f93:[<0x10000000ef7/article-13.xml v310>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f93:[<0x10000000ef7/article-13.xml v968>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.957 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.679+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f25 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-50.xml auth v998 ap=1 s=7810 n(v0 rc2024-09-19T07:13:23.261022+0000 b7810 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@48},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1239700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f25:[<0x10000000ef7/article-50.xml v88>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f25:[<0x10000000ef7/article-50.xml v998>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.957 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.679+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fb8 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-2.xml auth v988 ap=1 s=7868 n(v0 rc2024-09-19T07:13:23.660012+0000 b7868 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@36},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1108580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fb8:[<0x10000000ef7/article-2.xml v376>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000fb8:[<0x10000000ef7/article-2.xml v988>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.958 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.679+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fe5 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-54.jpg auth v994 ap=1 s=59737 n(v0 rc2024-09-19T07:13:23.799009+0000 b59737 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@48},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1108b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fe5:[<0x10000000ef7/picture-54.jpg v520>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000fe5:[<0x10000000ef7/picture-54.jpg v994>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.958 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.680+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000101a [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-29.jpg auth v982 ap=1 s=55991 n(v0 rc2024-09-19T07:13:23.975005+0000 b55991 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@42},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1109080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000101a:[<0x10000000ef7/picture-29.jpg v670>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000101a:[<0x10000000ef7/picture-29.jpg v982>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.958 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.680+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001054 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-10.jpg auth v972 ap=1 s=59073 n(v0 rc2024-09-19T07:13:24.178000+0000 b59073 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@37},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb12cb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001054:[<0x10000000ef7/picture-10.jpg v784>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001054:[<0x10000000ef7/picture-10.jpg v972>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.958 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.680+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001086 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-1.jpg auth{0=1} v860 ap=1 s=64279 n(v0 rc2024-09-19T07:13:24.298997+0000 b64279 1=1+0) caps={24793=pAsLsXsFscr/pFscr@29} mcw={0=Fscr} | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x561fb12cb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001086:[<0x10000000ef7/picture-1.jpg v838>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001086:[<0x10000000ef7/picture-1.jpg v860>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.958 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.680+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fd0 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-64.jpg auth v990 ap=1 s=45830 n(v0 rc2024-09-19T07:13:23.739010+0000 b45830 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@49},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb12cab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fd0:[<0x10000000ef7/picture-64.jpg v460>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000fd0:[<0x10000000ef7/picture-64.jpg v990>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.958 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.681+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fa4 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-9.xml auth v976 ap=1 s=15477 n(v0 rc2024-09-19T07:13:23.605014+0000 b15477 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@37},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb12cbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fa4:[<0x10000000ef7/article-9.xml v334>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000fa4:[<0x10000000ef7/article-9.xml v976>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.958 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.681+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fb0 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-6.xml auth v992 ap=1 s=20686 n(v0 rc2024-09-19T07:13:23.629013+0000 b20686 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@37},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1108000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fb0:[<0x10000000ef7/article-6.xml v352>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000fb0:[<0x10000000ef7/article-6.xml v992>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.958 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.681+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f34 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-44.xml auth v984 ap=1 s=21192 n(v0 rc2024-09-19T07:13:23.315021+0000 b21192 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@48},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb12cc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f34:[<0x10000000ef7/article-44.xml v124>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f34:[<0x10000000ef7/article-44.xml v984>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.959 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.681+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000efe [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-62.xml auth v986 ap=1 s=11922 n(v0 rc2024-09-19T07:13:23.126025+0000 b11922 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@49},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb12ccc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000efe:[<0x10000000ef7/article-62.xml v16>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000efe:[<0x10000000ef7/article-62.xml v986>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.959 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.681+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001069 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-6.jpg auth v994 ap=1 s=32210 n(v0 rc2024-09-19T07:13:24.240998+0000 b32210 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@37},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb12cc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001069:[<0x10000000ef7/picture-6.jpg v808>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001069:[<0x10000000ef7/picture-6.jpg v994>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.959 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.682+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f69 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-24.xml auth v970 ap=1 s=6175 n(v0 rc2024-09-19T07:13:23.474017+0000 b6175 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@42},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb12cd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f69:[<0x10000000ef7/article-24.xml v244>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f69:[<0x10000000ef7/article-24.xml v970>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.959 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.682+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000100a [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-37.jpg auth v1002 ap=1 s=44544 n(v0 rc2024-09-19T07:13:23.922006+0000 b44544 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@46},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1286000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000100a:[<0x10000000ef7/picture-37.jpg v622>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000100a:[<0x10000000ef7/picture-37.jpg v1002>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.959 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.682+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001033 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-17.jpg auth v1004 ap=1 s=65315 n(v0 rc2024-09-19T07:13:24.074002+0000 b65315 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@39},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1286580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001033:[<0x10000000ef7/picture-17.jpg v742>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001033:[<0x10000000ef7/picture-17.jpg v1004>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.959 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.682+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000101c [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-28.jpg auth v992 ap=1 s=50580 n(v0 rc2024-09-19T07:13:23.984004+0000 b50580 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@42},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb12cd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000101c:[<0x10000000ef7/picture-28.jpg v676>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000101c:[<0x10000000ef7/picture-28.jpg v992>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.959 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.682+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fb6 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-3.xml auth v998 ap=1 s=4026 n(v0 rc2024-09-19T07:13:23.654012+0000 b4026 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@36},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1286b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fb6:[<0x10000000ef7/article-3.xml v370>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000fb6:[<0x10000000ef7/article-3.xml v998>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.959 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.683+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001012 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-33.jpg auth v982 ap=1 s=23045 n(v0 rc2024-09-19T07:13:23.947005+0000 b23045 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@44},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1287600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001012:[<0x10000000ef7/picture-33.jpg v646>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001012:[<0x10000000ef7/picture-33.jpg v982>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.959 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.683+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001024 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-24.jpg auth v974 ap=1 s=12815 n(v0 rc2024-09-19T07:13:24.021004+0000 b12815 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@42},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1287080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001024:[<0x10000000ef7/picture-24.jpg v700>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001024:[<0x10000000ef7/picture-24.jpg v974>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.960 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.683+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fde [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-57.jpg auth v980 ap=1 s=17909 n(v0 rc2024-09-19T07:13:23.777009+0000 b17909 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@49},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1287b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fde:[<0x10000000ef7/picture-57.jpg v502>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000fde:[<0x10000000ef7/picture-57.jpg v980>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.960 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.683+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fab [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-7.xml auth v1000 ap=1 s=24702 n(v0 rc2024-09-19T07:13:23.620013+0000 b24702 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@37},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1288100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fab:[<0x10000000ef7/article-7.xml v346>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000fab:[<0x10000000ef7/article-7.xml v1000>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.960 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.683+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001000 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-42.jpg auth v988 ap=1 s=30175 n(v0 rc2024-09-19T07:13:23.890007+0000 b30175 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@48},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1288680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001000:[<0x10000000ef7/picture-42.jpg v592>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001000:[<0x10000000ef7/picture-42.jpg v988>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.960 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.683+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fcb [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-68.jpg auth v978 ap=1 s=61108 n(v0 rc2024-09-19T07:13:23.726011+0000 b61108 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1288c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fcb:[<0x10000000ef7/picture-68.jpg v436>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000fcb:[<0x10000000ef7/picture-68.jpg v978>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.960 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.683+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001006 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-39.jpg auth v996 ap=1 s=32968 n(v0 rc2024-09-19T07:13:23.909006+0000 b32968 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@47},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1289180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001006:[<0x10000000ef7/picture-39.jpg v610>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001006:[<0x10000000ef7/picture-39.jpg v996>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.960 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.684+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f07 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-59.xml auth v999 ap=1 s=30858 n(v0 rc2024-09-19T07:13:23.171024+0000 b30858 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@49},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1297b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f07:[<0x10000000ef7/article-59.xml v34>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f07:[<0x10000000ef7/article-59.xml v999>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.960 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.684+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001045 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-13.jpg auth v973 ap=1 s=52904 n(v0 rc2024-09-19T07:13:24.133001+0000 b52904 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@37},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1298100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001045:[<0x10000000ef7/picture-13.jpg v766>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001045:[<0x10000000ef7/picture-13.jpg v973>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.960 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.684+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f7f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-18.xml auth v995 ap=1 s=3798 n(v0 rc2024-09-19T07:13:23.544015+0000 b3798 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@40},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1298c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f7f:[<0x10000000ef7/article-18.xml v280>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f7f:[<0x10000000ef7/article-18.xml v995>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.960 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.684+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001030 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-18.jpg auth v1007 ap=1 s=29051 n(v0 rc2024-09-19T07:13:24.062003+0000 b29051 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@40},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1298680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001030:[<0x10000000ef7/picture-18.jpg v736>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001030:[<0x10000000ef7/picture-18.jpg v1007>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.961 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.685+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000102e [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-19.jpg auth v987 ap=1 s=52237 n(v0 rc2024-09-19T07:13:24.056003+0000 b52237 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@40},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1299180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000102e:[<0x10000000ef7/picture-19.jpg v730>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000102e:[<0x10000000ef7/picture-19.jpg v987>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.961 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.685+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f21 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-51.xml auth v975 ap=1 s=29205 n(v0 rc2024-09-19T07:13:23.252022+0000 b29205 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@48},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1299700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f21:[<0x10000000ef7/article-51.xml v82>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f21:[<0x10000000ef7/article-51.xml v975>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.961 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.685+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f62 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-27.xml auth v985 ap=1 s=17889 n(v0 rc2024-09-19T07:13:23.445017+0000 b17889 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@42},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb12b2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f62:[<0x10000000ef7/article-27.xml v226>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f62:[<0x10000000ef7/article-27.xml v985>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.961 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.685+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000100e [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-35.jpg auth v977 ap=1 s=37733 n(v0 rc2024-09-19T07:13:23.935006+0000 b37733 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@46},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb12b2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000100e:[<0x10000000ef7/picture-35.jpg v634>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000100e:[<0x10000000ef7/picture-35.jpg v977>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.961 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.685+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001080 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-2.jpg auth v1003 ap=1 s=16867 n(v0 rc2024-09-19T07:13:24.287997+0000 b16867 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@18},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb12b3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001080:[<0x10000000ef7/picture-2.jpg v832>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001080:[<0x10000000ef7/picture-2.jpg v1003>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.961 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.685+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f77 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-20.xml auth v983 ap=1 s=27909 n(v0 rc2024-09-19T07:13:23.528015+0000 b27909 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@41},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb12b3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f77:[<0x10000000ef7/article-20.xml v268>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f77:[<0x10000000ef7/article-20.xml v983>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.961 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.686+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001040 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-14.jpg auth v989 ap=1 s=54287 n(v0 rc2024-09-19T07:13:24.118001+0000 b54287 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@37},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb12b3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001040:[<0x10000000ef7/picture-14.jpg v760>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001040:[<0x10000000ef7/picture-14.jpg v989>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.961 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.686+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f3f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-41.xml auth v993 ap=1 s=5387 n(v0 rc2024-09-19T07:13:23.339020+0000 b5387 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@48},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb12b4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f3f:[<0x10000000ef7/article-41.xml v142>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f3f:[<0x10000000ef7/article-41.xml v993>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.961 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.686+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f31 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-45.xml auth v1001 ap=1 s=28670 n(v0 rc2024-09-19T07:13:23.309021+0000 b28670 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@48},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb12b4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f31:[<0x10000000ef7/article-45.xml v118>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f31:[<0x10000000ef7/article-45.xml v1001>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.961 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.686+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fd5 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-61.jpg auth v997 ap=1 s=30445 n(v0 rc2024-09-19T07:13:23.756010+0000 b30445 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@49},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb12b5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fd5:[<0x10000000ef7/picture-61.jpg v478>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000fd5:[<0x10000000ef7/picture-61.jpg v997>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.962 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.686+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001064 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-7.jpg auth v979 ap=1 s=14914 n(v0 rc2024-09-19T07:13:24.223999+0000 b14914 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@37},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb12b5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001064:[<0x10000000ef7/picture-7.jpg v802>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001064:[<0x10000000ef7/picture-7.jpg v979>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.962 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.686+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f58 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-31.xml auth v1009 ap=1 s=8937 n(v0 rc2024-09-19T07:13:23.407018+0000 b8937 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@43},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb12ca000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f58:[<0x10000000ef7/article-31.xml v202>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000f58:[<0x10000000ef7/article-31.xml v1009>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.962 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.686+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000105a [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-9.jpg auth v981 ap=1 s=16675 n(v0 rc2024-09-19T07:13:24.194999+0000 b16675 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@37},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb12ca580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000105a:[<0x10000000ef7/picture-9.jpg v790>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000105a:[<0x10000000ef7/picture-9.jpg v981>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.962 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.711+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001074 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-4.jpg auth v1005 ap=1 s=26517 n(v0 rc2024-09-19T07:13:24.267998+0000 b26517 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@36},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb12b2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001074:[<0x10000000ef7/picture-4.jpg v820>,<0x10000000399/blog-20 v24674>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001074:[<0x10000000ef7/picture-4.jpg v1005>,<0x10000000399/blog-20 v61418>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.962 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.729+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010ee [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-37.xml auth v893 ap=1 s=23644 n(v0 rc2024-09-19T07:13:24.479993+0000 b23644 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@7},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb1709600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010ee:[<0x10000001093/article-37.xml v100>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010ee:[<0x10000001093/article-37.xml v893>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.962 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.729+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010e3 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-39.xml auth v815 ap=1 s=18962 n(v0 rc2024-09-19T07:13:24.462993+0000 b18962 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@8},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb1709b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010e3:[<0x10000001093/article-39.xml v88>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010e3:[<0x10000001093/article-39.xml v815>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.962 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.729+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010f2 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-36.xml auth v881 ap=1 s=15033 n(v0 rc2024-09-19T07:13:24.490992+0000 b15033 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@8},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb170a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010f2:[<0x10000001093/article-36.xml v106>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010f2:[<0x10000001093/article-36.xml v881>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.962 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.729+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001162 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-12.xml auth v841 ap=1 s=17556 n(v0 rc2024-09-19T07:13:24.787985+0000 b17556 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@7},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb170a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001162:[<0x10000001093/article-12.xml v250>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001162:[<0x10000001093/article-12.xml v841>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.962 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.729+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001185 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-1.xml auth v773 ap=1 s=6829 n(v0 rc2024-09-19T07:13:24.910982+0000 b6829 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb170ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001185:[<0x10000001093/article-1.xml v316>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001185:[<0x10000001093/article-1.xml v773>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.963 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.730+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001193 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-16.jpg auth v883 ap=1 s=64452 n(v0 rc2024-09-19T07:13:24.960981+0000 b64452 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@7},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb170b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001193:[<0x10000001093/picture-16.jpg v364>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001193:[<0x10000001093/picture-16.jpg v883>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.963 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.731+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001132 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-23.xml auth v819 ap=1 s=7813 n(v0 rc2024-09-19T07:13:24.620989+0000 b7813 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@7},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb170b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001132:[<0x10000001093/article-23.xml v184>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001132:[<0x10000001093/article-23.xml v819>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.963 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.731+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000114d [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-17.xml auth v743 ap=1 s=1984 n(v0 rc2024-09-19T07:13:24.696987+0000 b1984 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@7},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb1716000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000114d:[<0x10000001093/article-17.xml v220>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000114d:[<0x10000001093/article-17.xml v743>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.963 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.731+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000118b [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-21.jpg auth v781 ap=1 s=32783 n(v0 rc2024-09-19T07:13:24.936982+0000 b32783 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@7},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16fcc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000118b:[<0x10000001093/picture-21.jpg v334>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000118b:[<0x10000001093/picture-21.jpg v781>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.963 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.731+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010f8 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-35.xml auth v853 ap=1 s=23225 n(v0 rc2024-09-19T07:13:24.497992+0000 b23225 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@8},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16fd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010f8:[<0x10000001093/article-35.xml v112>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010f8:[<0x10000001093/article-35.xml v853>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.963 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.732+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010df [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-40.xml auth v825 ap=1 s=1713 n(v0 rc2024-09-19T07:13:24.452993+0000 b1713 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@8},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16fd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010df:[<0x10000001093/article-40.xml v82>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010df:[<0x10000001093/article-40.xml v825>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.963 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.732+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001157 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-15.xml auth v859 ap=1 s=17819 n(v0 rc2024-09-19T07:13:24.737986+0000 b17819 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@7},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb1708000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001157:[<0x10000001093/article-15.xml v232>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001157:[<0x10000001093/article-15.xml v859>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.963 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.732+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001144 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-19.xml auth v747 ap=1 s=28316 n(v0 rc2024-09-19T07:13:24.668988+0000 b28316 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@7},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb1708580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001144:[<0x10000001093/article-19.xml v208>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001144:[<0x10000001093/article-19.xml v747>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.963 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.733+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010d5 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-42.xml auth v813 ap=1 s=12424 n(v0 rc2024-09-19T07:13:24.435994+0000 b12424 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@13},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb1709080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010d5:[<0x10000001093/article-42.xml v70>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010d5:[<0x10000001093/article-42.xml v813>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.964 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.733+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001187 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-23.jpg auth v779 ap=1 s=30501 n(v0 rc2024-09-19T07:13:24.915982+0000 b30501 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@7},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16ed600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001187:[<0x10000001093/picture-23.jpg v322>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001187:[<0x10000001093/picture-23.jpg v779>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.964 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.733+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000115b [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-14.xml auth v739 ap=1 s=29845 n(v0 rc2024-09-19T07:13:24.758986+0000 b29845 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@7},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16edb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000115b:[<0x10000001093/article-14.xml v238>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000115b:[<0x10000001093/article-14.xml v739>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.964 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.733+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010bf [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-46.xml auth v817 ap=1 s=22859 n(v0 rc2024-09-19T07:13:24.397995+0000 b22859 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@5},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16ee100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010bf:[<0x10000001093/article-46.xml v46>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010bf:[<0x10000001093/article-46.xml v817>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.964 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.733+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010ba [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-47.xml auth v891 ap=1 s=30342 n(v0 rc2024-09-19T07:13:24.387995+0000 b30342 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@4},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16ee680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010ba:[<0x10000001093/article-47.xml v40>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010ba:[<0x10000001093/article-47.xml v891>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.964 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.733+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001189 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-22.jpg auth v785 ap=1 s=46793 n(v0 rc2024-09-19T07:13:24.930982+0000 b46793 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@7},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16eec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001189:[<0x10000001093/picture-22.jpg v328>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001189:[<0x10000001093/picture-22.jpg v785>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.964 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.734+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001168 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-11.xml auth v845 ap=1 s=29706 n(v0 rc2024-09-19T07:13:24.805985+0000 b29706 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@7},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16ef180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001168:[<0x10000001093/article-11.xml v256>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001168:[<0x10000001093/article-11.xml v845>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.964 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.734+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001121 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-26.xml auth v879 ap=1 s=16797 n(v0 rc2024-09-19T07:13:24.580990+0000 b16797 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@7},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16fa000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001121:[<0x10000001093/article-26.xml v166>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001121:[<0x10000001093/article-26.xml v879>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.964 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.734+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001151 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-16.xml auth v831 ap=1 s=30668 n(v0 rc2024-09-19T07:13:24.713987+0000 b30668 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@7},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16ef700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001151:[<0x10000001093/article-16.xml v226>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001151:[<0x10000001093/article-16.xml v831>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.964 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.734+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001196 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-15.jpg auth v755 ap=1 s=9618 n(v0 rc2024-09-19T07:13:24.971981+0000 b9618 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@7},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16fa580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001196:[<0x10000001093/picture-15.jpg v370>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001196:[<0x10000001093/picture-15.jpg v755>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.964 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.734+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000116b [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-10.xml auth v769 ap=1 s=24372 n(v0 rc2024-09-19T07:13:24.817984+0000 b24372 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@7},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16fab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000116b:[<0x10000001093/article-10.xml v262>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000116b:[<0x10000001093/article-10.xml v769>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.965 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.734+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000119c [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-12.jpg auth v837 ap=1 s=17166 n(v0 rc2024-09-19T07:13:24.993980+0000 b17166 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@7},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16fb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000119c:[<0x10000001093/picture-12.jpg v388>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000119c:[<0x10000001093/picture-12.jpg v837>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.965 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.735+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010b5 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-48.xml auth v873 ap=1 s=17553 n(v0 rc2024-09-19T07:13:24.376995+0000 b17553 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@15},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16fb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010b5:[<0x10000001093/article-48.xml v34>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010b5:[<0x10000001093/article-48.xml v873>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.965 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.735+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001128 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-25.xml auth v877 ap=1 s=3434 n(v0 rc2024-09-19T07:13:24.589990+0000 b3434 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@7},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16fc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001128:[<0x10000001093/article-25.xml v172>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001128:[<0x10000001093/article-25.xml v877>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.965 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.735+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000117d [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-4.xml auth v847 ap=1 s=15514 n(v0 rc2024-09-19T07:13:24.884983+0000 b15514 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@4},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16fbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000117d:[<0x10000001093/article-4.xml v298>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000117d:[<0x10000001093/article-4.xml v847>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.965 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.735+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011b6 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-3.jpg auth v811 ap=1 s=59319 n(v0 rc2024-09-19T07:13:25.090978+0000 b59319 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16dcc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011b6:[<0x10000001093/picture-3.jpg v442>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011b6:[<0x10000001093/picture-3.jpg v811>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.965 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.736+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010e9 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-38.xml auth v797 ap=1 s=30487 n(v0 rc2024-09-19T07:13:24.470993+0000 b30487 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@8},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16fc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010e9:[<0x10000001093/article-38.xml v94>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010e9:[<0x10000001093/article-38.xml v797>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.965 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.736+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000119f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-11.jpg auth v789 ap=1 s=56941 n(v0 rc2024-09-19T07:13:25.008980+0000 b56941 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@7},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16dd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000119f:[<0x10000001093/picture-11.jpg v394>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000119f:[<0x10000001093/picture-11.jpg v789>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.965 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.736+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000117c [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-5.xml auth v827 ap=1 s=31324 n(v0 rc2024-09-19T07:13:24.875983+0000 b31324 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@4},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16dd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000117c:[<0x10000001093/article-5.xml v292>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000117c:[<0x10000001093/article-5.xml v827>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.965 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.736+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010fd [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-34.xml auth v759 ap=1 s=22876 n(v0 rc2024-09-19T07:13:24.506992+0000 b22876 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@5},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16ec000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010fd:[<0x10000001093/article-34.xml v118>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010fd:[<0x10000001093/article-34.xml v759>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.966 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.737+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001112 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-29.xml auth v875 ap=1 s=31542 n(v0 rc2024-09-19T07:13:24.549991+0000 b31542 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@7},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16ec580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001112:[<0x10000001093/article-29.xml v148>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001112:[<0x10000001093/article-29.xml v875>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.966 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.737+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001135 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-22.xml auth v775 ap=1 s=3813 n(v0 rc2024-09-19T07:13:24.634989+0000 b3813 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@7},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16ecb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001135:[<0x10000001093/article-22.xml v190>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001135:[<0x10000001093/article-22.xml v775>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.966 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.737+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010b0 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-49.xml auth v871 ap=1 s=28889 n(v0 rc2024-09-19T07:13:24.365995+0000 b28889 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@13},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16ed080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010b0:[<0x10000001093/article-49.xml v28>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010b0:[<0x10000001093/article-49.xml v871>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.966 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.738+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010d1 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-43.xml auth v855 ap=1 s=12450 n(v0 rc2024-09-19T07:13:24.426994+0000 b12450 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@12},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16dab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010d1:[<0x10000001093/article-43.xml v64>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010d1:[<0x10000001093/article-43.xml v855>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.966 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.738+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001101 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-33.xml auth v783 ap=1 s=12262 n(v0 rc2024-09-19T07:13:24.515992+0000 b12262 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@8},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16db080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001101:[<0x10000001093/article-33.xml v124>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001101:[<0x10000001093/article-33.xml v783>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.966 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.738+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011b0 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-5.jpg auth v745 ap=1 s=20519 n(v0 rc2024-09-19T07:13:25.070978+0000 b20519 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@4},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16db600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011b0:[<0x10000001093/picture-5.jpg v430>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011b0:[<0x10000001093/picture-5.jpg v745>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.966 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.739+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001099 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-53.xml auth v851 ap=1 s=11612 n(v0 rc2024-09-19T07:13:24.325996+0000 b11612 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@12},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16dbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001099:[<0x10000001093/article-53.xml v4>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001099:[<0x10000001093/article-53.xml v851>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.966 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.739+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001115 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-28.xml auth v821 ap=1 s=32283 n(v0 rc2024-09-19T07:13:24.558991+0000 b32283 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@7},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16dc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001115:[<0x10000001093/article-28.xml v154>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001115:[<0x10000001093/article-28.xml v821>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.967 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.739+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000109f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-52.xml auth v767 ap=1 s=14553 n(v0 rc2024-09-19T07:13:24.335996+0000 b14553 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@16},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16dc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000109f:[<0x10000001093/article-52.xml v10>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000109f:[<0x10000001093/article-52.xml v767>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.967 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.739+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001171 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-8.xml auth v849 ap=1 s=22995 n(v0 rc2024-09-19T07:13:24.840984+0000 b22995 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@5},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16cf600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001171:[<0x10000001093/article-8.xml v274>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001171:[<0x10000001093/article-8.xml v849>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.967 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.740+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011a7 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-8.jpg auth v741 ap=1 s=12334 n(v0 rc2024-09-19T07:13:25.036979+0000 b12334 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@5},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16cfb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011a7:[<0x10000001093/picture-8.jpg v412>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011a7:[<0x10000001093/picture-8.jpg v741>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.967 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.740+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001105 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-32.xml auth v771 ap=1 s=6929 n(v0 rc2024-09-19T07:13:24.524991+0000 b6929 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@8},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16d0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001105:[<0x10000001093/article-32.xml v130>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001105:[<0x10000001093/article-32.xml v771>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.967 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.740+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000113b [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-21.xml auth v777 ap=1 s=8499 n(v0 rc2024-09-19T07:13:24.646989+0000 b8499 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@7},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16d0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000113b:[<0x10000001093/article-21.xml v196>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000113b:[<0x10000001093/article-21.xml v777>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.967 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.740+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000110e [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-30.xml auth v809 ap=1 s=17101 n(v0 rc2024-09-19T07:13:24.542991+0000 b17101 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@8},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16d0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000110e:[<0x10000001093/article-30.xml v142>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000110e:[<0x10000001093/article-30.xml v809>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.967 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.741+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001160 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-13.xml auth v805 ap=1 s=9247 n(v0 rc2024-09-19T07:13:24.774985+0000 b9247 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@7},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16d1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001160:[<0x10000001093/article-13.xml v244>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001160:[<0x10000001093/article-13.xml v805>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.967 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.741+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010aa [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-50.xml auth v795 ap=1 s=17916 n(v0 rc2024-09-19T07:13:24.355996+0000 b17916 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@13},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16d1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010aa:[<0x10000001093/article-50.xml v22>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010aa:[<0x10000001093/article-50.xml v795>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.967 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.741+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001179 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-6.xml auth v801 ap=1 s=8655 n(v0 rc2024-09-19T07:13:24.864983+0000 b8655 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@4},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16da000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001179:[<0x10000001093/article-6.xml v286>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001179:[<0x10000001093/article-6.xml v801>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.967 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.741+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001182 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-2.xml auth v835 ap=1 s=5827 n(v0 rc2024-09-19T07:13:24.902982+0000 b5827 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16da580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001182:[<0x10000001093/article-2.xml v310>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001182:[<0x10000001093/article-2.xml v835>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.968 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.742+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011a1 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-10.jpg auth v791 ap=1 s=28321 n(v0 rc2024-09-19T07:13:25.016980+0000 b28321 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@7},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16c2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011a1:[<0x10000001093/picture-10.jpg v400>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011a1:[<0x10000001093/picture-10.jpg v791>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.968 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.742+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011bb [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-1.jpg auth v787 ap=1 s=50210 n(v0 rc2024-09-19T07:13:25.112977+0000 b50210 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16c2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011bb:[<0x10000001093/picture-1.jpg v454>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011bb:[<0x10000001093/picture-1.jpg v787>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.968 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.743+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000116e [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-9.xml auth v807 ap=1 s=12853 n(v0 rc2024-09-19T07:13:24.826984+0000 b12853 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@7},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16c2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000116e:[<0x10000001093/article-9.xml v268>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000116e:[<0x10000001093/article-9.xml v807>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.968 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.743+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010ca [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-44.xml auth v833 ap=1 s=28036 n(v0 rc2024-09-19T07:13:24.417994+0000 b28036 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@13},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16c3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010ca:[<0x10000001093/article-44.xml v58>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010ca:[<0x10000001093/article-44.xml v833>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.968 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.743+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011ac [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-6.jpg auth v861 ap=1 s=18810 n(v0 rc2024-09-19T07:13:25.058979+0000 b18810 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@4},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16c3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011ac:[<0x10000001093/picture-6.jpg v424>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011ac:[<0x10000001093/picture-6.jpg v861>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.968 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.744+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000112c [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-24.xml auth v887 ap=1 s=32750 n(v0 rc2024-09-19T07:13:24.602990+0000 b32750 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@7},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16ce000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000112c:[<0x10000001093/article-24.xml v178>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000112c:[<0x10000001093/article-24.xml v887>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.968 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.744+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001191 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-17.jpg auth v823 ap=1 s=50417 n(v0 rc2024-09-19T07:13:24.953981+0000 b50417 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@7},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16ce580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001191:[<0x10000001093/picture-17.jpg v358>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001191:[<0x10000001093/picture-17.jpg v823>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.968 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.745+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001180 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-3.xml auth v763 ap=1 s=32232 n(v0 rc2024-09-19T07:13:24.889983+0000 b32232 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@4},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16ceb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001180:[<0x10000001093/article-3.xml v304>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001180:[<0x10000001093/article-3.xml v763>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.968 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.745+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001174 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-7.xml auth v889 ap=1 s=29427 n(v0 rc2024-09-19T07:13:24.850984+0000 b29427 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@5},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16cf080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001174:[<0x10000001093/article-7.xml v280>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001174:[<0x10000001093/article-7.xml v889>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.969 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.745+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001199 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-13.jpg auth v829 ap=1 s=48447 n(v0 rc2024-09-19T07:13:24.987980+0000 b48447 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@7},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb1690b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001199:[<0x10000001093/picture-13.jpg v382>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001199:[<0x10000001093/picture-13.jpg v829>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.969 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.745+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000118f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-18.jpg auth v765 ap=1 s=41929 n(v0 rc2024-09-19T07:13:24.944981+0000 b41929 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@7},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb1691080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000118f:[<0x10000001093/picture-18.jpg v352>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000118f:[<0x10000001093/picture-18.jpg v765>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.969 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.745+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001147 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-18.xml auth v803 ap=1 s=29685 n(v0 rc2024-09-19T07:13:24.681988+0000 b29685 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@7},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb1691600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001147:[<0x10000001093/article-18.xml v214>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001147:[<0x10000001093/article-18.xml v803>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.969 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.746+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000118e [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-19.jpg auth v843 ap=1 s=16840 n(v0 rc2024-09-19T07:13:24.942981+0000 b16840 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@7},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb1691b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000118e:[<0x10000001093/picture-19.jpg v346>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000118e:[<0x10000001093/picture-19.jpg v843>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.969 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.746+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010a4 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-51.xml auth v793 ap=1 s=15631 n(v0 rc2024-09-19T07:13:24.346996+0000 b15631 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@14},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb1692100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010a4:[<0x10000001093/article-51.xml v16>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010a4:[<0x10000001093/article-51.xml v793>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.969 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.746+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000111c [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-27.xml auth v885 ap=1 s=2934 n(v0 rc2024-09-19T07:13:24.569990+0000 b2934 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@7},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb1692680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000111c:[<0x10000001093/article-27.xml v160>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000111c:[<0x10000001093/article-27.xml v885>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.969 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.746+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011b3 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-4.jpg auth v839 ap=1 s=39548 n(v0 rc2024-09-19T07:13:25.081978+0000 b39548 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@4},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb1692c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011b3:[<0x10000001093/picture-4.jpg v436>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011b3:[<0x10000001093/picture-4.jpg v839>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.969 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.746+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011b9 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-2.jpg auth v757 ap=1 s=17516 n(v0 rc2024-09-19T07:13:25.104978+0000 b17516 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb1693180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011b9:[<0x10000001093/picture-2.jpg v448>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011b9:[<0x10000001093/picture-2.jpg v757>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.969 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.746+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000113f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-20.xml auth v799 ap=1 s=5413 n(v0 rc2024-09-19T07:13:24.656988+0000 b5413 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@7},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb1693700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000113f:[<0x10000001093/article-20.xml v202>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000113f:[<0x10000001093/article-20.xml v799>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.970 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.747+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001197 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-14.jpg auth v869 ap=1 s=23482 n(v0 rc2024-09-19T07:13:24.982980+0000 b23482 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@7},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16c0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001197:[<0x10000001093/picture-14.jpg v376>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001197:[<0x10000001093/picture-14.jpg v869>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.970 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.747+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010da [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-41.xml auth v863 ap=1 s=19161 n(v0 rc2024-09-19T07:13:24.445993+0000 b19161 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@8},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16c0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010da:[<0x10000001093/article-41.xml v76>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010da:[<0x10000001093/article-41.xml v863>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.970 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.747+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011aa [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-7.jpg auth v751 ap=1 s=42505 n(v0 rc2024-09-19T07:13:25.050979+0000 b42505 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@5},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16c1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011aa:[<0x10000001093/picture-7.jpg v418>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011aa:[<0x10000001093/picture-7.jpg v751>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.970 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.747+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010c6 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-45.xml auth v749 ap=1 s=22643 n(v0 rc2024-09-19T07:13:24.406994+0000 b22643 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@8},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16c0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010c6:[<0x10000001093/article-45.xml v52>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010c6:[<0x10000001093/article-45.xml v749>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.970 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.747+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001109 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-31.xml auth v753 ap=1 s=7940 n(v0 rc2024-09-19T07:13:24.535991+0000 b7940 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@8},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x561fb16c1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001109:[<0x10000001093/article-31.xml v136>,<0x10000000399/blog-23 v26870>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001109:[<0x10000001093/article-31.xml v753>,<0x10000000399/blog-23 v61426>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.970 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.876+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001299 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-27.jpg auth v1043 ap=1 s=13782 n(v0 rc2024-09-19T07:13:25.853960+0000 b13782 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb162e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001299:[<0x10000001055/picture-27.jpg v592>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001299:[<0x10000001055/picture-27.jpg v1043>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.970 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.876+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000123e [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-52.jpg auth v1047 ap=1 s=59706 n(v0 rc2024-09-19T07:13:25.541967+0000 b59706 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb162e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000123e:[<0x10000001055/picture-52.jpg v442>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000123e:[<0x10000001055/picture-52.jpg v1047>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.970 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.877+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001077 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/article-1.xml auth v1029 ap=1 s=10785 n(v0 rc2024-09-19T07:13:24.273998+0000 b10785 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb162eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001077:[<0x10000001055/article-1.xml v40>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001077:[<0x10000001055/article-1.xml v1029>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.970 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.877+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001284 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-34.jpg auth v1049 ap=1 s=51423 n(v0 rc2024-09-19T07:13:25.793961+0000 b51423 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb162f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001284:[<0x10000001055/picture-34.jpg v550>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001284:[<0x10000001055/picture-34.jpg v1049>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.970 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.877+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001154 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-67.jpg auth v1037 ap=1 s=35582 n(v0 rc2024-09-19T07:13:24.718987+0000 b35582 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb162fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001154:[<0x10000001055/picture-67.jpg v262>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001154:[<0x10000001055/picture-67.jpg v1037>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.971 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.877+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000123b [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-53.jpg auth v1035 ap=1 s=39646 n(v0 rc2024-09-19T07:13:25.527967+0000 b39646 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb162f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000123b:[<0x10000001055/picture-53.jpg v436>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000123b:[<0x10000001055/picture-53.jpg v1035>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.971 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.877+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000107e [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-90.jpg auth v1045 ap=1 s=63899 n(v0 rc2024-09-19T07:13:24.283997+0000 b63899 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1630100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000107e:[<0x10000001055/picture-90.jpg v46>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000107e:[<0x10000001055/picture-90.jpg v1045>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.971 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.878+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012be [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-16.jpg auth v1039 ap=1 s=53028 n(v0 rc2024-09-19T07:13:25.965957+0000 b53028 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1631180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012be:[<0x10000001055/picture-16.jpg v658>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000012be:[<0x10000001055/picture-16.jpg v1039>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.971 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.878+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001106 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-74.jpg auth v1017 ap=1 s=39737 n(v0 rc2024-09-19T07:13:24.550991+0000 b39737 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb163a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001106:[<0x10000001055/picture-74.jpg v184>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001106:[<0x10000001055/picture-74.jpg v1017>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.971 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.879+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010f4 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-76.jpg auth v1033 ap=1 s=51284 n(v0 rc2024-09-19T07:13:24.497992+0000 b51284 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb163a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010f4:[<0x10000001055/picture-76.jpg v148>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010f4:[<0x10000001055/picture-76.jpg v1033>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.971 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.879+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000124e [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-48.jpg auth v1031 ap=1 s=10385 n(v0 rc2024-09-19T07:13:25.587966+0000 b10385 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb163b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000124e:[<0x10000001055/picture-48.jpg v466>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000124e:[<0x10000001055/picture-48.jpg v1031>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.971 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.879+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001117 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-73.jpg auth v1015 ap=1 s=22719 n(v0 rc2024-09-19T07:13:24.564991+0000 b22719 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb161e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001117:[<0x10000001055/picture-73.jpg v192>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001117:[<0x10000001055/picture-73.jpg v1015>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.971 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.880+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000128a [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-32.jpg auth v1041 ap=1 s=23080 n(v0 rc2024-09-19T07:13:25.813961+0000 b23080 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb163ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000128a:[<0x10000001055/picture-32.jpg v562>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000128a:[<0x10000001055/picture-32.jpg v1041>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.971 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.881+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012ac [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-21.jpg auth v1021 ap=1 s=43187 n(v0 rc2024-09-19T07:13:25.906958+0000 b43187 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb161e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012ac:[<0x10000001055/picture-21.jpg v628>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000012ac:[<0x10000001055/picture-21.jpg v1021>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.971 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.881+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010fe [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-75.jpg auth v1023 ap=1 s=30068 n(v0 rc2024-09-19T07:13:24.515992+0000 b30068 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb161eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010fe:[<0x10000001055/picture-75.jpg v160>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010fe:[<0x10000001055/picture-75.jpg v1023>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.972 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.881+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001290 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-30.jpg auth v1029 ap=1 s=36919 n(v0 rc2024-09-19T07:13:25.828960+0000 b36919 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb161f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001290:[<0x10000001055/picture-30.jpg v574>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001290:[<0x10000001055/picture-30.jpg v1029>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.972 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.881+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000127d [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-36.jpg auth v1025 ap=1 s=25870 n(v0 rc2024-09-19T07:13:25.773961+0000 b25870 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb161fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000127d:[<0x10000001055/picture-36.jpg v538>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000127d:[<0x10000001055/picture-36.jpg v1025>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.972 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.881+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001261 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-43.jpg auth v1017 ap=1 s=28982 n(v0 rc2024-09-19T07:13:25.651964+0000 b28982 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1620100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001261:[<0x10000001055/picture-43.jpg v496>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001261:[<0x10000001055/picture-43.jpg v1017>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.972 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.882+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012b0 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-20.jpg auth v1019 ap=1 s=9467 n(v0 rc2024-09-19T07:13:25.919958+0000 b9467 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1620680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012b0:[<0x10000001055/picture-20.jpg v634>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000012b0:[<0x10000001055/picture-20.jpg v1019>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.972 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.882+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001275 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-38.jpg auth v1027 ap=1 s=41656 n(v0 rc2024-09-19T07:13:25.738962+0000 b41656 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1620c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001275:[<0x10000001055/picture-38.jpg v526>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001275:[<0x10000001055/picture-38.jpg v1027>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.972 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.882+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012a5 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-23.jpg auth v1028 ap=1 s=17845 n(v0 rc2024-09-19T07:13:25.888959+0000 b17845 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb160a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012a5:[<0x10000001055/picture-23.jpg v616>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000012a5:[<0x10000001055/picture-23.jpg v1028>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.972 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.882+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010d6 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-79.jpg auth v1034 ap=1 s=24944 n(v0 rc2024-09-19T07:13:24.448993+0000 b24944 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb160a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010d6:[<0x10000001055/picture-79.jpg v114>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010d6:[<0x10000001055/picture-79.jpg v1034>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.972 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.883+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001259 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-45.jpg auth v1024 ap=1 s=35548 n(v0 rc2024-09-19T07:13:25.625965+0000 b35548 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb160ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001259:[<0x10000001055/picture-45.jpg v484>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001259:[<0x10000001055/picture-45.jpg v1024>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.972 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.883+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001269 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-41.jpg auth v1046 ap=1 s=36339 n(v0 rc2024-09-19T07:13:25.681964+0000 b36339 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb160b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001269:[<0x10000001055/picture-41.jpg v508>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001269:[<0x10000001055/picture-41.jpg v1046>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.972 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.883+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000120a [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-60.jpg auth v1020 ap=1 s=49268 n(v0 rc2024-09-19T07:13:25.394971+0000 b49268 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb160b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000120a:[<0x10000001055/picture-60.jpg v351>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000120a:[<0x10000001055/picture-60.jpg v1020>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.973 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.883+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001159 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-66.jpg auth v1040 ap=1 s=51713 n(v0 rc2024-09-19T07:13:25.251974+0000 b51713 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1614000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001159:[<0x10000001055/picture-66.jpg v270>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001159:[<0x10000001055/picture-66.jpg v1040>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.973 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.883+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010cc [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-80.jpg auth v1030 ap=1 s=65199 n(v0 rc2024-09-19T07:13:24.425994+0000 b65199 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1614580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010cc:[<0x10000001055/picture-80.jpg v106>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010cc:[<0x10000001055/picture-80.jpg v1030>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.973 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.884+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012a8 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-22.jpg auth v1018 ap=1 s=57687 n(v0 rc2024-09-19T07:13:25.897959+0000 b57687 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1614b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012a8:[<0x10000001055/picture-22.jpg v622>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000012a8:[<0x10000001055/picture-22.jpg v1018>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.973 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.884+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012c1 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-15.jpg auth v1036 ap=1 s=48552 n(v0 rc2024-09-19T07:13:25.973957+0000 b48552 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1615080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012c1:[<0x10000001055/picture-15.jpg v664>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000012c1:[<0x10000001055/picture-15.jpg v1036>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.973 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.884+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001225 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-56.jpg auth v1022 ap=1 s=23098 n(v0 rc2024-09-19T07:13:25.474969+0000 b23098 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1615600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001225:[<0x10000001055/picture-56.jpg v402>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001225:[<0x10000001055/picture-56.jpg v1022>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.973 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.884+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001252 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-47.jpg auth v1038 ap=1 s=30735 n(v0 rc2024-09-19T07:13:25.600966+0000 b30735 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1615b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001252:[<0x10000001055/picture-47.jpg v472>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001252:[<0x10000001055/picture-47.jpg v1038>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.973 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.884+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012cc [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-12.jpg auth v1044 ap=1 s=38144 n(v0 rc2024-09-19T07:13:26.014956+0000 b38144 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1616100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012cc:[<0x10000001055/picture-12.jpg v682>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000012cc:[<0x10000001055/picture-12.jpg v1044>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.973 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.885+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000125e [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-44.jpg auth v1032 ap=1 s=55749 n(v0 rc2024-09-19T07:13:25.637965+0000 b55749 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1616680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000125e:[<0x10000001055/picture-44.jpg v490>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000125e:[<0x10000001055/picture-44.jpg v1032>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.973 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.885+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001067 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/article-4.xml auth v1016 ap=1 s=4283 n(v0 rc2024-09-19T07:13:24.232999+0000 b4283 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@4},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1616c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001067:[<0x10000001055/article-4.xml v22>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001067:[<0x10000001055/article-4.xml v1016>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.973 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.885+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001123 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-72.jpg auth v1026 ap=1 s=26316 n(v0 rc2024-09-19T07:13:24.586990+0000 b26316 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1617180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001123:[<0x10000001055/picture-72.jpg v204>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001123:[<0x10000001055/picture-72.jpg v1026>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.974 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.885+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001211 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-59.jpg auth v1042 ap=1 s=61157 n(v0 rc2024-09-19T07:13:25.411970+0000 b61157 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1617700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001211:[<0x10000001055/picture-59.jpg v364>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001211:[<0x10000001055/picture-59.jpg v1042>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.974 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.886+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012d0 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-11.jpg auth v1039 ap=1 s=61156 n(v0 rc2024-09-19T07:13:26.032955+0000 b61156 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15fec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012d0:[<0x10000001055/picture-11.jpg v688>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000012d0:[<0x10000001055/picture-11.jpg v1039>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.974 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.886+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001138 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-70.jpg auth v1035 ap=1 s=55493 n(v0 rc2024-09-19T07:13:24.644989+0000 b55493 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15ff180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001138:[<0x10000001055/picture-70.jpg v228>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001138:[<0x10000001055/picture-70.jpg v1035>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.974 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.886+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000122e [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-55.jpg auth v1041 ap=1 s=42560 n(v0 rc2024-09-19T07:13:25.497968+0000 b42560 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15fe680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000122e:[<0x10000001055/picture-55.jpg v417>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000122e:[<0x10000001055/picture-55.jpg v1041>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.974 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.886+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001131 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-71.jpg auth v1029 ap=1 s=45119 n(v0 rc2024-09-19T07:13:24.625989+0000 b45119 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1608000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001131:[<0x10000001055/picture-71.jpg v220>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001131:[<0x10000001055/picture-71.jpg v1029>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.974 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.886+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001061 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/article-5.xml auth v1025 ap=1 s=21821 n(v0 rc2024-09-19T07:13:24.218999+0000 b21821 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@4},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15ff700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001061:[<0x10000001055/article-5.xml v16>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001061:[<0x10000001055/article-5.xml v1025>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.974 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.886+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011fa [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-63.jpg auth v1037 ap=1 s=10507 n(v0 rc2024-09-19T07:13:25.332972+0000 b10507 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1608580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011fa:[<0x10000001055/picture-63.jpg v322>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011fa:[<0x10000001055/picture-63.jpg v1037>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.974 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.887+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001090 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-87.jpg auth v1027 ap=1 s=15566 n(v0 rc2024-09-19T07:13:24.314997+0000 b15566 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1609080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001090:[<0x10000001055/picture-87.jpg v64>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001090:[<0x10000001055/picture-87.jpg v1027>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.974 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.887+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000126d [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-40.jpg auth v1031 ap=1 s=14764 n(v0 rc2024-09-19T07:13:25.698963+0000 b14764 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1608b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000126d:[<0x10000001055/picture-40.jpg v514>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000126d:[<0x10000001055/picture-40.jpg v1031>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.974 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.887+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010a2 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-84.jpg auth v1033 ap=1 s=12263 n(v0 rc2024-09-19T07:13:24.345996+0000 b12263 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1609600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010a2:[<0x10000001055/picture-84.jpg v82>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010a2:[<0x10000001055/picture-84.jpg v1033>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.975 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.888+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001097 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-86.jpg auth v1041 ap=1 s=19022 n(v0 rc2024-09-19T07:13:24.323996+0000 b19022 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15ee000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001097:[<0x10000001055/picture-86.jpg v70>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001097:[<0x10000001055/picture-86.jpg v1041>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.975 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.888+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010c1 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-81.jpg auth v1045 ap=1 s=41838 n(v0 rc2024-09-19T07:13:24.404994+0000 b41838 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15ee580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010c1:[<0x10000001055/picture-81.jpg v100>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010c1:[<0x10000001055/picture-81.jpg v1045>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.975 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.888+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001246 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-50.jpg auth v1049 ap=1 s=45491 n(v0 rc2024-09-19T07:13:25.564967+0000 b45491 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15ef080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001246:[<0x10000001055/picture-50.jpg v454>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001246:[<0x10000001055/picture-50.jpg v1049>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.975 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.888+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001217 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-58.jpg auth v1043 ap=1 s=8363 n(v0 rc2024-09-19T07:13:25.427970+0000 b8363 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15ef600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001217:[<0x10000001055/picture-58.jpg v372>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001217:[<0x10000001055/picture-58.jpg v1043>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.975 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.888+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011e9 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-65.jpg auth v1035 ap=1 s=27483 n(v0 rc2024-09-19T07:13:25.278973+0000 b27483 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15efb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011e9:[<0x10000001055/picture-65.jpg v283>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011e9:[<0x10000001055/picture-65.jpg v1035>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.975 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.889+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010ea [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-77.jpg auth v1033 ap=1 s=48981 n(v0 rc2024-09-19T07:13:24.478993+0000 b48981 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15f1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010ea:[<0x10000001055/picture-77.jpg v136>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010ea:[<0x10000001055/picture-77.jpg v1033>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.975 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.889+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000113e [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-69.jpg auth v1037 ap=1 s=42190 n(v0 rc2024-09-19T07:13:24.666988+0000 b42190 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15fc000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000113e:[<0x10000001055/picture-69.jpg v240>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000113e:[<0x10000001055/picture-69.jpg v1037>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.975 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.890+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001242 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-51.jpg auth v1039 ap=1 s=55007 n(v0 rc2024-09-19T07:13:25.552967+0000 b55007 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15fc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001242:[<0x10000001055/picture-51.jpg v448>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001242:[<0x10000001055/picture-51.jpg v1039>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.975 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.890+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001256 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-46.jpg auth v1031 ap=1 s=57659 n(v0 rc2024-09-19T07:13:25.612965+0000 b57659 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15fd080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001256:[<0x10000001055/picture-46.jpg v478>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001256:[<0x10000001055/picture-46.jpg v1031>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.976 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.890+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011fd [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-62.jpg auth v1047 ap=1 s=49683 n(v0 rc2024-09-19T07:13:25.358971+0000 b49683 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15fcb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011fd:[<0x10000001055/picture-62.jpg v330>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011fd:[<0x10000001055/picture-62.jpg v1047>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.976 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.890+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000129f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-25.jpg auth v1027 ap=1 s=38573 n(v0 rc2024-09-19T07:13:25.870959+0000 b38573 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15d8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000129f:[<0x10000001055/picture-25.jpg v604>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000129f:[<0x10000001055/picture-25.jpg v1027>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.976 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.890+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000128d [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-31.jpg auth v1039 ap=1 s=55169 n(v0 rc2024-09-19T07:13:25.821960+0000 b55169 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15d8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000128d:[<0x10000001055/picture-31.jpg v568>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000128d:[<0x10000001055/picture-31.jpg v1039>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.976 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.890+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000124a [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-49.jpg auth v1029 ap=1 s=46930 n(v0 rc2024-09-19T07:13:25.576966+0000 b46930 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15d9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000124a:[<0x10000001055/picture-49.jpg v460>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000124a:[<0x10000001055/picture-49.jpg v1029>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.976 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.891+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012dc [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-8.jpg auth v1023 ap=1 s=29560 n(v0 rc2024-09-19T07:13:26.076954+0000 b29560 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@4},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15d9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012dc:[<0x10000001055/picture-8.jpg v706>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000012dc:[<0x10000001055/picture-8.jpg v1023>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.976 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.891+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000108a [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-88.jpg auth v1031 ap=1 s=18784 n(v0 rc2024-09-19T07:13:24.304997+0000 b18784 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15e2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000108a:[<0x10000001055/picture-88.jpg v58>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000108a:[<0x10000001055/picture-88.jpg v1031>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.976 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.891+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000129c [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-26.jpg auth v1035 ap=1 s=55125 n(v0 rc2024-09-19T07:13:25.861959+0000 b55125 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15e2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000129c:[<0x10000001055/picture-26.jpg v598>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000129c:[<0x10000001055/picture-26.jpg v1035>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.976 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.891+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001072 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/article-2.xml auth v1019 ap=1 s=21821 n(v0 rc2024-09-19T07:13:24.262998+0000 b21821 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@4},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15e3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001072:[<0x10000001055/article-2.xml v34>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001072:[<0x10000001055/article-2.xml v1019>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.976 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.891+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000105d [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/article-6.xml auth v1021 ap=1 s=9838 n(v0 rc2024-09-19T07:13:24.201999+0000 b9838 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@4},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15e3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000105d:[<0x10000001055/article-6.xml v10>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000105d:[<0x10000001055/article-6.xml v1021>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.976 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.892+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001237 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-54.jpg auth v1025 ap=1 s=45242 n(v0 rc2024-09-19T07:13:25.516968+0000 b45242 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15e4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001237:[<0x10000001055/picture-54.jpg v430>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001237:[<0x10000001055/picture-54.jpg v1025>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.977 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.892+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001293 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-29.jpg auth v1037 ap=1 s=27006 n(v0 rc2024-09-19T07:13:25.835960+0000 b27006 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15e4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001293:[<0x10000001055/picture-29.jpg v580>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001293:[<0x10000001055/picture-29.jpg v1037>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.977 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.892+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011f1 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-64.jpg auth v1030 ap=1 s=13631 n(v0 rc2024-09-19T07:13:25.301973+0000 b13631 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15c5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011f1:[<0x10000001055/picture-64.jpg v300>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000011f1:[<0x10000001055/picture-64.jpg v1030>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.977 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.892+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012d4 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-10.jpg auth v1038 ap=1 s=41698 n(v0 rc2024-09-19T07:13:26.046955+0000 b41698 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15ce000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012d4:[<0x10000001055/picture-10.jpg v694>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000012d4:[<0x10000001055/picture-10.jpg v1038>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.977 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.893+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010ab [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-83.jpg auth v1032 ap=1 s=36525 n(v0 rc2024-09-19T07:13:24.365995+0000 b36525 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15cf080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010ab:[<0x10000001055/picture-83.jpg v88>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010ab:[<0x10000001055/picture-83.jpg v1032>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.977 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.893+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001296 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-28.jpg auth v1028 ap=1 s=42674 n(v0 rc2024-09-19T07:13:25.844960+0000 b42674 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15cfb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001296:[<0x10000001055/picture-28.jpg v586>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001296:[<0x10000001055/picture-28.jpg v1028>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.977 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.894+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000127a [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-37.jpg auth v1036 ap=1 s=20833 n(v0 rc2024-09-19T07:13:25.755962+0000 b20833 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15d0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000127a:[<0x10000001055/picture-37.jpg v532>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000127a:[<0x10000001055/picture-37.jpg v1036>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.977 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.894+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012bb [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-17.jpg auth v1048 ap=1 s=53254 n(v0 rc2024-09-19T07:13:25.956957+0000 b53254 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15d0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012bb:[<0x10000001055/picture-17.jpg v652>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000012bb:[<0x10000001055/picture-17.jpg v1048>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.977 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.894+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000109d [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-85.jpg auth v1034 ap=1 s=26378 n(v0 rc2024-09-19T07:13:24.333996+0000 b26378 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15d0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000109d:[<0x10000001055/picture-85.jpg v76>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000109d:[<0x10000001055/picture-85.jpg v1034>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.977 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.894+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000106b [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/article-3.xml auth v1022 ap=1 s=17993 n(v0 rc2024-09-19T07:13:24.251998+0000 b17993 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@4},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15d1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000106b:[<0x10000001055/article-3.xml v28>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000106b:[<0x10000001055/article-3.xml v1022>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.977 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.894+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012a2 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-24.jpg auth v1042 ap=1 s=43150 n(v0 rc2024-09-19T07:13:25.878959+0000 b43150 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15d1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012a2:[<0x10000001055/picture-24.jpg v610>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000012a2:[<0x10000001055/picture-24.jpg v1042>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.977 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.894+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001287 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-33.jpg auth v1050 ap=1 s=26343 n(v0 rc2024-09-19T07:13:25.803961+0000 b26343 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15d6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001287:[<0x10000001055/picture-33.jpg v556>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001287:[<0x10000001055/picture-33.jpg v1050>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.978 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.894+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000121d [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-57.jpg auth v1052 ap=1 s=53567 n(v0 rc2024-09-19T07:13:25.451969+0000 b53567 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15d6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000121d:[<0x10000001055/picture-57.jpg v387>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000121d:[<0x10000001055/picture-57.jpg v1052>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.978 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.895+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001057 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/article-7.xml auth v1026 ap=1 s=24370 n(v0 rc2024-09-19T07:13:24.190000+0000 b24370 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@4},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15d6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001057:[<0x10000001055/article-7.xml v4>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001057:[<0x10000001055/article-7.xml v1026>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.978 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.895+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001266 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-42.jpg auth v1040 ap=1 s=38388 n(v0 rc2024-09-19T07:13:25.663964+0000 b38388 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15d7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001266:[<0x10000001055/picture-42.jpg v502>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001266:[<0x10000001055/picture-42.jpg v1040>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.978 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.895+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000114a [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-68.jpg auth v1046 ap=1 s=21281 n(v0 rc2024-09-19T07:13:24.694987+0000 b21281 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15d7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000114a:[<0x10000001055/picture-68.jpg v252>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000114a:[<0x10000001055/picture-68.jpg v1046>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.978 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.895+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001272 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-39.jpg auth v1044 ap=1 s=56766 n(v0 rc2024-09-19T07:13:25.719963+0000 b56766 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15d7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001272:[<0x10000001055/picture-39.jpg v520>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001272:[<0x10000001055/picture-39.jpg v1044>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.978 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.896+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012c8 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-13.jpg auth v1036 ap=1 s=14662 n(v0 rc2024-09-19T07:13:26.002956+0000 b14662 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1465700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012c8:[<0x10000001055/picture-13.jpg v676>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000012c8:[<0x10000001055/picture-13.jpg v1036>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.978 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.897+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012b8 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-18.jpg auth v1044 ap=1 s=55375 n(v0 rc2024-09-19T07:13:25.945957+0000 b55375 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1465180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012b8:[<0x10000001055/picture-18.jpg v646>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000012b8:[<0x10000001055/picture-18.jpg v1044>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.978 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.898+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012b3 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-19.jpg auth v1040 ap=1 s=22333 n(v0 rc2024-09-19T07:13:25.933958+0000 b22333 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1464680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012b3:[<0x10000001055/picture-19.jpg v640>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000012b3:[<0x10000001055/picture-19.jpg v1040>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.978 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.898+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010b6 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-82.jpg auth v1038 ap=1 s=56671 n(v0 rc2024-09-19T07:13:24.385995+0000 b56671 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb1464100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010b6:[<0x10000001055/picture-82.jpg v94>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010b6:[<0x10000001055/picture-82.jpg v1038>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.979 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.898+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001281 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-35.jpg auth v1048 ap=1 s=16818 n(v0 rc2024-09-19T07:13:25.783961+0000 b16818 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15c2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001281:[<0x10000001055/picture-35.jpg v544>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001281:[<0x10000001055/picture-35.jpg v1048>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.979 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.899+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012c4 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-14.jpg auth v1032 ap=1 s=16041 n(v0 rc2024-09-19T07:13:25.986956+0000 b16041 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15c3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012c4:[<0x10000001055/picture-14.jpg v670>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000012c4:[<0x10000001055/picture-14.jpg v1032>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.979 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.899+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001083 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-89.jpg auth v1042 ap=1 s=40260 n(v0 rc2024-09-19T07:13:24.294997+0000 b40260 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15c3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001083:[<0x10000001055/picture-89.jpg v52>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001083:[<0x10000001055/picture-89.jpg v1042>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.979 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.899+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010e2 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-78.jpg auth v1034 ap=1 s=42235 n(v0 rc2024-09-19T07:13:24.466993+0000 b42235 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15c2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010e2:[<0x10000001055/picture-78.jpg v126>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000010e2:[<0x10000001055/picture-78.jpg v1034>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.979 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.899+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001206 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-61.jpg auth v1046 ap=1 s=34709 n(v0 rc2024-09-19T07:13:25.374971+0000 b34709 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15c3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001206:[<0x10000001055/picture-61.jpg v343>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000001206:[<0x10000001055/picture-61.jpg v1046>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.979 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.899+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012e1 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-7.jpg auth v1030 ap=1 s=9506 n(v0 rc2024-09-19T07:13:26.110953+0000 b9506 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@4},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15c4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012e1:[<0x10000001055/picture-7.jpg v714>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000012e1:[<0x10000001055/picture-7.jpg v1030>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:45.979 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:13:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:13:45.900+0000 7f609bfe0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012d8 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-9.jpg auth v1050 ap=1 s=41133 n(v0 rc2024-09-19T07:13:26.058955+0000 b41133 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561fb15c4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012d8:[<0x10000001055/picture-9.jpg v700>,<0x10000000399/blog-21 v29618>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000012d8:[<0x10000001055/picture-9.jpg v1050>,<0x10000000399/blog-21 v61412>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.022 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.712+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ad0 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-16.jpg auth v592 ap=1 s=60430 n(v0 rc2024-09-19T07:13:19.699108+0000 b60430 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae19600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ad0:[<0x10000000a37/picture-16.jpg v356>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ad0:[<0x10000000a37/picture-16.jpg v592>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.023 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.712+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a6e [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-22.xml auth v200 ap=1 s=5689 n(v0 rc2024-09-19T07:13:18.510137+0000 b5689 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35adfb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a6e:[<0x10000000a37/article-22.xml v200>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000a6e:[<0x10000000a37/article-22.xml v200>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.023 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.712+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a82 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-14.xml auth v220 ap=1 s=9014 n(v0 rc2024-09-19T07:13:18.593135+0000 b9014 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35adfbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a82:[<0x10000000a37/article-14.xml v220>,<0x10000000399/blog-10 v20288>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000a82:[<0x10000000a37/article-14.xml v220>,<0x10000000399/blog-10 v45726>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.023 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.832+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d99 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-13.xml auth v1503 ap=1 s=3683 n(v0 rc2024-09-19T07:13:21.962053+0000 b3683 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ad3f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d99:[<0x1000000039e/comment-13.xml v1441>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000d99:[<0x1000000039e/comment-13.xml v1503>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.023 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.832+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c1 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-64.xml auth v1134 ap=1 s=11721 n(v0 rc2024-09-19T07:13:13.256264+0000 b11721 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@4},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad3eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003c1:[<0x1000000039e/article-64.xml v1134>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000003c1:[<0x1000000039e/article-64.xml v1134>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.023 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.832+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d8d [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-21.xml auth v1489 ap=1 s=4333 n(v0 rc2024-09-19T07:13:21.916054+0000 b4333 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ad3f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d8d:[<0x1000000039e/comment-21.xml v1414>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000d8d:[<0x1000000039e/comment-21.xml v1489>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.023 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.832+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d14 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-26.xml auth v1487 ap=1 s=2898 n(v0 rc2024-09-19T07:13:21.118074+0000 b2898 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ad3fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d14:[<0x1000000039e/comment-26.xml v1366>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000d14:[<0x1000000039e/comment-26.xml v1487>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010ae (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-24.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011a2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-28.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001165 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-37.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011c1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-17.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011ae (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-24.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000111e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-3.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001184 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-33.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000110b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-7.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.025 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000063e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-64.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.025 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011b5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-13.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.025 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001175 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-21.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.025 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001146 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-26.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.025 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001130 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-42.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.025 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000114c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-39.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.025 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000622 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-75.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.025 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011ab (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-25.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.026 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.832+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d8f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-75.xml auth v1493 ap=1 s=25115 n(v0 rc2024-09-19T07:13:21.923054+0000 b25115 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@5},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ad40100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d8f:[<0x1000000039e/article-75.xml v1419>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000d8f:[<0x1000000039e/article-75.xml v1493>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.026 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.832+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000402 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-37.xml auth v1110 ap=1 s=26928 n(v0 rc2024-09-19T07:13:13.426260+0000 b26928 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad40680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000402:[<0x1000000039e/article-37.xml v1110>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000402:[<0x1000000039e/article-37.xml v1110>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.026 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000692 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-37.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.026 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001103 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-8.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.026 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000073e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-27.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.026 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000119a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-31.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.026 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000626 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-73.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.026 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011d5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-8.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.026 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000068c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-39.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.027 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010bd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-21.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.027 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000110f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-6.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.027 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000694 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-36.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.027 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001124 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-2.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.027 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010e8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-13.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.027 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000072e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-1.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.027 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011a0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-29.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.027 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011dc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-5.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.027 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000006e3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-12.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.028 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.833+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000527 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-27.jpg auth v1142 ap=1 s=28945 n(v0 rc2024-09-19T07:13:13.928248+0000 b28945 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad40c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000527:[<0x1000000039e/picture-27.jpg v1142>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000527:[<0x1000000039e/picture-27.jpg v1142>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.028 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.833+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003af [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-73.xml auth v1138 ap=1 s=4882 n(v0 rc2024-09-19T07:13:13.216265+0000 b4882 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@4},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad41180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003af:[<0x1000000039e/article-73.xml v1138>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000003af:[<0x1000000039e/article-73.xml v1138>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.028 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001096 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-28.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.028 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011e0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-3.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.028 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011a9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-26.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.028 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001126 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-30.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.028 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001113 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-5.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001190 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-18.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011cf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-11.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000007fa (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-16.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000108f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-29.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001142 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-40.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010e1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-14.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010b8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-22.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011b1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-23.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000639 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-66.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010f0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-11.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010d8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-16.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.030 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f02 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-87.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.030 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.833+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003fa [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-39.xml auth v1136 ap=1 s=28872 n(v0 rc2024-09-19T07:13:13.412260+0000 b28872 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad41700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003fa:[<0x1000000039e/article-39.xml v1136>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000003fa:[<0x1000000039e/article-39.xml v1136>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.030 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.833+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000404 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-36.xml auth v1126 ap=1 s=22369 n(v0 rc2024-09-19T07:13:13.433259+0000 b22369 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad64000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000404:[<0x1000000039e/article-36.xml v1126>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000404:[<0x1000000039e/article-36.xml v1126>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.030 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.834+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000044c [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-12.xml auth v1112 ap=1 s=10309 n(v0 rc2024-09-19T07:13:13.571256+0000 b10309 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad64580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000044c:[<0x1000000039e/article-12.xml v1112>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000044c:[<0x1000000039e/article-12.xml v1112>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.031 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010a1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-26.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.031 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001052 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-49.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.031 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001139 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-41.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.031 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010a6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-42.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.031 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011c7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-15.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.031 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ffb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-65.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.031 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011b4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-22.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.031 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010f7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-10.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.031 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011c6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-12.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.031 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011cd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-12.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.031 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000006c1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-23.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.032 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001119 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-4.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.032 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000009b5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-100.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.032 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010a8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-25.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.032 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000644 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-63.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.032 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011b7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-21.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.032 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.834+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004dc [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-52.jpg auth v1122 ap=1 s=56323 n(v0 rc2024-09-19T07:13:13.796251+0000 b56323 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad64b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004dc:[<0x1000000039e/picture-52.jpg v1122>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000004dc:[<0x1000000039e/picture-52.jpg v1122>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.032 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.834+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000046d [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-1.xml auth{0=1} v1456 ap=1 s=15847 n(v0 rc2024-09-19T07:13:13.620255+0000 b15847 1=1+0) caps={24793=pAsLsXsFscr/pFscr@2} mcw={0=Fscr} | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c35ad65080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000046d:[<0x1000000039e/article-1.xml v1144>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000046d:[<0x1000000039e/article-1.xml v1456>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.033 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.834+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d0a [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-30.xml auth v1505 ap=1 s=4011 n(v0 rc2024-09-19T07:13:21.066075+0000 b4011 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ad65600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d0a:[<0x1000000039e/comment-30.xml v1359>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000d0a:[<0x1000000039e/comment-30.xml v1505>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.033 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.835+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000513 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-34.jpg auth v1128 ap=1 s=56981 n(v0 rc2024-09-19T07:13:13.893248+0000 b56981 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad65b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000513:[<0x1000000039e/picture-34.jpg v1128>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000513:[<0x1000000039e/picture-34.jpg v1128>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.033 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000103b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-51.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.033 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000119d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-30.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.033 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010de (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-15.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.033 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000116c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-36.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.033 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000629 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-72.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.033 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010c8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-19.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.034 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000078a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-21.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.034 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000698 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-35.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.034 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011ba (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-20.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.034 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000fd4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-73.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.034 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001158 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-38.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.034 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000dc7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-96.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.034 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001013 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-60.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.034 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000fb1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-78.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.034 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000689 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-40.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.034 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ef3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-88.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.034 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000006da (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-15.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.035 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.835+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004da [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-53.jpg auth v1114 ap=1 s=40449 n(v0 rc2024-09-19T07:13:13.791251+0000 b40449 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad66100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004da:[<0x1000000039e/picture-53.jpg v1114>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000004da:[<0x1000000039e/picture-53.jpg v1114>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.035 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.835+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004af [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-67.jpg auth v1158 ap=1 s=50108 n(v0 rc2024-09-19T07:13:13.728252+0000 b50108 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad66680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004af:[<0x1000000039e/picture-67.jpg v1158>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000004af:[<0x1000000039e/picture-67.jpg v1158>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.035 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.835+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000da3 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-3.xml auth v1495 ap=1 s=9208 n(v0 rc2024-09-19T07:13:22.009052+0000 b9208 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ad66c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000da3:[<0x1000000039e/comment-3.xml v1449>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000da3:[<0x1000000039e/comment-3.xml v1495>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.035 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.835+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d94 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-18.xml auth v1499 ap=1 s=9511 n(v0 rc2024-09-19T07:13:21.937054+0000 b9511 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ad67180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d94:[<0x1000000039e/comment-18.xml v1430>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000d94:[<0x1000000039e/comment-18.xml v1499>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.035 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.835+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003bd [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-66.xml auth v1100 ap=1 s=4098 n(v0 rc2024-09-19T07:13:13.246264+0000 b4098 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad67700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003bd:[<0x1000000039e/article-66.xml v1100>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000003bd:[<0x1000000039e/article-66.xml v1100>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.036 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f9f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-79.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.036 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010c2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-40.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.036 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010cb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-39.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.036 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f0a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-86.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.036 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010f9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-33.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.036 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000006ce (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-19.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.036 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000079a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-20.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.036 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f71 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-82.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.036 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001107 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-32.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.037 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001007 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-63.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.037 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000102b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-54.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.037 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f41 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-42.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.037 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000e97 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-91.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.037 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f81 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-81.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.037 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000012ab (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-10.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.037 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000dee (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.038 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.836+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003a3 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-77.xml auth v1096 ap=1 s=5429 n(v0 rc2024-09-19T07:13:13.200265+0000 b5429 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad6e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003a3:[<0x1000000039e/article-77.xml v1096>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000003a3:[<0x1000000039e/article-77.xml v1096>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.038 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.836+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000543 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-16.jpg auth v1124 ap=1 s=33578 n(v0 rc2024-09-19T07:13:13.979246+0000 b33578 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad6e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000543:[<0x1000000039e/picture-16.jpg v1124>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000543:[<0x1000000039e/picture-16.jpg v1124>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.038 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.837+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d9a [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-12.xml auth v1501 ap=1 s=8067 n(v0 rc2024-09-19T07:13:21.966053+0000 b8067 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ad6eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d9a:[<0x1000000039e/comment-12.xml v1446>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000d9a:[<0x1000000039e/comment-12.xml v1501>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.038 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.837+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000049a [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-74.jpg auth v1118 ap=1 s=18712 n(v0 rc2024-09-19T07:13:13.687253+0000 b18712 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@4},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad6f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000049a:[<0x1000000039e/picture-74.jpg v1118>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000049a:[<0x1000000039e/picture-74.jpg v1118>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.038 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.837+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cd3 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-49.xml auth v1491 ap=1 s=8447 n(v0 rc2024-09-19T07:13:20.880079+0000 b8447 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ad6f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cd3:[<0x1000000039e/comment-49.xml v1322>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000cd3:[<0x1000000039e/comment-49.xml v1491>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.038 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000102f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-53.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.038 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000008e7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-11.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.039 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f1b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-85.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.039 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000070a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-5.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.039 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000069a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-34.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.039 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010eb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-35.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.039 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001136 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-28.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.039 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000617 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-81.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.039 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000101f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-57.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.039 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000006a9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-29.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.039 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000061c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-78.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.039 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000064d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-60.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.039 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000100f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-61.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.040 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000006c5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-22.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.040 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010d2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-38.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.040 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000fef (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-68.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.040 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000066d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-49.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.040 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.837+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ce8 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-42.xml auth v1507 ap=1 s=6578 n(v0 rc2024-09-19T07:13:20.943078+0000 b6578 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ad70100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ce8:[<0x1000000039e/comment-42.xml v1331>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ce8:[<0x1000000039e/comment-42.xml v1507>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.040 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.837+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000042b [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-23.xml auth v1108 ap=1 s=22499 n(v0 rc2024-09-19T07:13:13.522257+0000 b22499 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad70c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000042b:[<0x1000000039e/article-23.xml v1108>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000042b:[<0x1000000039e/article-23.xml v1108>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.040 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.838+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000043d [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-17.xml auth v1156 ap=1 s=14409 n(v0 rc2024-09-19T07:13:13.549257+0000 b14409 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad71180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000043d:[<0x1000000039e/article-17.xml v1156>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000043d:[<0x1000000039e/article-17.xml v1156>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.041 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.838+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000494 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-76.jpg auth v1106 ap=1 s=24278 n(v0 rc2024-09-19T07:13:13.678254+0000 b24278 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@4},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad71700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000494:[<0x1000000039e/picture-76.jpg v1106>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000494:[<0x1000000039e/picture-76.jpg v1106>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.041 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.838+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000518 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-32.jpg auth v1140 ap=1 s=10752 n(v0 rc2024-09-19T07:13:13.903248+0000 b10752 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad7c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000518:[<0x1000000039e/picture-32.jpg v1140>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000518:[<0x1000000039e/picture-32.jpg v1140>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.041 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f95 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-80.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.041 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000116f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-22.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.041 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001085 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-44.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.041 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000067f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-43.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.041 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000069e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-33.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.041 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000e3f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-93.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.042 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000a90 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-5.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.042 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000fbb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-76.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.042 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000113d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-27.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.042 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000656 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-57.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.042 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ff7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-66.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.042 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001036 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-52.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.042 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000061a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-79.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.042 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011a6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-15.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.042 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000652 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-58.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.042 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001094 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-43.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.043 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.838+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c3 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-63.xml auth v1102 ap=1 s=2591 n(v0 rc2024-09-19T07:13:13.262264+0000 b2591 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad7c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003c3:[<0x1000000039e/article-63.xml v1102>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000003c3:[<0x1000000039e/article-63.xml v1102>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.043 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.838+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004e8 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-48.jpg auth v1146 ap=1 s=22726 n(v0 rc2024-09-19T07:13:13.814250+0000 b22726 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad7cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004e8:[<0x1000000039e/picture-48.jpg v1146>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000004e8:[<0x1000000039e/picture-48.jpg v1146>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.043 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.839+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ccd [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-51.xml auth v1509 ap=1 s=6188 n(v0 rc2024-09-19T07:13:20.861080+0000 b6188 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ad7d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ccd:[<0x1000000039e/comment-51.xml v1317>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ccd:[<0x1000000039e/comment-51.xml v1509>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.043 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.839+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003b1 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-72.xml auth v1137 ap=1 s=8690 n(v0 rc2024-09-19T07:13:13.219265+0000 b8690 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35b041080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003b1:[<0x1000000039e/article-72.xml v1137>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000003b1:[<0x1000000039e/article-72.xml v1137>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.043 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000662 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-53.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.044 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001195 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-17.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.044 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000006ae (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-28.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.044 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000012b4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-9.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.044 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000009d2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-99.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.044 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001079 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-45.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.044 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f29 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-84.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.044 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000065b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-55.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.044 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000074f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-25.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.044 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000a6f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-97.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.044 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000006f8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-8.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.044 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001063 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-47.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.045 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001070 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-46.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.045 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000007b1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-68.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.045 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000fe1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-70.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.045 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000620 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-76.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.045 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000009b8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-8.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.046 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.840+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000049d [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-73.jpg auth v1131 ap=1 s=39822 n(v0 rc2024-09-19T07:13:13.691253+0000 b39822 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35b041600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000049d:[<0x1000000039e/picture-73.jpg v1131>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000049d:[<0x1000000039e/picture-73.jpg v1131>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.046 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.840+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000539 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-21.jpg auth v1149 ap=1 s=49463 n(v0 rc2024-09-19T07:13:13.957247+0000 b49463 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35b041b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000539:[<0x1000000039e/picture-21.jpg v1149>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000539:[<0x1000000039e/picture-21.jpg v1149>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.046 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.840+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000407 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-35.xml auth v1106 ap=1 s=12797 n(v0 rc2024-09-19T07:13:13.441259+0000 b12797 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35b042100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000407:[<0x1000000039e/article-35.xml v1106>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000407:[<0x1000000039e/article-35.xml v1106>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.046 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.842+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000497 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-75.jpg auth v1125 ap=1 s=44471 n(v0 rc2024-09-19T07:13:13.682253+0000 b44471 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@4},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35b043180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000497:[<0x1000000039e/picture-75.jpg v1125>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000497:[<0x1000000039e/picture-75.jpg v1125>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.046 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.842+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000da5 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-1.xml auth{0=1} v1518 ap=1 s=5148 n(v0 rc2024-09-19T07:13:22.018052+0000 b5148 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@2},l=24793 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c35b04e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000da5:[<0x1000000039e/comment-1.xml v1453>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000da5:[<0x1000000039e/comment-1.xml v1518>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.046 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.842+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003f8 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-40.xml auth v1104 ap=1 s=26700 n(v0 rc2024-09-19T07:13:13.405260+0000 b26700 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35b04e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003f8:[<0x1000000039e/article-40.xml v1104>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000003f8:[<0x1000000039e/article-40.xml v1104>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.046 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.843+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000051f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-30.jpg auth v1157 ap=1 s=37246 n(v0 rc2024-09-19T07:13:13.913248+0000 b37246 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35b04eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000051f:[<0x1000000039e/picture-30.jpg v1157>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000051f:[<0x1000000039e/picture-30.jpg v1157>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.047 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000747 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-26.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.047 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000a56 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-98.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.047 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000006a0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-32.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.047 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f3d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-83.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.047 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000fec (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-69.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.047 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ef0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-89.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.047 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000006c8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-21.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.047 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000006a7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-30.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.047 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000fcf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-74.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.047 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010e4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-36.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.048 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000006e0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-13.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.048 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001001 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-64.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.048 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000fd8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-72.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.048 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000066b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-50.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.048 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f86 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-6.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.048 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000722 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-2.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.048 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011af (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-14.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.049 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.843+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000443 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-15.xml auth v1108 ap=1 s=16429 n(v0 rc2024-09-19T07:13:13.558256+0000 b16429 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35b04f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000443:[<0x1000000039e/article-15.xml v1108>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000443:[<0x1000000039e/article-15.xml v1108>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.049 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.843+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cee [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-40.xml auth v1512 ap=1 s=6533 n(v0 rc2024-09-19T07:13:20.961078+0000 b6533 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35b050100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cee:[<0x1000000039e/comment-40.xml v1336>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000cee:[<0x1000000039e/comment-40.xml v1512>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.049 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.843+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d02 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-33.xml auth v1520 ap=1 s=7487 n(v0 rc2024-09-19T07:13:21.032076+0000 b7487 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35b050680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d02:[<0x1000000039e/comment-33.xml v1348>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000d02:[<0x1000000039e/comment-33.xml v1520>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.049 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.844+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cf1 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-39.xml auth v1528 ap=1 s=8789 n(v0 rc2024-09-19T07:13:20.971077+0000 b8789 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35b050c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cf1:[<0x1000000039e/comment-39.xml v1340>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000cf1:[<0x1000000039e/comment-39.xml v1528>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.049 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.844+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000050d [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-36.jpg auth v1113 ap=1 s=59917 n(v0 rc2024-09-19T07:13:13.884249+0000 b59917 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35b051700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000050d:[<0x1000000039e/picture-36.jpg v1113>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000050d:[<0x1000000039e/picture-36.jpg v1113>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.049 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.844+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004f7 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-43.jpg auth v1155 ap=1 s=39960 n(v0 rc2024-09-19T07:13:13.837250+0000 b39960 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35b05a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004f7:[<0x1000000039e/picture-43.jpg v1155>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000004f7:[<0x1000000039e/picture-43.jpg v1155>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.050 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.844+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000437 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-19.xml auth v1129 ap=1 s=31229 n(v0 rc2024-09-19T07:13:13.540257+0000 b31229 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35b05a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000437:[<0x1000000039e/article-19.xml v1129>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000437:[<0x1000000039e/article-19.xml v1129>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.050 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ff3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-67.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.050 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001186 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-19.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.050 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000659 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-56.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.050 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000619 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-80.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.050 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010db (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-37.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.050 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000fdd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-71.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.050 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000008f7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-10.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.051 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000de8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-95.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.051 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000e56 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.051 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000119b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-16.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.051 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000006f2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-9.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.051 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000fa2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-44.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.051 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000a60 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-6.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.051 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000063a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-65.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.051 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000007c1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-99.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.051 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000101b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-58.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.052 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.844+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000053c [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-20.jpg auth v1133 ap=1 s=57398 n(v0 rc2024-09-19T07:13:13.964247+0000 b57398 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35b05ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000053c:[<0x1000000039e/picture-20.jpg v1133>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000053c:[<0x1000000039e/picture-20.jpg v1133>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.052 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.845+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d04 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-32.xml auth v1516 ap=1 s=4514 n(v0 rc2024-09-19T07:13:21.045075+0000 b4514 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35b05b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d04:[<0x1000000039e/comment-32.xml v1351>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000d04:[<0x1000000039e/comment-32.xml v1516>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.052 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.845+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cc4 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-54.xml auth v1530 ap=1 s=5828 n(v0 rc2024-09-19T07:13:20.834081+0000 b5828 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35b05c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cc4:[<0x1000000039e/comment-54.xml v1314>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000cc4:[<0x1000000039e/comment-54.xml v1530>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.052 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.845+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003f3 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-42.xml auth v1139 ap=1 s=3671 n(v0 rc2024-09-19T07:13:13.393260+0000 b3671 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35b05c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003f3:[<0x1000000039e/article-42.xml v1139>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000003f3:[<0x1000000039e/article-42.xml v1139>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.052 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.845+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000506 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-38.jpg auth v1153 ap=1 s=10239 n(v0 rc2024-09-19T07:13:13.871249+0000 b10239 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35b05d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000506:[<0x1000000039e/picture-38.jpg v1153>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000506:[<0x1000000039e/picture-38.jpg v1153>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.053 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.845+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d9c [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-10.xml auth v1513 ap=1 s=6401 n(v0 rc2024-09-19T07:13:21.977053+0000 b6401 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae4c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d9c:[<0x1000000039e/comment-10.xml v1422>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000d9c:[<0x1000000039e/comment-10.xml v1513>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.053 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.846+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cc7 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-53.xml auth v1501 ap=1 s=6065 n(v0 rc2024-09-19T07:13:20.843080+0000 b6065 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae4d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cc7:[<0x1000000039e/comment-53.xml v1319>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000cc7:[<0x1000000039e/comment-53.xml v1501>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.053 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.846+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000da0 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-6.xml auth{0=1} v1447 ap=1 s=7283 n(v0 rc2024-09-19T07:13:21.995053+0000 b7283 1=1+0) caps={24793=pAsLsXsFscr/pFscr@4} mcw={0=Fscr} | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c35ae4d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000da0:[<0x1000000039e/comment-6.xml v1436>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000da0:[<0x1000000039e/comment-6.xml v1447>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.053 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000647 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-62.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.053 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000006be (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-24.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.053 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001027 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-55.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.053 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010f3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-34.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.054 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000114f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-25.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.054 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010b1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-41.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.054 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000637 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-67.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.054 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000fc0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-75.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.054 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000007e3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-17.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.054 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000071a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-3.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.054 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000759 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-24.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.054 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000006fe (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-7.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.054 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001164 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-23.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.054 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000115c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-24.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.054 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000650 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-59.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.055 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000833 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-13.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.055 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001021 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-56.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.055 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.846+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005a5 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-3.jpg auth{0=1} v1120 ap=1 s=53498 n(v0 rc2024-09-19T07:13:14.714229+0000 b53498 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=24793 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c35ae4cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005a5:[<0x1000000039e/picture-3.jpg v1120>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000005a5:[<0x1000000039e/picture-3.jpg v1120>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.055 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.846+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004d3 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-55.jpg auth v1126 ap=1 s=38747 n(v0 rc2024-09-19T07:13:13.782251+0000 b38747 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ae4db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004d3:[<0x1000000039e/picture-55.jpg v1126>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000004d3:[<0x1000000039e/picture-55.jpg v1126>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.055 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.846+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d8e [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-11.jpg auth v1507 ap=1 s=18839 n(v0 rc2024-09-19T07:13:21.918054+0000 b18839 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae4e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d8e:[<0x1000000039e/picture-11.jpg v1415>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000d8e:[<0x1000000039e/picture-11.jpg v1507>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.056 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.846+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004a6 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-70.jpg auth v1112 ap=1 s=15161 n(v0 rc2024-09-19T07:13:13.707253+0000 b15161 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@4},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ae4ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004a6:[<0x1000000039e/picture-70.jpg v1112>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000004a6:[<0x1000000039e/picture-70.jpg v1112>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.056 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.846+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000461 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-5.xml auth{0=1} v1445 ap=1 s=11367 n(v0 rc2024-09-19T07:13:13.602255+0000 b11367 1=1+0) caps={24793=pAsLsXsFscr/pFscr@2} mcw={0=Fscr} | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c35ae4f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000461:[<0x1000000039e/article-5.xml v1152>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000461:[<0x1000000039e/article-5.xml v1445>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.056 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.847+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000040a [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-34.xml auth v1136 ap=1 s=15560 n(v0 rc2024-09-19T07:13:13.448259+0000 b15560 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ae4f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000040a:[<0x1000000039e/article-34.xml v1136>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000040a:[<0x1000000039e/article-34.xml v1136>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.056 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.847+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cfd [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-35.xml auth v1511 ap=1 s=2175 n(v0 rc2024-09-19T07:13:21.010076+0000 b2175 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35aabe000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cfd:[<0x1000000039e/comment-35.xml v1344>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000cfd:[<0x1000000039e/comment-35.xml v1511>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.056 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000624 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-74.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.056 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000007c8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-18.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.056 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000006d1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-18.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.056 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000007ae (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-19.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.057 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000667 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-51.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.057 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000112d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-29.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.057 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000006b3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-27.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.057 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000dd0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-4.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.057 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000e19 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.057 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000006ca (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-20.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.057 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000064a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-61.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.057 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000685 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-41.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.057 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000679 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-45.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.057 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000632 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-69.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.057 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000e09 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-94.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.058 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000a4e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-7.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.058 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.847+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d10 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-28.xml auth v1515 ap=1 s=9485 n(v0 rc2024-09-19T07:13:21.100074+0000 b9485 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35aabe580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d10:[<0x1000000039e/comment-28.xml v1352>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000d10:[<0x1000000039e/comment-28.xml v1515>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.058 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.847+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cbb [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-57.xml auth v1519 ap=1 s=7287 n(v0 rc2024-09-19T07:13:20.807081+0000 b7287 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35aabeb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cbb:[<0x1000000039e/comment-57.xml v1311>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000cbb:[<0x1000000039e/comment-57.xml v1519>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.058 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.847+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000039f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-78.xml auth v1108 ap=1 s=19156 n(v0 rc2024-09-19T07:13:13.197265+0000 b19156 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@4},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35aabf080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000039f:[<0x1000000039e/article-78.xml v1108>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000039f:[<0x1000000039e/article-78.xml v1108>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.058 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.847+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004a3 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-71.jpg auth v1110 ap=1 s=31319 n(v0 rc2024-09-19T07:13:13.700253+0000 b31319 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@4},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35aabf600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004a3:[<0x1000000039e/picture-71.jpg v1110>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000004a3:[<0x1000000039e/picture-71.jpg v1110>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.059 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.847+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000419 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-29.xml auth v1114 ap=1 s=20823 n(v0 rc2024-09-19T07:13:13.483258+0000 b20823 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35aabfb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000419:[<0x1000000039e/article-29.xml v1114>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000419:[<0x1000000039e/article-29.xml v1114>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.059 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.847+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c9 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-60.xml auth v1134 ap=1 s=6281 n(v0 rc2024-09-19T07:13:13.281263+0000 b6281 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35aac0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003c9:[<0x1000000039e/article-60.xml v1134>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000003c9:[<0x1000000039e/article-60.xml v1134>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.059 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.848+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004bc [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-63.jpg auth v1154 ap=1 s=32742 n(v0 rc2024-09-19T07:13:13.746252+0000 b32742 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35aac0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004bc:[<0x1000000039e/picture-63.jpg v1154>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000004bc:[<0x1000000039e/picture-63.jpg v1154>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.059 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000006a3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-31.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.059 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011e5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-11.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.059 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001181 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-20.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.059 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ed3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-13.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.059 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000e99 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-18.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.060 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000e83 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-27.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.060 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ee8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-4.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.060 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000eef (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.060 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000e94 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-20.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.060 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ed1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-14.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.060 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ee1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-7.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.060 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000edc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-9.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.060 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ef2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.060 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000eb4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-9.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.060 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ee3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-6.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.060 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000e8a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-24.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.060 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000012e0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-92.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.061 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.848+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000501 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-40.jpg auth v1156 ap=1 s=37212 n(v0 rc2024-09-19T07:13:13.856249+0000 b37212 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35aac0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000501:[<0x1000000039e/picture-40.jpg v1156>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000501:[<0x1000000039e/picture-40.jpg v1156>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.061 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.848+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cf4 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-38.xml auth v1517 ap=1 s=8101 n(v0 rc2024-09-19T07:13:20.981077+0000 b8101 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae56000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cf4:[<0x1000000039e/comment-38.xml v1334>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000cf4:[<0x1000000039e/comment-38.xml v1517>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.061 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.848+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007dd [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-22.xml auth v1160 ap=1 s=11026 n(v0 rc2024-09-19T07:13:16.376188+0000 b11026 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35aac1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007dd:[<0x1000000039e/article-22.xml v1160>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000007dd:[<0x1000000039e/article-22.xml v1160>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.061 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.848+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000473 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-87.jpg auth v1138 ap=1 s=41730 n(v0 rc2024-09-19T07:13:13.629255+0000 b41730 1=1+0) caps={24793=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ae56b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000473:[<0x1000000039e/picture-87.jpg v1138>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000473:[<0x1000000039e/picture-87.jpg v1138>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.061 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.848+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000047c [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-84.jpg auth v1128 ap=1 s=62836 n(v0 rc2024-09-19T07:13:13.642254+0000 b62836 1=1+0) caps={24793=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ae57080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000047c:[<0x1000000039e/picture-84.jpg v1128>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000047c:[<0x1000000039e/picture-84.jpg v1128>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.062 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.849+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d9e [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-8.xml auth v1505 ap=1 s=8073 n(v0 rc2024-09-19T07:13:21.986053+0000 b8073 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae57b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d9e:[<0x1000000039e/comment-8.xml v1431>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000d9e:[<0x1000000039e/comment-8.xml v1505>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.062 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.849+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d1c [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-22.xml auth v1497 ap=1 s=7222 n(v0 rc2024-09-19T07:13:21.145073+0000 b7222 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35aed4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d1c:[<0x1000000039e/comment-22.xml v1372>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000d1c:[<0x1000000039e/comment-22.xml v1497>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.062 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.849+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000da4 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-2.xml auth{0=1} v1503 ap=1 s=6458 n(v0 rc2024-09-19T07:13:22.013052+0000 b6458 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@2},l=24793 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c35ac42000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000da4:[<0x1000000039e/comment-2.xml v1448>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000da4:[<0x1000000039e/comment-2.xml v1503>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.062 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.849+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000476 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-86.jpg auth v1113 ap=1 s=51063 n(v0 rc2024-09-19T07:13:13.633255+0000 b51063 1=1+0) caps={24793=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac42580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000476:[<0x1000000039e/picture-86.jpg v1113>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000476:[<0x1000000039e/picture-86.jpg v1113>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.062 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ec9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-17.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.062 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ec2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-3.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.062 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000eb9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-7.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.062 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000eb6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-8.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.062 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000edf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-8.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.063 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000e7c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-30.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.063 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000eab (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-13.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.063 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ebb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-6.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.063 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ec5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-2.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.063 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ee6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-5.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.063 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000e81 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-28.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.063 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000eeb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.063 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ed8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-11.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.063 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ebe (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-5.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.063 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000e7e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-29.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.063 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011a5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-27.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.064 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.850+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003f1 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-43.xml auth v1141 ap=1 s=24381 n(v0 rc2024-09-19T07:13:13.387261+0000 b24381 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac43080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003f1:[<0x1000000039e/article-43.xml v1141>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000003f1:[<0x1000000039e/article-43.xml v1141>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.064 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.850+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ce2 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-44.xml auth v1483 ap=1 s=3016 n(v0 rc2024-09-19T07:13:20.925078+0000 b3016 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ac42b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ce2:[<0x1000000039e/comment-44.xml v1329>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ce2:[<0x1000000039e/comment-44.xml v1483>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.064 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.850+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000040e [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-33.xml auth v1093 ap=1 s=26058 n(v0 rc2024-09-19T07:13:13.454259+0000 b26058 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac43600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000040e:[<0x1000000039e/article-33.xml v1093>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000040e:[<0x1000000039e/article-33.xml v1093>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.064 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.850+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000db9 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-81.jpg auth v1501 ap=1 s=37999 n(v0 rc2024-09-19T07:13:22.191048+0000 b37999 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ac43b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000db9:[<0x1000000039e/picture-81.jpg v1451>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000db9:[<0x1000000039e/picture-81.jpg v1501>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.064 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.850+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005a1 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-5.jpg auth{0=1} v1105 ap=1 s=29895 n(v0 rc2024-09-19T07:13:14.701229+0000 b29895 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=24793 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c35ac44100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005a1:[<0x1000000039e/picture-5.jpg v1105>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000005a1:[<0x1000000039e/picture-5.jpg v1105>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.064 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.850+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d12 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-27.xml auth v1487 ap=1 s=4345 n(v0 rc2024-09-19T07:13:21.109074+0000 b4345 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ac44680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d12:[<0x1000000039e/comment-27.xml v1356>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000d12:[<0x1000000039e/comment-27.xml v1487>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.064 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.851+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004e2 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-50.jpg auth v1147 ap=1 s=18137 n(v0 rc2024-09-19T07:13:13.805250+0000 b18137 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac44c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004e2:[<0x1000000039e/picture-50.jpg v1147>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000004e2:[<0x1000000039e/picture-50.jpg v1147>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.065 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010ed (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-12.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.065 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000112a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-1.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.065 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000117e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-34.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.065 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011c4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-16.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.065 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010b3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-23.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.065 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010d4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-17.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.065 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000118a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-32.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.065 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000de2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-2.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.065 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000081c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-14.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.065 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000062f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-70.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.066 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000dcf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-92.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.066 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000dbb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-9.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.066 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000e74 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-92.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.066 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000e91 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-21.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.066 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000e8f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-22.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.066 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000dd2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-3.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.066 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ea7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-14.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.067 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.851+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007d7 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-58.jpg auth v1119 ap=1 s=47393 n(v0 rc2024-09-19T07:13:16.359189+0000 b47393 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ac45700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007d7:[<0x1000000039e/picture-58.jpg v1119>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000007d7:[<0x1000000039e/picture-58.jpg v1119>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.067 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.851+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003cf [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-57.xml auth v1125 ap=1 s=30983 n(v0 rc2024-09-19T07:13:13.302263+0000 b30983 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ae3a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003cf:[<0x1000000039e/article-57.xml v1125>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000003cf:[<0x1000000039e/article-57.xml v1125>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.067 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.851+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cca [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-52.xml auth v1485 ap=1 s=7547 n(v0 rc2024-09-19T07:13:20.852080+0000 b7547 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae3a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cca:[<0x1000000039e/comment-52.xml v1323>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000cca:[<0x1000000039e/comment-52.xml v1485>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.067 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.851+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004b5 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-65.jpg auth v1123 ap=1 s=61854 n(v0 rc2024-09-19T07:13:13.737252+0000 b61854 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@4},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ae3b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004b5:[<0x1000000039e/picture-65.jpg v1123>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000004b5:[<0x1000000039e/picture-65.jpg v1123>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.067 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.852+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d9f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-7.xml auth{0=1} v1456 ap=1 s=8123 n(v0 rc2024-09-19T07:13:21.991053+0000 b8123 1=1+0) caps={24793=pAsLsXsFscr/pFscr@4} mcw={0=Fscr} | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c35ae3b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d9f:[<0x1000000039e/comment-7.xml v1440>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000d9f:[<0x1000000039e/comment-7.xml v1456>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.067 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000dc1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-7.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.067 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000012e6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-71.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.067 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000dbe (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-8.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.067 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000eaf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-11.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.068 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ea0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-16.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.068 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000e85 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-26.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.068 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ece (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-15.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.068 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000dae (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-13.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.068 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000eb2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-10.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.068 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000dc4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-6.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.068 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ed5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-12.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.068 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000dd6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-2.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.068 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ec0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-4.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.068 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000e88 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-25.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.068 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000dd4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-56.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.068 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000e96 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-19.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.069 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.852+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d97 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-15.xml auth v1481 ap=1 s=8059 n(v0 rc2024-09-19T07:13:21.953054+0000 b8059 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae3bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d97:[<0x1000000039e/comment-15.xml v1413>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000d97:[<0x1000000039e/comment-15.xml v1481>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.069 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.852+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003cd [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-58.xml auth v1139 ap=1 s=22299 n(v0 rc2024-09-19T07:13:13.295263+0000 b22299 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ae3c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003cd:[<0x1000000039e/article-58.xml v1139>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000003cd:[<0x1000000039e/article-58.xml v1139>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.069 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.852+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003d7 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-53.xml auth v1129 ap=1 s=31908 n(v0 rc2024-09-19T07:13:13.322262+0000 b31908 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ae3c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003d7:[<0x1000000039e/article-53.xml v1129>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000003d7:[<0x1000000039e/article-53.xml v1129>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.069 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ead (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-12.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.069 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ec7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-1.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.069 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ecc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-16.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.069 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000e9c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-17.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.070 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000e8d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-23.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.070 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:46.070 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ddf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-3.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.070 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000dc8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-5.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.075 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.852+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ce5 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-43.xml auth v1489 ap=1 s=4279 n(v0 rc2024-09-19T07:13:20.934078+0000 b4279 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae3cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ce5:[<0x1000000039e/comment-43.xml v1332>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ce5:[<0x1000000039e/comment-43.xml v1489>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.075 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.852+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d95 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-17.xml auth v1479 ap=1 s=10010 n(v0 rc2024-09-19T07:13:21.944054+0000 b10010 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ae3d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d95:[<0x1000000039e/comment-17.xml v1410>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000d95:[<0x1000000039e/comment-17.xml v1479>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.076 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.852+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d9d [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-9.xml auth v1499 ap=1 s=2573 n(v0 rc2024-09-19T07:13:21.981053+0000 b2573 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ad92000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d9d:[<0x1000000039e/comment-9.xml v1426>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000d9d:[<0x1000000039e/comment-9.xml v1499>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.076 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.852+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000041c [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-28.xml auth v1091 ap=1 s=27118 n(v0 rc2024-09-19T07:13:13.490258+0000 b27118 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ae3d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000041c:[<0x1000000039e/article-28.xml v1091>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000041c:[<0x1000000039e/article-28.xml v1091>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.076 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.852+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003d9 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-52.xml auth v1107 ap=1 s=27855 n(v0 rc2024-09-19T07:13:13.327262+0000 b27855 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad92580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003d9:[<0x1000000039e/article-52.xml v1107>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000003d9:[<0x1000000039e/article-52.xml v1107>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.076 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.853+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000491 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-77.jpg auth v1101 ap=1 s=38750 n(v0 rc2024-09-19T07:13:13.673254+0000 b38750 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad92b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000491:[<0x1000000039e/picture-77.jpg v1101>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000491:[<0x1000000039e/picture-77.jpg v1101>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.076 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.853+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004a9 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-69.jpg auth v1103 ap=1 s=39685 n(v0 rc2024-09-19T07:13:13.716253+0000 b39685 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad93080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004a9:[<0x1000000039e/picture-69.jpg v1103>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000004a9:[<0x1000000039e/picture-69.jpg v1103>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.076 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.853+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004df [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-51.jpg auth v1151 ap=1 s=14807 n(v0 rc2024-09-19T07:13:13.800251+0000 b14807 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad93600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004df:[<0x1000000039e/picture-51.jpg v1151>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000004df:[<0x1000000039e/picture-51.jpg v1151>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.076 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.853+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cdf [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-45.xml auth v1505 ap=1 s=10017 n(v0 rc2024-09-19T07:13:20.915079+0000 b10017 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ad93b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cdf:[<0x1000000039e/comment-45.xml v1326>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000cdf:[<0x1000000039e/comment-45.xml v1505>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.076 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.853+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004be [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-62.jpg auth v1095 ap=1 s=32964 n(v0 rc2024-09-19T07:13:13.750252+0000 b32964 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad94100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004be:[<0x1000000039e/picture-62.jpg v1095>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000004be:[<0x1000000039e/picture-62.jpg v1095>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.076 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.853+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004ef [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-46.jpg auth v1115 ap=1 s=16081 n(v0 rc2024-09-19T07:13:13.823250+0000 b16081 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad94c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004ef:[<0x1000000039e/picture-46.jpg v1115>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000004ef:[<0x1000000039e/picture-46.jpg v1115>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.076 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.854+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004b8 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-64.jpg auth v1116 ap=1 s=43133 n(v0 rc2024-09-19T07:13:13.741252+0000 b43133 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@4},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad7db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004b8:[<0x1000000039e/picture-64.jpg v1116>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000004b8:[<0x1000000039e/picture-64.jpg v1116>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.076 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.854+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cf7 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-37.xml auth v1509 ap=1 s=8668 n(v0 rc2024-09-19T07:13:20.991077+0000 b8668 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ad7e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cf7:[<0x1000000039e/comment-37.xml v1337>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000cf7:[<0x1000000039e/comment-37.xml v1509>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.077 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.854+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000595 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-10.jpg auth v1122 ap=1 s=62884 n(v0 rc2024-09-19T07:13:14.662230+0000 b62884 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad7ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000595:[<0x1000000039e/picture-10.jpg v1122>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000595:[<0x1000000039e/picture-10.jpg v1122>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.077 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.854+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005aa [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-1.jpg auth{0=1} v1140 ap=1 s=59398 n(v0 rc2024-09-19T07:13:14.727228+0000 b59398 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=24793 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c35ad7f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005aa:[<0x1000000039e/picture-1.jpg v1140>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000005aa:[<0x1000000039e/picture-1.jpg v1140>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.077 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.854+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d96 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-16.xml auth v1519 ap=1 s=3204 n(v0 rc2024-09-19T07:13:21.948054+0000 b3204 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ad7f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d96:[<0x1000000039e/comment-16.xml v1436>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000d96:[<0x1000000039e/comment-16.xml v1519>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.077 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.855+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000455 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-9.xml auth v1160 ap=1 s=7793 n(v0 rc2024-09-19T07:13:13.584256+0000 b7793 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad98000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000455:[<0x1000000039e/article-9.xml v1160>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000455:[<0x1000000039e/article-9.xml v1160>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.077 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.855+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000047e [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-83.jpg auth v1112 ap=1 s=41435 n(v0 rc2024-09-19T07:13:13.647254+0000 b41435 1=1+0) caps={24793=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad98580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000047e:[<0x1000000039e/picture-83.jpg v1112>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000047e:[<0x1000000039e/picture-83.jpg v1112>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.077 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.855+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003ef [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-44.xml auth v1114 ap=1 s=13275 n(v0 rc2024-09-19T07:13:13.379261+0000 b13275 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad98b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003ef:[<0x1000000039e/article-44.xml v1114>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000003ef:[<0x1000000039e/article-44.xml v1114>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.077 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.855+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000059f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-6.jpg auth v1120 ap=1 s=58166 n(v0 rc2024-09-19T07:13:14.693229+0000 b58166 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad99080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000059f:[<0x1000000039e/picture-6.jpg v1120>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000059f:[<0x1000000039e/picture-6.jpg v1120>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.077 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.855+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003bf [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-65.xml auth v1118 ap=1 s=28345 n(v0 rc2024-09-19T07:13:13.251264+0000 b28345 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@4},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad99600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003bf:[<0x1000000039e/article-65.xml v1118>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000003bf:[<0x1000000039e/article-65.xml v1118>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.077 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.855+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cb8 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-58.xml auth v1511 ap=1 s=7705 n(v0 rc2024-09-19T07:13:20.797081+0000 b7705 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ad99b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cb8:[<0x1000000039e/comment-58.xml v1308>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000cb8:[<0x1000000039e/comment-58.xml v1511>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.077 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.856+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cc1 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-55.xml auth v1513 ap=1 s=5099 n(v0 rc2024-09-19T07:13:20.825081+0000 b5099 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ad9a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cc1:[<0x1000000039e/comment-55.xml v1315>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000cc1:[<0x1000000039e/comment-55.xml v1513>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.077 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.856+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c5 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-62.xml auth v1128 ap=1 s=13463 n(v0 rc2024-09-19T07:13:13.268263+0000 b13463 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad9a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003c5:[<0x1000000039e/article-62.xml v1128>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000003c5:[<0x1000000039e/article-62.xml v1128>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.078 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.856+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000428 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-24.xml auth v1124 ap=1 s=28899 n(v0 rc2024-09-19T07:13:13.518257+0000 b28899 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ad9ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000428:[<0x1000000039e/article-24.xml v1124>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000428:[<0x1000000039e/article-24.xml v1124>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.078 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.856+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d16 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-25.xml auth v1521 ap=1 s=6102 n(v0 rc2024-09-19T07:13:21.125074+0000 b6102 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ad9b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d16:[<0x1000000039e/comment-25.xml v1364>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000d16:[<0x1000000039e/comment-25.xml v1521>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.078 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.856+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cff [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-34.xml auth v1525 ap=1 s=8570 n(v0 rc2024-09-19T07:13:21.020076+0000 b8570 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ad9b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cff:[<0x1000000039e/comment-34.xml v1346>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000cff:[<0x1000000039e/comment-34.xml v1525>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.078 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.856+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000525 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-28.jpg auth v1136 ap=1 s=34219 n(v0 rc2024-09-19T07:13:13.922248+0000 b34219 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ada2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000525:[<0x1000000039e/picture-28.jpg v1136>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000525:[<0x1000000039e/picture-28.jpg v1136>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.078 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.857+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ceb [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-41.xml auth v1527 ap=1 s=6615 n(v0 rc2024-09-19T07:13:20.952078+0000 b6615 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35ada2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ceb:[<0x1000000039e/comment-41.xml v1330>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ceb:[<0x1000000039e/comment-41.xml v1527>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.078 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.857+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003bb [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-67.xml auth v1158 ap=1 s=9005 n(v0 rc2024-09-19T07:13:13.242264+0000 b9005 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ada2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003bb:[<0x1000000039e/article-67.xml v1158>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000003bb:[<0x1000000039e/article-67.xml v1158>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.078 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.857+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000050a [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-37.jpg auth v1152 ap=1 s=52028 n(v0 rc2024-09-19T07:13:13.878249+0000 b52028 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ada3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000050a:[<0x1000000039e/picture-37.jpg v1152>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000050a:[<0x1000000039e/picture-37.jpg v1152>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.078 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.858+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000479 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-85.jpg auth v1104 ap=1 s=36577 n(v0 rc2024-09-19T07:13:13.638255+0000 b36577 1=1+0) caps={24793=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ada4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000479:[<0x1000000039e/picture-85.jpg v1104>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000479:[<0x1000000039e/picture-85.jpg v1104>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.078 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.862+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000467 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-3.xml auth v1108 ap=1 s=19335 n(v0 rc2024-09-19T07:13:13.611255+0000 b19335 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ada4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000467:[<0x1000000039e/article-3.xml v1108>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000467:[<0x1000000039e/article-3.xml v1108>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.078 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.862+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000542 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-17.jpg auth v1150 ap=1 s=24255 n(v0 rc2024-09-19T07:13:13.976246+0000 b24255 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ada3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000542:[<0x1000000039e/picture-17.jpg v1150>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000542:[<0x1000000039e/picture-17.jpg v1150>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.079 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.862+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000530 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-24.jpg auth v1138 ap=1 s=42411 n(v0 rc2024-09-19T07:13:13.942247+0000 b42411 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ada4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000530:[<0x1000000039e/picture-24.jpg v1138>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000530:[<0x1000000039e/picture-24.jpg v1138>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.079 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.862+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000516 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-33.jpg auth v1106 ap=1 s=21108 n(v0 rc2024-09-19T07:13:13.899248+0000 b21108 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ada5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000516:[<0x1000000039e/picture-33.jpg v1106>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000516:[<0x1000000039e/picture-33.jpg v1106>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.079 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.863+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004ce [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-57.jpg auth v1102 ap=1 s=44371 n(v0 rc2024-09-19T07:13:13.773251+0000 b44371 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35ada5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004ce:[<0x1000000039e/picture-57.jpg v1102>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000004ce:[<0x1000000039e/picture-57.jpg v1102>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.079 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.863+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000045b [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-7.xml auth v1142 ap=1 s=25450 n(v0 rc2024-09-19T07:13:13.593256+0000 b25450 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35adaa000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000045b:[<0x1000000039e/article-7.xml v1142>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000045b:[<0x1000000039e/article-7.xml v1142>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.079 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.863+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004fb [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-42.jpg auth v1110 ap=1 s=62841 n(v0 rc2024-09-19T07:13:13.847249+0000 b62841 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35adaa580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004fb:[<0x1000000039e/picture-42.jpg v1110>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000004fb:[<0x1000000039e/picture-42.jpg v1110>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.079 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.863+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004ac [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-68.jpg auth v1100 ap=1 s=30787 n(v0 rc2024-09-19T07:13:13.723252+0000 b30787 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35adaab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004ac:[<0x1000000039e/picture-68.jpg v1100>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000004ac:[<0x1000000039e/picture-68.jpg v1100>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.079 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.864+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000504 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-39.jpg auth v1164 ap=1 s=50588 n(v0 rc2024-09-19T07:13:13.863249+0000 b50588 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35adab080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000504:[<0x1000000039e/picture-39.jpg v1164>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000504:[<0x1000000039e/picture-39.jpg v1164>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.079 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.864+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d1a [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-23.xml auth v1517 ap=1 s=7389 n(v0 rc2024-09-19T07:13:21.138073+0000 b7389 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35adab600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d1a:[<0x1000000039e/comment-23.xml v1371>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000d1a:[<0x1000000039e/comment-23.xml v1517>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.079 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.864+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d18 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-24.xml auth v1523 ap=1 s=5321 n(v0 rc2024-09-19T07:13:21.132073+0000 b5321 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35adabb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d18:[<0x1000000039e/comment-24.xml v1368>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000d18:[<0x1000000039e/comment-24.xml v1523>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.079 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.864+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003cb [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-59.xml auth v1090 ap=1 s=6699 n(v0 rc2024-09-19T07:13:13.288263+0000 b6699 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35afc4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003cb:[<0x1000000039e/article-59.xml v1090>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000003cb:[<0x1000000039e/article-59.xml v1090>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.080 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.864+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000058d [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-13.jpg auth v1124 ap=1 s=33382 n(v0 rc2024-09-19T07:13:14.644230+0000 b33382 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35afc5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000058d:[<0x1000000039e/picture-13.jpg v1124>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000058d:[<0x1000000039e/picture-13.jpg v1124>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.080 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.864+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cbe [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-56.xml auth v1494 ap=1 s=4126 n(v0 rc2024-09-19T07:13:20.816081+0000 b4126 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35afc5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cbe:[<0x1000000039e/comment-56.xml v1312>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000cbe:[<0x1000000039e/comment-56.xml v1494>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.080 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.864+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000540 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-18.jpg auth v1098 ap=1 s=63764 n(v0 rc2024-09-19T07:13:13.971246+0000 b63764 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35a85e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000540:[<0x1000000039e/picture-18.jpg v1098>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000540:[<0x1000000039e/picture-18.jpg v1098>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.080 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.865+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000da1 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-5.xml auth{0=1} v1492 ap=1 s=2468 n(v0 rc2024-09-19T07:13:22.000052+0000 b2468 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@2},l=24793 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c35a85f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000da1:[<0x1000000039e/comment-5.xml v1444>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000da1:[<0x1000000039e/comment-5.xml v1492>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.080 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.865+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003ad [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-74.xml auth v1094 ap=1 s=21720 n(v0 rc2024-09-19T07:13:13.212265+0000 b21720 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@4},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35a85e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003ad:[<0x1000000039e/article-74.xml v1094>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000003ad:[<0x1000000039e/article-74.xml v1094>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.080 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.865+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000053e [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-19.jpg auth v1126 ap=1 s=11322 n(v0 rc2024-09-19T07:13:13.967247+0000 b11322 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35a85f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000053e:[<0x1000000039e/picture-19.jpg v1126>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000053e:[<0x1000000039e/picture-19.jpg v1126>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.080 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.867+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000043a [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-18.xml auth v1132 ap=1 s=2330 n(v0 rc2024-09-19T07:13:13.545257+0000 b2330 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35a85eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000043a:[<0x1000000039e/article-18.xml v1132>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000043a:[<0x1000000039e/article-18.xml v1132>,<0x10000000399/blog-2 v55774>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.080 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.868+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d0e [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-29.xml auth v1496 ap=1 s=2683 n(v0 rc2024-09-19T07:13:21.090074+0000 b2683 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35a860100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d0e:[<0x1000000039e/comment-29.xml v1363>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000d0e:[<0x1000000039e/comment-29.xml v1496>,<0x10000000399/blog-2 v62462>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.080 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.868+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003db [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-51.xml auth v1116 ap=1 s=14482 n(v0 rc2024-09-19T07:13:13.332262+0000 b14482 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35a85fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003db:[<0x1000000039e/article-51.xml v1116>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000003db:[<0x1000000039e/article-51.xml v1116>,<0x10000000399/blog-2 v62462>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.080 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.868+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000482 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-82.jpg auth v1096 ap=1 s=11624 n(v0 rc2024-09-19T07:13:13.651254+0000 b11624 1=1+0) caps={24793=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35a860680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000482:[<0x1000000039e/picture-82.jpg v1096>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000482:[<0x1000000039e/picture-82.jpg v1096>,<0x10000000399/blog-2 v62462>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.080 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.869+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000041f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-27.xml auth v1128 ap=1 s=20590 n(v0 rc2024-09-19T07:13:13.497258+0000 b20590 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35a860c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000041f:[<0x1000000039e/article-27.xml v1128>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000041f:[<0x1000000039e/article-27.xml v1128>,<0x10000000399/blog-2 v62462>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.081 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.869+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005a3 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-4.jpg auth{0=1} v1112 ap=1 s=40136 n(v0 rc2024-09-19T07:13:14.707229+0000 b40136 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=24793 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c35a861180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005a3:[<0x1000000039e/picture-4.jpg v1112>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000005a3:[<0x1000000039e/picture-4.jpg v1112>,<0x10000000399/blog-2 v62462>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.081 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.869+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000050f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-35.jpg auth v1108 ap=1 s=32829 n(v0 rc2024-09-19T07:13:13.889248+0000 b32829 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35a861700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000050f:[<0x1000000039e/picture-35.jpg v1108>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000050f:[<0x1000000039e/picture-35.jpg v1108>,<0x10000000399/blog-2 v62462>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.081 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.869+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005a7 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-2.jpg auth{0=1} v1114 ap=1 s=61220 n(v0 rc2024-09-19T07:13:14.721228+0000 b61220 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=24793 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c35a868000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005a7:[<0x1000000039e/picture-2.jpg v1114>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000005a7:[<0x1000000039e/picture-2.jpg v1114>,<0x10000000399/blog-2 v62462>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.081 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.869+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000048e [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-78.jpg auth v1120 ap=1 s=49128 n(v0 rc2024-09-19T07:13:13.669254+0000 b49128 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@4},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35a868580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000048e:[<0x1000000039e/picture-78.jpg v1120>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000048e:[<0x1000000039e/picture-78.jpg v1120>,<0x10000000399/blog-2 v62462>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.081 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.869+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003b5 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-70.xml auth v1084 ap=1 s=24126 n(v0 rc2024-09-19T07:13:13.227264+0000 b24126 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@4},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35a868b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003b5:[<0x1000000039e/article-70.xml v1084>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000003b5:[<0x1000000039e/article-70.xml v1084>,<0x10000000399/blog-2 v62462>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.081 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.870+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dbc [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-20.xml auth v1500 ap=1 s=2760 n(v0 rc2024-09-19T07:13:22.201048+0000 b2760 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35a869080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dbc:[<0x1000000039e/article-20.xml v1451>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000dbc:[<0x1000000039e/article-20.xml v1500>,<0x10000000399/blog-2 v62462>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.081 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.870+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000058b [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-14.jpg auth v1092 ap=1 s=63455 n(v0 rc2024-09-19T07:13:14.636230+0000 b63455 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35a869600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000058b:[<0x1000000039e/picture-14.jpg v1092>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000058b:[<0x1000000039e/picture-14.jpg v1092>,<0x10000000399/blog-2 v62462>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.081 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.870+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c7 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-61.xml auth v1138 ap=1 s=7436 n(v0 rc2024-09-19T07:13:13.275263+0000 b7436 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35a86a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003c7:[<0x1000000039e/article-61.xml v1138>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000003c7:[<0x1000000039e/article-61.xml v1138>,<0x10000000399/blog-2 v62462>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.081 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.870+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003f5 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-41.xml auth v1118 ap=1 s=26324 n(v0 rc2024-09-19T07:13:13.398260+0000 b26324 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35a86a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003f5:[<0x1000000039e/article-41.xml v1118>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000003f5:[<0x1000000039e/article-41.xml v1118>,<0x10000000399/blog-2 v62462>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.081 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.871+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003ec [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-45.xml auth v1134 ap=1 s=3786 n(v0 rc2024-09-19T07:13:13.372261+0000 b3786 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@2},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35a86ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003ec:[<0x1000000039e/article-45.xml v1134>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000003ec:[<0x1000000039e/article-45.xml v1134>,<0x10000000399/blog-2 v62462>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.082 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.871+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003b7 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-69.xml auth v1082 ap=1 s=3606 n(v0 rc2024-09-19T07:13:13.232264+0000 b3606 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@4},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35a86b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003b7:[<0x1000000039e/article-69.xml v1082>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000003b7:[<0x1000000039e/article-69.xml v1082>,<0x10000000399/blog-2 v62462>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.082 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.871+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004c1 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-61.jpg auth v1110 ap=1 s=33228 n(v0 rc2024-09-19T07:13:13.755252+0000 b33228 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35a86b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004c1:[<0x1000000039e/picture-61.jpg v1110>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x100000004c1:[<0x1000000039e/picture-61.jpg v1110>,<0x10000000399/blog-2 v62462>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.082 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.871+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000059e [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-7.jpg auth{0=1} v1100 ap=1 s=46286 n(v0 rc2024-09-19T07:13:14.686229+0000 b46286 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24793=0-4194304@3} caps={24793=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=24793 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c35b01c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000059e:[<0x1000000039e/picture-7.jpg v1100>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x1000000059e:[<0x1000000039e/picture-7.jpg v1100>,<0x10000000399/blog-2 v62462>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.082 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.872+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000413 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-31.xml auth v1086 ap=1 s=13406 n(v0 rc2024-09-19T07:13:13.468259+0000 b13406 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c35b01c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000413:[<0x1000000039e/article-31.xml v1086>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000413:[<0x1000000039e/article-31.xml v1086>,<0x10000000399/blog-2 v62462>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.082 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.872+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000597 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-9.jpg auth{0=1} v1456 ap=1 s=18551 n(v0 rc2024-09-19T07:13:14.670230+0000 b18551 1=1+0) caps={24793=pAsLsXsFscr/pFscr@4} mcw={0=Fscr} | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c35b01cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000597:[<0x1000000039e/picture-9.jpg v1140>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000597:[<0x1000000039e/picture-9.jpg v1456>,<0x10000000399/blog-2 v62462>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.082 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.872+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d9b [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-11.xml auth{0=1} v1458 ap=1 s=5618 n(v0 rc2024-09-19T07:13:21.972053+0000 b5618 1=1+0) caps={24793=pAsLsXsFscr/pFscr@4} mcw={0=Fscr} | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c35b01d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d9b:[<0x1000000039e/comment-11.xml v1423>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000d9b:[<0x1000000039e/comment-11.xml v1458>,<0x10000000399/blog-2 v62462>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.082 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.872+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d90 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-20.xml auth v1502 ap=1 s=3770 n(v0 rc2024-09-19T07:13:21.926054+0000 b3770 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35b01d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d90:[<0x1000000039e/comment-20.xml v1418>,<0x10000000399/blog-2 v20072>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000d90:[<0x1000000039e/comment-20.xml v1502>,<0x10000000399/blog-2 v62462>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.082 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.872+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b75 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-13.jpg auth v468 ap=1 s=64314 n(v0 rc2024-09-19T07:13:20.079099+0000 b64314 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35b05d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b75:[<0x10000000b22/picture-13.jpg v166>,<0x10000000399/blog-12 v19711>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000b75:[<0x10000000b22/picture-13.jpg v468>,<0x10000000399/blog-12 v45748>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.082 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.873+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b33 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-18.xml auth v400 ap=1 s=13072 n(v0 rc2024-09-19T07:13:19.936102+0000 b13072 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35b07c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b33:[<0x10000000b22/article-18.xml v34>,<0x10000000399/blog-12 v19711>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000b33:[<0x10000000b22/article-18.xml v400>,<0x10000000399/blog-12 v45748>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.082 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.873+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b90 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-4.jpg auth v410 ap=1 s=27870 n(v0 rc2024-09-19T07:13:20.139097+0000 b27870 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35b07c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b90:[<0x10000000b22/picture-4.jpg v220>,<0x10000000399/blog-12 v19711>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000b90:[<0x10000000b22/picture-4.jpg v410>,<0x10000000399/blog-12 v45748>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.083 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.874+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b96 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-2.jpg auth v458 ap=1 s=61977 n(v0 rc2024-09-19T07:13:20.152097+0000 b61977 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35b07cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b96:[<0x10000000b22/picture-2.jpg v232>,<0x10000000399/blog-12 v19711>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000b96:[<0x10000000b22/picture-2.jpg v458>,<0x10000000399/blog-12 v45748>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.083 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.874+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d85 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-93.jpg auth v446 ap=1 s=34653 n(v0 rc2024-09-19T07:13:21.738059+0000 b34653 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35b07d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d85:[<0x10000000b22/picture-93.jpg v257>,<0x10000000399/blog-12 v19711>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000d85:[<0x10000000b22/picture-93.jpg v446>,<0x10000000399/blog-12 v45748>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.083 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.874+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b2d [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-20.xml auth v428 ap=1 s=2851 n(v0 rc2024-09-19T07:13:19.923103+0000 b2851 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35b07d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b2d:[<0x10000000b22/article-20.xml v22>,<0x10000000399/blog-12 v19711>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000b2d:[<0x10000000b22/article-20.xml v428>,<0x10000000399/blog-12 v45748>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.083 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.874+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b72 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-14.jpg auth v448 ap=1 s=58785 n(v0 rc2024-09-19T07:13:20.072099+0000 b58785 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35b07db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b72:[<0x10000000b22/picture-14.jpg v160>,<0x10000000399/blog-12 v19711>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000b72:[<0x10000000b22/picture-14.jpg v448>,<0x10000000399/blog-12 v45748>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.083 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.875+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b87 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-7.jpg auth v456 ap=1 s=48723 n(v0 rc2024-09-19T07:13:20.118098+0000 b48723 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35b07e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b87:[<0x10000000b22/picture-7.jpg v202>,<0x10000000399/blog-12 v19711>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000b87:[<0x10000000b22/picture-7.jpg v456>,<0x10000000399/blog-12 v45748>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.083 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.875+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b81 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-9.jpg auth v412 ap=1 s=58550 n(v0 rc2024-09-19T07:13:20.105098+0000 b58550 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35b07e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b81:[<0x10000000b22/picture-9.jpg v190>,<0x10000000399/blog-12 v19711>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000b81:[<0x10000000b22/picture-9.jpg v412>,<0x10000000399/blog-12 v45748>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.083 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.876+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b7e [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-10.jpg auth v430 ap=1 s=37279 n(v0 rc2024-09-19T07:13:20.098098+0000 b37279 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35b07ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b7e:[<0x10000000b22/picture-10.jpg v184>,<0x10000000399/blog-12 v19711>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000b7e:[<0x10000000b22/picture-10.jpg v430>,<0x10000000399/blog-12 v45748>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.083 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.877+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b4e [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-9.xml auth v432 ap=1 s=15145 n(v0 rc2024-09-19T07:13:19.993101+0000 b15145 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35b07f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b4e:[<0x10000000b22/article-9.xml v88>,<0x10000000399/blog-12 v19711>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000b4e:[<0x10000000b22/article-9.xml v432>,<0x10000000399/blog-12 v45748>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.083 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.877+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b99 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-1.jpg auth v440 ap=1 s=59348 n(v0 rc2024-09-19T07:13:20.159097+0000 b59348 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35b07f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b99:[<0x10000000b22/picture-1.jpg v238>,<0x10000000399/blog-12 v19711>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000b99:[<0x10000000b22/picture-1.jpg v440>,<0x10000000399/blog-12 v45748>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.083 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.877+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b8a [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-6.jpg auth v494 ap=1 s=22535 n(v0 rc2024-09-19T07:13:20.125098+0000 b22535 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35afea000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b8a:[<0x10000000b22/picture-6.jpg v208>,<0x10000000399/blog-12 v19711>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000b8a:[<0x10000000b22/picture-6.jpg v494>,<0x10000000399/blog-12 v45748>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.084 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.878+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d86 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-85.xml auth v484 ap=1 s=13355 n(v0 rc2024-09-19T07:13:21.740059+0000 b13355 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35afea580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d86:[<0x10000000b22/article-85.xml v263>,<0x10000000399/blog-12 v19711>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000d86:[<0x10000000b22/article-85.xml v484>,<0x10000000399/blog-12 v45748>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.084 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.878+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b69 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-17.jpg auth v482 ap=1 s=29678 n(v0 rc2024-09-19T07:13:20.045100+0000 b29678 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35afeab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b69:[<0x10000000b22/picture-17.jpg v142>,<0x10000000399/blog-12 v19711>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000b69:[<0x10000000b22/picture-17.jpg v482>,<0x10000000399/blog-12 v45748>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.084 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.879+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b60 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-3.xml auth v420 ap=1 s=14207 n(v0 rc2024-09-19T07:13:20.027100+0000 b14207 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35afeb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b60:[<0x10000000b22/article-3.xml v124>,<0x10000000399/blog-12 v19711>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000b60:[<0x10000000b22/article-3.xml v420>,<0x10000000399/blog-12 v45748>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.084 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.879+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b51 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-8.xml auth v466 ap=1 s=12295 n(v0 rc2024-09-19T07:13:19.998101+0000 b12295 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35afebb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b51:[<0x10000000b22/article-8.xml v94>,<0x10000000399/blog-12 v19711>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000b51:[<0x10000000b22/article-8.xml v466>,<0x10000000399/blog-12 v45748>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.084 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.880+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b84 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-8.jpg auth v472 ap=1 s=30619 n(v0 rc2024-09-19T07:13:20.112098+0000 b30619 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35afec100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b84:[<0x10000000b22/picture-8.jpg v196>,<0x10000000399/blog-12 v19711>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000b84:[<0x10000000b22/picture-8.jpg v472>,<0x10000000399/blog-12 v45748>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.084 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.880+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b2a [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-21.xml auth v424 ap=1 s=3542 n(v0 rc2024-09-19T07:13:19.917103+0000 b3542 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35afec680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b2a:[<0x10000000b22/article-21.xml v16>,<0x10000000399/blog-12 v19711>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000b2a:[<0x10000000b22/article-21.xml v424>,<0x10000000399/blog-12 v45748>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.084 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.882+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b42 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-13.xml auth v470 ap=1 s=8066 n(v0 rc2024-09-19T07:13:19.968102+0000 b8066 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35afecc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b42:[<0x10000000b22/article-13.xml v64>,<0x10000000399/blog-12 v19711>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000b42:[<0x10000000b22/article-13.xml v470>,<0x10000000399/blog-12 v45748>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.084 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.883+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b57 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-6.xml auth v406 ap=1 s=20073 n(v0 rc2024-09-19T07:13:20.010100+0000 b20073 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35afed180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b57:[<0x10000000b22/article-6.xml v106>,<0x10000000399/blog-12 v19711>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000b57:[<0x10000000b22/article-6.xml v406>,<0x10000000399/blog-12 v45748>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.084 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.884+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b63 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-2.xml auth v404 ap=1 s=17772 n(v0 rc2024-09-19T07:13:20.033100+0000 b17772 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35afed700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b63:[<0x10000000b22/article-2.xml v130>,<0x10000000399/blog-12 v19711>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000b63:[<0x10000000b22/article-2.xml v404>,<0x10000000399/blog-12 v45748>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.085 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.887+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c43 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-96.jpg auth v464 ap=1 s=58609 n(v0 rc2024-09-19T07:13:20.562087+0000 b58609 1=1+0) caps={24793=pAsLsXsFsc/-@1},l=24793(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35aff0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c43:[<0x10000000b22/picture-96.jpg v244>,<0x10000000399/blog-12 v19711>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000c43:[<0x10000000b22/picture-96.jpg v464>,<0x10000000399/blog-12 v45748>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.085 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.887+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b8d [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-5.jpg auth v422 ap=1 s=55826 n(v0 rc2024-09-19T07:13:20.132098+0000 b55826 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35aff0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b8d:[<0x10000000b22/picture-5.jpg v214>,<0x10000000399/blog-12 v19711>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000b8d:[<0x10000000b22/picture-5.jpg v422>,<0x10000000399/blog-12 v45748>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.085 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.889+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b93 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-3.jpg auth v462 ap=1 s=34446 n(v0 rc2024-09-19T07:13:20.145097+0000 b34446 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35aff0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b93:[<0x10000000b22/picture-3.jpg v226>,<0x10000000399/blog-12 v19711>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000b93:[<0x10000000b22/picture-3.jpg v462>,<0x10000000399/blog-12 v45748>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.085 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.889+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b7b [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-11.jpg auth v418 ap=1 s=54310 n(v0 rc2024-09-19T07:13:20.092099+0000 b54310 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35aff1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b7b:[<0x10000000b22/picture-11.jpg v178>,<0x10000000399/blog-12 v19711>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000b7b:[<0x10000000b22/picture-11.jpg v418>,<0x10000000399/blog-12 v45748>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.085 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.889+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b5a [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-5.xml auth v436 ap=1 s=2450 n(v0 rc2024-09-19T07:13:20.015100+0000 b2450 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35aff1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b5a:[<0x10000000b22/article-5.xml v112>,<0x10000000399/blog-12 v19711>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000b5a:[<0x10000000b22/article-5.xml v436>,<0x10000000399/blog-12 v45748>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.085 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.890+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b27 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-22.xml auth v450 ap=1 s=18591 n(v0 rc2024-09-19T07:13:19.910103+0000 b18591 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35aff1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b27:[<0x10000000b22/article-22.xml v10>,<0x10000000399/blog-12 v19711>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000b27:[<0x10000000b22/article-22.xml v450>,<0x10000000399/blog-12 v45748>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.085 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.893+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b3f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-14.xml auth v444 ap=1 s=26115 n(v0 rc2024-09-19T07:13:19.961102+0000 b26115 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35aff2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b3f:[<0x10000000b22/article-14.xml v58>,<0x10000000399/blog-12 v19711>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000b3f:[<0x10000000b22/article-14.xml v444>,<0x10000000399/blog-12 v45748>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.085 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.894+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b48 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-11.xml auth v408 ap=1 s=30328 n(v0 rc2024-09-19T07:13:19.981101+0000 b30328 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35aff2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b48:[<0x10000000b22/article-11.xml v76>,<0x10000000399/blog-12 v19711>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000b48:[<0x10000000b22/article-11.xml v408>,<0x10000000399/blog-12 v62492>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.085 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.895+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b39 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-16.xml auth v426 ap=1 s=2258 n(v0 rc2024-09-19T07:13:19.949102+0000 b2258 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35aff2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b39:[<0x10000000b22/article-16.xml v46>,<0x10000000399/blog-12 v19711>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000b39:[<0x10000000b22/article-16.xml v426>,<0x10000000399/blog-12 v62492>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.086 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.896+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b6f [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-15.jpg auth v496 ap=1 s=47118 n(v0 rc2024-09-19T07:13:20.066099+0000 b47118 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35aff3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b6f:[<0x10000000b22/picture-15.jpg v154>,<0x10000000399/blog-12 v19711>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000b6f:[<0x10000000b22/picture-15.jpg v496>,<0x10000000399/blog-12 v62492>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.086 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.896+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b4b [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-10.xml auth v402 ap=1 s=31909 n(v0 rc2024-09-19T07:13:19.987101+0000 b31909 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35aff3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b4b:[<0x10000000b22/article-10.xml v82>,<0x10000000399/blog-12 v19711>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000b4b:[<0x10000000b22/article-10.xml v402>,<0x10000000399/blog-12 v62492>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.086 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.897+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b78 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-12.jpg auth v460 ap=1 s=24249 n(v0 rc2024-09-19T07:13:20.085099+0000 b24249 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35b088000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b78:[<0x10000000b22/picture-12.jpg v172>,<0x10000000399/blog-12 v19711>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000b78:[<0x10000000b22/picture-12.jpg v460>,<0x10000000399/blog-12 v62492>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.086 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.898+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b5d [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-4.xml auth v442 ap=1 s=13721 n(v0 rc2024-09-19T07:13:20.021100+0000 b13721 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35b088580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b5d:[<0x10000000b22/article-4.xml v118>,<0x10000000399/blog-12 v19711>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000b5d:[<0x10000000b22/article-4.xml v442>,<0x10000000399/blog-12 v62492>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.086 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.901+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b3c [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-15.xml auth v490 ap=1 s=11615 n(v0 rc2024-09-19T07:13:19.955102+0000 b11615 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35b088b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b3c:[<0x10000000b22/article-15.xml v52>,<0x10000000399/blog-12 v19711>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000b3c:[<0x10000000b22/article-15.xml v490>,<0x10000000399/blog-12 v62492>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.086 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.902+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b30 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-19.xml auth v438 ap=1 s=11825 n(v0 rc2024-09-19T07:13:19.930102+0000 b11825 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35b089080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b30:[<0x10000000b22/article-19.xml v28>,<0x10000000399/blog-12 v19711>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000b30:[<0x10000000b22/article-19.xml v438>,<0x10000000399/blog-12 v62492>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.086 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.903+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b45 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-12.xml auth v492 ap=1 s=9055 n(v0 rc2024-09-19T07:13:19.975101+0000 b9055 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35b089600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b45:[<0x10000000b22/article-12.xml v70>,<0x10000000399/blog-12 v19711>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000b45:[<0x10000000b22/article-12.xml v492>,<0x10000000399/blog-12 v62492>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.086 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.903+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d4a [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-1.xml auth v454 ap=1 s=22652 n(v0 rc2024-09-19T07:13:21.347068+0000 b22652 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35b089b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d4a:[<0x10000000b22/article-1.xml v250>,<0x10000000399/blog-12 v19711>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000d4a:[<0x10000000b22/article-1.xml v454>,<0x10000000399/blog-12 v62492>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.086 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.904+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b6c [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-16.jpg auth v480 ap=1 s=48549 n(v0 rc2024-09-19T07:13:20.059099+0000 b48549 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35b08a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b6c:[<0x10000000b22/picture-16.jpg v148>,<0x10000000399/blog-12 v19711>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000b6c:[<0x10000000b22/picture-16.jpg v480>,<0x10000000399/blog-12 v62492>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.086 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.907+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b24 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-23.xml auth v488 ap=1 s=9073 n(v0 rc2024-09-19T07:13:19.904103+0000 b9073 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35b08a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b24:[<0x10000000b22/article-23.xml v4>,<0x10000000399/blog-12 v19711>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000b24:[<0x10000000b22/article-23.xml v488>,<0x10000000399/blog-12 v62508>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.086 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:13:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:13:45.907+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b36 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-17.xml auth v452 ap=1 s=6586 n(v0 rc2024-09-19T07:13:19.942102+0000 b6586 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@3},l=24793 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c35b08ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b36:[<0x10000000b22/article-17.xml v40>,<0x10000000399/blog-12 v19711>,<0x10000000208/blogtest_in v389>,<0x10000000201/src v2117>,<0x10000000006/blogbench-1.0 v1827>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v50>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v79>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000b36:[<0x10000000b22/article-17.xml v452>,<0x10000000399/blog-12 v62508>,<0x10000000208/blogtest_in v517>,<0x10000000201/src v2144>,<0x10000000006/blogbench-1.0 v1859>,<0x10000000005/tmp v85>,<0x100000001fb/client.0 v77>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v88>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v101>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:13:46.193 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:13:46.522 INFO:journalctl@ceph.mds.f.smithi179.stdout:Sep 19 07:13:46 smithi179 systemd[1]: ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mds.f.service: Scheduled restart job, restart counter is at 1. 2024-09-19T07:13:46.522 INFO:journalctl@ceph.mds.f.smithi179.stdout:Sep 19 07:13:46 smithi179 systemd[1]: Stopped Ceph mds.f for eae8a4a8-7654-11ef-bceb-c7b262605968. 2024-09-19T07:13:46.523 INFO:journalctl@ceph.mds.f.smithi179.stdout:Sep 19 07:13:46 smithi179 systemd[1]: ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mds.f.service: Consumed 3.565s CPU time. 2024-09-19T07:13:46.523 INFO:journalctl@ceph.mds.f.smithi179.stdout:Sep 19 07:13:46 smithi179 systemd[1]: Starting Ceph mds.f for eae8a4a8-7654-11ef-bceb-c7b262605968... 2024-09-19T07:13:46.523 INFO:journalctl@ceph.mds.f.smithi179.stdout:Sep 19 07:13:46 smithi179 podman[69810]: 2024-09-19 07:13:46.163597138 +0000 UTC m=+0.019554802 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:13:46.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.668+0000 7f681c4d2640 1 -- 172.21.15.148:0/406682355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6814100e20 msgr2=0x7f6814101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:46.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.668+0000 7f681c4d2640 1 --2- 172.21.15.148:0/406682355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6814100e20 0x7f6814101200 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f6810009900 tx=0x7f681002a480 comp rx=0 tx=0).stop 2024-09-19T07:13:46.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.668+0000 7f681c4d2640 1 -- 172.21.15.148:0/406682355 shutdown_connections 2024-09-19T07:13:46.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.668+0000 7f681c4d2640 1 --2- 172.21.15.148:0/406682355 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6814102ef0 0x7f681410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:46.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.668+0000 7f681c4d2640 1 --2- 172.21.15.148:0/406682355 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6814102570 0x7f68141029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:46.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.668+0000 7f681c4d2640 1 --2- 172.21.15.148:0/406682355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6814100e20 0x7f6814101200 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:46.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.668+0000 7f681c4d2640 1 -- 172.21.15.148:0/406682355 >> 172.21.15.148:0/406682355 conn(0x7f68140fc7d0 msgr2=0x7f68140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:46.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.668+0000 7f681c4d2640 1 -- 172.21.15.148:0/406682355 shutdown_connections 2024-09-19T07:13:46.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.668+0000 7f681c4d2640 1 -- 172.21.15.148:0/406682355 wait complete. 2024-09-19T07:13:46.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.669+0000 7f681c4d2640 1 Processor -- start 2024-09-19T07:13:46.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.669+0000 7f681c4d2640 1 -- start start 2024-09-19T07:13:46.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.669+0000 7f681c4d2640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6814100e20 0x7f6814198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:46.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.669+0000 7f681c4d2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6814102570 0x7f6814198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:46.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.669+0000 7f681c4d2640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6814102ef0 0x7f681419cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:46.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.669+0000 7f681c4d2640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6814110f80 con 0x7f6814102ef0 2024-09-19T07:13:46.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.669+0000 7f681c4d2640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6814110e00 con 0x7f6814100e20 2024-09-19T07:13:46.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.669+0000 7f681c4d2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6814111100 con 0x7f6814102570 2024-09-19T07:13:46.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.669+0000 7f681a26e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6814100e20 0x7f6814198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:46.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.669+0000 7f6819a6d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6814102570 0x7f6814198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:46.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.669+0000 7f681a26e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6814100e20 0x7f6814198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:43808/0 (socket says 172.21.15.148:43808) 2024-09-19T07:13:46.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.669+0000 7f681a26e640 1 -- 172.21.15.148:0/1969640815 learned_addr learned my addr 172.21.15.148:0/1969640815 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:46.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.669+0000 7f681aa6f640 1 --2- 172.21.15.148:0/1969640815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6814102ef0 0x7f681419cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:46.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.669+0000 7f681a26e640 1 -- 172.21.15.148:0/1969640815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6814102570 msgr2=0x7f6814198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:46.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.669+0000 7f681a26e640 1 --2- 172.21.15.148:0/1969640815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6814102570 0x7f6814198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:46.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.669+0000 7f681a26e640 1 -- 172.21.15.148:0/1969640815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6814102ef0 msgr2=0x7f681419cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:46.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.669+0000 7f681a26e640 1 --2- 172.21.15.148:0/1969640815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6814102ef0 0x7f681419cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:46.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.669+0000 7f681a26e640 1 -- 172.21.15.148:0/1969640815 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f681419d4d0 con 0x7f6814100e20 2024-09-19T07:13:46.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.670+0000 7f6819a6d640 1 --2- 172.21.15.148:0/1969640815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6814102570 0x7f6814198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:13:46.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.669+0000 7f681aa6f640 1 --2- 172.21.15.148:0/1969640815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6814102ef0 0x7f681419cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:13:46.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.670+0000 7f681a26e640 1 --2- 172.21.15.148:0/1969640815 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6814100e20 0x7f6814198520 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6810006010 tx=0x7f6810003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:46.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.670+0000 7f680b7fe640 1 -- 172.21.15.148:0/1969640815 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f681003f070 con 0x7f6814100e20 2024-09-19T07:13:46.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.670+0000 7f681c4d2640 1 -- 172.21.15.148:0/1969640815 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f681419d760 con 0x7f6814100e20 2024-09-19T07:13:46.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.670+0000 7f680b7fe640 1 -- 172.21.15.148:0/1969640815 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6810031c30 con 0x7f6814100e20 2024-09-19T07:13:46.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.670+0000 7f680b7fe640 1 -- 172.21.15.148:0/1969640815 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6810035030 con 0x7f6814100e20 2024-09-19T07:13:46.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.670+0000 7f681c4d2640 1 -- 172.21.15.148:0/1969640815 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68141a50a0 con 0x7f6814100e20 2024-09-19T07:13:46.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.673+0000 7f680b7fe640 1 -- 172.21.15.148:0/1969640815 <== mon.2 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f6810042070 con 0x7f6814100e20 2024-09-19T07:13:46.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.673+0000 7f681e8ab740 1 Processor -- start 2024-09-19T07:13:46.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.674+0000 7f681e8ab740 1 -- start start 2024-09-19T07:13:46.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.674+0000 7f681e8ab740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56397896a4a0 0x56397896a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:46.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.674+0000 7f681e8ab740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56397896adc0 0x563978975140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:46.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.674+0000 7f681e8ab740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563978975680 0x563978977a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:46.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.674+0000 7f681e8ab740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5639788d02e0 con 0x563978975680 2024-09-19T07:13:46.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.674+0000 7f681e8ab740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x563978877ce0 con 0x56397896a4a0 2024-09-19T07:13:46.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.674+0000 7f681e8ab740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5639788cc2a0 con 0x56397896adc0 2024-09-19T07:13:46.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.674+0000 7f681aa6f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56397896a4a0 0x56397896a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:46.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.674+0000 7f6819a6d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563978975680 0x563978977a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:46.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.674+0000 7f681aa6f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56397896a4a0 0x56397896a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:43816/0 (socket says 172.21.15.148:43816) 2024-09-19T07:13:46.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.674+0000 7f681aa6f640 1 -- 172.21.15.148:0/2149672913 learned_addr learned my addr 172.21.15.148:0/2149672913 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:46.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.674+0000 7f681a26e640 1 --2- 172.21.15.148:0/2149672913 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56397896adc0 0x563978975140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:46.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.674+0000 7f681aa6f640 1 -- 172.21.15.148:0/2149672913 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56397896adc0 msgr2=0x563978975140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:46.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.674+0000 7f681aa6f640 1 --2- 172.21.15.148:0/2149672913 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56397896adc0 0x563978975140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:46.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.674+0000 7f681aa6f640 1 -- 172.21.15.148:0/2149672913 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563978975680 msgr2=0x563978977a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:46.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.674+0000 7f681aa6f640 1 --2- 172.21.15.148:0/2149672913 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563978975680 0x563978977a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:46.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.674+0000 7f681aa6f640 1 -- 172.21.15.148:0/2149672913 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56397885c440 con 0x56397896a4a0 2024-09-19T07:13:46.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.675+0000 7f680b7fe640 1 --2- 172.21.15.148:0/1969640815 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f68000a33b0 0x7f68000a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:46.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.675+0000 7f681a26e640 1 --2- 172.21.15.148:0/1969640815 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f68000a33b0 0x7f68000a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:46.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.675+0000 7f681aa6f640 1 --2- 172.21.15.148:0/2149672913 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56397896a4a0 0x56397896a880 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f680c010750 tx=0x7f680c010c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe8e863183e1f60e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:46.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.675+0000 7f680b7fe640 1 -- 172.21.15.148:0/1969640815 <== mon.2 v2:172.21.15.165:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f68100f0360 con 0x7f6814100e20 2024-09-19T07:13:46.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.675+0000 7f681a26e640 1 --2- 172.21.15.148:0/1969640815 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f68000a33b0 0x7f68000a5870 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x563978967890 tx=0x7f68100f3e50 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:46.687 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000dac (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-14.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.687 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000db4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-11.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.687 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000da8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-16.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.687 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000db8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-10.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.687 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000dcc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-4.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.687 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000daa (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-15.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.687 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000db0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-12.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.687 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ddb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-1.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.687 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:46.688 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: pgmap v84: 97 pgs: 97 active+clean; 138 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 857 KiB/s rd, 12 MiB/s wr, 1.13k op/s 2024-09-19T07:13:46.688 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: scrub summary: active paths [/] 2024-09-19T07:13:46.688 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:46.688 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: scrub summary: active paths [/] 2024-09-19T07:13:46.688 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000012cd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-27.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.688 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000127b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-52.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.688 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011ed (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-1.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.688 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000012b5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-34.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.688 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001276 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-53.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.688 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000123d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-67.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.689 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000121e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-74.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.689 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001215 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-76.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.689 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000012bc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-32.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.689 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001288 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-48.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.689 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000012e7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-21.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.690 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001223 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-73.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.690 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000121b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-75.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.690 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000012ad (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-36.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.690 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001297 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-43.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.690 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000012a6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-38.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.690 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000012dd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-23.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.690 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000120c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-79.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.690 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001291 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-45.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.690 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000129d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-41.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.690 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000125a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-60.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.690 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001243 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-66.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.690 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001208 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-80.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.691 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000012e2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-22.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.691 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000126a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-56.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.691 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000128b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-47.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.691 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001294 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-44.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.691 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001227 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-72.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.691 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000125f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-59.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.691 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000126e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-55.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.691 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000122f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-70.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.691 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000122b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-71.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.691 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000124f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-63.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.691 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000012a0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-40.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.691 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011f3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-87.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.691 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011fb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-84.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.691 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011f6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-86.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.692 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001205 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-81.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.692 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001282 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-50.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.692 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001262 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-58.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.692 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001247 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-65.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.692 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001213 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-77.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.692 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001234 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-69.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.692 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000127e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-51.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.692 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001253 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-62.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.692 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000128e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-46.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.692 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000012d5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-25.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.692 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000012bf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-31.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.692 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001285 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-49.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.693 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011f0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-88.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.693 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000012d1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-26.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.693 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001273 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-54.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.693 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000012c5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-29.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.693 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000124b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-64.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.693 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011ff (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-83.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.693 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000012c9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-28.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.693 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000012a9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-37.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.693 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011f8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-85.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.694 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000012d9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-24.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.694 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001267 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-57.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.694 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000012b9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-33.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.694 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000129a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-42.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.694 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001236 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-68.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.694 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000012a3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-39.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.694 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001201 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-82.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.694 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000012b1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-35.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.694 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000120f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-78.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.694 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001257 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-61.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.694 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:46.694 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: scrub summary: active paths [/] 2024-09-19T07:13:46.694 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: scrub summary: active paths [/] 2024-09-19T07:13:46.695 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011df (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-18.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.695 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011dd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-19.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.695 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011ee (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-13.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.695 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000121c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-4.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.695 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001224 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.695 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011ec (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-14.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.695 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000120d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-7.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.695 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001200 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-9.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.695 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011f9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-10.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.695 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001228 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.695 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011ca (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-9.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.695 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001214 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-6.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.695 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011e1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-17.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.695 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011d6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-3.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.696 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011ce (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-7.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.696 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001207 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-8.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.696 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000008c7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-64.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.696 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011cc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-8.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.696 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000093b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-37.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.696 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011c0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-13.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.696 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000008a4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-73.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.696 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011d0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-6.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.696 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000933 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-39.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.696 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000093e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-36.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.696 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011d8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-2.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.696 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000987 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-12.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.697 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000009a5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-1.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.697 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000008bf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-66.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.697 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001216 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-5.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.697 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000009a7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-16.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.697 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000966 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-23.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.697 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001163 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-42.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.697 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000008cb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-63.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.697 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000978 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-17.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.697 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000121f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.697 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011f5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-11.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.707 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000008a8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-72.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.707 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011d2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-5.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.707 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011c5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-11.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.707 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000942 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-35.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.707 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011e8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-15.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.707 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011c8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-10.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.707 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011f2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-12.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.707 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011d4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-4.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.708 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000092f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-40.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.708 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000097e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-15.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.708 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001173 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-40.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.708 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000117a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-39.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.708 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000972 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-19.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.708 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011c2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-12.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.708 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011db (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-1.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.708 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000928 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-42.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.708 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000918 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-46.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.708 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000981 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-14.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.708 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000912 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-47.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.708 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000008ac (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-71.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.709 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011e4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-16.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.709 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000098a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-11.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.709 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:46.709 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000097b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-16.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.709 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000008f1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-54.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.709 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000095d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-26.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.709 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000009a8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-15.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.709 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000098d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-10.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.709 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000009ab (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-12.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.709 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000090d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-48.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.709 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000099f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-4.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.709 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000960 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-25.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.709 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000936 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-38.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.709 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000009b7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-3.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.710 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000009ac (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-11.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.710 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000099c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-5.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.710 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000945 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-34.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.710 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000954 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-29.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.710 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000008d7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-60.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.710 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000969 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-22.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.710 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011fc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-38.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.710 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000909 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-49.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.710 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001155 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-44.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.710 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000924 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-43.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.710 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000948 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-33.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.710 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000009b4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-5.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.710 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000008e4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-57.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.711 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000008e0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-58.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.711 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000008f6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-53.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.711 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000115d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-43.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.711 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000957 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-28.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.711 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000009c6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-55.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.711 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000008fc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-52.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.711 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000993 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-8.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.711 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000008b8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-68.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.711 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000009af (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-8.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.712 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000094b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-32.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.712 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000096c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-21.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.712 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000951 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-30.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.712 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000120b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-36.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.712 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000984 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-13.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.712 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000905 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-50.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.712 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000999 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-6.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.712 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000009a3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-2.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.712 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000008e9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-56.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.712 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001204 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-37.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.712 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000009ad (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-10.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.712 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000009bc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-1.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.712 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000990 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-9.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.713 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000920 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-44.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.713 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000009b2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-6.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.713 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000008c3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-65.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.713 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000963 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-24.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.713 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000008cf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-62.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.713 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001169 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-41.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.713 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000008bb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-67.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.713 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000009a6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-17.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.713 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000009a1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-3.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.713 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000996 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-7.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.713 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000008db (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-59.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.713 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000009aa (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-13.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.713 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000975 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-18.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.714 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000900 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-51.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.714 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000095a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-27.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.714 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000009b6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-4.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.714 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000009b9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-2.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.714 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000096f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-20.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.714 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000008b0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-70.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.714 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000009a9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-14.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.714 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000092c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-41.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.714 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000008d3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-61.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.714 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000008b4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-69.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.714 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000091c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-45.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.714 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000009b1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-7.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.714 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000094e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-31.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.714 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000009ae (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-9.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.715 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:46.715 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: scrub summary: active paths [/] 2024-09-19T07:13:46.715 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: scrub summary: active paths [/] 2024-09-19T07:13:46.715 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ef8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-64.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.715 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000007c4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-37.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.715 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000719 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-75.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.715 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000101e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-27.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.715 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f45 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-39.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.715 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f4c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-36.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.715 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f97 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-12.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.715 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000feb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-52.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.715 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000007bb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-39.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.715 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000725 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-73.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.716 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000007c9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-36.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.716 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000fba (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-1.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.716 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000835 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-12.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.716 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001010 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-34.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.716 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000085f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-1.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.716 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000074e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-66.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.716 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000863 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-16.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.716 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000fe8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-53.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.716 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000070d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-77.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.716 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000fcc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-67.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.716 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000809 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-23.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.716 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000822 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-17.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.716 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000075b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-63.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.717 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001038 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-16.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.717 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000072b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-72.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.717 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000fc2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-74.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.720 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000007ce (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-35.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.720 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f6c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-23.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.720 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000007b6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-40.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.720 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000fbc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-76.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.721 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000082a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-15.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.721 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001014 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-32.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.721 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000081a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-19.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.721 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000efa (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-63.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.721 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f83 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-17.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.721 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000082d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-14.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.721 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ff4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-48.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.721 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000007ac (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-42.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.721 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000fc3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-73.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.721 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000102a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-21.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.722 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000079b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-46.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.722 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000fbf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-75.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.722 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000797 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-47.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.722 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f42 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-40.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.722 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000731 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-71.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.722 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000839 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-11.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.722 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f8b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-15.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.722 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000827 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-16.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.722 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001018 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-30.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.722 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000007fc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-26.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.722 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000077d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-54.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.722 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000100c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-36.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.722 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000867 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-15.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.723 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ffe (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-43.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.723 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000083d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-10.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.723 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000102c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-20.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.723 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f3b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-42.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.723 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f7b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-19.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.723 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001008 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-38.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.723 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000873 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-12.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.723 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001026 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-23.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.723 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f8f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-14.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.723 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000853 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-4.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.723 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ffa (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-45.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.723 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001002 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-41.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.723 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000007bf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-38.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.723 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000801 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-25.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.724 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f2f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-46.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.724 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000897 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.724 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000877 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-11.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.724 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000850 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-5.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.724 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000007d4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-34.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.724 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000fd7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-60.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.724 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000006f5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-81.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.724 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000fcd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-66.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.724 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000707 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-78.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.724 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000007ed (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-29.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.724 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f2d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-47.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.724 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000766 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-60.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.724 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001028 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-22.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.725 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000080f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-22.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.725 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f9c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-11.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.725 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000790 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-49.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.725 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f19 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-54.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.725 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f87 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-16.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.725 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000007a7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-43.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.725 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f64 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-26.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.725 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000007d9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-33.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.725 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000103c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-15.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.725 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000088f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-5.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.725 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000fdf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-56.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.725 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000771 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-57.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.725 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ff6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-47.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.725 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000fa0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-10.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.726 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000701 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-79.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.726 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000104a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-12.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.726 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ffc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-44.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.726 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000076e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-58.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.726 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000781 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-53.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.726 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000fb4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-4.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.726 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000007f1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-28.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.726 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f67 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-25.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.726 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000fd9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-59.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.726 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000784 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-52.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.726 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000fc5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-72.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.726 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f48 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-38.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.726 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000779 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-55.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.727 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000844 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-8.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.727 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000743 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-68.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.727 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000107a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-3.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.727 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000713 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-76.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.727 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000883 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-8.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.727 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000fe2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-55.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.727 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000007e0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-32.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.727 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000104f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-11.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.727 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000007e9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-30.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.727 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000fc9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-70.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.727 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000814 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-21.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.727 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000fb3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-5.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.727 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f51 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-34.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.727 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000831 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-13.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.728 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000078d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-50.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.728 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000085b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-2.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.728 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000fc7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-71.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.728 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000084c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-6.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.728 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f5d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-29.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.728 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f03 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-60.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.728 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000775 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-56.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.728 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000fd1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-63.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.728 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000006fb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-80.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.728 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001004 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-40.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.728 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000089f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.728 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000087b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-10.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.728 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f6f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-22.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.729 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000840 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-9.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.729 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f27 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-49.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.729 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000007a3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-44.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.729 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000088b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-6.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.729 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f37 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-43.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.729 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000753 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-65.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.729 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f53 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-33.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.729 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000805 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-24.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.729 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000106e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-5.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.730 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000075e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-62.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.730 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ff0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-50.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.730 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000857 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-3.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.730 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000fdb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-58.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.730 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000848 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-7.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.730 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f0f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-57.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.730 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000769 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-59.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.730 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000fce (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-65.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.730 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000086f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-13.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.730 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000071f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-74.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.730 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000081e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-18.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.730 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f0b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-58.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.730 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f1c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-53.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.731 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000788 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-51.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.731 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000007f7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-27.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.731 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f60 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-28.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.731 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000893 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-4.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.731 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000089b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.731 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f1f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-52.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.731 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000737 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-70.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.731 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000fca (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-69.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.731 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000817 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-20.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.731 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000fee (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-51.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.731 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000086b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-14.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.731 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000fd3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-62.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.731 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000762 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-61.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.732 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000007b2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-41.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.732 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ff8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-46.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.732 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000079f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-45.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.732 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000fa8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-8.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.732 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000073d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-69.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.732 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001022 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-25.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.732 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001016 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-31.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.732 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000887 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-7.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.732 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ff2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-49.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.732 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000007e5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-31.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.732 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000087f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-9.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.732 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ad9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-13.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.732 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000105f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-8.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.733 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000aca (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-18.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.733 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001020 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-26.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.733 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000a79 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-18.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.733 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f56 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-32.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.733 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ac7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-19.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.733 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f72 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-21.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.733 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000a5f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-27.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.733 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f5b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-30.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.733 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000af4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-4.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.733 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f93 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-13.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.733 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000afa (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.733 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000a74 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-20.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.733 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f25 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-50.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.733 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ad6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-14.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.734 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000fb8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-2.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.734 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000aeb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-7.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.734 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000a50 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-31.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.734 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000fe5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-54.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.734 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ae5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-9.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.734 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000101a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-29.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.734 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ae2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-10.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.734 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000afd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.734 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000a91 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-9.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.734 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001054 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-10.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.734 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000aee (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-6.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.734 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001086 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-1.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.734 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000a69 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-24.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.735 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000fd0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-64.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.735 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000aac (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-28.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.735 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ab8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-24.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.735 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000fa4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-9.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.735 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000fb0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-6.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.735 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000acd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-17.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.735 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f34 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-44.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.735 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000aa3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-3.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.735 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000efe (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-62.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.735 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000a98 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-7.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.735 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001069 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-6.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.735 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ab5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-25.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.735 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000a95 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-8.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.735 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f69 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-24.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.736 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ddd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-68.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.736 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ae8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-8.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.736 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000100a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-37.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.736 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000dd9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-26.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.736 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001033 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-17.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.737 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000a4c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-32.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.738 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000101c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-28.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.738 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000a71 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-21.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.738 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000fb6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-3.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.738 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001012 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-33.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.738 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000a54 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-30.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.738 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001024 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-24.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.738 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000a85 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-13.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.738 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000fde (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-57.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.738 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000a9b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-6.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.738 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000fab (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-7.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.738 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000aa6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-2.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.738 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001000 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-42.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.739 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000a49 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-33.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.739 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000fcb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-68.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.739 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001006 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-39.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.739 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000af1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-5.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.739 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000a5b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-28.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.739 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000af7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.739 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f07 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-59.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.739 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000adf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-11.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.739 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001045 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-13.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.739 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f7f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-18.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.739 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000a45 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-34.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.739 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001030 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-18.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.739 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000a58 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-29.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.739 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000abb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-23.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.740 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000102e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-19.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.740 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000abe (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-22.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.740 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f21 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-51.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.740 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000a89 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-11.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.740 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f62 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-27.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.740 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000a7e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-16.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.740 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000100e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-35.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.740 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000a63 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-26.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.740 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001080 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-2.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.740 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ad3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-15.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.740 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f77 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-20.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.740 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001040 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-14.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.741 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000a8e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-10.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.741 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000adc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-12.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.741 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f3f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-41.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.741 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f31 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-45.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.741 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000aa0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-4.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.741 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000fd5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-61.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.741 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001064 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-7.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.741 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000a66 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-25.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.741 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000f58 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-31.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.741 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000105a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-9.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.741 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000a39 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-38.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.741 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ac1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-21.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.741 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000a42 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-35.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.741 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000a80 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-15.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.742 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000a76 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-19.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.742 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ac4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-20.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.742 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000aaf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-27.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.742 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000a3c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-37.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.742 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000a3f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-36.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.742 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000a87 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-12.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.742 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000aa9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-1.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.742 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000a6b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-23.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.742 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000a7b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-17.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.742 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001074 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-4.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.742 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:46.742 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ad0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-16.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.742 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000a6e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-22.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.743 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000a82 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-14.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.743 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:46.743 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: scrub summary: active paths [/] 2024-09-19T07:13:46.743 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010ee (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-37.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.743 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010e3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-39.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.743 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010f2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-36.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.743 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001162 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-12.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.743 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001185 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-1.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.743 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001193 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-16.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.743 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001132 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-23.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.743 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000114d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-17.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.743 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000118b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-21.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.743 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010f8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-35.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.743 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010df (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-40.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.744 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001157 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-15.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.744 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001144 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-19.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.744 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010d5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-42.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.744 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001187 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-23.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.744 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000115b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-14.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.744 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010bf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-46.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.744 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010ba (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-47.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.744 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001189 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-22.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.744 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001168 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-11.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.744 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001121 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-26.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.744 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001151 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-16.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.744 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001196 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-15.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.744 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000116b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-10.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.745 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000119c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-12.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.745 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010b5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-48.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.745 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001128 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-25.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.745 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000117d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-4.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.745 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011b6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-3.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.745 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010e9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-38.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.745 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000119f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-11.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.745 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000117c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-5.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.745 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010fd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-34.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.745 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001112 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-29.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.745 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001135 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-22.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.745 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010b0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-49.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.745 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010d1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-43.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.745 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001101 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-33.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.746 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011b0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-5.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.746 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001099 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-53.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.746 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001115 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-28.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.746 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000109f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-52.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.746 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001171 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-8.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.746 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011a7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-8.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.746 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001105 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-32.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.746 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000113b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-21.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.746 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000110e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-30.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.746 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001160 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-13.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.746 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010aa (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-50.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.746 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001179 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-6.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.747 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001182 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-2.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.747 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011a1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-10.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.747 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011bb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-1.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.747 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000116e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-9.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.747 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010ca (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-44.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.747 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011ac (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-6.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.747 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000112c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-24.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.747 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001191 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-17.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.747 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001180 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-3.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.747 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001174 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-7.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.747 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001199 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-13.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.747 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000118f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-18.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.747 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001147 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-18.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000118e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-19.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010a4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-51.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000111c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-27.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011b3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-4.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011b9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-2.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000113f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-20.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001197 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-14.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010da (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-41.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011aa (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-7.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010c6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-45.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001109 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-31.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:46.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: scrub summary: active paths [/] 2024-09-19T07:13:46.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:46.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: scrub summary: active paths [/] 2024-09-19T07:13:46.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000d99 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-13.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000003c1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-64.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000d8d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-21.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000d14 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-26.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000d8f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-75.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000402 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-37.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000527 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-27.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000003af (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-73.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000003fa (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-39.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000404 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-36.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000044c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-12.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000004dc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-52.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000046d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-1.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000d0a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-30.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000513 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-34.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000004da (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-53.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000004af (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-67.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000da3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-3.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000d94 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-18.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000003bd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-66.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000003a3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-77.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000543 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-16.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000d9a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-12.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000049a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-74.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000cd3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-49.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ce8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-42.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000042b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-23.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000043d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-17.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000494 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-76.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000518 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-32.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000003c3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-63.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000004e8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-48.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ccd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-51.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000003b1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-72.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000049d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-73.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000539 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-21.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000407 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-35.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000497 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-75.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000da5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-1.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000003f8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-40.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000051f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-30.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000443 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-15.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000cee (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-40.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000d02 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-33.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000cf1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-39.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000050d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-36.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000004f7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-43.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000437 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-19.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000053c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-20.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000d04 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-32.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000cc4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-54.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000003f3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-42.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000506 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-38.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000d9c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-10.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000cc7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-53.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000da0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-6.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000005a5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000004d3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-55.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000d8e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-11.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000004a6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-70.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000461 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-5.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000040a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-34.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.753 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000cfd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-35.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000d10 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-28.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000cbb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-57.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000039f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-78.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000004a3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-71.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000419 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-29.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000003c9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-60.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000004bc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-63.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000501 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-40.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000cf4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-38.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000007dd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-22.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000473 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-87.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000047c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-84.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.754 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000d9e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-8.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000d1c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-22.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000da4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-2.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000476 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-86.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000003f1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-43.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ce2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-44.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000040e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-33.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000db9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-81.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000005a1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-5.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000d12 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-27.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000004e2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-50.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000007d7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-58.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000003cf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-57.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000cca (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-52.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.755 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000004b5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-65.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000d9f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-7.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000d97 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-15.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000003cd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-58.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000003d7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-53.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ce5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-43.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000d95 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-17.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000d9d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-9.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000041c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-28.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000003d9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-52.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000491 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-77.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000004a9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-69.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000004df (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-51.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000cdf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-45.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.757 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000004be (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-62.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.757 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000004ef (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-46.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.757 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000004b8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-64.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.757 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000cf7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-37.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.757 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000595 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-10.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.757 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000005aa (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.757 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000d96 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-16.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.757 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000455 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-9.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.757 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000047e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-83.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.757 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000003ef (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-44.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.757 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000059f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-6.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.757 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000003bf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-65.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.757 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000cb8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-58.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.757 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000cc1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-55.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.758 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000003c5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-62.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.758 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000428 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-24.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.758 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000d16 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-25.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.758 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000cff (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-34.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.758 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000525 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-28.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.758 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000ceb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-41.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.758 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000003bb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-67.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.758 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000050a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-37.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.758 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000479 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-85.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.759 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000467 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-3.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.759 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000542 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-17.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.759 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000530 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-24.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.759 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000516 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-33.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.759 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000004ce (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-57.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.759 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000045b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-7.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.759 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000004fb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-42.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.759 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000004ac (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-68.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.759 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000504 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-39.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.759 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000d1a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-23.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.759 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000d18 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-24.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.759 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000003cb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-59.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.759 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000058d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-13.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.759 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000cbe (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-56.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.760 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000540 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-18.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.760 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000da1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-5.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.760 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000003ad (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-74.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.760 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000053e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-19.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.760 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000043a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-18.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.760 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000d0e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-29.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.760 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000003db (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-51.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.760 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000482 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-82.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.760 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000041f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-27.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.760 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000005a3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-4.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.760 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000050f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-35.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.760 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000005a7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.760 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000048e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-78.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.761 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000003b5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-70.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.761 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000dbc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-20.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.761 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000058b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-14.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.761 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000003c7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-61.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.761 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000003f5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-41.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.761 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000003ec (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-45.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.761 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000003b7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-69.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.761 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000004c1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-61.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.761 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000059e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-7.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.761 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000413 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-31.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.761 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000597 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-9.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.761 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000d9b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-11.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.761 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000d90 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-20.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.762 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000b75 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-13.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.762 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000b33 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-18.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.762 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000b90 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-4.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.762 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000b96 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.762 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000d85 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-93.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.762 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000b2d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-20.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.762 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000b72 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-14.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.762 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000b87 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-7.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.762 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000b81 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-9.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.762 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000b7e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-10.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.762 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000b4e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-9.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.762 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000b99 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.762 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000b8a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-6.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.762 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000d86 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-85.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.763 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000b69 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-17.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.763 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000b60 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-3.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.763 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000b51 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-8.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.763 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000b84 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-8.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.763 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000b2a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-21.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.763 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000b42 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-13.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.763 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000b57 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-6.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.763 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000b63 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-2.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.763 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000c43 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-96.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.764 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000b8d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-5.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.764 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000b93 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.764 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000b7b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-11.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.764 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000b5a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-5.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.764 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000b27 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-22.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.764 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000b3f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-14.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.764 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000b48 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-11.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.764 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000b39 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-16.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.764 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000b6f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-15.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.764 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000b4b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-10.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.764 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000b78 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-12.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.764 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000b5d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-4.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.764 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000b3c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-15.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.765 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000b30 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-19.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.765 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000b45 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-12.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.765 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000d4a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-1.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.765 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000b6c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-16.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.765 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000b24 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-23.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.765 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000000b36 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-17.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.765 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:46 smithi179 ceph-mon[35716]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:46.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.690+0000 7f6808ff9640 1 -- 172.21.15.148:0/2149672913 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f680c00ead0 con 0x56397896a4a0 2024-09-19T07:13:46.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.690+0000 7f6808ff9640 1 -- 172.21.15.148:0/2149672913 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f680c010e60 con 0x56397896a4a0 2024-09-19T07:13:46.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.690+0000 7f6808ff9640 1 -- 172.21.15.148:0/2149672913 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f680c011640 con 0x56397896a4a0 2024-09-19T07:13:46.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.691+0000 7f681e8ab740 1 -- 172.21.15.148:0/2149672913 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56397896a4a0 msgr2=0x56397896a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:46.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.691+0000 7f681e8ab740 1 --2- 172.21.15.148:0/2149672913 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56397896a4a0 0x56397896a880 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f680c010750 tx=0x7f680c010c10 comp rx=0 tx=0).stop 2024-09-19T07:13:46.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.692+0000 7f681e8ab740 1 -- 172.21.15.148:0/2149672913 shutdown_connections 2024-09-19T07:13:46.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.692+0000 7f681e8ab740 1 --2- 172.21.15.148:0/2149672913 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563978975680 0x563978977a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:46.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.692+0000 7f681e8ab740 1 --2- 172.21.15.148:0/2149672913 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56397896adc0 0x563978975140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:46.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.692+0000 7f681e8ab740 1 --2- 172.21.15.148:0/2149672913 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56397896a4a0 0x56397896a880 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:46.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.692+0000 7f681e8ab740 1 -- 172.21.15.148:0/2149672913 >> 172.21.15.148:0/2149672913 conn(0x563978966a30 msgr2=0x563978966e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:46.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.692+0000 7f681e8ab740 1 -- 172.21.15.148:0/2149672913 shutdown_connections 2024-09-19T07:13:46.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.692+0000 7f681e8ab740 1 -- 172.21.15.148:0/2149672913 wait complete. 2024-09-19T07:13:46.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.692+0000 7f681e8ab740 1 -- start start 2024-09-19T07:13:46.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.692+0000 7f681e8ab740 1 Processor -- start 2024-09-19T07:13:46.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.693+0000 7f681e8ab740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56397896a4a0 0x563978974fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:46.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.693+0000 7f681e8ab740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56397896adc0 0x563978972250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:46.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.693+0000 7f681e8ab740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563978975680 0x563978972790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:46.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.693+0000 7f681e8ab740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56397897c660 con 0x56397896a4a0 2024-09-19T07:13:46.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.693+0000 7f681e8ab740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56397888b050 con 0x563978975680 2024-09-19T07:13:46.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.693+0000 7f681e8ab740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56397897c7e0 con 0x56397896adc0 2024-09-19T07:13:46.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.693+0000 7f681e8ab740 10 client.0 _ll_register_callbacks cb 0x5639788cb160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:13:46.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.693+0000 7f6819a6d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56397896adc0 0x563978972250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:46.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.693+0000 7f6819a6d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56397896adc0 0x563978972250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:48674/0 (socket says 172.21.15.148:48674) 2024-09-19T07:13:46.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.693+0000 7f6819a6d640 1 -- 172.21.15.148:0/3285843233 learned_addr learned my addr 172.21.15.148:0/3285843233 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:46.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.693+0000 7f681aa6f640 1 --2- 172.21.15.148:0/3285843233 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563978975680 0x563978972790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:46.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.694+0000 7f6819a6d640 1 -- 172.21.15.148:0/3285843233 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563978975680 msgr2=0x563978972790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:46.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.694+0000 7f6819a6d640 1 --2- 172.21.15.148:0/3285843233 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563978975680 0x563978972790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:46.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.694+0000 7f6819a6d640 1 -- 172.21.15.148:0/3285843233 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56397896a4a0 msgr2=0x563978974fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:46.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.694+0000 7f6819a6d640 1 --2- 172.21.15.148:0/3285843233 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56397896a4a0 0x563978974fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:46.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.694+0000 7f6819a6d640 1 -- 172.21.15.148:0/3285843233 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639786413c0 con 0x56397896adc0 2024-09-19T07:13:46.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.694+0000 7f6819a6d640 1 --2- 172.21.15.148:0/3285843233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56397896adc0 0x563978972250 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6804012d20 tx=0x7f680400f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c4b353149f623e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:46.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.694+0000 7f67fdffb640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-19T07:13:46.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.694+0000 7f67fdffb640 1 -- 172.21.15.148:0/3285843233 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6804012110 con 0x56397896adc0 2024-09-19T07:13:46.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.694+0000 7f67fdffb640 1 -- 172.21.15.148:0/3285843233 <== mon.1 v2:172.21.15.179:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f6804004030 con 0x56397896adc0 2024-09-19T07:13:46.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.694+0000 7f681e8ab740 1 -- 172.21.15.148:0/3285843233 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f680c010e60 con 0x56397896adc0 2024-09-19T07:13:46.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.694+0000 7f67fdffb640 1 -- 172.21.15.148:0/3285843233 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f68040122b0 con 0x56397896adc0 2024-09-19T07:13:46.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.694+0000 7f681e8ab740 10 client.25594 fetch_fsmap learned FSMap version 27 2024-09-19T07:13:46.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.694+0000 7f681e8ab740 1 -- 172.21.15.148:0/3285843233 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5639789798e0 con 0x56397896adc0 2024-09-19T07:13:46.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.695+0000 7f67fdffb640 1 -- 172.21.15.148:0/3285843233 <== mon.1 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6804004270 con 0x56397896adc0 2024-09-19T07:13:46.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.695+0000 7f67fdffb640 1 -- 172.21.15.148:0/3285843233 <== mon.1 v2:172.21.15.179:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f68040255a0 con 0x56397896adc0 2024-09-19T07:13:46.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.695+0000 7f681e8ab740 10 client.25594 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T07:13:46.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.695+0000 7f681e8ab740 10 client.25594 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:13:46.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.695+0000 7f681e8ab740 20 client.25594 populate_metadata read hostname 'smithi148' 2024-09-19T07:13:46.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.695+0000 7f681e8ab740 1 --2- 172.21.15.148:0/3285843233 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56397897ad90 0x56397897b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:46.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.695+0000 7f681e8ab740 4 client.25594 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:13:46.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.695+0000 7f681e8ab740 1 -- 172.21.15.148:0/3285843233 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f680c010e60 con 0x56397897ad90 2024-09-19T07:13:46.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.695+0000 7f681aa6f640 1 --2- 172.21.15.148:0/3285843233 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56397897ad90 0x56397897b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:46.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.695+0000 7f67fdffb640 10 client.25594 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:13:46.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.696+0000 7f681aa6f640 1 --2- 172.21.15.148:0/3285843233 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56397897ad90 0x56397897b1a0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a235a9b0595cddb server_cookie=18a0aa75d5ac0306 in_seq=0 out_seq=0 2024-09-19T07:13:46.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.699+0000 7f67fdffb640 1 -- 172.21.15.148:0/3285843233 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f680c010e60 con 0x56397897ad90 2024-09-19T07:13:46.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.699+0000 7f67fdffb640 10 client.25594 handle_command_reply: tid=0 2024-09-19T07:13:46.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.699+0000 7f681e8ab740 1 client.25594 shutdown 2024-09-19T07:13:46.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.699+0000 7f681e8ab740 1 -- 172.21.15.148:0/3285843233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56397896adc0 msgr2=0x563978972250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:46.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.699+0000 7f681e8ab740 1 --2- 172.21.15.148:0/3285843233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56397896adc0 0x563978972250 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6804012d20 tx=0x7f680400f790 comp rx=0 tx=0).stop 2024-09-19T07:13:46.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.699+0000 7f681e8ab740 1 -- 172.21.15.148:0/3285843233 shutdown_connections 2024-09-19T07:13:46.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.699+0000 7f681e8ab740 1 --2- 172.21.15.148:0/3285843233 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56397897ad90 0x56397897b1a0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:46.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.699+0000 7f681e8ab740 1 --2- 172.21.15.148:0/3285843233 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563978975680 0x563978972790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:46.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.699+0000 7f681e8ab740 1 --2- 172.21.15.148:0/3285843233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56397896adc0 0x563978972250 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:46.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.699+0000 7f681e8ab740 1 --2- 172.21.15.148:0/3285843233 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56397896a4a0 0x563978974fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:46.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.699+0000 7f681e8ab740 1 -- 172.21.15.148:0/3285843233 >> 172.21.15.148:0/3285843233 conn(0x563978966a30 msgr2=0x56397896c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:46.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.699+0000 7f67fdffb640 0 client.25594 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:13:46.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.699+0000 7f681e8ab740 1 -- 172.21.15.148:0/3285843233 shutdown_connections 2024-09-19T07:13:46.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.699+0000 7f681e8ab740 1 -- 172.21.15.148:0/3285843233 wait complete. 2024-09-19T07:13:46.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.699+0000 7f681e8ab740 20 client.25594 trim_cache size 0 max 16384 2024-09-19T07:13:46.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.718+0000 7f681e8ab740 1 Processor -- start 2024-09-19T07:13:46.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.718+0000 7f681e8ab740 1 -- start start 2024-09-19T07:13:46.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.718+0000 7f681e8ab740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56397896a4a0 0x56397896f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:46.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.718+0000 7f681e8ab740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56397896adc0 0x56397896f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:46.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.718+0000 7f681e8ab740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563978975680 0x563978971b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:46.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.718+0000 7f681e8ab740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f68141adee0 con 0x56397896adc0 2024-09-19T07:13:46.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.718+0000 7f681e8ab740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f68141ab7b0 con 0x563978975680 2024-09-19T07:13:46.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.718+0000 7f681e8ab740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f68141a95e0 con 0x56397896a4a0 2024-09-19T07:13:46.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.718+0000 7f6819a6d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56397896adc0 0x56397896f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:46.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.718+0000 7f681aa6f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56397896a4a0 0x56397896f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:46.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.718+0000 7f6819a6d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56397896adc0 0x56397896f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54060/0 (socket says 172.21.15.148:54060) 2024-09-19T07:13:46.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.718+0000 7f681aa6f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56397896a4a0 0x56397896f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:48680/0 (socket says 172.21.15.148:48680) 2024-09-19T07:13:46.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.718+0000 7f6819a6d640 1 -- 172.21.15.148:0/3144125190 learned_addr learned my addr 172.21.15.148:0/3144125190 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:46.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.718+0000 7f681aa6f640 1 --2- 172.21.15.148:0/3144125190 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563978975680 0x563978971b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:46.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.718+0000 7f6819a6d640 1 -- 172.21.15.148:0/3144125190 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56397896a4a0 msgr2=0x56397896f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:46.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.718+0000 7f6819a6d640 1 --2- 172.21.15.148:0/3144125190 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56397896a4a0 0x56397896f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:46.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.718+0000 7f6819a6d640 1 -- 172.21.15.148:0/3144125190 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563978975680 msgr2=0x563978971b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:46.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.718+0000 7f6819a6d640 1 --2- 172.21.15.148:0/3144125190 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563978975680 0x563978971b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:46.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.718+0000 7f6819a6d640 1 -- 172.21.15.148:0/3144125190 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639789707a0 con 0x56397896adc0 2024-09-19T07:13:46.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.719+0000 7f6819a6d640 1 --2- 172.21.15.148:0/3144125190 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56397896adc0 0x56397896f9f0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f6804025b60 tx=0x7f6804005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66ecf5eb82584a65 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:46.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.719+0000 7f67fffff640 1 -- 172.21.15.148:0/3144125190 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6804000e60 con 0x56397896adc0 2024-09-19T07:13:46.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.719+0000 7f67fffff640 1 -- 172.21.15.148:0/3144125190 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f680402a070 con 0x56397896adc0 2024-09-19T07:13:46.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.719+0000 7f67fffff640 1 -- 172.21.15.148:0/3144125190 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6804025780 con 0x56397896adc0 2024-09-19T07:13:46.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.719+0000 7f681e8ab740 1 -- 172.21.15.148:0/3144125190 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56397896adc0 msgr2=0x56397896f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:46.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.719+0000 7f681e8ab740 1 --2- 172.21.15.148:0/3144125190 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56397896adc0 0x56397896f9f0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f6804025b60 tx=0x7f6804005880 comp rx=0 tx=0).stop 2024-09-19T07:13:46.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.719+0000 7f681e8ab740 1 -- 172.21.15.148:0/3144125190 shutdown_connections 2024-09-19T07:13:46.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.719+0000 7f681e8ab740 1 --2- 172.21.15.148:0/3144125190 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563978975680 0x563978971b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:46.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.719+0000 7f681e8ab740 1 --2- 172.21.15.148:0/3144125190 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56397896adc0 0x56397896f9f0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:46.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.719+0000 7f681e8ab740 1 --2- 172.21.15.148:0/3144125190 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56397896a4a0 0x56397896f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:46.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.719+0000 7f681e8ab740 1 -- 172.21.15.148:0/3144125190 >> 172.21.15.148:0/3144125190 conn(0x563978966a30 msgr2=0x5639789742d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:46.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.720+0000 7f681e8ab740 1 -- 172.21.15.148:0/3144125190 shutdown_connections 2024-09-19T07:13:46.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.720+0000 7f681e8ab740 1 -- 172.21.15.148:0/3144125190 wait complete. 2024-09-19T07:13:46.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.720+0000 7f681e8ab740 1 -- start start 2024-09-19T07:13:46.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.720+0000 7f681e8ab740 1 Processor -- start 2024-09-19T07:13:46.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.720+0000 7f681e8ab740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56397896a4a0 0x563978992f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:46.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.720+0000 7f681e8ab740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56397896adc0 0x563978993450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:46.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.720+0000 7f681e8ab740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563978975680 0x563978993990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:46.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.720+0000 7f681e8ab740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f68141a9c70 con 0x56397896a4a0 2024-09-19T07:13:46.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.720+0000 7f681e8ab740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f68141ab0e0 con 0x56397896adc0 2024-09-19T07:13:46.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.720+0000 7f681e8ab740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f68141aa340 con 0x563978975680 2024-09-19T07:13:46.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.720+0000 7f681e8ab740 10 client.0 _ll_register_callbacks cb 0x7f6804009cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:13:46.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.720+0000 7f681aa6f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56397896a4a0 0x563978992f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:46.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.720+0000 7f681aa6f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56397896a4a0 0x563978992f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54066/0 (socket says 172.21.15.148:54066) 2024-09-19T07:13:46.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.720+0000 7f681aa6f640 1 -- 172.21.15.148:0/2505313458 learned_addr learned my addr 172.21.15.148:0/2505313458 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:46.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.721+0000 7f681aa6f640 1 --2- 172.21.15.148:0/2505313458 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563978975680 0x563978993990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:46.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.721+0000 7f6819a6d640 1 --2- 172.21.15.148:0/2505313458 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56397896adc0 0x563978993450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:46.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.721+0000 7f681aa6f640 1 -- 172.21.15.148:0/2505313458 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563978975680 msgr2=0x563978993990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:46.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.721+0000 7f681aa6f640 1 --2- 172.21.15.148:0/2505313458 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563978975680 0x563978993990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:46.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.721+0000 7f681aa6f640 1 -- 172.21.15.148:0/2505313458 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56397896adc0 msgr2=0x563978993450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:46.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.721+0000 7f681aa6f640 1 --2- 172.21.15.148:0/2505313458 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56397896adc0 0x563978993450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:46.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.721+0000 7f681aa6f640 1 -- 172.21.15.148:0/2505313458 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639789f7190 con 0x56397896a4a0 2024-09-19T07:13:46.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.721+0000 7f6819a6d640 1 --2- 172.21.15.148:0/2505313458 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56397896adc0 0x563978993450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:13:46.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.721+0000 7f681aa6f640 1 --2- 172.21.15.148:0/2505313458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56397896a4a0 0x563978992f10 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f680c012d00 tx=0x7f68040128a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=668f995da0fedef9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:46.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.721+0000 7f67fdffb640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:13:46.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.721+0000 7f67fdffb640 1 -- 172.21.15.148:0/2505313458 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f680c0049a0 con 0x56397896a4a0 2024-09-19T07:13:46.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.721+0000 7f67fdffb640 1 -- 172.21.15.148:0/2505313458 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f680c004b40 con 0x56397896a4a0 2024-09-19T07:13:46.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.721+0000 7f681e8ab740 1 -- 172.21.15.148:0/2505313458 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f680402a070 con 0x56397896a4a0 2024-09-19T07:13:46.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.721+0000 7f67fdffb640 1 -- 172.21.15.148:0/2505313458 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f680c004d40 con 0x56397896a4a0 2024-09-19T07:13:46.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.721+0000 7f681e8ab740 10 client.16179 fetch_fsmap learned FSMap version 27 2024-09-19T07:13:46.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.721+0000 7f681e8ab740 1 -- 172.21.15.148:0/2505313458 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5639789f8480 con 0x56397896a4a0 2024-09-19T07:13:46.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.721+0000 7f67fdffb640 1 -- 172.21.15.148:0/2505313458 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f680402a070 con 0x56397896a4a0 2024-09-19T07:13:46.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.722+0000 7f67fdffb640 1 -- 172.21.15.148:0/2505313458 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f680c00f040 con 0x56397896a4a0 2024-09-19T07:13:46.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.722+0000 7f681e8ab740 10 client.16179 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T07:13:46.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.722+0000 7f681e8ab740 10 client.16179 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:13:46.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.722+0000 7f681e8ab740 20 client.16179 populate_metadata read hostname 'smithi148' 2024-09-19T07:13:46.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.722+0000 7f681e8ab740 1 --2- 172.21.15.148:0/2505313458 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5639789f89b0 0x5639789fada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:46.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.722+0000 7f681e8ab740 4 client.16179 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T07:13:46.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.722+0000 7f681e8ab740 1 -- 172.21.15.148:0/2505313458 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5639788dd850 con 0x5639789f89b0 2024-09-19T07:13:46.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.722+0000 7f6819a6d640 1 --2- 172.21.15.148:0/2505313458 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5639789f89b0 0x5639789fada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:46.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.722+0000 7f6819a6d640 1 --2- 172.21.15.148:0/2505313458 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5639789f89b0 0x5639789fada0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4effc8f339c5c6df server_cookie=3009733fb8b5836d in_seq=0 out_seq=0 2024-09-19T07:13:46.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.722+0000 7f67fdffb640 10 client.16179 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:13:46.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.724+0000 7f67fdffb640 1 -- 172.21.15.148:0/2505313458 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+268 (crc 0 0 0) 0x5639788dd850 con 0x5639789f89b0 2024-09-19T07:13:46.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.724+0000 7f67fdffb640 10 client.16179 handle_command_reply: tid=0 2024-09-19T07:13:46.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.724+0000 7f681e8ab740 1 client.16179 shutdown 2024-09-19T07:13:46.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.724+0000 7f681e8ab740 1 -- 172.21.15.148:0/2505313458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56397896a4a0 msgr2=0x563978992f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:46.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.724+0000 7f681e8ab740 1 --2- 172.21.15.148:0/2505313458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56397896a4a0 0x563978992f10 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f680c012d00 tx=0x7f68040128a0 comp rx=0 tx=0).stop 2024-09-19T07:13:46.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.725+0000 7f681e8ab740 1 -- 172.21.15.148:0/2505313458 shutdown_connections 2024-09-19T07:13:46.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.725+0000 7f681e8ab740 1 --2- 172.21.15.148:0/2505313458 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5639789f89b0 0x5639789fada0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:46.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.725+0000 7f681e8ab740 1 --2- 172.21.15.148:0/2505313458 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563978975680 0x563978993990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:46.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.725+0000 7f681e8ab740 1 --2- 172.21.15.148:0/2505313458 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56397896adc0 0x563978993450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:46.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.725+0000 7f681e8ab740 1 --2- 172.21.15.148:0/2505313458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56397896a4a0 0x563978992f10 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:46.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.725+0000 7f681e8ab740 1 -- 172.21.15.148:0/2505313458 >> 172.21.15.148:0/2505313458 conn(0x563978966a30 msgr2=0x563978965350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:46.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.725+0000 7f67fdffb640 0 client.16179 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:13:46.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.725+0000 7f681e8ab740 1 -- 172.21.15.148:0/2505313458 shutdown_connections 2024-09-19T07:13:46.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.725+0000 7f681e8ab740 1 -- 172.21.15.148:0/2505313458 wait complete. 2024-09-19T07:13:46.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.725+0000 7f681e8ab740 20 client.16179 trim_cache size 0 max 16384 2024-09-19T07:13:46.783 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:13:46.783 INFO:teuthology.orchestra.run.smithi148.stdout: "status": "scrub active (3591 inodes in the stack)", 2024-09-19T07:13:46.783 INFO:teuthology.orchestra.run.smithi148.stdout: "scrubs": { 2024-09-19T07:13:46.783 INFO:teuthology.orchestra.run.smithi148.stdout: "b3915a2a-00bd-4db1-af26-9326d1b8231b": { 2024-09-19T07:13:46.783 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/", 2024-09-19T07:13:46.783 INFO:teuthology.orchestra.run.smithi148.stdout: "tag": "b3915a2a-00bd-4db1-af26-9326d1b8231b", 2024-09-19T07:13:46.783 INFO:teuthology.orchestra.run.smithi148.stdout: "options": "recursive,force" 2024-09-19T07:13:46.783 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:13:46.783 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:13:46.783 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:13:46.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.725+0000 7f681c4d2640 1 -- 172.21.15.148:0/1969640815 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f68000a33b0 msgr2=0x7f68000a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:46.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.725+0000 7f681c4d2640 1 --2- 172.21.15.148:0/1969640815 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f68000a33b0 0x7f68000a5870 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x563978967890 tx=0x7f68100f3e50 comp rx=0 tx=0).stop 2024-09-19T07:13:46.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.725+0000 7f681c4d2640 1 -- 172.21.15.148:0/1969640815 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6814100e20 msgr2=0x7f6814198520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:46.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.725+0000 7f681c4d2640 1 --2- 172.21.15.148:0/1969640815 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6814100e20 0x7f6814198520 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6810006010 tx=0x7f6810003c10 comp rx=0 tx=0).stop 2024-09-19T07:13:46.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.725+0000 7f681c4d2640 1 -- 172.21.15.148:0/1969640815 shutdown_connections 2024-09-19T07:13:46.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.725+0000 7f681c4d2640 1 --2- 172.21.15.148:0/1969640815 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f68000a33b0 0x7f68000a5870 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:46.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.725+0000 7f681c4d2640 1 --2- 172.21.15.148:0/1969640815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6814102ef0 0x7f681419cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:46.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.725+0000 7f681c4d2640 1 --2- 172.21.15.148:0/1969640815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6814102570 0x7f6814198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:46.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.725+0000 7f681c4d2640 1 --2- 172.21.15.148:0/1969640815 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6814100e20 0x7f6814198520 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:46.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.726+0000 7f681c4d2640 1 -- 172.21.15.148:0/1969640815 >> 172.21.15.148:0/1969640815 conn(0x7f68140fc7d0 msgr2=0x7f681406a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:46.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.726+0000 7f681c4d2640 1 -- 172.21.15.148:0/1969640815 shutdown_connections 2024-09-19T07:13:46.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:13:46.726+0000 7f681c4d2640 1 -- 172.21.15.148:0/1969640815 wait complete. 2024-09-19T07:13:46.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000dac (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-14.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000db4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-11.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000da8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-16.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000db8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-10.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000dcc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-4.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000daa (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-15.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000db0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-12.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ddb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-1.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:46.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: pgmap v84: 97 pgs: 97 active+clean; 138 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 857 KiB/s rd, 12 MiB/s wr, 1.13k op/s 2024-09-19T07:13:46.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: scrub summary: active paths [/] 2024-09-19T07:13:46.835 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:46.835 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: scrub summary: active paths [/] 2024-09-19T07:13:46.835 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000012cd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-27.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.835 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000127b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-52.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.835 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011ed (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-1.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.835 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000012b5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-34.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.835 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001276 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-53.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.835 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000123d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-67.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.835 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000121e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-74.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.835 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001215 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-76.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.836 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000012bc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-32.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.836 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001288 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-48.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.836 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000012e7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-21.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.836 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001223 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-73.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.836 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000121b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-75.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.836 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000012ad (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-36.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.836 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001297 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-43.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.836 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000012a6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-38.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.836 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000012dd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-23.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.836 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000120c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-79.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.836 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001291 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-45.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.836 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000129d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-41.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.836 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000125a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-60.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.837 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001243 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-66.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.837 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001208 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-80.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.837 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000012e2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-22.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.837 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000126a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-56.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.837 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000128b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-47.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.837 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001294 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-44.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.837 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001227 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-72.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.837 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000125f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-59.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.837 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000126e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-55.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.837 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000122f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-70.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.837 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000122b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-71.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.837 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000124f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-63.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.838 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000012a0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-40.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.838 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011f3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-87.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.838 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011fb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-84.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.838 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011f6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-86.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.838 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001205 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-81.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.838 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001282 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-50.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.844 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001262 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-58.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.844 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001247 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-65.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.845 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001213 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-77.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.845 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001234 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-69.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.845 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000127e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-51.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.845 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001253 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-62.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.845 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000128e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-46.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.845 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000012d5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-25.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.845 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000012bf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-31.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.845 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001285 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-49.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.846 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011f0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-88.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.846 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000012d1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-26.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.846 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001273 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-54.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.846 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000012c5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-29.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.846 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000124b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-64.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.846 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011ff (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-83.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.846 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000012c9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-28.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.846 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000012a9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-37.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.846 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011f8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-85.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.846 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000012d9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-24.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.846 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001267 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-57.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.846 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000012b9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-33.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.847 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000129a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-42.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.847 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001236 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-68.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.847 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000012a3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-39.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.847 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001201 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-82.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.847 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000012b1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-35.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.847 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000120f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-78.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.847 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001257 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-61.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.847 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:46.847 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: scrub summary: active paths [/] 2024-09-19T07:13:46.847 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: scrub summary: active paths [/] 2024-09-19T07:13:46.847 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011df (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-18.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.847 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011dd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-19.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.848 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011ee (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-13.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.848 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000121c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-4.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.848 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001224 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.848 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011ec (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-14.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.848 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000120d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-7.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.848 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001200 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-9.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.848 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011f9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-10.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.848 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001228 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.848 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011ca (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-9.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.849 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001214 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-6.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.849 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011e1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-17.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.849 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011d6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-3.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.849 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011ce (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-7.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.849 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001207 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-8.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.849 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000008c7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-64.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.849 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011cc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-8.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.849 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000093b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-37.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.849 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011c0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-13.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.849 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000008a4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-73.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.849 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011d0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-6.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.849 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000933 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-39.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.849 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000093e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-36.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.850 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011d8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-2.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.850 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000987 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-12.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.850 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000009a5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-1.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.850 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000008bf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-66.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.850 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001216 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-5.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.850 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000009a7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-16.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.850 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000966 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-23.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.850 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001163 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-42.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.851 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000008cb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-63.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.851 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000978 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-17.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.851 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000121f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.851 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011f5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-11.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.851 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000008a8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-72.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.851 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011d2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-5.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.851 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011c5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-11.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.851 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000942 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-35.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.851 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011e8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-15.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.852 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011c8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-10.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.852 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011f2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-12.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.852 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011d4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-4.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.852 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000092f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-40.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.852 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000097e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-15.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.852 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001173 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-40.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.853 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000117a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-39.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.853 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000972 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-19.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.853 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011c2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-12.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.853 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011db (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-1.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.853 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000928 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-42.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.853 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000918 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-46.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.854 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000981 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-14.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.854 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000912 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-47.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.854 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000008ac (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-71.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.854 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011e4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-16.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.854 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000098a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-11.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.855 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:46.855 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000097b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-16.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.855 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000008f1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-54.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.855 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000095d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-26.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.855 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000009a8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-15.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.855 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000098d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-10.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.855 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000009ab (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-12.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.855 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000090d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-48.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.856 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000099f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-4.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.856 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000960 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-25.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.856 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000936 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-38.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.856 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000009b7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-3.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.857 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000009ac (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-11.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.857 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000099c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-5.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.857 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000945 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-34.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.857 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000954 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-29.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.857 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000008d7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-60.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.858 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000969 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-22.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.858 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011fc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-38.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.858 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000909 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-49.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.858 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001155 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-44.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.859 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000924 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-43.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.859 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000948 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-33.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.859 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000009b4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-5.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.859 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000008e4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-57.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.859 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000008e0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-58.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.859 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000008f6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-53.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.859 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000115d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-43.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.860 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000957 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-28.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.860 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000009c6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-55.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.860 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000008fc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-52.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.860 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000993 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-8.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.860 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000008b8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-68.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.860 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000009af (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-8.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.860 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000094b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-32.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.861 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000096c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-21.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.861 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000951 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-30.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.861 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000120b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-36.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.861 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000984 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-13.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.861 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000905 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-50.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.861 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000999 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-6.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.861 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000009a3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-2.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.861 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000008e9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-56.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.861 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001204 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-37.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.862 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000009ad (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-10.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.862 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000009bc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-1.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.862 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000990 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-9.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.862 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000920 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-44.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.862 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000009b2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-6.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.862 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000008c3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-65.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.862 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000963 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-24.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.862 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000008cf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-62.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.862 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001169 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-41.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.862 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000008bb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-67.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.862 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000009a6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-17.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.862 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000009a1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-3.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000996 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-7.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000008db (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-59.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000009aa (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-13.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000975 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-18.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000900 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-51.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000095a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-27.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000009b6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-4.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000009b9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-2.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000096f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-20.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000008b0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-70.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000009a9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-14.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000092c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-41.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.863 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000008d3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-61.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000008b4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-69.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000091c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-45.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000009b1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-7.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000094e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-31.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000009ae (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-9.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:46.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: scrub summary: active paths [/] 2024-09-19T07:13:46.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: scrub summary: active paths [/] 2024-09-19T07:13:46.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ef8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-64.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000007c4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-37.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000719 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-75.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.864 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000101e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-27.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.865 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f45 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-39.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.865 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f4c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-36.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.865 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f97 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-12.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.865 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000feb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-52.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.865 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000007bb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-39.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.865 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000725 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-73.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.865 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000007c9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-36.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.865 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000fba (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-1.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.865 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000835 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-12.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.865 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001010 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-34.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.865 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000085f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-1.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.865 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000074e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-66.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.866 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000863 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-16.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.866 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000fe8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-53.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.866 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000070d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-77.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.866 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000fcc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-67.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.866 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000809 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-23.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.866 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000822 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-17.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.866 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000075b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-63.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.866 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001038 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-16.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.866 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000072b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-72.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.866 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000fc2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-74.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.866 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000007ce (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-35.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.866 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f6c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-23.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.867 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000007b6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-40.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.867 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000fbc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-76.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.867 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000082a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-15.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.867 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001014 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-32.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.867 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000081a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-19.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.867 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000efa (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-63.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.867 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f83 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-17.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.867 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000082d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-14.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.867 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ff4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-48.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.867 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000007ac (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-42.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.867 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000fc3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-73.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.868 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000102a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-21.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.868 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000079b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-46.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.868 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000fbf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-75.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.868 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000797 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-47.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.868 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f42 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-40.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.868 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000731 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-71.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.868 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000839 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-11.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.868 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f8b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-15.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.868 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000827 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-16.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.868 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001018 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-30.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.869 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000007fc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-26.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.869 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000077d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-54.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.869 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000100c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-36.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.869 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000867 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-15.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.869 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ffe (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-43.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.869 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000083d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-10.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.869 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000102c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-20.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.869 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f3b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-42.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.869 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f7b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-19.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.870 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001008 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-38.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.870 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000873 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-12.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.870 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001026 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-23.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.870 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f8f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-14.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.870 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000853 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-4.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.870 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ffa (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-45.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.870 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001002 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-41.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.870 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000007bf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-38.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.870 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000801 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-25.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.870 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f2f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-46.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.870 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000897 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.870 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000877 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-11.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.871 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000850 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-5.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.871 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000007d4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-34.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.871 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000fd7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-60.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.871 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000006f5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-81.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.871 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000fcd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-66.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.871 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000707 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-78.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.871 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000007ed (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-29.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.871 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f2d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-47.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.871 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000766 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-60.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.872 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001028 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-22.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.872 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000080f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-22.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.872 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f9c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-11.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.872 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000790 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-49.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.872 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f19 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-54.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.872 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f87 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-16.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.872 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000007a7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-43.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.872 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f64 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-26.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.872 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000007d9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-33.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.872 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000103c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-15.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.872 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000088f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-5.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.872 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000fdf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-56.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.873 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000771 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-57.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.873 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ff6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-47.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.873 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000fa0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-10.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.873 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000701 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-79.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.873 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000104a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-12.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.873 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ffc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-44.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.873 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000076e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-58.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.873 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000781 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-53.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.873 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000fb4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-4.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.873 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000007f1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-28.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.873 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f67 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-25.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.874 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000fd9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-59.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.874 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000784 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-52.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.874 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000fc5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-72.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.874 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f48 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-38.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.874 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000779 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-55.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.874 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000844 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-8.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.874 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000743 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-68.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.874 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000107a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-3.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.874 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000713 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-76.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.874 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000883 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-8.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.874 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000fe2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-55.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.875 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000007e0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-32.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.875 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000104f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-11.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.875 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000007e9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-30.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.875 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000fc9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-70.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.875 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000814 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-21.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.875 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000fb3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-5.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.875 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f51 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-34.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.875 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000831 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-13.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.875 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000078d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-50.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.875 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000085b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-2.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.875 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000fc7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-71.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.875 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000084c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-6.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.875 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f5d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-29.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.876 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f03 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-60.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.876 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000775 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-56.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.876 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000fd1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-63.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.876 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000006fb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-80.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.876 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001004 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-40.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.876 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000089f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.876 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000087b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-10.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.876 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f6f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-22.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.876 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000840 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-9.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.877 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f27 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-49.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.877 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000007a3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-44.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.877 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000088b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-6.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.877 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f37 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-43.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.877 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000753 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-65.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.877 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f53 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-33.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.877 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000805 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-24.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.878 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000106e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-5.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.878 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000075e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-62.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.878 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ff0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-50.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.878 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000857 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-3.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.878 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000fdb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-58.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.878 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000848 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-7.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.878 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f0f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-57.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.878 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000769 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-59.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.879 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000fce (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-65.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.879 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000086f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-13.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.879 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000071f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-74.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.879 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000081e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-18.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.879 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f0b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-58.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.879 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f1c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-53.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.879 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000788 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-51.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.879 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000007f7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-27.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.879 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f60 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-28.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.879 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000893 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-4.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.880 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000089b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.880 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f1f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-52.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.880 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000737 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-70.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.880 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000fca (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-69.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.880 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000817 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-20.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.880 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000fee (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-51.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.880 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000086b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-14.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.880 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000fd3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-62.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.880 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000762 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-61.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.880 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000007b2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-41.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.880 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ff8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-46.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.881 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000079f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-45.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.881 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000fa8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-8.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.881 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000073d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-69.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.881 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001022 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-25.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.881 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001016 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-31.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.881 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000887 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-7.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.881 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ff2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-49.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.881 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000007e5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-31.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.881 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000087f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-9.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.881 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ad9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-13.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.881 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000105f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-8.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.882 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000aca (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-18.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.882 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001020 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-26.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.882 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000a79 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-18.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.882 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f56 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-32.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.882 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ac7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-19.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.882 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f72 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-21.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.882 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000a5f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-27.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.882 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f5b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-30.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.882 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000af4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-4.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.882 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f93 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-13.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.883 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000afa (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.883 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000a74 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-20.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.883 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f25 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-50.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.883 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ad6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-14.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.883 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000fb8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-2.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.883 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000aeb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-7.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.883 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000a50 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-31.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.883 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000fe5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-54.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.883 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ae5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-9.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.883 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000101a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-29.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.883 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ae2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-10.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.883 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000afd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.884 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000a91 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-9.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.884 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001054 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-10.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.884 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000aee (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-6.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.884 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001086 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-1.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.884 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000a69 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-24.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.884 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000fd0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-64.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.884 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000aac (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-28.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.884 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ab8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-24.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.884 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000fa4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-9.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.884 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000fb0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-6.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.884 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000acd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-17.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.884 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f34 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-44.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.884 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000aa3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-3.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.884 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000efe (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-62.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.885 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000a98 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-7.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.885 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001069 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-6.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.885 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ab5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-25.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.885 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000a95 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-8.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.885 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f69 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-24.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.885 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ddd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-68.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.885 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ae8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-8.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.885 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000100a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-37.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.885 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000dd9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-26.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.885 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001033 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-17.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.886 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000a4c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-32.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.886 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000101c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-28.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.886 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000a71 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-21.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.886 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000fb6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-3.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.886 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001012 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-33.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.886 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000a54 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-30.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.886 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001024 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-24.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.886 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000a85 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-13.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.886 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000fde (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-57.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.886 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000a9b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-6.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.886 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000fab (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-7.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.886 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000aa6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-2.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.886 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001000 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-42.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.887 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000a49 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-33.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.887 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000fcb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-68.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.887 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001006 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-39.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.887 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000af1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-5.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.887 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000a5b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-28.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.887 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000af7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.888 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f07 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-59.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.888 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000adf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-11.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.888 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001045 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-13.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.888 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f7f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-18.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.888 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000a45 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-34.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.888 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001030 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-18.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.888 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000a58 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-29.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.888 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000abb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-23.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.889 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000102e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-19.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.889 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000abe (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-22.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.889 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f21 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-51.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.889 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000a89 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-11.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.889 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f62 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-27.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.889 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000a7e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-16.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.889 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000100e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-35.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.889 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000a63 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-26.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.889 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001080 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-2.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.889 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ad3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-15.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.890 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f77 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-20.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.890 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001040 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-14.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.890 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000a8e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-10.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.890 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000adc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-12.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.890 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f3f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-41.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.890 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f31 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-45.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.890 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000aa0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-4.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.890 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000fd5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-61.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.891 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001064 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-7.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.891 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000a66 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-25.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.891 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000f58 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-31.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.891 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000105a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-9.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.891 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000a39 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-38.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.891 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ac1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-21.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.891 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000a42 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-35.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.891 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000a80 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-15.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.891 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000a76 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-19.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.891 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ac4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-20.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.891 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000aaf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-27.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.892 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000a3c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-37.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.892 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000a3f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-36.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.892 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000a87 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-12.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.892 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000aa9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-1.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.892 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000a6b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-23.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.892 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000a7b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-17.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.892 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001074 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-4.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.892 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:46.892 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ad0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-16.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.893 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000a6e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-22.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.893 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000a82 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-14.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.893 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:46.893 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: scrub summary: active paths [/] 2024-09-19T07:13:46.893 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010ee (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-37.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.893 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010e3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-39.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.893 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010f2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-36.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.893 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001162 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-12.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.893 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001185 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-1.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.893 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001193 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-16.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.893 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001132 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-23.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.893 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000114d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-17.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.894 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000118b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-21.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.894 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010f8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-35.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.894 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010df (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-40.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.894 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001157 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-15.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.894 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001144 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-19.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.894 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010d5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-42.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.894 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001187 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-23.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.894 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000115b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-14.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.894 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010bf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-46.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.894 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010ba (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-47.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.894 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001189 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-22.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.894 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001168 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-11.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.894 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001121 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-26.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.895 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001151 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-16.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.895 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001196 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-15.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.895 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000116b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-10.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.895 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000119c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-12.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.895 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010b5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-48.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.895 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001128 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-25.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.895 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000117d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-4.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.895 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011b6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-3.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.895 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010e9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-38.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.895 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000119f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-11.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.895 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000117c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-5.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.895 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010fd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-34.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.895 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001112 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-29.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.895 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001135 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-22.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.896 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010b0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-49.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.896 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010d1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-43.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.896 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001101 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-33.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.896 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011b0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-5.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.896 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001099 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-53.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.896 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001115 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-28.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.896 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000109f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-52.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.896 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001171 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-8.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.896 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011a7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-8.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.896 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001105 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-32.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.896 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000113b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-21.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.896 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000110e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-30.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.896 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001160 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-13.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.897 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010aa (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-50.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.897 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001179 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-6.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.897 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001182 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-2.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.897 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011a1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-10.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.897 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011bb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-1.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.897 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000116e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-9.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.897 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010ca (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-44.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.897 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011ac (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-6.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.898 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000112c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-24.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.898 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001191 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-17.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.898 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001180 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-3.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.898 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001174 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-7.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.898 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001199 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-13.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.898 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000118f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-18.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.898 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001147 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-18.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.898 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000118e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-19.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.898 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010a4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-51.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.898 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000111c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-27.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.899 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011b3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-4.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.899 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011b9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-2.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.899 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000113f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-20.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.899 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001197 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-14.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.899 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010da (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-41.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.900 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011aa (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-7.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.900 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010c6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-45.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.900 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001109 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-31.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:46.900 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:46.900 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: scrub summary: active paths [/] 2024-09-19T07:13:46.900 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:46.900 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: scrub summary: active paths [/] 2024-09-19T07:13:46.900 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000d99 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-13.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.900 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000003c1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-64.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.900 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000d8d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-21.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.900 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000d14 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-26.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.900 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000d8f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-75.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.901 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000402 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-37.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.901 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000527 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-27.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.901 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000003af (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-73.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.901 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000003fa (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-39.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.901 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000404 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-36.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.901 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000044c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-12.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.901 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000004dc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-52.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.901 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000046d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-1.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.901 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000d0a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-30.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.901 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000513 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-34.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.902 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000004da (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-53.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.902 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000004af (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-67.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.902 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000da3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-3.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.902 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000d94 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-18.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.902 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000003bd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-66.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.902 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000003a3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-77.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.902 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000543 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-16.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.902 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000d9a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-12.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.902 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000049a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-74.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.902 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000cd3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-49.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.902 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ce8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-42.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.902 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000042b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-23.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.902 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000043d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-17.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.903 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000494 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-76.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.903 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000518 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-32.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.903 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000003c3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-63.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.903 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000004e8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-48.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.903 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ccd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-51.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.903 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000003b1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-72.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.903 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000049d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-73.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.904 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000539 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-21.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.904 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000407 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-35.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.904 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000497 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-75.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.904 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000da5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-1.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.904 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000003f8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-40.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.904 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000051f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-30.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.904 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000443 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-15.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.904 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000cee (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-40.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.904 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000d02 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-33.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.904 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000cf1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-39.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.904 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000050d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-36.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.905 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000004f7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-43.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.905 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000437 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-19.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.905 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000053c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-20.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.905 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000d04 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-32.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.905 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000cc4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-54.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.905 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000003f3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-42.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.905 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000506 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-38.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.905 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000d9c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-10.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.905 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000cc7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-53.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.905 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000da0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-6.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.905 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000005a5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.905 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000004d3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-55.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.905 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000d8e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-11.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.906 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000004a6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-70.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.906 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000461 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-5.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.906 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000040a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-34.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.906 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000cfd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-35.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.906 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000d10 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-28.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.906 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000cbb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-57.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.906 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000039f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-78.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.906 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000004a3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-71.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.906 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000419 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-29.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.906 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000003c9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-60.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.906 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000004bc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-63.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.906 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000501 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-40.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.906 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000cf4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-38.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.907 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000007dd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-22.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.907 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000473 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-87.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.907 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000047c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-84.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.907 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000d9e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-8.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.907 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000d1c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-22.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.907 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000da4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-2.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.907 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000476 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-86.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.907 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000003f1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-43.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.907 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ce2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-44.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.907 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000040e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-33.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.907 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000db9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-81.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.907 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000005a1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-5.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.907 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000d12 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-27.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.908 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000004e2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-50.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.908 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000007d7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-58.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.908 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000003cf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-57.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.908 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000cca (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-52.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.908 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000004b5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-65.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.908 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000d9f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-7.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.908 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000d97 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-15.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.908 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000003cd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-58.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.908 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000003d7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-53.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.909 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ce5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-43.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.909 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000d95 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-17.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.909 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000d9d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-9.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.909 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000041c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-28.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.909 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000003d9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-52.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.910 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000491 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-77.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.910 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000004a9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-69.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.910 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000004df (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-51.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.910 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000cdf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-45.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.910 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000004be (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-62.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.910 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000004ef (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-46.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.910 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000004b8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-64.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.910 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000cf7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-37.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.910 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000595 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-10.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.910 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000005aa (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.910 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000d96 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-16.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.911 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000455 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-9.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.911 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000047e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-83.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.911 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000003ef (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-44.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.911 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000059f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-6.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.911 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000003bf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-65.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.911 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000cb8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-58.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.911 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000cc1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-55.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.911 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000003c5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-62.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.911 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000428 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-24.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.911 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000d16 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-25.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.911 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000cff (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-34.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.911 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000525 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-28.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.911 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000ceb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-41.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.911 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000003bb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-67.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.912 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000050a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-37.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.912 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000479 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-85.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.912 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000467 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-3.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.912 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000542 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-17.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.912 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000530 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-24.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.912 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000516 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-33.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.912 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000004ce (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-57.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.912 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000045b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-7.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.912 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000004fb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-42.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.913 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000004ac (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-68.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.913 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000504 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-39.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.913 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000d1a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-23.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.913 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000d18 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-24.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.913 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000003cb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-59.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.913 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000058d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-13.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.913 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000cbe (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-56.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.913 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000540 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-18.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.913 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000da1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-5.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.913 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000003ad (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-74.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.913 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000053e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-19.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.913 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000043a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-18.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.913 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000d0e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-29.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.913 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000003db (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-51.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.914 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000482 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-82.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.914 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000041f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-27.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.914 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000005a3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-4.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.914 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000050f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-35.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.914 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000005a7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.914 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000048e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-78.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.914 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000003b5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-70.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.914 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000dbc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-20.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.914 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000058b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-14.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.914 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000003c7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-61.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.914 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000003f5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-41.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.914 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000003ec (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-45.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.914 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000003b7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-69.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.915 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000004c1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-61.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.915 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000059e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-7.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.915 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000413 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-31.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.915 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000597 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-9.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.915 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000d9b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-11.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.915 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000d90 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-20.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.915 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000b75 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-13.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.915 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000b33 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-18.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.915 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000b90 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-4.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.915 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000b96 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.915 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000d85 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-93.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.915 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000b2d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-20.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.915 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000b72 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-14.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.915 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000b87 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-7.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.916 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000b81 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-9.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.916 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000b7e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-10.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.916 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000b4e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-9.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.916 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000b99 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.916 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000b8a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-6.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.916 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000d86 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-85.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.916 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000b69 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-17.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.916 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000b60 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-3.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.916 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000b51 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-8.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.916 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000b84 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-8.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.916 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000b2a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-21.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.916 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000b42 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-13.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.916 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000b57 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-6.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.917 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000b63 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-2.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.917 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000c43 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-96.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.917 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000b8d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-5.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.917 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000b93 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.917 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000b7b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-11.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.917 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000b5a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-5.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.917 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000b27 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-22.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.917 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000b3f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-14.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.917 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000b48 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-11.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.917 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000b39 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-16.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.917 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000b6f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-15.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.917 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000b4b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-10.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.917 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000b78 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-12.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.917 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000b5d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-4.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.918 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000b3c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-15.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.918 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000b30 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-19.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.918 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000b45 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-12.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.918 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000d4a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-1.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.918 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000b6c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-16.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.918 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000b24 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-23.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.918 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000000b36 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-17.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:46.918 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:46 smithi148 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:47.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000dac (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-14.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000db4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-11.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.135 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000da8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-16.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.135 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000db8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-10.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.135 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000dcc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-4.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.135 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000daa (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-15.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.135 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000db0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-12.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.135 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ddb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-1.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.135 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:47.135 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: pgmap v84: 97 pgs: 97 active+clean; 138 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 857 KiB/s rd, 12 MiB/s wr, 1.13k op/s 2024-09-19T07:13:47.135 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: scrub summary: active paths [/] 2024-09-19T07:13:47.136 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:47.136 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: scrub summary: active paths [/] 2024-09-19T07:13:47.136 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000012cd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-27.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.136 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000127b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-52.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.136 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011ed (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-1.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.136 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000012b5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-34.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.136 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001276 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-53.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.136 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000123d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-67.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.137 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000121e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-74.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.137 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001215 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-76.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.137 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000012bc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-32.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.137 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001288 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-48.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.137 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000012e7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-21.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.137 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001223 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-73.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.137 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000121b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-75.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.137 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000012ad (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-36.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.137 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001297 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-43.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.137 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000012a6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-38.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.137 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000012dd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-23.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.137 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000120c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-79.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.137 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001291 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-45.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.138 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000129d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-41.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.138 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000125a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-60.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.138 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001243 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-66.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.138 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001208 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-80.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.138 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000012e2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-22.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.138 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000126a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-56.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.138 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000128b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-47.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.138 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001294 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-44.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.138 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001227 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-72.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.138 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000125f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-59.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.138 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000126e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-55.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.138 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000122f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-70.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.138 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000122b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-71.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.138 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000124f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-63.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.139 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000012a0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-40.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.139 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011f3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-87.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.139 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011fb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-84.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.139 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011f6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-86.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.139 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001205 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-81.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.139 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001282 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-50.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.139 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001262 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-58.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.139 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001247 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-65.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.139 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001213 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-77.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.139 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001234 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-69.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.139 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000127e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-51.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.139 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001253 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-62.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.139 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000128e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-46.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.139 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000012d5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-25.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.140 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000012bf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-31.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.140 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001285 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-49.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.140 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011f0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-88.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.140 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000012d1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-26.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.140 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001273 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-54.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.140 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000012c5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-29.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.140 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000124b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-64.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.140 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011ff (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-83.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.140 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000012c9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-28.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.140 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000012a9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-37.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.140 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011f8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-85.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.140 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000012d9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-24.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.140 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001267 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-57.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.140 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000012b9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-33.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.141 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000129a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-42.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.141 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001236 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-68.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.141 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000012a3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-39.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.141 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001201 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-82.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.141 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000012b1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-35.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.141 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000120f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-78.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.141 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001257 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-61.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.141 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:47.141 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: scrub summary: active paths [/] 2024-09-19T07:13:47.141 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: scrub summary: active paths [/] 2024-09-19T07:13:47.141 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011df (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-18.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.141 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011dd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-19.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.141 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011ee (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-13.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.147 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000121c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-4.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.147 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001224 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.147 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011ec (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-14.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.148 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000120d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-7.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.148 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001200 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-9.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.148 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011f9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-10.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.148 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001228 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.148 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011ca (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-9.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.148 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001214 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-6.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.148 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011e1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-17.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.148 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011d6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-3.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.148 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011ce (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-7.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.148 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001207 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-8.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.148 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000008c7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-64.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.148 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011cc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-8.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.148 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000093b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-37.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.149 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011c0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-13.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.149 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000008a4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-73.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.149 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011d0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-6.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.149 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000933 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-39.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.149 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000093e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-36.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.149 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011d8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-2.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.149 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000987 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-12.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.149 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000009a5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-1.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.149 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000008bf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-66.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.149 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001216 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-5.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.149 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000009a7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-16.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.149 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000966 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-23.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.149 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001163 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-42.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.149 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000008cb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-63.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.150 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000978 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-17.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.150 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000121f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.150 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011f5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-11.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.150 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000008a8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-72.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.150 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011d2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-5.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.150 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011c5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-11.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.150 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000942 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-35.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.150 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011e8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-15.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.150 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011c8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-10.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.150 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011f2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-12.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.150 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011d4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-4.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.150 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000092f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-40.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.150 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000097e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-15.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.150 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001173 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-40.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.151 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000117a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-39.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.151 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000972 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-19.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.151 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011c2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-12.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.151 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011db (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-1.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.151 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000928 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-42.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.151 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000918 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-46.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.151 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000981 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-14.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.151 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000912 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-47.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.151 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000008ac (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-71.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.151 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011e4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-16.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.151 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000098a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-11.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.151 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:47.151 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000097b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-16.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.151 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000008f1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-54.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.152 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000095d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-26.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.152 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000009a8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-15.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.152 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000098d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-10.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.152 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000009ab (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-12.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.152 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000090d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-48.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.152 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000099f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-4.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.152 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000960 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-25.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.152 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000936 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-38.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.152 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000009b7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-3.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.152 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000009ac (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-11.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.152 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000099c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-5.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.152 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000945 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-34.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.152 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000954 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-29.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.153 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000008d7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-60.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.153 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000969 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-22.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.153 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011fc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-38.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.153 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000909 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-49.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.153 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001155 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-44.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.153 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000924 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-43.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.153 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000948 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-33.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.153 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000009b4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-5.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.153 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000008e4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-57.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.153 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000008e0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-58.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.153 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000008f6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-53.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.154 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000115d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-43.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.154 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000957 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-28.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.154 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000009c6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-55.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.154 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000008fc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-52.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.154 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000993 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-8.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.154 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000008b8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-68.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.154 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000009af (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-8.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.154 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000094b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-32.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.154 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000096c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-21.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.154 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000951 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-30.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.154 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000120b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-36.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.154 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000984 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-13.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.154 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000905 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-50.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.154 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000999 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-6.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.155 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000009a3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-2.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.155 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000008e9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-56.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.155 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001204 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-37.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.155 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000009ad (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-10.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.155 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000009bc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-1.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.155 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000990 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-9.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.155 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000920 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-44.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.155 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000009b2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-6.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.155 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000008c3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-65.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.155 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000963 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-24.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.155 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000008cf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-62.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.155 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001169 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-41.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.155 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000008bb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-67.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.156 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000009a6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-17.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.156 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000009a1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-3.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.156 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000996 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-7.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.156 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000008db (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-59.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.156 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000009aa (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-13.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.156 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000975 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-18.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.156 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000900 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-51.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.156 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000095a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-27.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.156 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000009b6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-4.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.156 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000009b9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-2.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.156 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000096f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-20.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.156 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000008b0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-70.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.156 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000009a9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-14.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.157 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000092c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-41.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.157 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000008d3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-61.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.157 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000008b4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-69.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.157 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000091c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-45.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.157 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000009b1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-7.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.157 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000094e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-31.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.157 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000009ae (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-9.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.157 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:47.157 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: scrub summary: active paths [/] 2024-09-19T07:13:47.157 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: scrub summary: active paths [/] 2024-09-19T07:13:47.157 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ef8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-64.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.157 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000007c4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-37.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.157 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000719 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-75.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.157 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000101e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-27.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.158 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f45 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-39.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.158 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f4c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-36.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.158 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f97 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-12.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.158 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000feb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-52.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.158 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000007bb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-39.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.158 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000725 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-73.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.158 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000007c9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-36.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.158 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000fba (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-1.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.158 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000835 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-12.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.158 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001010 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-34.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.158 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000085f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-1.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.158 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000074e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-66.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.158 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000863 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-16.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.159 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000fe8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-53.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.159 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000070d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-77.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.159 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000fcc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-67.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.159 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000809 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-23.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.159 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000822 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-17.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.159 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000075b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-63.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.159 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001038 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-16.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.159 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000072b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-72.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.159 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000fc2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-74.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.159 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000007ce (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-35.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.159 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f6c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-23.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.159 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000007b6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-40.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.159 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000fbc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-76.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.159 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000082a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-15.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.159 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001014 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-32.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.160 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000081a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-19.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.160 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000efa (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-63.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.160 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f83 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-17.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.160 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000082d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-14.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.160 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ff4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-48.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.160 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000007ac (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-42.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.160 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000fc3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-73.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.160 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000102a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-21.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.160 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000079b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-46.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.160 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000fbf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-75.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.160 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000797 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-47.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.161 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f42 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-40.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.161 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000731 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-71.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.161 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000839 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-11.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.161 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f8b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-15.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.161 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000827 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-16.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.161 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001018 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-30.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.161 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000007fc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-26.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.161 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000077d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-54.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.162 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000100c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-36.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.162 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000867 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-15.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.162 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ffe (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-43.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.162 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000083d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-10.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.162 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000102c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-20.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.162 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f3b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-42.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.162 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f7b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-19.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.162 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001008 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-38.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.162 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000873 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-12.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.162 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001026 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-23.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.162 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f8f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-14.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.162 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000853 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-4.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.162 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ffa (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-45.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.163 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001002 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-41.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.163 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000007bf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-38.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.163 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000801 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-25.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.163 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f2f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-46.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.163 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000897 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.163 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000877 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-11.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.163 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000850 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-5.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.163 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000007d4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-34.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.163 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000fd7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-60.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.163 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000006f5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-81.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.163 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000fcd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-66.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.163 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000707 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-78.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.163 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000007ed (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-29.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.164 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f2d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-47.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.164 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000766 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-60.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.164 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001028 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-22.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.164 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000080f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-22.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.164 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f9c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-11.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.164 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000790 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-49.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.164 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f19 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-54.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.164 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f87 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-16.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.164 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000007a7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-43.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.164 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f64 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-26.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.164 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000007d9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-33.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.164 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000103c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-15.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.164 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000088f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-5.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.164 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000fdf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-56.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.165 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000771 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-57.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.165 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ff6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-47.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.165 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000fa0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-10.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.165 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000701 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-79.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.165 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000104a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-12.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.165 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ffc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-44.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.165 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000076e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-58.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.165 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000781 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-53.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.165 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000fb4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-4.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.165 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000007f1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-28.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.165 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f67 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-25.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.165 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000fd9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-59.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.165 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000784 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-52.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.166 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000fc5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-72.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.166 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f48 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-38.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.166 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000779 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-55.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.166 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000844 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-8.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.166 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000743 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-68.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.166 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000107a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-3.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.166 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000713 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-76.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.166 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000883 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-8.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.166 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000fe2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-55.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.166 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000007e0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-32.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.166 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000104f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-11.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.166 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000007e9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-30.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.166 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000fc9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-70.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.166 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000814 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-21.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.167 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000fb3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-5.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.167 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f51 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-34.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.167 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000831 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-13.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.167 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000078d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-50.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.167 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000085b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-2.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.167 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000fc7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-71.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.167 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000084c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-6.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.167 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f5d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-29.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.167 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f03 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-60.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.167 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000775 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-56.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.167 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000fd1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-63.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.167 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000006fb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-80.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.167 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001004 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-40.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.167 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000089f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.168 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000087b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-10.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.168 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f6f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-22.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.168 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000840 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-9.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.168 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f27 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-49.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.168 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000007a3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-44.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.168 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000088b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-6.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.168 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f37 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-43.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.168 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000753 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-65.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.168 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f53 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-33.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.168 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000805 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-24.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.168 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000106e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-5.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.168 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000075e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-62.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.168 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ff0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-50.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.169 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000857 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-3.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.169 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000fdb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-58.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.169 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000848 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-7.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.169 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f0f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-57.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.169 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000769 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-59.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.169 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000fce (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-65.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.169 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000086f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-13.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.169 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000071f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-74.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.169 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000081e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-18.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.169 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f0b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-58.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.169 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f1c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-53.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.169 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000788 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-51.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.169 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000007f7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-27.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.170 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f60 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-28.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.170 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000893 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-4.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.170 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000089b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.170 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f1f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-52.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.170 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000737 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-70.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.170 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000fca (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-69.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.170 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000817 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-20.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.170 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000fee (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-51.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.170 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000086b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-14.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.170 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000fd3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-62.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.170 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000762 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-61.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.170 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000007b2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-41.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.170 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ff8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-46.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.170 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000079f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-45.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.171 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000fa8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-8.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.171 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000073d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-69.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.171 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001022 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-25.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.171 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001016 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-31.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.171 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000887 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-7.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.171 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ff2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-49.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.171 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000007e5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-31.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.171 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000087f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-9.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.171 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ad9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-13.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.171 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000105f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-8.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.171 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000aca (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-18.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.171 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001020 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-26.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.171 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000a79 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-18.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.171 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f56 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-32.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.172 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ac7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-19.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.172 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f72 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-21.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.172 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000a5f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-27.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.172 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f5b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-30.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.172 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000af4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-4.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.172 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f93 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-13.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.172 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000afa (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.172 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000a74 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-20.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.172 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f25 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-50.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.172 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ad6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-14.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.172 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000fb8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-2.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.172 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000aeb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-7.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.172 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000a50 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-31.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.172 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000fe5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-54.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.173 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ae5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-9.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.173 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000101a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-29.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.173 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ae2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-10.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.173 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000afd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.173 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000a91 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-9.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.173 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001054 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-10.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.173 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000aee (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-6.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.173 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001086 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-1.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.173 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000a69 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-24.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.173 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000fd0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-64.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.173 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000aac (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-28.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.173 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ab8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-24.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.173 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000fa4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-9.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.174 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000fb0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-6.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.174 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000acd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-17.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.174 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f34 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-44.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.174 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000aa3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-3.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.174 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000efe (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-62.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.174 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000a98 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-7.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.174 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001069 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-6.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.174 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ab5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-25.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.174 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000a95 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-8.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.174 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f69 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-24.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.174 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ddd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-68.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.174 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ae8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-8.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.174 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000100a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-37.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.174 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000dd9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-26.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.175 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001033 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-17.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.175 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000a4c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-32.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.175 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000101c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-28.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.175 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000a71 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-21.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.175 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000fb6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-3.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.175 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001012 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-33.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.175 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000a54 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-30.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.175 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001024 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-24.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.175 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000a85 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-13.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.175 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000fde (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-57.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.175 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000a9b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-6.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.176 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000fab (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-7.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.176 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000aa6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-2.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.176 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001000 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-42.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.176 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000a49 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-33.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.176 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000fcb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-68.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.176 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001006 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-39.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.176 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000af1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-5.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.176 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000a5b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-28.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.176 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000af7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.176 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f07 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-59.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.176 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000adf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-11.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.176 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001045 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-13.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.176 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f7f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-18.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.176 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000a45 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-34.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.177 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001030 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-18.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.177 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000a58 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-29.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.177 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000abb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-23.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.177 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000102e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-19.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.177 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000abe (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-22.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.177 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f21 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-51.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.177 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000a89 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-11.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.177 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f62 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-27.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.177 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000a7e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-16.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.177 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000100e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-35.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.177 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000a63 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-26.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.177 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001080 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-2.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.177 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ad3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-15.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.177 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f77 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-20.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.178 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001040 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-14.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.178 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000a8e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-10.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.178 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000adc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-12.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.178 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f3f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-41.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.178 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f31 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-45.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.178 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000aa0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-4.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.179 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000fd5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-61.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.179 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001064 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-7.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.179 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000a66 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-25.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.179 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000f58 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-31.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.179 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000105a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-9.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.179 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000a39 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-38.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.179 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ac1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-21.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.179 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000a42 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-35.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.179 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000a80 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-15.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.179 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000a76 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-19.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.179 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ac4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-20.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.179 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000aaf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-27.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.179 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000a3c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-37.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.179 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000a3f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-36.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.180 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000a87 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-12.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.180 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000aa9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-1.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.180 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000a6b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-23.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.180 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000a7b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-17.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.180 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001074 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-4.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.180 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:47.180 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ad0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-16.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.180 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000a6e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-22.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.180 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000a82 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-14.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.180 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:47.180 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: scrub summary: active paths [/] 2024-09-19T07:13:47.180 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010ee (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-37.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.180 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010e3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-39.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.181 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010f2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-36.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.181 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001162 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-12.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.181 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001185 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-1.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.181 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001193 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-16.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.181 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001132 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-23.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.181 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000114d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-17.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.181 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000118b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-21.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.181 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010f8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-35.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.181 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010df (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-40.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.181 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001157 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-15.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.181 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001144 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-19.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.181 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010d5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-42.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.181 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001187 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-23.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.182 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000115b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-14.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.182 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010bf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-46.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.182 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010ba (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-47.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.182 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001189 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-22.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.182 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001168 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-11.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.182 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001121 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-26.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.182 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001151 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-16.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.182 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001196 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-15.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.182 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000116b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-10.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.182 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000119c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-12.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.182 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010b5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-48.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.182 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001128 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-25.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.182 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000117d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-4.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.182 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011b6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-3.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.183 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010e9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-38.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.183 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000119f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-11.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.183 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000117c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-5.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.183 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010fd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-34.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.183 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001112 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-29.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.183 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001135 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-22.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.183 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010b0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-49.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.183 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010d1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-43.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.183 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001101 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-33.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.183 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011b0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-5.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.183 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001099 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-53.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.183 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001115 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-28.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.183 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000109f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-52.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.183 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001171 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-8.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.184 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011a7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-8.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.184 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001105 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-32.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.184 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000113b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-21.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.184 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000110e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-30.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.184 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001160 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-13.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.184 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010aa (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-50.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.184 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001179 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-6.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.184 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001182 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-2.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.184 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011a1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-10.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.184 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011bb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-1.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.184 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000116e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-9.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.184 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010ca (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-44.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.184 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011ac (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-6.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.185 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000112c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-24.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.185 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001191 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-17.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.185 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001180 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-3.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.185 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001174 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-7.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.185 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001199 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-13.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.185 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000118f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-18.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.185 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001147 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-18.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.185 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000118e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-19.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.185 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010a4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-51.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.185 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000111c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-27.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.185 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011b3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-4.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.185 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011b9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-2.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.185 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000113f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-20.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.185 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001197 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-14.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.186 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010da (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-41.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.186 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011aa (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-7.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.186 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010c6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-45.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.186 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001109 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-31.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:47.186 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:47.186 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: scrub summary: active paths [/] 2024-09-19T07:13:47.186 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:47.186 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: scrub summary: active paths [/] 2024-09-19T07:13:47.186 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000d99 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-13.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.186 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000003c1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-64.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.186 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000d8d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-21.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.186 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000d14 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-26.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.186 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000d8f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-75.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.187 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000402 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-37.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.187 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000527 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-27.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.187 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000003af (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-73.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.187 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000003fa (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-39.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.187 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000404 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-36.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.187 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000044c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-12.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.187 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000004dc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-52.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.187 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000046d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-1.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.187 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000d0a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-30.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.187 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000513 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-34.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.187 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000004da (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-53.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.187 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000004af (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-67.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.187 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000da3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-3.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.187 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000d94 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-18.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.188 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000003bd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-66.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.188 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000003a3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-77.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.188 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000543 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-16.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.188 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000d9a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-12.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.188 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000049a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-74.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.188 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000cd3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-49.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.188 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ce8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-42.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.188 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000042b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-23.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.188 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000043d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-17.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.188 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000494 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-76.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.188 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000518 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-32.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.188 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000003c3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-63.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.188 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000004e8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-48.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.189 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ccd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-51.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.189 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000003b1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-72.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.189 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000049d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-73.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.189 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000539 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-21.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.189 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000407 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-35.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.189 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000497 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-75.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.189 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000da5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-1.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.189 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000003f8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-40.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.189 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000051f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-30.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.189 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000443 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-15.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.189 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000cee (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-40.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.189 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000d02 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-33.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.189 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000cf1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-39.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.189 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000050d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-36.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.190 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000004f7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-43.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.190 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000437 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-19.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.190 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000053c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-20.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.190 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000d04 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-32.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.190 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000cc4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-54.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.190 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000003f3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-42.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.190 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000506 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-38.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.190 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000d9c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-10.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.190 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000cc7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-53.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.190 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000da0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-6.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.190 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000005a5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.190 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000004d3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-55.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.190 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000d8e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-11.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.190 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000004a6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-70.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.191 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000461 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-5.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.191 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000040a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-34.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.191 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000cfd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-35.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.191 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000d10 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-28.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.191 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000cbb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-57.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.191 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000039f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-78.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.191 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000004a3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-71.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.191 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000419 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-29.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.191 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000003c9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-60.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.191 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000004bc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-63.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.191 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000501 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-40.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.191 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000cf4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-38.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.191 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000007dd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-22.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.192 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000473 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-87.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.192 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000047c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-84.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.192 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000d9e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-8.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.192 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000d1c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-22.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.192 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000da4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-2.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.192 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000476 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-86.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.192 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000003f1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-43.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.192 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ce2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-44.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.192 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000040e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-33.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.192 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000db9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-81.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.192 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000005a1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-5.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.192 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000d12 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-27.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.192 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000004e2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-50.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.192 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000007d7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-58.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.193 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000003cf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-57.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.193 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000cca (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-52.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.193 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000004b5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-65.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.193 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000d9f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-7.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.193 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000d97 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-15.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.193 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000003cd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-58.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.193 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000003d7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-53.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.193 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ce5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-43.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.193 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000d95 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-17.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.193 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000d9d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-9.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.193 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000041c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-28.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.193 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000003d9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-52.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.193 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000491 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-77.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.194 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000004a9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-69.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.194 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000004df (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-51.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.194 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000cdf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-45.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.194 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000004be (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-62.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.194 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000004ef (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-46.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.194 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000004b8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-64.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.194 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000cf7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-37.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.194 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000595 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-10.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.194 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000005aa (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.194 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000d96 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-16.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.194 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000455 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-9.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.194 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000047e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-83.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.194 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000003ef (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-44.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.194 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000059f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-6.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.195 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000003bf (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-65.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.195 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000cb8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-58.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.195 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000cc1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-55.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.195 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000003c5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-62.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.195 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000428 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-24.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.195 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000d16 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-25.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.195 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000cff (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-34.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.195 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000525 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-28.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.195 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000ceb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-41.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.195 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000003bb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-67.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.195 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000050a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-37.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.195 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000479 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-85.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.195 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000467 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-3.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.195 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000542 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-17.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.196 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000530 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-24.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.196 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000516 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-33.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.196 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000004ce (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-57.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.196 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000045b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-7.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.196 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000004fb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-42.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.196 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000004ac (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-68.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.196 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000504 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-39.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.196 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000d1a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-23.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.196 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000d18 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-24.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.196 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000003cb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-59.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.196 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000058d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-13.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.196 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000cbe (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-56.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.196 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000540 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-18.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.197 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000da1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-5.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.197 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000003ad (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-74.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.197 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000053e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-19.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.197 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000043a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-18.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.197 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000d0e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-29.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.197 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000003db (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-51.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.197 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000482 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-82.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.197 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000041f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-27.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.197 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000005a3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-4.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.197 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000050f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-35.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.197 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000005a7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.197 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000048e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-78.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.197 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000003b5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-70.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.197 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000dbc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-20.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.198 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000058b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-14.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.198 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000003c7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-61.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.198 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000003f5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-41.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.198 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000003ec (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-45.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.198 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000003b7 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-69.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.198 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000004c1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-61.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.198 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000059e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-7.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.198 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000413 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-31.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.198 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000597 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-9.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.198 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000d9b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-11.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.198 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000d90 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-20.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.198 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000b75 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-13.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.198 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000b33 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-18.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.198 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000b90 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-4.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.199 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000b96 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.199 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000d85 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-93.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.199 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000b2d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-20.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.199 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000b72 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-14.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.199 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000b87 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-7.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.199 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000b81 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-9.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.199 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000b7e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-10.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.199 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000b4e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-9.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.199 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000b99 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.199 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000b8a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-6.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.200 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000d86 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-85.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.200 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000b69 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-17.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.200 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000b60 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-3.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.200 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000b51 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-8.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.200 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000b84 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-8.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.200 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000b2a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-21.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.200 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000b42 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-13.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.200 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000b57 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-6.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.200 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000b63 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-2.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.200 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000c43 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-96.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.200 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000b8d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-5.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.200 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000b93 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.200 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000b7b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-11.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.201 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000b5a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-5.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.201 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000b27 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-22.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.201 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000b3f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-14.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.201 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000b48 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-11.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.201 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000b39 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-16.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.201 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000b6f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-15.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.201 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000b4b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-10.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.201 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000b78 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-12.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.201 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000b5d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-4.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.201 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000b3c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-15.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.201 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000b30 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-19.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.201 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000b45 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-12.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.201 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000d4a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-1.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.202 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000b6c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-16.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.202 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000b24 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-23.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.202 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000000b36 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-17.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:13:47.202 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:46 smithi165 ceph-mon[35326]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:47.647 INFO:tasks.cephfs.filesystem:scrub status for tag:b3915a2a-00bd-4db1-af26-9326d1b8231b - {'path': '/', 'tag': 'b3915a2a-00bd-4db1-af26-9326d1b8231b', 'options': 'recursive,force'} 2024-09-19T07:13:47.678 INFO:journalctl@ceph.mds.f.smithi179.stdout:Sep 19 07:13:47 smithi179 podman[69810]: 2024-09-19 07:13:47.300002232 +0000 UTC m=+1.155959879 container create 77788550133c7c42c5b90da22dff7a625da3ecb69030e1ed2d7225bc611bc844 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:13:48.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: scrub summary: active paths [/] 2024-09-19T07:13:48.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:48.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: scrub summary: active paths [/] 2024-09-19T07:13:48.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001299 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-27.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000123e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-52.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001077 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/article-1.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001284 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-34.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001154 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-67.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000123b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-53.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000107e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-90.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000012be (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-16.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001106 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-74.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010f4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-76.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000124e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-48.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001117 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-73.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000128a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-32.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.025 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000012ac (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-21.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.025 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010fe (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-75.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.025 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001290 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-30.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.025 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000127d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-36.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.025 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001261 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-43.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.025 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000012b0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-20.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.025 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001275 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-38.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.025 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000012a5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-23.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.025 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010d6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-79.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.025 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001259 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-45.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.025 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001269 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-41.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.025 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000120a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-60.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.026 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001159 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-66.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.026 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010cc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-80.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.026 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000012a8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-22.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.026 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000012c1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-15.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.026 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001225 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-56.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.026 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001252 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-47.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.026 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000012cc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-12.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.026 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000125e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-44.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.026 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001067 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/article-4.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.026 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001123 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-72.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.026 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001211 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-59.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.026 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000012d0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-11.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.026 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001138 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-70.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.027 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000122e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-55.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.027 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001131 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-71.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.027 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001061 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/article-5.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.027 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011fa (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-63.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.027 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001090 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-87.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.028 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000126d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-40.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.028 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010a2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-84.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.028 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001097 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-86.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.028 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010c1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-81.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.028 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001246 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-50.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.028 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001217 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-58.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.028 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011e9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-65.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.028 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010ea (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-77.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.028 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000113e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-69.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.028 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001242 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-51.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001256 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-46.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011fd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-62.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000129f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-25.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000128d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-31.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000124a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-49.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000012dc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-8.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000108a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-88.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000129c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-26.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001072 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/article-2.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000105d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/article-6.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001237 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-54.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001293 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-29.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000011f1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-64.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000012d4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-10.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.030 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010ab (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-83.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.030 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001296 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-28.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.030 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000127a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-37.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.030 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000012bb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-17.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.030 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000109d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-85.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.030 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000106b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/article-3.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.030 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000012a2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-24.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.030 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001287 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-33.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.030 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000121d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-57.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.030 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001057 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/article-7.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.030 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001266 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-42.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.030 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000114a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-68.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.031 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001272 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-39.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.031 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000012c8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-13.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.031 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000012b8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-18.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.031 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000012b3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-19.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.031 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010b6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-82.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.031 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001281 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-35.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.031 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000012c4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-14.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.031 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001083 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-89.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.031 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000010e2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-78.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.031 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001206 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-61.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.031 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000012e1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-7.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.031 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000012d8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-9.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.031 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:47 smithi179 ceph-mon[35716]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:48.035 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: scrub summary: active paths [/] 2024-09-19T07:13:48.036 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:48.036 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: scrub summary: active paths [/] 2024-09-19T07:13:48.036 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001299 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-27.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.036 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000123e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-52.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.036 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001077 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/article-1.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.036 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001284 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-34.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.036 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001154 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-67.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.036 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000123b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-53.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.036 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000107e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-90.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.036 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000012be (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-16.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.036 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001106 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-74.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.036 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010f4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-76.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.037 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000124e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-48.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.037 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001117 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-73.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.037 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000128a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-32.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.037 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000012ac (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-21.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.037 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010fe (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-75.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.037 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001290 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-30.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.037 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000127d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-36.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.037 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001261 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-43.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.037 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000012b0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-20.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.037 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001275 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-38.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.037 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000012a5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-23.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.038 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010d6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-79.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.038 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001259 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-45.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.038 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001269 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-41.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.039 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000120a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-60.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.039 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001159 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-66.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.039 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010cc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-80.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.039 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000012a8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-22.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.039 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000012c1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-15.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.039 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001225 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-56.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.039 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001252 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-47.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.039 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000012cc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-12.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.040 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000125e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-44.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.040 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001067 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/article-4.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.040 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001123 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-72.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.040 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001211 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-59.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.040 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000012d0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-11.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.040 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001138 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-70.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.040 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000122e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-55.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.040 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001131 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-71.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.040 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001061 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/article-5.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.040 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011fa (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-63.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.040 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001090 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-87.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.040 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000126d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-40.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.040 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010a2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-84.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.041 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001097 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-86.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.041 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010c1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-81.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.041 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001246 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-50.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.041 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001217 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-58.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.041 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011e9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-65.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.041 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010ea (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-77.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.041 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000113e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-69.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.041 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001242 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-51.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.041 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001256 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-46.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.041 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011fd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-62.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.041 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000129f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-25.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.041 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000128d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-31.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.041 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000124a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-49.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.041 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000012dc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-8.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.042 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000108a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-88.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.042 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000129c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-26.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.042 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001072 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/article-2.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.043 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000105d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/article-6.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.043 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001237 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-54.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.043 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001293 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-29.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.043 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000011f1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-64.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.043 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000012d4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-10.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.043 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010ab (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-83.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.043 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001296 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-28.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.043 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000127a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-37.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.043 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000012bb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-17.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.044 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000109d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-85.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.044 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000106b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/article-3.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.044 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000012a2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-24.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.044 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001287 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-33.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.044 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000121d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-57.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.044 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001057 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/article-7.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.044 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001266 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-42.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.044 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000114a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-68.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.044 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001272 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-39.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.044 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000012c8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-13.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.044 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000012b8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-18.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.044 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000012b3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-19.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.045 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010b6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-82.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.045 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001281 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-35.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.045 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000012c4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-14.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.045 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001083 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-89.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.045 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000010e2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-78.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.045 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001206 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-61.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.045 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000012e1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-7.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.045 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000012d8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-9.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.045 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:47 smithi165 ceph-mon[35326]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:48.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mon-a[31176]: 2024-09-19T07:13:47.671+0000 7f2e51b2a640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-19T07:13:48.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: scrub summary: active paths [/] 2024-09-19T07:13:48.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:48.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: scrub summary: active paths [/] 2024-09-19T07:13:48.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001299 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-27.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000123e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-52.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001077 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/article-1.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001284 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-34.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001154 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-67.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000123b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-53.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000107e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-90.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000012be (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-16.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001106 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-74.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010f4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-76.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000124e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-48.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001117 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-73.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000128a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-32.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000012ac (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-21.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010fe (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-75.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.086 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001290 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-30.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.086 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000127d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-36.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.086 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001261 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-43.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.086 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000012b0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-20.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.086 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001275 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-38.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.086 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000012a5 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-23.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.086 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010d6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-79.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.086 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001259 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-45.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.086 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001269 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-41.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.086 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000120a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-60.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.086 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001159 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-66.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.086 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010cc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-80.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.087 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000012a8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-22.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.087 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000012c1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-15.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.087 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001225 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-56.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.087 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001252 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-47.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.087 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000012cc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-12.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.087 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000125e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-44.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.087 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001067 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/article-4.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.087 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001123 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-72.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.087 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001211 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-59.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.087 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000012d0 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-11.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.088 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001138 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-70.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.088 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000122e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-55.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.088 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001131 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-71.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.088 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001061 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/article-5.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.088 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011fa (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-63.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.088 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001090 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-87.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.088 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000126d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-40.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.088 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010a2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-84.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.088 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001097 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-86.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.088 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010c1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-81.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.089 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001246 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-50.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.089 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001217 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-58.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.089 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011e9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-65.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.089 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010ea (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-77.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.090 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000113e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-69.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.090 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001242 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-51.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.090 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001256 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-46.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.090 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011fd (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-62.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.090 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000129f (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-25.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.090 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000128d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-31.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.090 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000124a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-49.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.090 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000012dc (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-8.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.090 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000108a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-88.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.090 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000129c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-26.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.090 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001072 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/article-2.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.091 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000105d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/article-6.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.091 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001237 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-54.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.091 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001293 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-29.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.091 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000011f1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-64.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.091 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000012d4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-10.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.091 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010ab (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-83.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.091 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001296 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-28.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.091 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000127a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-37.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.091 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000012bb (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-17.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.091 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000109d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-85.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.091 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000106b (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/article-3.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.091 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000012a2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-24.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.092 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001287 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-33.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.092 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000121d (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-57.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.092 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001057 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/article-7.xml) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.092 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001266 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-42.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.092 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000114a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-68.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.092 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001272 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-39.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.092 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000012c8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-13.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.092 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000012b8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-18.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.092 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000012b3 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-19.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.092 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010b6 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-82.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.092 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001281 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-35.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.093 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000012c4 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-14.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.093 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001083 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-89.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.093 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000010e2 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-78.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.093 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001206 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-61.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.093 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000012e1 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-7.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.093 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000012d8 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-9.jpg) see mds.b log and `damage ls` output for details 2024-09-19T07:13:48.093 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:47 smithi148 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:49.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:48 smithi179 ceph-mon[35716]: scrub summary: active paths [/] 2024-09-19T07:13:49.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:48 smithi179 ceph-mon[35716]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:49.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:48 smithi179 ceph-mon[35716]: pgmap v85: 97 pgs: 97 active+clean; 138 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 11 MiB/s wr, 1.09k op/s 2024-09-19T07:13:49.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:48 smithi179 ceph-mon[35716]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-19T07:13:49.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:48 smithi179 ceph-mon[35716]: mds.? [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] up:active 2024-09-19T07:13:49.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:48 smithi179 ceph-mon[35716]: MDS daemon mds.f is removed because it is dead or otherwise unavailable. 2024-09-19T07:13:49.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:48 smithi179 ceph-mon[35716]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:13:49.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:48 smithi179 ceph-mon[35716]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 5 up:standby 2024-09-19T07:13:49.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:48 smithi148 ceph-mon[31180]: scrub summary: active paths [/] 2024-09-19T07:13:49.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:48 smithi148 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:49.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:48 smithi148 ceph-mon[31180]: pgmap v85: 97 pgs: 97 active+clean; 138 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 11 MiB/s wr, 1.09k op/s 2024-09-19T07:13:49.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:48 smithi148 ceph-mon[31180]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-19T07:13:49.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:48 smithi148 ceph-mon[31180]: mds.? [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] up:active 2024-09-19T07:13:49.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:48 smithi148 ceph-mon[31180]: MDS daemon mds.f is removed because it is dead or otherwise unavailable. 2024-09-19T07:13:49.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:48 smithi148 ceph-mon[31180]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:13:49.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:48 smithi148 ceph-mon[31180]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 5 up:standby 2024-09-19T07:13:49.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:48 smithi165 ceph-mon[35326]: scrub summary: active paths [/] 2024-09-19T07:13:49.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:48 smithi165 ceph-mon[35326]: scrub summary: idle+waiting paths [/] 2024-09-19T07:13:49.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:48 smithi165 ceph-mon[35326]: pgmap v85: 97 pgs: 97 active+clean; 138 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 11 MiB/s wr, 1.09k op/s 2024-09-19T07:13:49.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:48 smithi165 ceph-mon[35326]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-19T07:13:49.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:48 smithi165 ceph-mon[35326]: mds.? [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] up:active 2024-09-19T07:13:49.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:48 smithi165 ceph-mon[35326]: MDS daemon mds.f is removed because it is dead or otherwise unavailable. 2024-09-19T07:13:49.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:48 smithi165 ceph-mon[35326]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:13:49.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:48 smithi165 ceph-mon[35326]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 5 up:standby 2024-09-19T07:13:49.693 INFO:journalctl@ceph.mds.f.smithi179.stdout:Sep 19 07:13:49 smithi179 podman[69810]: 2024-09-19 07:13:49.380411159 +0000 UTC m=+3.236368808 container init 77788550133c7c42c5b90da22dff7a625da3ecb69030e1ed2d7225bc611bc844 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-f, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-19T07:13:49.693 INFO:journalctl@ceph.mds.f.smithi179.stdout:Sep 19 07:13:49 smithi179 podman[69810]: 2024-09-19 07:13:49.383923509 +0000 UTC m=+3.239881175 container start 77788550133c7c42c5b90da22dff7a625da3ecb69030e1ed2d7225bc611bc844 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-f, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-19T07:13:49.693 INFO:journalctl@ceph.mds.f.smithi179.stdout:Sep 19 07:13:49 smithi179 ceph-mds[69830]: -- 172.21.15.179:0/1807335461 <== mon.1 v2:172.21.15.179:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560a8e687860 con 0x560a8e665000 2024-09-19T07:13:49.693 INFO:journalctl@ceph.mds.f.smithi179.stdout:Sep 19 07:13:49 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-f[69825]: starting mds.f at 2024-09-19T07:13:50.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:49 smithi179 ceph-mon[35716]: mds.? [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] up:active 2024-09-19T07:13:50.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:49 smithi179 ceph-mon[35716]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 5 up:standby 2024-09-19T07:13:50.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:49 smithi148 ceph-mon[31180]: mds.? [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] up:active 2024-09-19T07:13:50.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:49 smithi148 ceph-mon[31180]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 5 up:standby 2024-09-19T07:13:50.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:49 smithi165 ceph-mon[35326]: mds.? [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] up:active 2024-09-19T07:13:50.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:49 smithi165 ceph-mon[35326]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 5 up:standby 2024-09-19T07:13:50.693 INFO:journalctl@ceph.mds.f.smithi179.stdout:Sep 19 07:13:50 smithi179 bash[69810]: 77788550133c7c42c5b90da22dff7a625da3ecb69030e1ed2d7225bc611bc844 2024-09-19T07:13:50.693 INFO:journalctl@ceph.mds.f.smithi179.stdout:Sep 19 07:13:50 smithi179 systemd[1]: Started Ceph mds.f for eae8a4a8-7654-11ef-bceb-c7b262605968. 2024-09-19T07:13:51.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:50 smithi179 ceph-mon[35716]: pgmap v86: 97 pgs: 97 active+clean; 138 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 11 MiB/s wr, 1.09k op/s 2024-09-19T07:13:51.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:50 smithi179 ceph-mon[35716]: mds.? [v2:172.21.15.179:6834/3891676893,v1:172.21.15.179:6835/3891676893] up:boot 2024-09-19T07:13:51.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:50 smithi179 ceph-mon[35716]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:13:51.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:50 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T07:13:51.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:50 smithi148 ceph-mon[31180]: pgmap v86: 97 pgs: 97 active+clean; 138 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 11 MiB/s wr, 1.09k op/s 2024-09-19T07:13:51.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:50 smithi148 ceph-mon[31180]: mds.? [v2:172.21.15.179:6834/3891676893,v1:172.21.15.179:6835/3891676893] up:boot 2024-09-19T07:13:51.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:50 smithi148 ceph-mon[31180]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:13:51.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:50 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T07:13:51.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:50 smithi165 ceph-mon[35326]: pgmap v86: 97 pgs: 97 active+clean; 138 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 11 MiB/s wr, 1.09k op/s 2024-09-19T07:13:51.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:50 smithi165 ceph-mon[35326]: mds.? [v2:172.21.15.179:6834/3891676893,v1:172.21.15.179:6835/3891676893] up:boot 2024-09-19T07:13:51.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:50 smithi165 ceph-mon[35326]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:13:51.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:50 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T07:13:52.697 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:52 smithi165 ceph-mon[35326]: pgmap v87: 97 pgs: 97 active+clean; 150 MiB data, 943 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 12 MiB/s wr, 1.35k op/s 2024-09-19T07:13:53.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:52 smithi179 ceph-mon[35716]: pgmap v87: 97 pgs: 97 active+clean; 150 MiB data, 943 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 12 MiB/s wr, 1.35k op/s 2024-09-19T07:13:53.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:52 smithi148 ceph-mon[31180]: pgmap v87: 97 pgs: 97 active+clean; 150 MiB data, 943 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 12 MiB/s wr, 1.35k op/s 2024-09-19T07:13:53.193 INFO:tasks.workunit.client.0.smithi148.stdout: 66 33333 1335 21910 1154 13171 879 2024-09-19T07:13:53.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:53 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mon-a[31176]: 2024-09-19T07:13:53.236+0000 7f2e51b2a640 -1 log_channel(cluster) log [ERR] : Health check update: 2 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-19T07:13:54.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:53 smithi179 ceph-mon[35716]: Health check update: 2 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-19T07:13:54.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:53 smithi148 ceph-mon[31180]: Health check update: 2 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-19T07:13:54.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:53 smithi165 ceph-mon[35326]: Health check update: 2 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-19T07:13:55.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:54 smithi179 ceph-mon[35716]: pgmap v88: 97 pgs: 97 active+clean; 150 MiB data, 943 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 8.0 MiB/s wr, 1.16k op/s 2024-09-19T07:13:55.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:54 smithi148 ceph-mon[31180]: pgmap v88: 97 pgs: 97 active+clean; 150 MiB data, 943 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 8.0 MiB/s wr, 1.16k op/s 2024-09-19T07:13:55.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:54 smithi165 ceph-mon[35326]: pgmap v88: 97 pgs: 97 active+clean; 150 MiB data, 943 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 8.0 MiB/s wr, 1.16k op/s 2024-09-19T07:13:56.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.364+0000 7ffbdb84c640 1 -- 172.21.15.148:0/348158282 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbd4101350 msgr2=0x7ffbd410d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:56.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.364+0000 7ffbdb84c640 1 --2- 172.21.15.148:0/348158282 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbd4101350 0x7ffbd410d880 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc009cd0 tx=0x7ffbcc02a8e0 comp rx=0 tx=0).stop 2024-09-19T07:13:56.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.364+0000 7ffbdb84c640 1 -- 172.21.15.148:0/348158282 shutdown_connections 2024-09-19T07:13:56.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.364+0000 7ffbdb84c640 1 --2- 172.21.15.148:0/348158282 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbd4101350 0x7ffbd410d880 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:56.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.364+0000 7ffbdb84c640 1 --2- 172.21.15.148:0/348158282 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbd41009b0 0x7ffbd4100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:56.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.364+0000 7ffbdb84c640 1 --2- 172.21.15.148:0/348158282 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffbd41069c0 0x7ffbd4106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:56.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.364+0000 7ffbdb84c640 1 -- 172.21.15.148:0/348158282 >> 172.21.15.148:0/348158282 conn(0x7ffbd4077990 msgr2=0x7ffbd40fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:56.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.364+0000 7ffbdb84c640 1 -- 172.21.15.148:0/348158282 shutdown_connections 2024-09-19T07:13:56.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.364+0000 7ffbdb84c640 1 -- 172.21.15.148:0/348158282 wait complete. 2024-09-19T07:13:56.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.365+0000 7ffbdb84c640 1 Processor -- start 2024-09-19T07:13:56.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.365+0000 7ffbdb84c640 1 -- start start 2024-09-19T07:13:56.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.365+0000 7ffbdb84c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbd41009b0 0x7ffbd4199170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:56.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.365+0000 7ffbdb84c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbd4101350 0x7ffbd41996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:56.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.365+0000 7ffbdb84c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffbd41069c0 0x7ffbd41a41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:56.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.365+0000 7ffbdb84c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ffbd4110e00 con 0x7ffbd4101350 2024-09-19T07:13:56.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.365+0000 7ffbdb84c640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ffbd4110c80 con 0x7ffbd41069c0 2024-09-19T07:13:56.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.365+0000 7ffbdb84c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ffbd4110f80 con 0x7ffbd41009b0 2024-09-19T07:13:56.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.365+0000 7ffbd8de7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbd4101350 0x7ffbd41996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:56.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.365+0000 7ffbd8de7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbd4101350 0x7ffbd41996b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51356/0 (socket says 172.21.15.148:51356) 2024-09-19T07:13:56.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.365+0000 7ffbd8de7640 1 -- 172.21.15.148:0/2817170636 learned_addr learned my addr 172.21.15.148:0/2817170636 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:56.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.365+0000 7ffbd95e8640 1 --2- 172.21.15.148:0/2817170636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbd41009b0 0x7ffbd4199170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:56.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.365+0000 7ffbd8de7640 1 -- 172.21.15.148:0/2817170636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbd41009b0 msgr2=0x7ffbd4199170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:56.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.365+0000 7ffbd8de7640 1 --2- 172.21.15.148:0/2817170636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbd41009b0 0x7ffbd4199170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:56.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.365+0000 7ffbd8de7640 1 -- 172.21.15.148:0/2817170636 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffbd41069c0 msgr2=0x7ffbd41a41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:56.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.365+0000 7ffbd8de7640 1 --2- 172.21.15.148:0/2817170636 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffbd41069c0 0x7ffbd41a41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:56.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.365+0000 7ffbd8de7640 1 -- 172.21.15.148:0/2817170636 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbd41a4730 con 0x7ffbd4101350 2024-09-19T07:13:56.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.365+0000 7ffbd8de7640 1 --2- 172.21.15.148:0/2817170636 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbd4101350 0x7ffbd41996b0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7ffbc400e9f0 tx=0x7ffbc400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:56.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.365+0000 7ffbca7fc640 1 -- 172.21.15.148:0/2817170636 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc400cd80 con 0x7ffbd4101350 2024-09-19T07:13:56.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.365+0000 7ffbdb84c640 1 -- 172.21.15.148:0/2817170636 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbd41a4900 con 0x7ffbd4101350 2024-09-19T07:13:56.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.365+0000 7ffbca7fc640 1 -- 172.21.15.148:0/2817170636 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffbc4005500 con 0x7ffbd4101350 2024-09-19T07:13:56.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.365+0000 7ffbca7fc640 1 -- 172.21.15.148:0/2817170636 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc4010690 con 0x7ffbd4101350 2024-09-19T07:13:56.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.366+0000 7ffbdb84c640 1 -- 172.21.15.148:0/2817170636 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbd41a4dd0 con 0x7ffbd4101350 2024-09-19T07:13:56.375 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.368+0000 7ffbca7fc640 1 -- 172.21.15.148:0/2817170636 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7ffbc40046c0 con 0x7ffbd4101350 2024-09-19T07:13:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.368+0000 7ffbde5e4740 1 Processor -- start 2024-09-19T07:13:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.368+0000 7ffbde5e4740 1 -- start start 2024-09-19T07:13:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.368+0000 7ffbde5e4740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf32aca9d0 0x55cf32acadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.368+0000 7ffbde5e4740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cf32acb2f0 0x55cf32ad9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.368+0000 7ffbde5e4740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cf32ada0c0 0x55cf32adc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.368+0000 7ffbde5e4740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55cf32a2f2f0 con 0x55cf32aca9d0 2024-09-19T07:13:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.368+0000 7ffbde5e4740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55cf329d7270 con 0x55cf32acb2f0 2024-09-19T07:13:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.368+0000 7ffbde5e4740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55cf32a2b2b0 con 0x55cf32ada0c0 2024-09-19T07:13:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.368+0000 7ffbca7fc640 1 --2- 172.21.15.148:0/2817170636 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7ffbc00a3460 0x7ffbc00a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.368+0000 7ffbd9de9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf32aca9d0 0x55cf32acadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.369+0000 7ffbd8de7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cf32ada0c0 0x55cf32adc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.369+0000 7ffbd9de9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf32aca9d0 0x55cf32acadb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51364/0 (socket says 172.21.15.148:51364) 2024-09-19T07:13:56.377 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.369+0000 7ffbd9de9640 1 -- 172.21.15.148:0/3042547375 learned_addr learned my addr 172.21.15.148:0/3042547375 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:56.377 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.369+0000 7ffbd9de9640 1 --2- 172.21.15.148:0/2817170636 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7ffbc00a3460 0x7ffbc00a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:56.377 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.369+0000 7ffbd95e8640 1 --2- 172.21.15.148:0/3042547375 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cf32acb2f0 0x55cf32ad9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:56.377 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.369+0000 7ffbca7fc640 1 -- 172.21.15.148:0/2817170636 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7ffbc40d01e0 con 0x7ffbd4101350 2024-09-19T07:13:56.377 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.369+0000 7ffbd9de9640 1 -- 172.21.15.148:0/3042547375 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cf32ada0c0 msgr2=0x55cf32adc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:56.377 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.369+0000 7ffbd9de9640 1 --2- 172.21.15.148:0/3042547375 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cf32ada0c0 0x55cf32adc4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:56.377 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.369+0000 7ffbd9de9640 1 -- 172.21.15.148:0/3042547375 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cf32acb2f0 msgr2=0x55cf32ad9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:56.377 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.369+0000 7ffbd9de9640 1 --2- 172.21.15.148:0/3042547375 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cf32acb2f0 0x55cf32ad9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:56.377 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.369+0000 7ffbd9de9640 1 -- 172.21.15.148:0/3042547375 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf329d6340 con 0x55cf32aca9d0 2024-09-19T07:13:56.377 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.369+0000 7ffbd9de9640 1 --2- 172.21.15.148:0/3042547375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf32aca9d0 0x55cf32acadb0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc006010 tx=0x7ffbcc031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cff6ab71d70c4ac3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:56.377 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.369+0000 7ffbd9de9640 1 --2- 172.21.15.148:0/2817170636 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7ffbc00a3460 0x7ffbc00a5920 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc02ae00 tx=0x7ffbcc03f000 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.369+0000 7ffbbf7fe640 1 -- 172.21.15.148:0/3042547375 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc009860 con 0x55cf32aca9d0 2024-09-19T07:13:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.369+0000 7ffbbf7fe640 1 -- 172.21.15.148:0/3042547375 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffbcc036050 con 0x55cf32aca9d0 2024-09-19T07:13:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.369+0000 7ffbbf7fe640 1 -- 172.21.15.148:0/3042547375 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc03c410 con 0x55cf32aca9d0 2024-09-19T07:13:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.370+0000 7ffbde5e4740 1 -- 172.21.15.148:0/3042547375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf32aca9d0 msgr2=0x55cf32acadb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.370+0000 7ffbde5e4740 1 --2- 172.21.15.148:0/3042547375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf32aca9d0 0x55cf32acadb0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc006010 tx=0x7ffbcc031ca0 comp rx=0 tx=0).stop 2024-09-19T07:13:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.370+0000 7ffbde5e4740 1 -- 172.21.15.148:0/3042547375 shutdown_connections 2024-09-19T07:13:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.370+0000 7ffbde5e4740 1 --2- 172.21.15.148:0/3042547375 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cf32ada0c0 0x55cf32adc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.370+0000 7ffbde5e4740 1 --2- 172.21.15.148:0/3042547375 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cf32acb2f0 0x55cf32ad9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.370+0000 7ffbde5e4740 1 --2- 172.21.15.148:0/3042547375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf32aca9d0 0x55cf32acadb0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.370+0000 7ffbde5e4740 1 -- 172.21.15.148:0/3042547375 >> 172.21.15.148:0/3042547375 conn(0x55cf32ac7060 msgr2=0x55cf32ac7440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.370+0000 7ffbde5e4740 1 -- 172.21.15.148:0/3042547375 shutdown_connections 2024-09-19T07:13:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.370+0000 7ffbde5e4740 1 -- 172.21.15.148:0/3042547375 wait complete. 2024-09-19T07:13:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.371+0000 7ffbde5e4740 1 -- start start 2024-09-19T07:13:56.379 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.371+0000 7ffbde5e4740 1 Processor -- start 2024-09-19T07:13:56.379 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.371+0000 7ffbde5e4740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf32aca9d0 0x55cf32ad7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:56.379 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.371+0000 7ffbde5e4740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cf32acb2f0 0x55cf32ad75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:56.379 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.371+0000 7ffbde5e4740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cf32ada0c0 0x55cf32ad7b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:56.379 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.371+0000 7ffbde5e4740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55cf32adcc90 con 0x55cf32aca9d0 2024-09-19T07:13:56.379 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.371+0000 7ffbde5e4740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55cf329b8290 con 0x55cf32acb2f0 2024-09-19T07:13:56.379 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.371+0000 7ffbde5e4740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55cf32adce10 con 0x55cf32ada0c0 2024-09-19T07:13:56.379 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.371+0000 7ffbde5e4740 10 client.0 _ll_register_callbacks cb 0x55cf329e9140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:13:56.379 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.371+0000 7ffbd95e8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf32aca9d0 0x55cf32ad7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:56.379 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.371+0000 7ffbd95e8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf32aca9d0 0x55cf32ad7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51374/0 (socket says 172.21.15.148:51374) 2024-09-19T07:13:56.379 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.371+0000 7ffbd95e8640 1 -- 172.21.15.148:0/2676726173 learned_addr learned my addr 172.21.15.148:0/2676726173 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:56.379 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.371+0000 7ffbd9de9640 1 --2- 172.21.15.148:0/2676726173 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cf32ada0c0 0x55cf32ad7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:56.379 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.371+0000 7ffbd8de7640 1 --2- 172.21.15.148:0/2676726173 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cf32acb2f0 0x55cf32ad75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:56.380 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.371+0000 7ffbd95e8640 1 -- 172.21.15.148:0/2676726173 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cf32ada0c0 msgr2=0x55cf32ad7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:56.380 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.371+0000 7ffbd95e8640 1 --2- 172.21.15.148:0/2676726173 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cf32ada0c0 0x55cf32ad7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:56.380 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.371+0000 7ffbd95e8640 1 -- 172.21.15.148:0/2676726173 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cf32acb2f0 msgr2=0x55cf32ad75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:56.380 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.371+0000 7ffbd95e8640 1 --2- 172.21.15.148:0/2676726173 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cf32acb2f0 0x55cf32ad75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:56.380 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.371+0000 7ffbd95e8640 1 -- 172.21.15.148:0/2676726173 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf32742210 con 0x55cf32aca9d0 2024-09-19T07:13:56.380 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.372+0000 7ffbd95e8640 1 --2- 172.21.15.148:0/2676726173 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf32aca9d0 0x55cf32ad7080 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7ffbd00126e0 tx=0x7ffbd0012ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47d300c23c62ce59 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:56.380 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.372+0000 7ffbbcff9640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:13:56.380 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.372+0000 7ffbbcff9640 1 -- 172.21.15.148:0/2676726173 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd00120d0 con 0x55cf32aca9d0 2024-09-19T07:13:56.380 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.372+0000 7ffbde5e4740 1 -- 172.21.15.148:0/2676726173 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffbcc036050 con 0x55cf32aca9d0 2024-09-19T07:13:56.380 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.372+0000 7ffbbcff9640 1 -- 172.21.15.148:0/2676726173 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7ffbd000f920 con 0x55cf32aca9d0 2024-09-19T07:13:56.380 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.372+0000 7ffbbcff9640 1 -- 172.21.15.148:0/2676726173 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ffbd0012270 con 0x55cf32aca9d0 2024-09-19T07:13:56.380 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.372+0000 7ffbde5e4740 10 client.16194 fetch_fsmap learned FSMap version 31 2024-09-19T07:13:56.381 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.372+0000 7ffbde5e4740 1 -- 172.21.15.148:0/2676726173 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55cf3280e620 con 0x55cf32aca9d0 2024-09-19T07:13:56.381 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.372+0000 7ffbbcff9640 1 -- 172.21.15.148:0/2676726173 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffbcc036050 con 0x55cf32aca9d0 2024-09-19T07:13:56.381 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.372+0000 7ffbbcff9640 1 -- 172.21.15.148:0/2676726173 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7ffbd001c420 con 0x55cf32aca9d0 2024-09-19T07:13:56.381 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.372+0000 7ffbde5e4740 10 client.16194 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:13:56.381 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.372+0000 7ffbde5e4740 10 client.16194 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:13:56.381 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.372+0000 7ffbde5e4740 20 client.16194 populate_metadata read hostname 'smithi148' 2024-09-19T07:13:56.381 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.372+0000 7ffbde5e4740 1 --2- 172.21.15.148:0/2676726173 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55cf32aea180 0x55cf32aec5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:56.381 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.372+0000 7ffbde5e4740 4 client.16194 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:13:56.381 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.372+0000 7ffbde5e4740 1 -- 172.21.15.148:0/2676726173 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cf32a3ca20 con 0x55cf32aea180 2024-09-19T07:13:56.381 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.372+0000 7ffbd8de7640 1 --2- 172.21.15.148:0/2676726173 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55cf32aea180 0x55cf32aec5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:56.381 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.373+0000 7ffbbcff9640 10 client.16194 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:13:56.381 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.373+0000 7ffbd8de7640 1 --2- 172.21.15.148:0/2676726173 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55cf32aea180 0x55cf32aec5f0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58cf80b35ad87015 server_cookie=8d98c7d61c71f82 in_seq=0 out_seq=0 2024-09-19T07:13:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.375+0000 7ffbbcff9640 1 -- 172.21.15.148:0/2676726173 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cf32a3ca20 con 0x55cf32aea180 2024-09-19T07:13:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.375+0000 7ffbbcff9640 10 client.16194 handle_command_reply: tid=0 2024-09-19T07:13:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.375+0000 7ffbde5e4740 1 client.16194 shutdown 2024-09-19T07:13:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.375+0000 7ffbde5e4740 1 -- 172.21.15.148:0/2676726173 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf32aca9d0 msgr2=0x55cf32ad7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.375+0000 7ffbde5e4740 1 --2- 172.21.15.148:0/2676726173 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf32aca9d0 0x55cf32ad7080 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7ffbd00126e0 tx=0x7ffbd0012ba0 comp rx=0 tx=0).stop 2024-09-19T07:13:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.375+0000 7ffbde5e4740 1 -- 172.21.15.148:0/2676726173 shutdown_connections 2024-09-19T07:13:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.375+0000 7ffbde5e4740 1 --2- 172.21.15.148:0/2676726173 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55cf32aea180 0x55cf32aec5f0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.375+0000 7ffbde5e4740 1 --2- 172.21.15.148:0/2676726173 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cf32ada0c0 0x55cf32ad7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.375+0000 7ffbbcff9640 0 client.16194 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:13:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.375+0000 7ffbde5e4740 1 --2- 172.21.15.148:0/2676726173 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cf32acb2f0 0x55cf32ad75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.375+0000 7ffbde5e4740 1 --2- 172.21.15.148:0/2676726173 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf32aca9d0 0x55cf32ad7080 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.375+0000 7ffbde5e4740 1 -- 172.21.15.148:0/2676726173 >> 172.21.15.148:0/2676726173 conn(0x55cf32ac7060 msgr2=0x55cf32accd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.376+0000 7ffbde5e4740 1 -- 172.21.15.148:0/2676726173 shutdown_connections 2024-09-19T07:13:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.376+0000 7ffbde5e4740 1 -- 172.21.15.148:0/2676726173 wait complete. 2024-09-19T07:13:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.376+0000 7ffbde5e4740 20 client.16194 trim_cache size 0 max 16384 2024-09-19T07:13:56.393 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.391+0000 7ffbde5e4740 1 Processor -- start 2024-09-19T07:13:56.393 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.391+0000 7ffbde5e4740 1 -- start start 2024-09-19T07:13:56.393 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.391+0000 7ffbde5e4740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cf32aca9d0 0x55cf32ae6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:56.393 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.391+0000 7ffbde5e4740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cf32acb2f0 0x55cf32ad7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:56.394 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.391+0000 7ffbde5e4740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf32ada0c0 0x55cf32af1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:56.394 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.391+0000 7ffbde5e4740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ffbd41ade90 con 0x55cf32ada0c0 2024-09-19T07:13:56.394 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.391+0000 7ffbde5e4740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ffbd41ab760 con 0x55cf32acb2f0 2024-09-19T07:13:56.394 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.391+0000 7ffbde5e4740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ffbd41a95b0 con 0x55cf32aca9d0 2024-09-19T07:13:56.394 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.391+0000 7ffbd9de9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf32ada0c0 0x55cf32af1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:56.394 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.391+0000 7ffbd9de9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf32ada0c0 0x55cf32af1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51384/0 (socket says 172.21.15.148:51384) 2024-09-19T07:13:56.394 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.391+0000 7ffbd95e8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cf32aca9d0 0x55cf32ae6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:56.394 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.391+0000 7ffbd9de9640 1 -- 172.21.15.148:0/666319912 learned_addr learned my addr 172.21.15.148:0/666319912 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:56.394 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.391+0000 7ffbd8de7640 1 --2- 172.21.15.148:0/666319912 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cf32acb2f0 0x55cf32ad7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:56.394 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.392+0000 7ffbd9de9640 1 -- 172.21.15.148:0/666319912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cf32aca9d0 msgr2=0x55cf32ae6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:56.394 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.392+0000 7ffbd9de9640 1 --2- 172.21.15.148:0/666319912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cf32aca9d0 0x55cf32ae6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:56.394 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.392+0000 7ffbd9de9640 1 -- 172.21.15.148:0/666319912 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cf32acb2f0 msgr2=0x55cf32ad7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:56.395 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.392+0000 7ffbd9de9640 1 --2- 172.21.15.148:0/666319912 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cf32acb2f0 0x55cf32ad7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:56.395 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.392+0000 7ffbd9de9640 1 -- 172.21.15.148:0/666319912 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf32ae8ca0 con 0x55cf32ada0c0 2024-09-19T07:13:56.395 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.392+0000 7ffbd9de9640 1 --2- 172.21.15.148:0/666319912 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf32ada0c0 0x55cf32af1f00 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc009780 tx=0x7ffbcc031800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0438f66a5ec3cd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:56.395 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.392+0000 7ffbbeffd640 1 -- 172.21.15.148:0/666319912 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc030ec0 con 0x55cf32ada0c0 2024-09-19T07:13:56.395 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.392+0000 7ffbbeffd640 1 -- 172.21.15.148:0/666319912 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffbcc036040 con 0x55cf32ada0c0 2024-09-19T07:13:56.395 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.392+0000 7ffbbeffd640 1 -- 172.21.15.148:0/666319912 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc03c410 con 0x55cf32ada0c0 2024-09-19T07:13:56.401 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.393+0000 7ffbde5e4740 1 -- 172.21.15.148:0/666319912 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf32ada0c0 msgr2=0x55cf32af1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:56.401 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.393+0000 7ffbde5e4740 1 --2- 172.21.15.148:0/666319912 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf32ada0c0 0x55cf32af1f00 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc009780 tx=0x7ffbcc031800 comp rx=0 tx=0).stop 2024-09-19T07:13:56.401 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.393+0000 7ffbde5e4740 1 -- 172.21.15.148:0/666319912 shutdown_connections 2024-09-19T07:13:56.401 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.393+0000 7ffbde5e4740 1 --2- 172.21.15.148:0/666319912 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf32ada0c0 0x55cf32af1f00 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:56.401 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.393+0000 7ffbde5e4740 1 --2- 172.21.15.148:0/666319912 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cf32acb2f0 0x55cf32ad7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.393+0000 7ffbde5e4740 1 --2- 172.21.15.148:0/666319912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cf32aca9d0 0x55cf32ae6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.393+0000 7ffbde5e4740 1 -- 172.21.15.148:0/666319912 >> 172.21.15.148:0/666319912 conn(0x55cf32ac7060 msgr2=0x55cf32ad7040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.393+0000 7ffbde5e4740 1 -- 172.21.15.148:0/666319912 shutdown_connections 2024-09-19T07:13:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.393+0000 7ffbde5e4740 1 -- 172.21.15.148:0/666319912 wait complete. 2024-09-19T07:13:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.393+0000 7ffbde5e4740 1 -- start start 2024-09-19T07:13:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.393+0000 7ffbde5e4740 1 Processor -- start 2024-09-19T07:13:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.394+0000 7ffbde5e4740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf32aca9d0 0x55cf32ae26d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.394+0000 7ffbde5e4740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cf32acb2f0 0x55cf32adda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.394+0000 7ffbde5e4740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cf32ada0c0 0x55cf32addf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.394+0000 7ffbde5e4740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ffbd41a9c20 con 0x55cf32aca9d0 2024-09-19T07:13:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.394+0000 7ffbde5e4740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ffbd41ab090 con 0x55cf32acb2f0 2024-09-19T07:13:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.394+0000 7ffbde5e4740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ffbd41aa2f0 con 0x55cf32ada0c0 2024-09-19T07:13:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.394+0000 7ffbde5e4740 10 client.0 _ll_register_callbacks cb 0x7ffbd0009850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:13:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.394+0000 7ffbd95e8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf32aca9d0 0x55cf32ae26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.394+0000 7ffbd95e8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf32aca9d0 0x55cf32ae26d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51390/0 (socket says 172.21.15.148:51390) 2024-09-19T07:13:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.394+0000 7ffbd95e8640 1 -- 172.21.15.148:0/506103844 learned_addr learned my addr 172.21.15.148:0/506103844 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:13:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.394+0000 7ffbd9de9640 1 --2- 172.21.15.148:0/506103844 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cf32ada0c0 0x55cf32addf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.394+0000 7ffbd8de7640 1 --2- 172.21.15.148:0/506103844 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cf32acb2f0 0x55cf32adda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.394+0000 7ffbd95e8640 1 -- 172.21.15.148:0/506103844 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cf32ada0c0 msgr2=0x55cf32addf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.394+0000 7ffbd95e8640 1 --2- 172.21.15.148:0/506103844 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cf32ada0c0 0x55cf32addf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.394+0000 7ffbd95e8640 1 -- 172.21.15.148:0/506103844 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cf32acb2f0 msgr2=0x55cf32adda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:13:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.394+0000 7ffbd95e8640 1 --2- 172.21.15.148:0/506103844 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cf32acb2f0 0x55cf32adda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.394+0000 7ffbd95e8640 1 -- 172.21.15.148:0/506103844 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf32ade7b0 con 0x55cf32aca9d0 2024-09-19T07:13:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.394+0000 7ffbd95e8640 1 --2- 172.21.15.148:0/506103844 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf32aca9d0 0x55cf32ae26d0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7ffbd00059f0 tx=0x7ffbd001cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc3368e1d58b5947 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.394+0000 7ffbbcff9640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:13:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.395+0000 7ffbbcff9640 1 -- 172.21.15.148:0/506103844 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd0009e80 con 0x55cf32aca9d0 2024-09-19T07:13:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.395+0000 7ffbbcff9640 1 -- 172.21.15.148:0/506103844 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7ffbd000fb30 con 0x55cf32aca9d0 2024-09-19T07:13:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.395+0000 7ffbde5e4740 1 -- 172.21.15.148:0/506103844 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffbcc036040 con 0x55cf32aca9d0 2024-09-19T07:13:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.395+0000 7ffbbcff9640 1 -- 172.21.15.148:0/506103844 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ffbd0033050 con 0x55cf32aca9d0 2024-09-19T07:13:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.395+0000 7ffbde5e4740 10 client.16200 fetch_fsmap learned FSMap version 31 2024-09-19T07:13:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.395+0000 7ffbde5e4740 1 -- 172.21.15.148:0/506103844 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55cf32b54e10 con 0x55cf32aca9d0 2024-09-19T07:13:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.395+0000 7ffbbcff9640 1 -- 172.21.15.148:0/506103844 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffbcc036040 con 0x55cf32aca9d0 2024-09-19T07:13:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.395+0000 7ffbbcff9640 1 -- 172.21.15.148:0/506103844 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7ffbd002c060 con 0x55cf32aca9d0 2024-09-19T07:13:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.395+0000 7ffbde5e4740 10 client.16200 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:13:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.395+0000 7ffbde5e4740 10 client.16200 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:13:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.395+0000 7ffbde5e4740 20 client.16200 populate_metadata read hostname 'smithi148' 2024-09-19T07:13:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.395+0000 7ffbde5e4740 1 --2- 172.21.15.148:0/506103844 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55cf32aea180 0x55cf32b575f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.395+0000 7ffbde5e4740 4 client.16200 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:13:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.395+0000 7ffbde5e4740 1 -- 172.21.15.148:0/506103844 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cf32a36d70 con 0x55cf32aea180 2024-09-19T07:13:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.395+0000 7ffbd8de7640 1 --2- 172.21.15.148:0/506103844 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55cf32aea180 0x55cf32b575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:56.407 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.396+0000 7ffbbcff9640 10 client.16200 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:13:56.407 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:56.396+0000 7ffbd8de7640 1 --2- 172.21.15.148:0/506103844 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55cf32aea180 0x55cf32b575f0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=410dea386ce1a583 server_cookie=df8e9b1f989dad0e in_seq=0 out_seq=0 2024-09-19T07:13:57.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:56 smithi179 ceph-mon[35716]: pgmap v89: 97 pgs: 97 active+clean; 159 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.9 MiB/s wr, 1.24k op/s 2024-09-19T07:13:57.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:56 smithi148 ceph-mon[31180]: pgmap v89: 97 pgs: 97 active+clean; 159 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.9 MiB/s wr, 1.24k op/s 2024-09-19T07:13:57.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:56 smithi165 ceph-mon[35326]: pgmap v89: 97 pgs: 97 active+clean; 159 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.9 MiB/s wr, 1.24k op/s 2024-09-19T07:13:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:58.263+0000 7ffbbcff9640 1 -- 172.21.15.148:0/506103844 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cf32a36d70 con 0x55cf32aea180 2024-09-19T07:13:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:58.263+0000 7ffbbcff9640 10 client.16200 handle_command_reply: tid=0 2024-09-19T07:13:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:58.263+0000 7ffbde5e4740 1 client.16200 shutdown 2024-09-19T07:13:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:58.263+0000 7ffbde5e4740 1 -- 172.21.15.148:0/506103844 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf32aca9d0 msgr2=0x55cf32ae26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:58.263+0000 7ffbde5e4740 1 --2- 172.21.15.148:0/506103844 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf32aca9d0 0x55cf32ae26d0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7ffbd00059f0 tx=0x7ffbd001cd10 comp rx=0 tx=0).stop 2024-09-19T07:13:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:58.263+0000 7ffbde5e4740 1 -- 172.21.15.148:0/506103844 shutdown_connections 2024-09-19T07:13:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:58.263+0000 7ffbde5e4740 1 --2- 172.21.15.148:0/506103844 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55cf32aea180 0x55cf32b575f0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:58.263+0000 7ffbde5e4740 1 --2- 172.21.15.148:0/506103844 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cf32ada0c0 0x55cf32addf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:58.263+0000 7ffbbcff9640 0 client.16200 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:13:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:58.263+0000 7ffbde5e4740 1 --2- 172.21.15.148:0/506103844 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cf32acb2f0 0x55cf32adda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:58.263+0000 7ffbde5e4740 1 --2- 172.21.15.148:0/506103844 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf32aca9d0 0x55cf32ae26d0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:58.263+0000 7ffbde5e4740 1 -- 172.21.15.148:0/506103844 >> 172.21.15.148:0/506103844 conn(0x55cf32ac7060 msgr2=0x55cf32ac59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:58.263+0000 7ffbde5e4740 1 -- 172.21.15.148:0/506103844 shutdown_connections 2024-09-19T07:13:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:58.263+0000 7ffbde5e4740 1 -- 172.21.15.148:0/506103844 wait complete. 2024-09-19T07:13:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:58.264+0000 7ffbde5e4740 20 client.16200 trim_cache size 0 max 16384 2024-09-19T07:13:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:13:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:13:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:13:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:13:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:58.264+0000 7ffbdb84c640 1 -- 172.21.15.148:0/2817170636 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7ffbc00a3460 msgr2=0x7ffbc00a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:58.264+0000 7ffbdb84c640 1 --2- 172.21.15.148:0/2817170636 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7ffbc00a3460 0x7ffbc00a5920 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc02ae00 tx=0x7ffbcc03f000 comp rx=0 tx=0).stop 2024-09-19T07:13:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:58.264+0000 7ffbdb84c640 1 -- 172.21.15.148:0/2817170636 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbd4101350 msgr2=0x7ffbd41996b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:58.264+0000 7ffbdb84c640 1 --2- 172.21.15.148:0/2817170636 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbd4101350 0x7ffbd41996b0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7ffbc400e9f0 tx=0x7ffbc400edf0 comp rx=0 tx=0).stop 2024-09-19T07:13:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:58.264+0000 7ffbdb84c640 1 -- 172.21.15.148:0/2817170636 shutdown_connections 2024-09-19T07:13:58.268 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:58.264+0000 7ffbdb84c640 1 --2- 172.21.15.148:0/2817170636 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7ffbc00a3460 0x7ffbc00a5920 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:58.268 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:58.264+0000 7ffbdb84c640 1 --2- 172.21.15.148:0/2817170636 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffbd41069c0 0x7ffbd41a41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:58.268 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:58.264+0000 7ffbdb84c640 1 --2- 172.21.15.148:0/2817170636 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffbd4101350 0x7ffbd41996b0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:58.268 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:58.264+0000 7ffbdb84c640 1 --2- 172.21.15.148:0/2817170636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbd41009b0 0x7ffbd4199170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:58.268 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:58.264+0000 7ffbdb84c640 1 -- 172.21.15.148:0/2817170636 >> 172.21.15.148:0/2817170636 conn(0x7ffbd4077990 msgr2=0x7ffbd4103660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:58.268 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:58.264+0000 7ffbdb84c640 1 -- 172.21.15.148:0/2817170636 shutdown_connections 2024-09-19T07:13:58.268 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:13:58.264+0000 7ffbdb84c640 1 -- 172.21.15.148:0/2817170636 wait complete. 2024-09-19T07:13:59.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:13:58 smithi179 ceph-mon[35716]: pgmap v90: 97 pgs: 97 active+clean; 159 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 358 op/s 2024-09-19T07:13:59.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:13:58 smithi148 ceph-mon[31180]: pgmap v90: 97 pgs: 97 active+clean; 159 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 358 op/s 2024-09-19T07:13:59.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:13:58 smithi165 ceph-mon[35326]: pgmap v90: 97 pgs: 97 active+clean; 159 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 358 op/s 2024-09-19T07:14:01.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:00 smithi179 ceph-mon[35716]: pgmap v91: 97 pgs: 97 active+clean; 159 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 358 op/s 2024-09-19T07:14:01.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:00 smithi148 ceph-mon[31180]: pgmap v91: 97 pgs: 97 active+clean; 159 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 358 op/s 2024-09-19T07:14:01.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:00 smithi165 ceph-mon[35326]: pgmap v91: 97 pgs: 97 active+clean; 159 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 358 op/s 2024-09-19T07:14:02.717 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:14:02 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:14:02.455+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001691 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-27.jpg auth{0=1} v807 ap=1 s=17277 n(v0 rc2024-09-19T07:13:29.984860+0000 b17277 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@1},l=24793 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c35c3f4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001691:[<0x100000014be/picture-27.jpg v807>,<0x10000000399/blog-30 v55746>,<0x10000000208/blogtest_in v521>,<0x10000000201/src v2146>,<0x10000000006/blogbench-1.0 v1856>,<0x10000000005/tmp v82>,<0x100000001fb/client.0 v74>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v99>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000001691:[<0x100000014be/picture-27.jpg v807>,<0x10000000399/blog-30 v93421>,<0x10000000208/blogtest_in v849>,<0x10000000201/src v2190>,<0x10000000006/blogbench-1.0 v1894>,<0x10000000005/tmp v118>,<0x100000001fb/client.0 v111>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v123>,<0x10000000001/sv_1 v144>,<0x10000000000/qa v131>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:14:02.717 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:14:02 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:14:02.455+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000152e [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/article-12.xml auth{0=1} v803 ap=1 s=31888 n(v0 rc2024-09-19T07:13:28.431898+0000 b31888 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@1},l=24793 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c35c3f4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000152e:[<0x100000014be/article-12.xml v803>,<0x10000000399/blog-30 v55746>,<0x10000000208/blogtest_in v521>,<0x10000000201/src v2146>,<0x10000000006/blogbench-1.0 v1856>,<0x10000000005/tmp v82>,<0x100000001fb/client.0 v74>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v99>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x1000000152e:[<0x100000014be/article-12.xml v803>,<0x10000000399/blog-30 v93421>,<0x10000000208/blogtest_in v849>,<0x10000000201/src v2190>,<0x10000000006/blogbench-1.0 v1894>,<0x10000000005/tmp v118>,<0x100000001fb/client.0 v111>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v123>,<0x10000000001/sv_1 v144>,<0x10000000000/qa v131>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:14:02.717 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:14:02 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:14:02.456+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001566 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/article-1.xml auth{0=1} v795 ap=1 s=21922 n(v0 rc2024-09-19T07:13:28.610893+0000 b21922 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@1},l=24793 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c35c3f5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001566:[<0x100000014be/article-1.xml v795>,<0x10000000399/blog-30 v55746>,<0x10000000208/blogtest_in v521>,<0x10000000201/src v2146>,<0x10000000006/blogbench-1.0 v1856>,<0x10000000005/tmp v82>,<0x100000001fb/client.0 v74>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v99>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000001566:[<0x100000014be/article-1.xml v795>,<0x10000000399/blog-30 v93421>,<0x10000000208/blogtest_in v849>,<0x10000000201/src v2190>,<0x10000000006/blogbench-1.0 v1894>,<0x10000000005/tmp v118>,<0x100000001fb/client.0 v111>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v123>,<0x10000000001/sv_1 v144>,<0x10000000000/qa v131>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:14:02.717 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:14:02 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:14:02.456+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001612 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-52.jpg auth{0=1} v815 ap=1 s=44658 n(v0 rc2024-09-19T07:13:29.403874+0000 b44658 1=1+0) caps={24793=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c35c3f4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001612:[<0x100000014be/picture-52.jpg v815>,<0x10000000399/blog-30 v55746>,<0x10000000208/blogtest_in v521>,<0x10000000201/src v2146>,<0x10000000006/blogbench-1.0 v1856>,<0x10000000005/tmp v82>,<0x100000001fb/client.0 v74>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v99>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000001612:[<0x100000014be/picture-52.jpg v815>,<0x10000000399/blog-30 v93421>,<0x10000000208/blogtest_in v849>,<0x10000000201/src v2190>,<0x10000000006/blogbench-1.0 v1894>,<0x10000000005/tmp v118>,<0x100000001fb/client.0 v111>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v123>,<0x10000000001/sv_1 v144>,<0x10000000000/qa v131>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:14:02.717 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:14:02 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:14:02.457+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001670 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-34.jpg auth{0=1} v811 ap=1 s=19043 n(v0 rc2024-09-19T07:13:29.913862+0000 b19043 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@1},l=24793 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c35c3f5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001670:[<0x100000014be/picture-34.jpg v811>,<0x10000000399/blog-30 v55746>,<0x10000000208/blogtest_in v521>,<0x10000000201/src v2146>,<0x10000000006/blogbench-1.0 v1856>,<0x10000000005/tmp v82>,<0x100000001fb/client.0 v74>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v99>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000001670:[<0x100000014be/picture-34.jpg v811>,<0x10000000399/blog-30 v93421>,<0x10000000208/blogtest_in v849>,<0x10000000201/src v2190>,<0x10000000006/blogbench-1.0 v1894>,<0x10000000005/tmp v118>,<0x100000001fb/client.0 v111>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v123>,<0x10000000001/sv_1 v144>,<0x10000000000/qa v131>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:14:02.717 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:14:02 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:14:02.457+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000160c [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-53.jpg auth{0=1} v819 ap=1 s=47094 n(v0 rc2024-09-19T07:13:29.389875+0000 b47094 1=1+0) caps={24793=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c35c3f6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000160c:[<0x100000014be/picture-53.jpg v819>,<0x10000000399/blog-30 v55746>,<0x10000000208/blogtest_in v521>,<0x10000000201/src v2146>,<0x10000000006/blogbench-1.0 v1856>,<0x10000000005/tmp v82>,<0x100000001fb/client.0 v74>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v99>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x1000000160c:[<0x100000014be/picture-53.jpg v819>,<0x10000000399/blog-30 v93421>,<0x10000000208/blogtest_in v849>,<0x10000000201/src v2190>,<0x10000000006/blogbench-1.0 v1894>,<0x10000000005/tmp v118>,<0x100000001fb/client.0 v111>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v123>,<0x10000000001/sv_1 v144>,<0x10000000000/qa v131>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:14:02.718 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:14:02 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:14:02.457+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015ba [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-67.jpg auth{0=1} v813 ap=1 s=49563 n(v0 rc2024-09-19T07:13:29.013884+0000 b49563 1=1+0) caps={24793=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c35c3f6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015ba:[<0x100000014be/picture-67.jpg v813>,<0x10000000399/blog-30 v55746>,<0x10000000208/blogtest_in v521>,<0x10000000201/src v2146>,<0x10000000006/blogbench-1.0 v1856>,<0x10000000005/tmp v82>,<0x100000001fb/client.0 v74>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v99>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x100000015ba:[<0x100000014be/picture-67.jpg v813>,<0x10000000399/blog-30 v93421>,<0x10000000208/blogtest_in v849>,<0x10000000201/src v2190>,<0x10000000006/blogbench-1.0 v1894>,<0x10000000005/tmp v118>,<0x100000001fb/client.0 v111>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v123>,<0x10000000001/sv_1 v144>,<0x10000000000/qa v131>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:14:02.718 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:14:02 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:14:02.458+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016c9 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-16.jpg auth{0=1} v797 ap=1 s=16800 n(v0 rc2024-09-19T07:13:30.159856+0000 b16800 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@1},l=24793 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c35c3f7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016c9:[<0x100000014be/picture-16.jpg v797>,<0x10000000399/blog-30 v55746>,<0x10000000208/blogtest_in v521>,<0x10000000201/src v2146>,<0x10000000006/blogbench-1.0 v1856>,<0x10000000005/tmp v82>,<0x100000001fb/client.0 v74>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v99>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x100000016c9:[<0x100000014be/picture-16.jpg v797>,<0x10000000399/blog-30 v93421>,<0x10000000208/blogtest_in v849>,<0x10000000201/src v2190>,<0x10000000006/blogbench-1.0 v1894>,<0x10000000005/tmp v118>,<0x100000001fb/client.0 v111>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v123>,<0x10000000001/sv_1 v144>,<0x10000000000/qa v131>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:14:02.718 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:14:02 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:14:02.459+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001594 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-74.jpg auth{0=1} v817 ap=1 s=8805 n(v0 rc2024-09-19T07:13:28.830888+0000 b8805 1=1+0) caps={24793=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c35c3fe580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001594:[<0x100000014be/picture-74.jpg v817>,<0x10000000399/blog-30 v55746>,<0x10000000208/blogtest_in v521>,<0x10000000201/src v2146>,<0x10000000006/blogbench-1.0 v1856>,<0x10000000005/tmp v82>,<0x100000001fb/client.0 v74>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v99>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000001594:[<0x100000014be/picture-74.jpg v817>,<0x10000000399/blog-30 v93421>,<0x10000000208/blogtest_in v849>,<0x10000000201/src v2190>,<0x10000000006/blogbench-1.0 v1894>,<0x10000000005/tmp v118>,<0x100000001fb/client.0 v111>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v123>,<0x10000000001/sv_1 v144>,<0x10000000000/qa v131>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:14:02.718 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:14:02 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:14:02.460+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014f9 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/article-23.xml auth{0=1} v805 ap=1 s=24899 n(v0 rc2024-09-19T07:13:28.250902+0000 b24899 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@1},l=24793 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c35c3ffb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014f9:[<0x100000014be/article-23.xml v805>,<0x10000000399/blog-30 v55746>,<0x10000000208/blogtest_in v521>,<0x10000000201/src v2146>,<0x10000000006/blogbench-1.0 v1856>,<0x10000000005/tmp v82>,<0x100000001fb/client.0 v74>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v99>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x100000014f9:[<0x100000014be/article-23.xml v805>,<0x10000000399/blog-30 v93421>,<0x10000000208/blogtest_in v849>,<0x10000000201/src v2190>,<0x10000000006/blogbench-1.0 v1894>,<0x10000000005/tmp v118>,<0x100000001fb/client.0 v111>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v123>,<0x10000000001/sv_1 v144>,<0x10000000000/qa v131>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:14:02.718 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:14:02 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:14:02.460+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001513 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/article-17.xml auth{0=1} v801 ap=1 s=31426 n(v0 rc2024-09-19T07:13:28.345900+0000 b31426 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@1},l=24793 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c35c400100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001513:[<0x100000014be/article-17.xml v801>,<0x10000000399/blog-30 v55746>,<0x10000000208/blogtest_in v521>,<0x10000000201/src v2146>,<0x10000000006/blogbench-1.0 v1856>,<0x10000000005/tmp v82>,<0x100000001fb/client.0 v74>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v99>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000001513:[<0x100000014be/article-17.xml v801>,<0x10000000399/blog-30 v93421>,<0x10000000208/blogtest_in v849>,<0x10000000201/src v2190>,<0x10000000006/blogbench-1.0 v1894>,<0x10000000005/tmp v118>,<0x100000001fb/client.0 v111>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v123>,<0x10000000001/sv_1 v144>,<0x10000000000/qa v131>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:14:02.718 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:14:02 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:14:02.461+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001588 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-76.jpg auth{0=1} v799 ap=1 s=26681 n(v0 rc2024-09-19T07:13:28.765890+0000 b26681 1=1+0) caps={24793=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c35c400680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001588:[<0x100000014be/picture-76.jpg v799>,<0x10000000399/blog-30 v55746>,<0x10000000208/blogtest_in v521>,<0x10000000201/src v2146>,<0x10000000006/blogbench-1.0 v1856>,<0x10000000005/tmp v82>,<0x100000001fb/client.0 v74>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v99>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000001588:[<0x100000014be/picture-76.jpg v799>,<0x10000000399/blog-30 v93421>,<0x10000000208/blogtest_in v849>,<0x10000000201/src v2190>,<0x10000000006/blogbench-1.0 v1894>,<0x10000000005/tmp v118>,<0x100000001fb/client.0 v111>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v123>,<0x10000000001/sv_1 v144>,<0x10000000000/qa v131>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:14:02.718 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:14:02 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:14:02.461+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001679 [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-32.jpg auth{0=1} v809 ap=1 s=26620 n(v0 rc2024-09-19T07:13:29.934862+0000 b26620 1=1+0) (ifile excl) cr={24793=0-4194304@3} caps={24793=pAsLsXsFsxcrwb/pFscr@1},l=24793 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c35c400c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001679:[<0x100000014be/picture-32.jpg v809>,<0x10000000399/blog-30 v55746>,<0x10000000208/blogtest_in v521>,<0x10000000201/src v2146>,<0x10000000006/blogbench-1.0 v1856>,<0x10000000005/tmp v82>,<0x100000001fb/client.0 v74>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v99>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000001679:[<0x100000014be/picture-32.jpg v809>,<0x10000000399/blog-30 v93421>,<0x10000000208/blogtest_in v849>,<0x10000000201/src v2190>,<0x10000000006/blogbench-1.0 v1894>,<0x10000000005/tmp v118>,<0x100000001fb/client.0 v111>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v123>,<0x10000000001/sv_1 v144>,<0x10000000000/qa v131>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:14:02.718 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:14:02 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:14:02.461+0000 7f7401435640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000162a [4,head] /volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-48.jpg auth{0=1} v821 ap=1 s=52360 n(v0 rc2024-09-19T07:13:29.512872+0000 b52360 1=1+0) caps={24793=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c35c401180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000162a:[<0x100000014be/picture-48.jpg v821>,<0x10000000399/blog-30 v55746>,<0x10000000208/blogtest_in v521>,<0x10000000201/src v2146>,<0x10000000006/blogbench-1.0 v1856>,<0x10000000005/tmp v82>,<0x100000001fb/client.0 v74>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v99>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x1000000162a:[<0x100000014be/picture-48.jpg v821>,<0x10000000399/blog-30 v93421>,<0x10000000208/blogtest_in v849>,<0x10000000201/src v2190>,<0x10000000006/blogbench-1.0 v1894>,<0x10000000005/tmp v118>,<0x100000001fb/client.0 v111>,<0x100000001fa/54a4a3dd-38da-4966-86c2-35568425810f v123>,<0x10000000001/sv_1 v144>,<0x10000000000/qa v131>,<0x1/volumes v44>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:14:03.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:02 smithi179 ceph-mon[35716]: pgmap v92: 97 pgs: 97 active+clean; 152 MiB data, 989 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.9 MiB/s wr, 1.10k op/s 2024-09-19T07:14:03.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:02 smithi148 ceph-mon[31180]: pgmap v92: 97 pgs: 97 active+clean; 152 MiB data, 989 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.9 MiB/s wr, 1.10k op/s 2024-09-19T07:14:03.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:02 smithi165 ceph-mon[35326]: pgmap v92: 97 pgs: 97 active+clean; 152 MiB data, 989 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.9 MiB/s wr, 1.10k op/s 2024-09-19T07:14:03.193 INFO:tasks.workunit.client.0.smithi148.stdout: 86 0 975 0 1283 0 34 2024-09-19T07:14:04.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:03 smithi179 ceph-mon[35716]: scrub summary: active paths [/] 2024-09-19T07:14:04.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:03 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001691 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-27.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:14:04.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:03 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000152e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/article-12.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:14:04.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:03 smithi179 ceph-mon[35716]: scrub summary: idle+waiting paths [/] 2024-09-19T07:14:04.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:03 smithi179 ceph-mon[35716]: scrub summary: active paths [/] 2024-09-19T07:14:04.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:03 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001566 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/article-1.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:14:04.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:03 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001612 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-52.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:14:04.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:03 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001670 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-34.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:14:04.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:03 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000160c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-53.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:14:04.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:03 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000015ba (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-67.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:14:04.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:03 smithi179 ceph-mon[35716]: scrub summary: idle+waiting paths [/] 2024-09-19T07:14:04.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:03 smithi179 ceph-mon[35716]: scrub summary: active paths [/] 2024-09-19T07:14:04.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:03 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000016c9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-16.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:14:04.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:03 smithi179 ceph-mon[35716]: scrub summary: idle+waiting paths [/] 2024-09-19T07:14:04.025 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:03 smithi179 ceph-mon[35716]: scrub summary: active paths [/] 2024-09-19T07:14:04.025 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:03 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001594 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-74.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:14:04.025 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:03 smithi179 ceph-mon[35716]: scrub summary: idle+waiting paths [/] 2024-09-19T07:14:04.025 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:03 smithi179 ceph-mon[35716]: scrub summary: active paths [/] 2024-09-19T07:14:04.025 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:03 smithi179 ceph-mon[35716]: Scrub error on inode 0x100000014f9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/article-23.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:14:04.025 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:03 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001513 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/article-17.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:14:04.025 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:03 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001588 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-76.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:14:04.025 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:03 smithi179 ceph-mon[35716]: Scrub error on inode 0x10000001679 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-32.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:14:04.025 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:03 smithi179 ceph-mon[35716]: Scrub error on inode 0x1000000162a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-48.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:14:04.025 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:03 smithi179 ceph-mon[35716]: scrub summary: idle+waiting paths [/] 2024-09-19T07:14:04.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:03 smithi148 ceph-mon[31180]: scrub summary: active paths [/] 2024-09-19T07:14:04.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:03 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001691 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-27.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:14:04.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:03 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000152e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/article-12.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:14:04.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:03 smithi148 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-19T07:14:04.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:03 smithi148 ceph-mon[31180]: scrub summary: active paths [/] 2024-09-19T07:14:04.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:03 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001566 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/article-1.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:14:04.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:03 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001612 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-52.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:14:04.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:03 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001670 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-34.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:14:04.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:03 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000160c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-53.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:14:04.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:03 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000015ba (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-67.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:14:04.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:03 smithi148 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-19T07:14:04.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:03 smithi148 ceph-mon[31180]: scrub summary: active paths [/] 2024-09-19T07:14:04.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:03 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000016c9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-16.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:14:04.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:03 smithi148 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-19T07:14:04.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:03 smithi148 ceph-mon[31180]: scrub summary: active paths [/] 2024-09-19T07:14:04.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:03 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001594 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-74.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:14:04.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:03 smithi148 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-19T07:14:04.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:03 smithi148 ceph-mon[31180]: scrub summary: active paths [/] 2024-09-19T07:14:04.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:03 smithi148 ceph-mon[31180]: Scrub error on inode 0x100000014f9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/article-23.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:14:04.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:03 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001513 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/article-17.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:14:04.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:03 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001588 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-76.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:14:04.086 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:03 smithi148 ceph-mon[31180]: Scrub error on inode 0x10000001679 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-32.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:14:04.086 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:03 smithi148 ceph-mon[31180]: Scrub error on inode 0x1000000162a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-48.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:14:04.086 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:03 smithi148 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-19T07:14:04.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:03 smithi165 ceph-mon[35326]: scrub summary: active paths [/] 2024-09-19T07:14:04.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:03 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001691 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-27.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:14:04.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:03 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000152e (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/article-12.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:14:04.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:03 smithi165 ceph-mon[35326]: scrub summary: idle+waiting paths [/] 2024-09-19T07:14:04.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:03 smithi165 ceph-mon[35326]: scrub summary: active paths [/] 2024-09-19T07:14:04.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:03 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001566 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/article-1.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:14:04.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:03 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001612 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-52.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:14:04.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:03 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001670 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-34.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:14:04.135 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:03 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000160c (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-53.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:14:04.135 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:03 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000015ba (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-67.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:14:04.135 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:03 smithi165 ceph-mon[35326]: scrub summary: idle+waiting paths [/] 2024-09-19T07:14:04.135 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:03 smithi165 ceph-mon[35326]: scrub summary: active paths [/] 2024-09-19T07:14:04.135 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:03 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000016c9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-16.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:14:04.135 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:03 smithi165 ceph-mon[35326]: scrub summary: idle+waiting paths [/] 2024-09-19T07:14:04.135 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:03 smithi165 ceph-mon[35326]: scrub summary: active paths [/] 2024-09-19T07:14:04.135 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:03 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001594 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-74.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:14:04.135 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:03 smithi165 ceph-mon[35326]: scrub summary: idle+waiting paths [/] 2024-09-19T07:14:04.135 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:03 smithi165 ceph-mon[35326]: scrub summary: active paths [/] 2024-09-19T07:14:04.135 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:03 smithi165 ceph-mon[35326]: Scrub error on inode 0x100000014f9 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/article-23.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:14:04.136 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:03 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001513 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/article-17.xml) see mds.c log and `damage ls` output for details 2024-09-19T07:14:04.136 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:03 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001588 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-76.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:14:04.136 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:03 smithi165 ceph-mon[35326]: Scrub error on inode 0x10000001679 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-32.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:14:04.136 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:03 smithi165 ceph-mon[35326]: Scrub error on inode 0x1000000162a (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-48.jpg) see mds.c log and `damage ls` output for details 2024-09-19T07:14:04.136 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:03 smithi165 ceph-mon[35326]: scrub summary: idle+waiting paths [/] 2024-09-19T07:14:05.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:04 smithi179 ceph-mon[35716]: pgmap v93: 97 pgs: 97 active+clean; 152 MiB data, 989 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.7 MiB/s wr, 821 op/s 2024-09-19T07:14:05.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:04 smithi148 ceph-mon[31180]: pgmap v93: 97 pgs: 97 active+clean; 152 MiB data, 989 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.7 MiB/s wr, 821 op/s 2024-09-19T07:14:05.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:04 smithi165 ceph-mon[35326]: pgmap v93: 97 pgs: 97 active+clean; 152 MiB data, 989 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.7 MiB/s wr, 821 op/s 2024-09-19T07:14:07.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:06 smithi179 ceph-mon[35716]: pgmap v94: 97 pgs: 97 active+clean; 268 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 13 MiB/s wr, 1.41k op/s 2024-09-19T07:14:07.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:06 smithi148 ceph-mon[31180]: pgmap v94: 97 pgs: 97 active+clean; 268 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 13 MiB/s wr, 1.41k op/s 2024-09-19T07:14:07.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:06 smithi165 ceph-mon[35326]: pgmap v94: 97 pgs: 97 active+clean; 268 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 13 MiB/s wr, 1.41k op/s 2024-09-19T07:14:09.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:08 smithi179 ceph-mon[35716]: pgmap v95: 97 pgs: 97 active+clean; 268 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 12 MiB/s wr, 1.33k op/s 2024-09-19T07:14:09.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:08 smithi148 ceph-mon[31180]: pgmap v95: 97 pgs: 97 active+clean; 268 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 12 MiB/s wr, 1.33k op/s 2024-09-19T07:14:09.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:08 smithi165 ceph-mon[35326]: pgmap v95: 97 pgs: 97 active+clean; 268 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 12 MiB/s wr, 1.33k op/s 2024-09-19T07:14:10.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:09 smithi179 ceph-mon[35716]: scrub summary: active paths [/] 2024-09-19T07:14:10.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:09 smithi179 ceph-mon[35716]: scrub summary: idle+waiting paths [/] 2024-09-19T07:14:10.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:09 smithi179 ceph-mon[35716]: scrub summary: idle+waiting paths [/] 2024-09-19T07:14:10.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:09 smithi148 ceph-mon[31180]: scrub summary: active paths [/] 2024-09-19T07:14:10.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:09 smithi148 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-19T07:14:10.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:09 smithi148 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-19T07:14:10.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:09 smithi165 ceph-mon[35326]: scrub summary: active paths [/] 2024-09-19T07:14:10.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:09 smithi165 ceph-mon[35326]: scrub summary: idle+waiting paths [/] 2024-09-19T07:14:10.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:09 smithi165 ceph-mon[35326]: scrub summary: idle+waiting paths [/] 2024-09-19T07:14:11.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:10 smithi179 ceph-mon[35716]: pgmap v96: 97 pgs: 97 active+clean; 268 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 12 MiB/s wr, 1.33k op/s 2024-09-19T07:14:11.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:10 smithi148 ceph-mon[31180]: pgmap v96: 97 pgs: 97 active+clean; 268 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 12 MiB/s wr, 1.33k op/s 2024-09-19T07:14:11.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:10 smithi165 ceph-mon[35326]: pgmap v96: 97 pgs: 97 active+clean; 268 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 12 MiB/s wr, 1.33k op/s 2024-09-19T07:14:11.358 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.355+0000 7fab93398640 1 -- 172.21.15.148:0/312867368 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab8c1069e0 msgr2=0x7fab8c106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:11.358 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.355+0000 7fab93398640 1 --2- 172.21.15.148:0/312867368 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab8c1069e0 0x7fab8c106dc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fab88009930 tx=0x7fab8802a420 comp rx=0 tx=0).stop 2024-09-19T07:14:11.358 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.355+0000 7fab93398640 1 -- 172.21.15.148:0/312867368 shutdown_connections 2024-09-19T07:14:11.358 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.355+0000 7fab93398640 1 --2- 172.21.15.148:0/312867368 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab8c101370 0x7fab8c10d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:11.358 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.355+0000 7fab93398640 1 --2- 172.21.15.148:0/312867368 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab8c1009d0 0x7fab8c100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:11.359 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.355+0000 7fab93398640 1 --2- 172.21.15.148:0/312867368 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab8c1069e0 0x7fab8c106dc0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:11.359 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.355+0000 7fab93398640 1 -- 172.21.15.148:0/312867368 >> 172.21.15.148:0/312867368 conn(0x7fab8c0fc6b0 msgr2=0x7fab8c0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:11.359 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.355+0000 7fab93398640 1 -- 172.21.15.148:0/312867368 shutdown_connections 2024-09-19T07:14:11.359 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.355+0000 7fab93398640 1 -- 172.21.15.148:0/312867368 wait complete. 2024-09-19T07:14:11.359 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.356+0000 7fab93398640 1 Processor -- start 2024-09-19T07:14:11.359 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.356+0000 7fab93398640 1 -- start start 2024-09-19T07:14:11.359 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.356+0000 7fab93398640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab8c1009d0 0x7fab8c0fcca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:11.359 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.356+0000 7fab93398640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab8c101370 0x7fab8c0fd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:11.359 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.356+0000 7fab93398640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab8c1069e0 0x7fab8c0fd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:11.359 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.356+0000 7fab93398640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fab8c110e20 con 0x7fab8c1069e0 2024-09-19T07:14:11.359 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.356+0000 7fab93398640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fab8c110ca0 con 0x7fab8c101370 2024-09-19T07:14:11.359 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.356+0000 7fab93398640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fab8c110fa0 con 0x7fab8c1009d0 2024-09-19T07:14:11.360 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.356+0000 7fab91935640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab8c1069e0 0x7fab8c0fd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:11.360 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.356+0000 7fab91134640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab8c1009d0 0x7fab8c0fcca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:11.360 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.356+0000 7fab91134640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab8c1009d0 0x7fab8c0fcca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:37062/0 (socket says 172.21.15.148:37062) 2024-09-19T07:14:11.360 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.356+0000 7fab91134640 1 -- 172.21.15.148:0/1388018984 learned_addr learned my addr 172.21.15.148:0/1388018984 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:14:11.360 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.356+0000 7fab90933640 1 --2- 172.21.15.148:0/1388018984 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab8c101370 0x7fab8c0fd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:11.360 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.356+0000 7fab91935640 1 -- 172.21.15.148:0/1388018984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab8c1009d0 msgr2=0x7fab8c0fcca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:11.360 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.356+0000 7fab91935640 1 --2- 172.21.15.148:0/1388018984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab8c1009d0 0x7fab8c0fcca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:11.360 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.356+0000 7fab91935640 1 -- 172.21.15.148:0/1388018984 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab8c101370 msgr2=0x7fab8c0fd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:11.360 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.356+0000 7fab91935640 1 --2- 172.21.15.148:0/1388018984 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab8c101370 0x7fab8c0fd1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:11.360 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.356+0000 7fab91935640 1 -- 172.21.15.148:0/1388018984 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab8c1a6860 con 0x7fab8c1069e0 2024-09-19T07:14:11.360 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.356+0000 7fab90933640 1 --2- 172.21.15.148:0/1388018984 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab8c101370 0x7fab8c0fd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:14:11.360 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.357+0000 7fab91935640 1 --2- 172.21.15.148:0/1388018984 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab8c1069e0 0x7fab8c0fd720 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fab84009fd0 tx=0x7fab8400ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:11.360 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.357+0000 7fab7e7fc640 1 -- 172.21.15.148:0/1388018984 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab8400ce20 con 0x7fab8c1069e0 2024-09-19T07:14:11.361 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.357+0000 7fab93398640 1 -- 172.21.15.148:0/1388018984 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab8c1a6b50 con 0x7fab8c1069e0 2024-09-19T07:14:11.361 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.357+0000 7fab93398640 1 -- 172.21.15.148:0/1388018984 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab8c1a70f0 con 0x7fab8c1069e0 2024-09-19T07:14:11.361 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.357+0000 7fab7e7fc640 1 -- 172.21.15.148:0/1388018984 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab84010430 con 0x7fab8c1069e0 2024-09-19T07:14:11.361 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.357+0000 7fab7e7fc640 1 -- 172.21.15.148:0/1388018984 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab8400f620 con 0x7fab8c1069e0 2024-09-19T07:14:11.366 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.359+0000 7fab9620f740 1 Processor -- start 2024-09-19T07:14:11.366 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.360+0000 7fab7e7fc640 1 -- 172.21.15.148:0/1388018984 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fab84010950 con 0x7fab8c1069e0 2024-09-19T07:14:11.366 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.360+0000 7fab9620f740 1 -- start start 2024-09-19T07:14:11.366 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.360+0000 7fab9620f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561354c81af0 0x561354c81ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:11.366 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.360+0000 7fab9620f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561354c82410 0x561354c8c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:11.366 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.360+0000 7fab9620f740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561354c8ccb0 0x561354c8f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:11.366 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.360+0000 7fab9620f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x561354be62f0 con 0x561354c81af0 2024-09-19T07:14:11.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.360+0000 7fab9620f740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x561354b8e270 con 0x561354c8ccb0 2024-09-19T07:14:11.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.360+0000 7fab9620f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x561354be22b0 con 0x561354c82410 2024-09-19T07:14:11.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.360+0000 7fab91134640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561354c82410 0x561354c8c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:11.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.360+0000 7fab91134640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561354c82410 0x561354c8c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:37064/0 (socket says 172.21.15.148:37064) 2024-09-19T07:14:11.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.360+0000 7fab91134640 1 -- 172.21.15.148:0/1281982201 learned_addr learned my addr 172.21.15.148:0/1281982201 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:14:11.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.360+0000 7fab90933640 1 --2- 172.21.15.148:0/1281982201 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561354c81af0 0x561354c81ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:11.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.360+0000 7fab91134640 1 -- 172.21.15.148:0/1281982201 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561354c8ccb0 msgr2=0x561354c8f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:11.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.360+0000 7fab7e7fc640 1 --2- 172.21.15.148:0/1388018984 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fab780a3460 0x7fab780a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:11.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.360+0000 7fab90933640 1 --2- 172.21.15.148:0/1281982201 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561354c8ccb0 0x561354c8f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:11.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.360+0000 7fab91134640 1 --2- 172.21.15.148:0/1281982201 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561354c8ccb0 0x561354c8f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:11.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.360+0000 7fab91134640 1 -- 172.21.15.148:0/1281982201 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561354c81af0 msgr2=0x561354c81ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:11.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.360+0000 7fab91134640 1 --2- 172.21.15.148:0/1281982201 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561354c81af0 0x561354c81ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:11.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.360+0000 7fab91134640 1 -- 172.21.15.148:0/1281982201 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561354b8d340 con 0x561354c82410 2024-09-19T07:14:11.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.360+0000 7fab90933640 1 --2- 172.21.15.148:0/1281982201 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561354c8ccb0 0x561354c8f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:14:11.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.361+0000 7fab91935640 1 --2- 172.21.15.148:0/1388018984 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fab780a3460 0x7fab780a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:11.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.361+0000 7fab7e7fc640 1 -- 172.21.15.148:0/1388018984 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fab840d0010 con 0x7fab8c1069e0 2024-09-19T07:14:11.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.361+0000 7fab91134640 1 --2- 172.21.15.148:0/1281982201 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561354c82410 0x561354c8c770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fab88006010 tx=0x7fab88005dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c9414532936109c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:11.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.361+0000 7fab777fe640 1 -- 172.21.15.148:0/1281982201 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab88040070 con 0x561354c82410 2024-09-19T07:14:11.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.361+0000 7fab777fe640 1 -- 172.21.15.148:0/1281982201 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab880318f0 con 0x561354c82410 2024-09-19T07:14:11.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.361+0000 7fab777fe640 1 -- 172.21.15.148:0/1281982201 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab88035040 con 0x561354c82410 2024-09-19T07:14:11.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.362+0000 7fab9620f740 1 -- 172.21.15.148:0/1281982201 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561354c82410 msgr2=0x561354c8c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:11.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.362+0000 7fab91935640 1 --2- 172.21.15.148:0/1388018984 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fab780a3460 0x7fab780a5920 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fab8409c290 tx=0x7fab84066c40 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:11.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.362+0000 7fab9620f740 1 --2- 172.21.15.148:0/1281982201 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561354c82410 0x561354c8c770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fab88006010 tx=0x7fab88005dc0 comp rx=0 tx=0).stop 2024-09-19T07:14:11.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.362+0000 7fab9620f740 1 -- 172.21.15.148:0/1281982201 shutdown_connections 2024-09-19T07:14:11.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.362+0000 7fab9620f740 1 --2- 172.21.15.148:0/1281982201 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561354c8ccb0 0x561354c8f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:11.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.362+0000 7fab9620f740 1 --2- 172.21.15.148:0/1281982201 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561354c82410 0x561354c8c770 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:11.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.362+0000 7fab9620f740 1 --2- 172.21.15.148:0/1281982201 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561354c81af0 0x561354c81ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:11.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.362+0000 7fab9620f740 1 -- 172.21.15.148:0/1281982201 >> 172.21.15.148:0/1281982201 conn(0x561354c7e060 msgr2=0x561354c7e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:11.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.362+0000 7fab9620f740 1 -- 172.21.15.148:0/1281982201 shutdown_connections 2024-09-19T07:14:11.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.362+0000 7fab9620f740 1 -- 172.21.15.148:0/1281982201 wait complete. 2024-09-19T07:14:11.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.362+0000 7fab9620f740 1 -- start start 2024-09-19T07:14:11.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.362+0000 7fab9620f740 1 Processor -- start 2024-09-19T07:14:11.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.363+0000 7fab9620f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561354c81af0 0x561354c89b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:11.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.363+0000 7fab9620f740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561354c82410 0x561354c8a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:11.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.363+0000 7fab9620f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561354c8ccb0 0x561354c8a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:11.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.363+0000 7fab9620f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x561354c8f880 con 0x561354c8ccb0 2024-09-19T07:14:11.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.363+0000 7fab9620f740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x561354b6f290 con 0x561354c82410 2024-09-19T07:14:11.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.363+0000 7fab9620f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x561354c8fa00 con 0x561354c81af0 2024-09-19T07:14:11.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.363+0000 7fab9620f740 10 client.0 _ll_register_callbacks cb 0x561354ba0140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:14:11.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.363+0000 7fab90933640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561354c8ccb0 0x561354c8a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:11.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.363+0000 7fab90933640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561354c8ccb0 0x561354c8a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50210/0 (socket says 172.21.15.148:50210) 2024-09-19T07:14:11.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.363+0000 7fab90933640 1 -- 172.21.15.148:0/1076471102 learned_addr learned my addr 172.21.15.148:0/1076471102 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:14:11.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.363+0000 7fab90933640 1 --2- 172.21.15.148:0/1076471102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561354c81af0 0x561354c89b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:11.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.363+0000 7fab91134640 1 --2- 172.21.15.148:0/1076471102 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561354c82410 0x561354c8a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:11.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.363+0000 7fab90933640 1 -- 172.21.15.148:0/1076471102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561354c81af0 msgr2=0x561354c89b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:11.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.363+0000 7fab90933640 1 --2- 172.21.15.148:0/1076471102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561354c81af0 0x561354c89b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:11.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.363+0000 7fab90933640 1 -- 172.21.15.148:0/1076471102 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561354c82410 msgr2=0x561354c8a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:11.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.363+0000 7fab90933640 1 --2- 172.21.15.148:0/1076471102 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561354c82410 0x561354c8a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:11.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.363+0000 7fab90933640 1 -- 172.21.15.148:0/1076471102 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613548f9210 con 0x561354c8ccb0 2024-09-19T07:14:11.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.363+0000 7fab90933640 1 --2- 172.21.15.148:0/1076471102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561354c8ccb0 0x561354c8a5e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fab80011490 tx=0x7fab80005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=739a758674cb8b34 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:11.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.363+0000 7fab74ff9640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:14:11.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.363+0000 7fab74ff9640 1 -- 172.21.15.148:0/1076471102 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab800140d0 con 0x561354c8ccb0 2024-09-19T07:14:11.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.364+0000 7fab74ff9640 1 -- 172.21.15.148:0/1076471102 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fab8001c040 con 0x561354c8ccb0 2024-09-19T07:14:11.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.364+0000 7fab9620f740 1 -- 172.21.15.148:0/1076471102 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab880318f0 con 0x561354c8ccb0 2024-09-19T07:14:11.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.364+0000 7fab74ff9640 1 -- 172.21.15.148:0/1076471102 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fab80014270 con 0x561354c8ccb0 2024-09-19T07:14:11.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.364+0000 7fab9620f740 10 client.16212 fetch_fsmap learned FSMap version 31 2024-09-19T07:14:11.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.364+0000 7fab9620f740 1 -- 172.21.15.148:0/1076471102 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5613549c5620 con 0x561354c8ccb0 2024-09-19T07:14:11.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.364+0000 7fab74ff9640 1 -- 172.21.15.148:0/1076471102 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab880318f0 con 0x561354c8ccb0 2024-09-19T07:14:11.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.364+0000 7fab74ff9640 1 -- 172.21.15.148:0/1076471102 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fab80004ca0 con 0x561354c8ccb0 2024-09-19T07:14:11.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.364+0000 7fab9620f740 10 client.16212 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:14:11.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.364+0000 7fab9620f740 10 client.16212 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:14:11.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.364+0000 7fab9620f740 20 client.16212 populate_metadata read hostname 'smithi148' 2024-09-19T07:14:11.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.364+0000 7fab9620f740 1 --2- 172.21.15.148:0/1076471102 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561354c9cb90 0x561354c9efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:11.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.364+0000 7fab9620f740 4 client.16212 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:14:11.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.364+0000 7fab9620f740 1 -- 172.21.15.148:0/1076471102 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561354bf3a20 con 0x561354c9cb90 2024-09-19T07:14:11.372 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.364+0000 7fab91134640 1 --2- 172.21.15.148:0/1076471102 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561354c9cb90 0x561354c9efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:11.372 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.365+0000 7fab91134640 1 --2- 172.21.15.148:0/1076471102 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561354c9cb90 0x561354c9efe0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2580c071b9ed9be server_cookie=807d1e7a2ac58c9b in_seq=0 out_seq=0 2024-09-19T07:14:11.372 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.365+0000 7fab74ff9640 10 client.16212 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:14:11.373 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.367+0000 7fab74ff9640 1 -- 172.21.15.148:0/1076471102 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561354bf3a20 con 0x561354c9cb90 2024-09-19T07:14:11.373 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.367+0000 7fab74ff9640 10 client.16212 handle_command_reply: tid=0 2024-09-19T07:14:11.373 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.367+0000 7fab9620f740 1 client.16212 shutdown 2024-09-19T07:14:11.373 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.367+0000 7fab9620f740 1 -- 172.21.15.148:0/1076471102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561354c8ccb0 msgr2=0x561354c8a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:11.373 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.367+0000 7fab9620f740 1 --2- 172.21.15.148:0/1076471102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561354c8ccb0 0x561354c8a5e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fab80011490 tx=0x7fab80005f90 comp rx=0 tx=0).stop 2024-09-19T07:14:11.373 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.367+0000 7fab9620f740 1 -- 172.21.15.148:0/1076471102 shutdown_connections 2024-09-19T07:14:11.373 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.367+0000 7fab9620f740 1 --2- 172.21.15.148:0/1076471102 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561354c9cb90 0x561354c9efe0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:11.373 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.367+0000 7fab9620f740 1 --2- 172.21.15.148:0/1076471102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561354c8ccb0 0x561354c8a5e0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:11.373 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.367+0000 7fab9620f740 1 --2- 172.21.15.148:0/1076471102 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561354c82410 0x561354c8a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:11.374 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.367+0000 7fab74ff9640 0 client.16212 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:14:11.374 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.367+0000 7fab9620f740 1 --2- 172.21.15.148:0/1076471102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561354c81af0 0x561354c89b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:11.374 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.367+0000 7fab9620f740 1 -- 172.21.15.148:0/1076471102 >> 172.21.15.148:0/1076471102 conn(0x561354c7e060 msgr2=0x561354c83dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:11.374 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.367+0000 7fab9620f740 1 -- 172.21.15.148:0/1076471102 shutdown_connections 2024-09-19T07:14:11.374 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.367+0000 7fab9620f740 1 -- 172.21.15.148:0/1076471102 wait complete. 2024-09-19T07:14:11.374 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.367+0000 7fab9620f740 20 client.16212 trim_cache size 0 max 16384 2024-09-19T07:14:11.385 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.383+0000 7fab9620f740 1 Processor -- start 2024-09-19T07:14:11.385 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.383+0000 7fab9620f740 1 -- start start 2024-09-19T07:14:11.385 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.383+0000 7fab9620f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561354c81af0 0x561354c84560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:11.386 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.383+0000 7fab9620f740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561354c82410 0x561354c8a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:11.386 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.383+0000 7fab9620f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561354c8ccb0 0x561354c8a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:11.386 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.383+0000 7fab9620f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fab8c1b22e0 con 0x561354c81af0 2024-09-19T07:14:11.386 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.383+0000 7fab9620f740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fab8c1afbb0 con 0x561354c82410 2024-09-19T07:14:11.386 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.383+0000 7fab9620f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fab8c1ad9e0 con 0x561354c8ccb0 2024-09-19T07:14:11.386 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.383+0000 7fab90933640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561354c81af0 0x561354c84560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:11.386 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.383+0000 7fab90933640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561354c81af0 0x561354c84560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50224/0 (socket says 172.21.15.148:50224) 2024-09-19T07:14:11.386 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.383+0000 7fab90933640 1 -- 172.21.15.148:0/653477679 learned_addr learned my addr 172.21.15.148:0/653477679 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:14:11.386 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.383+0000 7fab90933640 1 --2- 172.21.15.148:0/653477679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561354c8ccb0 0x561354c8a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:11.386 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.383+0000 7fab91134640 1 --2- 172.21.15.148:0/653477679 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561354c82410 0x561354c8a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:11.386 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.383+0000 7fab90933640 1 -- 172.21.15.148:0/653477679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561354c8ccb0 msgr2=0x561354c8a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:11.386 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.383+0000 7fab90933640 1 --2- 172.21.15.148:0/653477679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561354c8ccb0 0x561354c8a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:11.387 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.383+0000 7fab90933640 1 -- 172.21.15.148:0/653477679 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561354c82410 msgr2=0x561354c8a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:11.387 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.383+0000 7fab90933640 1 --2- 172.21.15.148:0/653477679 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561354c82410 0x561354c8a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:11.387 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.383+0000 7fab90933640 1 -- 172.21.15.148:0/653477679 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561354c82240 con 0x561354c81af0 2024-09-19T07:14:11.387 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.383+0000 7fab90933640 1 --2- 172.21.15.148:0/653477679 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561354c81af0 0x561354c84560 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fab8000f480 tx=0x7fab80014b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=161d394358c07059 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:11.387 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.384+0000 7fab76ffd640 1 -- 172.21.15.148:0/653477679 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab80009770 con 0x561354c81af0 2024-09-19T07:14:11.387 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.384+0000 7fab76ffd640 1 -- 172.21.15.148:0/653477679 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab8000f6f0 con 0x561354c81af0 2024-09-19T07:14:11.387 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.384+0000 7fab76ffd640 1 -- 172.21.15.148:0/653477679 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab80021d30 con 0x561354c81af0 2024-09-19T07:14:11.387 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.384+0000 7fab9620f740 1 -- 172.21.15.148:0/653477679 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561354c81af0 msgr2=0x561354c84560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:11.387 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.384+0000 7fab9620f740 1 --2- 172.21.15.148:0/653477679 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561354c81af0 0x561354c84560 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fab8000f480 tx=0x7fab80014b70 comp rx=0 tx=0).stop 2024-09-19T07:14:11.387 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.384+0000 7fab9620f740 1 -- 172.21.15.148:0/653477679 shutdown_connections 2024-09-19T07:14:11.387 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.384+0000 7fab9620f740 1 --2- 172.21.15.148:0/653477679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561354c8ccb0 0x561354c8a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:11.387 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.384+0000 7fab9620f740 1 --2- 172.21.15.148:0/653477679 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561354c82410 0x561354c8a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:11.387 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.384+0000 7fab9620f740 1 --2- 172.21.15.148:0/653477679 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561354c81af0 0x561354c84560 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:11.388 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.384+0000 7fab9620f740 1 -- 172.21.15.148:0/653477679 >> 172.21.15.148:0/653477679 conn(0x561354c7e060 msgr2=0x561354c8bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:11.388 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.384+0000 7fab9620f740 1 -- 172.21.15.148:0/653477679 shutdown_connections 2024-09-19T07:14:11.388 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.384+0000 7fab9620f740 1 -- 172.21.15.148:0/653477679 wait complete. 2024-09-19T07:14:11.388 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.385+0000 7fab9620f740 1 -- start start 2024-09-19T07:14:11.388 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.385+0000 7fab9620f740 1 Processor -- start 2024-09-19T07:14:11.390 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.385+0000 7fab9620f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561354c81af0 0x561354c95390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:11.390 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.385+0000 7fab9620f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561354c82410 0x561354c906b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:11.390 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.385+0000 7fab9620f740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561354c8ccb0 0x561354c90bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:11.390 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.385+0000 7fab9620f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fab8c1ae070 con 0x561354c81af0 2024-09-19T07:14:11.390 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.385+0000 7fab9620f740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fab8c1af4e0 con 0x561354c8ccb0 2024-09-19T07:14:11.391 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.385+0000 7fab9620f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fab8c1ae740 con 0x561354c82410 2024-09-19T07:14:11.391 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.385+0000 7fab9620f740 10 client.0 _ll_register_callbacks cb 0x7fab80009c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:14:11.391 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.385+0000 7fab90933640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561354c81af0 0x561354c95390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:11.391 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.385+0000 7fab90933640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561354c81af0 0x561354c95390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50232/0 (socket says 172.21.15.148:50232) 2024-09-19T07:14:11.391 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.385+0000 7fab90933640 1 -- 172.21.15.148:0/3028018285 learned_addr learned my addr 172.21.15.148:0/3028018285 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:14:11.391 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.385+0000 7fab91134640 1 --2- 172.21.15.148:0/3028018285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561354c82410 0x561354c906b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:11.391 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.385+0000 7fab90933640 1 --2- 172.21.15.148:0/3028018285 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561354c8ccb0 0x561354c90bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:11.391 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.385+0000 7fab90933640 1 -- 172.21.15.148:0/3028018285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561354c82410 msgr2=0x561354c906b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:11.391 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.385+0000 7fab90933640 1 --2- 172.21.15.148:0/3028018285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561354c82410 0x561354c906b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:11.391 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.385+0000 7fab90933640 1 -- 172.21.15.148:0/3028018285 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561354c8ccb0 msgr2=0x561354c90bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:11.391 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.385+0000 7fab90933640 1 --2- 172.21.15.148:0/3028018285 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561354c8ccb0 0x561354c90bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:11.391 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.385+0000 7fab90933640 1 -- 172.21.15.148:0/3028018285 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561354c91420 con 0x561354c81af0 2024-09-19T07:14:11.391 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.386+0000 7fab90933640 1 --2- 172.21.15.148:0/3028018285 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561354c81af0 0x561354c95390 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fab8000f670 tx=0x7fab80005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f60838ca5373d88a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:11.392 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.386+0000 7fab74ff9640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:14:11.392 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.386+0000 7fab74ff9640 1 -- 172.21.15.148:0/3028018285 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab80021450 con 0x561354c81af0 2024-09-19T07:14:11.392 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.386+0000 7fab74ff9640 1 -- 172.21.15.148:0/3028018285 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fab800215f0 con 0x561354c81af0 2024-09-19T07:14:11.392 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.386+0000 7fab9620f740 1 -- 172.21.15.148:0/3028018285 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab8000f6f0 con 0x561354c81af0 2024-09-19T07:14:11.392 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.386+0000 7fab74ff9640 1 -- 172.21.15.148:0/3028018285 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fab800217f0 con 0x561354c81af0 2024-09-19T07:14:11.392 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.386+0000 7fab9620f740 10 client.16218 fetch_fsmap learned FSMap version 31 2024-09-19T07:14:11.392 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.386+0000 7fab9620f740 1 -- 172.21.15.148:0/3028018285 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x561354d07800 con 0x561354c81af0 2024-09-19T07:14:11.392 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.386+0000 7fab74ff9640 1 -- 172.21.15.148:0/3028018285 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab8000f6f0 con 0x561354c81af0 2024-09-19T07:14:11.392 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.386+0000 7fab74ff9640 1 -- 172.21.15.148:0/3028018285 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fab80041b80 con 0x561354c81af0 2024-09-19T07:14:11.392 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.386+0000 7fab9620f740 10 client.16218 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:14:11.392 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.386+0000 7fab9620f740 10 client.16218 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:14:11.392 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.386+0000 7fab9620f740 20 client.16218 populate_metadata read hostname 'smithi148' 2024-09-19T07:14:11.392 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.386+0000 7fab9620f740 1 --2- 172.21.15.148:0/3028018285 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561354d07df0 0x561354d0a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:11.393 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.386+0000 7fab9620f740 4 client.16218 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:14:11.393 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.386+0000 7fab9620f740 1 -- 172.21.15.148:0/3028018285 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561354bedd70 con 0x561354d07df0 2024-09-19T07:14:11.393 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.387+0000 7fab91134640 1 --2- 172.21.15.148:0/3028018285 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561354d07df0 0x561354d0a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:11.393 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.387+0000 7fab74ff9640 10 client.16218 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:14:11.393 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:11.387+0000 7fab91134640 1 --2- 172.21.15.148:0/3028018285 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561354d07df0 0x561354d0a210 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa674bbb1d9f5109 server_cookie=e0cf12827257984f in_seq=0 out_seq=0 2024-09-19T07:14:13.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:12 smithi179 ceph-mon[35716]: pgmap v97: 97 pgs: 97 active+clean; 293 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 14 MiB/s wr, 1.43k op/s 2024-09-19T07:14:13.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:12 smithi148 ceph-mon[31180]: pgmap v97: 97 pgs: 97 active+clean; 293 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 14 MiB/s wr, 1.43k op/s 2024-09-19T07:14:13.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:12 smithi165 ceph-mon[35326]: pgmap v97: 97 pgs: 97 active+clean; 293 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 14 MiB/s wr, 1.43k op/s 2024-09-19T07:14:13.193 INFO:tasks.workunit.client.0.smithi148.stdout: 99 4970 827 4816 564 0 235 2024-09-19T07:14:15.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:14 smithi179 ceph-mon[35716]: pgmap v98: 97 pgs: 97 active+clean; 293 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 12 MiB/s wr, 686 op/s 2024-09-19T07:14:15.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:14 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:14:15.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:14 smithi148 ceph-mon[31180]: pgmap v98: 97 pgs: 97 active+clean; 293 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 12 MiB/s wr, 686 op/s 2024-09-19T07:14:15.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:14 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:14:15.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:14 smithi165 ceph-mon[35326]: pgmap v98: 97 pgs: 97 active+clean; 293 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 12 MiB/s wr, 686 op/s 2024-09-19T07:14:15.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:14 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:14:16.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:15 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:16.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:15 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:14:16.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:15 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:14:16.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:15 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:16.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:15 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:14:16.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:15 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:14:16.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:15 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:16.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:15 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:14:16.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:15 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:14:17.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:16 smithi179 ceph-mon[35716]: pgmap v99: 97 pgs: 97 active+clean; 302 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 13 MiB/s wr, 1.02k op/s 2024-09-19T07:14:17.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:16 smithi179 ceph-mon[35716]: scrub summary: idle 2024-09-19T07:14:17.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:16 smithi148 ceph-mon[31180]: pgmap v99: 97 pgs: 97 active+clean; 302 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 13 MiB/s wr, 1.02k op/s 2024-09-19T07:14:17.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:16 smithi148 ceph-mon[31180]: scrub summary: idle 2024-09-19T07:14:17.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:16 smithi165 ceph-mon[35326]: pgmap v99: 97 pgs: 97 active+clean; 302 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 13 MiB/s wr, 1.02k op/s 2024-09-19T07:14:17.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:16 smithi165 ceph-mon[35326]: scrub summary: idle 2024-09-19T07:14:17.648 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T07:14:17.941 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:14:18.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:17 smithi179 ceph-mon[35716]: scrub summary: idle 2024-09-19T07:14:18.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:17 smithi179 ceph-mon[35716]: scrub summary: idle 2024-09-19T07:14:18.034 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:17 smithi165 ceph-mon[35326]: scrub summary: idle 2024-09-19T07:14:18.034 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:17 smithi165 ceph-mon[35326]: scrub summary: idle 2024-09-19T07:14:18.062 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:17 smithi148 ceph-mon[31180]: scrub summary: idle 2024-09-19T07:14:18.062 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:17 smithi148 ceph-mon[31180]: scrub summary: idle 2024-09-19T07:14:18.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.577+0000 7f4345dee640 1 -- 172.21.15.148:0/2174432952 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4340101410 msgr2=0x7f434010d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:18.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.577+0000 7f4345dee640 1 --2- 172.21.15.148:0/2174432952 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4340101410 0x7f434010d940 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4338009c10 tx=0x7f433802a6f0 comp rx=0 tx=0).stop 2024-09-19T07:14:18.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.577+0000 7f4345dee640 1 -- 172.21.15.148:0/2174432952 shutdown_connections 2024-09-19T07:14:18.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.577+0000 7f4345dee640 1 --2- 172.21.15.148:0/2174432952 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4340101410 0x7f434010d940 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:18.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.577+0000 7f4345dee640 1 --2- 172.21.15.148:0/2174432952 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4340100a70 0x7f4340100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:18.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.577+0000 7f4345dee640 1 --2- 172.21.15.148:0/2174432952 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4340106a70 0x7f4340106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:18.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.577+0000 7f4345dee640 1 -- 172.21.15.148:0/2174432952 >> 172.21.15.148:0/2174432952 conn(0x7f43400fc7d0 msgr2=0x7f43400febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:18.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.577+0000 7f4345dee640 1 -- 172.21.15.148:0/2174432952 shutdown_connections 2024-09-19T07:14:18.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.577+0000 7f4345dee640 1 -- 172.21.15.148:0/2174432952 wait complete. 2024-09-19T07:14:18.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.578+0000 7f4345dee640 1 Processor -- start 2024-09-19T07:14:18.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.578+0000 7f4345dee640 1 -- start start 2024-09-19T07:14:18.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.578+0000 7f4345dee640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4340100a70 0x7f434019b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:18.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.578+0000 7f4345dee640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4340101410 0x7f434019b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:18.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.578+0000 7f4345dee640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4340106a70 0x7f434019ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:18.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.578+0000 7f4345dee640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f434010fd90 con 0x7f4340100a70 2024-09-19T07:14:18.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.578+0000 7f4345dee640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f434010fc10 con 0x7f4340101410 2024-09-19T07:14:18.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.578+0000 7f4345dee640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f434010ff10 con 0x7f4340106a70 2024-09-19T07:14:18.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.578+0000 7f433ffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4340106a70 0x7f434019ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:18.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.578+0000 7f433ffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4340106a70 0x7f434019ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:54890/0 (socket says 172.21.15.148:54890) 2024-09-19T07:14:18.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.578+0000 7f433ffff640 1 -- 172.21.15.148:0/1570678128 learned_addr learned my addr 172.21.15.148:0/1570678128 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:14:18.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.578+0000 7f433f7fe640 1 --2- 172.21.15.148:0/1570678128 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4340100a70 0x7f434019b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:18.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.578+0000 7f4337fff640 1 --2- 172.21.15.148:0/1570678128 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4340101410 0x7f434019b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:18.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.578+0000 7f433ffff640 1 -- 172.21.15.148:0/1570678128 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4340101410 msgr2=0x7f434019b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:18.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.578+0000 7f433ffff640 1 --2- 172.21.15.148:0/1570678128 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4340101410 0x7f434019b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:18.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.578+0000 7f433ffff640 1 -- 172.21.15.148:0/1570678128 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4340100a70 msgr2=0x7f434019b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:18.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.578+0000 7f433ffff640 1 --2- 172.21.15.148:0/1570678128 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4340100a70 0x7f434019b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:18.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.578+0000 7f433ffff640 1 -- 172.21.15.148:0/1570678128 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f434019f610 con 0x7f4340106a70 2024-09-19T07:14:18.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.579+0000 7f4337fff640 1 --2- 172.21.15.148:0/1570678128 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4340101410 0x7f434019b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:14:18.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.579+0000 7f433ffff640 1 --2- 172.21.15.148:0/1570678128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4340106a70 0x7f434019ef30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f43380305b0 tx=0x7f43380305e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:18.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.579+0000 7f433d7fa640 1 -- 172.21.15.148:0/1570678128 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4338041020 con 0x7f4340106a70 2024-09-19T07:14:18.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.579+0000 7f433d7fa640 1 -- 172.21.15.148:0/1570678128 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4338037040 con 0x7f4340106a70 2024-09-19T07:14:18.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.579+0000 7f4345dee640 1 -- 172.21.15.148:0/1570678128 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f434019f8a0 con 0x7f4340106a70 2024-09-19T07:14:18.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.579+0000 7f4345dee640 1 -- 172.21.15.148:0/1570678128 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43401a7220 con 0x7f4340106a70 2024-09-19T07:14:18.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.579+0000 7f433d7fa640 1 -- 172.21.15.148:0/1570678128 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4338036070 con 0x7f4340106a70 2024-09-19T07:14:18.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.582+0000 7f433d7fa640 1 -- 172.21.15.148:0/1570678128 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f4338044020 con 0x7f4340106a70 2024-09-19T07:14:18.584 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.582+0000 7f433d7fa640 1 --2- 172.21.15.148:0/1570678128 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f432c0a3430 0x7f432c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:18.585 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.583+0000 7f433d7fa640 1 -- 172.21.15.148:0/1570678128 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f43380f0800 con 0x7f4340106a70 2024-09-19T07:14:18.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.583+0000 7f433f7fe640 1 --2- 172.21.15.148:0/1570678128 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f432c0a3430 0x7f432c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:18.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.583+0000 7f43481c7740 1 Processor -- start 2024-09-19T07:14:18.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.583+0000 7f43481c7740 1 -- start start 2024-09-19T07:14:18.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.584+0000 7f433f7fe640 1 --2- 172.21.15.148:0/1570678128 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f432c0a3430 0x7f432c0a58f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f433000bb60 tx=0x7f433000b390 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:18.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.584+0000 7f43481c7740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ada4fc04a0 0x55ada4fc0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:18.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.584+0000 7f43481c7740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ada4fc0dc0 0x55ada4fcb140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:18.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.584+0000 7f43481c7740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ada4fcb680 0x55ada4fcda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:18.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.584+0000 7f43481c7740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55ada4f262e0 con 0x55ada4fc04a0 2024-09-19T07:14:18.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.584+0000 7f43481c7740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ada4ecdce0 con 0x55ada4fc0dc0 2024-09-19T07:14:18.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.584+0000 7f43481c7740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ada4f222a0 con 0x55ada4fcb680 2024-09-19T07:14:18.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.584+0000 7f433ffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ada4fcb680 0x55ada4fcda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:18.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.584+0000 7f433ffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ada4fcb680 0x55ada4fcda70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:54892/0 (socket says 172.21.15.148:54892) 2024-09-19T07:14:18.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.584+0000 7f433ffff640 1 -- 172.21.15.148:0/1391496427 learned_addr learned my addr 172.21.15.148:0/1391496427 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:14:18.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.584+0000 7f433f7fe640 1 --2- 172.21.15.148:0/1391496427 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ada4fc04a0 0x55ada4fc0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:18.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.584+0000 7f4337fff640 1 --2- 172.21.15.148:0/1391496427 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ada4fc0dc0 0x55ada4fcb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:18.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.584+0000 7f433ffff640 1 -- 172.21.15.148:0/1391496427 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ada4fc0dc0 msgr2=0x55ada4fcb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:18.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.584+0000 7f433ffff640 1 --2- 172.21.15.148:0/1391496427 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ada4fc0dc0 0x55ada4fcb140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:18.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.584+0000 7f433ffff640 1 -- 172.21.15.148:0/1391496427 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ada4fc04a0 msgr2=0x55ada4fc0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:18.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.584+0000 7f433ffff640 1 --2- 172.21.15.148:0/1391496427 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ada4fc04a0 0x55ada4fc0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:18.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.584+0000 7f433ffff640 1 -- 172.21.15.148:0/1391496427 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ada4eb2440 con 0x55ada4fcb680 2024-09-19T07:14:18.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.584+0000 7f433f7fe640 1 --2- 172.21.15.148:0/1391496427 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ada4fc04a0 0x55ada4fc0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:14:18.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.585+0000 7f433ffff640 1 --2- 172.21.15.148:0/1391496427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ada4fcb680 0x55ada4fcda70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4338034040 tx=0x7f43380bc410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d5a107692760729 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:18.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.585+0000 7f4335ffb640 1 -- 172.21.15.148:0/1391496427 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43380c0e60 con 0x55ada4fcb680 2024-09-19T07:14:18.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.585+0000 7f4335ffb640 1 -- 172.21.15.148:0/1391496427 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43380c5720 con 0x55ada4fcb680 2024-09-19T07:14:18.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.585+0000 7f4335ffb640 1 -- 172.21.15.148:0/1391496427 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43380bcd10 con 0x55ada4fcb680 2024-09-19T07:14:18.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.585+0000 7f43481c7740 1 -- 172.21.15.148:0/1391496427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ada4fcb680 msgr2=0x55ada4fcda70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:18.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.585+0000 7f43481c7740 1 --2- 172.21.15.148:0/1391496427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ada4fcb680 0x55ada4fcda70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4338034040 tx=0x7f43380bc410 comp rx=0 tx=0).stop 2024-09-19T07:14:18.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.586+0000 7f43481c7740 1 -- 172.21.15.148:0/1391496427 shutdown_connections 2024-09-19T07:14:18.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.586+0000 7f43481c7740 1 --2- 172.21.15.148:0/1391496427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ada4fcb680 0x55ada4fcda70 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:18.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.586+0000 7f43481c7740 1 --2- 172.21.15.148:0/1391496427 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ada4fc0dc0 0x55ada4fcb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:18.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.586+0000 7f43481c7740 1 --2- 172.21.15.148:0/1391496427 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ada4fc04a0 0x55ada4fc0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:18.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.586+0000 7f43481c7740 1 -- 172.21.15.148:0/1391496427 >> 172.21.15.148:0/1391496427 conn(0x55ada4fbca30 msgr2=0x55ada4fbce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:18.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.586+0000 7f43481c7740 1 -- 172.21.15.148:0/1391496427 shutdown_connections 2024-09-19T07:14:18.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.586+0000 7f43481c7740 1 -- 172.21.15.148:0/1391496427 wait complete. 2024-09-19T07:14:18.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.586+0000 7f43481c7740 1 -- start start 2024-09-19T07:14:18.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.586+0000 7f43481c7740 1 Processor -- start 2024-09-19T07:14:18.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.587+0000 7f43481c7740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ada4fc04a0 0x55ada4fcaf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:18.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.587+0000 7f43481c7740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ada4fc0dc0 0x55ada4fc8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:18.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.587+0000 7f43481c7740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ada4fcb680 0x55ada4fc8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:18.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.587+0000 7f43481c7740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55ada4fce010 con 0x55ada4fc04a0 2024-09-19T07:14:18.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.587+0000 7f43481c7740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ada4ee1050 con 0x55ada4fcb680 2024-09-19T07:14:18.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.587+0000 7f43481c7740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ada4fce190 con 0x55ada4fc0dc0 2024-09-19T07:14:18.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.587+0000 7f43481c7740 10 client.0 _ll_register_callbacks cb 0x55ada4f21160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:14:18.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.587+0000 7f433f7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ada4fc04a0 0x55ada4fcaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:18.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.587+0000 7f433f7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ada4fc04a0 0x55ada4fcaf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38540/0 (socket says 172.21.15.148:38540) 2024-09-19T07:14:18.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.587+0000 7f433f7fe640 1 -- 172.21.15.148:0/1074857041 learned_addr learned my addr 172.21.15.148:0/1074857041 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:14:18.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.587+0000 7f433ffff640 1 --2- 172.21.15.148:0/1074857041 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ada4fcb680 0x55ada4fc8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:18.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.587+0000 7f4337fff640 1 --2- 172.21.15.148:0/1074857041 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ada4fc0dc0 0x55ada4fc8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:18.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.587+0000 7f4337fff640 1 -- 172.21.15.148:0/1074857041 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ada4fcb680 msgr2=0x55ada4fc8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:18.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.587+0000 7f4337fff640 1 --2- 172.21.15.148:0/1074857041 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ada4fcb680 0x55ada4fc8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:18.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.587+0000 7f4337fff640 1 -- 172.21.15.148:0/1074857041 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ada4fc04a0 msgr2=0x55ada4fcaf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:18.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.587+0000 7f4337fff640 1 --2- 172.21.15.148:0/1074857041 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ada4fc04a0 0x55ada4fcaf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:18.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.587+0000 7f4337fff640 1 -- 172.21.15.148:0/1074857041 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ada4c973c0 con 0x55ada4fc0dc0 2024-09-19T07:14:18.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.587+0000 7f433ffff640 1 --2- 172.21.15.148:0/1074857041 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ada4fcb680 0x55ada4fc8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:14:18.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.587+0000 7f433f7fe640 1 --2- 172.21.15.148:0/1074857041 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ada4fc04a0 0x55ada4fcaf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:14:18.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.587+0000 7f4337fff640 1 --2- 172.21.15.148:0/1074857041 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ada4fc0dc0 0x55ada4fc8240 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f43400fce40 tx=0x7f4328012aa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc2623cd675b5016 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:18.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.587+0000 7f431effd640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-19T07:14:18.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.588+0000 7f431effd640 1 -- 172.21.15.148:0/1074857041 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4328004240 con 0x55ada4fc0dc0 2024-09-19T07:14:18.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.588+0000 7f43481c7740 1 -- 172.21.15.148:0/1074857041 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43380c5720 con 0x55ada4fc0dc0 2024-09-19T07:14:18.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.588+0000 7f431effd640 1 -- 172.21.15.148:0/1074857041 <== mon.1 v2:172.21.15.179:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f43280043e0 con 0x55ada4fc0dc0 2024-09-19T07:14:18.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.588+0000 7f431effd640 1 -- 172.21.15.148:0/1074857041 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f43280035f0 con 0x55ada4fc0dc0 2024-09-19T07:14:18.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.588+0000 7f43481c7740 10 client.25654 fetch_fsmap learned FSMap version 31 2024-09-19T07:14:18.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.588+0000 7f43481c7740 1 -- 172.21.15.148:0/1074857041 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55ada4fd9960 con 0x55ada4fc0dc0 2024-09-19T07:14:18.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.588+0000 7f431effd640 1 -- 172.21.15.148:0/1074857041 <== mon.1 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43380c5720 con 0x55ada4fc0dc0 2024-09-19T07:14:18.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.588+0000 7f431effd640 1 -- 172.21.15.148:0/1074857041 <== mon.1 v2:172.21.15.179:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f4328011b80 con 0x55ada4fc0dc0 2024-09-19T07:14:18.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.589+0000 7f43481c7740 10 client.25654 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:14:18.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.589+0000 7f43481c7740 10 client.25654 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:14:18.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.589+0000 7f43481c7740 20 client.25654 populate_metadata read hostname 'smithi148' 2024-09-19T07:14:18.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.589+0000 7f43481c7740 1 --2- 172.21.15.148:0/1074857041 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ada4fdaf40 0x55ada4fdd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:18.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.589+0000 7f43481c7740 4 client.25654 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:14:18.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.589+0000 7f43481c7740 1 -- 172.21.15.148:0/1074857041 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ada4f33850 con 0x55ada4fdaf40 2024-09-19T07:14:18.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.589+0000 7f433f7fe640 1 --2- 172.21.15.148:0/1074857041 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ada4fdaf40 0x55ada4fdd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:18.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.589+0000 7f433f7fe640 1 --2- 172.21.15.148:0/1074857041 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ada4fdaf40 0x55ada4fdd3a0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c0451328ece178d server_cookie=352ee814e0528eec in_seq=0 out_seq=0 2024-09-19T07:14:18.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.589+0000 7f431effd640 10 client.25654 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:14:18.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.591+0000 7f431effd640 1 -- 172.21.15.148:0/1074857041 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ada4f33850 con 0x55ada4fdaf40 2024-09-19T07:14:18.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.591+0000 7f431effd640 10 client.25654 handle_command_reply: tid=0 2024-09-19T07:14:18.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.591+0000 7f43481c7740 1 client.25654 shutdown 2024-09-19T07:14:18.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.591+0000 7f43481c7740 1 -- 172.21.15.148:0/1074857041 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ada4fc0dc0 msgr2=0x55ada4fc8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:18.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.591+0000 7f43481c7740 1 --2- 172.21.15.148:0/1074857041 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ada4fc0dc0 0x55ada4fc8240 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f43400fce40 tx=0x7f4328012aa0 comp rx=0 tx=0).stop 2024-09-19T07:14:18.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.591+0000 7f43481c7740 1 -- 172.21.15.148:0/1074857041 shutdown_connections 2024-09-19T07:14:18.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.591+0000 7f43481c7740 1 --2- 172.21.15.148:0/1074857041 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ada4fdaf40 0x55ada4fdd3a0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:18.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.591+0000 7f43481c7740 1 --2- 172.21.15.148:0/1074857041 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ada4fcb680 0x55ada4fc8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:18.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.591+0000 7f431effd640 0 client.25654 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:14:18.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.591+0000 7f43481c7740 1 --2- 172.21.15.148:0/1074857041 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ada4fc0dc0 0x55ada4fc8240 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:18.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.591+0000 7f43481c7740 1 --2- 172.21.15.148:0/1074857041 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ada4fc04a0 0x55ada4fcaf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:18.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.591+0000 7f43481c7740 1 -- 172.21.15.148:0/1074857041 >> 172.21.15.148:0/1074857041 conn(0x55ada4fbca30 msgr2=0x55ada4fc2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:18.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.591+0000 7f43481c7740 1 -- 172.21.15.148:0/1074857041 shutdown_connections 2024-09-19T07:14:18.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.591+0000 7f43481c7740 1 -- 172.21.15.148:0/1074857041 wait complete. 2024-09-19T07:14:18.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.591+0000 7f43481c7740 20 client.25654 trim_cache size 0 max 16384 2024-09-19T07:14:18.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.610+0000 7f43481c7740 1 Processor -- start 2024-09-19T07:14:18.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.610+0000 7f43481c7740 1 -- start start 2024-09-19T07:14:18.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.610+0000 7f43481c7740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ada4fbca30 0x55ada4fd71e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:18.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.610+0000 7f43481c7740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ada4fc04a0 0x55ada4fc7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:18.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.610+0000 7f43481c7740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ada4fc0dc0 0x55ada4fe2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:18.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.610+0000 7f43481c7740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4320011000 con 0x55ada4fbca30 2024-09-19T07:14:18.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.610+0000 7f43481c7740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f432000e8d0 con 0x55ada4fc0dc0 2024-09-19T07:14:18.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.610+0000 7f43481c7740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f432000c700 con 0x55ada4fc04a0 2024-09-19T07:14:18.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.610+0000 7f433f7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ada4fbca30 0x55ada4fd71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:18.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.610+0000 7f433f7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ada4fbca30 0x55ada4fd71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38544/0 (socket says 172.21.15.148:38544) 2024-09-19T07:14:18.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.610+0000 7f433f7fe640 1 -- 172.21.15.148:0/525646249 learned_addr learned my addr 172.21.15.148:0/525646249 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:14:18.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.611+0000 7f4337fff640 1 --2- 172.21.15.148:0/525646249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ada4fc04a0 0x55ada4fc7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:18.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.611+0000 7f433ffff640 1 --2- 172.21.15.148:0/525646249 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ada4fc0dc0 0x55ada4fe2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:18.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.611+0000 7f433f7fe640 1 -- 172.21.15.148:0/525646249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ada4fc04a0 msgr2=0x55ada4fc7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:18.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.611+0000 7f433f7fe640 1 --2- 172.21.15.148:0/525646249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ada4fc04a0 0x55ada4fc7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:18.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.611+0000 7f433f7fe640 1 -- 172.21.15.148:0/525646249 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ada4fc0dc0 msgr2=0x55ada4fe2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:18.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.611+0000 7f433f7fe640 1 --2- 172.21.15.148:0/525646249 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ada4fc0dc0 0x55ada4fe2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:18.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.611+0000 7f433f7fe640 1 -- 172.21.15.148:0/525646249 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ada4fbc860 con 0x55ada4fbca30 2024-09-19T07:14:18.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.611+0000 7f433f7fe640 1 --2- 172.21.15.148:0/525646249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ada4fbca30 0x55ada4fd71e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f4330010860 tx=0x7f4330013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9bd3f88883a02ab server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:18.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.611+0000 7f43357fa640 1 -- 172.21.15.148:0/525646249 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4330011d40 con 0x55ada4fbca30 2024-09-19T07:14:18.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.611+0000 7f43357fa640 1 -- 172.21.15.148:0/525646249 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4330021e00 con 0x55ada4fbca30 2024-09-19T07:14:18.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.611+0000 7f43357fa640 1 -- 172.21.15.148:0/525646249 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43300047a0 con 0x55ada4fbca30 2024-09-19T07:14:18.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.612+0000 7f43481c7740 1 -- 172.21.15.148:0/525646249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ada4fbca30 msgr2=0x55ada4fd71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:18.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.612+0000 7f43481c7740 1 --2- 172.21.15.148:0/525646249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ada4fbca30 0x55ada4fd71e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f4330010860 tx=0x7f4330013000 comp rx=0 tx=0).stop 2024-09-19T07:14:18.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.612+0000 7f43481c7740 1 -- 172.21.15.148:0/525646249 shutdown_connections 2024-09-19T07:14:18.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.612+0000 7f43481c7740 1 --2- 172.21.15.148:0/525646249 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ada4fc0dc0 0x55ada4fe2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:18.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.612+0000 7f43481c7740 1 --2- 172.21.15.148:0/525646249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ada4fc04a0 0x55ada4fc7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:18.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.612+0000 7f43481c7740 1 --2- 172.21.15.148:0/525646249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ada4fbca30 0x55ada4fd71e0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:18.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.612+0000 7f43481c7740 1 -- 172.21.15.148:0/525646249 >> 172.21.15.148:0/525646249 conn(0x55ada4fc88e0 msgr2=0x55ada4fc6b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:18.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.612+0000 7f43481c7740 1 -- 172.21.15.148:0/525646249 shutdown_connections 2024-09-19T07:14:18.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.612+0000 7f43481c7740 1 -- 172.21.15.148:0/525646249 wait complete. 2024-09-19T07:14:18.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.612+0000 7f43481c7740 1 -- start start 2024-09-19T07:14:18.619 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.613+0000 7f43481c7740 1 Processor -- start 2024-09-19T07:14:18.619 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.613+0000 7f43481c7740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ada4fbca30 0x55ada4fd3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:18.619 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.613+0000 7f43481c7740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ada4fc04a0 0x55ada4fced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:18.619 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.613+0000 7f43481c7740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ada4fc0dc0 0x55ada4fcf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:18.619 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.613+0000 7f43481c7740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f432000cd90 con 0x55ada4fc04a0 2024-09-19T07:14:18.619 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.613+0000 7f43481c7740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f432000e200 con 0x55ada4fc0dc0 2024-09-19T07:14:18.619 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.613+0000 7f43481c7740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f432000d460 con 0x55ada4fbca30 2024-09-19T07:14:18.619 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.613+0000 7f43481c7740 10 client.0 _ll_register_callbacks cb 0x7f43280097b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:14:18.619 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.613+0000 7f4337fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ada4fc04a0 0x55ada4fced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:18.619 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.613+0000 7f433f7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ada4fbca30 0x55ada4fd3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:18.619 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.613+0000 7f4337fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ada4fc04a0 0x55ada4fced40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38560/0 (socket says 172.21.15.148:38560) 2024-09-19T07:14:18.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.613+0000 7f433f7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ada4fbca30 0x55ada4fd3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:54914/0 (socket says 172.21.15.148:54914) 2024-09-19T07:14:18.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.613+0000 7f4337fff640 1 -- 172.21.15.148:0/3871104983 learned_addr learned my addr 172.21.15.148:0/3871104983 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:14:18.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.613+0000 7f433ffff640 1 --2- 172.21.15.148:0/3871104983 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ada4fc0dc0 0x55ada4fcf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:18.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.613+0000 7f4337fff640 1 -- 172.21.15.148:0/3871104983 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ada4fbca30 msgr2=0x55ada4fd3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:18.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.613+0000 7f4337fff640 1 --2- 172.21.15.148:0/3871104983 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ada4fbca30 0x55ada4fd3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:18.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.613+0000 7f4337fff640 1 -- 172.21.15.148:0/3871104983 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ada4fc0dc0 msgr2=0x55ada4fcf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:18.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.613+0000 7f4337fff640 1 --2- 172.21.15.148:0/3871104983 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ada4fc0dc0 0x55ada4fcf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:18.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.613+0000 7f4337fff640 1 -- 172.21.15.148:0/3871104983 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ada4fcfa90 con 0x55ada4fc04a0 2024-09-19T07:14:18.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.613+0000 7f433f7fe640 1 --2- 172.21.15.148:0/3871104983 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ada4fbca30 0x55ada4fd3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:14:18.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.613+0000 7f4337fff640 1 --2- 172.21.15.148:0/3871104983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ada4fc04a0 0x55ada4fced40 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x55ada4fc9880 tx=0x7f4328009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1d4362e7f153f22 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:18.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.613+0000 7f431effd640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:14:18.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.614+0000 7f431effd640 1 -- 172.21.15.148:0/3871104983 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4328033070 con 0x55ada4fc04a0 2024-09-19T07:14:18.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.614+0000 7f431effd640 1 -- 172.21.15.148:0/3871104983 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f4328003be0 con 0x55ada4fc04a0 2024-09-19T07:14:18.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.614+0000 7f43481c7740 1 -- 172.21.15.148:0/3871104983 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4330021e00 con 0x55ada4fc04a0 2024-09-19T07:14:18.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.614+0000 7f431effd640 1 -- 172.21.15.148:0/3871104983 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f432803f050 con 0x55ada4fc04a0 2024-09-19T07:14:18.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.614+0000 7f43481c7740 10 client.16236 fetch_fsmap learned FSMap version 31 2024-09-19T07:14:18.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.614+0000 7f43481c7740 1 -- 172.21.15.148:0/3871104983 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55ada5045bf0 con 0x55ada4fc04a0 2024-09-19T07:14:18.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.614+0000 7f431effd640 1 -- 172.21.15.148:0/3871104983 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4330021e00 con 0x55ada4fc04a0 2024-09-19T07:14:18.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.614+0000 7f431effd640 1 -- 172.21.15.148:0/3871104983 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f432800f720 con 0x55ada4fc04a0 2024-09-19T07:14:18.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.614+0000 7f43481c7740 10 client.16236 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:14:18.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.614+0000 7f43481c7740 10 client.16236 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:14:18.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.614+0000 7f43481c7740 20 client.16236 populate_metadata read hostname 'smithi148' 2024-09-19T07:14:18.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.614+0000 7f43481c7740 1 --2- 172.21.15.148:0/3871104983 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ada4fcb680 0x55ada5048440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:18.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.615+0000 7f43481c7740 4 client.16236 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T07:14:18.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.615+0000 7f43481c7740 1 -- 172.21.15.148:0/3871104983 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ada4f2dd60 con 0x55ada4fcb680 2024-09-19T07:14:18.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.615+0000 7f433f7fe640 1 --2- 172.21.15.148:0/3871104983 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ada4fcb680 0x55ada5048440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:18.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.615+0000 7f433f7fe640 1 --2- 172.21.15.148:0/3871104983 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ada4fcb680 0x55ada5048440 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ac6ffac525becf4 server_cookie=a89b01928e9f25fc in_seq=0 out_seq=0 2024-09-19T07:14:18.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.615+0000 7f431effd640 10 client.16236 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:14:18.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.615+0000 7f431effd640 1 -- 172.21.15.148:0/3871104983 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55ada4f2dd60 con 0x55ada4fcb680 2024-09-19T07:14:18.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.615+0000 7f431effd640 10 client.16236 handle_command_reply: tid=0 2024-09-19T07:14:18.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.615+0000 7f43481c7740 1 client.16236 shutdown 2024-09-19T07:14:18.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.615+0000 7f43481c7740 1 -- 172.21.15.148:0/3871104983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ada4fc04a0 msgr2=0x55ada4fced40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:18.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.615+0000 7f43481c7740 1 --2- 172.21.15.148:0/3871104983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ada4fc04a0 0x55ada4fced40 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x55ada4fc9880 tx=0x7f4328009f70 comp rx=0 tx=0).stop 2024-09-19T07:14:18.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.616+0000 7f43481c7740 1 -- 172.21.15.148:0/3871104983 shutdown_connections 2024-09-19T07:14:18.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.616+0000 7f43481c7740 1 --2- 172.21.15.148:0/3871104983 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ada4fcb680 0x55ada5048440 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:18.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.616+0000 7f43481c7740 1 --2- 172.21.15.148:0/3871104983 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ada4fc0dc0 0x55ada4fcf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:18.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.616+0000 7f43481c7740 1 --2- 172.21.15.148:0/3871104983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ada4fc04a0 0x55ada4fced40 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:18.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.616+0000 7f43481c7740 1 --2- 172.21.15.148:0/3871104983 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ada4fbca30 0x55ada4fd3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:18.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.616+0000 7f43481c7740 1 -- 172.21.15.148:0/3871104983 >> 172.21.15.148:0/3871104983 conn(0x55ada4fc88e0 msgr2=0x55ada4fbb350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:18.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.616+0000 7f431effd640 0 client.16236 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:14:18.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.616+0000 7f43481c7740 1 -- 172.21.15.148:0/3871104983 shutdown_connections 2024-09-19T07:14:18.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.616+0000 7f43481c7740 1 -- 172.21.15.148:0/3871104983 wait complete. 2024-09-19T07:14:18.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.616+0000 7f43481c7740 20 client.16236 trim_cache size 0 max 16384 2024-09-19T07:14:18.623 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:14:18.623 INFO:teuthology.orchestra.run.smithi148.stdout: "status": "no active scrubs running", 2024-09-19T07:14:18.623 INFO:teuthology.orchestra.run.smithi148.stdout: "scrubs": {} 2024-09-19T07:14:18.623 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:14:18.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.616+0000 7f4345dee640 1 -- 172.21.15.148:0/1570678128 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f432c0a3430 msgr2=0x7f432c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:18.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.616+0000 7f4345dee640 1 --2- 172.21.15.148:0/1570678128 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f432c0a3430 0x7f432c0a58f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f433000bb60 tx=0x7f433000b390 comp rx=0 tx=0).stop 2024-09-19T07:14:18.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.616+0000 7f4345dee640 1 -- 172.21.15.148:0/1570678128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4340106a70 msgr2=0x7f434019ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:18.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.616+0000 7f4345dee640 1 --2- 172.21.15.148:0/1570678128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4340106a70 0x7f434019ef30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f43380305b0 tx=0x7f43380305e0 comp rx=0 tx=0).stop 2024-09-19T07:14:18.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.616+0000 7f4345dee640 1 -- 172.21.15.148:0/1570678128 shutdown_connections 2024-09-19T07:14:18.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.616+0000 7f4345dee640 1 --2- 172.21.15.148:0/1570678128 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f432c0a3430 0x7f432c0a58f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:18.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.616+0000 7f4345dee640 1 --2- 172.21.15.148:0/1570678128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4340106a70 0x7f434019ef30 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:18.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.616+0000 7f4345dee640 1 --2- 172.21.15.148:0/1570678128 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4340101410 0x7f434019b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:18.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.616+0000 7f4345dee640 1 --2- 172.21.15.148:0/1570678128 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4340100a70 0x7f434019b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:18.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.616+0000 7f4345dee640 1 -- 172.21.15.148:0/1570678128 >> 172.21.15.148:0/1570678128 conn(0x7f43400fc7d0 msgr2=0x7f43400fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:18.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.617+0000 7f4345dee640 1 -- 172.21.15.148:0/1570678128 shutdown_connections 2024-09-19T07:14:18.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:18.617+0000 7f4345dee640 1 -- 172.21.15.148:0/1570678128 wait complete. 2024-09-19T07:14:18.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:18 smithi148 ceph-mon[31180]: pgmap v100: 97 pgs: 97 active+clean; 302 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.1 MiB/s wr, 440 op/s 2024-09-19T07:14:19.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:18 smithi179 ceph-mon[35716]: pgmap v100: 97 pgs: 97 active+clean; 302 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.1 MiB/s wr, 440 op/s 2024-09-19T07:14:19.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:18 smithi165 ceph-mon[35326]: pgmap v100: 97 pgs: 97 active+clean; 302 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.1 MiB/s wr, 440 op/s 2024-09-19T07:14:19.440 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T07:14:19.440 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:14:19.690 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:14:20.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.209+0000 7f3737f9f640 1 -- 172.21.15.148:0/3718379743 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3730102570 msgr2=0x7f37301029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:20.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.209+0000 7f3737f9f640 1 --2- 172.21.15.148:0/3718379743 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3730102570 0x7f37301029b0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f3724009900 tx=0x7f372402a480 comp rx=0 tx=0).stop 2024-09-19T07:14:20.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.209+0000 7f3737f9f640 1 -- 172.21.15.148:0/3718379743 shutdown_connections 2024-09-19T07:14:20.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.209+0000 7f3737f9f640 1 --2- 172.21.15.148:0/3718379743 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3730102ef0 0x7f373010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:20.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.209+0000 7f3737f9f640 1 --2- 172.21.15.148:0/3718379743 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3730102570 0x7f37301029b0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:20.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.209+0000 7f3737f9f640 1 --2- 172.21.15.148:0/3718379743 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3730100e20 0x7f3730101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:20.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.209+0000 7f3737f9f640 1 -- 172.21.15.148:0/3718379743 >> 172.21.15.148:0/3718379743 conn(0x7f37300fc7d0 msgr2=0x7f37300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:20.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.209+0000 7f3737f9f640 1 -- 172.21.15.148:0/3718379743 shutdown_connections 2024-09-19T07:14:20.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.209+0000 7f3737f9f640 1 -- 172.21.15.148:0/3718379743 wait complete. 2024-09-19T07:14:20.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.209+0000 7f3737f9f640 1 Processor -- start 2024-09-19T07:14:20.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.209+0000 7f3737f9f640 1 -- start start 2024-09-19T07:14:20.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.209+0000 7f3737f9f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3730100e20 0x7f373010e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:20.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.209+0000 7f3737f9f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3730102570 0x7f373010ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:20.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.209+0000 7f3737f9f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3730102ef0 0x7f373010ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:20.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.209+0000 7f3737f9f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3730112120 con 0x7f3730102570 2024-09-19T07:14:20.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.209+0000 7f3737f9f640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3730111fa0 con 0x7f3730100e20 2024-09-19T07:14:20.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.209+0000 7f3737f9f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f37301122a0 con 0x7f3730102ef0 2024-09-19T07:14:20.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.210+0000 7f373553a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3730102570 0x7f373010ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:20.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.210+0000 7f373553a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3730102570 0x7f373010ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38590/0 (socket says 172.21.15.148:38590) 2024-09-19T07:14:20.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.210+0000 7f373553a640 1 -- 172.21.15.148:0/422939662 learned_addr learned my addr 172.21.15.148:0/422939662 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:14:20.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.210+0000 7f373653c640 1 --2- 172.21.15.148:0/422939662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3730102ef0 0x7f373010ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:20.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.210+0000 7f3735d3b640 1 --2- 172.21.15.148:0/422939662 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3730100e20 0x7f373010e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:20.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.210+0000 7f373553a640 1 -- 172.21.15.148:0/422939662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3730102ef0 msgr2=0x7f373010ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:20.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.210+0000 7f373553a640 1 --2- 172.21.15.148:0/422939662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3730102ef0 0x7f373010ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:20.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.210+0000 7f373553a640 1 -- 172.21.15.148:0/422939662 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3730100e20 msgr2=0x7f373010e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:20.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.210+0000 7f373553a640 1 --2- 172.21.15.148:0/422939662 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3730100e20 0x7f373010e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:20.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.210+0000 7f373553a640 1 -- 172.21.15.148:0/422939662 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37301a6b00 con 0x7f3730102570 2024-09-19T07:14:20.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.210+0000 7f373653c640 1 --2- 172.21.15.148:0/422939662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3730102ef0 0x7f373010ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:14:20.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.210+0000 7f3735d3b640 1 --2- 172.21.15.148:0/422939662 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3730100e20 0x7f373010e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:14:20.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.210+0000 7f373553a640 1 --2- 172.21.15.148:0/422939662 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3730102570 0x7f373010ea10 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f3724006010 tx=0x7f3724003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:20.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.210+0000 7f372effd640 1 -- 172.21.15.148:0/422939662 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f372403f070 con 0x7f3730102570 2024-09-19T07:14:20.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.210+0000 7f372effd640 1 -- 172.21.15.148:0/422939662 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3724031e30 con 0x7f3730102570 2024-09-19T07:14:20.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.210+0000 7f3737f9f640 1 -- 172.21.15.148:0/422939662 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37301a6d90 con 0x7f3730102570 2024-09-19T07:14:20.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.210+0000 7f372effd640 1 -- 172.21.15.148:0/422939662 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3724035030 con 0x7f3730102570 2024-09-19T07:14:20.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.210+0000 7f3737f9f640 1 -- 172.21.15.148:0/422939662 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37301a7260 con 0x7f3730102570 2024-09-19T07:14:20.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.211+0000 7f3737f9f640 1 -- 172.21.15.148:0/422939662 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3730101280 con 0x7f3730102570 2024-09-19T07:14:20.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.213+0000 7f372effd640 1 -- 172.21.15.148:0/422939662 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f3724042070 con 0x7f3730102570 2024-09-19T07:14:20.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.214+0000 7f372effd640 1 --2- 172.21.15.148:0/422939662 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f37180a3430 0x7f37180a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:20.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.214+0000 7f3735d3b640 1 --2- 172.21.15.148:0/422939662 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f37180a3430 0x7f37180a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:20.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.214+0000 7f372effd640 1 -- 172.21.15.148:0/422939662 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f37240f0c30 con 0x7f3730102570 2024-09-19T07:14:20.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.214+0000 7f3735d3b640 1 --2- 172.21.15.148:0/422939662 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f37180a3430 0x7f37180a58f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3728006fd0 tx=0x7f3728008040 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:20.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.217+0000 7f372effd640 1 -- 172.21.15.148:0/422939662 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f37240bd6b0 con 0x7f3730102570 2024-09-19T07:14:20.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.446+0000 7f3737f9f640 1 -- 172.21.15.148:0/422939662 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3730109090 con 0x7f3730102570 2024-09-19T07:14:20.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.446+0000 7f372effd640 1 -- 172.21.15.148:0/422939662 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11944 (secure 0 0 0) 0x7f37240bcfb0 con 0x7f3730102570 2024-09-19T07:14:20.447 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:14:20.448 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":31,"btime":"2024-09-19T07:13:49:685750+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/4263868576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":4263868576},{"type":"v1","addr":"172.21.15.148:6841","nonce":4263868576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":25606,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3891676893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3891676893},{"type":"v1","addr":"172.21.15.179:6835","nonce":3891676893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:09:19.543369+0000","modified":"2024-09-19T07:13:48.007806+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24457,"mds_1":24437,"mds_2":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24383":{"gid":24383,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6835/2146820965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2146820965},{"type":"v1","addr":"172.21.15.165:6835","nonce":2146820965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24410":{"gid":24410,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":75,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":71,"addr":"172.21.15.165:6839/3993490234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":3993490234},{"type":"v1","addr":"172.21.15.165:6839","nonce":3993490234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24457,"qdb_cluster":[24457,24437,24436]},"id":1}]} 2024-09-19T07:14:20.448 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 31 2024-09-19T07:14:20.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.449+0000 7f3737f9f640 1 -- 172.21.15.148:0/422939662 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f37180a3430 msgr2=0x7f37180a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:20.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.449+0000 7f3737f9f640 1 --2- 172.21.15.148:0/422939662 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f37180a3430 0x7f37180a58f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3728006fd0 tx=0x7f3728008040 comp rx=0 tx=0).stop 2024-09-19T07:14:20.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.449+0000 7f3737f9f640 1 -- 172.21.15.148:0/422939662 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3730102570 msgr2=0x7f373010ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:20.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.449+0000 7f3737f9f640 1 --2- 172.21.15.148:0/422939662 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3730102570 0x7f373010ea10 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f3724006010 tx=0x7f3724003c80 comp rx=0 tx=0).stop 2024-09-19T07:14:20.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.449+0000 7f3737f9f640 1 -- 172.21.15.148:0/422939662 shutdown_connections 2024-09-19T07:14:20.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.449+0000 7f3737f9f640 1 --2- 172.21.15.148:0/422939662 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f37180a3430 0x7f37180a58f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:20.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.449+0000 7f3737f9f640 1 --2- 172.21.15.148:0/422939662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3730102ef0 0x7f373010ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:20.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.449+0000 7f3737f9f640 1 --2- 172.21.15.148:0/422939662 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3730102570 0x7f373010ea10 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:20.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.449+0000 7f3737f9f640 1 --2- 172.21.15.148:0/422939662 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3730100e20 0x7f373010e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:20.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.449+0000 7f3737f9f640 1 -- 172.21.15.148:0/422939662 >> 172.21.15.148:0/422939662 conn(0x7f37300fc7d0 msgr2=0x7f37300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:20.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.449+0000 7f3737f9f640 1 -- 172.21.15.148:0/422939662 shutdown_connections 2024-09-19T07:14:20.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:20.449+0000 7f3737f9f640 1 -- 172.21.15.148:0/422939662 wait complete. 2024-09-19T07:14:21.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:20 smithi179 ceph-mon[35716]: pgmap v101: 97 pgs: 97 active+clean; 302 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.1 MiB/s wr, 440 op/s 2024-09-19T07:14:21.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:20 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/422939662' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:14:21.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:20 smithi148 ceph-mon[31180]: pgmap v101: 97 pgs: 97 active+clean; 302 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.1 MiB/s wr, 440 op/s 2024-09-19T07:14:21.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:20 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/422939662' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:14:21.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:20 smithi165 ceph-mon[35326]: pgmap v101: 97 pgs: 97 active+clean; 302 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.1 MiB/s wr, 440 op/s 2024-09-19T07:14:21.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:20 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/422939662' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:14:21.292 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:21.290+0000 7fab74ff9640 1 -- 172.21.15.148:0/3028018285 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561354bedd70 con 0x561354d07df0 2024-09-19T07:14:21.292 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:21.290+0000 7fab74ff9640 10 client.16218 handle_command_reply: tid=0 2024-09-19T07:14:21.292 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:21.290+0000 7fab9620f740 1 client.16218 shutdown 2024-09-19T07:14:21.292 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:21.290+0000 7fab9620f740 1 -- 172.21.15.148:0/3028018285 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561354c81af0 msgr2=0x561354c95390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:21.292 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:21.290+0000 7fab9620f740 1 --2- 172.21.15.148:0/3028018285 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561354c81af0 0x561354c95390 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fab8000f670 tx=0x7fab80005f90 comp rx=0 tx=0).stop 2024-09-19T07:14:21.292 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:21.290+0000 7fab9620f740 1 -- 172.21.15.148:0/3028018285 shutdown_connections 2024-09-19T07:14:21.292 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:21.290+0000 7fab9620f740 1 --2- 172.21.15.148:0/3028018285 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561354d07df0 0x561354d0a210 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:21.292 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:21.290+0000 7fab9620f740 1 --2- 172.21.15.148:0/3028018285 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561354c8ccb0 0x561354c90bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:21.292 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:21.290+0000 7fab74ff9640 0 client.16218 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:14:21.292 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:21.290+0000 7fab9620f740 1 --2- 172.21.15.148:0/3028018285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561354c82410 0x561354c906b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:21.292 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:21.290+0000 7fab9620f740 1 --2- 172.21.15.148:0/3028018285 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561354c81af0 0x561354c95390 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:21.293 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:21.290+0000 7fab9620f740 1 -- 172.21.15.148:0/3028018285 >> 172.21.15.148:0/3028018285 conn(0x561354c7e060 msgr2=0x561354c8b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:21.293 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:21.290+0000 7fab9620f740 1 -- 172.21.15.148:0/3028018285 shutdown_connections 2024-09-19T07:14:21.293 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:21.290+0000 7fab9620f740 1 -- 172.21.15.148:0/3028018285 wait complete. 2024-09-19T07:14:21.293 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:21.291+0000 7fab9620f740 20 client.16218 trim_cache size 0 max 16384 2024-09-19T07:14:21.293 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:14:21.293 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:14:21.293 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:14:21.293 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:14:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:21.291+0000 7fab93398640 1 -- 172.21.15.148:0/1388018984 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fab780a3460 msgr2=0x7fab780a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:21.291+0000 7fab93398640 1 --2- 172.21.15.148:0/1388018984 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fab780a3460 0x7fab780a5920 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fab8409c290 tx=0x7fab84066c40 comp rx=0 tx=0).stop 2024-09-19T07:14:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:21.291+0000 7fab93398640 1 -- 172.21.15.148:0/1388018984 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab8c1069e0 msgr2=0x7fab8c0fd720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:21.291+0000 7fab93398640 1 --2- 172.21.15.148:0/1388018984 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab8c1069e0 0x7fab8c0fd720 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fab84009fd0 tx=0x7fab8400ef10 comp rx=0 tx=0).stop 2024-09-19T07:14:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:21.291+0000 7fab93398640 1 -- 172.21.15.148:0/1388018984 shutdown_connections 2024-09-19T07:14:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:21.291+0000 7fab93398640 1 --2- 172.21.15.148:0/1388018984 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fab780a3460 0x7fab780a5920 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:21.295 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:21.291+0000 7fab93398640 1 --2- 172.21.15.148:0/1388018984 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab8c1069e0 0x7fab8c0fd720 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:21.295 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:21.291+0000 7fab93398640 1 --2- 172.21.15.148:0/1388018984 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab8c101370 0x7fab8c0fd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:21.295 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:21.291+0000 7fab93398640 1 --2- 172.21.15.148:0/1388018984 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab8c1009d0 0x7fab8c0fcca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:21.295 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:21.291+0000 7fab93398640 1 -- 172.21.15.148:0/1388018984 >> 172.21.15.148:0/1388018984 conn(0x7fab8c0fc6b0 msgr2=0x7fab8c06a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:21.295 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:21.291+0000 7fab93398640 1 -- 172.21.15.148:0/1388018984 shutdown_connections 2024-09-19T07:14:21.295 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:21.291+0000 7fab93398640 1 -- 172.21.15.148:0/1388018984 wait complete. 2024-09-19T07:14:22.042 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T07:14:22.380 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:14:23.054 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:22 smithi148 ceph-mon[31180]: pgmap v102: 97 pgs: 97 active+clean; 308 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.8 MiB/s wr, 486 op/s 2024-09-19T07:14:23.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.124+0000 7f1dec9be640 1 -- 172.21.15.148:0/1063031918 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de40319b0 con 0x7f1de8100a70 2024-09-19T07:14:23.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.124+0000 7f1defc24640 1 -- 172.21.15.148:0/1063031918 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1de8100a70 msgr2=0x7f1de8100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:23.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.124+0000 7f1defc24640 1 --2- 172.21.15.148:0/1063031918 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1de8100a70 0x7f1de8100ed0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f1de4009980 tx=0x7f1de402a4b0 comp rx=0 tx=0).stop 2024-09-19T07:14:23.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.124+0000 7f1defc24640 1 -- 172.21.15.148:0/1063031918 shutdown_connections 2024-09-19T07:14:23.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.124+0000 7f1defc24640 1 --2- 172.21.15.148:0/1063031918 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1de8101410 0x7f1de810d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:23.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.124+0000 7f1defc24640 1 --2- 172.21.15.148:0/1063031918 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1de8100a70 0x7f1de8100ed0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:23.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.124+0000 7f1defc24640 1 --2- 172.21.15.148:0/1063031918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1de8106a70 0x7f1de8106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:23.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.124+0000 7f1defc24640 1 -- 172.21.15.148:0/1063031918 >> 172.21.15.148:0/1063031918 conn(0x7f1de80fc790 msgr2=0x7f1de80febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:23.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.125+0000 7f1defc24640 1 -- 172.21.15.148:0/1063031918 shutdown_connections 2024-09-19T07:14:23.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.125+0000 7f1defc24640 1 -- 172.21.15.148:0/1063031918 wait complete. 2024-09-19T07:14:23.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.125+0000 7f1defc24640 1 Processor -- start 2024-09-19T07:14:23.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.129+0000 7f1defc24640 1 -- start start 2024-09-19T07:14:23.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.129+0000 7f1defc24640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1de8100a70 0x7f1de8116300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:23.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.129+0000 7f1defc24640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1de8101410 0x7f1de8116840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:23.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.129+0000 7f1defc24640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1de8106a70 0x7f1de8111420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:23.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.129+0000 7f1defc24640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1de810fe00 con 0x7f1de8100a70 2024-09-19T07:14:23.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.129+0000 7f1defc24640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1de810fc80 con 0x7f1de8101410 2024-09-19T07:14:23.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.129+0000 7f1defc24640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1de810ff80 con 0x7f1de8106a70 2024-09-19T07:14:23.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:22 smithi165 ceph-mon[35326]: pgmap v102: 97 pgs: 97 active+clean; 308 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.8 MiB/s wr, 486 op/s 2024-09-19T07:14:23.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.129+0000 7f1dee1c1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1de8106a70 0x7f1de8111420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:23.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.130+0000 7f1dee1c1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1de8106a70 0x7f1de8111420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:54948/0 (socket says 172.21.15.148:54948) 2024-09-19T07:14:23.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.130+0000 7f1dee1c1640 1 -- 172.21.15.148:0/1368329717 learned_addr learned my addr 172.21.15.148:0/1368329717 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:14:23.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.130+0000 7f1ded1bf640 1 --2- 172.21.15.148:0/1368329717 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1de8101410 0x7f1de8116840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:23.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.130+0000 7f1ded9c0640 1 --2- 172.21.15.148:0/1368329717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1de8100a70 0x7f1de8116300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:23.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.131+0000 7f1ded1bf640 1 -- 172.21.15.148:0/1368329717 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1de8106a70 msgr2=0x7f1de8111420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:23.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.131+0000 7f1ded1bf640 1 --2- 172.21.15.148:0/1368329717 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1de8106a70 0x7f1de8111420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:23.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.131+0000 7f1ded1bf640 1 -- 172.21.15.148:0/1368329717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1de8100a70 msgr2=0x7f1de8116300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:23.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.131+0000 7f1ded1bf640 1 --2- 172.21.15.148:0/1368329717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1de8100a70 0x7f1de8116300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:23.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.131+0000 7f1ded1bf640 1 -- 172.21.15.148:0/1368329717 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1de8111ce0 con 0x7f1de8101410 2024-09-19T07:14:23.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.131+0000 7f1ded9c0640 1 --2- 172.21.15.148:0/1368329717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1de8100a70 0x7f1de8116300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:14:23.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.131+0000 7f1ded1bf640 1 --2- 172.21.15.148:0/1368329717 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1de8101410 0x7f1de8116840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1de4000c00 tx=0x7f1de4004ea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:23.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.132+0000 7f1ddeffd640 1 -- 172.21.15.148:0/1368329717 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de403f030 con 0x7f1de8101410 2024-09-19T07:14:23.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.132+0000 7f1defc24640 1 -- 172.21.15.148:0/1368329717 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1de8111f70 con 0x7f1de8101410 2024-09-19T07:14:23.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.132+0000 7f1defc24640 1 -- 172.21.15.148:0/1368329717 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1de811e030 con 0x7f1de8101410 2024-09-19T07:14:23.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.132+0000 7f1ddeffd640 1 -- 172.21.15.148:0/1368329717 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1de40035f0 con 0x7f1de8101410 2024-09-19T07:14:23.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.132+0000 7f1ddeffd640 1 -- 172.21.15.148:0/1368329717 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de4035070 con 0x7f1de8101410 2024-09-19T07:14:23.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.135+0000 7f1ddeffd640 1 -- 172.21.15.148:0/1368329717 <== mon.2 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f1de4042070 con 0x7f1de8101410 2024-09-19T07:14:23.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.142+0000 7f1ddeffd640 1 --2- 172.21.15.148:0/1368329717 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f1dd40a3500 0x7f1dd40a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:23.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.142+0000 7f1ded9c0640 1 --2- 172.21.15.148:0/1368329717 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f1dd40a3500 0x7f1dd40a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:23.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.144+0000 7f1ddeffd640 1 -- 172.21.15.148:0/1368329717 <== mon.2 v2:172.21.15.165:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f1de40f0db0 con 0x7f1de8101410 2024-09-19T07:14:23.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.144+0000 7f1ded9c0640 1 --2- 172.21.15.148:0/1368329717 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f1dd40a3500 0x7f1dd40a59c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1de0005fd0 tx=0x7f1de0009500 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:23.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.145+0000 7f1df1ffd740 1 Processor -- start 2024-09-19T07:14:23.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.146+0000 7f1df1ffd740 1 -- start start 2024-09-19T07:14:23.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.146+0000 7f1df1ffd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558548855b40 0x558548854090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:23.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.147+0000 7f1df1ffd740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5585488545d0 0x558548854a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:23.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.147+0000 7f1ded9c0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558548855b40 0x558548854090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:23.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.147+0000 7f1ded9c0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558548855b40 0x558548854090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:54956/0 (socket says 172.21.15.148:54956) 2024-09-19T07:14:23.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.147+0000 7f1ded9c0640 1 -- 172.21.15.148:0/373551449 learned_addr learned my addr 172.21.15.148:0/373551449 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:14:23.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.147+0000 7f1df1ffd740 1 --2- 172.21.15.148:0/373551449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55854885f370 0x558548861760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:23.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.147+0000 7f1df1ffd740 1 -- 172.21.15.148:0/373551449 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5585487ba2f0 con 0x55854885f370 2024-09-19T07:14:23.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.147+0000 7f1df1ffd740 1 -- 172.21.15.148:0/373551449 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x558548761cf0 con 0x5585488545d0 2024-09-19T07:14:23.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.147+0000 7f1df1ffd740 1 -- 172.21.15.148:0/373551449 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5585487b62b0 con 0x558548855b40 2024-09-19T07:14:23.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.147+0000 7f1dee1c1640 1 --2- 172.21.15.148:0/373551449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55854885f370 0x558548861760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:23.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.148+0000 7f1dee1c1640 1 -- 172.21.15.148:0/373551449 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558548855b40 msgr2=0x558548854090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:23.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.148+0000 7f1dee1c1640 1 --2- 172.21.15.148:0/373551449 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558548855b40 0x558548854090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:23.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.148+0000 7f1dee1c1640 1 -- 172.21.15.148:0/373551449 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5585488545d0 msgr2=0x558548854a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T07:14:23.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.148+0000 7f1dee1c1640 1 --2- 172.21.15.148:0/373551449 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5585488545d0 0x558548854a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:23.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.148+0000 7f1dee1c1640 1 -- 172.21.15.148:0/373551449 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585487463a0 con 0x55854885f370 2024-09-19T07:14:23.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.149+0000 7f1dee1c1640 1 --2- 172.21.15.148:0/373551449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55854885f370 0x558548861760 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f1de8116f30 tx=0x7f1dd8009d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=414239064053d745 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:23.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.150+0000 7f1dd3fff640 1 -- 172.21.15.148:0/373551449 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd8017070 con 0x55854885f370 2024-09-19T07:14:23.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.151+0000 7f1dd3fff640 1 -- 172.21.15.148:0/373551449 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1dd8013470 con 0x55854885f370 2024-09-19T07:14:23.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.151+0000 7f1dd3fff640 1 -- 172.21.15.148:0/373551449 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd800eea0 con 0x55854885f370 2024-09-19T07:14:23.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.154+0000 7f1df1ffd740 1 -- 172.21.15.148:0/373551449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55854885f370 msgr2=0x558548861760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:23.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.154+0000 7f1df1ffd740 1 --2- 172.21.15.148:0/373551449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55854885f370 0x558548861760 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f1de8116f30 tx=0x7f1dd8009d60 comp rx=0 tx=0).stop 2024-09-19T07:14:23.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.154+0000 7f1df1ffd740 1 -- 172.21.15.148:0/373551449 shutdown_connections 2024-09-19T07:14:23.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.154+0000 7f1df1ffd740 1 --2- 172.21.15.148:0/373551449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55854885f370 0x558548861760 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:23.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.154+0000 7f1df1ffd740 1 --2- 172.21.15.148:0/373551449 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5585488545d0 0x558548854a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:23.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.154+0000 7f1df1ffd740 1 --2- 172.21.15.148:0/373551449 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558548855b40 0x558548854090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:23.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.155+0000 7f1df1ffd740 1 -- 172.21.15.148:0/373551449 >> 172.21.15.148:0/373551449 conn(0x55854881d310 msgr2=0x558548850c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:23.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.155+0000 7f1df1ffd740 1 -- 172.21.15.148:0/373551449 shutdown_connections 2024-09-19T07:14:23.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.155+0000 7f1df1ffd740 1 -- 172.21.15.148:0/373551449 wait complete. 2024-09-19T07:14:23.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.155+0000 7f1df1ffd740 1 -- start start 2024-09-19T07:14:23.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.156+0000 7f1df1ffd740 1 Processor -- start 2024-09-19T07:14:23.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.157+0000 7f1df1ffd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5585488545d0 0x55854885edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:23.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.157+0000 7f1df1ffd740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558548855b40 0x55854885c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:23.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.157+0000 7f1ded9c0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5585488545d0 0x55854885edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:23.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.157+0000 7f1ded9c0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5585488545d0 0x55854885edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:54970/0 (socket says 172.21.15.148:54970) 2024-09-19T07:14:23.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.157+0000 7f1ded1bf640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558548855b40 0x55854885c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:23.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.157+0000 7f1ded1bf640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558548855b40 0x55854885c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:55022/0 (socket says 172.21.15.148:55022) 2024-09-19T07:14:23.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.157+0000 7f1ded9c0640 1 -- 172.21.15.148:0/2480767387 learned_addr learned my addr 172.21.15.148:0/2480767387 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:14:23.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.157+0000 7f1df1ffd740 1 --2- 172.21.15.148:0/2480767387 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55854885f370 0x55854885c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:23.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.158+0000 7f1df1ffd740 1 -- 172.21.15.148:0/2480767387 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x558548862070 con 0x55854885f370 2024-09-19T07:14:23.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.158+0000 7f1df1ffd740 1 -- 172.21.15.148:0/2480767387 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x558548775060 con 0x558548855b40 2024-09-19T07:14:23.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.158+0000 7f1df1ffd740 1 -- 172.21.15.148:0/2480767387 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5585488621f0 con 0x5585488545d0 2024-09-19T07:14:23.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.158+0000 7f1df1ffd740 10 client.0 _ll_register_callbacks cb 0x5585484c88c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:14:23.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.158+0000 7f1dee1c1640 1 --2- 172.21.15.148:0/2480767387 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55854885f370 0x55854885c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:23.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.158+0000 7f1dee1c1640 1 -- 172.21.15.148:0/2480767387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5585488545d0 msgr2=0x55854885edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:23.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.158+0000 7f1dee1c1640 1 --2- 172.21.15.148:0/2480767387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5585488545d0 0x55854885edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:23.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.158+0000 7f1dee1c1640 1 -- 172.21.15.148:0/2480767387 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558548855b40 msgr2=0x55854885c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:23.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.158+0000 7f1dee1c1640 1 --2- 172.21.15.148:0/2480767387 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558548855b40 0x55854885c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:23.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.158+0000 7f1dee1c1640 1 -- 172.21.15.148:0/2480767387 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55854852b3c0 con 0x55854885f370 2024-09-19T07:14:23.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.159+0000 7f1dee1c1640 1 --2- 172.21.15.148:0/2480767387 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55854885f370 0x55854885c810 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x558548855070 tx=0x7f1dd8013850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4c75958245b983e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:23.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.159+0000 7f1dd17fa640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:14:23.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.160+0000 7f1dd17fa640 1 -- 172.21.15.148:0/2480767387 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd8017050 con 0x55854885f370 2024-09-19T07:14:23.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.160+0000 7f1dd17fa640 1 -- 172.21.15.148:0/2480767387 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f1dd801c650 con 0x55854885f370 2024-09-19T07:14:23.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.161+0000 7f1df1ffd740 1 -- 172.21.15.148:0/2480767387 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1dd8013470 con 0x55854885f370 2024-09-19T07:14:23.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.163+0000 7f1dd17fa640 1 -- 172.21.15.148:0/2480767387 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f1dd801c850 con 0x55854885f370 2024-09-19T07:14:23.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.166+0000 7f1df1ffd740 10 client.16254 fetch_fsmap learned FSMap version 31 2024-09-19T07:14:23.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.166+0000 7f1df1ffd740 1 -- 172.21.15.148:0/2480767387 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55854886dc00 con 0x55854885f370 2024-09-19T07:14:23.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.167+0000 7f1dd17fa640 1 -- 172.21.15.148:0/2480767387 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1dd8013470 con 0x55854885f370 2024-09-19T07:14:23.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.167+0000 7f1dd17fa640 1 -- 172.21.15.148:0/2480767387 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f1dd8030ae0 con 0x55854885f370 2024-09-19T07:14:23.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.167+0000 7f1df1ffd740 10 client.16254 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:14:23.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.167+0000 7f1df1ffd740 10 client.16254 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T07:14:23.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.167+0000 7f1df1ffd740 20 client.16254 populate_metadata read hostname 'smithi148' 2024-09-19T07:14:23.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.167+0000 7f1df1ffd740 1 --2- 172.21.15.148:0/2480767387 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x55854886efb0 0x5585488713a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:23.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.167+0000 7f1df1ffd740 4 client.16254 mds_command: new command op to 24436 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:14:23.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.167+0000 7f1df1ffd740 1 -- 172.21.15.148:0/2480767387 --> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5585487c7860 con 0x55854886efb0 2024-09-19T07:14:23.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.171+0000 7f1ded9c0640 1 --2- 172.21.15.148:0/2480767387 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x55854886efb0 0x5585488713a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:23.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.181+0000 7f1ded9c0640 1 --2- 172.21.15.148:0/2480767387 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x55854886efb0 0x5585488713a0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b786bd847ff05f3e server_cookie=2423dfe8cdf6b09 in_seq=0 out_seq=0 2024-09-19T07:14:23.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.181+0000 7f1dd17fa640 10 client.16254 ms_handle_connect on v2:172.21.15.179:6836/3827671241 2024-09-19T07:14:23.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.185+0000 7f1dd17fa640 1 -- 172.21.15.148:0/2480767387 <== mds.2 v2:172.21.15.179:6836/3827671241 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5585487c7860 con 0x55854886efb0 2024-09-19T07:14:23.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.185+0000 7f1dd17fa640 10 client.16254 handle_command_reply: tid=0 2024-09-19T07:14:23.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.187+0000 7f1df1ffd740 1 client.16254 shutdown 2024-09-19T07:14:23.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.189+0000 7f1df1ffd740 1 -- 172.21.15.148:0/2480767387 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55854885f370 msgr2=0x55854885c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:23.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.190+0000 7f1df1ffd740 1 --2- 172.21.15.148:0/2480767387 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55854885f370 0x55854885c810 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x558548855070 tx=0x7f1dd8013850 comp rx=0 tx=0).stop 2024-09-19T07:14:23.193 INFO:tasks.workunit.client.0.smithi148.stdout: 111 573527 623 374209 526 134494 949 2024-09-19T07:14:23.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.192+0000 7f1df1ffd740 1 -- 172.21.15.148:0/2480767387 shutdown_connections 2024-09-19T07:14:23.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.192+0000 7f1df1ffd740 1 --2- 172.21.15.148:0/2480767387 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x55854886efb0 0x5585488713a0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:23.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.192+0000 7f1df1ffd740 1 --2- 172.21.15.148:0/2480767387 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55854885f370 0x55854885c810 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:23.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.192+0000 7f1df1ffd740 1 --2- 172.21.15.148:0/2480767387 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558548855b40 0x55854885c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:23.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.192+0000 7f1df1ffd740 1 --2- 172.21.15.148:0/2480767387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5585488545d0 0x55854885edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:23.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.192+0000 7f1df1ffd740 1 -- 172.21.15.148:0/2480767387 >> 172.21.15.148:0/2480767387 conn(0x55854881d310 msgr2=0x558548856930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:23.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.192+0000 7f1dd17fa640 0 client.16254 ms_handle_reset on v2:172.21.15.179:6836/3827671241 2024-09-19T07:14:23.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.196+0000 7f1df1ffd740 1 -- 172.21.15.148:0/2480767387 shutdown_connections 2024-09-19T07:14:23.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.198+0000 7f1df1ffd740 1 -- 172.21.15.148:0/2480767387 wait complete. 2024-09-19T07:14:23.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.204+0000 7f1df1ffd740 20 client.16254 trim_cache size 0 max 16384 2024-09-19T07:14:23.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.236+0000 7f1df1ffd740 1 Processor -- start 2024-09-19T07:14:23.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.236+0000 7f1df1ffd740 1 -- start start 2024-09-19T07:14:23.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.237+0000 7f1df1ffd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5585488545d0 0x558548850e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:23.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.237+0000 7f1df1ffd740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558548855b40 0x55854885b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:23.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.237+0000 7f1df1ffd740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55854885f370 0x55854885be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:23.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.237+0000 7f1df1ffd740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1dcc011110 con 0x55854885f370 2024-09-19T07:14:23.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.237+0000 7f1df1ffd740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1dcc00e9e0 con 0x558548855b40 2024-09-19T07:14:23.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.237+0000 7f1df1ffd740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1dcc00c810 con 0x5585488545d0 2024-09-19T07:14:23.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.237+0000 7f1ded9c0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5585488545d0 0x558548850e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:23.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.237+0000 7f1ded9c0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5585488545d0 0x558548850e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:54978/0 (socket says 172.21.15.148:54978) 2024-09-19T07:14:23.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.237+0000 7f1ded9c0640 1 -- 172.21.15.148:0/3174517097 learned_addr learned my addr 172.21.15.148:0/3174517097 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:14:23.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.237+0000 7f1dee1c1640 1 --2- 172.21.15.148:0/3174517097 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55854885f370 0x55854885be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:23.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.237+0000 7f1ded1bf640 1 --2- 172.21.15.148:0/3174517097 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558548855b40 0x55854885b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:23.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.237+0000 7f1ded9c0640 1 -- 172.21.15.148:0/3174517097 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558548855b40 msgr2=0x55854885b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:23.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.237+0000 7f1ded9c0640 1 --2- 172.21.15.148:0/3174517097 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558548855b40 0x55854885b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:23.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.237+0000 7f1ded9c0640 1 -- 172.21.15.148:0/3174517097 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55854885f370 msgr2=0x55854885be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:23.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.237+0000 7f1ded9c0640 1 --2- 172.21.15.148:0/3174517097 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55854885f370 0x55854885be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:23.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.237+0000 7f1ded9c0640 1 -- 172.21.15.148:0/3174517097 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558548857120 con 0x5585488545d0 2024-09-19T07:14:23.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.242+0000 7f1ded9c0640 1 --2- 172.21.15.148:0/3174517097 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5585488545d0 0x558548850e10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1de000fb90 tx=0x7f1de0014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e60c9d13f40a61e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:23.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.248+0000 7f1dd37fe640 1 -- 172.21.15.148:0/3174517097 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de00044c0 con 0x5585488545d0 2024-09-19T07:14:23.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.248+0000 7f1dd37fe640 1 -- 172.21.15.148:0/3174517097 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1de0004660 con 0x5585488545d0 2024-09-19T07:14:23.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.249+0000 7f1df1ffd740 1 -- 172.21.15.148:0/3174517097 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5585488545d0 msgr2=0x558548850e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:23.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.249+0000 7f1df1ffd740 1 --2- 172.21.15.148:0/3174517097 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5585488545d0 0x558548850e10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1de000fb90 tx=0x7f1de0014000 comp rx=0 tx=0).stop 2024-09-19T07:14:23.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.252+0000 7f1df1ffd740 1 -- 172.21.15.148:0/3174517097 shutdown_connections 2024-09-19T07:14:23.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.252+0000 7f1df1ffd740 1 --2- 172.21.15.148:0/3174517097 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55854885f370 0x55854885be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:23.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.252+0000 7f1df1ffd740 1 --2- 172.21.15.148:0/3174517097 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558548855b40 0x55854885b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:23.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.252+0000 7f1df1ffd740 1 --2- 172.21.15.148:0/3174517097 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5585488545d0 0x558548850e10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:23.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.252+0000 7f1df1ffd740 1 -- 172.21.15.148:0/3174517097 >> 172.21.15.148:0/3174517097 conn(0x55854881d310 msgr2=0x558548850700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:23.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.256+0000 7f1df1ffd740 1 -- 172.21.15.148:0/3174517097 shutdown_connections 2024-09-19T07:14:23.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.258+0000 7f1df1ffd740 1 -- 172.21.15.148:0/3174517097 wait complete. 2024-09-19T07:14:23.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.258+0000 7f1df1ffd740 1 -- start start 2024-09-19T07:14:23.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.258+0000 7f1df1ffd740 1 Processor -- start 2024-09-19T07:14:23.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.259+0000 7f1df1ffd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5585488545d0 0x558548867890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:23.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.259+0000 7f1df1ffd740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558548855b40 0x558548867dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:23.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.259+0000 7f1df1ffd740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55854885f370 0x558548862e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:23.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.259+0000 7f1df1ffd740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1dcc00cea0 con 0x55854885f370 2024-09-19T07:14:23.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.259+0000 7f1df1ffd740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1dcc00e310 con 0x558548855b40 2024-09-19T07:14:23.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.259+0000 7f1df1ffd740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1dcc00d570 con 0x5585488545d0 2024-09-19T07:14:23.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.259+0000 7f1df1ffd740 10 client.0 _ll_register_callbacks cb 0x7f1dd8009810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:14:23.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.260+0000 7f1dee1c1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55854885f370 0x558548862e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:23.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.260+0000 7f1dee1c1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55854885f370 0x558548862e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38644/0 (socket says 172.21.15.148:38644) 2024-09-19T07:14:23.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.260+0000 7f1dee1c1640 1 -- 172.21.15.148:0/1868107322 learned_addr learned my addr 172.21.15.148:0/1868107322 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:14:23.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.261+0000 7f1dee1c1640 1 -- 172.21.15.148:0/1868107322 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5585488545d0 msgr2=0x558548867890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T07:14:23.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.261+0000 7f1dee1c1640 1 --2- 172.21.15.148:0/1868107322 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5585488545d0 0x558548867890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:23.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.261+0000 7f1dee1c1640 1 -- 172.21.15.148:0/1868107322 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558548855b40 msgr2=0x558548867dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T07:14:23.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.261+0000 7f1dee1c1640 1 --2- 172.21.15.148:0/1868107322 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558548855b40 0x558548867dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:23.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.261+0000 7f1dee1c1640 1 -- 172.21.15.148:0/1868107322 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558548863690 con 0x55854885f370 2024-09-19T07:14:23.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.261+0000 7f1dee1c1640 1 --2- 172.21.15.148:0/1868107322 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55854885f370 0x558548862e60 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x558548855070 tx=0x7f1dd8013e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d606221b013d18e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:23.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.261+0000 7f1dd17fa640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:14:23.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.262+0000 7f1dd17fa640 1 -- 172.21.15.148:0/1868107322 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd8017040 con 0x55854885f370 2024-09-19T07:14:23.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.262+0000 7f1df1ffd740 1 -- 172.21.15.148:0/1868107322 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1de0004660 con 0x55854885f370 2024-09-19T07:14:23.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.262+0000 7f1dd17fa640 1 -- 172.21.15.148:0/1868107322 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f1dd801cbf0 con 0x55854885f370 2024-09-19T07:14:23.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.263+0000 7f1dd17fa640 1 -- 172.21.15.148:0/1868107322 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f1dd8040050 con 0x55854885f370 2024-09-19T07:14:23.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.263+0000 7f1df1ffd740 10 client.16260 fetch_fsmap learned FSMap version 31 2024-09-19T07:14:23.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.263+0000 7f1df1ffd740 1 -- 172.21.15.148:0/1868107322 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5585488d95d0 con 0x55854885f370 2024-09-19T07:14:23.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.264+0000 7f1dd17fa640 1 -- 172.21.15.148:0/1868107322 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1de0004660 con 0x55854885f370 2024-09-19T07:14:23.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.264+0000 7f1dd17fa640 1 -- 172.21.15.148:0/1868107322 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f1dd8030420 con 0x55854885f370 2024-09-19T07:14:23.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.264+0000 7f1df1ffd740 10 client.16260 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:14:23.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.264+0000 7f1df1ffd740 10 client.16260 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T07:14:23.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.264+0000 7f1df1ffd740 20 client.16260 populate_metadata read hostname 'smithi148' 2024-09-19T07:14:23.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.264+0000 7f1df1ffd740 1 --2- 172.21.15.148:0/1868107322 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x5585488d9c70 0x5585488dc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:23.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.264+0000 7f1df1ffd740 4 client.16260 mds_command: new command op to 24436 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:14:23.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.264+0000 7f1df1ffd740 1 -- 172.21.15.148:0/1868107322 --> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5585487c1d70 con 0x5585488d9c70 2024-09-19T07:14:23.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.264+0000 7f1ded9c0640 1 --2- 172.21.15.148:0/1868107322 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x5585488d9c70 0x5585488dc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:23.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.266+0000 7f1ded9c0640 1 --2- 172.21.15.148:0/1868107322 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x5585488d9c70 0x5585488dc0f0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=69268f8a209acffe server_cookie=9ecbcd62b105760c in_seq=0 out_seq=0 2024-09-19T07:14:23.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.266+0000 7f1dd17fa640 10 client.16260 ms_handle_connect on v2:172.21.15.179:6836/3827671241 2024-09-19T07:14:23.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:22 smithi179 ceph-mon[35716]: pgmap v102: 97 pgs: 97 active+clean; 308 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.8 MiB/s wr, 486 op/s 2024-09-19T07:14:23.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.274+0000 7f1dd17fa640 1 -- 172.21.15.148:0/1868107322 <== mds.2 v2:172.21.15.179:6836/3827671241 1 ==== command_reply(tid 0: 0 ) ==== 8+0+169868 (crc 0 0 0) 0x5585487c1d70 con 0x5585488d9c70 2024-09-19T07:14:23.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.274+0000 7f1dd17fa640 10 client.16260 handle_command_reply: tid=0 2024-09-19T07:14:23.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.275+0000 7f1df1ffd740 1 client.16260 shutdown 2024-09-19T07:14:23.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.280+0000 7f1df1ffd740 1 -- 172.21.15.148:0/1868107322 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55854885f370 msgr2=0x558548862e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:23.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.280+0000 7f1df1ffd740 1 --2- 172.21.15.148:0/1868107322 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55854885f370 0x558548862e60 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x558548855070 tx=0x7f1dd8013e00 comp rx=0 tx=0).stop 2024-09-19T07:14:23.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.280+0000 7f1df1ffd740 1 -- 172.21.15.148:0/1868107322 shutdown_connections 2024-09-19T07:14:23.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.280+0000 7f1df1ffd740 1 --2- 172.21.15.148:0/1868107322 >> [v2:172.21.15.179:6836/3827671241,v1:172.21.15.179:6837/3827671241] conn(0x5585488d9c70 0x5585488dc0f0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:23.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.280+0000 7f1df1ffd740 1 --2- 172.21.15.148:0/1868107322 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55854885f370 0x558548862e60 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:23.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.280+0000 7f1df1ffd740 1 --2- 172.21.15.148:0/1868107322 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558548855b40 0x558548867dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:23.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.280+0000 7f1df1ffd740 1 --2- 172.21.15.148:0/1868107322 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5585488545d0 0x558548867890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:23.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.280+0000 7f1dd17fa640 0 client.16260 ms_handle_reset on v2:172.21.15.179:6836/3827671241 2024-09-19T07:14:23.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.280+0000 7f1df1ffd740 1 -- 172.21.15.148:0/1868107322 >> 172.21.15.148:0/1868107322 conn(0x55854881d310 msgr2=0x55854885b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:23.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.284+0000 7f1df1ffd740 1 -- 172.21.15.148:0/1868107322 shutdown_connections 2024-09-19T07:14:23.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.284+0000 7f1df1ffd740 1 -- 172.21.15.148:0/1868107322 wait complete. 2024-09-19T07:14:23.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.284+0000 7f1df1ffd740 20 client.16260 trim_cache size 0 max 16384 2024-09-19T07:14:23.288 INFO:teuthology.orchestra.run.smithi148.stdout:[ 2024-09-19T07:14:23.288 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.288 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.288 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2502529, 2024-09-19T07:14:23.288 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630688, 2024-09-19T07:14:23.288 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-3.xml" 2024-09-19T07:14:23.289 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.289 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.289 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.289 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 17089228, 2024-09-19T07:14:23.289 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630071, 2024-09-19T07:14:23.289 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-10.jpg" 2024-09-19T07:14:23.289 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.289 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.289 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.289 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 20529200, 2024-09-19T07:14:23.289 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632366, 2024-09-19T07:14:23.290 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-13.jpg" 2024-09-19T07:14:23.290 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.290 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.290 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.290 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 20947811, 2024-09-19T07:14:23.290 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629113, 2024-09-19T07:14:23.290 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-21.jpg" 2024-09-19T07:14:23.290 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.290 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.290 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.290 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 23029919, 2024-09-19T07:14:23.290 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631863, 2024-09-19T07:14:23.290 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-66.xml" 2024-09-19T07:14:23.291 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.291 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.291 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.291 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 46223397, 2024-09-19T07:14:23.291 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632396, 2024-09-19T07:14:23.291 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-79.jpg" 2024-09-19T07:14:23.291 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.291 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.291 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.291 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 51289592, 2024-09-19T07:14:23.291 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631489, 2024-09-19T07:14:23.291 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-28.xml" 2024-09-19T07:14:23.291 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.292 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.292 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.292 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 58492933, 2024-09-19T07:14:23.292 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629947, 2024-09-19T07:14:23.292 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-10.jpg" 2024-09-19T07:14:23.292 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.292 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.292 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.292 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 64732603, 2024-09-19T07:14:23.292 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629801, 2024-09-19T07:14:23.292 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-30.xml" 2024-09-19T07:14:23.292 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.293 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.293 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.293 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 64931988, 2024-09-19T07:14:23.293 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631550, 2024-09-19T07:14:23.293 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-5.xml" 2024-09-19T07:14:23.293 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.293 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.293 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.293 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 65655781, 2024-09-19T07:14:23.293 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629885, 2024-09-19T07:14:23.293 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-10.xml" 2024-09-19T07:14:23.294 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.294 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.294 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.294 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 75422804, 2024-09-19T07:14:23.294 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629530, 2024-09-19T07:14:23.294 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-15.xml" 2024-09-19T07:14:23.294 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.294 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.294 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.294 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 92779544, 2024-09-19T07:14:23.294 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629704, 2024-09-19T07:14:23.294 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-51.xml" 2024-09-19T07:14:23.295 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.295 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.295 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.295 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 106996095, 2024-09-19T07:14:23.295 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629080, 2024-09-19T07:14:23.295 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-32.jpg" 2024-09-19T07:14:23.295 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.295 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.295 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.295 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 142482615, 2024-09-19T07:14:23.295 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628792, 2024-09-19T07:14:23.295 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-40.xml" 2024-09-19T07:14:23.296 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.296 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.296 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.296 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 157156630, 2024-09-19T07:14:23.296 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628948, 2024-09-19T07:14:23.296 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-76.jpg" 2024-09-19T07:14:23.296 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.296 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.296 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.296 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 157452880, 2024-09-19T07:14:23.296 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630452, 2024-09-19T07:14:23.296 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-20.xml" 2024-09-19T07:14:23.297 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.297 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.297 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.297 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 158425704, 2024-09-19T07:14:23.297 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630739, 2024-09-19T07:14:23.297 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-3.jpg" 2024-09-19T07:14:23.297 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.297 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.297 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.297 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 158650003, 2024-09-19T07:14:23.297 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630664, 2024-09-19T07:14:23.297 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-11.xml" 2024-09-19T07:14:23.297 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.297 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.298 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.298 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 162859204, 2024-09-19T07:14:23.298 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629939, 2024-09-19T07:14:23.298 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-12.jpg" 2024-09-19T07:14:23.298 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.298 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.298 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.298 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 163494718, 2024-09-19T07:14:23.298 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629419, 2024-09-19T07:14:23.298 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-50.xml" 2024-09-19T07:14:23.298 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.298 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.299 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.299 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 164268168, 2024-09-19T07:14:23.299 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632020, 2024-09-19T07:14:23.299 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-43.xml" 2024-09-19T07:14:23.299 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.299 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.299 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.299 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 172302875, 2024-09-19T07:14:23.299 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629116, 2024-09-19T07:14:23.299 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-20.jpg" 2024-09-19T07:14:23.299 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.299 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.299 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.300 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 179224534, 2024-09-19T07:14:23.300 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632597, 2024-09-19T07:14:23.300 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-25.jpg" 2024-09-19T07:14:23.300 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.300 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.300 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.300 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 184666731, 2024-09-19T07:14:23.300 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631254, 2024-09-19T07:14:23.300 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-16.xml" 2024-09-19T07:14:23.300 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.300 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.300 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.301 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 190251050, 2024-09-19T07:14:23.301 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629439, 2024-09-19T07:14:23.301 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-43.xml" 2024-09-19T07:14:23.301 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.301 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.301 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.301 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 203046300, 2024-09-19T07:14:23.301 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629900, 2024-09-19T07:14:23.301 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-6.xml" 2024-09-19T07:14:23.301 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.301 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.301 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.301 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 204332639, 2024-09-19T07:14:23.302 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632544, 2024-09-19T07:14:23.302 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-40.jpg" 2024-09-19T07:14:23.302 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.302 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.302 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.302 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 225214823, 2024-09-19T07:14:23.302 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632397, 2024-09-19T07:14:23.302 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-7.jpg" 2024-09-19T07:14:23.302 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.302 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.302 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.302 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 228878166, 2024-09-19T07:14:23.302 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631038, 2024-09-19T07:14:23.302 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-56.xml" 2024-09-19T07:14:23.303 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.303 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.303 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.303 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 231897028, 2024-09-19T07:14:23.303 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632479, 2024-09-19T07:14:23.303 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-59.jpg" 2024-09-19T07:14:23.303 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.303 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.303 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.303 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 239963169, 2024-09-19T07:14:23.303 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629785, 2024-09-19T07:14:23.303 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-33.xml" 2024-09-19T07:14:23.303 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.304 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.304 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.304 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 254852850, 2024-09-19T07:14:23.304 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629340, 2024-09-19T07:14:23.304 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-78.xml" 2024-09-19T07:14:23.304 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.304 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.304 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.304 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 265000269, 2024-09-19T07:14:23.304 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629602, 2024-09-19T07:14:23.304 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-2.xml" 2024-09-19T07:14:23.304 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.306 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.306 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.306 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 272594377, 2024-09-19T07:14:23.306 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631505, 2024-09-19T07:14:23.306 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-21.xml" 2024-09-19T07:14:23.306 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.306 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.306 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.306 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 286400010, 2024-09-19T07:14:23.306 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629659, 2024-09-19T07:14:23.306 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-63.xml" 2024-09-19T07:14:23.307 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.307 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.307 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.307 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 288255352, 2024-09-19T07:14:23.307 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629815, 2024-09-19T07:14:23.307 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-27.xml" 2024-09-19T07:14:23.307 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.307 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.307 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.307 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 292260277, 2024-09-19T07:14:23.307 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632220, 2024-09-19T07:14:23.307 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-24.xml" 2024-09-19T07:14:23.308 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.308 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.308 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.308 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 292654583, 2024-09-19T07:14:23.308 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631247, 2024-09-19T07:14:23.308 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-75.xml" 2024-09-19T07:14:23.308 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.308 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.308 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.308 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 296757909, 2024-09-19T07:14:23.308 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629344, 2024-09-19T07:14:23.308 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-76.xml" 2024-09-19T07:14:23.308 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.309 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.309 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.309 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 313111854, 2024-09-19T07:14:23.309 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631618, 2024-09-19T07:14:23.309 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-87.xml" 2024-09-19T07:14:23.309 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.309 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.309 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.309 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 327618019, 2024-09-19T07:14:23.309 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631259, 2024-09-19T07:14:23.309 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-11.xml" 2024-09-19T07:14:23.309 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.310 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.310 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.310 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 338211727, 2024-09-19T07:14:23.311 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629087, 2024-09-19T07:14:23.311 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-30.jpg" 2024-09-19T07:14:23.311 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.311 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.311 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.311 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 342632360, 2024-09-19T07:14:23.312 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630473, 2024-09-19T07:14:23.312 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-11.xml" 2024-09-19T07:14:23.312 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.312 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.312 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.312 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 343527174, 2024-09-19T07:14:23.312 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631891, 2024-09-19T07:14:23.312 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-60.xml" 2024-09-19T07:14:23.312 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.312 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.312 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.312 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 363041425, 2024-09-19T07:14:23.313 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631569, 2024-09-19T07:14:23.313 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-14.jpg" 2024-09-19T07:14:23.313 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.313 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.313 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.313 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 372504341, 2024-09-19T07:14:23.313 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629458, 2024-09-19T07:14:23.313 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-37.xml" 2024-09-19T07:14:23.313 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.313 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.313 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.313 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 382006551, 2024-09-19T07:14:23.313 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631312, 2024-09-19T07:14:23.314 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-4.jpg" 2024-09-19T07:14:23.314 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.314 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.314 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.314 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 385094299, 2024-09-19T07:14:23.314 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629963, 2024-09-19T07:14:23.314 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-6.jpg" 2024-09-19T07:14:23.314 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.314 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.314 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.314 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 387365171, 2024-09-19T07:14:23.314 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631585, 2024-09-19T07:14:23.314 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-7.jpg" 2024-09-19T07:14:23.315 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.315 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.315 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.315 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 392909287, 2024-09-19T07:14:23.315 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631261, 2024-09-19T07:14:23.315 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-9.xml" 2024-09-19T07:14:23.315 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.315 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.315 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.315 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 410869096, 2024-09-19T07:14:23.315 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629697, 2024-09-19T07:14:23.315 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-53.xml" 2024-09-19T07:14:23.315 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.316 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.316 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.316 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 411389193, 2024-09-19T07:14:23.316 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628891, 2024-09-19T07:14:23.316 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-7.xml" 2024-09-19T07:14:23.316 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.316 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.316 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.316 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 414375829, 2024-09-19T07:14:23.316 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631841, 2024-09-19T07:14:23.316 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-70.xml" 2024-09-19T07:14:23.316 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.316 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.316 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.317 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 423877848, 2024-09-19T07:14:23.317 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630502, 2024-09-19T07:14:23.317 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-2.xml" 2024-09-19T07:14:23.317 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.317 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.317 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.317 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 426703345, 2024-09-19T07:14:23.317 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631592, 2024-09-19T07:14:23.317 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-4.jpg" 2024-09-19T07:14:23.317 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.317 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.317 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.317 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 428675184, 2024-09-19T07:14:23.317 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629207, 2024-09-19T07:14:23.318 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-9.jpg" 2024-09-19T07:14:23.318 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.318 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.318 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.318 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 433484404, 2024-09-19T07:14:23.318 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630446, 2024-09-19T07:14:23.318 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-22.xml" 2024-09-19T07:14:23.318 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.318 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.318 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.318 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 435231354, 2024-09-19T07:14:23.318 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632414, 2024-09-19T07:14:23.318 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-74.jpg" 2024-09-19T07:14:23.319 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.319 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.319 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.319 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 451075751, 2024-09-19T07:14:23.319 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629911, 2024-09-19T07:14:23.319 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-3.xml" 2024-09-19T07:14:23.319 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.319 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.319 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.319 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 453383433, 2024-09-19T07:14:23.319 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628903, 2024-09-19T07:14:23.319 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-3.xml" 2024-09-19T07:14:23.319 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.319 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.320 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.320 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 456976790, 2024-09-19T07:14:23.320 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631486, 2024-09-19T07:14:23.320 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-29.xml" 2024-09-19T07:14:23.320 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.320 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.320 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.320 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 458649327, 2024-09-19T07:14:23.320 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630718, 2024-09-19T07:14:23.320 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-10.jpg" 2024-09-19T07:14:23.320 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.320 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.320 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.321 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 459997911, 2024-09-19T07:14:23.321 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628942, 2024-09-19T07:14:23.321 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-78.jpg" 2024-09-19T07:14:23.321 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.321 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.321 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.321 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 460699456, 2024-09-19T07:14:23.321 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632538, 2024-09-19T07:14:23.321 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-42.jpg" 2024-09-19T07:14:23.321 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.321 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.321 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.321 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 462840320, 2024-09-19T07:14:23.321 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629205, 2024-09-19T07:14:23.322 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-10.jpg" 2024-09-19T07:14:23.322 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.322 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.322 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.322 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 480646898, 2024-09-19T07:14:23.322 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630414, 2024-09-19T07:14:23.322 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-7.jpg" 2024-09-19T07:14:23.322 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.322 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.322 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.322 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 484055221, 2024-09-19T07:14:23.322 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630508, 2024-09-19T07:14:23.322 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-28.jpg" 2024-09-19T07:14:23.322 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.322 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.323 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.323 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 497488798, 2024-09-19T07:14:23.323 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630499, 2024-09-19T07:14:23.323 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-3.xml" 2024-09-19T07:14:23.323 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.323 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.323 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.323 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 497896320, 2024-09-19T07:14:23.323 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629746, 2024-09-19T07:14:23.323 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-41.xml" 2024-09-19T07:14:23.323 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.323 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.323 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.323 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 505591328, 2024-09-19T07:14:23.324 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630568, 2024-09-19T07:14:23.324 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-8.jpg" 2024-09-19T07:14:23.324 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.324 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.324 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.324 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 506179198, 2024-09-19T07:14:23.324 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632585, 2024-09-19T07:14:23.324 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-28.jpg" 2024-09-19T07:14:23.324 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.324 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.324 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.324 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 509724480, 2024-09-19T07:14:23.324 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629646, 2024-09-19T07:14:23.325 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-66.xml" 2024-09-19T07:14:23.325 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.325 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.325 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.325 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 516797083, 2024-09-19T07:14:23.325 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631643, 2024-09-19T07:14:23.325 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-85.xml" 2024-09-19T07:14:23.325 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.325 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.325 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.325 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 521341751, 2024-09-19T07:14:23.326 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628969, 2024-09-19T07:14:23.326 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-69.jpg" 2024-09-19T07:14:23.326 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.326 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.326 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.326 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 532538397, 2024-09-19T07:14:23.326 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629617, 2024-09-19T07:14:23.326 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-71.xml" 2024-09-19T07:14:23.326 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.326 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.326 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.326 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 541576290, 2024-09-19T07:14:23.326 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511633171, 2024-09-19T07:14:23.326 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/article-17.xml" 2024-09-19T07:14:23.327 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.327 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.327 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.327 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 553370961, 2024-09-19T07:14:23.327 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632340, 2024-09-19T07:14:23.327 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-4.xml" 2024-09-19T07:14:23.327 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.327 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.327 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.327 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 565124500, 2024-09-19T07:14:23.327 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631823, 2024-09-19T07:14:23.327 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-74.xml" 2024-09-19T07:14:23.328 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.328 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.328 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.328 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 582129732, 2024-09-19T07:14:23.328 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629075, 2024-09-19T07:14:23.328 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-34.jpg" 2024-09-19T07:14:23.328 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.328 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.328 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.328 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 613319472, 2024-09-19T07:14:23.328 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632502, 2024-09-19T07:14:23.328 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-53.jpg" 2024-09-19T07:14:23.328 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.329 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.329 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.329 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 615998766, 2024-09-19T07:14:23.329 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631118, 2024-09-19T07:14:23.329 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-29.xml" 2024-09-19T07:14:23.329 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.329 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.329 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.329 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 622550991, 2024-09-19T07:14:23.329 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629195, 2024-09-19T07:14:23.329 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-14.jpg" 2024-09-19T07:14:23.329 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.329 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.330 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.330 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 626610700, 2024-09-19T07:14:23.330 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630517, 2024-09-19T07:14:23.330 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-25.jpg" 2024-09-19T07:14:23.330 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.330 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.330 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.330 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 626992788, 2024-09-19T07:14:23.330 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628749, 2024-09-19T07:14:23.330 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-58.xml" 2024-09-19T07:14:23.330 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.330 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.330 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.331 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 627637895, 2024-09-19T07:14:23.331 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632379, 2024-09-19T07:14:23.331 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-84.jpg" 2024-09-19T07:14:23.331 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.331 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.331 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.331 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 630871135, 2024-09-19T07:14:23.331 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630535, 2024-09-19T07:14:23.331 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-19.jpg" 2024-09-19T07:14:23.331 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.331 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.331 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.331 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 645831595, 2024-09-19T07:14:23.332 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631677, 2024-09-19T07:14:23.332 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-83.xml" 2024-09-19T07:14:23.332 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.332 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.332 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.332 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 646338452, 2024-09-19T07:14:23.332 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629057, 2024-09-19T07:14:23.332 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-40.jpg" 2024-09-19T07:14:23.332 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.332 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.332 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.333 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 656527015, 2024-09-19T07:14:23.333 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631498, 2024-09-19T07:14:23.333 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-24.xml" 2024-09-19T07:14:23.333 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.333 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.333 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.333 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 665394046, 2024-09-19T07:14:23.333 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629335, 2024-09-19T07:14:23.333 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-81.xml" 2024-09-19T07:14:23.333 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.333 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.333 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.333 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 665929577, 2024-09-19T07:14:23.333 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628763, 2024-09-19T07:14:23.334 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-51.xml" 2024-09-19T07:14:23.334 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.334 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.334 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.334 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 667545406, 2024-09-19T07:14:23.334 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629727, 2024-09-19T07:14:23.334 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-45.xml" 2024-09-19T07:14:23.334 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.334 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.334 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.334 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 675479677, 2024-09-19T07:14:23.334 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629881, 2024-09-19T07:14:23.334 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-11.xml" 2024-09-19T07:14:23.334 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.334 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.335 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.335 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 677150783, 2024-09-19T07:14:23.335 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630399, 2024-09-19T07:14:23.335 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-36.xml" 2024-09-19T07:14:23.335 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.335 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.335 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.335 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 678311726, 2024-09-19T07:14:23.335 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630733, 2024-09-19T07:14:23.335 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-5.jpg" 2024-09-19T07:14:23.335 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.335 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.335 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.335 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 678855045, 2024-09-19T07:14:23.336 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630565, 2024-09-19T07:14:23.336 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-9.jpg" 2024-09-19T07:14:23.336 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.336 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.336 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.336 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 685838217, 2024-09-19T07:14:23.336 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628897, 2024-09-19T07:14:23.336 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-5.xml" 2024-09-19T07:14:23.336 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.336 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.336 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.336 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 687370864, 2024-09-19T07:14:23.336 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632436, 2024-09-19T07:14:23.336 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-69.jpg" 2024-09-19T07:14:23.337 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.337 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.337 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.337 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 690205198, 2024-09-19T07:14:23.337 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632166, 2024-09-19T07:14:23.337 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-30.xml" 2024-09-19T07:14:23.337 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.337 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.337 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.337 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 693250095, 2024-09-19T07:14:23.337 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629026, 2024-09-19T07:14:23.337 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-50.jpg" 2024-09-19T07:14:23.337 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.338 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.338 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.338 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 696196081, 2024-09-19T07:14:23.338 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629685, 2024-09-19T07:14:23.338 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-56.xml" 2024-09-19T07:14:23.338 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.339 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.339 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.339 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 698181249, 2024-09-19T07:14:23.339 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632490, 2024-09-19T07:14:23.339 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-56.jpg" 2024-09-19T07:14:23.339 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.339 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.339 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.339 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 700608711, 2024-09-19T07:14:23.339 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632257, 2024-09-19T07:14:23.339 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-20.xml" 2024-09-19T07:14:23.339 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.339 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.339 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.340 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 709340847, 2024-09-19T07:14:23.340 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631571, 2024-09-19T07:14:23.340 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-13.jpg" 2024-09-19T07:14:23.340 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.340 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.340 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.340 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 713594362, 2024-09-19T07:14:23.340 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631501, 2024-09-19T07:14:23.340 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-23.xml" 2024-09-19T07:14:23.340 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.340 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.340 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.341 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 720623993, 2024-09-19T07:14:23.341 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632406, 2024-09-19T07:14:23.341 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-5.jpg" 2024-09-19T07:14:23.341 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.341 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.341 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.341 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 737018946, 2024-09-19T07:14:23.341 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632423, 2024-09-19T07:14:23.341 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-72.jpg" 2024-09-19T07:14:23.341 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.341 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.341 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.342 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 743090400, 2024-09-19T07:14:23.342 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629386, 2024-09-19T07:14:23.342 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-61.xml" 2024-09-19T07:14:23.342 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.342 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.342 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.342 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 747390850, 2024-09-19T07:14:23.342 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632523, 2024-09-19T07:14:23.342 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-47.jpg" 2024-09-19T07:14:23.342 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.342 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.342 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.342 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 764017243, 2024-09-19T07:14:23.343 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629820, 2024-09-19T07:14:23.343 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-26.xml" 2024-09-19T07:14:23.343 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.343 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.343 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.343 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 781011416, 2024-09-19T07:14:23.343 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631729, 2024-09-19T07:14:23.343 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-82.xml" 2024-09-19T07:14:23.343 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.343 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.343 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.343 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 782432232, 2024-09-19T07:14:23.343 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629873, 2024-09-19T07:14:23.344 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-13.xml" 2024-09-19T07:14:23.344 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.344 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.344 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.344 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 787514529, 2024-09-19T07:14:23.344 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631873, 2024-09-19T07:14:23.344 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-64.xml" 2024-09-19T07:14:23.344 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.344 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.344 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.344 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 799908838, 2024-09-19T07:14:23.344 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631237, 2024-09-19T07:14:23.345 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-93.jpg" 2024-09-19T07:14:23.345 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.345 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.345 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.345 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 808317839, 2024-09-19T07:14:23.345 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631538, 2024-09-19T07:14:23.345 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-10.xml" 2024-09-19T07:14:23.345 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.345 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.345 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.345 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 814473695, 2024-09-19T07:14:23.345 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631915, 2024-09-19T07:14:23.345 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-54.xml" 2024-09-19T07:14:23.346 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.346 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.346 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.346 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 821469253, 2024-09-19T07:14:23.346 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632207, 2024-09-19T07:14:23.346 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-25.xml" 2024-09-19T07:14:23.346 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.346 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.346 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.346 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 833162643, 2024-09-19T07:14:23.346 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632572, 2024-09-19T07:14:23.346 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-32.jpg" 2024-09-19T07:14:23.346 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.347 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.347 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.347 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 833708212, 2024-09-19T07:14:23.347 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629486, 2024-09-19T07:14:23.347 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-28.xml" 2024-09-19T07:14:23.347 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.347 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.347 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.347 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 833780401, 2024-09-19T07:14:23.347 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630736, 2024-09-19T07:14:23.347 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-4.jpg" 2024-09-19T07:14:23.347 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.347 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.347 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.348 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 840749776, 2024-09-19T07:14:23.348 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511633450, 2024-09-19T07:14:23.348 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-48.jpg" 2024-09-19T07:14:23.348 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.348 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.348 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.348 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 842246676, 2024-09-19T07:14:23.348 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632526, 2024-09-19T07:14:23.348 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-46.jpg" 2024-09-19T07:14:23.348 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.348 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.348 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.348 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 842854056, 2024-09-19T07:14:23.349 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631262, 2024-09-19T07:14:23.349 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-8.xml" 2024-09-19T07:14:23.349 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.349 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.349 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.349 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 843850383, 2024-09-19T07:14:23.349 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631603, 2024-09-19T07:14:23.349 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-88.xml" 2024-09-19T07:14:23.349 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.349 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.349 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.349 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 847227821, 2024-09-19T07:14:23.349 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629403, 2024-09-19T07:14:23.350 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-55.xml" 2024-09-19T07:14:23.350 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.350 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.350 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.350 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 849785274, 2024-09-19T07:14:23.350 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629839, 2024-09-19T07:14:23.350 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-22.xml" 2024-09-19T07:14:23.350 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.350 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.350 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.350 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 850672965, 2024-09-19T07:14:23.350 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628731, 2024-09-19T07:14:23.350 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-67.xml" 2024-09-19T07:14:23.351 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.351 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.351 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.351 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 851650752, 2024-09-19T07:14:23.351 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632403, 2024-09-19T07:14:23.351 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-77.jpg" 2024-09-19T07:14:23.351 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.351 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.351 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.351 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 859736899, 2024-09-19T07:14:23.351 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629069, 2024-09-19T07:14:23.351 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-36.jpg" 2024-09-19T07:14:23.351 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.352 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.352 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.352 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 866073269, 2024-09-19T07:14:23.352 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631587, 2024-09-19T07:14:23.352 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-6.jpg" 2024-09-19T07:14:23.352 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.352 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.352 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.352 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 886185103, 2024-09-19T07:14:23.352 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630449, 2024-09-19T07:14:23.352 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-21.xml" 2024-09-19T07:14:23.352 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.352 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.353 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.353 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 888343359, 2024-09-19T07:14:23.353 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630505, 2024-09-19T07:14:23.353 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-1.xml" 2024-09-19T07:14:23.353 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.353 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.353 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.353 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 895619809, 2024-09-19T07:14:23.353 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628721, 2024-09-19T07:14:23.353 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-72.xml" 2024-09-19T07:14:23.353 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.353 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.353 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.353 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 897802745, 2024-09-19T07:14:23.354 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629353, 2024-09-19T07:14:23.354 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-72.xml" 2024-09-19T07:14:23.354 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.354 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.354 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.354 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 915209114, 2024-09-19T07:14:23.354 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631516, 2024-09-19T07:14:23.354 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-17.xml" 2024-09-19T07:14:23.354 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.354 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.354 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.354 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 915808407, 2024-09-19T07:14:23.354 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629818, 2024-09-19T07:14:23.354 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-16.jpg" 2024-09-19T07:14:23.355 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.355 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.355 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.355 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 934723277, 2024-09-19T07:14:23.355 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631268, 2024-09-19T07:14:23.355 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-2.xml" 2024-09-19T07:14:23.355 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.355 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.355 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.355 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 939798576, 2024-09-19T07:14:23.355 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629481, 2024-09-19T07:14:23.355 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-29.xml" 2024-09-19T07:14:23.355 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.356 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.356 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.356 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 939939163, 2024-09-19T07:14:23.356 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632385, 2024-09-19T07:14:23.356 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-82.jpg" 2024-09-19T07:14:23.356 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.356 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.356 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.356 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 941483941, 2024-09-19T07:14:23.356 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629020, 2024-09-19T07:14:23.356 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-52.jpg" 2024-09-19T07:14:23.356 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.356 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.357 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.357 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 949841493, 2024-09-19T07:14:23.357 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632399, 2024-09-19T07:14:23.357 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-78.jpg" 2024-09-19T07:14:23.357 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.357 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.357 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.357 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 959318264, 2024-09-19T07:14:23.357 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629421, 2024-09-19T07:14:23.357 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-49.xml" 2024-09-19T07:14:23.357 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.357 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.357 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.358 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 965043454, 2024-09-19T07:14:23.358 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631808, 2024-09-19T07:14:23.358 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-75.xml" 2024-09-19T07:14:23.358 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.358 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.358 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.358 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 970467659, 2024-09-19T07:14:23.358 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629569, 2024-09-19T07:14:23.358 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-79.xml" 2024-09-19T07:14:23.358 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.358 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.358 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.358 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 988388098, 2024-09-19T07:14:23.358 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630715, 2024-09-19T07:14:23.359 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-11.jpg" 2024-09-19T07:14:23.359 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.359 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.359 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.359 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 989719996, 2024-09-19T07:14:23.359 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629678, 2024-09-19T07:14:23.359 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-58.xml" 2024-09-19T07:14:23.359 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.359 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.359 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.359 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1002151731, 2024-09-19T07:14:23.359 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628921, 2024-09-19T07:14:23.359 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-85.jpg" 2024-09-19T07:14:23.360 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.360 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.360 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.360 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1006433780, 2024-09-19T07:14:23.360 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632320, 2024-09-19T07:14:23.360 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-13.xml" 2024-09-19T07:14:23.360 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.360 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.360 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.360 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1010600694, 2024-09-19T07:14:23.360 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631252, 2024-09-19T07:14:23.360 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-18.xml" 2024-09-19T07:14:23.361 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.361 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.361 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.361 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1011264776, 2024-09-19T07:14:23.361 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628885, 2024-09-19T07:14:23.361 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-9.xml" 2024-09-19T07:14:23.361 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.361 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.361 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.361 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1020629500, 2024-09-19T07:14:23.361 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631369, 2024-09-19T07:14:23.361 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-94.xml" 2024-09-19T07:14:23.361 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.362 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.362 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.362 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1029948343, 2024-09-19T07:14:23.362 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631289, 2024-09-19T07:14:23.362 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-81.jpg" 2024-09-19T07:14:23.362 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.362 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.362 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.362 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1042542098, 2024-09-19T07:14:23.362 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628867, 2024-09-19T07:14:23.362 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-15.xml" 2024-09-19T07:14:23.362 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.362 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.363 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.363 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1044298604, 2024-09-19T07:14:23.363 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629780, 2024-09-19T07:14:23.363 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-34.xml" 2024-09-19T07:14:23.363 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.363 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.363 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.363 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1050006238, 2024-09-19T07:14:23.363 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631265, 2024-09-19T07:14:23.363 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-5.xml" 2024-09-19T07:14:23.364 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.364 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.364 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.364 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1060886947, 2024-09-19T07:14:23.364 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628743, 2024-09-19T07:14:23.364 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-61.xml" 2024-09-19T07:14:23.364 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.364 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.364 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.364 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1063896100, 2024-09-19T07:14:23.364 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632294, 2024-09-19T07:14:23.364 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-15.xml" 2024-09-19T07:14:23.364 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.365 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.365 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.365 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1067123006, 2024-09-19T07:14:23.365 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631803, 2024-09-19T07:14:23.365 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-76.xml" 2024-09-19T07:14:23.365 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.365 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.365 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.365 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1069520332, 2024-09-19T07:14:23.365 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629221, 2024-09-19T07:14:23.365 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-3.jpg" 2024-09-19T07:14:23.365 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.365 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.366 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.366 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1087156036, 2024-09-19T07:14:23.366 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630652, 2024-09-19T07:14:23.366 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-15.xml" 2024-09-19T07:14:23.366 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.366 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.366 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.366 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1087262396, 2024-09-19T07:14:23.366 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628825, 2024-09-19T07:14:23.366 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-29.xml" 2024-09-19T07:14:23.366 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.366 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.366 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.366 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1097479798, 2024-09-19T07:14:23.367 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632371, 2024-09-19T07:14:23.367 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-87.jpg" 2024-09-19T07:14:23.367 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.367 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.367 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.367 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1104401405, 2024-09-19T07:14:23.367 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629769, 2024-09-19T07:14:23.367 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-36.xml" 2024-09-19T07:14:23.367 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.367 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.367 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.367 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1108665870, 2024-09-19T07:14:23.367 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631557, 2024-09-19T07:14:23.367 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-2.xml" 2024-09-19T07:14:23.368 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.368 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.368 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.368 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1110267733, 2024-09-19T07:14:23.368 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628735, 2024-09-19T07:14:23.368 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-65.xml" 2024-09-19T07:14:23.368 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.368 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.368 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.368 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1125909738, 2024-09-19T07:14:23.368 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632357, 2024-09-19T07:14:23.368 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-11.xml" 2024-09-19T07:14:23.368 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.369 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.369 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.369 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1137019929, 2024-09-19T07:14:23.369 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632471, 2024-09-19T07:14:23.369 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-61.jpg" 2024-09-19T07:14:23.369 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.369 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.369 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.369 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1140206112, 2024-09-19T07:14:23.369 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628787, 2024-09-19T07:14:23.369 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-42.xml" 2024-09-19T07:14:23.369 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.370 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.370 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.370 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1146934843, 2024-09-19T07:14:23.370 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630706, 2024-09-19T07:14:23.370 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-14.jpg" 2024-09-19T07:14:23.371 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.371 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.371 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.371 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1158868425, 2024-09-19T07:14:23.371 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630447, 2024-09-19T07:14:23.371 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-97.xml" 2024-09-19T07:14:23.371 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.371 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.371 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.371 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1161516166, 2024-09-19T07:14:23.371 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632608, 2024-09-19T07:14:23.371 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-92.jpg" 2024-09-19T07:14:23.371 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.371 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.372 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.372 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1164519690, 2024-09-19T07:14:23.372 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632334, 2024-09-19T07:14:23.372 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-7.xml" 2024-09-19T07:14:23.372 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.372 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.372 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.372 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1175954436, 2024-09-19T07:14:23.372 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629971, 2024-09-19T07:14:23.372 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-4.jpg" 2024-09-19T07:14:23.372 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.372 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.372 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.373 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1176190683, 2024-09-19T07:14:23.373 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631837, 2024-09-19T07:14:23.373 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-71.xml" 2024-09-19T07:14:23.373 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.373 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.373 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.373 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1182729134, 2024-09-19T07:14:23.373 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632121, 2024-09-19T07:14:23.373 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-33.xml" 2024-09-19T07:14:23.373 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.373 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.373 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.374 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1190747589, 2024-09-19T07:14:23.374 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630441, 2024-09-19T07:14:23.374 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-24.xml" 2024-09-19T07:14:23.374 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.374 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.374 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.374 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1199032197, 2024-09-19T07:14:23.374 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629919, 2024-09-19T07:14:23.374 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-1.xml" 2024-09-19T07:14:23.374 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.374 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.374 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.374 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1201736510, 2024-09-19T07:14:23.375 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629095, 2024-09-19T07:14:23.375 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-27.jpg" 2024-09-19T07:14:23.375 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.375 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.375 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.375 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1205632643, 2024-09-19T07:14:23.375 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631484, 2024-09-19T07:14:23.375 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-30.xml" 2024-09-19T07:14:23.375 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.375 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.375 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.375 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1207144544, 2024-09-19T07:14:23.375 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628840, 2024-09-19T07:14:23.376 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-24.xml" 2024-09-19T07:14:23.376 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.376 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.376 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.376 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1219254092, 2024-09-19T07:14:23.376 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630631, 2024-09-19T07:14:23.376 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-22.xml" 2024-09-19T07:14:23.376 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.376 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.376 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.376 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1225841841, 2024-09-19T07:14:23.376 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629639, 2024-09-19T07:14:23.377 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-26.jpg" 2024-09-19T07:14:23.377 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.377 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.377 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.377 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1226587628, 2024-09-19T07:14:23.377 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629445, 2024-09-19T07:14:23.377 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-41.xml" 2024-09-19T07:14:23.377 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.377 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.377 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.377 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1228307576, 2024-09-19T07:14:23.377 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511633420, 2024-09-19T07:14:23.377 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-53.jpg" 2024-09-19T07:14:23.377 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.378 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.378 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.378 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1240649214, 2024-09-19T07:14:23.378 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630655, 2024-09-19T07:14:23.378 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-14.xml" 2024-09-19T07:14:23.378 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.378 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.378 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.378 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1252659444, 2024-09-19T07:14:23.378 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628727, 2024-09-19T07:14:23.378 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-69.xml" 2024-09-19T07:14:23.378 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.378 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.378 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.379 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1254752819, 2024-09-19T07:14:23.379 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632615, 2024-09-19T07:14:23.379 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-21.jpg" 2024-09-19T07:14:23.379 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.379 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.379 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.379 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1262346224, 2024-09-19T07:14:23.379 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628719, 2024-09-19T07:14:23.379 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-73.xml" 2024-09-19T07:14:23.379 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.379 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.379 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.379 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1267033885, 2024-09-19T07:14:23.379 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631527, 2024-09-19T07:14:23.380 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-14.xml" 2024-09-19T07:14:23.380 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.380 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.380 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.380 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1272117704, 2024-09-19T07:14:23.380 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629346, 2024-09-19T07:14:23.380 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-75.xml" 2024-09-19T07:14:23.380 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.380 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.380 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.380 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1273250002, 2024-09-19T07:14:23.380 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630538, 2024-09-19T07:14:23.380 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-18.jpg" 2024-09-19T07:14:23.380 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.381 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.381 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.381 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1277045403, 2024-09-19T07:14:23.381 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632374, 2024-09-19T07:14:23.381 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-86.jpg" 2024-09-19T07:14:23.381 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.381 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.381 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.381 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1280080825, 2024-09-19T07:14:23.381 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632427, 2024-09-19T07:14:23.381 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-71.jpg" 2024-09-19T07:14:23.381 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.381 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.381 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.382 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1282948901, 2024-09-19T07:14:23.382 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630589, 2024-09-19T07:14:23.382 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-1.jpg" 2024-09-19T07:14:23.382 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.382 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.382 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.382 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1293957518, 2024-09-19T07:14:23.382 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632038, 2024-09-19T07:14:23.382 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-42.xml" 2024-09-19T07:14:23.382 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.382 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.382 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.382 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1298062225, 2024-09-19T07:14:23.383 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628855, 2024-09-19T07:14:23.383 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-19.xml" 2024-09-19T07:14:23.383 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.383 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.383 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.383 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1301919412, 2024-09-19T07:14:23.383 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629123, 2024-09-19T07:14:23.383 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-16.jpg" 2024-09-19T07:14:23.383 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.383 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.383 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.383 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1302309720, 2024-09-19T07:14:23.383 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632557, 2024-09-19T07:14:23.383 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-36.jpg" 2024-09-19T07:14:23.384 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.384 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.384 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.384 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1302626783, 2024-09-19T07:14:23.384 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632283, 2024-09-19T07:14:23.384 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-16.xml" 2024-09-19T07:14:23.384 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.384 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.384 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.384 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1308247909, 2024-09-19T07:14:23.384 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632419, 2024-09-19T07:14:23.384 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-73.jpg" 2024-09-19T07:14:23.384 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.385 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.385 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.385 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1309180155, 2024-09-19T07:14:23.385 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630697, 2024-09-19T07:14:23.385 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-17.jpg" 2024-09-19T07:14:23.385 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.385 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.385 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.385 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1312569691, 2024-09-19T07:14:23.385 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631993, 2024-09-19T07:14:23.385 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-45.xml" 2024-09-19T07:14:23.385 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.385 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.385 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.385 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1315081690, 2024-09-19T07:14:23.386 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630405, 2024-09-19T07:14:23.386 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-34.xml" 2024-09-19T07:14:23.386 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.386 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.386 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.386 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1318055615, 2024-09-19T07:14:23.386 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632601, 2024-09-19T07:14:23.386 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-24.jpg" 2024-09-19T07:14:23.386 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.386 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.386 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.386 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1321560316, 2024-09-19T07:14:23.386 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632541, 2024-09-19T07:14:23.387 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-41.jpg" 2024-09-19T07:14:23.387 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.387 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.387 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.387 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1323790581, 2024-09-19T07:14:23.387 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630580, 2024-09-19T07:14:23.387 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-4.jpg" 2024-09-19T07:14:23.387 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.387 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.387 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.387 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1325262172, 2024-09-19T07:14:23.387 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628814, 2024-09-19T07:14:23.387 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-33.xml" 2024-09-19T07:14:23.387 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.388 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.388 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.388 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1326334401, 2024-09-19T07:14:23.388 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629967, 2024-09-19T07:14:23.388 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-5.jpg" 2024-09-19T07:14:23.388 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.388 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.388 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.388 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1332869775, 2024-09-19T07:14:23.388 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631130, 2024-09-19T07:14:23.388 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-23.xml" 2024-09-19T07:14:23.388 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.388 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.388 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.388 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1335083689, 2024-09-19T07:14:23.389 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632561, 2024-09-19T07:14:23.389 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-35.jpg" 2024-09-19T07:14:23.389 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.389 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.389 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.389 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1335380273, 2024-09-19T07:14:23.389 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511633520, 2024-09-19T07:14:23.389 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-34.jpg" 2024-09-19T07:14:23.389 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.389 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.389 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.389 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1340382510, 2024-09-19T07:14:23.389 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631047, 2024-09-19T07:14:23.390 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-53.xml" 2024-09-19T07:14:23.390 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.390 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.390 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.390 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1340560493, 2024-09-19T07:14:23.390 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632262, 2024-09-19T07:14:23.390 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-19.xml" 2024-09-19T07:14:23.390 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.390 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.390 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.390 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1348621214, 2024-09-19T07:14:23.390 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629452, 2024-09-19T07:14:23.390 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-39.xml" 2024-09-19T07:14:23.391 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.391 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.391 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.391 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1351450535, 2024-09-19T07:14:23.391 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628804, 2024-09-19T07:14:23.391 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-36.xml" 2024-09-19T07:14:23.391 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.391 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.391 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.391 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1353454730, 2024-09-19T07:14:23.391 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629673, 2024-09-19T07:14:23.391 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-59.xml" 2024-09-19T07:14:23.391 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.391 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.391 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.392 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1361080737, 2024-09-19T07:14:23.392 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629768, 2024-09-19T07:14:23.392 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-18.jpg" 2024-09-19T07:14:23.392 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.392 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.392 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.392 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1366613253, 2024-09-19T07:14:23.392 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630485, 2024-09-19T07:14:23.392 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-8.xml" 2024-09-19T07:14:23.392 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.392 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.392 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.392 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1373368334, 2024-09-19T07:14:23.393 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629563, 2024-09-19T07:14:23.393 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-80.xml" 2024-09-19T07:14:23.393 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.393 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.393 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.393 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1376773232, 2024-09-19T07:14:23.393 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631899, 2024-09-19T07:14:23.393 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-58.xml" 2024-09-19T07:14:23.393 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.393 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.393 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.393 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1388938592, 2024-09-19T07:14:23.393 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628759, 2024-09-19T07:14:23.394 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-53.xml" 2024-09-19T07:14:23.394 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.394 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.394 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.394 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1407304390, 2024-09-19T07:14:23.394 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632338, 2024-09-19T07:14:23.394 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-5.xml" 2024-09-19T07:14:23.394 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.394 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.394 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.394 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1408889897, 2024-09-19T07:14:23.394 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628789, 2024-09-19T07:14:23.394 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-41.xml" 2024-09-19T07:14:23.395 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.395 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.395 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.395 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1423124628, 2024-09-19T07:14:23.395 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629557, 2024-09-19T07:14:23.395 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-81.xml" 2024-09-19T07:14:23.395 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.395 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.395 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.395 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1430257466, 2024-09-19T07:14:23.395 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629623, 2024-09-19T07:14:23.395 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-70.xml" 2024-09-19T07:14:23.395 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.396 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.396 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.396 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1447065276, 2024-09-19T07:14:23.396 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629869, 2024-09-19T07:14:23.396 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-14.xml" 2024-09-19T07:14:23.396 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.396 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.396 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.396 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1452041797, 2024-09-19T07:14:23.396 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631089, 2024-09-19T07:14:23.396 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-39.xml" 2024-09-19T07:14:23.396 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.396 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.397 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.397 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1453101677, 2024-09-19T07:14:23.397 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631035, 2024-09-19T07:14:23.397 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-57.xml" 2024-09-19T07:14:23.397 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.397 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.397 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.397 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1453447866, 2024-09-19T07:14:23.397 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631446, 2024-09-19T07:14:23.397 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-1.jpg" 2024-09-19T07:14:23.397 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.397 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.397 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.398 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1458302213, 2024-09-19T07:14:23.398 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629850, 2024-09-19T07:14:23.398 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-19.xml" 2024-09-19T07:14:23.398 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.398 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.398 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.398 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1459258459, 2024-09-19T07:14:23.398 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632365, 2024-09-19T07:14:23.398 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-1.xml" 2024-09-19T07:14:23.398 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.398 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.399 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.399 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1465522134, 2024-09-19T07:14:23.399 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630574, 2024-09-19T07:14:23.399 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-6.jpg" 2024-09-19T07:14:23.399 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.399 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.399 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.399 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1469794265, 2024-09-19T07:14:23.399 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628828, 2024-09-19T07:14:23.399 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-28.xml" 2024-09-19T07:14:23.399 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.399 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.399 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.400 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1474661418, 2024-09-19T07:14:23.400 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630396, 2024-09-19T07:14:23.400 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-37.xml" 2024-09-19T07:14:23.400 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.400 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.400 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.400 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1485227622, 2024-09-19T07:14:23.400 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631059, 2024-09-19T07:14:23.400 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-49.xml" 2024-09-19T07:14:23.400 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.400 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.400 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.400 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1487208444, 2024-09-19T07:14:23.401 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631423, 2024-09-19T07:14:23.401 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-93.xml" 2024-09-19T07:14:23.401 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.401 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.401 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.401 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1489952386, 2024-09-19T07:14:23.401 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632392, 2024-09-19T07:14:23.401 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-80.jpg" 2024-09-19T07:14:23.401 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.401 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.401 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.401 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1500611789, 2024-09-19T07:14:23.402 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632049, 2024-09-19T07:14:23.402 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-41.xml" 2024-09-19T07:14:23.402 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.402 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.402 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.402 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1509885865, 2024-09-19T07:14:23.402 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629896, 2024-09-19T07:14:23.402 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-7.xml" 2024-09-19T07:14:23.402 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.402 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.402 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.402 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1510774427, 2024-09-19T07:14:23.402 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630550, 2024-09-19T07:14:23.402 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-14.jpg" 2024-09-19T07:14:23.403 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.403 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.403 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.403 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1513240081, 2024-09-19T07:14:23.403 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630915, 2024-09-19T07:14:23.403 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-96.jpg" 2024-09-19T07:14:23.403 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.403 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.403 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.403 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1515547505, 2024-09-19T07:14:23.403 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631600, 2024-09-19T07:14:23.403 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-89.xml" 2024-09-19T07:14:23.403 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.403 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.404 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.404 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1517505576, 2024-09-19T07:14:23.404 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631248, 2024-09-19T07:14:23.404 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-20.xml" 2024-09-19T07:14:23.404 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.404 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.404 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.404 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1523248353, 2024-09-19T07:14:23.404 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629755, 2024-09-19T07:14:23.404 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-39.xml" 2024-09-19T07:14:23.404 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.404 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.404 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.404 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1532910547, 2024-09-19T07:14:23.405 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629554, 2024-09-19T07:14:23.405 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-9.xml" 2024-09-19T07:14:23.405 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.408 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.408 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.408 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1539623559, 2024-09-19T07:14:23.408 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630393, 2024-09-19T07:14:23.408 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-38.xml" 2024-09-19T07:14:23.409 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.409 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.409 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.409 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1545302389, 2024-09-19T07:14:23.409 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629449, 2024-09-19T07:14:23.409 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-40.xml" 2024-09-19T07:14:23.409 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.409 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.409 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.409 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1545934358, 2024-09-19T07:14:23.409 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630491, 2024-09-19T07:14:23.409 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-6.xml" 2024-09-19T07:14:23.409 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.410 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.410 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.410 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1554576387, 2024-09-19T07:14:23.410 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632322, 2024-09-19T07:14:23.410 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-12.xml" 2024-09-19T07:14:23.410 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.410 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.410 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.410 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1564824915, 2024-09-19T07:14:23.410 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631520, 2024-09-19T07:14:23.410 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-16.xml" 2024-09-19T07:14:23.410 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.410 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.410 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.411 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1569506390, 2024-09-19T07:14:23.411 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629118, 2024-09-19T07:14:23.411 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-19.jpg" 2024-09-19T07:14:23.411 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.411 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.411 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.411 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1578622135, 2024-09-19T07:14:23.411 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631931, 2024-09-19T07:14:23.411 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-51.xml" 2024-09-19T07:14:23.412 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.412 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.412 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.412 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1579792321, 2024-09-19T07:14:23.412 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629789, 2024-09-19T07:14:23.412 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-22.xml" 2024-09-19T07:14:23.412 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.412 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.412 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.412 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1582363574, 2024-09-19T07:14:23.412 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632451, 2024-09-19T07:14:23.412 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-66.jpg" 2024-09-19T07:14:23.412 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.412 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.413 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.413 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1583356043, 2024-09-19T07:14:23.413 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628807, 2024-09-19T07:14:23.413 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-35.xml" 2024-09-19T07:14:23.413 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.413 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.413 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.413 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1584658391, 2024-09-19T07:14:23.413 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631926, 2024-09-19T07:14:23.413 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-52.xml" 2024-09-19T07:14:23.413 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.413 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.413 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.414 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1590907893, 2024-09-19T07:14:23.414 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631547, 2024-09-19T07:14:23.414 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-6.xml" 2024-09-19T07:14:23.414 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.414 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.414 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.414 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1600309218, 2024-09-19T07:14:23.414 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631321, 2024-09-19T07:14:23.414 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-26.jpg" 2024-09-19T07:14:23.414 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.414 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.414 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.414 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1607593043, 2024-09-19T07:14:23.415 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631086, 2024-09-19T07:14:23.415 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-40.xml" 2024-09-19T07:14:23.415 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.415 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.415 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.415 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1619747921, 2024-09-19T07:14:23.415 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629466, 2024-09-19T07:14:23.415 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-34.xml" 2024-09-19T07:14:23.415 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.415 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.415 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.415 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1628885573, 2024-09-19T07:14:23.415 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632342, 2024-09-19T07:14:23.415 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-3.xml" 2024-09-19T07:14:23.415 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.416 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.416 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.416 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1629030659, 2024-09-19T07:14:23.416 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629689, 2024-09-19T07:14:23.416 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-55.xml" 2024-09-19T07:14:23.416 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.416 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.416 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.416 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1633780558, 2024-09-19T07:14:23.416 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629521, 2024-09-19T07:14:23.416 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-18.xml" 2024-09-19T07:14:23.416 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.416 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.416 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.416 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1635172788, 2024-09-19T07:14:23.417 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628915, 2024-09-19T07:14:23.417 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-87.jpg" 2024-09-19T07:14:23.417 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.417 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.417 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.417 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1637935588, 2024-09-19T07:14:23.417 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631264, 2024-09-19T07:14:23.417 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-6.xml" 2024-09-19T07:14:23.417 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.417 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.417 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.417 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1643108391, 2024-09-19T07:14:23.417 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629512, 2024-09-19T07:14:23.418 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-21.xml" 2024-09-19T07:14:23.418 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.418 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.418 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.418 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1647663651, 2024-09-19T07:14:23.418 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632405, 2024-09-19T07:14:23.418 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-76.jpg" 2024-09-19T07:14:23.418 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.418 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.418 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.418 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1655088740, 2024-09-19T07:14:23.418 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629587, 2024-09-19T07:14:23.418 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-76.xml" 2024-09-19T07:14:23.418 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.418 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.419 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.419 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1658840231, 2024-09-19T07:14:23.419 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632272, 2024-09-19T07:14:23.419 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-18.xml" 2024-09-19T07:14:23.419 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.419 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.419 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.419 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1664618791, 2024-09-19T07:14:23.419 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628761, 2024-09-19T07:14:23.419 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-52.xml" 2024-09-19T07:14:23.419 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.419 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.419 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.420 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1676891544, 2024-09-19T07:14:23.420 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632344, 2024-09-19T07:14:23.420 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-2.xml" 2024-09-19T07:14:23.421 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.421 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.421 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.421 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1687510929, 2024-09-19T07:14:23.421 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628819, 2024-09-19T07:14:23.421 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-31.xml" 2024-09-19T07:14:23.421 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.421 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.421 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.421 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1691681910, 2024-09-19T07:14:23.421 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632404, 2024-09-19T07:14:23.421 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-6.jpg" 2024-09-19T07:14:23.422 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.422 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.422 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.422 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1697074179, 2024-09-19T07:14:23.422 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631573, 2024-09-19T07:14:23.422 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-12.jpg" 2024-09-19T07:14:23.422 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.422 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.422 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.422 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1702286959, 2024-09-19T07:14:23.422 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631867, 2024-09-19T07:14:23.422 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-65.xml" 2024-09-19T07:14:23.423 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.423 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.423 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.423 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1703305358, 2024-09-19T07:14:23.423 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629923, 2024-09-19T07:14:23.423 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-16.jpg" 2024-09-19T07:14:23.423 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.423 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.423 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.423 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1704675445, 2024-09-19T07:14:23.423 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630745, 2024-09-19T07:14:23.423 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-1.jpg" 2024-09-19T07:14:23.423 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.424 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.424 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.424 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1712525998, 2024-09-19T07:14:23.424 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629722, 2024-09-19T07:14:23.424 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-20.jpg" 2024-09-19T07:14:23.424 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.424 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.424 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.424 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1718161336, 2024-09-19T07:14:23.424 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631263, 2024-09-19T07:14:23.424 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-7.xml" 2024-09-19T07:14:23.424 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.425 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.425 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.425 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1735574215, 2024-09-19T07:14:23.425 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631044, 2024-09-19T07:14:23.425 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-54.xml" 2024-09-19T07:14:23.425 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.425 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.425 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.425 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1737970217, 2024-09-19T07:14:23.425 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629575, 2024-09-19T07:14:23.425 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-78.xml" 2024-09-19T07:14:23.425 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.425 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.426 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.426 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1750147823, 2024-09-19T07:14:23.426 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629470, 2024-09-19T07:14:23.426 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-33.xml" 2024-09-19T07:14:23.426 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.426 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.426 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.426 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1769367922, 2024-09-19T07:14:23.426 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630261, 2024-09-19T07:14:23.426 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-100.xml" 2024-09-19T07:14:23.426 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.426 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.426 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.426 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1788031622, 2024-09-19T07:14:23.427 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628745, 2024-09-19T07:14:23.427 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-60.xml" 2024-09-19T07:14:23.427 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.427 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.427 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.427 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1792811498, 2024-09-19T07:14:23.427 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632228, 2024-09-19T07:14:23.427 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-23.xml" 2024-09-19T07:14:23.427 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.427 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.427 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.427 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1793918017, 2024-09-19T07:14:23.428 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629740, 2024-09-19T07:14:23.428 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-42.xml" 2024-09-19T07:14:23.428 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.428 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.428 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.428 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1795952576, 2024-09-19T07:14:23.428 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632325, 2024-09-19T07:14:23.428 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-11.xml" 2024-09-19T07:14:23.428 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.428 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.428 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.428 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1799745605, 2024-09-19T07:14:23.428 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511633338, 2024-09-19T07:14:23.429 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-67.jpg" 2024-09-19T07:14:23.429 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.429 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.429 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.429 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1804806283, 2024-09-19T07:14:23.429 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631859, 2024-09-19T07:14:23.429 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-67.xml" 2024-09-19T07:14:23.429 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.429 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.429 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.429 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1806983413, 2024-09-19T07:14:23.429 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629120, 2024-09-19T07:14:23.429 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-18.jpg" 2024-09-19T07:14:23.430 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.430 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.430 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.430 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1811479881, 2024-09-19T07:14:23.430 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629383, 2024-09-19T07:14:23.430 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-62.xml" 2024-09-19T07:14:23.430 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.430 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.430 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.430 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1812554173, 2024-09-19T07:14:23.430 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632581, 2024-09-19T07:14:23.430 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-29.jpg" 2024-09-19T07:14:23.430 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.431 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.431 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.431 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1814900065, 2024-09-19T07:14:23.431 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632115, 2024-09-19T07:14:23.431 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-34.xml" 2024-09-19T07:14:23.431 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.431 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.431 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.431 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1817171634, 2024-09-19T07:14:23.431 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629338, 2024-09-19T07:14:23.431 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-79.xml" 2024-09-19T07:14:23.431 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.431 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.432 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.432 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1821989704, 2024-09-19T07:14:23.432 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631542, 2024-09-19T07:14:23.432 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-8.xml" 2024-09-19T07:14:23.432 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.432 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.432 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.432 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1825228230, 2024-09-19T07:14:23.432 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629217, 2024-09-19T07:14:23.432 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-5.jpg" 2024-09-19T07:14:23.432 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.432 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.432 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.433 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1831987875, 2024-09-19T07:14:23.433 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632349, 2024-09-19T07:14:23.433 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-19.jpg" 2024-09-19T07:14:23.433 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.433 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.433 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.433 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1835318073, 2024-09-19T07:14:23.433 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631245, 2024-09-19T07:14:23.433 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-21.xml" 2024-09-19T07:14:23.433 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.433 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.433 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.434 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1837547329, 2024-09-19T07:14:23.434 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632455, 2024-09-19T07:14:23.434 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-65.jpg" 2024-09-19T07:14:23.434 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.434 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.434 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.434 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1841085739, 2024-09-19T07:14:23.434 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632605, 2024-09-19T07:14:23.434 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-23.jpg" 2024-09-19T07:14:23.434 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.434 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.434 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.434 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1842961073, 2024-09-19T07:14:23.435 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630469, 2024-09-19T07:14:23.435 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-13.xml" 2024-09-19T07:14:23.435 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.435 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.435 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.435 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1842966324, 2024-09-19T07:14:23.435 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629759, 2024-09-19T07:14:23.435 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-38.xml" 2024-09-19T07:14:23.435 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.435 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.435 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.435 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1846727963, 2024-09-19T07:14:23.435 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630511, 2024-09-19T07:14:23.435 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-27.jpg" 2024-09-19T07:14:23.436 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.436 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.436 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.436 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1850518466, 2024-09-19T07:14:23.436 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630424, 2024-09-19T07:14:23.436 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-29.xml" 2024-09-19T07:14:23.436 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.436 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.436 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.436 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1856678313, 2024-09-19T07:14:23.436 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630438, 2024-09-19T07:14:23.436 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-25.xml" 2024-09-19T07:14:23.436 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.436 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.437 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.437 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1861612015, 2024-09-19T07:14:23.437 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632614, 2024-09-19T07:14:23.437 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-71.xml" 2024-09-19T07:14:23.437 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.437 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.437 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.437 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1868282528, 2024-09-19T07:14:23.437 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631083, 2024-09-19T07:14:23.437 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-41.xml" 2024-09-19T07:14:23.437 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.437 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.437 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.437 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1879108828, 2024-09-19T07:14:23.438 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631246, 2024-09-19T07:14:23.438 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-11.jpg" 2024-09-19T07:14:23.438 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.438 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.438 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.438 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1920140358, 2024-09-19T07:14:23.438 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629464, 2024-09-19T07:14:23.438 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-35.xml" 2024-09-19T07:14:23.438 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.438 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.438 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.438 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1920210071, 2024-09-19T07:14:23.438 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629761, 2024-09-19T07:14:23.438 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-99.xml" 2024-09-19T07:14:23.438 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.439 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.439 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.439 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1921900858, 2024-09-19T07:14:23.439 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628725, 2024-09-19T07:14:23.439 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-70.xml" 2024-09-19T07:14:23.439 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.439 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.439 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.439 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1923478794, 2024-09-19T07:14:23.439 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629888, 2024-09-19T07:14:23.439 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-9.xml" 2024-09-19T07:14:23.439 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.439 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.439 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.439 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1926415427, 2024-09-19T07:14:23.440 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629006, 2024-09-19T07:14:23.440 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-57.jpg" 2024-09-19T07:14:23.440 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.440 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.440 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.440 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1935313538, 2024-09-19T07:14:23.440 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629460, 2024-09-19T07:14:23.440 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-36.xml" 2024-09-19T07:14:23.440 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.440 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.440 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.440 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1940363934, 2024-09-19T07:14:23.440 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632445, 2024-09-19T07:14:23.440 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-67.jpg" 2024-09-19T07:14:23.441 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.441 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.441 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.441 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1940676085, 2024-09-19T07:14:23.441 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630556, 2024-09-19T07:14:23.441 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-12.jpg" 2024-09-19T07:14:23.441 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.441 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.441 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.441 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1942623154, 2024-09-19T07:14:23.441 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632391, 2024-09-19T07:14:23.441 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-8.jpg" 2024-09-19T07:14:23.441 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.441 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.442 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.442 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1944007137, 2024-09-19T07:14:23.442 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631778, 2024-09-19T07:14:23.442 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-44.xml" 2024-09-19T07:14:23.442 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.442 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.442 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.442 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1946587923, 2024-09-19T07:14:23.442 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630402, 2024-09-19T07:14:23.442 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-35.xml" 2024-09-19T07:14:23.442 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.442 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.442 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.442 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1959974333, 2024-09-19T07:14:23.443 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632514, 2024-09-19T07:14:23.443 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-50.jpg" 2024-09-19T07:14:23.443 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.443 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.443 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.443 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1960695597, 2024-09-19T07:14:23.443 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631253, 2024-09-19T07:14:23.443 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-17.xml" 2024-09-19T07:14:23.443 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.443 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.443 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.443 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1960712871, 2024-09-19T07:14:23.443 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629536, 2024-09-19T07:14:23.444 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-13.xml" 2024-09-19T07:14:23.444 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.444 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.444 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.444 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1965598068, 2024-09-19T07:14:23.444 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632415, 2024-09-19T07:14:23.444 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-3.jpg" 2024-09-19T07:14:23.444 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.444 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.444 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.444 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1984378860, 2024-09-19T07:14:23.444 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629847, 2024-09-19T07:14:23.444 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-20.xml" 2024-09-19T07:14:23.445 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.445 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.445 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.445 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1985913667, 2024-09-19T07:14:23.445 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629023, 2024-09-19T07:14:23.445 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-51.jpg" 2024-09-19T07:14:23.445 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.445 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.445 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.445 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1987639067, 2024-09-19T07:14:23.445 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629599, 2024-09-19T07:14:23.445 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-74.xml" 2024-09-19T07:14:23.446 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.446 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.446 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.446 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1990007283, 2024-09-19T07:14:23.446 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631258, 2024-09-19T07:14:23.446 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-12.xml" 2024-09-19T07:14:23.446 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.446 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.446 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.446 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2008063052, 2024-09-19T07:14:23.446 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631508, 2024-09-19T07:14:23.446 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-20.xml" 2024-09-19T07:14:23.446 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.447 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.447 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.447 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2026163587, 2024-09-19T07:14:23.447 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632494, 2024-09-19T07:14:23.447 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-55.jpg" 2024-09-19T07:14:23.447 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.447 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.447 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.447 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2027490385, 2024-09-19T07:14:23.447 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629502, 2024-09-19T07:14:23.447 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-24.xml" 2024-09-19T07:14:23.447 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.447 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.447 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.447 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2029916088, 2024-09-19T07:14:23.448 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631775, 2024-09-19T07:14:23.448 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-79.xml" 2024-09-19T07:14:23.448 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.448 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.448 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.448 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2035702213, 2024-09-19T07:14:23.448 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632091, 2024-09-19T07:14:23.448 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-37.xml" 2024-09-19T07:14:23.448 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.448 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.448 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.448 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2091910545, 2024-09-19T07:14:23.448 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629223, 2024-09-19T07:14:23.448 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-2.jpg" 2024-09-19T07:14:23.449 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.449 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.449 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.449 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2095058238, 2024-09-19T07:14:23.449 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629539, 2024-09-19T07:14:23.449 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-12.xml" 2024-09-19T07:14:23.449 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.449 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.449 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.449 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2113959596, 2024-09-19T07:14:23.449 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511633553, 2024-09-19T07:14:23.449 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-27.jpg" 2024-09-19T07:14:23.450 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.450 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.450 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.450 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2118157358, 2024-09-19T07:14:23.450 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628751, 2024-09-19T07:14:23.450 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-57.xml" 2024-09-19T07:14:23.450 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.450 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.450 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.450 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2138811292, 2024-09-19T07:14:23.450 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632474, 2024-09-19T07:14:23.450 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-60.jpg" 2024-09-19T07:14:23.450 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.450 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.450 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.451 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2150364874, 2024-09-19T07:14:23.451 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632356, 2024-09-19T07:14:23.451 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-16.jpg" 2024-09-19T07:14:23.451 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.451 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.451 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.451 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2173135509, 2024-09-19T07:14:23.451 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511633529, 2024-09-19T07:14:23.451 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-32.jpg" 2024-09-19T07:14:23.451 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.451 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.451 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.451 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2174064831, 2024-09-19T07:14:23.451 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630412, 2024-09-19T07:14:23.452 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-32.xml" 2024-09-19T07:14:23.452 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.452 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.452 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.452 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2174166382, 2024-09-19T07:14:23.452 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631911, 2024-09-19T07:14:23.452 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-55.xml" 2024-09-19T07:14:23.452 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.452 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.452 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.452 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2175140656, 2024-09-19T07:14:23.452 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630634, 2024-09-19T07:14:23.452 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-21.xml" 2024-09-19T07:14:23.453 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.453 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.453 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.453 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2176221753, 2024-09-19T07:14:23.453 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632066, 2024-09-19T07:14:23.453 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-40.xml" 2024-09-19T07:14:23.453 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.453 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.453 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.453 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2182550198, 2024-09-19T07:14:23.453 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630523, 2024-09-19T07:14:23.453 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-23.jpg" 2024-09-19T07:14:23.454 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.454 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.454 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.454 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2188524062, 2024-09-19T07:14:23.454 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631120, 2024-09-19T07:14:23.454 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-28.xml" 2024-09-19T07:14:23.454 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.454 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.454 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.454 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2197544100, 2024-09-19T07:14:23.454 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631292, 2024-09-19T07:14:23.454 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-20.xml" 2024-09-19T07:14:23.454 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.454 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.455 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.455 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2197946620, 2024-09-19T07:14:23.455 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632459, 2024-09-19T07:14:23.455 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-64.jpg" 2024-09-19T07:14:23.455 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.455 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.455 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.455 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2198022922, 2024-09-19T07:14:23.455 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632173, 2024-09-19T07:14:23.455 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-29.xml" 2024-09-19T07:14:23.455 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.455 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.455 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.455 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2202094870, 2024-09-19T07:14:23.456 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632075, 2024-09-19T07:14:23.456 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-39.xml" 2024-09-19T07:14:23.456 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.456 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.456 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.456 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2215630348, 2024-09-19T07:14:23.456 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631745, 2024-09-19T07:14:23.456 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-81.xml" 2024-09-19T07:14:23.456 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.456 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.456 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.456 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2228647407, 2024-09-19T07:14:23.456 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628717, 2024-09-19T07:14:23.456 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-74.xml" 2024-09-19T07:14:23.457 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.457 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.457 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.457 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2238033829, 2024-09-19T07:14:23.457 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629742, 2024-09-19T07:14:23.457 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-19.jpg" 2024-09-19T07:14:23.457 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.457 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.457 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.457 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2241934650, 2024-09-19T07:14:23.457 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632565, 2024-09-19T07:14:23.457 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-34.jpg" 2024-09-19T07:14:23.457 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.457 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.458 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.458 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2243887815, 2024-09-19T07:14:23.458 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511633254, 2024-09-19T07:14:23.458 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/article-1.xml" 2024-09-19T07:14:23.458 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.458 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.458 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.458 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2247594327, 2024-09-19T07:14:23.458 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630712, 2024-09-19T07:14:23.458 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-12.jpg" 2024-09-19T07:14:23.458 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.458 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.458 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.458 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2248319173, 2024-09-19T07:14:23.458 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628966, 2024-09-19T07:14:23.459 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-70.jpg" 2024-09-19T07:14:23.459 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.459 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.459 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.459 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2258659594, 2024-09-19T07:14:23.459 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631564, 2024-09-19T07:14:23.459 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-16.jpg" 2024-09-19T07:14:23.459 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.459 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.459 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.459 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2262081549, 2024-09-19T07:14:23.459 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632330, 2024-09-19T07:14:23.459 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-9.xml" 2024-09-19T07:14:23.459 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.459 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.460 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.460 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2262569910, 2024-09-19T07:14:23.460 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630658, 2024-09-19T07:14:23.460 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-13.xml" 2024-09-19T07:14:23.460 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.460 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.460 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.460 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2277801464, 2024-09-19T07:14:23.460 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629875, 2024-09-19T07:14:23.460 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-13.jpg" 2024-09-19T07:14:23.460 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.460 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.460 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.460 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2280421516, 2024-09-19T07:14:23.461 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628951, 2024-09-19T07:14:23.461 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-75.jpg" 2024-09-19T07:14:23.461 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.461 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.461 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.461 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2291465854, 2024-09-19T07:14:23.461 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630432, 2024-09-19T07:14:23.461 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-6.jpg" 2024-09-19T07:14:23.461 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.461 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.461 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.461 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2296598395, 2024-09-19T07:14:23.461 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631657, 2024-09-19T07:14:23.461 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-84.xml" 2024-09-19T07:14:23.462 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.462 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.462 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.462 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2316506214, 2024-09-19T07:14:23.462 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629731, 2024-09-19T07:14:23.462 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-44.xml" 2024-09-19T07:14:23.462 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.462 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.462 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.462 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2318448877, 2024-09-19T07:14:23.462 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629066, 2024-09-19T07:14:23.462 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-37.jpg" 2024-09-19T07:14:23.462 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.463 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.463 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.463 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2331351260, 2024-09-19T07:14:23.463 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630643, 2024-09-19T07:14:23.463 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-18.xml" 2024-09-19T07:14:23.463 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.463 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.463 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.463 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2334035695, 2024-09-19T07:14:23.464 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629927, 2024-09-19T07:14:23.464 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-15.jpg" 2024-09-19T07:14:23.464 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.464 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.464 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.464 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2336060750, 2024-09-19T07:14:23.464 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629226, 2024-09-19T07:14:23.464 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-1.jpg" 2024-09-19T07:14:23.464 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.464 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.464 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.464 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2338852773, 2024-09-19T07:14:23.464 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629122, 2024-09-19T07:14:23.464 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-17.jpg" 2024-09-19T07:14:23.465 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.465 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.465 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.465 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2342457854, 2024-09-19T07:14:23.465 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632507, 2024-09-19T07:14:23.465 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-52.jpg" 2024-09-19T07:14:23.465 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.465 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.465 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.465 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2344543109, 2024-09-19T07:14:23.465 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629983, 2024-09-19T07:14:23.465 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-1.jpg" 2024-09-19T07:14:23.465 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.466 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.466 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.466 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2348271749, 2024-09-19T07:14:23.466 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630709, 2024-09-19T07:14:23.467 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-13.jpg" 2024-09-19T07:14:23.467 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.467 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.467 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.467 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2352329522, 2024-09-19T07:14:23.467 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630264, 2024-09-19T07:14:23.467 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-8.jpg" 2024-09-19T07:14:23.467 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.467 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.467 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.467 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2362192221, 2024-09-19T07:14:23.468 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629051, 2024-09-19T07:14:23.468 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-42.jpg" 2024-09-19T07:14:23.468 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.468 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.468 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.468 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2379482415, 2024-09-19T07:14:23.468 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632107, 2024-09-19T07:14:23.468 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-35.xml" 2024-09-19T07:14:23.468 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.468 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.468 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.468 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2388707684, 2024-09-19T07:14:23.468 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631984, 2024-09-19T07:14:23.468 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-46.xml" 2024-09-19T07:14:23.469 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.469 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.469 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.469 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2397121240, 2024-09-19T07:14:23.469 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628733, 2024-09-19T07:14:23.469 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-66.xml" 2024-09-19T07:14:23.469 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.469 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.469 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.469 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2402130817, 2024-09-19T07:14:23.469 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631511, 2024-09-19T07:14:23.469 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-91.xml" 2024-09-19T07:14:23.469 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.470 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.470 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.470 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2406131391, 2024-09-19T07:14:23.470 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631053, 2024-09-19T07:14:23.470 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-51.xml" 2024-09-19T07:14:23.470 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.470 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.470 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.470 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2407403768, 2024-09-19T07:14:23.470 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630586, 2024-09-19T07:14:23.470 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-2.jpg" 2024-09-19T07:14:23.470 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.470 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.470 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.470 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2408041055, 2024-09-19T07:14:23.471 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629670, 2024-09-19T07:14:23.471 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-60.xml" 2024-09-19T07:14:23.471 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.471 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.471 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.471 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2414332113, 2024-09-19T07:14:23.471 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631533, 2024-09-19T07:14:23.471 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-12.xml" 2024-09-19T07:14:23.471 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.471 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.471 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.471 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2425189037, 2024-09-19T07:14:23.471 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631101, 2024-09-19T07:14:23.471 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-35.xml" 2024-09-19T07:14:23.472 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.472 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.472 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.472 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2438081208, 2024-09-19T07:14:23.472 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631336, 2024-09-19T07:14:23.472 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-95.xml" 2024-09-19T07:14:23.472 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.472 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.472 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.472 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2444844771, 2024-09-19T07:14:23.472 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630670, 2024-09-19T07:14:23.472 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-9.xml" 2024-09-19T07:14:23.472 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.472 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.473 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.473 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2450278245, 2024-09-19T07:14:23.473 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632383, 2024-09-19T07:14:23.473 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-83.jpg" 2024-09-19T07:14:23.473 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.473 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.473 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.473 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2454988861, 2024-09-19T07:14:23.473 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630464, 2024-09-19T07:14:23.473 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-15.xml" 2024-09-19T07:14:23.473 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.473 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.473 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.474 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2463965451, 2024-09-19T07:14:23.474 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629062, 2024-09-19T07:14:23.474 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-38.jpg" 2024-09-19T07:14:23.474 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.474 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.474 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.474 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2466821851, 2024-09-19T07:14:23.474 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628858, 2024-09-19T07:14:23.474 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-18.xml" 2024-09-19T07:14:23.474 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.474 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.474 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.474 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2474931194, 2024-09-19T07:14:23.475 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629370, 2024-09-19T07:14:23.475 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-65.xml" 2024-09-19T07:14:23.475 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.475 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.475 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.475 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2476788260, 2024-09-19T07:14:23.475 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630481, 2024-09-19T07:14:23.475 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-9.xml" 2024-09-19T07:14:23.475 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.475 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.475 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.475 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2477710596, 2024-09-19T07:14:23.475 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629797, 2024-09-19T07:14:23.476 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-31.xml" 2024-09-19T07:14:23.476 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.476 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.476 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.476 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2492891819, 2024-09-19T07:14:23.476 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632569, 2024-09-19T07:14:23.476 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-33.jpg" 2024-09-19T07:14:23.476 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.476 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.476 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.476 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2507064593, 2024-09-19T07:14:23.476 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629877, 2024-09-19T07:14:23.476 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-12.xml" 2024-09-19T07:14:23.476 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.477 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.477 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.477 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2509382333, 2024-09-19T07:14:23.477 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632328, 2024-09-19T07:14:23.477 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-10.xml" 2024-09-19T07:14:23.477 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.477 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.477 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.477 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2516416490, 2024-09-19T07:14:23.477 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629955, 2024-09-19T07:14:23.477 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-8.jpg" 2024-09-19T07:14:23.477 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.478 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.478 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.478 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2525203439, 2024-09-19T07:14:23.478 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630055, 2024-09-19T07:14:23.478 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-11.jpg" 2024-09-19T07:14:23.478 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.478 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.478 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.478 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2529056994, 2024-09-19T07:14:23.478 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632535, 2024-09-19T07:14:23.478 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-43.jpg" 2024-09-19T07:14:23.478 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.478 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.478 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.479 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2539203792, 2024-09-19T07:14:23.479 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628972, 2024-09-19T07:14:23.479 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-68.jpg" 2024-09-19T07:14:23.479 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.479 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.479 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.479 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2545880275, 2024-09-19T07:14:23.479 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631513, 2024-09-19T07:14:23.479 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-18.xml" 2024-09-19T07:14:23.479 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.479 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.479 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.479 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2546937081, 2024-09-19T07:14:23.480 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631903, 2024-09-19T07:14:23.480 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-57.xml" 2024-09-19T07:14:23.480 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.480 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.480 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.480 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2565308267, 2024-09-19T07:14:23.480 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631238, 2024-09-19T07:14:23.480 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-85.xml" 2024-09-19T07:14:23.480 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.480 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.480 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.480 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2576435436, 2024-09-19T07:14:23.480 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631108, 2024-09-19T07:14:23.480 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-32.xml" 2024-09-19T07:14:23.481 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.481 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.481 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.481 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2581509583, 2024-09-19T07:14:23.481 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631114, 2024-09-19T07:14:23.481 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-30.xml" 2024-09-19T07:14:23.481 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.481 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.481 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.481 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2589739770, 2024-09-19T07:14:23.481 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629362, 2024-09-19T07:14:23.481 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-69.xml" 2024-09-19T07:14:23.481 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.482 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.482 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.482 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2591967328, 2024-09-19T07:14:23.482 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630583, 2024-09-19T07:14:23.482 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-3.jpg" 2024-09-19T07:14:23.482 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.482 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.482 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.482 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2595515564, 2024-09-19T07:14:23.482 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632368, 2024-09-19T07:14:23.482 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-88.jpg" 2024-09-19T07:14:23.482 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.482 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.483 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.483 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2600736915, 2024-09-19T07:14:23.483 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629047, 2024-09-19T07:14:23.483 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-43.jpg" 2024-09-19T07:14:23.483 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.483 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.483 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.483 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2607035552, 2024-09-19T07:14:23.483 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629931, 2024-09-19T07:14:23.483 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-14.jpg" 2024-09-19T07:14:23.483 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.483 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.483 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.484 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2611672809, 2024-09-19T07:14:23.484 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632510, 2024-09-19T07:14:23.484 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-51.jpg" 2024-09-19T07:14:23.484 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.484 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.484 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.484 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2615457795, 2024-09-19T07:14:23.484 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631128, 2024-09-19T07:14:23.484 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-24.xml" 2024-09-19T07:14:23.484 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.484 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.484 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.484 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2616577992, 2024-09-19T07:14:23.485 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629566, 2024-09-19T07:14:23.485 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-7.xml" 2024-09-19T07:14:23.485 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.485 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.485 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.485 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2619437553, 2024-09-19T07:14:23.485 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628810, 2024-09-19T07:14:23.485 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-34.xml" 2024-09-19T07:14:23.485 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.485 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.485 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.485 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2620800944, 2024-09-19T07:14:23.485 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629630, 2024-09-19T07:14:23.486 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-27.jpg" 2024-09-19T07:14:23.486 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.486 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.486 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.486 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2623831960, 2024-09-19T07:14:23.486 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631531, 2024-09-19T07:14:23.486 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-13.xml" 2024-09-19T07:14:23.486 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.486 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.486 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.486 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2629374273, 2024-09-19T07:14:23.486 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632420, 2024-09-19T07:14:23.486 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-2.jpg" 2024-09-19T07:14:23.487 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.487 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.487 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.487 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2631313864, 2024-09-19T07:14:23.487 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631080, 2024-09-19T07:14:23.487 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-42.xml" 2024-09-19T07:14:23.487 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.487 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.487 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.487 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2632319210, 2024-09-19T07:14:23.487 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631554, 2024-09-19T07:14:23.487 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-3.xml" 2024-09-19T07:14:23.487 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.488 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.488 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.488 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2649183807, 2024-09-19T07:14:23.488 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511633609, 2024-09-19T07:14:23.488 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-16.jpg" 2024-09-19T07:14:23.488 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.488 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.488 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.488 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2653774434, 2024-09-19T07:14:23.488 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629809, 2024-09-19T07:14:23.488 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-28.xml" 2024-09-19T07:14:23.488 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.488 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.489 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.489 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2657735255, 2024-09-19T07:14:23.489 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631919, 2024-09-19T07:14:23.489 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-53.xml" 2024-09-19T07:14:23.489 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.489 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.489 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.489 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2663630532, 2024-09-19T07:14:23.489 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631602, 2024-09-19T07:14:23.489 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-1.jpg" 2024-09-19T07:14:23.489 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.489 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.489 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.489 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2664038472, 2024-09-19T07:14:23.490 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632553, 2024-09-19T07:14:23.490 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-37.jpg" 2024-09-19T07:14:23.490 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.490 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.490 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.490 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2665090132, 2024-09-19T07:14:23.490 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630520, 2024-09-19T07:14:23.490 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-24.jpg" 2024-09-19T07:14:23.490 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.490 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.490 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.490 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2666702881, 2024-09-19T07:14:23.490 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632239, 2024-09-19T07:14:23.491 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-22.xml" 2024-09-19T07:14:23.491 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.491 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.491 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.491 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2667388850, 2024-09-19T07:14:23.491 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631106, 2024-09-19T07:14:23.491 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-33.xml" 2024-09-19T07:14:23.491 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.491 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.491 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.491 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2676752924, 2024-09-19T07:14:23.491 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630488, 2024-09-19T07:14:23.491 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-7.xml" 2024-09-19T07:14:23.491 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.492 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.492 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.492 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2683686006, 2024-09-19T07:14:23.492 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630700, 2024-09-19T07:14:23.492 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-16.jpg" 2024-09-19T07:14:23.492 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.492 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.492 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.492 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2684596098, 2024-09-19T07:14:23.492 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631559, 2024-09-19T07:14:23.492 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-1.xml" 2024-09-19T07:14:23.492 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.492 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.492 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.493 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2701271701, 2024-09-19T07:14:23.493 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629783, 2024-09-19T07:14:23.493 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-58.jpg" 2024-09-19T07:14:23.493 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.493 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.493 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.493 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2707895096, 2024-09-19T07:14:23.493 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630673, 2024-09-19T07:14:23.493 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-8.xml" 2024-09-19T07:14:23.493 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.493 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.493 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.493 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2714968562, 2024-09-19T07:14:23.493 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630703, 2024-09-19T07:14:23.494 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-15.jpg" 2024-09-19T07:14:23.494 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.494 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.494 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.494 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2715317956, 2024-09-19T07:14:23.494 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629472, 2024-09-19T07:14:23.494 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-32.xml" 2024-09-19T07:14:23.494 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.494 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.494 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.494 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2734157462, 2024-09-19T07:14:23.494 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631178, 2024-09-19T07:14:23.494 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-1.xml" 2024-09-19T07:14:23.495 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.495 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.495 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.495 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2744162797, 2024-09-19T07:14:23.495 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629374, 2024-09-19T07:14:23.495 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-64.xml" 2024-09-19T07:14:23.495 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.495 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.495 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.495 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2744223598, 2024-09-19T07:14:23.495 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629605, 2024-09-19T07:14:23.495 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-73.xml" 2024-09-19T07:14:23.495 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.495 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.496 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.496 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2756474142, 2024-09-19T07:14:23.496 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629614, 2024-09-19T07:14:23.496 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-1.xml" 2024-09-19T07:14:23.496 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.496 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.496 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.496 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2769347198, 2024-09-19T07:14:23.496 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511633426, 2024-09-19T07:14:23.496 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-52.jpg" 2024-09-19T07:14:23.496 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.496 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.496 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.496 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2772932865, 2024-09-19T07:14:23.497 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630422, 2024-09-19T07:14:23.497 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-98.xml" 2024-09-19T07:14:23.497 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.497 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.497 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.497 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2793314627, 2024-09-19T07:14:23.497 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629709, 2024-09-19T07:14:23.497 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-50.xml" 2024-09-19T07:14:23.497 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.497 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.497 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.497 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2798147598, 2024-09-19T07:14:23.497 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628909, 2024-09-19T07:14:23.498 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-1.xml" 2024-09-19T07:14:23.498 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.498 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.498 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.498 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2802615322, 2024-09-19T07:14:23.498 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629380, 2024-09-19T07:14:23.498 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-63.xml" 2024-09-19T07:14:23.498 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.498 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.498 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.498 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2806202920, 2024-09-19T07:14:23.498 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632135, 2024-09-19T07:14:23.498 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-32.xml" 2024-09-19T07:14:23.498 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.499 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.499 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.499 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2807567860, 2024-09-19T07:14:23.499 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628794, 2024-09-19T07:14:23.499 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-39.xml" 2024-09-19T07:14:23.499 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.499 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.499 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.499 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2819400197, 2024-09-19T07:14:23.499 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628963, 2024-09-19T07:14:23.499 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-71.jpg" 2024-09-19T07:14:23.499 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.499 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.499 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.500 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2834473272, 2024-09-19T07:14:23.500 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630724, 2024-09-19T07:14:23.500 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-8.jpg" 2024-09-19T07:14:23.500 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.500 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.500 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.500 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2836238501, 2024-09-19T07:14:23.500 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629401, 2024-09-19T07:14:23.500 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-56.xml" 2024-09-19T07:14:23.500 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.500 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.500 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.500 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2836615352, 2024-09-19T07:14:23.500 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629852, 2024-09-19T07:14:23.501 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-14.jpg" 2024-09-19T07:14:23.501 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.501 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.501 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.501 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2837036601, 2024-09-19T07:14:23.501 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631342, 2024-09-19T07:14:23.501 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-3.jpg" 2024-09-19T07:14:23.501 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.501 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.501 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.501 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2838779426, 2024-09-19T07:14:23.501 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629629, 2024-09-19T07:14:23.501 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-69.xml" 2024-09-19T07:14:23.501 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.502 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.502 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.502 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2840089884, 2024-09-19T07:14:23.502 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629389, 2024-09-19T07:14:23.502 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-60.xml" 2024-09-19T07:14:23.502 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.502 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.502 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.502 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2844782454, 2024-09-19T07:14:23.502 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629398, 2024-09-19T07:14:23.502 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-57.xml" 2024-09-19T07:14:23.502 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.502 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.503 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.503 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2847838541, 2024-09-19T07:14:23.503 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631599, 2024-09-19T07:14:23.503 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-2.jpg" 2024-09-19T07:14:23.503 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.503 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.503 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.503 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2852248695, 2024-09-19T07:14:23.503 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631476, 2024-09-19T07:14:23.503 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-92.xml" 2024-09-19T07:14:23.503 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.503 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.503 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.503 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2855115177, 2024-09-19T07:14:23.504 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629647, 2024-09-19T07:14:23.504 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-25.jpg" 2024-09-19T07:14:23.504 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.504 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.504 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.504 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2858526159, 2024-09-19T07:14:23.504 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629337, 2024-09-19T07:14:23.504 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-80.xml" 2024-09-19T07:14:23.504 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.504 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.504 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.504 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2860452900, 2024-09-19T07:14:23.504 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631071, 2024-09-19T07:14:23.505 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-45.xml" 2024-09-19T07:14:23.505 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.505 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.505 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.505 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2864831948, 2024-09-19T07:14:23.505 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632364, 2024-09-19T07:14:23.505 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-14.jpg" 2024-09-19T07:14:23.505 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.505 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.505 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.505 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2881580388, 2024-09-19T07:14:23.505 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632550, 2024-09-19T07:14:23.505 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-38.jpg" 2024-09-19T07:14:23.505 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.506 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.506 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.506 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2895233346, 2024-09-19T07:14:23.506 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629578, 2024-09-19T07:14:23.506 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-5.xml" 2024-09-19T07:14:23.506 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.506 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.506 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.506 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2901753673, 2024-09-19T07:14:23.506 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629369, 2024-09-19T07:14:23.506 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-66.xml" 2024-09-19T07:14:23.506 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.507 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.507 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.507 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2906151667, 2024-09-19T07:14:23.507 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631493, 2024-09-19T07:14:23.507 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-26.xml" 2024-09-19T07:14:23.507 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.507 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.507 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.507 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2906818496, 2024-09-19T07:14:23.507 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631103, 2024-09-19T07:14:23.507 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-34.xml" 2024-09-19T07:14:23.507 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.508 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.508 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.508 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2906899039, 2024-09-19T07:14:23.508 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632517, 2024-09-19T07:14:23.508 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-49.jpg" 2024-09-19T07:14:23.508 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.508 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.508 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.508 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2910424964, 2024-09-19T07:14:23.508 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632520, 2024-09-19T07:14:23.508 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-48.jpg" 2024-09-19T07:14:23.509 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.509 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.509 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.509 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2911626981, 2024-09-19T07:14:23.509 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631765, 2024-09-19T07:14:23.509 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-80.xml" 2024-09-19T07:14:23.509 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.509 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.509 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.509 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2917479942, 2024-09-19T07:14:23.509 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629214, 2024-09-19T07:14:23.509 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-7.jpg" 2024-09-19T07:14:23.509 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.510 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.510 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.510 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2922527110, 2024-09-19T07:14:23.510 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632332, 2024-09-19T07:14:23.510 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-8.xml" 2024-09-19T07:14:23.510 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.510 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.510 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.510 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2927315927, 2024-09-19T07:14:23.510 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630480, 2024-09-19T07:14:23.510 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-5.jpg" 2024-09-19T07:14:23.510 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.510 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.511 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.511 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2927617030, 2024-09-19T07:14:23.511 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630577, 2024-09-19T07:14:23.511 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-5.jpg" 2024-09-19T07:14:23.511 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.511 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.511 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.511 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2930687669, 2024-09-19T07:14:23.511 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632326, 2024-09-19T07:14:23.511 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-12.xml" 2024-09-19T07:14:23.511 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.511 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.511 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.511 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2935118209, 2024-09-19T07:14:23.512 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630471, 2024-09-19T07:14:23.512 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-12.xml" 2024-09-19T07:14:23.512 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.512 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.512 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.512 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2936882521, 2024-09-19T07:14:23.512 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629735, 2024-09-19T07:14:23.512 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-43.xml" 2024-09-19T07:14:23.512 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.512 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.512 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.424+0000 7f1defc24640 1 -- 172.21.15.148:0/1368329717 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f1dd40a3500 msgr2=0x7f1dd40a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:23.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.424+0000 7f1defc24640 1 --2- 172.21.15.148:0/1368329717 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f1dd40a3500 0x7f1dd40a59c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1de0005fd0 tx=0x7f1de0009500 comp rx=0 tx=0).stop 2024-09-19T07:14:23.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.424+0000 7f1defc24640 1 -- 172.21.15.148:0/1368329717 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1de8101410 msgr2=0x7f1de8116840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:23.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.424+0000 7f1defc24640 1 --2- 172.21.15.148:0/1368329717 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1de8101410 0x7f1de8116840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1de4000c00 tx=0x7f1de4004ea0 comp rx=0 tx=0).stop 2024-09-19T07:14:23.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.424+0000 7f1defc24640 1 -- 172.21.15.148:0/1368329717 shutdown_connections 2024-09-19T07:14:23.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.424+0000 7f1defc24640 1 --2- 172.21.15.148:0/1368329717 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f1dd40a3500 0x7f1dd40a59c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:23.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.424+0000 7f1defc24640 1 --2- 172.21.15.148:0/1368329717 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1de8106a70 0x7f1de8111420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:23.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.424+0000 7f1defc24640 1 --2- 172.21.15.148:0/1368329717 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1de8101410 0x7f1de8116840 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:23.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.424+0000 7f1defc24640 1 --2- 172.21.15.148:0/1368329717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1de8100a70 0x7f1de8116300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:23.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.424+0000 7f1defc24640 1 -- 172.21.15.148:0/1368329717 >> 172.21.15.148:0/1368329717 conn(0x7f1de80fc790 msgr2=0x7f1de80fcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:23.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.424+0000 7f1defc24640 1 -- 172.21.15.148:0/1368329717 shutdown_connections 2024-09-19T07:14:23.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:23.424+0000 7f1defc24640 1 -- 172.21.15.148:0/1368329717 wait complete. 2024-09-19T07:14:23.514 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2940568069, 2024-09-19T07:14:23.514 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632360, 2024-09-19T07:14:23.514 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-15.jpg" 2024-09-19T07:14:23.514 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.515 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.515 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.515 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2940954848, 2024-09-19T07:14:23.515 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630682, 2024-09-19T07:14:23.515 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-5.xml" 2024-09-19T07:14:23.515 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.515 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.515 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.515 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2948314926, 2024-09-19T07:14:23.515 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629750, 2024-09-19T07:14:23.515 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-40.xml" 2024-09-19T07:14:23.515 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.515 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.516 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.516 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2952228792, 2024-09-19T07:14:23.516 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632373, 2024-09-19T07:14:23.516 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-11.jpg" 2024-09-19T07:14:23.516 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.516 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.516 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.516 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2952598616, 2024-09-19T07:14:23.516 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629904, 2024-09-19T07:14:23.516 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-5.xml" 2024-09-19T07:14:23.516 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.516 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.516 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.517 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2959916389, 2024-09-19T07:14:23.517 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632487, 2024-09-19T07:14:23.517 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-57.jpg" 2024-09-19T07:14:23.517 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.517 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.517 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.517 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2960517589, 2024-09-19T07:14:23.517 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629866, 2024-09-19T07:14:23.517 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-15.xml" 2024-09-19T07:14:23.517 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.517 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.517 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.517 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2961375115, 2024-09-19T07:14:23.518 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629693, 2024-09-19T07:14:23.518 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-54.xml" 2024-09-19T07:14:23.518 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.518 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.518 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.518 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2964789130, 2024-09-19T07:14:23.518 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628783, 2024-09-19T07:14:23.518 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-44.xml" 2024-09-19T07:14:23.518 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.518 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.518 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.518 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2971589161, 2024-09-19T07:14:23.519 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629666, 2024-09-19T07:14:23.519 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-61.xml" 2024-09-19T07:14:23.519 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.519 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.519 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.519 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2974853612, 2024-09-19T07:14:23.519 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631132, 2024-09-19T07:14:23.519 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-22.xml" 2024-09-19T07:14:23.519 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.519 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.519 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.519 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2984790532, 2024-09-19T07:14:23.519 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631077, 2024-09-19T07:14:23.519 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-43.xml" 2024-09-19T07:14:23.519 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.520 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.520 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.520 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2985818882, 2024-09-19T07:14:23.520 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629518, 2024-09-19T07:14:23.520 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-19.xml" 2024-09-19T07:14:23.520 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.520 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.520 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.520 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2991026805, 2024-09-19T07:14:23.520 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631074, 2024-09-19T07:14:23.520 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-44.xml" 2024-09-19T07:14:23.520 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.520 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.520 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.521 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3001539810, 2024-09-19T07:14:23.521 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629706, 2024-09-19T07:14:23.521 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-21.jpg" 2024-09-19T07:14:23.521 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.521 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.521 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.521 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3002671923, 2024-09-19T07:14:23.521 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630637, 2024-09-19T07:14:23.521 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-20.xml" 2024-09-19T07:14:23.521 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.521 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.521 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.521 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3016496380, 2024-09-19T07:14:23.522 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629792, 2024-09-19T07:14:23.522 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-32.xml" 2024-09-19T07:14:23.522 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.522 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.522 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.522 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3021091022, 2024-09-19T07:14:23.522 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631832, 2024-09-19T07:14:23.522 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-72.xml" 2024-09-19T07:14:23.522 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.522 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.522 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.522 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3045966769, 2024-09-19T07:14:23.522 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631126, 2024-09-19T07:14:23.522 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-25.xml" 2024-09-19T07:14:23.523 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.523 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.523 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.523 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3047217631, 2024-09-19T07:14:23.523 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629975, 2024-09-19T07:14:23.523 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-3.jpg" 2024-09-19T07:14:23.523 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.523 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.523 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.523 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3047233611, 2024-09-19T07:14:23.523 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632532, 2024-09-19T07:14:23.523 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-44.jpg" 2024-09-19T07:14:23.523 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.523 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.524 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.524 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3050336485, 2024-09-19T07:14:23.524 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632198, 2024-09-19T07:14:23.524 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-26.xml" 2024-09-19T07:14:23.524 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.524 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.524 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.524 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3056318311, 2024-09-19T07:14:23.524 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629219, 2024-09-19T07:14:23.524 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-4.jpg" 2024-09-19T07:14:23.524 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.524 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.524 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.525 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3062832280, 2024-09-19T07:14:23.525 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631491, 2024-09-19T07:14:23.525 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-27.xml" 2024-09-19T07:14:23.525 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.525 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.525 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.525 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3066318601, 2024-09-19T07:14:23.525 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632336, 2024-09-19T07:14:23.525 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-6.xml" 2024-09-19T07:14:23.525 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.525 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.525 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.525 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3068581795, 2024-09-19T07:14:23.526 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511633288, 2024-09-19T07:14:23.526 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-76.jpg" 2024-09-19T07:14:23.526 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.526 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.526 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.526 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3083087513, 2024-09-19T07:14:23.526 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629943, 2024-09-19T07:14:23.526 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-11.jpg" 2024-09-19T07:14:23.526 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.526 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.526 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.526 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3094030148, 2024-09-19T07:14:23.526 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631879, 2024-09-19T07:14:23.527 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-63.xml" 2024-09-19T07:14:23.527 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.527 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.527 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.527 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3095123694, 2024-09-19T07:14:23.527 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632347, 2024-09-19T07:14:23.527 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-1.xml" 2024-09-19T07:14:23.527 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.527 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.527 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.527 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3129965940, 2024-09-19T07:14:23.527 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629071, 2024-09-19T07:14:23.527 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-35.jpg" 2024-09-19T07:14:23.527 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.528 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.528 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.528 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3147312825, 2024-09-19T07:14:23.528 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630420, 2024-09-19T07:14:23.528 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-30.xml" 2024-09-19T07:14:23.528 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.528 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.528 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.528 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3149452203, 2024-09-19T07:14:23.528 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632182, 2024-09-19T07:14:23.528 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-28.xml" 2024-09-19T07:14:23.528 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.528 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.529 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.529 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3149972021, 2024-09-19T07:14:23.529 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629560, 2024-09-19T07:14:23.529 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-8.xml" 2024-09-19T07:14:23.529 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.529 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.529 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.529 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3162447953, 2024-09-19T07:14:23.529 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631681, 2024-09-19T07:14:23.529 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-42.xml" 2024-09-19T07:14:23.529 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.529 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.529 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.530 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3164253158, 2024-09-19T07:14:23.530 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630640, 2024-09-19T07:14:23.530 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-19.xml" 2024-09-19T07:14:23.530 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.530 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.530 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.530 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3167357608, 2024-09-19T07:14:23.530 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629833, 2024-09-19T07:14:23.530 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-23.xml" 2024-09-19T07:14:23.530 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.530 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.530 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.530 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3174205268, 2024-09-19T07:14:23.530 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629359, 2024-09-19T07:14:23.531 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-70.xml" 2024-09-19T07:14:23.531 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.531 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.531 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.531 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3178632528, 2024-09-19T07:14:23.531 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630416, 2024-09-19T07:14:23.531 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-31.xml" 2024-09-19T07:14:23.531 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.531 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.531 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.531 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3189774779, 2024-09-19T07:14:23.531 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629712, 2024-09-19T07:14:23.531 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-49.xml" 2024-09-19T07:14:23.532 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.532 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.532 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.532 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3193986526, 2024-09-19T07:14:23.532 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511633145, 2024-09-19T07:14:23.532 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/article-23.xml" 2024-09-19T07:14:23.532 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.532 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.532 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.532 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3199308136, 2024-09-19T07:14:23.532 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629764, 2024-09-19T07:14:23.532 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-37.xml" 2024-09-19T07:14:23.532 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.533 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.533 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3209556389, 2024-09-19T07:14:23.533 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630553, 2024-09-19T07:14:23.533 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-13.jpg" 2024-09-19T07:14:23.533 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.533 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.533 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3213746319, 2024-09-19T07:14:23.533 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632463, 2024-09-19T07:14:23.533 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-63.jpg" 2024-09-19T07:14:23.533 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.534 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.534 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3216862548, 2024-09-19T07:14:23.534 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629651, 2024-09-19T07:14:23.534 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-65.xml" 2024-09-19T07:14:23.534 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.534 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.534 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.534 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3220142732, 2024-09-19T07:14:23.534 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631092, 2024-09-19T07:14:23.534 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-38.xml" 2024-09-19T07:14:23.534 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.534 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.534 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.535 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3220599479, 2024-09-19T07:14:23.535 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631561, 2024-09-19T07:14:23.535 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-17.jpg" 2024-09-19T07:14:23.535 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.535 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.535 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.535 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3235996601, 2024-09-19T07:14:23.535 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630562, 2024-09-19T07:14:23.535 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-10.jpg" 2024-09-19T07:14:23.535 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.535 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.535 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.535 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3238836398, 2024-09-19T07:14:23.536 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630721, 2024-09-19T07:14:23.536 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-9.jpg" 2024-09-19T07:14:23.536 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.536 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.536 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.536 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3242865253, 2024-09-19T07:14:23.536 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632411, 2024-09-19T07:14:23.536 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-75.jpg" 2024-09-19T07:14:23.536 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.536 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.536 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.536 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3246569133, 2024-09-19T07:14:23.536 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631269, 2024-09-19T07:14:23.536 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-1.xml" 2024-09-19T07:14:23.537 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.537 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.537 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.537 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3251397363, 2024-09-19T07:14:23.537 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628918, 2024-09-19T07:14:23.537 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-86.jpg" 2024-09-19T07:14:23.537 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.537 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.537 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.537 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3272952817, 2024-09-19T07:14:23.537 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630727, 2024-09-19T07:14:23.537 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-7.jpg" 2024-09-19T07:14:23.537 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.537 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.538 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.538 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3277381429, 2024-09-19T07:14:23.538 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628954, 2024-09-19T07:14:23.538 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-74.jpg" 2024-09-19T07:14:23.538 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.538 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.538 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.538 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3286137177, 2024-09-19T07:14:23.538 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629392, 2024-09-19T07:14:23.538 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-59.xml" 2024-09-19T07:14:23.538 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.538 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.538 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.539 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3286503105, 2024-09-19T07:14:23.539 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632245, 2024-09-19T07:14:23.539 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-21.xml" 2024-09-19T07:14:23.539 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.539 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.539 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.539 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3301109447, 2024-09-19T07:14:23.539 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632082, 2024-09-19T07:14:23.539 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-38.xml" 2024-09-19T07:14:23.539 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.539 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.539 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.539 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3307141822, 2024-09-19T07:14:23.539 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631257, 2024-09-19T07:14:23.539 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-13.xml" 2024-09-19T07:14:23.540 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.540 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.540 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.540 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3309013573, 2024-09-19T07:14:23.540 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631552, 2024-09-19T07:14:23.540 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-4.xml" 2024-09-19T07:14:23.540 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.540 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.540 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.540 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3312103716, 2024-09-19T07:14:23.540 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629700, 2024-09-19T07:14:23.540 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-52.xml" 2024-09-19T07:14:23.540 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.540 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.540 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.541 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3312240500, 2024-09-19T07:14:23.541 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631503, 2024-09-19T07:14:23.541 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-22.xml" 2024-09-19T07:14:23.541 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.541 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.541 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.541 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3319352682, 2024-09-19T07:14:23.541 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629032, 2024-09-19T07:14:23.541 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-48.jpg" 2024-09-19T07:14:23.541 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.541 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.541 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.541 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3322120990, 2024-09-19T07:14:23.541 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630541, 2024-09-19T07:14:23.542 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-17.jpg" 2024-09-19T07:14:23.542 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.542 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.542 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.542 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3326089212, 2024-09-19T07:14:23.542 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631566, 2024-09-19T07:14:23.542 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-15.jpg" 2024-09-19T07:14:23.542 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.542 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.542 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.542 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3326977278, 2024-09-19T07:14:23.542 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632376, 2024-09-19T07:14:23.542 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-85.jpg" 2024-09-19T07:14:23.542 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.542 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.542 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.543 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3330078355, 2024-09-19T07:14:23.543 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628831, 2024-09-19T07:14:23.543 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-27.xml" 2024-09-19T07:14:23.543 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.543 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.543 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.543 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3330548440, 2024-09-19T07:14:23.543 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629844, 2024-09-19T07:14:23.543 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-21.xml" 2024-09-19T07:14:23.543 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.543 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.543 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.543 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3335155465, 2024-09-19T07:14:23.543 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628945, 2024-09-19T07:14:23.543 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-77.jpg" 2024-09-19T07:14:23.544 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.544 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.544 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.544 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3339758345, 2024-09-19T07:14:23.544 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629078, 2024-09-19T07:14:23.544 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-33.jpg" 2024-09-19T07:14:23.544 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.544 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.544 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.544 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3344630396, 2024-09-19T07:14:23.544 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629593, 2024-09-19T07:14:23.544 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-75.xml" 2024-09-19T07:14:23.544 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.544 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.545 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.545 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3351321178, 2024-09-19T07:14:23.545 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629723, 2024-09-19T07:14:23.545 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-46.xml" 2024-09-19T07:14:23.545 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.545 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.545 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.545 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3356696350, 2024-09-19T07:14:23.545 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630628, 2024-09-19T07:14:23.545 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-23.xml" 2024-09-19T07:14:23.545 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.545 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.545 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.545 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3356848832, 2024-09-19T07:14:23.546 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629479, 2024-09-19T07:14:23.546 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-30.xml" 2024-09-19T07:14:23.546 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.546 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.546 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.546 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3367793664, 2024-09-19T07:14:23.546 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630459, 2024-09-19T07:14:23.546 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-17.xml" 2024-09-19T07:14:23.546 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.546 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.546 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.546 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3376999049, 2024-09-19T07:14:23.546 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632438, 2024-09-19T07:14:23.546 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-68.jpg" 2024-09-19T07:14:23.547 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.547 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.547 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.547 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3379909264, 2024-09-19T07:14:23.547 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630435, 2024-09-19T07:14:23.547 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-26.xml" 2024-09-19T07:14:23.547 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.547 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.547 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.547 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3387159572, 2024-09-19T07:14:23.547 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629681, 2024-09-19T07:14:23.547 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-57.xml" 2024-09-19T07:14:23.547 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.547 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.547 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.548 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3397038390, 2024-09-19T07:14:23.548 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632555, 2024-09-19T07:14:23.548 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-10.xml" 2024-09-19T07:14:23.548 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.548 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.548 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.548 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3409313947, 2024-09-19T07:14:23.548 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629829, 2024-09-19T07:14:23.548 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-24.xml" 2024-09-19T07:14:23.548 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.548 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.548 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.548 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3415895080, 2024-09-19T07:14:23.549 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632529, 2024-09-19T07:14:23.549 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-45.jpg" 2024-09-19T07:14:23.549 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.549 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.549 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.549 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3417099898, 2024-09-19T07:14:23.549 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631496, 2024-09-19T07:14:23.549 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-25.xml" 2024-09-19T07:14:23.549 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.549 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.549 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.549 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3426847073, 2024-09-19T07:14:23.549 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631576, 2024-09-19T07:14:23.550 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-11.jpg" 2024-09-19T07:14:23.550 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.550 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.550 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.550 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3434209247, 2024-09-19T07:14:23.550 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628747, 2024-09-19T07:14:23.550 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-59.xml" 2024-09-19T07:14:23.550 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.550 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.550 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.550 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3436236543, 2024-09-19T07:14:23.550 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629979, 2024-09-19T07:14:23.550 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-2.jpg" 2024-09-19T07:14:23.550 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.550 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.551 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.551 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3436741926, 2024-09-19T07:14:23.551 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629350, 2024-09-19T07:14:23.551 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-73.xml" 2024-09-19T07:14:23.551 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.551 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.551 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.551 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3445539757, 2024-09-19T07:14:23.551 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629907, 2024-09-19T07:14:23.551 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-4.xml" 2024-09-19T07:14:23.551 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.551 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.551 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.551 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3458519975, 2024-09-19T07:14:23.551 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629415, 2024-09-19T07:14:23.552 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-51.xml" 2024-09-19T07:14:23.552 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.552 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.552 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.552 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3460171998, 2024-09-19T07:14:23.552 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629581, 2024-09-19T07:14:23.552 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-77.xml" 2024-09-19T07:14:23.552 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.552 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.552 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.552 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3461881235, 2024-09-19T07:14:23.552 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632424, 2024-09-19T07:14:23.552 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-1.jpg" 2024-09-19T07:14:23.552 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.552 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.553 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.553 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3462369312, 2024-09-19T07:14:23.553 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629348, 2024-09-19T07:14:23.553 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-74.xml" 2024-09-19T07:14:23.553 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.553 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.553 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.553 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3463005989, 2024-09-19T07:14:23.553 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629410, 2024-09-19T07:14:23.553 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-53.xml" 2024-09-19T07:14:23.553 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.553 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.553 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.553 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3464748155, 2024-09-19T07:14:23.554 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511633198, 2024-09-19T07:14:23.554 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/article-12.xml" 2024-09-19T07:14:23.554 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.554 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.554 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.554 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3468324551, 2024-09-19T07:14:23.554 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630649, 2024-09-19T07:14:23.554 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-16.xml" 2024-09-19T07:14:23.554 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.554 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.554 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.554 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3474592509, 2024-09-19T07:14:23.554 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631595, 2024-09-19T07:14:23.554 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-3.jpg" 2024-09-19T07:14:23.554 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.555 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.555 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.555 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3480100720, 2024-09-19T07:14:23.555 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511633300, 2024-09-19T07:14:23.555 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-74.jpg" 2024-09-19T07:14:23.555 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.555 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.555 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.555 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3480759482, 2024-09-19T07:14:23.555 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632309, 2024-09-19T07:14:23.555 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-13.xml" 2024-09-19T07:14:23.555 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.555 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.556 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.556 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3482507343, 2024-09-19T07:14:23.556 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632575, 2024-09-19T07:14:23.556 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-31.jpg" 2024-09-19T07:14:23.556 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.556 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.556 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.556 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3487181085, 2024-09-19T07:14:23.556 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632277, 2024-09-19T07:14:23.556 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-17.xml" 2024-09-19T07:14:23.556 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.556 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.556 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.556 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3489289505, 2024-09-19T07:14:23.556 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630679, 2024-09-19T07:14:23.557 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-6.xml" 2024-09-19T07:14:23.557 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.557 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.557 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.557 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3505471037, 2024-09-19T07:14:23.557 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629093, 2024-09-19T07:14:23.557 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-28.jpg" 2024-09-19T07:14:23.557 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.557 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.557 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.557 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3509555310, 2024-09-19T07:14:23.557 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629197, 2024-09-19T07:14:23.557 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-13.jpg" 2024-09-19T07:14:23.557 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.558 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.558 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3526956903, 2024-09-19T07:14:23.558 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631303, 2024-09-19T07:14:23.558 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-96.xml" 2024-09-19T07:14:23.558 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.558 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.558 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3527882307, 2024-09-19T07:14:23.558 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632593, 2024-09-19T07:14:23.559 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-26.jpg" 2024-09-19T07:14:23.559 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.559 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.559 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.559 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3528256900, 2024-09-19T07:14:23.559 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631041, 2024-09-19T07:14:23.559 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-55.xml" 2024-09-19T07:14:23.560 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.560 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.560 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.560 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3541455213, 2024-09-19T07:14:23.560 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630457, 2024-09-19T07:14:23.560 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-18.xml" 2024-09-19T07:14:23.560 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.560 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.560 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.560 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3545089476, 2024-09-19T07:14:23.560 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631852, 2024-09-19T07:14:23.560 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-69.xml" 2024-09-19T07:14:23.560 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.560 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.561 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.561 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3547120046, 2024-09-19T07:14:23.561 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632467, 2024-09-19T07:14:23.561 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-62.jpg" 2024-09-19T07:14:23.561 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.561 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.561 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.561 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3549066326, 2024-09-19T07:14:23.561 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632353, 2024-09-19T07:14:23.561 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-17.jpg" 2024-09-19T07:14:23.561 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.561 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.561 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.562 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3555030201, 2024-09-19T07:14:23.562 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629060, 2024-09-19T07:14:23.562 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-39.jpg" 2024-09-19T07:14:23.562 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.562 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.562 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.562 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3555175066, 2024-09-19T07:14:23.562 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630529, 2024-09-19T07:14:23.562 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-21.jpg" 2024-09-19T07:14:23.562 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.562 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.562 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.562 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3570603373, 2024-09-19T07:14:23.563 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629594, 2024-09-19T07:14:23.563 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-3.xml" 2024-09-19T07:14:23.563 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.563 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.563 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3581238337, 2024-09-19T07:14:23.563 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629935, 2024-09-19T07:14:23.563 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-13.jpg" 2024-09-19T07:14:23.563 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.563 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.563 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3583732360, 2024-09-19T07:14:23.564 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630730, 2024-09-19T07:14:23.564 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-6.jpg" 2024-09-19T07:14:23.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.564 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.564 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.564 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3584834069, 2024-09-19T07:14:23.564 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628802, 2024-09-19T07:14:23.564 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-37.xml" 2024-09-19T07:14:23.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.565 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.565 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3588967807, 2024-09-19T07:14:23.565 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628703, 2024-09-19T07:14:23.565 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-78.xml" 2024-09-19T07:14:23.565 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.565 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.565 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3590079333, 2024-09-19T07:14:23.565 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630646, 2024-09-19T07:14:23.565 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-17.xml" 2024-09-19T07:14:23.565 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.565 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.566 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3592148281, 2024-09-19T07:14:23.566 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628984, 2024-09-19T07:14:23.566 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-64.jpg" 2024-09-19T07:14:23.566 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.566 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.566 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.566 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3597182177, 2024-09-19T07:14:23.566 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628975, 2024-09-19T07:14:23.566 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-67.jpg" 2024-09-19T07:14:23.566 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.566 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.566 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.566 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3597552730, 2024-09-19T07:14:23.567 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629858, 2024-09-19T07:14:23.567 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-17.xml" 2024-09-19T07:14:23.567 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.567 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.567 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.567 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3603582942, 2024-09-19T07:14:23.567 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629795, 2024-09-19T07:14:23.567 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-17.jpg" 2024-09-19T07:14:23.567 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.567 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.567 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.567 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3604111143, 2024-09-19T07:14:23.567 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631325, 2024-09-19T07:14:23.568 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-68.xml" 2024-09-19T07:14:23.568 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.568 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.568 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.568 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3607308424, 2024-09-19T07:14:23.568 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630685, 2024-09-19T07:14:23.568 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-4.xml" 2024-09-19T07:14:23.568 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.568 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.568 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.568 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3620804445, 2024-09-19T07:14:23.568 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630443, 2024-09-19T07:14:23.568 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-23.xml" 2024-09-19T07:14:23.569 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.569 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.569 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.569 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3651458808, 2024-09-19T07:14:23.569 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630409, 2024-09-19T07:14:23.569 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-33.xml" 2024-09-19T07:14:23.569 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.569 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.569 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.569 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3660181362, 2024-09-19T07:14:23.569 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628993, 2024-09-19T07:14:23.569 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-61.jpg" 2024-09-19T07:14:23.569 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.570 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.570 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3669563439, 2024-09-19T07:14:23.570 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630571, 2024-09-19T07:14:23.570 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-7.jpg" 2024-09-19T07:14:23.570 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.570 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.570 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3672700731, 2024-09-19T07:14:23.570 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631510, 2024-09-19T07:14:23.570 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-19.xml" 2024-09-19T07:14:23.570 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.570 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.571 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3672945425, 2024-09-19T07:14:23.571 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631750, 2024-09-19T07:14:23.571 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-6.xml" 2024-09-19T07:14:23.571 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.571 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.571 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3674204490, 2024-09-19T07:14:23.571 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629491, 2024-09-19T07:14:23.571 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-27.xml" 2024-09-19T07:14:23.571 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.571 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.571 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3675923675, 2024-09-19T07:14:23.572 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632482, 2024-09-19T07:14:23.572 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-58.jpg" 2024-09-19T07:14:23.572 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.572 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.572 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.572 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3689715070, 2024-09-19T07:14:23.572 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629367, 2024-09-19T07:14:23.572 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-67.xml" 2024-09-19T07:14:23.572 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.572 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.572 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.572 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3693246110, 2024-09-19T07:14:23.572 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629951, 2024-09-19T07:14:23.573 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-9.jpg" 2024-09-19T07:14:23.573 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.573 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.573 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.573 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3704885114, 2024-09-19T07:14:23.573 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628876, 2024-09-19T07:14:23.573 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-12.xml" 2024-09-19T07:14:23.573 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.573 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.573 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.573 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3713867971, 2024-09-19T07:14:23.573 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631260, 2024-09-19T07:14:23.573 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-10.xml" 2024-09-19T07:14:23.573 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.574 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.574 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.574 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3714673743, 2024-09-19T07:14:23.574 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632589, 2024-09-19T07:14:23.574 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-27.jpg" 2024-09-19T07:14:23.574 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.574 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.574 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.574 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3715386049, 2024-09-19T07:14:23.574 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632547, 2024-09-19T07:14:23.574 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-39.jpg" 2024-09-19T07:14:23.574 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.574 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.574 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.575 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3719908032, 2024-09-19T07:14:23.575 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631887, 2024-09-19T07:14:23.575 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-61.xml" 2024-09-19T07:14:23.575 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.575 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.575 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.575 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3724118325, 2024-09-19T07:14:23.575 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629215, 2024-09-19T07:14:23.575 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-6.jpg" 2024-09-19T07:14:23.575 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.575 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.575 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.576 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3733865061, 2024-09-19T07:14:23.576 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632377, 2024-09-19T07:14:23.576 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-10.jpg" 2024-09-19T07:14:23.576 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.576 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.576 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3745831637, 2024-09-19T07:14:23.576 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631626, 2024-09-19T07:14:23.576 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-86.xml" 2024-09-19T07:14:23.576 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.576 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.576 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3749792243, 2024-09-19T07:14:23.577 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630478, 2024-09-19T07:14:23.577 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-10.xml" 2024-09-19T07:14:23.577 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.577 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.577 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.577 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3751510063, 2024-09-19T07:14:23.577 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632412, 2024-09-19T07:14:23.577 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-4.jpg" 2024-09-19T07:14:23.577 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.577 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.577 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.577 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3754242016, 2024-09-19T07:14:23.577 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630544, 2024-09-19T07:14:23.578 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-16.jpg" 2024-09-19T07:14:23.578 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.578 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.578 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.578 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3767549149, 2024-09-19T07:14:23.578 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629854, 2024-09-19T07:14:23.578 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-18.xml" 2024-09-19T07:14:23.578 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.578 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.578 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.578 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3769405341, 2024-09-19T07:14:23.578 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632499, 2024-09-19T07:14:23.578 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-54.jpg" 2024-09-19T07:14:23.579 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.579 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.579 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.579 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3782987565, 2024-09-19T07:14:23.579 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631124, 2024-09-19T07:14:23.579 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-26.xml" 2024-09-19T07:14:23.579 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.579 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.579 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.579 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3789720046, 2024-09-19T07:14:23.579 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629805, 2024-09-19T07:14:23.579 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-29.xml" 2024-09-19T07:14:23.579 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.580 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.580 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3791001758, 2024-09-19T07:14:23.580 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629514, 2024-09-19T07:14:23.580 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-20.xml" 2024-09-19T07:14:23.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.580 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.580 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3793681032, 2024-09-19T07:14:23.580 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631793, 2024-09-19T07:14:23.580 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-78.xml" 2024-09-19T07:14:23.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.581 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.581 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3793785331, 2024-09-19T07:14:23.581 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628785, 2024-09-19T07:14:23.581 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-43.xml" 2024-09-19T07:14:23.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.581 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.581 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3805876046, 2024-09-19T07:14:23.581 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628988, 2024-09-19T07:14:23.581 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-63.jpg" 2024-09-19T07:14:23.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.581 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.582 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3807276676, 2024-09-19T07:14:23.582 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628861, 2024-09-19T07:14:23.582 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-17.xml" 2024-09-19T07:14:23.582 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.582 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.582 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3822044473, 2024-09-19T07:14:23.582 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629863, 2024-09-19T07:14:23.582 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-16.xml" 2024-09-19T07:14:23.582 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.582 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.582 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3826260885, 2024-09-19T07:14:23.583 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632431, 2024-09-19T07:14:23.583 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-70.jpg" 2024-09-19T07:14:23.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.583 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.583 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3837098608, 2024-09-19T07:14:23.583 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630667, 2024-09-19T07:14:23.583 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-10.xml" 2024-09-19T07:14:23.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.583 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.583 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3847054418, 2024-09-19T07:14:23.583 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630661, 2024-09-19T07:14:23.584 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-12.xml" 2024-09-19T07:14:23.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.584 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.584 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.584 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3855269329, 2024-09-19T07:14:23.584 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632303, 2024-09-19T07:14:23.584 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-14.xml" 2024-09-19T07:14:23.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.584 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.584 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.584 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3861002368, 2024-09-19T07:14:23.584 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631385, 2024-09-19T07:14:23.584 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-2.jpg" 2024-09-19T07:14:23.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.585 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.585 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3866664872, 2024-09-19T07:14:23.585 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632389, 2024-09-19T07:14:23.585 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-81.jpg" 2024-09-19T07:14:23.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.585 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.585 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3868534833, 2024-09-19T07:14:23.585 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628930, 2024-09-19T07:14:23.585 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-82.jpg" 2024-09-19T07:14:23.586 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.586 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.586 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.586 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3872504544, 2024-09-19T07:14:23.586 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629104, 2024-09-19T07:14:23.586 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-24.jpg" 2024-09-19T07:14:23.586 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.586 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.586 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.586 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3878382248, 2024-09-19T07:14:23.586 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632384, 2024-09-19T07:14:23.586 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-9.jpg" 2024-09-19T07:14:23.586 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.586 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.586 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.587 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3882207786, 2024-09-19T07:14:23.587 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628739, 2024-09-19T07:14:23.587 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-63.xml" 2024-09-19T07:14:23.587 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.587 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.587 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3898369925, 2024-09-19T07:14:23.587 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631583, 2024-09-19T07:14:23.587 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-8.jpg" 2024-09-19T07:14:23.587 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.587 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.587 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3902218296, 2024-09-19T07:14:23.587 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629635, 2024-09-19T07:14:23.588 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-68.xml" 2024-09-19T07:14:23.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.588 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.588 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.588 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3907185670, 2024-09-19T07:14:23.588 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630526, 2024-09-19T07:14:23.588 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-22.jpg" 2024-09-19T07:14:23.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.588 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.588 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.588 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3918304679, 2024-09-19T07:14:23.588 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628957, 2024-09-19T07:14:23.588 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-73.jpg" 2024-09-19T07:14:23.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.589 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.589 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3925658789, 2024-09-19T07:14:23.589 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629774, 2024-09-19T07:14:23.589 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-35.xml" 2024-09-19T07:14:23.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.589 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.589 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3925798479, 2024-09-19T07:14:23.589 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631095, 2024-09-19T07:14:23.589 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-37.xml" 2024-09-19T07:14:23.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.590 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.590 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3926150877, 2024-09-19T07:14:23.590 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630466, 2024-09-19T07:14:23.590 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-14.xml" 2024-09-19T07:14:23.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.590 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.590 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3935922238, 2024-09-19T07:14:23.590 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630431, 2024-09-19T07:14:23.590 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-27.xml" 2024-09-19T07:14:23.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.590 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.590 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3936857871, 2024-09-19T07:14:23.591 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631545, 2024-09-19T07:14:23.591 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-7.xml" 2024-09-19T07:14:23.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.591 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.591 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.591 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3938060402, 2024-09-19T07:14:23.591 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629892, 2024-09-19T07:14:23.591 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-8.xml" 2024-09-19T07:14:23.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.591 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.591 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.591 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3944953893, 2024-09-19T07:14:23.591 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629018, 2024-09-19T07:14:23.591 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-53.jpg" 2024-09-19T07:14:23.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.592 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.592 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.592 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3954584176, 2024-09-19T07:14:23.592 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628981, 2024-09-19T07:14:23.592 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-65.jpg" 2024-09-19T07:14:23.592 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.592 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.592 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.592 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3960139644, 2024-09-19T07:14:23.592 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628843, 2024-09-19T07:14:23.592 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-23.xml" 2024-09-19T07:14:23.592 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.592 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.592 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.593 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3963762206, 2024-09-19T07:14:23.593 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630559, 2024-09-19T07:14:23.593 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-11.jpg" 2024-09-19T07:14:23.593 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.593 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.593 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.593 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3968772660, 2024-09-19T07:14:23.593 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631954, 2024-09-19T07:14:23.593 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-49.xml" 2024-09-19T07:14:23.593 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.593 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.593 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.593 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3983103426, 2024-09-19T07:14:23.594 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630496, 2024-09-19T07:14:23.594 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-4.xml" 2024-09-19T07:14:23.594 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.594 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.594 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3986848208, 2024-09-19T07:14:23.594 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629433, 2024-09-19T07:14:23.594 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-45.xml" 2024-09-19T07:14:23.594 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.594 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.594 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3988324165, 2024-09-19T07:14:23.594 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632610, 2024-09-19T07:14:23.594 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-22.jpg" 2024-09-19T07:14:23.595 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.595 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.595 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.595 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4001005461, 2024-09-19T07:14:23.595 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628990, 2024-09-19T07:14:23.595 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-62.jpg" 2024-09-19T07:14:23.595 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.595 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.595 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.595 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4004680406, 2024-09-19T07:14:23.595 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632005, 2024-09-19T07:14:23.595 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-44.xml" 2024-09-19T07:14:23.595 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.596 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.596 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4009688486, 2024-09-19T07:14:23.596 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628737, 2024-09-19T07:14:23.596 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-64.xml" 2024-09-19T07:14:23.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.596 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.596 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4022152615, 2024-09-19T07:14:23.596 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631540, 2024-09-19T07:14:23.596 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-9.xml" 2024-09-19T07:14:23.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.596 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.597 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4029108780, 2024-09-19T07:14:23.597 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630742, 2024-09-19T07:14:23.597 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-2.jpg" 2024-09-19T07:14:23.597 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.597 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.597 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.597 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4029379799, 2024-09-19T07:14:23.597 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631905, 2024-09-19T07:14:23.597 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-56.xml" 2024-09-19T07:14:23.597 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.597 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.597 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.597 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4036845350, 2024-09-19T07:14:23.598 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628707, 2024-09-19T07:14:23.598 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-77.xml" 2024-09-19T07:14:23.598 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.598 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.598 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4039030210, 2024-09-19T07:14:23.598 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631255, 2024-09-19T07:14:23.598 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-15.xml" 2024-09-19T07:14:23.598 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.598 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.598 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4051461997, 2024-09-19T07:14:23.598 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629915, 2024-09-19T07:14:23.598 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-2.xml" 2024-09-19T07:14:23.598 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.599 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.599 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4052309520, 2024-09-19T07:14:23.599 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630532, 2024-09-19T07:14:23.599 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-20.jpg" 2024-09-19T07:14:23.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.599 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.599 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4055209433, 2024-09-19T07:14:23.599 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629509, 2024-09-19T07:14:23.599 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-22.xml" 2024-09-19T07:14:23.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.600 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.600 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4058615367, 2024-09-19T07:14:23.600 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628741, 2024-09-19T07:14:23.600 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-62.xml" 2024-09-19T07:14:23.600 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.600 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.600 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.600 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4067529605, 2024-09-19T07:14:23.600 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632351, 2024-09-19T07:14:23.600 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-18.jpg" 2024-09-19T07:14:23.600 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.601 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.601 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.601 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4073673989, 2024-09-19T07:14:23.601 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628924, 2024-09-19T07:14:23.601 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-84.jpg" 2024-09-19T07:14:23.601 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.601 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.601 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.601 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4089076078, 2024-09-19T07:14:23.601 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631971, 2024-09-19T07:14:23.601 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-47.xml" 2024-09-19T07:14:23.601 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.601 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.602 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.602 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4106441540, 2024-09-19T07:14:23.602 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630462, 2024-09-19T07:14:23.602 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-16.xml" 2024-09-19T07:14:23.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.602 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.602 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4114921882, 2024-09-19T07:14:23.602 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629475, 2024-09-19T07:14:23.602 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-31.xml" 2024-09-19T07:14:23.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.603 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.603 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4122183217, 2024-09-19T07:14:23.603 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630427, 2024-09-19T07:14:23.603 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-28.xml" 2024-09-19T07:14:23.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.603 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.603 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4123536027, 2024-09-19T07:14:23.603 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628780, 2024-09-19T07:14:23.603 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-45.xml" 2024-09-19T07:14:23.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.603 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.604 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4141587894, 2024-09-19T07:14:23.604 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631580, 2024-09-19T07:14:23.604 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-9.jpg" 2024-09-19T07:14:23.604 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.604 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.604 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.604 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4151108787, 2024-09-19T07:14:23.604 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631855, 2024-09-19T07:14:23.604 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-68.xml" 2024-09-19T07:14:23.604 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.604 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.604 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.605 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4159296681, 2024-09-19T07:14:23.605 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632100, 2024-09-19T07:14:23.605 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-36.xml" 2024-09-19T07:14:23.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.605 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.605 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4159898041, 2024-09-19T07:14:23.605 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629662, 2024-09-19T07:14:23.605 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-62.xml" 2024-09-19T07:14:23.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.606 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.606 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4160894151, 2024-09-19T07:14:23.606 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629745, 2024-09-19T07:14:23.606 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-68.xml" 2024-09-19T07:14:23.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.606 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.606 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4163012947, 2024-09-19T07:14:23.606 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631122, 2024-09-19T07:14:23.606 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-27.xml" 2024-09-19T07:14:23.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.607 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.607 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.607 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4164181022, 2024-09-19T07:14:23.607 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632189, 2024-09-19T07:14:23.607 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-27.xml" 2024-09-19T07:14:23.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.607 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.607 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.607 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4165428061, 2024-09-19T07:14:23.607 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629394, 2024-09-19T07:14:23.607 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-58.xml" 2024-09-19T07:14:23.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.608 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.608 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4170282207, 2024-09-19T07:14:23.608 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630691, 2024-09-19T07:14:23.608 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-2.xml" 2024-09-19T07:14:23.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.608 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.608 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4170478785, 2024-09-19T07:14:23.608 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631050, 2024-09-19T07:14:23.608 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-52.xml" 2024-09-19T07:14:23.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.609 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.609 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.609 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4189806667, 2024-09-19T07:14:23.609 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631267, 2024-09-19T07:14:23.609 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-3.xml" 2024-09-19T07:14:23.609 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.609 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.609 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.609 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4190672213, 2024-09-19T07:14:23.609 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632370, 2024-09-19T07:14:23.609 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-12.jpg" 2024-09-19T07:14:23.609 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.609 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.610 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.610 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4191339956, 2024-09-19T07:14:23.610 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629039, 2024-09-19T07:14:23.610 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-46.jpg" 2024-09-19T07:14:23.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.610 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.610 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4192040363, 2024-09-19T07:14:23.610 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629825, 2024-09-19T07:14:23.610 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-25.xml" 2024-09-19T07:14:23.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.610 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.611 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4195165644, 2024-09-19T07:14:23.611 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632564, 2024-09-19T07:14:23.611 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-9.xml" 2024-09-19T07:14:23.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.611 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.611 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4198602344, 2024-09-19T07:14:23.611 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630454, 2024-09-19T07:14:23.611 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-19.xml" 2024-09-19T07:14:23.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.611 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.611 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4213430859, 2024-09-19T07:14:23.611 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629719, 2024-09-19T07:14:23.612 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-47.xml" 2024-09-19T07:14:23.612 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.612 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.612 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.612 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4220622707, 2024-09-19T07:14:23.612 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631535, 2024-09-19T07:14:23.612 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-11.xml" 2024-09-19T07:14:23.612 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.612 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.612 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.612 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4223862551, 2024-09-19T07:14:23.612 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631828, 2024-09-19T07:14:23.612 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-73.xml" 2024-09-19T07:14:23.612 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.613 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.613 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.613 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4232944703, 2024-09-19T07:14:23.613 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629611, 2024-09-19T07:14:23.613 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-72.xml" 2024-09-19T07:14:23.613 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.613 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.613 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.613 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4239632043, 2024-09-19T07:14:23.613 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630547, 2024-09-19T07:14:23.613 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-15.jpg" 2024-09-19T07:14:23.613 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.614 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.614 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.614 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4245494876, 2024-09-19T07:14:23.614 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629011, 2024-09-19T07:14:23.614 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-55.jpg" 2024-09-19T07:14:23.614 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.614 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.614 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.614 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4245758244, 2024-09-19T07:14:23.614 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631032, 2024-09-19T07:14:23.614 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-58.xml" 2024-09-19T07:14:23.614 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.614 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.614 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.615 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4249059141, 2024-09-19T07:14:23.615 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630290, 2024-09-19T07:14:23.615 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-99.xml" 2024-09-19T07:14:23.615 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.615 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.615 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.615 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4255855793, 2024-09-19T07:14:23.615 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629505, 2024-09-19T07:14:23.615 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-23.xml" 2024-09-19T07:14:23.615 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.615 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.615 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.615 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4263705615, 2024-09-19T07:14:23.615 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629959, 2024-09-19T07:14:23.616 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-7.jpg" 2024-09-19T07:14:23.616 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.616 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.616 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4273628319, 2024-09-19T07:14:23.616 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629657, 2024-09-19T07:14:23.616 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-24.jpg" 2024-09-19T07:14:23.616 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.616 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.616 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4280312454, 2024-09-19T07:14:23.616 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631590, 2024-09-19T07:14:23.616 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-5.jpg" 2024-09-19T07:14:23.616 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:23.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:23.617 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:23.617 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4281378561, 2024-09-19T07:14:23.617 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628926, 2024-09-19T07:14:23.617 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-83.jpg" 2024-09-19T07:14:23.617 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:14:23.617 INFO:teuthology.orchestra.run.smithi148.stdout:] 2024-09-19T07:14:24.799 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T07:14:25.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:24 smithi148 ceph-mon[31180]: pgmap v103: 97 pgs: 97 active+clean; 308 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 385 op/s 2024-09-19T07:14:25.086 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:14:25.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:24 smithi165 ceph-mon[35326]: pgmap v103: 97 pgs: 97 active+clean; 308 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 385 op/s 2024-09-19T07:14:25.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:24 smithi179 ceph-mon[35716]: pgmap v103: 97 pgs: 97 active+clean; 308 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 385 op/s 2024-09-19T07:14:25.676 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.672+0000 7f83b0f62640 1 -- 172.21.15.148:0/516495135 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83ac1082a0 msgr2=0x7f83ac10ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:25.676 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.672+0000 7f83b0f62640 1 --2- 172.21.15.148:0/516495135 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83ac1082a0 0x7f83ac10ec40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f83a4009be0 tx=0x7f83a402a6c0 comp rx=0 tx=0).stop 2024-09-19T07:14:25.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.673+0000 7f83b0f62640 1 -- 172.21.15.148:0/516495135 shutdown_connections 2024-09-19T07:14:25.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.673+0000 7f83b0f62640 1 --2- 172.21.15.148:0/516495135 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83ac1082a0 0x7f83ac10ec40 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:25.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.673+0000 7f83b0f62640 1 --2- 172.21.15.148:0/516495135 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f83ac1036e0 0x7f83ac107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:25.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.673+0000 7f83b0f62640 1 --2- 172.21.15.148:0/516495135 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83ac102d30 0x7f83ac103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:25.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.673+0000 7f83b0f62640 1 -- 172.21.15.148:0/516495135 >> 172.21.15.148:0/516495135 conn(0x7f83ac0fc7d0 msgr2=0x7f83ac0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:25.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.673+0000 7f83b0f62640 1 -- 172.21.15.148:0/516495135 shutdown_connections 2024-09-19T07:14:25.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.673+0000 7f83b0f62640 1 -- 172.21.15.148:0/516495135 wait complete. 2024-09-19T07:14:25.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.673+0000 7f83b0f62640 1 Processor -- start 2024-09-19T07:14:25.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.673+0000 7f83b0f62640 1 -- start start 2024-09-19T07:14:25.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.674+0000 7f83b0f62640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83ac102d30 0x7f83ac1985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:25.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.674+0000 7f83b0f62640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83ac1036e0 0x7f83ac198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:25.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.674+0000 7f83b0f62640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f83ac1082a0 0x7f83ac19cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:25.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.674+0000 7f83b0f62640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f83ac112050 con 0x7f83ac102d30 2024-09-19T07:14:25.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.674+0000 7f83b0f62640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f83ac111ed0 con 0x7f83ac1082a0 2024-09-19T07:14:25.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.674+0000 7f83b0f62640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f83ac1121d0 con 0x7f83ac1036e0 2024-09-19T07:14:25.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.674+0000 7f83aa59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83ac102d30 0x7f83ac1985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:25.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.674+0000 7f83a9d9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83ac1036e0 0x7f83ac198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:25.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.674+0000 7f83a9d9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83ac1036e0 0x7f83ac198b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:49928/0 (socket says 172.21.15.148:49928) 2024-09-19T07:14:25.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.674+0000 7f83aa59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83ac102d30 0x7f83ac1985d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35342/0 (socket says 172.21.15.148:35342) 2024-09-19T07:14:25.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.674+0000 7f83aad9d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f83ac1082a0 0x7f83ac19cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:25.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.674+0000 7f83a9d9b640 1 -- 172.21.15.148:0/677246930 learned_addr learned my addr 172.21.15.148:0/677246930 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:14:25.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.674+0000 7f83a9d9b640 1 -- 172.21.15.148:0/677246930 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f83ac1082a0 msgr2=0x7f83ac19cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:25.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.674+0000 7f83a9d9b640 1 --2- 172.21.15.148:0/677246930 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f83ac1082a0 0x7f83ac19cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:25.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.674+0000 7f83a9d9b640 1 -- 172.21.15.148:0/677246930 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83ac102d30 msgr2=0x7f83ac1985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:25.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.674+0000 7f83a9d9b640 1 --2- 172.21.15.148:0/677246930 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83ac102d30 0x7f83ac1985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:25.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.674+0000 7f83a9d9b640 1 -- 172.21.15.148:0/677246930 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83ac19d580 con 0x7f83ac1036e0 2024-09-19T07:14:25.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.674+0000 7f83a9d9b640 1 --2- 172.21.15.148:0/677246930 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83ac1036e0 0x7f83ac198b10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f83a000e9c0 tx=0x7f83a000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:25.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.674+0000 7f839b7fe640 1 -- 172.21.15.148:0/677246930 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a000ccc0 con 0x7f83ac1036e0 2024-09-19T07:14:25.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.675+0000 7f839b7fe640 1 -- 172.21.15.148:0/677246930 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83a0005500 con 0x7f83ac1036e0 2024-09-19T07:14:25.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.675+0000 7f83b0f62640 1 -- 172.21.15.148:0/677246930 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83ac19d870 con 0x7f83ac1036e0 2024-09-19T07:14:25.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.675+0000 7f839b7fe640 1 -- 172.21.15.148:0/677246930 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a0010690 con 0x7f83ac1036e0 2024-09-19T07:14:25.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.675+0000 7f83b0f62640 1 -- 172.21.15.148:0/677246930 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83ac1a5150 con 0x7f83ac1036e0 2024-09-19T07:14:25.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.677+0000 7f839b7fe640 1 -- 172.21.15.148:0/677246930 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f83a0004e80 con 0x7f83ac1036e0 2024-09-19T07:14:25.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.677+0000 7f83b333b740 1 Processor -- start 2024-09-19T07:14:25.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.677+0000 7f83b333b740 1 -- start start 2024-09-19T07:14:25.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.677+0000 7f83b333b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1e2eebb40 0x55e1e2eea090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:25.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.678+0000 7f83b333b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e1e2eea5d0 0x55e1e2eeaa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:25.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.678+0000 7f83b333b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1e2ef5370 0x55e1e2ef7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:25.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.678+0000 7f83b333b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55e1e2e502f0 con 0x55e1e2ef5370 2024-09-19T07:14:25.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.678+0000 7f83b333b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55e1e2df7cf0 con 0x55e1e2eea5d0 2024-09-19T07:14:25.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.678+0000 7f83b333b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55e1e2e4c2b0 con 0x55e1e2eebb40 2024-09-19T07:14:25.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.678+0000 7f839b7fe640 1 --2- 172.21.15.148:0/677246930 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f83940a33b0 0x7f83940a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:25.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.678+0000 7f83a9d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1e2ef5370 0x55e1e2ef7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:25.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.678+0000 7f83aad9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1e2eebb40 0x55e1e2eea090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:25.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.678+0000 7f83aa59c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e1e2eea5d0 0x55e1e2eeaa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:25.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.678+0000 7f83aa59c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e1e2eea5d0 0x55e1e2eeaa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:40108/0 (socket says 172.21.15.148:40108) 2024-09-19T07:14:25.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.678+0000 7f83aa59c640 1 -- 172.21.15.148:0/3785733830 learned_addr learned my addr 172.21.15.148:0/3785733830 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:14:25.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.678+0000 7f839b7fe640 1 -- 172.21.15.148:0/677246930 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f83a00d00b0 con 0x7f83ac1036e0 2024-09-19T07:14:25.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.678+0000 7f83aad9d640 1 --2- 172.21.15.148:0/677246930 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f83940a33b0 0x7f83940a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:25.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.678+0000 7f83aa59c640 1 -- 172.21.15.148:0/3785733830 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1e2eebb40 msgr2=0x55e1e2eea090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:25.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.678+0000 7f83aa59c640 1 --2- 172.21.15.148:0/3785733830 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1e2eebb40 0x55e1e2eea090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:25.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.678+0000 7f83aa59c640 1 -- 172.21.15.148:0/3785733830 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1e2ef5370 msgr2=0x55e1e2ef7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:25.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.678+0000 7f83aa59c640 1 --2- 172.21.15.148:0/3785733830 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1e2ef5370 0x55e1e2ef7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:25.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.678+0000 7f83aa59c640 1 -- 172.21.15.148:0/3785733830 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1e2ddc3a0 con 0x55e1e2eea5d0 2024-09-19T07:14:25.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.678+0000 7f83aad9d640 1 --2- 172.21.15.148:0/3785733830 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1e2eebb40 0x55e1e2eea090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:14:25.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.678+0000 7f83aa59c640 1 --2- 172.21.15.148:0/3785733830 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e1e2eea5d0 0x55e1e2eeaa10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f839c009cc0 tx=0x7f839c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5f7b1823972939a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:25.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.679+0000 7f83aad9d640 1 --2- 172.21.15.148:0/677246930 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f83940a33b0 0x7f83940a5870 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f83a4005f00 tx=0x7f83a402a6c0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:25.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.679+0000 7f8398ff9640 1 -- 172.21.15.148:0/3785733830 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c005220 con 0x55e1e2eea5d0 2024-09-19T07:14:25.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.679+0000 7f8398ff9640 1 -- 172.21.15.148:0/3785733830 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f839c004c80 con 0x55e1e2eea5d0 2024-09-19T07:14:25.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.679+0000 7f8398ff9640 1 -- 172.21.15.148:0/3785733830 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c0197d0 con 0x55e1e2eea5d0 2024-09-19T07:14:25.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.679+0000 7f83b333b740 1 -- 172.21.15.148:0/3785733830 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e1e2eea5d0 msgr2=0x55e1e2eeaa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:25.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.679+0000 7f83b333b740 1 --2- 172.21.15.148:0/3785733830 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e1e2eea5d0 0x55e1e2eeaa10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f839c009cc0 tx=0x7f839c011810 comp rx=0 tx=0).stop 2024-09-19T07:14:25.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.680+0000 7f83b333b740 1 -- 172.21.15.148:0/3785733830 shutdown_connections 2024-09-19T07:14:25.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.680+0000 7f83b333b740 1 --2- 172.21.15.148:0/3785733830 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1e2ef5370 0x55e1e2ef7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:25.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.680+0000 7f83b333b740 1 --2- 172.21.15.148:0/3785733830 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e1e2eea5d0 0x55e1e2eeaa10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:25.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.680+0000 7f83b333b740 1 --2- 172.21.15.148:0/3785733830 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1e2eebb40 0x55e1e2eea090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:25.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.680+0000 7f83b333b740 1 -- 172.21.15.148:0/3785733830 >> 172.21.15.148:0/3785733830 conn(0x55e1e2eb3310 msgr2=0x55e1e2ee6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:25.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.680+0000 7f83b333b740 1 -- 172.21.15.148:0/3785733830 shutdown_connections 2024-09-19T07:14:25.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.680+0000 7f83b333b740 1 -- 172.21.15.148:0/3785733830 wait complete. 2024-09-19T07:14:25.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.680+0000 7f83b333b740 1 -- start start 2024-09-19T07:14:25.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.680+0000 7f83b333b740 1 Processor -- start 2024-09-19T07:14:25.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.680+0000 7f83b333b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1e2eea5d0 0x55e1e2ef4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:25.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.680+0000 7f83b333b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1e2eebb40 0x55e1e2ef1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:25.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.680+0000 7f83b333b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e1e2ef5370 0x55e1e2ef2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:25.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.680+0000 7f83b333b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55e1e2efc480 con 0x55e1e2eea5d0 2024-09-19T07:14:25.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.681+0000 7f83b333b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55e1e2e0b060 con 0x55e1e2ef5370 2024-09-19T07:14:25.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.681+0000 7f83b333b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55e1e2efc600 con 0x55e1e2eebb40 2024-09-19T07:14:25.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.681+0000 7f83a9d9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1e2eebb40 0x55e1e2ef1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:25.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.681+0000 7f83aa59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1e2eea5d0 0x55e1e2ef4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:25.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.681+0000 7f83a9d9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1e2eebb40 0x55e1e2ef1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:49942/0 (socket says 172.21.15.148:49942) 2024-09-19T07:14:25.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.681+0000 7f83a9d9b640 1 -- 172.21.15.148:0/584334578 learned_addr learned my addr 172.21.15.148:0/584334578 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:14:25.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.681+0000 7f83b333b740 10 client.0 _ll_register_callbacks cb 0x55e1e2b5e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:14:25.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.681+0000 7f83aad9d640 1 --2- 172.21.15.148:0/584334578 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e1e2ef5370 0x55e1e2ef2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:25.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.681+0000 7f83a9d9b640 1 -- 172.21.15.148:0/584334578 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e1e2ef5370 msgr2=0x55e1e2ef2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:25.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.681+0000 7f83a9d9b640 1 --2- 172.21.15.148:0/584334578 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e1e2ef5370 0x55e1e2ef2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:25.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.681+0000 7f83a9d9b640 1 -- 172.21.15.148:0/584334578 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1e2eea5d0 msgr2=0x55e1e2ef4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:25.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.681+0000 7f83a9d9b640 1 --2- 172.21.15.148:0/584334578 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1e2eea5d0 0x55e1e2ef4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:25.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.681+0000 7f83a9d9b640 1 -- 172.21.15.148:0/584334578 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1e2bc13c0 con 0x55e1e2eebb40 2024-09-19T07:14:25.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.681+0000 7f83a9d9b640 1 --2- 172.21.15.148:0/584334578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1e2eebb40 0x55e1e2ef1fc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f83a0009770 tx=0x7f83a006b050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f226c3fb558223b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:25.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.681+0000 7f8391ffb640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-19T07:14:25.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.681+0000 7f8391ffb640 1 -- 172.21.15.148:0/584334578 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a000ce60 con 0x55e1e2eebb40 2024-09-19T07:14:25.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.681+0000 7f8391ffb640 1 -- 172.21.15.148:0/584334578 <== mon.1 v2:172.21.15.179:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f83a00cda50 con 0x55e1e2eebb40 2024-09-19T07:14:25.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.681+0000 7f83b333b740 1 -- 172.21.15.148:0/584334578 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f839c004c80 con 0x55e1e2eebb40 2024-09-19T07:14:25.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.682+0000 7f8391ffb640 1 -- 172.21.15.148:0/584334578 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f83a00cdc50 con 0x55e1e2eebb40 2024-09-19T07:14:25.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.682+0000 7f83b333b740 10 client.25690 fetch_fsmap learned FSMap version 31 2024-09-19T07:14:25.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.682+0000 7f83b333b740 1 -- 172.21.15.148:0/584334578 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55e1e2f07f30 con 0x55e1e2eebb40 2024-09-19T07:14:25.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.682+0000 7f8391ffb640 1 -- 172.21.15.148:0/584334578 <== mon.1 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f839c004c80 con 0x55e1e2eebb40 2024-09-19T07:14:25.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.682+0000 7f8391ffb640 1 -- 172.21.15.148:0/584334578 <== mon.1 v2:172.21.15.179:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f83a0066dc0 con 0x55e1e2eebb40 2024-09-19T07:14:25.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.682+0000 7f83b333b740 10 client.25690 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:14:25.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.682+0000 7f83b333b740 10 client.25690 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T07:14:25.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.682+0000 7f83b333b740 20 client.25690 populate_metadata read hostname 'smithi148' 2024-09-19T07:14:25.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.682+0000 7f83b333b740 1 --2- 172.21.15.148:0/584334578 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x55e1e2f092d0 0x55e1e2f0b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:25.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.682+0000 7f83b333b740 4 client.25690 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:14:25.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.682+0000 7f83b333b740 1 -- 172.21.15.148:0/584334578 --> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e1e2e5d860 con 0x55e1e2f092d0 2024-09-19T07:14:25.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.682+0000 7f83aa59c640 1 --2- 172.21.15.148:0/584334578 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x55e1e2f092d0 0x55e1e2f0b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:25.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.683+0000 7f83aa59c640 1 --2- 172.21.15.148:0/584334578 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x55e1e2f092d0 0x55e1e2f0b700 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=437945f28fdc670 server_cookie=1b42c2cc0afb1095 in_seq=0 out_seq=0 2024-09-19T07:14:25.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.683+0000 7f8391ffb640 10 client.25690 ms_handle_connect on v2:172.21.15.165:6838/3993490234 2024-09-19T07:14:25.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.683+0000 7f8391ffb640 1 -- 172.21.15.148:0/584334578 <== mds.1 v2:172.21.15.165:6838/3993490234 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e1e2e5d860 con 0x55e1e2f092d0 2024-09-19T07:14:25.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.683+0000 7f8391ffb640 10 client.25690 handle_command_reply: tid=0 2024-09-19T07:14:25.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.683+0000 7f83b333b740 1 client.25690 shutdown 2024-09-19T07:14:25.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.683+0000 7f83b333b740 1 -- 172.21.15.148:0/584334578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1e2eebb40 msgr2=0x55e1e2ef1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:25.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.683+0000 7f83b333b740 1 --2- 172.21.15.148:0/584334578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1e2eebb40 0x55e1e2ef1fc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f83a0009770 tx=0x7f83a006b050 comp rx=0 tx=0).stop 2024-09-19T07:14:25.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.684+0000 7f83b333b740 1 -- 172.21.15.148:0/584334578 shutdown_connections 2024-09-19T07:14:25.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.684+0000 7f83b333b740 1 --2- 172.21.15.148:0/584334578 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x55e1e2f092d0 0x55e1e2f0b700 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:25.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.684+0000 7f83b333b740 1 --2- 172.21.15.148:0/584334578 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e1e2ef5370 0x55e1e2ef2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:25.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.684+0000 7f83b333b740 1 --2- 172.21.15.148:0/584334578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1e2eebb40 0x55e1e2ef1fc0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:25.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.684+0000 7f83b333b740 1 --2- 172.21.15.148:0/584334578 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1e2eea5d0 0x55e1e2ef4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:25.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.684+0000 7f83b333b740 1 -- 172.21.15.148:0/584334578 >> 172.21.15.148:0/584334578 conn(0x55e1e2eb3310 msgr2=0x55e1e2eec960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:25.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.684+0000 7f8391ffb640 0 client.25690 ms_handle_reset on v2:172.21.15.165:6838/3993490234 2024-09-19T07:14:25.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.684+0000 7f83b333b740 1 -- 172.21.15.148:0/584334578 shutdown_connections 2024-09-19T07:14:25.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.684+0000 7f83b333b740 1 -- 172.21.15.148:0/584334578 wait complete. 2024-09-19T07:14:25.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.684+0000 7f83b333b740 20 client.25690 trim_cache size 0 max 16384 2024-09-19T07:14:25.699 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.698+0000 7f83b333b740 1 Processor -- start 2024-09-19T07:14:25.699 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.698+0000 7f83b333b740 1 -- start start 2024-09-19T07:14:25.699 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.698+0000 7f83b333b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1e2eea5d0 0x55e1e2f05720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:25.699 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.698+0000 7f83b333b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e1e2eebb40 0x55e1e2ef0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:25.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.698+0000 7f83b333b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1e2ef5370 0x55e1e2f10fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:25.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.698+0000 7f83b333b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f83ac1adf80 con 0x55e1e2eea5d0 2024-09-19T07:14:25.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.698+0000 7f83b333b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f83ac1ab850 con 0x55e1e2eebb40 2024-09-19T07:14:25.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.698+0000 7f83b333b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f83ac1a96c0 con 0x55e1e2ef5370 2024-09-19T07:14:25.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.698+0000 7f83aa59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1e2eea5d0 0x55e1e2f05720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:25.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.698+0000 7f83aa59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1e2eea5d0 0x55e1e2f05720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35368/0 (socket says 172.21.15.148:35368) 2024-09-19T07:14:25.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.698+0000 7f83aa59c640 1 -- 172.21.15.148:0/1220153249 learned_addr learned my addr 172.21.15.148:0/1220153249 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:14:25.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.698+0000 7f83aad9d640 1 --2- 172.21.15.148:0/1220153249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1e2ef5370 0x55e1e2f10fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:25.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.698+0000 7f83a9d9b640 1 --2- 172.21.15.148:0/1220153249 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e1e2eebb40 0x55e1e2ef0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:25.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.699+0000 7f83aa59c640 1 -- 172.21.15.148:0/1220153249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1e2ef5370 msgr2=0x55e1e2f10fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:25.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.699+0000 7f83aa59c640 1 --2- 172.21.15.148:0/1220153249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1e2ef5370 0x55e1e2f10fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:25.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.699+0000 7f83aa59c640 1 -- 172.21.15.148:0/1220153249 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e1e2eebb40 msgr2=0x55e1e2ef0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:25.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.699+0000 7f83aa59c640 1 --2- 172.21.15.148:0/1220153249 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e1e2eebb40 0x55e1e2ef0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:25.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.699+0000 7f83aa59c640 1 -- 172.21.15.148:0/1220153249 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1e2ef5040 con 0x55e1e2eea5d0 2024-09-19T07:14:25.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.699+0000 7f83a9d9b640 1 --2- 172.21.15.148:0/1220153249 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e1e2eebb40 0x55e1e2ef0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:14:25.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.699+0000 7f83aa59c640 1 --2- 172.21.15.148:0/1220153249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1e2eea5d0 0x55e1e2f05720 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f839c009a50 tx=0x7f839c0056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cee9fdc58ca6758 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:25.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.699+0000 7f8393fff640 1 -- 172.21.15.148:0/1220153249 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c034070 con 0x55e1e2eea5d0 2024-09-19T07:14:25.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.699+0000 7f8393fff640 1 -- 172.21.15.148:0/1220153249 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f839c004b40 con 0x55e1e2eea5d0 2024-09-19T07:14:25.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.699+0000 7f8393fff640 1 -- 172.21.15.148:0/1220153249 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c02e670 con 0x55e1e2eea5d0 2024-09-19T07:14:25.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.700+0000 7f83b333b740 1 -- 172.21.15.148:0/1220153249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1e2eea5d0 msgr2=0x55e1e2f05720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:25.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.700+0000 7f83b333b740 1 --2- 172.21.15.148:0/1220153249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1e2eea5d0 0x55e1e2f05720 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f839c009a50 tx=0x7f839c0056e0 comp rx=0 tx=0).stop 2024-09-19T07:14:25.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.700+0000 7f83b333b740 1 -- 172.21.15.148:0/1220153249 shutdown_connections 2024-09-19T07:14:25.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.700+0000 7f83b333b740 1 --2- 172.21.15.148:0/1220153249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1e2ef5370 0x55e1e2f10fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:25.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.700+0000 7f83b333b740 1 --2- 172.21.15.148:0/1220153249 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e1e2eebb40 0x55e1e2ef0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:25.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.700+0000 7f83b333b740 1 --2- 172.21.15.148:0/1220153249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1e2eea5d0 0x55e1e2f05720 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:25.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.700+0000 7f83b333b740 1 -- 172.21.15.148:0/1220153249 >> 172.21.15.148:0/1220153249 conn(0x55e1e2eb3310 msgr2=0x55e1e2ef0890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:25.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.700+0000 7f83b333b740 1 -- 172.21.15.148:0/1220153249 shutdown_connections 2024-09-19T07:14:25.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.700+0000 7f83b333b740 1 -- 172.21.15.148:0/1220153249 wait complete. 2024-09-19T07:14:25.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.700+0000 7f83b333b740 1 -- start start 2024-09-19T07:14:25.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.700+0000 7f83b333b740 1 Processor -- start 2024-09-19T07:14:25.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.701+0000 7f83b333b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e1e2eea5d0 0x55e1e2f01fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:25.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.701+0000 7f83b333b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1e2eebb40 0x55e1e2eeed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:25.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.701+0000 7f83b333b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1e2ef5370 0x55e1e2eef2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:25.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.701+0000 7f83b333b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f83ac1a9d10 con 0x55e1e2eebb40 2024-09-19T07:14:25.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.701+0000 7f83b333b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f83ac1ab180 con 0x55e1e2eea5d0 2024-09-19T07:14:25.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.701+0000 7f83b333b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f83ac1aa3e0 con 0x55e1e2ef5370 2024-09-19T07:14:25.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.701+0000 7f83b333b740 10 client.0 _ll_register_callbacks cb 0x7f83a00b3f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:14:25.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.701+0000 7f83aad9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1e2ef5370 0x55e1e2eef2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:25.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.701+0000 7f83aad9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1e2ef5370 0x55e1e2eef2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:49964/0 (socket says 172.21.15.148:49964) 2024-09-19T07:14:25.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.701+0000 7f83aad9d640 1 -- 172.21.15.148:0/3205353865 learned_addr learned my addr 172.21.15.148:0/3205353865 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:14:25.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.701+0000 7f83a9d9b640 1 --2- 172.21.15.148:0/3205353865 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1e2eebb40 0x55e1e2eeed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:25.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.701+0000 7f83aa59c640 1 --2- 172.21.15.148:0/3205353865 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e1e2eea5d0 0x55e1e2f01fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:25.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.701+0000 7f83aa59c640 1 -- 172.21.15.148:0/3205353865 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1e2ef5370 msgr2=0x55e1e2eef2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:25.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.701+0000 7f83aa59c640 1 --2- 172.21.15.148:0/3205353865 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1e2ef5370 0x55e1e2eef2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:25.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.701+0000 7f83aa59c640 1 -- 172.21.15.148:0/3205353865 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1e2eebb40 msgr2=0x55e1e2eeed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:25.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.701+0000 7f83aa59c640 1 --2- 172.21.15.148:0/3205353865 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1e2eebb40 0x55e1e2eeed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:25.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.701+0000 7f83aa59c640 1 -- 172.21.15.148:0/3205353865 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1e2eefaf0 con 0x55e1e2eea5d0 2024-09-19T07:14:25.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.701+0000 7f83aad9d640 1 --2- 172.21.15.148:0/3205353865 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1e2ef5370 0x55e1e2eef2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:14:25.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.702+0000 7f83aa59c640 1 --2- 172.21.15.148:0/3205353865 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e1e2eea5d0 0x55e1e2f01fe0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f839c01b040 tx=0x7f839c009f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db6e018eb89c11e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:25.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.702+0000 7f8391ffb640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-19T07:14:25.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.702+0000 7f8391ffb640 1 -- 172.21.15.148:0/3205353865 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c034030 con 0x55e1e2eea5d0 2024-09-19T07:14:25.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.702+0000 7f8391ffb640 1 -- 172.21.15.148:0/3205353865 <== mon.2 v2:172.21.15.165:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f839c004660 con 0x55e1e2eea5d0 2024-09-19T07:14:25.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.702+0000 7f83b333b740 1 -- 172.21.15.148:0/3205353865 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f839c004b40 con 0x55e1e2eea5d0 2024-09-19T07:14:25.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.702+0000 7f8391ffb640 1 -- 172.21.15.148:0/3205353865 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f839c011d10 con 0x55e1e2eea5d0 2024-09-19T07:14:25.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.702+0000 7f83b333b740 10 client.25613 fetch_fsmap learned FSMap version 31 2024-09-19T07:14:25.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.702+0000 7f83b333b740 1 -- 172.21.15.148:0/3205353865 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55e1e2f74000 con 0x55e1e2eea5d0 2024-09-19T07:14:25.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.702+0000 7f8391ffb640 1 -- 172.21.15.148:0/3205353865 <== mon.2 v2:172.21.15.165:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f839c004b40 con 0x55e1e2eea5d0 2024-09-19T07:14:25.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.703+0000 7f8391ffb640 1 -- 172.21.15.148:0/3205353865 <== mon.2 v2:172.21.15.165:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f839c0037b0 con 0x55e1e2eea5d0 2024-09-19T07:14:25.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.703+0000 7f83b333b740 10 client.25613 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T07:14:25.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.703+0000 7f83b333b740 10 client.25613 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T07:14:25.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.703+0000 7f83b333b740 20 client.25613 populate_metadata read hostname 'smithi148' 2024-09-19T07:14:25.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.703+0000 7f83b333b740 1 --2- 172.21.15.148:0/3205353865 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x55e1e2f74480 0x55e1e2f76870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:25.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.703+0000 7f83b333b740 4 client.25613 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:14:25.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.703+0000 7f83b333b740 1 -- 172.21.15.148:0/3205353865 --> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e1e2e57d70 con 0x55e1e2f74480 2024-09-19T07:14:25.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.703+0000 7f83a9d9b640 1 --2- 172.21.15.148:0/3205353865 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x55e1e2f74480 0x55e1e2f76870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:25.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.703+0000 7f8391ffb640 10 client.25613 ms_handle_connect on v2:172.21.15.165:6838/3993490234 2024-09-19T07:14:25.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.703+0000 7f83a9d9b640 1 --2- 172.21.15.148:0/3205353865 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x55e1e2f74480 0x55e1e2f76870 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ce9070189f2054f4 server_cookie=fb4135acff54dede in_seq=0 out_seq=0 2024-09-19T07:14:25.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.705+0000 7f8391ffb640 1 -- 172.21.15.148:0/3205353865 <== mds.1 v2:172.21.15.165:6838/3993490234 1 ==== command_reply(tid 0: 0 ) ==== 8+0+119611 (crc 0 0 0) 0x55e1e2e57d70 con 0x55e1e2f74480 2024-09-19T07:14:25.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.705+0000 7f8391ffb640 10 client.25613 handle_command_reply: tid=0 2024-09-19T07:14:25.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.705+0000 7f83b333b740 1 client.25613 shutdown 2024-09-19T07:14:25.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.706+0000 7f83b333b740 1 -- 172.21.15.148:0/3205353865 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e1e2eea5d0 msgr2=0x55e1e2f01fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:25.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.706+0000 7f83b333b740 1 --2- 172.21.15.148:0/3205353865 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e1e2eea5d0 0x55e1e2f01fe0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f839c01b040 tx=0x7f839c009f70 comp rx=0 tx=0).stop 2024-09-19T07:14:25.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.706+0000 7f83b333b740 1 -- 172.21.15.148:0/3205353865 shutdown_connections 2024-09-19T07:14:25.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.706+0000 7f83b333b740 1 --2- 172.21.15.148:0/3205353865 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1e2ef5370 0x55e1e2eef2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:25.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.706+0000 7f83b333b740 1 --2- 172.21.15.148:0/3205353865 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1e2eebb40 0x55e1e2eeed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:25.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.706+0000 7f83b333b740 1 --2- 172.21.15.148:0/3205353865 >> [v2:172.21.15.165:6838/3993490234,v1:172.21.15.165:6839/3993490234] conn(0x55e1e2f74480 0x55e1e2f76870 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:25.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.706+0000 7f83b333b740 1 --2- 172.21.15.148:0/3205353865 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e1e2eea5d0 0x55e1e2f01fe0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:25.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.706+0000 7f8391ffb640 0 client.25613 ms_handle_reset on v2:172.21.15.165:6838/3993490234 2024-09-19T07:14:25.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.706+0000 7f83b333b740 1 -- 172.21.15.148:0/3205353865 >> 172.21.15.148:0/3205353865 conn(0x55e1e2eb3310 msgr2=0x55e1e2ef10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:25.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.706+0000 7f83b333b740 1 -- 172.21.15.148:0/3205353865 shutdown_connections 2024-09-19T07:14:25.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.706+0000 7f83b333b740 1 -- 172.21.15.148:0/3205353865 wait complete. 2024-09-19T07:14:25.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.706+0000 7f83b333b740 20 client.25613 trim_cache size 0 max 16384 2024-09-19T07:14:25.710 INFO:teuthology.orchestra.run.smithi148.stdout:[ 2024-09-19T07:14:25.710 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.710 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.710 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 17037379, 2024-09-19T07:14:25.711 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631716, 2024-09-19T07:14:25.711 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-26.xml" 2024-09-19T07:14:25.711 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.711 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.711 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.711 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 21315971, 2024-09-19T07:14:25.711 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628658, 2024-09-19T07:14:25.711 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/man/Makefile" 2024-09-19T07:14:25.711 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.711 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.711 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.711 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 31599591, 2024-09-19T07:14:25.711 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630089, 2024-09-19T07:14:25.712 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-49.xml" 2024-09-19T07:14:25.712 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.712 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.712 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.712 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 33772217, 2024-09-19T07:14:25.712 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631856, 2024-09-19T07:14:25.712 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-50.jpg" 2024-09-19T07:14:25.712 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.712 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.712 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.712 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 40972544, 2024-09-19T07:14:25.712 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631663, 2024-09-19T07:14:25.712 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-46.xml" 2024-09-19T07:14:25.713 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.713 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.713 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.713 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 60438133, 2024-09-19T07:14:25.713 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632289, 2024-09-19T07:14:25.713 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-10.jpg" 2024-09-19T07:14:25.713 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.713 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.713 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.713 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 74074912, 2024-09-19T07:14:25.713 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630015, 2024-09-19T07:14:25.713 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-66.xml" 2024-09-19T07:14:25.713 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.714 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.714 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.714 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 84864623, 2024-09-19T07:14:25.714 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631759, 2024-09-19T07:14:25.714 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-14.xml" 2024-09-19T07:14:25.714 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.714 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.714 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.714 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 86453799, 2024-09-19T07:14:25.714 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632395, 2024-09-19T07:14:25.714 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-36.xml" 2024-09-19T07:14:25.714 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.714 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.715 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.715 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 99164097, 2024-09-19T07:14:25.715 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632226, 2024-09-19T07:14:25.715 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-12.xml" 2024-09-19T07:14:25.715 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.715 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.715 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.715 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 128475348, 2024-09-19T07:14:25.715 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632528, 2024-09-19T07:14:25.715 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-30.jpg" 2024-09-19T07:14:25.715 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.715 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.716 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.716 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 142551919, 2024-09-19T07:14:25.716 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631902, 2024-09-19T07:14:25.716 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-27.jpg" 2024-09-19T07:14:25.716 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.716 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.716 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.716 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 145058237, 2024-09-19T07:14:25.716 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632295, 2024-09-19T07:14:25.716 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-8.jpg" 2024-09-19T07:14:25.716 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.716 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.716 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.717 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 160710289, 2024-09-19T07:14:25.717 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632146, 2024-09-19T07:14:25.717 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-29.xml" 2024-09-19T07:14:25.717 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.717 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.717 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.717 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 160902794, 2024-09-19T07:14:25.717 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630139, 2024-09-19T07:14:25.717 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-37.xml" 2024-09-19T07:14:25.717 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.717 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.717 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.717 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 164215933, 2024-09-19T07:14:25.717 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630251, 2024-09-19T07:14:25.718 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-12.jpg" 2024-09-19T07:14:25.718 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.718 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.718 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.718 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 171521538, 2024-09-19T07:14:25.718 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632298, 2024-09-19T07:14:25.718 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-7.jpg" 2024-09-19T07:14:25.718 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.718 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.718 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.718 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 177745211, 2024-09-19T07:14:25.718 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631910, 2024-09-19T07:14:25.718 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-23.jpg" 2024-09-19T07:14:25.719 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.719 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.719 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.719 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 190359529, 2024-09-19T07:14:25.719 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630197, 2024-09-19T07:14:25.719 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-18.xml" 2024-09-19T07:14:25.719 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.719 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.719 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.719 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 196055773, 2024-09-19T07:14:25.719 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631623, 2024-09-19T07:14:25.719 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-59.xml" 2024-09-19T07:14:25.719 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.719 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.720 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.720 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 220713340, 2024-09-19T07:14:25.720 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632063, 2024-09-19T07:14:25.720 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-46.xml" 2024-09-19T07:14:25.720 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.720 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.720 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.720 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 226907546, 2024-09-19T07:14:25.720 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631845, 2024-09-19T07:14:25.720 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-54.jpg" 2024-09-19T07:14:25.720 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.720 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.720 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.720 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 234089688, 2024-09-19T07:14:25.721 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630265, 2024-09-19T07:14:25.721 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-2.jpg" 2024-09-19T07:14:25.721 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.721 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.721 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.721 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 234301326, 2024-09-19T07:14:25.721 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631982, 2024-09-19T07:14:25.721 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-5.jpg" 2024-09-19T07:14:25.721 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.721 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.721 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.721 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 245096979, 2024-09-19T07:14:25.721 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632261, 2024-09-19T07:14:25.722 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-1.xml" 2024-09-19T07:14:25.722 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.722 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.722 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.722 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 249640616, 2024-09-19T07:14:25.722 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632381, 2024-09-19T07:14:25.722 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-62.jpg" 2024-09-19T07:14:25.722 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.722 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.722 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.722 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 254749265, 2024-09-19T07:14:25.722 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632184, 2024-09-19T07:14:25.722 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-70.jpg" 2024-09-19T07:14:25.722 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.723 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.723 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.723 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 257147975, 2024-09-19T07:14:25.723 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632450, 2024-09-19T07:14:25.723 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-51.jpg" 2024-09-19T07:14:25.723 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.723 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.723 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.723 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 280714751, 2024-09-19T07:14:25.723 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632609, 2024-09-19T07:14:25.723 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-7.jpg" 2024-09-19T07:14:25.723 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.723 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.724 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.724 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 291694502, 2024-09-19T07:14:25.724 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631297, 2024-09-19T07:14:25.724 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-7.xml" 2024-09-19T07:14:25.724 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.724 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.724 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.724 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 298506287, 2024-09-19T07:14:25.724 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630019, 2024-09-19T07:14:25.724 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-65.xml" 2024-09-19T07:14:25.724 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.724 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.724 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.725 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 300613937, 2024-09-19T07:14:25.725 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628291, 2024-09-19T07:14:25.725 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/m4/acx_pthread.m4" 2024-09-19T07:14:25.725 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.725 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.725 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.725 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 312211968, 2024-09-19T07:14:25.725 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632109, 2024-09-19T07:14:25.725 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-12.xml" 2024-09-19T07:14:25.725 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.725 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.725 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.725 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 318355650, 2024-09-19T07:14:25.725 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631896, 2024-09-19T07:14:25.726 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-30.jpg" 2024-09-19T07:14:25.726 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.726 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.726 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.726 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 321860467, 2024-09-19T07:14:25.726 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631862, 2024-09-19T07:14:25.726 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-47.jpg" 2024-09-19T07:14:25.726 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.726 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.726 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.726 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 325728634, 2024-09-19T07:14:25.726 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630253, 2024-09-19T07:14:25.726 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-10.jpg" 2024-09-19T07:14:25.727 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.727 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.727 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.727 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 329857173, 2024-09-19T07:14:25.727 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630131, 2024-09-19T07:14:25.727 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-39.xml" 2024-09-19T07:14:25.727 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.727 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.727 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.727 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 335892251, 2024-09-19T07:14:25.727 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632120, 2024-09-19T07:14:25.727 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-35.xml" 2024-09-19T07:14:25.727 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.727 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.728 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.728 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 337216369, 2024-09-19T07:14:25.728 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630152, 2024-09-19T07:14:25.728 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-33.xml" 2024-09-19T07:14:25.728 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.728 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.728 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.728 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 340208831, 2024-09-19T07:14:25.728 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632311, 2024-09-19T07:14:25.728 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-21.jpg" 2024-09-19T07:14:25.728 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.728 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.728 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.729 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 363975848, 2024-09-19T07:14:25.729 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631821, 2024-09-19T07:14:25.729 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-66.jpg" 2024-09-19T07:14:25.729 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.729 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.729 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.729 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 365842490, 2024-09-19T07:14:25.729 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630023, 2024-09-19T07:14:25.729 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-64.xml" 2024-09-19T07:14:25.729 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.729 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.729 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.729 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 384833436, 2024-09-19T07:14:25.730 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632588, 2024-09-19T07:14:25.730 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-12.jpg" 2024-09-19T07:14:25.730 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.730 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.730 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.730 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 392544386, 2024-09-19T07:14:25.730 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630268, 2024-09-19T07:14:25.730 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-1.jpg" 2024-09-19T07:14:25.730 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.730 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.730 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.730 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 393554078, 2024-09-19T07:14:25.730 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631608, 2024-09-19T07:14:25.731 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-64.xml" 2024-09-19T07:14:25.731 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.731 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.731 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.731 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 411951525, 2024-09-19T07:14:25.731 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632215, 2024-09-19T07:14:25.731 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-15.xml" 2024-09-19T07:14:25.731 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.731 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.731 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.731 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 417918036, 2024-09-19T07:14:25.731 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632164, 2024-09-19T07:14:25.731 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-2.xml" 2024-09-19T07:14:25.731 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.732 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.732 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.732 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 438306747, 2024-09-19T07:14:25.732 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632549, 2024-09-19T07:14:25.732 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-23.jpg" 2024-09-19T07:14:25.732 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.732 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.732 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.732 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 452228154, 2024-09-19T07:14:25.732 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631627, 2024-09-19T07:14:25.732 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-58.xml" 2024-09-19T07:14:25.732 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.732 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.733 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.733 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 464413638, 2024-09-19T07:14:25.733 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632006, 2024-09-19T07:14:25.733 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-1.jpg" 2024-09-19T07:14:25.733 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.733 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.733 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.733 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 464470274, 2024-09-19T07:14:25.733 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632439, 2024-09-19T07:14:25.733 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-54.jpg" 2024-09-19T07:14:25.733 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.733 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.733 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.733 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 466405778, 2024-09-19T07:14:25.734 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632273, 2024-09-19T07:14:25.734 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-17.jpg" 2024-09-19T07:14:25.734 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.734 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.734 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.734 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 477285524, 2024-09-19T07:14:25.734 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632046, 2024-09-19T07:14:25.734 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-24.xml" 2024-09-19T07:14:25.734 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.734 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.734 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.734 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 483004702, 2024-09-19T07:14:25.734 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631848, 2024-09-19T07:14:25.734 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-53.jpg" 2024-09-19T07:14:25.735 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.735 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.735 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.735 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 490193364, 2024-09-19T07:14:25.735 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632282, 2024-09-19T07:14:25.735 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-31.jpg" 2024-09-19T07:14:25.735 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.735 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.735 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.735 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 495772736, 2024-09-19T07:14:25.735 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632029, 2024-09-19T07:14:25.735 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-85.jpg" 2024-09-19T07:14:25.735 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.735 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.736 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.736 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 496223559, 2024-09-19T07:14:25.736 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632116, 2024-09-19T07:14:25.736 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-76.jpg" 2024-09-19T07:14:25.736 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.736 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.736 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.736 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 509731911, 2024-09-19T07:14:25.736 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631975, 2024-09-19T07:14:25.736 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/article-4.xml" 2024-09-19T07:14:25.736 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.736 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.736 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.736 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 517306768, 2024-09-19T07:14:25.737 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632123, 2024-09-19T07:14:25.737 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-9.xml" 2024-09-19T07:14:25.737 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.737 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.737 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.737 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 518269283, 2024-09-19T07:14:25.737 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630146, 2024-09-19T07:14:25.737 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-35.xml" 2024-09-19T07:14:25.737 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.737 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.737 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.737 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 525628717, 2024-09-19T07:14:25.737 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631644, 2024-09-19T07:14:25.738 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-53.xml" 2024-09-19T07:14:25.738 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.738 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.738 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.738 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 526857971, 2024-09-19T07:14:25.738 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630255, 2024-09-19T07:14:25.738 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-8.jpg" 2024-09-19T07:14:25.738 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.738 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.738 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.738 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 529706209, 2024-09-19T07:14:25.738 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631979, 2024-09-19T07:14:25.738 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/article-3.xml" 2024-09-19T07:14:25.739 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.739 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.739 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.739 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 535875362, 2024-09-19T07:14:25.739 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632250, 2024-09-19T07:14:25.739 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-39.xml" 2024-09-19T07:14:25.739 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.739 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.739 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.739 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 565567734, 2024-09-19T07:14:25.739 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632331, 2024-09-19T07:14:25.739 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-13.jpg" 2024-09-19T07:14:25.739 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.739 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.740 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.740 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 575439086, 2024-09-19T07:14:25.740 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632563, 2024-09-19T07:14:25.740 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-19.jpg" 2024-09-19T07:14:25.740 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.740 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.740 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.740 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 579487672, 2024-09-19T07:14:25.740 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632522, 2024-09-19T07:14:25.740 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-32.jpg" 2024-09-19T07:14:25.740 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.740 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.740 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.740 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 601085950, 2024-09-19T07:14:25.741 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630127, 2024-09-19T07:14:25.741 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-40.xml" 2024-09-19T07:14:25.741 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.741 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.742 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.742 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 611865304, 2024-09-19T07:14:25.742 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631972, 2024-09-19T07:14:25.742 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-7.jpg" 2024-09-19T07:14:25.742 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.742 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.742 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.742 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 624126269, 2024-09-19T07:14:25.743 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632028, 2024-09-19T07:14:25.743 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-27.xml" 2024-09-19T07:14:25.743 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.743 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.743 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.743 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 631341279, 2024-09-19T07:14:25.743 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630098, 2024-09-19T07:14:25.743 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-47.xml" 2024-09-19T07:14:25.743 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.743 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.743 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.743 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 632395446, 2024-09-19T07:14:25.743 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630065, 2024-09-19T07:14:25.744 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-54.xml" 2024-09-19T07:14:25.744 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.744 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.744 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.744 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 634295656, 2024-09-19T07:14:25.744 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631820, 2024-09-19T07:14:25.744 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-67.jpg" 2024-09-19T07:14:25.744 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.744 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.744 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.744 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 651416152, 2024-09-19T07:14:25.744 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632329, 2024-09-19T07:14:25.744 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-14.jpg" 2024-09-19T07:14:25.745 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.745 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.745 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.745 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 652570563, 2024-09-19T07:14:25.745 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632584, 2024-09-19T07:14:25.745 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-13.jpg" 2024-09-19T07:14:25.745 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.745 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.745 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.745 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 686382384, 2024-09-19T07:14:25.745 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632333, 2024-09-19T07:14:25.745 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-12.jpg" 2024-09-19T07:14:25.745 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.745 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.746 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.746 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 696544984, 2024-09-19T07:14:25.746 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632034, 2024-09-19T07:14:25.746 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-84.jpg" 2024-09-19T07:14:25.746 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.746 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.746 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.746 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 698337696, 2024-09-19T07:14:25.746 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631704, 2024-09-19T07:14:25.746 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-31.xml" 2024-09-19T07:14:25.746 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.746 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.746 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.747 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 703483306, 2024-09-19T07:14:25.747 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632249, 2024-09-19T07:14:25.747 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-6.xml" 2024-09-19T07:14:25.747 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.747 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.747 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.747 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 708080290, 2024-09-19T07:14:25.747 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631870, 2024-09-19T07:14:25.747 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-43.jpg" 2024-09-19T07:14:25.747 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.747 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.747 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.747 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 715007761, 2024-09-19T07:14:25.747 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632048, 2024-09-19T07:14:25.748 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-49.xml" 2024-09-19T07:14:25.748 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.748 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.748 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.748 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 715869592, 2024-09-19T07:14:25.748 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632104, 2024-09-19T07:14:25.748 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-13.xml" 2024-09-19T07:14:25.748 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.748 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.748 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.748 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 743901499, 2024-09-19T07:14:25.748 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631807, 2024-09-19T07:14:25.748 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-75.jpg" 2024-09-19T07:14:25.749 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.749 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.749 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.749 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 760920860, 2024-09-19T07:14:25.749 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631751, 2024-09-19T07:14:25.749 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-16.xml" 2024-09-19T07:14:25.749 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.749 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.749 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.749 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 774638872, 2024-09-19T07:14:25.749 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630218, 2024-09-19T07:14:25.749 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-11.xml" 2024-09-19T07:14:25.749 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.750 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.750 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.750 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 779088074, 2024-09-19T07:14:25.750 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630164, 2024-09-19T07:14:25.750 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-29.xml" 2024-09-19T07:14:25.750 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.750 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.750 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.750 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 785928053, 2024-09-19T07:14:25.750 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631898, 2024-09-19T07:14:25.750 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-29.jpg" 2024-09-19T07:14:25.750 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.750 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.751 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.751 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 796708199, 2024-09-19T07:14:25.751 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630215, 2024-09-19T07:14:25.751 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-12.xml" 2024-09-19T07:14:25.751 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.751 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.751 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.751 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 802357711, 2024-09-19T07:14:25.751 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631272, 2024-09-19T07:14:25.751 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-16.xml" 2024-09-19T07:14:25.751 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.751 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.751 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.751 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 802675456, 2024-09-19T07:14:25.752 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631822, 2024-09-19T07:14:25.752 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-65.jpg" 2024-09-19T07:14:25.752 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.752 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.752 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.752 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 826030487, 2024-09-19T07:14:25.752 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630209, 2024-09-19T07:14:25.752 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-14.xml" 2024-09-19T07:14:25.752 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.752 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.752 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.752 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 829670413, 2024-09-19T07:14:25.752 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632293, 2024-09-19T07:14:25.752 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-27.jpg" 2024-09-19T07:14:25.753 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.753 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.753 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.753 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 842404014, 2024-09-19T07:14:25.753 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632000, 2024-09-19T07:14:25.753 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-2.jpg" 2024-09-19T07:14:25.753 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.753 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.753 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.753 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 857596869, 2024-09-19T07:14:25.753 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632209, 2024-09-19T07:14:25.753 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-16.xml" 2024-09-19T07:14:25.753 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.753 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.754 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.754 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 857613049, 2024-09-19T07:14:25.754 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632253, 2024-09-19T07:14:25.754 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-4.xml" 2024-09-19T07:14:25.754 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.754 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.754 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.754 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 867829249, 2024-09-19T07:14:25.754 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631872, 2024-09-19T07:14:25.754 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-42.jpg" 2024-09-19T07:14:25.754 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.754 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.754 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.755 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 871861611, 2024-09-19T07:14:25.755 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630236, 2024-09-19T07:14:25.755 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-5.xml" 2024-09-19T07:14:25.755 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.755 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.755 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.755 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 879839491, 2024-09-19T07:14:25.755 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630167, 2024-09-19T07:14:25.755 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-28.xml" 2024-09-19T07:14:25.755 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.755 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.755 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.755 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 889047622, 2024-09-19T07:14:25.755 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630224, 2024-09-19T07:14:25.756 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-9.xml" 2024-09-19T07:14:25.756 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.756 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.756 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.756 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 909509401, 2024-09-19T07:14:25.756 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630245, 2024-09-19T07:14:25.756 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-1.xml" 2024-09-19T07:14:25.756 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.756 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.756 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.756 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 915302995, 2024-09-19T07:14:25.756 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632176, 2024-09-19T07:14:25.756 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-42.jpg" 2024-09-19T07:14:25.756 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.757 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.757 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.757 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 922149749, 2024-09-19T07:14:25.757 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632191, 2024-09-19T07:14:25.757 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-20.xml" 2024-09-19T07:14:25.757 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.757 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.757 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.757 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 923808292, 2024-09-19T07:14:25.757 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632153, 2024-09-19T07:14:25.757 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-4.xml" 2024-09-19T07:14:25.757 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.757 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.758 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.758 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 931908314, 2024-09-19T07:14:25.758 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630052, 2024-09-19T07:14:25.758 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-57.xml" 2024-09-19T07:14:25.758 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.758 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.758 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.758 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 935159464, 2024-09-19T07:14:25.758 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630260, 2024-09-19T07:14:25.758 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-5.jpg" 2024-09-19T07:14:25.758 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.759 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.759 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.759 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 937669243, 2024-09-19T07:14:25.759 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630080, 2024-09-19T07:14:25.759 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-51.xml" 2024-09-19T07:14:25.759 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.759 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.759 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.759 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 938725909, 2024-09-19T07:14:25.759 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631699, 2024-09-19T07:14:25.759 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-33.xml" 2024-09-19T07:14:25.760 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.760 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.760 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.760 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 940397027, 2024-09-19T07:14:25.760 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632213, 2024-09-19T07:14:25.760 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-44.xml" 2024-09-19T07:14:25.760 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.760 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.760 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.760 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 970054657, 2024-09-19T07:14:25.760 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631878, 2024-09-19T07:14:25.760 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-39.jpg" 2024-09-19T07:14:25.760 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.761 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.761 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.761 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 970176663, 2024-09-19T07:14:25.761 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632279, 2024-09-19T07:14:25.761 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-14.jpg" 2024-09-19T07:14:25.761 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.761 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.761 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.761 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 971072252, 2024-09-19T07:14:25.761 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631969, 2024-09-19T07:14:25.761 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/article-5.xml" 2024-09-19T07:14:25.761 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.761 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.762 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.762 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 984195779, 2024-09-19T07:14:25.762 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632430, 2024-09-19T07:14:25.762 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-55.jpg" 2024-09-19T07:14:25.762 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.762 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.762 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.762 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 988890479, 2024-09-19T07:14:25.762 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632305, 2024-09-19T07:14:25.762 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-23.jpg" 2024-09-19T07:14:25.762 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.762 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.762 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.763 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 990335617, 2024-09-19T07:14:25.763 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630262, 2024-09-19T07:14:25.763 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-4.jpg" 2024-09-19T07:14:25.763 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.763 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.763 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.763 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 992106901, 2024-09-19T07:14:25.763 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631906, 2024-09-19T07:14:25.763 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-25.jpg" 2024-09-19T07:14:25.763 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.763 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.764 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.764 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 998065287, 2024-09-19T07:14:25.764 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630252, 2024-09-19T07:14:25.764 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-11.jpg" 2024-09-19T07:14:25.764 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.764 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.764 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.764 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 999356677, 2024-09-19T07:14:25.764 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630246, 2024-09-19T07:14:25.764 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-17.jpg" 2024-09-19T07:14:25.764 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.764 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.764 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.765 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1000427359, 2024-09-19T07:14:25.765 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632315, 2024-09-19T07:14:25.765 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-1.jpg" 2024-09-19T07:14:25.765 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.765 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.765 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.765 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1000590206, 2024-09-19T07:14:25.765 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632534, 2024-09-19T07:14:25.765 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-28.jpg" 2024-09-19T07:14:25.765 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.765 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.765 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.765 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1011467720, 2024-09-19T07:14:25.765 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631730, 2024-09-19T07:14:25.766 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-21.xml" 2024-09-19T07:14:25.766 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.766 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.766 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.766 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1017582002, 2024-09-19T07:14:25.766 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630027, 2024-09-19T07:14:25.766 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-63.xml" 2024-09-19T07:14:25.766 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.766 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.766 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.766 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1027509946, 2024-09-19T07:14:25.766 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630206, 2024-09-19T07:14:25.766 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-15.xml" 2024-09-19T07:14:25.766 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.767 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.767 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.767 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1030420745, 2024-09-19T07:14:25.767 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632106, 2024-09-19T07:14:25.767 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-77.jpg" 2024-09-19T07:14:25.767 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.767 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.767 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.767 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1030630298, 2024-09-19T07:14:25.767 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631868, 2024-09-19T07:14:25.767 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-44.jpg" 2024-09-19T07:14:25.767 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.767 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.767 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.768 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1047079448, 2024-09-19T07:14:25.768 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632369, 2024-09-19T07:14:25.768 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-64.jpg" 2024-09-19T07:14:25.768 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.768 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.768 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.768 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1060255187, 2024-09-19T07:14:25.768 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632238, 2024-09-19T07:14:25.768 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-9.xml" 2024-09-19T07:14:25.768 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.768 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.768 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.768 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1065397099, 2024-09-19T07:14:25.768 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632258, 2024-09-19T07:14:25.769 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-2.xml" 2024-09-19T07:14:25.769 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.769 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.769 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.769 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1096324385, 2024-09-19T07:14:25.769 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632339, 2024-09-19T07:14:25.769 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-9.jpg" 2024-09-19T07:14:25.769 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.769 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.769 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.769 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1101034159, 2024-09-19T07:14:25.770 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630221, 2024-09-19T07:14:25.770 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-10.xml" 2024-09-19T07:14:25.770 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.770 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.770 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.770 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1111282969, 2024-09-19T07:14:25.770 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632212, 2024-09-19T07:14:25.770 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-67.jpg" 2024-09-19T07:14:25.770 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.770 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.770 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.770 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1125324144, 2024-09-19T07:14:25.770 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631724, 2024-09-19T07:14:25.771 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-23.xml" 2024-09-19T07:14:25.771 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.771 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.771 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.771 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1137165703, 2024-09-19T07:14:25.771 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632040, 2024-09-19T07:14:25.771 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-25.xml" 2024-09-19T07:14:25.771 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.771 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.771 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.772 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1148206674, 2024-09-19T07:14:25.772 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629996, 2024-09-19T07:14:25.772 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-71.xml" 2024-09-19T07:14:25.772 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.772 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.772 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.772 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1152548624, 2024-09-19T07:14:25.772 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632036, 2024-09-19T07:14:25.772 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-51.xml" 2024-09-19T07:14:25.772 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.772 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.772 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.772 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1174352322, 2024-09-19T07:14:25.772 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632256, 2024-09-19T07:14:25.773 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-3.xml" 2024-09-19T07:14:25.773 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.773 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.773 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.773 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1185930749, 2024-09-19T07:14:25.773 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632196, 2024-09-19T07:14:25.773 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-19.xml" 2024-09-19T07:14:25.773 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.773 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.773 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.773 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1204508060, 2024-09-19T07:14:25.774 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631892, 2024-09-19T07:14:25.774 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-32.jpg" 2024-09-19T07:14:25.774 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.774 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.774 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.774 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1208254160, 2024-09-19T07:14:25.774 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632278, 2024-09-19T07:14:25.774 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-15.jpg" 2024-09-19T07:14:25.774 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.774 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.774 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.774 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1216729277, 2024-09-19T07:14:25.774 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632352, 2024-09-19T07:14:25.774 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-3.jpg" 2024-09-19T07:14:25.775 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.775 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.775 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.775 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1227736510, 2024-09-19T07:14:25.775 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632227, 2024-09-19T07:14:25.775 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-42.xml" 2024-09-19T07:14:25.775 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.775 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.775 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.775 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1237525356, 2024-09-19T07:14:25.775 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632571, 2024-09-19T07:14:25.775 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-17.jpg" 2024-09-19T07:14:25.775 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.776 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.776 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.776 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1244295701, 2024-09-19T07:14:25.776 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631671, 2024-09-19T07:14:25.776 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-43.xml" 2024-09-19T07:14:25.776 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.776 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.776 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.776 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1255483227, 2024-09-19T07:14:25.776 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631839, 2024-09-19T07:14:25.776 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-56.jpg" 2024-09-19T07:14:25.776 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.776 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.776 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.777 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1262796965, 2024-09-19T07:14:25.777 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631330, 2024-09-19T07:14:25.777 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-2.jpg" 2024-09-19T07:14:25.777 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.777 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.777 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.777 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1279682299, 2024-09-19T07:14:25.777 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632568, 2024-09-19T07:14:25.777 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-18.jpg" 2024-09-19T07:14:25.777 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.777 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.777 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.777 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1285212258, 2024-09-19T07:14:25.777 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628294, 2024-09-19T07:14:25.778 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/man/Makefile.am" 2024-09-19T07:14:25.778 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.778 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.778 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.778 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1285467739, 2024-09-19T07:14:25.778 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631900, 2024-09-19T07:14:25.778 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-28.jpg" 2024-09-19T07:14:25.778 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.778 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.778 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.778 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1289894607, 2024-09-19T07:14:25.778 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631719, 2024-09-19T07:14:25.778 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-25.xml" 2024-09-19T07:14:25.778 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.779 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.779 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.779 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1290341540, 2024-09-19T07:14:25.779 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631316, 2024-09-19T07:14:25.779 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-56.xml" 2024-09-19T07:14:25.779 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.779 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.779 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.779 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1294816123, 2024-09-19T07:14:25.779 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632525, 2024-09-19T07:14:25.779 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-31.jpg" 2024-09-19T07:14:25.779 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.779 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.780 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.780 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1297398570, 2024-09-19T07:14:25.780 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632446, 2024-09-19T07:14:25.780 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-52.jpg" 2024-09-19T07:14:25.780 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.780 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.780 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.780 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1308792409, 2024-09-19T07:14:25.780 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631743, 2024-09-19T07:14:25.780 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-18.xml" 2024-09-19T07:14:25.780 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.780 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.780 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.780 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1309919149, 2024-09-19T07:14:25.781 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631813, 2024-09-19T07:14:25.781 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-72.jpg" 2024-09-19T07:14:25.781 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.781 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.781 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.781 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1313867401, 2024-09-19T07:14:25.781 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631665, 2024-09-19T07:14:25.781 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-45.xml" 2024-09-19T07:14:25.781 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.781 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.781 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.781 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1315534205, 2024-09-19T07:14:25.781 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631735, 2024-09-19T07:14:25.781 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-20.xml" 2024-09-19T07:14:25.782 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.782 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.782 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.782 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1344637386, 2024-09-19T07:14:25.782 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630076, 2024-09-19T07:14:25.782 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-52.xml" 2024-09-19T07:14:25.782 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.782 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.782 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.782 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1352420461, 2024-09-19T07:14:25.782 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632275, 2024-09-19T07:14:25.782 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-16.jpg" 2024-09-19T07:14:25.782 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.782 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.783 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.783 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1356668850, 2024-09-19T07:14:25.783 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632531, 2024-09-19T07:14:25.783 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-29.jpg" 2024-09-19T07:14:25.783 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.783 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.783 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.783 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1361298810, 2024-09-19T07:14:25.783 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631318, 2024-09-19T07:14:25.783 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-2.xml" 2024-09-19T07:14:25.783 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.783 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.783 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.783 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1372677352, 2024-09-19T07:14:25.784 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632486, 2024-09-19T07:14:25.784 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-42.jpg" 2024-09-19T07:14:25.784 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.784 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.784 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.784 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1373762875, 2024-09-19T07:14:25.784 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632271, 2024-09-19T07:14:25.784 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-18.jpg" 2024-09-19T07:14:25.784 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.784 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.784 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.784 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1392867363, 2024-09-19T07:14:25.784 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632478, 2024-09-19T07:14:25.785 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-44.jpg" 2024-09-19T07:14:25.785 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.785 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.785 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.785 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1401099411, 2024-09-19T07:14:25.785 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632540, 2024-09-19T07:14:25.785 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-26.jpg" 2024-09-19T07:14:25.785 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.785 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.785 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.785 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1412976764, 2024-09-19T07:14:25.785 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631614, 2024-09-19T07:14:25.785 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-62.xml" 2024-09-19T07:14:25.785 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.786 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.786 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.786 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1437283370, 2024-09-19T07:14:25.786 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632142, 2024-09-19T07:14:25.786 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-30.xml" 2024-09-19T07:14:25.786 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.786 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.786 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.786 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1439451165, 2024-09-19T07:14:25.786 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630254, 2024-09-19T07:14:25.786 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-9.jpg" 2024-09-19T07:14:25.786 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.786 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.787 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.787 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1445171876, 2024-09-19T07:14:25.787 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631763, 2024-09-19T07:14:25.787 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-13.xml" 2024-09-19T07:14:25.787 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.787 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.787 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.787 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1447654090, 2024-09-19T07:14:25.787 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631833, 2024-09-19T07:14:25.787 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-59.jpg" 2024-09-19T07:14:25.787 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.787 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.787 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.787 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1455444831, 2024-09-19T07:14:25.788 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632501, 2024-09-19T07:14:25.788 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-38.jpg" 2024-09-19T07:14:25.788 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.788 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.788 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.788 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1456618854, 2024-09-19T07:14:25.788 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631641, 2024-09-19T07:14:25.788 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-54.xml" 2024-09-19T07:14:25.788 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.788 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.788 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.788 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1456686680, 2024-09-19T07:14:25.789 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632094, 2024-09-19T07:14:25.789 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-15.xml" 2024-09-19T07:14:25.789 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.789 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.789 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.789 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1471211089, 2024-09-19T07:14:25.789 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630158, 2024-09-19T07:14:25.789 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-31.xml" 2024-09-19T07:14:25.789 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.789 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.789 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.789 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1485767640, 2024-09-19T07:14:25.789 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632095, 2024-09-19T07:14:25.790 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-40.xml" 2024-09-19T07:14:25.790 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.790 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.790 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.790 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1487013971, 2024-09-19T07:14:25.790 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632335, 2024-09-19T07:14:25.790 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-11.jpg" 2024-09-19T07:14:25.790 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.790 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.790 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.790 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1490634901, 2024-09-19T07:14:25.790 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632324, 2024-09-19T07:14:25.790 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-16.jpg" 2024-09-19T07:14:25.790 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.791 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.791 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.791 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1509619708, 2024-09-19T07:14:25.791 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630233, 2024-09-19T07:14:25.791 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-6.xml" 2024-09-19T07:14:25.791 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.791 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.791 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.791 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1524799631, 2024-09-19T07:14:25.791 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631276, 2024-09-19T07:14:25.791 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-14.xml" 2024-09-19T07:14:25.791 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.792 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.792 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.792 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1541003132, 2024-09-19T07:14:25.792 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632098, 2024-09-19T07:14:25.792 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-78.jpg" 2024-09-19T07:14:25.792 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.792 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.792 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.792 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1543989254, 2024-09-19T07:14:25.792 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632033, 2024-09-19T07:14:25.792 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-26.xml" 2024-09-19T07:14:25.792 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.792 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.792 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.793 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1577405239, 2024-09-19T07:14:25.793 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632519, 2024-09-19T07:14:25.793 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-33.jpg" 2024-09-19T07:14:25.793 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.793 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.793 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.793 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1581029365, 2024-09-19T07:14:25.793 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630093, 2024-09-19T07:14:25.793 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-48.xml" 2024-09-19T07:14:25.793 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.793 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.793 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.793 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1585846890, 2024-09-19T07:14:25.794 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632304, 2024-09-19T07:14:25.794 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-5.jpg" 2024-09-19T07:14:25.794 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.794 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.794 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.794 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1590034980, 2024-09-19T07:14:25.794 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631702, 2024-09-19T07:14:25.794 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-32.xml" 2024-09-19T07:14:25.794 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.794 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.794 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.794 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1602977542, 2024-09-19T07:14:25.794 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631991, 2024-09-19T07:14:25.795 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/article-1.xml" 2024-09-19T07:14:25.795 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.795 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.795 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.795 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1610315354, 2024-09-19T07:14:25.795 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631876, 2024-09-19T07:14:25.795 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-40.jpg" 2024-09-19T07:14:25.795 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.795 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.795 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.795 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1610535363, 2024-09-19T07:14:25.795 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631920, 2024-09-19T07:14:25.795 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-18.jpg" 2024-09-19T07:14:25.796 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.796 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.796 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.796 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1611893583, 2024-09-19T07:14:25.796 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631928, 2024-09-19T07:14:25.796 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-16.jpg" 2024-09-19T07:14:25.796 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.796 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.796 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.796 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1623077034, 2024-09-19T07:14:25.796 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632577, 2024-09-19T07:14:25.796 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-15.jpg" 2024-09-19T07:14:25.796 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.796 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.797 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.797 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1632846295, 2024-09-19T07:14:25.797 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629988, 2024-09-19T07:14:25.797 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-73.xml" 2024-09-19T07:14:25.797 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.797 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.797 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.797 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1635353763, 2024-09-19T07:14:25.797 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631810, 2024-09-19T07:14:25.797 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-74.jpg" 2024-09-19T07:14:25.797 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.797 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.798 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.798 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1637779254, 2024-09-19T07:14:25.798 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632556, 2024-09-19T07:14:25.798 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-21.jpg" 2024-09-19T07:14:25.798 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.798 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.798 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.798 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1648283682, 2024-09-19T07:14:25.798 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632149, 2024-09-19T07:14:25.798 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-28.xml" 2024-09-19T07:14:25.798 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.798 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.798 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.798 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1671740828, 2024-09-19T07:14:25.799 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632133, 2024-09-19T07:14:25.799 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-32.xml" 2024-09-19T07:14:25.799 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.799 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.799 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.799 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1671896443, 2024-09-19T07:14:25.799 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632543, 2024-09-19T07:14:25.799 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-25.jpg" 2024-09-19T07:14:25.799 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.799 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.799 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.799 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1678346740, 2024-09-19T07:14:25.799 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631311, 2024-09-19T07:14:25.800 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-92.jpg" 2024-09-19T07:14:25.800 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.800 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.800 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.800 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1687468764, 2024-09-19T07:14:25.800 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632129, 2024-09-19T07:14:25.800 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-33.xml" 2024-09-19T07:14:25.800 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.800 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.800 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.800 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1705959189, 2024-09-19T07:14:25.800 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631824, 2024-09-19T07:14:25.800 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-64.jpg" 2024-09-19T07:14:25.801 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.801 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.801 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.801 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1714871306, 2024-09-19T07:14:25.801 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631707, 2024-09-19T07:14:25.801 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-30.xml" 2024-09-19T07:14:25.801 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.801 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.801 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.801 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1736396089, 2024-09-19T07:14:25.801 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631825, 2024-09-19T07:14:25.801 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-63.jpg" 2024-09-19T07:14:25.801 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.801 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.802 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.802 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1762537772, 2024-09-19T07:14:25.802 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632466, 2024-09-19T07:14:25.802 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-47.jpg" 2024-09-19T07:14:25.802 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.802 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.802 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.802 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1764919765, 2024-09-19T07:14:25.802 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632337, 2024-09-19T07:14:25.802 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-10.jpg" 2024-09-19T07:14:25.802 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.802 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.802 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.803 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1767223273, 2024-09-19T07:14:25.803 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631712, 2024-09-19T07:14:25.803 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-28.xml" 2024-09-19T07:14:25.803 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.803 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.803 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.803 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1819638620, 2024-09-19T07:14:25.803 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632139, 2024-09-19T07:14:25.803 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-7.xml" 2024-09-19T07:14:25.803 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.803 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.803 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.803 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1820714422, 2024-09-19T07:14:25.803 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632202, 2024-09-19T07:14:25.804 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-68.jpg" 2024-09-19T07:14:25.804 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.804 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.805 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.805 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1831195975, 2024-09-19T07:14:25.805 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632235, 2024-09-19T07:14:25.805 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-10.xml" 2024-09-19T07:14:25.805 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.805 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.805 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.805 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1839123947, 2024-09-19T07:14:25.805 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631835, 2024-09-19T07:14:25.805 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-58.jpg" 2024-09-19T07:14:25.805 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.805 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.805 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.806 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1845950759, 2024-09-19T07:14:25.806 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630188, 2024-09-19T07:14:25.806 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-21.xml" 2024-09-19T07:14:25.806 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.806 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.806 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.806 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1846723312, 2024-09-19T07:14:25.806 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632156, 2024-09-19T07:14:25.806 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-27.xml" 2024-09-19T07:14:25.806 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.806 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.806 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.807 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1852054226, 2024-09-19T07:14:25.807 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631655, 2024-09-19T07:14:25.807 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-49.xml" 2024-09-19T07:14:25.807 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.807 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.807 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.807 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1858278534, 2024-09-19T07:14:25.807 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632299, 2024-09-19T07:14:25.807 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-25.jpg" 2024-09-19T07:14:25.807 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.807 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.807 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.807 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1864863421, 2024-09-19T07:14:25.807 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632088, 2024-09-19T07:14:25.808 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-16.xml" 2024-09-19T07:14:25.808 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.808 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.808 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.808 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1867931102, 2024-09-19T07:14:25.808 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632147, 2024-09-19T07:14:25.808 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-5.xml" 2024-09-19T07:14:25.808 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.808 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.808 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.808 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1869055879, 2024-09-19T07:14:25.808 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630179, 2024-09-19T07:14:25.808 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-24.xml" 2024-09-19T07:14:25.809 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.809 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.809 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.809 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1870928461, 2024-09-19T07:14:25.809 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632513, 2024-09-19T07:14:25.809 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-35.jpg" 2024-09-19T07:14:25.809 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.809 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.809 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.809 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1872746191, 2024-09-19T07:14:25.809 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632161, 2024-09-19T07:14:25.809 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-26.xml" 2024-09-19T07:14:25.809 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.810 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.810 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.810 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1878980688, 2024-09-19T07:14:25.810 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632443, 2024-09-19T07:14:25.810 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-53.jpg" 2024-09-19T07:14:25.810 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.810 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.810 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.810 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1880561455, 2024-09-19T07:14:25.810 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632068, 2024-09-19T07:14:25.810 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-20.xml" 2024-09-19T07:14:25.810 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.811 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.811 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.811 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1891747582, 2024-09-19T07:14:25.811 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632308, 2024-09-19T07:14:25.811 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-22.jpg" 2024-09-19T07:14:25.811 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.811 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.811 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.811 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1897000147, 2024-09-19T07:14:25.811 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630112, 2024-09-19T07:14:25.811 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-44.xml" 2024-09-19T07:14:25.811 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.811 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.812 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.812 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1907556040, 2024-09-19T07:14:25.812 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631886, 2024-09-19T07:14:25.812 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-35.jpg" 2024-09-19T07:14:25.812 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.812 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.812 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.812 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1920476983, 2024-09-19T07:14:25.812 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632031, 2024-09-19T07:14:25.812 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-52.xml" 2024-09-19T07:14:25.812 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.812 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.812 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.813 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1938521100, 2024-09-19T07:14:25.813 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631327, 2024-09-19T07:14:25.813 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-3.jpg" 2024-09-19T07:14:25.813 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.813 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.813 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.813 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1938810799, 2024-09-19T07:14:25.813 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632143, 2024-09-19T07:14:25.813 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-6.xml" 2024-09-19T07:14:25.813 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.813 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.813 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.813 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1941736119, 2024-09-19T07:14:25.813 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632489, 2024-09-19T07:14:25.814 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-41.jpg" 2024-09-19T07:14:25.814 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.814 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.814 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.814 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1942270283, 2024-09-19T07:14:25.814 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632307, 2024-09-19T07:14:25.814 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-4.jpg" 2024-09-19T07:14:25.814 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.814 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.814 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.814 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1945216948, 2024-09-19T07:14:25.814 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630120, 2024-09-19T07:14:25.814 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-42.xml" 2024-09-19T07:14:25.815 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.815 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.815 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.815 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1946443920, 2024-09-19T07:14:25.815 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631682, 2024-09-19T07:14:25.815 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-40.xml" 2024-09-19T07:14:25.815 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.815 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.815 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.815 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1959006011, 2024-09-19T07:14:25.815 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632168, 2024-09-19T07:14:25.815 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-25.xml" 2024-09-19T07:14:25.815 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.815 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.816 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.816 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1971780127, 2024-09-19T07:14:25.816 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630191, 2024-09-19T07:14:25.816 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-20.xml" 2024-09-19T07:14:25.816 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.816 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.816 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.816 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1973274980, 2024-09-19T07:14:25.816 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630200, 2024-09-19T07:14:25.816 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-17.xml" 2024-09-19T07:14:25.816 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.816 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.816 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.817 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1983824087, 2024-09-19T07:14:25.817 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631796, 2024-09-19T07:14:25.817 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-4.xml" 2024-09-19T07:14:25.817 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.817 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.817 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.817 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 1989322263, 2024-09-19T07:14:25.817 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632343, 2024-09-19T07:14:25.817 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-7.jpg" 2024-09-19T07:14:25.817 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.817 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.817 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.817 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2000186497, 2024-09-19T07:14:25.817 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632421, 2024-09-19T07:14:25.818 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-56.jpg" 2024-09-19T07:14:25.818 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.818 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.818 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.818 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2002660487, 2024-09-19T07:14:25.818 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631866, 2024-09-19T07:14:25.818 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-45.jpg" 2024-09-19T07:14:25.818 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.818 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.818 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.818 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2006669537, 2024-09-19T07:14:25.818 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632151, 2024-09-19T07:14:25.818 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-73.jpg" 2024-09-19T07:14:25.819 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.819 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.819 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.819 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2006772518, 2024-09-19T07:14:25.819 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630194, 2024-09-19T07:14:25.819 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-19.xml" 2024-09-19T07:14:25.819 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.819 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.819 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.819 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2011659887, 2024-09-19T07:14:25.819 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630008, 2024-09-19T07:14:25.819 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-68.xml" 2024-09-19T07:14:25.820 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.820 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.820 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.820 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2014522998, 2024-09-19T07:14:25.820 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632051, 2024-09-19T07:14:25.820 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-23.xml" 2024-09-19T07:14:25.820 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.820 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.820 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.820 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2017373997, 2024-09-19T07:14:25.820 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632314, 2024-09-19T07:14:25.820 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-20.jpg" 2024-09-19T07:14:25.820 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.821 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.821 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.821 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2027098083, 2024-09-19T07:14:25.821 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632090, 2024-09-19T07:14:25.821 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-41.xml" 2024-09-19T07:14:25.821 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.821 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.821 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.821 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2036963098, 2024-09-19T07:14:25.821 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630182, 2024-09-19T07:14:25.821 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-23.xml" 2024-09-19T07:14:25.821 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.821 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.822 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.822 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2045735083, 2024-09-19T07:14:25.822 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630116, 2024-09-19T07:14:25.822 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-43.xml" 2024-09-19T07:14:25.822 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.822 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.822 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.822 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2053016041, 2024-09-19T07:14:25.822 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632252, 2024-09-19T07:14:25.822 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-5.xml" 2024-09-19T07:14:25.822 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.822 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.822 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.823 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2066278303, 2024-09-19T07:14:25.823 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631747, 2024-09-19T07:14:25.823 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-17.xml" 2024-09-19T07:14:25.823 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.823 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.823 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.823 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2076434683, 2024-09-19T07:14:25.823 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632265, 2024-09-19T07:14:25.823 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-22.jpg" 2024-09-19T07:14:25.823 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.823 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.823 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.823 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2098949848, 2024-09-19T07:14:25.823 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631804, 2024-09-19T07:14:25.823 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-76.jpg" 2024-09-19T07:14:25.823 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.824 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.824 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.824 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2122818284, 2024-09-19T07:14:25.824 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630263, 2024-09-19T07:14:25.824 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-3.jpg" 2024-09-19T07:14:25.824 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.824 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.824 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.824 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2129437726, 2024-09-19T07:14:25.824 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630161, 2024-09-19T07:14:25.824 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-30.xml" 2024-09-19T07:14:25.824 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.824 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.824 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.825 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2145112332, 2024-09-19T07:14:25.825 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630124, 2024-09-19T07:14:25.825 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-41.xml" 2024-09-19T07:14:25.825 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.825 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.825 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.825 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2146470146, 2024-09-19T07:14:25.825 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631819, 2024-09-19T07:14:25.825 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-68.jpg" 2024-09-19T07:14:25.825 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.825 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.825 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.825 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2165590826, 2024-09-19T07:14:25.826 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631951, 2024-09-19T07:14:25.826 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-11.jpg" 2024-09-19T07:14:25.826 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.826 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.826 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.826 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2167038785, 2024-09-19T07:14:25.826 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631727, 2024-09-19T07:14:25.826 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-22.xml" 2024-09-19T07:14:25.826 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.826 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.826 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.826 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2167703077, 2024-09-19T07:14:25.826 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630149, 2024-09-19T07:14:25.826 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-34.xml" 2024-09-19T07:14:25.827 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.827 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.827 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.827 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2168499523, 2024-09-19T07:14:25.827 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632300, 2024-09-19T07:14:25.827 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-6.jpg" 2024-09-19T07:14:25.827 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.827 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.827 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.827 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2174117749, 2024-09-19T07:14:25.827 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631967, 2024-09-19T07:14:25.827 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-8.jpg" 2024-09-19T07:14:25.827 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.827 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.828 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.828 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2177267006, 2024-09-19T07:14:25.828 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632313, 2024-09-19T07:14:25.828 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-2.jpg" 2024-09-19T07:14:25.828 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.828 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.828 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.828 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2181911224, 2024-09-19T07:14:25.828 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630108, 2024-09-19T07:14:25.828 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-45.xml" 2024-09-19T07:14:25.828 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.828 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.828 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.828 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2195911783, 2024-09-19T07:14:25.828 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632267, 2024-09-19T07:14:25.829 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-21.jpg" 2024-09-19T07:14:25.829 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.829 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.829 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.829 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2207768817, 2024-09-19T07:14:25.829 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632454, 2024-09-19T07:14:25.829 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-50.jpg" 2024-09-19T07:14:25.829 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.829 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.829 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.829 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2218901884, 2024-09-19T07:14:25.829 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631294, 2024-09-19T07:14:25.829 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-8.xml" 2024-09-19T07:14:25.829 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.830 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.830 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.830 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2225544646, 2024-09-19T07:14:25.830 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632236, 2024-09-19T07:14:25.830 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-36.jpg" 2024-09-19T07:14:25.830 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.830 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.830 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.830 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2228354335, 2024-09-19T07:14:25.830 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632600, 2024-09-19T07:14:25.830 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-9.jpg" 2024-09-19T07:14:25.830 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.830 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.830 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.830 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2234183186, 2024-09-19T07:14:25.831 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631962, 2024-09-19T07:14:25.831 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-9.jpg" 2024-09-19T07:14:25.831 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.831 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.831 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.831 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2237208016, 2024-09-19T07:14:25.831 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632498, 2024-09-19T07:14:25.831 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-39.jpg" 2024-09-19T07:14:25.831 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.831 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.831 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.831 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2251489508, 2024-09-19T07:14:25.831 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631291, 2024-09-19T07:14:25.831 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-9.xml" 2024-09-19T07:14:25.832 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.832 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.832 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.832 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2263513299, 2024-09-19T07:14:25.832 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632114, 2024-09-19T07:14:25.832 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-36.xml" 2024-09-19T07:14:25.832 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.832 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.832 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.832 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2270901604, 2024-09-19T07:14:25.832 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632327, 2024-09-19T07:14:25.832 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-15.jpg" 2024-09-19T07:14:25.832 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.833 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.833 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.833 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2274343367, 2024-09-19T07:14:25.833 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632134, 2024-09-19T07:14:25.833 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-74.jpg" 2024-09-19T07:14:25.833 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.833 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.833 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.833 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2279472141, 2024-09-19T07:14:25.833 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632219, 2024-09-19T07:14:25.833 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-14.xml" 2024-09-19T07:14:25.833 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.833 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.834 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.834 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2290126786, 2024-09-19T07:14:25.834 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630230, 2024-09-19T07:14:25.834 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-7.xml" 2024-09-19T07:14:25.834 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.834 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.834 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.834 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2295946322, 2024-09-19T07:14:25.834 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632287, 2024-09-19T07:14:25.834 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-11.jpg" 2024-09-19T07:14:25.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.734+0000 7f83b0f62640 1 -- 172.21.15.148:0/677246930 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f83940a33b0 msgr2=0x7f83940a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:25.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.734+0000 7f83b0f62640 1 --2- 172.21.15.148:0/677246930 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f83940a33b0 0x7f83940a5870 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f83a4005f00 tx=0x7f83a402a6c0 comp rx=0 tx=0).stop 2024-09-19T07:14:25.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.734+0000 7f83b0f62640 1 -- 172.21.15.148:0/677246930 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83ac1036e0 msgr2=0x7f83ac198b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:25.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.734+0000 7f83b0f62640 1 --2- 172.21.15.148:0/677246930 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83ac1036e0 0x7f83ac198b10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f83a000e9c0 tx=0x7f83a000ee80 comp rx=0 tx=0).stop 2024-09-19T07:14:25.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.734+0000 7f83b0f62640 1 -- 172.21.15.148:0/677246930 shutdown_connections 2024-09-19T07:14:25.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.734+0000 7f83b0f62640 1 --2- 172.21.15.148:0/677246930 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f83940a33b0 0x7f83940a5870 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:25.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.734+0000 7f83b0f62640 1 --2- 172.21.15.148:0/677246930 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f83ac1082a0 0x7f83ac19cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:25.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.734+0000 7f83b0f62640 1 --2- 172.21.15.148:0/677246930 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83ac1036e0 0x7f83ac198b10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:25.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.734+0000 7f83b0f62640 1 --2- 172.21.15.148:0/677246930 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83ac102d30 0x7f83ac1985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:25.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.734+0000 7f83b0f62640 1 -- 172.21.15.148:0/677246930 >> 172.21.15.148:0/677246930 conn(0x7f83ac0fc7d0 msgr2=0x7f83ac105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:25.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.735+0000 7f83b0f62640 1 -- 172.21.15.148:0/677246930 shutdown_connections 2024-09-19T07:14:25.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:25.735+0000 7f83b0f62640 1 -- 172.21.15.148:0/677246930 wait complete. 2024-09-19T07:14:25.837 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.837 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.837 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.837 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2300203070, 2024-09-19T07:14:25.837 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630142, 2024-09-19T07:14:25.837 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-36.xml" 2024-09-19T07:14:25.837 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.837 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.837 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.837 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2302940693, 2024-09-19T07:14:25.837 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632248, 2024-09-19T07:14:25.837 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-35.jpg" 2024-09-19T07:14:25.838 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.838 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.838 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.838 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2314653592, 2024-09-19T07:14:25.838 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632350, 2024-09-19T07:14:25.838 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-4.jpg" 2024-09-19T07:14:25.838 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.838 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.838 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.838 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2320373476, 2024-09-19T07:14:25.838 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631610, 2024-09-19T07:14:25.838 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-63.xml" 2024-09-19T07:14:25.838 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.838 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.839 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.839 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2321460668, 2024-09-19T07:14:25.839 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632194, 2024-09-19T07:14:25.839 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-40.jpg" 2024-09-19T07:14:25.839 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.839 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.839 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.839 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2329439593, 2024-09-19T07:14:25.839 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632072, 2024-09-19T07:14:25.839 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-19.xml" 2024-09-19T07:14:25.839 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.839 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.839 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.839 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2339059095, 2024-09-19T07:14:25.839 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632458, 2024-09-19T07:14:25.840 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-49.jpg" 2024-09-19T07:14:25.840 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.840 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.840 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.840 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2344033349, 2024-09-19T07:14:25.840 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632493, 2024-09-19T07:14:25.840 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-40.jpg" 2024-09-19T07:14:25.840 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.840 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.840 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.840 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2356155344, 2024-09-19T07:14:25.840 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632546, 2024-09-19T07:14:25.840 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-24.jpg" 2024-09-19T07:14:25.840 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.840 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.841 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.841 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2379426113, 2024-09-19T07:14:25.841 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632172, 2024-09-19T07:14:25.841 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-24.xml" 2024-09-19T07:14:25.841 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.841 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.841 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.841 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2381866727, 2024-09-19T07:14:25.841 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631776, 2024-09-19T07:14:25.841 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-10.xml" 2024-09-19T07:14:25.841 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.841 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.841 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.841 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2390260558, 2024-09-19T07:14:25.842 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631755, 2024-09-19T07:14:25.842 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-15.xml" 2024-09-19T07:14:25.842 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.842 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.842 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.842 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2394425080, 2024-09-19T07:14:25.842 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631661, 2024-09-19T07:14:25.842 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-47.xml" 2024-09-19T07:14:25.842 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.842 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.842 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.842 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2400288198, 2024-09-19T07:14:25.842 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631802, 2024-09-19T07:14:25.842 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-1.xml" 2024-09-19T07:14:25.843 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.843 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.843 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.843 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2425228564, 2024-09-19T07:14:25.843 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631904, 2024-09-19T07:14:25.843 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-26.jpg" 2024-09-19T07:14:25.843 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.843 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.843 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.843 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2430328954, 2024-09-19T07:14:25.843 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631936, 2024-09-19T07:14:25.843 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-14.jpg" 2024-09-19T07:14:25.843 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.844 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.844 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.844 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2437616983, 2024-09-19T07:14:25.844 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631818, 2024-09-19T07:14:25.844 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-69.jpg" 2024-09-19T07:14:25.844 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.844 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.844 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.844 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2452930459, 2024-09-19T07:14:25.844 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632199, 2024-09-19T07:14:25.844 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-18.xml" 2024-09-19T07:14:25.844 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.844 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.844 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.844 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2473186531, 2024-09-19T07:14:25.845 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631965, 2024-09-19T07:14:25.845 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/article-6.xml" 2024-09-19T07:14:25.845 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.845 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.845 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.845 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2474828874, 2024-09-19T07:14:25.845 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630011, 2024-09-19T07:14:25.845 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-67.xml" 2024-09-19T07:14:25.845 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.845 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.845 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.845 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2478662586, 2024-09-19T07:14:25.845 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630039, 2024-09-19T07:14:25.845 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-60.xml" 2024-09-19T07:14:25.845 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.846 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.846 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.846 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2481860546, 2024-09-19T07:14:25.846 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632552, 2024-09-19T07:14:25.846 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-22.jpg" 2024-09-19T07:14:25.846 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.846 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.846 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.846 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2483590384, 2024-09-19T07:14:25.846 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632065, 2024-09-19T07:14:25.846 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-81.jpg" 2024-09-19T07:14:25.846 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.846 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.846 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.847 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2491390597, 2024-09-19T07:14:25.847 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632086, 2024-09-19T07:14:25.847 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-79.jpg" 2024-09-19T07:14:25.847 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.847 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.847 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.847 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2492797850, 2024-09-19T07:14:25.847 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631912, 2024-09-19T07:14:25.847 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-22.jpg" 2024-09-19T07:14:25.847 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.847 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.847 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.847 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2503923878, 2024-09-19T07:14:25.847 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631649, 2024-09-19T07:14:25.847 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-51.xml" 2024-09-19T07:14:25.847 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.848 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.848 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.848 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2520942165, 2024-09-19T07:14:25.848 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632043, 2024-09-19T07:14:25.848 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-83.jpg" 2024-09-19T07:14:25.848 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.848 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.848 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.848 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2524190438, 2024-09-19T07:14:25.848 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631884, 2024-09-19T07:14:25.848 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-36.jpg" 2024-09-19T07:14:25.848 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.848 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.848 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.849 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2543604959, 2024-09-19T07:14:25.849 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631946, 2024-09-19T07:14:25.849 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-12.jpg" 2024-09-19T07:14:25.849 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.849 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.849 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.849 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2546374090, 2024-09-19T07:14:25.849 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632346, 2024-09-19T07:14:25.849 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-6.jpg" 2024-09-19T07:14:25.849 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.849 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.849 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.850 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2549315820, 2024-09-19T07:14:25.850 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632125, 2024-09-19T07:14:25.850 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-34.xml" 2024-09-19T07:14:25.850 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.850 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.850 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.850 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2549681354, 2024-09-19T07:14:25.850 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631653, 2024-09-19T07:14:25.850 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-50.xml" 2024-09-19T07:14:25.850 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.850 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.850 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.850 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2564822786, 2024-09-19T07:14:25.850 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630248, 2024-09-19T07:14:25.850 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-15.jpg" 2024-09-19T07:14:25.851 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.851 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.851 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.851 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2577357095, 2024-09-19T07:14:25.851 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632229, 2024-09-19T07:14:25.851 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-37.jpg" 2024-09-19T07:14:25.851 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.851 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.851 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.851 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2595811605, 2024-09-19T07:14:25.851 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632407, 2024-09-19T07:14:25.851 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-58.jpg" 2024-09-19T07:14:25.851 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.852 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.852 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.852 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2600686471, 2024-09-19T07:14:25.852 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632178, 2024-09-19T07:14:25.852 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-23.xml" 2024-09-19T07:14:25.852 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.852 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.852 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.852 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2644789464, 2024-09-19T07:14:25.852 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631784, 2024-09-19T07:14:25.852 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-8.xml" 2024-09-19T07:14:25.852 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.852 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.853 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.853 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2659403685, 2024-09-19T07:14:25.853 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632509, 2024-09-19T07:14:25.853 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-36.jpg" 2024-09-19T07:14:25.853 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.853 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.853 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.853 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2665129185, 2024-09-19T07:14:25.853 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631631, 2024-09-19T07:14:25.853 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-57.xml" 2024-09-19T07:14:25.853 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.853 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.853 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.854 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2674016625, 2024-09-19T07:14:25.854 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632355, 2024-09-19T07:14:25.854 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-2.jpg" 2024-09-19T07:14:25.854 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.854 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.854 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2679680204, 2024-09-19T07:14:25.854 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632131, 2024-09-19T07:14:25.854 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-8.xml" 2024-09-19T07:14:25.854 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.854 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.854 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2682195704, 2024-09-19T07:14:25.854 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631798, 2024-09-19T07:14:25.855 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-3.xml" 2024-09-19T07:14:25.855 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.855 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.855 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.855 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2685357557, 2024-09-19T07:14:25.855 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632163, 2024-09-19T07:14:25.855 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-72.jpg" 2024-09-19T07:14:25.855 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.855 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.855 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.855 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2689426017, 2024-09-19T07:14:25.855 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631685, 2024-09-19T07:14:25.855 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-39.xml" 2024-09-19T07:14:25.855 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.856 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.856 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.856 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2699489260, 2024-09-19T07:14:25.856 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632281, 2024-09-19T07:14:25.856 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-13.jpg" 2024-09-19T07:14:25.856 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.856 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.856 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.856 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2699858482, 2024-09-19T07:14:25.856 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631829, 2024-09-19T07:14:25.856 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-61.jpg" 2024-09-19T07:14:25.856 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.856 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.856 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.857 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2707834693, 2024-09-19T07:14:25.857 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630043, 2024-09-19T07:14:25.857 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-59.xml" 2024-09-19T07:14:25.857 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.857 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.857 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.857 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2713126108, 2024-09-19T07:14:25.857 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631697, 2024-09-19T07:14:25.857 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-34.xml" 2024-09-19T07:14:25.857 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.857 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.857 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.857 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2715743170, 2024-09-19T07:14:25.858 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632074, 2024-09-19T07:14:25.858 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-44.xml" 2024-09-19T07:14:25.858 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.858 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.858 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.858 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2722236936, 2024-09-19T07:14:25.858 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630278, 2024-09-19T07:14:25.858 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-55.xml" 2024-09-19T07:14:25.858 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.858 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.858 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.858 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2723116714, 2024-09-19T07:14:25.859 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632285, 2024-09-19T07:14:25.859 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-30.jpg" 2024-09-19T07:14:25.859 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.859 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.859 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.859 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2726008023, 2024-09-19T07:14:25.859 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632316, 2024-09-19T07:14:25.859 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-19.jpg" 2024-09-19T07:14:25.859 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.859 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.859 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.860 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2726092938, 2024-09-19T07:14:25.860 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632348, 2024-09-19T07:14:25.860 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-5.jpg" 2024-09-19T07:14:25.860 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.860 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.860 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.860 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2726771421, 2024-09-19T07:14:25.860 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631739, 2024-09-19T07:14:25.860 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-19.xml" 2024-09-19T07:14:25.860 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.860 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.860 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.860 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2729988316, 2024-09-19T07:14:25.861 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632290, 2024-09-19T07:14:25.861 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-28.jpg" 2024-09-19T07:14:25.861 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.861 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.861 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.861 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2738128193, 2024-09-19T07:14:25.861 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632413, 2024-09-19T07:14:25.861 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-57.jpg" 2024-09-19T07:14:25.861 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.861 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.861 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.861 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2741165769, 2024-09-19T07:14:25.861 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631815, 2024-09-19T07:14:25.862 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-71.jpg" 2024-09-19T07:14:25.862 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.862 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.862 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.862 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2745728617, 2024-09-19T07:14:25.862 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630104, 2024-09-19T07:14:25.862 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-46.xml" 2024-09-19T07:14:25.862 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.862 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.862 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.862 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2750829092, 2024-09-19T07:14:25.862 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631932, 2024-09-19T07:14:25.862 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-15.jpg" 2024-09-19T07:14:25.862 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.863 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.863 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.863 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2771858904, 2024-09-19T07:14:25.863 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630239, 2024-09-19T07:14:25.863 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-4.xml" 2024-09-19T07:14:25.863 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.863 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.863 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.863 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2774890463, 2024-09-19T07:14:25.863 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631800, 2024-09-19T07:14:25.863 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-2.xml" 2024-09-19T07:14:25.863 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.863 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.864 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.864 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2794189320, 2024-09-19T07:14:25.864 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632105, 2024-09-19T07:14:25.864 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-38.xml" 2024-09-19T07:14:25.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.864 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.864 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2797042069, 2024-09-19T07:14:25.864 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630155, 2024-09-19T07:14:25.864 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-32.xml" 2024-09-19T07:14:25.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.864 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.865 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2797845641, 2024-09-19T07:14:25.865 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631795, 2024-09-19T07:14:25.865 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-5.xml" 2024-09-19T07:14:25.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.865 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.865 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.865 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2810921025, 2024-09-19T07:14:25.865 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632270, 2024-09-19T07:14:25.865 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-19.jpg" 2024-09-19T07:14:25.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.865 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.865 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.865 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2837465203, 2024-09-19T07:14:25.865 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630249, 2024-09-19T07:14:25.866 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-14.jpg" 2024-09-19T07:14:25.866 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.866 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.866 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2838388415, 2024-09-19T07:14:25.866 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632319, 2024-09-19T07:14:25.866 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-18.jpg" 2024-09-19T07:14:25.866 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.866 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.866 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2856558942, 2024-09-19T07:14:25.866 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630173, 2024-09-19T07:14:25.866 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-26.xml" 2024-09-19T07:14:25.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.867 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.867 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.867 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2861587224, 2024-09-19T07:14:25.867 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631679, 2024-09-19T07:14:25.867 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-41.xml" 2024-09-19T07:14:25.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.867 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.867 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.867 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2867968857, 2024-09-19T07:14:25.867 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632177, 2024-09-19T07:14:25.867 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-71.jpg" 2024-09-19T07:14:25.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.867 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.868 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.868 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2870730778, 2024-09-19T07:14:25.868 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632076, 2024-09-19T07:14:25.868 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-80.jpg" 2024-09-19T07:14:25.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.868 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.868 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2876997873, 2024-09-19T07:14:25.868 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632284, 2024-09-19T07:14:25.868 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-12.jpg" 2024-09-19T07:14:25.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.868 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.869 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2879457272, 2024-09-19T07:14:25.869 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632266, 2024-09-19T07:14:25.869 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-32.jpg" 2024-09-19T07:14:25.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.869 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.869 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2906787070, 2024-09-19T07:14:25.869 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632099, 2024-09-19T07:14:25.869 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-39.xml" 2024-09-19T07:14:25.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.869 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.869 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2910764367, 2024-09-19T07:14:25.869 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631827, 2024-09-19T07:14:25.870 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-62.jpg" 2024-09-19T07:14:25.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.870 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.870 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2917265994, 2024-09-19T07:14:25.870 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631908, 2024-09-19T07:14:25.870 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-24.jpg" 2024-09-19T07:14:25.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.870 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.870 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2932678515, 2024-09-19T07:14:25.870 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630170, 2024-09-19T07:14:25.870 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-27.xml" 2024-09-19T07:14:25.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.871 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.871 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2933003944, 2024-09-19T07:14:25.871 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631977, 2024-09-19T07:14:25.871 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-6.jpg" 2024-09-19T07:14:25.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.871 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.871 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2936122298, 2024-09-19T07:14:25.871 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632126, 2024-09-19T07:14:25.871 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-75.jpg" 2024-09-19T07:14:25.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.872 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.872 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2936877653, 2024-09-19T07:14:25.872 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632081, 2024-09-19T07:14:25.872 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-43.xml" 2024-09-19T07:14:25.872 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.872 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.872 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2947029249, 2024-09-19T07:14:25.872 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631675, 2024-09-19T07:14:25.872 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-42.xml" 2024-09-19T07:14:25.872 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.872 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.873 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2954630080, 2024-09-19T07:14:25.873 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632025, 2024-09-19T07:14:25.873 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-53.xml" 2024-09-19T07:14:25.873 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.873 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.873 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.873 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2969251531, 2024-09-19T07:14:25.873 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632016, 2024-09-19T07:14:25.873 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-87.jpg" 2024-09-19T07:14:25.873 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.873 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.873 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.873 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 2973796083, 2024-09-19T07:14:25.874 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632221, 2024-09-19T07:14:25.874 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-43.xml" 2024-09-19T07:14:25.874 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.874 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.874 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3004304692, 2024-09-19T07:14:25.874 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511629992, 2024-09-19T07:14:25.874 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-72.xml" 2024-09-19T07:14:25.874 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.874 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.874 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3009503335, 2024-09-19T07:14:25.874 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631890, 2024-09-19T07:14:25.875 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-33.jpg" 2024-09-19T07:14:25.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.875 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.875 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3033765241, 2024-09-19T07:14:25.875 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631767, 2024-09-19T07:14:25.875 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-12.xml" 2024-09-19T07:14:25.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.875 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.875 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3040394810, 2024-09-19T07:14:25.875 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632010, 2024-09-19T07:14:25.875 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-88.jpg" 2024-09-19T07:14:25.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.876 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.876 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3045523918, 2024-09-19T07:14:25.876 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632596, 2024-09-19T07:14:25.876 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-10.jpg" 2024-09-19T07:14:25.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.876 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.876 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3050754596, 2024-09-19T07:14:25.876 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630134, 2024-09-19T07:14:25.876 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-38.xml" 2024-09-19T07:14:25.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.877 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.877 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3055311278, 2024-09-19T07:14:25.877 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631959, 2024-09-19T07:14:25.877 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/article-7.xml" 2024-09-19T07:14:25.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.877 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.877 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3056821560, 2024-09-19T07:14:25.877 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632560, 2024-09-19T07:14:25.877 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-20.jpg" 2024-09-19T07:14:25.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.877 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.878 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3070498583, 2024-09-19T07:14:25.878 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632015, 2024-09-19T07:14:25.878 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-29.xml" 2024-09-19T07:14:25.878 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.878 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.878 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.878 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3087276558, 2024-09-19T07:14:25.878 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630250, 2024-09-19T07:14:25.878 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-13.jpg" 2024-09-19T07:14:25.878 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.878 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.878 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.878 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3090280216, 2024-09-19T07:14:25.879 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632574, 2024-09-19T07:14:25.879 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-16.jpg" 2024-09-19T07:14:25.879 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.879 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.879 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.879 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3102636777, 2024-09-19T07:14:25.879 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630000, 2024-09-19T07:14:25.879 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-70.xml" 2024-09-19T07:14:25.879 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.879 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.879 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.879 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3112535212, 2024-09-19T07:14:25.879 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632516, 2024-09-19T07:14:25.879 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-34.jpg" 2024-09-19T07:14:25.880 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.880 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.880 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.880 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3114621460, 2024-09-19T07:14:25.880 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632380, 2024-09-19T07:14:25.880 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-38.xml" 2024-09-19T07:14:25.880 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.880 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.880 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.880 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3116130406, 2024-09-19T07:14:25.880 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632388, 2024-09-19T07:14:25.880 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-37.xml" 2024-09-19T07:14:25.880 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.881 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.881 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.881 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3116206970, 2024-09-19T07:14:25.881 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631709, 2024-09-19T07:14:25.881 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-29.xml" 2024-09-19T07:14:25.881 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.881 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.881 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.881 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3118141743, 2024-09-19T07:14:25.881 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632084, 2024-09-19T07:14:25.881 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-17.xml" 2024-09-19T07:14:25.881 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.881 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.881 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.882 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3124661663, 2024-09-19T07:14:25.882 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632112, 2024-09-19T07:14:25.882 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-11.xml" 2024-09-19T07:14:25.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.882 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.882 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3132313051, 2024-09-19T07:14:25.882 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631308, 2024-09-19T07:14:25.882 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-4.xml" 2024-09-19T07:14:25.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.882 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.882 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3187863394, 2024-09-19T07:14:25.883 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631858, 2024-09-19T07:14:25.883 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-49.jpg" 2024-09-19T07:14:25.883 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.883 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.883 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.883 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3201144334, 2024-09-19T07:14:25.883 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631894, 2024-09-19T07:14:25.883 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-31.jpg" 2024-09-19T07:14:25.883 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.883 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.883 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.883 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3206608789, 2024-09-19T07:14:25.883 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631619, 2024-09-19T07:14:25.883 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-60.xml" 2024-09-19T07:14:25.884 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.884 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.884 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.884 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3208637310, 2024-09-19T07:14:25.884 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632185, 2024-09-19T07:14:25.884 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-41.jpg" 2024-09-19T07:14:25.884 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.884 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.884 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.884 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3236062708, 2024-09-19T07:14:25.884 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631918, 2024-09-19T07:14:25.884 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-19.jpg" 2024-09-19T07:14:25.884 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.885 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.885 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3236102682, 2024-09-19T07:14:25.885 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632462, 2024-09-19T07:14:25.885 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-48.jpg" 2024-09-19T07:14:25.885 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.885 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.885 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3236955854, 2024-09-19T07:14:25.885 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630048, 2024-09-19T07:14:25.885 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-58.xml" 2024-09-19T07:14:25.885 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.886 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.886 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3238956671, 2024-09-19T07:14:25.886 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631668, 2024-09-19T07:14:25.886 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-44.xml" 2024-09-19T07:14:25.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.886 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.886 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.886 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3243136772, 2024-09-19T07:14:25.886 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632359, 2024-09-19T07:14:25.886 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-1.jpg" 2024-09-19T07:14:25.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.886 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.886 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.887 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3249654378, 2024-09-19T07:14:25.887 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631882, 2024-09-19T07:14:25.887 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-37.jpg" 2024-09-19T07:14:25.887 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.887 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.887 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.887 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3253668549, 2024-09-19T07:14:25.887 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631780, 2024-09-19T07:14:25.887 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-9.xml" 2024-09-19T07:14:25.887 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.887 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.887 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.887 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3261796115, 2024-09-19T07:14:25.888 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632537, 2024-09-19T07:14:25.888 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-27.jpg" 2024-09-19T07:14:25.888 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.888 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.888 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.888 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3266468821, 2024-09-19T07:14:25.888 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630004, 2024-09-19T07:14:25.888 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-69.xml" 2024-09-19T07:14:25.888 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.888 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.888 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.888 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3275448418, 2024-09-19T07:14:25.888 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632061, 2024-09-19T07:14:25.889 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-21.xml" 2024-09-19T07:14:25.889 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.889 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.889 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.889 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3305215397, 2024-09-19T07:14:25.889 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631838, 2024-09-19T07:14:25.889 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-57.jpg" 2024-09-19T07:14:25.889 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.889 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.889 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.889 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3307503956, 2024-09-19T07:14:25.889 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630176, 2024-09-19T07:14:25.889 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-25.xml" 2024-09-19T07:14:25.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.890 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.890 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3327570336, 2024-09-19T07:14:25.890 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631792, 2024-09-19T07:14:25.890 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-6.xml" 2024-09-19T07:14:25.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.890 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.890 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3329885931, 2024-09-19T07:14:25.890 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632056, 2024-09-19T07:14:25.890 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-22.xml" 2024-09-19T07:14:25.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.891 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.891 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3377080150, 2024-09-19T07:14:25.891 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632506, 2024-09-19T07:14:25.891 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-37.jpg" 2024-09-19T07:14:25.891 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.891 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.891 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.891 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3381340727, 2024-09-19T07:14:25.891 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630057, 2024-09-19T07:14:25.891 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-56.xml" 2024-09-19T07:14:25.891 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.891 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.891 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.892 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3381542292, 2024-09-19T07:14:25.892 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632204, 2024-09-19T07:14:25.892 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-39.jpg" 2024-09-19T07:14:25.892 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.892 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.892 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.892 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3382671156, 2024-09-19T07:14:25.892 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630258, 2024-09-19T07:14:25.892 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-6.jpg" 2024-09-19T07:14:25.892 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.892 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.892 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.892 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3420477847, 2024-09-19T07:14:25.892 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630257, 2024-09-19T07:14:25.893 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-7.jpg" 2024-09-19T07:14:25.893 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.893 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.893 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.893 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3425963951, 2024-09-19T07:14:25.893 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631842, 2024-09-19T07:14:25.893 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-55.jpg" 2024-09-19T07:14:25.893 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.893 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.893 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.893 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3431612153, 2024-09-19T07:14:25.893 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631300, 2024-09-19T07:14:25.893 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-6.xml" 2024-09-19T07:14:25.894 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.894 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.894 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.894 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3432809636, 2024-09-19T07:14:25.894 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632394, 2024-09-19T07:14:25.894 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-60.jpg" 2024-09-19T07:14:25.894 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.894 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.894 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.894 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3436620660, 2024-09-19T07:14:25.894 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632022, 2024-09-19T07:14:25.894 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-28.xml" 2024-09-19T07:14:25.894 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.894 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.895 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.895 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3439081405, 2024-09-19T07:14:25.895 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630035, 2024-09-19T07:14:25.895 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-61.xml" 2024-09-19T07:14:25.895 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.895 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.895 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.895 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3462499260, 2024-09-19T07:14:25.895 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632310, 2024-09-19T07:14:25.895 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-3.jpg" 2024-09-19T07:14:25.895 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.895 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.895 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.895 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3468850378, 2024-09-19T07:14:25.896 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630070, 2024-09-19T07:14:25.896 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-53.xml" 2024-09-19T07:14:25.896 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.896 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.896 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.896 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3472871501, 2024-09-19T07:14:25.896 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632137, 2024-09-19T07:14:25.896 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-31.xml" 2024-09-19T07:14:25.896 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.896 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.896 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.896 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3478210603, 2024-09-19T07:14:25.897 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630247, 2024-09-19T07:14:25.897 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-16.jpg" 2024-09-19T07:14:25.897 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.897 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.897 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.897 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3485732734, 2024-09-19T07:14:25.897 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631986, 2024-09-19T07:14:25.897 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/article-2.xml" 2024-09-19T07:14:25.897 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.897 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.897 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.897 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3497331018, 2024-09-19T07:14:25.897 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630212, 2024-09-19T07:14:25.897 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-13.xml" 2024-09-19T07:14:25.898 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.898 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.898 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.898 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3514377241, 2024-09-19T07:14:25.898 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632390, 2024-09-19T07:14:25.898 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-61.jpg" 2024-09-19T07:14:25.898 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.898 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.898 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.898 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3542144942, 2024-09-19T07:14:25.898 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631956, 2024-09-19T07:14:25.898 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-10.jpg" 2024-09-19T07:14:25.898 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.898 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.898 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.899 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3554555443, 2024-09-19T07:14:25.899 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632241, 2024-09-19T07:14:25.899 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-8.xml" 2024-09-19T07:14:25.899 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.899 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.899 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.899 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3576796906, 2024-09-19T07:14:25.899 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632580, 2024-09-19T07:14:25.899 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-14.jpg" 2024-09-19T07:14:25.899 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.899 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.899 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.899 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3584396968, 2024-09-19T07:14:25.899 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632023, 2024-09-19T07:14:25.900 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-86.jpg" 2024-09-19T07:14:25.900 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.900 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.900 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.900 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3617204365, 2024-09-19T07:14:25.900 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632401, 2024-09-19T07:14:25.900 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-59.jpg" 2024-09-19T07:14:25.900 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.900 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.900 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.900 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3622996301, 2024-09-19T07:14:25.900 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630243, 2024-09-19T07:14:25.900 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-2.xml" 2024-09-19T07:14:25.900 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.900 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.901 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.901 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3626731386, 2024-09-19T07:14:25.901 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632058, 2024-09-19T07:14:25.901 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-47.xml" 2024-09-19T07:14:25.901 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.901 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.901 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.901 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3644240561, 2024-09-19T07:14:25.901 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632592, 2024-09-19T07:14:25.901 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-11.jpg" 2024-09-19T07:14:25.901 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.901 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.901 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.902 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3672102100, 2024-09-19T07:14:25.902 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632181, 2024-09-19T07:14:25.902 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-22.xml" 2024-09-19T07:14:25.902 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.902 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.902 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.902 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3679623087, 2024-09-19T07:14:25.902 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632042, 2024-09-19T07:14:25.902 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-50.xml" 2024-09-19T07:14:25.902 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.902 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.902 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.902 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3683155660, 2024-09-19T07:14:25.902 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632054, 2024-09-19T07:14:25.903 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-82.jpg" 2024-09-19T07:14:25.903 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.903 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.903 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.903 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3694017725, 2024-09-19T07:14:25.903 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631811, 2024-09-19T07:14:25.903 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-73.jpg" 2024-09-19T07:14:25.903 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.903 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.903 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.903 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3694809834, 2024-09-19T07:14:25.903 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632224, 2024-09-19T07:14:25.903 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-13.xml" 2024-09-19T07:14:25.903 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.903 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.904 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.904 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3724041245, 2024-09-19T07:14:25.904 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631888, 2024-09-19T07:14:25.904 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-34.jpg" 2024-09-19T07:14:25.904 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.904 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.904 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.904 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3728228307, 2024-09-19T07:14:25.904 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631288, 2024-09-19T07:14:25.904 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-10.xml" 2024-09-19T07:14:25.904 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.904 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.904 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.905 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3734668259, 2024-09-19T07:14:25.905 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631278, 2024-09-19T07:14:25.905 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-13.xml" 2024-09-19T07:14:25.905 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.905 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.905 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.905 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3736870388, 2024-09-19T07:14:25.905 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631772, 2024-09-19T07:14:25.905 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-11.xml" 2024-09-19T07:14:25.905 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.905 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.905 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.905 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3737881339, 2024-09-19T07:14:25.906 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630227, 2024-09-19T07:14:25.906 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-8.xml" 2024-09-19T07:14:25.906 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.906 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.906 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.906 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3745654687, 2024-09-19T07:14:25.906 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632243, 2024-09-19T07:14:25.906 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-40.xml" 2024-09-19T07:14:25.906 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.906 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.906 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.906 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3749433966, 2024-09-19T07:14:25.906 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632085, 2024-09-19T07:14:25.906 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-42.xml" 2024-09-19T07:14:25.906 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.907 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.907 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.907 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3751709190, 2024-09-19T07:14:25.907 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632232, 2024-09-19T07:14:25.907 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-11.xml" 2024-09-19T07:14:25.907 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.907 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.907 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.907 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3756143678, 2024-09-19T07:14:25.907 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631854, 2024-09-19T07:14:25.907 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-51.jpg" 2024-09-19T07:14:25.907 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.907 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.907 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.907 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3775898948, 2024-09-19T07:14:25.907 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631647, 2024-09-19T07:14:25.908 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-52.xml" 2024-09-19T07:14:25.908 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.908 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.908 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.908 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3783538414, 2024-09-19T07:14:25.908 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631994, 2024-09-19T07:14:25.908 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-3.jpg" 2024-09-19T07:14:25.908 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.908 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.908 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.908 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3787276932, 2024-09-19T07:14:25.908 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631274, 2024-09-19T07:14:25.908 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-15.xml" 2024-09-19T07:14:25.909 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.909 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.909 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.909 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3790088151, 2024-09-19T07:14:25.909 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631721, 2024-09-19T07:14:25.909 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-24.xml" 2024-09-19T07:14:25.909 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.909 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.909 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.909 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3796238242, 2024-09-19T07:14:25.909 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632481, 2024-09-19T07:14:25.909 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-43.jpg" 2024-09-19T07:14:25.909 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.909 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.909 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.910 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3800895427, 2024-09-19T07:14:25.910 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632254, 2024-09-19T07:14:25.910 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-34.jpg" 2024-09-19T07:14:25.910 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.910 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.910 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.910 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3812392283, 2024-09-19T07:14:25.910 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630085, 2024-09-19T07:14:25.910 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-50.xml" 2024-09-19T07:14:25.910 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.910 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.910 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.910 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3834249984, 2024-09-19T07:14:25.910 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631914, 2024-09-19T07:14:25.910 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-21.jpg" 2024-09-19T07:14:25.911 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.911 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.911 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.911 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3834699944, 2024-09-19T07:14:25.911 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632190, 2024-09-19T07:14:25.911 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-69.jpg" 2024-09-19T07:14:25.911 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.911 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.911 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.911 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3834895105, 2024-09-19T07:14:25.911 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631314, 2024-09-19T07:14:25.911 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-3.xml" 2024-09-19T07:14:25.911 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.912 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.912 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.912 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3837050921, 2024-09-19T07:14:25.912 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631787, 2024-09-19T07:14:25.912 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-7.xml" 2024-09-19T07:14:25.912 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.912 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.912 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.912 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3838126055, 2024-09-19T07:14:25.912 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632233, 2024-09-19T07:14:25.912 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-41.xml" 2024-09-19T07:14:25.912 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.912 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.912 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.913 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3850439888, 2024-09-19T07:14:25.913 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632119, 2024-09-19T07:14:25.913 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-10.xml" 2024-09-19T07:14:25.913 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.913 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.913 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.913 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3850734620, 2024-09-19T07:14:25.913 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632473, 2024-09-19T07:14:25.913 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-45.jpg" 2024-09-19T07:14:25.913 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.913 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.913 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.913 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3850766228, 2024-09-19T07:14:25.914 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632097, 2024-09-19T07:14:25.914 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-14.xml" 2024-09-19T07:14:25.914 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.914 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.914 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.914 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3853599201, 2024-09-19T07:14:25.914 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632321, 2024-09-19T07:14:25.914 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-17.jpg" 2024-09-19T07:14:25.914 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.914 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.914 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.914 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3854266145, 2024-09-19T07:14:25.914 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631998, 2024-09-19T07:14:25.914 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-90.jpg" 2024-09-19T07:14:25.915 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.915 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.915 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.915 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3857681322, 2024-09-19T07:14:25.915 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631860, 2024-09-19T07:14:25.915 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-48.jpg" 2024-09-19T07:14:25.915 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.915 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.915 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.915 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3886591609, 2024-09-19T07:14:25.915 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631851, 2024-09-19T07:14:25.915 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-52.jpg" 2024-09-19T07:14:25.915 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.915 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.916 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.916 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3927827754, 2024-09-19T07:14:25.916 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631864, 2024-09-19T07:14:25.916 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-46.jpg" 2024-09-19T07:14:25.916 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.916 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.916 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.916 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3938662789, 2024-09-19T07:14:25.916 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632170, 2024-09-19T07:14:25.916 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-1.xml" 2024-09-19T07:14:25.916 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.916 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.916 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.916 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3942885265, 2024-09-19T07:14:25.916 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632302, 2024-09-19T07:14:25.917 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-24.jpg" 2024-09-19T07:14:25.917 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.917 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.917 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.917 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3958547017, 2024-09-19T07:14:25.917 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628295, 2024-09-19T07:14:25.917 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/man/Makefile.in" 2024-09-19T07:14:25.917 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.917 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.917 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.917 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3981552389, 2024-09-19T07:14:25.917 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631714, 2024-09-19T07:14:25.917 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-27.xml" 2024-09-19T07:14:25.917 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.918 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.918 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.918 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3986089899, 2024-09-19T07:14:25.918 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631988, 2024-09-19T07:14:25.918 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-4.jpg" 2024-09-19T07:14:25.918 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.918 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.918 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.918 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3992111595, 2024-09-19T07:14:25.918 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632070, 2024-09-19T07:14:25.918 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-45.xml" 2024-09-19T07:14:25.918 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.918 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.919 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.919 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 3998976708, 2024-09-19T07:14:25.919 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632288, 2024-09-19T07:14:25.919 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-29.jpg" 2024-09-19T07:14:25.919 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.919 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.919 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.919 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4004319297, 2024-09-19T07:14:25.919 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631941, 2024-09-19T07:14:25.919 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-13.jpg" 2024-09-19T07:14:25.919 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.919 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.919 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.919 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4011037168, 2024-09-19T07:14:25.920 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631323, 2024-09-19T07:14:25.920 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-1.xml" 2024-09-19T07:14:25.920 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.920 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.920 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.920 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4012700170, 2024-09-19T07:14:25.920 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632244, 2024-09-19T07:14:25.920 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-7.xml" 2024-09-19T07:14:25.920 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.920 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.920 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.920 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4012733322, 2024-09-19T07:14:25.920 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632260, 2024-09-19T07:14:25.921 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-33.jpg" 2024-09-19T07:14:25.921 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.921 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.921 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.921 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4036290777, 2024-09-19T07:14:25.921 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631916, 2024-09-19T07:14:25.921 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-20.jpg" 2024-09-19T07:14:25.921 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.921 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.921 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.921 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4045948395, 2024-09-19T07:14:25.921 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631880, 2024-09-19T07:14:25.921 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-38.jpg" 2024-09-19T07:14:25.921 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.922 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.922 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.922 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4047818460, 2024-09-19T07:14:25.922 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511628293, 2024-09-19T07:14:25.922 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/man/blogbench.8" 2024-09-19T07:14:25.922 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.922 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.922 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.922 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4063715339, 2024-09-19T07:14:25.922 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631923, 2024-09-19T07:14:25.922 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-17.jpg" 2024-09-19T07:14:25.922 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.922 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.922 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.923 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4068183075, 2024-09-19T07:14:25.923 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631304, 2024-09-19T07:14:25.923 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-5.xml" 2024-09-19T07:14:25.923 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.923 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.923 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.923 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4078207165, 2024-09-19T07:14:25.923 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632217, 2024-09-19T07:14:25.923 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-66.jpg" 2024-09-19T07:14:25.923 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.923 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.923 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.923 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4095338044, 2024-09-19T07:14:25.923 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632079, 2024-09-19T07:14:25.924 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-18.xml" 2024-09-19T07:14:25.924 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.924 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.924 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.924 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4110156973, 2024-09-19T07:14:25.924 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631692, 2024-09-19T07:14:25.924 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-36.xml" 2024-09-19T07:14:25.924 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.924 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.924 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.924 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4113797146, 2024-09-19T07:14:25.924 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632003, 2024-09-19T07:14:25.924 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-89.jpg" 2024-09-19T07:14:25.925 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.925 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.925 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.925 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4117483138, 2024-09-19T07:14:25.925 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632110, 2024-09-19T07:14:25.925 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-37.xml" 2024-09-19T07:14:25.925 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.925 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.925 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.925 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4130593446, 2024-09-19T07:14:25.925 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632158, 2024-09-19T07:14:25.925 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-3.xml" 2024-09-19T07:14:25.925 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.926 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.926 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.926 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4151043008, 2024-09-19T07:14:25.926 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632205, 2024-09-19T07:14:25.926 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-17.xml" 2024-09-19T07:14:25.926 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.926 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.926 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.926 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4153874610, 2024-09-19T07:14:25.926 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630031, 2024-09-19T07:14:25.926 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-62.xml" 2024-09-19T07:14:25.926 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.926 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.926 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.927 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4165205927, 2024-09-19T07:14:25.927 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632263, 2024-09-19T07:14:25.927 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-23.jpg" 2024-09-19T07:14:25.927 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.927 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.927 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.927 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4174485611, 2024-09-19T07:14:25.927 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631831, 2024-09-19T07:14:25.927 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-60.jpg" 2024-09-19T07:14:25.927 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.927 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.927 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.927 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4178253967, 2024-09-19T07:14:25.928 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632378, 2024-09-19T07:14:25.928 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-63.jpg" 2024-09-19T07:14:25.928 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.928 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.928 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.928 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4197067323, 2024-09-19T07:14:25.928 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631817, 2024-09-19T07:14:25.928 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-70.jpg" 2024-09-19T07:14:25.928 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.928 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.928 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.928 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4197887823, 2024-09-19T07:14:25.928 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631284, 2024-09-19T07:14:25.929 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-11.xml" 2024-09-19T07:14:25.929 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.929 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.929 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.929 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4199472425, 2024-09-19T07:14:25.929 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632604, 2024-09-19T07:14:25.929 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-8.jpg" 2024-09-19T07:14:25.929 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.929 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.929 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.929 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4201664615, 2024-09-19T07:14:25.929 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631688, 2024-09-19T07:14:25.929 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-38.xml" 2024-09-19T07:14:25.930 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.930 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.930 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.930 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4217947921, 2024-09-19T07:14:25.930 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630203, 2024-09-19T07:14:25.930 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-16.xml" 2024-09-19T07:14:25.930 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.930 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.930 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.930 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4230067420, 2024-09-19T07:14:25.930 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632216, 2024-09-19T07:14:25.930 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-38.jpg" 2024-09-19T07:14:25.930 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.930 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.931 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.931 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4230734928, 2024-09-19T07:14:25.931 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632053, 2024-09-19T07:14:25.931 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-48.xml" 2024-09-19T07:14:25.931 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.931 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.931 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.931 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4251842015, 2024-09-19T07:14:25.931 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630185, 2024-09-19T07:14:25.931 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-22.xml" 2024-09-19T07:14:25.931 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.931 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.931 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.931 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4260590801, 2024-09-19T07:14:25.932 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631280, 2024-09-19T07:14:25.932 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-12.xml" 2024-09-19T07:14:25.932 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.932 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.932 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.932 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4270339944, 2024-09-19T07:14:25.932 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632470, 2024-09-19T07:14:25.932 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-46.jpg" 2024-09-19T07:14:25.932 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.932 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.932 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.932 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4273970065, 2024-09-19T07:14:25.932 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511630241, 2024-09-19T07:14:25.932 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-3.xml" 2024-09-19T07:14:25.933 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.933 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.933 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.933 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4280437247, 2024-09-19T07:14:25.933 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511631874, 2024-09-19T07:14:25.933 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-41.jpg" 2024-09-19T07:14:25.933 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.933 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.933 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.933 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4283275880, 2024-09-19T07:14:25.933 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632341, 2024-09-19T07:14:25.933 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-8.jpg" 2024-09-19T07:14:25.933 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.934 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.934 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.934 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4284837836, 2024-09-19T07:14:25.934 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632187, 2024-09-19T07:14:25.934 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-21.xml" 2024-09-19T07:14:25.934 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.934 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.934 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.934 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4288850448, 2024-09-19T07:14:25.934 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632297, 2024-09-19T07:14:25.934 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-26.jpg" 2024-09-19T07:14:25.934 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:25.934 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:14:25.935 INFO:teuthology.orchestra.run.smithi148.stdout: "damage_type": "backtrace", 2024-09-19T07:14:25.935 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4292757306, 2024-09-19T07:14:25.935 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 1099511632361, 2024-09-19T07:14:25.935 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-65.jpg" 2024-09-19T07:14:25.935 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:14:25.935 INFO:teuthology.orchestra.run.smithi148.stdout:] 2024-09-19T07:14:27.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:26 smithi148 ceph-mon[31180]: pgmap v104: 97 pgs: 97 active+clean; 295 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 460 op/s 2024-09-19T07:14:27.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:26 smithi165 ceph-mon[35326]: pgmap v104: 97 pgs: 97 active+clean; 295 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 460 op/s 2024-09-19T07:14:27.206 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T07:14:27.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:26 smithi179 ceph-mon[35716]: pgmap v104: 97 pgs: 97 active+clean; 295 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 460 op/s 2024-09-19T07:14:27.518 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:14:28.007 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:27 smithi148 ceph-mon[31180]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:14:28.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:27 smithi165 ceph-mon[35326]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:14:28.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:27 smithi179 ceph-mon[35716]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:14:28.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.351+0000 7fbffa171640 1 -- 172.21.15.148:0/2623465111 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbff411b140 msgr2=0x7fbff411d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:28.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.351+0000 7fbffa171640 1 --2- 172.21.15.148:0/2623465111 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbff411b140 0x7fbff411d530 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fbfe4009900 tx=0x7fbfe402a420 comp rx=0 tx=0).stop 2024-09-19T07:14:28.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.352+0000 7fbffa171640 1 -- 172.21.15.148:0/2623465111 shutdown_connections 2024-09-19T07:14:28.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.352+0000 7fbffa171640 1 --2- 172.21.15.148:0/2623465111 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbff411b140 0x7fbff411d530 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:28.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.352+0000 7fbffa171640 1 --2- 172.21.15.148:0/2623465111 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbff406ea30 0x7fbff406ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:28.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.352+0000 7fbffa171640 1 --2- 172.21.15.148:0/2623465111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbff4110190 0x7fbff406e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:28.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.352+0000 7fbffa171640 1 -- 172.21.15.148:0/2623465111 >> 172.21.15.148:0/2623465111 conn(0x7fbff4073180 msgr2=0x7fbff4073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:28.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.357+0000 7fbffa171640 1 -- 172.21.15.148:0/2623465111 shutdown_connections 2024-09-19T07:14:28.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.358+0000 7fbffa171640 1 -- 172.21.15.148:0/2623465111 wait complete. 2024-09-19T07:14:28.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.360+0000 7fbffa171640 1 Processor -- start 2024-09-19T07:14:28.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.360+0000 7fbffa171640 1 -- start start 2024-09-19T07:14:28.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.360+0000 7fbffa171640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbff406ea30 0x7fbff41a7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:28.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.360+0000 7fbffa171640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbff4110190 0x7fbff41a7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:28.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.360+0000 7fbffa171640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbff411b140 0x7fbff41aba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:28.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.360+0000 7fbffa171640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbff4120bf0 con 0x7fbff411b140 2024-09-19T07:14:28.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.360+0000 7fbffa171640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbff4120a70 con 0x7fbff4110190 2024-09-19T07:14:28.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.360+0000 7fbffa171640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbff4120d70 con 0x7fbff406ea30 2024-09-19T07:14:28.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.361+0000 7fbff9970640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbff411b140 0x7fbff41aba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:28.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.361+0000 7fbff9970640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbff411b140 0x7fbff41aba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35394/0 (socket says 172.21.15.148:35394) 2024-09-19T07:14:28.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.361+0000 7fbff9970640 1 -- 172.21.15.148:0/3088245676 learned_addr learned my addr 172.21.15.148:0/3088245676 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:14:28.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.362+0000 7fbff9970640 1 -- 172.21.15.148:0/3088245676 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbff406ea30 msgr2=0x7fbff41a7150 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T07:14:28.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.362+0000 7fbff9970640 1 --2- 172.21.15.148:0/3088245676 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbff406ea30 0x7fbff41a7150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:28.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.362+0000 7fbff9970640 1 -- 172.21.15.148:0/3088245676 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbff4110190 msgr2=0x7fbff41a7690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T07:14:28.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.362+0000 7fbff9970640 1 --2- 172.21.15.148:0/3088245676 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbff4110190 0x7fbff41a7690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:28.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.362+0000 7fbff9970640 1 -- 172.21.15.148:0/3088245676 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbff41ac120 con 0x7fbff411b140 2024-09-19T07:14:28.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.362+0000 7fbff9970640 1 --2- 172.21.15.148:0/3088245676 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbff411b140 0x7fbff41aba20 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fbfe402a990 tx=0x7fbfe4003f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:28.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.365+0000 7fbfea7fc640 1 -- 172.21.15.148:0/3088245676 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe403f070 con 0x7fbff411b140 2024-09-19T07:14:28.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.365+0000 7fbfea7fc640 1 -- 172.21.15.148:0/3088245676 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfe4031c90 con 0x7fbff411b140 2024-09-19T07:14:28.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.365+0000 7fbfea7fc640 1 -- 172.21.15.148:0/3088245676 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe4035030 con 0x7fbff411b140 2024-09-19T07:14:28.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.365+0000 7fbffa171640 1 -- 172.21.15.148:0/3088245676 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbff41ac3b0 con 0x7fbff411b140 2024-09-19T07:14:28.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.365+0000 7fbffa171640 1 -- 172.21.15.148:0/3088245676 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbff41ac840 con 0x7fbff411b140 2024-09-19T07:14:28.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.376+0000 7fbffd7ac740 1 Processor -- start 2024-09-19T07:14:28.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.376+0000 7fbffd7ac740 1 -- start start 2024-09-19T07:14:28.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.376+0000 7fbffd7ac740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5629a3baecf0 0x5629a3bad240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:28.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.377+0000 7fbffd7ac740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629a3bad780 0x5629a3badbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:28.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.377+0000 7fbffd7ac740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629a3bb8520 0x5629a3bba910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:28.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.377+0000 7fbffd7ac740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5629a3b132f0 con 0x5629a3bad780 2024-09-19T07:14:28.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.377+0000 7fbffd7ac740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5629a3abacf0 con 0x5629a3baecf0 2024-09-19T07:14:28.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.377+0000 7fbffd7ac740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5629a3b0f2b0 con 0x5629a3bb8520 2024-09-19T07:14:28.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.377+0000 7fbff916f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629a3bad780 0x5629a3badbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:28.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.377+0000 7fbfea7fc640 1 -- 172.21.15.148:0/3088245676 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fbfe4042070 con 0x7fbff411b140 2024-09-19T07:14:28.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.378+0000 7fbff916f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629a3bad780 0x5629a3badbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35400/0 (socket says 172.21.15.148:35400) 2024-09-19T07:14:28.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.378+0000 7fbff916f640 1 -- 172.21.15.148:0/2587530641 learned_addr learned my addr 172.21.15.148:0/2587530641 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:14:28.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.379+0000 7fbff916f640 1 -- 172.21.15.148:0/2587530641 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629a3bb8520 msgr2=0x5629a3bba910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:28.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.379+0000 7fbff916f640 1 --2- 172.21.15.148:0/2587530641 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629a3bb8520 0x5629a3bba910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:28.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.379+0000 7fbff916f640 1 -- 172.21.15.148:0/2587530641 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5629a3baecf0 msgr2=0x5629a3bad240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:28.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.378+0000 7fbff896e640 1 --2- 172.21.15.148:0/2587530641 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5629a3baecf0 0x5629a3bad240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:28.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.379+0000 7fbff916f640 1 --2- 172.21.15.148:0/2587530641 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5629a3baecf0 0x5629a3bad240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:28.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.379+0000 7fbff916f640 1 -- 172.21.15.148:0/2587530641 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629a3a9f3a0 con 0x5629a3bad780 2024-09-19T07:14:28.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.380+0000 7fbff916f640 1 --2- 172.21.15.148:0/2587530641 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629a3bad780 0x5629a3badbc0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fbfec007ed0 tx=0x7fbfec00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e63c81d183ef795c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:28.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.381+0000 7fbff896e640 1 --2- 172.21.15.148:0/2587530641 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5629a3baecf0 0x5629a3bad240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:14:28.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.383+0000 7fbfea7fc640 1 --2- 172.21.15.148:0/3088245676 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fbfe00a35c0 0x7fbfe00a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:28.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.383+0000 7fbfea7fc640 1 -- 172.21.15.148:0/3088245676 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fbfe40f1490 con 0x7fbff411b140 2024-09-19T07:14:28.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.384+0000 7fbfdf7fe640 1 -- 172.21.15.148:0/2587530641 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfec014070 con 0x5629a3bad780 2024-09-19T07:14:28.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.384+0000 7fbff896e640 1 --2- 172.21.15.148:0/3088245676 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fbfe00a35c0 0x7fbfe00a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:28.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.384+0000 7fbfdf7fe640 1 -- 172.21.15.148:0/2587530641 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfec00fb30 con 0x5629a3bad780 2024-09-19T07:14:28.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.384+0000 7fbfdf7fe640 1 -- 172.21.15.148:0/2587530641 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfec00ec00 con 0x5629a3bad780 2024-09-19T07:14:28.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.385+0000 7fbff896e640 1 --2- 172.21.15.148:0/3088245676 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fbfe00a35c0 0x7fbfe00a5a80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbff0008fd0 tx=0x7fbff0008e40 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:28.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.388+0000 7fbffd7ac740 1 -- 172.21.15.148:0/2587530641 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629a3bad780 msgr2=0x5629a3badbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:28.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.388+0000 7fbffd7ac740 1 --2- 172.21.15.148:0/2587530641 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629a3bad780 0x5629a3badbc0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fbfec007ed0 tx=0x7fbfec00c6a0 comp rx=0 tx=0).stop 2024-09-19T07:14:28.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.390+0000 7fbffd7ac740 1 -- 172.21.15.148:0/2587530641 shutdown_connections 2024-09-19T07:14:28.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.390+0000 7fbffd7ac740 1 --2- 172.21.15.148:0/2587530641 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629a3bb8520 0x5629a3bba910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:28.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.390+0000 7fbffd7ac740 1 --2- 172.21.15.148:0/2587530641 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629a3bad780 0x5629a3badbc0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:28.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.390+0000 7fbffd7ac740 1 --2- 172.21.15.148:0/2587530641 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5629a3baecf0 0x5629a3bad240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:28.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.390+0000 7fbffd7ac740 1 -- 172.21.15.148:0/2587530641 >> 172.21.15.148:0/2587530641 conn(0x5629a3b76310 msgr2=0x5629a3ba9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:28.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.394+0000 7fbffd7ac740 1 -- 172.21.15.148:0/2587530641 shutdown_connections 2024-09-19T07:14:28.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.396+0000 7fbffd7ac740 1 -- 172.21.15.148:0/2587530641 wait complete. 2024-09-19T07:14:28.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.397+0000 7fbffd7ac740 1 -- start start 2024-09-19T07:14:28.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.397+0000 7fbffd7ac740 1 Processor -- start 2024-09-19T07:14:28.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.398+0000 7fbffd7ac740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629a3bad780 0x5629a3bb7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:28.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.398+0000 7fbffd7ac740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629a3baecf0 0x5629a3bb51f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:28.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.398+0000 7fbffd7ac740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5629a3bb8520 0x5629a3bb5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:28.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.398+0000 7fbffd7ac740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5629a3bbb220 con 0x5629a3bad780 2024-09-19T07:14:28.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.398+0000 7fbffd7ac740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5629a3ace060 con 0x5629a3bb8520 2024-09-19T07:14:28.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.398+0000 7fbffd7ac740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5629a3bbb3a0 con 0x5629a3baecf0 2024-09-19T07:14:28.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.398+0000 7fbffd7ac740 10 client.0 _ll_register_callbacks cb 0x5629a38218c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:14:28.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.399+0000 7fbff9970640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5629a3bb8520 0x5629a3bb5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:28.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.399+0000 7fbff9970640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5629a3bb8520 0x5629a3bb5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:40156/0 (socket says 172.21.15.148:40156) 2024-09-19T07:14:28.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.399+0000 7fbff9970640 1 -- 172.21.15.148:0/844151341 learned_addr learned my addr 172.21.15.148:0/844151341 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:14:28.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.399+0000 7fbff896e640 1 --2- 172.21.15.148:0/844151341 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629a3baecf0 0x5629a3bb51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:28.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.399+0000 7fbff916f640 1 --2- 172.21.15.148:0/844151341 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629a3bad780 0x5629a3bb7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:28.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.400+0000 7fbff916f640 1 -- 172.21.15.148:0/844151341 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629a3baecf0 msgr2=0x5629a3bb51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:28.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.400+0000 7fbff916f640 1 --2- 172.21.15.148:0/844151341 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629a3baecf0 0x5629a3bb51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:28.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.400+0000 7fbff916f640 1 -- 172.21.15.148:0/844151341 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5629a3bb8520 msgr2=0x5629a3bb5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:28.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.400+0000 7fbff916f640 1 --2- 172.21.15.148:0/844151341 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5629a3bb8520 0x5629a3bb5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:28.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.400+0000 7fbff916f640 1 -- 172.21.15.148:0/844151341 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629a38843c0 con 0x5629a3bad780 2024-09-19T07:14:28.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.400+0000 7fbff916f640 1 --2- 172.21.15.148:0/844151341 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629a3bad780 0x5629a3bb7f40 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fbfec007ed0 tx=0x7fbfec00e3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a74a16b7450ceeaf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:28.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.401+0000 7fbfdcff9640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:14:28.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.401+0000 7fbfdcff9640 1 -- 172.21.15.148:0/844151341 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfec025020 con 0x5629a3bad780 2024-09-19T07:14:28.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.401+0000 7fbffd7ac740 1 -- 172.21.15.148:0/844151341 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbfec00fb30 con 0x5629a3bad780 2024-09-19T07:14:28.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.401+0000 7fbfdcff9640 1 -- 172.21.15.148:0/844151341 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fbfec00f660 con 0x5629a3bad780 2024-09-19T07:14:28.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.402+0000 7fbfdcff9640 1 -- 172.21.15.148:0/844151341 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fbfec014050 con 0x5629a3bad780 2024-09-19T07:14:28.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.402+0000 7fbffd7ac740 10 client.16290 fetch_fsmap learned FSMap version 32 2024-09-19T07:14:28.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.402+0000 7fbffd7ac740 1 -- 172.21.15.148:0/844151341 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5629a3be8d00 con 0x5629a3bad780 2024-09-19T07:14:28.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.403+0000 7fbfdcff9640 1 -- 172.21.15.148:0/844151341 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfec00fb30 con 0x5629a3bad780 2024-09-19T07:14:28.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.404+0000 7fbfdcff9640 1 -- 172.21.15.148:0/844151341 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7fbfec00ed50 con 0x5629a3bad780 2024-09-19T07:14:28.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.404+0000 7fbffd7ac740 10 client.16290 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T07:14:28.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.404+0000 7fbffd7ac740 10 client.16290 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:14:28.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.404+0000 7fbffd7ac740 20 client.16290 populate_metadata read hostname 'smithi148' 2024-09-19T07:14:28.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.404+0000 7fbffd7ac740 1 --2- 172.21.15.148:0/844151341 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5629a3bea4d0 0x5629a3bec970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:28.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.404+0000 7fbffd7ac740 4 client.16290 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:14:28.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.404+0000 7fbffd7ac740 1 -- 172.21.15.148:0/844151341 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5629a3b20860 con 0x5629a3bea4d0 2024-09-19T07:14:28.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.406+0000 7fbff896e640 1 --2- 172.21.15.148:0/844151341 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5629a3bea4d0 0x5629a3bec970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:28.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.413+0000 7fbff896e640 1 --2- 172.21.15.148:0/844151341 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5629a3bea4d0 0x5629a3bec970 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1550890c5f695aa1 server_cookie=a8b4245cf2b0d41f in_seq=0 out_seq=0 2024-09-19T07:14:28.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.413+0000 7fbfdcff9640 10 client.16290 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:14:28.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.417+0000 7fbfdcff9640 1 -- 172.21.15.148:0/844151341 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5629a3b20860 con 0x5629a3bea4d0 2024-09-19T07:14:28.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.417+0000 7fbfdcff9640 10 client.16290 handle_command_reply: tid=0 2024-09-19T07:14:28.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.417+0000 7fbffd7ac740 1 client.16290 shutdown 2024-09-19T07:14:28.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.419+0000 7fbffd7ac740 1 -- 172.21.15.148:0/844151341 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629a3bad780 msgr2=0x5629a3bb7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:28.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.419+0000 7fbffd7ac740 1 --2- 172.21.15.148:0/844151341 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629a3bad780 0x5629a3bb7f40 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fbfec007ed0 tx=0x7fbfec00e3b0 comp rx=0 tx=0).stop 2024-09-19T07:14:28.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.419+0000 7fbffd7ac740 1 -- 172.21.15.148:0/844151341 shutdown_connections 2024-09-19T07:14:28.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.419+0000 7fbffd7ac740 1 --2- 172.21.15.148:0/844151341 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5629a3bea4d0 0x5629a3bec970 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:28.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.419+0000 7fbffd7ac740 1 --2- 172.21.15.148:0/844151341 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5629a3bb8520 0x5629a3bb5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:28.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.419+0000 7fbffd7ac740 1 --2- 172.21.15.148:0/844151341 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629a3baecf0 0x5629a3bb51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:28.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.419+0000 7fbffd7ac740 1 --2- 172.21.15.148:0/844151341 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629a3bad780 0x5629a3bb7f40 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:28.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.419+0000 7fbffd7ac740 1 -- 172.21.15.148:0/844151341 >> 172.21.15.148:0/844151341 conn(0x5629a3b76310 msgr2=0x5629a3bafae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:28.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.419+0000 7fbfdcff9640 0 client.16290 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:14:28.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.421+0000 7fbffd7ac740 1 -- 172.21.15.148:0/844151341 shutdown_connections 2024-09-19T07:14:28.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.421+0000 7fbffd7ac740 1 -- 172.21.15.148:0/844151341 wait complete. 2024-09-19T07:14:28.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.423+0000 7fbffd7ac740 20 client.16290 trim_cache size 0 max 16384 2024-09-19T07:14:28.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.464+0000 7fbffd7ac740 1 Processor -- start 2024-09-19T07:14:28.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.466+0000 7fbffd7ac740 1 -- start start 2024-09-19T07:14:28.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.466+0000 7fbffd7ac740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629a3bad780 0x5629a3bb4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:28.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.467+0000 7fbffd7ac740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629a3baecf0 0x5629a3ba8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:28.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.467+0000 7fbffd7ac740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5629a3bb8520 0x5629a3bb02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:28.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.467+0000 7fbffd7ac740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd8010f40 con 0x5629a3bad780 2024-09-19T07:14:28.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.467+0000 7fbffd7ac740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd800e7e0 con 0x5629a3bb8520 2024-09-19T07:14:28.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.467+0000 7fbff896e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629a3baecf0 0x5629a3ba8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:28.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.467+0000 7fbff916f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629a3bad780 0x5629a3bb4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:28.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.467+0000 7fbff896e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629a3baecf0 0x5629a3ba8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:50006/0 (socket says 172.21.15.148:50006) 2024-09-19T07:14:28.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.467+0000 7fbff896e640 1 -- 172.21.15.148:0/471689964 learned_addr learned my addr 172.21.15.148:0/471689964 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:14:28.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.467+0000 7fbffd7ac740 1 -- 172.21.15.148:0/471689964 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd800c6e0 con 0x5629a3baecf0 2024-09-19T07:14:28.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.468+0000 7fbff896e640 1 -- 172.21.15.148:0/471689964 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5629a3bb8520 msgr2=0x5629a3bb02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:28.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.468+0000 7fbff896e640 1 --2- 172.21.15.148:0/471689964 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5629a3bb8520 0x5629a3bb02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:28.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.468+0000 7fbff896e640 1 -- 172.21.15.148:0/471689964 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629a3bad780 msgr2=0x5629a3bb4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:28.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.468+0000 7fbff896e640 1 --2- 172.21.15.148:0/471689964 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629a3bad780 0x5629a3bb4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:28.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.468+0000 7fbff896e640 1 -- 172.21.15.148:0/471689964 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629a3bb5b70 con 0x5629a3baecf0 2024-09-19T07:14:28.472 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.471+0000 7fbff896e640 1 --2- 172.21.15.148:0/471689964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629a3baecf0 0x5629a3ba8dc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x5629a3bae220 tx=0x7fbff000f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfd2afb442d2f9a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:28.472 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.471+0000 7fbff916f640 1 --2- 172.21.15.148:0/471689964 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629a3bad780 0x5629a3bb4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:14:28.472 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.471+0000 7fbfdeffd640 1 -- 172.21.15.148:0/471689964 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff0008240 con 0x5629a3baecf0 2024-09-19T07:14:28.472 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.471+0000 7fbfdeffd640 1 -- 172.21.15.148:0/471689964 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbff000ce90 con 0x5629a3baecf0 2024-09-19T07:14:28.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.471+0000 7fbfdeffd640 1 -- 172.21.15.148:0/471689964 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff0021c30 con 0x5629a3baecf0 2024-09-19T07:14:28.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.473+0000 7fbffd7ac740 1 -- 172.21.15.148:0/471689964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629a3baecf0 msgr2=0x5629a3ba8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:28.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.473+0000 7fbffd7ac740 1 --2- 172.21.15.148:0/471689964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629a3baecf0 0x5629a3ba8dc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x5629a3bae220 tx=0x7fbff000f000 comp rx=0 tx=0).stop 2024-09-19T07:14:28.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.473+0000 7fbffd7ac740 1 -- 172.21.15.148:0/471689964 shutdown_connections 2024-09-19T07:14:28.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.473+0000 7fbffd7ac740 1 --2- 172.21.15.148:0/471689964 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5629a3bb8520 0x5629a3bb02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:28.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.473+0000 7fbffd7ac740 1 --2- 172.21.15.148:0/471689964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629a3baecf0 0x5629a3ba8dc0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:28.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.473+0000 7fbffd7ac740 1 --2- 172.21.15.148:0/471689964 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629a3bad780 0x5629a3bb4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:28.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.473+0000 7fbffd7ac740 1 -- 172.21.15.148:0/471689964 >> 172.21.15.148:0/471689964 conn(0x5629a3b76310 msgr2=0x5629a3ba86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:28.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.479+0000 7fbffd7ac740 1 -- 172.21.15.148:0/471689964 shutdown_connections 2024-09-19T07:14:28.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.480+0000 7fbffd7ac740 1 -- 172.21.15.148:0/471689964 wait complete. 2024-09-19T07:14:28.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.480+0000 7fbffd7ac740 1 -- start start 2024-09-19T07:14:28.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.481+0000 7fbffd7ac740 1 Processor -- start 2024-09-19T07:14:28.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.482+0000 7fbffd7ac740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629a3bad780 0x5629a3bbb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:28.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.482+0000 7fbffd7ac740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629a3baecf0 0x5629a3bbbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:28.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.483+0000 7fbff916f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629a3bad780 0x5629a3bbb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:28.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.483+0000 7fbff916f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629a3bad780 0x5629a3bbb700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:50012/0 (socket says 172.21.15.148:50012) 2024-09-19T07:14:28.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.483+0000 7fbff896e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629a3baecf0 0x5629a3bbbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:28.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.483+0000 7fbff896e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629a3baecf0 0x5629a3bbbc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35424/0 (socket says 172.21.15.148:35424) 2024-09-19T07:14:28.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.483+0000 7fbffd7ac740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5629a3bb8520 0x5629a3c53240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:28.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.483+0000 7fbffd7ac740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd800cca0 con 0x5629a3baecf0 2024-09-19T07:14:28.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.483+0000 7fbffd7ac740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd800e110 con 0x5629a3bb8520 2024-09-19T07:14:28.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.483+0000 7fbffd7ac740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd800d370 con 0x5629a3bad780 2024-09-19T07:14:28.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.483+0000 7fbffd7ac740 10 client.0 _ll_register_callbacks cb 0x7fbfec007cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:14:28.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.484+0000 7fbff916f640 1 -- 172.21.15.148:0/1435228616 learned_addr learned my addr 172.21.15.148:0/1435228616 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:14:28.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.484+0000 7fbff9970640 1 --2- 172.21.15.148:0/1435228616 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5629a3bb8520 0x5629a3c53240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:28.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.484+0000 7fbff916f640 1 -- 172.21.15.148:0/1435228616 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5629a3bb8520 msgr2=0x5629a3c53240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:28.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.484+0000 7fbff916f640 1 --2- 172.21.15.148:0/1435228616 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5629a3bb8520 0x5629a3c53240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:28.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.484+0000 7fbff916f640 1 -- 172.21.15.148:0/1435228616 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629a3baecf0 msgr2=0x5629a3bbbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:28.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.484+0000 7fbff916f640 1 --2- 172.21.15.148:0/1435228616 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629a3baecf0 0x5629a3bbbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:28.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.484+0000 7fbff916f640 1 -- 172.21.15.148:0/1435228616 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629a3bbc540 con 0x5629a3bad780 2024-09-19T07:14:28.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.485+0000 7fbff916f640 1 --2- 172.21.15.148:0/1435228616 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629a3bad780 0x5629a3bbb700 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbfec00c6e0 tx=0x7fbfec007860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a402a788c489ef8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:28.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.486+0000 7fbfdcff9640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-19T07:14:28.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.490+0000 7fbfdcff9640 1 -- 172.21.15.148:0/1435228616 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfec025070 con 0x5629a3bad780 2024-09-19T07:14:28.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.490+0000 7fbfdcff9640 1 -- 172.21.15.148:0/1435228616 <== mon.1 v2:172.21.15.179:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fbfec0072a0 con 0x5629a3bad780 2024-09-19T07:14:28.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.490+0000 7fbffd7ac740 1 -- 172.21.15.148:0/1435228616 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbff000ce90 con 0x5629a3bad780 2024-09-19T07:14:28.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.491+0000 7fbfdcff9640 1 -- 172.21.15.148:0/1435228616 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fbfec00f860 con 0x5629a3bad780 2024-09-19T07:14:28.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.492+0000 7fbffd7ac740 10 client.25705 fetch_fsmap learned FSMap version 32 2024-09-19T07:14:28.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.492+0000 7fbffd7ac740 1 -- 172.21.15.148:0/1435228616 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5629a3c547f0 con 0x5629a3bad780 2024-09-19T07:14:28.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.497+0000 7fbfdcff9640 1 -- 172.21.15.148:0/1435228616 <== mon.1 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbff000ce90 con 0x5629a3bad780 2024-09-19T07:14:28.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.497+0000 7fbfdcff9640 1 -- 172.21.15.148:0/1435228616 <== mon.1 v2:172.21.15.179:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7fbfec03b7b0 con 0x5629a3bad780 2024-09-19T07:14:28.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.497+0000 7fbffd7ac740 10 client.25705 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T07:14:28.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.497+0000 7fbffd7ac740 10 client.25705 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T07:14:28.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.497+0000 7fbffd7ac740 20 client.25705 populate_metadata read hostname 'smithi148' 2024-09-19T07:14:28.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.497+0000 7fbffd7ac740 1 --2- 172.21.15.148:0/1435228616 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5629a3c54f70 0x5629a3c57390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:28.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.497+0000 7fbffd7ac740 4 client.25705 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:14:28.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.497+0000 7fbffd7ac740 1 -- 172.21.15.148:0/1435228616 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5629a3b1ad70 con 0x5629a3c54f70 2024-09-19T07:14:28.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.498+0000 7fbff896e640 1 --2- 172.21.15.148:0/1435228616 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5629a3c54f70 0x5629a3c57390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:28.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.503+0000 7fbff896e640 1 --2- 172.21.15.148:0/1435228616 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5629a3c54f70 0x5629a3c57390 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c8fc14f917b9924 server_cookie=e9f432d7969ebae8 in_seq=0 out_seq=0 2024-09-19T07:14:28.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.503+0000 7fbfdcff9640 10 client.25705 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:14:28.507 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 16.6 2024-09-19T07:14:28.507 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:14:28.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.507+0000 7fbfdcff9640 1 -- 172.21.15.148:0/1435228616 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5629a3b1ad70 con 0x5629a3c54f70 2024-09-19T07:14:28.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.507+0000 7fbfdcff9640 10 client.25705 handle_command_reply: tid=0 2024-09-19T07:14:28.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.507+0000 7fbffd7ac740 1 client.25705 shutdown 2024-09-19T07:14:28.551 INFO:teuthology.orchestra.run.smithi148.stdout:[] 2024-09-19T07:14:28.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.510+0000 7fbffd7ac740 1 -- 172.21.15.148:0/1435228616 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629a3bad780 msgr2=0x5629a3bbb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:28.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.510+0000 7fbffd7ac740 1 --2- 172.21.15.148:0/1435228616 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629a3bad780 0x5629a3bbb700 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbfec00c6e0 tx=0x7fbfec007860 comp rx=0 tx=0).stop 2024-09-19T07:14:28.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.517+0000 7fbffd7ac740 1 -- 172.21.15.148:0/1435228616 shutdown_connections 2024-09-19T07:14:28.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.518+0000 7fbffd7ac740 1 --2- 172.21.15.148:0/1435228616 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5629a3c54f70 0x5629a3c57390 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:28.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.518+0000 7fbffd7ac740 1 --2- 172.21.15.148:0/1435228616 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5629a3bb8520 0x5629a3c53240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:28.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.518+0000 7fbffd7ac740 1 --2- 172.21.15.148:0/1435228616 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629a3baecf0 0x5629a3bbbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:28.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.518+0000 7fbffd7ac740 1 --2- 172.21.15.148:0/1435228616 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629a3bad780 0x5629a3bbb700 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:28.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.518+0000 7fbffd7ac740 1 -- 172.21.15.148:0/1435228616 >> 172.21.15.148:0/1435228616 conn(0x5629a3b76310 msgr2=0x5629a3ba8690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:28.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.518+0000 7fbfdcff9640 0 client.25705 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:14:28.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.520+0000 7fbffd7ac740 1 -- 172.21.15.148:0/1435228616 shutdown_connections 2024-09-19T07:14:28.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.520+0000 7fbffd7ac740 1 -- 172.21.15.148:0/1435228616 wait complete. 2024-09-19T07:14:28.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.520+0000 7fbffd7ac740 20 client.25705 trim_cache size 0 max 16384 2024-09-19T07:14:28.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.527+0000 7fbffa171640 1 -- 172.21.15.148:0/3088245676 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fbfe00a35c0 msgr2=0x7fbfe00a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:28.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.528+0000 7fbffa171640 1 --2- 172.21.15.148:0/3088245676 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fbfe00a35c0 0x7fbfe00a5a80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbff0008fd0 tx=0x7fbff0008e40 comp rx=0 tx=0).stop 2024-09-19T07:14:28.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.528+0000 7fbffa171640 1 -- 172.21.15.148:0/3088245676 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbff411b140 msgr2=0x7fbff41aba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:28.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.528+0000 7fbffa171640 1 --2- 172.21.15.148:0/3088245676 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbff411b140 0x7fbff41aba20 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fbfe402a990 tx=0x7fbfe4003f50 comp rx=0 tx=0).stop 2024-09-19T07:14:28.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.528+0000 7fbffa171640 1 -- 172.21.15.148:0/3088245676 shutdown_connections 2024-09-19T07:14:28.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.528+0000 7fbffa171640 1 --2- 172.21.15.148:0/3088245676 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fbfe00a35c0 0x7fbfe00a5a80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:28.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.528+0000 7fbffa171640 1 --2- 172.21.15.148:0/3088245676 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbff411b140 0x7fbff41aba20 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:28.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.528+0000 7fbffa171640 1 --2- 172.21.15.148:0/3088245676 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbff4110190 0x7fbff41a7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:28.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.528+0000 7fbffa171640 1 --2- 172.21.15.148:0/3088245676 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbff406ea30 0x7fbff41a7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:28.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.528+0000 7fbffa171640 1 -- 172.21.15.148:0/3088245676 >> 172.21.15.148:0/3088245676 conn(0x7fbff4073180 msgr2=0x7fbff4119370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:28.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.529+0000 7fbffa171640 1 -- 172.21.15.148:0/3088245676 shutdown_connections 2024-09-19T07:14:28.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:28.533+0000 7fbffa171640 1 -- 172.21.15.148:0/3088245676 wait complete. 2024-09-19T07:14:28.819 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:28 smithi148 ceph-mon[31180]: pgmap v105: 97 pgs: 97 active+clean; 295 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 121 op/s 2024-09-19T07:14:29.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:28 smithi165 ceph-mon[35326]: pgmap v105: 97 pgs: 97 active+clean; 295 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 121 op/s 2024-09-19T07:14:29.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:28 smithi179 ceph-mon[35716]: pgmap v105: 97 pgs: 97 active+clean; 295 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 121 op/s 2024-09-19T07:14:29.647 ERROR:tasks.fwd_scrub:rank 2 damaged: [{'damage_type': 'backtrace', 'id': 2502529, 'ino': 1099511630688, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-3.xml'}, {'damage_type': 'backtrace', 'id': 17089228, 'ino': 1099511630071, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 20529200, 'ino': 1099511632366, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 20947811, 'ino': 1099511629113, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 23029919, 'ino': 1099511631863, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-66.xml'}, {'damage_type': 'backtrace', 'id': 46223397, 'ino': 1099511632396, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-79.jpg'}, {'damage_type': 'backtrace', 'id': 51289592, 'ino': 1099511631489, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-28.xml'}, {'damage_type': 'backtrace', 'id': 58492933, 'ino': 1099511629947, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 64732603, 'ino': 1099511629801, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-30.xml'}, {'damage_type': 'backtrace', 'id': 64931988, 'ino': 1099511631550, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-5.xml'}, {'damage_type': 'backtrace', 'id': 65655781, 'ino': 1099511629885, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-10.xml'}, {'damage_type': 'backtrace', 'id': 75422804, 'ino': 1099511629530, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-15.xml'}, {'damage_type': 'backtrace', 'id': 92779544, 'ino': 1099511629704, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-51.xml'}, {'damage_type': 'backtrace', 'id': 106996095, 'ino': 1099511629080, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-32.jpg'}, {'damage_type': 'backtrace', 'id': 142482615, 'ino': 1099511628792, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-40.xml'}, {'damage_type': 'backtrace', 'id': 157156630, 'ino': 1099511628948, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-76.jpg'}, {'damage_type': 'backtrace', 'id': 157452880, 'ino': 1099511630452, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-20.xml'}, {'damage_type': 'backtrace', 'id': 158425704, 'ino': 1099511630739, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 158650003, 'ino': 1099511630664, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-11.xml'}, {'damage_type': 'backtrace', 'id': 162859204, 'ino': 1099511629939, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 163494718, 'ino': 1099511629419, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-50.xml'}, {'damage_type': 'backtrace', 'id': 164268168, 'ino': 1099511632020, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-43.xml'}, {'damage_type': 'backtrace', 'id': 172302875, 'ino': 1099511629116, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 179224534, 'ino': 1099511632597, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-25.jpg'}, {'damage_type': 'backtrace', 'id': 184666731, 'ino': 1099511631254, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-16.xml'}, {'damage_type': 'backtrace', 'id': 190251050, 'ino': 1099511629439, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-43.xml'}, {'damage_type': 'backtrace', 'id': 203046300, 'ino': 1099511629900, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-6.xml'}, {'damage_type': 'backtrace', 'id': 204332639, 'ino': 1099511632544, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-40.jpg'}, {'damage_type': 'backtrace', 'id': 225214823, 'ino': 1099511632397, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 228878166, 'ino': 1099511631038, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-56.xml'}, {'damage_type': 'backtrace', 'id': 231897028, 'ino': 1099511632479, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-59.jpg'}, {'damage_type': 'backtrace', 'id': 239963169, 'ino': 1099511629785, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-33.xml'}, {'damage_type': 'backtrace', 'id': 254852850, 'ino': 1099511629340, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-78.xml'}, {'damage_type': 'backtrace', 'id': 265000269, 'ino': 1099511629602, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-2.xml'}, {'damage_type': 'backtrace', 'id': 272594377, 'ino': 1099511631505, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-21.xml'}, {'damage_type': 'backtrace', 'id': 286400010, 'ino': 1099511629659, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-63.xml'}, {'damage_type': 'backtrace', 'id': 288255352, 'ino': 1099511629815, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-27.xml'}, {'damage_type': 'backtrace', 'id': 292260277, 'ino': 1099511632220, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-24.xml'}, {'damage_type': 'backtrace', 'id': 292654583, 'ino': 1099511631247, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-75.xml'}, {'damage_type': 'backtrace', 'id': 296757909, 'ino': 1099511629344, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-76.xml'}, {'damage_type': 'backtrace', 'id': 313111854, 'ino': 1099511631618, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-87.xml'}, {'damage_type': 'backtrace', 'id': 327618019, 'ino': 1099511631259, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-11.xml'}, {'damage_type': 'backtrace', 'id': 338211727, 'ino': 1099511629087, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-30.jpg'}, {'damage_type': 'backtrace', 'id': 342632360, 'ino': 1099511630473, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-11.xml'}, {'damage_type': 'backtrace', 'id': 343527174, 'ino': 1099511631891, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-60.xml'}, {'damage_type': 'backtrace', 'id': 363041425, 'ino': 1099511631569, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 372504341, 'ino': 1099511629458, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-37.xml'}, {'damage_type': 'backtrace', 'id': 382006551, 'ino': 1099511631312, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 385094299, 'ino': 1099511629963, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 387365171, 'ino': 1099511631585, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 392909287, 'ino': 1099511631261, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-9.xml'}, {'damage_type': 'backtrace', 'id': 410869096, 'ino': 1099511629697, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-53.xml'}, {'damage_type': 'backtrace', 'id': 411389193, 'ino': 1099511628891, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-7.xml'}, {'damage_type': 'backtrace', 'id': 414375829, 'ino': 1099511631841, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-70.xml'}, {'damage_type': 'backtrace', 'id': 423877848, 'ino': 1099511630502, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-2.xml'}, {'damage_type': 'backtrace', 'id': 426703345, 'ino': 1099511631592, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 428675184, 'ino': 1099511629207, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 433484404, 'ino': 1099511630446, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-22.xml'}, {'damage_type': 'backtrace', 'id': 435231354, 'ino': 1099511632414, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-74.jpg'}, {'damage_type': 'backtrace', 'id': 451075751, 'ino': 1099511629911, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-3.xml'}, {'damage_type': 'backtrace', 'id': 453383433, 'ino': 1099511628903, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-3.xml'}, {'damage_type': 'backtrace', 'id': 456976790, 'ino': 1099511631486, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-29.xml'}, {'damage_type': 'backtrace', 'id': 458649327, 'ino': 1099511630718, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 459997911, 'ino': 1099511628942, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-78.jpg'}, {'damage_type': 'backtrace', 'id': 460699456, 'ino': 1099511632538, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-42.jpg'}, {'damage_type': 'backtrace', 'id': 462840320, 'ino': 1099511629205, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 480646898, 'ino': 1099511630414, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 484055221, 'ino': 1099511630508, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 497488798, 'ino': 1099511630499, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-3.xml'}, {'damage_type': 'backtrace', 'id': 497896320, 'ino': 1099511629746, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-41.xml'}, {'damage_type': 'backtrace', 'id': 505591328, 'ino': 1099511630568, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 506179198, 'ino': 1099511632585, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 509724480, 'ino': 1099511629646, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-66.xml'}, {'damage_type': 'backtrace', 'id': 516797083, 'ino': 1099511631643, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-85.xml'}, {'damage_type': 'backtrace', 'id': 521341751, 'ino': 1099511628969, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-69.jpg'}, {'damage_type': 'backtrace', 'id': 532538397, 'ino': 1099511629617, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-71.xml'}, {'damage_type': 'backtrace', 'id': 541576290, 'ino': 1099511633171, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/article-17.xml'}, {'damage_type': 'backtrace', 'id': 553370961, 'ino': 1099511632340, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-4.xml'}, {'damage_type': 'backtrace', 'id': 565124500, 'ino': 1099511631823, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-74.xml'}, {'damage_type': 'backtrace', 'id': 582129732, 'ino': 1099511629075, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-34.jpg'}, {'damage_type': 'backtrace', 'id': 613319472, 'ino': 1099511632502, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-53.jpg'}, {'damage_type': 'backtrace', 'id': 615998766, 'ino': 1099511631118, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-29.xml'}, {'damage_type': 'backtrace', 'id': 622550991, 'ino': 1099511629195, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 626610700, 'ino': 1099511630517, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-25.jpg'}, {'damage_type': 'backtrace', 'id': 626992788, 'ino': 1099511628749, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-58.xml'}, {'damage_type': 'backtrace', 'id': 627637895, 'ino': 1099511632379, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-84.jpg'}, {'damage_type': 'backtrace', 'id': 630871135, 'ino': 1099511630535, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 645831595, 'ino': 1099511631677, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-83.xml'}, {'damage_type': 'backtrace', 'id': 646338452, 'ino': 1099511629057, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-40.jpg'}, {'damage_type': 'backtrace', 'id': 656527015, 'ino': 1099511631498, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-24.xml'}, {'damage_type': 'backtrace', 'id': 665394046, 'ino': 1099511629335, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-81.xml'}, {'damage_type': 'backtrace', 'id': 665929577, 'ino': 1099511628763, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-51.xml'}, {'damage_type': 'backtrace', 'id': 667545406, 'ino': 1099511629727, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-45.xml'}, {'damage_type': 'backtrace', 'id': 675479677, 'ino': 1099511629881, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-11.xml'}, {'damage_type': 'backtrace', 'id': 677150783, 'ino': 1099511630399, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-36.xml'}, {'damage_type': 'backtrace', 'id': 678311726, 'ino': 1099511630733, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 678855045, 'ino': 1099511630565, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 685838217, 'ino': 1099511628897, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-5.xml'}, {'damage_type': 'backtrace', 'id': 687370864, 'ino': 1099511632436, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-69.jpg'}, {'damage_type': 'backtrace', 'id': 690205198, 'ino': 1099511632166, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-30.xml'}, {'damage_type': 'backtrace', 'id': 693250095, 'ino': 1099511629026, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-50.jpg'}, {'damage_type': 'backtrace', 'id': 696196081, 'ino': 1099511629685, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-56.xml'}, {'damage_type': 'backtrace', 'id': 698181249, 'ino': 1099511632490, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-56.jpg'}, {'damage_type': 'backtrace', 'id': 700608711, 'ino': 1099511632257, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-20.xml'}, {'damage_type': 'backtrace', 'id': 709340847, 'ino': 1099511631571, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 713594362, 'ino': 1099511631501, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-23.xml'}, {'damage_type': 'backtrace', 'id': 720623993, 'ino': 1099511632406, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 737018946, 'ino': 1099511632423, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-72.jpg'}, {'damage_type': 'backtrace', 'id': 743090400, 'ino': 1099511629386, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-61.xml'}, {'damage_type': 'backtrace', 'id': 747390850, 'ino': 1099511632523, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-47.jpg'}, {'damage_type': 'backtrace', 'id': 764017243, 'ino': 1099511629820, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-26.xml'}, {'damage_type': 'backtrace', 'id': 781011416, 'ino': 1099511631729, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-82.xml'}, {'damage_type': 'backtrace', 'id': 782432232, 'ino': 1099511629873, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-13.xml'}, {'damage_type': 'backtrace', 'id': 787514529, 'ino': 1099511631873, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-64.xml'}, {'damage_type': 'backtrace', 'id': 799908838, 'ino': 1099511631237, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-93.jpg'}, {'damage_type': 'backtrace', 'id': 808317839, 'ino': 1099511631538, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-10.xml'}, {'damage_type': 'backtrace', 'id': 814473695, 'ino': 1099511631915, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-54.xml'}, {'damage_type': 'backtrace', 'id': 821469253, 'ino': 1099511632207, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-25.xml'}, {'damage_type': 'backtrace', 'id': 833162643, 'ino': 1099511632572, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-32.jpg'}, {'damage_type': 'backtrace', 'id': 833708212, 'ino': 1099511629486, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-28.xml'}, {'damage_type': 'backtrace', 'id': 833780401, 'ino': 1099511630736, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 840749776, 'ino': 1099511633450, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-48.jpg'}, {'damage_type': 'backtrace', 'id': 842246676, 'ino': 1099511632526, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-46.jpg'}, {'damage_type': 'backtrace', 'id': 842854056, 'ino': 1099511631262, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-8.xml'}, {'damage_type': 'backtrace', 'id': 843850383, 'ino': 1099511631603, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-88.xml'}, {'damage_type': 'backtrace', 'id': 847227821, 'ino': 1099511629403, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-55.xml'}, {'damage_type': 'backtrace', 'id': 849785274, 'ino': 1099511629839, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-22.xml'}, {'damage_type': 'backtrace', 'id': 850672965, 'ino': 1099511628731, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-67.xml'}, {'damage_type': 'backtrace', 'id': 851650752, 'ino': 1099511632403, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-77.jpg'}, {'damage_type': 'backtrace', 'id': 859736899, 'ino': 1099511629069, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-36.jpg'}, {'damage_type': 'backtrace', 'id': 866073269, 'ino': 1099511631587, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 886185103, 'ino': 1099511630449, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-21.xml'}, {'damage_type': 'backtrace', 'id': 888343359, 'ino': 1099511630505, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-1.xml'}, {'damage_type': 'backtrace', 'id': 895619809, 'ino': 1099511628721, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-72.xml'}, {'damage_type': 'backtrace', 'id': 897802745, 'ino': 1099511629353, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-72.xml'}, {'damage_type': 'backtrace', 'id': 915209114, 'ino': 1099511631516, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-17.xml'}, {'damage_type': 'backtrace', 'id': 915808407, 'ino': 1099511629818, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 934723277, 'ino': 1099511631268, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-2.xml'}, {'damage_type': 'backtrace', 'id': 939798576, 'ino': 1099511629481, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-29.xml'}, {'damage_type': 'backtrace', 'id': 939939163, 'ino': 1099511632385, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-82.jpg'}, {'damage_type': 'backtrace', 'id': 941483941, 'ino': 1099511629020, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-52.jpg'}, {'damage_type': 'backtrace', 'id': 949841493, 'ino': 1099511632399, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-78.jpg'}, {'damage_type': 'backtrace', 'id': 959318264, 'ino': 1099511629421, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-49.xml'}, {'damage_type': 'backtrace', 'id': 965043454, 'ino': 1099511631808, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-75.xml'}, {'damage_type': 'backtrace', 'id': 970467659, 'ino': 1099511629569, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-79.xml'}, {'damage_type': 'backtrace', 'id': 988388098, 'ino': 1099511630715, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 989719996, 'ino': 1099511629678, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-58.xml'}, {'damage_type': 'backtrace', 'id': 1002151731, 'ino': 1099511628921, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-85.jpg'}, {'damage_type': 'backtrace', 'id': 1006433780, 'ino': 1099511632320, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-13.xml'}, {'damage_type': 'backtrace', 'id': 1010600694, 'ino': 1099511631252, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-18.xml'}, {'damage_type': 'backtrace', 'id': 1011264776, 'ino': 1099511628885, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-9.xml'}, {'damage_type': 'backtrace', 'id': 1020629500, 'ino': 1099511631369, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-94.xml'}, {'damage_type': 'backtrace', 'id': 1029948343, 'ino': 1099511631289, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-81.jpg'}, {'damage_type': 'backtrace', 'id': 1042542098, 'ino': 1099511628867, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-15.xml'}, {'damage_type': 'backtrace', 'id': 1044298604, 'ino': 1099511629780, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-34.xml'}, {'damage_type': 'backtrace', 'id': 1050006238, 'ino': 1099511631265, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-5.xml'}, {'damage_type': 'backtrace', 'id': 1060886947, 'ino': 1099511628743, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-61.xml'}, {'damage_type': 'backtrace', 'id': 1063896100, 'ino': 1099511632294, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-15.xml'}, {'damage_type': 'backtrace', 'id': 1067123006, 'ino': 1099511631803, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-76.xml'}, {'damage_type': 'backtrace', 'id': 1069520332, 'ino': 1099511629221, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 1087156036, 'ino': 1099511630652, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-15.xml'}, {'damage_type': 'backtrace', 'id': 1087262396, 'ino': 1099511628825, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-29.xml'}, {'damage_type': 'backtrace', 'id': 1097479798, 'ino': 1099511632371, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-87.jpg'}, {'damage_type': 'backtrace', 'id': 1104401405, 'ino': 1099511629769, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-36.xml'}, {'damage_type': 'backtrace', 'id': 1108665870, 'ino': 1099511631557, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-2.xml'}, {'damage_type': 'backtrace', 'id': 1110267733, 'ino': 1099511628735, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-65.xml'}, {'damage_type': 'backtrace', 'id': 1125909738, 'ino': 1099511632357, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-11.xml'}, {'damage_type': 'backtrace', 'id': 1137019929, 'ino': 1099511632471, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-61.jpg'}, {'damage_type': 'backtrace', 'id': 1140206112, 'ino': 1099511628787, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-42.xml'}, {'damage_type': 'backtrace', 'id': 1146934843, 'ino': 1099511630706, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 1158868425, 'ino': 1099511630447, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-97.xml'}, {'damage_type': 'backtrace', 'id': 1161516166, 'ino': 1099511632608, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-92.jpg'}, {'damage_type': 'backtrace', 'id': 1164519690, 'ino': 1099511632334, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-7.xml'}, {'damage_type': 'backtrace', 'id': 1175954436, 'ino': 1099511629971, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 1176190683, 'ino': 1099511631837, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-71.xml'}, {'damage_type': 'backtrace', 'id': 1182729134, 'ino': 1099511632121, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-33.xml'}, {'damage_type': 'backtrace', 'id': 1190747589, 'ino': 1099511630441, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-24.xml'}, {'damage_type': 'backtrace', 'id': 1199032197, 'ino': 1099511629919, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-1.xml'}, {'damage_type': 'backtrace', 'id': 1201736510, 'ino': 1099511629095, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 1205632643, 'ino': 1099511631484, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-30.xml'}, {'damage_type': 'backtrace', 'id': 1207144544, 'ino': 1099511628840, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-24.xml'}, {'damage_type': 'backtrace', 'id': 1219254092, 'ino': 1099511630631, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-22.xml'}, {'damage_type': 'backtrace', 'id': 1225841841, 'ino': 1099511629639, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 1226587628, 'ino': 1099511629445, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-41.xml'}, {'damage_type': 'backtrace', 'id': 1228307576, 'ino': 1099511633420, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-53.jpg'}, {'damage_type': 'backtrace', 'id': 1240649214, 'ino': 1099511630655, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-14.xml'}, {'damage_type': 'backtrace', 'id': 1252659444, 'ino': 1099511628727, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-69.xml'}, {'damage_type': 'backtrace', 'id': 1254752819, 'ino': 1099511632615, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 1262346224, 'ino': 1099511628719, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-73.xml'}, {'damage_type': 'backtrace', 'id': 1267033885, 'ino': 1099511631527, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-14.xml'}, {'damage_type': 'backtrace', 'id': 1272117704, 'ino': 1099511629346, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-75.xml'}, {'damage_type': 'backtrace', 'id': 1273250002, 'ino': 1099511630538, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 1277045403, 'ino': 1099511632374, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-86.jpg'}, {'damage_type': 'backtrace', 'id': 1280080825, 'ino': 1099511632427, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-71.jpg'}, {'damage_type': 'backtrace', 'id': 1282948901, 'ino': 1099511630589, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 1293957518, 'ino': 1099511632038, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-42.xml'}, {'damage_type': 'backtrace', 'id': 1298062225, 'ino': 1099511628855, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-19.xml'}, {'damage_type': 'backtrace', 'id': 1301919412, 'ino': 1099511629123, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 1302309720, 'ino': 1099511632557, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-36.jpg'}, {'damage_type': 'backtrace', 'id': 1302626783, 'ino': 1099511632283, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-16.xml'}, {'damage_type': 'backtrace', 'id': 1308247909, 'ino': 1099511632419, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-73.jpg'}, {'damage_type': 'backtrace', 'id': 1309180155, 'ino': 1099511630697, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 1312569691, 'ino': 1099511631993, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-45.xml'}, {'damage_type': 'backtrace', 'id': 1315081690, 'ino': 1099511630405, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-34.xml'}, {'damage_type': 'backtrace', 'id': 1318055615, 'ino': 1099511632601, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 1321560316, 'ino': 1099511632541, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-41.jpg'}, {'damage_type': 'backtrace', 'id': 1323790581, 'ino': 1099511630580, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 1325262172, 'ino': 1099511628814, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-33.xml'}, {'damage_type': 'backtrace', 'id': 1326334401, 'ino': 1099511629967, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 1332869775, 'ino': 1099511631130, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-23.xml'}, {'damage_type': 'backtrace', 'id': 1335083689, 'ino': 1099511632561, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-35.jpg'}, {'damage_type': 'backtrace', 'id': 1335380273, 'ino': 1099511633520, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-34.jpg'}, {'damage_type': 'backtrace', 'id': 1340382510, 'ino': 1099511631047, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-53.xml'}, {'damage_type': 'backtrace', 'id': 1340560493, 'ino': 1099511632262, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-19.xml'}, {'damage_type': 'backtrace', 'id': 1348621214, 'ino': 1099511629452, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-39.xml'}, {'damage_type': 'backtrace', 'id': 1351450535, 'ino': 1099511628804, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-36.xml'}, {'damage_type': 'backtrace', 'id': 1353454730, 'ino': 1099511629673, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-59.xml'}, {'damage_type': 'backtrace', 'id': 1361080737, 'ino': 1099511629768, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 1366613253, 'ino': 1099511630485, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-8.xml'}, {'damage_type': 'backtrace', 'id': 1373368334, 'ino': 1099511629563, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-80.xml'}, {'damage_type': 'backtrace', 'id': 1376773232, 'ino': 1099511631899, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-58.xml'}, {'damage_type': 'backtrace', 'id': 1388938592, 'ino': 1099511628759, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-53.xml'}, {'damage_type': 'backtrace', 'id': 1407304390, 'ino': 1099511632338, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-5.xml'}, {'damage_type': 'backtrace', 'id': 1408889897, 'ino': 1099511628789, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-41.xml'}, {'damage_type': 'backtrace', 'id': 1423124628, 'ino': 1099511629557, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-81.xml'}, {'damage_type': 'backtrace', 'id': 1430257466, 'ino': 1099511629623, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-70.xml'}, {'damage_type': 'backtrace', 'id': 1447065276, 'ino': 1099511629869, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-14.xml'}, {'damage_type': 'backtrace', 'id': 1452041797, 'ino': 1099511631089, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-39.xml'}, {'damage_type': 'backtrace', 'id': 1453101677, 'ino': 1099511631035, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-57.xml'}, {'damage_type': 'backtrace', 'id': 1453447866, 'ino': 1099511631446, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 1458302213, 'ino': 1099511629850, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-19.xml'}, {'damage_type': 'backtrace', 'id': 1459258459, 'ino': 1099511632365, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-1.xml'}, {'damage_type': 'backtrace', 'id': 1465522134, 'ino': 1099511630574, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 1469794265, 'ino': 1099511628828, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-28.xml'}, {'damage_type': 'backtrace', 'id': 1474661418, 'ino': 1099511630396, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-37.xml'}, {'damage_type': 'backtrace', 'id': 1485227622, 'ino': 1099511631059, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-49.xml'}, {'damage_type': 'backtrace', 'id': 1487208444, 'ino': 1099511631423, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-93.xml'}, {'damage_type': 'backtrace', 'id': 1489952386, 'ino': 1099511632392, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-80.jpg'}, {'damage_type': 'backtrace', 'id': 1500611789, 'ino': 1099511632049, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-41.xml'}, {'damage_type': 'backtrace', 'id': 1509885865, 'ino': 1099511629896, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-7.xml'}, {'damage_type': 'backtrace', 'id': 1510774427, 'ino': 1099511630550, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 1513240081, 'ino': 1099511630915, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-96.jpg'}, {'damage_type': 'backtrace', 'id': 1515547505, 'ino': 1099511631600, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-89.xml'}, {'damage_type': 'backtrace', 'id': 1517505576, 'ino': 1099511631248, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-20.xml'}, {'damage_type': 'backtrace', 'id': 1523248353, 'ino': 1099511629755, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-39.xml'}, {'damage_type': 'backtrace', 'id': 1532910547, 'ino': 1099511629554, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-9.xml'}, {'damage_type': 'backtrace', 'id': 1539623559, 'ino': 1099511630393, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-38.xml'}, {'damage_type': 'backtrace', 'id': 1545302389, 'ino': 1099511629449, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-40.xml'}, {'damage_type': 'backtrace', 'id': 1545934358, 'ino': 1099511630491, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-6.xml'}, {'damage_type': 'backtrace', 'id': 1554576387, 'ino': 1099511632322, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-12.xml'}, {'damage_type': 'backtrace', 'id': 1564824915, 'ino': 1099511631520, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-16.xml'}, {'damage_type': 'backtrace', 'id': 1569506390, 'ino': 1099511629118, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 1578622135, 'ino': 1099511631931, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-51.xml'}, {'damage_type': 'backtrace', 'id': 1579792321, 'ino': 1099511629789, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-22.xml'}, {'damage_type': 'backtrace', 'id': 1582363574, 'ino': 1099511632451, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-66.jpg'}, {'damage_type': 'backtrace', 'id': 1583356043, 'ino': 1099511628807, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-35.xml'}, {'damage_type': 'backtrace', 'id': 1584658391, 'ino': 1099511631926, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-52.xml'}, {'damage_type': 'backtrace', 'id': 1590907893, 'ino': 1099511631547, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-6.xml'}, {'damage_type': 'backtrace', 'id': 1600309218, 'ino': 1099511631321, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 1607593043, 'ino': 1099511631086, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-40.xml'}, {'damage_type': 'backtrace', 'id': 1619747921, 'ino': 1099511629466, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-34.xml'}, {'damage_type': 'backtrace', 'id': 1628885573, 'ino': 1099511632342, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-3.xml'}, {'damage_type': 'backtrace', 'id': 1629030659, 'ino': 1099511629689, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-55.xml'}, {'damage_type': 'backtrace', 'id': 1633780558, 'ino': 1099511629521, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-18.xml'}, {'damage_type': 'backtrace', 'id': 1635172788, 'ino': 1099511628915, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-87.jpg'}, {'damage_type': 'backtrace', 'id': 1637935588, 'ino': 1099511631264, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-6.xml'}, {'damage_type': 'backtrace', 'id': 1643108391, 'ino': 1099511629512, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-21.xml'}, {'damage_type': 'backtrace', 'id': 1647663651, 'ino': 1099511632405, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-76.jpg'}, {'damage_type': 'backtrace', 'id': 1655088740, 'ino': 1099511629587, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-76.xml'}, {'damage_type': 'backtrace', 'id': 1658840231, 'ino': 1099511632272, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-18.xml'}, {'damage_type': 'backtrace', 'id': 1664618791, 'ino': 1099511628761, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-52.xml'}, {'damage_type': 'backtrace', 'id': 1676891544, 'ino': 1099511632344, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-2.xml'}, {'damage_type': 'backtrace', 'id': 1687510929, 'ino': 1099511628819, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-31.xml'}, {'damage_type': 'backtrace', 'id': 1691681910, 'ino': 1099511632404, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 1697074179, 'ino': 1099511631573, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 1702286959, 'ino': 1099511631867, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-65.xml'}, {'damage_type': 'backtrace', 'id': 1703305358, 'ino': 1099511629923, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 1704675445, 'ino': 1099511630745, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 1712525998, 'ino': 1099511629722, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 1718161336, 'ino': 1099511631263, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-7.xml'}, {'damage_type': 'backtrace', 'id': 1735574215, 'ino': 1099511631044, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-54.xml'}, {'damage_type': 'backtrace', 'id': 1737970217, 'ino': 1099511629575, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-78.xml'}, {'damage_type': 'backtrace', 'id': 1750147823, 'ino': 1099511629470, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-33.xml'}, {'damage_type': 'backtrace', 'id': 1769367922, 'ino': 1099511630261, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-100.xml'}, {'damage_type': 'backtrace', 'id': 1788031622, 'ino': 1099511628745, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-60.xml'}, {'damage_type': 'backtrace', 'id': 1792811498, 'ino': 1099511632228, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-23.xml'}, {'damage_type': 'backtrace', 'id': 1793918017, 'ino': 1099511629740, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-42.xml'}, {'damage_type': 'backtrace', 'id': 1795952576, 'ino': 1099511632325, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-11.xml'}, {'damage_type': 'backtrace', 'id': 1799745605, 'ino': 1099511633338, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-67.jpg'}, {'damage_type': 'backtrace', 'id': 1804806283, 'ino': 1099511631859, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-67.xml'}, {'damage_type': 'backtrace', 'id': 1806983413, 'ino': 1099511629120, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 1811479881, 'ino': 1099511629383, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-62.xml'}, {'damage_type': 'backtrace', 'id': 1812554173, 'ino': 1099511632581, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-29.jpg'}, {'damage_type': 'backtrace', 'id': 1814900065, 'ino': 1099511632115, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-34.xml'}, {'damage_type': 'backtrace', 'id': 1817171634, 'ino': 1099511629338, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-79.xml'}, {'damage_type': 'backtrace', 'id': 1821989704, 'ino': 1099511631542, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-8.xml'}, {'damage_type': 'backtrace', 'id': 1825228230, 'ino': 1099511629217, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 1831987875, 'ino': 1099511632349, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 1835318073, 'ino': 1099511631245, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-21.xml'}, {'damage_type': 'backtrace', 'id': 1837547329, 'ino': 1099511632455, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-65.jpg'}, {'damage_type': 'backtrace', 'id': 1841085739, 'ino': 1099511632605, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 1842961073, 'ino': 1099511630469, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-13.xml'}, {'damage_type': 'backtrace', 'id': 1842966324, 'ino': 1099511629759, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-38.xml'}, {'damage_type': 'backtrace', 'id': 1846727963, 'ino': 1099511630511, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 1850518466, 'ino': 1099511630424, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-29.xml'}, {'damage_type': 'backtrace', 'id': 1856678313, 'ino': 1099511630438, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-25.xml'}, {'damage_type': 'backtrace', 'id': 1861612015, 'ino': 1099511632614, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-71.xml'}, {'damage_type': 'backtrace', 'id': 1868282528, 'ino': 1099511631083, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-41.xml'}, {'damage_type': 'backtrace', 'id': 1879108828, 'ino': 1099511631246, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 1920140358, 'ino': 1099511629464, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-35.xml'}, {'damage_type': 'backtrace', 'id': 1920210071, 'ino': 1099511629761, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-99.xml'}, {'damage_type': 'backtrace', 'id': 1921900858, 'ino': 1099511628725, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-70.xml'}, {'damage_type': 'backtrace', 'id': 1923478794, 'ino': 1099511629888, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-9.xml'}, {'damage_type': 'backtrace', 'id': 1926415427, 'ino': 1099511629006, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-57.jpg'}, {'damage_type': 'backtrace', 'id': 1935313538, 'ino': 1099511629460, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-36.xml'}, {'damage_type': 'backtrace', 'id': 1940363934, 'ino': 1099511632445, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-67.jpg'}, {'damage_type': 'backtrace', 'id': 1940676085, 'ino': 1099511630556, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 1942623154, 'ino': 1099511632391, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 1944007137, 'ino': 1099511631778, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-44.xml'}, {'damage_type': 'backtrace', 'id': 1946587923, 'ino': 1099511630402, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-35.xml'}, {'damage_type': 'backtrace', 'id': 1959974333, 'ino': 1099511632514, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-50.jpg'}, {'damage_type': 'backtrace', 'id': 1960695597, 'ino': 1099511631253, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-17.xml'}, {'damage_type': 'backtrace', 'id': 1960712871, 'ino': 1099511629536, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-13.xml'}, {'damage_type': 'backtrace', 'id': 1965598068, 'ino': 1099511632415, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 1984378860, 'ino': 1099511629847, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-20.xml'}, {'damage_type': 'backtrace', 'id': 1985913667, 'ino': 1099511629023, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-51.jpg'}, {'damage_type': 'backtrace', 'id': 1987639067, 'ino': 1099511629599, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-74.xml'}, {'damage_type': 'backtrace', 'id': 1990007283, 'ino': 1099511631258, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-12.xml'}, {'damage_type': 'backtrace', 'id': 2008063052, 'ino': 1099511631508, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-20.xml'}, {'damage_type': 'backtrace', 'id': 2026163587, 'ino': 1099511632494, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-55.jpg'}, {'damage_type': 'backtrace', 'id': 2027490385, 'ino': 1099511629502, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-24.xml'}, {'damage_type': 'backtrace', 'id': 2029916088, 'ino': 1099511631775, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-79.xml'}, {'damage_type': 'backtrace', 'id': 2035702213, 'ino': 1099511632091, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-37.xml'}, {'damage_type': 'backtrace', 'id': 2091910545, 'ino': 1099511629223, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 2095058238, 'ino': 1099511629539, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-12.xml'}, {'damage_type': 'backtrace', 'id': 2113959596, 'ino': 1099511633553, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 2118157358, 'ino': 1099511628751, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-57.xml'}, {'damage_type': 'backtrace', 'id': 2138811292, 'ino': 1099511632474, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-60.jpg'}, {'damage_type': 'backtrace', 'id': 2150364874, 'ino': 1099511632356, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 2173135509, 'ino': 1099511633529, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-32.jpg'}, {'damage_type': 'backtrace', 'id': 2174064831, 'ino': 1099511630412, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-32.xml'}, {'damage_type': 'backtrace', 'id': 2174166382, 'ino': 1099511631911, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-55.xml'}, {'damage_type': 'backtrace', 'id': 2175140656, 'ino': 1099511630634, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-21.xml'}, {'damage_type': 'backtrace', 'id': 2176221753, 'ino': 1099511632066, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-40.xml'}, {'damage_type': 'backtrace', 'id': 2182550198, 'ino': 1099511630523, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 2188524062, 'ino': 1099511631120, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-28.xml'}, {'damage_type': 'backtrace', 'id': 2197544100, 'ino': 1099511631292, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-20.xml'}, {'damage_type': 'backtrace', 'id': 2197946620, 'ino': 1099511632459, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-64.jpg'}, {'damage_type': 'backtrace', 'id': 2198022922, 'ino': 1099511632173, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-29.xml'}, {'damage_type': 'backtrace', 'id': 2202094870, 'ino': 1099511632075, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-39.xml'}, {'damage_type': 'backtrace', 'id': 2215630348, 'ino': 1099511631745, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-81.xml'}, {'damage_type': 'backtrace', 'id': 2228647407, 'ino': 1099511628717, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-74.xml'}, {'damage_type': 'backtrace', 'id': 2238033829, 'ino': 1099511629742, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 2241934650, 'ino': 1099511632565, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-34.jpg'}, {'damage_type': 'backtrace', 'id': 2243887815, 'ino': 1099511633254, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/article-1.xml'}, {'damage_type': 'backtrace', 'id': 2247594327, 'ino': 1099511630712, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 2248319173, 'ino': 1099511628966, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-70.jpg'}, {'damage_type': 'backtrace', 'id': 2258659594, 'ino': 1099511631564, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 2262081549, 'ino': 1099511632330, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-9.xml'}, {'damage_type': 'backtrace', 'id': 2262569910, 'ino': 1099511630658, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-13.xml'}, {'damage_type': 'backtrace', 'id': 2277801464, 'ino': 1099511629875, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 2280421516, 'ino': 1099511628951, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-75.jpg'}, {'damage_type': 'backtrace', 'id': 2291465854, 'ino': 1099511630432, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 2296598395, 'ino': 1099511631657, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-84.xml'}, {'damage_type': 'backtrace', 'id': 2316506214, 'ino': 1099511629731, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-44.xml'}, {'damage_type': 'backtrace', 'id': 2318448877, 'ino': 1099511629066, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-37.jpg'}, {'damage_type': 'backtrace', 'id': 2331351260, 'ino': 1099511630643, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-18.xml'}, {'damage_type': 'backtrace', 'id': 2334035695, 'ino': 1099511629927, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 2336060750, 'ino': 1099511629226, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 2338852773, 'ino': 1099511629122, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 2342457854, 'ino': 1099511632507, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-52.jpg'}, {'damage_type': 'backtrace', 'id': 2344543109, 'ino': 1099511629983, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 2348271749, 'ino': 1099511630709, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 2352329522, 'ino': 1099511630264, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 2362192221, 'ino': 1099511629051, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-42.jpg'}, {'damage_type': 'backtrace', 'id': 2379482415, 'ino': 1099511632107, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-35.xml'}, {'damage_type': 'backtrace', 'id': 2388707684, 'ino': 1099511631984, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-46.xml'}, {'damage_type': 'backtrace', 'id': 2397121240, 'ino': 1099511628733, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-66.xml'}, {'damage_type': 'backtrace', 'id': 2402130817, 'ino': 1099511631511, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-91.xml'}, {'damage_type': 'backtrace', 'id': 2406131391, 'ino': 1099511631053, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-51.xml'}, {'damage_type': 'backtrace', 'id': 2407403768, 'ino': 1099511630586, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 2408041055, 'ino': 1099511629670, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-60.xml'}, {'damage_type': 'backtrace', 'id': 2414332113, 'ino': 1099511631533, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-12.xml'}, {'damage_type': 'backtrace', 'id': 2425189037, 'ino': 1099511631101, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-35.xml'}, {'damage_type': 'backtrace', 'id': 2438081208, 'ino': 1099511631336, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-95.xml'}, {'damage_type': 'backtrace', 'id': 2444844771, 'ino': 1099511630670, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-9.xml'}, {'damage_type': 'backtrace', 'id': 2450278245, 'ino': 1099511632383, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-83.jpg'}, {'damage_type': 'backtrace', 'id': 2454988861, 'ino': 1099511630464, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-15.xml'}, {'damage_type': 'backtrace', 'id': 2463965451, 'ino': 1099511629062, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-38.jpg'}, {'damage_type': 'backtrace', 'id': 2466821851, 'ino': 1099511628858, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-18.xml'}, {'damage_type': 'backtrace', 'id': 2474931194, 'ino': 1099511629370, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-65.xml'}, {'damage_type': 'backtrace', 'id': 2476788260, 'ino': 1099511630481, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-9.xml'}, {'damage_type': 'backtrace', 'id': 2477710596, 'ino': 1099511629797, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-31.xml'}, {'damage_type': 'backtrace', 'id': 2492891819, 'ino': 1099511632569, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-33.jpg'}, {'damage_type': 'backtrace', 'id': 2507064593, 'ino': 1099511629877, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-12.xml'}, {'damage_type': 'backtrace', 'id': 2509382333, 'ino': 1099511632328, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-10.xml'}, {'damage_type': 'backtrace', 'id': 2516416490, 'ino': 1099511629955, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 2525203439, 'ino': 1099511630055, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 2529056994, 'ino': 1099511632535, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-43.jpg'}, {'damage_type': 'backtrace', 'id': 2539203792, 'ino': 1099511628972, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-68.jpg'}, {'damage_type': 'backtrace', 'id': 2545880275, 'ino': 1099511631513, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-18.xml'}, {'damage_type': 'backtrace', 'id': 2546937081, 'ino': 1099511631903, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-57.xml'}, {'damage_type': 'backtrace', 'id': 2565308267, 'ino': 1099511631238, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-85.xml'}, {'damage_type': 'backtrace', 'id': 2576435436, 'ino': 1099511631108, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-32.xml'}, {'damage_type': 'backtrace', 'id': 2581509583, 'ino': 1099511631114, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-30.xml'}, {'damage_type': 'backtrace', 'id': 2589739770, 'ino': 1099511629362, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-69.xml'}, {'damage_type': 'backtrace', 'id': 2591967328, 'ino': 1099511630583, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 2595515564, 'ino': 1099511632368, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-88.jpg'}, {'damage_type': 'backtrace', 'id': 2600736915, 'ino': 1099511629047, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-43.jpg'}, {'damage_type': 'backtrace', 'id': 2607035552, 'ino': 1099511629931, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 2611672809, 'ino': 1099511632510, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-51.jpg'}, {'damage_type': 'backtrace', 'id': 2615457795, 'ino': 1099511631128, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-24.xml'}, {'damage_type': 'backtrace', 'id': 2616577992, 'ino': 1099511629566, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-7.xml'}, {'damage_type': 'backtrace', 'id': 2619437553, 'ino': 1099511628810, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-34.xml'}, {'damage_type': 'backtrace', 'id': 2620800944, 'ino': 1099511629630, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 2623831960, 'ino': 1099511631531, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-13.xml'}, {'damage_type': 'backtrace', 'id': 2629374273, 'ino': 1099511632420, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 2631313864, 'ino': 1099511631080, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-42.xml'}, {'damage_type': 'backtrace', 'id': 2632319210, 'ino': 1099511631554, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-3.xml'}, {'damage_type': 'backtrace', 'id': 2649183807, 'ino': 1099511633609, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 2653774434, 'ino': 1099511629809, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-28.xml'}, {'damage_type': 'backtrace', 'id': 2657735255, 'ino': 1099511631919, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-53.xml'}, {'damage_type': 'backtrace', 'id': 2663630532, 'ino': 1099511631602, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 2664038472, 'ino': 1099511632553, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-37.jpg'}, {'damage_type': 'backtrace', 'id': 2665090132, 'ino': 1099511630520, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 2666702881, 'ino': 1099511632239, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-22.xml'}, {'damage_type': 'backtrace', 'id': 2667388850, 'ino': 1099511631106, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-33.xml'}, {'damage_type': 'backtrace', 'id': 2676752924, 'ino': 1099511630488, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-7.xml'}, {'damage_type': 'backtrace', 'id': 2683686006, 'ino': 1099511630700, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 2684596098, 'ino': 1099511631559, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-1.xml'}, {'damage_type': 'backtrace', 'id': 2701271701, 'ino': 1099511629783, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-58.jpg'}, {'damage_type': 'backtrace', 'id': 2707895096, 'ino': 1099511630673, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-8.xml'}, {'damage_type': 'backtrace', 'id': 2714968562, 'ino': 1099511630703, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 2715317956, 'ino': 1099511629472, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-32.xml'}, {'damage_type': 'backtrace', 'id': 2734157462, 'ino': 1099511631178, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-1.xml'}, {'damage_type': 'backtrace', 'id': 2744162797, 'ino': 1099511629374, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-64.xml'}, {'damage_type': 'backtrace', 'id': 2744223598, 'ino': 1099511629605, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-73.xml'}, {'damage_type': 'backtrace', 'id': 2756474142, 'ino': 1099511629614, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-1.xml'}, {'damage_type': 'backtrace', 'id': 2769347198, 'ino': 1099511633426, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-52.jpg'}, {'damage_type': 'backtrace', 'id': 2772932865, 'ino': 1099511630422, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-98.xml'}, {'damage_type': 'backtrace', 'id': 2793314627, 'ino': 1099511629709, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-50.xml'}, {'damage_type': 'backtrace', 'id': 2798147598, 'ino': 1099511628909, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-1.xml'}, {'damage_type': 'backtrace', 'id': 2802615322, 'ino': 1099511629380, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-63.xml'}, {'damage_type': 'backtrace', 'id': 2806202920, 'ino': 1099511632135, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-32.xml'}, {'damage_type': 'backtrace', 'id': 2807567860, 'ino': 1099511628794, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-39.xml'}, {'damage_type': 'backtrace', 'id': 2819400197, 'ino': 1099511628963, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-71.jpg'}, {'damage_type': 'backtrace', 'id': 2834473272, 'ino': 1099511630724, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 2836238501, 'ino': 1099511629401, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-56.xml'}, {'damage_type': 'backtrace', 'id': 2836615352, 'ino': 1099511629852, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 2837036601, 'ino': 1099511631342, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 2838779426, 'ino': 1099511629629, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-69.xml'}, {'damage_type': 'backtrace', 'id': 2840089884, 'ino': 1099511629389, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-60.xml'}, {'damage_type': 'backtrace', 'id': 2844782454, 'ino': 1099511629398, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-57.xml'}, {'damage_type': 'backtrace', 'id': 2847838541, 'ino': 1099511631599, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 2852248695, 'ino': 1099511631476, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-92.xml'}, {'damage_type': 'backtrace', 'id': 2855115177, 'ino': 1099511629647, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-25.jpg'}, {'damage_type': 'backtrace', 'id': 2858526159, 'ino': 1099511629337, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-80.xml'}, {'damage_type': 'backtrace', 'id': 2860452900, 'ino': 1099511631071, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-45.xml'}, {'damage_type': 'backtrace', 'id': 2864831948, 'ino': 1099511632364, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 2881580388, 'ino': 1099511632550, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-38.jpg'}, {'damage_type': 'backtrace', 'id': 2895233346, 'ino': 1099511629578, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-5.xml'}, {'damage_type': 'backtrace', 'id': 2901753673, 'ino': 1099511629369, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-66.xml'}, {'damage_type': 'backtrace', 'id': 2906151667, 'ino': 1099511631493, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-26.xml'}, {'damage_type': 'backtrace', 'id': 2906818496, 'ino': 1099511631103, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-34.xml'}, {'damage_type': 'backtrace', 'id': 2906899039, 'ino': 1099511632517, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-49.jpg'}, {'damage_type': 'backtrace', 'id': 2910424964, 'ino': 1099511632520, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-48.jpg'}, {'damage_type': 'backtrace', 'id': 2911626981, 'ino': 1099511631765, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-80.xml'}, {'damage_type': 'backtrace', 'id': 2917479942, 'ino': 1099511629214, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 2922527110, 'ino': 1099511632332, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-8.xml'}, {'damage_type': 'backtrace', 'id': 2927315927, 'ino': 1099511630480, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 2927617030, 'ino': 1099511630577, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 2930687669, 'ino': 1099511632326, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-12.xml'}, {'damage_type': 'backtrace', 'id': 2935118209, 'ino': 1099511630471, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-12.xml'}, {'damage_type': 'backtrace', 'id': 2936882521, 'ino': 1099511629735, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-43.xml'}, {'damage_type': 'backtrace', 'id': 2940568069, 'ino': 1099511632360, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 2940954848, 'ino': 1099511630682, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-5.xml'}, {'damage_type': 'backtrace', 'id': 2948314926, 'ino': 1099511629750, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-40.xml'}, {'damage_type': 'backtrace', 'id': 2952228792, 'ino': 1099511632373, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 2952598616, 'ino': 1099511629904, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-5.xml'}, {'damage_type': 'backtrace', 'id': 2959916389, 'ino': 1099511632487, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-57.jpg'}, {'damage_type': 'backtrace', 'id': 2960517589, 'ino': 1099511629866, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-15.xml'}, {'damage_type': 'backtrace', 'id': 2961375115, 'ino': 1099511629693, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-54.xml'}, {'damage_type': 'backtrace', 'id': 2964789130, 'ino': 1099511628783, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-44.xml'}, {'damage_type': 'backtrace', 'id': 2971589161, 'ino': 1099511629666, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-61.xml'}, {'damage_type': 'backtrace', 'id': 2974853612, 'ino': 1099511631132, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-22.xml'}, {'damage_type': 'backtrace', 'id': 2984790532, 'ino': 1099511631077, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-43.xml'}, {'damage_type': 'backtrace', 'id': 2985818882, 'ino': 1099511629518, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-19.xml'}, {'damage_type': 'backtrace', 'id': 2991026805, 'ino': 1099511631074, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-44.xml'}, {'damage_type': 'backtrace', 'id': 3001539810, 'ino': 1099511629706, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 3002671923, 'ino': 1099511630637, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-20.xml'}, {'damage_type': 'backtrace', 'id': 3016496380, 'ino': 1099511629792, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-32.xml'}, {'damage_type': 'backtrace', 'id': 3021091022, 'ino': 1099511631832, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-72.xml'}, {'damage_type': 'backtrace', 'id': 3045966769, 'ino': 1099511631126, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-25.xml'}, {'damage_type': 'backtrace', 'id': 3047217631, 'ino': 1099511629975, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 3047233611, 'ino': 1099511632532, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-44.jpg'}, {'damage_type': 'backtrace', 'id': 3050336485, 'ino': 1099511632198, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-26.xml'}, {'damage_type': 'backtrace', 'id': 3056318311, 'ino': 1099511629219, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 3062832280, 'ino': 1099511631491, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-27.xml'}, {'damage_type': 'backtrace', 'id': 3066318601, 'ino': 1099511632336, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-6.xml'}, {'damage_type': 'backtrace', 'id': 3068581795, 'ino': 1099511633288, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-76.jpg'}, {'damage_type': 'backtrace', 'id': 3083087513, 'ino': 1099511629943, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 3094030148, 'ino': 1099511631879, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-63.xml'}, {'damage_type': 'backtrace', 'id': 3095123694, 'ino': 1099511632347, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-1.xml'}, {'damage_type': 'backtrace', 'id': 3129965940, 'ino': 1099511629071, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-35.jpg'}, {'damage_type': 'backtrace', 'id': 3147312825, 'ino': 1099511630420, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-30.xml'}, {'damage_type': 'backtrace', 'id': 3149452203, 'ino': 1099511632182, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-28.xml'}, {'damage_type': 'backtrace', 'id': 3149972021, 'ino': 1099511629560, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-8.xml'}, {'damage_type': 'backtrace', 'id': 3162447953, 'ino': 1099511631681, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-42.xml'}, {'damage_type': 'backtrace', 'id': 3164253158, 'ino': 1099511630640, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-19.xml'}, {'damage_type': 'backtrace', 'id': 3167357608, 'ino': 1099511629833, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-23.xml'}, {'damage_type': 'backtrace', 'id': 3174205268, 'ino': 1099511629359, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-70.xml'}, {'damage_type': 'backtrace', 'id': 3178632528, 'ino': 1099511630416, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-31.xml'}, {'damage_type': 'backtrace', 'id': 3189774779, 'ino': 1099511629712, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-49.xml'}, {'damage_type': 'backtrace', 'id': 3193986526, 'ino': 1099511633145, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/article-23.xml'}, {'damage_type': 'backtrace', 'id': 3199308136, 'ino': 1099511629764, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-37.xml'}, {'damage_type': 'backtrace', 'id': 3209556389, 'ino': 1099511630553, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 3213746319, 'ino': 1099511632463, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-63.jpg'}, {'damage_type': 'backtrace', 'id': 3216862548, 'ino': 1099511629651, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-65.xml'}, {'damage_type': 'backtrace', 'id': 3220142732, 'ino': 1099511631092, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-38.xml'}, {'damage_type': 'backtrace', 'id': 3220599479, 'ino': 1099511631561, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 3235996601, 'ino': 1099511630562, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 3238836398, 'ino': 1099511630721, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 3242865253, 'ino': 1099511632411, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-75.jpg'}, {'damage_type': 'backtrace', 'id': 3246569133, 'ino': 1099511631269, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-1.xml'}, {'damage_type': 'backtrace', 'id': 3251397363, 'ino': 1099511628918, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-86.jpg'}, {'damage_type': 'backtrace', 'id': 3272952817, 'ino': 1099511630727, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 3277381429, 'ino': 1099511628954, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-74.jpg'}, {'damage_type': 'backtrace', 'id': 3286137177, 'ino': 1099511629392, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-59.xml'}, {'damage_type': 'backtrace', 'id': 3286503105, 'ino': 1099511632245, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-21.xml'}, {'damage_type': 'backtrace', 'id': 3301109447, 'ino': 1099511632082, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-38.xml'}, {'damage_type': 'backtrace', 'id': 3307141822, 'ino': 1099511631257, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-13.xml'}, {'damage_type': 'backtrace', 'id': 3309013573, 'ino': 1099511631552, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-4.xml'}, {'damage_type': 'backtrace', 'id': 3312103716, 'ino': 1099511629700, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-52.xml'}, {'damage_type': 'backtrace', 'id': 3312240500, 'ino': 1099511631503, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-22.xml'}, {'damage_type': 'backtrace', 'id': 3319352682, 'ino': 1099511629032, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-48.jpg'}, {'damage_type': 'backtrace', 'id': 3322120990, 'ino': 1099511630541, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 3326089212, 'ino': 1099511631566, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 3326977278, 'ino': 1099511632376, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-85.jpg'}, {'damage_type': 'backtrace', 'id': 3330078355, 'ino': 1099511628831, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-27.xml'}, {'damage_type': 'backtrace', 'id': 3330548440, 'ino': 1099511629844, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-21.xml'}, {'damage_type': 'backtrace', 'id': 3335155465, 'ino': 1099511628945, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-77.jpg'}, {'damage_type': 'backtrace', 'id': 3339758345, 'ino': 1099511629078, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-33.jpg'}, {'damage_type': 'backtrace', 'id': 3344630396, 'ino': 1099511629593, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-75.xml'}, {'damage_type': 'backtrace', 'id': 3351321178, 'ino': 1099511629723, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-46.xml'}, {'damage_type': 'backtrace', 'id': 3356696350, 'ino': 1099511630628, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-23.xml'}, {'damage_type': 'backtrace', 'id': 3356848832, 'ino': 1099511629479, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-30.xml'}, {'damage_type': 'backtrace', 'id': 3367793664, 'ino': 1099511630459, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-17.xml'}, {'damage_type': 'backtrace', 'id': 3376999049, 'ino': 1099511632438, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-68.jpg'}, {'damage_type': 'backtrace', 'id': 3379909264, 'ino': 1099511630435, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-26.xml'}, {'damage_type': 'backtrace', 'id': 3387159572, 'ino': 1099511629681, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-57.xml'}, {'damage_type': 'backtrace', 'id': 3397038390, 'ino': 1099511632555, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-10.xml'}, {'damage_type': 'backtrace', 'id': 3409313947, 'ino': 1099511629829, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-24.xml'}, {'damage_type': 'backtrace', 'id': 3415895080, 'ino': 1099511632529, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-45.jpg'}, {'damage_type': 'backtrace', 'id': 3417099898, 'ino': 1099511631496, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-25.xml'}, {'damage_type': 'backtrace', 'id': 3426847073, 'ino': 1099511631576, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 3434209247, 'ino': 1099511628747, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-59.xml'}, {'damage_type': 'backtrace', 'id': 3436236543, 'ino': 1099511629979, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 3436741926, 'ino': 1099511629350, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-73.xml'}, {'damage_type': 'backtrace', 'id': 3445539757, 'ino': 1099511629907, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-4.xml'}, {'damage_type': 'backtrace', 'id': 3458519975, 'ino': 1099511629415, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-51.xml'}, {'damage_type': 'backtrace', 'id': 3460171998, 'ino': 1099511629581, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-77.xml'}, {'damage_type': 'backtrace', 'id': 3461881235, 'ino': 1099511632424, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 3462369312, 'ino': 1099511629348, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-74.xml'}, {'damage_type': 'backtrace', 'id': 3463005989, 'ino': 1099511629410, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-53.xml'}, {'damage_type': 'backtrace', 'id': 3464748155, 'ino': 1099511633198, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/article-12.xml'}, {'damage_type': 'backtrace', 'id': 3468324551, 'ino': 1099511630649, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-16.xml'}, {'damage_type': 'backtrace', 'id': 3474592509, 'ino': 1099511631595, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 3480100720, 'ino': 1099511633300, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-30/picture-74.jpg'}, {'damage_type': 'backtrace', 'id': 3480759482, 'ino': 1099511632309, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-13.xml'}, {'damage_type': 'backtrace', 'id': 3482507343, 'ino': 1099511632575, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-31.jpg'}, {'damage_type': 'backtrace', 'id': 3487181085, 'ino': 1099511632277, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-17.xml'}, {'damage_type': 'backtrace', 'id': 3489289505, 'ino': 1099511630679, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-6.xml'}, {'damage_type': 'backtrace', 'id': 3505471037, 'ino': 1099511629093, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 3509555310, 'ino': 1099511629197, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 3526956903, 'ino': 1099511631303, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-96.xml'}, {'damage_type': 'backtrace', 'id': 3527882307, 'ino': 1099511632593, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 3528256900, 'ino': 1099511631041, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-55.xml'}, {'damage_type': 'backtrace', 'id': 3541455213, 'ino': 1099511630457, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-18.xml'}, {'damage_type': 'backtrace', 'id': 3545089476, 'ino': 1099511631852, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-69.xml'}, {'damage_type': 'backtrace', 'id': 3547120046, 'ino': 1099511632467, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-62.jpg'}, {'damage_type': 'backtrace', 'id': 3549066326, 'ino': 1099511632353, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 3555030201, 'ino': 1099511629060, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-39.jpg'}, {'damage_type': 'backtrace', 'id': 3555175066, 'ino': 1099511630529, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 3570603373, 'ino': 1099511629594, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-3.xml'}, {'damage_type': 'backtrace', 'id': 3581238337, 'ino': 1099511629935, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 3583732360, 'ino': 1099511630730, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 3584834069, 'ino': 1099511628802, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-37.xml'}, {'damage_type': 'backtrace', 'id': 3588967807, 'ino': 1099511628703, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-78.xml'}, {'damage_type': 'backtrace', 'id': 3590079333, 'ino': 1099511630646, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-17.xml'}, {'damage_type': 'backtrace', 'id': 3592148281, 'ino': 1099511628984, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-64.jpg'}, {'damage_type': 'backtrace', 'id': 3597182177, 'ino': 1099511628975, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-67.jpg'}, {'damage_type': 'backtrace', 'id': 3597552730, 'ino': 1099511629858, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-17.xml'}, {'damage_type': 'backtrace', 'id': 3603582942, 'ino': 1099511629795, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 3604111143, 'ino': 1099511631325, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-68.xml'}, {'damage_type': 'backtrace', 'id': 3607308424, 'ino': 1099511630685, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-4.xml'}, {'damage_type': 'backtrace', 'id': 3620804445, 'ino': 1099511630443, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-23.xml'}, {'damage_type': 'backtrace', 'id': 3651458808, 'ino': 1099511630409, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-33.xml'}, {'damage_type': 'backtrace', 'id': 3660181362, 'ino': 1099511628993, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-61.jpg'}, {'damage_type': 'backtrace', 'id': 3669563439, 'ino': 1099511630571, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 3672700731, 'ino': 1099511631510, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-19.xml'}, {'damage_type': 'backtrace', 'id': 3672945425, 'ino': 1099511631750, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-6.xml'}, {'damage_type': 'backtrace', 'id': 3674204490, 'ino': 1099511629491, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-27.xml'}, {'damage_type': 'backtrace', 'id': 3675923675, 'ino': 1099511632482, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-58.jpg'}, {'damage_type': 'backtrace', 'id': 3689715070, 'ino': 1099511629367, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-67.xml'}, {'damage_type': 'backtrace', 'id': 3693246110, 'ino': 1099511629951, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 3704885114, 'ino': 1099511628876, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-12.xml'}, {'damage_type': 'backtrace', 'id': 3713867971, 'ino': 1099511631260, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-10.xml'}, {'damage_type': 'backtrace', 'id': 3714673743, 'ino': 1099511632589, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 3715386049, 'ino': 1099511632547, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-39.jpg'}, {'damage_type': 'backtrace', 'id': 3719908032, 'ino': 1099511631887, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-61.xml'}, {'damage_type': 'backtrace', 'id': 3724118325, 'ino': 1099511629215, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 3733865061, 'ino': 1099511632377, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 3745831637, 'ino': 1099511631626, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-86.xml'}, {'damage_type': 'backtrace', 'id': 3749792243, 'ino': 1099511630478, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-10.xml'}, {'damage_type': 'backtrace', 'id': 3751510063, 'ino': 1099511632412, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 3754242016, 'ino': 1099511630544, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 3767549149, 'ino': 1099511629854, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-18.xml'}, {'damage_type': 'backtrace', 'id': 3769405341, 'ino': 1099511632499, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-54.jpg'}, {'damage_type': 'backtrace', 'id': 3782987565, 'ino': 1099511631124, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-26.xml'}, {'damage_type': 'backtrace', 'id': 3789720046, 'ino': 1099511629805, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-29.xml'}, {'damage_type': 'backtrace', 'id': 3791001758, 'ino': 1099511629514, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-20.xml'}, {'damage_type': 'backtrace', 'id': 3793681032, 'ino': 1099511631793, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-78.xml'}, {'damage_type': 'backtrace', 'id': 3793785331, 'ino': 1099511628785, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-43.xml'}, {'damage_type': 'backtrace', 'id': 3805876046, 'ino': 1099511628988, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-63.jpg'}, {'damage_type': 'backtrace', 'id': 3807276676, 'ino': 1099511628861, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-17.xml'}, {'damage_type': 'backtrace', 'id': 3822044473, 'ino': 1099511629863, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-16.xml'}, {'damage_type': 'backtrace', 'id': 3826260885, 'ino': 1099511632431, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-70.jpg'}, {'damage_type': 'backtrace', 'id': 3837098608, 'ino': 1099511630667, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-10.xml'}, {'damage_type': 'backtrace', 'id': 3847054418, 'ino': 1099511630661, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-12.xml'}, {'damage_type': 'backtrace', 'id': 3855269329, 'ino': 1099511632303, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-14.xml'}, {'damage_type': 'backtrace', 'id': 3861002368, 'ino': 1099511631385, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 3866664872, 'ino': 1099511632389, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-81.jpg'}, {'damage_type': 'backtrace', 'id': 3868534833, 'ino': 1099511628930, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-82.jpg'}, {'damage_type': 'backtrace', 'id': 3872504544, 'ino': 1099511629104, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 3878382248, 'ino': 1099511632384, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 3882207786, 'ino': 1099511628739, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-63.xml'}, {'damage_type': 'backtrace', 'id': 3898369925, 'ino': 1099511631583, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 3902218296, 'ino': 1099511629635, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-68.xml'}, {'damage_type': 'backtrace', 'id': 3907185670, 'ino': 1099511630526, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 3918304679, 'ino': 1099511628957, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-73.jpg'}, {'damage_type': 'backtrace', 'id': 3925658789, 'ino': 1099511629774, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-35.xml'}, {'damage_type': 'backtrace', 'id': 3925798479, 'ino': 1099511631095, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-37.xml'}, {'damage_type': 'backtrace', 'id': 3926150877, 'ino': 1099511630466, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-14.xml'}, {'damage_type': 'backtrace', 'id': 3935922238, 'ino': 1099511630431, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-27.xml'}, {'damage_type': 'backtrace', 'id': 3936857871, 'ino': 1099511631545, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-7.xml'}, {'damage_type': 'backtrace', 'id': 3938060402, 'ino': 1099511629892, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-8.xml'}, {'damage_type': 'backtrace', 'id': 3944953893, 'ino': 1099511629018, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-53.jpg'}, {'damage_type': 'backtrace', 'id': 3954584176, 'ino': 1099511628981, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-65.jpg'}, {'damage_type': 'backtrace', 'id': 3960139644, 'ino': 1099511628843, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-23.xml'}, {'damage_type': 'backtrace', 'id': 3963762206, 'ino': 1099511630559, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 3968772660, 'ino': 1099511631954, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-49.xml'}, {'damage_type': 'backtrace', 'id': 3983103426, 'ino': 1099511630496, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-4.xml'}, {'damage_type': 'backtrace', 'id': 3986848208, 'ino': 1099511629433, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-45.xml'}, {'damage_type': 'backtrace', 'id': 3988324165, 'ino': 1099511632610, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 4001005461, 'ino': 1099511628990, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-62.jpg'}, {'damage_type': 'backtrace', 'id': 4004680406, 'ino': 1099511632005, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-44.xml'}, {'damage_type': 'backtrace', 'id': 4009688486, 'ino': 1099511628737, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-64.xml'}, {'damage_type': 'backtrace', 'id': 4022152615, 'ino': 1099511631540, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-9.xml'}, {'damage_type': 'backtrace', 'id': 4029108780, 'ino': 1099511630742, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 4029379799, 'ino': 1099511631905, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-56.xml'}, {'damage_type': 'backtrace', 'id': 4036845350, 'ino': 1099511628707, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-77.xml'}, {'damage_type': 'backtrace', 'id': 4039030210, 'ino': 1099511631255, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-15.xml'}, {'damage_type': 'backtrace', 'id': 4051461997, 'ino': 1099511629915, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-2.xml'}, {'damage_type': 'backtrace', 'id': 4052309520, 'ino': 1099511630532, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 4055209433, 'ino': 1099511629509, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-22.xml'}, {'damage_type': 'backtrace', 'id': 4058615367, 'ino': 1099511628741, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-62.xml'}, {'damage_type': 'backtrace', 'id': 4067529605, 'ino': 1099511632351, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 4073673989, 'ino': 1099511628924, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-84.jpg'}, {'damage_type': 'backtrace', 'id': 4089076078, 'ino': 1099511631971, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-47.xml'}, {'damage_type': 'backtrace', 'id': 4106441540, 'ino': 1099511630462, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-16.xml'}, {'damage_type': 'backtrace', 'id': 4114921882, 'ino': 1099511629475, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-31.xml'}, {'damage_type': 'backtrace', 'id': 4122183217, 'ino': 1099511630427, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-28.xml'}, {'damage_type': 'backtrace', 'id': 4123536027, 'ino': 1099511628780, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/article-45.xml'}, {'damage_type': 'backtrace', 'id': 4141587894, 'ino': 1099511631580, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 4151108787, 'ino': 1099511631855, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-68.xml'}, {'damage_type': 'backtrace', 'id': 4159296681, 'ino': 1099511632100, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-36.xml'}, {'damage_type': 'backtrace', 'id': 4159898041, 'ino': 1099511629662, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-62.xml'}, {'damage_type': 'backtrace', 'id': 4160894151, 'ino': 1099511629745, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-68.xml'}, {'damage_type': 'backtrace', 'id': 4163012947, 'ino': 1099511631122, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-27.xml'}, {'damage_type': 'backtrace', 'id': 4164181022, 'ino': 1099511632189, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-27.xml'}, {'damage_type': 'backtrace', 'id': 4165428061, 'ino': 1099511629394, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-58.xml'}, {'damage_type': 'backtrace', 'id': 4170282207, 'ino': 1099511630691, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-2.xml'}, {'damage_type': 'backtrace', 'id': 4170478785, 'ino': 1099511631050, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-52.xml'}, {'damage_type': 'backtrace', 'id': 4189806667, 'ino': 1099511631267, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-3.xml'}, {'damage_type': 'backtrace', 'id': 4190672213, 'ino': 1099511632370, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 4191339956, 'ino': 1099511629039, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-46.jpg'}, {'damage_type': 'backtrace', 'id': 4192040363, 'ino': 1099511629825, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-25.xml'}, {'damage_type': 'backtrace', 'id': 4195165644, 'ino': 1099511632564, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-9.xml'}, {'damage_type': 'backtrace', 'id': 4198602344, 'ino': 1099511630454, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/article-19.xml'}, {'damage_type': 'backtrace', 'id': 4213430859, 'ino': 1099511629719, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-47.xml'}, {'damage_type': 'backtrace', 'id': 4220622707, 'ino': 1099511631535, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-11.xml'}, {'damage_type': 'backtrace', 'id': 4223862551, 'ino': 1099511631828, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-73.xml'}, {'damage_type': 'backtrace', 'id': 4232944703, 'ino': 1099511629611, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/article-72.xml'}, {'damage_type': 'backtrace', 'id': 4239632043, 'ino': 1099511630547, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-10/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 4245494876, 'ino': 1099511629011, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-55.jpg'}, {'damage_type': 'backtrace', 'id': 4245758244, 'ino': 1099511631032, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/comment-58.xml'}, {'damage_type': 'backtrace', 'id': 4249059141, 'ino': 1099511630290, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/comment-99.xml'}, {'damage_type': 'backtrace', 'id': 4255855793, 'ino': 1099511629505, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/article-23.xml'}, {'damage_type': 'backtrace', 'id': 4263705615, 'ino': 1099511629959, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-6/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 4273628319, 'ino': 1099511629657, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-4/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 4280312454, 'ino': 1099511631590, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 4281378561, 'ino': 1099511628926, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-2/picture-83.jpg'}] 2024-09-19T07:14:29.648 ERROR:tasks.fwd_scrub:rank 1 damaged: [{'damage_type': 'backtrace', 'id': 17037379, 'ino': 1099511631716, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-26.xml'}, {'damage_type': 'backtrace', 'id': 21315971, 'ino': 1099511628658, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/man/Makefile'}, {'damage_type': 'backtrace', 'id': 31599591, 'ino': 1099511630089, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-49.xml'}, {'damage_type': 'backtrace', 'id': 33772217, 'ino': 1099511631856, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-50.jpg'}, {'damage_type': 'backtrace', 'id': 40972544, 'ino': 1099511631663, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-46.xml'}, {'damage_type': 'backtrace', 'id': 60438133, 'ino': 1099511632289, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 74074912, 'ino': 1099511630015, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-66.xml'}, {'damage_type': 'backtrace', 'id': 84864623, 'ino': 1099511631759, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-14.xml'}, {'damage_type': 'backtrace', 'id': 86453799, 'ino': 1099511632395, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-36.xml'}, {'damage_type': 'backtrace', 'id': 99164097, 'ino': 1099511632226, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-12.xml'}, {'damage_type': 'backtrace', 'id': 128475348, 'ino': 1099511632528, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-30.jpg'}, {'damage_type': 'backtrace', 'id': 142551919, 'ino': 1099511631902, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 145058237, 'ino': 1099511632295, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 160710289, 'ino': 1099511632146, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-29.xml'}, {'damage_type': 'backtrace', 'id': 160902794, 'ino': 1099511630139, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-37.xml'}, {'damage_type': 'backtrace', 'id': 164215933, 'ino': 1099511630251, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 171521538, 'ino': 1099511632298, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 177745211, 'ino': 1099511631910, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 190359529, 'ino': 1099511630197, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-18.xml'}, {'damage_type': 'backtrace', 'id': 196055773, 'ino': 1099511631623, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-59.xml'}, {'damage_type': 'backtrace', 'id': 220713340, 'ino': 1099511632063, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-46.xml'}, {'damage_type': 'backtrace', 'id': 226907546, 'ino': 1099511631845, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-54.jpg'}, {'damage_type': 'backtrace', 'id': 234089688, 'ino': 1099511630265, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 234301326, 'ino': 1099511631982, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 245096979, 'ino': 1099511632261, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-1.xml'}, {'damage_type': 'backtrace', 'id': 249640616, 'ino': 1099511632381, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-62.jpg'}, {'damage_type': 'backtrace', 'id': 254749265, 'ino': 1099511632184, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-70.jpg'}, {'damage_type': 'backtrace', 'id': 257147975, 'ino': 1099511632450, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-51.jpg'}, {'damage_type': 'backtrace', 'id': 280714751, 'ino': 1099511632609, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 291694502, 'ino': 1099511631297, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-7.xml'}, {'damage_type': 'backtrace', 'id': 298506287, 'ino': 1099511630019, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-65.xml'}, {'damage_type': 'backtrace', 'id': 300613937, 'ino': 1099511628291, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/m4/acx_pthread.m4'}, {'damage_type': 'backtrace', 'id': 312211968, 'ino': 1099511632109, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-12.xml'}, {'damage_type': 'backtrace', 'id': 318355650, 'ino': 1099511631896, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-30.jpg'}, {'damage_type': 'backtrace', 'id': 321860467, 'ino': 1099511631862, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-47.jpg'}, {'damage_type': 'backtrace', 'id': 325728634, 'ino': 1099511630253, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 329857173, 'ino': 1099511630131, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-39.xml'}, {'damage_type': 'backtrace', 'id': 335892251, 'ino': 1099511632120, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-35.xml'}, {'damage_type': 'backtrace', 'id': 337216369, 'ino': 1099511630152, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-33.xml'}, {'damage_type': 'backtrace', 'id': 340208831, 'ino': 1099511632311, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 363975848, 'ino': 1099511631821, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-66.jpg'}, {'damage_type': 'backtrace', 'id': 365842490, 'ino': 1099511630023, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-64.xml'}, {'damage_type': 'backtrace', 'id': 384833436, 'ino': 1099511632588, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 392544386, 'ino': 1099511630268, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 393554078, 'ino': 1099511631608, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-64.xml'}, {'damage_type': 'backtrace', 'id': 411951525, 'ino': 1099511632215, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-15.xml'}, {'damage_type': 'backtrace', 'id': 417918036, 'ino': 1099511632164, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-2.xml'}, {'damage_type': 'backtrace', 'id': 438306747, 'ino': 1099511632549, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 452228154, 'ino': 1099511631627, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-58.xml'}, {'damage_type': 'backtrace', 'id': 464413638, 'ino': 1099511632006, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 464470274, 'ino': 1099511632439, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-54.jpg'}, {'damage_type': 'backtrace', 'id': 466405778, 'ino': 1099511632273, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 477285524, 'ino': 1099511632046, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-24.xml'}, {'damage_type': 'backtrace', 'id': 483004702, 'ino': 1099511631848, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-53.jpg'}, {'damage_type': 'backtrace', 'id': 490193364, 'ino': 1099511632282, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-31.jpg'}, {'damage_type': 'backtrace', 'id': 495772736, 'ino': 1099511632029, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-85.jpg'}, {'damage_type': 'backtrace', 'id': 496223559, 'ino': 1099511632116, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-76.jpg'}, {'damage_type': 'backtrace', 'id': 509731911, 'ino': 1099511631975, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/article-4.xml'}, {'damage_type': 'backtrace', 'id': 517306768, 'ino': 1099511632123, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-9.xml'}, {'damage_type': 'backtrace', 'id': 518269283, 'ino': 1099511630146, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-35.xml'}, {'damage_type': 'backtrace', 'id': 525628717, 'ino': 1099511631644, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-53.xml'}, {'damage_type': 'backtrace', 'id': 526857971, 'ino': 1099511630255, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 529706209, 'ino': 1099511631979, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/article-3.xml'}, {'damage_type': 'backtrace', 'id': 535875362, 'ino': 1099511632250, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-39.xml'}, {'damage_type': 'backtrace', 'id': 565567734, 'ino': 1099511632331, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 575439086, 'ino': 1099511632563, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 579487672, 'ino': 1099511632522, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-32.jpg'}, {'damage_type': 'backtrace', 'id': 601085950, 'ino': 1099511630127, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-40.xml'}, {'damage_type': 'backtrace', 'id': 611865304, 'ino': 1099511631972, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 624126269, 'ino': 1099511632028, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-27.xml'}, {'damage_type': 'backtrace', 'id': 631341279, 'ino': 1099511630098, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-47.xml'}, {'damage_type': 'backtrace', 'id': 632395446, 'ino': 1099511630065, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-54.xml'}, {'damage_type': 'backtrace', 'id': 634295656, 'ino': 1099511631820, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-67.jpg'}, {'damage_type': 'backtrace', 'id': 651416152, 'ino': 1099511632329, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 652570563, 'ino': 1099511632584, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 686382384, 'ino': 1099511632333, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 696544984, 'ino': 1099511632034, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-84.jpg'}, {'damage_type': 'backtrace', 'id': 698337696, 'ino': 1099511631704, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-31.xml'}, {'damage_type': 'backtrace', 'id': 703483306, 'ino': 1099511632249, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-6.xml'}, {'damage_type': 'backtrace', 'id': 708080290, 'ino': 1099511631870, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-43.jpg'}, {'damage_type': 'backtrace', 'id': 715007761, 'ino': 1099511632048, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-49.xml'}, {'damage_type': 'backtrace', 'id': 715869592, 'ino': 1099511632104, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-13.xml'}, {'damage_type': 'backtrace', 'id': 743901499, 'ino': 1099511631807, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-75.jpg'}, {'damage_type': 'backtrace', 'id': 760920860, 'ino': 1099511631751, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-16.xml'}, {'damage_type': 'backtrace', 'id': 774638872, 'ino': 1099511630218, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-11.xml'}, {'damage_type': 'backtrace', 'id': 779088074, 'ino': 1099511630164, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-29.xml'}, {'damage_type': 'backtrace', 'id': 785928053, 'ino': 1099511631898, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-29.jpg'}, {'damage_type': 'backtrace', 'id': 796708199, 'ino': 1099511630215, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-12.xml'}, {'damage_type': 'backtrace', 'id': 802357711, 'ino': 1099511631272, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-16.xml'}, {'damage_type': 'backtrace', 'id': 802675456, 'ino': 1099511631822, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-65.jpg'}, {'damage_type': 'backtrace', 'id': 826030487, 'ino': 1099511630209, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-14.xml'}, {'damage_type': 'backtrace', 'id': 829670413, 'ino': 1099511632293, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 842404014, 'ino': 1099511632000, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 857596869, 'ino': 1099511632209, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-16.xml'}, {'damage_type': 'backtrace', 'id': 857613049, 'ino': 1099511632253, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-4.xml'}, {'damage_type': 'backtrace', 'id': 867829249, 'ino': 1099511631872, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-42.jpg'}, {'damage_type': 'backtrace', 'id': 871861611, 'ino': 1099511630236, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-5.xml'}, {'damage_type': 'backtrace', 'id': 879839491, 'ino': 1099511630167, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-28.xml'}, {'damage_type': 'backtrace', 'id': 889047622, 'ino': 1099511630224, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-9.xml'}, {'damage_type': 'backtrace', 'id': 909509401, 'ino': 1099511630245, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-1.xml'}, {'damage_type': 'backtrace', 'id': 915302995, 'ino': 1099511632176, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-42.jpg'}, {'damage_type': 'backtrace', 'id': 922149749, 'ino': 1099511632191, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-20.xml'}, {'damage_type': 'backtrace', 'id': 923808292, 'ino': 1099511632153, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-4.xml'}, {'damage_type': 'backtrace', 'id': 931908314, 'ino': 1099511630052, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-57.xml'}, {'damage_type': 'backtrace', 'id': 935159464, 'ino': 1099511630260, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 937669243, 'ino': 1099511630080, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-51.xml'}, {'damage_type': 'backtrace', 'id': 938725909, 'ino': 1099511631699, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-33.xml'}, {'damage_type': 'backtrace', 'id': 940397027, 'ino': 1099511632213, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-44.xml'}, {'damage_type': 'backtrace', 'id': 970054657, 'ino': 1099511631878, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-39.jpg'}, {'damage_type': 'backtrace', 'id': 970176663, 'ino': 1099511632279, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 971072252, 'ino': 1099511631969, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/article-5.xml'}, {'damage_type': 'backtrace', 'id': 984195779, 'ino': 1099511632430, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-55.jpg'}, {'damage_type': 'backtrace', 'id': 988890479, 'ino': 1099511632305, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 990335617, 'ino': 1099511630262, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 992106901, 'ino': 1099511631906, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-25.jpg'}, {'damage_type': 'backtrace', 'id': 998065287, 'ino': 1099511630252, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 999356677, 'ino': 1099511630246, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 1000427359, 'ino': 1099511632315, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 1000590206, 'ino': 1099511632534, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 1011467720, 'ino': 1099511631730, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-21.xml'}, {'damage_type': 'backtrace', 'id': 1017582002, 'ino': 1099511630027, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-63.xml'}, {'damage_type': 'backtrace', 'id': 1027509946, 'ino': 1099511630206, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-15.xml'}, {'damage_type': 'backtrace', 'id': 1030420745, 'ino': 1099511632106, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-77.jpg'}, {'damage_type': 'backtrace', 'id': 1030630298, 'ino': 1099511631868, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-44.jpg'}, {'damage_type': 'backtrace', 'id': 1047079448, 'ino': 1099511632369, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-64.jpg'}, {'damage_type': 'backtrace', 'id': 1060255187, 'ino': 1099511632238, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-9.xml'}, {'damage_type': 'backtrace', 'id': 1065397099, 'ino': 1099511632258, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-2.xml'}, {'damage_type': 'backtrace', 'id': 1096324385, 'ino': 1099511632339, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 1101034159, 'ino': 1099511630221, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-10.xml'}, {'damage_type': 'backtrace', 'id': 1111282969, 'ino': 1099511632212, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-67.jpg'}, {'damage_type': 'backtrace', 'id': 1125324144, 'ino': 1099511631724, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-23.xml'}, {'damage_type': 'backtrace', 'id': 1137165703, 'ino': 1099511632040, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-25.xml'}, {'damage_type': 'backtrace', 'id': 1148206674, 'ino': 1099511629996, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-71.xml'}, {'damage_type': 'backtrace', 'id': 1152548624, 'ino': 1099511632036, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-51.xml'}, {'damage_type': 'backtrace', 'id': 1174352322, 'ino': 1099511632256, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-3.xml'}, {'damage_type': 'backtrace', 'id': 1185930749, 'ino': 1099511632196, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-19.xml'}, {'damage_type': 'backtrace', 'id': 1204508060, 'ino': 1099511631892, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-32.jpg'}, {'damage_type': 'backtrace', 'id': 1208254160, 'ino': 1099511632278, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 1216729277, 'ino': 1099511632352, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 1227736510, 'ino': 1099511632227, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-42.xml'}, {'damage_type': 'backtrace', 'id': 1237525356, 'ino': 1099511632571, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 1244295701, 'ino': 1099511631671, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-43.xml'}, {'damage_type': 'backtrace', 'id': 1255483227, 'ino': 1099511631839, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-56.jpg'}, {'damage_type': 'backtrace', 'id': 1262796965, 'ino': 1099511631330, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 1279682299, 'ino': 1099511632568, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 1285212258, 'ino': 1099511628294, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/man/Makefile.am'}, {'damage_type': 'backtrace', 'id': 1285467739, 'ino': 1099511631900, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 1289894607, 'ino': 1099511631719, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-25.xml'}, {'damage_type': 'backtrace', 'id': 1290341540, 'ino': 1099511631316, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-56.xml'}, {'damage_type': 'backtrace', 'id': 1294816123, 'ino': 1099511632525, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-31.jpg'}, {'damage_type': 'backtrace', 'id': 1297398570, 'ino': 1099511632446, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-52.jpg'}, {'damage_type': 'backtrace', 'id': 1308792409, 'ino': 1099511631743, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-18.xml'}, {'damage_type': 'backtrace', 'id': 1309919149, 'ino': 1099511631813, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-72.jpg'}, {'damage_type': 'backtrace', 'id': 1313867401, 'ino': 1099511631665, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-45.xml'}, {'damage_type': 'backtrace', 'id': 1315534205, 'ino': 1099511631735, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-20.xml'}, {'damage_type': 'backtrace', 'id': 1344637386, 'ino': 1099511630076, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-52.xml'}, {'damage_type': 'backtrace', 'id': 1352420461, 'ino': 1099511632275, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 1356668850, 'ino': 1099511632531, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-29.jpg'}, {'damage_type': 'backtrace', 'id': 1361298810, 'ino': 1099511631318, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-2.xml'}, {'damage_type': 'backtrace', 'id': 1372677352, 'ino': 1099511632486, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-42.jpg'}, {'damage_type': 'backtrace', 'id': 1373762875, 'ino': 1099511632271, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 1392867363, 'ino': 1099511632478, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-44.jpg'}, {'damage_type': 'backtrace', 'id': 1401099411, 'ino': 1099511632540, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 1412976764, 'ino': 1099511631614, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-62.xml'}, {'damage_type': 'backtrace', 'id': 1437283370, 'ino': 1099511632142, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-30.xml'}, {'damage_type': 'backtrace', 'id': 1439451165, 'ino': 1099511630254, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 1445171876, 'ino': 1099511631763, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-13.xml'}, {'damage_type': 'backtrace', 'id': 1447654090, 'ino': 1099511631833, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-59.jpg'}, {'damage_type': 'backtrace', 'id': 1455444831, 'ino': 1099511632501, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-38.jpg'}, {'damage_type': 'backtrace', 'id': 1456618854, 'ino': 1099511631641, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-54.xml'}, {'damage_type': 'backtrace', 'id': 1456686680, 'ino': 1099511632094, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-15.xml'}, {'damage_type': 'backtrace', 'id': 1471211089, 'ino': 1099511630158, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-31.xml'}, {'damage_type': 'backtrace', 'id': 1485767640, 'ino': 1099511632095, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-40.xml'}, {'damage_type': 'backtrace', 'id': 1487013971, 'ino': 1099511632335, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 1490634901, 'ino': 1099511632324, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 1509619708, 'ino': 1099511630233, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-6.xml'}, {'damage_type': 'backtrace', 'id': 1524799631, 'ino': 1099511631276, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-14.xml'}, {'damage_type': 'backtrace', 'id': 1541003132, 'ino': 1099511632098, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-78.jpg'}, {'damage_type': 'backtrace', 'id': 1543989254, 'ino': 1099511632033, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-26.xml'}, {'damage_type': 'backtrace', 'id': 1577405239, 'ino': 1099511632519, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-33.jpg'}, {'damage_type': 'backtrace', 'id': 1581029365, 'ino': 1099511630093, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-48.xml'}, {'damage_type': 'backtrace', 'id': 1585846890, 'ino': 1099511632304, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 1590034980, 'ino': 1099511631702, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-32.xml'}, {'damage_type': 'backtrace', 'id': 1602977542, 'ino': 1099511631991, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/article-1.xml'}, {'damage_type': 'backtrace', 'id': 1610315354, 'ino': 1099511631876, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-40.jpg'}, {'damage_type': 'backtrace', 'id': 1610535363, 'ino': 1099511631920, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 1611893583, 'ino': 1099511631928, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 1623077034, 'ino': 1099511632577, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 1632846295, 'ino': 1099511629988, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-73.xml'}, {'damage_type': 'backtrace', 'id': 1635353763, 'ino': 1099511631810, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-74.jpg'}, {'damage_type': 'backtrace', 'id': 1637779254, 'ino': 1099511632556, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 1648283682, 'ino': 1099511632149, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-28.xml'}, {'damage_type': 'backtrace', 'id': 1671740828, 'ino': 1099511632133, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-32.xml'}, {'damage_type': 'backtrace', 'id': 1671896443, 'ino': 1099511632543, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-25.jpg'}, {'damage_type': 'backtrace', 'id': 1678346740, 'ino': 1099511631311, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-92.jpg'}, {'damage_type': 'backtrace', 'id': 1687468764, 'ino': 1099511632129, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-33.xml'}, {'damage_type': 'backtrace', 'id': 1705959189, 'ino': 1099511631824, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-64.jpg'}, {'damage_type': 'backtrace', 'id': 1714871306, 'ino': 1099511631707, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-30.xml'}, {'damage_type': 'backtrace', 'id': 1736396089, 'ino': 1099511631825, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-63.jpg'}, {'damage_type': 'backtrace', 'id': 1762537772, 'ino': 1099511632466, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-47.jpg'}, {'damage_type': 'backtrace', 'id': 1764919765, 'ino': 1099511632337, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 1767223273, 'ino': 1099511631712, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-28.xml'}, {'damage_type': 'backtrace', 'id': 1819638620, 'ino': 1099511632139, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-7.xml'}, {'damage_type': 'backtrace', 'id': 1820714422, 'ino': 1099511632202, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-68.jpg'}, {'damage_type': 'backtrace', 'id': 1831195975, 'ino': 1099511632235, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-10.xml'}, {'damage_type': 'backtrace', 'id': 1839123947, 'ino': 1099511631835, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-58.jpg'}, {'damage_type': 'backtrace', 'id': 1845950759, 'ino': 1099511630188, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-21.xml'}, {'damage_type': 'backtrace', 'id': 1846723312, 'ino': 1099511632156, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-27.xml'}, {'damage_type': 'backtrace', 'id': 1852054226, 'ino': 1099511631655, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-49.xml'}, {'damage_type': 'backtrace', 'id': 1858278534, 'ino': 1099511632299, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-25.jpg'}, {'damage_type': 'backtrace', 'id': 1864863421, 'ino': 1099511632088, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-16.xml'}, {'damage_type': 'backtrace', 'id': 1867931102, 'ino': 1099511632147, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-5.xml'}, {'damage_type': 'backtrace', 'id': 1869055879, 'ino': 1099511630179, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-24.xml'}, {'damage_type': 'backtrace', 'id': 1870928461, 'ino': 1099511632513, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-35.jpg'}, {'damage_type': 'backtrace', 'id': 1872746191, 'ino': 1099511632161, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-26.xml'}, {'damage_type': 'backtrace', 'id': 1878980688, 'ino': 1099511632443, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-53.jpg'}, {'damage_type': 'backtrace', 'id': 1880561455, 'ino': 1099511632068, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-20.xml'}, {'damage_type': 'backtrace', 'id': 1891747582, 'ino': 1099511632308, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 1897000147, 'ino': 1099511630112, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-44.xml'}, {'damage_type': 'backtrace', 'id': 1907556040, 'ino': 1099511631886, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-35.jpg'}, {'damage_type': 'backtrace', 'id': 1920476983, 'ino': 1099511632031, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-52.xml'}, {'damage_type': 'backtrace', 'id': 1938521100, 'ino': 1099511631327, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 1938810799, 'ino': 1099511632143, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-6.xml'}, {'damage_type': 'backtrace', 'id': 1941736119, 'ino': 1099511632489, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-41.jpg'}, {'damage_type': 'backtrace', 'id': 1942270283, 'ino': 1099511632307, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 1945216948, 'ino': 1099511630120, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-42.xml'}, {'damage_type': 'backtrace', 'id': 1946443920, 'ino': 1099511631682, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-40.xml'}, {'damage_type': 'backtrace', 'id': 1959006011, 'ino': 1099511632168, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-25.xml'}, {'damage_type': 'backtrace', 'id': 1971780127, 'ino': 1099511630191, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-20.xml'}, {'damage_type': 'backtrace', 'id': 1973274980, 'ino': 1099511630200, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-17.xml'}, {'damage_type': 'backtrace', 'id': 1983824087, 'ino': 1099511631796, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-4.xml'}, {'damage_type': 'backtrace', 'id': 1989322263, 'ino': 1099511632343, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 2000186497, 'ino': 1099511632421, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-56.jpg'}, {'damage_type': 'backtrace', 'id': 2002660487, 'ino': 1099511631866, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-45.jpg'}, {'damage_type': 'backtrace', 'id': 2006669537, 'ino': 1099511632151, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-73.jpg'}, {'damage_type': 'backtrace', 'id': 2006772518, 'ino': 1099511630194, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-19.xml'}, {'damage_type': 'backtrace', 'id': 2011659887, 'ino': 1099511630008, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-68.xml'}, {'damage_type': 'backtrace', 'id': 2014522998, 'ino': 1099511632051, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-23.xml'}, {'damage_type': 'backtrace', 'id': 2017373997, 'ino': 1099511632314, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 2027098083, 'ino': 1099511632090, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-41.xml'}, {'damage_type': 'backtrace', 'id': 2036963098, 'ino': 1099511630182, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-23.xml'}, {'damage_type': 'backtrace', 'id': 2045735083, 'ino': 1099511630116, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-43.xml'}, {'damage_type': 'backtrace', 'id': 2053016041, 'ino': 1099511632252, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-5.xml'}, {'damage_type': 'backtrace', 'id': 2066278303, 'ino': 1099511631747, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-17.xml'}, {'damage_type': 'backtrace', 'id': 2076434683, 'ino': 1099511632265, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 2098949848, 'ino': 1099511631804, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-76.jpg'}, {'damage_type': 'backtrace', 'id': 2122818284, 'ino': 1099511630263, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 2129437726, 'ino': 1099511630161, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-30.xml'}, {'damage_type': 'backtrace', 'id': 2145112332, 'ino': 1099511630124, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-41.xml'}, {'damage_type': 'backtrace', 'id': 2146470146, 'ino': 1099511631819, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-68.jpg'}, {'damage_type': 'backtrace', 'id': 2165590826, 'ino': 1099511631951, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 2167038785, 'ino': 1099511631727, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-22.xml'}, {'damage_type': 'backtrace', 'id': 2167703077, 'ino': 1099511630149, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-34.xml'}, {'damage_type': 'backtrace', 'id': 2168499523, 'ino': 1099511632300, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 2174117749, 'ino': 1099511631967, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 2177267006, 'ino': 1099511632313, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 2181911224, 'ino': 1099511630108, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-45.xml'}, {'damage_type': 'backtrace', 'id': 2195911783, 'ino': 1099511632267, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 2207768817, 'ino': 1099511632454, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-50.jpg'}, {'damage_type': 'backtrace', 'id': 2218901884, 'ino': 1099511631294, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-8.xml'}, {'damage_type': 'backtrace', 'id': 2225544646, 'ino': 1099511632236, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-36.jpg'}, {'damage_type': 'backtrace', 'id': 2228354335, 'ino': 1099511632600, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 2234183186, 'ino': 1099511631962, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 2237208016, 'ino': 1099511632498, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-39.jpg'}, {'damage_type': 'backtrace', 'id': 2251489508, 'ino': 1099511631291, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-9.xml'}, {'damage_type': 'backtrace', 'id': 2263513299, 'ino': 1099511632114, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-36.xml'}, {'damage_type': 'backtrace', 'id': 2270901604, 'ino': 1099511632327, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 2274343367, 'ino': 1099511632134, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-74.jpg'}, {'damage_type': 'backtrace', 'id': 2279472141, 'ino': 1099511632219, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-14.xml'}, {'damage_type': 'backtrace', 'id': 2290126786, 'ino': 1099511630230, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-7.xml'}, {'damage_type': 'backtrace', 'id': 2295946322, 'ino': 1099511632287, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 2300203070, 'ino': 1099511630142, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-36.xml'}, {'damage_type': 'backtrace', 'id': 2302940693, 'ino': 1099511632248, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-35.jpg'}, {'damage_type': 'backtrace', 'id': 2314653592, 'ino': 1099511632350, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 2320373476, 'ino': 1099511631610, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-63.xml'}, {'damage_type': 'backtrace', 'id': 2321460668, 'ino': 1099511632194, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-40.jpg'}, {'damage_type': 'backtrace', 'id': 2329439593, 'ino': 1099511632072, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-19.xml'}, {'damage_type': 'backtrace', 'id': 2339059095, 'ino': 1099511632458, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-49.jpg'}, {'damage_type': 'backtrace', 'id': 2344033349, 'ino': 1099511632493, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-40.jpg'}, {'damage_type': 'backtrace', 'id': 2356155344, 'ino': 1099511632546, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 2379426113, 'ino': 1099511632172, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-24.xml'}, {'damage_type': 'backtrace', 'id': 2381866727, 'ino': 1099511631776, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-10.xml'}, {'damage_type': 'backtrace', 'id': 2390260558, 'ino': 1099511631755, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-15.xml'}, {'damage_type': 'backtrace', 'id': 2394425080, 'ino': 1099511631661, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-47.xml'}, {'damage_type': 'backtrace', 'id': 2400288198, 'ino': 1099511631802, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-1.xml'}, {'damage_type': 'backtrace', 'id': 2425228564, 'ino': 1099511631904, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 2430328954, 'ino': 1099511631936, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 2437616983, 'ino': 1099511631818, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-69.jpg'}, {'damage_type': 'backtrace', 'id': 2452930459, 'ino': 1099511632199, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-18.xml'}, {'damage_type': 'backtrace', 'id': 2473186531, 'ino': 1099511631965, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/article-6.xml'}, {'damage_type': 'backtrace', 'id': 2474828874, 'ino': 1099511630011, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-67.xml'}, {'damage_type': 'backtrace', 'id': 2478662586, 'ino': 1099511630039, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-60.xml'}, {'damage_type': 'backtrace', 'id': 2481860546, 'ino': 1099511632552, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 2483590384, 'ino': 1099511632065, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-81.jpg'}, {'damage_type': 'backtrace', 'id': 2491390597, 'ino': 1099511632086, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-79.jpg'}, {'damage_type': 'backtrace', 'id': 2492797850, 'ino': 1099511631912, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 2503923878, 'ino': 1099511631649, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-51.xml'}, {'damage_type': 'backtrace', 'id': 2520942165, 'ino': 1099511632043, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-83.jpg'}, {'damage_type': 'backtrace', 'id': 2524190438, 'ino': 1099511631884, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-36.jpg'}, {'damage_type': 'backtrace', 'id': 2543604959, 'ino': 1099511631946, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 2546374090, 'ino': 1099511632346, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 2549315820, 'ino': 1099511632125, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-34.xml'}, {'damage_type': 'backtrace', 'id': 2549681354, 'ino': 1099511631653, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-50.xml'}, {'damage_type': 'backtrace', 'id': 2564822786, 'ino': 1099511630248, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 2577357095, 'ino': 1099511632229, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-37.jpg'}, {'damage_type': 'backtrace', 'id': 2595811605, 'ino': 1099511632407, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-58.jpg'}, {'damage_type': 'backtrace', 'id': 2600686471, 'ino': 1099511632178, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-23.xml'}, {'damage_type': 'backtrace', 'id': 2644789464, 'ino': 1099511631784, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-8.xml'}, {'damage_type': 'backtrace', 'id': 2659403685, 'ino': 1099511632509, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-36.jpg'}, {'damage_type': 'backtrace', 'id': 2665129185, 'ino': 1099511631631, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-57.xml'}, {'damage_type': 'backtrace', 'id': 2674016625, 'ino': 1099511632355, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 2679680204, 'ino': 1099511632131, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-8.xml'}, {'damage_type': 'backtrace', 'id': 2682195704, 'ino': 1099511631798, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-3.xml'}, {'damage_type': 'backtrace', 'id': 2685357557, 'ino': 1099511632163, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-72.jpg'}, {'damage_type': 'backtrace', 'id': 2689426017, 'ino': 1099511631685, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-39.xml'}, {'damage_type': 'backtrace', 'id': 2699489260, 'ino': 1099511632281, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 2699858482, 'ino': 1099511631829, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-61.jpg'}, {'damage_type': 'backtrace', 'id': 2707834693, 'ino': 1099511630043, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-59.xml'}, {'damage_type': 'backtrace', 'id': 2713126108, 'ino': 1099511631697, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-34.xml'}, {'damage_type': 'backtrace', 'id': 2715743170, 'ino': 1099511632074, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-44.xml'}, {'damage_type': 'backtrace', 'id': 2722236936, 'ino': 1099511630278, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-55.xml'}, {'damage_type': 'backtrace', 'id': 2723116714, 'ino': 1099511632285, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-30.jpg'}, {'damage_type': 'backtrace', 'id': 2726008023, 'ino': 1099511632316, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 2726092938, 'ino': 1099511632348, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 2726771421, 'ino': 1099511631739, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-19.xml'}, {'damage_type': 'backtrace', 'id': 2729988316, 'ino': 1099511632290, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 2738128193, 'ino': 1099511632413, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-57.jpg'}, {'damage_type': 'backtrace', 'id': 2741165769, 'ino': 1099511631815, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-71.jpg'}, {'damage_type': 'backtrace', 'id': 2745728617, 'ino': 1099511630104, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-46.xml'}, {'damage_type': 'backtrace', 'id': 2750829092, 'ino': 1099511631932, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 2771858904, 'ino': 1099511630239, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-4.xml'}, {'damage_type': 'backtrace', 'id': 2774890463, 'ino': 1099511631800, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-2.xml'}, {'damage_type': 'backtrace', 'id': 2794189320, 'ino': 1099511632105, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-38.xml'}, {'damage_type': 'backtrace', 'id': 2797042069, 'ino': 1099511630155, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-32.xml'}, {'damage_type': 'backtrace', 'id': 2797845641, 'ino': 1099511631795, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-5.xml'}, {'damage_type': 'backtrace', 'id': 2810921025, 'ino': 1099511632270, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 2837465203, 'ino': 1099511630249, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 2838388415, 'ino': 1099511632319, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 2856558942, 'ino': 1099511630173, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-26.xml'}, {'damage_type': 'backtrace', 'id': 2861587224, 'ino': 1099511631679, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-41.xml'}, {'damage_type': 'backtrace', 'id': 2867968857, 'ino': 1099511632177, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-71.jpg'}, {'damage_type': 'backtrace', 'id': 2870730778, 'ino': 1099511632076, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-80.jpg'}, {'damage_type': 'backtrace', 'id': 2876997873, 'ino': 1099511632284, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 2879457272, 'ino': 1099511632266, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-32.jpg'}, {'damage_type': 'backtrace', 'id': 2906787070, 'ino': 1099511632099, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-39.xml'}, {'damage_type': 'backtrace', 'id': 2910764367, 'ino': 1099511631827, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-62.jpg'}, {'damage_type': 'backtrace', 'id': 2917265994, 'ino': 1099511631908, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 2932678515, 'ino': 1099511630170, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-27.xml'}, {'damage_type': 'backtrace', 'id': 2933003944, 'ino': 1099511631977, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 2936122298, 'ino': 1099511632126, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-75.jpg'}, {'damage_type': 'backtrace', 'id': 2936877653, 'ino': 1099511632081, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-43.xml'}, {'damage_type': 'backtrace', 'id': 2947029249, 'ino': 1099511631675, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-42.xml'}, {'damage_type': 'backtrace', 'id': 2954630080, 'ino': 1099511632025, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-53.xml'}, {'damage_type': 'backtrace', 'id': 2969251531, 'ino': 1099511632016, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-87.jpg'}, {'damage_type': 'backtrace', 'id': 2973796083, 'ino': 1099511632221, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-43.xml'}, {'damage_type': 'backtrace', 'id': 3004304692, 'ino': 1099511629992, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-72.xml'}, {'damage_type': 'backtrace', 'id': 3009503335, 'ino': 1099511631890, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-33.jpg'}, {'damage_type': 'backtrace', 'id': 3033765241, 'ino': 1099511631767, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-12.xml'}, {'damage_type': 'backtrace', 'id': 3040394810, 'ino': 1099511632010, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-88.jpg'}, {'damage_type': 'backtrace', 'id': 3045523918, 'ino': 1099511632596, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 3050754596, 'ino': 1099511630134, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-38.xml'}, {'damage_type': 'backtrace', 'id': 3055311278, 'ino': 1099511631959, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/article-7.xml'}, {'damage_type': 'backtrace', 'id': 3056821560, 'ino': 1099511632560, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 3070498583, 'ino': 1099511632015, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-29.xml'}, {'damage_type': 'backtrace', 'id': 3087276558, 'ino': 1099511630250, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 3090280216, 'ino': 1099511632574, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 3102636777, 'ino': 1099511630000, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-70.xml'}, {'damage_type': 'backtrace', 'id': 3112535212, 'ino': 1099511632516, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-34.jpg'}, {'damage_type': 'backtrace', 'id': 3114621460, 'ino': 1099511632380, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-38.xml'}, {'damage_type': 'backtrace', 'id': 3116130406, 'ino': 1099511632388, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-37.xml'}, {'damage_type': 'backtrace', 'id': 3116206970, 'ino': 1099511631709, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-29.xml'}, {'damage_type': 'backtrace', 'id': 3118141743, 'ino': 1099511632084, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-17.xml'}, {'damage_type': 'backtrace', 'id': 3124661663, 'ino': 1099511632112, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-11.xml'}, {'damage_type': 'backtrace', 'id': 3132313051, 'ino': 1099511631308, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-4.xml'}, {'damage_type': 'backtrace', 'id': 3187863394, 'ino': 1099511631858, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-49.jpg'}, {'damage_type': 'backtrace', 'id': 3201144334, 'ino': 1099511631894, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-31.jpg'}, {'damage_type': 'backtrace', 'id': 3206608789, 'ino': 1099511631619, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-60.xml'}, {'damage_type': 'backtrace', 'id': 3208637310, 'ino': 1099511632185, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-41.jpg'}, {'damage_type': 'backtrace', 'id': 3236062708, 'ino': 1099511631918, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 3236102682, 'ino': 1099511632462, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-48.jpg'}, {'damage_type': 'backtrace', 'id': 3236955854, 'ino': 1099511630048, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-58.xml'}, {'damage_type': 'backtrace', 'id': 3238956671, 'ino': 1099511631668, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-44.xml'}, {'damage_type': 'backtrace', 'id': 3243136772, 'ino': 1099511632359, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 3249654378, 'ino': 1099511631882, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-37.jpg'}, {'damage_type': 'backtrace', 'id': 3253668549, 'ino': 1099511631780, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-9.xml'}, {'damage_type': 'backtrace', 'id': 3261796115, 'ino': 1099511632537, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 3266468821, 'ino': 1099511630004, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-69.xml'}, {'damage_type': 'backtrace', 'id': 3275448418, 'ino': 1099511632061, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-21.xml'}, {'damage_type': 'backtrace', 'id': 3305215397, 'ino': 1099511631838, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-57.jpg'}, {'damage_type': 'backtrace', 'id': 3307503956, 'ino': 1099511630176, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-25.xml'}, {'damage_type': 'backtrace', 'id': 3327570336, 'ino': 1099511631792, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-6.xml'}, {'damage_type': 'backtrace', 'id': 3329885931, 'ino': 1099511632056, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-22.xml'}, {'damage_type': 'backtrace', 'id': 3377080150, 'ino': 1099511632506, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-37.jpg'}, {'damage_type': 'backtrace', 'id': 3381340727, 'ino': 1099511630057, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-56.xml'}, {'damage_type': 'backtrace', 'id': 3381542292, 'ino': 1099511632204, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-39.jpg'}, {'damage_type': 'backtrace', 'id': 3382671156, 'ino': 1099511630258, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 3420477847, 'ino': 1099511630257, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 3425963951, 'ino': 1099511631842, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-55.jpg'}, {'damage_type': 'backtrace', 'id': 3431612153, 'ino': 1099511631300, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-6.xml'}, {'damage_type': 'backtrace', 'id': 3432809636, 'ino': 1099511632394, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-60.jpg'}, {'damage_type': 'backtrace', 'id': 3436620660, 'ino': 1099511632022, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-28.xml'}, {'damage_type': 'backtrace', 'id': 3439081405, 'ino': 1099511630035, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-61.xml'}, {'damage_type': 'backtrace', 'id': 3462499260, 'ino': 1099511632310, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 3468850378, 'ino': 1099511630070, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-53.xml'}, {'damage_type': 'backtrace', 'id': 3472871501, 'ino': 1099511632137, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-31.xml'}, {'damage_type': 'backtrace', 'id': 3478210603, 'ino': 1099511630247, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 3485732734, 'ino': 1099511631986, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/article-2.xml'}, {'damage_type': 'backtrace', 'id': 3497331018, 'ino': 1099511630212, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-13.xml'}, {'damage_type': 'backtrace', 'id': 3514377241, 'ino': 1099511632390, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-61.jpg'}, {'damage_type': 'backtrace', 'id': 3542144942, 'ino': 1099511631956, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 3554555443, 'ino': 1099511632241, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-8.xml'}, {'damage_type': 'backtrace', 'id': 3576796906, 'ino': 1099511632580, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 3584396968, 'ino': 1099511632023, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-86.jpg'}, {'damage_type': 'backtrace', 'id': 3617204365, 'ino': 1099511632401, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-59.jpg'}, {'damage_type': 'backtrace', 'id': 3622996301, 'ino': 1099511630243, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-2.xml'}, {'damage_type': 'backtrace', 'id': 3626731386, 'ino': 1099511632058, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-47.xml'}, {'damage_type': 'backtrace', 'id': 3644240561, 'ino': 1099511632592, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 3672102100, 'ino': 1099511632181, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-22.xml'}, {'damage_type': 'backtrace', 'id': 3679623087, 'ino': 1099511632042, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-50.xml'}, {'damage_type': 'backtrace', 'id': 3683155660, 'ino': 1099511632054, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-82.jpg'}, {'damage_type': 'backtrace', 'id': 3694017725, 'ino': 1099511631811, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-73.jpg'}, {'damage_type': 'backtrace', 'id': 3694809834, 'ino': 1099511632224, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-13.xml'}, {'damage_type': 'backtrace', 'id': 3724041245, 'ino': 1099511631888, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-34.jpg'}, {'damage_type': 'backtrace', 'id': 3728228307, 'ino': 1099511631288, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-10.xml'}, {'damage_type': 'backtrace', 'id': 3734668259, 'ino': 1099511631278, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-13.xml'}, {'damage_type': 'backtrace', 'id': 3736870388, 'ino': 1099511631772, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-11.xml'}, {'damage_type': 'backtrace', 'id': 3737881339, 'ino': 1099511630227, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-8.xml'}, {'damage_type': 'backtrace', 'id': 3745654687, 'ino': 1099511632243, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-40.xml'}, {'damage_type': 'backtrace', 'id': 3749433966, 'ino': 1099511632085, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-42.xml'}, {'damage_type': 'backtrace', 'id': 3751709190, 'ino': 1099511632232, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-11.xml'}, {'damage_type': 'backtrace', 'id': 3756143678, 'ino': 1099511631854, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-51.jpg'}, {'damage_type': 'backtrace', 'id': 3775898948, 'ino': 1099511631647, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-52.xml'}, {'damage_type': 'backtrace', 'id': 3783538414, 'ino': 1099511631994, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 3787276932, 'ino': 1099511631274, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-15.xml'}, {'damage_type': 'backtrace', 'id': 3790088151, 'ino': 1099511631721, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-24.xml'}, {'damage_type': 'backtrace', 'id': 3796238242, 'ino': 1099511632481, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-43.jpg'}, {'damage_type': 'backtrace', 'id': 3800895427, 'ino': 1099511632254, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-34.jpg'}, {'damage_type': 'backtrace', 'id': 3812392283, 'ino': 1099511630085, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-50.xml'}, {'damage_type': 'backtrace', 'id': 3834249984, 'ino': 1099511631914, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 3834699944, 'ino': 1099511632190, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-69.jpg'}, {'damage_type': 'backtrace', 'id': 3834895105, 'ino': 1099511631314, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-3.xml'}, {'damage_type': 'backtrace', 'id': 3837050921, 'ino': 1099511631787, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-7.xml'}, {'damage_type': 'backtrace', 'id': 3838126055, 'ino': 1099511632233, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/comment-41.xml'}, {'damage_type': 'backtrace', 'id': 3850439888, 'ino': 1099511632119, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-10.xml'}, {'damage_type': 'backtrace', 'id': 3850734620, 'ino': 1099511632473, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-45.jpg'}, {'damage_type': 'backtrace', 'id': 3850766228, 'ino': 1099511632097, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-14.xml'}, {'damage_type': 'backtrace', 'id': 3853599201, 'ino': 1099511632321, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 3854266145, 'ino': 1099511631998, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-90.jpg'}, {'damage_type': 'backtrace', 'id': 3857681322, 'ino': 1099511631860, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-48.jpg'}, {'damage_type': 'backtrace', 'id': 3886591609, 'ino': 1099511631851, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-52.jpg'}, {'damage_type': 'backtrace', 'id': 3927827754, 'ino': 1099511631864, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-46.jpg'}, {'damage_type': 'backtrace', 'id': 3938662789, 'ino': 1099511632170, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-1.xml'}, {'damage_type': 'backtrace', 'id': 3942885265, 'ino': 1099511632302, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 3958547017, 'ino': 1099511628295, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/man/Makefile.in'}, {'damage_type': 'backtrace', 'id': 3981552389, 'ino': 1099511631714, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-27.xml'}, {'damage_type': 'backtrace', 'id': 3986089899, 'ino': 1099511631988, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 3992111595, 'ino': 1099511632070, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-45.xml'}, {'damage_type': 'backtrace', 'id': 3998976708, 'ino': 1099511632288, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-29.jpg'}, {'damage_type': 'backtrace', 'id': 4004319297, 'ino': 1099511631941, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 4011037168, 'ino': 1099511631323, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-1.xml'}, {'damage_type': 'backtrace', 'id': 4012700170, 'ino': 1099511632244, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-7.xml'}, {'damage_type': 'backtrace', 'id': 4012733322, 'ino': 1099511632260, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-33.jpg'}, {'damage_type': 'backtrace', 'id': 4036290777, 'ino': 1099511631916, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 4045948395, 'ino': 1099511631880, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-38.jpg'}, {'damage_type': 'backtrace', 'id': 4047818460, 'ino': 1099511628293, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/man/blogbench.8'}, {'damage_type': 'backtrace', 'id': 4063715339, 'ino': 1099511631923, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 4068183075, 'ino': 1099511631304, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-5.xml'}, {'damage_type': 'backtrace', 'id': 4078207165, 'ino': 1099511632217, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-66.jpg'}, {'damage_type': 'backtrace', 'id': 4095338044, 'ino': 1099511632079, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-18.xml'}, {'damage_type': 'backtrace', 'id': 4110156973, 'ino': 1099511631692, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-36.xml'}, {'damage_type': 'backtrace', 'id': 4113797146, 'ino': 1099511632003, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-89.jpg'}, {'damage_type': 'backtrace', 'id': 4117483138, 'ino': 1099511632110, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-37.xml'}, {'damage_type': 'backtrace', 'id': 4130593446, 'ino': 1099511632158, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-3.xml'}, {'damage_type': 'backtrace', 'id': 4151043008, 'ino': 1099511632205, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-17.xml'}, {'damage_type': 'backtrace', 'id': 4153874610, 'ino': 1099511630031, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-62.xml'}, {'damage_type': 'backtrace', 'id': 4165205927, 'ino': 1099511632263, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 4174485611, 'ino': 1099511631831, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-60.jpg'}, {'damage_type': 'backtrace', 'id': 4178253967, 'ino': 1099511632378, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-63.jpg'}, {'damage_type': 'backtrace', 'id': 4197067323, 'ino': 1099511631817, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-70.jpg'}, {'damage_type': 'backtrace', 'id': 4197887823, 'ino': 1099511631284, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-11.xml'}, {'damage_type': 'backtrace', 'id': 4199472425, 'ino': 1099511632604, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 4201664615, 'ino': 1099511631688, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/article-38.xml'}, {'damage_type': 'backtrace', 'id': 4217947921, 'ino': 1099511630203, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-16.xml'}, {'damage_type': 'backtrace', 'id': 4230067420, 'ino': 1099511632216, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-38.jpg'}, {'damage_type': 'backtrace', 'id': 4230734928, 'ino': 1099511632053, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-48.xml'}, {'damage_type': 'backtrace', 'id': 4251842015, 'ino': 1099511630185, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-22.xml'}, {'damage_type': 'backtrace', 'id': 4260590801, 'ino': 1099511631280, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-12.xml'}, {'damage_type': 'backtrace', 'id': 4270339944, 'ino': 1099511632470, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-46.jpg'}, {'damage_type': 'backtrace', 'id': 4273970065, 'ino': 1099511630241, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-8/article-3.xml'}, {'damage_type': 'backtrace', 'id': 4280437247, 'ino': 1099511631874, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-20/picture-41.jpg'}, {'damage_type': 'backtrace', 'id': 4283275880, 'ino': 1099511632341, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 4284837836, 'ino': 1099511632187, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-23/article-21.xml'}, {'damage_type': 'backtrace', 'id': 4288850448, 'ino': 1099511632297, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 4292757306, 'ino': 1099511632361, 'path': '/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-21/picture-65.jpg'}] 2024-09-19T07:14:29.648 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 48, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 70, in _scrub self._check_damage() File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 81, in _check_damage raise RuntimeError(f"rank damage found: {types}") RuntimeError: rank damage found: {'backtrace'} 2024-09-19T07:14:29.838 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:14:30.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.369+0000 7fdb56d9f640 1 -- 172.21.15.148:0/3019306407 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb5011b040 msgr2=0x7fdb5011d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:30.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.369+0000 7fdb56d9f640 1 --2- 172.21.15.148:0/3019306407 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb5011b040 0x7fdb5011d430 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdb48009ca0 tx=0x7fdb4802a980 comp rx=0 tx=0).stop 2024-09-19T07:14:30.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.371+0000 7fdb56d9f640 1 -- 172.21.15.148:0/3019306407 shutdown_connections 2024-09-19T07:14:30.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.371+0000 7fdb56d9f640 1 --2- 172.21.15.148:0/3019306407 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb5011b040 0x7fdb5011d430 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:30.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.371+0000 7fdb56d9f640 1 --2- 172.21.15.148:0/3019306407 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdb5007b020 0x7fdb5007b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:30.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.371+0000 7fdb56d9f640 1 --2- 172.21.15.148:0/3019306407 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb50082bf0 0x7fdb5007aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:30.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.371+0000 7fdb56d9f640 1 -- 172.21.15.148:0/3019306407 >> 172.21.15.148:0/3019306407 conn(0x7fdb50077980 msgr2=0x7fdb50079da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:30.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.372+0000 7fdb56d9f640 1 -- 172.21.15.148:0/3019306407 shutdown_connections 2024-09-19T07:14:30.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.373+0000 7fdb56d9f640 1 -- 172.21.15.148:0/3019306407 wait complete. 2024-09-19T07:14:30.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.374+0000 7fdb56d9f640 1 Processor -- start 2024-09-19T07:14:30.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.377+0000 7fdb56d9f640 1 -- start start 2024-09-19T07:14:30.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.377+0000 7fdb56d9f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb5007b020 0x7fdb50073a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:30.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.377+0000 7fdb56d9f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdb50082bf0 0x7fdb5006cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:30.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.377+0000 7fdb56d9f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb5011b040 0x7fdb5006d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:30.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.377+0000 7fdb56d9f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdb50120c10 con 0x7fdb5011b040 2024-09-19T07:14:30.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.377+0000 7fdb56d9f640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdb50120a90 con 0x7fdb50082bf0 2024-09-19T07:14:30.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.377+0000 7fdb56d9f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdb50120d90 con 0x7fdb5007b020 2024-09-19T07:14:30.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.377+0000 7fdb55d9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb5007b020 0x7fdb50073a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:30.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.377+0000 7fdb55d9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb5007b020 0x7fdb50073a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:50034/0 (socket says 172.21.15.148:50034) 2024-09-19T07:14:30.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.377+0000 7fdb55d9d640 1 -- 172.21.15.148:0/333084555 learned_addr learned my addr 172.21.15.148:0/333084555 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:14:30.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.378+0000 7fdb5559c640 1 --2- 172.21.15.148:0/333084555 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdb50082bf0 0x7fdb5006cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:30.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.380+0000 7fdb5659e640 1 --2- 172.21.15.148:0/333084555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb5011b040 0x7fdb5006d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:30.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.381+0000 7fdb5659e640 1 -- 172.21.15.148:0/333084555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb5007b020 msgr2=0x7fdb50073a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:30.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.381+0000 7fdb5659e640 1 --2- 172.21.15.148:0/333084555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb5007b020 0x7fdb50073a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:30.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.381+0000 7fdb5659e640 1 -- 172.21.15.148:0/333084555 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdb50082bf0 msgr2=0x7fdb5006cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:30.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.381+0000 7fdb5659e640 1 --2- 172.21.15.148:0/333084555 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdb50082bf0 0x7fdb5006cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:30.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.381+0000 7fdb5659e640 1 -- 172.21.15.148:0/333084555 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb5006d5e0 con 0x7fdb5011b040 2024-09-19T07:14:30.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.384+0000 7fdb5659e640 1 --2- 172.21.15.148:0/333084555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb5011b040 0x7fdb5006d020 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fdb48009bf0 tx=0x7fdb4802f600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:30.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.388+0000 7fdb46ffd640 1 -- 172.21.15.148:0/333084555 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb48047070 con 0x7fdb5011b040 2024-09-19T07:14:30.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.388+0000 7fdb46ffd640 1 -- 172.21.15.148:0/333084555 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb4802f900 con 0x7fdb5011b040 2024-09-19T07:14:30.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.388+0000 7fdb46ffd640 1 -- 172.21.15.148:0/333084555 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb48034040 con 0x7fdb5011b040 2024-09-19T07:14:30.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.389+0000 7fdb56d9f640 1 -- 172.21.15.148:0/333084555 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb5006d870 con 0x7fdb5011b040 2024-09-19T07:14:30.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.391+0000 7fdb56d9f640 1 -- 172.21.15.148:0/333084555 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb50071760 con 0x7fdb5011b040 2024-09-19T07:14:30.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.394+0000 7fdb44ff9640 1 -- 172.21.15.148:0/333084555 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb5007c120 con 0x7fdb5011b040 2024-09-19T07:14:30.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.403+0000 7fdb46ffd640 1 -- 172.21.15.148:0/333084555 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fdb48037020 con 0x7fdb5011b040 2024-09-19T07:14:30.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.403+0000 7fdb46ffd640 1 --2- 172.21.15.148:0/333084555 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fdb3c0a35c0 0x7fdb3c0a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:30.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.404+0000 7fdb46ffd640 1 -- 172.21.15.148:0/333084555 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fdb480f0700 con 0x7fdb5011b040 2024-09-19T07:14:30.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.406+0000 7fdb55d9d640 1 --2- 172.21.15.148:0/333084555 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fdb3c0a35c0 0x7fdb3c0a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:30.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.408+0000 7fdb55d9d640 1 --2- 172.21.15.148:0/333084555 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fdb3c0a35c0 0x7fdb3c0a5a80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdb400058c0 tx=0x7fdb4000a380 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:30.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.409+0000 7fdb46ffd640 1 -- 172.21.15.148:0/333084555 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdb480098b0 con 0x7fdb5011b040 2024-09-19T07:14:30.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.784+0000 7fdb44ff9640 1 -- 172.21.15.148:0/333084555 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb5006dfc0 con 0x7fdb5011b040 2024-09-19T07:14:30.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.785+0000 7fdb46ffd640 1 -- 172.21.15.148:0/333084555 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11945 (secure 0 0 0) 0x7fdb480bd130 con 0x7fdb5011b040 2024-09-19T07:14:30.789 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:14:30.789 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":32,"btime":"2024-09-19T07:14:26:794629+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/4263868576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":4263868576},{"type":"v1","addr":"172.21.15.148:6841","nonce":4263868576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":25606,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3891676893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3891676893},{"type":"v1","addr":"172.21.15.179:6835","nonce":3891676893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":32,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:09:19.543369+0000","modified":"2024-09-19T07:14:25.968308+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24457,"mds_1":24437,"mds_2":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24383":{"gid":24383,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6835/2146820965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2146820965},{"type":"v1","addr":"172.21.15.165:6835","nonce":2146820965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24410":{"gid":24410,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":75,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":71,"addr":"172.21.15.165:6839/3993490234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":3993490234},{"type":"v1","addr":"172.21.15.165:6839","nonce":3993490234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24457,"qdb_cluster":[24436,24437,24457]},"id":1}]} 2024-09-19T07:14:30.790 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 32 2024-09-19T07:14:30.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.787+0000 7fdb44ff9640 1 -- 172.21.15.148:0/333084555 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fdb3c0a35c0 msgr2=0x7fdb3c0a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:30.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.787+0000 7fdb44ff9640 1 --2- 172.21.15.148:0/333084555 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fdb3c0a35c0 0x7fdb3c0a5a80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdb400058c0 tx=0x7fdb4000a380 comp rx=0 tx=0).stop 2024-09-19T07:14:30.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.787+0000 7fdb44ff9640 1 -- 172.21.15.148:0/333084555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb5011b040 msgr2=0x7fdb5006d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:30.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.787+0000 7fdb44ff9640 1 --2- 172.21.15.148:0/333084555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb5011b040 0x7fdb5006d020 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fdb48009bf0 tx=0x7fdb4802f600 comp rx=0 tx=0).stop 2024-09-19T07:14:30.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.787+0000 7fdb44ff9640 1 -- 172.21.15.148:0/333084555 shutdown_connections 2024-09-19T07:14:30.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.787+0000 7fdb44ff9640 1 --2- 172.21.15.148:0/333084555 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fdb3c0a35c0 0x7fdb3c0a5a80 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:30.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.787+0000 7fdb44ff9640 1 --2- 172.21.15.148:0/333084555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb5011b040 0x7fdb5006d020 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:30.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.787+0000 7fdb44ff9640 1 --2- 172.21.15.148:0/333084555 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdb50082bf0 0x7fdb5006cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:30.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.787+0000 7fdb44ff9640 1 --2- 172.21.15.148:0/333084555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb5007b020 0x7fdb50073a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:30.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.787+0000 7fdb44ff9640 1 -- 172.21.15.148:0/333084555 >> 172.21.15.148:0/333084555 conn(0x7fdb50077980 msgr2=0x7fdb50081c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:30.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.787+0000 7fdb44ff9640 1 -- 172.21.15.148:0/333084555 shutdown_connections 2024-09-19T07:14:30.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:30.787+0000 7fdb44ff9640 1 -- 172.21.15.148:0/333084555 wait complete. 2024-09-19T07:14:31.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:30 smithi148 ceph-mon[31180]: pgmap v106: 97 pgs: 97 active+clean; 295 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 121 op/s 2024-09-19T07:14:31.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:30 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/333084555' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:14:31.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:30 smithi165 ceph-mon[35326]: pgmap v106: 97 pgs: 97 active+clean; 295 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 121 op/s 2024-09-19T07:14:31.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:30 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/333084555' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:14:31.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:30 smithi179 ceph-mon[35716]: pgmap v106: 97 pgs: 97 active+clean; 295 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 121 op/s 2024-09-19T07:14:31.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:30 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/333084555' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:14:31.657 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24457 quiesce db / --timeout 90 --expiration 136.6 --await-for 45.0' 2024-09-19T07:14:31.658 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24457 quiesce db / --timeout 90 --expiration 136.6 --await-for 45.0 2024-09-19T07:14:31.977 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:14:32.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.558+0000 7fc342015640 1 -- 172.21.15.148:0/3923275968 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc33c102790 msgr2=0x7fc33c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:32.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.558+0000 7fc342015640 1 --2- 172.21.15.148:0/3923275968 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc33c102790 0x7fc33c1067e0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fc32c009900 tx=0x7fc32c02a410 comp rx=0 tx=0).stop 2024-09-19T07:14:32.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.558+0000 7fc342015640 1 -- 172.21.15.148:0/3923275968 shutdown_connections 2024-09-19T07:14:32.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.558+0000 7fc342015640 1 --2- 172.21.15.148:0/3923275968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc33c106f10 0x7fc33c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:32.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.558+0000 7fc342015640 1 --2- 172.21.15.148:0/3923275968 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc33c102790 0x7fc33c1067e0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:32.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.558+0000 7fc342015640 1 --2- 172.21.15.148:0/3923275968 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc33c101de0 0x7fc33c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:32.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.558+0000 7fc342015640 1 -- 172.21.15.148:0/3923275968 >> 172.21.15.148:0/3923275968 conn(0x7fc33c0fd8e0 msgr2=0x7fc33c0ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:32.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.558+0000 7fc342015640 1 -- 172.21.15.148:0/3923275968 shutdown_connections 2024-09-19T07:14:32.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.558+0000 7fc342015640 1 -- 172.21.15.148:0/3923275968 wait complete. 2024-09-19T07:14:32.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.559+0000 7fc342015640 1 Processor -- start 2024-09-19T07:14:32.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.559+0000 7fc342015640 1 -- start start 2024-09-19T07:14:32.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.559+0000 7fc342015640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc33c101de0 0x7fc33c198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:32.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.559+0000 7fc342015640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc33c102790 0x7fc33c1989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:32.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.559+0000 7fc342015640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc33c106f10 0x7fc33c19cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:32.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.559+0000 7fc342015640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc33c111f70 con 0x7fc33c102790 2024-09-19T07:14:32.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.559+0000 7fc342015640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc33c111df0 con 0x7fc33c106f10 2024-09-19T07:14:32.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.559+0000 7fc342015640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc33c1120f0 con 0x7fc33c101de0 2024-09-19T07:14:32.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.559+0000 7fc33b7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc33c101de0 0x7fc33c198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:32.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.559+0000 7fc33affd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc33c102790 0x7fc33c1989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:32.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.559+0000 7fc33b7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc33c101de0 0x7fc33c198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:50060/0 (socket says 172.21.15.148:50060) 2024-09-19T07:14:32.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.559+0000 7fc33b7fe640 1 -- 172.21.15.148:0/3326478651 learned_addr learned my addr 172.21.15.148:0/3326478651 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:14:32.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.560+0000 7fc33bfff640 1 --2- 172.21.15.148:0/3326478651 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc33c106f10 0x7fc33c19cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:32.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.560+0000 7fc33b7fe640 1 -- 172.21.15.148:0/3326478651 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc33c106f10 msgr2=0x7fc33c19cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:32.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.560+0000 7fc33b7fe640 1 --2- 172.21.15.148:0/3326478651 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc33c106f10 0x7fc33c19cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:32.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.560+0000 7fc33b7fe640 1 -- 172.21.15.148:0/3326478651 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc33c102790 msgr2=0x7fc33c1989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:32.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.560+0000 7fc33b7fe640 1 --2- 172.21.15.148:0/3326478651 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc33c102790 0x7fc33c1989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:32.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.560+0000 7fc33b7fe640 1 -- 172.21.15.148:0/3326478651 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc33c19d420 con 0x7fc33c101de0 2024-09-19T07:14:32.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.560+0000 7fc33bfff640 1 --2- 172.21.15.148:0/3326478651 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc33c106f10 0x7fc33c19cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:14:32.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.560+0000 7fc33b7fe640 1 --2- 172.21.15.148:0/3326478651 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc33c101de0 0x7fc33c198470 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc32400e9f0 tx=0x7fc32400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:32.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.560+0000 7fc338ff9640 1 -- 172.21.15.148:0/3326478651 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32400cd80 con 0x7fc33c101de0 2024-09-19T07:14:32.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.560+0000 7fc338ff9640 1 -- 172.21.15.148:0/3326478651 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc324010910 con 0x7fc33c101de0 2024-09-19T07:14:32.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.560+0000 7fc342015640 1 -- 172.21.15.148:0/3326478651 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc33c19d710 con 0x7fc33c101de0 2024-09-19T07:14:32.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.560+0000 7fc338ff9640 1 -- 172.21.15.148:0/3326478651 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3240188f0 con 0x7fc33c101de0 2024-09-19T07:14:32.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.560+0000 7fc342015640 1 -- 172.21.15.148:0/3326478651 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc33c1a4ff0 con 0x7fc33c101de0 2024-09-19T07:14:32.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.563+0000 7fc3443ee740 1 Processor -- start 2024-09-19T07:14:32.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.563+0000 7fc338ff9640 1 -- 172.21.15.148:0/3326478651 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fc324010ac0 con 0x7fc33c101de0 2024-09-19T07:14:32.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.564+0000 7fc3443ee740 1 -- start start 2024-09-19T07:14:32.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.564+0000 7fc3443ee740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560570539640 0x560570539a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:32.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.564+0000 7fc3443ee740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560570539f60 0x560570548810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:32.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.564+0000 7fc3443ee740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560570548d50 0x56057054b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:32.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.564+0000 7fc3443ee740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56057049f2a0 con 0x560570548d50 2024-09-19T07:14:32.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.564+0000 7fc3443ee740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x560570446b10 con 0x560570539640 2024-09-19T07:14:32.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.564+0000 7fc3443ee740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56057049b260 con 0x560570539f60 2024-09-19T07:14:32.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.564+0000 7fc33affd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560570548d50 0x56057054b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:32.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.564+0000 7fc33bfff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560570539640 0x560570539a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:32.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.564+0000 7fc33bfff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560570539640 0x560570539a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:40220/0 (socket says 172.21.15.148:40220) 2024-09-19T07:14:32.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.564+0000 7fc33bfff640 1 -- 172.21.15.148:0/1859222493 learned_addr learned my addr 172.21.15.148:0/1859222493 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:14:32.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.564+0000 7fc33b7fe640 1 --2- 172.21.15.148:0/1859222493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560570539f60 0x560570548810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:32.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.564+0000 7fc33bfff640 1 -- 172.21.15.148:0/1859222493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560570539f60 msgr2=0x560570548810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:32.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.564+0000 7fc33bfff640 1 --2- 172.21.15.148:0/1859222493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560570539f60 0x560570548810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:32.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.564+0000 7fc33bfff640 1 -- 172.21.15.148:0/1859222493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560570548d50 msgr2=0x56057054b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:32.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.564+0000 7fc33bfff640 1 --2- 172.21.15.148:0/1859222493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560570548d50 0x56057054b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:32.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.564+0000 7fc338ff9640 1 --2- 172.21.15.148:0/3326478651 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc3280a33b0 0x7fc3280a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:32.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.564+0000 7fc33bfff640 1 -- 172.21.15.148:0/1859222493 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560570210b90 con 0x560570539640 2024-09-19T07:14:32.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.565+0000 7fc33bfff640 1 --2- 172.21.15.148:0/1859222493 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560570539640 0x560570539a20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc334009fd0 tx=0x7fc334010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96dcfbf630d25f0c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:32.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.565+0000 7fc33b7fe640 1 --2- 172.21.15.148:0/3326478651 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc3280a33b0 0x7fc3280a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:32.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.565+0000 7fc338ff9640 1 -- 172.21.15.148:0/3326478651 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fc3240d00d0 con 0x7fc33c101de0 2024-09-19T07:14:32.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.565+0000 7fc331ffb640 1 -- 172.21.15.148:0/1859222493 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc334011700 con 0x560570539640 2024-09-19T07:14:32.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.565+0000 7fc33b7fe640 1 --2- 172.21.15.148:0/3326478651 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc3280a33b0 0x7fc3280a5870 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc3240cd980 tx=0x7fc3240d3c90 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:32.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.565+0000 7fc331ffb640 1 -- 172.21.15.148:0/1859222493 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc334011d80 con 0x560570539640 2024-09-19T07:14:32.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.566+0000 7fc331ffb640 1 -- 172.21.15.148:0/1859222493 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33400d340 con 0x560570539640 2024-09-19T07:14:32.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.566+0000 7fc3443ee740 1 -- 172.21.15.148:0/1859222493 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560570539640 msgr2=0x560570539a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:32.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.566+0000 7fc3443ee740 1 --2- 172.21.15.148:0/1859222493 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560570539640 0x560570539a20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc334009fd0 tx=0x7fc334010860 comp rx=0 tx=0).stop 2024-09-19T07:14:32.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.567+0000 7fc3443ee740 1 -- 172.21.15.148:0/1859222493 shutdown_connections 2024-09-19T07:14:32.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.567+0000 7fc3443ee740 1 --2- 172.21.15.148:0/1859222493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560570548d50 0x56057054b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:32.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.567+0000 7fc3443ee740 1 --2- 172.21.15.148:0/1859222493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560570539f60 0x560570548810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:32.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.567+0000 7fc3443ee740 1 --2- 172.21.15.148:0/1859222493 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560570539640 0x560570539a20 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:32.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.567+0000 7fc3443ee740 1 -- 172.21.15.148:0/1859222493 >> 172.21.15.148:0/1859222493 conn(0x560570535cf0 msgr2=0x5605705360d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:32.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.567+0000 7fc3443ee740 1 -- 172.21.15.148:0/1859222493 shutdown_connections 2024-09-19T07:14:32.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.567+0000 7fc3443ee740 1 -- 172.21.15.148:0/1859222493 wait complete. 2024-09-19T07:14:32.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.567+0000 7fc3443ee740 1 -- start start 2024-09-19T07:14:32.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.567+0000 7fc3443ee740 1 Processor -- start 2024-09-19T07:14:32.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.568+0000 7fc3443ee740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560570539640 0x560570545bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:32.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.568+0000 7fc3443ee740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560570539f60 0x5605705460f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:32.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.568+0000 7fc3443ee740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560570548d50 0x560570546630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:32.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.568+0000 7fc3443ee740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56057054b9c0 con 0x560570539640 2024-09-19T07:14:32.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.568+0000 7fc3443ee740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5605704276e0 con 0x560570539f60 2024-09-19T07:14:32.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.568+0000 7fc3443ee740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56057054bb40 con 0x560570548d50 2024-09-19T07:14:32.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.568+0000 7fc3443ee740 10 client.0 _ll_register_callbacks cb 0x56057044ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:14:32.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.568+0000 7fc33bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560570539640 0x560570545bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:32.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.568+0000 7fc33bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560570539640 0x560570545bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35476/0 (socket says 172.21.15.148:35476) 2024-09-19T07:14:32.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.568+0000 7fc33bfff640 1 -- 172.21.15.148:0/868017275 learned_addr learned my addr 172.21.15.148:0/868017275 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:14:32.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.568+0000 7fc33affd640 1 --2- 172.21.15.148:0/868017275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560570539f60 0x5605705460f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:32.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.568+0000 7fc33bfff640 1 --2- 172.21.15.148:0/868017275 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560570548d50 0x560570546630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:32.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.568+0000 7fc33bfff640 1 -- 172.21.15.148:0/868017275 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560570548d50 msgr2=0x560570546630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:32.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.568+0000 7fc33bfff640 1 --2- 172.21.15.148:0/868017275 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560570548d50 0x560570546630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:32.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.568+0000 7fc33bfff640 1 -- 172.21.15.148:0/868017275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560570539f60 msgr2=0x5605705460f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:32.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.568+0000 7fc33bfff640 1 --2- 172.21.15.148:0/868017275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560570539f60 0x5605705460f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:32.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.568+0000 7fc33bfff640 1 -- 172.21.15.148:0/868017275 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560570554ec0 con 0x560570539640 2024-09-19T07:14:32.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.568+0000 7fc33bfff640 1 --2- 172.21.15.148:0/868017275 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560570539640 0x560570545bb0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fc3340092f0 tx=0x7fc334011f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c1c2aa5a9f7b4e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:32.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.568+0000 7fc31affd640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:14:32.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.569+0000 7fc31affd640 1 -- 172.21.15.148:0/868017275 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33400e7d0 con 0x560570539640 2024-09-19T07:14:32.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.569+0000 7fc3443ee740 1 -- 172.21.15.148:0/868017275 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc334011d80 con 0x560570539640 2024-09-19T07:14:32.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.569+0000 7fc31affd640 1 -- 172.21.15.148:0/868017275 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fc334011500 con 0x560570539640 2024-09-19T07:14:32.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.569+0000 7fc31affd640 1 -- 172.21.15.148:0/868017275 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fc334011700 con 0x560570539640 2024-09-19T07:14:32.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.569+0000 7fc3443ee740 10 client.16308 fetch_fsmap learned FSMap version 33 2024-09-19T07:14:32.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.569+0000 7fc3443ee740 1 -- 172.21.15.148:0/868017275 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x560570557840 con 0x560570539640 2024-09-19T07:14:32.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.569+0000 7fc31affd640 1 -- 172.21.15.148:0/868017275 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc334011d80 con 0x560570539640 2024-09-19T07:14:32.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.569+0000 7fc31affd640 1 -- 172.21.15.148:0/868017275 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 33) ==== 8362+0+0 (secure 0 0 0) 0x7fc334005770 con 0x560570539640 2024-09-19T07:14:32.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.569+0000 7fc3443ee740 10 client.16308 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T07:14:32.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.569+0000 7fc3443ee740 10 client.16308 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:14:32.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.569+0000 7fc3443ee740 20 client.16308 populate_metadata read hostname 'smithi148' 2024-09-19T07:14:32.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.569+0000 7fc3443ee740 1 --2- 172.21.15.148:0/868017275 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x560570558c50 0x56057055b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:32.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.569+0000 7fc3443ee740 4 client.16308 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:14:32.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.569+0000 7fc3443ee740 1 -- 172.21.15.148:0/868017275 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5605704ac9d0 con 0x560570558c50 2024-09-19T07:14:32.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.570+0000 7fc33affd640 1 --2- 172.21.15.148:0/868017275 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x560570558c50 0x56057055b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:32.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.570+0000 7fc33affd640 1 --2- 172.21.15.148:0/868017275 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x560570558c50 0x56057055b040 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa4576a0c3cb27bd server_cookie=eed7688d44caf91 in_seq=0 out_seq=0 2024-09-19T07:14:32.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.570+0000 7fc31affd640 10 client.16308 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:14:32.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.573+0000 7fc31affd640 1 -- 172.21.15.148:0/868017275 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5605704ac9d0 con 0x560570558c50 2024-09-19T07:14:32.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.573+0000 7fc31affd640 10 client.16308 handle_command_reply: tid=0 2024-09-19T07:14:32.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.573+0000 7fc3443ee740 1 client.16308 shutdown 2024-09-19T07:14:32.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.573+0000 7fc3443ee740 1 -- 172.21.15.148:0/868017275 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560570539640 msgr2=0x560570545bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:32.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.573+0000 7fc3443ee740 1 --2- 172.21.15.148:0/868017275 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560570539640 0x560570545bb0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fc3340092f0 tx=0x7fc334011f70 comp rx=0 tx=0).stop 2024-09-19T07:14:32.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.573+0000 7fc3443ee740 1 -- 172.21.15.148:0/868017275 shutdown_connections 2024-09-19T07:14:32.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.573+0000 7fc3443ee740 1 --2- 172.21.15.148:0/868017275 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x560570558c50 0x56057055b040 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:32.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.573+0000 7fc31affd640 0 client.16308 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:14:32.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.573+0000 7fc3443ee740 1 --2- 172.21.15.148:0/868017275 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560570548d50 0x560570546630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:32.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.574+0000 7fc3443ee740 1 --2- 172.21.15.148:0/868017275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560570539f60 0x5605705460f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:32.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.574+0000 7fc3443ee740 1 --2- 172.21.15.148:0/868017275 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560570539640 0x560570545bb0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:32.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.574+0000 7fc3443ee740 1 -- 172.21.15.148:0/868017275 >> 172.21.15.148:0/868017275 conn(0x560570535cf0 msgr2=0x56057053ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:32.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.574+0000 7fc3443ee740 1 -- 172.21.15.148:0/868017275 shutdown_connections 2024-09-19T07:14:32.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.574+0000 7fc3443ee740 1 -- 172.21.15.148:0/868017275 wait complete. 2024-09-19T07:14:32.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.574+0000 7fc3443ee740 20 client.16308 trim_cache size 0 max 16384 2024-09-19T07:14:32.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.590+0000 7fc3443ee740 1 Processor -- start 2024-09-19T07:14:32.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.590+0000 7fc3443ee740 1 -- start start 2024-09-19T07:14:32.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.591+0000 7fc3443ee740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560570539640 0x560570547a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:32.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.591+0000 7fc3443ee740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560570539f60 0x5605705605e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:32.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.591+0000 7fc3443ee740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560570548d50 0x560570560b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:32.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.591+0000 7fc3443ee740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc33c1ae030 con 0x560570539f60 2024-09-19T07:14:32.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.591+0000 7fc3443ee740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc33c1ab8a0 con 0x560570548d50 2024-09-19T07:14:32.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.591+0000 7fc3443ee740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc33c1a96d0 con 0x560570539640 2024-09-19T07:14:32.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.591+0000 7fc33affd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560570539f60 0x5605705605e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:32.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.591+0000 7fc33bfff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560570548d50 0x560570560b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:32.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.591+0000 7fc33affd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560570539f60 0x5605705605e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35480/0 (socket says 172.21.15.148:35480) 2024-09-19T07:14:32.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.591+0000 7fc33affd640 1 -- 172.21.15.148:0/63323861 learned_addr learned my addr 172.21.15.148:0/63323861 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:14:32.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.591+0000 7fc33bfff640 1 --2- 172.21.15.148:0/63323861 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560570539640 0x560570547a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:32.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.591+0000 7fc33bfff640 1 -- 172.21.15.148:0/63323861 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560570539640 msgr2=0x560570547a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:32.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.591+0000 7fc33bfff640 1 --2- 172.21.15.148:0/63323861 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560570539640 0x560570547a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:32.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.591+0000 7fc33bfff640 1 -- 172.21.15.148:0/63323861 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560570539f60 msgr2=0x5605705605e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:32.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.591+0000 7fc33bfff640 1 --2- 172.21.15.148:0/63323861 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560570539f60 0x5605705605e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:32.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.591+0000 7fc33bfff640 1 -- 172.21.15.148:0/63323861 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560570539d90 con 0x560570548d50 2024-09-19T07:14:32.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.592+0000 7fc33bfff640 1 --2- 172.21.15.148:0/63323861 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560570548d50 0x560570560b20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc334009690 tx=0x7fc33401e040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43c5c09ac8ba0846 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:32.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.592+0000 7fc3317fa640 1 -- 172.21.15.148:0/63323861 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33403a020 con 0x560570548d50 2024-09-19T07:14:32.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.592+0000 7fc3317fa640 1 -- 172.21.15.148:0/63323861 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc334020030 con 0x560570548d50 2024-09-19T07:14:32.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.592+0000 7fc3317fa640 1 -- 172.21.15.148:0/63323861 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc334011bf0 con 0x560570548d50 2024-09-19T07:14:32.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.592+0000 7fc3443ee740 1 -- 172.21.15.148:0/63323861 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560570548d50 msgr2=0x560570560b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:32.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.592+0000 7fc3443ee740 1 --2- 172.21.15.148:0/63323861 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560570548d50 0x560570560b20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc334009690 tx=0x7fc33401e040 comp rx=0 tx=0).stop 2024-09-19T07:14:32.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.592+0000 7fc3443ee740 1 -- 172.21.15.148:0/63323861 shutdown_connections 2024-09-19T07:14:32.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.592+0000 7fc3443ee740 1 --2- 172.21.15.148:0/63323861 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560570548d50 0x560570560b20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:32.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.593+0000 7fc3443ee740 1 --2- 172.21.15.148:0/63323861 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560570539f60 0x5605705605e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:32.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.593+0000 7fc3443ee740 1 --2- 172.21.15.148:0/63323861 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560570539640 0x560570547a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:32.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.593+0000 7fc3443ee740 1 -- 172.21.15.148:0/63323861 >> 172.21.15.148:0/63323861 conn(0x560570535cf0 msgr2=0x560570544b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:32.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.593+0000 7fc3443ee740 1 -- 172.21.15.148:0/63323861 shutdown_connections 2024-09-19T07:14:32.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.593+0000 7fc3443ee740 1 -- 172.21.15.148:0/63323861 wait complete. 2024-09-19T07:14:32.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.593+0000 7fc3443ee740 1 -- start start 2024-09-19T07:14:32.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.593+0000 7fc3443ee740 1 Processor -- start 2024-09-19T07:14:32.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.593+0000 7fc3443ee740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560570539640 0x560570551010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:32.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.593+0000 7fc3443ee740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560570539f60 0x560570551550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:32.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.593+0000 7fc3443ee740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560570548d50 0x56057054e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:32.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.593+0000 7fc3443ee740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc33c1a9d60 con 0x560570548d50 2024-09-19T07:14:32.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.594+0000 7fc3443ee740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc33c1ab1d0 con 0x560570539640 2024-09-19T07:14:32.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.594+0000 7fc3443ee740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc33c1aa430 con 0x560570539f60 2024-09-19T07:14:32.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.594+0000 7fc3443ee740 10 client.0 _ll_register_callbacks cb 0x7fc334009e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:14:32.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.594+0000 7fc33bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560570548d50 0x56057054e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:32.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.594+0000 7fc33affd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560570539f60 0x560570551550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:32.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.594+0000 7fc33bfff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560570539640 0x560570551010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:32.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.594+0000 7fc33affd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560570539f60 0x560570551550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:50098/0 (socket says 172.21.15.148:50098) 2024-09-19T07:14:32.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.594+0000 7fc33affd640 1 -- 172.21.15.148:0/1273652377 learned_addr learned my addr 172.21.15.148:0/1273652377 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:14:32.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.594+0000 7fc33affd640 1 -- 172.21.15.148:0/1273652377 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560570539640 msgr2=0x560570551010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:32.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.594+0000 7fc33affd640 1 --2- 172.21.15.148:0/1273652377 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560570539640 0x560570551010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:32.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.594+0000 7fc33affd640 1 -- 172.21.15.148:0/1273652377 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560570548d50 msgr2=0x56057054e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:32.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.594+0000 7fc33affd640 1 --2- 172.21.15.148:0/1273652377 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560570548d50 0x56057054e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:32.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.594+0000 7fc33affd640 1 -- 172.21.15.148:0/1273652377 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56057054ea20 con 0x560570539f60 2024-09-19T07:14:32.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.594+0000 7fc33bfff640 1 --2- 172.21.15.148:0/1273652377 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560570548d50 0x56057054e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:14:32.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.594+0000 7fc33affd640 1 --2- 172.21.15.148:0/1273652377 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560570539f60 0x560570551550 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc32c005940 tx=0x7fc32c031950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=879fc3fff57cfea9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:32.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.594+0000 7fc31affd640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-19T07:14:32.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.594+0000 7fc31affd640 1 -- 172.21.15.148:0/1273652377 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32c035040 con 0x560570539f60 2024-09-19T07:14:32.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.594+0000 7fc3443ee740 1 -- 172.21.15.148:0/1273652377 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc334020030 con 0x560570539f60 2024-09-19T07:14:32.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.594+0000 7fc31affd640 1 -- 172.21.15.148:0/1273652377 <== mon.1 v2:172.21.15.179:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fc32c004450 con 0x560570539f60 2024-09-19T07:14:32.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.595+0000 7fc31affd640 1 -- 172.21.15.148:0/1273652377 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fc32c0035f0 con 0x560570539f60 2024-09-19T07:14:32.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.595+0000 7fc3443ee740 10 client.25729 fetch_fsmap learned FSMap version 33 2024-09-19T07:14:32.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.595+0000 7fc3443ee740 1 -- 172.21.15.148:0/1273652377 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56057053df10 con 0x560570539f60 2024-09-19T07:14:32.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.595+0000 7fc31affd640 1 -- 172.21.15.148:0/1273652377 <== mon.1 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc334020030 con 0x560570539f60 2024-09-19T07:14:32.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.595+0000 7fc31affd640 1 -- 172.21.15.148:0/1273652377 <== mon.1 v2:172.21.15.179:3300/0 5 ==== fsmap(e 33) ==== 8362+0+0 (secure 0 0 0) 0x7fc32c0487c0 con 0x560570539f60 2024-09-19T07:14:32.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.595+0000 7fc3443ee740 10 client.25729 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T07:14:32.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.595+0000 7fc3443ee740 10 client.25729 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:14:32.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.595+0000 7fc3443ee740 20 client.25729 populate_metadata read hostname 'smithi148' 2024-09-19T07:14:32.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.595+0000 7fc3443ee740 1 --2- 172.21.15.148:0/1273652377 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x560570558c50 0x5605705ca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:32.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.595+0000 7fc3443ee740 4 client.25729 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 136.6, "await_for": 45.0}] 2024-09-19T07:14:32.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.595+0000 7fc3443ee740 1 -- 172.21.15.148:0/1273652377 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 136.6, "await_for": 45.0}) -- 0x5605704a6d20 con 0x560570558c50 2024-09-19T07:14:32.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.595+0000 7fc33bfff640 1 --2- 172.21.15.148:0/1273652377 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x560570558c50 0x5605705ca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:32.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.596+0000 7fc31affd640 10 client.25729 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:14:32.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:32.596+0000 7fc33bfff640 1 --2- 172.21.15.148:0/1273652377 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x560570558c50 0x5605705ca3a0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83b7f36c34bef3df server_cookie=a7fe11bf928b284 in_seq=0 out_seq=0 2024-09-19T07:14:33.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:32 smithi148 ceph-mon[31180]: pgmap v107: 97 pgs: 97 active+clean; 350 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.1 MiB/s wr, 374 op/s 2024-09-19T07:14:33.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:32 smithi148 ceph-mon[31180]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:14:33.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:32 smithi165 ceph-mon[35326]: pgmap v107: 97 pgs: 97 active+clean; 350 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.1 MiB/s wr, 374 op/s 2024-09-19T07:14:33.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:32 smithi165 ceph-mon[35326]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:14:33.193 INFO:tasks.workunit.client.0.smithi148.stdout: 121 1298372 609 858186 664 363928 796 2024-09-19T07:14:33.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:32 smithi179 ceph-mon[35716]: pgmap v107: 97 pgs: 97 active+clean; 350 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.1 MiB/s wr, 374 op/s 2024-09-19T07:14:33.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:32 smithi179 ceph-mon[35716]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:14:34.382 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.379+0000 7f09ee2d0640 1 -- 172.21.15.148:0/2459989316 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09e81069c0 msgr2=0x7f09e8106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:34.382 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.379+0000 7f09ee2d0640 1 --2- 172.21.15.148:0/2459989316 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09e81069c0 0x7f09e8106da0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f09e0009cd0 tx=0x7f09e002a8e0 comp rx=0 tx=0).stop 2024-09-19T07:14:34.382 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.379+0000 7f09ee2d0640 1 -- 172.21.15.148:0/2459989316 shutdown_connections 2024-09-19T07:14:34.383 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.379+0000 7f09ee2d0640 1 --2- 172.21.15.148:0/2459989316 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09e8101350 0x7f09e810d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:34.383 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.379+0000 7f09ee2d0640 1 --2- 172.21.15.148:0/2459989316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09e81009b0 0x7f09e8100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:34.383 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.379+0000 7f09ee2d0640 1 --2- 172.21.15.148:0/2459989316 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09e81069c0 0x7f09e8106da0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:34.383 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.379+0000 7f09ee2d0640 1 -- 172.21.15.148:0/2459989316 >> 172.21.15.148:0/2459989316 conn(0x7f09e8077990 msgr2=0x7f09e80fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:34.383 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.379+0000 7f09ee2d0640 1 -- 172.21.15.148:0/2459989316 shutdown_connections 2024-09-19T07:14:34.383 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.379+0000 7f09ee2d0640 1 -- 172.21.15.148:0/2459989316 wait complete. 2024-09-19T07:14:34.383 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.379+0000 7f09ee2d0640 1 Processor -- start 2024-09-19T07:14:34.383 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.379+0000 7f09ee2d0640 1 -- start start 2024-09-19T07:14:34.383 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.380+0000 7f09ee2d0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09e81009b0 0x7f09e8198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:34.383 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.380+0000 7f09ee2d0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09e8101350 0x7f09e8198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:34.383 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.380+0000 7f09ee2d0640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09e81069c0 0x7f09e819cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:34.384 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.380+0000 7f09ee2d0640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f09e8110e00 con 0x7f09e81009b0 2024-09-19T07:14:34.384 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.380+0000 7f09ee2d0640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f09e8110c80 con 0x7f09e81069c0 2024-09-19T07:14:34.384 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.380+0000 7f09ee2d0640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f09e8110f80 con 0x7f09e8101350 2024-09-19T07:14:34.384 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.380+0000 7f09e7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09e81009b0 0x7f09e8198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:34.384 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.380+0000 7f09e7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09e81009b0 0x7f09e8198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35668/0 (socket says 172.21.15.148:35668) 2024-09-19T07:14:34.384 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.380+0000 7f09e7fff640 1 -- 172.21.15.148:0/3008325802 learned_addr learned my addr 172.21.15.148:0/3008325802 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:14:34.384 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.380+0000 7f09e77fe640 1 --2- 172.21.15.148:0/3008325802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09e8101350 0x7f09e8198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:34.384 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.380+0000 7f09ec86d640 1 --2- 172.21.15.148:0/3008325802 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09e81069c0 0x7f09e819cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:34.384 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.380+0000 7f09e7fff640 1 -- 172.21.15.148:0/3008325802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09e8101350 msgr2=0x7f09e8198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:34.384 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.380+0000 7f09e7fff640 1 --2- 172.21.15.148:0/3008325802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09e8101350 0x7f09e8198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:34.384 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.380+0000 7f09e7fff640 1 -- 172.21.15.148:0/3008325802 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09e81069c0 msgr2=0x7f09e819cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:34.384 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.380+0000 7f09e7fff640 1 --2- 172.21.15.148:0/3008325802 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09e81069c0 0x7f09e819cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:34.385 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.380+0000 7f09e7fff640 1 -- 172.21.15.148:0/3008325802 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09e819d330 con 0x7f09e81009b0 2024-09-19T07:14:34.385 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.380+0000 7f09e7fff640 1 --2- 172.21.15.148:0/3008325802 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09e81009b0 0x7f09e8198340 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f09e002ae00 tx=0x7f09e0031e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:34.385 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.380+0000 7f09e57fa640 1 -- 172.21.15.148:0/3008325802 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e0003e00 con 0x7f09e81009b0 2024-09-19T07:14:34.385 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.380+0000 7f09ee2d0640 1 -- 172.21.15.148:0/3008325802 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09e819d5c0 con 0x7f09e81009b0 2024-09-19T07:14:34.385 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.380+0000 7f09e57fa640 1 -- 172.21.15.148:0/3008325802 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f09e0004520 con 0x7f09e81009b0 2024-09-19T07:14:34.385 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.380+0000 7f09e57fa640 1 -- 172.21.15.148:0/3008325802 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e0030de0 con 0x7f09e81009b0 2024-09-19T07:14:34.385 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.381+0000 7f09ee2d0640 1 -- 172.21.15.148:0/3008325802 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09e81a4eb0 con 0x7f09e81009b0 2024-09-19T07:14:34.390 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.383+0000 7f09e57fa640 1 -- 172.21.15.148:0/3008325802 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f09e00046d0 con 0x7f09e81009b0 2024-09-19T07:14:34.390 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.383+0000 7f09f106c740 1 Processor -- start 2024-09-19T07:14:34.390 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.383+0000 7f09f106c740 1 -- start start 2024-09-19T07:14:34.391 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.383+0000 7f09e57fa640 1 --2- 172.21.15.148:0/3008325802 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f09d00a3460 0x7f09d00a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:34.391 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.383+0000 7f09f106c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56467e333af0 0x56467e333ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:34.391 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.383+0000 7f09f106c740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56467e334410 0x56467e33e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:34.391 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.383+0000 7f09f106c740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56467e33ecb0 0x56467e3410a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:34.391 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.383+0000 7f09f106c740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56467e2982f0 con 0x56467e334410 2024-09-19T07:14:34.391 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.384+0000 7f09f106c740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56467e240270 con 0x56467e33ecb0 2024-09-19T07:14:34.391 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.384+0000 7f09f106c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56467e2942b0 con 0x56467e333af0 2024-09-19T07:14:34.391 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.384+0000 7f09ec86d640 1 --2- 172.21.15.148:0/3008325802 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f09d00a3460 0x7f09d00a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:34.391 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.384+0000 7f09e57fa640 1 -- 172.21.15.148:0/3008325802 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f09e002e030 con 0x7f09e81009b0 2024-09-19T07:14:34.391 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.384+0000 7f09e77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56467e334410 0x56467e33e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:34.391 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.384+0000 7f09e7fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56467e333af0 0x56467e333ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:34.391 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.384+0000 7f09ec86d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56467e33ecb0 0x56467e3410a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.384+0000 7f09e7fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56467e333af0 0x56467e333ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:45582/0 (socket says 172.21.15.148:45582) 2024-09-19T07:14:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.384+0000 7f09e7fff640 1 -- 172.21.15.148:0/1341817809 learned_addr learned my addr 172.21.15.148:0/1341817809 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:14:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.384+0000 7f09e77fe640 1 -- 172.21.15.148:0/1341817809 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56467e333af0 msgr2=0x56467e333ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.384+0000 7f09e77fe640 1 --2- 172.21.15.148:0/1341817809 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56467e333af0 0x56467e333ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.384+0000 7f09e77fe640 1 -- 172.21.15.148:0/1341817809 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56467e33ecb0 msgr2=0x56467e3410a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.384+0000 7f09e77fe640 1 --2- 172.21.15.148:0/1341817809 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56467e33ecb0 0x56467e3410a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.384+0000 7f09e77fe640 1 -- 172.21.15.148:0/1341817809 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56467e23f340 con 0x56467e334410 2024-09-19T07:14:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.384+0000 7f09e7fff640 1 --2- 172.21.15.148:0/1341817809 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56467e333af0 0x56467e333ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:14:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.384+0000 7f09ec86d640 1 --2- 172.21.15.148:0/3008325802 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f09d00a3460 0x7f09d00a5920 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f09d8009ca0 tx=0x7f09d8009830 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.384+0000 7f09e77fe640 1 --2- 172.21.15.148:0/1341817809 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56467e334410 0x56467e33e770 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f09dc009bf0 tx=0x7f09dc011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ac6e0b5827b38ad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.384+0000 7f09ce7fc640 1 -- 172.21.15.148:0/1341817809 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09dc009da0 con 0x56467e334410 2024-09-19T07:14:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.384+0000 7f09ce7fc640 1 -- 172.21.15.148:0/1341817809 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f09dc005020 con 0x56467e334410 2024-09-19T07:14:34.393 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.384+0000 7f09ce7fc640 1 -- 172.21.15.148:0/1341817809 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09dc004b30 con 0x56467e334410 2024-09-19T07:14:34.393 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.385+0000 7f09f106c740 1 -- 172.21.15.148:0/1341817809 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56467e334410 msgr2=0x56467e33e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:34.393 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.385+0000 7f09f106c740 1 --2- 172.21.15.148:0/1341817809 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56467e334410 0x56467e33e770 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f09dc009bf0 tx=0x7f09dc011810 comp rx=0 tx=0).stop 2024-09-19T07:14:34.393 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.385+0000 7f09f106c740 1 -- 172.21.15.148:0/1341817809 shutdown_connections 2024-09-19T07:14:34.393 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.385+0000 7f09f106c740 1 --2- 172.21.15.148:0/1341817809 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56467e33ecb0 0x56467e3410a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:34.393 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.385+0000 7f09f106c740 1 --2- 172.21.15.148:0/1341817809 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56467e334410 0x56467e33e770 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:34.393 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.385+0000 7f09f106c740 1 --2- 172.21.15.148:0/1341817809 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56467e333af0 0x56467e333ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:34.393 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.385+0000 7f09f106c740 1 -- 172.21.15.148:0/1341817809 >> 172.21.15.148:0/1341817809 conn(0x56467e330060 msgr2=0x56467e330440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:34.393 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.385+0000 7f09f106c740 1 -- 172.21.15.148:0/1341817809 shutdown_connections 2024-09-19T07:14:34.393 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.385+0000 7f09f106c740 1 -- 172.21.15.148:0/1341817809 wait complete. 2024-09-19T07:14:34.393 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.385+0000 7f09f106c740 1 -- start start 2024-09-19T07:14:34.393 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.386+0000 7f09f106c740 1 Processor -- start 2024-09-19T07:14:34.394 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.386+0000 7f09f106c740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56467e333af0 0x56467e33bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:34.394 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.386+0000 7f09f106c740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56467e334410 0x56467e33c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:34.394 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.386+0000 7f09f106c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56467e33ecb0 0x56467e33c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:34.394 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.386+0000 7f09f106c740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56467e341880 con 0x56467e333af0 2024-09-19T07:14:34.394 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.386+0000 7f09f106c740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56467e221290 con 0x56467e334410 2024-09-19T07:14:34.394 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.386+0000 7f09f106c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56467e341a00 con 0x56467e33ecb0 2024-09-19T07:14:34.394 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.386+0000 7f09f106c740 10 client.0 _ll_register_callbacks cb 0x56467e252140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:14:34.394 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.386+0000 7f09e7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56467e333af0 0x56467e33bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:34.394 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.386+0000 7f09e7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56467e333af0 0x56467e33bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35680/0 (socket says 172.21.15.148:35680) 2024-09-19T07:14:34.394 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.386+0000 7f09e7fff640 1 -- 172.21.15.148:0/1304040768 learned_addr learned my addr 172.21.15.148:0/1304040768 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:14:34.394 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.386+0000 7f09e77fe640 1 --2- 172.21.15.148:0/1304040768 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56467e334410 0x56467e33c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:34.394 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.386+0000 7f09ec86d640 1 --2- 172.21.15.148:0/1304040768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56467e33ecb0 0x56467e33c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:34.394 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.386+0000 7f09e7fff640 1 -- 172.21.15.148:0/1304040768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56467e33ecb0 msgr2=0x56467e33c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:34.394 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.386+0000 7f09e7fff640 1 --2- 172.21.15.148:0/1304040768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56467e33ecb0 0x56467e33c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.386+0000 7f09e7fff640 1 -- 172.21.15.148:0/1304040768 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56467e334410 msgr2=0x56467e33c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.386+0000 7f09e7fff640 1 --2- 172.21.15.148:0/1304040768 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56467e334410 0x56467e33c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.386+0000 7f09e7fff640 1 -- 172.21.15.148:0/1304040768 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56467dfab210 con 0x56467e333af0 2024-09-19T07:14:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.387+0000 7f09e7fff640 1 --2- 172.21.15.148:0/1304040768 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56467e333af0 0x56467e33bad0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f09e00b9fb0 tx=0x7f09e00b9270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c265080de456944a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.387+0000 7f09c77fe640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:14:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.387+0000 7f09c77fe640 1 -- 172.21.15.148:0/1304040768 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e00bd5e0 con 0x56467e333af0 2024-09-19T07:14:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.387+0000 7f09c77fe640 1 -- 172.21.15.148:0/1304040768 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f09e00305a0 con 0x56467e333af0 2024-09-19T07:14:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.387+0000 7f09f106c740 1 -- 172.21.15.148:0/1304040768 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f09dc005020 con 0x56467e333af0 2024-09-19T07:14:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.387+0000 7f09c77fe640 1 -- 172.21.15.148:0/1304040768 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f09e00c1990 con 0x56467e333af0 2024-09-19T07:14:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.387+0000 7f09f106c740 10 client.16326 fetch_fsmap learned FSMap version 33 2024-09-19T07:14:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.387+0000 7f09f106c740 1 -- 172.21.15.148:0/1304040768 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56467e077620 con 0x56467e333af0 2024-09-19T07:14:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.387+0000 7f09c77fe640 1 -- 172.21.15.148:0/1304040768 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f09dc005020 con 0x56467e333af0 2024-09-19T07:14:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.387+0000 7f09c77fe640 1 -- 172.21.15.148:0/1304040768 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 33) ==== 8362+0+0 (secure 0 0 0) 0x7f09e004e070 con 0x56467e333af0 2024-09-19T07:14:34.396 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.387+0000 7f09f106c740 10 client.16326 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T07:14:34.396 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.387+0000 7f09f106c740 10 client.16326 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:14:34.396 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.387+0000 7f09f106c740 20 client.16326 populate_metadata read hostname 'smithi148' 2024-09-19T07:14:34.396 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.387+0000 7f09f106c740 1 --2- 172.21.15.148:0/1304040768 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56467e34eb40 0x56467e350f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:34.396 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.387+0000 7f09f106c740 4 client.16326 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:14:34.396 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.387+0000 7f09f106c740 1 -- 172.21.15.148:0/1304040768 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56467e2a5a20 con 0x56467e34eb40 2024-09-19T07:14:34.396 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.387+0000 7f09e77fe640 1 --2- 172.21.15.148:0/1304040768 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56467e34eb40 0x56467e350f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:34.396 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.388+0000 7f09c77fe640 10 client.16326 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:14:34.396 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.388+0000 7f09e77fe640 1 --2- 172.21.15.148:0/1304040768 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56467e34eb40 0x56467e350f70 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5fef76b94524f72 server_cookie=e2712907dcb86d13 in_seq=0 out_seq=0 2024-09-19T07:14:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.427+0000 7f09c77fe640 1 -- 172.21.15.148:0/1304040768 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56467e2a5a20 con 0x56467e34eb40 2024-09-19T07:14:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.427+0000 7f09c77fe640 10 client.16326 handle_command_reply: tid=0 2024-09-19T07:14:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.427+0000 7f09f106c740 1 client.16326 shutdown 2024-09-19T07:14:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.427+0000 7f09f106c740 1 -- 172.21.15.148:0/1304040768 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56467e333af0 msgr2=0x56467e33bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.427+0000 7f09f106c740 1 --2- 172.21.15.148:0/1304040768 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56467e333af0 0x56467e33bad0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f09e00b9fb0 tx=0x7f09e00b9270 comp rx=0 tx=0).stop 2024-09-19T07:14:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.427+0000 7f09f106c740 1 -- 172.21.15.148:0/1304040768 shutdown_connections 2024-09-19T07:14:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.427+0000 7f09f106c740 1 --2- 172.21.15.148:0/1304040768 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56467e34eb40 0x56467e350f70 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.427+0000 7f09f106c740 1 --2- 172.21.15.148:0/1304040768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56467e33ecb0 0x56467e33c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.427+0000 7f09f106c740 1 --2- 172.21.15.148:0/1304040768 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56467e334410 0x56467e33c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.427+0000 7f09f106c740 1 --2- 172.21.15.148:0/1304040768 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56467e333af0 0x56467e33bad0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.427+0000 7f09c77fe640 0 client.16326 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:14:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.427+0000 7f09f106c740 1 -- 172.21.15.148:0/1304040768 >> 172.21.15.148:0/1304040768 conn(0x56467e330060 msgr2=0x56467e335d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.427+0000 7f09f106c740 1 -- 172.21.15.148:0/1304040768 shutdown_connections 2024-09-19T07:14:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.427+0000 7f09f106c740 1 -- 172.21.15.148:0/1304040768 wait complete. 2024-09-19T07:14:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.427+0000 7f09f106c740 20 client.16326 trim_cache size 0 max 16384 2024-09-19T07:14:34.443 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.441+0000 7f09f106c740 1 Processor -- start 2024-09-19T07:14:34.443 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.441+0000 7f09f106c740 1 -- start start 2024-09-19T07:14:34.443 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.441+0000 7f09f106c740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56467e333af0 0x56467e33a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:34.443 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.441+0000 7f09f106c740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56467e334410 0x56467e33c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:34.443 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.441+0000 7f09f106c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56467e33ecb0 0x56467e356880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:34.444 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.441+0000 7f09f106c740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f09e81b0020 con 0x56467e334410 2024-09-19T07:14:34.444 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.441+0000 7f09f106c740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f09e81ad890 con 0x56467e333af0 2024-09-19T07:14:34.444 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.441+0000 7f09f106c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f09e81ab6c0 con 0x56467e33ecb0 2024-09-19T07:14:34.444 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.441+0000 7f09e77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56467e334410 0x56467e33c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:34.444 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.441+0000 7f09e77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56467e334410 0x56467e33c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35694/0 (socket says 172.21.15.148:35694) 2024-09-19T07:14:34.444 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.441+0000 7f09e77fe640 1 -- 172.21.15.148:0/378678771 learned_addr learned my addr 172.21.15.148:0/378678771 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:14:34.444 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.441+0000 7f09e7fff640 1 --2- 172.21.15.148:0/378678771 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56467e333af0 0x56467e33a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:34.444 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.441+0000 7f09ec86d640 1 --2- 172.21.15.148:0/378678771 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56467e33ecb0 0x56467e356880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:34.444 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.441+0000 7f09e77fe640 1 -- 172.21.15.148:0/378678771 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56467e33ecb0 msgr2=0x56467e356880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:34.444 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.442+0000 7f09e77fe640 1 --2- 172.21.15.148:0/378678771 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56467e33ecb0 0x56467e356880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:34.444 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.442+0000 7f09e77fe640 1 -- 172.21.15.148:0/378678771 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56467e333af0 msgr2=0x56467e33a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:34.444 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.442+0000 7f09e77fe640 1 --2- 172.21.15.148:0/378678771 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56467e333af0 0x56467e33a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:34.445 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.442+0000 7f09e77fe640 1 -- 172.21.15.148:0/378678771 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56467e32fe90 con 0x56467e334410 2024-09-19T07:14:34.445 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.442+0000 7f09ec86d640 1 --2- 172.21.15.148:0/378678771 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56467e33ecb0 0x56467e356880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:14:34.445 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.442+0000 7f09e77fe640 1 --2- 172.21.15.148:0/378678771 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56467e334410 0x56467e33c380 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x56467e330ec0 tx=0x7f09dc009930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=345cc7419cc8d671 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:34.445 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.442+0000 7f09cdffb640 1 -- 172.21.15.148:0/378678771 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09dc030070 con 0x56467e334410 2024-09-19T07:14:34.445 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.442+0000 7f09cdffb640 1 -- 172.21.15.148:0/378678771 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f09dc004040 con 0x56467e334410 2024-09-19T07:14:34.445 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.442+0000 7f09cdffb640 1 -- 172.21.15.148:0/378678771 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09dc004d20 con 0x56467e334410 2024-09-19T07:14:34.449 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.443+0000 7f09f106c740 1 -- 172.21.15.148:0/378678771 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56467e334410 msgr2=0x56467e33c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:34.449 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.443+0000 7f09f106c740 1 --2- 172.21.15.148:0/378678771 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56467e334410 0x56467e33c380 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x56467e330ec0 tx=0x7f09dc009930 comp rx=0 tx=0).stop 2024-09-19T07:14:34.450 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.443+0000 7f09f106c740 1 -- 172.21.15.148:0/378678771 shutdown_connections 2024-09-19T07:14:34.450 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.443+0000 7f09f106c740 1 --2- 172.21.15.148:0/378678771 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56467e33ecb0 0x56467e356880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:34.450 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.443+0000 7f09f106c740 1 --2- 172.21.15.148:0/378678771 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56467e334410 0x56467e33c380 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:34.450 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.443+0000 7f09f106c740 1 --2- 172.21.15.148:0/378678771 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56467e333af0 0x56467e33a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:34.450 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.443+0000 7f09f106c740 1 -- 172.21.15.148:0/378678771 >> 172.21.15.148:0/378678771 conn(0x56467e330060 msgr2=0x56467e33db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:34.450 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.443+0000 7f09f106c740 1 -- 172.21.15.148:0/378678771 shutdown_connections 2024-09-19T07:14:34.450 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.443+0000 7f09f106c740 1 -- 172.21.15.148:0/378678771 wait complete. 2024-09-19T07:14:34.450 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.443+0000 7f09f106c740 1 -- start start 2024-09-19T07:14:34.450 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.444+0000 7f09f106c740 1 Processor -- start 2024-09-19T07:14:34.450 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.444+0000 7f09f106c740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56467e333af0 0x56467e347490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:34.450 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.444+0000 7f09f106c740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56467e334410 0x56467e3388a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:34.450 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.444+0000 7f09f106c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56467e33ecb0 0x56467e338e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:34.451 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.444+0000 7f09f106c740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f09e81abd50 con 0x56467e334410 2024-09-19T07:14:34.451 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.444+0000 7f09f106c740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f09e81ad1c0 con 0x56467e333af0 2024-09-19T07:14:34.451 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.444+0000 7f09f106c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f09e81ac420 con 0x56467e33ecb0 2024-09-19T07:14:34.451 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.444+0000 7f09f106c740 10 client.0 _ll_register_callbacks cb 0x7f09e00ee9f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:14:34.451 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.444+0000 7f09e77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56467e334410 0x56467e3388a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:34.451 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.444+0000 7f09ec86d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56467e33ecb0 0x56467e338e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:34.451 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.444+0000 7f09e77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56467e334410 0x56467e3388a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35704/0 (socket says 172.21.15.148:35704) 2024-09-19T07:14:34.451 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.444+0000 7f09e7fff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56467e333af0 0x56467e347490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:34.451 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.444+0000 7f09e77fe640 1 -- 172.21.15.148:0/2702959417 learned_addr learned my addr 172.21.15.148:0/2702959417 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:14:34.451 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.444+0000 7f09e77fe640 1 -- 172.21.15.148:0/2702959417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56467e33ecb0 msgr2=0x56467e338e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:34.451 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.444+0000 7f09e77fe640 1 --2- 172.21.15.148:0/2702959417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56467e33ecb0 0x56467e338e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:34.451 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.444+0000 7f09e77fe640 1 -- 172.21.15.148:0/2702959417 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56467e333af0 msgr2=0x56467e347490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:34.451 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.444+0000 7f09e77fe640 1 --2- 172.21.15.148:0/2702959417 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56467e333af0 0x56467e347490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:34.451 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.444+0000 7f09e77fe640 1 -- 172.21.15.148:0/2702959417 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56467e339690 con 0x56467e334410 2024-09-19T07:14:34.452 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.445+0000 7f09e77fe640 1 --2- 172.21.15.148:0/2702959417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56467e334410 0x56467e3388a0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f09dc02e040 tx=0x7f09dc004420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=673066609862ab7c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:34.452 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.445+0000 7f09c77fe640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:14:34.452 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.445+0000 7f09c77fe640 1 -- 172.21.15.148:0/2702959417 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09dc030040 con 0x56467e334410 2024-09-19T07:14:34.452 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.445+0000 7f09c77fe640 1 -- 172.21.15.148:0/2702959417 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f09dc0052d0 con 0x56467e334410 2024-09-19T07:14:34.452 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.445+0000 7f09f106c740 1 -- 172.21.15.148:0/2702959417 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f09dc004040 con 0x56467e334410 2024-09-19T07:14:34.452 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.445+0000 7f09c77fe640 1 -- 172.21.15.148:0/2702959417 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f09dc0054f0 con 0x56467e334410 2024-09-19T07:14:34.452 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.445+0000 7f09f106c740 10 client.16332 fetch_fsmap learned FSMap version 33 2024-09-19T07:14:34.452 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.445+0000 7f09f106c740 1 -- 172.21.15.148:0/2702959417 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56467e3b98e0 con 0x56467e334410 2024-09-19T07:14:34.452 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.445+0000 7f09c77fe640 1 -- 172.21.15.148:0/2702959417 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f09dc004040 con 0x56467e334410 2024-09-19T07:14:34.453 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.445+0000 7f09c77fe640 1 -- 172.21.15.148:0/2702959417 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 33) ==== 8362+0+0 (secure 0 0 0) 0x7f09dc0038f0 con 0x56467e334410 2024-09-19T07:14:34.453 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.445+0000 7f09f106c740 10 client.16332 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T07:14:34.453 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.445+0000 7f09f106c740 10 client.16332 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:14:34.453 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.445+0000 7f09f106c740 20 client.16332 populate_metadata read hostname 'smithi148' 2024-09-19T07:14:34.453 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.445+0000 7f09f106c740 1 --2- 172.21.15.148:0/2702959417 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56467e3b9e30 0x56467e3bc250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:34.453 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.445+0000 7f09f106c740 4 client.16332 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:14:34.453 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.445+0000 7f09f106c740 1 -- 172.21.15.148:0/2702959417 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56467e29fd70 con 0x56467e3b9e30 2024-09-19T07:14:34.453 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.445+0000 7f09e7fff640 1 --2- 172.21.15.148:0/2702959417 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56467e3b9e30 0x56467e3bc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:34.453 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.446+0000 7f09c77fe640 10 client.16332 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:14:34.453 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.446+0000 7f09e7fff640 1 --2- 172.21.15.148:0/2702959417 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56467e3b9e30 0x56467e3bc250 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9189375448fc9cc1 server_cookie=5ce5565db57e770f in_seq=0 out_seq=0 2024-09-19T07:14:34.898 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.895+0000 7f09c77fe640 1 -- 172.21.15.148:0/2702959417 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56467e29fd70 con 0x56467e3b9e30 2024-09-19T07:14:34.898 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.895+0000 7f09c77fe640 10 client.16332 handle_command_reply: tid=0 2024-09-19T07:14:34.898 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.895+0000 7f09f106c740 1 client.16332 shutdown 2024-09-19T07:14:34.898 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.896+0000 7f09f106c740 1 -- 172.21.15.148:0/2702959417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56467e334410 msgr2=0x56467e3388a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:34.898 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.896+0000 7f09f106c740 1 --2- 172.21.15.148:0/2702959417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56467e334410 0x56467e3388a0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f09dc02e040 tx=0x7f09dc004420 comp rx=0 tx=0).stop 2024-09-19T07:14:34.898 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.896+0000 7f09f106c740 1 -- 172.21.15.148:0/2702959417 shutdown_connections 2024-09-19T07:14:34.898 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.896+0000 7f09f106c740 1 --2- 172.21.15.148:0/2702959417 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56467e3b9e30 0x56467e3bc250 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:34.898 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.896+0000 7f09f106c740 1 --2- 172.21.15.148:0/2702959417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56467e33ecb0 0x56467e338e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:34.898 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.896+0000 7f09f106c740 1 --2- 172.21.15.148:0/2702959417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56467e334410 0x56467e3388a0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:34.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.896+0000 7f09c77fe640 0 client.16332 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:14:34.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.896+0000 7f09f106c740 1 --2- 172.21.15.148:0/2702959417 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56467e333af0 0x56467e347490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:34.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.896+0000 7f09f106c740 1 -- 172.21.15.148:0/2702959417 >> 172.21.15.148:0/2702959417 conn(0x56467e330060 msgr2=0x56467e3354c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:34.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.896+0000 7f09f106c740 1 -- 172.21.15.148:0/2702959417 shutdown_connections 2024-09-19T07:14:34.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.896+0000 7f09f106c740 1 -- 172.21.15.148:0/2702959417 wait complete. 2024-09-19T07:14:34.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.896+0000 7f09f106c740 20 client.16332 trim_cache size 0 max 16384 2024-09-19T07:14:34.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:14:34.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:14:34.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:14:34.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:14:34.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.897+0000 7f09ee2d0640 1 -- 172.21.15.148:0/3008325802 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f09d00a3460 msgr2=0x7f09d00a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:34.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.897+0000 7f09ee2d0640 1 --2- 172.21.15.148:0/3008325802 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f09d00a3460 0x7f09d00a5920 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f09d8009ca0 tx=0x7f09d8009830 comp rx=0 tx=0).stop 2024-09-19T07:14:34.901 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.897+0000 7f09ee2d0640 1 -- 172.21.15.148:0/3008325802 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09e81009b0 msgr2=0x7f09e8198340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:34.901 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.897+0000 7f09ee2d0640 1 --2- 172.21.15.148:0/3008325802 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09e81009b0 0x7f09e8198340 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f09e002ae00 tx=0x7f09e0031e60 comp rx=0 tx=0).stop 2024-09-19T07:14:34.901 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.897+0000 7f09ee2d0640 1 -- 172.21.15.148:0/3008325802 shutdown_connections 2024-09-19T07:14:34.901 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.897+0000 7f09ee2d0640 1 --2- 172.21.15.148:0/3008325802 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f09d00a3460 0x7f09d00a5920 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:34.901 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.897+0000 7f09ee2d0640 1 --2- 172.21.15.148:0/3008325802 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09e81069c0 0x7f09e819cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:34.901 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.897+0000 7f09ee2d0640 1 --2- 172.21.15.148:0/3008325802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09e8101350 0x7f09e8198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:34.901 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.897+0000 7f09ee2d0640 1 --2- 172.21.15.148:0/3008325802 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09e81009b0 0x7f09e8198340 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:34.901 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.897+0000 7f09ee2d0640 1 -- 172.21.15.148:0/3008325802 >> 172.21.15.148:0/3008325802 conn(0x7f09e8077990 msgr2=0x7f09e80ff5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:34.901 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.897+0000 7f09ee2d0640 1 -- 172.21.15.148:0/3008325802 shutdown_connections 2024-09-19T07:14:34.901 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:34.897+0000 7f09ee2d0640 1 -- 172.21.15.148:0/3008325802 wait complete. 2024-09-19T07:14:35.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:34 smithi148 ceph-mon[31180]: pgmap v108: 97 pgs: 97 active+clean; 350 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.5 MiB/s wr, 328 op/s 2024-09-19T07:14:35.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:34 smithi165 ceph-mon[35326]: pgmap v108: 97 pgs: 97 active+clean; 350 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.5 MiB/s wr, 328 op/s 2024-09-19T07:14:35.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:34 smithi179 ceph-mon[35716]: pgmap v108: 97 pgs: 97 active+clean; 350 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.5 MiB/s wr, 328 op/s 2024-09-19T07:14:37.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:36 smithi148 ceph-mon[31180]: pgmap v109: 97 pgs: 97 active+clean; 392 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.9 MiB/s wr, 686 op/s 2024-09-19T07:14:37.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:36 smithi165 ceph-mon[35326]: pgmap v109: 97 pgs: 97 active+clean; 392 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.9 MiB/s wr, 686 op/s 2024-09-19T07:14:37.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:36 smithi179 ceph-mon[35716]: pgmap v109: 97 pgs: 97 active+clean; 392 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.9 MiB/s wr, 686 op/s 2024-09-19T07:14:39.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:38 smithi148 ceph-mon[31180]: pgmap v110: 97 pgs: 97 active+clean; 392 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 9.2 MiB/s wr, 610 op/s 2024-09-19T07:14:39.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:38 smithi165 ceph-mon[35326]: pgmap v110: 97 pgs: 97 active+clean; 392 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 9.2 MiB/s wr, 610 op/s 2024-09-19T07:14:39.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:38 smithi179 ceph-mon[35716]: pgmap v110: 97 pgs: 97 active+clean; 392 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 9.2 MiB/s wr, 610 op/s 2024-09-19T07:14:41.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:40 smithi165 ceph-mon[35326]: pgmap v111: 97 pgs: 97 active+clean; 392 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 9.2 MiB/s wr, 610 op/s 2024-09-19T07:14:41.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:40 smithi179 ceph-mon[35716]: pgmap v111: 97 pgs: 97 active+clean; 392 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 9.2 MiB/s wr, 610 op/s 2024-09-19T07:14:41.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:40 smithi148 ceph-mon[31180]: pgmap v111: 97 pgs: 97 active+clean; 392 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 9.2 MiB/s wr, 610 op/s 2024-09-19T07:14:41.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:41.805+0000 7fc31affd640 1 -- 172.21.15.148:0/1273652377 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5605704a6d20 con 0x560570558c50 2024-09-19T07:14:41.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:41.805+0000 7fc31affd640 10 client.25729 handle_command_reply: tid=0 2024-09-19T07:14:41.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:41.805+0000 7fc3443ee740 1 client.25729 shutdown 2024-09-19T07:14:41.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:41.805+0000 7fc3443ee740 1 -- 172.21.15.148:0/1273652377 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560570539f60 msgr2=0x560570551550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:41.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:41.805+0000 7fc3443ee740 1 --2- 172.21.15.148:0/1273652377 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560570539f60 0x560570551550 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc32c005940 tx=0x7fc32c031950 comp rx=0 tx=0).stop 2024-09-19T07:14:41.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:41.805+0000 7fc3443ee740 1 -- 172.21.15.148:0/1273652377 shutdown_connections 2024-09-19T07:14:41.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:41.805+0000 7fc3443ee740 1 --2- 172.21.15.148:0/1273652377 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x560570558c50 0x5605705ca3a0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:41.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:41.805+0000 7fc3443ee740 1 --2- 172.21.15.148:0/1273652377 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x560570548d50 0x56057054e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:41.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:41.805+0000 7fc3443ee740 1 --2- 172.21.15.148:0/1273652377 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560570539f60 0x560570551550 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:41.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:41.805+0000 7fc3443ee740 1 --2- 172.21.15.148:0/1273652377 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560570539640 0x560570551010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:41.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:41.805+0000 7fc31affd640 0 client.25729 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:14:41.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:41.805+0000 7fc3443ee740 1 -- 172.21.15.148:0/1273652377 >> 172.21.15.148:0/1273652377 conn(0x560570535cf0 msgr2=0x560570545b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:41.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:41.805+0000 7fc3443ee740 1 -- 172.21.15.148:0/1273652377 shutdown_connections 2024-09-19T07:14:41.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:41.805+0000 7fc3443ee740 1 -- 172.21.15.148:0/1273652377 wait complete. 2024-09-19T07:14:41.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:41.805+0000 7fc3443ee740 20 client.25729 trim_cache size 0 max 16384 2024-09-19T07:14:41.808 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:14:41.808 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 33, 2024-09-19T07:14:41.808 INFO:teuthology.orchestra.run.smithi148.stdout: "leader": 24457, 2024-09-19T07:14:41.808 INFO:teuthology.orchestra.run.smithi148.stdout: "set_version": 14, 2024-09-19T07:14:41.808 INFO:teuthology.orchestra.run.smithi148.stdout: "sets": { 2024-09-19T07:14:41.808 INFO:teuthology.orchestra.run.smithi148.stdout: "5545af34": { 2024-09-19T07:14:41.808 INFO:teuthology.orchestra.run.smithi148.stdout: "version": 14, 2024-09-19T07:14:41.808 INFO:teuthology.orchestra.run.smithi148.stdout: "age_ref": 0.0, 2024-09-19T07:14:41.808 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:14:41.809 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "QUIESCED", 2024-09-19T07:14:41.809 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:14:41.809 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:41.809 INFO:teuthology.orchestra.run.smithi148.stdout: "timeout": 90.0, 2024-09-19T07:14:41.809 INFO:teuthology.orchestra.run.smithi148.stdout: "expiration": 136.6, 2024-09-19T07:14:41.809 INFO:teuthology.orchestra.run.smithi148.stdout: "members": { 2024-09-19T07:14:41.809 INFO:teuthology.orchestra.run.smithi148.stdout: "file:/": { 2024-09-19T07:14:41.809 INFO:teuthology.orchestra.run.smithi148.stdout: "excluded": false, 2024-09-19T07:14:41.809 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:14:41.809 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "QUIESCED", 2024-09-19T07:14:41.809 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:14:41.809 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:14:41.809 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:14:41.810 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:14:41.810 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:14:41.810 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:14:41.810 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:14:41.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:41.806+0000 7fc342015640 1 -- 172.21.15.148:0/3326478651 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc3280a33b0 msgr2=0x7fc3280a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:41.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:41.806+0000 7fc342015640 1 --2- 172.21.15.148:0/3326478651 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc3280a33b0 0x7fc3280a5870 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc3240cd980 tx=0x7fc3240d3c90 comp rx=0 tx=0).stop 2024-09-19T07:14:41.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:41.806+0000 7fc342015640 1 -- 172.21.15.148:0/3326478651 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc33c101de0 msgr2=0x7fc33c198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:41.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:41.806+0000 7fc342015640 1 --2- 172.21.15.148:0/3326478651 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc33c101de0 0x7fc33c198470 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc32400e9f0 tx=0x7fc32400eeb0 comp rx=0 tx=0).stop 2024-09-19T07:14:41.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:41.806+0000 7fc342015640 1 -- 172.21.15.148:0/3326478651 shutdown_connections 2024-09-19T07:14:41.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:41.806+0000 7fc342015640 1 --2- 172.21.15.148:0/3326478651 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc3280a33b0 0x7fc3280a5870 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:41.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:41.806+0000 7fc342015640 1 --2- 172.21.15.148:0/3326478651 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc33c106f10 0x7fc33c19cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:41.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:41.806+0000 7fc342015640 1 --2- 172.21.15.148:0/3326478651 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc33c102790 0x7fc33c1989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:41.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:41.806+0000 7fc342015640 1 --2- 172.21.15.148:0/3326478651 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc33c101de0 0x7fc33c198470 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:41.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:41.806+0000 7fc342015640 1 -- 172.21.15.148:0/3326478651 >> 172.21.15.148:0/3326478651 conn(0x7fc33c0fd8e0 msgr2=0x7fc33c0fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:41.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:41.806+0000 7fc342015640 1 -- 172.21.15.148:0/3326478651 shutdown_connections 2024-09-19T07:14:41.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:41.806+0000 7fc342015640 1 -- 172.21.15.148:0/3326478651 wait complete. 2024-09-19T07:14:42.844 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '5545af34', quiesce took 14.3 seconds. Will release after: 2.3000000000000007 2024-09-19T07:14:43.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:42 smithi148 ceph-mon[31180]: pgmap v112: 97 pgs: 97 active+clean; 390 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 11 MiB/s wr, 939 op/s 2024-09-19T07:14:43.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:42 smithi165 ceph-mon[35326]: pgmap v112: 97 pgs: 97 active+clean; 390 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 11 MiB/s wr, 939 op/s 2024-09-19T07:14:43.194 INFO:tasks.workunit.client.0.smithi148.stdout: 121 12900 0 9892 0 3281 1 2024-09-19T07:14:43.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:42 smithi179 ceph-mon[35716]: pgmap v112: 97 pgs: 97 active+clean; 390 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 11 MiB/s wr, 939 op/s 2024-09-19T07:14:45.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:44 smithi165 ceph-mon[35326]: pgmap v113: 97 pgs: 97 active+clean; 390 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.4 MiB/s wr, 686 op/s 2024-09-19T07:14:45.146 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:14:45.169 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:44 smithi148 ceph-mon[31180]: pgmap v113: 97 pgs: 97 active+clean; 390 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.4 MiB/s wr, 686 op/s 2024-09-19T07:14:45.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:44 smithi179 ceph-mon[35716]: pgmap v113: 97 pgs: 97 active+clean; 390 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.4 MiB/s wr, 686 op/s 2024-09-19T07:14:45.394 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:14:45.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:45.981+0000 7f191976a640 1 -- 172.21.15.148:0/3087134995 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f191410c180 msgr2=0x7f191410e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:45.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:45.981+0000 7f191976a640 1 --2- 172.21.15.148:0/3087134995 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f191410c180 0x7f191410e600 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f190c009ca0 tx=0x7f190c02a950 comp rx=0 tx=0).stop 2024-09-19T07:14:45.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:45.981+0000 7f191976a640 1 -- 172.21.15.148:0/3087134995 shutdown_connections 2024-09-19T07:14:45.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:45.981+0000 7f191976a640 1 --2- 172.21.15.148:0/3087134995 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f191410c180 0x7f191410e600 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:45.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:45.981+0000 7f191976a640 1 --2- 172.21.15.148:0/3087134995 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19141036c0 0x7f191410bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:45.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:45.981+0000 7f191976a640 1 --2- 172.21.15.148:0/3087134995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1914102da0 0x7f1914103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:45.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:45.981+0000 7f191976a640 1 -- 172.21.15.148:0/3087134995 >> 172.21.15.148:0/3087134995 conn(0x7f19140fc7a0 msgr2=0x7f19140febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:45.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:45.981+0000 7f191976a640 1 -- 172.21.15.148:0/3087134995 shutdown_connections 2024-09-19T07:14:45.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:45.981+0000 7f191976a640 1 -- 172.21.15.148:0/3087134995 wait complete. 2024-09-19T07:14:45.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:45.982+0000 7f191976a640 1 Processor -- start 2024-09-19T07:14:45.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:45.982+0000 7f191976a640 1 -- start start 2024-09-19T07:14:45.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:45.982+0000 7f191976a640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1914102da0 0x7f1914100a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:45.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:45.982+0000 7f191976a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19141036c0 0x7f1914100f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:45.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:45.982+0000 7f191976a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f191410c180 0x7f1914101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:45.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:45.982+0000 7f191976a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1914111f60 con 0x7f191410c180 2024-09-19T07:14:45.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:45.982+0000 7f191976a640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1914111de0 con 0x7f1914102da0 2024-09-19T07:14:45.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:45.982+0000 7f191976a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f19141120e0 con 0x7f19141036c0 2024-09-19T07:14:45.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:45.982+0000 7f19137fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f191410c180 0x7f1914101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:45.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:45.982+0000 7f1912ffd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1914102da0 0x7f1914100a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:45.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:45.982+0000 7f19137fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f191410c180 0x7f1914101480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40170/0 (socket says 172.21.15.148:40170) 2024-09-19T07:14:45.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:45.982+0000 7f19137fe640 1 -- 172.21.15.148:0/3274040194 learned_addr learned my addr 172.21.15.148:0/3274040194 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:14:45.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:45.983+0000 7f19137fe640 1 -- 172.21.15.148:0/3274040194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19141036c0 msgr2=0x7f1914100f40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T07:14:45.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:45.983+0000 7f19137fe640 1 --2- 172.21.15.148:0/3274040194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19141036c0 0x7f1914100f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:45.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:45.983+0000 7f19137fe640 1 -- 172.21.15.148:0/3274040194 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1914102da0 msgr2=0x7f1914100a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:45.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:45.983+0000 7f19137fe640 1 --2- 172.21.15.148:0/3274040194 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1914102da0 0x7f1914100a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:45.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:45.983+0000 7f19137fe640 1 -- 172.21.15.148:0/3274040194 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19141a6900 con 0x7f191410c180 2024-09-19T07:14:45.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:45.983+0000 7f1912ffd640 1 --2- 172.21.15.148:0/3274040194 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1914102da0 0x7f1914100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:14:45.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:45.983+0000 7f19137fe640 1 --2- 172.21.15.148:0/3274040194 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f191410c180 0x7f1914101480 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f190c004af0 tx=0x7f190c02f3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:45.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:45.983+0000 7f1910ff9640 1 -- 172.21.15.148:0/3274040194 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f190c034040 con 0x7f191410c180 2024-09-19T07:14:45.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:45.983+0000 7f191976a640 1 -- 172.21.15.148:0/3274040194 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19141a6b90 con 0x7f191410c180 2024-09-19T07:14:45.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:45.983+0000 7f1910ff9640 1 -- 172.21.15.148:0/3274040194 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f190c030920 con 0x7f191410c180 2024-09-19T07:14:45.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:45.983+0000 7f1910ff9640 1 -- 172.21.15.148:0/3274040194 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f190c004670 con 0x7f191410c180 2024-09-19T07:14:45.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:45.983+0000 7f191976a640 1 -- 172.21.15.148:0/3274040194 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19141a7070 con 0x7f191410c180 2024-09-19T07:14:45.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:45.984+0000 7f191976a640 1 -- 172.21.15.148:0/3274040194 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1914103180 con 0x7f191410c180 2024-09-19T07:14:45.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:45.986+0000 7f1910ff9640 1 -- 172.21.15.148:0/3274040194 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f190c037020 con 0x7f191410c180 2024-09-19T07:14:45.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:45.986+0000 7f1910ff9640 1 --2- 172.21.15.148:0/3274040194 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f19000a33b0 0x7f19000a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:45.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:45.986+0000 7f1912ffd640 1 --2- 172.21.15.148:0/3274040194 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f19000a33b0 0x7f19000a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:45.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:45.986+0000 7f1910ff9640 1 -- 172.21.15.148:0/3274040194 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f190c0f09d0 con 0x7f191410c180 2024-09-19T07:14:45.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:45.987+0000 7f1912ffd640 1 --2- 172.21.15.148:0/3274040194 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f19000a33b0 0x7f19000a5870 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1904009fc0 tx=0x7f1904005f90 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:45.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:45.989+0000 7f1910ff9640 1 -- 172.21.15.148:0/3274040194 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f190c0bd4d0 con 0x7f191410c180 2024-09-19T07:14:46.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:46.190+0000 7f191976a640 1 -- 172.21.15.148:0/3274040194 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1914107220 con 0x7f191410c180 2024-09-19T07:14:46.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:46.191+0000 7f1910ff9640 1 -- 172.21.15.148:0/3274040194 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11947 (secure 0 0 0) 0x7f190c0bcdd0 con 0x7f191410c180 2024-09-19T07:14:46.192 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:14:46.192 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":33,"btime":"2024-09-19T07:14:31:818799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/4263868576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":4263868576},{"type":"v1","addr":"172.21.15.148:6841","nonce":4263868576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":25606,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3891676893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3891676893},{"type":"v1","addr":"172.21.15.179:6835","nonce":3891676893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":33,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:09:19.543369+0000","modified":"2024-09-19T07:14:30.968403+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24457,"mds_1":24437,"mds_2":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24383":{"gid":24383,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6835/2146820965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2146820965},{"type":"v1","addr":"172.21.15.165:6835","nonce":2146820965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24410":{"gid":24410,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":75,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":71,"addr":"172.21.15.165:6839/3993490234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":3993490234},{"type":"v1","addr":"172.21.15.165:6839","nonce":3993490234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24457,"qdb_cluster":[24457,24437,24436]},"id":1}]} 2024-09-19T07:14:46.192 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 33 2024-09-19T07:14:46.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:46.193+0000 7f191976a640 1 -- 172.21.15.148:0/3274040194 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f19000a33b0 msgr2=0x7f19000a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:46.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:46.193+0000 7f191976a640 1 --2- 172.21.15.148:0/3274040194 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f19000a33b0 0x7f19000a5870 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1904009fc0 tx=0x7f1904005f90 comp rx=0 tx=0).stop 2024-09-19T07:14:46.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:46.193+0000 7f191976a640 1 -- 172.21.15.148:0/3274040194 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f191410c180 msgr2=0x7f1914101480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:46.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:46.193+0000 7f191976a640 1 --2- 172.21.15.148:0/3274040194 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f191410c180 0x7f1914101480 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f190c004af0 tx=0x7f190c02f3a0 comp rx=0 tx=0).stop 2024-09-19T07:14:46.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:46.193+0000 7f191976a640 1 -- 172.21.15.148:0/3274040194 shutdown_connections 2024-09-19T07:14:46.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:46.193+0000 7f191976a640 1 --2- 172.21.15.148:0/3274040194 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f19000a33b0 0x7f19000a5870 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:46.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:46.193+0000 7f191976a640 1 --2- 172.21.15.148:0/3274040194 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f191410c180 0x7f1914101480 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:46.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:46.193+0000 7f191976a640 1 --2- 172.21.15.148:0/3274040194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19141036c0 0x7f1914100f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:46.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:46.193+0000 7f191976a640 1 --2- 172.21.15.148:0/3274040194 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1914102da0 0x7f1914100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:46.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:46.193+0000 7f191976a640 1 -- 172.21.15.148:0/3274040194 >> 172.21.15.148:0/3274040194 conn(0x7f19140fc7a0 msgr2=0x7f19140fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:46.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:46.193+0000 7f191976a640 1 -- 172.21.15.148:0/3274040194 shutdown_connections 2024-09-19T07:14:46.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:46.193+0000 7f191976a640 1 -- 172.21.15.148:0/3274040194 wait complete. 2024-09-19T07:14:46.964 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24457 quiesce db --set-id 5545af34 --release --await' 2024-09-19T07:14:46.964 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24457 quiesce db --set-id 5545af34 --release --await 2024-09-19T07:14:47.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:46 smithi165 ceph-mon[35326]: pgmap v114: 97 pgs: 97 active+clean; 400 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 7.3 MiB/s wr, 845 op/s 2024-09-19T07:14:47.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:46 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/3274040194' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:14:47.254 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:14:47.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:46 smithi179 ceph-mon[35716]: pgmap v114: 97 pgs: 97 active+clean; 400 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 7.3 MiB/s wr, 845 op/s 2024-09-19T07:14:47.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:46 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/3274040194' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:14:47.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:46 smithi148 ceph-mon[31180]: pgmap v114: 97 pgs: 97 active+clean; 400 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 7.3 MiB/s wr, 845 op/s 2024-09-19T07:14:47.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:46 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/3274040194' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:14:47.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.735+0000 7f553537e640 1 -- 172.21.15.148:0/2967251272 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5530102ef0 msgr2=0x7f553010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:47.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.735+0000 7f553537e640 1 --2- 172.21.15.148:0/2967251272 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5530102ef0 0x7f553010da40 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f5528009ca0 tx=0x7f552802a950 comp rx=0 tx=0).stop 2024-09-19T07:14:47.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.735+0000 7f553537e640 1 -- 172.21.15.148:0/2967251272 shutdown_connections 2024-09-19T07:14:47.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.735+0000 7f553537e640 1 --2- 172.21.15.148:0/2967251272 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5530102ef0 0x7f553010da40 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:47.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.735+0000 7f553537e640 1 --2- 172.21.15.148:0/2967251272 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5530102570 0x7f55301029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:47.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.735+0000 7f553537e640 1 --2- 172.21.15.148:0/2967251272 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5530100e20 0x7f5530101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:47.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.735+0000 7f553537e640 1 -- 172.21.15.148:0/2967251272 >> 172.21.15.148:0/2967251272 conn(0x7f55300fc7d0 msgr2=0x7f55300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:47.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.735+0000 7f553537e640 1 -- 172.21.15.148:0/2967251272 shutdown_connections 2024-09-19T07:14:47.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.735+0000 7f553537e640 1 -- 172.21.15.148:0/2967251272 wait complete. 2024-09-19T07:14:47.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.735+0000 7f553537e640 1 Processor -- start 2024-09-19T07:14:47.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.735+0000 7f553537e640 1 -- start start 2024-09-19T07:14:47.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.736+0000 7f553537e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5530100e20 0x7f55301984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:47.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.736+0000 7f553537e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5530102570 0x7f55301989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:47.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.736+0000 7f553537e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5530102ef0 0x7f553019cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:47.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.736+0000 7f553537e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5530110f80 con 0x7f5530100e20 2024-09-19T07:14:47.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.736+0000 7f553537e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5530110e00 con 0x7f5530102ef0 2024-09-19T07:14:47.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.736+0000 7f553537e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5530111100 con 0x7f5530102570 2024-09-19T07:14:47.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.736+0000 7f552effd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5530100e20 0x7f55301984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:47.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.736+0000 7f552effd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5530100e20 0x7f55301984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40190/0 (socket says 172.21.15.148:40190) 2024-09-19T07:14:47.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.736+0000 7f552effd640 1 -- 172.21.15.148:0/628962309 learned_addr learned my addr 172.21.15.148:0/628962309 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:14:47.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.736+0000 7f552f7fe640 1 --2- 172.21.15.148:0/628962309 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5530102ef0 0x7f553019cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:47.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.736+0000 7f55267fc640 1 --2- 172.21.15.148:0/628962309 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5530102570 0x7f55301989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:47.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.736+0000 7f552effd640 1 -- 172.21.15.148:0/628962309 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5530102570 msgr2=0x7f55301989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:47.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.736+0000 7f552effd640 1 --2- 172.21.15.148:0/628962309 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5530102570 0x7f55301989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:47.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.736+0000 7f552effd640 1 -- 172.21.15.148:0/628962309 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5530102ef0 msgr2=0x7f553019cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:47.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.736+0000 7f552effd640 1 --2- 172.21.15.148:0/628962309 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5530102ef0 0x7f553019cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:47.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.736+0000 7f552effd640 1 -- 172.21.15.148:0/628962309 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f553019d460 con 0x7f5530100e20 2024-09-19T07:14:47.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.736+0000 7f552f7fe640 1 --2- 172.21.15.148:0/628962309 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5530102ef0 0x7f553019cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:14:47.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.736+0000 7f55267fc640 1 --2- 172.21.15.148:0/628962309 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5530102570 0x7f55301989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:14:47.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.736+0000 7f552effd640 1 --2- 172.21.15.148:0/628962309 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5530100e20 0x7f55301984b0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f552000d950 tx=0x7f552000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:47.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.736+0000 7f552cff9640 1 -- 172.21.15.148:0/628962309 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5520017070 con 0x7f5530100e20 2024-09-19T07:14:47.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.736+0000 7f553537e640 1 -- 172.21.15.148:0/628962309 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f553019d750 con 0x7f5530100e20 2024-09-19T07:14:47.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.736+0000 7f552cff9640 1 -- 172.21.15.148:0/628962309 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5520009c30 con 0x7f5530100e20 2024-09-19T07:14:47.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.736+0000 7f552cff9640 1 -- 172.21.15.148:0/628962309 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f552000f6b0 con 0x7f5530100e20 2024-09-19T07:14:47.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.737+0000 7f553537e640 1 -- 172.21.15.148:0/628962309 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55301a5030 con 0x7f5530100e20 2024-09-19T07:14:47.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.739+0000 7f552cff9640 1 -- 172.21.15.148:0/628962309 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f55200109d0 con 0x7f5530100e20 2024-09-19T07:14:47.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.739+0000 7f5537757740 1 Processor -- start 2024-09-19T07:14:47.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.739+0000 7f5537757740 1 -- start start 2024-09-19T07:14:47.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.739+0000 7f5537757740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55df41c55060 0x55df41c55440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:47.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.739+0000 7f5537757740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55df41c55980 0x55df41c5fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:47.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.739+0000 7f5537757740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55df41c60240 0x55df41c62630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:47.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.739+0000 7f5537757740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55df41bba620 con 0x55df41c55980 2024-09-19T07:14:47.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.739+0000 7f5537757740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55df41b61e50 con 0x55df41c60240 2024-09-19T07:14:47.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.739+0000 7f5537757740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55df41bb65e0 con 0x55df41c55060 2024-09-19T07:14:47.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.740+0000 7f552effd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55df41c55980 0x55df41c5fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:47.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.740+0000 7f552effd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55df41c55980 0x55df41c5fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40200/0 (socket says 172.21.15.148:40200) 2024-09-19T07:14:47.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.740+0000 7f55267fc640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55df41c60240 0x55df41c62630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:47.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.740+0000 7f552effd640 1 -- 172.21.15.148:0/1752222488 learned_addr learned my addr 172.21.15.148:0/1752222488 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:14:47.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.740+0000 7f552f7fe640 1 --2- 172.21.15.148:0/1752222488 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55df41c55060 0x55df41c55440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:47.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.740+0000 7f552cff9640 1 --2- 172.21.15.148:0/628962309 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f551c0a33b0 0x7f551c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:47.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.740+0000 7f552f7fe640 1 --2- 172.21.15.148:0/628962309 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f551c0a33b0 0x7f551c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:47.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.740+0000 7f55267fc640 1 -- 172.21.15.148:0/1752222488 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55df41c55060 msgr2=0x55df41c55440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:47.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.740+0000 7f55267fc640 1 --2- 172.21.15.148:0/1752222488 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55df41c55060 0x55df41c55440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:47.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.740+0000 7f55267fc640 1 -- 172.21.15.148:0/1752222488 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55df41c55980 msgr2=0x55df41c5fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:47.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.740+0000 7f55267fc640 1 --2- 172.21.15.148:0/1752222488 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55df41c55980 0x55df41c5fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:47.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.740+0000 7f55267fc640 1 -- 172.21.15.148:0/1752222488 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df41b52d40 con 0x55df41c60240 2024-09-19T07:14:47.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.740+0000 7f552cff9640 1 -- 172.21.15.148:0/628962309 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f55200cfa20 con 0x7f5530100e20 2024-09-19T07:14:47.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.740+0000 7f552effd640 1 --2- 172.21.15.148:0/1752222488 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55df41c55980 0x55df41c5fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:14:47.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.740+0000 7f55267fc640 1 --2- 172.21.15.148:0/1752222488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55df41c60240 0x55df41c62630 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5518009ac0 tx=0x7f5518009f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1240547031f8e01 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:47.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.740+0000 7f552f7fe640 1 --2- 172.21.15.148:0/628962309 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f551c0a33b0 0x7f551c0a5870 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5528005fc0 tx=0x7f552802a950 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:47.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.740+0000 7f55257fa640 1 -- 172.21.15.148:0/1752222488 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5518016070 con 0x55df41c60240 2024-09-19T07:14:47.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.741+0000 7f55257fa640 1 -- 172.21.15.148:0/1752222488 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5518005500 con 0x55df41c60240 2024-09-19T07:14:47.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.741+0000 7f55257fa640 1 -- 172.21.15.148:0/1752222488 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5518011470 con 0x55df41c60240 2024-09-19T07:14:47.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.741+0000 7f5537757740 1 -- 172.21.15.148:0/1752222488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55df41c60240 msgr2=0x55df41c62630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:47.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.741+0000 7f5537757740 1 --2- 172.21.15.148:0/1752222488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55df41c60240 0x55df41c62630 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5518009ac0 tx=0x7f5518009f80 comp rx=0 tx=0).stop 2024-09-19T07:14:47.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.741+0000 7f5537757740 1 -- 172.21.15.148:0/1752222488 shutdown_connections 2024-09-19T07:14:47.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.741+0000 7f5537757740 1 --2- 172.21.15.148:0/1752222488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55df41c60240 0x55df41c62630 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:47.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.741+0000 7f5537757740 1 --2- 172.21.15.148:0/1752222488 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55df41c55980 0x55df41c5fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:47.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.741+0000 7f5537757740 1 --2- 172.21.15.148:0/1752222488 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55df41c55060 0x55df41c55440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:47.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.741+0000 7f5537757740 1 -- 172.21.15.148:0/1752222488 >> 172.21.15.148:0/1752222488 conn(0x55df41c515f0 msgr2=0x55df41c519d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:47.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.741+0000 7f5537757740 1 -- 172.21.15.148:0/1752222488 shutdown_connections 2024-09-19T07:14:47.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.741+0000 7f5537757740 1 -- 172.21.15.148:0/1752222488 wait complete. 2024-09-19T07:14:47.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.742+0000 7f5537757740 1 -- start start 2024-09-19T07:14:47.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.742+0000 7f5537757740 1 Processor -- start 2024-09-19T07:14:47.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.742+0000 7f5537757740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55df41c55060 0x55df41c5d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:47.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.742+0000 7f5537757740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55df41c55980 0x55df41c5d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:47.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.742+0000 7f5537757740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55df41c60240 0x55df41c5db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:47.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.742+0000 7f5537757740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55df41c62e10 con 0x55df41c60240 2024-09-19T07:14:47.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.742+0000 7f5537757740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55df41b42f10 con 0x55df41c55060 2024-09-19T07:14:47.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.742+0000 7f5537757740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55df41c62f90 con 0x55df41c55980 2024-09-19T07:14:47.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.742+0000 7f5537757740 10 client.0 _ll_register_callbacks cb 0x55df41b66db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:14:47.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.742+0000 7f552f7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55df41c60240 0x55df41c5db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:47.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.742+0000 7f552f7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55df41c60240 0x55df41c5db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40212/0 (socket says 172.21.15.148:40212) 2024-09-19T07:14:47.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.742+0000 7f552f7fe640 1 -- 172.21.15.148:0/196305992 learned_addr learned my addr 172.21.15.148:0/196305992 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:14:47.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.742+0000 7f552effd640 1 --2- 172.21.15.148:0/196305992 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55df41c55060 0x55df41c5d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:47.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.742+0000 7f55267fc640 1 --2- 172.21.15.148:0/196305992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55df41c55980 0x55df41c5d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:47.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.742+0000 7f552f7fe640 1 -- 172.21.15.148:0/196305992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55df41c55980 msgr2=0x55df41c5d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:47.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.742+0000 7f552f7fe640 1 --2- 172.21.15.148:0/196305992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55df41c55980 0x55df41c5d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:47.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.742+0000 7f552f7fe640 1 -- 172.21.15.148:0/196305992 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55df41c55060 msgr2=0x55df41c5d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:47.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.742+0000 7f552f7fe640 1 --2- 172.21.15.148:0/196305992 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55df41c55060 0x55df41c5d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:47.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.742+0000 7f552f7fe640 1 -- 172.21.15.148:0/196305992 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df418c9580 con 0x55df41c60240 2024-09-19T07:14:47.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.742+0000 7f55267fc640 1 --2- 172.21.15.148:0/196305992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55df41c55980 0x55df41c5d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:14:47.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.743+0000 7f552f7fe640 1 --2- 172.21.15.148:0/196305992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55df41c60240 0x55df41c5db80 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f5528003bf0 tx=0x7f55280095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e84b3d9aa6499e92 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:47.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.743+0000 7f55167fc640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:14:47.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.743+0000 7f55167fc640 1 -- 172.21.15.148:0/196305992 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5528034040 con 0x55df41c60240 2024-09-19T07:14:47.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.743+0000 7f5537757740 1 -- 172.21.15.148:0/196305992 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5518005500 con 0x55df41c60240 2024-09-19T07:14:47.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.743+0000 7f55167fc640 1 -- 172.21.15.148:0/196305992 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f55280045d0 con 0x55df41c60240 2024-09-19T07:14:47.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.743+0000 7f55167fc640 1 -- 172.21.15.148:0/196305992 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f5528059050 con 0x55df41c60240 2024-09-19T07:14:47.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.743+0000 7f5537757740 10 client.16350 fetch_fsmap learned FSMap version 33 2024-09-19T07:14:47.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.743+0000 7f5537757740 1 -- 172.21.15.148:0/196305992 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55df41993960 con 0x55df41c60240 2024-09-19T07:14:47.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.743+0000 7f55167fc640 1 -- 172.21.15.148:0/196305992 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5518005500 con 0x55df41c60240 2024-09-19T07:14:47.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.743+0000 7f55167fc640 1 -- 172.21.15.148:0/196305992 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 33) ==== 8362+0+0 (secure 0 0 0) 0x7f5528049040 con 0x55df41c60240 2024-09-19T07:14:47.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.743+0000 7f5537757740 10 client.16350 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T07:14:47.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.743+0000 7f5537757740 10 client.16350 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:14:47.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.743+0000 7f5537757740 20 client.16350 populate_metadata read hostname 'smithi148' 2024-09-19T07:14:47.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.743+0000 7f5537757740 1 --2- 172.21.15.148:0/196305992 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55df41c6fe90 0x55df41c72350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:47.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.743+0000 7f5537757740 4 client.16350 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:14:47.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.743+0000 7f5537757740 1 -- 172.21.15.148:0/196305992 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55df41bc7b90 con 0x55df41c6fe90 2024-09-19T07:14:47.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.744+0000 7f552effd640 1 --2- 172.21.15.148:0/196305992 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55df41c6fe90 0x55df41c72350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:47.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.744+0000 7f55167fc640 10 client.16350 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:14:47.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.744+0000 7f552effd640 1 --2- 172.21.15.148:0/196305992 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55df41c6fe90 0x55df41c72350 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de23e9f2171c2bf3 server_cookie=74f370fbe1315d0d in_seq=0 out_seq=0 2024-09-19T07:14:47.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.745+0000 7f55167fc640 1 -- 172.21.15.148:0/196305992 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55df41bc7b90 con 0x55df41c6fe90 2024-09-19T07:14:47.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.745+0000 7f55167fc640 10 client.16350 handle_command_reply: tid=0 2024-09-19T07:14:47.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.745+0000 7f5537757740 1 client.16350 shutdown 2024-09-19T07:14:47.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.745+0000 7f5537757740 1 -- 172.21.15.148:0/196305992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55df41c60240 msgr2=0x55df41c5db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:47.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.745+0000 7f5537757740 1 --2- 172.21.15.148:0/196305992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55df41c60240 0x55df41c5db80 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f5528003bf0 tx=0x7f55280095c0 comp rx=0 tx=0).stop 2024-09-19T07:14:47.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.745+0000 7f5537757740 1 -- 172.21.15.148:0/196305992 shutdown_connections 2024-09-19T07:14:47.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.745+0000 7f5537757740 1 --2- 172.21.15.148:0/196305992 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55df41c6fe90 0x55df41c72350 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:47.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.745+0000 7f5537757740 1 --2- 172.21.15.148:0/196305992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55df41c60240 0x55df41c5db80 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:47.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.745+0000 7f5537757740 1 --2- 172.21.15.148:0/196305992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55df41c55980 0x55df41c5d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:47.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.745+0000 7f5537757740 1 --2- 172.21.15.148:0/196305992 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55df41c55060 0x55df41c5d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:47.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.745+0000 7f55167fc640 0 client.16350 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:14:47.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.745+0000 7f5537757740 1 -- 172.21.15.148:0/196305992 >> 172.21.15.148:0/196305992 conn(0x55df41c515f0 msgr2=0x55df41c57320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:47.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.745+0000 7f5537757740 1 -- 172.21.15.148:0/196305992 shutdown_connections 2024-09-19T07:14:47.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.745+0000 7f5537757740 1 -- 172.21.15.148:0/196305992 wait complete. 2024-09-19T07:14:47.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.745+0000 7f5537757740 20 client.16350 trim_cache size 0 max 16384 2024-09-19T07:14:47.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.762+0000 7f5537757740 1 Processor -- start 2024-09-19T07:14:47.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.762+0000 7f5537757740 1 -- start start 2024-09-19T07:14:47.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.762+0000 7f5537757740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55df41c55060 0x55df41c77c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:47.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.762+0000 7f5537757740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55df41c55980 0x55df41c78160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:47.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.762+0000 7f5537757740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55df41c60240 0x55df41c5a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:47.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.762+0000 7f5537757740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f55301b0150 con 0x55df41c55980 2024-09-19T07:14:47.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.762+0000 7f5537757740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f55301ad9c0 con 0x55df41c60240 2024-09-19T07:14:47.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.762+0000 7f5537757740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f55301ab7f0 con 0x55df41c55060 2024-09-19T07:14:47.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.762+0000 7f55267fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55df41c55980 0x55df41c78160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:47.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.762+0000 7f55267fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55df41c55980 0x55df41c78160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40224/0 (socket says 172.21.15.148:40224) 2024-09-19T07:14:47.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.762+0000 7f55267fc640 1 -- 172.21.15.148:0/3866208619 learned_addr learned my addr 172.21.15.148:0/3866208619 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:14:47.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.762+0000 7f552effd640 1 --2- 172.21.15.148:0/3866208619 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55df41c55060 0x55df41c77c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:47.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.762+0000 7f55267fc640 1 -- 172.21.15.148:0/3866208619 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55df41c55060 msgr2=0x55df41c77c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:47.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.762+0000 7f55267fc640 1 --2- 172.21.15.148:0/3866208619 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55df41c55060 0x55df41c77c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:47.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.762+0000 7f55267fc640 1 -- 172.21.15.148:0/3866208619 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55df41c60240 msgr2=0x55df41c5a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:47.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.762+0000 7f55267fc640 1 --2- 172.21.15.148:0/3866208619 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55df41c60240 0x55df41c5a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:47.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.762+0000 7f55267fc640 1 -- 172.21.15.148:0/3866208619 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df41c51420 con 0x55df41c55980 2024-09-19T07:14:47.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.763+0000 7f55267fc640 1 --2- 172.21.15.148:0/3866208619 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55df41c55980 0x55df41c78160 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x55df41c52970 tx=0x7f5518004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47b082db8bfd7615 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:47.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.763+0000 7f5524ff9640 1 -- 172.21.15.148:0/3866208619 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5518016040 con 0x55df41c55980 2024-09-19T07:14:47.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.763+0000 7f5524ff9640 1 -- 172.21.15.148:0/3866208619 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5518004c00 con 0x55df41c55980 2024-09-19T07:14:47.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.763+0000 7f5524ff9640 1 -- 172.21.15.148:0/3866208619 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5518005000 con 0x55df41c55980 2024-09-19T07:14:47.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.763+0000 7f5537757740 1 -- 172.21.15.148:0/3866208619 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55df41c55980 msgr2=0x55df41c78160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:47.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.763+0000 7f5537757740 1 --2- 172.21.15.148:0/3866208619 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55df41c55980 0x55df41c78160 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x55df41c52970 tx=0x7f5518004af0 comp rx=0 tx=0).stop 2024-09-19T07:14:47.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.764+0000 7f5537757740 1 -- 172.21.15.148:0/3866208619 shutdown_connections 2024-09-19T07:14:47.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.764+0000 7f5537757740 1 --2- 172.21.15.148:0/3866208619 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55df41c60240 0x55df41c5a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:47.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.764+0000 7f5537757740 1 --2- 172.21.15.148:0/3866208619 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55df41c55980 0x55df41c78160 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:47.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.764+0000 7f5537757740 1 --2- 172.21.15.148:0/3866208619 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55df41c55060 0x55df41c77c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:47.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.764+0000 7f5537757740 1 -- 172.21.15.148:0/3866208619 >> 172.21.15.148:0/3866208619 conn(0x55df41c515f0 msgr2=0x55df41c5b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:47.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.764+0000 7f5537757740 1 -- 172.21.15.148:0/3866208619 shutdown_connections 2024-09-19T07:14:47.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.764+0000 7f5537757740 1 -- 172.21.15.148:0/3866208619 wait complete. 2024-09-19T07:14:47.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.764+0000 7f5537757740 1 -- start start 2024-09-19T07:14:47.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.764+0000 7f5537757740 1 Processor -- start 2024-09-19T07:14:47.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.764+0000 7f5537757740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55df41c55060 0x55df41c68860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:47.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.764+0000 7f5537757740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55df41c55980 0x55df41c651b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:47.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.764+0000 7f5537757740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55df41c60240 0x55df41c656f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:47.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.764+0000 7f5537757740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f55301abe80 con 0x55df41c55980 2024-09-19T07:14:47.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.764+0000 7f5537757740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f55301ad2f0 con 0x55df41c55060 2024-09-19T07:14:47.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.764+0000 7f5537757740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f55301ac550 con 0x55df41c60240 2024-09-19T07:14:47.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.764+0000 7f5537757740 10 client.0 _ll_register_callbacks cb 0x7f552802f780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:14:47.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.764+0000 7f55267fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55df41c55980 0x55df41c651b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:47.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.764+0000 7f55267fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55df41c55980 0x55df41c651b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40240/0 (socket says 172.21.15.148:40240) 2024-09-19T07:14:47.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.764+0000 7f55267fc640 1 -- 172.21.15.148:0/1300185782 learned_addr learned my addr 172.21.15.148:0/1300185782 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:14:47.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.764+0000 7f552f7fe640 1 --2- 172.21.15.148:0/1300185782 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55df41c60240 0x55df41c656f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:47.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.764+0000 7f552effd640 1 --2- 172.21.15.148:0/1300185782 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55df41c55060 0x55df41c68860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:47.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.765+0000 7f55267fc640 1 -- 172.21.15.148:0/1300185782 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55df41c60240 msgr2=0x55df41c656f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:47.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.765+0000 7f55267fc640 1 --2- 172.21.15.148:0/1300185782 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55df41c60240 0x55df41c656f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:47.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.765+0000 7f55267fc640 1 -- 172.21.15.148:0/1300185782 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55df41c55060 msgr2=0x55df41c68860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:47.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.765+0000 7f55267fc640 1 --2- 172.21.15.148:0/1300185782 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55df41c55060 0x55df41c68860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:47.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.765+0000 7f55267fc640 1 -- 172.21.15.148:0/1300185782 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df41c65e80 con 0x55df41c55980 2024-09-19T07:14:47.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.765+0000 7f55267fc640 1 --2- 172.21.15.148:0/1300185782 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55df41c55980 0x55df41c651b0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f5518009ac0 tx=0x7f5518005ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac3a4f761f8717f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:47.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.765+0000 7f55167fc640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:14:47.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.765+0000 7f55167fc640 1 -- 172.21.15.148:0/1300185782 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5518032060 con 0x55df41c55980 2024-09-19T07:14:47.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.765+0000 7f55167fc640 1 -- 172.21.15.148:0/1300185782 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f5518004440 con 0x55df41c55980 2024-09-19T07:14:47.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.765+0000 7f5537757740 1 -- 172.21.15.148:0/1300185782 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5518004c00 con 0x55df41c55980 2024-09-19T07:14:47.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.765+0000 7f55167fc640 1 -- 172.21.15.148:0/1300185782 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f5518016040 con 0x55df41c55980 2024-09-19T07:14:47.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.765+0000 7f5537757740 10 client.16356 fetch_fsmap learned FSMap version 33 2024-09-19T07:14:47.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.765+0000 7f5537757740 1 -- 172.21.15.148:0/1300185782 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55df41cdbc10 con 0x55df41c55980 2024-09-19T07:14:47.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.765+0000 7f55167fc640 1 -- 172.21.15.148:0/1300185782 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5518004c00 con 0x55df41c55980 2024-09-19T07:14:47.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.766+0000 7f55167fc640 1 -- 172.21.15.148:0/1300185782 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 33) ==== 8362+0+0 (secure 0 0 0) 0x7f551800f040 con 0x55df41c55980 2024-09-19T07:14:47.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.766+0000 7f5537757740 10 client.16356 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T07:14:47.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.766+0000 7f5537757740 10 client.16356 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:14:47.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.766+0000 7f5537757740 20 client.16356 populate_metadata read hostname 'smithi148' 2024-09-19T07:14:47.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.766+0000 7f5537757740 1 --2- 172.21.15.148:0/1300185782 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55df41cdc0b0 0x55df41cde4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:47.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.766+0000 7f5537757740 4 client.16356 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "5545af34", "release": true, "await": true}] 2024-09-19T07:14:47.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.766+0000 7f5537757740 1 -- 172.21.15.148:0/1300185782 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "quiesce db", "set_id": "5545af34", "release": true, "await": true}) -- 0x55df41bc20a0 con 0x55df41cdc0b0 2024-09-19T07:14:47.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.766+0000 7f552effd640 1 --2- 172.21.15.148:0/1300185782 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55df41cdc0b0 0x55df41cde4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:47.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.766+0000 7f552effd640 1 --2- 172.21.15.148:0/1300185782 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55df41cdc0b0 0x55df41cde4d0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=310ef5dad622d7ed server_cookie=c091ac6cb55ab2e1 in_seq=0 out_seq=0 2024-09-19T07:14:47.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:47.766+0000 7f55167fc640 10 client.16356 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:14:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.040+0000 7fed45326640 1 -- 172.21.15.148:0/538475700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed40101390 msgr2=0x7fed4010d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.040+0000 7fed45326640 1 --2- 172.21.15.148:0/538475700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed40101390 0x7fed4010d8c0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fed38009cd0 tx=0x7fed3802a8e0 comp rx=0 tx=0).stop 2024-09-19T07:14:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.040+0000 7fed45326640 1 -- 172.21.15.148:0/538475700 shutdown_connections 2024-09-19T07:14:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.040+0000 7fed45326640 1 --2- 172.21.15.148:0/538475700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed40101390 0x7fed4010d8c0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.040+0000 7fed45326640 1 --2- 172.21.15.148:0/538475700 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed401009f0 0x7fed40100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:48.045 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.040+0000 7fed45326640 1 --2- 172.21.15.148:0/538475700 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fed40106a00 0x7fed40106de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:48.045 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.040+0000 7fed45326640 1 -- 172.21.15.148:0/538475700 >> 172.21.15.148:0/538475700 conn(0x7fed400fc6b0 msgr2=0x7fed400fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:48.045 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.040+0000 7fed45326640 1 -- 172.21.15.148:0/538475700 shutdown_connections 2024-09-19T07:14:48.045 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.040+0000 7fed45326640 1 -- 172.21.15.148:0/538475700 wait complete. 2024-09-19T07:14:48.045 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.041+0000 7fed45326640 1 Processor -- start 2024-09-19T07:14:48.045 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.041+0000 7fed45326640 1 -- start start 2024-09-19T07:14:48.045 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.041+0000 7fed45326640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed401009f0 0x7fed401991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:48.045 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.041+0000 7fed45326640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fed40101390 0x7fed401996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:48.045 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.041+0000 7fed45326640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed40106a00 0x7fed401a4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:48.045 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.041+0000 7fed45326640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fed40110e40 con 0x7fed401009f0 2024-09-19T07:14:48.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.041+0000 7fed45326640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fed40110cc0 con 0x7fed40101390 2024-09-19T07:14:48.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.041+0000 7fed45326640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fed40110fc0 con 0x7fed40106a00 2024-09-19T07:14:48.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.041+0000 7fed3effd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed401009f0 0x7fed401991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:48.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.041+0000 7fed3effd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed401009f0 0x7fed401991b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40258/0 (socket says 172.21.15.148:40258) 2024-09-19T07:14:48.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.041+0000 7fed3effd640 1 -- 172.21.15.148:0/2178986042 learned_addr learned my addr 172.21.15.148:0/2178986042 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:14:48.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.041+0000 7fed3f7fe640 1 --2- 172.21.15.148:0/2178986042 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed40106a00 0x7fed401a4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:48.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.041+0000 7fed3e7fc640 1 --2- 172.21.15.148:0/2178986042 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fed40101390 0x7fed401996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:48.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.041+0000 7fed3effd640 1 -- 172.21.15.148:0/2178986042 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed40106a00 msgr2=0x7fed401a4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:48.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.041+0000 7fed3effd640 1 --2- 172.21.15.148:0/2178986042 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed40106a00 0x7fed401a4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:48.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.041+0000 7fed3effd640 1 -- 172.21.15.148:0/2178986042 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fed40101390 msgr2=0x7fed401996f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:48.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.041+0000 7fed3effd640 1 --2- 172.21.15.148:0/2178986042 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fed40101390 0x7fed401996f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:48.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.041+0000 7fed3effd640 1 -- 172.21.15.148:0/2178986042 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed401a4770 con 0x7fed401009f0 2024-09-19T07:14:48.047 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.042+0000 7fed3effd640 1 --2- 172.21.15.148:0/2178986042 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed401009f0 0x7fed401991b0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fed3000e9f0 tx=0x7fed3000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:48.047 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.042+0000 7fed27fff640 1 -- 172.21.15.148:0/2178986042 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed3000cd80 con 0x7fed401009f0 2024-09-19T07:14:48.047 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.042+0000 7fed27fff640 1 -- 172.21.15.148:0/2178986042 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed30010910 con 0x7fed401009f0 2024-09-19T07:14:48.047 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.042+0000 7fed45326640 1 -- 172.21.15.148:0/2178986042 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed401a4940 con 0x7fed401009f0 2024-09-19T07:14:48.047 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.042+0000 7fed27fff640 1 -- 172.21.15.148:0/2178986042 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed30018990 con 0x7fed401009f0 2024-09-19T07:14:48.047 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.042+0000 7fed45326640 1 -- 172.21.15.148:0/2178986042 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed401a4e60 con 0x7fed401009f0 2024-09-19T07:14:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.044+0000 7fed27fff640 1 -- 172.21.15.148:0/2178986042 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fed30010ac0 con 0x7fed401009f0 2024-09-19T07:14:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.044+0000 7fed480b8740 1 Processor -- start 2024-09-19T07:14:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.045+0000 7fed480b8740 1 -- start start 2024-09-19T07:14:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.045+0000 7fed480b8740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555f77ce29b0 0x555f77ce2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.045+0000 7fed480b8740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555f77ce32d0 0x555f77cf1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:48.054 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.045+0000 7fed480b8740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555f77cf20c0 0x555f77cf44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:48.054 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.045+0000 7fed480b8740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x555f77c472f0 con 0x555f77ce32d0 2024-09-19T07:14:48.054 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.045+0000 7fed480b8740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x555f77bef270 con 0x555f77ce29b0 2024-09-19T07:14:48.054 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.045+0000 7fed480b8740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x555f77c432b0 con 0x555f77cf20c0 2024-09-19T07:14:48.054 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.045+0000 7fed3effd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555f77ce32d0 0x555f77cf1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:48.054 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.045+0000 7fed3f7fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555f77ce29b0 0x555f77ce2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:48.054 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.045+0000 7fed3e7fc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555f77cf20c0 0x555f77cf44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:48.054 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.045+0000 7fed3effd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555f77ce32d0 0x555f77cf1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40270/0 (socket says 172.21.15.148:40270) 2024-09-19T07:14:48.054 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.045+0000 7fed3effd640 1 -- 172.21.15.148:0/2383580859 learned_addr learned my addr 172.21.15.148:0/2383580859 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:14:48.054 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.045+0000 7fed27fff640 1 --2- 172.21.15.148:0/2178986042 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fed280a3460 0x7fed280a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:48.054 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.045+0000 7fed3f7fe640 1 --2- 172.21.15.148:0/2178986042 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fed280a3460 0x7fed280a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:48.054 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.045+0000 7fed3e7fc640 1 -- 172.21.15.148:0/2383580859 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555f77ce29b0 msgr2=0x555f77ce2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.045+0000 7fed3e7fc640 1 --2- 172.21.15.148:0/2383580859 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555f77ce29b0 0x555f77ce2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.045+0000 7fed3e7fc640 1 -- 172.21.15.148:0/2383580859 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555f77ce32d0 msgr2=0x555f77cf1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.045+0000 7fed3e7fc640 1 --2- 172.21.15.148:0/2383580859 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555f77ce32d0 0x555f77cf1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.045+0000 7fed3e7fc640 1 -- 172.21.15.148:0/2383580859 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f77bee340 con 0x555f77cf20c0 2024-09-19T07:14:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.045+0000 7fed3effd640 1 --2- 172.21.15.148:0/2383580859 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555f77ce32d0 0x555f77cf1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:14:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.045+0000 7fed27fff640 1 -- 172.21.15.148:0/2178986042 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fed300cff80 con 0x7fed401009f0 2024-09-19T07:14:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.046+0000 7fed3e7fc640 1 --2- 172.21.15.148:0/2383580859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555f77cf20c0 0x555f77cf44b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fed34009bd0 tx=0x7fed34011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b97e85b15d008d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.046+0000 7fed3f7fe640 1 --2- 172.21.15.148:0/2178986042 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fed280a3460 0x7fed280a5920 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fed38004ab0 tx=0x7fed3802a8e0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.046+0000 7fed257fa640 1 -- 172.21.15.148:0/2383580859 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed34004230 con 0x555f77cf20c0 2024-09-19T07:14:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.046+0000 7fed257fa640 1 -- 172.21.15.148:0/2383580859 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed34009e40 con 0x555f77cf20c0 2024-09-19T07:14:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.046+0000 7fed257fa640 1 -- 172.21.15.148:0/2383580859 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed34004d10 con 0x555f77cf20c0 2024-09-19T07:14:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.046+0000 7fed480b8740 1 -- 172.21.15.148:0/2383580859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555f77cf20c0 msgr2=0x555f77cf44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:48.056 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.046+0000 7fed480b8740 1 --2- 172.21.15.148:0/2383580859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555f77cf20c0 0x555f77cf44b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fed34009bd0 tx=0x7fed34011810 comp rx=0 tx=0).stop 2024-09-19T07:14:48.056 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.046+0000 7fed480b8740 1 -- 172.21.15.148:0/2383580859 shutdown_connections 2024-09-19T07:14:48.056 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.046+0000 7fed480b8740 1 --2- 172.21.15.148:0/2383580859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555f77cf20c0 0x555f77cf44b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:48.056 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.046+0000 7fed480b8740 1 --2- 172.21.15.148:0/2383580859 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555f77ce32d0 0x555f77cf1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:48.056 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.046+0000 7fed480b8740 1 --2- 172.21.15.148:0/2383580859 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555f77ce29b0 0x555f77ce2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:48.056 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.046+0000 7fed480b8740 1 -- 172.21.15.148:0/2383580859 >> 172.21.15.148:0/2383580859 conn(0x555f77cdf060 msgr2=0x555f77cdf440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:48.056 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.046+0000 7fed480b8740 1 -- 172.21.15.148:0/2383580859 shutdown_connections 2024-09-19T07:14:48.056 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.047+0000 7fed480b8740 1 -- 172.21.15.148:0/2383580859 wait complete. 2024-09-19T07:14:48.056 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.047+0000 7fed480b8740 1 -- start start 2024-09-19T07:14:48.056 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.047+0000 7fed480b8740 1 Processor -- start 2024-09-19T07:14:48.056 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.047+0000 7fed480b8740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555f77ce29b0 0x555f77ceefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:48.056 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.047+0000 7fed480b8740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555f77ce32d0 0x555f77cef510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:48.056 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.047+0000 7fed480b8740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555f77cf20c0 0x555f77cefa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:48.057 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.047+0000 7fed480b8740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x555f77cf4c90 con 0x555f77ce29b0 2024-09-19T07:14:48.057 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.047+0000 7fed480b8740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x555f77bd0290 con 0x555f77cf20c0 2024-09-19T07:14:48.057 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.047+0000 7fed480b8740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x555f77cf4e10 con 0x555f77ce32d0 2024-09-19T07:14:48.057 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.047+0000 7fed480b8740 10 client.0 _ll_register_callbacks cb 0x555f77c01140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:14:48.057 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.047+0000 7fed3effd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555f77ce29b0 0x555f77ceefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:48.057 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.047+0000 7fed3effd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555f77ce29b0 0x555f77ceefd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40280/0 (socket says 172.21.15.148:40280) 2024-09-19T07:14:48.057 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.047+0000 7fed3effd640 1 -- 172.21.15.148:0/2929456651 learned_addr learned my addr 172.21.15.148:0/2929456651 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:14:48.057 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.047+0000 7fed3e7fc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555f77ce32d0 0x555f77cef510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:48.057 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.047+0000 7fed3f7fe640 1 --2- 172.21.15.148:0/2929456651 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555f77cf20c0 0x555f77cefa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:48.057 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.048+0000 7fed3effd640 1 -- 172.21.15.148:0/2929456651 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555f77ce32d0 msgr2=0x555f77cef510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:48.057 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.048+0000 7fed3effd640 1 --2- 172.21.15.148:0/2929456651 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555f77ce32d0 0x555f77cef510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:48.057 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.048+0000 7fed3effd640 1 -- 172.21.15.148:0/2929456651 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555f77cf20c0 msgr2=0x555f77cefa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:48.057 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.048+0000 7fed3effd640 1 --2- 172.21.15.148:0/2929456651 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555f77cf20c0 0x555f77cefa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:48.058 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.048+0000 7fed3effd640 1 -- 172.21.15.148:0/2929456651 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f7795a210 con 0x555f77ce29b0 2024-09-19T07:14:48.058 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.048+0000 7fed3e7fc640 1 --2- 172.21.15.148:0/2929456651 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555f77ce32d0 0x555f77cef510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:14:48.058 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.048+0000 7fed3effd640 1 --2- 172.21.15.148:0/2929456651 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555f77ce29b0 0x555f77ceefd0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fed30018460 tx=0x7fed300d35e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a04125a5a925c78 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:48.058 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.048+0000 7fed22ff5640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:14:48.058 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.048+0000 7fed22ff5640 1 -- 172.21.15.148:0/2929456651 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed300cdb70 con 0x555f77ce29b0 2024-09-19T07:14:48.058 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.048+0000 7fed22ff5640 1 -- 172.21.15.148:0/2929456651 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fed300bc2b0 con 0x555f77ce29b0 2024-09-19T07:14:48.058 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.048+0000 7fed480b8740 1 -- 172.21.15.148:0/2929456651 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555f77c54a20 con 0x555f77ce29b0 2024-09-19T07:14:48.058 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.048+0000 7fed22ff5640 1 -- 172.21.15.148:0/2929456651 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fed300b5050 con 0x555f77ce29b0 2024-09-19T07:14:48.058 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.048+0000 7fed480b8740 10 client.16368 fetch_fsmap learned FSMap version 33 2024-09-19T07:14:48.058 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.048+0000 7fed480b8740 1 -- 172.21.15.148:0/2929456651 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x555f77a26620 con 0x555f77ce29b0 2024-09-19T07:14:48.058 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.048+0000 7fed22ff5640 1 -- 172.21.15.148:0/2929456651 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x555f77c54a20 con 0x555f77ce29b0 2024-09-19T07:14:48.058 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.048+0000 7fed22ff5640 1 -- 172.21.15.148:0/2929456651 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 33) ==== 8362+0+0 (secure 0 0 0) 0x7fed3009b770 con 0x555f77ce29b0 2024-09-19T07:14:48.058 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.048+0000 7fed480b8740 10 client.16368 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T07:14:48.059 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.048+0000 7fed480b8740 10 client.16368 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:14:48.059 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.048+0000 7fed480b8740 20 client.16368 populate_metadata read hostname 'smithi148' 2024-09-19T07:14:48.059 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.048+0000 7fed480b8740 1 --2- 172.21.15.148:0/2929456651 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x555f77d02070 0x555f77d04460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:48.059 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.048+0000 7fed480b8740 4 client.16368 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:14:48.059 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.048+0000 7fed480b8740 1 -- 172.21.15.148:0/2929456651 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555f77c4ed70 con 0x555f77d02070 2024-09-19T07:14:48.059 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.049+0000 7fed3e7fc640 1 --2- 172.21.15.148:0/2929456651 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x555f77d02070 0x555f77d04460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:48.059 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.049+0000 7fed3e7fc640 1 --2- 172.21.15.148:0/2929456651 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x555f77d02070 0x555f77d04460 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=213a4c3eefdeaaf2 server_cookie=d94005750f4fe227 in_seq=0 out_seq=0 2024-09-19T07:14:48.059 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.049+0000 7fed22ff5640 10 client.16368 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:14:48.059 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.050+0000 7fed22ff5640 1 -- 172.21.15.148:0/2929456651 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555f77c4ed70 con 0x555f77d02070 2024-09-19T07:14:48.059 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.050+0000 7fed22ff5640 10 client.16368 handle_command_reply: tid=0 2024-09-19T07:14:48.059 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.050+0000 7fed480b8740 1 client.16368 shutdown 2024-09-19T07:14:48.059 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.050+0000 7fed480b8740 1 -- 172.21.15.148:0/2929456651 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555f77ce29b0 msgr2=0x555f77ceefd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:48.059 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.050+0000 7fed480b8740 1 --2- 172.21.15.148:0/2929456651 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555f77ce29b0 0x555f77ceefd0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fed30018460 tx=0x7fed300d35e0 comp rx=0 tx=0).stop 2024-09-19T07:14:48.060 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.050+0000 7fed480b8740 1 -- 172.21.15.148:0/2929456651 shutdown_connections 2024-09-19T07:14:48.060 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.050+0000 7fed480b8740 1 --2- 172.21.15.148:0/2929456651 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x555f77d02070 0x555f77d04460 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:48.060 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.050+0000 7fed480b8740 1 --2- 172.21.15.148:0/2929456651 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555f77cf20c0 0x555f77cefa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:48.060 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.050+0000 7fed480b8740 1 --2- 172.21.15.148:0/2929456651 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555f77ce32d0 0x555f77cef510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:48.060 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.050+0000 7fed480b8740 1 --2- 172.21.15.148:0/2929456651 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555f77ce29b0 0x555f77ceefd0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:48.060 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.050+0000 7fed22ff5640 0 client.16368 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:14:48.060 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.050+0000 7fed480b8740 1 -- 172.21.15.148:0/2929456651 >> 172.21.15.148:0/2929456651 conn(0x555f77cdf060 msgr2=0x555f77ce4d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:48.060 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.050+0000 7fed480b8740 1 -- 172.21.15.148:0/2929456651 shutdown_connections 2024-09-19T07:14:48.060 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.050+0000 7fed480b8740 1 -- 172.21.15.148:0/2929456651 wait complete. 2024-09-19T07:14:48.061 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.050+0000 7fed480b8740 20 client.16368 trim_cache size 0 max 16384 2024-09-19T07:14:48.068 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.065+0000 7fed480b8740 1 Processor -- start 2024-09-19T07:14:48.068 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.065+0000 7fed480b8740 1 -- start start 2024-09-19T07:14:48.068 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.065+0000 7fed480b8740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555f77ce29b0 0x555f77cf0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:48.069 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.065+0000 7fed480b8740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555f77ce32d0 0x555f77d09d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:48.069 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.065+0000 7fed480b8740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555f77cf20c0 0x555f77d0a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:48.069 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.065+0000 7fed480b8740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fed401adf40 con 0x555f77ce32d0 2024-09-19T07:14:48.069 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.065+0000 7fed480b8740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fed401ab7b0 con 0x555f77cf20c0 2024-09-19T07:14:48.069 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.065+0000 7fed480b8740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fed401a9600 con 0x555f77ce29b0 2024-09-19T07:14:48.069 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.065+0000 7fed3e7fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555f77ce32d0 0x555f77d09d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:48.069 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.065+0000 7fed3e7fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555f77ce32d0 0x555f77d09d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40296/0 (socket says 172.21.15.148:40296) 2024-09-19T07:14:48.069 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.065+0000 7fed3e7fc640 1 -- 172.21.15.148:0/2938663955 learned_addr learned my addr 172.21.15.148:0/2938663955 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:14:48.069 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.065+0000 7fed3effd640 1 --2- 172.21.15.148:0/2938663955 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555f77ce29b0 0x555f77cf0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:48.069 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.065+0000 7fed3f7fe640 1 --2- 172.21.15.148:0/2938663955 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555f77cf20c0 0x555f77d0a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:48.069 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.065+0000 7fed3e7fc640 1 -- 172.21.15.148:0/2938663955 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555f77ce29b0 msgr2=0x555f77cf0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:48.069 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.065+0000 7fed3e7fc640 1 --2- 172.21.15.148:0/2938663955 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555f77ce29b0 0x555f77cf0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:48.069 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.065+0000 7fed3e7fc640 1 -- 172.21.15.148:0/2938663955 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555f77cf20c0 msgr2=0x555f77d0a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:48.070 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.065+0000 7fed3e7fc640 1 --2- 172.21.15.148:0/2938663955 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555f77cf20c0 0x555f77d0a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:48.070 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.065+0000 7fed3e7fc640 1 -- 172.21.15.148:0/2938663955 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f77cdfcf0 con 0x555f77ce32d0 2024-09-19T07:14:48.070 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.066+0000 7fed3e7fc640 1 --2- 172.21.15.148:0/2938663955 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555f77ce32d0 0x555f77d09d70 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fed340058c0 tx=0x7fed34005d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4e2029b50acc81f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:48.070 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.066+0000 7fed24ff9640 1 -- 172.21.15.148:0/2938663955 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed3401e040 con 0x555f77ce32d0 2024-09-19T07:14:48.070 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.066+0000 7fed24ff9640 1 -- 172.21.15.148:0/2938663955 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed34004050 con 0x555f77ce32d0 2024-09-19T07:14:48.070 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.066+0000 7fed24ff9640 1 -- 172.21.15.148:0/2938663955 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed34003a80 con 0x555f77ce32d0 2024-09-19T07:14:48.070 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.066+0000 7fed480b8740 1 -- 172.21.15.148:0/2938663955 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555f77ce32d0 msgr2=0x555f77d09d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:48.070 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.066+0000 7fed480b8740 1 --2- 172.21.15.148:0/2938663955 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555f77ce32d0 0x555f77d09d70 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fed340058c0 tx=0x7fed34005d70 comp rx=0 tx=0).stop 2024-09-19T07:14:48.070 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.066+0000 7fed480b8740 1 -- 172.21.15.148:0/2938663955 shutdown_connections 2024-09-19T07:14:48.070 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.066+0000 7fed480b8740 1 --2- 172.21.15.148:0/2938663955 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555f77cf20c0 0x555f77d0a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:48.070 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.066+0000 7fed480b8740 1 --2- 172.21.15.148:0/2938663955 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555f77ce32d0 0x555f77d09d70 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:48.070 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.066+0000 7fed480b8740 1 --2- 172.21.15.148:0/2938663955 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555f77ce29b0 0x555f77cf0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:48.071 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.066+0000 7fed480b8740 1 -- 172.21.15.148:0/2938663955 >> 172.21.15.148:0/2938663955 conn(0x555f77cdf060 msgr2=0x555f77cf0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:48.071 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.066+0000 7fed480b8740 1 -- 172.21.15.148:0/2938663955 shutdown_connections 2024-09-19T07:14:48.071 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.066+0000 7fed480b8740 1 -- 172.21.15.148:0/2938663955 wait complete. 2024-09-19T07:14:48.071 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.067+0000 7fed480b8740 1 -- start start 2024-09-19T07:14:48.071 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.067+0000 7fed480b8740 1 Processor -- start 2024-09-19T07:14:48.073 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.067+0000 7fed480b8740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555f77ce29b0 0x555f77cfa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:48.074 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.067+0000 7fed480b8740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555f77ce32d0 0x555f77cf57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:48.074 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.067+0000 7fed480b8740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555f77cf20c0 0x555f77cf5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:48.074 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.067+0000 7fed480b8740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fed401a9c70 con 0x555f77cf20c0 2024-09-19T07:14:48.074 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.067+0000 7fed480b8740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fed401ab0e0 con 0x555f77ce29b0 2024-09-19T07:14:48.074 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.067+0000 7fed480b8740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fed401aa340 con 0x555f77ce32d0 2024-09-19T07:14:48.074 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.067+0000 7fed480b8740 10 client.0 _ll_register_callbacks cb 0x7fed3000e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:14:48.074 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.067+0000 7fed3f7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555f77cf20c0 0x555f77cf5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:48.074 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.067+0000 7fed3effd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555f77ce29b0 0x555f77cfa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:48.074 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.067+0000 7fed3f7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555f77cf20c0 0x555f77cf5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40306/0 (socket says 172.21.15.148:40306) 2024-09-19T07:14:48.074 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.067+0000 7fed3f7fe640 1 -- 172.21.15.148:0/63340002 learned_addr learned my addr 172.21.15.148:0/63340002 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:14:48.074 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.067+0000 7fed3e7fc640 1 --2- 172.21.15.148:0/63340002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555f77ce32d0 0x555f77cf57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:48.074 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.067+0000 7fed3f7fe640 1 -- 172.21.15.148:0/63340002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555f77ce32d0 msgr2=0x555f77cf57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:48.075 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.067+0000 7fed3f7fe640 1 --2- 172.21.15.148:0/63340002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555f77ce32d0 0x555f77cf57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:48.075 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.067+0000 7fed3f7fe640 1 -- 172.21.15.148:0/63340002 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555f77ce29b0 msgr2=0x555f77cfa4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:14:48.075 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.067+0000 7fed3f7fe640 1 --2- 172.21.15.148:0/63340002 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555f77ce29b0 0x555f77cfa4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:48.075 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.067+0000 7fed3f7fe640 1 -- 172.21.15.148:0/63340002 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f77ce9d50 con 0x555f77cf20c0 2024-09-19T07:14:48.075 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.068+0000 7fed3f7fe640 1 --2- 172.21.15.148:0/63340002 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555f77cf20c0 0x555f77cf5d30 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fed38009cd0 tx=0x7fed380095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63b97197b8bd0ad4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:48.075 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.068+0000 7fed22ff5640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:14:48.075 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.068+0000 7fed22ff5640 1 -- 172.21.15.148:0/63340002 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed380305a0 con 0x555f77cf20c0 2024-09-19T07:14:48.075 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.068+0000 7fed22ff5640 1 -- 172.21.15.148:0/63340002 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fed38030740 con 0x555f77cf20c0 2024-09-19T07:14:48.075 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.068+0000 7fed480b8740 1 -- 172.21.15.148:0/63340002 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed34004050 con 0x555f77cf20c0 2024-09-19T07:14:48.075 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.068+0000 7fed22ff5640 1 -- 172.21.15.148:0/63340002 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fed38004b40 con 0x555f77cf20c0 2024-09-19T07:14:48.075 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.068+0000 7fed480b8740 10 client.16374 fetch_fsmap learned FSMap version 33 2024-09-19T07:14:48.075 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.068+0000 7fed480b8740 1 -- 172.21.15.148:0/63340002 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x555f77d6c830 con 0x555f77cf20c0 2024-09-19T07:14:48.075 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.068+0000 7fed22ff5640 1 -- 172.21.15.148:0/63340002 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed34004050 con 0x555f77cf20c0 2024-09-19T07:14:48.076 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.068+0000 7fed22ff5640 1 -- 172.21.15.148:0/63340002 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 33) ==== 8362+0+0 (secure 0 0 0) 0x7fed38030070 con 0x555f77cf20c0 2024-09-19T07:14:48.076 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.068+0000 7fed480b8740 10 client.16374 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T07:14:48.076 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.068+0000 7fed480b8740 10 client.16374 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:14:48.076 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.068+0000 7fed480b8740 20 client.16374 populate_metadata read hostname 'smithi148' 2024-09-19T07:14:48.076 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.068+0000 7fed480b8740 1 --2- 172.21.15.148:0/63340002 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x555f77d6d010 0x555f77d6f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:48.076 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.068+0000 7fed480b8740 4 client.16374 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:14:48.076 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.068+0000 7fed480b8740 1 -- 172.21.15.148:0/63340002 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555f77bcb900 con 0x555f77d6d010 2024-09-19T07:14:48.076 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.068+0000 7fed3effd640 1 --2- 172.21.15.148:0/63340002 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x555f77d6d010 0x555f77d6f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:48.076 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.069+0000 7fed22ff5640 10 client.16374 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:14:48.076 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.069+0000 7fed3effd640 1 --2- 172.21.15.148:0/63340002 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x555f77d6d010 0x555f77d6f430 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3fb30fed0ae9e7cb server_cookie=79505f69321055ae in_seq=0 out_seq=0 2024-09-19T07:14:48.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:48.260+0000 7f55167fc640 1 -- 172.21.15.148:0/1300185782 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55df41bc20a0 con 0x55df41cdc0b0 2024-09-19T07:14:48.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:48.260+0000 7f55167fc640 10 client.16356 handle_command_reply: tid=0 2024-09-19T07:14:48.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:48.260+0000 7f5537757740 1 client.16356 shutdown 2024-09-19T07:14:48.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:48.261+0000 7f5537757740 1 -- 172.21.15.148:0/1300185782 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55df41c55980 msgr2=0x55df41c651b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:48.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:48.261+0000 7f5537757740 1 --2- 172.21.15.148:0/1300185782 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55df41c55980 0x55df41c651b0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f5518009ac0 tx=0x7f5518005ae0 comp rx=0 tx=0).stop 2024-09-19T07:14:48.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:48.261+0000 7f5537757740 1 -- 172.21.15.148:0/1300185782 shutdown_connections 2024-09-19T07:14:48.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:48.261+0000 7f5537757740 1 --2- 172.21.15.148:0/1300185782 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55df41cdc0b0 0x55df41cde4d0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:48.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:48.261+0000 7f5537757740 1 --2- 172.21.15.148:0/1300185782 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55df41c60240 0x55df41c656f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:48.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:48.261+0000 7f5537757740 1 --2- 172.21.15.148:0/1300185782 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55df41c55980 0x55df41c651b0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:48.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:48.261+0000 7f5537757740 1 --2- 172.21.15.148:0/1300185782 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55df41c55060 0x55df41c68860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:48.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:48.261+0000 7f5537757740 1 -- 172.21.15.148:0/1300185782 >> 172.21.15.148:0/1300185782 conn(0x55df41c515f0 msgr2=0x55df41c5d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:48.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:48.262+0000 7f55167fc640 0 client.16356 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:14:48.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:48.262+0000 7f5537757740 1 -- 172.21.15.148:0/1300185782 shutdown_connections 2024-09-19T07:14:48.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:48.262+0000 7f5537757740 1 -- 172.21.15.148:0/1300185782 wait complete. 2024-09-19T07:14:48.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:48.262+0000 7f5537757740 20 client.16356 trim_cache size 0 max 16384 2024-09-19T07:14:48.265 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:14:48.265 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 33, 2024-09-19T07:14:48.265 INFO:teuthology.orchestra.run.smithi148.stdout: "leader": 24457, 2024-09-19T07:14:48.265 INFO:teuthology.orchestra.run.smithi148.stdout: "set_version": 16, 2024-09-19T07:14:48.265 INFO:teuthology.orchestra.run.smithi148.stdout: "sets": { 2024-09-19T07:14:48.265 INFO:teuthology.orchestra.run.smithi148.stdout: "5545af34": { 2024-09-19T07:14:48.265 INFO:teuthology.orchestra.run.smithi148.stdout: "version": 16, 2024-09-19T07:14:48.265 INFO:teuthology.orchestra.run.smithi148.stdout: "age_ref": 0.0, 2024-09-19T07:14:48.265 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:14:48.266 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RELEASED", 2024-09-19T07:14:48.266 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:14:48.266 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:14:48.266 INFO:teuthology.orchestra.run.smithi148.stdout: "timeout": 90.0, 2024-09-19T07:14:48.266 INFO:teuthology.orchestra.run.smithi148.stdout: "expiration": 136.6, 2024-09-19T07:14:48.266 INFO:teuthology.orchestra.run.smithi148.stdout: "members": { 2024-09-19T07:14:48.266 INFO:teuthology.orchestra.run.smithi148.stdout: "file:/": { 2024-09-19T07:14:48.266 INFO:teuthology.orchestra.run.smithi148.stdout: "excluded": false, 2024-09-19T07:14:48.266 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:14:48.266 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RELEASED", 2024-09-19T07:14:48.266 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:14:48.266 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:14:48.266 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:14:48.266 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:14:48.267 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:14:48.267 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:14:48.267 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:14:48.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:48.265+0000 7f553537e640 1 -- 172.21.15.148:0/628962309 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f551c0a33b0 msgr2=0x7f551c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:48.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:48.265+0000 7f553537e640 1 --2- 172.21.15.148:0/628962309 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f551c0a33b0 0x7f551c0a5870 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5528005fc0 tx=0x7f552802a950 comp rx=0 tx=0).stop 2024-09-19T07:14:48.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:48.265+0000 7f553537e640 1 -- 172.21.15.148:0/628962309 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5530100e20 msgr2=0x7f55301984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:48.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:48.265+0000 7f553537e640 1 --2- 172.21.15.148:0/628962309 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5530100e20 0x7f55301984b0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f552000d950 tx=0x7f552000de10 comp rx=0 tx=0).stop 2024-09-19T07:14:48.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:48.265+0000 7f553537e640 1 -- 172.21.15.148:0/628962309 shutdown_connections 2024-09-19T07:14:48.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:48.265+0000 7f553537e640 1 --2- 172.21.15.148:0/628962309 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f551c0a33b0 0x7f551c0a5870 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:48.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:48.265+0000 7f553537e640 1 --2- 172.21.15.148:0/628962309 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5530102ef0 0x7f553019cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:48.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:48.265+0000 7f553537e640 1 --2- 172.21.15.148:0/628962309 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5530102570 0x7f55301989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:48.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:48.265+0000 7f553537e640 1 --2- 172.21.15.148:0/628962309 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5530100e20 0x7f55301984b0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:48.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:48.265+0000 7f553537e640 1 -- 172.21.15.148:0/628962309 >> 172.21.15.148:0/628962309 conn(0x7f55300fc7d0 msgr2=0x7f553006a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:48.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:48.266+0000 7f553537e640 1 -- 172.21.15.148:0/628962309 shutdown_connections 2024-09-19T07:14:48.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:14:48.267+0000 7f553537e640 1 -- 172.21.15.148:0/628962309 wait complete. 2024-09-19T07:14:48.839 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.837+0000 7fed22ff5640 1 -- 172.21.15.148:0/63340002 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555f77bcb900 con 0x555f77d6d010 2024-09-19T07:14:48.839 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.837+0000 7fed22ff5640 10 client.16374 handle_command_reply: tid=0 2024-09-19T07:14:48.839 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.837+0000 7fed480b8740 1 client.16374 shutdown 2024-09-19T07:14:48.839 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.837+0000 7fed480b8740 1 -- 172.21.15.148:0/63340002 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555f77cf20c0 msgr2=0x555f77cf5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:48.839 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.837+0000 7fed480b8740 1 --2- 172.21.15.148:0/63340002 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555f77cf20c0 0x555f77cf5d30 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fed38009cd0 tx=0x7fed380095c0 comp rx=0 tx=0).stop 2024-09-19T07:14:48.839 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.837+0000 7fed480b8740 1 -- 172.21.15.148:0/63340002 shutdown_connections 2024-09-19T07:14:48.839 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.837+0000 7fed480b8740 1 --2- 172.21.15.148:0/63340002 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x555f77d6d010 0x555f77d6f430 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:48.839 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.837+0000 7fed480b8740 1 --2- 172.21.15.148:0/63340002 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555f77cf20c0 0x555f77cf5d30 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:48.840 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.837+0000 7fed480b8740 1 --2- 172.21.15.148:0/63340002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555f77ce32d0 0x555f77cf57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:48.840 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.837+0000 7fed480b8740 1 --2- 172.21.15.148:0/63340002 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555f77ce29b0 0x555f77cfa4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:48.840 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.837+0000 7fed480b8740 1 -- 172.21.15.148:0/63340002 >> 172.21.15.148:0/63340002 conn(0x555f77cdf060 msgr2=0x555f77cf1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:48.840 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.837+0000 7fed22ff5640 0 client.16374 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:14:48.840 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.837+0000 7fed480b8740 1 -- 172.21.15.148:0/63340002 shutdown_connections 2024-09-19T07:14:48.840 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.837+0000 7fed480b8740 1 -- 172.21.15.148:0/63340002 wait complete. 2024-09-19T07:14:48.840 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.838+0000 7fed480b8740 20 client.16374 trim_cache size 0 max 16384 2024-09-19T07:14:48.840 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:14:48.840 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:14:48.840 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:14:48.841 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:14:48.841 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.838+0000 7fed45326640 1 -- 172.21.15.148:0/2178986042 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fed280a3460 msgr2=0x7fed280a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:48.841 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.838+0000 7fed45326640 1 --2- 172.21.15.148:0/2178986042 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fed280a3460 0x7fed280a5920 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fed38004ab0 tx=0x7fed3802a8e0 comp rx=0 tx=0).stop 2024-09-19T07:14:48.841 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.838+0000 7fed45326640 1 -- 172.21.15.148:0/2178986042 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed401009f0 msgr2=0x7fed401991b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:48.841 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.838+0000 7fed45326640 1 --2- 172.21.15.148:0/2178986042 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed401009f0 0x7fed401991b0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fed3000e9f0 tx=0x7fed3000eeb0 comp rx=0 tx=0).stop 2024-09-19T07:14:48.842 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.838+0000 7fed45326640 1 -- 172.21.15.148:0/2178986042 shutdown_connections 2024-09-19T07:14:48.842 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.838+0000 7fed45326640 1 --2- 172.21.15.148:0/2178986042 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fed280a3460 0x7fed280a5920 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:48.842 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.838+0000 7fed45326640 1 --2- 172.21.15.148:0/2178986042 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed40106a00 0x7fed401a4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:48.842 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.838+0000 7fed45326640 1 --2- 172.21.15.148:0/2178986042 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fed40101390 0x7fed401996f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:48.842 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.838+0000 7fed45326640 1 --2- 172.21.15.148:0/2178986042 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed401009f0 0x7fed401991b0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:48.842 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.838+0000 7fed45326640 1 -- 172.21.15.148:0/2178986042 >> 172.21.15.148:0/2178986042 conn(0x7fed400fc6b0 msgr2=0x7fed400fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:48.842 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.839+0000 7fed45326640 1 -- 172.21.15.148:0/2178986042 shutdown_connections 2024-09-19T07:14:48.842 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:14:48.839+0000 7fed45326640 1 -- 172.21.15.148:0/2178986042 wait complete. 2024-09-19T07:14:49.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:48 smithi148 ceph-mon[31180]: pgmap v115: 97 pgs: 97 active+clean; 400 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 2.8 MiB/s wr, 488 op/s 2024-09-19T07:14:49.133 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '5545af34', total seconds elapsed: 20.6 2024-09-19T07:14:49.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:48 smithi165 ceph-mon[35326]: pgmap v115: 97 pgs: 97 active+clean; 400 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 2.8 MiB/s wr, 488 op/s 2024-09-19T07:14:49.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:48 smithi179 ceph-mon[35716]: pgmap v115: 97 pgs: 97 active+clean; 400 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 2.8 MiB/s wr, 488 op/s 2024-09-19T07:14:51.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:50 smithi165 ceph-mon[35326]: pgmap v116: 97 pgs: 97 active+clean; 400 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 2.8 MiB/s wr, 488 op/s 2024-09-19T07:14:51.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:50 smithi179 ceph-mon[35716]: pgmap v116: 97 pgs: 97 active+clean; 400 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 2.8 MiB/s wr, 488 op/s 2024-09-19T07:14:51.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:50 smithi148 ceph-mon[31180]: pgmap v116: 97 pgs: 97 active+clean; 400 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 2.8 MiB/s wr, 488 op/s 2024-09-19T07:14:53.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:52 smithi165 ceph-mon[35326]: pgmap v117: 97 pgs: 97 active+clean; 396 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 3.4 MiB/s wr, 558 op/s 2024-09-19T07:14:53.193 INFO:tasks.workunit.client.0.smithi148.stdout: 133 510896 639 343627 716 140394 386 2024-09-19T07:14:53.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:52 smithi179 ceph-mon[35716]: pgmap v117: 97 pgs: 97 active+clean; 396 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 3.4 MiB/s wr, 558 op/s 2024-09-19T07:14:53.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:52 smithi148 ceph-mon[31180]: pgmap v117: 97 pgs: 97 active+clean; 396 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 3.4 MiB/s wr, 558 op/s 2024-09-19T07:14:55.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:54 smithi165 ceph-mon[35326]: pgmap v118: 97 pgs: 97 active+clean; 396 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 1.4 MiB/s wr, 229 op/s 2024-09-19T07:14:55.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:54 smithi179 ceph-mon[35716]: pgmap v118: 97 pgs: 97 active+clean; 396 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 1.4 MiB/s wr, 229 op/s 2024-09-19T07:14:55.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:54 smithi148 ceph-mon[31180]: pgmap v118: 97 pgs: 97 active+clean; 396 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 1.4 MiB/s wr, 229 op/s 2024-09-19T07:14:57.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:56 smithi165 ceph-mon[35326]: pgmap v119: 97 pgs: 97 active+clean; 406 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 2.3 MiB/s wr, 402 op/s 2024-09-19T07:14:57.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:56 smithi179 ceph-mon[35716]: pgmap v119: 97 pgs: 97 active+clean; 406 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 2.3 MiB/s wr, 402 op/s 2024-09-19T07:14:57.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:56 smithi148 ceph-mon[31180]: pgmap v119: 97 pgs: 97 active+clean; 406 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 2.3 MiB/s wr, 402 op/s 2024-09-19T07:14:59.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:14:58 smithi165 ceph-mon[35326]: pgmap v120: 97 pgs: 97 active+clean; 406 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.5 MiB/s wr, 243 op/s 2024-09-19T07:14:59.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:14:58 smithi179 ceph-mon[35716]: pgmap v120: 97 pgs: 97 active+clean; 406 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.5 MiB/s wr, 243 op/s 2024-09-19T07:14:59.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:14:58 smithi148 ceph-mon[31180]: pgmap v120: 97 pgs: 97 active+clean; 406 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.5 MiB/s wr, 243 op/s 2024-09-19T07:15:01.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:15:00 smithi165 ceph-mon[35326]: pgmap v121: 97 pgs: 97 active+clean; 406 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.5 MiB/s wr, 243 op/s 2024-09-19T07:15:01.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:15:00 smithi179 ceph-mon[35716]: pgmap v121: 97 pgs: 97 active+clean; 406 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.5 MiB/s wr, 243 op/s 2024-09-19T07:15:01.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:15:00 smithi148 ceph-mon[31180]: pgmap v121: 97 pgs: 97 active+clean; 406 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.5 MiB/s wr, 243 op/s 2024-09-19T07:15:03.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:15:02 smithi165 ceph-mon[35326]: pgmap v122: 97 pgs: 97 active+clean; 506 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 10 MiB/s wr, 790 op/s 2024-09-19T07:15:03.194 INFO:tasks.workunit.client.0.smithi148.stdout: 160 2242065 1623 1533255 1306 648425 2159 2024-09-19T07:15:03.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:15:02 smithi179 ceph-mon[35716]: pgmap v122: 97 pgs: 97 active+clean; 506 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 10 MiB/s wr, 790 op/s 2024-09-19T07:15:03.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:15:02 smithi148 ceph-mon[31180]: pgmap v122: 97 pgs: 97 active+clean; 506 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 10 MiB/s wr, 790 op/s 2024-09-19T07:15:03.690 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.689+0000 7fc8638a5640 1 -- 172.21.15.148:0/1976024073 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc85c1091f0 msgr2=0x7fc85c109630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:03.690 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.689+0000 7fc8638a5640 1 --2- 172.21.15.148:0/1976024073 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc85c1091f0 0x7fc85c109630 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fc854009be0 tx=0x7fc85402a6d0 comp rx=0 tx=0).stop 2024-09-19T07:15:03.692 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.691+0000 7fc8638a5640 1 -- 172.21.15.148:0/1976024073 shutdown_connections 2024-09-19T07:15:03.692 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.691+0000 7fc8638a5640 1 --2- 172.21.15.148:0/1976024073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc85c109b70 0x7fc85c07ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:03.692 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.691+0000 7fc8638a5640 1 --2- 172.21.15.148:0/1976024073 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc85c1091f0 0x7fc85c109630 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:03.692 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.691+0000 7fc8638a5640 1 --2- 172.21.15.148:0/1976024073 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc85c10d610 0x7fc85c10d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:03.692 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.691+0000 7fc8638a5640 1 -- 172.21.15.148:0/1976024073 >> 172.21.15.148:0/1976024073 conn(0x7fc85c06cc60 msgr2=0x7fc85c06d070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:15:03.693 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.692+0000 7fc8638a5640 1 -- 172.21.15.148:0/1976024073 shutdown_connections 2024-09-19T07:15:03.693 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.692+0000 7fc8638a5640 1 -- 172.21.15.148:0/1976024073 wait complete. 2024-09-19T07:15:03.693 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.693+0000 7fc8638a5640 1 Processor -- start 2024-09-19T07:15:03.693 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.693+0000 7fc8638a5640 1 -- start start 2024-09-19T07:15:03.694 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.693+0000 7fc8638a5640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc85c1091f0 0x7fc85c07a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:03.694 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.693+0000 7fc8638a5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc85c109b70 0x7fc85c075a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:03.694 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.693+0000 7fc8638a5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc85c10d610 0x7fc85c075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:03.694 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.693+0000 7fc8638a5640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc85c07e4b0 con 0x7fc85c109b70 2024-09-19T07:15:03.694 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.693+0000 7fc8638a5640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc85c07e330 con 0x7fc85c1091f0 2024-09-19T07:15:03.695 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.693+0000 7fc8638a5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc85c07e630 con 0x7fc85c10d610 2024-09-19T07:15:03.696 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.693+0000 7fc861641640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc85c1091f0 0x7fc85c07a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:03.696 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.693+0000 7fc860e40640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc85c109b70 0x7fc85c075a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:03.697 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.693+0000 7fc860e40640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc85c109b70 0x7fc85c075a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44398/0 (socket says 172.21.15.148:44398) 2024-09-19T07:15:03.697 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.693+0000 7fc860e40640 1 -- 172.21.15.148:0/118261072 learned_addr learned my addr 172.21.15.148:0/118261072 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:15:03.697 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.694+0000 7fc860e40640 1 -- 172.21.15.148:0/118261072 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc85c10d610 msgr2=0x7fc85c075f90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T07:15:03.697 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.694+0000 7fc860e40640 1 --2- 172.21.15.148:0/118261072 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc85c10d610 0x7fc85c075f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:03.697 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.694+0000 7fc860e40640 1 -- 172.21.15.148:0/118261072 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc85c1091f0 msgr2=0x7fc85c07a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:03.697 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.694+0000 7fc860e40640 1 --2- 172.21.15.148:0/118261072 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc85c1091f0 0x7fc85c07a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:03.697 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.694+0000 7fc860e40640 1 -- 172.21.15.148:0/118261072 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc85c076550 con 0x7fc85c109b70 2024-09-19T07:15:03.697 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.694+0000 7fc860e40640 1 --2- 172.21.15.148:0/118261072 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc85c109b70 0x7fc85c075a50 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fc854030e00 tx=0x7fc854003e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:03.697 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.695+0000 7fc861641640 1 --2- 172.21.15.148:0/118261072 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc85c1091f0 0x7fc85c07a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:15:03.732 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.731+0000 7fc8527fc640 1 -- 172.21.15.148:0/118261072 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc854041020 con 0x7fc85c109b70 2024-09-19T07:15:03.739 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.731+0000 7fc8638a5640 1 -- 172.21.15.148:0/118261072 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc85c0767e0 con 0x7fc85c109b70 2024-09-19T07:15:03.739 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.732+0000 7fc8638a5640 1 -- 172.21.15.148:0/118261072 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc85c1c4a40 con 0x7fc85c109b70 2024-09-19T07:15:03.740 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.739+0000 7fc866646740 1 Processor -- start 2024-09-19T07:15:03.740 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.739+0000 7fc866646740 1 -- start start 2024-09-19T07:15:03.740 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.740+0000 7fc866646740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56325963ecc0 0x56325963f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:03.742 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.740+0000 7fc866646740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56325963f5e0 0x563259649940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:03.742 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.740+0000 7fc866646740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563259649e80 0x56325964c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:03.742 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.740+0000 7fc866646740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5632595a32f0 con 0x563259649e80 2024-09-19T07:15:03.742 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.740+0000 7fc866646740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56325954b270 con 0x56325963f5e0 2024-09-19T07:15:03.742 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.740+0000 7fc866646740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56325959f2b0 con 0x56325963ecc0 2024-09-19T07:15:03.742 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.740+0000 7fc860e40640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563259649e80 0x56325964c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:03.742 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.740+0000 7fc860e40640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563259649e80 0x56325964c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44404/0 (socket says 172.21.15.148:44404) 2024-09-19T07:15:03.742 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.740+0000 7fc860e40640 1 -- 172.21.15.148:0/2557206306 learned_addr learned my addr 172.21.15.148:0/2557206306 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:15:03.742 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.741+0000 7fc860e40640 1 -- 172.21.15.148:0/2557206306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56325963ecc0 msgr2=0x56325963f0a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T07:15:03.742 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.741+0000 7fc860e40640 1 --2- 172.21.15.148:0/2557206306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56325963ecc0 0x56325963f0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:03.742 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.741+0000 7fc860e40640 1 -- 172.21.15.148:0/2557206306 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56325963f5e0 msgr2=0x563259649940 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T07:15:03.742 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.741+0000 7fc860e40640 1 --2- 172.21.15.148:0/2557206306 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56325963f5e0 0x563259649940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:03.743 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.741+0000 7fc860e40640 1 -- 172.21.15.148:0/2557206306 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56325954a340 con 0x563259649e80 2024-09-19T07:15:03.743 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.741+0000 7fc860e40640 1 --2- 172.21.15.148:0/2557206306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563259649e80 0x56325964c270 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fc8540ef5d0 tx=0x7fc8540f8440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc7dc947da5fdbf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:03.748 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.746+0000 7fc8527fc640 1 -- 172.21.15.148:0/118261072 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc854004040 con 0x7fc85c109b70 2024-09-19T07:15:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.748+0000 7fc8527fc640 1 -- 172.21.15.148:0/118261072 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc854036040 con 0x7fc85c109b70 2024-09-19T07:15:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.748+0000 7fc8527fc640 1 -- 172.21.15.148:0/118261072 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fc854044020 con 0x7fc85c109b70 2024-09-19T07:15:03.756 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.756+0000 7fc8527fc640 1 --2- 172.21.15.148:0/118261072 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc8480a3520 0x7fc8480a59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:03.757 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.756+0000 7fc861e42640 1 --2- 172.21.15.148:0/118261072 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc8480a3520 0x7fc8480a59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:03.758 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.757+0000 7fc861e42640 1 --2- 172.21.15.148:0/118261072 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc8480a3520 0x7fc8480a59e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc84c00b910 tx=0x7fc84c00b370 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:03.758 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.757+0000 7fc8527fc640 1 -- 172.21.15.148:0/118261072 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fc8540f1de0 con 0x7fc85c109b70 2024-09-19T07:15:03.768 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.768+0000 7fc8477fe640 1 -- 172.21.15.148:0/2557206306 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8540f80d0 con 0x563259649e80 2024-09-19T07:15:03.769 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.768+0000 7fc8477fe640 1 -- 172.21.15.148:0/2557206306 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8540f8270 con 0x563259649e80 2024-09-19T07:15:03.770 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.769+0000 7fc866646740 1 -- 172.21.15.148:0/2557206306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563259649e80 msgr2=0x56325964c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:03.770 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.770+0000 7fc866646740 1 --2- 172.21.15.148:0/2557206306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563259649e80 0x56325964c270 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fc8540ef5d0 tx=0x7fc8540f8440 comp rx=0 tx=0).stop 2024-09-19T07:15:03.780 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.779+0000 7fc866646740 1 -- 172.21.15.148:0/2557206306 shutdown_connections 2024-09-19T07:15:03.780 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.779+0000 7fc866646740 1 --2- 172.21.15.148:0/2557206306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563259649e80 0x56325964c270 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:03.780 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.779+0000 7fc866646740 1 --2- 172.21.15.148:0/2557206306 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56325963f5e0 0x563259649940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:03.780 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.779+0000 7fc866646740 1 --2- 172.21.15.148:0/2557206306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56325963ecc0 0x56325963f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:03.780 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.779+0000 7fc866646740 1 -- 172.21.15.148:0/2557206306 >> 172.21.15.148:0/2557206306 conn(0x56325963b230 msgr2=0x56325963b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:15:03.783 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.783+0000 7fc866646740 1 -- 172.21.15.148:0/2557206306 shutdown_connections 2024-09-19T07:15:03.784 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.783+0000 7fc866646740 1 -- 172.21.15.148:0/2557206306 wait complete. 2024-09-19T07:15:03.784 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.783+0000 7fc866646740 1 -- start start 2024-09-19T07:15:03.784 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.783+0000 7fc866646740 1 Processor -- start 2024-09-19T07:15:03.785 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.784+0000 7fc866646740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56325963ecc0 0x563259646c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:03.786 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.784+0000 7fc866646740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56325963f5e0 0x5632596471c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:03.786 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.784+0000 7fc866646740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563259649e80 0x563259647700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:03.786 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.784+0000 7fc866646740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56325964c810 con 0x563259649e80 2024-09-19T07:15:03.786 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.784+0000 7fc866646740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56325952c290 con 0x56325963ecc0 2024-09-19T07:15:03.786 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.784+0000 7fc866646740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56325964c990 con 0x56325963f5e0 2024-09-19T07:15:03.786 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.784+0000 7fc866646740 10 client.0 _ll_register_callbacks cb 0x56325955d140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:15:03.786 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.785+0000 7fc860e40640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56325963f5e0 0x5632596471c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:03.786 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.785+0000 7fc860e40640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56325963f5e0 0x5632596471c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:47676/0 (socket says 172.21.15.148:47676) 2024-09-19T07:15:03.786 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.785+0000 7fc860e40640 1 -- 172.21.15.148:0/3215824044 learned_addr learned my addr 172.21.15.148:0/3215824044 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:15:03.787 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.785+0000 7fc860e40640 1 -- 172.21.15.148:0/3215824044 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56325963ecc0 msgr2=0x563259646c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T07:15:03.787 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.785+0000 7fc860e40640 1 --2- 172.21.15.148:0/3215824044 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56325963ecc0 0x563259646c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:03.787 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.785+0000 7fc860e40640 1 -- 172.21.15.148:0/3215824044 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563259649e80 msgr2=0x563259647700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T07:15:03.787 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.786+0000 7fc861e42640 1 --2- 172.21.15.148:0/3215824044 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563259649e80 0x563259647700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:03.787 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.786+0000 7fc860e40640 1 --2- 172.21.15.148:0/3215824044 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563259649e80 0x563259647700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:03.787 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.786+0000 7fc860e40640 1 -- 172.21.15.148:0/3215824044 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632592b6210 con 0x56325963f5e0 2024-09-19T07:15:03.788 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.786+0000 7fc861e42640 1 --2- 172.21.15.148:0/3215824044 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563259649e80 0x563259647700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:15:03.788 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.786+0000 7fc860e40640 1 --2- 172.21.15.148:0/3215824044 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56325963f5e0 0x5632596471c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc8540bab60 tx=0x7fc8540f5fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cb4d0b133130da server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:03.816 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.815+0000 7fc844ff9640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-19T07:15:03.816 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.815+0000 7fc844ff9640 1 -- 172.21.15.148:0/3215824044 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8540dce60 con 0x56325963f5e0 2024-09-19T07:15:03.816 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.815+0000 7fc866646740 1 -- 172.21.15.148:0/3215824044 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8540f8270 con 0x56325963f5e0 2024-09-19T07:15:03.817 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.815+0000 7fc844ff9640 1 -- 172.21.15.148:0/3215824044 <== mon.1 v2:172.21.15.179:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fc85403a370 con 0x56325963f5e0 2024-09-19T07:15:03.817 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.815+0000 7fc844ff9640 1 -- 172.21.15.148:0/3215824044 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fc8540ba430 con 0x56325963f5e0 2024-09-19T07:15:03.817 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.816+0000 7fc866646740 10 client.25786 fetch_fsmap learned FSMap version 33 2024-09-19T07:15:03.817 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.816+0000 7fc866646740 1 -- 172.21.15.148:0/3215824044 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x563259382620 con 0x56325963f5e0 2024-09-19T07:15:03.821 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.821+0000 7fc844ff9640 1 -- 172.21.15.148:0/3215824044 <== mon.1 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8540f8270 con 0x56325963f5e0 2024-09-19T07:15:03.821 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.821+0000 7fc844ff9640 1 -- 172.21.15.148:0/3215824044 <== mon.1 v2:172.21.15.179:3300/0 5 ==== fsmap(e 33) ==== 8362+0+0 (secure 0 0 0) 0x7fc8540de0e0 con 0x56325963f5e0 2024-09-19T07:15:03.822 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.821+0000 7fc866646740 10 client.25786 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T07:15:03.822 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.821+0000 7fc866646740 10 client.25786 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:15:03.822 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.821+0000 7fc866646740 20 client.25786 populate_metadata read hostname 'smithi148' 2024-09-19T07:15:03.822 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.821+0000 7fc866646740 1 --2- 172.21.15.148:0/3215824044 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56325966ac70 0x56325966d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:03.822 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.821+0000 7fc866646740 4 client.25786 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:15:03.822 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.821+0000 7fc866646740 1 -- 172.21.15.148:0/3215824044 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5632595b0a20 con 0x56325966ac70 2024-09-19T07:15:03.822 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.821+0000 7fc861641640 1 --2- 172.21.15.148:0/3215824044 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56325966ac70 0x56325966d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:03.823 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.822+0000 7fc861641640 1 --2- 172.21.15.148:0/3215824044 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56325966ac70 0x56325966d0b0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=120b08ebdcc1ac61 server_cookie=81fb83d6472ceebb in_seq=0 out_seq=0 2024-09-19T07:15:03.823 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.823+0000 7fc844ff9640 10 client.25786 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:15:03.827 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.827+0000 7fc844ff9640 1 -- 172.21.15.148:0/3215824044 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5632595b0a20 con 0x56325966ac70 2024-09-19T07:15:03.828 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.827+0000 7fc844ff9640 10 client.25786 handle_command_reply: tid=0 2024-09-19T07:15:03.828 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.827+0000 7fc866646740 1 client.25786 shutdown 2024-09-19T07:15:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.827+0000 7fc866646740 1 -- 172.21.15.148:0/3215824044 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56325963f5e0 msgr2=0x5632596471c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.827+0000 7fc866646740 1 --2- 172.21.15.148:0/3215824044 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56325963f5e0 0x5632596471c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc8540bab60 tx=0x7fc8540f5fd0 comp rx=0 tx=0).stop 2024-09-19T07:15:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.827+0000 7fc866646740 1 -- 172.21.15.148:0/3215824044 shutdown_connections 2024-09-19T07:15:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.827+0000 7fc866646740 1 --2- 172.21.15.148:0/3215824044 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56325966ac70 0x56325966d0b0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.827+0000 7fc866646740 1 --2- 172.21.15.148:0/3215824044 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563259649e80 0x563259647700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.828+0000 7fc866646740 1 --2- 172.21.15.148:0/3215824044 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56325963f5e0 0x5632596471c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.828+0000 7fc866646740 1 --2- 172.21.15.148:0/3215824044 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56325963ecc0 0x563259646c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.828+0000 7fc866646740 1 -- 172.21.15.148:0/3215824044 >> 172.21.15.148:0/3215824044 conn(0x56325963b230 msgr2=0x563259640f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:15:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.828+0000 7fc844ff9640 0 client.25786 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:15:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.828+0000 7fc866646740 1 -- 172.21.15.148:0/3215824044 shutdown_connections 2024-09-19T07:15:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.828+0000 7fc866646740 1 -- 172.21.15.148:0/3215824044 wait complete. 2024-09-19T07:15:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:03.828+0000 7fc866646740 20 client.25786 trim_cache size 0 max 16384 2024-09-19T07:15:04.006 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.005+0000 7fc866646740 1 Processor -- start 2024-09-19T07:15:04.007 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.006+0000 7fc866646740 1 -- start start 2024-09-19T07:15:04.014 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.013+0000 7fc866646740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56325963ecc0 0x563259647530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:04.014 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.014+0000 7fc866646740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56325963f5e0 0x563259672980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:04.015 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.014+0000 7fc860e40640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56325963f5e0 0x563259672980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:04.016 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.014+0000 7fc860e40640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56325963f5e0 0x563259672980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44416/0 (socket says 172.21.15.148:44416) 2024-09-19T07:15:04.016 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.014+0000 7fc861641640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56325963ecc0 0x563259647530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:04.016 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.014+0000 7fc861641640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56325963ecc0 0x563259647530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:55868/0 (socket says 172.21.15.148:55868) 2024-09-19T07:15:04.016 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.014+0000 7fc860e40640 1 -- 172.21.15.148:0/811628709 learned_addr learned my addr 172.21.15.148:0/811628709 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:15:04.016 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.014+0000 7fc866646740 1 --2- 172.21.15.148:0/811628709 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563259649e80 0x563259672ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:04.016 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.015+0000 7fc866646740 1 -- 172.21.15.148:0/811628709 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc840011170 con 0x56325963f5e0 2024-09-19T07:15:04.016 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.015+0000 7fc861e42640 1 --2- 172.21.15.148:0/811628709 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563259649e80 0x563259672ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:04.016 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.015+0000 7fc866646740 1 -- 172.21.15.148:0/811628709 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc84000e9e0 con 0x56325963ecc0 2024-09-19T07:15:04.016 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.015+0000 7fc866646740 1 -- 172.21.15.148:0/811628709 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc84000c810 con 0x563259649e80 2024-09-19T07:15:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.016+0000 7fc860e40640 1 -- 172.21.15.148:0/811628709 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563259649e80 msgr2=0x563259672ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.016+0000 7fc860e40640 1 --2- 172.21.15.148:0/811628709 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563259649e80 0x563259672ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.016+0000 7fc860e40640 1 -- 172.21.15.148:0/811628709 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56325963ecc0 msgr2=0x563259647530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.016+0000 7fc860e40640 1 --2- 172.21.15.148:0/811628709 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56325963ecc0 0x563259647530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.016+0000 7fc860e40640 1 -- 172.21.15.148:0/811628709 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563259648000 con 0x56325963f5e0 2024-09-19T07:15:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.016+0000 7fc860e40640 1 --2- 172.21.15.148:0/811628709 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56325963f5e0 0x563259672980 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fc854034040 tx=0x7fc8540c25d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e70a0d7cedf6417 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:04.032 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.031+0000 7fc846ffd640 1 -- 172.21.15.148:0/811628709 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8540dce60 con 0x56325963f5e0 2024-09-19T07:15:04.032 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.031+0000 7fc846ffd640 1 -- 172.21.15.148:0/811628709 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8540f5b60 con 0x56325963f5e0 2024-09-19T07:15:04.032 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.031+0000 7fc846ffd640 1 -- 172.21.15.148:0/811628709 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8540f80d0 con 0x56325963f5e0 2024-09-19T07:15:04.036 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.035+0000 7fc866646740 1 -- 172.21.15.148:0/811628709 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56325963f5e0 msgr2=0x563259672980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:04.036 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.036+0000 7fc866646740 1 --2- 172.21.15.148:0/811628709 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56325963f5e0 0x563259672980 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fc854034040 tx=0x7fc8540c25d0 comp rx=0 tx=0).stop 2024-09-19T07:15:04.038 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.037+0000 7fc866646740 1 -- 172.21.15.148:0/811628709 shutdown_connections 2024-09-19T07:15:04.038 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.037+0000 7fc866646740 1 --2- 172.21.15.148:0/811628709 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563259649e80 0x563259672ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:04.038 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.037+0000 7fc866646740 1 --2- 172.21.15.148:0/811628709 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56325963f5e0 0x563259672980 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:04.038 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.037+0000 7fc866646740 1 --2- 172.21.15.148:0/811628709 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56325963ecc0 0x563259647530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:04.038 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.037+0000 7fc866646740 1 -- 172.21.15.148:0/811628709 >> 172.21.15.148:0/811628709 conn(0x56325963b230 msgr2=0x563259645d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:15:04.039 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.038+0000 7fc866646740 1 -- 172.21.15.148:0/811628709 shutdown_connections 2024-09-19T07:15:04.039 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.038+0000 7fc866646740 1 -- 172.21.15.148:0/811628709 wait complete. 2024-09-19T07:15:04.040 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.039+0000 7fc866646740 1 -- start start 2024-09-19T07:15:04.040 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.039+0000 7fc866646740 1 Processor -- start 2024-09-19T07:15:04.041 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.040+0000 7fc866646740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56325963ecc0 0x5632596460e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:04.041 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.041+0000 7fc866646740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56325963f5e0 0x563259646620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:04.041 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.041+0000 7fc861641640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56325963ecc0 0x5632596460e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:04.042 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.041+0000 7fc861641640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56325963ecc0 0x5632596460e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:47688/0 (socket says 172.21.15.148:47688) 2024-09-19T07:15:04.042 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.041+0000 7fc866646740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563259649e80 0x563259646b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:04.042 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.041+0000 7fc866646740 1 -- 172.21.15.148:0/3458802970 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc84000cea0 con 0x56325963f5e0 2024-09-19T07:15:04.042 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.041+0000 7fc866646740 1 -- 172.21.15.148:0/3458802970 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc84000e310 con 0x563259649e80 2024-09-19T07:15:04.042 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.041+0000 7fc866646740 1 -- 172.21.15.148:0/3458802970 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc84000d570 con 0x56325963ecc0 2024-09-19T07:15:04.042 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.041+0000 7fc861641640 1 -- 172.21.15.148:0/3458802970 learned_addr learned my addr 172.21.15.148:0/3458802970 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:15:04.042 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.041+0000 7fc866646740 10 client.0 _ll_register_callbacks cb 0x7fc8540f5dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:15:04.042 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.041+0000 7fc860e40640 1 --2- 172.21.15.148:0/3458802970 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56325963f5e0 0x563259646620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:04.042 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.041+0000 7fc861e42640 1 --2- 172.21.15.148:0/3458802970 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563259649e80 0x563259646b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:04.043 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.041+0000 7fc861641640 1 -- 172.21.15.148:0/3458802970 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563259649e80 msgr2=0x563259646b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:04.043 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.041+0000 7fc861641640 1 --2- 172.21.15.148:0/3458802970 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563259649e80 0x563259646b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:04.043 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.041+0000 7fc861641640 1 -- 172.21.15.148:0/3458802970 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56325963f5e0 msgr2=0x563259646620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:04.043 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.041+0000 7fc861641640 1 --2- 172.21.15.148:0/3458802970 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56325963f5e0 0x563259646620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:04.043 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.041+0000 7fc861641640 1 -- 172.21.15.148:0/3458802970 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563259650f40 con 0x56325963ecc0 2024-09-19T07:15:04.043 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.042+0000 7fc860e40640 1 --2- 172.21.15.148:0/3458802970 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56325963f5e0 0x563259646620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:15:04.043 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.042+0000 7fc861641640 1 --2- 172.21.15.148:0/3458802970 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56325963ecc0 0x5632596460e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x56325966d920 tx=0x7fc858011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5398213c02fcabb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:04.093 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.092+0000 7fc844ff9640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-19T07:15:04.093 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.092+0000 7fc844ff9640 1 -- 172.21.15.148:0/3458802970 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc858004440 con 0x56325963ecc0 2024-09-19T07:15:04.094 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.094+0000 7fc866646740 1 -- 172.21.15.148:0/3458802970 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8540f5b60 con 0x56325963ecc0 2024-09-19T07:15:04.098 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.094+0000 7fc844ff9640 1 -- 172.21.15.148:0/3458802970 <== mon.1 v2:172.21.15.179:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fc8580035f0 con 0x56325963ecc0 2024-09-19T07:15:04.099 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.098+0000 7fc844ff9640 1 -- 172.21.15.148:0/3458802970 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fc858009e20 con 0x56325963ecc0 2024-09-19T07:15:04.099 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.098+0000 7fc866646740 10 client.25792 fetch_fsmap learned FSMap version 33 2024-09-19T07:15:04.099 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.098+0000 7fc866646740 1 -- 172.21.15.148:0/3458802970 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x563259652290 con 0x56325963ecc0 2024-09-19T07:15:04.103 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.102+0000 7fc844ff9640 1 -- 172.21.15.148:0/3458802970 <== mon.1 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc858003cd0 con 0x56325963ecc0 2024-09-19T07:15:04.105 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.104+0000 7fc844ff9640 1 -- 172.21.15.148:0/3458802970 <== mon.1 v2:172.21.15.179:3300/0 5 ==== fsmap(e 33) ==== 8362+0+0 (secure 0 0 0) 0x7fc85800f040 con 0x56325963ecc0 2024-09-19T07:15:04.105 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.104+0000 7fc866646740 10 client.25792 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T07:15:04.105 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.105+0000 7fc866646740 10 client.25792 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:15:04.105 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.105+0000 7fc866646740 20 client.25792 populate_metadata read hostname 'smithi148' 2024-09-19T07:15:04.106 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.105+0000 7fc866646740 1 --2- 172.21.15.148:0/3458802970 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5632596d5950 0x5632596d7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:04.106 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.105+0000 7fc866646740 4 client.25792 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:15:04.106 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.106+0000 7fc866646740 1 -- 172.21.15.148:0/3458802970 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fc8540f5b60 con 0x5632596d5950 2024-09-19T07:15:04.107 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.106+0000 7fc860e40640 1 --2- 172.21.15.148:0/3458802970 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5632596d5950 0x5632596d7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:04.107 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.106+0000 7fc860e40640 1 --2- 172.21.15.148:0/3458802970 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5632596d5950 0x5632596d7d40 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34a50aa8ac2a0781 server_cookie=54db099e9d3e40f4 in_seq=0 out_seq=0 2024-09-19T07:15:04.108 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:04.108+0000 7fc844ff9640 10 client.25792 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:15:05.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:15:04 smithi165 ceph-mon[35326]: pgmap v123: 97 pgs: 97 active+clean; 506 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 9.8 MiB/s wr, 719 op/s 2024-09-19T07:15:05.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:15:04 smithi179 ceph-mon[35716]: pgmap v123: 97 pgs: 97 active+clean; 506 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 9.8 MiB/s wr, 719 op/s 2024-09-19T07:15:05.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:15:04 smithi148 ceph-mon[31180]: pgmap v123: 97 pgs: 97 active+clean; 506 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 9.8 MiB/s wr, 719 op/s 2024-09-19T07:15:07.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:15:06 smithi165 ceph-mon[35326]: pgmap v124: 97 pgs: 97 active+clean; 526 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 12 MiB/s wr, 1.02k op/s 2024-09-19T07:15:07.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:15:06 smithi179 ceph-mon[35716]: pgmap v124: 97 pgs: 97 active+clean; 526 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 12 MiB/s wr, 1.02k op/s 2024-09-19T07:15:07.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:15:06 smithi148 ceph-mon[31180]: pgmap v124: 97 pgs: 97 active+clean; 526 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 12 MiB/s wr, 1.02k op/s 2024-09-19T07:15:09.135 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:15:08 smithi148 ceph-mon[31180]: pgmap v125: 97 pgs: 97 active+clean; 526 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 11 MiB/s wr, 852 op/s 2024-09-19T07:15:09.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:15:08 smithi179 ceph-mon[35716]: pgmap v125: 97 pgs: 97 active+clean; 526 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 11 MiB/s wr, 852 op/s 2024-09-19T07:15:09.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:15:08 smithi165 ceph-mon[35326]: pgmap v125: 97 pgs: 97 active+clean; 526 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 11 MiB/s wr, 852 op/s 2024-09-19T07:15:11.087 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:15:10 smithi148 ceph-mon[31180]: pgmap v126: 97 pgs: 97 active+clean; 526 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 11 MiB/s wr, 852 op/s 2024-09-19T07:15:11.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:15:10 smithi179 ceph-mon[35716]: pgmap v126: 97 pgs: 97 active+clean; 526 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 11 MiB/s wr, 852 op/s 2024-09-19T07:15:11.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:15:10 smithi165 ceph-mon[35326]: pgmap v126: 97 pgs: 97 active+clean; 526 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 11 MiB/s wr, 852 op/s 2024-09-19T07:15:12.891 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:15:12 smithi148 ceph-mon[31180]: pgmap v127: 97 pgs: 97 active+clean; 542 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 12 MiB/s wr, 1.23k op/s 2024-09-19T07:15:13.194 INFO:tasks.workunit.client.0.smithi148.stdout: 200 2481620 2239 1689689 1928 718812 1221 2024-09-19T07:15:13.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:15:12 smithi179 ceph-mon[35716]: pgmap v127: 97 pgs: 97 active+clean; 542 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 12 MiB/s wr, 1.23k op/s 2024-09-19T07:15:13.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:15:12 smithi165 ceph-mon[35326]: pgmap v127: 97 pgs: 97 active+clean; 542 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 12 MiB/s wr, 1.23k op/s 2024-09-19T07:15:15.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:15:14 smithi179 ceph-mon[35716]: pgmap v128: 97 pgs: 97 active+clean; 542 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 687 op/s 2024-09-19T07:15:15.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:15:14 smithi148 ceph-mon[31180]: pgmap v128: 97 pgs: 97 active+clean; 542 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 687 op/s 2024-09-19T07:15:15.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:15:14 smithi165 ceph-mon[35326]: pgmap v128: 97 pgs: 97 active+clean; 542 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 687 op/s 2024-09-19T07:15:16.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:15:15 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:15:16.295 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:16.294+0000 7fc844ff9640 1 -- 172.21.15.148:0/3458802970 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fc8540f5b60 con 0x5632596d5950 2024-09-19T07:15:16.295 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:16.294+0000 7fc844ff9640 10 client.25792 handle_command_reply: tid=0 2024-09-19T07:15:16.296 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:16.294+0000 7fc866646740 1 client.25792 shutdown 2024-09-19T07:15:16.296 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:16.295+0000 7fc866646740 1 -- 172.21.15.148:0/3458802970 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56325963ecc0 msgr2=0x5632596460e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:16.296 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:16.295+0000 7fc866646740 1 --2- 172.21.15.148:0/3458802970 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56325963ecc0 0x5632596460e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x56325966d920 tx=0x7fc858011810 comp rx=0 tx=0).stop 2024-09-19T07:15:16.297 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:16.295+0000 7fc866646740 1 -- 172.21.15.148:0/3458802970 shutdown_connections 2024-09-19T07:15:16.297 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:16.295+0000 7fc866646740 1 --2- 172.21.15.148:0/3458802970 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5632596d5950 0x5632596d7d40 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:16.297 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:16.295+0000 7fc866646740 1 --2- 172.21.15.148:0/3458802970 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563259649e80 0x563259646b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:16.297 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:16.295+0000 7fc866646740 1 --2- 172.21.15.148:0/3458802970 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56325963f5e0 0x563259646620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:16.297 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:16.295+0000 7fc866646740 1 --2- 172.21.15.148:0/3458802970 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56325963ecc0 0x5632596460e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:16.297 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:16.295+0000 7fc866646740 1 -- 172.21.15.148:0/3458802970 >> 172.21.15.148:0/3458802970 conn(0x56325963b230 msgr2=0x5632596484e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:15:16.297 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:16.295+0000 7fc844ff9640 0 client.25792 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:15:16.297 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:16.295+0000 7fc866646740 1 -- 172.21.15.148:0/3458802970 shutdown_connections 2024-09-19T07:15:16.297 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:16.296+0000 7fc866646740 1 -- 172.21.15.148:0/3458802970 wait complete. 2024-09-19T07:15:16.297 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:16.296+0000 7fc866646740 20 client.25792 trim_cache size 0 max 16384 2024-09-19T07:15:16.298 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:15:16.298 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:15:16.298 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:15:16.298 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:15:16.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:15:15 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:15:16.374 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:16.373+0000 7fc8638a5640 1 -- 172.21.15.148:0/118261072 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc8480a3520 msgr2=0x7fc8480a59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:16.374 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:16.373+0000 7fc8638a5640 1 --2- 172.21.15.148:0/118261072 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc8480a3520 0x7fc8480a59e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc84c00b910 tx=0x7fc84c00b370 comp rx=0 tx=0).stop 2024-09-19T07:15:16.374 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:16.373+0000 7fc8638a5640 1 -- 172.21.15.148:0/118261072 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc85c109b70 msgr2=0x7fc85c075a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:16.374 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:16.373+0000 7fc8638a5640 1 --2- 172.21.15.148:0/118261072 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc85c109b70 0x7fc85c075a50 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fc854030e00 tx=0x7fc854003e40 comp rx=0 tx=0).stop 2024-09-19T07:15:16.384 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:16.382+0000 7fc8638a5640 1 -- 172.21.15.148:0/118261072 shutdown_connections 2024-09-19T07:15:16.384 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:16.382+0000 7fc8638a5640 1 --2- 172.21.15.148:0/118261072 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc8480a3520 0x7fc8480a59e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:16.384 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:16.382+0000 7fc8638a5640 1 --2- 172.21.15.148:0/118261072 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc85c10d610 0x7fc85c075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:16.384 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:16.382+0000 7fc8638a5640 1 --2- 172.21.15.148:0/118261072 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc85c109b70 0x7fc85c075a50 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:16.384 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:16.382+0000 7fc8638a5640 1 --2- 172.21.15.148:0/118261072 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc85c1091f0 0x7fc85c07a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:16.384 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:16.382+0000 7fc8638a5640 1 -- 172.21.15.148:0/118261072 >> 172.21.15.148:0/118261072 conn(0x7fc85c06cc60 msgr2=0x7fc85c072460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:15:16.384 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:16.383+0000 7fc8638a5640 1 -- 172.21.15.148:0/118261072 shutdown_connections 2024-09-19T07:15:16.384 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:16.383+0000 7fc8638a5640 1 -- 172.21.15.148:0/118261072 wait complete. 2024-09-19T07:15:16.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:15:15 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:15:17.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:15:16 smithi179 ceph-mon[35716]: pgmap v129: 97 pgs: 97 active+clean; 558 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.0 MiB/s wr, 805 op/s 2024-09-19T07:15:17.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:15:16 smithi148 ceph-mon[31180]: pgmap v129: 97 pgs: 97 active+clean; 558 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.0 MiB/s wr, 805 op/s 2024-09-19T07:15:17.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:15:16 smithi165 ceph-mon[35326]: pgmap v129: 97 pgs: 97 active+clean; 558 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.0 MiB/s wr, 805 op/s 2024-09-19T07:15:19.185 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:15:18 smithi165 ceph-mon[35326]: pgmap v130: 97 pgs: 97 active+clean; 558 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.0 MiB/s wr, 499 op/s 2024-09-19T07:15:19.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:15:18 smithi179 ceph-mon[35716]: pgmap v130: 97 pgs: 97 active+clean; 558 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.0 MiB/s wr, 499 op/s 2024-09-19T07:15:19.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:15:18 smithi148 ceph-mon[31180]: pgmap v130: 97 pgs: 97 active+clean; 558 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.0 MiB/s wr, 499 op/s 2024-09-19T07:15:19.963 INFO:tasks.quiescer.fs.[cephfs]:Total duration (59.6) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T07:15:19.963 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.8 2024-09-19T07:15:19.964 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:15:20.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:15:19 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:15:20.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:15:19 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:15:20.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:15:19 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:15:20.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:15:19 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:15:20.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:15:19 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:15:20.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:15:19 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:15:20.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:15:19 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:15:20.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:15:19 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:15:20.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:15:19 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:15:20.940 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:15:20 smithi148 ceph-mon[31180]: pgmap v131: 97 pgs: 97 active+clean; 550 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.0 MiB/s wr, 502 op/s 2024-09-19T07:15:21.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:15:20 smithi179 ceph-mon[35716]: pgmap v131: 97 pgs: 97 active+clean; 550 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.0 MiB/s wr, 502 op/s 2024-09-19T07:15:21.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:15:20 smithi165 ceph-mon[35326]: pgmap v131: 97 pgs: 97 active+clean; 550 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.0 MiB/s wr, 502 op/s 2024-09-19T07:15:23.086 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:15:22 smithi148 ceph-mon[31180]: pgmap v132: 97 pgs: 97 active+clean; 555 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.6 MiB/s wr, 673 op/s 2024-09-19T07:15:23.194 INFO:tasks.workunit.client.0.smithi148.stdout: 224 2331102 1490 1588863 1338 633371 1757 2024-09-19T07:15:23.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:15:22 smithi179 ceph-mon[35716]: pgmap v132: 97 pgs: 97 active+clean; 555 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.6 MiB/s wr, 673 op/s 2024-09-19T07:15:23.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:15:22 smithi165 ceph-mon[35326]: pgmap v132: 97 pgs: 97 active+clean; 555 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.6 MiB/s wr, 673 op/s 2024-09-19T07:15:25.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:15:24 smithi179 ceph-mon[35716]: pgmap v133: 97 pgs: 97 active+clean; 555 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.2 MiB/s wr, 291 op/s 2024-09-19T07:15:25.306 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:15:25.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:15:24 smithi148 ceph-mon[31180]: pgmap v133: 97 pgs: 97 active+clean; 555 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.2 MiB/s wr, 291 op/s 2024-09-19T07:15:25.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:15:24 smithi165 ceph-mon[35326]: pgmap v133: 97 pgs: 97 active+clean; 555 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.2 MiB/s wr, 291 op/s 2024-09-19T07:15:26.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.302+0000 7fab7cd85640 1 -- 172.21.15.148:0/2192973121 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab7806e750 msgr2=0x7fab7806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:26.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.302+0000 7fab7cd85640 1 --2- 172.21.15.148:0/2192973121 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab7806e750 0x7fab7806eb30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fab70009ca0 tx=0x7fab7002a8f0 comp rx=0 tx=0).stop 2024-09-19T07:15:26.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.303+0000 7fab7cd85640 1 -- 172.21.15.148:0/2192973121 shutdown_connections 2024-09-19T07:15:26.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.303+0000 7fab7cd85640 1 --2- 172.21.15.148:0/2192973121 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab7810e3f0 0x7fab78115fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:26.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.303+0000 7fab7cd85640 1 --2- 172.21.15.148:0/2192973121 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab7806f100 0x7fab7810dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:26.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.303+0000 7fab7cd85640 1 --2- 172.21.15.148:0/2192973121 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab7806e750 0x7fab7806eb30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:26.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.303+0000 7fab7cd85640 1 -- 172.21.15.148:0/2192973121 >> 172.21.15.148:0/2192973121 conn(0x7fab78073180 msgr2=0x7fab78073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:15:26.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.305+0000 7fab7cd85640 1 -- 172.21.15.148:0/2192973121 shutdown_connections 2024-09-19T07:15:26.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.307+0000 7fab7cd85640 1 -- 172.21.15.148:0/2192973121 wait complete. 2024-09-19T07:15:26.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.308+0000 7fab7cd85640 1 Processor -- start 2024-09-19T07:15:26.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.309+0000 7fab7cd85640 1 -- start start 2024-09-19T07:15:26.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.310+0000 7fab7cd85640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab7806e750 0x7fab7811ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:26.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.310+0000 7fab7cd85640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab7806f100 0x7fab78118af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:26.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.310+0000 7fab7cd85640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab7810e3f0 0x7fab78119030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:26.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.310+0000 7fab7cd85640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fab78117550 con 0x7fab7810e3f0 2024-09-19T07:15:26.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.311+0000 7fab7cd85640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fab781173d0 con 0x7fab7806e750 2024-09-19T07:15:26.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.311+0000 7fab7cd85640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fab781176d0 con 0x7fab7806f100 2024-09-19T07:15:26.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.311+0000 7fab77fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab7810e3f0 0x7fab78119030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:26.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.311+0000 7fab77fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab7810e3f0 0x7fab78119030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57346/0 (socket says 172.21.15.148:57346) 2024-09-19T07:15:26.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.311+0000 7fab77fff640 1 -- 172.21.15.148:0/1365437317 learned_addr learned my addr 172.21.15.148:0/1365437317 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:15:26.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.312+0000 7fab777fe640 1 --2- 172.21.15.148:0/1365437317 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab7806e750 0x7fab7811ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:26.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.312+0000 7fab77fff640 1 -- 172.21.15.148:0/1365437317 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab7806f100 msgr2=0x7fab78118af0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T07:15:26.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.315+0000 7fab76ffd640 1 --2- 172.21.15.148:0/1365437317 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab7806f100 0x7fab78118af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:26.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.316+0000 7fab77fff640 1 --2- 172.21.15.148:0/1365437317 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab7806f100 0x7fab78118af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:26.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.316+0000 7fab77fff640 1 -- 172.21.15.148:0/1365437317 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab7806e750 msgr2=0x7fab7811ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:26.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.316+0000 7fab77fff640 1 --2- 172.21.15.148:0/1365437317 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab7806e750 0x7fab7811ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:26.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.316+0000 7fab77fff640 1 -- 172.21.15.148:0/1365437317 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab781197b0 con 0x7fab7810e3f0 2024-09-19T07:15:26.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.316+0000 7fab77fff640 1 --2- 172.21.15.148:0/1365437317 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab7810e3f0 0x7fab78119030 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fab6c00d680 tx=0x7fab6c00db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:26.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.317+0000 7fab74ff9640 1 -- 172.21.15.148:0/1365437317 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab6c017070 con 0x7fab7810e3f0 2024-09-19T07:15:26.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.317+0000 7fab74ff9640 1 -- 172.21.15.148:0/1365437317 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab6c009820 con 0x7fab7810e3f0 2024-09-19T07:15:26.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.317+0000 7fab74ff9640 1 -- 172.21.15.148:0/1365437317 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab6c004d00 con 0x7fab7810e3f0 2024-09-19T07:15:26.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.317+0000 7fab7cd85640 1 -- 172.21.15.148:0/1365437317 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab781bbf20 con 0x7fab7810e3f0 2024-09-19T07:15:26.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.317+0000 7fab7cd85640 1 -- 172.21.15.148:0/1365437317 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab781bc380 con 0x7fab7810e3f0 2024-09-19T07:15:26.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.318+0000 7fab777fe640 1 --2- 172.21.15.148:0/1365437317 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab7806e750 0x7fab7811ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:15:26.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.318+0000 7fab76ffd640 1 --2- 172.21.15.148:0/1365437317 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab7806f100 0x7fab78118af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:15:26.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.323+0000 7fab5e7fc640 1 -- 172.21.15.148:0/1365437317 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab7810a800 con 0x7fab7810e3f0 2024-09-19T07:15:26.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.326+0000 7fab74ff9640 1 -- 172.21.15.148:0/1365437317 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fab6c005220 con 0x7fab7810e3f0 2024-09-19T07:15:26.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.327+0000 7fab74ff9640 1 --2- 172.21.15.148:0/1365437317 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fab600a35c0 0x7fab600a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:26.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.328+0000 7fab74ff9640 1 -- 172.21.15.148:0/1365437317 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fab6c0cf670 con 0x7fab7810e3f0 2024-09-19T07:15:26.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.330+0000 7fab777fe640 1 --2- 172.21.15.148:0/1365437317 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fab600a35c0 0x7fab600a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:26.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.331+0000 7fab777fe640 1 --2- 172.21.15.148:0/1365437317 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fab600a35c0 0x7fab600a5a80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fab7002f570 tx=0x7fab7002f340 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:26.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.338+0000 7fab74ff9640 1 -- 172.21.15.148:0/1365437317 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fab6c09c020 con 0x7fab7810e3f0 2024-09-19T07:15:26.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.817+0000 7fab5e7fc640 1 -- 172.21.15.148:0/1365437317 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fab7811a020 con 0x7fab7810e3f0 2024-09-19T07:15:26.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.818+0000 7fab74ff9640 1 -- 172.21.15.148:0/1365437317 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11947 (secure 0 0 0) 0x7fab6c09b920 con 0x7fab7810e3f0 2024-09-19T07:15:26.820 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:15:26.820 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":33,"btime":"2024-09-19T07:14:31:818799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/4263868576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":4263868576},{"type":"v1","addr":"172.21.15.148:6841","nonce":4263868576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":25606,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3891676893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3891676893},{"type":"v1","addr":"172.21.15.179:6835","nonce":3891676893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":33,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:09:19.543369+0000","modified":"2024-09-19T07:14:30.968403+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24457,"mds_1":24437,"mds_2":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24383":{"gid":24383,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6835/2146820965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2146820965},{"type":"v1","addr":"172.21.15.165:6835","nonce":2146820965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24410":{"gid":24410,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":75,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":71,"addr":"172.21.15.165:6839/3993490234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":3993490234},{"type":"v1","addr":"172.21.15.165:6839","nonce":3993490234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24457,"qdb_cluster":[24457,24437,24436]},"id":1}]} 2024-09-19T07:15:26.820 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 33 2024-09-19T07:15:26.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.823+0000 7fab5e7fc640 1 -- 172.21.15.148:0/1365437317 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fab600a35c0 msgr2=0x7fab600a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:26.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.823+0000 7fab5e7fc640 1 --2- 172.21.15.148:0/1365437317 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fab600a35c0 0x7fab600a5a80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fab7002f570 tx=0x7fab7002f340 comp rx=0 tx=0).stop 2024-09-19T07:15:26.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.823+0000 7fab5e7fc640 1 -- 172.21.15.148:0/1365437317 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab7810e3f0 msgr2=0x7fab78119030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:26.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.823+0000 7fab5e7fc640 1 --2- 172.21.15.148:0/1365437317 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab7810e3f0 0x7fab78119030 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fab6c00d680 tx=0x7fab6c00db40 comp rx=0 tx=0).stop 2024-09-19T07:15:26.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.823+0000 7fab5e7fc640 1 -- 172.21.15.148:0/1365437317 shutdown_connections 2024-09-19T07:15:26.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.823+0000 7fab5e7fc640 1 --2- 172.21.15.148:0/1365437317 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fab600a35c0 0x7fab600a5a80 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:26.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.823+0000 7fab5e7fc640 1 --2- 172.21.15.148:0/1365437317 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab7810e3f0 0x7fab78119030 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:26.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.823+0000 7fab5e7fc640 1 --2- 172.21.15.148:0/1365437317 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab7806f100 0x7fab78118af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:26.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.823+0000 7fab5e7fc640 1 --2- 172.21.15.148:0/1365437317 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab7806e750 0x7fab7811ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:26.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.824+0000 7fab5e7fc640 1 -- 172.21.15.148:0/1365437317 >> 172.21.15.148:0/1365437317 conn(0x7fab78073180 msgr2=0x7fab7806c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:15:26.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.824+0000 7fab5e7fc640 1 -- 172.21.15.148:0/1365437317 shutdown_connections 2024-09-19T07:15:26.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:26.824+0000 7fab5e7fc640 1 -- 172.21.15.148:0/1365437317 wait complete. 2024-09-19T07:15:26.976 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:15:26 smithi148 ceph-mon[31180]: pgmap v134: 97 pgs: 97 active+clean; 729 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 18 MiB/s wr, 1k op/s 2024-09-19T07:15:26.976 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:15:26 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/1365437317' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:15:27.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:15:26 smithi179 ceph-mon[35716]: pgmap v134: 97 pgs: 97 active+clean; 729 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 18 MiB/s wr, 1k op/s 2024-09-19T07:15:27.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:15:26 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/1365437317' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:15:27.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:15:26 smithi165 ceph-mon[35326]: pgmap v134: 97 pgs: 97 active+clean; 729 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 18 MiB/s wr, 1k op/s 2024-09-19T07:15:27.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:15:26 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/1365437317' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:15:27.682 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24457 quiesce db / --timeout 90 --expiration 149.8 --await-for 45.0' 2024-09-19T07:15:27.683 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24457 quiesce db / --timeout 90 --expiration 149.8 --await-for 45.0 2024-09-19T07:15:28.353 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:15:29.231 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:15:28 smithi148 ceph-mon[31180]: pgmap v135: 97 pgs: 97 active+clean; 729 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 17 MiB/s wr, 882 op/s 2024-09-19T07:15:29.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:15:28 smithi179 ceph-mon[35716]: pgmap v135: 97 pgs: 97 active+clean; 729 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 17 MiB/s wr, 882 op/s 2024-09-19T07:15:29.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:15:28 smithi165 ceph-mon[35326]: pgmap v135: 97 pgs: 97 active+clean; 729 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 17 MiB/s wr, 882 op/s 2024-09-19T07:15:29.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.346+0000 7f056a2d9640 1 -- 172.21.15.148:0/2910004502 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0564100a70 msgr2=0x7f0564100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:29.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.346+0000 7f056a2d9640 1 --2- 172.21.15.148:0/2910004502 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0564100a70 0x7f0564100ed0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f054c009930 tx=0x7f054c02a420 comp rx=0 tx=0).stop 2024-09-19T07:15:29.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.346+0000 7f056a2d9640 1 -- 172.21.15.148:0/2910004502 shutdown_connections 2024-09-19T07:15:29.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.346+0000 7f056a2d9640 1 --2- 172.21.15.148:0/2910004502 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0564101410 0x7f056410d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:29.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.346+0000 7f056a2d9640 1 --2- 172.21.15.148:0/2910004502 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0564100a70 0x7f0564100ed0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:29.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.346+0000 7f056a2d9640 1 --2- 172.21.15.148:0/2910004502 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0564106a70 0x7f0564106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:29.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.346+0000 7f056a2d9640 1 -- 172.21.15.148:0/2910004502 >> 172.21.15.148:0/2910004502 conn(0x7f05640fc7d0 msgr2=0x7f05640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:15:29.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.347+0000 7f056a2d9640 1 -- 172.21.15.148:0/2910004502 shutdown_connections 2024-09-19T07:15:29.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.347+0000 7f056a2d9640 1 -- 172.21.15.148:0/2910004502 wait complete. 2024-09-19T07:15:29.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.347+0000 7f056a2d9640 1 Processor -- start 2024-09-19T07:15:29.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.347+0000 7f056a2d9640 1 -- start start 2024-09-19T07:15:29.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.347+0000 7f056a2d9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0564100a70 0x7f0564199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:29.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.348+0000 7f056a2d9640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0564101410 0x7f0564199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:29.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.348+0000 7f056a2d9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0564106a70 0x7f05641a4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:29.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.348+0000 7f056a2d9640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0564110e70 con 0x7f0564100a70 2024-09-19T07:15:29.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.348+0000 7f056a2d9640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0564110cf0 con 0x7f0564101410 2024-09-19T07:15:29.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.348+0000 7f056a2d9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0564110ff0 con 0x7f0564106a70 2024-09-19T07:15:29.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.348+0000 7f0563fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0564100a70 0x7f0564199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:29.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.348+0000 7f0563fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0564100a70 0x7f0564199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57370/0 (socket says 172.21.15.148:57370) 2024-09-19T07:15:29.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.348+0000 7f0563fff640 1 -- 172.21.15.148:0/850417926 learned_addr learned my addr 172.21.15.148:0/850417926 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:15:29.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.348+0000 7f055bfff640 1 --2- 172.21.15.148:0/850417926 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0564101410 0x7f0564199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:29.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.348+0000 7f0568876640 1 --2- 172.21.15.148:0/850417926 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0564106a70 0x7f05641a4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:29.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.348+0000 7f0563fff640 1 -- 172.21.15.148:0/850417926 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0564106a70 msgr2=0x7f05641a4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:29.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.348+0000 7f0563fff640 1 --2- 172.21.15.148:0/850417926 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0564106a70 0x7f05641a4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:29.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.348+0000 7f0563fff640 1 -- 172.21.15.148:0/850417926 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0564101410 msgr2=0x7f0564199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:29.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.348+0000 7f0563fff640 1 --2- 172.21.15.148:0/850417926 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0564101410 0x7f0564199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:29.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.348+0000 7f0563fff640 1 -- 172.21.15.148:0/850417926 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05641a48c0 con 0x7f0564100a70 2024-09-19T07:15:29.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.348+0000 7f0563fff640 1 --2- 172.21.15.148:0/850417926 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0564100a70 0x7f0564199300 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f055400e9f0 tx=0x7f055400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:29.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.348+0000 7f0561ffb640 1 -- 172.21.15.148:0/850417926 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055400cd80 con 0x7f0564100a70 2024-09-19T07:15:29.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.348+0000 7f0561ffb640 1 -- 172.21.15.148:0/850417926 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0554005500 con 0x7f0564100a70 2024-09-19T07:15:29.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.348+0000 7f0561ffb640 1 -- 172.21.15.148:0/850417926 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0554010690 con 0x7f0564100a70 2024-09-19T07:15:29.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.348+0000 7f056a2d9640 1 -- 172.21.15.148:0/850417926 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05641a4a90 con 0x7f0564100a70 2024-09-19T07:15:29.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.348+0000 7f056a2d9640 1 -- 172.21.15.148:0/850417926 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05641a4f50 con 0x7f0564100a70 2024-09-19T07:15:29.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.351+0000 7f0561ffb640 1 -- 172.21.15.148:0/850417926 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f05540046c0 con 0x7f0564100a70 2024-09-19T07:15:29.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.351+0000 7f056c6b2740 1 Processor -- start 2024-09-19T07:15:29.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.351+0000 7f056c6b2740 1 -- start start 2024-09-19T07:15:29.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.351+0000 7f056c6b2740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ec0913e620 0x55ec0913ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:29.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.351+0000 7f056c6b2740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec0913ef40 0x55ec0914d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:29.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.351+0000 7f056c6b2740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ec0914dd50 0x55ec09150140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:29.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.351+0000 7f056c6b2740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55ec090a42a0 con 0x55ec0914dd50 2024-09-19T07:15:29.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.351+0000 7f056c6b2740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ec0904bb10 con 0x55ec0913ef40 2024-09-19T07:15:29.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.351+0000 7f056c6b2740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ec090a0260 con 0x55ec0913e620 2024-09-19T07:15:29.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.351+0000 7f0568876640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ec0913e620 0x55ec0913ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:29.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.351+0000 7f055bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ec0914dd50 0x55ec09150140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:29.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.351+0000 7f0568876640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ec0913e620 0x55ec0913ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:50566/0 (socket says 172.21.15.148:50566) 2024-09-19T07:15:29.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.352+0000 7f0568876640 1 -- 172.21.15.148:0/2136527012 learned_addr learned my addr 172.21.15.148:0/2136527012 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:15:29.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.352+0000 7f0563fff640 1 --2- 172.21.15.148:0/2136527012 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec0913ef40 0x55ec0914d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:29.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.352+0000 7f0568876640 1 -- 172.21.15.148:0/2136527012 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec0913ef40 msgr2=0x55ec0914d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:29.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.352+0000 7f0568876640 1 --2- 172.21.15.148:0/2136527012 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec0913ef40 0x55ec0914d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:29.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.352+0000 7f0568876640 1 -- 172.21.15.148:0/2136527012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ec0914dd50 msgr2=0x55ec09150140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:29.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.352+0000 7f0568876640 1 --2- 172.21.15.148:0/2136527012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ec0914dd50 0x55ec09150140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:29.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.352+0000 7f0568876640 1 -- 172.21.15.148:0/2136527012 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec08e15b90 con 0x55ec0913e620 2024-09-19T07:15:29.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.352+0000 7f0561ffb640 1 --2- 172.21.15.148:0/850417926 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f05500a3430 0x7f05500a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:29.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.352+0000 7f0568876640 1 --2- 172.21.15.148:0/2136527012 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ec0913e620 0x55ec0913ea00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f055c009fd0 tx=0x7f055c0118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1afcead139457265 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:29.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.352+0000 7f0563fff640 1 --2- 172.21.15.148:0/850417926 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f05500a3430 0x7f05500a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:29.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.352+0000 7f055a7fc640 1 -- 172.21.15.148:0/2136527012 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055c004d20 con 0x55ec0913e620 2024-09-19T07:15:29.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.352+0000 7f055a7fc640 1 -- 172.21.15.148:0/2136527012 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f055c004050 con 0x55ec0913e620 2024-09-19T07:15:29.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.352+0000 7f055a7fc640 1 -- 172.21.15.148:0/2136527012 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055c005260 con 0x55ec0913e620 2024-09-19T07:15:29.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.352+0000 7f0561ffb640 1 -- 172.21.15.148:0/850417926 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f05540d0060 con 0x7f0564100a70 2024-09-19T07:15:29.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.353+0000 7f056c6b2740 1 -- 172.21.15.148:0/2136527012 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ec0913e620 msgr2=0x55ec0913ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:29.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.353+0000 7f056c6b2740 1 --2- 172.21.15.148:0/2136527012 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ec0913e620 0x55ec0913ea00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f055c009fd0 tx=0x7f055c0118d0 comp rx=0 tx=0).stop 2024-09-19T07:15:29.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.353+0000 7f0563fff640 1 --2- 172.21.15.148:0/850417926 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f05500a3430 0x7f05500a58f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f055409c2e0 tx=0x7f05540d3880 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:29.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.353+0000 7f056c6b2740 1 -- 172.21.15.148:0/2136527012 shutdown_connections 2024-09-19T07:15:29.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.353+0000 7f056c6b2740 1 --2- 172.21.15.148:0/2136527012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ec0914dd50 0x55ec09150140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:29.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.353+0000 7f056c6b2740 1 --2- 172.21.15.148:0/2136527012 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec0913ef40 0x55ec0914d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:29.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.353+0000 7f056c6b2740 1 --2- 172.21.15.148:0/2136527012 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ec0913e620 0x55ec0913ea00 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:29.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.353+0000 7f056c6b2740 1 -- 172.21.15.148:0/2136527012 >> 172.21.15.148:0/2136527012 conn(0x55ec0913acf0 msgr2=0x55ec0913b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:15:29.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.353+0000 7f056c6b2740 1 -- 172.21.15.148:0/2136527012 shutdown_connections 2024-09-19T07:15:29.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.353+0000 7f056c6b2740 1 -- 172.21.15.148:0/2136527012 wait complete. 2024-09-19T07:15:29.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.353+0000 7f056c6b2740 1 -- start start 2024-09-19T07:15:29.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.354+0000 7f056c6b2740 1 Processor -- start 2024-09-19T07:15:29.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.354+0000 7f056c6b2740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ec0913e620 0x55ec0914abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:29.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.354+0000 7f056c6b2740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ec0913ef40 0x55ec0914b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:29.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.354+0000 7f056c6b2740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec0914dd50 0x55ec0914b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:29.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.354+0000 7f056c6b2740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55ec09150920 con 0x55ec0913ef40 2024-09-19T07:15:29.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.354+0000 7f056c6b2740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ec0902c6e0 con 0x55ec0914dd50 2024-09-19T07:15:29.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.354+0000 7f056c6b2740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ec09150aa0 con 0x55ec0913e620 2024-09-19T07:15:29.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.354+0000 7f056c6b2740 10 client.0 _ll_register_callbacks cb 0x55ec09050a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:15:29.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.354+0000 7f055bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ec0913ef40 0x55ec0914b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:29.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.354+0000 7f0568876640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec0914dd50 0x55ec0914b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:29.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.354+0000 7f0568876640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec0914dd50 0x55ec0914b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:43030/0 (socket says 172.21.15.148:43030) 2024-09-19T07:15:29.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.354+0000 7f0568876640 1 -- 172.21.15.148:0/4180231096 learned_addr learned my addr 172.21.15.148:0/4180231096 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:15:29.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.354+0000 7f0568876640 1 --2- 172.21.15.148:0/4180231096 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ec0913e620 0x55ec0914abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:29.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.354+0000 7f0568876640 1 -- 172.21.15.148:0/4180231096 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ec0913e620 msgr2=0x55ec0914abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:29.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.354+0000 7f0568876640 1 --2- 172.21.15.148:0/4180231096 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ec0913e620 0x55ec0914abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:29.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.354+0000 7f0568876640 1 -- 172.21.15.148:0/4180231096 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ec0913ef40 msgr2=0x55ec0914b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:29.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.354+0000 7f0568876640 1 --2- 172.21.15.148:0/4180231096 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ec0913ef40 0x55ec0914b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:29.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.354+0000 7f0568876640 1 -- 172.21.15.148:0/4180231096 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec09159e20 con 0x55ec0914dd50 2024-09-19T07:15:29.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.355+0000 7f0568876640 1 --2- 172.21.15.148:0/4180231096 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec0914dd50 0x55ec0914b670 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f055c0094d0 tx=0x7f055c009be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42f936d5e31a6582 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:29.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.355+0000 7f05437fe640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-19T07:15:29.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.355+0000 7f05437fe640 1 -- 172.21.15.148:0/4180231096 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055c02d060 con 0x55ec0914dd50 2024-09-19T07:15:29.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.355+0000 7f056c6b2740 1 -- 172.21.15.148:0/4180231096 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f055c004050 con 0x55ec0914dd50 2024-09-19T07:15:29.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.355+0000 7f05437fe640 1 -- 172.21.15.148:0/4180231096 <== mon.2 v2:172.21.15.165:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f055c00f4e0 con 0x55ec0914dd50 2024-09-19T07:15:29.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.355+0000 7f05437fe640 1 -- 172.21.15.148:0/4180231096 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f055c00f6e0 con 0x55ec0914dd50 2024-09-19T07:15:29.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.355+0000 7f056c6b2740 10 client.25724 fetch_fsmap learned FSMap version 33 2024-09-19T07:15:29.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.355+0000 7f056c6b2740 1 -- 172.21.15.148:0/4180231096 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55ec0915c790 con 0x55ec0914dd50 2024-09-19T07:15:29.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.355+0000 7f05437fe640 1 -- 172.21.15.148:0/4180231096 <== mon.2 v2:172.21.15.165:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f055c004050 con 0x55ec0914dd50 2024-09-19T07:15:29.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.355+0000 7f05437fe640 1 -- 172.21.15.148:0/4180231096 <== mon.2 v2:172.21.15.165:3300/0 5 ==== fsmap(e 33) ==== 8362+0+0 (secure 0 0 0) 0x7f055c025040 con 0x55ec0914dd50 2024-09-19T07:15:29.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.355+0000 7f056c6b2740 10 client.25724 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T07:15:29.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.355+0000 7f056c6b2740 10 client.25724 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:15:29.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.355+0000 7f056c6b2740 20 client.25724 populate_metadata read hostname 'smithi148' 2024-09-19T07:15:29.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.355+0000 7f056c6b2740 1 --2- 172.21.15.148:0/4180231096 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ec0915db40 0x55ec0915ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:29.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.355+0000 7f056c6b2740 4 client.25724 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:15:29.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.355+0000 7f056c6b2740 1 -- 172.21.15.148:0/4180231096 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec090b19d0 con 0x55ec0915db40 2024-09-19T07:15:29.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.356+0000 7f055bfff640 1 --2- 172.21.15.148:0/4180231096 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ec0915db40 0x55ec0915ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:29.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.356+0000 7f055bfff640 1 --2- 172.21.15.148:0/4180231096 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ec0915db40 0x55ec0915ff30 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58aac65104dcb88 server_cookie=a9fc89fddd9f98fa in_seq=0 out_seq=0 2024-09-19T07:15:29.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.356+0000 7f05437fe640 10 client.25724 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:15:29.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.357+0000 7f05437fe640 1 -- 172.21.15.148:0/4180231096 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ec090b19d0 con 0x55ec0915db40 2024-09-19T07:15:29.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.357+0000 7f05437fe640 10 client.25724 handle_command_reply: tid=0 2024-09-19T07:15:29.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.357+0000 7f056c6b2740 1 client.25724 shutdown 2024-09-19T07:15:29.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.357+0000 7f056c6b2740 1 -- 172.21.15.148:0/4180231096 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec0914dd50 msgr2=0x55ec0914b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:29.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.357+0000 7f056c6b2740 1 --2- 172.21.15.148:0/4180231096 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec0914dd50 0x55ec0914b670 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f055c0094d0 tx=0x7f055c009be0 comp rx=0 tx=0).stop 2024-09-19T07:15:29.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.357+0000 7f056c6b2740 1 -- 172.21.15.148:0/4180231096 shutdown_connections 2024-09-19T07:15:29.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.357+0000 7f056c6b2740 1 --2- 172.21.15.148:0/4180231096 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ec0915db40 0x55ec0915ff30 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:29.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.357+0000 7f056c6b2740 1 --2- 172.21.15.148:0/4180231096 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec0914dd50 0x55ec0914b670 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:29.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.357+0000 7f056c6b2740 1 --2- 172.21.15.148:0/4180231096 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ec0913ef40 0x55ec0914b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:29.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.357+0000 7f056c6b2740 1 --2- 172.21.15.148:0/4180231096 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ec0913e620 0x55ec0914abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:29.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.357+0000 7f05437fe640 0 client.25724 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:15:29.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.357+0000 7f056c6b2740 1 -- 172.21.15.148:0/4180231096 >> 172.21.15.148:0/4180231096 conn(0x55ec0913acf0 msgr2=0x55ec09139e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:15:29.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.357+0000 7f056c6b2740 1 -- 172.21.15.148:0/4180231096 shutdown_connections 2024-09-19T07:15:29.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.357+0000 7f056c6b2740 1 -- 172.21.15.148:0/4180231096 wait complete. 2024-09-19T07:15:29.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.357+0000 7f056c6b2740 20 client.25724 trim_cache size 0 max 16384 2024-09-19T07:15:29.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.375+0000 7f056c6b2740 1 Processor -- start 2024-09-19T07:15:29.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.375+0000 7f056c6b2740 1 -- start start 2024-09-19T07:15:29.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.376+0000 7f056c6b2740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec0913e620 0x55ec09139e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:29.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.376+0000 7f056c6b2740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ec0913ef40 0x55ec09165670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:29.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.376+0000 7f056c6b2740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ec0914dd50 0x55ec09165bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:29.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.376+0000 7f056c6b2740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f05641ae030 con 0x55ec0913ef40 2024-09-19T07:15:29.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.376+0000 7f056c6b2740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f05641ab8a0 con 0x55ec0913e620 2024-09-19T07:15:29.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.376+0000 7f056c6b2740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f05641a96f0 con 0x55ec0914dd50 2024-09-19T07:15:29.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.376+0000 7f055bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ec0913ef40 0x55ec09165670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:29.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.376+0000 7f0568876640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec0913e620 0x55ec09139e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:29.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.376+0000 7f0568876640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec0913e620 0x55ec09139e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:43038/0 (socket says 172.21.15.148:43038) 2024-09-19T07:15:29.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.376+0000 7f0568876640 1 -- 172.21.15.148:0/3932296679 learned_addr learned my addr 172.21.15.148:0/3932296679 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:15:29.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.376+0000 7f0568876640 1 --2- 172.21.15.148:0/3932296679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ec0914dd50 0x55ec09165bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:29.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.376+0000 7f0568876640 1 -- 172.21.15.148:0/3932296679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ec0914dd50 msgr2=0x55ec09165bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:29.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.376+0000 7f0568876640 1 --2- 172.21.15.148:0/3932296679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ec0914dd50 0x55ec09165bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:29.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.376+0000 7f0568876640 1 -- 172.21.15.148:0/3932296679 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ec0913ef40 msgr2=0x55ec09165670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:29.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.376+0000 7f0568876640 1 --2- 172.21.15.148:0/3932296679 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ec0913ef40 0x55ec09165670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:29.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.376+0000 7f0568876640 1 -- 172.21.15.148:0/3932296679 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec09136260 con 0x55ec0913e620 2024-09-19T07:15:29.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.376+0000 7f0568876640 1 --2- 172.21.15.148:0/3932296679 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec0913e620 0x55ec09139e70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f055c009bb0 tx=0x7f055c0118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=695819950890585f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:29.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.376+0000 7f0559ffb640 1 -- 172.21.15.148:0/3932296679 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055c02d070 con 0x55ec0913e620 2024-09-19T07:15:29.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.376+0000 7f0559ffb640 1 -- 172.21.15.148:0/3932296679 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f055c00fd60 con 0x55ec0913e620 2024-09-19T07:15:29.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.376+0000 7f0559ffb640 1 -- 172.21.15.148:0/3932296679 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055c028a80 con 0x55ec0913e620 2024-09-19T07:15:29.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.377+0000 7f056c6b2740 1 -- 172.21.15.148:0/3932296679 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec0913e620 msgr2=0x55ec09139e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:29.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.377+0000 7f056c6b2740 1 --2- 172.21.15.148:0/3932296679 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec0913e620 0x55ec09139e70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f055c009bb0 tx=0x7f055c0118d0 comp rx=0 tx=0).stop 2024-09-19T07:15:29.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.377+0000 7f056c6b2740 1 -- 172.21.15.148:0/3932296679 shutdown_connections 2024-09-19T07:15:29.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.377+0000 7f056c6b2740 1 --2- 172.21.15.148:0/3932296679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ec0914dd50 0x55ec09165bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:29.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.377+0000 7f056c6b2740 1 --2- 172.21.15.148:0/3932296679 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ec0913ef40 0x55ec09165670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:29.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.377+0000 7f056c6b2740 1 --2- 172.21.15.148:0/3932296679 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec0913e620 0x55ec09139e70 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:29.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.377+0000 7f056c6b2740 1 -- 172.21.15.148:0/3932296679 >> 172.21.15.148:0/3932296679 conn(0x55ec0913acf0 msgr2=0x55ec0914ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:15:29.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.377+0000 7f056c6b2740 1 -- 172.21.15.148:0/3932296679 shutdown_connections 2024-09-19T07:15:29.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.377+0000 7f056c6b2740 1 -- 172.21.15.148:0/3932296679 wait complete. 2024-09-19T07:15:29.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.377+0000 7f056c6b2740 1 -- start start 2024-09-19T07:15:29.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.378+0000 7f056c6b2740 1 Processor -- start 2024-09-19T07:15:29.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.378+0000 7f056c6b2740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ec0913e620 0x55ec091561e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:29.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.378+0000 7f056c6b2740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ec0913ef40 0x55ec09151560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:29.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.378+0000 7f056c6b2740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec0914dd50 0x55ec09151aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:29.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.378+0000 7f056c6b2740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f05641a9d60 con 0x55ec0913e620 2024-09-19T07:15:29.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.378+0000 7f056c6b2740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f05641ab1d0 con 0x55ec0914dd50 2024-09-19T07:15:29.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.378+0000 7f056c6b2740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f05641aa430 con 0x55ec0913ef40 2024-09-19T07:15:29.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.378+0000 7f056c6b2740 10 client.0 _ll_register_callbacks cb 0x7f055c003df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:15:29.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.378+0000 7f0568876640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ec0913e620 0x55ec091561e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:29.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.378+0000 7f0568876640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ec0913e620 0x55ec091561e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57406/0 (socket says 172.21.15.148:57406) 2024-09-19T07:15:29.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.378+0000 7f0568876640 1 -- 172.21.15.148:0/2222624718 learned_addr learned my addr 172.21.15.148:0/2222624718 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:15:29.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.378+0000 7f055bfff640 1 --2- 172.21.15.148:0/2222624718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ec0913ef40 0x55ec09151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:29.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.378+0000 7f0568876640 1 --2- 172.21.15.148:0/2222624718 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec0914dd50 0x55ec09151aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:29.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.378+0000 7f0568876640 1 -- 172.21.15.148:0/2222624718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ec0913ef40 msgr2=0x55ec09151560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:29.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.378+0000 7f0568876640 1 --2- 172.21.15.148:0/2222624718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ec0913ef40 0x55ec09151560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:29.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.378+0000 7f0568876640 1 -- 172.21.15.148:0/2222624718 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec0914dd50 msgr2=0x55ec09151aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:29.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.378+0000 7f0568876640 1 --2- 172.21.15.148:0/2222624718 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec0914dd50 0x55ec09151aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:29.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.378+0000 7f0568876640 1 -- 172.21.15.148:0/2222624718 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec09152010 con 0x55ec0913e620 2024-09-19T07:15:29.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.378+0000 7f055bfff640 1 --2- 172.21.15.148:0/2222624718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ec0913ef40 0x55ec09151560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:15:29.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.379+0000 7f0568876640 1 --2- 172.21.15.148:0/2222624718 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ec0913e620 0x55ec091561e0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f055c009c20 tx=0x7f055c005cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=553ceb224feffd81 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:29.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.379+0000 7f05437fe640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:15:29.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.379+0000 7f05437fe640 1 -- 172.21.15.148:0/2222624718 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055c02d030 con 0x55ec0913e620 2024-09-19T07:15:29.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.379+0000 7f056c6b2740 1 -- 172.21.15.148:0/2222624718 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f055c00fd60 con 0x55ec0913e620 2024-09-19T07:15:29.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.379+0000 7f05437fe640 1 -- 172.21.15.148:0/2222624718 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f055c028a80 con 0x55ec0913e620 2024-09-19T07:15:29.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.379+0000 7f05437fe640 1 -- 172.21.15.148:0/2222624718 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f055c028690 con 0x55ec0913e620 2024-09-19T07:15:29.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.379+0000 7f056c6b2740 10 client.16413 fetch_fsmap learned FSMap version 33 2024-09-19T07:15:29.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.379+0000 7f056c6b2740 1 -- 172.21.15.148:0/2222624718 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55ec091413a0 con 0x55ec0913e620 2024-09-19T07:15:29.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.379+0000 7f05437fe640 1 -- 172.21.15.148:0/2222624718 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f055c00fd60 con 0x55ec0913e620 2024-09-19T07:15:29.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.379+0000 7f05437fe640 1 -- 172.21.15.148:0/2222624718 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 33) ==== 8362+0+0 (secure 0 0 0) 0x7f055c040920 con 0x55ec0913e620 2024-09-19T07:15:29.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.379+0000 7f056c6b2740 10 client.16413 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T07:15:29.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.379+0000 7f056c6b2740 10 client.16413 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:15:29.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.379+0000 7f056c6b2740 20 client.16413 populate_metadata read hostname 'smithi148' 2024-09-19T07:15:29.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.379+0000 7f056c6b2740 1 --2- 172.21.15.148:0/2222624718 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ec09141b30 0x55ec09143f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:29.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.379+0000 7f056c6b2740 4 client.16413 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.8, "await_for": 45.0}] 2024-09-19T07:15:29.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.379+0000 7f056c6b2740 1 -- 172.21.15.148:0/2222624718 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.8, "await_for": 45.0}) -- 0x55ec090abd20 con 0x55ec09141b30 2024-09-19T07:15:29.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.380+0000 7f055bfff640 1 --2- 172.21.15.148:0/2222624718 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ec09141b30 0x55ec09143f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:29.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.380+0000 7f05437fe640 10 client.16413 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:15:29.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:29.380+0000 7f055bfff640 1 --2- 172.21.15.148:0/2222624718 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ec09141b30 0x55ec09143f20 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=346fc8d35c1500b9 server_cookie=6ba9a7c9efe89512 in_seq=0 out_seq=0 2024-09-19T07:15:29.586 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.581+0000 7fab81d2a640 1 -- 172.21.15.148:0/1425408278 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab7c10c0f0 msgr2=0x7fab7c10e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:29.586 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.581+0000 7fab81d2a640 1 --2- 172.21.15.148:0/1425408278 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab7c10c0f0 0x7fab7c10e560 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fab74009ca0 tx=0x7fab7402a950 comp rx=0 tx=0).stop 2024-09-19T07:15:29.586 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.581+0000 7fab81d2a640 1 -- 172.21.15.148:0/1425408278 shutdown_connections 2024-09-19T07:15:29.587 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.581+0000 7fab81d2a640 1 --2- 172.21.15.148:0/1425408278 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab7c10c0f0 0x7fab7c10e560 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:29.587 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.581+0000 7fab81d2a640 1 --2- 172.21.15.148:0/1425408278 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab7c103640 0x7fab7c10bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:29.588 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.581+0000 7fab81d2a640 1 --2- 172.21.15.148:0/1425408278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab7c102d20 0x7fab7c103100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:29.588 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.581+0000 7fab81d2a640 1 -- 172.21.15.148:0/1425408278 >> 172.21.15.148:0/1425408278 conn(0x7fab7c077990 msgr2=0x7fab7c0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:15:29.588 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.581+0000 7fab81d2a640 1 -- 172.21.15.148:0/1425408278 shutdown_connections 2024-09-19T07:15:29.588 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.581+0000 7fab81d2a640 1 -- 172.21.15.148:0/1425408278 wait complete. 2024-09-19T07:15:29.588 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.582+0000 7fab81d2a640 1 Processor -- start 2024-09-19T07:15:29.588 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.582+0000 7fab81d2a640 1 -- start start 2024-09-19T07:15:29.588 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.582+0000 7fab81d2a640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab7c102d20 0x7fab7c198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:29.589 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.582+0000 7fab81d2a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab7c103640 0x7fab7c198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:29.589 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.582+0000 7fab81d2a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab7c10c0f0 0x7fab7c19cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:29.589 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.582+0000 7fab81d2a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c111ec0 con 0x7fab7c10c0f0 2024-09-19T07:15:29.589 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.582+0000 7fab81d2a640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c111d40 con 0x7fab7c102d20 2024-09-19T07:15:29.589 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.582+0000 7fab81d2a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c112040 con 0x7fab7c103640 2024-09-19T07:15:29.589 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.582+0000 7fab7b7fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab7c102d20 0x7fab7c198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:29.589 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.582+0000 7fab7affd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab7c103640 0x7fab7c198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:29.589 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.582+0000 7fab7b7fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab7c102d20 0x7fab7c198350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:43068/0 (socket says 172.21.15.148:43068) 2024-09-19T07:15:29.590 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.582+0000 7fab7b7fe640 1 -- 172.21.15.148:0/2982774979 learned_addr learned my addr 172.21.15.148:0/2982774979 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:15:29.590 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.582+0000 7fab7bfff640 1 --2- 172.21.15.148:0/2982774979 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab7c10c0f0 0x7fab7c19cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:29.590 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.583+0000 7fab7affd640 1 -- 172.21.15.148:0/2982774979 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab7c102d20 msgr2=0x7fab7c198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:29.590 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.583+0000 7fab7affd640 1 --2- 172.21.15.148:0/2982774979 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab7c102d20 0x7fab7c198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:29.590 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.583+0000 7fab7affd640 1 -- 172.21.15.148:0/2982774979 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab7c10c0f0 msgr2=0x7fab7c19cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:29.590 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.583+0000 7fab7affd640 1 --2- 172.21.15.148:0/2982774979 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab7c10c0f0 0x7fab7c19cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:29.590 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.583+0000 7fab7affd640 1 -- 172.21.15.148:0/2982774979 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab7c19d340 con 0x7fab7c103640 2024-09-19T07:15:29.591 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.583+0000 7fab7b7fe640 1 --2- 172.21.15.148:0/2982774979 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab7c102d20 0x7fab7c198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:15:29.591 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.583+0000 7fab7affd640 1 --2- 172.21.15.148:0/2982774979 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab7c103640 0x7fab7c198890 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fab7000e9f0 tx=0x7fab7000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:29.591 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.583+0000 7fab78ff9640 1 -- 172.21.15.148:0/2982774979 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab7000ccc0 con 0x7fab7c103640 2024-09-19T07:15:29.591 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.583+0000 7fab78ff9640 1 -- 172.21.15.148:0/2982774979 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab70010910 con 0x7fab7c103640 2024-09-19T07:15:29.591 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.583+0000 7fab81d2a640 1 -- 172.21.15.148:0/2982774979 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab7c19d630 con 0x7fab7c103640 2024-09-19T07:15:29.591 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.583+0000 7fab78ff9640 1 -- 172.21.15.148:0/2982774979 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab70018960 con 0x7fab7c103640 2024-09-19T07:15:29.591 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.583+0000 7fab81d2a640 1 -- 172.21.15.148:0/2982774979 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab7c1a4ec0 con 0x7fab7c103640 2024-09-19T07:15:29.598 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.586+0000 7fab78ff9640 1 -- 172.21.15.148:0/2982774979 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fab70010ac0 con 0x7fab7c103640 2024-09-19T07:15:29.598 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.586+0000 7fab84ac3740 1 Processor -- start 2024-09-19T07:15:29.598 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.586+0000 7fab84ac3740 1 -- start start 2024-09-19T07:15:29.598 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.586+0000 7fab84ac3740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cdf0c639d0 0x55cdf0c63db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:29.598 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.586+0000 7fab84ac3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cdf0c642f0 0x55cdf0c72b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:29.598 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.586+0000 7fab84ac3740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cdf0c730c0 0x55cdf0c754b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:29.598 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.586+0000 7fab84ac3740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55cdf0bc82f0 con 0x55cdf0c730c0 2024-09-19T07:15:29.599 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.586+0000 7fab84ac3740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55cdf0b70270 con 0x55cdf0c639d0 2024-09-19T07:15:29.599 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.586+0000 7fab84ac3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55cdf0bc42b0 con 0x55cdf0c642f0 2024-09-19T07:15:29.599 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.587+0000 7fab7bfff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cdf0c639d0 0x55cdf0c63db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:29.599 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.587+0000 7fab7affd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cdf0c730c0 0x55cdf0c754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:29.599 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.587+0000 7fab7b7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cdf0c642f0 0x55cdf0c72b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:29.599 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.587+0000 7fab7bfff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cdf0c639d0 0x55cdf0c63db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:43070/0 (socket says 172.21.15.148:43070) 2024-09-19T07:15:29.599 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.587+0000 7fab7bfff640 1 -- 172.21.15.148:0/2923196649 learned_addr learned my addr 172.21.15.148:0/2923196649 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:15:29.599 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.587+0000 7fab78ff9640 1 --2- 172.21.15.148:0/2982774979 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fab640a3460 0x7fab640a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:29.599 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.587+0000 7fab7bfff640 1 -- 172.21.15.148:0/2923196649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cdf0c642f0 msgr2=0x55cdf0c72b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:29.599 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.587+0000 7fab7bfff640 1 --2- 172.21.15.148:0/2923196649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cdf0c642f0 0x55cdf0c72b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:29.599 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.587+0000 7fab7bfff640 1 -- 172.21.15.148:0/2923196649 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cdf0c730c0 msgr2=0x55cdf0c754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:29.600 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.587+0000 7fab7bfff640 1 --2- 172.21.15.148:0/2923196649 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cdf0c730c0 0x55cdf0c754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:29.600 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.587+0000 7fab7bfff640 1 -- 172.21.15.148:0/2923196649 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdf0b6f340 con 0x55cdf0c639d0 2024-09-19T07:15:29.600 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.587+0000 7fab78ff9640 1 -- 172.21.15.148:0/2982774979 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fab700d0020 con 0x7fab7c103640 2024-09-19T07:15:29.600 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.587+0000 7fab7bfff640 1 --2- 172.21.15.148:0/2982774979 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fab640a3460 0x7fab640a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:29.600 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.587+0000 7fab7bfff640 1 --2- 172.21.15.148:0/2923196649 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cdf0c639d0 0x55cdf0c63db0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fab74009a40 tx=0x7fab740093e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94f0ef32580f671 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:29.600 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.587+0000 7fab61ffb640 1 -- 172.21.15.148:0/2923196649 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab7404c070 con 0x55cdf0c639d0 2024-09-19T07:15:29.600 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.588+0000 7fab61ffb640 1 -- 172.21.15.148:0/2923196649 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab74003e50 con 0x55cdf0c639d0 2024-09-19T07:15:29.600 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.588+0000 7fab61ffb640 1 -- 172.21.15.148:0/2923196649 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab74034040 con 0x55cdf0c639d0 2024-09-19T07:15:29.600 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.588+0000 7fab7bfff640 1 --2- 172.21.15.148:0/2982774979 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fab640a3460 0x7fab640a5920 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fab74049000 tx=0x7fab7404c000 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:29.600 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.588+0000 7fab84ac3740 1 -- 172.21.15.148:0/2923196649 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cdf0c639d0 msgr2=0x55cdf0c63db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:29.600 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.588+0000 7fab84ac3740 1 --2- 172.21.15.148:0/2923196649 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cdf0c639d0 0x55cdf0c63db0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fab74009a40 tx=0x7fab740093e0 comp rx=0 tx=0).stop 2024-09-19T07:15:29.600 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.588+0000 7fab84ac3740 1 -- 172.21.15.148:0/2923196649 shutdown_connections 2024-09-19T07:15:29.601 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.588+0000 7fab84ac3740 1 --2- 172.21.15.148:0/2923196649 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cdf0c730c0 0x55cdf0c754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:29.601 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.588+0000 7fab84ac3740 1 --2- 172.21.15.148:0/2923196649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cdf0c642f0 0x55cdf0c72b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:29.601 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.588+0000 7fab84ac3740 1 --2- 172.21.15.148:0/2923196649 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cdf0c639d0 0x55cdf0c63db0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:29.601 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.588+0000 7fab84ac3740 1 -- 172.21.15.148:0/2923196649 >> 172.21.15.148:0/2923196649 conn(0x55cdf0c60060 msgr2=0x55cdf0c60440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:15:29.601 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.588+0000 7fab84ac3740 1 -- 172.21.15.148:0/2923196649 shutdown_connections 2024-09-19T07:15:29.601 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.588+0000 7fab84ac3740 1 -- 172.21.15.148:0/2923196649 wait complete. 2024-09-19T07:15:29.601 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.589+0000 7fab84ac3740 1 -- start start 2024-09-19T07:15:29.601 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.589+0000 7fab84ac3740 1 Processor -- start 2024-09-19T07:15:29.601 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.589+0000 7fab84ac3740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cdf0c639d0 0x55cdf0c70050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.589+0000 7fab84ac3740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cdf0c642f0 0x55cdf0c70590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.589+0000 7fab84ac3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cdf0c730c0 0x55cdf0c70ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.589+0000 7fab84ac3740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55cdf0c75cf0 con 0x55cdf0c642f0 2024-09-19T07:15:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.589+0000 7fab84ac3740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55cdf0b51290 con 0x55cdf0c639d0 2024-09-19T07:15:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.589+0000 7fab84ac3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55cdf0c75e70 con 0x55cdf0c730c0 2024-09-19T07:15:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.589+0000 7fab84ac3740 10 client.0 _ll_register_callbacks cb 0x55cdf0b82140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:15:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.590+0000 7fab7affd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cdf0c642f0 0x55cdf0c70590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.590+0000 7fab7b7fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cdf0c639d0 0x55cdf0c70050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.590+0000 7fab7b7fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cdf0c639d0 0x55cdf0c70050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:43084/0 (socket says 172.21.15.148:43084) 2024-09-19T07:15:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.590+0000 7fab7b7fe640 1 -- 172.21.15.148:0/587239118 learned_addr learned my addr 172.21.15.148:0/587239118 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:15:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.590+0000 7fab7affd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cdf0c642f0 0x55cdf0c70590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57434/0 (socket says 172.21.15.148:57434) 2024-09-19T07:15:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.590+0000 7fab7bfff640 1 --2- 172.21.15.148:0/587239118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cdf0c730c0 0x55cdf0c70ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.590+0000 7fab7affd640 1 -- 172.21.15.148:0/587239118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cdf0c730c0 msgr2=0x55cdf0c70ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.590+0000 7fab7affd640 1 --2- 172.21.15.148:0/587239118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cdf0c730c0 0x55cdf0c70ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.590+0000 7fab7affd640 1 -- 172.21.15.148:0/587239118 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cdf0c639d0 msgr2=0x55cdf0c70050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.590+0000 7fab7affd640 1 --2- 172.21.15.148:0/587239118 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cdf0c639d0 0x55cdf0c70050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.590+0000 7fab7affd640 1 -- 172.21.15.148:0/587239118 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cdf08db210 con 0x55cdf0c642f0 2024-09-19T07:15:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.590+0000 7fab7b7fe640 1 --2- 172.21.15.148:0/587239118 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cdf0c639d0 0x55cdf0c70050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:15:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.590+0000 7fab7affd640 1 --2- 172.21.15.148:0/587239118 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cdf0c642f0 0x55cdf0c70590 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fab700cd780 tx=0x7fab700d3640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=627a87192a8e857c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.590+0000 7fab5affd640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:15:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.590+0000 7fab5affd640 1 -- 172.21.15.148:0/587239118 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab7009c190 con 0x55cdf0c642f0 2024-09-19T07:15:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.590+0000 7fab84ac3740 1 -- 172.21.15.148:0/587239118 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab74003e50 con 0x55cdf0c642f0 2024-09-19T07:15:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.590+0000 7fab5affd640 1 -- 172.21.15.148:0/587239118 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fab700cda00 con 0x55cdf0c642f0 2024-09-19T07:15:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.590+0000 7fab5affd640 1 -- 172.21.15.148:0/587239118 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fab7009bd20 con 0x55cdf0c642f0 2024-09-19T07:15:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.590+0000 7fab84ac3740 10 client.16425 fetch_fsmap learned FSMap version 33 2024-09-19T07:15:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.590+0000 7fab84ac3740 1 -- 172.21.15.148:0/587239118 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55cdf09a7620 con 0x55cdf0c642f0 2024-09-19T07:15:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.591+0000 7fab5affd640 1 -- 172.21.15.148:0/587239118 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab74003e50 con 0x55cdf0c642f0 2024-09-19T07:15:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.591+0000 7fab5affd640 1 -- 172.21.15.148:0/587239118 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 33) ==== 8362+0+0 (secure 0 0 0) 0x7fab7009b810 con 0x55cdf0c642f0 2024-09-19T07:15:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.591+0000 7fab84ac3740 10 client.16425 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T07:15:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.591+0000 7fab84ac3740 10 client.16425 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:15:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.591+0000 7fab84ac3740 20 client.16425 populate_metadata read hostname 'smithi148' 2024-09-19T07:15:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.591+0000 7fab84ac3740 1 --2- 172.21.15.148:0/587239118 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55cdf0c83100 0x55cdf0c854f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.591+0000 7fab84ac3740 4 client.16425 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:15:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.591+0000 7fab84ac3740 1 -- 172.21.15.148:0/587239118 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cdf0bd5a20 con 0x55cdf0c83100 2024-09-19T07:15:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.591+0000 7fab7b7fe640 1 --2- 172.21.15.148:0/587239118 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55cdf0c83100 0x55cdf0c854f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.591+0000 7fab5affd640 10 client.16425 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:15:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.591+0000 7fab7b7fe640 1 --2- 172.21.15.148:0/587239118 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55cdf0c83100 0x55cdf0c854f0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e0f7e947e41eb18 server_cookie=43547a3830f747d9 in_seq=0 out_seq=0 2024-09-19T07:15:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.592+0000 7fab5affd640 1 -- 172.21.15.148:0/587239118 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cdf0bd5a20 con 0x55cdf0c83100 2024-09-19T07:15:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.592+0000 7fab5affd640 10 client.16425 handle_command_reply: tid=0 2024-09-19T07:15:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.592+0000 7fab84ac3740 1 client.16425 shutdown 2024-09-19T07:15:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.592+0000 7fab84ac3740 1 -- 172.21.15.148:0/587239118 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cdf0c642f0 msgr2=0x55cdf0c70590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.592+0000 7fab84ac3740 1 --2- 172.21.15.148:0/587239118 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cdf0c642f0 0x55cdf0c70590 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fab700cd780 tx=0x7fab700d3640 comp rx=0 tx=0).stop 2024-09-19T07:15:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.592+0000 7fab84ac3740 1 -- 172.21.15.148:0/587239118 shutdown_connections 2024-09-19T07:15:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.592+0000 7fab84ac3740 1 --2- 172.21.15.148:0/587239118 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55cdf0c83100 0x55cdf0c854f0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.593+0000 7fab84ac3740 1 --2- 172.21.15.148:0/587239118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cdf0c730c0 0x55cdf0c70ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.593+0000 7fab5affd640 0 client.16425 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:15:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.593+0000 7fab84ac3740 1 --2- 172.21.15.148:0/587239118 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cdf0c642f0 0x55cdf0c70590 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.593+0000 7fab84ac3740 1 --2- 172.21.15.148:0/587239118 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cdf0c639d0 0x55cdf0c70050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.593+0000 7fab84ac3740 1 -- 172.21.15.148:0/587239118 >> 172.21.15.148:0/587239118 conn(0x55cdf0c60060 msgr2=0x55cdf0c65dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:15:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.593+0000 7fab84ac3740 1 -- 172.21.15.148:0/587239118 shutdown_connections 2024-09-19T07:15:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.593+0000 7fab84ac3740 1 -- 172.21.15.148:0/587239118 wait complete. 2024-09-19T07:15:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.593+0000 7fab84ac3740 20 client.16425 trim_cache size 0 max 16384 2024-09-19T07:15:29.614 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.610+0000 7fab84ac3740 1 Processor -- start 2024-09-19T07:15:29.614 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.610+0000 7fab84ac3740 1 -- start start 2024-09-19T07:15:29.614 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.611+0000 7fab84ac3740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cdf0c639d0 0x55cdf0c71fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:29.614 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.611+0000 7fab84ac3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cdf0c642f0 0x55cdf0c8adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:29.614 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.611+0000 7fab84ac3740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cdf0c730c0 0x55cdf0c8b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:29.614 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.611+0000 7fab84ac3740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c1ade40 con 0x55cdf0c639d0 2024-09-19T07:15:29.615 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.611+0000 7fab84ac3740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c1ab6b0 con 0x55cdf0c730c0 2024-09-19T07:15:29.615 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.611+0000 7fab84ac3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c1a9500 con 0x55cdf0c642f0 2024-09-19T07:15:29.615 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.611+0000 7fab7b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cdf0c639d0 0x55cdf0c71fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:29.615 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.611+0000 7fab7b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cdf0c639d0 0x55cdf0c71fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57440/0 (socket says 172.21.15.148:57440) 2024-09-19T07:15:29.615 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.611+0000 7fab7b7fe640 1 -- 172.21.15.148:0/919735479 learned_addr learned my addr 172.21.15.148:0/919735479 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:15:29.615 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.611+0000 7fab7bfff640 1 --2- 172.21.15.148:0/919735479 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cdf0c730c0 0x55cdf0c8b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:29.616 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.611+0000 7fab7affd640 1 --2- 172.21.15.148:0/919735479 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cdf0c642f0 0x55cdf0c8adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:29.616 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.611+0000 7fab7b7fe640 1 -- 172.21.15.148:0/919735479 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cdf0c642f0 msgr2=0x55cdf0c8adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:29.616 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.611+0000 7fab7b7fe640 1 --2- 172.21.15.148:0/919735479 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cdf0c642f0 0x55cdf0c8adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:29.616 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.611+0000 7fab7b7fe640 1 -- 172.21.15.148:0/919735479 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cdf0c730c0 msgr2=0x55cdf0c8b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:29.616 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.611+0000 7fab7b7fe640 1 --2- 172.21.15.148:0/919735479 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cdf0c730c0 0x55cdf0c8b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:29.616 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.611+0000 7fab7b7fe640 1 -- 172.21.15.148:0/919735479 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdf0c75820 con 0x55cdf0c639d0 2024-09-19T07:15:29.616 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.611+0000 7fab7b7fe640 1 --2- 172.21.15.148:0/919735479 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cdf0c639d0 0x55cdf0c71fc0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fab6c012a70 tx=0x7fab6c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c85a0683fb74d9f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:29.616 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.611+0000 7fab617fa640 1 -- 172.21.15.148:0/919735479 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab6c012110 con 0x55cdf0c639d0 2024-09-19T07:15:29.616 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.612+0000 7fab617fa640 1 -- 172.21.15.148:0/919735479 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab6c005500 con 0x55cdf0c639d0 2024-09-19T07:15:29.617 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.612+0000 7fab617fa640 1 -- 172.21.15.148:0/919735479 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab6c010430 con 0x55cdf0c639d0 2024-09-19T07:15:29.617 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.612+0000 7fab84ac3740 1 -- 172.21.15.148:0/919735479 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cdf0c639d0 msgr2=0x55cdf0c71fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:29.617 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.612+0000 7fab84ac3740 1 --2- 172.21.15.148:0/919735479 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cdf0c639d0 0x55cdf0c71fc0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fab6c012a70 tx=0x7fab6c005f90 comp rx=0 tx=0).stop 2024-09-19T07:15:29.617 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.612+0000 7fab84ac3740 1 -- 172.21.15.148:0/919735479 shutdown_connections 2024-09-19T07:15:29.617 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.612+0000 7fab84ac3740 1 --2- 172.21.15.148:0/919735479 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cdf0c730c0 0x55cdf0c8b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:29.617 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.612+0000 7fab84ac3740 1 --2- 172.21.15.148:0/919735479 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cdf0c642f0 0x55cdf0c8adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:29.617 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.612+0000 7fab84ac3740 1 --2- 172.21.15.148:0/919735479 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cdf0c639d0 0x55cdf0c71fc0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:29.617 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.612+0000 7fab84ac3740 1 -- 172.21.15.148:0/919735479 >> 172.21.15.148:0/919735479 conn(0x55cdf0c60060 msgr2=0x55cdf0c718b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:15:29.618 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.613+0000 7fab84ac3740 1 -- 172.21.15.148:0/919735479 shutdown_connections 2024-09-19T07:15:29.618 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.613+0000 7fab84ac3740 1 -- 172.21.15.148:0/919735479 wait complete. 2024-09-19T07:15:29.618 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.613+0000 7fab84ac3740 1 -- start start 2024-09-19T07:15:29.618 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.613+0000 7fab84ac3740 1 Processor -- start 2024-09-19T07:15:29.622 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.613+0000 7fab84ac3740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cdf0c639d0 0x55cdf0c7b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:29.622 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.613+0000 7fab84ac3740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cdf0c642f0 0x55cdf0c7b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:29.622 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.613+0000 7fab84ac3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cdf0c730c0 0x55cdf0c78090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:29.622 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.613+0000 7fab84ac3740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c1a9b70 con 0x55cdf0c639d0 2024-09-19T07:15:29.622 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.613+0000 7fab84ac3740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c1aafe0 con 0x55cdf0c642f0 2024-09-19T07:15:29.622 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.613+0000 7fab84ac3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c1aa240 con 0x55cdf0c730c0 2024-09-19T07:15:29.622 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.613+0000 7fab84ac3740 10 client.0 _ll_register_callbacks cb 0x7fab700d3800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:15:29.622 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.614+0000 7fab7b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cdf0c639d0 0x55cdf0c7b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:29.623 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.614+0000 7fab7b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cdf0c639d0 0x55cdf0c7b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57442/0 (socket says 172.21.15.148:57442) 2024-09-19T07:15:29.623 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.614+0000 7fab7b7fe640 1 -- 172.21.15.148:0/2455755615 learned_addr learned my addr 172.21.15.148:0/2455755615 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:15:29.623 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.614+0000 7fab7affd640 1 --2- 172.21.15.148:0/2455755615 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cdf0c642f0 0x55cdf0c7b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:29.623 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.614+0000 7fab7bfff640 1 --2- 172.21.15.148:0/2455755615 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cdf0c730c0 0x55cdf0c78090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:29.623 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.614+0000 7fab7b7fe640 1 -- 172.21.15.148:0/2455755615 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cdf0c730c0 msgr2=0x55cdf0c78090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:29.623 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.614+0000 7fab7b7fe640 1 --2- 172.21.15.148:0/2455755615 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cdf0c730c0 0x55cdf0c78090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:29.623 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.614+0000 7fab7b7fe640 1 -- 172.21.15.148:0/2455755615 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cdf0c642f0 msgr2=0x55cdf0c7b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:29.624 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.614+0000 7fab7b7fe640 1 --2- 172.21.15.148:0/2455755615 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cdf0c642f0 0x55cdf0c7b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:29.624 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.614+0000 7fab7b7fe640 1 -- 172.21.15.148:0/2455755615 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cdf0c785d0 con 0x55cdf0c639d0 2024-09-19T07:15:29.624 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.614+0000 7fab7b7fe640 1 --2- 172.21.15.148:0/2455755615 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cdf0c639d0 0x55cdf0c7b0c0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fab6c014010 tx=0x7fab6c005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f295f794dd27fe4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:29.624 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.614+0000 7fab5affd640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:15:29.624 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.614+0000 7fab5affd640 1 -- 172.21.15.148:0/2455755615 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab6c038060 con 0x55cdf0c639d0 2024-09-19T07:15:29.624 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.614+0000 7fab5affd640 1 -- 172.21.15.148:0/2455755615 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fab6c012110 con 0x55cdf0c639d0 2024-09-19T07:15:29.624 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.614+0000 7fab84ac3740 1 -- 172.21.15.148:0/2455755615 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab6c005500 con 0x55cdf0c639d0 2024-09-19T07:15:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.614+0000 7fab5affd640 1 -- 172.21.15.148:0/2455755615 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fab6c004700 con 0x55cdf0c639d0 2024-09-19T07:15:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.614+0000 7fab84ac3740 10 client.16431 fetch_fsmap learned FSMap version 33 2024-09-19T07:15:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.614+0000 7fab84ac3740 1 -- 172.21.15.148:0/2455755615 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55cdf0cee3f0 con 0x55cdf0c639d0 2024-09-19T07:15:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.615+0000 7fab5affd640 1 -- 172.21.15.148:0/2455755615 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab6c005500 con 0x55cdf0c639d0 2024-09-19T07:15:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.615+0000 7fab5affd640 1 -- 172.21.15.148:0/2455755615 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 33) ==== 8362+0+0 (secure 0 0 0) 0x7fab6c033490 con 0x55cdf0c639d0 2024-09-19T07:15:29.626 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.615+0000 7fab84ac3740 10 client.16431 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T07:15:29.626 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.615+0000 7fab84ac3740 10 client.16431 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:15:29.626 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.615+0000 7fab84ac3740 20 client.16431 populate_metadata read hostname 'smithi148' 2024-09-19T07:15:29.626 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.615+0000 7fab84ac3740 1 --2- 172.21.15.148:0/2455755615 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55cdf0ceeb10 0x55cdf0cf0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:29.626 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.615+0000 7fab84ac3740 4 client.16431 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:15:29.627 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.615+0000 7fab84ac3740 1 -- 172.21.15.148:0/2455755615 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cdf0bcfd70 con 0x55cdf0ceeb10 2024-09-19T07:15:29.627 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.615+0000 7fab7affd640 1 --2- 172.21.15.148:0/2455755615 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55cdf0ceeb10 0x55cdf0cf0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:29.627 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.615+0000 7fab5affd640 10 client.16431 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:15:29.627 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:29.615+0000 7fab7affd640 1 --2- 172.21.15.148:0/2455755615 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55cdf0ceeb10 0x55cdf0cf0f30 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fc60e7088a66f19 server_cookie=a7108c8342b25f6c in_seq=0 out_seq=0 2024-09-19T07:15:31.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:15:30 smithi179 ceph-mon[35716]: pgmap v136: 97 pgs: 97 active+clean; 730 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 17 MiB/s wr, 891 op/s 2024-09-19T07:15:31.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:15:30 smithi148 ceph-mon[31180]: pgmap v136: 97 pgs: 97 active+clean; 730 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 17 MiB/s wr, 891 op/s 2024-09-19T07:15:31.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:15:30 smithi165 ceph-mon[35326]: pgmap v136: 97 pgs: 97 active+clean; 730 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 17 MiB/s wr, 891 op/s 2024-09-19T07:15:31.781 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:31.780+0000 7fab5affd640 1 -- 172.21.15.148:0/2455755615 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cdf0bcfd70 con 0x55cdf0ceeb10 2024-09-19T07:15:31.781 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:31.780+0000 7fab5affd640 10 client.16431 handle_command_reply: tid=0 2024-09-19T07:15:31.781 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:31.780+0000 7fab84ac3740 1 client.16431 shutdown 2024-09-19T07:15:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:31.781+0000 7fab84ac3740 1 -- 172.21.15.148:0/2455755615 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cdf0c639d0 msgr2=0x55cdf0c7b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:31.781+0000 7fab84ac3740 1 --2- 172.21.15.148:0/2455755615 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cdf0c639d0 0x55cdf0c7b0c0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fab6c014010 tx=0x7fab6c005740 comp rx=0 tx=0).stop 2024-09-19T07:15:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:31.781+0000 7fab84ac3740 1 -- 172.21.15.148:0/2455755615 shutdown_connections 2024-09-19T07:15:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:31.781+0000 7fab84ac3740 1 --2- 172.21.15.148:0/2455755615 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55cdf0ceeb10 0x55cdf0cf0f30 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:31.781+0000 7fab84ac3740 1 --2- 172.21.15.148:0/2455755615 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cdf0c730c0 0x55cdf0c78090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:31.781+0000 7fab84ac3740 1 --2- 172.21.15.148:0/2455755615 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cdf0c642f0 0x55cdf0c7b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:31.783 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:31.781+0000 7fab84ac3740 1 --2- 172.21.15.148:0/2455755615 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cdf0c639d0 0x55cdf0c7b0c0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:31.783 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:31.781+0000 7fab84ac3740 1 -- 172.21.15.148:0/2455755615 >> 172.21.15.148:0/2455755615 conn(0x55cdf0c60060 msgr2=0x55cdf0c720d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:15:31.783 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:31.781+0000 7fab5affd640 0 client.16431 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:15:31.783 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:31.781+0000 7fab84ac3740 1 -- 172.21.15.148:0/2455755615 shutdown_connections 2024-09-19T07:15:31.783 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:31.781+0000 7fab84ac3740 1 -- 172.21.15.148:0/2455755615 wait complete. 2024-09-19T07:15:31.783 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:31.781+0000 7fab84ac3740 20 client.16431 trim_cache size 0 max 16384 2024-09-19T07:15:31.783 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:15:31.783 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:15:31.783 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:15:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:15:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:31.782+0000 7fab81d2a640 1 -- 172.21.15.148:0/2982774979 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fab640a3460 msgr2=0x7fab640a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:31.782+0000 7fab81d2a640 1 --2- 172.21.15.148:0/2982774979 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fab640a3460 0x7fab640a5920 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fab74049000 tx=0x7fab7404c000 comp rx=0 tx=0).stop 2024-09-19T07:15:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:31.782+0000 7fab81d2a640 1 -- 172.21.15.148:0/2982774979 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab7c103640 msgr2=0x7fab7c198890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:31.782+0000 7fab81d2a640 1 --2- 172.21.15.148:0/2982774979 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab7c103640 0x7fab7c198890 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fab7000e9f0 tx=0x7fab7000eeb0 comp rx=0 tx=0).stop 2024-09-19T07:15:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:31.782+0000 7fab81d2a640 1 -- 172.21.15.148:0/2982774979 shutdown_connections 2024-09-19T07:15:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:31.782+0000 7fab81d2a640 1 --2- 172.21.15.148:0/2982774979 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fab640a3460 0x7fab640a5920 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:31.782+0000 7fab81d2a640 1 --2- 172.21.15.148:0/2982774979 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab7c10c0f0 0x7fab7c19cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:31.782+0000 7fab81d2a640 1 --2- 172.21.15.148:0/2982774979 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab7c103640 0x7fab7c198890 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:31.782+0000 7fab81d2a640 1 --2- 172.21.15.148:0/2982774979 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab7c102d20 0x7fab7c198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:31.782+0000 7fab81d2a640 1 -- 172.21.15.148:0/2982774979 >> 172.21.15.148:0/2982774979 conn(0x7fab7c077990 msgr2=0x7fab7c0fcee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:15:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:31.782+0000 7fab81d2a640 1 -- 172.21.15.148:0/2982774979 shutdown_connections 2024-09-19T07:15:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:31.782+0000 7fab81d2a640 1 -- 172.21.15.148:0/2982774979 wait complete. 2024-09-19T07:15:33.194 INFO:tasks.workunit.client.0.smithi148.stdout: 229 745331 153 511112 187 215555 1228 2024-09-19T07:15:33.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:15:32 smithi179 ceph-mon[35716]: pgmap v137: 97 pgs: 97 active+clean; 864 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 28 MiB/s wr, 1.49k op/s 2024-09-19T07:15:33.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:15:32 smithi148 ceph-mon[31180]: pgmap v137: 97 pgs: 97 active+clean; 864 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 28 MiB/s wr, 1.49k op/s 2024-09-19T07:15:33.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:15:32 smithi165 ceph-mon[35326]: pgmap v137: 97 pgs: 97 active+clean; 864 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 28 MiB/s wr, 1.49k op/s 2024-09-19T07:15:35.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:15:34 smithi179 ceph-mon[35716]: pgmap v138: 97 pgs: 97 active+clean; 864 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 27 MiB/s wr, 1.31k op/s 2024-09-19T07:15:35.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:15:34 smithi148 ceph-mon[31180]: pgmap v138: 97 pgs: 97 active+clean; 864 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 27 MiB/s wr, 1.31k op/s 2024-09-19T07:15:35.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:15:34 smithi165 ceph-mon[35326]: pgmap v138: 97 pgs: 97 active+clean; 864 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 27 MiB/s wr, 1.31k op/s 2024-09-19T07:15:37.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:15:36 smithi179 ceph-mon[35716]: pgmap v139: 97 pgs: 97 active+clean; 832 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 28 MiB/s wr, 2.21k op/s 2024-09-19T07:15:37.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:15:36 smithi148 ceph-mon[31180]: pgmap v139: 97 pgs: 97 active+clean; 832 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 28 MiB/s wr, 2.21k op/s 2024-09-19T07:15:37.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:15:36 smithi165 ceph-mon[35326]: pgmap v139: 97 pgs: 97 active+clean; 832 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 28 MiB/s wr, 2.21k op/s 2024-09-19T07:15:39.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:15:38 smithi179 ceph-mon[35716]: pgmap v140: 97 pgs: 97 active+clean; 832 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 13 MiB/s wr, 1.50k op/s 2024-09-19T07:15:39.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:15:38 smithi148 ceph-mon[31180]: pgmap v140: 97 pgs: 97 active+clean; 832 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 13 MiB/s wr, 1.50k op/s 2024-09-19T07:15:39.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:15:38 smithi165 ceph-mon[35326]: pgmap v140: 97 pgs: 97 active+clean; 832 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 13 MiB/s wr, 1.50k op/s 2024-09-19T07:15:41.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:15:40 smithi179 ceph-mon[35716]: pgmap v141: 97 pgs: 97 active+clean; 832 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 13 MiB/s wr, 1.50k op/s 2024-09-19T07:15:41.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:15:40 smithi148 ceph-mon[31180]: pgmap v141: 97 pgs: 97 active+clean; 832 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 13 MiB/s wr, 1.50k op/s 2024-09-19T07:15:41.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:15:40 smithi165 ceph-mon[35326]: pgmap v141: 97 pgs: 97 active+clean; 832 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 13 MiB/s wr, 1.50k op/s 2024-09-19T07:15:43.190 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:15:43.190 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 33, 2024-09-19T07:15:43.190 INFO:teuthology.orchestra.run.smithi148.stdout: "leader": 24457, 2024-09-19T07:15:43.190 INFO:teuthology.orchestra.run.smithi148.stdout: "set_version": 18, 2024-09-19T07:15:43.190 INFO:teuthology.orchestra.run.smithi148.stdout: "sets": { 2024-09-19T07:15:43.190 INFO:teuthology.orchestra.run.smithi148.stdout: "9d178c44": { 2024-09-19T07:15:43.190 INFO:teuthology.orchestra.run.smithi148.stdout: "version": 18, 2024-09-19T07:15:43.190 INFO:teuthology.orchestra.run.smithi148.stdout: "age_ref": 0.0, 2024-09-19T07:15:43.190 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:15:43.191 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "QUIESCED", 2024-09-19T07:15:43.191 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:15:43.191 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:15:43.191 INFO:teuthology.orchestra.run.smithi148.stdout: "timeout": 90.0, 2024-09-19T07:15:43.191 INFO:teuthology.orchestra.run.smithi148.stdout: "expiration": 149.8, 2024-09-19T07:15:43.191 INFO:teuthology.orchestra.run.smithi148.stdout: "members": { 2024-09-19T07:15:43.191 INFO:teuthology.orchestra.run.smithi148.stdout: "file:/": { 2024-09-19T07:15:43.191 INFO:teuthology.orchestra.run.smithi148.stdout: "excluded": false, 2024-09-19T07:15:43.191 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:15:43.191 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "QUIESCED", 2024-09-19T07:15:43.191 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:15:43.191 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:15:43.191 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:15:43.191 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:15:43.192 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:15:43.192 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:15:43.192 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:15:43.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:43.188+0000 7f05437fe640 1 -- 172.21.15.148:0/2222624718 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55ec090abd20 con 0x55ec09141b30 2024-09-19T07:15:43.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:43.188+0000 7f05437fe640 10 client.16413 handle_command_reply: tid=0 2024-09-19T07:15:43.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:43.188+0000 7f056c6b2740 1 client.16413 shutdown 2024-09-19T07:15:43.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:43.188+0000 7f056c6b2740 1 -- 172.21.15.148:0/2222624718 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ec0913e620 msgr2=0x55ec091561e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:43.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:43.188+0000 7f056c6b2740 1 --2- 172.21.15.148:0/2222624718 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ec0913e620 0x55ec091561e0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f055c009c20 tx=0x7f055c005cf0 comp rx=0 tx=0).stop 2024-09-19T07:15:43.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:43.188+0000 7f056c6b2740 1 -- 172.21.15.148:0/2222624718 shutdown_connections 2024-09-19T07:15:43.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:43.188+0000 7f056c6b2740 1 --2- 172.21.15.148:0/2222624718 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ec09141b30 0x55ec09143f20 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:43.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:43.188+0000 7f056c6b2740 1 --2- 172.21.15.148:0/2222624718 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec0914dd50 0x55ec09151aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:43.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:43.188+0000 7f056c6b2740 1 --2- 172.21.15.148:0/2222624718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ec0913ef40 0x55ec09151560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:43.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:43.188+0000 7f05437fe640 0 client.16413 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:15:43.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:43.188+0000 7f056c6b2740 1 --2- 172.21.15.148:0/2222624718 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ec0913e620 0x55ec091561e0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:43.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:43.188+0000 7f056c6b2740 1 -- 172.21.15.148:0/2222624718 >> 172.21.15.148:0/2222624718 conn(0x55ec0913acf0 msgr2=0x55ec0914b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:15:43.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:43.188+0000 7f056c6b2740 1 -- 172.21.15.148:0/2222624718 shutdown_connections 2024-09-19T07:15:43.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:43.188+0000 7f056c6b2740 1 -- 172.21.15.148:0/2222624718 wait complete. 2024-09-19T07:15:43.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:43.188+0000 7f056c6b2740 20 client.16413 trim_cache size 0 max 16384 2024-09-19T07:15:43.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:43.189+0000 7f056a2d9640 1 -- 172.21.15.148:0/850417926 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f05500a3430 msgr2=0x7f05500a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:43.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:43.189+0000 7f056a2d9640 1 --2- 172.21.15.148:0/850417926 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f05500a3430 0x7f05500a58f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f055409c2e0 tx=0x7f05540d3880 comp rx=0 tx=0).stop 2024-09-19T07:15:43.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:43.189+0000 7f056a2d9640 1 -- 172.21.15.148:0/850417926 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0564100a70 msgr2=0x7f0564199300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:43.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:43.189+0000 7f056a2d9640 1 --2- 172.21.15.148:0/850417926 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0564100a70 0x7f0564199300 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f055400e9f0 tx=0x7f055400edf0 comp rx=0 tx=0).stop 2024-09-19T07:15:43.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:43.189+0000 7f056a2d9640 1 -- 172.21.15.148:0/850417926 shutdown_connections 2024-09-19T07:15:43.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:43.189+0000 7f056a2d9640 1 --2- 172.21.15.148:0/850417926 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f05500a3430 0x7f05500a58f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:43.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:43.189+0000 7f056a2d9640 1 --2- 172.21.15.148:0/850417926 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0564106a70 0x7f05641a4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:43.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:43.189+0000 7f056a2d9640 1 --2- 172.21.15.148:0/850417926 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0564101410 0x7f0564199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:43.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:43.189+0000 7f056a2d9640 1 --2- 172.21.15.148:0/850417926 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0564100a70 0x7f0564199300 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:43.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:43.189+0000 7f056a2d9640 1 -- 172.21.15.148:0/850417926 >> 172.21.15.148:0/850417926 conn(0x7f05640fc7d0 msgr2=0x7f05640fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:15:43.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:43.189+0000 7f056a2d9640 1 -- 172.21.15.148:0/850417926 shutdown_connections 2024-09-19T07:15:43.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:43.189+0000 7f056a2d9640 1 -- 172.21.15.148:0/850417926 wait complete. 2024-09-19T07:15:43.195 INFO:tasks.workunit.client.0.smithi148.stdout: 229 1701 0 1529 0 3166 1 2024-09-19T07:15:43.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:15:42 smithi179 ceph-mon[35716]: pgmap v142: 97 pgs: 97 active+clean; 854 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 15 MiB/s wr, 1.74k op/s 2024-09-19T07:15:43.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:15:42 smithi148 ceph-mon[31180]: pgmap v142: 97 pgs: 97 active+clean; 854 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 15 MiB/s wr, 1.74k op/s 2024-09-19T07:15:43.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:15:42 smithi165 ceph-mon[35326]: pgmap v142: 97 pgs: 97 active+clean; 854 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 15 MiB/s wr, 1.74k op/s 2024-09-19T07:15:44.143 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '9d178c44', quiesce took 24.2 seconds. Will release after: 5.600000000000001 2024-09-19T07:15:44.882 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.878+0000 7fb0b2a65640 1 -- 172.21.15.148:0/949266874 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0ac101350 msgr2=0x7fb0ac10d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:44.882 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.878+0000 7fb0b2a65640 1 --2- 172.21.15.148:0/949266874 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0ac101350 0x7fb0ac10d880 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fb0a4009c10 tx=0x7fb0a402a6e0 comp rx=0 tx=0).stop 2024-09-19T07:15:44.882 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.878+0000 7fb0b2a65640 1 -- 172.21.15.148:0/949266874 shutdown_connections 2024-09-19T07:15:44.882 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.878+0000 7fb0b2a65640 1 --2- 172.21.15.148:0/949266874 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0ac101350 0x7fb0ac10d880 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:44.882 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.878+0000 7fb0b2a65640 1 --2- 172.21.15.148:0/949266874 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb0ac1009b0 0x7fb0ac100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:44.882 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.878+0000 7fb0b2a65640 1 --2- 172.21.15.148:0/949266874 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0ac1069c0 0x7fb0ac106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:44.882 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.878+0000 7fb0b2a65640 1 -- 172.21.15.148:0/949266874 >> 172.21.15.148:0/949266874 conn(0x7fb0ac077990 msgr2=0x7fb0ac0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:15:44.882 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.878+0000 7fb0b2a65640 1 -- 172.21.15.148:0/949266874 shutdown_connections 2024-09-19T07:15:44.882 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.878+0000 7fb0b2a65640 1 -- 172.21.15.148:0/949266874 wait complete. 2024-09-19T07:15:44.882 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.878+0000 7fb0b2a65640 1 Processor -- start 2024-09-19T07:15:44.883 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.878+0000 7fb0b2a65640 1 -- start start 2024-09-19T07:15:44.883 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.879+0000 7fb0b2a65640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0ac1009b0 0x7fb0ac199140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:44.883 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.879+0000 7fb0b2a65640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb0ac101350 0x7fb0ac199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:44.883 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.879+0000 7fb0b2a65640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0ac1069c0 0x7fb0ac1a41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:44.883 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.879+0000 7fb0b2a65640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ac110db0 con 0x7fb0ac1069c0 2024-09-19T07:15:44.883 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.879+0000 7fb0b2a65640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ac110c30 con 0x7fb0ac101350 2024-09-19T07:15:44.883 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.879+0000 7fb0b2a65640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ac110f30 con 0x7fb0ac1009b0 2024-09-19T07:15:44.883 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.879+0000 7fb0b1002640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0ac1069c0 0x7fb0ac1a41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:44.883 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.879+0000 7fb0abfff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb0ac101350 0x7fb0ac199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:44.883 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.879+0000 7fb0b0801640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0ac1009b0 0x7fb0ac199140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:44.883 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.879+0000 7fb0abfff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb0ac101350 0x7fb0ac199680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:53660/0 (socket says 172.21.15.148:53660) 2024-09-19T07:15:44.884 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.879+0000 7fb0abfff640 1 -- 172.21.15.148:0/906746388 learned_addr learned my addr 172.21.15.148:0/906746388 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:15:44.884 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.879+0000 7fb0b0801640 1 -- 172.21.15.148:0/906746388 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb0ac101350 msgr2=0x7fb0ac199680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:44.884 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.879+0000 7fb0b0801640 1 --2- 172.21.15.148:0/906746388 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb0ac101350 0x7fb0ac199680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:44.884 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.879+0000 7fb0b0801640 1 -- 172.21.15.148:0/906746388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0ac1069c0 msgr2=0x7fb0ac1a41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:44.884 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.879+0000 7fb0b0801640 1 --2- 172.21.15.148:0/906746388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0ac1069c0 0x7fb0ac1a41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:44.884 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.879+0000 7fb0b0801640 1 -- 172.21.15.148:0/906746388 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0ac1a4700 con 0x7fb0ac1009b0 2024-09-19T07:15:44.884 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.879+0000 7fb0abfff640 1 --2- 172.21.15.148:0/906746388 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb0ac101350 0x7fb0ac199680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:15:44.884 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.879+0000 7fb0b0801640 1 --2- 172.21.15.148:0/906746388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0ac1009b0 0x7fb0ac199140 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb0a000e9f0 tx=0x7fb0a000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:44.884 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.879+0000 7fb0a9ffb640 1 -- 172.21.15.148:0/906746388 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a000ccc0 con 0x7fb0ac1009b0 2024-09-19T07:15:44.884 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.879+0000 7fb0b2a65640 1 -- 172.21.15.148:0/906746388 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0ac1a48d0 con 0x7fb0ac1009b0 2024-09-19T07:15:44.884 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.880+0000 7fb0a9ffb640 1 -- 172.21.15.148:0/906746388 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0a0010910 con 0x7fb0ac1009b0 2024-09-19T07:15:44.884 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.880+0000 7fb0a9ffb640 1 -- 172.21.15.148:0/906746388 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a0018960 con 0x7fb0ac1009b0 2024-09-19T07:15:44.884 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.880+0000 7fb0b2a65640 1 -- 172.21.15.148:0/906746388 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0ac1a4e40 con 0x7fb0ac1009b0 2024-09-19T07:15:44.890 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.882+0000 7fb0a9ffb640 1 -- 172.21.15.148:0/906746388 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fb0a0010ac0 con 0x7fb0ac1009b0 2024-09-19T07:15:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.882+0000 7fb0b5804740 1 Processor -- start 2024-09-19T07:15:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.882+0000 7fb0b5804740 1 -- start start 2024-09-19T07:15:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.883+0000 7fb0b5804740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562834265af0 0x562834265ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.883+0000 7fb0b5804740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562834266410 0x562834270770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.883+0000 7fb0b5804740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562834270cb0 0x5628342730a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.883+0000 7fb0b5804740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5628341ca2f0 con 0x562834265af0 2024-09-19T07:15:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.883+0000 7fb0b5804740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x562834172270 con 0x562834270cb0 2024-09-19T07:15:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.883+0000 7fb0b5804740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5628341c62b0 con 0x562834266410 2024-09-19T07:15:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.883+0000 7fb0b0801640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562834266410 0x562834270770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.883+0000 7fb0b1002640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562834265af0 0x562834265ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.883+0000 7fb0abfff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562834270cb0 0x5628342730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:44.892 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.883+0000 7fb0b0801640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562834266410 0x562834270770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:53464/0 (socket says 172.21.15.148:53464) 2024-09-19T07:15:44.892 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.883+0000 7fb0b0801640 1 -- 172.21.15.148:0/2758293514 learned_addr learned my addr 172.21.15.148:0/2758293514 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:15:44.892 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.883+0000 7fb0a9ffb640 1 --2- 172.21.15.148:0/906746388 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fb09c0a3460 0x7fb09c0a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:44.892 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.883+0000 7fb0b1002640 1 --2- 172.21.15.148:0/906746388 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fb09c0a3460 0x7fb09c0a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:44.892 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.883+0000 7fb0b0801640 1 -- 172.21.15.148:0/2758293514 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562834270cb0 msgr2=0x5628342730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:44.892 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.883+0000 7fb0b0801640 1 --2- 172.21.15.148:0/2758293514 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562834270cb0 0x5628342730a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:44.892 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.883+0000 7fb0b0801640 1 -- 172.21.15.148:0/2758293514 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562834265af0 msgr2=0x562834265ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:44.892 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.883+0000 7fb0b0801640 1 --2- 172.21.15.148:0/2758293514 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562834265af0 0x562834265ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:44.892 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.883+0000 7fb0b0801640 1 -- 172.21.15.148:0/2758293514 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562834171340 con 0x562834266410 2024-09-19T07:15:44.892 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.883+0000 7fb0abfff640 1 --2- 172.21.15.148:0/2758293514 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562834270cb0 0x5628342730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:15:44.892 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.883+0000 7fb0a9ffb640 1 -- 172.21.15.148:0/906746388 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fb0a00d0020 con 0x7fb0ac1009b0 2024-09-19T07:15:44.892 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.884+0000 7fb0b0801640 1 --2- 172.21.15.148:0/2758293514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562834266410 0x562834270770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb0a00cd6c0 tx=0x7fb0a0009700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ccbef1d8e508c66 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:44.893 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.884+0000 7fb0b1002640 1 --2- 172.21.15.148:0/906746388 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fb09c0a3460 0x7fb09c0a5920 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb0a4004af0 tx=0x7fb0a402a6e0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:44.893 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.884+0000 7fb096ffd640 1 -- 172.21.15.148:0/2758293514 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a009bd20 con 0x562834266410 2024-09-19T07:15:44.893 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.884+0000 7fb096ffd640 1 -- 172.21.15.148:0/2758293514 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0a009c3c0 con 0x562834266410 2024-09-19T07:15:44.893 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.884+0000 7fb096ffd640 1 -- 172.21.15.148:0/2758293514 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a00cda00 con 0x562834266410 2024-09-19T07:15:44.893 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.885+0000 7fb0b5804740 1 -- 172.21.15.148:0/2758293514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562834266410 msgr2=0x562834270770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:44.893 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.885+0000 7fb0b5804740 1 --2- 172.21.15.148:0/2758293514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562834266410 0x562834270770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb0a00cd6c0 tx=0x7fb0a0009700 comp rx=0 tx=0).stop 2024-09-19T07:15:44.893 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.885+0000 7fb0b5804740 1 -- 172.21.15.148:0/2758293514 shutdown_connections 2024-09-19T07:15:44.893 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.885+0000 7fb0b5804740 1 --2- 172.21.15.148:0/2758293514 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562834270cb0 0x5628342730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:44.893 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.885+0000 7fb0b5804740 1 --2- 172.21.15.148:0/2758293514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562834266410 0x562834270770 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:44.893 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.885+0000 7fb0b5804740 1 --2- 172.21.15.148:0/2758293514 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562834265af0 0x562834265ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:44.893 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.885+0000 7fb0b5804740 1 -- 172.21.15.148:0/2758293514 >> 172.21.15.148:0/2758293514 conn(0x562834262060 msgr2=0x562834262440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:15:44.893 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.885+0000 7fb0b5804740 1 -- 172.21.15.148:0/2758293514 shutdown_connections 2024-09-19T07:15:44.893 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.885+0000 7fb0b5804740 1 -- 172.21.15.148:0/2758293514 wait complete. 2024-09-19T07:15:44.894 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.885+0000 7fb0b5804740 1 -- start start 2024-09-19T07:15:44.894 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.885+0000 7fb0b5804740 1 Processor -- start 2024-09-19T07:15:44.894 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.886+0000 7fb0b5804740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562834265af0 0x56283426db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:44.894 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.886+0000 7fb0b5804740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562834266410 0x56283426e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:44.894 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.886+0000 7fb0b5804740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562834270cb0 0x56283426e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:44.894 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.886+0000 7fb0b5804740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x562834273880 con 0x562834265af0 2024-09-19T07:15:44.894 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.886+0000 7fb0b5804740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x562834153290 con 0x562834270cb0 2024-09-19T07:15:44.894 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.886+0000 7fb0b5804740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x562834273a00 con 0x562834266410 2024-09-19T07:15:44.894 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.886+0000 7fb0b5804740 10 client.0 _ll_register_callbacks cb 0x562834184140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:15:44.894 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.886+0000 7fb0b0801640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562834265af0 0x56283426db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:44.894 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.886+0000 7fb0b1002640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562834270cb0 0x56283426e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:44.894 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.886+0000 7fb0b0801640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562834265af0 0x56283426db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36248/0 (socket says 172.21.15.148:36248) 2024-09-19T07:15:44.894 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.886+0000 7fb0b0801640 1 -- 172.21.15.148:0/140022679 learned_addr learned my addr 172.21.15.148:0/140022679 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:15:44.895 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.886+0000 7fb0b1002640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562834270cb0 0x56283426e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:53678/0 (socket says 172.21.15.148:53678) 2024-09-19T07:15:44.895 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.886+0000 7fb0abfff640 1 --2- 172.21.15.148:0/140022679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562834266410 0x56283426e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:44.895 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.886+0000 7fb0b0801640 1 -- 172.21.15.148:0/140022679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562834266410 msgr2=0x56283426e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:44.895 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.886+0000 7fb0b0801640 1 --2- 172.21.15.148:0/140022679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562834266410 0x56283426e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:44.895 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.886+0000 7fb0b0801640 1 -- 172.21.15.148:0/140022679 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562834270cb0 msgr2=0x56283426e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:44.895 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.886+0000 7fb0b0801640 1 --2- 172.21.15.148:0/140022679 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562834270cb0 0x56283426e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:44.895 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.886+0000 7fb0b0801640 1 -- 172.21.15.148:0/140022679 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562833edd210 con 0x562834265af0 2024-09-19T07:15:44.895 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.886+0000 7fb0b0801640 1 --2- 172.21.15.148:0/140022679 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562834265af0 0x56283426db90 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fb0a009c0c0 tx=0x7fb0a009c030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46815cbb13d9cdf9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:44.895 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.886+0000 7fb08bfff640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:15:44.895 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.887+0000 7fb08bfff640 1 -- 172.21.15.148:0/140022679 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a009bd20 con 0x562834265af0 2024-09-19T07:15:44.895 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.887+0000 7fb0b5804740 1 -- 172.21.15.148:0/140022679 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0a009c3c0 con 0x562834265af0 2024-09-19T07:15:44.895 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.887+0000 7fb08bfff640 1 -- 172.21.15.148:0/140022679 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fb0a00bc310 con 0x562834265af0 2024-09-19T07:15:44.895 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.887+0000 7fb08bfff640 1 -- 172.21.15.148:0/140022679 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fb0a00b5050 con 0x562834265af0 2024-09-19T07:15:44.896 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.887+0000 7fb0b5804740 10 client.16443 fetch_fsmap learned FSMap version 33 2024-09-19T07:15:44.896 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.887+0000 7fb0b5804740 1 -- 172.21.15.148:0/140022679 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x562833fa9620 con 0x562834265af0 2024-09-19T07:15:44.896 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.887+0000 7fb08bfff640 1 -- 172.21.15.148:0/140022679 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0a009c3c0 con 0x562834265af0 2024-09-19T07:15:44.896 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.887+0000 7fb08bfff640 1 -- 172.21.15.148:0/140022679 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 33) ==== 8362+0+0 (secure 0 0 0) 0x7fb0a0018b00 con 0x562834265af0 2024-09-19T07:15:44.896 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.887+0000 7fb0b5804740 10 client.16443 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T07:15:44.896 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.887+0000 7fb0b5804740 10 client.16443 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:15:44.896 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.887+0000 7fb0b5804740 20 client.16443 populate_metadata read hostname 'smithi148' 2024-09-19T07:15:44.896 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.887+0000 7fb0b5804740 1 --2- 172.21.15.148:0/140022679 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x562834280ab0 0x562834282ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:44.896 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.887+0000 7fb0b5804740 4 client.16443 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:15:44.896 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.887+0000 7fb0b5804740 1 -- 172.21.15.148:0/140022679 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5628341d7a20 con 0x562834280ab0 2024-09-19T07:15:44.896 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.887+0000 7fb0abfff640 1 --2- 172.21.15.148:0/140022679 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x562834280ab0 0x562834282ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:44.896 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.888+0000 7fb0abfff640 1 --2- 172.21.15.148:0/140022679 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x562834280ab0 0x562834282ea0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25dab028d95c4f55 server_cookie=b415de1d3efe12f1 in_seq=0 out_seq=0 2024-09-19T07:15:44.896 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.888+0000 7fb08bfff640 10 client.16443 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:15:44.897 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.889+0000 7fb08bfff640 1 -- 172.21.15.148:0/140022679 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5628341d7a20 con 0x562834280ab0 2024-09-19T07:15:44.897 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.889+0000 7fb08bfff640 10 client.16443 handle_command_reply: tid=0 2024-09-19T07:15:44.897 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.889+0000 7fb0b5804740 1 client.16443 shutdown 2024-09-19T07:15:44.897 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.890+0000 7fb0b5804740 1 -- 172.21.15.148:0/140022679 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562834265af0 msgr2=0x56283426db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:44.897 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.890+0000 7fb0b5804740 1 --2- 172.21.15.148:0/140022679 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562834265af0 0x56283426db90 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fb0a009c0c0 tx=0x7fb0a009c030 comp rx=0 tx=0).stop 2024-09-19T07:15:44.897 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.890+0000 7fb0b5804740 1 -- 172.21.15.148:0/140022679 shutdown_connections 2024-09-19T07:15:44.897 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.890+0000 7fb0b5804740 1 --2- 172.21.15.148:0/140022679 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x562834280ab0 0x562834282ea0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:44.897 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.890+0000 7fb0b5804740 1 --2- 172.21.15.148:0/140022679 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562834270cb0 0x56283426e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:44.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.890+0000 7fb0b5804740 1 --2- 172.21.15.148:0/140022679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562834266410 0x56283426e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:44.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.890+0000 7fb08bfff640 0 client.16443 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:15:44.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.890+0000 7fb0b5804740 1 --2- 172.21.15.148:0/140022679 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562834265af0 0x56283426db90 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:44.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.890+0000 7fb0b5804740 1 -- 172.21.15.148:0/140022679 >> 172.21.15.148:0/140022679 conn(0x562834262060 msgr2=0x562834267dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:15:44.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.890+0000 7fb0b5804740 1 -- 172.21.15.148:0/140022679 shutdown_connections 2024-09-19T07:15:44.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.890+0000 7fb0b5804740 1 -- 172.21.15.148:0/140022679 wait complete. 2024-09-19T07:15:44.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.890+0000 7fb0b5804740 20 client.16443 trim_cache size 0 max 16384 2024-09-19T07:15:44.909 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.906+0000 7fb0b5804740 1 Processor -- start 2024-09-19T07:15:44.909 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.906+0000 7fb0b5804740 1 -- start start 2024-09-19T07:15:44.909 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.906+0000 7fb0b5804740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562834265af0 0x56283426e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:44.909 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.906+0000 7fb0b5804740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562834266410 0x5628342884d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:44.909 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.906+0000 7fb0b5804740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562834270cb0 0x562834288a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:44.909 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.906+0000 7fb0b5804740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ac1b0130 con 0x562834265af0 2024-09-19T07:15:44.909 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.906+0000 7fb0b5804740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ac1ad9a0 con 0x562834270cb0 2024-09-19T07:15:44.909 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.906+0000 7fb0b5804740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ac1ab7d0 con 0x562834266410 2024-09-19T07:15:44.909 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.906+0000 7fb0b0801640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562834265af0 0x56283426e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:44.909 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.906+0000 7fb0b0801640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562834265af0 0x56283426e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36252/0 (socket says 172.21.15.148:36252) 2024-09-19T07:15:44.909 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.906+0000 7fb0b0801640 1 -- 172.21.15.148:0/2033183363 learned_addr learned my addr 172.21.15.148:0/2033183363 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:15:44.909 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.906+0000 7fb0b1002640 1 --2- 172.21.15.148:0/2033183363 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562834270cb0 0x562834288a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:44.910 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.906+0000 7fb0abfff640 1 --2- 172.21.15.148:0/2033183363 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562834266410 0x5628342884d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:44.910 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.907+0000 7fb0b0801640 1 -- 172.21.15.148:0/2033183363 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562834266410 msgr2=0x5628342884d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:44.910 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.907+0000 7fb0b0801640 1 --2- 172.21.15.148:0/2033183363 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562834266410 0x5628342884d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:44.910 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.907+0000 7fb0b0801640 1 -- 172.21.15.148:0/2033183363 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562834270cb0 msgr2=0x562834288a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:44.910 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.907+0000 7fb0b0801640 1 --2- 172.21.15.148:0/2033183363 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562834270cb0 0x562834288a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:44.910 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.907+0000 7fb0b0801640 1 -- 172.21.15.148:0/2033183363 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56283426cb20 con 0x562834265af0 2024-09-19T07:15:44.910 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.907+0000 7fb0abfff640 1 --2- 172.21.15.148:0/2033183363 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562834266410 0x5628342884d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:15:44.910 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.907+0000 7fb0b0801640 1 --2- 172.21.15.148:0/2033183363 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562834265af0 0x56283426e440 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fb0a009c350 tx=0x7fb0a0009700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5e7787f67948913 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:44.910 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.907+0000 7fb0967fc640 1 -- 172.21.15.148:0/2033183363 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a00cdc10 con 0x562834265af0 2024-09-19T07:15:44.911 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.907+0000 7fb0967fc640 1 -- 172.21.15.148:0/2033183363 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0a00982d0 con 0x562834265af0 2024-09-19T07:15:44.911 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.907+0000 7fb0967fc640 1 -- 172.21.15.148:0/2033183363 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a009ba50 con 0x562834265af0 2024-09-19T07:15:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.908+0000 7fb0b5804740 1 -- 172.21.15.148:0/2033183363 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562834265af0 msgr2=0x56283426e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.908+0000 7fb0b5804740 1 --2- 172.21.15.148:0/2033183363 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562834265af0 0x56283426e440 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fb0a009c350 tx=0x7fb0a0009700 comp rx=0 tx=0).stop 2024-09-19T07:15:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.908+0000 7fb0b5804740 1 -- 172.21.15.148:0/2033183363 shutdown_connections 2024-09-19T07:15:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.908+0000 7fb0b5804740 1 --2- 172.21.15.148:0/2033183363 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562834270cb0 0x562834288a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.908+0000 7fb0b5804740 1 --2- 172.21.15.148:0/2033183363 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562834266410 0x5628342884d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.908+0000 7fb0b5804740 1 --2- 172.21.15.148:0/2033183363 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562834265af0 0x56283426e440 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.908+0000 7fb0b5804740 1 -- 172.21.15.148:0/2033183363 >> 172.21.15.148:0/2033183363 conn(0x562834262060 msgr2=0x56283426fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:15:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.908+0000 7fb0b5804740 1 -- 172.21.15.148:0/2033183363 shutdown_connections 2024-09-19T07:15:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.908+0000 7fb0b5804740 1 -- 172.21.15.148:0/2033183363 wait complete. 2024-09-19T07:15:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.909+0000 7fb0b5804740 1 -- start start 2024-09-19T07:15:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.909+0000 7fb0b5804740 1 Processor -- start 2024-09-19T07:15:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.909+0000 7fb0b5804740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562834265af0 0x5628342790e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.909+0000 7fb0b5804740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562834266410 0x562834274400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.909+0000 7fb0b5804740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562834270cb0 0x562834274940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.909+0000 7fb0b5804740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ac1abe60 con 0x562834266410 2024-09-19T07:15:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.909+0000 7fb0b5804740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ac1ad2d0 con 0x562834265af0 2024-09-19T07:15:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.909+0000 7fb0b5804740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ac1ac530 con 0x562834270cb0 2024-09-19T07:15:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.909+0000 7fb0b5804740 10 client.0 _ll_register_callbacks cb 0x7fb0a00baf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:15:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.909+0000 7fb0abfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562834266410 0x562834274400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.909+0000 7fb0abfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562834266410 0x562834274400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36256/0 (socket says 172.21.15.148:36256) 2024-09-19T07:15:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.909+0000 7fb0abfff640 1 -- 172.21.15.148:0/3323368960 learned_addr learned my addr 172.21.15.148:0/3323368960 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:15:44.916 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.909+0000 7fb0b0801640 1 --2- 172.21.15.148:0/3323368960 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562834265af0 0x5628342790e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:44.916 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.909+0000 7fb0b1002640 1 --2- 172.21.15.148:0/3323368960 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562834270cb0 0x562834274940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:44.916 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.910+0000 7fb0abfff640 1 -- 172.21.15.148:0/3323368960 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562834270cb0 msgr2=0x562834274940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:44.916 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.910+0000 7fb0abfff640 1 --2- 172.21.15.148:0/3323368960 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562834270cb0 0x562834274940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:44.916 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.910+0000 7fb0abfff640 1 -- 172.21.15.148:0/3323368960 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562834265af0 msgr2=0x5628342790e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:44.916 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.910+0000 7fb0abfff640 1 --2- 172.21.15.148:0/3323368960 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562834265af0 0x5628342790e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:44.916 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.910+0000 7fb0abfff640 1 -- 172.21.15.148:0/3323368960 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562834274e80 con 0x562834266410 2024-09-19T07:15:44.916 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.910+0000 7fb0b0801640 1 --2- 172.21.15.148:0/3323368960 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562834265af0 0x5628342790e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:15:44.916 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.910+0000 7fb0abfff640 1 --2- 172.21.15.148:0/3323368960 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562834266410 0x562834274400 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x562834268690 tx=0x7fb098012c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90af12d869429c09 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:44.916 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.910+0000 7fb08bfff640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:15:44.916 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.910+0000 7fb08bfff640 1 -- 172.21.15.148:0/3323368960 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb09802d060 con 0x562834266410 2024-09-19T07:15:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.910+0000 7fb08bfff640 1 -- 172.21.15.148:0/3323368960 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fb098004250 con 0x562834266410 2024-09-19T07:15:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.910+0000 7fb0b5804740 1 -- 172.21.15.148:0/3323368960 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5628341d1d70 con 0x562834266410 2024-09-19T07:15:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.910+0000 7fb08bfff640 1 -- 172.21.15.148:0/3323368960 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fb098004450 con 0x562834266410 2024-09-19T07:15:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.910+0000 7fb0b5804740 10 client.16449 fetch_fsmap learned FSMap version 33 2024-09-19T07:15:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.910+0000 7fb0b5804740 1 -- 172.21.15.148:0/3323368960 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5628342eb210 con 0x562834266410 2024-09-19T07:15:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.910+0000 7fb08bfff640 1 -- 172.21.15.148:0/3323368960 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5628341d1d70 con 0x562834266410 2024-09-19T07:15:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.911+0000 7fb08bfff640 1 -- 172.21.15.148:0/3323368960 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 33) ==== 8362+0+0 (secure 0 0 0) 0x7fb098003b30 con 0x562834266410 2024-09-19T07:15:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.911+0000 7fb0b5804740 10 client.16449 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T07:15:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.911+0000 7fb0b5804740 10 client.16449 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:15:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.911+0000 7fb0b5804740 20 client.16449 populate_metadata read hostname 'smithi148' 2024-09-19T07:15:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.911+0000 7fb0b5804740 1 --2- 172.21.15.148:0/3323368960 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5628342eb9d0 0x5628342eddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.911+0000 7fb0b5804740 4 client.16449 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:15:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.911+0000 7fb0b5804740 1 -- 172.21.15.148:0/3323368960 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56283414e900 con 0x5628342eb9d0 2024-09-19T07:15:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.911+0000 7fb0b0801640 1 --2- 172.21.15.148:0/3323368960 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5628342eb9d0 0x5628342eddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.911+0000 7fb08bfff640 10 client.16449 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:15:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:44.911+0000 7fb0b0801640 1 --2- 172.21.15.148:0/3323368960 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5628342eb9d0 0x5628342eddf0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4db39199599e849 server_cookie=b9cd1d6c2b5bd2a4 in_seq=0 out_seq=0 2024-09-19T07:15:45.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:15:44 smithi179 ceph-mon[35716]: pgmap v143: 97 pgs: 97 active+clean; 854 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.9 MiB/s wr, 1.14k op/s 2024-09-19T07:15:45.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:15:44 smithi148 ceph-mon[31180]: pgmap v143: 97 pgs: 97 active+clean; 854 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.9 MiB/s wr, 1.14k op/s 2024-09-19T07:15:45.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:15:44 smithi165 ceph-mon[35326]: pgmap v143: 97 pgs: 97 active+clean; 854 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.9 MiB/s wr, 1.14k op/s 2024-09-19T07:15:45.470 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:45.468+0000 7fb08bfff640 1 -- 172.21.15.148:0/3323368960 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56283414e900 con 0x5628342eb9d0 2024-09-19T07:15:45.470 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:45.468+0000 7fb08bfff640 10 client.16449 handle_command_reply: tid=0 2024-09-19T07:15:45.470 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:45.468+0000 7fb0b5804740 1 client.16449 shutdown 2024-09-19T07:15:45.470 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:45.468+0000 7fb0b5804740 1 -- 172.21.15.148:0/3323368960 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562834266410 msgr2=0x562834274400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:45.470 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:45.468+0000 7fb0b5804740 1 --2- 172.21.15.148:0/3323368960 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562834266410 0x562834274400 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x562834268690 tx=0x7fb098012c60 comp rx=0 tx=0).stop 2024-09-19T07:15:45.470 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:45.468+0000 7fb0b5804740 1 -- 172.21.15.148:0/3323368960 shutdown_connections 2024-09-19T07:15:45.470 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:45.468+0000 7fb0b5804740 1 --2- 172.21.15.148:0/3323368960 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5628342eb9d0 0x5628342eddf0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:45.470 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:45.469+0000 7fb0b5804740 1 --2- 172.21.15.148:0/3323368960 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562834270cb0 0x562834274940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:45.470 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:45.469+0000 7fb0b5804740 1 --2- 172.21.15.148:0/3323368960 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562834266410 0x562834274400 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:45.470 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:45.469+0000 7fb0b5804740 1 --2- 172.21.15.148:0/3323368960 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562834265af0 0x5628342790e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:45.471 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:45.469+0000 7fb0b5804740 1 -- 172.21.15.148:0/3323368960 >> 172.21.15.148:0/3323368960 conn(0x562834262060 msgr2=0x562834267550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:15:45.471 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:45.469+0000 7fb08bfff640 0 client.16449 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:15:45.471 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:45.469+0000 7fb0b5804740 1 -- 172.21.15.148:0/3323368960 shutdown_connections 2024-09-19T07:15:45.471 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:45.469+0000 7fb0b5804740 1 -- 172.21.15.148:0/3323368960 wait complete. 2024-09-19T07:15:45.471 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:45.469+0000 7fb0b5804740 20 client.16449 trim_cache size 0 max 16384 2024-09-19T07:15:45.471 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:15:45.471 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:15:45.471 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:15:45.471 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:15:45.472 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:45.470+0000 7fb0b2a65640 1 -- 172.21.15.148:0/906746388 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fb09c0a3460 msgr2=0x7fb09c0a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:45.472 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:45.470+0000 7fb0b2a65640 1 --2- 172.21.15.148:0/906746388 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fb09c0a3460 0x7fb09c0a5920 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb0a4004af0 tx=0x7fb0a402a6e0 comp rx=0 tx=0).stop 2024-09-19T07:15:45.472 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:45.470+0000 7fb0b2a65640 1 -- 172.21.15.148:0/906746388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0ac1009b0 msgr2=0x7fb0ac199140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:45.472 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:45.470+0000 7fb0b2a65640 1 --2- 172.21.15.148:0/906746388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0ac1009b0 0x7fb0ac199140 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb0a000e9f0 tx=0x7fb0a000eeb0 comp rx=0 tx=0).stop 2024-09-19T07:15:45.473 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:45.470+0000 7fb0b2a65640 1 -- 172.21.15.148:0/906746388 shutdown_connections 2024-09-19T07:15:45.474 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:45.470+0000 7fb0b2a65640 1 --2- 172.21.15.148:0/906746388 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fb09c0a3460 0x7fb09c0a5920 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:45.474 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:45.470+0000 7fb0b2a65640 1 --2- 172.21.15.148:0/906746388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0ac1069c0 0x7fb0ac1a41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:45.474 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:45.470+0000 7fb0b2a65640 1 --2- 172.21.15.148:0/906746388 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb0ac101350 0x7fb0ac199680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:45.474 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:45.470+0000 7fb0b2a65640 1 --2- 172.21.15.148:0/906746388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0ac1009b0 0x7fb0ac199140 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:45.474 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:45.470+0000 7fb0b2a65640 1 -- 172.21.15.148:0/906746388 >> 172.21.15.148:0/906746388 conn(0x7fb0ac077990 msgr2=0x7fb0ac1037c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:15:45.474 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:45.470+0000 7fb0b2a65640 1 -- 172.21.15.148:0/906746388 shutdown_connections 2024-09-19T07:15:45.474 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:45.470+0000 7fb0b2a65640 1 -- 172.21.15.148:0/906746388 wait complete. 2024-09-19T07:15:47.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:15:46 smithi179 ceph-mon[35716]: pgmap v144: 97 pgs: 97 active+clean; 877 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 4.9 MiB/s wr, 1.33k op/s 2024-09-19T07:15:47.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:15:46 smithi148 ceph-mon[31180]: pgmap v144: 97 pgs: 97 active+clean; 877 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 4.9 MiB/s wr, 1.33k op/s 2024-09-19T07:15:47.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:15:46 smithi165 ceph-mon[35326]: pgmap v144: 97 pgs: 97 active+clean; 877 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 4.9 MiB/s wr, 1.33k op/s 2024-09-19T07:15:49.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:15:48 smithi179 ceph-mon[35716]: pgmap v145: 97 pgs: 97 active+clean; 877 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 3.9 MiB/s wr, 427 op/s 2024-09-19T07:15:49.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:15:48 smithi148 ceph-mon[31180]: pgmap v145: 97 pgs: 97 active+clean; 877 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 3.9 MiB/s wr, 427 op/s 2024-09-19T07:15:49.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:15:48 smithi165 ceph-mon[35326]: pgmap v145: 97 pgs: 97 active+clean; 877 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 3.9 MiB/s wr, 427 op/s 2024-09-19T07:15:49.744 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:15:50.019 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:15:50.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.541+0000 7f79f65b8640 1 -- 172.21.15.148:0/4039854291 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79f0100e20 msgr2=0x7f79f0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:50.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.541+0000 7f79f65b8640 1 --2- 172.21.15.148:0/4039854291 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79f0100e20 0x7f79f0101200 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f79e0009900 tx=0x7f79e002a480 comp rx=0 tx=0).stop 2024-09-19T07:15:50.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.541+0000 7f79f65b8640 1 -- 172.21.15.148:0/4039854291 shutdown_connections 2024-09-19T07:15:50.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.541+0000 7f79f65b8640 1 --2- 172.21.15.148:0/4039854291 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79f0102ef0 0x7f79f010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:50.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.541+0000 7f79f65b8640 1 --2- 172.21.15.148:0/4039854291 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79f0102570 0x7f79f01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:50.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.541+0000 7f79f65b8640 1 --2- 172.21.15.148:0/4039854291 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79f0100e20 0x7f79f0101200 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:50.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.541+0000 7f79f65b8640 1 -- 172.21.15.148:0/4039854291 >> 172.21.15.148:0/4039854291 conn(0x7f79f00fc7d0 msgr2=0x7f79f00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:15:50.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.541+0000 7f79f65b8640 1 -- 172.21.15.148:0/4039854291 shutdown_connections 2024-09-19T07:15:50.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.541+0000 7f79f65b8640 1 -- 172.21.15.148:0/4039854291 wait complete. 2024-09-19T07:15:50.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.542+0000 7f79f65b8640 1 Processor -- start 2024-09-19T07:15:50.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.542+0000 7f79f65b8640 1 -- start start 2024-09-19T07:15:50.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.542+0000 7f79f65b8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79f0100e20 0x7f79f01973c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:50.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.542+0000 7f79f65b8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79f0102570 0x7f79f0197900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:50.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.542+0000 7f79f65b8640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79f0102ef0 0x7f79f019bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:50.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.542+0000 7f79f65b8640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f79f0110f80 con 0x7f79f0100e20 2024-09-19T07:15:50.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.542+0000 7f79f65b8640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f79f0110e00 con 0x7f79f0102ef0 2024-09-19T07:15:50.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.542+0000 7f79f65b8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f79f0111100 con 0x7f79f0102570 2024-09-19T07:15:50.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.542+0000 7f79effff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79f0100e20 0x7f79f01973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:50.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.542+0000 7f79ef7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79f0102570 0x7f79f0197900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:50.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.542+0000 7f79effff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79f0100e20 0x7f79f01973c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36278/0 (socket says 172.21.15.148:36278) 2024-09-19T07:15:50.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.542+0000 7f79effff640 1 -- 172.21.15.148:0/3802250187 learned_addr learned my addr 172.21.15.148:0/3802250187 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:15:50.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.542+0000 7f79f4b55640 1 --2- 172.21.15.148:0/3802250187 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79f0102ef0 0x7f79f019bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:50.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.543+0000 7f79ef7fe640 1 -- 172.21.15.148:0/3802250187 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79f0102ef0 msgr2=0x7f79f019bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:50.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.543+0000 7f79ef7fe640 1 --2- 172.21.15.148:0/3802250187 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79f0102ef0 0x7f79f019bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:50.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.543+0000 7f79ef7fe640 1 -- 172.21.15.148:0/3802250187 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79f0100e20 msgr2=0x7f79f01973c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:50.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.543+0000 7f79ef7fe640 1 --2- 172.21.15.148:0/3802250187 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79f0100e20 0x7f79f01973c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:50.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.543+0000 7f79ef7fe640 1 -- 172.21.15.148:0/3802250187 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79f019c370 con 0x7f79f0102570 2024-09-19T07:15:50.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.543+0000 7f79effff640 1 --2- 172.21.15.148:0/3802250187 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79f0100e20 0x7f79f01973c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:15:50.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.543+0000 7f79ef7fe640 1 --2- 172.21.15.148:0/3802250187 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79f0102570 0x7f79f0197900 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f79e400eb00 tx=0x7f79e4009e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:50.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.543+0000 7f79ed7fa640 1 -- 172.21.15.148:0/3802250187 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e401c070 con 0x7f79f0102570 2024-09-19T07:15:50.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.543+0000 7f79f65b8640 1 -- 172.21.15.148:0/3802250187 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79f019c660 con 0x7f79f0102570 2024-09-19T07:15:50.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.543+0000 7f79ed7fa640 1 -- 172.21.15.148:0/3802250187 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79e400bb70 con 0x7f79f0102570 2024-09-19T07:15:50.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.543+0000 7f79f65b8640 1 -- 172.21.15.148:0/3802250187 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79f0069f70 con 0x7f79f0102570 2024-09-19T07:15:50.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.543+0000 7f79ed7fa640 1 -- 172.21.15.148:0/3802250187 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e40205b0 con 0x7f79f0102570 2024-09-19T07:15:50.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.544+0000 7f79f65b8640 1 -- 172.21.15.148:0/3802250187 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79f0101200 con 0x7f79f0102570 2024-09-19T07:15:50.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.545+0000 7f79ed7fa640 1 -- 172.21.15.148:0/3802250187 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f79e401f070 con 0x7f79f0102570 2024-09-19T07:15:50.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.546+0000 7f79ed7fa640 1 --2- 172.21.15.148:0/3802250187 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f79d80a33b0 0x7f79d80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:50.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.546+0000 7f79ed7fa640 1 -- 172.21.15.148:0/3802250187 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f79e40d1300 con 0x7f79f0102570 2024-09-19T07:15:50.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.546+0000 7f79effff640 1 --2- 172.21.15.148:0/3802250187 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f79d80a33b0 0x7f79d80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:50.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.547+0000 7f79effff640 1 --2- 172.21.15.148:0/3802250187 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f79d80a33b0 0x7f79d80a5870 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f79e00096c0 tx=0x7f79e0005a20 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:50.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.550+0000 7f79ed7fa640 1 -- 172.21.15.148:0/3802250187 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f79e409d6a0 con 0x7f79f0102570 2024-09-19T07:15:50.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.784+0000 7f79f65b8640 1 -- 172.21.15.148:0/3802250187 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f79f006a990 con 0x7f79f0102570 2024-09-19T07:15:50.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.786+0000 7f79ed7fa640 1 -- 172.21.15.148:0/3802250187 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11947 (secure 0 0 0) 0x7f79e40a19a0 con 0x7f79f0102570 2024-09-19T07:15:50.787 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:15:50.787 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":33,"btime":"2024-09-19T07:14:31:818799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/4263868576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":4263868576},{"type":"v1","addr":"172.21.15.148:6841","nonce":4263868576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":25606,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3891676893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3891676893},{"type":"v1","addr":"172.21.15.179:6835","nonce":3891676893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":33,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:09:19.543369+0000","modified":"2024-09-19T07:14:30.968403+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24457,"mds_1":24437,"mds_2":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24383":{"gid":24383,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6835/2146820965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2146820965},{"type":"v1","addr":"172.21.15.165:6835","nonce":2146820965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24410":{"gid":24410,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":75,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":71,"addr":"172.21.15.165:6839/3993490234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":3993490234},{"type":"v1","addr":"172.21.15.165:6839","nonce":3993490234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24457,"qdb_cluster":[24457,24437,24436]},"id":1}]} 2024-09-19T07:15:50.787 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 33 2024-09-19T07:15:50.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.788+0000 7f79f65b8640 1 -- 172.21.15.148:0/3802250187 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f79d80a33b0 msgr2=0x7f79d80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:50.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.788+0000 7f79f65b8640 1 --2- 172.21.15.148:0/3802250187 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f79d80a33b0 0x7f79d80a5870 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f79e00096c0 tx=0x7f79e0005a20 comp rx=0 tx=0).stop 2024-09-19T07:15:50.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.788+0000 7f79f65b8640 1 -- 172.21.15.148:0/3802250187 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79f0102570 msgr2=0x7f79f0197900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:50.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.788+0000 7f79f65b8640 1 --2- 172.21.15.148:0/3802250187 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79f0102570 0x7f79f0197900 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f79e400eb00 tx=0x7f79e4009e60 comp rx=0 tx=0).stop 2024-09-19T07:15:50.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.788+0000 7f79f65b8640 1 -- 172.21.15.148:0/3802250187 shutdown_connections 2024-09-19T07:15:50.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.789+0000 7f79f65b8640 1 --2- 172.21.15.148:0/3802250187 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f79d80a33b0 0x7f79d80a5870 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:50.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.789+0000 7f79f65b8640 1 --2- 172.21.15.148:0/3802250187 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79f0102ef0 0x7f79f019bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:50.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.789+0000 7f79f65b8640 1 --2- 172.21.15.148:0/3802250187 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79f0102570 0x7f79f0197900 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:50.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.789+0000 7f79f65b8640 1 --2- 172.21.15.148:0/3802250187 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79f0100e20 0x7f79f01973c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:50.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.789+0000 7f79f65b8640 1 -- 172.21.15.148:0/3802250187 >> 172.21.15.148:0/3802250187 conn(0x7f79f00fc7d0 msgr2=0x7f79f00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:15:50.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.789+0000 7f79f65b8640 1 -- 172.21.15.148:0/3802250187 shutdown_connections 2024-09-19T07:15:50.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:50.789+0000 7f79f65b8640 1 -- 172.21.15.148:0/3802250187 wait complete. 2024-09-19T07:15:51.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:15:50 smithi148 ceph-mon[31180]: pgmap v146: 97 pgs: 97 active+clean; 877 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 3.9 MiB/s wr, 438 op/s 2024-09-19T07:15:51.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:15:50 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/3802250187' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:15:51.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:15:50 smithi179 ceph-mon[35716]: pgmap v146: 97 pgs: 97 active+clean; 877 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 3.9 MiB/s wr, 438 op/s 2024-09-19T07:15:51.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:15:50 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/3802250187' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:15:51.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:15:50 smithi165 ceph-mon[35326]: pgmap v146: 97 pgs: 97 active+clean; 877 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 3.9 MiB/s wr, 438 op/s 2024-09-19T07:15:51.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:15:50 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/3802250187' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:15:51.607 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24457 quiesce db --set-id 9d178c44 --release --await' 2024-09-19T07:15:51.607 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24457 quiesce db --set-id 9d178c44 --release --await 2024-09-19T07:15:52.124 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:15:52.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.803+0000 7f3a8dfc8640 1 -- 172.21.15.148:0/307560372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a88106f10 msgr2=0x7f3a8810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:52.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.803+0000 7f3a8dfc8640 1 --2- 172.21.15.148:0/307560372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a88106f10 0x7f3a8810ea90 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f3a80009900 tx=0x7f3a8002a410 comp rx=0 tx=0).stop 2024-09-19T07:15:52.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.803+0000 7f3a8dfc8640 1 -- 172.21.15.148:0/307560372 shutdown_connections 2024-09-19T07:15:52.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.803+0000 7f3a8dfc8640 1 --2- 172.21.15.148:0/307560372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a88106f10 0x7f3a8810ea90 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:52.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.803+0000 7f3a8dfc8640 1 --2- 172.21.15.148:0/307560372 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a88102790 0x7f3a881067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:52.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.803+0000 7f3a8dfc8640 1 --2- 172.21.15.148:0/307560372 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3a88101de0 0x7f3a881021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:52.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.803+0000 7f3a8dfc8640 1 -- 172.21.15.148:0/307560372 >> 172.21.15.148:0/307560372 conn(0x7f3a880fd8c0 msgr2=0x7f3a880ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:15:52.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.803+0000 7f3a8dfc8640 1 -- 172.21.15.148:0/307560372 shutdown_connections 2024-09-19T07:15:52.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.803+0000 7f3a8dfc8640 1 -- 172.21.15.148:0/307560372 wait complete. 2024-09-19T07:15:52.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.803+0000 7f3a8dfc8640 1 Processor -- start 2024-09-19T07:15:52.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.804+0000 7f3a8dfc8640 1 -- start start 2024-09-19T07:15:52.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.804+0000 7f3a8dfc8640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3a88101de0 0x7f3a881a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:52.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.804+0000 7f3a8dfc8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a88102790 0x7f3a881a3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:52.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.804+0000 7f3a8dfc8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a88106f10 0x7f3a8810dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:52.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.804+0000 7f3a8dfc8640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3a88112010 con 0x7f3a88102790 2024-09-19T07:15:52.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.804+0000 7f3a8dfc8640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3a88111e90 con 0x7f3a88101de0 2024-09-19T07:15:52.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.804+0000 7f3a8dfc8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3a88112190 con 0x7f3a88106f10 2024-09-19T07:15:52.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.804+0000 7f3a86ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a88102790 0x7f3a881a3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:52.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.804+0000 7f3a86ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a88102790 0x7f3a881a3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36292/0 (socket says 172.21.15.148:36292) 2024-09-19T07:15:52.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.804+0000 7f3a86ffd640 1 -- 172.21.15.148:0/3056794923 learned_addr learned my addr 172.21.15.148:0/3056794923 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:15:52.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.804+0000 7f3a87fff640 1 --2- 172.21.15.148:0/3056794923 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a88106f10 0x7f3a8810dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:52.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.804+0000 7f3a877fe640 1 --2- 172.21.15.148:0/3056794923 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3a88101de0 0x7f3a881a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:52.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.804+0000 7f3a86ffd640 1 -- 172.21.15.148:0/3056794923 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a88106f10 msgr2=0x7f3a8810dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:52.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.804+0000 7f3a86ffd640 1 --2- 172.21.15.148:0/3056794923 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a88106f10 0x7f3a8810dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:52.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.804+0000 7f3a86ffd640 1 -- 172.21.15.148:0/3056794923 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3a88101de0 msgr2=0x7f3a881a37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:52.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.804+0000 7f3a86ffd640 1 --2- 172.21.15.148:0/3056794923 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3a88101de0 0x7f3a881a37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:52.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.804+0000 7f3a86ffd640 1 -- 172.21.15.148:0/3056794923 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a8810e430 con 0x7f3a88102790 2024-09-19T07:15:52.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.805+0000 7f3a86ffd640 1 --2- 172.21.15.148:0/3056794923 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a88102790 0x7f3a881a3ce0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f3a7000b4a0 tx=0x7f3a7000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:52.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.805+0000 7f3a84ff9640 1 -- 172.21.15.148:0/3056794923 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a70014070 con 0x7f3a88102790 2024-09-19T07:15:52.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.805+0000 7f3a84ff9640 1 -- 172.21.15.148:0/3056794923 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a70010af0 con 0x7f3a88102790 2024-09-19T07:15:52.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.805+0000 7f3a84ff9640 1 -- 172.21.15.148:0/3056794923 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a70017d10 con 0x7f3a88102790 2024-09-19T07:15:52.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.805+0000 7f3a8dfc8640 1 -- 172.21.15.148:0/3056794923 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a8810e720 con 0x7f3a88102790 2024-09-19T07:15:52.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.805+0000 7f3a8dfc8640 1 -- 172.21.15.148:0/3056794923 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a881ab6d0 con 0x7f3a88102790 2024-09-19T07:15:52.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.807+0000 7f3a84ff9640 1 -- 172.21.15.148:0/3056794923 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f3a70017070 con 0x7f3a88102790 2024-09-19T07:15:52.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.808+0000 7f3a903a1740 1 Processor -- start 2024-09-19T07:15:52.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.808+0000 7f3a903a1740 1 -- start start 2024-09-19T07:15:52.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.808+0000 7f3a903a1740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e7218a2060 0x55e7218a2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:52.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.808+0000 7f3a903a1740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7218a2980 0x55e7218acd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:52.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.808+0000 7f3a903a1740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7218ad240 0x55e7218af630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:52.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.808+0000 7f3a903a1740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55e721807620 con 0x55e7218ad240 2024-09-19T07:15:52.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.808+0000 7f3a903a1740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55e7217aee50 con 0x55e7218a2980 2024-09-19T07:15:52.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.808+0000 7f3a903a1740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55e7218035e0 con 0x55e7218a2060 2024-09-19T07:15:52.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.808+0000 7f3a86ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7218ad240 0x55e7218af630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:52.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.808+0000 7f3a86ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7218ad240 0x55e7218af630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36306/0 (socket says 172.21.15.148:36306) 2024-09-19T07:15:52.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.808+0000 7f3a86ffd640 1 -- 172.21.15.148:0/498819137 learned_addr learned my addr 172.21.15.148:0/498819137 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:15:52.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.808+0000 7f3a87fff640 1 --2- 172.21.15.148:0/498819137 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e7218a2060 0x55e7218a2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:52.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.808+0000 7f3a877fe640 1 --2- 172.21.15.148:0/498819137 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7218a2980 0x55e7218acd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:52.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.808+0000 7f3a84ff9640 1 --2- 172.21.15.148:0/3056794923 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f3a740a33b0 0x7f3a740a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:52.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.809+0000 7f3a86ffd640 1 -- 172.21.15.148:0/498819137 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e7218a2060 msgr2=0x55e7218a2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:52.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.809+0000 7f3a86ffd640 1 --2- 172.21.15.148:0/498819137 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e7218a2060 0x55e7218a2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:52.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.809+0000 7f3a86ffd640 1 -- 172.21.15.148:0/498819137 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7218a2980 msgr2=0x55e7218acd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:52.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.809+0000 7f3a86ffd640 1 --2- 172.21.15.148:0/498819137 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7218a2980 0x55e7218acd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:52.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.809+0000 7f3a86ffd640 1 -- 172.21.15.148:0/498819137 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e72179fd40 con 0x55e7218ad240 2024-09-19T07:15:52.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.809+0000 7f3a87fff640 1 --2- 172.21.15.148:0/3056794923 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f3a740a33b0 0x7f3a740a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:52.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.809+0000 7f3a84ff9640 1 -- 172.21.15.148:0/3056794923 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f3a700cf060 con 0x7f3a88102790 2024-09-19T07:15:52.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.809+0000 7f3a86ffd640 1 --2- 172.21.15.148:0/498819137 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7218ad240 0x55e7218af630 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f3a700cc7d0 tx=0x7f3a700908b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6aac0f28e1a95bf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:52.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.809+0000 7f3a7dffb640 1 -- 172.21.15.148:0/498819137 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a7009af60 con 0x55e7218ad240 2024-09-19T07:15:52.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.809+0000 7f3a87fff640 1 --2- 172.21.15.148:0/3056794923 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f3a740a33b0 0x7f3a740a5870 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3a80031550 tx=0x7f3a80009260 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:52.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.809+0000 7f3a7dffb640 1 -- 172.21.15.148:0/498819137 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a700943f0 con 0x55e7218ad240 2024-09-19T07:15:52.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.809+0000 7f3a7dffb640 1 -- 172.21.15.148:0/498819137 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a7006b0b0 con 0x55e7218ad240 2024-09-19T07:15:52.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.810+0000 7f3a903a1740 1 -- 172.21.15.148:0/498819137 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7218ad240 msgr2=0x55e7218af630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:52.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.810+0000 7f3a903a1740 1 --2- 172.21.15.148:0/498819137 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7218ad240 0x55e7218af630 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f3a700cc7d0 tx=0x7f3a700908b0 comp rx=0 tx=0).stop 2024-09-19T07:15:52.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.810+0000 7f3a903a1740 1 -- 172.21.15.148:0/498819137 shutdown_connections 2024-09-19T07:15:52.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.810+0000 7f3a903a1740 1 --2- 172.21.15.148:0/498819137 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7218ad240 0x55e7218af630 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:52.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.810+0000 7f3a903a1740 1 --2- 172.21.15.148:0/498819137 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7218a2980 0x55e7218acd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:52.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.810+0000 7f3a903a1740 1 --2- 172.21.15.148:0/498819137 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e7218a2060 0x55e7218a2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:52.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.810+0000 7f3a903a1740 1 -- 172.21.15.148:0/498819137 >> 172.21.15.148:0/498819137 conn(0x55e72189e5f0 msgr2=0x55e72189e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:15:52.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.810+0000 7f3a903a1740 1 -- 172.21.15.148:0/498819137 shutdown_connections 2024-09-19T07:15:52.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.810+0000 7f3a903a1740 1 -- 172.21.15.148:0/498819137 wait complete. 2024-09-19T07:15:52.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.810+0000 7f3a903a1740 1 -- start start 2024-09-19T07:15:52.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.810+0000 7f3a903a1740 1 Processor -- start 2024-09-19T07:15:52.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.811+0000 7f3a903a1740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7218a2060 0x55e7218aa180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:52.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.811+0000 7f3a903a1740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e7218a2980 0x55e7218aa6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:52.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.811+0000 7f3a903a1740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7218ad240 0x55e7218aac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:52.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.811+0000 7f3a903a1740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55e7218afe10 con 0x55e7218a2060 2024-09-19T07:15:52.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.811+0000 7f3a903a1740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55e72178ff10 con 0x55e7218ad240 2024-09-19T07:15:52.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.811+0000 7f3a903a1740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55e7218aff90 con 0x55e7218a2980 2024-09-19T07:15:52.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.811+0000 7f3a877fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7218a2060 0x55e7218aa180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:52.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.811+0000 7f3a903a1740 10 client.0 _ll_register_callbacks cb 0x55e7217b3db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:15:52.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.811+0000 7f3a877fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7218a2060 0x55e7218aa180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36318/0 (socket says 172.21.15.148:36318) 2024-09-19T07:15:52.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.811+0000 7f3a877fe640 1 -- 172.21.15.148:0/469703586 learned_addr learned my addr 172.21.15.148:0/469703586 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:15:52.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.811+0000 7f3a86ffd640 1 --2- 172.21.15.148:0/469703586 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e7218a2980 0x55e7218aa6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:52.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.811+0000 7f3a87fff640 1 --2- 172.21.15.148:0/469703586 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7218ad240 0x55e7218aac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:52.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.811+0000 7f3a877fe640 1 -- 172.21.15.148:0/469703586 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e7218a2980 msgr2=0x55e7218aa6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:52.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.811+0000 7f3a877fe640 1 --2- 172.21.15.148:0/469703586 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e7218a2980 0x55e7218aa6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:52.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.811+0000 7f3a877fe640 1 -- 172.21.15.148:0/469703586 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7218ad240 msgr2=0x55e7218aac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:52.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.811+0000 7f3a877fe640 1 --2- 172.21.15.148:0/469703586 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7218ad240 0x55e7218aac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:52.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.811+0000 7f3a877fe640 1 -- 172.21.15.148:0/469703586 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e721516580 con 0x55e7218a2060 2024-09-19T07:15:52.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.811+0000 7f3a87fff640 1 --2- 172.21.15.148:0/469703586 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7218ad240 0x55e7218aac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:15:52.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.811+0000 7f3a877fe640 1 --2- 172.21.15.148:0/469703586 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7218a2060 0x55e7218aa180 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f3a7800be80 tx=0x7f3a78007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e9ceab8a578e588 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:52.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.811+0000 7f3a66ffd640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:15:52.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.811+0000 7f3a66ffd640 1 -- 172.21.15.148:0/469703586 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a78018600 con 0x55e7218a2060 2024-09-19T07:15:52.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.811+0000 7f3a66ffd640 1 -- 172.21.15.148:0/469703586 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f3a780187a0 con 0x55e7218a2060 2024-09-19T07:15:52.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.811+0000 7f3a903a1740 1 -- 172.21.15.148:0/469703586 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e721814b90 con 0x55e7218a2060 2024-09-19T07:15:52.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.812+0000 7f3a66ffd640 1 -- 172.21.15.148:0/469703586 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f3a78025050 con 0x55e7218a2060 2024-09-19T07:15:52.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.812+0000 7f3a903a1740 10 client.16467 fetch_fsmap learned FSMap version 33 2024-09-19T07:15:52.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.812+0000 7f3a903a1740 1 -- 172.21.15.148:0/469703586 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55e7215e0960 con 0x55e7218a2060 2024-09-19T07:15:52.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.812+0000 7f3a66ffd640 1 -- 172.21.15.148:0/469703586 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55e721814b90 con 0x55e7218a2060 2024-09-19T07:15:52.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.812+0000 7f3a66ffd640 1 -- 172.21.15.148:0/469703586 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 33) ==== 8362+0+0 (secure 0 0 0) 0x7f3a78020030 con 0x55e7218a2060 2024-09-19T07:15:52.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.812+0000 7f3a903a1740 10 client.16467 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T07:15:52.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.812+0000 7f3a903a1740 10 client.16467 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:15:52.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.812+0000 7f3a903a1740 20 client.16467 populate_metadata read hostname 'smithi148' 2024-09-19T07:15:52.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.812+0000 7f3a903a1740 1 --2- 172.21.15.148:0/469703586 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e7218bce60 0x55e7218bf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:52.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.812+0000 7f3a903a1740 4 client.16467 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:15:52.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.812+0000 7f3a903a1740 1 -- 172.21.15.148:0/469703586 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e72180f0a0 con 0x55e7218bce60 2024-09-19T07:15:52.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.812+0000 7f3a86ffd640 1 --2- 172.21.15.148:0/469703586 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e7218bce60 0x55e7218bf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:52.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.813+0000 7f3a66ffd640 10 client.16467 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:15:52.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.813+0000 7f3a86ffd640 1 --2- 172.21.15.148:0/469703586 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e7218bce60 0x55e7218bf2d0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fad99331d93af5e6 server_cookie=96757e941dbeb8a8 in_seq=0 out_seq=0 2024-09-19T07:15:52.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.813+0000 7f3a66ffd640 1 -- 172.21.15.148:0/469703586 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e72180f0a0 con 0x55e7218bce60 2024-09-19T07:15:52.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.813+0000 7f3a66ffd640 10 client.16467 handle_command_reply: tid=0 2024-09-19T07:15:52.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.813+0000 7f3a903a1740 1 client.16467 shutdown 2024-09-19T07:15:52.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.814+0000 7f3a903a1740 1 -- 172.21.15.148:0/469703586 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7218a2060 msgr2=0x55e7218aa180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:52.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.814+0000 7f3a903a1740 1 --2- 172.21.15.148:0/469703586 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7218a2060 0x55e7218aa180 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f3a7800be80 tx=0x7f3a78007680 comp rx=0 tx=0).stop 2024-09-19T07:15:52.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.814+0000 7f3a903a1740 1 -- 172.21.15.148:0/469703586 shutdown_connections 2024-09-19T07:15:52.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.814+0000 7f3a903a1740 1 --2- 172.21.15.148:0/469703586 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e7218bce60 0x55e7218bf2d0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:52.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.814+0000 7f3a903a1740 1 --2- 172.21.15.148:0/469703586 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7218ad240 0x55e7218aac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:52.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.814+0000 7f3a903a1740 1 --2- 172.21.15.148:0/469703586 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e7218a2980 0x55e7218aa6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:52.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.814+0000 7f3a66ffd640 0 client.16467 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:15:52.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.814+0000 7f3a903a1740 1 --2- 172.21.15.148:0/469703586 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7218a2060 0x55e7218aa180 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:52.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.814+0000 7f3a903a1740 1 -- 172.21.15.148:0/469703586 >> 172.21.15.148:0/469703586 conn(0x55e72189e5f0 msgr2=0x55e7218a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:15:52.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.814+0000 7f3a903a1740 1 -- 172.21.15.148:0/469703586 shutdown_connections 2024-09-19T07:15:52.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.814+0000 7f3a903a1740 1 -- 172.21.15.148:0/469703586 wait complete. 2024-09-19T07:15:52.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.814+0000 7f3a903a1740 20 client.16467 trim_cache size 0 max 16384 2024-09-19T07:15:52.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.831+0000 7f3a903a1740 1 Processor -- start 2024-09-19T07:15:52.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.831+0000 7f3a903a1740 1 -- start start 2024-09-19T07:15:52.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.831+0000 7f3a903a1740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7218a2060 0x55e7218a41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:52.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.831+0000 7f3a903a1740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e7218a2980 0x55e7218c4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:52.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.831+0000 7f3a903a1740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7218ad240 0x55e7218c50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:52.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.831+0000 7f3a903a1740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3a881b6940 con 0x55e7218a2060 2024-09-19T07:15:52.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.831+0000 7f3a903a1740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3a881b41b0 con 0x55e7218ad240 2024-09-19T07:15:52.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.831+0000 7f3a903a1740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3a881b1fe0 con 0x55e7218a2980 2024-09-19T07:15:52.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.831+0000 7f3a877fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7218a2060 0x55e7218a41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:52.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.831+0000 7f3a877fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7218a2060 0x55e7218a41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36322/0 (socket says 172.21.15.148:36322) 2024-09-19T07:15:52.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.831+0000 7f3a877fe640 1 -- 172.21.15.148:0/4132793321 learned_addr learned my addr 172.21.15.148:0/4132793321 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:15:52.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.831+0000 7f3a86ffd640 1 --2- 172.21.15.148:0/4132793321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e7218a2980 0x55e7218c4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:52.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.831+0000 7f3a877fe640 1 -- 172.21.15.148:0/4132793321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e7218a2980 msgr2=0x55e7218c4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:52.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.831+0000 7f3a87fff640 1 --2- 172.21.15.148:0/4132793321 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7218ad240 0x55e7218c50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:52.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.831+0000 7f3a877fe640 1 --2- 172.21.15.148:0/4132793321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e7218a2980 0x55e7218c4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:52.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.831+0000 7f3a877fe640 1 -- 172.21.15.148:0/4132793321 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7218ad240 msgr2=0x55e7218c50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:52.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.831+0000 7f3a877fe640 1 --2- 172.21.15.148:0/4132793321 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7218ad240 0x55e7218c50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:52.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.831+0000 7f3a877fe640 1 -- 172.21.15.148:0/4132793321 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e72189e420 con 0x55e7218a2060 2024-09-19T07:15:52.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.832+0000 7f3a877fe640 1 --2- 172.21.15.148:0/4132793321 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7218a2060 0x55e7218a41c0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f3a78017a70 tx=0x7f3a78004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41a91e5f056eae69 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:52.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.832+0000 7f3a7d7fa640 1 -- 172.21.15.148:0/4132793321 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a7802d070 con 0x55e7218a2060 2024-09-19T07:15:52.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.832+0000 7f3a7d7fa640 1 -- 172.21.15.148:0/4132793321 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a78009e80 con 0x55e7218a2060 2024-09-19T07:15:52.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.832+0000 7f3a7d7fa640 1 -- 172.21.15.148:0/4132793321 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a78020b60 con 0x55e7218a2060 2024-09-19T07:15:52.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.832+0000 7f3a903a1740 1 -- 172.21.15.148:0/4132793321 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7218a2060 msgr2=0x55e7218a41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:52.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.833+0000 7f3a903a1740 1 --2- 172.21.15.148:0/4132793321 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7218a2060 0x55e7218a41c0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f3a78017a70 tx=0x7f3a78004a40 comp rx=0 tx=0).stop 2024-09-19T07:15:52.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.833+0000 7f3a903a1740 1 -- 172.21.15.148:0/4132793321 shutdown_connections 2024-09-19T07:15:52.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.833+0000 7f3a903a1740 1 --2- 172.21.15.148:0/4132793321 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7218ad240 0x55e7218c50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:52.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.833+0000 7f3a903a1740 1 --2- 172.21.15.148:0/4132793321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e7218a2980 0x55e7218c4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:52.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.833+0000 7f3a903a1740 1 --2- 172.21.15.148:0/4132793321 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7218a2060 0x55e7218a41c0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:52.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.833+0000 7f3a903a1740 1 -- 172.21.15.148:0/4132793321 >> 172.21.15.148:0/4132793321 conn(0x55e72189e5f0 msgr2=0x55e7218a3ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:15:52.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.833+0000 7f3a903a1740 1 -- 172.21.15.148:0/4132793321 shutdown_connections 2024-09-19T07:15:52.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.833+0000 7f3a903a1740 1 -- 172.21.15.148:0/4132793321 wait complete. 2024-09-19T07:15:52.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.833+0000 7f3a903a1740 1 -- start start 2024-09-19T07:15:52.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.833+0000 7f3a903a1740 1 Processor -- start 2024-09-19T07:15:52.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.833+0000 7f3a903a1740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e7218a2060 0x55e7218b13d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:52.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.833+0000 7f3a903a1740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7218a2980 0x55e7218b1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:52.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.833+0000 7f3a903a1740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7218ad240 0x55e721926b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:52.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.834+0000 7f3a903a1740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3a881b2670 con 0x55e7218ad240 2024-09-19T07:15:52.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.834+0000 7f3a903a1740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3a881b3ae0 con 0x55e7218a2980 2024-09-19T07:15:52.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.834+0000 7f3a903a1740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3a881b2d40 con 0x55e7218a2060 2024-09-19T07:15:52.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.834+0000 7f3a903a1740 10 client.0 _ll_register_callbacks cb 0x7f3a7800ba90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:15:52.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.834+0000 7f3a87fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7218ad240 0x55e721926b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:52.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.834+0000 7f3a87fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7218ad240 0x55e721926b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36328/0 (socket says 172.21.15.148:36328) 2024-09-19T07:15:52.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.834+0000 7f3a87fff640 1 -- 172.21.15.148:0/3367314144 learned_addr learned my addr 172.21.15.148:0/3367314144 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:15:52.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.834+0000 7f3a86ffd640 1 --2- 172.21.15.148:0/3367314144 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7218a2980 0x55e7218b1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:52.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.834+0000 7f3a877fe640 1 --2- 172.21.15.148:0/3367314144 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e7218a2060 0x55e7218b13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:52.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.834+0000 7f3a87fff640 1 -- 172.21.15.148:0/3367314144 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e7218a2060 msgr2=0x55e7218b13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:52.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.834+0000 7f3a87fff640 1 --2- 172.21.15.148:0/3367314144 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e7218a2060 0x55e7218b13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:52.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.834+0000 7f3a87fff640 1 -- 172.21.15.148:0/3367314144 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7218a2980 msgr2=0x55e7218b1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:52.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.834+0000 7f3a87fff640 1 --2- 172.21.15.148:0/3367314144 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7218a2980 0x55e7218b1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:52.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.834+0000 7f3a87fff640 1 -- 172.21.15.148:0/3367314144 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7219270b0 con 0x55e7218ad240 2024-09-19T07:15:52.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.834+0000 7f3a86ffd640 1 --2- 172.21.15.148:0/3367314144 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7218a2980 0x55e7218b1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:15:52.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.834+0000 7f3a87fff640 1 --2- 172.21.15.148:0/3367314144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7218ad240 0x55e721926b70 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f3a80033000 tx=0x7f3a80005a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5356cbd00163b635 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:52.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.834+0000 7f3a66ffd640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:15:52.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.834+0000 7f3a66ffd640 1 -- 172.21.15.148:0/3367314144 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a80035040 con 0x55e7218ad240 2024-09-19T07:15:52.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.834+0000 7f3a66ffd640 1 -- 172.21.15.148:0/3367314144 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f3a80003c80 con 0x55e7218ad240 2024-09-19T07:15:52.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.834+0000 7f3a903a1740 1 -- 172.21.15.148:0/3367314144 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e72178b5a0 con 0x55e7218ad240 2024-09-19T07:15:52.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.835+0000 7f3a66ffd640 1 -- 172.21.15.148:0/3367314144 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f3a80003e80 con 0x55e7218ad240 2024-09-19T07:15:52.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.835+0000 7f3a903a1740 10 client.16473 fetch_fsmap learned FSMap version 33 2024-09-19T07:15:52.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.835+0000 7f3a903a1740 1 -- 172.21.15.148:0/3367314144 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55e7219282d0 con 0x55e7218ad240 2024-09-19T07:15:52.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.835+0000 7f3a66ffd640 1 -- 172.21.15.148:0/3367314144 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55e72178b5a0 con 0x55e7218ad240 2024-09-19T07:15:52.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.835+0000 7f3a66ffd640 1 -- 172.21.15.148:0/3367314144 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 33) ==== 8362+0+0 (secure 0 0 0) 0x7f3a8003d720 con 0x55e7218ad240 2024-09-19T07:15:52.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.835+0000 7f3a903a1740 10 client.16473 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T07:15:52.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.835+0000 7f3a903a1740 10 client.16473 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:15:52.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.835+0000 7f3a903a1740 20 client.16473 populate_metadata read hostname 'smithi148' 2024-09-19T07:15:52.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.835+0000 7f3a903a1740 1 --2- 172.21.15.148:0/3367314144 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e721928a20 0x55e72192ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:52.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.835+0000 7f3a903a1740 4 client.16473 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "9d178c44", "release": true, "await": true}] 2024-09-19T07:15:52.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.835+0000 7f3a903a1740 1 -- 172.21.15.148:0/3367314144 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "quiesce db", "set_id": "9d178c44", "release": true, "await": true}) -- 0x55e7217d8ce0 con 0x55e721928a20 2024-09-19T07:15:52.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.835+0000 7f3a877fe640 1 --2- 172.21.15.148:0/3367314144 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e721928a20 0x55e72192ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:52.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.836+0000 7f3a877fe640 1 --2- 172.21.15.148:0/3367314144 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e721928a20 0x55e72192ae40 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4735ab558c3196db server_cookie=baa29e802a205f47 in_seq=0 out_seq=0 2024-09-19T07:15:52.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:52.836+0000 7f3a66ffd640 10 client.16473 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:15:53.002 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:15:53 smithi148 ceph-mon[31180]: pgmap v147: 97 pgs: 97 active+clean; 861 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 4.7 MiB/s wr, 761 op/s 2024-09-19T07:15:53.194 INFO:tasks.workunit.client.0.smithi148.stdout: 229 218543 0 148685 0 66910 0 2024-09-19T07:15:53.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:15:53 smithi179 ceph-mon[35716]: pgmap v147: 97 pgs: 97 active+clean; 861 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 4.7 MiB/s wr, 761 op/s 2024-09-19T07:15:53.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:15:53 smithi165 ceph-mon[35326]: pgmap v147: 97 pgs: 97 active+clean; 861 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 4.7 MiB/s wr, 761 op/s 2024-09-19T07:15:53.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:53.604+0000 7f3a66ffd640 1 -- 172.21.15.148:0/3367314144 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55e7217d8ce0 con 0x55e721928a20 2024-09-19T07:15:53.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:53.604+0000 7f3a66ffd640 10 client.16473 handle_command_reply: tid=0 2024-09-19T07:15:53.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:53.604+0000 7f3a903a1740 1 client.16473 shutdown 2024-09-19T07:15:53.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:53.604+0000 7f3a903a1740 1 -- 172.21.15.148:0/3367314144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7218ad240 msgr2=0x55e721926b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:53.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:53.604+0000 7f3a903a1740 1 --2- 172.21.15.148:0/3367314144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7218ad240 0x55e721926b70 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f3a80033000 tx=0x7f3a80005a40 comp rx=0 tx=0).stop 2024-09-19T07:15:53.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:53.604+0000 7f3a903a1740 1 -- 172.21.15.148:0/3367314144 shutdown_connections 2024-09-19T07:15:53.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:53.604+0000 7f3a903a1740 1 --2- 172.21.15.148:0/3367314144 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e721928a20 0x55e72192ae40 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:53.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:53.604+0000 7f3a903a1740 1 --2- 172.21.15.148:0/3367314144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e7218ad240 0x55e721926b70 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:53.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:53.604+0000 7f3a903a1740 1 --2- 172.21.15.148:0/3367314144 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7218a2980 0x55e7218b1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:53.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:53.604+0000 7f3a903a1740 1 --2- 172.21.15.148:0/3367314144 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e7218a2060 0x55e7218b13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:53.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:53.604+0000 7f3a903a1740 1 -- 172.21.15.148:0/3367314144 >> 172.21.15.148:0/3367314144 conn(0x55e72189e5f0 msgr2=0x55e72189d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:15:53.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:53.604+0000 7f3a66ffd640 0 client.16473 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:15:53.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:53.604+0000 7f3a903a1740 1 -- 172.21.15.148:0/3367314144 shutdown_connections 2024-09-19T07:15:53.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:53.604+0000 7f3a903a1740 1 -- 172.21.15.148:0/3367314144 wait complete. 2024-09-19T07:15:53.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:53.604+0000 7f3a903a1740 20 client.16473 trim_cache size 0 max 16384 2024-09-19T07:15:53.606 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:15:53.606 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 33, 2024-09-19T07:15:53.606 INFO:teuthology.orchestra.run.smithi148.stdout: "leader": 24457, 2024-09-19T07:15:53.606 INFO:teuthology.orchestra.run.smithi148.stdout: "set_version": 20, 2024-09-19T07:15:53.606 INFO:teuthology.orchestra.run.smithi148.stdout: "sets": { 2024-09-19T07:15:53.607 INFO:teuthology.orchestra.run.smithi148.stdout: "9d178c44": { 2024-09-19T07:15:53.607 INFO:teuthology.orchestra.run.smithi148.stdout: "version": 20, 2024-09-19T07:15:53.607 INFO:teuthology.orchestra.run.smithi148.stdout: "age_ref": 0.0, 2024-09-19T07:15:53.607 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:15:53.607 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RELEASED", 2024-09-19T07:15:53.607 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:15:53.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:15:53.607 INFO:teuthology.orchestra.run.smithi148.stdout: "timeout": 90.0, 2024-09-19T07:15:53.607 INFO:teuthology.orchestra.run.smithi148.stdout: "expiration": 149.8, 2024-09-19T07:15:53.607 INFO:teuthology.orchestra.run.smithi148.stdout: "members": { 2024-09-19T07:15:53.607 INFO:teuthology.orchestra.run.smithi148.stdout: "file:/": { 2024-09-19T07:15:53.607 INFO:teuthology.orchestra.run.smithi148.stdout: "excluded": false, 2024-09-19T07:15:53.607 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:15:53.607 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RELEASED", 2024-09-19T07:15:53.608 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:15:53.608 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:15:53.608 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:15:53.608 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:15:53.608 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:15:53.608 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:15:53.608 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:15:53.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:53.604+0000 7f3a8dfc8640 1 -- 172.21.15.148:0/3056794923 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f3a740a33b0 msgr2=0x7f3a740a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:53.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:53.604+0000 7f3a8dfc8640 1 --2- 172.21.15.148:0/3056794923 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f3a740a33b0 0x7f3a740a5870 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3a80031550 tx=0x7f3a80009260 comp rx=0 tx=0).stop 2024-09-19T07:15:53.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:53.604+0000 7f3a8dfc8640 1 -- 172.21.15.148:0/3056794923 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a88102790 msgr2=0x7f3a881a3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:53.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:53.604+0000 7f3a8dfc8640 1 --2- 172.21.15.148:0/3056794923 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a88102790 0x7f3a881a3ce0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f3a7000b4a0 tx=0x7f3a7000b960 comp rx=0 tx=0).stop 2024-09-19T07:15:53.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:53.605+0000 7f3a8dfc8640 1 -- 172.21.15.148:0/3056794923 shutdown_connections 2024-09-19T07:15:53.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:53.605+0000 7f3a8dfc8640 1 --2- 172.21.15.148:0/3056794923 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f3a740a33b0 0x7f3a740a5870 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:53.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:53.605+0000 7f3a8dfc8640 1 --2- 172.21.15.148:0/3056794923 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a88106f10 0x7f3a8810dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:53.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:53.605+0000 7f3a8dfc8640 1 --2- 172.21.15.148:0/3056794923 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a88102790 0x7f3a881a3ce0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:53.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:53.605+0000 7f3a8dfc8640 1 --2- 172.21.15.148:0/3056794923 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3a88101de0 0x7f3a881a37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:53.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:53.605+0000 7f3a8dfc8640 1 -- 172.21.15.148:0/3056794923 >> 172.21.15.148:0/3056794923 conn(0x7f3a880fd8c0 msgr2=0x7f3a880fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:15:53.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:53.605+0000 7f3a8dfc8640 1 -- 172.21.15.148:0/3056794923 shutdown_connections 2024-09-19T07:15:53.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:53.605+0000 7f3a8dfc8640 1 -- 172.21.15.148:0/3056794923 wait complete. 2024-09-19T07:15:54.982 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '9d178c44', total seconds elapsed: 35.0 2024-09-19T07:15:54.982 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.8 2024-09-19T07:15:54.983 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:15:55.233 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:15:55 smithi148 ceph-mon[31180]: pgmap v148: 97 pgs: 97 active+clean; 861 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 2.7 MiB/s wr, 516 op/s 2024-09-19T07:15:55.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:15:55 smithi179 ceph-mon[35716]: pgmap v148: 97 pgs: 97 active+clean; 861 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 2.7 MiB/s wr, 516 op/s 2024-09-19T07:15:55.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:15:55 smithi165 ceph-mon[35326]: pgmap v148: 97 pgs: 97 active+clean; 861 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 2.7 MiB/s wr, 516 op/s 2024-09-19T07:15:55.604 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:15:56.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.161+0000 7f6886154640 1 -- 172.21.15.148:0/1195232488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6880109e00 msgr2=0x7f688010e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:56.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.161+0000 7f6886154640 1 --2- 172.21.15.148:0/1195232488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6880109e00 0x7f688010e2b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6874009860 tx=0x7f687402a340 comp rx=0 tx=0).stop 2024-09-19T07:15:56.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.161+0000 7f6886154640 1 -- 172.21.15.148:0/1195232488 shutdown_connections 2024-09-19T07:15:56.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.161+0000 7f6886154640 1 --2- 172.21.15.148:0/1195232488 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f688010e9e0 0x7f6880115380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:56.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.161+0000 7f6886154640 1 --2- 172.21.15.148:0/1195232488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6880109e00 0x7f688010e2b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:56.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.161+0000 7f6886154640 1 --2- 172.21.15.148:0/1195232488 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6880109450 0x7f6880109830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:56.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.161+0000 7f6886154640 1 -- 172.21.15.148:0/1195232488 >> 172.21.15.148:0/1195232488 conn(0x7f68800735f0 msgr2=0x7f6880073a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:15:56.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.163+0000 7f6886154640 1 -- 172.21.15.148:0/1195232488 shutdown_connections 2024-09-19T07:15:56.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.163+0000 7f6886154640 1 -- 172.21.15.148:0/1195232488 wait complete. 2024-09-19T07:15:56.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.164+0000 7f6886154640 1 Processor -- start 2024-09-19T07:15:56.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.165+0000 7f6886154640 1 -- start start 2024-09-19T07:15:56.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.165+0000 7f6886154640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6880109450 0x7f68801a5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:56.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.165+0000 7f6886154640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6880109e00 0x7f68801a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:56.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.165+0000 7f6886154640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f688010e9e0 0x7f688019f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:56.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.165+0000 7f6886154640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6880118bf0 con 0x7f6880109e00 2024-09-19T07:15:56.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.165+0000 7f6886154640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6880118a70 con 0x7f688010e9e0 2024-09-19T07:15:56.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.165+0000 7f6886154640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6880118d70 con 0x7f6880109450 2024-09-19T07:15:56.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.165+0000 7f687ffff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f688010e9e0 0x7f688019f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:56.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.165+0000 7f687effd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6880109e00 0x7f68801a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:56.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.165+0000 7f687f7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6880109450 0x7f68801a5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:56.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.165+0000 7f687ffff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f688010e9e0 0x7f688019f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:35096/0 (socket says 172.21.15.148:35096) 2024-09-19T07:15:56.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.165+0000 7f687ffff640 1 -- 172.21.15.148:0/891602086 learned_addr learned my addr 172.21.15.148:0/891602086 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:15:56.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.166+0000 7f687ffff640 1 -- 172.21.15.148:0/891602086 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6880109450 msgr2=0x7f68801a5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:56.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.166+0000 7f687ffff640 1 --2- 172.21.15.148:0/891602086 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6880109450 0x7f68801a5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:56.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.166+0000 7f687ffff640 1 -- 172.21.15.148:0/891602086 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6880109e00 msgr2=0x7f68801a5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:56.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.166+0000 7f687ffff640 1 --2- 172.21.15.148:0/891602086 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6880109e00 0x7f68801a5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:56.168 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.166+0000 7f687ffff640 1 -- 172.21.15.148:0/891602086 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f688019ff20 con 0x7f688010e9e0 2024-09-19T07:15:56.168 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.166+0000 7f687ffff640 1 --2- 172.21.15.148:0/891602086 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f688010e9e0 0x7f688019f770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f687800b680 tx=0x7f687800ba80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:56.168 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.166+0000 7f687cff9640 1 -- 172.21.15.148:0/891602086 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6878004b20 con 0x7f688010e9e0 2024-09-19T07:15:56.168 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.166+0000 7f6886154640 1 -- 172.21.15.148:0/891602086 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68801a0210 con 0x7f688010e9e0 2024-09-19T07:15:56.168 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.166+0000 7f687cff9640 1 -- 172.21.15.148:0/891602086 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6878004cc0 con 0x7f688010e9e0 2024-09-19T07:15:56.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.167+0000 7f6886154640 1 -- 172.21.15.148:0/891602086 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f688010a270 con 0x7f688010e9e0 2024-09-19T07:15:56.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.167+0000 7f687cff9640 1 -- 172.21.15.148:0/891602086 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6878005780 con 0x7f688010e9e0 2024-09-19T07:15:56.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.168+0000 7f6886154640 1 -- 172.21.15.148:0/891602086 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f688006ee90 con 0x7f688010e9e0 2024-09-19T07:15:56.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.169+0000 7f687cff9640 1 -- 172.21.15.148:0/891602086 <== mon.2 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f6878020020 con 0x7f688010e9e0 2024-09-19T07:15:56.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.170+0000 7f687cff9640 1 --2- 172.21.15.148:0/891602086 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f68680a3310 0x7f68680a57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:56.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.171+0000 7f687f7fe640 1 --2- 172.21.15.148:0/891602086 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f68680a3310 0x7f68680a57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:56.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.171+0000 7f687cff9640 1 -- 172.21.15.148:0/891602086 <== mon.2 v2:172.21.15.165:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f68780d3ea0 con 0x7f688010e9e0 2024-09-19T07:15:56.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.171+0000 7f687f7fe640 1 --2- 172.21.15.148:0/891602086 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f68680a3310 0x7f68680a57d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f687000abe0 tx=0x7f687000a2d0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:56.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.174+0000 7f687cff9640 1 -- 172.21.15.148:0/891602086 <== mon.2 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f68780a0890 con 0x7f688010e9e0 2024-09-19T07:15:56.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.421+0000 7f6886154640 1 -- 172.21.15.148:0/891602086 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f68801a0c80 con 0x7f688010e9e0 2024-09-19T07:15:56.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.422+0000 7f687cff9640 1 -- 172.21.15.148:0/891602086 <== mon.2 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11947 (secure 0 0 0) 0x7f68780a0190 con 0x7f688010e9e0 2024-09-19T07:15:56.423 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:15:56.423 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":33,"btime":"2024-09-19T07:14:31:818799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/4263868576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":4263868576},{"type":"v1","addr":"172.21.15.148:6841","nonce":4263868576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":25606,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3891676893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3891676893},{"type":"v1","addr":"172.21.15.179:6835","nonce":3891676893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":33,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:09:19.543369+0000","modified":"2024-09-19T07:14:30.968403+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24457,"mds_1":24437,"mds_2":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24383":{"gid":24383,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6835/2146820965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2146820965},{"type":"v1","addr":"172.21.15.165:6835","nonce":2146820965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24410":{"gid":24410,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":75,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":71,"addr":"172.21.15.165:6839/3993490234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":3993490234},{"type":"v1","addr":"172.21.15.165:6839","nonce":3993490234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24457,"qdb_cluster":[24457,24437,24436]},"id":1}]} 2024-09-19T07:15:56.423 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 33 2024-09-19T07:15:56.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.424+0000 7f6886154640 1 -- 172.21.15.148:0/891602086 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f68680a3310 msgr2=0x7f68680a57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:56.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.424+0000 7f6886154640 1 --2- 172.21.15.148:0/891602086 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f68680a3310 0x7f68680a57d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f687000abe0 tx=0x7f687000a2d0 comp rx=0 tx=0).stop 2024-09-19T07:15:56.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.424+0000 7f6886154640 1 -- 172.21.15.148:0/891602086 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f688010e9e0 msgr2=0x7f688019f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:56.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.424+0000 7f6886154640 1 --2- 172.21.15.148:0/891602086 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f688010e9e0 0x7f688019f770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f687800b680 tx=0x7f687800ba80 comp rx=0 tx=0).stop 2024-09-19T07:15:56.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.424+0000 7f6886154640 1 -- 172.21.15.148:0/891602086 shutdown_connections 2024-09-19T07:15:56.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.424+0000 7f6886154640 1 --2- 172.21.15.148:0/891602086 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f68680a3310 0x7f68680a57d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:56.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.424+0000 7f6886154640 1 --2- 172.21.15.148:0/891602086 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f688010e9e0 0x7f688019f770 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:56.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.424+0000 7f6886154640 1 --2- 172.21.15.148:0/891602086 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6880109e00 0x7f68801a5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:56.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.424+0000 7f6886154640 1 --2- 172.21.15.148:0/891602086 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6880109450 0x7f68801a5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:56.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.424+0000 7f6886154640 1 -- 172.21.15.148:0/891602086 >> 172.21.15.148:0/891602086 conn(0x7f68800735f0 msgr2=0x7f688006d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:15:56.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.425+0000 7f6886154640 1 -- 172.21.15.148:0/891602086 shutdown_connections 2024-09-19T07:15:56.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:56.425+0000 7f6886154640 1 -- 172.21.15.148:0/891602086 wait complete. 2024-09-19T07:15:57.008 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:15:57 smithi148 ceph-mon[31180]: pgmap v149: 97 pgs: 97 active+clean; 866 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 3.1 MiB/s wr, 599 op/s 2024-09-19T07:15:57.009 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:15:57 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/891602086' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:15:57.208 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24457 quiesce db / --timeout 90 --expiration 149.8 --await-for 45.0' 2024-09-19T07:15:57.208 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24457 quiesce db / --timeout 90 --expiration 149.8 --await-for 45.0 2024-09-19T07:15:57.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:15:57 smithi179 ceph-mon[35716]: pgmap v149: 97 pgs: 97 active+clean; 866 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 3.1 MiB/s wr, 599 op/s 2024-09-19T07:15:57.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:15:57 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/891602086' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:15:57.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:15:57 smithi165 ceph-mon[35326]: pgmap v149: 97 pgs: 97 active+clean; 866 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 3.1 MiB/s wr, 599 op/s 2024-09-19T07:15:57.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:15:57 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/891602086' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:15:57.520 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:15:58.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.130+0000 7fc03b900640 1 -- 172.21.15.148:0/1256284321 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc034101de0 msgr2=0x7fc0341021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:58.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.130+0000 7fc03b900640 1 --2- 172.21.15.148:0/1256284321 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc034101de0 0x7fc0341021c0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fc024009860 tx=0x7fc02402e750 comp rx=0 tx=0).stop 2024-09-19T07:15:58.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.130+0000 7fc03b900640 1 -- 172.21.15.148:0/1256284321 shutdown_connections 2024-09-19T07:15:58.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.130+0000 7fc03b900640 1 --2- 172.21.15.148:0/1256284321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc034106f10 0x7fc03410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:58.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.130+0000 7fc03b900640 1 --2- 172.21.15.148:0/1256284321 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc034102790 0x7fc0341067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:58.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.130+0000 7fc03b900640 1 --2- 172.21.15.148:0/1256284321 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc034101de0 0x7fc0341021c0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:58.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.130+0000 7fc03b900640 1 -- 172.21.15.148:0/1256284321 >> 172.21.15.148:0/1256284321 conn(0x7fc0340fd8c0 msgr2=0x7fc0340ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:15:58.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.132+0000 7fc03b900640 1 -- 172.21.15.148:0/1256284321 shutdown_connections 2024-09-19T07:15:58.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.132+0000 7fc03b900640 1 -- 172.21.15.148:0/1256284321 wait complete. 2024-09-19T07:15:58.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.133+0000 7fc03b900640 1 Processor -- start 2024-09-19T07:15:58.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.134+0000 7fc03b900640 1 -- start start 2024-09-19T07:15:58.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.134+0000 7fc03b900640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc034101de0 0x7fc034073980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:58.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.134+0000 7fc03b900640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc034102790 0x7fc034073ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:58.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.134+0000 7fc03b900640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc034106f10 0x7fc03406cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:58.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.134+0000 7fc03b900640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc034118570 con 0x7fc034106f10 2024-09-19T07:15:58.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.134+0000 7fc03b900640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc0341183f0 con 0x7fc034101de0 2024-09-19T07:15:58.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.134+0000 7fc03b900640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc0341186f0 con 0x7fc034102790 2024-09-19T07:15:58.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.134+0000 7fc038e9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc034102790 0x7fc034073ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:58.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.135+0000 7fc038e9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc034102790 0x7fc034073ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:39698/0 (socket says 172.21.15.148:39698) 2024-09-19T07:15:58.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.135+0000 7fc038e9b640 1 -- 172.21.15.148:0/2823735618 learned_addr learned my addr 172.21.15.148:0/2823735618 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:15:58.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.135+0000 7fc039e9d640 1 --2- 172.21.15.148:0/2823735618 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc034106f10 0x7fc03406cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:58.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.135+0000 7fc038e9b640 1 -- 172.21.15.148:0/2823735618 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc034101de0 msgr2=0x7fc034073980 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T07:15:58.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.135+0000 7fc038e9b640 1 --2- 172.21.15.148:0/2823735618 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc034101de0 0x7fc034073980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:58.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.135+0000 7fc038e9b640 1 -- 172.21.15.148:0/2823735618 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc034106f10 msgr2=0x7fc03406cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:58.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.135+0000 7fc038e9b640 1 --2- 172.21.15.148:0/2823735618 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc034106f10 0x7fc03406cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:58.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.136+0000 7fc038e9b640 1 -- 172.21.15.148:0/2823735618 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc03406d490 con 0x7fc034102790 2024-09-19T07:15:58.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.136+0000 7fc038e9b640 1 --2- 172.21.15.148:0/2823735618 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc034102790 0x7fc034073ec0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc02c00efb0 tx=0x7fc02c00c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:58.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.137+0000 7fc02a7fc640 1 -- 172.21.15.148:0/2823735618 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc02c01b070 con 0x7fc034102790 2024-09-19T07:15:58.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.137+0000 7fc02a7fc640 1 -- 172.21.15.148:0/2823735618 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc02c00ba50 con 0x7fc034102790 2024-09-19T07:15:58.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.137+0000 7fc03b900640 1 -- 172.21.15.148:0/2823735618 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc03406d780 con 0x7fc034102790 2024-09-19T07:15:58.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.137+0000 7fc03b900640 1 -- 172.21.15.148:0/2823735618 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0340717c0 con 0x7fc034102790 2024-09-19T07:15:58.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.137+0000 7fc02a7fc640 1 -- 172.21.15.148:0/2823735618 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc02c016cd0 con 0x7fc034102790 2024-09-19T07:15:58.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.141+0000 7fc03dcd9740 1 Processor -- start 2024-09-19T07:15:58.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.142+0000 7fc03dcd9740 1 -- start start 2024-09-19T07:15:58.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.142+0000 7fc03dcd9740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cd7e7f8760 0x55cd7e7f8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:58.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.142+0000 7fc03dcd9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cd7e7f9080 0x55cd7e803400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:58.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.142+0000 7fc03dcd9740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cd7e803940 0x55cd7e805d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:58.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.142+0000 7fc03dcd9740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55cd7e75e2a0 con 0x55cd7e7f8760 2024-09-19T07:15:58.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.142+0000 7fc03dcd9740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55cd7e705b10 con 0x55cd7e803940 2024-09-19T07:15:58.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.142+0000 7fc03dcd9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55cd7e75a260 con 0x55cd7e7f9080 2024-09-19T07:15:58.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.143+0000 7fc039e9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cd7e7f8760 0x55cd7e7f8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:58.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.143+0000 7fc039e9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cd7e7f8760 0x55cd7e7f8b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55548/0 (socket says 172.21.15.148:55548) 2024-09-19T07:15:58.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.143+0000 7fc039e9d640 1 -- 172.21.15.148:0/2059637814 learned_addr learned my addr 172.21.15.148:0/2059637814 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:15:58.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.149+0000 7fc03969c640 1 --2- 172.21.15.148:0/2059637814 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cd7e7f9080 0x55cd7e803400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:58.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.149+0000 7fc039e9d640 1 -- 172.21.15.148:0/2059637814 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cd7e7f9080 msgr2=0x55cd7e803400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:58.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.149+0000 7fc039e9d640 1 --2- 172.21.15.148:0/2059637814 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cd7e7f9080 0x55cd7e803400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:58.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.149+0000 7fc039e9d640 1 -- 172.21.15.148:0/2059637814 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cd7e803940 msgr2=0x55cd7e805d30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T07:15:58.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.149+0000 7fc039e9d640 1 --2- 172.21.15.148:0/2059637814 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cd7e803940 0x55cd7e805d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:58.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.149+0000 7fc039e9d640 1 -- 172.21.15.148:0/2059637814 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd7e4cfb90 con 0x55cd7e7f8760 2024-09-19T07:15:58.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.149+0000 7fc02a7fc640 1 -- 172.21.15.148:0/2823735618 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fc02c01e070 con 0x7fc034102790 2024-09-19T07:15:58.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.150+0000 7fc039e9d640 1 --2- 172.21.15.148:0/2059637814 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cd7e7f8760 0x55cd7e7f8b40 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fc030009b90 tx=0x7fc0300117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c82e07b16b416ba2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:58.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.151+0000 7fc02a7fc640 1 --2- 172.21.15.148:0/2823735618 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc0200a34b0 0x7fc0200a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:58.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.151+0000 7fc02a7fc640 1 -- 172.21.15.148:0/2823735618 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fc02c0cfbe0 con 0x7fc034102790 2024-09-19T07:15:58.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.153+0000 7fc01f7fe640 1 -- 172.21.15.148:0/2059637814 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc030012450 con 0x55cd7e7f8760 2024-09-19T07:15:58.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.153+0000 7fc01f7fe640 1 -- 172.21.15.148:0/2059637814 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc030012ad0 con 0x55cd7e7f8760 2024-09-19T07:15:58.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.154+0000 7fc03dcd9740 1 -- 172.21.15.148:0/2059637814 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cd7e7f8760 msgr2=0x55cd7e7f8b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:58.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.154+0000 7fc03dcd9740 1 --2- 172.21.15.148:0/2059637814 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cd7e7f8760 0x55cd7e7f8b40 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fc030009b90 tx=0x7fc0300117b0 comp rx=0 tx=0).stop 2024-09-19T07:15:58.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.157+0000 7fc03dcd9740 1 -- 172.21.15.148:0/2059637814 shutdown_connections 2024-09-19T07:15:58.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.157+0000 7fc03dcd9740 1 --2- 172.21.15.148:0/2059637814 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cd7e803940 0x55cd7e805d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:58.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.157+0000 7fc03dcd9740 1 --2- 172.21.15.148:0/2059637814 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cd7e7f9080 0x55cd7e803400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:58.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.157+0000 7fc03dcd9740 1 --2- 172.21.15.148:0/2059637814 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cd7e7f8760 0x55cd7e7f8b40 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:58.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.157+0000 7fc03dcd9740 1 -- 172.21.15.148:0/2059637814 >> 172.21.15.148:0/2059637814 conn(0x55cd7e7f4cf0 msgr2=0x55cd7e7f50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:15:58.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.157+0000 7fc03969c640 1 --2- 172.21.15.148:0/2823735618 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc0200a34b0 0x7fc0200a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:58.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.160+0000 7fc03969c640 1 --2- 172.21.15.148:0/2823735618 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc0200a34b0 0x7fc0200a5970 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc024000c00 tx=0x7fc024005d30 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:58.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.160+0000 7fc03dcd9740 1 -- 172.21.15.148:0/2059637814 shutdown_connections 2024-09-19T07:15:58.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.160+0000 7fc03dcd9740 1 -- 172.21.15.148:0/2059637814 wait complete. 2024-09-19T07:15:58.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.161+0000 7fc03dcd9740 1 -- start start 2024-09-19T07:15:58.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.161+0000 7fc03dcd9740 1 Processor -- start 2024-09-19T07:15:58.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.162+0000 7fc03dcd9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cd7e7f8760 0x55cd7e8008f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:58.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.162+0000 7fc03dcd9740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cd7e7f9080 0x55cd7e800e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:58.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.162+0000 7fc03dcd9740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cd7e803940 0x55cd7e801370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:58.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.162+0000 7fc03dcd9740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55cd7e806560 con 0x55cd7e7f9080 2024-09-19T07:15:58.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.162+0000 7fc03dcd9740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55cd7e6e66e0 con 0x55cd7e803940 2024-09-19T07:15:58.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.162+0000 7fc03dcd9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55cd7e8066e0 con 0x55cd7e7f8760 2024-09-19T07:15:58.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.163+0000 7fc03dcd9740 10 client.0 _ll_register_callbacks cb 0x55cd7e70aa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:15:58.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.162+0000 7fc03969c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cd7e7f8760 0x55cd7e8008f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:58.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.163+0000 7fc03969c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cd7e7f8760 0x55cd7e8008f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:39726/0 (socket says 172.21.15.148:39726) 2024-09-19T07:15:58.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.163+0000 7fc03969c640 1 -- 172.21.15.148:0/1665755631 learned_addr learned my addr 172.21.15.148:0/1665755631 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:15:58.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.163+0000 7fc039e9d640 1 --2- 172.21.15.148:0/1665755631 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cd7e803940 0x55cd7e801370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:58.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.163+0000 7fc039e9d640 1 -- 172.21.15.148:0/1665755631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cd7e7f8760 msgr2=0x55cd7e8008f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:58.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.163+0000 7fc039e9d640 1 --2- 172.21.15.148:0/1665755631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cd7e7f8760 0x55cd7e8008f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:58.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.163+0000 7fc039e9d640 1 -- 172.21.15.148:0/1665755631 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cd7e7f9080 msgr2=0x55cd7e800e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:58.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.163+0000 7fc039e9d640 1 --2- 172.21.15.148:0/1665755631 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cd7e7f9080 0x55cd7e800e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:58.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.163+0000 7fc039e9d640 1 -- 172.21.15.148:0/1665755631 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd7e80fc10 con 0x55cd7e803940 2024-09-19T07:15:58.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.164+0000 7fc039e9d640 1 --2- 172.21.15.148:0/1665755631 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cd7e803940 0x55cd7e801370 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc03001c040 tx=0x7fc03000f440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6a3398cb1a546d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:58.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.167+0000 7fc01cff9640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-19T07:15:58.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.168+0000 7fc01cff9640 1 -- 172.21.15.148:0/1665755631 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc030027020 con 0x55cd7e803940 2024-09-19T07:15:58.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.168+0000 7fc03dcd9740 1 -- 172.21.15.148:0/1665755631 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cd7e76b9d0 con 0x55cd7e803940 2024-09-19T07:15:58.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.168+0000 7fc01cff9640 1 -- 172.21.15.148:0/1665755631 <== mon.2 v2:172.21.15.165:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fc0300052d0 con 0x55cd7e803940 2024-09-19T07:15:58.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.171+0000 7fc01cff9640 1 -- 172.21.15.148:0/1665755631 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fc030032050 con 0x55cd7e803940 2024-09-19T07:15:58.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.171+0000 7fc03dcd9740 10 client.25793 fetch_fsmap learned FSMap version 33 2024-09-19T07:15:58.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.171+0000 7fc03dcd9740 1 -- 172.21.15.148:0/1665755631 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55cd7e812610 con 0x55cd7e803940 2024-09-19T07:15:58.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.172+0000 7fc01cff9640 1 -- 172.21.15.148:0/1665755631 <== mon.2 v2:172.21.15.165:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55cd7e76b9d0 con 0x55cd7e803940 2024-09-19T07:15:58.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.173+0000 7fc01cff9640 1 -- 172.21.15.148:0/1665755631 <== mon.2 v2:172.21.15.165:3300/0 5 ==== fsmap(e 33) ==== 8362+0+0 (secure 0 0 0) 0x7fc030012450 con 0x55cd7e803940 2024-09-19T07:15:58.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.173+0000 7fc03dcd9740 10 client.25793 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T07:15:58.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.173+0000 7fc03dcd9740 10 client.25793 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:15:58.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.173+0000 7fc03dcd9740 20 client.25793 populate_metadata read hostname 'smithi148' 2024-09-19T07:15:58.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.173+0000 7fc03dcd9740 1 --2- 172.21.15.148:0/1665755631 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55cd7e813e30 0x55cd7e8162b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:58.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.173+0000 7fc03dcd9740 4 client.25793 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:15:58.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.173+0000 7fc03dcd9740 1 -- 172.21.15.148:0/1665755631 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd7e765d20 con 0x55cd7e813e30 2024-09-19T07:15:58.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.173+0000 7fc03969c640 1 --2- 172.21.15.148:0/1665755631 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55cd7e813e30 0x55cd7e8162b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:58.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.174+0000 7fc01cff9640 10 client.25793 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:15:58.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.174+0000 7fc03969c640 1 --2- 172.21.15.148:0/1665755631 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55cd7e813e30 0x55cd7e8162b0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3cefac52c2770acc server_cookie=c416abb4486e17a8 in_seq=0 out_seq=0 2024-09-19T07:15:58.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.176+0000 7fc01cff9640 1 -- 172.21.15.148:0/1665755631 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cd7e765d20 con 0x55cd7e813e30 2024-09-19T07:15:58.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.176+0000 7fc01cff9640 10 client.25793 handle_command_reply: tid=0 2024-09-19T07:15:58.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.177+0000 7fc03dcd9740 1 client.25793 shutdown 2024-09-19T07:15:58.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.177+0000 7fc03dcd9740 1 -- 172.21.15.148:0/1665755631 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cd7e803940 msgr2=0x55cd7e801370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:58.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.177+0000 7fc03dcd9740 1 --2- 172.21.15.148:0/1665755631 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cd7e803940 0x55cd7e801370 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc03001c040 tx=0x7fc03000f440 comp rx=0 tx=0).stop 2024-09-19T07:15:58.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.178+0000 7fc03dcd9740 1 -- 172.21.15.148:0/1665755631 shutdown_connections 2024-09-19T07:15:58.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.178+0000 7fc03dcd9740 1 --2- 172.21.15.148:0/1665755631 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55cd7e813e30 0x55cd7e8162b0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:58.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.178+0000 7fc03dcd9740 1 --2- 172.21.15.148:0/1665755631 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cd7e803940 0x55cd7e801370 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:58.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.178+0000 7fc03dcd9740 1 --2- 172.21.15.148:0/1665755631 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cd7e7f9080 0x55cd7e800e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:58.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.178+0000 7fc03dcd9740 1 --2- 172.21.15.148:0/1665755631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cd7e7f8760 0x55cd7e8008f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:58.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.178+0000 7fc03dcd9740 1 -- 172.21.15.148:0/1665755631 >> 172.21.15.148:0/1665755631 conn(0x55cd7e7f4cf0 msgr2=0x55cd7e7faa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:15:58.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.178+0000 7fc01cff9640 0 client.25793 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:15:58.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.180+0000 7fc03dcd9740 1 -- 172.21.15.148:0/1665755631 shutdown_connections 2024-09-19T07:15:58.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.180+0000 7fc03dcd9740 1 -- 172.21.15.148:0/1665755631 wait complete. 2024-09-19T07:15:58.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.180+0000 7fc03dcd9740 20 client.25793 trim_cache size 0 max 16384 2024-09-19T07:15:58.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.221+0000 7fc03dcd9740 1 Processor -- start 2024-09-19T07:15:58.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.221+0000 7fc03dcd9740 1 -- start start 2024-09-19T07:15:58.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.222+0000 7fc03dcd9740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cd7e7f8760 0x55cd7e8011c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:58.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.222+0000 7fc03dcd9740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cd7e7f9080 0x55cd7e81bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:58.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.222+0000 7fc03dcd9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cd7e803940 0x55cd7e81c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:58.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.222+0000 7fc03dcd9740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc018011170 con 0x55cd7e7f8760 2024-09-19T07:15:58.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.222+0000 7fc03dcd9740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc01800e9e0 con 0x55cd7e7f9080 2024-09-19T07:15:58.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.222+0000 7fc038e9b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cd7e7f9080 0x55cd7e81bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:58.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.222+0000 7fc03dcd9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc01800c810 con 0x55cd7e803940 2024-09-19T07:15:58.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.222+0000 7fc038e9b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cd7e7f9080 0x55cd7e81bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:35136/0 (socket says 172.21.15.148:35136) 2024-09-19T07:15:58.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.222+0000 7fc038e9b640 1 -- 172.21.15.148:0/4018360961 learned_addr learned my addr 172.21.15.148:0/4018360961 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:15:58.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.222+0000 7fc039e9d640 1 --2- 172.21.15.148:0/4018360961 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cd7e803940 0x55cd7e81c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:58.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.223+0000 7fc03969c640 1 --2- 172.21.15.148:0/4018360961 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cd7e7f8760 0x55cd7e8011c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:58.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.224+0000 7fc03969c640 1 -- 172.21.15.148:0/4018360961 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cd7e803940 msgr2=0x55cd7e81c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:58.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.224+0000 7fc03969c640 1 --2- 172.21.15.148:0/4018360961 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cd7e803940 0x55cd7e81c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:58.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.224+0000 7fc03969c640 1 -- 172.21.15.148:0/4018360961 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cd7e7f9080 msgr2=0x55cd7e81bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:58.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.224+0000 7fc03969c640 1 --2- 172.21.15.148:0/4018360961 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cd7e7f9080 0x55cd7e81bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:58.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.224+0000 7fc03969c640 1 -- 172.21.15.148:0/4018360961 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd7e7ff8a0 con 0x55cd7e7f8760 2024-09-19T07:15:58.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.225+0000 7fc03969c640 1 --2- 172.21.15.148:0/4018360961 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cd7e7f8760 0x55cd7e8011c0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fc024035000 tx=0x7fc024041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb4ddaae7b6c55da server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:58.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.227+0000 7fc01effd640 1 -- 172.21.15.148:0/4018360961 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc024035600 con 0x55cd7e7f8760 2024-09-19T07:15:58.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.227+0000 7fc01effd640 1 -- 172.21.15.148:0/4018360961 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc024005510 con 0x55cd7e7f8760 2024-09-19T07:15:58.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.228+0000 7fc03dcd9740 1 -- 172.21.15.148:0/4018360961 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cd7e7f8760 msgr2=0x55cd7e8011c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:58.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.228+0000 7fc03dcd9740 1 --2- 172.21.15.148:0/4018360961 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cd7e7f8760 0x55cd7e8011c0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fc024035000 tx=0x7fc024041000 comp rx=0 tx=0).stop 2024-09-19T07:15:58.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.229+0000 7fc03dcd9740 1 -- 172.21.15.148:0/4018360961 shutdown_connections 2024-09-19T07:15:58.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.229+0000 7fc03dcd9740 1 --2- 172.21.15.148:0/4018360961 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cd7e803940 0x55cd7e81c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:58.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.229+0000 7fc03dcd9740 1 --2- 172.21.15.148:0/4018360961 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cd7e7f9080 0x55cd7e81bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:58.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.229+0000 7fc03dcd9740 1 --2- 172.21.15.148:0/4018360961 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cd7e7f8760 0x55cd7e8011c0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:58.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.229+0000 7fc03dcd9740 1 -- 172.21.15.148:0/4018360961 >> 172.21.15.148:0/4018360961 conn(0x55cd7e7f4cf0 msgr2=0x55cd7e7fbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:15:58.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.233+0000 7fc03dcd9740 1 -- 172.21.15.148:0/4018360961 shutdown_connections 2024-09-19T07:15:58.234 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.233+0000 7fc03dcd9740 1 -- 172.21.15.148:0/4018360961 wait complete. 2024-09-19T07:15:58.234 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.233+0000 7fc03dcd9740 1 -- start start 2024-09-19T07:15:58.234 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.233+0000 7fc03dcd9740 1 Processor -- start 2024-09-19T07:15:58.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.234+0000 7fc03dcd9740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cd7e7f8760 0x55cd7e8069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:58.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.234+0000 7fc03dcd9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cd7e7f9080 0x55cd7e806f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:58.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.234+0000 7fc03dcd9740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cd7e803940 0x55cd7e807450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:58.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.234+0000 7fc03dcd9740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc01800cea0 con 0x55cd7e803940 2024-09-19T07:15:58.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.234+0000 7fc03dcd9740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc01800e310 con 0x55cd7e7f8760 2024-09-19T07:15:58.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.234+0000 7fc03dcd9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc01800d570 con 0x55cd7e7f9080 2024-09-19T07:15:58.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.234+0000 7fc03dcd9740 10 client.0 _ll_register_callbacks cb 0x7fc030009c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:15:58.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.235+0000 7fc038e9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cd7e7f9080 0x55cd7e806f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:58.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.235+0000 7fc038e9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cd7e7f9080 0x55cd7e806f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:39744/0 (socket says 172.21.15.148:39744) 2024-09-19T07:15:58.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.235+0000 7fc038e9b640 1 -- 172.21.15.148:0/736825470 learned_addr learned my addr 172.21.15.148:0/736825470 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:15:58.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.235+0000 7fc03969c640 1 --2- 172.21.15.148:0/736825470 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cd7e7f8760 0x55cd7e8069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:58.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.235+0000 7fc039e9d640 1 --2- 172.21.15.148:0/736825470 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cd7e803940 0x55cd7e807450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:58.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.236+0000 7fc03969c640 1 -- 172.21.15.148:0/736825470 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cd7e7f9080 msgr2=0x55cd7e806f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:58.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.236+0000 7fc03969c640 1 --2- 172.21.15.148:0/736825470 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cd7e7f9080 0x55cd7e806f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:58.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.236+0000 7fc03969c640 1 -- 172.21.15.148:0/736825470 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cd7e803940 msgr2=0x55cd7e807450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:58.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.236+0000 7fc03969c640 1 --2- 172.21.15.148:0/736825470 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cd7e803940 0x55cd7e807450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:58.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.236+0000 7fc03969c640 1 -- 172.21.15.148:0/736825470 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd7e87cc00 con 0x55cd7e7f8760 2024-09-19T07:15:58.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.236+0000 7fc03969c640 1 --2- 172.21.15.148:0/736825470 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cd7e7f8760 0x55cd7e8069d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc024035000 tx=0x7fc024035f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=198d4e70b1fcdb87 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:58.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.236+0000 7fc01cff9640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-19T07:15:58.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.236+0000 7fc01cff9640 1 -- 172.21.15.148:0/736825470 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc024062060 con 0x55cd7e7f8760 2024-09-19T07:15:58.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.236+0000 7fc01cff9640 1 -- 172.21.15.148:0/736825470 <== mon.2 v2:172.21.15.165:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7fc024005030 con 0x55cd7e7f8760 2024-09-19T07:15:58.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.236+0000 7fc03dcd9740 1 -- 172.21.15.148:0/736825470 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc024005510 con 0x55cd7e7f8760 2024-09-19T07:15:58.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.237+0000 7fc01cff9640 1 -- 172.21.15.148:0/736825470 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fc024005230 con 0x55cd7e7f8760 2024-09-19T07:15:58.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.240+0000 7fc03dcd9740 10 client.25799 fetch_fsmap learned FSMap version 33 2024-09-19T07:15:58.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.240+0000 7fc03dcd9740 1 -- 172.21.15.148:0/736825470 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55cd7e87dec0 con 0x55cd7e7f8760 2024-09-19T07:15:58.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.241+0000 7fc01cff9640 1 -- 172.21.15.148:0/736825470 <== mon.2 v2:172.21.15.165:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc024005510 con 0x55cd7e7f8760 2024-09-19T07:15:58.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.241+0000 7fc01cff9640 1 -- 172.21.15.148:0/736825470 <== mon.2 v2:172.21.15.165:3300/0 5 ==== fsmap(e 33) ==== 8362+0+0 (secure 0 0 0) 0x7fc02400f040 con 0x55cd7e7f8760 2024-09-19T07:15:58.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.241+0000 7fc03dcd9740 10 client.25799 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T07:15:58.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.241+0000 7fc03dcd9740 10 client.25799 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:15:58.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.241+0000 7fc03dcd9740 20 client.25799 populate_metadata read hostname 'smithi148' 2024-09-19T07:15:58.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.241+0000 7fc03dcd9740 1 --2- 172.21.15.148:0/736825470 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55cd7e87e600 0x55cd7e880a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:58.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.241+0000 7fc03dcd9740 4 client.25799 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.8, "await_for": 45.0}] 2024-09-19T07:15:58.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.241+0000 7fc03dcd9740 1 -- 172.21.15.148:0/736825470 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.8, "await_for": 45.0}) -- 0x55cd7e6e1ec0 con 0x55cd7e87e600 2024-09-19T07:15:58.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.244+0000 7fc038e9b640 1 --2- 172.21.15.148:0/736825470 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55cd7e87e600 0x55cd7e880a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:58.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.245+0000 7fc038e9b640 1 --2- 172.21.15.148:0/736825470 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55cd7e87e600 0x55cd7e880a20 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4c0d8b18ea4d21e server_cookie=e8013dca32fdfa81 in_seq=0 out_seq=0 2024-09-19T07:15:58.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:15:58.245+0000 7fc01cff9640 10 client.25799 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:15:58.576 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.575+0000 7f3b3cbb0640 1 -- 172.21.15.148:0/1258702921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b381069c0 msgr2=0x7f3b38106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:58.576 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.575+0000 7f3b3cbb0640 1 --2- 172.21.15.148:0/1258702921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b381069c0 0x7f3b38106da0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f3b28009930 tx=0x7f3b2802a420 comp rx=0 tx=0).stop 2024-09-19T07:15:58.576 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.575+0000 7f3b3cbb0640 1 -- 172.21.15.148:0/1258702921 shutdown_connections 2024-09-19T07:15:58.577 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.575+0000 7f3b3cbb0640 1 --2- 172.21.15.148:0/1258702921 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b38101350 0x7f3b3810d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:58.577 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.575+0000 7f3b3cbb0640 1 --2- 172.21.15.148:0/1258702921 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b381009b0 0x7f3b38100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:58.577 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.575+0000 7f3b3cbb0640 1 --2- 172.21.15.148:0/1258702921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b381069c0 0x7f3b38106da0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:58.577 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.575+0000 7f3b3cbb0640 1 -- 172.21.15.148:0/1258702921 >> 172.21.15.148:0/1258702921 conn(0x7f3b38077990 msgr2=0x7f3b380fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:15:58.577 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.575+0000 7f3b3cbb0640 1 -- 172.21.15.148:0/1258702921 shutdown_connections 2024-09-19T07:15:58.577 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.575+0000 7f3b3cbb0640 1 -- 172.21.15.148:0/1258702921 wait complete. 2024-09-19T07:15:58.578 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.576+0000 7f3b3cbb0640 1 Processor -- start 2024-09-19T07:15:58.578 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.576+0000 7f3b3cbb0640 1 -- start start 2024-09-19T07:15:58.578 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.576+0000 7f3b3cbb0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b381009b0 0x7f3b3819ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:58.578 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.576+0000 7f3b3cbb0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b38101350 0x7f3b3819f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:58.578 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.576+0000 7f3b3cbb0640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b381069c0 0x7f3b381a32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:58.582 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.576+0000 7f3b3cbb0640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3b38110e00 con 0x7f3b38101350 2024-09-19T07:15:58.582 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.576+0000 7f3b3cbb0640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3b38110c80 con 0x7f3b381069c0 2024-09-19T07:15:58.582 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.576+0000 7f3b3cbb0640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3b38110f80 con 0x7f3b381009b0 2024-09-19T07:15:58.582 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.577+0000 7f3b3659c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b381009b0 0x7f3b3819ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:58.582 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.577+0000 7f3b35d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b38101350 0x7f3b3819f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:58.590 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.577+0000 7f3b35d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b38101350 0x7f3b3819f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55598/0 (socket says 172.21.15.148:55598) 2024-09-19T07:15:58.591 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.577+0000 7f3b35d9b640 1 -- 172.21.15.148:0/3990831882 learned_addr learned my addr 172.21.15.148:0/3990831882 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:15:58.591 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.577+0000 7f3b36d9d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b381069c0 0x7f3b381a32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:58.591 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.577+0000 7f3b35d9b640 1 -- 172.21.15.148:0/3990831882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b381009b0 msgr2=0x7f3b3819ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:58.591 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.577+0000 7f3b35d9b640 1 --2- 172.21.15.148:0/3990831882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b381009b0 0x7f3b3819ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:58.591 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.577+0000 7f3b35d9b640 1 -- 172.21.15.148:0/3990831882 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b381069c0 msgr2=0x7f3b381a32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:58.591 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.577+0000 7f3b35d9b640 1 --2- 172.21.15.148:0/3990831882 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b381069c0 0x7f3b381a32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:58.591 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.577+0000 7f3b35d9b640 1 -- 172.21.15.148:0/3990831882 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b381a39f0 con 0x7f3b38101350 2024-09-19T07:15:58.591 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.577+0000 7f3b35d9b640 1 --2- 172.21.15.148:0/3990831882 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b38101350 0x7f3b3819f1a0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c00e9f0 tx=0x7f3b2c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:58.591 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.577+0000 7f3b277fe640 1 -- 172.21.15.148:0/3990831882 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c00cd80 con 0x7f3b38101350 2024-09-19T07:15:58.591 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.577+0000 7f3b277fe640 1 -- 172.21.15.148:0/3990831882 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b2c005500 con 0x7f3b38101350 2024-09-19T07:15:58.591 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.577+0000 7f3b277fe640 1 -- 172.21.15.148:0/3990831882 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c010690 con 0x7f3b38101350 2024-09-19T07:15:58.591 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.577+0000 7f3b3cbb0640 1 -- 172.21.15.148:0/3990831882 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b381a3ce0 con 0x7f3b38101350 2024-09-19T07:15:58.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.577+0000 7f3b3cbb0640 1 -- 172.21.15.148:0/3990831882 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b381ab590 con 0x7f3b38101350 2024-09-19T07:15:58.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.580+0000 7f3b277fe640 1 -- 172.21.15.148:0/3990831882 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f3b2c0046c0 con 0x7f3b38101350 2024-09-19T07:15:58.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.580+0000 7f3b3fa25740 1 Processor -- start 2024-09-19T07:15:58.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.580+0000 7f3b3fa25740 1 -- start start 2024-09-19T07:15:58.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.580+0000 7f3b3fa25740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55950c904af0 0x55950c904ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:58.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.580+0000 7f3b3fa25740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55950c905410 0x55950c90f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:58.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.580+0000 7f3b3fa25740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55950c90fcb0 0x55950c9120a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:58.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.580+0000 7f3b3fa25740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55950c8692f0 con 0x55950c90fcb0 2024-09-19T07:15:58.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.580+0000 7f3b3fa25740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55950c811270 con 0x55950c904af0 2024-09-19T07:15:58.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.580+0000 7f3b3fa25740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55950c8652b0 con 0x55950c905410 2024-09-19T07:15:58.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.581+0000 7f3b277fe640 1 --2- 172.21.15.148:0/3990831882 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f3b200a3460 0x7f3b200a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:58.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.581+0000 7f3b3659c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55950c905410 0x55950c90f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:58.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.581+0000 7f3b36d9d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55950c904af0 0x55950c904ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:58.593 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.581+0000 7f3b35d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55950c90fcb0 0x55950c9120a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:58.593 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.581+0000 7f3b3659c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55950c905410 0x55950c90f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:39764/0 (socket says 172.21.15.148:39764) 2024-09-19T07:15:58.593 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.581+0000 7f3b36d9d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55950c904af0 0x55950c904ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:35168/0 (socket says 172.21.15.148:35168) 2024-09-19T07:15:58.593 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.581+0000 7f3b3659c640 1 -- 172.21.15.148:0/2792989227 learned_addr learned my addr 172.21.15.148:0/2792989227 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:15:58.593 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.581+0000 7f3b277fe640 1 -- 172.21.15.148:0/3990831882 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f3b2c0d0170 con 0x7f3b38101350 2024-09-19T07:15:58.593 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.581+0000 7f3b3659c640 1 -- 172.21.15.148:0/2792989227 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55950c904af0 msgr2=0x55950c904ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:58.593 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.581+0000 7f3b3659c640 1 --2- 172.21.15.148:0/2792989227 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55950c904af0 0x55950c904ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:58.593 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.581+0000 7f3b3659c640 1 -- 172.21.15.148:0/2792989227 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55950c90fcb0 msgr2=0x55950c9120a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:58.593 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.581+0000 7f3b3659c640 1 --2- 172.21.15.148:0/2792989227 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55950c90fcb0 0x55950c9120a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:58.593 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.581+0000 7f3b3659c640 1 -- 172.21.15.148:0/2792989227 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55950c810340 con 0x55950c905410 2024-09-19T07:15:58.593 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.581+0000 7f3b36d9d640 1 --2- 172.21.15.148:0/3990831882 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f3b200a3460 0x7f3b200a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:58.593 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.581+0000 7f3b3659c640 1 --2- 172.21.15.148:0/2792989227 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55950c905410 0x55950c90f770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3b28000c00 tx=0x7f3b28005e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ebac9c1b73d5bb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:58.594 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.581+0000 7f3b24ff9640 1 -- 172.21.15.148:0/2792989227 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b28040070 con 0x55950c905410 2024-09-19T07:15:58.594 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.581+0000 7f3b36d9d640 1 --2- 172.21.15.148:0/3990831882 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f3b200a3460 0x7f3b200a5920 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3b30005fd0 tx=0x7f3b30014040 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:58.594 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.582+0000 7f3b24ff9640 1 -- 172.21.15.148:0/2792989227 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b280318b0 con 0x55950c905410 2024-09-19T07:15:58.594 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.582+0000 7f3b24ff9640 1 -- 172.21.15.148:0/2792989227 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b28035040 con 0x55950c905410 2024-09-19T07:15:58.594 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.582+0000 7f3b3fa25740 1 -- 172.21.15.148:0/2792989227 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55950c905410 msgr2=0x55950c90f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:58.594 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.582+0000 7f3b3fa25740 1 --2- 172.21.15.148:0/2792989227 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55950c905410 0x55950c90f770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3b28000c00 tx=0x7f3b28005e80 comp rx=0 tx=0).stop 2024-09-19T07:15:58.594 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.582+0000 7f3b3fa25740 1 -- 172.21.15.148:0/2792989227 shutdown_connections 2024-09-19T07:15:58.594 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.582+0000 7f3b3fa25740 1 --2- 172.21.15.148:0/2792989227 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55950c90fcb0 0x55950c9120a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:58.594 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.582+0000 7f3b3fa25740 1 --2- 172.21.15.148:0/2792989227 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55950c905410 0x55950c90f770 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:58.594 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.582+0000 7f3b3fa25740 1 --2- 172.21.15.148:0/2792989227 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55950c904af0 0x55950c904ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:58.594 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.582+0000 7f3b3fa25740 1 -- 172.21.15.148:0/2792989227 >> 172.21.15.148:0/2792989227 conn(0x55950c901060 msgr2=0x55950c901440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:15:58.594 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.583+0000 7f3b3fa25740 1 -- 172.21.15.148:0/2792989227 shutdown_connections 2024-09-19T07:15:58.594 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.583+0000 7f3b3fa25740 1 -- 172.21.15.148:0/2792989227 wait complete. 2024-09-19T07:15:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.583+0000 7f3b3fa25740 1 -- start start 2024-09-19T07:15:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.583+0000 7f3b3fa25740 1 Processor -- start 2024-09-19T07:15:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.583+0000 7f3b3fa25740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55950c904af0 0x55950c90cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.583+0000 7f3b3fa25740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55950c905410 0x55950c90d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.584+0000 7f3b3fa25740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55950c90fcb0 0x55950c90d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.584+0000 7f3b3fa25740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55950c912880 con 0x55950c904af0 2024-09-19T07:15:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.584+0000 7f3b3fa25740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55950c7f2290 con 0x55950c90fcb0 2024-09-19T07:15:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.584+0000 7f3b3fa25740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55950c912a00 con 0x55950c905410 2024-09-19T07:15:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.584+0000 7f3b3659c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55950c904af0 0x55950c90cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.584+0000 7f3b35d9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55950c905410 0x55950c90d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.584+0000 7f3b3659c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55950c904af0 0x55950c90cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55616/0 (socket says 172.21.15.148:55616) 2024-09-19T07:15:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.584+0000 7f3b3659c640 1 -- 172.21.15.148:0/3146824925 learned_addr learned my addr 172.21.15.148:0/3146824925 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:15:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.584+0000 7f3b3fa25740 10 client.0 _ll_register_callbacks cb 0x55950c823140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:15:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.584+0000 7f3b36d9d640 1 --2- 172.21.15.148:0/3146824925 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55950c90fcb0 0x55950c90d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.584+0000 7f3b35d9b640 1 -- 172.21.15.148:0/3146824925 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55950c90fcb0 msgr2=0x55950c90d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.584+0000 7f3b35d9b640 1 --2- 172.21.15.148:0/3146824925 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55950c90fcb0 0x55950c90d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.584+0000 7f3b35d9b640 1 -- 172.21.15.148:0/3146824925 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55950c904af0 msgr2=0x55950c90cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.584+0000 7f3b35d9b640 1 --2- 172.21.15.148:0/3146824925 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55950c904af0 0x55950c90cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.584+0000 7f3b35d9b640 1 -- 172.21.15.148:0/3146824925 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55950c57c210 con 0x55950c905410 2024-09-19T07:15:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.584+0000 7f3b3659c640 1 --2- 172.21.15.148:0/3146824925 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55950c904af0 0x55950c90cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:15:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.584+0000 7f3b35d9b640 1 --2- 172.21.15.148:0/3146824925 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55950c905410 0x55950c90d0c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c0cd890 tx=0x7f3b2c09bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=737ee64a52886fc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.584+0000 7f3b1dffb640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-19T07:15:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.584+0000 7f3b1dffb640 1 -- 172.21.15.148:0/3146824925 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c0cdd10 con 0x55950c905410 2024-09-19T07:15:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.584+0000 7f3b1dffb640 1 -- 172.21.15.148:0/3146824925 <== mon.1 v2:172.21.15.179:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f3b2c0b52a0 con 0x55950c905410 2024-09-19T07:15:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.584+0000 7f3b3fa25740 1 -- 172.21.15.148:0/3146824925 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b280318b0 con 0x55950c905410 2024-09-19T07:15:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.585+0000 7f3b1dffb640 1 -- 172.21.15.148:0/3146824925 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f3b2c09c420 con 0x55950c905410 2024-09-19T07:15:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.585+0000 7f3b3fa25740 10 client.25897 fetch_fsmap learned FSMap version 33 2024-09-19T07:15:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.585+0000 7f3b3fa25740 1 -- 172.21.15.148:0/3146824925 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55950c648620 con 0x55950c905410 2024-09-19T07:15:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.585+0000 7f3b1dffb640 1 -- 172.21.15.148:0/3146824925 <== mon.1 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b280318b0 con 0x55950c905410 2024-09-19T07:15:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.585+0000 7f3b1dffb640 1 -- 172.21.15.148:0/3146824925 <== mon.1 v2:172.21.15.179:3300/0 5 ==== fsmap(e 33) ==== 8362+0+0 (secure 0 0 0) 0x7f3b2c0d20f0 con 0x55950c905410 2024-09-19T07:15:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.585+0000 7f3b3fa25740 10 client.25897 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T07:15:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.585+0000 7f3b3fa25740 10 client.25897 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:15:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.585+0000 7f3b3fa25740 20 client.25897 populate_metadata read hostname 'smithi148' 2024-09-19T07:15:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.585+0000 7f3b3fa25740 1 --2- 172.21.15.148:0/3146824925 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55950c91fbd0 0x55950c922070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.585+0000 7f3b3fa25740 4 client.25897 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:15:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.585+0000 7f3b3fa25740 1 -- 172.21.15.148:0/3146824925 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55950c876a20 con 0x55950c91fbd0 2024-09-19T07:15:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.585+0000 7f3b3659c640 1 --2- 172.21.15.148:0/3146824925 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55950c91fbd0 0x55950c922070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.586+0000 7f3b3659c640 1 --2- 172.21.15.148:0/3146824925 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55950c91fbd0 0x55950c922070 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee0be66ce65e28d2 server_cookie=e2ef717220481d9 in_seq=0 out_seq=0 2024-09-19T07:15:58.598 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.586+0000 7f3b1dffb640 10 client.25897 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:15:58.598 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.586+0000 7f3b1dffb640 1 -- 172.21.15.148:0/3146824925 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55950c876a20 con 0x55950c91fbd0 2024-09-19T07:15:58.598 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.586+0000 7f3b1dffb640 10 client.25897 handle_command_reply: tid=0 2024-09-19T07:15:58.598 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.586+0000 7f3b3fa25740 1 client.25897 shutdown 2024-09-19T07:15:58.598 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.587+0000 7f3b3fa25740 1 -- 172.21.15.148:0/3146824925 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55950c905410 msgr2=0x55950c90d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:58.598 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.587+0000 7f3b3fa25740 1 --2- 172.21.15.148:0/3146824925 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55950c905410 0x55950c90d0c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c0cd890 tx=0x7f3b2c09bf60 comp rx=0 tx=0).stop 2024-09-19T07:15:58.598 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.587+0000 7f3b3fa25740 1 -- 172.21.15.148:0/3146824925 shutdown_connections 2024-09-19T07:15:58.598 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.587+0000 7f3b3fa25740 1 --2- 172.21.15.148:0/3146824925 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55950c91fbd0 0x55950c922070 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:58.598 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.587+0000 7f3b3fa25740 1 --2- 172.21.15.148:0/3146824925 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55950c90fcb0 0x55950c90d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:58.598 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.587+0000 7f3b3fa25740 1 --2- 172.21.15.148:0/3146824925 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55950c905410 0x55950c90d0c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:58.598 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.587+0000 7f3b1dffb640 0 client.25897 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:15:58.598 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.587+0000 7f3b3fa25740 1 --2- 172.21.15.148:0/3146824925 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55950c904af0 0x55950c90cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:58.598 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.587+0000 7f3b3fa25740 1 -- 172.21.15.148:0/3146824925 >> 172.21.15.148:0/3146824925 conn(0x55950c901060 msgr2=0x55950c906d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:15:58.599 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.587+0000 7f3b3fa25740 1 -- 172.21.15.148:0/3146824925 shutdown_connections 2024-09-19T07:15:58.599 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.587+0000 7f3b3fa25740 1 -- 172.21.15.148:0/3146824925 wait complete. 2024-09-19T07:15:58.599 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.587+0000 7f3b3fa25740 20 client.25897 trim_cache size 0 max 16384 2024-09-19T07:15:58.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.603+0000 7f3b3fa25740 1 Processor -- start 2024-09-19T07:15:58.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.603+0000 7f3b3fa25740 1 -- start start 2024-09-19T07:15:58.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.604+0000 7f3b3fa25740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55950c901060 0x55950c90d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:58.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.604+0000 7f3b3fa25740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55950c904af0 0x55950c90eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:58.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.604+0000 7f3b3fa25740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55950c905410 0x55950c927940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:58.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.604+0000 7f3b3fa25740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3b381b6680 con 0x55950c901060 2024-09-19T07:15:58.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.604+0000 7f3b3fa25740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3b381b3ef0 con 0x55950c904af0 2024-09-19T07:15:58.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.604+0000 7f3b3fa25740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3b381b1d20 con 0x55950c905410 2024-09-19T07:15:58.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.604+0000 7f3b3659c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55950c901060 0x55950c90d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:58.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.604+0000 7f3b3659c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55950c901060 0x55950c90d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55622/0 (socket says 172.21.15.148:55622) 2024-09-19T07:15:58.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.604+0000 7f3b3659c640 1 -- 172.21.15.148:0/2221201885 learned_addr learned my addr 172.21.15.148:0/2221201885 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:15:58.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.604+0000 7f3b35d9b640 1 --2- 172.21.15.148:0/2221201885 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55950c904af0 0x55950c90eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:58.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.604+0000 7f3b36d9d640 1 --2- 172.21.15.148:0/2221201885 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55950c905410 0x55950c927940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:58.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.604+0000 7f3b3659c640 1 -- 172.21.15.148:0/2221201885 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55950c905410 msgr2=0x55950c927940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:58.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.604+0000 7f3b3659c640 1 --2- 172.21.15.148:0/2221201885 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55950c905410 0x55950c927940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:58.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.604+0000 7f3b3659c640 1 -- 172.21.15.148:0/2221201885 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55950c904af0 msgr2=0x55950c90eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:58.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.604+0000 7f3b3659c640 1 --2- 172.21.15.148:0/2221201885 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55950c904af0 0x55950c90eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:58.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.604+0000 7f3b3659c640 1 -- 172.21.15.148:0/2221201885 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55950c900e90 con 0x55950c901060 2024-09-19T07:15:58.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.604+0000 7f3b36d9d640 1 --2- 172.21.15.148:0/2221201885 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55950c905410 0x55950c927940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:15:58.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.604+0000 7f3b3659c640 1 --2- 172.21.15.148:0/2221201885 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55950c901060 0x55950c90d430 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f3b280096c0 tx=0x7f3b2802a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7ef1ec9c7e3b260 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:58.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.604+0000 7f3b1ffff640 1 -- 172.21.15.148:0/2221201885 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b28035040 con 0x55950c901060 2024-09-19T07:15:58.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.604+0000 7f3b1ffff640 1 -- 172.21.15.148:0/2221201885 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b280035f0 con 0x55950c901060 2024-09-19T07:15:58.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.604+0000 7f3b1ffff640 1 -- 172.21.15.148:0/2221201885 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b28040040 con 0x55950c901060 2024-09-19T07:15:58.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.605+0000 7f3b3fa25740 1 -- 172.21.15.148:0/2221201885 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55950c901060 msgr2=0x55950c90d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:58.611 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.605+0000 7f3b3fa25740 1 --2- 172.21.15.148:0/2221201885 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55950c901060 0x55950c90d430 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f3b280096c0 tx=0x7f3b2802a420 comp rx=0 tx=0).stop 2024-09-19T07:15:58.611 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.605+0000 7f3b3fa25740 1 -- 172.21.15.148:0/2221201885 shutdown_connections 2024-09-19T07:15:58.611 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.605+0000 7f3b3fa25740 1 --2- 172.21.15.148:0/2221201885 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55950c905410 0x55950c927940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:58.611 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.605+0000 7f3b3fa25740 1 --2- 172.21.15.148:0/2221201885 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55950c904af0 0x55950c90eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:58.611 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.605+0000 7f3b3fa25740 1 --2- 172.21.15.148:0/2221201885 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55950c901060 0x55950c90d430 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:58.611 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.605+0000 7f3b3fa25740 1 -- 172.21.15.148:0/2221201885 >> 172.21.15.148:0/2221201885 conn(0x55950c908530 msgr2=0x55950c90e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:15:58.611 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.605+0000 7f3b3fa25740 1 -- 172.21.15.148:0/2221201885 shutdown_connections 2024-09-19T07:15:58.611 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.605+0000 7f3b3fa25740 1 -- 172.21.15.148:0/2221201885 wait complete. 2024-09-19T07:15:58.611 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.605+0000 7f3b3fa25740 1 -- start start 2024-09-19T07:15:58.611 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.605+0000 7f3b3fa25740 1 Processor -- start 2024-09-19T07:15:58.611 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.606+0000 7f3b3fa25740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55950c901060 0x55950c982ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:58.611 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.606+0000 7f3b3fa25740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55950c904af0 0x55950c9831e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:58.611 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.606+0000 7f3b3fa25740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55950c905410 0x55950c9131f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.606+0000 7f3b3fa25740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3b381b23b0 con 0x55950c901060 2024-09-19T07:15:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.606+0000 7f3b3fa25740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3b381b3820 con 0x55950c905410 2024-09-19T07:15:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.606+0000 7f3b3fa25740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3b381b2a80 con 0x55950c904af0 2024-09-19T07:15:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.606+0000 7f3b3fa25740 10 client.0 _ll_register_callbacks cb 0x7f3b2c004ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:15:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.606+0000 7f3b3659c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55950c901060 0x55950c982ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.606+0000 7f3b3659c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55950c901060 0x55950c982ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55634/0 (socket says 172.21.15.148:55634) 2024-09-19T07:15:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.606+0000 7f3b3659c640 1 -- 172.21.15.148:0/3621522636 learned_addr learned my addr 172.21.15.148:0/3621522636 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:15:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.606+0000 7f3b35d9b640 1 --2- 172.21.15.148:0/3621522636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55950c904af0 0x55950c9831e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.606+0000 7f3b36d9d640 1 --2- 172.21.15.148:0/3621522636 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55950c905410 0x55950c9131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.606+0000 7f3b3659c640 1 -- 172.21.15.148:0/3621522636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55950c904af0 msgr2=0x55950c9831e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.606+0000 7f3b3659c640 1 --2- 172.21.15.148:0/3621522636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55950c904af0 0x55950c9831e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.606+0000 7f3b3659c640 1 -- 172.21.15.148:0/3621522636 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55950c905410 msgr2=0x55950c9131f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:15:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.606+0000 7f3b3659c640 1 --2- 172.21.15.148:0/3621522636 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55950c905410 0x55950c9131f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:58.613 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.606+0000 7f3b3659c640 1 -- 172.21.15.148:0/3621522636 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55950c913a20 con 0x55950c901060 2024-09-19T07:15:58.613 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.606+0000 7f3b35d9b640 1 --2- 172.21.15.148:0/3621522636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55950c904af0 0x55950c9831e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:15:58.613 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.606+0000 7f3b36d9d640 1 --2- 172.21.15.148:0/3621522636 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55950c905410 0x55950c9131f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:15:58.613 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.606+0000 7f3b3659c640 1 --2- 172.21.15.148:0/3621522636 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55950c901060 0x55950c982ca0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f3b2802abd0 tx=0x7f3b28005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df2e36b8a95ff1e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:58.613 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.606+0000 7f3b1dffb640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:15:58.613 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.606+0000 7f3b1dffb640 1 -- 172.21.15.148:0/3621522636 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b28040070 con 0x55950c901060 2024-09-19T07:15:58.613 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.606+0000 7f3b1dffb640 1 -- 172.21.15.148:0/3621522636 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8512+0+0 (secure 0 0 0) 0x7f3b28004000 con 0x55950c901060 2024-09-19T07:15:58.613 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.606+0000 7f3b3fa25740 1 -- 172.21.15.148:0/3621522636 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b280035f0 con 0x55950c901060 2024-09-19T07:15:58.613 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.607+0000 7f3b1dffb640 1 -- 172.21.15.148:0/3621522636 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f3b28035040 con 0x55950c901060 2024-09-19T07:15:58.613 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.607+0000 7f3b3fa25740 10 client.16512 fetch_fsmap learned FSMap version 33 2024-09-19T07:15:58.613 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.607+0000 7f3b3fa25740 1 -- 172.21.15.148:0/3621522636 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55950c98a4a0 con 0x55950c901060 2024-09-19T07:15:58.613 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.607+0000 7f3b1dffb640 1 -- 172.21.15.148:0/3621522636 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b280035f0 con 0x55950c901060 2024-09-19T07:15:58.613 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.607+0000 7f3b1dffb640 1 -- 172.21.15.148:0/3621522636 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 33) ==== 8362+0+0 (secure 0 0 0) 0x7f3b2804d070 con 0x55950c901060 2024-09-19T07:15:58.614 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.607+0000 7f3b3fa25740 10 client.16512 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T07:15:58.614 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.607+0000 7f3b3fa25740 10 client.16512 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:15:58.614 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.607+0000 7f3b3fa25740 20 client.16512 populate_metadata read hostname 'smithi148' 2024-09-19T07:15:58.614 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.607+0000 7f3b3fa25740 1 --2- 172.21.15.148:0/3621522636 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55950c90fcb0 0x55950c98c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:58.614 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.607+0000 7f3b3fa25740 4 client.16512 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:15:58.614 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.607+0000 7f3b3fa25740 1 -- 172.21.15.148:0/3621522636 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55950c870d70 con 0x55950c90fcb0 2024-09-19T07:15:58.614 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.607+0000 7f3b35d9b640 1 --2- 172.21.15.148:0/3621522636 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55950c90fcb0 0x55950c98c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:58.614 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.608+0000 7f3b35d9b640 1 --2- 172.21.15.148:0/3621522636 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55950c90fcb0 0x55950c98c7a0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6596fdefa1c3bb2 server_cookie=10575088e773b504 in_seq=0 out_seq=0 2024-09-19T07:15:58.614 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:58.608+0000 7f3b1dffb640 10 client.16512 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:15:59.120 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:59.118+0000 7f3b1dffb640 1 -- 172.21.15.148:0/3621522636 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55950c870d70 con 0x55950c90fcb0 2024-09-19T07:15:59.120 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:59.118+0000 7f3b1dffb640 10 client.16512 handle_command_reply: tid=0 2024-09-19T07:15:59.120 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:59.118+0000 7f3b3fa25740 1 client.16512 shutdown 2024-09-19T07:15:59.120 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:59.119+0000 7f3b3fa25740 1 -- 172.21.15.148:0/3621522636 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55950c901060 msgr2=0x55950c982ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:59.120 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:59.119+0000 7f3b3fa25740 1 --2- 172.21.15.148:0/3621522636 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55950c901060 0x55950c982ca0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f3b2802abd0 tx=0x7f3b28005fd0 comp rx=0 tx=0).stop 2024-09-19T07:15:59.121 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:59.119+0000 7f3b3fa25740 1 -- 172.21.15.148:0/3621522636 shutdown_connections 2024-09-19T07:15:59.121 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:59.119+0000 7f3b3fa25740 1 --2- 172.21.15.148:0/3621522636 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55950c90fcb0 0x55950c98c7a0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:59.121 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:59.119+0000 7f3b3fa25740 1 --2- 172.21.15.148:0/3621522636 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55950c905410 0x55950c9131f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:59.121 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:59.119+0000 7f3b3fa25740 1 --2- 172.21.15.148:0/3621522636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55950c904af0 0x55950c9831e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:59.121 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:59.119+0000 7f3b1dffb640 0 client.16512 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:15:59.121 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:59.119+0000 7f3b3fa25740 1 --2- 172.21.15.148:0/3621522636 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55950c901060 0x55950c982ca0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:59.121 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:59.119+0000 7f3b3fa25740 1 -- 172.21.15.148:0/3621522636 >> 172.21.15.148:0/3621522636 conn(0x55950c908530 msgr2=0x55950c8ff9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:15:59.121 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:59.119+0000 7f3b3fa25740 1 -- 172.21.15.148:0/3621522636 shutdown_connections 2024-09-19T07:15:59.121 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:59.119+0000 7f3b3fa25740 1 -- 172.21.15.148:0/3621522636 wait complete. 2024-09-19T07:15:59.121 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:59.119+0000 7f3b3fa25740 20 client.16512 trim_cache size 0 max 16384 2024-09-19T07:15:59.122 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:15:59.122 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:15:59.122 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:15:59.122 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:15:59.123 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:59.120+0000 7f3b3cbb0640 1 -- 172.21.15.148:0/3990831882 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f3b200a3460 msgr2=0x7f3b200a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:59.123 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:59.120+0000 7f3b3cbb0640 1 --2- 172.21.15.148:0/3990831882 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f3b200a3460 0x7f3b200a5920 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3b30005fd0 tx=0x7f3b30014040 comp rx=0 tx=0).stop 2024-09-19T07:15:59.123 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:59.120+0000 7f3b3cbb0640 1 -- 172.21.15.148:0/3990831882 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b38101350 msgr2=0x7f3b3819f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:59.123 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:59.120+0000 7f3b3cbb0640 1 --2- 172.21.15.148:0/3990831882 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b38101350 0x7f3b3819f1a0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c00e9f0 tx=0x7f3b2c00edf0 comp rx=0 tx=0).stop 2024-09-19T07:15:59.123 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:59.120+0000 7f3b3cbb0640 1 -- 172.21.15.148:0/3990831882 shutdown_connections 2024-09-19T07:15:59.123 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:59.120+0000 7f3b3cbb0640 1 --2- 172.21.15.148:0/3990831882 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f3b200a3460 0x7f3b200a5920 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:59.123 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:59.120+0000 7f3b3cbb0640 1 --2- 172.21.15.148:0/3990831882 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b381069c0 0x7f3b381a32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:59.123 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:59.120+0000 7f3b3cbb0640 1 --2- 172.21.15.148:0/3990831882 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b38101350 0x7f3b3819f1a0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:59.123 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:59.120+0000 7f3b3cbb0640 1 --2- 172.21.15.148:0/3990831882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b381009b0 0x7f3b3819ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:59.123 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:59.120+0000 7f3b3cbb0640 1 -- 172.21.15.148:0/3990831882 >> 172.21.15.148:0/3990831882 conn(0x7f3b38077990 msgr2=0x7f3b380698a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:15:59.123 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:59.120+0000 7f3b3cbb0640 1 -- 172.21.15.148:0/3990831882 shutdown_connections 2024-09-19T07:15:59.123 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:15:59.120+0000 7f3b3cbb0640 1 -- 172.21.15.148:0/3990831882 wait complete. 2024-09-19T07:15:59.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:15:59 smithi179 ceph-mon[35716]: pgmap v150: 97 pgs: 97 active+clean; 866 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 1.2 MiB/s wr, 416 op/s 2024-09-19T07:15:59.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:15:59 smithi148 ceph-mon[31180]: pgmap v150: 97 pgs: 97 active+clean; 866 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 1.2 MiB/s wr, 416 op/s 2024-09-19T07:15:59.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:15:59 smithi165 ceph-mon[35326]: pgmap v150: 97 pgs: 97 active+clean; 866 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 1.2 MiB/s wr, 416 op/s 2024-09-19T07:15:59.883 INFO:journalctl@ceph.mds.e.smithi165.stdout:Sep 19 07:15:59 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-e[64984]: ignoring --setuser ceph since I am not root 2024-09-19T07:15:59.884 INFO:journalctl@ceph.mds.e.smithi165.stdout:Sep 19 07:15:59 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-e[64984]: ignoring --setgroup ceph since I am not root 2024-09-19T07:15:59.884 INFO:journalctl@ceph.mds.e.smithi165.stdout:Sep 19 07:15:59 smithi165 ceph-mds[64988]: -- 172.21.15.165:0/3166489780 <== mon.2 v2:172.21.15.165:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b758cef860 con 0x55b758ccc800 2024-09-19T07:15:59.884 INFO:journalctl@ceph.mds.e.smithi165.stdout:Sep 19 07:15:59 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-e[64984]: starting mds.e at 2024-09-19T07:16:00.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:16:00 smithi179 ceph-mon[35716]: daemon mds.e restarted 2024-09-19T07:16:00.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:16:00 smithi148 ceph-mon[31180]: daemon mds.e restarted 2024-09-19T07:16:00.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:16:00 smithi165 ceph-mon[35326]: daemon mds.e restarted 2024-09-19T07:16:01.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:16:01 smithi179 ceph-mon[35716]: pgmap v151: 97 pgs: 97 active+clean; 866 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 1.2 MiB/s wr, 425 op/s 2024-09-19T07:16:01.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:16:01 smithi179 ceph-mon[35716]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T07:16:01.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:16:01 smithi179 ceph-mon[35716]: mds.? [v2:172.21.15.165:6834/380886107,v1:172.21.15.165:6835/380886107] up:boot 2024-09-19T07:16:01.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:16:01 smithi179 ceph-mon[35716]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-09-19T07:16:01.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:16:01 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T07:16:01.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:16:01 smithi179 ceph-mon[35716]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:16:01.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:16:01 smithi148 ceph-mon[31180]: pgmap v151: 97 pgs: 97 active+clean; 866 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 1.2 MiB/s wr, 425 op/s 2024-09-19T07:16:01.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:16:01 smithi148 ceph-mon[31180]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T07:16:01.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:16:01 smithi148 ceph-mon[31180]: mds.? [v2:172.21.15.165:6834/380886107,v1:172.21.15.165:6835/380886107] up:boot 2024-09-19T07:16:01.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:16:01 smithi148 ceph-mon[31180]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-09-19T07:16:01.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:16:01 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T07:16:01.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:16:01 smithi148 ceph-mon[31180]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:16:01.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:16:01 smithi165 ceph-mon[35326]: pgmap v151: 97 pgs: 97 active+clean; 866 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 1.2 MiB/s wr, 425 op/s 2024-09-19T07:16:01.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:16:01 smithi165 ceph-mon[35326]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T07:16:01.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:16:01 smithi165 ceph-mon[35326]: mds.? [v2:172.21.15.165:6834/380886107,v1:172.21.15.165:6835/380886107] up:boot 2024-09-19T07:16:01.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:16:01 smithi165 ceph-mon[35326]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-09-19T07:16:01.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:16:01 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T07:16:01.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:16:01 smithi165 ceph-mon[35326]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:16:03.194 INFO:tasks.workunit.client.0.smithi148.stdout: 231 727730 194 500948 184 230384 604 2024-09-19T07:16:03.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:16:03 smithi179 ceph-mon[35716]: pgmap v153: 97 pgs: 97 active+clean; 890 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.0 MiB/s wr, 502 op/s 2024-09-19T07:16:03.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:16:03 smithi148 ceph-mon[31180]: pgmap v153: 97 pgs: 97 active+clean; 890 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.0 MiB/s wr, 502 op/s 2024-09-19T07:16:03.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:16:03 smithi165 ceph-mon[35326]: pgmap v153: 97 pgs: 97 active+clean; 890 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.0 MiB/s wr, 502 op/s 2024-09-19T07:16:05.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:16:05 smithi179 ceph-mon[35716]: pgmap v154: 97 pgs: 97 active+clean; 890 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.0 MiB/s wr, 502 op/s 2024-09-19T07:16:05.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:16:05 smithi148 ceph-mon[31180]: pgmap v154: 97 pgs: 97 active+clean; 890 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.0 MiB/s wr, 502 op/s 2024-09-19T07:16:05.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:16:05 smithi165 ceph-mon[35326]: pgmap v154: 97 pgs: 97 active+clean; 890 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.0 MiB/s wr, 502 op/s 2024-09-19T07:16:06.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:06.711+0000 7fc01cff9640 1 -- 172.21.15.148:0/736825470 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55cd7e6e1ec0 con 0x55cd7e87e600 2024-09-19T07:16:06.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:06.711+0000 7fc01cff9640 10 client.25799 handle_command_reply: tid=0 2024-09-19T07:16:06.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:06.711+0000 7fc03dcd9740 1 client.25799 shutdown 2024-09-19T07:16:06.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:06.711+0000 7fc03dcd9740 1 -- 172.21.15.148:0/736825470 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cd7e7f8760 msgr2=0x55cd7e8069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:06.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:06.711+0000 7fc03dcd9740 1 --2- 172.21.15.148:0/736825470 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cd7e7f8760 0x55cd7e8069d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc024035000 tx=0x7fc024035f70 comp rx=0 tx=0).stop 2024-09-19T07:16:06.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:06.711+0000 7fc03dcd9740 1 -- 172.21.15.148:0/736825470 shutdown_connections 2024-09-19T07:16:06.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:06.711+0000 7fc03dcd9740 1 --2- 172.21.15.148:0/736825470 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55cd7e87e600 0x55cd7e880a20 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:06.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:06.711+0000 7fc01cff9640 0 client.25799 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:16:06.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:06.711+0000 7fc03dcd9740 1 --2- 172.21.15.148:0/736825470 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cd7e803940 0x55cd7e807450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:06.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:06.711+0000 7fc03dcd9740 1 --2- 172.21.15.148:0/736825470 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cd7e7f9080 0x55cd7e806f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:06.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:06.711+0000 7fc03dcd9740 1 --2- 172.21.15.148:0/736825470 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cd7e7f8760 0x55cd7e8069d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:06.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:06.711+0000 7fc03dcd9740 1 -- 172.21.15.148:0/736825470 >> 172.21.15.148:0/736825470 conn(0x55cd7e7f4cf0 msgr2=0x55cd7e802150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:16:06.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:06.712+0000 7fc03dcd9740 1 -- 172.21.15.148:0/736825470 shutdown_connections 2024-09-19T07:16:06.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:06.712+0000 7fc03dcd9740 1 -- 172.21.15.148:0/736825470 wait complete. 2024-09-19T07:16:06.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:06.712+0000 7fc03dcd9740 20 client.25799 trim_cache size 0 max 16384 2024-09-19T07:16:06.714 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:16:06.714 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 35, 2024-09-19T07:16:06.714 INFO:teuthology.orchestra.run.smithi148.stdout: "leader": 24457, 2024-09-19T07:16:06.714 INFO:teuthology.orchestra.run.smithi148.stdout: "set_version": 22, 2024-09-19T07:16:06.714 INFO:teuthology.orchestra.run.smithi148.stdout: "sets": { 2024-09-19T07:16:06.715 INFO:teuthology.orchestra.run.smithi148.stdout: "a8f55d81": { 2024-09-19T07:16:06.715 INFO:teuthology.orchestra.run.smithi148.stdout: "version": 22, 2024-09-19T07:16:06.715 INFO:teuthology.orchestra.run.smithi148.stdout: "age_ref": 0.0, 2024-09-19T07:16:06.715 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:16:06.715 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "QUIESCED", 2024-09-19T07:16:06.715 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:16:06.715 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:16:06.715 INFO:teuthology.orchestra.run.smithi148.stdout: "timeout": 90.0, 2024-09-19T07:16:06.715 INFO:teuthology.orchestra.run.smithi148.stdout: "expiration": 149.8, 2024-09-19T07:16:06.715 INFO:teuthology.orchestra.run.smithi148.stdout: "members": { 2024-09-19T07:16:06.715 INFO:teuthology.orchestra.run.smithi148.stdout: "file:/": { 2024-09-19T07:16:06.715 INFO:teuthology.orchestra.run.smithi148.stdout: "excluded": false, 2024-09-19T07:16:06.715 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:16:06.716 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "QUIESCED", 2024-09-19T07:16:06.716 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:16:06.716 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:16:06.716 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:16:06.716 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:16:06.716 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:16:06.716 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:16:06.716 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:16:06.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:06.712+0000 7fc03b900640 1 -- 172.21.15.148:0/2823735618 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc0200a34b0 msgr2=0x7fc0200a5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:06.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:06.712+0000 7fc03b900640 1 --2- 172.21.15.148:0/2823735618 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc0200a34b0 0x7fc0200a5970 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc024000c00 tx=0x7fc024005d30 comp rx=0 tx=0).stop 2024-09-19T07:16:06.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:06.712+0000 7fc03b900640 1 -- 172.21.15.148:0/2823735618 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc034102790 msgr2=0x7fc034073ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:06.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:06.712+0000 7fc03b900640 1 --2- 172.21.15.148:0/2823735618 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc034102790 0x7fc034073ec0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc02c00efb0 tx=0x7fc02c00c800 comp rx=0 tx=0).stop 2024-09-19T07:16:06.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:06.713+0000 7fc03b900640 1 -- 172.21.15.148:0/2823735618 shutdown_connections 2024-09-19T07:16:06.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:06.713+0000 7fc03b900640 1 --2- 172.21.15.148:0/2823735618 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc0200a34b0 0x7fc0200a5970 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:06.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:06.713+0000 7fc03b900640 1 --2- 172.21.15.148:0/2823735618 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc034106f10 0x7fc03406cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:06.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:06.713+0000 7fc03b900640 1 --2- 172.21.15.148:0/2823735618 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc034102790 0x7fc034073ec0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:06.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:06.713+0000 7fc03b900640 1 --2- 172.21.15.148:0/2823735618 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc034101de0 0x7fc034073980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:06.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:06.713+0000 7fc03b900640 1 -- 172.21.15.148:0/2823735618 >> 172.21.15.148:0/2823735618 conn(0x7fc0340fd8c0 msgr2=0x7fc0340fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:16:06.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:06.713+0000 7fc03b900640 1 -- 172.21.15.148:0/2823735618 shutdown_connections 2024-09-19T07:16:06.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:06.713+0000 7fc03b900640 1 -- 172.21.15.148:0/2823735618 wait complete. 2024-09-19T07:16:07.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:16:07 smithi179 ceph-mon[35716]: pgmap v155: 97 pgs: 97 active+clean; 900 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.7 MiB/s wr, 463 op/s 2024-09-19T07:16:07.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:16:07 smithi148 ceph-mon[31180]: pgmap v155: 97 pgs: 97 active+clean; 900 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.7 MiB/s wr, 463 op/s 2024-09-19T07:16:07.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:16:07 smithi165 ceph-mon[35326]: pgmap v155: 97 pgs: 97 active+clean; 900 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.7 MiB/s wr, 463 op/s 2024-09-19T07:16:07.554 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'a8f55d81', quiesce took 12.6 seconds. Will release after: 17.200000000000003 2024-09-19T07:16:09.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:16:09 smithi179 ceph-mon[35716]: pgmap v156: 97 pgs: 97 active+clean; 900 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.7 MiB/s wr, 463 op/s 2024-09-19T07:16:09.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:16:09 smithi148 ceph-mon[31180]: pgmap v156: 97 pgs: 97 active+clean; 900 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.7 MiB/s wr, 463 op/s 2024-09-19T07:16:09.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:16:09 smithi165 ceph-mon[35326]: pgmap v156: 97 pgs: 97 active+clean; 900 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.7 MiB/s wr, 463 op/s 2024-09-19T07:16:11.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:16:11 smithi148 ceph-mon[31180]: pgmap v157: 97 pgs: 97 active+clean; 904 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.0 MiB/s wr, 482 op/s 2024-09-19T07:16:11.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:16:11 smithi165 ceph-mon[35326]: pgmap v157: 97 pgs: 97 active+clean; 904 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.0 MiB/s wr, 482 op/s 2024-09-19T07:16:11.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:16:11 smithi179 ceph-mon[35716]: pgmap v157: 97 pgs: 97 active+clean; 904 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.0 MiB/s wr, 482 op/s 2024-09-19T07:16:12.222 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.218+0000 7f60e6f68640 1 -- 172.21.15.148:0/2214503346 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f60e0103aa0 msgr2=0x7f60e0103e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:12.222 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.218+0000 7f60e6f68640 1 --2- 172.21.15.148:0/2214503346 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f60e0103aa0 0x7f60e0103e80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f60d4009900 tx=0x7f60d402a410 comp rx=0 tx=0).stop 2024-09-19T07:16:12.223 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.218+0000 7f60e6f68640 1 -- 172.21.15.148:0/2214503346 shutdown_connections 2024-09-19T07:16:12.223 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.218+0000 7f60e6f68640 1 --2- 172.21.15.148:0/2214503346 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60e01008e0 0x7f60e010ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:12.223 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.218+0000 7f60e6f68640 1 --2- 172.21.15.148:0/2214503346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60e00fff60 0x7f60e01003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:12.223 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.218+0000 7f60e6f68640 1 --2- 172.21.15.148:0/2214503346 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f60e0103aa0 0x7f60e0103e80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:12.223 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.218+0000 7f60e6f68640 1 -- 172.21.15.148:0/2214503346 >> 172.21.15.148:0/2214503346 conn(0x7f60e00770f0 msgr2=0x7f60e00fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:16:12.223 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.218+0000 7f60e6f68640 1 -- 172.21.15.148:0/2214503346 shutdown_connections 2024-09-19T07:16:12.223 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.218+0000 7f60e6f68640 1 -- 172.21.15.148:0/2214503346 wait complete. 2024-09-19T07:16:12.223 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.219+0000 7f60e6f68640 1 Processor -- start 2024-09-19T07:16:12.223 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.219+0000 7f60e6f68640 1 -- start start 2024-09-19T07:16:12.223 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.219+0000 7f60e6f68640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60e00fff60 0x7f60e01984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:12.223 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.219+0000 7f60e6f68640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60e01008e0 0x7f60e01989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:12.223 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.219+0000 7f60e6f68640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f60e0103aa0 0x7f60e019cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:12.223 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.219+0000 7f60e6f68640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f60e01120a0 con 0x7f60e00fff60 2024-09-19T07:16:12.224 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.219+0000 7f60e6f68640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f60e0111f20 con 0x7f60e0103aa0 2024-09-19T07:16:12.224 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.219+0000 7f60e6f68640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f60e0112220 con 0x7f60e01008e0 2024-09-19T07:16:12.224 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.219+0000 7f60e4d04640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60e00fff60 0x7f60e01984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:12.224 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.220+0000 7f60e4d04640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60e00fff60 0x7f60e01984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39474/0 (socket says 172.21.15.148:39474) 2024-09-19T07:16:12.224 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.220+0000 7f60e4d04640 1 -- 172.21.15.148:0/1980472376 learned_addr learned my addr 172.21.15.148:0/1980472376 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:16:12.224 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.220+0000 7f60e5505640 1 --2- 172.21.15.148:0/1980472376 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f60e0103aa0 0x7f60e019cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:12.224 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.220+0000 7f60dffff640 1 --2- 172.21.15.148:0/1980472376 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60e01008e0 0x7f60e01989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:12.224 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.220+0000 7f60e4d04640 1 -- 172.21.15.148:0/1980472376 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60e01008e0 msgr2=0x7f60e01989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:12.224 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.220+0000 7f60e4d04640 1 --2- 172.21.15.148:0/1980472376 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60e01008e0 0x7f60e01989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:12.224 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.220+0000 7f60e4d04640 1 -- 172.21.15.148:0/1980472376 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f60e0103aa0 msgr2=0x7f60e019cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:12.224 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.220+0000 7f60e4d04640 1 --2- 172.21.15.148:0/1980472376 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f60e0103aa0 0x7f60e019cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:12.224 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.220+0000 7f60e4d04640 1 -- 172.21.15.148:0/1980472376 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60e019d4a0 con 0x7f60e00fff60 2024-09-19T07:16:12.224 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.220+0000 7f60e4d04640 1 --2- 172.21.15.148:0/1980472376 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60e00fff60 0x7f60e01984b0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f60d4006010 tx=0x7f60d4004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:16:12.225 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.220+0000 7f60ddffb640 1 -- 172.21.15.148:0/1980472376 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d403f030 con 0x7f60e00fff60 2024-09-19T07:16:12.225 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.220+0000 7f60e6f68640 1 -- 172.21.15.148:0/1980472376 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60e019d730 con 0x7f60e00fff60 2024-09-19T07:16:12.225 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.220+0000 7f60ddffb640 1 -- 172.21.15.148:0/1980472376 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60d4004440 con 0x7f60e00fff60 2024-09-19T07:16:12.225 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.220+0000 7f60ddffb640 1 -- 172.21.15.148:0/1980472376 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d4035070 con 0x7f60e00fff60 2024-09-19T07:16:12.225 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.220+0000 7f60e6f68640 1 -- 172.21.15.148:0/1980472376 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60e01a5020 con 0x7f60e00fff60 2024-09-19T07:16:12.227 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.223+0000 7f60ddffb640 1 -- 172.21.15.148:0/1980472376 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f60d4042030 con 0x7f60e00fff60 2024-09-19T07:16:12.227 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.223+0000 7f60e9dd9740 1 Processor -- start 2024-09-19T07:16:12.227 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.223+0000 7f60e9dd9740 1 -- start start 2024-09-19T07:16:12.227 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.223+0000 7f60e9dd9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629f8433af0 0x5629f8433ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:12.227 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.223+0000 7f60e9dd9740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5629f8434410 0x5629f843e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:12.227 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.223+0000 7f60e9dd9740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629f843ecb0 0x5629f84410a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:12.227 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.223+0000 7f60e9dd9740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5629f83982f0 con 0x5629f843ecb0 2024-09-19T07:16:12.227 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.223+0000 7f60e9dd9740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5629f8340270 con 0x5629f8434410 2024-09-19T07:16:12.227 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.224+0000 7f60e9dd9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5629f83942b0 con 0x5629f8433af0 2024-09-19T07:16:12.227 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.224+0000 7f60dffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629f843ecb0 0x5629f84410a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:12.228 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.224+0000 7f60e5505640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629f8433af0 0x5629f8433ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:12.228 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.224+0000 7f60e5505640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629f8433af0 0x5629f8433ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:49130/0 (socket says 172.21.15.148:49130) 2024-09-19T07:16:12.228 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.224+0000 7f60e5505640 1 -- 172.21.15.148:0/2449006572 learned_addr learned my addr 172.21.15.148:0/2449006572 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:16:12.228 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.224+0000 7f60e4d04640 1 --2- 172.21.15.148:0/2449006572 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5629f8434410 0x5629f843e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:12.228 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.224+0000 7f60e5505640 1 -- 172.21.15.148:0/2449006572 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5629f8434410 msgr2=0x5629f843e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:16:12.228 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.224+0000 7f60e5505640 1 --2- 172.21.15.148:0/2449006572 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5629f8434410 0x5629f843e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:12.228 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.224+0000 7f60e5505640 1 -- 172.21.15.148:0/2449006572 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629f843ecb0 msgr2=0x5629f84410a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:16:12.228 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.224+0000 7f60e5505640 1 --2- 172.21.15.148:0/2449006572 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629f843ecb0 0x5629f84410a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:12.228 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.224+0000 7f60e5505640 1 -- 172.21.15.148:0/2449006572 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629f833f340 con 0x5629f8433af0 2024-09-19T07:16:12.228 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.224+0000 7f60ddffb640 1 --2- 172.21.15.148:0/1980472376 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f60d00a3460 0x7f60d00a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:12.228 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.224+0000 7f60e4d04640 1 --2- 172.21.15.148:0/1980472376 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f60d00a3460 0x7f60d00a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:12.228 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.224+0000 7f60e5505640 1 --2- 172.21.15.148:0/2449006572 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629f8433af0 0x5629f8433ed0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f60d8009f40 tx=0x7f60d80118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=813d7340cdbfa241 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:16:12.228 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.224+0000 7f60ddffb640 1 -- 172.21.15.148:0/1980472376 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8512+0+0 (secure 0 0 0) 0x7f60d40f0050 con 0x7f60e00fff60 2024-09-19T07:16:12.229 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.225+0000 7f60caffd640 1 -- 172.21.15.148:0/2449006572 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d8004d20 con 0x5629f8433af0 2024-09-19T07:16:12.229 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.225+0000 7f60caffd640 1 -- 172.21.15.148:0/2449006572 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60d8004050 con 0x5629f8433af0 2024-09-19T07:16:12.229 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.225+0000 7f60caffd640 1 -- 172.21.15.148:0/2449006572 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d8005280 con 0x5629f8433af0 2024-09-19T07:16:12.232 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.226+0000 7f60e9dd9740 1 -- 172.21.15.148:0/2449006572 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629f8433af0 msgr2=0x5629f8433ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:12.232 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.226+0000 7f60e4d04640 1 --2- 172.21.15.148:0/1980472376 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f60d00a3460 0x7f60d00a5920 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x5629f8430ec0 tx=0x7f60d402a410 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:16:12.232 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.226+0000 7f60e9dd9740 1 --2- 172.21.15.148:0/2449006572 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629f8433af0 0x5629f8433ed0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f60d8009f40 tx=0x7f60d80118d0 comp rx=0 tx=0).stop 2024-09-19T07:16:12.233 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.226+0000 7f60e9dd9740 1 -- 172.21.15.148:0/2449006572 shutdown_connections 2024-09-19T07:16:12.233 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.226+0000 7f60e9dd9740 1 --2- 172.21.15.148:0/2449006572 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629f843ecb0 0x5629f84410a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:12.233 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.226+0000 7f60e9dd9740 1 --2- 172.21.15.148:0/2449006572 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5629f8434410 0x5629f843e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:12.233 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.226+0000 7f60e9dd9740 1 --2- 172.21.15.148:0/2449006572 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629f8433af0 0x5629f8433ed0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:12.233 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.226+0000 7f60e9dd9740 1 -- 172.21.15.148:0/2449006572 >> 172.21.15.148:0/2449006572 conn(0x5629f8430060 msgr2=0x5629f8430440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:16:12.233 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.226+0000 7f60e9dd9740 1 -- 172.21.15.148:0/2449006572 shutdown_connections 2024-09-19T07:16:12.233 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.226+0000 7f60e9dd9740 1 -- 172.21.15.148:0/2449006572 wait complete. 2024-09-19T07:16:12.233 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.226+0000 7f60e9dd9740 1 -- start start 2024-09-19T07:16:12.233 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.226+0000 7f60e9dd9740 1 Processor -- start 2024-09-19T07:16:12.233 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.227+0000 7f60e9dd9740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629f8433af0 0x5629f843bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:12.233 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.227+0000 7f60e9dd9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629f8434410 0x5629f843c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:12.233 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.227+0000 7f60e9dd9740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5629f843ecb0 0x5629f843c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:12.233 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.227+0000 7f60e9dd9740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5629f8441880 con 0x5629f8433af0 2024-09-19T07:16:12.234 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.227+0000 7f60e9dd9740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5629f8321290 con 0x5629f843ecb0 2024-09-19T07:16:12.234 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.227+0000 7f60e9dd9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5629f8441a00 con 0x5629f8434410 2024-09-19T07:16:12.234 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.227+0000 7f60e9dd9740 10 client.0 _ll_register_callbacks cb 0x5629f8352140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:16:12.234 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.227+0000 7f60e5505640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629f8433af0 0x5629f843bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:12.234 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.227+0000 7f60e5505640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629f8433af0 0x5629f843bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39506/0 (socket says 172.21.15.148:39506) 2024-09-19T07:16:12.234 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.227+0000 7f60dffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629f8434410 0x5629f843c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:12.234 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.227+0000 7f60e5505640 1 -- 172.21.15.148:0/1298318333 learned_addr learned my addr 172.21.15.148:0/1298318333 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:16:12.234 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.227+0000 7f60e5505640 1 --2- 172.21.15.148:0/1298318333 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5629f843ecb0 0x5629f843c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:12.234 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.227+0000 7f60dffff640 1 -- 172.21.15.148:0/1298318333 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5629f843ecb0 msgr2=0x5629f843c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:16:12.234 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.227+0000 7f60dffff640 1 --2- 172.21.15.148:0/1298318333 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5629f843ecb0 0x5629f843c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:12.234 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.227+0000 7f60dffff640 1 -- 172.21.15.148:0/1298318333 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629f8433af0 msgr2=0x5629f843bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:16:12.234 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.227+0000 7f60dffff640 1 --2- 172.21.15.148:0/1298318333 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629f8433af0 0x5629f843bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:12.234 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.227+0000 7f60dffff640 1 -- 172.21.15.148:0/1298318333 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629f80ab210 con 0x5629f8434410 2024-09-19T07:16:12.235 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.227+0000 7f60e5505640 1 --2- 172.21.15.148:0/1298318333 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629f8433af0 0x5629f843bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:16:12.235 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.227+0000 7f60dffff640 1 --2- 172.21.15.148:0/1298318333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629f8434410 0x5629f843c0f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f60e00ff5c0 tx=0x7f60cc012b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=daf45767d35eed25 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:16:12.235 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.227+0000 7f60bffff640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-19T07:16:12.235 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.228+0000 7f60bffff640 1 -- 172.21.15.148:0/1298318333 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60cc00f920 con 0x5629f8434410 2024-09-19T07:16:12.235 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.228+0000 7f60bffff640 1 -- 172.21.15.148:0/1298318333 <== mon.1 v2:172.21.15.179:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8512+0+0 (secure 0 0 0) 0x7f60cc00fac0 con 0x5629f8434410 2024-09-19T07:16:12.235 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.228+0000 7f60e9dd9740 1 -- 172.21.15.148:0/1298318333 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60d8004050 con 0x5629f8434410 2024-09-19T07:16:12.235 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.228+0000 7f60bffff640 1 -- 172.21.15.148:0/1298318333 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f60cc00fcc0 con 0x5629f8434410 2024-09-19T07:16:12.235 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.228+0000 7f60e9dd9740 10 client.25921 fetch_fsmap learned FSMap version 35 2024-09-19T07:16:12.235 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.228+0000 7f60e9dd9740 1 -- 172.21.15.148:0/1298318333 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5629f8177620 con 0x5629f8434410 2024-09-19T07:16:12.235 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.228+0000 7f60bffff640 1 -- 172.21.15.148:0/1298318333 <== mon.1 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60d8004050 con 0x5629f8434410 2024-09-19T07:16:12.235 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.229+0000 7f60bffff640 1 -- 172.21.15.148:0/1298318333 <== mon.1 v2:172.21.15.179:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f60cc01c420 con 0x5629f8434410 2024-09-19T07:16:12.235 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.229+0000 7f60e9dd9740 10 client.25921 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:16:12.235 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.229+0000 7f60e9dd9740 10 client.25921 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:16:12.236 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.229+0000 7f60e9dd9740 20 client.25921 populate_metadata read hostname 'smithi148' 2024-09-19T07:16:12.236 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.229+0000 7f60e9dd9740 1 --2- 172.21.15.148:0/1298318333 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5629f8453160 0x5629f8455590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:12.236 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.229+0000 7f60e9dd9740 4 client.25921 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:16:12.236 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.229+0000 7f60e9dd9740 1 -- 172.21.15.148:0/1298318333 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5629f83a5a20 con 0x5629f8453160 2024-09-19T07:16:12.236 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.229+0000 7f60e5505640 1 --2- 172.21.15.148:0/1298318333 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5629f8453160 0x5629f8455590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:12.236 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.230+0000 7f60e5505640 1 --2- 172.21.15.148:0/1298318333 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5629f8453160 0x5629f8455590 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1655272207a40e63 server_cookie=ed37284a4b938a7f in_seq=0 out_seq=0 2024-09-19T07:16:12.236 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.230+0000 7f60bffff640 10 client.25921 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:16:12.237 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.231+0000 7f60bffff640 1 -- 172.21.15.148:0/1298318333 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5629f83a5a20 con 0x5629f8453160 2024-09-19T07:16:12.237 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.231+0000 7f60bffff640 10 client.25921 handle_command_reply: tid=0 2024-09-19T07:16:12.237 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.231+0000 7f60e9dd9740 1 client.25921 shutdown 2024-09-19T07:16:12.237 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.232+0000 7f60e9dd9740 1 -- 172.21.15.148:0/1298318333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629f8434410 msgr2=0x5629f843c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:12.237 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.232+0000 7f60e9dd9740 1 --2- 172.21.15.148:0/1298318333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629f8434410 0x5629f843c0f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f60e00ff5c0 tx=0x7f60cc012b60 comp rx=0 tx=0).stop 2024-09-19T07:16:12.237 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.232+0000 7f60e9dd9740 1 -- 172.21.15.148:0/1298318333 shutdown_connections 2024-09-19T07:16:12.238 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.232+0000 7f60e9dd9740 1 --2- 172.21.15.148:0/1298318333 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5629f8453160 0x5629f8455590 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:12.238 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.232+0000 7f60e9dd9740 1 --2- 172.21.15.148:0/1298318333 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5629f843ecb0 0x5629f843c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:12.238 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.232+0000 7f60e9dd9740 1 --2- 172.21.15.148:0/1298318333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629f8434410 0x5629f843c0f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:12.238 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.232+0000 7f60e9dd9740 1 --2- 172.21.15.148:0/1298318333 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629f8433af0 0x5629f843bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:12.238 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.232+0000 7f60bffff640 0 client.25921 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:16:12.238 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.232+0000 7f60e9dd9740 1 -- 172.21.15.148:0/1298318333 >> 172.21.15.148:0/1298318333 conn(0x5629f8430060 msgr2=0x5629f8435d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:16:12.238 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.232+0000 7f60e9dd9740 1 -- 172.21.15.148:0/1298318333 shutdown_connections 2024-09-19T07:16:12.238 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.232+0000 7f60e9dd9740 1 -- 172.21.15.148:0/1298318333 wait complete. 2024-09-19T07:16:12.238 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.232+0000 7f60e9dd9740 20 client.25921 trim_cache size 0 max 16384 2024-09-19T07:16:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.250+0000 7f60e9dd9740 1 Processor -- start 2024-09-19T07:16:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.250+0000 7f60e9dd9740 1 -- start start 2024-09-19T07:16:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.250+0000 7f60e9dd9740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629f8433af0 0x5629f8436560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.250+0000 7f60e9dd9740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5629f8434410 0x5629f843c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.250+0000 7f60e9dd9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629f843ecb0 0x5629f845ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.250+0000 7f60e9dd9740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f60e01adeb0 con 0x5629f8433af0 2024-09-19T07:16:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.250+0000 7f60e9dd9740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f60e01ab720 con 0x5629f8434410 2024-09-19T07:16:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.250+0000 7f60e9dd9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f60e01a9550 con 0x5629f843ecb0 2024-09-19T07:16:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.251+0000 7f60e5505640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629f8433af0 0x5629f8436560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.251+0000 7f60dffff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5629f8434410 0x5629f843c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.251+0000 7f60e5505640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629f8433af0 0x5629f8436560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39508/0 (socket says 172.21.15.148:39508) 2024-09-19T07:16:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.251+0000 7f60e5505640 1 -- 172.21.15.148:0/1684811534 learned_addr learned my addr 172.21.15.148:0/1684811534 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:16:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.251+0000 7f60e5505640 1 --2- 172.21.15.148:0/1684811534 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629f843ecb0 0x5629f845ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.251+0000 7f60dffff640 1 -- 172.21.15.148:0/1684811534 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629f843ecb0 msgr2=0x5629f845ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:16:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.251+0000 7f60dffff640 1 --2- 172.21.15.148:0/1684811534 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629f843ecb0 0x5629f845ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.251+0000 7f60dffff640 1 -- 172.21.15.148:0/1684811534 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629f8433af0 msgr2=0x5629f8436560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:16:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.251+0000 7f60dffff640 1 --2- 172.21.15.148:0/1684811534 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629f8433af0 0x5629f8436560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.251+0000 7f60dffff640 1 -- 172.21.15.148:0/1684811534 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629f842a2f0 con 0x5629f8434410 2024-09-19T07:16:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.251+0000 7f60e5505640 1 --2- 172.21.15.148:0/1684811534 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629f8433af0 0x5629f8436560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:16:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.251+0000 7f60dffff640 1 --2- 172.21.15.148:0/1684811534 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5629f8434410 0x5629f843c480 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f60cc01c910 tx=0x7f60cc005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ca6881cbfcbf77d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:16:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.251+0000 7f60ca7fc640 1 -- 172.21.15.148:0/1684811534 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60cc00f920 con 0x5629f8434410 2024-09-19T07:16:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.251+0000 7f60ca7fc640 1 -- 172.21.15.148:0/1684811534 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60cc00fac0 con 0x5629f8434410 2024-09-19T07:16:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.251+0000 7f60ca7fc640 1 -- 172.21.15.148:0/1684811534 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60cc003d30 con 0x5629f8434410 2024-09-19T07:16:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.252+0000 7f60e9dd9740 1 -- 172.21.15.148:0/1684811534 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5629f8434410 msgr2=0x5629f843c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.252+0000 7f60e9dd9740 1 --2- 172.21.15.148:0/1684811534 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5629f8434410 0x5629f843c480 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f60cc01c910 tx=0x7f60cc005850 comp rx=0 tx=0).stop 2024-09-19T07:16:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.252+0000 7f60e9dd9740 1 -- 172.21.15.148:0/1684811534 shutdown_connections 2024-09-19T07:16:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.252+0000 7f60e9dd9740 1 --2- 172.21.15.148:0/1684811534 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629f843ecb0 0x5629f845ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.252+0000 7f60e9dd9740 1 --2- 172.21.15.148:0/1684811534 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5629f8434410 0x5629f843c480 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:12.259 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.252+0000 7f60e9dd9740 1 --2- 172.21.15.148:0/1684811534 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629f8433af0 0x5629f8436560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:12.259 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.252+0000 7f60e9dd9740 1 -- 172.21.15.148:0/1684811534 >> 172.21.15.148:0/1684811534 conn(0x5629f8430060 msgr2=0x5629f843dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:16:12.259 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.252+0000 7f60e9dd9740 1 -- 172.21.15.148:0/1684811534 shutdown_connections 2024-09-19T07:16:12.259 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.252+0000 7f60e9dd9740 1 -- 172.21.15.148:0/1684811534 wait complete. 2024-09-19T07:16:12.259 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.253+0000 7f60e9dd9740 1 -- start start 2024-09-19T07:16:12.259 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.253+0000 7f60e9dd9740 1 Processor -- start 2024-09-19T07:16:12.259 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.253+0000 7f60e9dd9740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629f8433af0 0x5629f8438af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:12.259 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.253+0000 7f60e9dd9740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5629f8434410 0x5629f8439030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:12.259 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.253+0000 7f60e9dd9740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629f843ecb0 0x5629f8439570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:12.259 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.253+0000 7f60e9dd9740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f60e01a9be0 con 0x5629f8433af0 2024-09-19T07:16:12.259 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.253+0000 7f60e9dd9740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f60e01ab050 con 0x5629f8434410 2024-09-19T07:16:12.259 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.253+0000 7f60e9dd9740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f60e01aa2b0 con 0x5629f843ecb0 2024-09-19T07:16:12.260 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.253+0000 7f60e9dd9740 10 client.0 _ll_register_callbacks cb 0x7f60cc009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:16:12.260 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.253+0000 7f60e5505640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629f8433af0 0x5629f8438af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:12.260 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.253+0000 7f60dffff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5629f8434410 0x5629f8439030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:12.260 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.253+0000 7f60dffff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5629f8434410 0x5629f8439030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:33042/0 (socket says 172.21.15.148:33042) 2024-09-19T07:16:12.260 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.253+0000 7f60dffff640 1 -- 172.21.15.148:0/3167039174 learned_addr learned my addr 172.21.15.148:0/3167039174 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:16:12.260 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.253+0000 7f60e5505640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629f8433af0 0x5629f8438af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39510/0 (socket says 172.21.15.148:39510) 2024-09-19T07:16:12.260 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.253+0000 7f60e5505640 1 --2- 172.21.15.148:0/3167039174 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629f843ecb0 0x5629f8439570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:12.260 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.254+0000 7f60dffff640 1 -- 172.21.15.148:0/3167039174 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629f843ecb0 msgr2=0x5629f8439570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:16:12.260 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.254+0000 7f60dffff640 1 --2- 172.21.15.148:0/3167039174 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629f843ecb0 0x5629f8439570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:12.260 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.254+0000 7f60dffff640 1 -- 172.21.15.148:0/3167039174 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629f8433af0 msgr2=0x5629f8438af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:16:12.260 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.254+0000 7f60dffff640 1 --2- 172.21.15.148:0/3167039174 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629f8433af0 0x5629f8438af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:12.260 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.254+0000 7f60dffff640 1 -- 172.21.15.148:0/3167039174 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629f84bce30 con 0x5629f8434410 2024-09-19T07:16:12.260 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.254+0000 7f60dffff640 1 --2- 172.21.15.148:0/3167039174 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5629f8434410 0x5629f8439030 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f60cc0058c0 tx=0x7f60cc009e30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=300d463eaec8fe27 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:16:12.261 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.254+0000 7f60bffff640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-19T07:16:12.261 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.254+0000 7f60bffff640 1 -- 172.21.15.148:0/3167039174 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60cc00f920 con 0x5629f8434410 2024-09-19T07:16:12.261 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.254+0000 7f60bffff640 1 -- 172.21.15.148:0/3167039174 <== mon.2 v2:172.21.15.165:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8512+0+0 (secure 0 0 0) 0x7f60cc0052c0 con 0x5629f8434410 2024-09-19T07:16:12.261 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.254+0000 7f60e9dd9740 1 -- 172.21.15.148:0/3167039174 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60cc00fac0 con 0x5629f8434410 2024-09-19T07:16:12.261 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.254+0000 7f60bffff640 1 -- 172.21.15.148:0/3167039174 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f60cc0054c0 con 0x5629f8434410 2024-09-19T07:16:12.261 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.254+0000 7f60e9dd9740 10 client.25841 fetch_fsmap learned FSMap version 35 2024-09-19T07:16:12.261 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.254+0000 7f60e9dd9740 1 -- 172.21.15.148:0/3167039174 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5629f84be020 con 0x5629f8434410 2024-09-19T07:16:12.261 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.255+0000 7f60bffff640 1 -- 172.21.15.148:0/3167039174 <== mon.2 v2:172.21.15.165:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60cc031070 con 0x5629f8434410 2024-09-19T07:16:12.261 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.255+0000 7f60bffff640 1 -- 172.21.15.148:0/3167039174 <== mon.2 v2:172.21.15.165:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f60cc02b020 con 0x5629f8434410 2024-09-19T07:16:12.261 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.255+0000 7f60e9dd9740 10 client.25841 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:16:12.261 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.255+0000 7f60e9dd9740 10 client.25841 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:16:12.261 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.255+0000 7f60e9dd9740 20 client.25841 populate_metadata read hostname 'smithi148' 2024-09-19T07:16:12.261 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.255+0000 7f60e9dd9740 1 --2- 172.21.15.148:0/3167039174 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5629f84be640 0x5629f84c0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:12.262 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.255+0000 7f60e9dd9740 4 client.25841 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:16:12.262 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.255+0000 7f60e9dd9740 1 -- 172.21.15.148:0/3167039174 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f60cc00fac0 con 0x5629f84be640 2024-09-19T07:16:12.262 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.255+0000 7f60e5505640 1 --2- 172.21.15.148:0/3167039174 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5629f84be640 0x5629f84c0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:12.262 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.255+0000 7f60bffff640 10 client.25841 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:16:12.262 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:12.255+0000 7f60e5505640 1 --2- 172.21.15.148:0/3167039174 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5629f84be640 0x5629f84c0a60 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=901e15148d7df4cc server_cookie=a744af37ff8706f4 in_seq=0 out_seq=0 2024-09-19T07:16:13.194 INFO:tasks.workunit.client.0.smithi148.stdout: 231 42691 0 28659 0 15028 0 2024-09-19T07:16:13.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:16:13 smithi148 ceph-mon[31180]: pgmap v158: 97 pgs: 97 active+clean; 909 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.5 MiB/s wr, 657 op/s 2024-09-19T07:16:13.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:16:13 smithi165 ceph-mon[35326]: pgmap v158: 97 pgs: 97 active+clean; 909 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.5 MiB/s wr, 657 op/s 2024-09-19T07:16:13.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:16:13 smithi179 ceph-mon[35716]: pgmap v158: 97 pgs: 97 active+clean; 909 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.5 MiB/s wr, 657 op/s 2024-09-19T07:16:15.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:16:15 smithi148 ceph-mon[31180]: pgmap v159: 97 pgs: 97 active+clean; 909 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.8 MiB/s wr, 560 op/s 2024-09-19T07:16:15.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:16:15 smithi165 ceph-mon[35326]: pgmap v159: 97 pgs: 97 active+clean; 909 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.8 MiB/s wr, 560 op/s 2024-09-19T07:16:15.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:15.474+0000 7f60bffff640 1 -- 172.21.15.148:0/3167039174 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f60cc00fac0 con 0x5629f84be640 2024-09-19T07:16:15.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:15.474+0000 7f60bffff640 10 client.25841 handle_command_reply: tid=0 2024-09-19T07:16:15.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:15.475+0000 7f60e9dd9740 1 client.25841 shutdown 2024-09-19T07:16:15.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:15.475+0000 7f60e9dd9740 1 -- 172.21.15.148:0/3167039174 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5629f8434410 msgr2=0x5629f8439030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:15.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:15.475+0000 7f60e9dd9740 1 --2- 172.21.15.148:0/3167039174 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5629f8434410 0x5629f8439030 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f60cc0058c0 tx=0x7f60cc009e30 comp rx=0 tx=0).stop 2024-09-19T07:16:15.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:15.475+0000 7f60e9dd9740 1 -- 172.21.15.148:0/3167039174 shutdown_connections 2024-09-19T07:16:15.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:15.475+0000 7f60e9dd9740 1 --2- 172.21.15.148:0/3167039174 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5629f84be640 0x5629f84c0a60 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:15.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:15.475+0000 7f60e9dd9740 1 --2- 172.21.15.148:0/3167039174 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5629f843ecb0 0x5629f8439570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:15.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:15.475+0000 7f60e9dd9740 1 --2- 172.21.15.148:0/3167039174 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5629f8434410 0x5629f8439030 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:15.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:15.475+0000 7f60e9dd9740 1 --2- 172.21.15.148:0/3167039174 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629f8433af0 0x5629f8438af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:15.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:15.475+0000 7f60bffff640 0 client.25841 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:16:15.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:15.475+0000 7f60e9dd9740 1 -- 172.21.15.148:0/3167039174 >> 172.21.15.148:0/3167039174 conn(0x5629f8430060 msgr2=0x5629f842e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:16:15.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:15.475+0000 7f60e9dd9740 1 -- 172.21.15.148:0/3167039174 shutdown_connections 2024-09-19T07:16:15.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:15.475+0000 7f60e9dd9740 1 -- 172.21.15.148:0/3167039174 wait complete. 2024-09-19T07:16:15.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:15.475+0000 7f60e9dd9740 20 client.25841 trim_cache size 0 max 16384 2024-09-19T07:16:15.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:16:15.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:16:15.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:16:15.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:16:15.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:15.476+0000 7f60e6f68640 1 -- 172.21.15.148:0/1980472376 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f60d00a3460 msgr2=0x7f60d00a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:15.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:15.476+0000 7f60e6f68640 1 --2- 172.21.15.148:0/1980472376 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f60d00a3460 0x7f60d00a5920 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x5629f8430ec0 tx=0x7f60d402a410 comp rx=0 tx=0).stop 2024-09-19T07:16:15.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:15.476+0000 7f60e6f68640 1 -- 172.21.15.148:0/1980472376 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60e00fff60 msgr2=0x7f60e01984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:15.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:15.476+0000 7f60e6f68640 1 --2- 172.21.15.148:0/1980472376 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60e00fff60 0x7f60e01984b0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f60d4006010 tx=0x7f60d4004040 comp rx=0 tx=0).stop 2024-09-19T07:16:15.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:15.476+0000 7f60e6f68640 1 -- 172.21.15.148:0/1980472376 shutdown_connections 2024-09-19T07:16:15.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:15.476+0000 7f60e6f68640 1 --2- 172.21.15.148:0/1980472376 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f60d00a3460 0x7f60d00a5920 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:15.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:15.476+0000 7f60e6f68640 1 --2- 172.21.15.148:0/1980472376 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f60e0103aa0 0x7f60e019cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:15.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:15.476+0000 7f60e6f68640 1 --2- 172.21.15.148:0/1980472376 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60e01008e0 0x7f60e01989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:15.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:15.476+0000 7f60e6f68640 1 --2- 172.21.15.148:0/1980472376 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60e00fff60 0x7f60e01984b0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:15.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:15.476+0000 7f60e6f68640 1 -- 172.21.15.148:0/1980472376 >> 172.21.15.148:0/1980472376 conn(0x7f60e00770f0 msgr2=0x7f60e0105ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:16:15.480 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:15.476+0000 7f60e6f68640 1 -- 172.21.15.148:0/1980472376 shutdown_connections 2024-09-19T07:16:15.480 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:15.476+0000 7f60e6f68640 1 -- 172.21.15.148:0/1980472376 wait complete. 2024-09-19T07:16:15.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:16:15 smithi179 ceph-mon[35716]: pgmap v159: 97 pgs: 97 active+clean; 909 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.8 MiB/s wr, 560 op/s 2024-09-19T07:16:17.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:16:17 smithi148 ceph-mon[31180]: pgmap v160: 97 pgs: 97 active+clean; 919 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 MiB/s rd, 2.7 MiB/s wr, 1.29k op/s 2024-09-19T07:16:17.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:16:17 smithi165 ceph-mon[35326]: pgmap v160: 97 pgs: 97 active+clean; 919 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 MiB/s rd, 2.7 MiB/s wr, 1.29k op/s 2024-09-19T07:16:17.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:16:17 smithi179 ceph-mon[35716]: pgmap v160: 97 pgs: 97 active+clean; 919 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 MiB/s rd, 2.7 MiB/s wr, 1.29k op/s 2024-09-19T07:16:19.345 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:16:19 smithi148 ceph-mon[31180]: pgmap v161: 97 pgs: 97 active+clean; 919 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 1.7 MiB/s wr, 1.24k op/s 2024-09-19T07:16:19.517 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:16:19 smithi165 ceph-mon[35326]: pgmap v161: 97 pgs: 97 active+clean; 919 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 1.7 MiB/s wr, 1.24k op/s 2024-09-19T07:16:19.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:16:19 smithi179 ceph-mon[35716]: pgmap v161: 97 pgs: 97 active+clean; 919 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 1.7 MiB/s wr, 1.24k op/s 2024-09-19T07:16:20.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:16:20 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:16:20.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:16:20 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:16:20.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:16:20 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:16:20.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:16:20 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:16:20.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:16:20 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:16:20.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:16:20 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:16:20.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:16:20 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:16:20.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:16:20 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:16:20.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:16:20 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:16:20.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:16:20 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:16:20.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:16:20 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:16:20.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:16:20 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:16:21.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:16:21 smithi148 ceph-mon[31180]: pgmap v162: 97 pgs: 97 active+clean; 922 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 1.9 MiB/s wr, 1.24k op/s 2024-09-19T07:16:21.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:16:21 smithi165 ceph-mon[35326]: pgmap v162: 97 pgs: 97 active+clean; 922 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 1.9 MiB/s wr, 1.24k op/s 2024-09-19T07:16:21.423 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:16:21 smithi179 ceph-mon[35716]: pgmap v162: 97 pgs: 97 active+clean; 922 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 1.9 MiB/s wr, 1.24k op/s 2024-09-19T07:16:23.194 INFO:tasks.workunit.client.0.smithi148.stdout: 231 110905 0 74511 0 34558 0 2024-09-19T07:16:23.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:16:23 smithi148 ceph-mon[31180]: pgmap v163: 97 pgs: 97 active+clean; 913 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 1.9 MiB/s wr, 1.29k op/s 2024-09-19T07:16:23.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:16:23 smithi165 ceph-mon[35326]: pgmap v163: 97 pgs: 97 active+clean; 913 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 1.9 MiB/s wr, 1.29k op/s 2024-09-19T07:16:23.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:16:23 smithi179 ceph-mon[35716]: pgmap v163: 97 pgs: 97 active+clean; 913 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 1.9 MiB/s wr, 1.29k op/s 2024-09-19T07:16:24.755 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:16:25.015 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:16:25.296 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:16:25 smithi148 ceph-mon[31180]: pgmap v164: 97 pgs: 97 active+clean; 913 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 1.4 MiB/s wr, 808 op/s 2024-09-19T07:16:25.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:16:25 smithi165 ceph-mon[35326]: pgmap v164: 97 pgs: 97 active+clean; 913 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 1.4 MiB/s wr, 808 op/s 2024-09-19T07:16:25.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:16:25 smithi179 ceph-mon[35716]: pgmap v164: 97 pgs: 97 active+clean; 913 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 1.4 MiB/s wr, 808 op/s 2024-09-19T07:16:25.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.504+0000 7f26c8fd6640 1 -- 172.21.15.148:0/3552799260 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26c4100eb0 msgr2=0x7f26c4106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:25.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.504+0000 7f26c8fd6640 1 --2- 172.21.15.148:0/3552799260 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26c4100eb0 0x7f26c4106840 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f26ac009900 tx=0x7f26ac02a410 comp rx=0 tx=0).stop 2024-09-19T07:16:25.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.504+0000 7f26c8fd6640 1 -- 172.21.15.148:0/3552799260 shutdown_connections 2024-09-19T07:16:25.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.504+0000 7f26c8fd6640 1 --2- 172.21.15.148:0/3552799260 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26c4106f70 0x7f26c410eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:25.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.504+0000 7f26c8fd6640 1 --2- 172.21.15.148:0/3552799260 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26c4100eb0 0x7f26c4106840 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:25.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.504+0000 7f26c8fd6640 1 --2- 172.21.15.148:0/3552799260 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26c4100500 0x7f26c41008e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:25.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.504+0000 7f26c8fd6640 1 -- 172.21.15.148:0/3552799260 >> 172.21.15.148:0/3552799260 conn(0x7f26c40fc5c0 msgr2=0x7f26c40fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:16:25.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.504+0000 7f26c8fd6640 1 -- 172.21.15.148:0/3552799260 shutdown_connections 2024-09-19T07:16:25.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.504+0000 7f26c8fd6640 1 -- 172.21.15.148:0/3552799260 wait complete. 2024-09-19T07:16:25.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.505+0000 7f26c8fd6640 1 Processor -- start 2024-09-19T07:16:25.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.505+0000 7f26c8fd6640 1 -- start start 2024-09-19T07:16:25.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.505+0000 7f26c8fd6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26c4100500 0x7f26c4101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:25.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.505+0000 7f26c8fd6640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26c4100eb0 0x7f26c41019c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:25.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.505+0000 7f26c8fd6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26c4106f70 0x7f26c4101f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:25.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.505+0000 7f26c8fd6640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f26c4111fd0 con 0x7f26c4100500 2024-09-19T07:16:25.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.505+0000 7f26c8fd6640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f26c4111e50 con 0x7f26c4100eb0 2024-09-19T07:16:25.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.505+0000 7f26c8fd6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f26c4112150 con 0x7f26c4106f70 2024-09-19T07:16:25.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.505+0000 7f26c259c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26c4100500 0x7f26c4101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:25.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.506+0000 7f26c259c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26c4100500 0x7f26c4101480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43142/0 (socket says 172.21.15.148:43142) 2024-09-19T07:16:25.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.506+0000 7f26c259c640 1 -- 172.21.15.148:0/2945183205 learned_addr learned my addr 172.21.15.148:0/2945183205 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:16:25.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.506+0000 7f26c2d9d640 1 --2- 172.21.15.148:0/2945183205 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26c4106f70 0x7f26c4101f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:25.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.506+0000 7f26c1d9b640 1 --2- 172.21.15.148:0/2945183205 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26c4100eb0 0x7f26c41019c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:25.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.506+0000 7f26c259c640 1 -- 172.21.15.148:0/2945183205 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26c4106f70 msgr2=0x7f26c4101f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:25.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.506+0000 7f26c259c640 1 --2- 172.21.15.148:0/2945183205 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26c4106f70 0x7f26c4101f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:25.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.506+0000 7f26c259c640 1 -- 172.21.15.148:0/2945183205 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26c4100eb0 msgr2=0x7f26c41019c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:25.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.506+0000 7f26c259c640 1 --2- 172.21.15.148:0/2945183205 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26c4100eb0 0x7f26c41019c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:25.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.506+0000 7f26c259c640 1 -- 172.21.15.148:0/2945183205 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26c41a69f0 con 0x7f26c4100500 2024-09-19T07:16:25.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.506+0000 7f26c1d9b640 1 --2- 172.21.15.148:0/2945183205 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26c4100eb0 0x7f26c41019c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:16:25.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.506+0000 7f26c259c640 1 --2- 172.21.15.148:0/2945183205 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26c4100500 0x7f26c4101480 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f26b400d950 tx=0x7f26b400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:16:25.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.506+0000 7f26bb7fe640 1 -- 172.21.15.148:0/2945183205 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b4017070 con 0x7f26c4100500 2024-09-19T07:16:25.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.506+0000 7f26bb7fe640 1 -- 172.21.15.148:0/2945183205 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26b4009c30 con 0x7f26c4100500 2024-09-19T07:16:25.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.506+0000 7f26c8fd6640 1 -- 172.21.15.148:0/2945183205 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26c41a6ce0 con 0x7f26c4100500 2024-09-19T07:16:25.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.506+0000 7f26bb7fe640 1 -- 172.21.15.148:0/2945183205 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b400f600 con 0x7f26c4100500 2024-09-19T07:16:25.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.506+0000 7f26c8fd6640 1 -- 172.21.15.148:0/2945183205 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26c41a71a0 con 0x7f26c4100500 2024-09-19T07:16:25.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.507+0000 7f26c8fd6640 1 -- 172.21.15.148:0/2945183205 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26c41008e0 con 0x7f26c4100500 2024-09-19T07:16:25.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.508+0000 7f26bb7fe640 1 -- 172.21.15.148:0/2945183205 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f26b401a070 con 0x7f26c4100500 2024-09-19T07:16:25.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.509+0000 7f26bb7fe640 1 --2- 172.21.15.148:0/2945183205 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f26b00a33b0 0x7f26b00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:25.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.509+0000 7f26bb7fe640 1 -- 172.21.15.148:0/2945183205 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8512+0+0 (secure 0 0 0) 0x7f26b40cf7b0 con 0x7f26c4100500 2024-09-19T07:16:25.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.509+0000 7f26c1d9b640 1 --2- 172.21.15.148:0/2945183205 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f26b00a33b0 0x7f26b00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:25.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.510+0000 7f26c1d9b640 1 --2- 172.21.15.148:0/2945183205 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f26b00a33b0 0x7f26b00a5870 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f26ac009230 tx=0x7f26ac005a20 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:16:25.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.513+0000 7f26bb7fe640 1 -- 172.21.15.148:0/2945183205 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f26b4009de0 con 0x7f26c4100500 2024-09-19T07:16:25.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.713+0000 7f26c8fd6640 1 -- 172.21.15.148:0/2945183205 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f26c4109b50 con 0x7f26c4100500 2024-09-19T07:16:25.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.714+0000 7f26bb7fe640 1 -- 172.21.15.148:0/2945183205 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11944 (secure 0 0 0) 0x7f26b409c1a0 con 0x7f26c4100500 2024-09-19T07:16:25.715 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:16:25.715 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":35,"btime":"2024-09-19T07:16:00:026048+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/4263868576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":4263868576},{"type":"v1","addr":"172.21.15.148:6841","nonce":4263868576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":25606,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3891676893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3891676893},{"type":"v1","addr":"172.21.15.179:6835","nonce":3891676893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:09:19.543369+0000","modified":"2024-09-19T07:16:00.026035+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24457,"mds_1":24437,"mds_2":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":75,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":71,"addr":"172.21.15.165:6839/3993490234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":3993490234},{"type":"v1","addr":"172.21.15.165:6839","nonce":3993490234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25823":{"gid":25823,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6835/380886107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":380886107},{"type":"v1","addr":"172.21.15.165:6835","nonce":380886107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24457,"qdb_cluster":[24457,24437,24436]},"id":1}]} 2024-09-19T07:16:25.716 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 35 2024-09-19T07:16:25.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.716+0000 7f26c8fd6640 1 -- 172.21.15.148:0/2945183205 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f26b00a33b0 msgr2=0x7f26b00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:25.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.716+0000 7f26c8fd6640 1 --2- 172.21.15.148:0/2945183205 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f26b00a33b0 0x7f26b00a5870 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f26ac009230 tx=0x7f26ac005a20 comp rx=0 tx=0).stop 2024-09-19T07:16:25.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.716+0000 7f26c8fd6640 1 -- 172.21.15.148:0/2945183205 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26c4100500 msgr2=0x7f26c4101480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:25.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.716+0000 7f26c8fd6640 1 --2- 172.21.15.148:0/2945183205 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26c4100500 0x7f26c4101480 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f26b400d950 tx=0x7f26b400de10 comp rx=0 tx=0).stop 2024-09-19T07:16:25.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.717+0000 7f26c8fd6640 1 -- 172.21.15.148:0/2945183205 shutdown_connections 2024-09-19T07:16:25.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.717+0000 7f26c8fd6640 1 --2- 172.21.15.148:0/2945183205 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f26b00a33b0 0x7f26b00a5870 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:25.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.717+0000 7f26c8fd6640 1 --2- 172.21.15.148:0/2945183205 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26c4106f70 0x7f26c4101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:25.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.717+0000 7f26c8fd6640 1 --2- 172.21.15.148:0/2945183205 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26c4100eb0 0x7f26c41019c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:25.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.717+0000 7f26c8fd6640 1 --2- 172.21.15.148:0/2945183205 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26c4100500 0x7f26c4101480 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:25.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.717+0000 7f26c8fd6640 1 -- 172.21.15.148:0/2945183205 >> 172.21.15.148:0/2945183205 conn(0x7f26c40fc5c0 msgr2=0x7f26c40fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:16:25.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.717+0000 7f26c8fd6640 1 -- 172.21.15.148:0/2945183205 shutdown_connections 2024-09-19T07:16:25.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:25.717+0000 7f26c8fd6640 1 -- 172.21.15.148:0/2945183205 wait complete. 2024-09-19T07:16:26.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:16:26 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/2945183205' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:16:26.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:16:26 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/2945183205' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:16:26.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:16:26 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/2945183205' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:16:26.653 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24457 quiesce db --set-id a8f55d81 --release --await' 2024-09-19T07:16:26.653 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24457 quiesce db --set-id a8f55d81 --release --await 2024-09-19T07:16:26.902 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:16:27.275 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:16:27 smithi148 ceph-mon[31180]: pgmap v165: 97 pgs: 97 active+clean; 913 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 1.4 MiB/s wr, 815 op/s 2024-09-19T07:16:27.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:16:27 smithi165 ceph-mon[35326]: pgmap v165: 97 pgs: 97 active+clean; 913 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 1.4 MiB/s wr, 815 op/s 2024-09-19T07:16:27.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.365+0000 7fc3d00eb640 1 -- 172.21.15.148:0/320978631 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3c8102ef0 msgr2=0x7fc3c810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:27.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.365+0000 7fc3d00eb640 1 --2- 172.21.15.148:0/320978631 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3c8102ef0 0x7fc3c810da40 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8009900 tx=0x7fc3b802a480 comp rx=0 tx=0).stop 2024-09-19T07:16:27.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.365+0000 7fc3d00eb640 1 -- 172.21.15.148:0/320978631 shutdown_connections 2024-09-19T07:16:27.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.365+0000 7fc3d00eb640 1 --2- 172.21.15.148:0/320978631 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3c8102ef0 0x7fc3c810da40 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:27.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.365+0000 7fc3d00eb640 1 --2- 172.21.15.148:0/320978631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3c8102570 0x7fc3c81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:27.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.365+0000 7fc3d00eb640 1 --2- 172.21.15.148:0/320978631 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3c8100e20 0x7fc3c8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:27.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.365+0000 7fc3d00eb640 1 -- 172.21.15.148:0/320978631 >> 172.21.15.148:0/320978631 conn(0x7fc3c80fc7d0 msgr2=0x7fc3c80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:16:27.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.365+0000 7fc3d00eb640 1 -- 172.21.15.148:0/320978631 shutdown_connections 2024-09-19T07:16:27.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.365+0000 7fc3d00eb640 1 -- 172.21.15.148:0/320978631 wait complete. 2024-09-19T07:16:27.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.365+0000 7fc3d00eb640 1 Processor -- start 2024-09-19T07:16:27.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.365+0000 7fc3d00eb640 1 -- start start 2024-09-19T07:16:27.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.366+0000 7fc3d00eb640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3c8100e20 0x7fc3c810e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:27.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.366+0000 7fc3d00eb640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3c8102570 0x7fc3c810ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:27.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.366+0000 7fc3d00eb640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3c8102ef0 0x7fc3c810ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:27.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.366+0000 7fc3d00eb640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c81120a0 con 0x7fc3c8100e20 2024-09-19T07:16:27.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.366+0000 7fc3d00eb640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c8111f20 con 0x7fc3c8102570 2024-09-19T07:16:27.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.366+0000 7fc3d00eb640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c8112220 con 0x7fc3c8102ef0 2024-09-19T07:16:27.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.366+0000 7fc3cde87640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3c8100e20 0x7fc3c810e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:27.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.366+0000 7fc3cde87640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3c8100e20 0x7fc3c810e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43158/0 (socket says 172.21.15.148:43158) 2024-09-19T07:16:27.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.366+0000 7fc3cde87640 1 -- 172.21.15.148:0/3350924572 learned_addr learned my addr 172.21.15.148:0/3350924572 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:16:27.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.366+0000 7fc3ce688640 1 --2- 172.21.15.148:0/3350924572 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3c8102ef0 0x7fc3c810ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:27.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.366+0000 7fc3cd686640 1 --2- 172.21.15.148:0/3350924572 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3c8102570 0x7fc3c810ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:27.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.366+0000 7fc3cde87640 1 -- 172.21.15.148:0/3350924572 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3c8102ef0 msgr2=0x7fc3c810ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:27.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.366+0000 7fc3cde87640 1 --2- 172.21.15.148:0/3350924572 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3c8102ef0 0x7fc3c810ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:27.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.366+0000 7fc3cde87640 1 -- 172.21.15.148:0/3350924572 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3c8102570 msgr2=0x7fc3c810ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:27.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.366+0000 7fc3cde87640 1 --2- 172.21.15.148:0/3350924572 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3c8102570 0x7fc3c810ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:27.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.366+0000 7fc3cde87640 1 -- 172.21.15.148:0/3350924572 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3c81a6920 con 0x7fc3c8100e20 2024-09-19T07:16:27.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.366+0000 7fc3cd686640 1 --2- 172.21.15.148:0/3350924572 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3c8102570 0x7fc3c810ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:16:27.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.366+0000 7fc3cde87640 1 --2- 172.21.15.148:0/3350924572 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3c8100e20 0x7fc3c810e4d0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fc3c000d950 tx=0x7fc3c000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:16:27.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.366+0000 7fc3c6ffd640 1 -- 172.21.15.148:0/3350924572 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c0017070 con 0x7fc3c8100e20 2024-09-19T07:16:27.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.367+0000 7fc3d00eb640 1 -- 172.21.15.148:0/3350924572 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3c81a6c10 con 0x7fc3c8100e20 2024-09-19T07:16:27.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.367+0000 7fc3c6ffd640 1 -- 172.21.15.148:0/3350924572 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3c0009c30 con 0x7fc3c8100e20 2024-09-19T07:16:27.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.367+0000 7fc3c6ffd640 1 -- 172.21.15.148:0/3350924572 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c000f6b0 con 0x7fc3c8100e20 2024-09-19T07:16:27.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.367+0000 7fc3d00eb640 1 -- 172.21.15.148:0/3350924572 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3c81a71a0 con 0x7fc3c8100e20 2024-09-19T07:16:27.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.369+0000 7fc3d24c4740 1 Processor -- start 2024-09-19T07:16:27.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.370+0000 7fc3d24c4740 1 -- start start 2024-09-19T07:16:27.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.370+0000 7fc3d24c4740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb84a79060 0x55fb84a79440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:27.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.370+0000 7fc3d24c4740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb84a79980 0x55fb84a83d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:27.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.370+0000 7fc3d24c4740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb84a84240 0x55fb84a86630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:27.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.370+0000 7fc3d24c4740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55fb849de620 con 0x55fb84a79060 2024-09-19T07:16:27.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.370+0000 7fc3d24c4740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55fb84985e50 con 0x55fb84a79980 2024-09-19T07:16:27.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.370+0000 7fc3d24c4740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55fb849da5e0 con 0x55fb84a84240 2024-09-19T07:16:27.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.370+0000 7fc3c6ffd640 1 -- 172.21.15.148:0/3350924572 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fc3c00109d0 con 0x7fc3c8100e20 2024-09-19T07:16:27.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.370+0000 7fc3ce688640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb84a79060 0x55fb84a79440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:27.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.370+0000 7fc3ce688640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb84a79060 0x55fb84a79440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43166/0 (socket says 172.21.15.148:43166) 2024-09-19T07:16:27.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.370+0000 7fc3ce688640 1 -- 172.21.15.148:0/2953474481 learned_addr learned my addr 172.21.15.148:0/2953474481 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:16:27.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.370+0000 7fc3cd686640 1 --2- 172.21.15.148:0/2953474481 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb84a84240 0x55fb84a86630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:27.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.370+0000 7fc3cde87640 1 --2- 172.21.15.148:0/2953474481 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb84a79980 0x55fb84a83d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:27.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.371+0000 7fc3ce688640 1 -- 172.21.15.148:0/2953474481 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb84a84240 msgr2=0x55fb84a86630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:16:27.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.371+0000 7fc3ce688640 1 --2- 172.21.15.148:0/2953474481 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb84a84240 0x55fb84a86630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:27.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.371+0000 7fc3ce688640 1 -- 172.21.15.148:0/2953474481 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb84a79980 msgr2=0x55fb84a83d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:16:27.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.371+0000 7fc3ce688640 1 --2- 172.21.15.148:0/2953474481 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb84a79980 0x55fb84a83d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:27.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.371+0000 7fc3ce688640 1 -- 172.21.15.148:0/2953474481 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb84976d40 con 0x55fb84a79060 2024-09-19T07:16:27.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.371+0000 7fc3ce688640 1 --2- 172.21.15.148:0/2953474481 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb84a79060 0x55fb84a79440 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80314e0 tx=0x7fc3b8004170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdc9e13a2a9fe0df server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:16:27.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.371+0000 7fc3c6ffd640 1 --2- 172.21.15.148:0/3350924572 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc3b00a33b0 0x7fc3b00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:27.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.371+0000 7fc3affff640 1 -- 172.21.15.148:0/2953474481 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b8035030 con 0x55fb84a79060 2024-09-19T07:16:27.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.371+0000 7fc3affff640 1 -- 172.21.15.148:0/2953474481 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3b8005520 con 0x55fb84a79060 2024-09-19T07:16:27.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.371+0000 7fc3affff640 1 -- 172.21.15.148:0/2953474481 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b8003850 con 0x55fb84a79060 2024-09-19T07:16:27.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.371+0000 7fc3cde87640 1 --2- 172.21.15.148:0/3350924572 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc3b00a33b0 0x7fc3b00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:27.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.371+0000 7fc3c6ffd640 1 -- 172.21.15.148:0/3350924572 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8512+0+0 (secure 0 0 0) 0x7fc3c00cfa10 con 0x7fc3c8100e20 2024-09-19T07:16:27.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.372+0000 7fc3d24c4740 1 -- 172.21.15.148:0/2953474481 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb84a79060 msgr2=0x55fb84a79440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:27.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.372+0000 7fc3cde87640 1 --2- 172.21.15.148:0/3350924572 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc3b00a33b0 0x7fc3b00a5870 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x55fb84a76450 tx=0x7fc3c0086040 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:16:27.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.372+0000 7fc3d24c4740 1 --2- 172.21.15.148:0/2953474481 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb84a79060 0x55fb84a79440 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80314e0 tx=0x7fc3b8004170 comp rx=0 tx=0).stop 2024-09-19T07:16:27.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.372+0000 7fc3d24c4740 1 -- 172.21.15.148:0/2953474481 shutdown_connections 2024-09-19T07:16:27.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.372+0000 7fc3d24c4740 1 --2- 172.21.15.148:0/2953474481 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb84a84240 0x55fb84a86630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:27.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.372+0000 7fc3d24c4740 1 --2- 172.21.15.148:0/2953474481 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb84a79980 0x55fb84a83d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:27.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.372+0000 7fc3d24c4740 1 --2- 172.21.15.148:0/2953474481 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb84a79060 0x55fb84a79440 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:27.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.372+0000 7fc3d24c4740 1 -- 172.21.15.148:0/2953474481 >> 172.21.15.148:0/2953474481 conn(0x55fb84a755f0 msgr2=0x55fb84a759d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:16:27.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.372+0000 7fc3d24c4740 1 -- 172.21.15.148:0/2953474481 shutdown_connections 2024-09-19T07:16:27.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.372+0000 7fc3d24c4740 1 -- 172.21.15.148:0/2953474481 wait complete. 2024-09-19T07:16:27.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.372+0000 7fc3d24c4740 1 -- start start 2024-09-19T07:16:27.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.373+0000 7fc3d24c4740 1 Processor -- start 2024-09-19T07:16:27.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.373+0000 7fc3d24c4740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb84a79060 0x55fb84a81140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:27.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.373+0000 7fc3d24c4740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb84a79980 0x55fb84a81680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:27.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.373+0000 7fc3d24c4740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb84a84240 0x55fb84a81bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:27.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.373+0000 7fc3d24c4740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55fb84a86e10 con 0x55fb84a79980 2024-09-19T07:16:27.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.373+0000 7fc3d24c4740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55fb84966f10 con 0x55fb84a79060 2024-09-19T07:16:27.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.373+0000 7fc3d24c4740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55fb84a86f90 con 0x55fb84a84240 2024-09-19T07:16:27.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.373+0000 7fc3d24c4740 10 client.0 _ll_register_callbacks cb 0x55fb8498adb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:16:27.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.373+0000 7fc3cd686640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb84a79980 0x55fb84a81680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:27.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.373+0000 7fc3cd686640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb84a79980 0x55fb84a81680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43176/0 (socket says 172.21.15.148:43176) 2024-09-19T07:16:27.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.373+0000 7fc3cd686640 1 -- 172.21.15.148:0/3267560195 learned_addr learned my addr 172.21.15.148:0/3267560195 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:16:27.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.373+0000 7fc3ce688640 1 --2- 172.21.15.148:0/3267560195 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb84a79060 0x55fb84a81140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:27.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.373+0000 7fc3ce688640 1 --2- 172.21.15.148:0/3267560195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb84a84240 0x55fb84a81bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:27.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.374+0000 7fc3cd686640 1 -- 172.21.15.148:0/3267560195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb84a84240 msgr2=0x55fb84a81bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:16:27.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.374+0000 7fc3cd686640 1 --2- 172.21.15.148:0/3267560195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb84a84240 0x55fb84a81bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:27.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.374+0000 7fc3cd686640 1 -- 172.21.15.148:0/3267560195 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb84a79060 msgr2=0x55fb84a81140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:16:27.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.374+0000 7fc3cd686640 1 --2- 172.21.15.148:0/3267560195 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb84a79060 0x55fb84a81140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:27.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.374+0000 7fc3cd686640 1 -- 172.21.15.148:0/3267560195 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb846ed580 con 0x55fb84a79980 2024-09-19T07:16:27.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.374+0000 7fc3cd686640 1 --2- 172.21.15.148:0/3267560195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb84a79980 0x55fb84a81680 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc010a60 tx=0x7fc3bc010f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8bd39971b2da4ec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:16:27.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.374+0000 7fc3ad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:16:27.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.374+0000 7fc3ad7fa640 1 -- 172.21.15.148:0/3267560195 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc01d060 con 0x55fb84a79980 2024-09-19T07:16:27.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.374+0000 7fc3ad7fa640 1 -- 172.21.15.148:0/3267560195 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8512+0+0 (secure 0 0 0) 0x7fc3bc00eca0 con 0x55fb84a79980 2024-09-19T07:16:27.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.374+0000 7fc3d24c4740 1 -- 172.21.15.148:0/3267560195 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3b8005520 con 0x55fb84a79980 2024-09-19T07:16:27.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.374+0000 7fc3ad7fa640 1 -- 172.21.15.148:0/3267560195 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fc3bc00eea0 con 0x55fb84a79980 2024-09-19T07:16:27.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.374+0000 7fc3d24c4740 10 client.16554 fetch_fsmap learned FSMap version 35 2024-09-19T07:16:27.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.374+0000 7fc3d24c4740 1 -- 172.21.15.148:0/3267560195 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55fb847b7960 con 0x55fb84a79980 2024-09-19T07:16:27.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.374+0000 7fc3ad7fa640 1 -- 172.21.15.148:0/3267560195 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3b8005520 con 0x55fb84a79980 2024-09-19T07:16:27.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.374+0000 7fc3ad7fa640 1 -- 172.21.15.148:0/3267560195 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fc3bc0206c0 con 0x55fb84a79980 2024-09-19T07:16:27.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.374+0000 7fc3d24c4740 10 client.16554 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:16:27.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.374+0000 7fc3d24c4740 10 client.16554 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:16:27.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.375+0000 7fc3d24c4740 20 client.16554 populate_metadata read hostname 'smithi148' 2024-09-19T07:16:27.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.375+0000 7fc3d24c4740 1 --2- 172.21.15.148:0/3267560195 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55fb84a93e90 0x55fb84a962e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:27.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.375+0000 7fc3d24c4740 4 client.16554 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:16:27.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.375+0000 7fc3d24c4740 1 -- 172.21.15.148:0/3267560195 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fb849ebb90 con 0x55fb84a93e90 2024-09-19T07:16:27.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.375+0000 7fc3ce688640 1 --2- 172.21.15.148:0/3267560195 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55fb84a93e90 0x55fb84a962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:27.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.375+0000 7fc3ce688640 1 --2- 172.21.15.148:0/3267560195 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55fb84a93e90 0x55fb84a962e0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7856820b8d8f3d81 server_cookie=713c6359224cff1f in_seq=0 out_seq=0 2024-09-19T07:16:27.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.375+0000 7fc3ad7fa640 10 client.16554 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:16:27.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.376+0000 7fc3ad7fa640 1 -- 172.21.15.148:0/3267560195 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fb849ebb90 con 0x55fb84a93e90 2024-09-19T07:16:27.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.376+0000 7fc3ad7fa640 10 client.16554 handle_command_reply: tid=0 2024-09-19T07:16:27.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.376+0000 7fc3d24c4740 1 client.16554 shutdown 2024-09-19T07:16:27.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.376+0000 7fc3d24c4740 1 -- 172.21.15.148:0/3267560195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb84a79980 msgr2=0x55fb84a81680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:27.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.376+0000 7fc3d24c4740 1 --2- 172.21.15.148:0/3267560195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb84a79980 0x55fb84a81680 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc010a60 tx=0x7fc3bc010f20 comp rx=0 tx=0).stop 2024-09-19T07:16:27.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.376+0000 7fc3d24c4740 1 -- 172.21.15.148:0/3267560195 shutdown_connections 2024-09-19T07:16:27.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.376+0000 7fc3d24c4740 1 --2- 172.21.15.148:0/3267560195 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55fb84a93e90 0x55fb84a962e0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:27.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.376+0000 7fc3d24c4740 1 --2- 172.21.15.148:0/3267560195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb84a84240 0x55fb84a81bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:27.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.376+0000 7fc3d24c4740 1 --2- 172.21.15.148:0/3267560195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb84a79980 0x55fb84a81680 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:27.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.376+0000 7fc3d24c4740 1 --2- 172.21.15.148:0/3267560195 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb84a79060 0x55fb84a81140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:27.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.376+0000 7fc3ad7fa640 0 client.16554 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:16:27.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.376+0000 7fc3d24c4740 1 -- 172.21.15.148:0/3267560195 >> 172.21.15.148:0/3267560195 conn(0x55fb84a755f0 msgr2=0x55fb84a74750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:16:27.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.376+0000 7fc3d24c4740 1 -- 172.21.15.148:0/3267560195 shutdown_connections 2024-09-19T07:16:27.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.376+0000 7fc3d24c4740 1 -- 172.21.15.148:0/3267560195 wait complete. 2024-09-19T07:16:27.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.376+0000 7fc3d24c4740 20 client.16554 trim_cache size 0 max 16384 2024-09-19T07:16:27.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.393+0000 7fc3d24c4740 1 Processor -- start 2024-09-19T07:16:27.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.393+0000 7fc3d24c4740 1 -- start start 2024-09-19T07:16:27.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.393+0000 7fc3d24c4740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb84a79060 0x55fb84a7bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:27.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.393+0000 7fc3d24c4740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb84a79980 0x55fb84a9bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:27.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.393+0000 7fc3d24c4740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb84a84240 0x55fb84a9c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:27.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.393+0000 7fc3d24c4740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c81b2340 con 0x55fb84a79060 2024-09-19T07:16:27.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.393+0000 7fc3d24c4740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c81afbb0 con 0x55fb84a79980 2024-09-19T07:16:27.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.393+0000 7fc3d24c4740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c81ad9e0 con 0x55fb84a84240 2024-09-19T07:16:27.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.393+0000 7fc3ce688640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb84a79060 0x55fb84a7bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:27.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.394+0000 7fc3ce688640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb84a79060 0x55fb84a7bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43188/0 (socket says 172.21.15.148:43188) 2024-09-19T07:16:27.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.394+0000 7fc3ce688640 1 -- 172.21.15.148:0/1223673219 learned_addr learned my addr 172.21.15.148:0/1223673219 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:16:27.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.394+0000 7fc3cd686640 1 --2- 172.21.15.148:0/1223673219 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb84a79980 0x55fb84a9bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:27.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.394+0000 7fc3ce688640 1 --2- 172.21.15.148:0/1223673219 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb84a84240 0x55fb84a9c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:27.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.394+0000 7fc3ce688640 1 -- 172.21.15.148:0/1223673219 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb84a84240 msgr2=0x55fb84a9c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:16:27.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.394+0000 7fc3ce688640 1 --2- 172.21.15.148:0/1223673219 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb84a84240 0x55fb84a9c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:27.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.394+0000 7fc3ce688640 1 -- 172.21.15.148:0/1223673219 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb84a79980 msgr2=0x55fb84a9bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:16:27.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.394+0000 7fc3ce688640 1 --2- 172.21.15.148:0/1223673219 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb84a79980 0x55fb84a9bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:27.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.394+0000 7fc3ce688640 1 -- 172.21.15.148:0/1223673219 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb84a73bb0 con 0x55fb84a79060 2024-09-19T07:16:27.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.394+0000 7fc3ce688640 1 --2- 172.21.15.148:0/1223673219 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb84a79060 0x55fb84a7bb10 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80095d0 tx=0x7fc3b80058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d02e51dde15faad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:16:27.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.394+0000 7fc3af7fe640 1 -- 172.21.15.148:0/1223673219 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b8035040 con 0x55fb84a79060 2024-09-19T07:16:27.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.394+0000 7fc3af7fe640 1 -- 172.21.15.148:0/1223673219 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3b8004ba0 con 0x55fb84a79060 2024-09-19T07:16:27.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.394+0000 7fc3af7fe640 1 -- 172.21.15.148:0/1223673219 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b8003e40 con 0x55fb84a79060 2024-09-19T07:16:27.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.395+0000 7fc3d24c4740 1 -- 172.21.15.148:0/1223673219 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb84a79060 msgr2=0x55fb84a7bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:27.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.395+0000 7fc3d24c4740 1 --2- 172.21.15.148:0/1223673219 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb84a79060 0x55fb84a7bb10 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80095d0 tx=0x7fc3b80058b0 comp rx=0 tx=0).stop 2024-09-19T07:16:27.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.395+0000 7fc3d24c4740 1 -- 172.21.15.148:0/1223673219 shutdown_connections 2024-09-19T07:16:27.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.395+0000 7fc3d24c4740 1 --2- 172.21.15.148:0/1223673219 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb84a84240 0x55fb84a9c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:27.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.395+0000 7fc3d24c4740 1 --2- 172.21.15.148:0/1223673219 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb84a79980 0x55fb84a9bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:27.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.395+0000 7fc3d24c4740 1 --2- 172.21.15.148:0/1223673219 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb84a79060 0x55fb84a7bb10 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:27.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.395+0000 7fc3d24c4740 1 -- 172.21.15.148:0/1223673219 >> 172.21.15.148:0/1223673219 conn(0x55fb84a755f0 msgr2=0x55fb84a831c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:16:27.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.395+0000 7fc3d24c4740 1 -- 172.21.15.148:0/1223673219 shutdown_connections 2024-09-19T07:16:27.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.395+0000 7fc3d24c4740 1 -- 172.21.15.148:0/1223673219 wait complete. 2024-09-19T07:16:27.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.395+0000 7fc3d24c4740 1 -- start start 2024-09-19T07:16:27.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.395+0000 7fc3d24c4740 1 Processor -- start 2024-09-19T07:16:27.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.396+0000 7fc3d24c4740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb84a79060 0x55fb84a88860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:27.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.396+0000 7fc3d24c4740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb84a79980 0x55fb84a88da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:27.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.396+0000 7fc3d24c4740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb84a84240 0x55fb84af7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:27.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.396+0000 7fc3d24c4740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c81ae070 con 0x55fb84a84240 2024-09-19T07:16:27.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.396+0000 7fc3d24c4740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c81af4e0 con 0x55fb84a79060 2024-09-19T07:16:27.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.396+0000 7fc3d24c4740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c81ae740 con 0x55fb84a79980 2024-09-19T07:16:27.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.396+0000 7fc3d24c4740 10 client.0 _ll_register_callbacks cb 0x7fc3bc010640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:16:27.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.396+0000 7fc3ce688640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb84a84240 0x55fb84af7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:27.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.396+0000 7fc3ce688640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb84a84240 0x55fb84af7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43202/0 (socket says 172.21.15.148:43202) 2024-09-19T07:16:27.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.396+0000 7fc3ce688640 1 -- 172.21.15.148:0/3419373598 learned_addr learned my addr 172.21.15.148:0/3419373598 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:16:27.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.396+0000 7fc3ce688640 1 --2- 172.21.15.148:0/3419373598 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb84a79060 0x55fb84a88860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:27.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.396+0000 7fc3cd686640 1 --2- 172.21.15.148:0/3419373598 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb84a79980 0x55fb84a88da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:27.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.396+0000 7fc3ce688640 1 -- 172.21.15.148:0/3419373598 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb84a79980 msgr2=0x55fb84a88da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:16:27.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.396+0000 7fc3ce688640 1 --2- 172.21.15.148:0/3419373598 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb84a79980 0x55fb84a88da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:27.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.396+0000 7fc3ce688640 1 -- 172.21.15.148:0/3419373598 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb84a79060 msgr2=0x55fb84a88860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:16:27.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.396+0000 7fc3ce688640 1 --2- 172.21.15.148:0/3419373598 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb84a79060 0x55fb84a88860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:27.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.396+0000 7fc3ce688640 1 -- 172.21.15.148:0/3419373598 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb84af8300 con 0x55fb84a84240 2024-09-19T07:16:27.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.397+0000 7fc3ce688640 1 --2- 172.21.15.148:0/3419373598 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb84a84240 0x55fb84af7cc0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8001eb0 tx=0x7fc3b802ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=947dde37551b0667 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:16:27.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.397+0000 7fc3ad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:16:27.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.397+0000 7fc3ad7fa640 1 -- 172.21.15.148:0/3419373598 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b8035030 con 0x55fb84a84240 2024-09-19T07:16:27.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.397+0000 7fc3ad7fa640 1 -- 172.21.15.148:0/3419373598 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8512+0+0 (secure 0 0 0) 0x7fc3b8005390 con 0x55fb84a84240 2024-09-19T07:16:27.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.397+0000 7fc3d24c4740 1 -- 172.21.15.148:0/3419373598 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3b8004ba0 con 0x55fb84a84240 2024-09-19T07:16:27.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.397+0000 7fc3ad7fa640 1 -- 172.21.15.148:0/3419373598 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fc3b80035f0 con 0x55fb84a84240 2024-09-19T07:16:27.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.397+0000 7fc3d24c4740 10 client.16560 fetch_fsmap learned FSMap version 35 2024-09-19T07:16:27.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.397+0000 7fc3d24c4740 1 -- 172.21.15.148:0/3419373598 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55fb84aff6d0 con 0x55fb84a84240 2024-09-19T07:16:27.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.397+0000 7fc3ad7fa640 1 -- 172.21.15.148:0/3419373598 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3b8004ba0 con 0x55fb84a84240 2024-09-19T07:16:27.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.397+0000 7fc3ad7fa640 1 -- 172.21.15.148:0/3419373598 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fc3b8031940 con 0x55fb84a84240 2024-09-19T07:16:27.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.397+0000 7fc3d24c4740 10 client.16560 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:16:27.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.397+0000 7fc3d24c4740 10 client.16560 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:16:27.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.397+0000 7fc3d24c4740 20 client.16560 populate_metadata read hostname 'smithi148' 2024-09-19T07:16:27.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.397+0000 7fc3d24c4740 1 --2- 172.21.15.148:0/3419373598 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55fb84aff900 0x55fb84b01cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:27.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.397+0000 7fc3d24c4740 4 client.16560 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "a8f55d81", "release": true, "await": true}] 2024-09-19T07:16:27.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.397+0000 7fc3d24c4740 1 -- 172.21.15.148:0/3419373598 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "quiesce db", "set_id": "a8f55d81", "release": true, "await": true}) -- 0x55fb849e60a0 con 0x55fb84aff900 2024-09-19T07:16:27.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.398+0000 7fc3cd686640 1 --2- 172.21.15.148:0/3419373598 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55fb84aff900 0x55fb84b01cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:27.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.398+0000 7fc3cd686640 1 --2- 172.21.15.148:0/3419373598 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55fb84aff900 0x55fb84b01cf0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29776cf99949da74 server_cookie=bae9fa4e42bb531c in_seq=0 out_seq=0 2024-09-19T07:16:27.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:27.398+0000 7fc3ad7fa640 10 client.16560 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:16:27.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:16:27 smithi179 ceph-mon[35716]: pgmap v165: 97 pgs: 97 active+clean; 913 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 1.4 MiB/s wr, 815 op/s 2024-09-19T07:16:28.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:28.183+0000 7fc3ad7fa640 1 -- 172.21.15.148:0/3419373598 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55fb849e60a0 con 0x55fb84aff900 2024-09-19T07:16:28.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:28.183+0000 7fc3ad7fa640 10 client.16560 handle_command_reply: tid=0 2024-09-19T07:16:28.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:28.183+0000 7fc3d24c4740 1 client.16560 shutdown 2024-09-19T07:16:28.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:28.183+0000 7fc3d24c4740 1 -- 172.21.15.148:0/3419373598 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb84a84240 msgr2=0x55fb84af7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:28.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:28.183+0000 7fc3d24c4740 1 --2- 172.21.15.148:0/3419373598 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb84a84240 0x55fb84af7cc0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8001eb0 tx=0x7fc3b802ac00 comp rx=0 tx=0).stop 2024-09-19T07:16:28.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:28.183+0000 7fc3d24c4740 1 -- 172.21.15.148:0/3419373598 shutdown_connections 2024-09-19T07:16:28.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:28.183+0000 7fc3d24c4740 1 --2- 172.21.15.148:0/3419373598 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55fb84aff900 0x55fb84b01cf0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:28.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:28.183+0000 7fc3d24c4740 1 --2- 172.21.15.148:0/3419373598 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb84a84240 0x55fb84af7cc0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:28.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:28.183+0000 7fc3d24c4740 1 --2- 172.21.15.148:0/3419373598 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb84a79980 0x55fb84a88da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:28.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:28.183+0000 7fc3d24c4740 1 --2- 172.21.15.148:0/3419373598 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb84a79060 0x55fb84a88860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:28.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:28.183+0000 7fc3d24c4740 1 -- 172.21.15.148:0/3419373598 >> 172.21.15.148:0/3419373598 conn(0x55fb84a755f0 msgr2=0x55fb84a74750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:16:28.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:28.183+0000 7fc3ad7fa640 0 client.16560 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:16:28.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:28.183+0000 7fc3d24c4740 1 -- 172.21.15.148:0/3419373598 shutdown_connections 2024-09-19T07:16:28.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:28.183+0000 7fc3d24c4740 1 -- 172.21.15.148:0/3419373598 wait complete. 2024-09-19T07:16:28.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:28.183+0000 7fc3d24c4740 20 client.16560 trim_cache size 0 max 16384 2024-09-19T07:16:28.186 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:16:28.186 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 35, 2024-09-19T07:16:28.186 INFO:teuthology.orchestra.run.smithi148.stdout: "leader": 24457, 2024-09-19T07:16:28.186 INFO:teuthology.orchestra.run.smithi148.stdout: "set_version": 24, 2024-09-19T07:16:28.186 INFO:teuthology.orchestra.run.smithi148.stdout: "sets": { 2024-09-19T07:16:28.186 INFO:teuthology.orchestra.run.smithi148.stdout: "a8f55d81": { 2024-09-19T07:16:28.186 INFO:teuthology.orchestra.run.smithi148.stdout: "version": 24, 2024-09-19T07:16:28.186 INFO:teuthology.orchestra.run.smithi148.stdout: "age_ref": 0.0, 2024-09-19T07:16:28.186 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:16:28.187 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RELEASED", 2024-09-19T07:16:28.187 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:16:28.187 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:16:28.187 INFO:teuthology.orchestra.run.smithi148.stdout: "timeout": 90.0, 2024-09-19T07:16:28.187 INFO:teuthology.orchestra.run.smithi148.stdout: "expiration": 149.8, 2024-09-19T07:16:28.187 INFO:teuthology.orchestra.run.smithi148.stdout: "members": { 2024-09-19T07:16:28.187 INFO:teuthology.orchestra.run.smithi148.stdout: "file:/": { 2024-09-19T07:16:28.187 INFO:teuthology.orchestra.run.smithi148.stdout: "excluded": false, 2024-09-19T07:16:28.187 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:16:28.187 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RELEASED", 2024-09-19T07:16:28.187 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:16:28.187 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:16:28.187 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:16:28.187 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:16:28.188 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:16:28.188 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:16:28.188 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:16:28.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:28.184+0000 7fc3d00eb640 1 -- 172.21.15.148:0/3350924572 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc3b00a33b0 msgr2=0x7fc3b00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:28.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:28.184+0000 7fc3d00eb640 1 --2- 172.21.15.148:0/3350924572 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc3b00a33b0 0x7fc3b00a5870 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x55fb84a76450 tx=0x7fc3c0086040 comp rx=0 tx=0).stop 2024-09-19T07:16:28.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:28.184+0000 7fc3d00eb640 1 -- 172.21.15.148:0/3350924572 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3c8100e20 msgr2=0x7fc3c810e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:28.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:28.184+0000 7fc3d00eb640 1 --2- 172.21.15.148:0/3350924572 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3c8100e20 0x7fc3c810e4d0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fc3c000d950 tx=0x7fc3c000de10 comp rx=0 tx=0).stop 2024-09-19T07:16:28.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:28.184+0000 7fc3d00eb640 1 -- 172.21.15.148:0/3350924572 shutdown_connections 2024-09-19T07:16:28.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:28.184+0000 7fc3d00eb640 1 --2- 172.21.15.148:0/3350924572 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc3b00a33b0 0x7fc3b00a5870 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:28.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:28.184+0000 7fc3d00eb640 1 --2- 172.21.15.148:0/3350924572 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3c8102ef0 0x7fc3c810ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:28.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:28.184+0000 7fc3d00eb640 1 --2- 172.21.15.148:0/3350924572 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3c8102570 0x7fc3c810ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:28.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:28.184+0000 7fc3d00eb640 1 --2- 172.21.15.148:0/3350924572 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3c8100e20 0x7fc3c810e4d0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:28.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:28.184+0000 7fc3d00eb640 1 -- 172.21.15.148:0/3350924572 >> 172.21.15.148:0/3350924572 conn(0x7fc3c80fc7d0 msgr2=0x7fc3c8105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:16:28.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:28.184+0000 7fc3d00eb640 1 -- 172.21.15.148:0/3350924572 shutdown_connections 2024-09-19T07:16:28.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:16:28.184+0000 7fc3d00eb640 1 -- 172.21.15.148:0/3350924572 wait complete. 2024-09-19T07:16:28.576 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.574+0000 7f2a58665640 1 -- 172.21.15.148:0/4061044920 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a50101ad0 msgr2=0x7f2a50101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:28.576 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.574+0000 7f2a58665640 1 --2- 172.21.15.148:0/4061044920 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a50101ad0 0x7f2a50101f30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2a40009930 tx=0x7f2a4002a420 comp rx=0 tx=0).stop 2024-09-19T07:16:28.576 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.574+0000 7f2a58665640 1 -- 172.21.15.148:0/4061044920 shutdown_connections 2024-09-19T07:16:28.576 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.574+0000 7f2a58665640 1 --2- 172.21.15.148:0/4061044920 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a50102470 0x7f2a5010e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:28.576 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.575+0000 7f2a58665640 1 --2- 172.21.15.148:0/4061044920 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a50101ad0 0x7f2a50101f30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:28.576 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.575+0000 7f2a58665640 1 --2- 172.21.15.148:0/4061044920 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a50107b70 0x7f2a50107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:28.576 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.575+0000 7f2a58665640 1 -- 172.21.15.148:0/4061044920 >> 172.21.15.148:0/4061044920 conn(0x7f2a500fd7d0 msgr2=0x7f2a500ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:16:28.576 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.575+0000 7f2a58665640 1 -- 172.21.15.148:0/4061044920 shutdown_connections 2024-09-19T07:16:28.576 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.575+0000 7f2a58665640 1 -- 172.21.15.148:0/4061044920 wait complete. 2024-09-19T07:16:28.578 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.575+0000 7f2a58665640 1 Processor -- start 2024-09-19T07:16:28.578 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.575+0000 7f2a58665640 1 -- start start 2024-09-19T07:16:28.578 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.576+0000 7f2a58665640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a50101ad0 0x7f2a50198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:28.579 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.576+0000 7f2a58665640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a50102470 0x7f2a501988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:28.579 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.576+0000 7f2a58665640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a50107b70 0x7f2a5019cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:28.579 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.576+0000 7f2a58665640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2a50111f20 con 0x7f2a50101ad0 2024-09-19T07:16:28.579 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.576+0000 7f2a58665640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2a50111da0 con 0x7f2a50107b70 2024-09-19T07:16:28.579 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.576+0000 7f2a58665640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2a501120a0 con 0x7f2a50102470 2024-09-19T07:16:28.579 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.576+0000 7f2a56401640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a50101ad0 0x7f2a50198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:28.579 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.576+0000 7f2a56401640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a50101ad0 0x7f2a50198390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43228/0 (socket says 172.21.15.148:43228) 2024-09-19T07:16:28.579 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.576+0000 7f2a56401640 1 -- 172.21.15.148:0/1961606898 learned_addr learned my addr 172.21.15.148:0/1961606898 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:16:28.579 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.576+0000 7f2a55c00640 1 --2- 172.21.15.148:0/1961606898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a50102470 0x7f2a501988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:28.579 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.576+0000 7f2a56c02640 1 --2- 172.21.15.148:0/1961606898 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a50107b70 0x7f2a5019cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:28.579 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.576+0000 7f2a55c00640 1 -- 172.21.15.148:0/1961606898 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a50107b70 msgr2=0x7f2a5019cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:28.579 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.576+0000 7f2a55c00640 1 --2- 172.21.15.148:0/1961606898 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a50107b70 0x7f2a5019cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:28.579 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.576+0000 7f2a55c00640 1 -- 172.21.15.148:0/1961606898 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a50101ad0 msgr2=0x7f2a50198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:28.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.576+0000 7f2a55c00640 1 --2- 172.21.15.148:0/1961606898 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a50101ad0 0x7f2a50198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:28.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.576+0000 7f2a55c00640 1 -- 172.21.15.148:0/1961606898 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a5019d380 con 0x7f2a50102470 2024-09-19T07:16:28.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.576+0000 7f2a56401640 1 --2- 172.21.15.148:0/1961606898 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a50101ad0 0x7f2a50198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:16:28.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.576+0000 7f2a55c00640 1 --2- 172.21.15.148:0/1961606898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a50102470 0x7f2a501988d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2a40005940 tx=0x7f2a40031b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:16:28.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.577+0000 7f2a477fe640 1 -- 172.21.15.148:0/1961606898 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a4003f070 con 0x7f2a50102470 2024-09-19T07:16:28.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.577+0000 7f2a477fe640 1 -- 172.21.15.148:0/1961606898 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a40003ad0 con 0x7f2a50102470 2024-09-19T07:16:28.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.577+0000 7f2a58665640 1 -- 172.21.15.148:0/1961606898 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a5019d610 con 0x7f2a50102470 2024-09-19T07:16:28.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.577+0000 7f2a477fe640 1 -- 172.21.15.148:0/1961606898 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a40035070 con 0x7f2a50102470 2024-09-19T07:16:28.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.577+0000 7f2a58665640 1 -- 172.21.15.148:0/1961606898 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a501a4f00 con 0x7f2a50102470 2024-09-19T07:16:28.582 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.579+0000 7f2a477fe640 1 -- 172.21.15.148:0/1961606898 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f2a400035f0 con 0x7f2a50102470 2024-09-19T07:16:28.582 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.580+0000 7f2a5b402740 1 Processor -- start 2024-09-19T07:16:28.582 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.580+0000 7f2a5b402740 1 -- start start 2024-09-19T07:16:28.582 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.580+0000 7f2a5b402740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b9b72ddaf0 0x55b9b72dded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:28.582 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.580+0000 7f2a477fe640 1 --2- 172.21.15.148:0/1961606898 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f2a3c0a34e0 0x7f2a3c0a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:28.582 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.580+0000 7f2a5b402740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b9b72de410 0x55b9b72e8770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:28.582 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.580+0000 7f2a5b402740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b9b72e8cb0 0x55b9b72eb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:28.583 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.580+0000 7f2a5b402740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55b9b72422f0 con 0x55b9b72e8cb0 2024-09-19T07:16:28.583 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.580+0000 7f2a5b402740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55b9b71ea270 con 0x55b9b72ddaf0 2024-09-19T07:16:28.583 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.580+0000 7f2a5b402740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55b9b723e2b0 con 0x55b9b72de410 2024-09-19T07:16:28.583 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.580+0000 7f2a56c02640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b9b72ddaf0 0x55b9b72dded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:28.583 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.580+0000 7f2a56401640 1 --2- 172.21.15.148:0/1961606898 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f2a3c0a34e0 0x7f2a3c0a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:28.583 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.580+0000 7f2a56c02640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b9b72ddaf0 0x55b9b72dded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:44380/0 (socket says 172.21.15.148:44380) 2024-09-19T07:16:28.583 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.580+0000 7f2a55c00640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b9b72de410 0x55b9b72e8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:28.583 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.580+0000 7f2a56c02640 1 -- 172.21.15.148:0/3015683223 learned_addr learned my addr 172.21.15.148:0/3015683223 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:16:28.583 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.580+0000 7f2a56c02640 1 --2- 172.21.15.148:0/3015683223 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b9b72e8cb0 0x55b9b72eb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:28.583 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.580+0000 7f2a477fe640 1 -- 172.21.15.148:0/1961606898 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8512+0+0 (secure 0 0 0) 0x7f2a400f0060 con 0x7f2a50102470 2024-09-19T07:16:28.583 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.581+0000 7f2a56c02640 1 -- 172.21.15.148:0/3015683223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b9b72de410 msgr2=0x55b9b72e8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:16:28.583 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.581+0000 7f2a56c02640 1 --2- 172.21.15.148:0/3015683223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b9b72de410 0x55b9b72e8770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:28.583 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.581+0000 7f2a56c02640 1 -- 172.21.15.148:0/3015683223 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b9b72e8cb0 msgr2=0x55b9b72eb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:16:28.584 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.581+0000 7f2a56c02640 1 --2- 172.21.15.148:0/3015683223 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b9b72e8cb0 0x55b9b72eb0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:28.584 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.581+0000 7f2a56c02640 1 -- 172.21.15.148:0/3015683223 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9b71e9340 con 0x55b9b72ddaf0 2024-09-19T07:16:28.584 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.581+0000 7f2a56401640 1 --2- 172.21.15.148:0/1961606898 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f2a3c0a34e0 0x7f2a3c0a59a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c011490 tx=0x7f2a4c005f90 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:16:28.584 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.581+0000 7f2a56c02640 1 --2- 172.21.15.148:0/3015683223 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b9b72ddaf0 0x55b9b72dded0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2a48005f40 tx=0x7f2a48009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bcdfbe5d1719ae75 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:16:28.584 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.581+0000 7f2a44bfe640 1 -- 172.21.15.148:0/3015683223 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a48011070 con 0x55b9b72ddaf0 2024-09-19T07:16:28.584 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.581+0000 7f2a44bfe640 1 -- 172.21.15.148:0/3015683223 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a48003e50 con 0x55b9b72ddaf0 2024-09-19T07:16:28.584 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.581+0000 7f2a44bfe640 1 -- 172.21.15.148:0/3015683223 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a48004270 con 0x55b9b72ddaf0 2024-09-19T07:16:28.589 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.582+0000 7f2a5b402740 1 -- 172.21.15.148:0/3015683223 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b9b72ddaf0 msgr2=0x55b9b72dded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:28.589 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.582+0000 7f2a5b402740 1 --2- 172.21.15.148:0/3015683223 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b9b72ddaf0 0x55b9b72dded0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2a48005f40 tx=0x7f2a48009b80 comp rx=0 tx=0).stop 2024-09-19T07:16:28.589 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.582+0000 7f2a5b402740 1 -- 172.21.15.148:0/3015683223 shutdown_connections 2024-09-19T07:16:28.589 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.582+0000 7f2a5b402740 1 --2- 172.21.15.148:0/3015683223 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b9b72e8cb0 0x55b9b72eb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:28.589 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.582+0000 7f2a5b402740 1 --2- 172.21.15.148:0/3015683223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b9b72de410 0x55b9b72e8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:28.589 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.582+0000 7f2a5b402740 1 --2- 172.21.15.148:0/3015683223 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b9b72ddaf0 0x55b9b72dded0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:28.589 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.582+0000 7f2a5b402740 1 -- 172.21.15.148:0/3015683223 >> 172.21.15.148:0/3015683223 conn(0x55b9b72da060 msgr2=0x55b9b72da440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:16:28.589 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.582+0000 7f2a5b402740 1 -- 172.21.15.148:0/3015683223 shutdown_connections 2024-09-19T07:16:28.589 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.582+0000 7f2a5b402740 1 -- 172.21.15.148:0/3015683223 wait complete. 2024-09-19T07:16:28.589 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.582+0000 7f2a5b402740 1 -- start start 2024-09-19T07:16:28.589 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.583+0000 7f2a5b402740 1 Processor -- start 2024-09-19T07:16:28.590 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.583+0000 7f2a5b402740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b9b72ddaf0 0x55b9b72e5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:28.590 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.583+0000 7f2a5b402740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b9b72de410 0x55b9b72e6080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:28.590 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.583+0000 7f2a5b402740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b9b72e8cb0 0x55b9b72e65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:28.590 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.583+0000 7f2a5b402740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55b9b72eb880 con 0x55b9b72ddaf0 2024-09-19T07:16:28.590 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.583+0000 7f2a5b402740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55b9b71cb290 con 0x55b9b72e8cb0 2024-09-19T07:16:28.590 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.583+0000 7f2a5b402740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55b9b72eba00 con 0x55b9b72de410 2024-09-19T07:16:28.590 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.583+0000 7f2a5b402740 10 client.0 _ll_register_callbacks cb 0x55b9b71fc140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:16:28.590 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.583+0000 7f2a56401640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b9b72ddaf0 0x55b9b72e5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:28.590 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.583+0000 7f2a56401640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b9b72ddaf0 0x55b9b72e5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43252/0 (socket says 172.21.15.148:43252) 2024-09-19T07:16:28.590 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.583+0000 7f2a56401640 1 -- 172.21.15.148:0/88933095 learned_addr learned my addr 172.21.15.148:0/88933095 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:16:28.590 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.583+0000 7f2a56c02640 1 --2- 172.21.15.148:0/88933095 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b9b72e8cb0 0x55b9b72e65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:28.590 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.583+0000 7f2a55c00640 1 --2- 172.21.15.148:0/88933095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b9b72de410 0x55b9b72e6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:28.590 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.583+0000 7f2a56401640 1 -- 172.21.15.148:0/88933095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b9b72de410 msgr2=0x55b9b72e6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:16:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.583+0000 7f2a56401640 1 --2- 172.21.15.148:0/88933095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b9b72de410 0x55b9b72e6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.583+0000 7f2a56401640 1 -- 172.21.15.148:0/88933095 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b9b72e8cb0 msgr2=0x55b9b72e65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:16:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.583+0000 7f2a56401640 1 --2- 172.21.15.148:0/88933095 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b9b72e8cb0 0x55b9b72e65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.583+0000 7f2a56401640 1 -- 172.21.15.148:0/88933095 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9b6f55210 con 0x55b9b72ddaf0 2024-09-19T07:16:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.583+0000 7f2a56c02640 1 --2- 172.21.15.148:0/88933095 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b9b72e8cb0 0x55b9b72e65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:16:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.583+0000 7f2a56401640 1 --2- 172.21.15.148:0/88933095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b9b72ddaf0 0x55b9b72e5b40 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c00fcd0 tx=0x7f2a4c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d92279a76853acc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:16:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.583+0000 7f2a39ffb640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:16:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.584+0000 7f2a39ffb640 1 -- 172.21.15.148:0/88933095 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c01ce60 con 0x55b9b72ddaf0 2024-09-19T07:16:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.584+0000 7f2a5b402740 1 -- 172.21.15.148:0/88933095 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a48003e50 con 0x55b9b72ddaf0 2024-09-19T07:16:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.584+0000 7f2a39ffb640 1 -- 172.21.15.148:0/88933095 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8512+0+0 (secure 0 0 0) 0x7f2a4c0265f0 con 0x55b9b72ddaf0 2024-09-19T07:16:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.584+0000 7f2a39ffb640 1 -- 172.21.15.148:0/88933095 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f2a4c0267f0 con 0x55b9b72ddaf0 2024-09-19T07:16:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.584+0000 7f2a5b402740 10 client.16572 fetch_fsmap learned FSMap version 35 2024-09-19T07:16:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.584+0000 7f2a5b402740 1 -- 172.21.15.148:0/88933095 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55b9b7021620 con 0x55b9b72ddaf0 2024-09-19T07:16:28.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.584+0000 7f2a39ffb640 1 -- 172.21.15.148:0/88933095 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a48003e50 con 0x55b9b72ddaf0 2024-09-19T07:16:28.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.584+0000 7f2a39ffb640 1 -- 172.21.15.148:0/88933095 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f2a4c02fc50 con 0x55b9b72ddaf0 2024-09-19T07:16:28.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.584+0000 7f2a5b402740 10 client.16572 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:16:28.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.584+0000 7f2a5b402740 10 client.16572 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:16:28.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.584+0000 7f2a5b402740 20 client.16572 populate_metadata read hostname 'smithi148' 2024-09-19T07:16:28.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.584+0000 7f2a5b402740 1 --2- 172.21.15.148:0/88933095 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55b9b72f8c50 0x55b9b72fb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:28.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.584+0000 7f2a5b402740 4 client.16572 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:16:28.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.584+0000 7f2a5b402740 1 -- 172.21.15.148:0/88933095 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b9b724fa20 con 0x55b9b72f8c50 2024-09-19T07:16:28.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.584+0000 7f2a55c00640 1 --2- 172.21.15.148:0/88933095 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55b9b72f8c50 0x55b9b72fb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:28.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.585+0000 7f2a39ffb640 10 client.16572 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:16:28.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.585+0000 7f2a55c00640 1 --2- 172.21.15.148:0/88933095 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55b9b72f8c50 0x55b9b72fb080 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8770393093b6affd server_cookie=a4217de6951e0dad in_seq=0 out_seq=0 2024-09-19T07:16:28.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.586+0000 7f2a39ffb640 1 -- 172.21.15.148:0/88933095 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b9b724fa20 con 0x55b9b72f8c50 2024-09-19T07:16:28.593 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.586+0000 7f2a39ffb640 10 client.16572 handle_command_reply: tid=0 2024-09-19T07:16:28.593 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.586+0000 7f2a5b402740 1 client.16572 shutdown 2024-09-19T07:16:28.593 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.586+0000 7f2a5b402740 1 -- 172.21.15.148:0/88933095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b9b72ddaf0 msgr2=0x55b9b72e5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:28.593 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.586+0000 7f2a5b402740 1 --2- 172.21.15.148:0/88933095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b9b72ddaf0 0x55b9b72e5b40 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c00fcd0 tx=0x7f2a4c004730 comp rx=0 tx=0).stop 2024-09-19T07:16:28.593 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.586+0000 7f2a5b402740 1 -- 172.21.15.148:0/88933095 shutdown_connections 2024-09-19T07:16:28.593 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.586+0000 7f2a5b402740 1 --2- 172.21.15.148:0/88933095 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55b9b72f8c50 0x55b9b72fb080 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:28.593 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.586+0000 7f2a5b402740 1 --2- 172.21.15.148:0/88933095 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b9b72e8cb0 0x55b9b72e65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:28.593 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.586+0000 7f2a5b402740 1 --2- 172.21.15.148:0/88933095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b9b72de410 0x55b9b72e6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:28.593 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.586+0000 7f2a39ffb640 0 client.16572 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:16:28.593 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.586+0000 7f2a5b402740 1 --2- 172.21.15.148:0/88933095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b9b72ddaf0 0x55b9b72e5b40 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:28.593 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.586+0000 7f2a5b402740 1 -- 172.21.15.148:0/88933095 >> 172.21.15.148:0/88933095 conn(0x55b9b72da060 msgr2=0x55b9b72dfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:16:28.593 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.586+0000 7f2a5b402740 1 -- 172.21.15.148:0/88933095 shutdown_connections 2024-09-19T07:16:28.594 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.586+0000 7f2a5b402740 1 -- 172.21.15.148:0/88933095 wait complete. 2024-09-19T07:16:28.594 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.586+0000 7f2a5b402740 20 client.16572 trim_cache size 0 max 16384 2024-09-19T07:16:28.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.603+0000 7f2a5b402740 1 Processor -- start 2024-09-19T07:16:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.603+0000 7f2a5b402740 1 -- start start 2024-09-19T07:16:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.603+0000 7f2a5b402740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b9b72ddaf0 0x55b9b72e63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.603+0000 7f2a5b402740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b9b72de410 0x55b9b7300990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.603+0000 7f2a5b402740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b9b72e8cb0 0x55b9b7300ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.603+0000 7f2a5b402740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2a501adee0 con 0x55b9b72de410 2024-09-19T07:16:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.603+0000 7f2a5b402740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2a501ab750 con 0x55b9b72ddaf0 2024-09-19T07:16:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.603+0000 7f2a5b402740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2a501a9580 con 0x55b9b72e8cb0 2024-09-19T07:16:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.603+0000 7f2a55c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b9b72de410 0x55b9b7300990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.603+0000 7f2a55c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b9b72de410 0x55b9b7300990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43268/0 (socket says 172.21.15.148:43268) 2024-09-19T07:16:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.603+0000 7f2a55c00640 1 -- 172.21.15.148:0/693211993 learned_addr learned my addr 172.21.15.148:0/693211993 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:16:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.603+0000 7f2a56401640 1 --2- 172.21.15.148:0/693211993 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b9b72ddaf0 0x55b9b72e63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:28.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.603+0000 7f2a56c02640 1 --2- 172.21.15.148:0/693211993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b9b72e8cb0 0x55b9b7300ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:28.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.603+0000 7f2a55c00640 1 -- 172.21.15.148:0/693211993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b9b72e8cb0 msgr2=0x55b9b7300ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:16:28.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.603+0000 7f2a55c00640 1 --2- 172.21.15.148:0/693211993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b9b72e8cb0 0x55b9b7300ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:28.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.603+0000 7f2a55c00640 1 -- 172.21.15.148:0/693211993 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b9b72ddaf0 msgr2=0x55b9b72e63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:16:28.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.603+0000 7f2a55c00640 1 --2- 172.21.15.148:0/693211993 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b9b72ddaf0 0x55b9b72e63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:28.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.603+0000 7f2a55c00640 1 -- 172.21.15.148:0/693211993 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9b72de240 con 0x55b9b72de410 2024-09-19T07:16:28.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.603+0000 7f2a56401640 1 --2- 172.21.15.148:0/693211993 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b9b72ddaf0 0x55b9b72e63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:16:28.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.603+0000 7f2a55c00640 1 --2- 172.21.15.148:0/693211993 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b9b72de410 0x55b9b7300990 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f2a400ed820 tx=0x7f2a400daf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=542c5e4b0916899 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:16:28.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.604+0000 7f2a3bfff640 1 -- 172.21.15.148:0/693211993 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a40048040 con 0x55b9b72de410 2024-09-19T07:16:28.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.604+0000 7f2a3bfff640 1 -- 172.21.15.148:0/693211993 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a400c0700 con 0x55b9b72de410 2024-09-19T07:16:28.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.604+0000 7f2a3bfff640 1 -- 172.21.15.148:0/693211993 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a40003da0 con 0x55b9b72de410 2024-09-19T07:16:28.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.604+0000 7f2a5b402740 1 -- 172.21.15.148:0/693211993 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b9b72de410 msgr2=0x55b9b7300990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:28.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.604+0000 7f2a5b402740 1 --2- 172.21.15.148:0/693211993 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b9b72de410 0x55b9b7300990 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f2a400ed820 tx=0x7f2a400daf90 comp rx=0 tx=0).stop 2024-09-19T07:16:28.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.604+0000 7f2a5b402740 1 -- 172.21.15.148:0/693211993 shutdown_connections 2024-09-19T07:16:28.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.605+0000 7f2a5b402740 1 --2- 172.21.15.148:0/693211993 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b9b72e8cb0 0x55b9b7300ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:28.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.605+0000 7f2a5b402740 1 --2- 172.21.15.148:0/693211993 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b9b72de410 0x55b9b7300990 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:28.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.605+0000 7f2a5b402740 1 --2- 172.21.15.148:0/693211993 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b9b72ddaf0 0x55b9b72e63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:28.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.605+0000 7f2a5b402740 1 -- 172.21.15.148:0/693211993 >> 172.21.15.148:0/693211993 conn(0x55b9b72da060 msgr2=0x55b9b72e7bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:16:28.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.605+0000 7f2a5b402740 1 -- 172.21.15.148:0/693211993 shutdown_connections 2024-09-19T07:16:28.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.605+0000 7f2a5b402740 1 -- 172.21.15.148:0/693211993 wait complete. 2024-09-19T07:16:28.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.605+0000 7f2a5b402740 1 -- start start 2024-09-19T07:16:28.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.605+0000 7f2a5b402740 1 Processor -- start 2024-09-19T07:16:28.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.605+0000 7f2a5b402740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b9b72ddaf0 0x55b9b72f1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:28.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.605+0000 7f2a5b402740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b9b72de410 0x55b9b72f1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:28.611 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.605+0000 7f2a5b402740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b9b72e8cb0 0x55b9b72e26d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:28.611 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.605+0000 7f2a5b402740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2a501a9c10 con 0x55b9b72de410 2024-09-19T07:16:28.611 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.605+0000 7f2a5b402740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2a501ab080 con 0x55b9b72ddaf0 2024-09-19T07:16:28.611 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.605+0000 7f2a5b402740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2a501aa2e0 con 0x55b9b72e8cb0 2024-09-19T07:16:28.611 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.605+0000 7f2a5b402740 10 client.0 _ll_register_callbacks cb 0x7f2a4c009e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:16:28.611 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.605+0000 7f2a55c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b9b72de410 0x55b9b72f1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:28.611 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.605+0000 7f2a56401640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b9b72ddaf0 0x55b9b72f1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:28.611 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.605+0000 7f2a56c02640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b9b72e8cb0 0x55b9b72e26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:28.611 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.605+0000 7f2a55c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b9b72de410 0x55b9b72f1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43270/0 (socket says 172.21.15.148:43270) 2024-09-19T07:16:28.611 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.605+0000 7f2a55c00640 1 -- 172.21.15.148:0/114697440 learned_addr learned my addr 172.21.15.148:0/114697440 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:16:28.611 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.606+0000 7f2a55c00640 1 -- 172.21.15.148:0/114697440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b9b72e8cb0 msgr2=0x55b9b72e26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:16:28.611 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.606+0000 7f2a55c00640 1 --2- 172.21.15.148:0/114697440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b9b72e8cb0 0x55b9b72e26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:28.611 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.606+0000 7f2a55c00640 1 -- 172.21.15.148:0/114697440 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b9b72ddaf0 msgr2=0x55b9b72f1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:16:28.612 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.606+0000 7f2a55c00640 1 --2- 172.21.15.148:0/114697440 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b9b72ddaf0 0x55b9b72f1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:28.612 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.606+0000 7f2a55c00640 1 -- 172.21.15.148:0/114697440 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9b72e2f00 con 0x55b9b72de410 2024-09-19T07:16:28.612 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.606+0000 7f2a56401640 1 --2- 172.21.15.148:0/114697440 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b9b72ddaf0 0x55b9b72f1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:16:28.612 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.606+0000 7f2a55c00640 1 --2- 172.21.15.148:0/114697440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b9b72de410 0x55b9b72f1570 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f2a400b8860 tx=0x7f2a4002a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a934804c46d6b4b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:16:28.612 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.606+0000 7f2a39ffb640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:16:28.612 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.606+0000 7f2a39ffb640 1 -- 172.21.15.148:0/114697440 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a400cd020 con 0x55b9b72de410 2024-09-19T07:16:28.612 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.606+0000 7f2a39ffb640 1 -- 172.21.15.148:0/114697440 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8512+0+0 (secure 0 0 0) 0x7f2a400b8a70 con 0x55b9b72de410 2024-09-19T07:16:28.612 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.606+0000 7f2a5b402740 1 -- 172.21.15.148:0/114697440 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a400c0700 con 0x55b9b72de410 2024-09-19T07:16:28.612 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.606+0000 7f2a39ffb640 1 -- 172.21.15.148:0/114697440 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f2a40048070 con 0x55b9b72de410 2024-09-19T07:16:28.612 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.606+0000 7f2a5b402740 10 client.16578 fetch_fsmap learned FSMap version 35 2024-09-19T07:16:28.612 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.606+0000 7f2a5b402740 1 -- 172.21.15.148:0/114697440 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55b9b7363640 con 0x55b9b72de410 2024-09-19T07:16:28.612 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.606+0000 7f2a39ffb640 1 -- 172.21.15.148:0/114697440 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a400c0700 con 0x55b9b72de410 2024-09-19T07:16:28.612 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.607+0000 7f2a39ffb640 1 -- 172.21.15.148:0/114697440 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f2a4004b060 con 0x55b9b72de410 2024-09-19T07:16:28.613 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.607+0000 7f2a5b402740 10 client.16578 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:16:28.613 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.607+0000 7f2a5b402740 10 client.16578 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:16:28.613 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.607+0000 7f2a5b402740 20 client.16578 populate_metadata read hostname 'smithi148' 2024-09-19T07:16:28.613 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.607+0000 7f2a5b402740 1 --2- 172.21.15.148:0/114697440 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55b9b7363ba0 0x55b9b7365fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:28.613 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.607+0000 7f2a5b402740 4 client.16578 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:16:28.613 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.607+0000 7f2a5b402740 1 -- 172.21.15.148:0/114697440 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b9b7249d70 con 0x55b9b7363ba0 2024-09-19T07:16:28.613 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.607+0000 7f2a56401640 1 --2- 172.21.15.148:0/114697440 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55b9b7363ba0 0x55b9b7365fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:28.613 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.607+0000 7f2a39ffb640 10 client.16578 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:16:28.613 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:28.607+0000 7f2a56401640 1 --2- 172.21.15.148:0/114697440 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55b9b7363ba0 0x55b9b7365fc0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33cc68ba92ae6dd7 server_cookie=8fa36db826653e11 in_seq=0 out_seq=0 2024-09-19T07:16:29.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:29.042+0000 7f2a39ffb640 1 -- 172.21.15.148:0/114697440 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b9b7249d70 con 0x55b9b7363ba0 2024-09-19T07:16:29.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:29.042+0000 7f2a39ffb640 10 client.16578 handle_command_reply: tid=0 2024-09-19T07:16:29.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:29.042+0000 7f2a5b402740 1 client.16578 shutdown 2024-09-19T07:16:29.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:29.043+0000 7f2a5b402740 1 -- 172.21.15.148:0/114697440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b9b72de410 msgr2=0x55b9b72f1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:29.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:29.043+0000 7f2a5b402740 1 --2- 172.21.15.148:0/114697440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b9b72de410 0x55b9b72f1570 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f2a400b8860 tx=0x7f2a4002a420 comp rx=0 tx=0).stop 2024-09-19T07:16:29.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:29.043+0000 7f2a5b402740 1 -- 172.21.15.148:0/114697440 shutdown_connections 2024-09-19T07:16:29.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:29.043+0000 7f2a5b402740 1 --2- 172.21.15.148:0/114697440 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55b9b7363ba0 0x55b9b7365fc0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:29.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:29.043+0000 7f2a5b402740 1 --2- 172.21.15.148:0/114697440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b9b72e8cb0 0x55b9b72e26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:29.045 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:29.043+0000 7f2a5b402740 1 --2- 172.21.15.148:0/114697440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b9b72de410 0x55b9b72f1570 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:29.045 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:29.043+0000 7f2a5b402740 1 --2- 172.21.15.148:0/114697440 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b9b72ddaf0 0x55b9b72f1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:29.045 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:29.043+0000 7f2a5b402740 1 -- 172.21.15.148:0/114697440 >> 172.21.15.148:0/114697440 conn(0x55b9b72da060 msgr2=0x55b9b72d89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:16:29.045 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:29.043+0000 7f2a39ffb640 0 client.16578 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:16:29.045 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:29.043+0000 7f2a5b402740 1 -- 172.21.15.148:0/114697440 shutdown_connections 2024-09-19T07:16:29.045 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:29.043+0000 7f2a5b402740 1 -- 172.21.15.148:0/114697440 wait complete. 2024-09-19T07:16:29.045 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:29.043+0000 7f2a5b402740 20 client.16578 trim_cache size 0 max 16384 2024-09-19T07:16:29.045 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:16:29.045 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:16:29.045 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:16:29.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:16:29.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:29.044+0000 7f2a58665640 1 -- 172.21.15.148:0/1961606898 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f2a3c0a34e0 msgr2=0x7f2a3c0a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:29.047 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:29.044+0000 7f2a58665640 1 --2- 172.21.15.148:0/1961606898 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f2a3c0a34e0 0x7f2a3c0a59a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c011490 tx=0x7f2a4c005f90 comp rx=0 tx=0).stop 2024-09-19T07:16:29.047 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:29.044+0000 7f2a58665640 1 -- 172.21.15.148:0/1961606898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a50102470 msgr2=0x7f2a501988d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:29.047 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:29.044+0000 7f2a58665640 1 --2- 172.21.15.148:0/1961606898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a50102470 0x7f2a501988d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2a40005940 tx=0x7f2a40031b50 comp rx=0 tx=0).stop 2024-09-19T07:16:29.047 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:29.044+0000 7f2a58665640 1 -- 172.21.15.148:0/1961606898 shutdown_connections 2024-09-19T07:16:29.047 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:29.044+0000 7f2a58665640 1 --2- 172.21.15.148:0/1961606898 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f2a3c0a34e0 0x7f2a3c0a59a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:29.047 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:29.044+0000 7f2a58665640 1 --2- 172.21.15.148:0/1961606898 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a50107b70 0x7f2a5019cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:29.047 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:29.044+0000 7f2a58665640 1 --2- 172.21.15.148:0/1961606898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a50102470 0x7f2a501988d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:29.047 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:29.044+0000 7f2a58665640 1 --2- 172.21.15.148:0/1961606898 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a50101ad0 0x7f2a50198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:29.047 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:29.044+0000 7f2a58665640 1 -- 172.21.15.148:0/1961606898 >> 172.21.15.148:0/1961606898 conn(0x7f2a500fd7d0 msgr2=0x7f2a500fdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:16:29.047 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:29.044+0000 7f2a58665640 1 -- 172.21.15.148:0/1961606898 shutdown_connections 2024-09-19T07:16:29.047 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:29.044+0000 7f2a58665640 1 -- 172.21.15.148:0/1961606898 wait complete. 2024-09-19T07:16:29.112 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'a8f55d81', total seconds elapsed: 34.1 2024-09-19T07:16:29.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:16:29 smithi148 ceph-mon[31180]: pgmap v166: 97 pgs: 97 active+clean; 913 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 963 KiB/s rd, 579 KiB/s wr, 85 op/s 2024-09-19T07:16:29.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:16:29 smithi165 ceph-mon[35326]: pgmap v166: 97 pgs: 97 active+clean; 913 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 963 KiB/s rd, 579 KiB/s wr, 85 op/s 2024-09-19T07:16:29.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:16:29 smithi179 ceph-mon[35716]: pgmap v166: 97 pgs: 97 active+clean; 913 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 963 KiB/s rd, 579 KiB/s wr, 85 op/s 2024-09-19T07:16:31.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:16:31 smithi148 ceph-mon[31180]: pgmap v167: 97 pgs: 97 active+clean; 913 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 984 KiB/s rd, 596 KiB/s wr, 88 op/s 2024-09-19T07:16:31.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:16:31 smithi165 ceph-mon[35326]: pgmap v167: 97 pgs: 97 active+clean; 913 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 984 KiB/s rd, 596 KiB/s wr, 88 op/s 2024-09-19T07:16:31.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:16:31 smithi179 ceph-mon[35716]: pgmap v167: 97 pgs: 97 active+clean; 913 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 984 KiB/s rd, 596 KiB/s wr, 88 op/s 2024-09-19T07:16:33.194 INFO:tasks.workunit.client.0.smithi148.stdout: 245 636179 805 438652 720 208619 775 2024-09-19T07:16:33.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:16:33 smithi148 ceph-mon[31180]: pgmap v168: 97 pgs: 97 active+clean; 913 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 707 KiB/s wr, 168 op/s 2024-09-19T07:16:33.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:16:33 smithi165 ceph-mon[35326]: pgmap v168: 97 pgs: 97 active+clean; 913 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 707 KiB/s wr, 168 op/s 2024-09-19T07:16:33.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:16:33 smithi179 ceph-mon[35716]: pgmap v168: 97 pgs: 97 active+clean; 913 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 707 KiB/s wr, 168 op/s 2024-09-19T07:16:35.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:16:35 smithi148 ceph-mon[31180]: pgmap v169: 97 pgs: 97 active+clean; 913 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 813 KiB/s rd, 384 KiB/s wr, 92 op/s 2024-09-19T07:16:35.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:16:35 smithi165 ceph-mon[35326]: pgmap v169: 97 pgs: 97 active+clean; 913 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 813 KiB/s rd, 384 KiB/s wr, 92 op/s 2024-09-19T07:16:35.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:16:35 smithi179 ceph-mon[35716]: pgmap v169: 97 pgs: 97 active+clean; 913 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 813 KiB/s rd, 384 KiB/s wr, 92 op/s 2024-09-19T07:16:37.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:16:37 smithi148 ceph-mon[31180]: pgmap v170: 97 pgs: 97 active+clean; 975 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.7 MiB/s wr, 391 op/s 2024-09-19T07:16:37.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:16:37 smithi165 ceph-mon[35326]: pgmap v170: 97 pgs: 97 active+clean; 975 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.7 MiB/s wr, 391 op/s 2024-09-19T07:16:37.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:16:37 smithi179 ceph-mon[35716]: pgmap v170: 97 pgs: 97 active+clean; 975 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.7 MiB/s wr, 391 op/s 2024-09-19T07:16:39.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:16:39 smithi148 ceph-mon[31180]: pgmap v171: 97 pgs: 97 active+clean; 975 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.7 MiB/s wr, 384 op/s 2024-09-19T07:16:39.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:16:39 smithi165 ceph-mon[35326]: pgmap v171: 97 pgs: 97 active+clean; 975 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.7 MiB/s wr, 384 op/s 2024-09-19T07:16:39.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:16:39 smithi179 ceph-mon[35716]: pgmap v171: 97 pgs: 97 active+clean; 975 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.7 MiB/s wr, 384 op/s 2024-09-19T07:16:41.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:16:41 smithi148 ceph-mon[31180]: pgmap v172: 97 pgs: 97 active+clean; 975 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.7 MiB/s wr, 385 op/s 2024-09-19T07:16:41.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:16:41 smithi165 ceph-mon[35326]: pgmap v172: 97 pgs: 97 active+clean; 975 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.7 MiB/s wr, 385 op/s 2024-09-19T07:16:41.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:16:41 smithi179 ceph-mon[35716]: pgmap v172: 97 pgs: 97 active+clean; 975 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.7 MiB/s wr, 385 op/s 2024-09-19T07:16:42.163 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.160+0000 7f334bce6640 1 -- 172.21.15.148:0/993511793 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33441035a0 msgr2=0x7f334410ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:42.163 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.160+0000 7f334bce6640 1 --2- 172.21.15.148:0/993511793 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33441035a0 0x7f334410ba80 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f3334009900 tx=0x7f333402a480 comp rx=0 tx=0).stop 2024-09-19T07:16:42.163 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.160+0000 7f334bce6640 1 -- 172.21.15.148:0/993511793 shutdown_connections 2024-09-19T07:16:42.163 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.160+0000 7f334bce6640 1 --2- 172.21.15.148:0/993511793 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f334410c0d0 0x7f334410e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:42.163 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.160+0000 7f334bce6640 1 --2- 172.21.15.148:0/993511793 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33441035a0 0x7f334410ba80 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:42.163 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.160+0000 7f334bce6640 1 --2- 172.21.15.148:0/993511793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3344102c80 0x7f3344103060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:42.163 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.160+0000 7f334bce6640 1 -- 172.21.15.148:0/993511793 >> 172.21.15.148:0/993511793 conn(0x7f3344077990 msgr2=0x7f33440fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:16:42.163 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.160+0000 7f334bce6640 1 -- 172.21.15.148:0/993511793 shutdown_connections 2024-09-19T07:16:42.163 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.160+0000 7f334bce6640 1 -- 172.21.15.148:0/993511793 wait complete. 2024-09-19T07:16:42.163 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.160+0000 7f334bce6640 1 Processor -- start 2024-09-19T07:16:42.164 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.161+0000 7f334bce6640 1 -- start start 2024-09-19T07:16:42.164 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.161+0000 7f334bce6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3344102c80 0x7f3344198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:42.164 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.161+0000 7f334bce6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33441035a0 0x7f33441988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:42.164 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.161+0000 7f334bce6640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f334410c0d0 0x7f334419cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:42.164 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.161+0000 7f334bce6640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3344111eb0 con 0x7f33441035a0 2024-09-19T07:16:42.164 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.161+0000 7f334bce6640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3344111d30 con 0x7f334410c0d0 2024-09-19T07:16:42.164 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.161+0000 7f334bce6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3344112030 con 0x7f3344102c80 2024-09-19T07:16:42.164 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.161+0000 7f3349281640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33441035a0 0x7f33441988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:42.164 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.161+0000 7f3349a82640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3344102c80 0x7f3344198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:42.164 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.161+0000 7f3349281640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33441035a0 0x7f33441988c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38278/0 (socket says 172.21.15.148:38278) 2024-09-19T07:16:42.164 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.161+0000 7f3349281640 1 -- 172.21.15.148:0/647492871 learned_addr learned my addr 172.21.15.148:0/647492871 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:16:42.164 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.161+0000 7f334a283640 1 --2- 172.21.15.148:0/647492871 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f334410c0d0 0x7f334419cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:42.164 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.161+0000 7f3349281640 1 -- 172.21.15.148:0/647492871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3344102c80 msgr2=0x7f3344198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:42.165 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.161+0000 7f3349281640 1 --2- 172.21.15.148:0/647492871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3344102c80 0x7f3344198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:42.165 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.161+0000 7f3349281640 1 -- 172.21.15.148:0/647492871 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f334410c0d0 msgr2=0x7f334419cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:42.165 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.161+0000 7f3349281640 1 --2- 172.21.15.148:0/647492871 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f334410c0d0 0x7f334419cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:42.165 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.161+0000 7f3349281640 1 -- 172.21.15.148:0/647492871 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f334419d370 con 0x7f33441035a0 2024-09-19T07:16:42.165 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.161+0000 7f3349281640 1 --2- 172.21.15.148:0/647492871 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33441035a0 0x7f33441988c0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f3334006010 tx=0x7f3334031b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:16:42.165 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.162+0000 7f333affd640 1 -- 172.21.15.148:0/647492871 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333403f030 con 0x7f33441035a0 2024-09-19T07:16:42.165 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.162+0000 7f334bce6640 1 -- 172.21.15.148:0/647492871 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f334419d600 con 0x7f33441035a0 2024-09-19T07:16:42.165 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.162+0000 7f333affd640 1 -- 172.21.15.148:0/647492871 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33340043d0 con 0x7f33441035a0 2024-09-19T07:16:42.165 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.162+0000 7f334bce6640 1 -- 172.21.15.148:0/647492871 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33441a4ef0 con 0x7f33441035a0 2024-09-19T07:16:42.165 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.162+0000 7f333affd640 1 -- 172.21.15.148:0/647492871 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3334035070 con 0x7f33441035a0 2024-09-19T07:16:42.168 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.164+0000 7f334ea7e740 1 Processor -- start 2024-09-19T07:16:42.168 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.165+0000 7f334ea7e740 1 -- start start 2024-09-19T07:16:42.168 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.165+0000 7f334ea7e740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55810c242af0 0x55810c242ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:42.168 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.165+0000 7f334ea7e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55810c243410 0x55810c24d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:42.168 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.165+0000 7f334ea7e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55810c24dcb0 0x55810c2500a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:42.168 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.165+0000 7f334ea7e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55810c1a72f0 con 0x55810c24dcb0 2024-09-19T07:16:42.168 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.165+0000 7f334ea7e740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55810c14f270 con 0x55810c242af0 2024-09-19T07:16:42.169 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.165+0000 7f334ea7e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55810c1a32b0 con 0x55810c243410 2024-09-19T07:16:42.169 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.165+0000 7f334a283640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55810c242af0 0x55810c242ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:42.169 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.165+0000 7f334a283640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55810c242af0 0x55810c242ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:45954/0 (socket says 172.21.15.148:45954) 2024-09-19T07:16:42.169 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.165+0000 7f334a283640 1 -- 172.21.15.148:0/3021143155 learned_addr learned my addr 172.21.15.148:0/3021143155 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:16:42.169 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.165+0000 7f3349a82640 1 --2- 172.21.15.148:0/3021143155 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55810c243410 0x55810c24d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:42.169 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.165+0000 7f334a283640 1 -- 172.21.15.148:0/3021143155 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55810c243410 msgr2=0x55810c24d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:16:42.169 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.165+0000 7f334a283640 1 --2- 172.21.15.148:0/3021143155 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55810c243410 0x55810c24d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:42.169 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.165+0000 7f334a283640 1 -- 172.21.15.148:0/3021143155 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55810c24dcb0 msgr2=0x55810c2500a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T07:16:42.169 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.165+0000 7f334a283640 1 --2- 172.21.15.148:0/3021143155 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55810c24dcb0 0x55810c2500a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:42.169 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.165+0000 7f334a283640 1 -- 172.21.15.148:0/3021143155 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55810c14e340 con 0x55810c242af0 2024-09-19T07:16:42.169 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.165+0000 7f334a283640 1 --2- 172.21.15.148:0/3021143155 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55810c242af0 0x55810c242ed0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f333c009f50 tx=0x7f333c0118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d0ce019fc6674f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:16:42.169 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.165+0000 7f333affd640 1 -- 172.21.15.148:0/647492871 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f3334042030 con 0x7f33441035a0 2024-09-19T07:16:42.169 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.166+0000 7f332ffff640 1 -- 172.21.15.148:0/3021143155 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333c004d20 con 0x55810c242af0 2024-09-19T07:16:42.170 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.166+0000 7f332ffff640 1 -- 172.21.15.148:0/3021143155 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f333c004050 con 0x55810c242af0 2024-09-19T07:16:42.170 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.166+0000 7f332ffff640 1 -- 172.21.15.148:0/3021143155 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333c005260 con 0x55810c242af0 2024-09-19T07:16:42.170 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.166+0000 7f333affd640 1 --2- 172.21.15.148:0/647492871 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f33300a3460 0x7f33300a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:42.170 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.166+0000 7f3349a82640 1 --2- 172.21.15.148:0/647492871 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f33300a3460 0x7f33300a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:42.170 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.166+0000 7f333affd640 1 -- 172.21.15.148:0/647492871 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8512+0+0 (secure 0 0 0) 0x7f33340efe70 con 0x7f33441035a0 2024-09-19T07:16:42.170 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.166+0000 7f334ea7e740 1 -- 172.21.15.148:0/3021143155 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55810c242af0 msgr2=0x55810c242ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:42.170 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.166+0000 7f334ea7e740 1 --2- 172.21.15.148:0/3021143155 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55810c242af0 0x55810c242ed0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f333c009f50 tx=0x7f333c0118d0 comp rx=0 tx=0).stop 2024-09-19T07:16:42.170 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.167+0000 7f334ea7e740 1 -- 172.21.15.148:0/3021143155 shutdown_connections 2024-09-19T07:16:42.170 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.167+0000 7f334ea7e740 1 --2- 172.21.15.148:0/3021143155 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55810c24dcb0 0x55810c2500a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:42.170 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.167+0000 7f334ea7e740 1 --2- 172.21.15.148:0/3021143155 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55810c243410 0x55810c24d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:42.170 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.167+0000 7f334ea7e740 1 --2- 172.21.15.148:0/3021143155 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55810c242af0 0x55810c242ed0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:42.170 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.167+0000 7f334ea7e740 1 -- 172.21.15.148:0/3021143155 >> 172.21.15.148:0/3021143155 conn(0x55810c23f060 msgr2=0x55810c23f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:16:42.170 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.167+0000 7f334ea7e740 1 -- 172.21.15.148:0/3021143155 shutdown_connections 2024-09-19T07:16:42.171 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.167+0000 7f334ea7e740 1 -- 172.21.15.148:0/3021143155 wait complete. 2024-09-19T07:16:42.171 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.167+0000 7f3349a82640 1 --2- 172.21.15.148:0/647492871 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f33300a3460 0x7f33300a5920 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x55810c23fec0 tx=0x7f3340005f90 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:16:42.171 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.167+0000 7f334ea7e740 1 -- start start 2024-09-19T07:16:42.171 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.167+0000 7f334ea7e740 1 Processor -- start 2024-09-19T07:16:42.173 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.168+0000 7f334ea7e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55810c242af0 0x55810c24ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:42.173 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.168+0000 7f334ea7e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55810c243410 0x55810c24b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:42.173 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.168+0000 7f334ea7e740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55810c24dcb0 0x55810c24b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:42.173 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.168+0000 7f334ea7e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55810c254c90 con 0x55810c243410 2024-09-19T07:16:42.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.168+0000 7f334ea7e740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55810c130290 con 0x55810c24dcb0 2024-09-19T07:16:42.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.168+0000 7f334ea7e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55810c254e10 con 0x55810c242af0 2024-09-19T07:16:42.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.168+0000 7f334ea7e740 10 client.0 _ll_register_callbacks cb 0x55810c161140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:16:42.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.168+0000 7f3349281640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55810c243410 0x55810c24b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:42.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.168+0000 7f3349a82640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55810c242af0 0x55810c24ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:42.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.168+0000 7f334a283640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55810c24dcb0 0x55810c24b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:42.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.168+0000 7f3349281640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55810c243410 0x55810c24b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38292/0 (socket says 172.21.15.148:38292) 2024-09-19T07:16:42.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.168+0000 7f3349281640 1 -- 172.21.15.148:0/3788758687 learned_addr learned my addr 172.21.15.148:0/3788758687 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:16:42.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.168+0000 7f3349a82640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55810c242af0 0x55810c24ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:37756/0 (socket says 172.21.15.148:37756) 2024-09-19T07:16:42.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.168+0000 7f334a283640 1 -- 172.21.15.148:0/3788758687 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55810c242af0 msgr2=0x55810c24ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:16:42.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.168+0000 7f334a283640 1 --2- 172.21.15.148:0/3788758687 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55810c242af0 0x55810c24ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:42.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.168+0000 7f334a283640 1 -- 172.21.15.148:0/3788758687 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55810c243410 msgr2=0x55810c24b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:16:42.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.168+0000 7f334a283640 1 --2- 172.21.15.148:0/3788758687 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55810c243410 0x55810c24b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:42.175 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.168+0000 7f334a283640 1 -- 172.21.15.148:0/3788758687 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55810beba210 con 0x55810c24dcb0 2024-09-19T07:16:42.175 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.168+0000 7f3349281640 1 --2- 172.21.15.148:0/3788758687 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55810c243410 0x55810c24b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:16:42.175 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.169+0000 7f334a283640 1 --2- 172.21.15.148:0/3788758687 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55810c24dcb0 0x55810c24b600 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f333c012fd0 tx=0x7f333c004c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9146aa2f27c0dbf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:16:42.175 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.169+0000 7f332d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-19T07:16:42.175 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.169+0000 7f332d7fa640 1 -- 172.21.15.148:0/3788758687 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333c029020 con 0x55810c24dcb0 2024-09-19T07:16:42.175 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.169+0000 7f332d7fa640 1 -- 172.21.15.148:0/3788758687 <== mon.2 v2:172.21.15.165:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8512+0+0 (secure 0 0 0) 0x7f333c025470 con 0x55810c24dcb0 2024-09-19T07:16:42.175 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.169+0000 7f334ea7e740 1 -- 172.21.15.148:0/3788758687 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f333c004050 con 0x55810c24dcb0 2024-09-19T07:16:42.175 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.169+0000 7f332d7fa640 1 -- 172.21.15.148:0/3788758687 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f333c004610 con 0x55810c24dcb0 2024-09-19T07:16:42.175 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.169+0000 7f334ea7e740 10 client.25889 fetch_fsmap learned FSMap version 35 2024-09-19T07:16:42.175 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.169+0000 7f334ea7e740 1 -- 172.21.15.148:0/3788758687 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55810bf86620 con 0x55810c24dcb0 2024-09-19T07:16:42.175 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.169+0000 7f332d7fa640 1 -- 172.21.15.148:0/3788758687 <== mon.2 v2:172.21.15.165:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f333c004050 con 0x55810c24dcb0 2024-09-19T07:16:42.175 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.169+0000 7f332d7fa640 1 -- 172.21.15.148:0/3788758687 <== mon.2 v2:172.21.15.165:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f333c00f970 con 0x55810c24dcb0 2024-09-19T07:16:42.175 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.169+0000 7f334ea7e740 10 client.25889 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:16:42.175 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.169+0000 7f334ea7e740 10 client.25889 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:16:42.176 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.169+0000 7f334ea7e740 20 client.25889 populate_metadata read hostname 'smithi148' 2024-09-19T07:16:42.176 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.169+0000 7f334ea7e740 1 --2- 172.21.15.148:0/3788758687 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55810c261fa0 0x55810c264390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:42.176 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.169+0000 7f334ea7e740 4 client.25889 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:16:42.176 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.169+0000 7f334ea7e740 1 -- 172.21.15.148:0/3788758687 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55810c1b4a20 con 0x55810c261fa0 2024-09-19T07:16:42.176 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.170+0000 7f3349a82640 1 --2- 172.21.15.148:0/3788758687 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55810c261fa0 0x55810c264390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:42.176 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.170+0000 7f332d7fa640 10 client.25889 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:16:42.176 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.170+0000 7f3349a82640 1 --2- 172.21.15.148:0/3788758687 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55810c261fa0 0x55810c264390 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bef17de3453c9f50 server_cookie=3cd32dd925824f10 in_seq=0 out_seq=0 2024-09-19T07:16:42.177 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.173+0000 7f332d7fa640 1 -- 172.21.15.148:0/3788758687 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55810c1b4a20 con 0x55810c261fa0 2024-09-19T07:16:42.177 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.173+0000 7f332d7fa640 10 client.25889 handle_command_reply: tid=0 2024-09-19T07:16:42.177 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.173+0000 7f334ea7e740 1 client.25889 shutdown 2024-09-19T07:16:42.177 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.173+0000 7f334ea7e740 1 -- 172.21.15.148:0/3788758687 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55810c24dcb0 msgr2=0x55810c24b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:42.177 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.174+0000 7f334ea7e740 1 --2- 172.21.15.148:0/3788758687 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55810c24dcb0 0x55810c24b600 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f333c012fd0 tx=0x7f333c004c70 comp rx=0 tx=0).stop 2024-09-19T07:16:42.178 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.174+0000 7f334ea7e740 1 -- 172.21.15.148:0/3788758687 shutdown_connections 2024-09-19T07:16:42.178 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.174+0000 7f334ea7e740 1 --2- 172.21.15.148:0/3788758687 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55810c261fa0 0x55810c264390 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:42.178 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.174+0000 7f334ea7e740 1 --2- 172.21.15.148:0/3788758687 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55810c24dcb0 0x55810c24b600 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:42.178 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.174+0000 7f332d7fa640 0 client.25889 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:16:42.178 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.174+0000 7f334ea7e740 1 --2- 172.21.15.148:0/3788758687 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55810c243410 0x55810c24b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:42.178 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.174+0000 7f334ea7e740 1 --2- 172.21.15.148:0/3788758687 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55810c242af0 0x55810c24ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:42.178 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.174+0000 7f334ea7e740 1 -- 172.21.15.148:0/3788758687 >> 172.21.15.148:0/3788758687 conn(0x55810c23f060 msgr2=0x55810c244d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:16:42.178 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.174+0000 7f334ea7e740 1 -- 172.21.15.148:0/3788758687 shutdown_connections 2024-09-19T07:16:42.178 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.174+0000 7f334ea7e740 1 -- 172.21.15.148:0/3788758687 wait complete. 2024-09-19T07:16:42.178 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.174+0000 7f334ea7e740 20 client.25889 trim_cache size 0 max 16384 2024-09-19T07:16:42.192 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.190+0000 7f334ea7e740 1 Processor -- start 2024-09-19T07:16:42.192 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.190+0000 7f334ea7e740 1 -- start start 2024-09-19T07:16:42.192 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.190+0000 7f334ea7e740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55810c242af0 0x55810c245560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:42.192 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.190+0000 7f334ea7e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55810c243410 0x55810c24caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:42.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.191+0000 7f334ea7e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55810c24dcb0 0x55810c269b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:42.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.191+0000 7f334ea7e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f33441adf00 con 0x55810c243410 2024-09-19T07:16:42.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.191+0000 7f334ea7e740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f33441ab770 con 0x55810c242af0 2024-09-19T07:16:42.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.191+0000 7f334ea7e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f33441a95c0 con 0x55810c24dcb0 2024-09-19T07:16:42.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.191+0000 7f3349281640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55810c243410 0x55810c24caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:42.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.191+0000 7f3349a82640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55810c242af0 0x55810c245560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:42.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.191+0000 7f334a283640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55810c24dcb0 0x55810c269b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:42.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.191+0000 7f3349281640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55810c243410 0x55810c24caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38298/0 (socket says 172.21.15.148:38298) 2024-09-19T07:16:42.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.191+0000 7f3349281640 1 -- 172.21.15.148:0/735732583 learned_addr learned my addr 172.21.15.148:0/735732583 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:16:42.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.191+0000 7f3349a82640 1 -- 172.21.15.148:0/735732583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55810c24dcb0 msgr2=0x55810c269b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:16:42.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.191+0000 7f3349a82640 1 --2- 172.21.15.148:0/735732583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55810c24dcb0 0x55810c269b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:42.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.191+0000 7f3349a82640 1 -- 172.21.15.148:0/735732583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55810c243410 msgr2=0x55810c24caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:16:42.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.191+0000 7f3349a82640 1 --2- 172.21.15.148:0/735732583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55810c243410 0x55810c24caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:42.194 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.191+0000 7f3349a82640 1 -- 172.21.15.148:0/735732583 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55810c242920 con 0x55810c242af0 2024-09-19T07:16:42.194 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.191+0000 7f334a283640 1 --2- 172.21.15.148:0/735732583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55810c24dcb0 0x55810c269b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:16:42.194 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.191+0000 7f3349281640 1 --2- 172.21.15.148:0/735732583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55810c243410 0x55810c24caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:16:42.194 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.191+0000 7f3349a82640 1 --2- 172.21.15.148:0/735732583 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55810c242af0 0x55810c245560 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x55810c24bcf0 tx=0x7f3340022040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=411d8d1471bd4d2b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:16:42.194 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.192+0000 7f332f7fe640 1 -- 172.21.15.148:0/735732583 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f334002b470 con 0x55810c242af0 2024-09-19T07:16:42.194 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.192+0000 7f332f7fe640 1 -- 172.21.15.148:0/735732583 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f334002baf0 con 0x55810c242af0 2024-09-19T07:16:42.194 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.192+0000 7f332f7fe640 1 -- 172.21.15.148:0/735732583 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f334001fce0 con 0x55810c242af0 2024-09-19T07:16:42.198 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.193+0000 7f334ea7e740 1 -- 172.21.15.148:0/735732583 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55810c242af0 msgr2=0x55810c245560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:42.198 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.193+0000 7f334ea7e740 1 --2- 172.21.15.148:0/735732583 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55810c242af0 0x55810c245560 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x55810c24bcf0 tx=0x7f3340022040 comp rx=0 tx=0).stop 2024-09-19T07:16:42.198 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.193+0000 7f334ea7e740 1 -- 172.21.15.148:0/735732583 shutdown_connections 2024-09-19T07:16:42.198 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.193+0000 7f334ea7e740 1 --2- 172.21.15.148:0/735732583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55810c24dcb0 0x55810c269b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:42.198 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.193+0000 7f334ea7e740 1 --2- 172.21.15.148:0/735732583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55810c243410 0x55810c24caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:42.198 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.193+0000 7f334ea7e740 1 --2- 172.21.15.148:0/735732583 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55810c242af0 0x55810c245560 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:42.198 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.193+0000 7f334ea7e740 1 -- 172.21.15.148:0/735732583 >> 172.21.15.148:0/735732583 conn(0x55810c23f060 msgr2=0x55810c24c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:16:42.198 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.193+0000 7f334ea7e740 1 -- 172.21.15.148:0/735732583 shutdown_connections 2024-09-19T07:16:42.198 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.193+0000 7f334ea7e740 1 -- 172.21.15.148:0/735732583 wait complete. 2024-09-19T07:16:42.199 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.193+0000 7f334ea7e740 1 -- start start 2024-09-19T07:16:42.199 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.193+0000 7f334ea7e740 1 Processor -- start 2024-09-19T07:16:42.199 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.194+0000 7f334ea7e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55810c242af0 0x55810c25a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:42.199 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.194+0000 7f334ea7e740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55810c243410 0x55810c247610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:42.199 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.194+0000 7f334ea7e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55810c24dcb0 0x55810c247b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:42.199 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.194+0000 7f334ea7e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f33441a9c30 con 0x55810c24dcb0 2024-09-19T07:16:42.199 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.194+0000 7f334ea7e740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f33441ab0a0 con 0x55810c243410 2024-09-19T07:16:42.199 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.194+0000 7f334ea7e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f33441aa300 con 0x55810c242af0 2024-09-19T07:16:42.199 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.194+0000 7f334ea7e740 10 client.0 _ll_register_callbacks cb 0x7f3340009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:16:42.199 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.194+0000 7f334a283640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55810c24dcb0 0x55810c247b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:42.199 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.194+0000 7f3349a82640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55810c242af0 0x55810c25a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:42.199 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.194+0000 7f3349281640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55810c243410 0x55810c247610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:42.199 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.194+0000 7f334a283640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55810c24dcb0 0x55810c247b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38314/0 (socket says 172.21.15.148:38314) 2024-09-19T07:16:42.200 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.194+0000 7f334a283640 1 -- 172.21.15.148:0/2054460986 learned_addr learned my addr 172.21.15.148:0/2054460986 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:16:42.200 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.194+0000 7f3349281640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55810c243410 0x55810c247610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:45982/0 (socket says 172.21.15.148:45982) 2024-09-19T07:16:42.200 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.194+0000 7f3349a82640 1 --2- 172.21.15.148:0/2054460986 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55810c242af0 0x55810c25a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:37766/0 (socket says 172.21.15.148:37766) 2024-09-19T07:16:42.200 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.194+0000 7f334a283640 1 -- 172.21.15.148:0/2054460986 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55810c242af0 msgr2=0x55810c25a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:16:42.200 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.194+0000 7f334a283640 1 --2- 172.21.15.148:0/2054460986 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55810c242af0 0x55810c25a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:42.200 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.194+0000 7f334a283640 1 -- 172.21.15.148:0/2054460986 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55810c243410 msgr2=0x55810c247610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:16:42.200 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.194+0000 7f334a283640 1 --2- 172.21.15.148:0/2054460986 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55810c243410 0x55810c247610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:42.200 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.194+0000 7f334a283640 1 -- 172.21.15.148:0/2054460986 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55810c248090 con 0x55810c24dcb0 2024-09-19T07:16:42.200 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.194+0000 7f3349281640 1 --2- 172.21.15.148:0/2054460986 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55810c243410 0x55810c247610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:16:42.200 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.194+0000 7f334a283640 1 --2- 172.21.15.148:0/2054460986 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55810c24dcb0 0x55810c247b50 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f333c011dd0 tx=0x7f333c019f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=321149fcd1dc90ca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:16:42.200 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.194+0000 7f332d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:16:42.200 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.195+0000 7f332d7fa640 1 -- 172.21.15.148:0/2054460986 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333c03d060 con 0x55810c24dcb0 2024-09-19T07:16:42.200 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.195+0000 7f332d7fa640 1 -- 172.21.15.148:0/2054460986 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8512+0+0 (secure 0 0 0) 0x7f333c004410 con 0x55810c24dcb0 2024-09-19T07:16:42.201 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.195+0000 7f334ea7e740 1 -- 172.21.15.148:0/2054460986 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f334002baf0 con 0x55810c24dcb0 2024-09-19T07:16:42.201 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.195+0000 7f332d7fa640 1 -- 172.21.15.148:0/2054460986 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f333c029070 con 0x55810c24dcb0 2024-09-19T07:16:42.201 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.195+0000 7f334ea7e740 10 client.16593 fetch_fsmap learned FSMap version 35 2024-09-19T07:16:42.201 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.195+0000 7f334ea7e740 1 -- 172.21.15.148:0/2054460986 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55810c2cc850 con 0x55810c24dcb0 2024-09-19T07:16:42.201 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.195+0000 7f332d7fa640 1 -- 172.21.15.148:0/2054460986 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f334002baf0 con 0x55810c24dcb0 2024-09-19T07:16:42.201 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.195+0000 7f332d7fa640 1 -- 172.21.15.148:0/2054460986 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7f333c038510 con 0x55810c24dcb0 2024-09-19T07:16:42.201 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.195+0000 7f334ea7e740 10 client.16593 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T07:16:42.201 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.195+0000 7f334ea7e740 10 client.16593 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:16:42.201 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.195+0000 7f334ea7e740 20 client.16593 populate_metadata read hostname 'smithi148' 2024-09-19T07:16:42.201 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.195+0000 7f334ea7e740 1 --2- 172.21.15.148:0/2054460986 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55810c2ccf40 0x55810c2cf360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:42.201 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.195+0000 7f334ea7e740 4 client.16593 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:16:42.201 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.195+0000 7f334ea7e740 1 -- 172.21.15.148:0/2054460986 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55810c1aed70 con 0x55810c2ccf40 2024-09-19T07:16:42.201 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.195+0000 7f3349a82640 1 --2- 172.21.15.148:0/2054460986 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55810c2ccf40 0x55810c2cf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:42.202 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.196+0000 7f332d7fa640 10 client.16593 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:16:42.202 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:42.196+0000 7f3349a82640 1 --2- 172.21.15.148:0/2054460986 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55810c2ccf40 0x55810c2cf360 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce00e8b5035b471e server_cookie=96f7d6a4767c9f73 in_seq=0 out_seq=0 2024-09-19T07:16:43.194 INFO:tasks.workunit.client.0.smithi148.stdout: 261 1443133 928 976667 619 467337 991 2024-09-19T07:16:43.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:16:43 smithi148 ceph-mon[31180]: pgmap v173: 97 pgs: 97 active+clean; 983 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.5 MiB/s wr, 436 op/s 2024-09-19T07:16:43.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:16:43 smithi165 ceph-mon[35326]: pgmap v173: 97 pgs: 97 active+clean; 983 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.5 MiB/s wr, 436 op/s 2024-09-19T07:16:43.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:16:43 smithi179 ceph-mon[35716]: pgmap v173: 97 pgs: 97 active+clean; 983 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.5 MiB/s wr, 436 op/s 2024-09-19T07:16:45.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:16:45 smithi165 ceph-mon[35326]: pgmap v174: 97 pgs: 97 active+clean; 983 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.1 MiB/s wr, 353 op/s 2024-09-19T07:16:45.525 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:16:45 smithi179 ceph-mon[35716]: pgmap v174: 97 pgs: 97 active+clean; 983 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.1 MiB/s wr, 353 op/s 2024-09-19T07:16:45.586 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:16:45 smithi148 ceph-mon[31180]: pgmap v174: 97 pgs: 97 active+clean; 983 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.1 MiB/s wr, 353 op/s 2024-09-19T07:16:46.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:16:46 smithi165 ceph-mon[35326]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:16:46.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:16:46 smithi179 ceph-mon[35716]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:16:46.585 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:16:46 smithi148 ceph-mon[31180]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:16:46.872 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:46.871+0000 7f332d7fa640 1 -- 172.21.15.148:0/2054460986 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55810c1aed70 con 0x55810c2ccf40 2024-09-19T07:16:46.872 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:46.871+0000 7f332d7fa640 10 client.16593 handle_command_reply: tid=0 2024-09-19T07:16:46.872 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:46.871+0000 7f334ea7e740 1 client.16593 shutdown 2024-09-19T07:16:46.873 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:46.872+0000 7f334ea7e740 1 -- 172.21.15.148:0/2054460986 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55810c24dcb0 msgr2=0x55810c247b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:46.873 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:46.872+0000 7f334ea7e740 1 --2- 172.21.15.148:0/2054460986 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55810c24dcb0 0x55810c247b50 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f333c011dd0 tx=0x7f333c019f90 comp rx=0 tx=0).stop 2024-09-19T07:16:46.873 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:46.872+0000 7f334ea7e740 1 -- 172.21.15.148:0/2054460986 shutdown_connections 2024-09-19T07:16:46.873 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:46.872+0000 7f334ea7e740 1 --2- 172.21.15.148:0/2054460986 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55810c2ccf40 0x55810c2cf360 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:46.874 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:46.872+0000 7f334ea7e740 1 --2- 172.21.15.148:0/2054460986 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55810c24dcb0 0x55810c247b50 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:46.874 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:46.872+0000 7f334ea7e740 1 --2- 172.21.15.148:0/2054460986 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55810c243410 0x55810c247610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:46.874 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:46.872+0000 7f332d7fa640 0 client.16593 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:16:46.874 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:46.872+0000 7f334ea7e740 1 --2- 172.21.15.148:0/2054460986 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55810c242af0 0x55810c25a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:46.874 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:46.872+0000 7f334ea7e740 1 -- 172.21.15.148:0/2054460986 >> 172.21.15.148:0/2054460986 conn(0x55810c23f060 msgr2=0x55810c23e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:16:46.874 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:46.872+0000 7f334ea7e740 1 -- 172.21.15.148:0/2054460986 shutdown_connections 2024-09-19T07:16:46.874 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:46.872+0000 7f334ea7e740 1 -- 172.21.15.148:0/2054460986 wait complete. 2024-09-19T07:16:46.874 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:46.873+0000 7f334ea7e740 20 client.16593 trim_cache size 0 max 16384 2024-09-19T07:16:46.874 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:16:46.875 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:16:46.875 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:16:46.875 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:16:46.887 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:46.886+0000 7f334bce6640 1 -- 172.21.15.148:0/647492871 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f33300a3460 msgr2=0x7f33300a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:46.887 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:46.886+0000 7f334bce6640 1 --2- 172.21.15.148:0/647492871 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f33300a3460 0x7f33300a5920 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x55810c23fec0 tx=0x7f3340005f90 comp rx=0 tx=0).stop 2024-09-19T07:16:46.887 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:46.886+0000 7f334bce6640 1 -- 172.21.15.148:0/647492871 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33441035a0 msgr2=0x7f33441988c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:46.887 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:46.886+0000 7f334bce6640 1 --2- 172.21.15.148:0/647492871 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33441035a0 0x7f33441988c0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f3334006010 tx=0x7f3334031b20 comp rx=0 tx=0).stop 2024-09-19T07:16:46.887 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:46.886+0000 7f334bce6640 1 -- 172.21.15.148:0/647492871 shutdown_connections 2024-09-19T07:16:46.887 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:46.886+0000 7f334bce6640 1 --2- 172.21.15.148:0/647492871 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f33300a3460 0x7f33300a5920 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:46.887 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:46.886+0000 7f334bce6640 1 --2- 172.21.15.148:0/647492871 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f334410c0d0 0x7f334419cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:46.890 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:46.886+0000 7f334bce6640 1 --2- 172.21.15.148:0/647492871 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33441035a0 0x7f33441988c0 secure :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f3334006010 tx=0x7f3334031b20 comp rx=0 tx=0).stop 2024-09-19T07:16:46.890 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:46.890+0000 7f334bce6640 1 --2- 172.21.15.148:0/647492871 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3344102c80 0x7f3344198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:46.891 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:46.890+0000 7f334bce6640 1 -- 172.21.15.148:0/647492871 >> 172.21.15.148:0/647492871 conn(0x7f3344077990 msgr2=0x7f33440fcf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:16:46.891 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:46.890+0000 7f334bce6640 1 -- 172.21.15.148:0/647492871 shutdown_connections 2024-09-19T07:16:46.891 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:16:46.890+0000 7f334bce6640 1 -- 172.21.15.148:0/647492871 wait complete. 2024-09-19T07:16:47.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:16:47 smithi165 ceph-mon[35326]: pgmap v175: 97 pgs: 97 active+clean; 996 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 7.3 MiB/s wr, 477 op/s 2024-09-19T07:16:47.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:16:47 smithi179 ceph-mon[35716]: pgmap v175: 97 pgs: 97 active+clean; 996 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 7.3 MiB/s wr, 477 op/s 2024-09-19T07:16:47.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:16:47 smithi148 ceph-mon[31180]: pgmap v175: 97 pgs: 97 active+clean; 996 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 7.3 MiB/s wr, 477 op/s 2024-09-19T07:16:49.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:16:49 smithi179 ceph-mon[35716]: pgmap v176: 97 pgs: 97 active+clean; 996 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.0 MiB/s wr, 179 op/s 2024-09-19T07:16:49.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:16:49 smithi148 ceph-mon[31180]: pgmap v176: 97 pgs: 97 active+clean; 996 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.0 MiB/s wr, 179 op/s 2024-09-19T07:16:49.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:16:49 smithi165 ceph-mon[35326]: pgmap v176: 97 pgs: 97 active+clean; 996 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.0 MiB/s wr, 179 op/s 2024-09-19T07:16:51.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:16:51 smithi179 ceph-mon[35716]: pgmap v177: 97 pgs: 97 active+clean; 1000 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.3 MiB/s wr, 261 op/s 2024-09-19T07:16:51.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:16:51 smithi179 ceph-mon[35716]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:16:51.578 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:16:51 smithi148 ceph-mon[31180]: pgmap v177: 97 pgs: 97 active+clean; 1000 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.3 MiB/s wr, 261 op/s 2024-09-19T07:16:51.578 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:16:51 smithi148 ceph-mon[31180]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:16:51.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:16:51 smithi165 ceph-mon[35326]: pgmap v177: 97 pgs: 97 active+clean; 1000 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.3 MiB/s wr, 261 op/s 2024-09-19T07:16:51.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:16:51 smithi165 ceph-mon[35326]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:16:53.194 INFO:tasks.workunit.client.0.smithi148.stdout: 281 2372675 1266 1592760 1033 764693 1264 2024-09-19T07:16:53.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:16:53 smithi179 ceph-mon[35716]: pgmap v178: 97 pgs: 97 active+clean; 991 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.5 MiB/s wr, 928 op/s 2024-09-19T07:16:53.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:16:53 smithi148 ceph-mon[31180]: pgmap v178: 97 pgs: 97 active+clean; 991 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.5 MiB/s wr, 928 op/s 2024-09-19T07:16:53.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:16:53 smithi165 ceph-mon[35326]: pgmap v178: 97 pgs: 97 active+clean; 991 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.5 MiB/s wr, 928 op/s 2024-09-19T07:16:55.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:16:55 smithi179 ceph-mon[35716]: pgmap v179: 97 pgs: 97 active+clean; 991 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.7 MiB/s wr, 874 op/s 2024-09-19T07:16:55.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:16:55 smithi148 ceph-mon[31180]: pgmap v179: 97 pgs: 97 active+clean; 991 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.7 MiB/s wr, 874 op/s 2024-09-19T07:16:55.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:16:55 smithi165 ceph-mon[35326]: pgmap v179: 97 pgs: 97 active+clean; 991 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.7 MiB/s wr, 874 op/s 2024-09-19T07:16:57.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:16:57 smithi179 ceph-mon[35716]: pgmap v180: 97 pgs: 97 active+clean; 1.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 7.1 MiB/s wr, 1.21k op/s 2024-09-19T07:16:57.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:16:57 smithi148 ceph-mon[31180]: pgmap v180: 97 pgs: 97 active+clean; 1.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 7.1 MiB/s wr, 1.21k op/s 2024-09-19T07:16:57.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:16:57 smithi165 ceph-mon[35326]: pgmap v180: 97 pgs: 97 active+clean; 1.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 7.1 MiB/s wr, 1.21k op/s 2024-09-19T07:16:59.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:16:59 smithi179 ceph-mon[35716]: pgmap v181: 97 pgs: 97 active+clean; 1.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.1 MiB/s wr, 1.11k op/s 2024-09-19T07:16:59.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:16:59 smithi148 ceph-mon[31180]: pgmap v181: 97 pgs: 97 active+clean; 1.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.1 MiB/s wr, 1.11k op/s 2024-09-19T07:16:59.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:16:59 smithi165 ceph-mon[35326]: pgmap v181: 97 pgs: 97 active+clean; 1.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.1 MiB/s wr, 1.11k op/s 2024-09-19T07:17:00.031 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.027+0000 7f847afc0640 1 -- 172.21.15.148:0/824827756 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8474103aa0 msgr2=0x7f8474103e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:17:00.031 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.027+0000 7f847afc0640 1 --2- 172.21.15.148:0/824827756 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8474103aa0 0x7f8474103e80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8468009900 tx=0x7f846802a3f0 comp rx=0 tx=0).stop 2024-09-19T07:17:00.031 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.027+0000 7f847afc0640 1 -- 172.21.15.148:0/824827756 shutdown_connections 2024-09-19T07:17:00.031 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.027+0000 7f847afc0640 1 --2- 172.21.15.148:0/824827756 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84741008e0 0x7f847410ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:00.032 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.027+0000 7f847afc0640 1 --2- 172.21.15.148:0/824827756 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f84740fff60 0x7f84741003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:00.032 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.027+0000 7f847afc0640 1 --2- 172.21.15.148:0/824827756 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8474103aa0 0x7f8474103e80 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:00.032 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.027+0000 7f847afc0640 1 -- 172.21.15.148:0/824827756 >> 172.21.15.148:0/824827756 conn(0x7f84740770f0 msgr2=0x7f84740fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:17:00.032 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.027+0000 7f847afc0640 1 -- 172.21.15.148:0/824827756 shutdown_connections 2024-09-19T07:17:00.032 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.027+0000 7f847afc0640 1 -- 172.21.15.148:0/824827756 wait complete. 2024-09-19T07:17:00.032 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.028+0000 7f847afc0640 1 Processor -- start 2024-09-19T07:17:00.032 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.028+0000 7f847afc0640 1 -- start start 2024-09-19T07:17:00.032 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.028+0000 7f847afc0640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f84740fff60 0x7f8474198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:00.032 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.028+0000 7f847afc0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84741008e0 0x7f8474198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:00.032 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.028+0000 7f847afc0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8474103aa0 0x7f847419ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:00.032 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.028+0000 7f847afc0640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f84741120a0 con 0x7f8474103aa0 2024-09-19T07:17:00.032 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.028+0000 7f847afc0640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8474111f20 con 0x7f84740fff60 2024-09-19T07:17:00.032 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.028+0000 7f847afc0640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8474112220 con 0x7f84741008e0 2024-09-19T07:17:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.028+0000 7f847955d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8474103aa0 0x7f847419ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.028+0000 7f847955d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8474103aa0 0x7f847419ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38294/0 (socket says 172.21.15.148:38294) 2024-09-19T07:17:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.028+0000 7f847955d640 1 -- 172.21.15.148:0/1961705333 learned_addr learned my addr 172.21.15.148:0/1961705333 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:17:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.028+0000 7f8478d5c640 1 --2- 172.21.15.148:0/1961705333 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f84740fff60 0x7f8474198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.028+0000 7f8473fff640 1 --2- 172.21.15.148:0/1961705333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84741008e0 0x7f8474198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.028+0000 7f847955d640 1 -- 172.21.15.148:0/1961705333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84741008e0 msgr2=0x7f8474198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:17:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.028+0000 7f847955d640 1 --2- 172.21.15.148:0/1961705333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84741008e0 0x7f8474198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.028+0000 7f847955d640 1 -- 172.21.15.148:0/1961705333 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f84740fff60 msgr2=0x7f8474198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:17:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.028+0000 7f847955d640 1 --2- 172.21.15.148:0/1961705333 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f84740fff60 0x7f8474198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.029+0000 7f847955d640 1 -- 172.21.15.148:0/1961705333 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f847419d540 con 0x7f8474103aa0 2024-09-19T07:17:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.029+0000 7f847955d640 1 --2- 172.21.15.148:0/1961705333 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8474103aa0 0x7f847419ce10 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f846c00efd0 tx=0x7f846c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:17:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.029+0000 7f8471ffb640 1 -- 172.21.15.148:0/1961705333 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f846c003b70 con 0x7f8474103aa0 2024-09-19T07:17:00.034 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.029+0000 7f847afc0640 1 -- 172.21.15.148:0/1961705333 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f847419d830 con 0x7f8474103aa0 2024-09-19T07:17:00.034 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.029+0000 7f8471ffb640 1 -- 172.21.15.148:0/1961705333 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f846c003d10 con 0x7f8474103aa0 2024-09-19T07:17:00.034 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.029+0000 7f8471ffb640 1 -- 172.21.15.148:0/1961705333 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f846c010a30 con 0x7f8474103aa0 2024-09-19T07:17:00.034 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.029+0000 7f847afc0640 1 -- 172.21.15.148:0/1961705333 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84741a50c0 con 0x7f8474103aa0 2024-09-19T07:17:00.038 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.031+0000 7f8471ffb640 1 -- 172.21.15.148:0/1961705333 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f846c004000 con 0x7f8474103aa0 2024-09-19T07:17:00.039 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.032+0000 7f8471ffb640 1 --2- 172.21.15.148:0/1961705333 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f84640a3460 0x7f84640a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:00.039 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.032+0000 7f847de2f740 1 Processor -- start 2024-09-19T07:17:00.039 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.032+0000 7f847de2f740 1 -- start start 2024-09-19T07:17:00.039 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.032+0000 7f8471ffb640 1 -- 172.21.15.148:0/1961705333 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8512+0+0 (secure 0 0 0) 0x7f846c0d00a0 con 0x7f8474103aa0 2024-09-19T07:17:00.039 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.032+0000 7f8478d5c640 1 --2- 172.21.15.148:0/1961705333 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f84640a3460 0x7f84640a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:00.039 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.032+0000 7f847de2f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e907130af0 0x55e907130ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:00.039 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.032+0000 7f847de2f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e907131410 0x55e90713b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:00.039 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.032+0000 7f847de2f740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e90713bcb0 0x55e90713e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:00.039 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.032+0000 7f847de2f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55e9070952f0 con 0x55e907130af0 2024-09-19T07:17:00.039 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.032+0000 7f847de2f740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55e90703d270 con 0x55e90713bcb0 2024-09-19T07:17:00.039 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.032+0000 7f847de2f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55e9070912b0 con 0x55e907131410 2024-09-19T07:17:00.040 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.033+0000 7f8478d5c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e907130af0 0x55e907130ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:00.040 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.033+0000 7f847955d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e90713bcb0 0x55e90713e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:00.040 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.033+0000 7f8478d5c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e907130af0 0x55e907130ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38298/0 (socket says 172.21.15.148:38298) 2024-09-19T07:17:00.040 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.033+0000 7f8473fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e907131410 0x55e90713b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:00.040 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.033+0000 7f8478d5c640 1 -- 172.21.15.148:0/3120866832 learned_addr learned my addr 172.21.15.148:0/3120866832 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:17:00.040 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.033+0000 7f847955d640 1 -- 172.21.15.148:0/3120866832 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e907131410 msgr2=0x55e90713b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:17:00.040 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.033+0000 7f847955d640 1 --2- 172.21.15.148:0/3120866832 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e907131410 0x55e90713b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:00.040 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.033+0000 7f847955d640 1 -- 172.21.15.148:0/3120866832 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e907130af0 msgr2=0x55e907130ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:17:00.040 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.033+0000 7f847955d640 1 --2- 172.21.15.148:0/3120866832 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e907130af0 0x55e907130ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:00.040 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.033+0000 7f847955d640 1 -- 172.21.15.148:0/3120866832 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e90703c340 con 0x55e90713bcb0 2024-09-19T07:17:00.040 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.033+0000 7f8478d5c640 1 --2- 172.21.15.148:0/1961705333 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f84640a3460 0x7f84640a5920 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8468000c00 tx=0x7f8468031810 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:17:00.040 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.033+0000 7f8473fff640 1 --2- 172.21.15.148:0/3120866832 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e907131410 0x55e90713b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:17:00.040 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.033+0000 7f847955d640 1 --2- 172.21.15.148:0/3120866832 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e90713bcb0 0x55e90713e0a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f846c0cd800 tx=0x7f846c010430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9487176610085961 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:17:00.041 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.033+0000 7f845effd640 1 -- 172.21.15.148:0/3120866832 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f846c09ca90 con 0x55e90713bcb0 2024-09-19T07:17:00.041 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.033+0000 7f845effd640 1 -- 172.21.15.148:0/3120866832 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f846c09c390 con 0x55e90713bcb0 2024-09-19T07:17:00.041 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.033+0000 7f845effd640 1 -- 172.21.15.148:0/3120866832 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f846c098a00 con 0x55e90713bcb0 2024-09-19T07:17:00.041 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.034+0000 7f847de2f740 1 -- 172.21.15.148:0/3120866832 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e90713bcb0 msgr2=0x55e90713e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:17:00.041 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.034+0000 7f847de2f740 1 --2- 172.21.15.148:0/3120866832 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e90713bcb0 0x55e90713e0a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f846c0cd800 tx=0x7f846c010430 comp rx=0 tx=0).stop 2024-09-19T07:17:00.041 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.034+0000 7f847de2f740 1 -- 172.21.15.148:0/3120866832 shutdown_connections 2024-09-19T07:17:00.041 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.034+0000 7f847de2f740 1 --2- 172.21.15.148:0/3120866832 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e90713bcb0 0x55e90713e0a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:00.041 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.034+0000 7f847de2f740 1 --2- 172.21.15.148:0/3120866832 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e907131410 0x55e90713b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:00.041 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.034+0000 7f847de2f740 1 --2- 172.21.15.148:0/3120866832 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e907130af0 0x55e907130ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:00.041 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.034+0000 7f847de2f740 1 -- 172.21.15.148:0/3120866832 >> 172.21.15.148:0/3120866832 conn(0x55e90712d060 msgr2=0x55e90712d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:17:00.041 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.034+0000 7f847de2f740 1 -- 172.21.15.148:0/3120866832 shutdown_connections 2024-09-19T07:17:00.041 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.034+0000 7f847de2f740 1 -- 172.21.15.148:0/3120866832 wait complete. 2024-09-19T07:17:00.041 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.035+0000 7f847de2f740 1 -- start start 2024-09-19T07:17:00.042 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.035+0000 7f847de2f740 1 Processor -- start 2024-09-19T07:17:00.042 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.035+0000 7f847de2f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e907130af0 0x55e907138b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:00.042 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.035+0000 7f847de2f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e907131410 0x55e9071390d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:00.042 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.035+0000 7f847de2f740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e90713bcb0 0x55e907139610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:00.042 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.035+0000 7f847de2f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55e90713e880 con 0x55e907130af0 2024-09-19T07:17:00.042 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.035+0000 7f847de2f740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55e90701e290 con 0x55e90713bcb0 2024-09-19T07:17:00.042 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.035+0000 7f847de2f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55e90713ea00 con 0x55e907131410 2024-09-19T07:17:00.042 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.035+0000 7f847de2f740 10 client.0 _ll_register_callbacks cb 0x55e90704f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:17:00.042 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.035+0000 7f8478d5c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e907130af0 0x55e907138b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:00.042 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.035+0000 7f8478d5c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e907130af0 0x55e907138b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38310/0 (socket says 172.21.15.148:38310) 2024-09-19T07:17:00.042 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.035+0000 7f8478d5c640 1 -- 172.21.15.148:0/2336969158 learned_addr learned my addr 172.21.15.148:0/2336969158 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:17:00.042 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.035+0000 7f8473fff640 1 --2- 172.21.15.148:0/2336969158 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e907131410 0x55e9071390d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:00.042 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.035+0000 7f847955d640 1 --2- 172.21.15.148:0/2336969158 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e90713bcb0 0x55e907139610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:00.043 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.036+0000 7f8478d5c640 1 -- 172.21.15.148:0/2336969158 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e907131410 msgr2=0x55e9071390d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:17:00.043 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.036+0000 7f8478d5c640 1 --2- 172.21.15.148:0/2336969158 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e907131410 0x55e9071390d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:00.043 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.036+0000 7f8478d5c640 1 -- 172.21.15.148:0/2336969158 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e90713bcb0 msgr2=0x55e907139610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:17:00.043 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.036+0000 7f8478d5c640 1 --2- 172.21.15.148:0/2336969158 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e90713bcb0 0x55e907139610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:00.043 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.036+0000 7f8478d5c640 1 -- 172.21.15.148:0/2336969158 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e906da8210 con 0x55e907130af0 2024-09-19T07:17:00.043 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.036+0000 7f8478d5c640 1 --2- 172.21.15.148:0/2336969158 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e907130af0 0x55e907138b90 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f8468009230 tx=0x7f846802a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1cdc8ce134028b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:17:00.043 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.036+0000 7f8453fff640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:17:00.043 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.036+0000 7f8453fff640 1 -- 172.21.15.148:0/2336969158 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8468035040 con 0x55e907130af0 2024-09-19T07:17:00.043 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.036+0000 7f8453fff640 1 -- 172.21.15.148:0/2336969158 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8512+0+0 (secure 0 0 0) 0x7f8468003b80 con 0x55e907130af0 2024-09-19T07:17:00.043 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.036+0000 7f847de2f740 1 -- 172.21.15.148:0/2336969158 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f846c09c390 con 0x55e907130af0 2024-09-19T07:17:00.043 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.036+0000 7f8453fff640 1 -- 172.21.15.148:0/2336969158 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f8468059050 con 0x55e907130af0 2024-09-19T07:17:00.043 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.036+0000 7f847de2f740 10 client.16605 fetch_fsmap learned FSMap version 37 2024-09-19T07:17:00.043 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.036+0000 7f847de2f740 1 -- 172.21.15.148:0/2336969158 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55e906e74620 con 0x55e907130af0 2024-09-19T07:17:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.036+0000 7f8453fff640 1 -- 172.21.15.148:0/2336969158 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f846c09c390 con 0x55e907130af0 2024-09-19T07:17:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.036+0000 7f8453fff640 1 -- 172.21.15.148:0/2336969158 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 37) ==== 8370+0+0 (secure 0 0 0) 0x7f846803cce0 con 0x55e907130af0 2024-09-19T07:17:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.037+0000 7f847de2f740 10 client.16605 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T07:17:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.037+0000 7f847de2f740 10 client.16605 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:17:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.037+0000 7f847de2f740 20 client.16605 populate_metadata read hostname 'smithi148' 2024-09-19T07:17:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.037+0000 7f847de2f740 1 --2- 172.21.15.148:0/2336969158 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e90714bcb0 0x55e90714e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.037+0000 7f847de2f740 4 client.16605 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:17:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.037+0000 7f847de2f740 1 -- 172.21.15.148:0/2336969158 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e9070a2a20 con 0x55e90714bcb0 2024-09-19T07:17:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.037+0000 7f8473fff640 1 --2- 172.21.15.148:0/2336969158 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e90714bcb0 0x55e90714e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.037+0000 7f8473fff640 1 --2- 172.21.15.148:0/2336969158 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e90714bcb0 0x55e90714e0c0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63a0d7dd9af66cf7 server_cookie=20785797f79c7ce5 in_seq=0 out_seq=0 2024-09-19T07:17:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.037+0000 7f8453fff640 10 client.16605 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:17:00.045 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.040+0000 7f8453fff640 1 -- 172.21.15.148:0/2336969158 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e9070a2a20 con 0x55e90714bcb0 2024-09-19T07:17:00.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.040+0000 7f8453fff640 10 client.16605 handle_command_reply: tid=0 2024-09-19T07:17:00.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.040+0000 7f847de2f740 1 client.16605 shutdown 2024-09-19T07:17:00.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.041+0000 7f847de2f740 1 -- 172.21.15.148:0/2336969158 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e907130af0 msgr2=0x55e907138b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:17:00.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.041+0000 7f847de2f740 1 --2- 172.21.15.148:0/2336969158 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e907130af0 0x55e907138b90 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f8468009230 tx=0x7f846802a3f0 comp rx=0 tx=0).stop 2024-09-19T07:17:00.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.041+0000 7f847de2f740 1 -- 172.21.15.148:0/2336969158 shutdown_connections 2024-09-19T07:17:00.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.041+0000 7f847de2f740 1 --2- 172.21.15.148:0/2336969158 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e90714bcb0 0x55e90714e0c0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:00.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.041+0000 7f847de2f740 1 --2- 172.21.15.148:0/2336969158 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e90713bcb0 0x55e907139610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:00.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.041+0000 7f8453fff640 0 client.16605 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:17:00.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.041+0000 7f847de2f740 1 --2- 172.21.15.148:0/2336969158 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e907131410 0x55e9071390d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:00.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.041+0000 7f847de2f740 1 --2- 172.21.15.148:0/2336969158 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e907130af0 0x55e907138b90 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:00.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.041+0000 7f847de2f740 1 -- 172.21.15.148:0/2336969158 >> 172.21.15.148:0/2336969158 conn(0x55e90712d060 msgr2=0x55e907132dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:17:00.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.041+0000 7f847de2f740 1 -- 172.21.15.148:0/2336969158 shutdown_connections 2024-09-19T07:17:00.047 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.041+0000 7f847de2f740 1 -- 172.21.15.148:0/2336969158 wait complete. 2024-09-19T07:17:00.047 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.041+0000 7f847de2f740 20 client.16605 trim_cache size 0 max 16384 2024-09-19T07:17:00.058 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.055+0000 7f847de2f740 1 Processor -- start 2024-09-19T07:17:00.059 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.055+0000 7f847de2f740 1 -- start start 2024-09-19T07:17:00.059 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.056+0000 7f847de2f740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e907130af0 0x55e907139440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:00.059 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.056+0000 7f847de2f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e907131410 0x55e9071539d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:00.059 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.056+0000 7f847de2f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e90713bcb0 0x55e907153f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:00.059 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.056+0000 7f847de2f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f84741b01b0 con 0x55e90713bcb0 2024-09-19T07:17:00.059 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.056+0000 7f847de2f740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f84741ad9c0 con 0x55e907130af0 2024-09-19T07:17:00.059 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.056+0000 7f847de2f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f84741ab7f0 con 0x55e907131410 2024-09-19T07:17:00.059 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.056+0000 7f847955d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e90713bcb0 0x55e907153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:00.059 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.056+0000 7f847955d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e90713bcb0 0x55e907153f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38316/0 (socket says 172.21.15.148:38316) 2024-09-19T07:17:00.059 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.056+0000 7f847955d640 1 -- 172.21.15.148:0/3222858328 learned_addr learned my addr 172.21.15.148:0/3222858328 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:17:00.059 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.056+0000 7f8473fff640 1 --2- 172.21.15.148:0/3222858328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e907131410 0x55e9071539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:00.059 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.056+0000 7f8478d5c640 1 --2- 172.21.15.148:0/3222858328 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e907130af0 0x55e907139440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:00.059 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.056+0000 7f847955d640 1 -- 172.21.15.148:0/3222858328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e907131410 msgr2=0x55e9071539d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:17:00.060 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.056+0000 7f847955d640 1 --2- 172.21.15.148:0/3222858328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e907131410 0x55e9071539d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:00.060 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.056+0000 7f847955d640 1 -- 172.21.15.148:0/3222858328 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e907130af0 msgr2=0x55e907139440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:17:00.060 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.056+0000 7f847955d640 1 --2- 172.21.15.148:0/3222858328 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e907130af0 0x55e907139440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:00.060 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.056+0000 7f847955d640 1 -- 172.21.15.148:0/3222858328 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e90714e740 con 0x55e90713bcb0 2024-09-19T07:17:00.060 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.056+0000 7f8473fff640 1 --2- 172.21.15.148:0/3222858328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e907131410 0x55e9071539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:17:00.060 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.056+0000 7f847955d640 1 --2- 172.21.15.148:0/3222858328 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e90713bcb0 0x55e907153f10 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f846c00cba0 tx=0x7f846c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbb0f2204d0f6c9c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:17:00.060 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.056+0000 7f845e7fc640 1 -- 172.21.15.148:0/3222858328 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f846c0a0740 con 0x55e90713bcb0 2024-09-19T07:17:00.060 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.057+0000 7f845e7fc640 1 -- 172.21.15.148:0/3222858328 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f846c09c390 con 0x55e90713bcb0 2024-09-19T07:17:00.060 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.057+0000 7f845e7fc640 1 -- 172.21.15.148:0/3222858328 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f846c098b90 con 0x55e90713bcb0 2024-09-19T07:17:00.060 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.057+0000 7f847de2f740 1 -- 172.21.15.148:0/3222858328 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e90713bcb0 msgr2=0x55e907153f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:17:00.060 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.057+0000 7f847de2f740 1 --2- 172.21.15.148:0/3222858328 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e90713bcb0 0x55e907153f10 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f846c00cba0 tx=0x7f846c00cf90 comp rx=0 tx=0).stop 2024-09-19T07:17:00.060 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.057+0000 7f847de2f740 1 -- 172.21.15.148:0/3222858328 shutdown_connections 2024-09-19T07:17:00.060 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.057+0000 7f847de2f740 1 --2- 172.21.15.148:0/3222858328 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e90713bcb0 0x55e907153f10 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:00.061 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.057+0000 7f847de2f740 1 --2- 172.21.15.148:0/3222858328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e907131410 0x55e9071539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:00.061 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.057+0000 7f847de2f740 1 --2- 172.21.15.148:0/3222858328 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e907130af0 0x55e907139440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:00.061 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.057+0000 7f847de2f740 1 -- 172.21.15.148:0/3222858328 >> 172.21.15.148:0/3222858328 conn(0x55e90712d060 msgr2=0x55e90713ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:17:00.061 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.058+0000 7f847de2f740 1 -- 172.21.15.148:0/3222858328 shutdown_connections 2024-09-19T07:17:00.061 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.058+0000 7f847de2f740 1 -- 172.21.15.148:0/3222858328 wait complete. 2024-09-19T07:17:00.061 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.058+0000 7f847de2f740 1 -- start start 2024-09-19T07:17:00.061 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.058+0000 7f847de2f740 1 Processor -- start 2024-09-19T07:17:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.058+0000 7f847de2f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e907130af0 0x55e907135b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.058+0000 7f847de2f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e907131410 0x55e907136060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.058+0000 7f847de2f740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e90713bcb0 0x55e9071365a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.058+0000 7f847de2f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f84741abe80 con 0x55e907131410 2024-09-19T07:17:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.058+0000 7f847de2f740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f84741ad2f0 con 0x55e90713bcb0 2024-09-19T07:17:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.058+0000 7f847de2f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f84741ac550 con 0x55e907130af0 2024-09-19T07:17:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.058+0000 7f847de2f740 10 client.0 _ll_register_callbacks cb 0x7f8468009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:17:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.058+0000 7f8473fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e907131410 0x55e907136060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.058+0000 7f8473fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e907131410 0x55e907136060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38320/0 (socket says 172.21.15.148:38320) 2024-09-19T07:17:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.058+0000 7f8473fff640 1 -- 172.21.15.148:0/1962431273 learned_addr learned my addr 172.21.15.148:0/1962431273 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:17:00.065 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.058+0000 7f8478d5c640 1 --2- 172.21.15.148:0/1962431273 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e907130af0 0x55e907135b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:00.065 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.058+0000 7f847955d640 1 --2- 172.21.15.148:0/1962431273 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e90713bcb0 0x55e9071365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:00.065 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.059+0000 7f8473fff640 1 -- 172.21.15.148:0/1962431273 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e907130af0 msgr2=0x55e907135b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:17:00.065 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.059+0000 7f8473fff640 1 --2- 172.21.15.148:0/1962431273 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e907130af0 0x55e907135b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:00.065 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.059+0000 7f8473fff640 1 -- 172.21.15.148:0/1962431273 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e90713bcb0 msgr2=0x55e9071365a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:17:00.065 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.059+0000 7f8473fff640 1 --2- 172.21.15.148:0/1962431273 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e90713bcb0 0x55e9071365a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:00.065 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.059+0000 7f8473fff640 1 -- 172.21.15.148:0/1962431273 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9071b59a0 con 0x55e907131410 2024-09-19T07:17:00.065 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.059+0000 7f8473fff640 1 --2- 172.21.15.148:0/1962431273 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e907131410 0x55e907136060 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f8460009e50 tx=0x7f846001fb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b22560ca9f646b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:17:00.065 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.059+0000 7f8453fff640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:17:00.065 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.059+0000 7f8453fff640 1 -- 172.21.15.148:0/1962431273 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8460010b60 con 0x55e907131410 2024-09-19T07:17:00.065 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.059+0000 7f8453fff640 1 -- 172.21.15.148:0/1962431273 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8512+0+0 (secure 0 0 0) 0x7f8460010d00 con 0x55e907131410 2024-09-19T07:17:00.065 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.059+0000 7f847de2f740 1 -- 172.21.15.148:0/1962431273 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f846c09c390 con 0x55e907131410 2024-09-19T07:17:00.065 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.059+0000 7f8453fff640 1 -- 172.21.15.148:0/1962431273 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f8460026410 con 0x55e907131410 2024-09-19T07:17:00.065 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.059+0000 7f847de2f740 10 client.16611 fetch_fsmap learned FSMap version 37 2024-09-19T07:17:00.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.059+0000 7f847de2f740 1 -- 172.21.15.148:0/1962431273 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55e9071b6c70 con 0x55e907131410 2024-09-19T07:17:00.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.059+0000 7f8453fff640 1 -- 172.21.15.148:0/1962431273 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f846c09c390 con 0x55e907131410 2024-09-19T07:17:00.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.059+0000 7f8453fff640 1 -- 172.21.15.148:0/1962431273 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 37) ==== 8370+0+0 (secure 0 0 0) 0x7f846002e520 con 0x55e907131410 2024-09-19T07:17:00.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.060+0000 7f847de2f740 10 client.16611 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T07:17:00.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.060+0000 7f847de2f740 10 client.16611 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:17:00.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.060+0000 7f847de2f740 20 client.16611 populate_metadata read hostname 'smithi148' 2024-09-19T07:17:00.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.060+0000 7f847de2f740 1 --2- 172.21.15.148:0/1962431273 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e9071b74d0 0x55e9071b98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:00.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.060+0000 7f847de2f740 4 client.16611 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:17:00.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.060+0000 7f847de2f740 1 -- 172.21.15.148:0/1962431273 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e90709cd70 con 0x55e9071b74d0 2024-09-19T07:17:00.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.060+0000 7f8478d5c640 1 --2- 172.21.15.148:0/1962431273 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e9071b74d0 0x55e9071b98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:00.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.060+0000 7f8478d5c640 1 --2- 172.21.15.148:0/1962431273 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e9071b74d0 0x55e9071b98f0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9f9c84813b388c4 server_cookie=87690fd8677cb486 in_seq=0 out_seq=0 2024-09-19T07:17:00.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:00.060+0000 7f8453fff640 10 client.16611 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:17:01.229 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:01.227+0000 7f8453fff640 1 -- 172.21.15.148:0/1962431273 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e90709cd70 con 0x55e9071b74d0 2024-09-19T07:17:01.229 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:01.227+0000 7f8453fff640 10 client.16611 handle_command_reply: tid=0 2024-09-19T07:17:01.229 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:01.227+0000 7f847de2f740 1 client.16611 shutdown 2024-09-19T07:17:01.229 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:01.227+0000 7f847de2f740 1 -- 172.21.15.148:0/1962431273 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e907131410 msgr2=0x55e907136060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:17:01.229 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:01.228+0000 7f847de2f740 1 --2- 172.21.15.148:0/1962431273 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e907131410 0x55e907136060 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f8460009e50 tx=0x7f846001fb70 comp rx=0 tx=0).stop 2024-09-19T07:17:01.229 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:01.228+0000 7f847de2f740 1 -- 172.21.15.148:0/1962431273 shutdown_connections 2024-09-19T07:17:01.229 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:01.228+0000 7f847de2f740 1 --2- 172.21.15.148:0/1962431273 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e9071b74d0 0x55e9071b98f0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:01.230 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:01.228+0000 7f847de2f740 1 --2- 172.21.15.148:0/1962431273 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e90713bcb0 0x55e9071365a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:01.230 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:01.228+0000 7f847de2f740 1 --2- 172.21.15.148:0/1962431273 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e907131410 0x55e907136060 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:01.230 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:01.228+0000 7f847de2f740 1 --2- 172.21.15.148:0/1962431273 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e907130af0 0x55e907135b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:01.230 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:01.228+0000 7f847de2f740 1 -- 172.21.15.148:0/1962431273 >> 172.21.15.148:0/1962431273 conn(0x55e90712d060 msgr2=0x55e90713a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:17:01.230 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:01.228+0000 7f8453fff640 0 client.16611 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:17:01.230 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:01.228+0000 7f847de2f740 1 -- 172.21.15.148:0/1962431273 shutdown_connections 2024-09-19T07:17:01.230 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:01.228+0000 7f847de2f740 1 -- 172.21.15.148:0/1962431273 wait complete. 2024-09-19T07:17:01.230 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:01.228+0000 7f847de2f740 20 client.16611 trim_cache size 0 max 16384 2024-09-19T07:17:01.230 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:17:01.231 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:17:01.231 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:17:01.231 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:17:01.231 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:01.229+0000 7f847afc0640 1 -- 172.21.15.148:0/1961705333 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f84640a3460 msgr2=0x7f84640a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:17:01.232 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:01.229+0000 7f847afc0640 1 --2- 172.21.15.148:0/1961705333 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f84640a3460 0x7f84640a5920 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8468000c00 tx=0x7f8468031810 comp rx=0 tx=0).stop 2024-09-19T07:17:01.232 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:01.229+0000 7f847afc0640 1 -- 172.21.15.148:0/1961705333 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8474103aa0 msgr2=0x7f847419ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:17:01.232 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:01.229+0000 7f847afc0640 1 --2- 172.21.15.148:0/1961705333 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8474103aa0 0x7f847419ce10 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f846c00efd0 tx=0x7f846c00c6a0 comp rx=0 tx=0).stop 2024-09-19T07:17:01.232 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:01.229+0000 7f847afc0640 1 -- 172.21.15.148:0/1961705333 shutdown_connections 2024-09-19T07:17:01.232 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:01.229+0000 7f847afc0640 1 --2- 172.21.15.148:0/1961705333 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f84640a3460 0x7f84640a5920 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:01.232 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:01.229+0000 7f847afc0640 1 --2- 172.21.15.148:0/1961705333 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8474103aa0 0x7f847419ce10 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:01.232 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:01.229+0000 7f847afc0640 1 --2- 172.21.15.148:0/1961705333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84741008e0 0x7f8474198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:01.232 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:01.229+0000 7f847afc0640 1 --2- 172.21.15.148:0/1961705333 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f84740fff60 0x7f8474198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:01.232 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:01.229+0000 7f847afc0640 1 -- 172.21.15.148:0/1961705333 >> 172.21.15.148:0/1961705333 conn(0x7f84740770f0 msgr2=0x7f8474105bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:17:01.232 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:01.229+0000 7f847afc0640 1 -- 172.21.15.148:0/1961705333 shutdown_connections 2024-09-19T07:17:01.232 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:01.230+0000 7f847afc0640 1 -- 172.21.15.148:0/1961705333 wait complete. 2024-09-19T07:17:01.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:17:01 smithi179 ceph-mon[35716]: pgmap v182: 97 pgs: 97 active+clean; 1.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.3 MiB/s wr, 1.13k op/s 2024-09-19T07:17:01.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:17:01 smithi148 ceph-mon[31180]: pgmap v182: 97 pgs: 97 active+clean; 1.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.3 MiB/s wr, 1.13k op/s 2024-09-19T07:17:01.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:17:01 smithi165 ceph-mon[35326]: pgmap v182: 97 pgs: 97 active+clean; 1.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.3 MiB/s wr, 1.13k op/s 2024-09-19T07:17:03.195 INFO:tasks.workunit.client.0.smithi148.stdout: 291 1201309 553 795789 518 379865 1259 2024-09-19T07:17:03.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:17:03 smithi179 ceph-mon[35716]: pgmap v183: 97 pgs: 97 active+clean; 1.1 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 14 MiB/s wr, 1.50k op/s 2024-09-19T07:17:03.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:17:03 smithi148 ceph-mon[31180]: pgmap v183: 97 pgs: 97 active+clean; 1.1 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 14 MiB/s wr, 1.50k op/s 2024-09-19T07:17:03.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:17:03 smithi165 ceph-mon[35326]: pgmap v183: 97 pgs: 97 active+clean; 1.1 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 14 MiB/s wr, 1.50k op/s 2024-09-19T07:17:05.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:17:05 smithi179 ceph-mon[35716]: pgmap v184: 97 pgs: 97 active+clean; 1.1 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 13 MiB/s wr, 828 op/s 2024-09-19T07:17:05.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:17:05 smithi148 ceph-mon[31180]: pgmap v184: 97 pgs: 97 active+clean; 1.1 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 13 MiB/s wr, 828 op/s 2024-09-19T07:17:05.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:17:05 smithi165 ceph-mon[35326]: pgmap v184: 97 pgs: 97 active+clean; 1.1 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 13 MiB/s wr, 828 op/s 2024-09-19T07:17:07.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:17:07 smithi179 ceph-mon[35716]: pgmap v185: 97 pgs: 97 active+clean; 1.1 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 15 MiB/s wr, 1.50k op/s 2024-09-19T07:17:07.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:17:07 smithi148 ceph-mon[31180]: pgmap v185: 97 pgs: 97 active+clean; 1.1 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 15 MiB/s wr, 1.50k op/s 2024-09-19T07:17:07.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:17:07 smithi165 ceph-mon[35326]: pgmap v185: 97 pgs: 97 active+clean; 1.1 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 15 MiB/s wr, 1.50k op/s 2024-09-19T07:17:09.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:17:09 smithi179 ceph-mon[35716]: pgmap v186: 97 pgs: 97 active+clean; 1.1 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 11 MiB/s wr, 1.22k op/s 2024-09-19T07:17:09.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:17:09 smithi148 ceph-mon[31180]: pgmap v186: 97 pgs: 97 active+clean; 1.1 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 11 MiB/s wr, 1.22k op/s 2024-09-19T07:17:09.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:17:09 smithi165 ceph-mon[35326]: pgmap v186: 97 pgs: 97 active+clean; 1.1 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 11 MiB/s wr, 1.22k op/s 2024-09-19T07:17:11.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:17:11 smithi179 ceph-mon[35716]: pgmap v187: 97 pgs: 97 active+clean; 1.1 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 11 MiB/s wr, 1.19k op/s 2024-09-19T07:17:11.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:17:11 smithi148 ceph-mon[31180]: pgmap v187: 97 pgs: 97 active+clean; 1.1 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 11 MiB/s wr, 1.19k op/s 2024-09-19T07:17:11.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:17:11 smithi165 ceph-mon[35326]: pgmap v187: 97 pgs: 97 active+clean; 1.1 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 11 MiB/s wr, 1.19k op/s 2024-09-19T07:17:13.195 INFO:tasks.workunit.client.0.smithi148.stdout: 319 2593980 1594 1733106 1521 897615 3310 2024-09-19T07:17:13.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:17:13 smithi179 ceph-mon[35716]: pgmap v188: 97 pgs: 97 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 13 MiB/s wr, 1.27k op/s 2024-09-19T07:17:13.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:17:13 smithi148 ceph-mon[31180]: pgmap v188: 97 pgs: 97 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 13 MiB/s wr, 1.27k op/s 2024-09-19T07:17:13.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:17:13 smithi165 ceph-mon[35326]: pgmap v188: 97 pgs: 97 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 13 MiB/s wr, 1.27k op/s 2024-09-19T07:17:15.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:17:15 smithi179 ceph-mon[35716]: pgmap v189: 97 pgs: 97 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.5 MiB/s wr, 821 op/s 2024-09-19T07:17:15.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:17:15 smithi148 ceph-mon[31180]: pgmap v189: 97 pgs: 97 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.5 MiB/s wr, 821 op/s 2024-09-19T07:17:15.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:17:15 smithi165 ceph-mon[35326]: pgmap v189: 97 pgs: 97 active+clean; 1.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.5 MiB/s wr, 821 op/s 2024-09-19T07:17:17.499 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.496+0000 7fe8d3362640 1 -- 172.21.15.148:0/2480082277 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8cc1091f0 msgr2=0x7fe8cc110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:17:17.499 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.496+0000 7fe8d3362640 1 --2- 172.21.15.148:0/2480082277 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8cc1091f0 0x7fe8cc110250 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc01a910 tx=0x7fe8bc03b470 comp rx=0 tx=0).stop 2024-09-19T07:17:17.499 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.496+0000 7fe8d3362640 1 -- 172.21.15.148:0/2480082277 shutdown_connections 2024-09-19T07:17:17.499 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.496+0000 7fe8d3362640 1 --2- 172.21.15.148:0/2480082277 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8cc11b140 0x7fe8cc11d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:17.499 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.496+0000 7fe8d3362640 1 --2- 172.21.15.148:0/2480082277 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8cc1095d0 0x7fe8cc109a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:17.500 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.496+0000 7fe8d3362640 1 --2- 172.21.15.148:0/2480082277 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8cc1091f0 0x7fe8cc110250 secure :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc01a910 tx=0x7fe8bc03b470 comp rx=0 tx=0).stop 2024-09-19T07:17:17.500 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.496+0000 7fe8d3362640 1 -- 172.21.15.148:0/2480082277 >> 172.21.15.148:0/2480082277 conn(0x7fe8cc06cbf0 msgr2=0x7fe8cc06d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:17:17.500 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.497+0000 7fe8d3362640 1 -- 172.21.15.148:0/2480082277 shutdown_connections 2024-09-19T07:17:17.504 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.497+0000 7fe8d3362640 1 -- 172.21.15.148:0/2480082277 wait complete. 2024-09-19T07:17:17.505 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.498+0000 7fe8d3362640 1 Processor -- start 2024-09-19T07:17:17.505 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.498+0000 7fe8d3362640 1 -- start start 2024-09-19T07:17:17.505 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.498+0000 7fe8d3362640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8cc1095d0 0x7fe8cc11aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:17.505 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.498+0000 7fe8d3362640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8cc11b140 0x7fe8cc116b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:17.505 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.498+0000 7fe8d3362640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8cc117050 0x7fe8cc1174e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:17.506 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.498+0000 7fe8d3362640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe8cc1132f0 con 0x7fe8cc1095d0 2024-09-19T07:17:17.506 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.498+0000 7fe8d3362640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe8cc113170 con 0x7fe8cc11b140 2024-09-19T07:17:17.506 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.498+0000 7fe8d3362640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe8cc113470 con 0x7fe8cc117050 2024-09-19T07:17:17.506 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.499+0000 7fe8d1b5f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8cc11b140 0x7fe8cc116b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:17.506 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.499+0000 7fe8d1b5f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8cc11b140 0x7fe8cc116b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:59526/0 (socket says 172.21.15.148:59526) 2024-09-19T07:17:17.507 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.499+0000 7fe8d1b5f640 1 -- 172.21.15.148:0/2309766428 learned_addr learned my addr 172.21.15.148:0/2309766428 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:17:17.507 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.499+0000 7fe8d2b61640 1 --2- 172.21.15.148:0/2309766428 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8cc117050 0x7fe8cc1174e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:17.507 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.499+0000 7fe8d1b5f640 1 -- 172.21.15.148:0/2309766428 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8cc117050 msgr2=0x7fe8cc1174e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:17:17.507 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.499+0000 7fe8d1b5f640 1 --2- 172.21.15.148:0/2309766428 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8cc117050 0x7fe8cc1174e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:17.508 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.499+0000 7fe8d1b5f640 1 -- 172.21.15.148:0/2309766428 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8cc1095d0 msgr2=0x7fe8cc11aa80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T07:17:17.508 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.499+0000 7fe8d1b5f640 1 --2- 172.21.15.148:0/2309766428 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8cc1095d0 0x7fe8cc11aa80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:17.508 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.499+0000 7fe8d1b5f640 1 -- 172.21.15.148:0/2309766428 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8cc07a640 con 0x7fe8cc11b140 2024-09-19T07:17:17.509 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.500+0000 7fe8d1b5f640 1 --2- 172.21.15.148:0/2309766428 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8cc11b140 0x7fe8cc116b10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe8c800c890 tx=0x7fe8c800cd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:17:17.515 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.514+0000 7fe8c37fe640 1 -- 172.21.15.148:0/2309766428 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c8004220 con 0x7fe8cc11b140 2024-09-19T07:17:17.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:17:17 smithi179 ceph-mon[35716]: pgmap v190: 97 pgs: 97 active+clean; 1.2 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 6.3 MiB/s wr, 900 op/s 2024-09-19T07:17:17.525 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.514+0000 7fe8d3362640 1 -- 172.21.15.148:0/2309766428 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8cc07a930 con 0x7fe8cc11b140 2024-09-19T07:17:17.525 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.514+0000 7fe8d3362640 1 -- 172.21.15.148:0/2309766428 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8cc07ae80 con 0x7fe8cc11b140 2024-09-19T07:17:17.525 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.522+0000 7fe8d743b740 1 Processor -- start 2024-09-19T07:17:17.526 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.522+0000 7fe8d743b740 1 -- start start 2024-09-19T07:17:17.526 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.522+0000 7fe8d743b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fc1a652cc0 0x55fc1a6530a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:17.526 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.523+0000 7fe8d2b61640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fc1a652cc0 0x55fc1a6530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:17.526 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.523+0000 7fe8d743b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fc1a6535e0 0x55fc1a65d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:17.526 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.523+0000 7fe8d743b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fc1a65de80 0x55fc1a660270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:17.526 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.523+0000 7fe8d743b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55fc1a5b72f0 con 0x55fc1a652cc0 2024-09-19T07:17:17.526 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.523+0000 7fe8d743b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55fc1a55f270 con 0x55fc1a6535e0 2024-09-19T07:17:17.527 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.523+0000 7fe8d743b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55fc1a5b32b0 con 0x55fc1a65de80 2024-09-19T07:17:17.527 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.524+0000 7fe8d1b5f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fc1a65de80 0x55fc1a660270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:17.527 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.524+0000 7fe8d1b5f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fc1a65de80 0x55fc1a660270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:37158/0 (socket says 172.21.15.148:37158) 2024-09-19T07:17:17.527 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.524+0000 7fe8d1b5f640 1 -- 172.21.15.148:0/1631161483 learned_addr learned my addr 172.21.15.148:0/1631161483 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:17:17.529 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.525+0000 7fe8d1b5f640 1 -- 172.21.15.148:0/1631161483 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fc1a6535e0 msgr2=0x55fc1a65d940 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T07:17:17.530 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.525+0000 7fe8d1b5f640 1 --2- 172.21.15.148:0/1631161483 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fc1a6535e0 0x55fc1a65d940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:17.530 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.525+0000 7fe8d1b5f640 1 -- 172.21.15.148:0/1631161483 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fc1a652cc0 msgr2=0x55fc1a6530a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:17:17.530 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.525+0000 7fe8d1b5f640 1 --2- 172.21.15.148:0/1631161483 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fc1a652cc0 0x55fc1a6530a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:17.530 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.525+0000 7fe8d1b5f640 1 -- 172.21.15.148:0/1631161483 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc1a55e340 con 0x55fc1a65de80 2024-09-19T07:17:17.530 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.525+0000 7fe8d1b5f640 1 --2- 172.21.15.148:0/1631161483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fc1a65de80 0x55fc1a660270 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe8c80ce1b0 tx=0x7fe8c80d9580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef455ea5a97fd3e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:17:17.530 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.525+0000 7fe8c37fe640 1 -- 172.21.15.148:0/2309766428 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8c80043c0 con 0x7fe8cc11b140 2024-09-19T07:17:17.530 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.525+0000 7fe8c37fe640 1 -- 172.21.15.148:0/2309766428 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c80049c0 con 0x7fe8cc11b140 2024-09-19T07:17:17.531 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.526+0000 7fe8c37fe640 1 -- 172.21.15.148:0/2309766428 <== mon.2 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fe8c8004c40 con 0x7fe8cc11b140 2024-09-19T07:17:17.531 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.527+0000 7fe8c37fe640 1 --2- 172.21.15.148:0/2309766428 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe8b80a35b0 0x7fe8b80a5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:17.531 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.528+0000 7fe8c37fe640 1 -- 172.21.15.148:0/2309766428 <== mon.2 v2:172.21.15.165:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8512+0+0 (secure 0 0 0) 0x7fe8c80d0ad0 con 0x7fe8cc11b140 2024-09-19T07:17:17.532 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.530+0000 7fe8d2b61640 1 --2- 172.21.15.148:0/2309766428 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe8b80a35b0 0x7fe8b80a5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:17.545 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.544+0000 7fe8d2b61640 1 --2- 172.21.15.148:0/2309766428 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe8b80a35b0 0x7fe8b80a5a70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4009fd0 tx=0x7fe8c400e040 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:17:17.578 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.577+0000 7fe8c0bfe640 1 -- 172.21.15.148:0/1631161483 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c80de630 con 0x55fc1a65de80 2024-09-19T07:17:17.578 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.577+0000 7fe8c0bfe640 1 -- 172.21.15.148:0/1631161483 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8c80d4e10 con 0x55fc1a65de80 2024-09-19T07:17:17.578 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.577+0000 7fe8c0bfe640 1 -- 172.21.15.148:0/1631161483 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c80ddb50 con 0x55fc1a65de80 2024-09-19T07:17:17.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.579+0000 7fe8d743b740 1 -- 172.21.15.148:0/1631161483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fc1a65de80 msgr2=0x55fc1a660270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:17:17.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.579+0000 7fe8d743b740 1 --2- 172.21.15.148:0/1631161483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fc1a65de80 0x55fc1a660270 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe8c80ce1b0 tx=0x7fe8c80d9580 comp rx=0 tx=0).stop 2024-09-19T07:17:17.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.579+0000 7fe8d743b740 1 -- 172.21.15.148:0/1631161483 shutdown_connections 2024-09-19T07:17:17.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.579+0000 7fe8d743b740 1 --2- 172.21.15.148:0/1631161483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fc1a65de80 0x55fc1a660270 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:17.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.579+0000 7fe8d743b740 1 --2- 172.21.15.148:0/1631161483 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fc1a6535e0 0x55fc1a65d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:17.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.579+0000 7fe8d743b740 1 --2- 172.21.15.148:0/1631161483 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fc1a652cc0 0x55fc1a6530a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:17.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.579+0000 7fe8d743b740 1 -- 172.21.15.148:0/1631161483 >> 172.21.15.148:0/1631161483 conn(0x55fc1a64f230 msgr2=0x55fc1a64f610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:17:17.581 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.579+0000 7fe8d743b740 1 -- 172.21.15.148:0/1631161483 shutdown_connections 2024-09-19T07:17:17.581 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.580+0000 7fe8d743b740 1 -- 172.21.15.148:0/1631161483 wait complete. 2024-09-19T07:17:17.581 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.580+0000 7fe8d743b740 1 -- start start 2024-09-19T07:17:17.581 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.580+0000 7fe8d743b740 1 Processor -- start 2024-09-19T07:17:17.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:17:17 smithi148 ceph-mon[31180]: pgmap v190: 97 pgs: 97 active+clean; 1.2 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 6.3 MiB/s wr, 900 op/s 2024-09-19T07:17:17.584 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.582+0000 7fe8d743b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fc1a652cc0 0x55fc1a65ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:17.584 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.582+0000 7fe8d743b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fc1a6535e0 0x55fc1a65b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:17.584 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.582+0000 7fe8d743b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fc1a65de80 0x55fc1a65b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:17.584 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.582+0000 7fe8d743b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55fc1a660a50 con 0x55fc1a652cc0 2024-09-19T07:17:17.584 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.582+0000 7fe8d743b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55fc1a540290 con 0x55fc1a65de80 2024-09-19T07:17:17.584 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.582+0000 7fe8d743b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55fc1a660bd0 con 0x55fc1a6535e0 2024-09-19T07:17:17.584 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.582+0000 7fe8d743b740 10 client.0 _ll_register_callbacks cb 0x55fc1a571140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:17:17.585 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.583+0000 7fe8d2b61640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fc1a65de80 0x55fc1a65b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:17.585 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.583+0000 7fe8d2b61640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fc1a65de80 0x55fc1a65b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:59540/0 (socket says 172.21.15.148:59540) 2024-09-19T07:17:17.585 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.583+0000 7fe8d2b61640 1 -- 172.21.15.148:0/3180725818 learned_addr learned my addr 172.21.15.148:0/3180725818 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:17:17.585 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.583+0000 7fe8d1b5f640 1 --2- 172.21.15.148:0/3180725818 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fc1a6535e0 0x55fc1a65b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:17.585 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.583+0000 7fe8d2b61640 1 -- 172.21.15.148:0/3180725818 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fc1a6535e0 msgr2=0x55fc1a65b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:17:17.585 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.583+0000 7fe8d2b61640 1 --2- 172.21.15.148:0/3180725818 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fc1a6535e0 0x55fc1a65b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:17.585 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.583+0000 7fe8d2b61640 1 -- 172.21.15.148:0/3180725818 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fc1a652cc0 msgr2=0x55fc1a65ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:17:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.583+0000 7fe8d2b61640 1 --2- 172.21.15.148:0/3180725818 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fc1a652cc0 0x55fc1a65ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.583+0000 7fe8d2b61640 1 -- 172.21.15.148:0/3180725818 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc1a2ca210 con 0x55fc1a65de80 2024-09-19T07:17:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.584+0000 7fe8d2b61640 1 --2- 172.21.15.148:0/3180725818 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fc1a65de80 0x55fc1a65b7b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4018e70 tx=0x7fe8c4004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b46fdd8066b18eeb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:17:17.598 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.597+0000 7fe8b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-19T07:17:17.599 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.597+0000 7fe8b5ffb640 1 -- 172.21.15.148:0/3180725818 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c4016d20 con 0x55fc1a65de80 2024-09-19T07:17:17.599 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.597+0000 7fe8d743b740 1 -- 172.21.15.148:0/3180725818 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8c80d4e10 con 0x55fc1a65de80 2024-09-19T07:17:17.599 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.597+0000 7fe8b5ffb640 1 -- 172.21.15.148:0/3180725818 <== mon.2 v2:172.21.15.165:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8512+0+0 (secure 0 0 0) 0x7fe8c4018030 con 0x55fc1a65de80 2024-09-19T07:17:17.599 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.597+0000 7fe8b5ffb640 1 -- 172.21.15.148:0/3180725818 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fe8c4018230 con 0x55fc1a65de80 2024-09-19T07:17:17.599 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.597+0000 7fe8d743b740 10 client.25922 fetch_fsmap learned FSMap version 37 2024-09-19T07:17:17.599 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.598+0000 7fe8d743b740 1 -- 172.21.15.148:0/3180725818 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55fc1a396620 con 0x55fc1a65de80 2024-09-19T07:17:17.600 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.599+0000 7fe8b5ffb640 1 -- 172.21.15.148:0/3180725818 <== mon.2 v2:172.21.15.165:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8c80d4e10 con 0x55fc1a65de80 2024-09-19T07:17:17.600 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.599+0000 7fe8b5ffb640 1 -- 172.21.15.148:0/3180725818 <== mon.2 v2:172.21.15.165:3300/0 5 ==== fsmap(e 37) ==== 8370+0+0 (secure 0 0 0) 0x7fe8c4016070 con 0x55fc1a65de80 2024-09-19T07:17:17.603 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.603+0000 7fe8d743b740 10 client.25922 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T07:17:17.603 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.603+0000 7fe8d743b740 10 client.25922 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:17:17.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.603+0000 7fe8d743b740 20 client.25922 populate_metadata read hostname 'smithi148' 2024-09-19T07:17:17.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.603+0000 7fe8d743b740 1 --2- 172.21.15.148:0/3180725818 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55fc1a66e350 0x55fc1a670810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:17.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.603+0000 7fe8d743b740 4 client.25922 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:17:17.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.603+0000 7fe8d743b740 1 -- 172.21.15.148:0/3180725818 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fc1a5c4a20 con 0x55fc1a66e350 2024-09-19T07:17:17.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.603+0000 7fe8d2360640 1 --2- 172.21.15.148:0/3180725818 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55fc1a66e350 0x55fc1a670810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:17.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.604+0000 7fe8d2360640 1 --2- 172.21.15.148:0/3180725818 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55fc1a66e350 0x55fc1a670810 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d6cfe88a7c2c2f9 server_cookie=9b4b5c6c7416a7b3 in_seq=0 out_seq=0 2024-09-19T07:17:17.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.604+0000 7fe8b5ffb640 10 client.25922 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:17:17.608 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.605+0000 7fe8b5ffb640 1 -- 172.21.15.148:0/3180725818 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fc1a5c4a20 con 0x55fc1a66e350 2024-09-19T07:17:17.608 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.606+0000 7fe8b5ffb640 10 client.25922 handle_command_reply: tid=0 2024-09-19T07:17:17.608 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.606+0000 7fe8d743b740 1 client.25922 shutdown 2024-09-19T07:17:17.608 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.606+0000 7fe8d743b740 1 -- 172.21.15.148:0/3180725818 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fc1a65de80 msgr2=0x55fc1a65b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:17:17.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.606+0000 7fe8d743b740 1 --2- 172.21.15.148:0/3180725818 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fc1a65de80 0x55fc1a65b7b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4018e70 tx=0x7fe8c4004a40 comp rx=0 tx=0).stop 2024-09-19T07:17:17.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.606+0000 7fe8d743b740 1 -- 172.21.15.148:0/3180725818 shutdown_connections 2024-09-19T07:17:17.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.606+0000 7fe8d743b740 1 --2- 172.21.15.148:0/3180725818 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55fc1a66e350 0x55fc1a670810 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:17.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.606+0000 7fe8d743b740 1 --2- 172.21.15.148:0/3180725818 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fc1a65de80 0x55fc1a65b7b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:17.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.606+0000 7fe8d743b740 1 --2- 172.21.15.148:0/3180725818 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fc1a6535e0 0x55fc1a65b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:17.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.606+0000 7fe8d743b740 1 --2- 172.21.15.148:0/3180725818 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fc1a652cc0 0x55fc1a65ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:17.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.606+0000 7fe8d743b740 1 -- 172.21.15.148:0/3180725818 >> 172.21.15.148:0/3180725818 conn(0x55fc1a64f230 msgr2=0x55fc1a654f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:17:17.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.607+0000 7fe8b5ffb640 0 client.25922 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:17:17.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.607+0000 7fe8d743b740 1 -- 172.21.15.148:0/3180725818 shutdown_connections 2024-09-19T07:17:17.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.607+0000 7fe8d743b740 1 -- 172.21.15.148:0/3180725818 wait complete. 2024-09-19T07:17:17.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.607+0000 7fe8d743b740 20 client.25922 trim_cache size 0 max 16384 2024-09-19T07:17:17.640 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:17:17 smithi165 ceph-mon[35326]: pgmap v190: 97 pgs: 97 active+clean; 1.2 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 6.3 MiB/s wr, 900 op/s 2024-09-19T07:17:17.865 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.864+0000 7fe8d743b740 1 Processor -- start 2024-09-19T07:17:17.865 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.864+0000 7fe8d743b740 1 -- start start 2024-09-19T07:17:17.865 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.865+0000 7fe8d743b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fc1a652cc0 0x55fc1a65b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:17.867 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.865+0000 7fe8d2360640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fc1a652cc0 0x55fc1a65b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:17.868 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.865+0000 7fe8d2360640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fc1a652cc0 0x55fc1a65b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58524/0 (socket says 172.21.15.148:58524) 2024-09-19T07:17:17.868 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.865+0000 7fe8d2360640 1 -- 172.21.15.148:0/4177878128 learned_addr learned my addr 172.21.15.148:0/4177878128 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:17:17.868 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.865+0000 7fe8d743b740 1 --2- 172.21.15.148:0/4177878128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fc1a6535e0 0x55fc1a676120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:17.868 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.866+0000 7fe8d743b740 1 --2- 172.21.15.148:0/4177878128 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fc1a65de80 0x55fc1a676660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:17.868 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.866+0000 7fe8d1b5f640 1 --2- 172.21.15.148:0/4177878128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fc1a6535e0 0x55fc1a676120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:17.869 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.866+0000 7fe8d2b61640 1 --2- 172.21.15.148:0/4177878128 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fc1a65de80 0x55fc1a676660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:17.869 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.866+0000 7fe8d743b740 1 -- 172.21.15.148:0/4177878128 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe8b00111c0 con 0x55fc1a652cc0 2024-09-19T07:17:17.869 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.866+0000 7fe8d743b740 1 -- 172.21.15.148:0/4177878128 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe8b000e9d0 con 0x55fc1a65de80 2024-09-19T07:17:17.869 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.866+0000 7fe8d743b740 1 -- 172.21.15.148:0/4177878128 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe8b000c800 con 0x55fc1a6535e0 2024-09-19T07:17:17.870 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.867+0000 7fe8d2b61640 1 -- 172.21.15.148:0/4177878128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fc1a6535e0 msgr2=0x55fc1a676120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:17:17.870 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.867+0000 7fe8d2b61640 1 --2- 172.21.15.148:0/4177878128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fc1a6535e0 0x55fc1a676120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:17.870 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.867+0000 7fe8d2b61640 1 -- 172.21.15.148:0/4177878128 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fc1a652cc0 msgr2=0x55fc1a65b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:17:17.871 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.867+0000 7fe8d2b61640 1 --2- 172.21.15.148:0/4177878128 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fc1a652cc0 0x55fc1a65b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:17.871 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.867+0000 7fe8d2b61640 1 -- 172.21.15.148:0/4177878128 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc1a6503a0 con 0x55fc1a65de80 2024-09-19T07:17:17.871 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.867+0000 7fe8d2b61640 1 --2- 172.21.15.148:0/4177878128 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fc1a65de80 0x55fc1a676660 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe8c400ad50 tx=0x7fe8c4018ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50a5069d4217db59 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:17:17.885 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.885+0000 7fe8b7fff640 1 -- 172.21.15.148:0/4177878128 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c4016ca0 con 0x55fc1a65de80 2024-09-19T07:17:17.886 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.885+0000 7fe8b7fff640 1 -- 172.21.15.148:0/4177878128 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8c4016e40 con 0x55fc1a65de80 2024-09-19T07:17:17.886 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.885+0000 7fe8b7fff640 1 -- 172.21.15.148:0/4177878128 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c4024880 con 0x55fc1a65de80 2024-09-19T07:17:17.890 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.889+0000 7fe8d743b740 1 -- 172.21.15.148:0/4177878128 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fc1a65de80 msgr2=0x55fc1a676660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:17:17.890 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.889+0000 7fe8d743b740 1 --2- 172.21.15.148:0/4177878128 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fc1a65de80 0x55fc1a676660 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe8c400ad50 tx=0x7fe8c4018ad0 comp rx=0 tx=0).stop 2024-09-19T07:17:17.904 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.903+0000 7fe8d743b740 1 -- 172.21.15.148:0/4177878128 shutdown_connections 2024-09-19T07:17:17.904 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.903+0000 7fe8d743b740 1 --2- 172.21.15.148:0/4177878128 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fc1a65de80 0x55fc1a676660 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:17.905 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.903+0000 7fe8d743b740 1 --2- 172.21.15.148:0/4177878128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fc1a6535e0 0x55fc1a676120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:17.905 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.903+0000 7fe8d743b740 1 --2- 172.21.15.148:0/4177878128 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fc1a652cc0 0x55fc1a65b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:17.905 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.903+0000 7fe8d743b740 1 -- 172.21.15.148:0/4177878128 >> 172.21.15.148:0/4177878128 conn(0x55fc1a64f230 msgr2=0x55fc1a656020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:17:17.913 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.912+0000 7fe8d743b740 1 -- 172.21.15.148:0/4177878128 shutdown_connections 2024-09-19T07:17:17.913 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.912+0000 7fe8d743b740 1 -- 172.21.15.148:0/4177878128 wait complete. 2024-09-19T07:17:17.913 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.913+0000 7fe8d743b740 1 -- start start 2024-09-19T07:17:17.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.913+0000 7fe8d743b740 1 Processor -- start 2024-09-19T07:17:17.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.914+0000 7fe8d743b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fc1a652cc0 0x55fc1a665ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:17.916 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.915+0000 7fe8d2360640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fc1a652cc0 0x55fc1a665ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:17.916 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.915+0000 7fe8d743b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fc1a6535e0 0x55fc1a666430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:17.916 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.915+0000 7fe8d743b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fc1a65de80 0x55fc1a657140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:17.917 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.915+0000 7fe8d1b5f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fc1a6535e0 0x55fc1a666430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:17.917 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.915+0000 7fe8d1b5f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fc1a6535e0 0x55fc1a666430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:59564/0 (socket says 172.21.15.148:59564) 2024-09-19T07:17:17.921 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.915+0000 7fe8d1b5f640 1 -- 172.21.15.148:0/2097234647 learned_addr learned my addr 172.21.15.148:0/2097234647 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:17:17.921 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.920+0000 7fe8d2b61640 1 --2- 172.21.15.148:0/2097234647 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fc1a65de80 0x55fc1a657140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:17.921 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.920+0000 7fe8d743b740 1 -- 172.21.15.148:0/2097234647 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe8b000ce90 con 0x55fc1a652cc0 2024-09-19T07:17:17.921 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.920+0000 7fe8d743b740 1 -- 172.21.15.148:0/2097234647 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe8b000e300 con 0x55fc1a6535e0 2024-09-19T07:17:17.922 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.920+0000 7fe8d743b740 1 -- 172.21.15.148:0/2097234647 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe8b000d560 con 0x55fc1a65de80 2024-09-19T07:17:17.922 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.920+0000 7fe8d1b5f640 1 -- 172.21.15.148:0/2097234647 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fc1a65de80 msgr2=0x55fc1a657140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:17:17.923 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.920+0000 7fe8d1b5f640 1 --2- 172.21.15.148:0/2097234647 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fc1a65de80 0x55fc1a657140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:17.923 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.921+0000 7fe8d1b5f640 1 -- 172.21.15.148:0/2097234647 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fc1a652cc0 msgr2=0x55fc1a665ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:17:17.923 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.921+0000 7fe8d1b5f640 1 --2- 172.21.15.148:0/2097234647 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fc1a652cc0 0x55fc1a665ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:17.923 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.921+0000 7fe8d1b5f640 1 -- 172.21.15.148:0/2097234647 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc1a657680 con 0x55fc1a6535e0 2024-09-19T07:17:17.923 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.921+0000 7fe8d2b61640 1 --2- 172.21.15.148:0/2097234647 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fc1a65de80 0x55fc1a657140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:17:17.923 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.921+0000 7fe8d1b5f640 1 --2- 172.21.15.148:0/2097234647 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fc1a6535e0 0x55fc1a666430 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe8c80d9a80 tx=0x7fe8c8004570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5240ea66feb7d1be server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:17:17.923 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.921+0000 7fe8d743b740 10 client.0 _ll_register_callbacks cb 0x7fe8c4009c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:17:17.923 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.921+0000 7fe8d743b740 1 -- 172.21.15.148:0/2097234647 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fc1a5bed70 con 0x55fc1a6535e0 2024-09-19T07:17:17.945 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.944+0000 7fe8b5ffb640 10 client.25928 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-19T07:17:17.945 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.944+0000 7fe8b5ffb640 1 -- 172.21.15.148:0/2097234647 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c801d040 con 0x55fc1a6535e0 2024-09-19T07:17:17.945 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.944+0000 7fe8b5ffb640 1 -- 172.21.15.148:0/2097234647 <== mon.2 v2:172.21.15.165:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8512+0+0 (secure 0 0 0) 0x7fe8c80d4770 con 0x55fc1a6535e0 2024-09-19T07:17:17.945 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.944+0000 7fe8b5ffb640 1 -- 172.21.15.148:0/2097234647 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fe8c80990a0 con 0x55fc1a6535e0 2024-09-19T07:17:17.946 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.946+0000 7fe8d743b740 10 client.25928 fetch_fsmap learned FSMap version 37 2024-09-19T07:17:17.946 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.946+0000 7fe8d743b740 1 -- 172.21.15.148:0/2097234647 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({fsmap=37}) -- 0x55fc1a6d8620 con 0x55fc1a6535e0 2024-09-19T07:17:17.957 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.954+0000 7fe8b5ffb640 1 -- 172.21.15.148:0/2097234647 <== mon.2 v2:172.21.15.165:3300/0 4 ==== fsmap(e 37) ==== 8370+0+0 (secure 0 0 0) 0x7fe8c80ce4f0 con 0x55fc1a6535e0 2024-09-19T07:17:17.957 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.955+0000 7fe8d743b740 10 client.25928 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T07:17:17.957 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.955+0000 7fe8d743b740 10 client.25928 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:17:17.957 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.955+0000 7fe8d743b740 20 client.25928 populate_metadata read hostname 'smithi148' 2024-09-19T07:17:17.957 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.955+0000 7fe8d743b740 1 --2- 172.21.15.148:0/2097234647 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55fc1a6d8850 0x55fc1a6dac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:17.958 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.955+0000 7fe8d743b740 4 client.25928 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:17:17.958 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.955+0000 7fe8d743b740 1 -- 172.21.15.148:0/2097234647 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fc1a5bed70 con 0x55fc1a6d8850 2024-09-19T07:17:17.958 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.955+0000 7fe8d2360640 1 --2- 172.21.15.148:0/2097234647 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55fc1a6d8850 0x55fc1a6dac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:17.958 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.956+0000 7fe8d2360640 1 --2- 172.21.15.148:0/2097234647 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55fc1a6d8850 0x55fc1a6dac40 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7beb2aaca8d2a45d server_cookie=8e63f7b2d0a89058 in_seq=0 out_seq=0 2024-09-19T07:17:17.958 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:17.957+0000 7fe8b5ffb640 10 client.25928 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:17:19.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:17:19 smithi179 ceph-mon[35716]: pgmap v191: 97 pgs: 97 active+clean; 1.2 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.2 MiB/s wr, 263 op/s 2024-09-19T07:17:19.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:17:19 smithi148 ceph-mon[31180]: pgmap v191: 97 pgs: 97 active+clean; 1.2 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.2 MiB/s wr, 263 op/s 2024-09-19T07:17:19.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:17:19 smithi165 ceph-mon[35326]: pgmap v191: 97 pgs: 97 active+clean; 1.2 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.2 MiB/s wr, 263 op/s 2024-09-19T07:17:20.602 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:17:20 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:17:20.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:17:20 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:17:20.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:17:20 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:17:21.585 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:17:21 smithi148 ceph-mon[31180]: pgmap v192: 97 pgs: 97 active+clean; 1.2 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.8 MiB/s wr, 215 op/s 2024-09-19T07:17:21.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:17:21 smithi165 ceph-mon[35326]: pgmap v192: 97 pgs: 97 active+clean; 1.2 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.8 MiB/s wr, 215 op/s 2024-09-19T07:17:21.673 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:17:21 smithi179 ceph-mon[35716]: pgmap v192: 97 pgs: 97 active+clean; 1.2 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.8 MiB/s wr, 215 op/s 2024-09-19T07:17:22.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:17:22 smithi165 ceph-mon[35326]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:17:22.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:17:22 smithi165 ceph-mon[35326]: pgmap v193: 97 pgs: 97 active+clean; 1.3 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 15 MiB/s wr, 846 op/s 2024-09-19T07:17:22.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:17:22 smithi179 ceph-mon[35716]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:17:22.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:17:22 smithi179 ceph-mon[35716]: pgmap v193: 97 pgs: 97 active+clean; 1.3 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 15 MiB/s wr, 846 op/s 2024-09-19T07:17:22.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:17:22 smithi148 ceph-mon[31180]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:17:22.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:17:22 smithi148 ceph-mon[31180]: pgmap v193: 97 pgs: 97 active+clean; 1.3 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 15 MiB/s wr, 846 op/s 2024-09-19T07:17:23.119 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:23.118+0000 7fe8b5ffb640 1 -- 172.21.15.148:0/2097234647 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fc1a5bed70 con 0x55fc1a6d8850 2024-09-19T07:17:23.119 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:23.118+0000 7fe8b5ffb640 10 client.25928 handle_command_reply: tid=0 2024-09-19T07:17:23.119 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:23.118+0000 7fe8d743b740 1 client.25928 shutdown 2024-09-19T07:17:23.119 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:23.118+0000 7fe8d743b740 1 -- 172.21.15.148:0/2097234647 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fc1a6535e0 msgr2=0x55fc1a666430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:17:23.119 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:23.118+0000 7fe8d743b740 1 --2- 172.21.15.148:0/2097234647 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fc1a6535e0 0x55fc1a666430 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe8c80d9a80 tx=0x7fe8c8004570 comp rx=0 tx=0).stop 2024-09-19T07:17:23.120 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:23.119+0000 7fe8d743b740 1 -- 172.21.15.148:0/2097234647 shutdown_connections 2024-09-19T07:17:23.120 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:23.119+0000 7fe8d743b740 1 --2- 172.21.15.148:0/2097234647 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55fc1a6d8850 0x55fc1a6dac40 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:23.120 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:23.119+0000 7fe8d743b740 1 --2- 172.21.15.148:0/2097234647 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fc1a65de80 0x55fc1a657140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:23.120 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:23.119+0000 7fe8d743b740 1 --2- 172.21.15.148:0/2097234647 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fc1a6535e0 0x55fc1a666430 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:23.120 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:23.119+0000 7fe8d743b740 1 --2- 172.21.15.148:0/2097234647 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fc1a652cc0 0x55fc1a665ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:23.120 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:23.119+0000 7fe8d743b740 1 -- 172.21.15.148:0/2097234647 >> 172.21.15.148:0/2097234647 conn(0x55fc1a64f230 msgr2=0x55fc1a65c590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:17:23.120 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:23.119+0000 7fe8b5ffb640 0 client.25928 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:17:23.121 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:23.119+0000 7fe8d743b740 1 -- 172.21.15.148:0/2097234647 shutdown_connections 2024-09-19T07:17:23.121 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:23.119+0000 7fe8d743b740 1 -- 172.21.15.148:0/2097234647 wait complete. 2024-09-19T07:17:23.121 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:23.119+0000 7fe8d743b740 20 client.25928 trim_cache size 0 max 16384 2024-09-19T07:17:23.121 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:17:23.121 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:17:23.121 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:17:23.121 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:17:23.132 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:23.132+0000 7fe8d3362640 1 -- 172.21.15.148:0/2309766428 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe8b80a35b0 msgr2=0x7fe8b80a5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:17:23.133 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:23.132+0000 7fe8d3362640 1 --2- 172.21.15.148:0/2309766428 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe8b80a35b0 0x7fe8b80a5a70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4009fd0 tx=0x7fe8c400e040 comp rx=0 tx=0).stop 2024-09-19T07:17:23.133 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:23.132+0000 7fe8d3362640 1 -- 172.21.15.148:0/2309766428 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8cc11b140 msgr2=0x7fe8cc116b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:17:23.133 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:23.132+0000 7fe8d3362640 1 --2- 172.21.15.148:0/2309766428 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8cc11b140 0x7fe8cc116b10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe8c800c890 tx=0x7fe8c800cd50 comp rx=0 tx=0).stop 2024-09-19T07:17:23.134 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:23.133+0000 7fe8d3362640 1 -- 172.21.15.148:0/2309766428 shutdown_connections 2024-09-19T07:17:23.134 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:23.133+0000 7fe8d3362640 1 --2- 172.21.15.148:0/2309766428 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe8b80a35b0 0x7fe8b80a5a70 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:23.134 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:23.133+0000 7fe8d3362640 1 --2- 172.21.15.148:0/2309766428 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8cc117050 0x7fe8cc1174e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:23.134 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:23.133+0000 7fe8d3362640 1 --2- 172.21.15.148:0/2309766428 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8cc11b140 0x7fe8cc116b10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:23.134 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:23.133+0000 7fe8d3362640 1 --2- 172.21.15.148:0/2309766428 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8cc1095d0 0x7fe8cc11aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:23.134 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:23.133+0000 7fe8d3362640 1 -- 172.21.15.148:0/2309766428 >> 172.21.15.148:0/2309766428 conn(0x7fe8cc06cbf0 msgr2=0x7fe8cc070780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:17:23.135 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:23.134+0000 7fe8d3362640 1 -- 172.21.15.148:0/2309766428 shutdown_connections 2024-09-19T07:17:23.135 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:23.134+0000 7fe8d3362640 1 -- 172.21.15.148:0/2309766428 wait complete. 2024-09-19T07:17:23.195 INFO:tasks.workunit.client.0.smithi148.stdout: 328 1782961 381 1191819 462 640866 696 2024-09-19T07:17:23.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:17:23 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:17:23.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:17:23 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:17:23.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:17:23 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:17:23.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:17:23 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:17:23.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:17:23 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:17:23.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:17:23 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:17:23.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:17:23 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:17:23.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:17:23 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:17:23.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:17:23 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:17:24.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:17:24 smithi179 ceph-mon[35716]: pgmap v194: 97 pgs: 97 active+clean; 1.3 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 13 MiB/s wr, 870 op/s 2024-09-19T07:17:24.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:17:24 smithi148 ceph-mon[31180]: pgmap v194: 97 pgs: 97 active+clean; 1.3 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 13 MiB/s wr, 870 op/s 2024-09-19T07:17:24.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:17:24 smithi165 ceph-mon[35326]: pgmap v194: 97 pgs: 97 active+clean; 1.3 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 13 MiB/s wr, 870 op/s 2024-09-19T07:17:26.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:17:26 smithi179 ceph-mon[35716]: pgmap v195: 97 pgs: 97 active+clean; 1.3 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 17 MiB/s wr, 1.60k op/s 2024-09-19T07:17:26.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:17:26 smithi148 ceph-mon[31180]: pgmap v195: 97 pgs: 97 active+clean; 1.3 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 17 MiB/s wr, 1.60k op/s 2024-09-19T07:17:26.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:17:26 smithi165 ceph-mon[35326]: pgmap v195: 97 pgs: 97 active+clean; 1.3 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 17 MiB/s wr, 1.60k op/s 2024-09-19T07:17:28.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:17:28 smithi179 ceph-mon[35716]: pgmap v196: 97 pgs: 97 active+clean; 1.3 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 16 MiB/s wr, 1.64k op/s 2024-09-19T07:17:28.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:17:28 smithi148 ceph-mon[31180]: pgmap v196: 97 pgs: 97 active+clean; 1.3 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 16 MiB/s wr, 1.64k op/s 2024-09-19T07:17:28.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:17:28 smithi165 ceph-mon[35326]: pgmap v196: 97 pgs: 97 active+clean; 1.3 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 16 MiB/s wr, 1.64k op/s 2024-09-19T07:17:30.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:17:30 smithi179 ceph-mon[35716]: pgmap v197: 97 pgs: 97 active+clean; 1.3 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 16 MiB/s wr, 1.61k op/s 2024-09-19T07:17:30.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:17:30 smithi148 ceph-mon[31180]: pgmap v197: 97 pgs: 97 active+clean; 1.3 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 16 MiB/s wr, 1.61k op/s 2024-09-19T07:17:30.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:17:30 smithi165 ceph-mon[35326]: pgmap v197: 97 pgs: 97 active+clean; 1.3 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 16 MiB/s wr, 1.61k op/s 2024-09-19T07:17:32.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:17:32 smithi179 ceph-mon[35716]: pgmap v198: 97 pgs: 97 active+clean; 1.3 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 17 MiB/s wr, 1.69k op/s 2024-09-19T07:17:32.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:17:32 smithi148 ceph-mon[31180]: pgmap v198: 97 pgs: 97 active+clean; 1.3 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 17 MiB/s wr, 1.69k op/s 2024-09-19T07:17:32.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:17:32 smithi165 ceph-mon[35326]: pgmap v198: 97 pgs: 97 active+clean; 1.3 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 17 MiB/s wr, 1.69k op/s 2024-09-19T07:17:33.195 INFO:tasks.workunit.client.0.smithi148.stdout: 356 2519980 1518 1688575 1417 907187 1473 2024-09-19T07:17:34.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:17:34 smithi179 ceph-mon[35716]: pgmap v199: 97 pgs: 97 active+clean; 1.3 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 7.3 MiB/s wr, 1.07k op/s 2024-09-19T07:17:34.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:17:34 smithi148 ceph-mon[31180]: pgmap v199: 97 pgs: 97 active+clean; 1.3 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 7.3 MiB/s wr, 1.07k op/s 2024-09-19T07:17:34.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:17:34 smithi165 ceph-mon[35326]: pgmap v199: 97 pgs: 97 active+clean; 1.3 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 7.3 MiB/s wr, 1.07k op/s 2024-09-19T07:17:36.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:17:36 smithi179 ceph-mon[35716]: pgmap v200: 97 pgs: 97 active+clean; 1.3 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 7.7 MiB/s wr, 1.02k op/s 2024-09-19T07:17:36.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:17:36 smithi148 ceph-mon[31180]: pgmap v200: 97 pgs: 97 active+clean; 1.3 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 7.7 MiB/s wr, 1.02k op/s 2024-09-19T07:17:36.885 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:17:36 smithi165 ceph-mon[35326]: pgmap v200: 97 pgs: 97 active+clean; 1.3 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 7.7 MiB/s wr, 1.02k op/s 2024-09-19T07:17:38.300 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.299+0000 7f364ea9b640 1 -- 172.21.15.148:0/3542436787 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36481091f0 msgr2=0x7f3648110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:17:38.301 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.299+0000 7f364ea9b640 1 --2- 172.21.15.148:0/3542436787 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36481091f0 0x7f3648110250 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f3640009ca0 tx=0x7f364002a8e0 comp rx=0 tx=0).stop 2024-09-19T07:17:38.301 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.300+0000 7f364ea9b640 1 -- 172.21.15.148:0/3542436787 shutdown_connections 2024-09-19T07:17:38.301 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.300+0000 7f364ea9b640 1 --2- 172.21.15.148:0/3542436787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f364811b140 0x7f364811d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:38.301 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.300+0000 7f364ea9b640 1 --2- 172.21.15.148:0/3542436787 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36481095d0 0x7f3648109a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:38.301 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.300+0000 7f364ea9b640 1 --2- 172.21.15.148:0/3542436787 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36481091f0 0x7f3648110250 secure :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f3640009ca0 tx=0x7f364002a8e0 comp rx=0 tx=0).stop 2024-09-19T07:17:38.301 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.300+0000 7f364ea9b640 1 -- 172.21.15.148:0/3542436787 >> 172.21.15.148:0/3542436787 conn(0x7f364806cc60 msgr2=0x7f364806d070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:17:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.320+0000 7f364ea9b640 1 -- 172.21.15.148:0/3542436787 shutdown_connections 2024-09-19T07:17:38.322 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.320+0000 7f364ea9b640 1 -- 172.21.15.148:0/3542436787 wait complete. 2024-09-19T07:17:38.322 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.321+0000 7f364ea9b640 1 Processor -- start 2024-09-19T07:17:38.322 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.321+0000 7f364ea9b640 1 -- start start 2024-09-19T07:17:38.322 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.322+0000 7f364ea9b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36481095d0 0x7f36481188d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:38.323 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.322+0000 7f364ea9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f364811b140 0x7f3648111950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:38.323 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.322+0000 7f364ea9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3648111e90 0x7f3648112340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:38.323 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.322+0000 7f364ea9b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3648120c20 con 0x7f3648111e90 2024-09-19T07:17:38.323 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.322+0000 7f364ea9b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3648120aa0 con 0x7f36481095d0 2024-09-19T07:17:38.323 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.322+0000 7f364ea9b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3648120da0 con 0x7f364811b140 2024-09-19T07:17:38.324 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.322+0000 7f3647fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f364811b140 0x7f3648111950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:38.324 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.322+0000 7f3647fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f364811b140 0x7f3648111950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:41288/0 (socket says 172.21.15.148:41288) 2024-09-19T07:17:38.324 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.322+0000 7f3647fff640 1 -- 172.21.15.148:0/1089710597 learned_addr learned my addr 172.21.15.148:0/1089710597 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:17:38.324 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.322+0000 7f364d038640 1 --2- 172.21.15.148:0/1089710597 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3648111e90 0x7f3648112340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:38.324 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.323+0000 7f3647fff640 1 -- 172.21.15.148:0/1089710597 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36481095d0 msgr2=0x7f36481188d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T07:17:38.324 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.323+0000 7f3647fff640 1 --2- 172.21.15.148:0/1089710597 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36481095d0 0x7f36481188d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:38.324 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.323+0000 7f3647fff640 1 -- 172.21.15.148:0/1089710597 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3648111e90 msgr2=0x7f3648112340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:17:38.324 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.323+0000 7f3647fff640 1 --2- 172.21.15.148:0/1089710597 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3648111e90 0x7f3648112340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:38.325 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.323+0000 7f3647fff640 1 -- 172.21.15.148:0/1089710597 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36481164a0 con 0x7f364811b140 2024-09-19T07:17:38.325 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.323+0000 7f364d038640 1 --2- 172.21.15.148:0/1089710597 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3648111e90 0x7f3648112340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:17:38.325 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.323+0000 7f3647fff640 1 --2- 172.21.15.148:0/1089710597 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f364811b140 0x7f3648111950 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f363c00b4a0 tx=0x7f363c00b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:17:38.381 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.381+0000 7f3645ffb640 1 -- 172.21.15.148:0/1089710597 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f363c014070 con 0x7f364811b140 2024-09-19T07:17:38.385 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.381+0000 7f364ea9b640 1 -- 172.21.15.148:0/1089710597 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3648116790 con 0x7f364811b140 2024-09-19T07:17:38.386 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.381+0000 7f364ea9b640 1 -- 172.21.15.148:0/1089710597 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3648116ce0 con 0x7f364811b140 2024-09-19T07:17:38.387 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.386+0000 7f3651835740 1 Processor -- start 2024-09-19T07:17:38.387 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.386+0000 7f3651835740 1 -- start start 2024-09-19T07:17:38.387 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.386+0000 7f3651835740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562356c89cc0 0x562356c8a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:38.387 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.386+0000 7f3651835740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562356c8a5e0 0x562356c94940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:38.387 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.386+0000 7f3651835740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562356c94e80 0x562356c97270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:38.388 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.386+0000 7f3651835740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x562356bee2f0 con 0x562356c89cc0 2024-09-19T07:17:38.388 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.386+0000 7f3651835740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x562356b96270 con 0x562356c8a5e0 2024-09-19T07:17:38.388 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.386+0000 7f3651835740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x562356bea2b0 con 0x562356c94e80 2024-09-19T07:17:38.388 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.387+0000 7f364d038640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562356c89cc0 0x562356c8a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:38.388 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.387+0000 7f364d038640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562356c89cc0 0x562356c8a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42110/0 (socket says 172.21.15.148:42110) 2024-09-19T07:17:38.389 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.387+0000 7f364d038640 1 -- 172.21.15.148:0/815020598 learned_addr learned my addr 172.21.15.148:0/815020598 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:17:38.389 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.388+0000 7f364d038640 1 -- 172.21.15.148:0/815020598 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562356c94e80 msgr2=0x562356c97270 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T07:17:38.389 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.388+0000 7f364d038640 1 --2- 172.21.15.148:0/815020598 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562356c94e80 0x562356c97270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:38.389 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.388+0000 7f364d038640 1 -- 172.21.15.148:0/815020598 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562356c8a5e0 msgr2=0x562356c94940 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T07:17:38.389 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.388+0000 7f364d038640 1 --2- 172.21.15.148:0/815020598 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562356c8a5e0 0x562356c94940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:38.389 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.388+0000 7f364d038640 1 -- 172.21.15.148:0/815020598 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562356b95340 con 0x562356c89cc0 2024-09-19T07:17:38.390 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.388+0000 7f364d038640 1 --2- 172.21.15.148:0/815020598 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562356c89cc0 0x562356c8a0a0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f363800ba50 tx=0x7f363800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=808c1b505a7c2486 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:17:38.390 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.388+0000 7f3645ffb640 1 -- 172.21.15.148:0/1089710597 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f363c010af0 con 0x7f364811b140 2024-09-19T07:17:38.390 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.388+0000 7f3645ffb640 1 -- 172.21.15.148:0/1089710597 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f363c017d20 con 0x7f364811b140 2024-09-19T07:17:38.395 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.393+0000 7f3645ffb640 1 -- 172.21.15.148:0/1089710597 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f363c017070 con 0x7f364811b140 2024-09-19T07:17:38.395 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.394+0000 7f3645ffb640 1 --2- 172.21.15.148:0/1089710597 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f36300a35c0 0x7f36300a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:38.395 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.394+0000 7f364c837640 1 --2- 172.21.15.148:0/1089710597 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f36300a35c0 0x7f36300a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:38.414 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.413+0000 7f3645ffb640 1 -- 172.21.15.148:0/1089710597 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8512+0+0 (secure 0 0 0) 0x7f363c0d0050 con 0x7f364811b140 2024-09-19T07:17:38.414 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.413+0000 7f364c837640 1 --2- 172.21.15.148:0/1089710597 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f36300a35c0 0x7f36300a5a80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f364002aed0 tx=0x7f3640000f40 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:17:38.415 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.414+0000 7f362effd640 1 -- 172.21.15.148:0/815020598 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f363800d8a0 con 0x562356c89cc0 2024-09-19T07:17:38.415 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.414+0000 7f362effd640 1 -- 172.21.15.148:0/815020598 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3638019070 con 0x562356c89cc0 2024-09-19T07:17:38.417 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.416+0000 7f3651835740 1 -- 172.21.15.148:0/815020598 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562356c89cc0 msgr2=0x562356c8a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:17:38.417 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.416+0000 7f3651835740 1 --2- 172.21.15.148:0/815020598 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562356c89cc0 0x562356c8a0a0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f363800ba50 tx=0x7f363800bf10 comp rx=0 tx=0).stop 2024-09-19T07:17:38.425 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.425+0000 7f3651835740 1 -- 172.21.15.148:0/815020598 shutdown_connections 2024-09-19T07:17:38.426 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.425+0000 7f3651835740 1 --2- 172.21.15.148:0/815020598 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562356c94e80 0x562356c97270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:38.426 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.425+0000 7f3651835740 1 --2- 172.21.15.148:0/815020598 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562356c8a5e0 0x562356c94940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:38.426 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.425+0000 7f3651835740 1 --2- 172.21.15.148:0/815020598 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562356c89cc0 0x562356c8a0a0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:38.426 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.425+0000 7f3651835740 1 -- 172.21.15.148:0/815020598 >> 172.21.15.148:0/815020598 conn(0x562356c86230 msgr2=0x562356c86610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:17:38.426 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.426+0000 7f3651835740 1 -- 172.21.15.148:0/815020598 shutdown_connections 2024-09-19T07:17:38.426 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.426+0000 7f3651835740 1 -- 172.21.15.148:0/815020598 wait complete. 2024-09-19T07:17:38.427 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.426+0000 7f3651835740 1 -- start start 2024-09-19T07:17:38.427 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.426+0000 7f3651835740 1 Processor -- start 2024-09-19T07:17:38.428 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.427+0000 7f3651835740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562356c89cc0 0x562356c91d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:38.428 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.427+0000 7f3651835740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562356c8a5e0 0x562356c92270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:38.428 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.427+0000 7f3651835740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562356c94e80 0x562356c927b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:38.428 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.427+0000 7f3651835740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x562356c97aa0 con 0x562356c89cc0 2024-09-19T07:17:38.428 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.427+0000 7f3651835740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x562356b77290 con 0x562356c8a5e0 2024-09-19T07:17:38.428 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.427+0000 7f3651835740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x562356c97c20 con 0x562356c94e80 2024-09-19T07:17:38.428 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.427+0000 7f3651835740 10 client.0 _ll_register_callbacks cb 0x562356ba8140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:17:38.429 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.427+0000 7f364c837640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562356c89cc0 0x562356c91d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:38.429 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.427+0000 7f364d038640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562356c94e80 0x562356c927b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:38.429 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.428+0000 7f364d038640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562356c94e80 0x562356c927b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:41306/0 (socket says 172.21.15.148:41306) 2024-09-19T07:17:38.429 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.428+0000 7f364d038640 1 -- 172.21.15.148:0/554354445 learned_addr learned my addr 172.21.15.148:0/554354445 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:17:38.430 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.428+0000 7f3647fff640 1 --2- 172.21.15.148:0/554354445 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562356c8a5e0 0x562356c92270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:38.430 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.428+0000 7f3647fff640 1 -- 172.21.15.148:0/554354445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562356c94e80 msgr2=0x562356c927b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:17:38.430 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.428+0000 7f3647fff640 1 --2- 172.21.15.148:0/554354445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562356c94e80 0x562356c927b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:38.430 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.428+0000 7f3647fff640 1 -- 172.21.15.148:0/554354445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562356c89cc0 msgr2=0x562356c91d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:17:38.430 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.428+0000 7f3647fff640 1 --2- 172.21.15.148:0/554354445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562356c89cc0 0x562356c91d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:38.430 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.428+0000 7f3647fff640 1 -- 172.21.15.148:0/554354445 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562356901210 con 0x562356c8a5e0 2024-09-19T07:17:38.430 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.428+0000 7f364c837640 1 --2- 172.21.15.148:0/554354445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562356c89cc0 0x562356c91d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:17:38.430 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.429+0000 7f3647fff640 1 --2- 172.21.15.148:0/554354445 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562356c8a5e0 0x562356c92270 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f363c0cd880 tx=0x7f363c09cc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4abaed27419fd0b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:17:38.472 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.471+0000 7f362c7f8640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-19T07:17:38.472 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.471+0000 7f362c7f8640 1 -- 172.21.15.148:0/554354445 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f363c01e040 con 0x562356c8a5e0 2024-09-19T07:17:38.472 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.471+0000 7f3651835740 1 -- 172.21.15.148:0/554354445 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3638019070 con 0x562356c8a5e0 2024-09-19T07:17:38.472 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.471+0000 7f362c7f8640 1 -- 172.21.15.148:0/554354445 <== mon.2 v2:172.21.15.165:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8512+0+0 (secure 0 0 0) 0x7f363c0cd9f0 con 0x562356c8a5e0 2024-09-19T07:17:38.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.478+0000 7f362c7f8640 1 -- 172.21.15.148:0/554354445 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f363c0cdbf0 con 0x562356c8a5e0 2024-09-19T07:17:38.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.478+0000 7f3651835740 10 client.25931 fetch_fsmap learned FSMap version 38 2024-09-19T07:17:38.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.478+0000 7f3651835740 1 -- 172.21.15.148:0/554354445 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5623569cd620 con 0x562356c8a5e0 2024-09-19T07:17:38.482 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.482+0000 7f362c7f8640 1 -- 172.21.15.148:0/554354445 <== mon.2 v2:172.21.15.165:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3638019070 con 0x562356c8a5e0 2024-09-19T07:17:38.483 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.482+0000 7f362c7f8640 1 -- 172.21.15.148:0/554354445 <== mon.2 v2:172.21.15.165:3300/0 5 ==== fsmap(e 38) ==== 8366+0+0 (secure 0 0 0) 0x7f363c0b5370 con 0x562356c8a5e0 2024-09-19T07:17:38.484 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.483+0000 7f3651835740 10 client.25931 fetch_fsmap finished waiting for FSMap version 38 2024-09-19T07:17:38.484 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.483+0000 7f3651835740 10 client.25931 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:17:38.484 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.483+0000 7f3651835740 20 client.25931 populate_metadata read hostname 'smithi148' 2024-09-19T07:17:38.484 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.483+0000 7f3651835740 1 --2- 172.21.15.148:0/554354445 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x562356ca53e0 0x562356ca7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:38.484 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.483+0000 7f3651835740 4 client.25931 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:17:38.484 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.483+0000 7f3651835740 1 -- 172.21.15.148:0/554354445 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562356bfba20 con 0x562356ca53e0 2024-09-19T07:17:38.485 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.484+0000 7f364c837640 1 --2- 172.21.15.148:0/554354445 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x562356ca53e0 0x562356ca7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:38.485 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.484+0000 7f364c837640 1 --2- 172.21.15.148:0/554354445 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x562356ca53e0 0x562356ca7800 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5504dd5210dd974 server_cookie=34a22a2d327632f1 in_seq=0 out_seq=0 2024-09-19T07:17:38.486 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.485+0000 7f362c7f8640 10 client.25931 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:17:38.486 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.485+0000 7f362c7f8640 1 -- 172.21.15.148:0/554354445 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562356bfba20 con 0x562356ca53e0 2024-09-19T07:17:38.486 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.485+0000 7f362c7f8640 10 client.25931 handle_command_reply: tid=0 2024-09-19T07:17:38.486 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.485+0000 7f3651835740 1 client.25931 shutdown 2024-09-19T07:17:38.487 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.486+0000 7f3651835740 1 -- 172.21.15.148:0/554354445 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562356c8a5e0 msgr2=0x562356c92270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:17:38.487 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.486+0000 7f3651835740 1 --2- 172.21.15.148:0/554354445 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562356c8a5e0 0x562356c92270 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f363c0cd880 tx=0x7f363c09cc10 comp rx=0 tx=0).stop 2024-09-19T07:17:38.488 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.488+0000 7f3651835740 1 -- 172.21.15.148:0/554354445 shutdown_connections 2024-09-19T07:17:38.488 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.488+0000 7f3651835740 1 --2- 172.21.15.148:0/554354445 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x562356ca53e0 0x562356ca7800 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:38.489 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.488+0000 7f3651835740 1 --2- 172.21.15.148:0/554354445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562356c94e80 0x562356c927b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:38.489 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.488+0000 7f3651835740 1 --2- 172.21.15.148:0/554354445 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562356c8a5e0 0x562356c92270 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:38.489 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.488+0000 7f3651835740 1 --2- 172.21.15.148:0/554354445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562356c89cc0 0x562356c91d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:38.489 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.488+0000 7f3651835740 1 -- 172.21.15.148:0/554354445 >> 172.21.15.148:0/554354445 conn(0x562356c86230 msgr2=0x562356c8bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:17:38.489 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.488+0000 7f362c7f8640 0 client.25931 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:17:38.490 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.488+0000 7f3651835740 1 -- 172.21.15.148:0/554354445 shutdown_connections 2024-09-19T07:17:38.490 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.488+0000 7f3651835740 1 -- 172.21.15.148:0/554354445 wait complete. 2024-09-19T07:17:38.492 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.491+0000 7f3651835740 20 client.25931 trim_cache size 0 max 16384 2024-09-19T07:17:38.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:17:38 smithi179 ceph-mon[35716]: pgmap v201: 97 pgs: 97 active+clean; 1.3 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.1 MiB/s wr, 300 op/s 2024-09-19T07:17:38.791 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.791+0000 7f3651835740 1 Processor -- start 2024-09-19T07:17:38.794 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.793+0000 7f3651835740 1 -- start start 2024-09-19T07:17:38.794 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.794+0000 7f3651835740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562356c89cc0 0x562356c925e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:38.794 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.794+0000 7f3651835740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562356c8a5e0 0x562356c93ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:38.795 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.794+0000 7f364c837640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562356c89cc0 0x562356c925e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:38.795 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.794+0000 7f364c837640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562356c89cc0 0x562356c925e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:33826/0 (socket says 172.21.15.148:33826) 2024-09-19T07:17:38.795 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.794+0000 7f3647fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562356c8a5e0 0x562356c93ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:38.796 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.795+0000 7f3647fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562356c8a5e0 0x562356c93ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42136/0 (socket says 172.21.15.148:42136) 2024-09-19T07:17:38.796 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.795+0000 7f3651835740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562356c94e80 0x562356cad110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:38.796 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.795+0000 7f3647fff640 1 -- 172.21.15.148:0/957776248 learned_addr learned my addr 172.21.15.148:0/957776248 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:17:38.796 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.795+0000 7f3651835740 1 -- 172.21.15.148:0/957776248 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3634011220 con 0x562356c8a5e0 2024-09-19T07:17:38.796 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.795+0000 7f3651835740 1 -- 172.21.15.148:0/957776248 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f363400ea30 con 0x562356c89cc0 2024-09-19T07:17:38.796 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.795+0000 7f3651835740 1 -- 172.21.15.148:0/957776248 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f363400c860 con 0x562356c94e80 2024-09-19T07:17:38.796 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.795+0000 7f364d038640 1 --2- 172.21.15.148:0/957776248 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562356c94e80 0x562356cad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:38.803 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.802+0000 7f3647fff640 1 -- 172.21.15.148:0/957776248 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562356c94e80 msgr2=0x562356cad110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:17:38.803 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.802+0000 7f3647fff640 1 --2- 172.21.15.148:0/957776248 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562356c94e80 0x562356cad110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:38.803 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.802+0000 7f3647fff640 1 -- 172.21.15.148:0/957776248 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562356c89cc0 msgr2=0x562356c925e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:17:38.803 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.803+0000 7f3647fff640 1 --2- 172.21.15.148:0/957776248 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562356c89cc0 0x562356c925e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:38.804 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.803+0000 7f3647fff640 1 -- 172.21.15.148:0/957776248 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562356c8a410 con 0x562356c8a5e0 2024-09-19T07:17:38.804 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.803+0000 7f3647fff640 1 --2- 172.21.15.148:0/957776248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562356c8a5e0 0x562356c93ca0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f363c09a7c0 tx=0x7f363c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c42655df51094926 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:17:38.807 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.806+0000 7f362e7fc640 1 -- 172.21.15.148:0/957776248 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f363c0cd960 con 0x562356c8a5e0 2024-09-19T07:17:38.807 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.807+0000 7f362e7fc640 1 -- 172.21.15.148:0/957776248 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f363c0cdb00 con 0x562356c8a5e0 2024-09-19T07:17:38.807 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.807+0000 7f362e7fc640 1 -- 172.21.15.148:0/957776248 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f363c0b5470 con 0x562356c8a5e0 2024-09-19T07:17:38.809 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.808+0000 7f3651835740 1 -- 172.21.15.148:0/957776248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562356c8a5e0 msgr2=0x562356c93ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:17:38.809 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.808+0000 7f3651835740 1 --2- 172.21.15.148:0/957776248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562356c8a5e0 0x562356c93ca0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f363c09a7c0 tx=0x7f363c0046c0 comp rx=0 tx=0).stop 2024-09-19T07:17:38.817 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.816+0000 7f3651835740 1 -- 172.21.15.148:0/957776248 shutdown_connections 2024-09-19T07:17:38.817 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.816+0000 7f3651835740 1 --2- 172.21.15.148:0/957776248 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562356c94e80 0x562356cad110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:38.817 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.816+0000 7f3651835740 1 --2- 172.21.15.148:0/957776248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562356c8a5e0 0x562356c93ca0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:38.817 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.816+0000 7f3651835740 1 --2- 172.21.15.148:0/957776248 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562356c89cc0 0x562356c925e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:38.818 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.817+0000 7f3651835740 1 -- 172.21.15.148:0/957776248 >> 172.21.15.148:0/957776248 conn(0x562356c86230 msgr2=0x562356c93590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:17:38.826 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.826+0000 7f3651835740 1 -- 172.21.15.148:0/957776248 shutdown_connections 2024-09-19T07:17:38.826 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.826+0000 7f3651835740 1 -- 172.21.15.148:0/957776248 wait complete. 2024-09-19T07:17:38.827 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.826+0000 7f3651835740 1 -- start start 2024-09-19T07:17:38.827 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.827+0000 7f3651835740 1 Processor -- start 2024-09-19T07:17:38.828 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.827+0000 7f3651835740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562356c89cc0 0x562356c95260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:38.828 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.827+0000 7f3651835740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562356c8a5e0 0x562356c957a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:38.829 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.828+0000 7f364c837640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562356c89cc0 0x562356c95260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:38.829 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.828+0000 7f364c837640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562356c89cc0 0x562356c95260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:33828/0 (socket says 172.21.15.148:33828) 2024-09-19T07:17:38.829 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.828+0000 7f364c837640 1 -- 172.21.15.148:0/320257472 learned_addr learned my addr 172.21.15.148:0/320257472 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:17:38.829 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.828+0000 7f3647fff640 1 --2- 172.21.15.148:0/320257472 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562356c8a5e0 0x562356c957a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:38.829 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.828+0000 7f3651835740 1 --2- 172.21.15.148:0/320257472 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562356c94e80 0x562356c95ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:38.830 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.828+0000 7f364d038640 1 --2- 172.21.15.148:0/320257472 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562356c94e80 0x562356c95ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:38.830 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.828+0000 7f3651835740 1 -- 172.21.15.148:0/320257472 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f363400cef0 con 0x562356c94e80 2024-09-19T07:17:38.830 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.828+0000 7f3651835740 1 -- 172.21.15.148:0/320257472 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f363400e360 con 0x562356c89cc0 2024-09-19T07:17:38.830 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.828+0000 7f3651835740 1 -- 172.21.15.148:0/320257472 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f363400d5c0 con 0x562356c8a5e0 2024-09-19T07:17:38.830 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.829+0000 7f3647fff640 1 -- 172.21.15.148:0/320257472 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562356c89cc0 msgr2=0x562356c95260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:17:38.831 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.829+0000 7f3647fff640 1 --2- 172.21.15.148:0/320257472 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562356c89cc0 0x562356c95260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:38.831 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.829+0000 7f3647fff640 1 -- 172.21.15.148:0/320257472 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562356c94e80 msgr2=0x562356c95ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:17:38.831 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.829+0000 7f3647fff640 1 --2- 172.21.15.148:0/320257472 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562356c94e80 0x562356c95ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:38.831 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.829+0000 7f3647fff640 1 -- 172.21.15.148:0/320257472 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562356c9bf60 con 0x562356c8a5e0 2024-09-19T07:17:38.831 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.829+0000 7f364d038640 1 --2- 172.21.15.148:0/320257472 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562356c94e80 0x562356c95ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:17:38.831 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.830+0000 7f3651835740 10 client.0 _ll_register_callbacks cb 0x7f363c09c050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:17:38.831 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.830+0000 7f3651835740 1 -- 172.21.15.148:0/320257472 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f363c0cdb00 con 0x562356c8a5e0 2024-09-19T07:17:38.831 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.830+0000 7f3647fff640 1 --2- 172.21.15.148:0/320257472 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562356c8a5e0 0x562356c957a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f363c09a7c0 tx=0x7f363c09c3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12466123cc0dd4ce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:17:38.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:17:38 smithi148 ceph-mon[31180]: pgmap v201: 97 pgs: 97 active+clean; 1.3 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.1 MiB/s wr, 300 op/s 2024-09-19T07:17:38.841 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.840+0000 7f362c7f8640 10 client.26029 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-19T07:17:38.841 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.840+0000 7f362c7f8640 1 -- 172.21.15.148:0/320257472 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f363c07c020 con 0x562356c8a5e0 2024-09-19T07:17:38.841 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.840+0000 7f362c7f8640 1 -- 172.21.15.148:0/320257472 <== mon.1 v2:172.21.15.179:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8512+0+0 (secure 0 0 0) 0x7f363c0982b0 con 0x562356c8a5e0 2024-09-19T07:17:38.841 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.840+0000 7f362c7f8640 1 -- 172.21.15.148:0/320257472 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f363c0cd960 con 0x562356c8a5e0 2024-09-19T07:17:38.841 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.840+0000 7f3651835740 10 client.26029 fetch_fsmap learned FSMap version 38 2024-09-19T07:17:38.841 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.840+0000 7f3651835740 1 -- 172.21.15.148:0/320257472 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({fsmap=38}) -- 0x562356c9ce20 con 0x562356c8a5e0 2024-09-19T07:17:38.862 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.861+0000 7f362c7f8640 1 -- 172.21.15.148:0/320257472 <== mon.1 v2:172.21.15.179:3300/0 4 ==== fsmap(e 38) ==== 8366+0+0 (secure 0 0 0) 0x7f363c010610 con 0x562356c8a5e0 2024-09-19T07:17:38.862 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.861+0000 7f3651835740 10 client.26029 fetch_fsmap finished waiting for FSMap version 38 2024-09-19T07:17:38.862 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.861+0000 7f3651835740 10 client.26029 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:17:38.862 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.861+0000 7f3651835740 20 client.26029 populate_metadata read hostname 'smithi148' 2024-09-19T07:17:38.862 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.861+0000 7f3651835740 1 --2- 172.21.15.148:0/320257472 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x562356c9d260 0x562356c9d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:38.862 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.861+0000 7f3651835740 4 client.26029 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:17:38.863 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.861+0000 7f3651835740 1 -- 172.21.15.148:0/320257472 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f363c0cdb00 con 0x562356c9d260 2024-09-19T07:17:38.863 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.861+0000 7f364c837640 1 --2- 172.21.15.148:0/320257472 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x562356c9d260 0x562356c9d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:38.863 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.862+0000 7f364c837640 1 --2- 172.21.15.148:0/320257472 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x562356c9d260 0x562356c9d710 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f589859e593806a server_cookie=ef71c107ecacac0f in_seq=0 out_seq=0 2024-09-19T07:17:38.864 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:38.864+0000 7f362c7f8640 10 client.26029 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:17:38.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:17:38 smithi165 ceph-mon[35326]: pgmap v201: 97 pgs: 97 active+clean; 1.3 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.1 MiB/s wr, 300 op/s 2024-09-19T07:17:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:40.572+0000 7f362c7f8640 1 -- 172.21.15.148:0/320257472 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f363c0cdb00 con 0x562356c9d260 2024-09-19T07:17:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:40.572+0000 7f362c7f8640 10 client.26029 handle_command_reply: tid=0 2024-09-19T07:17:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:40.572+0000 7f3651835740 1 client.26029 shutdown 2024-09-19T07:17:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:40.572+0000 7f3651835740 1 -- 172.21.15.148:0/320257472 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562356c8a5e0 msgr2=0x562356c957a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:17:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:40.572+0000 7f3651835740 1 --2- 172.21.15.148:0/320257472 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562356c8a5e0 0x562356c957a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f363c09a7c0 tx=0x7f363c09c3b0 comp rx=0 tx=0).stop 2024-09-19T07:17:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:40.572+0000 7f3651835740 1 -- 172.21.15.148:0/320257472 shutdown_connections 2024-09-19T07:17:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:40.572+0000 7f3651835740 1 --2- 172.21.15.148:0/320257472 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x562356c9d260 0x562356c9d710 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:40.572+0000 7f3651835740 1 --2- 172.21.15.148:0/320257472 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562356c94e80 0x562356c95ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:40.572+0000 7f3651835740 1 --2- 172.21.15.148:0/320257472 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562356c8a5e0 0x562356c957a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:40.572+0000 7f3651835740 1 --2- 172.21.15.148:0/320257472 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562356c89cc0 0x562356c95260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:40.575 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:40.572+0000 7f3651835740 1 -- 172.21.15.148:0/320257472 >> 172.21.15.148:0/320257472 conn(0x562356c86230 msgr2=0x562356c85260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:17:40.575 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:40.573+0000 7f362c7f8640 0 client.26029 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:17:40.575 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:40.573+0000 7f3651835740 1 -- 172.21.15.148:0/320257472 shutdown_connections 2024-09-19T07:17:40.575 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:40.573+0000 7f3651835740 1 -- 172.21.15.148:0/320257472 wait complete. 2024-09-19T07:17:40.575 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:40.573+0000 7f3651835740 20 client.26029 trim_cache size 0 max 16384 2024-09-19T07:17:40.575 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:17:40.576 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:17:40.576 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:17:40.576 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:17:40.599 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:40.597+0000 7f364ea9b640 1 -- 172.21.15.148:0/1089710597 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f36300a35c0 msgr2=0x7f36300a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:17:40.599 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:40.597+0000 7f364ea9b640 1 --2- 172.21.15.148:0/1089710597 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f36300a35c0 0x7f36300a5a80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f364002aed0 tx=0x7f3640000f40 comp rx=0 tx=0).stop 2024-09-19T07:17:40.599 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:40.597+0000 7f364ea9b640 1 -- 172.21.15.148:0/1089710597 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f364811b140 msgr2=0x7f3648111950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:17:40.599 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:40.597+0000 7f364ea9b640 1 --2- 172.21.15.148:0/1089710597 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f364811b140 0x7f3648111950 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f363c00b4a0 tx=0x7f363c00b960 comp rx=0 tx=0).stop 2024-09-19T07:17:40.599 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:40.598+0000 7f364ea9b640 1 -- 172.21.15.148:0/1089710597 shutdown_connections 2024-09-19T07:17:40.599 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:40.598+0000 7f364ea9b640 1 --2- 172.21.15.148:0/1089710597 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f36300a35c0 0x7f36300a5a80 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:40.600 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:40.598+0000 7f364ea9b640 1 --2- 172.21.15.148:0/1089710597 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3648111e90 0x7f3648112340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:40.600 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:40.598+0000 7f364ea9b640 1 --2- 172.21.15.148:0/1089710597 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f364811b140 0x7f3648111950 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:40.600 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:40.598+0000 7f364ea9b640 1 --2- 172.21.15.148:0/1089710597 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36481095d0 0x7f36481188d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:40.600 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:40.598+0000 7f364ea9b640 1 -- 172.21.15.148:0/1089710597 >> 172.21.15.148:0/1089710597 conn(0x7f364806cc60 msgr2=0x7f364811b910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:17:40.600 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:40.599+0000 7f364ea9b640 1 -- 172.21.15.148:0/1089710597 shutdown_connections 2024-09-19T07:17:40.601 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:40.600+0000 7f364ea9b640 1 -- 172.21.15.148:0/1089710597 wait complete. 2024-09-19T07:17:40.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:17:40 smithi179 ceph-mon[35716]: pgmap v202: 97 pgs: 97 active+clean; 1.3 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.4 MiB/s wr, 204 op/s 2024-09-19T07:17:40.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:17:40 smithi148 ceph-mon[31180]: pgmap v202: 97 pgs: 97 active+clean; 1.3 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.4 MiB/s wr, 204 op/s 2024-09-19T07:17:40.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:17:40 smithi165 ceph-mon[35326]: pgmap v202: 97 pgs: 97 active+clean; 1.3 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.4 MiB/s wr, 204 op/s 2024-09-19T07:17:42.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:17:42 smithi179 ceph-mon[35716]: pgmap v203: 97 pgs: 97 active+clean; 1.3 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.5 MiB/s wr, 604 op/s 2024-09-19T07:17:42.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:17:42 smithi148 ceph-mon[31180]: pgmap v203: 97 pgs: 97 active+clean; 1.3 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.5 MiB/s wr, 604 op/s 2024-09-19T07:17:42.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:17:42 smithi165 ceph-mon[35326]: pgmap v203: 97 pgs: 97 active+clean; 1.3 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.5 MiB/s wr, 604 op/s 2024-09-19T07:17:43.195 INFO:tasks.workunit.client.0.smithi148.stdout: 373 2052651 1108 1371744 786 735820 1323 2024-09-19T07:17:44.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:17:44 smithi179 ceph-mon[35716]: pgmap v204: 97 pgs: 97 active+clean; 1.4 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.9 MiB/s wr, 645 op/s 2024-09-19T07:17:44.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:17:44 smithi148 ceph-mon[31180]: pgmap v204: 97 pgs: 97 active+clean; 1.4 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.9 MiB/s wr, 645 op/s 2024-09-19T07:17:44.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:17:44 smithi165 ceph-mon[35326]: pgmap v204: 97 pgs: 97 active+clean; 1.4 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.9 MiB/s wr, 645 op/s 2024-09-19T07:17:46.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:17:46 smithi179 ceph-mon[35716]: pgmap v205: 97 pgs: 97 active+clean; 1.4 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 11 MiB/s wr, 1.03k op/s 2024-09-19T07:17:46.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:17:46 smithi148 ceph-mon[31180]: pgmap v205: 97 pgs: 97 active+clean; 1.4 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 11 MiB/s wr, 1.03k op/s 2024-09-19T07:17:46.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:17:46 smithi165 ceph-mon[35326]: pgmap v205: 97 pgs: 97 active+clean; 1.4 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 11 MiB/s wr, 1.03k op/s 2024-09-19T07:17:47.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:17:47 smithi179 ceph-mon[35716]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:17:47.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:17:47 smithi148 ceph-mon[31180]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:17:47.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:17:47 smithi165 ceph-mon[35326]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:17:48.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:17:48 smithi179 ceph-mon[35716]: pgmap v206: 97 pgs: 97 active+clean; 1.4 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 10 MiB/s wr, 1.03k op/s 2024-09-19T07:17:48.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:17:48 smithi148 ceph-mon[31180]: pgmap v206: 97 pgs: 97 active+clean; 1.4 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 10 MiB/s wr, 1.03k op/s 2024-09-19T07:17:48.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:17:48 smithi165 ceph-mon[35326]: pgmap v206: 97 pgs: 97 active+clean; 1.4 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 10 MiB/s wr, 1.03k op/s 2024-09-19T07:17:50.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:17:50 smithi179 ceph-mon[35716]: pgmap v207: 97 pgs: 97 active+clean; 1.4 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 11 MiB/s wr, 1.10k op/s 2024-09-19T07:17:50.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:17:50 smithi148 ceph-mon[31180]: pgmap v207: 97 pgs: 97 active+clean; 1.4 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 11 MiB/s wr, 1.10k op/s 2024-09-19T07:17:50.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:17:50 smithi165 ceph-mon[35326]: pgmap v207: 97 pgs: 97 active+clean; 1.4 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 11 MiB/s wr, 1.10k op/s 2024-09-19T07:17:52.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:17:52 smithi148 ceph-mon[31180]: pgmap v208: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 16 MiB/s wr, 1.37k op/s 2024-09-19T07:17:52.885 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:17:52 smithi165 ceph-mon[35326]: pgmap v208: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 16 MiB/s wr, 1.37k op/s 2024-09-19T07:17:53.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:17:52 smithi179 ceph-mon[35716]: pgmap v208: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 16 MiB/s wr, 1.37k op/s 2024-09-19T07:17:53.195 INFO:tasks.workunit.client.0.smithi148.stdout: 387 1497420 793 1004637 904 535607 1158 2024-09-19T07:17:54.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:17:54 smithi148 ceph-mon[31180]: pgmap v209: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 16 MiB/s wr, 1.00k op/s 2024-09-19T07:17:54.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:17:54 smithi165 ceph-mon[35326]: pgmap v209: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 16 MiB/s wr, 1.00k op/s 2024-09-19T07:17:54.960 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:54.958+0000 7f126c952640 1 -- 172.21.15.148:0/3308894241 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12681091f0 msgr2=0x7f1268110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:17:54.961 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:54.958+0000 7f126c952640 1 --2- 172.21.15.148:0/3308894241 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12681091f0 0x7f1268110250 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f125801a910 tx=0x7f125803b470 comp rx=0 tx=0).stop 2024-09-19T07:17:54.961 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:54.958+0000 7f126c952640 1 -- 172.21.15.148:0/3308894241 shutdown_connections 2024-09-19T07:17:54.961 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:54.958+0000 7f126c952640 1 --2- 172.21.15.148:0/3308894241 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f126811b140 0x7f126811d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:54.961 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:54.958+0000 7f126c952640 1 --2- 172.21.15.148:0/3308894241 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12681095d0 0x7f1268109a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:54.961 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:54.959+0000 7f126c952640 1 --2- 172.21.15.148:0/3308894241 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12681091f0 0x7f1268110250 secure :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f125801a910 tx=0x7f125803b470 comp rx=0 tx=0).stop 2024-09-19T07:17:54.961 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:54.959+0000 7f126c952640 1 -- 172.21.15.148:0/3308894241 >> 172.21.15.148:0/3308894241 conn(0x7f126806cc60 msgr2=0x7f126806d070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:17:54.979 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:54.973+0000 7f126c952640 1 -- 172.21.15.148:0/3308894241 shutdown_connections 2024-09-19T07:17:54.979 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:54.973+0000 7f126c952640 1 -- 172.21.15.148:0/3308894241 wait complete. 2024-09-19T07:17:54.979 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:54.974+0000 7f126c952640 1 Processor -- start 2024-09-19T07:17:54.979 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:54.975+0000 7f126c952640 1 -- start start 2024-09-19T07:17:54.979 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:54.975+0000 7f126c952640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12681095d0 0x7f126811ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:54.979 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:54.976+0000 7f126c952640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f126811b140 0x7f1268116bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:54.979 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:54.976+0000 7f1265d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f126811b140 0x7f1268116bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:54.979 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:54.976+0000 7f1265d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f126811b140 0x7f1268116bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39512/0 (socket says 172.21.15.148:39512) 2024-09-19T07:17:54.979 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:54.976+0000 7f1265d9b640 1 -- 172.21.15.148:0/2271336838 learned_addr learned my addr 172.21.15.148:0/2271336838 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:17:54.979 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:54.976+0000 7f126c952640 1 --2- 172.21.15.148:0/2271336838 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1268117180 0x7f12681175e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:54.980 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:54.976+0000 7f126659c640 1 --2- 172.21.15.148:0/2271336838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12681095d0 0x7f126811ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:54.980 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:54.977+0000 7f126c952640 1 -- 172.21.15.148:0/2271336838 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1268113360 con 0x7f126811b140 2024-09-19T07:17:54.980 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:54.977+0000 7f1266d9d640 1 --2- 172.21.15.148:0/2271336838 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1268117180 0x7f12681175e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:54.980 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:54.977+0000 7f126c952640 1 -- 172.21.15.148:0/2271336838 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f12681131e0 con 0x7f1268117180 2024-09-19T07:17:54.980 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:54.977+0000 7f126c952640 1 -- 172.21.15.148:0/2271336838 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f12681134e0 con 0x7f12681095d0 2024-09-19T07:17:54.981 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:54.978+0000 7f1266d9d640 1 -- 172.21.15.148:0/2271336838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12681095d0 msgr2=0x7f126811ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:17:54.981 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:54.978+0000 7f1266d9d640 1 --2- 172.21.15.148:0/2271336838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12681095d0 0x7f126811ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:54.981 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:54.978+0000 7f1266d9d640 1 -- 172.21.15.148:0/2271336838 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f126811b140 msgr2=0x7f1268116bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:17:54.981 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:54.978+0000 7f1266d9d640 1 --2- 172.21.15.148:0/2271336838 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f126811b140 0x7f1268116bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:54.981 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:54.978+0000 7f1266d9d640 1 -- 172.21.15.148:0/2271336838 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12681ab170 con 0x7f1268117180 2024-09-19T07:17:54.981 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:54.978+0000 7f1265d9b640 1 --2- 172.21.15.148:0/2271336838 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f126811b140 0x7f1268116bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:17:54.981 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:54.979+0000 7f1266d9d640 1 --2- 172.21.15.148:0/2271336838 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1268117180 0x7f12681175e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f126000ca00 tx=0x7f126000cec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:17:54.994 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:54.993+0000 7f12577fe640 1 -- 172.21.15.148:0/2271336838 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1260007d30 con 0x7f1268117180 2024-09-19T07:17:54.996 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:54.995+0000 7f126c952640 1 -- 172.21.15.148:0/2271336838 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12681ab400 con 0x7f1268117180 2024-09-19T07:17:54.996 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:54.996+0000 7f126c952640 1 -- 172.21.15.148:0/2271336838 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12681ab8f0 con 0x7f1268117180 2024-09-19T07:17:55.001 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.000+0000 7f126f7cc740 1 Processor -- start 2024-09-19T07:17:55.003 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.002+0000 7f12577fe640 1 -- 172.21.15.148:0/2271336838 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1260005020 con 0x7f1268117180 2024-09-19T07:17:55.003 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.002+0000 7f12577fe640 1 -- 172.21.15.148:0/2271336838 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126000f6b0 con 0x7f1268117180 2024-09-19T07:17:55.003 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.003+0000 7f12577fe640 1 -- 172.21.15.148:0/2271336838 <== mon.2 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f126000f970 con 0x7f1268117180 2024-09-19T07:17:55.004 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.003+0000 7f126f7cc740 1 -- start start 2024-09-19T07:17:55.005 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.004+0000 7f126f7cc740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56162fc4e5e0 0x56162fc4ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:55.006 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.005+0000 7f1265d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56162fc4e5e0 0x56162fc4ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:55.006 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.005+0000 7f1265d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56162fc4e5e0 0x56162fc4ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39526/0 (socket says 172.21.15.148:39526) 2024-09-19T07:17:55.006 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.005+0000 7f12577fe640 1 --2- 172.21.15.148:0/2271336838 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f12500a35f0 0x7f12500a5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:55.006 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.005+0000 7f1265d9b640 1 -- 172.21.15.148:0/3841958414 learned_addr learned my addr 172.21.15.148:0/3841958414 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:17:55.006 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.005+0000 7f126f7cc740 1 --2- 172.21.15.148:0/3841958414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56162fc4d3c0 0x56162fc4d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:55.006 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.005+0000 7f126f7cc740 1 --2- 172.21.15.148:0/3841958414 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56162fc57c80 0x56162fc5a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:55.006 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.005+0000 7f126f7cc740 1 -- 172.21.15.148:0/3841958414 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56162fbb12f0 con 0x56162fc4e5e0 2024-09-19T07:17:55.006 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.005+0000 7f12577fe640 1 -- 172.21.15.148:0/2271336838 <== mon.2 v2:172.21.15.165:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8512+0+0 (secure 0 0 0) 0x7f12600d0ee0 con 0x7f1268117180 2024-09-19T07:17:55.006 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.005+0000 7f126f7cc740 1 -- 172.21.15.148:0/3841958414 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56162fb59270 con 0x56162fc57c80 2024-09-19T07:17:55.007 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.005+0000 7f126f7cc740 1 -- 172.21.15.148:0/3841958414 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56162fbad2b0 con 0x56162fc4d3c0 2024-09-19T07:17:55.007 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.005+0000 7f1266d9d640 1 --2- 172.21.15.148:0/3841958414 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56162fc57c80 0x56162fc5a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:55.007 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.006+0000 7f1265d9b640 1 -- 172.21.15.148:0/3841958414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56162fc4d3c0 msgr2=0x56162fc4d820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T07:17:55.007 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.006+0000 7f1265d9b640 1 --2- 172.21.15.148:0/3841958414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56162fc4d3c0 0x56162fc4d820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:55.007 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.006+0000 7f1265d9b640 1 -- 172.21.15.148:0/3841958414 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56162fc57c80 msgr2=0x56162fc5a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:17:55.008 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.006+0000 7f1265d9b640 1 --2- 172.21.15.148:0/3841958414 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56162fc57c80 0x56162fc5a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:55.008 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.006+0000 7f1265d9b640 1 -- 172.21.15.148:0/3841958414 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56162fb58340 con 0x56162fc4e5e0 2024-09-19T07:17:55.008 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.006+0000 7f1265d9b640 1 --2- 172.21.15.148:0/3841958414 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56162fc4e5e0 0x56162fc4ce80 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f125c0093b0 tx=0x7f125c00e700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15cc06b2b467e0c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:17:55.008 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.007+0000 7f1266d9d640 1 --2- 172.21.15.148:0/3841958414 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56162fc57c80 0x56162fc5a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:17:55.008 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.007+0000 7f126659c640 1 --2- 172.21.15.148:0/2271336838 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f12500a35f0 0x7f12500a5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:55.009 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.008+0000 7f126659c640 1 --2- 172.21.15.148:0/2271336838 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f12500a35f0 0x7f12500a5ab0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f125801a860 tx=0x7f1258005fd0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:17:55.015 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.015+0000 7f124ffff640 1 -- 172.21.15.148:0/3841958414 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f125c017070 con 0x56162fc4e5e0 2024-09-19T07:17:55.015 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.015+0000 7f124ffff640 1 -- 172.21.15.148:0/3841958414 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f125c013950 con 0x56162fc4e5e0 2024-09-19T07:17:55.017 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.016+0000 7f126f7cc740 1 -- 172.21.15.148:0/3841958414 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56162fc4e5e0 msgr2=0x56162fc4ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:17:55.017 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.016+0000 7f126f7cc740 1 --2- 172.21.15.148:0/3841958414 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56162fc4e5e0 0x56162fc4ce80 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f125c0093b0 tx=0x7f125c00e700 comp rx=0 tx=0).stop 2024-09-19T07:17:55.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:17:54 smithi179 ceph-mon[35716]: pgmap v209: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 16 MiB/s wr, 1.00k op/s 2024-09-19T07:17:55.024 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.023+0000 7f126f7cc740 1 -- 172.21.15.148:0/3841958414 shutdown_connections 2024-09-19T07:17:55.024 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.023+0000 7f126f7cc740 1 --2- 172.21.15.148:0/3841958414 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56162fc57c80 0x56162fc5a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:55.024 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.023+0000 7f126f7cc740 1 --2- 172.21.15.148:0/3841958414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56162fc4d3c0 0x56162fc4d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:55.024 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.023+0000 7f126f7cc740 1 --2- 172.21.15.148:0/3841958414 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56162fc4e5e0 0x56162fc4ce80 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:55.024 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.023+0000 7f126f7cc740 1 -- 172.21.15.148:0/3841958414 >> 172.21.15.148:0/3841958414 conn(0x56162fc49570 msgr2=0x56162fc49950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:17:55.024 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.023+0000 7f126f7cc740 1 -- 172.21.15.148:0/3841958414 shutdown_connections 2024-09-19T07:17:55.024 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.024+0000 7f126f7cc740 1 -- 172.21.15.148:0/3841958414 wait complete. 2024-09-19T07:17:55.025 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.024+0000 7f126f7cc740 1 -- start start 2024-09-19T07:17:55.025 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.024+0000 7f126f7cc740 1 Processor -- start 2024-09-19T07:17:55.026 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.025+0000 7f126f7cc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56162fc4d3c0 0x56162fc54a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:55.026 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.025+0000 7f126f7cc740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56162fc4e5e0 0x56162fc54fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:55.026 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.025+0000 7f126f7cc740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56162fc57c80 0x56162fc554e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:55.027 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.025+0000 7f126659c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56162fc4d3c0 0x56162fc54a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:55.027 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.026+0000 7f126659c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56162fc4d3c0 0x56162fc54a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:48274/0 (socket says 172.21.15.148:48274) 2024-09-19T07:17:55.027 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.026+0000 7f1265d9b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56162fc4e5e0 0x56162fc54fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:55.027 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.026+0000 7f1265d9b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56162fc4e5e0 0x56162fc54fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:45162/0 (socket says 172.21.15.148:45162) 2024-09-19T07:17:55.028 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.026+0000 7f1266d9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56162fc57c80 0x56162fc554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:55.028 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.026+0000 7f1266d9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56162fc57c80 0x56162fc554e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39534/0 (socket says 172.21.15.148:39534) 2024-09-19T07:17:55.028 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.026+0000 7f126f7cc740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56162fc5ab10 con 0x56162fc57c80 2024-09-19T07:17:55.028 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.026+0000 7f126f7cc740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56162fb3a290 con 0x56162fc4e5e0 2024-09-19T07:17:55.028 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.026+0000 7f126f7cc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56162fc5ac90 con 0x56162fc4d3c0 2024-09-19T07:17:55.028 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.026+0000 7f126659c640 1 -- 172.21.15.148:0/1630322801 learned_addr learned my addr 172.21.15.148:0/1630322801 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:17:55.028 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.027+0000 7f1265d9b640 1 -- 172.21.15.148:0/1630322801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56162fc4d3c0 msgr2=0x56162fc54a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:17:55.028 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.027+0000 7f1265d9b640 1 --2- 172.21.15.148:0/1630322801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56162fc4d3c0 0x56162fc54a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:55.028 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.027+0000 7f1265d9b640 1 -- 172.21.15.148:0/1630322801 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56162fc57c80 msgr2=0x56162fc554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:17:55.028 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.027+0000 7f1265d9b640 1 --2- 172.21.15.148:0/1630322801 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56162fc57c80 0x56162fc554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:55.029 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.027+0000 7f1265d9b640 1 -- 172.21.15.148:0/1630322801 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56162f8c4210 con 0x56162fc4e5e0 2024-09-19T07:17:55.029 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.027+0000 7f126659c640 1 --2- 172.21.15.148:0/1630322801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56162fc4d3c0 0x56162fc54a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:17:55.029 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.027+0000 7f1266d9d640 1 --2- 172.21.15.148:0/1630322801 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56162fc57c80 0x56162fc554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:17:55.029 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.027+0000 7f126f7cc740 10 client.0 _ll_register_callbacks cb 0x56162fb6b140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:17:55.029 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.027+0000 7f1265d9b640 1 --2- 172.21.15.148:0/1630322801 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56162fc4e5e0 0x56162fc54fa0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f125c0093b0 tx=0x7f125c012e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d414e37e7e76e819 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:17:55.029 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.027+0000 7f126f7cc740 1 -- 172.21.15.148:0/1630322801 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f125c013950 con 0x56162fc4e5e0 2024-09-19T07:17:55.140 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.139+0000 7f124dffb640 10 client.25946 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-19T07:17:55.140 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.139+0000 7f124dffb640 1 -- 172.21.15.148:0/1630322801 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f125c020070 con 0x56162fc4e5e0 2024-09-19T07:17:55.140 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.139+0000 7f124dffb640 1 -- 172.21.15.148:0/1630322801 <== mon.2 v2:172.21.15.165:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8512+0+0 (secure 0 0 0) 0x7f125c004040 con 0x56162fc4e5e0 2024-09-19T07:17:55.142 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.141+0000 7f124dffb640 1 -- 172.21.15.148:0/1630322801 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f125c017070 con 0x56162fc4e5e0 2024-09-19T07:17:55.142 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.141+0000 7f126f7cc740 10 client.25946 fetch_fsmap learned FSMap version 39 2024-09-19T07:17:55.142 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.141+0000 7f126f7cc740 1 -- 172.21.15.148:0/1630322801 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({fsmap=39}) -- 0x56162f990620 con 0x56162fc4e5e0 2024-09-19T07:17:55.148 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.147+0000 7f124dffb640 1 -- 172.21.15.148:0/1630322801 <== mon.2 v2:172.21.15.165:3300/0 4 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f125c004240 con 0x56162fc4e5e0 2024-09-19T07:17:55.148 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.147+0000 7f126f7cc740 10 client.25946 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T07:17:55.148 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.147+0000 7f126f7cc740 10 client.25946 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:17:55.148 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.147+0000 7f126f7cc740 20 client.25946 populate_metadata read hostname 'smithi148' 2024-09-19T07:17:55.148 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.147+0000 7f126f7cc740 1 --2- 172.21.15.148:0/1630322801 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56162fc67f40 0x56162fc6a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:55.148 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.147+0000 7f126f7cc740 4 client.25946 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:17:55.148 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.147+0000 7f126f7cc740 1 -- 172.21.15.148:0/1630322801 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56162fbbea20 con 0x56162fc67f40 2024-09-19T07:17:55.148 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.147+0000 7f126659c640 1 --2- 172.21.15.148:0/1630322801 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56162fc67f40 0x56162fc6a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:55.148 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.148+0000 7f126659c640 1 --2- 172.21.15.148:0/1630322801 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56162fc67f40 0x56162fc6a400 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3293ac6c301456e server_cookie=2ab51f34875391c8 in_seq=0 out_seq=0 2024-09-19T07:17:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.152+0000 7f124dffb640 10 client.25946 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:17:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.152+0000 7f124dffb640 1 -- 172.21.15.148:0/1630322801 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56162fbbea20 con 0x56162fc67f40 2024-09-19T07:17:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.152+0000 7f124dffb640 10 client.25946 handle_command_reply: tid=0 2024-09-19T07:17:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.152+0000 7f126f7cc740 1 client.25946 shutdown 2024-09-19T07:17:55.187 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.186+0000 7f126f7cc740 1 -- 172.21.15.148:0/1630322801 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56162fc4e5e0 msgr2=0x56162fc54fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:17:55.187 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.186+0000 7f126f7cc740 1 --2- 172.21.15.148:0/1630322801 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56162fc4e5e0 0x56162fc54fa0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f125c0093b0 tx=0x7f125c012e00 comp rx=0 tx=0).stop 2024-09-19T07:17:55.187 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.186+0000 7f126f7cc740 1 -- 172.21.15.148:0/1630322801 shutdown_connections 2024-09-19T07:17:55.188 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.186+0000 7f126f7cc740 1 --2- 172.21.15.148:0/1630322801 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56162fc67f40 0x56162fc6a400 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:55.188 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.186+0000 7f126f7cc740 1 --2- 172.21.15.148:0/1630322801 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56162fc57c80 0x56162fc554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:55.188 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.186+0000 7f126f7cc740 1 --2- 172.21.15.148:0/1630322801 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56162fc4e5e0 0x56162fc54fa0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:55.188 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.186+0000 7f126f7cc740 1 --2- 172.21.15.148:0/1630322801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56162fc4d3c0 0x56162fc54a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:55.188 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.186+0000 7f124dffb640 0 client.25946 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:17:55.188 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.186+0000 7f126f7cc740 1 -- 172.21.15.148:0/1630322801 >> 172.21.15.148:0/1630322801 conn(0x56162fc49570 msgr2=0x56162fc4f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:17:55.188 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.187+0000 7f126f7cc740 1 -- 172.21.15.148:0/1630322801 shutdown_connections 2024-09-19T07:17:55.188 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.187+0000 7f126f7cc740 1 -- 172.21.15.148:0/1630322801 wait complete. 2024-09-19T07:17:55.188 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.187+0000 7f126f7cc740 20 client.25946 trim_cache size 0 max 16384 2024-09-19T07:17:55.279 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.278+0000 7f126f7cc740 1 Processor -- start 2024-09-19T07:17:55.279 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.278+0000 7f126f7cc740 1 -- start start 2024-09-19T07:17:55.280 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.279+0000 7f126f7cc740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56162fc4d3c0 0x56162fc44350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:55.280 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.279+0000 7f126f7cc740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56162fc4e5e0 0x56162fc55310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:55.280 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.279+0000 7f126f7cc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56162fc57c80 0x56162fc59070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:55.280 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.279+0000 7f126659c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56162fc4d3c0 0x56162fc44350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:55.280 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.280+0000 7f126659c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56162fc4d3c0 0x56162fc44350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:45166/0 (socket says 172.21.15.148:45166) 2024-09-19T07:17:55.281 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.280+0000 7f126659c640 1 -- 172.21.15.148:0/3860922438 learned_addr learned my addr 172.21.15.148:0/3860922438 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:17:55.281 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.280+0000 7f1266d9d640 1 --2- 172.21.15.148:0/3860922438 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56162fc57c80 0x56162fc59070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:55.281 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.280+0000 7f1265d9b640 1 --2- 172.21.15.148:0/3860922438 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56162fc4e5e0 0x56162fc55310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:55.281 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.280+0000 7f126f7cc740 1 -- 172.21.15.148:0/3860922438 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f12681b6c70 con 0x56162fc4e5e0 2024-09-19T07:17:55.282 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.280+0000 7f126f7cc740 1 -- 172.21.15.148:0/3860922438 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f12681b4480 con 0x56162fc4d3c0 2024-09-19T07:17:55.282 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.280+0000 7f126f7cc740 1 -- 172.21.15.148:0/3860922438 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f12681b22b0 con 0x56162fc57c80 2024-09-19T07:17:55.282 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.280+0000 7f126659c640 1 -- 172.21.15.148:0/3860922438 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56162fc57c80 msgr2=0x56162fc59070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:17:55.282 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.280+0000 7f126659c640 1 --2- 172.21.15.148:0/3860922438 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56162fc57c80 0x56162fc59070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:55.282 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.280+0000 7f126659c640 1 -- 172.21.15.148:0/3860922438 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56162fc4e5e0 msgr2=0x56162fc55310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:17:55.282 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.281+0000 7f126659c640 1 --2- 172.21.15.148:0/3860922438 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56162fc4e5e0 0x56162fc55310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:55.282 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.281+0000 7f126659c640 1 -- 172.21.15.148:0/3860922438 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56162fc6aa80 con 0x56162fc4d3c0 2024-09-19T07:17:55.282 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.281+0000 7f1265d9b640 1 --2- 172.21.15.148:0/3860922438 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56162fc4e5e0 0x56162fc55310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:17:55.282 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.281+0000 7f126659c640 1 --2- 172.21.15.148:0/3860922438 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56162fc4d3c0 0x56162fc44350 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x56162fc6acb0 tx=0x7f1258050000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c0d3fdfe384752d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:17:55.287 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.286+0000 7f124f7fe640 1 -- 172.21.15.148:0/3860922438 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1258004b60 con 0x56162fc4d3c0 2024-09-19T07:17:55.287 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.286+0000 7f124f7fe640 1 -- 172.21.15.148:0/3860922438 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1258069070 con 0x56162fc4d3c0 2024-09-19T07:17:55.287 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.286+0000 7f124f7fe640 1 -- 172.21.15.148:0/3860922438 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1258040a20 con 0x56162fc4d3c0 2024-09-19T07:17:55.288 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.288+0000 7f126f7cc740 1 -- 172.21.15.148:0/3860922438 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56162fc4d3c0 msgr2=0x56162fc44350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:17:55.288 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.288+0000 7f126f7cc740 1 --2- 172.21.15.148:0/3860922438 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56162fc4d3c0 0x56162fc44350 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x56162fc6acb0 tx=0x7f1258050000 comp rx=0 tx=0).stop 2024-09-19T07:17:55.310 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.310+0000 7f126f7cc740 1 -- 172.21.15.148:0/3860922438 shutdown_connections 2024-09-19T07:17:55.311 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.310+0000 7f126f7cc740 1 --2- 172.21.15.148:0/3860922438 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56162fc57c80 0x56162fc59070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:55.311 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.310+0000 7f126f7cc740 1 --2- 172.21.15.148:0/3860922438 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56162fc4e5e0 0x56162fc55310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:55.311 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.310+0000 7f126f7cc740 1 --2- 172.21.15.148:0/3860922438 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56162fc4d3c0 0x56162fc44350 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:55.311 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.310+0000 7f126f7cc740 1 -- 172.21.15.148:0/3860922438 >> 172.21.15.148:0/3860922438 conn(0x56162fc49570 msgr2=0x56162fc62df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:17:55.311 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.310+0000 7f126f7cc740 1 -- 172.21.15.148:0/3860922438 shutdown_connections 2024-09-19T07:17:55.311 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.310+0000 7f126f7cc740 1 -- 172.21.15.148:0/3860922438 wait complete. 2024-09-19T07:17:55.311 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.310+0000 7f126f7cc740 1 -- start start 2024-09-19T07:17:55.312 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.311+0000 7f126f7cc740 1 Processor -- start 2024-09-19T07:17:55.313 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.311+0000 7f126f7cc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56162fc4d3c0 0x56162fc6ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:55.314 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.311+0000 7f126f7cc740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56162fc4e5e0 0x56162fc6f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:55.314 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.311+0000 7f126f7cc740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56162fc57c80 0x56162fc6f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:55.314 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.311+0000 7f126f7cc740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f12681b2940 con 0x56162fc57c80 2024-09-19T07:17:55.314 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.311+0000 7f126f7cc740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f12681b3db0 con 0x56162fc4e5e0 2024-09-19T07:17:55.314 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.311+0000 7f126f7cc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f12681b3010 con 0x56162fc4d3c0 2024-09-19T07:17:55.314 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.312+0000 7f126f7cc740 10 client.0 _ll_register_callbacks cb 0x7f125c009f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:17:55.314 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.312+0000 7f1265d9b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56162fc4e5e0 0x56162fc6f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:55.314 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.312+0000 7f1265d9b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56162fc4e5e0 0x56162fc6f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:45176/0 (socket says 172.21.15.148:45176) 2024-09-19T07:17:55.314 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.312+0000 7f1265d9b640 1 -- 172.21.15.148:0/1385852902 learned_addr learned my addr 172.21.15.148:0/1385852902 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:17:55.314 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.312+0000 7f1266d9d640 1 --2- 172.21.15.148:0/1385852902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56162fc57c80 0x56162fc6f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:55.314 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.312+0000 7f126659c640 1 --2- 172.21.15.148:0/1385852902 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56162fc4d3c0 0x56162fc6ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:55.314 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.313+0000 7f1265d9b640 1 -- 172.21.15.148:0/1385852902 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56162fc4d3c0 msgr2=0x56162fc6ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:17:55.314 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.313+0000 7f1265d9b640 1 --2- 172.21.15.148:0/1385852902 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56162fc4d3c0 0x56162fc6ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:55.315 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.313+0000 7f1265d9b640 1 -- 172.21.15.148:0/1385852902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56162fc57c80 msgr2=0x56162fc6f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:17:55.315 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.313+0000 7f1265d9b640 1 --2- 172.21.15.148:0/1385852902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56162fc57c80 0x56162fc6f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:55.315 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.313+0000 7f1265d9b640 1 -- 172.21.15.148:0/1385852902 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56162fc5f0d0 con 0x56162fc4e5e0 2024-09-19T07:17:55.315 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.313+0000 7f1266d9d640 1 --2- 172.21.15.148:0/1385852902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56162fc57c80 0x56162fc6f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:17:55.315 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.314+0000 7f1265d9b640 1 --2- 172.21.15.148:0/1385852902 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56162fc4e5e0 0x56162fc6f240 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f125c008010 tx=0x7f125c008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca2026b7e11eb902 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:17:55.319 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.318+0000 7f124d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-19T07:17:55.319 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.319+0000 7f124d7fa640 1 -- 172.21.15.148:0/1385852902 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f125c020070 con 0x56162fc4e5e0 2024-09-19T07:17:55.320 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.319+0000 7f126f7cc740 1 -- 172.21.15.148:0/1385852902 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1258069070 con 0x56162fc4e5e0 2024-09-19T07:17:55.320 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.319+0000 7f124d7fa640 1 -- 172.21.15.148:0/1385852902 <== mon.2 v2:172.21.15.165:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8512+0+0 (secure 0 0 0) 0x7f125c01c650 con 0x56162fc4e5e0 2024-09-19T07:17:55.320 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.319+0000 7f124d7fa640 1 -- 172.21.15.148:0/1385852902 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f125c006bf0 con 0x56162fc4e5e0 2024-09-19T07:17:55.320 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.319+0000 7f126f7cc740 10 client.25952 fetch_fsmap learned FSMap version 39 2024-09-19T07:17:55.320 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.320+0000 7f126f7cc740 1 -- 172.21.15.148:0/1385852902 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x56162fc603c0 con 0x56162fc4e5e0 2024-09-19T07:17:55.321 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.320+0000 7f124d7fa640 1 -- 172.21.15.148:0/1385852902 <== mon.2 v2:172.21.15.165:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1258069070 con 0x56162fc4e5e0 2024-09-19T07:17:55.322 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.321+0000 7f124d7fa640 1 -- 172.21.15.148:0/1385852902 <== mon.2 v2:172.21.15.165:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f125c042470 con 0x56162fc4e5e0 2024-09-19T07:17:55.323 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.322+0000 7f126f7cc740 10 client.25952 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T07:17:55.323 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.322+0000 7f126f7cc740 10 client.25952 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:17:55.323 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.322+0000 7f126f7cc740 20 client.25952 populate_metadata read hostname 'smithi148' 2024-09-19T07:17:55.323 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.322+0000 7f126f7cc740 1 --2- 172.21.15.148:0/1385852902 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56162fcd2ce0 0x56162fcd50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:55.323 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.322+0000 7f126f7cc740 4 client.25952 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:17:55.323 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.322+0000 7f126f7cc740 1 -- 172.21.15.148:0/1385852902 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56162fbb8d70 con 0x56162fcd2ce0 2024-09-19T07:17:55.323 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.322+0000 7f126659c640 1 --2- 172.21.15.148:0/1385852902 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56162fcd2ce0 0x56162fcd50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:55.324 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.323+0000 7f126659c640 1 --2- 172.21.15.148:0/1385852902 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56162fcd2ce0 0x56162fcd50d0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86267ae9f8079aca server_cookie=e4030658f5231cbf in_seq=0 out_seq=0 2024-09-19T07:17:55.324 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:55.323+0000 7f124d7fa640 10 client.25952 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:17:56.343 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:56.342+0000 7f124d7fa640 1 -- 172.21.15.148:0/1385852902 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56162fbb8d70 con 0x56162fcd2ce0 2024-09-19T07:17:56.343 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:56.342+0000 7f124d7fa640 10 client.25952 handle_command_reply: tid=0 2024-09-19T07:17:56.343 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:56.342+0000 7f126f7cc740 1 client.25952 shutdown 2024-09-19T07:17:56.343 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:56.342+0000 7f126f7cc740 1 -- 172.21.15.148:0/1385852902 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56162fc4e5e0 msgr2=0x56162fc6f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:17:56.343 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:56.342+0000 7f126f7cc740 1 --2- 172.21.15.148:0/1385852902 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56162fc4e5e0 0x56162fc6f240 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f125c008010 tx=0x7f125c008040 comp rx=0 tx=0).stop 2024-09-19T07:17:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:56.342+0000 7f126f7cc740 1 -- 172.21.15.148:0/1385852902 shutdown_connections 2024-09-19T07:17:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:56.342+0000 7f126f7cc740 1 --2- 172.21.15.148:0/1385852902 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56162fcd2ce0 0x56162fcd50d0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:56.342+0000 7f126f7cc740 1 --2- 172.21.15.148:0/1385852902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56162fc57c80 0x56162fc6f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:56.343+0000 7f126f7cc740 1 --2- 172.21.15.148:0/1385852902 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56162fc4e5e0 0x56162fc6f240 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:56.343+0000 7f126f7cc740 1 --2- 172.21.15.148:0/1385852902 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56162fc4d3c0 0x56162fc6ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:56.343+0000 7f126f7cc740 1 -- 172.21.15.148:0/1385852902 >> 172.21.15.148:0/1385852902 conn(0x56162fc49570 msgr2=0x56162fc63610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:17:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:56.343+0000 7f124d7fa640 0 client.25952 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:17:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:56.343+0000 7f126f7cc740 1 -- 172.21.15.148:0/1385852902 shutdown_connections 2024-09-19T07:17:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:56.343+0000 7f126f7cc740 1 -- 172.21.15.148:0/1385852902 wait complete. 2024-09-19T07:17:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:56.343+0000 7f126f7cc740 20 client.25952 trim_cache size 0 max 16384 2024-09-19T07:17:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:17:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:17:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:17:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:17:56.396 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:56.395+0000 7f12557fa640 1 -- 172.21.15.148:0/2271336838 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f12500a35f0 msgr2=0x7f12500a5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:17:56.396 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:56.395+0000 7f12557fa640 1 --2- 172.21.15.148:0/2271336838 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f12500a35f0 0x7f12500a5ab0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f125801a860 tx=0x7f1258005fd0 comp rx=0 tx=0).stop 2024-09-19T07:17:56.396 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:56.395+0000 7f12557fa640 1 -- 172.21.15.148:0/2271336838 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1268117180 msgr2=0x7f12681175e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:17:56.396 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:56.395+0000 7f12557fa640 1 --2- 172.21.15.148:0/2271336838 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1268117180 0x7f12681175e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f126000ca00 tx=0x7f126000cec0 comp rx=0 tx=0).stop 2024-09-19T07:17:56.397 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:56.395+0000 7f12557fa640 1 -- 172.21.15.148:0/2271336838 shutdown_connections 2024-09-19T07:17:56.397 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:56.396+0000 7f12557fa640 1 --2- 172.21.15.148:0/2271336838 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f12500a35f0 0x7f12500a5ab0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:56.397 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:56.396+0000 7f12557fa640 1 --2- 172.21.15.148:0/2271336838 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1268117180 0x7f12681175e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:56.397 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:56.396+0000 7f12557fa640 1 --2- 172.21.15.148:0/2271336838 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f126811b140 0x7f1268116bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:56.398 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:56.396+0000 7f12557fa640 1 --2- 172.21.15.148:0/2271336838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12681095d0 0x7f126811ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:56.398 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:56.396+0000 7f12557fa640 1 -- 172.21.15.148:0/2271336838 >> 172.21.15.148:0/2271336838 conn(0x7f126806cc60 msgr2=0x7f12680707e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:17:56.398 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:56.396+0000 7f12557fa640 1 -- 172.21.15.148:0/2271336838 shutdown_connections 2024-09-19T07:17:56.398 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:17:56.396+0000 7f12557fa640 1 -- 172.21.15.148:0/2271336838 wait complete. 2024-09-19T07:17:56.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:17:56 smithi148 ceph-mon[31180]: pgmap v210: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 17 MiB/s wr, 947 op/s 2024-09-19T07:17:56.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:17:56 smithi165 ceph-mon[35326]: pgmap v210: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 17 MiB/s wr, 947 op/s 2024-09-19T07:17:57.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:17:56 smithi179 ceph-mon[35716]: pgmap v210: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 17 MiB/s wr, 947 op/s 2024-09-19T07:17:58.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:17:58 smithi148 ceph-mon[31180]: pgmap v211: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.4 MiB/s wr, 581 op/s 2024-09-19T07:17:58.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:17:58 smithi165 ceph-mon[35326]: pgmap v211: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.4 MiB/s wr, 581 op/s 2024-09-19T07:17:59.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:17:58 smithi179 ceph-mon[35716]: pgmap v211: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.4 MiB/s wr, 581 op/s 2024-09-19T07:18:00.834 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:18:00 smithi148 ceph-mon[31180]: pgmap v212: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 8.5 MiB/s wr, 566 op/s 2024-09-19T07:18:00.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:18:00 smithi165 ceph-mon[35326]: pgmap v212: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 8.5 MiB/s wr, 566 op/s 2024-09-19T07:18:01.025 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:18:00 smithi179 ceph-mon[35716]: pgmap v212: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 8.5 MiB/s wr, 566 op/s 2024-09-19T07:18:02.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:18:02 smithi148 ceph-mon[31180]: pgmap v213: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 8.6 MiB/s wr, 786 op/s 2024-09-19T07:18:02.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:18:02 smithi165 ceph-mon[35326]: pgmap v213: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 8.6 MiB/s wr, 786 op/s 2024-09-19T07:18:03.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:18:02 smithi179 ceph-mon[35716]: pgmap v213: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 8.6 MiB/s wr, 786 op/s 2024-09-19T07:18:03.195 INFO:tasks.workunit.client.0.smithi148.stdout: 409 2481782 1175 1659906 1080 888510 1480 2024-09-19T07:18:04.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:18:04 smithi148 ceph-mon[31180]: pgmap v214: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.2 MiB/s wr, 509 op/s 2024-09-19T07:18:04.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:18:04 smithi165 ceph-mon[35326]: pgmap v214: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.2 MiB/s wr, 509 op/s 2024-09-19T07:18:05.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:18:04 smithi179 ceph-mon[35716]: pgmap v214: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.2 MiB/s wr, 509 op/s 2024-09-19T07:18:06.836 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:18:06 smithi148 ceph-mon[31180]: pgmap v215: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.9 MiB/s wr, 534 op/s 2024-09-19T07:18:06.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:18:06 smithi165 ceph-mon[35326]: pgmap v215: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.9 MiB/s wr, 534 op/s 2024-09-19T07:18:07.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:18:06 smithi179 ceph-mon[35716]: pgmap v215: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.9 MiB/s wr, 534 op/s 2024-09-19T07:18:08.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:18:08 smithi148 ceph-mon[31180]: pgmap v216: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 454 op/s 2024-09-19T07:18:08.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:18:08 smithi165 ceph-mon[35326]: pgmap v216: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 454 op/s 2024-09-19T07:18:09.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:18:08 smithi179 ceph-mon[35716]: pgmap v216: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 454 op/s 2024-09-19T07:18:09.669 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.665+0000 7fc80b3f6640 1 -- 172.21.15.148:0/3943678928 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc804074eb0 msgr2=0x7fc8041125b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:09.669 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.665+0000 7fc80b3f6640 1 --2- 172.21.15.148:0/3943678928 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc804074eb0 0x7fc8041125b0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4009900 tx=0x7fc7f402a480 comp rx=0 tx=0).stop 2024-09-19T07:18:09.669 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.665+0000 7fc80b3f6640 1 -- 172.21.15.148:0/3943678928 shutdown_connections 2024-09-19T07:18:09.669 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.665+0000 7fc80b3f6640 1 --2- 172.21.15.148:0/3943678928 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc804112af0 0x7fc804114ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:09.669 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.665+0000 7fc80b3f6640 1 --2- 172.21.15.148:0/3943678928 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc804074eb0 0x7fc8041125b0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:09.670 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.665+0000 7fc80b3f6640 1 --2- 172.21.15.148:0/3943678928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc804074590 0x7fc804074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:09.670 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.665+0000 7fc80b3f6640 1 -- 172.21.15.148:0/3943678928 >> 172.21.15.148:0/3943678928 conn(0x7fc8040fd7e0 msgr2=0x7fc8040ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:18:09.670 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.665+0000 7fc80b3f6640 1 -- 172.21.15.148:0/3943678928 shutdown_connections 2024-09-19T07:18:09.670 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.665+0000 7fc80b3f6640 1 -- 172.21.15.148:0/3943678928 wait complete. 2024-09-19T07:18:09.670 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.666+0000 7fc80b3f6640 1 Processor -- start 2024-09-19T07:18:09.670 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.666+0000 7fc80b3f6640 1 -- start start 2024-09-19T07:18:09.670 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.666+0000 7fc80b3f6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc804074590 0x7fc8041a4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:09.670 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.666+0000 7fc80b3f6640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc804074eb0 0x7fc8041a4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:09.670 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.666+0000 7fc80b3f6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc804112af0 0x7fc80419e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:09.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.666+0000 7fc80b3f6640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc8041184c0 con 0x7fc804074590 2024-09-19T07:18:09.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.666+0000 7fc80b3f6640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc804118340 con 0x7fc804074eb0 2024-09-19T07:18:09.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.666+0000 7fc80b3f6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc804118640 con 0x7fc804112af0 2024-09-19T07:18:09.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.666+0000 7fc809192640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc804074590 0x7fc8041a4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:09.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.666+0000 7fc809192640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc804074590 0x7fc8041a4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47178/0 (socket says 172.21.15.148:47178) 2024-09-19T07:18:09.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.666+0000 7fc809192640 1 -- 172.21.15.148:0/4252792155 learned_addr learned my addr 172.21.15.148:0/4252792155 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:18:09.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.667+0000 7fc809993640 1 --2- 172.21.15.148:0/4252792155 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc804112af0 0x7fc80419e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:09.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.667+0000 7fc808991640 1 --2- 172.21.15.148:0/4252792155 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc804074eb0 0x7fc8041a4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:09.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.667+0000 7fc809192640 1 -- 172.21.15.148:0/4252792155 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc804112af0 msgr2=0x7fc80419e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:09.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.667+0000 7fc809192640 1 --2- 172.21.15.148:0/4252792155 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc804112af0 0x7fc80419e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:09.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.667+0000 7fc809192640 1 -- 172.21.15.148:0/4252792155 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc804074eb0 msgr2=0x7fc8041a4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:09.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.667+0000 7fc809192640 1 --2- 172.21.15.148:0/4252792155 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc804074eb0 0x7fc8041a4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:09.672 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.667+0000 7fc809192640 1 -- 172.21.15.148:0/4252792155 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc80419ef60 con 0x7fc804074590 2024-09-19T07:18:09.672 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.667+0000 7fc808991640 1 --2- 172.21.15.148:0/4252792155 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc804074eb0 0x7fc8041a4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:18:09.672 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.667+0000 7fc809993640 1 --2- 172.21.15.148:0/4252792155 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc804112af0 0x7fc80419e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:18:09.672 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.667+0000 7fc809192640 1 --2- 172.21.15.148:0/4252792155 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc804074590 0x7fc8041a4620 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fc80000d770 tx=0x7fc80000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:18:09.672 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.667+0000 7fc7fa7fc640 1 -- 172.21.15.148:0/4252792155 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc800017070 con 0x7fc804074590 2024-09-19T07:18:09.672 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.667+0000 7fc7fa7fc640 1 -- 172.21.15.148:0/4252792155 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc800005500 con 0x7fc804074590 2024-09-19T07:18:09.672 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.667+0000 7fc7fa7fc640 1 -- 172.21.15.148:0/4252792155 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc800004e00 con 0x7fc804074590 2024-09-19T07:18:09.672 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.667+0000 7fc80b3f6640 1 -- 172.21.15.148:0/4252792155 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc80419f250 con 0x7fc804074590 2024-09-19T07:18:09.672 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.667+0000 7fc80b3f6640 1 -- 172.21.15.148:0/4252792155 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8041ab470 con 0x7fc804074590 2024-09-19T07:18:09.679 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.669+0000 7fc7fa7fc640 1 -- 172.21.15.148:0/4252792155 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fc800004fa0 con 0x7fc804074590 2024-09-19T07:18:09.679 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.670+0000 7fc80e26b740 1 Processor -- start 2024-09-19T07:18:09.679 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.670+0000 7fc80e26b740 1 -- start start 2024-09-19T07:18:09.679 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.670+0000 7fc80e26b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5599e0a30af0 0x5599e0a30ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:09.679 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.670+0000 7fc80e26b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599e0a31410 0x5599e0a3b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:09.679 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.670+0000 7fc80e26b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5599e0a3bcb0 0x5599e0a3e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:09.679 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.670+0000 7fc80e26b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5599e09952f0 con 0x5599e0a31410 2024-09-19T07:18:09.679 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.670+0000 7fc80e26b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5599e093d270 con 0x5599e0a30af0 2024-09-19T07:18:09.680 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.670+0000 7fc80e26b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5599e09912b0 con 0x5599e0a3bcb0 2024-09-19T07:18:09.680 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.670+0000 7fc809192640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599e0a31410 0x5599e0a3b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:09.680 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.670+0000 7fc7fa7fc640 1 --2- 172.21.15.148:0/4252792155 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc7f00a34e0 0x7fc7f00a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:09.680 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.670+0000 7fc809192640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599e0a31410 0x5599e0a3b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47194/0 (socket says 172.21.15.148:47194) 2024-09-19T07:18:09.680 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.670+0000 7fc809192640 1 -- 172.21.15.148:0/1021604547 learned_addr learned my addr 172.21.15.148:0/1021604547 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:18:09.680 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.670+0000 7fc808991640 1 --2- 172.21.15.148:0/1021604547 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5599e0a3bcb0 0x5599e0a3e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:09.680 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.670+0000 7fc809993640 1 --2- 172.21.15.148:0/1021604547 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5599e0a30af0 0x5599e0a30ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:09.680 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.671+0000 7fc809993640 1 --2- 172.21.15.148:0/4252792155 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc7f00a34e0 0x7fc7f00a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:09.680 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.671+0000 7fc7fa7fc640 1 -- 172.21.15.148:0/4252792155 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8512+0+0 (secure 0 0 0) 0x7fc8000cf790 con 0x7fc804074590 2024-09-19T07:18:09.680 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.671+0000 7fc809192640 1 -- 172.21.15.148:0/1021604547 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5599e0a3bcb0 msgr2=0x5599e0a3e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:18:09.681 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.671+0000 7fc809192640 1 --2- 172.21.15.148:0/1021604547 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5599e0a3bcb0 0x5599e0a3e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:09.681 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.671+0000 7fc809192640 1 -- 172.21.15.148:0/1021604547 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5599e0a30af0 msgr2=0x5599e0a30ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:18:09.681 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.671+0000 7fc809192640 1 --2- 172.21.15.148:0/1021604547 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5599e0a30af0 0x5599e0a30ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:09.681 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.671+0000 7fc809192640 1 -- 172.21.15.148:0/1021604547 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599e093c340 con 0x5599e0a31410 2024-09-19T07:18:09.681 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.671+0000 7fc808991640 1 --2- 172.21.15.148:0/1021604547 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5599e0a3bcb0 0x5599e0a3e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:18:09.681 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.671+0000 7fc809192640 1 --2- 172.21.15.148:0/1021604547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599e0a31410 0x5599e0a3b770 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fc80009ba10 tx=0x7fc800009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f73409b9160e302 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:18:09.681 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.671+0000 7fc809993640 1 --2- 172.21.15.148:0/4252792155 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc7f00a34e0 0x7fc7f00a59a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc013b30 tx=0x7fc7fc005c60 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:18:09.681 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.671+0000 7fc7ef7fe640 1 -- 172.21.15.148:0/1021604547 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc800020070 con 0x5599e0a31410 2024-09-19T07:18:09.681 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.671+0000 7fc7ef7fe640 1 -- 172.21.15.148:0/1021604547 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8000046c0 con 0x5599e0a31410 2024-09-19T07:18:09.681 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.671+0000 7fc7ef7fe640 1 -- 172.21.15.148:0/1021604547 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8000980f0 con 0x5599e0a31410 2024-09-19T07:18:09.681 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.672+0000 7fc80e26b740 1 -- 172.21.15.148:0/1021604547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599e0a31410 msgr2=0x5599e0a3b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:09.681 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.672+0000 7fc80e26b740 1 --2- 172.21.15.148:0/1021604547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599e0a31410 0x5599e0a3b770 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fc80009ba10 tx=0x7fc800009c30 comp rx=0 tx=0).stop 2024-09-19T07:18:09.681 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.672+0000 7fc80e26b740 1 -- 172.21.15.148:0/1021604547 shutdown_connections 2024-09-19T07:18:09.682 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.672+0000 7fc80e26b740 1 --2- 172.21.15.148:0/1021604547 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5599e0a3bcb0 0x5599e0a3e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:09.682 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.672+0000 7fc80e26b740 1 --2- 172.21.15.148:0/1021604547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599e0a31410 0x5599e0a3b770 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:09.682 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.672+0000 7fc80e26b740 1 --2- 172.21.15.148:0/1021604547 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5599e0a30af0 0x5599e0a30ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:09.682 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.672+0000 7fc80e26b740 1 -- 172.21.15.148:0/1021604547 >> 172.21.15.148:0/1021604547 conn(0x5599e0a2d060 msgr2=0x5599e0a2d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:18:09.682 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.672+0000 7fc80e26b740 1 -- 172.21.15.148:0/1021604547 shutdown_connections 2024-09-19T07:18:09.682 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.672+0000 7fc80e26b740 1 -- 172.21.15.148:0/1021604547 wait complete. 2024-09-19T07:18:09.682 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.672+0000 7fc80e26b740 1 -- start start 2024-09-19T07:18:09.682 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.673+0000 7fc80e26b740 1 Processor -- start 2024-09-19T07:18:09.682 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.673+0000 7fc80e26b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5599e0a30af0 0x5599e0a38c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:09.682 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.673+0000 7fc80e26b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5599e0a31410 0x5599e0a391b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:09.682 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.673+0000 7fc80e26b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599e0a3bcb0 0x5599e0a396f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:09.682 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.673+0000 7fc80e26b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5599e0a3e820 con 0x5599e0a3bcb0 2024-09-19T07:18:09.682 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.673+0000 7fc80e26b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5599e091e290 con 0x5599e0a31410 2024-09-19T07:18:09.683 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.673+0000 7fc80e26b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5599e0a3e9a0 con 0x5599e0a30af0 2024-09-19T07:18:09.683 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.673+0000 7fc80e26b740 10 client.0 _ll_register_callbacks cb 0x5599e094f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:18:09.683 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.673+0000 7fc809993640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599e0a3bcb0 0x5599e0a396f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:09.683 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.673+0000 7fc809192640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5599e0a30af0 0x5599e0a38c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:09.683 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.673+0000 7fc809993640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599e0a3bcb0 0x5599e0a396f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47208/0 (socket says 172.21.15.148:47208) 2024-09-19T07:18:09.683 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.673+0000 7fc809993640 1 -- 172.21.15.148:0/244425216 learned_addr learned my addr 172.21.15.148:0/244425216 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:18:09.683 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.673+0000 7fc808991640 1 --2- 172.21.15.148:0/244425216 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5599e0a31410 0x5599e0a391b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:09.683 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.673+0000 7fc809993640 1 -- 172.21.15.148:0/244425216 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5599e0a30af0 msgr2=0x5599e0a38c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:18:09.683 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.673+0000 7fc809993640 1 --2- 172.21.15.148:0/244425216 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5599e0a30af0 0x5599e0a38c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:09.683 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.673+0000 7fc809993640 1 -- 172.21.15.148:0/244425216 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5599e0a31410 msgr2=0x5599e0a391b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:18:09.683 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.673+0000 7fc809993640 1 --2- 172.21.15.148:0/244425216 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5599e0a31410 0x5599e0a391b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:09.683 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.673+0000 7fc809993640 1 -- 172.21.15.148:0/244425216 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599e06a8210 con 0x5599e0a3bcb0 2024-09-19T07:18:09.684 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.674+0000 7fc809993640 1 --2- 172.21.15.148:0/244425216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599e0a3bcb0 0x5599e0a396f0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc010be0 tx=0x7fc7fc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=625502196ca71355 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:18:09.684 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.674+0000 7fc7ecff9640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:18:09.684 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.674+0000 7fc7ecff9640 1 -- 172.21.15.148:0/244425216 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7fc023070 con 0x5599e0a3bcb0 2024-09-19T07:18:09.684 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.674+0000 7fc7ecff9640 1 -- 172.21.15.148:0/244425216 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8512+0+0 (secure 0 0 0) 0x7fc7fc028460 con 0x5599e0a3bcb0 2024-09-19T07:18:09.684 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.674+0000 7fc80e26b740 1 -- 172.21.15.148:0/244425216 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5599e09a2a20 con 0x5599e0a3bcb0 2024-09-19T07:18:09.684 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.674+0000 7fc7ecff9640 1 -- 172.21.15.148:0/244425216 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fc7fc012e20 con 0x5599e0a3bcb0 2024-09-19T07:18:09.684 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.674+0000 7fc80e26b740 10 client.16665 fetch_fsmap learned FSMap version 39 2024-09-19T07:18:09.684 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.674+0000 7fc80e26b740 1 -- 172.21.15.148:0/244425216 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5599e0774620 con 0x5599e0a3bcb0 2024-09-19T07:18:09.684 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.674+0000 7fc7ecff9640 1 -- 172.21.15.148:0/244425216 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5599e09a2a20 con 0x5599e0a3bcb0 2024-09-19T07:18:09.684 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.674+0000 7fc7ecff9640 1 -- 172.21.15.148:0/244425216 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7fc7fc00e8a0 con 0x5599e0a3bcb0 2024-09-19T07:18:09.684 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.674+0000 7fc80e26b740 10 client.16665 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T07:18:09.685 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.674+0000 7fc80e26b740 10 client.16665 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:18:09.685 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.674+0000 7fc80e26b740 20 client.16665 populate_metadata read hostname 'smithi148' 2024-09-19T07:18:09.685 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.674+0000 7fc80e26b740 1 --2- 172.21.15.148:0/244425216 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5599e0a4bcc0 0x5599e0a4e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:09.685 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.674+0000 7fc80e26b740 4 client.16665 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:18:09.685 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.674+0000 7fc80e26b740 1 -- 172.21.15.148:0/244425216 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5599e099cd70 con 0x5599e0a4bcc0 2024-09-19T07:18:09.685 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.675+0000 7fc809192640 1 --2- 172.21.15.148:0/244425216 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5599e0a4bcc0 0x5599e0a4e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:09.685 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.675+0000 7fc809192640 1 --2- 172.21.15.148:0/244425216 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5599e0a4bcc0 0x5599e0a4e130 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f9da489cec69d29 server_cookie=f8aed914dba4504b in_seq=0 out_seq=0 2024-09-19T07:18:09.685 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.675+0000 7fc7ecff9640 10 client.16665 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:18:09.685 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.676+0000 7fc7ecff9640 1 -- 172.21.15.148:0/244425216 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5599e099cd70 con 0x5599e0a4bcc0 2024-09-19T07:18:09.685 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.676+0000 7fc7ecff9640 10 client.16665 handle_command_reply: tid=0 2024-09-19T07:18:09.685 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.676+0000 7fc80e26b740 1 client.16665 shutdown 2024-09-19T07:18:09.685 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.676+0000 7fc80e26b740 1 -- 172.21.15.148:0/244425216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599e0a3bcb0 msgr2=0x5599e0a396f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:09.685 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.676+0000 7fc80e26b740 1 --2- 172.21.15.148:0/244425216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599e0a3bcb0 0x5599e0a396f0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc010be0 tx=0x7fc7fc004a40 comp rx=0 tx=0).stop 2024-09-19T07:18:09.686 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.676+0000 7fc80e26b740 1 -- 172.21.15.148:0/244425216 shutdown_connections 2024-09-19T07:18:09.686 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.676+0000 7fc80e26b740 1 --2- 172.21.15.148:0/244425216 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5599e0a4bcc0 0x5599e0a4e130 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:09.686 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.676+0000 7fc80e26b740 1 --2- 172.21.15.148:0/244425216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599e0a3bcb0 0x5599e0a396f0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:09.686 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.676+0000 7fc80e26b740 1 --2- 172.21.15.148:0/244425216 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5599e0a31410 0x5599e0a391b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:09.686 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.676+0000 7fc80e26b740 1 --2- 172.21.15.148:0/244425216 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5599e0a30af0 0x5599e0a38c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:09.686 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.676+0000 7fc7ecff9640 0 client.16665 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:18:09.686 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.676+0000 7fc80e26b740 1 -- 172.21.15.148:0/244425216 >> 172.21.15.148:0/244425216 conn(0x5599e0a2d060 msgr2=0x5599e0a32dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:18:09.686 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.676+0000 7fc80e26b740 1 -- 172.21.15.148:0/244425216 shutdown_connections 2024-09-19T07:18:09.686 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.676+0000 7fc80e26b740 1 -- 172.21.15.148:0/244425216 wait complete. 2024-09-19T07:18:09.686 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.676+0000 7fc80e26b740 20 client.16665 trim_cache size 0 max 16384 2024-09-19T07:18:09.696 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.691+0000 7fc80e26b740 1 Processor -- start 2024-09-19T07:18:09.696 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.691+0000 7fc80e26b740 1 -- start start 2024-09-19T07:18:09.696 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.691+0000 7fc80e26b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599e0a30af0 0x5599e0a39520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:09.696 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.691+0000 7fc80e26b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5599e0a31410 0x5599e0a53a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:09.696 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.691+0000 7fc80e26b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5599e0a3bcb0 0x5599e0a53f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:09.696 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.691+0000 7fc80e26b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc8041b67f0 con 0x5599e0a30af0 2024-09-19T07:18:09.697 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.691+0000 7fc80e26b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc8041b4000 con 0x5599e0a31410 2024-09-19T07:18:09.697 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.691+0000 7fc80e26b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc8041b1e30 con 0x5599e0a3bcb0 2024-09-19T07:18:09.697 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.691+0000 7fc809192640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599e0a30af0 0x5599e0a39520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:09.697 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.691+0000 7fc809192640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599e0a30af0 0x5599e0a39520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47210/0 (socket says 172.21.15.148:47210) 2024-09-19T07:18:09.697 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.691+0000 7fc809192640 1 -- 172.21.15.148:0/2717428824 learned_addr learned my addr 172.21.15.148:0/2717428824 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:18:09.697 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.691+0000 7fc808991640 1 --2- 172.21.15.148:0/2717428824 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5599e0a31410 0x5599e0a53a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:09.697 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.691+0000 7fc809192640 1 -- 172.21.15.148:0/2717428824 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5599e0a3bcb0 msgr2=0x5599e0a53f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:18:09.697 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.691+0000 7fc809192640 1 --2- 172.21.15.148:0/2717428824 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5599e0a3bcb0 0x5599e0a53f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:09.697 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.691+0000 7fc809192640 1 -- 172.21.15.148:0/2717428824 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5599e0a31410 msgr2=0x5599e0a53a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:18:09.697 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.691+0000 7fc809192640 1 --2- 172.21.15.148:0/2717428824 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5599e0a31410 0x5599e0a53a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:09.697 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.691+0000 7fc809192640 1 -- 172.21.15.148:0/2717428824 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599e0a39a60 con 0x5599e0a30af0 2024-09-19T07:18:09.697 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.691+0000 7fc808991640 1 --2- 172.21.15.148:0/2717428824 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5599e0a31410 0x5599e0a53a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:18:09.697 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.691+0000 7fc809192640 1 --2- 172.21.15.148:0/2717428824 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599e0a30af0 0x5599e0a39520 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fc80009ba10 tx=0x7fc80009b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d12144ec79e658de server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:18:09.698 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.691+0000 7fc7eeffd640 1 -- 172.21.15.148:0/2717428824 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8000b4070 con 0x5599e0a30af0 2024-09-19T07:18:09.698 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.692+0000 7fc7eeffd640 1 -- 172.21.15.148:0/2717428824 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc80009c180 con 0x5599e0a30af0 2024-09-19T07:18:09.698 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.692+0000 7fc7eeffd640 1 -- 172.21.15.148:0/2717428824 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc800020040 con 0x5599e0a30af0 2024-09-19T07:18:09.698 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.692+0000 7fc80e26b740 1 -- 172.21.15.148:0/2717428824 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599e0a30af0 msgr2=0x5599e0a39520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:09.698 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.692+0000 7fc80e26b740 1 --2- 172.21.15.148:0/2717428824 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599e0a30af0 0x5599e0a39520 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fc80009ba10 tx=0x7fc80009b900 comp rx=0 tx=0).stop 2024-09-19T07:18:09.698 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.692+0000 7fc80e26b740 1 -- 172.21.15.148:0/2717428824 shutdown_connections 2024-09-19T07:18:09.698 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.692+0000 7fc80e26b740 1 --2- 172.21.15.148:0/2717428824 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5599e0a3bcb0 0x5599e0a53f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:09.698 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.692+0000 7fc80e26b740 1 --2- 172.21.15.148:0/2717428824 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5599e0a31410 0x5599e0a53a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:09.698 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.692+0000 7fc80e26b740 1 --2- 172.21.15.148:0/2717428824 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599e0a30af0 0x5599e0a39520 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:09.698 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.692+0000 7fc80e26b740 1 -- 172.21.15.148:0/2717428824 >> 172.21.15.148:0/2717428824 conn(0x5599e0a2d060 msgr2=0x5599e0a2d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:18:09.698 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.692+0000 7fc80e26b740 1 -- 172.21.15.148:0/2717428824 shutdown_connections 2024-09-19T07:18:09.698 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.692+0000 7fc80e26b740 1 -- 172.21.15.148:0/2717428824 wait complete. 2024-09-19T07:18:09.698 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.692+0000 7fc80e26b740 1 -- start start 2024-09-19T07:18:09.698 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.693+0000 7fc80e26b740 1 Processor -- start 2024-09-19T07:18:09.699 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.693+0000 7fc80e26b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5599e0a30af0 0x5599e0a44060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:09.699 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.693+0000 7fc80e26b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5599e0a31410 0x5599e0a3f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:09.699 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.693+0000 7fc80e26b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599e0a3bcb0 0x5599e0a3f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:09.699 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.693+0000 7fc80e26b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc8041b24c0 con 0x5599e0a3bcb0 2024-09-19T07:18:09.699 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.693+0000 7fc80e26b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc8041b3930 con 0x5599e0a31410 2024-09-19T07:18:09.699 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.693+0000 7fc80e26b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc8041b2b90 con 0x5599e0a30af0 2024-09-19T07:18:09.699 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.693+0000 7fc80e26b740 10 client.0 _ll_register_callbacks cb 0x7fc7fc013350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:18:09.699 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.693+0000 7fc809993640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599e0a3bcb0 0x5599e0a3f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:09.699 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.693+0000 7fc809993640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599e0a3bcb0 0x5599e0a3f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47214/0 (socket says 172.21.15.148:47214) 2024-09-19T07:18:09.699 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.693+0000 7fc809993640 1 -- 172.21.15.148:0/1217533697 learned_addr learned my addr 172.21.15.148:0/1217533697 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:18:09.699 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.693+0000 7fc809192640 1 --2- 172.21.15.148:0/1217533697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5599e0a30af0 0x5599e0a44060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:09.699 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.693+0000 7fc808991640 1 --2- 172.21.15.148:0/1217533697 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5599e0a31410 0x5599e0a3f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:09.699 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.693+0000 7fc809993640 1 -- 172.21.15.148:0/1217533697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5599e0a30af0 msgr2=0x5599e0a44060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:18:09.700 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.693+0000 7fc809993640 1 --2- 172.21.15.148:0/1217533697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5599e0a30af0 0x5599e0a44060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:09.700 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.693+0000 7fc809993640 1 -- 172.21.15.148:0/1217533697 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5599e0a31410 msgr2=0x5599e0a3f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:18:09.700 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.693+0000 7fc809993640 1 --2- 172.21.15.148:0/1217533697 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5599e0a31410 0x5599e0a3f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:09.700 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.693+0000 7fc809993640 1 -- 172.21.15.148:0/1217533697 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599e0a3fe00 con 0x5599e0a3bcb0 2024-09-19T07:18:09.700 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.694+0000 7fc809993640 1 --2- 172.21.15.148:0/1217533697 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599e0a3bcb0 0x5599e0a3f8c0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc0107a0 tx=0x7fc7fc00eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a61ecfbbc95debf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:18:09.700 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.694+0000 7fc7ecff9640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:18:09.700 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.694+0000 7fc7ecff9640 1 -- 172.21.15.148:0/1217533697 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7fc035070 con 0x5599e0a3bcb0 2024-09-19T07:18:09.700 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.694+0000 7fc7ecff9640 1 -- 172.21.15.148:0/1217533697 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8512+0+0 (secure 0 0 0) 0x7fc7fc013870 con 0x5599e0a3bcb0 2024-09-19T07:18:09.700 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.694+0000 7fc80e26b740 1 -- 172.21.15.148:0/1217533697 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc80009c180 con 0x5599e0a3bcb0 2024-09-19T07:18:09.700 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.694+0000 7fc7ecff9640 1 -- 172.21.15.148:0/1217533697 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fc7fc023040 con 0x5599e0a3bcb0 2024-09-19T07:18:09.700 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.694+0000 7fc80e26b740 10 client.16671 fetch_fsmap learned FSMap version 39 2024-09-19T07:18:09.700 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.694+0000 7fc80e26b740 1 -- 172.21.15.148:0/1217533697 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5599e0ab6680 con 0x5599e0a3bcb0 2024-09-19T07:18:09.700 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.694+0000 7fc7ecff9640 1 -- 172.21.15.148:0/1217533697 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc80009c180 con 0x5599e0a3bcb0 2024-09-19T07:18:09.701 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.694+0000 7fc7ecff9640 1 -- 172.21.15.148:0/1217533697 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7fc7fc0040b0 con 0x5599e0a3bcb0 2024-09-19T07:18:09.701 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.694+0000 7fc80e26b740 10 client.16671 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T07:18:09.701 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.694+0000 7fc80e26b740 10 client.16671 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:18:09.701 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.694+0000 7fc80e26b740 20 client.16671 populate_metadata read hostname 'smithi148' 2024-09-19T07:18:09.701 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.694+0000 7fc80e26b740 1 --2- 172.21.15.148:0/1217533697 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5599e0ab6da0 0x5599e0ab91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:09.701 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.694+0000 7fc80e26b740 4 client.16671 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:18:09.701 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.694+0000 7fc80e26b740 1 -- 172.21.15.148:0/1217533697 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5599e0919900 con 0x5599e0ab6da0 2024-09-19T07:18:09.701 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.695+0000 7fc809192640 1 --2- 172.21.15.148:0/1217533697 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5599e0ab6da0 0x5599e0ab91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:09.701 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.695+0000 7fc809192640 1 --2- 172.21.15.148:0/1217533697 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5599e0ab6da0 0x5599e0ab91c0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3de44a63b64d7ea server_cookie=e28c2bbab6e8cded in_seq=0 out_seq=0 2024-09-19T07:18:09.701 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:09.695+0000 7fc7ecff9640 10 client.16671 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:18:10.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:18:10 smithi148 ceph-mon[31180]: pgmap v217: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 424 op/s 2024-09-19T07:18:10.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:18:10 smithi165 ceph-mon[35326]: pgmap v217: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 424 op/s 2024-09-19T07:18:11.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:18:10 smithi179 ceph-mon[35716]: pgmap v217: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 424 op/s 2024-09-19T07:18:12.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:18:12 smithi148 ceph-mon[31180]: pgmap v218: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 404 op/s 2024-09-19T07:18:12.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:18:12 smithi148 ceph-mon[31180]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:18:12.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:18:12 smithi165 ceph-mon[35326]: pgmap v218: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 404 op/s 2024-09-19T07:18:12.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:18:12 smithi165 ceph-mon[35326]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:18:13.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:18:12 smithi179 ceph-mon[35716]: pgmap v218: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 404 op/s 2024-09-19T07:18:13.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:18:12 smithi179 ceph-mon[35716]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:18:13.195 INFO:tasks.workunit.client.0.smithi148.stdout: 409 53696 0 36947 0 17501 0 2024-09-19T07:18:14.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:18:14 smithi148 ceph-mon[31180]: pgmap v219: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 929 KiB/s rd, 1.3 MiB/s wr, 162 op/s 2024-09-19T07:18:14.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:18:14 smithi165 ceph-mon[35326]: pgmap v219: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 929 KiB/s rd, 1.3 MiB/s wr, 162 op/s 2024-09-19T07:18:15.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:18:14 smithi179 ceph-mon[35716]: pgmap v219: 97 pgs: 97 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 929 KiB/s rd, 1.3 MiB/s wr, 162 op/s 2024-09-19T07:18:15.081 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:15.079+0000 7fc7ecff9640 1 -- 172.21.15.148:0/1217533697 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5599e0919900 con 0x5599e0ab6da0 2024-09-19T07:18:15.081 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:15.079+0000 7fc7ecff9640 10 client.16671 handle_command_reply: tid=0 2024-09-19T07:18:15.081 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:15.079+0000 7fc80e26b740 1 client.16671 shutdown 2024-09-19T07:18:15.081 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:15.079+0000 7fc80e26b740 1 -- 172.21.15.148:0/1217533697 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599e0a3bcb0 msgr2=0x5599e0a3f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:15.081 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:15.079+0000 7fc80e26b740 1 --2- 172.21.15.148:0/1217533697 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599e0a3bcb0 0x5599e0a3f8c0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc0107a0 tx=0x7fc7fc00eb40 comp rx=0 tx=0).stop 2024-09-19T07:18:15.082 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:15.079+0000 7fc80e26b740 1 -- 172.21.15.148:0/1217533697 shutdown_connections 2024-09-19T07:18:15.082 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:15.079+0000 7fc80e26b740 1 --2- 172.21.15.148:0/1217533697 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5599e0ab6da0 0x5599e0ab91c0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:15.082 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:15.079+0000 7fc80e26b740 1 --2- 172.21.15.148:0/1217533697 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599e0a3bcb0 0x5599e0a3f8c0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:15.082 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:15.079+0000 7fc80e26b740 1 --2- 172.21.15.148:0/1217533697 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5599e0a31410 0x5599e0a3f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:15.082 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:15.079+0000 7fc80e26b740 1 --2- 172.21.15.148:0/1217533697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5599e0a30af0 0x5599e0a44060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:15.082 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:15.079+0000 7fc7ecff9640 0 client.16671 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:18:15.082 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:15.079+0000 7fc80e26b740 1 -- 172.21.15.148:0/1217533697 >> 172.21.15.148:0/1217533697 conn(0x5599e0a2d060 msgr2=0x5599e0a3a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:18:15.083 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:15.079+0000 7fc80e26b740 1 -- 172.21.15.148:0/1217533697 shutdown_connections 2024-09-19T07:18:15.083 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:15.079+0000 7fc80e26b740 1 -- 172.21.15.148:0/1217533697 wait complete. 2024-09-19T07:18:15.083 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:15.079+0000 7fc80e26b740 20 client.16671 trim_cache size 0 max 16384 2024-09-19T07:18:15.083 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:18:15.084 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:18:15.084 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:18:15.084 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:18:15.085 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:15.080+0000 7fc80b3f6640 1 -- 172.21.15.148:0/4252792155 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc7f00a34e0 msgr2=0x7fc7f00a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:15.085 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:15.080+0000 7fc80b3f6640 1 --2- 172.21.15.148:0/4252792155 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc7f00a34e0 0x7fc7f00a59a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc013b30 tx=0x7fc7fc005c60 comp rx=0 tx=0).stop 2024-09-19T07:18:15.085 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:15.080+0000 7fc80b3f6640 1 -- 172.21.15.148:0/4252792155 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc804074590 msgr2=0x7fc8041a4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:15.085 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:15.080+0000 7fc80b3f6640 1 --2- 172.21.15.148:0/4252792155 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc804074590 0x7fc8041a4620 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fc80000d770 tx=0x7fc80000dc30 comp rx=0 tx=0).stop 2024-09-19T07:18:15.086 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:15.080+0000 7fc80b3f6640 1 -- 172.21.15.148:0/4252792155 shutdown_connections 2024-09-19T07:18:15.086 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:15.080+0000 7fc80b3f6640 1 --2- 172.21.15.148:0/4252792155 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc7f00a34e0 0x7fc7f00a59a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:15.086 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:15.080+0000 7fc80b3f6640 1 --2- 172.21.15.148:0/4252792155 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc804112af0 0x7fc80419e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:15.086 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:15.080+0000 7fc80b3f6640 1 --2- 172.21.15.148:0/4252792155 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc804074eb0 0x7fc8041a4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:15.086 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:15.080+0000 7fc80b3f6640 1 --2- 172.21.15.148:0/4252792155 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc804074590 0x7fc8041a4620 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:15.086 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:15.080+0000 7fc80b3f6640 1 -- 172.21.15.148:0/4252792155 >> 172.21.15.148:0/4252792155 conn(0x7fc8040fd7e0 msgr2=0x7fc8040fee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:18:15.087 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:15.080+0000 7fc80b3f6640 1 -- 172.21.15.148:0/4252792155 shutdown_connections 2024-09-19T07:18:15.087 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:15.080+0000 7fc80b3f6640 1 -- 172.21.15.148:0/4252792155 wait complete. 2024-09-19T07:18:16.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:18:16 smithi148 ceph-mon[31180]: pgmap v220: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.4 MiB/s wr, 746 op/s 2024-09-19T07:18:16.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:18:16 smithi165 ceph-mon[35326]: pgmap v220: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.4 MiB/s wr, 746 op/s 2024-09-19T07:18:17.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:18:16 smithi179 ceph-mon[35716]: pgmap v220: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.4 MiB/s wr, 746 op/s 2024-09-19T07:18:17.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:18:17 smithi148 ceph-mon[31180]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T07:18:17.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:18:17 smithi165 ceph-mon[35326]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T07:18:18.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:18:17 smithi179 ceph-mon[35716]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T07:18:18.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:18:18 smithi165 ceph-mon[35326]: pgmap v222: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 9.5 MiB/s wr, 824 op/s 2024-09-19T07:18:19.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:18:18 smithi179 ceph-mon[35716]: pgmap v222: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 9.5 MiB/s wr, 824 op/s 2024-09-19T07:18:19.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:18:18 smithi148 ceph-mon[31180]: pgmap v222: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 9.5 MiB/s wr, 824 op/s 2024-09-19T07:18:19.799 INFO:tasks.quiescer.fs.[cephfs]:Total duration (51.5) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T07:18:19.800 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 25.75 2024-09-19T07:18:19.800 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:18:20.115 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:18:20.869 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:18:20 smithi148 ceph-mon[31180]: pgmap v223: 97 pgs: 5 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 81 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 12 MiB/s wr, 1.01k op/s 2024-09-19T07:18:20.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:18:20 smithi165 ceph-mon[35326]: pgmap v223: 97 pgs: 5 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 81 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 12 MiB/s wr, 1.01k op/s 2024-09-19T07:18:20.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:20.976+0000 7f1edef37640 1 -- 172.21.15.148:0/738731126 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ed8100430 msgr2=0x7f1ed8100810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:20.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:20.976+0000 7f1edef37640 1 --2- 172.21.15.148:0/738731126 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ed8100430 0x7f1ed8100810 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc009900 tx=0x7f1ecc02a410 comp rx=0 tx=0).stop 2024-09-19T07:18:20.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:20.976+0000 7f1edef37640 1 -- 172.21.15.148:0/738731126 shutdown_connections 2024-09-19T07:18:20.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:20.976+0000 7f1edef37640 1 --2- 172.21.15.148:0/738731126 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ed8105560 0x7f1ed810d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:20.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:20.976+0000 7f1edef37640 1 --2- 172.21.15.148:0/738731126 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ed8100de0 0x7f1ed8104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:20.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:20.976+0000 7f1edef37640 1 --2- 172.21.15.148:0/738731126 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ed8100430 0x7f1ed8100810 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:20.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:20.976+0000 7f1edef37640 1 -- 172.21.15.148:0/738731126 >> 172.21.15.148:0/738731126 conn(0x7f1ed8077230 msgr2=0x7f1ed80fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:18:20.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:20.977+0000 7f1edef37640 1 -- 172.21.15.148:0/738731126 shutdown_connections 2024-09-19T07:18:20.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:20.977+0000 7f1edef37640 1 -- 172.21.15.148:0/738731126 wait complete. 2024-09-19T07:18:20.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:20.977+0000 7f1edef37640 1 Processor -- start 2024-09-19T07:18:20.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:20.977+0000 7f1edef37640 1 -- start start 2024-09-19T07:18:20.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:20.978+0000 7f1edef37640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ed8100430 0x7f1ed819a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:20.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:20.978+0000 7f1edef37640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ed8100de0 0x7f1ed819ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:20.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:20.978+0000 7f1edef37640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ed8105560 0x7f1ed819efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:20.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:20.978+0000 7f1edef37640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed81105e0 con 0x7f1ed8105560 2024-09-19T07:18:20.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:20.978+0000 7f1edef37640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed8110460 con 0x7f1ed8100430 2024-09-19T07:18:20.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:20.978+0000 7f1edef37640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed8110760 con 0x7f1ed8100de0 2024-09-19T07:18:20.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:20.978+0000 7f1edccd3640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ed8100430 0x7f1ed819a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:20.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:20.978+0000 7f1edd4d4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ed8105560 0x7f1ed819efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:20.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:20.978+0000 7f1ed7fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ed8100de0 0x7f1ed819ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:20.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:20.978+0000 7f1edd4d4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ed8105560 0x7f1ed819efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52670/0 (socket says 172.21.15.148:52670) 2024-09-19T07:18:20.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:20.978+0000 7f1edccd3640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ed8100430 0x7f1ed819a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:43770/0 (socket says 172.21.15.148:43770) 2024-09-19T07:18:20.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:20.978+0000 7f1edd4d4640 1 -- 172.21.15.148:0/1569079911 learned_addr learned my addr 172.21.15.148:0/1569079911 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:18:20.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:20.978+0000 7f1edd4d4640 1 -- 172.21.15.148:0/1569079911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ed8100de0 msgr2=0x7f1ed819ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:20.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:20.978+0000 7f1edd4d4640 1 --2- 172.21.15.148:0/1569079911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ed8100de0 0x7f1ed819ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:20.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:20.978+0000 7f1edd4d4640 1 -- 172.21.15.148:0/1569079911 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ed8100430 msgr2=0x7f1ed819a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:20.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:20.978+0000 7f1edd4d4640 1 --2- 172.21.15.148:0/1569079911 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ed8100430 0x7f1ed819a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:20.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:20.978+0000 7f1edd4d4640 1 -- 172.21.15.148:0/1569079911 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ed819f6c0 con 0x7f1ed8105560 2024-09-19T07:18:20.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:20.978+0000 7f1edccd3640 1 --2- 172.21.15.148:0/1569079911 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ed8100430 0x7f1ed819a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:18:20.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:20.979+0000 7f1edd4d4640 1 --2- 172.21.15.148:0/1569079911 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ed8105560 0x7f1ed819efe0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f1ed000eb10 tx=0x7f1ed000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:18:20.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:20.979+0000 7f1ed5ffb640 1 -- 172.21.15.148:0/1569079911 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed000ce20 con 0x7f1ed8105560 2024-09-19T07:18:20.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:20.979+0000 7f1edef37640 1 -- 172.21.15.148:0/1569079911 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ed819f9b0 con 0x7f1ed8105560 2024-09-19T07:18:20.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:20.979+0000 7f1ed5ffb640 1 -- 172.21.15.148:0/1569079911 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ed0005020 con 0x7f1ed8105560 2024-09-19T07:18:20.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:20.979+0000 7f1ed5ffb640 1 -- 172.21.15.148:0/1569079911 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed0010670 con 0x7f1ed8105560 2024-09-19T07:18:20.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:20.979+0000 7f1edef37640 1 -- 172.21.15.148:0/1569079911 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ed81a7290 con 0x7f1ed8105560 2024-09-19T07:18:20.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:20.980+0000 7f1edef37640 1 -- 172.21.15.148:0/1569079911 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ed8100810 con 0x7f1ed8105560 2024-09-19T07:18:20.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:20.982+0000 7f1ed5ffb640 1 -- 172.21.15.148:0/1569079911 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f1ed0005520 con 0x7f1ed8105560 2024-09-19T07:18:20.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:20.982+0000 7f1ed5ffb640 1 --2- 172.21.15.148:0/1569079911 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f1ec80a3430 0x7f1ec80a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:20.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:20.983+0000 7f1edccd3640 1 --2- 172.21.15.148:0/1569079911 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f1ec80a3430 0x7f1ec80a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:20.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:20.983+0000 7f1ed5ffb640 1 -- 172.21.15.148:0/1569079911 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8600+0+0 (secure 0 0 0) 0x7f1ed00d0320 con 0x7f1ed8105560 2024-09-19T07:18:20.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:20.983+0000 7f1edccd3640 1 --2- 172.21.15.148:0/1569079911 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f1ec80a3430 0x7f1ec80a58f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc009230 tx=0x7f1ecc0058d0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:18:20.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:20.988+0000 7f1ed5ffb640 1 -- 172.21.15.148:0/1569079911 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1ed009cc50 con 0x7f1ed8105560 2024-09-19T07:18:21.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:18:20 smithi179 ceph-mon[35716]: pgmap v223: 97 pgs: 5 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 81 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 12 MiB/s wr, 1.01k op/s 2024-09-19T07:18:21.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:21.323+0000 7f1edef37640 1 -- 172.21.15.148:0/1569079911 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1ed81a7570 con 0x7f1ed8105560 2024-09-19T07:18:21.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:21.324+0000 7f1ed5ffb640 1 -- 172.21.15.148:0/1569079911 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+11945 (secure 0 0 0) 0x7f1ed009c550 con 0x7f1ed8105560 2024-09-19T07:18:21.325 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:18:21.325 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":40,"btime":"2024-09-19T07:18:11:558365+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/4263868576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":4263868576},{"type":"v1","addr":"172.21.15.148:6841","nonce":4263868576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":25606,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3891676893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3891676893},{"type":"v1","addr":"172.21.15.179:6835","nonce":3891676893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":40,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:09:19.543369+0000","modified":"2024-09-19T07:18:11.106406+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24457,"mds_1":24437,"mds_2":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":75,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":71,"addr":"172.21.15.165:6839/3993490234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":3993490234},{"type":"v1","addr":"172.21.15.165:6839","nonce":3993490234}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25823":{"gid":25823,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6835/380886107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":380886107},{"type":"v1","addr":"172.21.15.165:6835","nonce":380886107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24457,"qdb_cluster":[24436,24437,24457]},"id":1}]} 2024-09-19T07:18:21.326 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 40 2024-09-19T07:18:21.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:21.329+0000 7f1edef37640 1 -- 172.21.15.148:0/1569079911 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f1ec80a3430 msgr2=0x7f1ec80a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:21.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:21.329+0000 7f1edef37640 1 --2- 172.21.15.148:0/1569079911 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f1ec80a3430 0x7f1ec80a58f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc009230 tx=0x7f1ecc0058d0 comp rx=0 tx=0).stop 2024-09-19T07:18:21.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:21.329+0000 7f1edef37640 1 -- 172.21.15.148:0/1569079911 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ed8105560 msgr2=0x7f1ed819efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:21.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:21.329+0000 7f1edef37640 1 --2- 172.21.15.148:0/1569079911 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ed8105560 0x7f1ed819efe0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f1ed000eb10 tx=0x7f1ed000ef10 comp rx=0 tx=0).stop 2024-09-19T07:18:21.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:21.329+0000 7f1edef37640 1 -- 172.21.15.148:0/1569079911 shutdown_connections 2024-09-19T07:18:21.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:21.329+0000 7f1edef37640 1 --2- 172.21.15.148:0/1569079911 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f1ec80a3430 0x7f1ec80a58f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:21.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:21.329+0000 7f1edef37640 1 --2- 172.21.15.148:0/1569079911 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ed8105560 0x7f1ed819efe0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:21.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:21.329+0000 7f1edef37640 1 --2- 172.21.15.148:0/1569079911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ed8100de0 0x7f1ed819ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:21.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:21.329+0000 7f1edef37640 1 --2- 172.21.15.148:0/1569079911 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ed8100430 0x7f1ed819a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:21.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:21.329+0000 7f1edef37640 1 -- 172.21.15.148:0/1569079911 >> 172.21.15.148:0/1569079911 conn(0x7f1ed8077230 msgr2=0x7f1ed80ff060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:18:21.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:21.329+0000 7f1edef37640 1 -- 172.21.15.148:0/1569079911 shutdown_connections 2024-09-19T07:18:21.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:21.329+0000 7f1edef37640 1 -- 172.21.15.148:0/1569079911 wait complete. 2024-09-19T07:18:21.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:18:21 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/1569079911' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:18:22.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:18:21 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/1569079911' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:18:22.056 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:18:21 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/1569079911' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:18:22.616 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24457 quiesce db / --timeout 90 --expiration 145.75 --await-for 45.0' 2024-09-19T07:18:22.616 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24457 quiesce db / --timeout 90 --expiration 145.75 --await-for 45.0 2024-09-19T07:18:22.836 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:18:22 smithi148 ceph-mon[31180]: pgmap v224: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 17 MiB/s wr, 1.20k op/s 2024-09-19T07:18:22.836 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:18:22 smithi148 ceph-mon[31180]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:18:22.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:18:22 smithi165 ceph-mon[35326]: pgmap v224: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 17 MiB/s wr, 1.20k op/s 2024-09-19T07:18:22.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:18:22 smithi165 ceph-mon[35326]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:18:22.923 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:18:22 smithi179 ceph-mon[35716]: pgmap v224: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 17 MiB/s wr, 1.20k op/s 2024-09-19T07:18:22.923 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:18:22 smithi179 ceph-mon[35716]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:18:23.014 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:18:23.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.656+0000 7f601aaae640 1 -- 172.21.15.148:0/1798369927 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6014106a80 msgr2=0x7f6014106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:23.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.656+0000 7f601aaae640 1 --2- 172.21.15.148:0/1798369927 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6014106a80 0x7f6014106e60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f600c009be0 tx=0x7f600c02a6d0 comp rx=0 tx=0).stop 2024-09-19T07:18:23.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.656+0000 7f601aaae640 1 -- 172.21.15.148:0/1798369927 shutdown_connections 2024-09-19T07:18:23.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.656+0000 7f601aaae640 1 --2- 172.21.15.148:0/1798369927 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6014101420 0x7f601410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:23.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.656+0000 7f601aaae640 1 --2- 172.21.15.148:0/1798369927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6014100a80 0x7f6014100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:23.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.656+0000 7f601aaae640 1 --2- 172.21.15.148:0/1798369927 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6014106a80 0x7f6014106e60 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:23.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.656+0000 7f601aaae640 1 -- 172.21.15.148:0/1798369927 >> 172.21.15.148:0/1798369927 conn(0x7f60140fc7a0 msgr2=0x7f60140febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:18:23.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.657+0000 7f601aaae640 1 -- 172.21.15.148:0/1798369927 shutdown_connections 2024-09-19T07:18:23.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.657+0000 7f601aaae640 1 -- 172.21.15.148:0/1798369927 wait complete. 2024-09-19T07:18:23.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.658+0000 7f601aaae640 1 Processor -- start 2024-09-19T07:18:23.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.658+0000 7f601aaae640 1 -- start start 2024-09-19T07:18:23.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.659+0000 7f601aaae640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6014100a80 0x7f60141971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:23.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.659+0000 7f601aaae640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6014101420 0x7f60141976e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:23.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.659+0000 7f601aaae640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6014106a80 0x7f601419ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:23.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.659+0000 7f601aaae640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6014110e80 con 0x7f6014100a80 2024-09-19T07:18:23.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.659+0000 7f601aaae640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6014110d00 con 0x7f6014101420 2024-09-19T07:18:23.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.659+0000 7f601aaae640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6014111000 con 0x7f6014106a80 2024-09-19T07:18:23.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.659+0000 7f601884a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6014100a80 0x7f60141971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:23.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.659+0000 7f601884a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6014100a80 0x7f60141971a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52692/0 (socket says 172.21.15.148:52692) 2024-09-19T07:18:23.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.659+0000 7f601884a640 1 -- 172.21.15.148:0/1776948509 learned_addr learned my addr 172.21.15.148:0/1776948509 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:18:23.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.659+0000 7f6013fff640 1 --2- 172.21.15.148:0/1776948509 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6014101420 0x7f60141976e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:23.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.659+0000 7f601904b640 1 --2- 172.21.15.148:0/1776948509 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6014106a80 0x7f601419ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:23.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.660+0000 7f601884a640 1 -- 172.21.15.148:0/1776948509 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6014106a80 msgr2=0x7f601419ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:23.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.660+0000 7f601884a640 1 --2- 172.21.15.148:0/1776948509 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6014106a80 0x7f601419ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:23.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.660+0000 7f601884a640 1 -- 172.21.15.148:0/1776948509 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6014101420 msgr2=0x7f60141976e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:23.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.660+0000 7f601884a640 1 --2- 172.21.15.148:0/1776948509 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6014101420 0x7f60141976e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:23.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.660+0000 7f601884a640 1 -- 172.21.15.148:0/1776948509 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f601419c150 con 0x7f6014100a80 2024-09-19T07:18:23.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.660+0000 7f601904b640 1 --2- 172.21.15.148:0/1776948509 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6014106a80 0x7f601419ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:18:23.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.660+0000 7f6013fff640 1 --2- 172.21.15.148:0/1776948509 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6014101420 0x7f60141976e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:18:23.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.660+0000 7f601884a640 1 --2- 172.21.15.148:0/1776948509 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6014100a80 0x7f60141971a0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f600c034040 tx=0x7f600c030d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:18:23.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.661+0000 7f6011ffb640 1 -- 172.21.15.148:0/1776948509 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600c036040 con 0x7f6014100a80 2024-09-19T07:18:23.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.661+0000 7f6011ffb640 1 -- 172.21.15.148:0/1776948509 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f600c03e070 con 0x7f6014100a80 2024-09-19T07:18:23.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.661+0000 7f601aaae640 1 -- 172.21.15.148:0/1776948509 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f601419c3e0 con 0x7f6014100a80 2024-09-19T07:18:23.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.661+0000 7f6011ffb640 1 -- 172.21.15.148:0/1776948509 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600c004480 con 0x7f6014100a80 2024-09-19T07:18:23.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.661+0000 7f601aaae640 1 -- 172.21.15.148:0/1776948509 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f601419c800 con 0x7f6014100a80 2024-09-19T07:18:23.666 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.665+0000 7f6011ffb640 1 -- 172.21.15.148:0/1776948509 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f600c03a070 con 0x7f6014100a80 2024-09-19T07:18:23.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.666+0000 7f601ce87740 1 Processor -- start 2024-09-19T07:18:23.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.666+0000 7f601ce87740 1 -- start start 2024-09-19T07:18:23.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.667+0000 7f601ce87740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564c3bc6c770 0x564c3bc6cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:23.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.667+0000 7f601ce87740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564c3bc6d090 0x564c3bc7fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:23.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.667+0000 7f601ce87740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564c3bc80240 0x564c3bc82630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:23.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.667+0000 7f601ce87740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x564c3bbd1160 con 0x564c3bc80240 2024-09-19T07:18:23.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.667+0000 7f601ce87740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x564c3bb78720 con 0x564c3bc6c770 2024-09-19T07:18:23.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.667+0000 7f601ce87740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564c3bbcd120 con 0x564c3bc6d090 2024-09-19T07:18:23.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.667+0000 7f6013fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564c3bc80240 0x564c3bc82630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:23.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.667+0000 7f6013fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564c3bc80240 0x564c3bc82630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52702/0 (socket says 172.21.15.148:52702) 2024-09-19T07:18:23.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.667+0000 7f6013fff640 1 -- 172.21.15.148:0/453275695 learned_addr learned my addr 172.21.15.148:0/453275695 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:18:23.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.668+0000 7f6013fff640 1 -- 172.21.15.148:0/453275695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564c3bc6d090 msgr2=0x564c3bc7fd00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T07:18:23.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.668+0000 7f601904b640 1 --2- 172.21.15.148:0/453275695 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564c3bc6c770 0x564c3bc6cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:23.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.668+0000 7f6011ffb640 1 --2- 172.21.15.148:0/1776948509 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f5ffc0a3580 0x7f5ffc0a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:23.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.668+0000 7f601884a640 1 --2- 172.21.15.148:0/453275695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564c3bc6d090 0x564c3bc7fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:23.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.668+0000 7f6011ffb640 1 -- 172.21.15.148:0/1776948509 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8600+0+0 (secure 0 0 0) 0x7f600c0eff70 con 0x7f6014100a80 2024-09-19T07:18:23.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.668+0000 7f6013fff640 1 --2- 172.21.15.148:0/453275695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564c3bc6d090 0x564c3bc7fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:23.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.668+0000 7f6013fff640 1 -- 172.21.15.148:0/453275695 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564c3bc6c770 msgr2=0x564c3bc6cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:18:23.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.668+0000 7f6013fff640 1 --2- 172.21.15.148:0/453275695 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564c3bc6c770 0x564c3bc6cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:23.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.668+0000 7f6013fff640 1 -- 172.21.15.148:0/453275695 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c3b942ba0 con 0x564c3bc80240 2024-09-19T07:18:23.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.669+0000 7f601904b640 1 --2- 172.21.15.148:0/453275695 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564c3bc6c770 0x564c3bc6cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:18:23.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.669+0000 7f6013fff640 1 --2- 172.21.15.148:0/453275695 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564c3bc80240 0x564c3bc82630 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f60040114f0 tx=0x7f60040119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ea2999f6f9f6475 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:18:23.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.669+0000 7f601904b640 1 --2- 172.21.15.148:0/1776948509 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f5ffc0a3580 0x7f5ffc0a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:23.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.669+0000 7f5ffaffd640 1 -- 172.21.15.148:0/453275695 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6004005020 con 0x564c3bc80240 2024-09-19T07:18:23.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.670+0000 7f5ffaffd640 1 -- 172.21.15.148:0/453275695 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60040047a0 con 0x564c3bc80240 2024-09-19T07:18:23.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.670+0000 7f5ffaffd640 1 -- 172.21.15.148:0/453275695 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600400fa80 con 0x564c3bc80240 2024-09-19T07:18:23.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.671+0000 7f601904b640 1 --2- 172.21.15.148:0/1776948509 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f5ffc0a3580 0x7f5ffc0a5a40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6008009c00 tx=0x7f60080046c0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:18:23.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.671+0000 7f601ce87740 1 -- 172.21.15.148:0/453275695 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564c3bc80240 msgr2=0x564c3bc82630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:23.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.671+0000 7f601ce87740 1 --2- 172.21.15.148:0/453275695 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564c3bc80240 0x564c3bc82630 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f60040114f0 tx=0x7f60040119b0 comp rx=0 tx=0).stop 2024-09-19T07:18:23.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.671+0000 7f601ce87740 1 -- 172.21.15.148:0/453275695 shutdown_connections 2024-09-19T07:18:23.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.671+0000 7f601ce87740 1 --2- 172.21.15.148:0/453275695 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564c3bc80240 0x564c3bc82630 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:23.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.671+0000 7f601ce87740 1 --2- 172.21.15.148:0/453275695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564c3bc6d090 0x564c3bc7fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:23.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.671+0000 7f601ce87740 1 --2- 172.21.15.148:0/453275695 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564c3bc6c770 0x564c3bc6cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:23.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.671+0000 7f601ce87740 1 -- 172.21.15.148:0/453275695 >> 172.21.15.148:0/453275695 conn(0x564c3bc68de0 msgr2=0x564c3bc691c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:18:23.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.672+0000 7f601ce87740 1 -- 172.21.15.148:0/453275695 shutdown_connections 2024-09-19T07:18:23.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.672+0000 7f601ce87740 1 -- 172.21.15.148:0/453275695 wait complete. 2024-09-19T07:18:23.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.672+0000 7f601ce87740 1 -- start start 2024-09-19T07:18:23.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.673+0000 7f601ce87740 1 Processor -- start 2024-09-19T07:18:23.676 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.673+0000 7f601ce87740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564c3bc6c770 0x564c3bc79d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:23.676 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.674+0000 7f601ce87740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564c3bc6d090 0x564c3bc7a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:23.676 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.674+0000 7f601ce87740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564c3bc80240 0x564c3bc7fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:23.676 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.674+0000 7f601884a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564c3bc6c770 0x564c3bc79d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:23.676 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.674+0000 7f601884a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564c3bc6c770 0x564c3bc79d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:52328/0 (socket says 172.21.15.148:52328) 2024-09-19T07:18:23.676 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.674+0000 7f601884a640 1 -- 172.21.15.148:0/3786453295 learned_addr learned my addr 172.21.15.148:0/3786453295 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:18:23.676 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.674+0000 7f601ce87740 1 -- 172.21.15.148:0/3786453295 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x564c3bc6f720 con 0x564c3bc80240 2024-09-19T07:18:23.676 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.674+0000 7f601ce87740 1 -- 172.21.15.148:0/3786453295 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x564c3bb59900 con 0x564c3bc6d090 2024-09-19T07:18:23.676 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.674+0000 7f601ce87740 1 -- 172.21.15.148:0/3786453295 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564c3bc6f8a0 con 0x564c3bc6c770 2024-09-19T07:18:23.676 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.674+0000 7f601ce87740 10 client.0 _ll_register_callbacks cb 0x564c3bb57780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:18:23.676 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.674+0000 7f6013fff640 1 --2- 172.21.15.148:0/3786453295 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564c3bc6d090 0x564c3bc7a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:23.676 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.675+0000 7f601904b640 1 --2- 172.21.15.148:0/3786453295 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564c3bc80240 0x564c3bc7fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:23.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.675+0000 7f601884a640 1 -- 172.21.15.148:0/3786453295 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564c3bc6d090 msgr2=0x564c3bc7a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:18:23.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.675+0000 7f601884a640 1 --2- 172.21.15.148:0/3786453295 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564c3bc6d090 0x564c3bc7a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:23.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.675+0000 7f601884a640 1 -- 172.21.15.148:0/3786453295 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564c3bc80240 msgr2=0x564c3bc7fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:18:23.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.675+0000 7f601884a640 1 --2- 172.21.15.148:0/3786453295 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564c3bc80240 0x564c3bc7fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:23.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.675+0000 7f601884a640 1 -- 172.21.15.148:0/3786453295 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c3bb99c50 con 0x564c3bc6c770 2024-09-19T07:18:23.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.675+0000 7f601884a640 1 --2- 172.21.15.148:0/3786453295 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564c3bc6c770 0x564c3bc79d30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f600c030d90 tx=0x7f600c0bbdf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2a8a2d99017b788 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:18:23.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.675+0000 7f6013fff640 1 --2- 172.21.15.148:0/3786453295 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564c3bc6d090 0x564c3bc7a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:18:23.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.676+0000 7f5ff3fff640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-19T07:18:23.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.676+0000 7f5ff3fff640 1 -- 172.21.15.148:0/3786453295 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600c03a360 con 0x564c3bc6c770 2024-09-19T07:18:23.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.676+0000 7f5ff3fff640 1 -- 172.21.15.148:0/3786453295 <== mon.1 v2:172.21.15.179:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8600+0+0 (secure 0 0 0) 0x7f600c02d1c0 con 0x564c3bc6c770 2024-09-19T07:18:23.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.676+0000 7f601ce87740 1 -- 172.21.15.148:0/3786453295 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60040047a0 con 0x564c3bc6c770 2024-09-19T07:18:23.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.677+0000 7f5ff3fff640 1 -- 172.21.15.148:0/3786453295 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f600c0bc9b0 con 0x564c3bc6c770 2024-09-19T07:18:23.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.677+0000 7f601ce87740 10 client.26071 fetch_fsmap learned FSMap version 41 2024-09-19T07:18:23.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.677+0000 7f601ce87740 1 -- 172.21.15.148:0/3786453295 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x564c3bc6f720 con 0x564c3bc6c770 2024-09-19T07:18:23.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.677+0000 7f5ff3fff640 1 -- 172.21.15.148:0/3786453295 <== mon.1 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60040047a0 con 0x564c3bc6c770 2024-09-19T07:18:23.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.677+0000 7f5ff3fff640 1 -- 172.21.15.148:0/3786453295 <== mon.1 v2:172.21.15.179:3300/0 5 ==== fsmap(e 41) ==== 8370+0+0 (secure 0 0 0) 0x7f600c04b030 con 0x564c3bc6c770 2024-09-19T07:18:23.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.677+0000 7f601ce87740 10 client.26071 fetch_fsmap finished waiting for FSMap version 41 2024-09-19T07:18:23.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.677+0000 7f601ce87740 10 client.26071 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:18:23.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.677+0000 7f601ce87740 20 client.26071 populate_metadata read hostname 'smithi148' 2024-09-19T07:18:23.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.677+0000 7f601ce87740 1 --2- 172.21.15.148:0/3786453295 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x564c3bc986c0 0x564c3bc9aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:23.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.677+0000 7f601ce87740 4 client.26071 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:18:23.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.677+0000 7f601ce87740 1 -- 172.21.15.148:0/3786453295 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564c3bbde890 con 0x564c3bc986c0 2024-09-19T07:18:23.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.678+0000 7f6013fff640 1 --2- 172.21.15.148:0/3786453295 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x564c3bc986c0 0x564c3bc9aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:23.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.679+0000 7f5ff3fff640 10 client.26071 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:18:23.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.679+0000 7f6013fff640 1 --2- 172.21.15.148:0/3786453295 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x564c3bc986c0 0x564c3bc9aaf0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2ea0a577af58f19 server_cookie=56e6ed2f4a213df8 in_seq=0 out_seq=0 2024-09-19T07:18:23.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.680+0000 7f5ff3fff640 1 -- 172.21.15.148:0/3786453295 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564c3bbde890 con 0x564c3bc986c0 2024-09-19T07:18:23.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.680+0000 7f5ff3fff640 10 client.26071 handle_command_reply: tid=0 2024-09-19T07:18:23.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.680+0000 7f601ce87740 1 client.26071 shutdown 2024-09-19T07:18:23.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.680+0000 7f601ce87740 1 -- 172.21.15.148:0/3786453295 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564c3bc6c770 msgr2=0x564c3bc79d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:23.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.680+0000 7f601ce87740 1 --2- 172.21.15.148:0/3786453295 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564c3bc6c770 0x564c3bc79d30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f600c030d90 tx=0x7f600c0bbdf0 comp rx=0 tx=0).stop 2024-09-19T07:18:23.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.680+0000 7f601ce87740 1 -- 172.21.15.148:0/3786453295 shutdown_connections 2024-09-19T07:18:23.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.680+0000 7f601ce87740 1 --2- 172.21.15.148:0/3786453295 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x564c3bc986c0 0x564c3bc9aaf0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:23.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.680+0000 7f5ff3fff640 0 client.26071 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:18:23.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.680+0000 7f601ce87740 1 --2- 172.21.15.148:0/3786453295 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564c3bc80240 0x564c3bc7fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:23.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.680+0000 7f601ce87740 1 --2- 172.21.15.148:0/3786453295 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564c3bc6d090 0x564c3bc7a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:23.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.681+0000 7f601ce87740 1 --2- 172.21.15.148:0/3786453295 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564c3bc6c770 0x564c3bc79d30 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:23.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.681+0000 7f601ce87740 1 -- 172.21.15.148:0/3786453295 >> 172.21.15.148:0/3786453295 conn(0x564c3bc68de0 msgr2=0x564c3bc6ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:18:23.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.681+0000 7f601ce87740 1 -- 172.21.15.148:0/3786453295 shutdown_connections 2024-09-19T07:18:23.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.681+0000 7f601ce87740 1 -- 172.21.15.148:0/3786453295 wait complete. 2024-09-19T07:18:23.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.681+0000 7f601ce87740 20 client.26071 trim_cache size 0 max 16384 2024-09-19T07:18:23.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.709+0000 7f601ce87740 1 Processor -- start 2024-09-19T07:18:23.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.709+0000 7f601ce87740 1 -- start start 2024-09-19T07:18:23.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.709+0000 7f601ce87740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564c3bc6c770 0x564c3bc7f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:23.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.709+0000 7f601ce87740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564c3bc6d090 0x564c3bc67dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:23.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.709+0000 7f601ce87740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564c3bc80240 0x564c3bc68310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:23.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.709+0000 7f601ce87740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f60141ae060 con 0x564c3bc6d090 2024-09-19T07:18:23.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.709+0000 7f601ce87740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f60141ab870 con 0x564c3bc80240 2024-09-19T07:18:23.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.709+0000 7f601ce87740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f60141a96e0 con 0x564c3bc6c770 2024-09-19T07:18:23.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.709+0000 7f6013fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564c3bc6d090 0x564c3bc67dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:23.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.709+0000 7f6013fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564c3bc6d090 0x564c3bc67dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52722/0 (socket says 172.21.15.148:52722) 2024-09-19T07:18:23.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.709+0000 7f601904b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564c3bc80240 0x564c3bc68310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:23.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.709+0000 7f6013fff640 1 -- 172.21.15.148:0/514715423 learned_addr learned my addr 172.21.15.148:0/514715423 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:18:23.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.709+0000 7f601884a640 1 --2- 172.21.15.148:0/514715423 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564c3bc6c770 0x564c3bc7f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:23.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.710+0000 7f6013fff640 1 -- 172.21.15.148:0/514715423 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564c3bc6c770 msgr2=0x564c3bc7f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:18:23.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.710+0000 7f6013fff640 1 --2- 172.21.15.148:0/514715423 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564c3bc6c770 0x564c3bc7f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:23.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.710+0000 7f6013fff640 1 -- 172.21.15.148:0/514715423 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564c3bc80240 msgr2=0x564c3bc68310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:18:23.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.710+0000 7f6013fff640 1 --2- 172.21.15.148:0/514715423 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564c3bc80240 0x564c3bc68310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:23.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.710+0000 7f6013fff640 1 -- 172.21.15.148:0/514715423 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c3bc6cec0 con 0x564c3bc6d090 2024-09-19T07:18:23.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.710+0000 7f601904b640 1 --2- 172.21.15.148:0/514715423 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564c3bc80240 0x564c3bc68310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:18:23.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.710+0000 7f6013fff640 1 --2- 172.21.15.148:0/514715423 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564c3bc6d090 0x564c3bc67dd0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f60040058c0 tx=0x7f6004005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73097f141cc7b606 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:18:23.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.710+0000 7f5ffa7fc640 1 -- 172.21.15.148:0/514715423 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6004004020 con 0x564c3bc6d090 2024-09-19T07:18:23.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.710+0000 7f5ffa7fc640 1 -- 172.21.15.148:0/514715423 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6004005390 con 0x564c3bc6d090 2024-09-19T07:18:23.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.710+0000 7f5ffa7fc640 1 -- 172.21.15.148:0/514715423 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600400f890 con 0x564c3bc6d090 2024-09-19T07:18:23.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.711+0000 7f601ce87740 1 -- 172.21.15.148:0/514715423 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564c3bc6d090 msgr2=0x564c3bc67dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:23.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.711+0000 7f601ce87740 1 --2- 172.21.15.148:0/514715423 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564c3bc6d090 0x564c3bc67dd0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f60040058c0 tx=0x7f6004005fd0 comp rx=0 tx=0).stop 2024-09-19T07:18:23.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.711+0000 7f601ce87740 1 -- 172.21.15.148:0/514715423 shutdown_connections 2024-09-19T07:18:23.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.711+0000 7f601ce87740 1 --2- 172.21.15.148:0/514715423 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564c3bc80240 0x564c3bc68310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:23.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.711+0000 7f601ce87740 1 --2- 172.21.15.148:0/514715423 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564c3bc6d090 0x564c3bc67dd0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:23.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.711+0000 7f601ce87740 1 --2- 172.21.15.148:0/514715423 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564c3bc6c770 0x564c3bc7f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:23.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.711+0000 7f601ce87740 1 -- 172.21.15.148:0/514715423 >> 172.21.15.148:0/514715423 conn(0x564c3bc68de0 msgr2=0x564c3bc676c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:18:23.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.711+0000 7f601ce87740 1 -- 172.21.15.148:0/514715423 shutdown_connections 2024-09-19T07:18:23.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.711+0000 7f601ce87740 1 -- 172.21.15.148:0/514715423 wait complete. 2024-09-19T07:18:23.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.712+0000 7f601ce87740 1 -- start start 2024-09-19T07:18:23.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.712+0000 7f601ce87740 1 Processor -- start 2024-09-19T07:18:23.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.713+0000 7f601ce87740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564c3bc6c770 0x564c3bca7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:23.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.713+0000 7f601ce87740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564c3bc6d090 0x564c3bca8330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:23.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.713+0000 7f601ce87740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564c3bc80240 0x564c3bca8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:23.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.713+0000 7f601ce87740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f60141a9d30 con 0x564c3bc6d090 2024-09-19T07:18:23.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.713+0000 7f601ce87740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f60141ab1a0 con 0x564c3bc80240 2024-09-19T07:18:23.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.713+0000 7f601ce87740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f60141aa400 con 0x564c3bc6c770 2024-09-19T07:18:23.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.713+0000 7f6013fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564c3bc6d090 0x564c3bca8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:23.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.713+0000 7f601ce87740 10 client.0 _ll_register_callbacks cb 0x7f600c005f70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:18:23.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.713+0000 7f601884a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564c3bc6c770 0x564c3bca7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:23.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.713+0000 7f6013fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564c3bc6d090 0x564c3bca8330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52724/0 (socket says 172.21.15.148:52724) 2024-09-19T07:18:23.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.713+0000 7f6013fff640 1 -- 172.21.15.148:0/2698616444 learned_addr learned my addr 172.21.15.148:0/2698616444 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:18:23.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.713+0000 7f601904b640 1 --2- 172.21.15.148:0/2698616444 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564c3bc80240 0x564c3bca8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:23.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.713+0000 7f601884a640 1 -- 172.21.15.148:0/2698616444 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564c3bc80240 msgr2=0x564c3bca8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:18:23.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.713+0000 7f601884a640 1 --2- 172.21.15.148:0/2698616444 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564c3bc80240 0x564c3bca8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:23.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.713+0000 7f601884a640 1 -- 172.21.15.148:0/2698616444 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564c3bc6d090 msgr2=0x564c3bca8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:18:23.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.713+0000 7f601884a640 1 --2- 172.21.15.148:0/2698616444 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564c3bc6d090 0x564c3bca8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:23.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.713+0000 7f601884a640 1 -- 172.21.15.148:0/2698616444 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c3bd02250 con 0x564c3bc6c770 2024-09-19T07:18:23.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.714+0000 7f601884a640 1 --2- 172.21.15.148:0/2698616444 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564c3bc6c770 0x564c3bca7df0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f600c0bbfb0 tx=0x7f600c0bbf20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4781b2ec0a0ed2d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:18:23.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.714+0000 7f5ff3fff640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-19T07:18:23.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.714+0000 7f5ff3fff640 1 -- 172.21.15.148:0/2698616444 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600c0c6020 con 0x564c3bc6c770 2024-09-19T07:18:23.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.714+0000 7f5ff3fff640 1 -- 172.21.15.148:0/2698616444 <== mon.1 v2:172.21.15.179:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8600+0+0 (secure 0 0 0) 0x7f600c0bc510 con 0x564c3bc6c770 2024-09-19T07:18:23.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.714+0000 7f601ce87740 1 -- 172.21.15.148:0/2698616444 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6004005390 con 0x564c3bc6c770 2024-09-19T07:18:23.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.714+0000 7f5ff3fff640 1 -- 172.21.15.148:0/2698616444 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f600c0b8550 con 0x564c3bc6c770 2024-09-19T07:18:23.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.714+0000 7f601ce87740 10 client.26077 fetch_fsmap learned FSMap version 41 2024-09-19T07:18:23.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.714+0000 7f601ce87740 1 -- 172.21.15.148:0/2698616444 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x564c3bd02250 con 0x564c3bc6c770 2024-09-19T07:18:23.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.714+0000 7f5ff3fff640 1 -- 172.21.15.148:0/2698616444 <== mon.1 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6004005390 con 0x564c3bc6c770 2024-09-19T07:18:23.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.714+0000 7f5ff3fff640 1 -- 172.21.15.148:0/2698616444 <== mon.1 v2:172.21.15.179:3300/0 5 ==== fsmap(e 41) ==== 8370+0+0 (secure 0 0 0) 0x7f600c04b040 con 0x564c3bc6c770 2024-09-19T07:18:23.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.715+0000 7f601ce87740 10 client.26077 fetch_fsmap finished waiting for FSMap version 41 2024-09-19T07:18:23.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.715+0000 7f601ce87740 10 client.26077 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:18:23.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.715+0000 7f601ce87740 20 client.26077 populate_metadata read hostname 'smithi148' 2024-09-19T07:18:23.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.715+0000 7f601ce87740 1 --2- 172.21.15.148:0/2698616444 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x564c3bd038d0 0x564c3bd05cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:23.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.715+0000 7f601ce87740 4 client.26077 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.75, "await_for": 45.0}] 2024-09-19T07:18:23.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.715+0000 7f601ce87740 1 -- 172.21.15.148:0/2698616444 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.75, "await_for": 45.0}) -- 0x564c3bc64410 con 0x564c3bd038d0 2024-09-19T07:18:23.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.715+0000 7f6013fff640 1 --2- 172.21.15.148:0/2698616444 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x564c3bd038d0 0x564c3bd05cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:23.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.715+0000 7f6013fff640 1 --2- 172.21.15.148:0/2698616444 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x564c3bd038d0 0x564c3bd05cf0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=851c9c2a9e3137de server_cookie=3128b65a8b15bb62 in_seq=0 out_seq=0 2024-09-19T07:18:23.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:23.715+0000 7f5ff3fff640 10 client.26077 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:18:23.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:18:23 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:18:23.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:18:23 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:18:24.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:18:23 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:18:24.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:18:24 smithi165 ceph-mon[35326]: pgmap v225: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 17 MiB/s wr, 1.14k op/s 2024-09-19T07:18:25.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:18:24 smithi179 ceph-mon[35716]: pgmap v225: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 17 MiB/s wr, 1.14k op/s 2024-09-19T07:18:25.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:18:24 smithi148 ceph-mon[31180]: pgmap v225: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 17 MiB/s wr, 1.14k op/s 2024-09-19T07:18:26.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:18:26 smithi165 ceph-mon[35326]: pgmap v226: 97 pgs: 4 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 82 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 8.6 MiB/s wr, 481 op/s 2024-09-19T07:18:27.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:18:26 smithi179 ceph-mon[35716]: pgmap v226: 97 pgs: 4 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 82 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 8.6 MiB/s wr, 481 op/s 2024-09-19T07:18:27.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:18:26 smithi148 ceph-mon[31180]: pgmap v226: 97 pgs: 4 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 82 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 8.6 MiB/s wr, 481 op/s 2024-09-19T07:18:28.179 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.176+0000 7f07d7474640 1 -- 172.21.15.148:0/2543432137 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07d01069e0 msgr2=0x7f07d0106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:28.179 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.176+0000 7f07d7474640 1 --2- 172.21.15.148:0/2543432137 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07d01069e0 0x7f07d0106dc0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f07cc009930 tx=0x7f07cc02a420 comp rx=0 tx=0).stop 2024-09-19T07:18:28.179 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.176+0000 7f07d7474640 1 -- 172.21.15.148:0/2543432137 shutdown_connections 2024-09-19T07:18:28.179 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.176+0000 7f07d7474640 1 --2- 172.21.15.148:0/2543432137 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07d0101370 0x7f07d010d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:28.179 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.176+0000 7f07d7474640 1 --2- 172.21.15.148:0/2543432137 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f07d01009d0 0x7f07d0100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:28.179 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.176+0000 7f07d7474640 1 --2- 172.21.15.148:0/2543432137 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07d01069e0 0x7f07d0106dc0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:28.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.176+0000 7f07d7474640 1 -- 172.21.15.148:0/2543432137 >> 172.21.15.148:0/2543432137 conn(0x7f07d00fc6b0 msgr2=0x7f07d00fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:18:28.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.176+0000 7f07d7474640 1 -- 172.21.15.148:0/2543432137 shutdown_connections 2024-09-19T07:18:28.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.176+0000 7f07d7474640 1 -- 172.21.15.148:0/2543432137 wait complete. 2024-09-19T07:18:28.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.177+0000 7f07d7474640 1 Processor -- start 2024-09-19T07:18:28.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.177+0000 7f07d7474640 1 -- start start 2024-09-19T07:18:28.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.177+0000 7f07d7474640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07d01009d0 0x7f07d0197260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:28.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.177+0000 7f07d7474640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07d0101370 0x7f07d01977a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:28.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.177+0000 7f07d7474640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f07d01069e0 0x7f07d019bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:28.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.177+0000 7f07d7474640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f07d0110e70 con 0x7f07d01009d0 2024-09-19T07:18:28.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.177+0000 7f07d7474640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f07d0110cf0 con 0x7f07d01069e0 2024-09-19T07:18:28.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.177+0000 7f07d7474640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f07d0110ff0 con 0x7f07d0101370 2024-09-19T07:18:28.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.177+0000 7f07d5210640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07d01009d0 0x7f07d0197260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:28.181 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.177+0000 7f07d5210640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07d01009d0 0x7f07d0197260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36902/0 (socket says 172.21.15.148:36902) 2024-09-19T07:18:28.181 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.177+0000 7f07d5210640 1 -- 172.21.15.148:0/53702264 learned_addr learned my addr 172.21.15.148:0/53702264 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:18:28.181 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.177+0000 7f07d5a11640 1 --2- 172.21.15.148:0/53702264 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f07d01069e0 0x7f07d019bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:28.181 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.177+0000 7f07d4a0f640 1 --2- 172.21.15.148:0/53702264 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07d0101370 0x7f07d01977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:28.181 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.177+0000 7f07d5210640 1 -- 172.21.15.148:0/53702264 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07d0101370 msgr2=0x7f07d01977a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:28.181 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.177+0000 7f07d5210640 1 --2- 172.21.15.148:0/53702264 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07d0101370 0x7f07d01977a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:28.181 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.177+0000 7f07d5210640 1 -- 172.21.15.148:0/53702264 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f07d01069e0 msgr2=0x7f07d019bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:28.181 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.177+0000 7f07d5210640 1 --2- 172.21.15.148:0/53702264 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f07d01069e0 0x7f07d019bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:28.181 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.177+0000 7f07d5210640 1 -- 172.21.15.148:0/53702264 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07d019c250 con 0x7f07d01009d0 2024-09-19T07:18:28.181 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.178+0000 7f07d5210640 1 --2- 172.21.15.148:0/53702264 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07d01009d0 0x7f07d0197260 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f07cc02a940 tx=0x7f07cc003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:18:28.181 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.178+0000 7f07c67fc640 1 -- 172.21.15.148:0/53702264 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07cc035070 con 0x7f07d01009d0 2024-09-19T07:18:28.181 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.178+0000 7f07c67fc640 1 -- 172.21.15.148:0/53702264 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f07cc031c90 con 0x7f07d01009d0 2024-09-19T07:18:28.181 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.178+0000 7f07d7474640 1 -- 172.21.15.148:0/53702264 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07d019c4e0 con 0x7f07d01009d0 2024-09-19T07:18:28.182 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.178+0000 7f07c67fc640 1 -- 172.21.15.148:0/53702264 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07cc039d40 con 0x7f07d01009d0 2024-09-19T07:18:28.182 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.178+0000 7f07d7474640 1 -- 172.21.15.148:0/53702264 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07d006a0c0 con 0x7f07d01009d0 2024-09-19T07:18:28.187 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.181+0000 7f07c67fc640 1 -- 172.21.15.148:0/53702264 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f07cc0394e0 con 0x7f07d01009d0 2024-09-19T07:18:28.187 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.181+0000 7f07da215740 1 Processor -- start 2024-09-19T07:18:28.188 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.181+0000 7f07da215740 1 -- start start 2024-09-19T07:18:28.188 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.182+0000 7f07da215740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5557e99ecaf0 0x5557e99eced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:28.188 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.182+0000 7f07da215740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5557e99ed410 0x5557e99f7770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:28.188 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.182+0000 7f07da215740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5557e99f7cb0 0x5557e99fa0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:28.188 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.182+0000 7f07da215740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5557e99512f0 con 0x5557e99ecaf0 2024-09-19T07:18:28.188 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.182+0000 7f07da215740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5557e98f9270 con 0x5557e99f7cb0 2024-09-19T07:18:28.188 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.182+0000 7f07da215740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5557e994d2b0 con 0x5557e99ed410 2024-09-19T07:18:28.188 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.182+0000 7f07d5210640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5557e99ed410 0x5557e99f7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:28.188 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.182+0000 7f07d4a0f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5557e99f7cb0 0x5557e99fa0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:28.188 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.182+0000 7f07d4a0f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5557e99f7cb0 0x5557e99fa0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:58894/0 (socket says 172.21.15.148:58894) 2024-09-19T07:18:28.188 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.182+0000 7f07d4a0f640 1 -- 172.21.15.148:0/2798065375 learned_addr learned my addr 172.21.15.148:0/2798065375 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:18:28.188 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.182+0000 7f07d5210640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5557e99ed410 0x5557e99f7770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:35612/0 (socket says 172.21.15.148:35612) 2024-09-19T07:18:28.189 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.182+0000 7f07c67fc640 1 --2- 172.21.15.148:0/53702264 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f07bc0a3460 0x7f07bc0a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:28.189 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.182+0000 7f07d5a11640 1 --2- 172.21.15.148:0/2798065375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5557e99ecaf0 0x5557e99eced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:28.189 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.182+0000 7f07d5210640 1 -- 172.21.15.148:0/2798065375 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5557e99f7cb0 msgr2=0x5557e99fa0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:18:28.189 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.182+0000 7f07d5210640 1 --2- 172.21.15.148:0/2798065375 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5557e99f7cb0 0x5557e99fa0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:28.189 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.182+0000 7f07d5210640 1 -- 172.21.15.148:0/2798065375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5557e99ecaf0 msgr2=0x5557e99eced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:18:28.189 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.182+0000 7f07d5210640 1 --2- 172.21.15.148:0/2798065375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5557e99ecaf0 0x5557e99eced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:28.189 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.182+0000 7f07d5210640 1 -- 172.21.15.148:0/2798065375 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557e98f8340 con 0x5557e99ed410 2024-09-19T07:18:28.189 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.182+0000 7f07c67fc640 1 -- 172.21.15.148:0/53702264 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8600+0+0 (secure 0 0 0) 0x7f07cc0f1f40 con 0x7f07d01009d0 2024-09-19T07:18:28.189 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.182+0000 7f07d5a11640 1 --2- 172.21.15.148:0/53702264 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f07bc0a3460 0x7f07bc0a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:28.189 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.182+0000 7f07d5210640 1 --2- 172.21.15.148:0/2798065375 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5557e99ed410 0x5557e99f7770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f07cc0ef640 tx=0x7f07cc04c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7921f1256237a9d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:18:28.189 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.183+0000 7f07bb7fe640 1 -- 172.21.15.148:0/2798065375 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07cc0bdb30 con 0x5557e99ed410 2024-09-19T07:18:28.189 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.183+0000 7f07bb7fe640 1 -- 172.21.15.148:0/2798065375 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f07cc031e40 con 0x5557e99ed410 2024-09-19T07:18:28.189 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.183+0000 7f07bb7fe640 1 -- 172.21.15.148:0/2798065375 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07cc0be8d0 con 0x5557e99ed410 2024-09-19T07:18:28.190 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.184+0000 7f07da215740 1 -- 172.21.15.148:0/2798065375 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5557e99ed410 msgr2=0x5557e99f7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:28.190 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.184+0000 7f07d5a11640 1 --2- 172.21.15.148:0/53702264 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f07bc0a3460 0x7f07bc0a5920 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f07c8005fd0 tx=0x7f07c8004ab0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:18:28.190 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.184+0000 7f07da215740 1 --2- 172.21.15.148:0/2798065375 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5557e99ed410 0x5557e99f7770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f07cc0ef640 tx=0x7f07cc04c000 comp rx=0 tx=0).stop 2024-09-19T07:18:28.190 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.184+0000 7f07da215740 1 -- 172.21.15.148:0/2798065375 shutdown_connections 2024-09-19T07:18:28.190 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.184+0000 7f07da215740 1 --2- 172.21.15.148:0/2798065375 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5557e99f7cb0 0x5557e99fa0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:28.190 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.184+0000 7f07da215740 1 --2- 172.21.15.148:0/2798065375 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5557e99ed410 0x5557e99f7770 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:28.190 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.184+0000 7f07da215740 1 --2- 172.21.15.148:0/2798065375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5557e99ecaf0 0x5557e99eced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:28.190 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.184+0000 7f07da215740 1 -- 172.21.15.148:0/2798065375 >> 172.21.15.148:0/2798065375 conn(0x5557e99e9060 msgr2=0x5557e99e9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:18:28.190 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.184+0000 7f07da215740 1 -- 172.21.15.148:0/2798065375 shutdown_connections 2024-09-19T07:18:28.190 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.184+0000 7f07da215740 1 -- 172.21.15.148:0/2798065375 wait complete. 2024-09-19T07:18:28.190 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.184+0000 7f07da215740 1 -- start start 2024-09-19T07:18:28.190 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.184+0000 7f07da215740 1 Processor -- start 2024-09-19T07:18:28.190 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.185+0000 7f07da215740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5557e99ecaf0 0x5557e99f4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:28.191 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.185+0000 7f07da215740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5557e99f7cb0 0x5557e99f5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:28.191 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.185+0000 7f07da215740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5557e99f5780 0x5557e9a0c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:28.191 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.185+0000 7f07da215740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5557e994d2b0 con 0x5557e99f5780 2024-09-19T07:18:28.191 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.185+0000 7f07da215740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5557e98da290 con 0x5557e99f7cb0 2024-09-19T07:18:28.191 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.185+0000 7f07da215740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5557e99fa640 con 0x5557e99ecaf0 2024-09-19T07:18:28.191 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.185+0000 7f07da215740 10 client.0 _ll_register_callbacks cb 0x5557e990b140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:18:28.191 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.185+0000 7f07d4a0f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5557e99f7cb0 0x5557e99f5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:28.191 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.185+0000 7f07d5a11640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5557e99f5780 0x5557e9a0c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:28.191 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.185+0000 7f07d4a0f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5557e99f7cb0 0x5557e99f5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:58906/0 (socket says 172.21.15.148:58906) 2024-09-19T07:18:28.191 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.185+0000 7f07d4a0f640 1 -- 172.21.15.148:0/1430244604 learned_addr learned my addr 172.21.15.148:0/1430244604 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:18:28.191 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.185+0000 7f07d5210640 1 --2- 172.21.15.148:0/1430244604 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5557e99ecaf0 0x5557e99f4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:28.191 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.185+0000 7f07d4a0f640 1 -- 172.21.15.148:0/1430244604 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5557e99ecaf0 msgr2=0x5557e99f4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:18:28.191 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.185+0000 7f07d4a0f640 1 --2- 172.21.15.148:0/1430244604 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5557e99ecaf0 0x5557e99f4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:28.192 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.185+0000 7f07d4a0f640 1 -- 172.21.15.148:0/1430244604 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5557e99f5780 msgr2=0x5557e9a0c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:18:28.192 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.185+0000 7f07d4a0f640 1 --2- 172.21.15.148:0/1430244604 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5557e99f5780 0x5557e9a0c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:28.192 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.185+0000 7f07d4a0f640 1 -- 172.21.15.148:0/1430244604 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557e9664210 con 0x5557e99f7cb0 2024-09-19T07:18:28.192 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.186+0000 7f07d5a11640 1 --2- 172.21.15.148:0/1430244604 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5557e99f5780 0x5557e9a0c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:18:28.192 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.186+0000 7f07d5210640 1 --2- 172.21.15.148:0/1430244604 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5557e99ecaf0 0x5557e99f4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:18:28.192 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.186+0000 7f07d4a0f640 1 --2- 172.21.15.148:0/1430244604 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5557e99f7cb0 0x5557e99f5240 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f07c000bf60 tx=0x7f07c000bf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27434b0dc8dc45f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:18:28.192 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.186+0000 7f07b8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-19T07:18:28.192 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.186+0000 7f07b8ff9640 1 -- 172.21.15.148:0/1430244604 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c0004020 con 0x5557e99f7cb0 2024-09-19T07:18:28.192 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.186+0000 7f07b8ff9640 1 -- 172.21.15.148:0/1430244604 <== mon.2 v2:172.21.15.165:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8600+0+0 (secure 0 0 0) 0x7f07c00041c0 con 0x5557e99f7cb0 2024-09-19T07:18:28.192 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.186+0000 7f07da215740 1 -- 172.21.15.148:0/1430244604 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5557e995ea20 con 0x5557e99f7cb0 2024-09-19T07:18:28.192 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.186+0000 7f07b8ff9640 1 -- 172.21.15.148:0/1430244604 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f07c00043c0 con 0x5557e99f7cb0 2024-09-19T07:18:28.192 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.186+0000 7f07da215740 10 client.25985 fetch_fsmap learned FSMap version 41 2024-09-19T07:18:28.192 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.186+0000 7f07da215740 1 -- 172.21.15.148:0/1430244604 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x5557e9730620 con 0x5557e99f7cb0 2024-09-19T07:18:28.192 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.186+0000 7f07b8ff9640 1 -- 172.21.15.148:0/1430244604 <== mon.2 v2:172.21.15.165:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5557e995ea20 con 0x5557e99f7cb0 2024-09-19T07:18:28.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.187+0000 7f07b8ff9640 1 -- 172.21.15.148:0/1430244604 <== mon.2 v2:172.21.15.165:3300/0 5 ==== fsmap(e 41) ==== 8370+0+0 (secure 0 0 0) 0x7f07c0003a60 con 0x5557e99f7cb0 2024-09-19T07:18:28.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.187+0000 7f07da215740 10 client.25985 fetch_fsmap finished waiting for FSMap version 41 2024-09-19T07:18:28.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.187+0000 7f07da215740 10 client.25985 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:18:28.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.187+0000 7f07da215740 20 client.25985 populate_metadata read hostname 'smithi148' 2024-09-19T07:18:28.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.187+0000 7f07da215740 1 --2- 172.21.15.148:0/1430244604 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5557e9a10510 0x5557e9a12960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:28.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.187+0000 7f07da215740 4 client.25985 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:18:28.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.187+0000 7f07da215740 1 -- 172.21.15.148:0/1430244604 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5557e9958d70 con 0x5557e9a10510 2024-09-19T07:18:28.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.187+0000 7f07d5210640 1 --2- 172.21.15.148:0/1430244604 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5557e9a10510 0x5557e9a12960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:28.194 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.187+0000 7f07b8ff9640 10 client.25985 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:18:28.194 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.187+0000 7f07d5210640 1 --2- 172.21.15.148:0/1430244604 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5557e9a10510 0x5557e9a12960 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b5660a03a6b8498 server_cookie=72c315d7809354c1 in_seq=0 out_seq=0 2024-09-19T07:18:28.194 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.188+0000 7f07b8ff9640 1 -- 172.21.15.148:0/1430244604 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5557e9958d70 con 0x5557e9a10510 2024-09-19T07:18:28.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.188+0000 7f07b8ff9640 10 client.25985 handle_command_reply: tid=0 2024-09-19T07:18:28.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.188+0000 7f07da215740 1 client.25985 shutdown 2024-09-19T07:18:28.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.189+0000 7f07da215740 1 -- 172.21.15.148:0/1430244604 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5557e99f7cb0 msgr2=0x5557e99f5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:28.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.189+0000 7f07da215740 1 --2- 172.21.15.148:0/1430244604 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5557e99f7cb0 0x5557e99f5240 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f07c000bf60 tx=0x7f07c000bf90 comp rx=0 tx=0).stop 2024-09-19T07:18:28.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.189+0000 7f07da215740 1 -- 172.21.15.148:0/1430244604 shutdown_connections 2024-09-19T07:18:28.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.189+0000 7f07da215740 1 --2- 172.21.15.148:0/1430244604 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5557e9a10510 0x5557e9a12960 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:28.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.189+0000 7f07da215740 1 --2- 172.21.15.148:0/1430244604 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5557e99f5780 0x5557e9a0c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:28.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.189+0000 7f07da215740 1 --2- 172.21.15.148:0/1430244604 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5557e99f7cb0 0x5557e99f5240 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:28.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.189+0000 7f07da215740 1 --2- 172.21.15.148:0/1430244604 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5557e99ecaf0 0x5557e99f4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:28.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.189+0000 7f07b8ff9640 0 client.25985 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:18:28.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.189+0000 7f07da215740 1 -- 172.21.15.148:0/1430244604 >> 172.21.15.148:0/1430244604 conn(0x5557e99e9060 msgr2=0x5557e99eedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:18:28.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.189+0000 7f07da215740 1 -- 172.21.15.148:0/1430244604 shutdown_connections 2024-09-19T07:18:28.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.189+0000 7f07da215740 1 -- 172.21.15.148:0/1430244604 wait complete. 2024-09-19T07:18:28.196 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.189+0000 7f07da215740 20 client.25985 trim_cache size 0 max 16384 2024-09-19T07:18:28.212 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.210+0000 7f07da215740 1 Processor -- start 2024-09-19T07:18:28.212 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.211+0000 7f07da215740 1 -- start start 2024-09-19T07:18:28.212 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.211+0000 7f07da215740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5557e99ecaf0 0x5557e9a0bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:28.212 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.211+0000 7f07da215740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5557e99f5780 0x5557e9a18270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:28.212 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.211+0000 7f07da215740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5557e99f7cb0 0x5557e9a187b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:28.212 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.211+0000 7f07da215740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f07d01adfd0 con 0x5557e99f7cb0 2024-09-19T07:18:28.212 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.211+0000 7f07da215740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f07d01ab7e0 con 0x5557e99f5780 2024-09-19T07:18:28.212 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.211+0000 7f07da215740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f07d01a9650 con 0x5557e99ecaf0 2024-09-19T07:18:28.212 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.211+0000 7f07d5a11640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5557e99f7cb0 0x5557e9a187b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:28.212 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.211+0000 7f07d5a11640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5557e99f7cb0 0x5557e9a187b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36920/0 (socket says 172.21.15.148:36920) 2024-09-19T07:18:28.213 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.211+0000 7f07d5a11640 1 -- 172.21.15.148:0/3197705977 learned_addr learned my addr 172.21.15.148:0/3197705977 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:18:28.213 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.211+0000 7f07d4a0f640 1 --2- 172.21.15.148:0/3197705977 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5557e99f5780 0x5557e9a18270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:28.213 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.211+0000 7f07d5210640 1 --2- 172.21.15.148:0/3197705977 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5557e99ecaf0 0x5557e9a0bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:28.217 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.211+0000 7f07d5a11640 1 -- 172.21.15.148:0/3197705977 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5557e99ecaf0 msgr2=0x5557e9a0bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:18:28.217 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.211+0000 7f07d5a11640 1 --2- 172.21.15.148:0/3197705977 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5557e99ecaf0 0x5557e9a0bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:28.217 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.211+0000 7f07d5a11640 1 -- 172.21.15.148:0/3197705977 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5557e99f5780 msgr2=0x5557e9a18270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:18:28.217 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.211+0000 7f07d5a11640 1 --2- 172.21.15.148:0/3197705977 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5557e99f5780 0x5557e9a18270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:28.217 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.211+0000 7f07d5a11640 1 -- 172.21.15.148:0/3197705977 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557e99f7850 con 0x5557e99f7cb0 2024-09-19T07:18:28.217 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.211+0000 7f07d4a0f640 1 --2- 172.21.15.148:0/3197705977 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5557e99f5780 0x5557e9a18270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:18:28.217 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.212+0000 7f07d5a11640 1 --2- 172.21.15.148:0/3197705977 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5557e99f7cb0 0x5557e9a187b0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f07c8013430 tx=0x7f07c801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c058baef0151abe0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:18:28.217 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.212+0000 7f07baffd640 1 -- 172.21.15.148:0/3197705977 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c802e070 con 0x5557e99f7cb0 2024-09-19T07:18:28.217 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.212+0000 7f07baffd640 1 -- 172.21.15.148:0/3197705977 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f07c8029410 con 0x5557e99f7cb0 2024-09-19T07:18:28.218 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.212+0000 7f07baffd640 1 -- 172.21.15.148:0/3197705977 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c8020600 con 0x5557e99f7cb0 2024-09-19T07:18:28.218 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.213+0000 7f07da215740 1 -- 172.21.15.148:0/3197705977 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5557e99f7cb0 msgr2=0x5557e9a187b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:28.218 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.213+0000 7f07da215740 1 --2- 172.21.15.148:0/3197705977 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5557e99f7cb0 0x5557e9a187b0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f07c8013430 tx=0x7f07c801a000 comp rx=0 tx=0).stop 2024-09-19T07:18:28.218 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.213+0000 7f07da215740 1 -- 172.21.15.148:0/3197705977 shutdown_connections 2024-09-19T07:18:28.218 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.213+0000 7f07da215740 1 --2- 172.21.15.148:0/3197705977 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5557e99f7cb0 0x5557e9a187b0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:28.218 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.213+0000 7f07da215740 1 --2- 172.21.15.148:0/3197705977 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5557e99f5780 0x5557e9a18270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:28.218 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.213+0000 7f07da215740 1 --2- 172.21.15.148:0/3197705977 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5557e99ecaf0 0x5557e9a0bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:28.218 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.213+0000 7f07da215740 1 -- 172.21.15.148:0/3197705977 >> 172.21.15.148:0/3197705977 conn(0x5557e99e9060 msgr2=0x5557e99f35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:18:28.218 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.213+0000 7f07da215740 1 -- 172.21.15.148:0/3197705977 shutdown_connections 2024-09-19T07:18:28.218 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.213+0000 7f07da215740 1 -- 172.21.15.148:0/3197705977 wait complete. 2024-09-19T07:18:28.218 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.213+0000 7f07da215740 1 -- start start 2024-09-19T07:18:28.218 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.213+0000 7f07da215740 1 Processor -- start 2024-09-19T07:18:28.218 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.214+0000 7f07da215740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5557e99ecaf0 0x5557e9a087c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:28.219 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.214+0000 7f07da215740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5557e99f5780 0x5557e9a03ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:28.219 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.214+0000 7f07da215740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5557e99f7cb0 0x5557e9a04020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:28.219 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.214+0000 7f07da215740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f07d01a9ca0 con 0x5557e99f5780 2024-09-19T07:18:28.219 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.214+0000 7f07da215740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f07d01ab110 con 0x5557e99f7cb0 2024-09-19T07:18:28.219 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.214+0000 7f07da215740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f07d01aa370 con 0x5557e99ecaf0 2024-09-19T07:18:28.219 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.214+0000 7f07da215740 10 client.0 _ll_register_callbacks cb 0x7f07c0005d00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:18:28.219 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.214+0000 7f07d4a0f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5557e99f5780 0x5557e9a03ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:28.219 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.214+0000 7f07d5210640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5557e99ecaf0 0x5557e9a087c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:28.219 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.214+0000 7f07d4a0f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5557e99f5780 0x5557e9a03ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36936/0 (socket says 172.21.15.148:36936) 2024-09-19T07:18:28.219 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.214+0000 7f07d4a0f640 1 -- 172.21.15.148:0/3130159289 learned_addr learned my addr 172.21.15.148:0/3130159289 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:18:28.219 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.214+0000 7f07d5210640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5557e99ecaf0 0x5557e9a087c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:35632/0 (socket says 172.21.15.148:35632) 2024-09-19T07:18:28.219 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.214+0000 7f07d5a11640 1 --2- 172.21.15.148:0/3130159289 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5557e99f7cb0 0x5557e9a04020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:28.219 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.214+0000 7f07d4a0f640 1 -- 172.21.15.148:0/3130159289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5557e99ecaf0 msgr2=0x5557e9a087c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:18:28.220 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.214+0000 7f07d4a0f640 1 --2- 172.21.15.148:0/3130159289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5557e99ecaf0 0x5557e9a087c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:28.220 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.214+0000 7f07d4a0f640 1 -- 172.21.15.148:0/3130159289 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5557e99f7cb0 msgr2=0x5557e9a04020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:18:28.220 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.214+0000 7f07d4a0f640 1 --2- 172.21.15.148:0/3130159289 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5557e99f7cb0 0x5557e9a04020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:28.220 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.214+0000 7f07d4a0f640 1 -- 172.21.15.148:0/3130159289 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557e9a04820 con 0x5557e99f5780 2024-09-19T07:18:28.220 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.214+0000 7f07d4a0f640 1 --2- 172.21.15.148:0/3130159289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5557e99f5780 0x5557e9a03ae0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x5557e99f4570 tx=0x7f07c000b500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9d39cf2407ee586 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:18:28.220 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.214+0000 7f07b8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:18:28.220 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.214+0000 7f07b8ff9640 1 -- 172.21.15.148:0/3130159289 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c0005040 con 0x5557e99f5780 2024-09-19T07:18:28.220 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.214+0000 7f07da215740 1 -- 172.21.15.148:0/3130159289 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07c8029410 con 0x5557e99f5780 2024-09-19T07:18:28.220 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.214+0000 7f07b8ff9640 1 -- 172.21.15.148:0/3130159289 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8600+0+0 (secure 0 0 0) 0x7f07c00051e0 con 0x5557e99f5780 2024-09-19T07:18:28.220 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.215+0000 7f07b8ff9640 1 -- 172.21.15.148:0/3130159289 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f07c003a050 con 0x5557e99f5780 2024-09-19T07:18:28.220 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.215+0000 7f07da215740 10 client.16713 fetch_fsmap learned FSMap version 41 2024-09-19T07:18:28.220 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.215+0000 7f07da215740 1 -- 172.21.15.148:0/3130159289 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x5557e9a7b220 con 0x5557e99f5780 2024-09-19T07:18:28.220 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.215+0000 7f07b8ff9640 1 -- 172.21.15.148:0/3130159289 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f07c8029410 con 0x5557e99f5780 2024-09-19T07:18:28.221 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.215+0000 7f07b8ff9640 1 -- 172.21.15.148:0/3130159289 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 41) ==== 8370+0+0 (secure 0 0 0) 0x7f07c0003a00 con 0x5557e99f5780 2024-09-19T07:18:28.221 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.215+0000 7f07da215740 10 client.16713 fetch_fsmap finished waiting for FSMap version 41 2024-09-19T07:18:28.221 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.215+0000 7f07da215740 10 client.16713 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:18:28.221 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.215+0000 7f07da215740 20 client.16713 populate_metadata read hostname 'smithi148' 2024-09-19T07:18:28.221 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.215+0000 7f07da215740 1 --2- 172.21.15.148:0/3130159289 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5557e9a7b9f0 0x5557e9a7de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:28.221 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.215+0000 7f07da215740 4 client.16713 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:18:28.221 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.215+0000 7f07da215740 1 -- 172.21.15.148:0/3130159289 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5557e98d5900 con 0x5557e9a7b9f0 2024-09-19T07:18:28.221 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.215+0000 7f07d5210640 1 --2- 172.21.15.148:0/3130159289 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5557e9a7b9f0 0x5557e9a7de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:28.221 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.216+0000 7f07b8ff9640 10 client.16713 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:18:28.221 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:28.216+0000 7f07d5210640 1 --2- 172.21.15.148:0/3130159289 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5557e9a7b9f0 0x5557e9a7de10 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d82968e3acc8bbe server_cookie=cf98fc094b351cae in_seq=0 out_seq=0 2024-09-19T07:18:28.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:18:28 smithi165 ceph-mon[35326]: pgmap v227: 97 pgs: 4 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 82 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 8.0 MiB/s wr, 445 op/s 2024-09-19T07:18:29.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:18:28 smithi179 ceph-mon[35716]: pgmap v227: 97 pgs: 4 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 82 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 8.0 MiB/s wr, 445 op/s 2024-09-19T07:18:29.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:18:28 smithi148 ceph-mon[31180]: pgmap v227: 97 pgs: 4 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 82 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 8.0 MiB/s wr, 445 op/s 2024-09-19T07:18:29.700 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:29.698+0000 7f07b8ff9640 1 -- 172.21.15.148:0/3130159289 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5557e98d5900 con 0x5557e9a7b9f0 2024-09-19T07:18:29.700 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:29.698+0000 7f07b8ff9640 10 client.16713 handle_command_reply: tid=0 2024-09-19T07:18:29.700 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:29.698+0000 7f07da215740 1 client.16713 shutdown 2024-09-19T07:18:29.700 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:29.699+0000 7f07da215740 1 -- 172.21.15.148:0/3130159289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5557e99f5780 msgr2=0x5557e9a03ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:29.701 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:29.699+0000 7f07da215740 1 --2- 172.21.15.148:0/3130159289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5557e99f5780 0x5557e9a03ae0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x5557e99f4570 tx=0x7f07c000b500 comp rx=0 tx=0).stop 2024-09-19T07:18:29.701 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:29.699+0000 7f07da215740 1 -- 172.21.15.148:0/3130159289 shutdown_connections 2024-09-19T07:18:29.701 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:29.699+0000 7f07da215740 1 --2- 172.21.15.148:0/3130159289 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5557e9a7b9f0 0x5557e9a7de10 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:29.701 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:29.699+0000 7f07b8ff9640 0 client.16713 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:18:29.701 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:29.699+0000 7f07da215740 1 --2- 172.21.15.148:0/3130159289 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5557e99f7cb0 0x5557e9a04020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:29.701 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:29.699+0000 7f07da215740 1 --2- 172.21.15.148:0/3130159289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5557e99f5780 0x5557e9a03ae0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:29.701 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:29.699+0000 7f07da215740 1 --2- 172.21.15.148:0/3130159289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5557e99ecaf0 0x5557e9a087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:29.701 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:29.699+0000 7f07da215740 1 -- 172.21.15.148:0/3130159289 >> 172.21.15.148:0/3130159289 conn(0x5557e99e9060 msgr2=0x5557e99e79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:18:29.701 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:29.699+0000 7f07da215740 1 -- 172.21.15.148:0/3130159289 shutdown_connections 2024-09-19T07:18:29.701 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:29.699+0000 7f07da215740 1 -- 172.21.15.148:0/3130159289 wait complete. 2024-09-19T07:18:29.701 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:29.699+0000 7f07da215740 20 client.16713 trim_cache size 0 max 16384 2024-09-19T07:18:29.702 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:18:29.702 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:18:29.702 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:18:29.702 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:18:29.702 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:29.700+0000 7f07d7474640 1 -- 172.21.15.148:0/53702264 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f07bc0a3460 msgr2=0x7f07bc0a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:29.703 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:29.700+0000 7f07d7474640 1 --2- 172.21.15.148:0/53702264 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f07bc0a3460 0x7f07bc0a5920 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f07c8005fd0 tx=0x7f07c8004ab0 comp rx=0 tx=0).stop 2024-09-19T07:18:29.703 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:29.700+0000 7f07d7474640 1 -- 172.21.15.148:0/53702264 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07d01009d0 msgr2=0x7f07d0197260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:29.703 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:29.700+0000 7f07d7474640 1 --2- 172.21.15.148:0/53702264 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07d01009d0 0x7f07d0197260 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f07cc02a940 tx=0x7f07cc003b90 comp rx=0 tx=0).stop 2024-09-19T07:18:29.703 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:29.700+0000 7f07d7474640 1 -- 172.21.15.148:0/53702264 shutdown_connections 2024-09-19T07:18:29.703 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:29.700+0000 7f07d7474640 1 --2- 172.21.15.148:0/53702264 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f07bc0a3460 0x7f07bc0a5920 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:29.703 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:29.700+0000 7f07d7474640 1 --2- 172.21.15.148:0/53702264 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f07d01069e0 0x7f07d019bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:29.703 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:29.700+0000 7f07d7474640 1 --2- 172.21.15.148:0/53702264 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07d0101370 0x7f07d01977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:29.703 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:29.700+0000 7f07d7474640 1 --2- 172.21.15.148:0/53702264 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07d01009d0 0x7f07d0197260 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:29.703 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:29.700+0000 7f07d7474640 1 -- 172.21.15.148:0/53702264 >> 172.21.15.148:0/53702264 conn(0x7f07d00fc6b0 msgr2=0x7f07d00fcd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:18:29.703 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:29.700+0000 7f07d7474640 1 -- 172.21.15.148:0/53702264 shutdown_connections 2024-09-19T07:18:29.703 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:29.700+0000 7f07d7474640 1 -- 172.21.15.148:0/53702264 wait complete. 2024-09-19T07:18:30.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:18:30 smithi165 ceph-mon[35326]: pgmap v228: 97 pgs: 97 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 7.2 MiB/s wr, 429 op/s 2024-09-19T07:18:31.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:18:30 smithi179 ceph-mon[35716]: pgmap v228: 97 pgs: 97 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 7.2 MiB/s wr, 429 op/s 2024-09-19T07:18:31.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:18:30 smithi148 ceph-mon[31180]: pgmap v228: 97 pgs: 97 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 7.2 MiB/s wr, 429 op/s 2024-09-19T07:18:32.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:18:32 smithi148 ceph-mon[31180]: pgmap v229: 97 pgs: 97 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 6.8 MiB/s wr, 999 op/s 2024-09-19T07:18:32.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:18:32 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:18:32.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:18:32 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:18:32.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:18:32 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:18:32.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:18:32 smithi165 ceph-mon[35326]: pgmap v229: 97 pgs: 97 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 6.8 MiB/s wr, 999 op/s 2024-09-19T07:18:32.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:18:32 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:18:32.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:18:32 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:18:32.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:18:32 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:18:33.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:18:32 smithi179 ceph-mon[35716]: pgmap v229: 97 pgs: 97 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 6.8 MiB/s wr, 999 op/s 2024-09-19T07:18:33.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:18:32 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:18:33.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:18:32 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:18:33.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:18:32 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:18:34.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:18:34 smithi148 ceph-mon[31180]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T07:18:34.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:18:34 smithi148 ceph-mon[31180]: pgmap v231: 97 pgs: 97 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.8 MiB/s wr, 1.09k op/s 2024-09-19T07:18:34.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:18:34 smithi165 ceph-mon[35326]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T07:18:34.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:18:34 smithi165 ceph-mon[35326]: pgmap v231: 97 pgs: 97 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.8 MiB/s wr, 1.09k op/s 2024-09-19T07:18:34.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:18:34 smithi179 ceph-mon[35716]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T07:18:34.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:18:34 smithi179 ceph-mon[35716]: pgmap v231: 97 pgs: 97 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.8 MiB/s wr, 1.09k op/s 2024-09-19T07:18:36.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:18:36 smithi179 ceph-mon[35716]: pgmap v232: 97 pgs: 97 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.4 MiB/s wr, 1.60k op/s 2024-09-19T07:18:36.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:18:36 smithi148 ceph-mon[31180]: pgmap v232: 97 pgs: 97 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.4 MiB/s wr, 1.60k op/s 2024-09-19T07:18:36.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:18:36 smithi165 ceph-mon[35326]: pgmap v232: 97 pgs: 97 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.4 MiB/s wr, 1.60k op/s 2024-09-19T07:18:38.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:18:38 smithi179 ceph-mon[35716]: pgmap v233: 97 pgs: 97 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.4 MiB/s wr, 1.60k op/s 2024-09-19T07:18:38.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:18:38 smithi148 ceph-mon[31180]: pgmap v233: 97 pgs: 97 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.4 MiB/s wr, 1.60k op/s 2024-09-19T07:18:38.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:18:38 smithi165 ceph-mon[35326]: pgmap v233: 97 pgs: 97 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.4 MiB/s wr, 1.60k op/s 2024-09-19T07:18:40.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:18:40 smithi179 ceph-mon[35716]: pgmap v234: 97 pgs: 97 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.5 MiB/s wr, 1.58k op/s 2024-09-19T07:18:40.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:18:40 smithi148 ceph-mon[31180]: pgmap v234: 97 pgs: 97 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.5 MiB/s wr, 1.58k op/s 2024-09-19T07:18:40.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:18:40 smithi165 ceph-mon[35326]: pgmap v234: 97 pgs: 97 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.5 MiB/s wr, 1.58k op/s 2024-09-19T07:18:42.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:18:42 smithi179 ceph-mon[35716]: pgmap v235: 97 pgs: 97 active+clean; 1.7 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.3 MiB/s wr, 1.12k op/s 2024-09-19T07:18:42.796 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.795+0000 7f1eb4513640 1 -- 172.21.15.148:0/143781159 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1eac1069c0 msgr2=0x7f1eac106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:42.796 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.795+0000 7f1eb4513640 1 --2- 172.21.15.148:0/143781159 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1eac1069c0 0x7f1eac106da0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8009930 tx=0x7f1ea802a420 comp rx=0 tx=0).stop 2024-09-19T07:18:42.797 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.795+0000 7f1eb4513640 1 -- 172.21.15.148:0/143781159 shutdown_connections 2024-09-19T07:18:42.797 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.795+0000 7f1eb4513640 1 --2- 172.21.15.148:0/143781159 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1eac101350 0x7f1eac10d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:42.797 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.795+0000 7f1eb4513640 1 --2- 172.21.15.148:0/143781159 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1eac1009b0 0x7f1eac100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:42.797 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.795+0000 7f1eb4513640 1 --2- 172.21.15.148:0/143781159 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1eac1069c0 0x7f1eac106da0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:42.797 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.795+0000 7f1eb4513640 1 -- 172.21.15.148:0/143781159 >> 172.21.15.148:0/143781159 conn(0x7f1eac077990 msgr2=0x7f1eac0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:18:42.797 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.795+0000 7f1eb4513640 1 -- 172.21.15.148:0/143781159 shutdown_connections 2024-09-19T07:18:42.797 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.795+0000 7f1eb4513640 1 -- 172.21.15.148:0/143781159 wait complete. 2024-09-19T07:18:42.797 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.796+0000 7f1eb4513640 1 Processor -- start 2024-09-19T07:18:42.797 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.796+0000 7f1eb4513640 1 -- start start 2024-09-19T07:18:42.799 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.796+0000 7f1eb4513640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1eac1009b0 0x7f1eac197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:42.799 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.796+0000 7f1eb4513640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1eac101350 0x7f1eac1977b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:42.799 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.796+0000 7f1eb4513640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1eac1069c0 0x7f1eac19bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:42.799 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.796+0000 7f1eb4513640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1eac110dc0 con 0x7f1eac1069c0 2024-09-19T07:18:42.799 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.796+0000 7f1eb4513640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1eac110c40 con 0x7f1eac101350 2024-09-19T07:18:42.799 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.796+0000 7f1eb4513640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1eac110f40 con 0x7f1eac1009b0 2024-09-19T07:18:42.799 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.796+0000 7f1eb22af640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1eac1009b0 0x7f1eac197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:42.800 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.796+0000 7f1eb22af640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1eac1009b0 0x7f1eac197270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:50352/0 (socket says 172.21.15.148:50352) 2024-09-19T07:18:42.800 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.796+0000 7f1eb2ab0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1eac1069c0 0x7f1eac19bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:42.800 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.796+0000 7f1eb22af640 1 -- 172.21.15.148:0/3613212209 learned_addr learned my addr 172.21.15.148:0/3613212209 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:18:42.800 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.796+0000 7f1eb1aae640 1 --2- 172.21.15.148:0/3613212209 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1eac101350 0x7f1eac1977b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:42.800 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.797+0000 7f1eb2ab0640 1 -- 172.21.15.148:0/3613212209 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1eac1009b0 msgr2=0x7f1eac197270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:42.800 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.797+0000 7f1eb2ab0640 1 --2- 172.21.15.148:0/3613212209 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1eac1009b0 0x7f1eac197270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:42.800 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.797+0000 7f1eb2ab0640 1 -- 172.21.15.148:0/3613212209 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1eac101350 msgr2=0x7f1eac1977b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:42.800 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.797+0000 7f1eb2ab0640 1 --2- 172.21.15.148:0/3613212209 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1eac101350 0x7f1eac1977b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:42.800 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.797+0000 7f1eb2ab0640 1 -- 172.21.15.148:0/3613212209 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1eac19c260 con 0x7f1eac1069c0 2024-09-19T07:18:42.800 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.797+0000 7f1eb1aae640 1 --2- 172.21.15.148:0/3613212209 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1eac101350 0x7f1eac1977b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:18:42.800 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.797+0000 7f1eb22af640 1 --2- 172.21.15.148:0/3613212209 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1eac1009b0 0x7f1eac197270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:18:42.800 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.797+0000 7f1eb2ab0640 1 --2- 172.21.15.148:0/3613212209 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1eac1069c0 0x7f1eac19bb30 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f1ea4009fd0 tx=0x7f1ea400ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:18:42.800 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.797+0000 7f1ea37fe640 1 -- 172.21.15.148:0/3613212209 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea400ce20 con 0x7f1eac1069c0 2024-09-19T07:18:42.801 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.797+0000 7f1ea37fe640 1 -- 172.21.15.148:0/3613212209 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ea4005020 con 0x7f1eac1069c0 2024-09-19T07:18:42.801 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.797+0000 7f1eb4513640 1 -- 172.21.15.148:0/3613212209 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1eac19c550 con 0x7f1eac1069c0 2024-09-19T07:18:42.801 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.797+0000 7f1ea37fe640 1 -- 172.21.15.148:0/3613212209 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea4010720 con 0x7f1eac1069c0 2024-09-19T07:18:42.801 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.797+0000 7f1eb4513640 1 -- 172.21.15.148:0/3613212209 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1eac0698a0 con 0x7f1eac1069c0 2024-09-19T07:18:42.807 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.799+0000 7f1ea37fe640 1 -- 172.21.15.148:0/3613212209 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f1ea4005540 con 0x7f1eac1069c0 2024-09-19T07:18:42.807 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.800+0000 7f1eb72a3740 1 Processor -- start 2024-09-19T07:18:42.807 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.801+0000 7f1ea37fe640 1 --2- 172.21.15.148:0/3613212209 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f1e980a34e0 0x7f1e980a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:42.807 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.801+0000 7f1eb72a3740 1 -- start start 2024-09-19T07:18:42.807 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.801+0000 7f1eb72a3740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561cc4f97af0 0x561cc4f97ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:42.807 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.801+0000 7f1eb72a3740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cc4f98410 0x561cc4fa2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:42.807 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.801+0000 7f1eb72a3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561cc4fa2cb0 0x561cc4fa50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:42.807 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.801+0000 7f1eb72a3740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x561cc4efc2f0 con 0x561cc4f98410 2024-09-19T07:18:42.807 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.801+0000 7f1eb72a3740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x561cc4ea4270 con 0x561cc4f97af0 2024-09-19T07:18:42.808 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.801+0000 7f1eb72a3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x561cc4ef82b0 con 0x561cc4fa2cb0 2024-09-19T07:18:42.808 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.801+0000 7f1eb1aae640 1 --2- 172.21.15.148:0/3613212209 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f1e980a34e0 0x7f1e980a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:42.808 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.801+0000 7f1eb1aae640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cc4f98410 0x561cc4fa2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:42.808 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.801+0000 7f1ea37fe640 1 -- 172.21.15.148:0/3613212209 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8556+0+0 (secure 0 0 0) 0x7f1ea40d03b0 con 0x7f1eac1069c0 2024-09-19T07:18:42.808 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.801+0000 7f1eb2ab0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561cc4fa2cb0 0x561cc4fa50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:42.808 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.801+0000 7f1eb1aae640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cc4f98410 0x561cc4fa2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60980/0 (socket says 172.21.15.148:60980) 2024-09-19T07:18:42.808 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.801+0000 7f1eb1aae640 1 -- 172.21.15.148:0/4109391251 learned_addr learned my addr 172.21.15.148:0/4109391251 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:18:42.808 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.801+0000 7f1eb22af640 1 --2- 172.21.15.148:0/4109391251 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561cc4f97af0 0x561cc4f97ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:42.808 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.801+0000 7f1eb2ab0640 1 -- 172.21.15.148:0/4109391251 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561cc4f97af0 msgr2=0x561cc4f97ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:18:42.808 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.801+0000 7f1eb2ab0640 1 --2- 172.21.15.148:0/4109391251 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561cc4f97af0 0x561cc4f97ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:42.808 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.801+0000 7f1eb2ab0640 1 -- 172.21.15.148:0/4109391251 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cc4f98410 msgr2=0x561cc4fa2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:18:42.808 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.801+0000 7f1eb2ab0640 1 --2- 172.21.15.148:0/4109391251 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cc4f98410 0x561cc4fa2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:42.808 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.801+0000 7f1eb2ab0640 1 -- 172.21.15.148:0/4109391251 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cc4ea3340 con 0x561cc4fa2cb0 2024-09-19T07:18:42.809 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.801+0000 7f1eb1aae640 1 --2- 172.21.15.148:0/4109391251 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cc4f98410 0x561cc4fa2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:18:42.809 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.801+0000 7f1eb1aae640 1 --2- 172.21.15.148:0/3613212209 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f1e980a34e0 0x7f1e980a59a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c00bfd0 tx=0x7f1e9c00bb20 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:18:42.809 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.802+0000 7f1eb2ab0640 1 --2- 172.21.15.148:0/4109391251 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561cc4fa2cb0 0x561cc4fa50a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1ea40cdae0 tx=0x7f1ea409ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b155c6baa77fa480 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:18:42.809 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.802+0000 7f1ea0bfe640 1 -- 172.21.15.148:0/4109391251 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea40a52e0 con 0x561cc4fa2cb0 2024-09-19T07:18:42.809 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.802+0000 7f1ea0bfe640 1 -- 172.21.15.148:0/4109391251 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ea4085970 con 0x561cc4fa2cb0 2024-09-19T07:18:42.809 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.802+0000 7f1ea0bfe640 1 -- 172.21.15.148:0/4109391251 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea4088290 con 0x561cc4fa2cb0 2024-09-19T07:18:42.809 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.802+0000 7f1eb72a3740 1 -- 172.21.15.148:0/4109391251 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561cc4fa2cb0 msgr2=0x561cc4fa50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:42.809 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.802+0000 7f1eb72a3740 1 --2- 172.21.15.148:0/4109391251 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561cc4fa2cb0 0x561cc4fa50a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1ea40cdae0 tx=0x7f1ea409ce30 comp rx=0 tx=0).stop 2024-09-19T07:18:42.809 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.802+0000 7f1eb72a3740 1 -- 172.21.15.148:0/4109391251 shutdown_connections 2024-09-19T07:18:42.809 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.802+0000 7f1eb72a3740 1 --2- 172.21.15.148:0/4109391251 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561cc4fa2cb0 0x561cc4fa50a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:42.809 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.802+0000 7f1eb72a3740 1 --2- 172.21.15.148:0/4109391251 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cc4f98410 0x561cc4fa2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:42.809 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.802+0000 7f1eb72a3740 1 --2- 172.21.15.148:0/4109391251 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561cc4f97af0 0x561cc4f97ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:42.809 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.802+0000 7f1eb72a3740 1 -- 172.21.15.148:0/4109391251 >> 172.21.15.148:0/4109391251 conn(0x561cc4f94060 msgr2=0x561cc4f94440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:18:42.810 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.803+0000 7f1eb72a3740 1 -- 172.21.15.148:0/4109391251 shutdown_connections 2024-09-19T07:18:42.810 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.803+0000 7f1eb72a3740 1 -- 172.21.15.148:0/4109391251 wait complete. 2024-09-19T07:18:42.810 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.803+0000 7f1eb72a3740 1 -- start start 2024-09-19T07:18:42.810 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.803+0000 7f1eb72a3740 1 Processor -- start 2024-09-19T07:18:42.810 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.803+0000 7f1eb72a3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561cc4f97af0 0x561cc4f9fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:42.810 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.803+0000 7f1eb72a3740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cc4f98410 0x561cc4fa0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:42.810 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.803+0000 7f1eb72a3740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561cc4fa2cb0 0x561cc4fa05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:42.810 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.803+0000 7f1eb72a3740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x561cc4fa5880 con 0x561cc4f98410 2024-09-19T07:18:42.810 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.803+0000 7f1eb72a3740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x561cc4e85290 con 0x561cc4fa2cb0 2024-09-19T07:18:42.810 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.803+0000 7f1eb72a3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x561cc4fa5a00 con 0x561cc4f97af0 2024-09-19T07:18:42.810 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.803+0000 7f1eb72a3740 10 client.0 _ll_register_callbacks cb 0x561cc4eb6140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:18:42.811 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.803+0000 7f1eb1aae640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cc4f98410 0x561cc4fa0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:42.811 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.803+0000 7f1eb22af640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561cc4f97af0 0x561cc4f9fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:42.811 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.803+0000 7f1eb1aae640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cc4f98410 0x561cc4fa0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60994/0 (socket says 172.21.15.148:60994) 2024-09-19T07:18:42.811 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.803+0000 7f1eb1aae640 1 -- 172.21.15.148:0/4231594395 learned_addr learned my addr 172.21.15.148:0/4231594395 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:18:42.811 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.803+0000 7f1eb2ab0640 1 --2- 172.21.15.148:0/4231594395 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561cc4fa2cb0 0x561cc4fa05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:42.811 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.804+0000 7f1eb1aae640 1 -- 172.21.15.148:0/4231594395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561cc4f97af0 msgr2=0x561cc4f9fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:18:42.811 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.804+0000 7f1eb1aae640 1 --2- 172.21.15.148:0/4231594395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561cc4f97af0 0x561cc4f9fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:42.811 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.804+0000 7f1eb1aae640 1 -- 172.21.15.148:0/4231594395 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561cc4fa2cb0 msgr2=0x561cc4fa05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:18:42.811 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.804+0000 7f1eb1aae640 1 --2- 172.21.15.148:0/4231594395 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561cc4fa2cb0 0x561cc4fa05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:42.811 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.804+0000 7f1eb1aae640 1 -- 172.21.15.148:0/4231594395 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cc4c0f210 con 0x561cc4f98410 2024-09-19T07:18:42.811 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.804+0000 7f1eb22af640 1 --2- 172.21.15.148:0/4231594395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561cc4f97af0 0x561cc4f9fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:18:42.811 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.804+0000 7f1eb1aae640 1 --2- 172.21.15.148:0/4231594395 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cc4f98410 0x561cc4fa0090 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c010dd0 tx=0x7f1e9c005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28d72f44eb64a623 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:18:42.811 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.804+0000 7f1e95ffb640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:18:42.812 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.804+0000 7f1e95ffb640 1 -- 172.21.15.148:0/4231594395 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c004020 con 0x561cc4f98410 2024-09-19T07:18:42.812 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.804+0000 7f1e95ffb640 1 -- 172.21.15.148:0/4231594395 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8556+0+0 (secure 0 0 0) 0x7f1e9c0041c0 con 0x561cc4f98410 2024-09-19T07:18:42.812 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.804+0000 7f1eb72a3740 1 -- 172.21.15.148:0/4231594395 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ea4085970 con 0x561cc4f98410 2024-09-19T07:18:42.812 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.804+0000 7f1e95ffb640 1 -- 172.21.15.148:0/4231594395 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f1e9c0043c0 con 0x561cc4f98410 2024-09-19T07:18:42.812 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.804+0000 7f1eb72a3740 10 client.16725 fetch_fsmap learned FSMap version 41 2024-09-19T07:18:42.812 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.804+0000 7f1eb72a3740 1 -- 172.21.15.148:0/4231594395 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x561cc4cdb620 con 0x561cc4f98410 2024-09-19T07:18:42.812 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.804+0000 7f1e95ffb640 1 -- 172.21.15.148:0/4231594395 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ea4085970 con 0x561cc4f98410 2024-09-19T07:18:42.812 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.805+0000 7f1e95ffb640 1 -- 172.21.15.148:0/4231594395 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 41) ==== 8370+0+0 (secure 0 0 0) 0x7f1e9c00f040 con 0x561cc4f98410 2024-09-19T07:18:42.812 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.805+0000 7f1eb72a3740 10 client.16725 fetch_fsmap finished waiting for FSMap version 41 2024-09-19T07:18:42.812 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.805+0000 7f1eb72a3740 10 client.16725 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:18:42.812 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.805+0000 7f1eb72a3740 20 client.16725 populate_metadata read hostname 'smithi148' 2024-09-19T07:18:42.812 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.805+0000 7f1eb72a3740 1 --2- 172.21.15.148:0/4231594395 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561cc4fb2be0 0x561cc4fb5030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:42.812 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.805+0000 7f1eb72a3740 4 client.16725 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:18:42.813 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.805+0000 7f1eb72a3740 1 -- 172.21.15.148:0/4231594395 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561cc4f09a20 con 0x561cc4fb2be0 2024-09-19T07:18:42.813 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.805+0000 7f1eb22af640 1 --2- 172.21.15.148:0/4231594395 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561cc4fb2be0 0x561cc4fb5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:42.813 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.805+0000 7f1e95ffb640 10 client.16725 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:18:42.813 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.805+0000 7f1eb22af640 1 --2- 172.21.15.148:0/4231594395 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561cc4fb2be0 0x561cc4fb5030 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9189ae1685e436d5 server_cookie=7d418860bdbcd7c4 in_seq=0 out_seq=0 2024-09-19T07:18:42.831 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.829+0000 7f1e95ffb640 1 -- 172.21.15.148:0/4231594395 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561cc4f09a20 con 0x561cc4fb2be0 2024-09-19T07:18:42.831 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.829+0000 7f1e95ffb640 10 client.16725 handle_command_reply: tid=0 2024-09-19T07:18:42.831 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.830+0000 7f1eb72a3740 1 client.16725 shutdown 2024-09-19T07:18:42.831 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.830+0000 7f1eb72a3740 1 -- 172.21.15.148:0/4231594395 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cc4f98410 msgr2=0x561cc4fa0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:42.831 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.830+0000 7f1eb72a3740 1 --2- 172.21.15.148:0/4231594395 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cc4f98410 0x561cc4fa0090 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c010dd0 tx=0x7f1e9c005850 comp rx=0 tx=0).stop 2024-09-19T07:18:42.831 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.830+0000 7f1eb72a3740 1 -- 172.21.15.148:0/4231594395 shutdown_connections 2024-09-19T07:18:42.831 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.830+0000 7f1eb72a3740 1 --2- 172.21.15.148:0/4231594395 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561cc4fb2be0 0x561cc4fb5030 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:42.832 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.830+0000 7f1eb72a3740 1 --2- 172.21.15.148:0/4231594395 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561cc4fa2cb0 0x561cc4fa05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:42.832 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.830+0000 7f1eb72a3740 1 --2- 172.21.15.148:0/4231594395 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cc4f98410 0x561cc4fa0090 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:42.832 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.830+0000 7f1e95ffb640 0 client.16725 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:18:42.832 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.830+0000 7f1eb72a3740 1 --2- 172.21.15.148:0/4231594395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561cc4f97af0 0x561cc4f9fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:42.832 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.830+0000 7f1eb72a3740 1 -- 172.21.15.148:0/4231594395 >> 172.21.15.148:0/4231594395 conn(0x561cc4f94060 msgr2=0x561cc4f99d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:18:42.832 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.830+0000 7f1eb72a3740 1 -- 172.21.15.148:0/4231594395 shutdown_connections 2024-09-19T07:18:42.832 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.830+0000 7f1eb72a3740 1 -- 172.21.15.148:0/4231594395 wait complete. 2024-09-19T07:18:42.832 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.830+0000 7f1eb72a3740 20 client.16725 trim_cache size 0 max 16384 2024-09-19T07:18:42.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:18:42 smithi148 ceph-mon[31180]: pgmap v235: 97 pgs: 97 active+clean; 1.7 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.3 MiB/s wr, 1.12k op/s 2024-09-19T07:18:42.850 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.845+0000 7f1eb72a3740 1 Processor -- start 2024-09-19T07:18:42.850 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.845+0000 7f1eb72a3740 1 -- start start 2024-09-19T07:18:42.850 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.845+0000 7f1eb72a3740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561cc4f97af0 0x561cc4f98c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:42.850 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.845+0000 7f1eb72a3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561cc4f98410 0x561cc4fa0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:42.851 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.845+0000 7f1eb72a3740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cc4fa2cb0 0x561cc4fa1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:42.851 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.845+0000 7f1eb72a3740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1eac1b0150 con 0x561cc4fa2cb0 2024-09-19T07:18:42.851 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.845+0000 7f1eb72a3740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1eac1ad960 con 0x561cc4f97af0 2024-09-19T07:18:42.851 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.845+0000 7f1eb72a3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1eac1ab7d0 con 0x561cc4f98410 2024-09-19T07:18:42.851 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.846+0000 7f1eb2ab0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cc4fa2cb0 0x561cc4fa1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:42.851 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.846+0000 7f1eb2ab0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cc4fa2cb0 0x561cc4fa1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60998/0 (socket says 172.21.15.148:60998) 2024-09-19T07:18:42.851 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.846+0000 7f1eb2ab0640 1 -- 172.21.15.148:0/2307831684 learned_addr learned my addr 172.21.15.148:0/2307831684 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:18:42.851 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.846+0000 7f1eb1aae640 1 --2- 172.21.15.148:0/2307831684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561cc4f98410 0x561cc4fa0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:42.851 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.846+0000 7f1eb22af640 1 --2- 172.21.15.148:0/2307831684 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561cc4f97af0 0x561cc4f98c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:42.851 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.846+0000 7f1eb2ab0640 1 -- 172.21.15.148:0/2307831684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561cc4f98410 msgr2=0x561cc4fa0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:18:42.851 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.846+0000 7f1eb2ab0640 1 --2- 172.21.15.148:0/2307831684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561cc4f98410 0x561cc4fa0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:42.851 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.846+0000 7f1eb2ab0640 1 -- 172.21.15.148:0/2307831684 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561cc4f97af0 msgr2=0x561cc4f98c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:18:42.851 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.846+0000 7f1eb2ab0640 1 --2- 172.21.15.148:0/2307831684 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561cc4f97af0 0x561cc4f98c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:42.852 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.846+0000 7f1eb2ab0640 1 -- 172.21.15.148:0/2307831684 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cc4f9e080 con 0x561cc4fa2cb0 2024-09-19T07:18:42.852 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.846+0000 7f1eb2ab0640 1 --2- 172.21.15.148:0/2307831684 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cc4fa2cb0 0x561cc4fa1ac0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f1ea409c370 tx=0x7f1ea40d0340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7d04151d3a2f381 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:18:42.852 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.846+0000 7f1e97fff640 1 -- 172.21.15.148:0/2307831684 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea409a970 con 0x561cc4fa2cb0 2024-09-19T07:18:42.852 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.846+0000 7f1e97fff640 1 -- 172.21.15.148:0/2307831684 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ea40051d0 con 0x561cc4fa2cb0 2024-09-19T07:18:42.852 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.846+0000 7f1e97fff640 1 -- 172.21.15.148:0/2307831684 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea409cb30 con 0x561cc4fa2cb0 2024-09-19T07:18:42.852 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.847+0000 7f1eb72a3740 1 -- 172.21.15.148:0/2307831684 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cc4fa2cb0 msgr2=0x561cc4fa1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:42.852 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.847+0000 7f1eb72a3740 1 --2- 172.21.15.148:0/2307831684 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cc4fa2cb0 0x561cc4fa1ac0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f1ea409c370 tx=0x7f1ea40d0340 comp rx=0 tx=0).stop 2024-09-19T07:18:42.852 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.847+0000 7f1eb72a3740 1 -- 172.21.15.148:0/2307831684 shutdown_connections 2024-09-19T07:18:42.852 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.847+0000 7f1eb72a3740 1 --2- 172.21.15.148:0/2307831684 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cc4fa2cb0 0x561cc4fa1ac0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:42.852 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.847+0000 7f1eb72a3740 1 --2- 172.21.15.148:0/2307831684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561cc4f98410 0x561cc4fa0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:42.852 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.847+0000 7f1eb72a3740 1 --2- 172.21.15.148:0/2307831684 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561cc4f97af0 0x561cc4f98c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:42.852 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.847+0000 7f1eb72a3740 1 -- 172.21.15.148:0/2307831684 >> 172.21.15.148:0/2307831684 conn(0x561cc4f94060 msgr2=0x561cc4fa13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:18:42.852 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.847+0000 7f1eb72a3740 1 -- 172.21.15.148:0/2307831684 shutdown_connections 2024-09-19T07:18:42.853 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.847+0000 7f1eb72a3740 1 -- 172.21.15.148:0/2307831684 wait complete. 2024-09-19T07:18:42.853 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.847+0000 7f1eb72a3740 1 -- start start 2024-09-19T07:18:42.853 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.847+0000 7f1eb72a3740 1 Processor -- start 2024-09-19T07:18:42.853 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.847+0000 7f1eb72a3740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561cc4f97af0 0x561cc4fab260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:42.853 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.847+0000 7f1eb72a3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561cc4f98410 0x561cc4fa6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:42.853 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.847+0000 7f1eb72a3740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cc4fa2cb0 0x561cc4fa6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:42.853 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.847+0000 7f1eb72a3740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1eac1abe20 con 0x561cc4fa2cb0 2024-09-19T07:18:42.853 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.847+0000 7f1eb72a3740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1eac1ad290 con 0x561cc4f97af0 2024-09-19T07:18:42.853 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.847+0000 7f1eb72a3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1eac1ac4f0 con 0x561cc4f98410 2024-09-19T07:18:42.853 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.848+0000 7f1eb72a3740 10 client.0 _ll_register_callbacks cb 0x7f1e9c013ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:18:42.853 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.848+0000 7f1eb2ab0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cc4fa2cb0 0x561cc4fa6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:42.853 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.848+0000 7f1eb1aae640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561cc4f98410 0x561cc4fa6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:42.854 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.848+0000 7f1eb2ab0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cc4fa2cb0 0x561cc4fa6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:32780/0 (socket says 172.21.15.148:32780) 2024-09-19T07:18:42.854 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.848+0000 7f1eb2ab0640 1 -- 172.21.15.148:0/3922693018 learned_addr learned my addr 172.21.15.148:0/3922693018 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:18:42.854 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.848+0000 7f1eb22af640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561cc4f97af0 0x561cc4fab260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:42.854 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.848+0000 7f1eb2ab0640 1 -- 172.21.15.148:0/3922693018 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561cc4f98410 msgr2=0x561cc4fa6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:18:42.854 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.848+0000 7f1eb2ab0640 1 --2- 172.21.15.148:0/3922693018 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561cc4f98410 0x561cc4fa6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:42.854 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.848+0000 7f1eb2ab0640 1 -- 172.21.15.148:0/3922693018 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561cc4f97af0 msgr2=0x561cc4fab260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:18:42.854 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.848+0000 7f1eb2ab0640 1 --2- 172.21.15.148:0/3922693018 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561cc4f97af0 0x561cc4fab260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:42.854 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.848+0000 7f1eb2ab0640 1 -- 172.21.15.148:0/3922693018 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cc4fa7160 con 0x561cc4fa2cb0 2024-09-19T07:18:42.854 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.848+0000 7f1eb2ab0640 1 --2- 172.21.15.148:0/3922693018 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cc4fa2cb0 0x561cc4fa6ac0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f1ea40a4db0 tx=0x7f1ea4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbf2d46156e2bac9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:18:42.854 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.848+0000 7f1e95ffb640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:18:42.854 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.848+0000 7f1e95ffb640 1 -- 172.21.15.148:0/3922693018 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea409cad0 con 0x561cc4fa2cb0 2024-09-19T07:18:42.854 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.848+0000 7f1e95ffb640 1 -- 172.21.15.148:0/3922693018 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8556+0+0 (secure 0 0 0) 0x7f1ea40a4e50 con 0x561cc4fa2cb0 2024-09-19T07:18:42.854 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.848+0000 7f1eb72a3740 1 -- 172.21.15.148:0/3922693018 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ea40051d0 con 0x561cc4fa2cb0 2024-09-19T07:18:42.854 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.848+0000 7f1e95ffb640 1 -- 172.21.15.148:0/3922693018 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f1ea4098e50 con 0x561cc4fa2cb0 2024-09-19T07:18:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.848+0000 7f1eb72a3740 10 client.16731 fetch_fsmap learned FSMap version 41 2024-09-19T07:18:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.848+0000 7f1eb72a3740 1 -- 172.21.15.148:0/3922693018 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x561cc501d7e0 con 0x561cc4fa2cb0 2024-09-19T07:18:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.849+0000 7f1e95ffb640 1 -- 172.21.15.148:0/3922693018 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ea40051d0 con 0x561cc4fa2cb0 2024-09-19T07:18:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.849+0000 7f1e95ffb640 1 -- 172.21.15.148:0/3922693018 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 41) ==== 8370+0+0 (secure 0 0 0) 0x7f1ea407d070 con 0x561cc4fa2cb0 2024-09-19T07:18:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.849+0000 7f1eb72a3740 10 client.16731 fetch_fsmap finished waiting for FSMap version 41 2024-09-19T07:18:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.849+0000 7f1eb72a3740 10 client.16731 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:18:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.849+0000 7f1eb72a3740 20 client.16731 populate_metadata read hostname 'smithi148' 2024-09-19T07:18:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.849+0000 7f1eb72a3740 1 --2- 172.21.15.148:0/3922693018 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561cc501da00 0x561cc501fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.849+0000 7f1eb72a3740 4 client.16731 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:18:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.849+0000 7f1eb72a3740 1 -- 172.21.15.148:0/3922693018 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561cc4f03d70 con 0x561cc501da00 2024-09-19T07:18:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.849+0000 7f1eb22af640 1 --2- 172.21.15.148:0/3922693018 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561cc501da00 0x561cc501fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.849+0000 7f1e95ffb640 10 client.16731 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:18:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:42.849+0000 7f1eb22af640 1 --2- 172.21.15.148:0/3922693018 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561cc501da00 0x561cc501fdf0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf8a58dfa97b226a server_cookie=61f4d9751c0f678b in_seq=0 out_seq=0 2024-09-19T07:18:42.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:18:42 smithi165 ceph-mon[35326]: pgmap v235: 97 pgs: 97 active+clean; 1.7 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.3 MiB/s wr, 1.12k op/s 2024-09-19T07:18:44.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:18:44 smithi179 ceph-mon[35716]: pgmap v236: 97 pgs: 97 active+clean; 1.7 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.2 MiB/s wr, 988 op/s 2024-09-19T07:18:44.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:18:44 smithi148 ceph-mon[31180]: pgmap v236: 97 pgs: 97 active+clean; 1.7 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.2 MiB/s wr, 988 op/s 2024-09-19T07:18:44.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:18:44 smithi165 ceph-mon[35326]: pgmap v236: 97 pgs: 97 active+clean; 1.7 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.2 MiB/s wr, 988 op/s 2024-09-19T07:18:44.905 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:44.903+0000 7f1e95ffb640 1 -- 172.21.15.148:0/3922693018 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561cc4f03d70 con 0x561cc501da00 2024-09-19T07:18:44.905 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:44.903+0000 7f1e95ffb640 10 client.16731 handle_command_reply: tid=0 2024-09-19T07:18:44.905 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:44.903+0000 7f1eb72a3740 1 client.16731 shutdown 2024-09-19T07:18:44.905 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:44.903+0000 7f1eb72a3740 1 -- 172.21.15.148:0/3922693018 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cc4fa2cb0 msgr2=0x561cc4fa6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:44.905 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:44.903+0000 7f1eb72a3740 1 --2- 172.21.15.148:0/3922693018 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cc4fa2cb0 0x561cc4fa6ac0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f1ea40a4db0 tx=0x7f1ea4005830 comp rx=0 tx=0).stop 2024-09-19T07:18:44.905 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:44.904+0000 7f1eb72a3740 1 -- 172.21.15.148:0/3922693018 shutdown_connections 2024-09-19T07:18:44.905 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:44.904+0000 7f1eb72a3740 1 --2- 172.21.15.148:0/3922693018 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561cc501da00 0x561cc501fdf0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:44.906 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:44.904+0000 7f1eb72a3740 1 --2- 172.21.15.148:0/3922693018 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561cc4fa2cb0 0x561cc4fa6ac0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:44.906 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:44.904+0000 7f1eb72a3740 1 --2- 172.21.15.148:0/3922693018 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561cc4f98410 0x561cc4fa6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:44.906 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:44.904+0000 7f1e95ffb640 0 client.16731 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:18:44.906 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:44.904+0000 7f1eb72a3740 1 --2- 172.21.15.148:0/3922693018 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561cc4f97af0 0x561cc4fab260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:44.906 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:44.904+0000 7f1eb72a3740 1 -- 172.21.15.148:0/3922693018 >> 172.21.15.148:0/3922693018 conn(0x561cc4f94060 msgr2=0x561cc4f931c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:18:44.906 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:44.904+0000 7f1eb72a3740 1 -- 172.21.15.148:0/3922693018 shutdown_connections 2024-09-19T07:18:44.906 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:44.904+0000 7f1eb72a3740 1 -- 172.21.15.148:0/3922693018 wait complete. 2024-09-19T07:18:44.906 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:44.904+0000 7f1eb72a3740 20 client.16731 trim_cache size 0 max 16384 2024-09-19T07:18:44.906 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:18:44.907 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:18:44.907 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:18:44.907 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:18:44.907 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:44.904+0000 7f1eb4513640 1 -- 172.21.15.148:0/3613212209 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f1e980a34e0 msgr2=0x7f1e980a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:44.908 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:44.904+0000 7f1eb4513640 1 --2- 172.21.15.148:0/3613212209 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f1e980a34e0 0x7f1e980a59a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c00bfd0 tx=0x7f1e9c00bb20 comp rx=0 tx=0).stop 2024-09-19T07:18:44.908 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:44.904+0000 7f1eb4513640 1 -- 172.21.15.148:0/3613212209 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1eac1069c0 msgr2=0x7f1eac19bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:44.908 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:44.904+0000 7f1eb4513640 1 --2- 172.21.15.148:0/3613212209 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1eac1069c0 0x7f1eac19bb30 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f1ea4009fd0 tx=0x7f1ea400ef10 comp rx=0 tx=0).stop 2024-09-19T07:18:44.908 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:44.904+0000 7f1eb4513640 1 -- 172.21.15.148:0/3613212209 shutdown_connections 2024-09-19T07:18:44.908 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:44.904+0000 7f1eb4513640 1 --2- 172.21.15.148:0/3613212209 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f1e980a34e0 0x7f1e980a59a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:44.908 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:44.904+0000 7f1eb4513640 1 --2- 172.21.15.148:0/3613212209 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1eac1069c0 0x7f1eac19bb30 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:44.908 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:44.904+0000 7f1eb4513640 1 --2- 172.21.15.148:0/3613212209 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1eac101350 0x7f1eac1977b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:44.908 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:44.904+0000 7f1eb4513640 1 --2- 172.21.15.148:0/3613212209 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1eac1009b0 0x7f1eac197270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:44.908 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:44.904+0000 7f1eb4513640 1 -- 172.21.15.148:0/3613212209 >> 172.21.15.148:0/3613212209 conn(0x7f1eac077990 msgr2=0x7f1eac1037b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:18:44.908 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:44.904+0000 7f1eb4513640 1 -- 172.21.15.148:0/3613212209 shutdown_connections 2024-09-19T07:18:44.908 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:44.905+0000 7f1eb4513640 1 -- 172.21.15.148:0/3613212209 wait complete. 2024-09-19T07:18:46.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:18:46 smithi179 ceph-mon[35716]: pgmap v237: 97 pgs: 97 active+clean; 1.7 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.1 MiB/s wr, 968 op/s 2024-09-19T07:18:46.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:18:46 smithi148 ceph-mon[31180]: pgmap v237: 97 pgs: 97 active+clean; 1.7 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.1 MiB/s wr, 968 op/s 2024-09-19T07:18:46.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:18:46 smithi165 ceph-mon[35326]: pgmap v237: 97 pgs: 97 active+clean; 1.7 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.1 MiB/s wr, 968 op/s 2024-09-19T07:18:48.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:18:48 smithi179 ceph-mon[35716]: pgmap v238: 97 pgs: 97 active+clean; 1.7 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 498 op/s 2024-09-19T07:18:48.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:18:48 smithi148 ceph-mon[31180]: pgmap v238: 97 pgs: 97 active+clean; 1.7 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 498 op/s 2024-09-19T07:18:48.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:18:48 smithi165 ceph-mon[35326]: pgmap v238: 97 pgs: 97 active+clean; 1.7 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 498 op/s 2024-09-19T07:18:50.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:18:50 smithi179 ceph-mon[35716]: pgmap v239: 97 pgs: 97 active+clean; 1.7 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 500 op/s 2024-09-19T07:18:50.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:18:50 smithi148 ceph-mon[31180]: pgmap v239: 97 pgs: 97 active+clean; 1.7 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 500 op/s 2024-09-19T07:18:50.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:18:50 smithi165 ceph-mon[35326]: pgmap v239: 97 pgs: 97 active+clean; 1.7 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 500 op/s 2024-09-19T07:18:52.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:18:52 smithi179 ceph-mon[35716]: pgmap v240: 97 pgs: 97 active+clean; 1.7 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.1 MiB/s wr, 738 op/s 2024-09-19T07:18:52.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:18:52 smithi148 ceph-mon[31180]: pgmap v240: 97 pgs: 97 active+clean; 1.7 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.1 MiB/s wr, 738 op/s 2024-09-19T07:18:52.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:18:52 smithi165 ceph-mon[35326]: pgmap v240: 97 pgs: 97 active+clean; 1.7 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.1 MiB/s wr, 738 op/s 2024-09-19T07:18:54.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:18:54 smithi179 ceph-mon[35716]: pgmap v241: 97 pgs: 97 active+clean; 1.7 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 400 op/s 2024-09-19T07:18:54.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:18:54 smithi148 ceph-mon[31180]: pgmap v241: 97 pgs: 97 active+clean; 1.7 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 400 op/s 2024-09-19T07:18:54.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:18:54 smithi165 ceph-mon[35326]: pgmap v241: 97 pgs: 97 active+clean; 1.7 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 400 op/s 2024-09-19T07:18:56.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:18:56 smithi179 ceph-mon[35716]: pgmap v242: 97 pgs: 97 active+clean; 1.7 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 617 op/s 2024-09-19T07:18:56.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:18:56 smithi148 ceph-mon[31180]: pgmap v242: 97 pgs: 97 active+clean; 1.7 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 617 op/s 2024-09-19T07:18:56.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:18:56 smithi165 ceph-mon[35326]: pgmap v242: 97 pgs: 97 active+clean; 1.7 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 617 op/s 2024-09-19T07:18:57.994 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.991+0000 7fb73558d640 1 -- 172.21.15.148:0/683057478 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb730102ce0 msgr2=0x7fb7301030c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:57.994 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.991+0000 7fb73558d640 1 --2- 172.21.15.148:0/683057478 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb730102ce0 0x7fb7301030c0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fb720009900 tx=0x7fb72002a480 comp rx=0 tx=0).stop 2024-09-19T07:18:57.994 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.991+0000 7fb73558d640 1 -- 172.21.15.148:0/683057478 shutdown_connections 2024-09-19T07:18:57.994 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.991+0000 7fb73558d640 1 --2- 172.21.15.148:0/683057478 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb73010c0b0 0x7fb73010e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.991+0000 7fb73558d640 1 --2- 172.21.15.148:0/683057478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb730103600 0x7fb73010bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.991+0000 7fb73558d640 1 --2- 172.21.15.148:0/683057478 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb730102ce0 0x7fb7301030c0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.991+0000 7fb73558d640 1 -- 172.21.15.148:0/683057478 >> 172.21.15.148:0/683057478 conn(0x7fb730077990 msgr2=0x7fb7300fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:18:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.991+0000 7fb73558d640 1 -- 172.21.15.148:0/683057478 shutdown_connections 2024-09-19T07:18:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.991+0000 7fb73558d640 1 -- 172.21.15.148:0/683057478 wait complete. 2024-09-19T07:18:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.991+0000 7fb73558d640 1 Processor -- start 2024-09-19T07:18:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.991+0000 7fb73558d640 1 -- start start 2024-09-19T07:18:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.992+0000 7fb73558d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb730102ce0 0x7fb730100930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.992+0000 7fb73558d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb730103600 0x7fb730100e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.992+0000 7fb73558d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb73010c0b0 0x7fb7301013b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.992+0000 7fb73558d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb730111eb0 con 0x7fb730102ce0 2024-09-19T07:18:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.992+0000 7fb73558d640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb730111d30 con 0x7fb73010c0b0 2024-09-19T07:18:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.992+0000 7fb73558d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb730112030 con 0x7fb730103600 2024-09-19T07:18:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.992+0000 7fb72effd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb730102ce0 0x7fb730100930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.992+0000 7fb72effd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb730102ce0 0x7fb730100930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48450/0 (socket says 172.21.15.148:48450) 2024-09-19T07:18:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.992+0000 7fb72effd640 1 -- 172.21.15.148:0/399139040 learned_addr learned my addr 172.21.15.148:0/399139040 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:18:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.992+0000 7fb727fff640 1 --2- 172.21.15.148:0/399139040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb730103600 0x7fb730100e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.992+0000 7fb72f7fe640 1 --2- 172.21.15.148:0/399139040 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb73010c0b0 0x7fb7301013b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.992+0000 7fb72effd640 1 -- 172.21.15.148:0/399139040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb730103600 msgr2=0x7fb730100e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.992+0000 7fb72effd640 1 --2- 172.21.15.148:0/399139040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb730103600 0x7fb730100e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.992+0000 7fb72effd640 1 -- 172.21.15.148:0/399139040 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb73010c0b0 msgr2=0x7fb7301013b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.992+0000 7fb72effd640 1 --2- 172.21.15.148:0/399139040 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb73010c0b0 0x7fb7301013b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.992+0000 7fb72effd640 1 -- 172.21.15.148:0/399139040 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7301aacc0 con 0x7fb730102ce0 2024-09-19T07:18:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.992+0000 7fb72f7fe640 1 --2- 172.21.15.148:0/399139040 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb73010c0b0 0x7fb7301013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:18:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.992+0000 7fb72effd640 1 --2- 172.21.15.148:0/399139040 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb730102ce0 0x7fb730100930 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fb720006010 tx=0x7fb720004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:18:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.992+0000 7fb72cff9640 1 -- 172.21.15.148:0/399139040 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72003f030 con 0x7fb730102ce0 2024-09-19T07:18:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.992+0000 7fb72cff9640 1 -- 172.21.15.148:0/399139040 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb720003ad0 con 0x7fb730102ce0 2024-09-19T07:18:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.993+0000 7fb73558d640 1 -- 172.21.15.148:0/399139040 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7301aae90 con 0x7fb730102ce0 2024-09-19T07:18:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.993+0000 7fb72cff9640 1 -- 172.21.15.148:0/399139040 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb720035070 con 0x7fb730102ce0 2024-09-19T07:18:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.993+0000 7fb73558d640 1 -- 172.21.15.148:0/399139040 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7301ab300 con 0x7fb730102ce0 2024-09-19T07:18:58.003 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.995+0000 7fb72cff9640 1 -- 172.21.15.148:0/399139040 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fb720042030 con 0x7fb730102ce0 2024-09-19T07:18:58.003 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.995+0000 7fb738403740 1 Processor -- start 2024-09-19T07:18:58.003 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.995+0000 7fb738403740 1 -- start start 2024-09-19T07:18:58.003 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.996+0000 7fb738403740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a0fcc19af0 0x55a0fcc19ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:58.003 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.996+0000 7fb738403740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a0fcc1a410 0x55a0fcc24770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:58.003 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.996+0000 7fb738403740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a0fcc24cb0 0x55a0fcc270a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:58.003 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.996+0000 7fb738403740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55a0fcb7e2f0 con 0x55a0fcc1a410 2024-09-19T07:18:58.003 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.996+0000 7fb738403740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55a0fcb26270 con 0x55a0fcc24cb0 2024-09-19T07:18:58.003 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.996+0000 7fb738403740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a0fcb7a2b0 con 0x55a0fcc19af0 2024-09-19T07:18:58.003 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.996+0000 7fb72f7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a0fcc19af0 0x55a0fcc19ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:58.004 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.996+0000 7fb727fff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a0fcc24cb0 0x55a0fcc270a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:58.004 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.996+0000 7fb72f7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a0fcc19af0 0x55a0fcc19ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:41492/0 (socket says 172.21.15.148:41492) 2024-09-19T07:18:58.004 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.996+0000 7fb72effd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a0fcc1a410 0x55a0fcc24770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:58.004 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.996+0000 7fb72f7fe640 1 -- 172.21.15.148:0/2510135225 learned_addr learned my addr 172.21.15.148:0/2510135225 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:18:58.004 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.996+0000 7fb72cff9640 1 --2- 172.21.15.148:0/399139040 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fb71c0a3460 0x7fb71c0a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:58.004 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.996+0000 7fb72f7fe640 1 -- 172.21.15.148:0/2510135225 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a0fcc24cb0 msgr2=0x55a0fcc270a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:18:58.004 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.996+0000 7fb72f7fe640 1 --2- 172.21.15.148:0/2510135225 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a0fcc24cb0 0x55a0fcc270a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:58.004 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.996+0000 7fb72f7fe640 1 -- 172.21.15.148:0/2510135225 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a0fcc1a410 msgr2=0x55a0fcc24770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:18:58.004 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.996+0000 7fb72f7fe640 1 --2- 172.21.15.148:0/2510135225 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a0fcc1a410 0x55a0fcc24770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:58.004 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.996+0000 7fb72f7fe640 1 -- 172.21.15.148:0/2510135225 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0fcb25340 con 0x55a0fcc19af0 2024-09-19T07:18:58.004 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.996+0000 7fb72f7fe640 1 --2- 172.21.15.148:0/399139040 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fb71c0a3460 0x7fb71c0a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:58.004 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.996+0000 7fb72cff9640 1 -- 172.21.15.148:0/399139040 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8556+0+0 (secure 0 0 0) 0x7fb7200f0470 con 0x7fb730102ce0 2024-09-19T07:18:58.004 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.997+0000 7fb72f7fe640 1 --2- 172.21.15.148:0/2510135225 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a0fcc19af0 0x55a0fcc19ed0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb728005c80 tx=0x7fb72800e7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0b6a679ebfefda9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:18:58.005 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.997+0000 7fb7257fa640 1 -- 172.21.15.148:0/2510135225 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb728022070 con 0x55a0fcc19af0 2024-09-19T07:18:58.005 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.997+0000 7fb7257fa640 1 -- 172.21.15.148:0/2510135225 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb728011c30 con 0x55a0fcc19af0 2024-09-19T07:18:58.005 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.997+0000 7fb72f7fe640 1 --2- 172.21.15.148:0/399139040 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fb71c0a3460 0x7fb71c0a5920 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb72801f000 tx=0x7fb728020000 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:18:58.005 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.997+0000 7fb7257fa640 1 -- 172.21.15.148:0/2510135225 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72801a400 con 0x55a0fcc19af0 2024-09-19T07:18:58.005 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.997+0000 7fb738403740 1 -- 172.21.15.148:0/2510135225 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a0fcc19af0 msgr2=0x55a0fcc19ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:58.005 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.997+0000 7fb738403740 1 --2- 172.21.15.148:0/2510135225 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a0fcc19af0 0x55a0fcc19ed0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb728005c80 tx=0x7fb72800e7e0 comp rx=0 tx=0).stop 2024-09-19T07:18:58.005 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.998+0000 7fb738403740 1 -- 172.21.15.148:0/2510135225 shutdown_connections 2024-09-19T07:18:58.005 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.998+0000 7fb738403740 1 --2- 172.21.15.148:0/2510135225 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a0fcc24cb0 0x55a0fcc270a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:58.005 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.998+0000 7fb738403740 1 --2- 172.21.15.148:0/2510135225 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a0fcc1a410 0x55a0fcc24770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:58.005 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.998+0000 7fb738403740 1 --2- 172.21.15.148:0/2510135225 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a0fcc19af0 0x55a0fcc19ed0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:58.005 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.998+0000 7fb738403740 1 -- 172.21.15.148:0/2510135225 >> 172.21.15.148:0/2510135225 conn(0x55a0fcc16060 msgr2=0x55a0fcc16440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:18:58.005 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.998+0000 7fb738403740 1 -- 172.21.15.148:0/2510135225 shutdown_connections 2024-09-19T07:18:58.005 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.998+0000 7fb738403740 1 -- 172.21.15.148:0/2510135225 wait complete. 2024-09-19T07:18:58.006 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.998+0000 7fb738403740 1 -- start start 2024-09-19T07:18:58.006 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.998+0000 7fb738403740 1 Processor -- start 2024-09-19T07:18:58.006 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.998+0000 7fb738403740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a0fcc19af0 0x55a0fcc21bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:58.006 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.998+0000 7fb738403740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a0fcc1a410 0x55a0fcc22100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:58.006 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.998+0000 7fb738403740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a0fcc24cb0 0x55a0fcc22640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:58.006 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.998+0000 7fb738403740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55a0fcc27880 con 0x55a0fcc19af0 2024-09-19T07:18:58.006 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.998+0000 7fb738403740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55a0fcb07290 con 0x55a0fcc1a410 2024-09-19T07:18:58.006 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.998+0000 7fb738403740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a0fcc27a00 con 0x55a0fcc24cb0 2024-09-19T07:18:58.006 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.998+0000 7fb738403740 10 client.0 _ll_register_callbacks cb 0x55a0fcb38140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:18:58.006 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.998+0000 7fb72effd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a0fcc19af0 0x55a0fcc21bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:58.006 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.998+0000 7fb72effd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a0fcc19af0 0x55a0fcc21bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48478/0 (socket says 172.21.15.148:48478) 2024-09-19T07:18:58.006 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.998+0000 7fb72effd640 1 -- 172.21.15.148:0/322101009 learned_addr learned my addr 172.21.15.148:0/322101009 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:18:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.998+0000 7fb72f7fe640 1 --2- 172.21.15.148:0/322101009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a0fcc24cb0 0x55a0fcc22640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.998+0000 7fb727fff640 1 --2- 172.21.15.148:0/322101009 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a0fcc1a410 0x55a0fcc22100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.999+0000 7fb72effd640 1 -- 172.21.15.148:0/322101009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a0fcc24cb0 msgr2=0x55a0fcc22640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:18:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.999+0000 7fb72effd640 1 --2- 172.21.15.148:0/322101009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a0fcc24cb0 0x55a0fcc22640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.999+0000 7fb72effd640 1 -- 172.21.15.148:0/322101009 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a0fcc1a410 msgr2=0x55a0fcc22100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:18:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.999+0000 7fb72effd640 1 --2- 172.21.15.148:0/322101009 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a0fcc1a410 0x55a0fcc22100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.999+0000 7fb72effd640 1 -- 172.21.15.148:0/322101009 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0fc891210 con 0x55a0fcc19af0 2024-09-19T07:18:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.999+0000 7fb72effd640 1 --2- 172.21.15.148:0/322101009 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a0fcc19af0 0x55a0fcc21bc0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fb7200bc780 tx=0x7fb7200057d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9f6a54897e3401c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:18:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.999+0000 7fb7167fc640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:18:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.999+0000 7fb7167fc640 1 -- 172.21.15.148:0/322101009 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb720049070 con 0x55a0fcc19af0 2024-09-19T07:18:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.999+0000 7fb7167fc640 1 -- 172.21.15.148:0/322101009 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8556+0+0 (secure 0 0 0) 0x7fb7200baaf0 con 0x55a0fcc19af0 2024-09-19T07:18:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.999+0000 7fb738403740 1 -- 172.21.15.148:0/322101009 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb728011c30 con 0x55a0fcc19af0 2024-09-19T07:18:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.999+0000 7fb7167fc640 1 -- 172.21.15.148:0/322101009 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fb7200bc330 con 0x55a0fcc19af0 2024-09-19T07:18:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.999+0000 7fb738403740 10 client.16743 fetch_fsmap learned FSMap version 41 2024-09-19T07:18:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.999+0000 7fb738403740 1 -- 172.21.15.148:0/322101009 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55a0fc95d620 con 0x55a0fcc19af0 2024-09-19T07:18:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.999+0000 7fb7167fc640 1 -- 172.21.15.148:0/322101009 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb728011c30 con 0x55a0fcc19af0 2024-09-19T07:18:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.999+0000 7fb7167fc640 1 -- 172.21.15.148:0/322101009 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 41) ==== 8370+0+0 (secure 0 0 0) 0x7fb7200ef070 con 0x55a0fcc19af0 2024-09-19T07:18:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.999+0000 7fb738403740 10 client.16743 fetch_fsmap finished waiting for FSMap version 41 2024-09-19T07:18:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.999+0000 7fb738403740 10 client.16743 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:18:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:57.999+0000 7fb738403740 20 client.16743 populate_metadata read hostname 'smithi148' 2024-09-19T07:18:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.000+0000 7fb738403740 1 --2- 172.21.15.148:0/322101009 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55a0fcc34bc0 0x55a0fcc37060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.000+0000 7fb738403740 4 client.16743 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:18:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.000+0000 7fb738403740 1 -- 172.21.15.148:0/322101009 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a0fcb8ba20 con 0x55a0fcc34bc0 2024-09-19T07:18:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.000+0000 7fb727fff640 1 --2- 172.21.15.148:0/322101009 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55a0fcc34bc0 0x55a0fcc37060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.000+0000 7fb7167fc640 10 client.16743 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:18:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.000+0000 7fb727fff640 1 --2- 172.21.15.148:0/322101009 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55a0fcc34bc0 0x55a0fcc37060 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=adfd238d54606f10 server_cookie=57da7adeb209022d in_seq=0 out_seq=0 2024-09-19T07:18:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.002+0000 7fb7167fc640 1 -- 172.21.15.148:0/322101009 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a0fcb8ba20 con 0x55a0fcc34bc0 2024-09-19T07:18:58.009 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.002+0000 7fb7167fc640 10 client.16743 handle_command_reply: tid=0 2024-09-19T07:18:58.009 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.002+0000 7fb738403740 1 client.16743 shutdown 2024-09-19T07:18:58.009 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.002+0000 7fb738403740 1 -- 172.21.15.148:0/322101009 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a0fcc19af0 msgr2=0x55a0fcc21bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:58.009 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.002+0000 7fb738403740 1 --2- 172.21.15.148:0/322101009 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a0fcc19af0 0x55a0fcc21bc0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fb7200bc780 tx=0x7fb7200057d0 comp rx=0 tx=0).stop 2024-09-19T07:18:58.009 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.002+0000 7fb738403740 1 -- 172.21.15.148:0/322101009 shutdown_connections 2024-09-19T07:18:58.009 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.002+0000 7fb738403740 1 --2- 172.21.15.148:0/322101009 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55a0fcc34bc0 0x55a0fcc37060 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:58.009 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.002+0000 7fb738403740 1 --2- 172.21.15.148:0/322101009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a0fcc24cb0 0x55a0fcc22640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:58.009 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.002+0000 7fb7167fc640 0 client.16743 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:18:58.009 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.002+0000 7fb738403740 1 --2- 172.21.15.148:0/322101009 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a0fcc1a410 0x55a0fcc22100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:58.009 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.002+0000 7fb738403740 1 --2- 172.21.15.148:0/322101009 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a0fcc19af0 0x55a0fcc21bc0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:58.009 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.002+0000 7fb738403740 1 -- 172.21.15.148:0/322101009 >> 172.21.15.148:0/322101009 conn(0x55a0fcc16060 msgr2=0x55a0fcc1bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:18:58.009 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.002+0000 7fb738403740 1 -- 172.21.15.148:0/322101009 shutdown_connections 2024-09-19T07:18:58.009 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.002+0000 7fb738403740 1 -- 172.21.15.148:0/322101009 wait complete. 2024-09-19T07:18:58.010 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.002+0000 7fb738403740 20 client.16743 trim_cache size 0 max 16384 2024-09-19T07:18:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.016+0000 7fb738403740 1 Processor -- start 2024-09-19T07:18:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.016+0000 7fb738403740 1 -- start start 2024-09-19T07:18:58.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.017+0000 7fb738403740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a0fcc19af0 0x55a0fcc22470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:58.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.017+0000 7fb738403740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a0fcc1a410 0x55a0fcc3c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:58.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.017+0000 7fb738403740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a0fcc24cb0 0x55a0fcc3ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:58.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.017+0000 7fb738403740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb7301b66b0 con 0x55a0fcc24cb0 2024-09-19T07:18:58.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.017+0000 7fb738403740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb7301b3ec0 con 0x55a0fcc1a410 2024-09-19T07:18:58.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.017+0000 7fb738403740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb7301b1d30 con 0x55a0fcc19af0 2024-09-19T07:18:58.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.017+0000 7fb72f7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a0fcc24cb0 0x55a0fcc3ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:58.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.017+0000 7fb72f7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a0fcc24cb0 0x55a0fcc3ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48482/0 (socket says 172.21.15.148:48482) 2024-09-19T07:18:58.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.017+0000 7fb72f7fe640 1 -- 172.21.15.148:0/1947260191 learned_addr learned my addr 172.21.15.148:0/1947260191 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:18:58.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.017+0000 7fb72effd640 1 --2- 172.21.15.148:0/1947260191 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a0fcc19af0 0x55a0fcc22470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:58.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.017+0000 7fb727fff640 1 --2- 172.21.15.148:0/1947260191 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a0fcc1a410 0x55a0fcc3c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.017+0000 7fb72f7fe640 1 -- 172.21.15.148:0/1947260191 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a0fcc19af0 msgr2=0x55a0fcc22470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:18:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.017+0000 7fb72f7fe640 1 --2- 172.21.15.148:0/1947260191 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a0fcc19af0 0x55a0fcc22470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.017+0000 7fb72f7fe640 1 -- 172.21.15.148:0/1947260191 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a0fcc1a410 msgr2=0x55a0fcc3c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:18:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.017+0000 7fb72f7fe640 1 --2- 172.21.15.148:0/1947260191 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a0fcc1a410 0x55a0fcc3c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.017+0000 7fb72f7fe640 1 -- 172.21.15.148:0/1947260191 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0fcc102f0 con 0x55a0fcc24cb0 2024-09-19T07:18:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.017+0000 7fb727fff640 1 --2- 172.21.15.148:0/1947260191 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a0fcc1a410 0x55a0fcc3c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:18:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.017+0000 7fb72f7fe640 1 --2- 172.21.15.148:0/1947260191 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a0fcc24cb0 0x55a0fcc3ceb0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fb7280072e0 tx=0x7fb72801cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3138a93bb8fb137c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:18:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.017+0000 7fb724ff9640 1 -- 172.21.15.148:0/1947260191 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb728036070 con 0x55a0fcc24cb0 2024-09-19T07:18:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.018+0000 7fb724ff9640 1 -- 172.21.15.148:0/1947260191 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb728007890 con 0x55a0fcc24cb0 2024-09-19T07:18:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.018+0000 7fb724ff9640 1 -- 172.21.15.148:0/1947260191 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb728022040 con 0x55a0fcc24cb0 2024-09-19T07:18:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.018+0000 7fb738403740 1 -- 172.21.15.148:0/1947260191 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a0fcc24cb0 msgr2=0x55a0fcc3ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.018+0000 7fb738403740 1 --2- 172.21.15.148:0/1947260191 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a0fcc24cb0 0x55a0fcc3ceb0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fb7280072e0 tx=0x7fb72801cb60 comp rx=0 tx=0).stop 2024-09-19T07:18:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.018+0000 7fb738403740 1 -- 172.21.15.148:0/1947260191 shutdown_connections 2024-09-19T07:18:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.018+0000 7fb738403740 1 --2- 172.21.15.148:0/1947260191 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a0fcc24cb0 0x55a0fcc3ceb0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.018+0000 7fb738403740 1 --2- 172.21.15.148:0/1947260191 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a0fcc1a410 0x55a0fcc3c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.018+0000 7fb738403740 1 --2- 172.21.15.148:0/1947260191 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a0fcc19af0 0x55a0fcc22470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.018+0000 7fb738403740 1 -- 172.21.15.148:0/1947260191 >> 172.21.15.148:0/1947260191 conn(0x55a0fcc16060 msgr2=0x55a0fcc23c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:18:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.018+0000 7fb738403740 1 -- 172.21.15.148:0/1947260191 shutdown_connections 2024-09-19T07:18:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.018+0000 7fb738403740 1 -- 172.21.15.148:0/1947260191 wait complete. 2024-09-19T07:18:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.019+0000 7fb738403740 1 -- start start 2024-09-19T07:18:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.019+0000 7fb738403740 1 Processor -- start 2024-09-19T07:18:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.019+0000 7fb738403740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a0fcc19af0 0x55a0fcc28990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.019+0000 7fb738403740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a0fcc1a410 0x55a0fcc28ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.019+0000 7fb738403740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a0fcc24cb0 0x55a0fcc29410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.019+0000 7fb738403740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb7301b2380 con 0x55a0fcc19af0 2024-09-19T07:18:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.019+0000 7fb738403740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb7301b37f0 con 0x55a0fcc24cb0 2024-09-19T07:18:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.019+0000 7fb738403740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb7301b2a50 con 0x55a0fcc1a410 2024-09-19T07:18:58.025 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.019+0000 7fb738403740 10 client.0 _ll_register_callbacks cb 0x7fb720005890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:18:58.025 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.019+0000 7fb72effd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a0fcc19af0 0x55a0fcc28990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:58.025 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.019+0000 7fb72effd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a0fcc19af0 0x55a0fcc28990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48492/0 (socket says 172.21.15.148:48492) 2024-09-19T07:18:58.025 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.019+0000 7fb72effd640 1 -- 172.21.15.148:0/4044702288 learned_addr learned my addr 172.21.15.148:0/4044702288 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:18:58.025 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.019+0000 7fb727fff640 1 --2- 172.21.15.148:0/4044702288 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a0fcc1a410 0x55a0fcc28ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:58.025 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.019+0000 7fb72f7fe640 1 --2- 172.21.15.148:0/4044702288 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a0fcc24cb0 0x55a0fcc29410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:58.025 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.019+0000 7fb72effd640 1 -- 172.21.15.148:0/4044702288 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a0fcc1a410 msgr2=0x55a0fcc28ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:18:58.025 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.019+0000 7fb72effd640 1 --2- 172.21.15.148:0/4044702288 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a0fcc1a410 0x55a0fcc28ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:58.025 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.019+0000 7fb72effd640 1 -- 172.21.15.148:0/4044702288 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a0fcc24cb0 msgr2=0x55a0fcc29410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:18:58.025 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.019+0000 7fb72effd640 1 --2- 172.21.15.148:0/4044702288 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a0fcc24cb0 0x55a0fcc29410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:58.025 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.019+0000 7fb72effd640 1 -- 172.21.15.148:0/4044702288 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0fcc9e940 con 0x55a0fcc19af0 2024-09-19T07:18:58.025 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.019+0000 7fb72effd640 1 --2- 172.21.15.148:0/4044702288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a0fcc19af0 0x55a0fcc28990 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fb720003fd0 tx=0x7fb7200bad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34353c73d5538e62 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:18:58.026 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.019+0000 7fb7167fc640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:18:58.026 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.020+0000 7fb7167fc640 1 -- 172.21.15.148:0/4044702288 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb720049070 con 0x55a0fcc19af0 2024-09-19T07:18:58.026 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.020+0000 7fb7167fc640 1 -- 172.21.15.148:0/4044702288 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8556+0+0 (secure 0 0 0) 0x7fb7200ede20 con 0x55a0fcc19af0 2024-09-19T07:18:58.026 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.020+0000 7fb738403740 1 -- 172.21.15.148:0/4044702288 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb728007890 con 0x55a0fcc19af0 2024-09-19T07:18:58.026 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.020+0000 7fb7167fc640 1 -- 172.21.15.148:0/4044702288 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fb7200bc150 con 0x55a0fcc19af0 2024-09-19T07:18:58.026 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.020+0000 7fb738403740 10 client.16749 fetch_fsmap learned FSMap version 41 2024-09-19T07:18:58.026 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.020+0000 7fb738403740 1 -- 172.21.15.148:0/4044702288 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55a0fcc9fbe0 con 0x55a0fcc19af0 2024-09-19T07:18:58.026 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.020+0000 7fb7167fc640 1 -- 172.21.15.148:0/4044702288 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb728007890 con 0x55a0fcc19af0 2024-09-19T07:18:58.026 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.020+0000 7fb7167fc640 1 -- 172.21.15.148:0/4044702288 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 41) ==== 8370+0+0 (secure 0 0 0) 0x7fb7200ef070 con 0x55a0fcc19af0 2024-09-19T07:18:58.026 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.020+0000 7fb738403740 10 client.16749 fetch_fsmap finished waiting for FSMap version 41 2024-09-19T07:18:58.026 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.020+0000 7fb738403740 10 client.16749 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:18:58.026 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.020+0000 7fb738403740 20 client.16749 populate_metadata read hostname 'smithi148' 2024-09-19T07:18:58.026 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.020+0000 7fb738403740 1 --2- 172.21.15.148:0/4044702288 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55a0fcca01a0 0x55a0fcca25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:58.027 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.020+0000 7fb738403740 4 client.16749 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:18:58.027 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.020+0000 7fb738403740 1 -- 172.21.15.148:0/4044702288 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a0fcb85d70 con 0x55a0fcca01a0 2024-09-19T07:18:58.027 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.020+0000 7fb727fff640 1 --2- 172.21.15.148:0/4044702288 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55a0fcca01a0 0x55a0fcca25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:58.027 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.021+0000 7fb7167fc640 10 client.16749 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:18:58.027 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.021+0000 7fb727fff640 1 --2- 172.21.15.148:0/4044702288 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55a0fcca01a0 0x55a0fcca25c0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a38f61afa671c031 server_cookie=3bfa41dee60ce848 in_seq=0 out_seq=0 2024-09-19T07:18:58.460 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:18:58.460 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 41, 2024-09-19T07:18:58.460 INFO:teuthology.orchestra.run.smithi148.stdout: "leader": 24457, 2024-09-19T07:18:58.460 INFO:teuthology.orchestra.run.smithi148.stdout: "set_version": 26, 2024-09-19T07:18:58.460 INFO:teuthology.orchestra.run.smithi148.stdout: "sets": { 2024-09-19T07:18:58.460 INFO:teuthology.orchestra.run.smithi148.stdout: "cb62f993": { 2024-09-19T07:18:58.460 INFO:teuthology.orchestra.run.smithi148.stdout: "version": 26, 2024-09-19T07:18:58.461 INFO:teuthology.orchestra.run.smithi148.stdout: "age_ref": 0.0, 2024-09-19T07:18:58.461 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:18:58.461 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "QUIESCED", 2024-09-19T07:18:58.461 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:18:58.461 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:18:58.461 INFO:teuthology.orchestra.run.smithi148.stdout: "timeout": 90.0, 2024-09-19T07:18:58.461 INFO:teuthology.orchestra.run.smithi148.stdout: "expiration": 145.8, 2024-09-19T07:18:58.461 INFO:teuthology.orchestra.run.smithi148.stdout: "members": { 2024-09-19T07:18:58.461 INFO:teuthology.orchestra.run.smithi148.stdout: "file:/": { 2024-09-19T07:18:58.461 INFO:teuthology.orchestra.run.smithi148.stdout: "excluded": false, 2024-09-19T07:18:58.461 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:18:58.461 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "QUIESCED", 2024-09-19T07:18:58.461 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:18:58.461 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:18:58.462 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:18:58.462 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:18:58.462 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:18:58.462 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:18:58.462 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:18:58.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:58.459+0000 7f5ff3fff640 1 -- 172.21.15.148:0/2698616444 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x564c3bc64410 con 0x564c3bd038d0 2024-09-19T07:18:58.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:58.459+0000 7f5ff3fff640 10 client.26077 handle_command_reply: tid=0 2024-09-19T07:18:58.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:58.459+0000 7f601ce87740 1 client.26077 shutdown 2024-09-19T07:18:58.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:58.459+0000 7f601ce87740 1 -- 172.21.15.148:0/2698616444 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564c3bc6c770 msgr2=0x564c3bca7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:58.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:58.459+0000 7f601ce87740 1 --2- 172.21.15.148:0/2698616444 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564c3bc6c770 0x564c3bca7df0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f600c0bbfb0 tx=0x7f600c0bbf20 comp rx=0 tx=0).stop 2024-09-19T07:18:58.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:58.459+0000 7f601ce87740 1 -- 172.21.15.148:0/2698616444 shutdown_connections 2024-09-19T07:18:58.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:58.459+0000 7f601ce87740 1 --2- 172.21.15.148:0/2698616444 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x564c3bd038d0 0x564c3bd05cf0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:58.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:58.459+0000 7f601ce87740 1 --2- 172.21.15.148:0/2698616444 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564c3bc80240 0x564c3bca8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:58.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:58.459+0000 7f601ce87740 1 --2- 172.21.15.148:0/2698616444 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564c3bc6d090 0x564c3bca8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:58.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:58.459+0000 7f601ce87740 1 --2- 172.21.15.148:0/2698616444 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564c3bc6c770 0x564c3bca7df0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:58.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:58.459+0000 7f5ff3fff640 0 client.26077 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:18:58.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:58.459+0000 7f601ce87740 1 -- 172.21.15.148:0/2698616444 >> 172.21.15.148:0/2698616444 conn(0x564c3bc68de0 msgr2=0x564c3bc67ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:18:58.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:58.459+0000 7f601ce87740 1 -- 172.21.15.148:0/2698616444 shutdown_connections 2024-09-19T07:18:58.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:58.459+0000 7f601ce87740 1 -- 172.21.15.148:0/2698616444 wait complete. 2024-09-19T07:18:58.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:58.459+0000 7f601ce87740 20 client.26077 trim_cache size 0 max 16384 2024-09-19T07:18:58.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:58.459+0000 7f601aaae640 1 -- 172.21.15.148:0/1776948509 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f5ffc0a3580 msgr2=0x7f5ffc0a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:58.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:58.459+0000 7f601aaae640 1 --2- 172.21.15.148:0/1776948509 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f5ffc0a3580 0x7f5ffc0a5a40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6008009c00 tx=0x7f60080046c0 comp rx=0 tx=0).stop 2024-09-19T07:18:58.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:58.459+0000 7f601aaae640 1 -- 172.21.15.148:0/1776948509 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6014100a80 msgr2=0x7f60141971a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:58.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:58.459+0000 7f601aaae640 1 --2- 172.21.15.148:0/1776948509 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6014100a80 0x7f60141971a0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f600c034040 tx=0x7f600c030d20 comp rx=0 tx=0).stop 2024-09-19T07:18:58.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:58.459+0000 7f601aaae640 1 -- 172.21.15.148:0/1776948509 shutdown_connections 2024-09-19T07:18:58.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:58.459+0000 7f601aaae640 1 --2- 172.21.15.148:0/1776948509 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f5ffc0a3580 0x7f5ffc0a5a40 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:58.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:58.459+0000 7f601aaae640 1 --2- 172.21.15.148:0/1776948509 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6014106a80 0x7f601419ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:58.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:58.459+0000 7f601aaae640 1 --2- 172.21.15.148:0/1776948509 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6014101420 0x7f60141976e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:58.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:58.459+0000 7f601aaae640 1 --2- 172.21.15.148:0/1776948509 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6014100a80 0x7f60141971a0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:58.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:58.459+0000 7f601aaae640 1 -- 172.21.15.148:0/1776948509 >> 172.21.15.148:0/1776948509 conn(0x7f60140fc7a0 msgr2=0x7f60140fdbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:18:58.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:58.459+0000 7f601aaae640 1 -- 172.21.15.148:0/1776948509 shutdown_connections 2024-09-19T07:18:58.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:18:58.459+0000 7f601aaae640 1 -- 172.21.15.148:0/1776948509 wait complete. 2024-09-19T07:18:58.696 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.694+0000 7fb7167fc640 1 -- 172.21.15.148:0/4044702288 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a0fcb85d70 con 0x55a0fcca01a0 2024-09-19T07:18:58.696 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.694+0000 7fb7167fc640 10 client.16749 handle_command_reply: tid=0 2024-09-19T07:18:58.696 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.694+0000 7fb738403740 1 client.16749 shutdown 2024-09-19T07:18:58.696 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.694+0000 7fb738403740 1 -- 172.21.15.148:0/4044702288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a0fcc19af0 msgr2=0x55a0fcc28990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:58.696 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.694+0000 7fb738403740 1 --2- 172.21.15.148:0/4044702288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a0fcc19af0 0x55a0fcc28990 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fb720003fd0 tx=0x7fb7200bad00 comp rx=0 tx=0).stop 2024-09-19T07:18:58.696 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.694+0000 7fb738403740 1 -- 172.21.15.148:0/4044702288 shutdown_connections 2024-09-19T07:18:58.696 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.694+0000 7fb738403740 1 --2- 172.21.15.148:0/4044702288 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55a0fcca01a0 0x55a0fcca25c0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:58.696 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.694+0000 7fb7167fc640 0 client.16749 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:18:58.696 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.694+0000 7fb738403740 1 --2- 172.21.15.148:0/4044702288 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a0fcc24cb0 0x55a0fcc29410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:58.697 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.694+0000 7fb738403740 1 --2- 172.21.15.148:0/4044702288 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a0fcc1a410 0x55a0fcc28ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:58.697 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.694+0000 7fb738403740 1 --2- 172.21.15.148:0/4044702288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a0fcc19af0 0x55a0fcc28990 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:58.697 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.694+0000 7fb738403740 1 -- 172.21.15.148:0/4044702288 >> 172.21.15.148:0/4044702288 conn(0x55a0fcc16060 msgr2=0x55a0fcc23c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:18:58.697 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.694+0000 7fb738403740 1 -- 172.21.15.148:0/4044702288 shutdown_connections 2024-09-19T07:18:58.697 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.694+0000 7fb738403740 1 -- 172.21.15.148:0/4044702288 wait complete. 2024-09-19T07:18:58.697 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.695+0000 7fb738403740 20 client.16749 trim_cache size 0 max 16384 2024-09-19T07:18:58.697 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:18:58.697 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:18:58.697 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:18:58.697 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:18:58.698 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.695+0000 7fb73558d640 1 -- 172.21.15.148:0/399139040 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fb71c0a3460 msgr2=0x7fb71c0a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:58.698 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.695+0000 7fb73558d640 1 --2- 172.21.15.148:0/399139040 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fb71c0a3460 0x7fb71c0a5920 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb72801f000 tx=0x7fb728020000 comp rx=0 tx=0).stop 2024-09-19T07:18:58.698 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.695+0000 7fb73558d640 1 -- 172.21.15.148:0/399139040 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb730102ce0 msgr2=0x7fb730100930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:58.698 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.695+0000 7fb73558d640 1 --2- 172.21.15.148:0/399139040 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb730102ce0 0x7fb730100930 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fb720006010 tx=0x7fb720004270 comp rx=0 tx=0).stop 2024-09-19T07:18:58.699 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.695+0000 7fb73558d640 1 -- 172.21.15.148:0/399139040 shutdown_connections 2024-09-19T07:18:58.699 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.695+0000 7fb73558d640 1 --2- 172.21.15.148:0/399139040 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fb71c0a3460 0x7fb71c0a5920 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:58.699 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.695+0000 7fb73558d640 1 --2- 172.21.15.148:0/399139040 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb73010c0b0 0x7fb7301013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:58.699 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.695+0000 7fb73558d640 1 --2- 172.21.15.148:0/399139040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb730103600 0x7fb730100e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:58.699 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.695+0000 7fb73558d640 1 --2- 172.21.15.148:0/399139040 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb730102ce0 0x7fb730100930 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:58.699 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.695+0000 7fb73558d640 1 -- 172.21.15.148:0/399139040 >> 172.21.15.148:0/399139040 conn(0x7fb730077990 msgr2=0x7fb7300fcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:18:58.699 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.696+0000 7fb73558d640 1 -- 172.21.15.148:0/399139040 shutdown_connections 2024-09-19T07:18:58.699 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:18:58.696+0000 7fb73558d640 1 -- 172.21.15.148:0/399139040 wait complete. 2024-09-19T07:18:58.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:18:58 smithi179 ceph-mon[35716]: pgmap v243: 97 pgs: 97 active+clean; 1.7 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 478 op/s 2024-09-19T07:18:58.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:18:58 smithi148 ceph-mon[31180]: pgmap v243: 97 pgs: 97 active+clean; 1.7 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 478 op/s 2024-09-19T07:18:58.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:18:58 smithi165 ceph-mon[35326]: pgmap v243: 97 pgs: 97 active+clean; 1.7 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 478 op/s 2024-09-19T07:18:59.658 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'cb62f993', quiesce took 39.9 seconds. Will release after: -14.149999999999999 2024-09-19T07:18:59.659 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:18:59.960 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:19:00.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.451+0000 7f00db930640 1 -- 172.21.15.148:0/3317132884 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00d4102ef0 msgr2=0x7f00d410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:00.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.451+0000 7f00db930640 1 --2- 172.21.15.148:0/3317132884 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00d4102ef0 0x7f00d410da40 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f00cc009ca0 tx=0x7f00cc02a950 comp rx=0 tx=0).stop 2024-09-19T07:19:00.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.451+0000 7f00db930640 1 -- 172.21.15.148:0/3317132884 shutdown_connections 2024-09-19T07:19:00.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.451+0000 7f00db930640 1 --2- 172.21.15.148:0/3317132884 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00d4102ef0 0x7f00d410da40 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:00.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.451+0000 7f00db930640 1 --2- 172.21.15.148:0/3317132884 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f00d4102570 0x7f00d41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:00.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.451+0000 7f00db930640 1 --2- 172.21.15.148:0/3317132884 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00d4100e20 0x7f00d4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:00.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.451+0000 7f00db930640 1 -- 172.21.15.148:0/3317132884 >> 172.21.15.148:0/3317132884 conn(0x7f00d40fc7d0 msgr2=0x7f00d40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:00.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.452+0000 7f00db930640 1 -- 172.21.15.148:0/3317132884 shutdown_connections 2024-09-19T07:19:00.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.452+0000 7f00db930640 1 -- 172.21.15.148:0/3317132884 wait complete. 2024-09-19T07:19:00.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.452+0000 7f00db930640 1 Processor -- start 2024-09-19T07:19:00.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.452+0000 7f00db930640 1 -- start start 2024-09-19T07:19:00.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.452+0000 7f00db930640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00d4100e20 0x7f00d4199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:00.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.452+0000 7f00db930640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00d4102570 0x7f00d4199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:00.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.452+0000 7f00db930640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f00d4102ef0 0x7f00d41a4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:00.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.452+0000 7f00db930640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f00d4110fd0 con 0x7f00d4100e20 2024-09-19T07:19:00.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.452+0000 7f00db930640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f00d4110e50 con 0x7f00d4102ef0 2024-09-19T07:19:00.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.452+0000 7f00db930640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f00d4111150 con 0x7f00d4102570 2024-09-19T07:19:00.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.452+0000 7f00d96cc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00d4100e20 0x7f00d4199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:00.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.453+0000 7f00d96cc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00d4100e20 0x7f00d4199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48516/0 (socket says 172.21.15.148:48516) 2024-09-19T07:19:00.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.453+0000 7f00d96cc640 1 -- 172.21.15.148:0/3450303217 learned_addr learned my addr 172.21.15.148:0/3450303217 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:19:00.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.453+0000 7f00d9ecd640 1 --2- 172.21.15.148:0/3450303217 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f00d4102ef0 0x7f00d41a4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:00.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.453+0000 7f00d8ecb640 1 --2- 172.21.15.148:0/3450303217 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00d4102570 0x7f00d4199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:00.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.453+0000 7f00d96cc640 1 -- 172.21.15.148:0/3450303217 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00d4102570 msgr2=0x7f00d4199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:00.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.453+0000 7f00d96cc640 1 --2- 172.21.15.148:0/3450303217 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00d4102570 0x7f00d4199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:00.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.453+0000 7f00d96cc640 1 -- 172.21.15.148:0/3450303217 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f00d4102ef0 msgr2=0x7f00d41a4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:00.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.453+0000 7f00d96cc640 1 --2- 172.21.15.148:0/3450303217 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f00d4102ef0 0x7f00d41a4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:00.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.453+0000 7f00d96cc640 1 -- 172.21.15.148:0/3450303217 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00d41a48c0 con 0x7f00d4100e20 2024-09-19T07:19:00.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.453+0000 7f00d96cc640 1 --2- 172.21.15.148:0/3450303217 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00d4100e20 0x7f00d4199300 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f00d000c970 tx=0x7f00d000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:00.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.453+0000 7f00ca7fc640 1 -- 172.21.15.148:0/3450303217 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d0007bb0 con 0x7f00d4100e20 2024-09-19T07:19:00.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.453+0000 7f00ca7fc640 1 -- 172.21.15.148:0/3450303217 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00d0007d50 con 0x7f00d4100e20 2024-09-19T07:19:00.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.453+0000 7f00ca7fc640 1 -- 172.21.15.148:0/3450303217 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d000f450 con 0x7f00d4100e20 2024-09-19T07:19:00.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.453+0000 7f00db930640 1 -- 172.21.15.148:0/3450303217 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00d41a4a90 con 0x7f00d4100e20 2024-09-19T07:19:00.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.453+0000 7f00db930640 1 -- 172.21.15.148:0/3450303217 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00d41a4f50 con 0x7f00d4100e20 2024-09-19T07:19:00.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.454+0000 7f00db930640 1 -- 172.21.15.148:0/3450303217 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00d4101200 con 0x7f00d4100e20 2024-09-19T07:19:00.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.456+0000 7f00ca7fc640 1 -- 172.21.15.148:0/3450303217 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f00d0005020 con 0x7f00d4100e20 2024-09-19T07:19:00.472 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.456+0000 7f00ca7fc640 1 --2- 172.21.15.148:0/3450303217 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f00c00a33b0 0x7f00c00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:00.472 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.456+0000 7f00d8ecb640 1 --2- 172.21.15.148:0/3450303217 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f00c00a33b0 0x7f00c00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:00.472 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.456+0000 7f00ca7fc640 1 -- 172.21.15.148:0/3450303217 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8556+0+0 (secure 0 0 0) 0x7f00d00cfb30 con 0x7f00d4100e20 2024-09-19T07:19:00.472 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.457+0000 7f00d8ecb640 1 --2- 172.21.15.148:0/3450303217 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f00c00a33b0 0x7f00c00a5870 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f00c4005fd0 tx=0x7f00c4005850 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:00.472 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.460+0000 7f00ca7fc640 1 -- 172.21.15.148:0/3450303217 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f00d0014030 con 0x7f00d4100e20 2024-09-19T07:19:00.607 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:19:00 smithi148 ceph-mon[31180]: pgmap v244: 97 pgs: 97 active+clean; 1.7 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 496 op/s 2024-09-19T07:19:00.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.678+0000 7f00db930640 1 -- 172.21.15.148:0/3450303217 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f00d406a560 con 0x7f00d4100e20 2024-09-19T07:19:00.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.679+0000 7f00ca7fc640 1 -- 172.21.15.148:0/3450303217 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+11947 (secure 0 0 0) 0x7f00d406a560 con 0x7f00d4100e20 2024-09-19T07:19:00.681 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:19:00.681 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":41,"btime":"2024-09-19T07:18:21:600996+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/4263868576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":4263868576},{"type":"v1","addr":"172.21.15.148:6841","nonce":4263868576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":25606,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3891676893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3891676893},{"type":"v1","addr":"172.21.15.179:6835","nonce":3891676893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":41,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:09:19.543369+0000","modified":"2024-09-19T07:18:21.108238+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24457,"mds_1":24437,"mds_2":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":75,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":71,"addr":"172.21.15.165:6839/3993490234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":3993490234},{"type":"v1","addr":"172.21.15.165:6839","nonce":3993490234}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25823":{"gid":25823,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6835/380886107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":380886107},{"type":"v1","addr":"172.21.15.165:6835","nonce":380886107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24457,"qdb_cluster":[24457,24437,24436]},"id":1}]} 2024-09-19T07:19:00.681 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 41 2024-09-19T07:19:00.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.681+0000 7f00db930640 1 -- 172.21.15.148:0/3450303217 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f00c00a33b0 msgr2=0x7f00c00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:00.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.681+0000 7f00db930640 1 --2- 172.21.15.148:0/3450303217 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f00c00a33b0 0x7f00c00a5870 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f00c4005fd0 tx=0x7f00c4005850 comp rx=0 tx=0).stop 2024-09-19T07:19:00.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.681+0000 7f00db930640 1 -- 172.21.15.148:0/3450303217 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00d4100e20 msgr2=0x7f00d4199300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:00.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.681+0000 7f00db930640 1 --2- 172.21.15.148:0/3450303217 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00d4100e20 0x7f00d4199300 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f00d000c970 tx=0x7f00d000ce30 comp rx=0 tx=0).stop 2024-09-19T07:19:00.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.681+0000 7f00db930640 1 -- 172.21.15.148:0/3450303217 shutdown_connections 2024-09-19T07:19:00.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.681+0000 7f00db930640 1 --2- 172.21.15.148:0/3450303217 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f00c00a33b0 0x7f00c00a5870 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:00.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.681+0000 7f00db930640 1 --2- 172.21.15.148:0/3450303217 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f00d4102ef0 0x7f00d41a4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:00.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.681+0000 7f00db930640 1 --2- 172.21.15.148:0/3450303217 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00d4102570 0x7f00d4199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:00.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.681+0000 7f00db930640 1 --2- 172.21.15.148:0/3450303217 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00d4100e20 0x7f00d4199300 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:00.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.681+0000 7f00db930640 1 -- 172.21.15.148:0/3450303217 >> 172.21.15.148:0/3450303217 conn(0x7f00d40fc7d0 msgr2=0x7f00d4106810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:00.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.682+0000 7f00db930640 1 -- 172.21.15.148:0/3450303217 shutdown_connections 2024-09-19T07:19:00.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:00.682+0000 7f00db930640 1 -- 172.21.15.148:0/3450303217 wait complete. 2024-09-19T07:19:00.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:19:00 smithi179 ceph-mon[35716]: pgmap v244: 97 pgs: 97 active+clean; 1.7 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 496 op/s 2024-09-19T07:19:00.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:19:00 smithi165 ceph-mon[35326]: pgmap v244: 97 pgs: 97 active+clean; 1.7 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 496 op/s 2024-09-19T07:19:01.393 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24457 quiesce db --set-id cb62f993 --release --await' 2024-09-19T07:19:01.393 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24457 quiesce db --set-id cb62f993 --release --await 2024-09-19T07:19:01.638 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:19:01 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/3450303217' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:19:01.655 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:19:01.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:19:01 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/3450303217' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:19:01.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:19:01 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/3450303217' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:19:02.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.154+0000 7f2a7826f640 1 -- 172.21.15.148:0/3622619712 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a70102790 msgr2=0x7f2a701067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:02.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.154+0000 7f2a7826f640 1 --2- 172.21.15.148:0/3622619712 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a70102790 0x7f2a701067e0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f2a60009900 tx=0x7f2a6002a410 comp rx=0 tx=0).stop 2024-09-19T07:19:02.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.154+0000 7f2a7826f640 1 -- 172.21.15.148:0/3622619712 shutdown_connections 2024-09-19T07:19:02.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.154+0000 7f2a7826f640 1 --2- 172.21.15.148:0/3622619712 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a70106f10 0x7f2a7010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:02.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.154+0000 7f2a7826f640 1 --2- 172.21.15.148:0/3622619712 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a70102790 0x7f2a701067e0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:02.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.154+0000 7f2a7826f640 1 --2- 172.21.15.148:0/3622619712 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a70101de0 0x7f2a701021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:02.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.154+0000 7f2a7826f640 1 -- 172.21.15.148:0/3622619712 >> 172.21.15.148:0/3622619712 conn(0x7f2a700fd8c0 msgr2=0x7f2a700ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:02.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.154+0000 7f2a7826f640 1 -- 172.21.15.148:0/3622619712 shutdown_connections 2024-09-19T07:19:02.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.154+0000 7f2a7826f640 1 -- 172.21.15.148:0/3622619712 wait complete. 2024-09-19T07:19:02.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.154+0000 7f2a7826f640 1 Processor -- start 2024-09-19T07:19:02.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.154+0000 7f2a7826f640 1 -- start start 2024-09-19T07:19:02.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.155+0000 7f2a7826f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a70101de0 0x7f2a701984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:02.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.155+0000 7f2a7826f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a70102790 0x7f2a701989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:02.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.155+0000 7f2a7826f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a70106f10 0x7f2a7019cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:02.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.155+0000 7f2a7826f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2a70111f90 con 0x7f2a70106f10 2024-09-19T07:19:02.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.155+0000 7f2a7826f640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2a70111e10 con 0x7f2a70101de0 2024-09-19T07:19:02.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.155+0000 7f2a7826f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2a70112110 con 0x7f2a70102790 2024-09-19T07:19:02.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.155+0000 7f2a7680c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a70106f10 0x7f2a7019cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:02.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.155+0000 7f2a7680c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a70106f10 0x7f2a7019cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48534/0 (socket says 172.21.15.148:48534) 2024-09-19T07:19:02.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.155+0000 7f2a7680c640 1 -- 172.21.15.148:0/637090710 learned_addr learned my addr 172.21.15.148:0/637090710 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:19:02.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.155+0000 7f2a7580a640 1 --2- 172.21.15.148:0/637090710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a70102790 0x7f2a701989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:02.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.155+0000 7f2a7600b640 1 --2- 172.21.15.148:0/637090710 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a70101de0 0x7f2a701984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:02.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.155+0000 7f2a7680c640 1 -- 172.21.15.148:0/637090710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a70102790 msgr2=0x7f2a701989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:02.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.155+0000 7f2a7680c640 1 --2- 172.21.15.148:0/637090710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a70102790 0x7f2a701989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:02.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.155+0000 7f2a7680c640 1 -- 172.21.15.148:0/637090710 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a70101de0 msgr2=0x7f2a701984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:02.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.155+0000 7f2a7680c640 1 --2- 172.21.15.148:0/637090710 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a70101de0 0x7f2a701984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:02.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.155+0000 7f2a7680c640 1 -- 172.21.15.148:0/637090710 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a7019d460 con 0x7f2a70106f10 2024-09-19T07:19:02.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.155+0000 7f2a7600b640 1 --2- 172.21.15.148:0/637090710 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a70101de0 0x7f2a701984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:19:02.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.155+0000 7f2a7680c640 1 --2- 172.21.15.148:0/637090710 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a70106f10 0x7f2a7019cd80 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f2a6800cad0 tx=0x7f2a6800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:02.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.155+0000 7f2a677fe640 1 -- 172.21.15.148:0/637090710 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a6800ae20 con 0x7f2a70106f10 2024-09-19T07:19:02.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.155+0000 7f2a677fe640 1 -- 172.21.15.148:0/637090710 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a68005020 con 0x7f2a70106f10 2024-09-19T07:19:02.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.155+0000 7f2a677fe640 1 -- 172.21.15.148:0/637090710 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a6800f6f0 con 0x7f2a70106f10 2024-09-19T07:19:02.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.155+0000 7f2a7826f640 1 -- 172.21.15.148:0/637090710 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a7019d750 con 0x7f2a70106f10 2024-09-19T07:19:02.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.155+0000 7f2a7826f640 1 -- 172.21.15.148:0/637090710 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a701a5030 con 0x7f2a70106f10 2024-09-19T07:19:02.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.158+0000 7f2a677fe640 1 -- 172.21.15.148:0/637090710 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f2a680051d0 con 0x7f2a70106f10 2024-09-19T07:19:02.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.158+0000 7f2a7a648740 1 Processor -- start 2024-09-19T07:19:02.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.158+0000 7f2a7a648740 1 -- start start 2024-09-19T07:19:02.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.158+0000 7f2a7a648740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc99324f40 0x55dc99325320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:02.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.158+0000 7f2a7a648740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dc99325860 0x55dc99334110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:02.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.158+0000 7f2a7a648740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dc99334650 0x55dc99336a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:02.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.159+0000 7f2a7a648740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55dc9928a620 con 0x55dc99324f40 2024-09-19T07:19:02.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.159+0000 7f2a677fe640 1 --2- 172.21.15.148:0/637090710 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f2a5c0a33b0 0x7f2a5c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:02.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.159+0000 7f2a7a648740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55dc99231e50 con 0x55dc99334650 2024-09-19T07:19:02.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.159+0000 7f2a7a648740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55dc992865e0 con 0x55dc99325860 2024-09-19T07:19:02.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.159+0000 7f2a7580a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc99324f40 0x55dc99325320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:02.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.159+0000 7f2a7580a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc99324f40 0x55dc99325320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48546/0 (socket says 172.21.15.148:48546) 2024-09-19T07:19:02.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.159+0000 7f2a7580a640 1 -- 172.21.15.148:0/457510308 learned_addr learned my addr 172.21.15.148:0/457510308 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:19:02.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.159+0000 7f2a7680c640 1 --2- 172.21.15.148:0/637090710 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f2a5c0a33b0 0x7f2a5c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:02.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.159+0000 7f2a7600b640 1 --2- 172.21.15.148:0/457510308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dc99325860 0x55dc99334110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:02.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.159+0000 7f2a677fe640 1 -- 172.21.15.148:0/637090710 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8556+0+0 (secure 0 0 0) 0x7f2a680cfe40 con 0x7f2a70106f10 2024-09-19T07:19:02.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.159+0000 7f2a7580a640 1 --2- 172.21.15.148:0/457510308 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dc99334650 0x55dc99336a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:02.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.159+0000 7f2a7580a640 1 -- 172.21.15.148:0/457510308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dc99325860 msgr2=0x55dc99334110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:02.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.159+0000 7f2a7580a640 1 --2- 172.21.15.148:0/457510308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dc99325860 0x55dc99334110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:02.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.159+0000 7f2a7580a640 1 -- 172.21.15.148:0/457510308 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dc99334650 msgr2=0x55dc99336a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:02.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.159+0000 7f2a7580a640 1 --2- 172.21.15.148:0/457510308 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dc99334650 0x55dc99336a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:02.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.159+0000 7f2a7580a640 1 -- 172.21.15.148:0/457510308 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc99222d40 con 0x55dc99324f40 2024-09-19T07:19:02.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.159+0000 7f2a7600b640 1 --2- 172.21.15.148:0/457510308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dc99325860 0x55dc99334110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:19:02.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.159+0000 7f2a7580a640 1 --2- 172.21.15.148:0/457510308 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc99324f40 0x55dc99325320 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f2a60005ec0 tx=0x7f2a60005d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cac93ad6974a2600 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:02.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.159+0000 7f2a7680c640 1 --2- 172.21.15.148:0/637090710 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f2a5c0a33b0 0x7f2a5c0a5870 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2a6801c7a0 tx=0x7f2a68091530 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:02.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.159+0000 7f2a64dea640 1 -- 172.21.15.148:0/457510308 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a60035040 con 0x55dc99324f40 2024-09-19T07:19:02.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.159+0000 7f2a64dea640 1 -- 172.21.15.148:0/457510308 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a600035f0 con 0x55dc99324f40 2024-09-19T07:19:02.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.159+0000 7f2a64dea640 1 -- 172.21.15.148:0/457510308 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a6003a5f0 con 0x55dc99324f40 2024-09-19T07:19:02.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.160+0000 7f2a7a648740 1 -- 172.21.15.148:0/457510308 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc99324f40 msgr2=0x55dc99325320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:02.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.160+0000 7f2a7a648740 1 --2- 172.21.15.148:0/457510308 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc99324f40 0x55dc99325320 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f2a60005ec0 tx=0x7f2a60005d90 comp rx=0 tx=0).stop 2024-09-19T07:19:02.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.160+0000 7f2a7a648740 1 -- 172.21.15.148:0/457510308 shutdown_connections 2024-09-19T07:19:02.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.160+0000 7f2a7a648740 1 --2- 172.21.15.148:0/457510308 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dc99334650 0x55dc99336a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:02.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.160+0000 7f2a7a648740 1 --2- 172.21.15.148:0/457510308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dc99325860 0x55dc99334110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:02.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.160+0000 7f2a7a648740 1 --2- 172.21.15.148:0/457510308 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc99324f40 0x55dc99325320 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:02.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.160+0000 7f2a7a648740 1 -- 172.21.15.148:0/457510308 >> 172.21.15.148:0/457510308 conn(0x55dc993215f0 msgr2=0x55dc993219d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:02.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.160+0000 7f2a7a648740 1 -- 172.21.15.148:0/457510308 shutdown_connections 2024-09-19T07:19:02.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.160+0000 7f2a7a648740 1 -- 172.21.15.148:0/457510308 wait complete. 2024-09-19T07:19:02.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.161+0000 7f2a7a648740 1 -- start start 2024-09-19T07:19:02.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.161+0000 7f2a7a648740 1 Processor -- start 2024-09-19T07:19:02.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.161+0000 7f2a7a648740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc99324f40 0x55dc99331580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:02.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.161+0000 7f2a7a648740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dc99325860 0x55dc99331ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:02.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.161+0000 7f2a7a648740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dc99334650 0x55dc99332000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:02.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.161+0000 7f2a7a648740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55dc99337220 con 0x55dc99324f40 2024-09-19T07:19:02.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.161+0000 7f2a7a648740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55dc99212f10 con 0x55dc99334650 2024-09-19T07:19:02.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.161+0000 7f2a7a648740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55dc993373a0 con 0x55dc99325860 2024-09-19T07:19:02.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.161+0000 7f2a7a648740 10 client.0 _ll_register_callbacks cb 0x55dc99236db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:19:02.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.161+0000 7f2a7580a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc99324f40 0x55dc99331580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:02.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.161+0000 7f2a7580a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc99324f40 0x55dc99331580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48562/0 (socket says 172.21.15.148:48562) 2024-09-19T07:19:02.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.161+0000 7f2a7580a640 1 -- 172.21.15.148:0/2518307354 learned_addr learned my addr 172.21.15.148:0/2518307354 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:19:02.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.161+0000 7f2a7600b640 1 --2- 172.21.15.148:0/2518307354 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dc99325860 0x55dc99331ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:02.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.161+0000 7f2a7580a640 1 -- 172.21.15.148:0/2518307354 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dc99325860 msgr2=0x55dc99331ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:02.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.161+0000 7f2a7580a640 1 --2- 172.21.15.148:0/2518307354 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dc99325860 0x55dc99331ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:02.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.161+0000 7f2a7580a640 1 -- 172.21.15.148:0/2518307354 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dc99334650 msgr2=0x55dc99332000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:02.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.161+0000 7f2a7580a640 1 --2- 172.21.15.148:0/2518307354 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dc99334650 0x55dc99332000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:02.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.161+0000 7f2a7580a640 1 -- 172.21.15.148:0/2518307354 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc98f99580 con 0x55dc99324f40 2024-09-19T07:19:02.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.161+0000 7f2a7600b640 1 --2- 172.21.15.148:0/2518307354 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dc99325860 0x55dc99331ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:19:02.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.161+0000 7f2a7580a640 1 --2- 172.21.15.148:0/2518307354 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc99324f40 0x55dc99331580 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f2a60005980 tx=0x7f2a60031820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58e0c763b70330ac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:02.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.161+0000 7f2a59ffb640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:19:02.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.162+0000 7f2a59ffb640 1 -- 172.21.15.148:0/2518307354 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a6004f020 con 0x55dc99324f40 2024-09-19T07:19:02.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.162+0000 7f2a59ffb640 1 -- 172.21.15.148:0/2518307354 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8556+0+0 (secure 0 0 0) 0x7f2a600037a0 con 0x55dc99324f40 2024-09-19T07:19:02.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.162+0000 7f2a7a648740 1 -- 172.21.15.148:0/2518307354 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a600035f0 con 0x55dc99324f40 2024-09-19T07:19:02.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.162+0000 7f2a59ffb640 1 -- 172.21.15.148:0/2518307354 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f2a60035040 con 0x55dc99324f40 2024-09-19T07:19:02.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.162+0000 7f2a7a648740 10 client.16767 fetch_fsmap learned FSMap version 41 2024-09-19T07:19:02.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.162+0000 7f2a7a648740 1 -- 172.21.15.148:0/2518307354 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55dc99063960 con 0x55dc99324f40 2024-09-19T07:19:02.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.162+0000 7f2a59ffb640 1 -- 172.21.15.148:0/2518307354 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a600035f0 con 0x55dc99324f40 2024-09-19T07:19:02.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.162+0000 7f2a59ffb640 1 -- 172.21.15.148:0/2518307354 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 41) ==== 8370+0+0 (secure 0 0 0) 0x7f2a60049ce0 con 0x55dc99324f40 2024-09-19T07:19:02.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.162+0000 7f2a7a648740 10 client.16767 fetch_fsmap finished waiting for FSMap version 41 2024-09-19T07:19:02.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.162+0000 7f2a7a648740 10 client.16767 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:19:02.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.162+0000 7f2a7a648740 20 client.16767 populate_metadata read hostname 'smithi148' 2024-09-19T07:19:02.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.162+0000 7f2a7a648740 1 --2- 172.21.15.148:0/2518307354 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55dc993440c0 0x55dc993464b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:02.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.162+0000 7f2a7a648740 4 client.16767 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:19:02.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.162+0000 7f2a7a648740 1 -- 172.21.15.148:0/2518307354 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dc99297b90 con 0x55dc993440c0 2024-09-19T07:19:02.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.163+0000 7f2a7600b640 1 --2- 172.21.15.148:0/2518307354 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55dc993440c0 0x55dc993464b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:02.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.163+0000 7f2a7600b640 1 --2- 172.21.15.148:0/2518307354 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55dc993440c0 0x55dc993464b0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5e61aa45429af6b server_cookie=d695a0e49898dc26 in_seq=0 out_seq=0 2024-09-19T07:19:02.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.163+0000 7f2a59ffb640 10 client.16767 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:19:02.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.164+0000 7f2a59ffb640 1 -- 172.21.15.148:0/2518307354 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dc99297b90 con 0x55dc993440c0 2024-09-19T07:19:02.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.164+0000 7f2a59ffb640 10 client.16767 handle_command_reply: tid=0 2024-09-19T07:19:02.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.164+0000 7f2a7a648740 1 client.16767 shutdown 2024-09-19T07:19:02.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.164+0000 7f2a7a648740 1 -- 172.21.15.148:0/2518307354 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc99324f40 msgr2=0x55dc99331580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:02.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.164+0000 7f2a7a648740 1 --2- 172.21.15.148:0/2518307354 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc99324f40 0x55dc99331580 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f2a60005980 tx=0x7f2a60031820 comp rx=0 tx=0).stop 2024-09-19T07:19:02.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.164+0000 7f2a7a648740 1 -- 172.21.15.148:0/2518307354 shutdown_connections 2024-09-19T07:19:02.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.164+0000 7f2a7a648740 1 --2- 172.21.15.148:0/2518307354 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55dc993440c0 0x55dc993464b0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:02.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.164+0000 7f2a7a648740 1 --2- 172.21.15.148:0/2518307354 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dc99334650 0x55dc99332000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:02.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.164+0000 7f2a59ffb640 0 client.16767 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:19:02.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.164+0000 7f2a7a648740 1 --2- 172.21.15.148:0/2518307354 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dc99325860 0x55dc99331ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:02.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.164+0000 7f2a7a648740 1 --2- 172.21.15.148:0/2518307354 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc99324f40 0x55dc99331580 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:02.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.164+0000 7f2a7a648740 1 -- 172.21.15.148:0/2518307354 >> 172.21.15.148:0/2518307354 conn(0x55dc993215f0 msgr2=0x55dc99327350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:02.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.164+0000 7f2a7a648740 1 -- 172.21.15.148:0/2518307354 shutdown_connections 2024-09-19T07:19:02.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.164+0000 7f2a7a648740 1 -- 172.21.15.148:0/2518307354 wait complete. 2024-09-19T07:19:02.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.164+0000 7f2a7a648740 20 client.16767 trim_cache size 0 max 16384 2024-09-19T07:19:02.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.181+0000 7f2a7a648740 1 Processor -- start 2024-09-19T07:19:02.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.181+0000 7f2a7a648740 1 -- start start 2024-09-19T07:19:02.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.182+0000 7f2a7a648740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dc99324f40 0x55dc99331c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:02.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.182+0000 7f2a7a648740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dc99325860 0x55dc99332190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:02.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.182+0000 7f2a7a648740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc99334650 0x55dc9934bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:02.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.182+0000 7f2a7a648740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2a701adfe0 con 0x55dc99334650 2024-09-19T07:19:02.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.182+0000 7f2a7a648740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2a701ab7f0 con 0x55dc99324f40 2024-09-19T07:19:02.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.182+0000 7f2a7a648740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2a701a9660 con 0x55dc99325860 2024-09-19T07:19:02.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.182+0000 7f2a7580a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc99334650 0x55dc9934bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:02.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.182+0000 7f2a7580a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc99334650 0x55dc9934bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48566/0 (socket says 172.21.15.148:48566) 2024-09-19T07:19:02.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.182+0000 7f2a7580a640 1 -- 172.21.15.148:0/2892720541 learned_addr learned my addr 172.21.15.148:0/2892720541 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:19:02.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.182+0000 7f2a7600b640 1 --2- 172.21.15.148:0/2892720541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dc99325860 0x55dc99332190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:02.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.182+0000 7f2a7580a640 1 --2- 172.21.15.148:0/2892720541 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dc99324f40 0x55dc99331c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:02.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.182+0000 7f2a7580a640 1 -- 172.21.15.148:0/2892720541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dc99325860 msgr2=0x55dc99332190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:02.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.182+0000 7f2a7580a640 1 --2- 172.21.15.148:0/2892720541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dc99325860 0x55dc99332190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:02.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.182+0000 7f2a7580a640 1 -- 172.21.15.148:0/2892720541 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dc99324f40 msgr2=0x55dc99331c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:02.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.182+0000 7f2a7580a640 1 --2- 172.21.15.148:0/2892720541 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dc99324f40 0x55dc99331c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:02.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.182+0000 7f2a7580a640 1 -- 172.21.15.148:0/2892720541 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc99325690 con 0x55dc99334650 2024-09-19T07:19:02.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.182+0000 7f2a7580a640 1 --2- 172.21.15.148:0/2892720541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc99334650 0x55dc9934bab0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f2a60009870 tx=0x7f2a6003f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79246e07a8d7aad2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:02.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.182+0000 7f2a5bfff640 1 -- 172.21.15.148:0/2892720541 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a6005c070 con 0x55dc99334650 2024-09-19T07:19:02.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.182+0000 7f2a5bfff640 1 -- 172.21.15.148:0/2892720541 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a60031a20 con 0x55dc99334650 2024-09-19T07:19:02.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.182+0000 7f2a5bfff640 1 -- 172.21.15.148:0/2892720541 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a6004f040 con 0x55dc99334650 2024-09-19T07:19:02.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.183+0000 7f2a7a648740 1 -- 172.21.15.148:0/2892720541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc99334650 msgr2=0x55dc9934bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:02.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.183+0000 7f2a7a648740 1 --2- 172.21.15.148:0/2892720541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc99334650 0x55dc9934bab0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f2a60009870 tx=0x7f2a6003f040 comp rx=0 tx=0).stop 2024-09-19T07:19:02.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.183+0000 7f2a7a648740 1 -- 172.21.15.148:0/2892720541 shutdown_connections 2024-09-19T07:19:02.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.183+0000 7f2a7a648740 1 --2- 172.21.15.148:0/2892720541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc99334650 0x55dc9934bab0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:02.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.183+0000 7f2a7a648740 1 --2- 172.21.15.148:0/2892720541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dc99325860 0x55dc99332190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:02.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.183+0000 7f2a7a648740 1 --2- 172.21.15.148:0/2892720541 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dc99324f40 0x55dc99331c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:02.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.183+0000 7f2a7a648740 1 -- 172.21.15.148:0/2892720541 >> 172.21.15.148:0/2892720541 conn(0x55dc993215f0 msgr2=0x55dc99331540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:02.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.183+0000 7f2a7a648740 1 -- 172.21.15.148:0/2892720541 shutdown_connections 2024-09-19T07:19:02.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.183+0000 7f2a7a648740 1 -- 172.21.15.148:0/2892720541 wait complete. 2024-09-19T07:19:02.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.184+0000 7f2a7a648740 1 -- start start 2024-09-19T07:19:02.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.184+0000 7f2a7a648740 1 Processor -- start 2024-09-19T07:19:02.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.184+0000 7f2a7a648740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dc99324f40 0x55dc9933cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:02.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.184+0000 7f2a7a648740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc99325860 0x55dc993391e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:02.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.184+0000 7f2a7a648740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dc99334650 0x55dc993397d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:02.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.184+0000 7f2a7a648740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2a701a9cb0 con 0x55dc99325860 2024-09-19T07:19:02.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.184+0000 7f2a7a648740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2a701ab120 con 0x55dc99324f40 2024-09-19T07:19:02.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.184+0000 7f2a7a648740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2a701aa380 con 0x55dc99334650 2024-09-19T07:19:02.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.184+0000 7f2a7a648740 10 client.0 _ll_register_callbacks cb 0x7f2a60031750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:19:02.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.184+0000 7f2a7600b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc99325860 0x55dc993391e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:02.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.184+0000 7f2a7600b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc99325860 0x55dc993391e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48572/0 (socket says 172.21.15.148:48572) 2024-09-19T07:19:02.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.184+0000 7f2a7600b640 1 -- 172.21.15.148:0/3917055950 learned_addr learned my addr 172.21.15.148:0/3917055950 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:19:02.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.184+0000 7f2a7580a640 1 --2- 172.21.15.148:0/3917055950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dc99334650 0x55dc993397d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:02.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.184+0000 7f2a7600b640 1 -- 172.21.15.148:0/3917055950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dc99334650 msgr2=0x55dc993397d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:02.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.184+0000 7f2a7600b640 1 --2- 172.21.15.148:0/3917055950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dc99334650 0x55dc993397d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:02.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.184+0000 7f2a7580a640 1 --2- 172.21.15.148:0/3917055950 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dc99324f40 0x55dc9933cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:02.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.184+0000 7f2a7600b640 1 -- 172.21.15.148:0/3917055950 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dc99324f40 msgr2=0x55dc9933cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:02.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.184+0000 7f2a7600b640 1 --2- 172.21.15.148:0/3917055950 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dc99324f40 0x55dc9933cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:02.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.184+0000 7f2a7600b640 1 -- 172.21.15.148:0/3917055950 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc9933a000 con 0x55dc99325860 2024-09-19T07:19:02.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.185+0000 7f2a7600b640 1 --2- 172.21.15.148:0/3917055950 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc99325860 0x55dc993391e0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x55dc99330e10 tx=0x7f2a6c0157f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec85f803eca781e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:02.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.185+0000 7f2a59ffb640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:19:02.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.185+0000 7f2a59ffb640 1 -- 172.21.15.148:0/3917055950 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c0145c0 con 0x55dc99325860 2024-09-19T07:19:02.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.185+0000 7f2a59ffb640 1 -- 172.21.15.148:0/3917055950 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8556+0+0 (secure 0 0 0) 0x7f2a6c014760 con 0x55dc99325860 2024-09-19T07:19:02.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.185+0000 7f2a7a648740 1 -- 172.21.15.148:0/3917055950 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a60031a20 con 0x55dc99325860 2024-09-19T07:19:02.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.185+0000 7f2a59ffb640 1 -- 172.21.15.148:0/3917055950 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f2a6c014960 con 0x55dc99325860 2024-09-19T07:19:02.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.185+0000 7f2a7a648740 10 client.16773 fetch_fsmap learned FSMap version 41 2024-09-19T07:19:02.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.185+0000 7f2a7a648740 1 -- 172.21.15.148:0/3917055950 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55dc993afc70 con 0x55dc99325860 2024-09-19T07:19:02.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.185+0000 7f2a59ffb640 1 -- 172.21.15.148:0/3917055950 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a60031a20 con 0x55dc99325860 2024-09-19T07:19:02.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.185+0000 7f2a59ffb640 1 -- 172.21.15.148:0/3917055950 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 41) ==== 8370+0+0 (secure 0 0 0) 0x7f2a6c022070 con 0x55dc99325860 2024-09-19T07:19:02.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.185+0000 7f2a7a648740 10 client.16773 fetch_fsmap finished waiting for FSMap version 41 2024-09-19T07:19:02.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.185+0000 7f2a7a648740 10 client.16773 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:19:02.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.185+0000 7f2a7a648740 20 client.16773 populate_metadata read hostname 'smithi148' 2024-09-19T07:19:02.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.185+0000 7f2a7a648740 1 --2- 172.21.15.148:0/3917055950 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55dc993b0450 0x55dc993b2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:02.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.185+0000 7f2a7a648740 4 client.16773 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "cb62f993", "release": true, "await": true}] 2024-09-19T07:19:02.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.185+0000 7f2a7a648740 1 -- 172.21.15.148:0/3917055950 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "quiesce db", "set_id": "cb62f993", "release": true, "await": true}) -- 0x55dc992920a0 con 0x55dc993b0450 2024-09-19T07:19:02.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.186+0000 7f2a7580a640 1 --2- 172.21.15.148:0/3917055950 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55dc993b0450 0x55dc993b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:02.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.186+0000 7f2a7580a640 1 --2- 172.21.15.148:0/3917055950 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55dc993b0450 0x55dc993b2870 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1edafd19fad1d8d1 server_cookie=a600ec497530a137 in_seq=0 out_seq=0 2024-09-19T07:19:02.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:02.186+0000 7f2a59ffb640 10 client.16773 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:19:02.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:19:02 smithi179 ceph-mon[35716]: pgmap v245: 97 pgs: 97 active+clean; 1.7 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.8 MiB/s wr, 766 op/s 2024-09-19T07:19:02.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:19:02 smithi148 ceph-mon[31180]: pgmap v245: 97 pgs: 97 active+clean; 1.7 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.8 MiB/s wr, 766 op/s 2024-09-19T07:19:02.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:19:02 smithi165 ceph-mon[35326]: pgmap v245: 97 pgs: 97 active+clean; 1.7 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.8 MiB/s wr, 766 op/s 2024-09-19T07:19:03.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:03.233+0000 7f2a59ffb640 1 -- 172.21.15.148:0/3917055950 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55dc992920a0 con 0x55dc993b0450 2024-09-19T07:19:03.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:03.233+0000 7f2a59ffb640 10 client.16773 handle_command_reply: tid=0 2024-09-19T07:19:03.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:03.233+0000 7f2a7a648740 1 client.16773 shutdown 2024-09-19T07:19:03.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:03.233+0000 7f2a7a648740 1 -- 172.21.15.148:0/3917055950 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc99325860 msgr2=0x55dc993391e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:03.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:03.233+0000 7f2a7a648740 1 --2- 172.21.15.148:0/3917055950 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc99325860 0x55dc993391e0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x55dc99330e10 tx=0x7f2a6c0157f0 comp rx=0 tx=0).stop 2024-09-19T07:19:03.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:03.233+0000 7f2a7a648740 1 -- 172.21.15.148:0/3917055950 shutdown_connections 2024-09-19T07:19:03.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:03.233+0000 7f2a7a648740 1 --2- 172.21.15.148:0/3917055950 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55dc993b0450 0x55dc993b2870 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:03.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:03.233+0000 7f2a7a648740 1 --2- 172.21.15.148:0/3917055950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dc99334650 0x55dc993397d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:03.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:03.233+0000 7f2a7a648740 1 --2- 172.21.15.148:0/3917055950 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc99325860 0x55dc993391e0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:03.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:03.233+0000 7f2a7a648740 1 --2- 172.21.15.148:0/3917055950 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dc99324f40 0x55dc9933cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:03.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:03.233+0000 7f2a7a648740 1 -- 172.21.15.148:0/3917055950 >> 172.21.15.148:0/3917055950 conn(0x55dc993215f0 msgr2=0x55dc99333950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:03.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:03.233+0000 7f2a59ffb640 0 client.16773 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:19:03.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:03.234+0000 7f2a7a648740 1 -- 172.21.15.148:0/3917055950 shutdown_connections 2024-09-19T07:19:03.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:03.234+0000 7f2a7a648740 1 -- 172.21.15.148:0/3917055950 wait complete. 2024-09-19T07:19:03.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:03.234+0000 7f2a7a648740 20 client.16773 trim_cache size 0 max 16384 2024-09-19T07:19:03.236 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:19:03.236 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 41, 2024-09-19T07:19:03.236 INFO:teuthology.orchestra.run.smithi148.stdout: "leader": 24457, 2024-09-19T07:19:03.236 INFO:teuthology.orchestra.run.smithi148.stdout: "set_version": 28, 2024-09-19T07:19:03.237 INFO:teuthology.orchestra.run.smithi148.stdout: "sets": { 2024-09-19T07:19:03.237 INFO:teuthology.orchestra.run.smithi148.stdout: "cb62f993": { 2024-09-19T07:19:03.237 INFO:teuthology.orchestra.run.smithi148.stdout: "version": 28, 2024-09-19T07:19:03.237 INFO:teuthology.orchestra.run.smithi148.stdout: "age_ref": 0.0, 2024-09-19T07:19:03.237 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:19:03.237 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RELEASED", 2024-09-19T07:19:03.237 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:19:03.237 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:19:03.237 INFO:teuthology.orchestra.run.smithi148.stdout: "timeout": 90.0, 2024-09-19T07:19:03.237 INFO:teuthology.orchestra.run.smithi148.stdout: "expiration": 145.8, 2024-09-19T07:19:03.237 INFO:teuthology.orchestra.run.smithi148.stdout: "members": { 2024-09-19T07:19:03.238 INFO:teuthology.orchestra.run.smithi148.stdout: "file:/": { 2024-09-19T07:19:03.238 INFO:teuthology.orchestra.run.smithi148.stdout: "excluded": false, 2024-09-19T07:19:03.238 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:19:03.238 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RELEASED", 2024-09-19T07:19:03.238 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:19:03.238 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:19:03.238 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:19:03.238 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:19:03.238 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:19:03.238 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:19:03.238 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:19:03.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:03.234+0000 7f2a7826f640 1 -- 172.21.15.148:0/637090710 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f2a5c0a33b0 msgr2=0x7f2a5c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:03.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:03.234+0000 7f2a7826f640 1 --2- 172.21.15.148:0/637090710 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f2a5c0a33b0 0x7f2a5c0a5870 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2a6801c7a0 tx=0x7f2a68091530 comp rx=0 tx=0).stop 2024-09-19T07:19:03.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:03.235+0000 7f2a7826f640 1 -- 172.21.15.148:0/637090710 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a70106f10 msgr2=0x7f2a7019cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:03.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:03.235+0000 7f2a7826f640 1 --2- 172.21.15.148:0/637090710 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a70106f10 0x7f2a7019cd80 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f2a6800cad0 tx=0x7f2a6800cf90 comp rx=0 tx=0).stop 2024-09-19T07:19:03.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:03.235+0000 7f2a7826f640 1 -- 172.21.15.148:0/637090710 shutdown_connections 2024-09-19T07:19:03.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:03.235+0000 7f2a7826f640 1 --2- 172.21.15.148:0/637090710 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f2a5c0a33b0 0x7f2a5c0a5870 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:03.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:03.235+0000 7f2a7826f640 1 --2- 172.21.15.148:0/637090710 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a70106f10 0x7f2a7019cd80 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:03.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:03.235+0000 7f2a7826f640 1 --2- 172.21.15.148:0/637090710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a70102790 0x7f2a701989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:03.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:03.235+0000 7f2a7826f640 1 --2- 172.21.15.148:0/637090710 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a70101de0 0x7f2a701984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:03.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:03.235+0000 7f2a7826f640 1 -- 172.21.15.148:0/637090710 >> 172.21.15.148:0/637090710 conn(0x7f2a700fd8c0 msgr2=0x7f2a700fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:03.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:03.235+0000 7f2a7826f640 1 -- 172.21.15.148:0/637090710 shutdown_connections 2024-09-19T07:19:03.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:03.235+0000 7f2a7826f640 1 -- 172.21.15.148:0/637090710 wait complete. 2024-09-19T07:19:03.941 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'cb62f993', total seconds elapsed: 44.1 2024-09-19T07:19:03.941 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 25.75 2024-09-19T07:19:03.941 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:19:04.199 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:19:04.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:19:04 smithi148 ceph-mon[31180]: pgmap v246: 97 pgs: 97 active+clean; 1.7 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 519 op/s 2024-09-19T07:19:04.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.715+0000 7f495a498640 1 -- 172.21.15.148:0/580148263 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4954100330 msgr2=0x7f4954100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:04.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.715+0000 7f495a498640 1 --2- 172.21.15.148:0/580148263 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4954100330 0x7f4954100710 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f4944009930 tx=0x7f494402a420 comp rx=0 tx=0).stop 2024-09-19T07:19:04.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.715+0000 7f495a498640 1 -- 172.21.15.148:0/580148263 shutdown_connections 2024-09-19T07:19:04.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.715+0000 7f495a498640 1 --2- 172.21.15.148:0/580148263 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4954106f30 0x7f495410ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:04.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.715+0000 7f495a498640 1 --2- 172.21.15.148:0/580148263 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4954100ce0 0x7f4954106820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:04.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.715+0000 7f495a498640 1 --2- 172.21.15.148:0/580148263 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4954100330 0x7f4954100710 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:04.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.715+0000 7f495a498640 1 -- 172.21.15.148:0/580148263 >> 172.21.15.148:0/580148263 conn(0x7f49540fbee0 msgr2=0x7f49540fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:04.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.715+0000 7f495a498640 1 -- 172.21.15.148:0/580148263 shutdown_connections 2024-09-19T07:19:04.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.715+0000 7f495a498640 1 -- 172.21.15.148:0/580148263 wait complete. 2024-09-19T07:19:04.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.716+0000 7f495a498640 1 Processor -- start 2024-09-19T07:19:04.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.716+0000 7f495a498640 1 -- start start 2024-09-19T07:19:04.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.716+0000 7f495a498640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4954100330 0x7f49541012b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:04.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.716+0000 7f495a498640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4954100ce0 0x7f49541017f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:04.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.716+0000 7f495a498640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4954106f30 0x7f4954101d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:04.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.716+0000 7f495a498640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4954112000 con 0x7f4954100ce0 2024-09-19T07:19:04.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.716+0000 7f495a498640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4954111e80 con 0x7f4954106f30 2024-09-19T07:19:04.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.716+0000 7f495a498640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4954112180 con 0x7f4954100330 2024-09-19T07:19:04.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.716+0000 7f494bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4954100ce0 0x7f49541017f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:04.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.716+0000 7f494bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4954100ce0 0x7f49541017f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57290/0 (socket says 172.21.15.148:57290) 2024-09-19T07:19:04.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.716+0000 7f494bfff640 1 -- 172.21.15.148:0/3594443600 learned_addr learned my addr 172.21.15.148:0/3594443600 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:19:04.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.717+0000 7f4953fff640 1 --2- 172.21.15.148:0/3594443600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4954100330 0x7f49541012b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:04.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.717+0000 7f4958a35640 1 --2- 172.21.15.148:0/3594443600 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4954106f30 0x7f4954101d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:04.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.717+0000 7f494bfff640 1 -- 172.21.15.148:0/3594443600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4954100330 msgr2=0x7f49541012b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:04.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.717+0000 7f494bfff640 1 --2- 172.21.15.148:0/3594443600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4954100330 0x7f49541012b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:04.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.717+0000 7f494bfff640 1 -- 172.21.15.148:0/3594443600 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4954106f30 msgr2=0x7f4954101d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:04.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.717+0000 7f494bfff640 1 --2- 172.21.15.148:0/3594443600 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4954106f30 0x7f4954101d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:04.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.717+0000 7f494bfff640 1 -- 172.21.15.148:0/3594443600 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49541a69e0 con 0x7f4954100ce0 2024-09-19T07:19:04.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.717+0000 7f494bfff640 1 --2- 172.21.15.148:0/3594443600 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4954100ce0 0x7f49541017f0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f493c00b450 tx=0x7f493c00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:04.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.717+0000 7f4951ffb640 1 -- 172.21.15.148:0/3594443600 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f493c015020 con 0x7f4954100ce0 2024-09-19T07:19:04.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.717+0000 7f495a498640 1 -- 172.21.15.148:0/3594443600 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49541a6cd0 con 0x7f4954100ce0 2024-09-19T07:19:04.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.717+0000 7f4951ffb640 1 -- 172.21.15.148:0/3594443600 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f493c011d70 con 0x7f4954100ce0 2024-09-19T07:19:04.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.717+0000 7f4951ffb640 1 -- 172.21.15.148:0/3594443600 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f493c00f340 con 0x7f4954100ce0 2024-09-19T07:19:04.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.717+0000 7f495a498640 1 -- 172.21.15.148:0/3594443600 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49541a7200 con 0x7f4954100ce0 2024-09-19T07:19:04.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.718+0000 7f495a498640 1 -- 172.21.15.148:0/3594443600 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4954100710 con 0x7f4954100ce0 2024-09-19T07:19:04.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.719+0000 7f4951ffb640 1 -- 172.21.15.148:0/3594443600 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f493c018020 con 0x7f4954100ce0 2024-09-19T07:19:04.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.720+0000 7f4951ffb640 1 --2- 172.21.15.148:0/3594443600 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f49400a33b0 0x7f49400a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:04.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.720+0000 7f4953fff640 1 --2- 172.21.15.148:0/3594443600 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f49400a33b0 0x7f49400a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:04.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.720+0000 7f4951ffb640 1 -- 172.21.15.148:0/3594443600 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8556+0+0 (secure 0 0 0) 0x7f493c0cf6b0 con 0x7f4954100ce0 2024-09-19T07:19:04.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.721+0000 7f4953fff640 1 --2- 172.21.15.148:0/3594443600 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f49400a33b0 0x7f49400a5870 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4944009900 tx=0x7f49440058d0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:04.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.724+0000 7f4951ffb640 1 -- 172.21.15.148:0/3594443600 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f493c01f020 con 0x7f4954100ce0 2024-09-19T07:19:04.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:19:04 smithi179 ceph-mon[35716]: pgmap v246: 97 pgs: 97 active+clean; 1.7 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 519 op/s 2024-09-19T07:19:04.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:19:04 smithi165 ceph-mon[35326]: pgmap v246: 97 pgs: 97 active+clean; 1.7 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 519 op/s 2024-09-19T07:19:04.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.924+0000 7f495a498640 1 -- 172.21.15.148:0/3594443600 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f495402d7c0 con 0x7f4954100ce0 2024-09-19T07:19:04.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.924+0000 7f4951ffb640 1 -- 172.21.15.148:0/3594443600 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+11947 (secure 0 0 0) 0x7f493c00d040 con 0x7f4954100ce0 2024-09-19T07:19:04.926 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:19:04.926 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":41,"btime":"2024-09-19T07:18:21:600996+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/4263868576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":4263868576},{"type":"v1","addr":"172.21.15.148:6841","nonce":4263868576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":25606,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3891676893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3891676893},{"type":"v1","addr":"172.21.15.179:6835","nonce":3891676893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":41,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:09:19.543369+0000","modified":"2024-09-19T07:18:21.108238+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24457,"mds_1":24437,"mds_2":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":75,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":71,"addr":"172.21.15.165:6839/3993490234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":3993490234},{"type":"v1","addr":"172.21.15.165:6839","nonce":3993490234}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25823":{"gid":25823,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6835/380886107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":380886107},{"type":"v1","addr":"172.21.15.165:6835","nonce":380886107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24457,"qdb_cluster":[24457,24437,24436]},"id":1}]} 2024-09-19T07:19:04.926 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 41 2024-09-19T07:19:04.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.926+0000 7f495a498640 1 -- 172.21.15.148:0/3594443600 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f49400a33b0 msgr2=0x7f49400a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:04.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.926+0000 7f495a498640 1 --2- 172.21.15.148:0/3594443600 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f49400a33b0 0x7f49400a5870 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4944009900 tx=0x7f49440058d0 comp rx=0 tx=0).stop 2024-09-19T07:19:04.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.927+0000 7f495a498640 1 -- 172.21.15.148:0/3594443600 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4954100ce0 msgr2=0x7f49541017f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:04.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.927+0000 7f495a498640 1 --2- 172.21.15.148:0/3594443600 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4954100ce0 0x7f49541017f0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f493c00b450 tx=0x7f493c00b910 comp rx=0 tx=0).stop 2024-09-19T07:19:04.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.927+0000 7f495a498640 1 -- 172.21.15.148:0/3594443600 shutdown_connections 2024-09-19T07:19:04.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.927+0000 7f495a498640 1 --2- 172.21.15.148:0/3594443600 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f49400a33b0 0x7f49400a5870 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:04.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.927+0000 7f495a498640 1 --2- 172.21.15.148:0/3594443600 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4954106f30 0x7f4954101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:04.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.927+0000 7f495a498640 1 --2- 172.21.15.148:0/3594443600 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4954100ce0 0x7f49541017f0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:04.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.927+0000 7f495a498640 1 --2- 172.21.15.148:0/3594443600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4954100330 0x7f49541012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:04.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.927+0000 7f495a498640 1 -- 172.21.15.148:0/3594443600 >> 172.21.15.148:0/3594443600 conn(0x7f49540fbee0 msgr2=0x7f49540fd240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:04.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.927+0000 7f495a498640 1 -- 172.21.15.148:0/3594443600 shutdown_connections 2024-09-19T07:19:04.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:04.927+0000 7f495a498640 1 -- 172.21.15.148:0/3594443600 wait complete. 2024-09-19T07:19:05.524 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:19:05 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/3594443600' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:19:05.552 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24457 quiesce db / --timeout 90 --expiration 145.75 --await-for 45.0' 2024-09-19T07:19:05.552 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24457 quiesce db / --timeout 90 --expiration 145.75 --await-for 45.0 2024-09-19T07:19:05.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:19:05 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/3594443600' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:19:05.798 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:19:05.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:19:05 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/3594443600' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:19:06.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.333+0000 7fd7f6ba6640 1 -- 172.21.15.148:0/1065245808 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7f0101420 msgr2=0x7fd7f010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:06.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.333+0000 7fd7f6ba6640 1 --2- 172.21.15.148:0/1065245808 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7f0101420 0x7fd7f010d950 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8009cd0 tx=0x7fd7e802a8e0 comp rx=0 tx=0).stop 2024-09-19T07:19:06.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.333+0000 7fd7f6ba6640 1 -- 172.21.15.148:0/1065245808 shutdown_connections 2024-09-19T07:19:06.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.333+0000 7fd7f6ba6640 1 --2- 172.21.15.148:0/1065245808 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7f0101420 0x7fd7f010d950 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:06.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.333+0000 7fd7f6ba6640 1 --2- 172.21.15.148:0/1065245808 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7f0100a80 0x7fd7f0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:06.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.333+0000 7fd7f6ba6640 1 --2- 172.21.15.148:0/1065245808 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7f0106a80 0x7fd7f0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:06.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.333+0000 7fd7f6ba6640 1 -- 172.21.15.148:0/1065245808 >> 172.21.15.148:0/1065245808 conn(0x7fd7f00fc7a0 msgr2=0x7fd7f00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:06.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.333+0000 7fd7f6ba6640 1 -- 172.21.15.148:0/1065245808 shutdown_connections 2024-09-19T07:19:06.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.333+0000 7fd7f6ba6640 1 -- 172.21.15.148:0/1065245808 wait complete. 2024-09-19T07:19:06.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.334+0000 7fd7f6ba6640 1 Processor -- start 2024-09-19T07:19:06.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.334+0000 7fd7f6ba6640 1 -- start start 2024-09-19T07:19:06.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.334+0000 7fd7f6ba6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7f0100a80 0x7fd7f01972e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:06.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.334+0000 7fd7f6ba6640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7f0101420 0x7fd7f0197820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:06.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.334+0000 7fd7f6ba6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7f0106a80 0x7fd7f019bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:06.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.334+0000 7fd7f6ba6640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f0110e80 con 0x7fd7f0106a80 2024-09-19T07:19:06.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.334+0000 7fd7f6ba6640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f0110d00 con 0x7fd7f0101420 2024-09-19T07:19:06.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.334+0000 7fd7f6ba6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f0111000 con 0x7fd7f0100a80 2024-09-19T07:19:06.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.335+0000 7fd7f5143640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7f0106a80 0x7fd7f019bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:06.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.335+0000 7fd7f5143640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7f0106a80 0x7fd7f019bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57302/0 (socket says 172.21.15.148:57302) 2024-09-19T07:19:06.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.335+0000 7fd7f5143640 1 -- 172.21.15.148:0/890551342 learned_addr learned my addr 172.21.15.148:0/890551342 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:19:06.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.335+0000 7fd7f4942640 1 --2- 172.21.15.148:0/890551342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7f0100a80 0x7fd7f01972e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:06.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.335+0000 7fd7effff640 1 --2- 172.21.15.148:0/890551342 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7f0101420 0x7fd7f0197820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:06.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.335+0000 7fd7f5143640 1 -- 172.21.15.148:0/890551342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7f0100a80 msgr2=0x7fd7f01972e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:06.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.335+0000 7fd7f5143640 1 --2- 172.21.15.148:0/890551342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7f0100a80 0x7fd7f01972e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:06.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.335+0000 7fd7f5143640 1 -- 172.21.15.148:0/890551342 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7f0101420 msgr2=0x7fd7f0197820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:06.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.335+0000 7fd7f5143640 1 --2- 172.21.15.148:0/890551342 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7f0101420 0x7fd7f0197820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:06.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.335+0000 7fd7f5143640 1 -- 172.21.15.148:0/890551342 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7f019c290 con 0x7fd7f0106a80 2024-09-19T07:19:06.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.335+0000 7fd7f5143640 1 --2- 172.21.15.148:0/890551342 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7f0106a80 0x7fd7f019bbb0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8005cc0 tx=0x7fd7e8032f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:06.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.335+0000 7fd7edffb640 1 -- 172.21.15.148:0/890551342 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e8004040 con 0x7fd7f0106a80 2024-09-19T07:19:06.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.335+0000 7fd7edffb640 1 -- 172.21.15.148:0/890551342 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7e80046c0 con 0x7fd7f0106a80 2024-09-19T07:19:06.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.335+0000 7fd7f6ba6640 1 -- 172.21.15.148:0/890551342 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7f019c520 con 0x7fd7f0106a80 2024-09-19T07:19:06.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.335+0000 7fd7edffb640 1 -- 172.21.15.148:0/890551342 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e8030e00 con 0x7fd7f0106a80 2024-09-19T07:19:06.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.336+0000 7fd7f6ba6640 1 -- 172.21.15.148:0/890551342 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7f01a3e60 con 0x7fd7f0106a80 2024-09-19T07:19:06.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.338+0000 7fd7edffb640 1 -- 172.21.15.148:0/890551342 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fd7e80305a0 con 0x7fd7f0106a80 2024-09-19T07:19:06.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.338+0000 7fd7f8f7f740 1 Processor -- start 2024-09-19T07:19:06.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.338+0000 7fd7f8f7f740 1 -- start start 2024-09-19T07:19:06.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.338+0000 7fd7edffb640 1 --2- 172.21.15.148:0/890551342 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fd7e00a33b0 0x7fd7e00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:06.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.338+0000 7fd7f8f7f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed720ab850 0x55ed720abc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:06.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.338+0000 7fd7f8f7f740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed720ac170 0x55ed720b64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:06.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.338+0000 7fd7f8f7f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ed720b6a30 0x55ed720b8e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:06.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.338+0000 7fd7f8f7f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55ed72010160 con 0x55ed720ab850 2024-09-19T07:19:06.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.338+0000 7fd7f8f7f740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ed71fb7720 con 0x55ed720ac170 2024-09-19T07:19:06.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.338+0000 7fd7f8f7f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ed7200c120 con 0x55ed720b6a30 2024-09-19T07:19:06.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.338+0000 7fd7effff640 1 --2- 172.21.15.148:0/890551342 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fd7e00a33b0 0x7fd7e00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:06.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.339+0000 7fd7edffb640 1 -- 172.21.15.148:0/890551342 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8556+0+0 (secure 0 0 0) 0x7fd7e802e030 con 0x7fd7f0106a80 2024-09-19T07:19:06.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.339+0000 7fd7f4942640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed720ab850 0x55ed720abc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:06.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.339+0000 7fd7f4942640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed720ab850 0x55ed720abc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57312/0 (socket says 172.21.15.148:57312) 2024-09-19T07:19:06.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.339+0000 7fd7f4942640 1 -- 172.21.15.148:0/1761444471 learned_addr learned my addr 172.21.15.148:0/1761444471 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:19:06.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.339+0000 7fd7effff640 1 --2- 172.21.15.148:0/1761444471 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed720ac170 0x55ed720b64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:06.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.339+0000 7fd7f5143640 1 --2- 172.21.15.148:0/1761444471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ed720b6a30 0x55ed720b8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:06.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.339+0000 7fd7f4942640 1 -- 172.21.15.148:0/1761444471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ed720b6a30 msgr2=0x55ed720b8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:06.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.339+0000 7fd7f4942640 1 --2- 172.21.15.148:0/1761444471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ed720b6a30 0x55ed720b8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:06.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.339+0000 7fd7f4942640 1 -- 172.21.15.148:0/1761444471 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed720ac170 msgr2=0x55ed720b64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:06.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.339+0000 7fd7f4942640 1 --2- 172.21.15.148:0/1761444471 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed720ac170 0x55ed720b64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:06.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.339+0000 7fd7f4942640 1 -- 172.21.15.148:0/1761444471 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed71d81ba0 con 0x55ed720ab850 2024-09-19T07:19:06.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.339+0000 7fd7effff640 1 --2- 172.21.15.148:0/890551342 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fd7e00a33b0 0x7fd7e00a5870 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0106070 tx=0x7fd7dc0138e0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:06.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.339+0000 7fd7f4942640 1 --2- 172.21.15.148:0/1761444471 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed720ab850 0x55ed720abc30 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4009c20 tx=0x7fd7e40119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c421b74ff2b3aa5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:06.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.339+0000 7fd7daffd640 1 -- 172.21.15.148:0/1761444471 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e401f070 con 0x55ed720ab850 2024-09-19T07:19:06.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.339+0000 7fd7daffd640 1 -- 172.21.15.148:0/1761444471 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7e401a8f0 con 0x55ed720ab850 2024-09-19T07:19:06.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.339+0000 7fd7daffd640 1 -- 172.21.15.148:0/1761444471 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e400e8f0 con 0x55ed720ab850 2024-09-19T07:19:06.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.340+0000 7fd7f8f7f740 1 -- 172.21.15.148:0/1761444471 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed720ab850 msgr2=0x55ed720abc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:06.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.340+0000 7fd7f8f7f740 1 --2- 172.21.15.148:0/1761444471 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed720ab850 0x55ed720abc30 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4009c20 tx=0x7fd7e40119a0 comp rx=0 tx=0).stop 2024-09-19T07:19:06.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.340+0000 7fd7f8f7f740 1 -- 172.21.15.148:0/1761444471 shutdown_connections 2024-09-19T07:19:06.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.340+0000 7fd7f8f7f740 1 --2- 172.21.15.148:0/1761444471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ed720b6a30 0x55ed720b8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:06.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.340+0000 7fd7f8f7f740 1 --2- 172.21.15.148:0/1761444471 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed720ac170 0x55ed720b64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:06.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.340+0000 7fd7f8f7f740 1 --2- 172.21.15.148:0/1761444471 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed720ab850 0x55ed720abc30 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:06.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.340+0000 7fd7f8f7f740 1 -- 172.21.15.148:0/1761444471 >> 172.21.15.148:0/1761444471 conn(0x55ed720a7de0 msgr2=0x55ed720a81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:06.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.340+0000 7fd7f8f7f740 1 -- 172.21.15.148:0/1761444471 shutdown_connections 2024-09-19T07:19:06.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.340+0000 7fd7f8f7f740 1 -- 172.21.15.148:0/1761444471 wait complete. 2024-09-19T07:19:06.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.340+0000 7fd7f8f7f740 1 -- start start 2024-09-19T07:19:06.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.341+0000 7fd7f8f7f740 1 Processor -- start 2024-09-19T07:19:06.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.341+0000 7fd7f8f7f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ed720ab850 0x55ed720b3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:06.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.341+0000 7fd7f8f7f740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed720ac170 0x55ed720b3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:06.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.341+0000 7fd7f8f7f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed720b6a30 0x55ed720b4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:06.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.341+0000 7fd7f8f7f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55ed720b9600 con 0x55ed720b6a30 2024-09-19T07:19:06.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.341+0000 7fd7f8f7f740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ed71f98900 con 0x55ed720ac170 2024-09-19T07:19:06.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.341+0000 7fd7f8f7f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ed720b9780 con 0x55ed720ab850 2024-09-19T07:19:06.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.341+0000 7fd7f8f7f740 10 client.0 _ll_register_callbacks cb 0x55ed71f96780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:19:06.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.341+0000 7fd7f5143640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed720b6a30 0x55ed720b4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:06.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.341+0000 7fd7f5143640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed720b6a30 0x55ed720b4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57328/0 (socket says 172.21.15.148:57328) 2024-09-19T07:19:06.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.341+0000 7fd7f5143640 1 -- 172.21.15.148:0/3183776887 learned_addr learned my addr 172.21.15.148:0/3183776887 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:19:06.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.341+0000 7fd7f4942640 1 --2- 172.21.15.148:0/3183776887 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ed720ab850 0x55ed720b3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:06.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.341+0000 7fd7f5143640 1 -- 172.21.15.148:0/3183776887 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ed720ab850 msgr2=0x55ed720b3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:06.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.341+0000 7fd7f5143640 1 --2- 172.21.15.148:0/3183776887 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ed720ab850 0x55ed720b3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:06.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.341+0000 7fd7f5143640 1 -- 172.21.15.148:0/3183776887 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed720ac170 msgr2=0x55ed720b3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:06.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.341+0000 7fd7f5143640 1 --2- 172.21.15.148:0/3183776887 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed720ac170 0x55ed720b3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:06.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.341+0000 7fd7f5143640 1 -- 172.21.15.148:0/3183776887 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed71fd8c50 con 0x55ed720b6a30 2024-09-19T07:19:06.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.342+0000 7fd7f5143640 1 --2- 172.21.15.148:0/3183776887 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed720b6a30 0x55ed720b4380 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fd7e804d000 tx=0x7fd7e80b9af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c83d2694ac6e824f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:06.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.342+0000 7fd7cffff640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:19:06.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.342+0000 7fd7cffff640 1 -- 172.21.15.148:0/3183776887 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e80bd1b0 con 0x55ed720b6a30 2024-09-19T07:19:06.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.342+0000 7fd7cffff640 1 -- 172.21.15.148:0/3183776887 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8556+0+0 (secure 0 0 0) 0x7fd7e80a6b50 con 0x55ed720b6a30 2024-09-19T07:19:06.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.342+0000 7fd7f8f7f740 1 -- 172.21.15.148:0/3183776887 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7e401a8f0 con 0x55ed720b6a30 2024-09-19T07:19:06.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.342+0000 7fd7cffff640 1 -- 172.21.15.148:0/3183776887 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fd7e80bdf50 con 0x55ed720b6a30 2024-09-19T07:19:06.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.342+0000 7fd7f8f7f740 10 client.16791 fetch_fsmap learned FSMap version 41 2024-09-19T07:19:06.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.342+0000 7fd7f8f7f740 1 -- 172.21.15.148:0/3183776887 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55ed720c5290 con 0x55ed720b6a30 2024-09-19T07:19:06.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.342+0000 7fd7cffff640 1 -- 172.21.15.148:0/3183776887 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7e401a8f0 con 0x55ed720b6a30 2024-09-19T07:19:06.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.342+0000 7fd7cffff640 1 -- 172.21.15.148:0/3183776887 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 41) ==== 8370+0+0 (secure 0 0 0) 0x7fd7e804e070 con 0x55ed720b6a30 2024-09-19T07:19:06.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.342+0000 7fd7f8f7f740 10 client.16791 fetch_fsmap finished waiting for FSMap version 41 2024-09-19T07:19:06.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.342+0000 7fd7f8f7f740 10 client.16791 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:19:06.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.342+0000 7fd7f8f7f740 20 client.16791 populate_metadata read hostname 'smithi148' 2024-09-19T07:19:06.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.342+0000 7fd7f8f7f740 1 --2- 172.21.15.148:0/3183776887 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ed720c6750 0x55ed720c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:06.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.342+0000 7fd7f8f7f740 4 client.16791 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:19:06.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.342+0000 7fd7f8f7f740 1 -- 172.21.15.148:0/3183776887 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ed7201d890 con 0x55ed720c6750 2024-09-19T07:19:06.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.342+0000 7fd7f4942640 1 --2- 172.21.15.148:0/3183776887 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ed720c6750 0x55ed720c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:06.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.343+0000 7fd7cffff640 10 client.16791 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:19:06.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.343+0000 7fd7f4942640 1 --2- 172.21.15.148:0/3183776887 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ed720c6750 0x55ed720c8bf0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d413e74dfd213093 server_cookie=ce61c662b0cb2428 in_seq=0 out_seq=0 2024-09-19T07:19:06.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.344+0000 7fd7cffff640 1 -- 172.21.15.148:0/3183776887 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ed7201d890 con 0x55ed720c6750 2024-09-19T07:19:06.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.344+0000 7fd7cffff640 10 client.16791 handle_command_reply: tid=0 2024-09-19T07:19:06.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.344+0000 7fd7f8f7f740 1 client.16791 shutdown 2024-09-19T07:19:06.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.344+0000 7fd7f8f7f740 1 -- 172.21.15.148:0/3183776887 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed720b6a30 msgr2=0x55ed720b4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:06.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.344+0000 7fd7f8f7f740 1 --2- 172.21.15.148:0/3183776887 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed720b6a30 0x55ed720b4380 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fd7e804d000 tx=0x7fd7e80b9af0 comp rx=0 tx=0).stop 2024-09-19T07:19:06.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.344+0000 7fd7f8f7f740 1 -- 172.21.15.148:0/3183776887 shutdown_connections 2024-09-19T07:19:06.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.344+0000 7fd7f8f7f740 1 --2- 172.21.15.148:0/3183776887 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ed720c6750 0x55ed720c8bf0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:06.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.344+0000 7fd7f8f7f740 1 --2- 172.21.15.148:0/3183776887 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed720b6a30 0x55ed720b4380 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:06.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.344+0000 7fd7f8f7f740 1 --2- 172.21.15.148:0/3183776887 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed720ac170 0x55ed720b3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:06.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.344+0000 7fd7f8f7f740 1 --2- 172.21.15.148:0/3183776887 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ed720ab850 0x55ed720b3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:06.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.344+0000 7fd7cffff640 0 client.16791 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:19:06.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.344+0000 7fd7f8f7f740 1 -- 172.21.15.148:0/3183776887 >> 172.21.15.148:0/3183776887 conn(0x55ed720a7de0 msgr2=0x55ed720adb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:06.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.344+0000 7fd7f8f7f740 1 -- 172.21.15.148:0/3183776887 shutdown_connections 2024-09-19T07:19:06.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.344+0000 7fd7f8f7f740 1 -- 172.21.15.148:0/3183776887 wait complete. 2024-09-19T07:19:06.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.344+0000 7fd7f8f7f740 20 client.16791 trim_cache size 0 max 16384 2024-09-19T07:19:06.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.360+0000 7fd7f8f7f740 1 Processor -- start 2024-09-19T07:19:06.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.361+0000 7fd7f8f7f740 1 -- start start 2024-09-19T07:19:06.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.361+0000 7fd7f8f7f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ed720ab850 0x55ed720a6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:06.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.361+0000 7fd7f8f7f740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed720ac170 0x55ed720ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:06.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.361+0000 7fd7f8f7f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed720b6a30 0x55ed720cea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:06.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.361+0000 7fd7f8f7f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f01adea0 con 0x55ed720b6a30 2024-09-19T07:19:06.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.361+0000 7fd7f8f7f740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f01ab6b0 con 0x55ed720ac170 2024-09-19T07:19:06.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.361+0000 7fd7f8f7f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f01a9520 con 0x55ed720ab850 2024-09-19T07:19:06.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.361+0000 7fd7f5143640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed720b6a30 0x55ed720cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:06.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.361+0000 7fd7f5143640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed720b6a30 0x55ed720cea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57336/0 (socket says 172.21.15.148:57336) 2024-09-19T07:19:06.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.361+0000 7fd7f5143640 1 -- 172.21.15.148:0/4171877130 learned_addr learned my addr 172.21.15.148:0/4171877130 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:19:06.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.361+0000 7fd7f4942640 1 --2- 172.21.15.148:0/4171877130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ed720ab850 0x55ed720a6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:06.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.361+0000 7fd7f5143640 1 -- 172.21.15.148:0/4171877130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ed720ab850 msgr2=0x55ed720a6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:06.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.361+0000 7fd7f5143640 1 --2- 172.21.15.148:0/4171877130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ed720ab850 0x55ed720a6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:06.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.361+0000 7fd7f5143640 1 -- 172.21.15.148:0/4171877130 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed720ac170 msgr2=0x55ed720ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:06.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.361+0000 7fd7f5143640 1 --2- 172.21.15.148:0/4171877130 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed720ac170 0x55ed720ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:06.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.361+0000 7fd7f5143640 1 -- 172.21.15.148:0/4171877130 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed720b94e0 con 0x55ed720b6a30 2024-09-19T07:19:06.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.361+0000 7fd7f5143640 1 --2- 172.21.15.148:0/4171877130 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed720b6a30 0x55ed720cea40 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fd7e80bd550 tx=0x7fd7e80b9c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=334694c470884632 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:06.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.361+0000 7fd7da7fc640 1 -- 172.21.15.148:0/4171877130 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e80bd1b0 con 0x55ed720b6a30 2024-09-19T07:19:06.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.361+0000 7fd7da7fc640 1 -- 172.21.15.148:0/4171877130 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7e8036040 con 0x55ed720b6a30 2024-09-19T07:19:06.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.361+0000 7fd7da7fc640 1 -- 172.21.15.148:0/4171877130 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e80bd620 con 0x55ed720b6a30 2024-09-19T07:19:06.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.362+0000 7fd7f8f7f740 1 -- 172.21.15.148:0/4171877130 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed720b6a30 msgr2=0x55ed720cea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:06.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.362+0000 7fd7f8f7f740 1 --2- 172.21.15.148:0/4171877130 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed720b6a30 0x55ed720cea40 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fd7e80bd550 tx=0x7fd7e80b9c20 comp rx=0 tx=0).stop 2024-09-19T07:19:06.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.362+0000 7fd7f8f7f740 1 -- 172.21.15.148:0/4171877130 shutdown_connections 2024-09-19T07:19:06.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.362+0000 7fd7f8f7f740 1 --2- 172.21.15.148:0/4171877130 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed720b6a30 0x55ed720cea40 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:06.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.362+0000 7fd7f8f7f740 1 --2- 172.21.15.148:0/4171877130 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed720ac170 0x55ed720ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:06.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.362+0000 7fd7f8f7f740 1 --2- 172.21.15.148:0/4171877130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ed720ab850 0x55ed720a6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:06.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.362+0000 7fd7f8f7f740 1 -- 172.21.15.148:0/4171877130 >> 172.21.15.148:0/4171877130 conn(0x55ed720a7de0 msgr2=0x55ed720a66a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:06.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.362+0000 7fd7f8f7f740 1 -- 172.21.15.148:0/4171877130 shutdown_connections 2024-09-19T07:19:06.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.362+0000 7fd7f8f7f740 1 -- 172.21.15.148:0/4171877130 wait complete. 2024-09-19T07:19:06.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.362+0000 7fd7f8f7f740 1 -- start start 2024-09-19T07:19:06.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.362+0000 7fd7f8f7f740 1 Processor -- start 2024-09-19T07:19:06.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.363+0000 7fd7f8f7f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed720ab850 0x55ed720bab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:06.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.363+0000 7fd7f8f7f740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed720ac170 0x55ed720bb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:06.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.363+0000 7fd7f8f7f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ed720b6a30 0x55ed721348e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:06.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.363+0000 7fd7f8f7f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f01a9b70 con 0x55ed720ab850 2024-09-19T07:19:06.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.363+0000 7fd7f8f7f740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f01aafe0 con 0x55ed720ac170 2024-09-19T07:19:06.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.363+0000 7fd7f8f7f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f01aa240 con 0x55ed720b6a30 2024-09-19T07:19:06.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.363+0000 7fd7f8f7f740 10 client.0 _ll_register_callbacks cb 0x7fd7e8030fc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:19:06.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.363+0000 7fd7f4942640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed720ab850 0x55ed720bab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:06.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.363+0000 7fd7f4942640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed720ab850 0x55ed720bab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57352/0 (socket says 172.21.15.148:57352) 2024-09-19T07:19:06.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.363+0000 7fd7f4942640 1 -- 172.21.15.148:0/940831040 learned_addr learned my addr 172.21.15.148:0/940831040 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:19:06.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.363+0000 7fd7f4942640 1 -- 172.21.15.148:0/940831040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ed720b6a30 msgr2=0x55ed721348e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:06.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.363+0000 7fd7f4942640 1 --2- 172.21.15.148:0/940831040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ed720b6a30 0x55ed721348e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:06.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.363+0000 7fd7f4942640 1 -- 172.21.15.148:0/940831040 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed720ac170 msgr2=0x55ed720bb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:06.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.363+0000 7fd7f4942640 1 --2- 172.21.15.148:0/940831040 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed720ac170 0x55ed720bb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:06.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.363+0000 7fd7f4942640 1 -- 172.21.15.148:0/940831040 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed72134e20 con 0x55ed720ab850 2024-09-19T07:19:06.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.363+0000 7fd7f4942640 1 --2- 172.21.15.148:0/940831040 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed720ab850 0x55ed720bab30 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4009c20 tx=0x7fd7e4005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0eb1cd833bc4539 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:06.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.363+0000 7fd7cffff640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:19:06.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.363+0000 7fd7cffff640 1 -- 172.21.15.148:0/940831040 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e401f070 con 0x55ed720ab850 2024-09-19T07:19:06.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.363+0000 7fd7cffff640 1 -- 172.21.15.148:0/940831040 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8556+0+0 (secure 0 0 0) 0x7fd7e4011050 con 0x55ed720ab850 2024-09-19T07:19:06.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.364+0000 7fd7f8f7f740 1 -- 172.21.15.148:0/940831040 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7e8036040 con 0x55ed720ab850 2024-09-19T07:19:06.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.364+0000 7fd7cffff640 1 -- 172.21.15.148:0/940831040 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fd7e4037050 con 0x55ed720ab850 2024-09-19T07:19:06.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.364+0000 7fd7f8f7f740 10 client.16797 fetch_fsmap learned FSMap version 41 2024-09-19T07:19:06.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.364+0000 7fd7f8f7f740 1 -- 172.21.15.148:0/940831040 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55ed72135fa0 con 0x55ed720ab850 2024-09-19T07:19:06.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.364+0000 7fd7cffff640 1 -- 172.21.15.148:0/940831040 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7e8036040 con 0x55ed720ab850 2024-09-19T07:19:06.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.364+0000 7fd7cffff640 1 -- 172.21.15.148:0/940831040 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 41) ==== 8370+0+0 (secure 0 0 0) 0x7fd7e4003710 con 0x55ed720ab850 2024-09-19T07:19:06.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.364+0000 7fd7f8f7f740 10 client.16797 fetch_fsmap finished waiting for FSMap version 41 2024-09-19T07:19:06.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.364+0000 7fd7f8f7f740 10 client.16797 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:19:06.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.364+0000 7fd7f8f7f740 20 client.16797 populate_metadata read hostname 'smithi148' 2024-09-19T07:19:06.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.364+0000 7fd7f8f7f740 1 --2- 172.21.15.148:0/940831040 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ed72136560 0x55ed72138980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:06.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.364+0000 7fd7f8f7f740 4 client.16797 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.75, "await_for": 45.0}] 2024-09-19T07:19:06.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.364+0000 7fd7f8f7f740 1 -- 172.21.15.148:0/940831040 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.75, "await_for": 45.0}) -- 0x55ed720a3410 con 0x55ed72136560 2024-09-19T07:19:06.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.364+0000 7fd7effff640 1 --2- 172.21.15.148:0/940831040 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ed72136560 0x55ed72138980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:06.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.365+0000 7fd7cffff640 10 client.16797 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:19:06.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:06.365+0000 7fd7effff640 1 --2- 172.21.15.148:0/940831040 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ed72136560 0x55ed72138980 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36568eda801fd5b2 server_cookie=a21cb3000be7717a in_seq=0 out_seq=0 2024-09-19T07:19:06.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:19:06 smithi148 ceph-mon[31180]: pgmap v247: 97 pgs: 97 active+clean; 1.7 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 537 op/s 2024-09-19T07:19:06.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:19:06 smithi179 ceph-mon[35716]: pgmap v247: 97 pgs: 97 active+clean; 1.7 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 537 op/s 2024-09-19T07:19:06.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:19:06 smithi165 ceph-mon[35326]: pgmap v247: 97 pgs: 97 active+clean; 1.7 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 537 op/s 2024-09-19T07:19:07.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:19:07 smithi179 ceph-mon[35716]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T07:19:07.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:19:07 smithi148 ceph-mon[31180]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T07:19:07.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:19:07 smithi165 ceph-mon[35326]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T07:19:08.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:19:08 smithi179 ceph-mon[35716]: pgmap v249: 97 pgs: 97 active+clean; 1.7 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 836 KiB/s rd, 1.2 MiB/s wr, 382 op/s 2024-09-19T07:19:08.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:19:08 smithi148 ceph-mon[31180]: pgmap v249: 97 pgs: 97 active+clean; 1.7 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 836 KiB/s rd, 1.2 MiB/s wr, 382 op/s 2024-09-19T07:19:08.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:19:08 smithi165 ceph-mon[35326]: pgmap v249: 97 pgs: 97 active+clean; 1.7 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 836 KiB/s rd, 1.2 MiB/s wr, 382 op/s 2024-09-19T07:19:10.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:19:10 smithi179 ceph-mon[35716]: pgmap v250: 97 pgs: 11 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 82 active+clean; 1.7 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 836 KiB/s rd, 1.2 MiB/s wr, 362 op/s 2024-09-19T07:19:10.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:19:10 smithi148 ceph-mon[31180]: pgmap v250: 97 pgs: 11 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 82 active+clean; 1.7 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 836 KiB/s rd, 1.2 MiB/s wr, 362 op/s 2024-09-19T07:19:10.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:19:10 smithi165 ceph-mon[35326]: pgmap v250: 97 pgs: 11 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 82 active+clean; 1.7 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 836 KiB/s rd, 1.2 MiB/s wr, 362 op/s 2024-09-19T07:19:11.838 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.836+0000 7fb1867fc640 1 -- 172.21.15.148:0/3408494962 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb170030950 con 0x7fb1881095d0 2024-09-19T07:19:11.838 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.837+0000 7fb18dc01640 1 -- 172.21.15.148:0/3408494962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1881095d0 msgr2=0x7fb188109a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:11.838 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.837+0000 7fb18dc01640 1 --2- 172.21.15.148:0/3408494962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1881095d0 0x7fb188109a10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb170009890 tx=0x7fb17002a380 comp rx=0 tx=0).stop 2024-09-19T07:19:11.838 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.837+0000 7fb18dc01640 1 -- 172.21.15.148:0/3408494962 shutdown_connections 2024-09-19T07:19:11.838 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.837+0000 7fb18dc01640 1 --2- 172.21.15.148:0/3408494962 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb18811b140 0x7fb18811d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:11.838 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.837+0000 7fb18dc01640 1 --2- 172.21.15.148:0/3408494962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1881095d0 0x7fb188109a10 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:11.839 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.837+0000 7fb18dc01640 1 --2- 172.21.15.148:0/3408494962 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb1881091f0 0x7fb188110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:11.839 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.837+0000 7fb18dc01640 1 -- 172.21.15.148:0/3408494962 >> 172.21.15.148:0/3408494962 conn(0x7fb18806ce00 msgr2=0x7fb18806d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:11.839 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.837+0000 7fb18dc01640 1 -- 172.21.15.148:0/3408494962 shutdown_connections 2024-09-19T07:19:11.839 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.837+0000 7fb18dc01640 1 -- 172.21.15.148:0/3408494962 wait complete. 2024-09-19T07:19:11.839 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.838+0000 7fb18dc01640 1 Processor -- start 2024-09-19T07:19:11.839 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.838+0000 7fb18dc01640 1 -- start start 2024-09-19T07:19:11.839 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.839+0000 7fb18dc01640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1881091f0 0x7fb1881a70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:11.840 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.839+0000 7fb18dc01640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1881095d0 0x7fb1881a7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:11.840 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.839+0000 7fb18dc01640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb18811b140 0x7fb1881ab9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:11.840 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.839+0000 7fb18dc01640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb188120d30 con 0x7fb1881095d0 2024-09-19T07:19:11.840 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.839+0000 7fb18dc01640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb188120bb0 con 0x7fb18811b140 2024-09-19T07:19:11.840 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.839+0000 7fb18dc01640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb188120eb0 con 0x7fb1881091f0 2024-09-19T07:19:11.840 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.839+0000 7fb186ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1881095d0 0x7fb1881a7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:11.840 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.839+0000 7fb186ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1881095d0 0x7fb1881a7620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57368/0 (socket says 172.21.15.148:57368) 2024-09-19T07:19:11.841 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.839+0000 7fb186ffd640 1 -- 172.21.15.148:0/1388408632 learned_addr learned my addr 172.21.15.148:0/1388408632 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:19:11.841 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.839+0000 7fb1877fe640 1 --2- 172.21.15.148:0/1388408632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1881091f0 0x7fb1881a70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:11.841 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.840+0000 7fb187fff640 1 --2- 172.21.15.148:0/1388408632 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb18811b140 0x7fb1881ab9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:11.841 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.840+0000 7fb1877fe640 1 -- 172.21.15.148:0/1388408632 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb18811b140 msgr2=0x7fb1881ab9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:11.841 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.840+0000 7fb1877fe640 1 --2- 172.21.15.148:0/1388408632 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb18811b140 0x7fb1881ab9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:11.842 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.840+0000 7fb1877fe640 1 -- 172.21.15.148:0/1388408632 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1881095d0 msgr2=0x7fb1881a7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:11.842 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.840+0000 7fb1877fe640 1 --2- 172.21.15.148:0/1388408632 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1881095d0 0x7fb1881a7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:11.842 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.840+0000 7fb1877fe640 1 -- 172.21.15.148:0/1388408632 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1881ac0d0 con 0x7fb1881091f0 2024-09-19T07:19:11.842 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.840+0000 7fb1877fe640 1 --2- 172.21.15.148:0/1388408632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1881091f0 0x7fb1881a70e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb18000e790 tx=0x7fb18000ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:11.842 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.840+0000 7fb184ff9640 1 -- 172.21.15.148:0/1388408632 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb18000eea0 con 0x7fb1881091f0 2024-09-19T07:19:11.842 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.841+0000 7fb184ff9640 1 -- 172.21.15.148:0/1388408632 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb18000ccc0 con 0x7fb1881091f0 2024-09-19T07:19:11.843 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.842+0000 7fb184ff9640 1 -- 172.21.15.148:0/1388408632 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb180018760 con 0x7fb1881091f0 2024-09-19T07:19:11.843 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.842+0000 7fb18dc01640 1 -- 172.21.15.148:0/1388408632 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1881ac3c0 con 0x7fb1881091f0 2024-09-19T07:19:11.843 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.842+0000 7fb18dc01640 1 -- 172.21.15.148:0/1388408632 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1881b3c50 con 0x7fb1881091f0 2024-09-19T07:19:11.850 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.849+0000 7fb190a74740 1 Processor -- start 2024-09-19T07:19:11.850 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.849+0000 7fb190a74740 1 -- start start 2024-09-19T07:19:11.850 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.849+0000 7fb190a74740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c5da570af0 0x55c5da570ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:11.850 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.849+0000 7fb190a74740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c5da571410 0x55c5da57b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:11.850 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.849+0000 7fb190a74740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5da57bcb0 0x55c5da57e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:11.851 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.849+0000 7fb190a74740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55c5da4d52f0 con 0x55c5da571410 2024-09-19T07:19:11.851 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.849+0000 7fb190a74740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55c5da47d270 con 0x55c5da57bcb0 2024-09-19T07:19:11.851 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.849+0000 7fb190a74740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c5da4d12b0 con 0x55c5da570af0 2024-09-19T07:19:11.851 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.851+0000 7fb186ffd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5da57bcb0 0x55c5da57e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:11.851 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.851+0000 7fb186ffd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5da57bcb0 0x55c5da57e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:43282/0 (socket says 172.21.15.148:43282) 2024-09-19T07:19:11.851 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.851+0000 7fb186ffd640 1 -- 172.21.15.148:0/1085462403 learned_addr learned my addr 172.21.15.148:0/1085462403 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:19:11.852 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.851+0000 7fb184ff9640 1 -- 172.21.15.148:0/1388408632 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fb18001f020 con 0x7fb1881091f0 2024-09-19T07:19:11.852 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.851+0000 7fb187fff640 1 --2- 172.21.15.148:0/1085462403 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c5da570af0 0x55c5da570ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:11.852 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.851+0000 7fb1877fe640 1 --2- 172.21.15.148:0/1085462403 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c5da571410 0x55c5da57b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:11.854 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.852+0000 7fb186ffd640 1 -- 172.21.15.148:0/1085462403 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c5da570af0 msgr2=0x55c5da570ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:11.854 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.852+0000 7fb186ffd640 1 --2- 172.21.15.148:0/1085462403 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c5da570af0 0x55c5da570ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:11.854 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.852+0000 7fb186ffd640 1 -- 172.21.15.148:0/1085462403 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c5da571410 msgr2=0x55c5da57b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:11.854 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.853+0000 7fb184ff9640 1 --2- 172.21.15.148:0/1388408632 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fb1740a33d0 0x7fb1740a5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:11.855 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.853+0000 7fb186ffd640 1 --2- 172.21.15.148:0/1085462403 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c5da571410 0x55c5da57b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:11.855 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.853+0000 7fb186ffd640 1 -- 172.21.15.148:0/1085462403 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5da47c340 con 0x55c5da57bcb0 2024-09-19T07:19:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.854+0000 7fb184ff9640 1 -- 172.21.15.148:0/1388408632 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8600+0+0 (secure 0 0 0) 0x7fb1800cfdd0 con 0x7fb1881091f0 2024-09-19T07:19:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.854+0000 7fb1877fe640 1 --2- 172.21.15.148:0/1085462403 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c5da571410 0x55c5da57b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:19:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.854+0000 7fb186ffd640 1 --2- 172.21.15.148:0/1085462403 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5da57bcb0 0x55c5da57e0a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb170005e00 tx=0x7fb1700303c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c87e45a4923b72c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.854+0000 7fb187fff640 1 --2- 172.21.15.148:0/1388408632 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fb1740a33d0 0x7fb1740a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.855+0000 7fb17dffb640 1 -- 172.21.15.148:0/1085462403 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb170037040 con 0x55c5da57bcb0 2024-09-19T07:19:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.855+0000 7fb17dffb640 1 -- 172.21.15.148:0/1085462403 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb170041070 con 0x55c5da57bcb0 2024-09-19T07:19:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.855+0000 7fb187fff640 1 --2- 172.21.15.148:0/1388408632 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fb1740a33d0 0x7fb1740a5890 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb17800a400 tx=0x7fb17800d040 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.855+0000 7fb17dffb640 1 -- 172.21.15.148:0/1085462403 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb170005380 con 0x55c5da57bcb0 2024-09-19T07:19:11.857 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.856+0000 7fb190a74740 1 -- 172.21.15.148:0/1085462403 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5da57bcb0 msgr2=0x55c5da57e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:11.857 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.856+0000 7fb190a74740 1 --2- 172.21.15.148:0/1085462403 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5da57bcb0 0x55c5da57e0a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb170005e00 tx=0x7fb1700303c0 comp rx=0 tx=0).stop 2024-09-19T07:19:11.857 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.856+0000 7fb190a74740 1 -- 172.21.15.148:0/1085462403 shutdown_connections 2024-09-19T07:19:11.857 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.856+0000 7fb190a74740 1 --2- 172.21.15.148:0/1085462403 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5da57bcb0 0x55c5da57e0a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:11.857 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.856+0000 7fb190a74740 1 --2- 172.21.15.148:0/1085462403 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c5da571410 0x55c5da57b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:11.857 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.856+0000 7fb190a74740 1 --2- 172.21.15.148:0/1085462403 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c5da570af0 0x55c5da570ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:11.857 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.856+0000 7fb190a74740 1 -- 172.21.15.148:0/1085462403 >> 172.21.15.148:0/1085462403 conn(0x55c5da56d060 msgr2=0x55c5da56d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:11.858 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.856+0000 7fb190a74740 1 -- 172.21.15.148:0/1085462403 shutdown_connections 2024-09-19T07:19:11.858 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.857+0000 7fb190a74740 1 -- 172.21.15.148:0/1085462403 wait complete. 2024-09-19T07:19:11.858 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.857+0000 7fb190a74740 1 -- start start 2024-09-19T07:19:11.859 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.857+0000 7fb190a74740 1 Processor -- start 2024-09-19T07:19:11.859 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.858+0000 7fb190a74740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c5da570af0 0x55c5da578b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:11.859 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.858+0000 7fb190a74740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5da571410 0x55c5da579070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:11.859 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.858+0000 7fb190a74740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c5da57bcb0 0x55c5da5795b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:11.859 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.858+0000 7fb190a74740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55c5da57e880 con 0x55c5da57bcb0 2024-09-19T07:19:11.859 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.858+0000 7fb190a74740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55c5da45e290 con 0x55c5da571410 2024-09-19T07:19:11.859 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.858+0000 7fb190a74740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c5da57ea00 con 0x55c5da570af0 2024-09-19T07:19:11.859 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.858+0000 7fb190a74740 10 client.0 _ll_register_callbacks cb 0x55c5da48f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:19:11.861 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.858+0000 7fb187fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c5da57bcb0 0x55c5da5795b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:11.861 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.858+0000 7fb187fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c5da57bcb0 0x55c5da5795b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57390/0 (socket says 172.21.15.148:57390) 2024-09-19T07:19:11.861 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.858+0000 7fb187fff640 1 -- 172.21.15.148:0/2514564829 learned_addr learned my addr 172.21.15.148:0/2514564829 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:19:11.861 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.858+0000 7fb186ffd640 1 --2- 172.21.15.148:0/2514564829 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5da571410 0x55c5da579070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:11.861 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.858+0000 7fb1877fe640 1 --2- 172.21.15.148:0/2514564829 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c5da570af0 0x55c5da578b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:11.861 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.859+0000 7fb187fff640 1 -- 172.21.15.148:0/2514564829 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c5da570af0 msgr2=0x55c5da578b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:11.862 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.859+0000 7fb187fff640 1 --2- 172.21.15.148:0/2514564829 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c5da570af0 0x55c5da578b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:11.862 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.859+0000 7fb187fff640 1 -- 172.21.15.148:0/2514564829 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5da571410 msgr2=0x55c5da579070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:11.862 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.859+0000 7fb187fff640 1 --2- 172.21.15.148:0/2514564829 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5da571410 0x55c5da579070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:11.862 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.859+0000 7fb187fff640 1 -- 172.21.15.148:0/2514564829 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5da1e8210 con 0x55c5da57bcb0 2024-09-19T07:19:11.862 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.859+0000 7fb187fff640 1 --2- 172.21.15.148:0/2514564829 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c5da57bcb0 0x55c5da5795b0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fb178018ed0 tx=0x7fb178004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ed0dbdf48e34e5e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:11.862 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.859+0000 7fb166ffd640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:19:11.862 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.859+0000 7fb166ffd640 1 -- 172.21.15.148:0/2514564829 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb178028060 con 0x55c5da57bcb0 2024-09-19T07:19:11.862 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.859+0000 7fb166ffd640 1 -- 172.21.15.148:0/2514564829 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8600+0+0 (secure 0 0 0) 0x7fb1780177d0 con 0x55c5da57bcb0 2024-09-19T07:19:11.862 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.859+0000 7fb190a74740 1 -- 172.21.15.148:0/2514564829 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb170041070 con 0x55c5da57bcb0 2024-09-19T07:19:11.862 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.859+0000 7fb166ffd640 1 -- 172.21.15.148:0/2514564829 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fb178016e40 con 0x55c5da57bcb0 2024-09-19T07:19:11.862 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.860+0000 7fb190a74740 10 client.16803 fetch_fsmap learned FSMap version 41 2024-09-19T07:19:11.862 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.860+0000 7fb190a74740 1 -- 172.21.15.148:0/2514564829 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55c5da2b4620 con 0x55c5da57bcb0 2024-09-19T07:19:11.863 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.860+0000 7fb166ffd640 1 -- 172.21.15.148:0/2514564829 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb170041070 con 0x55c5da57bcb0 2024-09-19T07:19:11.863 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.860+0000 7fb166ffd640 1 -- 172.21.15.148:0/2514564829 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 41) ==== 8370+0+0 (secure 0 0 0) 0x7fb178023bb0 con 0x55c5da57bcb0 2024-09-19T07:19:11.863 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.860+0000 7fb190a74740 10 client.16803 fetch_fsmap finished waiting for FSMap version 41 2024-09-19T07:19:11.863 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.860+0000 7fb190a74740 10 client.16803 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:19:11.863 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.860+0000 7fb190a74740 20 client.16803 populate_metadata read hostname 'smithi148' 2024-09-19T07:19:11.863 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.860+0000 7fb190a74740 1 --2- 172.21.15.148:0/2514564829 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55c5da58bb30 0x55c5da58df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:11.863 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.860+0000 7fb190a74740 4 client.16803 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:19:11.863 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.860+0000 7fb190a74740 1 -- 172.21.15.148:0/2514564829 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c5da4e2a20 con 0x55c5da58bb30 2024-09-19T07:19:11.863 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.861+0000 7fb1877fe640 1 --2- 172.21.15.148:0/2514564829 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55c5da58bb30 0x55c5da58df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:11.864 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.861+0000 7fb166ffd640 10 client.16803 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:19:11.864 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.861+0000 7fb1877fe640 1 --2- 172.21.15.148:0/2514564829 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55c5da58bb30 0x55c5da58df60 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59b719f721388aab server_cookie=3fd6190e82b6b01e in_seq=0 out_seq=0 2024-09-19T07:19:11.864 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.862+0000 7fb166ffd640 1 -- 172.21.15.148:0/2514564829 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c5da4e2a20 con 0x55c5da58bb30 2024-09-19T07:19:11.864 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.862+0000 7fb166ffd640 10 client.16803 handle_command_reply: tid=0 2024-09-19T07:19:11.864 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.863+0000 7fb190a74740 1 client.16803 shutdown 2024-09-19T07:19:11.864 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.863+0000 7fb190a74740 1 -- 172.21.15.148:0/2514564829 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c5da57bcb0 msgr2=0x55c5da5795b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:11.864 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.863+0000 7fb190a74740 1 --2- 172.21.15.148:0/2514564829 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c5da57bcb0 0x55c5da5795b0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fb178018ed0 tx=0x7fb178004a40 comp rx=0 tx=0).stop 2024-09-19T07:19:11.865 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.864+0000 7fb190a74740 1 -- 172.21.15.148:0/2514564829 shutdown_connections 2024-09-19T07:19:11.865 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.864+0000 7fb190a74740 1 --2- 172.21.15.148:0/2514564829 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55c5da58bb30 0x55c5da58df60 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.864+0000 7fb190a74740 1 --2- 172.21.15.148:0/2514564829 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c5da57bcb0 0x55c5da5795b0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.864+0000 7fb190a74740 1 --2- 172.21.15.148:0/2514564829 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5da571410 0x55c5da579070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.864+0000 7fb190a74740 1 --2- 172.21.15.148:0/2514564829 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c5da570af0 0x55c5da578b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.864+0000 7fb190a74740 1 -- 172.21.15.148:0/2514564829 >> 172.21.15.148:0/2514564829 conn(0x55c5da56d060 msgr2=0x55c5da572dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.864+0000 7fb166ffd640 0 client.16803 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:19:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.865+0000 7fb190a74740 1 -- 172.21.15.148:0/2514564829 shutdown_connections 2024-09-19T07:19:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.865+0000 7fb190a74740 1 -- 172.21.15.148:0/2514564829 wait complete. 2024-09-19T07:19:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.865+0000 7fb190a74740 20 client.16803 trim_cache size 0 max 16384 2024-09-19T07:19:11.893 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.892+0000 7fb190a74740 1 Processor -- start 2024-09-19T07:19:11.893 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.892+0000 7fb190a74740 1 -- start start 2024-09-19T07:19:11.893 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.893+0000 7fb190a74740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c5da570af0 0x55c5da5793e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:11.894 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.893+0000 7fb190a74740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5da571410 0x55c5da593870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:11.894 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.893+0000 7fb190a74740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c5da57bcb0 0x55c5da593db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:11.894 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.893+0000 7fb190a74740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb1881bed70 con 0x55c5da570af0 2024-09-19T07:19:11.894 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.893+0000 7fb190a74740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb1881bc580 con 0x55c5da571410 2024-09-19T07:19:11.894 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.893+0000 7fb190a74740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb1881ba3f0 con 0x55c5da57bcb0 2024-09-19T07:19:11.895 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.893+0000 7fb187fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c5da57bcb0 0x55c5da593db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:11.895 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.893+0000 7fb187fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c5da57bcb0 0x55c5da593db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:38070/0 (socket says 172.21.15.148:38070) 2024-09-19T07:19:11.895 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.893+0000 7fb186ffd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5da571410 0x55c5da593870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:11.895 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.893+0000 7fb187fff640 1 -- 172.21.15.148:0/3189410699 learned_addr learned my addr 172.21.15.148:0/3189410699 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:19:11.895 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.893+0000 7fb1877fe640 1 --2- 172.21.15.148:0/3189410699 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c5da570af0 0x55c5da5793e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:11.895 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.893+0000 7fb186ffd640 1 -- 172.21.15.148:0/3189410699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c5da57bcb0 msgr2=0x55c5da593db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:11.895 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.893+0000 7fb186ffd640 1 --2- 172.21.15.148:0/3189410699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c5da57bcb0 0x55c5da593db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:11.895 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.893+0000 7fb186ffd640 1 -- 172.21.15.148:0/3189410699 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c5da570af0 msgr2=0x55c5da5793e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:11.895 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.893+0000 7fb186ffd640 1 --2- 172.21.15.148:0/3189410699 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c5da570af0 0x55c5da5793e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:11.896 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.893+0000 7fb186ffd640 1 -- 172.21.15.148:0/3189410699 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5da56ce90 con 0x55c5da571410 2024-09-19T07:19:11.896 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.893+0000 7fb1877fe640 1 --2- 172.21.15.148:0/3189410699 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c5da570af0 0x55c5da5793e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:19:11.896 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.894+0000 7fb186ffd640 1 --2- 172.21.15.148:0/3189410699 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5da571410 0x55c5da593870 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb170000c00 tx=0x7fb170030ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0265943aac6ad99 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:11.896 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.894+0000 7fb17d7fa640 1 -- 172.21.15.148:0/3189410699 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb170049070 con 0x55c5da571410 2024-09-19T07:19:11.896 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.894+0000 7fb17d7fa640 1 -- 172.21.15.148:0/3189410699 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb170041050 con 0x55c5da571410 2024-09-19T07:19:11.896 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.894+0000 7fb17d7fa640 1 -- 172.21.15.148:0/3189410699 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb170037040 con 0x55c5da571410 2024-09-19T07:19:11.898 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.895+0000 7fb190a74740 1 -- 172.21.15.148:0/3189410699 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5da571410 msgr2=0x55c5da593870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:11.898 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.895+0000 7fb190a74740 1 --2- 172.21.15.148:0/3189410699 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5da571410 0x55c5da593870 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb170000c00 tx=0x7fb170030ae0 comp rx=0 tx=0).stop 2024-09-19T07:19:11.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.895+0000 7fb190a74740 1 -- 172.21.15.148:0/3189410699 shutdown_connections 2024-09-19T07:19:11.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.895+0000 7fb190a74740 1 --2- 172.21.15.148:0/3189410699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c5da57bcb0 0x55c5da593db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:11.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.895+0000 7fb190a74740 1 --2- 172.21.15.148:0/3189410699 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5da571410 0x55c5da593870 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:11.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.895+0000 7fb190a74740 1 --2- 172.21.15.148:0/3189410699 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c5da570af0 0x55c5da5793e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:11.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.895+0000 7fb190a74740 1 -- 172.21.15.148:0/3189410699 >> 172.21.15.148:0/3189410699 conn(0x55c5da56d060 msgr2=0x55c5da57abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:11.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.895+0000 7fb190a74740 1 -- 172.21.15.148:0/3189410699 shutdown_connections 2024-09-19T07:19:11.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.895+0000 7fb190a74740 1 -- 172.21.15.148:0/3189410699 wait complete. 2024-09-19T07:19:11.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.896+0000 7fb190a74740 1 -- start start 2024-09-19T07:19:11.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.896+0000 7fb190a74740 1 Processor -- start 2024-09-19T07:19:11.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.896+0000 7fb190a74740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c5da570af0 0x55c5da584430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:11.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.897+0000 7fb190a74740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c5da571410 0x55c5da5758a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:11.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.897+0000 7fb190a74740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5da57bcb0 0x55c5da575de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:11.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.897+0000 7fb186ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c5da571410 0x55c5da5758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:11.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.897+0000 7fb186ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c5da571410 0x55c5da5758a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57414/0 (socket says 172.21.15.148:57414) 2024-09-19T07:19:11.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.897+0000 7fb1877fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c5da570af0 0x55c5da584430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:11.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.897+0000 7fb1877fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c5da570af0 0x55c5da584430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:38074/0 (socket says 172.21.15.148:38074) 2024-09-19T07:19:11.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.897+0000 7fb186ffd640 1 -- 172.21.15.148:0/3261002444 learned_addr learned my addr 172.21.15.148:0/3261002444 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:19:11.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.897+0000 7fb190a74740 1 -- 172.21.15.148:0/3261002444 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb1881baa40 con 0x55c5da571410 2024-09-19T07:19:11.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.897+0000 7fb190a74740 1 -- 172.21.15.148:0/3261002444 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb1881bbeb0 con 0x55c5da57bcb0 2024-09-19T07:19:11.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.897+0000 7fb190a74740 1 -- 172.21.15.148:0/3261002444 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb1881bb110 con 0x55c5da570af0 2024-09-19T07:19:11.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.897+0000 7fb190a74740 10 client.0 _ll_register_callbacks cb 0x7fb178009a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:19:11.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.897+0000 7fb187fff640 1 --2- 172.21.15.148:0/3261002444 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5da57bcb0 0x55c5da575de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:11.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.898+0000 7fb186ffd640 1 -- 172.21.15.148:0/3261002444 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c5da570af0 msgr2=0x55c5da584430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:11.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.898+0000 7fb186ffd640 1 --2- 172.21.15.148:0/3261002444 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c5da570af0 0x55c5da584430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:11.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.898+0000 7fb186ffd640 1 -- 172.21.15.148:0/3261002444 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5da57bcb0 msgr2=0x55c5da575de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:11.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.898+0000 7fb186ffd640 1 --2- 172.21.15.148:0/3261002444 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5da57bcb0 0x55c5da575de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:11.901 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.898+0000 7fb186ffd640 1 -- 172.21.15.148:0/3261002444 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5da576610 con 0x55c5da571410 2024-09-19T07:19:11.902 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.898+0000 7fb186ffd640 1 --2- 172.21.15.148:0/3261002444 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c5da571410 0x55c5da5758a0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fb1700095f0 tx=0x7fb170030340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba7c3a02f99b1a58 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:11.902 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.898+0000 7fb166ffd640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:19:11.903 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.899+0000 7fb166ffd640 1 -- 172.21.15.148:0/3261002444 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb170037040 con 0x55c5da571410 2024-09-19T07:19:11.903 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.899+0000 7fb166ffd640 1 -- 172.21.15.148:0/3261002444 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8600+0+0 (secure 0 0 0) 0x7fb1700054d0 con 0x55c5da571410 2024-09-19T07:19:11.903 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.899+0000 7fb190a74740 1 -- 172.21.15.148:0/3261002444 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb170041050 con 0x55c5da571410 2024-09-19T07:19:11.903 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.899+0000 7fb166ffd640 1 -- 172.21.15.148:0/3261002444 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fb170049040 con 0x55c5da571410 2024-09-19T07:19:11.903 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.900+0000 7fb190a74740 10 client.16809 fetch_fsmap learned FSMap version 41 2024-09-19T07:19:11.903 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.900+0000 7fb190a74740 1 -- 172.21.15.148:0/3261002444 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55c5da5f68a0 con 0x55c5da571410 2024-09-19T07:19:11.903 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.900+0000 7fb166ffd640 1 -- 172.21.15.148:0/3261002444 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb170004ba0 con 0x55c5da571410 2024-09-19T07:19:11.903 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.901+0000 7fb166ffd640 1 -- 172.21.15.148:0/3261002444 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 41) ==== 8370+0+0 (secure 0 0 0) 0x7fb1700329b0 con 0x55c5da571410 2024-09-19T07:19:11.903 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.901+0000 7fb190a74740 10 client.16809 fetch_fsmap finished waiting for FSMap version 41 2024-09-19T07:19:11.903 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.901+0000 7fb190a74740 10 client.16809 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:19:11.903 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.901+0000 7fb190a74740 20 client.16809 populate_metadata read hostname 'smithi148' 2024-09-19T07:19:11.903 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.901+0000 7fb190a74740 1 --2- 172.21.15.148:0/3261002444 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55c5da5f6b20 0x55c5da5f8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:11.904 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.901+0000 7fb190a74740 4 client.16809 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:19:11.904 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.901+0000 7fb190a74740 1 -- 172.21.15.148:0/3261002444 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fb170041050 con 0x55c5da5f6b20 2024-09-19T07:19:11.904 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.902+0000 7fb1877fe640 1 --2- 172.21.15.148:0/3261002444 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55c5da5f6b20 0x55c5da5f8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:11.904 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.902+0000 7fb1877fe640 1 --2- 172.21.15.148:0/3261002444 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55c5da5f6b20 0x55c5da5f8f40 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bca89d82515a1dee server_cookie=4ffe2ba5afcfa6fd in_seq=0 out_seq=0 2024-09-19T07:19:11.904 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:11.903+0000 7fb166ffd640 10 client.16809 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:19:12.393 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:12.392+0000 7fb166ffd640 1 -- 172.21.15.148:0/3261002444 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fb170041050 con 0x55c5da5f6b20 2024-09-19T07:19:12.394 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:12.392+0000 7fb166ffd640 10 client.16809 handle_command_reply: tid=0 2024-09-19T07:19:12.394 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:12.392+0000 7fb190a74740 1 client.16809 shutdown 2024-09-19T07:19:12.394 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:12.392+0000 7fb190a74740 1 -- 172.21.15.148:0/3261002444 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c5da571410 msgr2=0x55c5da5758a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:12.394 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:12.392+0000 7fb190a74740 1 --2- 172.21.15.148:0/3261002444 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c5da571410 0x55c5da5758a0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fb1700095f0 tx=0x7fb170030340 comp rx=0 tx=0).stop 2024-09-19T07:19:12.394 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:12.392+0000 7fb190a74740 1 -- 172.21.15.148:0/3261002444 shutdown_connections 2024-09-19T07:19:12.394 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:12.392+0000 7fb190a74740 1 --2- 172.21.15.148:0/3261002444 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55c5da5f6b20 0x55c5da5f8f40 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:12.394 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:12.392+0000 7fb190a74740 1 --2- 172.21.15.148:0/3261002444 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5da57bcb0 0x55c5da575de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:12.394 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:12.392+0000 7fb166ffd640 0 client.16809 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:19:12.394 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:12.392+0000 7fb190a74740 1 --2- 172.21.15.148:0/3261002444 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c5da571410 0x55c5da5758a0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:12.394 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:12.392+0000 7fb190a74740 1 --2- 172.21.15.148:0/3261002444 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c5da570af0 0x55c5da584430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:12.394 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:12.392+0000 7fb190a74740 1 -- 172.21.15.148:0/3261002444 >> 172.21.15.148:0/3261002444 conn(0x55c5da56d060 msgr2=0x55c5da56b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:12.394 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:12.392+0000 7fb190a74740 1 -- 172.21.15.148:0/3261002444 shutdown_connections 2024-09-19T07:19:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:12.392+0000 7fb190a74740 1 -- 172.21.15.148:0/3261002444 wait complete. 2024-09-19T07:19:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:12.392+0000 7fb190a74740 20 client.16809 trim_cache size 0 max 16384 2024-09-19T07:19:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:19:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:19:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:19:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:19:12.396 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:12.393+0000 7fb18dc01640 1 -- 172.21.15.148:0/1388408632 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fb1740a33d0 msgr2=0x7fb1740a5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:12.396 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:12.393+0000 7fb18dc01640 1 --2- 172.21.15.148:0/1388408632 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fb1740a33d0 0x7fb1740a5890 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb17800a400 tx=0x7fb17800d040 comp rx=0 tx=0).stop 2024-09-19T07:19:12.396 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:12.393+0000 7fb18dc01640 1 -- 172.21.15.148:0/1388408632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1881091f0 msgr2=0x7fb1881a70e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:12.396 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:12.393+0000 7fb18dc01640 1 --2- 172.21.15.148:0/1388408632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1881091f0 0x7fb1881a70e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb18000e790 tx=0x7fb18000ec50 comp rx=0 tx=0).stop 2024-09-19T07:19:12.396 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:12.393+0000 7fb18dc01640 1 -- 172.21.15.148:0/1388408632 shutdown_connections 2024-09-19T07:19:12.396 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:12.393+0000 7fb18dc01640 1 --2- 172.21.15.148:0/1388408632 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fb1740a33d0 0x7fb1740a5890 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:12.396 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:12.393+0000 7fb18dc01640 1 --2- 172.21.15.148:0/1388408632 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb18811b140 0x7fb1881ab9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:12.397 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:12.393+0000 7fb18dc01640 1 --2- 172.21.15.148:0/1388408632 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1881095d0 0x7fb1881a7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:12.397 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:12.393+0000 7fb18dc01640 1 --2- 172.21.15.148:0/1388408632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1881091f0 0x7fb1881a70e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:12.397 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:12.393+0000 7fb18dc01640 1 -- 172.21.15.148:0/1388408632 >> 172.21.15.148:0/1388408632 conn(0x7fb18806ce00 msgr2=0x7fb18811b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:12.397 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:12.393+0000 7fb18dc01640 1 -- 172.21.15.148:0/1388408632 shutdown_connections 2024-09-19T07:19:12.397 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:12.393+0000 7fb18dc01640 1 -- 172.21.15.148:0/1388408632 wait complete. 2024-09-19T07:19:12.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:19:12 smithi179 ceph-mon[35716]: pgmap v251: 97 pgs: 41 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 34 active+clean; 1.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 143 KiB/s wr, 43 op/s 2024-09-19T07:19:12.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:19:12 smithi148 ceph-mon[31180]: pgmap v251: 97 pgs: 41 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 34 active+clean; 1.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 143 KiB/s wr, 43 op/s 2024-09-19T07:19:12.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:19:12 smithi165 ceph-mon[35326]: pgmap v251: 97 pgs: 41 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 34 active+clean; 1.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 143 KiB/s wr, 43 op/s 2024-09-19T07:19:14.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:19:14 smithi179 ceph-mon[35716]: pgmap v252: 97 pgs: 41 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 34 active+clean; 1.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 122 KiB/s wr, 34 op/s 2024-09-19T07:19:14.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:19:14 smithi148 ceph-mon[31180]: pgmap v252: 97 pgs: 41 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 34 active+clean; 1.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 122 KiB/s wr, 34 op/s 2024-09-19T07:19:14.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:19:14 smithi165 ceph-mon[35326]: pgmap v252: 97 pgs: 41 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 34 active+clean; 1.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 122 KiB/s wr, 34 op/s 2024-09-19T07:19:16.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:19:16 smithi179 ceph-mon[35716]: pgmap v253: 97 pgs: 11 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 82 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 59 KiB/s wr, 25 op/s 2024-09-19T07:19:16.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:19:16 smithi148 ceph-mon[31180]: pgmap v253: 97 pgs: 11 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 82 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 59 KiB/s wr, 25 op/s 2024-09-19T07:19:16.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:19:16 smithi165 ceph-mon[35326]: pgmap v253: 97 pgs: 11 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 82 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 59 KiB/s wr, 25 op/s 2024-09-19T07:19:17.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:17.864+0000 7fd7cffff640 1 -- 172.21.15.148:0/940831040 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55ed720a3410 con 0x55ed72136560 2024-09-19T07:19:17.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:17.864+0000 7fd7cffff640 10 client.16797 handle_command_reply: tid=0 2024-09-19T07:19:17.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:17.864+0000 7fd7f8f7f740 1 client.16797 shutdown 2024-09-19T07:19:17.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:17.864+0000 7fd7f8f7f740 1 -- 172.21.15.148:0/940831040 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed720ab850 msgr2=0x55ed720bab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:17.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:17.864+0000 7fd7f8f7f740 1 --2- 172.21.15.148:0/940831040 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed720ab850 0x55ed720bab30 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4009c20 tx=0x7fd7e4005fa0 comp rx=0 tx=0).stop 2024-09-19T07:19:17.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:17.864+0000 7fd7f8f7f740 1 -- 172.21.15.148:0/940831040 shutdown_connections 2024-09-19T07:19:17.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:17.864+0000 7fd7f8f7f740 1 --2- 172.21.15.148:0/940831040 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ed72136560 0x55ed72138980 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:17.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:17.864+0000 7fd7f8f7f740 1 --2- 172.21.15.148:0/940831040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ed720b6a30 0x55ed721348e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:17.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:17.864+0000 7fd7cffff640 0 client.16797 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:19:17.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:17.864+0000 7fd7f8f7f740 1 --2- 172.21.15.148:0/940831040 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed720ac170 0x55ed720bb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:17.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:17.864+0000 7fd7f8f7f740 1 --2- 172.21.15.148:0/940831040 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ed720ab850 0x55ed720bab30 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:17.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:17.864+0000 7fd7f8f7f740 1 -- 172.21.15.148:0/940831040 >> 172.21.15.148:0/940831040 conn(0x55ed720a7de0 msgr2=0x55ed720b5980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:17.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:17.864+0000 7fd7f8f7f740 1 -- 172.21.15.148:0/940831040 shutdown_connections 2024-09-19T07:19:17.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:17.864+0000 7fd7f8f7f740 1 -- 172.21.15.148:0/940831040 wait complete. 2024-09-19T07:19:17.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:17.864+0000 7fd7f8f7f740 20 client.16797 trim_cache size 0 max 16384 2024-09-19T07:19:17.867 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:19:17.867 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 41, 2024-09-19T07:19:17.867 INFO:teuthology.orchestra.run.smithi148.stdout: "leader": 24457, 2024-09-19T07:19:17.867 INFO:teuthology.orchestra.run.smithi148.stdout: "set_version": 30, 2024-09-19T07:19:17.867 INFO:teuthology.orchestra.run.smithi148.stdout: "sets": { 2024-09-19T07:19:17.867 INFO:teuthology.orchestra.run.smithi148.stdout: "d158fe2": { 2024-09-19T07:19:17.867 INFO:teuthology.orchestra.run.smithi148.stdout: "version": 30, 2024-09-19T07:19:17.867 INFO:teuthology.orchestra.run.smithi148.stdout: "age_ref": 0.0, 2024-09-19T07:19:17.867 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:19:17.868 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "QUIESCED", 2024-09-19T07:19:17.868 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:19:17.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:19:17.868 INFO:teuthology.orchestra.run.smithi148.stdout: "timeout": 90.0, 2024-09-19T07:19:17.868 INFO:teuthology.orchestra.run.smithi148.stdout: "expiration": 145.8, 2024-09-19T07:19:17.868 INFO:teuthology.orchestra.run.smithi148.stdout: "members": { 2024-09-19T07:19:17.868 INFO:teuthology.orchestra.run.smithi148.stdout: "file:/": { 2024-09-19T07:19:17.868 INFO:teuthology.orchestra.run.smithi148.stdout: "excluded": false, 2024-09-19T07:19:17.868 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:19:17.868 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "QUIESCED", 2024-09-19T07:19:17.868 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:19:17.868 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:19:17.868 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:19:17.869 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:19:17.869 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:19:17.869 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:19:17.869 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:19:17.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:17.865+0000 7fd7f6ba6640 1 -- 172.21.15.148:0/890551342 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fd7e00a33b0 msgr2=0x7fd7e00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:17.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:17.865+0000 7fd7f6ba6640 1 --2- 172.21.15.148:0/890551342 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fd7e00a33b0 0x7fd7e00a5870 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0106070 tx=0x7fd7dc0138e0 comp rx=0 tx=0).stop 2024-09-19T07:19:17.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:17.865+0000 7fd7f6ba6640 1 -- 172.21.15.148:0/890551342 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7f0106a80 msgr2=0x7fd7f019bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:17.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:17.865+0000 7fd7f6ba6640 1 --2- 172.21.15.148:0/890551342 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7f0106a80 0x7fd7f019bbb0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8005cc0 tx=0x7fd7e8032f40 comp rx=0 tx=0).stop 2024-09-19T07:19:17.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:17.865+0000 7fd7f6ba6640 1 -- 172.21.15.148:0/890551342 shutdown_connections 2024-09-19T07:19:17.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:17.865+0000 7fd7f6ba6640 1 --2- 172.21.15.148:0/890551342 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fd7e00a33b0 0x7fd7e00a5870 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:17.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:17.865+0000 7fd7f6ba6640 1 --2- 172.21.15.148:0/890551342 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd7f0106a80 0x7fd7f019bbb0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:17.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:17.865+0000 7fd7f6ba6640 1 --2- 172.21.15.148:0/890551342 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7f0101420 0x7fd7f0197820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:17.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:17.865+0000 7fd7f6ba6640 1 --2- 172.21.15.148:0/890551342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7f0100a80 0x7fd7f01972e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:17.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:17.865+0000 7fd7f6ba6640 1 -- 172.21.15.148:0/890551342 >> 172.21.15.148:0/890551342 conn(0x7fd7f00fc7a0 msgr2=0x7fd7f00fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:17.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:17.866+0000 7fd7f6ba6640 1 -- 172.21.15.148:0/890551342 shutdown_connections 2024-09-19T07:19:17.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:17.866+0000 7fd7f6ba6640 1 -- 172.21.15.148:0/890551342 wait complete. 2024-09-19T07:19:18.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:19:18 smithi148 ceph-mon[31180]: pgmap v254: 97 pgs: 11 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 82 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 54 KiB/s wr, 23 op/s 2024-09-19T07:19:18.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:19:18 smithi165 ceph-mon[35326]: pgmap v254: 97 pgs: 11 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 82 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 54 KiB/s wr, 23 op/s 2024-09-19T07:19:19.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:19:18 smithi179 ceph-mon[35716]: pgmap v254: 97 pgs: 11 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 82 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 54 KiB/s wr, 23 op/s 2024-09-19T07:19:19.186 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'd158fe2', quiesce took 15.2 seconds. Will release after: 10.55 2024-09-19T07:19:20.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:19:20 smithi148 ceph-mon[31180]: pgmap v255: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 50 KiB/s wr, 22 op/s 2024-09-19T07:19:20.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:19:20 smithi165 ceph-mon[35326]: pgmap v255: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 50 KiB/s wr, 22 op/s 2024-09-19T07:19:21.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:19:20 smithi179 ceph-mon[35716]: pgmap v255: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 50 KiB/s wr, 22 op/s 2024-09-19T07:19:22.825 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:19:22 smithi179 ceph-mon[35716]: pgmap v256: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-19T07:19:22.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:19:22 smithi148 ceph-mon[31180]: pgmap v256: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-19T07:19:22.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:19:22 smithi165 ceph-mon[35326]: pgmap v256: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-19T07:19:24.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:19:24 smithi148 ceph-mon[31180]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T07:19:24.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:19:24 smithi148 ceph-mon[31180]: pgmap v258: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 47 KiB/s wr, 21 op/s 2024-09-19T07:19:24.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:19:24 smithi165 ceph-mon[35326]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T07:19:24.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:19:24 smithi165 ceph-mon[35326]: pgmap v258: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 47 KiB/s wr, 21 op/s 2024-09-19T07:19:24.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:19:24 smithi179 ceph-mon[35716]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T07:19:24.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:19:24 smithi179 ceph-mon[35716]: pgmap v258: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 47 KiB/s wr, 21 op/s 2024-09-19T07:19:25.495 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.494+0000 7fe28ebcf640 1 -- 172.21.15.148:0/1997599550 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2881009b0 msgr2=0x7fe288100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:25.496 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.494+0000 7fe28ebcf640 1 --2- 172.21.15.148:0/1997599550 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2881009b0 0x7fe288100e10 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fe278009930 tx=0x7fe27802a420 comp rx=0 tx=0).stop 2024-09-19T07:19:25.496 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.494+0000 7fe28ebcf640 1 -- 172.21.15.148:0/1997599550 shutdown_connections 2024-09-19T07:19:25.496 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.494+0000 7fe28ebcf640 1 --2- 172.21.15.148:0/1997599550 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe288101350 0x7fe28810d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:25.496 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.494+0000 7fe28ebcf640 1 --2- 172.21.15.148:0/1997599550 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2881009b0 0x7fe288100e10 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:25.496 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.494+0000 7fe28ebcf640 1 --2- 172.21.15.148:0/1997599550 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2881069c0 0x7fe288106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:25.496 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.494+0000 7fe28ebcf640 1 -- 172.21.15.148:0/1997599550 >> 172.21.15.148:0/1997599550 conn(0x7fe288077990 msgr2=0x7fe2880fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:25.496 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.494+0000 7fe28ebcf640 1 -- 172.21.15.148:0/1997599550 shutdown_connections 2024-09-19T07:19:25.496 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.494+0000 7fe28ebcf640 1 -- 172.21.15.148:0/1997599550 wait complete. 2024-09-19T07:19:25.496 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.495+0000 7fe28ebcf640 1 Processor -- start 2024-09-19T07:19:25.496 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.495+0000 7fe28ebcf640 1 -- start start 2024-09-19T07:19:25.498 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.495+0000 7fe28ebcf640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2881009b0 0x7fe288197250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:25.498 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.495+0000 7fe28ebcf640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe288101350 0x7fe288197790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:25.498 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.495+0000 7fe28ebcf640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2881069c0 0x7fe28819bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:25.498 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.495+0000 7fe28ebcf640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe288110e00 con 0x7fe2881069c0 2024-09-19T07:19:25.499 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.495+0000 7fe28ebcf640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe288110c80 con 0x7fe2881009b0 2024-09-19T07:19:25.499 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.495+0000 7fe28ebcf640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe288110f80 con 0x7fe288101350 2024-09-19T07:19:25.499 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.495+0000 7fe28d16c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2881069c0 0x7fe28819bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:25.499 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.495+0000 7fe28d16c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2881069c0 0x7fe28819bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43354/0 (socket says 172.21.15.148:43354) 2024-09-19T07:19:25.499 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.495+0000 7fe28d16c640 1 -- 172.21.15.148:0/703488639 learned_addr learned my addr 172.21.15.148:0/703488639 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:19:25.499 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.495+0000 7fe28c96b640 1 --2- 172.21.15.148:0/703488639 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2881009b0 0x7fe288197250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:25.499 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.496+0000 7fe27ffff640 1 --2- 172.21.15.148:0/703488639 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe288101350 0x7fe288197790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:25.499 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.496+0000 7fe28d16c640 1 -- 172.21.15.148:0/703488639 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe288101350 msgr2=0x7fe288197790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:25.499 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.496+0000 7fe28d16c640 1 --2- 172.21.15.148:0/703488639 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe288101350 0x7fe288197790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:25.499 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.496+0000 7fe28d16c640 1 -- 172.21.15.148:0/703488639 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2881009b0 msgr2=0x7fe288197250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:25.499 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.496+0000 7fe28d16c640 1 --2- 172.21.15.148:0/703488639 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2881009b0 0x7fe288197250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:25.499 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.496+0000 7fe28d16c640 1 -- 172.21.15.148:0/703488639 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe28819c240 con 0x7fe2881069c0 2024-09-19T07:19:25.499 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.496+0000 7fe28d16c640 1 --2- 172.21.15.148:0/703488639 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2881069c0 0x7fe28819bb10 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fe28000cce0 tx=0x7fe28000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:25.500 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.496+0000 7fe27dffb640 1 -- 172.21.15.148:0/703488639 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28000f450 con 0x7fe2881069c0 2024-09-19T07:19:25.500 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.496+0000 7fe27dffb640 1 -- 172.21.15.148:0/703488639 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe28000fad0 con 0x7fe2881069c0 2024-09-19T07:19:25.500 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.496+0000 7fe28ebcf640 1 -- 172.21.15.148:0/703488639 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe28819c530 con 0x7fe2881069c0 2024-09-19T07:19:25.500 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.496+0000 7fe27dffb640 1 -- 172.21.15.148:0/703488639 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe280018c10 con 0x7fe2881069c0 2024-09-19T07:19:25.500 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.496+0000 7fe28ebcf640 1 -- 172.21.15.148:0/703488639 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2881a3dc0 con 0x7fe2881069c0 2024-09-19T07:19:25.509 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.499+0000 7fe27dffb640 1 -- 172.21.15.148:0/703488639 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fe28000f5f0 con 0x7fe2881069c0 2024-09-19T07:19:25.510 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.499+0000 7fe291a44740 1 Processor -- start 2024-09-19T07:19:25.510 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.499+0000 7fe291a44740 1 -- start start 2024-09-19T07:19:25.510 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.499+0000 7fe27dffb640 1 --2- 172.21.15.148:0/703488639 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe2700a3460 0x7fe2700a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:25.510 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.499+0000 7fe291a44740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b664bacd00 0x55b664bad0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:25.510 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.499+0000 7fe291a44740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b664bad620 0x55b664bb7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:25.510 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.499+0000 7fe291a44740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b664bb7ec0 0x55b664bba2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:25.510 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.499+0000 7fe291a44740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55b664b0f2f0 con 0x55b664bacd00 2024-09-19T07:19:25.510 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.500+0000 7fe291a44740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55b664ab7270 con 0x55b664bb7ec0 2024-09-19T07:19:25.510 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.500+0000 7fe291a44740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55b664b0b2b0 con 0x55b664bad620 2024-09-19T07:19:25.510 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.500+0000 7fe28c96b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b664bacd00 0x55b664bad0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:25.511 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.500+0000 7fe27ffff640 1 --2- 172.21.15.148:0/703488639 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe2700a3460 0x7fe2700a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:25.511 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.500+0000 7fe28c96b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b664bacd00 0x55b664bad0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43360/0 (socket says 172.21.15.148:43360) 2024-09-19T07:19:25.511 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.500+0000 7fe28c96b640 1 -- 172.21.15.148:0/4234992399 learned_addr learned my addr 172.21.15.148:0/4234992399 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:19:25.511 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.500+0000 7fe27dffb640 1 -- 172.21.15.148:0/703488639 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7fe2800d0490 con 0x7fe2881069c0 2024-09-19T07:19:25.511 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.500+0000 7fe27ffff640 1 --2- 172.21.15.148:0/4234992399 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b664bad620 0x55b664bb7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:25.511 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.500+0000 7fe28d16c640 1 --2- 172.21.15.148:0/4234992399 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b664bb7ec0 0x55b664bba2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:25.511 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.500+0000 7fe28c96b640 1 -- 172.21.15.148:0/4234992399 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b664bad620 msgr2=0x55b664bb7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:25.512 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.500+0000 7fe28c96b640 1 --2- 172.21.15.148:0/4234992399 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b664bad620 0x55b664bb7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:25.512 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.500+0000 7fe28c96b640 1 -- 172.21.15.148:0/4234992399 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b664bb7ec0 msgr2=0x55b664bba2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:25.512 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.500+0000 7fe28c96b640 1 --2- 172.21.15.148:0/4234992399 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b664bb7ec0 0x55b664bba2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:25.512 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.500+0000 7fe28c96b640 1 -- 172.21.15.148:0/4234992399 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b664ab6340 con 0x55b664bacd00 2024-09-19T07:19:25.512 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.500+0000 7fe28d16c640 1 --2- 172.21.15.148:0/4234992399 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b664bb7ec0 0x55b664bba2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:19:25.512 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.500+0000 7fe27ffff640 1 --2- 172.21.15.148:0/4234992399 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b664bad620 0x55b664bb7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:19:25.512 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.500+0000 7fe28c96b640 1 --2- 172.21.15.148:0/4234992399 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b664bacd00 0x55b664bad0e0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fe28400aba0 tx=0x7fe28400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5abc8e5ab75b1afa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:25.512 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.500+0000 7fe27ffff640 1 --2- 172.21.15.148:0/703488639 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe2700a3460 0x7fe2700a5920 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe278000c00 tx=0x7fe278031470 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:25.512 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.500+0000 7fe26effd640 1 -- 172.21.15.148:0/4234992399 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28401d070 con 0x55b664bacd00 2024-09-19T07:19:25.512 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.500+0000 7fe26effd640 1 -- 172.21.15.148:0/4234992399 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe284018b20 con 0x55b664bacd00 2024-09-19T07:19:25.512 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.500+0000 7fe26effd640 1 -- 172.21.15.148:0/4234992399 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe284010af0 con 0x55b664bacd00 2024-09-19T07:19:25.513 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.501+0000 7fe291a44740 1 -- 172.21.15.148:0/4234992399 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b664bacd00 msgr2=0x55b664bad0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:25.513 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.501+0000 7fe291a44740 1 --2- 172.21.15.148:0/4234992399 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b664bacd00 0x55b664bad0e0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fe28400aba0 tx=0x7fe28400f790 comp rx=0 tx=0).stop 2024-09-19T07:19:25.513 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.501+0000 7fe291a44740 1 -- 172.21.15.148:0/4234992399 shutdown_connections 2024-09-19T07:19:25.513 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.501+0000 7fe291a44740 1 --2- 172.21.15.148:0/4234992399 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b664bb7ec0 0x55b664bba2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:25.513 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.501+0000 7fe291a44740 1 --2- 172.21.15.148:0/4234992399 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b664bad620 0x55b664bb7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:25.513 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.501+0000 7fe291a44740 1 --2- 172.21.15.148:0/4234992399 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b664bacd00 0x55b664bad0e0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:25.513 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.501+0000 7fe291a44740 1 -- 172.21.15.148:0/4234992399 >> 172.21.15.148:0/4234992399 conn(0x55b664ba9270 msgr2=0x55b664ba9650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:25.513 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.501+0000 7fe291a44740 1 -- 172.21.15.148:0/4234992399 shutdown_connections 2024-09-19T07:19:25.513 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.501+0000 7fe291a44740 1 -- 172.21.15.148:0/4234992399 wait complete. 2024-09-19T07:19:25.513 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.501+0000 7fe291a44740 1 -- start start 2024-09-19T07:19:25.513 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.502+0000 7fe291a44740 1 Processor -- start 2024-09-19T07:19:25.513 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.502+0000 7fe291a44740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b664bacd00 0x55b664bb4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:25.513 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.502+0000 7fe291a44740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b664bad620 0x55b664bb52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:25.514 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.502+0000 7fe291a44740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b664bb7ec0 0x55b664bb5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:25.514 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.502+0000 7fe291a44740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55b664bbaa90 con 0x55b664bb7ec0 2024-09-19T07:19:25.514 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.502+0000 7fe291a44740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55b664a98290 con 0x55b664bacd00 2024-09-19T07:19:25.514 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.502+0000 7fe291a44740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55b664bbac10 con 0x55b664bad620 2024-09-19T07:19:25.514 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.502+0000 7fe291a44740 10 client.0 _ll_register_callbacks cb 0x55b664ac9140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:19:25.514 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.502+0000 7fe28d16c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b664bb7ec0 0x55b664bb5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:25.514 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.502+0000 7fe28d16c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b664bb7ec0 0x55b664bb5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43376/0 (socket says 172.21.15.148:43376) 2024-09-19T07:19:25.514 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.502+0000 7fe28d16c640 1 -- 172.21.15.148:0/1826809488 learned_addr learned my addr 172.21.15.148:0/1826809488 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:19:25.514 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.502+0000 7fe27ffff640 1 --2- 172.21.15.148:0/1826809488 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b664bad620 0x55b664bb52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:25.514 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.502+0000 7fe28c96b640 1 --2- 172.21.15.148:0/1826809488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b664bacd00 0x55b664bb4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:25.514 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.502+0000 7fe28d16c640 1 -- 172.21.15.148:0/1826809488 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b664bad620 msgr2=0x55b664bb52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:25.514 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.502+0000 7fe28d16c640 1 --2- 172.21.15.148:0/1826809488 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b664bad620 0x55b664bb52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:25.514 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.502+0000 7fe28d16c640 1 -- 172.21.15.148:0/1826809488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b664bacd00 msgr2=0x55b664bb4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.502+0000 7fe28d16c640 1 --2- 172.21.15.148:0/1826809488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b664bacd00 0x55b664bb4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.503+0000 7fe28d16c640 1 -- 172.21.15.148:0/1826809488 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b664822210 con 0x55b664bb7ec0 2024-09-19T07:19:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.503+0000 7fe28c96b640 1 --2- 172.21.15.148:0/1826809488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b664bacd00 0x55b664bb4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:19:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.503+0000 7fe28d16c640 1 --2- 172.21.15.148:0/1826809488 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b664bb7ec0 0x55b664bb5830 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fe280098b50 tx=0x7fe28009c050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba7f36588197cb92 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.503+0000 7fe267fff640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:19:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.503+0000 7fe267fff640 1 -- 172.21.15.148:0/1826809488 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2800655f0 con 0x55b664bb7ec0 2024-09-19T07:19:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.503+0000 7fe267fff640 1 -- 172.21.15.148:0/1826809488 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7fe2800cdde0 con 0x55b664bb7ec0 2024-09-19T07:19:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.503+0000 7fe291a44740 1 -- 172.21.15.148:0/1826809488 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe284018b20 con 0x55b664bb7ec0 2024-09-19T07:19:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.503+0000 7fe267fff640 1 -- 172.21.15.148:0/1826809488 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fe2800cdfe0 con 0x55b664bb7ec0 2024-09-19T07:19:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.503+0000 7fe291a44740 10 client.16821 fetch_fsmap learned FSMap version 41 2024-09-19T07:19:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.503+0000 7fe291a44740 1 -- 172.21.15.148:0/1826809488 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55b6648ee620 con 0x55b664bb7ec0 2024-09-19T07:19:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.503+0000 7fe267fff640 1 -- 172.21.15.148:0/1826809488 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe284018b20 con 0x55b664bb7ec0 2024-09-19T07:19:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.503+0000 7fe267fff640 1 -- 172.21.15.148:0/1826809488 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 41) ==== 8370+0+0 (secure 0 0 0) 0x7fe2800a4ed0 con 0x55b664bb7ec0 2024-09-19T07:19:25.516 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.503+0000 7fe291a44740 10 client.16821 fetch_fsmap finished waiting for FSMap version 41 2024-09-19T07:19:25.516 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.503+0000 7fe291a44740 10 client.16821 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:19:25.516 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.503+0000 7fe291a44740 20 client.16821 populate_metadata read hostname 'smithi148' 2024-09-19T07:19:25.516 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.503+0000 7fe291a44740 1 --2- 172.21.15.148:0/1826809488 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55b664bc7e10 0x55b664bca220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:25.516 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.503+0000 7fe291a44740 4 client.16821 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:19:25.516 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.503+0000 7fe291a44740 1 -- 172.21.15.148:0/1826809488 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b664b1ca20 con 0x55b664bc7e10 2024-09-19T07:19:25.516 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.504+0000 7fe28c96b640 1 --2- 172.21.15.148:0/1826809488 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55b664bc7e10 0x55b664bca220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:25.516 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.504+0000 7fe267fff640 10 client.16821 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:19:25.516 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.504+0000 7fe28c96b640 1 --2- 172.21.15.148:0/1826809488 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55b664bc7e10 0x55b664bca220 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=285c7b5afdddf34 server_cookie=64f4949656bd6528 in_seq=0 out_seq=0 2024-09-19T07:19:25.516 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.505+0000 7fe267fff640 1 -- 172.21.15.148:0/1826809488 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b664b1ca20 con 0x55b664bc7e10 2024-09-19T07:19:25.516 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.505+0000 7fe267fff640 10 client.16821 handle_command_reply: tid=0 2024-09-19T07:19:25.516 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.505+0000 7fe291a44740 1 client.16821 shutdown 2024-09-19T07:19:25.517 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.505+0000 7fe291a44740 1 -- 172.21.15.148:0/1826809488 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b664bb7ec0 msgr2=0x55b664bb5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:25.517 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.505+0000 7fe291a44740 1 --2- 172.21.15.148:0/1826809488 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b664bb7ec0 0x55b664bb5830 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fe280098b50 tx=0x7fe28009c050 comp rx=0 tx=0).stop 2024-09-19T07:19:25.517 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.505+0000 7fe291a44740 1 -- 172.21.15.148:0/1826809488 shutdown_connections 2024-09-19T07:19:25.517 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.505+0000 7fe291a44740 1 --2- 172.21.15.148:0/1826809488 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55b664bc7e10 0x55b664bca220 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:25.517 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.505+0000 7fe291a44740 1 --2- 172.21.15.148:0/1826809488 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b664bb7ec0 0x55b664bb5830 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:25.517 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.505+0000 7fe291a44740 1 --2- 172.21.15.148:0/1826809488 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b664bad620 0x55b664bb52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:25.517 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.505+0000 7fe291a44740 1 --2- 172.21.15.148:0/1826809488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b664bacd00 0x55b664bb4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:25.517 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.505+0000 7fe267fff640 0 client.16821 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:19:25.517 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.505+0000 7fe291a44740 1 -- 172.21.15.148:0/1826809488 >> 172.21.15.148:0/1826809488 conn(0x55b664ba9270 msgr2=0x55b664ba61c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:25.517 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.505+0000 7fe291a44740 1 -- 172.21.15.148:0/1826809488 shutdown_connections 2024-09-19T07:19:25.517 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.505+0000 7fe291a44740 1 -- 172.21.15.148:0/1826809488 wait complete. 2024-09-19T07:19:25.517 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.505+0000 7fe291a44740 20 client.16821 trim_cache size 0 max 16384 2024-09-19T07:19:25.522 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.520+0000 7fe291a44740 1 Processor -- start 2024-09-19T07:19:25.522 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.520+0000 7fe291a44740 1 -- start start 2024-09-19T07:19:25.522 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.520+0000 7fe291a44740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b664bacd00 0x55b664baf770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:25.522 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.520+0000 7fe291a44740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b664bad620 0x55b664bb6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:25.522 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.520+0000 7fe291a44740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b664bb7ec0 0x55b664bcfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:25.522 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.520+0000 7fe291a44740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe2881adf40 con 0x55b664bb7ec0 2024-09-19T07:19:25.522 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.520+0000 7fe291a44740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe2881ab750 con 0x55b664bacd00 2024-09-19T07:19:25.522 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.520+0000 7fe291a44740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe2881a95c0 con 0x55b664bad620 2024-09-19T07:19:25.523 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.520+0000 7fe28d16c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b664bb7ec0 0x55b664bcfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:25.523 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.520+0000 7fe28d16c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b664bb7ec0 0x55b664bcfb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43378/0 (socket says 172.21.15.148:43378) 2024-09-19T07:19:25.523 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.520+0000 7fe28d16c640 1 -- 172.21.15.148:0/2701476542 learned_addr learned my addr 172.21.15.148:0/2701476542 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:19:25.523 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.520+0000 7fe28c96b640 1 --2- 172.21.15.148:0/2701476542 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b664bacd00 0x55b664baf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:25.523 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.520+0000 7fe28d16c640 1 -- 172.21.15.148:0/2701476542 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b664bad620 msgr2=0x55b664bb6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:25.523 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.520+0000 7fe28d16c640 1 --2- 172.21.15.148:0/2701476542 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b664bad620 0x55b664bb6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:25.523 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.520+0000 7fe28d16c640 1 -- 172.21.15.148:0/2701476542 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b664bacd00 msgr2=0x55b664baf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:25.523 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.520+0000 7fe28d16c640 1 --2- 172.21.15.148:0/2701476542 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b664bacd00 0x55b664baf770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:25.523 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.520+0000 7fe28d16c640 1 -- 172.21.15.148:0/2701476542 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b664bb7900 con 0x55b664bb7ec0 2024-09-19T07:19:25.523 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.520+0000 7fe28d16c640 1 --2- 172.21.15.148:0/2701476542 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b664bb7ec0 0x55b664bcfb30 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fe2800990c0 tx=0x7fe28009c180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f57adeecd59b8572 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:25.523 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.520+0000 7fe26e7fc640 1 -- 172.21.15.148:0/2701476542 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2800a5360 con 0x55b664bb7ec0 2024-09-19T07:19:25.523 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.520+0000 7fe26e7fc640 1 -- 172.21.15.148:0/2701476542 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe28009c6f0 con 0x55b664bb7ec0 2024-09-19T07:19:25.524 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.520+0000 7fe26e7fc640 1 -- 172.21.15.148:0/2701476542 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28009b5b0 con 0x55b664bb7ec0 2024-09-19T07:19:25.524 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.521+0000 7fe291a44740 1 -- 172.21.15.148:0/2701476542 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b664bb7ec0 msgr2=0x55b664bcfb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:25.524 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.521+0000 7fe291a44740 1 --2- 172.21.15.148:0/2701476542 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b664bb7ec0 0x55b664bcfb30 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fe2800990c0 tx=0x7fe28009c180 comp rx=0 tx=0).stop 2024-09-19T07:19:25.524 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.521+0000 7fe291a44740 1 -- 172.21.15.148:0/2701476542 shutdown_connections 2024-09-19T07:19:25.524 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.521+0000 7fe291a44740 1 --2- 172.21.15.148:0/2701476542 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b664bb7ec0 0x55b664bcfb30 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:25.524 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.521+0000 7fe291a44740 1 --2- 172.21.15.148:0/2701476542 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b664bad620 0x55b664bb6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:25.524 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.521+0000 7fe291a44740 1 --2- 172.21.15.148:0/2701476542 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b664bacd00 0x55b664baf770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:25.524 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.521+0000 7fe291a44740 1 -- 172.21.15.148:0/2701476542 >> 172.21.15.148:0/2701476542 conn(0x55b664ba9270 msgr2=0x55b664bb6610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:25.524 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.521+0000 7fe291a44740 1 -- 172.21.15.148:0/2701476542 shutdown_connections 2024-09-19T07:19:25.524 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.521+0000 7fe291a44740 1 -- 172.21.15.148:0/2701476542 wait complete. 2024-09-19T07:19:25.524 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.521+0000 7fe291a44740 1 -- start start 2024-09-19T07:19:25.524 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.521+0000 7fe291a44740 1 Processor -- start 2024-09-19T07:19:25.527 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.522+0000 7fe291a44740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b664bacd00 0x55b664bc03f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:25.527 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.522+0000 7fe291a44740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b664bad620 0x55b664bb19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:25.527 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.522+0000 7fe291a44740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b664bb7ec0 0x55b664bb1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:25.527 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.522+0000 7fe291a44740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe2881a9c10 con 0x55b664bad620 2024-09-19T07:19:25.527 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.522+0000 7fe291a44740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe2881ab080 con 0x55b664bacd00 2024-09-19T07:19:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.522+0000 7fe291a44740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe2881aa2e0 con 0x55b664bb7ec0 2024-09-19T07:19:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.522+0000 7fe291a44740 10 client.0 _ll_register_callbacks cb 0x7fe2800185b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:19:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.522+0000 7fe27ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b664bad620 0x55b664bb19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.522+0000 7fe27ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b664bad620 0x55b664bb19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43380/0 (socket says 172.21.15.148:43380) 2024-09-19T07:19:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.522+0000 7fe27ffff640 1 -- 172.21.15.148:0/1355055653 learned_addr learned my addr 172.21.15.148:0/1355055653 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:19:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.522+0000 7fe28c96b640 1 --2- 172.21.15.148:0/1355055653 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b664bacd00 0x55b664bc03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.522+0000 7fe28d16c640 1 --2- 172.21.15.148:0/1355055653 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b664bb7ec0 0x55b664bb1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.522+0000 7fe27ffff640 1 -- 172.21.15.148:0/1355055653 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b664bb7ec0 msgr2=0x55b664bb1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.522+0000 7fe27ffff640 1 --2- 172.21.15.148:0/1355055653 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b664bb7ec0 0x55b664bb1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.522+0000 7fe27ffff640 1 -- 172.21.15.148:0/1355055653 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b664bacd00 msgr2=0x55b664bc03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.522+0000 7fe27ffff640 1 --2- 172.21.15.148:0/1355055653 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b664bacd00 0x55b664bc03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.522+0000 7fe27ffff640 1 -- 172.21.15.148:0/1355055653 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b664bb2570 con 0x55b664bad620 2024-09-19T07:19:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.522+0000 7fe27ffff640 1 --2- 172.21.15.148:0/1355055653 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b664bad620 0x55b664bb19c0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fe278009930 tx=0x7fe278009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=283c9a2ca46a02ef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:25.529 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.522+0000 7fe267fff640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:19:25.529 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.523+0000 7fe267fff640 1 -- 172.21.15.148:0/1355055653 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe278050020 con 0x55b664bad620 2024-09-19T07:19:25.529 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.523+0000 7fe267fff640 1 -- 172.21.15.148:0/1355055653 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7fe278003bd0 con 0x55b664bad620 2024-09-19T07:19:25.529 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.523+0000 7fe291a44740 1 -- 172.21.15.148:0/1355055653 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe28009c6f0 con 0x55b664bad620 2024-09-19T07:19:25.529 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.523+0000 7fe267fff640 1 -- 172.21.15.148:0/1355055653 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fe278035030 con 0x55b664bad620 2024-09-19T07:19:25.529 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.523+0000 7fe291a44740 10 client.16827 fetch_fsmap learned FSMap version 41 2024-09-19T07:19:25.529 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.523+0000 7fe291a44740 1 -- 172.21.15.148:0/1355055653 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55b664c329d0 con 0x55b664bad620 2024-09-19T07:19:25.529 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.523+0000 7fe267fff640 1 -- 172.21.15.148:0/1355055653 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe28009c6f0 con 0x55b664bad620 2024-09-19T07:19:25.529 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.523+0000 7fe267fff640 1 -- 172.21.15.148:0/1355055653 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 41) ==== 8370+0+0 (secure 0 0 0) 0x7fe27803a480 con 0x55b664bad620 2024-09-19T07:19:25.529 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.523+0000 7fe291a44740 10 client.16827 fetch_fsmap finished waiting for FSMap version 41 2024-09-19T07:19:25.529 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.523+0000 7fe291a44740 10 client.16827 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:19:25.529 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.523+0000 7fe291a44740 20 client.16827 populate_metadata read hostname 'smithi148' 2024-09-19T07:19:25.529 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.523+0000 7fe291a44740 1 --2- 172.21.15.148:0/1355055653 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55b664c33260 0x55b664c35680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:25.530 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.523+0000 7fe291a44740 4 client.16827 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:19:25.530 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.523+0000 7fe291a44740 1 -- 172.21.15.148:0/1355055653 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b664b16d70 con 0x55b664c33260 2024-09-19T07:19:25.530 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.523+0000 7fe28c96b640 1 --2- 172.21.15.148:0/1355055653 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55b664c33260 0x55b664c35680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:25.530 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.524+0000 7fe267fff640 10 client.16827 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:19:25.530 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.524+0000 7fe28c96b640 1 --2- 172.21.15.148:0/1355055653 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55b664c33260 0x55b664c35680 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45f24bdf34ee41 server_cookie=1c7438b6b29e68bd in_seq=0 out_seq=0 2024-09-19T07:19:25.548 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.547+0000 7fe267fff640 1 -- 172.21.15.148:0/1355055653 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b664b16d70 con 0x55b664c33260 2024-09-19T07:19:25.548 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.547+0000 7fe267fff640 10 client.16827 handle_command_reply: tid=0 2024-09-19T07:19:25.548 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.547+0000 7fe291a44740 1 client.16827 shutdown 2024-09-19T07:19:25.548 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.547+0000 7fe291a44740 1 -- 172.21.15.148:0/1355055653 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b664bad620 msgr2=0x55b664bb19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:25.548 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.547+0000 7fe291a44740 1 --2- 172.21.15.148:0/1355055653 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b664bad620 0x55b664bb19c0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fe278009930 tx=0x7fe278009560 comp rx=0 tx=0).stop 2024-09-19T07:19:25.548 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.547+0000 7fe291a44740 1 -- 172.21.15.148:0/1355055653 shutdown_connections 2024-09-19T07:19:25.548 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.547+0000 7fe291a44740 1 --2- 172.21.15.148:0/1355055653 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55b664c33260 0x55b664c35680 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:25.549 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.547+0000 7fe291a44740 1 --2- 172.21.15.148:0/1355055653 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b664bb7ec0 0x55b664bb1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:25.549 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.547+0000 7fe291a44740 1 --2- 172.21.15.148:0/1355055653 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b664bad620 0x55b664bb19c0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:25.549 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.547+0000 7fe267fff640 0 client.16827 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:19:25.549 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.547+0000 7fe291a44740 1 --2- 172.21.15.148:0/1355055653 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b664bacd00 0x55b664bc03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:25.549 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.547+0000 7fe291a44740 1 -- 172.21.15.148:0/1355055653 >> 172.21.15.148:0/1355055653 conn(0x55b664ba9270 msgr2=0x55b664ba61c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:25.549 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.547+0000 7fe291a44740 1 -- 172.21.15.148:0/1355055653 shutdown_connections 2024-09-19T07:19:25.549 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.547+0000 7fe291a44740 1 -- 172.21.15.148:0/1355055653 wait complete. 2024-09-19T07:19:25.549 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.547+0000 7fe291a44740 20 client.16827 trim_cache size 0 max 16384 2024-09-19T07:19:25.549 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:19:25.549 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:19:25.550 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:19:25.550 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:19:25.550 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.548+0000 7fe28ebcf640 1 -- 172.21.15.148:0/703488639 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe2700a3460 msgr2=0x7fe2700a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.548+0000 7fe28ebcf640 1 --2- 172.21.15.148:0/703488639 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe2700a3460 0x7fe2700a5920 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe278000c00 tx=0x7fe278031470 comp rx=0 tx=0).stop 2024-09-19T07:19:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.548+0000 7fe28ebcf640 1 -- 172.21.15.148:0/703488639 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2881069c0 msgr2=0x7fe28819bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.548+0000 7fe28ebcf640 1 --2- 172.21.15.148:0/703488639 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2881069c0 0x7fe28819bb10 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fe28000cce0 tx=0x7fe28000a620 comp rx=0 tx=0).stop 2024-09-19T07:19:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.548+0000 7fe28ebcf640 1 -- 172.21.15.148:0/703488639 shutdown_connections 2024-09-19T07:19:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.548+0000 7fe28ebcf640 1 --2- 172.21.15.148:0/703488639 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe2700a3460 0x7fe2700a5920 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.548+0000 7fe28ebcf640 1 --2- 172.21.15.148:0/703488639 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2881069c0 0x7fe28819bb10 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.548+0000 7fe28ebcf640 1 --2- 172.21.15.148:0/703488639 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe288101350 0x7fe288197790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.548+0000 7fe28ebcf640 1 --2- 172.21.15.148:0/703488639 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2881009b0 0x7fe288197250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.548+0000 7fe28ebcf640 1 -- 172.21.15.148:0/703488639 >> 172.21.15.148:0/703488639 conn(0x7fe288077990 msgr2=0x7fe288103760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.548+0000 7fe28ebcf640 1 -- 172.21.15.148:0/703488639 shutdown_connections 2024-09-19T07:19:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:25.548+0000 7fe28ebcf640 1 -- 172.21.15.148:0/703488639 wait complete. 2024-09-19T07:19:26.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:19:26 smithi179 ceph-mon[35716]: pgmap v259: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 8 op/s 2024-09-19T07:19:26.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:19:26 smithi148 ceph-mon[31180]: pgmap v259: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 8 op/s 2024-09-19T07:19:26.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:19:26 smithi165 ceph-mon[35326]: pgmap v259: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 8 op/s 2024-09-19T07:19:28.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:19:28 smithi179 ceph-mon[35716]: pgmap v260: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 8 op/s 2024-09-19T07:19:28.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:19:28 smithi148 ceph-mon[31180]: pgmap v260: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 8 op/s 2024-09-19T07:19:28.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:19:28 smithi165 ceph-mon[35326]: pgmap v260: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 8 op/s 2024-09-19T07:19:29.737 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:19:29.999 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:19:30.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.482+0000 7f22b4ac7640 1 -- 172.21.15.148:0/2293188586 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22b0106f10 msgr2=0x7f22b010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:30.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.482+0000 7f22b4ac7640 1 --2- 172.21.15.148:0/2293188586 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22b0106f10 0x7f22b010ea90 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f22a8009ca0 tx=0x7f22a802a8c0 comp rx=0 tx=0).stop 2024-09-19T07:19:30.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.482+0000 7f22b4ac7640 1 -- 172.21.15.148:0/2293188586 shutdown_connections 2024-09-19T07:19:30.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.482+0000 7f22b4ac7640 1 --2- 172.21.15.148:0/2293188586 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22b0106f10 0x7f22b010ea90 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:30.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.482+0000 7f22b4ac7640 1 --2- 172.21.15.148:0/2293188586 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f22b0102790 0x7f22b01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:30.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.482+0000 7f22b4ac7640 1 --2- 172.21.15.148:0/2293188586 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22b0101de0 0x7f22b01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:30.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.482+0000 7f22b4ac7640 1 -- 172.21.15.148:0/2293188586 >> 172.21.15.148:0/2293188586 conn(0x7f22b00fd8c0 msgr2=0x7f22b00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:30.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.482+0000 7f22b4ac7640 1 -- 172.21.15.148:0/2293188586 shutdown_connections 2024-09-19T07:19:30.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.482+0000 7f22b4ac7640 1 -- 172.21.15.148:0/2293188586 wait complete. 2024-09-19T07:19:30.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.483+0000 7f22b4ac7640 1 Processor -- start 2024-09-19T07:19:30.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.483+0000 7f22b4ac7640 1 -- start start 2024-09-19T07:19:30.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.483+0000 7f22b4ac7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22b0101de0 0x7f22b01985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:30.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.483+0000 7f22b4ac7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22b0102790 0x7f22b0198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:30.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.483+0000 7f22b4ac7640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f22b0106f10 0x7f22b019cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:30.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.483+0000 7f22b4ac7640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f22b0112010 con 0x7f22b0101de0 2024-09-19T07:19:30.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.483+0000 7f22b4ac7640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f22b0111e90 con 0x7f22b0106f10 2024-09-19T07:19:30.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.483+0000 7f22b4ac7640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f22b0112190 con 0x7f22b0102790 2024-09-19T07:19:30.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.483+0000 7f22ae59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22b0101de0 0x7f22b01985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:30.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.483+0000 7f22ae59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22b0101de0 0x7f22b01985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43396/0 (socket says 172.21.15.148:43396) 2024-09-19T07:19:30.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.483+0000 7f22ae59c640 1 -- 172.21.15.148:0/764678937 learned_addr learned my addr 172.21.15.148:0/764678937 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:19:30.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.483+0000 7f22add9b640 1 --2- 172.21.15.148:0/764678937 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22b0102790 0x7f22b0198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:30.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.483+0000 7f22ae59c640 1 -- 172.21.15.148:0/764678937 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22b0102790 msgr2=0x7f22b0198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:30.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.483+0000 7f22aed9d640 1 --2- 172.21.15.148:0/764678937 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f22b0106f10 0x7f22b019cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:30.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.483+0000 7f22ae59c640 1 --2- 172.21.15.148:0/764678937 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22b0102790 0x7f22b0198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:30.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.483+0000 7f22ae59c640 1 -- 172.21.15.148:0/764678937 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f22b0106f10 msgr2=0x7f22b019cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:30.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.483+0000 7f22ae59c640 1 --2- 172.21.15.148:0/764678937 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f22b0106f10 0x7f22b019cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:30.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.483+0000 7f22ae59c640 1 -- 172.21.15.148:0/764678937 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22b019d5a0 con 0x7f22b0101de0 2024-09-19T07:19:30.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.483+0000 7f22add9b640 1 --2- 172.21.15.148:0/764678937 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22b0102790 0x7f22b0198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:19:30.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.483+0000 7f22aed9d640 1 --2- 172.21.15.148:0/764678937 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f22b0106f10 0x7f22b019cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:19:30.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.484+0000 7f22ae59c640 1 --2- 172.21.15.148:0/764678937 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22b0101de0 0x7f22b01985f0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f22a000b4a0 tx=0x7f22a000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:30.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.484+0000 7f22a77fe640 1 -- 172.21.15.148:0/764678937 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a0014070 con 0x7f22b0101de0 2024-09-19T07:19:30.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.484+0000 7f22a77fe640 1 -- 172.21.15.148:0/764678937 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22a0010af0 con 0x7f22b0101de0 2024-09-19T07:19:30.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.484+0000 7f22b4ac7640 1 -- 172.21.15.148:0/764678937 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22b019d890 con 0x7f22b0101de0 2024-09-19T07:19:30.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.484+0000 7f22a77fe640 1 -- 172.21.15.148:0/764678937 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a0017d10 con 0x7f22b0101de0 2024-09-19T07:19:30.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.484+0000 7f22b4ac7640 1 -- 172.21.15.148:0/764678937 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22b01a5170 con 0x7f22b0101de0 2024-09-19T07:19:30.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.485+0000 7f22b4ac7640 1 -- 172.21.15.148:0/764678937 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22b0102240 con 0x7f22b0101de0 2024-09-19T07:19:30.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.486+0000 7f22a77fe640 1 -- 172.21.15.148:0/764678937 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f22a0017070 con 0x7f22b0101de0 2024-09-19T07:19:30.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.487+0000 7f22a77fe640 1 --2- 172.21.15.148:0/764678937 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f229c0a33b0 0x7f229c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:30.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.487+0000 7f22add9b640 1 --2- 172.21.15.148:0/764678937 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f229c0a33b0 0x7f229c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:30.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.487+0000 7f22a77fe640 1 -- 172.21.15.148:0/764678937 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7f22a00cf0b0 con 0x7f22b0101de0 2024-09-19T07:19:30.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.487+0000 7f22add9b640 1 --2- 172.21.15.148:0/764678937 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f229c0a33b0 0x7f229c0a5870 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2298006fd0 tx=0x7f2298008040 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:30.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.491+0000 7f22a77fe640 1 -- 172.21.15.148:0/764678937 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f22a009bb80 con 0x7f22b0101de0 2024-09-19T07:19:30.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.692+0000 7f22b4ac7640 1 -- 172.21.15.148:0/764678937 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f22b0199950 con 0x7f22b0101de0 2024-09-19T07:19:30.693 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:19:30 smithi148 ceph-mon[31180]: pgmap v261: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 8 op/s 2024-09-19T07:19:30.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.693+0000 7f22a77fe640 1 -- 172.21.15.148:0/764678937 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+11947 (secure 0 0 0) 0x7f22a009b480 con 0x7f22b0101de0 2024-09-19T07:19:30.694 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:19:30.694 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":41,"btime":"2024-09-19T07:18:21:600996+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/4263868576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":4263868576},{"type":"v1","addr":"172.21.15.148:6841","nonce":4263868576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":25606,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3891676893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3891676893},{"type":"v1","addr":"172.21.15.179:6835","nonce":3891676893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":41,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:09:19.543369+0000","modified":"2024-09-19T07:18:21.108238+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24457,"mds_1":24437,"mds_2":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":75,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":71,"addr":"172.21.15.165:6839/3993490234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":3993490234},{"type":"v1","addr":"172.21.15.165:6839","nonce":3993490234}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25823":{"gid":25823,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6835/380886107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":380886107},{"type":"v1","addr":"172.21.15.165:6835","nonce":380886107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24457,"qdb_cluster":[24457,24437,24436]},"id":1}]} 2024-09-19T07:19:30.694 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 41 2024-09-19T07:19:30.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.695+0000 7f22b4ac7640 1 -- 172.21.15.148:0/764678937 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f229c0a33b0 msgr2=0x7f229c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:30.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.695+0000 7f22b4ac7640 1 --2- 172.21.15.148:0/764678937 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f229c0a33b0 0x7f229c0a5870 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2298006fd0 tx=0x7f2298008040 comp rx=0 tx=0).stop 2024-09-19T07:19:30.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.695+0000 7f22b4ac7640 1 -- 172.21.15.148:0/764678937 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22b0101de0 msgr2=0x7f22b01985f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:30.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.695+0000 7f22b4ac7640 1 --2- 172.21.15.148:0/764678937 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22b0101de0 0x7f22b01985f0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f22a000b4a0 tx=0x7f22a000b960 comp rx=0 tx=0).stop 2024-09-19T07:19:30.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.695+0000 7f22b4ac7640 1 -- 172.21.15.148:0/764678937 shutdown_connections 2024-09-19T07:19:30.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.695+0000 7f22b4ac7640 1 --2- 172.21.15.148:0/764678937 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f229c0a33b0 0x7f229c0a5870 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:30.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.695+0000 7f22b4ac7640 1 --2- 172.21.15.148:0/764678937 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f22b0106f10 0x7f22b019cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:30.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.695+0000 7f22b4ac7640 1 --2- 172.21.15.148:0/764678937 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22b0102790 0x7f22b0198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:30.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.695+0000 7f22b4ac7640 1 --2- 172.21.15.148:0/764678937 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22b0101de0 0x7f22b01985f0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:30.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.695+0000 7f22b4ac7640 1 -- 172.21.15.148:0/764678937 >> 172.21.15.148:0/764678937 conn(0x7f22b00fd8c0 msgr2=0x7f22b00fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:30.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.695+0000 7f22b4ac7640 1 -- 172.21.15.148:0/764678937 shutdown_connections 2024-09-19T07:19:30.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:30.695+0000 7f22b4ac7640 1 -- 172.21.15.148:0/764678937 wait complete. 2024-09-19T07:19:30.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:19:30 smithi179 ceph-mon[35716]: pgmap v261: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 8 op/s 2024-09-19T07:19:30.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:19:30 smithi165 ceph-mon[35326]: pgmap v261: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 8 op/s 2024-09-19T07:19:31.443 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24457 quiesce db --set-id d158fe2 --release --await' 2024-09-19T07:19:31.443 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24457 quiesce db --set-id d158fe2 --release --await 2024-09-19T07:19:31.691 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:19:31.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:19:31 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/764678937' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:19:31.812 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:19:31 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/764678937' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:19:31.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:19:31 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/764678937' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:19:32.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.189+0000 7f10cf442640 1 -- 172.21.15.148:0/2250428570 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10c810c180 msgr2=0x7f10c810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:32.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.189+0000 7f10cf442640 1 --2- 172.21.15.148:0/2250428570 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10c810c180 0x7f10c810e610 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f10c0009ca0 tx=0x7f10c002a950 comp rx=0 tx=0).stop 2024-09-19T07:19:32.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.189+0000 7f10cf442640 1 -- 172.21.15.148:0/2250428570 shutdown_connections 2024-09-19T07:19:32.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.189+0000 7f10cf442640 1 --2- 172.21.15.148:0/2250428570 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10c810c180 0x7f10c810e610 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:32.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.189+0000 7f10cf442640 1 --2- 172.21.15.148:0/2250428570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10c8103700 0x7f10c810bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:32.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.189+0000 7f10cf442640 1 --2- 172.21.15.148:0/2250428570 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10c8102de0 0x7f10c81031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:32.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.189+0000 7f10cf442640 1 -- 172.21.15.148:0/2250428570 >> 172.21.15.148:0/2250428570 conn(0x7f10c80fc7a0 msgr2=0x7f10c80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:32.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.189+0000 7f10cf442640 1 -- 172.21.15.148:0/2250428570 shutdown_connections 2024-09-19T07:19:32.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.189+0000 7f10cf442640 1 -- 172.21.15.148:0/2250428570 wait complete. 2024-09-19T07:19:32.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.190+0000 7f10cf442640 1 Processor -- start 2024-09-19T07:19:32.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.190+0000 7f10cf442640 1 -- start start 2024-09-19T07:19:32.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.190+0000 7f10cf442640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10c8102de0 0x7f10c8198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:32.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.190+0000 7f10cf442640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10c8103700 0x7f10c8198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:32.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.190+0000 7f10cf442640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10c810c180 0x7f10c819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:32.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.190+0000 7f10cf442640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f10c8111f70 con 0x7f10c8103700 2024-09-19T07:19:32.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.190+0000 7f10cf442640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f10c8111df0 con 0x7f10c8102de0 2024-09-19T07:19:32.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.190+0000 7f10cf442640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f10c81120f0 con 0x7f10c810c180 2024-09-19T07:19:32.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.190+0000 7f10cc9dd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10c8103700 0x7f10c8198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:32.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.190+0000 7f10cc9dd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10c8103700 0x7f10c8198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43426/0 (socket says 172.21.15.148:43426) 2024-09-19T07:19:32.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.190+0000 7f10cc9dd640 1 -- 172.21.15.148:0/4090196377 learned_addr learned my addr 172.21.15.148:0/4090196377 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:19:32.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.191+0000 7f10cd1de640 1 --2- 172.21.15.148:0/4090196377 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10c8102de0 0x7f10c8198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:32.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.191+0000 7f10cd9df640 1 --2- 172.21.15.148:0/4090196377 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10c810c180 0x7f10c819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:32.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.191+0000 7f10cc9dd640 1 -- 172.21.15.148:0/4090196377 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10c810c180 msgr2=0x7f10c819cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:32.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.191+0000 7f10cc9dd640 1 --2- 172.21.15.148:0/4090196377 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10c810c180 0x7f10c819cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:32.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.191+0000 7f10cc9dd640 1 -- 172.21.15.148:0/4090196377 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10c8102de0 msgr2=0x7f10c8198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:32.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.191+0000 7f10cc9dd640 1 --2- 172.21.15.148:0/4090196377 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10c8102de0 0x7f10c8198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:32.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.191+0000 7f10cc9dd640 1 -- 172.21.15.148:0/4090196377 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10c819d3c0 con 0x7f10c8103700 2024-09-19T07:19:32.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.191+0000 7f10cc9dd640 1 --2- 172.21.15.148:0/4090196377 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10c8103700 0x7f10c8198950 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f10b800c970 tx=0x7f10b800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:32.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.191+0000 7f10be7fc640 1 -- 172.21.15.148:0/4090196377 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b8007bb0 con 0x7f10c8103700 2024-09-19T07:19:32.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.191+0000 7f10be7fc640 1 -- 172.21.15.148:0/4090196377 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10b8007d50 con 0x7f10c8103700 2024-09-19T07:19:32.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.191+0000 7f10cf442640 1 -- 172.21.15.148:0/4090196377 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10c819d6b0 con 0x7f10c8103700 2024-09-19T07:19:32.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.191+0000 7f10be7fc640 1 -- 172.21.15.148:0/4090196377 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b800f450 con 0x7f10c8103700 2024-09-19T07:19:32.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.191+0000 7f10cf442640 1 -- 172.21.15.148:0/4090196377 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10c81a4f90 con 0x7f10c8103700 2024-09-19T07:19:32.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.193+0000 7f10be7fc640 1 -- 172.21.15.148:0/4090196377 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f10b8005020 con 0x7f10c8103700 2024-09-19T07:19:32.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.194+0000 7f10d181b740 1 Processor -- start 2024-09-19T07:19:32.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.194+0000 7f10d181b740 1 -- start start 2024-09-19T07:19:32.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.194+0000 7f10d181b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564f09006f20 0x564f09007300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:32.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.194+0000 7f10d181b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564f09007840 0x564f09016110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:32.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.194+0000 7f10be7fc640 1 --2- 172.21.15.148:0/4090196377 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f10b40a33b0 0x7f10b40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:32.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.194+0000 7f10d181b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f09016650 0x564f09018a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:32.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.194+0000 7f10d181b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x564f08f6c620 con 0x564f09016650 2024-09-19T07:19:32.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.194+0000 7f10d181b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x564f08f13e50 con 0x564f09006f20 2024-09-19T07:19:32.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.194+0000 7f10d181b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564f08f685e0 con 0x564f09007840 2024-09-19T07:19:32.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.194+0000 7f10cc9dd640 1 --2- 172.21.15.148:0/4090196377 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f10b40a33b0 0x7f10b40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:32.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.194+0000 7f10cd9df640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f09016650 0x564f09018a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:32.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.194+0000 7f10be7fc640 1 -- 172.21.15.148:0/4090196377 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7f10b80cfbc0 con 0x7f10c8103700 2024-09-19T07:19:32.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.194+0000 7f10cd9df640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f09016650 0x564f09018a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43428/0 (socket says 172.21.15.148:43428) 2024-09-19T07:19:32.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.194+0000 7f10cd9df640 1 -- 172.21.15.148:0/308450836 learned_addr learned my addr 172.21.15.148:0/308450836 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:19:32.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.194+0000 7f10cd1de640 1 --2- 172.21.15.148:0/308450836 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564f09007840 0x564f09016110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:32.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.194+0000 7f10cd9df640 1 --2- 172.21.15.148:0/308450836 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564f09006f20 0x564f09007300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:32.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.195+0000 7f10cd9df640 1 -- 172.21.15.148:0/308450836 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564f09007840 msgr2=0x564f09016110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:32.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.195+0000 7f10cd9df640 1 --2- 172.21.15.148:0/308450836 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564f09007840 0x564f09016110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:32.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.195+0000 7f10cd9df640 1 -- 172.21.15.148:0/308450836 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564f09006f20 msgr2=0x564f09007300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:32.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.195+0000 7f10cd9df640 1 --2- 172.21.15.148:0/308450836 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564f09006f20 0x564f09007300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:32.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.195+0000 7f10cd9df640 1 -- 172.21.15.148:0/308450836 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f08f04d40 con 0x564f09016650 2024-09-19T07:19:32.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.195+0000 7f10cc9dd640 1 --2- 172.21.15.148:0/4090196377 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f10b40a33b0 0x7f10b40a5870 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f10b809bb20 tx=0x7f10b80912b0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:32.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.195+0000 7f10cd9df640 1 --2- 172.21.15.148:0/308450836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f09016650 0x564f09018a40 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f10c0009430 tx=0x7f10c0005f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df4a53df946b5448 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:32.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.195+0000 7f10b37fe640 1 -- 172.21.15.148:0/308450836 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c003e070 con 0x564f09016650 2024-09-19T07:19:32.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.195+0000 7f10b37fe640 1 -- 172.21.15.148:0/308450836 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10c0003e50 con 0x564f09016650 2024-09-19T07:19:32.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.195+0000 7f10b37fe640 1 -- 172.21.15.148:0/308450836 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c0034040 con 0x564f09016650 2024-09-19T07:19:32.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.196+0000 7f10d181b740 1 -- 172.21.15.148:0/308450836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f09016650 msgr2=0x564f09018a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:32.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.196+0000 7f10d181b740 1 --2- 172.21.15.148:0/308450836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f09016650 0x564f09018a40 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f10c0009430 tx=0x7f10c0005f60 comp rx=0 tx=0).stop 2024-09-19T07:19:32.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.196+0000 7f10d181b740 1 -- 172.21.15.148:0/308450836 shutdown_connections 2024-09-19T07:19:32.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.196+0000 7f10d181b740 1 --2- 172.21.15.148:0/308450836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f09016650 0x564f09018a40 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:32.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.196+0000 7f10d181b740 1 --2- 172.21.15.148:0/308450836 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564f09007840 0x564f09016110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:32.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.196+0000 7f10d181b740 1 --2- 172.21.15.148:0/308450836 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564f09006f20 0x564f09007300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:32.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.196+0000 7f10d181b740 1 -- 172.21.15.148:0/308450836 >> 172.21.15.148:0/308450836 conn(0x564f090035f0 msgr2=0x564f090039d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:32.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.196+0000 7f10d181b740 1 -- 172.21.15.148:0/308450836 shutdown_connections 2024-09-19T07:19:32.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.196+0000 7f10d181b740 1 -- 172.21.15.148:0/308450836 wait complete. 2024-09-19T07:19:32.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.196+0000 7f10d181b740 1 -- start start 2024-09-19T07:19:32.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.196+0000 7f10d181b740 1 Processor -- start 2024-09-19T07:19:32.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.197+0000 7f10d181b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564f09006f20 0x564f090135c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:32.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.197+0000 7f10d181b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f09007840 0x564f09013b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:32.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.197+0000 7f10d181b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564f09016650 0x564f09014040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:32.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.197+0000 7f10d181b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x564f090191c0 con 0x564f09007840 2024-09-19T07:19:32.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.197+0000 7f10d181b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x564f08ef4f10 con 0x564f09016650 2024-09-19T07:19:32.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.197+0000 7f10d181b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564f09019340 con 0x564f09006f20 2024-09-19T07:19:32.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.197+0000 7f10cd1de640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f09007840 0x564f09013b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:32.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.197+0000 7f10d181b740 10 client.0 _ll_register_callbacks cb 0x564f08f18db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:19:32.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.197+0000 7f10cd1de640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f09007840 0x564f09013b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43432/0 (socket says 172.21.15.148:43432) 2024-09-19T07:19:32.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.197+0000 7f10cd1de640 1 -- 172.21.15.148:0/3257001390 learned_addr learned my addr 172.21.15.148:0/3257001390 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:19:32.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.197+0000 7f10cd9df640 1 --2- 172.21.15.148:0/3257001390 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564f09006f20 0x564f090135c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:32.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.197+0000 7f10cd9df640 1 --2- 172.21.15.148:0/3257001390 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564f09016650 0x564f09014040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:32.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.197+0000 7f10cd1de640 1 -- 172.21.15.148:0/3257001390 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564f09006f20 msgr2=0x564f090135c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:32.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.197+0000 7f10cd1de640 1 --2- 172.21.15.148:0/3257001390 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564f09006f20 0x564f090135c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:32.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.197+0000 7f10cd1de640 1 -- 172.21.15.148:0/3257001390 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564f09016650 msgr2=0x564f09014040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:32.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.197+0000 7f10cd1de640 1 --2- 172.21.15.148:0/3257001390 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564f09016650 0x564f09014040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:32.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.197+0000 7f10cd1de640 1 -- 172.21.15.148:0/3257001390 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f08c7b580 con 0x564f09007840 2024-09-19T07:19:32.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.197+0000 7f10cd9df640 1 --2- 172.21.15.148:0/3257001390 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564f09016650 0x564f09014040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:19:32.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.197+0000 7f10cd1de640 1 --2- 172.21.15.148:0/3257001390 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f09007840 0x564f09013b00 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f10c4011740 tx=0x7f10c4011c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cebcaec4501763f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:32.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.197+0000 7f10b0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:19:32.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.197+0000 7f10b0ff9640 1 -- 172.21.15.148:0/3257001390 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c401e060 con 0x564f09007840 2024-09-19T07:19:32.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.197+0000 7f10b0ff9640 1 -- 172.21.15.148:0/3257001390 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7f10c400fdb0 con 0x564f09007840 2024-09-19T07:19:32.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.197+0000 7f10d181b740 1 -- 172.21.15.148:0/3257001390 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10c0003e50 con 0x564f09007840 2024-09-19T07:19:32.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.197+0000 7f10b0ff9640 1 -- 172.21.15.148:0/3257001390 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f10c4022430 con 0x564f09007840 2024-09-19T07:19:32.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.198+0000 7f10d181b740 10 client.16845 fetch_fsmap learned FSMap version 41 2024-09-19T07:19:32.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.198+0000 7f10d181b740 1 -- 172.21.15.148:0/3257001390 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x564f08d45960 con 0x564f09007840 2024-09-19T07:19:32.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.198+0000 7f10b0ff9640 1 -- 172.21.15.148:0/3257001390 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10c0003e50 con 0x564f09007840 2024-09-19T07:19:32.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.198+0000 7f10b0ff9640 1 -- 172.21.15.148:0/3257001390 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 41) ==== 8370+0+0 (secure 0 0 0) 0x7f10c4018030 con 0x564f09007840 2024-09-19T07:19:32.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.198+0000 7f10d181b740 10 client.16845 fetch_fsmap finished waiting for FSMap version 41 2024-09-19T07:19:32.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.198+0000 7f10d181b740 10 client.16845 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:19:32.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.198+0000 7f10d181b740 20 client.16845 populate_metadata read hostname 'smithi148' 2024-09-19T07:19:32.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.198+0000 7f10d181b740 1 --2- 172.21.15.148:0/3257001390 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x564f09026300 0x564f09028720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:32.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.198+0000 7f10d181b740 4 client.16845 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:19:32.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.198+0000 7f10d181b740 1 -- 172.21.15.148:0/3257001390 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f08f79b90 con 0x564f09026300 2024-09-19T07:19:32.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.198+0000 7f10cd9df640 1 --2- 172.21.15.148:0/3257001390 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x564f09026300 0x564f09028720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:32.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.199+0000 7f10cd9df640 1 --2- 172.21.15.148:0/3257001390 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x564f09026300 0x564f09028720 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1c4c4609360e8ee server_cookie=254bdca999d92f0d in_seq=0 out_seq=0 2024-09-19T07:19:32.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.199+0000 7f10b0ff9640 10 client.16845 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:19:32.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.199+0000 7f10b0ff9640 1 -- 172.21.15.148:0/3257001390 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564f08f79b90 con 0x564f09026300 2024-09-19T07:19:32.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.199+0000 7f10b0ff9640 10 client.16845 handle_command_reply: tid=0 2024-09-19T07:19:32.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.199+0000 7f10d181b740 1 client.16845 shutdown 2024-09-19T07:19:32.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.199+0000 7f10d181b740 1 -- 172.21.15.148:0/3257001390 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f09007840 msgr2=0x564f09013b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:32.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.199+0000 7f10d181b740 1 --2- 172.21.15.148:0/3257001390 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f09007840 0x564f09013b00 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f10c4011740 tx=0x7f10c4011c00 comp rx=0 tx=0).stop 2024-09-19T07:19:32.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.199+0000 7f10d181b740 1 -- 172.21.15.148:0/3257001390 shutdown_connections 2024-09-19T07:19:32.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.199+0000 7f10d181b740 1 --2- 172.21.15.148:0/3257001390 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x564f09026300 0x564f09028720 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:32.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.199+0000 7f10d181b740 1 --2- 172.21.15.148:0/3257001390 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564f09016650 0x564f09014040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:32.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.199+0000 7f10d181b740 1 --2- 172.21.15.148:0/3257001390 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f09007840 0x564f09013b00 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:32.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.199+0000 7f10b0ff9640 0 client.16845 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:19:32.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.199+0000 7f10d181b740 1 --2- 172.21.15.148:0/3257001390 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564f09006f20 0x564f090135c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:32.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.199+0000 7f10d181b740 1 -- 172.21.15.148:0/3257001390 >> 172.21.15.148:0/3257001390 conn(0x564f090035f0 msgr2=0x564f09002750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:32.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.200+0000 7f10d181b740 1 -- 172.21.15.148:0/3257001390 shutdown_connections 2024-09-19T07:19:32.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.200+0000 7f10d181b740 1 -- 172.21.15.148:0/3257001390 wait complete. 2024-09-19T07:19:32.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.200+0000 7f10d181b740 20 client.16845 trim_cache size 0 max 16384 2024-09-19T07:19:32.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.216+0000 7f10d181b740 1 Processor -- start 2024-09-19T07:19:32.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.216+0000 7f10d181b740 1 -- start start 2024-09-19T07:19:32.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.217+0000 7f10d181b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564f09006f20 0x564f0902e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:32.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.217+0000 7f10d181b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f09007840 0x564f0902e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:32.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.217+0000 7f10d181b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564f09016650 0x564f09010820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:32.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.217+0000 7f10d181b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f10c81ae0a0 con 0x564f09007840 2024-09-19T07:19:32.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.217+0000 7f10d181b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f10c81ab8b0 con 0x564f09006f20 2024-09-19T07:19:32.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.217+0000 7f10d181b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f10c81a9720 con 0x564f09016650 2024-09-19T07:19:32.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.217+0000 7f10cd1de640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f09007840 0x564f0902e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:32.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.217+0000 7f10cd1de640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f09007840 0x564f0902e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43440/0 (socket says 172.21.15.148:43440) 2024-09-19T07:19:32.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.217+0000 7f10cd1de640 1 -- 172.21.15.148:0/2366841727 learned_addr learned my addr 172.21.15.148:0/2366841727 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:19:32.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.217+0000 7f10cd9df640 1 --2- 172.21.15.148:0/2366841727 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564f09016650 0x564f09010820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:32.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.217+0000 7f10cd9df640 1 --2- 172.21.15.148:0/2366841727 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564f09006f20 0x564f0902e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:32.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.217+0000 7f10cd1de640 1 -- 172.21.15.148:0/2366841727 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564f09016650 msgr2=0x564f09010820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:32.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.217+0000 7f10cd1de640 1 --2- 172.21.15.148:0/2366841727 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564f09016650 0x564f09010820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:32.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.217+0000 7f10cd1de640 1 -- 172.21.15.148:0/2366841727 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564f09006f20 msgr2=0x564f0902e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:32.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.217+0000 7f10cd1de640 1 --2- 172.21.15.148:0/2366841727 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564f09006f20 0x564f0902e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:32.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.217+0000 7f10cd1de640 1 -- 172.21.15.148:0/2366841727 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f09011b10 con 0x564f09007840 2024-09-19T07:19:32.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.217+0000 7f10cd9df640 1 --2- 172.21.15.148:0/2366841727 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564f09006f20 0x564f0902e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:19:32.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.217+0000 7f10cd1de640 1 --2- 172.21.15.148:0/2366841727 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f09007840 0x564f0902e570 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f10c4011710 tx=0x7f10c4005c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63fa55ab803534df server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:32.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.217+0000 7f10b2ffd640 1 -- 172.21.15.148:0/2366841727 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c40218b0 con 0x564f09007840 2024-09-19T07:19:32.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.217+0000 7f10b2ffd640 1 -- 172.21.15.148:0/2366841727 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10c4011e50 con 0x564f09007840 2024-09-19T07:19:32.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.217+0000 7f10b2ffd640 1 -- 172.21.15.148:0/2366841727 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c400fbb0 con 0x564f09007840 2024-09-19T07:19:32.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.218+0000 7f10d181b740 1 -- 172.21.15.148:0/2366841727 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f09007840 msgr2=0x564f0902e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:32.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.218+0000 7f10d181b740 1 --2- 172.21.15.148:0/2366841727 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f09007840 0x564f0902e570 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f10c4011710 tx=0x7f10c4005c40 comp rx=0 tx=0).stop 2024-09-19T07:19:32.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.218+0000 7f10d181b740 1 -- 172.21.15.148:0/2366841727 shutdown_connections 2024-09-19T07:19:32.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.218+0000 7f10d181b740 1 --2- 172.21.15.148:0/2366841727 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564f09016650 0x564f09010820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:32.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.218+0000 7f10d181b740 1 --2- 172.21.15.148:0/2366841727 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f09007840 0x564f0902e570 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:32.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.218+0000 7f10d181b740 1 --2- 172.21.15.148:0/2366841727 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564f09006f20 0x564f0902e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:32.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.218+0000 7f10d181b740 1 -- 172.21.15.148:0/2366841727 >> 172.21.15.148:0/2366841727 conn(0x564f090035f0 msgr2=0x564f09011e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:32.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.218+0000 7f10d181b740 1 -- 172.21.15.148:0/2366841727 shutdown_connections 2024-09-19T07:19:32.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.218+0000 7f10d181b740 1 -- 172.21.15.148:0/2366841727 wait complete. 2024-09-19T07:19:32.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.218+0000 7f10d181b740 1 -- start start 2024-09-19T07:19:32.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.219+0000 7f10d181b740 1 Processor -- start 2024-09-19T07:19:32.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.219+0000 7f10d181b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564f09006f20 0x564f0901e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:32.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.219+0000 7f10d181b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f09007840 0x564f0901ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:32.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.219+0000 7f10d181b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564f09016650 0x564f0901aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:32.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.219+0000 7f10d181b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f10c81a9d70 con 0x564f09007840 2024-09-19T07:19:32.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.219+0000 7f10d181b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f10c81ab1e0 con 0x564f09016650 2024-09-19T07:19:32.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.219+0000 7f10d181b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f10c81aa440 con 0x564f09006f20 2024-09-19T07:19:32.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.219+0000 7f10d181b740 10 client.0 _ll_register_callbacks cb 0x7f10c400cf10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:19:32.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.219+0000 7f10cd1de640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f09007840 0x564f0901ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:32.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.219+0000 7f10cd1de640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f09007840 0x564f0901ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43444/0 (socket says 172.21.15.148:43444) 2024-09-19T07:19:32.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.219+0000 7f10cd1de640 1 -- 172.21.15.148:0/2487710892 learned_addr learned my addr 172.21.15.148:0/2487710892 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:19:32.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.219+0000 7f10cd9df640 1 --2- 172.21.15.148:0/2487710892 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564f09006f20 0x564f0901e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:32.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.219+0000 7f10cd1de640 1 -- 172.21.15.148:0/2487710892 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564f09006f20 msgr2=0x564f0901e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:32.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.219+0000 7f10cd1de640 1 --2- 172.21.15.148:0/2487710892 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564f09006f20 0x564f0901e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:32.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.219+0000 7f10cd1de640 1 -- 172.21.15.148:0/2487710892 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564f09016650 msgr2=0x564f0901aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:32.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.219+0000 7f10cd1de640 1 --2- 172.21.15.148:0/2487710892 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564f09016650 0x564f0901aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:32.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.219+0000 7f10cd1de640 1 -- 172.21.15.148:0/2487710892 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f0901b300 con 0x564f09007840 2024-09-19T07:19:32.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.220+0000 7f10cd1de640 1 --2- 172.21.15.148:0/2487710892 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f09007840 0x564f0901ebd0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f10c4011740 tx=0x7f10c4021c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2881394bd5acdf2b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:32.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.220+0000 7f10b0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:19:32.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.220+0000 7f10b0ff9640 1 -- 172.21.15.148:0/2487710892 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c401e070 con 0x564f09007840 2024-09-19T07:19:32.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.220+0000 7f10b0ff9640 1 -- 172.21.15.148:0/2487710892 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7f10c4011020 con 0x564f09007840 2024-09-19T07:19:32.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.220+0000 7f10d181b740 1 -- 172.21.15.148:0/2487710892 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10c4011e50 con 0x564f09007840 2024-09-19T07:19:32.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.220+0000 7f10b0ff9640 1 -- 172.21.15.148:0/2487710892 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f10c4021a40 con 0x564f09007840 2024-09-19T07:19:32.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.220+0000 7f10d181b740 10 client.16851 fetch_fsmap learned FSMap version 41 2024-09-19T07:19:32.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.220+0000 7f10d181b740 1 -- 172.21.15.148:0/2487710892 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x564f09091a20 con 0x564f09007840 2024-09-19T07:19:32.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.220+0000 7f10b0ff9640 1 -- 172.21.15.148:0/2487710892 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10c4011e50 con 0x564f09007840 2024-09-19T07:19:32.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.220+0000 7f10b0ff9640 1 -- 172.21.15.148:0/2487710892 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 41) ==== 8370+0+0 (secure 0 0 0) 0x7f10c402b030 con 0x564f09007840 2024-09-19T07:19:32.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.220+0000 7f10d181b740 10 client.16851 fetch_fsmap finished waiting for FSMap version 41 2024-09-19T07:19:32.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.220+0000 7f10d181b740 10 client.16851 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:19:32.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.220+0000 7f10d181b740 20 client.16851 populate_metadata read hostname 'smithi148' 2024-09-19T07:19:32.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.220+0000 7f10d181b740 1 --2- 172.21.15.148:0/2487710892 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x564f09092020 0x564f09094410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:32.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.220+0000 7f10d181b740 4 client.16851 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "d158fe2", "release": true, "await": true}] 2024-09-19T07:19:32.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.220+0000 7f10d181b740 1 -- 172.21.15.148:0/2487710892 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "quiesce db", "set_id": "d158fe2", "release": true, "await": true}) -- 0x564f08f740a0 con 0x564f09092020 2024-09-19T07:19:32.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.221+0000 7f10cd9df640 1 --2- 172.21.15.148:0/2487710892 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x564f09092020 0x564f09094410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:32.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.221+0000 7f10b0ff9640 10 client.16851 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:19:32.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:32.221+0000 7f10cd9df640 1 --2- 172.21.15.148:0/2487710892 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x564f09092020 0x564f09094410 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5641a70b87768ae6 server_cookie=dfa084d248619239 in_seq=0 out_seq=0 2024-09-19T07:19:32.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:19:32 smithi179 ceph-mon[35716]: pgmap v262: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 35 KiB/s wr, 12 op/s 2024-09-19T07:19:32.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:19:32 smithi148 ceph-mon[31180]: pgmap v262: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 35 KiB/s wr, 12 op/s 2024-09-19T07:19:32.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:19:32 smithi165 ceph-mon[35326]: pgmap v262: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 35 KiB/s wr, 12 op/s 2024-09-19T07:19:33.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:33.438+0000 7f10b0ff9640 1 -- 172.21.15.148:0/2487710892 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x564f08f740a0 con 0x564f09092020 2024-09-19T07:19:33.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:33.438+0000 7f10b0ff9640 10 client.16851 handle_command_reply: tid=0 2024-09-19T07:19:33.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:33.438+0000 7f10d181b740 1 client.16851 shutdown 2024-09-19T07:19:33.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:33.438+0000 7f10d181b740 1 -- 172.21.15.148:0/2487710892 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f09007840 msgr2=0x564f0901ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:33.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:33.438+0000 7f10d181b740 1 --2- 172.21.15.148:0/2487710892 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f09007840 0x564f0901ebd0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f10c4011740 tx=0x7f10c4021c60 comp rx=0 tx=0).stop 2024-09-19T07:19:33.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:33.438+0000 7f10d181b740 1 -- 172.21.15.148:0/2487710892 shutdown_connections 2024-09-19T07:19:33.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:33.438+0000 7f10d181b740 1 --2- 172.21.15.148:0/2487710892 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x564f09092020 0x564f09094410 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:33.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:33.438+0000 7f10d181b740 1 --2- 172.21.15.148:0/2487710892 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564f09016650 0x564f0901aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:33.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:33.438+0000 7f10d181b740 1 --2- 172.21.15.148:0/2487710892 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564f09007840 0x564f0901ebd0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:33.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:33.438+0000 7f10b0ff9640 0 client.16851 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:19:33.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:33.438+0000 7f10d181b740 1 --2- 172.21.15.148:0/2487710892 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564f09006f20 0x564f0901e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:33.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:33.438+0000 7f10d181b740 1 -- 172.21.15.148:0/2487710892 >> 172.21.15.148:0/2487710892 conn(0x564f090035f0 msgr2=0x564f09001f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:33.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:33.438+0000 7f10d181b740 1 -- 172.21.15.148:0/2487710892 shutdown_connections 2024-09-19T07:19:33.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:33.438+0000 7f10d181b740 1 -- 172.21.15.148:0/2487710892 wait complete. 2024-09-19T07:19:33.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:33.439+0000 7f10d181b740 20 client.16851 trim_cache size 0 max 16384 2024-09-19T07:19:33.441 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:19:33.441 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 41, 2024-09-19T07:19:33.441 INFO:teuthology.orchestra.run.smithi148.stdout: "leader": 24457, 2024-09-19T07:19:33.442 INFO:teuthology.orchestra.run.smithi148.stdout: "set_version": 32, 2024-09-19T07:19:33.442 INFO:teuthology.orchestra.run.smithi148.stdout: "sets": { 2024-09-19T07:19:33.442 INFO:teuthology.orchestra.run.smithi148.stdout: "d158fe2": { 2024-09-19T07:19:33.442 INFO:teuthology.orchestra.run.smithi148.stdout: "version": 32, 2024-09-19T07:19:33.442 INFO:teuthology.orchestra.run.smithi148.stdout: "age_ref": 0.0, 2024-09-19T07:19:33.442 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:19:33.442 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RELEASED", 2024-09-19T07:19:33.442 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:19:33.442 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:19:33.442 INFO:teuthology.orchestra.run.smithi148.stdout: "timeout": 90.0, 2024-09-19T07:19:33.442 INFO:teuthology.orchestra.run.smithi148.stdout: "expiration": 145.8, 2024-09-19T07:19:33.443 INFO:teuthology.orchestra.run.smithi148.stdout: "members": { 2024-09-19T07:19:33.443 INFO:teuthology.orchestra.run.smithi148.stdout: "file:/": { 2024-09-19T07:19:33.443 INFO:teuthology.orchestra.run.smithi148.stdout: "excluded": false, 2024-09-19T07:19:33.443 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:19:33.443 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RELEASED", 2024-09-19T07:19:33.443 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:19:33.443 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:19:33.443 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:19:33.444 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:19:33.444 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:19:33.444 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:19:33.444 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:19:33.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:33.439+0000 7f10cf442640 1 -- 172.21.15.148:0/4090196377 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f10b40a33b0 msgr2=0x7f10b40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:33.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:33.439+0000 7f10cf442640 1 --2- 172.21.15.148:0/4090196377 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f10b40a33b0 0x7f10b40a5870 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f10b809bb20 tx=0x7f10b80912b0 comp rx=0 tx=0).stop 2024-09-19T07:19:33.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:33.439+0000 7f10cf442640 1 -- 172.21.15.148:0/4090196377 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10c8103700 msgr2=0x7f10c8198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:33.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:33.439+0000 7f10cf442640 1 --2- 172.21.15.148:0/4090196377 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10c8103700 0x7f10c8198950 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f10b800c970 tx=0x7f10b800ce30 comp rx=0 tx=0).stop 2024-09-19T07:19:33.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:33.439+0000 7f10cf442640 1 -- 172.21.15.148:0/4090196377 shutdown_connections 2024-09-19T07:19:33.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:33.439+0000 7f10cf442640 1 --2- 172.21.15.148:0/4090196377 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f10b40a33b0 0x7f10b40a5870 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:33.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:33.439+0000 7f10cf442640 1 --2- 172.21.15.148:0/4090196377 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10c810c180 0x7f10c819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:33.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:33.439+0000 7f10cf442640 1 --2- 172.21.15.148:0/4090196377 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10c8103700 0x7f10c8198950 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:33.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:33.439+0000 7f10cf442640 1 --2- 172.21.15.148:0/4090196377 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10c8102de0 0x7f10c8198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:33.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:33.439+0000 7f10cf442640 1 -- 172.21.15.148:0/4090196377 >> 172.21.15.148:0/4090196377 conn(0x7f10c80fc7a0 msgr2=0x7f10c80fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:33.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:33.439+0000 7f10cf442640 1 -- 172.21.15.148:0/4090196377 shutdown_connections 2024-09-19T07:19:33.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:19:33.439+0000 7f10cf442640 1 -- 172.21.15.148:0/4090196377 wait complete. 2024-09-19T07:19:33.747 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:19:33 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:19:33.747 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:19:33 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:33.747 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:19:33 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:19:33.747 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:19:33 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:19:33.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:19:33 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:19:33.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:19:33 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:33.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:19:33 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:19:33.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:19:33 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:19:33.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:19:33 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:19:33.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:19:33 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:33.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:19:33 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:19:33.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:19:33 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:19:34.109 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'd158fe2', total seconds elapsed: 30.2 2024-09-19T07:19:35.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:19:35 smithi165 ceph-mon[35326]: pgmap v263: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 KiB/s wr, 12 op/s 2024-09-19T07:19:35.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:19:35 smithi179 ceph-mon[35716]: pgmap v263: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 KiB/s wr, 12 op/s 2024-09-19T07:19:35.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:19:35 smithi148 ceph-mon[31180]: pgmap v263: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 KiB/s wr, 12 op/s 2024-09-19T07:19:37.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:19:37 smithi165 ceph-mon[35326]: pgmap v264: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 36 KiB/s wr, 13 op/s 2024-09-19T07:19:37.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:19:37 smithi179 ceph-mon[35716]: pgmap v264: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 36 KiB/s wr, 13 op/s 2024-09-19T07:19:37.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:19:37 smithi148 ceph-mon[31180]: pgmap v264: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 36 KiB/s wr, 13 op/s 2024-09-19T07:19:38.643 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.642+0000 7f3619311640 1 -- 172.21.15.148:0/1521903391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3614102c80 msgr2=0x7f3614103060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:38.643 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.642+0000 7f3619311640 1 --2- 172.21.15.148:0/1521903391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3614102c80 0x7f3614103060 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f3604009ca0 tx=0x7f360402a950 comp rx=0 tx=0).stop 2024-09-19T07:19:38.643 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.642+0000 7f3619311640 1 -- 172.21.15.148:0/1521903391 shutdown_connections 2024-09-19T07:19:38.643 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.642+0000 7f3619311640 1 --2- 172.21.15.148:0/1521903391 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f361410c0d0 0x7f361410e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:38.644 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.642+0000 7f3619311640 1 --2- 172.21.15.148:0/1521903391 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36141035a0 0x7f361410ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:38.644 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.642+0000 7f3619311640 1 --2- 172.21.15.148:0/1521903391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3614102c80 0x7f3614103060 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:38.644 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.642+0000 7f3619311640 1 -- 172.21.15.148:0/1521903391 >> 172.21.15.148:0/1521903391 conn(0x7f3614077990 msgr2=0x7f36140fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:38.644 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.642+0000 7f3619311640 1 -- 172.21.15.148:0/1521903391 shutdown_connections 2024-09-19T07:19:38.644 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.642+0000 7f3619311640 1 -- 172.21.15.148:0/1521903391 wait complete. 2024-09-19T07:19:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.643+0000 7f3619311640 1 Processor -- start 2024-09-19T07:19:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.643+0000 7f3619311640 1 -- start start 2024-09-19T07:19:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.644+0000 7f3619311640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3614102c80 0x7f36141983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.644+0000 7f3619311640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36141035a0 0x7f3614198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.644+0000 7f3619311640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f361410c0d0 0x7f361419cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.644+0000 7f3619311640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3614111eb0 con 0x7f36141035a0 2024-09-19T07:19:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.644+0000 7f3619311640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3614111d30 con 0x7f3614102c80 2024-09-19T07:19:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.644+0000 7f3619311640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3614112030 con 0x7f361410c0d0 2024-09-19T07:19:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.644+0000 7f36127fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36141035a0 0x7f3614198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.644+0000 7f36127fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36141035a0 0x7f3614198920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45666/0 (socket says 172.21.15.148:45666) 2024-09-19T07:19:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.644+0000 7f36127fc640 1 -- 172.21.15.148:0/1706412184 learned_addr learned my addr 172.21.15.148:0/1706412184 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:19:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.644+0000 7f36137fe640 1 --2- 172.21.15.148:0/1706412184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f361410c0d0 0x7f361419cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.644+0000 7f3612ffd640 1 --2- 172.21.15.148:0/1706412184 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3614102c80 0x7f36141983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.644+0000 7f36127fc640 1 -- 172.21.15.148:0/1706412184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f361410c0d0 msgr2=0x7f361419cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.644+0000 7f36127fc640 1 --2- 172.21.15.148:0/1706412184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f361410c0d0 0x7f361419cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.644+0000 7f36127fc640 1 -- 172.21.15.148:0/1706412184 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3614102c80 msgr2=0x7f36141983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.644+0000 7f36127fc640 1 --2- 172.21.15.148:0/1706412184 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3614102c80 0x7f36141983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.644+0000 7f36127fc640 1 -- 172.21.15.148:0/1706412184 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f361419d3d0 con 0x7f36141035a0 2024-09-19T07:19:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.644+0000 7f36127fc640 1 --2- 172.21.15.148:0/1706412184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36141035a0 0x7f3614198920 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f35fc00d750 tx=0x7f35fc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:38.648 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.645+0000 7f360bfff640 1 -- 172.21.15.148:0/1706412184 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35fc017070 con 0x7f36141035a0 2024-09-19T07:19:38.648 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.645+0000 7f360bfff640 1 -- 172.21.15.148:0/1706412184 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35fc005020 con 0x7f36141035a0 2024-09-19T07:19:38.648 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.645+0000 7f360bfff640 1 -- 172.21.15.148:0/1706412184 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35fc004d00 con 0x7f36141035a0 2024-09-19T07:19:38.648 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.645+0000 7f3619311640 1 -- 172.21.15.148:0/1706412184 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f361419d6c0 con 0x7f36141035a0 2024-09-19T07:19:38.648 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.645+0000 7f3619311640 1 -- 172.21.15.148:0/1706412184 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36141a4f50 con 0x7f36141035a0 2024-09-19T07:19:38.656 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.647+0000 7f360bfff640 1 -- 172.21.15.148:0/1706412184 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f35fc009a30 con 0x7f36141035a0 2024-09-19T07:19:38.656 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.647+0000 7f361c0ad740 1 Processor -- start 2024-09-19T07:19:38.656 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.648+0000 7f361c0ad740 1 -- start start 2024-09-19T07:19:38.656 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.648+0000 7f361c0ad740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d242571af0 0x55d242571ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:38.656 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.648+0000 7f361c0ad740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d242572410 0x55d24257c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:38.656 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.648+0000 7f361c0ad740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d24257ccb0 0x55d24257f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:38.656 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.648+0000 7f361c0ad740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55d2424d62f0 con 0x55d242571af0 2024-09-19T07:19:38.656 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.648+0000 7f361c0ad740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55d24247e270 con 0x55d242572410 2024-09-19T07:19:38.656 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.648+0000 7f361c0ad740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d2424d22b0 con 0x55d24257ccb0 2024-09-19T07:19:38.656 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.648+0000 7f360bfff640 1 --2- 172.21.15.148:0/1706412184 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f36000a3460 0x7f36000a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:38.657 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.648+0000 7f36137fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d242571af0 0x55d242571ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:38.657 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.648+0000 7f36137fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d242571af0 0x55d242571ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45678/0 (socket says 172.21.15.148:45678) 2024-09-19T07:19:38.657 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.648+0000 7f36137fe640 1 -- 172.21.15.148:0/879876141 learned_addr learned my addr 172.21.15.148:0/879876141 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:19:38.657 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.648+0000 7f36137fe640 1 --2- 172.21.15.148:0/1706412184 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f36000a3460 0x7f36000a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:38.657 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.648+0000 7f360bfff640 1 -- 172.21.15.148:0/1706412184 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7f35fc0cf6a0 con 0x7f36141035a0 2024-09-19T07:19:38.657 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.648+0000 7f36127fc640 1 --2- 172.21.15.148:0/879876141 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d24257ccb0 0x55d24257f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:38.657 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.648+0000 7f3612ffd640 1 --2- 172.21.15.148:0/879876141 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d242572410 0x55d24257c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:38.657 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.648+0000 7f36137fe640 1 -- 172.21.15.148:0/879876141 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d24257ccb0 msgr2=0x55d24257f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:38.657 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.648+0000 7f36137fe640 1 --2- 172.21.15.148:0/879876141 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d24257ccb0 0x55d24257f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:38.657 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.648+0000 7f36137fe640 1 -- 172.21.15.148:0/879876141 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d242572410 msgr2=0x55d24257c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:38.657 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.649+0000 7f36137fe640 1 --2- 172.21.15.148:0/879876141 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d242572410 0x55d24257c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:38.657 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.649+0000 7f36137fe640 1 -- 172.21.15.148:0/879876141 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d24247d340 con 0x55d242571af0 2024-09-19T07:19:38.657 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.649+0000 7f36127fc640 1 --2- 172.21.15.148:0/879876141 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d24257ccb0 0x55d24257f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:19:38.658 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.649+0000 7f36137fe640 1 --2- 172.21.15.148:0/879876141 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d242571af0 0x55d242571ed0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f360c0129f0 tx=0x7f360c012eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da005a23b23dea83 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:38.658 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.649+0000 7f36137fe640 1 --2- 172.21.15.148:0/1706412184 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f36000a3460 0x7f36000a5920 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f360c010740 tx=0x7f360c017000 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:38.658 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.649+0000 7f36097fa640 1 -- 172.21.15.148:0/879876141 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f360c024070 con 0x55d242571af0 2024-09-19T07:19:38.658 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.649+0000 7f36097fa640 1 -- 172.21.15.148:0/879876141 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f360c00b9c0 con 0x55d242571af0 2024-09-19T07:19:38.658 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.649+0000 7f36097fa640 1 -- 172.21.15.148:0/879876141 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f360c004cd0 con 0x55d242571af0 2024-09-19T07:19:38.658 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.650+0000 7f361c0ad740 1 -- 172.21.15.148:0/879876141 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d242571af0 msgr2=0x55d242571ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:38.658 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.650+0000 7f361c0ad740 1 --2- 172.21.15.148:0/879876141 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d242571af0 0x55d242571ed0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f360c0129f0 tx=0x7f360c012eb0 comp rx=0 tx=0).stop 2024-09-19T07:19:38.658 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.650+0000 7f361c0ad740 1 -- 172.21.15.148:0/879876141 shutdown_connections 2024-09-19T07:19:38.658 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.650+0000 7f361c0ad740 1 --2- 172.21.15.148:0/879876141 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d24257ccb0 0x55d24257f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:38.658 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.650+0000 7f361c0ad740 1 --2- 172.21.15.148:0/879876141 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d242572410 0x55d24257c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:38.658 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.650+0000 7f361c0ad740 1 --2- 172.21.15.148:0/879876141 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d242571af0 0x55d242571ed0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:38.658 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.650+0000 7f361c0ad740 1 -- 172.21.15.148:0/879876141 >> 172.21.15.148:0/879876141 conn(0x55d24256e060 msgr2=0x55d24256e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:38.658 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.650+0000 7f361c0ad740 1 -- 172.21.15.148:0/879876141 shutdown_connections 2024-09-19T07:19:38.658 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.650+0000 7f361c0ad740 1 -- 172.21.15.148:0/879876141 wait complete. 2024-09-19T07:19:38.659 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.650+0000 7f361c0ad740 1 -- start start 2024-09-19T07:19:38.659 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.650+0000 7f361c0ad740 1 Processor -- start 2024-09-19T07:19:38.659 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.651+0000 7f361c0ad740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d242571af0 0x55d242579b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:38.659 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.651+0000 7f361c0ad740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d242572410 0x55d24257a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:38.659 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.651+0000 7f361c0ad740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d24257ccb0 0x55d24257a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:38.659 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.651+0000 7f361c0ad740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55d24257f880 con 0x55d242571af0 2024-09-19T07:19:38.659 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.651+0000 7f361c0ad740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55d24245f290 con 0x55d24257ccb0 2024-09-19T07:19:38.659 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.651+0000 7f361c0ad740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d24257fa00 con 0x55d242572410 2024-09-19T07:19:38.659 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.651+0000 7f361c0ad740 10 client.0 _ll_register_callbacks cb 0x55d242490140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:19:38.659 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.651+0000 7f3612ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d242571af0 0x55d242579b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:38.659 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.651+0000 7f3612ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d242571af0 0x55d242579b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45680/0 (socket says 172.21.15.148:45680) 2024-09-19T07:19:38.659 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.651+0000 7f3612ffd640 1 -- 172.21.15.148:0/931047938 learned_addr learned my addr 172.21.15.148:0/931047938 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:19:38.660 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.651+0000 7f36137fe640 1 --2- 172.21.15.148:0/931047938 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d24257ccb0 0x55d24257a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:38.660 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.651+0000 7f36127fc640 1 --2- 172.21.15.148:0/931047938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d242572410 0x55d24257a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:38.660 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.651+0000 7f3612ffd640 1 -- 172.21.15.148:0/931047938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d242572410 msgr2=0x55d24257a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:38.660 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.651+0000 7f3612ffd640 1 --2- 172.21.15.148:0/931047938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d242572410 0x55d24257a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:38.660 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.651+0000 7f3612ffd640 1 -- 172.21.15.148:0/931047938 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d24257ccb0 msgr2=0x55d24257a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:38.660 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.651+0000 7f3612ffd640 1 --2- 172.21.15.148:0/931047938 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d24257ccb0 0x55d24257a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:38.660 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.651+0000 7f3612ffd640 1 -- 172.21.15.148:0/931047938 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2421e9210 con 0x55d242571af0 2024-09-19T07:19:38.660 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.651+0000 7f36127fc640 1 --2- 172.21.15.148:0/931047938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d242572410 0x55d24257a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:19:38.660 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.651+0000 7f36137fe640 1 --2- 172.21.15.148:0/931047938 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d24257ccb0 0x55d24257a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:19:38.660 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.651+0000 7f3612ffd640 1 --2- 172.21.15.148:0/931047938 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d242571af0 0x55d242579b70 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f3604009ca0 tx=0x7f360402f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef72ff480fe36a90 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:38.660 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.651+0000 7f35fa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:19:38.660 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.651+0000 7f35fa7fc640 1 -- 172.21.15.148:0/931047938 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3604049060 con 0x55d242571af0 2024-09-19T07:19:38.660 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.651+0000 7f35fa7fc640 1 -- 172.21.15.148:0/931047938 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7f3604003b70 con 0x55d242571af0 2024-09-19T07:19:38.661 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.651+0000 7f361c0ad740 1 -- 172.21.15.148:0/931047938 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f360c00b9c0 con 0x55d242571af0 2024-09-19T07:19:38.661 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.651+0000 7f35fa7fc640 1 -- 172.21.15.148:0/931047938 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f3604034040 con 0x55d242571af0 2024-09-19T07:19:38.661 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.652+0000 7f361c0ad740 10 client.16863 fetch_fsmap learned FSMap version 41 2024-09-19T07:19:38.661 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.652+0000 7f361c0ad740 1 -- 172.21.15.148:0/931047938 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55d2422b5620 con 0x55d242571af0 2024-09-19T07:19:38.661 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.652+0000 7f35fa7fc640 1 -- 172.21.15.148:0/931047938 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f360c00b9c0 con 0x55d242571af0 2024-09-19T07:19:38.661 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.652+0000 7f35fa7fc640 1 -- 172.21.15.148:0/931047938 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 41) ==== 8370+0+0 (secure 0 0 0) 0x7f3604030560 con 0x55d242571af0 2024-09-19T07:19:38.661 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.652+0000 7f361c0ad740 10 client.16863 fetch_fsmap finished waiting for FSMap version 41 2024-09-19T07:19:38.661 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.652+0000 7f361c0ad740 10 client.16863 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:19:38.661 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.652+0000 7f361c0ad740 20 client.16863 populate_metadata read hostname 'smithi148' 2024-09-19T07:19:38.661 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.652+0000 7f361c0ad740 1 --2- 172.21.15.148:0/931047938 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55d24258cb40 0x55d24258ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:38.662 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.652+0000 7f361c0ad740 4 client.16863 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:19:38.662 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.652+0000 7f361c0ad740 1 -- 172.21.15.148:0/931047938 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d2424e3a20 con 0x55d24258cb40 2024-09-19T07:19:38.662 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.652+0000 7f36127fc640 1 --2- 172.21.15.148:0/931047938 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55d24258cb40 0x55d24258ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:38.662 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.653+0000 7f35fa7fc640 10 client.16863 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:19:38.662 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.653+0000 7f36127fc640 1 --2- 172.21.15.148:0/931047938 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55d24258cb40 0x55d24258ef70 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=873c6b6c0271a77b server_cookie=17572dc65ba02879 in_seq=0 out_seq=0 2024-09-19T07:19:38.662 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.653+0000 7f35fa7fc640 1 -- 172.21.15.148:0/931047938 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d2424e3a20 con 0x55d24258cb40 2024-09-19T07:19:38.662 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.653+0000 7f35fa7fc640 10 client.16863 handle_command_reply: tid=0 2024-09-19T07:19:38.662 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.653+0000 7f361c0ad740 1 client.16863 shutdown 2024-09-19T07:19:38.662 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.653+0000 7f361c0ad740 1 -- 172.21.15.148:0/931047938 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d242571af0 msgr2=0x55d242579b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:38.662 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.653+0000 7f361c0ad740 1 --2- 172.21.15.148:0/931047938 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d242571af0 0x55d242579b70 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f3604009ca0 tx=0x7f360402f5d0 comp rx=0 tx=0).stop 2024-09-19T07:19:38.662 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.653+0000 7f361c0ad740 1 -- 172.21.15.148:0/931047938 shutdown_connections 2024-09-19T07:19:38.662 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.653+0000 7f361c0ad740 1 --2- 172.21.15.148:0/931047938 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55d24258cb40 0x55d24258ef70 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:38.663 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.653+0000 7f361c0ad740 1 --2- 172.21.15.148:0/931047938 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d24257ccb0 0x55d24257a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:38.663 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.653+0000 7f361c0ad740 1 --2- 172.21.15.148:0/931047938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d242572410 0x55d24257a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:38.663 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.653+0000 7f35fa7fc640 0 client.16863 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:19:38.663 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.653+0000 7f361c0ad740 1 --2- 172.21.15.148:0/931047938 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d242571af0 0x55d242579b70 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:38.663 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.653+0000 7f361c0ad740 1 -- 172.21.15.148:0/931047938 >> 172.21.15.148:0/931047938 conn(0x55d24256e060 msgr2=0x55d242573dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:38.663 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.653+0000 7f361c0ad740 1 -- 172.21.15.148:0/931047938 shutdown_connections 2024-09-19T07:19:38.663 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.653+0000 7f361c0ad740 1 -- 172.21.15.148:0/931047938 wait complete. 2024-09-19T07:19:38.663 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.654+0000 7f361c0ad740 20 client.16863 trim_cache size 0 max 16384 2024-09-19T07:19:38.670 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.668+0000 7f361c0ad740 1 Processor -- start 2024-09-19T07:19:38.670 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.668+0000 7f361c0ad740 1 -- start start 2024-09-19T07:19:38.670 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.668+0000 7f361c0ad740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d242571af0 0x55d242574560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:38.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.668+0000 7f361c0ad740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d242572410 0x55d24257a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:38.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.668+0000 7f361c0ad740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d24257ccb0 0x55d24257bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:38.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.668+0000 7f361c0ad740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f36141b0140 con 0x55d242572410 2024-09-19T07:19:38.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.668+0000 7f361c0ad740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f36141ad950 con 0x55d24257ccb0 2024-09-19T07:19:38.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.668+0000 7f361c0ad740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f36141ab7c0 con 0x55d242571af0 2024-09-19T07:19:38.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.668+0000 7f36127fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d242572410 0x55d24257a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:38.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.668+0000 7f36127fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d242572410 0x55d24257a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45688/0 (socket says 172.21.15.148:45688) 2024-09-19T07:19:38.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.668+0000 7f36127fc640 1 -- 172.21.15.148:0/1798370434 learned_addr learned my addr 172.21.15.148:0/1798370434 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:19:38.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.668+0000 7f36127fc640 1 -- 172.21.15.148:0/1798370434 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d242571af0 msgr2=0x55d242574560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:38.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.668+0000 7f36127fc640 1 --2- 172.21.15.148:0/1798370434 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d242571af0 0x55d242574560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:38.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.668+0000 7f36127fc640 1 -- 172.21.15.148:0/1798370434 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d24257ccb0 msgr2=0x55d24257bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:38.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.668+0000 7f36127fc640 1 --2- 172.21.15.148:0/1798370434 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d24257ccb0 0x55d24257bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:38.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.668+0000 7f36127fc640 1 -- 172.21.15.148:0/1798370434 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d24257aef0 con 0x55d242572410 2024-09-19T07:19:38.672 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.669+0000 7f36127fc640 1 --2- 172.21.15.148:0/1798370434 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d242572410 0x55d24257a420 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f35fc0983e0 tx=0x7f35fc086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eea57947a900871 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:38.672 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.669+0000 7f3608ff9640 1 -- 172.21.15.148:0/1798370434 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35fc0b3070 con 0x55d242572410 2024-09-19T07:19:38.672 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.669+0000 7f3608ff9640 1 -- 172.21.15.148:0/1798370434 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35fc009d20 con 0x55d242572410 2024-09-19T07:19:38.672 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.669+0000 7f3608ff9640 1 -- 172.21.15.148:0/1798370434 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35fc020040 con 0x55d242572410 2024-09-19T07:19:38.672 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.669+0000 7f361c0ad740 1 -- 172.21.15.148:0/1798370434 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d242572410 msgr2=0x55d24257a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:38.672 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.669+0000 7f361c0ad740 1 --2- 172.21.15.148:0/1798370434 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d242572410 0x55d24257a420 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f35fc0983e0 tx=0x7f35fc086040 comp rx=0 tx=0).stop 2024-09-19T07:19:38.672 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.669+0000 7f361c0ad740 1 -- 172.21.15.148:0/1798370434 shutdown_connections 2024-09-19T07:19:38.672 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.669+0000 7f361c0ad740 1 --2- 172.21.15.148:0/1798370434 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d24257ccb0 0x55d24257bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:38.672 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.669+0000 7f361c0ad740 1 --2- 172.21.15.148:0/1798370434 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d242572410 0x55d24257a420 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:38.672 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.669+0000 7f361c0ad740 1 --2- 172.21.15.148:0/1798370434 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d242571af0 0x55d242574560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:38.672 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.669+0000 7f361c0ad740 1 -- 172.21.15.148:0/1798370434 >> 172.21.15.148:0/1798370434 conn(0x55d24256e060 msgr2=0x55d24257b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:38.672 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.669+0000 7f361c0ad740 1 -- 172.21.15.148:0/1798370434 shutdown_connections 2024-09-19T07:19:38.672 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.669+0000 7f361c0ad740 1 -- 172.21.15.148:0/1798370434 wait complete. 2024-09-19T07:19:38.673 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.670+0000 7f361c0ad740 1 -- start start 2024-09-19T07:19:38.673 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.670+0000 7f361c0ad740 1 Processor -- start 2024-09-19T07:19:38.676 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.670+0000 7f361c0ad740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d242571af0 0x55d2425850e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:38.676 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.670+0000 7f361c0ad740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d242572410 0x55d242576540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:38.676 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.670+0000 7f361c0ad740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d24257ccb0 0x55d242576a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:38.676 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.670+0000 7f361c0ad740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f36141abe10 con 0x55d242571af0 2024-09-19T07:19:38.676 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.670+0000 7f361c0ad740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f36141ad280 con 0x55d24257ccb0 2024-09-19T07:19:38.676 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.670+0000 7f361c0ad740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f36141ac4e0 con 0x55d242572410 2024-09-19T07:19:38.676 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.670+0000 7f361c0ad740 10 client.0 _ll_register_callbacks cb 0x7f360402fe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:19:38.676 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.670+0000 7f3612ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d242571af0 0x55d2425850e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:38.676 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.670+0000 7f3612ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d242571af0 0x55d2425850e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45696/0 (socket says 172.21.15.148:45696) 2024-09-19T07:19:38.676 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.670+0000 7f3612ffd640 1 -- 172.21.15.148:0/1370591548 learned_addr learned my addr 172.21.15.148:0/1370591548 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:19:38.677 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.670+0000 7f3612ffd640 1 -- 172.21.15.148:0/1370591548 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d242572410 msgr2=0x55d242576540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:38.677 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.670+0000 7f36127fc640 1 --2- 172.21.15.148:0/1370591548 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d242572410 0x55d242576540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:38.677 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.670+0000 7f3612ffd640 1 --2- 172.21.15.148:0/1370591548 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d242572410 0x55d242576540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:38.677 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.670+0000 7f3612ffd640 1 -- 172.21.15.148:0/1370591548 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d24257ccb0 msgr2=0x55d242576a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:38.677 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.670+0000 7f3612ffd640 1 --2- 172.21.15.148:0/1370591548 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d24257ccb0 0x55d242576a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:38.677 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.670+0000 7f3612ffd640 1 -- 172.21.15.148:0/1370591548 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d242576fc0 con 0x55d242571af0 2024-09-19T07:19:38.677 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.671+0000 7f3612ffd640 1 --2- 172.21.15.148:0/1370591548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d242571af0 0x55d2425850e0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f3604009bf0 tx=0x7f360402b050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=297e6e0e30dda7e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:38.677 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.671+0000 7f35fa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:19:38.677 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.671+0000 7f35fa7fc640 1 -- 172.21.15.148:0/1370591548 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3604049070 con 0x55d242571af0 2024-09-19T07:19:38.677 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.671+0000 7f35fa7fc640 1 -- 172.21.15.148:0/1370591548 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7f3604003970 con 0x55d242571af0 2024-09-19T07:19:38.677 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.671+0000 7f361c0ad740 1 -- 172.21.15.148:0/1370591548 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35fc009d20 con 0x55d242571af0 2024-09-19T07:19:38.677 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.671+0000 7f35fa7fc640 1 -- 172.21.15.148:0/1370591548 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f3604003b70 con 0x55d242571af0 2024-09-19T07:19:38.677 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.671+0000 7f361c0ad740 10 client.16869 fetch_fsmap learned FSMap version 41 2024-09-19T07:19:38.677 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.671+0000 7f361c0ad740 1 -- 172.21.15.148:0/1370591548 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55d2425f7590 con 0x55d242571af0 2024-09-19T07:19:38.678 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.671+0000 7f35fa7fc640 1 -- 172.21.15.148:0/1370591548 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35fc009d20 con 0x55d242571af0 2024-09-19T07:19:38.678 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.671+0000 7f35fa7fc640 1 -- 172.21.15.148:0/1370591548 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 41) ==== 8370+0+0 (secure 0 0 0) 0x7f360403a430 con 0x55d242571af0 2024-09-19T07:19:38.678 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.671+0000 7f361c0ad740 10 client.16869 fetch_fsmap finished waiting for FSMap version 41 2024-09-19T07:19:38.678 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.671+0000 7f361c0ad740 10 client.16869 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:19:38.678 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.671+0000 7f361c0ad740 20 client.16869 populate_metadata read hostname 'smithi148' 2024-09-19T07:19:38.678 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.671+0000 7f361c0ad740 1 --2- 172.21.15.148:0/1370591548 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55d2425f7dc0 0x55d2425fa1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:38.678 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.671+0000 7f361c0ad740 4 client.16869 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:19:38.678 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.671+0000 7f361c0ad740 1 -- 172.21.15.148:0/1370591548 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d2424ddd70 con 0x55d2425f7dc0 2024-09-19T07:19:38.678 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.672+0000 7f36127fc640 1 --2- 172.21.15.148:0/1370591548 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55d2425f7dc0 0x55d2425fa1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:38.678 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.672+0000 7f35fa7fc640 10 client.16869 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:19:38.678 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:38.672+0000 7f36127fc640 1 --2- 172.21.15.148:0/1370591548 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55d2425f7dc0 0x55d2425fa1e0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=329bfeee748c73a7 server_cookie=c68b622637872d21 in_seq=0 out_seq=0 2024-09-19T07:19:39.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:19:39 smithi165 ceph-mon[35326]: pgmap v265: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 29 KiB/s wr, 11 op/s 2024-09-19T07:19:39.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:19:39 smithi179 ceph-mon[35716]: pgmap v265: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 29 KiB/s wr, 11 op/s 2024-09-19T07:19:39.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:19:39 smithi148 ceph-mon[31180]: pgmap v265: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 29 KiB/s wr, 11 op/s 2024-09-19T07:19:39.820 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:39.818+0000 7f35fa7fc640 1 -- 172.21.15.148:0/1370591548 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d2424ddd70 con 0x55d2425f7dc0 2024-09-19T07:19:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:39.818+0000 7f35fa7fc640 10 client.16869 handle_command_reply: tid=0 2024-09-19T07:19:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:39.818+0000 7f361c0ad740 1 client.16869 shutdown 2024-09-19T07:19:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:39.819+0000 7f361c0ad740 1 -- 172.21.15.148:0/1370591548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d242571af0 msgr2=0x55d2425850e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:39.819+0000 7f361c0ad740 1 --2- 172.21.15.148:0/1370591548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d242571af0 0x55d2425850e0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f3604009bf0 tx=0x7f360402b050 comp rx=0 tx=0).stop 2024-09-19T07:19:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:39.819+0000 7f361c0ad740 1 -- 172.21.15.148:0/1370591548 shutdown_connections 2024-09-19T07:19:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:39.819+0000 7f361c0ad740 1 --2- 172.21.15.148:0/1370591548 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55d2425f7dc0 0x55d2425fa1e0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:39.819+0000 7f35fa7fc640 0 client.16869 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:19:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:39.819+0000 7f361c0ad740 1 --2- 172.21.15.148:0/1370591548 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d24257ccb0 0x55d242576a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:39.819+0000 7f361c0ad740 1 --2- 172.21.15.148:0/1370591548 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d242572410 0x55d242576540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:39.819+0000 7f361c0ad740 1 --2- 172.21.15.148:0/1370591548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d242571af0 0x55d2425850e0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:39.819+0000 7f361c0ad740 1 -- 172.21.15.148:0/1370591548 >> 172.21.15.148:0/1370591548 conn(0x55d24256e060 msgr2=0x55d24256d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:39.819+0000 7f361c0ad740 1 -- 172.21.15.148:0/1370591548 shutdown_connections 2024-09-19T07:19:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:39.819+0000 7f361c0ad740 1 -- 172.21.15.148:0/1370591548 wait complete. 2024-09-19T07:19:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:39.819+0000 7f361c0ad740 20 client.16869 trim_cache size 0 max 16384 2024-09-19T07:19:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:19:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:19:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:19:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:19:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:39.820+0000 7f3619311640 1 -- 172.21.15.148:0/1706412184 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f36000a3460 msgr2=0x7f36000a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:39.820+0000 7f3619311640 1 --2- 172.21.15.148:0/1706412184 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f36000a3460 0x7f36000a5920 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f360c010740 tx=0x7f360c017000 comp rx=0 tx=0).stop 2024-09-19T07:19:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:39.820+0000 7f3619311640 1 -- 172.21.15.148:0/1706412184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36141035a0 msgr2=0x7f3614198920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:39.820+0000 7f3619311640 1 --2- 172.21.15.148:0/1706412184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36141035a0 0x7f3614198920 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f35fc00d750 tx=0x7f35fc00dc10 comp rx=0 tx=0).stop 2024-09-19T07:19:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:39.820+0000 7f3619311640 1 -- 172.21.15.148:0/1706412184 shutdown_connections 2024-09-19T07:19:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:39.820+0000 7f3619311640 1 --2- 172.21.15.148:0/1706412184 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f36000a3460 0x7f36000a5920 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:39.820+0000 7f3619311640 1 --2- 172.21.15.148:0/1706412184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f361410c0d0 0x7f361419cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:39.820+0000 7f3619311640 1 --2- 172.21.15.148:0/1706412184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36141035a0 0x7f3614198920 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:39.820+0000 7f3619311640 1 --2- 172.21.15.148:0/1706412184 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3614102c80 0x7f36141983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:39.820+0000 7f3619311640 1 -- 172.21.15.148:0/1706412184 >> 172.21.15.148:0/1706412184 conn(0x7f3614077990 msgr2=0x7f36140fcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:39.820+0000 7f3619311640 1 -- 172.21.15.148:0/1706412184 shutdown_connections 2024-09-19T07:19:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:39.820+0000 7f3619311640 1 -- 172.21.15.148:0/1706412184 wait complete. 2024-09-19T07:19:41.385 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:19:41 smithi148 ceph-mon[31180]: pgmap v266: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 34 KiB/s wr, 13 op/s 2024-09-19T07:19:41.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:19:41 smithi179 ceph-mon[35716]: pgmap v266: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 34 KiB/s wr, 13 op/s 2024-09-19T07:19:41.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:19:41 smithi165 ceph-mon[35326]: pgmap v266: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 34 KiB/s wr, 13 op/s 2024-09-19T07:19:43.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:19:43 smithi179 ceph-mon[35716]: pgmap v267: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 57 KiB/s wr, 18 op/s 2024-09-19T07:19:43.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:19:43 smithi148 ceph-mon[31180]: pgmap v267: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 57 KiB/s wr, 18 op/s 2024-09-19T07:19:43.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:19:43 smithi165 ceph-mon[35326]: pgmap v267: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 57 KiB/s wr, 18 op/s 2024-09-19T07:19:45.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:19:45 smithi179 ceph-mon[35716]: pgmap v268: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 310 KiB/s wr, 16 op/s 2024-09-19T07:19:45.640 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:19:45 smithi165 ceph-mon[35326]: pgmap v268: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 310 KiB/s wr, 16 op/s 2024-09-19T07:19:45.640 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:19:45 smithi148 ceph-mon[31180]: pgmap v268: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 310 KiB/s wr, 16 op/s 2024-09-19T07:19:47.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:19:47 smithi179 ceph-mon[35716]: pgmap v269: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 34 op/s 2024-09-19T07:19:47.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:19:47 smithi148 ceph-mon[31180]: pgmap v269: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 34 op/s 2024-09-19T07:19:47.636 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:19:47 smithi165 ceph-mon[35326]: pgmap v269: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 34 op/s 2024-09-19T07:19:49.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:19:49 smithi179 ceph-mon[35716]: pgmap v270: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 31 op/s 2024-09-19T07:19:49.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:19:49 smithi148 ceph-mon[31180]: pgmap v270: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 31 op/s 2024-09-19T07:19:49.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:19:49 smithi165 ceph-mon[35326]: pgmap v270: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 31 op/s 2024-09-19T07:19:51.436 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:19:51 smithi165 ceph-mon[35326]: pgmap v271: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 33 op/s 2024-09-19T07:19:51.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:19:51 smithi179 ceph-mon[35716]: pgmap v271: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 33 op/s 2024-09-19T07:19:51.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:19:51 smithi148 ceph-mon[31180]: pgmap v271: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 33 op/s 2024-09-19T07:19:52.920 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.916+0000 7f26a7647640 1 -- 172.21.15.148:0/612695312 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26a01069c0 msgr2=0x7f26a0106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:52.921 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.916+0000 7f26a7647640 1 --2- 172.21.15.148:0/612695312 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26a01069c0 0x7f26a0106da0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f2694009930 tx=0x7f269402a420 comp rx=0 tx=0).stop 2024-09-19T07:19:52.921 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.916+0000 7f26a7647640 1 -- 172.21.15.148:0/612695312 shutdown_connections 2024-09-19T07:19:52.921 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.916+0000 7f26a7647640 1 --2- 172.21.15.148:0/612695312 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26a0101350 0x7f26a010d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:52.921 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.916+0000 7f26a7647640 1 --2- 172.21.15.148:0/612695312 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26a01009b0 0x7f26a0100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:52.921 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.916+0000 7f26a7647640 1 --2- 172.21.15.148:0/612695312 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26a01069c0 0x7f26a0106da0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:52.921 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.916+0000 7f26a7647640 1 -- 172.21.15.148:0/612695312 >> 172.21.15.148:0/612695312 conn(0x7f26a0077990 msgr2=0x7f26a00fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:52.921 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.916+0000 7f26a7647640 1 -- 172.21.15.148:0/612695312 shutdown_connections 2024-09-19T07:19:52.921 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.916+0000 7f26a7647640 1 -- 172.21.15.148:0/612695312 wait complete. 2024-09-19T07:19:52.921 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.917+0000 7f26a7647640 1 Processor -- start 2024-09-19T07:19:52.921 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.917+0000 7f26a7647640 1 -- start start 2024-09-19T07:19:52.921 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.917+0000 7f26a7647640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26a01009b0 0x7f26a01a4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:52.922 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.917+0000 7f26a7647640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26a0101350 0x7f26a01a4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:52.922 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.917+0000 7f26a7647640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26a01069c0 0x7f26a019e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:52.922 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.917+0000 7f26a7647640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f26a0118500 con 0x7f26a01009b0 2024-09-19T07:19:52.922 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.917+0000 7f26a7647640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f26a0118380 con 0x7f26a0101350 2024-09-19T07:19:52.922 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.917+0000 7f26a7647640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f26a0118680 con 0x7f26a01069c0 2024-09-19T07:19:52.922 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.917+0000 7f26a53e3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26a01009b0 0x7f26a01a4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:52.922 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.917+0000 7f26a53e3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26a01009b0 0x7f26a01a4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54366/0 (socket says 172.21.15.148:54366) 2024-09-19T07:19:52.922 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.917+0000 7f26a53e3640 1 -- 172.21.15.148:0/2308745043 learned_addr learned my addr 172.21.15.148:0/2308745043 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:19:52.922 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.917+0000 7f26a4be2640 1 --2- 172.21.15.148:0/2308745043 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26a0101350 0x7f26a01a4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:52.922 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.917+0000 7f26a53e3640 1 -- 172.21.15.148:0/2308745043 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26a01069c0 msgr2=0x7f26a019e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:52.922 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.917+0000 7f26a53e3640 1 --2- 172.21.15.148:0/2308745043 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26a01069c0 0x7f26a019e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:52.922 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.917+0000 7f26a53e3640 1 -- 172.21.15.148:0/2308745043 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26a0101350 msgr2=0x7f26a01a4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:52.922 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.917+0000 7f26a53e3640 1 --2- 172.21.15.148:0/2308745043 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26a0101350 0x7f26a01a4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:52.923 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.917+0000 7f26a53e3640 1 -- 172.21.15.148:0/2308745043 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26a019f010 con 0x7f26a01009b0 2024-09-19T07:19:52.923 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.917+0000 7f26a53e3640 1 --2- 172.21.15.148:0/2308745043 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26a01009b0 0x7f26a01a4690 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f2694009230 tx=0x7f2694004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:52.923 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.918+0000 7f26927fc640 1 -- 172.21.15.148:0/2308745043 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269403f030 con 0x7f26a01009b0 2024-09-19T07:19:52.923 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.918+0000 7f26927fc640 1 -- 172.21.15.148:0/2308745043 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2694003ad0 con 0x7f26a01009b0 2024-09-19T07:19:52.923 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.918+0000 7f26a7647640 1 -- 172.21.15.148:0/2308745043 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26a019f2a0 con 0x7f26a01009b0 2024-09-19T07:19:52.923 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.918+0000 7f26927fc640 1 -- 172.21.15.148:0/2308745043 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2694035070 con 0x7f26a01009b0 2024-09-19T07:19:52.923 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.918+0000 7f26a7647640 1 -- 172.21.15.148:0/2308745043 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26a01ab430 con 0x7f26a01009b0 2024-09-19T07:19:52.923 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.920+0000 7f26927fc640 1 -- 172.21.15.148:0/2308745043 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f2694042030 con 0x7f26a01009b0 2024-09-19T07:19:52.932 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.920+0000 7f26aa3e0740 1 Processor -- start 2024-09-19T07:19:52.932 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.920+0000 7f26aa3e0740 1 -- start start 2024-09-19T07:19:52.932 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.920+0000 7f26aa3e0740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563eb2b71af0 0x563eb2b71ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:52.932 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.920+0000 7f26aa3e0740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563eb2b72410 0x563eb2b7c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:52.932 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.920+0000 7f26aa3e0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563eb2b7ccb0 0x563eb2b7f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:52.933 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.920+0000 7f26aa3e0740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x563eb2ad62f0 con 0x563eb2b71af0 2024-09-19T07:19:52.933 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.920+0000 7f26aa3e0740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x563eb2a7e270 con 0x563eb2b72410 2024-09-19T07:19:52.933 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.921+0000 7f26aa3e0740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x563eb2ad22b0 con 0x563eb2b7ccb0 2024-09-19T07:19:52.934 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.921+0000 7f26927fc640 1 --2- 172.21.15.148:0/2308745043 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f268c0a3460 0x7f268c0a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:52.934 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.921+0000 7f26a5be4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563eb2b71af0 0x563eb2b71ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:52.934 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.921+0000 7f26a5be4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563eb2b71af0 0x563eb2b71ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54374/0 (socket says 172.21.15.148:54374) 2024-09-19T07:19:52.934 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.921+0000 7f26a5be4640 1 -- 172.21.15.148:0/1191467983 learned_addr learned my addr 172.21.15.148:0/1191467983 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:19:52.934 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.921+0000 7f26a53e3640 1 --2- 172.21.15.148:0/1191467983 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563eb2b72410 0x563eb2b7c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:52.934 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.921+0000 7f26a5be4640 1 --2- 172.21.15.148:0/2308745043 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f268c0a3460 0x7f268c0a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:52.934 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.921+0000 7f26a4be2640 1 --2- 172.21.15.148:0/1191467983 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563eb2b7ccb0 0x563eb2b7f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:52.934 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.921+0000 7f26927fc640 1 -- 172.21.15.148:0/2308745043 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7f26940f02c0 con 0x7f26a01009b0 2024-09-19T07:19:52.934 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.921+0000 7f26a5be4640 1 -- 172.21.15.148:0/1191467983 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563eb2b7ccb0 msgr2=0x563eb2b7f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:52.934 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.921+0000 7f26a5be4640 1 --2- 172.21.15.148:0/1191467983 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563eb2b7ccb0 0x563eb2b7f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:52.934 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.921+0000 7f26a5be4640 1 -- 172.21.15.148:0/1191467983 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563eb2b72410 msgr2=0x563eb2b7c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:52.934 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.921+0000 7f26a5be4640 1 --2- 172.21.15.148:0/1191467983 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563eb2b72410 0x563eb2b7c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:52.935 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.921+0000 7f26a5be4640 1 -- 172.21.15.148:0/1191467983 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563eb2a7d340 con 0x563eb2b71af0 2024-09-19T07:19:52.935 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.921+0000 7f26a5be4640 1 --2- 172.21.15.148:0/1191467983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563eb2b71af0 0x563eb2b71ed0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f2698012cb0 tx=0x7f269800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=219a6df3bce808a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:52.935 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.921+0000 7f26a5be4640 1 --2- 172.21.15.148:0/2308745043 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f268c0a3460 0x7f268c0a5920 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2698005c40 tx=0x7f269801a000 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:52.935 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.921+0000 7f268b7fe640 1 -- 172.21.15.148:0/1191467983 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2698020070 con 0x563eb2b71af0 2024-09-19T07:19:52.935 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.921+0000 7f268b7fe640 1 -- 172.21.15.148:0/1191467983 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2698019ab0 con 0x563eb2b71af0 2024-09-19T07:19:52.935 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.921+0000 7f268b7fe640 1 -- 172.21.15.148:0/1191467983 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2698005480 con 0x563eb2b71af0 2024-09-19T07:19:52.935 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.922+0000 7f26aa3e0740 1 -- 172.21.15.148:0/1191467983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563eb2b71af0 msgr2=0x563eb2b71ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:52.935 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.922+0000 7f26aa3e0740 1 --2- 172.21.15.148:0/1191467983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563eb2b71af0 0x563eb2b71ed0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f2698012cb0 tx=0x7f269800f730 comp rx=0 tx=0).stop 2024-09-19T07:19:52.935 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.922+0000 7f26aa3e0740 1 -- 172.21.15.148:0/1191467983 shutdown_connections 2024-09-19T07:19:52.935 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.922+0000 7f26aa3e0740 1 --2- 172.21.15.148:0/1191467983 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563eb2b7ccb0 0x563eb2b7f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:52.935 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.922+0000 7f26aa3e0740 1 --2- 172.21.15.148:0/1191467983 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563eb2b72410 0x563eb2b7c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:52.936 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.922+0000 7f26aa3e0740 1 --2- 172.21.15.148:0/1191467983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563eb2b71af0 0x563eb2b71ed0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:52.936 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.922+0000 7f26aa3e0740 1 -- 172.21.15.148:0/1191467983 >> 172.21.15.148:0/1191467983 conn(0x563eb2b6e060 msgr2=0x563eb2b6e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:52.936 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.922+0000 7f26aa3e0740 1 -- 172.21.15.148:0/1191467983 shutdown_connections 2024-09-19T07:19:52.936 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.922+0000 7f26aa3e0740 1 -- 172.21.15.148:0/1191467983 wait complete. 2024-09-19T07:19:52.936 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.923+0000 7f26aa3e0740 1 -- start start 2024-09-19T07:19:52.936 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.923+0000 7f26aa3e0740 1 Processor -- start 2024-09-19T07:19:52.936 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.923+0000 7f26aa3e0740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563eb2b71af0 0x563eb2b79ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:52.936 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.923+0000 7f26aa3e0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563eb2b72410 0x563eb2b7a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:52.936 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.923+0000 7f26aa3e0740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563eb2b7ccb0 0x563eb2b7a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:52.936 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.923+0000 7f26aa3e0740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x563eb2b7f880 con 0x563eb2b7ccb0 2024-09-19T07:19:52.936 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.923+0000 7f26aa3e0740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x563eb2a5f290 con 0x563eb2b71af0 2024-09-19T07:19:52.936 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.923+0000 7f26aa3e0740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x563eb2b7fa00 con 0x563eb2b72410 2024-09-19T07:19:52.936 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.923+0000 7f26aa3e0740 10 client.0 _ll_register_callbacks cb 0x563eb2a90140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:19:52.937 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.923+0000 7f26a5be4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563eb2b7ccb0 0x563eb2b7a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:52.937 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.923+0000 7f26a5be4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563eb2b7ccb0 0x563eb2b7a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54382/0 (socket says 172.21.15.148:54382) 2024-09-19T07:19:52.937 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.923+0000 7f26a5be4640 1 -- 172.21.15.148:0/3438780306 learned_addr learned my addr 172.21.15.148:0/3438780306 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:19:52.937 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.923+0000 7f26a53e3640 1 --2- 172.21.15.148:0/3438780306 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563eb2b71af0 0x563eb2b79ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:52.937 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.923+0000 7f26a4be2640 1 --2- 172.21.15.148:0/3438780306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563eb2b72410 0x563eb2b7a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:52.937 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.923+0000 7f26a5be4640 1 -- 172.21.15.148:0/3438780306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563eb2b72410 msgr2=0x563eb2b7a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:52.937 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.923+0000 7f26a5be4640 1 --2- 172.21.15.148:0/3438780306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563eb2b72410 0x563eb2b7a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:52.937 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.923+0000 7f26a5be4640 1 -- 172.21.15.148:0/3438780306 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563eb2b71af0 msgr2=0x563eb2b79ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:52.937 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.923+0000 7f26a5be4640 1 --2- 172.21.15.148:0/3438780306 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563eb2b71af0 0x563eb2b79ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:52.937 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.923+0000 7f26a5be4640 1 -- 172.21.15.148:0/3438780306 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563eb27e9210 con 0x563eb2b7ccb0 2024-09-19T07:19:52.937 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.923+0000 7f26a4be2640 1 --2- 172.21.15.148:0/3438780306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563eb2b72410 0x563eb2b7a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:19:52.937 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.924+0000 7f26a5be4640 1 --2- 172.21.15.148:0/3438780306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563eb2b7ccb0 0x563eb2b7a620 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f2698004a80 tx=0x7f2698012910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b5eb0bd5dd06d01 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:52.937 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.924+0000 7f2688ff9640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:19:52.938 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.924+0000 7f2688ff9640 1 -- 172.21.15.148:0/3438780306 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2698020040 con 0x563eb2b7ccb0 2024-09-19T07:19:52.938 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.924+0000 7f2688ff9640 1 -- 172.21.15.148:0/3438780306 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7f2698004d20 con 0x563eb2b7ccb0 2024-09-19T07:19:52.938 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.924+0000 7f26aa3e0740 1 -- 172.21.15.148:0/3438780306 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2698019ab0 con 0x563eb2b7ccb0 2024-09-19T07:19:52.938 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.924+0000 7f2688ff9640 1 -- 172.21.15.148:0/3438780306 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f26980051c0 con 0x563eb2b7ccb0 2024-09-19T07:19:52.938 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.924+0000 7f26aa3e0740 10 client.16881 fetch_fsmap learned FSMap version 41 2024-09-19T07:19:52.938 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.924+0000 7f26aa3e0740 1 -- 172.21.15.148:0/3438780306 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x563eb28b5620 con 0x563eb2b7ccb0 2024-09-19T07:19:52.938 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.924+0000 7f2688ff9640 1 -- 172.21.15.148:0/3438780306 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2698019ab0 con 0x563eb2b7ccb0 2024-09-19T07:19:52.938 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.924+0000 7f2688ff9640 1 -- 172.21.15.148:0/3438780306 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 41) ==== 8370+0+0 (secure 0 0 0) 0x7f269801b070 con 0x563eb2b7ccb0 2024-09-19T07:19:52.938 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.924+0000 7f26aa3e0740 10 client.16881 fetch_fsmap finished waiting for FSMap version 41 2024-09-19T07:19:52.938 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.924+0000 7f26aa3e0740 10 client.16881 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:19:52.938 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.924+0000 7f26aa3e0740 20 client.16881 populate_metadata read hostname 'smithi148' 2024-09-19T07:19:52.938 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.924+0000 7f26aa3e0740 1 --2- 172.21.15.148:0/3438780306 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x563eb2b8cc00 0x563eb2b8eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:52.938 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.924+0000 7f26aa3e0740 4 client.16881 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:19:52.939 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.924+0000 7f26aa3e0740 1 -- 172.21.15.148:0/3438780306 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563eb2ae3a20 con 0x563eb2b8cc00 2024-09-19T07:19:52.939 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.925+0000 7f26a53e3640 1 --2- 172.21.15.148:0/3438780306 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x563eb2b8cc00 0x563eb2b8eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:52.939 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.925+0000 7f2688ff9640 10 client.16881 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:19:52.939 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.925+0000 7f26a53e3640 1 --2- 172.21.15.148:0/3438780306 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x563eb2b8cc00 0x563eb2b8eff0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e62f0aa69c33ecb server_cookie=54dd8b73e668092e in_seq=0 out_seq=0 2024-09-19T07:19:52.939 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.926+0000 7f2688ff9640 1 -- 172.21.15.148:0/3438780306 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563eb2ae3a20 con 0x563eb2b8cc00 2024-09-19T07:19:52.939 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.926+0000 7f2688ff9640 10 client.16881 handle_command_reply: tid=0 2024-09-19T07:19:52.939 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.926+0000 7f26aa3e0740 1 client.16881 shutdown 2024-09-19T07:19:52.939 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.926+0000 7f26aa3e0740 1 -- 172.21.15.148:0/3438780306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563eb2b7ccb0 msgr2=0x563eb2b7a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:52.939 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.926+0000 7f26aa3e0740 1 --2- 172.21.15.148:0/3438780306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563eb2b7ccb0 0x563eb2b7a620 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f2698004a80 tx=0x7f2698012910 comp rx=0 tx=0).stop 2024-09-19T07:19:52.940 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.926+0000 7f26aa3e0740 1 -- 172.21.15.148:0/3438780306 shutdown_connections 2024-09-19T07:19:52.940 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.926+0000 7f26aa3e0740 1 --2- 172.21.15.148:0/3438780306 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x563eb2b8cc00 0x563eb2b8eff0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:52.940 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.926+0000 7f26aa3e0740 1 --2- 172.21.15.148:0/3438780306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563eb2b7ccb0 0x563eb2b7a620 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:52.940 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.926+0000 7f26aa3e0740 1 --2- 172.21.15.148:0/3438780306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563eb2b72410 0x563eb2b7a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:52.940 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.926+0000 7f2688ff9640 0 client.16881 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:19:52.940 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.926+0000 7f26aa3e0740 1 --2- 172.21.15.148:0/3438780306 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563eb2b71af0 0x563eb2b79ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:52.940 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.926+0000 7f26aa3e0740 1 -- 172.21.15.148:0/3438780306 >> 172.21.15.148:0/3438780306 conn(0x563eb2b6e060 msgr2=0x563eb2b73dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:52.940 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.926+0000 7f26aa3e0740 1 -- 172.21.15.148:0/3438780306 shutdown_connections 2024-09-19T07:19:52.940 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.926+0000 7f26aa3e0740 1 -- 172.21.15.148:0/3438780306 wait complete. 2024-09-19T07:19:52.940 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.926+0000 7f26aa3e0740 20 client.16881 trim_cache size 0 max 16384 2024-09-19T07:19:52.946 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.940+0000 7f26aa3e0740 1 Processor -- start 2024-09-19T07:19:52.946 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.940+0000 7f26aa3e0740 1 -- start start 2024-09-19T07:19:52.946 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.940+0000 7f26aa3e0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563eb2b71af0 0x563eb2b7a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:52.946 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.940+0000 7f26aa3e0740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563eb2b72410 0x563eb2b94760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:52.946 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.940+0000 7f26aa3e0740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563eb2b7ccb0 0x563eb2b94ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:52.946 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.940+0000 7f26aa3e0740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f26a01b6860 con 0x563eb2b7ccb0 2024-09-19T07:19:52.946 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.940+0000 7f26aa3e0740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f26a01b4070 con 0x563eb2b72410 2024-09-19T07:19:52.946 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.940+0000 7f26aa3e0740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f26a01b1ee0 con 0x563eb2b71af0 2024-09-19T07:19:52.946 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.940+0000 7f26a5be4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563eb2b7ccb0 0x563eb2b94ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:52.947 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.941+0000 7f26a5be4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563eb2b7ccb0 0x563eb2b94ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54392/0 (socket says 172.21.15.148:54392) 2024-09-19T07:19:52.947 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.941+0000 7f26a5be4640 1 -- 172.21.15.148:0/60607094 learned_addr learned my addr 172.21.15.148:0/60607094 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:19:52.947 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.941+0000 7f26a53e3640 1 --2- 172.21.15.148:0/60607094 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563eb2b71af0 0x563eb2b7a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:52.947 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.941+0000 7f26a5be4640 1 -- 172.21.15.148:0/60607094 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563eb2b71af0 msgr2=0x563eb2b7a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:52.947 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.941+0000 7f26a5be4640 1 --2- 172.21.15.148:0/60607094 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563eb2b71af0 0x563eb2b7a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:52.947 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.941+0000 7f26a5be4640 1 -- 172.21.15.148:0/60607094 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563eb2b72410 msgr2=0x563eb2b94760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:52.947 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.941+0000 7f26a5be4640 1 --2- 172.21.15.148:0/60607094 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563eb2b72410 0x563eb2b94760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:52.947 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.941+0000 7f26a5be4640 1 -- 172.21.15.148:0/60607094 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563eb2b6ecf0 con 0x563eb2b7ccb0 2024-09-19T07:19:52.947 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.941+0000 7f26a5be4640 1 --2- 172.21.15.148:0/60607094 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563eb2b7ccb0 0x563eb2b94ca0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f269802c780 tx=0x7f2698012980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6ee0e4a32241076 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:52.947 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.941+0000 7f268affd640 1 -- 172.21.15.148:0/60607094 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2698020030 con 0x563eb2b7ccb0 2024-09-19T07:19:52.947 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.941+0000 7f268affd640 1 -- 172.21.15.148:0/60607094 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2698019ab0 con 0x563eb2b7ccb0 2024-09-19T07:19:52.947 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.941+0000 7f268affd640 1 -- 172.21.15.148:0/60607094 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269802cbb0 con 0x563eb2b7ccb0 2024-09-19T07:19:52.947 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.942+0000 7f26aa3e0740 1 -- 172.21.15.148:0/60607094 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563eb2b7ccb0 msgr2=0x563eb2b94ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:52.948 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.942+0000 7f26aa3e0740 1 --2- 172.21.15.148:0/60607094 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563eb2b7ccb0 0x563eb2b94ca0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f269802c780 tx=0x7f2698012980 comp rx=0 tx=0).stop 2024-09-19T07:19:52.948 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.942+0000 7f26aa3e0740 1 -- 172.21.15.148:0/60607094 shutdown_connections 2024-09-19T07:19:52.948 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.942+0000 7f26aa3e0740 1 --2- 172.21.15.148:0/60607094 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563eb2b7ccb0 0x563eb2b94ca0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:52.948 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.942+0000 7f26aa3e0740 1 --2- 172.21.15.148:0/60607094 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563eb2b72410 0x563eb2b94760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:52.948 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.942+0000 7f26aa3e0740 1 --2- 172.21.15.148:0/60607094 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563eb2b71af0 0x563eb2b7a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:52.948 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.942+0000 7f26aa3e0740 1 -- 172.21.15.148:0/60607094 >> 172.21.15.148:0/60607094 conn(0x563eb2b6e060 msgr2=0x563eb2b7bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:52.948 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.942+0000 7f26aa3e0740 1 -- 172.21.15.148:0/60607094 shutdown_connections 2024-09-19T07:19:52.948 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.942+0000 7f26aa3e0740 1 -- 172.21.15.148:0/60607094 wait complete. 2024-09-19T07:19:52.948 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.942+0000 7f26aa3e0740 1 -- start start 2024-09-19T07:19:52.948 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.942+0000 7f26aa3e0740 1 Processor -- start 2024-09-19T07:19:52.948 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.942+0000 7f26aa3e0740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563eb2b71af0 0x563eb2b85470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:52.948 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.942+0000 7f26aa3e0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563eb2b72410 0x563eb2b80790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:52.948 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.942+0000 7f26aa3e0740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563eb2b7ccb0 0x563eb2b80cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:52.949 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.942+0000 7f26aa3e0740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f26a01b2530 con 0x563eb2b7ccb0 2024-09-19T07:19:52.949 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.942+0000 7f26aa3e0740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f26a01b39a0 con 0x563eb2b71af0 2024-09-19T07:19:52.949 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.942+0000 7f26aa3e0740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f26a01b2c00 con 0x563eb2b72410 2024-09-19T07:19:52.949 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.942+0000 7f26aa3e0740 10 client.0 _ll_register_callbacks cb 0x7f26940bc0c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:19:52.949 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.943+0000 7f26a5be4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563eb2b7ccb0 0x563eb2b80cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:52.949 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.943+0000 7f26a5be4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563eb2b7ccb0 0x563eb2b80cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54394/0 (socket says 172.21.15.148:54394) 2024-09-19T07:19:52.949 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.943+0000 7f26a5be4640 1 -- 172.21.15.148:0/2171423917 learned_addr learned my addr 172.21.15.148:0/2171423917 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:19:52.950 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.943+0000 7f26a53e3640 1 --2- 172.21.15.148:0/2171423917 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563eb2b71af0 0x563eb2b85470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:52.950 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.943+0000 7f26a4be2640 1 --2- 172.21.15.148:0/2171423917 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563eb2b72410 0x563eb2b80790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:52.950 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.943+0000 7f26a5be4640 1 -- 172.21.15.148:0/2171423917 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563eb2b72410 msgr2=0x563eb2b80790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:52.950 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.943+0000 7f26a5be4640 1 --2- 172.21.15.148:0/2171423917 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563eb2b72410 0x563eb2b80790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:52.950 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.943+0000 7f26a5be4640 1 -- 172.21.15.148:0/2171423917 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563eb2b71af0 msgr2=0x563eb2b85470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:19:52.950 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.943+0000 7f26a5be4640 1 --2- 172.21.15.148:0/2171423917 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563eb2b71af0 0x563eb2b85470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:52.950 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.943+0000 7f26a5be4640 1 -- 172.21.15.148:0/2171423917 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563eb2b81520 con 0x563eb2b7ccb0 2024-09-19T07:19:52.950 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.943+0000 7f26a5be4640 1 --2- 172.21.15.148:0/2171423917 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563eb2b7ccb0 0x563eb2b80cf0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f269802cd70 tx=0x7f269802c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73e4ce2815a3ceaf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:52.950 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.943+0000 7f2688ff9640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:19:52.950 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.943+0000 7f2688ff9640 1 -- 172.21.15.148:0/2171423917 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2698020050 con 0x563eb2b7ccb0 2024-09-19T07:19:52.950 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.943+0000 7f2688ff9640 1 -- 172.21.15.148:0/2171423917 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7f2698004d30 con 0x563eb2b7ccb0 2024-09-19T07:19:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.943+0000 7f26aa3e0740 1 -- 172.21.15.148:0/2171423917 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2698019ab0 con 0x563eb2b7ccb0 2024-09-19T07:19:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.943+0000 7f2688ff9640 1 -- 172.21.15.148:0/2171423917 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f26980127b0 con 0x563eb2b7ccb0 2024-09-19T07:19:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.943+0000 7f26aa3e0740 10 client.16887 fetch_fsmap learned FSMap version 41 2024-09-19T07:19:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.943+0000 7f26aa3e0740 1 -- 172.21.15.148:0/2171423917 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x563eb2bf77d0 con 0x563eb2b7ccb0 2024-09-19T07:19:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.943+0000 7f2688ff9640 1 -- 172.21.15.148:0/2171423917 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2698019ab0 con 0x563eb2b7ccb0 2024-09-19T07:19:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.944+0000 7f2688ff9640 1 -- 172.21.15.148:0/2171423917 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 41) ==== 8370+0+0 (secure 0 0 0) 0x7f269801b040 con 0x563eb2b7ccb0 2024-09-19T07:19:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.944+0000 7f26aa3e0740 10 client.16887 fetch_fsmap finished waiting for FSMap version 41 2024-09-19T07:19:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.944+0000 7f26aa3e0740 10 client.16887 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:19:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.944+0000 7f26aa3e0740 20 client.16887 populate_metadata read hostname 'smithi148' 2024-09-19T07:19:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.944+0000 7f26aa3e0740 1 --2- 172.21.15.148:0/2171423917 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x563eb2bf7e00 0x563eb2bfa220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.944+0000 7f26aa3e0740 4 client.16887 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:19:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.944+0000 7f26aa3e0740 1 -- 172.21.15.148:0/2171423917 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563eb2addd70 con 0x563eb2bf7e00 2024-09-19T07:19:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.944+0000 7f26a53e3640 1 --2- 172.21.15.148:0/2171423917 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x563eb2bf7e00 0x563eb2bfa220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.944+0000 7f2688ff9640 10 client.16887 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:19:52.952 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.944+0000 7f26a53e3640 1 --2- 172.21.15.148:0/2171423917 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x563eb2bf7e00 0x563eb2bfa220 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0253f0f3a0e5a9 server_cookie=7af86ef22c97effb in_seq=0 out_seq=0 2024-09-19T07:19:52.965 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.962+0000 7f2688ff9640 1 -- 172.21.15.148:0/2171423917 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563eb2addd70 con 0x563eb2bf7e00 2024-09-19T07:19:52.965 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.962+0000 7f2688ff9640 10 client.16887 handle_command_reply: tid=0 2024-09-19T07:19:52.965 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.962+0000 7f26aa3e0740 1 client.16887 shutdown 2024-09-19T07:19:52.965 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.963+0000 7f26aa3e0740 1 -- 172.21.15.148:0/2171423917 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563eb2b7ccb0 msgr2=0x563eb2b80cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:52.965 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.963+0000 7f26aa3e0740 1 --2- 172.21.15.148:0/2171423917 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563eb2b7ccb0 0x563eb2b80cf0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f269802cd70 tx=0x7f269802c430 comp rx=0 tx=0).stop 2024-09-19T07:19:52.965 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.963+0000 7f26aa3e0740 1 -- 172.21.15.148:0/2171423917 shutdown_connections 2024-09-19T07:19:52.965 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.963+0000 7f26aa3e0740 1 --2- 172.21.15.148:0/2171423917 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x563eb2bf7e00 0x563eb2bfa220 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:52.965 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.963+0000 7f26aa3e0740 1 --2- 172.21.15.148:0/2171423917 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563eb2b7ccb0 0x563eb2b80cf0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:52.965 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.963+0000 7f26aa3e0740 1 --2- 172.21.15.148:0/2171423917 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563eb2b72410 0x563eb2b80790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.963+0000 7f26aa3e0740 1 --2- 172.21.15.148:0/2171423917 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563eb2b71af0 0x563eb2b85470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.963+0000 7f2688ff9640 0 client.16887 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:19:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.963+0000 7f26aa3e0740 1 -- 172.21.15.148:0/2171423917 >> 172.21.15.148:0/2171423917 conn(0x563eb2b6e060 msgr2=0x563eb2b6c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.963+0000 7f26aa3e0740 1 -- 172.21.15.148:0/2171423917 shutdown_connections 2024-09-19T07:19:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.963+0000 7f26aa3e0740 1 -- 172.21.15.148:0/2171423917 wait complete. 2024-09-19T07:19:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.963+0000 7f26aa3e0740 20 client.16887 trim_cache size 0 max 16384 2024-09-19T07:19:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:19:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:19:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:19:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:19:52.967 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.964+0000 7f26a7647640 1 -- 172.21.15.148:0/2308745043 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f268c0a3460 msgr2=0x7f268c0a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:52.967 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.964+0000 7f26a7647640 1 --2- 172.21.15.148:0/2308745043 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f268c0a3460 0x7f268c0a5920 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2698005c40 tx=0x7f269801a000 comp rx=0 tx=0).stop 2024-09-19T07:19:52.967 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.964+0000 7f26a7647640 1 -- 172.21.15.148:0/2308745043 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26a01009b0 msgr2=0x7f26a01a4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:52.968 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.964+0000 7f26a7647640 1 --2- 172.21.15.148:0/2308745043 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26a01009b0 0x7f26a01a4690 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f2694009230 tx=0x7f2694004270 comp rx=0 tx=0).stop 2024-09-19T07:19:52.968 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.964+0000 7f26a7647640 1 -- 172.21.15.148:0/2308745043 shutdown_connections 2024-09-19T07:19:52.968 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.964+0000 7f26a7647640 1 --2- 172.21.15.148:0/2308745043 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f268c0a3460 0x7f268c0a5920 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:52.968 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.964+0000 7f26a7647640 1 --2- 172.21.15.148:0/2308745043 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26a01069c0 0x7f26a019e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:52.968 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.964+0000 7f26a7647640 1 --2- 172.21.15.148:0/2308745043 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26a0101350 0x7f26a01a4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:52.968 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.964+0000 7f26a7647640 1 --2- 172.21.15.148:0/2308745043 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26a01009b0 0x7f26a01a4690 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:52.968 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.964+0000 7f26a7647640 1 -- 172.21.15.148:0/2308745043 >> 172.21.15.148:0/2308745043 conn(0x7f26a0077990 msgr2=0x7f26a01037b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:52.968 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.964+0000 7f26a7647640 1 -- 172.21.15.148:0/2308745043 shutdown_connections 2024-09-19T07:19:52.968 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:19:52.964+0000 7f26a7647640 1 -- 172.21.15.148:0/2308745043 wait complete. 2024-09-19T07:19:53.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:19:53 smithi179 ceph-mon[35716]: pgmap v272: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 36 op/s 2024-09-19T07:19:53.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:19:53 smithi148 ceph-mon[31180]: pgmap v272: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 36 op/s 2024-09-19T07:19:53.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:19:53 smithi165 ceph-mon[35326]: pgmap v272: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 36 op/s 2024-09-19T07:19:55.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:19:55 smithi179 ceph-mon[35716]: pgmap v273: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 31 op/s 2024-09-19T07:19:55.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:19:55 smithi148 ceph-mon[31180]: pgmap v273: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 31 op/s 2024-09-19T07:19:55.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:19:55 smithi165 ceph-mon[35326]: pgmap v273: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 31 op/s 2024-09-19T07:19:57.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:19:57 smithi179 ceph-mon[35716]: pgmap v274: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 843 KiB/s wr, 37 op/s 2024-09-19T07:19:57.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:19:57 smithi148 ceph-mon[31180]: pgmap v274: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 843 KiB/s wr, 37 op/s 2024-09-19T07:19:57.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:19:57 smithi165 ceph-mon[35326]: pgmap v274: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 843 KiB/s wr, 37 op/s 2024-09-19T07:19:59.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:19:59 smithi179 ceph-mon[35716]: pgmap v275: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 28 KiB/s wr, 19 op/s 2024-09-19T07:19:59.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:19:59 smithi148 ceph-mon[31180]: pgmap v275: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 28 KiB/s wr, 19 op/s 2024-09-19T07:19:59.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:19:59 smithi165 ceph-mon[35326]: pgmap v275: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 28 KiB/s wr, 19 op/s 2024-09-19T07:20:00.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:20:00 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mon-a[31176]: 2024-09-19T07:19:59.999+0000 7f2e51b2a640 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 2 MDSs report damaged metadata 2024-09-19T07:20:00.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:20:00 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mon-a[31176]: 2024-09-19T07:19:59.999+0000 7f2e51b2a640 -1 log_channel(cluster) log [ERR] : [ERR] MDS_DAMAGE: 2 MDSs report damaged metadata 2024-09-19T07:20:00.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:20:00 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mon-a[31176]: 2024-09-19T07:19:59.999+0000 7f2e51b2a640 -1 log_channel(cluster) log [ERR] : mds.c(mds.2): Metadata damage detected 2024-09-19T07:20:00.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:20:00 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mon-a[31176]: 2024-09-19T07:19:59.999+0000 7f2e51b2a640 -1 log_channel(cluster) log [ERR] : mds.b(mds.1): Metadata damage detected 2024-09-19T07:20:00.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:20:00 smithi148 ceph-mon[31180]: Health detail: HEALTH_ERR 2 MDSs report damaged metadata 2024-09-19T07:20:00.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:20:00 smithi148 ceph-mon[31180]: [ERR] MDS_DAMAGE: 2 MDSs report damaged metadata 2024-09-19T07:20:00.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:20:00 smithi148 ceph-mon[31180]: mds.c(mds.2): Metadata damage detected 2024-09-19T07:20:00.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:20:00 smithi148 ceph-mon[31180]: mds.b(mds.1): Metadata damage detected 2024-09-19T07:20:00.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:20:00 smithi179 ceph-mon[35716]: Health detail: HEALTH_ERR 2 MDSs report damaged metadata 2024-09-19T07:20:00.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:20:00 smithi179 ceph-mon[35716]: [ERR] MDS_DAMAGE: 2 MDSs report damaged metadata 2024-09-19T07:20:00.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:20:00 smithi179 ceph-mon[35716]: mds.c(mds.2): Metadata damage detected 2024-09-19T07:20:00.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:20:00 smithi179 ceph-mon[35716]: mds.b(mds.1): Metadata damage detected 2024-09-19T07:20:00.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:20:00 smithi165 ceph-mon[35326]: Health detail: HEALTH_ERR 2 MDSs report damaged metadata 2024-09-19T07:20:00.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:20:00 smithi165 ceph-mon[35326]: [ERR] MDS_DAMAGE: 2 MDSs report damaged metadata 2024-09-19T07:20:00.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:20:00 smithi165 ceph-mon[35326]: mds.c(mds.2): Metadata damage detected 2024-09-19T07:20:00.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:20:00 smithi165 ceph-mon[35326]: mds.b(mds.1): Metadata damage detected 2024-09-19T07:20:01.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:20:01 smithi179 ceph-mon[35716]: pgmap v276: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 46 KiB/s wr, 21 op/s 2024-09-19T07:20:01.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:20:01 smithi148 ceph-mon[31180]: pgmap v276: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 46 KiB/s wr, 21 op/s 2024-09-19T07:20:01.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:20:01 smithi165 ceph-mon[35326]: pgmap v276: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 46 KiB/s wr, 21 op/s 2024-09-19T07:20:03.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:20:03 smithi179 ceph-mon[35716]: pgmap v277: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 48 KiB/s wr, 26 op/s 2024-09-19T07:20:03.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:20:03 smithi148 ceph-mon[31180]: pgmap v277: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 48 KiB/s wr, 26 op/s 2024-09-19T07:20:03.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:20:03 smithi165 ceph-mon[35326]: pgmap v277: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 48 KiB/s wr, 26 op/s 2024-09-19T07:20:05.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:20:05 smithi179 ceph-mon[35716]: pgmap v278: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 56 KiB/s wr, 22 op/s 2024-09-19T07:20:05.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:20:05 smithi148 ceph-mon[31180]: pgmap v278: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 56 KiB/s wr, 22 op/s 2024-09-19T07:20:05.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:20:05 smithi165 ceph-mon[35326]: pgmap v278: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 56 KiB/s wr, 22 op/s 2024-09-19T07:20:06.065 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.062+0000 7f73cd4f1640 1 -- 172.21.15.148:0/2028263600 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73c8101ad0 msgr2=0x7f73c8101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:06.065 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.062+0000 7f73cd4f1640 1 --2- 172.21.15.148:0/2028263600 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73c8101ad0 0x7f73c8101f30 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f73bc009930 tx=0x7f73bc02a420 comp rx=0 tx=0).stop 2024-09-19T07:20:06.065 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.062+0000 7f73cd4f1640 1 -- 172.21.15.148:0/2028263600 shutdown_connections 2024-09-19T07:20:06.065 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.062+0000 7f73cd4f1640 1 --2- 172.21.15.148:0/2028263600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73c8102470 0x7f73c810e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:06.065 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.062+0000 7f73cd4f1640 1 --2- 172.21.15.148:0/2028263600 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73c8101ad0 0x7f73c8101f30 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:06.065 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.062+0000 7f73cd4f1640 1 --2- 172.21.15.148:0/2028263600 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f73c8107b70 0x7f73c8107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:06.065 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.062+0000 7f73cd4f1640 1 -- 172.21.15.148:0/2028263600 >> 172.21.15.148:0/2028263600 conn(0x7f73c80fd7d0 msgr2=0x7f73c80ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:06.065 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.062+0000 7f73cd4f1640 1 -- 172.21.15.148:0/2028263600 shutdown_connections 2024-09-19T07:20:06.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.062+0000 7f73cd4f1640 1 -- 172.21.15.148:0/2028263600 wait complete. 2024-09-19T07:20:06.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.062+0000 7f73cd4f1640 1 Processor -- start 2024-09-19T07:20:06.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.063+0000 7f73cd4f1640 1 -- start start 2024-09-19T07:20:06.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.063+0000 7f73cd4f1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73c8101ad0 0x7f73c81982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:06.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.063+0000 7f73cd4f1640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f73c8102470 0x7f73c8198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:06.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.063+0000 7f73cd4f1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73c8107b70 0x7f73c819cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:06.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.063+0000 7f73cd4f1640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f73c8111ee0 con 0x7f73c8101ad0 2024-09-19T07:20:06.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.063+0000 7f73cd4f1640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f73c8111d60 con 0x7f73c8102470 2024-09-19T07:20:06.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.063+0000 7f73cd4f1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f73c8112060 con 0x7f73c8107b70 2024-09-19T07:20:06.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.063+0000 7f73c6ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73c8101ad0 0x7f73c81982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:06.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.063+0000 7f73c6ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73c8101ad0 0x7f73c81982d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38810/0 (socket says 172.21.15.148:38810) 2024-09-19T07:20:06.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.063+0000 7f73c6ffd640 1 -- 172.21.15.148:0/898517411 learned_addr learned my addr 172.21.15.148:0/898517411 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:20:06.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.063+0000 7f73c67fc640 1 --2- 172.21.15.148:0/898517411 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f73c8102470 0x7f73c8198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:06.067 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.063+0000 7f73c77fe640 1 --2- 172.21.15.148:0/898517411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73c8107b70 0x7f73c819cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:06.067 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.063+0000 7f73c6ffd640 1 -- 172.21.15.148:0/898517411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73c8107b70 msgr2=0x7f73c819cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:06.067 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.063+0000 7f73c6ffd640 1 --2- 172.21.15.148:0/898517411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73c8107b70 0x7f73c819cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:06.067 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.063+0000 7f73c6ffd640 1 -- 172.21.15.148:0/898517411 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f73c8102470 msgr2=0x7f73c8198810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:06.067 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.063+0000 7f73c6ffd640 1 --2- 172.21.15.148:0/898517411 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f73c8102470 0x7f73c8198810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:06.067 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.063+0000 7f73c6ffd640 1 -- 172.21.15.148:0/898517411 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73c819d2c0 con 0x7f73c8101ad0 2024-09-19T07:20:06.067 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.063+0000 7f73c67fc640 1 --2- 172.21.15.148:0/898517411 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f73c8102470 0x7f73c8198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:20:06.067 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.063+0000 7f73c6ffd640 1 --2- 172.21.15.148:0/898517411 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73c8101ad0 0x7f73c81982d0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f73b800c890 tx=0x7f73b800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:06.067 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.064+0000 7f73affff640 1 -- 172.21.15.148:0/898517411 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b8004220 con 0x7f73c8101ad0 2024-09-19T07:20:06.067 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.064+0000 7f73affff640 1 -- 172.21.15.148:0/898517411 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73b80043c0 con 0x7f73c8101ad0 2024-09-19T07:20:06.067 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.064+0000 7f73cd4f1640 1 -- 172.21.15.148:0/898517411 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73c819d5b0 con 0x7f73c8101ad0 2024-09-19T07:20:06.067 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.064+0000 7f73affff640 1 -- 172.21.15.148:0/898517411 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b80049e0 con 0x7f73c8101ad0 2024-09-19T07:20:06.067 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.064+0000 7f73cd4f1640 1 -- 172.21.15.148:0/898517411 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73c81a4e40 con 0x7f73c8101ad0 2024-09-19T07:20:06.074 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.066+0000 7f73affff640 1 -- 172.21.15.148:0/898517411 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f73b80079b0 con 0x7f73c8101ad0 2024-09-19T07:20:06.074 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.066+0000 7f73d028f740 1 Processor -- start 2024-09-19T07:20:06.074 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.066+0000 7f73d028f740 1 -- start start 2024-09-19T07:20:06.074 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.066+0000 7f73d028f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e679b7baf0 0x55e679b7bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:06.074 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.066+0000 7f73d028f740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e679b7c410 0x55e679b86770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:06.074 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.066+0000 7f73d028f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e679b86cb0 0x55e679b890a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:06.074 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.066+0000 7f73d028f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55e679ae02f0 con 0x55e679b7baf0 2024-09-19T07:20:06.074 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.066+0000 7f73d028f740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55e679a88270 con 0x55e679b7c410 2024-09-19T07:20:06.075 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.066+0000 7f73d028f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55e679adc2b0 con 0x55e679b86cb0 2024-09-19T07:20:06.075 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.067+0000 7f73affff640 1 --2- 172.21.15.148:0/898517411 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f73b00a3460 0x7f73b00a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:06.075 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.067+0000 7f73c77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e679b7baf0 0x55e679b7bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:06.075 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.067+0000 7f73c77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e679b7baf0 0x55e679b7bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38818/0 (socket says 172.21.15.148:38818) 2024-09-19T07:20:06.075 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.067+0000 7f73c77fe640 1 -- 172.21.15.148:0/2575263847 learned_addr learned my addr 172.21.15.148:0/2575263847 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:20:06.075 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.067+0000 7f73c6ffd640 1 --2- 172.21.15.148:0/2575263847 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e679b7c410 0x55e679b86770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:06.075 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.067+0000 7f73c77fe640 1 --2- 172.21.15.148:0/898517411 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f73b00a3460 0x7f73b00a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:06.075 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.067+0000 7f73c67fc640 1 --2- 172.21.15.148:0/2575263847 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e679b86cb0 0x55e679b890a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:06.075 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.067+0000 7f73affff640 1 -- 172.21.15.148:0/898517411 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7f73b80cfd60 con 0x7f73c8101ad0 2024-09-19T07:20:06.075 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.067+0000 7f73c77fe640 1 -- 172.21.15.148:0/2575263847 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e679b86cb0 msgr2=0x55e679b890a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:20:06.075 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.067+0000 7f73c77fe640 1 --2- 172.21.15.148:0/2575263847 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e679b86cb0 0x55e679b890a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:06.075 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.067+0000 7f73c77fe640 1 -- 172.21.15.148:0/2575263847 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e679b7c410 msgr2=0x55e679b86770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:20:06.075 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.067+0000 7f73c77fe640 1 --2- 172.21.15.148:0/2575263847 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e679b7c410 0x55e679b86770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.067+0000 7f73c77fe640 1 -- 172.21.15.148:0/2575263847 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e679a87340 con 0x55e679b7baf0 2024-09-19T07:20:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.067+0000 7f73c77fe640 1 --2- 172.21.15.148:0/2575263847 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e679b7baf0 0x55e679b7bed0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f73c0014f10 tx=0x7f73c00117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1618a5a4ffe4f15 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.067+0000 7f73c77fe640 1 --2- 172.21.15.148:0/898517411 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f73b00a3460 0x7f73b00a5920 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f73c0005c40 tx=0x7f73c0016000 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.067+0000 7f73ad7fa640 1 -- 172.21.15.148:0/2575263847 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c0024070 con 0x55e679b7baf0 2024-09-19T07:20:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.067+0000 7f73ad7fa640 1 -- 172.21.15.148:0/2575263847 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73c0007ce0 con 0x55e679b7baf0 2024-09-19T07:20:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.067+0000 7f73ad7fa640 1 -- 172.21.15.148:0/2575263847 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c00057d0 con 0x55e679b7baf0 2024-09-19T07:20:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.068+0000 7f73d028f740 1 -- 172.21.15.148:0/2575263847 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e679b7baf0 msgr2=0x55e679b7bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.068+0000 7f73d028f740 1 --2- 172.21.15.148:0/2575263847 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e679b7baf0 0x55e679b7bed0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f73c0014f10 tx=0x7f73c00117b0 comp rx=0 tx=0).stop 2024-09-19T07:20:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.068+0000 7f73d028f740 1 -- 172.21.15.148:0/2575263847 shutdown_connections 2024-09-19T07:20:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.068+0000 7f73d028f740 1 --2- 172.21.15.148:0/2575263847 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e679b86cb0 0x55e679b890a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.068+0000 7f73d028f740 1 --2- 172.21.15.148:0/2575263847 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e679b7c410 0x55e679b86770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.068+0000 7f73d028f740 1 --2- 172.21.15.148:0/2575263847 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e679b7baf0 0x55e679b7bed0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.068+0000 7f73d028f740 1 -- 172.21.15.148:0/2575263847 >> 172.21.15.148:0/2575263847 conn(0x55e679b78060 msgr2=0x55e679b78440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.068+0000 7f73d028f740 1 -- 172.21.15.148:0/2575263847 shutdown_connections 2024-09-19T07:20:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.068+0000 7f73d028f740 1 -- 172.21.15.148:0/2575263847 wait complete. 2024-09-19T07:20:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.069+0000 7f73d028f740 1 -- start start 2024-09-19T07:20:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.069+0000 7f73d028f740 1 Processor -- start 2024-09-19T07:20:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.069+0000 7f73d028f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e679b7baf0 0x55e679b83ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.069+0000 7f73d028f740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e679b7c410 0x55e679b840e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.069+0000 7f73d028f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e679b86cb0 0x55e679b84620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.069+0000 7f73d028f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55e679b89880 con 0x55e679b86cb0 2024-09-19T07:20:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.069+0000 7f73d028f740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55e679a69290 con 0x55e679b7c410 2024-09-19T07:20:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.069+0000 7f73d028f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55e679b89a00 con 0x55e679b7baf0 2024-09-19T07:20:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.069+0000 7f73d028f740 10 client.0 _ll_register_callbacks cb 0x55e679a9a140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:20:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.069+0000 7f73c77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e679b86cb0 0x55e679b84620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:06.078 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.069+0000 7f73c77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e679b86cb0 0x55e679b84620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38824/0 (socket says 172.21.15.148:38824) 2024-09-19T07:20:06.078 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.069+0000 7f73c77fe640 1 -- 172.21.15.148:0/1155340209 learned_addr learned my addr 172.21.15.148:0/1155340209 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:20:06.078 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.069+0000 7f73c77fe640 1 -- 172.21.15.148:0/1155340209 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e679b7baf0 msgr2=0x55e679b83ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:20:06.078 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.069+0000 7f73c6ffd640 1 --2- 172.21.15.148:0/1155340209 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e679b7baf0 0x55e679b83ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:06.078 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.069+0000 7f73c67fc640 1 --2- 172.21.15.148:0/1155340209 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e679b7c410 0x55e679b840e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:06.078 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.069+0000 7f73c77fe640 1 --2- 172.21.15.148:0/1155340209 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e679b7baf0 0x55e679b83ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:06.078 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.069+0000 7f73c77fe640 1 -- 172.21.15.148:0/1155340209 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e679b7c410 msgr2=0x55e679b840e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:20:06.078 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.069+0000 7f73c77fe640 1 --2- 172.21.15.148:0/1155340209 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e679b7c410 0x55e679b840e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:06.078 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.069+0000 7f73c77fe640 1 -- 172.21.15.148:0/1155340209 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6797f3210 con 0x55e679b86cb0 2024-09-19T07:20:06.078 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.069+0000 7f73c6ffd640 1 --2- 172.21.15.148:0/1155340209 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e679b7baf0 0x55e679b83ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:20:06.079 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.070+0000 7f73c77fe640 1 --2- 172.21.15.148:0/1155340209 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e679b86cb0 0x55e679b84620 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f73c000cf60 tx=0x7f73c000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7788f5d92367203b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:06.079 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.070+0000 7f73aaff5640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:20:06.079 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.070+0000 7f73aaff5640 1 -- 172.21.15.148:0/1155340209 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c0035060 con 0x55e679b86cb0 2024-09-19T07:20:06.079 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.070+0000 7f73aaff5640 1 -- 172.21.15.148:0/1155340209 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7f73c0003970 con 0x55e679b86cb0 2024-09-19T07:20:06.079 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.070+0000 7f73d028f740 1 -- 172.21.15.148:0/1155340209 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e679aeda20 con 0x55e679b86cb0 2024-09-19T07:20:06.079 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.070+0000 7f73aaff5640 1 -- 172.21.15.148:0/1155340209 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f73c0024050 con 0x55e679b86cb0 2024-09-19T07:20:06.079 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.070+0000 7f73d028f740 10 client.16899 fetch_fsmap learned FSMap version 42 2024-09-19T07:20:06.079 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.070+0000 7f73d028f740 1 -- 172.21.15.148:0/1155340209 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55e6798bf620 con 0x55e679b86cb0 2024-09-19T07:20:06.079 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.070+0000 7f73aaff5640 1 -- 172.21.15.148:0/1155340209 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55e679aeda20 con 0x55e679b86cb0 2024-09-19T07:20:06.079 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.070+0000 7f73aaff5640 1 -- 172.21.15.148:0/1155340209 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 42) ==== 8366+0+0 (secure 0 0 0) 0x7f73c0004040 con 0x55e679b86cb0 2024-09-19T07:20:06.079 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.070+0000 7f73d028f740 10 client.16899 fetch_fsmap finished waiting for FSMap version 42 2024-09-19T07:20:06.079 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.070+0000 7f73d028f740 10 client.16899 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:20:06.079 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.070+0000 7f73d028f740 20 client.16899 populate_metadata read hostname 'smithi148' 2024-09-19T07:20:06.079 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.070+0000 7f73d028f740 1 --2- 172.21.15.148:0/1155340209 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e679b96ba0 0x55e679b98f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:06.080 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.070+0000 7f73d028f740 4 client.16899 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:20:06.080 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.070+0000 7f73d028f740 1 -- 172.21.15.148:0/1155340209 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e679ae7d70 con 0x55e679b96ba0 2024-09-19T07:20:06.080 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.071+0000 7f73c6ffd640 1 --2- 172.21.15.148:0/1155340209 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e679b96ba0 0x55e679b98f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:06.080 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.071+0000 7f73aaff5640 10 client.16899 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:20:06.080 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.071+0000 7f73c6ffd640 1 --2- 172.21.15.148:0/1155340209 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e679b96ba0 0x55e679b98f90 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da7db7e17d72fc4a server_cookie=f530721b2a689a71 in_seq=0 out_seq=0 2024-09-19T07:20:06.080 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.072+0000 7f73aaff5640 1 -- 172.21.15.148:0/1155340209 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e679ae7d70 con 0x55e679b96ba0 2024-09-19T07:20:06.080 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.072+0000 7f73aaff5640 10 client.16899 handle_command_reply: tid=0 2024-09-19T07:20:06.080 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.072+0000 7f73d028f740 1 client.16899 shutdown 2024-09-19T07:20:06.080 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.072+0000 7f73d028f740 1 -- 172.21.15.148:0/1155340209 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e679b86cb0 msgr2=0x55e679b84620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:06.080 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.072+0000 7f73d028f740 1 --2- 172.21.15.148:0/1155340209 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e679b86cb0 0x55e679b84620 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f73c000cf60 tx=0x7f73c000cf90 comp rx=0 tx=0).stop 2024-09-19T07:20:06.080 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.072+0000 7f73d028f740 1 -- 172.21.15.148:0/1155340209 shutdown_connections 2024-09-19T07:20:06.080 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.072+0000 7f73d028f740 1 --2- 172.21.15.148:0/1155340209 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e679b96ba0 0x55e679b98f90 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:06.080 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.072+0000 7f73d028f740 1 --2- 172.21.15.148:0/1155340209 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e679b86cb0 0x55e679b84620 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:06.081 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.072+0000 7f73d028f740 1 --2- 172.21.15.148:0/1155340209 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e679b7c410 0x55e679b840e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:06.081 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.072+0000 7f73aaff5640 0 client.16899 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:20:06.081 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.072+0000 7f73d028f740 1 --2- 172.21.15.148:0/1155340209 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e679b7baf0 0x55e679b83ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:06.081 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.072+0000 7f73d028f740 1 -- 172.21.15.148:0/1155340209 >> 172.21.15.148:0/1155340209 conn(0x55e679b78060 msgr2=0x55e679b7ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:06.081 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.072+0000 7f73d028f740 1 -- 172.21.15.148:0/1155340209 shutdown_connections 2024-09-19T07:20:06.081 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.072+0000 7f73d028f740 1 -- 172.21.15.148:0/1155340209 wait complete. 2024-09-19T07:20:06.081 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.072+0000 7f73d028f740 20 client.16899 trim_cache size 0 max 16384 2024-09-19T07:20:06.091 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.086+0000 7f73d028f740 1 Processor -- start 2024-09-19T07:20:06.091 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.086+0000 7f73d028f740 1 -- start start 2024-09-19T07:20:06.091 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.086+0000 7f73d028f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e679b7baf0 0x55e679b840d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:06.092 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.086+0000 7f73d028f740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e679b7c410 0x55e679b84610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:06.092 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.086+0000 7f73d028f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e679b86cb0 0x55e679b9e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:06.092 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.086+0000 7f73d028f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f73c81b0160 con 0x55e679b7baf0 2024-09-19T07:20:06.092 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.086+0000 7f73d028f740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f73c81ad9a0 con 0x55e679b7c410 2024-09-19T07:20:06.092 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.086+0000 7f73d028f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f73c81ab810 con 0x55e679b86cb0 2024-09-19T07:20:06.092 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.087+0000 7f73c6ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e679b7baf0 0x55e679b840d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:06.092 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.087+0000 7f73c6ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e679b7baf0 0x55e679b840d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38832/0 (socket says 172.21.15.148:38832) 2024-09-19T07:20:06.092 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.087+0000 7f73c6ffd640 1 -- 172.21.15.148:0/2385245971 learned_addr learned my addr 172.21.15.148:0/2385245971 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:20:06.092 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.087+0000 7f73c6ffd640 1 -- 172.21.15.148:0/2385245971 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e679b86cb0 msgr2=0x55e679b9e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:20:06.092 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.087+0000 7f73c6ffd640 1 --2- 172.21.15.148:0/2385245971 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e679b86cb0 0x55e679b9e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:06.092 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.087+0000 7f73c6ffd640 1 -- 172.21.15.148:0/2385245971 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e679b7c410 msgr2=0x55e679b84610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:20:06.092 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.087+0000 7f73c6ffd640 1 --2- 172.21.15.148:0/2385245971 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e679b7c410 0x55e679b84610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:06.093 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.087+0000 7f73c6ffd640 1 -- 172.21.15.148:0/2385245971 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e679b78cf0 con 0x55e679b7baf0 2024-09-19T07:20:06.093 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.087+0000 7f73c6ffd640 1 --2- 172.21.15.148:0/2385245971 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e679b7baf0 0x55e679b840d0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f73b80989f0 tx=0x7f73b806dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8b77eb6cae51090 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:06.093 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.087+0000 7f73acff9640 1 -- 172.21.15.148:0/2385245971 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b801d040 con 0x55e679b7baf0 2024-09-19T07:20:06.093 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.087+0000 7f73acff9640 1 -- 172.21.15.148:0/2385245971 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73b809c720 con 0x55e679b7baf0 2024-09-19T07:20:06.093 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.087+0000 7f73acff9640 1 -- 172.21.15.148:0/2385245971 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b80bc040 con 0x55e679b7baf0 2024-09-19T07:20:06.093 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.088+0000 7f73d028f740 1 -- 172.21.15.148:0/2385245971 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e679b7baf0 msgr2=0x55e679b840d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:06.093 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.088+0000 7f73d028f740 1 --2- 172.21.15.148:0/2385245971 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e679b7baf0 0x55e679b840d0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f73b80989f0 tx=0x7f73b806dda0 comp rx=0 tx=0).stop 2024-09-19T07:20:06.093 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.088+0000 7f73d028f740 1 -- 172.21.15.148:0/2385245971 shutdown_connections 2024-09-19T07:20:06.093 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.088+0000 7f73d028f740 1 --2- 172.21.15.148:0/2385245971 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e679b86cb0 0x55e679b9e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:06.093 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.088+0000 7f73d028f740 1 --2- 172.21.15.148:0/2385245971 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e679b7c410 0x55e679b84610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:06.093 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.088+0000 7f73d028f740 1 --2- 172.21.15.148:0/2385245971 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e679b7baf0 0x55e679b840d0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.088+0000 7f73d028f740 1 -- 172.21.15.148:0/2385245971 >> 172.21.15.148:0/2385245971 conn(0x55e679b78060 msgr2=0x55e679b85c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.088+0000 7f73d028f740 1 -- 172.21.15.148:0/2385245971 shutdown_connections 2024-09-19T07:20:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.088+0000 7f73d028f740 1 -- 172.21.15.148:0/2385245971 wait complete. 2024-09-19T07:20:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.088+0000 7f73d028f740 1 -- start start 2024-09-19T07:20:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.088+0000 7f73d028f740 1 Processor -- start 2024-09-19T07:20:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.088+0000 7f73d028f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e679b7baf0 0x55e679b8efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.088+0000 7f73d028f740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e679b7c410 0x55e679b8f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.088+0000 7f73d028f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e679b86cb0 0x55e679b8a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.088+0000 7f73d028f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f73c81abe60 con 0x55e679b7baf0 2024-09-19T07:20:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.088+0000 7f73d028f740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f73c81ad2d0 con 0x55e679b7c410 2024-09-19T07:20:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.088+0000 7f73d028f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f73c81ac530 con 0x55e679b86cb0 2024-09-19T07:20:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.088+0000 7f73d028f740 10 client.0 _ll_register_callbacks cb 0x7f73b80058c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:20:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.089+0000 7f73c6ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e679b7baf0 0x55e679b8efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.089+0000 7f73c6ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e679b7baf0 0x55e679b8efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38848/0 (socket says 172.21.15.148:38848) 2024-09-19T07:20:06.095 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.089+0000 7f73c6ffd640 1 -- 172.21.15.148:0/1880780493 learned_addr learned my addr 172.21.15.148:0/1880780493 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:20:06.095 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.089+0000 7f73c67fc640 1 --2- 172.21.15.148:0/1880780493 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e679b7c410 0x55e679b8f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:06.095 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.089+0000 7f73c77fe640 1 --2- 172.21.15.148:0/1880780493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e679b86cb0 0x55e679b8a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:06.095 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.089+0000 7f73c6ffd640 1 -- 172.21.15.148:0/1880780493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e679b86cb0 msgr2=0x55e679b8a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:20:06.095 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.089+0000 7f73c6ffd640 1 --2- 172.21.15.148:0/1880780493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e679b86cb0 0x55e679b8a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:06.095 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.089+0000 7f73c6ffd640 1 -- 172.21.15.148:0/1880780493 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e679b7c410 msgr2=0x55e679b8f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:20:06.095 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.089+0000 7f73c6ffd640 1 --2- 172.21.15.148:0/1880780493 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e679b7c410 0x55e679b8f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:06.095 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.089+0000 7f73c6ffd640 1 -- 172.21.15.148:0/1880780493 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e679b8ac50 con 0x55e679b7baf0 2024-09-19T07:20:06.095 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.089+0000 7f73c67fc640 1 --2- 172.21.15.148:0/1880780493 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e679b7c410 0x55e679b8f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:20:06.095 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.089+0000 7f73c6ffd640 1 --2- 172.21.15.148:0/1880780493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e679b7baf0 0x55e679b8efe0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f73b80cd540 tx=0x7f73b809c110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=261a4822f6836d80 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:06.095 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.089+0000 7f73aaff5640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:20:06.095 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.089+0000 7f73aaff5640 1 -- 172.21.15.148:0/1880780493 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b801d070 con 0x55e679b7baf0 2024-09-19T07:20:06.095 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.089+0000 7f73aaff5640 1 -- 172.21.15.148:0/1880780493 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8556+0+0 (secure 0 0 0) 0x7f73b8098690 con 0x55e679b7baf0 2024-09-19T07:20:06.095 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.089+0000 7f73d028f740 1 -- 172.21.15.148:0/1880780493 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73b809c720 con 0x55e679b7baf0 2024-09-19T07:20:06.096 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.089+0000 7f73aaff5640 1 -- 172.21.15.148:0/1880780493 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f73b8007ca0 con 0x55e679b7baf0 2024-09-19T07:20:06.096 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.089+0000 7f73d028f740 10 client.16905 fetch_fsmap learned FSMap version 42 2024-09-19T07:20:06.096 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.089+0000 7f73d028f740 1 -- 172.21.15.148:0/1880780493 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55e679c012e0 con 0x55e679b7baf0 2024-09-19T07:20:06.096 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.089+0000 7f73aaff5640 1 -- 172.21.15.148:0/1880780493 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73b809c720 con 0x55e679b7baf0 2024-09-19T07:20:06.096 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.089+0000 7f73aaff5640 1 -- 172.21.15.148:0/1880780493 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 42) ==== 8366+0+0 (secure 0 0 0) 0x7f73b80a4800 con 0x55e679b7baf0 2024-09-19T07:20:06.096 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.090+0000 7f73d028f740 10 client.16905 fetch_fsmap finished waiting for FSMap version 42 2024-09-19T07:20:06.096 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.090+0000 7f73d028f740 10 client.16905 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:20:06.096 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.090+0000 7f73d028f740 20 client.16905 populate_metadata read hostname 'smithi148' 2024-09-19T07:20:06.096 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.090+0000 7f73d028f740 1 --2- 172.21.15.148:0/1880780493 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e679c018f0 0x55e679c03d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:06.096 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.090+0000 7f73d028f740 4 client.16905 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:20:06.096 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.090+0000 7f73d028f740 1 -- 172.21.15.148:0/1880780493 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e679a64900 con 0x55e679c018f0 2024-09-19T07:20:06.096 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.090+0000 7f73c67fc640 1 --2- 172.21.15.148:0/1880780493 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e679c018f0 0x55e679c03d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:06.096 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.090+0000 7f73aaff5640 10 client.16905 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:20:06.097 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.090+0000 7f73c67fc640 1 --2- 172.21.15.148:0/1880780493 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e679c018f0 0x55e679c03d10 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a10e91370287d14b server_cookie=a13e3f7d767e03b7 in_seq=0 out_seq=0 2024-09-19T07:20:06.112 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.111+0000 7f73aaff5640 1 -- 172.21.15.148:0/1880780493 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e679a64900 con 0x55e679c018f0 2024-09-19T07:20:06.113 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.111+0000 7f73aaff5640 10 client.16905 handle_command_reply: tid=0 2024-09-19T07:20:06.113 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.111+0000 7f73d028f740 1 client.16905 shutdown 2024-09-19T07:20:06.113 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.111+0000 7f73d028f740 1 -- 172.21.15.148:0/1880780493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e679b7baf0 msgr2=0x55e679b8efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:06.113 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.111+0000 7f73d028f740 1 --2- 172.21.15.148:0/1880780493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e679b7baf0 0x55e679b8efe0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f73b80cd540 tx=0x7f73b809c110 comp rx=0 tx=0).stop 2024-09-19T07:20:06.113 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.111+0000 7f73d028f740 1 -- 172.21.15.148:0/1880780493 shutdown_connections 2024-09-19T07:20:06.113 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.111+0000 7f73d028f740 1 --2- 172.21.15.148:0/1880780493 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e679c018f0 0x55e679c03d10 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:06.113 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.111+0000 7f73d028f740 1 --2- 172.21.15.148:0/1880780493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e679b86cb0 0x55e679b8a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:06.113 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.111+0000 7f73aaff5640 0 client.16905 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:20:06.113 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.111+0000 7f73d028f740 1 --2- 172.21.15.148:0/1880780493 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e679b7c410 0x55e679b8f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:06.113 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.111+0000 7f73d028f740 1 --2- 172.21.15.148:0/1880780493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e679b7baf0 0x55e679b8efe0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:06.113 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.111+0000 7f73d028f740 1 -- 172.21.15.148:0/1880780493 >> 172.21.15.148:0/1880780493 conn(0x55e679b78060 msgr2=0x55e679b771c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:06.113 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.111+0000 7f73d028f740 1 -- 172.21.15.148:0/1880780493 shutdown_connections 2024-09-19T07:20:06.113 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.111+0000 7f73d028f740 1 -- 172.21.15.148:0/1880780493 wait complete. 2024-09-19T07:20:06.114 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.111+0000 7f73d028f740 20 client.16905 trim_cache size 0 max 16384 2024-09-19T07:20:06.114 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:20:06.114 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:20:06.114 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:20:06.114 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:20:06.115 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.112+0000 7f73cd4f1640 1 -- 172.21.15.148:0/898517411 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f73b00a3460 msgr2=0x7f73b00a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:06.115 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.112+0000 7f73cd4f1640 1 --2- 172.21.15.148:0/898517411 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f73b00a3460 0x7f73b00a5920 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f73c0005c40 tx=0x7f73c0016000 comp rx=0 tx=0).stop 2024-09-19T07:20:06.115 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.112+0000 7f73cd4f1640 1 -- 172.21.15.148:0/898517411 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73c8101ad0 msgr2=0x7f73c81982d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:06.115 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.112+0000 7f73cd4f1640 1 --2- 172.21.15.148:0/898517411 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73c8101ad0 0x7f73c81982d0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f73b800c890 tx=0x7f73b800cd50 comp rx=0 tx=0).stop 2024-09-19T07:20:06.115 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.112+0000 7f73cd4f1640 1 -- 172.21.15.148:0/898517411 shutdown_connections 2024-09-19T07:20:06.115 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.112+0000 7f73cd4f1640 1 --2- 172.21.15.148:0/898517411 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f73b00a3460 0x7f73b00a5920 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:06.115 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.112+0000 7f73cd4f1640 1 --2- 172.21.15.148:0/898517411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73c8107b70 0x7f73c819cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:06.116 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.112+0000 7f73cd4f1640 1 --2- 172.21.15.148:0/898517411 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f73c8102470 0x7f73c8198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:06.116 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.112+0000 7f73cd4f1640 1 --2- 172.21.15.148:0/898517411 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73c8101ad0 0x7f73c81982d0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:06.116 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.112+0000 7f73cd4f1640 1 -- 172.21.15.148:0/898517411 >> 172.21.15.148:0/898517411 conn(0x7f73c80fd7d0 msgr2=0x7f73c80fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:06.116 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.112+0000 7f73cd4f1640 1 -- 172.21.15.148:0/898517411 shutdown_connections 2024-09-19T07:20:06.116 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:06.112+0000 7f73cd4f1640 1 -- 172.21.15.148:0/898517411 wait complete. 2024-09-19T07:20:06.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:20:06 smithi179 ceph-mon[35716]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:20:06.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:20:06 smithi148 ceph-mon[31180]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:20:06.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:20:06 smithi165 ceph-mon[35326]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:20:07.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:20:07 smithi179 ceph-mon[35716]: pgmap v279: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 98 KiB/s wr, 41 op/s 2024-09-19T07:20:07.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:20:07 smithi179 ceph-mon[35716]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T07:20:07.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:20:07 smithi148 ceph-mon[31180]: pgmap v279: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 98 KiB/s wr, 41 op/s 2024-09-19T07:20:07.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:20:07 smithi148 ceph-mon[31180]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T07:20:07.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:20:07 smithi165 ceph-mon[35326]: pgmap v279: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 98 KiB/s wr, 41 op/s 2024-09-19T07:20:07.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:20:07 smithi165 ceph-mon[35326]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T07:20:09.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:20:09 smithi179 ceph-mon[35716]: pgmap v281: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 103 KiB/s wr, 38 op/s 2024-09-19T07:20:09.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:20:09 smithi148 ceph-mon[31180]: pgmap v281: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 103 KiB/s wr, 38 op/s 2024-09-19T07:20:09.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:20:09 smithi165 ceph-mon[35326]: pgmap v281: 97 pgs: 97 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 103 KiB/s wr, 38 op/s 2024-09-19T07:20:11.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:20:11 smithi179 ceph-mon[35716]: pgmap v282: 97 pgs: 4 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 82 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 108 KiB/s wr, 38 op/s 2024-09-19T07:20:11.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:20:11 smithi148 ceph-mon[31180]: pgmap v282: 97 pgs: 4 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 82 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 108 KiB/s wr, 38 op/s 2024-09-19T07:20:11.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:20:11 smithi165 ceph-mon[35326]: pgmap v282: 97 pgs: 4 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 82 active+clean; 1.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 108 KiB/s wr, 38 op/s 2024-09-19T07:20:13.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:20:13 smithi179 ceph-mon[35716]: pgmap v283: 97 pgs: 12 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 59 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 110 KiB/s wr, 41 op/s 2024-09-19T07:20:13.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:20:13 smithi148 ceph-mon[31180]: pgmap v283: 97 pgs: 12 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 59 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 110 KiB/s wr, 41 op/s 2024-09-19T07:20:13.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:20:13 smithi165 ceph-mon[35326]: pgmap v283: 97 pgs: 12 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 59 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 110 KiB/s wr, 41 op/s 2024-09-19T07:20:15.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:20:15 smithi179 ceph-mon[35716]: pgmap v284: 97 pgs: 8 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 74 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 107 KiB/s wr, 41 op/s 2024-09-19T07:20:15.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:20:15 smithi148 ceph-mon[31180]: pgmap v284: 97 pgs: 8 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 74 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 107 KiB/s wr, 41 op/s 2024-09-19T07:20:15.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:20:15 smithi165 ceph-mon[35326]: pgmap v284: 97 pgs: 8 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 74 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 107 KiB/s wr, 41 op/s 2024-09-19T07:20:17.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:20:17 smithi179 ceph-mon[35716]: pgmap v285: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 344 KiB/s wr, 22 op/s 2024-09-19T07:20:17.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:20:17 smithi148 ceph-mon[31180]: pgmap v285: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 344 KiB/s wr, 22 op/s 2024-09-19T07:20:17.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:20:17 smithi165 ceph-mon[35326]: pgmap v285: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 344 KiB/s wr, 22 op/s 2024-09-19T07:20:19.215 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.211+0000 7f23940e6640 1 -- 172.21.15.148:0/4263522255 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f238c10c0b0 msgr2=0x7f238c10e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:19.215 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.211+0000 7f23940e6640 1 --2- 172.21.15.148:0/4263522255 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f238c10c0b0 0x7f238c10e550 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f2384009ca0 tx=0x7f238402a950 comp rx=0 tx=0).stop 2024-09-19T07:20:19.215 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.211+0000 7f23940e6640 1 -- 172.21.15.148:0/4263522255 shutdown_connections 2024-09-19T07:20:19.215 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.211+0000 7f23940e6640 1 --2- 172.21.15.148:0/4263522255 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f238c10c0b0 0x7f238c10e550 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:19.215 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.211+0000 7f23940e6640 1 --2- 172.21.15.148:0/4263522255 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f238c103600 0x7f238c10bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:19.215 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.211+0000 7f23940e6640 1 --2- 172.21.15.148:0/4263522255 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f238c102ce0 0x7f238c1030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:19.215 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.211+0000 7f23940e6640 1 -- 172.21.15.148:0/4263522255 >> 172.21.15.148:0/4263522255 conn(0x7f238c077990 msgr2=0x7f238c0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:19.215 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.211+0000 7f23940e6640 1 -- 172.21.15.148:0/4263522255 shutdown_connections 2024-09-19T07:20:19.215 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.211+0000 7f23940e6640 1 -- 172.21.15.148:0/4263522255 wait complete. 2024-09-19T07:20:19.216 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.212+0000 7f23940e6640 1 Processor -- start 2024-09-19T07:20:19.216 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.212+0000 7f23940e6640 1 -- start start 2024-09-19T07:20:19.216 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.212+0000 7f23940e6640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f238c102ce0 0x7f238c1982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:19.216 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.212+0000 7f23940e6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f238c103600 0x7f238c198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:19.216 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.212+0000 7f23940e6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f238c10c0b0 0x7f238c19cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:19.216 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.212+0000 7f23940e6640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f238c111eb0 con 0x7f238c103600 2024-09-19T07:20:19.216 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.212+0000 7f23940e6640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f238c111d30 con 0x7f238c102ce0 2024-09-19T07:20:19.216 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.212+0000 7f23940e6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f238c112030 con 0x7f238c10c0b0 2024-09-19T07:20:19.216 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.212+0000 7f2391681640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f238c103600 0x7f238c198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:19.216 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.212+0000 7f2391681640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f238c103600 0x7f238c198800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58230/0 (socket says 172.21.15.148:58230) 2024-09-19T07:20:19.216 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.213+0000 7f2391681640 1 -- 172.21.15.148:0/581609581 learned_addr learned my addr 172.21.15.148:0/581609581 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:20:19.216 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.213+0000 7f2391e82640 1 --2- 172.21.15.148:0/581609581 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f238c102ce0 0x7f238c1982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:19.217 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.213+0000 7f2392683640 1 --2- 172.21.15.148:0/581609581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f238c10c0b0 0x7f238c19cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:19.217 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.213+0000 7f2391681640 1 -- 172.21.15.148:0/581609581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f238c10c0b0 msgr2=0x7f238c19cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:19.217 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.213+0000 7f2391681640 1 --2- 172.21.15.148:0/581609581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f238c10c0b0 0x7f238c19cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:19.217 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.213+0000 7f2391681640 1 -- 172.21.15.148:0/581609581 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f238c102ce0 msgr2=0x7f238c1982c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:19.217 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.213+0000 7f2391681640 1 --2- 172.21.15.148:0/581609581 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f238c102ce0 0x7f238c1982c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:19.217 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.213+0000 7f2391681640 1 -- 172.21.15.148:0/581609581 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f238c19d2b0 con 0x7f238c103600 2024-09-19T07:20:19.217 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.213+0000 7f2391e82640 1 --2- 172.21.15.148:0/581609581 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f238c102ce0 0x7f238c1982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:20:19.217 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.213+0000 7f2391681640 1 --2- 172.21.15.148:0/581609581 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f238c103600 0x7f238c198800 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f237c00e9f0 tx=0x7f237c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:19.217 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.213+0000 7f2382ffd640 1 -- 172.21.15.148:0/581609581 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237c00cd80 con 0x7f238c103600 2024-09-19T07:20:19.217 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.213+0000 7f2382ffd640 1 -- 172.21.15.148:0/581609581 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f237c005500 con 0x7f238c103600 2024-09-19T07:20:19.218 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.213+0000 7f2382ffd640 1 -- 172.21.15.148:0/581609581 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237c010690 con 0x7f238c103600 2024-09-19T07:20:19.218 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.213+0000 7f23940e6640 1 -- 172.21.15.148:0/581609581 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f238c19d5a0 con 0x7f238c103600 2024-09-19T07:20:19.218 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.213+0000 7f23940e6640 1 -- 172.21.15.148:0/581609581 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f238c1a4e30 con 0x7f238c103600 2024-09-19T07:20:19.224 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.216+0000 7f2382ffd640 1 -- 172.21.15.148:0/581609581 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f237c0046c0 con 0x7f238c103600 2024-09-19T07:20:19.224 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.216+0000 7f2396e7d740 1 Processor -- start 2024-09-19T07:20:19.224 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.216+0000 7f2396e7d740 1 -- start start 2024-09-19T07:20:19.224 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.216+0000 7f2396e7d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b917c58af0 0x55b917c58ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:19.224 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.216+0000 7f2396e7d740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b917c59410 0x55b917c63770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:19.225 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.216+0000 7f2396e7d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b917c63cb0 0x55b917c660a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:19.225 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.216+0000 7f2396e7d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55b917bbd2f0 con 0x55b917c58af0 2024-09-19T07:20:19.225 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.216+0000 7f2396e7d740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55b917b65270 con 0x55b917c59410 2024-09-19T07:20:19.225 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.216+0000 7f2396e7d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55b917bb92b0 con 0x55b917c63cb0 2024-09-19T07:20:19.225 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.216+0000 7f2392683640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b917c58af0 0x55b917c58ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:19.225 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.217+0000 7f2392683640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b917c58af0 0x55b917c58ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58244/0 (socket says 172.21.15.148:58244) 2024-09-19T07:20:19.225 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.217+0000 7f2392683640 1 -- 172.21.15.148:0/2345515910 learned_addr learned my addr 172.21.15.148:0/2345515910 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:20:19.225 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.217+0000 7f2382ffd640 1 --2- 172.21.15.148:0/581609581 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f23780a34e0 0x7f23780a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:19.225 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.217+0000 7f2391e82640 1 --2- 172.21.15.148:0/2345515910 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b917c59410 0x55b917c63770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:19.225 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.217+0000 7f2391681640 1 --2- 172.21.15.148:0/2345515910 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b917c63cb0 0x55b917c660a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:19.225 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.217+0000 7f2392683640 1 --2- 172.21.15.148:0/581609581 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f23780a34e0 0x7f23780a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:19.225 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.217+0000 7f2392683640 1 -- 172.21.15.148:0/2345515910 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b917c63cb0 msgr2=0x55b917c660a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:20:19.225 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.217+0000 7f2392683640 1 --2- 172.21.15.148:0/2345515910 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b917c63cb0 0x55b917c660a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:19.226 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.217+0000 7f2382ffd640 1 -- 172.21.15.148:0/581609581 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8556+0+0 (secure 0 0 0) 0x7f237c0d0030 con 0x7f238c103600 2024-09-19T07:20:19.226 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.217+0000 7f2392683640 1 -- 172.21.15.148:0/2345515910 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b917c59410 msgr2=0x55b917c63770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:20:19.226 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.217+0000 7f2392683640 1 --2- 172.21.15.148:0/2345515910 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b917c59410 0x55b917c63770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:19.226 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.217+0000 7f2392683640 1 -- 172.21.15.148:0/2345515910 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b917b64340 con 0x55b917c58af0 2024-09-19T07:20:19.226 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.217+0000 7f2392683640 1 --2- 172.21.15.148:0/2345515910 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b917c58af0 0x55b917c58ed0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f2384009ca0 tx=0x7f238402fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=887307b8ce35fc56 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:19.226 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.217+0000 7f2377fff640 1 -- 172.21.15.148:0/2345515910 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2384043050 con 0x55b917c58af0 2024-09-19T07:20:19.226 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.217+0000 7f2377fff640 1 -- 172.21.15.148:0/2345515910 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2384044040 con 0x55b917c58af0 2024-09-19T07:20:19.226 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.217+0000 7f2377fff640 1 -- 172.21.15.148:0/2345515910 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238404d020 con 0x55b917c58af0 2024-09-19T07:20:19.226 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.217+0000 7f2392683640 1 --2- 172.21.15.148:0/581609581 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f23780a34e0 0x7f23780a59a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f238404e000 tx=0x7f238404c000 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:19.226 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.218+0000 7f2396e7d740 1 -- 172.21.15.148:0/2345515910 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b917c58af0 msgr2=0x55b917c58ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:19.226 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.218+0000 7f2396e7d740 1 --2- 172.21.15.148:0/2345515910 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b917c58af0 0x55b917c58ed0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f2384009ca0 tx=0x7f238402fc60 comp rx=0 tx=0).stop 2024-09-19T07:20:19.226 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.218+0000 7f2396e7d740 1 -- 172.21.15.148:0/2345515910 shutdown_connections 2024-09-19T07:20:19.226 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.218+0000 7f2396e7d740 1 --2- 172.21.15.148:0/2345515910 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b917c63cb0 0x55b917c660a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.218+0000 7f2396e7d740 1 --2- 172.21.15.148:0/2345515910 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b917c59410 0x55b917c63770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.218+0000 7f2396e7d740 1 --2- 172.21.15.148:0/2345515910 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b917c58af0 0x55b917c58ed0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.218+0000 7f2396e7d740 1 -- 172.21.15.148:0/2345515910 >> 172.21.15.148:0/2345515910 conn(0x55b917c55060 msgr2=0x55b917c55440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.218+0000 7f2396e7d740 1 -- 172.21.15.148:0/2345515910 shutdown_connections 2024-09-19T07:20:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.218+0000 7f2396e7d740 1 -- 172.21.15.148:0/2345515910 wait complete. 2024-09-19T07:20:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.219+0000 7f2396e7d740 1 -- start start 2024-09-19T07:20:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.219+0000 7f2396e7d740 1 Processor -- start 2024-09-19T07:20:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.219+0000 7f2396e7d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b917c58af0 0x55b917c60b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.219+0000 7f2396e7d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b917c59410 0x55b917c61070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.219+0000 7f2396e7d740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b917c63cb0 0x55b917c615b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.219+0000 7f2396e7d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55b917c66880 con 0x55b917c58af0 2024-09-19T07:20:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.219+0000 7f2396e7d740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55b917b46290 con 0x55b917c63cb0 2024-09-19T07:20:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.219+0000 7f2396e7d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55b917c66a00 con 0x55b917c59410 2024-09-19T07:20:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.219+0000 7f2396e7d740 10 client.0 _ll_register_callbacks cb 0x55b917b77140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:20:19.228 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.219+0000 7f2391e82640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b917c58af0 0x55b917c60b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:19.228 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.219+0000 7f2391e82640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b917c58af0 0x55b917c60b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58254/0 (socket says 172.21.15.148:58254) 2024-09-19T07:20:19.228 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.219+0000 7f2391e82640 1 -- 172.21.15.148:0/2814603844 learned_addr learned my addr 172.21.15.148:0/2814603844 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:20:19.228 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.219+0000 7f2391681640 1 --2- 172.21.15.148:0/2814603844 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b917c59410 0x55b917c61070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:19.228 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.220+0000 7f2391e82640 1 -- 172.21.15.148:0/2814603844 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b917c59410 msgr2=0x55b917c61070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:20:19.228 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.220+0000 7f2391e82640 1 --2- 172.21.15.148:0/2814603844 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b917c59410 0x55b917c61070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:19.228 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.220+0000 7f2392683640 1 --2- 172.21.15.148:0/2814603844 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b917c63cb0 0x55b917c615b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:19.228 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.220+0000 7f2391e82640 1 -- 172.21.15.148:0/2814603844 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b917c63cb0 msgr2=0x55b917c615b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:20:19.228 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.220+0000 7f2391e82640 1 --2- 172.21.15.148:0/2814603844 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b917c63cb0 0x55b917c615b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:19.228 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.220+0000 7f2391e82640 1 -- 172.21.15.148:0/2814603844 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9178d0210 con 0x55b917c58af0 2024-09-19T07:20:19.228 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.220+0000 7f2392683640 1 --2- 172.21.15.148:0/2814603844 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b917c63cb0 0x55b917c615b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:20:19.228 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.220+0000 7f2391e82640 1 --2- 172.21.15.148:0/2814603844 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b917c58af0 0x55b917c60b30 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f2388012d20 tx=0x7f238800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1aab6e516f3c6cf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:19.228 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.220+0000 7f23757fa640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:20:19.229 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.220+0000 7f23757fa640 1 -- 172.21.15.148:0/2814603844 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2388012110 con 0x55b917c58af0 2024-09-19T07:20:19.229 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.220+0000 7f23757fa640 1 -- 172.21.15.148:0/2814603844 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8556+0+0 (secure 0 0 0) 0x7f2388004050 con 0x55b917c58af0 2024-09-19T07:20:19.229 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.220+0000 7f2396e7d740 1 -- 172.21.15.148:0/2814603844 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2384044040 con 0x55b917c58af0 2024-09-19T07:20:19.229 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.220+0000 7f23757fa640 1 -- 172.21.15.148:0/2814603844 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f23880122b0 con 0x55b917c58af0 2024-09-19T07:20:19.229 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.220+0000 7f2396e7d740 10 client.16917 fetch_fsmap learned FSMap version 42 2024-09-19T07:20:19.229 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.220+0000 7f2396e7d740 1 -- 172.21.15.148:0/2814603844 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55b91799c620 con 0x55b917c58af0 2024-09-19T07:20:19.229 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.220+0000 7f23757fa640 1 -- 172.21.15.148:0/2814603844 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2384044040 con 0x55b917c58af0 2024-09-19T07:20:19.229 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.220+0000 7f23757fa640 1 -- 172.21.15.148:0/2814603844 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 42) ==== 8366+0+0 (secure 0 0 0) 0x7f23880104c0 con 0x55b917c58af0 2024-09-19T07:20:19.229 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.220+0000 7f2396e7d740 10 client.16917 fetch_fsmap finished waiting for FSMap version 42 2024-09-19T07:20:19.229 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.220+0000 7f2396e7d740 10 client.16917 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:20:19.229 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.220+0000 7f2396e7d740 20 client.16917 populate_metadata read hostname 'smithi148' 2024-09-19T07:20:19.229 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.220+0000 7f2396e7d740 1 --2- 172.21.15.148:0/2814603844 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55b917c73be0 0x55b917c76030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:19.229 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.220+0000 7f2396e7d740 4 client.16917 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:20:19.230 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.220+0000 7f2396e7d740 1 -- 172.21.15.148:0/2814603844 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b917bcaa20 con 0x55b917c73be0 2024-09-19T07:20:19.230 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.221+0000 7f2391681640 1 --2- 172.21.15.148:0/2814603844 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55b917c73be0 0x55b917c76030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:19.230 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.221+0000 7f23757fa640 10 client.16917 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:20:19.230 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.221+0000 7f2391681640 1 --2- 172.21.15.148:0/2814603844 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55b917c73be0 0x55b917c76030 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a15440e2bf915ba5 server_cookie=bf7b90b094c537c5 in_seq=0 out_seq=0 2024-09-19T07:20:19.230 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.222+0000 7f23757fa640 1 -- 172.21.15.148:0/2814603844 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b917bcaa20 con 0x55b917c73be0 2024-09-19T07:20:19.230 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.222+0000 7f23757fa640 10 client.16917 handle_command_reply: tid=0 2024-09-19T07:20:19.230 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.222+0000 7f2396e7d740 1 client.16917 shutdown 2024-09-19T07:20:19.230 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.222+0000 7f2396e7d740 1 -- 172.21.15.148:0/2814603844 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b917c58af0 msgr2=0x55b917c60b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:19.230 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.222+0000 7f2396e7d740 1 --2- 172.21.15.148:0/2814603844 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b917c58af0 0x55b917c60b30 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f2388012d20 tx=0x7f238800f790 comp rx=0 tx=0).stop 2024-09-19T07:20:19.231 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.222+0000 7f2396e7d740 1 -- 172.21.15.148:0/2814603844 shutdown_connections 2024-09-19T07:20:19.231 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.222+0000 7f2396e7d740 1 --2- 172.21.15.148:0/2814603844 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55b917c73be0 0x55b917c76030 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:19.231 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.222+0000 7f2396e7d740 1 --2- 172.21.15.148:0/2814603844 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b917c63cb0 0x55b917c615b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:19.231 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.222+0000 7f2396e7d740 1 --2- 172.21.15.148:0/2814603844 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b917c59410 0x55b917c61070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:19.231 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.222+0000 7f2396e7d740 1 --2- 172.21.15.148:0/2814603844 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b917c58af0 0x55b917c60b30 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:19.231 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.222+0000 7f23757fa640 0 client.16917 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:20:19.231 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.222+0000 7f2396e7d740 1 -- 172.21.15.148:0/2814603844 >> 172.21.15.148:0/2814603844 conn(0x55b917c55060 msgr2=0x55b917c5adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:19.231 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.222+0000 7f2396e7d740 1 -- 172.21.15.148:0/2814603844 shutdown_connections 2024-09-19T07:20:19.231 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.222+0000 7f2396e7d740 1 -- 172.21.15.148:0/2814603844 wait complete. 2024-09-19T07:20:19.231 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.222+0000 7f2396e7d740 20 client.16917 trim_cache size 0 max 16384 2024-09-19T07:20:19.242 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.237+0000 7f2396e7d740 1 Processor -- start 2024-09-19T07:20:19.242 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.237+0000 7f2396e7d740 1 -- start start 2024-09-19T07:20:19.242 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.237+0000 7f2396e7d740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b917c58af0 0x55b917c5b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:19.242 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.237+0000 7f2396e7d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b917c59410 0x55b917c613e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:19.242 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.237+0000 7f2396e7d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b917c63cb0 0x55b917c6c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:19.242 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.237+0000 7f2396e7d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f238c1b0100 con 0x55b917c63cb0 2024-09-19T07:20:19.243 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.237+0000 7f2396e7d740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f238c1ad940 con 0x55b917c58af0 2024-09-19T07:20:19.243 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.237+0000 7f2396e7d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f238c1ab7b0 con 0x55b917c59410 2024-09-19T07:20:19.243 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.237+0000 7f2392683640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b917c63cb0 0x55b917c6c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:19.243 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.237+0000 7f2392683640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b917c63cb0 0x55b917c6c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58268/0 (socket says 172.21.15.148:58268) 2024-09-19T07:20:19.243 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.237+0000 7f2392683640 1 -- 172.21.15.148:0/2378900330 learned_addr learned my addr 172.21.15.148:0/2378900330 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:20:19.243 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.237+0000 7f2391e82640 1 --2- 172.21.15.148:0/2378900330 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b917c58af0 0x55b917c5b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:19.243 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.237+0000 7f2392683640 1 -- 172.21.15.148:0/2378900330 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b917c59410 msgr2=0x55b917c613e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:20:19.243 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.237+0000 7f2392683640 1 --2- 172.21.15.148:0/2378900330 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b917c59410 0x55b917c613e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:19.243 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.237+0000 7f2392683640 1 -- 172.21.15.148:0/2378900330 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b917c58af0 msgr2=0x55b917c5b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:20:19.243 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.237+0000 7f2392683640 1 --2- 172.21.15.148:0/2378900330 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b917c58af0 0x55b917c5b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:19.243 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.237+0000 7f2392683640 1 -- 172.21.15.148:0/2378900330 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b917c54e90 con 0x55b917c63cb0 2024-09-19T07:20:19.243 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.237+0000 7f2391e82640 1 --2- 172.21.15.148:0/2378900330 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b917c58af0 0x55b917c5b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:20:19.244 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.237+0000 7f2392683640 1 --2- 172.21.15.148:0/2378900330 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b917c63cb0 0x55b917c6c070 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f2384009600 tx=0x7f2384004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d34ba2cec83379e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:19.244 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.237+0000 7f23777fe640 1 -- 172.21.15.148:0/2378900330 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238404d050 con 0x55b917c63cb0 2024-09-19T07:20:19.244 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.237+0000 7f23777fe640 1 -- 172.21.15.148:0/2378900330 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f238402fe90 con 0x55b917c63cb0 2024-09-19T07:20:19.244 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.237+0000 7f23777fe640 1 -- 172.21.15.148:0/2378900330 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2384034040 con 0x55b917c63cb0 2024-09-19T07:20:19.244 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.238+0000 7f2396e7d740 1 -- 172.21.15.148:0/2378900330 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b917c63cb0 msgr2=0x55b917c6c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.238+0000 7f2396e7d740 1 --2- 172.21.15.148:0/2378900330 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b917c63cb0 0x55b917c6c070 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f2384009600 tx=0x7f2384004a40 comp rx=0 tx=0).stop 2024-09-19T07:20:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.238+0000 7f2396e7d740 1 -- 172.21.15.148:0/2378900330 shutdown_connections 2024-09-19T07:20:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.238+0000 7f2396e7d740 1 --2- 172.21.15.148:0/2378900330 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b917c63cb0 0x55b917c6c070 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.238+0000 7f2396e7d740 1 --2- 172.21.15.148:0/2378900330 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b917c59410 0x55b917c613e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.238+0000 7f2396e7d740 1 --2- 172.21.15.148:0/2378900330 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b917c58af0 0x55b917c5b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.238+0000 7f2396e7d740 1 -- 172.21.15.148:0/2378900330 >> 172.21.15.148:0/2378900330 conn(0x55b917c55060 msgr2=0x55b917c62bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.238+0000 7f2396e7d740 1 -- 172.21.15.148:0/2378900330 shutdown_connections 2024-09-19T07:20:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.238+0000 7f2396e7d740 1 -- 172.21.15.148:0/2378900330 wait complete. 2024-09-19T07:20:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.238+0000 7f2396e7d740 1 -- start start 2024-09-19T07:20:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.238+0000 7f2396e7d740 1 Processor -- start 2024-09-19T07:20:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.239+0000 7f2396e7d740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b917c58af0 0x55b917c64090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.239+0000 7f2396e7d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b917c59410 0x55b917c645d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.239+0000 7f2396e7d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b917c63cb0 0x55b917ce1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.239+0000 7f2396e7d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f238c1abe00 con 0x55b917c59410 2024-09-19T07:20:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.239+0000 7f2396e7d740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f238c1ad270 con 0x55b917c58af0 2024-09-19T07:20:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.239+0000 7f2396e7d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f238c1ac4d0 con 0x55b917c63cb0 2024-09-19T07:20:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.239+0000 7f2396e7d740 10 client.0 _ll_register_callbacks cb 0x7f2388009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:20:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.239+0000 7f2391681640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b917c59410 0x55b917c645d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.239+0000 7f2391681640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b917c59410 0x55b917c645d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58274/0 (socket says 172.21.15.148:58274) 2024-09-19T07:20:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.239+0000 7f2391681640 1 -- 172.21.15.148:0/4263702163 learned_addr learned my addr 172.21.15.148:0/4263702163 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:20:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.239+0000 7f2391e82640 1 --2- 172.21.15.148:0/4263702163 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b917c58af0 0x55b917c64090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.239+0000 7f2391681640 1 -- 172.21.15.148:0/4263702163 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b917c63cb0 msgr2=0x55b917ce1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:20:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.239+0000 7f2391681640 1 --2- 172.21.15.148:0/4263702163 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b917c63cb0 0x55b917ce1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.239+0000 7f2391681640 1 -- 172.21.15.148:0/4263702163 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b917c58af0 msgr2=0x55b917c64090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:20:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.239+0000 7f2391681640 1 --2- 172.21.15.148:0/4263702163 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b917c58af0 0x55b917c64090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.239+0000 7f2391681640 1 -- 172.21.15.148:0/4263702163 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b917c64ea0 con 0x55b917c59410 2024-09-19T07:20:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.239+0000 7f2391e82640 1 --2- 172.21.15.148:0/4263702163 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b917c58af0 0x55b917c64090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:20:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.239+0000 7f2391681640 1 --2- 172.21.15.148:0/4263702163 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b917c59410 0x55b917c645d0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f237c0049d0 tx=0x7f237c01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7296481f865ab563 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.239+0000 7f23757fa640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:20:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.240+0000 7f23757fa640 1 -- 172.21.15.148:0/4263702163 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237c096e60 con 0x55b917c59410 2024-09-19T07:20:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.240+0000 7f23757fa640 1 -- 172.21.15.148:0/4263702163 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8556+0+0 (secure 0 0 0) 0x7f237c098960 con 0x55b917c59410 2024-09-19T07:20:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.240+0000 7f2396e7d740 1 -- 172.21.15.148:0/4263702163 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b917bc4d70 con 0x55b917c59410 2024-09-19T07:20:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.240+0000 7f23757fa640 1 -- 172.21.15.148:0/4263702163 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f237c00a250 con 0x55b917c59410 2024-09-19T07:20:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.240+0000 7f2396e7d740 10 client.16923 fetch_fsmap learned FSMap version 42 2024-09-19T07:20:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.240+0000 7f2396e7d740 1 -- 172.21.15.148:0/4263702163 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55b917ce2f60 con 0x55b917c59410 2024-09-19T07:20:19.248 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.240+0000 7f23757fa640 1 -- 172.21.15.148:0/4263702163 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55b917bc4d70 con 0x55b917c59410 2024-09-19T07:20:19.248 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.240+0000 7f23757fa640 1 -- 172.21.15.148:0/4263702163 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 42) ==== 8366+0+0 (secure 0 0 0) 0x7f237c09c550 con 0x55b917c59410 2024-09-19T07:20:19.248 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.240+0000 7f2396e7d740 10 client.16923 fetch_fsmap finished waiting for FSMap version 42 2024-09-19T07:20:19.248 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.240+0000 7f2396e7d740 10 client.16923 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:20:19.248 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.240+0000 7f2396e7d740 20 client.16923 populate_metadata read hostname 'smithi148' 2024-09-19T07:20:19.248 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.240+0000 7f2396e7d740 1 --2- 172.21.15.148:0/4263702163 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55b917ce36a0 0x55b917ce5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:19.248 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.240+0000 7f2396e7d740 4 client.16923 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:20:19.248 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.240+0000 7f2396e7d740 1 -- 172.21.15.148:0/4263702163 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b917b41900 con 0x55b917ce36a0 2024-09-19T07:20:19.248 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.241+0000 7f2391e82640 1 --2- 172.21.15.148:0/4263702163 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55b917ce36a0 0x55b917ce5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:19.248 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.241+0000 7f2391e82640 1 --2- 172.21.15.148:0/4263702163 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55b917ce36a0 0x55b917ce5ac0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58bff6c262c43d5b server_cookie=b709b72be18d3fa9 in_seq=0 out_seq=0 2024-09-19T07:20:19.248 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.241+0000 7f23757fa640 10 client.16923 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:20:19.257 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.256+0000 7f23757fa640 1 -- 172.21.15.148:0/4263702163 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b917b41900 con 0x55b917ce36a0 2024-09-19T07:20:19.258 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.256+0000 7f23757fa640 10 client.16923 handle_command_reply: tid=0 2024-09-19T07:20:19.258 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.256+0000 7f2396e7d740 1 client.16923 shutdown 2024-09-19T07:20:19.258 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.256+0000 7f2396e7d740 1 -- 172.21.15.148:0/4263702163 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b917c59410 msgr2=0x55b917c645d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:19.258 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.256+0000 7f2396e7d740 1 --2- 172.21.15.148:0/4263702163 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b917c59410 0x55b917c645d0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f237c0049d0 tx=0x7f237c01d000 comp rx=0 tx=0).stop 2024-09-19T07:20:19.258 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.256+0000 7f2396e7d740 1 -- 172.21.15.148:0/4263702163 shutdown_connections 2024-09-19T07:20:19.258 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.256+0000 7f2396e7d740 1 --2- 172.21.15.148:0/4263702163 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55b917ce36a0 0x55b917ce5ac0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:19.258 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.256+0000 7f2396e7d740 1 --2- 172.21.15.148:0/4263702163 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b917c63cb0 0x55b917ce1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:19.258 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.256+0000 7f2396e7d740 1 --2- 172.21.15.148:0/4263702163 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b917c59410 0x55b917c645d0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:19.258 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.256+0000 7f23757fa640 0 client.16923 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:20:19.258 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.256+0000 7f2396e7d740 1 --2- 172.21.15.148:0/4263702163 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b917c58af0 0x55b917c64090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:19.258 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.256+0000 7f2396e7d740 1 -- 172.21.15.148:0/4263702163 >> 172.21.15.148:0/4263702163 conn(0x55b917c55060 msgr2=0x55b917c539a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:19.258 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.256+0000 7f2396e7d740 1 -- 172.21.15.148:0/4263702163 shutdown_connections 2024-09-19T07:20:19.259 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.256+0000 7f2396e7d740 1 -- 172.21.15.148:0/4263702163 wait complete. 2024-09-19T07:20:19.259 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.257+0000 7f2396e7d740 20 client.16923 trim_cache size 0 max 16384 2024-09-19T07:20:19.259 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:20:19.259 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:20:19.259 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:20:19.259 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:20:19.260 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.257+0000 7f23940e6640 1 -- 172.21.15.148:0/581609581 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f23780a34e0 msgr2=0x7f23780a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:19.260 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.257+0000 7f23940e6640 1 --2- 172.21.15.148:0/581609581 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f23780a34e0 0x7f23780a59a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f238404e000 tx=0x7f238404c000 comp rx=0 tx=0).stop 2024-09-19T07:20:19.260 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.257+0000 7f23940e6640 1 -- 172.21.15.148:0/581609581 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f238c103600 msgr2=0x7f238c198800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:19.260 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.257+0000 7f23940e6640 1 --2- 172.21.15.148:0/581609581 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f238c103600 0x7f238c198800 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f237c00e9f0 tx=0x7f237c00edf0 comp rx=0 tx=0).stop 2024-09-19T07:20:19.260 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.257+0000 7f23940e6640 1 -- 172.21.15.148:0/581609581 shutdown_connections 2024-09-19T07:20:19.260 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.257+0000 7f23940e6640 1 --2- 172.21.15.148:0/581609581 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f23780a34e0 0x7f23780a59a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:19.260 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.257+0000 7f23940e6640 1 --2- 172.21.15.148:0/581609581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f238c10c0b0 0x7f238c19cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:19.260 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.257+0000 7f23940e6640 1 --2- 172.21.15.148:0/581609581 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f238c103600 0x7f238c198800 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:19.261 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.257+0000 7f23940e6640 1 --2- 172.21.15.148:0/581609581 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f238c102ce0 0x7f238c1982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:19.261 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.257+0000 7f23940e6640 1 -- 172.21.15.148:0/581609581 >> 172.21.15.148:0/581609581 conn(0x7f238c077990 msgr2=0x7f238c0fcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:19.261 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.257+0000 7f23940e6640 1 -- 172.21.15.148:0/581609581 shutdown_connections 2024-09-19T07:20:19.261 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:19.257+0000 7f23940e6640 1 -- 172.21.15.148:0/581609581 wait complete. 2024-09-19T07:20:19.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:20:19 smithi179 ceph-mon[35716]: pgmap v286: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 307 KiB/s wr, 20 op/s 2024-09-19T07:20:19.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:20:19 smithi179 ceph-mon[35716]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T07:20:19.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:20:19 smithi148 ceph-mon[31180]: pgmap v286: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 307 KiB/s wr, 20 op/s 2024-09-19T07:20:19.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:20:19 smithi148 ceph-mon[31180]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T07:20:19.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:20:19 smithi165 ceph-mon[35326]: pgmap v286: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 307 KiB/s wr, 20 op/s 2024-09-19T07:20:19.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:20:19 smithi165 ceph-mon[35326]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T07:20:21.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:20:21 smithi179 ceph-mon[35716]: pgmap v288: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 325 KiB/s wr, 21 op/s 2024-09-19T07:20:21.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:20:21 smithi179 ceph-mon[35716]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:20:21.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:20:21 smithi148 ceph-mon[31180]: pgmap v288: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 325 KiB/s wr, 21 op/s 2024-09-19T07:20:21.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:20:21 smithi148 ceph-mon[31180]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:20:21.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:20:21 smithi165 ceph-mon[35326]: pgmap v288: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 325 KiB/s wr, 21 op/s 2024-09-19T07:20:21.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:20:21 smithi165 ceph-mon[35326]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:20:23.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:20:23 smithi179 ceph-mon[35716]: pgmap v289: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 324 KiB/s wr, 18 op/s 2024-09-19T07:20:23.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:20:23 smithi148 ceph-mon[31180]: pgmap v289: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 324 KiB/s wr, 18 op/s 2024-09-19T07:20:23.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:20:23 smithi165 ceph-mon[35326]: pgmap v289: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 324 KiB/s wr, 18 op/s 2024-09-19T07:20:25.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:20:25 smithi179 ceph-mon[35716]: pgmap v290: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 319 KiB/s wr, 18 op/s 2024-09-19T07:20:25.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:20:25 smithi148 ceph-mon[31180]: pgmap v290: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 319 KiB/s wr, 18 op/s 2024-09-19T07:20:25.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:20:25 smithi165 ceph-mon[35326]: pgmap v290: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 319 KiB/s wr, 18 op/s 2024-09-19T07:20:27.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:20:27 smithi179 ceph-mon[35716]: pgmap v291: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 37 KiB/s wr, 16 op/s 2024-09-19T07:20:27.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:20:27 smithi148 ceph-mon[31180]: pgmap v291: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 37 KiB/s wr, 16 op/s 2024-09-19T07:20:27.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:20:27 smithi165 ceph-mon[35326]: pgmap v291: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 37 KiB/s wr, 16 op/s 2024-09-19T07:20:29.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:20:29 smithi179 ceph-mon[35716]: pgmap v292: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 37 KiB/s wr, 16 op/s 2024-09-19T07:20:29.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:20:29 smithi148 ceph-mon[31180]: pgmap v292: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 37 KiB/s wr, 16 op/s 2024-09-19T07:20:29.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:20:29 smithi165 ceph-mon[35326]: pgmap v292: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 37 KiB/s wr, 16 op/s 2024-09-19T07:20:31.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:20:31 smithi179 ceph-mon[35716]: pgmap v293: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 30 KiB/s wr, 14 op/s 2024-09-19T07:20:31.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:20:31 smithi148 ceph-mon[31180]: pgmap v293: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 30 KiB/s wr, 14 op/s 2024-09-19T07:20:31.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:20:31 smithi165 ceph-mon[35326]: pgmap v293: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 30 KiB/s wr, 14 op/s 2024-09-19T07:20:32.357 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.354+0000 7f98c6752640 1 -- 172.21.15.148:0/4066841484 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f98c01080f0 msgr2=0x7f98c010ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:32.357 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.354+0000 7f98c6752640 1 --2- 172.21.15.148:0/4066841484 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f98c01080f0 0x7f98c010ea40 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f98b8009cd0 tx=0x7f98b802a970 comp rx=0 tx=0).stop 2024-09-19T07:20:32.357 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.354+0000 7f98c6752640 1 -- 172.21.15.148:0/4066841484 shutdown_connections 2024-09-19T07:20:32.357 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.354+0000 7f98c6752640 1 --2- 172.21.15.148:0/4066841484 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f98c01080f0 0x7f98c010ea40 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:32.357 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.354+0000 7f98c6752640 1 --2- 172.21.15.148:0/4066841484 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f98c0101150 0x7f98c0107990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:32.358 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.354+0000 7f98c6752640 1 --2- 172.21.15.148:0/4066841484 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98c0100830 0x7f98c0100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:32.358 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.354+0000 7f98c6752640 1 -- 172.21.15.148:0/4066841484 >> 172.21.15.148:0/4066841484 conn(0x7f98c0075f20 msgr2=0x7f98c0076330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:32.358 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.354+0000 7f98c6752640 1 -- 172.21.15.148:0/4066841484 shutdown_connections 2024-09-19T07:20:32.358 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.354+0000 7f98c6752640 1 -- 172.21.15.148:0/4066841484 wait complete. 2024-09-19T07:20:32.358 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.354+0000 7f98c6752640 1 Processor -- start 2024-09-19T07:20:32.358 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.355+0000 7f98c6752640 1 -- start start 2024-09-19T07:20:32.358 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.355+0000 7f98c6752640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f98c0100830 0x7f98c0198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:32.358 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.355+0000 7f98c6752640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98c0101150 0x7f98c0198770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:32.358 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.355+0000 7f98c6752640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f98c01080f0 0x7f98c019caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:32.358 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.355+0000 7f98c6752640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f98c0111f20 con 0x7f98c0100830 2024-09-19T07:20:32.358 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.355+0000 7f98c6752640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f98c0111da0 con 0x7f98c01080f0 2024-09-19T07:20:32.358 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.355+0000 7f98c6752640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f98c01120a0 con 0x7f98c0101150 2024-09-19T07:20:32.359 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.355+0000 7f98bffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f98c0100830 0x7f98c0198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:32.359 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.355+0000 7f98bffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f98c0100830 0x7f98c0198230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49524/0 (socket says 172.21.15.148:49524) 2024-09-19T07:20:32.359 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.355+0000 7f98bffff640 1 -- 172.21.15.148:0/3793923285 learned_addr learned my addr 172.21.15.148:0/3793923285 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:20:32.359 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.355+0000 7f98b7fff640 1 --2- 172.21.15.148:0/3793923285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98c0101150 0x7f98c0198770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:32.359 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.355+0000 7f98c4cef640 1 --2- 172.21.15.148:0/3793923285 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f98c01080f0 0x7f98c019caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:32.359 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.355+0000 7f98bffff640 1 -- 172.21.15.148:0/3793923285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98c0101150 msgr2=0x7f98c0198770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:32.359 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.355+0000 7f98bffff640 1 --2- 172.21.15.148:0/3793923285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98c0101150 0x7f98c0198770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:32.359 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.355+0000 7f98bffff640 1 -- 172.21.15.148:0/3793923285 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f98c01080f0 msgr2=0x7f98c019caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:32.359 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.355+0000 7f98bffff640 1 --2- 172.21.15.148:0/3793923285 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f98c01080f0 0x7f98c019caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:32.359 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.355+0000 7f98bffff640 1 -- 172.21.15.148:0/3793923285 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98c019d220 con 0x7f98c0100830 2024-09-19T07:20:32.359 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.355+0000 7f98c4cef640 1 --2- 172.21.15.148:0/3793923285 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f98c01080f0 0x7f98c019caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:20:32.359 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.355+0000 7f98bffff640 1 --2- 172.21.15.148:0/3793923285 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f98c0100830 0x7f98c0198230 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f98b000c920 tx=0x7f98b000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:32.359 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.356+0000 7f98bdffb640 1 -- 172.21.15.148:0/3793923285 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98b0007c70 con 0x7f98c0100830 2024-09-19T07:20:32.360 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.356+0000 7f98bdffb640 1 -- 172.21.15.148:0/3793923285 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98b0007e10 con 0x7f98c0100830 2024-09-19T07:20:32.360 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.356+0000 7f98c6752640 1 -- 172.21.15.148:0/3793923285 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98c019d510 con 0x7f98c0100830 2024-09-19T07:20:32.360 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.356+0000 7f98bdffb640 1 -- 172.21.15.148:0/3793923285 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98b0018890 con 0x7f98c0100830 2024-09-19T07:20:32.360 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.356+0000 7f98c6752640 1 -- 172.21.15.148:0/3793923285 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98c01a4da0 con 0x7f98c0100830 2024-09-19T07:20:32.366 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.358+0000 7f98bdffb640 1 -- 172.21.15.148:0/3793923285 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f98b0018a70 con 0x7f98c0100830 2024-09-19T07:20:32.366 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.358+0000 7f98c95cb740 1 Processor -- start 2024-09-19T07:20:32.366 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.358+0000 7f98c95cb740 1 -- start start 2024-09-19T07:20:32.366 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.358+0000 7f98c95cb740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5643976739d0 0x564397673db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:32.366 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.358+0000 7f98c95cb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5643976742f0 0x564397682b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:32.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.359+0000 7f98c95cb740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5643976830c0 0x5643976854b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:32.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.359+0000 7f98c95cb740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5643975d82f0 con 0x5643976830c0 2024-09-19T07:20:32.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.359+0000 7f98c95cb740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x564397580270 con 0x5643976739d0 2024-09-19T07:20:32.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.359+0000 7f98c95cb740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5643975d42b0 con 0x5643976742f0 2024-09-19T07:20:32.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.359+0000 7f98bdffb640 1 --2- 172.21.15.148:0/3793923285 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f98ac0a3460 0x7f98ac0a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:32.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.359+0000 7f98b7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5643976830c0 0x5643976854b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:32.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.359+0000 7f98b7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5643976830c0 0x5643976854b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49534/0 (socket says 172.21.15.148:49534) 2024-09-19T07:20:32.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.359+0000 7f98b7fff640 1 -- 172.21.15.148:0/867936330 learned_addr learned my addr 172.21.15.148:0/867936330 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:20:32.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.359+0000 7f98bffff640 1 --2- 172.21.15.148:0/867936330 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5643976742f0 0x564397682b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:32.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.359+0000 7f98c4cef640 1 --2- 172.21.15.148:0/867936330 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5643976739d0 0x564397673db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:32.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.359+0000 7f98c4cef640 1 --2- 172.21.15.148:0/3793923285 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f98ac0a3460 0x7f98ac0a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:32.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.359+0000 7f98bdffb640 1 -- 172.21.15.148:0/3793923285 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8556+0+0 (secure 0 0 0) 0x7f98b00cfe90 con 0x7f98c0100830 2024-09-19T07:20:32.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.359+0000 7f98b7fff640 1 -- 172.21.15.148:0/867936330 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5643976742f0 msgr2=0x564397682b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:20:32.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.359+0000 7f98b7fff640 1 --2- 172.21.15.148:0/867936330 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5643976742f0 0x564397682b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:32.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.359+0000 7f98b7fff640 1 -- 172.21.15.148:0/867936330 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5643976739d0 msgr2=0x564397673db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:20:32.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.359+0000 7f98b7fff640 1 --2- 172.21.15.148:0/867936330 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5643976739d0 0x564397673db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:32.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.359+0000 7f98b7fff640 1 -- 172.21.15.148:0/867936330 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56439757f340 con 0x5643976830c0 2024-09-19T07:20:32.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.359+0000 7f98b7fff640 1 --2- 172.21.15.148:0/867936330 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5643976830c0 0x5643976854b0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f98a8009c50 tx=0x7f98a8011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a78f55b0c85e0b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:32.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.359+0000 7f98c4cef640 1 --2- 172.21.15.148:0/3793923285 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f98ac0a3460 0x7f98ac0a5920 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f98b8004af0 tx=0x7f98b80095c0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:32.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.359+0000 7f98b67fc640 1 -- 172.21.15.148:0/867936330 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a8004050 con 0x5643976830c0 2024-09-19T07:20:32.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.359+0000 7f98b67fc640 1 -- 172.21.15.148:0/867936330 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98a8005500 con 0x5643976830c0 2024-09-19T07:20:32.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.360+0000 7f98b67fc640 1 -- 172.21.15.148:0/867936330 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a8004e00 con 0x5643976830c0 2024-09-19T07:20:32.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.360+0000 7f98c95cb740 1 -- 172.21.15.148:0/867936330 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5643976830c0 msgr2=0x5643976854b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:32.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.360+0000 7f98c95cb740 1 --2- 172.21.15.148:0/867936330 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5643976830c0 0x5643976854b0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f98a8009c50 tx=0x7f98a8011810 comp rx=0 tx=0).stop 2024-09-19T07:20:32.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.360+0000 7f98c95cb740 1 -- 172.21.15.148:0/867936330 shutdown_connections 2024-09-19T07:20:32.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.360+0000 7f98c95cb740 1 --2- 172.21.15.148:0/867936330 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5643976830c0 0x5643976854b0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:32.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.360+0000 7f98c95cb740 1 --2- 172.21.15.148:0/867936330 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5643976742f0 0x564397682b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:32.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.360+0000 7f98c95cb740 1 --2- 172.21.15.148:0/867936330 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5643976739d0 0x564397673db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:32.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.360+0000 7f98c95cb740 1 -- 172.21.15.148:0/867936330 >> 172.21.15.148:0/867936330 conn(0x564397670060 msgr2=0x564397670440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:32.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.360+0000 7f98c95cb740 1 -- 172.21.15.148:0/867936330 shutdown_connections 2024-09-19T07:20:32.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.360+0000 7f98c95cb740 1 -- 172.21.15.148:0/867936330 wait complete. 2024-09-19T07:20:32.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.361+0000 7f98c95cb740 1 -- start start 2024-09-19T07:20:32.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.361+0000 7f98c95cb740 1 Processor -- start 2024-09-19T07:20:32.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.361+0000 7f98c95cb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5643976739d0 0x564397680000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:32.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.361+0000 7f98c95cb740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5643976742f0 0x564397680540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:32.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.361+0000 7f98c95cb740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5643976830c0 0x564397680a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:32.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.361+0000 7f98c95cb740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x564397685cf0 con 0x5643976742f0 2024-09-19T07:20:32.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.361+0000 7f98c95cb740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x564397561290 con 0x5643976830c0 2024-09-19T07:20:32.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.361+0000 7f98c95cb740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564397685e70 con 0x5643976739d0 2024-09-19T07:20:32.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.361+0000 7f98c95cb740 10 client.0 _ll_register_callbacks cb 0x564397592140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:20:32.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.361+0000 7f98b7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5643976742f0 0x564397680540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:32.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.361+0000 7f98b7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5643976742f0 0x564397680540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49546/0 (socket says 172.21.15.148:49546) 2024-09-19T07:20:32.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.361+0000 7f98b7fff640 1 -- 172.21.15.148:0/3642025278 learned_addr learned my addr 172.21.15.148:0/3642025278 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:20:32.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.361+0000 7f98c4cef640 1 --2- 172.21.15.148:0/3642025278 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5643976830c0 0x564397680a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:32.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.362+0000 7f98bffff640 1 --2- 172.21.15.148:0/3642025278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5643976739d0 0x564397680000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:32.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.362+0000 7f98b7fff640 1 -- 172.21.15.148:0/3642025278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5643976739d0 msgr2=0x564397680000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:20:32.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.362+0000 7f98b7fff640 1 --2- 172.21.15.148:0/3642025278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5643976739d0 0x564397680000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:32.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.362+0000 7f98b7fff640 1 -- 172.21.15.148:0/3642025278 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5643976830c0 msgr2=0x564397680a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:20:32.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.362+0000 7f98b7fff640 1 --2- 172.21.15.148:0/3642025278 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5643976830c0 0x564397680a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:32.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.362+0000 7f98b7fff640 1 -- 172.21.15.148:0/3642025278 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643972eb210 con 0x5643976742f0 2024-09-19T07:20:32.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.362+0000 7f98bffff640 1 --2- 172.21.15.148:0/3642025278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5643976739d0 0x564397680000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:20:32.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.362+0000 7f98b7fff640 1 --2- 172.21.15.148:0/3642025278 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5643976742f0 0x564397680540 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f98a8004ae0 tx=0x7f98a8005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f6e30a218bda8c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:32.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.362+0000 7f989f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:20:32.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.362+0000 7f989f7fe640 1 -- 172.21.15.148:0/3642025278 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a8027070 con 0x5643976742f0 2024-09-19T07:20:32.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.362+0000 7f989f7fe640 1 -- 172.21.15.148:0/3642025278 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8556+0+0 (secure 0 0 0) 0x7f98a8004d80 con 0x5643976742f0 2024-09-19T07:20:32.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.362+0000 7f98c95cb740 1 -- 172.21.15.148:0/3642025278 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98a8005500 con 0x5643976742f0 2024-09-19T07:20:32.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.362+0000 7f989f7fe640 1 -- 172.21.15.148:0/3642025278 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f98a8033050 con 0x5643976742f0 2024-09-19T07:20:32.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.362+0000 7f98c95cb740 10 client.16935 fetch_fsmap learned FSMap version 43 2024-09-19T07:20:32.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.362+0000 7f98c95cb740 1 -- 172.21.15.148:0/3642025278 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x5643973b7620 con 0x5643976742f0 2024-09-19T07:20:32.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.362+0000 7f989f7fe640 1 -- 172.21.15.148:0/3642025278 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98a8005500 con 0x5643976742f0 2024-09-19T07:20:32.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.362+0000 7f989f7fe640 1 -- 172.21.15.148:0/3642025278 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 43) ==== 8362+0+0 (secure 0 0 0) 0x7f98a8023460 con 0x5643976742f0 2024-09-19T07:20:32.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.363+0000 7f98c95cb740 10 client.16935 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T07:20:32.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.363+0000 7f98c95cb740 10 client.16935 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:20:32.371 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.363+0000 7f98c95cb740 20 client.16935 populate_metadata read hostname 'smithi148' 2024-09-19T07:20:32.372 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.363+0000 7f98c95cb740 1 --2- 172.21.15.148:0/3642025278 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x564397692f80 0x564397695370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:32.372 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.363+0000 7f98c95cb740 4 client.16935 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:20:32.372 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.363+0000 7f98c95cb740 1 -- 172.21.15.148:0/3642025278 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5643975e5a20 con 0x564397692f80 2024-09-19T07:20:32.372 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.363+0000 7f98bffff640 1 --2- 172.21.15.148:0/3642025278 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x564397692f80 0x564397695370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:32.372 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.363+0000 7f98bffff640 1 --2- 172.21.15.148:0/3642025278 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x564397692f80 0x564397695370 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9906fbbfceda6e03 server_cookie=ef1308a4d8f0b610 in_seq=0 out_seq=0 2024-09-19T07:20:32.372 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.363+0000 7f989f7fe640 10 client.16935 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:20:32.372 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.364+0000 7f989f7fe640 1 -- 172.21.15.148:0/3642025278 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5643975e5a20 con 0x564397692f80 2024-09-19T07:20:32.372 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.364+0000 7f989f7fe640 10 client.16935 handle_command_reply: tid=0 2024-09-19T07:20:32.372 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.364+0000 7f98c95cb740 1 client.16935 shutdown 2024-09-19T07:20:32.372 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.364+0000 7f98c95cb740 1 -- 172.21.15.148:0/3642025278 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5643976742f0 msgr2=0x564397680540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:32.372 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.364+0000 7f98c95cb740 1 --2- 172.21.15.148:0/3642025278 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5643976742f0 0x564397680540 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f98a8004ae0 tx=0x7f98a8005db0 comp rx=0 tx=0).stop 2024-09-19T07:20:32.372 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.364+0000 7f98c95cb740 1 -- 172.21.15.148:0/3642025278 shutdown_connections 2024-09-19T07:20:32.373 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.364+0000 7f98c95cb740 1 --2- 172.21.15.148:0/3642025278 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x564397692f80 0x564397695370 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:32.373 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.364+0000 7f98c95cb740 1 --2- 172.21.15.148:0/3642025278 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5643976830c0 0x564397680a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:32.373 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.364+0000 7f989f7fe640 0 client.16935 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:20:32.373 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.364+0000 7f98c95cb740 1 --2- 172.21.15.148:0/3642025278 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5643976742f0 0x564397680540 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:32.373 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.364+0000 7f98c95cb740 1 --2- 172.21.15.148:0/3642025278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5643976739d0 0x564397680000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:32.373 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.364+0000 7f98c95cb740 1 -- 172.21.15.148:0/3642025278 >> 172.21.15.148:0/3642025278 conn(0x564397670060 msgr2=0x56439766f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:32.373 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.364+0000 7f98c95cb740 1 -- 172.21.15.148:0/3642025278 shutdown_connections 2024-09-19T07:20:32.373 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.364+0000 7f98c95cb740 1 -- 172.21.15.148:0/3642025278 wait complete. 2024-09-19T07:20:32.373 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.365+0000 7f98c95cb740 20 client.16935 trim_cache size 0 max 16384 2024-09-19T07:20:32.381 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.379+0000 7f98c95cb740 1 Processor -- start 2024-09-19T07:20:32.381 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.379+0000 7f98c95cb740 1 -- start start 2024-09-19T07:20:32.381 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.379+0000 7f98c95cb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5643976739d0 0x56439766f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:32.382 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.379+0000 7f98c95cb740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5643976742f0 0x56439769aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:32.382 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.379+0000 7f98c95cb740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5643976830c0 0x56439769b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:32.382 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.379+0000 7f98c95cb740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f98c01ade70 con 0x5643976742f0 2024-09-19T07:20:32.382 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.379+0000 7f98c95cb740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f98c01ab6e0 con 0x5643976830c0 2024-09-19T07:20:32.382 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.379+0000 7f98c95cb740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f98c01a9570 con 0x5643976739d0 2024-09-19T07:20:32.382 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.379+0000 7f98b7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5643976742f0 0x56439769aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:32.382 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.379+0000 7f98b7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5643976742f0 0x56439769aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49558/0 (socket says 172.21.15.148:49558) 2024-09-19T07:20:32.382 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.379+0000 7f98b7fff640 1 -- 172.21.15.148:0/3298449639 learned_addr learned my addr 172.21.15.148:0/3298449639 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:20:32.382 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.379+0000 7f98c4cef640 1 --2- 172.21.15.148:0/3298449639 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5643976830c0 0x56439769b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:32.382 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.379+0000 7f98b7fff640 1 -- 172.21.15.148:0/3298449639 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5643976739d0 msgr2=0x56439766f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:20:32.382 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.379+0000 7f98b7fff640 1 --2- 172.21.15.148:0/3298449639 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5643976739d0 0x56439766f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:32.382 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.379+0000 7f98b7fff640 1 -- 172.21.15.148:0/3298449639 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5643976830c0 msgr2=0x56439769b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:20:32.382 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.379+0000 7f98b7fff640 1 --2- 172.21.15.148:0/3298449639 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5643976830c0 0x56439769b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:32.383 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.379+0000 7f98b7fff640 1 -- 172.21.15.148:0/3298449639 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564397685bd0 con 0x5643976742f0 2024-09-19T07:20:32.383 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.379+0000 7f98c4cef640 1 --2- 172.21.15.148:0/3298449639 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5643976830c0 0x56439769b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:20:32.383 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.379+0000 7f98b7fff640 1 --2- 172.21.15.148:0/3298449639 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5643976742f0 0x56439769aae0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f98a8023a20 tx=0x7f98a8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d30be438173c0928 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:32.383 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.380+0000 7f98b5ffb640 1 -- 172.21.15.148:0/3298449639 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a8027040 con 0x5643976742f0 2024-09-19T07:20:32.383 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.380+0000 7f98b5ffb640 1 -- 172.21.15.148:0/3298449639 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98a8023aa0 con 0x5643976742f0 2024-09-19T07:20:32.383 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.380+0000 7f98b5ffb640 1 -- 172.21.15.148:0/3298449639 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a8003d10 con 0x5643976742f0 2024-09-19T07:20:32.383 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.380+0000 7f98c95cb740 1 -- 172.21.15.148:0/3298449639 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5643976742f0 msgr2=0x56439769aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:32.383 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.380+0000 7f98c95cb740 1 --2- 172.21.15.148:0/3298449639 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5643976742f0 0x56439769aae0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f98a8023a20 tx=0x7f98a8000bc0 comp rx=0 tx=0).stop 2024-09-19T07:20:32.383 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.380+0000 7f98c95cb740 1 -- 172.21.15.148:0/3298449639 shutdown_connections 2024-09-19T07:20:32.383 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.380+0000 7f98c95cb740 1 --2- 172.21.15.148:0/3298449639 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5643976830c0 0x56439769b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:32.383 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.380+0000 7f98c95cb740 1 --2- 172.21.15.148:0/3298449639 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5643976742f0 0x56439769aae0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:32.383 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.380+0000 7f98c95cb740 1 --2- 172.21.15.148:0/3298449639 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5643976739d0 0x56439766f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:32.383 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.380+0000 7f98c95cb740 1 -- 172.21.15.148:0/3298449639 >> 172.21.15.148:0/3298449639 conn(0x564397670060 msgr2=0x56439766e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:32.384 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.380+0000 7f98c95cb740 1 -- 172.21.15.148:0/3298449639 shutdown_connections 2024-09-19T07:20:32.384 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.380+0000 7f98c95cb740 1 -- 172.21.15.148:0/3298449639 wait complete. 2024-09-19T07:20:32.384 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.381+0000 7f98c95cb740 1 -- start start 2024-09-19T07:20:32.384 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.381+0000 7f98c95cb740 1 Processor -- start 2024-09-19T07:20:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.381+0000 7f98c95cb740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5643976739d0 0x56439768b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:32.387 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.381+0000 7f98c95cb740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5643976742f0 0x56439768b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:32.387 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.381+0000 7f98c95cb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5643976830c0 0x5643976880a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:32.387 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.381+0000 7f98c95cb740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f98c01a9bc0 con 0x5643976742f0 2024-09-19T07:20:32.387 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.381+0000 7f98c95cb740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f98c01ab010 con 0x5643976739d0 2024-09-19T07:20:32.387 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.381+0000 7f98c95cb740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f98c01aa270 con 0x5643976830c0 2024-09-19T07:20:32.387 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.381+0000 7f98c95cb740 10 client.0 _ll_register_callbacks cb 0x7f98a8009a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:20:32.387 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.381+0000 7f98b7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5643976742f0 0x56439768b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:32.387 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.381+0000 7f98b7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5643976742f0 0x56439768b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49566/0 (socket says 172.21.15.148:49566) 2024-09-19T07:20:32.387 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.381+0000 7f98b7fff640 1 -- 172.21.15.148:0/4195904038 learned_addr learned my addr 172.21.15.148:0/4195904038 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:20:32.387 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.381+0000 7f98bffff640 1 --2- 172.21.15.148:0/4195904038 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5643976739d0 0x56439768b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:32.387 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.381+0000 7f98b7fff640 1 -- 172.21.15.148:0/4195904038 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5643976830c0 msgr2=0x5643976880a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:20:32.387 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.382+0000 7f98b7fff640 1 --2- 172.21.15.148:0/4195904038 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5643976830c0 0x5643976880a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:32.387 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.382+0000 7f98b7fff640 1 -- 172.21.15.148:0/4195904038 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5643976739d0 msgr2=0x56439768b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:20:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.382+0000 7f98b7fff640 1 --2- 172.21.15.148:0/4195904038 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5643976739d0 0x56439768b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.382+0000 7f98b7fff640 1 -- 172.21.15.148:0/4195904038 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643976885e0 con 0x5643976742f0 2024-09-19T07:20:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.382+0000 7f98bffff640 1 --2- 172.21.15.148:0/4195904038 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5643976739d0 0x56439768b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:20:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.382+0000 7f98b7fff640 1 --2- 172.21.15.148:0/4195904038 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5643976742f0 0x56439768b610 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f98a80239a0 tx=0x7f98a8023e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=354a28dcda59a0d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.382+0000 7f989f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:20:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.382+0000 7f989f7fe640 1 -- 172.21.15.148:0/4195904038 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a8045060 con 0x5643976742f0 2024-09-19T07:20:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.382+0000 7f989f7fe640 1 -- 172.21.15.148:0/4195904038 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8556+0+0 (secure 0 0 0) 0x7f98a80035f0 con 0x5643976742f0 2024-09-19T07:20:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.382+0000 7f98c95cb740 1 -- 172.21.15.148:0/4195904038 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98a8023aa0 con 0x5643976742f0 2024-09-19T07:20:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.382+0000 7f989f7fe640 1 -- 172.21.15.148:0/4195904038 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f98a8027040 con 0x5643976742f0 2024-09-19T07:20:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.382+0000 7f98c95cb740 10 client.16941 fetch_fsmap learned FSMap version 43 2024-09-19T07:20:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.382+0000 7f98c95cb740 1 -- 172.21.15.148:0/4195904038 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x5643976fe150 con 0x5643976742f0 2024-09-19T07:20:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.382+0000 7f989f7fe640 1 -- 172.21.15.148:0/4195904038 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98a8023aa0 con 0x5643976742f0 2024-09-19T07:20:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.382+0000 7f989f7fe640 1 -- 172.21.15.148:0/4195904038 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 43) ==== 8362+0+0 (secure 0 0 0) 0x7f98a802c670 con 0x5643976742f0 2024-09-19T07:20:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.382+0000 7f98c95cb740 10 client.16941 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T07:20:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.382+0000 7f98c95cb740 10 client.16941 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:20:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.382+0000 7f98c95cb740 20 client.16941 populate_metadata read hostname 'smithi148' 2024-09-19T07:20:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.382+0000 7f98c95cb740 1 --2- 172.21.15.148:0/4195904038 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x564397692f80 0x5643977008e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.382+0000 7f98c95cb740 4 client.16941 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:20:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.382+0000 7f98c95cb740 1 -- 172.21.15.148:0/4195904038 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5643975dfd70 con 0x564397692f80 2024-09-19T07:20:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.383+0000 7f98bffff640 1 --2- 172.21.15.148:0/4195904038 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x564397692f80 0x5643977008e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.383+0000 7f98bffff640 1 --2- 172.21.15.148:0/4195904038 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x564397692f80 0x5643977008e0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a474162670e6d082 server_cookie=c77bbd0e7b866ecd in_seq=0 out_seq=0 2024-09-19T07:20:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.383+0000 7f989f7fe640 10 client.16941 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:20:32.396 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.395+0000 7f989f7fe640 1 -- 172.21.15.148:0/4195904038 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5643975dfd70 con 0x564397692f80 2024-09-19T07:20:32.396 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.395+0000 7f989f7fe640 10 client.16941 handle_command_reply: tid=0 2024-09-19T07:20:32.397 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.395+0000 7f98c95cb740 1 client.16941 shutdown 2024-09-19T07:20:32.397 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.395+0000 7f98c95cb740 1 -- 172.21.15.148:0/4195904038 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5643976742f0 msgr2=0x56439768b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:32.397 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.395+0000 7f98c95cb740 1 --2- 172.21.15.148:0/4195904038 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5643976742f0 0x56439768b610 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f98a80239a0 tx=0x7f98a8023e80 comp rx=0 tx=0).stop 2024-09-19T07:20:32.397 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.395+0000 7f98c95cb740 1 -- 172.21.15.148:0/4195904038 shutdown_connections 2024-09-19T07:20:32.397 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.395+0000 7f98c95cb740 1 --2- 172.21.15.148:0/4195904038 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x564397692f80 0x5643977008e0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:32.397 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.395+0000 7f98c95cb740 1 --2- 172.21.15.148:0/4195904038 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5643976830c0 0x5643976880a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:32.397 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.395+0000 7f98c95cb740 1 --2- 172.21.15.148:0/4195904038 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5643976742f0 0x56439768b610 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:32.397 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.395+0000 7f98c95cb740 1 --2- 172.21.15.148:0/4195904038 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5643976739d0 0x56439768b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:32.397 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.395+0000 7f989f7fe640 0 client.16941 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:20:32.397 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.395+0000 7f98c95cb740 1 -- 172.21.15.148:0/4195904038 >> 172.21.15.148:0/4195904038 conn(0x564397670060 msgr2=0x56439766f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:32.397 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.396+0000 7f98c95cb740 1 -- 172.21.15.148:0/4195904038 shutdown_connections 2024-09-19T07:20:32.398 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.396+0000 7f98c95cb740 1 -- 172.21.15.148:0/4195904038 wait complete. 2024-09-19T07:20:32.398 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.396+0000 7f98c95cb740 20 client.16941 trim_cache size 0 max 16384 2024-09-19T07:20:32.398 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:20:32.398 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:20:32.398 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:20:32.398 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:20:32.399 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.396+0000 7f98c6752640 1 -- 172.21.15.148:0/3793923285 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f98ac0a3460 msgr2=0x7f98ac0a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:32.399 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.396+0000 7f98c6752640 1 --2- 172.21.15.148:0/3793923285 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f98ac0a3460 0x7f98ac0a5920 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f98b8004af0 tx=0x7f98b80095c0 comp rx=0 tx=0).stop 2024-09-19T07:20:32.399 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.396+0000 7f98c6752640 1 -- 172.21.15.148:0/3793923285 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f98c0100830 msgr2=0x7f98c0198230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:32.399 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.396+0000 7f98c6752640 1 --2- 172.21.15.148:0/3793923285 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f98c0100830 0x7f98c0198230 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f98b000c920 tx=0x7f98b000cde0 comp rx=0 tx=0).stop 2024-09-19T07:20:32.399 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.396+0000 7f98c6752640 1 -- 172.21.15.148:0/3793923285 shutdown_connections 2024-09-19T07:20:32.399 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.396+0000 7f98c6752640 1 --2- 172.21.15.148:0/3793923285 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f98ac0a3460 0x7f98ac0a5920 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:32.399 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.396+0000 7f98c6752640 1 --2- 172.21.15.148:0/3793923285 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f98c01080f0 0x7f98c019caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:32.399 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.396+0000 7f98c6752640 1 --2- 172.21.15.148:0/3793923285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98c0101150 0x7f98c0198770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:32.399 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.396+0000 7f98c6752640 1 --2- 172.21.15.148:0/3793923285 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f98c0100830 0x7f98c0198230 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:32.400 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.396+0000 7f98c6752640 1 -- 172.21.15.148:0/3793923285 >> 172.21.15.148:0/3793923285 conn(0x7f98c0075f20 msgr2=0x7f98c00ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:32.400 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.396+0000 7f98c6752640 1 -- 172.21.15.148:0/3793923285 shutdown_connections 2024-09-19T07:20:32.400 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:32.396+0000 7f98c6752640 1 -- 172.21.15.148:0/3793923285 wait complete. 2024-09-19T07:20:33.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:20:33 smithi179 ceph-mon[35716]: pgmap v294: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 33 KiB/s wr, 17 op/s 2024-09-19T07:20:33.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:20:33 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:20:33.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:20:33 smithi148 ceph-mon[31180]: pgmap v294: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 33 KiB/s wr, 17 op/s 2024-09-19T07:20:33.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:20:33 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:20:33.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:20:33 smithi165 ceph-mon[35326]: pgmap v294: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 33 KiB/s wr, 17 op/s 2024-09-19T07:20:33.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:20:33 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:20:34.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:20:34 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:20:34.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:20:34 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:20:34.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:20:34 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:20:34.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:20:34 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:20:34.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:20:34 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:20:34.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:20:34 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:20:34.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:20:34 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:20:34.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:20:34 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:20:34.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:20:34 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:20:35.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:20:35 smithi179 ceph-mon[35716]: pgmap v295: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 28 KiB/s wr, 11 op/s 2024-09-19T07:20:35.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:20:35 smithi148 ceph-mon[31180]: pgmap v295: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 28 KiB/s wr, 11 op/s 2024-09-19T07:20:35.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:20:35 smithi165 ceph-mon[35326]: pgmap v295: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 28 KiB/s wr, 11 op/s 2024-09-19T07:20:37.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:20:37 smithi179 ceph-mon[35716]: pgmap v296: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 32 KiB/s wr, 16 op/s 2024-09-19T07:20:37.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:20:37 smithi148 ceph-mon[31180]: pgmap v296: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 32 KiB/s wr, 16 op/s 2024-09-19T07:20:37.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:20:37 smithi165 ceph-mon[35326]: pgmap v296: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 32 KiB/s wr, 16 op/s 2024-09-19T07:20:39.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:20:39 smithi179 ceph-mon[35716]: pgmap v297: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 KiB/s wr, 12 op/s 2024-09-19T07:20:39.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:20:39 smithi148 ceph-mon[31180]: pgmap v297: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 KiB/s wr, 12 op/s 2024-09-19T07:20:39.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:20:39 smithi165 ceph-mon[35326]: pgmap v297: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 KiB/s wr, 12 op/s 2024-09-19T07:20:41.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:20:41 smithi179 ceph-mon[35716]: pgmap v298: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 KiB/s wr, 12 op/s 2024-09-19T07:20:41.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:20:41 smithi148 ceph-mon[31180]: pgmap v298: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 KiB/s wr, 12 op/s 2024-09-19T07:20:41.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:20:41 smithi165 ceph-mon[35326]: pgmap v298: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 25 KiB/s wr, 12 op/s 2024-09-19T07:20:43.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:20:43 smithi179 ceph-mon[35716]: pgmap v299: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 KiB/s wr, 15 op/s 2024-09-19T07:20:43.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:20:43 smithi148 ceph-mon[31180]: pgmap v299: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 KiB/s wr, 15 op/s 2024-09-19T07:20:43.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:20:43 smithi165 ceph-mon[35326]: pgmap v299: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 KiB/s wr, 15 op/s 2024-09-19T07:20:45.497 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.493+0000 7f1b0c781640 1 -- 172.21.15.148:0/558614276 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b04101370 msgr2=0x7f1b0410d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:45.497 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.493+0000 7f1b0c781640 1 --2- 172.21.15.148:0/558614276 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b04101370 0x7f1b0410d8a0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f1afc009cd0 tx=0x7f1afc02a8e0 comp rx=0 tx=0).stop 2024-09-19T07:20:45.497 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.493+0000 7f1b0c781640 1 -- 172.21.15.148:0/558614276 shutdown_connections 2024-09-19T07:20:45.497 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.493+0000 7f1b0c781640 1 --2- 172.21.15.148:0/558614276 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b04101370 0x7f1b0410d8a0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:45.497 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.493+0000 7f1b0c781640 1 --2- 172.21.15.148:0/558614276 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b041009d0 0x7f1b04100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.493+0000 7f1b0c781640 1 --2- 172.21.15.148:0/558614276 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b041069e0 0x7f1b04106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.493+0000 7f1b0c781640 1 -- 172.21.15.148:0/558614276 >> 172.21.15.148:0/558614276 conn(0x7f1b040fc6f0 msgr2=0x7f1b040feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.493+0000 7f1b0c781640 1 -- 172.21.15.148:0/558614276 shutdown_connections 2024-09-19T07:20:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.493+0000 7f1b0c781640 1 -- 172.21.15.148:0/558614276 wait complete. 2024-09-19T07:20:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.494+0000 7f1b0c781640 1 Processor -- start 2024-09-19T07:20:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.494+0000 7f1b0c781640 1 -- start start 2024-09-19T07:20:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.494+0000 7f1b0c781640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b041009d0 0x7f1b041982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.494+0000 7f1b0c781640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b04101370 0x7f1b04198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.494+0000 7f1b0c781640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b041069e0 0x7f1b0419cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.494+0000 7f1b0c781640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1b04110e20 con 0x7f1b04101370 2024-09-19T07:20:45.499 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.494+0000 7f1b0c781640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1b04110ca0 con 0x7f1b041009d0 2024-09-19T07:20:45.499 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.494+0000 7f1b0c781640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1b04110fa0 con 0x7f1b041069e0 2024-09-19T07:20:45.499 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.495+0000 7f1b09d1c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b04101370 0x7f1b04198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:45.499 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.495+0000 7f1b09d1c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b04101370 0x7f1b04198800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44964/0 (socket says 172.21.15.148:44964) 2024-09-19T07:20:45.499 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.495+0000 7f1b09d1c640 1 -- 172.21.15.148:0/3100262008 learned_addr learned my addr 172.21.15.148:0/3100262008 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:20:45.499 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.495+0000 7f1b0a51d640 1 --2- 172.21.15.148:0/3100262008 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b041009d0 0x7f1b041982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:45.499 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.495+0000 7f1b0ad1e640 1 --2- 172.21.15.148:0/3100262008 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b041069e0 0x7f1b0419cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:45.499 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.495+0000 7f1b09d1c640 1 -- 172.21.15.148:0/3100262008 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b041069e0 msgr2=0x7f1b0419cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:45.499 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.495+0000 7f1b09d1c640 1 --2- 172.21.15.148:0/3100262008 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b041069e0 0x7f1b0419cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:45.499 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.495+0000 7f1b09d1c640 1 -- 172.21.15.148:0/3100262008 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b041009d0 msgr2=0x7f1b041982c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:45.499 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.495+0000 7f1b09d1c640 1 --2- 172.21.15.148:0/3100262008 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b041009d0 0x7f1b041982c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:45.499 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.495+0000 7f1b09d1c640 1 -- 172.21.15.148:0/3100262008 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b0419d2b0 con 0x7f1b04101370 2024-09-19T07:20:45.500 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.495+0000 7f1b09d1c640 1 --2- 172.21.15.148:0/3100262008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b04101370 0x7f1b04198800 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f1af400c890 tx=0x7f1af400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:45.500 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.495+0000 7f1afb7fe640 1 -- 172.21.15.148:0/3100262008 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af4004220 con 0x7f1b04101370 2024-09-19T07:20:45.500 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.495+0000 7f1afb7fe640 1 -- 172.21.15.148:0/3100262008 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1af40043c0 con 0x7f1b04101370 2024-09-19T07:20:45.500 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.495+0000 7f1b0c781640 1 -- 172.21.15.148:0/3100262008 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b0419d5a0 con 0x7f1b04101370 2024-09-19T07:20:45.500 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.495+0000 7f1afb7fe640 1 -- 172.21.15.148:0/3100262008 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af4004a00 con 0x7f1b04101370 2024-09-19T07:20:45.500 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.495+0000 7f1b0c781640 1 -- 172.21.15.148:0/3100262008 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b041a4e30 con 0x7f1b04101370 2024-09-19T07:20:45.507 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.498+0000 7f1afb7fe640 1 -- 172.21.15.148:0/3100262008 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f1af40079b0 con 0x7f1b04101370 2024-09-19T07:20:45.507 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.498+0000 7f1b0f5f3740 1 Processor -- start 2024-09-19T07:20:45.508 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.498+0000 7f1b0f5f3740 1 -- start start 2024-09-19T07:20:45.508 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.498+0000 7f1b0f5f3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558832a11af0 0x558832a11ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:45.508 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.498+0000 7f1b0f5f3740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558832a12410 0x558832a1c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:45.508 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.498+0000 7f1b0f5f3740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558832a1ccb0 0x558832a1f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:45.508 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.498+0000 7f1b0f5f3740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5588329762f0 con 0x558832a1ccb0 2024-09-19T07:20:45.508 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.498+0000 7f1b0f5f3740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55883291e270 con 0x558832a12410 2024-09-19T07:20:45.508 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.498+0000 7f1b0f5f3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5588329722b0 con 0x558832a11af0 2024-09-19T07:20:45.508 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.499+0000 7f1afb7fe640 1 --2- 172.21.15.148:0/3100262008 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f1af00a34e0 0x7f1af00a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:45.508 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.499+0000 7f1b09d1c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558832a1ccb0 0x558832a1f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:45.508 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.499+0000 7f1b0a51d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558832a12410 0x558832a1c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:45.508 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.499+0000 7f1b09d1c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558832a1ccb0 0x558832a1f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44978/0 (socket says 172.21.15.148:44978) 2024-09-19T07:20:45.509 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.499+0000 7f1b0a51d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558832a12410 0x558832a1c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:60702/0 (socket says 172.21.15.148:60702) 2024-09-19T07:20:45.509 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.499+0000 7f1b09d1c640 1 -- 172.21.15.148:0/2277708036 learned_addr learned my addr 172.21.15.148:0/2277708036 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:20:45.509 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.499+0000 7f1b0ad1e640 1 --2- 172.21.15.148:0/2277708036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558832a11af0 0x558832a11ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:45.509 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.499+0000 7f1b0ad1e640 1 --2- 172.21.15.148:0/3100262008 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f1af00a34e0 0x7f1af00a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:45.509 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.499+0000 7f1afb7fe640 1 -- 172.21.15.148:0/3100262008 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8556+0+0 (secure 0 0 0) 0x7f1af40cf8e0 con 0x7f1b04101370 2024-09-19T07:20:45.509 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.499+0000 7f1b09d1c640 1 -- 172.21.15.148:0/2277708036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558832a11af0 msgr2=0x558832a11ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:20:45.509 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.499+0000 7f1b09d1c640 1 --2- 172.21.15.148:0/2277708036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558832a11af0 0x558832a11ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:45.509 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.499+0000 7f1b09d1c640 1 -- 172.21.15.148:0/2277708036 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558832a12410 msgr2=0x558832a1c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:20:45.509 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.499+0000 7f1b09d1c640 1 --2- 172.21.15.148:0/2277708036 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558832a12410 0x558832a1c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:45.509 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.499+0000 7f1b09d1c640 1 -- 172.21.15.148:0/2277708036 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55883291d340 con 0x558832a1ccb0 2024-09-19T07:20:45.509 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.499+0000 7f1b0a51d640 1 --2- 172.21.15.148:0/2277708036 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558832a12410 0x558832a1c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:20:45.509 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.499+0000 7f1b09d1c640 1 --2- 172.21.15.148:0/2277708036 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558832a1ccb0 0x558832a1f0a0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f1af40cd070 tx=0x7f1af4005380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24122e66bb00856d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:45.510 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.499+0000 7f1b0ad1e640 1 --2- 172.21.15.148:0/3100262008 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f1af00a34e0 0x7f1af00a59a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1afc033040 tx=0x7f1afc0095c0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:45.510 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.499+0000 7f1af8ff9640 1 -- 172.21.15.148:0/2277708036 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af401d070 con 0x558832a1ccb0 2024-09-19T07:20:45.510 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.499+0000 7f1af8ff9640 1 -- 172.21.15.148:0/2277708036 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1af409c2a0 con 0x558832a1ccb0 2024-09-19T07:20:45.510 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.499+0000 7f1af8ff9640 1 -- 172.21.15.148:0/2277708036 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af4098210 con 0x558832a1ccb0 2024-09-19T07:20:45.510 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.500+0000 7f1b0f5f3740 1 -- 172.21.15.148:0/2277708036 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558832a1ccb0 msgr2=0x558832a1f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:45.510 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.500+0000 7f1b0f5f3740 1 --2- 172.21.15.148:0/2277708036 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558832a1ccb0 0x558832a1f0a0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f1af40cd070 tx=0x7f1af4005380 comp rx=0 tx=0).stop 2024-09-19T07:20:45.510 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.500+0000 7f1b0f5f3740 1 -- 172.21.15.148:0/2277708036 shutdown_connections 2024-09-19T07:20:45.510 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.500+0000 7f1b0f5f3740 1 --2- 172.21.15.148:0/2277708036 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558832a1ccb0 0x558832a1f0a0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:45.510 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.500+0000 7f1b0f5f3740 1 --2- 172.21.15.148:0/2277708036 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558832a12410 0x558832a1c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:45.510 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.500+0000 7f1b0f5f3740 1 --2- 172.21.15.148:0/2277708036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558832a11af0 0x558832a11ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:45.511 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.500+0000 7f1b0f5f3740 1 -- 172.21.15.148:0/2277708036 >> 172.21.15.148:0/2277708036 conn(0x558832a0e060 msgr2=0x558832a0e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:45.511 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.500+0000 7f1b0f5f3740 1 -- 172.21.15.148:0/2277708036 shutdown_connections 2024-09-19T07:20:45.511 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.500+0000 7f1b0f5f3740 1 -- 172.21.15.148:0/2277708036 wait complete. 2024-09-19T07:20:45.511 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.501+0000 7f1b0f5f3740 1 -- start start 2024-09-19T07:20:45.511 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.501+0000 7f1b0f5f3740 1 Processor -- start 2024-09-19T07:20:45.511 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.501+0000 7f1b0f5f3740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558832a11af0 0x558832a19c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:45.511 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.501+0000 7f1b0f5f3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558832a12410 0x558832a1a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:45.511 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.501+0000 7f1b0f5f3740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558832a1ccb0 0x558832a1a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:45.511 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.501+0000 7f1b0f5f3740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x558832a1f880 con 0x558832a11af0 2024-09-19T07:20:45.511 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.501+0000 7f1b0f5f3740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5588328ff290 con 0x558832a1ccb0 2024-09-19T07:20:45.512 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.501+0000 7f1b0f5f3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x558832a1fa00 con 0x558832a12410 2024-09-19T07:20:45.512 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.501+0000 7f1b0f5f3740 10 client.0 _ll_register_callbacks cb 0x558832930140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:20:45.512 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.501+0000 7f1b0a51d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558832a11af0 0x558832a19c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:45.512 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.501+0000 7f1b0a51d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558832a11af0 0x558832a19c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44992/0 (socket says 172.21.15.148:44992) 2024-09-19T07:20:45.512 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.501+0000 7f1b0a51d640 1 -- 172.21.15.148:0/2354367505 learned_addr learned my addr 172.21.15.148:0/2354367505 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:20:45.512 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.501+0000 7f1b0ad1e640 1 --2- 172.21.15.148:0/2354367505 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558832a1ccb0 0x558832a1a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:45.512 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.501+0000 7f1b0a51d640 1 -- 172.21.15.148:0/2354367505 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558832a12410 msgr2=0x558832a1a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:20:45.512 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.501+0000 7f1b0a51d640 1 --2- 172.21.15.148:0/2354367505 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558832a12410 0x558832a1a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:45.512 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.501+0000 7f1b0a51d640 1 -- 172.21.15.148:0/2354367505 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558832a1ccb0 msgr2=0x558832a1a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:20:45.512 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.501+0000 7f1b0a51d640 1 --2- 172.21.15.148:0/2354367505 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558832a1ccb0 0x558832a1a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:45.512 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.501+0000 7f1b0a51d640 1 -- 172.21.15.148:0/2354367505 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558832689210 con 0x558832a11af0 2024-09-19T07:20:45.512 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.501+0000 7f1b0ad1e640 1 --2- 172.21.15.148:0/2354367505 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558832a1ccb0 0x558832a1a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:20:45.513 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.502+0000 7f1b0a51d640 1 --2- 172.21.15.148:0/2354367505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558832a11af0 0x558832a19c10 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f1b00010a50 tx=0x7f1b00010f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fde7a566eeaf907 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:45.513 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.502+0000 7f1aedffb640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:20:45.513 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.502+0000 7f1aedffb640 1 -- 172.21.15.148:0/2354367505 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b0001e060 con 0x558832a11af0 2024-09-19T07:20:45.513 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.502+0000 7f1aedffb640 1 -- 172.21.15.148:0/2354367505 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8556+0+0 (secure 0 0 0) 0x7f1b0000fb10 con 0x558832a11af0 2024-09-19T07:20:45.513 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.502+0000 7f1b0f5f3740 1 -- 172.21.15.148:0/2354367505 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1af409c2a0 con 0x558832a11af0 2024-09-19T07:20:45.513 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.502+0000 7f1aedffb640 1 -- 172.21.15.148:0/2354367505 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f1b0000fd10 con 0x558832a11af0 2024-09-19T07:20:45.513 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.502+0000 7f1b0f5f3740 10 client.16953 fetch_fsmap learned FSMap version 43 2024-09-19T07:20:45.513 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.502+0000 7f1b0f5f3740 1 -- 172.21.15.148:0/2354367505 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x558832755620 con 0x558832a11af0 2024-09-19T07:20:45.513 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.502+0000 7f1aedffb640 1 -- 172.21.15.148:0/2354367505 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1af409c2a0 con 0x558832a11af0 2024-09-19T07:20:45.513 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.502+0000 7f1aedffb640 1 -- 172.21.15.148:0/2354367505 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 43) ==== 8362+0+0 (secure 0 0 0) 0x7f1b0000e570 con 0x558832a11af0 2024-09-19T07:20:45.513 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.502+0000 7f1b0f5f3740 10 client.16953 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T07:20:45.513 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.502+0000 7f1b0f5f3740 10 client.16953 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:20:45.514 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.502+0000 7f1b0f5f3740 20 client.16953 populate_metadata read hostname 'smithi148' 2024-09-19T07:20:45.514 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.502+0000 7f1b0f5f3740 1 --2- 172.21.15.148:0/2354367505 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x558832a2cd00 0x558832a2f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:45.514 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.502+0000 7f1b0f5f3740 4 client.16953 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:20:45.514 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.502+0000 7f1b0f5f3740 1 -- 172.21.15.148:0/2354367505 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558832983a20 con 0x558832a2cd00 2024-09-19T07:20:45.514 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.503+0000 7f1b09d1c640 1 --2- 172.21.15.148:0/2354367505 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x558832a2cd00 0x558832a2f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:45.514 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.503+0000 7f1b09d1c640 1 --2- 172.21.15.148:0/2354367505 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x558832a2cd00 0x558832a2f190 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1d4c538286f5d60 server_cookie=b1696d04bb45d59e in_seq=0 out_seq=0 2024-09-19T07:20:45.514 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.503+0000 7f1aedffb640 10 client.16953 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:20:45.514 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.504+0000 7f1aedffb640 1 -- 172.21.15.148:0/2354367505 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558832983a20 con 0x558832a2cd00 2024-09-19T07:20:45.514 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.504+0000 7f1aedffb640 10 client.16953 handle_command_reply: tid=0 2024-09-19T07:20:45.515 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.504+0000 7f1b0f5f3740 1 client.16953 shutdown 2024-09-19T07:20:45.515 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.504+0000 7f1b0f5f3740 1 -- 172.21.15.148:0/2354367505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558832a11af0 msgr2=0x558832a19c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:45.515 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.504+0000 7f1b0f5f3740 1 --2- 172.21.15.148:0/2354367505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558832a11af0 0x558832a19c10 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f1b00010a50 tx=0x7f1b00010f10 comp rx=0 tx=0).stop 2024-09-19T07:20:45.515 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.504+0000 7f1b0f5f3740 1 -- 172.21.15.148:0/2354367505 shutdown_connections 2024-09-19T07:20:45.515 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.504+0000 7f1b0f5f3740 1 --2- 172.21.15.148:0/2354367505 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x558832a2cd00 0x558832a2f190 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:45.515 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.504+0000 7f1b0f5f3740 1 --2- 172.21.15.148:0/2354367505 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558832a1ccb0 0x558832a1a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:45.515 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.504+0000 7f1aedffb640 0 client.16953 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:20:45.515 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.504+0000 7f1b0f5f3740 1 --2- 172.21.15.148:0/2354367505 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558832a12410 0x558832a1a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:45.515 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.504+0000 7f1b0f5f3740 1 --2- 172.21.15.148:0/2354367505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558832a11af0 0x558832a19c10 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:45.515 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.504+0000 7f1b0f5f3740 1 -- 172.21.15.148:0/2354367505 >> 172.21.15.148:0/2354367505 conn(0x558832a0e060 msgr2=0x558832a13d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:45.515 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.504+0000 7f1b0f5f3740 1 -- 172.21.15.148:0/2354367505 shutdown_connections 2024-09-19T07:20:45.515 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.504+0000 7f1b0f5f3740 1 -- 172.21.15.148:0/2354367505 wait complete. 2024-09-19T07:20:45.515 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.504+0000 7f1b0f5f3740 20 client.16953 trim_cache size 0 max 16384 2024-09-19T07:20:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.519+0000 7f1b0f5f3740 1 Processor -- start 2024-09-19T07:20:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.519+0000 7f1b0f5f3740 1 -- start start 2024-09-19T07:20:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.519+0000 7f1b0f5f3740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558832a11af0 0x558832a1a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.519+0000 7f1b0f5f3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558832a12410 0x558832a1bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.519+0000 7f1b0f5f3740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558832a1ccb0 0x558832a34aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.519+0000 7f1b0f5f3740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1b041b01d0 con 0x558832a11af0 2024-09-19T07:20:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.519+0000 7f1b0f5f3740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1b041ada40 con 0x558832a1ccb0 2024-09-19T07:20:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.519+0000 7f1b0f5f3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1b041ab8b0 con 0x558832a12410 2024-09-19T07:20:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.519+0000 7f1b0a51d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558832a11af0 0x558832a1a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.519+0000 7f1b0a51d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558832a11af0 0x558832a1a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45008/0 (socket says 172.21.15.148:45008) 2024-09-19T07:20:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.519+0000 7f1b0a51d640 1 -- 172.21.15.148:0/1818836350 learned_addr learned my addr 172.21.15.148:0/1818836350 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:20:45.526 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.519+0000 7f1b0a51d640 1 -- 172.21.15.148:0/1818836350 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558832a12410 msgr2=0x558832a1bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:20:45.526 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.519+0000 7f1b0a51d640 1 --2- 172.21.15.148:0/1818836350 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558832a12410 0x558832a1bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:45.526 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.519+0000 7f1b0a51d640 1 -- 172.21.15.148:0/1818836350 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558832a1ccb0 msgr2=0x558832a34aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:20:45.526 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.519+0000 7f1b0a51d640 1 --2- 172.21.15.148:0/1818836350 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558832a1ccb0 0x558832a34aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:45.526 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.519+0000 7f1b0a51d640 1 -- 172.21.15.148:0/1818836350 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558832a1c760 con 0x558832a11af0 2024-09-19T07:20:45.526 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.520+0000 7f1b0a51d640 1 --2- 172.21.15.148:0/1818836350 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558832a11af0 0x558832a1a490 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f1b0000f870 tx=0x7f1b0000fb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f78ee3d12de5df21 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:45.526 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.520+0000 7f1aeffff640 1 -- 172.21.15.148:0/1818836350 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b00030070 con 0x558832a11af0 2024-09-19T07:20:45.526 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.520+0000 7f1aeffff640 1 -- 172.21.15.148:0/1818836350 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b0000a340 con 0x558832a11af0 2024-09-19T07:20:45.526 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.520+0000 7f1aeffff640 1 -- 172.21.15.148:0/1818836350 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b0001ab50 con 0x558832a11af0 2024-09-19T07:20:45.526 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.520+0000 7f1b0f5f3740 1 -- 172.21.15.148:0/1818836350 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558832a11af0 msgr2=0x558832a1a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:45.526 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.520+0000 7f1b0f5f3740 1 --2- 172.21.15.148:0/1818836350 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558832a11af0 0x558832a1a490 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f1b0000f870 tx=0x7f1b0000fb10 comp rx=0 tx=0).stop 2024-09-19T07:20:45.526 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.520+0000 7f1b0f5f3740 1 -- 172.21.15.148:0/1818836350 shutdown_connections 2024-09-19T07:20:45.526 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.520+0000 7f1b0f5f3740 1 --2- 172.21.15.148:0/1818836350 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558832a1ccb0 0x558832a34aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:45.527 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.520+0000 7f1b0f5f3740 1 --2- 172.21.15.148:0/1818836350 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558832a12410 0x558832a1bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:45.527 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.520+0000 7f1b0f5f3740 1 --2- 172.21.15.148:0/1818836350 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558832a11af0 0x558832a1a490 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:45.527 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.520+0000 7f1b0f5f3740 1 -- 172.21.15.148:0/1818836350 >> 172.21.15.148:0/1818836350 conn(0x558832a0e060 msgr2=0x558832a1b470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:45.527 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.520+0000 7f1b0f5f3740 1 -- 172.21.15.148:0/1818836350 shutdown_connections 2024-09-19T07:20:45.527 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.520+0000 7f1b0f5f3740 1 -- 172.21.15.148:0/1818836350 wait complete. 2024-09-19T07:20:45.527 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.521+0000 7f1b0f5f3740 1 -- start start 2024-09-19T07:20:45.527 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.521+0000 7f1b0f5f3740 1 Processor -- start 2024-09-19T07:20:45.527 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.521+0000 7f1b0f5f3740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558832a11af0 0x558832a25310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:45.527 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.521+0000 7f1b0f5f3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558832a12410 0x558832a16820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:45.527 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.521+0000 7f1b0f5f3740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558832a1ccb0 0x558832a16d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.521+0000 7f1b0f5f3740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1b041abf00 con 0x558832a1ccb0 2024-09-19T07:20:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.521+0000 7f1b0f5f3740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1b041ad370 con 0x558832a11af0 2024-09-19T07:20:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.521+0000 7f1b0f5f3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1b041ac5d0 con 0x558832a12410 2024-09-19T07:20:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.521+0000 7f1b0f5f3740 10 client.0 _ll_register_callbacks cb 0x7f1b0000a7c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:20:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.521+0000 7f1b0ad1e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558832a1ccb0 0x558832a16d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.521+0000 7f1b0ad1e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558832a1ccb0 0x558832a16d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45022/0 (socket says 172.21.15.148:45022) 2024-09-19T07:20:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.521+0000 7f1b0ad1e640 1 -- 172.21.15.148:0/1992238604 learned_addr learned my addr 172.21.15.148:0/1992238604 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:20:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.521+0000 7f1b09d1c640 1 --2- 172.21.15.148:0/1992238604 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558832a12410 0x558832a16820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.521+0000 7f1b0a51d640 1 --2- 172.21.15.148:0/1992238604 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558832a11af0 0x558832a25310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.521+0000 7f1b0ad1e640 1 -- 172.21.15.148:0/1992238604 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558832a12410 msgr2=0x558832a16820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:20:45.529 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.521+0000 7f1b0ad1e640 1 --2- 172.21.15.148:0/1992238604 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558832a12410 0x558832a16820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:45.529 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.521+0000 7f1b0ad1e640 1 -- 172.21.15.148:0/1992238604 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558832a11af0 msgr2=0x558832a25310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:20:45.529 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.521+0000 7f1b0ad1e640 1 --2- 172.21.15.148:0/1992238604 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558832a11af0 0x558832a25310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:45.529 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.521+0000 7f1b0ad1e640 1 -- 172.21.15.148:0/1992238604 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558832a174a0 con 0x558832a1ccb0 2024-09-19T07:20:45.529 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.521+0000 7f1b0a51d640 1 --2- 172.21.15.148:0/1992238604 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558832a11af0 0x558832a25310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:20:45.530 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.522+0000 7f1b0ad1e640 1 --2- 172.21.15.148:0/1992238604 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558832a1ccb0 0x558832a16d60 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f1afc035000 tx=0x7f1afc005f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=413437171149fb21 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:45.530 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.522+0000 7f1aedffb640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:20:45.530 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.522+0000 7f1aedffb640 1 -- 172.21.15.148:0/1992238604 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1afc056060 con 0x558832a1ccb0 2024-09-19T07:20:45.530 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.522+0000 7f1aedffb640 1 -- 172.21.15.148:0/1992238604 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8556+0+0 (secure 0 0 0) 0x7f1afc004540 con 0x558832a1ccb0 2024-09-19T07:20:45.530 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.522+0000 7f1b0f5f3740 1 -- 172.21.15.148:0/1992238604 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b0000a340 con 0x558832a1ccb0 2024-09-19T07:20:45.530 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.522+0000 7f1aedffb640 1 -- 172.21.15.148:0/1992238604 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f1afc041050 con 0x558832a1ccb0 2024-09-19T07:20:45.531 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.522+0000 7f1b0f5f3740 10 client.16959 fetch_fsmap learned FSMap version 43 2024-09-19T07:20:45.531 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.522+0000 7f1b0f5f3740 1 -- 172.21.15.148:0/1992238604 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x558832a97990 con 0x558832a1ccb0 2024-09-19T07:20:45.531 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.522+0000 7f1aedffb640 1 -- 172.21.15.148:0/1992238604 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b0000a340 con 0x558832a1ccb0 2024-09-19T07:20:45.531 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.522+0000 7f1aedffb640 1 -- 172.21.15.148:0/1992238604 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 43) ==== 8362+0+0 (secure 0 0 0) 0x7f1afc030070 con 0x558832a1ccb0 2024-09-19T07:20:45.531 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.522+0000 7f1b0f5f3740 10 client.16959 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T07:20:45.531 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.522+0000 7f1b0f5f3740 10 client.16959 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:20:45.532 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.522+0000 7f1b0f5f3740 20 client.16959 populate_metadata read hostname 'smithi148' 2024-09-19T07:20:45.532 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.522+0000 7f1b0f5f3740 1 --2- 172.21.15.148:0/1992238604 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x558832a981a0 0x558832a9a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:45.532 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.522+0000 7f1b0f5f3740 4 client.16959 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:20:45.532 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.522+0000 7f1b0f5f3740 1 -- 172.21.15.148:0/1992238604 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55883297dd70 con 0x558832a981a0 2024-09-19T07:20:45.532 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.523+0000 7f1b0a51d640 1 --2- 172.21.15.148:0/1992238604 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x558832a981a0 0x558832a9a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:45.532 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.523+0000 7f1b0a51d640 1 --2- 172.21.15.148:0/1992238604 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x558832a981a0 0x558832a9a5c0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=577974d36fe55ff6 server_cookie=4af4a2cc5a070819 in_seq=0 out_seq=0 2024-09-19T07:20:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.523+0000 7f1aedffb640 10 client.16959 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:20:45.533 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:20:45 smithi179 ceph-mon[35716]: pgmap v300: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 11 op/s 2024-09-19T07:20:45.537 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.535+0000 7f1aedffb640 1 -- 172.21.15.148:0/1992238604 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55883297dd70 con 0x558832a981a0 2024-09-19T07:20:45.537 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.535+0000 7f1aedffb640 10 client.16959 handle_command_reply: tid=0 2024-09-19T07:20:45.537 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.535+0000 7f1b0f5f3740 1 client.16959 shutdown 2024-09-19T07:20:45.537 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.535+0000 7f1b0f5f3740 1 -- 172.21.15.148:0/1992238604 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558832a1ccb0 msgr2=0x558832a16d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:45.537 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.535+0000 7f1b0f5f3740 1 --2- 172.21.15.148:0/1992238604 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558832a1ccb0 0x558832a16d60 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f1afc035000 tx=0x7f1afc005f60 comp rx=0 tx=0).stop 2024-09-19T07:20:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.535+0000 7f1b0f5f3740 1 -- 172.21.15.148:0/1992238604 shutdown_connections 2024-09-19T07:20:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.535+0000 7f1b0f5f3740 1 --2- 172.21.15.148:0/1992238604 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x558832a981a0 0x558832a9a5c0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.535+0000 7f1b0f5f3740 1 --2- 172.21.15.148:0/1992238604 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558832a1ccb0 0x558832a16d60 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.535+0000 7f1b0f5f3740 1 --2- 172.21.15.148:0/1992238604 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558832a12410 0x558832a16820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.535+0000 7f1aedffb640 0 client.16959 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:20:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.535+0000 7f1b0f5f3740 1 --2- 172.21.15.148:0/1992238604 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558832a11af0 0x558832a25310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.535+0000 7f1b0f5f3740 1 -- 172.21.15.148:0/1992238604 >> 172.21.15.148:0/1992238604 conn(0x558832a0e060 msgr2=0x558832a0c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.535+0000 7f1b0f5f3740 1 -- 172.21.15.148:0/1992238604 shutdown_connections 2024-09-19T07:20:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.535+0000 7f1b0f5f3740 1 -- 172.21.15.148:0/1992238604 wait complete. 2024-09-19T07:20:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.535+0000 7f1b0f5f3740 20 client.16959 trim_cache size 0 max 16384 2024-09-19T07:20:45.539 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:20:45.539 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:20:45.539 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:20:45.539 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:20:45.540 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.536+0000 7f1b0c781640 1 -- 172.21.15.148:0/3100262008 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f1af00a34e0 msgr2=0x7f1af00a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:45.540 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.536+0000 7f1b0c781640 1 --2- 172.21.15.148:0/3100262008 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f1af00a34e0 0x7f1af00a59a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1afc033040 tx=0x7f1afc0095c0 comp rx=0 tx=0).stop 2024-09-19T07:20:45.540 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.536+0000 7f1b0c781640 1 -- 172.21.15.148:0/3100262008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b04101370 msgr2=0x7f1b04198800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:45.540 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.536+0000 7f1b0c781640 1 --2- 172.21.15.148:0/3100262008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b04101370 0x7f1b04198800 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f1af400c890 tx=0x7f1af400cc90 comp rx=0 tx=0).stop 2024-09-19T07:20:45.540 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.536+0000 7f1b0c781640 1 -- 172.21.15.148:0/3100262008 shutdown_connections 2024-09-19T07:20:45.541 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.536+0000 7f1b0c781640 1 --2- 172.21.15.148:0/3100262008 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f1af00a34e0 0x7f1af00a59a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:45.541 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.536+0000 7f1b0c781640 1 --2- 172.21.15.148:0/3100262008 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b041069e0 0x7f1b0419cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:45.541 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.536+0000 7f1b0c781640 1 --2- 172.21.15.148:0/3100262008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b04101370 0x7f1b04198800 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:45.541 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.536+0000 7f1b0c781640 1 --2- 172.21.15.148:0/3100262008 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b041009d0 0x7f1b041982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:45.541 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.536+0000 7f1b0c781640 1 -- 172.21.15.148:0/3100262008 >> 172.21.15.148:0/3100262008 conn(0x7f1b040fc6f0 msgr2=0x7f1b040fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:45.541 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.536+0000 7f1b0c781640 1 -- 172.21.15.148:0/3100262008 shutdown_connections 2024-09-19T07:20:45.541 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:45.536+0000 7f1b0c781640 1 -- 172.21.15.148:0/3100262008 wait complete. 2024-09-19T07:20:45.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:20:45 smithi148 ceph-mon[31180]: pgmap v300: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 11 op/s 2024-09-19T07:20:45.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:20:45 smithi165 ceph-mon[35326]: pgmap v300: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 11 op/s 2024-09-19T07:20:47.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:20:47 smithi179 ceph-mon[35716]: pgmap v301: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 KiB/s wr, 14 op/s 2024-09-19T07:20:47.592 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:20:47 smithi148 ceph-mon[31180]: pgmap v301: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 KiB/s wr, 14 op/s 2024-09-19T07:20:47.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:20:47 smithi165 ceph-mon[35326]: pgmap v301: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 KiB/s wr, 14 op/s 2024-09-19T07:20:49.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:20:49 smithi179 ceph-mon[35716]: pgmap v302: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 8 op/s 2024-09-19T07:20:49.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:20:49 smithi148 ceph-mon[31180]: pgmap v302: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 8 op/s 2024-09-19T07:20:49.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:20:49 smithi165 ceph-mon[35326]: pgmap v302: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 8 op/s 2024-09-19T07:20:51.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:20:51 smithi179 ceph-mon[35716]: pgmap v303: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 18 KiB/s wr, 9 op/s 2024-09-19T07:20:51.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:20:51 smithi148 ceph-mon[31180]: pgmap v303: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 18 KiB/s wr, 9 op/s 2024-09-19T07:20:51.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:20:51 smithi165 ceph-mon[35326]: pgmap v303: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 18 KiB/s wr, 9 op/s 2024-09-19T07:20:53.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:20:53 smithi148 ceph-mon[31180]: pgmap v304: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 32 KiB/s wr, 16 op/s 2024-09-19T07:20:53.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:20:53 smithi165 ceph-mon[35326]: pgmap v304: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 32 KiB/s wr, 16 op/s 2024-09-19T07:20:53.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:20:53 smithi179 ceph-mon[35716]: pgmap v304: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 32 KiB/s wr, 16 op/s 2024-09-19T07:20:55.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:20:55 smithi179 ceph-mon[35716]: pgmap v305: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-09-19T07:20:55.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:20:55 smithi148 ceph-mon[31180]: pgmap v305: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-09-19T07:20:55.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:20:55 smithi165 ceph-mon[35326]: pgmap v305: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-09-19T07:20:57.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:20:57 smithi148 ceph-mon[31180]: pgmap v306: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 38 KiB/s wr, 16 op/s 2024-09-19T07:20:57.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:20:57 smithi165 ceph-mon[35326]: pgmap v306: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 38 KiB/s wr, 16 op/s 2024-09-19T07:20:57.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:20:57 smithi179 ceph-mon[35716]: pgmap v306: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 38 KiB/s wr, 16 op/s 2024-09-19T07:20:58.632 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.631+0000 7f49052e4640 1 -- 172.21.15.148:0/1979342699 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4900101350 msgr2=0x7f490010d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:58.633 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.631+0000 7f49052e4640 1 --2- 172.21.15.148:0/1979342699 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4900101350 0x7f490010d880 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f48f8009cd0 tx=0x7f48f802a8e0 comp rx=0 tx=0).stop 2024-09-19T07:20:58.633 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.631+0000 7f49052e4640 1 -- 172.21.15.148:0/1979342699 shutdown_connections 2024-09-19T07:20:58.633 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.631+0000 7f49052e4640 1 --2- 172.21.15.148:0/1979342699 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4900101350 0x7f490010d880 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:58.633 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.631+0000 7f49052e4640 1 --2- 172.21.15.148:0/1979342699 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49001009b0 0x7f4900100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:58.633 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.631+0000 7f49052e4640 1 --2- 172.21.15.148:0/1979342699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49001069c0 0x7f4900106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:58.633 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.631+0000 7f49052e4640 1 -- 172.21.15.148:0/1979342699 >> 172.21.15.148:0/1979342699 conn(0x7f4900077990 msgr2=0x7f49000fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:58.633 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.631+0000 7f49052e4640 1 -- 172.21.15.148:0/1979342699 shutdown_connections 2024-09-19T07:20:58.633 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.631+0000 7f49052e4640 1 -- 172.21.15.148:0/1979342699 wait complete. 2024-09-19T07:20:58.633 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.632+0000 7f49052e4640 1 Processor -- start 2024-09-19T07:20:58.633 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.632+0000 7f49052e4640 1 -- start start 2024-09-19T07:20:58.635 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.632+0000 7f49052e4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49001009b0 0x7f4900198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:58.636 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.632+0000 7f49052e4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4900101350 0x7f49001987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:58.636 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.632+0000 7f49052e4640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49001069c0 0x7f490019cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:58.636 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.632+0000 7f49052e4640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4900111ef0 con 0x7f49001009b0 2024-09-19T07:20:58.636 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.632+0000 7f49052e4640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4900111d70 con 0x7f49001069c0 2024-09-19T07:20:58.636 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.632+0000 7f49052e4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4900112070 con 0x7f4900101350 2024-09-19T07:20:58.636 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.632+0000 7f48feffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49001009b0 0x7f4900198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:58.636 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.632+0000 7f48feffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49001009b0 0x7f4900198260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59730/0 (socket says 172.21.15.148:59730) 2024-09-19T07:20:58.636 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.632+0000 7f48feffd640 1 -- 172.21.15.148:0/2794028763 learned_addr learned my addr 172.21.15.148:0/2794028763 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:20:58.636 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.633+0000 7f48fe7fc640 1 --2- 172.21.15.148:0/2794028763 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4900101350 0x7f49001987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:58.636 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.633+0000 7f48ff7fe640 1 --2- 172.21.15.148:0/2794028763 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49001069c0 0x7f490019cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:58.636 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.633+0000 7f48feffd640 1 -- 172.21.15.148:0/2794028763 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4900101350 msgr2=0x7f49001987a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:58.636 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.633+0000 7f48feffd640 1 --2- 172.21.15.148:0/2794028763 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4900101350 0x7f49001987a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:58.637 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.633+0000 7f48feffd640 1 -- 172.21.15.148:0/2794028763 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49001069c0 msgr2=0x7f490019cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:58.637 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.633+0000 7f48feffd640 1 --2- 172.21.15.148:0/2794028763 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49001069c0 0x7f490019cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:58.637 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.633+0000 7f48feffd640 1 -- 172.21.15.148:0/2794028763 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f490019d250 con 0x7f49001009b0 2024-09-19T07:20:58.637 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.633+0000 7f48fe7fc640 1 --2- 172.21.15.148:0/2794028763 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4900101350 0x7f49001987a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:20:58.637 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.633+0000 7f48ff7fe640 1 --2- 172.21.15.148:0/2794028763 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49001069c0 0x7f490019cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:20:58.637 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.633+0000 7f48feffd640 1 --2- 172.21.15.148:0/2794028763 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49001009b0 0x7f4900198260 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f48f000c920 tx=0x7f48f000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:58.637 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.633+0000 7f48e7fff640 1 -- 172.21.15.148:0/2794028763 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f0007c70 con 0x7f49001009b0 2024-09-19T07:20:58.637 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.633+0000 7f48e7fff640 1 -- 172.21.15.148:0/2794028763 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48f0007e10 con 0x7f49001009b0 2024-09-19T07:20:58.637 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.633+0000 7f49052e4640 1 -- 172.21.15.148:0/2794028763 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f490019d540 con 0x7f49001009b0 2024-09-19T07:20:58.637 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.633+0000 7f48e7fff640 1 -- 172.21.15.148:0/2794028763 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f0018890 con 0x7f49001009b0 2024-09-19T07:20:58.637 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.633+0000 7f49052e4640 1 -- 172.21.15.148:0/2794028763 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49001a4dd0 con 0x7f49001009b0 2024-09-19T07:20:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.636+0000 7f48e7fff640 1 -- 172.21.15.148:0/2794028763 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f48f0018a70 con 0x7f49001009b0 2024-09-19T07:20:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.636+0000 7f4908085740 1 Processor -- start 2024-09-19T07:20:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.636+0000 7f4908085740 1 -- start start 2024-09-19T07:20:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.636+0000 7f4908085740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ddcfc60af0 0x55ddcfc60ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.636+0000 7f4908085740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ddcfc61410 0x55ddcfc6b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.636+0000 7f4908085740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ddcfc6bcb0 0x55ddcfc6e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.636+0000 7f4908085740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55ddcfbc52f0 con 0x55ddcfc60af0 2024-09-19T07:20:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.636+0000 7f4908085740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ddcfb6d270 con 0x55ddcfc6bcb0 2024-09-19T07:20:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.636+0000 7f4908085740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ddcfbc12b0 con 0x55ddcfc61410 2024-09-19T07:20:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.636+0000 7f48ff7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ddcfc60af0 0x55ddcfc60ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:58.645 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.636+0000 7f48ff7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ddcfc60af0 0x55ddcfc60ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59734/0 (socket says 172.21.15.148:59734) 2024-09-19T07:20:58.645 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.636+0000 7f48ff7fe640 1 -- 172.21.15.148:0/397530184 learned_addr learned my addr 172.21.15.148:0/397530184 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:20:58.645 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.637+0000 7f48fe7fc640 1 --2- 172.21.15.148:0/397530184 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ddcfc6bcb0 0x55ddcfc6e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:58.645 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.637+0000 7f48feffd640 1 --2- 172.21.15.148:0/397530184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ddcfc61410 0x55ddcfc6b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:58.645 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.637+0000 7f48e7fff640 1 --2- 172.21.15.148:0/2794028763 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f48e80a34e0 0x7f48e80a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:58.645 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.637+0000 7f48ff7fe640 1 -- 172.21.15.148:0/397530184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ddcfc61410 msgr2=0x55ddcfc6b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:20:58.645 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.637+0000 7f48ff7fe640 1 --2- 172.21.15.148:0/397530184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ddcfc61410 0x55ddcfc6b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:58.645 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.637+0000 7f48ff7fe640 1 -- 172.21.15.148:0/397530184 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ddcfc6bcb0 msgr2=0x55ddcfc6e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:20:58.645 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.637+0000 7f48ff7fe640 1 --2- 172.21.15.148:0/397530184 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ddcfc6bcb0 0x55ddcfc6e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:58.645 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.637+0000 7f48ff7fe640 1 -- 172.21.15.148:0/397530184 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddcfb6c340 con 0x55ddcfc60af0 2024-09-19T07:20:58.645 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.637+0000 7f48feffd640 1 --2- 172.21.15.148:0/397530184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ddcfc61410 0x55ddcfc6b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:20:58.645 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.637+0000 7f48e7fff640 1 -- 172.21.15.148:0/2794028763 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8556+0+0 (secure 0 0 0) 0x7f48f00cfe40 con 0x7f49001009b0 2024-09-19T07:20:58.645 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.637+0000 7f48ff7fe640 1 --2- 172.21.15.148:0/2794028763 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f48e80a34e0 0x7f48e80a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:58.645 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.637+0000 7f48ff7fe640 1 --2- 172.21.15.148:0/397530184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ddcfc60af0 0x55ddcfc60ed0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f48f8005e30 tx=0x7f48f80314b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55153215f0c31a3b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.637+0000 7f48e57fa640 1 -- 172.21.15.148:0/397530184 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f804d070 con 0x55ddcfc60af0 2024-09-19T07:20:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.637+0000 7f48e57fa640 1 -- 172.21.15.148:0/397530184 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48f8043070 con 0x55ddcfc60af0 2024-09-19T07:20:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.637+0000 7f48e57fa640 1 -- 172.21.15.148:0/397530184 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f8030d10 con 0x55ddcfc60af0 2024-09-19T07:20:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.638+0000 7f4908085740 1 -- 172.21.15.148:0/397530184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ddcfc60af0 msgr2=0x55ddcfc60ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.638+0000 7f4908085740 1 --2- 172.21.15.148:0/397530184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ddcfc60af0 0x55ddcfc60ed0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f48f8005e30 tx=0x7f48f80314b0 comp rx=0 tx=0).stop 2024-09-19T07:20:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.638+0000 7f48ff7fe640 1 --2- 172.21.15.148:0/2794028763 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f48e80a34e0 0x7f48e80a59a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f48f804a000 tx=0x7f48f804b000 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.638+0000 7f4908085740 1 -- 172.21.15.148:0/397530184 shutdown_connections 2024-09-19T07:20:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.638+0000 7f4908085740 1 --2- 172.21.15.148:0/397530184 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ddcfc6bcb0 0x55ddcfc6e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.638+0000 7f4908085740 1 --2- 172.21.15.148:0/397530184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ddcfc61410 0x55ddcfc6b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.638+0000 7f4908085740 1 --2- 172.21.15.148:0/397530184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ddcfc60af0 0x55ddcfc60ed0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.638+0000 7f4908085740 1 -- 172.21.15.148:0/397530184 >> 172.21.15.148:0/397530184 conn(0x55ddcfc5d060 msgr2=0x55ddcfc5d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.638+0000 7f4908085740 1 -- 172.21.15.148:0/397530184 shutdown_connections 2024-09-19T07:20:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.638+0000 7f4908085740 1 -- 172.21.15.148:0/397530184 wait complete. 2024-09-19T07:20:58.646 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.639+0000 7f4908085740 1 -- start start 2024-09-19T07:20:58.647 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.639+0000 7f4908085740 1 Processor -- start 2024-09-19T07:20:58.647 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.639+0000 7f4908085740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ddcfc60af0 0x55ddcfc68b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:58.647 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.639+0000 7f4908085740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ddcfc61410 0x55ddcfc690c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:58.647 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.639+0000 7f4908085740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ddcfc6bcb0 0x55ddcfc69600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:58.647 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.639+0000 7f4908085740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55ddcfc6e880 con 0x55ddcfc6bcb0 2024-09-19T07:20:58.647 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.639+0000 7f4908085740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ddcfb4e290 con 0x55ddcfc60af0 2024-09-19T07:20:58.647 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.639+0000 7f4908085740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ddcfc6ea00 con 0x55ddcfc61410 2024-09-19T07:20:58.647 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.639+0000 7f4908085740 10 client.0 _ll_register_callbacks cb 0x55ddcfb7f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:20:58.647 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.639+0000 7f48ff7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ddcfc6bcb0 0x55ddcfc69600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:58.647 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.639+0000 7f48ff7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ddcfc6bcb0 0x55ddcfc69600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59738/0 (socket says 172.21.15.148:59738) 2024-09-19T07:20:58.647 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.639+0000 7f48ff7fe640 1 -- 172.21.15.148:0/3214256632 learned_addr learned my addr 172.21.15.148:0/3214256632 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:20:58.647 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.639+0000 7f48fe7fc640 1 --2- 172.21.15.148:0/3214256632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ddcfc61410 0x55ddcfc690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:58.647 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.639+0000 7f48ff7fe640 1 -- 172.21.15.148:0/3214256632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ddcfc61410 msgr2=0x55ddcfc690c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:20:58.648 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.639+0000 7f48feffd640 1 --2- 172.21.15.148:0/3214256632 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ddcfc60af0 0x55ddcfc68b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:58.648 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.639+0000 7f48ff7fe640 1 --2- 172.21.15.148:0/3214256632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ddcfc61410 0x55ddcfc690c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:58.648 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.639+0000 7f48ff7fe640 1 -- 172.21.15.148:0/3214256632 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ddcfc60af0 msgr2=0x55ddcfc68b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:20:58.648 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.639+0000 7f48ff7fe640 1 --2- 172.21.15.148:0/3214256632 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ddcfc60af0 0x55ddcfc68b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:58.648 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.639+0000 7f48ff7fe640 1 -- 172.21.15.148:0/3214256632 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddcf8d8210 con 0x55ddcfc6bcb0 2024-09-19T07:20:58.648 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.639+0000 7f48fe7fc640 1 --2- 172.21.15.148:0/3214256632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ddcfc61410 0x55ddcfc690c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:20:58.648 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.639+0000 7f48feffd640 1 --2- 172.21.15.148:0/3214256632 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ddcfc60af0 0x55ddcfc68b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:20:58.648 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.640+0000 7f48ff7fe640 1 --2- 172.21.15.148:0/3214256632 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ddcfc6bcb0 0x55ddcfc69600 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f48f8030d20 tx=0x7f48f8005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=830508047290af17 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:58.648 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.640+0000 7f48e2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:20:58.648 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.640+0000 7f48e2ff5640 1 -- 172.21.15.148:0/3214256632 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f8058020 con 0x55ddcfc6bcb0 2024-09-19T07:20:58.648 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.640+0000 7f48e2ff5640 1 -- 172.21.15.148:0/3214256632 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8556+0+0 (secure 0 0 0) 0x7f48f8047430 con 0x55ddcfc6bcb0 2024-09-19T07:20:58.648 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.640+0000 7f4908085740 1 -- 172.21.15.148:0/3214256632 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48f8043070 con 0x55ddcfc6bcb0 2024-09-19T07:20:58.648 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.640+0000 7f48e2ff5640 1 -- 172.21.15.148:0/3214256632 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f48f8063050 con 0x55ddcfc6bcb0 2024-09-19T07:20:58.649 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.640+0000 7f4908085740 10 client.16971 fetch_fsmap learned FSMap version 43 2024-09-19T07:20:58.649 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.640+0000 7f4908085740 1 -- 172.21.15.148:0/3214256632 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55ddcf9a4620 con 0x55ddcfc6bcb0 2024-09-19T07:20:58.649 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.640+0000 7f48e2ff5640 1 -- 172.21.15.148:0/3214256632 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48f8043070 con 0x55ddcfc6bcb0 2024-09-19T07:20:58.649 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.640+0000 7f48e2ff5640 1 -- 172.21.15.148:0/3214256632 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 43) ==== 8362+0+0 (secure 0 0 0) 0x7f48f8030070 con 0x55ddcfc6bcb0 2024-09-19T07:20:58.649 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.640+0000 7f4908085740 10 client.16971 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T07:20:58.649 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.640+0000 7f4908085740 10 client.16971 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:20:58.649 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.640+0000 7f4908085740 20 client.16971 populate_metadata read hostname 'smithi148' 2024-09-19T07:20:58.649 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.640+0000 7f4908085740 1 --2- 172.21.15.148:0/3214256632 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ddcfc7ba80 0x55ddcfc7de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:58.649 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.640+0000 7f4908085740 4 client.16971 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:20:58.649 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.640+0000 7f4908085740 1 -- 172.21.15.148:0/3214256632 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ddcfbd2a20 con 0x55ddcfc7ba80 2024-09-19T07:20:58.649 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.641+0000 7f48feffd640 1 --2- 172.21.15.148:0/3214256632 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ddcfc7ba80 0x55ddcfc7de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:58.649 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.641+0000 7f48feffd640 1 --2- 172.21.15.148:0/3214256632 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ddcfc7ba80 0x55ddcfc7de70 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7629e752197d9527 server_cookie=3101481cd24664f3 in_seq=0 out_seq=0 2024-09-19T07:20:58.649 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.641+0000 7f48e2ff5640 10 client.16971 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:20:58.649 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.642+0000 7f48e2ff5640 1 -- 172.21.15.148:0/3214256632 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ddcfbd2a20 con 0x55ddcfc7ba80 2024-09-19T07:20:58.650 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.642+0000 7f48e2ff5640 10 client.16971 handle_command_reply: tid=0 2024-09-19T07:20:58.650 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.642+0000 7f4908085740 1 client.16971 shutdown 2024-09-19T07:20:58.650 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.642+0000 7f4908085740 1 -- 172.21.15.148:0/3214256632 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ddcfc6bcb0 msgr2=0x55ddcfc69600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:58.650 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.642+0000 7f4908085740 1 --2- 172.21.15.148:0/3214256632 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ddcfc6bcb0 0x55ddcfc69600 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f48f8030d20 tx=0x7f48f8005dc0 comp rx=0 tx=0).stop 2024-09-19T07:20:58.650 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.642+0000 7f4908085740 1 -- 172.21.15.148:0/3214256632 shutdown_connections 2024-09-19T07:20:58.650 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.642+0000 7f4908085740 1 --2- 172.21.15.148:0/3214256632 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ddcfc7ba80 0x55ddcfc7de70 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:58.650 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.642+0000 7f4908085740 1 --2- 172.21.15.148:0/3214256632 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ddcfc6bcb0 0x55ddcfc69600 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:58.650 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.642+0000 7f4908085740 1 --2- 172.21.15.148:0/3214256632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ddcfc61410 0x55ddcfc690c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:58.650 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.642+0000 7f48e2ff5640 0 client.16971 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:20:58.650 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.642+0000 7f4908085740 1 --2- 172.21.15.148:0/3214256632 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ddcfc60af0 0x55ddcfc68b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:58.651 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.642+0000 7f4908085740 1 -- 172.21.15.148:0/3214256632 >> 172.21.15.148:0/3214256632 conn(0x55ddcfc5d060 msgr2=0x55ddcfc62d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:58.651 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.642+0000 7f4908085740 1 -- 172.21.15.148:0/3214256632 shutdown_connections 2024-09-19T07:20:58.651 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.642+0000 7f4908085740 1 -- 172.21.15.148:0/3214256632 wait complete. 2024-09-19T07:20:58.651 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.642+0000 7f4908085740 20 client.16971 trim_cache size 0 max 16384 2024-09-19T07:20:58.662 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.657+0000 7f4908085740 1 Processor -- start 2024-09-19T07:20:58.662 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.657+0000 7f4908085740 1 -- start start 2024-09-19T07:20:58.662 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.657+0000 7f4908085740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ddcfc60af0 0x55ddcfc69430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:58.663 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.657+0000 7f4908085740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ddcfc61410 0x55ddcfc6aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:58.663 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.657+0000 7f4908085740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ddcfc6bcb0 0x55ddcfc835e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:58.663 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.657+0000 7f4908085740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f49001b0150 con 0x55ddcfc61410 2024-09-19T07:20:58.663 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.657+0000 7f4908085740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f49001ad9c0 con 0x55ddcfc60af0 2024-09-19T07:20:58.663 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.657+0000 7f4908085740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f49001ab830 con 0x55ddcfc6bcb0 2024-09-19T07:20:58.663 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.657+0000 7f48fe7fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ddcfc61410 0x55ddcfc6aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:58.663 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.657+0000 7f48fe7fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ddcfc61410 0x55ddcfc6aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59744/0 (socket says 172.21.15.148:59744) 2024-09-19T07:20:58.663 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.657+0000 7f48fe7fc640 1 -- 172.21.15.148:0/1656089118 learned_addr learned my addr 172.21.15.148:0/1656089118 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:20:58.663 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.657+0000 7f48feffd640 1 --2- 172.21.15.148:0/1656089118 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ddcfc60af0 0x55ddcfc69430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:58.663 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.657+0000 7f48fe7fc640 1 -- 172.21.15.148:0/1656089118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ddcfc6bcb0 msgr2=0x55ddcfc835e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:20:58.663 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.657+0000 7f48fe7fc640 1 --2- 172.21.15.148:0/1656089118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ddcfc6bcb0 0x55ddcfc835e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:58.663 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.657+0000 7f48fe7fc640 1 -- 172.21.15.148:0/1656089118 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ddcfc60af0 msgr2=0x55ddcfc69430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:20:58.663 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.657+0000 7f48fe7fc640 1 --2- 172.21.15.148:0/1656089118 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ddcfc60af0 0x55ddcfc69430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:58.664 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.657+0000 7f48fe7fc640 1 -- 172.21.15.148:0/1656089118 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddcfc67b10 con 0x55ddcfc61410 2024-09-19T07:20:58.664 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.657+0000 7f48feffd640 1 --2- 172.21.15.148:0/1656089118 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ddcfc60af0 0x55ddcfc69430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:20:58.664 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.657+0000 7f48fe7fc640 1 --2- 172.21.15.148:0/1656089118 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ddcfc61410 0x55ddcfc6aaf0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f48f4005fd0 tx=0x7f48f4013830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e621f92b68570745 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:58.664 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.658+0000 7f48e4ff9640 1 -- 172.21.15.148:0/1656089118 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f4004030 con 0x55ddcfc61410 2024-09-19T07:20:58.664 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.658+0000 7f48e4ff9640 1 -- 172.21.15.148:0/1656089118 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48f40041d0 con 0x55ddcfc61410 2024-09-19T07:20:58.664 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.658+0000 7f48e4ff9640 1 -- 172.21.15.148:0/1656089118 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f40117f0 con 0x55ddcfc61410 2024-09-19T07:20:58.664 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.658+0000 7f4908085740 1 -- 172.21.15.148:0/1656089118 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ddcfc61410 msgr2=0x55ddcfc6aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:58.664 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.658+0000 7f4908085740 1 --2- 172.21.15.148:0/1656089118 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ddcfc61410 0x55ddcfc6aaf0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f48f4005fd0 tx=0x7f48f4013830 comp rx=0 tx=0).stop 2024-09-19T07:20:58.664 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.658+0000 7f4908085740 1 -- 172.21.15.148:0/1656089118 shutdown_connections 2024-09-19T07:20:58.664 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.658+0000 7f4908085740 1 --2- 172.21.15.148:0/1656089118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ddcfc6bcb0 0x55ddcfc835e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:58.664 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.658+0000 7f4908085740 1 --2- 172.21.15.148:0/1656089118 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ddcfc61410 0x55ddcfc6aaf0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:58.664 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.658+0000 7f4908085740 1 --2- 172.21.15.148:0/1656089118 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ddcfc60af0 0x55ddcfc69430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:58.664 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.658+0000 7f4908085740 1 -- 172.21.15.148:0/1656089118 >> 172.21.15.148:0/1656089118 conn(0x55ddcfc5d060 msgr2=0x55ddcfc6a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:58.664 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.658+0000 7f4908085740 1 -- 172.21.15.148:0/1656089118 shutdown_connections 2024-09-19T07:20:58.665 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.658+0000 7f4908085740 1 -- 172.21.15.148:0/1656089118 wait complete. 2024-09-19T07:20:58.665 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.658+0000 7f4908085740 1 -- start start 2024-09-19T07:20:58.665 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.659+0000 7f4908085740 1 Processor -- start 2024-09-19T07:20:58.665 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.659+0000 7f4908085740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ddcfc60af0 0x55ddcfc740c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:58.665 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.659+0000 7f4908085740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ddcfc61410 0x55ddcfc6f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:58.665 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.659+0000 7f4908085740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ddcfc6bcb0 0x55ddcfc6f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:58.665 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.659+0000 7f4908085740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f49001abe80 con 0x55ddcfc6bcb0 2024-09-19T07:20:58.665 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.659+0000 7f4908085740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f49001ad2f0 con 0x55ddcfc61410 2024-09-19T07:20:58.665 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.659+0000 7f4908085740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f49001ac550 con 0x55ddcfc60af0 2024-09-19T07:20:58.665 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.659+0000 7f4908085740 10 client.0 _ll_register_callbacks cb 0x7f48f804b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:20:58.665 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.659+0000 7f48ff7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ddcfc6bcb0 0x55ddcfc6f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:58.665 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.659+0000 7f48ff7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ddcfc6bcb0 0x55ddcfc6f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59754/0 (socket says 172.21.15.148:59754) 2024-09-19T07:20:58.665 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.659+0000 7f48ff7fe640 1 -- 172.21.15.148:0/597902091 learned_addr learned my addr 172.21.15.148:0/597902091 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:20:58.666 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.659+0000 7f48feffd640 1 --2- 172.21.15.148:0/597902091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ddcfc60af0 0x55ddcfc740c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:58.666 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.659+0000 7f48fe7fc640 1 --2- 172.21.15.148:0/597902091 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ddcfc61410 0x55ddcfc6f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:58.666 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.659+0000 7f48ff7fe640 1 -- 172.21.15.148:0/597902091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ddcfc60af0 msgr2=0x55ddcfc740c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:20:58.666 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.659+0000 7f48ff7fe640 1 --2- 172.21.15.148:0/597902091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ddcfc60af0 0x55ddcfc740c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:58.666 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.659+0000 7f48ff7fe640 1 -- 172.21.15.148:0/597902091 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ddcfc61410 msgr2=0x55ddcfc6f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:20:58.666 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.659+0000 7f48ff7fe640 1 --2- 172.21.15.148:0/597902091 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ddcfc61410 0x55ddcfc6f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:58.666 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.659+0000 7f48ff7fe640 1 -- 172.21.15.148:0/597902091 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddcfc6feb0 con 0x55ddcfc6bcb0 2024-09-19T07:20:58.666 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.659+0000 7f48fe7fc640 1 --2- 172.21.15.148:0/597902091 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ddcfc61410 0x55ddcfc6f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:20:58.666 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.659+0000 7f48ff7fe640 1 --2- 172.21.15.148:0/597902091 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ddcfc6bcb0 0x55ddcfc6f970 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f48f8009390 tx=0x7f48f80093c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8ed8d8a041c595d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:58.666 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.659+0000 7f48e2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:20:58.666 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.660+0000 7f48e2ff5640 1 -- 172.21.15.148:0/597902091 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f8058040 con 0x55ddcfc6bcb0 2024-09-19T07:20:58.666 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.660+0000 7f4908085740 1 -- 172.21.15.148:0/597902091 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48f40041d0 con 0x55ddcfc6bcb0 2024-09-19T07:20:58.666 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.660+0000 7f48e2ff5640 1 -- 172.21.15.148:0/597902091 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8556+0+0 (secure 0 0 0) 0x7f48f803d420 con 0x55ddcfc6bcb0 2024-09-19T07:20:58.667 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.660+0000 7f48e2ff5640 1 -- 172.21.15.148:0/597902091 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f48f804d070 con 0x55ddcfc6bcb0 2024-09-19T07:20:58.667 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.660+0000 7f4908085740 10 client.16977 fetch_fsmap learned FSMap version 43 2024-09-19T07:20:58.667 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.660+0000 7f4908085740 1 -- 172.21.15.148:0/597902091 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55ddcfce6220 con 0x55ddcfc6bcb0 2024-09-19T07:20:58.667 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.660+0000 7f48e2ff5640 1 -- 172.21.15.148:0/597902091 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48f40041d0 con 0x55ddcfc6bcb0 2024-09-19T07:20:58.667 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.660+0000 7f48e2ff5640 1 -- 172.21.15.148:0/597902091 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 43) ==== 8362+0+0 (secure 0 0 0) 0x7f48f8047430 con 0x55ddcfc6bcb0 2024-09-19T07:20:58.667 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.660+0000 7f4908085740 10 client.16977 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T07:20:58.667 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.660+0000 7f4908085740 10 client.16977 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:20:58.667 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.660+0000 7f4908085740 20 client.16977 populate_metadata read hostname 'smithi148' 2024-09-19T07:20:58.667 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.660+0000 7f4908085740 1 --2- 172.21.15.148:0/597902091 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ddcfce68e0 0x55ddcfce8d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:58.667 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.660+0000 7f4908085740 4 client.16977 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:20:58.667 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.660+0000 7f4908085740 1 -- 172.21.15.148:0/597902091 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ddcfbccd70 con 0x55ddcfce68e0 2024-09-19T07:20:58.667 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.660+0000 7f48feffd640 1 --2- 172.21.15.148:0/597902091 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ddcfce68e0 0x55ddcfce8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:58.667 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.661+0000 7f48feffd640 1 --2- 172.21.15.148:0/597902091 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ddcfce68e0 0x55ddcfce8d00 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da4c451da16dc515 server_cookie=990391820e7ffe13 in_seq=0 out_seq=0 2024-09-19T07:20:58.667 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.661+0000 7f48e2ff5640 10 client.16977 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:20:58.673 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.672+0000 7f48e2ff5640 1 -- 172.21.15.148:0/597902091 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ddcfbccd70 con 0x55ddcfce68e0 2024-09-19T07:20:58.673 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.672+0000 7f48e2ff5640 10 client.16977 handle_command_reply: tid=0 2024-09-19T07:20:58.673 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.672+0000 7f4908085740 1 client.16977 shutdown 2024-09-19T07:20:58.673 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.672+0000 7f4908085740 1 -- 172.21.15.148:0/597902091 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ddcfc6bcb0 msgr2=0x55ddcfc6f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:58.673 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.672+0000 7f4908085740 1 --2- 172.21.15.148:0/597902091 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ddcfc6bcb0 0x55ddcfc6f970 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f48f8009390 tx=0x7f48f80093c0 comp rx=0 tx=0).stop 2024-09-19T07:20:58.674 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.672+0000 7f4908085740 1 -- 172.21.15.148:0/597902091 shutdown_connections 2024-09-19T07:20:58.674 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.672+0000 7f4908085740 1 --2- 172.21.15.148:0/597902091 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ddcfce68e0 0x55ddcfce8d00 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:58.674 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.672+0000 7f4908085740 1 --2- 172.21.15.148:0/597902091 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ddcfc6bcb0 0x55ddcfc6f970 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:58.674 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.672+0000 7f4908085740 1 --2- 172.21.15.148:0/597902091 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ddcfc61410 0x55ddcfc6f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:58.674 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.672+0000 7f48e2ff5640 0 client.16977 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:20:58.674 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.672+0000 7f4908085740 1 --2- 172.21.15.148:0/597902091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ddcfc60af0 0x55ddcfc740c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:58.674 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.672+0000 7f4908085740 1 -- 172.21.15.148:0/597902091 >> 172.21.15.148:0/597902091 conn(0x55ddcfc5d060 msgr2=0x55ddcfc6ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:58.674 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.672+0000 7f4908085740 1 -- 172.21.15.148:0/597902091 shutdown_connections 2024-09-19T07:20:58.674 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.672+0000 7f4908085740 1 -- 172.21.15.148:0/597902091 wait complete. 2024-09-19T07:20:58.674 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.672+0000 7f4908085740 20 client.16977 trim_cache size 0 max 16384 2024-09-19T07:20:58.674 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:20:58.675 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:20:58.675 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:20:58.675 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:20:58.676 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.673+0000 7f49052e4640 1 -- 172.21.15.148:0/2794028763 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f48e80a34e0 msgr2=0x7f48e80a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:58.676 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.673+0000 7f49052e4640 1 --2- 172.21.15.148:0/2794028763 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f48e80a34e0 0x7f48e80a59a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f48f804a000 tx=0x7f48f804b000 comp rx=0 tx=0).stop 2024-09-19T07:20:58.676 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.673+0000 7f49052e4640 1 -- 172.21.15.148:0/2794028763 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49001009b0 msgr2=0x7f4900198260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:58.676 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.673+0000 7f49052e4640 1 --2- 172.21.15.148:0/2794028763 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49001009b0 0x7f4900198260 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f48f000c920 tx=0x7f48f000cde0 comp rx=0 tx=0).stop 2024-09-19T07:20:58.676 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.673+0000 7f49052e4640 1 -- 172.21.15.148:0/2794028763 shutdown_connections 2024-09-19T07:20:58.676 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.673+0000 7f49052e4640 1 --2- 172.21.15.148:0/2794028763 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f48e80a34e0 0x7f48e80a59a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:58.676 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.673+0000 7f49052e4640 1 --2- 172.21.15.148:0/2794028763 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49001069c0 0x7f490019cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:58.676 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.673+0000 7f49052e4640 1 --2- 172.21.15.148:0/2794028763 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4900101350 0x7f49001987a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:58.676 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.673+0000 7f49052e4640 1 --2- 172.21.15.148:0/2794028763 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49001009b0 0x7f4900198260 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:58.676 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.673+0000 7f49052e4640 1 -- 172.21.15.148:0/2794028763 >> 172.21.15.148:0/2794028763 conn(0x7f4900077990 msgr2=0x7f49000feea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:58.676 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.673+0000 7f49052e4640 1 -- 172.21.15.148:0/2794028763 shutdown_connections 2024-09-19T07:20:58.676 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:20:58.673+0000 7f49052e4640 1 -- 172.21.15.148:0/2794028763 wait complete. 2024-09-19T07:20:59.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:20:59 smithi148 ceph-mon[31180]: pgmap v307: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 29 KiB/s wr, 13 op/s 2024-09-19T07:20:59.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:20:59 smithi165 ceph-mon[35326]: pgmap v307: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 29 KiB/s wr, 13 op/s 2024-09-19T07:20:59.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:20:59 smithi179 ceph-mon[35716]: pgmap v307: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 29 KiB/s wr, 13 op/s 2024-09-19T07:21:01.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:01 smithi148 ceph-mon[31180]: pgmap v308: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 31 KiB/s wr, 14 op/s 2024-09-19T07:21:01.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:01 smithi165 ceph-mon[35326]: pgmap v308: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 31 KiB/s wr, 14 op/s 2024-09-19T07:21:01.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:01 smithi179 ceph-mon[35716]: pgmap v308: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 31 KiB/s wr, 14 op/s 2024-09-19T07:21:03.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:03 smithi148 ceph-mon[31180]: pgmap v309: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 54 KiB/s wr, 20 op/s 2024-09-19T07:21:03.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:03 smithi165 ceph-mon[35326]: pgmap v309: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 54 KiB/s wr, 20 op/s 2024-09-19T07:21:03.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:03 smithi179 ceph-mon[35716]: pgmap v309: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 54 KiB/s wr, 20 op/s 2024-09-19T07:21:05.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:05 smithi148 ceph-mon[31180]: pgmap v310: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 45 KiB/s wr, 30 op/s 2024-09-19T07:21:05.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:05 smithi165 ceph-mon[35326]: pgmap v310: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 45 KiB/s wr, 30 op/s 2024-09-19T07:21:05.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:05 smithi179 ceph-mon[35716]: pgmap v310: 97 pgs: 97 active+clean; 1.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 45 KiB/s wr, 30 op/s 2024-09-19T07:21:07.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:07 smithi148 ceph-mon[31180]: pgmap v311: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 127 KiB/s wr, 96 op/s 2024-09-19T07:21:07.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:07 smithi165 ceph-mon[35326]: pgmap v311: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 127 KiB/s wr, 96 op/s 2024-09-19T07:21:07.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:07 smithi179 ceph-mon[35716]: pgmap v311: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 127 KiB/s wr, 96 op/s 2024-09-19T07:21:09.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:09 smithi148 ceph-mon[31180]: pgmap v312: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 118 KiB/s wr, 92 op/s 2024-09-19T07:21:09.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:09 smithi165 ceph-mon[35326]: pgmap v312: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 118 KiB/s wr, 92 op/s 2024-09-19T07:21:09.754 INFO:tasks.quiescer.fs.[cephfs]:Total duration (60) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T07:21:09.754 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-09-19T07:21:09.755 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:21:09.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:09 smithi179 ceph-mon[35716]: pgmap v312: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 118 KiB/s wr, 92 op/s 2024-09-19T07:21:10.018 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:21:10.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.502+0000 7f20fefc7640 1 -- 172.21.15.148:0/4120896076 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20f8106a70 msgr2=0x7f20f8106e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:10.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.502+0000 7f20fefc7640 1 --2- 172.21.15.148:0/4120896076 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20f8106a70 0x7f20f8106e50 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f20ec009930 tx=0x7f20ec02a420 comp rx=0 tx=0).stop 2024-09-19T07:21:10.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.502+0000 7f20fefc7640 1 -- 172.21.15.148:0/4120896076 shutdown_connections 2024-09-19T07:21:10.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.502+0000 7f20fefc7640 1 --2- 172.21.15.148:0/4120896076 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20f8101410 0x7f20f810d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:10.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.502+0000 7f20fefc7640 1 --2- 172.21.15.148:0/4120896076 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20f8100a70 0x7f20f8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:10.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.502+0000 7f20fefc7640 1 --2- 172.21.15.148:0/4120896076 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20f8106a70 0x7f20f8106e50 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:10.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.502+0000 7f20fefc7640 1 -- 172.21.15.148:0/4120896076 >> 172.21.15.148:0/4120896076 conn(0x7f20f80fc790 msgr2=0x7f20f80febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:10.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.502+0000 7f20fefc7640 1 -- 172.21.15.148:0/4120896076 shutdown_connections 2024-09-19T07:21:10.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.502+0000 7f20fefc7640 1 -- 172.21.15.148:0/4120896076 wait complete. 2024-09-19T07:21:10.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.503+0000 7f20fefc7640 1 Processor -- start 2024-09-19T07:21:10.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.503+0000 7f20fefc7640 1 -- start start 2024-09-19T07:21:10.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.503+0000 7f20fefc7640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20f8100a70 0x7f20f80fce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:10.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.503+0000 7f20fefc7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20f8101410 0x7f20f80fd360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:10.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.503+0000 7f20fefc7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20f8106a70 0x7f20f80fd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:10.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.503+0000 7f20fefc7640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f20f8110e30 con 0x7f20f8101410 2024-09-19T07:21:10.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.503+0000 7f20fefc7640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f20f8110cb0 con 0x7f20f8100a70 2024-09-19T07:21:10.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.503+0000 7f20fefc7640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f20f8110fb0 con 0x7f20f8106a70 2024-09-19T07:21:10.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.504+0000 7f20f7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20f8101410 0x7f20f80fd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:10.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.504+0000 7f20f7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20f8101410 0x7f20f80fd360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59526/0 (socket says 172.21.15.148:59526) 2024-09-19T07:21:10.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.504+0000 7f20f7fff640 1 -- 172.21.15.148:0/1989793054 learned_addr learned my addr 172.21.15.148:0/1989793054 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:21:10.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.504+0000 7f20fcd63640 1 --2- 172.21.15.148:0/1989793054 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20f8100a70 0x7f20f80fce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:10.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.504+0000 7f20fd564640 1 --2- 172.21.15.148:0/1989793054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20f8106a70 0x7f20f80fd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:10.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.504+0000 7f20f7fff640 1 -- 172.21.15.148:0/1989793054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20f8106a70 msgr2=0x7f20f80fd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:10.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.504+0000 7f20f7fff640 1 --2- 172.21.15.148:0/1989793054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20f8106a70 0x7f20f80fd8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:10.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.504+0000 7f20f7fff640 1 -- 172.21.15.148:0/1989793054 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20f8100a70 msgr2=0x7f20f80fce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:10.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.504+0000 7f20f7fff640 1 --2- 172.21.15.148:0/1989793054 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20f8100a70 0x7f20f80fce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:10.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.504+0000 7f20f7fff640 1 -- 172.21.15.148:0/1989793054 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f81a68c0 con 0x7f20f8101410 2024-09-19T07:21:10.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.504+0000 7f20f7fff640 1 --2- 172.21.15.148:0/1989793054 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20f8101410 0x7f20f80fd360 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f20e400d950 tx=0x7f20e400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:10.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.504+0000 7f20f5ffb640 1 -- 172.21.15.148:0/1989793054 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e4017030 con 0x7f20f8101410 2024-09-19T07:21:10.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.504+0000 7f20fefc7640 1 -- 172.21.15.148:0/1989793054 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20f81a6bb0 con 0x7f20f8101410 2024-09-19T07:21:10.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.504+0000 7f20f5ffb640 1 -- 172.21.15.148:0/1989793054 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20e4004020 con 0x7f20f8101410 2024-09-19T07:21:10.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.504+0000 7f20f5ffb640 1 -- 172.21.15.148:0/1989793054 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e40047a0 con 0x7f20f8101410 2024-09-19T07:21:10.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.505+0000 7f20fefc7640 1 -- 172.21.15.148:0/1989793054 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20f81a7140 con 0x7f20f8101410 2024-09-19T07:21:10.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.505+0000 7f20fefc7640 1 -- 172.21.15.148:0/1989793054 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20f8100ed0 con 0x7f20f8101410 2024-09-19T07:21:10.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.507+0000 7f20f5ffb640 1 -- 172.21.15.148:0/1989793054 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f20e40041d0 con 0x7f20f8101410 2024-09-19T07:21:10.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.507+0000 7f20f5ffb640 1 --2- 172.21.15.148:0/1989793054 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f20e80a33b0 0x7f20e80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:10.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.508+0000 7f20f5ffb640 1 -- 172.21.15.148:0/1989793054 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8556+0+0 (secure 0 0 0) 0x7f20e40cfd10 con 0x7f20f8101410 2024-09-19T07:21:10.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.508+0000 7f20fcd63640 1 --2- 172.21.15.148:0/1989793054 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f20e80a33b0 0x7f20e80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:10.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.508+0000 7f20fcd63640 1 --2- 172.21.15.148:0/1989793054 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f20e80a33b0 0x7f20e80a5870 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f20ec009900 tx=0x7f20ec0058d0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:10.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.511+0000 7f20f5ffb640 1 -- 172.21.15.148:0/1989793054 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f20e409c6d0 con 0x7f20f8101410 2024-09-19T07:21:10.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.744+0000 7f20fefc7640 1 -- 172.21.15.148:0/1989793054 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f20f80fe350 con 0x7f20f8101410 2024-09-19T07:21:10.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.744+0000 7f20f5ffb640 1 -- 172.21.15.148:0/1989793054 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+11944 (secure 0 0 0) 0x7f20e409bfd0 con 0x7f20f8101410 2024-09-19T07:21:10.746 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:21:10.746 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":43,"btime":"2024-09-19T07:20:20:209191+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/4263868576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":4263868576},{"type":"v1","addr":"172.21.15.148:6841","nonce":4263868576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":25606,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3891676893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3891676893},{"type":"v1","addr":"172.21.15.179:6835","nonce":3891676893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":43,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:09:19.543369+0000","modified":"2024-09-19T07:20:19.813692+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24457,"mds_1":24437,"mds_2":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":75,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":71,"addr":"172.21.15.165:6839/3993490234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":3993490234},{"type":"v1","addr":"172.21.15.165:6839","nonce":3993490234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25823":{"gid":25823,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6835/380886107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":380886107},{"type":"v1","addr":"172.21.15.165:6835","nonce":380886107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24457,"qdb_cluster":[24457,24437,24436]},"id":1}]} 2024-09-19T07:21:10.746 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 43 2024-09-19T07:21:10.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.747+0000 7f20fefc7640 1 -- 172.21.15.148:0/1989793054 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f20e80a33b0 msgr2=0x7f20e80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:10.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.747+0000 7f20fefc7640 1 --2- 172.21.15.148:0/1989793054 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f20e80a33b0 0x7f20e80a5870 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f20ec009900 tx=0x7f20ec0058d0 comp rx=0 tx=0).stop 2024-09-19T07:21:10.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.747+0000 7f20fefc7640 1 -- 172.21.15.148:0/1989793054 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20f8101410 msgr2=0x7f20f80fd360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:10.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.747+0000 7f20fefc7640 1 --2- 172.21.15.148:0/1989793054 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20f8101410 0x7f20f80fd360 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f20e400d950 tx=0x7f20e400de10 comp rx=0 tx=0).stop 2024-09-19T07:21:10.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.747+0000 7f20fefc7640 1 -- 172.21.15.148:0/1989793054 shutdown_connections 2024-09-19T07:21:10.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.747+0000 7f20fefc7640 1 --2- 172.21.15.148:0/1989793054 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f20e80a33b0 0x7f20e80a5870 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:10.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.747+0000 7f20fefc7640 1 --2- 172.21.15.148:0/1989793054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20f8106a70 0x7f20f80fd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:10.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.747+0000 7f20fefc7640 1 --2- 172.21.15.148:0/1989793054 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20f8101410 0x7f20f80fd360 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:10.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.747+0000 7f20fefc7640 1 --2- 172.21.15.148:0/1989793054 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20f8100a70 0x7f20f80fce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:10.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.747+0000 7f20fefc7640 1 -- 172.21.15.148:0/1989793054 >> 172.21.15.148:0/1989793054 conn(0x7f20f80fc790 msgr2=0x7f20f806a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:10.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.747+0000 7f20fefc7640 1 -- 172.21.15.148:0/1989793054 shutdown_connections 2024-09-19T07:21:10.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:10.747+0000 7f20fefc7640 1 -- 172.21.15.148:0/1989793054 wait complete. 2024-09-19T07:21:11.508 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:11 smithi148 ceph-mon[31180]: pgmap v313: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 125 KiB/s wr, 93 op/s 2024-09-19T07:21:11.508 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:11 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/1989793054' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:21:11.560 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24457 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-09-19T07:21:11.561 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24457 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-09-19T07:21:11.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:11 smithi165 ceph-mon[35326]: pgmap v313: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 125 KiB/s wr, 93 op/s 2024-09-19T07:21:11.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:11 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/1989793054' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:21:11.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:11 smithi179 ceph-mon[35716]: pgmap v313: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 125 KiB/s wr, 93 op/s 2024-09-19T07:21:11.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:11 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/1989793054' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:21:11.826 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.823+0000 7f7ba759e640 1 -- 172.21.15.148:0/4026201643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ba81018b0 msgr2=0x7f7ba8101d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:11.826 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.823+0000 7f7ba759e640 1 --2- 172.21.15.148:0/4026201643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ba81018b0 0x7f7ba8101d10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c009930 tx=0x7f7b9c02a480 comp rx=0 tx=0).stop 2024-09-19T07:21:11.827 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.825+0000 7f7ba759e640 1 -- 172.21.15.148:0/4026201643 shutdown_connections 2024-09-19T07:21:11.827 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.825+0000 7f7ba759e640 1 --2- 172.21.15.148:0/4026201643 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ba8102250 0x7f7ba810e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:11.827 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.825+0000 7f7ba759e640 1 --2- 172.21.15.148:0/4026201643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ba81018b0 0x7f7ba8101d10 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:11.827 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.825+0000 7f7ba759e640 1 --2- 172.21.15.148:0/4026201643 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ba81078c0 0x7f7ba8107ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:11.827 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.825+0000 7f7ba759e640 1 -- 172.21.15.148:0/4026201643 >> 172.21.15.148:0/4026201643 conn(0x7f7ba80fd5d0 msgr2=0x7f7ba80ff9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:11.828 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.827+0000 7f7ba759e640 1 -- 172.21.15.148:0/4026201643 shutdown_connections 2024-09-19T07:21:11.832 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.829+0000 7f7ba759e640 1 -- 172.21.15.148:0/4026201643 wait complete. 2024-09-19T07:21:11.832 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.830+0000 7f7ba759e640 1 Processor -- start 2024-09-19T07:21:11.832 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.830+0000 7f7ba759e640 1 -- start start 2024-09-19T07:21:11.832 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.831+0000 7f7ba759e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ba81018b0 0x7f7ba8073a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:11.832 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.831+0000 7f7ba759e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ba8102250 0x7f7ba806caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:11.833 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.831+0000 7f7ba759e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ba81078c0 0x7f7ba806d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:11.833 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.831+0000 7f7ba759e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba8076140 con 0x7f7ba8102250 2024-09-19T07:21:11.833 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.831+0000 7f7ba759e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba8075fc0 con 0x7f7ba81018b0 2024-09-19T07:21:11.833 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.831+0000 7f7ba759e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba80762c0 con 0x7f7ba81078c0 2024-09-19T07:21:11.834 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.832+0000 7f7ba5d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ba8102250 0x7f7ba806caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:11.834 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.832+0000 7f7ba5d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ba8102250 0x7f7ba806caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59540/0 (socket says 172.21.15.148:59540) 2024-09-19T07:21:11.834 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.832+0000 7f7ba5d9b640 1 -- 172.21.15.148:0/2892890932 learned_addr learned my addr 172.21.15.148:0/2892890932 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:21:11.834 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.832+0000 7f7ba6d9d640 1 --2- 172.21.15.148:0/2892890932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ba81078c0 0x7f7ba806d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:11.836 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.834+0000 7f7ba5d9b640 1 -- 172.21.15.148:0/2892890932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ba81078c0 msgr2=0x7f7ba806d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:11.836 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.834+0000 7f7ba5d9b640 1 --2- 172.21.15.148:0/2892890932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ba81078c0 0x7f7ba806d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:11.836 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.834+0000 7f7ba5d9b640 1 -- 172.21.15.148:0/2892890932 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ba81018b0 msgr2=0x7f7ba8073a70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T07:21:11.836 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.834+0000 7f7ba5d9b640 1 --2- 172.21.15.148:0/2892890932 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ba81018b0 0x7f7ba8073a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:11.836 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.834+0000 7f7ba5d9b640 1 -- 172.21.15.148:0/2892890932 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ba806d670 con 0x7f7ba8102250 2024-09-19T07:21:11.836 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.834+0000 7f7ba5d9b640 1 --2- 172.21.15.148:0/2892890932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ba8102250 0x7f7ba806caf0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c005ab0 tx=0x7f7b9c003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:11.838 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.836+0000 7f7b977fe640 1 -- 172.21.15.148:0/2892890932 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c040030 con 0x7f7ba8102250 2024-09-19T07:21:11.838 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.836+0000 7f7b977fe640 1 -- 172.21.15.148:0/2892890932 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b9c004180 con 0x7f7ba8102250 2024-09-19T07:21:11.838 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.836+0000 7f7b977fe640 1 -- 172.21.15.148:0/2892890932 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c03c9a0 con 0x7f7ba8102250 2024-09-19T07:21:11.838 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.836+0000 7f7ba759e640 1 -- 172.21.15.148:0/2892890932 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ba806d900 con 0x7f7ba8102250 2024-09-19T07:21:11.838 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.836+0000 7f7ba759e640 1 -- 172.21.15.148:0/2892890932 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ba8071830 con 0x7f7ba8102250 2024-09-19T07:21:11.844 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.842+0000 7f7baf9c1740 1 Processor -- start 2024-09-19T07:21:11.845 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.843+0000 7f7baf9c1740 1 -- start start 2024-09-19T07:21:11.845 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.843+0000 7f7baf9c1740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561a7bb44cc0 0x561a7bb450a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:11.845 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.843+0000 7f7baf9c1740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561a7bb455e0 0x561a7bb4f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:11.845 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.843+0000 7f7baf9c1740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561a7bb4fe80 0x561a7bb52270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:11.845 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.843+0000 7f7baf9c1740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x561a7baa92f0 con 0x561a7bb455e0 2024-09-19T07:21:11.845 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.843+0000 7f7baf9c1740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x561a7ba51270 con 0x561a7bb4fe80 2024-09-19T07:21:11.845 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.843+0000 7f7baf9c1740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x561a7baa52b0 con 0x561a7bb44cc0 2024-09-19T07:21:11.846 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.844+0000 7f7ba659c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561a7bb455e0 0x561a7bb4f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:11.846 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.844+0000 7f7ba659c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561a7bb455e0 0x561a7bb4f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59544/0 (socket says 172.21.15.148:59544) 2024-09-19T07:21:11.846 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.844+0000 7f7ba659c640 1 -- 172.21.15.148:0/649954288 learned_addr learned my addr 172.21.15.148:0/649954288 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:21:11.846 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.844+0000 7f7ba6d9d640 1 --2- 172.21.15.148:0/649954288 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561a7bb44cc0 0x561a7bb450a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:11.849 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.848+0000 7f7b977fe640 1 -- 172.21.15.148:0/2892890932 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f7b9c043030 con 0x7f7ba8102250 2024-09-19T07:21:11.850 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.848+0000 7f7ba6d9d640 1 -- 172.21.15.148:0/649954288 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561a7bb4fe80 msgr2=0x561a7bb52270 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T07:21:11.850 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.848+0000 7f7ba6d9d640 1 --2- 172.21.15.148:0/649954288 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561a7bb4fe80 0x561a7bb52270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:11.850 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.848+0000 7f7ba6d9d640 1 -- 172.21.15.148:0/649954288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561a7bb455e0 msgr2=0x561a7bb4f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:11.850 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.848+0000 7f7ba6d9d640 1 --2- 172.21.15.148:0/649954288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561a7bb455e0 0x561a7bb4f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:11.850 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.848+0000 7f7ba6d9d640 1 -- 172.21.15.148:0/649954288 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a7ba50340 con 0x561a7bb44cc0 2024-09-19T07:21:11.851 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.849+0000 7f7ba6d9d640 1 --2- 172.21.15.148:0/649954288 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561a7bb44cc0 0x561a7bb450a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7ba0009f70 tx=0x7f7ba0009650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58ebffa6f80bbd15 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:11.851 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.849+0000 7f7b977fe640 1 --2- 172.21.15.148:0/2892890932 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f7b900a35c0 0x7f7b900a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:11.851 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.850+0000 7f7b977fe640 1 -- 172.21.15.148:0/2892890932 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8600+0+0 (secure 0 0 0) 0x7f7b9c0f0100 con 0x7f7ba8102250 2024-09-19T07:21:11.852 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.851+0000 7f7b94ff9640 1 -- 172.21.15.148:0/649954288 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba0013850 con 0x561a7bb44cc0 2024-09-19T07:21:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.851+0000 7f7b94ff9640 1 -- 172.21.15.148:0/649954288 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ba0019070 con 0x561a7bb44cc0 2024-09-19T07:21:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.851+0000 7f7ba659c640 1 --2- 172.21.15.148:0/2892890932 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f7b900a35c0 0x7f7b900a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.852+0000 7f7baf9c1740 1 -- 172.21.15.148:0/649954288 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561a7bb44cc0 msgr2=0x561a7bb450a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:11.854 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.852+0000 7f7baf9c1740 1 --2- 172.21.15.148:0/649954288 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561a7bb44cc0 0x561a7bb450a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7ba0009f70 tx=0x7f7ba0009650 comp rx=0 tx=0).stop 2024-09-19T07:21:11.854 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.853+0000 7f7baf9c1740 1 -- 172.21.15.148:0/649954288 shutdown_connections 2024-09-19T07:21:11.855 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.853+0000 7f7baf9c1740 1 --2- 172.21.15.148:0/649954288 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561a7bb4fe80 0x561a7bb52270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:11.855 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.853+0000 7f7baf9c1740 1 --2- 172.21.15.148:0/649954288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561a7bb455e0 0x561a7bb4f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:11.855 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.853+0000 7f7baf9c1740 1 --2- 172.21.15.148:0/649954288 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561a7bb44cc0 0x561a7bb450a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:11.855 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.853+0000 7f7baf9c1740 1 -- 172.21.15.148:0/649954288 >> 172.21.15.148:0/649954288 conn(0x561a7bb41230 msgr2=0x561a7bb41610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:11.855 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.853+0000 7f7baf9c1740 1 -- 172.21.15.148:0/649954288 shutdown_connections 2024-09-19T07:21:11.855 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.853+0000 7f7ba659c640 1 --2- 172.21.15.148:0/2892890932 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f7b900a35c0 0x7f7b900a5a80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x561a7bb42090 tx=0x7f7b98008040 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.853+0000 7f7baf9c1740 1 -- 172.21.15.148:0/649954288 wait complete. 2024-09-19T07:21:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.854+0000 7f7baf9c1740 1 -- start start 2024-09-19T07:21:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.854+0000 7f7baf9c1740 1 Processor -- start 2024-09-19T07:21:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.854+0000 7f7baf9c1740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561a7bb44cc0 0x561a7bb4ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.854+0000 7f7baf9c1740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561a7bb455e0 0x561a7bb4d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:11.857 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.854+0000 7f7baf9c1740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561a7bb4fe80 0x561a7bb4d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:11.857 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.854+0000 7f7baf9c1740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x561a7bb52aa0 con 0x561a7bb455e0 2024-09-19T07:21:11.857 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.854+0000 7f7baf9c1740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x561a7ba32290 con 0x561a7bb4fe80 2024-09-19T07:21:11.857 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.854+0000 7f7baf9c1740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x561a7bb52c20 con 0x561a7bb44cc0 2024-09-19T07:21:11.857 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.854+0000 7f7baf9c1740 10 client.0 _ll_register_callbacks cb 0x561a7ba63140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:21:11.857 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.855+0000 7f7ba6d9d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561a7bb4fe80 0x561a7bb4d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:11.857 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.855+0000 7f7ba6d9d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561a7bb4fe80 0x561a7bb4d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:57034/0 (socket says 172.21.15.148:57034) 2024-09-19T07:21:11.857 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.855+0000 7f7ba6d9d640 1 -- 172.21.15.148:0/3522367539 learned_addr learned my addr 172.21.15.148:0/3522367539 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:21:11.857 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.855+0000 7f7ba659c640 1 --2- 172.21.15.148:0/3522367539 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561a7bb44cc0 0x561a7bb4ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:11.858 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.856+0000 7f7ba5d9b640 1 --2- 172.21.15.148:0/3522367539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561a7bb455e0 0x561a7bb4d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:11.859 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.857+0000 7f7ba6d9d640 1 -- 172.21.15.148:0/3522367539 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561a7bb44cc0 msgr2=0x561a7bb4ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:11.859 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.857+0000 7f7ba6d9d640 1 --2- 172.21.15.148:0/3522367539 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561a7bb44cc0 0x561a7bb4ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:11.859 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.857+0000 7f7ba6d9d640 1 -- 172.21.15.148:0/3522367539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561a7bb455e0 msgr2=0x561a7bb4d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:11.859 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.857+0000 7f7ba6d9d640 1 --2- 172.21.15.148:0/3522367539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561a7bb455e0 0x561a7bb4d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:11.859 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.857+0000 7f7ba6d9d640 1 -- 172.21.15.148:0/3522367539 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a7b7bc210 con 0x561a7bb4fe80 2024-09-19T07:21:11.860 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.858+0000 7f7ba6d9d640 1 --2- 172.21.15.148:0/3522367539 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561a7bb4fe80 0x561a7bb4d770 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7ba0014b90 tx=0x7f7ba0014650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd8408fc58c69e13 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:11.860 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.858+0000 7f7b8dffb640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-19T07:21:11.860 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.858+0000 7f7b8dffb640 1 -- 172.21.15.148:0/3522367539 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba0013850 con 0x561a7bb4fe80 2024-09-19T07:21:11.860 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.859+0000 7f7baf9c1740 1 -- 172.21.15.148:0/3522367539 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ba0019070 con 0x561a7bb4fe80 2024-09-19T07:21:11.860 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.859+0000 7f7b8dffb640 1 -- 172.21.15.148:0/3522367539 <== mon.2 v2:172.21.15.165:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8600+0+0 (secure 0 0 0) 0x7f7ba00139f0 con 0x561a7bb4fe80 2024-09-19T07:21:11.861 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.859+0000 7f7b8dffb640 1 -- 172.21.15.148:0/3522367539 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f7ba0013c10 con 0x561a7bb4fe80 2024-09-19T07:21:11.861 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.859+0000 7f7baf9c1740 10 client.26162 fetch_fsmap learned FSMap version 43 2024-09-19T07:21:11.861 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.859+0000 7f7baf9c1740 1 -- 172.21.15.148:0/3522367539 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x561a7b888620 con 0x561a7bb4fe80 2024-09-19T07:21:11.861 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.860+0000 7f7b8dffb640 1 -- 172.21.15.148:0/3522367539 <== mon.2 v2:172.21.15.165:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ba0019070 con 0x561a7bb4fe80 2024-09-19T07:21:11.862 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.860+0000 7f7b8dffb640 1 -- 172.21.15.148:0/3522367539 <== mon.2 v2:172.21.15.165:3300/0 5 ==== fsmap(e 43) ==== 8362+0+0 (secure 0 0 0) 0x7f7ba001d400 con 0x561a7bb4fe80 2024-09-19T07:21:11.862 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.860+0000 7f7baf9c1740 10 client.26162 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T07:21:11.862 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.860+0000 7f7baf9c1740 10 client.26162 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:21:11.862 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.860+0000 7f7baf9c1740 20 client.26162 populate_metadata read hostname 'smithi148' 2024-09-19T07:21:11.862 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.860+0000 7f7baf9c1740 1 --2- 172.21.15.148:0/3522367539 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561a7bb60240 0x561a7bb626a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:11.862 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.860+0000 7f7baf9c1740 4 client.26162 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:21:11.863 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.860+0000 7f7baf9c1740 1 -- 172.21.15.148:0/3522367539 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561a7bab6a20 con 0x561a7bb60240 2024-09-19T07:21:11.863 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.860+0000 7f7ba659c640 1 --2- 172.21.15.148:0/3522367539 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561a7bb60240 0x561a7bb626a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:11.865 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.861+0000 7f7ba659c640 1 --2- 172.21.15.148:0/3522367539 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561a7bb60240 0x561a7bb626a0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd04b787cd4b1883 server_cookie=e3d8cb01cc902ec8 in_seq=0 out_seq=0 2024-09-19T07:21:11.865 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.863+0000 7f7b8dffb640 10 client.26162 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:21:11.868 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.866+0000 7f7b8dffb640 1 -- 172.21.15.148:0/3522367539 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561a7bab6a20 con 0x561a7bb60240 2024-09-19T07:21:11.868 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.866+0000 7f7b8dffb640 10 client.26162 handle_command_reply: tid=0 2024-09-19T07:21:11.868 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.866+0000 7f7baf9c1740 1 client.26162 shutdown 2024-09-19T07:21:11.868 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.866+0000 7f7baf9c1740 1 -- 172.21.15.148:0/3522367539 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561a7bb4fe80 msgr2=0x561a7bb4d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:11.868 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.866+0000 7f7baf9c1740 1 --2- 172.21.15.148:0/3522367539 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561a7bb4fe80 0x561a7bb4d770 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7ba0014b90 tx=0x7f7ba0014650 comp rx=0 tx=0).stop 2024-09-19T07:21:11.868 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.866+0000 7f7baf9c1740 1 -- 172.21.15.148:0/3522367539 shutdown_connections 2024-09-19T07:21:11.869 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.866+0000 7f7baf9c1740 1 --2- 172.21.15.148:0/3522367539 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561a7bb60240 0x561a7bb626a0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:11.869 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.866+0000 7f7baf9c1740 1 --2- 172.21.15.148:0/3522367539 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561a7bb4fe80 0x561a7bb4d770 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:11.869 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.866+0000 7f7baf9c1740 1 --2- 172.21.15.148:0/3522367539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561a7bb455e0 0x561a7bb4d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:11.869 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.866+0000 7f7baf9c1740 1 --2- 172.21.15.148:0/3522367539 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561a7bb44cc0 0x561a7bb4ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:11.869 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.866+0000 7f7baf9c1740 1 -- 172.21.15.148:0/3522367539 >> 172.21.15.148:0/3522367539 conn(0x561a7bb41230 msgr2=0x561a7bb46f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:11.869 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.867+0000 7f7b8dffb640 0 client.26162 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:21:11.872 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.871+0000 7f7baf9c1740 1 -- 172.21.15.148:0/3522367539 shutdown_connections 2024-09-19T07:21:11.872 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.871+0000 7f7baf9c1740 1 -- 172.21.15.148:0/3522367539 wait complete. 2024-09-19T07:21:11.872 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.871+0000 7f7baf9c1740 20 client.26162 trim_cache size 0 max 16384 2024-09-19T07:21:11.901 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.899+0000 7f7baf9c1740 1 Processor -- start 2024-09-19T07:21:11.903 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.901+0000 7f7baf9c1740 1 -- start start 2024-09-19T07:21:11.903 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.901+0000 7f7baf9c1740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561a7bb44cc0 0x561a7bb4d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:11.904 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.901+0000 7f7baf9c1740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561a7bb455e0 0x561a7bb47fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:11.904 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.901+0000 7f7baf9c1740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561a7bb4fe80 0x561a7bb484e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:11.904 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.901+0000 7f7baf9c1740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7b88011280 con 0x561a7bb44cc0 2024-09-19T07:21:11.904 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.901+0000 7f7baf9c1740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7b8800eaf0 con 0x561a7bb4fe80 2024-09-19T07:21:11.904 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.901+0000 7f7baf9c1740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7b8800c960 con 0x561a7bb455e0 2024-09-19T07:21:11.904 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.902+0000 7f7ba6d9d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561a7bb4fe80 0x561a7bb484e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:11.904 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.902+0000 7f7ba6d9d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561a7bb4fe80 0x561a7bb484e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:57044/0 (socket says 172.21.15.148:57044) 2024-09-19T07:21:11.904 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.902+0000 7f7ba6d9d640 1 -- 172.21.15.148:0/3997200306 learned_addr learned my addr 172.21.15.148:0/3997200306 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:21:11.904 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.902+0000 7f7ba6d9d640 1 -- 172.21.15.148:0/3997200306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561a7bb455e0 msgr2=0x561a7bb47fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:11.904 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.902+0000 7f7ba6d9d640 1 --2- 172.21.15.148:0/3997200306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561a7bb455e0 0x561a7bb47fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:11.904 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.902+0000 7f7ba6d9d640 1 -- 172.21.15.148:0/3997200306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561a7bb44cc0 msgr2=0x561a7bb4d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:11.904 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.902+0000 7f7ba6d9d640 1 --2- 172.21.15.148:0/3997200306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561a7bb44cc0 0x561a7bb4d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:11.905 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.902+0000 7f7ba6d9d640 1 -- 172.21.15.148:0/3997200306 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a7bb45410 con 0x561a7bb4fe80 2024-09-19T07:21:11.905 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.902+0000 7f7ba6d9d640 1 --2- 172.21.15.148:0/3997200306 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561a7bb4fe80 0x561a7bb484e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7ba0009f70 tx=0x7f7ba0004a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a66c460a8326566f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:11.905 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.903+0000 7f7b8ffff640 1 -- 172.21.15.148:0/3997200306 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba0009b60 con 0x561a7bb4fe80 2024-09-19T07:21:11.905 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.903+0000 7f7b8ffff640 1 -- 172.21.15.148:0/3997200306 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ba0019070 con 0x561a7bb4fe80 2024-09-19T07:21:11.905 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.903+0000 7f7b8ffff640 1 -- 172.21.15.148:0/3997200306 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba0027430 con 0x561a7bb4fe80 2024-09-19T07:21:11.906 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.904+0000 7f7baf9c1740 1 -- 172.21.15.148:0/3997200306 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561a7bb4fe80 msgr2=0x561a7bb484e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:11.906 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.904+0000 7f7baf9c1740 1 --2- 172.21.15.148:0/3997200306 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561a7bb4fe80 0x561a7bb484e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7ba0009f70 tx=0x7f7ba0004a30 comp rx=0 tx=0).stop 2024-09-19T07:21:11.906 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.904+0000 7f7baf9c1740 1 -- 172.21.15.148:0/3997200306 shutdown_connections 2024-09-19T07:21:11.906 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.904+0000 7f7baf9c1740 1 --2- 172.21.15.148:0/3997200306 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561a7bb4fe80 0x561a7bb484e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:11.906 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.904+0000 7f7baf9c1740 1 --2- 172.21.15.148:0/3997200306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561a7bb455e0 0x561a7bb47fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:11.906 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.904+0000 7f7baf9c1740 1 --2- 172.21.15.148:0/3997200306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561a7bb44cc0 0x561a7bb4d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:11.906 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.904+0000 7f7baf9c1740 1 -- 172.21.15.148:0/3997200306 >> 172.21.15.148:0/3997200306 conn(0x561a7bb41230 msgr2=0x561a7bb41610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:11.907 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.905+0000 7f7baf9c1740 1 -- 172.21.15.148:0/3997200306 shutdown_connections 2024-09-19T07:21:11.907 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.905+0000 7f7baf9c1740 1 -- 172.21.15.148:0/3997200306 wait complete. 2024-09-19T07:21:11.907 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.906+0000 7f7baf9c1740 1 -- start start 2024-09-19T07:21:11.907 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.906+0000 7f7baf9c1740 1 Processor -- start 2024-09-19T07:21:11.910 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.908+0000 7f7baf9c1740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561a7bb44cc0 0x561a7bb583d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:11.910 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.908+0000 7f7baf9c1740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561a7bb455e0 0x561a7bb4a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:11.910 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.908+0000 7f7baf9c1740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561a7bb4fe80 0x561a7bb4a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:11.910 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.908+0000 7f7baf9c1740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7b8800cfb0 con 0x561a7bb44cc0 2024-09-19T07:21:11.910 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.908+0000 7f7baf9c1740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7b8800e420 con 0x561a7bb455e0 2024-09-19T07:21:11.911 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.908+0000 7f7baf9c1740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7b8800d680 con 0x561a7bb4fe80 2024-09-19T07:21:11.911 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.908+0000 7f7baf9c1740 10 client.0 _ll_register_callbacks cb 0x7f7ba0009dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:21:11.911 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.908+0000 7f7ba6d9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561a7bb4fe80 0x561a7bb4a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:11.911 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.908+0000 7f7ba6d9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561a7bb4fe80 0x561a7bb4a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:54092/0 (socket says 172.21.15.148:54092) 2024-09-19T07:21:11.911 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.908+0000 7f7ba6d9d640 1 -- 172.21.15.148:0/7581160 learned_addr learned my addr 172.21.15.148:0/7581160 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:21:11.911 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.909+0000 7f7ba5d9b640 1 --2- 172.21.15.148:0/7581160 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561a7bb455e0 0x561a7bb4a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:11.911 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.909+0000 7f7ba6d9d640 1 -- 172.21.15.148:0/7581160 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561a7bb455e0 msgr2=0x561a7bb4a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:11.911 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.909+0000 7f7ba6d9d640 1 --2- 172.21.15.148:0/7581160 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561a7bb455e0 0x561a7bb4a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:11.911 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.909+0000 7f7ba6d9d640 1 -- 172.21.15.148:0/7581160 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561a7bb44cc0 msgr2=0x561a7bb583d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:11.911 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.909+0000 7f7ba6d9d640 1 --2- 172.21.15.148:0/7581160 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561a7bb44cc0 0x561a7bb583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:11.912 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.909+0000 7f7ba6d9d640 1 -- 172.21.15.148:0/7581160 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a7bb4ab20 con 0x561a7bb4fe80 2024-09-19T07:21:11.912 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.910+0000 7f7ba6d9d640 1 --2- 172.21.15.148:0/7581160 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561a7bb4fe80 0x561a7bb4a5e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7ba0009f40 tx=0x7f7ba001dfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1706ad2e928d3436 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:11.912 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.911+0000 7f7b8dffb640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-19T07:21:11.913 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.911+0000 7f7b8dffb640 1 -- 172.21.15.148:0/7581160 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba001da70 con 0x561a7bb4fe80 2024-09-19T07:21:11.913 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.911+0000 7f7baf9c1740 1 -- 172.21.15.148:0/7581160 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ba0019070 con 0x561a7bb4fe80 2024-09-19T07:21:11.913 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.911+0000 7f7b8dffb640 1 -- 172.21.15.148:0/7581160 <== mon.1 v2:172.21.15.179:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8600+0+0 (secure 0 0 0) 0x7f7ba0013650 con 0x561a7bb4fe80 2024-09-19T07:21:11.913 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.912+0000 7f7b8dffb640 1 -- 172.21.15.148:0/7581160 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f7ba0044050 con 0x561a7bb4fe80 2024-09-19T07:21:11.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.913+0000 7f7baf9c1740 10 client.26296 fetch_fsmap learned FSMap version 43 2024-09-19T07:21:11.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.913+0000 7f7baf9c1740 1 -- 172.21.15.148:0/7581160 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x561a7bbc9f80 con 0x561a7bb4fe80 2024-09-19T07:21:11.915 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.914+0000 7f7b8dffb640 1 -- 172.21.15.148:0/7581160 <== mon.1 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ba0019070 con 0x561a7bb4fe80 2024-09-19T07:21:11.915 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.914+0000 7f7b8dffb640 1 -- 172.21.15.148:0/7581160 <== mon.1 v2:172.21.15.179:3300/0 5 ==== fsmap(e 43) ==== 8362+0+0 (secure 0 0 0) 0x7f7ba0027710 con 0x561a7bb4fe80 2024-09-19T07:21:11.916 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.914+0000 7f7baf9c1740 10 client.26296 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T07:21:11.916 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.914+0000 7f7baf9c1740 10 client.26296 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:21:11.916 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.914+0000 7f7baf9c1740 20 client.26296 populate_metadata read hostname 'smithi148' 2024-09-19T07:21:11.916 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.914+0000 7f7baf9c1740 1 --2- 172.21.15.148:0/7581160 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561a7bbca280 0x561a7bbcc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:11.916 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.914+0000 7f7baf9c1740 4 client.26296 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:21:11.916 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.914+0000 7f7baf9c1740 1 -- 172.21.15.148:0/7581160 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561a7bab0d70 con 0x561a7bbca280 2024-09-19T07:21:11.917 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.915+0000 7f7ba659c640 1 --2- 172.21.15.148:0/7581160 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561a7bbca280 0x561a7bbcc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:11.918 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.916+0000 7f7ba659c640 1 --2- 172.21.15.148:0/7581160 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561a7bbca280 0x561a7bbcc6a0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67585ac615ff417c server_cookie=b95758cfc5b4e76e in_seq=0 out_seq=0 2024-09-19T07:21:11.918 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:11.917+0000 7f7b8dffb640 10 client.26296 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:21:12.047 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:12.046+0000 7f7b8dffb640 1 -- 172.21.15.148:0/7581160 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561a7bab0d70 con 0x561a7bbca280 2024-09-19T07:21:12.048 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:12.046+0000 7f7b8dffb640 10 client.26296 handle_command_reply: tid=0 2024-09-19T07:21:12.048 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:12.046+0000 7f7baf9c1740 1 client.26296 shutdown 2024-09-19T07:21:12.048 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:12.046+0000 7f7baf9c1740 1 -- 172.21.15.148:0/7581160 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561a7bb4fe80 msgr2=0x561a7bb4a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:12.048 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:12.046+0000 7f7baf9c1740 1 --2- 172.21.15.148:0/7581160 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561a7bb4fe80 0x561a7bb4a5e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7ba0009f40 tx=0x7f7ba001dfd0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.049 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:12.046+0000 7f7baf9c1740 1 -- 172.21.15.148:0/7581160 shutdown_connections 2024-09-19T07:21:12.049 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:12.046+0000 7f7baf9c1740 1 --2- 172.21.15.148:0/7581160 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561a7bbca280 0x561a7bbcc6a0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.049 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:12.046+0000 7f7baf9c1740 1 --2- 172.21.15.148:0/7581160 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561a7bb4fe80 0x561a7bb4a5e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.049 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:12.046+0000 7f7baf9c1740 1 --2- 172.21.15.148:0/7581160 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561a7bb455e0 0x561a7bb4a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.049 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:12.046+0000 7f7baf9c1740 1 --2- 172.21.15.148:0/7581160 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561a7bb44cc0 0x561a7bb583d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.049 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:12.046+0000 7f7baf9c1740 1 -- 172.21.15.148:0/7581160 >> 172.21.15.148:0/7581160 conn(0x561a7bb41230 msgr2=0x561a7bb47fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:12.049 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:12.046+0000 7f7b8dffb640 0 client.26296 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:21:12.049 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:12.046+0000 7f7baf9c1740 1 -- 172.21.15.148:0/7581160 shutdown_connections 2024-09-19T07:21:12.049 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:12.046+0000 7f7baf9c1740 1 -- 172.21.15.148:0/7581160 wait complete. 2024-09-19T07:21:12.049 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:12.047+0000 7f7baf9c1740 20 client.26296 trim_cache size 0 max 16384 2024-09-19T07:21:12.053 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:21:12.053 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:21:12.053 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:21:12.053 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:21:12.055 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:12.054+0000 7f7ba759e640 1 -- 172.21.15.148:0/2892890932 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f7b900a35c0 msgr2=0x7f7b900a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:12.055 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:12.054+0000 7f7ba759e640 1 --2- 172.21.15.148:0/2892890932 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f7b900a35c0 0x7f7b900a5a80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x561a7bb42090 tx=0x7f7b98008040 comp rx=0 tx=0).stop 2024-09-19T07:21:12.055 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:12.054+0000 7f7ba759e640 1 -- 172.21.15.148:0/2892890932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ba8102250 msgr2=0x7f7ba806caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:12.055 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:12.054+0000 7f7ba759e640 1 --2- 172.21.15.148:0/2892890932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ba8102250 0x7f7ba806caf0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c005ab0 tx=0x7f7b9c003d80 comp rx=0 tx=0).stop 2024-09-19T07:21:12.057 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:21:12.058 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:12.056+0000 7f7ba759e640 1 -- 172.21.15.148:0/2892890932 shutdown_connections 2024-09-19T07:21:12.058 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:12.056+0000 7f7ba759e640 1 --2- 172.21.15.148:0/2892890932 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f7b900a35c0 0x7f7b900a5a80 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.058 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:12.056+0000 7f7ba759e640 1 --2- 172.21.15.148:0/2892890932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ba81078c0 0x7f7ba806d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.058 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:12.056+0000 7f7ba759e640 1 --2- 172.21.15.148:0/2892890932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ba8102250 0x7f7ba806caf0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.058 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:12.056+0000 7f7ba759e640 1 --2- 172.21.15.148:0/2892890932 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ba81018b0 0x7f7ba8073a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.058 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:12.056+0000 7f7ba759e640 1 -- 172.21.15.148:0/2892890932 >> 172.21.15.148:0/2892890932 conn(0x7f7ba80fd5d0 msgr2=0x7f7ba80fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:12.058 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:12.057+0000 7f7ba759e640 1 -- 172.21.15.148:0/2892890932 shutdown_connections 2024-09-19T07:21:12.059 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:12.057+0000 7f7ba759e640 1 -- 172.21.15.148:0/2892890932 wait complete. 2024-09-19T07:21:12.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:12 smithi148 ceph-mon[31180]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T07:21:12.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:12 smithi165 ceph-mon[35326]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T07:21:12.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.760+0000 7fa2241ba640 1 -- 172.21.15.148:0/3680285854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa21c109450 msgr2=0x7fa21c109830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:12.762 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.760+0000 7fa2241ba640 1 --2- 172.21.15.148:0/3680285854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa21c109450 0x7fa21c109830 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa218009860 tx=0x7fa21802b450 comp rx=0 tx=0).stop 2024-09-19T07:21:12.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.769+0000 7fa2241ba640 1 -- 172.21.15.148:0/3680285854 shutdown_connections 2024-09-19T07:21:12.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.769+0000 7fa2241ba640 1 --2- 172.21.15.148:0/3680285854 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa21c10ea80 0x7fa21c1154f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.769+0000 7fa2241ba640 1 --2- 172.21.15.148:0/3680285854 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa21c109e00 0x7fa21c10e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.769+0000 7fa2241ba640 1 --2- 172.21.15.148:0/3680285854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa21c109450 0x7fa21c109830 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.769+0000 7fa2241ba640 1 -- 172.21.15.148:0/3680285854 >> 172.21.15.148:0/3680285854 conn(0x7fa21c06e2d0 msgr2=0x7fa21c06e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:12.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:12 smithi179 ceph-mon[35716]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T07:21:12.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.771+0000 7fa2241ba640 1 -- 172.21.15.148:0/3680285854 shutdown_connections 2024-09-19T07:21:12.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.772+0000 7fa2241ba640 1 -- 172.21.15.148:0/3680285854 wait complete. 2024-09-19T07:21:12.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.773+0000 7fa2241ba640 1 Processor -- start 2024-09-19T07:21:12.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.775+0000 7fa2241ba640 1 -- start start 2024-09-19T07:21:12.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.775+0000 7fa2241ba640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa21c109450 0x7fa21c1a58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:12.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.775+0000 7fa2241ba640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa21c109e00 0x7fa21c19e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:12.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.775+0000 7fa2241ba640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa21c10ea80 0x7fa21c19ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:12.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.775+0000 7fa2241ba640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa21c118610 con 0x7fa21c109450 2024-09-19T07:21:12.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.775+0000 7fa2241ba640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa21c118490 con 0x7fa21c109e00 2024-09-19T07:21:12.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.775+0000 7fa2241ba640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa21c118790 con 0x7fa21c10ea80 2024-09-19T07:21:12.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.775+0000 7fa221755640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa21c109e00 0x7fa21c19e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:12.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.775+0000 7fa221755640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa21c109e00 0x7fa21c19e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:57052/0 (socket says 172.21.15.148:57052) 2024-09-19T07:21:12.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.776+0000 7fa221755640 1 -- 172.21.15.148:0/2418200862 learned_addr learned my addr 172.21.15.148:0/2418200862 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:21:12.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.776+0000 7fa221f56640 1 --2- 172.21.15.148:0/2418200862 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa21c109450 0x7fa21c1a58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:12.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.776+0000 7fa221755640 1 -- 172.21.15.148:0/2418200862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa21c10ea80 msgr2=0x7fa21c19ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:12.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.776+0000 7fa221755640 1 --2- 172.21.15.148:0/2418200862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa21c10ea80 0x7fa21c19ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.776+0000 7fa221755640 1 -- 172.21.15.148:0/2418200862 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa21c109450 msgr2=0x7fa21c1a58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:12.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.776+0000 7fa221755640 1 --2- 172.21.15.148:0/2418200862 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa21c109450 0x7fa21c1a58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.776+0000 7fa221755640 1 -- 172.21.15.148:0/2418200862 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa21c19f400 con 0x7fa21c109e00 2024-09-19T07:21:12.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.776+0000 7fa221755640 1 --2- 172.21.15.148:0/2418200862 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa21c109e00 0x7fa21c19e930 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa20c00b450 tx=0x7fa20c00b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:12.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.777+0000 7fa212ffd640 1 -- 172.21.15.148:0/2418200862 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa20c015020 con 0x7fa21c109e00 2024-09-19T07:21:12.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.777+0000 7fa2241ba640 1 -- 172.21.15.148:0/2418200862 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa21c19f6f0 con 0x7fa21c109e00 2024-09-19T07:21:12.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.777+0000 7fa2241ba640 1 -- 172.21.15.148:0/2418200862 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa21c1a36e0 con 0x7fa21c109e00 2024-09-19T07:21:12.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.780+0000 7fa226593740 1 Processor -- start 2024-09-19T07:21:12.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.780+0000 7fa212ffd640 1 -- 172.21.15.148:0/2418200862 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa20c011d70 con 0x7fa21c109e00 2024-09-19T07:21:12.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.781+0000 7fa212ffd640 1 -- 172.21.15.148:0/2418200862 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa20c00f340 con 0x7fa21c109e00 2024-09-19T07:21:12.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.783+0000 7fa212ffd640 1 -- 172.21.15.148:0/2418200862 <== mon.2 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fa20c018020 con 0x7fa21c109e00 2024-09-19T07:21:12.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.783+0000 7fa226593740 1 -- start start 2024-09-19T07:21:12.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.783+0000 7fa226593740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5559573d6760 0x5559573d6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:12.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.783+0000 7fa226593740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5559573d7080 0x5559573e1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:12.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.783+0000 7fa226593740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5559573e1940 0x5559573e3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:12.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.783+0000 7fa226593740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55595733c2a0 con 0x5559573e1940 2024-09-19T07:21:12.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.783+0000 7fa226593740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5559572e3b10 con 0x5559573d7080 2024-09-19T07:21:12.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.783+0000 7fa226593740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x555957338260 con 0x5559573d6760 2024-09-19T07:21:12.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.783+0000 7fa222757640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5559573d6760 0x5559573d6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:12.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.784+0000 7fa222757640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5559573d6760 0x5559573d6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:54114/0 (socket says 172.21.15.148:54114) 2024-09-19T07:21:12.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.784+0000 7fa222757640 1 -- 172.21.15.148:0/637480354 learned_addr learned my addr 172.21.15.148:0/637480354 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:21:12.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.784+0000 7fa221f56640 1 --2- 172.21.15.148:0/637480354 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5559573d7080 0x5559573e1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:12.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.790+0000 7fa221755640 1 --2- 172.21.15.148:0/637480354 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5559573e1940 0x5559573e3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:12.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.794+0000 7fa222757640 1 -- 172.21.15.148:0/637480354 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5559573d7080 msgr2=0x5559573e1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:12.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.794+0000 7fa222757640 1 --2- 172.21.15.148:0/637480354 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5559573d7080 0x5559573e1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.794+0000 7fa222757640 1 -- 172.21.15.148:0/637480354 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5559573e1940 msgr2=0x5559573e3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:12.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.796+0000 7fa222757640 1 --2- 172.21.15.148:0/637480354 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5559573e1940 0x5559573e3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.796+0000 7fa222757640 1 -- 172.21.15.148:0/637480354 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559570adb90 con 0x5559573d6760 2024-09-19T07:21:12.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.796+0000 7fa221755640 1 --2- 172.21.15.148:0/637480354 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5559573e1940 0x5559573e3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:21:12.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.796+0000 7fa212ffd640 1 --2- 172.21.15.148:0/2418200862 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fa2080a33e0 0x7fa2080a58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:12.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.797+0000 7fa222757640 1 --2- 172.21.15.148:0/637480354 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5559573d6760 0x5559573d6b40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa214009d80 tx=0x7fa21400e760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9be0d34b1b1f21c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:12.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.797+0000 7fa212ffd640 1 -- 172.21.15.148:0/2418200862 <== mon.2 v2:172.21.15.165:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8600+0+0 (secure 0 0 0) 0x7fa20c0cf700 con 0x7fa21c109e00 2024-09-19T07:21:12.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.797+0000 7fa221f56640 1 --2- 172.21.15.148:0/2418200862 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fa2080a33e0 0x7fa2080a58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:12.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.798+0000 7fa207fff640 1 -- 172.21.15.148:0/637480354 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21400f810 con 0x5559573d6760 2024-09-19T07:21:12.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.798+0000 7fa207fff640 1 -- 172.21.15.148:0/637480354 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2140173f0 con 0x5559573d6760 2024-09-19T07:21:12.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.799+0000 7fa226593740 1 -- 172.21.15.148:0/637480354 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5559573d6760 msgr2=0x5559573d6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:12.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.799+0000 7fa226593740 1 --2- 172.21.15.148:0/637480354 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5559573d6760 0x5559573d6b40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa214009d80 tx=0x7fa21400e760 comp rx=0 tx=0).stop 2024-09-19T07:21:12.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.799+0000 7fa221f56640 1 --2- 172.21.15.148:0/2418200862 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fa2080a33e0 0x7fa2080a58a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa21800d3b0 tx=0x7fa21800d340 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:12.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.800+0000 7fa226593740 1 -- 172.21.15.148:0/637480354 shutdown_connections 2024-09-19T07:21:12.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.800+0000 7fa226593740 1 --2- 172.21.15.148:0/637480354 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5559573e1940 0x5559573e3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.800+0000 7fa226593740 1 --2- 172.21.15.148:0/637480354 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5559573d7080 0x5559573e1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.800+0000 7fa226593740 1 --2- 172.21.15.148:0/637480354 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5559573d6760 0x5559573d6b40 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.800+0000 7fa226593740 1 -- 172.21.15.148:0/637480354 >> 172.21.15.148:0/637480354 conn(0x5559573d2cf0 msgr2=0x5559573d30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:12.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.800+0000 7fa226593740 1 -- 172.21.15.148:0/637480354 shutdown_connections 2024-09-19T07:21:12.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.801+0000 7fa226593740 1 -- 172.21.15.148:0/637480354 wait complete. 2024-09-19T07:21:12.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.801+0000 7fa226593740 1 -- start start 2024-09-19T07:21:12.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.801+0000 7fa226593740 1 Processor -- start 2024-09-19T07:21:12.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.803+0000 7fa226593740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5559573d6760 0x5559573de740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:12.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.803+0000 7fa226593740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5559573d7080 0x5559573dec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:12.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.803+0000 7fa226593740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5559573e1940 0x5559573df1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:12.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.803+0000 7fa226593740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5559573e4560 con 0x5559573d6760 2024-09-19T07:21:12.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.803+0000 7fa226593740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5559572c46e0 con 0x5559573d7080 2024-09-19T07:21:12.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.803+0000 7fa226593740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5559573e46e0 con 0x5559573e1940 2024-09-19T07:21:12.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.803+0000 7fa226593740 10 client.0 _ll_register_callbacks cb 0x5559572e8a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:21:12.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.804+0000 7fa221755640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5559573d7080 0x5559573dec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:12.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.804+0000 7fa221755640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5559573d7080 0x5559573dec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:57066/0 (socket says 172.21.15.148:57066) 2024-09-19T07:21:12.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.804+0000 7fa221755640 1 -- 172.21.15.148:0/975611821 learned_addr learned my addr 172.21.15.148:0/975611821 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:21:12.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.805+0000 7fa221755640 1 -- 172.21.15.148:0/975611821 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5559573e1940 msgr2=0x5559573df1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:12.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.805+0000 7fa221755640 1 --2- 172.21.15.148:0/975611821 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5559573e1940 0x5559573df1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.805+0000 7fa221755640 1 -- 172.21.15.148:0/975611821 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5559573d6760 msgr2=0x5559573de740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:12.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.805+0000 7fa221755640 1 --2- 172.21.15.148:0/975611821 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5559573d6760 0x5559573de740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.805+0000 7fa221755640 1 -- 172.21.15.148:0/975611821 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559573eda80 con 0x5559573d7080 2024-09-19T07:21:12.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.805+0000 7fa221755640 1 --2- 172.21.15.148:0/975611821 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5559573d7080 0x5559573dec80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa20c0ccf10 tx=0x7fa20c09c140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88f8f5b47db4bbb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:12.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.805+0000 7fa2057fa640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-19T07:21:12.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.805+0000 7fa2057fa640 1 -- 172.21.15.148:0/975611821 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa20c0cd230 con 0x5559573d7080 2024-09-19T07:21:12.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.805+0000 7fa2057fa640 1 -- 172.21.15.148:0/975611821 <== mon.2 v2:172.21.15.165:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8600+0+0 (secure 0 0 0) 0x7fa20c09b090 con 0x5559573d7080 2024-09-19T07:21:12.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.806+0000 7fa226593740 1 -- 172.21.15.148:0/975611821 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2140173f0 con 0x5559573d7080 2024-09-19T07:21:12.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.807+0000 7fa2057fa640 1 -- 172.21.15.148:0/975611821 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fa20c0a46b0 con 0x5559573d7080 2024-09-19T07:21:12.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.807+0000 7fa226593740 10 client.26177 fetch_fsmap learned FSMap version 43 2024-09-19T07:21:12.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.807+0000 7fa226593740 1 -- 172.21.15.148:0/975611821 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x5559573f0390 con 0x5559573d7080 2024-09-19T07:21:12.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.808+0000 7fa2057fa640 1 -- 172.21.15.148:0/975611821 <== mon.2 v2:172.21.15.165:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2140173f0 con 0x5559573d7080 2024-09-19T07:21:12.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.808+0000 7fa2057fa640 1 -- 172.21.15.148:0/975611821 <== mon.2 v2:172.21.15.165:3300/0 5 ==== fsmap(e 43) ==== 8362+0+0 (secure 0 0 0) 0x7fa20c0d2ce0 con 0x5559573d7080 2024-09-19T07:21:12.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.809+0000 7fa226593740 10 client.26177 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T07:21:12.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.809+0000 7fa226593740 10 client.26177 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:21:12.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.809+0000 7fa226593740 20 client.26177 populate_metadata read hostname 'smithi148' 2024-09-19T07:21:12.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.809+0000 7fa226593740 1 --2- 172.21.15.148:0/975611821 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5559573f1920 0x5559573f3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:12.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.809+0000 7fa226593740 4 client.26177 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:21:12.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.809+0000 7fa226593740 1 -- 172.21.15.148:0/975611821 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5559573499d0 con 0x5559573f1920 2024-09-19T07:21:12.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.811+0000 7fa221f56640 1 --2- 172.21.15.148:0/975611821 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5559573f1920 0x5559573f3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:12.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.813+0000 7fa221f56640 1 --2- 172.21.15.148:0/975611821 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5559573f1920 0x5559573f3d80 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66742cfb109c6b3 server_cookie=96503377fd87ae6a in_seq=0 out_seq=0 2024-09-19T07:21:12.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.813+0000 7fa2057fa640 10 client.26177 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:21:12.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.814+0000 7fa2057fa640 1 -- 172.21.15.148:0/975611821 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5559573499d0 con 0x5559573f1920 2024-09-19T07:21:12.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.814+0000 7fa2057fa640 10 client.26177 handle_command_reply: tid=0 2024-09-19T07:21:12.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.814+0000 7fa226593740 1 client.26177 shutdown 2024-09-19T07:21:12.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.814+0000 7fa226593740 1 -- 172.21.15.148:0/975611821 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5559573d7080 msgr2=0x5559573dec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:12.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.814+0000 7fa226593740 1 --2- 172.21.15.148:0/975611821 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5559573d7080 0x5559573dec80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa20c0ccf10 tx=0x7fa20c09c140 comp rx=0 tx=0).stop 2024-09-19T07:21:12.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.814+0000 7fa226593740 1 -- 172.21.15.148:0/975611821 shutdown_connections 2024-09-19T07:21:12.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.814+0000 7fa226593740 1 --2- 172.21.15.148:0/975611821 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5559573f1920 0x5559573f3d80 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.814+0000 7fa226593740 1 --2- 172.21.15.148:0/975611821 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5559573e1940 0x5559573df1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.814+0000 7fa226593740 1 --2- 172.21.15.148:0/975611821 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5559573d7080 0x5559573dec80 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.814+0000 7fa226593740 1 --2- 172.21.15.148:0/975611821 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5559573d6760 0x5559573de740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.814+0000 7fa2057fa640 0 client.26177 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:21:12.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.814+0000 7fa226593740 1 -- 172.21.15.148:0/975611821 >> 172.21.15.148:0/975611821 conn(0x5559573d2cf0 msgr2=0x5559573d89d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:12.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.815+0000 7fa226593740 1 -- 172.21.15.148:0/975611821 shutdown_connections 2024-09-19T07:21:12.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.815+0000 7fa226593740 1 -- 172.21.15.148:0/975611821 wait complete. 2024-09-19T07:21:12.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.817+0000 7fa226593740 20 client.26177 trim_cache size 0 max 16384 2024-09-19T07:21:12.854 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.853+0000 7fa226593740 1 Processor -- start 2024-09-19T07:21:12.854 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.853+0000 7fa226593740 1 -- start start 2024-09-19T07:21:12.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.854+0000 7fa226593740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5559573d6760 0x5559573f9690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:12.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.854+0000 7fa226593740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5559573d7080 0x5559573f9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:12.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.854+0000 7fa221f56640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5559573d6760 0x5559573f9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:12.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.854+0000 7fa221f56640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5559573d6760 0x5559573f9690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:54130/0 (socket says 172.21.15.148:54130) 2024-09-19T07:21:12.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.854+0000 7fa221f56640 1 -- 172.21.15.148:0/3791411538 learned_addr learned my addr 172.21.15.148:0/3791411538 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:21:12.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.854+0000 7fa226593740 1 --2- 172.21.15.148:0/3791411538 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5559573e1940 0x5559573dba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:12.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.854+0000 7fa226593740 1 -- 172.21.15.148:0/3791411538 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa2000112d0 con 0x5559573d7080 2024-09-19T07:21:12.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.854+0000 7fa226593740 1 -- 172.21.15.148:0/3791411538 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa20000eb40 con 0x5559573e1940 2024-09-19T07:21:12.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.855+0000 7fa222757640 1 --2- 172.21.15.148:0/3791411538 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5559573e1940 0x5559573dba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:12.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.854+0000 7fa226593740 1 -- 172.21.15.148:0/3791411538 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa20000c9b0 con 0x5559573d6760 2024-09-19T07:21:12.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.855+0000 7fa221f56640 1 -- 172.21.15.148:0/3791411538 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5559573e1940 msgr2=0x5559573dba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:12.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.855+0000 7fa221f56640 1 --2- 172.21.15.148:0/3791411538 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5559573e1940 0x5559573dba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.855+0000 7fa221f56640 1 -- 172.21.15.148:0/3791411538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5559573d7080 msgr2=0x5559573f9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:12.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.855+0000 7fa221f56640 1 --2- 172.21.15.148:0/3791411538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5559573d7080 0x5559573f9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.855+0000 7fa221f56640 1 -- 172.21.15.148:0/3791411538 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559573d2b20 con 0x5559573d6760 2024-09-19T07:21:12.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.856+0000 7fa221f56640 1 --2- 172.21.15.148:0/3791411538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5559573d6760 0x5559573f9690 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa2180314b0 tx=0x7fa218041000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81d840e231b8b80f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:12.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.856+0000 7fa2077fe640 1 -- 172.21.15.148:0/3791411538 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa218031850 con 0x5559573d6760 2024-09-19T07:21:12.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.856+0000 7fa2077fe640 1 -- 172.21.15.148:0/3791411538 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa218005410 con 0x5559573d6760 2024-09-19T07:21:12.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.857+0000 7fa226593740 1 -- 172.21.15.148:0/3791411538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5559573d6760 msgr2=0x5559573f9690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:12.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.857+0000 7fa226593740 1 --2- 172.21.15.148:0/3791411538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5559573d6760 0x5559573f9690 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa2180314b0 tx=0x7fa218041000 comp rx=0 tx=0).stop 2024-09-19T07:21:12.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.857+0000 7fa226593740 1 -- 172.21.15.148:0/3791411538 shutdown_connections 2024-09-19T07:21:12.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.857+0000 7fa226593740 1 --2- 172.21.15.148:0/3791411538 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5559573e1940 0x5559573dba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.857+0000 7fa226593740 1 --2- 172.21.15.148:0/3791411538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5559573d7080 0x5559573f9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.857+0000 7fa226593740 1 --2- 172.21.15.148:0/3791411538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5559573d6760 0x5559573f9690 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.857+0000 7fa226593740 1 -- 172.21.15.148:0/3791411538 >> 172.21.15.148:0/3791411538 conn(0x5559573d2cf0 msgr2=0x5559573e07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:12.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.859+0000 7fa226593740 1 -- 172.21.15.148:0/3791411538 shutdown_connections 2024-09-19T07:21:12.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.860+0000 7fa226593740 1 -- 172.21.15.148:0/3791411538 wait complete. 2024-09-19T07:21:12.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.860+0000 7fa226593740 1 -- start start 2024-09-19T07:21:12.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.860+0000 7fa226593740 1 Processor -- start 2024-09-19T07:21:12.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.861+0000 7fa226593740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5559573d6760 0x5559573e9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:12.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.861+0000 7fa226593740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5559573d7080 0x5559573ea100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:12.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.861+0000 7fa226593740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5559573e1940 0x5559573e69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:12.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.861+0000 7fa226593740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa20000d000 con 0x5559573d7080 2024-09-19T07:21:12.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.861+0000 7fa226593740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa20000e470 con 0x5559573d6760 2024-09-19T07:21:12.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.861+0000 7fa226593740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa20000d6d0 con 0x5559573e1940 2024-09-19T07:21:12.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.861+0000 7fa226593740 10 client.0 _ll_register_callbacks cb 0x7fa20c09b8e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:21:12.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.862+0000 7fa222757640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5559573e1940 0x5559573e69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:12.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.863+0000 7fa222757640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5559573e1940 0x5559573e69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:54146/0 (socket says 172.21.15.148:54146) 2024-09-19T07:21:12.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.863+0000 7fa222757640 1 -- 172.21.15.148:0/3076910118 learned_addr learned my addr 172.21.15.148:0/3076910118 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:21:12.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.863+0000 7fa221f56640 1 --2- 172.21.15.148:0/3076910118 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5559573d6760 0x5559573e9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:12.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.863+0000 7fa221755640 1 --2- 172.21.15.148:0/3076910118 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5559573d7080 0x5559573ea100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:12.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.863+0000 7fa221f56640 1 -- 172.21.15.148:0/3076910118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5559573e1940 msgr2=0x5559573e69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:12.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.863+0000 7fa221f56640 1 --2- 172.21.15.148:0/3076910118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5559573e1940 0x5559573e69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.863+0000 7fa221f56640 1 -- 172.21.15.148:0/3076910118 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5559573d7080 msgr2=0x5559573ea100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:12.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.863+0000 7fa221f56640 1 --2- 172.21.15.148:0/3076910118 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5559573d7080 0x5559573ea100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.863+0000 7fa221f56640 1 -- 172.21.15.148:0/3076910118 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559573d6590 con 0x5559573d6760 2024-09-19T07:21:12.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.864+0000 7fa221f56640 1 --2- 172.21.15.148:0/3076910118 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5559573d6760 0x5559573e9bc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa21802bc20 tx=0x7fa218031f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d405648a0c0517dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:12.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.864+0000 7fa2057fa640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-19T07:21:12.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.865+0000 7fa2057fa640 1 -- 172.21.15.148:0/3076910118 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2180046c0 con 0x5559573d6760 2024-09-19T07:21:12.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.865+0000 7fa226593740 1 -- 172.21.15.148:0/3076910118 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa218005410 con 0x5559573d6760 2024-09-19T07:21:12.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.865+0000 7fa2057fa640 1 -- 172.21.15.148:0/3076910118 <== mon.2 v2:172.21.15.165:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8600+0+0 (secure 0 0 0) 0x7fa218055040 con 0x5559573d6760 2024-09-19T07:21:12.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.865+0000 7fa2057fa640 1 -- 172.21.15.148:0/3076910118 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fa218004050 con 0x5559573d6760 2024-09-19T07:21:12.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.866+0000 7fa226593740 10 client.26183 fetch_fsmap learned FSMap version 43 2024-09-19T07:21:12.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.866+0000 7fa226593740 1 -- 172.21.15.148:0/3076910118 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55595745ceb0 con 0x5559573d6760 2024-09-19T07:21:12.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.867+0000 7fa2057fa640 1 -- 172.21.15.148:0/3076910118 <== mon.2 v2:172.21.15.165:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa218005410 con 0x5559573d6760 2024-09-19T07:21:12.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.867+0000 7fa2057fa640 1 -- 172.21.15.148:0/3076910118 <== mon.2 v2:172.21.15.165:3300/0 5 ==== fsmap(e 43) ==== 8362+0+0 (secure 0 0 0) 0x7fa218061460 con 0x5559573d6760 2024-09-19T07:21:12.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.867+0000 7fa226593740 10 client.26183 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T07:21:12.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.867+0000 7fa226593740 10 client.26183 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:21:12.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.867+0000 7fa226593740 20 client.26183 populate_metadata read hostname 'smithi148' 2024-09-19T07:21:12.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.867+0000 7fa226593740 1 --2- 172.21.15.148:0/3076910118 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55595745d5f0 0x55595745fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:12.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.867+0000 7fa226593740 4 client.26183 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-09-19T07:21:12.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.867+0000 7fa226593740 1 -- 172.21.15.148:0/3076910118 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x7fa218004e50 con 0x55595745d5f0 2024-09-19T07:21:12.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.868+0000 7fa221755640 1 --2- 172.21.15.148:0/3076910118 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55595745d5f0 0x55595745fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:12.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.872+0000 7fa221755640 1 --2- 172.21.15.148:0/3076910118 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55595745d5f0 0x55595745fa10 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e272e2563f24093 server_cookie=1b6ef5f035ed86d0 in_seq=0 out_seq=0 2024-09-19T07:21:12.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:12.872+0000 7fa2057fa640 10 client.26183 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:21:13.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:13 smithi148 ceph-mon[31180]: pgmap v315: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 148 KiB/s wr, 110 op/s 2024-09-19T07:21:13.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:13 smithi165 ceph-mon[35326]: pgmap v315: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 148 KiB/s wr, 110 op/s 2024-09-19T07:21:13.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:13 smithi179 ceph-mon[35716]: pgmap v315: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 148 KiB/s wr, 110 op/s 2024-09-19T07:21:14.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:14 smithi165 ceph-mon[35326]: pgmap v316: 97 pgs: 4 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 82 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 151 KiB/s wr, 96 op/s 2024-09-19T07:21:14.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:14 smithi179 ceph-mon[35716]: pgmap v316: 97 pgs: 4 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 82 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 151 KiB/s wr, 96 op/s 2024-09-19T07:21:14.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:14 smithi148 ceph-mon[31180]: pgmap v316: 97 pgs: 4 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 82 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 151 KiB/s wr, 96 op/s 2024-09-19T07:21:16.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:16 smithi179 ceph-mon[35716]: pgmap v317: 97 pgs: 18 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 44 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 74 KiB/s wr, 28 op/s 2024-09-19T07:21:16.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:16 smithi148 ceph-mon[31180]: pgmap v317: 97 pgs: 18 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 44 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 74 KiB/s wr, 28 op/s 2024-09-19T07:21:16.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:16 smithi165 ceph-mon[35326]: pgmap v317: 97 pgs: 18 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 44 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 74 KiB/s wr, 28 op/s 2024-09-19T07:21:18.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:18 smithi179 ceph-mon[35716]: pgmap v318: 97 pgs: 18 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 44 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 74 KiB/s wr, 28 op/s 2024-09-19T07:21:18.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:18 smithi148 ceph-mon[31180]: pgmap v318: 97 pgs: 18 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 44 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 74 KiB/s wr, 28 op/s 2024-09-19T07:21:18.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:18 smithi165 ceph-mon[35326]: pgmap v318: 97 pgs: 18 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 44 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 74 KiB/s wr, 28 op/s 2024-09-19T07:21:20.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:20 smithi179 ceph-mon[35716]: pgmap v319: 97 pgs: 14 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 59 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 66 KiB/s wr, 28 op/s 2024-09-19T07:21:20.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:20 smithi148 ceph-mon[31180]: pgmap v319: 97 pgs: 14 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 59 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 66 KiB/s wr, 28 op/s 2024-09-19T07:21:20.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:20 smithi165 ceph-mon[35326]: pgmap v319: 97 pgs: 14 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 59 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 66 KiB/s wr, 28 op/s 2024-09-19T07:21:22.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:22 smithi179 ceph-mon[35716]: pgmap v320: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 39 KiB/s wr, 24 op/s 2024-09-19T07:21:22.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:22 smithi148 ceph-mon[31180]: pgmap v320: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 39 KiB/s wr, 24 op/s 2024-09-19T07:21:22.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:22 smithi165 ceph-mon[35326]: pgmap v320: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 39 KiB/s wr, 24 op/s 2024-09-19T07:21:24.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:24 smithi165 ceph-mon[35326]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T07:21:24.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:24 smithi165 ceph-mon[35326]: pgmap v322: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 29 KiB/s wr, 20 op/s 2024-09-19T07:21:24.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:24 smithi179 ceph-mon[35716]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T07:21:24.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:24 smithi179 ceph-mon[35716]: pgmap v322: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 29 KiB/s wr, 20 op/s 2024-09-19T07:21:24.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:24 smithi148 ceph-mon[31180]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T07:21:24.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:24 smithi148 ceph-mon[31180]: pgmap v322: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 29 KiB/s wr, 20 op/s 2024-09-19T07:21:25.166 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.165+0000 7f9dd1b9f640 1 -- 172.21.15.148:0/1358290186 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9dcc106a00 msgr2=0x7f9dcc106de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:25.166 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.165+0000 7f9dd1b9f640 1 --2- 172.21.15.148:0/1358290186 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9dcc106a00 0x7f9dcc106de0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc009930 tx=0x7f9dbc02a420 comp rx=0 tx=0).stop 2024-09-19T07:21:25.166 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.165+0000 7f9dd1b9f640 1 -- 172.21.15.148:0/1358290186 shutdown_connections 2024-09-19T07:21:25.166 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.165+0000 7f9dd1b9f640 1 --2- 172.21.15.148:0/1358290186 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9dcc101390 0x7f9dcc10d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.166 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.165+0000 7f9dd1b9f640 1 --2- 172.21.15.148:0/1358290186 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9dcc1009f0 0x7f9dcc100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.166 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.165+0000 7f9dd1b9f640 1 --2- 172.21.15.148:0/1358290186 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9dcc106a00 0x7f9dcc106de0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.166 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.165+0000 7f9dd1b9f640 1 -- 172.21.15.148:0/1358290186 >> 172.21.15.148:0/1358290186 conn(0x7f9dcc0fc6b0 msgr2=0x7f9dcc0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:25.166 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.165+0000 7f9dd1b9f640 1 -- 172.21.15.148:0/1358290186 shutdown_connections 2024-09-19T07:21:25.167 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.165+0000 7f9dd1b9f640 1 -- 172.21.15.148:0/1358290186 wait complete. 2024-09-19T07:21:25.167 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.165+0000 7f9dd1b9f640 1 Processor -- start 2024-09-19T07:21:25.167 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.165+0000 7f9dd1b9f640 1 -- start start 2024-09-19T07:21:25.168 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.166+0000 7f9dd1b9f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9dcc1009f0 0x7f9dcc1972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:25.169 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.166+0000 7f9dd1b9f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9dcc101390 0x7f9dcc1977f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:25.169 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.166+0000 7f9dd1b9f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9dcc106a00 0x7f9dcc19bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:25.169 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.166+0000 7f9dd1b9f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9dcc110e40 con 0x7f9dcc101390 2024-09-19T07:21:25.169 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.166+0000 7f9dd1b9f640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9dcc110cc0 con 0x7f9dcc1009f0 2024-09-19T07:21:25.169 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.166+0000 7f9dd1b9f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9dcc110fc0 con 0x7f9dcc106a00 2024-09-19T07:21:25.169 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.166+0000 7f9dcb7fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9dcc1009f0 0x7f9dcc1972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:25.169 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.166+0000 7f9dcaffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9dcc101390 0x7f9dcc1977f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:25.169 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.166+0000 7f9dcb7fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9dcc1009f0 0x7f9dcc1972b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:41108/0 (socket says 172.21.15.148:41108) 2024-09-19T07:21:25.170 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.166+0000 7f9dcb7fe640 1 -- 172.21.15.148:0/2299586463 learned_addr learned my addr 172.21.15.148:0/2299586463 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:21:25.170 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.166+0000 7f9dcbfff640 1 --2- 172.21.15.148:0/2299586463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9dcc106a00 0x7f9dcc19bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:25.170 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.166+0000 7f9dcaffd640 1 -- 172.21.15.148:0/2299586463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9dcc106a00 msgr2=0x7f9dcc19bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:25.170 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.166+0000 7f9dcaffd640 1 --2- 172.21.15.148:0/2299586463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9dcc106a00 0x7f9dcc19bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.170 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.166+0000 7f9dcaffd640 1 -- 172.21.15.148:0/2299586463 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9dcc1009f0 msgr2=0x7f9dcc1972b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:25.170 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.166+0000 7f9dcaffd640 1 --2- 172.21.15.148:0/2299586463 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9dcc1009f0 0x7f9dcc1972b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.170 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.166+0000 7f9dcaffd640 1 -- 172.21.15.148:0/2299586463 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dcc19c2a0 con 0x7f9dcc101390 2024-09-19T07:21:25.170 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.166+0000 7f9dcb7fe640 1 --2- 172.21.15.148:0/2299586463 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9dcc1009f0 0x7f9dcc1972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:21:25.170 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.166+0000 7f9dcaffd640 1 --2- 172.21.15.148:0/2299586463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9dcc101390 0x7f9dcc1977f0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f9dc000e9f0 tx=0x7f9dc000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:25.170 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.166+0000 7f9dc8ff9640 1 -- 172.21.15.148:0/2299586463 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc000ccc0 con 0x7f9dcc101390 2024-09-19T07:21:25.171 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.167+0000 7f9dd1b9f640 1 -- 172.21.15.148:0/2299586463 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dcc19c590 con 0x7f9dcc101390 2024-09-19T07:21:25.171 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.167+0000 7f9dc8ff9640 1 -- 172.21.15.148:0/2299586463 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9dc0010910 con 0x7f9dcc101390 2024-09-19T07:21:25.171 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.167+0000 7f9dc8ff9640 1 -- 172.21.15.148:0/2299586463 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc0018960 con 0x7f9dcc101390 2024-09-19T07:21:25.171 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.167+0000 7f9dd1b9f640 1 -- 172.21.15.148:0/2299586463 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dcc1a3e20 con 0x7f9dcc101390 2024-09-19T07:21:25.177 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.169+0000 7f9dc8ff9640 1 -- 172.21.15.148:0/2299586463 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f9dc0010ac0 con 0x7f9dcc101390 2024-09-19T07:21:25.177 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.169+0000 7f9dd4a16740 1 Processor -- start 2024-09-19T07:21:25.177 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.169+0000 7f9dd4a16740 1 -- start start 2024-09-19T07:21:25.177 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.169+0000 7f9dd4a16740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556089718d00 0x5560897190e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:25.177 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.169+0000 7f9dd4a16740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556089719620 0x556089723980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:25.177 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.170+0000 7f9dd4a16740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556089723ec0 0x5560897262b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:25.177 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.170+0000 7f9dd4a16740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55608967b2f0 con 0x556089718d00 2024-09-19T07:21:25.177 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.170+0000 7f9dd4a16740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x556089623270 con 0x556089719620 2024-09-19T07:21:25.177 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.170+0000 7f9dd4a16740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5560896772b0 con 0x556089723ec0 2024-09-19T07:21:25.177 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.170+0000 7f9dc8ff9640 1 --2- 172.21.15.148:0/2299586463 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f9db40a3460 0x7f9db40a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:25.177 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.170+0000 7f9dcbfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556089718d00 0x5560897190e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:25.178 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.170+0000 7f9dcb7fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556089719620 0x556089723980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:25.178 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.170+0000 7f9dcbfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556089718d00 0x5560897190e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45694/0 (socket says 172.21.15.148:45694) 2024-09-19T07:21:25.178 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.170+0000 7f9dcbfff640 1 -- 172.21.15.148:0/3048061891 learned_addr learned my addr 172.21.15.148:0/3048061891 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:21:25.178 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.170+0000 7f9dcaffd640 1 --2- 172.21.15.148:0/3048061891 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556089723ec0 0x5560897262b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:25.178 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.170+0000 7f9dcbfff640 1 --2- 172.21.15.148:0/2299586463 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f9db40a3460 0x7f9db40a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:25.178 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.170+0000 7f9dcb7fe640 1 -- 172.21.15.148:0/3048061891 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556089723ec0 msgr2=0x5560897262b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:25.178 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.170+0000 7f9dc8ff9640 1 -- 172.21.15.148:0/2299586463 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8556+0+0 (secure 0 0 0) 0x7f9dc00d00b0 con 0x7f9dcc101390 2024-09-19T07:21:25.178 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.170+0000 7f9dcb7fe640 1 --2- 172.21.15.148:0/3048061891 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556089723ec0 0x5560897262b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.178 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.170+0000 7f9dcb7fe640 1 -- 172.21.15.148:0/3048061891 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556089718d00 msgr2=0x5560897190e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:25.178 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.170+0000 7f9dcb7fe640 1 --2- 172.21.15.148:0/3048061891 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556089718d00 0x5560897190e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.178 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.170+0000 7f9dcb7fe640 1 -- 172.21.15.148:0/3048061891 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556089622340 con 0x556089719620 2024-09-19T07:21:25.178 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.170+0000 7f9dcaffd640 1 --2- 172.21.15.148:0/3048061891 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556089723ec0 0x5560897262b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:21:25.178 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.170+0000 7f9dcb7fe640 1 --2- 172.21.15.148:0/3048061891 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556089719620 0x556089723980 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc009900 tx=0x7f9dbc005e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d02d9f6785c57072 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:25.179 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.170+0000 7f9dcbfff640 1 --2- 172.21.15.148:0/2299586463 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f9db40a3460 0x7f9db40a5920 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4005f40 tx=0x7f9dc4004ab0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:25.179 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.170+0000 7f9db1ffb640 1 -- 172.21.15.148:0/3048061891 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc035040 con 0x556089719620 2024-09-19T07:21:25.179 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.171+0000 7f9db1ffb640 1 -- 172.21.15.148:0/3048061891 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9dbc0318b0 con 0x556089719620 2024-09-19T07:21:25.179 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.171+0000 7f9db1ffb640 1 -- 172.21.15.148:0/3048061891 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc0049c0 con 0x556089719620 2024-09-19T07:21:25.179 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.171+0000 7f9dd4a16740 1 -- 172.21.15.148:0/3048061891 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556089719620 msgr2=0x556089723980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:25.179 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.171+0000 7f9dd4a16740 1 --2- 172.21.15.148:0/3048061891 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556089719620 0x556089723980 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc009900 tx=0x7f9dbc005e70 comp rx=0 tx=0).stop 2024-09-19T07:21:25.179 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.171+0000 7f9dd4a16740 1 -- 172.21.15.148:0/3048061891 shutdown_connections 2024-09-19T07:21:25.179 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.171+0000 7f9dd4a16740 1 --2- 172.21.15.148:0/3048061891 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556089723ec0 0x5560897262b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.179 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.171+0000 7f9dd4a16740 1 --2- 172.21.15.148:0/3048061891 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556089719620 0x556089723980 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.179 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.171+0000 7f9dd4a16740 1 --2- 172.21.15.148:0/3048061891 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556089718d00 0x5560897190e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.179 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.171+0000 7f9dd4a16740 1 -- 172.21.15.148:0/3048061891 >> 172.21.15.148:0/3048061891 conn(0x556089715270 msgr2=0x556089715650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:25.179 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.171+0000 7f9dd4a16740 1 -- 172.21.15.148:0/3048061891 shutdown_connections 2024-09-19T07:21:25.179 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.171+0000 7f9dd4a16740 1 -- 172.21.15.148:0/3048061891 wait complete. 2024-09-19T07:21:25.179 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.172+0000 7f9dd4a16740 1 -- start start 2024-09-19T07:21:25.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.172+0000 7f9dd4a16740 1 Processor -- start 2024-09-19T07:21:25.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.172+0000 7f9dd4a16740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556089718d00 0x556089720d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:25.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.172+0000 7f9dd4a16740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556089719620 0x5560897212b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:25.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.172+0000 7f9dd4a16740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556089723ec0 0x5560897217f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:25.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.172+0000 7f9dd4a16740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x556089726a90 con 0x556089723ec0 2024-09-19T07:21:25.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.172+0000 7f9dd4a16740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x556089604290 con 0x556089719620 2024-09-19T07:21:25.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.172+0000 7f9dd4a16740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x556089726c10 con 0x556089718d00 2024-09-19T07:21:25.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.172+0000 7f9dd4a16740 10 client.0 _ll_register_callbacks cb 0x556089635140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:21:25.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.172+0000 7f9dcbfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556089723ec0 0x5560897217f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:25.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.172+0000 7f9dcaffd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556089719620 0x5560897212b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:25.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.172+0000 7f9dcb7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556089718d00 0x556089720d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:25.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.172+0000 7f9dcb7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556089718d00 0x556089720d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:35010/0 (socket says 172.21.15.148:35010) 2024-09-19T07:21:25.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.172+0000 7f9dcaffd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556089719620 0x5560897212b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:41128/0 (socket says 172.21.15.148:41128) 2024-09-19T07:21:25.181 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.172+0000 7f9dcb7fe640 1 -- 172.21.15.148:0/2045781583 learned_addr learned my addr 172.21.15.148:0/2045781583 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:21:25.181 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.172+0000 7f9dcbfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556089723ec0 0x5560897217f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45700/0 (socket says 172.21.15.148:45700) 2024-09-19T07:21:25.181 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.173+0000 7f9dcbfff640 1 -- 172.21.15.148:0/2045781583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556089718d00 msgr2=0x556089720d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:25.181 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.173+0000 7f9dcbfff640 1 --2- 172.21.15.148:0/2045781583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556089718d00 0x556089720d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.181 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.173+0000 7f9dcbfff640 1 -- 172.21.15.148:0/2045781583 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556089719620 msgr2=0x5560897212b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:25.181 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.173+0000 7f9dcbfff640 1 --2- 172.21.15.148:0/2045781583 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556089719620 0x5560897212b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.181 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.173+0000 7f9dcbfff640 1 -- 172.21.15.148:0/2045781583 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55608938e210 con 0x556089723ec0 2024-09-19T07:21:25.181 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.173+0000 7f9dcbfff640 1 --2- 172.21.15.148:0/2045781583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556089723ec0 0x5560897217f0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4014360 tx=0x7f9dc4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c07137268ff5fa84 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:25.181 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.173+0000 7f9daaffd640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:21:25.181 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.173+0000 7f9daaffd640 1 -- 172.21.15.148:0/2045781583 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc401a040 con 0x556089723ec0 2024-09-19T07:21:25.181 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.173+0000 7f9daaffd640 1 -- 172.21.15.148:0/2045781583 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8556+0+0 (secure 0 0 0) 0x7f9dc4013980 con 0x556089723ec0 2024-09-19T07:21:25.181 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.173+0000 7f9dd4a16740 1 -- 172.21.15.148:0/2045781583 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9dbc0318b0 con 0x556089723ec0 2024-09-19T07:21:25.181 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.173+0000 7f9daaffd640 1 -- 172.21.15.148:0/2045781583 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f9dc4013b80 con 0x556089723ec0 2024-09-19T07:21:25.181 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.173+0000 7f9dd4a16740 10 client.17010 fetch_fsmap learned FSMap version 43 2024-09-19T07:21:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.173+0000 7f9dd4a16740 1 -- 172.21.15.148:0/2045781583 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55608945a620 con 0x556089723ec0 2024-09-19T07:21:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.173+0000 7f9daaffd640 1 -- 172.21.15.148:0/2045781583 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9dbc0318b0 con 0x556089723ec0 2024-09-19T07:21:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.174+0000 7f9daaffd640 1 -- 172.21.15.148:0/2045781583 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 43) ==== 8362+0+0 (secure 0 0 0) 0x7f9dc4020040 con 0x556089723ec0 2024-09-19T07:21:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.174+0000 7f9dd4a16740 10 client.17010 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T07:21:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.174+0000 7f9dd4a16740 10 client.17010 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:21:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.174+0000 7f9dd4a16740 20 client.17010 populate_metadata read hostname 'smithi148' 2024-09-19T07:21:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.174+0000 7f9dd4a16740 1 --2- 172.21.15.148:0/2045781583 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x556089733e80 0x556089736290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.174+0000 7f9dd4a16740 4 client.17010 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:21:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.174+0000 7f9dd4a16740 1 -- 172.21.15.148:0/2045781583 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556089688a20 con 0x556089733e80 2024-09-19T07:21:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.174+0000 7f9dcb7fe640 1 --2- 172.21.15.148:0/2045781583 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x556089733e80 0x556089736290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.174+0000 7f9dcb7fe640 1 --2- 172.21.15.148:0/2045781583 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x556089733e80 0x556089736290 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7cdd146d39951c9 server_cookie=94f5751ca9e3d413 in_seq=0 out_seq=0 2024-09-19T07:21:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.174+0000 7f9daaffd640 10 client.17010 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:21:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.175+0000 7f9daaffd640 1 -- 172.21.15.148:0/2045781583 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556089688a20 con 0x556089733e80 2024-09-19T07:21:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.175+0000 7f9daaffd640 10 client.17010 handle_command_reply: tid=0 2024-09-19T07:21:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.175+0000 7f9dd4a16740 1 client.17010 shutdown 2024-09-19T07:21:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.175+0000 7f9dd4a16740 1 -- 172.21.15.148:0/2045781583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556089723ec0 msgr2=0x5560897217f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.175+0000 7f9dd4a16740 1 --2- 172.21.15.148:0/2045781583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556089723ec0 0x5560897217f0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4014360 tx=0x7f9dc4004a40 comp rx=0 tx=0).stop 2024-09-19T07:21:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.175+0000 7f9dd4a16740 1 -- 172.21.15.148:0/2045781583 shutdown_connections 2024-09-19T07:21:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.175+0000 7f9dd4a16740 1 --2- 172.21.15.148:0/2045781583 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x556089733e80 0x556089736290 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.175+0000 7f9dd4a16740 1 --2- 172.21.15.148:0/2045781583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556089723ec0 0x5560897217f0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.175+0000 7f9dd4a16740 1 --2- 172.21.15.148:0/2045781583 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556089719620 0x5560897212b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.175+0000 7f9daaffd640 0 client.17010 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:21:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.175+0000 7f9dd4a16740 1 --2- 172.21.15.148:0/2045781583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556089718d00 0x556089720d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.175+0000 7f9dd4a16740 1 -- 172.21.15.148:0/2045781583 >> 172.21.15.148:0/2045781583 conn(0x556089715270 msgr2=0x55608971afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.175+0000 7f9dd4a16740 1 -- 172.21.15.148:0/2045781583 shutdown_connections 2024-09-19T07:21:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.175+0000 7f9dd4a16740 1 -- 172.21.15.148:0/2045781583 wait complete. 2024-09-19T07:21:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.175+0000 7f9dd4a16740 20 client.17010 trim_cache size 0 max 16384 2024-09-19T07:21:25.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.190+0000 7f9dd4a16740 1 Processor -- start 2024-09-19T07:21:25.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.190+0000 7f9dd4a16740 1 -- start start 2024-09-19T07:21:25.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.190+0000 7f9dd4a16740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556089718d00 0x556089722ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:25.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.190+0000 7f9dd4a16740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556089719620 0x55608973bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:25.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.190+0000 7f9dd4a16740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556089723ec0 0x55608973c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:25.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.190+0000 7f9dd4a16740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9dcc1ae060 con 0x556089719620 2024-09-19T07:21:25.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.190+0000 7f9dd4a16740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9dcc1ab8d0 con 0x556089718d00 2024-09-19T07:21:25.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.190+0000 7f9dd4a16740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9dcc1a9740 con 0x556089723ec0 2024-09-19T07:21:25.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.190+0000 7f9dcaffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556089719620 0x55608973bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.190+0000 7f9dcaffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556089719620 0x55608973bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45714/0 (socket says 172.21.15.148:45714) 2024-09-19T07:21:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.190+0000 7f9dcaffd640 1 -- 172.21.15.148:0/1877207493 learned_addr learned my addr 172.21.15.148:0/1877207493 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:21:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.190+0000 7f9dcb7fe640 1 --2- 172.21.15.148:0/1877207493 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556089718d00 0x556089722ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.190+0000 7f9dcaffd640 1 -- 172.21.15.148:0/1877207493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556089723ec0 msgr2=0x55608973c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.190+0000 7f9dcbfff640 1 --2- 172.21.15.148:0/1877207493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556089723ec0 0x55608973c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.190+0000 7f9dcaffd640 1 --2- 172.21.15.148:0/1877207493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556089723ec0 0x55608973c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.190+0000 7f9dcaffd640 1 -- 172.21.15.148:0/1877207493 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556089718d00 msgr2=0x556089722ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.190+0000 7f9dcaffd640 1 --2- 172.21.15.148:0/1877207493 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556089718d00 0x556089722ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.190+0000 7f9dcaffd640 1 -- 172.21.15.148:0/1877207493 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556089736910 con 0x556089719620 2024-09-19T07:21:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.190+0000 7f9dcb7fe640 1 --2- 172.21.15.148:0/1877207493 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556089718d00 0x556089722ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:21:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.190+0000 7f9dcaffd640 1 --2- 172.21.15.148:0/1877207493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556089719620 0x55608973bba0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f9dc009c3b0 tx=0x7f9dc0096f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d9dd72754bbd523 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.190+0000 7f9db17fa640 1 -- 172.21.15.148:0/1877207493 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc00a0720 con 0x556089719620 2024-09-19T07:21:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.191+0000 7f9db17fa640 1 -- 172.21.15.148:0/1877207493 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9dc00a4fe0 con 0x556089719620 2024-09-19T07:21:25.197 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.191+0000 7f9db17fa640 1 -- 172.21.15.148:0/1877207493 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc00d20b0 con 0x556089719620 2024-09-19T07:21:25.197 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.191+0000 7f9dd4a16740 1 -- 172.21.15.148:0/1877207493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556089719620 msgr2=0x55608973bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:25.197 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.191+0000 7f9dd4a16740 1 --2- 172.21.15.148:0/1877207493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556089719620 0x55608973bba0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f9dc009c3b0 tx=0x7f9dc0096f90 comp rx=0 tx=0).stop 2024-09-19T07:21:25.197 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.191+0000 7f9dd4a16740 1 -- 172.21.15.148:0/1877207493 shutdown_connections 2024-09-19T07:21:25.197 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.191+0000 7f9dd4a16740 1 --2- 172.21.15.148:0/1877207493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556089723ec0 0x55608973c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.197 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.191+0000 7f9dd4a16740 1 --2- 172.21.15.148:0/1877207493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556089719620 0x55608973bba0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.197 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.191+0000 7f9dd4a16740 1 --2- 172.21.15.148:0/1877207493 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556089718d00 0x556089722ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.197 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.191+0000 7f9dd4a16740 1 -- 172.21.15.148:0/1877207493 >> 172.21.15.148:0/1877207493 conn(0x556089715270 msgr2=0x5560897225d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:25.197 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.191+0000 7f9dd4a16740 1 -- 172.21.15.148:0/1877207493 shutdown_connections 2024-09-19T07:21:25.197 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.191+0000 7f9dd4a16740 1 -- 172.21.15.148:0/1877207493 wait complete. 2024-09-19T07:21:25.197 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.191+0000 7f9dd4a16740 1 -- start start 2024-09-19T07:21:25.197 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.192+0000 7f9dd4a16740 1 Processor -- start 2024-09-19T07:21:25.197 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.192+0000 7f9dd4a16740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556089718d00 0x556089728270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:25.198 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.192+0000 7f9dd4a16740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556089719620 0x5560897287b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:25.198 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.192+0000 7f9dd4a16740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556089723ec0 0x55608979db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:25.198 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.192+0000 7f9dd4a16740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9dcc1a9d90 con 0x556089718d00 2024-09-19T07:21:25.198 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.192+0000 7f9dd4a16740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9dcc1ab200 con 0x556089723ec0 2024-09-19T07:21:25.198 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.192+0000 7f9dd4a16740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9dcc1aa460 con 0x556089719620 2024-09-19T07:21:25.198 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.192+0000 7f9dd4a16740 10 client.0 _ll_register_callbacks cb 0x7f9dc4014030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:21:25.198 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.192+0000 7f9dcb7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556089718d00 0x556089728270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:25.198 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.192+0000 7f9dcb7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556089718d00 0x556089728270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45730/0 (socket says 172.21.15.148:45730) 2024-09-19T07:21:25.198 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.192+0000 7f9dcb7fe640 1 -- 172.21.15.148:0/614090834 learned_addr learned my addr 172.21.15.148:0/614090834 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:21:25.198 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.192+0000 7f9dcaffd640 1 --2- 172.21.15.148:0/614090834 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556089719620 0x5560897287b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:25.198 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.192+0000 7f9dcbfff640 1 --2- 172.21.15.148:0/614090834 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556089723ec0 0x55608979db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:25.198 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.192+0000 7f9dcb7fe640 1 -- 172.21.15.148:0/614090834 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556089719620 msgr2=0x5560897287b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:25.198 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.192+0000 7f9dcb7fe640 1 --2- 172.21.15.148:0/614090834 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556089719620 0x5560897287b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.199 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.192+0000 7f9dcb7fe640 1 -- 172.21.15.148:0/614090834 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556089723ec0 msgr2=0x55608979db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:25.199 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.192+0000 7f9dcb7fe640 1 --2- 172.21.15.148:0/614090834 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556089723ec0 0x55608979db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.199 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.192+0000 7f9dcb7fe640 1 -- 172.21.15.148:0/614090834 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560897150a0 con 0x556089718d00 2024-09-19T07:21:25.199 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.193+0000 7f9dcb7fe640 1 --2- 172.21.15.148:0/614090834 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556089718d00 0x556089728270 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc000c00 tx=0x7f9dbc005470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44e569d44f79608c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:25.199 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.193+0000 7f9daaffd640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:21:25.199 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.193+0000 7f9daaffd640 1 -- 172.21.15.148:0/614090834 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc035040 con 0x556089718d00 2024-09-19T07:21:25.199 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.193+0000 7f9daaffd640 1 -- 172.21.15.148:0/614090834 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8556+0+0 (secure 0 0 0) 0x7f9dbc004250 con 0x556089718d00 2024-09-19T07:21:25.199 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.193+0000 7f9dd4a16740 1 -- 172.21.15.148:0/614090834 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9dc00a4fe0 con 0x556089718d00 2024-09-19T07:21:25.199 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.193+0000 7f9daaffd640 1 -- 172.21.15.148:0/614090834 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f9dbc061050 con 0x556089718d00 2024-09-19T07:21:25.199 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.193+0000 7f9dd4a16740 10 client.17016 fetch_fsmap learned FSMap version 43 2024-09-19T07:21:25.199 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.193+0000 7f9dd4a16740 1 -- 172.21.15.148:0/614090834 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55608979f120 con 0x556089718d00 2024-09-19T07:21:25.199 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.193+0000 7f9daaffd640 1 -- 172.21.15.148:0/614090834 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9dc00a4fe0 con 0x556089718d00 2024-09-19T07:21:25.199 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.193+0000 7f9daaffd640 1 -- 172.21.15.148:0/614090834 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 43) ==== 8362+0+0 (secure 0 0 0) 0x7f9dbc050070 con 0x556089718d00 2024-09-19T07:21:25.199 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.193+0000 7f9dd4a16740 10 client.17016 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T07:21:25.200 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.193+0000 7f9dd4a16740 10 client.17016 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:21:25.200 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.193+0000 7f9dd4a16740 20 client.17016 populate_metadata read hostname 'smithi148' 2024-09-19T07:21:25.200 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.193+0000 7f9dd4a16740 1 --2- 172.21.15.148:0/614090834 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55608979f480 0x5560897a1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:25.200 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.193+0000 7f9dd4a16740 4 client.17016 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:21:25.200 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.193+0000 7f9dd4a16740 1 -- 172.21.15.148:0/614090834 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556089682d70 con 0x55608979f480 2024-09-19T07:21:25.200 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.193+0000 7f9dcaffd640 1 --2- 172.21.15.148:0/614090834 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55608979f480 0x5560897a1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:25.200 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.194+0000 7f9dcaffd640 1 --2- 172.21.15.148:0/614090834 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55608979f480 0x5560897a1870 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e0faf7357528b07 server_cookie=592fa009a6aac2f9 in_seq=0 out_seq=0 2024-09-19T07:21:25.200 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.194+0000 7f9daaffd640 10 client.17016 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:21:25.210 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.208+0000 7f9daaffd640 1 -- 172.21.15.148:0/614090834 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556089682d70 con 0x55608979f480 2024-09-19T07:21:25.210 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.208+0000 7f9daaffd640 10 client.17016 handle_command_reply: tid=0 2024-09-19T07:21:25.210 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.208+0000 7f9dd4a16740 1 client.17016 shutdown 2024-09-19T07:21:25.210 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.208+0000 7f9dd4a16740 1 -- 172.21.15.148:0/614090834 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556089718d00 msgr2=0x556089728270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:25.210 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.208+0000 7f9dd4a16740 1 --2- 172.21.15.148:0/614090834 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556089718d00 0x556089728270 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc000c00 tx=0x7f9dbc005470 comp rx=0 tx=0).stop 2024-09-19T07:21:25.210 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.208+0000 7f9dd4a16740 1 -- 172.21.15.148:0/614090834 shutdown_connections 2024-09-19T07:21:25.210 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.208+0000 7f9dd4a16740 1 --2- 172.21.15.148:0/614090834 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55608979f480 0x5560897a1870 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.210 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.208+0000 7f9dd4a16740 1 --2- 172.21.15.148:0/614090834 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556089723ec0 0x55608979db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.210 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.208+0000 7f9dd4a16740 1 --2- 172.21.15.148:0/614090834 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556089719620 0x5560897287b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.210 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.208+0000 7f9daaffd640 0 client.17016 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:21:25.210 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.208+0000 7f9dd4a16740 1 --2- 172.21.15.148:0/614090834 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556089718d00 0x556089728270 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.211 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.208+0000 7f9dd4a16740 1 -- 172.21.15.148:0/614090834 >> 172.21.15.148:0/614090834 conn(0x556089715270 msgr2=0x556089721550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:25.211 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.208+0000 7f9dd4a16740 1 -- 172.21.15.148:0/614090834 shutdown_connections 2024-09-19T07:21:25.211 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.208+0000 7f9dd4a16740 1 -- 172.21.15.148:0/614090834 wait complete. 2024-09-19T07:21:25.211 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.208+0000 7f9dd4a16740 20 client.17016 trim_cache size 0 max 16384 2024-09-19T07:21:25.211 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:21:25.211 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:21:25.211 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:21:25.211 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:21:25.212 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.209+0000 7f9dd1b9f640 1 -- 172.21.15.148:0/2299586463 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f9db40a3460 msgr2=0x7f9db40a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:25.212 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.209+0000 7f9dd1b9f640 1 --2- 172.21.15.148:0/2299586463 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f9db40a3460 0x7f9db40a5920 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4005f40 tx=0x7f9dc4004ab0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.212 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.209+0000 7f9dd1b9f640 1 -- 172.21.15.148:0/2299586463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9dcc101390 msgr2=0x7f9dcc1977f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:25.212 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.209+0000 7f9dd1b9f640 1 --2- 172.21.15.148:0/2299586463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9dcc101390 0x7f9dcc1977f0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f9dc000e9f0 tx=0x7f9dc000eeb0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.212 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.209+0000 7f9dd1b9f640 1 -- 172.21.15.148:0/2299586463 shutdown_connections 2024-09-19T07:21:25.212 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.209+0000 7f9dd1b9f640 1 --2- 172.21.15.148:0/2299586463 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f9db40a3460 0x7f9db40a5920 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.213 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.209+0000 7f9dd1b9f640 1 --2- 172.21.15.148:0/2299586463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9dcc106a00 0x7f9dcc19bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.213 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.209+0000 7f9dd1b9f640 1 --2- 172.21.15.148:0/2299586463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9dcc101390 0x7f9dcc1977f0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.213 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.209+0000 7f9dd1b9f640 1 --2- 172.21.15.148:0/2299586463 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9dcc1009f0 0x7f9dcc1972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.213 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.209+0000 7f9dd1b9f640 1 -- 172.21.15.148:0/2299586463 >> 172.21.15.148:0/2299586463 conn(0x7f9dcc0fc6b0 msgr2=0x7f9dcc0fdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:25.213 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.209+0000 7f9dd1b9f640 1 -- 172.21.15.148:0/2299586463 shutdown_connections 2024-09-19T07:21:25.213 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:25.209+0000 7f9dd1b9f640 1 -- 172.21.15.148:0/2299586463 wait complete. 2024-09-19T07:21:25.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:25.598+0000 7fa2057fa640 1 -- 172.21.15.148:0/3076910118 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7fa218004e50 con 0x55595745d5f0 2024-09-19T07:21:25.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:25.598+0000 7fa2057fa640 10 client.26183 handle_command_reply: tid=0 2024-09-19T07:21:25.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:25.598+0000 7fa226593740 1 client.26183 shutdown 2024-09-19T07:21:25.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:25.599+0000 7fa226593740 1 -- 172.21.15.148:0/3076910118 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5559573d6760 msgr2=0x5559573e9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:25.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:25.599+0000 7fa226593740 1 --2- 172.21.15.148:0/3076910118 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5559573d6760 0x5559573e9bc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa21802bc20 tx=0x7fa218031f30 comp rx=0 tx=0).stop 2024-09-19T07:21:25.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:25.599+0000 7fa226593740 1 -- 172.21.15.148:0/3076910118 shutdown_connections 2024-09-19T07:21:25.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:25.599+0000 7fa226593740 1 --2- 172.21.15.148:0/3076910118 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55595745d5f0 0x55595745fa10 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:25.599+0000 7fa226593740 1 --2- 172.21.15.148:0/3076910118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5559573e1940 0x5559573e69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:25.599+0000 7fa226593740 1 --2- 172.21.15.148:0/3076910118 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5559573d7080 0x5559573ea100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:25.599+0000 7fa226593740 1 --2- 172.21.15.148:0/3076910118 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5559573d6760 0x5559573e9bc0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:25.599+0000 7fa2057fa640 0 client.26183 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:21:25.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:25.599+0000 7fa226593740 1 -- 172.21.15.148:0/3076910118 >> 172.21.15.148:0/3076910118 conn(0x5559573d2cf0 msgr2=0x5559573d1650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:25.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:25.599+0000 7fa226593740 1 -- 172.21.15.148:0/3076910118 shutdown_connections 2024-09-19T07:21:25.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:25.599+0000 7fa226593740 1 -- 172.21.15.148:0/3076910118 wait complete. 2024-09-19T07:21:25.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:25.599+0000 7fa226593740 20 client.26183 trim_cache size 0 max 16384 2024-09-19T07:21:25.602 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:21:25.602 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 43, 2024-09-19T07:21:25.602 INFO:teuthology.orchestra.run.smithi148.stdout: "leader": 24457, 2024-09-19T07:21:25.602 INFO:teuthology.orchestra.run.smithi148.stdout: "set_version": 34, 2024-09-19T07:21:25.602 INFO:teuthology.orchestra.run.smithi148.stdout: "sets": { 2024-09-19T07:21:25.602 INFO:teuthology.orchestra.run.smithi148.stdout: "3dcc7167": { 2024-09-19T07:21:25.602 INFO:teuthology.orchestra.run.smithi148.stdout: "version": 34, 2024-09-19T07:21:25.602 INFO:teuthology.orchestra.run.smithi148.stdout: "age_ref": 0.0, 2024-09-19T07:21:25.602 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:21:25.602 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "QUIESCED", 2024-09-19T07:21:25.602 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:21:25.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:21:25.603 INFO:teuthology.orchestra.run.smithi148.stdout: "timeout": 90.0, 2024-09-19T07:21:25.603 INFO:teuthology.orchestra.run.smithi148.stdout: "expiration": 150.0, 2024-09-19T07:21:25.603 INFO:teuthology.orchestra.run.smithi148.stdout: "members": { 2024-09-19T07:21:25.603 INFO:teuthology.orchestra.run.smithi148.stdout: "file:/": { 2024-09-19T07:21:25.603 INFO:teuthology.orchestra.run.smithi148.stdout: "excluded": false, 2024-09-19T07:21:25.603 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:21:25.603 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "QUIESCED", 2024-09-19T07:21:25.603 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:21:25.603 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:21:25.603 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:21:25.603 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:21:25.603 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:21:25.603 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:21:25.604 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:21:25.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:25.600+0000 7fa2241ba640 1 -- 172.21.15.148:0/2418200862 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fa2080a33e0 msgr2=0x7fa2080a58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:25.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:25.600+0000 7fa2241ba640 1 --2- 172.21.15.148:0/2418200862 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fa2080a33e0 0x7fa2080a58a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa21800d3b0 tx=0x7fa21800d340 comp rx=0 tx=0).stop 2024-09-19T07:21:25.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:25.600+0000 7fa2241ba640 1 -- 172.21.15.148:0/2418200862 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa21c109e00 msgr2=0x7fa21c19e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:25.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:25.600+0000 7fa2241ba640 1 --2- 172.21.15.148:0/2418200862 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa21c109e00 0x7fa21c19e930 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa20c00b450 tx=0x7fa20c00b910 comp rx=0 tx=0).stop 2024-09-19T07:21:25.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:25.600+0000 7fa2241ba640 1 -- 172.21.15.148:0/2418200862 shutdown_connections 2024-09-19T07:21:25.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:25.600+0000 7fa2241ba640 1 --2- 172.21.15.148:0/2418200862 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fa2080a33e0 0x7fa2080a58a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:25.600+0000 7fa2241ba640 1 --2- 172.21.15.148:0/2418200862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa21c10ea80 0x7fa21c19ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:25.600+0000 7fa2241ba640 1 --2- 172.21.15.148:0/2418200862 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa21c109e00 0x7fa21c19e930 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:25.600+0000 7fa2241ba640 1 --2- 172.21.15.148:0/2418200862 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa21c109450 0x7fa21c1a58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:25.600+0000 7fa2241ba640 1 -- 172.21.15.148:0/2418200862 >> 172.21.15.148:0/2418200862 conn(0x7fa21c06e2d0 msgr2=0x7fa21c072980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:25.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:25.600+0000 7fa2241ba640 1 -- 172.21.15.148:0/2418200862 shutdown_connections 2024-09-19T07:21:25.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:25.600+0000 7fa2241ba640 1 -- 172.21.15.148:0/2418200862 wait complete. 2024-09-19T07:21:26.392 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '3dcc7167', quiesce took 16.6 seconds. Will release after: 13.399999999999999 2024-09-19T07:21:26.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:26 smithi179 ceph-mon[35716]: pgmap v323: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 8.5 KiB/s wr, 12 op/s 2024-09-19T07:21:26.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:26 smithi148 ceph-mon[31180]: pgmap v323: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 8.5 KiB/s wr, 12 op/s 2024-09-19T07:21:26.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:26 smithi165 ceph-mon[35326]: pgmap v323: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 8.5 KiB/s wr, 12 op/s 2024-09-19T07:21:28.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:28 smithi179 ceph-mon[35716]: pgmap v324: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 8.5 KiB/s wr, 12 op/s 2024-09-19T07:21:28.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:28 smithi148 ceph-mon[31180]: pgmap v324: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 8.5 KiB/s wr, 12 op/s 2024-09-19T07:21:28.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:28 smithi165 ceph-mon[35326]: pgmap v324: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 8.5 KiB/s wr, 12 op/s 2024-09-19T07:21:30.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:30 smithi179 ceph-mon[35716]: pgmap v325: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 KiB/s wr, 12 op/s 2024-09-19T07:21:30.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:30 smithi148 ceph-mon[31180]: pgmap v325: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 KiB/s wr, 12 op/s 2024-09-19T07:21:30.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:30 smithi165 ceph-mon[35326]: pgmap v325: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 KiB/s wr, 12 op/s 2024-09-19T07:21:32.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:32 smithi179 ceph-mon[35716]: pgmap v326: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 18 KiB/s wr, 12 op/s 2024-09-19T07:21:32.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:32 smithi148 ceph-mon[31180]: pgmap v326: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 18 KiB/s wr, 12 op/s 2024-09-19T07:21:32.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:32 smithi165 ceph-mon[35326]: pgmap v326: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 18 KiB/s wr, 12 op/s 2024-09-19T07:21:34.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:34 smithi179 ceph-mon[35716]: pgmap v327: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 KiB/s wr, 12 op/s 2024-09-19T07:21:34.904 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:34 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:21:34.905 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:34 smithi165 ceph-mon[35326]: pgmap v327: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 KiB/s wr, 12 op/s 2024-09-19T07:21:34.905 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:34 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:21:34.906 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:34 smithi148 ceph-mon[31180]: pgmap v327: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 KiB/s wr, 12 op/s 2024-09-19T07:21:34.906 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:34 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:21:36.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:36 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:21:36.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:36 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:21:36.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:36 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:21:36.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:36 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:21:36.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:36 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:21:36.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:36 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:21:36.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:36 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:21:36.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:36 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:21:36.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:36 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:21:36.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:36 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:21:36.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:36 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:21:36.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:36 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:21:36.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:36 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:21:36.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:36 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:21:36.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:36 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:21:36.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:36 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:21:36.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:36 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:21:36.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:36 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:21:36.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:36 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:21:36.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:36 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:21:36.524 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:36 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:21:36.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:36 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:21:36.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:36 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:21:36.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:36 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:21:36.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:36 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:21:36.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:36 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:21:36.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:36 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:21:36.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:36 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:21:36.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:36 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:21:36.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:36 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:21:36.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:36 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:21:36.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:36 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:21:36.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:36 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:21:36.585 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:36 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:21:36.585 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:36 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:21:36.585 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:36 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:21:36.585 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:36 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:21:36.585 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:36 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:21:36.585 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:36 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:21:36.585 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:36 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:21:36.585 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:36 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:21:36.585 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:36 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:21:36.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:36 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:21:36.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:36 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:21:36.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:36 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:21:36.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:36 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:21:36.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:36 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:21:36.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:36 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:21:36.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:36 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:21:36.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:36 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:21:36.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:36 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:21:36.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:36 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:21:36.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:36 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:21:36.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:36 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:21:36.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:36 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:21:36.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:36 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:21:36.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:36 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:21:36.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:36 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:21:36.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:36 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:21:36.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:36 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:21:36.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:36 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:21:36.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:36 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:21:36.635 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:36 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:21:37.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:37 smithi179 ceph-mon[35716]: pgmap v328: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 KiB/s wr, 12 op/s 2024-09-19T07:21:37.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:37 smithi179 ceph-mon[35716]: Adjusting osd_memory_target on smithi165 to 176.0M 2024-09-19T07:21:37.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:37 smithi179 ceph-mon[35716]: Adjusting osd_memory_target on smithi148 to 176.0M 2024-09-19T07:21:37.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:37 smithi179 ceph-mon[35716]: Unable to set osd_memory_target on smithi165 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-19T07:21:37.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:37 smithi179 ceph-mon[35716]: Unable to set osd_memory_target on smithi148 to 184579584: error parsing value: Value '184579584' is below minimum 939524096 2024-09-19T07:21:37.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:37 smithi179 ceph-mon[35716]: Adjusting osd_memory_target on smithi179 to 176.0M 2024-09-19T07:21:37.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:37 smithi179 ceph-mon[35716]: Unable to set osd_memory_target on smithi179 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-19T07:21:37.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:37 smithi148 ceph-mon[31180]: pgmap v328: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 KiB/s wr, 12 op/s 2024-09-19T07:21:37.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:37 smithi148 ceph-mon[31180]: Adjusting osd_memory_target on smithi165 to 176.0M 2024-09-19T07:21:37.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:37 smithi148 ceph-mon[31180]: Adjusting osd_memory_target on smithi148 to 176.0M 2024-09-19T07:21:37.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:37 smithi148 ceph-mon[31180]: Unable to set osd_memory_target on smithi165 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-19T07:21:37.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:37 smithi148 ceph-mon[31180]: Unable to set osd_memory_target on smithi148 to 184579584: error parsing value: Value '184579584' is below minimum 939524096 2024-09-19T07:21:37.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:37 smithi148 ceph-mon[31180]: Adjusting osd_memory_target on smithi179 to 176.0M 2024-09-19T07:21:37.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:37 smithi148 ceph-mon[31180]: Unable to set osd_memory_target on smithi179 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-19T07:21:37.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:37 smithi165 ceph-mon[35326]: pgmap v328: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 KiB/s wr, 12 op/s 2024-09-19T07:21:37.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:37 smithi165 ceph-mon[35326]: Adjusting osd_memory_target on smithi165 to 176.0M 2024-09-19T07:21:37.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:37 smithi165 ceph-mon[35326]: Adjusting osd_memory_target on smithi148 to 176.0M 2024-09-19T07:21:37.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:37 smithi165 ceph-mon[35326]: Unable to set osd_memory_target on smithi165 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-19T07:21:37.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:37 smithi165 ceph-mon[35326]: Unable to set osd_memory_target on smithi148 to 184579584: error parsing value: Value '184579584' is below minimum 939524096 2024-09-19T07:21:37.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:37 smithi165 ceph-mon[35326]: Adjusting osd_memory_target on smithi179 to 176.0M 2024-09-19T07:21:37.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:37 smithi165 ceph-mon[35326]: Unable to set osd_memory_target on smithi179 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-19T07:21:38.311 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.306+0000 7f8998131640 1 -- 172.21.15.148:0/3177446563 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8990101ad0 msgr2=0x7f8990101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:38.311 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.306+0000 7f8998131640 1 --2- 172.21.15.148:0/3177446563 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8990101ad0 0x7f8990101f30 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f8980009930 tx=0x7f898002a420 comp rx=0 tx=0).stop 2024-09-19T07:21:38.311 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.307+0000 7f8998131640 1 -- 172.21.15.148:0/3177446563 shutdown_connections 2024-09-19T07:21:38.311 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.307+0000 7f8998131640 1 --2- 172.21.15.148:0/3177446563 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8990102470 0x7f899010e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:38.311 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.307+0000 7f8998131640 1 --2- 172.21.15.148:0/3177446563 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8990101ad0 0x7f8990101f30 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:38.311 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.307+0000 7f8998131640 1 --2- 172.21.15.148:0/3177446563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8990107b70 0x7f8990107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:38.311 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.307+0000 7f8998131640 1 -- 172.21.15.148:0/3177446563 >> 172.21.15.148:0/3177446563 conn(0x7f89900fd7d0 msgr2=0x7f89900ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:38.311 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.307+0000 7f8998131640 1 -- 172.21.15.148:0/3177446563 shutdown_connections 2024-09-19T07:21:38.311 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.307+0000 7f8998131640 1 -- 172.21.15.148:0/3177446563 wait complete. 2024-09-19T07:21:38.312 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.307+0000 7f8998131640 1 Processor -- start 2024-09-19T07:21:38.312 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.307+0000 7f8998131640 1 -- start start 2024-09-19T07:21:38.312 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.307+0000 7f8998131640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8990101ad0 0x7f8990198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:38.312 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.307+0000 7f8998131640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8990102470 0x7f89901988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:38.312 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.308+0000 7f8998131640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8990107b70 0x7f899019cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:38.312 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.308+0000 7f8998131640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8990111f20 con 0x7f8990101ad0 2024-09-19T07:21:38.312 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.308+0000 7f8998131640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8990111da0 con 0x7f8990102470 2024-09-19T07:21:38.312 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.308+0000 7f8998131640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f89901120a0 con 0x7f8990107b70 2024-09-19T07:21:38.312 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.308+0000 7f8995ecd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8990101ad0 0x7f8990198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:38.313 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.308+0000 7f8995ecd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8990101ad0 0x7f8990198370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47850/0 (socket says 172.21.15.148:47850) 2024-09-19T07:21:38.313 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.308+0000 7f8995ecd640 1 -- 172.21.15.148:0/1415269271 learned_addr learned my addr 172.21.15.148:0/1415269271 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:21:38.313 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.308+0000 7f89956cc640 1 --2- 172.21.15.148:0/1415269271 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8990102470 0x7f89901988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:38.313 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.308+0000 7f89966ce640 1 --2- 172.21.15.148:0/1415269271 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8990107b70 0x7f899019cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:38.313 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.308+0000 7f8995ecd640 1 -- 172.21.15.148:0/1415269271 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8990107b70 msgr2=0x7f899019cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:38.313 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.308+0000 7f8995ecd640 1 --2- 172.21.15.148:0/1415269271 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8990107b70 0x7f899019cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:38.313 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.308+0000 7f8995ecd640 1 -- 172.21.15.148:0/1415269271 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8990102470 msgr2=0x7f89901988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:38.313 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.308+0000 7f8995ecd640 1 --2- 172.21.15.148:0/1415269271 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8990102470 0x7f89901988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:38.313 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.308+0000 7f8995ecd640 1 -- 172.21.15.148:0/1415269271 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f899019d360 con 0x7f8990101ad0 2024-09-19T07:21:38.313 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.308+0000 7f8995ecd640 1 --2- 172.21.15.148:0/1415269271 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8990101ad0 0x7f8990198370 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f898c00d770 tx=0x7f898c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:38.313 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.308+0000 7f8986ffd640 1 -- 172.21.15.148:0/1415269271 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898c017070 con 0x7f8990101ad0 2024-09-19T07:21:38.314 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.308+0000 7f8986ffd640 1 -- 172.21.15.148:0/1415269271 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f898c005500 con 0x7f8990101ad0 2024-09-19T07:21:38.314 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.308+0000 7f8986ffd640 1 -- 172.21.15.148:0/1415269271 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898c004e00 con 0x7f8990101ad0 2024-09-19T07:21:38.314 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.308+0000 7f8998131640 1 -- 172.21.15.148:0/1415269271 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f899019d650 con 0x7f8990101ad0 2024-09-19T07:21:38.314 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.308+0000 7f8998131640 1 -- 172.21.15.148:0/1415269271 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89901a4ee0 con 0x7f8990101ad0 2024-09-19T07:21:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.311+0000 7f8986ffd640 1 -- 172.21.15.148:0/1415269271 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f898c004fa0 con 0x7f8990101ad0 2024-09-19T07:21:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.311+0000 7f899aecc740 1 Processor -- start 2024-09-19T07:21:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.311+0000 7f899aecc740 1 -- start start 2024-09-19T07:21:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.311+0000 7f899aecc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d875a4af0 0x564d875a4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.311+0000 7f899aecc740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d875a5410 0x564d875af770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.312+0000 7f899aecc740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564d875afcb0 0x564d875b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:38.322 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.312+0000 7f899aecc740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x564d875092f0 con 0x564d875a5410 2024-09-19T07:21:38.322 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.312+0000 7f899aecc740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x564d874b1270 con 0x564d875afcb0 2024-09-19T07:21:38.322 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.312+0000 7f899aecc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564d875052b0 con 0x564d875a4af0 2024-09-19T07:21:38.322 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.312+0000 7f8986ffd640 1 --2- 172.21.15.148:0/1415269271 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f897c0a3460 0x7f897c0a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:38.322 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.312+0000 7f89966ce640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d875a4af0 0x564d875a4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:38.322 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.312+0000 7f8995ecd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d875a5410 0x564d875af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:38.322 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.312+0000 7f89956cc640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564d875afcb0 0x564d875b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:38.322 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.312+0000 7f89966ce640 1 --2- 172.21.15.148:0/1415269271 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f897c0a3460 0x7f897c0a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:38.322 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.312+0000 7f89956cc640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564d875afcb0 0x564d875b20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:52462/0 (socket says 172.21.15.148:52462) 2024-09-19T07:21:38.322 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.312+0000 7f89956cc640 1 -- 172.21.15.148:0/750029259 learned_addr learned my addr 172.21.15.148:0/750029259 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:21:38.322 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.312+0000 7f8986ffd640 1 -- 172.21.15.148:0/1415269271 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8556+0+0 (secure 0 0 0) 0x7f898c0cf7c0 con 0x7f8990101ad0 2024-09-19T07:21:38.323 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.312+0000 7f8995ecd640 1 -- 172.21.15.148:0/750029259 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d875a4af0 msgr2=0x564d875a4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:38.323 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.312+0000 7f8995ecd640 1 --2- 172.21.15.148:0/750029259 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d875a4af0 0x564d875a4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:38.323 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.312+0000 7f8995ecd640 1 -- 172.21.15.148:0/750029259 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564d875afcb0 msgr2=0x564d875b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:38.323 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.312+0000 7f8995ecd640 1 --2- 172.21.15.148:0/750029259 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564d875afcb0 0x564d875b20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:38.323 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.312+0000 7f8995ecd640 1 -- 172.21.15.148:0/750029259 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d874b0340 con 0x564d875a5410 2024-09-19T07:21:38.323 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.312+0000 7f89966ce640 1 --2- 172.21.15.148:0/1415269271 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f897c0a3460 0x7f897c0a5920 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8988009270 tx=0x7f8988004ab0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:38.324 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.312+0000 7f8995ecd640 1 --2- 172.21.15.148:0/750029259 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d875a5410 0x564d875af770 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f898c0ccef0 tx=0x7f898c0048a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8c7a60e13b54a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:38.324 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.313+0000 7f897bfff640 1 -- 172.21.15.148:0/750029259 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898c020030 con 0x564d875a5410 2024-09-19T07:21:38.324 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.313+0000 7f897bfff640 1 -- 172.21.15.148:0/750029259 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f898c09c180 con 0x564d875a5410 2024-09-19T07:21:38.324 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.313+0000 7f897bfff640 1 -- 172.21.15.148:0/750029259 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898c0860e0 con 0x564d875a5410 2024-09-19T07:21:38.324 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.313+0000 7f899aecc740 1 -- 172.21.15.148:0/750029259 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d875a5410 msgr2=0x564d875af770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:38.324 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.313+0000 7f899aecc740 1 --2- 172.21.15.148:0/750029259 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d875a5410 0x564d875af770 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f898c0ccef0 tx=0x7f898c0048a0 comp rx=0 tx=0).stop 2024-09-19T07:21:38.324 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.313+0000 7f899aecc740 1 -- 172.21.15.148:0/750029259 shutdown_connections 2024-09-19T07:21:38.324 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.313+0000 7f899aecc740 1 --2- 172.21.15.148:0/750029259 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564d875afcb0 0x564d875b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:38.324 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.313+0000 7f899aecc740 1 --2- 172.21.15.148:0/750029259 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d875a5410 0x564d875af770 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:38.325 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.313+0000 7f899aecc740 1 --2- 172.21.15.148:0/750029259 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d875a4af0 0x564d875a4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:38.325 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.313+0000 7f899aecc740 1 -- 172.21.15.148:0/750029259 >> 172.21.15.148:0/750029259 conn(0x564d875a1060 msgr2=0x564d875a1440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:38.325 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.313+0000 7f899aecc740 1 -- 172.21.15.148:0/750029259 shutdown_connections 2024-09-19T07:21:38.325 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.314+0000 7f899aecc740 1 -- 172.21.15.148:0/750029259 wait complete. 2024-09-19T07:21:38.325 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.314+0000 7f899aecc740 1 -- start start 2024-09-19T07:21:38.325 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.314+0000 7f899aecc740 1 Processor -- start 2024-09-19T07:21:38.325 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.314+0000 7f899aecc740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d875a4af0 0x564d875acc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:38.325 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.314+0000 7f899aecc740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564d875a5410 0x564d875ad160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:38.325 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.314+0000 7f899aecc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d875afcb0 0x564d875ad6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:38.326 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.314+0000 7f899aecc740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x564d875b2820 con 0x564d875a4af0 2024-09-19T07:21:38.326 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.314+0000 7f899aecc740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x564d87492290 con 0x564d875a5410 2024-09-19T07:21:38.326 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.314+0000 7f899aecc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564d875b29a0 con 0x564d875afcb0 2024-09-19T07:21:38.326 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.314+0000 7f899aecc740 10 client.0 _ll_register_callbacks cb 0x564d874c3140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:21:38.326 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.315+0000 7f8995ecd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d875a4af0 0x564d875acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:38.326 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.315+0000 7f8995ecd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d875a4af0 0x564d875acc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47868/0 (socket says 172.21.15.148:47868) 2024-09-19T07:21:38.326 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.315+0000 7f8995ecd640 1 -- 172.21.15.148:0/3367935535 learned_addr learned my addr 172.21.15.148:0/3367935535 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:21:38.326 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.315+0000 7f89956cc640 1 --2- 172.21.15.148:0/3367935535 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564d875a5410 0x564d875ad160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:38.326 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.315+0000 7f89966ce640 1 --2- 172.21.15.148:0/3367935535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d875afcb0 0x564d875ad6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:38.326 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.315+0000 7f8995ecd640 1 -- 172.21.15.148:0/3367935535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d875afcb0 msgr2=0x564d875ad6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:38.326 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.315+0000 7f8995ecd640 1 --2- 172.21.15.148:0/3367935535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d875afcb0 0x564d875ad6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:38.326 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.315+0000 7f8995ecd640 1 -- 172.21.15.148:0/3367935535 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564d875a5410 msgr2=0x564d875ad160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:38.327 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.315+0000 7f8995ecd640 1 --2- 172.21.15.148:0/3367935535 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564d875a5410 0x564d875ad160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:38.327 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.315+0000 7f8995ecd640 1 -- 172.21.15.148:0/3367935535 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d8721c210 con 0x564d875a4af0 2024-09-19T07:21:38.327 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.315+0000 7f8995ecd640 1 --2- 172.21.15.148:0/3367935535 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d875a4af0 0x564d875acc20 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f898c09b780 tx=0x7f898c0057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1a73314297b6752 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:38.327 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.315+0000 7f89797fa640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:21:38.327 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.315+0000 7f89797fa640 1 -- 172.21.15.148:0/3367935535 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898c020050 con 0x564d875a4af0 2024-09-19T07:21:38.327 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.315+0000 7f89797fa640 1 -- 172.21.15.148:0/3367935535 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8556+0+0 (secure 0 0 0) 0x7f898c0860b0 con 0x564d875a4af0 2024-09-19T07:21:38.327 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.315+0000 7f899aecc740 1 -- 172.21.15.148:0/3367935535 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f898c09c180 con 0x564d875a4af0 2024-09-19T07:21:38.327 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.315+0000 7f89797fa640 1 -- 172.21.15.148:0/3367935535 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f898c09fe30 con 0x564d875a4af0 2024-09-19T07:21:38.327 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.315+0000 7f899aecc740 10 client.17028 fetch_fsmap learned FSMap version 43 2024-09-19T07:21:38.327 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.315+0000 7f899aecc740 1 -- 172.21.15.148:0/3367935535 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x564d872e8620 con 0x564d875a4af0 2024-09-19T07:21:38.328 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.316+0000 7f89797fa640 1 -- 172.21.15.148:0/3367935535 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f898c09c180 con 0x564d875a4af0 2024-09-19T07:21:38.328 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.316+0000 7f89797fa640 1 -- 172.21.15.148:0/3367935535 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 43) ==== 8362+0+0 (secure 0 0 0) 0x7f898c09aed0 con 0x564d875a4af0 2024-09-19T07:21:38.328 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.316+0000 7f899aecc740 10 client.17028 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T07:21:38.328 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.316+0000 7f899aecc740 10 client.17028 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:21:38.328 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.316+0000 7f899aecc740 20 client.17028 populate_metadata read hostname 'smithi148' 2024-09-19T07:21:38.328 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.316+0000 7f899aecc740 1 --2- 172.21.15.148:0/3367935535 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x564d875bfaa0 0x564d875c1e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:38.328 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.316+0000 7f899aecc740 4 client.17028 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:21:38.328 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.316+0000 7f899aecc740 1 -- 172.21.15.148:0/3367935535 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564d87516a20 con 0x564d875bfaa0 2024-09-19T07:21:38.328 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.316+0000 7f89956cc640 1 --2- 172.21.15.148:0/3367935535 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x564d875bfaa0 0x564d875c1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:38.328 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.316+0000 7f89956cc640 1 --2- 172.21.15.148:0/3367935535 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x564d875bfaa0 0x564d875c1e90 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8e72fe480593487 server_cookie=924dfb68b2338752 in_seq=0 out_seq=0 2024-09-19T07:21:38.328 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.316+0000 7f89797fa640 10 client.17028 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:21:38.328 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.317+0000 7f89797fa640 1 -- 172.21.15.148:0/3367935535 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564d87516a20 con 0x564d875bfaa0 2024-09-19T07:21:38.329 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.317+0000 7f89797fa640 10 client.17028 handle_command_reply: tid=0 2024-09-19T07:21:38.329 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.317+0000 7f899aecc740 1 client.17028 shutdown 2024-09-19T07:21:38.329 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.317+0000 7f899aecc740 1 -- 172.21.15.148:0/3367935535 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d875a4af0 msgr2=0x564d875acc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:38.329 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.317+0000 7f899aecc740 1 --2- 172.21.15.148:0/3367935535 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d875a4af0 0x564d875acc20 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f898c09b780 tx=0x7f898c0057b0 comp rx=0 tx=0).stop 2024-09-19T07:21:38.329 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.317+0000 7f899aecc740 1 -- 172.21.15.148:0/3367935535 shutdown_connections 2024-09-19T07:21:38.329 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.317+0000 7f899aecc740 1 --2- 172.21.15.148:0/3367935535 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x564d875bfaa0 0x564d875c1e90 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:38.329 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.317+0000 7f899aecc740 1 --2- 172.21.15.148:0/3367935535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d875afcb0 0x564d875ad6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:38.329 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.317+0000 7f899aecc740 1 --2- 172.21.15.148:0/3367935535 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564d875a5410 0x564d875ad160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:38.329 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.317+0000 7f89797fa640 0 client.17028 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:21:38.329 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.317+0000 7f899aecc740 1 --2- 172.21.15.148:0/3367935535 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d875a4af0 0x564d875acc20 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:38.329 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.317+0000 7f899aecc740 1 -- 172.21.15.148:0/3367935535 >> 172.21.15.148:0/3367935535 conn(0x564d875a1060 msgr2=0x564d875a6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:38.330 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.317+0000 7f899aecc740 1 -- 172.21.15.148:0/3367935535 shutdown_connections 2024-09-19T07:21:38.330 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.317+0000 7f899aecc740 1 -- 172.21.15.148:0/3367935535 wait complete. 2024-09-19T07:21:38.330 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.317+0000 7f899aecc740 20 client.17028 trim_cache size 0 max 16384 2024-09-19T07:21:38.334 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.332+0000 7f899aecc740 1 Processor -- start 2024-09-19T07:21:38.334 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.332+0000 7f899aecc740 1 -- start start 2024-09-19T07:21:38.334 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.332+0000 7f899aecc740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564d875a4af0 0x564d875ad4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:38.334 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.332+0000 7f899aecc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d875a5410 0x564d875c7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:38.334 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.332+0000 7f899aecc740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d875afcb0 0x564d875c7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:38.335 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.332+0000 7f899aecc740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f89901adfd0 con 0x564d875afcb0 2024-09-19T07:21:38.335 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.332+0000 7f899aecc740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f89901ab840 con 0x564d875a4af0 2024-09-19T07:21:38.335 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.332+0000 7f899aecc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f89901a96d0 con 0x564d875a5410 2024-09-19T07:21:38.335 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.332+0000 7f89966ce640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d875afcb0 0x564d875c7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:38.335 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.332+0000 7f89966ce640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d875afcb0 0x564d875c7970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47882/0 (socket says 172.21.15.148:47882) 2024-09-19T07:21:38.335 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.332+0000 7f89966ce640 1 -- 172.21.15.148:0/2122814959 learned_addr learned my addr 172.21.15.148:0/2122814959 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:21:38.335 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.332+0000 7f8995ecd640 1 --2- 172.21.15.148:0/2122814959 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564d875a4af0 0x564d875ad4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:38.335 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.332+0000 7f89956cc640 1 --2- 172.21.15.148:0/2122814959 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d875a5410 0x564d875c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:38.335 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.332+0000 7f89966ce640 1 -- 172.21.15.148:0/2122814959 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d875a5410 msgr2=0x564d875c7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:38.335 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.332+0000 7f89966ce640 1 --2- 172.21.15.148:0/2122814959 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d875a5410 0x564d875c7430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:38.335 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.332+0000 7f89966ce640 1 -- 172.21.15.148:0/2122814959 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564d875a4af0 msgr2=0x564d875ad4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:38.335 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.332+0000 7f89966ce640 1 --2- 172.21.15.148:0/2122814959 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564d875a4af0 0x564d875ad4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:38.335 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.332+0000 7f89966ce640 1 -- 172.21.15.148:0/2122814959 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d875bc600 con 0x564d875afcb0 2024-09-19T07:21:38.336 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.332+0000 7f8995ecd640 1 --2- 172.21.15.148:0/2122814959 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564d875a4af0 0x564d875ad4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:21:38.336 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.332+0000 7f89966ce640 1 --2- 172.21.15.148:0/2122814959 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d875afcb0 0x564d875c7970 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f8988015d20 tx=0x7f8988014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec24f0fc2a026134 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:38.336 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.333+0000 7f897b7fe640 1 -- 172.21.15.148:0/2122814959 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89880156b0 con 0x564d875afcb0 2024-09-19T07:21:38.336 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.333+0000 7f897b7fe640 1 -- 172.21.15.148:0/2122814959 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8988013c50 con 0x564d875afcb0 2024-09-19T07:21:38.336 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.333+0000 7f897b7fe640 1 -- 172.21.15.148:0/2122814959 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898802dd90 con 0x564d875afcb0 2024-09-19T07:21:38.336 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.333+0000 7f899aecc740 1 -- 172.21.15.148:0/2122814959 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d875afcb0 msgr2=0x564d875c7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:38.336 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.333+0000 7f899aecc740 1 --2- 172.21.15.148:0/2122814959 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d875afcb0 0x564d875c7970 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f8988015d20 tx=0x7f8988014000 comp rx=0 tx=0).stop 2024-09-19T07:21:38.336 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.333+0000 7f899aecc740 1 -- 172.21.15.148:0/2122814959 shutdown_connections 2024-09-19T07:21:38.336 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.333+0000 7f899aecc740 1 --2- 172.21.15.148:0/2122814959 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d875afcb0 0x564d875c7970 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:38.336 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.333+0000 7f899aecc740 1 --2- 172.21.15.148:0/2122814959 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d875a5410 0x564d875c7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:38.336 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.333+0000 7f899aecc740 1 --2- 172.21.15.148:0/2122814959 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564d875a4af0 0x564d875ad4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:38.336 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.333+0000 7f899aecc740 1 -- 172.21.15.148:0/2122814959 >> 172.21.15.148:0/2122814959 conn(0x564d875a1060 msgr2=0x564d875aeca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:38.336 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.333+0000 7f899aecc740 1 -- 172.21.15.148:0/2122814959 shutdown_connections 2024-09-19T07:21:38.337 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.333+0000 7f899aecc740 1 -- 172.21.15.148:0/2122814959 wait complete. 2024-09-19T07:21:38.337 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.334+0000 7f899aecc740 1 -- start start 2024-09-19T07:21:38.337 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.334+0000 7f899aecc740 1 Processor -- start 2024-09-19T07:21:38.340 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.334+0000 7f899aecc740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564d875a4af0 0x564d875a9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:38.340 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.334+0000 7f899aecc740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d875a5410 0x564d875aa0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:38.340 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.334+0000 7f899aecc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d875afcb0 0x564d875aa610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:38.340 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.334+0000 7f899aecc740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f89901a9d20 con 0x564d875a5410 2024-09-19T07:21:38.340 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.334+0000 7f899aecc740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f89901ab170 con 0x564d875a4af0 2024-09-19T07:21:38.340 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.334+0000 7f899aecc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f89901aa3d0 con 0x564d875afcb0 2024-09-19T07:21:38.340 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.334+0000 7f899aecc740 10 client.0 _ll_register_callbacks cb 0x7f8980009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:21:38.340 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.334+0000 7f89956cc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d875a5410 0x564d875aa0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:38.341 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.334+0000 7f89956cc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d875a5410 0x564d875aa0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47892/0 (socket says 172.21.15.148:47892) 2024-09-19T07:21:38.341 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.334+0000 7f89956cc640 1 -- 172.21.15.148:0/1549519884 learned_addr learned my addr 172.21.15.148:0/1549519884 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:21:38.341 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.334+0000 7f8995ecd640 1 --2- 172.21.15.148:0/1549519884 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564d875a4af0 0x564d875a9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:38.341 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.334+0000 7f89956cc640 1 -- 172.21.15.148:0/1549519884 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d875afcb0 msgr2=0x564d875aa610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:38.341 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.334+0000 7f89956cc640 1 --2- 172.21.15.148:0/1549519884 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d875afcb0 0x564d875aa610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:38.341 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.334+0000 7f89956cc640 1 -- 172.21.15.148:0/1549519884 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564d875a4af0 msgr2=0x564d875a9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:38.341 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.334+0000 7f89956cc640 1 --2- 172.21.15.148:0/1549519884 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564d875a4af0 0x564d875a9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:38.341 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.334+0000 7f89956cc640 1 -- 172.21.15.148:0/1549519884 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d87629400 con 0x564d875a5410 2024-09-19T07:21:38.341 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.335+0000 7f89956cc640 1 --2- 172.21.15.148:0/1549519884 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d875a5410 0x564d875aa0d0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f8980009230 tx=0x7f8980005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c617577334990d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:38.342 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.335+0000 7f89797fa640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:21:38.342 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.335+0000 7f89797fa640 1 -- 172.21.15.148:0/1549519884 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898004a060 con 0x564d875a5410 2024-09-19T07:21:38.342 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.335+0000 7f89797fa640 1 -- 172.21.15.148:0/1549519884 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8556+0+0 (secure 0 0 0) 0x7f8980005040 con 0x564d875a5410 2024-09-19T07:21:38.342 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.335+0000 7f899aecc740 1 -- 172.21.15.148:0/1549519884 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8988013c50 con 0x564d875a5410 2024-09-19T07:21:38.342 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.335+0000 7f89797fa640 1 -- 172.21.15.148:0/1549519884 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f8980035040 con 0x564d875a5410 2024-09-19T07:21:38.342 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.335+0000 7f899aecc740 10 client.17034 fetch_fsmap learned FSMap version 43 2024-09-19T07:21:38.342 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.335+0000 7f899aecc740 1 -- 172.21.15.148:0/1549519884 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x564d8762a720 con 0x564d875a5410 2024-09-19T07:21:38.342 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.335+0000 7f89797fa640 1 -- 172.21.15.148:0/1549519884 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8988013c50 con 0x564d875a5410 2024-09-19T07:21:38.342 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.335+0000 7f89797fa640 1 -- 172.21.15.148:0/1549519884 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 43) ==== 8362+0+0 (secure 0 0 0) 0x7f89800035f0 con 0x564d875a5410 2024-09-19T07:21:38.342 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.335+0000 7f899aecc740 10 client.17034 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T07:21:38.342 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.335+0000 7f899aecc740 10 client.17034 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:21:38.342 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.335+0000 7f899aecc740 20 client.17034 populate_metadata read hostname 'smithi148' 2024-09-19T07:21:38.342 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.335+0000 7f899aecc740 1 --2- 172.21.15.148:0/1549519884 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x564d8762aeb0 0x564d8762d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:38.343 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.335+0000 7f899aecc740 4 client.17034 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:21:38.343 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.335+0000 7f899aecc740 1 -- 172.21.15.148:0/1549519884 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564d87510d70 con 0x564d8762aeb0 2024-09-19T07:21:38.343 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.336+0000 7f8995ecd640 1 --2- 172.21.15.148:0/1549519884 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x564d8762aeb0 0x564d8762d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:38.343 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.336+0000 7f8995ecd640 1 --2- 172.21.15.148:0/1549519884 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x564d8762aeb0 0x564d8762d2d0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48a102e1e305cc6d server_cookie=91c71c2786f8bafe in_seq=0 out_seq=0 2024-09-19T07:21:38.343 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.336+0000 7f89797fa640 10 client.17034 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:21:38.350 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.349+0000 7f89797fa640 1 -- 172.21.15.148:0/1549519884 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564d87510d70 con 0x564d8762aeb0 2024-09-19T07:21:38.350 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.349+0000 7f89797fa640 10 client.17034 handle_command_reply: tid=0 2024-09-19T07:21:38.350 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.349+0000 7f899aecc740 1 client.17034 shutdown 2024-09-19T07:21:38.350 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.349+0000 7f899aecc740 1 -- 172.21.15.148:0/1549519884 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d875a5410 msgr2=0x564d875aa0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:38.350 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.349+0000 7f899aecc740 1 --2- 172.21.15.148:0/1549519884 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d875a5410 0x564d875aa0d0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f8980009230 tx=0x7f8980005a20 comp rx=0 tx=0).stop 2024-09-19T07:21:38.350 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.349+0000 7f899aecc740 1 -- 172.21.15.148:0/1549519884 shutdown_connections 2024-09-19T07:21:38.350 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.349+0000 7f899aecc740 1 --2- 172.21.15.148:0/1549519884 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x564d8762aeb0 0x564d8762d2d0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:38.350 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.349+0000 7f899aecc740 1 --2- 172.21.15.148:0/1549519884 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d875afcb0 0x564d875aa610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:38.350 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.349+0000 7f89797fa640 0 client.17034 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:21:38.350 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.349+0000 7f899aecc740 1 --2- 172.21.15.148:0/1549519884 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564d875a5410 0x564d875aa0d0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:38.351 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.349+0000 7f899aecc740 1 --2- 172.21.15.148:0/1549519884 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564d875a4af0 0x564d875a9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:38.351 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.349+0000 7f899aecc740 1 -- 172.21.15.148:0/1549519884 >> 172.21.15.148:0/1549519884 conn(0x564d875a1060 msgr2=0x564d875aeca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:38.351 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.349+0000 7f899aecc740 1 -- 172.21.15.148:0/1549519884 shutdown_connections 2024-09-19T07:21:38.351 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.349+0000 7f899aecc740 1 -- 172.21.15.148:0/1549519884 wait complete. 2024-09-19T07:21:38.351 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.349+0000 7f899aecc740 20 client.17034 trim_cache size 0 max 16384 2024-09-19T07:21:38.351 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:21:38.351 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:21:38.351 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:21:38.351 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:21:38.352 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.350+0000 7f8998131640 1 -- 172.21.15.148:0/1415269271 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f897c0a3460 msgr2=0x7f897c0a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:38.352 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.350+0000 7f8998131640 1 --2- 172.21.15.148:0/1415269271 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f897c0a3460 0x7f897c0a5920 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8988009270 tx=0x7f8988004ab0 comp rx=0 tx=0).stop 2024-09-19T07:21:38.352 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.350+0000 7f8998131640 1 -- 172.21.15.148:0/1415269271 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8990101ad0 msgr2=0x7f8990198370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:38.353 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.350+0000 7f8998131640 1 --2- 172.21.15.148:0/1415269271 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8990101ad0 0x7f8990198370 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f898c00d770 tx=0x7f898c00dc30 comp rx=0 tx=0).stop 2024-09-19T07:21:38.353 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.350+0000 7f8998131640 1 -- 172.21.15.148:0/1415269271 shutdown_connections 2024-09-19T07:21:38.353 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.350+0000 7f8998131640 1 --2- 172.21.15.148:0/1415269271 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f897c0a3460 0x7f897c0a5920 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:38.353 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.350+0000 7f8998131640 1 --2- 172.21.15.148:0/1415269271 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8990107b70 0x7f899019cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:38.353 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.350+0000 7f8998131640 1 --2- 172.21.15.148:0/1415269271 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8990102470 0x7f89901988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:38.353 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.350+0000 7f8998131640 1 --2- 172.21.15.148:0/1415269271 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8990101ad0 0x7f8990198370 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:38.353 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.350+0000 7f8998131640 1 -- 172.21.15.148:0/1415269271 >> 172.21.15.148:0/1415269271 conn(0x7f89900fd7d0 msgr2=0x7f89900fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:38.353 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.350+0000 7f8998131640 1 -- 172.21.15.148:0/1415269271 shutdown_connections 2024-09-19T07:21:38.353 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:38.350+0000 7f8998131640 1 -- 172.21.15.148:0/1415269271 wait complete. 2024-09-19T07:21:39.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:39 smithi179 ceph-mon[35716]: pgmap v329: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 8 op/s 2024-09-19T07:21:39.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:39 smithi148 ceph-mon[31180]: pgmap v329: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 8 op/s 2024-09-19T07:21:39.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:39 smithi165 ceph-mon[35326]: pgmap v329: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 8 op/s 2024-09-19T07:21:39.793 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:21:40.055 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:21:40.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.527+0000 7fc0f2544640 1 -- 172.21.15.148:0/3184772119 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0ec106f10 msgr2=0x7fc0ec10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:40.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.527+0000 7fc0f2544640 1 --2- 172.21.15.148:0/3184772119 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0ec106f10 0x7fc0ec10ea90 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fc0e4009ca0 tx=0x7fc0e402a8c0 comp rx=0 tx=0).stop 2024-09-19T07:21:40.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.528+0000 7fc0f2544640 1 -- 172.21.15.148:0/3184772119 shutdown_connections 2024-09-19T07:21:40.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.528+0000 7fc0f2544640 1 --2- 172.21.15.148:0/3184772119 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0ec106f10 0x7fc0ec10ea90 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:40.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.528+0000 7fc0f2544640 1 --2- 172.21.15.148:0/3184772119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0ec102790 0x7fc0ec1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:40.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.528+0000 7fc0f2544640 1 --2- 172.21.15.148:0/3184772119 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc0ec101de0 0x7fc0ec1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:40.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.528+0000 7fc0f2544640 1 -- 172.21.15.148:0/3184772119 >> 172.21.15.148:0/3184772119 conn(0x7fc0ec0fd8c0 msgr2=0x7fc0ec0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:40.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.528+0000 7fc0f2544640 1 -- 172.21.15.148:0/3184772119 shutdown_connections 2024-09-19T07:21:40.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.528+0000 7fc0f2544640 1 -- 172.21.15.148:0/3184772119 wait complete. 2024-09-19T07:21:40.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.528+0000 7fc0f2544640 1 Processor -- start 2024-09-19T07:21:40.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.528+0000 7fc0f2544640 1 -- start start 2024-09-19T07:21:40.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.529+0000 7fc0f2544640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc0ec101de0 0x7fc0ec198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:40.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.529+0000 7fc0f2544640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0ec102790 0x7fc0ec1988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:40.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.529+0000 7fc0f2544640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0ec106f10 0x7fc0ec19cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:40.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.529+0000 7fc0f2544640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc0ec111f90 con 0x7fc0ec106f10 2024-09-19T07:21:40.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.529+0000 7fc0f2544640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc0ec111e10 con 0x7fc0ec101de0 2024-09-19T07:21:40.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.529+0000 7fc0f2544640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc0ec112110 con 0x7fc0ec102790 2024-09-19T07:21:40.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.529+0000 7fc0f0ae1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0ec106f10 0x7fc0ec19cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:40.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.529+0000 7fc0ebfff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc0ec101de0 0x7fc0ec198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:40.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.529+0000 7fc0f0ae1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0ec106f10 0x7fc0ec19cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47912/0 (socket says 172.21.15.148:47912) 2024-09-19T07:21:40.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.529+0000 7fc0f0ae1640 1 -- 172.21.15.148:0/1253149181 learned_addr learned my addr 172.21.15.148:0/1253149181 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:21:40.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.529+0000 7fc0eb7fe640 1 --2- 172.21.15.148:0/1253149181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0ec102790 0x7fc0ec1988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:40.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.529+0000 7fc0f0ae1640 1 -- 172.21.15.148:0/1253149181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0ec102790 msgr2=0x7fc0ec1988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:40.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.529+0000 7fc0f0ae1640 1 --2- 172.21.15.148:0/1253149181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0ec102790 0x7fc0ec1988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:40.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.529+0000 7fc0f0ae1640 1 -- 172.21.15.148:0/1253149181 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc0ec101de0 msgr2=0x7fc0ec198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:40.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.529+0000 7fc0f0ae1640 1 --2- 172.21.15.148:0/1253149181 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc0ec101de0 0x7fc0ec198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:40.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.529+0000 7fc0f0ae1640 1 -- 172.21.15.148:0/1253149181 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0ec19d340 con 0x7fc0ec106f10 2024-09-19T07:21:40.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.529+0000 7fc0f0ae1640 1 --2- 172.21.15.148:0/1253149181 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0ec106f10 0x7fc0ec19cc60 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fc0e4031a60 tx=0x7fc0e4031a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:40.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.530+0000 7fc0e97fa640 1 -- 172.21.15.148:0/1253149181 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0e4003b70 con 0x7fc0ec106f10 2024-09-19T07:21:40.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.530+0000 7fc0e97fa640 1 -- 172.21.15.148:0/1253149181 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0e4003d10 con 0x7fc0ec106f10 2024-09-19T07:21:40.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.530+0000 7fc0e97fa640 1 -- 172.21.15.148:0/1253149181 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0e4004770 con 0x7fc0ec106f10 2024-09-19T07:21:40.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.530+0000 7fc0f2544640 1 -- 172.21.15.148:0/1253149181 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0ec19d5d0 con 0x7fc0ec106f10 2024-09-19T07:21:40.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.530+0000 7fc0f2544640 1 -- 172.21.15.148:0/1253149181 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0ec1a4f10 con 0x7fc0ec106f10 2024-09-19T07:21:40.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.531+0000 7fc0f2544640 1 -- 172.21.15.148:0/1253149181 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0ec1021c0 con 0x7fc0ec106f10 2024-09-19T07:21:40.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.532+0000 7fc0e97fa640 1 -- 172.21.15.148:0/1253149181 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fc0e402f790 con 0x7fc0ec106f10 2024-09-19T07:21:40.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.533+0000 7fc0e97fa640 1 --2- 172.21.15.148:0/1253149181 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc0d40a3430 0x7fc0d40a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:40.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.533+0000 7fc0ebfff640 1 --2- 172.21.15.148:0/1253149181 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc0d40a3430 0x7fc0d40a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:40.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.533+0000 7fc0e97fa640 1 -- 172.21.15.148:0/1253149181 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8556+0+0 (secure 0 0 0) 0x7fc0e40f0e20 con 0x7fc0ec106f10 2024-09-19T07:21:40.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.533+0000 7fc0ebfff640 1 --2- 172.21.15.148:0/1253149181 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc0d40a3430 0x7fc0d40a58f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc009990 tx=0x7fc0dc009110 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:40.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.537+0000 7fc0e97fa640 1 -- 172.21.15.148:0/1253149181 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc0e40bd8f0 con 0x7fc0ec106f10 2024-09-19T07:21:40.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.738+0000 7fc0f2544640 1 -- 172.21.15.148:0/1253149181 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc0ec10a120 con 0x7fc0ec106f10 2024-09-19T07:21:40.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.738+0000 7fc0e97fa640 1 -- 172.21.15.148:0/1253149181 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+11944 (secure 0 0 0) 0x7fc0e40bd1f0 con 0x7fc0ec106f10 2024-09-19T07:21:40.739 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:21:40.739 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":43,"btime":"2024-09-19T07:20:20:209191+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/4263868576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":4263868576},{"type":"v1","addr":"172.21.15.148:6841","nonce":4263868576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":25606,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3891676893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3891676893},{"type":"v1","addr":"172.21.15.179:6835","nonce":3891676893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":43,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:09:19.543369+0000","modified":"2024-09-19T07:20:19.813692+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24457,"mds_1":24437,"mds_2":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":75,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":71,"addr":"172.21.15.165:6839/3993490234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":3993490234},{"type":"v1","addr":"172.21.15.165:6839","nonce":3993490234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25823":{"gid":25823,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6835/380886107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":380886107},{"type":"v1","addr":"172.21.15.165:6835","nonce":380886107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24457,"qdb_cluster":[24457,24437,24436]},"id":1}]} 2024-09-19T07:21:40.740 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 43 2024-09-19T07:21:40.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.740+0000 7fc0f2544640 1 -- 172.21.15.148:0/1253149181 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc0d40a3430 msgr2=0x7fc0d40a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:40.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.740+0000 7fc0f2544640 1 --2- 172.21.15.148:0/1253149181 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc0d40a3430 0x7fc0d40a58f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc009990 tx=0x7fc0dc009110 comp rx=0 tx=0).stop 2024-09-19T07:21:40.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.740+0000 7fc0f2544640 1 -- 172.21.15.148:0/1253149181 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0ec106f10 msgr2=0x7fc0ec19cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:40.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.740+0000 7fc0f2544640 1 --2- 172.21.15.148:0/1253149181 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0ec106f10 0x7fc0ec19cc60 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fc0e4031a60 tx=0x7fc0e4031a90 comp rx=0 tx=0).stop 2024-09-19T07:21:40.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.741+0000 7fc0f2544640 1 -- 172.21.15.148:0/1253149181 shutdown_connections 2024-09-19T07:21:40.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.741+0000 7fc0f2544640 1 --2- 172.21.15.148:0/1253149181 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc0d40a3430 0x7fc0d40a58f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:40.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.741+0000 7fc0f2544640 1 --2- 172.21.15.148:0/1253149181 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0ec106f10 0x7fc0ec19cc60 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:40.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.741+0000 7fc0f2544640 1 --2- 172.21.15.148:0/1253149181 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0ec102790 0x7fc0ec1988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:40.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.741+0000 7fc0f2544640 1 --2- 172.21.15.148:0/1253149181 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc0ec101de0 0x7fc0ec198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:40.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.741+0000 7fc0f2544640 1 -- 172.21.15.148:0/1253149181 >> 172.21.15.148:0/1253149181 conn(0x7fc0ec0fd8c0 msgr2=0x7fc0ec0fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:40.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.741+0000 7fc0f2544640 1 -- 172.21.15.148:0/1253149181 shutdown_connections 2024-09-19T07:21:40.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:40.741+0000 7fc0f2544640 1 -- 172.21.15.148:0/1253149181 wait complete. 2024-09-19T07:21:41.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:41 smithi148 ceph-mon[31180]: pgmap v330: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 KiB/s wr, 9 op/s 2024-09-19T07:21:41.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:41 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/1253149181' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:21:41.458 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24457 quiesce db --set-id 3dcc7167 --release --await' 2024-09-19T07:21:41.458 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24457 quiesce db --set-id 3dcc7167 --release --await 2024-09-19T07:21:41.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:41 smithi179 ceph-mon[35716]: pgmap v330: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 KiB/s wr, 9 op/s 2024-09-19T07:21:41.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:41 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/1253149181' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:21:41.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:41 smithi165 ceph-mon[35326]: pgmap v330: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 KiB/s wr, 9 op/s 2024-09-19T07:21:41.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:41 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/1253149181' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:21:41.719 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:21:42.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.194+0000 7f257149a640 1 -- 172.21.15.148:0/4135768018 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f256c101410 msgr2=0x7f256c10d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:42.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.194+0000 7f257149a640 1 --2- 172.21.15.148:0/4135768018 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f256c101410 0x7f256c10d940 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f2564009cd0 tx=0x7f256402a8e0 comp rx=0 tx=0).stop 2024-09-19T07:21:42.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.194+0000 7f257149a640 1 -- 172.21.15.148:0/4135768018 shutdown_connections 2024-09-19T07:21:42.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.194+0000 7f257149a640 1 --2- 172.21.15.148:0/4135768018 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f256c101410 0x7f256c10d940 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:42.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.194+0000 7f257149a640 1 --2- 172.21.15.148:0/4135768018 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f256c100a70 0x7f256c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:42.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.194+0000 7f257149a640 1 --2- 172.21.15.148:0/4135768018 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f256c106a70 0x7f256c106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:42.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.194+0000 7f257149a640 1 -- 172.21.15.148:0/4135768018 >> 172.21.15.148:0/4135768018 conn(0x7f256c0fc790 msgr2=0x7f256c0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:42.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.194+0000 7f257149a640 1 -- 172.21.15.148:0/4135768018 shutdown_connections 2024-09-19T07:21:42.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.194+0000 7f257149a640 1 -- 172.21.15.148:0/4135768018 wait complete. 2024-09-19T07:21:42.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.194+0000 7f257149a640 1 Processor -- start 2024-09-19T07:21:42.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.195+0000 7f257149a640 1 -- start start 2024-09-19T07:21:42.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.195+0000 7f257149a640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f256c100a70 0x7f256c199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:42.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.195+0000 7f257149a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f256c101410 0x7f256c1997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:42.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.195+0000 7f257149a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f256c106a70 0x7f256c1a4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:42.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.195+0000 7f257149a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f256c110e90 con 0x7f256c106a70 2024-09-19T07:21:42.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.195+0000 7f257149a640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f256c110d10 con 0x7f256c100a70 2024-09-19T07:21:42.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.195+0000 7f257149a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f256c111010 con 0x7f256c101410 2024-09-19T07:21:42.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.195+0000 7f256b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f256c106a70 0x7f256c1a4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:42.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.195+0000 7f256b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f256c106a70 0x7f256c1a4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47934/0 (socket says 172.21.15.148:47934) 2024-09-19T07:21:42.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.195+0000 7f256b7fe640 1 -- 172.21.15.148:0/3597290285 learned_addr learned my addr 172.21.15.148:0/3597290285 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:21:42.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.195+0000 7f25627fc640 1 --2- 172.21.15.148:0/3597290285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f256c101410 0x7f256c1997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:42.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.195+0000 7f256b7fe640 1 -- 172.21.15.148:0/3597290285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f256c101410 msgr2=0x7f256c1997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:42.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.195+0000 7f256b7fe640 1 --2- 172.21.15.148:0/3597290285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f256c101410 0x7f256c1997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:42.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.195+0000 7f256affd640 1 --2- 172.21.15.148:0/3597290285 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f256c100a70 0x7f256c199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:42.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.195+0000 7f256b7fe640 1 -- 172.21.15.148:0/3597290285 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f256c100a70 msgr2=0x7f256c199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:42.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.195+0000 7f256b7fe640 1 --2- 172.21.15.148:0/3597290285 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f256c100a70 0x7f256c199290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:42.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.195+0000 7f256b7fe640 1 -- 172.21.15.148:0/3597290285 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f256c1a4850 con 0x7f256c106a70 2024-09-19T07:21:42.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.195+0000 7f256b7fe640 1 --2- 172.21.15.148:0/3597290285 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f256c106a70 0x7f256c1a4310 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f2564006010 tx=0x7f2564003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:42.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.196+0000 7f2568ff9640 1 -- 172.21.15.148:0/3597290285 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2564004450 con 0x7f256c106a70 2024-09-19T07:21:42.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.196+0000 7f2568ff9640 1 -- 172.21.15.148:0/3597290285 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2564003e10 con 0x7f256c106a70 2024-09-19T07:21:42.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.196+0000 7f257149a640 1 -- 172.21.15.148:0/3597290285 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f256c1a4a20 con 0x7f256c106a70 2024-09-19T07:21:42.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.196+0000 7f2568ff9640 1 -- 172.21.15.148:0/3597290285 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25640466e0 con 0x7f256c106a70 2024-09-19T07:21:42.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.196+0000 7f257149a640 1 -- 172.21.15.148:0/3597290285 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f256c1a4ed0 con 0x7f256c106a70 2024-09-19T07:21:42.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.198+0000 7f2568ff9640 1 -- 172.21.15.148:0/3597290285 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f25640305a0 con 0x7f256c106a70 2024-09-19T07:21:42.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.198+0000 7f2573873740 1 Processor -- start 2024-09-19T07:21:42.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.198+0000 7f2573873740 1 -- start start 2024-09-19T07:21:42.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.198+0000 7f2573873740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56340b4f2470 0x56340b4f2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:42.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.198+0000 7f2573873740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56340b4f2d90 0x56340b4fd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:42.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.199+0000 7f2573873740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56340b4fd650 0x56340b4ffa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:42.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.199+0000 7f2573873740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56340b453620 con 0x56340b4f2d90 2024-09-19T07:21:42.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.199+0000 7f2573873740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56340b3fae50 con 0x56340b4fd650 2024-09-19T07:21:42.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.199+0000 7f2573873740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56340b44f5e0 con 0x56340b4f2470 2024-09-19T07:21:42.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.199+0000 7f256affd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56340b4f2d90 0x56340b4fd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:42.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.199+0000 7f256affd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56340b4f2d90 0x56340b4fd110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47940/0 (socket says 172.21.15.148:47940) 2024-09-19T07:21:42.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.199+0000 7f256affd640 1 -- 172.21.15.148:0/2459513036 learned_addr learned my addr 172.21.15.148:0/2459513036 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:21:42.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.199+0000 7f25627fc640 1 --2- 172.21.15.148:0/2459513036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56340b4f2470 0x56340b4f2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:42.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.199+0000 7f25627fc640 1 --2- 172.21.15.148:0/2459513036 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56340b4fd650 0x56340b4ffa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:42.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.199+0000 7f256affd640 1 -- 172.21.15.148:0/2459513036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56340b4f2470 msgr2=0x56340b4f2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:42.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.199+0000 7f256affd640 1 --2- 172.21.15.148:0/2459513036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56340b4f2470 0x56340b4f2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:42.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.199+0000 7f256affd640 1 -- 172.21.15.148:0/2459513036 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56340b4fd650 msgr2=0x56340b4ffa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:42.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.199+0000 7f256affd640 1 --2- 172.21.15.148:0/2459513036 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56340b4fd650 0x56340b4ffa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:42.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.199+0000 7f256affd640 1 -- 172.21.15.148:0/2459513036 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56340b3ebd40 con 0x56340b4f2d90 2024-09-19T07:21:42.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.199+0000 7f2568ff9640 1 --2- 172.21.15.148:0/3597290285 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f25580a33b0 0x7f25580a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:42.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.199+0000 7f25627fc640 1 --2- 172.21.15.148:0/2459513036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56340b4f2470 0x56340b4f2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:21:42.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.199+0000 7f256affd640 1 --2- 172.21.15.148:0/2459513036 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56340b4f2d90 0x56340b4fd110 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f255c00a920 tx=0x7f255c00ade0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4578cedb66c72a29 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:42.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.199+0000 7f25627fc640 1 --2- 172.21.15.148:0/3597290285 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f25580a33b0 0x7f25580a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:42.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.199+0000 7f2568ff9640 1 -- 172.21.15.148:0/3597290285 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8556+0+0 (secure 0 0 0) 0x7f256402e030 con 0x7f256c106a70 2024-09-19T07:21:42.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.199+0000 7f25617fa640 1 -- 172.21.15.148:0/2459513036 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c015070 con 0x56340b4f2d90 2024-09-19T07:21:42.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.199+0000 7f25617fa640 1 -- 172.21.15.148:0/2459513036 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f255c00cc00 con 0x56340b4f2d90 2024-09-19T07:21:42.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.199+0000 7f25617fa640 1 -- 172.21.15.148:0/2459513036 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c0185c0 con 0x56340b4f2d90 2024-09-19T07:21:42.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.200+0000 7f2573873740 1 -- 172.21.15.148:0/2459513036 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56340b4f2d90 msgr2=0x56340b4fd110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:42.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.200+0000 7f25627fc640 1 --2- 172.21.15.148:0/3597290285 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f25580a33b0 0x7f25580a5870 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x56340b4efd80 tx=0x7f25540046c0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:42.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.200+0000 7f2573873740 1 --2- 172.21.15.148:0/2459513036 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56340b4f2d90 0x56340b4fd110 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f255c00a920 tx=0x7f255c00ade0 comp rx=0 tx=0).stop 2024-09-19T07:21:42.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.200+0000 7f2573873740 1 -- 172.21.15.148:0/2459513036 shutdown_connections 2024-09-19T07:21:42.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.200+0000 7f2573873740 1 --2- 172.21.15.148:0/2459513036 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56340b4fd650 0x56340b4ffa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:42.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.200+0000 7f2573873740 1 --2- 172.21.15.148:0/2459513036 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56340b4f2d90 0x56340b4fd110 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:42.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.200+0000 7f2573873740 1 --2- 172.21.15.148:0/2459513036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56340b4f2470 0x56340b4f2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:42.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.200+0000 7f2573873740 1 -- 172.21.15.148:0/2459513036 >> 172.21.15.148:0/2459513036 conn(0x56340b4eea00 msgr2=0x56340b4eede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:42.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.200+0000 7f2573873740 1 -- 172.21.15.148:0/2459513036 shutdown_connections 2024-09-19T07:21:42.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.200+0000 7f2573873740 1 -- 172.21.15.148:0/2459513036 wait complete. 2024-09-19T07:21:42.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.201+0000 7f2573873740 1 -- start start 2024-09-19T07:21:42.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.201+0000 7f2573873740 1 Processor -- start 2024-09-19T07:21:42.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.201+0000 7f2573873740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56340b4f2470 0x56340b4fa4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:42.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.201+0000 7f2573873740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56340b4f2d90 0x56340b4faa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:42.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.201+0000 7f2573873740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56340b4fd650 0x56340b4faf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:42.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.201+0000 7f2573873740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56340b500220 con 0x56340b4f2d90 2024-09-19T07:21:42.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.201+0000 7f2573873740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56340b3dbf10 con 0x56340b4fd650 2024-09-19T07:21:42.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.201+0000 7f2573873740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56340b5003a0 con 0x56340b4f2470 2024-09-19T07:21:42.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.201+0000 7f2573873740 10 client.0 _ll_register_callbacks cb 0x56340b3ffdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:21:42.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.201+0000 7f25627fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56340b4f2d90 0x56340b4faa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:42.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.201+0000 7f25627fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56340b4f2d90 0x56340b4faa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47942/0 (socket says 172.21.15.148:47942) 2024-09-19T07:21:42.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.201+0000 7f25627fc640 1 -- 172.21.15.148:0/1802955213 learned_addr learned my addr 172.21.15.148:0/1802955213 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:21:42.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.201+0000 7f256affd640 1 --2- 172.21.15.148:0/1802955213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56340b4f2470 0x56340b4fa4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:42.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.201+0000 7f25627fc640 1 -- 172.21.15.148:0/1802955213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56340b4f2470 msgr2=0x56340b4fa4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:42.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.201+0000 7f25627fc640 1 --2- 172.21.15.148:0/1802955213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56340b4f2470 0x56340b4fa4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:42.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.201+0000 7f25627fc640 1 -- 172.21.15.148:0/1802955213 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56340b4fd650 msgr2=0x56340b4faf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:42.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.201+0000 7f25627fc640 1 --2- 172.21.15.148:0/1802955213 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56340b4fd650 0x56340b4faf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:42.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.201+0000 7f25627fc640 1 -- 172.21.15.148:0/1802955213 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56340b162580 con 0x56340b4f2d90 2024-09-19T07:21:42.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.202+0000 7f25627fc640 1 --2- 172.21.15.148:0/1802955213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56340b4f2d90 0x56340b4faa20 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f2554010e00 tx=0x7f2554004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec1b0cee17734b1e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:42.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.202+0000 7f25527fc640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:21:42.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.202+0000 7f25527fc640 1 -- 172.21.15.148:0/1802955213 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255400ebf0 con 0x56340b4f2d90 2024-09-19T07:21:42.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.202+0000 7f25527fc640 1 -- 172.21.15.148:0/1802955213 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8556+0+0 (secure 0 0 0) 0x7f255401e3f0 con 0x56340b4f2d90 2024-09-19T07:21:42.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.202+0000 7f2573873740 1 -- 172.21.15.148:0/1802955213 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f255c00cc00 con 0x56340b4f2d90 2024-09-19T07:21:42.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.202+0000 7f25527fc640 1 -- 172.21.15.148:0/1802955213 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f2554026600 con 0x56340b4f2d90 2024-09-19T07:21:42.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.202+0000 7f2573873740 10 client.17052 fetch_fsmap learned FSMap version 43 2024-09-19T07:21:42.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.202+0000 7f2573873740 1 -- 172.21.15.148:0/1802955213 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x56340b22c960 con 0x56340b4f2d90 2024-09-19T07:21:42.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.202+0000 7f25527fc640 1 -- 172.21.15.148:0/1802955213 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f255c00cc00 con 0x56340b4f2d90 2024-09-19T07:21:42.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.202+0000 7f25527fc640 1 -- 172.21.15.148:0/1802955213 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 43) ==== 8362+0+0 (secure 0 0 0) 0x7f255401eca0 con 0x56340b4f2d90 2024-09-19T07:21:42.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.202+0000 7f2573873740 10 client.17052 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T07:21:42.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.202+0000 7f2573873740 10 client.17052 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:21:42.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.202+0000 7f2573873740 20 client.17052 populate_metadata read hostname 'smithi148' 2024-09-19T07:21:42.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.202+0000 7f2573873740 1 --2- 172.21.15.148:0/1802955213 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56340b50d2e0 0x56340b50f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:42.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.202+0000 7f2573873740 4 client.17052 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:21:42.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.202+0000 7f2573873740 1 -- 172.21.15.148:0/1802955213 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56340b460b90 con 0x56340b50d2e0 2024-09-19T07:21:42.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.203+0000 7f256affd640 1 --2- 172.21.15.148:0/1802955213 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56340b50d2e0 0x56340b50f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:42.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.203+0000 7f25527fc640 10 client.17052 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:21:42.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.203+0000 7f256affd640 1 --2- 172.21.15.148:0/1802955213 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56340b50d2e0 0x56340b50f780 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2dd21027bd016d0 server_cookie=c9974912b022f61e in_seq=0 out_seq=0 2024-09-19T07:21:42.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.204+0000 7f25527fc640 1 -- 172.21.15.148:0/1802955213 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56340b460b90 con 0x56340b50d2e0 2024-09-19T07:21:42.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.204+0000 7f25527fc640 10 client.17052 handle_command_reply: tid=0 2024-09-19T07:21:42.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.204+0000 7f2573873740 1 client.17052 shutdown 2024-09-19T07:21:42.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.204+0000 7f2573873740 1 -- 172.21.15.148:0/1802955213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56340b4f2d90 msgr2=0x56340b4faa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:42.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.204+0000 7f2573873740 1 --2- 172.21.15.148:0/1802955213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56340b4f2d90 0x56340b4faa20 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f2554010e00 tx=0x7f2554004730 comp rx=0 tx=0).stop 2024-09-19T07:21:42.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.204+0000 7f2573873740 1 -- 172.21.15.148:0/1802955213 shutdown_connections 2024-09-19T07:21:42.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.204+0000 7f2573873740 1 --2- 172.21.15.148:0/1802955213 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56340b50d2e0 0x56340b50f780 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:42.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.204+0000 7f2573873740 1 --2- 172.21.15.148:0/1802955213 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56340b4fd650 0x56340b4faf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:42.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.204+0000 7f2573873740 1 --2- 172.21.15.148:0/1802955213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56340b4f2d90 0x56340b4faa20 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:42.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.204+0000 7f25527fc640 0 client.17052 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:21:42.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.204+0000 7f2573873740 1 --2- 172.21.15.148:0/1802955213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56340b4f2470 0x56340b4fa4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:42.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.204+0000 7f2573873740 1 -- 172.21.15.148:0/1802955213 >> 172.21.15.148:0/1802955213 conn(0x56340b4eea00 msgr2=0x56340b4e9750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:42.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.204+0000 7f2573873740 1 -- 172.21.15.148:0/1802955213 shutdown_connections 2024-09-19T07:21:42.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.204+0000 7f2573873740 1 -- 172.21.15.148:0/1802955213 wait complete. 2024-09-19T07:21:42.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.204+0000 7f2573873740 20 client.17052 trim_cache size 0 max 16384 2024-09-19T07:21:42.234 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.221+0000 7f2573873740 1 Processor -- start 2024-09-19T07:21:42.234 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.221+0000 7f2573873740 1 -- start start 2024-09-19T07:21:42.234 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.221+0000 7f2573873740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56340b4f2470 0x56340b4fc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:42.234 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.221+0000 7f2573873740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56340b4f2d90 0x56340b515090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:42.234 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.221+0000 7f2573873740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56340b4fd650 0x56340b5155d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:42.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.222+0000 7f2573873740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f256c1adf80 con 0x56340b4f2d90 2024-09-19T07:21:42.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.222+0000 7f2573873740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f256c1ab7f0 con 0x56340b4f2470 2024-09-19T07:21:42.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.222+0000 7f2573873740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f256c1a9660 con 0x56340b4fd650 2024-09-19T07:21:42.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.222+0000 7f25627fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56340b4f2d90 0x56340b515090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:42.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.222+0000 7f25627fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56340b4f2d90 0x56340b515090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47944/0 (socket says 172.21.15.148:47944) 2024-09-19T07:21:42.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.222+0000 7f25627fc640 1 -- 172.21.15.148:0/2289274572 learned_addr learned my addr 172.21.15.148:0/2289274572 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:21:42.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.222+0000 7f25627fc640 1 -- 172.21.15.148:0/2289274572 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56340b4fd650 msgr2=0x56340b5155d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:42.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.222+0000 7f256affd640 1 --2- 172.21.15.148:0/2289274572 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56340b4f2470 0x56340b4fc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:42.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.222+0000 7f256b7fe640 1 --2- 172.21.15.148:0/2289274572 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56340b4fd650 0x56340b5155d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:42.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.222+0000 7f25627fc640 1 --2- 172.21.15.148:0/2289274572 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56340b4fd650 0x56340b5155d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:42.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.222+0000 7f25627fc640 1 -- 172.21.15.148:0/2289274572 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56340b4f2470 msgr2=0x56340b4fc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:42.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.222+0000 7f25627fc640 1 --2- 172.21.15.148:0/2289274572 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56340b4f2470 0x56340b4fc450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:42.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.222+0000 7f25627fc640 1 -- 172.21.15.148:0/2289274572 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56340b4ee830 con 0x56340b4f2d90 2024-09-19T07:21:42.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.222+0000 7f256b7fe640 1 --2- 172.21.15.148:0/2289274572 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56340b4fd650 0x56340b5155d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:21:42.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.222+0000 7f256affd640 1 --2- 172.21.15.148:0/2289274572 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56340b4f2470 0x56340b4fc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:21:42.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.222+0000 7f25627fc640 1 --2- 172.21.15.148:0/2289274572 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56340b4f2d90 0x56340b515090 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f2554012fd0 tx=0x7f255400fc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a19108e06b79e3aa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:42.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.222+0000 7f2560ff9640 1 -- 172.21.15.148:0/2289274572 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2554032070 con 0x56340b4f2d90 2024-09-19T07:21:42.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.222+0000 7f2560ff9640 1 -- 172.21.15.148:0/2289274572 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2554033040 con 0x56340b4f2d90 2024-09-19T07:21:42.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.222+0000 7f2560ff9640 1 -- 172.21.15.148:0/2289274572 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255401caf0 con 0x56340b4f2d90 2024-09-19T07:21:42.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.223+0000 7f2573873740 1 -- 172.21.15.148:0/2289274572 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56340b4f2d90 msgr2=0x56340b515090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:42.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.223+0000 7f2573873740 1 --2- 172.21.15.148:0/2289274572 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56340b4f2d90 0x56340b515090 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f2554012fd0 tx=0x7f255400fc20 comp rx=0 tx=0).stop 2024-09-19T07:21:42.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.223+0000 7f2573873740 1 -- 172.21.15.148:0/2289274572 shutdown_connections 2024-09-19T07:21:42.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.223+0000 7f2573873740 1 --2- 172.21.15.148:0/2289274572 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56340b4fd650 0x56340b5155d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:42.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.223+0000 7f2573873740 1 --2- 172.21.15.148:0/2289274572 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56340b4f2d90 0x56340b515090 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:42.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.223+0000 7f2573873740 1 --2- 172.21.15.148:0/2289274572 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56340b4f2470 0x56340b4fc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:42.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.223+0000 7f2573873740 1 -- 172.21.15.148:0/2289274572 >> 172.21.15.148:0/2289274572 conn(0x56340b4eea00 msgr2=0x56340b4fbd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:42.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.223+0000 7f2573873740 1 -- 172.21.15.148:0/2289274572 shutdown_connections 2024-09-19T07:21:42.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.223+0000 7f2573873740 1 -- 172.21.15.148:0/2289274572 wait complete. 2024-09-19T07:21:42.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.224+0000 7f2573873740 1 -- start start 2024-09-19T07:21:42.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.224+0000 7f2573873740 1 Processor -- start 2024-09-19T07:21:42.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.224+0000 7f2573873740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56340b4f2470 0x56340b505840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:42.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.224+0000 7f2573873740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56340b4f2d90 0x56340b505d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:42.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.224+0000 7f2573873740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56340b4fd650 0x56340b500610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:42.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.224+0000 7f2573873740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f256c1a9cb0 con 0x56340b4fd650 2024-09-19T07:21:42.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.224+0000 7f2573873740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f256c1ab120 con 0x56340b4f2d90 2024-09-19T07:21:42.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.224+0000 7f2573873740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f256c1aa380 con 0x56340b4f2470 2024-09-19T07:21:42.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.224+0000 7f2573873740 10 client.0 _ll_register_callbacks cb 0x7f2554010ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:21:42.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.224+0000 7f256b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56340b4fd650 0x56340b500610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:42.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.224+0000 7f256b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56340b4fd650 0x56340b500610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47958/0 (socket says 172.21.15.148:47958) 2024-09-19T07:21:42.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.224+0000 7f256b7fe640 1 -- 172.21.15.148:0/504394433 learned_addr learned my addr 172.21.15.148:0/504394433 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:21:42.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.224+0000 7f25627fc640 1 --2- 172.21.15.148:0/504394433 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56340b4f2d90 0x56340b505d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:42.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.224+0000 7f256affd640 1 --2- 172.21.15.148:0/504394433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56340b4f2470 0x56340b505840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:42.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.224+0000 7f256b7fe640 1 -- 172.21.15.148:0/504394433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56340b4f2470 msgr2=0x56340b505840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:42.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.224+0000 7f256b7fe640 1 --2- 172.21.15.148:0/504394433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56340b4f2470 0x56340b505840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:42.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.224+0000 7f256b7fe640 1 -- 172.21.15.148:0/504394433 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56340b4f2d90 msgr2=0x56340b505d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:42.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.224+0000 7f256b7fe640 1 --2- 172.21.15.148:0/504394433 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56340b4f2d90 0x56340b505d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:42.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.224+0000 7f256b7fe640 1 -- 172.21.15.148:0/504394433 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56340b500e10 con 0x56340b4fd650 2024-09-19T07:21:42.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.225+0000 7f256b7fe640 1 --2- 172.21.15.148:0/504394433 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56340b4fd650 0x56340b500610 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f25640bd810 tx=0x7f2564039e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44e8d11e0e5019f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:42.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.225+0000 7f25527fc640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:21:42.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.225+0000 7f25527fc640 1 -- 172.21.15.148:0/504394433 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25640c1c30 con 0x56340b4fd650 2024-09-19T07:21:42.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.225+0000 7f25527fc640 1 -- 172.21.15.148:0/504394433 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8556+0+0 (secure 0 0 0) 0x7f2564030890 con 0x56340b4fd650 2024-09-19T07:21:42.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.225+0000 7f2573873740 1 -- 172.21.15.148:0/504394433 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2554033040 con 0x56340b4fd650 2024-09-19T07:21:42.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.225+0000 7f25527fc640 1 -- 172.21.15.148:0/504394433 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f25640c64f0 con 0x56340b4fd650 2024-09-19T07:21:42.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.225+0000 7f2573873740 10 client.17058 fetch_fsmap learned FSMap version 43 2024-09-19T07:21:42.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.225+0000 7f2573873740 1 -- 172.21.15.148:0/504394433 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x56340b578b10 con 0x56340b4fd650 2024-09-19T07:21:42.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.225+0000 7f25527fc640 1 -- 172.21.15.148:0/504394433 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2554033040 con 0x56340b4fd650 2024-09-19T07:21:42.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.225+0000 7f25527fc640 1 -- 172.21.15.148:0/504394433 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 43) ==== 8362+0+0 (secure 0 0 0) 0x7f2564030070 con 0x56340b4fd650 2024-09-19T07:21:42.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.225+0000 7f2573873740 10 client.17058 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T07:21:42.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.225+0000 7f2573873740 10 client.17058 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:21:42.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.225+0000 7f2573873740 20 client.17058 populate_metadata read hostname 'smithi148' 2024-09-19T07:21:42.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.225+0000 7f2573873740 1 --2- 172.21.15.148:0/504394433 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56340b579240 0x56340b57b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:42.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.225+0000 7f2573873740 4 client.17058 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "3dcc7167", "release": true, "await": true}] 2024-09-19T07:21:42.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.225+0000 7f2573873740 1 -- 172.21.15.148:0/504394433 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "quiesce db", "set_id": "3dcc7167", "release": true, "await": true}) -- 0x56340b45b0a0 con 0x56340b579240 2024-09-19T07:21:42.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.226+0000 7f256affd640 1 --2- 172.21.15.148:0/504394433 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56340b579240 0x56340b57b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:42.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.226+0000 7f25527fc640 10 client.17058 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:21:42.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:42.226+0000 7f256affd640 1 --2- 172.21.15.148:0/504394433 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56340b579240 0x56340b57b660 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7aedf44ccccdcb99 server_cookie=2af9162fe25ba941 in_seq=0 out_seq=0 2024-09-19T07:21:43.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:43 smithi179 ceph-mon[35716]: pgmap v331: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-09-19T07:21:43.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:43.545+0000 7f25527fc640 1 -- 172.21.15.148:0/504394433 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x56340b45b0a0 con 0x56340b579240 2024-09-19T07:21:43.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:43.545+0000 7f25527fc640 10 client.17058 handle_command_reply: tid=0 2024-09-19T07:21:43.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:43.545+0000 7f2573873740 1 client.17058 shutdown 2024-09-19T07:21:43.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:43.545+0000 7f2573873740 1 -- 172.21.15.148:0/504394433 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56340b4fd650 msgr2=0x56340b500610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:43.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:43.545+0000 7f2573873740 1 --2- 172.21.15.148:0/504394433 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56340b4fd650 0x56340b500610 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f25640bd810 tx=0x7f2564039e60 comp rx=0 tx=0).stop 2024-09-19T07:21:43.548 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:43 smithi148 ceph-mon[31180]: pgmap v331: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-09-19T07:21:43.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:43.545+0000 7f2573873740 1 -- 172.21.15.148:0/504394433 shutdown_connections 2024-09-19T07:21:43.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:43.545+0000 7f2573873740 1 --2- 172.21.15.148:0/504394433 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56340b579240 0x56340b57b660 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:43.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:43.545+0000 7f2573873740 1 --2- 172.21.15.148:0/504394433 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56340b4fd650 0x56340b500610 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:43.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:43.546+0000 7f25527fc640 0 client.17058 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:21:43.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:43.546+0000 7f2573873740 1 --2- 172.21.15.148:0/504394433 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56340b4f2d90 0x56340b505d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:43.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:43.546+0000 7f2573873740 1 --2- 172.21.15.148:0/504394433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56340b4f2470 0x56340b505840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:43.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:43.546+0000 7f2573873740 1 -- 172.21.15.148:0/504394433 >> 172.21.15.148:0/504394433 conn(0x56340b4eea00 msgr2=0x56340b4fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:43.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:43.546+0000 7f2573873740 1 -- 172.21.15.148:0/504394433 shutdown_connections 2024-09-19T07:21:43.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:43.546+0000 7f2573873740 1 -- 172.21.15.148:0/504394433 wait complete. 2024-09-19T07:21:43.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:43.546+0000 7f2573873740 20 client.17058 trim_cache size 0 max 16384 2024-09-19T07:21:43.551 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:21:43.551 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 43, 2024-09-19T07:21:43.551 INFO:teuthology.orchestra.run.smithi148.stdout: "leader": 24457, 2024-09-19T07:21:43.551 INFO:teuthology.orchestra.run.smithi148.stdout: "set_version": 36, 2024-09-19T07:21:43.551 INFO:teuthology.orchestra.run.smithi148.stdout: "sets": { 2024-09-19T07:21:43.552 INFO:teuthology.orchestra.run.smithi148.stdout: "3dcc7167": { 2024-09-19T07:21:43.552 INFO:teuthology.orchestra.run.smithi148.stdout: "version": 36, 2024-09-19T07:21:43.552 INFO:teuthology.orchestra.run.smithi148.stdout: "age_ref": 0.0, 2024-09-19T07:21:43.552 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:21:43.552 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RELEASED", 2024-09-19T07:21:43.552 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:21:43.553 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:21:43.553 INFO:teuthology.orchestra.run.smithi148.stdout: "timeout": 90.0, 2024-09-19T07:21:43.553 INFO:teuthology.orchestra.run.smithi148.stdout: "expiration": 150.0, 2024-09-19T07:21:43.553 INFO:teuthology.orchestra.run.smithi148.stdout: "members": { 2024-09-19T07:21:43.553 INFO:teuthology.orchestra.run.smithi148.stdout: "file:/": { 2024-09-19T07:21:43.553 INFO:teuthology.orchestra.run.smithi148.stdout: "excluded": false, 2024-09-19T07:21:43.554 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:21:43.554 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RELEASED", 2024-09-19T07:21:43.554 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:21:43.554 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:21:43.554 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:21:43.555 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:21:43.555 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:21:43.555 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:21:43.555 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:21:43.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:43.547+0000 7f257149a640 1 -- 172.21.15.148:0/3597290285 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f25580a33b0 msgr2=0x7f25580a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:43.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:43.547+0000 7f257149a640 1 --2- 172.21.15.148:0/3597290285 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f25580a33b0 0x7f25580a5870 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x56340b4efd80 tx=0x7f25540046c0 comp rx=0 tx=0).stop 2024-09-19T07:21:43.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:43.547+0000 7f257149a640 1 -- 172.21.15.148:0/3597290285 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f256c106a70 msgr2=0x7f256c1a4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:43.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:43.547+0000 7f257149a640 1 --2- 172.21.15.148:0/3597290285 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f256c106a70 0x7f256c1a4310 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f2564006010 tx=0x7f2564003c20 comp rx=0 tx=0).stop 2024-09-19T07:21:43.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:43.547+0000 7f257149a640 1 -- 172.21.15.148:0/3597290285 shutdown_connections 2024-09-19T07:21:43.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:43.547+0000 7f257149a640 1 --2- 172.21.15.148:0/3597290285 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f25580a33b0 0x7f25580a5870 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:43.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:43.547+0000 7f257149a640 1 --2- 172.21.15.148:0/3597290285 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f256c106a70 0x7f256c1a4310 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:43.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:43.547+0000 7f257149a640 1 --2- 172.21.15.148:0/3597290285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f256c101410 0x7f256c1997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:43.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:43.547+0000 7f257149a640 1 --2- 172.21.15.148:0/3597290285 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f256c100a70 0x7f256c199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:43.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:43.547+0000 7f257149a640 1 -- 172.21.15.148:0/3597290285 >> 172.21.15.148:0/3597290285 conn(0x7f256c0fc790 msgr2=0x7f256c0fceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:43.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:43.547+0000 7f257149a640 1 -- 172.21.15.148:0/3597290285 shutdown_connections 2024-09-19T07:21:43.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:43.547+0000 7f257149a640 1 -- 172.21.15.148:0/3597290285 wait complete. 2024-09-19T07:21:43.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:43 smithi165 ceph-mon[35326]: pgmap v331: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-09-19T07:21:44.215 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '3dcc7167', total seconds elapsed: 34.5 2024-09-19T07:21:44.215 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-09-19T07:21:44.216 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:21:44.468 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:21:44.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:44.923+0000 7fc93ff81640 1 -- 172.21.15.148:0/3428579866 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc938102d40 msgr2=0x7fc938103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:44.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:44.923+0000 7fc93ff81640 1 --2- 172.21.15.148:0/3428579866 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc938102d40 0x7fc938103120 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fc92c009900 tx=0x7fc92c02a480 comp rx=0 tx=0).stop 2024-09-19T07:21:44.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:44.923+0000 7fc93ff81640 1 -- 172.21.15.148:0/3428579866 shutdown_connections 2024-09-19T07:21:44.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:44.923+0000 7fc93ff81640 1 --2- 172.21.15.148:0/3428579866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc93810c170 0x7fc93810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:44.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:44.923+0000 7fc93ff81640 1 --2- 172.21.15.148:0/3428579866 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc938103660 0x7fc93810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:44.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:44.923+0000 7fc93ff81640 1 --2- 172.21.15.148:0/3428579866 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc938102d40 0x7fc938103120 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:44.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:44.923+0000 7fc93ff81640 1 -- 172.21.15.148:0/3428579866 >> 172.21.15.148:0/3428579866 conn(0x7fc9380fc7a0 msgr2=0x7fc9380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:44.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:44.923+0000 7fc93ff81640 1 -- 172.21.15.148:0/3428579866 shutdown_connections 2024-09-19T07:21:44.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:44.924+0000 7fc93ff81640 1 -- 172.21.15.148:0/3428579866 wait complete. 2024-09-19T07:21:44.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:44.924+0000 7fc93ff81640 1 Processor -- start 2024-09-19T07:21:44.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:44.924+0000 7fc93ff81640 1 -- start start 2024-09-19T07:21:44.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:44.924+0000 7fc93ff81640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc938102d40 0x7fc9381983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:44.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:44.924+0000 7fc93ff81640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc938103660 0x7fc938198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:44.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:44.924+0000 7fc93ff81640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc93810c170 0x7fc93819ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:44.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:44.924+0000 7fc93ff81640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc938111f70 con 0x7fc93810c170 2024-09-19T07:21:44.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:44.924+0000 7fc93ff81640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc938111df0 con 0x7fc938103660 2024-09-19T07:21:44.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:44.924+0000 7fc93ff81640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc9381120f0 con 0x7fc938102d40 2024-09-19T07:21:44.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:44.924+0000 7fc93e51e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc93810c170 0x7fc93819ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:44.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:44.924+0000 7fc93e51e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc93810c170 0x7fc93819ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52200/0 (socket says 172.21.15.148:52200) 2024-09-19T07:21:44.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:44.924+0000 7fc93e51e640 1 -- 172.21.15.148:0/2642797945 learned_addr learned my addr 172.21.15.148:0/2642797945 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:21:44.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:44.925+0000 7fc93dd1d640 1 --2- 172.21.15.148:0/2642797945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc938102d40 0x7fc9381983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:44.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:44.925+0000 7fc93d51c640 1 --2- 172.21.15.148:0/2642797945 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc938103660 0x7fc938198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:44.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:44.925+0000 7fc93e51e640 1 -- 172.21.15.148:0/2642797945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc938102d40 msgr2=0x7fc9381983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:44.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:44.925+0000 7fc93e51e640 1 --2- 172.21.15.148:0/2642797945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc938102d40 0x7fc9381983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:44.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:44.925+0000 7fc93e51e640 1 -- 172.21.15.148:0/2642797945 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc938103660 msgr2=0x7fc938198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:44.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:44.925+0000 7fc93e51e640 1 --2- 172.21.15.148:0/2642797945 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc938103660 0x7fc938198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:44.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:44.925+0000 7fc93e51e640 1 -- 172.21.15.148:0/2642797945 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc93819d390 con 0x7fc93810c170 2024-09-19T07:21:44.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:44.925+0000 7fc93dd1d640 1 --2- 172.21.15.148:0/2642797945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc938102d40 0x7fc9381983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:21:44.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:44.925+0000 7fc93e51e640 1 --2- 172.21.15.148:0/2642797945 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc93810c170 0x7fc93819ccb0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fc93000cce0 tx=0x7fc93000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:44.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:44.925+0000 7fc92affd640 1 -- 172.21.15.148:0/2642797945 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc93000f450 con 0x7fc93810c170 2024-09-19T07:21:44.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:44.925+0000 7fc93ff81640 1 -- 172.21.15.148:0/2642797945 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc93819d680 con 0x7fc93810c170 2024-09-19T07:21:44.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:44.925+0000 7fc92affd640 1 -- 172.21.15.148:0/2642797945 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc93000fad0 con 0x7fc93810c170 2024-09-19T07:21:44.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:44.925+0000 7fc92affd640 1 -- 172.21.15.148:0/2642797945 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc930018c10 con 0x7fc93810c170 2024-09-19T07:21:44.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:44.925+0000 7fc93ff81640 1 -- 172.21.15.148:0/2642797945 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9381a4f60 con 0x7fc93810c170 2024-09-19T07:21:44.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:44.926+0000 7fc93ff81640 1 -- 172.21.15.148:0/2642797945 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc938103120 con 0x7fc93810c170 2024-09-19T07:21:44.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:44.927+0000 7fc92affd640 1 -- 172.21.15.148:0/2642797945 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fc93000f5f0 con 0x7fc93810c170 2024-09-19T07:21:44.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:44.928+0000 7fc92affd640 1 --2- 172.21.15.148:0/2642797945 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc9240a33b0 0x7fc9240a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:44.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:44.928+0000 7fc93dd1d640 1 --2- 172.21.15.148:0/2642797945 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc9240a33b0 0x7fc9240a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:44.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:44.928+0000 7fc92affd640 1 -- 172.21.15.148:0/2642797945 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8556+0+0 (secure 0 0 0) 0x7fc9300d0420 con 0x7fc93810c170 2024-09-19T07:21:44.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:44.928+0000 7fc93dd1d640 1 --2- 172.21.15.148:0/2642797945 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc9240a33b0 0x7fc9240a5870 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc92c005ab0 tx=0x7fc92c005a20 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:44.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:44.931+0000 7fc92affd640 1 -- 172.21.15.148:0/2642797945 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc930014030 con 0x7fc93810c170 2024-09-19T07:21:45.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:45.131+0000 7fc93ff81640 1 -- 172.21.15.148:0/2642797945 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc938199740 con 0x7fc93810c170 2024-09-19T07:21:45.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:45.131+0000 7fc92affd640 1 -- 172.21.15.148:0/2642797945 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+11944 (secure 0 0 0) 0x7fc938199740 con 0x7fc93810c170 2024-09-19T07:21:45.133 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:21:45.133 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":43,"btime":"2024-09-19T07:20:20:209191+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/4263868576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":4263868576},{"type":"v1","addr":"172.21.15.148:6841","nonce":4263868576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":25606,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3891676893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3891676893},{"type":"v1","addr":"172.21.15.179:6835","nonce":3891676893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":43,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:09:19.543369+0000","modified":"2024-09-19T07:20:19.813692+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24457,"mds_1":24437,"mds_2":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":75,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":71,"addr":"172.21.15.165:6839/3993490234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":3993490234},{"type":"v1","addr":"172.21.15.165:6839","nonce":3993490234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25823":{"gid":25823,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6835/380886107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":380886107},{"type":"v1","addr":"172.21.15.165:6835","nonce":380886107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24457,"qdb_cluster":[24457,24437,24436]},"id":1}]} 2024-09-19T07:21:45.134 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 43 2024-09-19T07:21:45.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:45.134+0000 7fc93ff81640 1 -- 172.21.15.148:0/2642797945 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc9240a33b0 msgr2=0x7fc9240a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:45.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:45.134+0000 7fc93ff81640 1 --2- 172.21.15.148:0/2642797945 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc9240a33b0 0x7fc9240a5870 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc92c005ab0 tx=0x7fc92c005a20 comp rx=0 tx=0).stop 2024-09-19T07:21:45.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:45.134+0000 7fc93ff81640 1 -- 172.21.15.148:0/2642797945 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc93810c170 msgr2=0x7fc93819ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:45.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:45.134+0000 7fc93ff81640 1 --2- 172.21.15.148:0/2642797945 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc93810c170 0x7fc93819ccb0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fc93000cce0 tx=0x7fc93000a620 comp rx=0 tx=0).stop 2024-09-19T07:21:45.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:45.135+0000 7fc93ff81640 1 -- 172.21.15.148:0/2642797945 shutdown_connections 2024-09-19T07:21:45.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:45.135+0000 7fc93ff81640 1 --2- 172.21.15.148:0/2642797945 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc9240a33b0 0x7fc9240a5870 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:45.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:45.135+0000 7fc93ff81640 1 --2- 172.21.15.148:0/2642797945 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc93810c170 0x7fc93819ccb0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:45.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:45.135+0000 7fc93ff81640 1 --2- 172.21.15.148:0/2642797945 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc938103660 0x7fc938198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:45.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:45.135+0000 7fc93ff81640 1 --2- 172.21.15.148:0/2642797945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc938102d40 0x7fc9381983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:45.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:45.135+0000 7fc93ff81640 1 -- 172.21.15.148:0/2642797945 >> 172.21.15.148:0/2642797945 conn(0x7fc9380fc7a0 msgr2=0x7fc9380fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:45.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:45.135+0000 7fc93ff81640 1 -- 172.21.15.148:0/2642797945 shutdown_connections 2024-09-19T07:21:45.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:45.135+0000 7fc93ff81640 1 -- 172.21.15.148:0/2642797945 wait complete. 2024-09-19T07:21:45.492 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:45 smithi148 ceph-mon[31180]: pgmap v332: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 9.2 KiB/s wr, 7 op/s 2024-09-19T07:21:45.493 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:45 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/2642797945' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:21:45.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:45 smithi179 ceph-mon[35716]: pgmap v332: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 9.2 KiB/s wr, 7 op/s 2024-09-19T07:21:45.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:45 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/2642797945' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:21:45.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:45 smithi165 ceph-mon[35326]: pgmap v332: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 9.2 KiB/s wr, 7 op/s 2024-09-19T07:21:45.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:45 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/2642797945' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:21:45.846 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24457 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-09-19T07:21:45.846 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24457 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-09-19T07:21:46.096 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:21:46.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.601+0000 7f992b0d4640 1 -- 172.21.15.148:0/2034681809 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9924102790 msgr2=0x7f99241067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:46.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.601+0000 7f992b0d4640 1 --2- 172.21.15.148:0/2034681809 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9924102790 0x7f99241067e0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f9910009900 tx=0x7f991002a410 comp rx=0 tx=0).stop 2024-09-19T07:21:46.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.601+0000 7f992b0d4640 1 -- 172.21.15.148:0/2034681809 shutdown_connections 2024-09-19T07:21:46.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.601+0000 7f992b0d4640 1 --2- 172.21.15.148:0/2034681809 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9924106f10 0x7f992410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:46.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.601+0000 7f992b0d4640 1 --2- 172.21.15.148:0/2034681809 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9924102790 0x7f99241067e0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:46.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.601+0000 7f992b0d4640 1 --2- 172.21.15.148:0/2034681809 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9924101de0 0x7f99241021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:46.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.601+0000 7f992b0d4640 1 -- 172.21.15.148:0/2034681809 >> 172.21.15.148:0/2034681809 conn(0x7f99240fd8c0 msgr2=0x7f99240ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:46.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.601+0000 7f992b0d4640 1 -- 172.21.15.148:0/2034681809 shutdown_connections 2024-09-19T07:21:46.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.601+0000 7f992b0d4640 1 -- 172.21.15.148:0/2034681809 wait complete. 2024-09-19T07:21:46.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.602+0000 7f992b0d4640 1 Processor -- start 2024-09-19T07:21:46.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.602+0000 7f992b0d4640 1 -- start start 2024-09-19T07:21:46.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.602+0000 7f992b0d4640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9924101de0 0x7f9924198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:46.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.602+0000 7f992b0d4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9924102790 0x7f99241989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:46.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.602+0000 7f992b0d4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9924106f10 0x7f992419cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:46.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.602+0000 7f992b0d4640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9924111f70 con 0x7f9924102790 2024-09-19T07:21:46.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.602+0000 7f992b0d4640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9924111df0 con 0x7f9924101de0 2024-09-19T07:21:46.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.602+0000 7f992b0d4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f99241120f0 con 0x7f9924106f10 2024-09-19T07:21:46.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.602+0000 7f9923fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9924102790 0x7f99241989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:46.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.602+0000 7f9923fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9924102790 0x7f99241989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52214/0 (socket says 172.21.15.148:52214) 2024-09-19T07:21:46.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.602+0000 7f9923fff640 1 -- 172.21.15.148:0/639445117 learned_addr learned my addr 172.21.15.148:0/639445117 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:21:46.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.602+0000 7f9928e70640 1 --2- 172.21.15.148:0/639445117 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9924101de0 0x7f9924198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:46.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.602+0000 7f9923fff640 1 -- 172.21.15.148:0/639445117 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9924106f10 msgr2=0x7f992419cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:46.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.602+0000 7f9929671640 1 --2- 172.21.15.148:0/639445117 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9924106f10 0x7f992419cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:46.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.603+0000 7f9923fff640 1 --2- 172.21.15.148:0/639445117 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9924106f10 0x7f992419cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:46.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.603+0000 7f9923fff640 1 -- 172.21.15.148:0/639445117 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9924101de0 msgr2=0x7f9924198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:46.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.603+0000 7f9923fff640 1 --2- 172.21.15.148:0/639445117 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9924101de0 0x7f9924198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:46.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.603+0000 7f9923fff640 1 -- 172.21.15.148:0/639445117 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f992419d440 con 0x7f9924102790 2024-09-19T07:21:46.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.603+0000 7f9923fff640 1 --2- 172.21.15.148:0/639445117 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9924102790 0x7f99241989d0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f9910006010 tx=0x7f99100042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:46.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.603+0000 7f9921ffb640 1 -- 172.21.15.148:0/639445117 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f991003f030 con 0x7f9924102790 2024-09-19T07:21:46.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.603+0000 7f992b0d4640 1 -- 172.21.15.148:0/639445117 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f992419d6d0 con 0x7f9924102790 2024-09-19T07:21:46.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.603+0000 7f9921ffb640 1 -- 172.21.15.148:0/639445117 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9910003ce0 con 0x7f9924102790 2024-09-19T07:21:46.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.603+0000 7f9921ffb640 1 -- 172.21.15.148:0/639445117 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9910035070 con 0x7f9924102790 2024-09-19T07:21:46.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.603+0000 7f992b0d4640 1 -- 172.21.15.148:0/639445117 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99241a5010 con 0x7f9924102790 2024-09-19T07:21:46.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.606+0000 7f9921ffb640 1 -- 172.21.15.148:0/639445117 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f9910042030 con 0x7f9924102790 2024-09-19T07:21:46.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.606+0000 7f992d4ad740 1 Processor -- start 2024-09-19T07:21:46.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.606+0000 7f992d4ad740 1 -- start start 2024-09-19T07:21:46.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.606+0000 7f992d4ad740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f305c2e640 0x55f305c2ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:46.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.606+0000 7f992d4ad740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f305c2ef60 0x55f305c3d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:46.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.606+0000 7f992d4ad740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f305c3dd50 0x55f305c40140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:46.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.606+0000 7f992d4ad740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55f305b942a0 con 0x55f305c2e640 2024-09-19T07:21:46.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.606+0000 7f992d4ad740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55f305b3bb10 con 0x55f305c3dd50 2024-09-19T07:21:46.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.606+0000 7f992d4ad740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f305b90260 con 0x55f305c2ef60 2024-09-19T07:21:46.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.607+0000 7f9929671640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f305c2e640 0x55f305c2ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:46.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.607+0000 7f9929671640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f305c2e640 0x55f305c2ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52216/0 (socket says 172.21.15.148:52216) 2024-09-19T07:21:46.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.607+0000 7f9929671640 1 -- 172.21.15.148:0/3851961324 learned_addr learned my addr 172.21.15.148:0/3851961324 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:21:46.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.607+0000 7f9923fff640 1 --2- 172.21.15.148:0/3851961324 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f305c3dd50 0x55f305c40140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:46.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.607+0000 7f9921ffb640 1 --2- 172.21.15.148:0/639445117 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f99140a33b0 0x7f99140a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:46.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.607+0000 7f9928e70640 1 --2- 172.21.15.148:0/3851961324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f305c2ef60 0x55f305c3d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:46.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.607+0000 7f9929671640 1 -- 172.21.15.148:0/3851961324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f305c2ef60 msgr2=0x55f305c3d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:46.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.607+0000 7f9929671640 1 --2- 172.21.15.148:0/3851961324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f305c2ef60 0x55f305c3d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:46.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.607+0000 7f9929671640 1 -- 172.21.15.148:0/3851961324 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f305c3dd50 msgr2=0x55f305c40140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:46.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.607+0000 7f9929671640 1 --2- 172.21.15.148:0/3851961324 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f305c3dd50 0x55f305c40140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:46.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.607+0000 7f9929671640 1 -- 172.21.15.148:0/3851961324 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f305905b90 con 0x55f305c2e640 2024-09-19T07:21:46.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.607+0000 7f9921ffb640 1 -- 172.21.15.148:0/639445117 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8556+0+0 (secure 0 0 0) 0x7f99100f0400 con 0x7f9924102790 2024-09-19T07:21:46.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.607+0000 7f9929671640 1 --2- 172.21.15.148:0/639445117 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f99140a33b0 0x7f99140a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:46.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.607+0000 7f9929671640 1 --2- 172.21.15.148:0/3851961324 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f305c2e640 0x55f305c2ea20 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f991c009440 tx=0x7f991c00e780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de2853d2da90a85c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:46.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.607+0000 7f990effd640 1 -- 172.21.15.148:0/3851961324 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f991c01b5d0 con 0x55f305c2e640 2024-09-19T07:21:46.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.607+0000 7f990effd640 1 -- 172.21.15.148:0/3851961324 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f991c01bc50 con 0x55f305c2e640 2024-09-19T07:21:46.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.607+0000 7f990effd640 1 -- 172.21.15.148:0/3851961324 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f991c011b00 con 0x55f305c2e640 2024-09-19T07:21:46.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.607+0000 7f9929671640 1 --2- 172.21.15.148:0/639445117 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f99140a33b0 0x7f99140a5870 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f991c01f000 tx=0x7f991c020000 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:46.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.608+0000 7f992d4ad740 1 -- 172.21.15.148:0/3851961324 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f305c2e640 msgr2=0x55f305c2ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:46.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.608+0000 7f992d4ad740 1 --2- 172.21.15.148:0/3851961324 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f305c2e640 0x55f305c2ea20 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f991c009440 tx=0x7f991c00e780 comp rx=0 tx=0).stop 2024-09-19T07:21:46.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.608+0000 7f992d4ad740 1 -- 172.21.15.148:0/3851961324 shutdown_connections 2024-09-19T07:21:46.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.608+0000 7f992d4ad740 1 --2- 172.21.15.148:0/3851961324 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f305c3dd50 0x55f305c40140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:46.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.608+0000 7f992d4ad740 1 --2- 172.21.15.148:0/3851961324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f305c2ef60 0x55f305c3d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:46.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.608+0000 7f992d4ad740 1 --2- 172.21.15.148:0/3851961324 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f305c2e640 0x55f305c2ea20 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:46.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.608+0000 7f992d4ad740 1 -- 172.21.15.148:0/3851961324 >> 172.21.15.148:0/3851961324 conn(0x55f305c2acf0 msgr2=0x55f305c2b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:46.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.608+0000 7f992d4ad740 1 -- 172.21.15.148:0/3851961324 shutdown_connections 2024-09-19T07:21:46.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.608+0000 7f992d4ad740 1 -- 172.21.15.148:0/3851961324 wait complete. 2024-09-19T07:21:46.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.608+0000 7f992d4ad740 1 -- start start 2024-09-19T07:21:46.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.609+0000 7f992d4ad740 1 Processor -- start 2024-09-19T07:21:46.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.609+0000 7f992d4ad740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f305c2e640 0x55f305c3ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:46.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.609+0000 7f992d4ad740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f305c2ef60 0x55f305c3b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:46.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.609+0000 7f992d4ad740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f305c3dd50 0x55f305c3b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:46.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.609+0000 7f992d4ad740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55f305c40920 con 0x55f305c2e640 2024-09-19T07:21:46.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.609+0000 7f992d4ad740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55f305b1c6e0 con 0x55f305c3dd50 2024-09-19T07:21:46.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.609+0000 7f992d4ad740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f305c40aa0 con 0x55f305c2ef60 2024-09-19T07:21:46.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.609+0000 7f992d4ad740 10 client.0 _ll_register_callbacks cb 0x55f305b40a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:21:46.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.609+0000 7f9928e70640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f305c2e640 0x55f305c3ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:46.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.609+0000 7f9928e70640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f305c2e640 0x55f305c3ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52222/0 (socket says 172.21.15.148:52222) 2024-09-19T07:21:46.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.609+0000 7f9928e70640 1 -- 172.21.15.148:0/3892947277 learned_addr learned my addr 172.21.15.148:0/3892947277 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:21:46.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.609+0000 7f9929671640 1 --2- 172.21.15.148:0/3892947277 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f305c3dd50 0x55f305c3b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:46.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.609+0000 7f9923fff640 1 --2- 172.21.15.148:0/3892947277 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f305c2ef60 0x55f305c3b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:46.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.609+0000 7f9928e70640 1 -- 172.21.15.148:0/3892947277 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f305c2ef60 msgr2=0x55f305c3b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:46.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.609+0000 7f9928e70640 1 --2- 172.21.15.148:0/3892947277 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f305c2ef60 0x55f305c3b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:46.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.609+0000 7f9928e70640 1 -- 172.21.15.148:0/3892947277 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f305c3dd50 msgr2=0x55f305c3b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:46.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.609+0000 7f9928e70640 1 --2- 172.21.15.148:0/3892947277 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f305c3dd50 0x55f305c3b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:46.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.609+0000 7f9928e70640 1 -- 172.21.15.148:0/3892947277 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f305c49e50 con 0x55f305c2e640 2024-09-19T07:21:46.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.610+0000 7f9928e70640 1 --2- 172.21.15.148:0/3892947277 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f305c2e640 0x55f305c3ac30 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f991800bf20 tx=0x7f99180128e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6000c7882655f008 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:46.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.610+0000 7f9903fff640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:21:46.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.610+0000 7f9903fff640 1 -- 172.21.15.148:0/3892947277 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9918005220 con 0x55f305c2e640 2024-09-19T07:21:46.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.610+0000 7f9903fff640 1 -- 172.21.15.148:0/3892947277 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8556+0+0 (secure 0 0 0) 0x7f99180053c0 con 0x55f305c2e640 2024-09-19T07:21:46.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.610+0000 7f992d4ad740 1 -- 172.21.15.148:0/3892947277 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f991c01bc50 con 0x55f305c2e640 2024-09-19T07:21:46.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.610+0000 7f9903fff640 1 -- 172.21.15.148:0/3892947277 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f99180055c0 con 0x55f305c2e640 2024-09-19T07:21:46.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.610+0000 7f992d4ad740 10 client.17076 fetch_fsmap learned FSMap version 43 2024-09-19T07:21:46.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.610+0000 7f992d4ad740 1 -- 172.21.15.148:0/3892947277 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55f305c4c840 con 0x55f305c2e640 2024-09-19T07:21:46.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.610+0000 7f9903fff640 1 -- 172.21.15.148:0/3892947277 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f991c01bc50 con 0x55f305c2e640 2024-09-19T07:21:46.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.610+0000 7f9903fff640 1 -- 172.21.15.148:0/3892947277 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 43) ==== 8362+0+0 (secure 0 0 0) 0x7f9918010ca0 con 0x55f305c2e640 2024-09-19T07:21:46.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.610+0000 7f992d4ad740 10 client.17076 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T07:21:46.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.610+0000 7f992d4ad740 10 client.17076 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:21:46.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.610+0000 7f992d4ad740 20 client.17076 populate_metadata read hostname 'smithi148' 2024-09-19T07:21:46.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.610+0000 7f992d4ad740 1 --2- 172.21.15.148:0/3892947277 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55f305c4dd00 0x55f305c501a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:46.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.610+0000 7f992d4ad740 4 client.17076 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:21:46.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.610+0000 7f992d4ad740 1 -- 172.21.15.148:0/3892947277 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f305ba19d0 con 0x55f305c4dd00 2024-09-19T07:21:46.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.611+0000 7f9923fff640 1 --2- 172.21.15.148:0/3892947277 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55f305c4dd00 0x55f305c501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:46.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.611+0000 7f9903fff640 10 client.17076 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:21:46.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.611+0000 7f9923fff640 1 --2- 172.21.15.148:0/3892947277 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55f305c4dd00 0x55f305c501a0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bacc53b48de81ae server_cookie=258c36521a545384 in_seq=0 out_seq=0 2024-09-19T07:21:46.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.612+0000 7f9903fff640 1 -- 172.21.15.148:0/3892947277 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f305ba19d0 con 0x55f305c4dd00 2024-09-19T07:21:46.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.612+0000 7f9903fff640 10 client.17076 handle_command_reply: tid=0 2024-09-19T07:21:46.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.612+0000 7f992d4ad740 1 client.17076 shutdown 2024-09-19T07:21:46.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.612+0000 7f992d4ad740 1 -- 172.21.15.148:0/3892947277 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f305c2e640 msgr2=0x55f305c3ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:46.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.612+0000 7f992d4ad740 1 --2- 172.21.15.148:0/3892947277 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f305c2e640 0x55f305c3ac30 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f991800bf20 tx=0x7f99180128e0 comp rx=0 tx=0).stop 2024-09-19T07:21:46.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.612+0000 7f992d4ad740 1 -- 172.21.15.148:0/3892947277 shutdown_connections 2024-09-19T07:21:46.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.612+0000 7f992d4ad740 1 --2- 172.21.15.148:0/3892947277 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55f305c4dd00 0x55f305c501a0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:46.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.612+0000 7f992d4ad740 1 --2- 172.21.15.148:0/3892947277 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f305c3dd50 0x55f305c3b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:46.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.612+0000 7f992d4ad740 1 --2- 172.21.15.148:0/3892947277 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f305c2ef60 0x55f305c3b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:46.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.612+0000 7f9903fff640 0 client.17076 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:21:46.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.612+0000 7f992d4ad740 1 --2- 172.21.15.148:0/3892947277 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f305c2e640 0x55f305c3ac30 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:46.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.612+0000 7f992d4ad740 1 -- 172.21.15.148:0/3892947277 >> 172.21.15.148:0/3892947277 conn(0x55f305c2acf0 msgr2=0x55f305c30a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:46.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.612+0000 7f992d4ad740 1 -- 172.21.15.148:0/3892947277 shutdown_connections 2024-09-19T07:21:46.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.612+0000 7f992d4ad740 1 -- 172.21.15.148:0/3892947277 wait complete. 2024-09-19T07:21:46.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.612+0000 7f992d4ad740 20 client.17076 trim_cache size 0 max 16384 2024-09-19T07:21:46.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.629+0000 7f992d4ad740 1 Processor -- start 2024-09-19T07:21:46.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.629+0000 7f992d4ad740 1 -- start start 2024-09-19T07:21:46.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.629+0000 7f992d4ad740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f305c2e640 0x55f305c30860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:46.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.629+0000 7f992d4ad740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f305c2ef60 0x55f305c55a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:46.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.629+0000 7f992d4ad740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f305c3dd50 0x55f305c55fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:46.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.629+0000 7f992d4ad740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f99241adf60 con 0x55f305c3dd50 2024-09-19T07:21:46.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.629+0000 7f992d4ad740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f99241ab7d0 con 0x55f305c2ef60 2024-09-19T07:21:46.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.629+0000 7f992d4ad740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f99241a9640 con 0x55f305c2e640 2024-09-19T07:21:46.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.629+0000 7f9929671640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f305c3dd50 0x55f305c55fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:46.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.629+0000 7f9929671640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f305c3dd50 0x55f305c55fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52236/0 (socket says 172.21.15.148:52236) 2024-09-19T07:21:46.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.629+0000 7f9929671640 1 -- 172.21.15.148:0/1643490392 learned_addr learned my addr 172.21.15.148:0/1643490392 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:21:46.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.630+0000 7f9923fff640 1 --2- 172.21.15.148:0/1643490392 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f305c2ef60 0x55f305c55a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:46.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.630+0000 7f9928e70640 1 --2- 172.21.15.148:0/1643490392 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f305c2e640 0x55f305c30860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:46.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.630+0000 7f9929671640 1 -- 172.21.15.148:0/1643490392 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f305c2e640 msgr2=0x55f305c30860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:46.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.630+0000 7f9929671640 1 --2- 172.21.15.148:0/1643490392 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f305c2e640 0x55f305c30860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:46.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.630+0000 7f9929671640 1 -- 172.21.15.148:0/1643490392 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f305c2ef60 msgr2=0x55f305c55a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:46.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.630+0000 7f9929671640 1 --2- 172.21.15.148:0/1643490392 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f305c2ef60 0x55f305c55a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:46.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.630+0000 7f9929671640 1 -- 172.21.15.148:0/1643490392 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f305c40800 con 0x55f305c3dd50 2024-09-19T07:21:46.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.630+0000 7f9929671640 1 --2- 172.21.15.148:0/1643490392 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f305c3dd50 0x55f305c55fb0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f991c00ef80 tx=0x7f991c00efb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2176c10df11e5c06 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:46.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.630+0000 7f990e7fc640 1 -- 172.21.15.148:0/1643490392 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f991c011e90 con 0x55f305c3dd50 2024-09-19T07:21:46.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.630+0000 7f990e7fc640 1 -- 172.21.15.148:0/1643490392 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f991c011460 con 0x55f305c3dd50 2024-09-19T07:21:46.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.630+0000 7f990e7fc640 1 -- 172.21.15.148:0/1643490392 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f991c01b750 con 0x55f305c3dd50 2024-09-19T07:21:46.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.631+0000 7f992d4ad740 1 -- 172.21.15.148:0/1643490392 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f305c3dd50 msgr2=0x55f305c55fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:46.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.631+0000 7f992d4ad740 1 --2- 172.21.15.148:0/1643490392 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f305c3dd50 0x55f305c55fb0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f991c00ef80 tx=0x7f991c00efb0 comp rx=0 tx=0).stop 2024-09-19T07:21:46.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.631+0000 7f992d4ad740 1 -- 172.21.15.148:0/1643490392 shutdown_connections 2024-09-19T07:21:46.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.631+0000 7f992d4ad740 1 --2- 172.21.15.148:0/1643490392 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f305c3dd50 0x55f305c55fb0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:46.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.631+0000 7f992d4ad740 1 --2- 172.21.15.148:0/1643490392 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f305c2ef60 0x55f305c55a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:46.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.631+0000 7f992d4ad740 1 --2- 172.21.15.148:0/1643490392 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f305c2e640 0x55f305c30860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:46.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.631+0000 7f992d4ad740 1 -- 172.21.15.148:0/1643490392 >> 172.21.15.148:0/1643490392 conn(0x55f305c2acf0 msgr2=0x55f305c30150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:46.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.631+0000 7f992d4ad740 1 -- 172.21.15.148:0/1643490392 shutdown_connections 2024-09-19T07:21:46.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.631+0000 7f992d4ad740 1 -- 172.21.15.148:0/1643490392 wait complete. 2024-09-19T07:21:46.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.631+0000 7f992d4ad740 1 -- start start 2024-09-19T07:21:46.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.631+0000 7f992d4ad740 1 Processor -- start 2024-09-19T07:21:46.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.632+0000 7f992d4ad740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f305c2e640 0x55f305c420c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:46.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.632+0000 7f992d4ad740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f305c2ef60 0x55f305c42600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:46.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.632+0000 7f992d4ad740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f305c3dd50 0x55f305cb7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:46.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.632+0000 7f992d4ad740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f99241a9c90 con 0x55f305c2ef60 2024-09-19T07:21:46.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.632+0000 7f992d4ad740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f99241ab100 con 0x55f305c3dd50 2024-09-19T07:21:46.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.632+0000 7f992d4ad740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f99241aa360 con 0x55f305c2e640 2024-09-19T07:21:46.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.632+0000 7f992d4ad740 10 client.0 _ll_register_callbacks cb 0x7f991800b9c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:21:46.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.632+0000 7f9923fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f305c2ef60 0x55f305c42600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:46.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.632+0000 7f9923fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f305c2ef60 0x55f305c42600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52252/0 (socket says 172.21.15.148:52252) 2024-09-19T07:21:46.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.632+0000 7f9923fff640 1 -- 172.21.15.148:0/3946047658 learned_addr learned my addr 172.21.15.148:0/3946047658 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:21:46.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.632+0000 7f9928e70640 1 --2- 172.21.15.148:0/3946047658 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f305c2e640 0x55f305c420c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:46.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.632+0000 7f9929671640 1 --2- 172.21.15.148:0/3946047658 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f305c3dd50 0x55f305cb7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:46.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.632+0000 7f9923fff640 1 -- 172.21.15.148:0/3946047658 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f305c2e640 msgr2=0x55f305c420c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:46.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.632+0000 7f9923fff640 1 --2- 172.21.15.148:0/3946047658 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f305c2e640 0x55f305c420c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:46.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.632+0000 7f9923fff640 1 -- 172.21.15.148:0/3946047658 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f305c3dd50 msgr2=0x55f305cb7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:46.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.632+0000 7f9923fff640 1 --2- 172.21.15.148:0/3946047658 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f305c3dd50 0x55f305cb7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:46.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.632+0000 7f9923fff640 1 -- 172.21.15.148:0/3946047658 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f305cb7f80 con 0x55f305c2ef60 2024-09-19T07:21:46.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.632+0000 7f9923fff640 1 --2- 172.21.15.148:0/3946047658 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f305c2ef60 0x55f305c42600 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f99100bc710 tx=0x7f99100f0600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bab1c170ed641ae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:46.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.632+0000 7f9903fff640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:21:46.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.632+0000 7f9903fff640 1 -- 172.21.15.148:0/3946047658 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9910049040 con 0x55f305c2ef60 2024-09-19T07:21:46.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.632+0000 7f9903fff640 1 -- 172.21.15.148:0/3946047658 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8556+0+0 (secure 0 0 0) 0x7f99100eddb0 con 0x55f305c2ef60 2024-09-19T07:21:46.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.632+0000 7f992d4ad740 1 -- 172.21.15.148:0/3946047658 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f991c011460 con 0x55f305c2ef60 2024-09-19T07:21:46.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.633+0000 7f9903fff640 1 -- 172.21.15.148:0/3946047658 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f99100bc2c0 con 0x55f305c2ef60 2024-09-19T07:21:46.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.633+0000 7f992d4ad740 10 client.17082 fetch_fsmap learned FSMap version 43 2024-09-19T07:21:46.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.633+0000 7f992d4ad740 1 -- 172.21.15.148:0/3946047658 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55f305cb91c0 con 0x55f305c2ef60 2024-09-19T07:21:46.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.633+0000 7f9903fff640 1 -- 172.21.15.148:0/3946047658 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f991c011460 con 0x55f305c2ef60 2024-09-19T07:21:46.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.633+0000 7f9903fff640 1 -- 172.21.15.148:0/3946047658 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 43) ==== 8362+0+0 (secure 0 0 0) 0x7f99100b8040 con 0x55f305c2ef60 2024-09-19T07:21:46.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.633+0000 7f992d4ad740 10 client.17082 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T07:21:46.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.633+0000 7f992d4ad740 10 client.17082 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:21:46.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.633+0000 7f992d4ad740 20 client.17082 populate_metadata read hostname 'smithi148' 2024-09-19T07:21:46.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.633+0000 7f992d4ad740 1 --2- 172.21.15.148:0/3946047658 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55f305cb9990 0x55f305cbbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:46.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.633+0000 7f992d4ad740 4 client.17082 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-09-19T07:21:46.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.633+0000 7f992d4ad740 1 -- 172.21.15.148:0/3946047658 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x55f305b9bd20 con 0x55f305cb9990 2024-09-19T07:21:46.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.633+0000 7f9928e70640 1 --2- 172.21.15.148:0/3946047658 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55f305cb9990 0x55f305cbbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:46.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.634+0000 7f9928e70640 1 --2- 172.21.15.148:0/3946047658 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55f305cb9990 0x55f305cbbdb0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43460acdc9c79381 server_cookie=11ecfd82f43ba4e8 in_seq=0 out_seq=0 2024-09-19T07:21:46.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:46.634+0000 7f9903fff640 10 client.17082 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:21:47.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:47 smithi179 ceph-mon[35716]: pgmap v333: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.5 KiB/s wr, 10 op/s 2024-09-19T07:21:47.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:47 smithi148 ceph-mon[31180]: pgmap v333: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.5 KiB/s wr, 10 op/s 2024-09-19T07:21:47.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:47 smithi165 ceph-mon[35326]: pgmap v333: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.5 KiB/s wr, 10 op/s 2024-09-19T07:21:49.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:49 smithi179 ceph-mon[35716]: pgmap v334: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 9.0 KiB/s wr, 7 op/s 2024-09-19T07:21:49.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:49 smithi148 ceph-mon[31180]: pgmap v334: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 9.0 KiB/s wr, 7 op/s 2024-09-19T07:21:49.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:49 smithi165 ceph-mon[35326]: pgmap v334: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 9.0 KiB/s wr, 7 op/s 2024-09-19T07:21:51.451 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.447+0000 7fc7d5f9f640 1 -- 172.21.15.148:0/379727530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7d0106a00 msgr2=0x7fc7d0106de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:51.451 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.447+0000 7fc7d5f9f640 1 --2- 172.21.15.148:0/379727530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7d0106a00 0x7fc7d0106de0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0009930 tx=0x7fc7c002a420 comp rx=0 tx=0).stop 2024-09-19T07:21:51.451 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.447+0000 7fc7d5f9f640 1 -- 172.21.15.148:0/379727530 shutdown_connections 2024-09-19T07:21:51.451 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.447+0000 7fc7d5f9f640 1 --2- 172.21.15.148:0/379727530 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc7d0101390 0x7fc7d010d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:51.451 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.447+0000 7fc7d5f9f640 1 --2- 172.21.15.148:0/379727530 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7d01009f0 0x7fc7d0100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:51.451 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.447+0000 7fc7d5f9f640 1 --2- 172.21.15.148:0/379727530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7d0106a00 0x7fc7d0106de0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:51.451 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.447+0000 7fc7d5f9f640 1 -- 172.21.15.148:0/379727530 >> 172.21.15.148:0/379727530 conn(0x7fc7d00fc6b0 msgr2=0x7fc7d00fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:51.451 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.447+0000 7fc7d5f9f640 1 -- 172.21.15.148:0/379727530 shutdown_connections 2024-09-19T07:21:51.451 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.447+0000 7fc7d5f9f640 1 -- 172.21.15.148:0/379727530 wait complete. 2024-09-19T07:21:51.452 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.448+0000 7fc7d5f9f640 1 Processor -- start 2024-09-19T07:21:51.452 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.448+0000 7fc7d5f9f640 1 -- start start 2024-09-19T07:21:51.452 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.448+0000 7fc7d5f9f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7d01009f0 0x7fc7d01972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:51.452 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.448+0000 7fc7d5f9f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7d0101390 0x7fc7d01977f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:51.452 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.448+0000 7fc7d5f9f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc7d0106a00 0x7fc7d019bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:51.452 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.448+0000 7fc7d5f9f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d0110e40 con 0x7fc7d0101390 2024-09-19T07:21:51.452 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.448+0000 7fc7d5f9f640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d0110cc0 con 0x7fc7d0106a00 2024-09-19T07:21:51.452 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.448+0000 7fc7d5f9f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d0110fc0 con 0x7fc7d01009f0 2024-09-19T07:21:51.452 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.448+0000 7fc7c7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7d0101390 0x7fc7d01977f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:51.452 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.449+0000 7fc7c7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7d0101390 0x7fc7d01977f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52278/0 (socket says 172.21.15.148:52278) 2024-09-19T07:21:51.453 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.449+0000 7fc7c7fff640 1 -- 172.21.15.148:0/2449770974 learned_addr learned my addr 172.21.15.148:0/2449770974 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:21:51.453 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.449+0000 7fc7cffff640 1 --2- 172.21.15.148:0/2449770974 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc7d0106a00 0x7fc7d019bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:51.453 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.449+0000 7fc7cf7fe640 1 --2- 172.21.15.148:0/2449770974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7d01009f0 0x7fc7d01972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:51.453 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.449+0000 7fc7cffff640 1 -- 172.21.15.148:0/2449770974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7d01009f0 msgr2=0x7fc7d01972b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:51.453 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.449+0000 7fc7cffff640 1 --2- 172.21.15.148:0/2449770974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7d01009f0 0x7fc7d01972b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:51.453 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.449+0000 7fc7cffff640 1 -- 172.21.15.148:0/2449770974 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7d0101390 msgr2=0x7fc7d01977f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:51.453 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.449+0000 7fc7cffff640 1 --2- 172.21.15.148:0/2449770974 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7d0101390 0x7fc7d01977f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:51.453 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.449+0000 7fc7cffff640 1 -- 172.21.15.148:0/2449770974 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7d019c2a0 con 0x7fc7d0106a00 2024-09-19T07:21:51.453 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.449+0000 7fc7c7fff640 1 --2- 172.21.15.148:0/2449770974 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7d0101390 0x7fc7d01977f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:21:51.453 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.449+0000 7fc7cffff640 1 --2- 172.21.15.148:0/2449770974 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc7d0106a00 0x7fc7d019bb70 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc7c8009fd0 tx=0x7fc7c800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:51.453 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.449+0000 7fc7cd7fa640 1 -- 172.21.15.148:0/2449770974 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c800ce20 con 0x7fc7d0106a00 2024-09-19T07:21:51.453 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.449+0000 7fc7cd7fa640 1 -- 172.21.15.148:0/2449770974 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7c8005020 con 0x7fc7d0106a00 2024-09-19T07:21:51.454 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.449+0000 7fc7d5f9f640 1 -- 172.21.15.148:0/2449770974 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7d019c590 con 0x7fc7d0106a00 2024-09-19T07:21:51.454 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.449+0000 7fc7cd7fa640 1 -- 172.21.15.148:0/2449770974 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c8010720 con 0x7fc7d0106a00 2024-09-19T07:21:51.454 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.449+0000 7fc7d5f9f640 1 -- 172.21.15.148:0/2449770974 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7d01a3e20 con 0x7fc7d0106a00 2024-09-19T07:21:51.461 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.452+0000 7fc7cd7fa640 1 -- 172.21.15.148:0/2449770974 <== mon.2 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fc7c8005540 con 0x7fc7d0106a00 2024-09-19T07:21:51.461 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.452+0000 7fc7d8e1b740 1 Processor -- start 2024-09-19T07:21:51.461 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.452+0000 7fc7d8e1b740 1 -- start start 2024-09-19T07:21:51.462 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.453+0000 7fc7d8e1b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e1d4dbaaf0 0x55e1d4dbaed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:51.462 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.453+0000 7fc7d8e1b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1d4dbb410 0x55e1d4dc5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:51.462 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.453+0000 7fc7d8e1b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1d4dc5cb0 0x55e1d4dc80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:51.462 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.453+0000 7fc7d8e1b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55e1d4d1f2f0 con 0x55e1d4dc5cb0 2024-09-19T07:21:51.462 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.453+0000 7fc7d8e1b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55e1d4cc7270 con 0x55e1d4dbaaf0 2024-09-19T07:21:51.462 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.453+0000 7fc7d8e1b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55e1d4d1b2b0 con 0x55e1d4dbb410 2024-09-19T07:21:51.462 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.453+0000 7fc7c7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1d4dc5cb0 0x55e1d4dc80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:51.462 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.453+0000 7fc7c7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1d4dc5cb0 0x55e1d4dc80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52290/0 (socket says 172.21.15.148:52290) 2024-09-19T07:21:51.462 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.453+0000 7fc7c7fff640 1 -- 172.21.15.148:0/3231800528 learned_addr learned my addr 172.21.15.148:0/3231800528 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:21:51.462 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.453+0000 7fc7cf7fe640 1 --2- 172.21.15.148:0/3231800528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1d4dbb410 0x55e1d4dc5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:51.462 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.453+0000 7fc7c7fff640 1 --2- 172.21.15.148:0/3231800528 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e1d4dbaaf0 0x55e1d4dbaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:51.462 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.453+0000 7fc7cd7fa640 1 --2- 172.21.15.148:0/2449770974 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc7bc0a3460 0x7fc7bc0a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:51.463 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.453+0000 7fc7cffff640 1 --2- 172.21.15.148:0/2449770974 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc7bc0a3460 0x7fc7bc0a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:51.463 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.453+0000 7fc7cf7fe640 1 -- 172.21.15.148:0/3231800528 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e1d4dbaaf0 msgr2=0x55e1d4dbaed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:51.463 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.453+0000 7fc7cf7fe640 1 --2- 172.21.15.148:0/3231800528 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e1d4dbaaf0 0x55e1d4dbaed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:51.463 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.453+0000 7fc7cf7fe640 1 -- 172.21.15.148:0/3231800528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1d4dc5cb0 msgr2=0x55e1d4dc80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:51.463 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.453+0000 7fc7cf7fe640 1 --2- 172.21.15.148:0/3231800528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1d4dc5cb0 0x55e1d4dc80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:51.463 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.453+0000 7fc7cf7fe640 1 -- 172.21.15.148:0/3231800528 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1d4cc6340 con 0x55e1d4dbb410 2024-09-19T07:21:51.463 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.453+0000 7fc7c7fff640 1 --2- 172.21.15.148:0/3231800528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1d4dc5cb0 0x55e1d4dc80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:21:51.463 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.453+0000 7fc7cd7fa640 1 -- 172.21.15.148:0/2449770974 <== mon.2 v2:172.21.15.165:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8556+0+0 (secure 0 0 0) 0x7fc7c80d0460 con 0x7fc7d0106a00 2024-09-19T07:21:51.463 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.453+0000 7fc7cf7fe640 1 --2- 172.21.15.148:0/3231800528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1d4dbb410 0x55e1d4dc5770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0009900 tx=0x7fc7c0005dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75980126c6890b24 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:51.463 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.454+0000 7fc7c5ffb640 1 -- 172.21.15.148:0/3231800528 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c003f070 con 0x55e1d4dbb410 2024-09-19T07:21:51.463 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.454+0000 7fc7cffff640 1 --2- 172.21.15.148:0/2449770974 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc7bc0a3460 0x7fc7bc0a5920 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc7c80cdc40 tx=0x7fc7c8091bb0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:51.463 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.454+0000 7fc7c5ffb640 1 -- 172.21.15.148:0/3231800528 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7c0004030 con 0x55e1d4dbb410 2024-09-19T07:21:51.463 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.454+0000 7fc7c5ffb640 1 -- 172.21.15.148:0/3231800528 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c0035070 con 0x55e1d4dbb410 2024-09-19T07:21:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.454+0000 7fc7d8e1b740 1 -- 172.21.15.148:0/3231800528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1d4dbb410 msgr2=0x55e1d4dc5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.454+0000 7fc7d8e1b740 1 --2- 172.21.15.148:0/3231800528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1d4dbb410 0x55e1d4dc5770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0009900 tx=0x7fc7c0005dd0 comp rx=0 tx=0).stop 2024-09-19T07:21:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.454+0000 7fc7d8e1b740 1 -- 172.21.15.148:0/3231800528 shutdown_connections 2024-09-19T07:21:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.454+0000 7fc7d8e1b740 1 --2- 172.21.15.148:0/3231800528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1d4dc5cb0 0x55e1d4dc80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.454+0000 7fc7d8e1b740 1 --2- 172.21.15.148:0/3231800528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1d4dbb410 0x55e1d4dc5770 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.454+0000 7fc7d8e1b740 1 --2- 172.21.15.148:0/3231800528 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e1d4dbaaf0 0x55e1d4dbaed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.454+0000 7fc7d8e1b740 1 -- 172.21.15.148:0/3231800528 >> 172.21.15.148:0/3231800528 conn(0x55e1d4db7060 msgr2=0x55e1d4db7440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.454+0000 7fc7d8e1b740 1 -- 172.21.15.148:0/3231800528 shutdown_connections 2024-09-19T07:21:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.454+0000 7fc7d8e1b740 1 -- 172.21.15.148:0/3231800528 wait complete. 2024-09-19T07:21:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.455+0000 7fc7d8e1b740 1 -- start start 2024-09-19T07:21:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.455+0000 7fc7d8e1b740 1 Processor -- start 2024-09-19T07:21:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.455+0000 7fc7d8e1b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e1d4dbaaf0 0x55e1d4dc2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.455+0000 7fc7d8e1b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1d4dbb410 0x55e1d4dc3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:51.465 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.455+0000 7fc7d8e1b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1d4dc5cb0 0x55e1d4dc3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:51.465 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.455+0000 7fc7d8e1b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55e1d4dc8880 con 0x55e1d4dc5cb0 2024-09-19T07:21:51.465 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.455+0000 7fc7d8e1b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55e1d4ca8290 con 0x55e1d4dbaaf0 2024-09-19T07:21:51.465 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.455+0000 7fc7d8e1b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55e1d4dc8a00 con 0x55e1d4dbb410 2024-09-19T07:21:51.465 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.455+0000 7fc7d8e1b740 10 client.0 _ll_register_callbacks cb 0x55e1d4cd9140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:21:51.465 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.455+0000 7fc7c7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1d4dc5cb0 0x55e1d4dc3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:51.465 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.455+0000 7fc7cf7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1d4dbb410 0x55e1d4dc3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:51.465 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.455+0000 7fc7c7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1d4dc5cb0 0x55e1d4dc3650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52306/0 (socket says 172.21.15.148:52306) 2024-09-19T07:21:51.465 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.455+0000 7fc7c7fff640 1 -- 172.21.15.148:0/1971089265 learned_addr learned my addr 172.21.15.148:0/1971089265 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:21:51.465 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.455+0000 7fc7c7fff640 1 --2- 172.21.15.148:0/1971089265 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e1d4dbaaf0 0x55e1d4dc2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:51.465 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.456+0000 7fc7cf7fe640 1 -- 172.21.15.148:0/1971089265 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e1d4dbaaf0 msgr2=0x55e1d4dc2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:51.465 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.456+0000 7fc7cf7fe640 1 --2- 172.21.15.148:0/1971089265 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e1d4dbaaf0 0x55e1d4dc2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.456+0000 7fc7cf7fe640 1 -- 172.21.15.148:0/1971089265 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1d4dc5cb0 msgr2=0x55e1d4dc3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.456+0000 7fc7cf7fe640 1 --2- 172.21.15.148:0/1971089265 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1d4dc5cb0 0x55e1d4dc3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.456+0000 7fc7cf7fe640 1 -- 172.21.15.148:0/1971089265 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1d4a32210 con 0x55e1d4dbb410 2024-09-19T07:21:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.456+0000 7fc7cf7fe640 1 --2- 172.21.15.148:0/1971089265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1d4dbb410 0x55e1d4dc3110 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0005940 tx=0x7fc7c0009520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba76cbc630a04756 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.456+0000 7fc7aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-19T07:21:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.456+0000 7fc7aeffd640 1 -- 172.21.15.148:0/1971089265 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c0035070 con 0x55e1d4dbb410 2024-09-19T07:21:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.456+0000 7fc7d8e1b740 1 -- 172.21.15.148:0/1971089265 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7c0004030 con 0x55e1d4dbb410 2024-09-19T07:21:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.456+0000 7fc7aeffd640 1 -- 172.21.15.148:0/1971089265 <== mon.1 v2:172.21.15.179:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8556+0+0 (secure 0 0 0) 0x7fc7c00315b0 con 0x55e1d4dbb410 2024-09-19T07:21:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.456+0000 7fc7aeffd640 1 -- 172.21.15.148:0/1971089265 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fc7c0055050 con 0x55e1d4dbb410 2024-09-19T07:21:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.456+0000 7fc7d8e1b740 10 client.26374 fetch_fsmap learned FSMap version 43 2024-09-19T07:21:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.456+0000 7fc7d8e1b740 1 -- 172.21.15.148:0/1971089265 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55e1d4afe620 con 0x55e1d4dbb410 2024-09-19T07:21:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.456+0000 7fc7aeffd640 1 -- 172.21.15.148:0/1971089265 <== mon.1 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7c0004030 con 0x55e1d4dbb410 2024-09-19T07:21:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.457+0000 7fc7aeffd640 1 -- 172.21.15.148:0/1971089265 <== mon.1 v2:172.21.15.179:3300/0 5 ==== fsmap(e 43) ==== 8362+0+0 (secure 0 0 0) 0x7fc7c00046c0 con 0x55e1d4dbb410 2024-09-19T07:21:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.457+0000 7fc7d8e1b740 10 client.26374 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T07:21:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.457+0000 7fc7d8e1b740 10 client.26374 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:21:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.457+0000 7fc7d8e1b740 20 client.26374 populate_metadata read hostname 'smithi148' 2024-09-19T07:21:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.457+0000 7fc7d8e1b740 1 --2- 172.21.15.148:0/1971089265 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e1d4dd5ad0 0x55e1d4dd7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.457+0000 7fc7d8e1b740 4 client.26374 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:21:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.457+0000 7fc7d8e1b740 1 -- 172.21.15.148:0/1971089265 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e1d4d2ca20 con 0x55e1d4dd5ad0 2024-09-19T07:21:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.457+0000 7fc7c7fff640 1 --2- 172.21.15.148:0/1971089265 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e1d4dd5ad0 0x55e1d4dd7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.457+0000 7fc7aeffd640 10 client.26374 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:21:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.457+0000 7fc7c7fff640 1 --2- 172.21.15.148:0/1971089265 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e1d4dd5ad0 0x55e1d4dd7ec0 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7267b18c21d5b410 server_cookie=44de6cb939ef65b7 in_seq=0 out_seq=0 2024-09-19T07:21:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.458+0000 7fc7aeffd640 1 -- 172.21.15.148:0/1971089265 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e1d4d2ca20 con 0x55e1d4dd5ad0 2024-09-19T07:21:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.458+0000 7fc7aeffd640 10 client.26374 handle_command_reply: tid=0 2024-09-19T07:21:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.458+0000 7fc7d8e1b740 1 client.26374 shutdown 2024-09-19T07:21:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.458+0000 7fc7d8e1b740 1 -- 172.21.15.148:0/1971089265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1d4dbb410 msgr2=0x55e1d4dc3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.458+0000 7fc7d8e1b740 1 --2- 172.21.15.148:0/1971089265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1d4dbb410 0x55e1d4dc3110 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0005940 tx=0x7fc7c0009520 comp rx=0 tx=0).stop 2024-09-19T07:21:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.458+0000 7fc7d8e1b740 1 -- 172.21.15.148:0/1971089265 shutdown_connections 2024-09-19T07:21:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.458+0000 7fc7d8e1b740 1 --2- 172.21.15.148:0/1971089265 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e1d4dd5ad0 0x55e1d4dd7ec0 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.458+0000 7fc7d8e1b740 1 --2- 172.21.15.148:0/1971089265 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1d4dc5cb0 0x55e1d4dc3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.458+0000 7fc7d8e1b740 1 --2- 172.21.15.148:0/1971089265 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1d4dbb410 0x55e1d4dc3110 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.458+0000 7fc7aeffd640 0 client.26374 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:21:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.458+0000 7fc7d8e1b740 1 --2- 172.21.15.148:0/1971089265 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e1d4dbaaf0 0x55e1d4dc2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.458+0000 7fc7d8e1b740 1 -- 172.21.15.148:0/1971089265 >> 172.21.15.148:0/1971089265 conn(0x55e1d4db7060 msgr2=0x55e1d4dbcd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.458+0000 7fc7d8e1b740 1 -- 172.21.15.148:0/1971089265 shutdown_connections 2024-09-19T07:21:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.458+0000 7fc7d8e1b740 1 -- 172.21.15.148:0/1971089265 wait complete. 2024-09-19T07:21:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.458+0000 7fc7d8e1b740 20 client.26374 trim_cache size 0 max 16384 2024-09-19T07:21:51.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.473+0000 7fc7d8e1b740 1 Processor -- start 2024-09-19T07:21:51.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.473+0000 7fc7d8e1b740 1 -- start start 2024-09-19T07:21:51.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.473+0000 7fc7d8e1b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e1d4dbaaf0 0x55e1d4dc3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:51.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.473+0000 7fc7d8e1b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1d4dbb410 0x55e1d4dcde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:51.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.473+0000 7fc7d8e1b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1d4dc5cb0 0x55e1d4dce3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:51.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.473+0000 7fc7d8e1b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d01af000 con 0x55e1d4dbb410 2024-09-19T07:21:51.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.473+0000 7fc7d8e1b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d01ac870 con 0x55e1d4dbaaf0 2024-09-19T07:21:51.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.473+0000 7fc7d8e1b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d01aa6e0 con 0x55e1d4dc5cb0 2024-09-19T07:21:51.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.474+0000 7fc7cf7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1d4dbb410 0x55e1d4dcde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:51.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.474+0000 7fc7cf7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1d4dbb410 0x55e1d4dcde80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52310/0 (socket says 172.21.15.148:52310) 2024-09-19T07:21:51.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.474+0000 7fc7c7fff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e1d4dbaaf0 0x55e1d4dc3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:51.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.474+0000 7fc7cf7fe640 1 -- 172.21.15.148:0/1239144714 learned_addr learned my addr 172.21.15.148:0/1239144714 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:21:51.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.474+0000 7fc7c7fff640 1 --2- 172.21.15.148:0/1239144714 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1d4dc5cb0 0x55e1d4dce3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:51.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.474+0000 7fc7cf7fe640 1 -- 172.21.15.148:0/1239144714 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1d4dc5cb0 msgr2=0x55e1d4dce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:51.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.474+0000 7fc7cf7fe640 1 --2- 172.21.15.148:0/1239144714 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1d4dc5cb0 0x55e1d4dce3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:51.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.474+0000 7fc7cf7fe640 1 -- 172.21.15.148:0/1239144714 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e1d4dbaaf0 msgr2=0x55e1d4dc3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:51.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.474+0000 7fc7cf7fe640 1 --2- 172.21.15.148:0/1239144714 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e1d4dbaaf0 0x55e1d4dc3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:51.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.474+0000 7fc7cf7fe640 1 -- 172.21.15.148:0/1239144714 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1d4dce900 con 0x55e1d4dbb410 2024-09-19T07:21:51.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.474+0000 7fc7c7fff640 1 --2- 172.21.15.148:0/1239144714 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e1d4dbaaf0 0x55e1d4dc3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:21:51.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.474+0000 7fc7cf7fe640 1 --2- 172.21.15.148:0/1239144714 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1d4dbb410 0x55e1d4dcde80 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0005ec0 tx=0x7fc7c0005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2beca00ec84e600b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:51.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.474+0000 7fc7c57fa640 1 -- 172.21.15.148:0/1239144714 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c0035070 con 0x55e1d4dbb410 2024-09-19T07:21:51.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.474+0000 7fc7c57fa640 1 -- 172.21.15.148:0/1239144714 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7c004c070 con 0x55e1d4dbb410 2024-09-19T07:21:51.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.474+0000 7fc7c57fa640 1 -- 172.21.15.148:0/1239144714 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c003f040 con 0x55e1d4dbb410 2024-09-19T07:21:51.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.475+0000 7fc7d8e1b740 1 -- 172.21.15.148:0/1239144714 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1d4dbb410 msgr2=0x55e1d4dcde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:51.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.475+0000 7fc7d8e1b740 1 --2- 172.21.15.148:0/1239144714 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1d4dbb410 0x55e1d4dcde80 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0005ec0 tx=0x7fc7c0005dd0 comp rx=0 tx=0).stop 2024-09-19T07:21:51.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.475+0000 7fc7d8e1b740 1 -- 172.21.15.148:0/1239144714 shutdown_connections 2024-09-19T07:21:51.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.475+0000 7fc7d8e1b740 1 --2- 172.21.15.148:0/1239144714 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1d4dc5cb0 0x55e1d4dce3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:51.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.475+0000 7fc7d8e1b740 1 --2- 172.21.15.148:0/1239144714 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1d4dbb410 0x55e1d4dcde80 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:51.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.475+0000 7fc7d8e1b740 1 --2- 172.21.15.148:0/1239144714 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e1d4dbaaf0 0x55e1d4dc3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:51.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.475+0000 7fc7d8e1b740 1 -- 172.21.15.148:0/1239144714 >> 172.21.15.148:0/1239144714 conn(0x55e1d4db7060 msgr2=0x55e1d4dc4c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:51.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.475+0000 7fc7d8e1b740 1 -- 172.21.15.148:0/1239144714 shutdown_connections 2024-09-19T07:21:51.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.475+0000 7fc7d8e1b740 1 -- 172.21.15.148:0/1239144714 wait complete. 2024-09-19T07:21:51.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.475+0000 7fc7d8e1b740 1 -- start start 2024-09-19T07:21:51.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.476+0000 7fc7d8e1b740 1 Processor -- start 2024-09-19T07:21:51.482 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.476+0000 7fc7d8e1b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1d4dbaaf0 0x55e1d4dc07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:51.482 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.476+0000 7fc7d8e1b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e1d4dbb410 0x55e1d4dc2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:51.482 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.476+0000 7fc7d8e1b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1d4dc5cb0 0x55e1d4dc30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:51.482 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.476+0000 7fc7d8e1b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d01aad30 con 0x55e1d4dc5cb0 2024-09-19T07:21:51.483 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.476+0000 7fc7d8e1b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d01ac1a0 con 0x55e1d4dbb410 2024-09-19T07:21:51.483 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.476+0000 7fc7d8e1b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d01ab400 con 0x55e1d4dbaaf0 2024-09-19T07:21:51.483 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.476+0000 7fc7d8e1b740 10 client.0 _ll_register_callbacks cb 0x7fc7b8012700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:21:51.483 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.476+0000 7fc7c7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1d4dc5cb0 0x55e1d4dc30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:51.483 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.476+0000 7fc7cf7fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e1d4dbb410 0x55e1d4dc2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:51.483 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.476+0000 7fc7cf7fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e1d4dbb410 0x55e1d4dc2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:42232/0 (socket says 172.21.15.148:42232) 2024-09-19T07:21:51.483 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.476+0000 7fc7cf7fe640 1 -- 172.21.15.148:0/2796671966 learned_addr learned my addr 172.21.15.148:0/2796671966 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:21:51.483 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.476+0000 7fc7c7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1d4dc5cb0 0x55e1d4dc30f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52318/0 (socket says 172.21.15.148:52318) 2024-09-19T07:21:51.484 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.476+0000 7fc7c7fff640 1 --2- 172.21.15.148:0/2796671966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1d4dbaaf0 0x55e1d4dc07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:51.484 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.477+0000 7fc7cf7fe640 1 -- 172.21.15.148:0/2796671966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1d4dbaaf0 msgr2=0x55e1d4dc07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:51.484 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.477+0000 7fc7cf7fe640 1 --2- 172.21.15.148:0/2796671966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1d4dbaaf0 0x55e1d4dc07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:51.484 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.477+0000 7fc7cf7fe640 1 -- 172.21.15.148:0/2796671966 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1d4dc5cb0 msgr2=0x55e1d4dc30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:51.484 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.477+0000 7fc7cf7fe640 1 --2- 172.21.15.148:0/2796671966 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1d4dc5cb0 0x55e1d4dc30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:51.484 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.477+0000 7fc7cf7fe640 1 -- 172.21.15.148:0/2796671966 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1d4dc3920 con 0x55e1d4dbb410 2024-09-19T07:21:51.485 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.477+0000 7fc7cf7fe640 1 --2- 172.21.15.148:0/2796671966 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e1d4dbb410 0x55e1d4dc2bb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0004a90 tx=0x7fc7c0004b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d255c47eb06da8b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:51.485 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.477+0000 7fc7aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-19T07:21:51.485 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.477+0000 7fc7aeffd640 1 -- 172.21.15.148:0/2796671966 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c005e060 con 0x55e1d4dbb410 2024-09-19T07:21:51.485 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.477+0000 7fc7d8e1b740 1 -- 172.21.15.148:0/2796671966 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7c004c070 con 0x55e1d4dbb410 2024-09-19T07:21:51.486 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.477+0000 7fc7aeffd640 1 -- 172.21.15.148:0/2796671966 <== mon.2 v2:172.21.15.165:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8556+0+0 (secure 0 0 0) 0x7fc7c00315b0 con 0x55e1d4dbb410 2024-09-19T07:21:51.486 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.477+0000 7fc7aeffd640 1 -- 172.21.15.148:0/2796671966 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fc7c0035070 con 0x55e1d4dbb410 2024-09-19T07:21:51.486 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.477+0000 7fc7d8e1b740 10 client.26267 fetch_fsmap learned FSMap version 43 2024-09-19T07:21:51.486 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.477+0000 7fc7d8e1b740 1 -- 172.21.15.148:0/2796671966 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55e1d4e42580 con 0x55e1d4dbb410 2024-09-19T07:21:51.486 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.477+0000 7fc7aeffd640 1 -- 172.21.15.148:0/2796671966 <== mon.2 v2:172.21.15.165:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7c004c070 con 0x55e1d4dbb410 2024-09-19T07:21:51.486 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.478+0000 7fc7aeffd640 1 -- 172.21.15.148:0/2796671966 <== mon.2 v2:172.21.15.165:3300/0 5 ==== fsmap(e 43) ==== 8362+0+0 (secure 0 0 0) 0x7fc7c00515e0 con 0x55e1d4dbb410 2024-09-19T07:21:51.487 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.478+0000 7fc7d8e1b740 10 client.26267 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T07:21:51.487 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.478+0000 7fc7d8e1b740 10 client.26267 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:21:51.487 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.478+0000 7fc7d8e1b740 20 client.26267 populate_metadata read hostname 'smithi148' 2024-09-19T07:21:51.487 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.478+0000 7fc7d8e1b740 1 --2- 172.21.15.148:0/2796671966 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e1d4dd5ad0 0x55e1d4e44d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:51.487 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.478+0000 7fc7d8e1b740 4 client.26267 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:21:51.487 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.478+0000 7fc7d8e1b740 1 -- 172.21.15.148:0/2796671966 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e1d4d26d70 con 0x55e1d4dd5ad0 2024-09-19T07:21:51.488 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.478+0000 7fc7c7fff640 1 --2- 172.21.15.148:0/2796671966 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e1d4dd5ad0 0x55e1d4e44d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:51.488 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.478+0000 7fc7aeffd640 10 client.26267 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:21:51.488 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.478+0000 7fc7c7fff640 1 --2- 172.21.15.148:0/2796671966 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e1d4dd5ad0 0x55e1d4e44d70 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=418c67af4ba5cf6b server_cookie=5f4e730bb18dcdd4 in_seq=0 out_seq=0 2024-09-19T07:21:51.490 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.489+0000 7fc7aeffd640 1 -- 172.21.15.148:0/2796671966 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e1d4d26d70 con 0x55e1d4dd5ad0 2024-09-19T07:21:51.490 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.489+0000 7fc7aeffd640 10 client.26267 handle_command_reply: tid=0 2024-09-19T07:21:51.490 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.489+0000 7fc7d8e1b740 1 client.26267 shutdown 2024-09-19T07:21:51.491 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.489+0000 7fc7d8e1b740 1 -- 172.21.15.148:0/2796671966 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e1d4dbb410 msgr2=0x55e1d4dc2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:51.491 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.489+0000 7fc7d8e1b740 1 --2- 172.21.15.148:0/2796671966 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e1d4dbb410 0x55e1d4dc2bb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0004a90 tx=0x7fc7c0004b90 comp rx=0 tx=0).stop 2024-09-19T07:21:51.491 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.489+0000 7fc7d8e1b740 1 -- 172.21.15.148:0/2796671966 shutdown_connections 2024-09-19T07:21:51.491 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.489+0000 7fc7d8e1b740 1 --2- 172.21.15.148:0/2796671966 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e1d4dd5ad0 0x55e1d4e44d70 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:51.491 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.489+0000 7fc7d8e1b740 1 --2- 172.21.15.148:0/2796671966 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e1d4dc5cb0 0x55e1d4dc30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:51.491 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.489+0000 7fc7d8e1b740 1 --2- 172.21.15.148:0/2796671966 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e1d4dbb410 0x55e1d4dc2bb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:51.491 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.489+0000 7fc7aeffd640 0 client.26267 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:21:51.491 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.489+0000 7fc7d8e1b740 1 --2- 172.21.15.148:0/2796671966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e1d4dbaaf0 0x55e1d4dc07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:51.491 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.489+0000 7fc7d8e1b740 1 -- 172.21.15.148:0/2796671966 >> 172.21.15.148:0/2796671966 conn(0x55e1d4db7060 msgr2=0x55e1d4dc4430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:51.491 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.489+0000 7fc7d8e1b740 1 -- 172.21.15.148:0/2796671966 shutdown_connections 2024-09-19T07:21:51.491 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.489+0000 7fc7d8e1b740 1 -- 172.21.15.148:0/2796671966 wait complete. 2024-09-19T07:21:51.491 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.489+0000 7fc7d8e1b740 20 client.26267 trim_cache size 0 max 16384 2024-09-19T07:21:51.492 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:21:51.492 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:21:51.492 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:21:51.492 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:21:51.493 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.490+0000 7fc7d5f9f640 1 -- 172.21.15.148:0/2449770974 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc7bc0a3460 msgr2=0x7fc7bc0a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:51.493 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.490+0000 7fc7d5f9f640 1 --2- 172.21.15.148:0/2449770974 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc7bc0a3460 0x7fc7bc0a5920 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc7c80cdc40 tx=0x7fc7c8091bb0 comp rx=0 tx=0).stop 2024-09-19T07:21:51.493 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.490+0000 7fc7d5f9f640 1 -- 172.21.15.148:0/2449770974 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc7d0106a00 msgr2=0x7fc7d019bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:51.493 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.490+0000 7fc7d5f9f640 1 --2- 172.21.15.148:0/2449770974 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc7d0106a00 0x7fc7d019bb70 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc7c8009fd0 tx=0x7fc7c800ef10 comp rx=0 tx=0).stop 2024-09-19T07:21:51.493 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.490+0000 7fc7d5f9f640 1 -- 172.21.15.148:0/2449770974 shutdown_connections 2024-09-19T07:21:51.493 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.490+0000 7fc7d5f9f640 1 --2- 172.21.15.148:0/2449770974 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc7bc0a3460 0x7fc7bc0a5920 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:51.493 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.490+0000 7fc7d5f9f640 1 --2- 172.21.15.148:0/2449770974 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc7d0106a00 0x7fc7d019bb70 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:51.493 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.490+0000 7fc7d5f9f640 1 --2- 172.21.15.148:0/2449770974 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7d0101390 0x7fc7d01977f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:51.493 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.490+0000 7fc7d5f9f640 1 --2- 172.21.15.148:0/2449770974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7d01009f0 0x7fc7d01972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:51.493 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.490+0000 7fc7d5f9f640 1 -- 172.21.15.148:0/2449770974 >> 172.21.15.148:0/2449770974 conn(0x7fc7d00fc6b0 msgr2=0x7fc7d00fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:51.494 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.490+0000 7fc7d5f9f640 1 -- 172.21.15.148:0/2449770974 shutdown_connections 2024-09-19T07:21:51.494 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:21:51.490+0000 7fc7d5f9f640 1 -- 172.21.15.148:0/2449770974 wait complete. 2024-09-19T07:21:51.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:51 smithi179 ceph-mon[35716]: pgmap v335: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-09-19T07:21:51.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:51 smithi148 ceph-mon[31180]: pgmap v335: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-09-19T07:21:51.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:51 smithi165 ceph-mon[35326]: pgmap v335: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-09-19T07:21:53.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:53 smithi179 ceph-mon[35716]: pgmap v336: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 10 op/s 2024-09-19T07:21:53.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:53 smithi148 ceph-mon[31180]: pgmap v336: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 10 op/s 2024-09-19T07:21:53.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:53 smithi165 ceph-mon[35326]: pgmap v336: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 10 op/s 2024-09-19T07:21:55.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:55 smithi179 ceph-mon[35716]: pgmap v337: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 8 op/s 2024-09-19T07:21:55.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:55 smithi148 ceph-mon[31180]: pgmap v337: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 8 op/s 2024-09-19T07:21:55.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:55 smithi165 ceph-mon[35326]: pgmap v337: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 8 op/s 2024-09-19T07:21:57.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:57 smithi179 ceph-mon[35716]: pgmap v338: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 11 op/s 2024-09-19T07:21:57.571 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:57 smithi148 ceph-mon[31180]: pgmap v338: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 11 op/s 2024-09-19T07:21:57.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:57.569+0000 7f9903fff640 1 -- 172.21.15.148:0/3946047658 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55f305b9bd20 con 0x55f305cb9990 2024-09-19T07:21:57.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:57.569+0000 7f9903fff640 10 client.17082 handle_command_reply: tid=0 2024-09-19T07:21:57.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:57.569+0000 7f992d4ad740 1 client.17082 shutdown 2024-09-19T07:21:57.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:57.570+0000 7f992d4ad740 1 -- 172.21.15.148:0/3946047658 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f305c2ef60 msgr2=0x55f305c42600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:57.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:57.570+0000 7f992d4ad740 1 --2- 172.21.15.148:0/3946047658 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f305c2ef60 0x55f305c42600 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f99100bc710 tx=0x7f99100f0600 comp rx=0 tx=0).stop 2024-09-19T07:21:57.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:57.570+0000 7f992d4ad740 1 -- 172.21.15.148:0/3946047658 shutdown_connections 2024-09-19T07:21:57.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:57.570+0000 7f992d4ad740 1 --2- 172.21.15.148:0/3946047658 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55f305cb9990 0x55f305cbbdb0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:57.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:57.570+0000 7f992d4ad740 1 --2- 172.21.15.148:0/3946047658 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f305c3dd50 0x55f305cb7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:57.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:57.570+0000 7f992d4ad740 1 --2- 172.21.15.148:0/3946047658 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f305c2ef60 0x55f305c42600 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:57.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:57.570+0000 7f992d4ad740 1 --2- 172.21.15.148:0/3946047658 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f305c2e640 0x55f305c420c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:57.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:57.570+0000 7f9903fff640 0 client.17082 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:21:57.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:57.570+0000 7f992d4ad740 1 -- 172.21.15.148:0/3946047658 >> 172.21.15.148:0/3946047658 conn(0x55f305c2acf0 msgr2=0x55f305c29e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:57.573 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:21:57.573 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 43, 2024-09-19T07:21:57.573 INFO:teuthology.orchestra.run.smithi148.stdout: "leader": 24457, 2024-09-19T07:21:57.573 INFO:teuthology.orchestra.run.smithi148.stdout: "set_version": 38, 2024-09-19T07:21:57.573 INFO:teuthology.orchestra.run.smithi148.stdout: "sets": { 2024-09-19T07:21:57.573 INFO:teuthology.orchestra.run.smithi148.stdout: "8900e1a2": { 2024-09-19T07:21:57.573 INFO:teuthology.orchestra.run.smithi148.stdout: "version": 38, 2024-09-19T07:21:57.573 INFO:teuthology.orchestra.run.smithi148.stdout: "age_ref": 0.0, 2024-09-19T07:21:57.574 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:21:57.574 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "QUIESCED", 2024-09-19T07:21:57.574 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:21:57.574 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:21:57.574 INFO:teuthology.orchestra.run.smithi148.stdout: "timeout": 90.0, 2024-09-19T07:21:57.574 INFO:teuthology.orchestra.run.smithi148.stdout: "expiration": 150.0, 2024-09-19T07:21:57.574 INFO:teuthology.orchestra.run.smithi148.stdout: "members": { 2024-09-19T07:21:57.574 INFO:teuthology.orchestra.run.smithi148.stdout: "file:/": { 2024-09-19T07:21:57.574 INFO:teuthology.orchestra.run.smithi148.stdout: "excluded": false, 2024-09-19T07:21:57.574 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:21:57.574 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "QUIESCED", 2024-09-19T07:21:57.574 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:21:57.574 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:21:57.575 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:21:57.575 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:21:57.575 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:21:57.575 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:21:57.575 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:21:57.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:57.570+0000 7f992d4ad740 1 -- 172.21.15.148:0/3946047658 shutdown_connections 2024-09-19T07:21:57.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:57.570+0000 7f992d4ad740 1 -- 172.21.15.148:0/3946047658 wait complete. 2024-09-19T07:21:57.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:57.570+0000 7f992d4ad740 20 client.17082 trim_cache size 0 max 16384 2024-09-19T07:21:57.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:57.571+0000 7f992b0d4640 1 -- 172.21.15.148:0/639445117 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f99140a33b0 msgr2=0x7f99140a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:57.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:57.571+0000 7f992b0d4640 1 --2- 172.21.15.148:0/639445117 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f99140a33b0 0x7f99140a5870 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f991c01f000 tx=0x7f991c020000 comp rx=0 tx=0).stop 2024-09-19T07:21:57.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:57.571+0000 7f992b0d4640 1 -- 172.21.15.148:0/639445117 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9924102790 msgr2=0x7f99241989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:57.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:57.571+0000 7f992b0d4640 1 --2- 172.21.15.148:0/639445117 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9924102790 0x7f99241989d0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f9910006010 tx=0x7f99100042f0 comp rx=0 tx=0).stop 2024-09-19T07:21:57.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:57.571+0000 7f992b0d4640 1 -- 172.21.15.148:0/639445117 shutdown_connections 2024-09-19T07:21:57.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:57.571+0000 7f992b0d4640 1 --2- 172.21.15.148:0/639445117 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f99140a33b0 0x7f99140a5870 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:57.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:57.571+0000 7f992b0d4640 1 --2- 172.21.15.148:0/639445117 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9924106f10 0x7f992419cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:57.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:57.571+0000 7f992b0d4640 1 --2- 172.21.15.148:0/639445117 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9924102790 0x7f99241989d0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:57.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:57.571+0000 7f992b0d4640 1 --2- 172.21.15.148:0/639445117 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9924101de0 0x7f9924198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:57.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:57.571+0000 7f992b0d4640 1 -- 172.21.15.148:0/639445117 >> 172.21.15.148:0/639445117 conn(0x7f99240fd8c0 msgr2=0x7f99240fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:57.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:57.571+0000 7f992b0d4640 1 -- 172.21.15.148:0/639445117 shutdown_connections 2024-09-19T07:21:57.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:21:57.571+0000 7f992b0d4640 1 -- 172.21.15.148:0/639445117 wait complete. 2024-09-19T07:21:57.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:57 smithi165 ceph-mon[35326]: pgmap v338: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 11 op/s 2024-09-19T07:21:58.242 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '8900e1a2', quiesce took 14.0 seconds. Will release after: 16.0 2024-09-19T07:21:59.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:21:59 smithi179 ceph-mon[35716]: pgmap v339: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 KiB/s wr, 9 op/s 2024-09-19T07:21:59.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:21:59 smithi148 ceph-mon[31180]: pgmap v339: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 KiB/s wr, 9 op/s 2024-09-19T07:21:59.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:21:59 smithi165 ceph-mon[35326]: pgmap v339: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 KiB/s wr, 9 op/s 2024-09-19T07:22:01.523 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:22:01 smithi179 ceph-mon[35716]: pgmap v340: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 KiB/s wr, 9 op/s 2024-09-19T07:22:01.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:22:01 smithi148 ceph-mon[31180]: pgmap v340: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 KiB/s wr, 9 op/s 2024-09-19T07:22:01.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:22:01 smithi165 ceph-mon[35326]: pgmap v340: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 KiB/s wr, 9 op/s 2024-09-19T07:22:03.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:22:03 smithi179 ceph-mon[35716]: pgmap v341: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 12 op/s 2024-09-19T07:22:03.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:22:03 smithi148 ceph-mon[31180]: pgmap v341: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 12 op/s 2024-09-19T07:22:03.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:22:03 smithi165 ceph-mon[35326]: pgmap v341: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 12 op/s 2024-09-19T07:22:04.588 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.587+0000 7fdc5d38f640 1 -- 172.21.15.148:0/1743146095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc581069e0 msgr2=0x7fdc58106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:04.589 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.587+0000 7fdc5d38f640 1 --2- 172.21.15.148:0/1743146095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc581069e0 0x7fdc58106dc0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fdc48009930 tx=0x7fdc4802a420 comp rx=0 tx=0).stop 2024-09-19T07:22:04.589 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.587+0000 7fdc5d38f640 1 -- 172.21.15.148:0/1743146095 shutdown_connections 2024-09-19T07:22:04.589 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.587+0000 7fdc5d38f640 1 --2- 172.21.15.148:0/1743146095 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc58101370 0x7fdc5810d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:04.589 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.587+0000 7fdc5d38f640 1 --2- 172.21.15.148:0/1743146095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc581009d0 0x7fdc58100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:04.589 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.587+0000 7fdc5d38f640 1 --2- 172.21.15.148:0/1743146095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc581069e0 0x7fdc58106dc0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:04.589 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.587+0000 7fdc5d38f640 1 -- 172.21.15.148:0/1743146095 >> 172.21.15.148:0/1743146095 conn(0x7fdc580fc6f0 msgr2=0x7fdc580feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:04.589 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.587+0000 7fdc5d38f640 1 -- 172.21.15.148:0/1743146095 shutdown_connections 2024-09-19T07:22:04.589 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.587+0000 7fdc5d38f640 1 -- 172.21.15.148:0/1743146095 wait complete. 2024-09-19T07:22:04.589 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.588+0000 7fdc5d38f640 1 Processor -- start 2024-09-19T07:22:04.591 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.588+0000 7fdc5d38f640 1 -- start start 2024-09-19T07:22:04.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.588+0000 7fdc5d38f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc581009d0 0x7fdc58197290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:04.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.588+0000 7fdc5d38f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc58101370 0x7fdc581977d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:04.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.589+0000 7fdc5d38f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc581069e0 0x7fdc5819bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:04.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.589+0000 7fdc5d38f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdc58110e20 con 0x7fdc581009d0 2024-09-19T07:22:04.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.589+0000 7fdc5d38f640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdc58110ca0 con 0x7fdc581069e0 2024-09-19T07:22:04.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.589+0000 7fdc5d38f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdc58110fa0 con 0x7fdc58101370 2024-09-19T07:22:04.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.589+0000 7fdc56ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc581009d0 0x7fdc58197290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:04.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.589+0000 7fdc56ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc581009d0 0x7fdc58197290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56770/0 (socket says 172.21.15.148:56770) 2024-09-19T07:22:04.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.589+0000 7fdc56ffd640 1 -- 172.21.15.148:0/2506144538 learned_addr learned my addr 172.21.15.148:0/2506144538 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:22:04.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.589+0000 7fdc577fe640 1 --2- 172.21.15.148:0/2506144538 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc581069e0 0x7fdc5819bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:04.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.589+0000 7fdc56ffd640 1 -- 172.21.15.148:0/2506144538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc58101370 msgr2=0x7fdc581977d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:04.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.589+0000 7fdc567fc640 1 --2- 172.21.15.148:0/2506144538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc58101370 0x7fdc581977d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:04.593 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.589+0000 7fdc56ffd640 1 --2- 172.21.15.148:0/2506144538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc58101370 0x7fdc581977d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:04.593 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.589+0000 7fdc56ffd640 1 -- 172.21.15.148:0/2506144538 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc581069e0 msgr2=0x7fdc5819bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:04.593 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.589+0000 7fdc56ffd640 1 --2- 172.21.15.148:0/2506144538 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc581069e0 0x7fdc5819bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:04.593 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.589+0000 7fdc56ffd640 1 -- 172.21.15.148:0/2506144538 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc5819c280 con 0x7fdc581009d0 2024-09-19T07:22:04.593 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.589+0000 7fdc577fe640 1 --2- 172.21.15.148:0/2506144538 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc581069e0 0x7fdc5819bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:22:04.593 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.589+0000 7fdc567fc640 1 --2- 172.21.15.148:0/2506144538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc58101370 0x7fdc581977d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:22:04.593 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.589+0000 7fdc56ffd640 1 --2- 172.21.15.148:0/2506144538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc581009d0 0x7fdc58197290 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fdc48009230 tx=0x7fdc48004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:04.593 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.589+0000 7fdc3ffff640 1 -- 172.21.15.148:0/2506144538 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4803f030 con 0x7fdc581009d0 2024-09-19T07:22:04.593 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.589+0000 7fdc3ffff640 1 -- 172.21.15.148:0/2506144538 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc48003ad0 con 0x7fdc581009d0 2024-09-19T07:22:04.593 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.589+0000 7fdc5d38f640 1 -- 172.21.15.148:0/2506144538 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc5819c510 con 0x7fdc581009d0 2024-09-19T07:22:04.593 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.589+0000 7fdc3ffff640 1 -- 172.21.15.148:0/2506144538 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc48035070 con 0x7fdc581009d0 2024-09-19T07:22:04.593 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.589+0000 7fdc5d38f640 1 -- 172.21.15.148:0/2506144538 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc581a3e00 con 0x7fdc581009d0 2024-09-19T07:22:04.600 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.592+0000 7fdc3ffff640 1 -- 172.21.15.148:0/2506144538 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fdc48042030 con 0x7fdc581009d0 2024-09-19T07:22:04.600 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.592+0000 7fdc601ff740 1 Processor -- start 2024-09-19T07:22:04.600 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.592+0000 7fdc601ff740 1 -- start start 2024-09-19T07:22:04.600 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.592+0000 7fdc3ffff640 1 --2- 172.21.15.148:0/2506144538 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fdc400a3460 0x7fdc400a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:04.600 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.592+0000 7fdc601ff740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56155f664af0 0x56155f664ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:04.600 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.592+0000 7fdc601ff740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56155f665410 0x56155f66f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:04.600 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.592+0000 7fdc601ff740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56155f66fcb0 0x56155f6720a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:04.600 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.592+0000 7fdc601ff740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56155f5c92f0 con 0x56155f66fcb0 2024-09-19T07:22:04.601 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.592+0000 7fdc601ff740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56155f571270 con 0x56155f664af0 2024-09-19T07:22:04.601 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.592+0000 7fdc601ff740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56155f5c52b0 con 0x56155f665410 2024-09-19T07:22:04.601 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.593+0000 7fdc577fe640 1 --2- 172.21.15.148:0/2506144538 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fdc400a3460 0x7fdc400a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:04.601 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.593+0000 7fdc3ffff640 1 -- 172.21.15.148:0/2506144538 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8556+0+0 (secure 0 0 0) 0x7fdc480efff0 con 0x7fdc581009d0 2024-09-19T07:22:04.601 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.593+0000 7fdc577fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56155f66fcb0 0x56155f6720a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:04.601 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.593+0000 7fdc577fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56155f66fcb0 0x56155f6720a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56784/0 (socket says 172.21.15.148:56784) 2024-09-19T07:22:04.601 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.593+0000 7fdc577fe640 1 -- 172.21.15.148:0/3811559484 learned_addr learned my addr 172.21.15.148:0/3811559484 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:22:04.601 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.593+0000 7fdc56ffd640 1 --2- 172.21.15.148:0/3811559484 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56155f664af0 0x56155f664ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:04.601 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.593+0000 7fdc567fc640 1 --2- 172.21.15.148:0/3811559484 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56155f665410 0x56155f66f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:04.601 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.593+0000 7fdc577fe640 1 -- 172.21.15.148:0/3811559484 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56155f665410 msgr2=0x56155f66f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:04.601 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.593+0000 7fdc577fe640 1 --2- 172.21.15.148:0/3811559484 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56155f665410 0x56155f66f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:04.601 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.593+0000 7fdc577fe640 1 -- 172.21.15.148:0/3811559484 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56155f664af0 msgr2=0x56155f664ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:04.601 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.593+0000 7fdc577fe640 1 --2- 172.21.15.148:0/3811559484 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56155f664af0 0x56155f664ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:04.602 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.593+0000 7fdc577fe640 1 -- 172.21.15.148:0/3811559484 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56155f570340 con 0x56155f66fcb0 2024-09-19T07:22:04.602 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.593+0000 7fdc577fe640 1 --2- 172.21.15.148:0/2506144538 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fdc400a3460 0x7fdc400a5920 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdc50009fd0 tx=0x7fdc50009d80 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:04.602 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.593+0000 7fdc577fe640 1 --2- 172.21.15.148:0/3811559484 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56155f66fcb0 0x56155f6720a0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fdc50010cd0 tx=0x7fdc5001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf629ddee94e24ad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:04.602 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.593+0000 7fdc3d7fa640 1 -- 172.21.15.148:0/3811559484 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc50021070 con 0x56155f66fcb0 2024-09-19T07:22:04.602 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.593+0000 7fdc3d7fa640 1 -- 172.21.15.148:0/3811559484 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc5000ebf0 con 0x56155f66fcb0 2024-09-19T07:22:04.602 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.593+0000 7fdc3d7fa640 1 -- 172.21.15.148:0/3811559484 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc50005750 con 0x56155f66fcb0 2024-09-19T07:22:04.602 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.594+0000 7fdc601ff740 1 -- 172.21.15.148:0/3811559484 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56155f66fcb0 msgr2=0x56155f6720a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:04.602 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.594+0000 7fdc601ff740 1 --2- 172.21.15.148:0/3811559484 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56155f66fcb0 0x56155f6720a0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fdc50010cd0 tx=0x7fdc5001a000 comp rx=0 tx=0).stop 2024-09-19T07:22:04.602 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.594+0000 7fdc601ff740 1 -- 172.21.15.148:0/3811559484 shutdown_connections 2024-09-19T07:22:04.602 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.594+0000 7fdc601ff740 1 --2- 172.21.15.148:0/3811559484 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56155f66fcb0 0x56155f6720a0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:04.603 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.594+0000 7fdc601ff740 1 --2- 172.21.15.148:0/3811559484 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56155f665410 0x56155f66f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:04.603 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.594+0000 7fdc601ff740 1 --2- 172.21.15.148:0/3811559484 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56155f664af0 0x56155f664ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:04.603 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.594+0000 7fdc601ff740 1 -- 172.21.15.148:0/3811559484 >> 172.21.15.148:0/3811559484 conn(0x56155f661060 msgr2=0x56155f661440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:04.603 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.594+0000 7fdc601ff740 1 -- 172.21.15.148:0/3811559484 shutdown_connections 2024-09-19T07:22:04.603 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.594+0000 7fdc601ff740 1 -- 172.21.15.148:0/3811559484 wait complete. 2024-09-19T07:22:04.603 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.594+0000 7fdc601ff740 1 -- start start 2024-09-19T07:22:04.603 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.595+0000 7fdc601ff740 1 Processor -- start 2024-09-19T07:22:04.603 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.595+0000 7fdc601ff740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56155f664af0 0x56155f66cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:04.603 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.595+0000 7fdc601ff740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56155f665410 0x56155f66d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:04.603 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.595+0000 7fdc601ff740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56155f66fcb0 0x56155f66d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:04.603 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.595+0000 7fdc601ff740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56155f672880 con 0x56155f66fcb0 2024-09-19T07:22:04.603 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.595+0000 7fdc601ff740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56155f552290 con 0x56155f664af0 2024-09-19T07:22:04.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.595+0000 7fdc601ff740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56155f672a00 con 0x56155f665410 2024-09-19T07:22:04.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.595+0000 7fdc601ff740 10 client.0 _ll_register_callbacks cb 0x56155f583140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:22:04.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.595+0000 7fdc577fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56155f66fcb0 0x56155f66d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:04.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.595+0000 7fdc577fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56155f66fcb0 0x56155f66d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56800/0 (socket says 172.21.15.148:56800) 2024-09-19T07:22:04.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.595+0000 7fdc577fe640 1 -- 172.21.15.148:0/4045149333 learned_addr learned my addr 172.21.15.148:0/4045149333 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:22:04.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.595+0000 7fdc567fc640 1 --2- 172.21.15.148:0/4045149333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56155f665410 0x56155f66d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:04.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.595+0000 7fdc56ffd640 1 --2- 172.21.15.148:0/4045149333 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56155f664af0 0x56155f66cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:04.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.595+0000 7fdc577fe640 1 -- 172.21.15.148:0/4045149333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56155f665410 msgr2=0x56155f66d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:04.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.595+0000 7fdc577fe640 1 --2- 172.21.15.148:0/4045149333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56155f665410 0x56155f66d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:04.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.595+0000 7fdc577fe640 1 -- 172.21.15.148:0/4045149333 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56155f664af0 msgr2=0x56155f66cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:04.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.595+0000 7fdc577fe640 1 --2- 172.21.15.148:0/4045149333 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56155f664af0 0x56155f66cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:04.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.595+0000 7fdc577fe640 1 -- 172.21.15.148:0/4045149333 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56155f2dc210 con 0x56155f66fcb0 2024-09-19T07:22:04.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.595+0000 7fdc577fe640 1 --2- 172.21.15.148:0/4045149333 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56155f66fcb0 0x56155f66d630 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fdc500053b0 tx=0x7fdc5000efd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10402fc10afde31c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:04.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.595+0000 7fdc3aff5640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:22:04.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.596+0000 7fdc3aff5640 1 -- 172.21.15.148:0/4045149333 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc50021040 con 0x56155f66fcb0 2024-09-19T07:22:04.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.596+0000 7fdc3aff5640 1 -- 172.21.15.148:0/4045149333 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8556+0+0 (secure 0 0 0) 0x7fdc50010dc0 con 0x56155f66fcb0 2024-09-19T07:22:04.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.596+0000 7fdc601ff740 1 -- 172.21.15.148:0/4045149333 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc5000ebf0 con 0x56155f66fcb0 2024-09-19T07:22:04.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.596+0000 7fdc3aff5640 1 -- 172.21.15.148:0/4045149333 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fdc50009a90 con 0x56155f66fcb0 2024-09-19T07:22:04.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.596+0000 7fdc601ff740 10 client.17112 fetch_fsmap learned FSMap version 43 2024-09-19T07:22:04.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.596+0000 7fdc601ff740 1 -- 172.21.15.148:0/4045149333 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x56155f3a8620 con 0x56155f66fcb0 2024-09-19T07:22:04.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.596+0000 7fdc3aff5640 1 -- 172.21.15.148:0/4045149333 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc5000ebf0 con 0x56155f66fcb0 2024-09-19T07:22:04.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.596+0000 7fdc3aff5640 1 -- 172.21.15.148:0/4045149333 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 43) ==== 8362+0+0 (secure 0 0 0) 0x7fdc50035030 con 0x56155f66fcb0 2024-09-19T07:22:04.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.596+0000 7fdc601ff740 10 client.17112 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T07:22:04.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.596+0000 7fdc601ff740 10 client.17112 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:22:04.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.596+0000 7fdc601ff740 20 client.17112 populate_metadata read hostname 'smithi148' 2024-09-19T07:22:04.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.596+0000 7fdc601ff740 1 --2- 172.21.15.148:0/4045149333 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56155f67fbf0 0x56155f681fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:04.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.596+0000 7fdc601ff740 4 client.17112 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:22:04.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.596+0000 7fdc601ff740 1 -- 172.21.15.148:0/4045149333 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56155f5d6a20 con 0x56155f67fbf0 2024-09-19T07:22:04.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.596+0000 7fdc56ffd640 1 --2- 172.21.15.148:0/4045149333 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56155f67fbf0 0x56155f681fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:04.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.597+0000 7fdc3aff5640 10 client.17112 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:22:04.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.597+0000 7fdc56ffd640 1 --2- 172.21.15.148:0/4045149333 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56155f67fbf0 0x56155f681fe0 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a140a9feb3ca74e server_cookie=814a1a5ccaeb4466 in_seq=0 out_seq=0 2024-09-19T07:22:04.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.598+0000 7fdc3aff5640 1 -- 172.21.15.148:0/4045149333 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56155f5d6a20 con 0x56155f67fbf0 2024-09-19T07:22:04.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.598+0000 7fdc3aff5640 10 client.17112 handle_command_reply: tid=0 2024-09-19T07:22:04.607 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.598+0000 7fdc601ff740 1 client.17112 shutdown 2024-09-19T07:22:04.607 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.598+0000 7fdc601ff740 1 -- 172.21.15.148:0/4045149333 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56155f66fcb0 msgr2=0x56155f66d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:04.607 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.598+0000 7fdc601ff740 1 --2- 172.21.15.148:0/4045149333 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56155f66fcb0 0x56155f66d630 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fdc500053b0 tx=0x7fdc5000efd0 comp rx=0 tx=0).stop 2024-09-19T07:22:04.607 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.598+0000 7fdc601ff740 1 -- 172.21.15.148:0/4045149333 shutdown_connections 2024-09-19T07:22:04.607 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.598+0000 7fdc601ff740 1 --2- 172.21.15.148:0/4045149333 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56155f67fbf0 0x56155f681fe0 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:04.607 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.598+0000 7fdc601ff740 1 --2- 172.21.15.148:0/4045149333 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56155f66fcb0 0x56155f66d630 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:04.607 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.598+0000 7fdc601ff740 1 --2- 172.21.15.148:0/4045149333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56155f665410 0x56155f66d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:04.607 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.598+0000 7fdc3aff5640 0 client.17112 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:22:04.607 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.598+0000 7fdc601ff740 1 --2- 172.21.15.148:0/4045149333 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56155f664af0 0x56155f66cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:04.607 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.598+0000 7fdc601ff740 1 -- 172.21.15.148:0/4045149333 >> 172.21.15.148:0/4045149333 conn(0x56155f661060 msgr2=0x56155f666dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:04.607 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.598+0000 7fdc601ff740 1 -- 172.21.15.148:0/4045149333 shutdown_connections 2024-09-19T07:22:04.607 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.598+0000 7fdc601ff740 1 -- 172.21.15.148:0/4045149333 wait complete. 2024-09-19T07:22:04.607 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.598+0000 7fdc601ff740 20 client.17112 trim_cache size 0 max 16384 2024-09-19T07:22:04.617 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.612+0000 7fdc601ff740 1 Processor -- start 2024-09-19T07:22:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.612+0000 7fdc601ff740 1 -- start start 2024-09-19T07:22:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.612+0000 7fdc601ff740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56155f664af0 0x56155f66d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.612+0000 7fdc601ff740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56155f665410 0x56155f6600b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.612+0000 7fdc601ff740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56155f66fcb0 0x56155f677f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.612+0000 7fdc601ff740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdc581af0b0 con 0x56155f66fcb0 2024-09-19T07:22:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.612+0000 7fdc601ff740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdc581ac920 con 0x56155f665410 2024-09-19T07:22:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.612+0000 7fdc601ff740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdc581aa770 con 0x56155f664af0 2024-09-19T07:22:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.613+0000 7fdc577fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56155f66fcb0 0x56155f677f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.613+0000 7fdc577fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56155f66fcb0 0x56155f677f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56806/0 (socket says 172.21.15.148:56806) 2024-09-19T07:22:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.613+0000 7fdc577fe640 1 -- 172.21.15.148:0/3767564482 learned_addr learned my addr 172.21.15.148:0/3767564482 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:22:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.613+0000 7fdc567fc640 1 --2- 172.21.15.148:0/3767564482 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56155f665410 0x56155f6600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.613+0000 7fdc577fe640 1 -- 172.21.15.148:0/3767564482 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56155f664af0 msgr2=0x56155f66d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.613+0000 7fdc577fe640 1 --2- 172.21.15.148:0/3767564482 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56155f664af0 0x56155f66d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.613+0000 7fdc577fe640 1 -- 172.21.15.148:0/3767564482 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56155f665410 msgr2=0x56155f6600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.613+0000 7fdc577fe640 1 --2- 172.21.15.148:0/3767564482 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56155f665410 0x56155f6600b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.613+0000 7fdc577fe640 1 -- 172.21.15.148:0/3767564482 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56155f66b0e0 con 0x56155f66fcb0 2024-09-19T07:22:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.613+0000 7fdc577fe640 1 --2- 172.21.15.148:0/3767564482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56155f66fcb0 0x56155f677f00 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fdc50009980 tx=0x7fdc50013690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=257ce3ac3e9b7d78 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.613+0000 7fdc3cff9640 1 -- 172.21.15.148:0/3767564482 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc50021070 con 0x56155f66fcb0 2024-09-19T07:22:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.613+0000 7fdc3cff9640 1 -- 172.21.15.148:0/3767564482 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc50010dc0 con 0x56155f66fcb0 2024-09-19T07:22:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.613+0000 7fdc3cff9640 1 -- 172.21.15.148:0/3767564482 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc50003bd0 con 0x56155f66fcb0 2024-09-19T07:22:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.614+0000 7fdc601ff740 1 -- 172.21.15.148:0/3767564482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56155f66fcb0 msgr2=0x56155f677f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:04.620 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.614+0000 7fdc601ff740 1 --2- 172.21.15.148:0/3767564482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56155f66fcb0 0x56155f677f00 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fdc50009980 tx=0x7fdc50013690 comp rx=0 tx=0).stop 2024-09-19T07:22:04.620 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.614+0000 7fdc601ff740 1 -- 172.21.15.148:0/3767564482 shutdown_connections 2024-09-19T07:22:04.620 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.614+0000 7fdc601ff740 1 --2- 172.21.15.148:0/3767564482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56155f66fcb0 0x56155f677f00 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:04.620 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.614+0000 7fdc601ff740 1 --2- 172.21.15.148:0/3767564482 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56155f665410 0x56155f6600b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:04.620 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.614+0000 7fdc601ff740 1 --2- 172.21.15.148:0/3767564482 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56155f664af0 0x56155f66d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:04.620 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.614+0000 7fdc601ff740 1 -- 172.21.15.148:0/3767564482 >> 172.21.15.148:0/3767564482 conn(0x56155f661060 msgr2=0x56155f65f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:04.620 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.614+0000 7fdc601ff740 1 -- 172.21.15.148:0/3767564482 shutdown_connections 2024-09-19T07:22:04.620 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.614+0000 7fdc601ff740 1 -- 172.21.15.148:0/3767564482 wait complete. 2024-09-19T07:22:04.620 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.614+0000 7fdc601ff740 1 -- start start 2024-09-19T07:22:04.620 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.614+0000 7fdc601ff740 1 Processor -- start 2024-09-19T07:22:04.620 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.614+0000 7fdc601ff740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56155f664af0 0x56155f672aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:04.620 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.614+0000 7fdc601ff740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56155f665410 0x56155f672fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.614+0000 7fdc601ff740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56155f66fcb0 0x56155f673520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.614+0000 7fdc601ff740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdc581aade0 con 0x56155f66fcb0 2024-09-19T07:22:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.614+0000 7fdc601ff740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdc581ac250 con 0x56155f664af0 2024-09-19T07:22:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.614+0000 7fdc601ff740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdc581ab4b0 con 0x56155f665410 2024-09-19T07:22:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.614+0000 7fdc601ff740 10 client.0 _ll_register_callbacks cb 0x7fdc480b84f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:22:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.615+0000 7fdc577fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56155f66fcb0 0x56155f673520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.615+0000 7fdc577fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56155f66fcb0 0x56155f673520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56810/0 (socket says 172.21.15.148:56810) 2024-09-19T07:22:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.615+0000 7fdc577fe640 1 -- 172.21.15.148:0/2673423009 learned_addr learned my addr 172.21.15.148:0/2673423009 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:22:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.615+0000 7fdc567fc640 1 --2- 172.21.15.148:0/2673423009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56155f665410 0x56155f672fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.615+0000 7fdc56ffd640 1 --2- 172.21.15.148:0/2673423009 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56155f664af0 0x56155f672aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.615+0000 7fdc577fe640 1 -- 172.21.15.148:0/2673423009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56155f665410 msgr2=0x56155f672fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.615+0000 7fdc577fe640 1 --2- 172.21.15.148:0/2673423009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56155f665410 0x56155f672fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.615+0000 7fdc577fe640 1 -- 172.21.15.148:0/2673423009 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56155f664af0 msgr2=0x56155f672aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.615+0000 7fdc577fe640 1 --2- 172.21.15.148:0/2673423009 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56155f664af0 0x56155f672aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:04.622 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.615+0000 7fdc577fe640 1 -- 172.21.15.148:0/2673423009 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56155f6eb6d0 con 0x56155f66fcb0 2024-09-19T07:22:04.622 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.615+0000 7fdc56ffd640 1 --2- 172.21.15.148:0/2673423009 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56155f664af0 0x56155f672aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:22:04.622 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.615+0000 7fdc577fe640 1 --2- 172.21.15.148:0/2673423009 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56155f66fcb0 0x56155f673520 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fdc50003ef0 tx=0x7fdc50005790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62fd53f73f33582e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:04.622 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.615+0000 7fdc3aff5640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:22:04.622 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.615+0000 7fdc3aff5640 1 -- 172.21.15.148:0/2673423009 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc50021040 con 0x56155f66fcb0 2024-09-19T07:22:04.622 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.615+0000 7fdc3aff5640 1 -- 172.21.15.148:0/2673423009 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8556+0+0 (secure 0 0 0) 0x7fdc50025410 con 0x56155f66fcb0 2024-09-19T07:22:04.622 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.615+0000 7fdc601ff740 1 -- 172.21.15.148:0/2673423009 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc50010dc0 con 0x56155f66fcb0 2024-09-19T07:22:04.622 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.615+0000 7fdc3aff5640 1 -- 172.21.15.148:0/2673423009 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fdc50025610 con 0x56155f66fcb0 2024-09-19T07:22:04.622 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.615+0000 7fdc601ff740 10 client.17118 fetch_fsmap learned FSMap version 43 2024-09-19T07:22:04.622 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.615+0000 7fdc601ff740 1 -- 172.21.15.148:0/2673423009 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x56155f6ec9c0 con 0x56155f66fcb0 2024-09-19T07:22:04.622 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.615+0000 7fdc3aff5640 1 -- 172.21.15.148:0/2673423009 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc50010dc0 con 0x56155f66fcb0 2024-09-19T07:22:04.622 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.616+0000 7fdc3aff5640 1 -- 172.21.15.148:0/2673423009 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 43) ==== 8362+0+0 (secure 0 0 0) 0x7fdc50046030 con 0x56155f66fcb0 2024-09-19T07:22:04.622 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.616+0000 7fdc601ff740 10 client.17118 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T07:22:04.622 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.616+0000 7fdc601ff740 10 client.17118 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:22:04.623 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.616+0000 7fdc601ff740 20 client.17118 populate_metadata read hostname 'smithi148' 2024-09-19T07:22:04.623 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.616+0000 7fdc601ff740 1 --2- 172.21.15.148:0/2673423009 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56155f6eceb0 0x56155f6ef2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:04.623 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.616+0000 7fdc601ff740 4 client.17118 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:22:04.623 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.616+0000 7fdc601ff740 1 -- 172.21.15.148:0/2673423009 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56155f5d0d70 con 0x56155f6eceb0 2024-09-19T07:22:04.623 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.616+0000 7fdc56ffd640 1 --2- 172.21.15.148:0/2673423009 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56155f6eceb0 0x56155f6ef2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:04.623 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.616+0000 7fdc56ffd640 1 --2- 172.21.15.148:0/2673423009 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56155f6eceb0 0x56155f6ef2d0 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c72f19d4ade3155 server_cookie=9dd9f5ac29bab6d3 in_seq=0 out_seq=0 2024-09-19T07:22:04.623 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.616+0000 7fdc3aff5640 10 client.17118 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:22:04.631 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.630+0000 7fdc3aff5640 1 -- 172.21.15.148:0/2673423009 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56155f5d0d70 con 0x56155f6eceb0 2024-09-19T07:22:04.631 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.630+0000 7fdc3aff5640 10 client.17118 handle_command_reply: tid=0 2024-09-19T07:22:04.631 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.630+0000 7fdc601ff740 1 client.17118 shutdown 2024-09-19T07:22:04.631 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.630+0000 7fdc601ff740 1 -- 172.21.15.148:0/2673423009 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56155f66fcb0 msgr2=0x56155f673520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:04.631 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.630+0000 7fdc601ff740 1 --2- 172.21.15.148:0/2673423009 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56155f66fcb0 0x56155f673520 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fdc50003ef0 tx=0x7fdc50005790 comp rx=0 tx=0).stop 2024-09-19T07:22:04.631 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.630+0000 7fdc601ff740 1 -- 172.21.15.148:0/2673423009 shutdown_connections 2024-09-19T07:22:04.631 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.630+0000 7fdc601ff740 1 --2- 172.21.15.148:0/2673423009 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56155f6eceb0 0x56155f6ef2d0 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:04.631 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.630+0000 7fdc601ff740 1 --2- 172.21.15.148:0/2673423009 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56155f66fcb0 0x56155f673520 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:04.631 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.630+0000 7fdc601ff740 1 --2- 172.21.15.148:0/2673423009 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56155f665410 0x56155f672fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:04.631 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.630+0000 7fdc3aff5640 0 client.17118 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:22:04.631 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.630+0000 7fdc601ff740 1 --2- 172.21.15.148:0/2673423009 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56155f664af0 0x56155f672aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.630+0000 7fdc601ff740 1 -- 172.21.15.148:0/2673423009 >> 172.21.15.148:0/2673423009 conn(0x56155f661060 msgr2=0x56155f6601c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.630+0000 7fdc601ff740 1 -- 172.21.15.148:0/2673423009 shutdown_connections 2024-09-19T07:22:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.630+0000 7fdc601ff740 1 -- 172.21.15.148:0/2673423009 wait complete. 2024-09-19T07:22:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.630+0000 7fdc601ff740 20 client.17118 trim_cache size 0 max 16384 2024-09-19T07:22:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:22:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:22:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:22:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:22:04.633 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.630+0000 7fdc5d38f640 1 -- 172.21.15.148:0/2506144538 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fdc400a3460 msgr2=0x7fdc400a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:04.633 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.630+0000 7fdc5d38f640 1 --2- 172.21.15.148:0/2506144538 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fdc400a3460 0x7fdc400a5920 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdc50009fd0 tx=0x7fdc50009d80 comp rx=0 tx=0).stop 2024-09-19T07:22:04.633 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.630+0000 7fdc5d38f640 1 -- 172.21.15.148:0/2506144538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc581009d0 msgr2=0x7fdc58197290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:04.633 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.630+0000 7fdc5d38f640 1 --2- 172.21.15.148:0/2506144538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc581009d0 0x7fdc58197290 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fdc48009230 tx=0x7fdc48004270 comp rx=0 tx=0).stop 2024-09-19T07:22:04.633 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.631+0000 7fdc5d38f640 1 -- 172.21.15.148:0/2506144538 shutdown_connections 2024-09-19T07:22:04.634 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.631+0000 7fdc5d38f640 1 --2- 172.21.15.148:0/2506144538 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fdc400a3460 0x7fdc400a5920 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:04.634 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.631+0000 7fdc5d38f640 1 --2- 172.21.15.148:0/2506144538 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc581069e0 0x7fdc5819bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:04.634 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.631+0000 7fdc5d38f640 1 --2- 172.21.15.148:0/2506144538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc58101370 0x7fdc581977d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:04.634 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.631+0000 7fdc5d38f640 1 --2- 172.21.15.148:0/2506144538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc581009d0 0x7fdc58197290 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:04.634 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.631+0000 7fdc5d38f640 1 -- 172.21.15.148:0/2506144538 >> 172.21.15.148:0/2506144538 conn(0x7fdc580fc6f0 msgr2=0x7fdc580fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:04.634 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.631+0000 7fdc5d38f640 1 -- 172.21.15.148:0/2506144538 shutdown_connections 2024-09-19T07:22:04.634 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:04.631+0000 7fdc5d38f640 1 -- 172.21.15.148:0/2506144538 wait complete. 2024-09-19T07:22:05.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:22:05 smithi179 ceph-mon[35716]: pgmap v342: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 9 op/s 2024-09-19T07:22:05.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:22:05 smithi148 ceph-mon[31180]: pgmap v342: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 9 op/s 2024-09-19T07:22:05.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:22:05 smithi165 ceph-mon[35326]: pgmap v342: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 9 op/s 2024-09-19T07:22:07.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:22:07 smithi148 ceph-mon[31180]: pgmap v343: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 55 KiB/s wr, 29 op/s 2024-09-19T07:22:07.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:22:07 smithi148 ceph-mon[31180]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T07:22:07.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:22:07 smithi165 ceph-mon[35326]: pgmap v343: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 55 KiB/s wr, 29 op/s 2024-09-19T07:22:07.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:22:07 smithi165 ceph-mon[35326]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T07:22:07.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:22:07 smithi179 ceph-mon[35716]: pgmap v343: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 55 KiB/s wr, 29 op/s 2024-09-19T07:22:07.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:22:07 smithi179 ceph-mon[35716]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T07:22:09.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:22:09 smithi148 ceph-mon[31180]: pgmap v345: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 64 KiB/s wr, 29 op/s 2024-09-19T07:22:09.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:22:09 smithi165 ceph-mon[35326]: pgmap v345: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 64 KiB/s wr, 29 op/s 2024-09-19T07:22:09.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:22:09 smithi179 ceph-mon[35716]: pgmap v345: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 64 KiB/s wr, 29 op/s 2024-09-19T07:22:11.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:22:11 smithi148 ceph-mon[31180]: pgmap v346: 97 pgs: 4 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 82 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 69 KiB/s wr, 30 op/s 2024-09-19T07:22:11.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:22:11 smithi165 ceph-mon[35326]: pgmap v346: 97 pgs: 4 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 82 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 69 KiB/s wr, 30 op/s 2024-09-19T07:22:11.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:22:11 smithi179 ceph-mon[35716]: pgmap v346: 97 pgs: 4 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 82 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 69 KiB/s wr, 30 op/s 2024-09-19T07:22:13.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:22:13 smithi148 ceph-mon[31180]: pgmap v347: 97 pgs: 13 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 54 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-09-19T07:22:13.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:22:13 smithi165 ceph-mon[35326]: pgmap v347: 97 pgs: 13 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 54 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-09-19T07:22:13.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:22:13 smithi179 ceph-mon[35716]: pgmap v347: 97 pgs: 13 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 54 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 67 KiB/s wr, 30 op/s 2024-09-19T07:22:14.244 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:22:14.509 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:22:15.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.209+0000 7f4b8feba640 1 -- 172.21.15.148:0/2442989758 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b88102da0 msgr2=0x7f4b88103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:15.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.209+0000 7f4b8feba640 1 --2- 172.21.15.148:0/2442989758 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b88102da0 0x7f4b88103180 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f4b80009900 tx=0x7f4b8002a480 comp rx=0 tx=0).stop 2024-09-19T07:22:15.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.209+0000 7f4b8feba640 1 -- 172.21.15.148:0/2442989758 shutdown_connections 2024-09-19T07:22:15.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.209+0000 7f4b8feba640 1 --2- 172.21.15.148:0/2442989758 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b8810c180 0x7f4b8810e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:15.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.209+0000 7f4b8feba640 1 --2- 172.21.15.148:0/2442989758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b881036c0 0x7f4b8810bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:15.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.209+0000 7f4b8feba640 1 --2- 172.21.15.148:0/2442989758 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b88102da0 0x7f4b88103180 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:15.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.209+0000 7f4b8feba640 1 -- 172.21.15.148:0/2442989758 >> 172.21.15.148:0/2442989758 conn(0x7f4b880fc7a0 msgr2=0x7f4b880febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:15.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.209+0000 7f4b8feba640 1 -- 172.21.15.148:0/2442989758 shutdown_connections 2024-09-19T07:22:15.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.209+0000 7f4b8feba640 1 -- 172.21.15.148:0/2442989758 wait complete. 2024-09-19T07:22:15.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.210+0000 7f4b8feba640 1 Processor -- start 2024-09-19T07:22:15.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.210+0000 7f4b8feba640 1 -- start start 2024-09-19T07:22:15.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.210+0000 7f4b8feba640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b88102da0 0x7f4b881983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:15.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.210+0000 7f4b8feba640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b881036c0 0x7f4b88198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:15.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.210+0000 7f4b8feba640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b8810c180 0x7f4b8819cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:15.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.210+0000 7f4b8feba640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4b88111f60 con 0x7f4b881036c0 2024-09-19T07:22:15.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.210+0000 7f4b8feba640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4b88111de0 con 0x7f4b88102da0 2024-09-19T07:22:15.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.210+0000 7f4b8feba640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4b881120e0 con 0x7f4b8810c180 2024-09-19T07:22:15.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.210+0000 7f4b8d455640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b881036c0 0x7f4b88198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:15.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.210+0000 7f4b8d455640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b881036c0 0x7f4b88198900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47360/0 (socket says 172.21.15.148:47360) 2024-09-19T07:22:15.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.210+0000 7f4b8d455640 1 -- 172.21.15.148:0/4130725594 learned_addr learned my addr 172.21.15.148:0/4130725594 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:22:15.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.210+0000 7f4b8dc56640 1 --2- 172.21.15.148:0/4130725594 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b88102da0 0x7f4b881983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:15.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.210+0000 7f4b8e457640 1 --2- 172.21.15.148:0/4130725594 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b8810c180 0x7f4b8819cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:15.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.211+0000 7f4b8d455640 1 -- 172.21.15.148:0/4130725594 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b8810c180 msgr2=0x7f4b8819cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:15.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.211+0000 7f4b8d455640 1 --2- 172.21.15.148:0/4130725594 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b8810c180 0x7f4b8819cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:15.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.211+0000 7f4b8d455640 1 -- 172.21.15.148:0/4130725594 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b88102da0 msgr2=0x7f4b881983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:15.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.211+0000 7f4b8d455640 1 --2- 172.21.15.148:0/4130725594 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b88102da0 0x7f4b881983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:15.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.211+0000 7f4b8d455640 1 -- 172.21.15.148:0/4130725594 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b8819d370 con 0x7f4b881036c0 2024-09-19T07:22:15.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.211+0000 7f4b8e457640 1 --2- 172.21.15.148:0/4130725594 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b8810c180 0x7f4b8819cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:22:15.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.211+0000 7f4b8d455640 1 --2- 172.21.15.148:0/4130725594 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b881036c0 0x7f4b88198900 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c00c970 tx=0x7f4b7c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:15.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.211+0000 7f4b86ffd640 1 -- 172.21.15.148:0/4130725594 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c007bb0 con 0x7f4b881036c0 2024-09-19T07:22:15.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.211+0000 7f4b86ffd640 1 -- 172.21.15.148:0/4130725594 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b7c007d50 con 0x7f4b881036c0 2024-09-19T07:22:15.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.211+0000 7f4b8feba640 1 -- 172.21.15.148:0/4130725594 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b8819d660 con 0x7f4b881036c0 2024-09-19T07:22:15.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.211+0000 7f4b86ffd640 1 -- 172.21.15.148:0/4130725594 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c00f450 con 0x7f4b881036c0 2024-09-19T07:22:15.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.211+0000 7f4b8feba640 1 -- 172.21.15.148:0/4130725594 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b881a4f40 con 0x7f4b881036c0 2024-09-19T07:22:15.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.212+0000 7f4b8feba640 1 -- 172.21.15.148:0/4130725594 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b88103180 con 0x7f4b881036c0 2024-09-19T07:22:15.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.213+0000 7f4b86ffd640 1 -- 172.21.15.148:0/4130725594 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f4b7c004fe0 con 0x7f4b881036c0 2024-09-19T07:22:15.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.214+0000 7f4b86ffd640 1 --2- 172.21.15.148:0/4130725594 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f4b700a3430 0x7f4b700a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:15.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.214+0000 7f4b8dc56640 1 --2- 172.21.15.148:0/4130725594 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f4b700a3430 0x7f4b700a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:15.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.214+0000 7f4b86ffd640 1 -- 172.21.15.148:0/4130725594 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8600+0+0 (secure 0 0 0) 0x7f4b7c0cfec0 con 0x7f4b881036c0 2024-09-19T07:22:15.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.214+0000 7f4b8dc56640 1 --2- 172.21.15.148:0/4130725594 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f4b700a3430 0x7f4b700a58f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4b80000c00 tx=0x7f4b800058d0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:15.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.217+0000 7f4b86ffd640 1 -- 172.21.15.148:0/4130725594 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4b7c014030 con 0x7f4b881036c0 2024-09-19T07:22:15.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.421+0000 7f4b8feba640 1 -- 172.21.15.148:0/4130725594 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4b88199720 con 0x7f4b881036c0 2024-09-19T07:22:15.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.422+0000 7f4b86ffd640 1 -- 172.21.15.148:0/4130725594 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+11944 (secure 0 0 0) 0x7f4b88199720 con 0x7f4b881036c0 2024-09-19T07:22:15.424 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:22:15.424 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":43,"btime":"2024-09-19T07:20:20:209191+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/4263868576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":4263868576},{"type":"v1","addr":"172.21.15.148:6841","nonce":4263868576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":25606,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3891676893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3891676893},{"type":"v1","addr":"172.21.15.179:6835","nonce":3891676893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":43,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:09:19.543369+0000","modified":"2024-09-19T07:20:19.813692+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24457,"mds_1":24437,"mds_2":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":75,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":71,"addr":"172.21.15.165:6839/3993490234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":3993490234},{"type":"v1","addr":"172.21.15.165:6839","nonce":3993490234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25823":{"gid":25823,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6835/380886107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":380886107},{"type":"v1","addr":"172.21.15.165:6835","nonce":380886107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24457,"qdb_cluster":[24457,24437,24436]},"id":1}]} 2024-09-19T07:22:15.424 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 43 2024-09-19T07:22:15.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.424+0000 7f4b8feba640 1 -- 172.21.15.148:0/4130725594 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f4b700a3430 msgr2=0x7f4b700a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:15.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.424+0000 7f4b8feba640 1 --2- 172.21.15.148:0/4130725594 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f4b700a3430 0x7f4b700a58f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4b80000c00 tx=0x7f4b800058d0 comp rx=0 tx=0).stop 2024-09-19T07:22:15.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.424+0000 7f4b8feba640 1 -- 172.21.15.148:0/4130725594 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b881036c0 msgr2=0x7f4b88198900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:15.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.424+0000 7f4b8feba640 1 --2- 172.21.15.148:0/4130725594 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b881036c0 0x7f4b88198900 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c00c970 tx=0x7f4b7c00ce30 comp rx=0 tx=0).stop 2024-09-19T07:22:15.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.424+0000 7f4b8feba640 1 -- 172.21.15.148:0/4130725594 shutdown_connections 2024-09-19T07:22:15.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.424+0000 7f4b8feba640 1 --2- 172.21.15.148:0/4130725594 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f4b700a3430 0x7f4b700a58f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:15.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.424+0000 7f4b8feba640 1 --2- 172.21.15.148:0/4130725594 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b8810c180 0x7f4b8819cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:15.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.424+0000 7f4b8feba640 1 --2- 172.21.15.148:0/4130725594 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b881036c0 0x7f4b88198900 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:15.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.424+0000 7f4b8feba640 1 --2- 172.21.15.148:0/4130725594 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b88102da0 0x7f4b881983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:15.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.424+0000 7f4b8feba640 1 -- 172.21.15.148:0/4130725594 >> 172.21.15.148:0/4130725594 conn(0x7f4b880fc7a0 msgr2=0x7f4b880fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:15.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.424+0000 7f4b8feba640 1 -- 172.21.15.148:0/4130725594 shutdown_connections 2024-09-19T07:22:15.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:15.424+0000 7f4b8feba640 1 -- 172.21.15.148:0/4130725594 wait complete. 2024-09-19T07:22:15.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:22:15 smithi148 ceph-mon[31180]: pgmap v348: 97 pgs: 9 active+clean+snaptrim, 19 active+clean+snaptrim_wait, 69 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 65 KiB/s wr, 29 op/s 2024-09-19T07:22:15.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:22:15 smithi165 ceph-mon[35326]: pgmap v348: 97 pgs: 9 active+clean+snaptrim, 19 active+clean+snaptrim_wait, 69 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 65 KiB/s wr, 29 op/s 2024-09-19T07:22:15.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:22:15 smithi179 ceph-mon[35716]: pgmap v348: 97 pgs: 9 active+clean+snaptrim, 19 active+clean+snaptrim_wait, 69 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 65 KiB/s wr, 29 op/s 2024-09-19T07:22:16.075 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24457 quiesce db --set-id 8900e1a2 --release --await' 2024-09-19T07:22:16.076 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24457 quiesce db --set-id 8900e1a2 --release --await 2024-09-19T07:22:16.325 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:22:16.559 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:22:16 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/4130725594' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:22:16.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:22:16 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/4130725594' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:22:16.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:22:16 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/4130725594' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:22:16.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.768+0000 7f56dae0b640 1 -- 172.21.15.148:0/1649420298 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56d4101de0 msgr2=0x7f56d41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:16.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.768+0000 7f56dae0b640 1 --2- 172.21.15.148:0/1649420298 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56d4101de0 0x7f56d41021c0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f56c8009900 tx=0x7f56c802a410 comp rx=0 tx=0).stop 2024-09-19T07:22:16.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.768+0000 7f56dae0b640 1 -- 172.21.15.148:0/1649420298 shutdown_connections 2024-09-19T07:22:16.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.768+0000 7f56dae0b640 1 --2- 172.21.15.148:0/1649420298 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f56d4106f10 0x7f56d410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:16.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.768+0000 7f56dae0b640 1 --2- 172.21.15.148:0/1649420298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56d4102790 0x7f56d41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:16.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.768+0000 7f56dae0b640 1 --2- 172.21.15.148:0/1649420298 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56d4101de0 0x7f56d41021c0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:16.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.768+0000 7f56dae0b640 1 -- 172.21.15.148:0/1649420298 >> 172.21.15.148:0/1649420298 conn(0x7f56d40fd8c0 msgr2=0x7f56d40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:16.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.768+0000 7f56dae0b640 1 -- 172.21.15.148:0/1649420298 shutdown_connections 2024-09-19T07:22:16.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.768+0000 7f56dae0b640 1 -- 172.21.15.148:0/1649420298 wait complete. 2024-09-19T07:22:16.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.769+0000 7f56dae0b640 1 Processor -- start 2024-09-19T07:22:16.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.769+0000 7f56dae0b640 1 -- start start 2024-09-19T07:22:16.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.769+0000 7f56dae0b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f56d4101de0 0x7f56d40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:16.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.769+0000 7f56dae0b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56d4102790 0x7f56d4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:16.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.769+0000 7f56dae0b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56d4106f10 0x7f56d4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:16.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.769+0000 7f56dae0b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f56d4111f70 con 0x7f56d4102790 2024-09-19T07:22:16.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.769+0000 7f56dae0b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f56d4111df0 con 0x7f56d4101de0 2024-09-19T07:22:16.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.769+0000 7f56dae0b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f56d41120f0 con 0x7f56d4106f10 2024-09-19T07:22:16.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.769+0000 7f56d3fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56d4102790 0x7f56d4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:16.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.769+0000 7f56d3fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56d4102790 0x7f56d4074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47374/0 (socket says 172.21.15.148:47374) 2024-09-19T07:22:16.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.769+0000 7f56d3fff640 1 -- 172.21.15.148:0/2992860292 learned_addr learned my addr 172.21.15.148:0/2992860292 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:22:16.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.770+0000 7f56d8ba7640 1 --2- 172.21.15.148:0/2992860292 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f56d4101de0 0x7f56d40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:16.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.770+0000 7f56d3fff640 1 -- 172.21.15.148:0/2992860292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56d4106f10 msgr2=0x7f56d4074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:16.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.770+0000 7f56d93a8640 1 --2- 172.21.15.148:0/2992860292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56d4106f10 0x7f56d4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:16.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.770+0000 7f56d3fff640 1 --2- 172.21.15.148:0/2992860292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56d4106f10 0x7f56d4074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:16.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.770+0000 7f56d3fff640 1 -- 172.21.15.148:0/2992860292 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f56d4101de0 msgr2=0x7f56d40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:16.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.770+0000 7f56d3fff640 1 --2- 172.21.15.148:0/2992860292 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f56d4101de0 0x7f56d40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:16.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.770+0000 7f56d3fff640 1 -- 172.21.15.148:0/2992860292 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56d41a6890 con 0x7f56d4102790 2024-09-19T07:22:16.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.770+0000 7f56d8ba7640 1 --2- 172.21.15.148:0/2992860292 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f56d4101de0 0x7f56d40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:22:16.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.770+0000 7f56d93a8640 1 --2- 172.21.15.148:0/2992860292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56d4106f10 0x7f56d4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:22:16.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.770+0000 7f56d3fff640 1 --2- 172.21.15.148:0/2992860292 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56d4102790 0x7f56d4074a30 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f56c000d770 tx=0x7f56c000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:16.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.770+0000 7f56d1ffb640 1 -- 172.21.15.148:0/2992860292 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c0017070 con 0x7f56d4102790 2024-09-19T07:22:16.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.770+0000 7f56d1ffb640 1 -- 172.21.15.148:0/2992860292 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56c0005500 con 0x7f56d4102790 2024-09-19T07:22:16.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.770+0000 7f56dae0b640 1 -- 172.21.15.148:0/2992860292 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56d41a6b80 con 0x7f56d4102790 2024-09-19T07:22:16.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.770+0000 7f56d1ffb640 1 -- 172.21.15.148:0/2992860292 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c0004e00 con 0x7f56d4102790 2024-09-19T07:22:16.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.770+0000 7f56dae0b640 1 -- 172.21.15.148:0/2992860292 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56d41a7070 con 0x7f56d4102790 2024-09-19T07:22:16.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.773+0000 7f56d1ffb640 1 -- 172.21.15.148:0/2992860292 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f56c0004fa0 con 0x7f56d4102790 2024-09-19T07:22:16.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.773+0000 7f56dd1e4740 1 Processor -- start 2024-09-19T07:22:16.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.773+0000 7f56dd1e4740 1 -- start start 2024-09-19T07:22:16.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.773+0000 7f56dd1e4740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5596278c3060 0x5596278c3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:16.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.773+0000 7f56dd1e4740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5596278c3980 0x5596278cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:16.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.773+0000 7f56dd1e4740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596278ce240 0x5596278d0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:16.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.773+0000 7f56dd1e4740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x559627828620 con 0x5596278c3980 2024-09-19T07:22:16.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.773+0000 7f56dd1e4740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5596277cfe50 con 0x5596278c3060 2024-09-19T07:22:16.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.773+0000 7f56dd1e4740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5596278245e0 con 0x5596278ce240 2024-09-19T07:22:16.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.773+0000 7f56d1ffb640 1 --2- 172.21.15.148:0/2992860292 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f56c40a33b0 0x7f56c40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:16.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.773+0000 7f56d8ba7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5596278c3980 0x5596278cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:16.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.773+0000 7f56d8ba7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5596278c3980 0x5596278cdd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47380/0 (socket says 172.21.15.148:47380) 2024-09-19T07:22:16.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.773+0000 7f56d8ba7640 1 -- 172.21.15.148:0/1083635030 learned_addr learned my addr 172.21.15.148:0/1083635030 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:22:16.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.773+0000 7f56d93a8640 1 --2- 172.21.15.148:0/2992860292 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f56c40a33b0 0x7f56c40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:16.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.774+0000 7f56d1ffb640 1 -- 172.21.15.148:0/2992860292 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8600+0+0 (secure 0 0 0) 0x7f56c00cf8a0 con 0x7f56d4102790 2024-09-19T07:22:16.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.774+0000 7f56d93a8640 1 --2- 172.21.15.148:0/1083635030 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5596278c3060 0x5596278c3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:16.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.774+0000 7f56d8ba7640 1 -- 172.21.15.148:0/1083635030 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596278ce240 msgr2=0x5596278d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:16.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.774+0000 7f56d3fff640 1 --2- 172.21.15.148:0/1083635030 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596278ce240 0x5596278d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:16.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.774+0000 7f56d8ba7640 1 --2- 172.21.15.148:0/1083635030 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596278ce240 0x5596278d0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:16.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.774+0000 7f56d8ba7640 1 -- 172.21.15.148:0/1083635030 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5596278c3060 msgr2=0x5596278c3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:16.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.774+0000 7f56d8ba7640 1 --2- 172.21.15.148:0/1083635030 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5596278c3060 0x5596278c3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:16.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.774+0000 7f56d8ba7640 1 -- 172.21.15.148:0/1083635030 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596277c0d40 con 0x5596278c3980 2024-09-19T07:22:16.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.774+0000 7f56d3fff640 1 --2- 172.21.15.148:0/1083635030 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596278ce240 0x5596278d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:22:16.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.774+0000 7f56d8ba7640 1 --2- 172.21.15.148:0/1083635030 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5596278c3980 0x5596278cdd00 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f56c8031550 tx=0x7f56c8032cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd63d4d3f4c76473 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:16.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.774+0000 7f56d93a8640 1 --2- 172.21.15.148:0/2992860292 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f56c40a33b0 0x7f56c40a5870 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f56cc012790 tx=0x7f56cc00a380 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:16.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.774+0000 7f56beffd640 1 -- 172.21.15.148:0/1083635030 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c803f070 con 0x5596278c3980 2024-09-19T07:22:16.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.774+0000 7f56beffd640 1 -- 172.21.15.148:0/1083635030 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56c80317b0 con 0x5596278c3980 2024-09-19T07:22:16.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.774+0000 7f56beffd640 1 -- 172.21.15.148:0/1083635030 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c8035070 con 0x5596278c3980 2024-09-19T07:22:16.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.775+0000 7f56dd1e4740 1 -- 172.21.15.148:0/1083635030 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5596278c3980 msgr2=0x5596278cdd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:16.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.775+0000 7f56dd1e4740 1 --2- 172.21.15.148:0/1083635030 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5596278c3980 0x5596278cdd00 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f56c8031550 tx=0x7f56c8032cd0 comp rx=0 tx=0).stop 2024-09-19T07:22:16.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.775+0000 7f56dd1e4740 1 -- 172.21.15.148:0/1083635030 shutdown_connections 2024-09-19T07:22:16.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.775+0000 7f56dd1e4740 1 --2- 172.21.15.148:0/1083635030 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596278ce240 0x5596278d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:16.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.775+0000 7f56dd1e4740 1 --2- 172.21.15.148:0/1083635030 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5596278c3980 0x5596278cdd00 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:16.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.775+0000 7f56dd1e4740 1 --2- 172.21.15.148:0/1083635030 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5596278c3060 0x5596278c3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:16.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.775+0000 7f56dd1e4740 1 -- 172.21.15.148:0/1083635030 >> 172.21.15.148:0/1083635030 conn(0x5596278bf5f0 msgr2=0x5596278bf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:16.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.775+0000 7f56dd1e4740 1 -- 172.21.15.148:0/1083635030 shutdown_connections 2024-09-19T07:22:16.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.775+0000 7f56dd1e4740 1 -- 172.21.15.148:0/1083635030 wait complete. 2024-09-19T07:22:16.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.775+0000 7f56dd1e4740 1 -- start start 2024-09-19T07:22:16.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.775+0000 7f56dd1e4740 1 Processor -- start 2024-09-19T07:22:16.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.776+0000 7f56dd1e4740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5596278c3060 0x5596278cb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:16.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.776+0000 7f56dd1e4740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596278c3980 0x5596278cb620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:16.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.776+0000 7f56dd1e4740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5596278ce240 0x5596278cbb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:16.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.776+0000 7f56dd1e4740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5596278d0e10 con 0x5596278ce240 2024-09-19T07:22:16.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.776+0000 7f56dd1e4740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5596277b0f10 con 0x5596278c3060 2024-09-19T07:22:16.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.776+0000 7f56dd1e4740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5596278d0f90 con 0x5596278c3980 2024-09-19T07:22:16.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.776+0000 7f56dd1e4740 10 client.0 _ll_register_callbacks cb 0x5596277d4db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:22:16.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.776+0000 7f56d93a8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5596278ce240 0x5596278cbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:16.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.776+0000 7f56d93a8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5596278ce240 0x5596278cbb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47386/0 (socket says 172.21.15.148:47386) 2024-09-19T07:22:16.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.776+0000 7f56d93a8640 1 -- 172.21.15.148:0/1017400127 learned_addr learned my addr 172.21.15.148:0/1017400127 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:22:16.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.776+0000 7f56d3fff640 1 --2- 172.21.15.148:0/1017400127 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596278c3980 0x5596278cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:16.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.776+0000 7f56d8ba7640 1 --2- 172.21.15.148:0/1017400127 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5596278c3060 0x5596278cb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:16.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.776+0000 7f56d93a8640 1 -- 172.21.15.148:0/1017400127 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596278c3980 msgr2=0x5596278cb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:16.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.776+0000 7f56d93a8640 1 --2- 172.21.15.148:0/1017400127 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596278c3980 0x5596278cb620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:16.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.776+0000 7f56d93a8640 1 -- 172.21.15.148:0/1017400127 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5596278c3060 msgr2=0x5596278cb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:16.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.776+0000 7f56d93a8640 1 --2- 172.21.15.148:0/1017400127 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5596278c3060 0x5596278cb0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:16.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.776+0000 7f56d93a8640 1 -- 172.21.15.148:0/1017400127 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559627537580 con 0x5596278ce240 2024-09-19T07:22:16.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.776+0000 7f56d93a8640 1 --2- 172.21.15.148:0/1017400127 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5596278ce240 0x5596278cbb60 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f56cc012400 tx=0x7f56cc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84d74d5a92d3ff77 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:16.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.776+0000 7f56b3fff640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:22:16.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.776+0000 7f56b3fff640 1 -- 172.21.15.148:0/1017400127 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56cc011470 con 0x5596278ce240 2024-09-19T07:22:16.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.777+0000 7f56b3fff640 1 -- 172.21.15.148:0/1017400127 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8600+0+0 (secure 0 0 0) 0x7f56cc011610 con 0x5596278ce240 2024-09-19T07:22:16.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.777+0000 7f56dd1e4740 1 -- 172.21.15.148:0/1017400127 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56c80317b0 con 0x5596278ce240 2024-09-19T07:22:16.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.777+0000 7f56b3fff640 1 -- 172.21.15.148:0/1017400127 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f56cc011810 con 0x5596278ce240 2024-09-19T07:22:16.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.777+0000 7f56dd1e4740 10 client.17136 fetch_fsmap learned FSMap version 43 2024-09-19T07:22:16.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.777+0000 7f56dd1e4740 1 -- 172.21.15.148:0/1017400127 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x559627601960 con 0x5596278ce240 2024-09-19T07:22:16.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.777+0000 7f56b3fff640 1 -- 172.21.15.148:0/1017400127 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56c80317b0 con 0x5596278ce240 2024-09-19T07:22:16.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.777+0000 7f56b3fff640 1 -- 172.21.15.148:0/1017400127 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 43) ==== 8362+0+0 (secure 0 0 0) 0x7f56cc026b70 con 0x5596278ce240 2024-09-19T07:22:16.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.777+0000 7f56dd1e4740 10 client.17136 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T07:22:16.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.777+0000 7f56dd1e4740 10 client.17136 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:22:16.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.777+0000 7f56dd1e4740 20 client.17136 populate_metadata read hostname 'smithi148' 2024-09-19T07:22:16.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.777+0000 7f56dd1e4740 1 --2- 172.21.15.148:0/1017400127 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5596278dddb0 0x5596278e0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:16.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.777+0000 7f56dd1e4740 4 client.17136 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:22:16.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.777+0000 7f56dd1e4740 1 -- 172.21.15.148:0/1017400127 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559627835b90 con 0x5596278dddb0 2024-09-19T07:22:16.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.777+0000 7f56d8ba7640 1 --2- 172.21.15.148:0/1017400127 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5596278dddb0 0x5596278e0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:16.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.778+0000 7f56d8ba7640 1 --2- 172.21.15.148:0/1017400127 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5596278dddb0 0x5596278e0270 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ef1d1a7103066d9 server_cookie=d6e97d341a9339f7 in_seq=0 out_seq=0 2024-09-19T07:22:16.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.778+0000 7f56b3fff640 10 client.17136 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:22:16.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.778+0000 7f56b3fff640 1 -- 172.21.15.148:0/1017400127 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559627835b90 con 0x5596278dddb0 2024-09-19T07:22:16.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.778+0000 7f56b3fff640 10 client.17136 handle_command_reply: tid=0 2024-09-19T07:22:16.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.779+0000 7f56dd1e4740 1 client.17136 shutdown 2024-09-19T07:22:16.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.779+0000 7f56dd1e4740 1 -- 172.21.15.148:0/1017400127 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5596278ce240 msgr2=0x5596278cbb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:16.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.779+0000 7f56dd1e4740 1 --2- 172.21.15.148:0/1017400127 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5596278ce240 0x5596278cbb60 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f56cc012400 tx=0x7f56cc004ab0 comp rx=0 tx=0).stop 2024-09-19T07:22:16.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.779+0000 7f56dd1e4740 1 -- 172.21.15.148:0/1017400127 shutdown_connections 2024-09-19T07:22:16.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.779+0000 7f56dd1e4740 1 --2- 172.21.15.148:0/1017400127 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5596278dddb0 0x5596278e0270 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:16.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.779+0000 7f56dd1e4740 1 --2- 172.21.15.148:0/1017400127 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5596278ce240 0x5596278cbb60 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:16.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.779+0000 7f56dd1e4740 1 --2- 172.21.15.148:0/1017400127 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596278c3980 0x5596278cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:16.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.779+0000 7f56dd1e4740 1 --2- 172.21.15.148:0/1017400127 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5596278c3060 0x5596278cb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:16.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.779+0000 7f56dd1e4740 1 -- 172.21.15.148:0/1017400127 >> 172.21.15.148:0/1017400127 conn(0x5596278bf5f0 msgr2=0x5596278c5320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:16.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.779+0000 7f56b3fff640 0 client.17136 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:22:16.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.779+0000 7f56dd1e4740 1 -- 172.21.15.148:0/1017400127 shutdown_connections 2024-09-19T07:22:16.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.779+0000 7f56dd1e4740 1 -- 172.21.15.148:0/1017400127 wait complete. 2024-09-19T07:22:16.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.779+0000 7f56dd1e4740 20 client.17136 trim_cache size 0 max 16384 2024-09-19T07:22:16.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.795+0000 7f56dd1e4740 1 Processor -- start 2024-09-19T07:22:16.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.795+0000 7f56dd1e4740 1 -- start start 2024-09-19T07:22:16.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.795+0000 7f56dd1e4740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5596278c3060 0x5596278c5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:16.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.795+0000 7f56dd1e4740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5596278c3980 0x5596278e5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:16.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.795+0000 7f56dd1e4740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596278ce240 0x5596278e6080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:16.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.795+0000 7f56dd1e4740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f56d41b2430 con 0x5596278c3980 2024-09-19T07:22:16.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.795+0000 7f56dd1e4740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f56d41afca0 con 0x5596278c3060 2024-09-19T07:22:16.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.795+0000 7f56dd1e4740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f56d41adb10 con 0x5596278ce240 2024-09-19T07:22:16.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.796+0000 7f56d3fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5596278c3980 0x5596278e5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:16.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.796+0000 7f56d3fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5596278c3980 0x5596278e5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47398/0 (socket says 172.21.15.148:47398) 2024-09-19T07:22:16.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.796+0000 7f56d3fff640 1 -- 172.21.15.148:0/2163584210 learned_addr learned my addr 172.21.15.148:0/2163584210 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:22:16.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.796+0000 7f56d3fff640 1 -- 172.21.15.148:0/2163584210 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596278ce240 msgr2=0x5596278e6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:16.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.796+0000 7f56d3fff640 1 --2- 172.21.15.148:0/2163584210 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596278ce240 0x5596278e6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:16.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.796+0000 7f56d3fff640 1 -- 172.21.15.148:0/2163584210 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5596278c3060 msgr2=0x5596278c5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:16.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.796+0000 7f56d3fff640 1 --2- 172.21.15.148:0/2163584210 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5596278c3060 0x5596278c5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:16.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.796+0000 7f56d3fff640 1 -- 172.21.15.148:0/2163584210 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596278bf090 con 0x5596278c3980 2024-09-19T07:22:16.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.796+0000 7f56d3fff640 1 --2- 172.21.15.148:0/2163584210 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5596278c3980 0x5596278e5b40 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f56c0097f90 tx=0x7f56c0086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c4610444694826d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:16.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.796+0000 7f56be7fc640 1 -- 172.21.15.148:0/2163584210 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c009ce60 con 0x5596278c3980 2024-09-19T07:22:16.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.796+0000 7f56be7fc640 1 -- 172.21.15.148:0/2163584210 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56c009fee0 con 0x5596278c3980 2024-09-19T07:22:16.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.796+0000 7f56be7fc640 1 -- 172.21.15.148:0/2163584210 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c0020040 con 0x5596278c3980 2024-09-19T07:22:16.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.797+0000 7f56dd1e4740 1 -- 172.21.15.148:0/2163584210 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5596278c3980 msgr2=0x5596278e5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:16.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.797+0000 7f56dd1e4740 1 --2- 172.21.15.148:0/2163584210 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5596278c3980 0x5596278e5b40 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f56c0097f90 tx=0x7f56c0086040 comp rx=0 tx=0).stop 2024-09-19T07:22:16.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.797+0000 7f56dd1e4740 1 -- 172.21.15.148:0/2163584210 shutdown_connections 2024-09-19T07:22:16.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.797+0000 7f56dd1e4740 1 --2- 172.21.15.148:0/2163584210 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596278ce240 0x5596278e6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:16.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.797+0000 7f56dd1e4740 1 --2- 172.21.15.148:0/2163584210 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5596278c3980 0x5596278e5b40 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:16.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.797+0000 7f56dd1e4740 1 --2- 172.21.15.148:0/2163584210 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5596278c3060 0x5596278c5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:16.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.797+0000 7f56dd1e4740 1 -- 172.21.15.148:0/2163584210 >> 172.21.15.148:0/2163584210 conn(0x5596278bf5f0 msgr2=0x5596278c99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:16.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.797+0000 7f56dd1e4740 1 -- 172.21.15.148:0/2163584210 shutdown_connections 2024-09-19T07:22:16.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.797+0000 7f56dd1e4740 1 -- 172.21.15.148:0/2163584210 wait complete. 2024-09-19T07:22:16.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.797+0000 7f56dd1e4740 1 -- start start 2024-09-19T07:22:16.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.797+0000 7f56dd1e4740 1 Processor -- start 2024-09-19T07:22:16.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.798+0000 7f56dd1e4740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596278c3060 0x5596278d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:16.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.798+0000 7f56dd1e4740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5596278c3980 0x5596278d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:16.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.798+0000 7f56dd1e4740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5596278ce240 0x5596278d2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:16.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.798+0000 7f56dd1e4740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f56d41ae160 con 0x5596278ce240 2024-09-19T07:22:16.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.798+0000 7f56dd1e4740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f56d41af5d0 con 0x5596278c3980 2024-09-19T07:22:16.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.798+0000 7f56dd1e4740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f56d41ae830 con 0x5596278c3060 2024-09-19T07:22:16.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.798+0000 7f56dd1e4740 10 client.0 _ll_register_callbacks cb 0x7f56cc012050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:22:16.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.798+0000 7f56d93a8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5596278ce240 0x5596278d2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:16.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.798+0000 7f56d93a8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5596278ce240 0x5596278d2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47408/0 (socket says 172.21.15.148:47408) 2024-09-19T07:22:16.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.798+0000 7f56d93a8640 1 -- 172.21.15.148:0/3777545282 learned_addr learned my addr 172.21.15.148:0/3777545282 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:22:16.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.798+0000 7f56d8ba7640 1 --2- 172.21.15.148:0/3777545282 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596278c3060 0x5596278d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:16.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.798+0000 7f56d3fff640 1 --2- 172.21.15.148:0/3777545282 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5596278c3980 0x5596278d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:16.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.798+0000 7f56d93a8640 1 -- 172.21.15.148:0/3777545282 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596278c3060 msgr2=0x5596278d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:16.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.798+0000 7f56d93a8640 1 --2- 172.21.15.148:0/3777545282 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596278c3060 0x5596278d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:16.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.798+0000 7f56d93a8640 1 -- 172.21.15.148:0/3777545282 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5596278c3980 msgr2=0x5596278d2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:16.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.798+0000 7f56d93a8640 1 --2- 172.21.15.148:0/3777545282 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5596278c3980 0x5596278d2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:16.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.798+0000 7f56d93a8640 1 -- 172.21.15.148:0/3777545282 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559627947d10 con 0x5596278ce240 2024-09-19T07:22:16.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.798+0000 7f56d93a8640 1 --2- 172.21.15.148:0/3777545282 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5596278ce240 0x5596278d2c80 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f56cc01d460 tx=0x7f56cc00aa20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d05a1f7f582ebf90 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:16.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.798+0000 7f56b3fff640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:22:16.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.798+0000 7f56b3fff640 1 -- 172.21.15.148:0/3777545282 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56cc00db50 con 0x5596278ce240 2024-09-19T07:22:16.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.798+0000 7f56dd1e4740 1 -- 172.21.15.148:0/3777545282 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56c009fee0 con 0x5596278ce240 2024-09-19T07:22:16.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.798+0000 7f56b3fff640 1 -- 172.21.15.148:0/3777545282 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8600+0+0 (secure 0 0 0) 0x7f56cc01da20 con 0x5596278ce240 2024-09-19T07:22:16.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.798+0000 7f56b3fff640 1 -- 172.21.15.148:0/3777545282 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f56cc01d850 con 0x5596278ce240 2024-09-19T07:22:16.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.799+0000 7f56dd1e4740 10 client.17142 fetch_fsmap learned FSMap version 43 2024-09-19T07:22:16.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.799+0000 7f56dd1e4740 1 -- 172.21.15.148:0/3777545282 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x559627949010 con 0x5596278ce240 2024-09-19T07:22:16.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.799+0000 7f56b3fff640 1 -- 172.21.15.148:0/3777545282 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56c009fee0 con 0x5596278ce240 2024-09-19T07:22:16.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.799+0000 7f56b3fff640 1 -- 172.21.15.148:0/3777545282 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 43) ==== 8362+0+0 (secure 0 0 0) 0x7f56cc026660 con 0x5596278ce240 2024-09-19T07:22:16.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.799+0000 7f56dd1e4740 10 client.17142 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T07:22:16.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.799+0000 7f56dd1e4740 10 client.17142 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:22:16.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.799+0000 7f56dd1e4740 20 client.17142 populate_metadata read hostname 'smithi148' 2024-09-19T07:22:16.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.799+0000 7f56dd1e4740 1 --2- 172.21.15.148:0/3777545282 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5596279497e0 0x55962794bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:16.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.799+0000 7f56dd1e4740 4 client.17142 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "8900e1a2", "release": true, "await": true}] 2024-09-19T07:22:16.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.799+0000 7f56dd1e4740 1 -- 172.21.15.148:0/3777545282 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "quiesce db", "set_id": "8900e1a2", "release": true, "await": true}) -- 0x5596278300a0 con 0x5596279497e0 2024-09-19T07:22:16.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.799+0000 7f56d8ba7640 1 --2- 172.21.15.148:0/3777545282 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5596279497e0 0x55962794bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:16.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.800+0000 7f56b3fff640 10 client.17142 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:22:16.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:16.800+0000 7f56d8ba7640 1 --2- 172.21.15.148:0/3777545282 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5596279497e0 0x55962794bc00 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f10ad392377f7a5 server_cookie=522ff3414b583056 in_seq=0 out_seq=0 2024-09-19T07:22:17.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:22:17 smithi148 ceph-mon[31180]: pgmap v349: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-09-19T07:22:17.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:22:17 smithi165 ceph-mon[35326]: pgmap v349: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-09-19T07:22:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.726+0000 7fddaaf11640 1 -- 172.21.15.148:0/808028667 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdda41008a0 msgr2=0x7fdda4100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.726+0000 7fddaaf11640 1 --2- 172.21.15.148:0/808028667 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdda41008a0 0x7fdda4100c80 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fdd98009900 tx=0x7fdd9802a410 comp rx=0 tx=0).stop 2024-09-19T07:22:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.726+0000 7fddaaf11640 1 -- 172.21.15.148:0/808028667 shutdown_connections 2024-09-19T07:22:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.726+0000 7fddaaf11640 1 --2- 172.21.15.148:0/808028667 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdda41080f0 0x7fdda410ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.726+0000 7fddaaf11640 1 --2- 172.21.15.148:0/808028667 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdda4101250 0x7fdda4107990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.726+0000 7fddaaf11640 1 --2- 172.21.15.148:0/808028667 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdda41008a0 0x7fdda4100c80 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.726+0000 7fddaaf11640 1 -- 172.21.15.148:0/808028667 >> 172.21.15.148:0/808028667 conn(0x7fdda4075ef0 msgr2=0x7fdda4076300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.726+0000 7fddaaf11640 1 -- 172.21.15.148:0/808028667 shutdown_connections 2024-09-19T07:22:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.726+0000 7fddaaf11640 1 -- 172.21.15.148:0/808028667 wait complete. 2024-09-19T07:22:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.727+0000 7fddaaf11640 1 Processor -- start 2024-09-19T07:22:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.727+0000 7fddaaf11640 1 -- start start 2024-09-19T07:22:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.727+0000 7fddaaf11640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdda41008a0 0x7fdda4198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.727+0000 7fddaaf11640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdda41080f0 0x7fdda4198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.727+0000 7fddaaf11640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdda419cbf0 0x7fdda419d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.727+0000 7fddaaf11640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdda4111f20 con 0x7fdda419cbf0 2024-09-19T07:22:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.727+0000 7fddaaf11640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdda4111da0 con 0x7fdda41080f0 2024-09-19T07:22:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.727+0000 7fddaaf11640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdda41120a0 con 0x7fdda41008a0 2024-09-19T07:22:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.727+0000 7fdda8cad640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdda41008a0 0x7fdda4198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.727+0000 7fdda94ae640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdda419cbf0 0x7fdda419d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.727+0000 7fdda8cad640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdda41008a0 0x7fdda4198330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:49276/0 (socket says 172.21.15.148:49276) 2024-09-19T07:22:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.727+0000 7fdda8cad640 1 -- 172.21.15.148:0/3683589420 learned_addr learned my addr 172.21.15.148:0/3683589420 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:22:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.727+0000 7fdda3fff640 1 --2- 172.21.15.148:0/3683589420 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdda41080f0 0x7fdda4198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.728+0000 7fdda94ae640 1 -- 172.21.15.148:0/3683589420 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdda41008a0 msgr2=0x7fdda4198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.728+0000 7fdda94ae640 1 --2- 172.21.15.148:0/3683589420 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdda41008a0 0x7fdda4198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.728+0000 7fdda94ae640 1 -- 172.21.15.148:0/3683589420 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdda41080f0 msgr2=0x7fdda4198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:17.732 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.728+0000 7fdda94ae640 1 --2- 172.21.15.148:0/3683589420 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdda41080f0 0x7fdda4198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:17.732 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.728+0000 7fdda94ae640 1 -- 172.21.15.148:0/3683589420 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda419d6e0 con 0x7fdda419cbf0 2024-09-19T07:22:17.732 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.728+0000 7fdda8cad640 1 --2- 172.21.15.148:0/3683589420 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdda41008a0 0x7fdda4198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:22:17.732 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.728+0000 7fdda94ae640 1 --2- 172.21.15.148:0/3683589420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdda419cbf0 0x7fdda419d0a0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c009fd0 tx=0x7fdd9c00ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:17.732 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.728+0000 7fdda1ffb640 1 -- 172.21.15.148:0/3683589420 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c00ce20 con 0x7fdda419cbf0 2024-09-19T07:22:17.732 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.728+0000 7fddaaf11640 1 -- 172.21.15.148:0/3683589420 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdda419d9d0 con 0x7fdda419cbf0 2024-09-19T07:22:17.732 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.728+0000 7fdda1ffb640 1 -- 172.21.15.148:0/3683589420 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd9c005020 con 0x7fdda419cbf0 2024-09-19T07:22:17.732 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.728+0000 7fdda1ffb640 1 -- 172.21.15.148:0/3683589420 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c010720 con 0x7fdda419cbf0 2024-09-19T07:22:17.732 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.728+0000 7fddaaf11640 1 -- 172.21.15.148:0/3683589420 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdda41a5170 con 0x7fdda419cbf0 2024-09-19T07:22:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.731+0000 7fdda1ffb640 1 -- 172.21.15.148:0/3683589420 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fdd9c005540 con 0x7fdda419cbf0 2024-09-19T07:22:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.731+0000 7fddadca8740 1 Processor -- start 2024-09-19T07:22:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.731+0000 7fddadca8740 1 -- start start 2024-09-19T07:22:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.731+0000 7fdda1ffb640 1 --2- 172.21.15.148:0/3683589420 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fdd940a3460 0x7fdd940a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.731+0000 7fddadca8740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56505fe00af0 0x56505fe00ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.731+0000 7fddadca8740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56505fe01410 0x56505fe0b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.731+0000 7fddadca8740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56505fe0bcb0 0x56505fe0e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.731+0000 7fddadca8740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56505fd652f0 con 0x56505fe00af0 2024-09-19T07:22:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.731+0000 7fddadca8740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56505fd0d270 con 0x56505fe0bcb0 2024-09-19T07:22:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.731+0000 7fddadca8740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56505fd612b0 con 0x56505fe01410 2024-09-19T07:22:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.731+0000 7fdda8cad640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56505fe00af0 0x56505fe00ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.731+0000 7fdda1ffb640 1 -- 172.21.15.148:0/3683589420 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8600+0+0 (secure 0 0 0) 0x7fdd9c0d0480 con 0x7fdda419cbf0 2024-09-19T07:22:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.731+0000 7fdda3fff640 1 --2- 172.21.15.148:0/3683589420 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fdd940a3460 0x7fdd940a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.731+0000 7fdda8cad640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56505fe00af0 0x56505fe00ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47436/0 (socket says 172.21.15.148:47436) 2024-09-19T07:22:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.731+0000 7fdda94ae640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56505fe0bcb0 0x56505fe0e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.731+0000 7fdda8cad640 1 -- 172.21.15.148:0/4265748629 learned_addr learned my addr 172.21.15.148:0/4265748629 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:22:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.732+0000 7fdda3fff640 1 --2- 172.21.15.148:0/4265748629 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56505fe01410 0x56505fe0b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.732+0000 7fdda94ae640 1 -- 172.21.15.148:0/4265748629 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56505fe01410 msgr2=0x56505fe0b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.732+0000 7fdda94ae640 1 --2- 172.21.15.148:0/4265748629 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56505fe01410 0x56505fe0b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.732+0000 7fdda94ae640 1 -- 172.21.15.148:0/4265748629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56505fe00af0 msgr2=0x56505fe00ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.732+0000 7fdda94ae640 1 --2- 172.21.15.148:0/4265748629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56505fe00af0 0x56505fe00ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.732+0000 7fdda94ae640 1 -- 172.21.15.148:0/4265748629 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56505fd0c340 con 0x56505fe0bcb0 2024-09-19T07:22:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.732+0000 7fdda8cad640 1 --2- 172.21.15.148:0/4265748629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56505fe00af0 0x56505fe00ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:22:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.732+0000 7fdda3fff640 1 --2- 172.21.15.148:0/3683589420 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fdd940a3460 0x7fdd940a5920 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdd90009710 tx=0x7fdd90009ad0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.732+0000 7fdda94ae640 1 --2- 172.21.15.148:0/4265748629 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56505fe0bcb0 0x56505fe0e0a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c0cdb80 tx=0x7fdd9c09c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=deb346679cdd06fd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.732+0000 7fdd8effd640 1 -- 172.21.15.148:0/4265748629 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c01e2b0 con 0x56505fe0bcb0 2024-09-19T07:22:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.732+0000 7fdd8effd640 1 -- 172.21.15.148:0/4265748629 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd9c0796e0 con 0x56505fe0bcb0 2024-09-19T07:22:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.732+0000 7fdd8effd640 1 -- 172.21.15.148:0/4265748629 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c07e120 con 0x56505fe0bcb0 2024-09-19T07:22:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.733+0000 7fddadca8740 1 -- 172.21.15.148:0/4265748629 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56505fe0bcb0 msgr2=0x56505fe0e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.733+0000 7fddadca8740 1 --2- 172.21.15.148:0/4265748629 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56505fe0bcb0 0x56505fe0e0a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c0cdb80 tx=0x7fdd9c09c380 comp rx=0 tx=0).stop 2024-09-19T07:22:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.733+0000 7fddadca8740 1 -- 172.21.15.148:0/4265748629 shutdown_connections 2024-09-19T07:22:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.733+0000 7fddadca8740 1 --2- 172.21.15.148:0/4265748629 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56505fe0bcb0 0x56505fe0e0a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.733+0000 7fddadca8740 1 --2- 172.21.15.148:0/4265748629 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56505fe01410 0x56505fe0b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.733+0000 7fddadca8740 1 --2- 172.21.15.148:0/4265748629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56505fe00af0 0x56505fe00ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.733+0000 7fddadca8740 1 -- 172.21.15.148:0/4265748629 >> 172.21.15.148:0/4265748629 conn(0x56505fdfd060 msgr2=0x56505fdfd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.733+0000 7fddadca8740 1 -- 172.21.15.148:0/4265748629 shutdown_connections 2024-09-19T07:22:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.733+0000 7fddadca8740 1 -- 172.21.15.148:0/4265748629 wait complete. 2024-09-19T07:22:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.733+0000 7fddadca8740 1 -- start start 2024-09-19T07:22:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.733+0000 7fddadca8740 1 Processor -- start 2024-09-19T07:22:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.734+0000 7fddadca8740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56505fe00af0 0x56505fe08ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.734+0000 7fddadca8740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56505fe01410 0x56505fe09020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.734+0000 7fddadca8740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56505fe0bcb0 0x56505fe09560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.734+0000 7fddadca8740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56505fe0e880 con 0x56505fe0bcb0 2024-09-19T07:22:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.734+0000 7fddadca8740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56505fcee290 con 0x56505fe01410 2024-09-19T07:22:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.734+0000 7fddadca8740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56505fe0ea00 con 0x56505fe00af0 2024-09-19T07:22:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.734+0000 7fddadca8740 10 client.0 _ll_register_callbacks cb 0x56505fd1f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:22:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.734+0000 7fdda8cad640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56505fe00af0 0x56505fe08ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.734+0000 7fdda94ae640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56505fe0bcb0 0x56505fe09560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.734+0000 7fdda8cad640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56505fe00af0 0x56505fe08ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:49286/0 (socket says 172.21.15.148:49286) 2024-09-19T07:22:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.734+0000 7fdda94ae640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56505fe0bcb0 0x56505fe09560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47444/0 (socket says 172.21.15.148:47444) 2024-09-19T07:22:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.734+0000 7fdda8cad640 1 -- 172.21.15.148:0/421218130 learned_addr learned my addr 172.21.15.148:0/421218130 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:22:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.734+0000 7fdda3fff640 1 --2- 172.21.15.148:0/421218130 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56505fe01410 0x56505fe09020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.734+0000 7fdda94ae640 1 -- 172.21.15.148:0/421218130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56505fe00af0 msgr2=0x56505fe08ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.734+0000 7fdda94ae640 1 --2- 172.21.15.148:0/421218130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56505fe00af0 0x56505fe08ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.734+0000 7fdda94ae640 1 -- 172.21.15.148:0/421218130 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56505fe01410 msgr2=0x56505fe09020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.734+0000 7fdda94ae640 1 --2- 172.21.15.148:0/421218130 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56505fe01410 0x56505fe09020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.734+0000 7fdda94ae640 1 -- 172.21.15.148:0/421218130 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56505fa78210 con 0x56505fe0bcb0 2024-09-19T07:22:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.734+0000 7fdda94ae640 1 --2- 172.21.15.148:0/421218130 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56505fe0bcb0 0x56505fe09560 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c09c8d0 tx=0x7fdd9c0054b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a958fb977c79fb31 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.734+0000 7fdd83fff640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:22:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.735+0000 7fdd83fff640 1 -- 172.21.15.148:0/421218130 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c09c710 con 0x56505fe0bcb0 2024-09-19T07:22:17.747 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.735+0000 7fdd83fff640 1 -- 172.21.15.148:0/421218130 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8600+0+0 (secure 0 0 0) 0x7fdd9c0051d0 con 0x56505fe0bcb0 2024-09-19T07:22:17.747 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.735+0000 7fddadca8740 1 -- 172.21.15.148:0/421218130 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd9c0796e0 con 0x56505fe0bcb0 2024-09-19T07:22:17.747 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.735+0000 7fdd83fff640 1 -- 172.21.15.148:0/421218130 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fdd9c0a0ac0 con 0x56505fe0bcb0 2024-09-19T07:22:17.747 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.735+0000 7fddadca8740 10 client.17154 fetch_fsmap learned FSMap version 43 2024-09-19T07:22:17.747 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.735+0000 7fddadca8740 1 -- 172.21.15.148:0/421218130 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x56505fb44620 con 0x56505fe0bcb0 2024-09-19T07:22:17.747 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.735+0000 7fdd83fff640 1 -- 172.21.15.148:0/421218130 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd9c0796e0 con 0x56505fe0bcb0 2024-09-19T07:22:17.747 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.735+0000 7fdd83fff640 1 -- 172.21.15.148:0/421218130 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 43) ==== 8362+0+0 (secure 0 0 0) 0x7fdd9c0a4ef0 con 0x56505fe0bcb0 2024-09-19T07:22:17.747 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.735+0000 7fddadca8740 10 client.17154 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T07:22:17.747 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.735+0000 7fddadca8740 10 client.17154 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:22:17.747 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.735+0000 7fddadca8740 20 client.17154 populate_metadata read hostname 'smithi148' 2024-09-19T07:22:17.747 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.735+0000 7fddadca8740 1 --2- 172.21.15.148:0/421218130 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56505fe1b9d0 0x56505fe1ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:17.747 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.735+0000 7fddadca8740 4 client.17154 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:22:17.748 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.735+0000 7fddadca8740 1 -- 172.21.15.148:0/421218130 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56505fd72a20 con 0x56505fe1b9d0 2024-09-19T07:22:17.748 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.735+0000 7fdda8cad640 1 --2- 172.21.15.148:0/421218130 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56505fe1b9d0 0x56505fe1ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:17.748 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.736+0000 7fdd83fff640 10 client.17154 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:22:17.748 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.736+0000 7fdda8cad640 1 --2- 172.21.15.148:0/421218130 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56505fe1b9d0 0x56505fe1ddc0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be0114bd79efc75d server_cookie=45d28801ea75a4cc in_seq=0 out_seq=0 2024-09-19T07:22:17.748 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.736+0000 7fdd83fff640 1 -- 172.21.15.148:0/421218130 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56505fd72a20 con 0x56505fe1b9d0 2024-09-19T07:22:17.748 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.736+0000 7fdd83fff640 10 client.17154 handle_command_reply: tid=0 2024-09-19T07:22:17.748 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.736+0000 7fddadca8740 1 client.17154 shutdown 2024-09-19T07:22:17.748 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.736+0000 7fddadca8740 1 -- 172.21.15.148:0/421218130 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56505fe0bcb0 msgr2=0x56505fe09560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:17.748 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.736+0000 7fddadca8740 1 --2- 172.21.15.148:0/421218130 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56505fe0bcb0 0x56505fe09560 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c09c8d0 tx=0x7fdd9c0054b0 comp rx=0 tx=0).stop 2024-09-19T07:22:17.748 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.737+0000 7fddadca8740 1 -- 172.21.15.148:0/421218130 shutdown_connections 2024-09-19T07:22:17.748 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.737+0000 7fddadca8740 1 --2- 172.21.15.148:0/421218130 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56505fe1b9d0 0x56505fe1ddc0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:17.748 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.737+0000 7fddadca8740 1 --2- 172.21.15.148:0/421218130 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56505fe0bcb0 0x56505fe09560 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:17.749 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.737+0000 7fdd83fff640 0 client.17154 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:22:17.749 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.737+0000 7fddadca8740 1 --2- 172.21.15.148:0/421218130 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56505fe01410 0x56505fe09020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:17.749 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.737+0000 7fddadca8740 1 --2- 172.21.15.148:0/421218130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56505fe00af0 0x56505fe08ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:17.749 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.737+0000 7fddadca8740 1 -- 172.21.15.148:0/421218130 >> 172.21.15.148:0/421218130 conn(0x56505fdfd060 msgr2=0x56505fe02dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:17.749 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.737+0000 7fddadca8740 1 -- 172.21.15.148:0/421218130 shutdown_connections 2024-09-19T07:22:17.749 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.737+0000 7fddadca8740 1 -- 172.21.15.148:0/421218130 wait complete. 2024-09-19T07:22:17.749 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.737+0000 7fddadca8740 20 client.17154 trim_cache size 0 max 16384 2024-09-19T07:22:17.756 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.751+0000 7fddadca8740 1 Processor -- start 2024-09-19T07:22:17.756 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.751+0000 7fddadca8740 1 -- start start 2024-09-19T07:22:17.756 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.751+0000 7fddadca8740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56505fe00af0 0x56505fe07390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:17.756 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.751+0000 7fddadca8740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56505fe01410 0x56505fe09390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:17.756 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.751+0000 7fddadca8740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56505fe0bcb0 0x56505fe23360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:17.756 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.751+0000 7fddadca8740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdda41b0130 con 0x56505fe00af0 2024-09-19T07:22:17.756 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.751+0000 7fddadca8740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdda41ad9a0 con 0x56505fe01410 2024-09-19T07:22:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.751+0000 7fddadca8740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdda41ab810 con 0x56505fe0bcb0 2024-09-19T07:22:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.751+0000 7fdda8cad640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56505fe00af0 0x56505fe07390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.751+0000 7fdda8cad640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56505fe00af0 0x56505fe07390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47446/0 (socket says 172.21.15.148:47446) 2024-09-19T07:22:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.751+0000 7fdda8cad640 1 -- 172.21.15.148:0/21840346 learned_addr learned my addr 172.21.15.148:0/21840346 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:22:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.751+0000 7fdda94ae640 1 --2- 172.21.15.148:0/21840346 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56505fe0bcb0 0x56505fe23360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.751+0000 7fdda3fff640 1 --2- 172.21.15.148:0/21840346 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56505fe01410 0x56505fe09390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.751+0000 7fdda8cad640 1 -- 172.21.15.148:0/21840346 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56505fe0bcb0 msgr2=0x56505fe23360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.751+0000 7fdda8cad640 1 --2- 172.21.15.148:0/21840346 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56505fe0bcb0 0x56505fe23360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.751+0000 7fdda8cad640 1 -- 172.21.15.148:0/21840346 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56505fe01410 msgr2=0x56505fe09390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.751+0000 7fdda8cad640 1 --2- 172.21.15.148:0/21840346 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56505fe01410 0x56505fe09390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.751+0000 7fdda8cad640 1 -- 172.21.15.148:0/21840346 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56505fe1e130 con 0x56505fe00af0 2024-09-19T07:22:17.758 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.751+0000 7fdda3fff640 1 --2- 172.21.15.148:0/21840346 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56505fe01410 0x56505fe09390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:22:17.758 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.752+0000 7fdda8cad640 1 --2- 172.21.15.148:0/21840346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56505fe00af0 0x56505fe07390 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fdd98031550 tx=0x7fdd98005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ca8678515a7ac8d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:17.758 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.752+0000 7fdd8e7fc640 1 -- 172.21.15.148:0/21840346 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd98035040 con 0x56505fe00af0 2024-09-19T07:22:17.758 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.752+0000 7fdd8e7fc640 1 -- 172.21.15.148:0/21840346 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd98032a70 con 0x56505fe00af0 2024-09-19T07:22:17.758 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.752+0000 7fdd8e7fc640 1 -- 172.21.15.148:0/21840346 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd98004b80 con 0x56505fe00af0 2024-09-19T07:22:17.758 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.752+0000 7fddadca8740 1 -- 172.21.15.148:0/21840346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56505fe00af0 msgr2=0x56505fe07390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:17.758 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.752+0000 7fddadca8740 1 --2- 172.21.15.148:0/21840346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56505fe00af0 0x56505fe07390 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fdd98031550 tx=0x7fdd98005a20 comp rx=0 tx=0).stop 2024-09-19T07:22:17.759 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.752+0000 7fddadca8740 1 -- 172.21.15.148:0/21840346 shutdown_connections 2024-09-19T07:22:17.759 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.752+0000 7fddadca8740 1 --2- 172.21.15.148:0/21840346 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56505fe0bcb0 0x56505fe23360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:17.759 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.752+0000 7fddadca8740 1 --2- 172.21.15.148:0/21840346 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56505fe01410 0x56505fe09390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:17.759 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.752+0000 7fddadca8740 1 --2- 172.21.15.148:0/21840346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56505fe00af0 0x56505fe07390 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:17.759 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.752+0000 7fddadca8740 1 -- 172.21.15.148:0/21840346 >> 172.21.15.148:0/21840346 conn(0x56505fdfd060 msgr2=0x56505fe0ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:17.759 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.752+0000 7fddadca8740 1 -- 172.21.15.148:0/21840346 shutdown_connections 2024-09-19T07:22:17.759 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.752+0000 7fddadca8740 1 -- 172.21.15.148:0/21840346 wait complete. 2024-09-19T07:22:17.759 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.753+0000 7fddadca8740 1 -- start start 2024-09-19T07:22:17.760 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.753+0000 7fddadca8740 1 Processor -- start 2024-09-19T07:22:17.760 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.753+0000 7fddadca8740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56505fe00af0 0x56505fe142f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:17.760 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.753+0000 7fddadca8740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56505fe01410 0x56505fe0c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:17.760 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.753+0000 7fddadca8740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56505fe0bcb0 0x56505fe0ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:17.760 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.753+0000 7fddadca8740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdda41abe60 con 0x56505fe0bcb0 2024-09-19T07:22:17.760 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.753+0000 7fddadca8740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdda41ad2d0 con 0x56505fe01410 2024-09-19T07:22:17.760 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.753+0000 7fddadca8740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdda41ac530 con 0x56505fe00af0 2024-09-19T07:22:17.760 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.753+0000 7fddadca8740 10 client.0 _ll_register_callbacks cb 0x7fdd9c09c2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:22:17.760 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.753+0000 7fdda94ae640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56505fe0bcb0 0x56505fe0ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:17.760 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.753+0000 7fdda8cad640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56505fe00af0 0x56505fe142f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:17.760 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.753+0000 7fdda94ae640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56505fe0bcb0 0x56505fe0ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47448/0 (socket says 172.21.15.148:47448) 2024-09-19T07:22:17.760 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.753+0000 7fdda8cad640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56505fe00af0 0x56505fe142f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:49304/0 (socket says 172.21.15.148:49304) 2024-09-19T07:22:17.761 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.753+0000 7fdda94ae640 1 -- 172.21.15.148:0/2501754813 learned_addr learned my addr 172.21.15.148:0/2501754813 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:22:17.761 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.753+0000 7fdda3fff640 1 --2- 172.21.15.148:0/2501754813 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56505fe01410 0x56505fe0c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:17.761 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.753+0000 7fdda94ae640 1 -- 172.21.15.148:0/2501754813 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56505fe00af0 msgr2=0x56505fe142f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:17.761 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.754+0000 7fdda94ae640 1 --2- 172.21.15.148:0/2501754813 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56505fe00af0 0x56505fe142f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:17.761 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.754+0000 7fdda94ae640 1 -- 172.21.15.148:0/2501754813 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56505fe01410 msgr2=0x56505fe0c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:17.761 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.754+0000 7fdda94ae640 1 --2- 172.21.15.148:0/2501754813 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56505fe01410 0x56505fe0c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:17.761 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.754+0000 7fdda94ae640 1 -- 172.21.15.148:0/2501754813 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56505fe0d6b0 con 0x56505fe0bcb0 2024-09-19T07:22:17.761 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.754+0000 7fdda94ae640 1 --2- 172.21.15.148:0/2501754813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56505fe0bcb0 0x56505fe0ceb0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c0ce180 tx=0x7fdd9c07b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c608adcdaf75c186 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:17.761 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.754+0000 7fdd83fff640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:22:17.761 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.754+0000 7fdd83fff640 1 -- 172.21.15.148:0/2501754813 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c09c710 con 0x56505fe0bcb0 2024-09-19T07:22:17.761 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.754+0000 7fdd83fff640 1 -- 172.21.15.148:0/2501754813 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8600+0+0 (secure 0 0 0) 0x7fdd9c0051d0 con 0x56505fe0bcb0 2024-09-19T07:22:17.762 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.754+0000 7fddadca8740 1 -- 172.21.15.148:0/2501754813 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56505fd6cd70 con 0x56505fe0bcb0 2024-09-19T07:22:17.762 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.754+0000 7fdd83fff640 1 -- 172.21.15.148:0/2501754813 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fdd9c0a5380 con 0x56505fe0bcb0 2024-09-19T07:22:17.762 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.754+0000 7fddadca8740 10 client.17160 fetch_fsmap learned FSMap version 43 2024-09-19T07:22:17.762 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.754+0000 7fddadca8740 1 -- 172.21.15.148:0/2501754813 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x56505fe0d6b0 con 0x56505fe0bcb0 2024-09-19T07:22:17.762 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.754+0000 7fdd83fff640 1 -- 172.21.15.148:0/2501754813 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x56505fd6cd70 con 0x56505fe0bcb0 2024-09-19T07:22:17.762 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.754+0000 7fdd83fff640 1 -- 172.21.15.148:0/2501754813 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 43) ==== 8362+0+0 (secure 0 0 0) 0x7fdd9c09bbf0 con 0x56505fe0bcb0 2024-09-19T07:22:17.762 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.754+0000 7fddadca8740 10 client.17160 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T07:22:17.762 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.754+0000 7fddadca8740 10 client.17160 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:22:17.762 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.754+0000 7fddadca8740 20 client.17160 populate_metadata read hostname 'smithi148' 2024-09-19T07:22:17.762 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.754+0000 7fddadca8740 1 --2- 172.21.15.148:0/2501754813 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56505fe8a920 0x56505fe8cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:17.762 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.754+0000 7fddadca8740 4 client.17160 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:22:17.762 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.754+0000 7fddadca8740 1 -- 172.21.15.148:0/2501754813 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56505fce9900 con 0x56505fe8a920 2024-09-19T07:22:17.763 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.755+0000 7fdda8cad640 1 --2- 172.21.15.148:0/2501754813 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56505fe8a920 0x56505fe8cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:17.763 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.755+0000 7fdd83fff640 10 client.17160 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:22:17.763 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.755+0000 7fdda8cad640 1 --2- 172.21.15.148:0/2501754813 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56505fe8a920 0x56505fe8cd40 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6aa4378b5be62675 server_cookie=d27612a841b10694 in_seq=0 out_seq=0 2024-09-19T07:22:17.767 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.766+0000 7fdd83fff640 1 -- 172.21.15.148:0/2501754813 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56505fce9900 con 0x56505fe8a920 2024-09-19T07:22:17.767 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.766+0000 7fdd83fff640 10 client.17160 handle_command_reply: tid=0 2024-09-19T07:22:17.767 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.766+0000 7fddadca8740 1 client.17160 shutdown 2024-09-19T07:22:17.767 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.766+0000 7fddadca8740 1 -- 172.21.15.148:0/2501754813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56505fe0bcb0 msgr2=0x56505fe0ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:17.768 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.766+0000 7fddadca8740 1 --2- 172.21.15.148:0/2501754813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56505fe0bcb0 0x56505fe0ceb0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c0ce180 tx=0x7fdd9c07b310 comp rx=0 tx=0).stop 2024-09-19T07:22:17.768 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.766+0000 7fddadca8740 1 -- 172.21.15.148:0/2501754813 shutdown_connections 2024-09-19T07:22:17.768 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.766+0000 7fddadca8740 1 --2- 172.21.15.148:0/2501754813 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56505fe8a920 0x56505fe8cd40 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:17.768 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.766+0000 7fddadca8740 1 --2- 172.21.15.148:0/2501754813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56505fe0bcb0 0x56505fe0ceb0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:17.768 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.766+0000 7fdd83fff640 0 client.17160 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:22:17.768 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.766+0000 7fddadca8740 1 --2- 172.21.15.148:0/2501754813 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56505fe01410 0x56505fe0c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:17.768 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.766+0000 7fddadca8740 1 --2- 172.21.15.148:0/2501754813 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56505fe00af0 0x56505fe142f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:17.768 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.766+0000 7fddadca8740 1 -- 172.21.15.148:0/2501754813 >> 172.21.15.148:0/2501754813 conn(0x56505fdfd060 msgr2=0x56505fe0a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:17.768 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.766+0000 7fddadca8740 1 -- 172.21.15.148:0/2501754813 shutdown_connections 2024-09-19T07:22:17.768 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.766+0000 7fddadca8740 1 -- 172.21.15.148:0/2501754813 wait complete. 2024-09-19T07:22:17.768 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.766+0000 7fddadca8740 20 client.17160 trim_cache size 0 max 16384 2024-09-19T07:22:17.769 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:22:17.769 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:22:17.769 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:22:17.769 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:22:17.770 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.767+0000 7fddaaf11640 1 -- 172.21.15.148:0/3683589420 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fdd940a3460 msgr2=0x7fdd940a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:17.770 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.767+0000 7fddaaf11640 1 --2- 172.21.15.148:0/3683589420 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fdd940a3460 0x7fdd940a5920 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdd90009710 tx=0x7fdd90009ad0 comp rx=0 tx=0).stop 2024-09-19T07:22:17.770 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.767+0000 7fddaaf11640 1 -- 172.21.15.148:0/3683589420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdda419cbf0 msgr2=0x7fdda419d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:17.770 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.767+0000 7fddaaf11640 1 --2- 172.21.15.148:0/3683589420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdda419cbf0 0x7fdda419d0a0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c009fd0 tx=0x7fdd9c00ef10 comp rx=0 tx=0).stop 2024-09-19T07:22:17.770 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.767+0000 7fddaaf11640 1 -- 172.21.15.148:0/3683589420 shutdown_connections 2024-09-19T07:22:17.771 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.767+0000 7fddaaf11640 1 --2- 172.21.15.148:0/3683589420 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fdd940a3460 0x7fdd940a5920 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:17.771 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.767+0000 7fddaaf11640 1 --2- 172.21.15.148:0/3683589420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdda419cbf0 0x7fdda419d0a0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:17.771 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.767+0000 7fddaaf11640 1 --2- 172.21.15.148:0/3683589420 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdda41080f0 0x7fdda4198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:17.771 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.767+0000 7fddaaf11640 1 --2- 172.21.15.148:0/3683589420 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdda41008a0 0x7fdda4198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:17.771 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.767+0000 7fddaaf11640 1 -- 172.21.15.148:0/3683589420 >> 172.21.15.148:0/3683589420 conn(0x7fdda4075ef0 msgr2=0x7fdda40ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:17.771 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.767+0000 7fddaaf11640 1 -- 172.21.15.148:0/3683589420 shutdown_connections 2024-09-19T07:22:17.771 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:17.767+0000 7fddaaf11640 1 -- 172.21.15.148:0/3683589420 wait complete. 2024-09-19T07:22:17.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:22:17 smithi179 ceph-mon[35716]: pgmap v349: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-09-19T07:22:18.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:18.102+0000 7f56b3fff640 1 -- 172.21.15.148:0/3777545282 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5596278300a0 con 0x5596279497e0 2024-09-19T07:22:18.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:18.102+0000 7f56b3fff640 10 client.17142 handle_command_reply: tid=0 2024-09-19T07:22:18.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:18.102+0000 7f56dd1e4740 1 client.17142 shutdown 2024-09-19T07:22:18.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:18.103+0000 7f56dd1e4740 1 -- 172.21.15.148:0/3777545282 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5596278ce240 msgr2=0x5596278d2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:18.105 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:18.103+0000 7f56dd1e4740 1 --2- 172.21.15.148:0/3777545282 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5596278ce240 0x5596278d2c80 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f56cc01d460 tx=0x7f56cc00aa20 comp rx=0 tx=0).stop 2024-09-19T07:22:18.105 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:18.103+0000 7f56dd1e4740 1 -- 172.21.15.148:0/3777545282 shutdown_connections 2024-09-19T07:22:18.105 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:18.103+0000 7f56dd1e4740 1 --2- 172.21.15.148:0/3777545282 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5596279497e0 0x55962794bc00 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:18.105 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:18.103+0000 7f56b3fff640 0 client.17142 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:22:18.105 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:18.103+0000 7f56dd1e4740 1 --2- 172.21.15.148:0/3777545282 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5596278ce240 0x5596278d2c80 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:18.105 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:18.103+0000 7f56dd1e4740 1 --2- 172.21.15.148:0/3777545282 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5596278c3980 0x5596278d2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:18.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:18.103+0000 7f56dd1e4740 1 --2- 172.21.15.148:0/3777545282 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596278c3060 0x5596278d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:18.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:18.103+0000 7f56dd1e4740 1 -- 172.21.15.148:0/3777545282 >> 172.21.15.148:0/3777545282 conn(0x5596278bf5f0 msgr2=0x5596278bdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:18.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:18.103+0000 7f56dd1e4740 1 -- 172.21.15.148:0/3777545282 shutdown_connections 2024-09-19T07:22:18.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:18.103+0000 7f56dd1e4740 1 -- 172.21.15.148:0/3777545282 wait complete. 2024-09-19T07:22:18.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:18.103+0000 7f56dd1e4740 20 client.17142 trim_cache size 0 max 16384 2024-09-19T07:22:18.107 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:22:18.107 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 43, 2024-09-19T07:22:18.107 INFO:teuthology.orchestra.run.smithi148.stdout: "leader": 24457, 2024-09-19T07:22:18.108 INFO:teuthology.orchestra.run.smithi148.stdout: "set_version": 40, 2024-09-19T07:22:18.108 INFO:teuthology.orchestra.run.smithi148.stdout: "sets": { 2024-09-19T07:22:18.108 INFO:teuthology.orchestra.run.smithi148.stdout: "8900e1a2": { 2024-09-19T07:22:18.108 INFO:teuthology.orchestra.run.smithi148.stdout: "version": 40, 2024-09-19T07:22:18.108 INFO:teuthology.orchestra.run.smithi148.stdout: "age_ref": 0.0, 2024-09-19T07:22:18.108 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:22:18.109 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RELEASED", 2024-09-19T07:22:18.109 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:22:18.109 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:22:18.109 INFO:teuthology.orchestra.run.smithi148.stdout: "timeout": 90.0, 2024-09-19T07:22:18.109 INFO:teuthology.orchestra.run.smithi148.stdout: "expiration": 150.0, 2024-09-19T07:22:18.110 INFO:teuthology.orchestra.run.smithi148.stdout: "members": { 2024-09-19T07:22:18.110 INFO:teuthology.orchestra.run.smithi148.stdout: "file:/": { 2024-09-19T07:22:18.110 INFO:teuthology.orchestra.run.smithi148.stdout: "excluded": false, 2024-09-19T07:22:18.110 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:22:18.110 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RELEASED", 2024-09-19T07:22:18.110 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:22:18.111 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:22:18.111 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:22:18.112 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:22:18.112 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:22:18.112 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:22:18.112 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:22:18.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:18.104+0000 7f56dae0b640 1 -- 172.21.15.148:0/2992860292 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f56c40a33b0 msgr2=0x7f56c40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:18.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:18.104+0000 7f56dae0b640 1 --2- 172.21.15.148:0/2992860292 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f56c40a33b0 0x7f56c40a5870 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f56cc012790 tx=0x7f56cc00a380 comp rx=0 tx=0).stop 2024-09-19T07:22:18.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:18.104+0000 7f56dae0b640 1 -- 172.21.15.148:0/2992860292 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56d4102790 msgr2=0x7f56d4074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:18.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:18.104+0000 7f56dae0b640 1 --2- 172.21.15.148:0/2992860292 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56d4102790 0x7f56d4074a30 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f56c000d770 tx=0x7f56c000dc30 comp rx=0 tx=0).stop 2024-09-19T07:22:18.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:18.104+0000 7f56dae0b640 1 -- 172.21.15.148:0/2992860292 shutdown_connections 2024-09-19T07:22:18.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:18.104+0000 7f56dae0b640 1 --2- 172.21.15.148:0/2992860292 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f56c40a33b0 0x7f56c40a5870 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:18.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:18.104+0000 7f56dae0b640 1 --2- 172.21.15.148:0/2992860292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56d4106f10 0x7f56d4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:18.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:18.104+0000 7f56dae0b640 1 --2- 172.21.15.148:0/2992860292 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56d4102790 0x7f56d4074a30 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:18.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:18.104+0000 7f56dae0b640 1 --2- 172.21.15.148:0/2992860292 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f56d4101de0 0x7f56d40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:18.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:18.104+0000 7f56dae0b640 1 -- 172.21.15.148:0/2992860292 >> 172.21.15.148:0/2992860292 conn(0x7f56d40fd8c0 msgr2=0x7f56d40febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:18.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:18.104+0000 7f56dae0b640 1 -- 172.21.15.148:0/2992860292 shutdown_connections 2024-09-19T07:22:18.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:22:18.104+0000 7f56dae0b640 1 -- 172.21.15.148:0/2992860292 wait complete. 2024-09-19T07:22:18.861 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '8900e1a2', total seconds elapsed: 34.6 2024-09-19T07:22:19.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:22:19 smithi148 ceph-mon[31180]: pgmap v350: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.8 KiB/s wr, 7 op/s 2024-09-19T07:22:19.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:22:19 smithi148 ceph-mon[31180]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T07:22:19.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:22:19 smithi165 ceph-mon[35326]: pgmap v350: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.8 KiB/s wr, 7 op/s 2024-09-19T07:22:19.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:22:19 smithi165 ceph-mon[35326]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T07:22:19.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:22:19 smithi179 ceph-mon[35716]: pgmap v350: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.8 KiB/s wr, 7 op/s 2024-09-19T07:22:19.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:22:19 smithi179 ceph-mon[35716]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T07:22:21.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:22:21 smithi148 ceph-mon[31180]: pgmap v352: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-09-19T07:22:21.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:22:21 smithi165 ceph-mon[35326]: pgmap v352: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-09-19T07:22:21.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:22:21 smithi179 ceph-mon[35716]: pgmap v352: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-09-19T07:22:23.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:22:23 smithi148 ceph-mon[31180]: pgmap v353: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 9 op/s 2024-09-19T07:22:23.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:22:23 smithi165 ceph-mon[35326]: pgmap v353: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 9 op/s 2024-09-19T07:22:23.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:22:23 smithi179 ceph-mon[35716]: pgmap v353: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 9 op/s 2024-09-19T07:22:25.575 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:22:25 smithi179 ceph-mon[35716]: pgmap v354: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 9 op/s 2024-09-19T07:22:25.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:22:25 smithi148 ceph-mon[31180]: pgmap v354: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 9 op/s 2024-09-19T07:22:25.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:22:25 smithi165 ceph-mon[35326]: pgmap v354: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 9 op/s 2024-09-19T07:22:27.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:22:27 smithi148 ceph-mon[31180]: pgmap v355: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-09-19T07:22:27.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:22:27 smithi165 ceph-mon[35326]: pgmap v355: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-09-19T07:22:27.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:22:27 smithi179 ceph-mon[35716]: pgmap v355: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-09-19T07:22:29.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:22:29 smithi148 ceph-mon[31180]: pgmap v356: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-09-19T07:22:29.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:22:29 smithi165 ceph-mon[35326]: pgmap v356: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-09-19T07:22:29.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:22:29 smithi179 ceph-mon[35716]: pgmap v356: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-09-19T07:22:30.866 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.863+0000 7fabc50f1640 1 -- 172.21.15.148:0/388885836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabc0101ae0 msgr2=0x7fabc0101f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:30.867 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.863+0000 7fabc50f1640 1 --2- 172.21.15.148:0/388885836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabc0101ae0 0x7fabc0101f40 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fabb4009930 tx=0x7fabb402a420 comp rx=0 tx=0).stop 2024-09-19T07:22:30.867 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.863+0000 7fabc50f1640 1 -- 172.21.15.148:0/388885836 shutdown_connections 2024-09-19T07:22:30.867 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.863+0000 7fabc50f1640 1 --2- 172.21.15.148:0/388885836 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fabc0102480 0x7fabc010e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:30.867 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.863+0000 7fabc50f1640 1 --2- 172.21.15.148:0/388885836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabc0101ae0 0x7fabc0101f40 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:30.867 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.863+0000 7fabc50f1640 1 --2- 172.21.15.148:0/388885836 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabc0107b80 0x7fabc0107f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:30.867 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.863+0000 7fabc50f1640 1 -- 172.21.15.148:0/388885836 >> 172.21.15.148:0/388885836 conn(0x7fabc00fd7e0 msgr2=0x7fabc00ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:30.867 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.864+0000 7fabc50f1640 1 -- 172.21.15.148:0/388885836 shutdown_connections 2024-09-19T07:22:30.867 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.864+0000 7fabc50f1640 1 -- 172.21.15.148:0/388885836 wait complete. 2024-09-19T07:22:30.867 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.864+0000 7fabc50f1640 1 Processor -- start 2024-09-19T07:22:30.867 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.865+0000 7fabc50f1640 1 -- start start 2024-09-19T07:22:30.868 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.865+0000 7fabc50f1640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fabc0101ae0 0x7fabc0198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:30.868 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.865+0000 7fabc50f1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabc0102480 0x7fabc01988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:30.868 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.865+0000 7fabc50f1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabc0107b80 0x7fabc019cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:30.868 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.865+0000 7fabc50f1640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fabc0111ef0 con 0x7fabc0102480 2024-09-19T07:22:30.868 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.865+0000 7fabc50f1640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fabc0111d70 con 0x7fabc0101ae0 2024-09-19T07:22:30.868 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.865+0000 7fabc50f1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fabc0112070 con 0x7fabc0107b80 2024-09-19T07:22:30.868 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.865+0000 7fabbe59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabc0102480 0x7fabc01988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:30.868 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.865+0000 7fabbe59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabc0102480 0x7fabc01988c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42058/0 (socket says 172.21.15.148:42058) 2024-09-19T07:22:30.868 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.865+0000 7fabbe59c640 1 -- 172.21.15.148:0/302900188 learned_addr learned my addr 172.21.15.148:0/302900188 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:22:30.868 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.865+0000 7fabbf59e640 1 --2- 172.21.15.148:0/302900188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabc0107b80 0x7fabc019cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:30.868 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.865+0000 7fabbed9d640 1 --2- 172.21.15.148:0/302900188 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fabc0101ae0 0x7fabc0198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:30.868 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.865+0000 7fabbe59c640 1 -- 172.21.15.148:0/302900188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabc0107b80 msgr2=0x7fabc019cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:30.869 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.865+0000 7fabbe59c640 1 --2- 172.21.15.148:0/302900188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabc0107b80 0x7fabc019cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:30.869 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.865+0000 7fabbe59c640 1 -- 172.21.15.148:0/302900188 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fabc0101ae0 msgr2=0x7fabc0198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:30.869 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.865+0000 7fabbe59c640 1 --2- 172.21.15.148:0/302900188 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fabc0101ae0 0x7fabc0198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:30.869 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.865+0000 7fabbe59c640 1 -- 172.21.15.148:0/302900188 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabc019d370 con 0x7fabc0102480 2024-09-19T07:22:30.869 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.865+0000 7fabbed9d640 1 --2- 172.21.15.148:0/302900188 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fabc0101ae0 0x7fabc0198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:22:30.869 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.865+0000 7fabbe59c640 1 --2- 172.21.15.148:0/302900188 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabc0102480 0x7fabc01988c0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fabb4009230 tx=0x7fabb4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:30.869 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.866+0000 7faba7fff640 1 -- 172.21.15.148:0/302900188 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb403f030 con 0x7fabc0102480 2024-09-19T07:22:30.869 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.866+0000 7fabc50f1640 1 -- 172.21.15.148:0/302900188 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabc019d600 con 0x7fabc0102480 2024-09-19T07:22:30.869 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.866+0000 7faba7fff640 1 -- 172.21.15.148:0/302900188 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fabb4003ad0 con 0x7fabc0102480 2024-09-19T07:22:30.869 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.866+0000 7faba7fff640 1 -- 172.21.15.148:0/302900188 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb4035070 con 0x7fabc0102480 2024-09-19T07:22:30.869 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.866+0000 7fabc50f1640 1 -- 172.21.15.148:0/302900188 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabc01a4ef0 con 0x7fabc0102480 2024-09-19T07:22:30.876 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.868+0000 7faba7fff640 1 -- 172.21.15.148:0/302900188 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fabb4042030 con 0x7fabc0102480 2024-09-19T07:22:30.876 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.868+0000 7fabc7e8d740 1 Processor -- start 2024-09-19T07:22:30.876 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.869+0000 7fabc7e8d740 1 -- start start 2024-09-19T07:22:30.876 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.869+0000 7fabc7e8d740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e865701af0 0x55e865701ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:30.876 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.869+0000 7fabc7e8d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e865702410 0x55e86570c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:30.876 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.869+0000 7fabc7e8d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e86570ccb0 0x55e86570f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:30.876 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.869+0000 7fabc7e8d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55e8656662f0 con 0x55e865702410 2024-09-19T07:22:30.876 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.869+0000 7fabc7e8d740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55e86560e270 con 0x55e865701af0 2024-09-19T07:22:30.876 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.869+0000 7fabc7e8d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55e8656622b0 con 0x55e86570ccb0 2024-09-19T07:22:30.877 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.869+0000 7fabbed9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e865702410 0x55e86570c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:30.877 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.869+0000 7fabbed9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e865702410 0x55e86570c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42066/0 (socket says 172.21.15.148:42066) 2024-09-19T07:22:30.877 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.869+0000 7fabbed9d640 1 -- 172.21.15.148:0/844428232 learned_addr learned my addr 172.21.15.148:0/844428232 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:22:30.877 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.869+0000 7fabbe59c640 1 --2- 172.21.15.148:0/844428232 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e86570ccb0 0x55e86570f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:30.877 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.869+0000 7faba7fff640 1 --2- 172.21.15.148:0/302900188 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7faba80a3460 0x7faba80a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:30.877 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.869+0000 7fabbf59e640 1 --2- 172.21.15.148:0/844428232 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e865701af0 0x55e865701ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:30.877 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.869+0000 7fabbf59e640 1 --2- 172.21.15.148:0/302900188 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7faba80a3460 0x7faba80a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:30.877 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.869+0000 7fabbed9d640 1 -- 172.21.15.148:0/844428232 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e86570ccb0 msgr2=0x55e86570f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:30.877 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.869+0000 7fabbed9d640 1 --2- 172.21.15.148:0/844428232 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e86570ccb0 0x55e86570f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:30.877 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.869+0000 7fabbed9d640 1 -- 172.21.15.148:0/844428232 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e865701af0 msgr2=0x55e865701ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:30.877 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.869+0000 7fabbed9d640 1 --2- 172.21.15.148:0/844428232 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e865701af0 0x55e865701ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:30.877 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.869+0000 7fabbed9d640 1 -- 172.21.15.148:0/844428232 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e86560d340 con 0x55e865702410 2024-09-19T07:22:30.878 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.869+0000 7faba7fff640 1 -- 172.21.15.148:0/302900188 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8556+0+0 (secure 0 0 0) 0x7fabb40f0320 con 0x7fabc0102480 2024-09-19T07:22:30.878 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.870+0000 7fabbed9d640 1 --2- 172.21.15.148:0/844428232 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e865702410 0x55e86570c770 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fabb0009ec0 tx=0x7fabb000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49c7cdcf9213fec2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:30.878 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.870+0000 7fabbf59e640 1 --2- 172.21.15.148:0/302900188 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7faba80a3460 0x7faba80a5920 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fabb800cfd0 tx=0x7fabb8004730 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:30.878 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.870+0000 7faba57fa640 1 -- 172.21.15.148:0/844428232 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb0003b70 con 0x55e865702410 2024-09-19T07:22:30.878 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.870+0000 7faba57fa640 1 -- 172.21.15.148:0/844428232 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fabb0003d10 con 0x55e865702410 2024-09-19T07:22:30.878 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.870+0000 7faba57fa640 1 -- 172.21.15.148:0/844428232 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb00119e0 con 0x55e865702410 2024-09-19T07:22:30.878 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.870+0000 7fabc7e8d740 1 -- 172.21.15.148:0/844428232 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e865702410 msgr2=0x55e86570c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:30.878 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.870+0000 7fabc7e8d740 1 --2- 172.21.15.148:0/844428232 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e865702410 0x55e86570c770 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fabb0009ec0 tx=0x7fabb000f730 comp rx=0 tx=0).stop 2024-09-19T07:22:30.878 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.871+0000 7fabc7e8d740 1 -- 172.21.15.148:0/844428232 shutdown_connections 2024-09-19T07:22:30.878 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.871+0000 7fabc7e8d740 1 --2- 172.21.15.148:0/844428232 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e86570ccb0 0x55e86570f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:30.878 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.871+0000 7fabc7e8d740 1 --2- 172.21.15.148:0/844428232 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e865702410 0x55e86570c770 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:30.879 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.871+0000 7fabc7e8d740 1 --2- 172.21.15.148:0/844428232 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e865701af0 0x55e865701ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:30.879 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.871+0000 7fabc7e8d740 1 -- 172.21.15.148:0/844428232 >> 172.21.15.148:0/844428232 conn(0x55e8656fe060 msgr2=0x55e8656fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:30.879 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.871+0000 7fabc7e8d740 1 -- 172.21.15.148:0/844428232 shutdown_connections 2024-09-19T07:22:30.879 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.871+0000 7fabc7e8d740 1 -- 172.21.15.148:0/844428232 wait complete. 2024-09-19T07:22:30.879 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.871+0000 7fabc7e8d740 1 -- start start 2024-09-19T07:22:30.879 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.871+0000 7fabc7e8d740 1 Processor -- start 2024-09-19T07:22:30.879 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.871+0000 7fabc7e8d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e865701af0 0x55e865709b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:30.879 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.871+0000 7fabc7e8d740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e865702410 0x55e86570a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:30.879 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.871+0000 7fabc7e8d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e86570ccb0 0x55e86570a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:30.879 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.871+0000 7fabc7e8d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55e86570f880 con 0x55e865701af0 2024-09-19T07:22:30.879 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.871+0000 7fabc7e8d740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55e8655ef290 con 0x55e865702410 2024-09-19T07:22:30.879 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.871+0000 7fabc7e8d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55e86570fa00 con 0x55e86570ccb0 2024-09-19T07:22:30.879 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.871+0000 7fabc7e8d740 10 client.0 _ll_register_callbacks cb 0x55e865620140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:22:30.880 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.871+0000 7fabbed9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e865701af0 0x55e865709b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:30.880 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.871+0000 7fabbed9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e865701af0 0x55e865709b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42082/0 (socket says 172.21.15.148:42082) 2024-09-19T07:22:30.880 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.871+0000 7fabbed9d640 1 -- 172.21.15.148:0/3816744881 learned_addr learned my addr 172.21.15.148:0/3816744881 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:22:30.880 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.872+0000 7fabbe59c640 1 --2- 172.21.15.148:0/3816744881 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e865702410 0x55e86570a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:30.880 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.872+0000 7fabbf59e640 1 --2- 172.21.15.148:0/3816744881 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e86570ccb0 0x55e86570a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:30.880 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.872+0000 7fabbed9d640 1 -- 172.21.15.148:0/3816744881 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e86570ccb0 msgr2=0x55e86570a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:30.880 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.872+0000 7fabbed9d640 1 --2- 172.21.15.148:0/3816744881 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e86570ccb0 0x55e86570a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:30.880 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.872+0000 7fabbed9d640 1 -- 172.21.15.148:0/3816744881 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e865702410 msgr2=0x55e86570a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:30.880 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.872+0000 7fabbed9d640 1 --2- 172.21.15.148:0/3816744881 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e865702410 0x55e86570a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:30.880 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.872+0000 7fabbed9d640 1 -- 172.21.15.148:0/3816744881 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e865379210 con 0x55e865701af0 2024-09-19T07:22:30.880 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.872+0000 7fabbed9d640 1 --2- 172.21.15.148:0/3816744881 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e865701af0 0x55e865709b70 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fabb0006010 tx=0x7fabb000ffd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29f856ddb63d22e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:30.881 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.872+0000 7faba2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:22:30.881 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.872+0000 7faba2ff5640 1 -- 172.21.15.148:0/3816744881 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb0004a40 con 0x55e865701af0 2024-09-19T07:22:30.881 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.872+0000 7faba2ff5640 1 -- 172.21.15.148:0/3816744881 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8556+0+0 (secure 0 0 0) 0x7fabb0004be0 con 0x55e865701af0 2024-09-19T07:22:30.881 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.872+0000 7fabc7e8d740 1 -- 172.21.15.148:0/3816744881 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fabb0003d10 con 0x55e865701af0 2024-09-19T07:22:30.881 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.872+0000 7faba2ff5640 1 -- 172.21.15.148:0/3816744881 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fabb0004e00 con 0x55e865701af0 2024-09-19T07:22:30.881 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.872+0000 7fabc7e8d740 10 client.17172 fetch_fsmap learned FSMap version 43 2024-09-19T07:22:30.881 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.872+0000 7fabc7e8d740 1 -- 172.21.15.148:0/3816744881 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55e865445620 con 0x55e865701af0 2024-09-19T07:22:30.881 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.872+0000 7faba2ff5640 1 -- 172.21.15.148:0/3816744881 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fabb0003d10 con 0x55e865701af0 2024-09-19T07:22:30.881 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.873+0000 7faba2ff5640 1 -- 172.21.15.148:0/3816744881 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 43) ==== 8362+0+0 (secure 0 0 0) 0x7fabb0011a20 con 0x55e865701af0 2024-09-19T07:22:30.881 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.873+0000 7fabc7e8d740 10 client.17172 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T07:22:30.881 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.873+0000 7fabc7e8d740 10 client.17172 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:22:30.881 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.873+0000 7fabc7e8d740 20 client.17172 populate_metadata read hostname 'smithi148' 2024-09-19T07:22:30.881 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.873+0000 7fabc7e8d740 1 --2- 172.21.15.148:0/3816744881 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e86571cc30 0x55e86571f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:30.882 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.873+0000 7fabc7e8d740 4 client.17172 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:22:30.882 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.873+0000 7fabc7e8d740 1 -- 172.21.15.148:0/3816744881 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e865673a20 con 0x55e86571cc30 2024-09-19T07:22:30.882 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.873+0000 7fabbe59c640 1 --2- 172.21.15.148:0/3816744881 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e86571cc30 0x55e86571f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:30.882 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.873+0000 7faba2ff5640 10 client.17172 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:22:30.882 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.873+0000 7fabbe59c640 1 --2- 172.21.15.148:0/3816744881 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e86571cc30 0x55e86571f020 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8acc8308c62d93df server_cookie=5570f4317f9d490c in_seq=0 out_seq=0 2024-09-19T07:22:30.882 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.874+0000 7faba2ff5640 1 -- 172.21.15.148:0/3816744881 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e865673a20 con 0x55e86571cc30 2024-09-19T07:22:30.882 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.874+0000 7faba2ff5640 10 client.17172 handle_command_reply: tid=0 2024-09-19T07:22:30.882 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.874+0000 7fabc7e8d740 1 client.17172 shutdown 2024-09-19T07:22:30.882 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.874+0000 7fabc7e8d740 1 -- 172.21.15.148:0/3816744881 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e865701af0 msgr2=0x55e865709b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:30.883 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.874+0000 7fabc7e8d740 1 --2- 172.21.15.148:0/3816744881 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e865701af0 0x55e865709b70 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fabb0006010 tx=0x7fabb000ffd0 comp rx=0 tx=0).stop 2024-09-19T07:22:30.883 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.874+0000 7fabc7e8d740 1 -- 172.21.15.148:0/3816744881 shutdown_connections 2024-09-19T07:22:30.883 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.874+0000 7fabc7e8d740 1 --2- 172.21.15.148:0/3816744881 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e86571cc30 0x55e86571f020 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:30.883 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.874+0000 7fabc7e8d740 1 --2- 172.21.15.148:0/3816744881 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e86570ccb0 0x55e86570a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:30.883 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.874+0000 7fabc7e8d740 1 --2- 172.21.15.148:0/3816744881 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e865702410 0x55e86570a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:30.883 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.874+0000 7fabc7e8d740 1 --2- 172.21.15.148:0/3816744881 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e865701af0 0x55e865709b70 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:30.884 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.874+0000 7faba2ff5640 0 client.17172 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:22:30.884 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.874+0000 7fabc7e8d740 1 -- 172.21.15.148:0/3816744881 >> 172.21.15.148:0/3816744881 conn(0x55e8656fe060 msgr2=0x55e865703dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:30.884 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.874+0000 7fabc7e8d740 1 -- 172.21.15.148:0/3816744881 shutdown_connections 2024-09-19T07:22:30.884 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.874+0000 7fabc7e8d740 1 -- 172.21.15.148:0/3816744881 wait complete. 2024-09-19T07:22:30.884 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.874+0000 7fabc7e8d740 20 client.17172 trim_cache size 0 max 16384 2024-09-19T07:22:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.889+0000 7fabc7e8d740 1 Processor -- start 2024-09-19T07:22:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.889+0000 7fabc7e8d740 1 -- start start 2024-09-19T07:22:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.889+0000 7fabc7e8d740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e865701af0 0x55e86570a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.889+0000 7fabc7e8d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e865702410 0x55e865715070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.889+0000 7fabc7e8d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e86570ccb0 0x55e8657155b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.889+0000 7fabc7e8d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fabc01b0210 con 0x55e865702410 2024-09-19T07:22:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.889+0000 7fabc7e8d740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fabc01ada80 con 0x55e865701af0 2024-09-19T07:22:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.889+0000 7fabc7e8d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fabc01ab8f0 con 0x55e86570ccb0 2024-09-19T07:22:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.889+0000 7fabbe59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e865702410 0x55e865715070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.889+0000 7fabbe59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e865702410 0x55e865715070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42088/0 (socket says 172.21.15.148:42088) 2024-09-19T07:22:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.889+0000 7fabbe59c640 1 -- 172.21.15.148:0/595782387 learned_addr learned my addr 172.21.15.148:0/595782387 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:22:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.889+0000 7fabbed9d640 1 --2- 172.21.15.148:0/595782387 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e865701af0 0x55e86570a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.889+0000 7fabbe59c640 1 -- 172.21.15.148:0/595782387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e86570ccb0 msgr2=0x55e8657155b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.889+0000 7fabbe59c640 1 --2- 172.21.15.148:0/595782387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e86570ccb0 0x55e8657155b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.889+0000 7fabbe59c640 1 -- 172.21.15.148:0/595782387 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e865701af0 msgr2=0x55e86570a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.889+0000 7fabbe59c640 1 --2- 172.21.15.148:0/595782387 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e865701af0 0x55e86570a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.889+0000 7fabbe59c640 1 -- 172.21.15.148:0/595782387 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8656fde90 con 0x55e865702410 2024-09-19T07:22:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.889+0000 7fabbe59c640 1 --2- 172.21.15.148:0/595782387 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e865702410 0x55e865715070 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fabb40bc280 tx=0x7fabb40b88d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c77b36a6b6985cbc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.889+0000 7faba4ff9640 1 -- 172.21.15.148:0/595782387 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb4049040 con 0x55e865702410 2024-09-19T07:22:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.889+0000 7faba4ff9640 1 -- 172.21.15.148:0/595782387 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fabb40bc580 con 0x55e865702410 2024-09-19T07:22:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.889+0000 7faba4ff9640 1 -- 172.21.15.148:0/595782387 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb4003c80 con 0x55e865702410 2024-09-19T07:22:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.890+0000 7fabc7e8d740 1 -- 172.21.15.148:0/595782387 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e865702410 msgr2=0x55e865715070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.890+0000 7fabc7e8d740 1 --2- 172.21.15.148:0/595782387 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e865702410 0x55e865715070 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fabb40bc280 tx=0x7fabb40b88d0 comp rx=0 tx=0).stop 2024-09-19T07:22:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.890+0000 7fabc7e8d740 1 -- 172.21.15.148:0/595782387 shutdown_connections 2024-09-19T07:22:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.890+0000 7fabc7e8d740 1 --2- 172.21.15.148:0/595782387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e86570ccb0 0x55e8657155b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.890+0000 7fabc7e8d740 1 --2- 172.21.15.148:0/595782387 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e865702410 0x55e865715070 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.890+0000 7fabc7e8d740 1 --2- 172.21.15.148:0/595782387 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e865701af0 0x55e86570a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.890+0000 7fabc7e8d740 1 -- 172.21.15.148:0/595782387 >> 172.21.15.148:0/595782387 conn(0x55e8656fe060 msgr2=0x55e86570bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:30.901 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.890+0000 7fabc7e8d740 1 -- 172.21.15.148:0/595782387 shutdown_connections 2024-09-19T07:22:30.901 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.890+0000 7fabc7e8d740 1 -- 172.21.15.148:0/595782387 wait complete. 2024-09-19T07:22:30.901 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.890+0000 7fabc7e8d740 1 -- start start 2024-09-19T07:22:30.901 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.890+0000 7fabc7e8d740 1 Processor -- start 2024-09-19T07:22:30.901 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.891+0000 7fabc7e8d740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e865701af0 0x55e865707740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:30.901 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.891+0000 7fabc7e8d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e865702410 0x55e865724170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:30.901 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.891+0000 7fabc7e8d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e86570ccb0 0x55e8657246b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:30.901 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.891+0000 7fabc7e8d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fabc01abf40 con 0x55e865702410 2024-09-19T07:22:30.901 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.891+0000 7fabc7e8d740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fabc01ad3b0 con 0x55e865701af0 2024-09-19T07:22:30.901 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.891+0000 7fabc7e8d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fabc01ac610 con 0x55e86570ccb0 2024-09-19T07:22:30.901 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.891+0000 7fabc7e8d740 10 client.0 _ll_register_callbacks cb 0x7fabb800c2d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:22:30.902 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.891+0000 7fabbe59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e865702410 0x55e865724170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:30.902 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.891+0000 7fabbe59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e865702410 0x55e865724170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42096/0 (socket says 172.21.15.148:42096) 2024-09-19T07:22:30.902 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.891+0000 7fabbe59c640 1 -- 172.21.15.148:0/4213527332 learned_addr learned my addr 172.21.15.148:0/4213527332 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:22:30.902 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.891+0000 7fabbf59e640 1 --2- 172.21.15.148:0/4213527332 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e86570ccb0 0x55e8657246b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:30.902 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.891+0000 7fabbed9d640 1 --2- 172.21.15.148:0/4213527332 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e865701af0 0x55e865707740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:30.902 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.891+0000 7fabbe59c640 1 -- 172.21.15.148:0/4213527332 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e86570ccb0 msgr2=0x55e8657246b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:30.902 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.891+0000 7fabbe59c640 1 --2- 172.21.15.148:0/4213527332 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e86570ccb0 0x55e8657246b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:30.902 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.891+0000 7fabbe59c640 1 -- 172.21.15.148:0/4213527332 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e865701af0 msgr2=0x55e865707740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:30.902 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.891+0000 7fabbe59c640 1 --2- 172.21.15.148:0/4213527332 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e865701af0 0x55e865707740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:30.902 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.891+0000 7fabbe59c640 1 -- 172.21.15.148:0/4213527332 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e865724ee0 con 0x55e865702410 2024-09-19T07:22:30.902 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.891+0000 7fabbe59c640 1 --2- 172.21.15.148:0/4213527332 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e865702410 0x55e865724170 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fabb4009900 tx=0x7fabb4009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d018067072421c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:30.902 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.891+0000 7faba2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:22:30.902 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.891+0000 7faba2ff5640 1 -- 172.21.15.148:0/4213527332 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb4049070 con 0x55e865702410 2024-09-19T07:22:30.903 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.891+0000 7faba2ff5640 1 -- 172.21.15.148:0/4213527332 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8556+0+0 (secure 0 0 0) 0x7fabb40edc70 con 0x55e865702410 2024-09-19T07:22:30.903 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.891+0000 7fabc7e8d740 1 -- 172.21.15.148:0/4213527332 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fabb40bc580 con 0x55e865702410 2024-09-19T07:22:30.903 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.892+0000 7faba2ff5640 1 -- 172.21.15.148:0/4213527332 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fabb40ede70 con 0x55e865702410 2024-09-19T07:22:30.903 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.892+0000 7fabc7e8d740 10 client.17178 fetch_fsmap learned FSMap version 43 2024-09-19T07:22:30.903 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.892+0000 7fabc7e8d740 1 -- 172.21.15.148:0/4213527332 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55e86578b710 con 0x55e865702410 2024-09-19T07:22:30.903 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.892+0000 7faba2ff5640 1 -- 172.21.15.148:0/4213527332 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fabb40bc580 con 0x55e865702410 2024-09-19T07:22:30.903 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.892+0000 7faba2ff5640 1 -- 172.21.15.148:0/4213527332 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 43) ==== 8362+0+0 (secure 0 0 0) 0x7fabb4031bd0 con 0x55e865702410 2024-09-19T07:22:30.903 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.892+0000 7fabc7e8d740 10 client.17178 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T07:22:30.903 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.892+0000 7fabc7e8d740 10 client.17178 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:22:30.903 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.892+0000 7fabc7e8d740 20 client.17178 populate_metadata read hostname 'smithi148' 2024-09-19T07:22:30.904 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.892+0000 7fabc7e8d740 1 --2- 172.21.15.148:0/4213527332 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e86578bec0 0x55e86578e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:30.904 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.892+0000 7fabc7e8d740 4 client.17178 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:22:30.904 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.892+0000 7fabc7e8d740 1 -- 172.21.15.148:0/4213527332 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e86566dd70 con 0x55e86578bec0 2024-09-19T07:22:30.904 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.892+0000 7fabbed9d640 1 --2- 172.21.15.148:0/4213527332 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e86578bec0 0x55e86578e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:30.904 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.893+0000 7fabbed9d640 1 --2- 172.21.15.148:0/4213527332 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e86578bec0 0x55e86578e2e0 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56a31b780235b827 server_cookie=f2316ba4cc625743 in_seq=0 out_seq=0 2024-09-19T07:22:30.904 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.893+0000 7faba2ff5640 10 client.17178 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:22:30.910 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.908+0000 7faba2ff5640 1 -- 172.21.15.148:0/4213527332 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e86566dd70 con 0x55e86578bec0 2024-09-19T07:22:30.910 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.908+0000 7faba2ff5640 10 client.17178 handle_command_reply: tid=0 2024-09-19T07:22:30.910 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.908+0000 7fabc7e8d740 1 client.17178 shutdown 2024-09-19T07:22:30.910 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.909+0000 7fabc7e8d740 1 -- 172.21.15.148:0/4213527332 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e865702410 msgr2=0x55e865724170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:30.910 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.909+0000 7fabc7e8d740 1 --2- 172.21.15.148:0/4213527332 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e865702410 0x55e865724170 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fabb4009900 tx=0x7fabb4009260 comp rx=0 tx=0).stop 2024-09-19T07:22:30.910 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.909+0000 7fabc7e8d740 1 -- 172.21.15.148:0/4213527332 shutdown_connections 2024-09-19T07:22:30.911 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.909+0000 7fabc7e8d740 1 --2- 172.21.15.148:0/4213527332 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e86578bec0 0x55e86578e2e0 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:30.911 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.909+0000 7fabc7e8d740 1 --2- 172.21.15.148:0/4213527332 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e86570ccb0 0x55e8657246b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:30.911 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.909+0000 7faba2ff5640 0 client.17178 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:22:30.911 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.909+0000 7fabc7e8d740 1 --2- 172.21.15.148:0/4213527332 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e865702410 0x55e865724170 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:30.911 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.909+0000 7fabc7e8d740 1 --2- 172.21.15.148:0/4213527332 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e865701af0 0x55e865707740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:30.911 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.909+0000 7fabc7e8d740 1 -- 172.21.15.148:0/4213527332 >> 172.21.15.148:0/4213527332 conn(0x55e8656fe060 msgr2=0x55e86570bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:30.911 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.909+0000 7fabc7e8d740 1 -- 172.21.15.148:0/4213527332 shutdown_connections 2024-09-19T07:22:30.912 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.909+0000 7fabc7e8d740 1 -- 172.21.15.148:0/4213527332 wait complete. 2024-09-19T07:22:30.912 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.909+0000 7fabc7e8d740 20 client.17178 trim_cache size 0 max 16384 2024-09-19T07:22:30.912 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:22:30.912 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:22:30.912 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:22:30.912 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:22:30.913 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.909+0000 7fabc50f1640 1 -- 172.21.15.148:0/302900188 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7faba80a3460 msgr2=0x7faba80a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:30.913 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.909+0000 7fabc50f1640 1 --2- 172.21.15.148:0/302900188 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7faba80a3460 0x7faba80a5920 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fabb800cfd0 tx=0x7fabb8004730 comp rx=0 tx=0).stop 2024-09-19T07:22:30.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.909+0000 7fabc50f1640 1 -- 172.21.15.148:0/302900188 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabc0102480 msgr2=0x7fabc01988c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:30.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.909+0000 7fabc50f1640 1 --2- 172.21.15.148:0/302900188 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabc0102480 0x7fabc01988c0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fabb4009230 tx=0x7fabb4004270 comp rx=0 tx=0).stop 2024-09-19T07:22:30.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.909+0000 7fabc50f1640 1 -- 172.21.15.148:0/302900188 shutdown_connections 2024-09-19T07:22:30.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.909+0000 7fabc50f1640 1 --2- 172.21.15.148:0/302900188 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7faba80a3460 0x7faba80a5920 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:30.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.910+0000 7fabc50f1640 1 --2- 172.21.15.148:0/302900188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabc0107b80 0x7fabc019cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:30.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.910+0000 7fabc50f1640 1 --2- 172.21.15.148:0/302900188 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabc0102480 0x7fabc01988c0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:30.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.910+0000 7fabc50f1640 1 --2- 172.21.15.148:0/302900188 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fabc0101ae0 0x7fabc0198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:30.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.910+0000 7fabc50f1640 1 -- 172.21.15.148:0/302900188 >> 172.21.15.148:0/302900188 conn(0x7fabc00fd7e0 msgr2=0x7fabc00fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:30.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.910+0000 7fabc50f1640 1 -- 172.21.15.148:0/302900188 shutdown_connections 2024-09-19T07:22:30.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:30.910+0000 7fabc50f1640 1 -- 172.21.15.148:0/302900188 wait complete. 2024-09-19T07:22:31.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:22:31 smithi148 ceph-mon[31180]: pgmap v357: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 4.5 KiB/s wr, 9 op/s 2024-09-19T07:22:31.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:22:31 smithi165 ceph-mon[35326]: pgmap v357: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 4.5 KiB/s wr, 9 op/s 2024-09-19T07:22:31.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:22:31 smithi179 ceph-mon[35716]: pgmap v357: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 4.5 KiB/s wr, 9 op/s 2024-09-19T07:22:33.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:22:33 smithi148 ceph-mon[31180]: pgmap v358: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 10 KiB/s wr, 11 op/s 2024-09-19T07:22:33.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:22:33 smithi165 ceph-mon[35326]: pgmap v358: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 10 KiB/s wr, 11 op/s 2024-09-19T07:22:33.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:22:33 smithi179 ceph-mon[35716]: pgmap v358: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 10 KiB/s wr, 11 op/s 2024-09-19T07:22:35.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:22:35 smithi148 ceph-mon[31180]: pgmap v359: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 8 op/s 2024-09-19T07:22:35.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:22:35 smithi165 ceph-mon[35326]: pgmap v359: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 8 op/s 2024-09-19T07:22:35.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:22:35 smithi179 ceph-mon[35716]: pgmap v359: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 8 op/s 2024-09-19T07:22:36.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:22:36 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:22:36.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:22:36 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:22:36.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:22:36 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:22:36.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:22:36 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:22:36.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:22:36 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:22:36.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:22:36 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:22:36.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:22:36 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:22:36.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:22:36 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:22:36.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:22:36 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:22:36.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:22:36 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:22:36.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:22:36 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:22:36.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:22:36 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:22:37.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:22:37 smithi148 ceph-mon[31180]: pgmap v360: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 12 op/s 2024-09-19T07:22:37.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:22:37 smithi148 ceph-mon[31180]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:22:37.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:22:37 smithi165 ceph-mon[35326]: pgmap v360: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 12 op/s 2024-09-19T07:22:37.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:22:37 smithi165 ceph-mon[35326]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:22:37.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:22:37 smithi179 ceph-mon[35716]: pgmap v360: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 12 op/s 2024-09-19T07:22:37.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:22:37 smithi179 ceph-mon[35716]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:22:39.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:22:39 smithi148 ceph-mon[31180]: pgmap v361: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 KiB/s wr, 9 op/s 2024-09-19T07:22:39.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:22:39 smithi165 ceph-mon[35326]: pgmap v361: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 KiB/s wr, 9 op/s 2024-09-19T07:22:39.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:22:39 smithi179 ceph-mon[35716]: pgmap v361: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 KiB/s wr, 9 op/s 2024-09-19T07:22:41.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:22:41 smithi148 ceph-mon[31180]: pgmap v362: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 10 op/s 2024-09-19T07:22:41.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:22:41 smithi165 ceph-mon[35326]: pgmap v362: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 10 op/s 2024-09-19T07:22:41.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:22:41 smithi179 ceph-mon[35716]: pgmap v362: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 10 op/s 2024-09-19T07:22:43.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:22:43 smithi165 ceph-mon[35326]: pgmap v363: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 27 KiB/s wr, 14 op/s 2024-09-19T07:22:43.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:22:43 smithi179 ceph-mon[35716]: pgmap v363: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 27 KiB/s wr, 14 op/s 2024-09-19T07:22:43.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:22:43 smithi148 ceph-mon[31180]: pgmap v363: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 27 KiB/s wr, 14 op/s 2024-09-19T07:22:44.010 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.006+0000 7f4218bf1640 1 -- 172.21.15.148:0/3684432284 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4214107b80 msgr2=0x7f4214107f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:44.010 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.006+0000 7f4218bf1640 1 --2- 172.21.15.148:0/3684432284 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4214107b80 0x7f4214107f60 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f4204009930 tx=0x7f420402a420 comp rx=0 tx=0).stop 2024-09-19T07:22:44.010 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.006+0000 7f4218bf1640 1 -- 172.21.15.148:0/3684432284 shutdown_connections 2024-09-19T07:22:44.010 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.006+0000 7f4218bf1640 1 --2- 172.21.15.148:0/3684432284 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4214102480 0x7f421410e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:44.010 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.006+0000 7f4218bf1640 1 --2- 172.21.15.148:0/3684432284 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4214101ae0 0x7f4214101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:44.010 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.006+0000 7f4218bf1640 1 --2- 172.21.15.148:0/3684432284 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4214107b80 0x7f4214107f60 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:44.010 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.006+0000 7f4218bf1640 1 -- 172.21.15.148:0/3684432284 >> 172.21.15.148:0/3684432284 conn(0x7f42140fd7e0 msgr2=0x7f42140ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:44.010 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.006+0000 7f4218bf1640 1 -- 172.21.15.148:0/3684432284 shutdown_connections 2024-09-19T07:22:44.011 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.007+0000 7f4218bf1640 1 -- 172.21.15.148:0/3684432284 wait complete. 2024-09-19T07:22:44.011 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.007+0000 7f4218bf1640 1 Processor -- start 2024-09-19T07:22:44.011 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.007+0000 7f4218bf1640 1 -- start start 2024-09-19T07:22:44.011 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.008+0000 7f4218bf1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4214101ae0 0x7f42140744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:44.011 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.008+0000 7f4218bf1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4214102480 0x7f4214074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:44.011 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.008+0000 7f4218bf1640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4214107b80 0x7f4214074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:44.011 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.008+0000 7f4218bf1640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4214111f30 con 0x7f4214101ae0 2024-09-19T07:22:44.011 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.008+0000 7f4218bf1640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4214111db0 con 0x7f4214107b80 2024-09-19T07:22:44.011 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.008+0000 7f4218bf1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f42141120b0 con 0x7f4214102480 2024-09-19T07:22:44.011 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.008+0000 7f421259c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4214101ae0 0x7f42140744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:44.011 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.008+0000 7f421259c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4214101ae0 0x7f42140744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36962/0 (socket says 172.21.15.148:36962) 2024-09-19T07:22:44.011 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.008+0000 7f421259c640 1 -- 172.21.15.148:0/3272701163 learned_addr learned my addr 172.21.15.148:0/3272701163 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:22:44.012 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.008+0000 7f4212d9d640 1 --2- 172.21.15.148:0/3272701163 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4214107b80 0x7f4214074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:44.012 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.008+0000 7f4211d9b640 1 --2- 172.21.15.148:0/3272701163 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4214102480 0x7f4214074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:44.012 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.008+0000 7f421259c640 1 -- 172.21.15.148:0/3272701163 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4214102480 msgr2=0x7f4214074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:44.012 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.008+0000 7f421259c640 1 --2- 172.21.15.148:0/3272701163 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4214102480 0x7f4214074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:44.012 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.008+0000 7f421259c640 1 -- 172.21.15.148:0/3272701163 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4214107b80 msgr2=0x7f4214074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:44.012 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.008+0000 7f421259c640 1 --2- 172.21.15.148:0/3272701163 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4214107b80 0x7f4214074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:44.012 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.008+0000 7f421259c640 1 -- 172.21.15.148:0/3272701163 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42141a6850 con 0x7f4214101ae0 2024-09-19T07:22:44.012 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.008+0000 7f4212d9d640 1 --2- 172.21.15.148:0/3272701163 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4214107b80 0x7f4214074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:22:44.012 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.008+0000 7f421259c640 1 --2- 172.21.15.148:0/3272701163 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4214101ae0 0x7f42140744f0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f4204009230 tx=0x7f4204004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:44.012 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.008+0000 7f42037fe640 1 -- 172.21.15.148:0/3272701163 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f420403f030 con 0x7f4214101ae0 2024-09-19T07:22:44.012 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.008+0000 7f42037fe640 1 -- 172.21.15.148:0/3272701163 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4204003ad0 con 0x7f4214101ae0 2024-09-19T07:22:44.012 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.008+0000 7f4218bf1640 1 -- 172.21.15.148:0/3272701163 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42141a6ae0 con 0x7f4214101ae0 2024-09-19T07:22:44.012 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.008+0000 7f42037fe640 1 -- 172.21.15.148:0/3272701163 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4204035070 con 0x7f4214101ae0 2024-09-19T07:22:44.013 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.008+0000 7f4218bf1640 1 -- 172.21.15.148:0/3272701163 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42141a7020 con 0x7f4214101ae0 2024-09-19T07:22:44.019 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.011+0000 7f42037fe640 1 -- 172.21.15.148:0/3272701163 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f4204042030 con 0x7f4214101ae0 2024-09-19T07:22:44.019 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.011+0000 7f421ba64740 1 Processor -- start 2024-09-19T07:22:44.019 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.011+0000 7f421ba64740 1 -- start start 2024-09-19T07:22:44.019 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.011+0000 7f421ba64740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c444681af0 0x55c444681ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:44.019 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.011+0000 7f421ba64740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c444682410 0x55c44468c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:44.019 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.011+0000 7f421ba64740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c44468ccb0 0x55c44468f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:44.019 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.012+0000 7f421ba64740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55c4445e62f0 con 0x55c444681af0 2024-09-19T07:22:44.019 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.012+0000 7f421ba64740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55c44458e270 con 0x55c44468ccb0 2024-09-19T07:22:44.019 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.012+0000 7f42037fe640 1 --2- 172.21.15.148:0/3272701163 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f41fc0a34e0 0x7f41fc0a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:44.019 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.012+0000 7f421ba64740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c4445e22b0 con 0x55c444682410 2024-09-19T07:22:44.019 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.012+0000 7f4212d9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c444681af0 0x55c444681ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:44.020 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.012+0000 7f4212d9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c444681af0 0x55c444681ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36972/0 (socket says 172.21.15.148:36972) 2024-09-19T07:22:44.020 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.012+0000 7f4212d9d640 1 -- 172.21.15.148:0/2762926040 learned_addr learned my addr 172.21.15.148:0/2762926040 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:22:44.020 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.012+0000 7f4212d9d640 1 --2- 172.21.15.148:0/3272701163 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f41fc0a34e0 0x7f41fc0a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:44.020 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.012+0000 7f42037fe640 1 -- 172.21.15.148:0/3272701163 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8556+0+0 (secure 0 0 0) 0x7f42040f0230 con 0x7f4214101ae0 2024-09-19T07:22:44.020 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.012+0000 7f4211d9b640 1 --2- 172.21.15.148:0/2762926040 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c44468ccb0 0x55c44468f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:44.020 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.012+0000 7f421259c640 1 --2- 172.21.15.148:0/2762926040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c444682410 0x55c44468c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:44.020 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.012+0000 7f4212d9d640 1 -- 172.21.15.148:0/2762926040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c444682410 msgr2=0x55c44468c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:44.020 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.012+0000 7f4212d9d640 1 --2- 172.21.15.148:0/2762926040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c444682410 0x55c44468c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:44.020 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.012+0000 7f4212d9d640 1 -- 172.21.15.148:0/2762926040 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c44468ccb0 msgr2=0x55c44468f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:44.020 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.012+0000 7f4212d9d640 1 --2- 172.21.15.148:0/2762926040 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c44468ccb0 0x55c44468f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:44.020 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.012+0000 7f4212d9d640 1 -- 172.21.15.148:0/2762926040 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c44458d340 con 0x55c444681af0 2024-09-19T07:22:44.020 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.012+0000 7f4212d9d640 1 --2- 172.21.15.148:0/2762926040 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c444681af0 0x55c444681ed0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f420c012cf0 tx=0x7f420c010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=577544a0ca0599d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:44.020 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.012+0000 7f4212d9d640 1 --2- 172.21.15.148:0/3272701163 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f41fc0a34e0 0x7f41fc0a59a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f420c010c40 tx=0x7f420c017000 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:44.021 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.012+0000 7f4200ff9640 1 -- 172.21.15.148:0/2762926040 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f420c022070 con 0x55c444681af0 2024-09-19T07:22:44.021 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.012+0000 7f4200ff9640 1 -- 172.21.15.148:0/2762926040 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f420c009cb0 con 0x55c444681af0 2024-09-19T07:22:44.021 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.013+0000 7f4200ff9640 1 -- 172.21.15.148:0/2762926040 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f420c00cd70 con 0x55c444681af0 2024-09-19T07:22:44.021 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.013+0000 7f421ba64740 1 -- 172.21.15.148:0/2762926040 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c444681af0 msgr2=0x55c444681ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:44.021 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.013+0000 7f421ba64740 1 --2- 172.21.15.148:0/2762926040 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c444681af0 0x55c444681ed0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f420c012cf0 tx=0x7f420c010740 comp rx=0 tx=0).stop 2024-09-19T07:22:44.021 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.013+0000 7f421ba64740 1 -- 172.21.15.148:0/2762926040 shutdown_connections 2024-09-19T07:22:44.021 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.013+0000 7f421ba64740 1 --2- 172.21.15.148:0/2762926040 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c44468ccb0 0x55c44468f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:44.021 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.013+0000 7f421ba64740 1 --2- 172.21.15.148:0/2762926040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c444682410 0x55c44468c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:44.021 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.013+0000 7f421ba64740 1 --2- 172.21.15.148:0/2762926040 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c444681af0 0x55c444681ed0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:44.021 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.013+0000 7f421ba64740 1 -- 172.21.15.148:0/2762926040 >> 172.21.15.148:0/2762926040 conn(0x55c44467e060 msgr2=0x55c44467e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:44.021 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.013+0000 7f421ba64740 1 -- 172.21.15.148:0/2762926040 shutdown_connections 2024-09-19T07:22:44.021 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.013+0000 7f421ba64740 1 -- 172.21.15.148:0/2762926040 wait complete. 2024-09-19T07:22:44.021 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.014+0000 7f421ba64740 1 -- start start 2024-09-19T07:22:44.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.014+0000 7f421ba64740 1 Processor -- start 2024-09-19T07:22:44.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.014+0000 7f421ba64740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c444681af0 0x55c444689c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:44.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.014+0000 7f421ba64740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c444682410 0x55c44468a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:44.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.014+0000 7f421ba64740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c44468ccb0 0x55c44468a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:44.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.014+0000 7f421ba64740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55c44468f880 con 0x55c444682410 2024-09-19T07:22:44.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.014+0000 7f421ba64740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55c44456f290 con 0x55c44468ccb0 2024-09-19T07:22:44.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.014+0000 7f421ba64740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c44468fa00 con 0x55c444681af0 2024-09-19T07:22:44.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.014+0000 7f421ba64740 10 client.0 _ll_register_callbacks cb 0x55c4445a0140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:22:44.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.014+0000 7f4211d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c444682410 0x55c44468a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:44.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.014+0000 7f4211d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c444682410 0x55c44468a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36980/0 (socket says 172.21.15.148:36980) 2024-09-19T07:22:44.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.014+0000 7f4211d9b640 1 -- 172.21.15.148:0/1020356888 learned_addr learned my addr 172.21.15.148:0/1020356888 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:22:44.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.014+0000 7f4212d9d640 1 --2- 172.21.15.148:0/1020356888 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c44468ccb0 0x55c44468a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:44.023 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.014+0000 7f421259c640 1 --2- 172.21.15.148:0/1020356888 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c444681af0 0x55c444689c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:44.023 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.014+0000 7f4211d9b640 1 -- 172.21.15.148:0/1020356888 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c444681af0 msgr2=0x55c444689c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:44.023 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.014+0000 7f4211d9b640 1 --2- 172.21.15.148:0/1020356888 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c444681af0 0x55c444689c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:44.023 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.014+0000 7f4211d9b640 1 -- 172.21.15.148:0/1020356888 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c44468ccb0 msgr2=0x55c44468a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:44.023 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.014+0000 7f4211d9b640 1 --2- 172.21.15.148:0/1020356888 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c44468ccb0 0x55c44468a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:44.023 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.014+0000 7f4211d9b640 1 -- 172.21.15.148:0/1020356888 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4442f9210 con 0x55c444682410 2024-09-19T07:22:44.023 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.014+0000 7f4212d9d640 1 --2- 172.21.15.148:0/1020356888 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c44468ccb0 0x55c44468a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:22:44.023 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.014+0000 7f421259c640 1 --2- 172.21.15.148:0/1020356888 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c444681af0 0x55c444689c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:22:44.023 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.015+0000 7f4211d9b640 1 --2- 172.21.15.148:0/1020356888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c444682410 0x55c44468a140 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f420800da10 tx=0x7f420800ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41c3f40fc889c509 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:44.023 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.015+0000 7f41f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:22:44.023 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.015+0000 7f41f9ffb640 1 -- 172.21.15.148:0/1020356888 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4208005020 con 0x55c444682410 2024-09-19T07:22:44.023 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.015+0000 7f41f9ffb640 1 -- 172.21.15.148:0/1020356888 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8556+0+0 (secure 0 0 0) 0x7f42080051c0 con 0x55c444682410 2024-09-19T07:22:44.023 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.015+0000 7f421ba64740 1 -- 172.21.15.148:0/1020356888 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f420c009cb0 con 0x55c444682410 2024-09-19T07:22:44.024 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.015+0000 7f41f9ffb640 1 -- 172.21.15.148:0/1020356888 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f42080053c0 con 0x55c444682410 2024-09-19T07:22:44.024 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.015+0000 7f421ba64740 10 client.17190 fetch_fsmap learned FSMap version 44 2024-09-19T07:22:44.024 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.015+0000 7f421ba64740 1 -- 172.21.15.148:0/1020356888 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55c4443c5620 con 0x55c444682410 2024-09-19T07:22:44.024 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.015+0000 7f41f9ffb640 1 -- 172.21.15.148:0/1020356888 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f420c009cb0 con 0x55c444682410 2024-09-19T07:22:44.024 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.015+0000 7f41f9ffb640 1 -- 172.21.15.148:0/1020356888 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 44) ==== 8358+0+0 (secure 0 0 0) 0x7f4208019030 con 0x55c444682410 2024-09-19T07:22:44.024 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.015+0000 7f421ba64740 10 client.17190 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T07:22:44.024 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.015+0000 7f421ba64740 10 client.17190 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:22:44.024 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.015+0000 7f421ba64740 20 client.17190 populate_metadata read hostname 'smithi148' 2024-09-19T07:22:44.024 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.015+0000 7f421ba64740 1 --2- 172.21.15.148:0/1020356888 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55c44469cd20 0x55c44469f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:44.024 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.015+0000 7f421ba64740 4 client.17190 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:22:44.024 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.015+0000 7f421ba64740 1 -- 172.21.15.148:0/1020356888 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c4445f3a20 con 0x55c44469cd20 2024-09-19T07:22:44.024 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.016+0000 7f421259c640 1 --2- 172.21.15.148:0/1020356888 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55c44469cd20 0x55c44469f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:44.024 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.016+0000 7f41f9ffb640 10 client.17190 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:22:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.016+0000 7f421259c640 1 --2- 172.21.15.148:0/1020356888 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55c44469cd20 0x55c44469f1a0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2c0393748db5936 server_cookie=e824c01668eeca43 in_seq=0 out_seq=0 2024-09-19T07:22:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.017+0000 7f41f9ffb640 1 -- 172.21.15.148:0/1020356888 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c4445f3a20 con 0x55c44469cd20 2024-09-19T07:22:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.017+0000 7f41f9ffb640 10 client.17190 handle_command_reply: tid=0 2024-09-19T07:22:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.017+0000 7f421ba64740 1 client.17190 shutdown 2024-09-19T07:22:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.017+0000 7f421ba64740 1 -- 172.21.15.148:0/1020356888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c444682410 msgr2=0x55c44468a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.017+0000 7f421ba64740 1 --2- 172.21.15.148:0/1020356888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c444682410 0x55c44468a140 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f420800da10 tx=0x7f420800ded0 comp rx=0 tx=0).stop 2024-09-19T07:22:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.017+0000 7f421ba64740 1 -- 172.21.15.148:0/1020356888 shutdown_connections 2024-09-19T07:22:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.017+0000 7f421ba64740 1 --2- 172.21.15.148:0/1020356888 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55c44469cd20 0x55c44469f1a0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.017+0000 7f421ba64740 1 --2- 172.21.15.148:0/1020356888 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c44468ccb0 0x55c44468a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.017+0000 7f421ba64740 1 --2- 172.21.15.148:0/1020356888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c444682410 0x55c44468a140 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.017+0000 7f421ba64740 1 --2- 172.21.15.148:0/1020356888 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c444681af0 0x55c444689c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.017+0000 7f41f9ffb640 0 client.17190 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:22:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.017+0000 7f421ba64740 1 -- 172.21.15.148:0/1020356888 >> 172.21.15.148:0/1020356888 conn(0x55c44467e060 msgr2=0x55c444683d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.017+0000 7f421ba64740 1 -- 172.21.15.148:0/1020356888 shutdown_connections 2024-09-19T07:22:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.017+0000 7f421ba64740 1 -- 172.21.15.148:0/1020356888 wait complete. 2024-09-19T07:22:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.017+0000 7f421ba64740 20 client.17190 trim_cache size 0 max 16384 2024-09-19T07:22:44.037 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.031+0000 7f421ba64740 1 Processor -- start 2024-09-19T07:22:44.037 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.032+0000 7f421ba64740 1 -- start start 2024-09-19T07:22:44.037 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.032+0000 7f421ba64740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c444681af0 0x55c444684560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:44.037 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.032+0000 7f421ba64740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c444682410 0x55c44468a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:44.037 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.032+0000 7f421ba64740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c44468ccb0 0x55c4446a4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:44.037 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.032+0000 7f421ba64740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f42141b22c0 con 0x55c44468ccb0 2024-09-19T07:22:44.037 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.032+0000 7f421ba64740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f42141afb60 con 0x55c444681af0 2024-09-19T07:22:44.037 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.032+0000 7f421ba64740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f42141ad9d0 con 0x55c444682410 2024-09-19T07:22:44.037 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.032+0000 7f4212d9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c44468ccb0 0x55c4446a4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:44.037 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.032+0000 7f4212d9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c44468ccb0 0x55c4446a4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36982/0 (socket says 172.21.15.148:36982) 2024-09-19T07:22:44.037 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.032+0000 7f4212d9d640 1 -- 172.21.15.148:0/1240235166 learned_addr learned my addr 172.21.15.148:0/1240235166 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:22:44.037 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.032+0000 7f4211d9b640 1 --2- 172.21.15.148:0/1240235166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c444682410 0x55c44468a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:44.038 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.032+0000 7f421259c640 1 --2- 172.21.15.148:0/1240235166 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c444681af0 0x55c444684560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:44.038 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.032+0000 7f4212d9d640 1 -- 172.21.15.148:0/1240235166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c444682410 msgr2=0x55c44468a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:44.038 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.032+0000 7f4212d9d640 1 --2- 172.21.15.148:0/1240235166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c444682410 0x55c44468a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:44.038 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.032+0000 7f4212d9d640 1 -- 172.21.15.148:0/1240235166 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c444681af0 msgr2=0x55c444684560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:44.038 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.032+0000 7f4212d9d640 1 --2- 172.21.15.148:0/1240235166 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c444681af0 0x55c444684560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:44.038 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.032+0000 7f4212d9d640 1 -- 172.21.15.148:0/1240235166 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c44467f110 con 0x55c44468ccb0 2024-09-19T07:22:44.038 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.032+0000 7f421259c640 1 --2- 172.21.15.148:0/1240235166 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c444681af0 0x55c444684560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:22:44.038 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.032+0000 7f4212d9d640 1 --2- 172.21.15.148:0/1240235166 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c44468ccb0 0x55c4446a4ab0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f420c012ea0 tx=0x7f420c012ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b308c351bc7e308a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:44.038 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.033+0000 7f41fbfff640 1 -- 172.21.15.148:0/1240235166 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f420c022040 con 0x55c44468ccb0 2024-09-19T07:22:44.038 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.033+0000 7f41fbfff640 1 -- 172.21.15.148:0/1240235166 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f420c012800 con 0x55c44468ccb0 2024-09-19T07:22:44.038 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.033+0000 7f41fbfff640 1 -- 172.21.15.148:0/1240235166 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f420c00ce30 con 0x55c44468ccb0 2024-09-19T07:22:44.038 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.033+0000 7f421ba64740 1 -- 172.21.15.148:0/1240235166 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c44468ccb0 msgr2=0x55c4446a4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:44.038 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.033+0000 7f421ba64740 1 --2- 172.21.15.148:0/1240235166 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c44468ccb0 0x55c4446a4ab0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f420c012ea0 tx=0x7f420c012ed0 comp rx=0 tx=0).stop 2024-09-19T07:22:44.039 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.033+0000 7f421ba64740 1 -- 172.21.15.148:0/1240235166 shutdown_connections 2024-09-19T07:22:44.039 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.033+0000 7f421ba64740 1 --2- 172.21.15.148:0/1240235166 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c44468ccb0 0x55c4446a4ab0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:44.039 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.033+0000 7f421ba64740 1 --2- 172.21.15.148:0/1240235166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c444682410 0x55c44468a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:44.039 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.033+0000 7f421ba64740 1 --2- 172.21.15.148:0/1240235166 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c444681af0 0x55c444684560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:44.039 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.033+0000 7f421ba64740 1 -- 172.21.15.148:0/1240235166 >> 172.21.15.148:0/1240235166 conn(0x55c44467e060 msgr2=0x55c44468bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:44.039 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.033+0000 7f421ba64740 1 -- 172.21.15.148:0/1240235166 shutdown_connections 2024-09-19T07:22:44.039 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.033+0000 7f421ba64740 1 -- 172.21.15.148:0/1240235166 wait complete. 2024-09-19T07:22:44.039 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.034+0000 7f421ba64740 1 -- start start 2024-09-19T07:22:44.039 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.034+0000 7f421ba64740 1 Processor -- start 2024-09-19T07:22:44.039 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.034+0000 7f421ba64740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c444681af0 0x55c4446954c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:44.039 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.034+0000 7f421ba64740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c444682410 0x55c4446907e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:44.039 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.034+0000 7f421ba64740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c44468ccb0 0x55c444690dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:44.039 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.034+0000 7f421ba64740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f42141ae020 con 0x55c44468ccb0 2024-09-19T07:22:44.040 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.034+0000 7f421ba64740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f42141af490 con 0x55c444682410 2024-09-19T07:22:44.040 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.034+0000 7f421ba64740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f42141ae6f0 con 0x55c444681af0 2024-09-19T07:22:44.040 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.034+0000 7f421ba64740 10 client.0 _ll_register_callbacks cb 0x7f4208004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:22:44.040 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.034+0000 7f4212d9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c44468ccb0 0x55c444690dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:44.040 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.034+0000 7f4212d9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c44468ccb0 0x55c444690dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36994/0 (socket says 172.21.15.148:36994) 2024-09-19T07:22:44.040 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.034+0000 7f4212d9d640 1 -- 172.21.15.148:0/1725655004 learned_addr learned my addr 172.21.15.148:0/1725655004 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:22:44.040 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.034+0000 7f4211d9b640 1 --2- 172.21.15.148:0/1725655004 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c444682410 0x55c4446907e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:44.040 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.034+0000 7f421259c640 1 --2- 172.21.15.148:0/1725655004 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c444681af0 0x55c4446954c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:44.040 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.034+0000 7f4212d9d640 1 -- 172.21.15.148:0/1725655004 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c444681af0 msgr2=0x55c4446954c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:44.040 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.034+0000 7f4212d9d640 1 --2- 172.21.15.148:0/1725655004 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c444681af0 0x55c4446954c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:44.040 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.034+0000 7f4212d9d640 1 -- 172.21.15.148:0/1725655004 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c444682410 msgr2=0x55c4446907e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:44.040 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.034+0000 7f4212d9d640 1 --2- 172.21.15.148:0/1725655004 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c444682410 0x55c4446907e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:44.040 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.034+0000 7f4212d9d640 1 -- 172.21.15.148:0/1725655004 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c444691600 con 0x55c44468ccb0 2024-09-19T07:22:44.041 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.034+0000 7f4211d9b640 1 --2- 172.21.15.148:0/1725655004 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c444682410 0x55c4446907e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:22:44.041 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.035+0000 7f4212d9d640 1 --2- 172.21.15.148:0/1725655004 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c44468ccb0 0x55c444690dd0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f420c012370 tx=0x7f420c010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=386758553014065f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:44.041 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.035+0000 7f41f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:22:44.041 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.035+0000 7f41f9ffb640 1 -- 172.21.15.148:0/1725655004 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f420c01b040 con 0x55c44468ccb0 2024-09-19T07:22:44.041 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.035+0000 7f41f9ffb640 1 -- 172.21.15.148:0/1725655004 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8556+0+0 (secure 0 0 0) 0x7f420c004a00 con 0x55c44468ccb0 2024-09-19T07:22:44.041 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.035+0000 7f421ba64740 1 -- 172.21.15.148:0/1725655004 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f420c012800 con 0x55c44468ccb0 2024-09-19T07:22:44.041 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.035+0000 7f41f9ffb640 1 -- 172.21.15.148:0/1725655004 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f420c022040 con 0x55c44468ccb0 2024-09-19T07:22:44.041 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.035+0000 7f421ba64740 10 client.17196 fetch_fsmap learned FSMap version 44 2024-09-19T07:22:44.041 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.035+0000 7f421ba64740 1 -- 172.21.15.148:0/1725655004 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55c444707ae0 con 0x55c44468ccb0 2024-09-19T07:22:44.041 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.035+0000 7f41f9ffb640 1 -- 172.21.15.148:0/1725655004 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f420c012800 con 0x55c44468ccb0 2024-09-19T07:22:44.041 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.035+0000 7f41f9ffb640 1 -- 172.21.15.148:0/1725655004 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 44) ==== 8358+0+0 (secure 0 0 0) 0x7f420c03a4e0 con 0x55c44468ccb0 2024-09-19T07:22:44.041 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.035+0000 7f421ba64740 10 client.17196 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T07:22:44.041 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.035+0000 7f421ba64740 10 client.17196 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:22:44.042 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.035+0000 7f421ba64740 20 client.17196 populate_metadata read hostname 'smithi148' 2024-09-19T07:22:44.042 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.035+0000 7f421ba64740 1 --2- 172.21.15.148:0/1725655004 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55c444707fa0 0x55c44470a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:44.042 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.035+0000 7f421ba64740 4 client.17196 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:22:44.042 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.035+0000 7f421ba64740 1 -- 172.21.15.148:0/1725655004 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c4445edd70 con 0x55c444707fa0 2024-09-19T07:22:44.042 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.036+0000 7f421259c640 1 --2- 172.21.15.148:0/1725655004 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55c444707fa0 0x55c44470a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:44.042 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.036+0000 7f41f9ffb640 10 client.17196 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:22:44.042 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.036+0000 7f421259c640 1 --2- 172.21.15.148:0/1725655004 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55c444707fa0 0x55c44470a390 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4e3409a33c2d4f6 server_cookie=7ba655d45c025401 in_seq=0 out_seq=0 2024-09-19T07:22:44.070 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.068+0000 7f41f9ffb640 1 -- 172.21.15.148:0/1725655004 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c4445edd70 con 0x55c444707fa0 2024-09-19T07:22:44.070 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.068+0000 7f41f9ffb640 10 client.17196 handle_command_reply: tid=0 2024-09-19T07:22:44.070 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.068+0000 7f421ba64740 1 client.17196 shutdown 2024-09-19T07:22:44.070 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.069+0000 7f421ba64740 1 -- 172.21.15.148:0/1725655004 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c44468ccb0 msgr2=0x55c444690dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:44.070 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.069+0000 7f421ba64740 1 --2- 172.21.15.148:0/1725655004 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c44468ccb0 0x55c444690dd0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f420c012370 tx=0x7f420c010740 comp rx=0 tx=0).stop 2024-09-19T07:22:44.070 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.069+0000 7f421ba64740 1 -- 172.21.15.148:0/1725655004 shutdown_connections 2024-09-19T07:22:44.070 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.069+0000 7f421ba64740 1 --2- 172.21.15.148:0/1725655004 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55c444707fa0 0x55c44470a390 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:44.070 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.069+0000 7f421ba64740 1 --2- 172.21.15.148:0/1725655004 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c44468ccb0 0x55c444690dd0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:44.070 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.069+0000 7f421ba64740 1 --2- 172.21.15.148:0/1725655004 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c444682410 0x55c4446907e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:44.070 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.069+0000 7f41f9ffb640 0 client.17196 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:22:44.071 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.069+0000 7f421ba64740 1 --2- 172.21.15.148:0/1725655004 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c444681af0 0x55c4446954c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:44.071 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.069+0000 7f421ba64740 1 -- 172.21.15.148:0/1725655004 >> 172.21.15.148:0/1725655004 conn(0x55c44467e060 msgr2=0x55c44468b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:44.071 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.069+0000 7f421ba64740 1 -- 172.21.15.148:0/1725655004 shutdown_connections 2024-09-19T07:22:44.071 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.069+0000 7f421ba64740 1 -- 172.21.15.148:0/1725655004 wait complete. 2024-09-19T07:22:44.071 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.069+0000 7f421ba64740 20 client.17196 trim_cache size 0 max 16384 2024-09-19T07:22:44.071 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:22:44.071 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:22:44.071 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:22:44.071 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:22:44.072 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.069+0000 7f4218bf1640 1 -- 172.21.15.148:0/3272701163 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f41fc0a34e0 msgr2=0x7f41fc0a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:44.072 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.069+0000 7f4218bf1640 1 --2- 172.21.15.148:0/3272701163 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f41fc0a34e0 0x7f41fc0a59a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f420c010c40 tx=0x7f420c017000 comp rx=0 tx=0).stop 2024-09-19T07:22:44.073 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.069+0000 7f4218bf1640 1 -- 172.21.15.148:0/3272701163 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4214101ae0 msgr2=0x7f42140744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:44.073 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.069+0000 7f4218bf1640 1 --2- 172.21.15.148:0/3272701163 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4214101ae0 0x7f42140744f0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f4204009230 tx=0x7f4204004270 comp rx=0 tx=0).stop 2024-09-19T07:22:44.073 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.069+0000 7f4218bf1640 1 -- 172.21.15.148:0/3272701163 shutdown_connections 2024-09-19T07:22:44.073 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.069+0000 7f4218bf1640 1 --2- 172.21.15.148:0/3272701163 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f41fc0a34e0 0x7f41fc0a59a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:44.073 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.069+0000 7f4218bf1640 1 --2- 172.21.15.148:0/3272701163 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4214107b80 0x7f4214074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:44.073 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.069+0000 7f4218bf1640 1 --2- 172.21.15.148:0/3272701163 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4214102480 0x7f4214074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:44.073 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.069+0000 7f4218bf1640 1 --2- 172.21.15.148:0/3272701163 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4214101ae0 0x7f42140744f0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:44.073 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.070+0000 7f4218bf1640 1 -- 172.21.15.148:0/3272701163 >> 172.21.15.148:0/3272701163 conn(0x7f42140fd7e0 msgr2=0x7f42140fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:44.073 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.070+0000 7f4218bf1640 1 -- 172.21.15.148:0/3272701163 shutdown_connections 2024-09-19T07:22:44.073 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:44.070+0000 7f4218bf1640 1 -- 172.21.15.148:0/3272701163 wait complete. 2024-09-19T07:22:45.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:22:45 smithi165 ceph-mon[35326]: pgmap v364: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 23 KiB/s wr, 12 op/s 2024-09-19T07:22:45.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:22:45 smithi179 ceph-mon[35716]: pgmap v364: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 23 KiB/s wr, 12 op/s 2024-09-19T07:22:45.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:22:45 smithi148 ceph-mon[31180]: pgmap v364: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 23 KiB/s wr, 12 op/s 2024-09-19T07:22:46.773 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:22:46 smithi179 ceph-mon[35716]: pgmap v365: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 38 KiB/s wr, 20 op/s 2024-09-19T07:22:46.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:22:46 smithi148 ceph-mon[31180]: pgmap v365: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 38 KiB/s wr, 20 op/s 2024-09-19T07:22:46.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:22:46 smithi165 ceph-mon[35326]: pgmap v365: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 38 KiB/s wr, 20 op/s 2024-09-19T07:22:48.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:22:48 smithi179 ceph-mon[35716]: pgmap v366: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 31 KiB/s wr, 15 op/s 2024-09-19T07:22:48.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:22:48 smithi148 ceph-mon[31180]: pgmap v366: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 31 KiB/s wr, 15 op/s 2024-09-19T07:22:48.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:22:48 smithi165 ceph-mon[35326]: pgmap v366: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 31 KiB/s wr, 15 op/s 2024-09-19T07:22:50.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:22:50 smithi179 ceph-mon[35716]: pgmap v367: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 38 KiB/s wr, 16 op/s 2024-09-19T07:22:50.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:22:50 smithi148 ceph-mon[31180]: pgmap v367: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 38 KiB/s wr, 16 op/s 2024-09-19T07:22:50.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:22:50 smithi165 ceph-mon[35326]: pgmap v367: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 38 KiB/s wr, 16 op/s 2024-09-19T07:22:52.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:22:52 smithi179 ceph-mon[35716]: pgmap v368: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 47 KiB/s wr, 20 op/s 2024-09-19T07:22:52.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:22:52 smithi148 ceph-mon[31180]: pgmap v368: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 47 KiB/s wr, 20 op/s 2024-09-19T07:22:52.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:22:52 smithi165 ceph-mon[35326]: pgmap v368: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 47 KiB/s wr, 20 op/s 2024-09-19T07:22:54.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:22:54 smithi179 ceph-mon[35716]: pgmap v369: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 41 KiB/s wr, 17 op/s 2024-09-19T07:22:54.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:22:54 smithi148 ceph-mon[31180]: pgmap v369: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 41 KiB/s wr, 17 op/s 2024-09-19T07:22:54.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:22:54 smithi165 ceph-mon[35326]: pgmap v369: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 41 KiB/s wr, 17 op/s 2024-09-19T07:22:56.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:22:56 smithi148 ceph-mon[31180]: pgmap v370: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 50 KiB/s wr, 21 op/s 2024-09-19T07:22:56.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:22:56 smithi165 ceph-mon[35326]: pgmap v370: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 50 KiB/s wr, 21 op/s 2024-09-19T07:22:57.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:22:56 smithi179 ceph-mon[35716]: pgmap v370: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 50 KiB/s wr, 21 op/s 2024-09-19T07:22:57.167 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.166+0000 7f547e186640 1 -- 172.21.15.148:0/1421572667 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54781009d0 msgr2=0x7f5478100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:57.167 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.166+0000 7f547e186640 1 --2- 172.21.15.148:0/1421572667 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54781009d0 0x7f5478100e30 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f546c009930 tx=0x7f546c02a420 comp rx=0 tx=0).stop 2024-09-19T07:22:57.167 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.166+0000 7f547e186640 1 -- 172.21.15.148:0/1421572667 shutdown_connections 2024-09-19T07:22:57.168 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.166+0000 7f547e186640 1 --2- 172.21.15.148:0/1421572667 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5478101370 0x7f547810d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:57.168 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.166+0000 7f547e186640 1 --2- 172.21.15.148:0/1421572667 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54781009d0 0x7f5478100e30 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:57.168 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.166+0000 7f547e186640 1 --2- 172.21.15.148:0/1421572667 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54781069e0 0x7f5478106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:57.168 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.166+0000 7f547e186640 1 -- 172.21.15.148:0/1421572667 >> 172.21.15.148:0/1421572667 conn(0x7f54780fc6f0 msgr2=0x7f54780feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:57.168 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.166+0000 7f547e186640 1 -- 172.21.15.148:0/1421572667 shutdown_connections 2024-09-19T07:22:57.168 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.166+0000 7f547e186640 1 -- 172.21.15.148:0/1421572667 wait complete. 2024-09-19T07:22:57.168 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.166+0000 7f547e186640 1 Processor -- start 2024-09-19T07:22:57.168 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.167+0000 7f547e186640 1 -- start start 2024-09-19T07:22:57.177 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.167+0000 7f547e186640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54781009d0 0x7f54780fcc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:57.178 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.167+0000 7f547e186640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5478101370 0x7f54780fd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:57.178 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.167+0000 7f547e186640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54781069e0 0x7f54780fd710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:57.178 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.167+0000 7f547e186640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5478110e70 con 0x7f54781009d0 2024-09-19T07:22:57.178 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.167+0000 7f547e186640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5478110cf0 con 0x7f5478101370 2024-09-19T07:22:57.178 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.167+0000 7f547e186640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5478110ff0 con 0x7f54781069e0 2024-09-19T07:22:57.178 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.167+0000 7f54777fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54781009d0 0x7f54780fcc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:57.178 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.167+0000 7f54777fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54781009d0 0x7f54780fcc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50266/0 (socket says 172.21.15.148:50266) 2024-09-19T07:22:57.178 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.167+0000 7f54777fe640 1 -- 172.21.15.148:0/1822932116 learned_addr learned my addr 172.21.15.148:0/1822932116 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:22:57.178 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.167+0000 7f5476ffd640 1 --2- 172.21.15.148:0/1822932116 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5478101370 0x7f54780fd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:57.178 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.167+0000 7f5477fff640 1 --2- 172.21.15.148:0/1822932116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54781069e0 0x7f54780fd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:57.178 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.167+0000 7f54777fe640 1 -- 172.21.15.148:0/1822932116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54781069e0 msgr2=0x7f54780fd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:57.178 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.167+0000 7f54777fe640 1 --2- 172.21.15.148:0/1822932116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54781069e0 0x7f54780fd710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:57.179 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.167+0000 7f54777fe640 1 -- 172.21.15.148:0/1822932116 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5478101370 msgr2=0x7f54780fd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:57.179 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.167+0000 7f54777fe640 1 --2- 172.21.15.148:0/1822932116 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5478101370 0x7f54780fd1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:57.179 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.167+0000 7f54777fe640 1 -- 172.21.15.148:0/1822932116 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54781a68d0 con 0x7f54781009d0 2024-09-19T07:22:57.179 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.167+0000 7f5476ffd640 1 --2- 172.21.15.148:0/1822932116 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5478101370 0x7f54780fd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:22:57.179 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.167+0000 7f54777fe640 1 --2- 172.21.15.148:0/1822932116 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54781009d0 0x7f54780fcc90 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f546800d770 tx=0x7f546800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:57.179 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.168+0000 7f5474ff9640 1 -- 172.21.15.148:0/1822932116 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5468017070 con 0x7f54781009d0 2024-09-19T07:22:57.179 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.168+0000 7f547e186640 1 -- 172.21.15.148:0/1822932116 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54781a6bc0 con 0x7f54781009d0 2024-09-19T07:22:57.179 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.168+0000 7f5474ff9640 1 -- 172.21.15.148:0/1822932116 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5468005500 con 0x7f54781009d0 2024-09-19T07:22:57.179 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.168+0000 7f5474ff9640 1 -- 172.21.15.148:0/1822932116 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5468004e00 con 0x7f54781009d0 2024-09-19T07:22:57.179 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.168+0000 7f547e186640 1 -- 172.21.15.148:0/1822932116 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54781a7110 con 0x7f54781009d0 2024-09-19T07:22:57.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.170+0000 7f5474ff9640 1 -- 172.21.15.148:0/1822932116 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f5468004fa0 con 0x7f54781009d0 2024-09-19T07:22:57.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.170+0000 7f5480ffe740 1 Processor -- start 2024-09-19T07:22:57.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.170+0000 7f5480ffe740 1 -- start start 2024-09-19T07:22:57.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.170+0000 7f5480ffe740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55790e8f7af0 0x55790e8f7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:57.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.170+0000 7f5480ffe740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55790e8f8410 0x55790e902770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:57.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.170+0000 7f5480ffe740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55790e902cb0 0x55790e9050a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:57.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.171+0000 7f5480ffe740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55790e85c2f0 con 0x55790e902cb0 2024-09-19T07:22:57.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.171+0000 7f5480ffe740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55790e804270 con 0x55790e8f8410 2024-09-19T07:22:57.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.171+0000 7f5480ffe740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55790e8582b0 con 0x55790e8f7af0 2024-09-19T07:22:57.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.171+0000 7f5474ff9640 1 --2- 172.21.15.148:0/1822932116 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f54600a3460 0x7f54600a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:57.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.171+0000 7f5476ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55790e902cb0 0x55790e9050a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:57.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.171+0000 7f5476ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55790e902cb0 0x55790e9050a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50280/0 (socket says 172.21.15.148:50280) 2024-09-19T07:22:57.181 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.171+0000 7f5476ffd640 1 -- 172.21.15.148:0/1573850186 learned_addr learned my addr 172.21.15.148:0/1573850186 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:22:57.181 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.171+0000 7f5477fff640 1 --2- 172.21.15.148:0/1822932116 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f54600a3460 0x7f54600a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:57.181 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.171+0000 7f54777fe640 1 --2- 172.21.15.148:0/1573850186 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55790e8f8410 0x55790e902770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:57.181 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.171+0000 7f5474ff9640 1 -- 172.21.15.148:0/1822932116 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8556+0+0 (secure 0 0 0) 0x7f54680cf7b0 con 0x7f54781009d0 2024-09-19T07:22:57.181 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.171+0000 7f5477fff640 1 --2- 172.21.15.148:0/1573850186 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55790e8f7af0 0x55790e8f7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:57.181 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.171+0000 7f5476ffd640 1 -- 172.21.15.148:0/1573850186 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55790e8f7af0 msgr2=0x55790e8f7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:57.181 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.171+0000 7f5476ffd640 1 --2- 172.21.15.148:0/1573850186 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55790e8f7af0 0x55790e8f7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:57.181 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.171+0000 7f5476ffd640 1 -- 172.21.15.148:0/1573850186 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55790e8f8410 msgr2=0x55790e902770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:57.181 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.171+0000 7f5476ffd640 1 --2- 172.21.15.148:0/1573850186 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55790e8f8410 0x55790e902770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:57.181 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.171+0000 7f5476ffd640 1 -- 172.21.15.148:0/1573850186 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55790e803340 con 0x55790e902cb0 2024-09-19T07:22:57.182 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.171+0000 7f5476ffd640 1 --2- 172.21.15.148:0/1573850186 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55790e902cb0 0x55790e9050a0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f546c005ab0 tx=0x7f546c0040f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=616dfd66f2785f4f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:57.182 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.171+0000 7f5477fff640 1 --2- 172.21.15.148:0/1822932116 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f54600a3460 0x7f54600a5920 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5470005fd0 tx=0x7f5470009480 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:57.182 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.171+0000 7f545dffb640 1 -- 172.21.15.148:0/1573850186 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546c03f070 con 0x55790e902cb0 2024-09-19T07:22:57.182 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.171+0000 7f545dffb640 1 -- 172.21.15.148:0/1573850186 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f546c005520 con 0x55790e902cb0 2024-09-19T07:22:57.182 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.171+0000 7f545dffb640 1 -- 172.21.15.148:0/1573850186 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546c035030 con 0x55790e902cb0 2024-09-19T07:22:57.182 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.172+0000 7f5480ffe740 1 -- 172.21.15.148:0/1573850186 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55790e902cb0 msgr2=0x55790e9050a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:57.182 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.172+0000 7f5480ffe740 1 --2- 172.21.15.148:0/1573850186 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55790e902cb0 0x55790e9050a0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f546c005ab0 tx=0x7f546c0040f0 comp rx=0 tx=0).stop 2024-09-19T07:22:57.182 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.172+0000 7f5480ffe740 1 -- 172.21.15.148:0/1573850186 shutdown_connections 2024-09-19T07:22:57.182 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.172+0000 7f5480ffe740 1 --2- 172.21.15.148:0/1573850186 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55790e902cb0 0x55790e9050a0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:57.182 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.172+0000 7f5480ffe740 1 --2- 172.21.15.148:0/1573850186 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55790e8f8410 0x55790e902770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:57.182 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.172+0000 7f5480ffe740 1 --2- 172.21.15.148:0/1573850186 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55790e8f7af0 0x55790e8f7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:57.182 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.172+0000 7f5480ffe740 1 -- 172.21.15.148:0/1573850186 >> 172.21.15.148:0/1573850186 conn(0x55790e8f4060 msgr2=0x55790e8f4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:57.182 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.172+0000 7f5480ffe740 1 -- 172.21.15.148:0/1573850186 shutdown_connections 2024-09-19T07:22:57.183 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.172+0000 7f5480ffe740 1 -- 172.21.15.148:0/1573850186 wait complete. 2024-09-19T07:22:57.183 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.173+0000 7f5480ffe740 1 -- start start 2024-09-19T07:22:57.183 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.173+0000 7f5480ffe740 1 Processor -- start 2024-09-19T07:22:57.183 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.173+0000 7f5480ffe740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55790e8f7af0 0x55790e8ffb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:57.183 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.173+0000 7f5480ffe740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55790e8f8410 0x55790e900060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:57.183 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.173+0000 7f5480ffe740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55790e902cb0 0x55790e9005a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:57.183 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.173+0000 7f5480ffe740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55790e905880 con 0x55790e8f7af0 2024-09-19T07:22:57.183 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.173+0000 7f5480ffe740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55790e7e5290 con 0x55790e902cb0 2024-09-19T07:22:57.183 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.173+0000 7f5480ffe740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55790e905a00 con 0x55790e8f8410 2024-09-19T07:22:57.183 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.173+0000 7f5480ffe740 10 client.0 _ll_register_callbacks cb 0x55790e816140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:22:57.183 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.173+0000 7f54777fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55790e8f7af0 0x55790e8ffb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:57.183 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.173+0000 7f54777fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55790e8f7af0 0x55790e8ffb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50288/0 (socket says 172.21.15.148:50288) 2024-09-19T07:22:57.183 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.173+0000 7f54777fe640 1 -- 172.21.15.148:0/694044706 learned_addr learned my addr 172.21.15.148:0/694044706 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:22:57.184 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.174+0000 7f5477fff640 1 --2- 172.21.15.148:0/694044706 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55790e902cb0 0x55790e9005a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:57.184 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.174+0000 7f5476ffd640 1 --2- 172.21.15.148:0/694044706 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55790e8f8410 0x55790e900060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:57.184 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.174+0000 7f54777fe640 1 -- 172.21.15.148:0/694044706 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55790e8f8410 msgr2=0x55790e900060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:57.184 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.174+0000 7f54777fe640 1 --2- 172.21.15.148:0/694044706 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55790e8f8410 0x55790e900060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:57.184 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.174+0000 7f54777fe640 1 -- 172.21.15.148:0/694044706 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55790e902cb0 msgr2=0x55790e9005a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:57.184 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.174+0000 7f54777fe640 1 --2- 172.21.15.148:0/694044706 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55790e902cb0 0x55790e9005a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:57.184 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.174+0000 7f54777fe640 1 -- 172.21.15.148:0/694044706 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55790e56f210 con 0x55790e8f7af0 2024-09-19T07:22:57.185 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.174+0000 7f54777fe640 1 --2- 172.21.15.148:0/694044706 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55790e8f7af0 0x55790e8ffb20 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f5468009610 tx=0x7f5468018ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b5fcbde2f05909d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:57.185 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.174+0000 7f5456ffd640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:22:57.185 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.174+0000 7f5456ffd640 1 -- 172.21.15.148:0/694044706 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546809c170 con 0x55790e8f7af0 2024-09-19T07:22:57.185 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.174+0000 7f5456ffd640 1 -- 172.21.15.148:0/694044706 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8556+0+0 (secure 0 0 0) 0x7f54680860b0 con 0x55790e8f7af0 2024-09-19T07:22:57.185 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.174+0000 7f5480ffe740 1 -- 172.21.15.148:0/694044706 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f546c005520 con 0x55790e8f7af0 2024-09-19T07:22:57.185 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.174+0000 7f5456ffd640 1 -- 172.21.15.148:0/694044706 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f546809ba70 con 0x55790e8f7af0 2024-09-19T07:22:57.185 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.174+0000 7f5480ffe740 10 client.17208 fetch_fsmap learned FSMap version 45 2024-09-19T07:22:57.185 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.174+0000 7f5480ffe740 1 -- 172.21.15.148:0/694044706 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55790e63b620 con 0x55790e8f7af0 2024-09-19T07:22:57.185 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.174+0000 7f5456ffd640 1 -- 172.21.15.148:0/694044706 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f546c005520 con 0x55790e8f7af0 2024-09-19T07:22:57.185 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.174+0000 7f5456ffd640 1 -- 172.21.15.148:0/694044706 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 45) ==== 8354+0+0 (secure 0 0 0) 0x7f54680cd160 con 0x55790e8f7af0 2024-09-19T07:22:57.186 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.174+0000 7f5480ffe740 10 client.17208 fetch_fsmap finished waiting for FSMap version 45 2024-09-19T07:22:57.186 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.174+0000 7f5480ffe740 10 client.17208 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:22:57.186 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.174+0000 7f5480ffe740 20 client.17208 populate_metadata read hostname 'smithi148' 2024-09-19T07:22:57.186 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.175+0000 7f5480ffe740 1 --2- 172.21.15.148:0/694044706 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55790e912b80 0x55790e914fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:57.186 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.175+0000 7f5480ffe740 4 client.17208 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:22:57.186 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.175+0000 7f5480ffe740 1 -- 172.21.15.148:0/694044706 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55790e869a20 con 0x55790e912b80 2024-09-19T07:22:57.186 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.175+0000 7f5476ffd640 1 --2- 172.21.15.148:0/694044706 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55790e912b80 0x55790e914fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:57.186 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.175+0000 7f5476ffd640 1 --2- 172.21.15.148:0/694044706 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55790e912b80 0x55790e914fd0 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c2ba6dedb03ae31 server_cookie=6bca6665bae940a6 in_seq=0 out_seq=0 2024-09-19T07:22:57.186 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.175+0000 7f5456ffd640 10 client.17208 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:22:57.186 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.176+0000 7f5456ffd640 1 -- 172.21.15.148:0/694044706 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55790e869a20 con 0x55790e912b80 2024-09-19T07:22:57.186 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.176+0000 7f5456ffd640 10 client.17208 handle_command_reply: tid=0 2024-09-19T07:22:57.186 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.176+0000 7f5480ffe740 1 client.17208 shutdown 2024-09-19T07:22:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.176+0000 7f5480ffe740 1 -- 172.21.15.148:0/694044706 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55790e8f7af0 msgr2=0x55790e8ffb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.176+0000 7f5480ffe740 1 --2- 172.21.15.148:0/694044706 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55790e8f7af0 0x55790e8ffb20 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f5468009610 tx=0x7f5468018ad0 comp rx=0 tx=0).stop 2024-09-19T07:22:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.176+0000 7f5480ffe740 1 -- 172.21.15.148:0/694044706 shutdown_connections 2024-09-19T07:22:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.176+0000 7f5480ffe740 1 --2- 172.21.15.148:0/694044706 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55790e912b80 0x55790e914fd0 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.176+0000 7f5480ffe740 1 --2- 172.21.15.148:0/694044706 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55790e902cb0 0x55790e9005a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.176+0000 7f5456ffd640 0 client.17208 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:22:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.176+0000 7f5480ffe740 1 --2- 172.21.15.148:0/694044706 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55790e8f8410 0x55790e900060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.176+0000 7f5480ffe740 1 --2- 172.21.15.148:0/694044706 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55790e8f7af0 0x55790e8ffb20 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.176+0000 7f5480ffe740 1 -- 172.21.15.148:0/694044706 >> 172.21.15.148:0/694044706 conn(0x55790e8f4060 msgr2=0x55790e8f9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.176+0000 7f5480ffe740 1 -- 172.21.15.148:0/694044706 shutdown_connections 2024-09-19T07:22:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.176+0000 7f5480ffe740 1 -- 172.21.15.148:0/694044706 wait complete. 2024-09-19T07:22:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.176+0000 7f5480ffe740 20 client.17208 trim_cache size 0 max 16384 2024-09-19T07:22:57.196 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.191+0000 7f5480ffe740 1 Processor -- start 2024-09-19T07:22:57.197 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.191+0000 7f5480ffe740 1 -- start start 2024-09-19T07:22:57.197 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.191+0000 7f5480ffe740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55790e8f7af0 0x55790e9003d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:57.197 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.191+0000 7f5480ffe740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55790e8f8410 0x55790e901a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:57.197 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.191+0000 7f5480ffe740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55790e902cb0 0x55790e91a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:57.197 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.191+0000 7f5480ffe740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f54781b22e0 con 0x55790e8f7af0 2024-09-19T07:22:57.197 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.191+0000 7f5480ffe740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f54781afb80 con 0x55790e8f8410 2024-09-19T07:22:57.197 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.191+0000 7f5480ffe740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f54781ad9f0 con 0x55790e902cb0 2024-09-19T07:22:57.197 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.191+0000 7f54777fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55790e8f7af0 0x55790e9003d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:57.198 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.191+0000 7f54777fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55790e8f7af0 0x55790e9003d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50302/0 (socket says 172.21.15.148:50302) 2024-09-19T07:22:57.198 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.191+0000 7f54777fe640 1 -- 172.21.15.148:0/2017092296 learned_addr learned my addr 172.21.15.148:0/2017092296 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:22:57.198 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.191+0000 7f5477fff640 1 --2- 172.21.15.148:0/2017092296 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55790e902cb0 0x55790e91a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:57.198 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.191+0000 7f5476ffd640 1 --2- 172.21.15.148:0/2017092296 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55790e8f8410 0x55790e901a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:57.198 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.191+0000 7f54777fe640 1 -- 172.21.15.148:0/2017092296 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55790e902cb0 msgr2=0x55790e91a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:57.198 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.191+0000 7f54777fe640 1 --2- 172.21.15.148:0/2017092296 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55790e902cb0 0x55790e91a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:57.198 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.191+0000 7f54777fe640 1 -- 172.21.15.148:0/2017092296 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55790e8f8410 msgr2=0x55790e901a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:57.198 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.191+0000 7f54777fe640 1 --2- 172.21.15.148:0/2017092296 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55790e8f8410 0x55790e901a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:57.198 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.191+0000 7f54777fe640 1 -- 172.21.15.148:0/2017092296 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55790e8f3e90 con 0x55790e8f7af0 2024-09-19T07:22:57.198 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.191+0000 7f54777fe640 1 --2- 172.21.15.148:0/2017092296 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55790e8f7af0 0x55790e9003d0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f5468021000 tx=0x7f5468099f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4be71b7334192ba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:57.198 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.192+0000 7f545d7fa640 1 -- 172.21.15.148:0/2017092296 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5468020070 con 0x55790e8f7af0 2024-09-19T07:22:57.198 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.192+0000 7f545d7fa640 1 -- 172.21.15.148:0/2017092296 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54680962a0 con 0x55790e8f7af0 2024-09-19T07:22:57.198 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.192+0000 7f545d7fa640 1 -- 172.21.15.148:0/2017092296 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546809fe20 con 0x55790e8f7af0 2024-09-19T07:22:57.199 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.192+0000 7f5480ffe740 1 -- 172.21.15.148:0/2017092296 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55790e8f7af0 msgr2=0x55790e9003d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:57.199 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.192+0000 7f5480ffe740 1 --2- 172.21.15.148:0/2017092296 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55790e8f7af0 0x55790e9003d0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f5468021000 tx=0x7f5468099f80 comp rx=0 tx=0).stop 2024-09-19T07:22:57.199 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.192+0000 7f5480ffe740 1 -- 172.21.15.148:0/2017092296 shutdown_connections 2024-09-19T07:22:57.199 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.192+0000 7f5480ffe740 1 --2- 172.21.15.148:0/2017092296 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55790e902cb0 0x55790e91a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:57.199 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.192+0000 7f5480ffe740 1 --2- 172.21.15.148:0/2017092296 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55790e8f8410 0x55790e901a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:57.199 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.192+0000 7f5480ffe740 1 --2- 172.21.15.148:0/2017092296 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55790e8f7af0 0x55790e9003d0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:57.199 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.192+0000 7f5480ffe740 1 -- 172.21.15.148:0/2017092296 >> 172.21.15.148:0/2017092296 conn(0x55790e8f4060 msgr2=0x55790e901380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:57.199 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.192+0000 7f5480ffe740 1 -- 172.21.15.148:0/2017092296 shutdown_connections 2024-09-19T07:22:57.199 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.192+0000 7f5480ffe740 1 -- 172.21.15.148:0/2017092296 wait complete. 2024-09-19T07:22:57.200 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.193+0000 7f5480ffe740 1 -- start start 2024-09-19T07:22:57.200 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.193+0000 7f5480ffe740 1 Processor -- start 2024-09-19T07:22:57.200 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.193+0000 7f5480ffe740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55790e8f7af0 0x55790e8fca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:57.200 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.193+0000 7f5480ffe740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55790e8f8410 0x55790e8fcfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:57.200 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.193+0000 7f5480ffe740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55790e902cb0 0x55790e8fd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:57.200 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.193+0000 7f5480ffe740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f54781ae040 con 0x55790e8f8410 2024-09-19T07:22:57.200 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.193+0000 7f5480ffe740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f54781af4b0 con 0x55790e8f7af0 2024-09-19T07:22:57.200 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.193+0000 7f5480ffe740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f54781ae710 con 0x55790e902cb0 2024-09-19T07:22:57.200 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.193+0000 7f5480ffe740 10 client.0 _ll_register_callbacks cb 0x7f5468097e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:22:57.200 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.193+0000 7f5476ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55790e8f8410 0x55790e8fcfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:57.200 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.193+0000 7f5476ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55790e8f8410 0x55790e8fcfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50310/0 (socket says 172.21.15.148:50310) 2024-09-19T07:22:57.201 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.193+0000 7f5476ffd640 1 -- 172.21.15.148:0/1894337201 learned_addr learned my addr 172.21.15.148:0/1894337201 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:22:57.201 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.193+0000 7f54777fe640 1 --2- 172.21.15.148:0/1894337201 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55790e8f7af0 0x55790e8fca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:57.201 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.194+0000 7f5476ffd640 1 -- 172.21.15.148:0/1894337201 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55790e902cb0 msgr2=0x55790e8fd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:57.201 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.194+0000 7f5477fff640 1 --2- 172.21.15.148:0/1894337201 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55790e902cb0 0x55790e8fd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:57.201 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.194+0000 7f5476ffd640 1 --2- 172.21.15.148:0/1894337201 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55790e902cb0 0x55790e8fd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:57.201 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.194+0000 7f5476ffd640 1 -- 172.21.15.148:0/1894337201 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55790e8f7af0 msgr2=0x55790e8fca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:57.201 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.194+0000 7f5476ffd640 1 --2- 172.21.15.148:0/1894337201 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55790e8f7af0 0x55790e8fca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:57.201 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.194+0000 7f5476ffd640 1 -- 172.21.15.148:0/1894337201 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55790e8f4cf0 con 0x55790e8f8410 2024-09-19T07:22:57.201 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.194+0000 7f5477fff640 1 --2- 172.21.15.148:0/1894337201 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55790e902cb0 0x55790e8fd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:22:57.201 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.194+0000 7f5476ffd640 1 --2- 172.21.15.148:0/1894337201 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55790e8f8410 0x55790e8fcfd0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f546c009230 tx=0x7f546c004a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4299a85fe1982a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:57.201 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.194+0000 7f5456ffd640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:22:57.201 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.194+0000 7f5456ffd640 1 -- 172.21.15.148:0/1894337201 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546c035040 con 0x55790e8f8410 2024-09-19T07:22:57.202 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.194+0000 7f5480ffe740 1 -- 172.21.15.148:0/1894337201 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55790e8fb700 con 0x55790e8f8410 2024-09-19T07:22:57.202 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.194+0000 7f5456ffd640 1 -- 172.21.15.148:0/1894337201 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8556+0+0 (secure 0 0 0) 0x7f546c0317b0 con 0x55790e8f8410 2024-09-19T07:22:57.202 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.194+0000 7f5456ffd640 1 -- 172.21.15.148:0/1894337201 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f546c05f050 con 0x55790e8f8410 2024-09-19T07:22:57.202 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.194+0000 7f5480ffe740 10 client.17214 fetch_fsmap learned FSMap version 45 2024-09-19T07:22:57.202 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.194+0000 7f5480ffe740 1 -- 172.21.15.148:0/1894337201 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55790e97d970 con 0x55790e8f8410 2024-09-19T07:22:57.202 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.194+0000 7f5456ffd640 1 -- 172.21.15.148:0/1894337201 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55790e8fb700 con 0x55790e8f8410 2024-09-19T07:22:57.202 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.194+0000 7f5456ffd640 1 -- 172.21.15.148:0/1894337201 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 45) ==== 8354+0+0 (secure 0 0 0) 0x7f546c003880 con 0x55790e8f8410 2024-09-19T07:22:57.202 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.195+0000 7f5480ffe740 10 client.17214 fetch_fsmap finished waiting for FSMap version 45 2024-09-19T07:22:57.202 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.195+0000 7f5480ffe740 10 client.17214 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:22:57.202 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.195+0000 7f5480ffe740 20 client.17214 populate_metadata read hostname 'smithi148' 2024-09-19T07:22:57.202 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.195+0000 7f5480ffe740 1 --2- 172.21.15.148:0/1894337201 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55790e97dd00 0x55790e9800f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:57.202 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.195+0000 7f5480ffe740 4 client.17214 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:22:57.202 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.195+0000 7f5480ffe740 1 -- 172.21.15.148:0/1894337201 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55790e863d70 con 0x55790e97dd00 2024-09-19T07:22:57.202 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.195+0000 7f54777fe640 1 --2- 172.21.15.148:0/1894337201 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55790e97dd00 0x55790e9800f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:57.203 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.195+0000 7f5456ffd640 10 client.17214 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:22:57.203 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.195+0000 7f54777fe640 1 --2- 172.21.15.148:0/1894337201 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55790e97dd00 0x55790e9800f0 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eda891c275546fa3 server_cookie=5f51bd38e17645d9 in_seq=0 out_seq=0 2024-09-19T07:22:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.210+0000 7f5456ffd640 1 -- 172.21.15.148:0/1894337201 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55790e863d70 con 0x55790e97dd00 2024-09-19T07:22:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.210+0000 7f5456ffd640 10 client.17214 handle_command_reply: tid=0 2024-09-19T07:22:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.210+0000 7f5480ffe740 1 client.17214 shutdown 2024-09-19T07:22:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.210+0000 7f5480ffe740 1 -- 172.21.15.148:0/1894337201 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55790e8f8410 msgr2=0x55790e8fcfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.210+0000 7f5480ffe740 1 --2- 172.21.15.148:0/1894337201 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55790e8f8410 0x55790e8fcfd0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f546c009230 tx=0x7f546c004a70 comp rx=0 tx=0).stop 2024-09-19T07:22:57.212 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.210+0000 7f5480ffe740 1 -- 172.21.15.148:0/1894337201 shutdown_connections 2024-09-19T07:22:57.212 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.210+0000 7f5480ffe740 1 --2- 172.21.15.148:0/1894337201 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55790e97dd00 0x55790e9800f0 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:57.212 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.210+0000 7f5480ffe740 1 --2- 172.21.15.148:0/1894337201 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55790e902cb0 0x55790e8fd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:57.212 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.210+0000 7f5480ffe740 1 --2- 172.21.15.148:0/1894337201 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55790e8f8410 0x55790e8fcfd0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:57.212 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.210+0000 7f5456ffd640 0 client.17214 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:22:57.212 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.210+0000 7f5480ffe740 1 --2- 172.21.15.148:0/1894337201 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55790e8f7af0 0x55790e8fca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:57.212 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.210+0000 7f5480ffe740 1 -- 172.21.15.148:0/1894337201 >> 172.21.15.148:0/1894337201 conn(0x55790e8f4060 msgr2=0x55790e8f9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:57.212 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.210+0000 7f5480ffe740 1 -- 172.21.15.148:0/1894337201 shutdown_connections 2024-09-19T07:22:57.212 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.210+0000 7f5480ffe740 1 -- 172.21.15.148:0/1894337201 wait complete. 2024-09-19T07:22:57.212 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.210+0000 7f5480ffe740 20 client.17214 trim_cache size 0 max 16384 2024-09-19T07:22:57.212 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:22:57.213 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:22:57.213 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:22:57.213 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:22:57.214 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.211+0000 7f547e186640 1 -- 172.21.15.148:0/1822932116 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f54600a3460 msgr2=0x7f54600a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:57.214 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.211+0000 7f547e186640 1 --2- 172.21.15.148:0/1822932116 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f54600a3460 0x7f54600a5920 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5470005fd0 tx=0x7f5470009480 comp rx=0 tx=0).stop 2024-09-19T07:22:57.214 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.211+0000 7f547e186640 1 -- 172.21.15.148:0/1822932116 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54781009d0 msgr2=0x7f54780fcc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:57.215 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.211+0000 7f547e186640 1 --2- 172.21.15.148:0/1822932116 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54781009d0 0x7f54780fcc90 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f546800d770 tx=0x7f546800dc30 comp rx=0 tx=0).stop 2024-09-19T07:22:57.215 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.211+0000 7f547e186640 1 -- 172.21.15.148:0/1822932116 shutdown_connections 2024-09-19T07:22:57.215 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.211+0000 7f547e186640 1 --2- 172.21.15.148:0/1822932116 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f54600a3460 0x7f54600a5920 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:57.215 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.211+0000 7f547e186640 1 --2- 172.21.15.148:0/1822932116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54781069e0 0x7f54780fd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:57.215 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.211+0000 7f547e186640 1 --2- 172.21.15.148:0/1822932116 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5478101370 0x7f54780fd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:57.215 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.211+0000 7f547e186640 1 --2- 172.21.15.148:0/1822932116 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54781009d0 0x7f54780fcc90 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:57.215 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.211+0000 7f547e186640 1 -- 172.21.15.148:0/1822932116 >> 172.21.15.148:0/1822932116 conn(0x7f54780fc6f0 msgr2=0x7f547806a500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:57.215 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.211+0000 7f547e186640 1 -- 172.21.15.148:0/1822932116 shutdown_connections 2024-09-19T07:22:57.215 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:22:57.211+0000 7f547e186640 1 -- 172.21.15.148:0/1822932116 wait complete. 2024-09-19T07:22:57.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:22:57 smithi148 ceph-mon[31180]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:22:57.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:22:57 smithi165 ceph-mon[35326]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:22:58.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:22:57 smithi179 ceph-mon[35716]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:22:58.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:22:58 smithi148 ceph-mon[31180]: pgmap v371: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 30 KiB/s wr, 11 op/s 2024-09-19T07:22:58.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:22:58 smithi165 ceph-mon[35326]: pgmap v371: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 30 KiB/s wr, 11 op/s 2024-09-19T07:22:59.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:22:58 smithi179 ceph-mon[35716]: pgmap v371: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 30 KiB/s wr, 11 op/s 2024-09-19T07:23:00.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:23:00 smithi148 ceph-mon[31180]: pgmap v372: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 37 KiB/s wr, 13 op/s 2024-09-19T07:23:00.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:23:00 smithi165 ceph-mon[35326]: pgmap v372: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 37 KiB/s wr, 13 op/s 2024-09-19T07:23:01.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:23:00 smithi179 ceph-mon[35716]: pgmap v372: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 37 KiB/s wr, 13 op/s 2024-09-19T07:23:02.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:23:02 smithi148 ceph-mon[31180]: pgmap v373: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 38 KiB/s wr, 17 op/s 2024-09-19T07:23:02.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:23:02 smithi165 ceph-mon[35326]: pgmap v373: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 38 KiB/s wr, 17 op/s 2024-09-19T07:23:03.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:23:02 smithi179 ceph-mon[35716]: pgmap v373: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 38 KiB/s wr, 17 op/s 2024-09-19T07:23:04.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:23:04 smithi148 ceph-mon[31180]: pgmap v374: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-19T07:23:04.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:23:04 smithi165 ceph-mon[35326]: pgmap v374: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-19T07:23:05.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:23:04 smithi179 ceph-mon[35716]: pgmap v374: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-19T07:23:06.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:23:06 smithi148 ceph-mon[31180]: pgmap v375: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 74 KiB/s wr, 32 op/s 2024-09-19T07:23:06.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:23:06 smithi165 ceph-mon[35326]: pgmap v375: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 74 KiB/s wr, 32 op/s 2024-09-19T07:23:07.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:23:06 smithi179 ceph-mon[35716]: pgmap v375: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 74 KiB/s wr, 32 op/s 2024-09-19T07:23:07.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:23:07 smithi148 ceph-mon[31180]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T07:23:07.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:23:07 smithi165 ceph-mon[35326]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T07:23:08.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:23:07 smithi179 ceph-mon[35716]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T07:23:08.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:23:08 smithi148 ceph-mon[31180]: pgmap v377: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 76 KiB/s wr, 33 op/s 2024-09-19T07:23:08.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:23:08 smithi165 ceph-mon[35326]: pgmap v377: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 76 KiB/s wr, 33 op/s 2024-09-19T07:23:09.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:23:08 smithi179 ceph-mon[35716]: pgmap v377: 97 pgs: 97 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 76 KiB/s wr, 33 op/s 2024-09-19T07:23:10.300 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.297+0000 7f1f60f18640 1 -- 172.21.15.148:0/819607409 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f5c103630 msgr2=0x7f1f5c10bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:10.300 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.297+0000 7f1f60f18640 1 --2- 172.21.15.148:0/819607409 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f5c103630 0x7f1f5c10bb10 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f1f50009900 tx=0x7f1f5002a480 comp rx=0 tx=0).stop 2024-09-19T07:23:10.300 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.297+0000 7f1f60f18640 1 -- 172.21.15.148:0/819607409 shutdown_connections 2024-09-19T07:23:10.300 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.297+0000 7f1f60f18640 1 --2- 172.21.15.148:0/819607409 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f5c10c0e0 0x7f1f5c10e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:10.300 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.297+0000 7f1f60f18640 1 --2- 172.21.15.148:0/819607409 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f5c103630 0x7f1f5c10bb10 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:10.300 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.297+0000 7f1f60f18640 1 --2- 172.21.15.148:0/819607409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f5c102d10 0x7f1f5c1030f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:10.300 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.297+0000 7f1f60f18640 1 -- 172.21.15.148:0/819607409 >> 172.21.15.148:0/819607409 conn(0x7f1f5c0fc6c0 msgr2=0x7f1f5c0feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:10.300 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.297+0000 7f1f60f18640 1 -- 172.21.15.148:0/819607409 shutdown_connections 2024-09-19T07:23:10.300 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.297+0000 7f1f60f18640 1 -- 172.21.15.148:0/819607409 wait complete. 2024-09-19T07:23:10.301 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.298+0000 7f1f60f18640 1 Processor -- start 2024-09-19T07:23:10.301 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.298+0000 7f1f60f18640 1 -- start start 2024-09-19T07:23:10.301 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.298+0000 7f1f60f18640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f5c102d10 0x7f1f5c1983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:10.301 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.298+0000 7f1f60f18640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f5c103630 0x7f1f5c198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:10.301 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.298+0000 7f1f60f18640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f5c10c0e0 0x7f1f5c19cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:10.301 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.298+0000 7f1f60f18640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c111ee0 con 0x7f1f5c103630 2024-09-19T07:23:10.301 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.298+0000 7f1f60f18640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c111d60 con 0x7f1f5c102d10 2024-09-19T07:23:10.301 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.298+0000 7f1f60f18640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c112060 con 0x7f1f5c10c0e0 2024-09-19T07:23:10.301 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.298+0000 7f1f59d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f5c103630 0x7f1f5c198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:10.301 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.298+0000 7f1f59d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f5c103630 0x7f1f5c198910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60046/0 (socket says 172.21.15.148:60046) 2024-09-19T07:23:10.301 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.298+0000 7f1f59d9b640 1 -- 172.21.15.148:0/3950662820 learned_addr learned my addr 172.21.15.148:0/3950662820 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:23:10.301 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.299+0000 7f1f5a59c640 1 --2- 172.21.15.148:0/3950662820 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f5c102d10 0x7f1f5c1983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:10.301 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.299+0000 7f1f5ad9d640 1 --2- 172.21.15.148:0/3950662820 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f5c10c0e0 0x7f1f5c19cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:10.301 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.299+0000 7f1f59d9b640 1 -- 172.21.15.148:0/3950662820 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f5c10c0e0 msgr2=0x7f1f5c19cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:10.302 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.299+0000 7f1f59d9b640 1 --2- 172.21.15.148:0/3950662820 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f5c10c0e0 0x7f1f5c19cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:10.302 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.299+0000 7f1f59d9b640 1 -- 172.21.15.148:0/3950662820 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f5c102d10 msgr2=0x7f1f5c1983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:10.302 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.299+0000 7f1f59d9b640 1 --2- 172.21.15.148:0/3950662820 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f5c102d10 0x7f1f5c1983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:10.302 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.299+0000 7f1f59d9b640 1 -- 172.21.15.148:0/3950662820 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f5c19d3c0 con 0x7f1f5c103630 2024-09-19T07:23:10.302 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.299+0000 7f1f5a59c640 1 --2- 172.21.15.148:0/3950662820 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f5c102d10 0x7f1f5c1983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:23:10.302 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.299+0000 7f1f59d9b640 1 --2- 172.21.15.148:0/3950662820 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f5c103630 0x7f1f5c198910 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f1f50006010 tx=0x7f1f50004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:10.302 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.299+0000 7f1f4b7fe640 1 -- 172.21.15.148:0/3950662820 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f5003f030 con 0x7f1f5c103630 2024-09-19T07:23:10.302 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.299+0000 7f1f60f18640 1 -- 172.21.15.148:0/3950662820 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f5c19d650 con 0x7f1f5c103630 2024-09-19T07:23:10.302 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.299+0000 7f1f4b7fe640 1 -- 172.21.15.148:0/3950662820 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f50003ad0 con 0x7f1f5c103630 2024-09-19T07:23:10.302 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.299+0000 7f1f4b7fe640 1 -- 172.21.15.148:0/3950662820 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f50035070 con 0x7f1f5c103630 2024-09-19T07:23:10.303 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.299+0000 7f1f60f18640 1 -- 172.21.15.148:0/3950662820 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f5c1a4f40 con 0x7f1f5c103630 2024-09-19T07:23:10.309 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.301+0000 7f1f4b7fe640 1 -- 172.21.15.148:0/3950662820 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f1f50042030 con 0x7f1f5c103630 2024-09-19T07:23:10.309 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.302+0000 7f1f63cb1740 1 Processor -- start 2024-09-19T07:23:10.309 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.302+0000 7f1f63cb1740 1 -- start start 2024-09-19T07:23:10.309 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.302+0000 7f1f4b7fe640 1 --2- 172.21.15.148:0/3950662820 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f1f440a3460 0x7f1f440a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:10.309 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.302+0000 7f1f63cb1740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5568f113a9b0 0x5568f113ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:10.309 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.302+0000 7f1f63cb1740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568f113b2d0 0x5568f1149b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:10.309 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.302+0000 7f1f63cb1740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568f114a0c0 0x5568f114c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:10.309 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.302+0000 7f1f63cb1740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5568f109f2f0 con 0x5568f113b2d0 2024-09-19T07:23:10.309 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.302+0000 7f1f63cb1740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5568f1047270 con 0x5568f113a9b0 2024-09-19T07:23:10.309 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.302+0000 7f1f63cb1740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5568f109b2b0 con 0x5568f114a0c0 2024-09-19T07:23:10.309 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.302+0000 7f1f59d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568f113b2d0 0x5568f1149b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:10.310 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.302+0000 7f1f5ad9d640 1 --2- 172.21.15.148:0/3950662820 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f1f440a3460 0x7f1f440a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:10.310 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.302+0000 7f1f59d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568f113b2d0 0x5568f1149b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60054/0 (socket says 172.21.15.148:60054) 2024-09-19T07:23:10.310 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.302+0000 7f1f59d9b640 1 -- 172.21.15.148:0/963145994 learned_addr learned my addr 172.21.15.148:0/963145994 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:23:10.310 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.302+0000 7f1f4b7fe640 1 -- 172.21.15.148:0/3950662820 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8600+0+0 (secure 0 0 0) 0x7f1f500f05b0 con 0x7f1f5c103630 2024-09-19T07:23:10.310 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.302+0000 7f1f5a59c640 1 --2- 172.21.15.148:0/963145994 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5568f113a9b0 0x5568f113ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:10.310 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.302+0000 7f1f5ad9d640 1 --2- 172.21.15.148:0/963145994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568f114a0c0 0x5568f114c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:10.310 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.302+0000 7f1f59d9b640 1 -- 172.21.15.148:0/963145994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568f114a0c0 msgr2=0x5568f114c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:10.310 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.303+0000 7f1f59d9b640 1 --2- 172.21.15.148:0/963145994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568f114a0c0 0x5568f114c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:10.310 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.303+0000 7f1f59d9b640 1 -- 172.21.15.148:0/963145994 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5568f113a9b0 msgr2=0x5568f113ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:10.310 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.303+0000 7f1f59d9b640 1 --2- 172.21.15.148:0/963145994 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5568f113a9b0 0x5568f113ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:10.310 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.303+0000 7f1f59d9b640 1 -- 172.21.15.148:0/963145994 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568f1046340 con 0x5568f113b2d0 2024-09-19T07:23:10.310 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.303+0000 7f1f5ad9d640 1 --2- 172.21.15.148:0/3950662820 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f1f440a3460 0x7f1f440a5920 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1f54005fd0 tx=0x7f1f54013a40 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:10.310 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.303+0000 7f1f59d9b640 1 --2- 172.21.15.148:0/963145994 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568f113b2d0 0x5568f1149b80 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f1f500edbc0 tx=0x7f1f5002a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1dbc409fedb203b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:10.311 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.303+0000 7f1f48ff9640 1 -- 172.21.15.148:0/963145994 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f50049020 con 0x5568f113b2d0 2024-09-19T07:23:10.311 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.303+0000 7f1f48ff9640 1 -- 172.21.15.148:0/963145994 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f5003b460 con 0x5568f113b2d0 2024-09-19T07:23:10.311 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.303+0000 7f1f48ff9640 1 -- 172.21.15.148:0/963145994 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f500bcfa0 con 0x5568f113b2d0 2024-09-19T07:23:10.311 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.304+0000 7f1f63cb1740 1 -- 172.21.15.148:0/963145994 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568f113b2d0 msgr2=0x5568f1149b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:10.311 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.304+0000 7f1f63cb1740 1 --2- 172.21.15.148:0/963145994 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568f113b2d0 0x5568f1149b80 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f1f500edbc0 tx=0x7f1f5002a480 comp rx=0 tx=0).stop 2024-09-19T07:23:10.311 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.304+0000 7f1f63cb1740 1 -- 172.21.15.148:0/963145994 shutdown_connections 2024-09-19T07:23:10.311 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.304+0000 7f1f63cb1740 1 --2- 172.21.15.148:0/963145994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568f114a0c0 0x5568f114c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:10.311 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.304+0000 7f1f63cb1740 1 --2- 172.21.15.148:0/963145994 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568f113b2d0 0x5568f1149b80 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:10.311 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.304+0000 7f1f63cb1740 1 --2- 172.21.15.148:0/963145994 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5568f113a9b0 0x5568f113ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:10.311 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.304+0000 7f1f63cb1740 1 -- 172.21.15.148:0/963145994 >> 172.21.15.148:0/963145994 conn(0x5568f1137060 msgr2=0x5568f1137440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:10.311 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.304+0000 7f1f63cb1740 1 -- 172.21.15.148:0/963145994 shutdown_connections 2024-09-19T07:23:10.311 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.304+0000 7f1f63cb1740 1 -- 172.21.15.148:0/963145994 wait complete. 2024-09-19T07:23:10.311 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.304+0000 7f1f63cb1740 1 -- start start 2024-09-19T07:23:10.311 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.304+0000 7f1f63cb1740 1 Processor -- start 2024-09-19T07:23:10.312 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.304+0000 7f1f63cb1740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5568f113a9b0 0x5568f1147040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:10.312 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.304+0000 7f1f63cb1740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568f113b2d0 0x5568f1147580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:10.312 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.304+0000 7f1f63cb1740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568f114a0c0 0x5568f1147ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:10.312 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.304+0000 7f1f63cb1740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5568f114ca50 con 0x5568f114a0c0 2024-09-19T07:23:10.312 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.304+0000 7f1f63cb1740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5568f1028290 con 0x5568f113a9b0 2024-09-19T07:23:10.312 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.304+0000 7f1f63cb1740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5568f114cbd0 con 0x5568f113b2d0 2024-09-19T07:23:10.312 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.304+0000 7f1f63cb1740 10 client.0 _ll_register_callbacks cb 0x5568f1059140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:23:10.312 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.304+0000 7f1f5ad9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568f114a0c0 0x5568f1147ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:10.312 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.305+0000 7f1f5ad9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568f114a0c0 0x5568f1147ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60062/0 (socket says 172.21.15.148:60062) 2024-09-19T07:23:10.312 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.305+0000 7f1f5ad9d640 1 -- 172.21.15.148:0/3829276249 learned_addr learned my addr 172.21.15.148:0/3829276249 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:23:10.312 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.305+0000 7f1f5a59c640 1 --2- 172.21.15.148:0/3829276249 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5568f113a9b0 0x5568f1147040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:10.312 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.305+0000 7f1f59d9b640 1 --2- 172.21.15.148:0/3829276249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568f113b2d0 0x5568f1147580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:10.312 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.305+0000 7f1f5ad9d640 1 -- 172.21.15.148:0/3829276249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568f113b2d0 msgr2=0x5568f1147580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:10.313 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.305+0000 7f1f5ad9d640 1 --2- 172.21.15.148:0/3829276249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568f113b2d0 0x5568f1147580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:10.313 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.305+0000 7f1f5ad9d640 1 -- 172.21.15.148:0/3829276249 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5568f113a9b0 msgr2=0x5568f1147040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:10.313 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.305+0000 7f1f5ad9d640 1 --2- 172.21.15.148:0/3829276249 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5568f113a9b0 0x5568f1147040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:10.313 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.305+0000 7f1f5ad9d640 1 -- 172.21.15.148:0/3829276249 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568f0db2210 con 0x5568f114a0c0 2024-09-19T07:23:10.313 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.305+0000 7f1f5ad9d640 1 --2- 172.21.15.148:0/3829276249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568f114a0c0 0x5568f1147ac0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f1f54003c60 tx=0x7f1f54004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88b41103a8c40d47 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:10.313 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.305+0000 7f1f41ffb640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:23:10.313 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.305+0000 7f1f41ffb640 1 -- 172.21.15.148:0/3829276249 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f54025030 con 0x5568f114a0c0 2024-09-19T07:23:10.313 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.305+0000 7f1f41ffb640 1 -- 172.21.15.148:0/3829276249 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8600+0+0 (secure 0 0 0) 0x7f1f54004b20 con 0x5568f114a0c0 2024-09-19T07:23:10.313 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.305+0000 7f1f63cb1740 1 -- 172.21.15.148:0/3829276249 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5568f10aca20 con 0x5568f114a0c0 2024-09-19T07:23:10.313 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.305+0000 7f1f41ffb640 1 -- 172.21.15.148:0/3829276249 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f1f5402f050 con 0x5568f114a0c0 2024-09-19T07:23:10.313 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.305+0000 7f1f63cb1740 10 client.17226 fetch_fsmap learned FSMap version 45 2024-09-19T07:23:10.313 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.305+0000 7f1f63cb1740 1 -- 172.21.15.148:0/3829276249 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x5568f0e7e620 con 0x5568f114a0c0 2024-09-19T07:23:10.313 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.305+0000 7f1f41ffb640 1 -- 172.21.15.148:0/3829276249 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5568f10aca20 con 0x5568f114a0c0 2024-09-19T07:23:10.314 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.306+0000 7f1f41ffb640 1 -- 172.21.15.148:0/3829276249 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 45) ==== 8354+0+0 (secure 0 0 0) 0x7f1f54005220 con 0x5568f114a0c0 2024-09-19T07:23:10.314 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.306+0000 7f1f63cb1740 10 client.17226 fetch_fsmap finished waiting for FSMap version 45 2024-09-19T07:23:10.314 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.306+0000 7f1f63cb1740 10 client.17226 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:23:10.314 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.306+0000 7f1f63cb1740 20 client.17226 populate_metadata read hostname 'smithi148' 2024-09-19T07:23:10.314 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.306+0000 7f1f63cb1740 1 --2- 172.21.15.148:0/3829276249 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5568f1159de0 0x5568f115c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:10.314 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.306+0000 7f1f63cb1740 4 client.17226 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:23:10.314 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.306+0000 7f1f63cb1740 1 -- 172.21.15.148:0/3829276249 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5568f10a6d70 con 0x5568f1159de0 2024-09-19T07:23:10.314 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.306+0000 7f1f5a59c640 1 --2- 172.21.15.148:0/3829276249 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5568f1159de0 0x5568f115c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:10.314 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.306+0000 7f1f41ffb640 10 client.17226 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:23:10.314 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.306+0000 7f1f5a59c640 1 --2- 172.21.15.148:0/3829276249 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5568f1159de0 0x5568f115c1d0 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ee948e96fbf436a server_cookie=e4a0207c86ecd623 in_seq=0 out_seq=0 2024-09-19T07:23:10.314 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.307+0000 7f1f41ffb640 1 -- 172.21.15.148:0/3829276249 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5568f10a6d70 con 0x5568f1159de0 2024-09-19T07:23:10.314 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.307+0000 7f1f41ffb640 10 client.17226 handle_command_reply: tid=0 2024-09-19T07:23:10.314 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.307+0000 7f1f63cb1740 1 client.17226 shutdown 2024-09-19T07:23:10.314 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.307+0000 7f1f63cb1740 1 -- 172.21.15.148:0/3829276249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568f114a0c0 msgr2=0x5568f1147ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:10.315 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.307+0000 7f1f63cb1740 1 --2- 172.21.15.148:0/3829276249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568f114a0c0 0x5568f1147ac0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f1f54003c60 tx=0x7f1f54004ab0 comp rx=0 tx=0).stop 2024-09-19T07:23:10.315 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.307+0000 7f1f63cb1740 1 -- 172.21.15.148:0/3829276249 shutdown_connections 2024-09-19T07:23:10.315 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.307+0000 7f1f63cb1740 1 --2- 172.21.15.148:0/3829276249 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5568f1159de0 0x5568f115c1d0 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:10.315 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.307+0000 7f1f63cb1740 1 --2- 172.21.15.148:0/3829276249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568f114a0c0 0x5568f1147ac0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:10.315 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.307+0000 7f1f63cb1740 1 --2- 172.21.15.148:0/3829276249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568f113b2d0 0x5568f1147580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:10.315 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.307+0000 7f1f63cb1740 1 --2- 172.21.15.148:0/3829276249 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5568f113a9b0 0x5568f1147040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:10.315 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.307+0000 7f1f41ffb640 0 client.17226 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:23:10.315 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.307+0000 7f1f63cb1740 1 -- 172.21.15.148:0/3829276249 >> 172.21.15.148:0/3829276249 conn(0x5568f1137060 msgr2=0x5568f113ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:10.315 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.307+0000 7f1f63cb1740 1 -- 172.21.15.148:0/3829276249 shutdown_connections 2024-09-19T07:23:10.315 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.307+0000 7f1f63cb1740 1 -- 172.21.15.148:0/3829276249 wait complete. 2024-09-19T07:23:10.315 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.307+0000 7f1f63cb1740 20 client.17226 trim_cache size 0 max 16384 2024-09-19T07:23:10.326 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.321+0000 7f1f63cb1740 1 Processor -- start 2024-09-19T07:23:10.326 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.321+0000 7f1f63cb1740 1 -- start start 2024-09-19T07:23:10.326 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.321+0000 7f1f63cb1740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5568f113a9b0 0x5568f113cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:10.326 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.321+0000 7f1f63cb1740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568f113b2d0 0x5568f1161ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:10.326 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.321+0000 7f1f63cb1740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568f114a0c0 0x5568f1162000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:10.326 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.321+0000 7f1f63cb1740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c1adf90 con 0x5568f113b2d0 2024-09-19T07:23:10.326 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.321+0000 7f1f63cb1740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c1ab830 con 0x5568f113a9b0 2024-09-19T07:23:10.326 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.321+0000 7f1f63cb1740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c1a96a0 con 0x5568f114a0c0 2024-09-19T07:23:10.326 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.322+0000 7f1f59d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568f113b2d0 0x5568f1161ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:10.326 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.322+0000 7f1f59d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568f113b2d0 0x5568f1161ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60068/0 (socket says 172.21.15.148:60068) 2024-09-19T07:23:10.326 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.322+0000 7f1f59d9b640 1 -- 172.21.15.148:0/1883368930 learned_addr learned my addr 172.21.15.148:0/1883368930 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:23:10.327 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.322+0000 7f1f5a59c640 1 --2- 172.21.15.148:0/1883368930 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5568f113a9b0 0x5568f113cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:10.327 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.322+0000 7f1f59d9b640 1 -- 172.21.15.148:0/1883368930 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568f114a0c0 msgr2=0x5568f1162000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:10.327 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.322+0000 7f1f59d9b640 1 --2- 172.21.15.148:0/1883368930 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568f114a0c0 0x5568f1162000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:10.327 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.322+0000 7f1f59d9b640 1 -- 172.21.15.148:0/1883368930 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5568f113a9b0 msgr2=0x5568f113cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:10.327 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.322+0000 7f1f59d9b640 1 --2- 172.21.15.148:0/1883368930 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5568f113a9b0 0x5568f113cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:10.327 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.322+0000 7f1f59d9b640 1 -- 172.21.15.148:0/1883368930 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568f115c830 con 0x5568f113b2d0 2024-09-19T07:23:10.327 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.322+0000 7f1f59d9b640 1 --2- 172.21.15.148:0/1883368930 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568f113b2d0 0x5568f1161ac0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f1f500b9270 tx=0x7f1f500b8c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97fcb0ef3d981b2d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:10.327 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.322+0000 7f1f43fff640 1 -- 172.21.15.148:0/1883368930 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f50049070 con 0x5568f113b2d0 2024-09-19T07:23:10.327 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.322+0000 7f1f43fff640 1 -- 172.21.15.148:0/1883368930 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f500bcfa0 con 0x5568f113b2d0 2024-09-19T07:23:10.327 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.322+0000 7f1f43fff640 1 -- 172.21.15.148:0/1883368930 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f500d8330 con 0x5568f113b2d0 2024-09-19T07:23:10.327 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.323+0000 7f1f63cb1740 1 -- 172.21.15.148:0/1883368930 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568f113b2d0 msgr2=0x5568f1161ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:10.327 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.323+0000 7f1f63cb1740 1 --2- 172.21.15.148:0/1883368930 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568f113b2d0 0x5568f1161ac0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f1f500b9270 tx=0x7f1f500b8c40 comp rx=0 tx=0).stop 2024-09-19T07:23:10.327 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.323+0000 7f1f63cb1740 1 -- 172.21.15.148:0/1883368930 shutdown_connections 2024-09-19T07:23:10.328 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.323+0000 7f1f63cb1740 1 --2- 172.21.15.148:0/1883368930 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568f114a0c0 0x5568f1162000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:10.328 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.323+0000 7f1f63cb1740 1 --2- 172.21.15.148:0/1883368930 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568f113b2d0 0x5568f1161ac0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:10.328 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.323+0000 7f1f63cb1740 1 --2- 172.21.15.148:0/1883368930 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5568f113a9b0 0x5568f113cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:10.328 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.323+0000 7f1f63cb1740 1 -- 172.21.15.148:0/1883368930 >> 172.21.15.148:0/1883368930 conn(0x5568f1137060 msgr2=0x5568f113c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:10.328 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.323+0000 7f1f63cb1740 1 -- 172.21.15.148:0/1883368930 shutdown_connections 2024-09-19T07:23:10.328 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.323+0000 7f1f63cb1740 1 -- 172.21.15.148:0/1883368930 wait complete. 2024-09-19T07:23:10.328 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.323+0000 7f1f63cb1740 1 -- start start 2024-09-19T07:23:10.328 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.323+0000 7f1f63cb1740 1 Processor -- start 2024-09-19T07:23:10.328 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.323+0000 7f1f63cb1740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568f113a9b0 0x5568f114e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:10.328 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.323+0000 7f1f63cb1740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568f113b2d0 0x5568f114e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:10.328 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.323+0000 7f1f63cb1740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5568f114a0c0 0x5568f11c3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:10.328 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.323+0000 7f1f63cb1740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c1a9cf0 con 0x5568f113b2d0 2024-09-19T07:23:10.328 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.323+0000 7f1f63cb1740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c1ab160 con 0x5568f114a0c0 2024-09-19T07:23:10.328 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.323+0000 7f1f63cb1740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c1aa3c0 con 0x5568f113a9b0 2024-09-19T07:23:10.329 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.323+0000 7f1f63cb1740 10 client.0 _ll_register_callbacks cb 0x7f1f54003970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:23:10.329 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.323+0000 7f1f59d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568f113b2d0 0x5568f114e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:10.329 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.323+0000 7f1f59d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568f113b2d0 0x5568f114e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60074/0 (socket says 172.21.15.148:60074) 2024-09-19T07:23:10.329 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.323+0000 7f1f59d9b640 1 -- 172.21.15.148:0/1710402318 learned_addr learned my addr 172.21.15.148:0/1710402318 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:23:10.329 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.324+0000 7f1f59d9b640 1 -- 172.21.15.148:0/1710402318 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568f113a9b0 msgr2=0x5568f114e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:10.329 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.324+0000 7f1f59d9b640 1 --2- 172.21.15.148:0/1710402318 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568f113a9b0 0x5568f114e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:10.329 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.324+0000 7f1f59d9b640 1 -- 172.21.15.148:0/1710402318 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5568f114a0c0 msgr2=0x5568f11c3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:10.329 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.324+0000 7f1f59d9b640 1 --2- 172.21.15.148:0/1710402318 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5568f114a0c0 0x5568f11c3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:10.329 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.324+0000 7f1f59d9b640 1 -- 172.21.15.148:0/1710402318 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568f11c3fd0 con 0x5568f113b2d0 2024-09-19T07:23:10.329 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.324+0000 7f1f59d9b640 1 --2- 172.21.15.148:0/1710402318 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568f113b2d0 0x5568f114e780 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f1f500c4fe0 tx=0x7f1f5002a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=712962d0e38b8ea server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:10.329 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.324+0000 7f1f41ffb640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:23:10.329 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.324+0000 7f1f41ffb640 1 -- 172.21.15.148:0/1710402318 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f50049030 con 0x5568f113b2d0 2024-09-19T07:23:10.329 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.324+0000 7f1f41ffb640 1 -- 172.21.15.148:0/1710402318 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8600+0+0 (secure 0 0 0) 0x7f1f500b8f10 con 0x5568f113b2d0 2024-09-19T07:23:10.329 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.324+0000 7f1f63cb1740 1 -- 172.21.15.148:0/1710402318 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f500bcfa0 con 0x5568f113b2d0 2024-09-19T07:23:10.330 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.324+0000 7f1f41ffb640 1 -- 172.21.15.148:0/1710402318 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f1f50083080 con 0x5568f113b2d0 2024-09-19T07:23:10.330 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.324+0000 7f1f63cb1740 10 client.17232 fetch_fsmap learned FSMap version 45 2024-09-19T07:23:10.330 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.324+0000 7f1f63cb1740 1 -- 172.21.15.148:0/1710402318 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x5568f11c5290 con 0x5568f113b2d0 2024-09-19T07:23:10.330 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.324+0000 7f1f41ffb640 1 -- 172.21.15.148:0/1710402318 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f500bcfa0 con 0x5568f113b2d0 2024-09-19T07:23:10.330 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.324+0000 7f1f41ffb640 1 -- 172.21.15.148:0/1710402318 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 45) ==== 8354+0+0 (secure 0 0 0) 0x7f1f500bdbd0 con 0x5568f113b2d0 2024-09-19T07:23:10.330 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.324+0000 7f1f63cb1740 10 client.17232 fetch_fsmap finished waiting for FSMap version 45 2024-09-19T07:23:10.330 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.324+0000 7f1f63cb1740 10 client.17232 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:23:10.330 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.324+0000 7f1f63cb1740 20 client.17232 populate_metadata read hostname 'smithi148' 2024-09-19T07:23:10.330 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.324+0000 7f1f63cb1740 1 --2- 172.21.15.148:0/1710402318 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5568f11c5620 0x5568f11c7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:10.330 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.324+0000 7f1f63cb1740 4 client.17232 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:23:10.330 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.324+0000 7f1f63cb1740 1 -- 172.21.15.148:0/1710402318 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5568f1023900 con 0x5568f11c5620 2024-09-19T07:23:10.330 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.325+0000 7f1f5a59c640 1 --2- 172.21.15.148:0/1710402318 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5568f11c5620 0x5568f11c7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:10.330 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.325+0000 7f1f5a59c640 1 --2- 172.21.15.148:0/1710402318 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5568f11c5620 0x5568f11c7a40 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3d024507cc27667 server_cookie=cb4110378c1e7785 in_seq=0 out_seq=0 2024-09-19T07:23:10.330 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.325+0000 7f1f41ffb640 10 client.17232 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:23:10.347 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.346+0000 7f1f41ffb640 1 -- 172.21.15.148:0/1710402318 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5568f1023900 con 0x5568f11c5620 2024-09-19T07:23:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.346+0000 7f1f41ffb640 10 client.17232 handle_command_reply: tid=0 2024-09-19T07:23:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.346+0000 7f1f63cb1740 1 client.17232 shutdown 2024-09-19T07:23:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.346+0000 7f1f63cb1740 1 -- 172.21.15.148:0/1710402318 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568f113b2d0 msgr2=0x5568f114e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.346+0000 7f1f63cb1740 1 --2- 172.21.15.148:0/1710402318 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568f113b2d0 0x5568f114e780 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f1f500c4fe0 tx=0x7f1f5002a480 comp rx=0 tx=0).stop 2024-09-19T07:23:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.347+0000 7f1f63cb1740 1 -- 172.21.15.148:0/1710402318 shutdown_connections 2024-09-19T07:23:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.347+0000 7f1f63cb1740 1 --2- 172.21.15.148:0/1710402318 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5568f11c5620 0x5568f11c7a40 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.347+0000 7f1f63cb1740 1 --2- 172.21.15.148:0/1710402318 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5568f114a0c0 0x5568f11c3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.347+0000 7f1f41ffb640 0 client.17232 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:23:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.347+0000 7f1f63cb1740 1 --2- 172.21.15.148:0/1710402318 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568f113b2d0 0x5568f114e780 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:10.349 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.347+0000 7f1f63cb1740 1 --2- 172.21.15.148:0/1710402318 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5568f113a9b0 0x5568f114e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:10.349 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.347+0000 7f1f63cb1740 1 -- 172.21.15.148:0/1710402318 >> 172.21.15.148:0/1710402318 conn(0x5568f1137060 msgr2=0x5568f113c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:10.349 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.347+0000 7f1f63cb1740 1 -- 172.21.15.148:0/1710402318 shutdown_connections 2024-09-19T07:23:10.349 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.347+0000 7f1f63cb1740 1 -- 172.21.15.148:0/1710402318 wait complete. 2024-09-19T07:23:10.349 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.347+0000 7f1f63cb1740 20 client.17232 trim_cache size 0 max 16384 2024-09-19T07:23:10.349 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:23:10.349 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:23:10.349 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:23:10.349 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:23:10.350 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.347+0000 7f1f60f18640 1 -- 172.21.15.148:0/3950662820 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f1f440a3460 msgr2=0x7f1f440a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:10.350 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.347+0000 7f1f60f18640 1 --2- 172.21.15.148:0/3950662820 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f1f440a3460 0x7f1f440a5920 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1f54005fd0 tx=0x7f1f54013a40 comp rx=0 tx=0).stop 2024-09-19T07:23:10.350 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.347+0000 7f1f60f18640 1 -- 172.21.15.148:0/3950662820 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f5c103630 msgr2=0x7f1f5c198910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:10.350 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.347+0000 7f1f60f18640 1 --2- 172.21.15.148:0/3950662820 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f5c103630 0x7f1f5c198910 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f1f50006010 tx=0x7f1f50004270 comp rx=0 tx=0).stop 2024-09-19T07:23:10.350 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.347+0000 7f1f60f18640 1 -- 172.21.15.148:0/3950662820 shutdown_connections 2024-09-19T07:23:10.350 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.347+0000 7f1f60f18640 1 --2- 172.21.15.148:0/3950662820 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f1f440a3460 0x7f1f440a5920 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:10.351 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.347+0000 7f1f60f18640 1 --2- 172.21.15.148:0/3950662820 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f5c10c0e0 0x7f1f5c19cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:10.351 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.347+0000 7f1f60f18640 1 --2- 172.21.15.148:0/3950662820 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f5c103630 0x7f1f5c198910 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:10.351 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.347+0000 7f1f60f18640 1 --2- 172.21.15.148:0/3950662820 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f5c102d10 0x7f1f5c1983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:10.351 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.347+0000 7f1f60f18640 1 -- 172.21.15.148:0/3950662820 >> 172.21.15.148:0/3950662820 conn(0x7f1f5c0fc6c0 msgr2=0x7f1f5c0fd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:10.351 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.347+0000 7f1f60f18640 1 -- 172.21.15.148:0/3950662820 shutdown_connections 2024-09-19T07:23:10.351 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:10.347+0000 7f1f60f18640 1 -- 172.21.15.148:0/3950662820 wait complete. 2024-09-19T07:23:10.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:23:10 smithi148 ceph-mon[31180]: pgmap v378: 97 pgs: 4 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 82 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 73 KiB/s wr, 33 op/s 2024-09-19T07:23:10.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:23:10 smithi165 ceph-mon[35326]: pgmap v378: 97 pgs: 4 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 82 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 73 KiB/s wr, 33 op/s 2024-09-19T07:23:11.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:23:10 smithi179 ceph-mon[35716]: pgmap v378: 97 pgs: 4 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 82 active+clean; 1.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 73 KiB/s wr, 33 op/s 2024-09-19T07:23:12.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:23:12 smithi148 ceph-mon[31180]: pgmap v379: 97 pgs: 8 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 72 active+clean; 1.7 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 82 KiB/s wr, 34 op/s 2024-09-19T07:23:12.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:23:12 smithi165 ceph-mon[35326]: pgmap v379: 97 pgs: 8 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 72 active+clean; 1.7 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 82 KiB/s wr, 34 op/s 2024-09-19T07:23:13.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:23:12 smithi179 ceph-mon[35716]: pgmap v379: 97 pgs: 8 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 72 active+clean; 1.7 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 82 KiB/s wr, 34 op/s 2024-09-19T07:23:14.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:23:14 smithi148 ceph-mon[31180]: pgmap v380: 97 pgs: 4 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 87 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 89 KiB/s wr, 35 op/s 2024-09-19T07:23:14.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:23:14 smithi165 ceph-mon[35326]: pgmap v380: 97 pgs: 4 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 87 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 89 KiB/s wr, 35 op/s 2024-09-19T07:23:15.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:23:14 smithi179 ceph-mon[35716]: pgmap v380: 97 pgs: 4 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 87 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 89 KiB/s wr, 35 op/s 2024-09-19T07:23:16.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:23:16 smithi165 ceph-mon[35326]: pgmap v381: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 51 KiB/s wr, 21 op/s 2024-09-19T07:23:17.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:23:16 smithi179 ceph-mon[35716]: pgmap v381: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 51 KiB/s wr, 21 op/s 2024-09-19T07:23:17.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:23:16 smithi148 ceph-mon[31180]: pgmap v381: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 51 KiB/s wr, 21 op/s 2024-09-19T07:23:17.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:23:17 smithi165 ceph-mon[35326]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:23:18.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:23:17 smithi179 ceph-mon[35716]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:23:18.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:23:17 smithi148 ceph-mon[31180]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:23:18.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:23:18 smithi165 ceph-mon[35326]: pgmap v382: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 47 KiB/s wr, 20 op/s 2024-09-19T07:23:18.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:23:18 smithi165 ceph-mon[35326]: osdmap e94: 12 total, 12 up, 12 in 2024-09-19T07:23:19.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:23:18 smithi179 ceph-mon[35716]: pgmap v382: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 47 KiB/s wr, 20 op/s 2024-09-19T07:23:19.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:23:18 smithi179 ceph-mon[35716]: osdmap e94: 12 total, 12 up, 12 in 2024-09-19T07:23:19.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:23:18 smithi148 ceph-mon[31180]: pgmap v382: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 47 KiB/s wr, 20 op/s 2024-09-19T07:23:19.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:23:18 smithi148 ceph-mon[31180]: osdmap e94: 12 total, 12 up, 12 in 2024-09-19T07:23:20.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:23:20 smithi165 ceph-mon[35326]: pgmap v384: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 48 KiB/s wr, 21 op/s 2024-09-19T07:23:21.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:23:20 smithi179 ceph-mon[35716]: pgmap v384: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 48 KiB/s wr, 21 op/s 2024-09-19T07:23:21.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:23:20 smithi148 ceph-mon[31180]: pgmap v384: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 48 KiB/s wr, 21 op/s 2024-09-19T07:23:22.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:23:22 smithi165 ceph-mon[35326]: pgmap v385: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 47 KiB/s wr, 19 op/s 2024-09-19T07:23:23.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:23:22 smithi179 ceph-mon[35716]: pgmap v385: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 47 KiB/s wr, 19 op/s 2024-09-19T07:23:23.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:23:22 smithi148 ceph-mon[31180]: pgmap v385: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 47 KiB/s wr, 19 op/s 2024-09-19T07:23:23.445 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.442+0000 7fb425d31640 1 -- 172.21.15.148:0/799536132 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb420102470 msgr2=0x7fb42010e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:23.445 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.442+0000 7fb425d31640 1 --2- 172.21.15.148:0/799536132 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb420102470 0x7fb42010e9a0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fb418009cd0 tx=0x7fb41802a8e0 comp rx=0 tx=0).stop 2024-09-19T07:23:23.445 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.442+0000 7fb425d31640 1 -- 172.21.15.148:0/799536132 shutdown_connections 2024-09-19T07:23:23.445 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.442+0000 7fb425d31640 1 --2- 172.21.15.148:0/799536132 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb420102470 0x7fb42010e9a0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:23.445 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.442+0000 7fb425d31640 1 --2- 172.21.15.148:0/799536132 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb420101ad0 0x7fb420101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:23.446 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.442+0000 7fb425d31640 1 --2- 172.21.15.148:0/799536132 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb420107b70 0x7fb420107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:23.446 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.442+0000 7fb425d31640 1 -- 172.21.15.148:0/799536132 >> 172.21.15.148:0/799536132 conn(0x7fb4200fd7d0 msgr2=0x7fb4200ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:23.446 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.442+0000 7fb425d31640 1 -- 172.21.15.148:0/799536132 shutdown_connections 2024-09-19T07:23:23.446 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.442+0000 7fb425d31640 1 -- 172.21.15.148:0/799536132 wait complete. 2024-09-19T07:23:23.446 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.443+0000 7fb425d31640 1 Processor -- start 2024-09-19T07:23:23.446 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.443+0000 7fb425d31640 1 -- start start 2024-09-19T07:23:23.446 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.443+0000 7fb425d31640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb420101ad0 0x7fb4200744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:23.446 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.443+0000 7fb425d31640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb420102470 0x7fb420074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:23.446 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.443+0000 7fb425d31640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb420107b70 0x7fb420074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:23.446 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.443+0000 7fb425d31640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb420111f20 con 0x7fb420102470 2024-09-19T07:23:23.446 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.443+0000 7fb425d31640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb420111da0 con 0x7fb420107b70 2024-09-19T07:23:23.446 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.443+0000 7fb425d31640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb4201120a0 con 0x7fb420101ad0 2024-09-19T07:23:23.446 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.443+0000 7fb41effd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb420102470 0x7fb420074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:23.447 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.443+0000 7fb41effd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb420102470 0x7fb420074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33590/0 (socket says 172.21.15.148:33590) 2024-09-19T07:23:23.447 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.443+0000 7fb41effd640 1 -- 172.21.15.148:0/2571154307 learned_addr learned my addr 172.21.15.148:0/2571154307 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:23:23.447 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.444+0000 7fb41f7fe640 1 --2- 172.21.15.148:0/2571154307 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb420101ad0 0x7fb4200744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:23.447 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.444+0000 7fb41ffff640 1 --2- 172.21.15.148:0/2571154307 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb420107b70 0x7fb420074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:23.447 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.444+0000 7fb41effd640 1 -- 172.21.15.148:0/2571154307 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb420101ad0 msgr2=0x7fb4200744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:23.447 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.444+0000 7fb41effd640 1 --2- 172.21.15.148:0/2571154307 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb420101ad0 0x7fb4200744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:23.447 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.444+0000 7fb41effd640 1 -- 172.21.15.148:0/2571154307 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb420107b70 msgr2=0x7fb420074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:23.447 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.444+0000 7fb41effd640 1 --2- 172.21.15.148:0/2571154307 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb420107b70 0x7fb420074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:23.447 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.444+0000 7fb41effd640 1 -- 172.21.15.148:0/2571154307 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4201a6870 con 0x7fb420102470 2024-09-19T07:23:23.447 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.444+0000 7fb41effd640 1 --2- 172.21.15.148:0/2571154307 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb420102470 0x7fb420074a30 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fb41400d950 tx=0x7fb41400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:23.447 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.444+0000 7fb41cff9640 1 -- 172.21.15.148:0/2571154307 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb414017070 con 0x7fb420102470 2024-09-19T07:23:23.447 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.444+0000 7fb425d31640 1 -- 172.21.15.148:0/2571154307 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4201a6b60 con 0x7fb420102470 2024-09-19T07:23:23.447 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.444+0000 7fb41cff9640 1 -- 172.21.15.148:0/2571154307 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb414009c30 con 0x7fb420102470 2024-09-19T07:23:23.447 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.444+0000 7fb41cff9640 1 -- 172.21.15.148:0/2571154307 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41400f6b0 con 0x7fb420102470 2024-09-19T07:23:23.448 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.444+0000 7fb425d31640 1 -- 172.21.15.148:0/2571154307 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4201a70b0 con 0x7fb420102470 2024-09-19T07:23:23.454 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.446+0000 7fb41cff9640 1 -- 172.21.15.148:0/2571154307 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fb4140109d0 con 0x7fb420102470 2024-09-19T07:23:23.454 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.447+0000 7fb428acc740 1 Processor -- start 2024-09-19T07:23:23.454 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.447+0000 7fb428acc740 1 -- start start 2024-09-19T07:23:23.454 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.447+0000 7fb428acc740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562542589af0 0x562542589ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:23.454 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.447+0000 7fb428acc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56254258a410 0x562542594770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:23.454 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.447+0000 7fb428acc740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562542594cb0 0x5625425970a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:23.454 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.447+0000 7fb428acc740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5625424ee2f0 con 0x562542594cb0 2024-09-19T07:23:23.454 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.447+0000 7fb428acc740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x562542496270 con 0x562542589af0 2024-09-19T07:23:23.454 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.447+0000 7fb428acc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5625424ea2b0 con 0x56254258a410 2024-09-19T07:23:23.455 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.447+0000 7fb41cff9640 1 --2- 172.21.15.148:0/2571154307 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fb4080a3460 0x7fb4080a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:23.455 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.447+0000 7fb41effd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562542594cb0 0x5625425970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:23.455 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.447+0000 7fb41effd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562542594cb0 0x5625425970a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33602/0 (socket says 172.21.15.148:33602) 2024-09-19T07:23:23.455 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.447+0000 7fb41effd640 1 -- 172.21.15.148:0/674202228 learned_addr learned my addr 172.21.15.148:0/674202228 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:23:23.455 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.447+0000 7fb41f7fe640 1 --2- 172.21.15.148:0/674202228 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56254258a410 0x562542594770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:23.455 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.447+0000 7fb41ffff640 1 --2- 172.21.15.148:0/2571154307 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fb4080a3460 0x7fb4080a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:23.455 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.447+0000 7fb41cff9640 1 -- 172.21.15.148:0/2571154307 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8556+0+0 (secure 0 0 0) 0x7fb4140cf8a0 con 0x7fb420102470 2024-09-19T07:23:23.455 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.447+0000 7fb41ffff640 1 --2- 172.21.15.148:0/674202228 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562542589af0 0x562542589ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:23.455 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.448+0000 7fb41effd640 1 -- 172.21.15.148:0/674202228 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56254258a410 msgr2=0x562542594770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:23.455 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.448+0000 7fb41effd640 1 --2- 172.21.15.148:0/674202228 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56254258a410 0x562542594770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:23.456 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.448+0000 7fb41effd640 1 -- 172.21.15.148:0/674202228 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562542589af0 msgr2=0x562542589ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:23.456 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.448+0000 7fb41effd640 1 --2- 172.21.15.148:0/674202228 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562542589af0 0x562542589ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:23.456 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.448+0000 7fb41effd640 1 -- 172.21.15.148:0/674202228 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562542495340 con 0x562542594cb0 2024-09-19T07:23:23.456 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.448+0000 7fb41ffff640 1 --2- 172.21.15.148:0/674202228 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562542589af0 0x562542589ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:23:23.456 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.448+0000 7fb41effd640 1 --2- 172.21.15.148:0/674202228 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562542594cb0 0x5625425970a0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fb414061160 tx=0x7fb414005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43bda8c3222fdd73 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:23.456 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.448+0000 7fb41ffff640 1 --2- 172.21.15.148:0/2571154307 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fb4080a3460 0x7fb4080a5920 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb418009430 tx=0x7fb418009360 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:23.456 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.448+0000 7fb405ffb640 1 -- 172.21.15.148:0/674202228 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb414020050 con 0x562542594cb0 2024-09-19T07:23:23.456 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.448+0000 7fb405ffb640 1 -- 172.21.15.148:0/674202228 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb414060f80 con 0x562542594cb0 2024-09-19T07:23:23.456 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.448+0000 7fb405ffb640 1 -- 172.21.15.148:0/674202228 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4140a4340 con 0x562542594cb0 2024-09-19T07:23:23.456 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.449+0000 7fb428acc740 1 -- 172.21.15.148:0/674202228 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562542594cb0 msgr2=0x5625425970a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:23.456 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.449+0000 7fb428acc740 1 --2- 172.21.15.148:0/674202228 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562542594cb0 0x5625425970a0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fb414061160 tx=0x7fb414005880 comp rx=0 tx=0).stop 2024-09-19T07:23:23.456 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.449+0000 7fb428acc740 1 -- 172.21.15.148:0/674202228 shutdown_connections 2024-09-19T07:23:23.456 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.449+0000 7fb428acc740 1 --2- 172.21.15.148:0/674202228 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562542594cb0 0x5625425970a0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:23.457 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.449+0000 7fb428acc740 1 --2- 172.21.15.148:0/674202228 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56254258a410 0x562542594770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:23.457 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.449+0000 7fb428acc740 1 --2- 172.21.15.148:0/674202228 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562542589af0 0x562542589ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:23.457 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.449+0000 7fb428acc740 1 -- 172.21.15.148:0/674202228 >> 172.21.15.148:0/674202228 conn(0x562542586060 msgr2=0x562542586440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:23.457 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.449+0000 7fb428acc740 1 -- 172.21.15.148:0/674202228 shutdown_connections 2024-09-19T07:23:23.457 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.449+0000 7fb428acc740 1 -- 172.21.15.148:0/674202228 wait complete. 2024-09-19T07:23:23.457 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.449+0000 7fb428acc740 1 -- start start 2024-09-19T07:23:23.457 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.449+0000 7fb428acc740 1 Processor -- start 2024-09-19T07:23:23.457 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.450+0000 7fb428acc740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562542589af0 0x562542591bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:23.457 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.450+0000 7fb428acc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56254258a410 0x562542592100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:23.457 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.450+0000 7fb428acc740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562542594cb0 0x562542592640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:23.457 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.450+0000 7fb428acc740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x562542597880 con 0x562542594cb0 2024-09-19T07:23:23.457 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.450+0000 7fb428acc740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x562542477290 con 0x562542589af0 2024-09-19T07:23:23.457 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.450+0000 7fb428acc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x562542597a00 con 0x56254258a410 2024-09-19T07:23:23.458 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.450+0000 7fb428acc740 10 client.0 _ll_register_callbacks cb 0x5625424a8140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:23:23.458 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.450+0000 7fb41ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562542594cb0 0x562542592640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:23.458 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.450+0000 7fb41ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562542594cb0 0x562542592640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33610/0 (socket says 172.21.15.148:33610) 2024-09-19T07:23:23.458 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.450+0000 7fb41ffff640 1 -- 172.21.15.148:0/4154355745 learned_addr learned my addr 172.21.15.148:0/4154355745 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:23:23.458 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.450+0000 7fb41effd640 1 --2- 172.21.15.148:0/4154355745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56254258a410 0x562542592100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:23.458 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.450+0000 7fb41f7fe640 1 --2- 172.21.15.148:0/4154355745 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562542589af0 0x562542591bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:23.458 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.450+0000 7fb41ffff640 1 -- 172.21.15.148:0/4154355745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56254258a410 msgr2=0x562542592100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:23.458 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.450+0000 7fb41ffff640 1 --2- 172.21.15.148:0/4154355745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56254258a410 0x562542592100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:23.458 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.450+0000 7fb41ffff640 1 -- 172.21.15.148:0/4154355745 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562542589af0 msgr2=0x562542591bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:23.458 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.450+0000 7fb41ffff640 1 --2- 172.21.15.148:0/4154355745 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562542589af0 0x562542591bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:23.458 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.450+0000 7fb41ffff640 1 -- 172.21.15.148:0/4154355745 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562542201210 con 0x562542594cb0 2024-09-19T07:23:23.458 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.450+0000 7fb41ffff640 1 --2- 172.21.15.148:0/4154355745 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562542594cb0 0x562542592640 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fb418009cd0 tx=0x7fb4180095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d104393794ad25 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:23.458 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.450+0000 7fb3feffd640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:23:23.459 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.450+0000 7fb3feffd640 1 -- 172.21.15.148:0/4154355745 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41804f070 con 0x562542594cb0 2024-09-19T07:23:23.459 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.451+0000 7fb3feffd640 1 -- 172.21.15.148:0/4154355745 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8556+0+0 (secure 0 0 0) 0x7fb4180047a0 con 0x562542594cb0 2024-09-19T07:23:23.459 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.451+0000 7fb428acc740 1 -- 172.21.15.148:0/4154355745 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb414060f80 con 0x562542594cb0 2024-09-19T07:23:23.459 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.451+0000 7fb3feffd640 1 -- 172.21.15.148:0/4154355745 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7fb418004b40 con 0x562542594cb0 2024-09-19T07:23:23.459 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.451+0000 7fb428acc740 10 client.17244 fetch_fsmap learned FSMap version 46 2024-09-19T07:23:23.459 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.451+0000 7fb428acc740 1 -- 172.21.15.148:0/4154355745 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x5625422cd620 con 0x562542594cb0 2024-09-19T07:23:23.459 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.451+0000 7fb3feffd640 1 -- 172.21.15.148:0/4154355745 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb414060f80 con 0x562542594cb0 2024-09-19T07:23:23.459 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.451+0000 7fb3feffd640 1 -- 172.21.15.148:0/4154355745 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 46) ==== 8358+0+0 (secure 0 0 0) 0x7fb418048040 con 0x562542594cb0 2024-09-19T07:23:23.459 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.451+0000 7fb428acc740 10 client.17244 fetch_fsmap finished waiting for FSMap version 46 2024-09-19T07:23:23.459 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.451+0000 7fb428acc740 10 client.17244 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:23:23.459 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.451+0000 7fb428acc740 20 client.17244 populate_metadata read hostname 'smithi148' 2024-09-19T07:23:23.459 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.451+0000 7fb428acc740 1 --2- 172.21.15.148:0/4154355745 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5625425a4ce0 0x5625425a70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:23.459 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.451+0000 7fb428acc740 4 client.17244 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:23:23.459 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.451+0000 7fb428acc740 1 -- 172.21.15.148:0/4154355745 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5625424fba20 con 0x5625425a4ce0 2024-09-19T07:23:23.460 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.451+0000 7fb41f7fe640 1 --2- 172.21.15.148:0/4154355745 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5625425a4ce0 0x5625425a70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:23.460 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.452+0000 7fb3feffd640 10 client.17244 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:23:23.460 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.452+0000 7fb41f7fe640 1 --2- 172.21.15.148:0/4154355745 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5625425a4ce0 0x5625425a70f0 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=181943b364f2c6c2 server_cookie=25e35ef34d507567 in_seq=0 out_seq=0 2024-09-19T07:23:23.460 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.452+0000 7fb3feffd640 1 -- 172.21.15.148:0/4154355745 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5625424fba20 con 0x5625425a4ce0 2024-09-19T07:23:23.460 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.452+0000 7fb3feffd640 10 client.17244 handle_command_reply: tid=0 2024-09-19T07:23:23.460 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.452+0000 7fb428acc740 1 client.17244 shutdown 2024-09-19T07:23:23.460 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.453+0000 7fb428acc740 1 -- 172.21.15.148:0/4154355745 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562542594cb0 msgr2=0x562542592640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:23.460 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.453+0000 7fb428acc740 1 --2- 172.21.15.148:0/4154355745 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562542594cb0 0x562542592640 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fb418009cd0 tx=0x7fb4180095c0 comp rx=0 tx=0).stop 2024-09-19T07:23:23.460 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.453+0000 7fb428acc740 1 -- 172.21.15.148:0/4154355745 shutdown_connections 2024-09-19T07:23:23.460 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.453+0000 7fb428acc740 1 --2- 172.21.15.148:0/4154355745 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5625425a4ce0 0x5625425a70f0 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:23.460 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.453+0000 7fb428acc740 1 --2- 172.21.15.148:0/4154355745 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562542594cb0 0x562542592640 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:23.460 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.453+0000 7fb428acc740 1 --2- 172.21.15.148:0/4154355745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56254258a410 0x562542592100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:23.460 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.453+0000 7fb428acc740 1 --2- 172.21.15.148:0/4154355745 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562542589af0 0x562542591bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:23.461 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.453+0000 7fb3feffd640 0 client.17244 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:23:23.461 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.453+0000 7fb428acc740 1 -- 172.21.15.148:0/4154355745 >> 172.21.15.148:0/4154355745 conn(0x562542586060 msgr2=0x56254258bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:23.461 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.453+0000 7fb428acc740 1 -- 172.21.15.148:0/4154355745 shutdown_connections 2024-09-19T07:23:23.461 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.453+0000 7fb428acc740 1 -- 172.21.15.148:0/4154355745 wait complete. 2024-09-19T07:23:23.461 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.453+0000 7fb428acc740 20 client.17244 trim_cache size 0 max 16384 2024-09-19T07:23:23.473 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.467+0000 7fb428acc740 1 Processor -- start 2024-09-19T07:23:23.473 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.467+0000 7fb428acc740 1 -- start start 2024-09-19T07:23:23.473 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.467+0000 7fb428acc740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562542589af0 0x562542593ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:23.473 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.467+0000 7fb428acc740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56254258a410 0x562542592470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:23.473 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.467+0000 7fb428acc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562542594cb0 0x5625425aca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:23.473 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.467+0000 7fb428acc740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb4201b2310 con 0x562542589af0 2024-09-19T07:23:23.473 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.467+0000 7fb428acc740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb4201afb80 con 0x56254258a410 2024-09-19T07:23:23.473 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.467+0000 7fb428acc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb4201ad9f0 con 0x562542594cb0 2024-09-19T07:23:23.474 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.468+0000 7fb41f7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562542589af0 0x562542593ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:23.474 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.468+0000 7fb41f7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562542589af0 0x562542593ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33618/0 (socket says 172.21.15.148:33618) 2024-09-19T07:23:23.474 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.468+0000 7fb41f7fe640 1 -- 172.21.15.148:0/2509699119 learned_addr learned my addr 172.21.15.148:0/2509699119 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:23:23.474 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.468+0000 7fb41effd640 1 --2- 172.21.15.148:0/2509699119 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56254258a410 0x562542592470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:23.474 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.468+0000 7fb41f7fe640 1 -- 172.21.15.148:0/2509699119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562542594cb0 msgr2=0x5625425aca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:23.474 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.468+0000 7fb41f7fe640 1 --2- 172.21.15.148:0/2509699119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562542594cb0 0x5625425aca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:23.474 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.468+0000 7fb41f7fe640 1 -- 172.21.15.148:0/2509699119 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56254258a410 msgr2=0x562542592470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:23.474 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.468+0000 7fb41f7fe640 1 --2- 172.21.15.148:0/2509699119 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56254258a410 0x562542592470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:23.474 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.468+0000 7fb41f7fe640 1 -- 172.21.15.148:0/2509699119 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625425a7770 con 0x562542589af0 2024-09-19T07:23:23.474 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.468+0000 7fb41effd640 1 --2- 172.21.15.148:0/2509699119 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56254258a410 0x562542592470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:23:23.474 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.468+0000 7fb41f7fe640 1 --2- 172.21.15.148:0/2509699119 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562542589af0 0x562542593ef0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fb410009dd0 tx=0x7fb410005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2e2fdca3d7e6ea9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:23.474 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.468+0000 7fb4057fa640 1 -- 172.21.15.148:0/2509699119 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb410003e20 con 0x562542589af0 2024-09-19T07:23:23.475 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.468+0000 7fb4057fa640 1 -- 172.21.15.148:0/2509699119 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb410010910 con 0x562542589af0 2024-09-19T07:23:23.475 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.468+0000 7fb4057fa640 1 -- 172.21.15.148:0/2509699119 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41001eb50 con 0x562542589af0 2024-09-19T07:23:23.475 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.469+0000 7fb428acc740 1 -- 172.21.15.148:0/2509699119 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562542589af0 msgr2=0x562542593ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:23.475 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.469+0000 7fb428acc740 1 --2- 172.21.15.148:0/2509699119 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562542589af0 0x562542593ef0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fb410009dd0 tx=0x7fb410005f90 comp rx=0 tx=0).stop 2024-09-19T07:23:23.475 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.469+0000 7fb428acc740 1 -- 172.21.15.148:0/2509699119 shutdown_connections 2024-09-19T07:23:23.475 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.469+0000 7fb428acc740 1 --2- 172.21.15.148:0/2509699119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562542594cb0 0x5625425aca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:23.475 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.469+0000 7fb428acc740 1 --2- 172.21.15.148:0/2509699119 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56254258a410 0x562542592470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:23.475 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.469+0000 7fb428acc740 1 --2- 172.21.15.148:0/2509699119 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562542589af0 0x562542593ef0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:23.475 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.469+0000 7fb428acc740 1 -- 172.21.15.148:0/2509699119 >> 172.21.15.148:0/2509699119 conn(0x562542586060 msgr2=0x5625425851c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:23.475 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.469+0000 7fb428acc740 1 -- 172.21.15.148:0/2509699119 shutdown_connections 2024-09-19T07:23:23.475 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.469+0000 7fb428acc740 1 -- 172.21.15.148:0/2509699119 wait complete. 2024-09-19T07:23:23.475 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.469+0000 7fb428acc740 1 -- start start 2024-09-19T07:23:23.475 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.469+0000 7fb428acc740 1 Processor -- start 2024-09-19T07:23:23.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.470+0000 7fb428acc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562542589af0 0x56254259cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:23.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.470+0000 7fb428acc740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56254258a410 0x56254259d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:23.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.470+0000 7fb428acc740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562542594cb0 0x562542599c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:23.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.470+0000 7fb428acc740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb4201ae040 con 0x562542594cb0 2024-09-19T07:23:23.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.470+0000 7fb428acc740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb4201af4b0 con 0x56254258a410 2024-09-19T07:23:23.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.470+0000 7fb428acc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb4201ae710 con 0x562542589af0 2024-09-19T07:23:23.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.470+0000 7fb428acc740 10 client.0 _ll_register_callbacks cb 0x7fb418009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:23:23.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.470+0000 7fb41ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562542594cb0 0x562542599c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:23.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.470+0000 7fb41ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562542594cb0 0x562542599c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33628/0 (socket says 172.21.15.148:33628) 2024-09-19T07:23:23.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.470+0000 7fb41ffff640 1 -- 172.21.15.148:0/4060793017 learned_addr learned my addr 172.21.15.148:0/4060793017 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:23:23.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.470+0000 7fb41f7fe640 1 --2- 172.21.15.148:0/4060793017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562542589af0 0x56254259cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:23.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.470+0000 7fb41effd640 1 --2- 172.21.15.148:0/4060793017 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56254258a410 0x56254259d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:23.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.470+0000 7fb41ffff640 1 -- 172.21.15.148:0/4060793017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562542589af0 msgr2=0x56254259cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:23.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.470+0000 7fb41ffff640 1 --2- 172.21.15.148:0/4060793017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562542589af0 0x56254259cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:23.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.470+0000 7fb41ffff640 1 -- 172.21.15.148:0/4060793017 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56254258a410 msgr2=0x56254259d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:23.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.470+0000 7fb41ffff640 1 --2- 172.21.15.148:0/4060793017 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56254258a410 0x56254259d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:23.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.470+0000 7fb41ffff640 1 -- 172.21.15.148:0/4060793017 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562542589920 con 0x562542594cb0 2024-09-19T07:23:23.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.470+0000 7fb41f7fe640 1 --2- 172.21.15.148:0/4060793017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562542589af0 0x56254259cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:23:23.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.470+0000 7fb41effd640 1 --2- 172.21.15.148:0/4060793017 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56254258a410 0x56254259d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:23:23.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.470+0000 7fb41ffff640 1 --2- 172.21.15.148:0/4060793017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562542594cb0 0x562542599c60 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fb418005070 tx=0x7fb418005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14938148edcc10dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:23.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.470+0000 7fb3feffd640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:23:23.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.470+0000 7fb3feffd640 1 -- 172.21.15.148:0/4060793017 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41804f070 con 0x562542594cb0 2024-09-19T07:23:23.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.470+0000 7fb3feffd640 1 -- 172.21.15.148:0/4060793017 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8556+0+0 (secure 0 0 0) 0x7fb4180056e0 con 0x562542594cb0 2024-09-19T07:23:23.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.470+0000 7fb428acc740 1 -- 172.21.15.148:0/4060793017 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb410010910 con 0x562542594cb0 2024-09-19T07:23:23.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.471+0000 7fb3feffd640 1 -- 172.21.15.148:0/4060793017 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7fb418066050 con 0x562542594cb0 2024-09-19T07:23:23.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.471+0000 7fb428acc740 10 client.17250 fetch_fsmap learned FSMap version 46 2024-09-19T07:23:23.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.471+0000 7fb428acc740 1 -- 172.21.15.148:0/4060793017 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x56254260fce0 con 0x562542594cb0 2024-09-19T07:23:23.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.471+0000 7fb3feffd640 1 -- 172.21.15.148:0/4060793017 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb410010910 con 0x562542594cb0 2024-09-19T07:23:23.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.471+0000 7fb3feffd640 1 -- 172.21.15.148:0/4060793017 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 46) ==== 8358+0+0 (secure 0 0 0) 0x7fb418048040 con 0x562542594cb0 2024-09-19T07:23:23.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.471+0000 7fb428acc740 10 client.17250 fetch_fsmap finished waiting for FSMap version 46 2024-09-19T07:23:23.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.471+0000 7fb428acc740 10 client.17250 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:23:23.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.471+0000 7fb428acc740 20 client.17250 populate_metadata read hostname 'smithi148' 2024-09-19T07:23:23.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.471+0000 7fb428acc740 1 --2- 172.21.15.148:0/4060793017 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x562542610430 0x562542612850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:23.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.471+0000 7fb428acc740 4 client.17250 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:23:23.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.471+0000 7fb428acc740 1 -- 172.21.15.148:0/4060793017 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5625424f5d70 con 0x562542610430 2024-09-19T07:23:23.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.471+0000 7fb41f7fe640 1 --2- 172.21.15.148:0/4060793017 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x562542610430 0x562542612850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:23.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.472+0000 7fb3feffd640 10 client.17250 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:23:23.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.472+0000 7fb41f7fe640 1 --2- 172.21.15.148:0/4060793017 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x562542610430 0x562542612850 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be45866f93e6fcbd server_cookie=5e945243bcf9fb45 in_seq=0 out_seq=0 2024-09-19T07:23:23.486 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.485+0000 7fb3feffd640 1 -- 172.21.15.148:0/4060793017 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5625424f5d70 con 0x562542610430 2024-09-19T07:23:23.486 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.485+0000 7fb3feffd640 10 client.17250 handle_command_reply: tid=0 2024-09-19T07:23:23.486 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.485+0000 7fb428acc740 1 client.17250 shutdown 2024-09-19T07:23:23.486 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.485+0000 7fb428acc740 1 -- 172.21.15.148:0/4060793017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562542594cb0 msgr2=0x562542599c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:23.486 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.485+0000 7fb428acc740 1 --2- 172.21.15.148:0/4060793017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562542594cb0 0x562542599c60 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fb418005070 tx=0x7fb418005ef0 comp rx=0 tx=0).stop 2024-09-19T07:23:23.487 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.485+0000 7fb428acc740 1 -- 172.21.15.148:0/4060793017 shutdown_connections 2024-09-19T07:23:23.487 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.485+0000 7fb428acc740 1 --2- 172.21.15.148:0/4060793017 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x562542610430 0x562542612850 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:23.487 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.485+0000 7fb428acc740 1 --2- 172.21.15.148:0/4060793017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562542594cb0 0x562542599c60 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:23.487 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.485+0000 7fb428acc740 1 --2- 172.21.15.148:0/4060793017 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56254258a410 0x56254259d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:23.487 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.485+0000 7fb428acc740 1 --2- 172.21.15.148:0/4060793017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562542589af0 0x56254259cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:23.487 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.485+0000 7fb428acc740 1 -- 172.21.15.148:0/4060793017 >> 172.21.15.148:0/4060793017 conn(0x562542586060 msgr2=0x5625425849a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:23.487 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.485+0000 7fb3feffd640 0 client.17250 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:23:23.487 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.485+0000 7fb428acc740 1 -- 172.21.15.148:0/4060793017 shutdown_connections 2024-09-19T07:23:23.487 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.485+0000 7fb428acc740 1 -- 172.21.15.148:0/4060793017 wait complete. 2024-09-19T07:23:23.487 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.485+0000 7fb428acc740 20 client.17250 trim_cache size 0 max 16384 2024-09-19T07:23:23.488 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:23:23.488 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:23:23.488 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:23:23.488 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:23:23.489 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.486+0000 7fb425d31640 1 -- 172.21.15.148:0/2571154307 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fb4080a3460 msgr2=0x7fb4080a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:23.489 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.486+0000 7fb425d31640 1 --2- 172.21.15.148:0/2571154307 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fb4080a3460 0x7fb4080a5920 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb418009430 tx=0x7fb418009360 comp rx=0 tx=0).stop 2024-09-19T07:23:23.489 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.486+0000 7fb425d31640 1 -- 172.21.15.148:0/2571154307 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb420102470 msgr2=0x7fb420074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:23.489 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.486+0000 7fb425d31640 1 --2- 172.21.15.148:0/2571154307 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb420102470 0x7fb420074a30 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fb41400d950 tx=0x7fb41400de10 comp rx=0 tx=0).stop 2024-09-19T07:23:23.489 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.486+0000 7fb425d31640 1 -- 172.21.15.148:0/2571154307 shutdown_connections 2024-09-19T07:23:23.489 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.486+0000 7fb425d31640 1 --2- 172.21.15.148:0/2571154307 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fb4080a3460 0x7fb4080a5920 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:23.489 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.486+0000 7fb425d31640 1 --2- 172.21.15.148:0/2571154307 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb420107b70 0x7fb420074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:23.489 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.486+0000 7fb425d31640 1 --2- 172.21.15.148:0/2571154307 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb420102470 0x7fb420074a30 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:23.489 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.486+0000 7fb425d31640 1 --2- 172.21.15.148:0/2571154307 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb420101ad0 0x7fb4200744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:23.489 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.486+0000 7fb425d31640 1 -- 172.21.15.148:0/2571154307 >> 172.21.15.148:0/2571154307 conn(0x7fb4200fd7d0 msgr2=0x7fb4200fed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:23.489 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.486+0000 7fb425d31640 1 -- 172.21.15.148:0/2571154307 shutdown_connections 2024-09-19T07:23:23.489 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:23.486+0000 7fb425d31640 1 -- 172.21.15.148:0/2571154307 wait complete. 2024-09-19T07:23:24.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:23:24 smithi165 ceph-mon[35326]: pgmap v386: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 40 KiB/s wr, 18 op/s 2024-09-19T07:23:25.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:23:24 smithi179 ceph-mon[35716]: pgmap v386: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 40 KiB/s wr, 18 op/s 2024-09-19T07:23:25.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:23:24 smithi148 ceph-mon[31180]: pgmap v386: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 40 KiB/s wr, 18 op/s 2024-09-19T07:23:26.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:23:26 smithi165 ceph-mon[35326]: pgmap v387: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 32 KiB/s wr, 14 op/s 2024-09-19T07:23:27.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:23:26 smithi179 ceph-mon[35716]: pgmap v387: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 32 KiB/s wr, 14 op/s 2024-09-19T07:23:27.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:23:26 smithi148 ceph-mon[31180]: pgmap v387: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 32 KiB/s wr, 14 op/s 2024-09-19T07:23:27.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:23:27 smithi165 ceph-mon[35326]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:23:28.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:23:27 smithi179 ceph-mon[35716]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:23:28.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:23:27 smithi148 ceph-mon[31180]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:23:29.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:23:28 smithi179 ceph-mon[35716]: pgmap v388: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 32 KiB/s wr, 14 op/s 2024-09-19T07:23:29.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:23:28 smithi148 ceph-mon[31180]: pgmap v388: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 32 KiB/s wr, 14 op/s 2024-09-19T07:23:29.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:23:28 smithi165 ceph-mon[35326]: pgmap v388: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 32 KiB/s wr, 14 op/s 2024-09-19T07:23:31.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:23:30 smithi179 ceph-mon[35716]: pgmap v389: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-09-19T07:23:31.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:23:30 smithi148 ceph-mon[31180]: pgmap v389: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-09-19T07:23:31.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:23:30 smithi165 ceph-mon[35326]: pgmap v389: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-09-19T07:23:33.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:23:32 smithi179 ceph-mon[35716]: pgmap v390: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-19T07:23:33.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:23:32 smithi148 ceph-mon[31180]: pgmap v390: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-19T07:23:33.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:23:32 smithi165 ceph-mon[35326]: pgmap v390: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-19T07:23:35.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:23:34 smithi179 ceph-mon[35716]: pgmap v391: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 KiB/s wr, 11 op/s 2024-09-19T07:23:35.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:23:34 smithi148 ceph-mon[31180]: pgmap v391: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 KiB/s wr, 11 op/s 2024-09-19T07:23:35.136 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:23:34 smithi165 ceph-mon[35326]: pgmap v391: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 KiB/s wr, 11 op/s 2024-09-19T07:23:36.579 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.576+0000 7f4993cba640 1 -- 172.21.15.148:0/2042034530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f498c103600 msgr2=0x7f498c10bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:36.579 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.576+0000 7f4993cba640 1 --2- 172.21.15.148:0/2042034530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f498c103600 0x7f498c10bae0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f497c009900 tx=0x7f497c02a480 comp rx=0 tx=0).stop 2024-09-19T07:23:36.579 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.576+0000 7f4993cba640 1 -- 172.21.15.148:0/2042034530 shutdown_connections 2024-09-19T07:23:36.579 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.576+0000 7f4993cba640 1 --2- 172.21.15.148:0/2042034530 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f498c10c0b0 0x7f498c10e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.579 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.576+0000 7f4993cba640 1 --2- 172.21.15.148:0/2042034530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f498c103600 0x7f498c10bae0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.579 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.576+0000 7f4993cba640 1 --2- 172.21.15.148:0/2042034530 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f498c102ce0 0x7f498c1030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.579 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.576+0000 7f4993cba640 1 -- 172.21.15.148:0/2042034530 >> 172.21.15.148:0/2042034530 conn(0x7f498c077990 msgr2=0x7f498c0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:36.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.576+0000 7f4993cba640 1 -- 172.21.15.148:0/2042034530 shutdown_connections 2024-09-19T07:23:36.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.576+0000 7f4993cba640 1 -- 172.21.15.148:0/2042034530 wait complete. 2024-09-19T07:23:36.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.577+0000 7f4993cba640 1 Processor -- start 2024-09-19T07:23:36.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.577+0000 7f4993cba640 1 -- start start 2024-09-19T07:23:36.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.577+0000 7f4993cba640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f498c102ce0 0x7f498c198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:36.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.577+0000 7f4993cba640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f498c103600 0x7f498c198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:36.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.577+0000 7f4993cba640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f498c10c0b0 0x7f498c19cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:36.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.577+0000 7f4993cba640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f498c111eb0 con 0x7f498c10c0b0 2024-09-19T07:23:36.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.577+0000 7f4993cba640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f498c111d30 con 0x7f498c102ce0 2024-09-19T07:23:36.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.577+0000 7f4993cba640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f498c112030 con 0x7f498c103600 2024-09-19T07:23:36.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.577+0000 7f4992257640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f498c10c0b0 0x7f498c19cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:36.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.577+0000 7f4992257640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f498c10c0b0 0x7f498c19cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48202/0 (socket says 172.21.15.148:48202) 2024-09-19T07:23:36.581 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.577+0000 7f4991255640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f498c103600 0x7f498c198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:36.581 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.577+0000 7f4991a56640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f498c102ce0 0x7f498c198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:36.581 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.577+0000 7f4992257640 1 -- 172.21.15.148:0/1518737548 learned_addr learned my addr 172.21.15.148:0/1518737548 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:23:36.581 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.578+0000 7f4992257640 1 -- 172.21.15.148:0/1518737548 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f498c103600 msgr2=0x7f498c198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:36.581 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.578+0000 7f4992257640 1 --2- 172.21.15.148:0/1518737548 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f498c103600 0x7f498c198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.581 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.578+0000 7f4992257640 1 -- 172.21.15.148:0/1518737548 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f498c102ce0 msgr2=0x7f498c198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:36.581 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.578+0000 7f4992257640 1 --2- 172.21.15.148:0/1518737548 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f498c102ce0 0x7f498c198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.581 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.578+0000 7f4992257640 1 -- 172.21.15.148:0/1518737548 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f498c19d330 con 0x7f498c10c0b0 2024-09-19T07:23:36.581 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.578+0000 7f4992257640 1 --2- 172.21.15.148:0/1518737548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f498c10c0b0 0x7f498c19cc00 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f498400eb10 tx=0x7f498400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:36.581 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.578+0000 7f4982ffd640 1 -- 172.21.15.148:0/1518737548 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4984004b20 con 0x7f498c10c0b0 2024-09-19T07:23:36.581 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.578+0000 7f4982ffd640 1 -- 172.21.15.148:0/1518737548 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4984004cc0 con 0x7f498c10c0b0 2024-09-19T07:23:36.581 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.578+0000 7f4993cba640 1 -- 172.21.15.148:0/1518737548 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f498c19d620 con 0x7f498c10c0b0 2024-09-19T07:23:36.581 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.578+0000 7f4982ffd640 1 -- 172.21.15.148:0/1518737548 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4984010760 con 0x7f498c10c0b0 2024-09-19T07:23:36.582 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.578+0000 7f4993cba640 1 -- 172.21.15.148:0/1518737548 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f498c1a4eb0 con 0x7f498c10c0b0 2024-09-19T07:23:36.589 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.580+0000 7f4982ffd640 1 -- 172.21.15.148:0/1518737548 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f4984005020 con 0x7f498c10c0b0 2024-09-19T07:23:36.589 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.581+0000 7f4982ffd640 1 --2- 172.21.15.148:0/1518737548 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f49780a3460 0x7f49780a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:36.589 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.581+0000 7f4991a56640 1 --2- 172.21.15.148:0/1518737548 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f49780a3460 0x7f49780a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:36.589 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.581+0000 7f4982ffd640 1 -- 172.21.15.148:0/1518737548 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8556+0+0 (secure 0 0 0) 0x7f49840d03d0 con 0x7f498c10c0b0 2024-09-19T07:23:36.589 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.581+0000 7f4991a56640 1 --2- 172.21.15.148:0/1518737548 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f49780a3460 0x7f49780a5920 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4988009bd0 tx=0x7f4988005f90 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:36.589 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.582+0000 7f4996a5b740 1 Processor -- start 2024-09-19T07:23:36.590 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.582+0000 7f4996a5b740 1 -- start start 2024-09-19T07:23:36.590 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.582+0000 7f4996a5b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fe60aaaaf0 0x55fe60aaaed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:36.590 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.582+0000 7f4996a5b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fe60aab410 0x55fe60ab5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:36.590 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.582+0000 7f4996a5b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fe60ab5cb0 0x55fe60ab80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:36.590 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.582+0000 7f4996a5b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55fe60a0f2f0 con 0x55fe60ab5cb0 2024-09-19T07:23:36.590 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.582+0000 7f4996a5b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55fe609b7270 con 0x55fe60aab410 2024-09-19T07:23:36.590 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.582+0000 7f4996a5b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55fe60a0b2b0 con 0x55fe60aaaaf0 2024-09-19T07:23:36.590 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.582+0000 7f4991255640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fe60aab410 0x55fe60ab5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:36.590 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.582+0000 7f4992257640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fe60ab5cb0 0x55fe60ab80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:36.590 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.582+0000 7f4991255640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fe60aab410 0x55fe60ab5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:60360/0 (socket says 172.21.15.148:60360) 2024-09-19T07:23:36.590 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.582+0000 7f4991255640 1 -- 172.21.15.148:0/256753932 learned_addr learned my addr 172.21.15.148:0/256753932 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:23:36.590 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.582+0000 7f4991a56640 1 --2- 172.21.15.148:0/256753932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fe60aaaaf0 0x55fe60aaaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:36.590 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.583+0000 7f4991255640 1 -- 172.21.15.148:0/256753932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fe60aaaaf0 msgr2=0x55fe60aaaed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:36.591 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.583+0000 7f4991255640 1 --2- 172.21.15.148:0/256753932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fe60aaaaf0 0x55fe60aaaed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.591 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.583+0000 7f4991255640 1 -- 172.21.15.148:0/256753932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fe60ab5cb0 msgr2=0x55fe60ab80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:36.591 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.583+0000 7f4991255640 1 --2- 172.21.15.148:0/256753932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fe60ab5cb0 0x55fe60ab80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.591 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.583+0000 7f4991255640 1 -- 172.21.15.148:0/256753932 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe609b6340 con 0x55fe60aab410 2024-09-19T07:23:36.591 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.583+0000 7f4991255640 1 --2- 172.21.15.148:0/256753932 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fe60aab410 0x55fe60ab5770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f497c009900 tx=0x7f497c005be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7677367f3f963f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:36.591 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.583+0000 7f4977fff640 1 -- 172.21.15.148:0/256753932 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f497c040070 con 0x55fe60aab410 2024-09-19T07:23:36.591 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.583+0000 7f4977fff640 1 -- 172.21.15.148:0/256753932 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f497c031de0 con 0x55fe60aab410 2024-09-19T07:23:36.591 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.583+0000 7f4977fff640 1 -- 172.21.15.148:0/256753932 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f497c035040 con 0x55fe60aab410 2024-09-19T07:23:36.591 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.584+0000 7f4996a5b740 1 -- 172.21.15.148:0/256753932 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fe60aab410 msgr2=0x55fe60ab5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:36.591 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.584+0000 7f4996a5b740 1 --2- 172.21.15.148:0/256753932 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fe60aab410 0x55fe60ab5770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f497c009900 tx=0x7f497c005be0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.591 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.584+0000 7f4996a5b740 1 -- 172.21.15.148:0/256753932 shutdown_connections 2024-09-19T07:23:36.591 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.584+0000 7f4996a5b740 1 --2- 172.21.15.148:0/256753932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fe60ab5cb0 0x55fe60ab80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.591 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.584+0000 7f4996a5b740 1 --2- 172.21.15.148:0/256753932 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fe60aab410 0x55fe60ab5770 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.584+0000 7f4996a5b740 1 --2- 172.21.15.148:0/256753932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fe60aaaaf0 0x55fe60aaaed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.584+0000 7f4996a5b740 1 -- 172.21.15.148:0/256753932 >> 172.21.15.148:0/256753932 conn(0x55fe60aa7060 msgr2=0x55fe60aa7440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:36.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.584+0000 7f4996a5b740 1 -- 172.21.15.148:0/256753932 shutdown_connections 2024-09-19T07:23:36.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.584+0000 7f4996a5b740 1 -- 172.21.15.148:0/256753932 wait complete. 2024-09-19T07:23:36.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.584+0000 7f4996a5b740 1 -- start start 2024-09-19T07:23:36.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.585+0000 7f4996a5b740 1 Processor -- start 2024-09-19T07:23:36.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.585+0000 7f4996a5b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fe60aaaaf0 0x55fe60ab2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:36.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.585+0000 7f4996a5b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fe60aab410 0x55fe60ab30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:36.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.585+0000 7f4996a5b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fe60ab5cb0 0x55fe60ab3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:36.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.585+0000 7f4996a5b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55fe60ab8880 con 0x55fe60aab410 2024-09-19T07:23:36.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.585+0000 7f4996a5b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55fe60998290 con 0x55fe60ab5cb0 2024-09-19T07:23:36.592 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.585+0000 7f4996a5b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55fe60ab8a00 con 0x55fe60aaaaf0 2024-09-19T07:23:36.593 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.585+0000 7f4996a5b740 10 client.0 _ll_register_callbacks cb 0x55fe609c9140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:23:36.593 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.585+0000 7f4991255640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fe60aab410 0x55fe60ab30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:36.593 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.585+0000 7f4991a56640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fe60aaaaf0 0x55fe60ab2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:36.593 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.585+0000 7f4991a56640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fe60aaaaf0 0x55fe60ab2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:42628/0 (socket says 172.21.15.148:42628) 2024-09-19T07:23:36.593 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.585+0000 7f4991a56640 1 -- 172.21.15.148:0/1531700771 learned_addr learned my addr 172.21.15.148:0/1531700771 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:23:36.593 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.585+0000 7f4992257640 1 --2- 172.21.15.148:0/1531700771 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fe60ab5cb0 0x55fe60ab3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:36.593 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.586+0000 7f4991255640 1 -- 172.21.15.148:0/1531700771 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fe60aaaaf0 msgr2=0x55fe60ab2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:36.593 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.586+0000 7f4991255640 1 --2- 172.21.15.148:0/1531700771 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fe60aaaaf0 0x55fe60ab2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.593 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.586+0000 7f4991255640 1 -- 172.21.15.148:0/1531700771 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fe60ab5cb0 msgr2=0x55fe60ab3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:36.593 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.586+0000 7f4991255640 1 --2- 172.21.15.148:0/1531700771 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fe60ab5cb0 0x55fe60ab3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.593 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.586+0000 7f4991255640 1 -- 172.21.15.148:0/1531700771 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe60722210 con 0x55fe60aab410 2024-09-19T07:23:36.593 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.586+0000 7f4991255640 1 --2- 172.21.15.148:0/1531700771 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fe60aab410 0x55fe60ab30e0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f497c005940 tx=0x7f497c0314c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5da4d8466c53bcf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:36.593 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.586+0000 7f49757fa640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:23:36.594 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.586+0000 7f49757fa640 1 -- 172.21.15.148:0/1531700771 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f497c04d060 con 0x55fe60aab410 2024-09-19T07:23:36.594 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.586+0000 7f49757fa640 1 -- 172.21.15.148:0/1531700771 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8556+0+0 (secure 0 0 0) 0x7f497c005100 con 0x55fe60aab410 2024-09-19T07:23:36.594 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.586+0000 7f4996a5b740 1 -- 172.21.15.148:0/1531700771 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f497c031de0 con 0x55fe60aab410 2024-09-19T07:23:36.594 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.586+0000 7f49757fa640 1 -- 172.21.15.148:0/1531700771 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f497c040070 con 0x55fe60aab410 2024-09-19T07:23:36.594 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.586+0000 7f4996a5b740 10 client.17262 fetch_fsmap learned FSMap version 47 2024-09-19T07:23:36.594 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.586+0000 7f4996a5b740 1 -- 172.21.15.148:0/1531700771 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55fe607ee620 con 0x55fe60aab410 2024-09-19T07:23:36.594 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.586+0000 7f49757fa640 1 -- 172.21.15.148:0/1531700771 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f497c031de0 con 0x55fe60aab410 2024-09-19T07:23:36.594 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.587+0000 7f49757fa640 1 -- 172.21.15.148:0/1531700771 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 47) ==== 8354+0+0 (secure 0 0 0) 0x7f497c051480 con 0x55fe60aab410 2024-09-19T07:23:36.594 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.587+0000 7f4996a5b740 10 client.17262 fetch_fsmap finished waiting for FSMap version 47 2024-09-19T07:23:36.594 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.587+0000 7f4996a5b740 10 client.17262 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:23:36.594 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.587+0000 7f4996a5b740 20 client.17262 populate_metadata read hostname 'smithi148' 2024-09-19T07:23:36.594 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.587+0000 7f4996a5b740 1 --2- 172.21.15.148:0/1531700771 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55fe60ac5a90 0x55fe60ac7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:36.595 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.587+0000 7f4996a5b740 4 client.17262 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:23:36.595 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.587+0000 7f4996a5b740 1 -- 172.21.15.148:0/1531700771 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fe60a1ca20 con 0x55fe60ac5a90 2024-09-19T07:23:36.595 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.587+0000 7f4991a56640 1 --2- 172.21.15.148:0/1531700771 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55fe60ac5a90 0x55fe60ac7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:36.595 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.587+0000 7f4991a56640 1 --2- 172.21.15.148:0/1531700771 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55fe60ac5a90 0x55fe60ac7e80 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82e8fa5e8f790ca4 server_cookie=6a81bacd2c189bc0 in_seq=0 out_seq=0 2024-09-19T07:23:36.595 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.587+0000 7f49757fa640 10 client.17262 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:23:36.595 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.588+0000 7f49757fa640 1 -- 172.21.15.148:0/1531700771 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fe60a1ca20 con 0x55fe60ac5a90 2024-09-19T07:23:36.595 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.588+0000 7f49757fa640 10 client.17262 handle_command_reply: tid=0 2024-09-19T07:23:36.595 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.588+0000 7f4996a5b740 1 client.17262 shutdown 2024-09-19T07:23:36.595 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.588+0000 7f4996a5b740 1 -- 172.21.15.148:0/1531700771 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fe60aab410 msgr2=0x55fe60ab30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:36.595 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.588+0000 7f4996a5b740 1 --2- 172.21.15.148:0/1531700771 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fe60aab410 0x55fe60ab30e0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f497c005940 tx=0x7f497c0314c0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.595 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.588+0000 7f4996a5b740 1 -- 172.21.15.148:0/1531700771 shutdown_connections 2024-09-19T07:23:36.595 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.588+0000 7f4996a5b740 1 --2- 172.21.15.148:0/1531700771 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55fe60ac5a90 0x55fe60ac7e80 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.595 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.588+0000 7f4996a5b740 1 --2- 172.21.15.148:0/1531700771 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fe60ab5cb0 0x55fe60ab3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.595 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.588+0000 7f4996a5b740 1 --2- 172.21.15.148:0/1531700771 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fe60aab410 0x55fe60ab30e0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.596 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.588+0000 7f4996a5b740 1 --2- 172.21.15.148:0/1531700771 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fe60aaaaf0 0x55fe60ab2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.596 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.588+0000 7f4996a5b740 1 -- 172.21.15.148:0/1531700771 >> 172.21.15.148:0/1531700771 conn(0x55fe60aa7060 msgr2=0x55fe60aa61c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:36.596 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.588+0000 7f49757fa640 0 client.17262 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:23:36.596 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.588+0000 7f4996a5b740 1 -- 172.21.15.148:0/1531700771 shutdown_connections 2024-09-19T07:23:36.596 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.588+0000 7f4996a5b740 1 -- 172.21.15.148:0/1531700771 wait complete. 2024-09-19T07:23:36.596 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.588+0000 7f4996a5b740 20 client.17262 trim_cache size 0 max 16384 2024-09-19T07:23:36.608 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.602+0000 7f4996a5b740 1 Processor -- start 2024-09-19T07:23:36.608 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.602+0000 7f4996a5b740 1 -- start start 2024-09-19T07:23:36.608 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.603+0000 7f4996a5b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fe60aaaaf0 0x55fe60ab3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:36.608 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.603+0000 7f4996a5b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fe60aab410 0x55fe60acaac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:36.608 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.603+0000 7f4996a5b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fe60ab5cb0 0x55fe60acb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:36.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.603+0000 7f4996a5b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f498c1b0160 con 0x55fe60aab410 2024-09-19T07:23:36.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.603+0000 7f4996a5b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f498c1ad9d0 con 0x55fe60aaaaf0 2024-09-19T07:23:36.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.603+0000 7f4996a5b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f498c1ab840 con 0x55fe60ab5cb0 2024-09-19T07:23:36.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.603+0000 7f4991255640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fe60aab410 0x55fe60acaac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:36.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.603+0000 7f4991255640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fe60aab410 0x55fe60acaac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48232/0 (socket says 172.21.15.148:48232) 2024-09-19T07:23:36.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.603+0000 7f4991255640 1 -- 172.21.15.148:0/143076455 learned_addr learned my addr 172.21.15.148:0/143076455 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:23:36.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.603+0000 7f4991a56640 1 --2- 172.21.15.148:0/143076455 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fe60aaaaf0 0x55fe60ab3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:36.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.603+0000 7f4992257640 1 --2- 172.21.15.148:0/143076455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fe60ab5cb0 0x55fe60acb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:36.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.603+0000 7f4991255640 1 -- 172.21.15.148:0/143076455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fe60ab5cb0 msgr2=0x55fe60acb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:36.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.603+0000 7f4991255640 1 --2- 172.21.15.148:0/143076455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fe60ab5cb0 0x55fe60acb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.603+0000 7f4991255640 1 -- 172.21.15.148:0/143076455 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fe60aaaaf0 msgr2=0x55fe60ab3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:36.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.603+0000 7f4991255640 1 --2- 172.21.15.148:0/143076455 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fe60aaaaf0 0x55fe60ab3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.603+0000 7f4991255640 1 -- 172.21.15.148:0/143076455 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe60aaa870 con 0x55fe60aab410 2024-09-19T07:23:36.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.603+0000 7f4991255640 1 --2- 172.21.15.148:0/143076455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fe60aab410 0x55fe60acaac0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f497c009900 tx=0x7f497c02a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48f275b32851f02a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:36.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.603+0000 7f49777fe640 1 -- 172.21.15.148:0/143076455 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f497c04d070 con 0x55fe60aab410 2024-09-19T07:23:36.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.603+0000 7f49777fe640 1 -- 172.21.15.148:0/143076455 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f497c052e50 con 0x55fe60aab410 2024-09-19T07:23:36.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.603+0000 7f49777fe640 1 -- 172.21.15.148:0/143076455 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f497c035040 con 0x55fe60aab410 2024-09-19T07:23:36.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.604+0000 7f4996a5b740 1 -- 172.21.15.148:0/143076455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fe60aab410 msgr2=0x55fe60acaac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:36.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.604+0000 7f4996a5b740 1 --2- 172.21.15.148:0/143076455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fe60aab410 0x55fe60acaac0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f497c009900 tx=0x7f497c02a480 comp rx=0 tx=0).stop 2024-09-19T07:23:36.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.604+0000 7f4996a5b740 1 -- 172.21.15.148:0/143076455 shutdown_connections 2024-09-19T07:23:36.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.604+0000 7f4996a5b740 1 --2- 172.21.15.148:0/143076455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fe60ab5cb0 0x55fe60acb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.604+0000 7f4996a5b740 1 --2- 172.21.15.148:0/143076455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fe60aab410 0x55fe60acaac0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.604+0000 7f4996a5b740 1 --2- 172.21.15.148:0/143076455 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fe60aaaaf0 0x55fe60ab3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.611 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.604+0000 7f4996a5b740 1 -- 172.21.15.148:0/143076455 >> 172.21.15.148:0/143076455 conn(0x55fe60aa7060 msgr2=0x55fe60ab4c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:36.611 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.604+0000 7f4996a5b740 1 -- 172.21.15.148:0/143076455 shutdown_connections 2024-09-19T07:23:36.611 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.604+0000 7f4996a5b740 1 -- 172.21.15.148:0/143076455 wait complete. 2024-09-19T07:23:36.611 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.604+0000 7f4996a5b740 1 -- start start 2024-09-19T07:23:36.611 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.605+0000 7f4996a5b740 1 Processor -- start 2024-09-19T07:23:36.611 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.605+0000 7f4996a5b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fe60aaaaf0 0x55fe60acb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:36.611 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.605+0000 7f4996a5b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fe60aab410 0x55fe60ac8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:36.611 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.605+0000 7f4996a5b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fe60ab5cb0 0x55fe60ac8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:36.611 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.605+0000 7f4996a5b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f498c1abe90 con 0x55fe60ab5cb0 2024-09-19T07:23:36.611 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.605+0000 7f4996a5b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f498c1ad300 con 0x55fe60aaaaf0 2024-09-19T07:23:36.611 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.605+0000 7f4996a5b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f498c1ac560 con 0x55fe60aab410 2024-09-19T07:23:36.612 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.605+0000 7f4996a5b740 10 client.0 _ll_register_callbacks cb 0x7f49880099e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:23:36.612 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.605+0000 7f4992257640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fe60ab5cb0 0x55fe60ac8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:36.612 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.605+0000 7f4992257640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fe60ab5cb0 0x55fe60ac8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48240/0 (socket says 172.21.15.148:48240) 2024-09-19T07:23:36.612 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.605+0000 7f4992257640 1 -- 172.21.15.148:0/168255931 learned_addr learned my addr 172.21.15.148:0/168255931 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:23:36.612 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.605+0000 7f4991a56640 1 --2- 172.21.15.148:0/168255931 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fe60aaaaf0 0x55fe60acb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:36.612 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.605+0000 7f4991255640 1 --2- 172.21.15.148:0/168255931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fe60aab410 0x55fe60ac8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:36.612 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.605+0000 7f4992257640 1 -- 172.21.15.148:0/168255931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fe60aab410 msgr2=0x55fe60ac8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:36.612 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.605+0000 7f4992257640 1 --2- 172.21.15.148:0/168255931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fe60aab410 0x55fe60ac8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.612 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.605+0000 7f4992257640 1 -- 172.21.15.148:0/168255931 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fe60aaaaf0 msgr2=0x55fe60acb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:36.612 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.605+0000 7f4992257640 1 --2- 172.21.15.148:0/168255931 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fe60aaaaf0 0x55fe60acb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.612 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.605+0000 7f4992257640 1 -- 172.21.15.148:0/168255931 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe60ac9570 con 0x55fe60ab5cb0 2024-09-19T07:23:36.612 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.606+0000 7f4992257640 1 --2- 172.21.15.148:0/168255931 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fe60ab5cb0 0x55fe60ac8d40 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f498409c330 tx=0x7f4984009590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c09bdf20703f354e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:36.612 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.606+0000 7f49757fa640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:23:36.613 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.606+0000 7f49757fa640 1 -- 172.21.15.148:0/168255931 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f498409cd30 con 0x55fe60ab5cb0 2024-09-19T07:23:36.613 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.606+0000 7f49757fa640 1 -- 172.21.15.148:0/168255931 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8556+0+0 (secure 0 0 0) 0x7f4984005310 con 0x55fe60ab5cb0 2024-09-19T07:23:36.613 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.606+0000 7f4996a5b740 1 -- 172.21.15.148:0/168255931 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f497c052e50 con 0x55fe60ab5cb0 2024-09-19T07:23:36.613 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.606+0000 7f49757fa640 1 -- 172.21.15.148:0/168255931 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f498409c630 con 0x55fe60ab5cb0 2024-09-19T07:23:36.613 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.606+0000 7f4996a5b740 10 client.17268 fetch_fsmap learned FSMap version 47 2024-09-19T07:23:36.613 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.606+0000 7f4996a5b740 1 -- 172.21.15.148:0/168255931 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55fe60b30570 con 0x55fe60ab5cb0 2024-09-19T07:23:36.613 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.606+0000 7f49757fa640 1 -- 172.21.15.148:0/168255931 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f497c052e50 con 0x55fe60ab5cb0 2024-09-19T07:23:36.613 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.606+0000 7f49757fa640 1 -- 172.21.15.148:0/168255931 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 47) ==== 8354+0+0 (secure 0 0 0) 0x7f49840b0c70 con 0x55fe60ab5cb0 2024-09-19T07:23:36.613 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.606+0000 7f4996a5b740 10 client.17268 fetch_fsmap finished waiting for FSMap version 47 2024-09-19T07:23:36.613 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.606+0000 7f4996a5b740 10 client.17268 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:23:36.613 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.606+0000 7f4996a5b740 20 client.17268 populate_metadata read hostname 'smithi148' 2024-09-19T07:23:36.613 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.606+0000 7f4996a5b740 1 --2- 172.21.15.148:0/168255931 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55fe60b30df0 0x55fe60b331e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:36.613 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.606+0000 7f4996a5b740 4 client.17268 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:23:36.614 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.606+0000 7f4996a5b740 1 -- 172.21.15.148:0/168255931 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fe60a16d70 con 0x55fe60b30df0 2024-09-19T07:23:36.614 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.606+0000 7f4991a56640 1 --2- 172.21.15.148:0/168255931 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55fe60b30df0 0x55fe60b331e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:36.614 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.607+0000 7f49757fa640 10 client.17268 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:23:36.614 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.607+0000 7f4991a56640 1 --2- 172.21.15.148:0/168255931 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55fe60b30df0 0x55fe60b331e0 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c79f261ea485fd91 server_cookie=5c496548bc0d075d in_seq=0 out_seq=0 2024-09-19T07:23:36.625 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.622+0000 7f49757fa640 1 -- 172.21.15.148:0/168255931 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fe60a16d70 con 0x55fe60b30df0 2024-09-19T07:23:36.625 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.622+0000 7f49757fa640 10 client.17268 handle_command_reply: tid=0 2024-09-19T07:23:36.625 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.622+0000 7f4996a5b740 1 client.17268 shutdown 2024-09-19T07:23:36.625 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.622+0000 7f4996a5b740 1 -- 172.21.15.148:0/168255931 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fe60ab5cb0 msgr2=0x55fe60ac8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:36.625 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.622+0000 7f4996a5b740 1 --2- 172.21.15.148:0/168255931 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fe60ab5cb0 0x55fe60ac8d40 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f498409c330 tx=0x7f4984009590 comp rx=0 tx=0).stop 2024-09-19T07:23:36.626 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.622+0000 7f4996a5b740 1 -- 172.21.15.148:0/168255931 shutdown_connections 2024-09-19T07:23:36.626 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.622+0000 7f4996a5b740 1 --2- 172.21.15.148:0/168255931 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55fe60b30df0 0x55fe60b331e0 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.626 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.622+0000 7f4996a5b740 1 --2- 172.21.15.148:0/168255931 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fe60ab5cb0 0x55fe60ac8d40 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.626 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.622+0000 7f4996a5b740 1 --2- 172.21.15.148:0/168255931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fe60aab410 0x55fe60ac8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.626 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.622+0000 7f4996a5b740 1 --2- 172.21.15.148:0/168255931 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fe60aaaaf0 0x55fe60acb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.626 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.622+0000 7f49757fa640 0 client.17268 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:23:36.626 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.622+0000 7f4996a5b740 1 -- 172.21.15.148:0/168255931 >> 172.21.15.148:0/168255931 conn(0x55fe60aa7060 msgr2=0x55fe60aa59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:36.626 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.622+0000 7f4996a5b740 1 -- 172.21.15.148:0/168255931 shutdown_connections 2024-09-19T07:23:36.627 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.622+0000 7f4996a5b740 1 -- 172.21.15.148:0/168255931 wait complete. 2024-09-19T07:23:36.627 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.622+0000 7f4996a5b740 20 client.17268 trim_cache size 0 max 16384 2024-09-19T07:23:36.627 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:23:36.627 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:23:36.627 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:23:36.627 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:23:36.628 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.623+0000 7f4993cba640 1 -- 172.21.15.148:0/1518737548 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f49780a3460 msgr2=0x7f49780a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:36.628 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.623+0000 7f4993cba640 1 --2- 172.21.15.148:0/1518737548 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f49780a3460 0x7f49780a5920 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4988009bd0 tx=0x7f4988005f90 comp rx=0 tx=0).stop 2024-09-19T07:23:36.628 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.623+0000 7f4993cba640 1 -- 172.21.15.148:0/1518737548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f498c10c0b0 msgr2=0x7f498c19cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:36.628 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.623+0000 7f4993cba640 1 --2- 172.21.15.148:0/1518737548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f498c10c0b0 0x7f498c19cc00 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f498400eb10 tx=0x7f498400c2d0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.628 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.623+0000 7f4993cba640 1 -- 172.21.15.148:0/1518737548 shutdown_connections 2024-09-19T07:23:36.629 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.623+0000 7f4993cba640 1 --2- 172.21.15.148:0/1518737548 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f49780a3460 0x7f49780a5920 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.629 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.623+0000 7f4993cba640 1 --2- 172.21.15.148:0/1518737548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f498c10c0b0 0x7f498c19cc00 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.629 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.623+0000 7f4993cba640 1 --2- 172.21.15.148:0/1518737548 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f498c103600 0x7f498c198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.629 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.623+0000 7f4993cba640 1 --2- 172.21.15.148:0/1518737548 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f498c102ce0 0x7f498c198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.629 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.623+0000 7f4993cba640 1 -- 172.21.15.148:0/1518737548 >> 172.21.15.148:0/1518737548 conn(0x7f498c077990 msgr2=0x7f498c0fd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:36.629 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.623+0000 7f4993cba640 1 -- 172.21.15.148:0/1518737548 shutdown_connections 2024-09-19T07:23:36.629 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:36.623+0000 7f4993cba640 1 -- 172.21.15.148:0/1518737548 wait complete. 2024-09-19T07:23:37.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:23:36 smithi179 ceph-mon[35716]: pgmap v392: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 15 op/s 2024-09-19T07:23:37.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:23:36 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:23:37.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:23:36 smithi148 ceph-mon[31180]: pgmap v392: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 15 op/s 2024-09-19T07:23:37.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:23:36 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:23:37.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:23:36 smithi165 ceph-mon[35326]: pgmap v392: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 15 op/s 2024-09-19T07:23:37.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:23:36 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:23:38.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:23:37 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:23:38.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:23:37 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:23:38.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:23:37 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:23:38.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:23:37 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:23:38.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:23:37 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:23:38.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:23:37 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:23:38.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:23:37 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:23:38.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:23:37 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:23:38.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:23:37 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:23:38.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:23:37 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:23:38.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:23:37 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:23:38.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:23:37 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:23:38.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:23:37 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:23:38.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:23:37 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:23:38.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:23:37 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:23:38.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:23:37 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:23:38.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:23:37 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:23:38.084 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:23:37 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:23:38.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:23:37 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:23:38.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:23:37 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:23:38.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:23:37 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:23:38.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:23:37 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:23:38.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:23:37 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:23:38.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:23:37 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:23:38.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:23:37 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:23:38.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:23:37 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:23:38.135 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:23:37 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:23:39.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:23:39 smithi179 ceph-mon[35716]: pgmap v393: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 33 KiB/s wr, 9 op/s 2024-09-19T07:23:39.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:23:39 smithi148 ceph-mon[31180]: pgmap v393: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 33 KiB/s wr, 9 op/s 2024-09-19T07:23:39.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:23:39 smithi165 ceph-mon[35326]: pgmap v393: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 33 KiB/s wr, 9 op/s 2024-09-19T07:23:41.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:23:41 smithi179 ceph-mon[35716]: pgmap v394: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 38 KiB/s wr, 10 op/s 2024-09-19T07:23:41.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:23:41 smithi148 ceph-mon[31180]: pgmap v394: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 38 KiB/s wr, 10 op/s 2024-09-19T07:23:41.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:23:41 smithi165 ceph-mon[35326]: pgmap v394: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 38 KiB/s wr, 10 op/s 2024-09-19T07:23:43.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:23:43 smithi179 ceph-mon[35716]: pgmap v395: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 54 KiB/s wr, 17 op/s 2024-09-19T07:23:43.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:23:43 smithi148 ceph-mon[31180]: pgmap v395: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 54 KiB/s wr, 17 op/s 2024-09-19T07:23:43.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:23:43 smithi165 ceph-mon[35326]: pgmap v395: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 54 KiB/s wr, 17 op/s 2024-09-19T07:23:45.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:23:45 smithi179 ceph-mon[35716]: pgmap v396: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 47 KiB/s wr, 14 op/s 2024-09-19T07:23:45.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:23:45 smithi148 ceph-mon[31180]: pgmap v396: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 47 KiB/s wr, 14 op/s 2024-09-19T07:23:45.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:23:45 smithi165 ceph-mon[35326]: pgmap v396: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 47 KiB/s wr, 14 op/s 2024-09-19T07:23:47.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:23:47 smithi179 ceph-mon[35716]: pgmap v397: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 56 KiB/s wr, 18 op/s 2024-09-19T07:23:47.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:23:47 smithi148 ceph-mon[31180]: pgmap v397: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 56 KiB/s wr, 18 op/s 2024-09-19T07:23:47.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:23:47 smithi165 ceph-mon[35326]: pgmap v397: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 56 KiB/s wr, 18 op/s 2024-09-19T07:23:49.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:23:49 smithi179 ceph-mon[35716]: pgmap v398: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 37 KiB/s wr, 14 op/s 2024-09-19T07:23:49.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:23:49 smithi148 ceph-mon[31180]: pgmap v398: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 37 KiB/s wr, 14 op/s 2024-09-19T07:23:49.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:23:49 smithi165 ceph-mon[35326]: pgmap v398: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 37 KiB/s wr, 14 op/s 2024-09-19T07:23:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.719+0000 7f2a9bb91640 1 -- 172.21.15.148:0/188256230 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a94101250 msgr2=0x7f2a94107990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.719+0000 7f2a9bb91640 1 --2- 172.21.15.148:0/188256230 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a94101250 0x7f2a94107990 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f2a84009900 tx=0x7f2a8402a410 comp rx=0 tx=0).stop 2024-09-19T07:23:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.719+0000 7f2a9bb91640 1 -- 172.21.15.148:0/188256230 shutdown_connections 2024-09-19T07:23:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.719+0000 7f2a9bb91640 1 --2- 172.21.15.148:0/188256230 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a941080f0 0x7f2a9410ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.719+0000 7f2a9bb91640 1 --2- 172.21.15.148:0/188256230 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a94101250 0x7f2a94107990 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.719+0000 7f2a9bb91640 1 --2- 172.21.15.148:0/188256230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a941008a0 0x7f2a94100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.719+0000 7f2a9bb91640 1 -- 172.21.15.148:0/188256230 >> 172.21.15.148:0/188256230 conn(0x7f2a94075ef0 msgr2=0x7f2a94076300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.719+0000 7f2a9bb91640 1 -- 172.21.15.148:0/188256230 shutdown_connections 2024-09-19T07:23:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.719+0000 7f2a9bb91640 1 -- 172.21.15.148:0/188256230 wait complete. 2024-09-19T07:23:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.720+0000 7f2a9bb91640 1 Processor -- start 2024-09-19T07:23:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.720+0000 7f2a9bb91640 1 -- start start 2024-09-19T07:23:49.723 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.720+0000 7f2a9bb91640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a941008a0 0x7f2a94101810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:49.723 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.720+0000 7f2a9bb91640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a941080f0 0x7f2a94101d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:49.723 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.720+0000 7f2a9bb91640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a94102290 0x7f2a941a6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:49.723 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.720+0000 7f2a9bb91640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2a94111f20 con 0x7f2a941008a0 2024-09-19T07:23:49.723 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.720+0000 7f2a9bb91640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2a94111da0 con 0x7f2a941080f0 2024-09-19T07:23:49.723 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.720+0000 7f2a9bb91640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2a941120a0 con 0x7f2a94102290 2024-09-19T07:23:49.723 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.720+0000 7f2a9992d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a941008a0 0x7f2a94101810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:49.723 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.720+0000 7f2a9992d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a941008a0 0x7f2a94101810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44396/0 (socket says 172.21.15.148:44396) 2024-09-19T07:23:49.723 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.720+0000 7f2a9992d640 1 -- 172.21.15.148:0/3368901402 learned_addr learned my addr 172.21.15.148:0/3368901402 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:23:49.724 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.720+0000 7f2a9a12e640 1 --2- 172.21.15.148:0/3368901402 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a94102290 0x7f2a941a6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:49.724 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.720+0000 7f2a9912c640 1 --2- 172.21.15.148:0/3368901402 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a941080f0 0x7f2a94101d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:49.724 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.720+0000 7f2a9992d640 1 -- 172.21.15.148:0/3368901402 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a94102290 msgr2=0x7f2a941a6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:49.724 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.720+0000 7f2a9992d640 1 --2- 172.21.15.148:0/3368901402 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a94102290 0x7f2a941a6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.724 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.720+0000 7f2a9992d640 1 -- 172.21.15.148:0/3368901402 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a941080f0 msgr2=0x7f2a94101d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:49.724 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.720+0000 7f2a9992d640 1 --2- 172.21.15.148:0/3368901402 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a941080f0 0x7f2a94101d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.724 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.720+0000 7f2a9992d640 1 -- 172.21.15.148:0/3368901402 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a941a6c60 con 0x7f2a941008a0 2024-09-19T07:23:49.724 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.720+0000 7f2a9912c640 1 --2- 172.21.15.148:0/3368901402 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a941080f0 0x7f2a94101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:23:49.724 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.720+0000 7f2a9a12e640 1 --2- 172.21.15.148:0/3368901402 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a94102290 0x7f2a941a6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:23:49.724 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.721+0000 7f2a9992d640 1 --2- 172.21.15.148:0/3368901402 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a941008a0 0x7f2a94101810 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f2a9000d770 tx=0x7f2a9000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:49.724 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.721+0000 7f2a8affd640 1 -- 172.21.15.148:0/3368901402 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a90017070 con 0x7f2a941008a0 2024-09-19T07:23:49.724 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.721+0000 7f2a8affd640 1 -- 172.21.15.148:0/3368901402 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a90005500 con 0x7f2a941008a0 2024-09-19T07:23:49.724 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.721+0000 7f2a9bb91640 1 -- 172.21.15.148:0/3368901402 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a941a6f50 con 0x7f2a941008a0 2024-09-19T07:23:49.725 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.721+0000 7f2a8affd640 1 -- 172.21.15.148:0/3368901402 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a90004e00 con 0x7f2a941008a0 2024-09-19T07:23:49.725 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.721+0000 7f2a9bb91640 1 -- 172.21.15.148:0/3368901402 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a941a73c0 con 0x7f2a941008a0 2024-09-19T07:23:49.731 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.723+0000 7f2a8affd640 1 -- 172.21.15.148:0/3368901402 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f2a90004fa0 con 0x7f2a941008a0 2024-09-19T07:23:49.731 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.724+0000 7f2a9ea0b740 1 Processor -- start 2024-09-19T07:23:49.731 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.724+0000 7f2a9ea0b740 1 -- start start 2024-09-19T07:23:49.731 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.724+0000 7f2a9ea0b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0b8bd2af0 0x55f0b8bd2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:49.731 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.724+0000 7f2a9ea0b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f0b8bd3410 0x55f0b8bdd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:49.731 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.724+0000 7f2a9ea0b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f0b8bddcb0 0x55f0b8be00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:49.731 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.724+0000 7f2a9ea0b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55f0b8b372f0 con 0x55f0b8bd2af0 2024-09-19T07:23:49.731 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.724+0000 7f2a9ea0b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55f0b8adf270 con 0x55f0b8bddcb0 2024-09-19T07:23:49.732 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.724+0000 7f2a9ea0b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f0b8b332b0 con 0x55f0b8bd3410 2024-09-19T07:23:49.732 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.724+0000 7f2a9a12e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0b8bd2af0 0x55f0b8bd2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:49.732 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.724+0000 7f2a9a12e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0b8bd2af0 0x55f0b8bd2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44402/0 (socket says 172.21.15.148:44402) 2024-09-19T07:23:49.732 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.724+0000 7f2a9a12e640 1 -- 172.21.15.148:0/1148912061 learned_addr learned my addr 172.21.15.148:0/1148912061 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:23:49.732 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.724+0000 7f2a9992d640 1 --2- 172.21.15.148:0/1148912061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f0b8bd3410 0x55f0b8bdd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:49.732 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.725+0000 7f2a9912c640 1 --2- 172.21.15.148:0/1148912061 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f0b8bddcb0 0x55f0b8be00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:49.732 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.725+0000 7f2a8affd640 1 --2- 172.21.15.148:0/3368901402 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f2a800a3490 0x7f2a800a5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:49.732 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.725+0000 7f2a9a12e640 1 -- 172.21.15.148:0/1148912061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f0b8bd3410 msgr2=0x55f0b8bdd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:49.732 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.725+0000 7f2a9a12e640 1 --2- 172.21.15.148:0/1148912061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f0b8bd3410 0x55f0b8bdd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.732 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.725+0000 7f2a9a12e640 1 -- 172.21.15.148:0/1148912061 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f0b8bddcb0 msgr2=0x55f0b8be00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:49.732 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.725+0000 7f2a9a12e640 1 --2- 172.21.15.148:0/1148912061 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f0b8bddcb0 0x55f0b8be00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.732 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.725+0000 7f2a9a12e640 1 -- 172.21.15.148:0/1148912061 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0b8ade340 con 0x55f0b8bd2af0 2024-09-19T07:23:49.732 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.725+0000 7f2a9a12e640 1 --2- 172.21.15.148:0/3368901402 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f2a800a3490 0x7f2a800a5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:49.733 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.725+0000 7f2a8affd640 1 -- 172.21.15.148:0/3368901402 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8556+0+0 (secure 0 0 0) 0x7f2a900cf7c0 con 0x7f2a941008a0 2024-09-19T07:23:49.733 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.725+0000 7f2a9a12e640 1 --2- 172.21.15.148:0/1148912061 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0b8bd2af0 0x55f0b8bd2ed0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c008ed0 tx=0x7f2a8c00d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b31c9d00ea9faa34 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:49.733 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.725+0000 7f2a7ffff640 1 -- 172.21.15.148:0/1148912061 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c011e60 con 0x55f0b8bd2af0 2024-09-19T07:23:49.733 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.725+0000 7f2a7ffff640 1 -- 172.21.15.148:0/1148912061 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a8c01adc0 con 0x55f0b8bd2af0 2024-09-19T07:23:49.733 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.725+0000 7f2a7ffff640 1 -- 172.21.15.148:0/1148912061 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c019c70 con 0x55f0b8bd2af0 2024-09-19T07:23:49.733 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.725+0000 7f2a9a12e640 1 --2- 172.21.15.148:0/3368901402 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f2a800a3490 0x7f2a800a5950 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c01e000 tx=0x7f2a8c01f000 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:49.733 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.726+0000 7f2a9ea0b740 1 -- 172.21.15.148:0/1148912061 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0b8bd2af0 msgr2=0x55f0b8bd2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:49.733 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.726+0000 7f2a9ea0b740 1 --2- 172.21.15.148:0/1148912061 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0b8bd2af0 0x55f0b8bd2ed0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c008ed0 tx=0x7f2a8c00d710 comp rx=0 tx=0).stop 2024-09-19T07:23:49.733 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.726+0000 7f2a9ea0b740 1 -- 172.21.15.148:0/1148912061 shutdown_connections 2024-09-19T07:23:49.733 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.726+0000 7f2a9ea0b740 1 --2- 172.21.15.148:0/1148912061 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f0b8bddcb0 0x55f0b8be00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.733 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.726+0000 7f2a9ea0b740 1 --2- 172.21.15.148:0/1148912061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f0b8bd3410 0x55f0b8bdd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.733 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.726+0000 7f2a9ea0b740 1 --2- 172.21.15.148:0/1148912061 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0b8bd2af0 0x55f0b8bd2ed0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.733 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.726+0000 7f2a9ea0b740 1 -- 172.21.15.148:0/1148912061 >> 172.21.15.148:0/1148912061 conn(0x55f0b8bcf060 msgr2=0x55f0b8bcf440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:49.733 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.726+0000 7f2a9ea0b740 1 -- 172.21.15.148:0/1148912061 shutdown_connections 2024-09-19T07:23:49.734 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.726+0000 7f2a9ea0b740 1 -- 172.21.15.148:0/1148912061 wait complete. 2024-09-19T07:23:49.734 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.727+0000 7f2a9ea0b740 1 -- start start 2024-09-19T07:23:49.734 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.727+0000 7f2a9ea0b740 1 Processor -- start 2024-09-19T07:23:49.734 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.727+0000 7f2a9ea0b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f0b8bd2af0 0x55f0b8bdab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:49.734 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.727+0000 7f2a9ea0b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f0b8bd3410 0x55f0b8bdb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:49.734 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.727+0000 7f2a9ea0b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0b8bddcb0 0x55f0b8bdb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:49.734 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.727+0000 7f2a9ea0b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55f0b8be0880 con 0x55f0b8bddcb0 2024-09-19T07:23:49.734 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.727+0000 7f2a9ea0b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55f0b8ac0290 con 0x55f0b8bd2af0 2024-09-19T07:23:49.734 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.727+0000 7f2a9ea0b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f0b8be0a00 con 0x55f0b8bd3410 2024-09-19T07:23:49.734 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.727+0000 7f2a9ea0b740 10 client.0 _ll_register_callbacks cb 0x55f0b8af1140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:23:49.734 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.727+0000 7f2a9a12e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0b8bddcb0 0x55f0b8bdb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:49.734 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.727+0000 7f2a9a12e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0b8bddcb0 0x55f0b8bdb5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44408/0 (socket says 172.21.15.148:44408) 2024-09-19T07:23:49.734 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.727+0000 7f2a9a12e640 1 -- 172.21.15.148:0/1056632264 learned_addr learned my addr 172.21.15.148:0/1056632264 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:23:49.735 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.727+0000 7f2a9912c640 1 --2- 172.21.15.148:0/1056632264 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f0b8bd3410 0x55f0b8bdb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:49.735 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.727+0000 7f2a9992d640 1 --2- 172.21.15.148:0/1056632264 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f0b8bd2af0 0x55f0b8bdab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:49.735 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.728+0000 7f2a9a12e640 1 -- 172.21.15.148:0/1056632264 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f0b8bd3410 msgr2=0x55f0b8bdb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:49.735 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.728+0000 7f2a9a12e640 1 --2- 172.21.15.148:0/1056632264 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f0b8bd3410 0x55f0b8bdb090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.735 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.728+0000 7f2a9a12e640 1 -- 172.21.15.148:0/1056632264 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f0b8bd2af0 msgr2=0x55f0b8bdab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:49.735 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.728+0000 7f2a9a12e640 1 --2- 172.21.15.148:0/1056632264 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f0b8bd2af0 0x55f0b8bdab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.735 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.728+0000 7f2a9a12e640 1 -- 172.21.15.148:0/1056632264 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0b884a210 con 0x55f0b8bddcb0 2024-09-19T07:23:49.735 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.728+0000 7f2a9992d640 1 --2- 172.21.15.148:0/1056632264 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f0b8bd2af0 0x55f0b8bdab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:23:49.735 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.728+0000 7f2a9a12e640 1 --2- 172.21.15.148:0/1056632264 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0b8bddcb0 0x55f0b8bdb5d0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c019c20 tx=0x7f2a8c019c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed66c7b637eba242 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:49.735 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.728+0000 7f2a7d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:23:49.735 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.728+0000 7f2a7d7fa640 1 -- 172.21.15.148:0/1056632264 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c011e60 con 0x55f0b8bddcb0 2024-09-19T07:23:49.735 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.728+0000 7f2a7d7fa640 1 -- 172.21.15.148:0/1056632264 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8556+0+0 (secure 0 0 0) 0x7f2a8c020030 con 0x55f0b8bddcb0 2024-09-19T07:23:49.735 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.728+0000 7f2a9ea0b740 1 -- 172.21.15.148:0/1056632264 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a8c01adc0 con 0x55f0b8bddcb0 2024-09-19T07:23:49.735 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.728+0000 7f2a7d7fa640 1 -- 172.21.15.148:0/1056632264 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f2a8c01aa70 con 0x55f0b8bddcb0 2024-09-19T07:23:49.736 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.728+0000 7f2a9ea0b740 10 client.17280 fetch_fsmap learned FSMap version 47 2024-09-19T07:23:49.736 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.728+0000 7f2a9ea0b740 1 -- 172.21.15.148:0/1056632264 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55f0b8916620 con 0x55f0b8bddcb0 2024-09-19T07:23:49.736 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.728+0000 7f2a7d7fa640 1 -- 172.21.15.148:0/1056632264 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a8c01adc0 con 0x55f0b8bddcb0 2024-09-19T07:23:49.736 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.728+0000 7f2a7d7fa640 1 -- 172.21.15.148:0/1056632264 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 47) ==== 8354+0+0 (secure 0 0 0) 0x7f2a8c024b60 con 0x55f0b8bddcb0 2024-09-19T07:23:49.736 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.729+0000 7f2a9ea0b740 10 client.17280 fetch_fsmap finished waiting for FSMap version 47 2024-09-19T07:23:49.736 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.729+0000 7f2a9ea0b740 10 client.17280 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:23:49.736 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.729+0000 7f2a9ea0b740 20 client.17280 populate_metadata read hostname 'smithi148' 2024-09-19T07:23:49.736 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.729+0000 7f2a9ea0b740 1 --2- 172.21.15.148:0/1056632264 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55f0b8bedb00 0x55f0b8befef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:49.736 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.729+0000 7f2a9ea0b740 4 client.17280 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:23:49.737 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.729+0000 7f2a9ea0b740 1 -- 172.21.15.148:0/1056632264 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f0b8b44a20 con 0x55f0b8bedb00 2024-09-19T07:23:49.737 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.729+0000 7f2a9992d640 1 --2- 172.21.15.148:0/1056632264 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55f0b8bedb00 0x55f0b8befef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:49.737 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.729+0000 7f2a7d7fa640 10 client.17280 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:23:49.737 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.729+0000 7f2a9992d640 1 --2- 172.21.15.148:0/1056632264 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55f0b8bedb00 0x55f0b8befef0 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6100504733308ac server_cookie=d89dba12d3d2f12d in_seq=0 out_seq=0 2024-09-19T07:23:49.737 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.730+0000 7f2a7d7fa640 1 -- 172.21.15.148:0/1056632264 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f0b8b44a20 con 0x55f0b8bedb00 2024-09-19T07:23:49.737 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.730+0000 7f2a7d7fa640 10 client.17280 handle_command_reply: tid=0 2024-09-19T07:23:49.737 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.730+0000 7f2a9ea0b740 1 client.17280 shutdown 2024-09-19T07:23:49.737 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.730+0000 7f2a9ea0b740 1 -- 172.21.15.148:0/1056632264 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0b8bddcb0 msgr2=0x55f0b8bdb5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:49.737 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.730+0000 7f2a9ea0b740 1 --2- 172.21.15.148:0/1056632264 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0b8bddcb0 0x55f0b8bdb5d0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c019c20 tx=0x7f2a8c019c50 comp rx=0 tx=0).stop 2024-09-19T07:23:49.737 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.730+0000 7f2a9ea0b740 1 -- 172.21.15.148:0/1056632264 shutdown_connections 2024-09-19T07:23:49.737 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.730+0000 7f2a9ea0b740 1 --2- 172.21.15.148:0/1056632264 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55f0b8bedb00 0x55f0b8befef0 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.737 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.730+0000 7f2a9ea0b740 1 --2- 172.21.15.148:0/1056632264 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0b8bddcb0 0x55f0b8bdb5d0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.737 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.730+0000 7f2a9ea0b740 1 --2- 172.21.15.148:0/1056632264 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f0b8bd3410 0x55f0b8bdb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.737 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.730+0000 7f2a9ea0b740 1 --2- 172.21.15.148:0/1056632264 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f0b8bd2af0 0x55f0b8bdab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.738 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.730+0000 7f2a7d7fa640 0 client.17280 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:23:49.738 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.730+0000 7f2a9ea0b740 1 -- 172.21.15.148:0/1056632264 >> 172.21.15.148:0/1056632264 conn(0x55f0b8bcf060 msgr2=0x55f0b8bd4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:49.738 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.730+0000 7f2a9ea0b740 1 -- 172.21.15.148:0/1056632264 shutdown_connections 2024-09-19T07:23:49.738 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.730+0000 7f2a9ea0b740 1 -- 172.21.15.148:0/1056632264 wait complete. 2024-09-19T07:23:49.738 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.730+0000 7f2a9ea0b740 20 client.17280 trim_cache size 0 max 16384 2024-09-19T07:23:49.749 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.745+0000 7f2a9ea0b740 1 Processor -- start 2024-09-19T07:23:49.749 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.745+0000 7f2a9ea0b740 1 -- start start 2024-09-19T07:23:49.749 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.745+0000 7f2a9ea0b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f0b8bd2af0 0x55f0b8bd5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:49.749 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.745+0000 7f2a9ea0b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f0b8bd3410 0x55f0b8bdb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:49.749 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.745+0000 7f2a9ea0b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0b8bddcb0 0x55f0b8bdb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:49.750 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.745+0000 7f2a9ea0b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2a941b2460 con 0x55f0b8bddcb0 2024-09-19T07:23:49.750 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.745+0000 7f2a9ea0b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2a941afcd0 con 0x55f0b8bd2af0 2024-09-19T07:23:49.750 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.745+0000 7f2a9ea0b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2a941adb40 con 0x55f0b8bd3410 2024-09-19T07:23:49.750 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.745+0000 7f2a9a12e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0b8bddcb0 0x55f0b8bdb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:49.750 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.745+0000 7f2a9a12e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0b8bddcb0 0x55f0b8bdb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44412/0 (socket says 172.21.15.148:44412) 2024-09-19T07:23:49.750 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.745+0000 7f2a9a12e640 1 -- 172.21.15.148:0/1557643314 learned_addr learned my addr 172.21.15.148:0/1557643314 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:23:49.750 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.745+0000 7f2a9912c640 1 --2- 172.21.15.148:0/1557643314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f0b8bd3410 0x55f0b8bdb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:49.750 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.745+0000 7f2a9a12e640 1 -- 172.21.15.148:0/1557643314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f0b8bd3410 msgr2=0x55f0b8bdb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:49.750 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.745+0000 7f2a9a12e640 1 --2- 172.21.15.148:0/1557643314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f0b8bd3410 0x55f0b8bdb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.750 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.745+0000 7f2a9a12e640 1 -- 172.21.15.148:0/1557643314 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f0b8bd2af0 msgr2=0x55f0b8bd5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:49.750 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.745+0000 7f2a9992d640 1 --2- 172.21.15.148:0/1557643314 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f0b8bd2af0 0x55f0b8bd5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:49.750 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.745+0000 7f2a9a12e640 1 --2- 172.21.15.148:0/1557643314 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f0b8bd2af0 0x55f0b8bd5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.750 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.745+0000 7f2a9a12e640 1 -- 172.21.15.148:0/1557643314 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0b8bf0480 con 0x55f0b8bddcb0 2024-09-19T07:23:49.751 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.745+0000 7f2a9992d640 1 --2- 172.21.15.148:0/1557643314 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f0b8bd2af0 0x55f0b8bd5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:23:49.751 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.745+0000 7f2a9a12e640 1 --2- 172.21.15.148:0/1557643314 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0b8bddcb0 0x55f0b8bdb5c0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c00d750 tx=0x7f2a8c011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62c1e7c1c5a6affa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:49.751 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.745+0000 7f2a7f7fe640 1 -- 172.21.15.148:0/1557643314 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c011e60 con 0x55f0b8bddcb0 2024-09-19T07:23:49.751 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.746+0000 7f2a7f7fe640 1 -- 172.21.15.148:0/1557643314 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a8c0083d0 con 0x55f0b8bddcb0 2024-09-19T07:23:49.751 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.746+0000 7f2a7f7fe640 1 -- 172.21.15.148:0/1557643314 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c0366c0 con 0x55f0b8bddcb0 2024-09-19T07:23:49.751 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.746+0000 7f2a9ea0b740 1 -- 172.21.15.148:0/1557643314 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0b8bddcb0 msgr2=0x55f0b8bdb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:49.751 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.746+0000 7f2a9ea0b740 1 --2- 172.21.15.148:0/1557643314 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0b8bddcb0 0x55f0b8bdb5c0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c00d750 tx=0x7f2a8c011440 comp rx=0 tx=0).stop 2024-09-19T07:23:49.751 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.746+0000 7f2a9ea0b740 1 -- 172.21.15.148:0/1557643314 shutdown_connections 2024-09-19T07:23:49.751 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.746+0000 7f2a9ea0b740 1 --2- 172.21.15.148:0/1557643314 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0b8bddcb0 0x55f0b8bdb5c0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.751 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.746+0000 7f2a9ea0b740 1 --2- 172.21.15.148:0/1557643314 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f0b8bd3410 0x55f0b8bdb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.751 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.746+0000 7f2a9ea0b740 1 --2- 172.21.15.148:0/1557643314 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f0b8bd2af0 0x55f0b8bd5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.751 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.746+0000 7f2a9ea0b740 1 -- 172.21.15.148:0/1557643314 >> 172.21.15.148:0/1557643314 conn(0x55f0b8bcf060 msgr2=0x55f0b8bdcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:49.751 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.746+0000 7f2a9ea0b740 1 -- 172.21.15.148:0/1557643314 shutdown_connections 2024-09-19T07:23:49.751 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.746+0000 7f2a9ea0b740 1 -- 172.21.15.148:0/1557643314 wait complete. 2024-09-19T07:23:49.752 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.746+0000 7f2a9ea0b740 1 -- start start 2024-09-19T07:23:49.752 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.746+0000 7f2a9ea0b740 1 Processor -- start 2024-09-19T07:23:49.752 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.747+0000 7f2a9ea0b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f0b8bd2af0 0x55f0b8c50980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:49.752 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.747+0000 7f2a9ea0b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f0b8bd3410 0x55f0b8c50ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:49.752 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.747+0000 7f2a9ea0b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0b8bddcb0 0x55f0b8be11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:49.752 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.747+0000 7f2a9ea0b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2a941ae190 con 0x55f0b8bddcb0 2024-09-19T07:23:49.752 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.747+0000 7f2a9ea0b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2a941af600 con 0x55f0b8bd2af0 2024-09-19T07:23:49.752 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.747+0000 7f2a9ea0b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2a941ae860 con 0x55f0b8bd3410 2024-09-19T07:23:49.752 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.747+0000 7f2a9ea0b740 10 client.0 _ll_register_callbacks cb 0x7f2a8c01d020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:23:49.752 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.747+0000 7f2a9a12e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0b8bddcb0 0x55f0b8be11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:49.752 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.747+0000 7f2a9a12e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0b8bddcb0 0x55f0b8be11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44418/0 (socket says 172.21.15.148:44418) 2024-09-19T07:23:49.752 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.747+0000 7f2a9a12e640 1 -- 172.21.15.148:0/3401305056 learned_addr learned my addr 172.21.15.148:0/3401305056 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:23:49.752 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.747+0000 7f2a9a12e640 1 -- 172.21.15.148:0/3401305056 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f0b8bd3410 msgr2=0x55f0b8c50ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:49.753 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.747+0000 7f2a9a12e640 1 --2- 172.21.15.148:0/3401305056 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f0b8bd3410 0x55f0b8c50ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.753 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.747+0000 7f2a9a12e640 1 -- 172.21.15.148:0/3401305056 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f0b8bd2af0 msgr2=0x55f0b8c50980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:49.753 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.747+0000 7f2a9a12e640 1 --2- 172.21.15.148:0/3401305056 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f0b8bd2af0 0x55f0b8c50980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.753 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.747+0000 7f2a9a12e640 1 -- 172.21.15.148:0/3401305056 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0b8bcee90 con 0x55f0b8bddcb0 2024-09-19T07:23:49.753 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.747+0000 7f2a9a12e640 1 --2- 172.21.15.148:0/3401305056 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0b8bddcb0 0x55f0b8be11e0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c036440 tx=0x7f2a8c024a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb11adb09f00953e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:49.753 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.747+0000 7f2a7d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:23:49.753 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.748+0000 7f2a7d7fa640 1 -- 172.21.15.148:0/3401305056 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c011e60 con 0x55f0b8bddcb0 2024-09-19T07:23:49.753 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.748+0000 7f2a7d7fa640 1 -- 172.21.15.148:0/3401305056 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8556+0+0 (secure 0 0 0) 0x7f2a8c02a040 con 0x55f0b8bddcb0 2024-09-19T07:23:49.753 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.748+0000 7f2a9ea0b740 1 -- 172.21.15.148:0/3401305056 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a8c0083d0 con 0x55f0b8bddcb0 2024-09-19T07:23:49.753 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.748+0000 7f2a7d7fa640 1 -- 172.21.15.148:0/3401305056 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f2a8c04d050 con 0x55f0b8bddcb0 2024-09-19T07:23:49.753 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.748+0000 7f2a9ea0b740 10 client.17286 fetch_fsmap learned FSMap version 47 2024-09-19T07:23:49.753 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.748+0000 7f2a9ea0b740 1 -- 172.21.15.148:0/3401305056 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55f0b8c57f30 con 0x55f0b8bddcb0 2024-09-19T07:23:49.753 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.748+0000 7f2a7d7fa640 1 -- 172.21.15.148:0/3401305056 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a8c0083d0 con 0x55f0b8bddcb0 2024-09-19T07:23:49.754 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.748+0000 7f2a7d7fa640 1 -- 172.21.15.148:0/3401305056 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 47) ==== 8354+0+0 (secure 0 0 0) 0x7f2a8c03d020 con 0x55f0b8bddcb0 2024-09-19T07:23:49.754 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.748+0000 7f2a9ea0b740 10 client.17286 fetch_fsmap finished waiting for FSMap version 47 2024-09-19T07:23:49.754 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.748+0000 7f2a9ea0b740 10 client.17286 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:23:49.754 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.748+0000 7f2a9ea0b740 20 client.17286 populate_metadata read hostname 'smithi148' 2024-09-19T07:23:49.754 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.748+0000 7f2a9ea0b740 1 --2- 172.21.15.148:0/3401305056 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55f0b8c58640 0x55f0b8c5aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:49.754 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.748+0000 7f2a9ea0b740 4 client.17286 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:23:49.754 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.748+0000 7f2a9ea0b740 1 -- 172.21.15.148:0/3401305056 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f0b8b3ed70 con 0x55f0b8c58640 2024-09-19T07:23:49.754 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.748+0000 7f2a9992d640 1 --2- 172.21.15.148:0/3401305056 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55f0b8c58640 0x55f0b8c5aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:49.754 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.749+0000 7f2a7d7fa640 10 client.17286 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:23:49.754 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.749+0000 7f2a9992d640 1 --2- 172.21.15.148:0/3401305056 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55f0b8c58640 0x55f0b8c5aac0 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=621b5414d7ee784d server_cookie=418fffec23970811 in_seq=0 out_seq=0 2024-09-19T07:23:49.766 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.766+0000 7f2a7d7fa640 1 -- 172.21.15.148:0/3401305056 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f0b8b3ed70 con 0x55f0b8c58640 2024-09-19T07:23:49.766 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.766+0000 7f2a7d7fa640 10 client.17286 handle_command_reply: tid=0 2024-09-19T07:23:49.766 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.766+0000 7f2a9ea0b740 1 client.17286 shutdown 2024-09-19T07:23:49.766 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.766+0000 7f2a9ea0b740 1 -- 172.21.15.148:0/3401305056 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0b8bddcb0 msgr2=0x55f0b8be11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.766+0000 7f2a9ea0b740 1 --2- 172.21.15.148:0/3401305056 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0b8bddcb0 0x55f0b8be11e0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c036440 tx=0x7f2a8c024a90 comp rx=0 tx=0).stop 2024-09-19T07:23:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.766+0000 7f2a9ea0b740 1 -- 172.21.15.148:0/3401305056 shutdown_connections 2024-09-19T07:23:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.766+0000 7f2a9ea0b740 1 --2- 172.21.15.148:0/3401305056 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55f0b8c58640 0x55f0b8c5aac0 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.766+0000 7f2a9ea0b740 1 --2- 172.21.15.148:0/3401305056 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0b8bddcb0 0x55f0b8be11e0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.766+0000 7f2a9ea0b740 1 --2- 172.21.15.148:0/3401305056 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f0b8bd3410 0x55f0b8c50ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.766+0000 7f2a7d7fa640 0 client.17286 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:23:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.766+0000 7f2a9ea0b740 1 --2- 172.21.15.148:0/3401305056 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f0b8bd2af0 0x55f0b8c50980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.766+0000 7f2a9ea0b740 1 -- 172.21.15.148:0/3401305056 >> 172.21.15.148:0/3401305056 conn(0x55f0b8bcf060 msgr2=0x55f0b8bcd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.766+0000 7f2a9ea0b740 1 -- 172.21.15.148:0/3401305056 shutdown_connections 2024-09-19T07:23:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.766+0000 7f2a9ea0b740 1 -- 172.21.15.148:0/3401305056 wait complete. 2024-09-19T07:23:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.766+0000 7f2a9ea0b740 20 client.17286 trim_cache size 0 max 16384 2024-09-19T07:23:49.768 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:23:49.768 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:23:49.768 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:23:49.768 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:23:49.769 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.766+0000 7f2a9bb91640 1 -- 172.21.15.148:0/3368901402 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f2a800a3490 msgr2=0x7f2a800a5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:49.769 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.766+0000 7f2a9bb91640 1 --2- 172.21.15.148:0/3368901402 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f2a800a3490 0x7f2a800a5950 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c01e000 tx=0x7f2a8c01f000 comp rx=0 tx=0).stop 2024-09-19T07:23:49.769 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.766+0000 7f2a9bb91640 1 -- 172.21.15.148:0/3368901402 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a941008a0 msgr2=0x7f2a94101810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:49.769 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.766+0000 7f2a9bb91640 1 --2- 172.21.15.148:0/3368901402 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a941008a0 0x7f2a94101810 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f2a9000d770 tx=0x7f2a9000dc30 comp rx=0 tx=0).stop 2024-09-19T07:23:49.769 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.766+0000 7f2a9bb91640 1 -- 172.21.15.148:0/3368901402 shutdown_connections 2024-09-19T07:23:49.769 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.766+0000 7f2a9bb91640 1 --2- 172.21.15.148:0/3368901402 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f2a800a3490 0x7f2a800a5950 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.769 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.766+0000 7f2a9bb91640 1 --2- 172.21.15.148:0/3368901402 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a94102290 0x7f2a941a6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.769 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.766+0000 7f2a9bb91640 1 --2- 172.21.15.148:0/3368901402 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a941080f0 0x7f2a94101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.769 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.766+0000 7f2a9bb91640 1 --2- 172.21.15.148:0/3368901402 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a941008a0 0x7f2a94101810 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.769 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.766+0000 7f2a9bb91640 1 -- 172.21.15.148:0/3368901402 >> 172.21.15.148:0/3368901402 conn(0x7f2a94075ef0 msgr2=0x7f2a940ff670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:49.769 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.766+0000 7f2a9bb91640 1 -- 172.21.15.148:0/3368901402 shutdown_connections 2024-09-19T07:23:49.769 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:23:49.766+0000 7f2a9bb91640 1 -- 172.21.15.148:0/3368901402 wait complete. 2024-09-19T07:23:51.441 INFO:tasks.workunit.client.0.smithi148.stdout: 2024-09-19T07:23:51.441 INFO:tasks.workunit.client.0.smithi148.stdout:Final score for writes: 409 2024-09-19T07:23:51.441 INFO:tasks.workunit.client.0.smithi148.stdout:Final score for reads : 604960 2024-09-19T07:23:51.441 INFO:tasks.workunit.client.0.smithi148.stdout: 2024-09-19T07:23:51.442 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T07:23:51.443 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T07:23:51.510 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:23:51 smithi148 ceph-mon[31180]: pgmap v399: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 37 KiB/s wr, 14 op/s 2024-09-19T07:23:51.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:23:51 smithi179 ceph-mon[35716]: pgmap v399: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 37 KiB/s wr, 14 op/s 2024-09-19T07:23:51.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:23:51 smithi165 ceph-mon[35326]: pgmap v399: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 37 KiB/s wr, 14 op/s 2024-09-19T07:23:53.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:23:53 smithi179 ceph-mon[35716]: pgmap v400: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 43 KiB/s wr, 18 op/s 2024-09-19T07:23:53.582 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:23:53 smithi148 ceph-mon[31180]: pgmap v400: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 43 KiB/s wr, 18 op/s 2024-09-19T07:23:53.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:23:53 smithi165 ceph-mon[35326]: pgmap v400: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 43 KiB/s wr, 18 op/s 2024-09-19T07:23:55.434 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:23:55 smithi165 ceph-mon[35326]: pgmap v401: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 29 KiB/s wr, 19 op/s 2024-09-19T07:23:55.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:23:55 smithi179 ceph-mon[35716]: pgmap v401: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 29 KiB/s wr, 19 op/s 2024-09-19T07:23:55.582 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:23:55 smithi148 ceph-mon[31180]: pgmap v401: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 29 KiB/s wr, 19 op/s 2024-09-19T07:23:57.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:23:57 smithi179 ceph-mon[35716]: pgmap v402: 97 pgs: 97 active+clean; 1.7 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 656 KiB/s rd, 995 KiB/s wr, 99 op/s 2024-09-19T07:23:57.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:23:57 smithi148 ceph-mon[31180]: pgmap v402: 97 pgs: 97 active+clean; 1.7 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 656 KiB/s rd, 995 KiB/s wr, 99 op/s 2024-09-19T07:23:57.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:23:57 smithi165 ceph-mon[35326]: pgmap v402: 97 pgs: 97 active+clean; 1.7 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 656 KiB/s rd, 995 KiB/s wr, 99 op/s 2024-09-19T07:23:59.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:23:59 smithi179 ceph-mon[35716]: pgmap v403: 97 pgs: 97 active+clean; 1.7 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 984 KiB/s wr, 94 op/s 2024-09-19T07:23:59.582 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:23:59 smithi148 ceph-mon[31180]: pgmap v403: 97 pgs: 97 active+clean; 1.7 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 984 KiB/s wr, 94 op/s 2024-09-19T07:23:59.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:23:59 smithi165 ceph-mon[35326]: pgmap v403: 97 pgs: 97 active+clean; 1.7 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 984 KiB/s wr, 94 op/s 2024-09-19T07:24:01.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:24:01 smithi179 ceph-mon[35716]: pgmap v404: 97 pgs: 97 active+clean; 1.7 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 1.1 MiB/s wr, 138 op/s 2024-09-19T07:24:01.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:24:01 smithi148 ceph-mon[31180]: pgmap v404: 97 pgs: 97 active+clean; 1.7 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 1.1 MiB/s wr, 138 op/s 2024-09-19T07:24:01.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:24:01 smithi165 ceph-mon[35326]: pgmap v404: 97 pgs: 97 active+clean; 1.7 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 1.1 MiB/s wr, 138 op/s 2024-09-19T07:24:02.865 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.862+0000 7f3b47354640 1 -- 172.21.15.148:0/1646558449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b401070d0 msgr2=0x7f3b40112580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:02.865 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.862+0000 7f3b47354640 1 --2- 172.21.15.148:0/1646558449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b401070d0 0x7f3b40112580 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f3b30009900 tx=0x7f3b3002a410 comp rx=0 tx=0).stop 2024-09-19T07:24:02.865 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.862+0000 7f3b47354640 1 -- 172.21.15.148:0/1646558449 shutdown_connections 2024-09-19T07:24:02.866 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.862+0000 7f3b47354640 1 --2- 172.21.15.148:0/1646558449 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b40112ac0 0x7f3b40114eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.866 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.862+0000 7f3b47354640 1 --2- 172.21.15.148:0/1646558449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b401070d0 0x7f3b40112580 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.866 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.862+0000 7f3b47354640 1 --2- 172.21.15.148:0/1646558449 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b401067b0 0x7f3b40106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.866 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.862+0000 7f3b47354640 1 -- 172.21.15.148:0/1646558449 >> 172.21.15.148:0/1646558449 conn(0x7f3b40075e20 msgr2=0x7f3b40076230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:02.866 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.863+0000 7f3b47354640 1 -- 172.21.15.148:0/1646558449 shutdown_connections 2024-09-19T07:24:02.866 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.863+0000 7f3b47354640 1 -- 172.21.15.148:0/1646558449 wait complete. 2024-09-19T07:24:02.866 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.863+0000 7f3b47354640 1 Processor -- start 2024-09-19T07:24:02.866 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.863+0000 7f3b47354640 1 -- start start 2024-09-19T07:24:02.866 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.863+0000 7f3b47354640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b401067b0 0x7f3b401a4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:02.866 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.863+0000 7f3b47354640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b401070d0 0x7f3b401a4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:02.866 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.864+0000 7f3b47354640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b40112ac0 0x7f3b4019e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:02.866 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.864+0000 7f3b47354640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3b40118530 con 0x7f3b40112ac0 2024-09-19T07:24:02.867 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.864+0000 7f3b47354640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3b401183b0 con 0x7f3b401067b0 2024-09-19T07:24:02.867 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.864+0000 7f3b47354640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3b401186b0 con 0x7f3b401070d0 2024-09-19T07:24:02.867 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.864+0000 7f3b458f1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b40112ac0 0x7f3b4019e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:02.867 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.864+0000 7f3b450f0640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b401067b0 0x7f3b401a4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:02.867 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.864+0000 7f3b458f1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b40112ac0 0x7f3b4019e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34518/0 (socket says 172.21.15.148:34518) 2024-09-19T07:24:02.867 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.864+0000 7f3b458f1640 1 -- 172.21.15.148:0/172575946 learned_addr learned my addr 172.21.15.148:0/172575946 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:24:02.867 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.864+0000 7f3b448ef640 1 --2- 172.21.15.148:0/172575946 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b401070d0 0x7f3b401a4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:02.867 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.864+0000 7f3b458f1640 1 -- 172.21.15.148:0/172575946 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b401070d0 msgr2=0x7f3b401a4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:02.867 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.864+0000 7f3b458f1640 1 --2- 172.21.15.148:0/172575946 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b401070d0 0x7f3b401a4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.867 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.864+0000 7f3b458f1640 1 -- 172.21.15.148:0/172575946 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b401067b0 msgr2=0x7f3b401a4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:02.867 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.864+0000 7f3b458f1640 1 --2- 172.21.15.148:0/172575946 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b401067b0 0x7f3b401a4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.867 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.864+0000 7f3b458f1640 1 -- 172.21.15.148:0/172575946 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b4019efd0 con 0x7f3b40112ac0 2024-09-19T07:24:02.868 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.864+0000 7f3b450f0640 1 --2- 172.21.15.148:0/172575946 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b401067b0 0x7f3b401a4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:24:02.868 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.864+0000 7f3b458f1640 1 --2- 172.21.15.148:0/172575946 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b40112ac0 0x7f3b4019e800 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f3b3800cab0 tx=0x7f3b3800cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:02.868 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.864+0000 7f3b367fc640 1 -- 172.21.15.148:0/172575946 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3800ae20 con 0x7f3b40112ac0 2024-09-19T07:24:02.868 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.864+0000 7f3b47354640 1 -- 172.21.15.148:0/172575946 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b4019f2c0 con 0x7f3b40112ac0 2024-09-19T07:24:02.868 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.864+0000 7f3b367fc640 1 -- 172.21.15.148:0/172575946 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b3800f930 con 0x7f3b40112ac0 2024-09-19T07:24:02.868 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.864+0000 7f3b367fc640 1 -- 172.21.15.148:0/172575946 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b38018b80 con 0x7f3b40112ac0 2024-09-19T07:24:02.868 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.864+0000 7f3b47354640 1 -- 172.21.15.148:0/172575946 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b401ab4e0 con 0x7f3b40112ac0 2024-09-19T07:24:02.877 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.867+0000 7f3b367fc640 1 -- 172.21.15.148:0/172575946 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f3b3800fae0 con 0x7f3b40112ac0 2024-09-19T07:24:02.877 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.867+0000 7f3b4a1c8740 1 Processor -- start 2024-09-19T07:24:02.877 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.867+0000 7f3b4a1c8740 1 -- start start 2024-09-19T07:24:02.877 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.867+0000 7f3b4a1c8740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a22febaaf0 0x55a22febaed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:02.877 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.867+0000 7f3b4a1c8740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a22febb410 0x55a22fec5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:02.877 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.867+0000 7f3b4a1c8740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a22fec5cb0 0x55a22fec80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:02.877 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.867+0000 7f3b4a1c8740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55a22fe1f2f0 con 0x55a22fec5cb0 2024-09-19T07:24:02.877 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.867+0000 7f3b4a1c8740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55a22fdc7270 con 0x55a22febaaf0 2024-09-19T07:24:02.877 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.867+0000 7f3b4a1c8740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a22fe1b2b0 con 0x55a22febb410 2024-09-19T07:24:02.877 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.868+0000 7f3b367fc640 1 --2- 172.21.15.148:0/172575946 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f3b2c0a3460 0x7f3b2c0a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:02.878 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.868+0000 7f3b448ef640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a22fec5cb0 0x55a22fec80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:02.878 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.868+0000 7f3b448ef640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a22fec5cb0 0x55a22fec80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34526/0 (socket says 172.21.15.148:34526) 2024-09-19T07:24:02.878 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.868+0000 7f3b448ef640 1 -- 172.21.15.148:0/815518713 learned_addr learned my addr 172.21.15.148:0/815518713 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:24:02.878 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.868+0000 7f3b450f0640 1 --2- 172.21.15.148:0/815518713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a22febb410 0x55a22fec5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:02.878 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.868+0000 7f3b448ef640 1 --2- 172.21.15.148:0/815518713 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a22febaaf0 0x55a22febaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:02.878 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.868+0000 7f3b458f1640 1 --2- 172.21.15.148:0/172575946 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f3b2c0a3460 0x7f3b2c0a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:02.878 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.868+0000 7f3b367fc640 1 -- 172.21.15.148:0/172575946 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8556+0+0 (secure 0 0 0) 0x7f3b380d0040 con 0x7f3b40112ac0 2024-09-19T07:24:02.878 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.868+0000 7f3b448ef640 1 -- 172.21.15.148:0/815518713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a22febb410 msgr2=0x55a22fec5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:02.878 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.868+0000 7f3b448ef640 1 --2- 172.21.15.148:0/815518713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a22febb410 0x55a22fec5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.878 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.868+0000 7f3b448ef640 1 -- 172.21.15.148:0/815518713 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a22febaaf0 msgr2=0x55a22febaed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:02.878 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.868+0000 7f3b448ef640 1 --2- 172.21.15.148:0/815518713 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a22febaaf0 0x55a22febaed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.878 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.868+0000 7f3b448ef640 1 -- 172.21.15.148:0/815518713 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a22fdc6340 con 0x55a22fec5cb0 2024-09-19T07:24:02.878 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.868+0000 7f3b448ef640 1 --2- 172.21.15.148:0/815518713 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a22fec5cb0 0x55a22fec80a0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f3b30031550 tx=0x7f3b3002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ded1c03ebe054442 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:02.879 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.869+0000 7f3b458f1640 1 --2- 172.21.15.148:0/172575946 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f3b2c0a3460 0x7f3b2c0a5920 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3b3809c290 tx=0x7f3b3806f130 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:02.879 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.869+0000 7f3b2b7fe640 1 -- 172.21.15.148:0/815518713 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b30035040 con 0x55a22fec5cb0 2024-09-19T07:24:02.879 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.869+0000 7f3b2b7fe640 1 -- 172.21.15.148:0/815518713 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b300038c0 con 0x55a22fec5cb0 2024-09-19T07:24:02.879 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.869+0000 7f3b2b7fe640 1 -- 172.21.15.148:0/815518713 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b300049b0 con 0x55a22fec5cb0 2024-09-19T07:24:02.879 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.869+0000 7f3b4a1c8740 1 -- 172.21.15.148:0/815518713 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a22fec5cb0 msgr2=0x55a22fec80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:02.879 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.869+0000 7f3b4a1c8740 1 --2- 172.21.15.148:0/815518713 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a22fec5cb0 0x55a22fec80a0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f3b30031550 tx=0x7f3b3002a410 comp rx=0 tx=0).stop 2024-09-19T07:24:02.879 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.869+0000 7f3b4a1c8740 1 -- 172.21.15.148:0/815518713 shutdown_connections 2024-09-19T07:24:02.879 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.869+0000 7f3b4a1c8740 1 --2- 172.21.15.148:0/815518713 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a22fec5cb0 0x55a22fec80a0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.879 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.869+0000 7f3b4a1c8740 1 --2- 172.21.15.148:0/815518713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a22febb410 0x55a22fec5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.879 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.869+0000 7f3b4a1c8740 1 --2- 172.21.15.148:0/815518713 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a22febaaf0 0x55a22febaed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.879 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.869+0000 7f3b4a1c8740 1 -- 172.21.15.148:0/815518713 >> 172.21.15.148:0/815518713 conn(0x55a22feb7060 msgr2=0x55a22feb7440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:02.879 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.870+0000 7f3b4a1c8740 1 -- 172.21.15.148:0/815518713 shutdown_connections 2024-09-19T07:24:02.879 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.870+0000 7f3b4a1c8740 1 -- 172.21.15.148:0/815518713 wait complete. 2024-09-19T07:24:02.880 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.870+0000 7f3b4a1c8740 1 -- start start 2024-09-19T07:24:02.880 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.870+0000 7f3b4a1c8740 1 Processor -- start 2024-09-19T07:24:02.880 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.870+0000 7f3b4a1c8740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a22febaaf0 0x55a22fec2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:02.880 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.870+0000 7f3b4a1c8740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a22febb410 0x55a22fec3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:02.880 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.870+0000 7f3b4a1c8740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a22fec5cb0 0x55a22fec3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:02.880 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.870+0000 7f3b4a1c8740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55a22fec8880 con 0x55a22fec5cb0 2024-09-19T07:24:02.880 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.870+0000 7f3b4a1c8740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55a22fda8290 con 0x55a22febb410 2024-09-19T07:24:02.880 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.870+0000 7f3b4a1c8740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a22fec8a00 con 0x55a22febaaf0 2024-09-19T07:24:02.880 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.871+0000 7f3b4a1c8740 10 client.0 _ll_register_callbacks cb 0x55a22fdd9140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:24:02.880 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.871+0000 7f3b448ef640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a22fec5cb0 0x55a22fec3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:02.880 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.871+0000 7f3b450f0640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a22febb410 0x55a22fec3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:02.880 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.871+0000 7f3b448ef640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a22fec5cb0 0x55a22fec3650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34528/0 (socket says 172.21.15.148:34528) 2024-09-19T07:24:02.880 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.871+0000 7f3b448ef640 1 -- 172.21.15.148:0/2345043419 learned_addr learned my addr 172.21.15.148:0/2345043419 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:24:02.881 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.871+0000 7f3b448ef640 1 --2- 172.21.15.148:0/2345043419 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a22febaaf0 0x55a22fec2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:02.881 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.871+0000 7f3b450f0640 1 -- 172.21.15.148:0/2345043419 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a22febaaf0 msgr2=0x55a22fec2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:02.881 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.871+0000 7f3b450f0640 1 --2- 172.21.15.148:0/2345043419 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a22febaaf0 0x55a22fec2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.881 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.871+0000 7f3b450f0640 1 -- 172.21.15.148:0/2345043419 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a22fec5cb0 msgr2=0x55a22fec3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:02.881 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.871+0000 7f3b450f0640 1 --2- 172.21.15.148:0/2345043419 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a22fec5cb0 0x55a22fec3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.881 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.871+0000 7f3b450f0640 1 -- 172.21.15.148:0/2345043419 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a22fb32210 con 0x55a22febb410 2024-09-19T07:24:02.881 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.871+0000 7f3b448ef640 1 --2- 172.21.15.148:0/2345043419 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a22fec5cb0 0x55a22fec3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:24:02.881 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.871+0000 7f3b450f0640 1 --2- 172.21.15.148:0/2345043419 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a22febb410 0x55a22fec3110 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c011710 tx=0x7f3b3c011bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84c4fd18ae770650 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:02.881 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.871+0000 7f3b28ff9640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-19T07:24:02.881 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.871+0000 7f3b28ff9640 1 -- 172.21.15.148:0/2345043419 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c010ba0 con 0x55a22febb410 2024-09-19T07:24:02.881 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.871+0000 7f3b4a1c8740 1 -- 172.21.15.148:0/2345043419 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b300038c0 con 0x55a22febb410 2024-09-19T07:24:02.881 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.871+0000 7f3b28ff9640 1 -- 172.21.15.148:0/2345043419 <== mon.2 v2:172.21.15.165:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8556+0+0 (secure 0 0 0) 0x7f3b3c010d40 con 0x55a22febb410 2024-09-19T07:24:02.881 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.872+0000 7f3b28ff9640 1 -- 172.21.15.148:0/2345043419 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f3b3c004020 con 0x55a22febb410 2024-09-19T07:24:02.882 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.872+0000 7f3b4a1c8740 10 client.26399 fetch_fsmap learned FSMap version 47 2024-09-19T07:24:02.882 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.872+0000 7f3b4a1c8740 1 -- 172.21.15.148:0/2345043419 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55a22fbfe620 con 0x55a22febb410 2024-09-19T07:24:02.882 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.872+0000 7f3b28ff9640 1 -- 172.21.15.148:0/2345043419 <== mon.2 v2:172.21.15.165:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b300038c0 con 0x55a22febb410 2024-09-19T07:24:02.882 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.872+0000 7f3b28ff9640 1 -- 172.21.15.148:0/2345043419 <== mon.2 v2:172.21.15.165:3300/0 5 ==== fsmap(e 47) ==== 8354+0+0 (secure 0 0 0) 0x7f3b3c0048a0 con 0x55a22febb410 2024-09-19T07:24:02.882 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.872+0000 7f3b4a1c8740 10 client.26399 fetch_fsmap finished waiting for FSMap version 47 2024-09-19T07:24:02.882 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.872+0000 7f3b4a1c8740 10 client.26399 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:24:02.882 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.872+0000 7f3b4a1c8740 20 client.26399 populate_metadata read hostname 'smithi148' 2024-09-19T07:24:02.882 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.872+0000 7f3b4a1c8740 1 --2- 172.21.15.148:0/2345043419 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55a22fed5d80 0x55a22fed81a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:02.882 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.872+0000 7f3b4a1c8740 4 client.26399 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:24:02.882 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.872+0000 7f3b4a1c8740 1 -- 172.21.15.148:0/2345043419 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a22fe2ca20 con 0x55a22fed5d80 2024-09-19T07:24:02.882 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.872+0000 7f3b448ef640 1 --2- 172.21.15.148:0/2345043419 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55a22fed5d80 0x55a22fed81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:02.882 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.873+0000 7f3b28ff9640 10 client.26399 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:24:02.882 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.873+0000 7f3b448ef640 1 --2- 172.21.15.148:0/2345043419 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55a22fed5d80 0x55a22fed81a0 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=831a0f6f3b70951b server_cookie=f7afed121f2e8d67 in_seq=0 out_seq=0 2024-09-19T07:24:02.883 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.874+0000 7f3b28ff9640 1 -- 172.21.15.148:0/2345043419 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a22fe2ca20 con 0x55a22fed5d80 2024-09-19T07:24:02.883 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.874+0000 7f3b28ff9640 10 client.26399 handle_command_reply: tid=0 2024-09-19T07:24:02.883 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.874+0000 7f3b4a1c8740 1 client.26399 shutdown 2024-09-19T07:24:02.883 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.874+0000 7f3b4a1c8740 1 -- 172.21.15.148:0/2345043419 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a22febb410 msgr2=0x55a22fec3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:02.883 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.874+0000 7f3b4a1c8740 1 --2- 172.21.15.148:0/2345043419 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a22febb410 0x55a22fec3110 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c011710 tx=0x7f3b3c011bd0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.883 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.874+0000 7f3b4a1c8740 1 -- 172.21.15.148:0/2345043419 shutdown_connections 2024-09-19T07:24:02.883 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.874+0000 7f3b4a1c8740 1 --2- 172.21.15.148:0/2345043419 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55a22fed5d80 0x55a22fed81a0 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.883 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.874+0000 7f3b4a1c8740 1 --2- 172.21.15.148:0/2345043419 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a22fec5cb0 0x55a22fec3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.883 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.874+0000 7f3b4a1c8740 1 --2- 172.21.15.148:0/2345043419 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a22febb410 0x55a22fec3110 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.883 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.874+0000 7f3b28ff9640 0 client.26399 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:24:02.883 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.874+0000 7f3b4a1c8740 1 --2- 172.21.15.148:0/2345043419 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a22febaaf0 0x55a22fec2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.883 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.874+0000 7f3b4a1c8740 1 -- 172.21.15.148:0/2345043419 >> 172.21.15.148:0/2345043419 conn(0x55a22feb7060 msgr2=0x55a22febcd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:02.883 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.874+0000 7f3b4a1c8740 1 -- 172.21.15.148:0/2345043419 shutdown_connections 2024-09-19T07:24:02.884 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.874+0000 7f3b4a1c8740 1 -- 172.21.15.148:0/2345043419 wait complete. 2024-09-19T07:24:02.884 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.874+0000 7f3b4a1c8740 20 client.26399 trim_cache size 0 max 16384 2024-09-19T07:24:02.890 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.888+0000 7f3b4a1c8740 1 Processor -- start 2024-09-19T07:24:02.891 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.888+0000 7f3b4a1c8740 1 -- start start 2024-09-19T07:24:02.891 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.889+0000 7f3b4a1c8740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a22febaaf0 0x55a22fec4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:02.891 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.889+0000 7f3b4a1c8740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a22febb410 0x55a22fec3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:02.891 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.889+0000 7f3b4a1c8740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a22fec5cb0 0x55a22fedda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:02.891 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.889+0000 7f3b4a1c8740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3b401b6760 con 0x55a22febaaf0 2024-09-19T07:24:02.891 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.889+0000 7f3b4a1c8740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3b401b3fd0 con 0x55a22fec5cb0 2024-09-19T07:24:02.891 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.889+0000 7f3b4a1c8740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3b401b1e40 con 0x55a22febb410 2024-09-19T07:24:02.891 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.889+0000 7f3b448ef640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a22febaaf0 0x55a22fec4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:02.891 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.889+0000 7f3b448ef640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a22febaaf0 0x55a22fec4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34530/0 (socket says 172.21.15.148:34530) 2024-09-19T07:24:02.891 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.889+0000 7f3b448ef640 1 -- 172.21.15.148:0/1853662282 learned_addr learned my addr 172.21.15.148:0/1853662282 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:24:02.891 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.889+0000 7f3b448ef640 1 -- 172.21.15.148:0/1853662282 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a22febb410 msgr2=0x55a22fec3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:02.892 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.889+0000 7f3b448ef640 1 --2- 172.21.15.148:0/1853662282 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a22febb410 0x55a22fec3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.892 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.889+0000 7f3b448ef640 1 -- 172.21.15.148:0/1853662282 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a22fec5cb0 msgr2=0x55a22fedda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:02.892 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.889+0000 7f3b448ef640 1 --2- 172.21.15.148:0/1853662282 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a22fec5cb0 0x55a22fedda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.892 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.889+0000 7f3b448ef640 1 -- 172.21.15.148:0/1853662282 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a22febb240 con 0x55a22febaaf0 2024-09-19T07:24:02.892 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.889+0000 7f3b448ef640 1 --2- 172.21.15.148:0/1853662282 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a22febaaf0 0x55a22fec4b40 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f3b30001eb0 tx=0x7f3b30005e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fd2f3552580801b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:02.892 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.889+0000 7f3b2affd640 1 -- 172.21.15.148:0/1853662282 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b30035040 con 0x55a22febaaf0 2024-09-19T07:24:02.892 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.889+0000 7f3b2affd640 1 -- 172.21.15.148:0/1853662282 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b300046c0 con 0x55a22febaaf0 2024-09-19T07:24:02.892 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.889+0000 7f3b2affd640 1 -- 172.21.15.148:0/1853662282 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b300318f0 con 0x55a22febaaf0 2024-09-19T07:24:02.892 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.890+0000 7f3b4a1c8740 1 -- 172.21.15.148:0/1853662282 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a22febaaf0 msgr2=0x55a22fec4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:02.892 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.890+0000 7f3b4a1c8740 1 --2- 172.21.15.148:0/1853662282 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a22febaaf0 0x55a22fec4b40 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f3b30001eb0 tx=0x7f3b30005e10 comp rx=0 tx=0).stop 2024-09-19T07:24:02.892 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.890+0000 7f3b4a1c8740 1 -- 172.21.15.148:0/1853662282 shutdown_connections 2024-09-19T07:24:02.892 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.890+0000 7f3b4a1c8740 1 --2- 172.21.15.148:0/1853662282 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a22fec5cb0 0x55a22fedda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.892 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.890+0000 7f3b4a1c8740 1 --2- 172.21.15.148:0/1853662282 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a22febb410 0x55a22fec3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.893 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.890+0000 7f3b4a1c8740 1 --2- 172.21.15.148:0/1853662282 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a22febaaf0 0x55a22fec4b40 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.893 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.890+0000 7f3b4a1c8740 1 -- 172.21.15.148:0/1853662282 >> 172.21.15.148:0/1853662282 conn(0x55a22feb7060 msgr2=0x55a22fec4430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:02.893 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.890+0000 7f3b4a1c8740 1 -- 172.21.15.148:0/1853662282 shutdown_connections 2024-09-19T07:24:02.893 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.890+0000 7f3b4a1c8740 1 -- 172.21.15.148:0/1853662282 wait complete. 2024-09-19T07:24:02.893 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.890+0000 7f3b4a1c8740 1 -- start start 2024-09-19T07:24:02.893 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.890+0000 7f3b4a1c8740 1 Processor -- start 2024-09-19T07:24:02.898 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.891+0000 7f3b4a1c8740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a22febaaf0 0x55a22fec9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:02.898 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.891+0000 7f3b4a1c8740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a22febb410 0x55a22fec9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:02.898 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.891+0000 7f3b4a1c8740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a22fec5cb0 0x55a22ff3ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:02.898 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.891+0000 7f3b4a1c8740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3b401b2490 con 0x55a22febaaf0 2024-09-19T07:24:02.898 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.891+0000 7f3b4a1c8740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3b401b3900 con 0x55a22fec5cb0 2024-09-19T07:24:02.898 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.891+0000 7f3b4a1c8740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3b401b2b60 con 0x55a22febb410 2024-09-19T07:24:02.898 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.891+0000 7f3b4a1c8740 10 client.0 _ll_register_callbacks cb 0x7f3b3c00bbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:24:02.898 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.891+0000 7f3b448ef640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a22febaaf0 0x55a22fec9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:02.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.891+0000 7f3b448ef640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a22febaaf0 0x55a22fec9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34542/0 (socket says 172.21.15.148:34542) 2024-09-19T07:24:02.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.891+0000 7f3b448ef640 1 -- 172.21.15.148:0/1116115966 learned_addr learned my addr 172.21.15.148:0/1116115966 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:24:02.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.891+0000 7f3b450f0640 1 --2- 172.21.15.148:0/1116115966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a22febb410 0x55a22fec9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:02.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.891+0000 7f3b448ef640 1 -- 172.21.15.148:0/1116115966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a22febb410 msgr2=0x55a22fec9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:02.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.891+0000 7f3b448ef640 1 --2- 172.21.15.148:0/1116115966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a22febb410 0x55a22fec9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.891+0000 7f3b448ef640 1 -- 172.21.15.148:0/1116115966 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a22fec5cb0 msgr2=0x55a22ff3ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:02.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.891+0000 7f3b448ef640 1 --2- 172.21.15.148:0/1116115966 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a22fec5cb0 0x55a22ff3ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.891+0000 7f3b448ef640 1 -- 172.21.15.148:0/1116115966 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a22ff3ef70 con 0x55a22febaaf0 2024-09-19T07:24:02.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.891+0000 7f3b448ef640 1 --2- 172.21.15.148:0/1116115966 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a22febaaf0 0x55a22fec9040 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f3b30004220 tx=0x7f3b30004380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d12e36ac1d5938c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:02.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.891+0000 7f3b28ff9640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:24:02.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.891+0000 7f3b28ff9640 1 -- 172.21.15.148:0/1116115966 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b30035040 con 0x55a22febaaf0 2024-09-19T07:24:02.899 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.891+0000 7f3b28ff9640 1 -- 172.21.15.148:0/1116115966 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8556+0+0 (secure 0 0 0) 0x7f3b30004f90 con 0x55a22febaaf0 2024-09-19T07:24:02.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.891+0000 7f3b4a1c8740 1 -- 172.21.15.148:0/1116115966 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b300046c0 con 0x55a22febaaf0 2024-09-19T07:24:02.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.892+0000 7f3b28ff9640 1 -- 172.21.15.148:0/1116115966 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f3b30005190 con 0x55a22febaaf0 2024-09-19T07:24:02.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.892+0000 7f3b4a1c8740 10 client.17304 fetch_fsmap learned FSMap version 47 2024-09-19T07:24:02.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.892+0000 7f3b4a1c8740 1 -- 172.21.15.148:0/1116115966 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55a22ff40140 con 0x55a22febaaf0 2024-09-19T07:24:02.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.892+0000 7f3b28ff9640 1 -- 172.21.15.148:0/1116115966 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b300046c0 con 0x55a22febaaf0 2024-09-19T07:24:02.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.892+0000 7f3b28ff9640 1 -- 172.21.15.148:0/1116115966 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 47) ==== 8354+0+0 (secure 0 0 0) 0x7f3b3003a040 con 0x55a22febaaf0 2024-09-19T07:24:02.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.892+0000 7f3b4a1c8740 10 client.17304 fetch_fsmap finished waiting for FSMap version 47 2024-09-19T07:24:02.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.892+0000 7f3b4a1c8740 10 client.17304 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:24:02.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.892+0000 7f3b4a1c8740 20 client.17304 populate_metadata read hostname 'smithi148' 2024-09-19T07:24:02.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.892+0000 7f3b4a1c8740 1 --2- 172.21.15.148:0/1116115966 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55a22ff40310 0x55a22ff42700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:02.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.892+0000 7f3b4a1c8740 4 client.17304 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:24:02.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.892+0000 7f3b4a1c8740 1 -- 172.21.15.148:0/1116115966 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a22fe26d70 con 0x55a22ff40310 2024-09-19T07:24:02.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.892+0000 7f3b450f0640 1 --2- 172.21.15.148:0/1116115966 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55a22ff40310 0x55a22ff42700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:02.901 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.893+0000 7f3b450f0640 1 --2- 172.21.15.148:0/1116115966 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55a22ff40310 0x55a22ff42700 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9529c96480250919 server_cookie=6e5fa0b856e4984b in_seq=0 out_seq=0 2024-09-19T07:24:02.901 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.893+0000 7f3b28ff9640 10 client.17304 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:24:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.904+0000 7f3b28ff9640 1 -- 172.21.15.148:0/1116115966 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a22fe26d70 con 0x55a22ff40310 2024-09-19T07:24:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.904+0000 7f3b28ff9640 10 client.17304 handle_command_reply: tid=0 2024-09-19T07:24:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.904+0000 7f3b4a1c8740 1 client.17304 shutdown 2024-09-19T07:24:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.904+0000 7f3b4a1c8740 1 -- 172.21.15.148:0/1116115966 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a22febaaf0 msgr2=0x55a22fec9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.904+0000 7f3b4a1c8740 1 --2- 172.21.15.148:0/1116115966 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a22febaaf0 0x55a22fec9040 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f3b30004220 tx=0x7f3b30004380 comp rx=0 tx=0).stop 2024-09-19T07:24:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.904+0000 7f3b4a1c8740 1 -- 172.21.15.148:0/1116115966 shutdown_connections 2024-09-19T07:24:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.904+0000 7f3b4a1c8740 1 --2- 172.21.15.148:0/1116115966 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55a22ff40310 0x55a22ff42700 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.904+0000 7f3b4a1c8740 1 --2- 172.21.15.148:0/1116115966 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a22fec5cb0 0x55a22ff3ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.904+0000 7f3b4a1c8740 1 --2- 172.21.15.148:0/1116115966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a22febb410 0x55a22fec9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.904+0000 7f3b28ff9640 0 client.17304 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:24:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.904+0000 7f3b4a1c8740 1 --2- 172.21.15.148:0/1116115966 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a22febaaf0 0x55a22fec9040 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.906 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.904+0000 7f3b4a1c8740 1 -- 172.21.15.148:0/1116115966 >> 172.21.15.148:0/1116115966 conn(0x55a22feb7060 msgr2=0x55a22feb61c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:02.906 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.904+0000 7f3b4a1c8740 1 -- 172.21.15.148:0/1116115966 shutdown_connections 2024-09-19T07:24:02.906 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.904+0000 7f3b4a1c8740 1 -- 172.21.15.148:0/1116115966 wait complete. 2024-09-19T07:24:02.906 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.904+0000 7f3b4a1c8740 20 client.17304 trim_cache size 0 max 16384 2024-09-19T07:24:02.906 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:24:02.906 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:24:02.906 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:24:02.906 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:24:02.907 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.905+0000 7f3b47354640 1 -- 172.21.15.148:0/172575946 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f3b2c0a3460 msgr2=0x7f3b2c0a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:02.907 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.905+0000 7f3b47354640 1 --2- 172.21.15.148:0/172575946 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f3b2c0a3460 0x7f3b2c0a5920 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3b3809c290 tx=0x7f3b3806f130 comp rx=0 tx=0).stop 2024-09-19T07:24:02.907 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.905+0000 7f3b47354640 1 -- 172.21.15.148:0/172575946 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b40112ac0 msgr2=0x7f3b4019e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:02.907 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.905+0000 7f3b47354640 1 --2- 172.21.15.148:0/172575946 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b40112ac0 0x7f3b4019e800 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f3b3800cab0 tx=0x7f3b3800cf70 comp rx=0 tx=0).stop 2024-09-19T07:24:02.907 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.905+0000 7f3b47354640 1 -- 172.21.15.148:0/172575946 shutdown_connections 2024-09-19T07:24:02.908 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.905+0000 7f3b47354640 1 --2- 172.21.15.148:0/172575946 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f3b2c0a3460 0x7f3b2c0a5920 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.908 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.905+0000 7f3b47354640 1 --2- 172.21.15.148:0/172575946 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b40112ac0 0x7f3b4019e800 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.908 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.905+0000 7f3b47354640 1 --2- 172.21.15.148:0/172575946 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b401070d0 0x7f3b401a4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.908 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.905+0000 7f3b47354640 1 --2- 172.21.15.148:0/172575946 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b401067b0 0x7f3b401a4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.908 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.905+0000 7f3b47354640 1 -- 172.21.15.148:0/172575946 >> 172.21.15.148:0/172575946 conn(0x7f3b40075e20 msgr2=0x7f3b40112ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:02.908 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.905+0000 7f3b47354640 1 -- 172.21.15.148:0/172575946 shutdown_connections 2024-09-19T07:24:02.908 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:02.905+0000 7f3b47354640 1 -- 172.21.15.148:0/172575946 wait complete. 2024-09-19T07:24:03.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:24:03 smithi179 ceph-mon[35716]: pgmap v405: 97 pgs: 97 active+clean; 1.7 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 321 op/s 2024-09-19T07:24:03.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:24:03 smithi148 ceph-mon[31180]: pgmap v405: 97 pgs: 97 active+clean; 1.7 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 321 op/s 2024-09-19T07:24:03.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:24:03 smithi165 ceph-mon[35326]: pgmap v405: 97 pgs: 97 active+clean; 1.7 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 321 op/s 2024-09-19T07:24:05.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:24:05 smithi179 ceph-mon[35716]: pgmap v406: 97 pgs: 97 active+clean; 1.7 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 366 op/s 2024-09-19T07:24:05.582 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:24:05 smithi148 ceph-mon[31180]: pgmap v406: 97 pgs: 97 active+clean; 1.7 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 366 op/s 2024-09-19T07:24:05.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:24:05 smithi165 ceph-mon[35326]: pgmap v406: 97 pgs: 97 active+clean; 1.7 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 366 op/s 2024-09-19T07:24:07.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:24:07 smithi179 ceph-mon[35716]: pgmap v407: 97 pgs: 97 active+clean; 1.7 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 431 op/s 2024-09-19T07:24:07.582 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:24:07 smithi148 ceph-mon[31180]: pgmap v407: 97 pgs: 97 active+clean; 1.7 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 431 op/s 2024-09-19T07:24:07.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:24:07 smithi165 ceph-mon[35326]: pgmap v407: 97 pgs: 97 active+clean; 1.7 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 431 op/s 2024-09-19T07:24:09.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:24:09 smithi179 ceph-mon[35716]: pgmap v408: 97 pgs: 97 active+clean; 1.7 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 351 op/s 2024-09-19T07:24:09.584 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:24:09 smithi148 ceph-mon[31180]: pgmap v408: 97 pgs: 97 active+clean; 1.7 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 351 op/s 2024-09-19T07:24:09.638 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:24:09 smithi165 ceph-mon[35326]: pgmap v408: 97 pgs: 97 active+clean; 1.7 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 351 op/s 2024-09-19T07:24:10.290 INFO:tasks.quiescer.fs.[cephfs]:Total duration (44.4) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T07:24:10.291 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 22.2 2024-09-19T07:24:10.291 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:24:10.546 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:24:11.327 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:24:11 smithi148 ceph-mon[31180]: pgmap v409: 97 pgs: 97 active+clean; 1.7 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 375 op/s 2024-09-19T07:24:11.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.363+0000 7f4403fff640 1 -- 172.21.15.148:0/3295681658 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f440402f340 con 0x7f440c11b140 2024-09-19T07:24:11.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.363+0000 7f441342d640 1 -- 172.21.15.148:0/3295681658 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f440c11b140 msgr2=0x7f440c11d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:11.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.363+0000 7f441342d640 1 --2- 172.21.15.148:0/3295681658 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f440c11b140 0x7f440c11d530 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f4404009ca0 tx=0x7f440402a8f0 comp rx=0 tx=0).stop 2024-09-19T07:24:11.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.364+0000 7f441342d640 1 -- 172.21.15.148:0/3295681658 shutdown_connections 2024-09-19T07:24:11.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.364+0000 7f441342d640 1 --2- 172.21.15.148:0/3295681658 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f440c11b140 0x7f440c11d530 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:11.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.364+0000 7f441342d640 1 --2- 172.21.15.148:0/3295681658 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f440c109830 0x7f440c109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:11.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.364+0000 7f441342d640 1 --2- 172.21.15.148:0/3295681658 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f440c109450 0x7f440c110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:11.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.364+0000 7f441342d640 1 -- 172.21.15.148:0/3295681658 >> 172.21.15.148:0/3295681658 conn(0x7f440c06e140 msgr2=0x7f440c06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:11.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.364+0000 7f441342d640 1 -- 172.21.15.148:0/3295681658 shutdown_connections 2024-09-19T07:24:11.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.365+0000 7f441342d640 1 -- 172.21.15.148:0/3295681658 wait complete. 2024-09-19T07:24:11.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.365+0000 7f441342d640 1 Processor -- start 2024-09-19T07:24:11.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.366+0000 7f441342d640 1 -- start start 2024-09-19T07:24:11.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.366+0000 7f441342d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f440c109450 0x7f440c1a7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:11.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.366+0000 7f441342d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f440c109830 0x7f440c1a78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:11.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.366+0000 7f441342d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f440c11b140 0x7f440c1abc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:11.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.366+0000 7f441342d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f440c120ed0 con 0x7f440c11b140 2024-09-19T07:24:11.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.366+0000 7f441342d640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f440c120d50 con 0x7f440c109830 2024-09-19T07:24:11.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.366+0000 7f441342d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f440c121050 con 0x7f440c109450 2024-09-19T07:24:11.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.366+0000 7f44119ca640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f440c11b140 0x7f440c1abc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:11.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.366+0000 7f44119ca640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f440c11b140 0x7f440c1abc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60166/0 (socket says 172.21.15.148:60166) 2024-09-19T07:24:11.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.366+0000 7f44119ca640 1 -- 172.21.15.148:0/1575593214 learned_addr learned my addr 172.21.15.148:0/1575593214 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:24:11.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.367+0000 7f44119ca640 1 -- 172.21.15.148:0/1575593214 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f440c109450 msgr2=0x7f440c1a7370 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T07:24:11.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.367+0000 7f44119ca640 1 --2- 172.21.15.148:0/1575593214 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f440c109450 0x7f440c1a7370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:11.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.367+0000 7f44119ca640 1 -- 172.21.15.148:0/1575593214 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f440c109830 msgr2=0x7f440c1a78b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T07:24:11.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.367+0000 7f44119ca640 1 --2- 172.21.15.148:0/1575593214 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f440c109830 0x7f440c1a78b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:11.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.367+0000 7f44119ca640 1 -- 172.21.15.148:0/1575593214 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f440c1ac320 con 0x7f440c11b140 2024-09-19T07:24:11.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.368+0000 7f44119ca640 1 --2- 172.21.15.148:0/1575593214 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f440c11b140 0x7f440c1abc40 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f4404030c60 tx=0x7f4404030c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:11.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.368+0000 7f44027fc640 1 -- 172.21.15.148:0/1575593214 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4404003b70 con 0x7f440c11b140 2024-09-19T07:24:11.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.368+0000 7f44027fc640 1 -- 172.21.15.148:0/1575593214 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f440402d070 con 0x7f440c11b140 2024-09-19T07:24:11.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.369+0000 7f44027fc640 1 -- 172.21.15.148:0/1575593214 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44040046e0 con 0x7f440c11b140 2024-09-19T07:24:11.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.373+0000 7f441342d640 1 -- 172.21.15.148:0/1575593214 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f440c1ac5b0 con 0x7f440c11b140 2024-09-19T07:24:11.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.373+0000 7f441342d640 1 -- 172.21.15.148:0/1575593214 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f440c1aca70 con 0x7f440c11b140 2024-09-19T07:24:11.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.378+0000 7f441342d640 1 -- 172.21.15.148:0/1575593214 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f440c073b00 con 0x7f440c11b140 2024-09-19T07:24:11.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.379+0000 7f44027fc640 1 -- 172.21.15.148:0/1575593214 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f4404031480 con 0x7f440c11b140 2024-09-19T07:24:11.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.380+0000 7f44027fc640 1 --2- 172.21.15.148:0/1575593214 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f43f80a33e0 0x7f43f80a58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:11.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.380+0000 7f44027fc640 1 -- 172.21.15.148:0/1575593214 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8600+0+0 (secure 0 0 0) 0x7f44040f1260 con 0x7f440c11b140 2024-09-19T07:24:11.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.381+0000 7f44111c9640 1 --2- 172.21.15.148:0/1575593214 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f43f80a33e0 0x7f43f80a58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:11.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.384+0000 7f44111c9640 1 --2- 172.21.15.148:0/1575593214 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f43f80a33e0 0x7f43f80a58a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f43fc009670 tx=0x7f43fc006bd0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:11.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.389+0000 7f44027fc640 1 -- 172.21.15.148:0/1575593214 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f440c1aca70 con 0x7f440c11b140 2024-09-19T07:24:11.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:24:11 smithi179 ceph-mon[35716]: pgmap v409: 97 pgs: 97 active+clean; 1.7 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 375 op/s 2024-09-19T07:24:11.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:24:11 smithi165 ceph-mon[35326]: pgmap v409: 97 pgs: 97 active+clean; 1.7 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 375 op/s 2024-09-19T07:24:11.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.793+0000 7f441342d640 1 -- 172.21.15.148:0/1575593214 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f440c10b420 con 0x7f440c11b140 2024-09-19T07:24:11.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.795+0000 7f44027fc640 1 -- 172.21.15.148:0/1575593214 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+11941 (secure 0 0 0) 0x7f440404a060 con 0x7f440c11b140 2024-09-19T07:24:11.796 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:24:11.797 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":47,"btime":"2024-09-19T07:23:26:615080+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/4263868576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":4263868576},{"type":"v1","addr":"172.21.15.148:6841","nonce":4263868576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":25606,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3891676893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3891676893},{"type":"v1","addr":"172.21.15.179:6835","nonce":3891676893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":47,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:09:19.543369+0000","modified":"2024-09-19T07:23:26.380794+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24457,"mds_1":24437,"mds_2":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":75,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":71,"addr":"172.21.15.165:6839/3993490234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":3993490234},{"type":"v1","addr":"172.21.15.165:6839","nonce":3993490234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25823":{"gid":25823,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6835/380886107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":380886107},{"type":"v1","addr":"172.21.15.165:6835","nonce":380886107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24457,"qdb_cluster":[24457,24437,24436]},"id":1}]} 2024-09-19T07:24:11.797 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 47 2024-09-19T07:24:11.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.800+0000 7f441342d640 1 -- 172.21.15.148:0/1575593214 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f43f80a33e0 msgr2=0x7f43f80a58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:11.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.800+0000 7f441342d640 1 --2- 172.21.15.148:0/1575593214 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f43f80a33e0 0x7f43f80a58a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f43fc009670 tx=0x7f43fc006bd0 comp rx=0 tx=0).stop 2024-09-19T07:24:11.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.800+0000 7f441342d640 1 -- 172.21.15.148:0/1575593214 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f440c11b140 msgr2=0x7f440c1abc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:11.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.800+0000 7f441342d640 1 --2- 172.21.15.148:0/1575593214 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f440c11b140 0x7f440c1abc40 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f4404030c60 tx=0x7f4404030c90 comp rx=0 tx=0).stop 2024-09-19T07:24:11.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.800+0000 7f441342d640 1 -- 172.21.15.148:0/1575593214 shutdown_connections 2024-09-19T07:24:11.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.800+0000 7f441342d640 1 --2- 172.21.15.148:0/1575593214 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f43f80a33e0 0x7f43f80a58a0 secure :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f43fc009670 tx=0x7f43fc006bd0 comp rx=0 tx=0).stop 2024-09-19T07:24:11.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.800+0000 7f441342d640 1 --2- 172.21.15.148:0/1575593214 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f440c11b140 0x7f440c1abc40 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:11.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.800+0000 7f441342d640 1 --2- 172.21.15.148:0/1575593214 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f440c109830 0x7f440c1a78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:11.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.800+0000 7f441342d640 1 --2- 172.21.15.148:0/1575593214 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f440c109450 0x7f440c1a7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:11.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.800+0000 7f441342d640 1 -- 172.21.15.148:0/1575593214 >> 172.21.15.148:0/1575593214 conn(0x7f440c06e140 msgr2=0x7f440c11bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:11.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.804+0000 7f441342d640 1 -- 172.21.15.148:0/1575593214 shutdown_connections 2024-09-19T07:24:11.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:11.804+0000 7f441342d640 1 -- 172.21.15.148:0/1575593214 wait complete. 2024-09-19T07:24:12.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:24:12 smithi179 ceph-mon[35716]: osdmap e95: 12 total, 12 up, 12 in 2024-09-19T07:24:12.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:24:12 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/1575593214' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:24:12.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:24:12 smithi148 ceph-mon[31180]: osdmap e95: 12 total, 12 up, 12 in 2024-09-19T07:24:12.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:24:12 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/1575593214' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:24:12.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:24:12 smithi165 ceph-mon[35326]: osdmap e95: 12 total, 12 up, 12 in 2024-09-19T07:24:12.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:24:12 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/1575593214' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:24:12.820 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24457 quiesce db / --timeout 90 --expiration 142.2 --await-for 45.0' 2024-09-19T07:24:12.821 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24457 quiesce db / --timeout 90 --expiration 142.2 --await-for 45.0 2024-09-19T07:24:13.184 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:24:13.342 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:24:13 smithi148 ceph-mon[31180]: pgmap v411: 97 pgs: 97 active+clean; 1.7 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 348 op/s 2024-09-19T07:24:13.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:24:13 smithi179 ceph-mon[35716]: pgmap v411: 97 pgs: 97 active+clean; 1.7 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 348 op/s 2024-09-19T07:24:13.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:24:13 smithi165 ceph-mon[35326]: pgmap v411: 97 pgs: 97 active+clean; 1.7 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 348 op/s 2024-09-19T07:24:13.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.753+0000 7fa21bc7c640 1 -- 172.21.15.148:0/2182939217 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa214102ef0 msgr2=0x7fa21410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:13.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.753+0000 7fa21bc7c640 1 --2- 172.21.15.148:0/2182939217 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa214102ef0 0x7fa21410da40 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fa20c009ca0 tx=0x7fa20c02a950 comp rx=0 tx=0).stop 2024-09-19T07:24:13.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.753+0000 7fa21bc7c640 1 -- 172.21.15.148:0/2182939217 shutdown_connections 2024-09-19T07:24:13.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.753+0000 7fa21bc7c640 1 --2- 172.21.15.148:0/2182939217 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa214102ef0 0x7fa21410da40 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.753+0000 7fa21bc7c640 1 --2- 172.21.15.148:0/2182939217 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa214102570 0x7fa2141029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.753+0000 7fa21bc7c640 1 --2- 172.21.15.148:0/2182939217 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa214100e20 0x7fa214101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.753+0000 7fa21bc7c640 1 -- 172.21.15.148:0/2182939217 >> 172.21.15.148:0/2182939217 conn(0x7fa2140fc7d0 msgr2=0x7fa2140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:13.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.753+0000 7fa21bc7c640 1 -- 172.21.15.148:0/2182939217 shutdown_connections 2024-09-19T07:24:13.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.753+0000 7fa21bc7c640 1 -- 172.21.15.148:0/2182939217 wait complete. 2024-09-19T07:24:13.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.754+0000 7fa21bc7c640 1 Processor -- start 2024-09-19T07:24:13.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.754+0000 7fa21bc7c640 1 -- start start 2024-09-19T07:24:13.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.754+0000 7fa21bc7c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa214100e20 0x7fa2141993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.754+0000 7fa21bc7c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa214102570 0x7fa214199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.754+0000 7fa21bc7c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa214102ef0 0x7fa214199e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.754+0000 7fa21bc7c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa214110f80 con 0x7fa214100e20 2024-09-19T07:24:13.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.754+0000 7fa21bc7c640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa214110e00 con 0x7fa214102570 2024-09-19T07:24:13.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.754+0000 7fa21bc7c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa214111100 con 0x7fa214102ef0 2024-09-19T07:24:13.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.755+0000 7fa219a18640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa214100e20 0x7fa2141993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.755+0000 7fa219a18640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa214100e20 0x7fa2141993d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60184/0 (socket says 172.21.15.148:60184) 2024-09-19T07:24:13.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.755+0000 7fa219a18640 1 -- 172.21.15.148:0/127514835 learned_addr learned my addr 172.21.15.148:0/127514835 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:24:13.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.755+0000 7fa219217640 1 --2- 172.21.15.148:0/127514835 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa214102570 0x7fa214199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.755+0000 7fa21a219640 1 --2- 172.21.15.148:0/127514835 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa214102ef0 0x7fa214199e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.755+0000 7fa219a18640 1 -- 172.21.15.148:0/127514835 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa214102ef0 msgr2=0x7fa214199e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:13.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.755+0000 7fa219a18640 1 --2- 172.21.15.148:0/127514835 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa214102ef0 0x7fa214199e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.755+0000 7fa219a18640 1 -- 172.21.15.148:0/127514835 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa214102570 msgr2=0x7fa214199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:13.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.755+0000 7fa219a18640 1 --2- 172.21.15.148:0/127514835 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa214102570 0x7fa214199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.755+0000 7fa219a18640 1 -- 172.21.15.148:0/127514835 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2141a47d0 con 0x7fa214100e20 2024-09-19T07:24:13.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.755+0000 7fa219a18640 1 --2- 172.21.15.148:0/127514835 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa214100e20 0x7fa2141993d0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fa21000d770 tx=0x7fa21000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:13.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.756+0000 7fa20affd640 1 -- 172.21.15.148:0/127514835 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa210017070 con 0x7fa214100e20 2024-09-19T07:24:13.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.756+0000 7fa21bc7c640 1 -- 172.21.15.148:0/127514835 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2141a4ac0 con 0x7fa214100e20 2024-09-19T07:24:13.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.756+0000 7fa20affd640 1 -- 172.21.15.148:0/127514835 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa210005500 con 0x7fa214100e20 2024-09-19T07:24:13.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.756+0000 7fa21bc7c640 1 -- 172.21.15.148:0/127514835 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2141a5000 con 0x7fa214100e20 2024-09-19T07:24:13.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.756+0000 7fa20affd640 1 -- 172.21.15.148:0/127514835 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa210004e00 con 0x7fa214100e20 2024-09-19T07:24:13.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.760+0000 7fa20affd640 1 -- 172.21.15.148:0/127514835 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fa210009c30 con 0x7fa214100e20 2024-09-19T07:24:13.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.760+0000 7fa21e055740 1 Processor -- start 2024-09-19T07:24:13.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.760+0000 7fa21e055740 1 -- start start 2024-09-19T07:24:13.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.760+0000 7fa21e055740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b2268d4760 0x55b2268d4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.761+0000 7fa21e055740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b2268d5080 0x55b2268df400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.761+0000 7fa21e055740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b2268df940 0x55b2268e1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.761+0000 7fa21e055740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55b22683a2a0 con 0x55b2268d4760 2024-09-19T07:24:13.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.761+0000 7fa21e055740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55b2267e1b10 con 0x55b2268df940 2024-09-19T07:24:13.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.761+0000 7fa21e055740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55b226836260 con 0x55b2268d5080 2024-09-19T07:24:13.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.761+0000 7fa20affd640 1 --2- 172.21.15.148:0/127514835 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fa2000a3430 0x7fa2000a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.761+0000 7fa21a219640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b2268d4760 0x55b2268d4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.761+0000 7fa21a219640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b2268d4760 0x55b2268d4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60188/0 (socket says 172.21.15.148:60188) 2024-09-19T07:24:13.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.761+0000 7fa21a219640 1 -- 172.21.15.148:0/2460233410 learned_addr learned my addr 172.21.15.148:0/2460233410 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:24:13.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.761+0000 7fa21a219640 1 --2- 172.21.15.148:0/127514835 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fa2000a3430 0x7fa2000a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.761+0000 7fa219217640 1 --2- 172.21.15.148:0/2460233410 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b2268df940 0x55b2268e1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.761+0000 7fa20affd640 1 -- 172.21.15.148:0/127514835 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8600+0+0 (secure 0 0 0) 0x7fa2100cf7d0 con 0x7fa214100e20 2024-09-19T07:24:13.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.761+0000 7fa219a18640 1 --2- 172.21.15.148:0/2460233410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b2268d5080 0x55b2268df400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.761+0000 7fa219a18640 1 -- 172.21.15.148:0/2460233410 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b2268df940 msgr2=0x55b2268e1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:13.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.761+0000 7fa219a18640 1 --2- 172.21.15.148:0/2460233410 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b2268df940 0x55b2268e1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.761+0000 7fa219a18640 1 -- 172.21.15.148:0/2460233410 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b2268d4760 msgr2=0x55b2268d4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:13.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.761+0000 7fa219a18640 1 --2- 172.21.15.148:0/2460233410 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b2268d4760 0x55b2268d4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.761+0000 7fa219a18640 1 -- 172.21.15.148:0/2460233410 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2265abb90 con 0x55b2268d5080 2024-09-19T07:24:13.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.761+0000 7fa219217640 1 --2- 172.21.15.148:0/2460233410 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b2268df940 0x55b2268e1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:24:13.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.761+0000 7fa21a219640 1 --2- 172.21.15.148:0/2460233410 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b2268d4760 0x55b2268d4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:24:13.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.762+0000 7fa219a18640 1 --2- 172.21.15.148:0/2460233410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b2268d5080 0x55b2268df400 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa2100cced0 tx=0x7fa21009c220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29e8678a8a2a7bd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:13.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.762+0000 7fa21a219640 1 --2- 172.21.15.148:0/127514835 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fa2000a3430 0x7fa2000a58f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa20c030040 tx=0x7fa20c0093f0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:13.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.762+0000 7fa1fffff640 1 -- 172.21.15.148:0/2460233410 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa210020070 con 0x55b2268d5080 2024-09-19T07:24:13.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.762+0000 7fa1fffff640 1 -- 172.21.15.148:0/2460233410 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa21009fe10 con 0x55b2268d5080 2024-09-19T07:24:13.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.762+0000 7fa1fffff640 1 -- 172.21.15.148:0/2460233410 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21009aeb0 con 0x55b2268d5080 2024-09-19T07:24:13.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.763+0000 7fa21e055740 1 -- 172.21.15.148:0/2460233410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b2268d5080 msgr2=0x55b2268df400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:13.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.763+0000 7fa21e055740 1 --2- 172.21.15.148:0/2460233410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b2268d5080 0x55b2268df400 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa2100cced0 tx=0x7fa21009c220 comp rx=0 tx=0).stop 2024-09-19T07:24:13.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.763+0000 7fa21e055740 1 -- 172.21.15.148:0/2460233410 shutdown_connections 2024-09-19T07:24:13.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.763+0000 7fa21e055740 1 --2- 172.21.15.148:0/2460233410 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b2268df940 0x55b2268e1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.763+0000 7fa21e055740 1 --2- 172.21.15.148:0/2460233410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b2268d5080 0x55b2268df400 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.763+0000 7fa21e055740 1 --2- 172.21.15.148:0/2460233410 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b2268d4760 0x55b2268d4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.763+0000 7fa21e055740 1 -- 172.21.15.148:0/2460233410 >> 172.21.15.148:0/2460233410 conn(0x55b2268d0cf0 msgr2=0x55b2268d10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:13.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.763+0000 7fa21e055740 1 -- 172.21.15.148:0/2460233410 shutdown_connections 2024-09-19T07:24:13.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.763+0000 7fa21e055740 1 -- 172.21.15.148:0/2460233410 wait complete. 2024-09-19T07:24:13.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.763+0000 7fa21e055740 1 -- start start 2024-09-19T07:24:13.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.763+0000 7fa21e055740 1 Processor -- start 2024-09-19T07:24:13.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.764+0000 7fa21e055740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b2268d4760 0x55b2268dc810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.764+0000 7fa21e055740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b2268d5080 0x55b2268dcd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.764+0000 7fa21e055740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b2268df940 0x55b2268dd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.764+0000 7fa21e055740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55b2268e24b0 con 0x55b2268d5080 2024-09-19T07:24:13.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.764+0000 7fa21e055740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55b2267c26e0 con 0x55b2268d4760 2024-09-19T07:24:13.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.764+0000 7fa21e055740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55b2268e2630 con 0x55b2268df940 2024-09-19T07:24:13.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.764+0000 7fa21e055740 10 client.0 _ll_register_callbacks cb 0x55b2267e6a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:24:13.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.764+0000 7fa219217640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b2268d5080 0x55b2268dcd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.764+0000 7fa219217640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b2268d5080 0x55b2268dcd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60204/0 (socket says 172.21.15.148:60204) 2024-09-19T07:24:13.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.764+0000 7fa219a18640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b2268d4760 0x55b2268dc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.764+0000 7fa219217640 1 -- 172.21.15.148:0/271391979 learned_addr learned my addr 172.21.15.148:0/271391979 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:24:13.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.764+0000 7fa21a219640 1 --2- 172.21.15.148:0/271391979 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b2268df940 0x55b2268dd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.764+0000 7fa219a18640 1 -- 172.21.15.148:0/271391979 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b2268df940 msgr2=0x55b2268dd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:13.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.764+0000 7fa219a18640 1 --2- 172.21.15.148:0/271391979 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b2268df940 0x55b2268dd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.764+0000 7fa219a18640 1 -- 172.21.15.148:0/271391979 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b2268d5080 msgr2=0x55b2268dcd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:13.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.764+0000 7fa219a18640 1 --2- 172.21.15.148:0/271391979 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b2268d5080 0x55b2268dcd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.764+0000 7fa219a18640 1 -- 172.21.15.148:0/271391979 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2268eb9a0 con 0x55b2268d4760 2024-09-19T07:24:13.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.764+0000 7fa219217640 1 --2- 172.21.15.148:0/271391979 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b2268d5080 0x55b2268dcd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:24:13.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.764+0000 7fa219a18640 1 --2- 172.21.15.148:0/271391979 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b2268d4760 0x55b2268dc810 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa21009bc20 tx=0x7fa2100cce60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e2fc523abb2d636 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:13.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.764+0000 7fa1fd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-19T07:24:13.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.765+0000 7fa1fd7fa640 1 -- 172.21.15.148:0/271391979 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2100b3070 con 0x55b2268d4760 2024-09-19T07:24:13.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.765+0000 7fa21e055740 1 -- 172.21.15.148:0/271391979 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa21009fe10 con 0x55b2268d4760 2024-09-19T07:24:13.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.765+0000 7fa1fd7fa640 1 -- 172.21.15.148:0/271391979 <== mon.2 v2:172.21.15.165:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8600+0+0 (secure 0 0 0) 0x7fa2100ba360 con 0x55b2268d4760 2024-09-19T07:24:13.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.765+0000 7fa1fd7fa640 1 -- 172.21.15.148:0/271391979 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fa210020070 con 0x55b2268d4760 2024-09-19T07:24:13.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.765+0000 7fa21e055740 10 client.26411 fetch_fsmap learned FSMap version 47 2024-09-19T07:24:13.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.765+0000 7fa21e055740 1 -- 172.21.15.148:0/271391979 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55b2268ee310 con 0x55b2268d4760 2024-09-19T07:24:13.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.765+0000 7fa1fd7fa640 1 -- 172.21.15.148:0/271391979 <== mon.2 v2:172.21.15.165:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa21009fe10 con 0x55b2268d4760 2024-09-19T07:24:13.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.765+0000 7fa1fd7fa640 1 -- 172.21.15.148:0/271391979 <== mon.2 v2:172.21.15.165:3300/0 5 ==== fsmap(e 47) ==== 8354+0+0 (secure 0 0 0) 0x7fa21009a920 con 0x55b2268d4760 2024-09-19T07:24:13.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.765+0000 7fa21e055740 10 client.26411 fetch_fsmap finished waiting for FSMap version 47 2024-09-19T07:24:13.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.765+0000 7fa21e055740 10 client.26411 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:24:13.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.765+0000 7fa21e055740 20 client.26411 populate_metadata read hostname 'smithi148' 2024-09-19T07:24:13.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.765+0000 7fa21e055740 1 --2- 172.21.15.148:0/271391979 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55b2268ef660 0x55b2268f1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.765+0000 7fa21e055740 4 client.26411 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:24:13.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.765+0000 7fa21e055740 1 -- 172.21.15.148:0/271391979 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b2268479d0 con 0x55b2268ef660 2024-09-19T07:24:13.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.766+0000 7fa219217640 1 --2- 172.21.15.148:0/271391979 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55b2268ef660 0x55b2268f1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.766+0000 7fa219217640 1 --2- 172.21.15.148:0/271391979 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55b2268ef660 0x55b2268f1a50 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4626b4e915c4d4e8 server_cookie=e81ffccbf79f3735 in_seq=0 out_seq=0 2024-09-19T07:24:13.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.766+0000 7fa1fd7fa640 10 client.26411 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:24:13.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.767+0000 7fa1fd7fa640 1 -- 172.21.15.148:0/271391979 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b2268479d0 con 0x55b2268ef660 2024-09-19T07:24:13.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.767+0000 7fa1fd7fa640 10 client.26411 handle_command_reply: tid=0 2024-09-19T07:24:13.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.767+0000 7fa21e055740 1 client.26411 shutdown 2024-09-19T07:24:13.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.767+0000 7fa21e055740 1 -- 172.21.15.148:0/271391979 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b2268d4760 msgr2=0x55b2268dc810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:13.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.767+0000 7fa21e055740 1 --2- 172.21.15.148:0/271391979 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b2268d4760 0x55b2268dc810 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa21009bc20 tx=0x7fa2100cce60 comp rx=0 tx=0).stop 2024-09-19T07:24:13.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.767+0000 7fa21e055740 1 -- 172.21.15.148:0/271391979 shutdown_connections 2024-09-19T07:24:13.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.767+0000 7fa21e055740 1 --2- 172.21.15.148:0/271391979 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55b2268ef660 0x55b2268f1a50 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.767+0000 7fa21e055740 1 --2- 172.21.15.148:0/271391979 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b2268df940 0x55b2268dd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.767+0000 7fa21e055740 1 --2- 172.21.15.148:0/271391979 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b2268d5080 0x55b2268dcd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.767+0000 7fa21e055740 1 --2- 172.21.15.148:0/271391979 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b2268d4760 0x55b2268dc810 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.767+0000 7fa1fd7fa640 0 client.26411 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:24:13.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.767+0000 7fa21e055740 1 -- 172.21.15.148:0/271391979 >> 172.21.15.148:0/271391979 conn(0x55b2268d0cf0 msgr2=0x55b2268d6a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:13.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.767+0000 7fa21e055740 1 -- 172.21.15.148:0/271391979 shutdown_connections 2024-09-19T07:24:13.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.767+0000 7fa21e055740 1 -- 172.21.15.148:0/271391979 wait complete. 2024-09-19T07:24:13.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.767+0000 7fa21e055740 20 client.26411 trim_cache size 0 max 16384 2024-09-19T07:24:13.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.784+0000 7fa21e055740 1 Processor -- start 2024-09-19T07:24:13.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.784+0000 7fa21e055740 1 -- start start 2024-09-19T07:24:13.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.784+0000 7fa21e055740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b2268d4760 0x55b2268de6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.784+0000 7fa21e055740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b2268d5080 0x55b2268d71c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.784+0000 7fa21e055740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b2268df940 0x55b2268f7050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.784+0000 7fa21e055740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa2141b0220 con 0x55b2268d5080 2024-09-19T07:24:13.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.784+0000 7fa21e055740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa2141ada90 con 0x55b2268df940 2024-09-19T07:24:13.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.784+0000 7fa21e055740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa2141ab900 con 0x55b2268d4760 2024-09-19T07:24:13.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.784+0000 7fa219217640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b2268d5080 0x55b2268d71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.784+0000 7fa219217640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b2268d5080 0x55b2268d71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60210/0 (socket says 172.21.15.148:60210) 2024-09-19T07:24:13.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.784+0000 7fa219217640 1 -- 172.21.15.148:0/3955916081 learned_addr learned my addr 172.21.15.148:0/3955916081 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:24:13.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.784+0000 7fa21a219640 1 --2- 172.21.15.148:0/3955916081 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b2268df940 0x55b2268f7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.784+0000 7fa219a18640 1 --2- 172.21.15.148:0/3955916081 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b2268d4760 0x55b2268de6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.784+0000 7fa219217640 1 -- 172.21.15.148:0/3955916081 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b2268d4760 msgr2=0x55b2268de6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:13.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.784+0000 7fa219217640 1 --2- 172.21.15.148:0/3955916081 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b2268d4760 0x55b2268de6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.784+0000 7fa219217640 1 -- 172.21.15.148:0/3955916081 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b2268df940 msgr2=0x55b2268f7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:13.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.784+0000 7fa219217640 1 --2- 172.21.15.148:0/3955916081 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b2268df940 0x55b2268f7050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.785+0000 7fa219217640 1 -- 172.21.15.148:0/3955916081 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2268cc260 con 0x55b2268d5080 2024-09-19T07:24:13.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.785+0000 7fa219217640 1 --2- 172.21.15.148:0/3955916081 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b2268d5080 0x55b2268d71c0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fa204012600 tx=0x7fa204005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5995f6d222a872d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:13.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.785+0000 7fa1ff7fe640 1 -- 172.21.15.148:0/3955916081 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa204005220 con 0x55b2268d5080 2024-09-19T07:24:13.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.785+0000 7fa1ff7fe640 1 -- 172.21.15.148:0/3955916081 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa204004c80 con 0x55b2268d5080 2024-09-19T07:24:13.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.785+0000 7fa1ff7fe640 1 -- 172.21.15.148:0/3955916081 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa204010820 con 0x55b2268d5080 2024-09-19T07:24:13.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.786+0000 7fa21e055740 1 -- 172.21.15.148:0/3955916081 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b2268d5080 msgr2=0x55b2268d71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:13.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.786+0000 7fa21e055740 1 --2- 172.21.15.148:0/3955916081 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b2268d5080 0x55b2268d71c0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fa204012600 tx=0x7fa204005f90 comp rx=0 tx=0).stop 2024-09-19T07:24:13.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.786+0000 7fa21e055740 1 -- 172.21.15.148:0/3955916081 shutdown_connections 2024-09-19T07:24:13.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.786+0000 7fa21e055740 1 --2- 172.21.15.148:0/3955916081 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b2268df940 0x55b2268f7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.786+0000 7fa21e055740 1 --2- 172.21.15.148:0/3955916081 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b2268d5080 0x55b2268d71c0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.786+0000 7fa21e055740 1 --2- 172.21.15.148:0/3955916081 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b2268d4760 0x55b2268de6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.786+0000 7fa21e055740 1 -- 172.21.15.148:0/3955916081 >> 172.21.15.148:0/3955916081 conn(0x55b2268d0cf0 msgr2=0x55b2268cfe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:13.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.786+0000 7fa21e055740 1 -- 172.21.15.148:0/3955916081 shutdown_connections 2024-09-19T07:24:13.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.786+0000 7fa21e055740 1 -- 172.21.15.148:0/3955916081 wait complete. 2024-09-19T07:24:13.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.786+0000 7fa21e055740 1 -- start start 2024-09-19T07:24:13.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.786+0000 7fa21e055740 1 Processor -- start 2024-09-19T07:24:13.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.787+0000 7fa21e055740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b2268d4760 0x55b2268e7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.787+0000 7fa21e055740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b2268d5080 0x55b2268e3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.787+0000 7fa21e055740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b2268df940 0x55b2268e4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.787+0000 7fa21e055740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa2141abf50 con 0x55b2268d5080 2024-09-19T07:24:13.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.787+0000 7fa21e055740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa2141ad3c0 con 0x55b2268d4760 2024-09-19T07:24:13.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.787+0000 7fa21e055740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa2141ac620 con 0x55b2268df940 2024-09-19T07:24:13.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.787+0000 7fa21e055740 10 client.0 _ll_register_callbacks cb 0x7fa2100046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:24:13.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.787+0000 7fa219a18640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b2268d4760 0x55b2268e7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.787+0000 7fa219217640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b2268d5080 0x55b2268e3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.787+0000 7fa219a18640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b2268d4760 0x55b2268e7ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:60464/0 (socket says 172.21.15.148:60464) 2024-09-19T07:24:13.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.787+0000 7fa219a18640 1 -- 172.21.15.148:0/1345266077 learned_addr learned my addr 172.21.15.148:0/1345266077 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:24:13.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.787+0000 7fa21a219640 1 --2- 172.21.15.148:0/1345266077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b2268df940 0x55b2268e4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.787+0000 7fa219a18640 1 -- 172.21.15.148:0/1345266077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b2268df940 msgr2=0x55b2268e4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:13.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.787+0000 7fa219a18640 1 --2- 172.21.15.148:0/1345266077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b2268df940 0x55b2268e4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.787+0000 7fa219a18640 1 -- 172.21.15.148:0/1345266077 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b2268d5080 msgr2=0x55b2268e3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:13.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.787+0000 7fa219a18640 1 --2- 172.21.15.148:0/1345266077 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b2268d5080 0x55b2268e3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.787+0000 7fa219a18640 1 -- 172.21.15.148:0/1345266077 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2268d0580 con 0x55b2268d4760 2024-09-19T07:24:13.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.787+0000 7fa21a219640 1 --2- 172.21.15.148:0/1345266077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b2268df940 0x55b2268e4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:24:13.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.788+0000 7fa219a18640 1 --2- 172.21.15.148:0/1345266077 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b2268d4760 0x55b2268e7ca0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa210097ec0 tx=0x7fa2100aff80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0a5fb601fa01fd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:13.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.788+0000 7fa1fd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-19T07:24:13.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.788+0000 7fa1fd7fa640 1 -- 172.21.15.148:0/1345266077 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2100b3070 con 0x55b2268d4760 2024-09-19T07:24:13.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.788+0000 7fa1fd7fa640 1 -- 172.21.15.148:0/1345266077 <== mon.2 v2:172.21.15.165:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8600+0+0 (secure 0 0 0) 0x7fa21009a920 con 0x55b2268d4760 2024-09-19T07:24:13.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.788+0000 7fa21e055740 1 -- 172.21.15.148:0/1345266077 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa204004c80 con 0x55b2268d4760 2024-09-19T07:24:13.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.788+0000 7fa1fd7fa640 1 -- 172.21.15.148:0/1345266077 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fa21009b830 con 0x55b2268d4760 2024-09-19T07:24:13.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.788+0000 7fa21e055740 10 client.26417 fetch_fsmap learned FSMap version 47 2024-09-19T07:24:13.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.788+0000 7fa21e055740 1 -- 172.21.15.148:0/1345266077 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55b22695ab10 con 0x55b2268d4760 2024-09-19T07:24:13.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.788+0000 7fa1fd7fa640 1 -- 172.21.15.148:0/1345266077 <== mon.2 v2:172.21.15.165:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa204004c80 con 0x55b2268d4760 2024-09-19T07:24:13.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.788+0000 7fa1fd7fa640 1 -- 172.21.15.148:0/1345266077 <== mon.2 v2:172.21.15.165:3300/0 5 ==== fsmap(e 47) ==== 8354+0+0 (secure 0 0 0) 0x7fa210005070 con 0x55b2268d4760 2024-09-19T07:24:13.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.788+0000 7fa21e055740 10 client.26417 fetch_fsmap finished waiting for FSMap version 47 2024-09-19T07:24:13.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.788+0000 7fa21e055740 10 client.26417 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:24:13.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.788+0000 7fa21e055740 20 client.26417 populate_metadata read hostname 'smithi148' 2024-09-19T07:24:13.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.788+0000 7fa21e055740 1 --2- 172.21.15.148:0/1345266077 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55b22695b100 0x55b22695d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.788+0000 7fa21e055740 4 client.26417 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.2, "await_for": 45.0}] 2024-09-19T07:24:13.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.788+0000 7fa21e055740 1 -- 172.21.15.148:0/1345266077 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.2, "await_for": 45.0}) -- 0x55b226841d20 con 0x55b22695b100 2024-09-19T07:24:13.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.789+0000 7fa219217640 1 --2- 172.21.15.148:0/1345266077 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55b22695b100 0x55b22695d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.789+0000 7fa219217640 1 --2- 172.21.15.148:0/1345266077 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55b22695b100 0x55b22695d4f0 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=545fee757ac26b9c server_cookie=7a21a46084d8aaea in_seq=0 out_seq=0 2024-09-19T07:24:13.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:13.789+0000 7fa1fd7fa640 10 client.26417 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:24:15.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:24:15 smithi179 ceph-mon[35716]: pgmap v412: 97 pgs: 11 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 82 active+clean; 1.7 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 348 op/s 2024-09-19T07:24:15.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:24:15 smithi148 ceph-mon[31180]: pgmap v412: 97 pgs: 11 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 82 active+clean; 1.7 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 348 op/s 2024-09-19T07:24:15.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:24:15 smithi165 ceph-mon[35326]: pgmap v412: 97 pgs: 11 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 82 active+clean; 1.7 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 348 op/s 2024-09-19T07:24:16.006 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.001+0000 7f435acb7640 1 -- 172.21.15.148:0/4163381001 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f435410e430 msgr2=0x7f4354110820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:16.006 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.001+0000 7f435acb7640 1 --2- 172.21.15.148:0/4163381001 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f435410e430 0x7f4354110820 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f434c009900 tx=0x7f434c02a410 comp rx=0 tx=0).stop 2024-09-19T07:24:16.006 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.001+0000 7f435acb7640 1 -- 172.21.15.148:0/4163381001 shutdown_connections 2024-09-19T07:24:16.006 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.001+0000 7f435acb7640 1 --2- 172.21.15.148:0/4163381001 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f435410e430 0x7f4354110820 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:16.006 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.001+0000 7f435acb7640 1 --2- 172.21.15.148:0/4163381001 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4354101230 0x7f435410def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:16.006 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.001+0000 7f435acb7640 1 --2- 172.21.15.148:0/4163381001 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4354100880 0x7f4354100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:16.006 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.001+0000 7f435acb7640 1 -- 172.21.15.148:0/4163381001 >> 172.21.15.148:0/4163381001 conn(0x7f4354077990 msgr2=0x7f43540fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:16.006 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.001+0000 7f435acb7640 1 -- 172.21.15.148:0/4163381001 shutdown_connections 2024-09-19T07:24:16.006 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.001+0000 7f435acb7640 1 -- 172.21.15.148:0/4163381001 wait complete. 2024-09-19T07:24:16.007 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.002+0000 7f435acb7640 1 Processor -- start 2024-09-19T07:24:16.007 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.002+0000 7f435acb7640 1 -- start start 2024-09-19T07:24:16.007 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.002+0000 7f435acb7640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4354100880 0x7f435419a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:16.007 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.002+0000 7f435acb7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4354101230 0x7f435419aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:16.007 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.002+0000 7f435acb7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f435410e430 0x7f435419ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:16.007 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.002+0000 7f435acb7640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f43541140a0 con 0x7f435410e430 2024-09-19T07:24:16.007 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.002+0000 7f435acb7640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4354113f20 con 0x7f4354100880 2024-09-19T07:24:16.007 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.002+0000 7f435acb7640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4354114220 con 0x7f4354101230 2024-09-19T07:24:16.007 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.002+0000 7f4359254640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f435410e430 0x7f435419ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:16.007 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.002+0000 7f4359254640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f435410e430 0x7f435419ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60018/0 (socket says 172.21.15.148:60018) 2024-09-19T07:24:16.008 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.002+0000 7f4359254640 1 -- 172.21.15.148:0/1414898963 learned_addr learned my addr 172.21.15.148:0/1414898963 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:24:16.008 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.002+0000 7f4353fff640 1 --2- 172.21.15.148:0/1414898963 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4354101230 0x7f435419aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:16.008 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.002+0000 7f4358a53640 1 --2- 172.21.15.148:0/1414898963 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4354100880 0x7f435419a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:16.008 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.002+0000 7f4359254640 1 -- 172.21.15.148:0/1414898963 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4354101230 msgr2=0x7f435419aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:16.008 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.002+0000 7f4359254640 1 --2- 172.21.15.148:0/1414898963 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4354101230 0x7f435419aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:16.008 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.002+0000 7f4359254640 1 -- 172.21.15.148:0/1414898963 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4354100880 msgr2=0x7f435419a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:16.008 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.002+0000 7f4359254640 1 --2- 172.21.15.148:0/1414898963 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4354100880 0x7f435419a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:16.008 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.002+0000 7f4359254640 1 -- 172.21.15.148:0/1414898963 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f435419f540 con 0x7f435410e430 2024-09-19T07:24:16.008 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.002+0000 7f4358a53640 1 --2- 172.21.15.148:0/1414898963 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4354100880 0x7f435419a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:24:16.008 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.003+0000 7f4359254640 1 --2- 172.21.15.148:0/1414898963 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f435410e430 0x7f435419ee10 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f434c009230 tx=0x7f434c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:16.008 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.003+0000 7f4351ffb640 1 -- 172.21.15.148:0/1414898963 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f434c03f030 con 0x7f435410e430 2024-09-19T07:24:16.009 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.003+0000 7f4351ffb640 1 -- 172.21.15.148:0/1414898963 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f434c004440 con 0x7f435410e430 2024-09-19T07:24:16.009 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.003+0000 7f435acb7640 1 -- 172.21.15.148:0/1414898963 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f435419f7d0 con 0x7f435410e430 2024-09-19T07:24:16.009 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.003+0000 7f4351ffb640 1 -- 172.21.15.148:0/1414898963 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f434c035070 con 0x7f435410e430 2024-09-19T07:24:16.009 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.003+0000 7f435acb7640 1 -- 172.21.15.148:0/1414898963 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43541a70c0 con 0x7f435410e430 2024-09-19T07:24:16.009 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.005+0000 7f4351ffb640 1 -- 172.21.15.148:0/1414898963 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f434c042030 con 0x7f435410e430 2024-09-19T07:24:16.015 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.006+0000 7f435da4f740 1 Processor -- start 2024-09-19T07:24:16.015 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.006+0000 7f435da4f740 1 -- start start 2024-09-19T07:24:16.015 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.006+0000 7f4351ffb640 1 --2- 172.21.15.148:0/1414898963 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f433c0a34e0 0x7f433c0a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:16.015 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.006+0000 7f435da4f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac59db4af0 0x55ac59db4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:16.016 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.006+0000 7f435da4f740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ac59db5410 0x55ac59dbf770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:16.016 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.006+0000 7f435da4f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac59dbfcb0 0x55ac59dc20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:16.016 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.006+0000 7f435da4f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55ac59d192f0 con 0x55ac59dbfcb0 2024-09-19T07:24:16.016 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.006+0000 7f435da4f740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ac59cc1270 con 0x55ac59db5410 2024-09-19T07:24:16.016 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.006+0000 7f435da4f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ac59d152b0 con 0x55ac59db4af0 2024-09-19T07:24:16.016 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.006+0000 7f4353fff640 1 --2- 172.21.15.148:0/1414898963 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f433c0a34e0 0x7f433c0a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:16.016 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.006+0000 7f4358a53640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac59db4af0 0x55ac59db4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:16.016 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.006+0000 7f4358a53640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac59db4af0 0x55ac59db4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:33254/0 (socket says 172.21.15.148:33254) 2024-09-19T07:24:16.016 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.006+0000 7f4358a53640 1 -- 172.21.15.148:0/1244347308 learned_addr learned my addr 172.21.15.148:0/1244347308 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:24:16.016 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.006+0000 7f4351ffb640 1 -- 172.21.15.148:0/1414898963 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8600+0+0 (secure 0 0 0) 0x7f434c0f0170 con 0x7f435410e430 2024-09-19T07:24:16.016 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.006+0000 7f4359254640 1 --2- 172.21.15.148:0/1244347308 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac59dbfcb0 0x55ac59dc20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:16.016 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.007+0000 7f4353fff640 1 --2- 172.21.15.148:0/1244347308 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ac59db5410 0x55ac59dbf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:16.016 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.007+0000 7f4358a53640 1 -- 172.21.15.148:0/1244347308 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ac59db5410 msgr2=0x55ac59dbf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:16.017 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.007+0000 7f4358a53640 1 --2- 172.21.15.148:0/1244347308 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ac59db5410 0x55ac59dbf770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:16.017 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.007+0000 7f4358a53640 1 -- 172.21.15.148:0/1244347308 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac59dbfcb0 msgr2=0x55ac59dc20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:16.017 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.007+0000 7f4358a53640 1 --2- 172.21.15.148:0/1244347308 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac59dbfcb0 0x55ac59dc20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:16.017 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.007+0000 7f4358a53640 1 -- 172.21.15.148:0/1244347308 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac59cc0340 con 0x55ac59db4af0 2024-09-19T07:24:16.017 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.007+0000 7f4353fff640 1 --2- 172.21.15.148:0/1414898963 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f433c0a34e0 0x7f433c0a59a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4354102720 tx=0x7f4348009f90 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:16.017 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.007+0000 7f4358a53640 1 --2- 172.21.15.148:0/1244347308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac59db4af0 0x55ac59db4ed0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f434400f3e0 tx=0x7f434400f8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d561653604f54ef9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:16.017 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.007+0000 7f433affd640 1 -- 172.21.15.148:0/1244347308 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4344004d20 con 0x55ac59db4af0 2024-09-19T07:24:16.017 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.007+0000 7f433affd640 1 -- 172.21.15.148:0/1244347308 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43440119e0 con 0x55ac59db4af0 2024-09-19T07:24:16.017 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.007+0000 7f433affd640 1 -- 172.21.15.148:0/1244347308 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43440055e0 con 0x55ac59db4af0 2024-09-19T07:24:16.017 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.008+0000 7f435da4f740 1 -- 172.21.15.148:0/1244347308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac59db4af0 msgr2=0x55ac59db4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:16.017 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.008+0000 7f435da4f740 1 --2- 172.21.15.148:0/1244347308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac59db4af0 0x55ac59db4ed0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f434400f3e0 tx=0x7f434400f8a0 comp rx=0 tx=0).stop 2024-09-19T07:24:16.017 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.008+0000 7f435da4f740 1 -- 172.21.15.148:0/1244347308 shutdown_connections 2024-09-19T07:24:16.017 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.008+0000 7f435da4f740 1 --2- 172.21.15.148:0/1244347308 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac59dbfcb0 0x55ac59dc20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:16.017 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.008+0000 7f435da4f740 1 --2- 172.21.15.148:0/1244347308 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ac59db5410 0x55ac59dbf770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:16.018 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.008+0000 7f435da4f740 1 --2- 172.21.15.148:0/1244347308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac59db4af0 0x55ac59db4ed0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:16.018 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.008+0000 7f435da4f740 1 -- 172.21.15.148:0/1244347308 >> 172.21.15.148:0/1244347308 conn(0x55ac59db1060 msgr2=0x55ac59db1440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:16.018 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.008+0000 7f435da4f740 1 -- 172.21.15.148:0/1244347308 shutdown_connections 2024-09-19T07:24:16.018 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.008+0000 7f435da4f740 1 -- 172.21.15.148:0/1244347308 wait complete. 2024-09-19T07:24:16.018 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.008+0000 7f435da4f740 1 -- start start 2024-09-19T07:24:16.018 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.008+0000 7f435da4f740 1 Processor -- start 2024-09-19T07:24:16.018 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.009+0000 7f435da4f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac59db4af0 0x55ac59dbcb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:16.018 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.009+0000 7f435da4f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac59db5410 0x55ac59dbd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:16.018 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.009+0000 7f435da4f740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ac59dbfcb0 0x55ac59dbd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:16.018 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.009+0000 7f435da4f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55ac59dc2880 con 0x55ac59db4af0 2024-09-19T07:24:16.018 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.009+0000 7f435da4f740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ac59ca2290 con 0x55ac59dbfcb0 2024-09-19T07:24:16.018 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.009+0000 7f435da4f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ac59dc2a00 con 0x55ac59db5410 2024-09-19T07:24:16.019 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.009+0000 7f435da4f740 10 client.0 _ll_register_callbacks cb 0x55ac59cd3140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:24:16.019 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.009+0000 7f4358a53640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac59db4af0 0x55ac59dbcb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:16.019 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.009+0000 7f4358a53640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac59db4af0 0x55ac59dbcb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60032/0 (socket says 172.21.15.148:60032) 2024-09-19T07:24:16.019 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.009+0000 7f4358a53640 1 -- 172.21.15.148:0/2303501791 learned_addr learned my addr 172.21.15.148:0/2303501791 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:24:16.019 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.009+0000 7f4353fff640 1 --2- 172.21.15.148:0/2303501791 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac59db5410 0x55ac59dbd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:16.019 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.009+0000 7f4359254640 1 --2- 172.21.15.148:0/2303501791 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ac59dbfcb0 0x55ac59dbd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:16.019 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.009+0000 7f4358a53640 1 -- 172.21.15.148:0/2303501791 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac59db5410 msgr2=0x55ac59dbd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:16.019 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.009+0000 7f4358a53640 1 --2- 172.21.15.148:0/2303501791 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac59db5410 0x55ac59dbd0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:16.019 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.009+0000 7f4358a53640 1 -- 172.21.15.148:0/2303501791 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ac59dbfcb0 msgr2=0x55ac59dbd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:16.019 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.009+0000 7f4358a53640 1 --2- 172.21.15.148:0/2303501791 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ac59dbfcb0 0x55ac59dbd610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:16.019 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.009+0000 7f4358a53640 1 -- 172.21.15.148:0/2303501791 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac59a2c210 con 0x55ac59db4af0 2024-09-19T07:24:16.019 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.009+0000 7f4358a53640 1 --2- 172.21.15.148:0/2303501791 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac59db4af0 0x55ac59dbcb90 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f4344011e40 tx=0x7f4344011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a79c3b4f65994b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:16.020 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.009+0000 7f4333fff640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:24:16.020 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.009+0000 7f4333fff640 1 -- 172.21.15.148:0/2303501791 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4344004a00 con 0x55ac59db4af0 2024-09-19T07:24:16.020 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.009+0000 7f4333fff640 1 -- 172.21.15.148:0/2303501791 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8600+0+0 (secure 0 0 0) 0x7f4344004ba0 con 0x55ac59db4af0 2024-09-19T07:24:16.020 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.009+0000 7f435da4f740 1 -- 172.21.15.148:0/2303501791 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43440119e0 con 0x55ac59db4af0 2024-09-19T07:24:16.020 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.010+0000 7f4333fff640 1 -- 172.21.15.148:0/2303501791 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f4344032050 con 0x55ac59db4af0 2024-09-19T07:24:16.020 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.010+0000 7f435da4f740 10 client.17340 fetch_fsmap learned FSMap version 47 2024-09-19T07:24:16.020 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.010+0000 7f435da4f740 1 -- 172.21.15.148:0/2303501791 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55ac59af8620 con 0x55ac59db4af0 2024-09-19T07:24:16.020 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.010+0000 7f4333fff640 1 -- 172.21.15.148:0/2303501791 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43440119e0 con 0x55ac59db4af0 2024-09-19T07:24:16.020 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.010+0000 7f4333fff640 1 -- 172.21.15.148:0/2303501791 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 47) ==== 8354+0+0 (secure 0 0 0) 0x7f434402d030 con 0x55ac59db4af0 2024-09-19T07:24:16.020 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.010+0000 7f435da4f740 10 client.17340 fetch_fsmap finished waiting for FSMap version 47 2024-09-19T07:24:16.020 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.010+0000 7f435da4f740 10 client.17340 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:24:16.020 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.010+0000 7f435da4f740 20 client.17340 populate_metadata read hostname 'smithi148' 2024-09-19T07:24:16.020 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.010+0000 7f435da4f740 1 --2- 172.21.15.148:0/2303501791 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ac59dcfbf0 0x55ac59dd1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:16.021 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.010+0000 7f435da4f740 4 client.17340 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:24:16.021 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.010+0000 7f435da4f740 1 -- 172.21.15.148:0/2303501791 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ac59d26a20 con 0x55ac59dcfbf0 2024-09-19T07:24:16.021 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.010+0000 7f4353fff640 1 --2- 172.21.15.148:0/2303501791 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ac59dcfbf0 0x55ac59dd1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:16.021 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.011+0000 7f4333fff640 10 client.17340 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:24:16.021 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.011+0000 7f4353fff640 1 --2- 172.21.15.148:0/2303501791 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ac59dcfbf0 0x55ac59dd1fe0 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=417bf7b75d9989aa server_cookie=c3af7610da25eb7b in_seq=0 out_seq=0 2024-09-19T07:24:16.021 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.011+0000 7f4333fff640 1 -- 172.21.15.148:0/2303501791 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ac59d26a20 con 0x55ac59dcfbf0 2024-09-19T07:24:16.021 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.011+0000 7f4333fff640 10 client.17340 handle_command_reply: tid=0 2024-09-19T07:24:16.021 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.011+0000 7f435da4f740 1 client.17340 shutdown 2024-09-19T07:24:16.021 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.011+0000 7f435da4f740 1 -- 172.21.15.148:0/2303501791 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac59db4af0 msgr2=0x55ac59dbcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:16.021 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.011+0000 7f435da4f740 1 --2- 172.21.15.148:0/2303501791 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac59db4af0 0x55ac59dbcb90 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f4344011e40 tx=0x7f4344011e70 comp rx=0 tx=0).stop 2024-09-19T07:24:16.021 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.011+0000 7f435da4f740 1 -- 172.21.15.148:0/2303501791 shutdown_connections 2024-09-19T07:24:16.021 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.011+0000 7f435da4f740 1 --2- 172.21.15.148:0/2303501791 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ac59dcfbf0 0x55ac59dd1fe0 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:16.021 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.011+0000 7f435da4f740 1 --2- 172.21.15.148:0/2303501791 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ac59dbfcb0 0x55ac59dbd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:16.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.011+0000 7f435da4f740 1 --2- 172.21.15.148:0/2303501791 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac59db5410 0x55ac59dbd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:16.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.011+0000 7f4333fff640 0 client.17340 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:24:16.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.011+0000 7f435da4f740 1 --2- 172.21.15.148:0/2303501791 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac59db4af0 0x55ac59dbcb90 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:16.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.012+0000 7f435da4f740 1 -- 172.21.15.148:0/2303501791 >> 172.21.15.148:0/2303501791 conn(0x55ac59db1060 msgr2=0x55ac59db6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:16.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.012+0000 7f435da4f740 1 -- 172.21.15.148:0/2303501791 shutdown_connections 2024-09-19T07:24:16.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.012+0000 7f435da4f740 1 -- 172.21.15.148:0/2303501791 wait complete. 2024-09-19T07:24:16.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.012+0000 7f435da4f740 20 client.17340 trim_cache size 0 max 16384 2024-09-19T07:24:16.031 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.026+0000 7f435da4f740 1 Processor -- start 2024-09-19T07:24:16.032 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.026+0000 7f435da4f740 1 -- start start 2024-09-19T07:24:16.032 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.026+0000 7f435da4f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac59db4af0 0x55ac59db7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:16.032 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.026+0000 7f435da4f740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ac59db5410 0x55ac59dbd440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:16.032 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.026+0000 7f435da4f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac59dbfcb0 0x55ac59dd7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:16.032 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.026+0000 7f435da4f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f43541b23c0 con 0x55ac59dbfcb0 2024-09-19T07:24:16.032 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.026+0000 7f435da4f740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f43541afc30 con 0x55ac59db5410 2024-09-19T07:24:16.032 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.026+0000 7f435da4f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f43541adaa0 con 0x55ac59db4af0 2024-09-19T07:24:16.032 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.026+0000 7f4359254640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac59dbfcb0 0x55ac59dd7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:16.032 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.026+0000 7f4359254640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac59dbfcb0 0x55ac59dd7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60048/0 (socket says 172.21.15.148:60048) 2024-09-19T07:24:16.032 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.026+0000 7f4359254640 1 -- 172.21.15.148:0/3503214255 learned_addr learned my addr 172.21.15.148:0/3503214255 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:24:16.033 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.026+0000 7f4358a53640 1 --2- 172.21.15.148:0/3503214255 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac59db4af0 0x55ac59db7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:16.033 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.027+0000 7f4353fff640 1 --2- 172.21.15.148:0/3503214255 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ac59db5410 0x55ac59dbd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:16.033 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.027+0000 7f4359254640 1 -- 172.21.15.148:0/3503214255 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac59db4af0 msgr2=0x55ac59db7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:16.033 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.027+0000 7f4359254640 1 --2- 172.21.15.148:0/3503214255 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac59db4af0 0x55ac59db7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:16.033 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.027+0000 7f4359254640 1 -- 172.21.15.148:0/3503214255 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ac59db5410 msgr2=0x55ac59dbd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:16.033 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.027+0000 7f4359254640 1 --2- 172.21.15.148:0/3503214255 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ac59db5410 0x55ac59dbd440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:16.033 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.027+0000 7f4359254640 1 -- 172.21.15.148:0/3503214255 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac59db0e90 con 0x55ac59dbfcb0 2024-09-19T07:24:16.033 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.027+0000 7f4359254640 1 --2- 172.21.15.148:0/3503214255 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac59dbfcb0 0x55ac59dd7750 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f434c0bc0a0 tx=0x7f434c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc894c6e81d01625 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:16.034 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.027+0000 7f433a7fc640 1 -- 172.21.15.148:0/3503214255 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f434c049070 con 0x55ac59dbfcb0 2024-09-19T07:24:16.034 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.027+0000 7f433a7fc640 1 -- 172.21.15.148:0/3503214255 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f434c08dcc0 con 0x55ac59dbfcb0 2024-09-19T07:24:16.034 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.027+0000 7f433a7fc640 1 -- 172.21.15.148:0/3503214255 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f434c0eda90 con 0x55ac59dbfcb0 2024-09-19T07:24:16.034 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.027+0000 7f435da4f740 1 -- 172.21.15.148:0/3503214255 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac59dbfcb0 msgr2=0x55ac59dd7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:16.034 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.027+0000 7f435da4f740 1 --2- 172.21.15.148:0/3503214255 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac59dbfcb0 0x55ac59dd7750 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f434c0bc0a0 tx=0x7f434c009260 comp rx=0 tx=0).stop 2024-09-19T07:24:16.034 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.028+0000 7f435da4f740 1 -- 172.21.15.148:0/3503214255 shutdown_connections 2024-09-19T07:24:16.034 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.028+0000 7f435da4f740 1 --2- 172.21.15.148:0/3503214255 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac59dbfcb0 0x55ac59dd7750 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:16.034 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.028+0000 7f435da4f740 1 --2- 172.21.15.148:0/3503214255 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ac59db5410 0x55ac59dbd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:16.034 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.028+0000 7f435da4f740 1 --2- 172.21.15.148:0/3503214255 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac59db4af0 0x55ac59db7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:16.034 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.028+0000 7f435da4f740 1 -- 172.21.15.148:0/3503214255 >> 172.21.15.148:0/3503214255 conn(0x55ac59db1060 msgr2=0x55ac59dbec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:16.034 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.028+0000 7f435da4f740 1 -- 172.21.15.148:0/3503214255 shutdown_connections 2024-09-19T07:24:16.035 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.028+0000 7f435da4f740 1 -- 172.21.15.148:0/3503214255 wait complete. 2024-09-19T07:24:16.035 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.028+0000 7f435da4f740 1 -- start start 2024-09-19T07:24:16.035 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.028+0000 7f435da4f740 1 Processor -- start 2024-09-19T07:24:16.035 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.028+0000 7f435da4f740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ac59db4af0 0x55ac59dc3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:16.035 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.028+0000 7f435da4f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac59db5410 0x55ac59dc3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:16.035 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.028+0000 7f435da4f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac59dbfcb0 0x55ac59dc4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:16.035 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.028+0000 7f435da4f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f43541ae0f0 con 0x55ac59dbfcb0 2024-09-19T07:24:16.035 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.028+0000 7f435da4f740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f43541af560 con 0x55ac59db4af0 2024-09-19T07:24:16.036 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.028+0000 7f435da4f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f43541ae7c0 con 0x55ac59db5410 2024-09-19T07:24:16.036 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.028+0000 7f435da4f740 10 client.0 _ll_register_callbacks cb 0x7f4344015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:24:16.036 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.028+0000 7f4359254640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac59dbfcb0 0x55ac59dc4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:16.036 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.029+0000 7f4359254640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac59dbfcb0 0x55ac59dc4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60056/0 (socket says 172.21.15.148:60056) 2024-09-19T07:24:16.036 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.029+0000 7f4359254640 1 -- 172.21.15.148:0/3389311257 learned_addr learned my addr 172.21.15.148:0/3389311257 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:24:16.036 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.029+0000 7f4353fff640 1 --2- 172.21.15.148:0/3389311257 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac59db5410 0x55ac59dc3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:16.036 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.029+0000 7f4358a53640 1 --2- 172.21.15.148:0/3389311257 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ac59db4af0 0x55ac59dc3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:16.036 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.029+0000 7f4359254640 1 -- 172.21.15.148:0/3389311257 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac59db5410 msgr2=0x55ac59dc3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:16.036 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.029+0000 7f4359254640 1 --2- 172.21.15.148:0/3389311257 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac59db5410 0x55ac59dc3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:16.036 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.029+0000 7f4359254640 1 -- 172.21.15.148:0/3389311257 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ac59db4af0 msgr2=0x55ac59dc3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:16.036 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.029+0000 7f4359254640 1 --2- 172.21.15.148:0/3389311257 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ac59db4af0 0x55ac59dc3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:16.037 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.029+0000 7f4359254640 1 -- 172.21.15.148:0/3389311257 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac59dac2d0 con 0x55ac59dbfcb0 2024-09-19T07:24:16.037 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.029+0000 7f4359254640 1 --2- 172.21.15.148:0/3389311257 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac59dbfcb0 0x55ac59dc4530 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f434c0b8d70 tx=0x7f434c0b8c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b31e0920255cc82b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:16.037 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.029+0000 7f4333fff640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:24:16.037 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.029+0000 7f4333fff640 1 -- 172.21.15.148:0/3389311257 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f434c0d5060 con 0x55ac59dbfcb0 2024-09-19T07:24:16.037 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.029+0000 7f4333fff640 1 -- 172.21.15.148:0/3389311257 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8600+0+0 (secure 0 0 0) 0x7f434c0d5200 con 0x55ac59dbfcb0 2024-09-19T07:24:16.037 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.029+0000 7f435da4f740 1 -- 172.21.15.148:0/3389311257 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f434c08dcc0 con 0x55ac59dbfcb0 2024-09-19T07:24:16.037 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.029+0000 7f4333fff640 1 -- 172.21.15.148:0/3389311257 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f434c049070 con 0x55ac59dbfcb0 2024-09-19T07:24:16.038 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.029+0000 7f435da4f740 10 client.17346 fetch_fsmap learned FSMap version 47 2024-09-19T07:24:16.038 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.029+0000 7f435da4f740 1 -- 172.21.15.148:0/3389311257 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55ac59e3a910 con 0x55ac59dbfcb0 2024-09-19T07:24:16.038 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.029+0000 7f4333fff640 1 -- 172.21.15.148:0/3389311257 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f434c08dcc0 con 0x55ac59dbfcb0 2024-09-19T07:24:16.038 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.030+0000 7f4333fff640 1 -- 172.21.15.148:0/3389311257 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 47) ==== 8354+0+0 (secure 0 0 0) 0x7f434c031bd0 con 0x55ac59dbfcb0 2024-09-19T07:24:16.038 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.030+0000 7f435da4f740 10 client.17346 fetch_fsmap finished waiting for FSMap version 47 2024-09-19T07:24:16.038 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.030+0000 7f435da4f740 10 client.17346 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:24:16.038 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.030+0000 7f435da4f740 20 client.17346 populate_metadata read hostname 'smithi148' 2024-09-19T07:24:16.038 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.030+0000 7f435da4f740 1 --2- 172.21.15.148:0/3389311257 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ac59e3b030 0x55ac59e3d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:16.038 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.030+0000 7f435da4f740 4 client.17346 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:24:16.039 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.030+0000 7f435da4f740 1 -- 172.21.15.148:0/3389311257 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ac59d20d70 con 0x55ac59e3b030 2024-09-19T07:24:16.039 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.030+0000 7f4358a53640 1 --2- 172.21.15.148:0/3389311257 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ac59e3b030 0x55ac59e3d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:16.039 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.030+0000 7f4358a53640 1 --2- 172.21.15.148:0/3389311257 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ac59e3b030 0x55ac59e3d450 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16d052f8b2adc008 server_cookie=904c6fe0535a97f4 in_seq=0 out_seq=0 2024-09-19T07:24:16.039 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.030+0000 7f4333fff640 10 client.17346 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:24:16.043 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.042+0000 7f4333fff640 1 -- 172.21.15.148:0/3389311257 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ac59d20d70 con 0x55ac59e3b030 2024-09-19T07:24:16.043 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.042+0000 7f4333fff640 10 client.17346 handle_command_reply: tid=0 2024-09-19T07:24:16.043 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.042+0000 7f435da4f740 1 client.17346 shutdown 2024-09-19T07:24:16.043 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.042+0000 7f435da4f740 1 -- 172.21.15.148:0/3389311257 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac59dbfcb0 msgr2=0x55ac59dc4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:16.043 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.042+0000 7f435da4f740 1 --2- 172.21.15.148:0/3389311257 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac59dbfcb0 0x55ac59dc4530 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f434c0b8d70 tx=0x7f434c0b8c40 comp rx=0 tx=0).stop 2024-09-19T07:24:16.043 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.042+0000 7f435da4f740 1 -- 172.21.15.148:0/3389311257 shutdown_connections 2024-09-19T07:24:16.043 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.042+0000 7f435da4f740 1 --2- 172.21.15.148:0/3389311257 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ac59e3b030 0x55ac59e3d450 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:16.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.042+0000 7f435da4f740 1 --2- 172.21.15.148:0/3389311257 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac59dbfcb0 0x55ac59dc4530 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:16.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.042+0000 7f435da4f740 1 --2- 172.21.15.148:0/3389311257 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac59db5410 0x55ac59dc3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:16.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.042+0000 7f4333fff640 0 client.17346 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:24:16.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.042+0000 7f435da4f740 1 --2- 172.21.15.148:0/3389311257 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ac59db4af0 0x55ac59dc3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:16.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.042+0000 7f435da4f740 1 -- 172.21.15.148:0/3389311257 >> 172.21.15.148:0/3389311257 conn(0x55ac59db1060 msgr2=0x55ac59dbe3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:16.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.042+0000 7f435da4f740 1 -- 172.21.15.148:0/3389311257 shutdown_connections 2024-09-19T07:24:16.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.042+0000 7f435da4f740 1 -- 172.21.15.148:0/3389311257 wait complete. 2024-09-19T07:24:16.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.042+0000 7f435da4f740 20 client.17346 trim_cache size 0 max 16384 2024-09-19T07:24:16.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:24:16.045 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:24:16.045 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:24:16.045 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:24:16.045 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.043+0000 7f435acb7640 1 -- 172.21.15.148:0/1414898963 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f433c0a34e0 msgr2=0x7f433c0a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:16.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.043+0000 7f435acb7640 1 --2- 172.21.15.148:0/1414898963 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f433c0a34e0 0x7f433c0a59a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4354102720 tx=0x7f4348009f90 comp rx=0 tx=0).stop 2024-09-19T07:24:16.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.043+0000 7f435acb7640 1 -- 172.21.15.148:0/1414898963 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f435410e430 msgr2=0x7f435419ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:16.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.043+0000 7f435acb7640 1 --2- 172.21.15.148:0/1414898963 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f435410e430 0x7f435419ee10 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f434c009230 tx=0x7f434c004040 comp rx=0 tx=0).stop 2024-09-19T07:24:16.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.043+0000 7f435acb7640 1 -- 172.21.15.148:0/1414898963 shutdown_connections 2024-09-19T07:24:16.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.043+0000 7f435acb7640 1 --2- 172.21.15.148:0/1414898963 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f433c0a34e0 0x7f433c0a59a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:16.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.043+0000 7f435acb7640 1 --2- 172.21.15.148:0/1414898963 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f435410e430 0x7f435419ee10 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:16.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.043+0000 7f435acb7640 1 --2- 172.21.15.148:0/1414898963 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4354101230 0x7f435419aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:16.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.043+0000 7f435acb7640 1 --2- 172.21.15.148:0/1414898963 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4354100880 0x7f435419a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:16.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.043+0000 7f435acb7640 1 -- 172.21.15.148:0/1414898963 >> 172.21.15.148:0/1414898963 conn(0x7f4354077990 msgr2=0x7f43540ff540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:16.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.043+0000 7f435acb7640 1 -- 172.21.15.148:0/1414898963 shutdown_connections 2024-09-19T07:24:16.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:16.043+0000 7f435acb7640 1 -- 172.21.15.148:0/1414898963 wait complete. 2024-09-19T07:24:17.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:24:17 smithi179 ceph-mon[35716]: pgmap v413: 97 pgs: 11 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 82 active+clean; 1.7 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 431 op/s 2024-09-19T07:24:17.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:24:17 smithi148 ceph-mon[31180]: pgmap v413: 97 pgs: 11 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 82 active+clean; 1.7 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 431 op/s 2024-09-19T07:24:17.636 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:24:17 smithi165 ceph-mon[35326]: pgmap v413: 97 pgs: 11 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 82 active+clean; 1.7 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 431 op/s 2024-09-19T07:24:19.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:24:19 smithi179 ceph-mon[35716]: pgmap v414: 97 pgs: 11 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 82 active+clean; 1.7 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 431 op/s 2024-09-19T07:24:19.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:24:19 smithi148 ceph-mon[31180]: pgmap v414: 97 pgs: 11 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 82 active+clean; 1.7 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 431 op/s 2024-09-19T07:24:19.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:24:19 smithi165 ceph-mon[35326]: pgmap v414: 97 pgs: 11 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 82 active+clean; 1.7 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 431 op/s 2024-09-19T07:24:21.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:24:21 smithi179 ceph-mon[35716]: pgmap v415: 97 pgs: 97 active+clean; 1.7 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 421 op/s 2024-09-19T07:24:21.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:24:21 smithi148 ceph-mon[31180]: pgmap v415: 97 pgs: 97 active+clean; 1.7 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 421 op/s 2024-09-19T07:24:21.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:24:21 smithi165 ceph-mon[35326]: pgmap v415: 97 pgs: 97 active+clean; 1.7 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 421 op/s 2024-09-19T07:24:23.522 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:24:23 smithi179 ceph-mon[35716]: pgmap v416: 97 pgs: 97 active+clean; 1.7 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.0 MiB/s wr, 261 op/s 2024-09-19T07:24:23.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:24:23 smithi148 ceph-mon[31180]: pgmap v416: 97 pgs: 97 active+clean; 1.7 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.0 MiB/s wr, 261 op/s 2024-09-19T07:24:23.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:24:23 smithi165 ceph-mon[35326]: pgmap v416: 97 pgs: 97 active+clean; 1.7 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.0 MiB/s wr, 261 op/s 2024-09-19T07:24:24.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:24:24 smithi148 ceph-mon[31180]: osdmap e96: 12 total, 12 up, 12 in 2024-09-19T07:24:24.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:24:24 smithi148 ceph-mon[31180]: pgmap v418: 97 pgs: 97 active+clean; 1.7 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 215 op/s 2024-09-19T07:24:24.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:24:24 smithi179 ceph-mon[35716]: osdmap e96: 12 total, 12 up, 12 in 2024-09-19T07:24:24.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:24:24 smithi179 ceph-mon[35716]: pgmap v418: 97 pgs: 97 active+clean; 1.7 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 215 op/s 2024-09-19T07:24:24.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:24:24 smithi165 ceph-mon[35326]: osdmap e96: 12 total, 12 up, 12 in 2024-09-19T07:24:24.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:24:24 smithi165 ceph-mon[35326]: pgmap v418: 97 pgs: 97 active+clean; 1.7 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 215 op/s 2024-09-19T07:24:24.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:24.898+0000 7fa1fd7fa640 1 -- 172.21.15.148:0/1345266077 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55b226841d20 con 0x55b22695b100 2024-09-19T07:24:24.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:24.898+0000 7fa1fd7fa640 10 client.26417 handle_command_reply: tid=0 2024-09-19T07:24:24.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:24.898+0000 7fa21e055740 1 client.26417 shutdown 2024-09-19T07:24:24.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:24.898+0000 7fa21e055740 1 -- 172.21.15.148:0/1345266077 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b2268d4760 msgr2=0x55b2268e7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:24.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:24.898+0000 7fa21e055740 1 --2- 172.21.15.148:0/1345266077 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b2268d4760 0x55b2268e7ca0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa210097ec0 tx=0x7fa2100aff80 comp rx=0 tx=0).stop 2024-09-19T07:24:24.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:24.898+0000 7fa21e055740 1 -- 172.21.15.148:0/1345266077 shutdown_connections 2024-09-19T07:24:24.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:24.898+0000 7fa21e055740 1 --2- 172.21.15.148:0/1345266077 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55b22695b100 0x55b22695d4f0 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:24.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:24.898+0000 7fa21e055740 1 --2- 172.21.15.148:0/1345266077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b2268df940 0x55b2268e4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:24.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:24.898+0000 7fa21e055740 1 --2- 172.21.15.148:0/1345266077 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b2268d5080 0x55b2268e3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:24.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:24.898+0000 7fa1fd7fa640 0 client.26417 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:24:24.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:24.898+0000 7fa21e055740 1 --2- 172.21.15.148:0/1345266077 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b2268d4760 0x55b2268e7ca0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:24.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:24.898+0000 7fa21e055740 1 -- 172.21.15.148:0/1345266077 >> 172.21.15.148:0/1345266077 conn(0x55b2268d0cf0 msgr2=0x55b2268ea700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:24.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:24.898+0000 7fa21e055740 1 -- 172.21.15.148:0/1345266077 shutdown_connections 2024-09-19T07:24:24.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:24.898+0000 7fa21e055740 1 -- 172.21.15.148:0/1345266077 wait complete. 2024-09-19T07:24:24.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:24.899+0000 7fa21e055740 20 client.26417 trim_cache size 0 max 16384 2024-09-19T07:24:24.900 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:24:24.900 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 47, 2024-09-19T07:24:24.901 INFO:teuthology.orchestra.run.smithi148.stdout: "leader": 24457, 2024-09-19T07:24:24.901 INFO:teuthology.orchestra.run.smithi148.stdout: "set_version": 42, 2024-09-19T07:24:24.901 INFO:teuthology.orchestra.run.smithi148.stdout: "sets": { 2024-09-19T07:24:24.901 INFO:teuthology.orchestra.run.smithi148.stdout: "3424aa4a": { 2024-09-19T07:24:24.901 INFO:teuthology.orchestra.run.smithi148.stdout: "version": 42, 2024-09-19T07:24:24.901 INFO:teuthology.orchestra.run.smithi148.stdout: "age_ref": 0.0, 2024-09-19T07:24:24.901 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:24:24.901 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "QUIESCED", 2024-09-19T07:24:24.901 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:24:24.901 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:24:24.901 INFO:teuthology.orchestra.run.smithi148.stdout: "timeout": 90.0, 2024-09-19T07:24:24.901 INFO:teuthology.orchestra.run.smithi148.stdout: "expiration": 142.2, 2024-09-19T07:24:24.901 INFO:teuthology.orchestra.run.smithi148.stdout: "members": { 2024-09-19T07:24:24.901 INFO:teuthology.orchestra.run.smithi148.stdout: "file:/": { 2024-09-19T07:24:24.902 INFO:teuthology.orchestra.run.smithi148.stdout: "excluded": false, 2024-09-19T07:24:24.902 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:24:24.902 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "QUIESCED", 2024-09-19T07:24:24.902 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:24:24.902 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:24:24.902 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:24:24.902 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:24:24.902 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:24:24.902 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:24:24.902 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:24:24.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:24.899+0000 7fa21bc7c640 1 -- 172.21.15.148:0/127514835 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fa2000a3430 msgr2=0x7fa2000a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:24.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:24.899+0000 7fa21bc7c640 1 --2- 172.21.15.148:0/127514835 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fa2000a3430 0x7fa2000a58f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa20c030040 tx=0x7fa20c0093f0 comp rx=0 tx=0).stop 2024-09-19T07:24:24.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:24.899+0000 7fa21bc7c640 1 -- 172.21.15.148:0/127514835 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa214100e20 msgr2=0x7fa2141993d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:24.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:24.899+0000 7fa21bc7c640 1 --2- 172.21.15.148:0/127514835 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa214100e20 0x7fa2141993d0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fa21000d770 tx=0x7fa21000dc30 comp rx=0 tx=0).stop 2024-09-19T07:24:24.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:24.899+0000 7fa21bc7c640 1 -- 172.21.15.148:0/127514835 shutdown_connections 2024-09-19T07:24:24.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:24.899+0000 7fa21bc7c640 1 --2- 172.21.15.148:0/127514835 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fa2000a3430 0x7fa2000a58f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:24.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:24.899+0000 7fa21bc7c640 1 --2- 172.21.15.148:0/127514835 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa214102ef0 0x7fa214199e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:24.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:24.899+0000 7fa21bc7c640 1 --2- 172.21.15.148:0/127514835 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa214102570 0x7fa214199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:24.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:24.899+0000 7fa21bc7c640 1 --2- 172.21.15.148:0/127514835 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa214100e20 0x7fa2141993d0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:24.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:24.899+0000 7fa21bc7c640 1 -- 172.21.15.148:0/127514835 >> 172.21.15.148:0/127514835 conn(0x7fa2140fc7d0 msgr2=0x7fa2141068d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:24.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:24.900+0000 7fa21bc7c640 1 -- 172.21.15.148:0/127514835 shutdown_connections 2024-09-19T07:24:24.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:24.900+0000 7fa21bc7c640 1 -- 172.21.15.148:0/127514835 wait complete. 2024-09-19T07:24:25.727 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '3424aa4a', quiesce took 15.4 seconds. Will release after: 6.799999999999999 2024-09-19T07:24:26.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:24:26 smithi148 ceph-mon[31180]: pgmap v419: 97 pgs: 97 active+clean; 1.7 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 449 KiB/s wr, 80 op/s 2024-09-19T07:24:26.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:24:26 smithi165 ceph-mon[35326]: pgmap v419: 97 pgs: 97 active+clean; 1.7 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 449 KiB/s wr, 80 op/s 2024-09-19T07:24:27.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:24:26 smithi179 ceph-mon[35716]: pgmap v419: 97 pgs: 97 active+clean; 1.7 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 449 KiB/s wr, 80 op/s 2024-09-19T07:24:28.824 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:24:28 smithi179 ceph-mon[35716]: pgmap v420: 97 pgs: 97 active+clean; 1.7 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 449 KiB/s wr, 80 op/s 2024-09-19T07:24:28.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:24:28 smithi148 ceph-mon[31180]: pgmap v420: 97 pgs: 97 active+clean; 1.7 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 449 KiB/s wr, 80 op/s 2024-09-19T07:24:28.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:24:28 smithi165 ceph-mon[35326]: pgmap v420: 97 pgs: 97 active+clean; 1.7 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 449 KiB/s wr, 80 op/s 2024-09-19T07:24:29.141 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.138+0000 7fdd9bde4640 1 -- 172.21.15.148:0/702728066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd94102310 msgr2=0x7fdd94106740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:29.141 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.138+0000 7fdd9bde4640 1 --2- 172.21.15.148:0/702728066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd94102310 0x7fdd94106740 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fdd84009900 tx=0x7fdd8402a410 comp rx=0 tx=0).stop 2024-09-19T07:24:29.142 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.138+0000 7fdd9bde4640 1 -- 172.21.15.148:0/702728066 shutdown_connections 2024-09-19T07:24:29.142 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.138+0000 7fdd9bde4640 1 --2- 172.21.15.148:0/702728066 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd94106ea0 0x7fdd9410d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:29.142 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.138+0000 7fdd9bde4640 1 --2- 172.21.15.148:0/702728066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd94102310 0x7fdd94106740 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:29.142 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.138+0000 7fdd9bde4640 1 --2- 172.21.15.148:0/702728066 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdd94101960 0x7fdd94101d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:29.142 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.138+0000 7fdd9bde4640 1 -- 172.21.15.148:0/702728066 >> 172.21.15.148:0/702728066 conn(0x7fdd94075db0 msgr2=0x7fdd940761c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:29.142 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.138+0000 7fdd9bde4640 1 -- 172.21.15.148:0/702728066 shutdown_connections 2024-09-19T07:24:29.142 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.138+0000 7fdd9bde4640 1 -- 172.21.15.148:0/702728066 wait complete. 2024-09-19T07:24:29.142 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.139+0000 7fdd9bde4640 1 Processor -- start 2024-09-19T07:24:29.142 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.139+0000 7fdd9bde4640 1 -- start start 2024-09-19T07:24:29.142 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.139+0000 7fdd9bde4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd94101960 0x7fdd94198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:29.142 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.139+0000 7fdd9bde4640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdd94106ea0 0x7fdd94198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:29.143 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.139+0000 7fdd9bde4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd9419cbc0 0x7fdd9419d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:29.143 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.139+0000 7fdd9bde4640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdd94110e20 con 0x7fdd9419cbc0 2024-09-19T07:24:29.143 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.139+0000 7fdd9bde4640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdd94110ca0 con 0x7fdd94106ea0 2024-09-19T07:24:29.143 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.139+0000 7fdd9bde4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdd94110fa0 con 0x7fdd94101960 2024-09-19T07:24:29.143 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.139+0000 7fdd9a381640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd9419cbc0 0x7fdd9419d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:29.143 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.139+0000 7fdd9a381640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd9419cbc0 0x7fdd9419d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:32858/0 (socket says 172.21.15.148:32858) 2024-09-19T07:24:29.143 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.139+0000 7fdd9a381640 1 -- 172.21.15.148:0/2530193365 learned_addr learned my addr 172.21.15.148:0/2530193365 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:24:29.143 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.139+0000 7fdd9937f640 1 --2- 172.21.15.148:0/2530193365 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdd94106ea0 0x7fdd94198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:29.143 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.140+0000 7fdd99b80640 1 --2- 172.21.15.148:0/2530193365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd94101960 0x7fdd94198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:29.144 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.140+0000 7fdd9a381640 1 -- 172.21.15.148:0/2530193365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd94101960 msgr2=0x7fdd94198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:29.144 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.140+0000 7fdd9a381640 1 --2- 172.21.15.148:0/2530193365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd94101960 0x7fdd94198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:29.144 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.140+0000 7fdd9a381640 1 -- 172.21.15.148:0/2530193365 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdd94106ea0 msgr2=0x7fdd94198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:29.144 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.140+0000 7fdd9a381640 1 --2- 172.21.15.148:0/2530193365 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdd94106ea0 0x7fdd94198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:29.144 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.140+0000 7fdd9a381640 1 -- 172.21.15.148:0/2530193365 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd9419d6b0 con 0x7fdd9419cbc0 2024-09-19T07:24:29.144 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.140+0000 7fdd9a381640 1 --2- 172.21.15.148:0/2530193365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd9419cbc0 0x7fdd9419d070 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c00cce0 tx=0x7fdd8c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:29.144 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.140+0000 7fdd8affd640 1 -- 172.21.15.148:0/2530193365 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c00f450 con 0x7fdd9419cbc0 2024-09-19T07:24:29.144 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.140+0000 7fdd8affd640 1 -- 172.21.15.148:0/2530193365 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd8c00fad0 con 0x7fdd9419cbc0 2024-09-19T07:24:29.145 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.140+0000 7fdd8affd640 1 -- 172.21.15.148:0/2530193365 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c018c10 con 0x7fdd9419cbc0 2024-09-19T07:24:29.145 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.140+0000 7fdd9bde4640 1 -- 172.21.15.148:0/2530193365 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd9419d9a0 con 0x7fdd9419cbc0 2024-09-19T07:24:29.145 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.140+0000 7fdd9bde4640 1 -- 172.21.15.148:0/2530193365 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd941a5110 con 0x7fdd9419cbc0 2024-09-19T07:24:29.150 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.143+0000 7fdd8affd640 1 -- 172.21.15.148:0/2530193365 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fdd8c00f5f0 con 0x7fdd9419cbc0 2024-09-19T07:24:29.151 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.143+0000 7fdd9ec58740 1 Processor -- start 2024-09-19T07:24:29.151 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.144+0000 7fdd9ec58740 1 -- start start 2024-09-19T07:24:29.151 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.144+0000 7fdd9ec58740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f48f36caf0 0x55f48f36ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:29.151 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.144+0000 7fdd9ec58740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f48f36d410 0x55f48f377770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:29.151 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.144+0000 7fdd9ec58740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f48f377cb0 0x55f48f37a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:29.151 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.144+0000 7fdd9ec58740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55f48f2d12f0 con 0x55f48f36caf0 2024-09-19T07:24:29.151 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.144+0000 7fdd9ec58740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55f48f279270 con 0x55f48f36d410 2024-09-19T07:24:29.151 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.144+0000 7fdd9ec58740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f48f2cd2b0 con 0x55f48f377cb0 2024-09-19T07:24:29.151 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.144+0000 7fdd9937f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f48f36caf0 0x55f48f36ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:29.151 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.144+0000 7fdd9937f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f48f36caf0 0x55f48f36ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:32866/0 (socket says 172.21.15.148:32866) 2024-09-19T07:24:29.151 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.144+0000 7fdd9937f640 1 -- 172.21.15.148:0/2585573535 learned_addr learned my addr 172.21.15.148:0/2585573535 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:24:29.151 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.144+0000 7fdd99b80640 1 --2- 172.21.15.148:0/2585573535 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f48f36d410 0x55f48f377770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:29.151 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.145+0000 7fdd8affd640 1 --2- 172.21.15.148:0/2530193365 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fdd800a3460 0x7fdd800a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:29.152 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.145+0000 7fdd9937f640 1 -- 172.21.15.148:0/2585573535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f48f377cb0 msgr2=0x55f48f37a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:29.152 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.145+0000 7fdd9937f640 1 --2- 172.21.15.148:0/2585573535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f48f377cb0 0x55f48f37a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:29.152 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.145+0000 7fdd9937f640 1 -- 172.21.15.148:0/2585573535 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f48f36d410 msgr2=0x55f48f377770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:29.152 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.145+0000 7fdd9937f640 1 --2- 172.21.15.148:0/2585573535 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f48f36d410 0x55f48f377770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:29.152 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.145+0000 7fdd9937f640 1 -- 172.21.15.148:0/2585573535 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f48f278340 con 0x55f48f36caf0 2024-09-19T07:24:29.152 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.145+0000 7fdd99b80640 1 --2- 172.21.15.148:0/2585573535 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f48f36d410 0x55f48f377770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:24:29.152 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.145+0000 7fdd9a381640 1 --2- 172.21.15.148:0/2530193365 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fdd800a3460 0x7fdd800a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:29.152 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.145+0000 7fdd9937f640 1 --2- 172.21.15.148:0/2585573535 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f48f36caf0 0x55f48f36ced0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fdd84009900 tx=0x7fdd84031660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40ba6a1f1a31d2f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:29.152 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.145+0000 7fdd8affd640 1 -- 172.21.15.148:0/2530193365 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8556+0+0 (secure 0 0 0) 0x7fdd8c0d03c0 con 0x7fdd9419cbc0 2024-09-19T07:24:29.152 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.145+0000 7fdd7ffff640 1 -- 172.21.15.148:0/2585573535 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd84035040 con 0x55f48f36caf0 2024-09-19T07:24:29.152 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.145+0000 7fdd7ffff640 1 -- 172.21.15.148:0/2585573535 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd84005020 con 0x55f48f36caf0 2024-09-19T07:24:29.152 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.145+0000 7fdd7ffff640 1 -- 172.21.15.148:0/2585573535 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd84004a90 con 0x55f48f36caf0 2024-09-19T07:24:29.152 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.146+0000 7fdd9ec58740 1 -- 172.21.15.148:0/2585573535 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f48f36caf0 msgr2=0x55f48f36ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:29.153 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.146+0000 7fdd9a381640 1 --2- 172.21.15.148:0/2530193365 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fdd800a3460 0x7fdd800a5920 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c09c380 tx=0x7fdd8c06f4b0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:29.153 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.146+0000 7fdd9ec58740 1 --2- 172.21.15.148:0/2585573535 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f48f36caf0 0x55f48f36ced0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fdd84009900 tx=0x7fdd84031660 comp rx=0 tx=0).stop 2024-09-19T07:24:29.153 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.146+0000 7fdd9ec58740 1 -- 172.21.15.148:0/2585573535 shutdown_connections 2024-09-19T07:24:29.153 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.146+0000 7fdd9ec58740 1 --2- 172.21.15.148:0/2585573535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f48f377cb0 0x55f48f37a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:29.153 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.146+0000 7fdd9ec58740 1 --2- 172.21.15.148:0/2585573535 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f48f36d410 0x55f48f377770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:29.153 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.146+0000 7fdd9ec58740 1 --2- 172.21.15.148:0/2585573535 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f48f36caf0 0x55f48f36ced0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:29.153 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.146+0000 7fdd9ec58740 1 -- 172.21.15.148:0/2585573535 >> 172.21.15.148:0/2585573535 conn(0x55f48f369060 msgr2=0x55f48f369440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:29.153 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.146+0000 7fdd9ec58740 1 -- 172.21.15.148:0/2585573535 shutdown_connections 2024-09-19T07:24:29.153 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.146+0000 7fdd9ec58740 1 -- 172.21.15.148:0/2585573535 wait complete. 2024-09-19T07:24:29.153 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.146+0000 7fdd9ec58740 1 -- start start 2024-09-19T07:24:29.153 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.146+0000 7fdd9ec58740 1 Processor -- start 2024-09-19T07:24:29.153 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.147+0000 7fdd9ec58740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f48f36caf0 0x55f48f374b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:29.153 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.147+0000 7fdd9ec58740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f48f36d410 0x55f48f375070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:29.154 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.147+0000 7fdd9ec58740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f48f377cb0 0x55f48f3755b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:29.154 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.147+0000 7fdd9ec58740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55f48f37a880 con 0x55f48f36caf0 2024-09-19T07:24:29.154 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.147+0000 7fdd9ec58740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55f48f25a290 con 0x55f48f36d410 2024-09-19T07:24:29.154 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.147+0000 7fdd9ec58740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f48f37aa00 con 0x55f48f377cb0 2024-09-19T07:24:29.154 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.147+0000 7fdd9ec58740 10 client.0 _ll_register_callbacks cb 0x55f48f28b140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:24:29.154 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.147+0000 7fdd9937f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f48f36caf0 0x55f48f374b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:29.154 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.147+0000 7fdd9937f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f48f36caf0 0x55f48f374b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:32876/0 (socket says 172.21.15.148:32876) 2024-09-19T07:24:29.154 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.147+0000 7fdd9937f640 1 -- 172.21.15.148:0/3800326470 learned_addr learned my addr 172.21.15.148:0/3800326470 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:24:29.154 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.147+0000 7fdd9937f640 1 --2- 172.21.15.148:0/3800326470 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f48f377cb0 0x55f48f3755b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:29.154 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.147+0000 7fdd99b80640 1 --2- 172.21.15.148:0/3800326470 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f48f36d410 0x55f48f375070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:29.154 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.147+0000 7fdd9937f640 1 -- 172.21.15.148:0/3800326470 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f48f377cb0 msgr2=0x55f48f3755b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:29.154 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.147+0000 7fdd9937f640 1 --2- 172.21.15.148:0/3800326470 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f48f377cb0 0x55f48f3755b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:29.154 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.147+0000 7fdd9937f640 1 -- 172.21.15.148:0/3800326470 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f48f36d410 msgr2=0x55f48f375070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:29.155 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.147+0000 7fdd9937f640 1 --2- 172.21.15.148:0/3800326470 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f48f36d410 0x55f48f375070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:29.155 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.147+0000 7fdd9937f640 1 -- 172.21.15.148:0/3800326470 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f48efe4210 con 0x55f48f36caf0 2024-09-19T07:24:29.155 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.147+0000 7fdd9937f640 1 --2- 172.21.15.148:0/3800326470 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f48f36caf0 0x55f48f374b30 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fdd840055d0 tx=0x7fdd84031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e984cbe674bda5cc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:29.155 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.147+0000 7fdd7d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:24:29.155 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.148+0000 7fdd7d7fa640 1 -- 172.21.15.148:0/3800326470 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd84004c20 con 0x55f48f36caf0 2024-09-19T07:24:29.155 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.148+0000 7fdd7d7fa640 1 -- 172.21.15.148:0/3800326470 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8556+0+0 (secure 0 0 0) 0x7fdd84004dc0 con 0x55f48f36caf0 2024-09-19T07:24:29.155 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.148+0000 7fdd9ec58740 1 -- 172.21.15.148:0/3800326470 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd84005020 con 0x55f48f36caf0 2024-09-19T07:24:29.155 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.148+0000 7fdd7d7fa640 1 -- 172.21.15.148:0/3800326470 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fdd84045440 con 0x55f48f36caf0 2024-09-19T07:24:29.155 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.148+0000 7fdd9ec58740 10 client.17358 fetch_fsmap learned FSMap version 47 2024-09-19T07:24:29.155 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.148+0000 7fdd9ec58740 1 -- 172.21.15.148:0/3800326470 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55f48f0b0620 con 0x55f48f36caf0 2024-09-19T07:24:29.155 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.148+0000 7fdd7d7fa640 1 -- 172.21.15.148:0/3800326470 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd84005020 con 0x55f48f36caf0 2024-09-19T07:24:29.155 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.148+0000 7fdd7d7fa640 1 -- 172.21.15.148:0/3800326470 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 47) ==== 8354+0+0 (secure 0 0 0) 0x7fdd8403b860 con 0x55f48f36caf0 2024-09-19T07:24:29.155 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.148+0000 7fdd9ec58740 10 client.17358 fetch_fsmap finished waiting for FSMap version 47 2024-09-19T07:24:29.155 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.148+0000 7fdd9ec58740 10 client.17358 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:24:29.156 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.148+0000 7fdd9ec58740 20 client.17358 populate_metadata read hostname 'smithi148' 2024-09-19T07:24:29.156 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.148+0000 7fdd9ec58740 1 --2- 172.21.15.148:0/3800326470 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55f48f38be50 0x55f48f38e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:29.156 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.148+0000 7fdd9ec58740 4 client.17358 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:24:29.156 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.148+0000 7fdd9ec58740 1 -- 172.21.15.148:0/3800326470 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f48f2dea20 con 0x55f48f38be50 2024-09-19T07:24:29.156 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.148+0000 7fdd99b80640 1 --2- 172.21.15.148:0/3800326470 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55f48f38be50 0x55f48f38e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:29.156 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.149+0000 7fdd7d7fa640 10 client.17358 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:24:29.156 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.149+0000 7fdd99b80640 1 --2- 172.21.15.148:0/3800326470 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55f48f38be50 0x55f48f38e240 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5300adb5573eaef server_cookie=2004583a7a67d2e7 in_seq=0 out_seq=0 2024-09-19T07:24:29.156 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.150+0000 7fdd7d7fa640 1 -- 172.21.15.148:0/3800326470 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f48f2dea20 con 0x55f48f38be50 2024-09-19T07:24:29.156 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.150+0000 7fdd7d7fa640 10 client.17358 handle_command_reply: tid=0 2024-09-19T07:24:29.156 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.150+0000 7fdd9ec58740 1 client.17358 shutdown 2024-09-19T07:24:29.156 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.150+0000 7fdd9ec58740 1 -- 172.21.15.148:0/3800326470 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f48f36caf0 msgr2=0x55f48f374b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:29.156 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.150+0000 7fdd9ec58740 1 --2- 172.21.15.148:0/3800326470 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f48f36caf0 0x55f48f374b30 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fdd840055d0 tx=0x7fdd84031400 comp rx=0 tx=0).stop 2024-09-19T07:24:29.156 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.150+0000 7fdd9ec58740 1 -- 172.21.15.148:0/3800326470 shutdown_connections 2024-09-19T07:24:29.157 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.150+0000 7fdd9ec58740 1 --2- 172.21.15.148:0/3800326470 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55f48f38be50 0x55f48f38e240 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:29.157 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.150+0000 7fdd9ec58740 1 --2- 172.21.15.148:0/3800326470 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f48f377cb0 0x55f48f3755b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:29.157 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.150+0000 7fdd9ec58740 1 --2- 172.21.15.148:0/3800326470 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f48f36d410 0x55f48f375070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:29.157 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.150+0000 7fdd9ec58740 1 --2- 172.21.15.148:0/3800326470 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f48f36caf0 0x55f48f374b30 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:29.157 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.150+0000 7fdd7d7fa640 0 client.17358 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:24:29.157 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.150+0000 7fdd9ec58740 1 -- 172.21.15.148:0/3800326470 >> 172.21.15.148:0/3800326470 conn(0x55f48f369060 msgr2=0x55f48f36edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:29.157 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.150+0000 7fdd9ec58740 1 -- 172.21.15.148:0/3800326470 shutdown_connections 2024-09-19T07:24:29.157 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.150+0000 7fdd9ec58740 1 -- 172.21.15.148:0/3800326470 wait complete. 2024-09-19T07:24:29.157 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.150+0000 7fdd9ec58740 20 client.17358 trim_cache size 0 max 16384 2024-09-19T07:24:29.169 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.164+0000 7fdd9ec58740 1 Processor -- start 2024-09-19T07:24:29.170 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.164+0000 7fdd9ec58740 1 -- start start 2024-09-19T07:24:29.170 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.165+0000 7fdd9ec58740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f48f36caf0 0x55f48f376aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:29.170 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.165+0000 7fdd9ec58740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f48f36d410 0x55f48f3937e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:29.170 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.165+0000 7fdd9ec58740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f48f377cb0 0x55f48f393d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:29.170 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.165+0000 7fdd9ec58740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdd941adda0 con 0x55f48f36d410 2024-09-19T07:24:29.170 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.165+0000 7fdd9ec58740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdd941ab610 con 0x55f48f377cb0 2024-09-19T07:24:29.170 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.165+0000 7fdd9ec58740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdd941a9480 con 0x55f48f36caf0 2024-09-19T07:24:29.170 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.165+0000 7fdd99b80640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f48f36d410 0x55f48f3937e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:29.170 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.165+0000 7fdd99b80640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f48f36d410 0x55f48f3937e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:32890/0 (socket says 172.21.15.148:32890) 2024-09-19T07:24:29.170 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.165+0000 7fdd99b80640 1 -- 172.21.15.148:0/629286034 learned_addr learned my addr 172.21.15.148:0/629286034 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:24:29.170 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.165+0000 7fdd9937f640 1 --2- 172.21.15.148:0/629286034 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f48f36caf0 0x55f48f376aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:29.170 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.165+0000 7fdd99b80640 1 -- 172.21.15.148:0/629286034 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f48f36caf0 msgr2=0x55f48f376aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:29.170 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.165+0000 7fdd99b80640 1 --2- 172.21.15.148:0/629286034 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f48f36caf0 0x55f48f376aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:29.171 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.165+0000 7fdd9937f640 1 --2- 172.21.15.148:0/629286034 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f48f377cb0 0x55f48f393d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:29.171 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.165+0000 7fdd99b80640 1 -- 172.21.15.148:0/629286034 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f48f377cb0 msgr2=0x55f48f393d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:29.171 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.165+0000 7fdd99b80640 1 --2- 172.21.15.148:0/629286034 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f48f377cb0 0x55f48f393d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:29.171 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.165+0000 7fdd99b80640 1 -- 172.21.15.148:0/629286034 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f48f368e90 con 0x55f48f36d410 2024-09-19T07:24:29.171 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.165+0000 7fdd9937f640 1 --2- 172.21.15.148:0/629286034 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f48f377cb0 0x55f48f393d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:24:29.171 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.165+0000 7fdd99b80640 1 --2- 172.21.15.148:0/629286034 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f48f36d410 0x55f48f3937e0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fdd90009ba0 tx=0x7fdd900093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=802fbf2d7ca39909 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:29.171 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.165+0000 7fdd7f7fe640 1 -- 172.21.15.148:0/629286034 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd900142d0 con 0x55f48f36d410 2024-09-19T07:24:29.171 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.165+0000 7fdd7f7fe640 1 -- 172.21.15.148:0/629286034 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd9001b810 con 0x55f48f36d410 2024-09-19T07:24:29.171 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.165+0000 7fdd7f7fe640 1 -- 172.21.15.148:0/629286034 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd900129b0 con 0x55f48f36d410 2024-09-19T07:24:29.171 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.166+0000 7fdd9ec58740 1 -- 172.21.15.148:0/629286034 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f48f36d410 msgr2=0x55f48f3937e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:29.171 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.166+0000 7fdd9ec58740 1 --2- 172.21.15.148:0/629286034 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f48f36d410 0x55f48f3937e0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fdd90009ba0 tx=0x7fdd900093d0 comp rx=0 tx=0).stop 2024-09-19T07:24:29.171 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.166+0000 7fdd9ec58740 1 -- 172.21.15.148:0/629286034 shutdown_connections 2024-09-19T07:24:29.171 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.166+0000 7fdd9ec58740 1 --2- 172.21.15.148:0/629286034 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f48f377cb0 0x55f48f393d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:29.172 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.166+0000 7fdd9ec58740 1 --2- 172.21.15.148:0/629286034 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f48f36d410 0x55f48f3937e0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:29.172 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.166+0000 7fdd9ec58740 1 --2- 172.21.15.148:0/629286034 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f48f36caf0 0x55f48f376aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:29.172 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.166+0000 7fdd9ec58740 1 -- 172.21.15.148:0/629286034 >> 172.21.15.148:0/629286034 conn(0x55f48f369060 msgr2=0x55f48f376390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:29.172 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.166+0000 7fdd9ec58740 1 -- 172.21.15.148:0/629286034 shutdown_connections 2024-09-19T07:24:29.172 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.166+0000 7fdd9ec58740 1 -- 172.21.15.148:0/629286034 wait complete. 2024-09-19T07:24:29.172 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.166+0000 7fdd9ec58740 1 -- start start 2024-09-19T07:24:29.172 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.166+0000 7fdd9ec58740 1 Processor -- start 2024-09-19T07:24:29.172 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.167+0000 7fdd9ec58740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f48f36caf0 0x55f48f37ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:29.172 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.167+0000 7fdd9ec58740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f48f36d410 0x55f48f380510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:29.172 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.167+0000 7fdd9ec58740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f48f377cb0 0x55f48f380a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:29.172 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.167+0000 7fdd9ec58740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdd941a9ad0 con 0x55f48f36caf0 2024-09-19T07:24:29.172 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.167+0000 7fdd9ec58740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdd941aaf40 con 0x55f48f36d410 2024-09-19T07:24:29.172 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.167+0000 7fdd9ec58740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdd941aa1a0 con 0x55f48f377cb0 2024-09-19T07:24:29.173 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.167+0000 7fdd9ec58740 10 client.0 _ll_register_callbacks cb 0x7fdd900092a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:24:29.173 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.167+0000 7fdd9937f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f48f36caf0 0x55f48f37ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:29.173 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.167+0000 7fdd9937f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f48f36caf0 0x55f48f37ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:32892/0 (socket says 172.21.15.148:32892) 2024-09-19T07:24:29.173 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.167+0000 7fdd9937f640 1 -- 172.21.15.148:0/1969997162 learned_addr learned my addr 172.21.15.148:0/1969997162 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:24:29.173 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.167+0000 7fdd99b80640 1 --2- 172.21.15.148:0/1969997162 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f48f36d410 0x55f48f380510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:29.173 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.167+0000 7fdd9937f640 1 --2- 172.21.15.148:0/1969997162 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f48f377cb0 0x55f48f380a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:29.173 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.167+0000 7fdd9937f640 1 -- 172.21.15.148:0/1969997162 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f48f377cb0 msgr2=0x55f48f380a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:29.173 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.167+0000 7fdd9937f640 1 --2- 172.21.15.148:0/1969997162 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f48f377cb0 0x55f48f380a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:29.173 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.167+0000 7fdd9937f640 1 -- 172.21.15.148:0/1969997162 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f48f36d410 msgr2=0x55f48f380510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:29.173 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.167+0000 7fdd9937f640 1 --2- 172.21.15.148:0/1969997162 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f48f36d410 0x55f48f380510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:29.173 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.167+0000 7fdd9937f640 1 -- 172.21.15.148:0/1969997162 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f48f369cf0 con 0x55f48f36caf0 2024-09-19T07:24:29.173 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.167+0000 7fdd9937f640 1 --2- 172.21.15.148:0/1969997162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f48f36caf0 0x55f48f37ffd0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fdd84031bf0 tx=0x7fdd84031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e253931832fa2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:29.173 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.167+0000 7fdd7d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:24:29.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.168+0000 7fdd7d7fa640 1 -- 172.21.15.148:0/1969997162 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd84064060 con 0x55f48f36caf0 2024-09-19T07:24:29.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.168+0000 7fdd7d7fa640 1 -- 172.21.15.148:0/1969997162 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8556+0+0 (secure 0 0 0) 0x7fdd84004040 con 0x55f48f36caf0 2024-09-19T07:24:29.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.168+0000 7fdd9ec58740 1 -- 172.21.15.148:0/1969997162 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd9001b810 con 0x55f48f36caf0 2024-09-19T07:24:29.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.168+0000 7fdd7d7fa640 1 -- 172.21.15.148:0/1969997162 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fdd84035070 con 0x55f48f36caf0 2024-09-19T07:24:29.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.168+0000 7fdd9ec58740 10 client.17364 fetch_fsmap learned FSMap version 47 2024-09-19T07:24:29.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.168+0000 7fdd9ec58740 1 -- 172.21.15.148:0/1969997162 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55f48f3f6960 con 0x55f48f36caf0 2024-09-19T07:24:29.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.168+0000 7fdd7d7fa640 1 -- 172.21.15.148:0/1969997162 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd9001b810 con 0x55f48f36caf0 2024-09-19T07:24:29.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.168+0000 7fdd7d7fa640 1 -- 172.21.15.148:0/1969997162 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 47) ==== 8354+0+0 (secure 0 0 0) 0x7fdd8403d690 con 0x55f48f36caf0 2024-09-19T07:24:29.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.168+0000 7fdd9ec58740 10 client.17364 fetch_fsmap finished waiting for FSMap version 47 2024-09-19T07:24:29.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.168+0000 7fdd9ec58740 10 client.17364 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:24:29.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.168+0000 7fdd9ec58740 20 client.17364 populate_metadata read hostname 'smithi148' 2024-09-19T07:24:29.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.168+0000 7fdd9ec58740 1 --2- 172.21.15.148:0/1969997162 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55f48f3f6fc0 0x55f48f3f93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:29.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.168+0000 7fdd9ec58740 4 client.17364 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:24:29.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.168+0000 7fdd9ec58740 1 -- 172.21.15.148:0/1969997162 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f48f2d8d70 con 0x55f48f3f6fc0 2024-09-19T07:24:29.175 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.168+0000 7fdd99b80640 1 --2- 172.21.15.148:0/1969997162 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55f48f3f6fc0 0x55f48f3f93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:29.175 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.169+0000 7fdd7d7fa640 10 client.17364 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:24:29.175 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.169+0000 7fdd99b80640 1 --2- 172.21.15.148:0/1969997162 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55f48f3f6fc0 0x55f48f3f93e0 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f974e6d6edee912a server_cookie=5954a19ea12c7731 in_seq=0 out_seq=0 2024-09-19T07:24:29.181 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.180+0000 7fdd7d7fa640 1 -- 172.21.15.148:0/1969997162 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f48f2d8d70 con 0x55f48f3f6fc0 2024-09-19T07:24:29.181 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.180+0000 7fdd7d7fa640 10 client.17364 handle_command_reply: tid=0 2024-09-19T07:24:29.181 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.180+0000 7fdd9ec58740 1 client.17364 shutdown 2024-09-19T07:24:29.181 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.180+0000 7fdd9ec58740 1 -- 172.21.15.148:0/1969997162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f48f36caf0 msgr2=0x55f48f37ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:29.181 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.180+0000 7fdd9ec58740 1 --2- 172.21.15.148:0/1969997162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f48f36caf0 0x55f48f37ffd0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fdd84031bf0 tx=0x7fdd84031400 comp rx=0 tx=0).stop 2024-09-19T07:24:29.181 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.180+0000 7fdd9ec58740 1 -- 172.21.15.148:0/1969997162 shutdown_connections 2024-09-19T07:24:29.181 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.180+0000 7fdd9ec58740 1 --2- 172.21.15.148:0/1969997162 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55f48f3f6fc0 0x55f48f3f93e0 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:29.181 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.180+0000 7fdd9ec58740 1 --2- 172.21.15.148:0/1969997162 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f48f377cb0 0x55f48f380a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:29.181 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.180+0000 7fdd7d7fa640 0 client.17364 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:24:29.181 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.180+0000 7fdd9ec58740 1 --2- 172.21.15.148:0/1969997162 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f48f36d410 0x55f48f380510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:29.182 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.180+0000 7fdd9ec58740 1 --2- 172.21.15.148:0/1969997162 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f48f36caf0 0x55f48f37ffd0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:29.182 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.180+0000 7fdd9ec58740 1 -- 172.21.15.148:0/1969997162 >> 172.21.15.148:0/1969997162 conn(0x55f48f369060 msgr2=0x55f48f36ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:29.182 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.180+0000 7fdd9ec58740 1 -- 172.21.15.148:0/1969997162 shutdown_connections 2024-09-19T07:24:29.182 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.180+0000 7fdd9ec58740 1 -- 172.21.15.148:0/1969997162 wait complete. 2024-09-19T07:24:29.182 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.180+0000 7fdd9ec58740 20 client.17364 trim_cache size 0 max 16384 2024-09-19T07:24:29.182 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:24:29.182 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:24:29.182 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:24:29.182 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:24:29.183 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.181+0000 7fdd9bde4640 1 -- 172.21.15.148:0/2530193365 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fdd800a3460 msgr2=0x7fdd800a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:29.183 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.181+0000 7fdd9bde4640 1 --2- 172.21.15.148:0/2530193365 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fdd800a3460 0x7fdd800a5920 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c09c380 tx=0x7fdd8c06f4b0 comp rx=0 tx=0).stop 2024-09-19T07:24:29.183 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.181+0000 7fdd9bde4640 1 -- 172.21.15.148:0/2530193365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd9419cbc0 msgr2=0x7fdd9419d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:29.183 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.181+0000 7fdd9bde4640 1 --2- 172.21.15.148:0/2530193365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd9419cbc0 0x7fdd9419d070 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c00cce0 tx=0x7fdd8c00a620 comp rx=0 tx=0).stop 2024-09-19T07:24:29.183 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.181+0000 7fdd9bde4640 1 -- 172.21.15.148:0/2530193365 shutdown_connections 2024-09-19T07:24:29.184 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.181+0000 7fdd9bde4640 1 --2- 172.21.15.148:0/2530193365 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fdd800a3460 0x7fdd800a5920 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:29.184 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.181+0000 7fdd9bde4640 1 --2- 172.21.15.148:0/2530193365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd9419cbc0 0x7fdd9419d070 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:29.184 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.181+0000 7fdd9bde4640 1 --2- 172.21.15.148:0/2530193365 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdd94106ea0 0x7fdd94198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:29.184 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.181+0000 7fdd9bde4640 1 --2- 172.21.15.148:0/2530193365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd94101960 0x7fdd94198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:29.184 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.181+0000 7fdd9bde4640 1 -- 172.21.15.148:0/2530193365 >> 172.21.15.148:0/2530193365 conn(0x7fdd94075db0 msgr2=0x7fdd941051b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:29.184 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.181+0000 7fdd9bde4640 1 -- 172.21.15.148:0/2530193365 shutdown_connections 2024-09-19T07:24:29.184 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:29.181+0000 7fdd9bde4640 1 -- 172.21.15.148:0/2530193365 wait complete. 2024-09-19T07:24:30.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:24:30 smithi148 ceph-mon[31180]: pgmap v421: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 206 KiB/s wr, 65 op/s 2024-09-19T07:24:30.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:24:30 smithi165 ceph-mon[35326]: pgmap v421: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 206 KiB/s wr, 65 op/s 2024-09-19T07:24:31.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:24:30 smithi179 ceph-mon[35716]: pgmap v421: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 206 KiB/s wr, 65 op/s 2024-09-19T07:24:32.529 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:24:32.792 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:24:32.832 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:24:32 smithi148 ceph-mon[31180]: pgmap v422: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 214 KiB/s wr, 54 op/s 2024-09-19T07:24:32.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:24:32 smithi165 ceph-mon[35326]: pgmap v422: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 214 KiB/s wr, 54 op/s 2024-09-19T07:24:33.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:24:32 smithi179 ceph-mon[35716]: pgmap v422: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 214 KiB/s wr, 54 op/s 2024-09-19T07:24:33.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.291+0000 7fdf08017640 1 -- 172.21.15.148:0/1557300253 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf00102790 msgr2=0x7fdf001067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:33.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.291+0000 7fdf08017640 1 --2- 172.21.15.148:0/1557300253 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf00102790 0x7fdf001067e0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fdef0009900 tx=0x7fdef002a410 comp rx=0 tx=0).stop 2024-09-19T07:24:33.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.291+0000 7fdf08017640 1 -- 172.21.15.148:0/1557300253 shutdown_connections 2024-09-19T07:24:33.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.291+0000 7fdf08017640 1 --2- 172.21.15.148:0/1557300253 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdf00106f10 0x7fdf0010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:33.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.291+0000 7fdf08017640 1 --2- 172.21.15.148:0/1557300253 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf00102790 0x7fdf001067e0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:33.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.291+0000 7fdf08017640 1 --2- 172.21.15.148:0/1557300253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf00101de0 0x7fdf001021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:33.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.291+0000 7fdf08017640 1 -- 172.21.15.148:0/1557300253 >> 172.21.15.148:0/1557300253 conn(0x7fdf000fd8c0 msgr2=0x7fdf000ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:33.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.291+0000 7fdf08017640 1 -- 172.21.15.148:0/1557300253 shutdown_connections 2024-09-19T07:24:33.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.291+0000 7fdf08017640 1 -- 172.21.15.148:0/1557300253 wait complete. 2024-09-19T07:24:33.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.292+0000 7fdf08017640 1 Processor -- start 2024-09-19T07:24:33.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.292+0000 7fdf08017640 1 -- start start 2024-09-19T07:24:33.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.293+0000 7fdf08017640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf00101de0 0x7fdf001985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:33.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.293+0000 7fdf08017640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf00102790 0x7fdf00198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:33.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.293+0000 7fdf08017640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdf00106f10 0x7fdf0019ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:33.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.293+0000 7fdf08017640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdf00112010 con 0x7fdf00102790 2024-09-19T07:24:33.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.293+0000 7fdf08017640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdf00111e90 con 0x7fdf00106f10 2024-09-19T07:24:33.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.293+0000 7fdf08017640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdf00112190 con 0x7fdf00101de0 2024-09-19T07:24:33.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.293+0000 7fdf055b2640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf00102790 0x7fdf00198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:33.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.293+0000 7fdf055b2640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf00102790 0x7fdf00198af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:32904/0 (socket says 172.21.15.148:32904) 2024-09-19T07:24:33.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.293+0000 7fdf055b2640 1 -- 172.21.15.148:0/1956918347 learned_addr learned my addr 172.21.15.148:0/1956918347 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:24:33.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.293+0000 7fdf065b4640 1 --2- 172.21.15.148:0/1956918347 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdf00106f10 0x7fdf0019ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:33.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.293+0000 7fdf05db3640 1 --2- 172.21.15.148:0/1956918347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf00101de0 0x7fdf001985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:33.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.293+0000 7fdf055b2640 1 -- 172.21.15.148:0/1956918347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf00101de0 msgr2=0x7fdf001985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:33.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.293+0000 7fdf055b2640 1 --2- 172.21.15.148:0/1956918347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf00101de0 0x7fdf001985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:33.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.293+0000 7fdf055b2640 1 -- 172.21.15.148:0/1956918347 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdf00106f10 msgr2=0x7fdf0019ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:33.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.293+0000 7fdf055b2640 1 --2- 172.21.15.148:0/1956918347 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdf00106f10 0x7fdf0019ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:33.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.293+0000 7fdf055b2640 1 -- 172.21.15.148:0/1956918347 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf0019d560 con 0x7fdf00102790 2024-09-19T07:24:33.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.293+0000 7fdf065b4640 1 --2- 172.21.15.148:0/1956918347 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdf00106f10 0x7fdf0019ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:24:33.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.293+0000 7fdf055b2640 1 --2- 172.21.15.148:0/1956918347 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf00102790 0x7fdf00198af0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fdef0005ab0 tx=0x7fdef00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:33.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.293+0000 7fdef6ffd640 1 -- 172.21.15.148:0/1956918347 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef003f030 con 0x7fdf00102790 2024-09-19T07:24:33.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.293+0000 7fdef6ffd640 1 -- 172.21.15.148:0/1956918347 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdef0003ce0 con 0x7fdf00102790 2024-09-19T07:24:33.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.293+0000 7fdf08017640 1 -- 172.21.15.148:0/1956918347 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf0019d7f0 con 0x7fdf00102790 2024-09-19T07:24:33.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.293+0000 7fdef6ffd640 1 -- 172.21.15.148:0/1956918347 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef0035070 con 0x7fdf00102790 2024-09-19T07:24:33.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.293+0000 7fdf08017640 1 -- 172.21.15.148:0/1956918347 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf001a5130 con 0x7fdf00102790 2024-09-19T07:24:33.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.294+0000 7fdf08017640 1 -- 172.21.15.148:0/1956918347 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf00102240 con 0x7fdf00102790 2024-09-19T07:24:33.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.296+0000 7fdef6ffd640 1 -- 172.21.15.148:0/1956918347 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fdef0042030 con 0x7fdf00102790 2024-09-19T07:24:33.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.296+0000 7fdef6ffd640 1 --2- 172.21.15.148:0/1956918347 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fdeec0a3430 0x7fdeec0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:33.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.296+0000 7fdef6ffd640 1 -- 172.21.15.148:0/1956918347 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8556+0+0 (secure 0 0 0) 0x7fdef00f08b0 con 0x7fdf00102790 2024-09-19T07:24:33.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.296+0000 7fdf05db3640 1 --2- 172.21.15.148:0/1956918347 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fdeec0a3430 0x7fdeec0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:33.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.297+0000 7fdf05db3640 1 --2- 172.21.15.148:0/1956918347 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fdeec0a3430 0x7fdeec0a58f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdefc009f20 tx=0x7fdefc0094f0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:33.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.300+0000 7fdef6ffd640 1 -- 172.21.15.148:0/1956918347 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdef00bd270 con 0x7fdf00102790 2024-09-19T07:24:33.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.502+0000 7fdf08017640 1 -- 172.21.15.148:0/1956918347 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdf00199910 con 0x7fdf00102790 2024-09-19T07:24:33.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.502+0000 7fdef6ffd640 1 -- 172.21.15.148:0/1956918347 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+11941 (secure 0 0 0) 0x7fdf00199910 con 0x7fdf00102790 2024-09-19T07:24:33.503 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:24:33.503 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":47,"btime":"2024-09-19T07:23:26:615080+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/4263868576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":4263868576},{"type":"v1","addr":"172.21.15.148:6841","nonce":4263868576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":25606,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3891676893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3891676893},{"type":"v1","addr":"172.21.15.179:6835","nonce":3891676893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":47,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:09:19.543369+0000","modified":"2024-09-19T07:23:26.380794+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24457,"mds_1":24437,"mds_2":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":75,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":71,"addr":"172.21.15.165:6839/3993490234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":3993490234},{"type":"v1","addr":"172.21.15.165:6839","nonce":3993490234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25823":{"gid":25823,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6835/380886107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":380886107},{"type":"v1","addr":"172.21.15.165:6835","nonce":380886107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24457,"qdb_cluster":[24457,24437,24436]},"id":1}]} 2024-09-19T07:24:33.504 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 47 2024-09-19T07:24:33.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.505+0000 7fdf08017640 1 -- 172.21.15.148:0/1956918347 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fdeec0a3430 msgr2=0x7fdeec0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:33.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.505+0000 7fdf08017640 1 --2- 172.21.15.148:0/1956918347 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fdeec0a3430 0x7fdeec0a58f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdefc009f20 tx=0x7fdefc0094f0 comp rx=0 tx=0).stop 2024-09-19T07:24:33.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.505+0000 7fdf08017640 1 -- 172.21.15.148:0/1956918347 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf00102790 msgr2=0x7fdf00198af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:33.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.505+0000 7fdf08017640 1 --2- 172.21.15.148:0/1956918347 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf00102790 0x7fdf00198af0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fdef0005ab0 tx=0x7fdef00042f0 comp rx=0 tx=0).stop 2024-09-19T07:24:33.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.505+0000 7fdf08017640 1 -- 172.21.15.148:0/1956918347 shutdown_connections 2024-09-19T07:24:33.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.505+0000 7fdf08017640 1 --2- 172.21.15.148:0/1956918347 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fdeec0a3430 0x7fdeec0a58f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:33.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.505+0000 7fdf08017640 1 --2- 172.21.15.148:0/1956918347 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdf00106f10 0x7fdf0019ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:33.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.505+0000 7fdf08017640 1 --2- 172.21.15.148:0/1956918347 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf00102790 0x7fdf00198af0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:33.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.505+0000 7fdf08017640 1 --2- 172.21.15.148:0/1956918347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf00101de0 0x7fdf001985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:33.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.505+0000 7fdf08017640 1 -- 172.21.15.148:0/1956918347 >> 172.21.15.148:0/1956918347 conn(0x7fdf000fd8c0 msgr2=0x7fdf000fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:33.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.505+0000 7fdf08017640 1 -- 172.21.15.148:0/1956918347 shutdown_connections 2024-09-19T07:24:33.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:33.505+0000 7fdf08017640 1 -- 172.21.15.148:0/1956918347 wait complete. 2024-09-19T07:24:33.832 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:24:33 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/1956918347' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:24:33.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:24:33 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/1956918347' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:24:34.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:24:33 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/1956918347' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:24:34.378 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24457 quiesce db --set-id 3424aa4a --release --await' 2024-09-19T07:24:34.379 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24457 quiesce db --set-id 3424aa4a --release --await 2024-09-19T07:24:34.628 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:24:34.750 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:24:34 smithi148 ceph-mon[31180]: pgmap v423: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 45 KiB/s wr, 48 op/s 2024-09-19T07:24:34.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:24:34 smithi165 ceph-mon[35326]: pgmap v423: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 45 KiB/s wr, 48 op/s 2024-09-19T07:24:35.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:24:34 smithi179 ceph-mon[35716]: pgmap v423: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 45 KiB/s wr, 48 op/s 2024-09-19T07:24:35.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.062+0000 7fb1a3acc640 1 -- 172.21.15.148:0/187384524 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb19c100e20 msgr2=0x7fb19c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:35.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.062+0000 7fb1a3acc640 1 --2- 172.21.15.148:0/187384524 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb19c100e20 0x7fb19c101200 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fb198009900 tx=0x7fb19802a480 comp rx=0 tx=0).stop 2024-09-19T07:24:35.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.062+0000 7fb1a3acc640 1 -- 172.21.15.148:0/187384524 shutdown_connections 2024-09-19T07:24:35.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.062+0000 7fb1a3acc640 1 --2- 172.21.15.148:0/187384524 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb19c102ef0 0x7fb19c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:35.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.062+0000 7fb1a3acc640 1 --2- 172.21.15.148:0/187384524 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb19c102570 0x7fb19c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:35.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.062+0000 7fb1a3acc640 1 --2- 172.21.15.148:0/187384524 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb19c100e20 0x7fb19c101200 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:35.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.062+0000 7fb1a3acc640 1 -- 172.21.15.148:0/187384524 >> 172.21.15.148:0/187384524 conn(0x7fb19c0fc7d0 msgr2=0x7fb19c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:35.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.062+0000 7fb1a3acc640 1 -- 172.21.15.148:0/187384524 shutdown_connections 2024-09-19T07:24:35.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.062+0000 7fb1a3acc640 1 -- 172.21.15.148:0/187384524 wait complete. 2024-09-19T07:24:35.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.063+0000 7fb1a3acc640 1 Processor -- start 2024-09-19T07:24:35.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.063+0000 7fb1a3acc640 1 -- start start 2024-09-19T07:24:35.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.063+0000 7fb1a3acc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb19c100e20 0x7fb19c198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:35.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.063+0000 7fb1a3acc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb19c102570 0x7fb19c198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:35.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.063+0000 7fb1a3acc640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb19c102ef0 0x7fb19c19cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:35.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.063+0000 7fb1a3acc640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb19c110f80 con 0x7fb19c100e20 2024-09-19T07:24:35.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.063+0000 7fb1a3acc640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb19c110e00 con 0x7fb19c102ef0 2024-09-19T07:24:35.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.063+0000 7fb1a3acc640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb19c111100 con 0x7fb19c102570 2024-09-19T07:24:35.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.063+0000 7fb1a1868640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb19c100e20 0x7fb19c198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:35.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.063+0000 7fb1a1868640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb19c100e20 0x7fb19c198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35672/0 (socket says 172.21.15.148:35672) 2024-09-19T07:24:35.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.063+0000 7fb1a1868640 1 -- 172.21.15.148:0/1832568756 learned_addr learned my addr 172.21.15.148:0/1832568756 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:24:35.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.064+0000 7fb1a1067640 1 --2- 172.21.15.148:0/1832568756 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb19c102570 0x7fb19c198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:35.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.064+0000 7fb1a2069640 1 --2- 172.21.15.148:0/1832568756 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb19c102ef0 0x7fb19c19cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:35.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.064+0000 7fb1a1868640 1 -- 172.21.15.148:0/1832568756 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb19c102570 msgr2=0x7fb19c198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:35.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.064+0000 7fb1a1868640 1 --2- 172.21.15.148:0/1832568756 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb19c102570 0x7fb19c198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:35.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.064+0000 7fb1a1868640 1 -- 172.21.15.148:0/1832568756 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb19c102ef0 msgr2=0x7fb19c19cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:35.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.064+0000 7fb1a1868640 1 --2- 172.21.15.148:0/1832568756 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb19c102ef0 0x7fb19c19cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:35.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.064+0000 7fb1a1868640 1 -- 172.21.15.148:0/1832568756 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb19c19d3e0 con 0x7fb19c100e20 2024-09-19T07:24:35.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.064+0000 7fb1a1868640 1 --2- 172.21.15.148:0/1832568756 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb19c100e20 0x7fb19c198430 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fb198006010 tx=0x7fb198003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:35.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.064+0000 7fb192ffd640 1 -- 172.21.15.148:0/1832568756 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb19803f070 con 0x7fb19c100e20 2024-09-19T07:24:35.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.064+0000 7fb1a3acc640 1 -- 172.21.15.148:0/1832568756 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb19c19d670 con 0x7fb19c100e20 2024-09-19T07:24:35.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.064+0000 7fb192ffd640 1 -- 172.21.15.148:0/1832568756 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb198031e30 con 0x7fb19c100e20 2024-09-19T07:24:35.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.064+0000 7fb192ffd640 1 -- 172.21.15.148:0/1832568756 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb198035030 con 0x7fb19c100e20 2024-09-19T07:24:35.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.064+0000 7fb1a3acc640 1 -- 172.21.15.148:0/1832568756 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb19c1a4fb0 con 0x7fb19c100e20 2024-09-19T07:24:35.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.066+0000 7fb192ffd640 1 -- 172.21.15.148:0/1832568756 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fb198042070 con 0x7fb19c100e20 2024-09-19T07:24:35.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.067+0000 7fb1a5ea5740 1 Processor -- start 2024-09-19T07:24:35.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.067+0000 7fb1a5ea5740 1 -- start start 2024-09-19T07:24:35.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.067+0000 7fb1a5ea5740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561de2c3bf40 0x561de2c3c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:35.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.067+0000 7fb1a5ea5740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561de2c3c860 0x561de2c4b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:35.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.067+0000 7fb192ffd640 1 --2- 172.21.15.148:0/1832568756 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fb1880a33b0 0x7fb1880a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:35.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.067+0000 7fb1a5ea5740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561de2c4b650 0x561de2c4da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:35.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.067+0000 7fb1a5ea5740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x561de2ba1620 con 0x561de2c4b650 2024-09-19T07:24:35.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.067+0000 7fb1a5ea5740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x561de2b48e50 con 0x561de2c3bf40 2024-09-19T07:24:35.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.067+0000 7fb1a5ea5740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x561de2b9d5e0 con 0x561de2c3c860 2024-09-19T07:24:35.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.067+0000 7fb1a2069640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561de2c4b650 0x561de2c4da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:35.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.067+0000 7fb1a2069640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561de2c4b650 0x561de2c4da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35678/0 (socket says 172.21.15.148:35678) 2024-09-19T07:24:35.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.067+0000 7fb1a2069640 1 -- 172.21.15.148:0/2646815220 learned_addr learned my addr 172.21.15.148:0/2646815220 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:24:35.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.068+0000 7fb192ffd640 1 -- 172.21.15.148:0/1832568756 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8556+0+0 (secure 0 0 0) 0x7fb1980f0580 con 0x7fb19c100e20 2024-09-19T07:24:35.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.068+0000 7fb1a1067640 1 --2- 172.21.15.148:0/1832568756 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fb1880a33b0 0x7fb1880a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:35.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.068+0000 7fb1a1868640 1 --2- 172.21.15.148:0/2646815220 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561de2c3c860 0x561de2c4b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:35.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.068+0000 7fb1a2069640 1 --2- 172.21.15.148:0/2646815220 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561de2c3bf40 0x561de2c3c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:35.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.068+0000 7fb1a1868640 1 -- 172.21.15.148:0/2646815220 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561de2c3bf40 msgr2=0x561de2c3c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:35.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.068+0000 7fb1a1868640 1 --2- 172.21.15.148:0/2646815220 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561de2c3bf40 0x561de2c3c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:35.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.068+0000 7fb1a1868640 1 -- 172.21.15.148:0/2646815220 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561de2c4b650 msgr2=0x561de2c4da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:35.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.068+0000 7fb1a1868640 1 --2- 172.21.15.148:0/2646815220 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561de2c4b650 0x561de2c4da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:35.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.068+0000 7fb1a1868640 1 -- 172.21.15.148:0/2646815220 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561de2b39d40 con 0x561de2c3c860 2024-09-19T07:24:35.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.068+0000 7fb1a2069640 1 --2- 172.21.15.148:0/2646815220 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561de2c4b650 0x561de2c4da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:24:35.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.068+0000 7fb1a1067640 1 --2- 172.21.15.148:0/1832568756 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fb1880a33b0 0x7fb1880a5870 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb19c0ffea0 tx=0x7fb18c00a2d0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:35.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.068+0000 7fb1a1868640 1 --2- 172.21.15.148:0/2646815220 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561de2c3c860 0x561de2c4b110 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb1980edcb0 tx=0x7fb1980b8c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b51d8b8a79334e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:35.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.068+0000 7fb187fff640 1 -- 172.21.15.148:0/2646815220 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb198049070 con 0x561de2c3c860 2024-09-19T07:24:35.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.068+0000 7fb187fff640 1 -- 172.21.15.148:0/2646815220 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb19803be50 con 0x561de2c3c860 2024-09-19T07:24:35.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.068+0000 7fb187fff640 1 -- 172.21.15.148:0/2646815220 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1980b8eb0 con 0x561de2c3c860 2024-09-19T07:24:35.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.069+0000 7fb1a5ea5740 1 -- 172.21.15.148:0/2646815220 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561de2c3c860 msgr2=0x561de2c4b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:35.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.069+0000 7fb1a5ea5740 1 --2- 172.21.15.148:0/2646815220 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561de2c3c860 0x561de2c4b110 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb1980edcb0 tx=0x7fb1980b8c10 comp rx=0 tx=0).stop 2024-09-19T07:24:35.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.069+0000 7fb1a5ea5740 1 -- 172.21.15.148:0/2646815220 shutdown_connections 2024-09-19T07:24:35.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.069+0000 7fb1a5ea5740 1 --2- 172.21.15.148:0/2646815220 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561de2c4b650 0x561de2c4da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:35.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.069+0000 7fb1a5ea5740 1 --2- 172.21.15.148:0/2646815220 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561de2c3c860 0x561de2c4b110 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:35.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.069+0000 7fb1a5ea5740 1 --2- 172.21.15.148:0/2646815220 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561de2c3bf40 0x561de2c3c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:35.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.069+0000 7fb1a5ea5740 1 -- 172.21.15.148:0/2646815220 >> 172.21.15.148:0/2646815220 conn(0x561de2c385f0 msgr2=0x561de2c389d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:35.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.069+0000 7fb1a5ea5740 1 -- 172.21.15.148:0/2646815220 shutdown_connections 2024-09-19T07:24:35.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.069+0000 7fb1a5ea5740 1 -- 172.21.15.148:0/2646815220 wait complete. 2024-09-19T07:24:35.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.070+0000 7fb1a5ea5740 1 -- start start 2024-09-19T07:24:35.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.070+0000 7fb1a5ea5740 1 Processor -- start 2024-09-19T07:24:35.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.070+0000 7fb1a5ea5740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561de2c3bf40 0x561de2c48660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:35.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.070+0000 7fb1a5ea5740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561de2c3c860 0x561de2c48ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:35.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.070+0000 7fb1a5ea5740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561de2c4b650 0x561de2c490e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:35.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.070+0000 7fb1a5ea5740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x561de2c4dfe0 con 0x561de2c4b650 2024-09-19T07:24:35.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.070+0000 7fb1a5ea5740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x561de2b29f10 con 0x561de2c3c860 2024-09-19T07:24:35.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.070+0000 7fb1a5ea5740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x561de2c4e160 con 0x561de2c3bf40 2024-09-19T07:24:35.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.070+0000 7fb1a5ea5740 10 client.0 _ll_register_callbacks cb 0x561de2b4ddb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:24:35.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.070+0000 7fb1a2069640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561de2c4b650 0x561de2c490e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:35.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.070+0000 7fb1a2069640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561de2c4b650 0x561de2c490e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35688/0 (socket says 172.21.15.148:35688) 2024-09-19T07:24:35.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.070+0000 7fb1a2069640 1 -- 172.21.15.148:0/3789745838 learned_addr learned my addr 172.21.15.148:0/3789745838 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:24:35.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.070+0000 7fb1a1868640 1 --2- 172.21.15.148:0/3789745838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561de2c3bf40 0x561de2c48660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:35.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.070+0000 7fb1a1067640 1 --2- 172.21.15.148:0/3789745838 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561de2c3c860 0x561de2c48ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:35.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.071+0000 7fb1a2069640 1 -- 172.21.15.148:0/3789745838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561de2c3bf40 msgr2=0x561de2c48660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:35.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.071+0000 7fb1a2069640 1 --2- 172.21.15.148:0/3789745838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561de2c3bf40 0x561de2c48660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:35.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.071+0000 7fb1a2069640 1 -- 172.21.15.148:0/3789745838 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561de2c3c860 msgr2=0x561de2c48ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:35.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.071+0000 7fb1a2069640 1 --2- 172.21.15.148:0/3789745838 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561de2c3c860 0x561de2c48ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:35.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.071+0000 7fb1a2069640 1 -- 172.21.15.148:0/3789745838 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561de28b0580 con 0x561de2c4b650 2024-09-19T07:24:35.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.071+0000 7fb1a2069640 1 --2- 172.21.15.148:0/3789745838 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561de2c4b650 0x561de2c490e0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fb194014e00 tx=0x7fb194012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e8baf68af2484df server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:35.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.071+0000 7fb1857fa640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:24:35.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.071+0000 7fb1857fa640 1 -- 172.21.15.148:0/3789745838 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb194004d20 con 0x561de2c4b650 2024-09-19T07:24:35.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.071+0000 7fb1857fa640 1 -- 172.21.15.148:0/3789745838 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8556+0+0 (secure 0 0 0) 0x7fb194011650 con 0x561de2c4b650 2024-09-19T07:24:35.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.071+0000 7fb1a5ea5740 1 -- 172.21.15.148:0/3789745838 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb19803be50 con 0x561de2c4b650 2024-09-19T07:24:35.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.071+0000 7fb1857fa640 1 -- 172.21.15.148:0/3789745838 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fb194025050 con 0x561de2c4b650 2024-09-19T07:24:35.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.071+0000 7fb1a5ea5740 10 client.17382 fetch_fsmap learned FSMap version 47 2024-09-19T07:24:35.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.071+0000 7fb1a5ea5740 1 -- 172.21.15.148:0/3789745838 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x561de297a960 con 0x561de2c4b650 2024-09-19T07:24:35.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.071+0000 7fb1857fa640 1 -- 172.21.15.148:0/3789745838 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb19803be50 con 0x561de2c4b650 2024-09-19T07:24:35.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.072+0000 7fb1857fa640 1 -- 172.21.15.148:0/3789745838 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 47) ==== 8354+0+0 (secure 0 0 0) 0x7fb19400f930 con 0x561de2c4b650 2024-09-19T07:24:35.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.072+0000 7fb1a5ea5740 10 client.17382 fetch_fsmap finished waiting for FSMap version 47 2024-09-19T07:24:35.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.072+0000 7fb1a5ea5740 10 client.17382 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:24:35.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.072+0000 7fb1a5ea5740 20 client.17382 populate_metadata read hostname 'smithi148' 2024-09-19T07:24:35.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.072+0000 7fb1a5ea5740 1 --2- 172.21.15.148:0/3789745838 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561de2c5b170 0x561de2c5d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:35.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.072+0000 7fb1a5ea5740 4 client.17382 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:24:35.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.072+0000 7fb1a5ea5740 1 -- 172.21.15.148:0/3789745838 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561de2baeb90 con 0x561de2c5b170 2024-09-19T07:24:35.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.072+0000 7fb1a1868640 1 --2- 172.21.15.148:0/3789745838 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561de2c5b170 0x561de2c5d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:35.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.072+0000 7fb1857fa640 10 client.17382 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:24:35.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.072+0000 7fb1a1868640 1 --2- 172.21.15.148:0/3789745838 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561de2c5b170 0x561de2c5d5d0 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32b59269926bd88 server_cookie=3fecd315aa7a0b3b in_seq=0 out_seq=0 2024-09-19T07:24:35.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.073+0000 7fb1857fa640 1 -- 172.21.15.148:0/3789745838 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561de2baeb90 con 0x561de2c5b170 2024-09-19T07:24:35.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.073+0000 7fb1857fa640 10 client.17382 handle_command_reply: tid=0 2024-09-19T07:24:35.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.073+0000 7fb1a5ea5740 1 client.17382 shutdown 2024-09-19T07:24:35.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.073+0000 7fb1a5ea5740 1 -- 172.21.15.148:0/3789745838 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561de2c4b650 msgr2=0x561de2c490e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:35.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.073+0000 7fb1a5ea5740 1 --2- 172.21.15.148:0/3789745838 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561de2c4b650 0x561de2c490e0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fb194014e00 tx=0x7fb194012820 comp rx=0 tx=0).stop 2024-09-19T07:24:35.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.073+0000 7fb1a5ea5740 1 -- 172.21.15.148:0/3789745838 shutdown_connections 2024-09-19T07:24:35.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.073+0000 7fb1a5ea5740 1 --2- 172.21.15.148:0/3789745838 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561de2c5b170 0x561de2c5d5d0 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:35.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.073+0000 7fb1a5ea5740 1 --2- 172.21.15.148:0/3789745838 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561de2c4b650 0x561de2c490e0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:35.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.073+0000 7fb1a5ea5740 1 --2- 172.21.15.148:0/3789745838 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561de2c3c860 0x561de2c48ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:35.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.073+0000 7fb1857fa640 0 client.17382 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:24:35.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.073+0000 7fb1a5ea5740 1 --2- 172.21.15.148:0/3789745838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561de2c3bf40 0x561de2c48660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:35.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.073+0000 7fb1a5ea5740 1 -- 172.21.15.148:0/3789745838 >> 172.21.15.148:0/3789745838 conn(0x561de2c385f0 msgr2=0x561de2c3e350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:35.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.073+0000 7fb1a5ea5740 1 -- 172.21.15.148:0/3789745838 shutdown_connections 2024-09-19T07:24:35.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.073+0000 7fb1a5ea5740 1 -- 172.21.15.148:0/3789745838 wait complete. 2024-09-19T07:24:35.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.073+0000 7fb1a5ea5740 20 client.17382 trim_cache size 0 max 16384 2024-09-19T07:24:35.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.090+0000 7fb1a5ea5740 1 Processor -- start 2024-09-19T07:24:35.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.090+0000 7fb1a5ea5740 1 -- start start 2024-09-19T07:24:35.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.090+0000 7fb1a5ea5740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561de2c3bf40 0x561de2c46f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:35.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.090+0000 7fb1a5ea5740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561de2c3c860 0x561de2c37640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:35.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.090+0000 7fb1a5ea5740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561de2c4b650 0x561de2c62ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:35.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.090+0000 7fb1a5ea5740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb19c1ade60 con 0x561de2c3c860 2024-09-19T07:24:35.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.090+0000 7fb1a5ea5740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb19c1ab6d0 con 0x561de2c4b650 2024-09-19T07:24:35.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.090+0000 7fb1a5ea5740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb19c1a9540 con 0x561de2c3bf40 2024-09-19T07:24:35.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.091+0000 7fb1a1067640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561de2c3c860 0x561de2c37640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:35.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.091+0000 7fb1a1067640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561de2c3c860 0x561de2c37640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35694/0 (socket says 172.21.15.148:35694) 2024-09-19T07:24:35.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.091+0000 7fb1a1067640 1 -- 172.21.15.148:0/1600061258 learned_addr learned my addr 172.21.15.148:0/1600061258 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:24:35.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.091+0000 7fb1a1868640 1 --2- 172.21.15.148:0/1600061258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561de2c3bf40 0x561de2c46f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:35.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.091+0000 7fb1a1067640 1 -- 172.21.15.148:0/1600061258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561de2c3bf40 msgr2=0x561de2c46f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:35.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.091+0000 7fb1a2069640 1 --2- 172.21.15.148:0/1600061258 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561de2c4b650 0x561de2c62ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:35.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.091+0000 7fb1a1067640 1 --2- 172.21.15.148:0/1600061258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561de2c3bf40 0x561de2c46f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:35.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.091+0000 7fb1a1067640 1 -- 172.21.15.148:0/1600061258 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561de2c4b650 msgr2=0x561de2c62ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:35.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.091+0000 7fb1a1067640 1 --2- 172.21.15.148:0/1600061258 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561de2c4b650 0x561de2c62ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:35.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.091+0000 7fb1a1067640 1 -- 172.21.15.148:0/1600061258 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561de2c5dc50 con 0x561de2c3c860 2024-09-19T07:24:35.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.091+0000 7fb1a2069640 1 --2- 172.21.15.148:0/1600061258 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561de2c4b650 0x561de2c62ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:24:35.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.091+0000 7fb1a1067640 1 --2- 172.21.15.148:0/1600061258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561de2c3c860 0x561de2c37640 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fb18c010010 tx=0x7fb18c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c0789add5a4317a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:35.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.091+0000 7fb1877fe640 1 -- 172.21.15.148:0/1600061258 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb18c02a070 con 0x561de2c3c860 2024-09-19T07:24:35.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.091+0000 7fb1877fe640 1 -- 172.21.15.148:0/1600061258 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb18c010c90 con 0x561de2c3c860 2024-09-19T07:24:35.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.091+0000 7fb1877fe640 1 -- 172.21.15.148:0/1600061258 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb18c016070 con 0x561de2c3c860 2024-09-19T07:24:35.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.092+0000 7fb1a5ea5740 1 -- 172.21.15.148:0/1600061258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561de2c3c860 msgr2=0x561de2c37640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:35.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.092+0000 7fb1a5ea5740 1 --2- 172.21.15.148:0/1600061258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561de2c3c860 0x561de2c37640 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fb18c010010 tx=0x7fb18c012000 comp rx=0 tx=0).stop 2024-09-19T07:24:35.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.092+0000 7fb1a5ea5740 1 -- 172.21.15.148:0/1600061258 shutdown_connections 2024-09-19T07:24:35.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.092+0000 7fb1a5ea5740 1 --2- 172.21.15.148:0/1600061258 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561de2c4b650 0x561de2c62ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:35.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.092+0000 7fb1a5ea5740 1 --2- 172.21.15.148:0/1600061258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561de2c3c860 0x561de2c37640 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:35.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.092+0000 7fb1a5ea5740 1 --2- 172.21.15.148:0/1600061258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561de2c3bf40 0x561de2c46f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:35.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.092+0000 7fb1a5ea5740 1 -- 172.21.15.148:0/1600061258 >> 172.21.15.148:0/1600061258 conn(0x561de2c385f0 msgr2=0x561de2c36f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:35.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.092+0000 7fb1a5ea5740 1 -- 172.21.15.148:0/1600061258 shutdown_connections 2024-09-19T07:24:35.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.092+0000 7fb1a5ea5740 1 -- 172.21.15.148:0/1600061258 wait complete. 2024-09-19T07:24:35.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.092+0000 7fb1a5ea5740 1 -- start start 2024-09-19T07:24:35.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.092+0000 7fb1a5ea5740 1 Processor -- start 2024-09-19T07:24:35.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.093+0000 7fb1a5ea5740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561de2c3bf40 0x561de2c4f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:35.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.093+0000 7fb1a5ea5740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561de2c3c860 0x561de2c4fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:35.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.093+0000 7fb1a5ea5740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561de2c4b650 0x561de2cc4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:35.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.093+0000 7fb1a5ea5740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb19c1a9b90 con 0x561de2c3c860 2024-09-19T07:24:35.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.093+0000 7fb1a5ea5740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb19c1ab000 con 0x561de2c3bf40 2024-09-19T07:24:35.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.093+0000 7fb1a5ea5740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb19c1aa260 con 0x561de2c4b650 2024-09-19T07:24:35.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.093+0000 7fb1a5ea5740 10 client.0 _ll_register_callbacks cb 0x7fb194014360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:24:35.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.093+0000 7fb1a1067640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561de2c3c860 0x561de2c4fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:35.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.093+0000 7fb1a1067640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561de2c3c860 0x561de2c4fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35710/0 (socket says 172.21.15.148:35710) 2024-09-19T07:24:35.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.093+0000 7fb1a1067640 1 -- 172.21.15.148:0/1823746743 learned_addr learned my addr 172.21.15.148:0/1823746743 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:24:35.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.093+0000 7fb1a2069640 1 --2- 172.21.15.148:0/1823746743 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561de2c4b650 0x561de2cc4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:35.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.093+0000 7fb1a1868640 1 --2- 172.21.15.148:0/1823746743 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561de2c3bf40 0x561de2c4f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:35.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.093+0000 7fb1a1067640 1 -- 172.21.15.148:0/1823746743 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561de2c4b650 msgr2=0x561de2cc4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:35.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.093+0000 7fb1a1067640 1 --2- 172.21.15.148:0/1823746743 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561de2c4b650 0x561de2cc4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:35.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.093+0000 7fb1a1067640 1 -- 172.21.15.148:0/1823746743 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561de2c3bf40 msgr2=0x561de2c4f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:35.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.093+0000 7fb1a1067640 1 --2- 172.21.15.148:0/1823746743 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561de2c3bf40 0x561de2c4f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:35.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.093+0000 7fb1a1067640 1 -- 172.21.15.148:0/1823746743 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561de2cc5460 con 0x561de2c3c860 2024-09-19T07:24:35.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.093+0000 7fb1a2069640 1 --2- 172.21.15.148:0/1823746743 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561de2c4b650 0x561de2cc4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:24:35.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.093+0000 7fb1a1067640 1 --2- 172.21.15.148:0/1823746743 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561de2c3c860 0x561de2c4fe30 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fb18c010910 tx=0x7fb18c01dfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13f6df7c99b9a59e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:35.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.093+0000 7fb1857fa640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:24:35.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.094+0000 7fb1857fa640 1 -- 172.21.15.148:0/1823746743 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb18c02a040 con 0x561de2c3c860 2024-09-19T07:24:35.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.094+0000 7fb1857fa640 1 -- 172.21.15.148:0/1823746743 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8556+0+0 (secure 0 0 0) 0x7fb18c01c420 con 0x561de2c3c860 2024-09-19T07:24:35.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.094+0000 7fb1a5ea5740 1 -- 172.21.15.148:0/1823746743 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb18c010c90 con 0x561de2c3c860 2024-09-19T07:24:35.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.094+0000 7fb1857fa640 1 -- 172.21.15.148:0/1823746743 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fb18c03d050 con 0x561de2c3c860 2024-09-19T07:24:35.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.094+0000 7fb1a5ea5740 10 client.17388 fetch_fsmap learned FSMap version 47 2024-09-19T07:24:35.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.094+0000 7fb1a5ea5740 1 -- 172.21.15.148:0/1823746743 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x561de2cc66b0 con 0x561de2c3c860 2024-09-19T07:24:35.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.094+0000 7fb1857fa640 1 -- 172.21.15.148:0/1823746743 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb18c010c90 con 0x561de2c3c860 2024-09-19T07:24:35.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.094+0000 7fb1857fa640 1 -- 172.21.15.148:0/1823746743 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 47) ==== 8354+0+0 (secure 0 0 0) 0x7fb18c038030 con 0x561de2c3c860 2024-09-19T07:24:35.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.094+0000 7fb1a5ea5740 10 client.17388 fetch_fsmap finished waiting for FSMap version 47 2024-09-19T07:24:35.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.094+0000 7fb1a5ea5740 10 client.17388 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:24:35.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.094+0000 7fb1a5ea5740 20 client.17388 populate_metadata read hostname 'smithi148' 2024-09-19T07:24:35.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.094+0000 7fb1a5ea5740 1 --2- 172.21.15.148:0/1823746743 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561de2cc6e60 0x561de2cc9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:35.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.094+0000 7fb1a5ea5740 4 client.17388 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "3424aa4a", "release": true, "await": true}] 2024-09-19T07:24:35.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.094+0000 7fb1a5ea5740 1 -- 172.21.15.148:0/1823746743 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "quiesce db", "set_id": "3424aa4a", "release": true, "await": true}) -- 0x561de2ba90a0 con 0x561de2cc6e60 2024-09-19T07:24:35.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.094+0000 7fb1a1868640 1 --2- 172.21.15.148:0/1823746743 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561de2cc6e60 0x561de2cc9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:35.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.095+0000 7fb1a1868640 1 --2- 172.21.15.148:0/1823746743 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561de2cc6e60 0x561de2cc9280 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cead52c26f7d417 server_cookie=350bbb8c565f1e2 in_seq=0 out_seq=0 2024-09-19T07:24:35.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:35.095+0000 7fb1857fa640 10 client.17388 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:24:36.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:36.183+0000 7fb1857fa640 1 -- 172.21.15.148:0/1823746743 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x561de2ba90a0 con 0x561de2cc6e60 2024-09-19T07:24:36.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:36.183+0000 7fb1857fa640 10 client.17388 handle_command_reply: tid=0 2024-09-19T07:24:36.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:36.183+0000 7fb1a5ea5740 1 client.17388 shutdown 2024-09-19T07:24:36.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:36.183+0000 7fb1a5ea5740 1 -- 172.21.15.148:0/1823746743 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561de2c3c860 msgr2=0x561de2c4fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:36.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:36.183+0000 7fb1a5ea5740 1 --2- 172.21.15.148:0/1823746743 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561de2c3c860 0x561de2c4fe30 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fb18c010910 tx=0x7fb18c01dfd0 comp rx=0 tx=0).stop 2024-09-19T07:24:36.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:36.183+0000 7fb1a5ea5740 1 -- 172.21.15.148:0/1823746743 shutdown_connections 2024-09-19T07:24:36.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:36.183+0000 7fb1a5ea5740 1 --2- 172.21.15.148:0/1823746743 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561de2cc6e60 0x561de2cc9280 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:36.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:36.183+0000 7fb1a5ea5740 1 --2- 172.21.15.148:0/1823746743 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561de2c4b650 0x561de2cc4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:36.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:36.183+0000 7fb1a5ea5740 1 --2- 172.21.15.148:0/1823746743 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561de2c3c860 0x561de2c4fe30 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:36.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:36.183+0000 7fb1a5ea5740 1 --2- 172.21.15.148:0/1823746743 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561de2c3bf40 0x561de2c4f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:36.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:36.183+0000 7fb1857fa640 0 client.17388 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:24:36.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:36.183+0000 7fb1a5ea5740 1 -- 172.21.15.148:0/1823746743 >> 172.21.15.148:0/1823746743 conn(0x561de2c385f0 msgr2=0x561de2c37750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:36.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:36.183+0000 7fb1a5ea5740 1 -- 172.21.15.148:0/1823746743 shutdown_connections 2024-09-19T07:24:36.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:36.183+0000 7fb1a5ea5740 1 -- 172.21.15.148:0/1823746743 wait complete. 2024-09-19T07:24:36.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:36.183+0000 7fb1a5ea5740 20 client.17388 trim_cache size 0 max 16384 2024-09-19T07:24:36.185 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:24:36.186 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 47, 2024-09-19T07:24:36.186 INFO:teuthology.orchestra.run.smithi148.stdout: "leader": 24457, 2024-09-19T07:24:36.186 INFO:teuthology.orchestra.run.smithi148.stdout: "set_version": 44, 2024-09-19T07:24:36.186 INFO:teuthology.orchestra.run.smithi148.stdout: "sets": { 2024-09-19T07:24:36.186 INFO:teuthology.orchestra.run.smithi148.stdout: "3424aa4a": { 2024-09-19T07:24:36.186 INFO:teuthology.orchestra.run.smithi148.stdout: "version": 44, 2024-09-19T07:24:36.186 INFO:teuthology.orchestra.run.smithi148.stdout: "age_ref": 0.0, 2024-09-19T07:24:36.186 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:24:36.186 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RELEASED", 2024-09-19T07:24:36.186 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:24:36.186 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:24:36.187 INFO:teuthology.orchestra.run.smithi148.stdout: "timeout": 90.0, 2024-09-19T07:24:36.187 INFO:teuthology.orchestra.run.smithi148.stdout: "expiration": 142.2, 2024-09-19T07:24:36.187 INFO:teuthology.orchestra.run.smithi148.stdout: "members": { 2024-09-19T07:24:36.187 INFO:teuthology.orchestra.run.smithi148.stdout: "file:/": { 2024-09-19T07:24:36.187 INFO:teuthology.orchestra.run.smithi148.stdout: "excluded": false, 2024-09-19T07:24:36.187 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:24:36.187 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RELEASED", 2024-09-19T07:24:36.187 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:24:36.187 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:24:36.187 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:24:36.187 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:24:36.187 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:24:36.187 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:24:36.188 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:24:36.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:36.184+0000 7fb1a3acc640 1 -- 172.21.15.148:0/1832568756 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fb1880a33b0 msgr2=0x7fb1880a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:36.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:36.184+0000 7fb1a3acc640 1 --2- 172.21.15.148:0/1832568756 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fb1880a33b0 0x7fb1880a5870 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb19c0ffea0 tx=0x7fb18c00a2d0 comp rx=0 tx=0).stop 2024-09-19T07:24:36.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:36.184+0000 7fb1a3acc640 1 -- 172.21.15.148:0/1832568756 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb19c100e20 msgr2=0x7fb19c198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:36.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:36.184+0000 7fb1a3acc640 1 --2- 172.21.15.148:0/1832568756 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb19c100e20 0x7fb19c198430 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fb198006010 tx=0x7fb198003c80 comp rx=0 tx=0).stop 2024-09-19T07:24:36.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:36.184+0000 7fb1a3acc640 1 -- 172.21.15.148:0/1832568756 shutdown_connections 2024-09-19T07:24:36.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:36.184+0000 7fb1a3acc640 1 --2- 172.21.15.148:0/1832568756 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fb1880a33b0 0x7fb1880a5870 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:36.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:36.184+0000 7fb1a3acc640 1 --2- 172.21.15.148:0/1832568756 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb19c102ef0 0x7fb19c19cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:36.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:36.184+0000 7fb1a3acc640 1 --2- 172.21.15.148:0/1832568756 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb19c102570 0x7fb19c198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:36.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:36.184+0000 7fb1a3acc640 1 --2- 172.21.15.148:0/1832568756 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb19c100e20 0x7fb19c198430 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:36.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:36.184+0000 7fb1a3acc640 1 -- 172.21.15.148:0/1832568756 >> 172.21.15.148:0/1832568756 conn(0x7fb19c0fc7d0 msgr2=0x7fb19c06a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:36.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:36.184+0000 7fb1a3acc640 1 -- 172.21.15.148:0/1832568756 shutdown_connections 2024-09-19T07:24:36.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:36.184+0000 7fb1a3acc640 1 -- 172.21.15.148:0/1832568756 wait complete. 2024-09-19T07:24:36.822 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:24:36 smithi148 ceph-mon[31180]: pgmap v424: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 41 KiB/s wr, 42 op/s 2024-09-19T07:24:36.853 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '3424aa4a', total seconds elapsed: 26.6 2024-09-19T07:24:36.853 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 22.2 2024-09-19T07:24:36.853 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:24:36.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:24:36 smithi165 ceph-mon[35326]: pgmap v424: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 41 KiB/s wr, 42 op/s 2024-09-19T07:24:37.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:24:36 smithi179 ceph-mon[35716]: pgmap v424: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 41 KiB/s wr, 42 op/s 2024-09-19T07:24:37.113 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:24:37.676 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.649+0000 7f86ae890640 1 -- 172.21.15.148:0/2174457178 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86a8074f40 msgr2=0x7f86a810de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:37.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.649+0000 7f86ae890640 1 --2- 172.21.15.148:0/2174457178 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86a8074f40 0x7f86a810de70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f869c009900 tx=0x7f869c02a480 comp rx=0 tx=0).stop 2024-09-19T07:24:37.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.649+0000 7f86ae890640 1 -- 172.21.15.148:0/2174457178 shutdown_connections 2024-09-19T07:24:37.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.649+0000 7f86ae890640 1 --2- 172.21.15.148:0/2174457178 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86a810e3b0 0x7f86a8110800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:37.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.649+0000 7f86ae890640 1 --2- 172.21.15.148:0/2174457178 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86a8074f40 0x7f86a810de70 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:37.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.649+0000 7f86ae890640 1 --2- 172.21.15.148:0/2174457178 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86a8074620 0x7f86a8074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:37.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.649+0000 7f86ae890640 1 -- 172.21.15.148:0/2174457178 >> 172.21.15.148:0/2174457178 conn(0x7f86a80fd890 msgr2=0x7f86a80ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:37.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.649+0000 7f86ae890640 1 -- 172.21.15.148:0/2174457178 shutdown_connections 2024-09-19T07:24:37.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.649+0000 7f86ae890640 1 -- 172.21.15.148:0/2174457178 wait complete. 2024-09-19T07:24:37.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.650+0000 7f86ae890640 1 Processor -- start 2024-09-19T07:24:37.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.650+0000 7f86ae890640 1 -- start start 2024-09-19T07:24:37.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.650+0000 7f86ae890640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86a8074620 0x7f86a819a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:37.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.650+0000 7f86ae890640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86a8074f40 0x7f86a819ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:37.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.650+0000 7f86ae890640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86a810e3b0 0x7f86a819ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:37.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.650+0000 7f86ae890640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f86a8114130 con 0x7f86a810e3b0 2024-09-19T07:24:37.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.650+0000 7f86ae890640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f86a8113fb0 con 0x7f86a8074620 2024-09-19T07:24:37.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.650+0000 7f86ae890640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f86a81142b0 con 0x7f86a8074f40 2024-09-19T07:24:37.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.650+0000 7f86ace2d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86a810e3b0 0x7f86a819ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:37.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.650+0000 7f86ace2d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86a810e3b0 0x7f86a819ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35728/0 (socket says 172.21.15.148:35728) 2024-09-19T07:24:37.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.650+0000 7f86ace2d640 1 -- 172.21.15.148:0/628687579 learned_addr learned my addr 172.21.15.148:0/628687579 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:24:37.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.650+0000 7f86a7fff640 1 --2- 172.21.15.148:0/628687579 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86a8074620 0x7f86a819a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:37.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.651+0000 7f86a77fe640 1 --2- 172.21.15.148:0/628687579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86a8074f40 0x7f86a819ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:37.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.651+0000 7f86ace2d640 1 -- 172.21.15.148:0/628687579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86a8074f40 msgr2=0x7f86a819ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:37.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.651+0000 7f86ace2d640 1 --2- 172.21.15.148:0/628687579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86a8074f40 0x7f86a819ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:37.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.651+0000 7f86ace2d640 1 -- 172.21.15.148:0/628687579 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86a8074620 msgr2=0x7f86a819a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:37.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.651+0000 7f86ace2d640 1 --2- 172.21.15.148:0/628687579 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86a8074620 0x7f86a819a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:37.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.651+0000 7f86ace2d640 1 -- 172.21.15.148:0/628687579 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86a819f670 con 0x7f86a810e3b0 2024-09-19T07:24:37.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.651+0000 7f86a77fe640 1 --2- 172.21.15.148:0/628687579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86a8074f40 0x7f86a819ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:24:37.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.651+0000 7f86a7fff640 1 --2- 172.21.15.148:0/628687579 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86a8074620 0x7f86a819a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:24:37.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.651+0000 7f86ace2d640 1 --2- 172.21.15.148:0/628687579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86a810e3b0 0x7f86a819ef90 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f86a000eb10 tx=0x7f86a000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:37.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.651+0000 7f86a57fa640 1 -- 172.21.15.148:0/628687579 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a0004b20 con 0x7f86a810e3b0 2024-09-19T07:24:37.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.651+0000 7f86ae890640 1 -- 172.21.15.148:0/628687579 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86a819f960 con 0x7f86a810e3b0 2024-09-19T07:24:37.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.651+0000 7f86a57fa640 1 -- 172.21.15.148:0/628687579 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86a0004cc0 con 0x7f86a810e3b0 2024-09-19T07:24:37.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.651+0000 7f86a57fa640 1 -- 172.21.15.148:0/628687579 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a0010760 con 0x7f86a810e3b0 2024-09-19T07:24:37.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.651+0000 7f86ae890640 1 -- 172.21.15.148:0/628687579 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86a81a7240 con 0x7f86a810e3b0 2024-09-19T07:24:37.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.652+0000 7f86ae890640 1 -- 172.21.15.148:0/628687579 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86a8074a00 con 0x7f86a810e3b0 2024-09-19T07:24:37.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.653+0000 7f86a57fa640 1 -- 172.21.15.148:0/628687579 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f86a0005020 con 0x7f86a810e3b0 2024-09-19T07:24:37.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.654+0000 7f86a57fa640 1 --2- 172.21.15.148:0/628687579 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f86900a33b0 0x7f86900a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:37.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.655+0000 7f86a7fff640 1 --2- 172.21.15.148:0/628687579 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f86900a33b0 0x7f86900a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:37.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.655+0000 7f86a57fa640 1 -- 172.21.15.148:0/628687579 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8556+0+0 (secure 0 0 0) 0x7f86a00d0340 con 0x7f86a810e3b0 2024-09-19T07:24:37.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.655+0000 7f86a7fff640 1 --2- 172.21.15.148:0/628687579 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f86900a33b0 0x7f86900a5870 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8698009cd0 tx=0x7f8698005f90 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:37.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.658+0000 7f86a57fa640 1 -- 172.21.15.148:0/628687579 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f86a009cca0 con 0x7f86a810e3b0 2024-09-19T07:24:37.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:24:37 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:24:37.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.870+0000 7f86ae890640 1 -- 172.21.15.148:0/628687579 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f86a802d7c0 con 0x7f86a810e3b0 2024-09-19T07:24:37.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.870+0000 7f86a57fa640 1 -- 172.21.15.148:0/628687579 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+11941 (secure 0 0 0) 0x7f86a009c5a0 con 0x7f86a810e3b0 2024-09-19T07:24:37.871 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:24:37.872 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":47,"btime":"2024-09-19T07:23:26:615080+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/4263868576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":4263868576},{"type":"v1","addr":"172.21.15.148:6841","nonce":4263868576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":25606,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3891676893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3891676893},{"type":"v1","addr":"172.21.15.179:6835","nonce":3891676893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":47,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:09:19.543369+0000","modified":"2024-09-19T07:23:26.380794+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24457,"mds_1":24437,"mds_2":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":75,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":71,"addr":"172.21.15.165:6839/3993490234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":3993490234},{"type":"v1","addr":"172.21.15.165:6839","nonce":3993490234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25823":{"gid":25823,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6835/380886107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":380886107},{"type":"v1","addr":"172.21.15.165:6835","nonce":380886107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24457,"qdb_cluster":[24457,24437,24436]},"id":1}]} 2024-09-19T07:24:37.872 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 47 2024-09-19T07:24:37.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.873+0000 7f86ae890640 1 -- 172.21.15.148:0/628687579 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f86900a33b0 msgr2=0x7f86900a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:37.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.873+0000 7f86ae890640 1 --2- 172.21.15.148:0/628687579 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f86900a33b0 0x7f86900a5870 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8698009cd0 tx=0x7f8698005f90 comp rx=0 tx=0).stop 2024-09-19T07:24:37.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.873+0000 7f86ae890640 1 -- 172.21.15.148:0/628687579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86a810e3b0 msgr2=0x7f86a819ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:37.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.873+0000 7f86ae890640 1 --2- 172.21.15.148:0/628687579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86a810e3b0 0x7f86a819ef90 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f86a000eb10 tx=0x7f86a000c2d0 comp rx=0 tx=0).stop 2024-09-19T07:24:37.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.873+0000 7f86ae890640 1 -- 172.21.15.148:0/628687579 shutdown_connections 2024-09-19T07:24:37.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.873+0000 7f86ae890640 1 --2- 172.21.15.148:0/628687579 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f86900a33b0 0x7f86900a5870 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:37.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.873+0000 7f86ae890640 1 --2- 172.21.15.148:0/628687579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86a810e3b0 0x7f86a819ef90 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:37.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.873+0000 7f86ae890640 1 --2- 172.21.15.148:0/628687579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86a8074f40 0x7f86a819ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:37.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.873+0000 7f86ae890640 1 --2- 172.21.15.148:0/628687579 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86a8074620 0x7f86a819a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:37.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.873+0000 7f86ae890640 1 -- 172.21.15.148:0/628687579 >> 172.21.15.148:0/628687579 conn(0x7f86a80fd890 msgr2=0x7f86a80ff0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:37.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.873+0000 7f86ae890640 1 -- 172.21.15.148:0/628687579 shutdown_connections 2024-09-19T07:24:37.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:37.873+0000 7f86ae890640 1 -- 172.21.15.148:0/628687579 wait complete. 2024-09-19T07:24:37.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:24:37 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:24:38.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:24:37 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:24:38.666 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24457 quiesce db / --timeout 90 --expiration 142.2 --await-for 45.0' 2024-09-19T07:24:38.666 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24457 quiesce db / --timeout 90 --expiration 142.2 --await-for 45.0 2024-09-19T07:24:38.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:24:38 smithi148 ceph-mon[31180]: pgmap v425: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 13 op/s 2024-09-19T07:24:38.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:24:38 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/628687579' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:24:38.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:24:38 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:24:38.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:24:38 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:24:38.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:24:38 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:24:38.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:24:38 smithi165 ceph-mon[35326]: pgmap v425: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 13 op/s 2024-09-19T07:24:38.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:24:38 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/628687579' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:24:38.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:24:38 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:24:38.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:24:38 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:24:38.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:24:38 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:24:38.954 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:24:39.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:24:38 smithi179 ceph-mon[35716]: pgmap v425: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 13 op/s 2024-09-19T07:24:39.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:24:38 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/628687579' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:24:39.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:24:38 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:24:39.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:24:38 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:24:39.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:24:38 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:24:39.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.462+0000 7fc569962640 1 -- 172.21.15.148:0/2938902446 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc55c0aa230 msgr2=0x7fc55c0aa610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:39.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.462+0000 7fc569962640 1 --2- 172.21.15.148:0/2938902446 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc55c0aa230 0x7fc55c0aa610 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fc564065a40 tx=0x7fc56408e380 comp rx=0 tx=0).stop 2024-09-19T07:24:39.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.463+0000 7fc569962640 1 -- 172.21.15.148:0/2938902446 shutdown_connections 2024-09-19T07:24:39.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.463+0000 7fc569962640 1 --2- 172.21.15.148:0/2938902446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc55c0a4d30 0x7fc55c0a51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.463+0000 7fc569962640 1 --2- 172.21.15.148:0/2938902446 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc55c0aab50 0x7fc55c0a47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.463+0000 7fc569962640 1 --2- 172.21.15.148:0/2938902446 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc55c0aa230 0x7fc55c0aa610 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.463+0000 7fc569962640 1 -- 172.21.15.148:0/2938902446 >> 172.21.15.148:0/2938902446 conn(0x7fc55c01a0a0 msgr2=0x7fc55c01a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:39.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.464+0000 7fc569962640 1 -- 172.21.15.148:0/2938902446 shutdown_connections 2024-09-19T07:24:39.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.464+0000 7fc569962640 1 -- 172.21.15.148:0/2938902446 wait complete. 2024-09-19T07:24:39.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.465+0000 7fc569962640 1 Processor -- start 2024-09-19T07:24:39.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.465+0000 7fc569962640 1 -- start start 2024-09-19T07:24:39.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.466+0000 7fc569962640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc55c0a4d30 0x7fc55c143470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:39.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.466+0000 7fc569962640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc55c0aa230 0x7fc55c1439b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:39.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.466+0000 7fc569962640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc55c0aab50 0x7fc55c147d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:39.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.466+0000 7fc569962640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc55c0bcf30 con 0x7fc55c0aab50 2024-09-19T07:24:39.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.466+0000 7fc569962640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc55c0bcdb0 con 0x7fc55c0aa230 2024-09-19T07:24:39.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.466+0000 7fc569962640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc55c0bd0b0 con 0x7fc55c0a4d30 2024-09-19T07:24:39.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.466+0000 7fc5627fc640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc55c0aa230 0x7fc55c1439b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:39.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.466+0000 7fc5627fc640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc55c0aa230 0x7fc55c1439b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:45342/0 (socket says 172.21.15.148:45342) 2024-09-19T07:24:39.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.466+0000 7fc5627fc640 1 -- 172.21.15.148:0/403250777 learned_addr learned my addr 172.21.15.148:0/403250777 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:24:39.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.466+0000 7fc562ffd640 1 --2- 172.21.15.148:0/403250777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc55c0a4d30 0x7fc55c143470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:39.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.466+0000 7fc5637fe640 1 --2- 172.21.15.148:0/403250777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc55c0aab50 0x7fc55c147d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:39.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.467+0000 7fc562ffd640 1 -- 172.21.15.148:0/403250777 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc55c0aa230 msgr2=0x7fc55c1439b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:39.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.467+0000 7fc562ffd640 1 --2- 172.21.15.148:0/403250777 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc55c0aa230 0x7fc55c1439b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.467+0000 7fc562ffd640 1 -- 172.21.15.148:0/403250777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc55c0aab50 msgr2=0x7fc55c147d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:39.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.467+0000 7fc562ffd640 1 --2- 172.21.15.148:0/403250777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc55c0aab50 0x7fc55c147d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.467+0000 7fc562ffd640 1 -- 172.21.15.148:0/403250777 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc55c148420 con 0x7fc55c0a4d30 2024-09-19T07:24:39.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.467+0000 7fc562ffd640 1 --2- 172.21.15.148:0/403250777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc55c0a4d30 0x7fc55c143470 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc564051220 tx=0x7fc564063640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:39.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.468+0000 7fc568960640 1 -- 172.21.15.148:0/403250777 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56406f2d0 con 0x7fc55c0a4d30 2024-09-19T07:24:39.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.468+0000 7fc568960640 1 -- 172.21.15.148:0/403250777 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc56406dc10 con 0x7fc55c0a4d30 2024-09-19T07:24:39.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.468+0000 7fc568960640 1 -- 172.21.15.148:0/403250777 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc564096b30 con 0x7fc55c0a4d30 2024-09-19T07:24:39.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.469+0000 7fc569962640 1 -- 172.21.15.148:0/403250777 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc55c1486b0 con 0x7fc55c0a4d30 2024-09-19T07:24:39.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.469+0000 7fc569962640 1 -- 172.21.15.148:0/403250777 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc55c148b70 con 0x7fc55c0a4d30 2024-09-19T07:24:39.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.473+0000 7fc56bd3b740 1 Processor -- start 2024-09-19T07:24:39.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.473+0000 7fc56bd3b740 1 -- start start 2024-09-19T07:24:39.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.473+0000 7fc56bd3b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55579106f900 0x55579106fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:39.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.473+0000 7fc56bd3b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555791070220 0x55579107a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:39.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.473+0000 7fc56bd3b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55579107aae0 0x55579107ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:39.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.473+0000 7fc56bd3b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x555790fd52a0 con 0x555791070220 2024-09-19T07:24:39.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.473+0000 7fc56bd3b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x555790f7cb10 con 0x55579106f900 2024-09-19T07:24:39.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.473+0000 7fc56bd3b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x555790fd1260 con 0x55579107aae0 2024-09-19T07:24:39.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.474+0000 7fc5637fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55579106f900 0x55579106fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:39.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.474+0000 7fc5627fc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55579107aae0 0x55579107ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:39.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.474+0000 7fc5637fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55579106f900 0x55579106fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:45358/0 (socket says 172.21.15.148:45358) 2024-09-19T07:24:39.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.474+0000 7fc5637fe640 1 -- 172.21.15.148:0/2732157794 learned_addr learned my addr 172.21.15.148:0/2732157794 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:24:39.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.474+0000 7fc568960640 1 -- 172.21.15.148:0/403250777 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fc564094030 con 0x7fc55c0a4d30 2024-09-19T07:24:39.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.474+0000 7fc562ffd640 1 --2- 172.21.15.148:0/2732157794 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555791070220 0x55579107a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:39.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.474+0000 7fc5637fe640 1 -- 172.21.15.148:0/2732157794 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55579107aae0 msgr2=0x55579107ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:39.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.474+0000 7fc5637fe640 1 --2- 172.21.15.148:0/2732157794 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55579107aae0 0x55579107ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.474+0000 7fc5637fe640 1 -- 172.21.15.148:0/2732157794 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555791070220 msgr2=0x55579107a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:39.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.474+0000 7fc5637fe640 1 --2- 172.21.15.148:0/2732157794 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555791070220 0x55579107a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.474+0000 7fc5637fe640 1 -- 172.21.15.148:0/2732157794 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555790d46b90 con 0x55579106f900 2024-09-19T07:24:39.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.474+0000 7fc562ffd640 1 --2- 172.21.15.148:0/2732157794 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555791070220 0x55579107a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:24:39.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.475+0000 7fc5637fe640 1 --2- 172.21.15.148:0/2732157794 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55579106f900 0x55579106fce0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc558009c10 tx=0x7fc5580117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f21045544c35263 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:39.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.475+0000 7fc549ffb640 1 -- 172.21.15.148:0/2732157794 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc558012450 con 0x55579106f900 2024-09-19T07:24:39.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.475+0000 7fc549ffb640 1 -- 172.21.15.148:0/2732157794 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc558012ad0 con 0x55579106f900 2024-09-19T07:24:39.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.475+0000 7fc549ffb640 1 -- 172.21.15.148:0/2732157794 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc55800fbd0 con 0x55579106f900 2024-09-19T07:24:39.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.475+0000 7fc568960640 1 --2- 172.21.15.148:0/403250777 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc54c0a34c0 0x7fc54c0a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:39.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.475+0000 7fc568960640 1 -- 172.21.15.148:0/403250777 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8556+0+0 (secure 0 0 0) 0x7fc564152db0 con 0x7fc55c0a4d30 2024-09-19T07:24:39.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.476+0000 7fc562ffd640 1 --2- 172.21.15.148:0/403250777 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc54c0a34c0 0x7fc54c0a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:39.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.476+0000 7fc56bd3b740 1 -- 172.21.15.148:0/2732157794 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55579106f900 msgr2=0x55579106fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:39.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.476+0000 7fc56bd3b740 1 --2- 172.21.15.148:0/2732157794 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55579106f900 0x55579106fce0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc558009c10 tx=0x7fc5580117b0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.476+0000 7fc56bd3b740 1 -- 172.21.15.148:0/2732157794 shutdown_connections 2024-09-19T07:24:39.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.476+0000 7fc56bd3b740 1 --2- 172.21.15.148:0/2732157794 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55579107aae0 0x55579107ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.476+0000 7fc56bd3b740 1 --2- 172.21.15.148:0/2732157794 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555791070220 0x55579107a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.476+0000 7fc56bd3b740 1 --2- 172.21.15.148:0/2732157794 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55579106f900 0x55579106fce0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.476+0000 7fc56bd3b740 1 -- 172.21.15.148:0/2732157794 >> 172.21.15.148:0/2732157794 conn(0x55579106be90 msgr2=0x55579106c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:39.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.477+0000 7fc56bd3b740 1 -- 172.21.15.148:0/2732157794 shutdown_connections 2024-09-19T07:24:39.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.477+0000 7fc56bd3b740 1 -- 172.21.15.148:0/2732157794 wait complete. 2024-09-19T07:24:39.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.477+0000 7fc56bd3b740 1 -- start start 2024-09-19T07:24:39.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.477+0000 7fc56bd3b740 1 Processor -- start 2024-09-19T07:24:39.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.478+0000 7fc56bd3b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55579106f900 0x555791077a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:39.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.478+0000 7fc56bd3b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555791070220 0x555791077f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:39.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.478+0000 7fc56bd3b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55579107aae0 0x5557910784b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:39.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.478+0000 7fc56bd3b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55579108e6c0 con 0x55579106f900 2024-09-19T07:24:39.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.478+0000 7fc562ffd640 1 --2- 172.21.15.148:0/403250777 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc54c0a34c0 0x7fc54c0a5980 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x55579106ccf0 tx=0x7fc5640955f0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:39.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.478+0000 7fc56bd3b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x555790f5d6e0 con 0x555791070220 2024-09-19T07:24:39.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.478+0000 7fc56bd3b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55579108e840 con 0x55579107aae0 2024-09-19T07:24:39.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.478+0000 7fc5627fc640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555791070220 0x555791077f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:39.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.478+0000 7fc5627fc640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555791070220 0x555791077f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:45370/0 (socket says 172.21.15.148:45370) 2024-09-19T07:24:39.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.478+0000 7fc5627fc640 1 -- 172.21.15.148:0/4152812406 learned_addr learned my addr 172.21.15.148:0/4152812406 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:24:39.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.478+0000 7fc56bd3b740 10 client.0 _ll_register_callbacks cb 0x555790f81a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:24:39.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.479+0000 7fc5637fe640 1 --2- 172.21.15.148:0/4152812406 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55579107aae0 0x5557910784b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:39.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.479+0000 7fc5627fc640 1 -- 172.21.15.148:0/4152812406 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55579107aae0 msgr2=0x5557910784b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:39.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.479+0000 7fc5627fc640 1 --2- 172.21.15.148:0/4152812406 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55579107aae0 0x5557910784b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.479+0000 7fc5627fc640 1 -- 172.21.15.148:0/4152812406 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55579106f900 msgr2=0x555791077a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:39.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.479+0000 7fc5627fc640 1 --2- 172.21.15.148:0/4152812406 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55579106f900 0x555791077a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.479+0000 7fc5627fc640 1 -- 172.21.15.148:0/4152812406 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555791097cc0 con 0x555791070220 2024-09-19T07:24:39.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.479+0000 7fc5627fc640 1 --2- 172.21.15.148:0/4152812406 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555791070220 0x555791077f70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc554010530 tx=0x7fc5540109f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=963584b2ce625a5d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:39.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.479+0000 7fc542ffd640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-19T07:24:39.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.479+0000 7fc542ffd640 1 -- 172.21.15.148:0/4152812406 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc554018070 con 0x555791070220 2024-09-19T07:24:39.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.479+0000 7fc56bd3b740 1 -- 172.21.15.148:0/4152812406 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc558012ad0 con 0x555791070220 2024-09-19T07:24:39.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.479+0000 7fc542ffd640 1 -- 172.21.15.148:0/4152812406 <== mon.2 v2:172.21.15.165:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8556+0+0 (secure 0 0 0) 0x7fc554014640 con 0x555791070220 2024-09-19T07:24:39.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.480+0000 7fc542ffd640 1 -- 172.21.15.148:0/4152812406 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fc554024050 con 0x555791070220 2024-09-19T07:24:39.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.480+0000 7fc56bd3b740 10 client.26474 fetch_fsmap learned FSMap version 47 2024-09-19T07:24:39.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.480+0000 7fc56bd3b740 1 -- 172.21.15.148:0/4152812406 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55579109a660 con 0x555791070220 2024-09-19T07:24:39.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.481+0000 7fc542ffd640 1 -- 172.21.15.148:0/4152812406 <== mon.2 v2:172.21.15.165:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc558012ad0 con 0x555791070220 2024-09-19T07:24:39.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.481+0000 7fc542ffd640 1 -- 172.21.15.148:0/4152812406 <== mon.2 v2:172.21.15.165:3300/0 5 ==== fsmap(e 47) ==== 8354+0+0 (secure 0 0 0) 0x7fc554012b10 con 0x555791070220 2024-09-19T07:24:39.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.481+0000 7fc56bd3b740 10 client.26474 fetch_fsmap finished waiting for FSMap version 47 2024-09-19T07:24:39.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.481+0000 7fc56bd3b740 10 client.26474 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:24:39.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.481+0000 7fc56bd3b740 20 client.26474 populate_metadata read hostname 'smithi148' 2024-09-19T07:24:39.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.481+0000 7fc56bd3b740 1 --2- 172.21.15.148:0/4152812406 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55579109bac0 0x55579109def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:39.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.481+0000 7fc56bd3b740 4 client.26474 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:24:39.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.481+0000 7fc56bd3b740 1 -- 172.21.15.148:0/4152812406 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555790fe29d0 con 0x55579109bac0 2024-09-19T07:24:39.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.482+0000 7fc5637fe640 1 --2- 172.21.15.148:0/4152812406 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55579109bac0 0x55579109def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:39.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.482+0000 7fc5637fe640 1 --2- 172.21.15.148:0/4152812406 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55579109bac0 0x55579109def0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb1c9476363f6178 server_cookie=e14fba7b6d7c91cd in_seq=0 out_seq=0 2024-09-19T07:24:39.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.482+0000 7fc542ffd640 10 client.26474 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:24:39.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.484+0000 7fc542ffd640 1 -- 172.21.15.148:0/4152812406 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555790fe29d0 con 0x55579109bac0 2024-09-19T07:24:39.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.484+0000 7fc542ffd640 10 client.26474 handle_command_reply: tid=0 2024-09-19T07:24:39.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.485+0000 7fc56bd3b740 1 client.26474 shutdown 2024-09-19T07:24:39.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.486+0000 7fc56bd3b740 1 -- 172.21.15.148:0/4152812406 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555791070220 msgr2=0x555791077f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:39.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.486+0000 7fc56bd3b740 1 --2- 172.21.15.148:0/4152812406 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555791070220 0x555791077f70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc554010530 tx=0x7fc5540109f0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.486+0000 7fc56bd3b740 1 -- 172.21.15.148:0/4152812406 shutdown_connections 2024-09-19T07:24:39.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.486+0000 7fc56bd3b740 1 --2- 172.21.15.148:0/4152812406 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55579109bac0 0x55579109def0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.486+0000 7fc542ffd640 0 client.26474 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:24:39.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.486+0000 7fc56bd3b740 1 --2- 172.21.15.148:0/4152812406 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55579107aae0 0x5557910784b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.486+0000 7fc56bd3b740 1 --2- 172.21.15.148:0/4152812406 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555791070220 0x555791077f70 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.486+0000 7fc56bd3b740 1 --2- 172.21.15.148:0/4152812406 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55579106f900 0x555791077a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.486+0000 7fc56bd3b740 1 -- 172.21.15.148:0/4152812406 >> 172.21.15.148:0/4152812406 conn(0x55579106be90 msgr2=0x555791071bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:39.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.487+0000 7fc56bd3b740 1 -- 172.21.15.148:0/4152812406 shutdown_connections 2024-09-19T07:24:39.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.487+0000 7fc56bd3b740 1 -- 172.21.15.148:0/4152812406 wait complete. 2024-09-19T07:24:39.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.487+0000 7fc56bd3b740 20 client.26474 trim_cache size 0 max 16384 2024-09-19T07:24:39.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.519+0000 7fc56bd3b740 1 Processor -- start 2024-09-19T07:24:39.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.519+0000 7fc56bd3b740 1 -- start start 2024-09-19T07:24:39.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.519+0000 7fc56bd3b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55579106f900 0x555791078300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:39.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.519+0000 7fc56bd3b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555791070220 0x555791071a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:39.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.519+0000 7fc56bd3b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55579107aae0 0x5557910a3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:39.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.519+0000 7fc56bd3b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc55c152a00 con 0x555791070220 2024-09-19T07:24:39.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.519+0000 7fc56bd3b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc55c150270 con 0x55579107aae0 2024-09-19T07:24:39.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.519+0000 7fc56bd3b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc55c1447d0 con 0x55579106f900 2024-09-19T07:24:39.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.520+0000 7fc5627fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555791070220 0x555791071a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:39.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.520+0000 7fc5627fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555791070220 0x555791071a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35784/0 (socket says 172.21.15.148:35784) 2024-09-19T07:24:39.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.520+0000 7fc5627fc640 1 -- 172.21.15.148:0/2064753964 learned_addr learned my addr 172.21.15.148:0/2064753964 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:24:39.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.520+0000 7fc5627fc640 1 -- 172.21.15.148:0/2064753964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55579106f900 msgr2=0x555791078300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:39.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.521+0000 7fc5627fc640 1 --2- 172.21.15.148:0/2064753964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55579106f900 0x555791078300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.521+0000 7fc5627fc640 1 -- 172.21.15.148:0/2064753964 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55579107aae0 msgr2=0x5557910a3800 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T07:24:39.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.521+0000 7fc5627fc640 1 --2- 172.21.15.148:0/2064753964 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55579107aae0 0x5557910a3800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.521+0000 7fc5627fc640 1 -- 172.21.15.148:0/2064753964 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55579106cb20 con 0x555791070220 2024-09-19T07:24:39.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.521+0000 7fc5627fc640 1 --2- 172.21.15.148:0/2064753964 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555791070220 0x555791071a60 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fc554014fd0 tx=0x7fc554006fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56fd5434c752d626 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:39.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.522+0000 7fc5497fa640 1 -- 172.21.15.148:0/2064753964 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc554018050 con 0x555791070220 2024-09-19T07:24:39.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.522+0000 7fc5497fa640 1 -- 172.21.15.148:0/2064753964 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc554004520 con 0x555791070220 2024-09-19T07:24:39.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.522+0000 7fc5497fa640 1 -- 172.21.15.148:0/2064753964 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc554003da0 con 0x555791070220 2024-09-19T07:24:39.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.523+0000 7fc56bd3b740 1 -- 172.21.15.148:0/2064753964 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555791070220 msgr2=0x555791071a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:39.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.523+0000 7fc56bd3b740 1 --2- 172.21.15.148:0/2064753964 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555791070220 0x555791071a60 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fc554014fd0 tx=0x7fc554006fd0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.523+0000 7fc56bd3b740 1 -- 172.21.15.148:0/2064753964 shutdown_connections 2024-09-19T07:24:39.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.523+0000 7fc56bd3b740 1 --2- 172.21.15.148:0/2064753964 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55579107aae0 0x5557910a3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.523+0000 7fc56bd3b740 1 --2- 172.21.15.148:0/2064753964 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555791070220 0x555791071a60 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.523+0000 7fc56bd3b740 1 --2- 172.21.15.148:0/2064753964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55579106f900 0x555791078300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.523+0000 7fc56bd3b740 1 -- 172.21.15.148:0/2064753964 >> 172.21.15.148:0/2064753964 conn(0x55579106be90 msgr2=0x555791071350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:39.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.523+0000 7fc56bd3b740 1 -- 172.21.15.148:0/2064753964 shutdown_connections 2024-09-19T07:24:39.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.523+0000 7fc56bd3b740 1 -- 172.21.15.148:0/2064753964 wait complete. 2024-09-19T07:24:39.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.524+0000 7fc56bd3b740 1 -- start start 2024-09-19T07:24:39.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.524+0000 7fc56bd3b740 1 Processor -- start 2024-09-19T07:24:39.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.525+0000 7fc56bd3b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55579106f900 0x55579108fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:39.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.525+0000 7fc56bd3b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555791070220 0x555791090050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:39.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.525+0000 7fc56bd3b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55579107aae0 0x555791090590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:39.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.525+0000 7fc56bd3b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc55c0b4810 con 0x55579106f900 2024-09-19T07:24:39.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.525+0000 7fc56bd3b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc55c0b5c60 con 0x555791070220 2024-09-19T07:24:39.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.525+0000 7fc56bd3b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc55c0b4ec0 con 0x55579107aae0 2024-09-19T07:24:39.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.525+0000 7fc56bd3b740 10 client.0 _ll_register_callbacks cb 0x7fc554007de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:24:39.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.525+0000 7fc5637fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55579106f900 0x55579108fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:39.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.525+0000 7fc5637fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55579106f900 0x55579108fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35790/0 (socket says 172.21.15.148:35790) 2024-09-19T07:24:39.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.525+0000 7fc5637fe640 1 -- 172.21.15.148:0/1906132708 learned_addr learned my addr 172.21.15.148:0/1906132708 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:24:39.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.525+0000 7fc5637fe640 1 --2- 172.21.15.148:0/1906132708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55579107aae0 0x555791090590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:39.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.525+0000 7fc5627fc640 1 --2- 172.21.15.148:0/1906132708 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555791070220 0x555791090050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:39.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.526+0000 7fc5637fe640 1 -- 172.21.15.148:0/1906132708 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555791070220 msgr2=0x555791090050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:39.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.526+0000 7fc5637fe640 1 --2- 172.21.15.148:0/1906132708 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555791070220 0x555791090050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.526+0000 7fc5637fe640 1 -- 172.21.15.148:0/1906132708 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55579106f900 msgr2=0x55579108fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:39.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.526+0000 7fc5637fe640 1 --2- 172.21.15.148:0/1906132708 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55579106f900 0x55579108fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.526+0000 7fc5637fe640 1 -- 172.21.15.148:0/1906132708 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55579106b670 con 0x55579107aae0 2024-09-19T07:24:39.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.526+0000 7fc5637fe640 1 --2- 172.21.15.148:0/1906132708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55579107aae0 0x555791090590 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc55800f740 tx=0x7fc55800f6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c05e92ee00a3c0c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:39.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.526+0000 7fc542ffd640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-19T07:24:39.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.526+0000 7fc542ffd640 1 -- 172.21.15.148:0/1906132708 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc55802e040 con 0x55579107aae0 2024-09-19T07:24:39.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.526+0000 7fc56bd3b740 1 -- 172.21.15.148:0/1906132708 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc554004520 con 0x55579107aae0 2024-09-19T07:24:39.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.526+0000 7fc542ffd640 1 -- 172.21.15.148:0/1906132708 <== mon.1 v2:172.21.15.179:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8556+0+0 (secure 0 0 0) 0x7fc55800fa30 con 0x55579107aae0 2024-09-19T07:24:39.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.526+0000 7fc542ffd640 1 -- 172.21.15.148:0/1906132708 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fc55800fc30 con 0x55579107aae0 2024-09-19T07:24:39.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.527+0000 7fc56bd3b740 10 client.26587 fetch_fsmap learned FSMap version 47 2024-09-19T07:24:39.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.527+0000 7fc56bd3b740 1 -- 172.21.15.148:0/1906132708 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x555791106b10 con 0x55579107aae0 2024-09-19T07:24:39.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.527+0000 7fc542ffd640 1 -- 172.21.15.148:0/1906132708 <== mon.1 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc554004520 con 0x55579107aae0 2024-09-19T07:24:39.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.527+0000 7fc542ffd640 1 -- 172.21.15.148:0/1906132708 <== mon.1 v2:172.21.15.179:3300/0 5 ==== fsmap(e 47) ==== 8354+0+0 (secure 0 0 0) 0x7fc5580054a0 con 0x55579107aae0 2024-09-19T07:24:39.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.527+0000 7fc56bd3b740 10 client.26587 fetch_fsmap finished waiting for FSMap version 47 2024-09-19T07:24:39.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.527+0000 7fc56bd3b740 10 client.26587 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:24:39.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.527+0000 7fc56bd3b740 20 client.26587 populate_metadata read hostname 'smithi148' 2024-09-19T07:24:39.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.527+0000 7fc56bd3b740 1 --2- 172.21.15.148:0/1906132708 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55579109bac0 0x555791109160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:39.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.527+0000 7fc56bd3b740 4 client.26587 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.2, "await_for": 45.0}] 2024-09-19T07:24:39.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.527+0000 7fc56bd3b740 1 -- 172.21.15.148:0/1906132708 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.2, "await_for": 45.0}) -- 0x555790fdcd20 con 0x55579109bac0 2024-09-19T07:24:39.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.527+0000 7fc5627fc640 1 --2- 172.21.15.148:0/1906132708 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55579109bac0 0x555791109160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:39.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.528+0000 7fc542ffd640 10 client.26587 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:24:39.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:39.528+0000 7fc5627fc640 1 --2- 172.21.15.148:0/1906132708 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55579109bac0 0x555791109160 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fff6b3ebbb659ee9 server_cookie=7570ef5cbd238898 in_seq=0 out_seq=0 2024-09-19T07:24:40.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:24:40 smithi148 ceph-mon[31180]: pgmap v426: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 27 KiB/s wr, 21 op/s 2024-09-19T07:24:40.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:24:40 smithi165 ceph-mon[35326]: pgmap v426: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 27 KiB/s wr, 21 op/s 2024-09-19T07:24:41.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:24:40 smithi179 ceph-mon[35716]: pgmap v426: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 27 KiB/s wr, 21 op/s 2024-09-19T07:24:42.306 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.305+0000 7f407a19f640 1 -- 172.21.15.148:0/391080224 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4074102480 msgr2=0x7f407410e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:42.306 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.305+0000 7f407a19f640 1 --2- 172.21.15.148:0/391080224 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4074102480 0x7f407410e9b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f406c009c10 tx=0x7f406c02a6e0 comp rx=0 tx=0).stop 2024-09-19T07:24:42.306 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.305+0000 7f407a19f640 1 -- 172.21.15.148:0/391080224 shutdown_connections 2024-09-19T07:24:42.306 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.305+0000 7f407a19f640 1 --2- 172.21.15.148:0/391080224 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4074102480 0x7f407410e9b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:42.306 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.305+0000 7f407a19f640 1 --2- 172.21.15.148:0/391080224 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4074101ae0 0x7f4074101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:42.306 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.305+0000 7f407a19f640 1 --2- 172.21.15.148:0/391080224 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4074107b80 0x7f4074107f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:42.306 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.305+0000 7f407a19f640 1 -- 172.21.15.148:0/391080224 >> 172.21.15.148:0/391080224 conn(0x7f40740fd7e0 msgr2=0x7f40740ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:42.307 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.305+0000 7f407a19f640 1 -- 172.21.15.148:0/391080224 shutdown_connections 2024-09-19T07:24:42.307 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.307+0000 7f407a19f640 1 -- 172.21.15.148:0/391080224 wait complete. 2024-09-19T07:24:42.309 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.308+0000 7f407a19f640 1 Processor -- start 2024-09-19T07:24:42.309 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.308+0000 7f407a19f640 1 -- start start 2024-09-19T07:24:42.309 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.309+0000 7f407a19f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4074101ae0 0x7f4074111590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:42.309 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.309+0000 7f407a19f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4074102480 0x7f4074111ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:42.309 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.309+0000 7f407a19f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4074107b80 0x7f4074116da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:42.309 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.309+0000 7f407a19f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f407410fcf0 con 0x7f4074101ae0 2024-09-19T07:24:42.309 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.309+0000 7f407a19f640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f407410fb70 con 0x7f4074102480 2024-09-19T07:24:42.309 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.309+0000 7f407a19f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f407410fe70 con 0x7f4074107b80 2024-09-19T07:24:42.310 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.309+0000 7f40737fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4074101ae0 0x7f4074111590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:42.310 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.309+0000 7f40737fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4074101ae0 0x7f4074111590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35814/0 (socket says 172.21.15.148:35814) 2024-09-19T07:24:42.310 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.309+0000 7f40737fe640 1 -- 172.21.15.148:0/471028951 learned_addr learned my addr 172.21.15.148:0/471028951 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:24:42.310 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.309+0000 7f4073fff640 1 --2- 172.21.15.148:0/471028951 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4074107b80 0x7f4074116da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:42.310 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.310+0000 7f40737fe640 1 -- 172.21.15.148:0/471028951 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4074107b80 msgr2=0x7f4074116da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:42.311 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.310+0000 7f40737fe640 1 --2- 172.21.15.148:0/471028951 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4074107b80 0x7f4074116da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:42.311 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.310+0000 7f40737fe640 1 -- 172.21.15.148:0/471028951 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4074102480 msgr2=0x7f4074111ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:42.311 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.310+0000 7f40737fe640 1 --2- 172.21.15.148:0/471028951 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4074102480 0x7f4074111ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:42.311 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.310+0000 7f40737fe640 1 -- 172.21.15.148:0/471028951 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4074117640 con 0x7f4074101ae0 2024-09-19T07:24:42.311 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.310+0000 7f40737fe640 1 --2- 172.21.15.148:0/471028951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4074101ae0 0x7f4074111590 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f406400e9c0 tx=0x7f406400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:42.311 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.311+0000 7f4070ff9640 1 -- 172.21.15.148:0/471028951 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f406400cde0 con 0x7f4074101ae0 2024-09-19T07:24:42.311 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.311+0000 7f4070ff9640 1 -- 172.21.15.148:0/471028951 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40640035f0 con 0x7f4074101ae0 2024-09-19T07:24:42.312 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.311+0000 7f407a19f640 1 -- 172.21.15.148:0/471028951 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4074117930 con 0x7f4074101ae0 2024-09-19T07:24:42.312 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.312+0000 7f407a19f640 1 -- 172.21.15.148:0/471028951 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40741b3ce0 con 0x7f4074101ae0 2024-09-19T07:24:42.312 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.312+0000 7f4070ff9640 1 -- 172.21.15.148:0/471028951 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4064010690 con 0x7f4074101ae0 2024-09-19T07:24:42.314 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.314+0000 7f4070ff9640 1 -- 172.21.15.148:0/471028951 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f40640037a0 con 0x7f4074101ae0 2024-09-19T07:24:42.315 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.315+0000 7f4070ff9640 1 --2- 172.21.15.148:0/471028951 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f405c0a34e0 0x7f405c0a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:42.315 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.315+0000 7f407d018740 1 Processor -- start 2024-09-19T07:24:42.316 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.315+0000 7f407d018740 1 -- start start 2024-09-19T07:24:42.316 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.315+0000 7f4070ff9640 1 -- 172.21.15.148:0/471028951 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8556+0+0 (secure 0 0 0) 0x7f40640cfff0 con 0x7f4074101ae0 2024-09-19T07:24:42.316 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.315+0000 7f407d018740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56435035aaf0 0x56435035aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:42.316 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.315+0000 7f407d018740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56435035b410 0x564350365770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:42.316 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.315+0000 7f407d018740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564350365cb0 0x5643503680a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:42.316 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.315+0000 7f407d018740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5643502bf2f0 con 0x564350365cb0 2024-09-19T07:24:42.316 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.315+0000 7f407d018740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x564350267270 con 0x56435035b410 2024-09-19T07:24:42.316 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.315+0000 7f407d018740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5643502bb2b0 con 0x56435035aaf0 2024-09-19T07:24:42.316 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.316+0000 7f4072ffd640 1 --2- 172.21.15.148:0/471028951 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f405c0a34e0 0x7f405c0a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:42.317 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.316+0000 7f4073fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564350365cb0 0x5643503680a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:42.317 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.316+0000 7f4073fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564350365cb0 0x5643503680a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35822/0 (socket says 172.21.15.148:35822) 2024-09-19T07:24:42.317 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.316+0000 7f4073fff640 1 -- 172.21.15.148:0/2792695541 learned_addr learned my addr 172.21.15.148:0/2792695541 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:24:42.318 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.316+0000 7f4072ffd640 1 --2- 172.21.15.148:0/2792695541 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56435035b410 0x564350365770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:42.318 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.316+0000 7f40737fe640 1 --2- 172.21.15.148:0/2792695541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56435035aaf0 0x56435035aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:42.318 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.316+0000 7f4073fff640 1 -- 172.21.15.148:0/2792695541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56435035aaf0 msgr2=0x56435035aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:42.318 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.316+0000 7f4073fff640 1 --2- 172.21.15.148:0/2792695541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56435035aaf0 0x56435035aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:42.318 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.316+0000 7f4073fff640 1 -- 172.21.15.148:0/2792695541 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56435035b410 msgr2=0x564350365770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:42.318 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.316+0000 7f4073fff640 1 --2- 172.21.15.148:0/2792695541 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56435035b410 0x564350365770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:42.318 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.316+0000 7f4073fff640 1 -- 172.21.15.148:0/2792695541 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564350266340 con 0x564350365cb0 2024-09-19T07:24:42.318 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.316+0000 7f4072ffd640 1 --2- 172.21.15.148:0/471028951 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f405c0a34e0 0x7f405c0a59a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f40680058c0 tx=0x7f40680127c0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:42.318 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.317+0000 7f4073fff640 1 --2- 172.21.15.148:0/2792695541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564350365cb0 0x5643503680a0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f406c009be0 tx=0x7f406c030a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adc47716c3bdaf6f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:42.319 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.318+0000 7f4059ffb640 1 -- 172.21.15.148:0/2792695541 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f406c041030 con 0x564350365cb0 2024-09-19T07:24:42.319 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.318+0000 7f4059ffb640 1 -- 172.21.15.148:0/2792695541 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f406c030c60 con 0x564350365cb0 2024-09-19T07:24:42.319 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.319+0000 7f4059ffb640 1 -- 172.21.15.148:0/2792695541 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f406c036040 con 0x564350365cb0 2024-09-19T07:24:42.320 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.319+0000 7f407d018740 1 -- 172.21.15.148:0/2792695541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564350365cb0 msgr2=0x5643503680a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:42.320 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.319+0000 7f407d018740 1 --2- 172.21.15.148:0/2792695541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564350365cb0 0x5643503680a0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f406c009be0 tx=0x7f406c030a30 comp rx=0 tx=0).stop 2024-09-19T07:24:42.320 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.319+0000 7f407d018740 1 -- 172.21.15.148:0/2792695541 shutdown_connections 2024-09-19T07:24:42.320 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.319+0000 7f407d018740 1 --2- 172.21.15.148:0/2792695541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564350365cb0 0x5643503680a0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:42.320 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.319+0000 7f407d018740 1 --2- 172.21.15.148:0/2792695541 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56435035b410 0x564350365770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:42.320 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.319+0000 7f407d018740 1 --2- 172.21.15.148:0/2792695541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56435035aaf0 0x56435035aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:42.320 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.319+0000 7f407d018740 1 -- 172.21.15.148:0/2792695541 >> 172.21.15.148:0/2792695541 conn(0x564350357060 msgr2=0x564350357440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:42.321 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.320+0000 7f407d018740 1 -- 172.21.15.148:0/2792695541 shutdown_connections 2024-09-19T07:24:42.321 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.320+0000 7f407d018740 1 -- 172.21.15.148:0/2792695541 wait complete. 2024-09-19T07:24:42.321 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.320+0000 7f407d018740 1 -- start start 2024-09-19T07:24:42.322 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.321+0000 7f407d018740 1 Processor -- start 2024-09-19T07:24:42.322 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.321+0000 7f407d018740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56435035aaf0 0x564350362be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:42.322 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.321+0000 7f407d018740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56435035b410 0x564350363120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:42.322 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.321+0000 7f407d018740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564350365cb0 0x564350363660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:42.322 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.321+0000 7f407d018740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5643503798e0 con 0x56435035aaf0 2024-09-19T07:24:42.322 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.321+0000 7f407d018740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x564350248290 con 0x56435035b410 2024-09-19T07:24:42.322 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.321+0000 7f407d018740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564350379a60 con 0x564350365cb0 2024-09-19T07:24:42.322 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.321+0000 7f407d018740 10 client.0 _ll_register_callbacks cb 0x564350279140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:24:42.323 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.321+0000 7f4073fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564350365cb0 0x564350363660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:42.323 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.322+0000 7f4073fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564350365cb0 0x564350363660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:43102/0 (socket says 172.21.15.148:43102) 2024-09-19T07:24:42.323 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.322+0000 7f4073fff640 1 -- 172.21.15.148:0/3684776555 learned_addr learned my addr 172.21.15.148:0/3684776555 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:24:42.323 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.322+0000 7f40737fe640 1 --2- 172.21.15.148:0/3684776555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56435035aaf0 0x564350362be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:42.323 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.322+0000 7f4073fff640 1 -- 172.21.15.148:0/3684776555 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56435035b410 msgr2=0x564350363120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T07:24:42.323 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.322+0000 7f4073fff640 1 --2- 172.21.15.148:0/3684776555 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56435035b410 0x564350363120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:42.323 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.322+0000 7f4073fff640 1 -- 172.21.15.148:0/3684776555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56435035aaf0 msgr2=0x564350362be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:42.323 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.322+0000 7f4073fff640 1 --2- 172.21.15.148:0/3684776555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56435035aaf0 0x564350362be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:42.323 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.322+0000 7f4073fff640 1 -- 172.21.15.148:0/3684776555 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56434ffd2210 con 0x564350365cb0 2024-09-19T07:24:42.324 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.322+0000 7f4073fff640 1 --2- 172.21.15.148:0/3684776555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564350365cb0 0x564350363660 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f406c02ac00 tx=0x7f406c009820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a594e5f48eb94d36 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:42.324 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.322+0000 7f4052ffd640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-19T07:24:42.324 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.322+0000 7f4052ffd640 1 -- 172.21.15.148:0/3684776555 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f406c036050 con 0x564350365cb0 2024-09-19T07:24:42.325 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.322+0000 7f407d018740 1 -- 172.21.15.148:0/3684776555 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f406c030c60 con 0x564350365cb0 2024-09-19T07:24:42.325 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.323+0000 7f4052ffd640 1 -- 172.21.15.148:0/3684776555 <== mon.1 v2:172.21.15.179:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8556+0+0 (secure 0 0 0) 0x7f406c0303a0 con 0x564350365cb0 2024-09-19T07:24:42.325 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.323+0000 7f4052ffd640 1 -- 172.21.15.148:0/3684776555 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f406c041040 con 0x564350365cb0 2024-09-19T07:24:42.325 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.323+0000 7f407d018740 10 client.26599 fetch_fsmap learned FSMap version 48 2024-09-19T07:24:42.325 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.323+0000 7f407d018740 1 -- 172.21.15.148:0/3684776555 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x56435009e620 con 0x564350365cb0 2024-09-19T07:24:42.325 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.323+0000 7f4052ffd640 1 -- 172.21.15.148:0/3684776555 <== mon.1 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f406c030c60 con 0x564350365cb0 2024-09-19T07:24:42.325 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.323+0000 7f4052ffd640 1 -- 172.21.15.148:0/3684776555 <== mon.1 v2:172.21.15.179:3300/0 5 ==== fsmap(e 48) ==== 8358+0+0 (secure 0 0 0) 0x7f406c03dcd0 con 0x564350365cb0 2024-09-19T07:24:42.325 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.323+0000 7f407d018740 10 client.26599 fetch_fsmap finished waiting for FSMap version 48 2024-09-19T07:24:42.325 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.323+0000 7f407d018740 10 client.26599 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:24:42.325 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.323+0000 7f407d018740 20 client.26599 populate_metadata read hostname 'smithi148' 2024-09-19T07:24:42.325 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.323+0000 7f407d018740 1 --2- 172.21.15.148:0/3684776555 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x564350386b60 0x564350388f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:42.325 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.323+0000 7f407d018740 4 client.26599 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:24:42.326 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.323+0000 7f407d018740 1 -- 172.21.15.148:0/3684776555 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5643502cca20 con 0x564350386b60 2024-09-19T07:24:42.326 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.324+0000 7f40737fe640 1 --2- 172.21.15.148:0/3684776555 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x564350386b60 0x564350388f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:42.327 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.324+0000 7f4052ffd640 10 client.26599 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:24:42.327 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.324+0000 7f40737fe640 1 --2- 172.21.15.148:0/3684776555 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x564350386b60 0x564350388f50 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=acb07e273b952a99 server_cookie=14fc6c523c65de87 in_seq=0 out_seq=0 2024-09-19T07:24:42.327 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.325+0000 7f4052ffd640 1 -- 172.21.15.148:0/3684776555 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5643502cca20 con 0x564350386b60 2024-09-19T07:24:42.327 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.325+0000 7f4052ffd640 10 client.26599 handle_command_reply: tid=0 2024-09-19T07:24:42.327 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.325+0000 7f407d018740 1 client.26599 shutdown 2024-09-19T07:24:42.327 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.326+0000 7f407d018740 1 -- 172.21.15.148:0/3684776555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564350365cb0 msgr2=0x564350363660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:42.327 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.326+0000 7f407d018740 1 --2- 172.21.15.148:0/3684776555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564350365cb0 0x564350363660 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f406c02ac00 tx=0x7f406c009820 comp rx=0 tx=0).stop 2024-09-19T07:24:42.327 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.326+0000 7f407d018740 1 -- 172.21.15.148:0/3684776555 shutdown_connections 2024-09-19T07:24:42.328 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.326+0000 7f407d018740 1 --2- 172.21.15.148:0/3684776555 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x564350386b60 0x564350388f50 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:42.328 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.326+0000 7f407d018740 1 --2- 172.21.15.148:0/3684776555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564350365cb0 0x564350363660 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:42.328 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.326+0000 7f407d018740 1 --2- 172.21.15.148:0/3684776555 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56435035b410 0x564350363120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:42.328 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.326+0000 7f407d018740 1 --2- 172.21.15.148:0/3684776555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56435035aaf0 0x564350362be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:42.328 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.326+0000 7f407d018740 1 -- 172.21.15.148:0/3684776555 >> 172.21.15.148:0/3684776555 conn(0x564350357060 msgr2=0x56435035cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:42.328 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.326+0000 7f4052ffd640 0 client.26599 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:24:42.328 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.326+0000 7f407d018740 1 -- 172.21.15.148:0/3684776555 shutdown_connections 2024-09-19T07:24:42.328 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.326+0000 7f407d018740 1 -- 172.21.15.148:0/3684776555 wait complete. 2024-09-19T07:24:42.328 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.326+0000 7f407d018740 20 client.26599 trim_cache size 0 max 16384 2024-09-19T07:24:42.349 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.349+0000 7f407d018740 1 Processor -- start 2024-09-19T07:24:42.349 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.349+0000 7f407d018740 1 -- start start 2024-09-19T07:24:42.350 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.349+0000 7f407d018740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56435035aaf0 0x56435035d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:42.350 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.349+0000 7f407d018740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56435035b410 0x564350363490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:42.350 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.349+0000 7f407d018740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564350365cb0 0x56435038e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:42.350 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.349+0000 7f407d018740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f40741b6700 con 0x56435035aaf0 2024-09-19T07:24:42.351 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.350+0000 7f4073fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564350365cb0 0x56435038e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:42.351 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.350+0000 7f4073fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564350365cb0 0x56435038e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:43118/0 (socket says 172.21.15.148:43118) 2024-09-19T07:24:42.351 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.350+0000 7f4073fff640 1 -- 172.21.15.148:0/3344514806 learned_addr learned my addr 172.21.15.148:0/3344514806 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:24:42.351 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.349+0000 7f407d018740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f40741b3f70 con 0x56435035b410 2024-09-19T07:24:42.351 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.350+0000 7f407d018740 1 -- 172.21.15.148:0/3344514806 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f40741031e0 con 0x564350365cb0 2024-09-19T07:24:42.351 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.350+0000 7f4072ffd640 1 --2- 172.21.15.148:0/3344514806 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56435035b410 0x564350363490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:42.352 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.351+0000 7f4072ffd640 1 -- 172.21.15.148:0/3344514806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564350365cb0 msgr2=0x56435038e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:42.352 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.351+0000 7f4072ffd640 1 --2- 172.21.15.148:0/3344514806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564350365cb0 0x56435038e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:42.352 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.351+0000 7f4072ffd640 1 -- 172.21.15.148:0/3344514806 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56435035aaf0 msgr2=0x56435035d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:42.352 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.351+0000 7f4072ffd640 1 --2- 172.21.15.148:0/3344514806 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56435035aaf0 0x56435035d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:42.352 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.351+0000 7f4072ffd640 1 -- 172.21.15.148:0/3344514806 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564350379770 con 0x56435035b410 2024-09-19T07:24:42.352 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.351+0000 7f4072ffd640 1 --2- 172.21.15.148:0/3344514806 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56435035b410 0x564350363490 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x564350364190 tx=0x7f406801d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f6ebe09614385cb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:42.352 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.351+0000 7f40597fa640 1 -- 172.21.15.148:0/3344514806 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f406801e650 con 0x56435035b410 2024-09-19T07:24:42.353 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.352+0000 7f40597fa640 1 -- 172.21.15.148:0/3344514806 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f406801ecd0 con 0x56435035b410 2024-09-19T07:24:42.353 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.352+0000 7f40597fa640 1 -- 172.21.15.148:0/3344514806 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4068026be0 con 0x56435035b410 2024-09-19T07:24:42.354 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.354+0000 7f407d018740 1 -- 172.21.15.148:0/3344514806 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56435035b410 msgr2=0x564350363490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:42.354 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.354+0000 7f407d018740 1 --2- 172.21.15.148:0/3344514806 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56435035b410 0x564350363490 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x564350364190 tx=0x7f406801d000 comp rx=0 tx=0).stop 2024-09-19T07:24:42.354 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.354+0000 7f407d018740 1 -- 172.21.15.148:0/3344514806 shutdown_connections 2024-09-19T07:24:42.354 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.354+0000 7f407d018740 1 --2- 172.21.15.148:0/3344514806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564350365cb0 0x56435038e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:42.355 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.354+0000 7f407d018740 1 --2- 172.21.15.148:0/3344514806 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56435035b410 0x564350363490 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:42.355 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.354+0000 7f407d018740 1 --2- 172.21.15.148:0/3344514806 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56435035aaf0 0x56435035d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:42.355 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.354+0000 7f407d018740 1 -- 172.21.15.148:0/3344514806 >> 172.21.15.148:0/3344514806 conn(0x564350357060 msgr2=0x56435035de90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:42.355 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.354+0000 7f407d018740 1 -- 172.21.15.148:0/3344514806 shutdown_connections 2024-09-19T07:24:42.355 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.354+0000 7f407d018740 1 -- 172.21.15.148:0/3344514806 wait complete. 2024-09-19T07:24:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.354+0000 7f407d018740 1 -- start start 2024-09-19T07:24:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.355+0000 7f407d018740 1 Processor -- start 2024-09-19T07:24:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.355+0000 7f407d018740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56435035aaf0 0x56435037ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.355+0000 7f407d018740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56435035b410 0x56435037f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.355+0000 7f407d018740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564350365cb0 0x56435035f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.355+0000 7f4072ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56435035b410 0x56435037f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.355+0000 7f4072ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56435035b410 0x56435037f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35856/0 (socket says 172.21.15.148:35856) 2024-09-19T07:24:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.355+0000 7f4072ffd640 1 -- 172.21.15.148:0/2185356309 learned_addr learned my addr 172.21.15.148:0/2185356309 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:24:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.355+0000 7f407d018740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f40740728d0 con 0x56435035b410 2024-09-19T07:24:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.355+0000 7f407d018740 1 -- 172.21.15.148:0/2185356309 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4074073d40 con 0x56435035aaf0 2024-09-19T07:24:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.355+0000 7f407d018740 1 -- 172.21.15.148:0/2185356309 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4074072fa0 con 0x564350365cb0 2024-09-19T07:24:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.355+0000 7f40737fe640 1 --2- 172.21.15.148:0/2185356309 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56435035aaf0 0x56435037ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.355+0000 7f407d018740 10 client.0 _ll_register_callbacks cb 0x7f4068009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:24:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.355+0000 7f4073fff640 1 --2- 172.21.15.148:0/2185356309 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564350365cb0 0x56435035f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.356+0000 7f4072ffd640 1 -- 172.21.15.148:0/2185356309 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564350365cb0 msgr2=0x56435035f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.356+0000 7f4072ffd640 1 --2- 172.21.15.148:0/2185356309 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564350365cb0 0x56435035f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.356+0000 7f4072ffd640 1 -- 172.21.15.148:0/2185356309 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56435035aaf0 msgr2=0x56435037ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.356+0000 7f4072ffd640 1 --2- 172.21.15.148:0/2185356309 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56435035aaf0 0x56435037ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.356+0000 7f4072ffd640 1 -- 172.21.15.148:0/2185356309 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56435035fae0 con 0x56435035b410 2024-09-19T07:24:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.356+0000 7f40737fe640 1 --2- 172.21.15.148:0/2185356309 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56435035aaf0 0x56435037ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:24:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.356+0000 7f4072ffd640 1 --2- 172.21.15.148:0/2185356309 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56435035b410 0x56435037f450 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f4068009600 tx=0x7f406801e8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3908e29908868907 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.356+0000 7f4052ffd640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:24:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.356+0000 7f4052ffd640 1 -- 172.21.15.148:0/2185356309 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f406801eae0 con 0x56435035b410 2024-09-19T07:24:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.356+0000 7f4052ffd640 1 -- 172.21.15.148:0/2185356309 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8556+0+0 (secure 0 0 0) 0x7f4068009040 con 0x56435035b410 2024-09-19T07:24:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.356+0000 7f407d018740 1 -- 172.21.15.148:0/2185356309 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f406801ecd0 con 0x56435035b410 2024-09-19T07:24:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.356+0000 7f4052ffd640 1 -- 172.21.15.148:0/2185356309 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f406803f050 con 0x56435035b410 2024-09-19T07:24:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.356+0000 7f407d018740 10 client.17421 fetch_fsmap learned FSMap version 48 2024-09-19T07:24:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.356+0000 7f407d018740 1 -- 172.21.15.148:0/2185356309 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x5643503f0fb0 con 0x56435035b410 2024-09-19T07:24:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.357+0000 7f4052ffd640 1 -- 172.21.15.148:0/2185356309 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4068036070 con 0x56435035b410 2024-09-19T07:24:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.357+0000 7f4052ffd640 1 -- 172.21.15.148:0/2185356309 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 48) ==== 8358+0+0 (secure 0 0 0) 0x7f4068030070 con 0x56435035b410 2024-09-19T07:24:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.357+0000 7f407d018740 10 client.17421 fetch_fsmap finished waiting for FSMap version 48 2024-09-19T07:24:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.357+0000 7f407d018740 10 client.17421 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:24:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.357+0000 7f407d018740 20 client.17421 populate_metadata read hostname 'smithi148' 2024-09-19T07:24:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.357+0000 7f407d018740 1 --2- 172.21.15.148:0/2185356309 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5643503f1760 0x5643503f3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:42.361 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.357+0000 7f407d018740 4 client.17421 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:24:42.361 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.357+0000 7f407d018740 1 -- 172.21.15.148:0/2185356309 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f406801ecd0 con 0x5643503f1760 2024-09-19T07:24:42.361 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.357+0000 7f40737fe640 1 --2- 172.21.15.148:0/2185356309 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5643503f1760 0x5643503f3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:42.361 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.357+0000 7f40737fe640 1 --2- 172.21.15.148:0/2185356309 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5643503f1760 0x5643503f3b80 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4250aa1a725fd16 server_cookie=c1f004cce1d96008 in_seq=0 out_seq=0 2024-09-19T07:24:42.361 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.357+0000 7f4052ffd640 10 client.17421 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:24:42.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.365+0000 7f4052ffd640 1 -- 172.21.15.148:0/2185356309 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f406801ecd0 con 0x5643503f1760 2024-09-19T07:24:42.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.365+0000 7f4052ffd640 10 client.17421 handle_command_reply: tid=0 2024-09-19T07:24:42.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.366+0000 7f407d018740 1 client.17421 shutdown 2024-09-19T07:24:42.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.366+0000 7f407d018740 1 -- 172.21.15.148:0/2185356309 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56435035b410 msgr2=0x56435037f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:42.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.366+0000 7f407d018740 1 --2- 172.21.15.148:0/2185356309 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56435035b410 0x56435037f450 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f4068009600 tx=0x7f406801e8f0 comp rx=0 tx=0).stop 2024-09-19T07:24:42.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.366+0000 7f407d018740 1 -- 172.21.15.148:0/2185356309 shutdown_connections 2024-09-19T07:24:42.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.366+0000 7f407d018740 1 --2- 172.21.15.148:0/2185356309 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5643503f1760 0x5643503f3b80 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:42.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.366+0000 7f407d018740 1 --2- 172.21.15.148:0/2185356309 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564350365cb0 0x56435035f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:42.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.366+0000 7f407d018740 1 --2- 172.21.15.148:0/2185356309 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56435035b410 0x56435037f450 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:42.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.366+0000 7f407d018740 1 --2- 172.21.15.148:0/2185356309 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56435035aaf0 0x56435037ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:42.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.366+0000 7f4052ffd640 0 client.17421 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:24:42.367 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.366+0000 7f407d018740 1 -- 172.21.15.148:0/2185356309 >> 172.21.15.148:0/2185356309 conn(0x564350357060 msgr2=0x5643503559a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:42.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.366+0000 7f407d018740 1 -- 172.21.15.148:0/2185356309 shutdown_connections 2024-09-19T07:24:42.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.366+0000 7f407d018740 1 -- 172.21.15.148:0/2185356309 wait complete. 2024-09-19T07:24:42.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.366+0000 7f407d018740 20 client.17421 trim_cache size 0 max 16384 2024-09-19T07:24:42.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:24:42.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:24:42.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:24:42.368 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:24:42.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.367+0000 7f407a19f640 1 -- 172.21.15.148:0/471028951 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f405c0a34e0 msgr2=0x7f405c0a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:42.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.367+0000 7f407a19f640 1 --2- 172.21.15.148:0/471028951 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f405c0a34e0 0x7f405c0a59a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f40680058c0 tx=0x7f40680127c0 comp rx=0 tx=0).stop 2024-09-19T07:24:42.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.367+0000 7f407a19f640 1 -- 172.21.15.148:0/471028951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4074101ae0 msgr2=0x7f4074111590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:42.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.367+0000 7f407a19f640 1 --2- 172.21.15.148:0/471028951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4074101ae0 0x7f4074111590 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f406400e9c0 tx=0x7f406400ee80 comp rx=0 tx=0).stop 2024-09-19T07:24:42.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.367+0000 7f407a19f640 1 -- 172.21.15.148:0/471028951 shutdown_connections 2024-09-19T07:24:42.369 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.367+0000 7f407a19f640 1 --2- 172.21.15.148:0/471028951 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f405c0a34e0 0x7f405c0a59a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:42.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.367+0000 7f407a19f640 1 --2- 172.21.15.148:0/471028951 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4074107b80 0x7f4074116da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:42.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.367+0000 7f407a19f640 1 --2- 172.21.15.148:0/471028951 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4074102480 0x7f4074111ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:42.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.367+0000 7f407a19f640 1 --2- 172.21.15.148:0/471028951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4074101ae0 0x7f4074111590 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:42.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.367+0000 7f407a19f640 1 -- 172.21.15.148:0/471028951 >> 172.21.15.148:0/471028951 conn(0x7f40740fd7e0 msgr2=0x7f40740fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:42.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.367+0000 7f407a19f640 1 -- 172.21.15.148:0/471028951 shutdown_connections 2024-09-19T07:24:42.370 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:42.367+0000 7f407a19f640 1 -- 172.21.15.148:0/471028951 wait complete. 2024-09-19T07:24:42.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:24:42 smithi165 ceph-mon[35326]: pgmap v427: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 899 KiB/s rd, 915 KiB/s wr, 120 op/s 2024-09-19T07:24:42.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:24:42 smithi165 ceph-mon[35326]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:24:43.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:24:42 smithi179 ceph-mon[35716]: pgmap v427: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 899 KiB/s rd, 915 KiB/s wr, 120 op/s 2024-09-19T07:24:43.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:24:42 smithi179 ceph-mon[35716]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:24:43.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:24:42 smithi148 ceph-mon[31180]: pgmap v427: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 899 KiB/s rd, 915 KiB/s wr, 120 op/s 2024-09-19T07:24:43.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:24:42 smithi148 ceph-mon[31180]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:24:44.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:24:44 smithi165 ceph-mon[35326]: pgmap v428: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 883 KiB/s rd, 904 KiB/s wr, 146 op/s 2024-09-19T07:24:44.884 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:24:44 smithi148 ceph-mon[31180]: pgmap v428: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 883 KiB/s rd, 904 KiB/s wr, 146 op/s 2024-09-19T07:24:45.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:24:44 smithi179 ceph-mon[35716]: pgmap v428: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 883 KiB/s rd, 904 KiB/s wr, 146 op/s 2024-09-19T07:24:46.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:24:46 smithi165 ceph-mon[35326]: pgmap v429: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 163 op/s 2024-09-19T07:24:47.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:24:46 smithi179 ceph-mon[35716]: pgmap v429: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 163 op/s 2024-09-19T07:24:47.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:24:46 smithi148 ceph-mon[31180]: pgmap v429: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 163 op/s 2024-09-19T07:24:48.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:24:48 smithi165 ceph-mon[35326]: pgmap v430: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 161 op/s 2024-09-19T07:24:49.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:24:48 smithi179 ceph-mon[35716]: pgmap v430: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 161 op/s 2024-09-19T07:24:49.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:24:48 smithi148 ceph-mon[31180]: pgmap v430: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 161 op/s 2024-09-19T07:24:49.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:49.793+0000 7fc542ffd640 1 -- 172.21.15.148:0/1906132708 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x555790fdcd20 con 0x55579109bac0 2024-09-19T07:24:49.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:49.793+0000 7fc542ffd640 10 client.26587 handle_command_reply: tid=0 2024-09-19T07:24:49.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:49.793+0000 7fc56bd3b740 1 client.26587 shutdown 2024-09-19T07:24:49.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:49.793+0000 7fc56bd3b740 1 -- 172.21.15.148:0/1906132708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55579107aae0 msgr2=0x555791090590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:49.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:49.793+0000 7fc56bd3b740 1 --2- 172.21.15.148:0/1906132708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55579107aae0 0x555791090590 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc55800f740 tx=0x7fc55800f6d0 comp rx=0 tx=0).stop 2024-09-19T07:24:49.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:49.793+0000 7fc56bd3b740 1 -- 172.21.15.148:0/1906132708 shutdown_connections 2024-09-19T07:24:49.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:49.793+0000 7fc56bd3b740 1 --2- 172.21.15.148:0/1906132708 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55579109bac0 0x555791109160 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:49.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:49.793+0000 7fc56bd3b740 1 --2- 172.21.15.148:0/1906132708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55579107aae0 0x555791090590 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:49.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:49.793+0000 7fc56bd3b740 1 --2- 172.21.15.148:0/1906132708 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555791070220 0x555791090050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:49.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:49.793+0000 7fc542ffd640 0 client.26587 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:24:49.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:49.793+0000 7fc56bd3b740 1 --2- 172.21.15.148:0/1906132708 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55579106f900 0x55579108fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:49.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:49.793+0000 7fc56bd3b740 1 -- 172.21.15.148:0/1906132708 >> 172.21.15.148:0/1906132708 conn(0x55579106be90 msgr2=0x555791079ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:49.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:49.794+0000 7fc56bd3b740 1 -- 172.21.15.148:0/1906132708 shutdown_connections 2024-09-19T07:24:49.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:49.794+0000 7fc56bd3b740 1 -- 172.21.15.148:0/1906132708 wait complete. 2024-09-19T07:24:49.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:49.794+0000 7fc56bd3b740 20 client.26587 trim_cache size 0 max 16384 2024-09-19T07:24:49.796 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:24:49.796 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 48, 2024-09-19T07:24:49.796 INFO:teuthology.orchestra.run.smithi148.stdout: "leader": 24457, 2024-09-19T07:24:49.796 INFO:teuthology.orchestra.run.smithi148.stdout: "set_version": 46, 2024-09-19T07:24:49.796 INFO:teuthology.orchestra.run.smithi148.stdout: "sets": { 2024-09-19T07:24:49.796 INFO:teuthology.orchestra.run.smithi148.stdout: "52b74135": { 2024-09-19T07:24:49.796 INFO:teuthology.orchestra.run.smithi148.stdout: "version": 46, 2024-09-19T07:24:49.796 INFO:teuthology.orchestra.run.smithi148.stdout: "age_ref": 0.0, 2024-09-19T07:24:49.796 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:24:49.796 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "QUIESCED", 2024-09-19T07:24:49.796 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:24:49.797 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:24:49.797 INFO:teuthology.orchestra.run.smithi148.stdout: "timeout": 90.0, 2024-09-19T07:24:49.797 INFO:teuthology.orchestra.run.smithi148.stdout: "expiration": 142.2, 2024-09-19T07:24:49.797 INFO:teuthology.orchestra.run.smithi148.stdout: "members": { 2024-09-19T07:24:49.797 INFO:teuthology.orchestra.run.smithi148.stdout: "file:/": { 2024-09-19T07:24:49.797 INFO:teuthology.orchestra.run.smithi148.stdout: "excluded": false, 2024-09-19T07:24:49.797 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:24:49.797 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "QUIESCED", 2024-09-19T07:24:49.797 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:24:49.797 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:24:49.797 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:24:49.797 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:24:49.797 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:24:49.797 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:24:49.798 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:24:49.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:49.794+0000 7fc569962640 1 -- 172.21.15.148:0/403250777 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc54c0a34c0 msgr2=0x7fc54c0a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:49.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:49.794+0000 7fc569962640 1 --2- 172.21.15.148:0/403250777 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc54c0a34c0 0x7fc54c0a5980 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x55579106ccf0 tx=0x7fc5640955f0 comp rx=0 tx=0).stop 2024-09-19T07:24:49.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:49.794+0000 7fc569962640 1 -- 172.21.15.148:0/403250777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc55c0a4d30 msgr2=0x7fc55c143470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:49.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:49.794+0000 7fc569962640 1 --2- 172.21.15.148:0/403250777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc55c0a4d30 0x7fc55c143470 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc564051220 tx=0x7fc564063640 comp rx=0 tx=0).stop 2024-09-19T07:24:49.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:49.795+0000 7fc569962640 1 -- 172.21.15.148:0/403250777 shutdown_connections 2024-09-19T07:24:49.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:49.795+0000 7fc569962640 1 --2- 172.21.15.148:0/403250777 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc54c0a34c0 0x7fc54c0a5980 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:49.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:49.795+0000 7fc569962640 1 --2- 172.21.15.148:0/403250777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc55c0aab50 0x7fc55c147d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:49.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:49.795+0000 7fc569962640 1 --2- 172.21.15.148:0/403250777 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc55c0aa230 0x7fc55c1439b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:49.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:49.795+0000 7fc569962640 1 --2- 172.21.15.148:0/403250777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc55c0a4d30 0x7fc55c143470 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:49.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:49.795+0000 7fc569962640 1 -- 172.21.15.148:0/403250777 >> 172.21.15.148:0/403250777 conn(0x7fc55c01a0a0 msgr2=0x7fc55c0a6a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:49.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:49.795+0000 7fc569962640 1 -- 172.21.15.148:0/403250777 shutdown_connections 2024-09-19T07:24:49.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:49.795+0000 7fc569962640 1 -- 172.21.15.148:0/403250777 wait complete. 2024-09-19T07:24:50.483 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '52b74135', quiesce took 13.6 seconds. Will release after: 8.6 2024-09-19T07:24:50.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:24:50 smithi148 ceph-mon[31180]: pgmap v431: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 162 op/s 2024-09-19T07:24:50.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:24:50 smithi165 ceph-mon[35326]: pgmap v431: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 162 op/s 2024-09-19T07:24:51.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:24:50 smithi179 ceph-mon[35716]: pgmap v431: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 162 op/s 2024-09-19T07:24:52.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:24:52 smithi165 ceph-mon[35326]: pgmap v432: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 165 op/s 2024-09-19T07:24:53.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:24:52 smithi179 ceph-mon[35716]: pgmap v432: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 165 op/s 2024-09-19T07:24:53.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:24:52 smithi148 ceph-mon[31180]: pgmap v432: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 165 op/s 2024-09-19T07:24:54.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:24:54 smithi165 ceph-mon[35326]: pgmap v433: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 177 KiB/s wr, 63 op/s 2024-09-19T07:24:54.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:24:54 smithi165 ceph-mon[35326]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:24:55.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:24:54 smithi179 ceph-mon[35716]: pgmap v433: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 177 KiB/s wr, 63 op/s 2024-09-19T07:24:55.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:24:54 smithi179 ceph-mon[35716]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:24:55.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:24:54 smithi148 ceph-mon[31180]: pgmap v433: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 177 KiB/s wr, 63 op/s 2024-09-19T07:24:55.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:24:54 smithi148 ceph-mon[31180]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:24:55.466 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.463+0000 7f60ef853640 1 -- 172.21.15.148:0/188084551 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60e8102480 msgr2=0x7f60e810e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:55.466 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.463+0000 7f60ef853640 1 --2- 172.21.15.148:0/188084551 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60e8102480 0x7f60e810e9b0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f60e0009cd0 tx=0x7f60e002a8e0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.466 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.464+0000 7f60ef853640 1 -- 172.21.15.148:0/188084551 shutdown_connections 2024-09-19T07:24:55.467 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.464+0000 7f60ef853640 1 --2- 172.21.15.148:0/188084551 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60e8102480 0x7f60e810e9b0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.467 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.464+0000 7f60ef853640 1 --2- 172.21.15.148:0/188084551 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60e8101ae0 0x7f60e8101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.467 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.464+0000 7f60ef853640 1 --2- 172.21.15.148:0/188084551 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f60e8107b80 0x7f60e8107f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.467 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.464+0000 7f60ef853640 1 -- 172.21.15.148:0/188084551 >> 172.21.15.148:0/188084551 conn(0x7f60e80fd7e0 msgr2=0x7f60e80ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:55.467 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.464+0000 7f60ef853640 1 -- 172.21.15.148:0/188084551 shutdown_connections 2024-09-19T07:24:55.467 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.464+0000 7f60ef853640 1 -- 172.21.15.148:0/188084551 wait complete. 2024-09-19T07:24:55.467 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.464+0000 7f60ef853640 1 Processor -- start 2024-09-19T07:24:55.467 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.464+0000 7f60ef853640 1 -- start start 2024-09-19T07:24:55.467 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.465+0000 7f60ef853640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60e8101ae0 0x7f60e81982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:55.467 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.465+0000 7f60ef853640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f60e8102480 0x7f60e8198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:55.467 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.465+0000 7f60ef853640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60e8107b80 0x7f60e819cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:55.467 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.465+0000 7f60ef853640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f60e8111ef0 con 0x7f60e8107b80 2024-09-19T07:24:55.468 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.465+0000 7f60ef853640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f60e8111d70 con 0x7f60e8102480 2024-09-19T07:24:55.468 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.465+0000 7f60ef853640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f60e8112070 con 0x7f60e8101ae0 2024-09-19T07:24:55.468 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.465+0000 7f60eddf0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60e8107b80 0x7f60e819cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:55.468 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.465+0000 7f60ecdee640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f60e8102480 0x7f60e8198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:55.468 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.465+0000 7f60eddf0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60e8107b80 0x7f60e819cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56412/0 (socket says 172.21.15.148:56412) 2024-09-19T07:24:55.468 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.465+0000 7f60eddf0640 1 -- 172.21.15.148:0/530541237 learned_addr learned my addr 172.21.15.148:0/530541237 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:24:55.468 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.465+0000 7f60ed5ef640 1 --2- 172.21.15.148:0/530541237 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60e8101ae0 0x7f60e81982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:55.468 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.465+0000 7f60eddf0640 1 -- 172.21.15.148:0/530541237 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60e8101ae0 msgr2=0x7f60e81982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:55.468 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.465+0000 7f60eddf0640 1 --2- 172.21.15.148:0/530541237 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60e8101ae0 0x7f60e81982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.468 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.465+0000 7f60eddf0640 1 -- 172.21.15.148:0/530541237 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f60e8102480 msgr2=0x7f60e8198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:55.468 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.465+0000 7f60eddf0640 1 --2- 172.21.15.148:0/530541237 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f60e8102480 0x7f60e8198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.468 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.465+0000 7f60eddf0640 1 -- 172.21.15.148:0/530541237 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60e819d2d0 con 0x7f60e8107b80 2024-09-19T07:24:55.468 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.465+0000 7f60eddf0640 1 --2- 172.21.15.148:0/530541237 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60e8107b80 0x7f60e819cba0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f60e0005cc0 tx=0x7f60e0032f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:55.469 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.465+0000 7f60de7fc640 1 -- 172.21.15.148:0/530541237 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e0004040 con 0x7f60e8107b80 2024-09-19T07:24:55.469 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.465+0000 7f60ef853640 1 -- 172.21.15.148:0/530541237 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60e819d560 con 0x7f60e8107b80 2024-09-19T07:24:55.469 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.466+0000 7f60de7fc640 1 -- 172.21.15.148:0/530541237 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60e00046c0 con 0x7f60e8107b80 2024-09-19T07:24:55.469 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.466+0000 7f60de7fc640 1 -- 172.21.15.148:0/530541237 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e0030e00 con 0x7f60e8107b80 2024-09-19T07:24:55.469 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.466+0000 7f60ef853640 1 -- 172.21.15.148:0/530541237 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60e81a4e50 con 0x7f60e8107b80 2024-09-19T07:24:55.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.468+0000 7f60de7fc640 1 -- 172.21.15.148:0/530541237 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f60e00305a0 con 0x7f60e8107b80 2024-09-19T07:24:55.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.468+0000 7f60f25ea740 1 Processor -- start 2024-09-19T07:24:55.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.468+0000 7f60f25ea740 1 -- start start 2024-09-19T07:24:55.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.469+0000 7f60f25ea740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0f2f319f0 0x55d0f2f31dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:55.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.469+0000 7f60f25ea740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d0f2f32310 0x55d0f2f40b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:55.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.469+0000 7f60f25ea740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d0f2f410c0 0x55d0f2f434b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:55.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.469+0000 7f60f25ea740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55d0f2e962f0 con 0x55d0f2f319f0 2024-09-19T07:24:55.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.469+0000 7f60f25ea740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55d0f2e3e270 con 0x55d0f2f410c0 2024-09-19T07:24:55.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.469+0000 7f60f25ea740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d0f2e922b0 con 0x55d0f2f32310 2024-09-19T07:24:55.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.469+0000 7f60de7fc640 1 --2- 172.21.15.148:0/530541237 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f60d40a3460 0x7f60d40a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:55.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.469+0000 7f60ecdee640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0f2f319f0 0x55d0f2f31dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:55.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.469+0000 7f60ecdee640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0f2f319f0 0x55d0f2f31dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56414/0 (socket says 172.21.15.148:56414) 2024-09-19T07:24:55.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.469+0000 7f60ecdee640 1 -- 172.21.15.148:0/844727689 learned_addr learned my addr 172.21.15.148:0/844727689 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:24:55.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.469+0000 7f60ed5ef640 1 --2- 172.21.15.148:0/844727689 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d0f2f32310 0x55d0f2f40b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:55.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.469+0000 7f60eddf0640 1 --2- 172.21.15.148:0/530541237 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f60d40a3460 0x7f60d40a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:55.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.469+0000 7f60ecdee640 1 --2- 172.21.15.148:0/844727689 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d0f2f410c0 0x55d0f2f434b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:55.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.469+0000 7f60de7fc640 1 -- 172.21.15.148:0/530541237 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8556+0+0 (secure 0 0 0) 0x7f60e002e030 con 0x7f60e8107b80 2024-09-19T07:24:55.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.469+0000 7f60ed5ef640 1 -- 172.21.15.148:0/844727689 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d0f2f410c0 msgr2=0x55d0f2f434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:55.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.469+0000 7f60ed5ef640 1 --2- 172.21.15.148:0/844727689 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d0f2f410c0 0x55d0f2f434b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.469+0000 7f60ed5ef640 1 -- 172.21.15.148:0/844727689 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0f2f319f0 msgr2=0x55d0f2f31dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:55.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.469+0000 7f60ed5ef640 1 --2- 172.21.15.148:0/844727689 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0f2f319f0 0x55d0f2f31dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.469+0000 7f60ed5ef640 1 -- 172.21.15.148:0/844727689 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0f2e3d340 con 0x55d0f2f32310 2024-09-19T07:24:55.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.469+0000 7f60ecdee640 1 --2- 172.21.15.148:0/844727689 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0f2f319f0 0x55d0f2f31dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:24:55.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.469+0000 7f60ed5ef640 1 --2- 172.21.15.148:0/844727689 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d0f2f32310 0x55d0f2f40b80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f60e400bb70 tx=0x7f60e40107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c0b660a3084a605 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:55.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.470+0000 7f60eddf0640 1 --2- 172.21.15.148:0/530541237 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f60d40a3460 0x7f60d40a5920 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f60e00c5e90 tx=0x7f60e0088140 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:55.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.470+0000 7f60d37fe640 1 -- 172.21.15.148:0/844727689 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e4004030 con 0x55d0f2f32310 2024-09-19T07:24:55.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.470+0000 7f60d37fe640 1 -- 172.21.15.148:0/844727689 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60e40041d0 con 0x55d0f2f32310 2024-09-19T07:24:55.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.470+0000 7f60d37fe640 1 -- 172.21.15.148:0/844727689 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e40116a0 con 0x55d0f2f32310 2024-09-19T07:24:55.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.471+0000 7f60f25ea740 1 -- 172.21.15.148:0/844727689 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d0f2f32310 msgr2=0x55d0f2f40b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:55.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.471+0000 7f60f25ea740 1 --2- 172.21.15.148:0/844727689 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d0f2f32310 0x55d0f2f40b80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f60e400bb70 tx=0x7f60e40107a0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.471+0000 7f60f25ea740 1 -- 172.21.15.148:0/844727689 shutdown_connections 2024-09-19T07:24:55.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.471+0000 7f60f25ea740 1 --2- 172.21.15.148:0/844727689 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d0f2f410c0 0x55d0f2f434b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.471+0000 7f60f25ea740 1 --2- 172.21.15.148:0/844727689 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d0f2f32310 0x55d0f2f40b80 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.471+0000 7f60f25ea740 1 --2- 172.21.15.148:0/844727689 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0f2f319f0 0x55d0f2f31dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.471+0000 7f60f25ea740 1 -- 172.21.15.148:0/844727689 >> 172.21.15.148:0/844727689 conn(0x55d0f2f2e060 msgr2=0x55d0f2f2e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:55.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.471+0000 7f60f25ea740 1 -- 172.21.15.148:0/844727689 shutdown_connections 2024-09-19T07:24:55.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.471+0000 7f60f25ea740 1 -- 172.21.15.148:0/844727689 wait complete. 2024-09-19T07:24:55.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.471+0000 7f60f25ea740 1 -- start start 2024-09-19T07:24:55.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.471+0000 7f60f25ea740 1 Processor -- start 2024-09-19T07:24:55.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.472+0000 7f60f25ea740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d0f2f319f0 0x55d0f2f3e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:55.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.472+0000 7f60f25ea740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0f2f32310 0x55d0f2f3e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:55.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.472+0000 7f60f25ea740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d0f2f410c0 0x55d0f2f3eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:55.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.472+0000 7f60f25ea740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55d0f2f43d20 con 0x55d0f2f32310 2024-09-19T07:24:55.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.472+0000 7f60f25ea740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55d0f2e1f290 con 0x55d0f2f319f0 2024-09-19T07:24:55.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.472+0000 7f60f25ea740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d0f2f43ea0 con 0x55d0f2f410c0 2024-09-19T07:24:55.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.472+0000 7f60f25ea740 10 client.0 _ll_register_callbacks cb 0x55d0f2e50140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:24:55.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.472+0000 7f60ed5ef640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0f2f32310 0x55d0f2f3e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:55.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.472+0000 7f60ed5ef640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0f2f32310 0x55d0f2f3e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56424/0 (socket says 172.21.15.148:56424) 2024-09-19T07:24:55.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.472+0000 7f60ed5ef640 1 -- 172.21.15.148:0/3812545240 learned_addr learned my addr 172.21.15.148:0/3812545240 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:24:55.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.472+0000 7f60ecdee640 1 --2- 172.21.15.148:0/3812545240 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d0f2f410c0 0x55d0f2f3eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:55.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.472+0000 7f60ecdee640 1 --2- 172.21.15.148:0/3812545240 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d0f2f319f0 0x55d0f2f3e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:55.480 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.472+0000 7f60ed5ef640 1 -- 172.21.15.148:0/3812545240 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d0f2f410c0 msgr2=0x55d0f2f3eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:55.480 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.472+0000 7f60ed5ef640 1 --2- 172.21.15.148:0/3812545240 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d0f2f410c0 0x55d0f2f3eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.480 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.472+0000 7f60ed5ef640 1 -- 172.21.15.148:0/3812545240 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d0f2f319f0 msgr2=0x55d0f2f3e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:55.480 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.472+0000 7f60ed5ef640 1 --2- 172.21.15.148:0/3812545240 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d0f2f319f0 0x55d0f2f3e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.480 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.472+0000 7f60ed5ef640 1 -- 172.21.15.148:0/3812545240 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0f2ba9210 con 0x55d0f2f32310 2024-09-19T07:24:55.480 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.472+0000 7f60ed5ef640 1 --2- 172.21.15.148:0/3812545240 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0f2f32310 0x55d0f2f3e560 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f60e400b620 tx=0x7f60e400bd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8945ef047788bd27 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:55.480 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.472+0000 7f60d0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:24:55.480 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.472+0000 7f60d0ff9640 1 -- 172.21.15.148:0/3812545240 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e402a060 con 0x55d0f2f32310 2024-09-19T07:24:55.480 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.472+0000 7f60f25ea740 1 -- 172.21.15.148:0/3812545240 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60e40041d0 con 0x55d0f2f32310 2024-09-19T07:24:55.480 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.472+0000 7f60d0ff9640 1 -- 172.21.15.148:0/3812545240 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8556+0+0 (secure 0 0 0) 0x7f60e40035f0 con 0x55d0f2f32310 2024-09-19T07:24:55.480 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.473+0000 7f60d0ff9640 1 -- 172.21.15.148:0/3812545240 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f60e400be90 con 0x55d0f2f32310 2024-09-19T07:24:55.480 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.473+0000 7f60f25ea740 10 client.17433 fetch_fsmap learned FSMap version 49 2024-09-19T07:24:55.480 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.473+0000 7f60f25ea740 1 -- 172.21.15.148:0/3812545240 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55d0f2c75620 con 0x55d0f2f32310 2024-09-19T07:24:55.481 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.473+0000 7f60d0ff9640 1 -- 172.21.15.148:0/3812545240 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60e40041d0 con 0x55d0f2f32310 2024-09-19T07:24:55.481 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.473+0000 7f60d0ff9640 1 -- 172.21.15.148:0/3812545240 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 49) ==== 8362+0+0 (secure 0 0 0) 0x7f60e4004850 con 0x55d0f2f32310 2024-09-19T07:24:55.481 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.473+0000 7f60f25ea740 10 client.17433 fetch_fsmap finished waiting for FSMap version 49 2024-09-19T07:24:55.481 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.473+0000 7f60f25ea740 10 client.17433 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:24:55.481 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.473+0000 7f60f25ea740 20 client.17433 populate_metadata read hostname 'smithi148' 2024-09-19T07:24:55.481 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.473+0000 7f60f25ea740 1 --2- 172.21.15.148:0/3812545240 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55d0f2f510e0 0x55d0f2f534d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:55.481 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.473+0000 7f60f25ea740 4 client.17433 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:24:55.481 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.473+0000 7f60f25ea740 1 -- 172.21.15.148:0/3812545240 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d0f2ea3a20 con 0x55d0f2f510e0 2024-09-19T07:24:55.481 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.473+0000 7f60ecdee640 1 --2- 172.21.15.148:0/3812545240 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55d0f2f510e0 0x55d0f2f534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:55.481 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.474+0000 7f60ecdee640 1 --2- 172.21.15.148:0/3812545240 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55d0f2f510e0 0x55d0f2f534d0 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4f70f599c48f95e server_cookie=3390cb878001e3dc in_seq=0 out_seq=0 2024-09-19T07:24:55.482 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.474+0000 7f60d0ff9640 10 client.17433 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:24:55.482 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.475+0000 7f60d0ff9640 1 -- 172.21.15.148:0/3812545240 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d0f2ea3a20 con 0x55d0f2f510e0 2024-09-19T07:24:55.482 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.475+0000 7f60d0ff9640 10 client.17433 handle_command_reply: tid=0 2024-09-19T07:24:55.482 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.475+0000 7f60f25ea740 1 client.17433 shutdown 2024-09-19T07:24:55.482 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.475+0000 7f60f25ea740 1 -- 172.21.15.148:0/3812545240 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0f2f32310 msgr2=0x55d0f2f3e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:55.482 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.475+0000 7f60f25ea740 1 --2- 172.21.15.148:0/3812545240 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0f2f32310 0x55d0f2f3e560 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f60e400b620 tx=0x7f60e400bd20 comp rx=0 tx=0).stop 2024-09-19T07:24:55.482 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.475+0000 7f60f25ea740 1 -- 172.21.15.148:0/3812545240 shutdown_connections 2024-09-19T07:24:55.482 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.475+0000 7f60f25ea740 1 --2- 172.21.15.148:0/3812545240 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55d0f2f510e0 0x55d0f2f534d0 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.482 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.475+0000 7f60f25ea740 1 --2- 172.21.15.148:0/3812545240 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d0f2f410c0 0x55d0f2f3eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.482 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.475+0000 7f60f25ea740 1 --2- 172.21.15.148:0/3812545240 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0f2f32310 0x55d0f2f3e560 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.482 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.475+0000 7f60d0ff9640 0 client.17433 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:24:55.482 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.475+0000 7f60f25ea740 1 --2- 172.21.15.148:0/3812545240 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d0f2f319f0 0x55d0f2f3e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.482 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.475+0000 7f60f25ea740 1 -- 172.21.15.148:0/3812545240 >> 172.21.15.148:0/3812545240 conn(0x55d0f2f2e060 msgr2=0x55d0f2f33dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:55.483 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.475+0000 7f60f25ea740 1 -- 172.21.15.148:0/3812545240 shutdown_connections 2024-09-19T07:24:55.483 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.475+0000 7f60f25ea740 1 -- 172.21.15.148:0/3812545240 wait complete. 2024-09-19T07:24:55.483 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.475+0000 7f60f25ea740 20 client.17433 trim_cache size 0 max 16384 2024-09-19T07:24:55.491 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.489+0000 7f60f25ea740 1 Processor -- start 2024-09-19T07:24:55.491 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.489+0000 7f60f25ea740 1 -- start start 2024-09-19T07:24:55.492 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.489+0000 7f60f25ea740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d0f2f319f0 0x55d0f2f58a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:55.492 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.489+0000 7f60f25ea740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0f2f32310 0x55d0f2f58fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:55.492 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.489+0000 7f60f25ea740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d0f2f410c0 0x55d0f2f3b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:55.492 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.489+0000 7f60f25ea740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f60e81adec0 con 0x55d0f2f32310 2024-09-19T07:24:55.492 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.489+0000 7f60f25ea740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f60e81ab6d0 con 0x55d0f2f410c0 2024-09-19T07:24:55.492 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.489+0000 7f60f25ea740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f60e81a9560 con 0x55d0f2f319f0 2024-09-19T07:24:55.492 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.490+0000 7f60ed5ef640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0f2f32310 0x55d0f2f58fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:55.492 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.490+0000 7f60ed5ef640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0f2f32310 0x55d0f2f58fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56436/0 (socket says 172.21.15.148:56436) 2024-09-19T07:24:55.492 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.490+0000 7f60ed5ef640 1 -- 172.21.15.148:0/4122542292 learned_addr learned my addr 172.21.15.148:0/4122542292 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:24:55.492 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.490+0000 7f60ecdee640 1 --2- 172.21.15.148:0/4122542292 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d0f2f410c0 0x55d0f2f3b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:55.492 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.490+0000 7f60ed5ef640 1 -- 172.21.15.148:0/4122542292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d0f2f319f0 msgr2=0x55d0f2f58a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:55.492 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.490+0000 7f60ed5ef640 1 --2- 172.21.15.148:0/4122542292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d0f2f319f0 0x55d0f2f58a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.493 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.490+0000 7f60ed5ef640 1 -- 172.21.15.148:0/4122542292 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d0f2f410c0 msgr2=0x55d0f2f3b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:55.493 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.490+0000 7f60ed5ef640 1 --2- 172.21.15.148:0/4122542292 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d0f2f410c0 0x55d0f2f3b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.493 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.490+0000 7f60ed5ef640 1 -- 172.21.15.148:0/4122542292 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0f2f3cfb0 con 0x55d0f2f32310 2024-09-19T07:24:55.493 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.490+0000 7f60ecdee640 1 --2- 172.21.15.148:0/4122542292 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d0f2f410c0 0x55d0f2f3b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:24:55.493 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.490+0000 7f60ed5ef640 1 --2- 172.21.15.148:0/4122542292 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0f2f32310 0x55d0f2f58fb0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f60e4004c20 tx=0x7f60e40107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=576b89594c5fe0a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:55.493 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.490+0000 7f60d2ffd640 1 -- 172.21.15.148:0/4122542292 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e4000e60 con 0x55d0f2f32310 2024-09-19T07:24:55.493 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.490+0000 7f60d2ffd640 1 -- 172.21.15.148:0/4122542292 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60e401f020 con 0x55d0f2f32310 2024-09-19T07:24:55.493 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.490+0000 7f60d2ffd640 1 -- 172.21.15.148:0/4122542292 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e40035f0 con 0x55d0f2f32310 2024-09-19T07:24:55.493 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.491+0000 7f60f25ea740 1 -- 172.21.15.148:0/4122542292 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0f2f32310 msgr2=0x55d0f2f58fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:55.493 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.491+0000 7f60f25ea740 1 --2- 172.21.15.148:0/4122542292 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0f2f32310 0x55d0f2f58fb0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f60e4004c20 tx=0x7f60e40107a0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.493 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.491+0000 7f60f25ea740 1 -- 172.21.15.148:0/4122542292 shutdown_connections 2024-09-19T07:24:55.493 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.491+0000 7f60f25ea740 1 --2- 172.21.15.148:0/4122542292 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d0f2f410c0 0x55d0f2f3b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.493 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.491+0000 7f60f25ea740 1 --2- 172.21.15.148:0/4122542292 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0f2f32310 0x55d0f2f58fb0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.493 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.491+0000 7f60f25ea740 1 --2- 172.21.15.148:0/4122542292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d0f2f319f0 0x55d0f2f58a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.494 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.491+0000 7f60f25ea740 1 -- 172.21.15.148:0/4122542292 >> 172.21.15.148:0/4122542292 conn(0x55d0f2f2e060 msgr2=0x55d0f2f400a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:55.494 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.491+0000 7f60f25ea740 1 -- 172.21.15.148:0/4122542292 shutdown_connections 2024-09-19T07:24:55.494 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.491+0000 7f60f25ea740 1 -- 172.21.15.148:0/4122542292 wait complete. 2024-09-19T07:24:55.494 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.491+0000 7f60f25ea740 1 -- start start 2024-09-19T07:24:55.494 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.491+0000 7f60f25ea740 1 Processor -- start 2024-09-19T07:24:55.497 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.492+0000 7f60f25ea740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d0f2f319f0 0x55d0f2f450e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.492+0000 7f60f25ea740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0f2f32310 0x55d0f2f45620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.492+0000 7f60f25ea740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d0f2f410c0 0x55d0f2f45b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.492+0000 7f60f25ea740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f60e81a9bb0 con 0x55d0f2f32310 2024-09-19T07:24:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.492+0000 7f60f25ea740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f60e81ab000 con 0x55d0f2f319f0 2024-09-19T07:24:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.492+0000 7f60f25ea740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f60e81aa260 con 0x55d0f2f410c0 2024-09-19T07:24:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.492+0000 7f60f25ea740 10 client.0 _ll_register_callbacks cb 0x7f60d80097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:24:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.492+0000 7f60ed5ef640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0f2f32310 0x55d0f2f45620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.492+0000 7f60ed5ef640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0f2f32310 0x55d0f2f45620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56440/0 (socket says 172.21.15.148:56440) 2024-09-19T07:24:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.492+0000 7f60ed5ef640 1 -- 172.21.15.148:0/592015764 learned_addr learned my addr 172.21.15.148:0/592015764 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:24:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.492+0000 7f60ecdee640 1 --2- 172.21.15.148:0/592015764 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d0f2f410c0 0x55d0f2f45b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.492+0000 7f60ecdee640 1 --2- 172.21.15.148:0/592015764 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d0f2f319f0 0x55d0f2f450e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:55.499 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.492+0000 7f60ed5ef640 1 -- 172.21.15.148:0/592015764 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d0f2f410c0 msgr2=0x55d0f2f45b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:55.499 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.492+0000 7f60ed5ef640 1 --2- 172.21.15.148:0/592015764 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d0f2f410c0 0x55d0f2f45b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.499 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.492+0000 7f60ed5ef640 1 -- 172.21.15.148:0/592015764 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d0f2f319f0 msgr2=0x55d0f2f450e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:55.499 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.492+0000 7f60ed5ef640 1 --2- 172.21.15.148:0/592015764 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d0f2f319f0 0x55d0f2f450e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.499 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.492+0000 7f60ed5ef640 1 -- 172.21.15.148:0/592015764 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0f2f32140 con 0x55d0f2f32310 2024-09-19T07:24:55.499 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.492+0000 7f60ecdee640 1 --2- 172.21.15.148:0/592015764 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d0f2f410c0 0x55d0f2f45b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:24:55.499 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.492+0000 7f60ed5ef640 1 --2- 172.21.15.148:0/592015764 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0f2f32310 0x55d0f2f45620 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f60e4004c20 tx=0x7f60e4004d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bb8adc904507530 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:55.499 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.492+0000 7f60d0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:24:55.499 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.492+0000 7f60d0ff9640 1 -- 172.21.15.148:0/592015764 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e4000e40 con 0x55d0f2f32310 2024-09-19T07:24:55.499 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.492+0000 7f60d0ff9640 1 -- 172.21.15.148:0/592015764 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8556+0+0 (secure 0 0 0) 0x7f60e4003800 con 0x55d0f2f32310 2024-09-19T07:24:55.499 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.492+0000 7f60f25ea740 1 -- 172.21.15.148:0/592015764 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60e401f020 con 0x55d0f2f32310 2024-09-19T07:24:55.499 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.492+0000 7f60d0ff9640 1 -- 172.21.15.148:0/592015764 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f60e4044050 con 0x55d0f2f32310 2024-09-19T07:24:55.500 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.492+0000 7f60f25ea740 10 client.17439 fetch_fsmap learned FSMap version 49 2024-09-19T07:24:55.500 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.492+0000 7f60f25ea740 1 -- 172.21.15.148:0/592015764 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55d0f2fbbd00 con 0x55d0f2f32310 2024-09-19T07:24:55.500 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.493+0000 7f60d0ff9640 1 -- 172.21.15.148:0/592015764 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60e401f020 con 0x55d0f2f32310 2024-09-19T07:24:55.500 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.493+0000 7f60d0ff9640 1 -- 172.21.15.148:0/592015764 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 49) ==== 8362+0+0 (secure 0 0 0) 0x7f60e4005470 con 0x55d0f2f32310 2024-09-19T07:24:55.500 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.493+0000 7f60f25ea740 10 client.17439 fetch_fsmap finished waiting for FSMap version 49 2024-09-19T07:24:55.500 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.493+0000 7f60f25ea740 10 client.17439 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:24:55.500 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.493+0000 7f60f25ea740 20 client.17439 populate_metadata read hostname 'smithi148' 2024-09-19T07:24:55.500 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.493+0000 7f60f25ea740 1 --2- 172.21.15.148:0/592015764 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55d0f2fbc390 0x55d0f2fbe7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:55.500 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.493+0000 7f60f25ea740 4 client.17439 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:24:55.500 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.493+0000 7f60f25ea740 1 -- 172.21.15.148:0/592015764 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d0f2e9dd70 con 0x55d0f2fbc390 2024-09-19T07:24:55.500 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.493+0000 7f60ecdee640 1 --2- 172.21.15.148:0/592015764 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55d0f2fbc390 0x55d0f2fbe7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:55.500 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.493+0000 7f60d0ff9640 10 client.17439 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:24:55.500 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.493+0000 7f60ecdee640 1 --2- 172.21.15.148:0/592015764 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55d0f2fbc390 0x55d0f2fbe7b0 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ddaab570ee34b987 server_cookie=140653ff86d05c8c in_seq=0 out_seq=0 2024-09-19T07:24:55.505 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.504+0000 7f60d0ff9640 1 -- 172.21.15.148:0/592015764 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d0f2e9dd70 con 0x55d0f2fbc390 2024-09-19T07:24:55.505 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.504+0000 7f60d0ff9640 10 client.17439 handle_command_reply: tid=0 2024-09-19T07:24:55.505 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.504+0000 7f60f25ea740 1 client.17439 shutdown 2024-09-19T07:24:55.505 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.504+0000 7f60f25ea740 1 -- 172.21.15.148:0/592015764 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0f2f32310 msgr2=0x55d0f2f45620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:55.505 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.504+0000 7f60f25ea740 1 --2- 172.21.15.148:0/592015764 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0f2f32310 0x55d0f2f45620 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f60e4004c20 tx=0x7f60e4004d20 comp rx=0 tx=0).stop 2024-09-19T07:24:55.506 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.504+0000 7f60f25ea740 1 -- 172.21.15.148:0/592015764 shutdown_connections 2024-09-19T07:24:55.506 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.504+0000 7f60f25ea740 1 --2- 172.21.15.148:0/592015764 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55d0f2fbc390 0x55d0f2fbe7b0 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.506 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.504+0000 7f60f25ea740 1 --2- 172.21.15.148:0/592015764 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d0f2f410c0 0x55d0f2f45b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.506 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.504+0000 7f60f25ea740 1 --2- 172.21.15.148:0/592015764 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d0f2f32310 0x55d0f2f45620 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.506 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.504+0000 7f60d0ff9640 0 client.17439 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:24:55.506 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.504+0000 7f60f25ea740 1 --2- 172.21.15.148:0/592015764 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d0f2f319f0 0x55d0f2f450e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.506 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.504+0000 7f60f25ea740 1 -- 172.21.15.148:0/592015764 >> 172.21.15.148:0/592015764 conn(0x55d0f2f2e060 msgr2=0x55d0f2f2c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:55.506 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.504+0000 7f60f25ea740 1 -- 172.21.15.148:0/592015764 shutdown_connections 2024-09-19T07:24:55.506 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.504+0000 7f60f25ea740 1 -- 172.21.15.148:0/592015764 wait complete. 2024-09-19T07:24:55.506 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.504+0000 7f60f25ea740 20 client.17439 trim_cache size 0 max 16384 2024-09-19T07:24:55.507 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:24:55.507 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:24:55.507 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:24:55.507 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:24:55.508 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.505+0000 7f60ef853640 1 -- 172.21.15.148:0/530541237 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f60d40a3460 msgr2=0x7f60d40a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:55.508 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.505+0000 7f60ef853640 1 --2- 172.21.15.148:0/530541237 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f60d40a3460 0x7f60d40a5920 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f60e00c5e90 tx=0x7f60e0088140 comp rx=0 tx=0).stop 2024-09-19T07:24:55.508 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.505+0000 7f60ef853640 1 -- 172.21.15.148:0/530541237 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60e8107b80 msgr2=0x7f60e819cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:55.508 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.505+0000 7f60ef853640 1 --2- 172.21.15.148:0/530541237 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60e8107b80 0x7f60e819cba0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f60e0005cc0 tx=0x7f60e0032f40 comp rx=0 tx=0).stop 2024-09-19T07:24:55.508 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.505+0000 7f60ef853640 1 -- 172.21.15.148:0/530541237 shutdown_connections 2024-09-19T07:24:55.508 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.505+0000 7f60ef853640 1 --2- 172.21.15.148:0/530541237 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f60d40a3460 0x7f60d40a5920 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.508 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.505+0000 7f60ef853640 1 --2- 172.21.15.148:0/530541237 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60e8107b80 0x7f60e819cba0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.508 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.505+0000 7f60ef853640 1 --2- 172.21.15.148:0/530541237 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f60e8102480 0x7f60e8198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.508 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.505+0000 7f60ef853640 1 --2- 172.21.15.148:0/530541237 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60e8101ae0 0x7f60e81982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.508 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.505+0000 7f60ef853640 1 -- 172.21.15.148:0/530541237 >> 172.21.15.148:0/530541237 conn(0x7f60e80fd7e0 msgr2=0x7f60e80fde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:55.508 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.505+0000 7f60ef853640 1 -- 172.21.15.148:0/530541237 shutdown_connections 2024-09-19T07:24:55.509 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:24:55.505+0000 7f60ef853640 1 -- 172.21.15.148:0/530541237 wait complete. 2024-09-19T07:24:56.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:24:56 smithi165 ceph-mon[35326]: pgmap v434: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 172 KiB/s wr, 35 op/s 2024-09-19T07:24:57.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:24:56 smithi179 ceph-mon[35716]: pgmap v434: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 172 KiB/s wr, 35 op/s 2024-09-19T07:24:57.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:24:56 smithi148 ceph-mon[31180]: pgmap v434: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 172 KiB/s wr, 35 op/s 2024-09-19T07:24:58.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:24:58 smithi165 ceph-mon[35326]: pgmap v435: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-19T07:24:59.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:24:58 smithi179 ceph-mon[35716]: pgmap v435: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-19T07:24:59.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:24:58 smithi148 ceph-mon[31180]: pgmap v435: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-19T07:24:59.084 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:24:59.347 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:24:59.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:59.862+0000 7f2fd6b24640 1 -- 172.21.15.148:0/2273917254 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2fd0106f70 msgr2=0x7f2fd010eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:59.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:59.862+0000 7f2fd6b24640 1 --2- 172.21.15.148:0/2273917254 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2fd0106f70 0x7f2fd010eab0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f2fc8009ca0 tx=0x7f2fc802a8c0 comp rx=0 tx=0).stop 2024-09-19T07:24:59.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:59.862+0000 7f2fd6b24640 1 -- 172.21.15.148:0/2273917254 shutdown_connections 2024-09-19T07:24:59.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:59.862+0000 7f2fd6b24640 1 --2- 172.21.15.148:0/2273917254 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2fd0106f70 0x7f2fd010eab0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:59.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:59.862+0000 7f2fd6b24640 1 --2- 172.21.15.148:0/2273917254 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2fd0100eb0 0x7f2fd0106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:59.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:59.862+0000 7f2fd6b24640 1 --2- 172.21.15.148:0/2273917254 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2fd0100500 0x7f2fd01008e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:59.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:59.862+0000 7f2fd6b24640 1 -- 172.21.15.148:0/2273917254 >> 172.21.15.148:0/2273917254 conn(0x7f2fd00fc5c0 msgr2=0x7f2fd00fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:59.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:59.862+0000 7f2fd6b24640 1 -- 172.21.15.148:0/2273917254 shutdown_connections 2024-09-19T07:24:59.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:59.862+0000 7f2fd6b24640 1 -- 172.21.15.148:0/2273917254 wait complete. 2024-09-19T07:24:59.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:59.863+0000 7f2fd6b24640 1 Processor -- start 2024-09-19T07:24:59.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:59.863+0000 7f2fd6b24640 1 -- start start 2024-09-19T07:24:59.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:59.863+0000 7f2fd6b24640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2fd0100500 0x7f2fd01984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:59.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:59.863+0000 7f2fd6b24640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2fd0100eb0 0x7f2fd01989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:59.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:59.863+0000 7f2fd6b24640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2fd0106f70 0x7f2fd019cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:59.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:59.863+0000 7f2fd6b24640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd0112010 con 0x7f2fd0106f70 2024-09-19T07:24:59.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:59.863+0000 7f2fd6b24640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd0111e90 con 0x7f2fd0100500 2024-09-19T07:24:59.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:59.863+0000 7f2fd6b24640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd0112190 con 0x7f2fd0100eb0 2024-09-19T07:24:59.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:59.863+0000 7f2fd50c1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2fd0106f70 0x7f2fd019cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:59.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:59.863+0000 7f2fd50c1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2fd0106f70 0x7f2fd019cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56458/0 (socket says 172.21.15.148:56458) 2024-09-19T07:24:59.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:59.863+0000 7f2fd50c1640 1 -- 172.21.15.148:0/1692378694 learned_addr learned my addr 172.21.15.148:0/1692378694 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:24:59.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:59.863+0000 7f2fc7fff640 1 --2- 172.21.15.148:0/1692378694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2fd0100eb0 0x7f2fd01989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:59.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:59.864+0000 7f2fd48c0640 1 --2- 172.21.15.148:0/1692378694 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2fd0100500 0x7f2fd01984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:59.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:59.864+0000 7f2fd50c1640 1 -- 172.21.15.148:0/1692378694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2fd0100eb0 msgr2=0x7f2fd01989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:59.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:59.864+0000 7f2fd50c1640 1 --2- 172.21.15.148:0/1692378694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2fd0100eb0 0x7f2fd01989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:59.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:59.864+0000 7f2fd50c1640 1 -- 172.21.15.148:0/1692378694 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2fd0100500 msgr2=0x7f2fd01984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:59.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:59.864+0000 7f2fd50c1640 1 --2- 172.21.15.148:0/1692378694 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2fd0100500 0x7f2fd01984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:59.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:59.864+0000 7f2fd50c1640 1 -- 172.21.15.148:0/1692378694 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fd019d460 con 0x7f2fd0106f70 2024-09-19T07:24:59.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:59.864+0000 7f2fd50c1640 1 --2- 172.21.15.148:0/1692378694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2fd0106f70 0x7f2fd019cd80 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f2fc8031a60 tx=0x7f2fc8031a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:59.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:59.864+0000 7f2fc5ffb640 1 -- 172.21.15.148:0/1692378694 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc8003c30 con 0x7f2fd0106f70 2024-09-19T07:24:59.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:59.864+0000 7f2fc5ffb640 1 -- 172.21.15.148:0/1692378694 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2fc8003dd0 con 0x7f2fd0106f70 2024-09-19T07:24:59.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:59.864+0000 7f2fd6b24640 1 -- 172.21.15.148:0/1692378694 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fd019d6f0 con 0x7f2fd0106f70 2024-09-19T07:24:59.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:59.864+0000 7f2fc5ffb640 1 -- 172.21.15.148:0/1692378694 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc80047e0 con 0x7f2fd0106f70 2024-09-19T07:24:59.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:59.864+0000 7f2fd6b24640 1 -- 172.21.15.148:0/1692378694 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fd01a5030 con 0x7f2fd0106f70 2024-09-19T07:24:59.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:59.865+0000 7f2fd6b24640 1 -- 172.21.15.148:0/1692378694 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fd01008e0 con 0x7f2fd0106f70 2024-09-19T07:24:59.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:59.866+0000 7f2fc5ffb640 1 -- 172.21.15.148:0/1692378694 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f2fc802f790 con 0x7f2fd0106f70 2024-09-19T07:24:59.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:59.867+0000 7f2fc5ffb640 1 --2- 172.21.15.148:0/1692378694 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f2fb80a33b0 0x7f2fb80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:59.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:59.867+0000 7f2fc5ffb640 1 -- 172.21.15.148:0/1692378694 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8556+0+0 (secure 0 0 0) 0x7f2fc80f1290 con 0x7f2fd0106f70 2024-09-19T07:24:59.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:59.867+0000 7f2fd48c0640 1 --2- 172.21.15.148:0/1692378694 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f2fb80a33b0 0x7f2fb80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:59.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:59.867+0000 7f2fd48c0640 1 --2- 172.21.15.148:0/1692378694 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f2fb80a33b0 0x7f2fb80a5870 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0069fc0 tx=0x7f2fcc008040 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:59.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:24:59.870+0000 7f2fc5ffb640 1 -- 172.21.15.148:0/1692378694 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2fc80bdd60 con 0x7f2fd0106f70 2024-09-19T07:25:00.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:00.070+0000 7f2fd6b24640 1 -- 172.21.15.148:0/1692378694 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2fd0199810 con 0x7f2fd0106f70 2024-09-19T07:25:00.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:00.071+0000 7f2fc5ffb640 1 -- 172.21.15.148:0/1692378694 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+11944 (secure 0 0 0) 0x7f2fc80bd660 con 0x7f2fd0106f70 2024-09-19T07:25:00.072 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:25:00.072 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":49,"btime":"2024-09-19T07:24:53:598124+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/4263868576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":4263868576},{"type":"v1","addr":"172.21.15.148:6841","nonce":4263868576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":25606,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3891676893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3891676893},{"type":"v1","addr":"172.21.15.179:6835","nonce":3891676893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":49,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:09:19.543369+0000","modified":"2024-09-19T07:24:52.659702+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24457,"mds_1":24437,"mds_2":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":75,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":71,"addr":"172.21.15.165:6839/3993490234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":3993490234},{"type":"v1","addr":"172.21.15.165:6839","nonce":3993490234}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25823":{"gid":25823,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6835/380886107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":380886107},{"type":"v1","addr":"172.21.15.165:6835","nonce":380886107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24457,"qdb_cluster":[24457,24437,24436]},"id":1}]} 2024-09-19T07:25:00.072 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 49 2024-09-19T07:25:00.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:00.073+0000 7f2fd6b24640 1 -- 172.21.15.148:0/1692378694 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f2fb80a33b0 msgr2=0x7f2fb80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:00.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:00.073+0000 7f2fd6b24640 1 --2- 172.21.15.148:0/1692378694 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f2fb80a33b0 0x7f2fb80a5870 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0069fc0 tx=0x7f2fcc008040 comp rx=0 tx=0).stop 2024-09-19T07:25:00.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:00.073+0000 7f2fd6b24640 1 -- 172.21.15.148:0/1692378694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2fd0106f70 msgr2=0x7f2fd019cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:00.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:00.073+0000 7f2fd6b24640 1 --2- 172.21.15.148:0/1692378694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2fd0106f70 0x7f2fd019cd80 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f2fc8031a60 tx=0x7f2fc8031a90 comp rx=0 tx=0).stop 2024-09-19T07:25:00.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:00.073+0000 7f2fd6b24640 1 -- 172.21.15.148:0/1692378694 shutdown_connections 2024-09-19T07:25:00.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:00.073+0000 7f2fd6b24640 1 --2- 172.21.15.148:0/1692378694 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f2fb80a33b0 0x7f2fb80a5870 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:00.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:00.073+0000 7f2fd6b24640 1 --2- 172.21.15.148:0/1692378694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2fd0106f70 0x7f2fd019cd80 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:00.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:00.073+0000 7f2fd6b24640 1 --2- 172.21.15.148:0/1692378694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2fd0100eb0 0x7f2fd01989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:00.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:00.073+0000 7f2fd6b24640 1 --2- 172.21.15.148:0/1692378694 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2fd0100500 0x7f2fd01984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:00.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:00.073+0000 7f2fd6b24640 1 -- 172.21.15.148:0/1692378694 >> 172.21.15.148:0/1692378694 conn(0x7f2fd00fc5c0 msgr2=0x7f2fd0105790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:00.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:00.074+0000 7f2fd6b24640 1 -- 172.21.15.148:0/1692378694 shutdown_connections 2024-09-19T07:25:00.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:00.074+0000 7f2fd6b24640 1 -- 172.21.15.148:0/1692378694 wait complete. 2024-09-19T07:25:00.783 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24457 quiesce db --set-id 52b74135 --release --await' 2024-09-19T07:25:00.784 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24457 quiesce db --set-id 52b74135 --release --await 2024-09-19T07:25:00.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:25:00 smithi165 ceph-mon[35326]: pgmap v436: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 23 KiB/s wr, 19 op/s 2024-09-19T07:25:00.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:25:00 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/1692378694' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:25:01.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:25:00 smithi179 ceph-mon[35716]: pgmap v436: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 23 KiB/s wr, 19 op/s 2024-09-19T07:25:01.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:25:00 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/1692378694' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:25:01.040 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:25:01.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:25:00 smithi148 ceph-mon[31180]: pgmap v436: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 23 KiB/s wr, 19 op/s 2024-09-19T07:25:01.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:25:00 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/1692378694' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:25:01.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.563+0000 7f71de0db640 1 -- 172.21.15.148:0/1312993781 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71d8102570 msgr2=0x7f71d81029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:01.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.563+0000 7f71de0db640 1 --2- 172.21.15.148:0/1312993781 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71d8102570 0x7f71d81029b0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f71cc009900 tx=0x7f71cc02a480 comp rx=0 tx=0).stop 2024-09-19T07:25:01.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.563+0000 7f71de0db640 1 -- 172.21.15.148:0/1312993781 shutdown_connections 2024-09-19T07:25:01.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.563+0000 7f71de0db640 1 --2- 172.21.15.148:0/1312993781 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71d8102ef0 0x7f71d810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:01.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.563+0000 7f71de0db640 1 --2- 172.21.15.148:0/1312993781 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71d8102570 0x7f71d81029b0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:01.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.563+0000 7f71de0db640 1 --2- 172.21.15.148:0/1312993781 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f71d8100e20 0x7f71d8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:01.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.563+0000 7f71de0db640 1 -- 172.21.15.148:0/1312993781 >> 172.21.15.148:0/1312993781 conn(0x7f71d80fc7d0 msgr2=0x7f71d80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:01.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.563+0000 7f71de0db640 1 -- 172.21.15.148:0/1312993781 shutdown_connections 2024-09-19T07:25:01.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.563+0000 7f71de0db640 1 -- 172.21.15.148:0/1312993781 wait complete. 2024-09-19T07:25:01.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.563+0000 7f71de0db640 1 Processor -- start 2024-09-19T07:25:01.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.564+0000 7f71de0db640 1 -- start start 2024-09-19T07:25:01.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.564+0000 7f71de0db640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71d8100e20 0x7f71d81984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:01.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.564+0000 7f71de0db640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71d8102570 0x7f71d8198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:01.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.564+0000 7f71de0db640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f71d8102ef0 0x7f71d819cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:01.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.564+0000 7f71de0db640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f71d8110f80 con 0x7f71d8102570 2024-09-19T07:25:01.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.564+0000 7f71de0db640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f71d8110e00 con 0x7f71d8102ef0 2024-09-19T07:25:01.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.564+0000 7f71de0db640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f71d8111100 con 0x7f71d8100e20 2024-09-19T07:25:01.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.564+0000 7f71d6ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71d8102570 0x7f71d8198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:01.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.564+0000 7f71d6ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71d8102570 0x7f71d8198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56470/0 (socket says 172.21.15.148:56470) 2024-09-19T07:25:01.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.564+0000 7f71d6ffd640 1 -- 172.21.15.148:0/1381567815 learned_addr learned my addr 172.21.15.148:0/1381567815 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:25:01.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.564+0000 7f71d77fe640 1 --2- 172.21.15.148:0/1381567815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71d8100e20 0x7f71d81984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:01.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.564+0000 7f71d6ffd640 1 -- 172.21.15.148:0/1381567815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71d8100e20 msgr2=0x7f71d81984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:01.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.564+0000 7f71d6ffd640 1 --2- 172.21.15.148:0/1381567815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71d8100e20 0x7f71d81984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:01.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.564+0000 7f71d6ffd640 1 -- 172.21.15.148:0/1381567815 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f71d8102ef0 msgr2=0x7f71d819cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:01.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.564+0000 7f71d7fff640 1 --2- 172.21.15.148:0/1381567815 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f71d8102ef0 0x7f71d819cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:01.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.564+0000 7f71d6ffd640 1 --2- 172.21.15.148:0/1381567815 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f71d8102ef0 0x7f71d819cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:01.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.564+0000 7f71d6ffd640 1 -- 172.21.15.148:0/1381567815 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71d819d480 con 0x7f71d8102570 2024-09-19T07:25:01.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.564+0000 7f71d6ffd640 1 --2- 172.21.15.148:0/1381567815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71d8102570 0x7f71d8198a10 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f71cc006010 tx=0x7f71cc003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:01.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.565+0000 7f71d4ff9640 1 -- 172.21.15.148:0/1381567815 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71cc03f070 con 0x7f71d8102570 2024-09-19T07:25:01.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.565+0000 7f71d4ff9640 1 -- 172.21.15.148:0/1381567815 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71cc031e30 con 0x7f71d8102570 2024-09-19T07:25:01.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.565+0000 7f71de0db640 1 -- 172.21.15.148:0/1381567815 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71d819d710 con 0x7f71d8102570 2024-09-19T07:25:01.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.565+0000 7f71d4ff9640 1 -- 172.21.15.148:0/1381567815 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71cc035030 con 0x7f71d8102570 2024-09-19T07:25:01.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.565+0000 7f71de0db640 1 -- 172.21.15.148:0/1381567815 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71d81a5050 con 0x7f71d8102570 2024-09-19T07:25:01.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.567+0000 7f71d4ff9640 1 -- 172.21.15.148:0/1381567815 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f71cc042070 con 0x7f71d8102570 2024-09-19T07:25:01.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.567+0000 7f71e04b4740 1 Processor -- start 2024-09-19T07:25:01.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.567+0000 7f71e04b4740 1 -- start start 2024-09-19T07:25:01.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.568+0000 7f71e04b4740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b7cb97f60 0x558b7cb98340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:01.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.568+0000 7f71e04b4740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b7cb98880 0x558b7cba7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:01.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.568+0000 7f71e04b4740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b7cba7650 0x558b7cba9a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:01.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.568+0000 7f71d4ff9640 1 --2- 172.21.15.148:0/1381567815 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f71c00a33b0 0x7f71c00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:01.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.568+0000 7f71e04b4740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x558b7cafd620 con 0x558b7cb97f60 2024-09-19T07:25:01.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.568+0000 7f71e04b4740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x558b7caa4e50 con 0x558b7cba7650 2024-09-19T07:25:01.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.568+0000 7f71e04b4740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x558b7caf95e0 con 0x558b7cb98880 2024-09-19T07:25:01.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.568+0000 7f71d7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b7cb97f60 0x558b7cb98340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:01.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.568+0000 7f71d7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b7cb97f60 0x558b7cb98340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56484/0 (socket says 172.21.15.148:56484) 2024-09-19T07:25:01.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.568+0000 7f71d7fff640 1 -- 172.21.15.148:0/2086213169 learned_addr learned my addr 172.21.15.148:0/2086213169 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:25:01.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.568+0000 7f71d4ff9640 1 -- 172.21.15.148:0/1381567815 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8556+0+0 (secure 0 0 0) 0x7f71cc0f0740 con 0x7f71d8102570 2024-09-19T07:25:01.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.568+0000 7f71d7fff640 1 --2- 172.21.15.148:0/1381567815 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f71c00a33b0 0x7f71c00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:01.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.568+0000 7f71d6ffd640 1 --2- 172.21.15.148:0/2086213169 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b7cba7650 0x558b7cba9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:01.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.568+0000 7f71d77fe640 1 --2- 172.21.15.148:0/2086213169 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b7cb98880 0x558b7cba7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:01.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.568+0000 7f71d7fff640 1 -- 172.21.15.148:0/2086213169 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b7cb98880 msgr2=0x558b7cba7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:01.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.568+0000 7f71d7fff640 1 --2- 172.21.15.148:0/2086213169 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b7cb98880 0x558b7cba7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:01.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.568+0000 7f71d7fff640 1 -- 172.21.15.148:0/2086213169 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b7cba7650 msgr2=0x558b7cba9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:01.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.568+0000 7f71d7fff640 1 --2- 172.21.15.148:0/2086213169 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b7cba7650 0x558b7cba9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:01.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.568+0000 7f71d7fff640 1 -- 172.21.15.148:0/2086213169 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b7ca95d40 con 0x558b7cb97f60 2024-09-19T07:25:01.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.568+0000 7f71d77fe640 1 --2- 172.21.15.148:0/2086213169 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b7cb98880 0x558b7cba7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:25:01.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.568+0000 7f71d7fff640 1 --2- 172.21.15.148:0/2086213169 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b7cb97f60 0x558b7cb98340 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f71d00129d0 tx=0x7f71d0012e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1330512f45831ba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:01.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.568+0000 7f71d7fff640 1 --2- 172.21.15.148:0/1381567815 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f71c00a33b0 0x7f71c00a5870 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f71d000f730 tx=0x7f71d0014000 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:01.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.569+0000 7f71bdffb640 1 -- 172.21.15.148:0/2086213169 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d0020070 con 0x558b7cb97f60 2024-09-19T07:25:01.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.569+0000 7f71bdffb640 1 -- 172.21.15.148:0/2086213169 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71d000fe30 con 0x558b7cb97f60 2024-09-19T07:25:01.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.569+0000 7f71bdffb640 1 -- 172.21.15.148:0/2086213169 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d001cc30 con 0x558b7cb97f60 2024-09-19T07:25:01.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.569+0000 7f71e04b4740 1 -- 172.21.15.148:0/2086213169 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b7cb97f60 msgr2=0x558b7cb98340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:01.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.569+0000 7f71e04b4740 1 --2- 172.21.15.148:0/2086213169 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b7cb97f60 0x558b7cb98340 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f71d00129d0 tx=0x7f71d0012e90 comp rx=0 tx=0).stop 2024-09-19T07:25:01.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.569+0000 7f71e04b4740 1 -- 172.21.15.148:0/2086213169 shutdown_connections 2024-09-19T07:25:01.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.569+0000 7f71e04b4740 1 --2- 172.21.15.148:0/2086213169 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b7cba7650 0x558b7cba9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:01.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.569+0000 7f71e04b4740 1 --2- 172.21.15.148:0/2086213169 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b7cb98880 0x558b7cba7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:01.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.569+0000 7f71e04b4740 1 --2- 172.21.15.148:0/2086213169 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b7cb97f60 0x558b7cb98340 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:01.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.569+0000 7f71e04b4740 1 -- 172.21.15.148:0/2086213169 >> 172.21.15.148:0/2086213169 conn(0x558b7cb945f0 msgr2=0x558b7cb949d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:01.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.569+0000 7f71e04b4740 1 -- 172.21.15.148:0/2086213169 shutdown_connections 2024-09-19T07:25:01.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.569+0000 7f71e04b4740 1 -- 172.21.15.148:0/2086213169 wait complete. 2024-09-19T07:25:01.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.570+0000 7f71e04b4740 1 -- start start 2024-09-19T07:25:01.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.570+0000 7f71e04b4740 1 Processor -- start 2024-09-19T07:25:01.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.570+0000 7f71e04b4740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b7cb97f60 0x558b7cba4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:01.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.570+0000 7f71e04b4740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b7cb98880 0x558b7cba4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:01.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.570+0000 7f71e04b4740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b7cba7650 0x558b7cba5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:01.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.570+0000 7f71e04b4740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x558b7cbaa220 con 0x558b7cb97f60 2024-09-19T07:25:01.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.570+0000 7f71e04b4740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x558b7ca85f10 con 0x558b7cba7650 2024-09-19T07:25:01.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.570+0000 7f71e04b4740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x558b7cbaa3a0 con 0x558b7cb98880 2024-09-19T07:25:01.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.570+0000 7f71e04b4740 10 client.0 _ll_register_callbacks cb 0x558b7caa9db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:25:01.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.570+0000 7f71d77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b7cb97f60 0x558b7cba4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:01.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.570+0000 7f71d77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b7cb97f60 0x558b7cba4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56490/0 (socket says 172.21.15.148:56490) 2024-09-19T07:25:01.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.570+0000 7f71d77fe640 1 -- 172.21.15.148:0/421195365 learned_addr learned my addr 172.21.15.148:0/421195365 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:25:01.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.571+0000 7f71d7fff640 1 --2- 172.21.15.148:0/421195365 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b7cba7650 0x558b7cba5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:01.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.571+0000 7f71d6ffd640 1 --2- 172.21.15.148:0/421195365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b7cb98880 0x558b7cba4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:01.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.571+0000 7f71d77fe640 1 -- 172.21.15.148:0/421195365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b7cb98880 msgr2=0x558b7cba4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:01.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.571+0000 7f71d77fe640 1 --2- 172.21.15.148:0/421195365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b7cb98880 0x558b7cba4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:01.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.571+0000 7f71d77fe640 1 -- 172.21.15.148:0/421195365 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b7cba7650 msgr2=0x558b7cba5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:01.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.571+0000 7f71d77fe640 1 --2- 172.21.15.148:0/421195365 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b7cba7650 0x558b7cba5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:01.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.571+0000 7f71d77fe640 1 -- 172.21.15.148:0/421195365 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b7c80c580 con 0x558b7cb97f60 2024-09-19T07:25:01.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.571+0000 7f71d7fff640 1 --2- 172.21.15.148:0/421195365 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b7cba7650 0x558b7cba5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:25:01.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.571+0000 7f71d77fe640 1 --2- 172.21.15.148:0/421195365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b7cb97f60 0x558b7cba4600 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f71c80116c0 tx=0x7f71c8011b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b411206fd08f7645 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:01.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.571+0000 7f71b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:25:01.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.571+0000 7f71b6ffd640 1 -- 172.21.15.148:0/421195365 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c800fb40 con 0x558b7cb97f60 2024-09-19T07:25:01.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.571+0000 7f71b6ffd640 1 -- 172.21.15.148:0/421195365 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8556+0+0 (secure 0 0 0) 0x7f71c800fce0 con 0x558b7cb97f60 2024-09-19T07:25:01.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.571+0000 7f71e04b4740 1 -- 172.21.15.148:0/421195365 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71d000fe30 con 0x558b7cb97f60 2024-09-19T07:25:01.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.571+0000 7f71b6ffd640 1 -- 172.21.15.148:0/421195365 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f71c801d480 con 0x558b7cb97f60 2024-09-19T07:25:01.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.571+0000 7f71e04b4740 10 client.17457 fetch_fsmap learned FSMap version 49 2024-09-19T07:25:01.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.571+0000 7f71e04b4740 1 -- 172.21.15.148:0/421195365 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x558b7c8d6960 con 0x558b7cb97f60 2024-09-19T07:25:01.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.571+0000 7f71b6ffd640 1 -- 172.21.15.148:0/421195365 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71d000fe30 con 0x558b7cb97f60 2024-09-19T07:25:01.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.571+0000 7f71b6ffd640 1 -- 172.21.15.148:0/421195365 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 49) ==== 8362+0+0 (secure 0 0 0) 0x7f71c80127e0 con 0x558b7cb97f60 2024-09-19T07:25:01.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.572+0000 7f71e04b4740 10 client.17457 fetch_fsmap finished waiting for FSMap version 49 2024-09-19T07:25:01.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.572+0000 7f71e04b4740 10 client.17457 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:25:01.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.572+0000 7f71e04b4740 20 client.17457 populate_metadata read hostname 'smithi148' 2024-09-19T07:25:01.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.572+0000 7f71e04b4740 1 --2- 172.21.15.148:0/421195365 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x558b7cbb7370 0x558b7cbb97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:01.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.572+0000 7f71e04b4740 4 client.17457 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:25:01.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.572+0000 7f71e04b4740 1 -- 172.21.15.148:0/421195365 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558b7cb0ab90 con 0x558b7cbb7370 2024-09-19T07:25:01.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.572+0000 7f71d6ffd640 1 --2- 172.21.15.148:0/421195365 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x558b7cbb7370 0x558b7cbb97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:01.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.572+0000 7f71b6ffd640 10 client.17457 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:25:01.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.572+0000 7f71d6ffd640 1 --2- 172.21.15.148:0/421195365 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x558b7cbb7370 0x558b7cbb97a0 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14bb31e148a3269a server_cookie=14eeaf15b097357c in_seq=0 out_seq=0 2024-09-19T07:25:01.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.573+0000 7f71b6ffd640 1 -- 172.21.15.148:0/421195365 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558b7cb0ab90 con 0x558b7cbb7370 2024-09-19T07:25:01.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.573+0000 7f71b6ffd640 10 client.17457 handle_command_reply: tid=0 2024-09-19T07:25:01.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.573+0000 7f71e04b4740 1 client.17457 shutdown 2024-09-19T07:25:01.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.573+0000 7f71e04b4740 1 -- 172.21.15.148:0/421195365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b7cb97f60 msgr2=0x558b7cba4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:01.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.573+0000 7f71e04b4740 1 --2- 172.21.15.148:0/421195365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b7cb97f60 0x558b7cba4600 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f71c80116c0 tx=0x7f71c8011b80 comp rx=0 tx=0).stop 2024-09-19T07:25:01.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.573+0000 7f71e04b4740 1 -- 172.21.15.148:0/421195365 shutdown_connections 2024-09-19T07:25:01.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.573+0000 7f71e04b4740 1 --2- 172.21.15.148:0/421195365 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x558b7cbb7370 0x558b7cbb97a0 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:01.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.573+0000 7f71e04b4740 1 --2- 172.21.15.148:0/421195365 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b7cba7650 0x558b7cba5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:01.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.573+0000 7f71e04b4740 1 --2- 172.21.15.148:0/421195365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b7cb98880 0x558b7cba4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:01.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.573+0000 7f71e04b4740 1 --2- 172.21.15.148:0/421195365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b7cb97f60 0x558b7cba4600 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:01.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.573+0000 7f71b6ffd640 0 client.17457 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:25:01.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.573+0000 7f71e04b4740 1 -- 172.21.15.148:0/421195365 >> 172.21.15.148:0/421195365 conn(0x558b7cb945f0 msgr2=0x558b7cb9a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:01.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.573+0000 7f71e04b4740 1 -- 172.21.15.148:0/421195365 shutdown_connections 2024-09-19T07:25:01.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.573+0000 7f71e04b4740 1 -- 172.21.15.148:0/421195365 wait complete. 2024-09-19T07:25:01.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.573+0000 7f71e04b4740 20 client.17457 trim_cache size 0 max 16384 2024-09-19T07:25:01.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.590+0000 7f71e04b4740 1 Processor -- start 2024-09-19T07:25:01.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.590+0000 7f71e04b4740 1 -- start start 2024-09-19T07:25:01.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.590+0000 7f71e04b4740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b7cb97f60 0x558b7cbbf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:01.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.590+0000 7f71e04b4740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b7cb98880 0x558b7cbbf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:01.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.590+0000 7f71e04b4740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b7cba7650 0x558b7cbaf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:01.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.590+0000 7f71e04b4740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f71d81adf90 con 0x558b7cb97f60 2024-09-19T07:25:01.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.590+0000 7f71e04b4740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f71d81ab7a0 con 0x558b7cba7650 2024-09-19T07:25:01.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.590+0000 7f71e04b4740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f71d81a9610 con 0x558b7cb98880 2024-09-19T07:25:01.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.590+0000 7f71d77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b7cb97f60 0x558b7cbbf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:01.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.590+0000 7f71d77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b7cb97f60 0x558b7cbbf070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56496/0 (socket says 172.21.15.148:56496) 2024-09-19T07:25:01.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.590+0000 7f71d77fe640 1 -- 172.21.15.148:0/1454773554 learned_addr learned my addr 172.21.15.148:0/1454773554 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:25:01.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.590+0000 7f71d77fe640 1 -- 172.21.15.148:0/1454773554 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b7cb98880 msgr2=0x558b7cbbf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:01.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.590+0000 7f71d77fe640 1 --2- 172.21.15.148:0/1454773554 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b7cb98880 0x558b7cbbf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:01.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.590+0000 7f71d77fe640 1 -- 172.21.15.148:0/1454773554 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b7cba7650 msgr2=0x558b7cbaf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:01.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.590+0000 7f71d77fe640 1 --2- 172.21.15.148:0/1454773554 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b7cba7650 0x558b7cbaf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:01.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.590+0000 7f71d77fe640 1 -- 172.21.15.148:0/1454773554 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b7cba35b0 con 0x558b7cb97f60 2024-09-19T07:25:01.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.591+0000 7f71d77fe640 1 --2- 172.21.15.148:0/1454773554 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b7cb97f60 0x558b7cbbf070 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f71c8005c40 tx=0x7f71c800af20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d29864aadba98d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:01.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.591+0000 7f71bd7fa640 1 -- 172.21.15.148:0/1454773554 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c802a040 con 0x558b7cb97f60 2024-09-19T07:25:01.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.591+0000 7f71bd7fa640 1 -- 172.21.15.148:0/1454773554 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71c800a7c0 con 0x558b7cb97f60 2024-09-19T07:25:01.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.591+0000 7f71bd7fa640 1 -- 172.21.15.148:0/1454773554 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c8012950 con 0x558b7cb97f60 2024-09-19T07:25:01.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.591+0000 7f71e04b4740 1 -- 172.21.15.148:0/1454773554 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b7cb97f60 msgr2=0x558b7cbbf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:01.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.591+0000 7f71e04b4740 1 --2- 172.21.15.148:0/1454773554 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b7cb97f60 0x558b7cbbf070 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f71c8005c40 tx=0x7f71c800af20 comp rx=0 tx=0).stop 2024-09-19T07:25:01.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.591+0000 7f71e04b4740 1 -- 172.21.15.148:0/1454773554 shutdown_connections 2024-09-19T07:25:01.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.591+0000 7f71e04b4740 1 --2- 172.21.15.148:0/1454773554 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b7cba7650 0x558b7cbaf620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:01.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.591+0000 7f71e04b4740 1 --2- 172.21.15.148:0/1454773554 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b7cb98880 0x558b7cbbf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:01.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.591+0000 7f71e04b4740 1 --2- 172.21.15.148:0/1454773554 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b7cb97f60 0x558b7cbbf070 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:01.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.591+0000 7f71e04b4740 1 -- 172.21.15.148:0/1454773554 >> 172.21.15.148:0/1454773554 conn(0x558b7cb945f0 msgr2=0x558b7cba45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:01.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.591+0000 7f71e04b4740 1 -- 172.21.15.148:0/1454773554 shutdown_connections 2024-09-19T07:25:01.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.591+0000 7f71e04b4740 1 -- 172.21.15.148:0/1454773554 wait complete. 2024-09-19T07:25:01.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.592+0000 7f71e04b4740 1 -- start start 2024-09-19T07:25:01.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.592+0000 7f71e04b4740 1 Processor -- start 2024-09-19T07:25:01.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.592+0000 7f71e04b4740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b7cb97f60 0x558b7cbac5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:01.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.592+0000 7f71e04b4740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b7cb98880 0x558b7cbacae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:01.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.592+0000 7f71e04b4740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b7cba7650 0x558b7cbad020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:01.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.592+0000 7f71e04b4740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f71d81a9c60 con 0x558b7cb97f60 2024-09-19T07:25:01.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.592+0000 7f71e04b4740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f71d81ab0d0 con 0x558b7cb98880 2024-09-19T07:25:01.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.592+0000 7f71e04b4740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f71d81aa330 con 0x558b7cba7650 2024-09-19T07:25:01.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.592+0000 7f71e04b4740 10 client.0 _ll_register_callbacks cb 0x7f71c800ae70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:25:01.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.592+0000 7f71d77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b7cb97f60 0x558b7cbac5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:01.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.592+0000 7f71d77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b7cb97f60 0x558b7cbac5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56512/0 (socket says 172.21.15.148:56512) 2024-09-19T07:25:01.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.592+0000 7f71d77fe640 1 -- 172.21.15.148:0/3081489463 learned_addr learned my addr 172.21.15.148:0/3081489463 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:25:01.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.593+0000 7f71d77fe640 1 -- 172.21.15.148:0/3081489463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b7cba7650 msgr2=0x558b7cbad020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:01.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.593+0000 7f71d77fe640 1 --2- 172.21.15.148:0/3081489463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b7cba7650 0x558b7cbad020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:01.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.593+0000 7f71d77fe640 1 -- 172.21.15.148:0/3081489463 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b7cb98880 msgr2=0x558b7cbacae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:01.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.593+0000 7f71d77fe640 1 --2- 172.21.15.148:0/3081489463 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b7cb98880 0x558b7cbacae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:01.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.593+0000 7f71d77fe640 1 -- 172.21.15.148:0/3081489463 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b7cc222a0 con 0x558b7cb97f60 2024-09-19T07:25:01.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.593+0000 7f71d77fe640 1 --2- 172.21.15.148:0/3081489463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b7cb97f60 0x558b7cbac5a0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f71c8005fe0 tx=0x7f71c800f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=650b8f2f1f9e207a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:01.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.593+0000 7f71b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:25:01.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.593+0000 7f71b6ffd640 1 -- 172.21.15.148:0/3081489463 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c803b020 con 0x558b7cb97f60 2024-09-19T07:25:01.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.593+0000 7f71b6ffd640 1 -- 172.21.15.148:0/3081489463 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8556+0+0 (secure 0 0 0) 0x7f71c8012690 con 0x558b7cb97f60 2024-09-19T07:25:01.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.593+0000 7f71e04b4740 1 -- 172.21.15.148:0/3081489463 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71c800a7c0 con 0x558b7cb97f60 2024-09-19T07:25:01.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.593+0000 7f71b6ffd640 1 -- 172.21.15.148:0/3081489463 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f71c8046050 con 0x558b7cb97f60 2024-09-19T07:25:01.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.593+0000 7f71e04b4740 10 client.17463 fetch_fsmap learned FSMap version 49 2024-09-19T07:25:01.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.593+0000 7f71e04b4740 1 -- 172.21.15.148:0/3081489463 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x558b7cc235c0 con 0x558b7cb97f60 2024-09-19T07:25:01.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.593+0000 7f71b6ffd640 1 -- 172.21.15.148:0/3081489463 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71c800a7c0 con 0x558b7cb97f60 2024-09-19T07:25:01.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.593+0000 7f71b6ffd640 1 -- 172.21.15.148:0/3081489463 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 49) ==== 8362+0+0 (secure 0 0 0) 0x7f71c8004400 con 0x558b7cb97f60 2024-09-19T07:25:01.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.593+0000 7f71e04b4740 10 client.17463 fetch_fsmap finished waiting for FSMap version 49 2024-09-19T07:25:01.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.593+0000 7f71e04b4740 10 client.17463 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:25:01.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.593+0000 7f71e04b4740 20 client.17463 populate_metadata read hostname 'smithi148' 2024-09-19T07:25:01.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.593+0000 7f71e04b4740 1 --2- 172.21.15.148:0/3081489463 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x558b7cc23ba0 0x558b7cc26020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:01.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.593+0000 7f71e04b4740 4 client.17463 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "52b74135", "release": true, "await": true}] 2024-09-19T07:25:01.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.593+0000 7f71e04b4740 1 -- 172.21.15.148:0/3081489463 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "quiesce db", "set_id": "52b74135", "release": true, "await": true}) -- 0x558b7cb050a0 con 0x558b7cc23ba0 2024-09-19T07:25:01.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.594+0000 7f71d6ffd640 1 --2- 172.21.15.148:0/3081489463 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x558b7cc23ba0 0x558b7cc26020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:01.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.594+0000 7f71d6ffd640 1 --2- 172.21.15.148:0/3081489463 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x558b7cc23ba0 0x558b7cc26020 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1069459b1d0cc24a server_cookie=44dc14e3864fc17e in_seq=0 out_seq=0 2024-09-19T07:25:01.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:01.594+0000 7f71b6ffd640 10 client.17463 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:25:02.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:02.632+0000 7f71b6ffd640 1 -- 172.21.15.148:0/3081489463 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x558b7cb050a0 con 0x558b7cc23ba0 2024-09-19T07:25:02.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:02.632+0000 7f71b6ffd640 10 client.17463 handle_command_reply: tid=0 2024-09-19T07:25:02.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:02.632+0000 7f71e04b4740 1 client.17463 shutdown 2024-09-19T07:25:02.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:02.632+0000 7f71e04b4740 1 -- 172.21.15.148:0/3081489463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b7cb97f60 msgr2=0x558b7cbac5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:02.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:02.632+0000 7f71e04b4740 1 --2- 172.21.15.148:0/3081489463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b7cb97f60 0x558b7cbac5a0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f71c8005fe0 tx=0x7f71c800f840 comp rx=0 tx=0).stop 2024-09-19T07:25:02.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:02.632+0000 7f71e04b4740 1 -- 172.21.15.148:0/3081489463 shutdown_connections 2024-09-19T07:25:02.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:02.632+0000 7f71e04b4740 1 --2- 172.21.15.148:0/3081489463 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x558b7cc23ba0 0x558b7cc26020 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:02.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:02.632+0000 7f71e04b4740 1 --2- 172.21.15.148:0/3081489463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558b7cba7650 0x558b7cbad020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:02.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:02.632+0000 7f71e04b4740 1 --2- 172.21.15.148:0/3081489463 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b7cb98880 0x558b7cbacae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:02.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:02.632+0000 7f71b6ffd640 0 client.17463 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:25:02.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:02.632+0000 7f71e04b4740 1 --2- 172.21.15.148:0/3081489463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558b7cb97f60 0x558b7cbac5a0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:02.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:02.632+0000 7f71e04b4740 1 -- 172.21.15.148:0/3081489463 >> 172.21.15.148:0/3081489463 conn(0x558b7cb945f0 msgr2=0x558b7cb99a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:02.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:02.633+0000 7f71e04b4740 1 -- 172.21.15.148:0/3081489463 shutdown_connections 2024-09-19T07:25:02.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:02.633+0000 7f71e04b4740 1 -- 172.21.15.148:0/3081489463 wait complete. 2024-09-19T07:25:02.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:02.633+0000 7f71e04b4740 20 client.17463 trim_cache size 0 max 16384 2024-09-19T07:25:02.636 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:25:02.636 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 50, 2024-09-19T07:25:02.636 INFO:teuthology.orchestra.run.smithi148.stdout: "leader": 24457, 2024-09-19T07:25:02.636 INFO:teuthology.orchestra.run.smithi148.stdout: "set_version": 48, 2024-09-19T07:25:02.636 INFO:teuthology.orchestra.run.smithi148.stdout: "sets": { 2024-09-19T07:25:02.636 INFO:teuthology.orchestra.run.smithi148.stdout: "52b74135": { 2024-09-19T07:25:02.636 INFO:teuthology.orchestra.run.smithi148.stdout: "version": 48, 2024-09-19T07:25:02.636 INFO:teuthology.orchestra.run.smithi148.stdout: "age_ref": 0.0, 2024-09-19T07:25:02.636 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:25:02.636 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RELEASED", 2024-09-19T07:25:02.636 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:25:02.637 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:25:02.637 INFO:teuthology.orchestra.run.smithi148.stdout: "timeout": 90.0, 2024-09-19T07:25:02.637 INFO:teuthology.orchestra.run.smithi148.stdout: "expiration": 142.2, 2024-09-19T07:25:02.637 INFO:teuthology.orchestra.run.smithi148.stdout: "members": { 2024-09-19T07:25:02.637 INFO:teuthology.orchestra.run.smithi148.stdout: "file:/": { 2024-09-19T07:25:02.637 INFO:teuthology.orchestra.run.smithi148.stdout: "excluded": false, 2024-09-19T07:25:02.637 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:25:02.637 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RELEASED", 2024-09-19T07:25:02.637 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:25:02.637 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:25:02.637 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:25:02.637 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:25:02.637 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:25:02.638 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:25:02.638 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:25:02.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:02.633+0000 7f71de0db640 1 -- 172.21.15.148:0/1381567815 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f71c00a33b0 msgr2=0x7f71c00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:02.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:02.633+0000 7f71de0db640 1 --2- 172.21.15.148:0/1381567815 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f71c00a33b0 0x7f71c00a5870 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f71d000f730 tx=0x7f71d0014000 comp rx=0 tx=0).stop 2024-09-19T07:25:02.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:02.633+0000 7f71de0db640 1 -- 172.21.15.148:0/1381567815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71d8102570 msgr2=0x7f71d8198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:02.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:02.633+0000 7f71de0db640 1 --2- 172.21.15.148:0/1381567815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71d8102570 0x7f71d8198a10 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f71cc006010 tx=0x7f71cc003c80 comp rx=0 tx=0).stop 2024-09-19T07:25:02.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:02.633+0000 7f71de0db640 1 -- 172.21.15.148:0/1381567815 shutdown_connections 2024-09-19T07:25:02.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:02.633+0000 7f71de0db640 1 --2- 172.21.15.148:0/1381567815 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f71c00a33b0 0x7f71c00a5870 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:02.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:02.633+0000 7f71de0db640 1 --2- 172.21.15.148:0/1381567815 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f71d8102ef0 0x7f71d819cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:02.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:02.633+0000 7f71de0db640 1 --2- 172.21.15.148:0/1381567815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71d8102570 0x7f71d8198a10 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:02.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:02.633+0000 7f71de0db640 1 --2- 172.21.15.148:0/1381567815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71d8100e20 0x7f71d81984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:02.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:02.633+0000 7f71de0db640 1 -- 172.21.15.148:0/1381567815 >> 172.21.15.148:0/1381567815 conn(0x7f71d80fc7d0 msgr2=0x7f71d806a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:02.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:02.634+0000 7f71de0db640 1 -- 172.21.15.148:0/1381567815 shutdown_connections 2024-09-19T07:25:02.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:25:02.634+0000 7f71de0db640 1 -- 172.21.15.148:0/1381567815 wait complete. 2024-09-19T07:25:02.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:25:02 smithi165 ceph-mon[35326]: pgmap v437: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 21 op/s 2024-09-19T07:25:02.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:25:02 smithi165 ceph-mon[35326]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:25:02.986 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:25:02 smithi148 ceph-mon[31180]: pgmap v437: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 21 op/s 2024-09-19T07:25:02.986 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:25:02 smithi148 ceph-mon[31180]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:25:03.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:25:02 smithi179 ceph-mon[35716]: pgmap v437: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 21 op/s 2024-09-19T07:25:03.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:25:02 smithi179 ceph-mon[35716]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:25:03.306 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '52b74135', total seconds elapsed: 26.5 2024-09-19T07:25:04.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:25:04 smithi165 ceph-mon[35326]: pgmap v438: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 10 KiB/s wr, 11 op/s 2024-09-19T07:25:05.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:25:04 smithi179 ceph-mon[35716]: pgmap v438: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 10 KiB/s wr, 11 op/s 2024-09-19T07:25:05.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:25:04 smithi148 ceph-mon[31180]: pgmap v438: 97 pgs: 97 active+clean; 1.7 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 10 KiB/s wr, 11 op/s 2024-09-19T07:25:06.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:25:06 smithi165 ceph-mon[35326]: pgmap v439: 97 pgs: 97 active+clean; 1.7 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 736 KiB/s wr, 74 op/s 2024-09-19T07:25:07.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:25:06 smithi179 ceph-mon[35716]: pgmap v439: 97 pgs: 97 active+clean; 1.7 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 736 KiB/s wr, 74 op/s 2024-09-19T07:25:07.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:25:06 smithi148 ceph-mon[31180]: pgmap v439: 97 pgs: 97 active+clean; 1.7 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 736 KiB/s wr, 74 op/s 2024-09-19T07:25:08.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:25:07 smithi179 ceph-mon[35716]: osdmap e97: 12 total, 12 up, 12 in 2024-09-19T07:25:08.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:25:07 smithi148 ceph-mon[31180]: osdmap e97: 12 total, 12 up, 12 in 2024-09-19T07:25:08.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:25:07 smithi165 ceph-mon[35326]: osdmap e97: 12 total, 12 up, 12 in 2024-09-19T07:25:08.626 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.625+0000 7f52e359e640 1 -- 172.21.15.148:0/863567849 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52e4105b80 msgr2=0x7f52e410d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:08.626 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.625+0000 7f52e359e640 1 --2- 172.21.15.148:0/863567849 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52e4105b80 0x7f52e410d6d0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f52dc009ca0 tx=0x7f52dc02a8c0 comp rx=0 tx=0).stop 2024-09-19T07:25:08.626 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.625+0000 7f52e359e640 1 -- 172.21.15.148:0/863567849 shutdown_connections 2024-09-19T07:25:08.626 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.625+0000 7f52e359e640 1 --2- 172.21.15.148:0/863567849 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52e4105b80 0x7f52e410d6d0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:08.626 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.625+0000 7f52e359e640 1 --2- 172.21.15.148:0/863567849 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f52e4101e80 0x7f52e4105420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:08.626 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.625+0000 7f52e359e640 1 --2- 172.21.15.148:0/863567849 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52e41014d0 0x7f52e41018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:08.626 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.625+0000 7f52e359e640 1 -- 172.21.15.148:0/863567849 >> 172.21.15.148:0/863567849 conn(0x7f52e4077200 msgr2=0x7f52e4077610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:08.626 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.625+0000 7f52e359e640 1 -- 172.21.15.148:0/863567849 shutdown_connections 2024-09-19T07:25:08.626 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.625+0000 7f52e359e640 1 -- 172.21.15.148:0/863567849 wait complete. 2024-09-19T07:25:08.629 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.626+0000 7f52e359e640 1 Processor -- start 2024-09-19T07:25:08.629 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.627+0000 7f52e359e640 1 -- start start 2024-09-19T07:25:08.629 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.627+0000 7f52e359e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52e41014d0 0x7f52e41981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:08.629 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.627+0000 7f52e359e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52e4105b80 0x7f52e4198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:08.629 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.627+0000 7f52e259c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52e41014d0 0x7f52e41981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:08.629 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.627+0000 7f52e259c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52e41014d0 0x7f52e41981f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45720/0 (socket says 172.21.15.148:45720) 2024-09-19T07:25:08.629 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.627+0000 7f52e259c640 1 -- 172.21.15.148:0/579189567 learned_addr learned my addr 172.21.15.148:0/579189567 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:25:08.629 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.627+0000 7f52e359e640 1 --2- 172.21.15.148:0/579189567 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f52e419cab0 0x7f52e419cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:08.629 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.627+0000 7f52e359e640 1 -- 172.21.15.148:0/579189567 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f52e4110c30 con 0x7f52e41014d0 2024-09-19T07:25:08.629 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.627+0000 7f52e359e640 1 -- 172.21.15.148:0/579189567 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f52e4110ab0 con 0x7f52e419cab0 2024-09-19T07:25:08.629 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.627+0000 7f52d9d9b640 1 --2- 172.21.15.148:0/579189567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52e4105b80 0x7f52e4198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:08.629 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.628+0000 7f52e359e640 1 -- 172.21.15.148:0/579189567 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f52e4110db0 con 0x7f52e4105b80 2024-09-19T07:25:08.630 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.628+0000 7f52e2d9d640 1 --2- 172.21.15.148:0/579189567 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f52e419cab0 0x7f52e419cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:08.630 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.628+0000 7f52e259c640 1 -- 172.21.15.148:0/579189567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52e4105b80 msgr2=0x7f52e4198730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:08.630 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.628+0000 7f52e259c640 1 --2- 172.21.15.148:0/579189567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52e4105b80 0x7f52e4198730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:08.630 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.628+0000 7f52e259c640 1 -- 172.21.15.148:0/579189567 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f52e419cab0 msgr2=0x7f52e419cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:08.630 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.628+0000 7f52e259c640 1 --2- 172.21.15.148:0/579189567 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f52e419cab0 0x7f52e419cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:08.630 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.628+0000 7f52e259c640 1 -- 172.21.15.148:0/579189567 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52e419d5a0 con 0x7f52e41014d0 2024-09-19T07:25:08.630 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.628+0000 7f52e259c640 1 --2- 172.21.15.148:0/579189567 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52e41014d0 0x7f52e41981f0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f52d400e9f0 tx=0x7f52d400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:08.631 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.629+0000 7f52dbfff640 1 -- 172.21.15.148:0/579189567 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d400cd80 con 0x7f52e41014d0 2024-09-19T07:25:08.631 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.629+0000 7f52dbfff640 1 -- 172.21.15.148:0/579189567 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52d4005500 con 0x7f52e41014d0 2024-09-19T07:25:08.631 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.629+0000 7f52dbfff640 1 -- 172.21.15.148:0/579189567 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d4010690 con 0x7f52e41014d0 2024-09-19T07:25:08.631 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.629+0000 7f52e359e640 1 -- 172.21.15.148:0/579189567 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52e419d890 con 0x7f52e41014d0 2024-09-19T07:25:08.631 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.629+0000 7f52e359e640 1 -- 172.21.15.148:0/579189567 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52e41a5030 con 0x7f52e41014d0 2024-09-19T07:25:08.632 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.632+0000 7f52dbfff640 1 -- 172.21.15.148:0/579189567 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f52d40046c0 con 0x7f52e41014d0 2024-09-19T07:25:08.632 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.632+0000 7f52eb678740 1 Processor -- start 2024-09-19T07:25:08.633 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.633+0000 7f52eb678740 1 -- start start 2024-09-19T07:25:08.633 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.633+0000 7f52eb678740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5567e54a7e90 0x5567e54a8270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:08.633 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.633+0000 7f52eb678740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5567e54a3830 0x5567e54a3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:08.635 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.633+0000 7f52eb678740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567e54a41d0 0x5567e54afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:08.635 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.633+0000 7f52eb678740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5567e53fe2f0 con 0x5567e54a7e90 2024-09-19T07:25:08.635 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.633+0000 7f52eb678740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5567e53a6270 con 0x5567e54a3830 2024-09-19T07:25:08.635 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.633+0000 7f52eb678740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5567e53fa2b0 con 0x5567e54a41d0 2024-09-19T07:25:08.635 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.633+0000 7f52e2d9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5567e54a7e90 0x5567e54a8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:08.635 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.633+0000 7f52e2d9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5567e54a7e90 0x5567e54a8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45722/0 (socket says 172.21.15.148:45722) 2024-09-19T07:25:08.635 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.633+0000 7f52e2d9d640 1 -- 172.21.15.148:0/2393763127 learned_addr learned my addr 172.21.15.148:0/2393763127 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:25:08.635 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.633+0000 7f52d9d9b640 1 --2- 172.21.15.148:0/2393763127 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567e54a41d0 0x5567e54afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:08.635 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.633+0000 7f52e259c640 1 --2- 172.21.15.148:0/2393763127 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5567e54a3830 0x5567e54a3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:08.635 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.634+0000 7f52d9d9b640 1 -- 172.21.15.148:0/2393763127 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5567e54a3830 msgr2=0x5567e54a3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:08.635 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.634+0000 7f52dbfff640 1 --2- 172.21.15.148:0/579189567 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f52d00a3580 0x7f52d00a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:08.635 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.634+0000 7f52d9d9b640 1 --2- 172.21.15.148:0/2393763127 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5567e54a3830 0x5567e54a3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:08.636 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.634+0000 7f52d9d9b640 1 -- 172.21.15.148:0/2393763127 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5567e54a7e90 msgr2=0x5567e54a8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:08.636 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.634+0000 7f52d9d9b640 1 --2- 172.21.15.148:0/2393763127 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5567e54a7e90 0x5567e54a8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:08.636 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.634+0000 7f52d9d9b640 1 -- 172.21.15.148:0/2393763127 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567e53a5340 con 0x5567e54a41d0 2024-09-19T07:25:08.636 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.634+0000 7f52e2d9d640 1 --2- 172.21.15.148:0/2393763127 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5567e54a7e90 0x5567e54a8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:25:08.636 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.634+0000 7f52e259c640 1 --2- 172.21.15.148:0/2393763127 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5567e54a3830 0x5567e54a3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:25:08.636 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.634+0000 7f52e2d9d640 1 --2- 172.21.15.148:0/579189567 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f52d00a3580 0x7f52d00a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:08.636 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.634+0000 7f52dbfff640 1 -- 172.21.15.148:0/579189567 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8600+0+0 (secure 0 0 0) 0x7f52d40d0100 con 0x7f52e41014d0 2024-09-19T07:25:08.636 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.634+0000 7f52d9d9b640 1 --2- 172.21.15.148:0/2393763127 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567e54a41d0 0x5567e54afb90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f52cc005d00 tx=0x7f52cc0107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa3062a7947c0daf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:08.636 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.634+0000 7f52d8d99640 1 -- 172.21.15.148:0/2393763127 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52cc01c480 con 0x5567e54a41d0 2024-09-19T07:25:08.636 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.634+0000 7f52d8d99640 1 -- 172.21.15.148:0/2393763127 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52cc011920 con 0x5567e54a41d0 2024-09-19T07:25:08.636 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.635+0000 7f52e2d9d640 1 --2- 172.21.15.148:0/579189567 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f52d00a3580 0x7f52d00a5a40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f52dc009430 tx=0x7f52dc0095c0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:08.636 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.634+0000 7f52d8d99640 1 -- 172.21.15.148:0/2393763127 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52cc01a820 con 0x5567e54a41d0 2024-09-19T07:25:08.639 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.635+0000 7f52eb678740 1 -- 172.21.15.148:0/2393763127 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567e54a41d0 msgr2=0x5567e54afb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:08.640 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.635+0000 7f52eb678740 1 --2- 172.21.15.148:0/2393763127 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567e54a41d0 0x5567e54afb90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f52cc005d00 tx=0x7f52cc0107a0 comp rx=0 tx=0).stop 2024-09-19T07:25:08.640 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.635+0000 7f52eb678740 1 -- 172.21.15.148:0/2393763127 shutdown_connections 2024-09-19T07:25:08.640 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.635+0000 7f52eb678740 1 --2- 172.21.15.148:0/2393763127 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567e54a41d0 0x5567e54afb90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:08.640 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.635+0000 7f52eb678740 1 --2- 172.21.15.148:0/2393763127 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5567e54a3830 0x5567e54a3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:08.640 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.635+0000 7f52eb678740 1 --2- 172.21.15.148:0/2393763127 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5567e54a7e90 0x5567e54a8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:08.640 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.636+0000 7f52eb678740 1 -- 172.21.15.148:0/2393763127 >> 172.21.15.148:0/2393763127 conn(0x5567e5495ce0 msgr2=0x5567e54960c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:08.640 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.636+0000 7f52eb678740 1 -- 172.21.15.148:0/2393763127 shutdown_connections 2024-09-19T07:25:08.640 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.636+0000 7f52eb678740 1 -- 172.21.15.148:0/2393763127 wait complete. 2024-09-19T07:25:08.640 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.636+0000 7f52eb678740 1 -- start start 2024-09-19T07:25:08.640 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.636+0000 7f52eb678740 1 Processor -- start 2024-09-19T07:25:08.640 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.636+0000 7f52eb678740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567e54a3830 0x5567e54acfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:08.640 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.636+0000 7f52eb678740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5567e54a41d0 0x5567e54ad510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:08.641 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.637+0000 7f52eb678740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5567e54a7e90 0x5567e54ada50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:08.641 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.637+0000 7f52eb678740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5567e54b0280 con 0x5567e54a41d0 2024-09-19T07:25:08.641 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.637+0000 7f52eb678740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5567e5387290 con 0x5567e54a7e90 2024-09-19T07:25:08.641 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.637+0000 7f52eb678740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5567e54b0400 con 0x5567e54a3830 2024-09-19T07:25:08.641 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.637+0000 7f52eb678740 10 client.0 _ll_register_callbacks cb 0x5567e53b8140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:25:08.641 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.637+0000 7f52e259c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567e54a3830 0x5567e54acfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:08.641 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.637+0000 7f52e259c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567e54a3830 0x5567e54acfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:39022/0 (socket says 172.21.15.148:39022) 2024-09-19T07:25:08.641 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.637+0000 7f52e259c640 1 -- 172.21.15.148:0/3719794433 learned_addr learned my addr 172.21.15.148:0/3719794433 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:25:08.641 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.637+0000 7f52d9d9b640 1 --2- 172.21.15.148:0/3719794433 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5567e54a41d0 0x5567e54ad510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:08.641 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.637+0000 7f52e2d9d640 1 --2- 172.21.15.148:0/3719794433 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5567e54a7e90 0x5567e54ada50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:08.641 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.637+0000 7f52d9d9b640 1 -- 172.21.15.148:0/3719794433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567e54a3830 msgr2=0x5567e54acfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:08.641 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.637+0000 7f52d9d9b640 1 --2- 172.21.15.148:0/3719794433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567e54a3830 0x5567e54acfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:08.642 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.637+0000 7f52d9d9b640 1 -- 172.21.15.148:0/3719794433 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5567e54a7e90 msgr2=0x5567e54ada50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:08.642 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.637+0000 7f52d9d9b640 1 --2- 172.21.15.148:0/3719794433 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5567e54a7e90 0x5567e54ada50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:08.642 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.637+0000 7f52d9d9b640 1 -- 172.21.15.148:0/3719794433 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567e5111210 con 0x5567e54a41d0 2024-09-19T07:25:08.642 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.637+0000 7f52d9d9b640 1 --2- 172.21.15.148:0/3719794433 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5567e54a41d0 0x5567e54ad510 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f52cc006010 tx=0x7f52cc011670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dc5f42bc72c2d72 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:08.642 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.637+0000 7f52c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:25:08.642 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.638+0000 7f52c9ffb640 1 -- 172.21.15.148:0/3719794433 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52cc011ce0 con 0x5567e54a41d0 2024-09-19T07:25:08.642 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.638+0000 7f52c9ffb640 1 -- 172.21.15.148:0/3719794433 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8600+0+0 (secure 0 0 0) 0x7f52cc004020 con 0x5567e54a41d0 2024-09-19T07:25:08.642 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.638+0000 7f52eb678740 1 -- 172.21.15.148:0/3719794433 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52cc011920 con 0x5567e54a41d0 2024-09-19T07:25:08.642 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.638+0000 7f52c9ffb640 1 -- 172.21.15.148:0/3719794433 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f52cc004260 con 0x5567e54a41d0 2024-09-19T07:25:08.642 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.638+0000 7f52eb678740 10 client.17475 fetch_fsmap learned FSMap version 50 2024-09-19T07:25:08.642 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.638+0000 7f52eb678740 1 -- 172.21.15.148:0/3719794433 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x5567e51dd620 con 0x5567e54a41d0 2024-09-19T07:25:08.642 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.639+0000 7f52c9ffb640 1 -- 172.21.15.148:0/3719794433 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52cc011920 con 0x5567e54a41d0 2024-09-19T07:25:08.642 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.639+0000 7f52c9ffb640 1 -- 172.21.15.148:0/3719794433 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 50) ==== 8358+0+0 (secure 0 0 0) 0x7f52cc0049a0 con 0x5567e54a41d0 2024-09-19T07:25:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.639+0000 7f52eb678740 10 client.17475 fetch_fsmap finished waiting for FSMap version 50 2024-09-19T07:25:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.639+0000 7f52eb678740 10 client.17475 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:25:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.639+0000 7f52eb678740 20 client.17475 populate_metadata read hostname 'smithi148' 2024-09-19T07:25:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.639+0000 7f52eb678740 1 --2- 172.21.15.148:0/3719794433 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5567e54bd480 0x5567e54bf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.639+0000 7f52eb678740 4 client.17475 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:25:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.639+0000 7f52eb678740 1 -- 172.21.15.148:0/3719794433 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5567e540ba20 con 0x5567e54bd480 2024-09-19T07:25:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.639+0000 7f52e259c640 1 --2- 172.21.15.148:0/3719794433 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5567e54bd480 0x5567e54bf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:08.644 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.639+0000 7f52c9ffb640 10 client.17475 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:25:08.644 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.640+0000 7f52e259c640 1 --2- 172.21.15.148:0/3719794433 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5567e54bd480 0x5567e54bf870 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2db04496680dcae server_cookie=30ae47d6c1247e62 in_seq=0 out_seq=0 2024-09-19T07:25:08.644 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.640+0000 7f52c9ffb640 1 -- 172.21.15.148:0/3719794433 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5567e540ba20 con 0x5567e54bd480 2024-09-19T07:25:08.644 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.640+0000 7f52c9ffb640 10 client.17475 handle_command_reply: tid=0 2024-09-19T07:25:08.644 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.641+0000 7f52eb678740 1 client.17475 shutdown 2024-09-19T07:25:08.645 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.641+0000 7f52eb678740 1 -- 172.21.15.148:0/3719794433 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5567e54a41d0 msgr2=0x5567e54ad510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:08.645 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.641+0000 7f52eb678740 1 --2- 172.21.15.148:0/3719794433 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5567e54a41d0 0x5567e54ad510 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f52cc006010 tx=0x7f52cc011670 comp rx=0 tx=0).stop 2024-09-19T07:25:08.645 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.641+0000 7f52eb678740 1 -- 172.21.15.148:0/3719794433 shutdown_connections 2024-09-19T07:25:08.645 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.641+0000 7f52eb678740 1 --2- 172.21.15.148:0/3719794433 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5567e54bd480 0x5567e54bf870 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:08.645 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.641+0000 7f52c9ffb640 0 client.17475 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:25:08.645 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.641+0000 7f52eb678740 1 --2- 172.21.15.148:0/3719794433 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5567e54a7e90 0x5567e54ada50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:08.645 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.641+0000 7f52eb678740 1 --2- 172.21.15.148:0/3719794433 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5567e54a41d0 0x5567e54ad510 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:08.645 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.641+0000 7f52eb678740 1 --2- 172.21.15.148:0/3719794433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567e54a3830 0x5567e54acfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:08.645 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.641+0000 7f52eb678740 1 -- 172.21.15.148:0/3719794433 >> 172.21.15.148:0/3719794433 conn(0x5567e5495ce0 msgr2=0x5567e54a3040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:08.645 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.641+0000 7f52eb678740 1 -- 172.21.15.148:0/3719794433 shutdown_connections 2024-09-19T07:25:08.645 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.641+0000 7f52eb678740 1 -- 172.21.15.148:0/3719794433 wait complete. 2024-09-19T07:25:08.645 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.641+0000 7f52eb678740 20 client.17475 trim_cache size 0 max 16384 2024-09-19T07:25:08.664 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.663+0000 7f52eb678740 1 Processor -- start 2024-09-19T07:25:08.664 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.663+0000 7f52eb678740 1 -- start start 2024-09-19T07:25:08.664 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.663+0000 7f52eb678740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5567e54a3830 0x5567e54aef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:08.664 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.663+0000 7f52eb678740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5567e54a7e90 0x5567e54c4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:08.664 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.663+0000 7f52eb678740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567e54bd480 0x5567e54c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:08.664 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.663+0000 7f52eb678740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f52e41adee0 con 0x5567e54a7e90 2024-09-19T07:25:08.664 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.663+0000 7f52eb678740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f52e41ab720 con 0x5567e54a3830 2024-09-19T07:25:08.664 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.663+0000 7f52eb678740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f52e41a9590 con 0x5567e54bd480 2024-09-19T07:25:08.664 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.663+0000 7f52e259c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5567e54a3830 0x5567e54aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:08.665 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.663+0000 7f52e259c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5567e54a3830 0x5567e54aef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:50132/0 (socket says 172.21.15.148:50132) 2024-09-19T07:25:08.665 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.663+0000 7f52e259c640 1 -- 172.21.15.148:0/2054220125 learned_addr learned my addr 172.21.15.148:0/2054220125 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:25:08.665 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.663+0000 7f52d9d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5567e54a7e90 0x5567e54c4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:08.665 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.663+0000 7f52e2d9d640 1 --2- 172.21.15.148:0/2054220125 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567e54bd480 0x5567e54c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:08.669 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.664+0000 7f52e259c640 1 -- 172.21.15.148:0/2054220125 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567e54bd480 msgr2=0x5567e54c53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:08.670 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.664+0000 7f52e259c640 1 --2- 172.21.15.148:0/2054220125 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567e54bd480 0x5567e54c53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:08.670 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.664+0000 7f52e259c640 1 -- 172.21.15.148:0/2054220125 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5567e54a7e90 msgr2=0x5567e54c4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:08.670 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.664+0000 7f52e259c640 1 --2- 172.21.15.148:0/2054220125 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5567e54a7e90 0x5567e54c4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:08.670 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.664+0000 7f52e259c640 1 -- 172.21.15.148:0/2054220125 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567e5499b50 con 0x5567e54a3830 2024-09-19T07:25:08.670 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.664+0000 7f52e259c640 1 --2- 172.21.15.148:0/2054220125 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5567e54a3830 0x5567e54aef40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f52d4098d00 tx=0x7f52d40d24d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfcf5a1bad0f8419 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:08.670 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.664+0000 7f52cbfff640 1 -- 172.21.15.148:0/2054220125 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d409ca30 con 0x5567e54a3830 2024-09-19T07:25:08.670 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.664+0000 7f52cbfff640 1 -- 172.21.15.148:0/2054220125 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52d409c330 con 0x5567e54a3830 2024-09-19T07:25:08.670 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.664+0000 7f52cbfff640 1 -- 172.21.15.148:0/2054220125 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d40d20e0 con 0x5567e54a3830 2024-09-19T07:25:08.670 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.665+0000 7f52eb678740 1 -- 172.21.15.148:0/2054220125 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5567e54a3830 msgr2=0x5567e54aef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:08.670 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.665+0000 7f52eb678740 1 --2- 172.21.15.148:0/2054220125 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5567e54a3830 0x5567e54aef40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f52d4098d00 tx=0x7f52d40d24d0 comp rx=0 tx=0).stop 2024-09-19T07:25:08.670 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.665+0000 7f52eb678740 1 -- 172.21.15.148:0/2054220125 shutdown_connections 2024-09-19T07:25:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.665+0000 7f52eb678740 1 --2- 172.21.15.148:0/2054220125 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567e54bd480 0x5567e54c53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.665+0000 7f52eb678740 1 --2- 172.21.15.148:0/2054220125 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5567e54a7e90 0x5567e54c4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.665+0000 7f52eb678740 1 --2- 172.21.15.148:0/2054220125 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5567e54a3830 0x5567e54aef40 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.665+0000 7f52eb678740 1 -- 172.21.15.148:0/2054220125 >> 172.21.15.148:0/2054220125 conn(0x5567e5495ce0 msgr2=0x5567e54ae830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.665+0000 7f52eb678740 1 -- 172.21.15.148:0/2054220125 shutdown_connections 2024-09-19T07:25:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.665+0000 7f52eb678740 1 -- 172.21.15.148:0/2054220125 wait complete. 2024-09-19T07:25:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.666+0000 7f52eb678740 1 -- start start 2024-09-19T07:25:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.666+0000 7f52eb678740 1 Processor -- start 2024-09-19T07:25:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.666+0000 7f52eb678740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567e54a3830 0x5567e54b5690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.666+0000 7f52eb678740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5567e54a7e90 0x5567e54b5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.666+0000 7f52eb678740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5567e54bd480 0x5567e54b2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.666+0000 7f52eb678740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f52e41a9be0 con 0x5567e54bd480 2024-09-19T07:25:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.666+0000 7f52eb678740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f52e41ab050 con 0x5567e54a7e90 2024-09-19T07:25:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.666+0000 7f52e259c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567e54a3830 0x5567e54b5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:08.672 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.666+0000 7f52eb678740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f52e41aa2b0 con 0x5567e54a3830 2024-09-19T07:25:08.672 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.666+0000 7f52e259c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567e54a3830 0x5567e54b5690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:39032/0 (socket says 172.21.15.148:39032) 2024-09-19T07:25:08.672 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.666+0000 7f52e259c640 1 -- 172.21.15.148:0/1834151208 learned_addr learned my addr 172.21.15.148:0/1834151208 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:25:08.672 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.667+0000 7f52e2d9d640 1 --2- 172.21.15.148:0/1834151208 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5567e54bd480 0x5567e54b2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:08.672 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.667+0000 7f52eb678740 10 client.0 _ll_register_callbacks cb 0x7f52d4005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:25:08.672 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.667+0000 7f52d9d9b640 1 --2- 172.21.15.148:0/1834151208 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5567e54a7e90 0x5567e54b5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:08.672 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.667+0000 7f52e259c640 1 -- 172.21.15.148:0/1834151208 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5567e54a7e90 msgr2=0x5567e54b5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:08.672 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.667+0000 7f52e259c640 1 --2- 172.21.15.148:0/1834151208 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5567e54a7e90 0x5567e54b5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:08.672 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.667+0000 7f52e259c640 1 -- 172.21.15.148:0/1834151208 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5567e54bd480 msgr2=0x5567e54b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:08.672 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.667+0000 7f52e259c640 1 --2- 172.21.15.148:0/1834151208 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5567e54bd480 0x5567e54b2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:08.672 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.667+0000 7f52e259c640 1 -- 172.21.15.148:0/1834151208 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567e54b2bd0 con 0x5567e54a3830 2024-09-19T07:25:08.672 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.667+0000 7f52d9d9b640 1 --2- 172.21.15.148:0/1834151208 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5567e54a7e90 0x5567e54b5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:25:08.672 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.667+0000 7f52e2d9d640 1 --2- 172.21.15.148:0/1834151208 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5567e54bd480 0x5567e54b2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:25:08.673 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.667+0000 7f52e259c640 1 --2- 172.21.15.148:0/1834151208 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567e54a3830 0x5567e54b5690 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f52d4098790 tx=0x7f52d409ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4501930340b0553f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:08.673 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.667+0000 7f52c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-19T07:25:08.673 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.667+0000 7f52c9ffb640 1 -- 172.21.15.148:0/1834151208 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d40a4fa0 con 0x5567e54a3830 2024-09-19T07:25:08.673 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.667+0000 7f52c9ffb640 1 -- 172.21.15.148:0/1834151208 <== mon.1 v2:172.21.15.179:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8600+0+0 (secure 0 0 0) 0x7f52d40cda20 con 0x5567e54a3830 2024-09-19T07:25:08.673 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.667+0000 7f52eb678740 1 -- 172.21.15.148:0/1834151208 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52d409c330 con 0x5567e54a3830 2024-09-19T07:25:08.673 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.667+0000 7f52c9ffb640 1 -- 172.21.15.148:0/1834151208 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f52d409a630 con 0x5567e54a3830 2024-09-19T07:25:08.673 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.667+0000 7f52eb678740 10 client.26647 fetch_fsmap learned FSMap version 50 2024-09-19T07:25:08.673 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.667+0000 7f52eb678740 1 -- 172.21.15.148:0/1834151208 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x5567e5528680 con 0x5567e54a3830 2024-09-19T07:25:08.673 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.668+0000 7f52c9ffb640 1 -- 172.21.15.148:0/1834151208 <== mon.1 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52d40d20f0 con 0x5567e54a3830 2024-09-19T07:25:08.673 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.668+0000 7f52c9ffb640 1 -- 172.21.15.148:0/1834151208 <== mon.1 v2:172.21.15.179:3300/0 5 ==== fsmap(e 50) ==== 8358+0+0 (secure 0 0 0) 0x7f52d40b02e0 con 0x5567e54a3830 2024-09-19T07:25:08.673 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.668+0000 7f52eb678740 10 client.26647 fetch_fsmap finished waiting for FSMap version 50 2024-09-19T07:25:08.673 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.668+0000 7f52eb678740 10 client.26647 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:25:08.673 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.668+0000 7f52eb678740 20 client.26647 populate_metadata read hostname 'smithi148' 2024-09-19T07:25:08.673 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.668+0000 7f52eb678740 1 --2- 172.21.15.148:0/1834151208 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5567e5528d30 0x5567e552b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:08.674 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.668+0000 7f52eb678740 4 client.26647 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:25:08.674 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.668+0000 7f52eb678740 1 -- 172.21.15.148:0/1834151208 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f52d409c330 con 0x5567e5528d30 2024-09-19T07:25:08.674 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.668+0000 7f52d9d9b640 1 --2- 172.21.15.148:0/1834151208 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5567e5528d30 0x5567e552b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:08.674 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.669+0000 7f52c9ffb640 10 client.26647 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:25:08.674 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.669+0000 7f52d9d9b640 1 --2- 172.21.15.148:0/1834151208 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5567e5528d30 0x5567e552b150 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7d88ecc55ae646 server_cookie=9c3096dd03411ea3 in_seq=0 out_seq=0 2024-09-19T07:25:08.756 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.755+0000 7f52c9ffb640 1 -- 172.21.15.148:0/1834151208 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f52d409c330 con 0x5567e5528d30 2024-09-19T07:25:08.756 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.755+0000 7f52c9ffb640 10 client.26647 handle_command_reply: tid=0 2024-09-19T07:25:08.756 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.755+0000 7f52eb678740 1 client.26647 shutdown 2024-09-19T07:25:08.756 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.755+0000 7f52eb678740 1 -- 172.21.15.148:0/1834151208 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567e54a3830 msgr2=0x5567e54b5690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:08.756 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.755+0000 7f52eb678740 1 --2- 172.21.15.148:0/1834151208 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567e54a3830 0x5567e54b5690 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f52d4098790 tx=0x7f52d409ca30 comp rx=0 tx=0).stop 2024-09-19T07:25:08.756 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.755+0000 7f52eb678740 1 -- 172.21.15.148:0/1834151208 shutdown_connections 2024-09-19T07:25:08.757 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.755+0000 7f52eb678740 1 --2- 172.21.15.148:0/1834151208 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5567e5528d30 0x5567e552b150 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:08.757 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.755+0000 7f52eb678740 1 --2- 172.21.15.148:0/1834151208 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5567e54bd480 0x5567e54b2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:08.757 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.755+0000 7f52c9ffb640 0 client.26647 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:25:08.757 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.755+0000 7f52eb678740 1 --2- 172.21.15.148:0/1834151208 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5567e54a7e90 0x5567e54b5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:08.757 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.755+0000 7f52eb678740 1 --2- 172.21.15.148:0/1834151208 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5567e54a3830 0x5567e54b5690 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:08.757 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.755+0000 7f52eb678740 1 -- 172.21.15.148:0/1834151208 >> 172.21.15.148:0/1834151208 conn(0x5567e5495ce0 msgr2=0x5567e54a3040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:08.757 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.755+0000 7f52eb678740 1 -- 172.21.15.148:0/1834151208 shutdown_connections 2024-09-19T07:25:08.757 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.755+0000 7f52eb678740 1 -- 172.21.15.148:0/1834151208 wait complete. 2024-09-19T07:25:08.757 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.755+0000 7f52eb678740 20 client.26647 trim_cache size 0 max 16384 2024-09-19T07:25:08.757 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:25:08.758 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:25:08.758 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:25:08.758 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:25:08.758 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.756+0000 7f52e359e640 1 -- 172.21.15.148:0/579189567 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f52d00a3580 msgr2=0x7f52d00a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:08.758 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.756+0000 7f52e359e640 1 --2- 172.21.15.148:0/579189567 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f52d00a3580 0x7f52d00a5a40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f52dc009430 tx=0x7f52dc0095c0 comp rx=0 tx=0).stop 2024-09-19T07:25:08.759 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.756+0000 7f52e359e640 1 -- 172.21.15.148:0/579189567 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52e41014d0 msgr2=0x7f52e41981f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:08.759 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.756+0000 7f52e359e640 1 --2- 172.21.15.148:0/579189567 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52e41014d0 0x7f52e41981f0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f52d400e9f0 tx=0x7f52d400edf0 comp rx=0 tx=0).stop 2024-09-19T07:25:08.759 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.756+0000 7f52e359e640 1 -- 172.21.15.148:0/579189567 shutdown_connections 2024-09-19T07:25:08.759 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.756+0000 7f52e359e640 1 --2- 172.21.15.148:0/579189567 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f52d00a3580 0x7f52d00a5a40 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:08.759 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.756+0000 7f52e359e640 1 --2- 172.21.15.148:0/579189567 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f52e419cab0 0x7f52e419cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:08.759 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.756+0000 7f52e359e640 1 --2- 172.21.15.148:0/579189567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52e4105b80 0x7f52e4198730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:08.759 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.756+0000 7f52e359e640 1 --2- 172.21.15.148:0/579189567 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52e41014d0 0x7f52e41981f0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:08.759 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.756+0000 7f52e359e640 1 -- 172.21.15.148:0/579189567 >> 172.21.15.148:0/579189567 conn(0x7f52e4077200 msgr2=0x7f52e4103360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:08.759 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.756+0000 7f52e359e640 1 -- 172.21.15.148:0/579189567 shutdown_connections 2024-09-19T07:25:08.759 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:08.756+0000 7f52e359e640 1 -- 172.21.15.148:0/579189567 wait complete. 2024-09-19T07:25:09.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:25:08 smithi179 ceph-mon[35716]: pgmap v441: 97 pgs: 97 active+clean; 1.7 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 881 KiB/s wr, 85 op/s 2024-09-19T07:25:09.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:25:08 smithi148 ceph-mon[31180]: pgmap v441: 97 pgs: 97 active+clean; 1.7 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 881 KiB/s wr, 85 op/s 2024-09-19T07:25:09.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:25:08 smithi165 ceph-mon[35326]: pgmap v441: 97 pgs: 97 active+clean; 1.7 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 881 KiB/s wr, 85 op/s 2024-09-19T07:25:11.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:25:10 smithi179 ceph-mon[35716]: pgmap v442: 97 pgs: 4 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 82 active+clean; 1.7 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 121 op/s 2024-09-19T07:25:11.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:25:10 smithi148 ceph-mon[31180]: pgmap v442: 97 pgs: 4 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 82 active+clean; 1.7 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 121 op/s 2024-09-19T07:25:11.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:25:10 smithi165 ceph-mon[35326]: pgmap v442: 97 pgs: 4 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 82 active+clean; 1.7 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 121 op/s 2024-09-19T07:25:13.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:25:12 smithi179 ceph-mon[35716]: pgmap v443: 97 pgs: 14 active+clean+snaptrim, 28 active+clean+snaptrim_wait, 55 active+clean; 1.7 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 226 op/s 2024-09-19T07:25:13.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:25:12 smithi148 ceph-mon[31180]: pgmap v443: 97 pgs: 14 active+clean+snaptrim, 28 active+clean+snaptrim_wait, 55 active+clean; 1.7 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 226 op/s 2024-09-19T07:25:13.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:25:12 smithi165 ceph-mon[35326]: pgmap v443: 97 pgs: 14 active+clean+snaptrim, 28 active+clean+snaptrim_wait, 55 active+clean; 1.7 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 226 op/s 2024-09-19T07:25:15.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:25:14 smithi179 ceph-mon[35716]: pgmap v444: 97 pgs: 10 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 70 active+clean; 1.7 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 251 op/s 2024-09-19T07:25:15.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:25:14 smithi148 ceph-mon[31180]: pgmap v444: 97 pgs: 10 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 70 active+clean; 1.7 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 251 op/s 2024-09-19T07:25:15.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:25:14 smithi165 ceph-mon[35326]: pgmap v444: 97 pgs: 10 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 70 active+clean; 1.7 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 251 op/s 2024-09-19T07:25:17.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:25:16 smithi179 ceph-mon[35716]: pgmap v445: 97 pgs: 97 active+clean; 1.7 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.5 MiB/s wr, 321 op/s 2024-09-19T07:25:17.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:25:16 smithi148 ceph-mon[31180]: pgmap v445: 97 pgs: 97 active+clean; 1.7 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.5 MiB/s wr, 321 op/s 2024-09-19T07:25:17.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:25:16 smithi165 ceph-mon[35326]: pgmap v445: 97 pgs: 97 active+clean; 1.7 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.5 MiB/s wr, 321 op/s 2024-09-19T07:25:18.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:25:17 smithi179 ceph-mon[35716]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:25:18.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:25:17 smithi148 ceph-mon[31180]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:25:18.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:25:17 smithi165 ceph-mon[35326]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:25:19.027 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:25:18 smithi179 ceph-mon[35716]: pgmap v446: 97 pgs: 97 active+clean; 1.7 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.3 MiB/s wr, 296 op/s 2024-09-19T07:25:19.027 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:25:18 smithi179 ceph-mon[35716]: osdmap e98: 12 total, 12 up, 12 in 2024-09-19T07:25:19.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:25:18 smithi148 ceph-mon[31180]: pgmap v446: 97 pgs: 97 active+clean; 1.7 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.3 MiB/s wr, 296 op/s 2024-09-19T07:25:19.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:25:18 smithi148 ceph-mon[31180]: osdmap e98: 12 total, 12 up, 12 in 2024-09-19T07:25:19.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:25:18 smithi165 ceph-mon[35326]: pgmap v446: 97 pgs: 97 active+clean; 1.7 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.3 MiB/s wr, 296 op/s 2024-09-19T07:25:19.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:25:18 smithi165 ceph-mon[35326]: osdmap e98: 12 total, 12 up, 12 in 2024-09-19T07:25:21.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:25:20 smithi179 ceph-mon[35716]: pgmap v448: 97 pgs: 97 active+clean; 1.7 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.1 MiB/s wr, 327 op/s 2024-09-19T07:25:21.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:25:20 smithi148 ceph-mon[31180]: pgmap v448: 97 pgs: 97 active+clean; 1.7 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.1 MiB/s wr, 327 op/s 2024-09-19T07:25:21.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:25:20 smithi165 ceph-mon[35326]: pgmap v448: 97 pgs: 97 active+clean; 1.7 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.1 MiB/s wr, 327 op/s 2024-09-19T07:25:21.862 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.861+0000 7f5294e65640 1 -- 172.21.15.148:0/2361851286 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5290109c30 msgr2=0x7f5290114570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:21.862 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.861+0000 7f5294e65640 1 --2- 172.21.15.148:0/2361851286 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5290109c30 0x7f5290114570 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f5284009900 tx=0x7f528402a410 comp rx=0 tx=0).stop 2024-09-19T07:25:21.863 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.862+0000 7f5294e65640 1 -- 172.21.15.148:0/2361851286 shutdown_connections 2024-09-19T07:25:21.863 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.862+0000 7f5294e65640 1 --2- 172.21.15.148:0/2361851286 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5290114ab0 0x7f5290116ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:21.863 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.862+0000 7f5294e65640 1 --2- 172.21.15.148:0/2361851286 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5290109c30 0x7f5290114570 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:21.863 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.862+0000 7f5294e65640 1 --2- 172.21.15.148:0/2361851286 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5290109280 0x7f5290109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:21.863 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.862+0000 7f5294e65640 1 -- 172.21.15.148:0/2361851286 >> 172.21.15.148:0/2361851286 conn(0x7f529006d210 msgr2=0x7f529006d620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:21.863 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.862+0000 7f5294e65640 1 -- 172.21.15.148:0/2361851286 shutdown_connections 2024-09-19T07:25:21.863 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.862+0000 7f5294e65640 1 -- 172.21.15.148:0/2361851286 wait complete. 2024-09-19T07:25:21.864 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.863+0000 7f5294e65640 1 Processor -- start 2024-09-19T07:25:21.864 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.863+0000 7f5294e65640 1 -- start start 2024-09-19T07:25:21.865 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.863+0000 7f5294e65640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5290109280 0x7f52901a68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:21.865 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.863+0000 7f5294e65640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5290109c30 0x7f52901a6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:21.865 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.863+0000 7f5294e65640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5290114ab0 0x7f52901a0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:21.865 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.863+0000 7f5294e65640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f529011a7c0 con 0x7f5290109280 2024-09-19T07:25:21.865 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.863+0000 7f5294e65640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f529011a640 con 0x7f5290109c30 2024-09-19T07:25:21.865 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.863+0000 7f5294e65640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f529011a940 con 0x7f5290114ab0 2024-09-19T07:25:21.865 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.863+0000 7f528e59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5290109280 0x7f52901a68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:21.865 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.863+0000 7f528e59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5290109280 0x7f52901a68c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36612/0 (socket says 172.21.15.148:36612) 2024-09-19T07:25:21.865 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.863+0000 7f528e59c640 1 -- 172.21.15.148:0/3485634453 learned_addr learned my addr 172.21.15.148:0/3485634453 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:25:21.865 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.863+0000 7f528dd9b640 1 --2- 172.21.15.148:0/3485634453 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5290109c30 0x7f52901a6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:21.865 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.863+0000 7f528ed9d640 1 --2- 172.21.15.148:0/3485634453 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5290114ab0 0x7f52901a0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:21.865 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.864+0000 7f528e59c640 1 -- 172.21.15.148:0/3485634453 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5290114ab0 msgr2=0x7f52901a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:21.865 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.864+0000 7f528e59c640 1 --2- 172.21.15.148:0/3485634453 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5290114ab0 0x7f52901a0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:21.866 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.864+0000 7f528e59c640 1 -- 172.21.15.148:0/3485634453 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5290109c30 msgr2=0x7f52901a6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:21.866 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.864+0000 7f528e59c640 1 --2- 172.21.15.148:0/3485634453 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5290109c30 0x7f52901a6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:21.866 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.864+0000 7f528e59c640 1 -- 172.21.15.148:0/3485634453 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52901a11f0 con 0x7f5290109280 2024-09-19T07:25:21.866 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.865+0000 7f528e59c640 1 --2- 172.21.15.148:0/3485634453 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5290109280 0x7f52901a68c0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f528000e9f0 tx=0x7f528000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:21.866 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.865+0000 7f527f7fe640 1 -- 172.21.15.148:0/3485634453 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f528000cd80 con 0x7f5290109280 2024-09-19T07:25:21.867 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.865+0000 7f527f7fe640 1 -- 172.21.15.148:0/3485634453 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5280010910 con 0x7f5290109280 2024-09-19T07:25:21.867 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.865+0000 7f527f7fe640 1 -- 172.21.15.148:0/3485634453 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5280018990 con 0x7f5290109280 2024-09-19T07:25:21.867 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.866+0000 7f5294e65640 1 -- 172.21.15.148:0/3485634453 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52901a14e0 con 0x7f5290109280 2024-09-19T07:25:21.867 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.866+0000 7f5294e65640 1 -- 172.21.15.148:0/3485634453 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f529010a300 con 0x7f5290109280 2024-09-19T07:25:21.869 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.869+0000 7f5297c06740 1 Processor -- start 2024-09-19T07:25:21.870 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.869+0000 7f5297c06740 1 -- start start 2024-09-19T07:25:21.870 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.869+0000 7f527f7fe640 1 -- 172.21.15.148:0/3485634453 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f5280010ac0 con 0x7f5290109280 2024-09-19T07:25:21.870 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.870+0000 7f5297c06740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a3ca384300 0x55a3ca3846e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:21.870 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.870+0000 7f5297c06740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a3ca384c20 0x55a3ca38ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:21.870 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.870+0000 7f5297c06740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a3ca38f4c0 0x55a3ca3918b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:21.870 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.870+0000 7f5297c06740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55a3ca2e02f0 con 0x55a3ca38f4c0 2024-09-19T07:25:21.870 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.870+0000 7f5297c06740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55a3ca288270 con 0x55a3ca384c20 2024-09-19T07:25:21.870 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.870+0000 7f5297c06740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a3ca2dc2b0 con 0x55a3ca384300 2024-09-19T07:25:21.871 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.871+0000 7f527f7fe640 1 --2- 172.21.15.148:0/3485634453 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f52780a3560 0x7f52780a5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:21.871 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.871+0000 7f527f7fe640 1 -- 172.21.15.148:0/3485634453 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8556+0+0 (secure 0 0 0) 0x7f52800d0010 con 0x7f5290109280 2024-09-19T07:25:21.871 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.871+0000 7f528ed9d640 1 --2- 172.21.15.148:0/3485634453 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f52780a3560 0x7f52780a5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:21.871 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.871+0000 7f528dd9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a3ca38f4c0 0x55a3ca3918b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:21.871 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.871+0000 7f528dd9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a3ca38f4c0 0x55a3ca3918b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36620/0 (socket says 172.21.15.148:36620) 2024-09-19T07:25:21.871 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.871+0000 7f528dd9b640 1 -- 172.21.15.148:0/3480394734 learned_addr learned my addr 172.21.15.148:0/3480394734 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:25:21.872 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.871+0000 7f528e59c640 1 --2- 172.21.15.148:0/3480394734 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a3ca384c20 0x55a3ca38ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:21.872 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.871+0000 7f528dd9b640 1 -- 172.21.15.148:0/3480394734 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a3ca384300 msgr2=0x55a3ca3846e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:21.873 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.871+0000 7f528dd9b640 1 --2- 172.21.15.148:0/3480394734 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a3ca384300 0x55a3ca3846e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:21.873 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.871+0000 7f528dd9b640 1 -- 172.21.15.148:0/3480394734 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a3ca384c20 msgr2=0x55a3ca38ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:21.873 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.871+0000 7f528dd9b640 1 --2- 172.21.15.148:0/3480394734 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a3ca384c20 0x55a3ca38ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:21.873 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.871+0000 7f528dd9b640 1 -- 172.21.15.148:0/3480394734 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3ca287340 con 0x55a3ca38f4c0 2024-09-19T07:25:21.873 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.871+0000 7f528ed9d640 1 --2- 172.21.15.148:0/3485634453 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f52780a3560 0x7f52780a5a20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5288010a90 tx=0x7f5288010a20 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:21.873 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.872+0000 7f528dd9b640 1 --2- 172.21.15.148:0/3480394734 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a3ca38f4c0 0x55a3ca3918b0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f5284009900 tx=0x7f5284005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a86e42731bf8d60 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:21.873 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.872+0000 7f527cff9640 1 -- 172.21.15.148:0/3480394734 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5284040070 con 0x55a3ca38f4c0 2024-09-19T07:25:21.873 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.872+0000 7f527cff9640 1 -- 172.21.15.148:0/3480394734 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52840318f0 con 0x55a3ca38f4c0 2024-09-19T07:25:21.873 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.872+0000 7f527cff9640 1 -- 172.21.15.148:0/3480394734 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5284035040 con 0x55a3ca38f4c0 2024-09-19T07:25:21.874 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.873+0000 7f5297c06740 1 -- 172.21.15.148:0/3480394734 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a3ca38f4c0 msgr2=0x55a3ca3918b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:21.874 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.873+0000 7f5297c06740 1 --2- 172.21.15.148:0/3480394734 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a3ca38f4c0 0x55a3ca3918b0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f5284009900 tx=0x7f5284005e00 comp rx=0 tx=0).stop 2024-09-19T07:25:21.874 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.873+0000 7f5297c06740 1 -- 172.21.15.148:0/3480394734 shutdown_connections 2024-09-19T07:25:21.874 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.873+0000 7f5297c06740 1 --2- 172.21.15.148:0/3480394734 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a3ca38f4c0 0x55a3ca3918b0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:21.874 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.873+0000 7f5297c06740 1 --2- 172.21.15.148:0/3480394734 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a3ca384c20 0x55a3ca38ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:21.875 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.873+0000 7f5297c06740 1 --2- 172.21.15.148:0/3480394734 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a3ca384300 0x55a3ca3846e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:21.875 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.873+0000 7f5297c06740 1 -- 172.21.15.148:0/3480394734 >> 172.21.15.148:0/3480394734 conn(0x55a3ca380870 msgr2=0x55a3ca380c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:21.875 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.873+0000 7f5297c06740 1 -- 172.21.15.148:0/3480394734 shutdown_connections 2024-09-19T07:25:21.875 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.873+0000 7f5297c06740 1 -- 172.21.15.148:0/3480394734 wait complete. 2024-09-19T07:25:21.875 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.874+0000 7f5297c06740 1 -- start start 2024-09-19T07:25:21.875 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.874+0000 7f5297c06740 1 Processor -- start 2024-09-19T07:25:21.875 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.874+0000 7f5297c06740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a3ca384300 0x55a3ca38c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:21.876 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.874+0000 7f5297c06740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a3ca384c20 0x55a3ca38c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:21.876 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.874+0000 7f5297c06740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a3ca38f4c0 0x55a3ca38cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:21.876 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.874+0000 7f528e59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a3ca384300 0x55a3ca38c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:21.876 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.874+0000 7f5297c06740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55a3ca392090 con 0x55a3ca384300 2024-09-19T07:25:21.876 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.874+0000 7f5297c06740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55a3ca269290 con 0x55a3ca38f4c0 2024-09-19T07:25:21.876 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.874+0000 7f528e59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a3ca384300 0x55a3ca38c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36624/0 (socket says 172.21.15.148:36624) 2024-09-19T07:25:21.876 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.874+0000 7f5297c06740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a3ca392210 con 0x55a3ca384c20 2024-09-19T07:25:21.876 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.874+0000 7f528e59c640 1 -- 172.21.15.148:0/4233577475 learned_addr learned my addr 172.21.15.148:0/4233577475 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:25:21.876 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.874+0000 7f528dd9b640 1 --2- 172.21.15.148:0/4233577475 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a3ca384c20 0x55a3ca38c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:21.876 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.875+0000 7f528ed9d640 1 --2- 172.21.15.148:0/4233577475 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a3ca38f4c0 0x55a3ca38cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:21.876 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.875+0000 7f528e59c640 1 -- 172.21.15.148:0/4233577475 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a3ca384c20 msgr2=0x55a3ca38c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:21.877 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.875+0000 7f528e59c640 1 --2- 172.21.15.148:0/4233577475 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a3ca384c20 0x55a3ca38c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:21.877 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.875+0000 7f5297c06740 10 client.0 _ll_register_callbacks cb 0x55a3ca29a140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:25:21.877 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.875+0000 7f528e59c640 1 -- 172.21.15.148:0/4233577475 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a3ca38f4c0 msgr2=0x55a3ca38cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:21.877 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.875+0000 7f528e59c640 1 --2- 172.21.15.148:0/4233577475 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a3ca38f4c0 0x55a3ca38cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:21.877 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.875+0000 7f528e59c640 1 -- 172.21.15.148:0/4233577475 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3c9ff3210 con 0x55a3ca384300 2024-09-19T07:25:21.877 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.875+0000 7f5297c06740 1 -- 172.21.15.148:0/4233577475 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52840318f0 con 0x55a3ca384300 2024-09-19T07:25:21.877 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.875+0000 7f528ed9d640 1 --2- 172.21.15.148:0/4233577475 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a3ca38f4c0 0x55a3ca38cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:25:21.877 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.875+0000 7f528e59c640 1 --2- 172.21.15.148:0/4233577475 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a3ca384300 0x55a3ca38c370 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f52800097b0 tx=0x7f528009bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85df74698b2bf7dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:21.877 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.875+0000 7f5275ffb640 10 client.17493 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:25:21.879 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.876+0000 7f5275ffb640 1 -- 172.21.15.148:0/4233577475 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52800ac2e0 con 0x55a3ca384300 2024-09-19T07:25:21.879 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.876+0000 7f5275ffb640 1 -- 172.21.15.148:0/4233577475 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8556+0+0 (secure 0 0 0) 0x7f52800bc0b0 con 0x55a3ca384300 2024-09-19T07:25:21.880 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.876+0000 7f5275ffb640 1 -- 172.21.15.148:0/4233577475 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f52800bc2d0 con 0x55a3ca384300 2024-09-19T07:25:21.880 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.876+0000 7f5297c06740 10 client.17493 fetch_fsmap learned FSMap version 51 2024-09-19T07:25:21.880 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.876+0000 7f5297c06740 1 -- 172.21.15.148:0/4233577475 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({fsmap=51}) -- 0x55a3ca0bf620 con 0x55a3ca384300 2024-09-19T07:25:21.880 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.876+0000 7f5275ffb640 1 -- 172.21.15.148:0/4233577475 <== mon.0 v2:172.21.15.148:3300/0 4 ==== fsmap(e 51) ==== 8354+0+0 (secure 0 0 0) 0x7f52800a0120 con 0x55a3ca384300 2024-09-19T07:25:21.880 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.877+0000 7f5297c06740 10 client.17493 fetch_fsmap finished waiting for FSMap version 51 2024-09-19T07:25:21.880 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.877+0000 7f5297c06740 10 client.17493 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:25:21.880 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.877+0000 7f5297c06740 20 client.17493 populate_metadata read hostname 'smithi148' 2024-09-19T07:25:21.880 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.877+0000 7f5297c06740 1 --2- 172.21.15.148:0/4233577475 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55a3ca37b0e0 0x55a3ca37d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:21.880 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.877+0000 7f5297c06740 4 client.17493 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:25:21.880 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.877+0000 7f5297c06740 1 -- 172.21.15.148:0/4233577475 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a3ca2eda20 con 0x55a3ca37b0e0 2024-09-19T07:25:21.880 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.877+0000 7f528dd9b640 1 --2- 172.21.15.148:0/4233577475 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55a3ca37b0e0 0x55a3ca37d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:21.881 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.877+0000 7f528dd9b640 1 --2- 172.21.15.148:0/4233577475 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55a3ca37b0e0 0x55a3ca37d510 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e78f26292fec878 server_cookie=b0ecbd744963e24 in_seq=0 out_seq=0 2024-09-19T07:25:21.881 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.877+0000 7f5275ffb640 10 client.17493 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:25:21.881 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.878+0000 7f5275ffb640 1 -- 172.21.15.148:0/4233577475 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a3ca2eda20 con 0x55a3ca37b0e0 2024-09-19T07:25:21.881 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.878+0000 7f5275ffb640 10 client.17493 handle_command_reply: tid=0 2024-09-19T07:25:21.881 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.878+0000 7f5297c06740 1 client.17493 shutdown 2024-09-19T07:25:21.881 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.878+0000 7f5297c06740 1 -- 172.21.15.148:0/4233577475 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a3ca384300 msgr2=0x55a3ca38c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:21.881 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.878+0000 7f5297c06740 1 --2- 172.21.15.148:0/4233577475 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a3ca384300 0x55a3ca38c370 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f52800097b0 tx=0x7f528009bf80 comp rx=0 tx=0).stop 2024-09-19T07:25:21.881 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.879+0000 7f5297c06740 1 -- 172.21.15.148:0/4233577475 shutdown_connections 2024-09-19T07:25:21.881 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.879+0000 7f5297c06740 1 --2- 172.21.15.148:0/4233577475 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55a3ca37b0e0 0x55a3ca37d510 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:21.881 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.879+0000 7f5297c06740 1 --2- 172.21.15.148:0/4233577475 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a3ca38f4c0 0x55a3ca38cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:21.881 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.879+0000 7f5275ffb640 0 client.17493 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:25:21.881 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.879+0000 7f5297c06740 1 --2- 172.21.15.148:0/4233577475 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a3ca384c20 0x55a3ca38c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:21.881 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.879+0000 7f5297c06740 1 --2- 172.21.15.148:0/4233577475 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a3ca384300 0x55a3ca38c370 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:21.885 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.879+0000 7f5297c06740 1 -- 172.21.15.148:0/4233577475 >> 172.21.15.148:0/4233577475 conn(0x55a3ca380870 msgr2=0x55a3ca3771c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:21.885 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.879+0000 7f5297c06740 1 -- 172.21.15.148:0/4233577475 shutdown_connections 2024-09-19T07:25:21.885 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.879+0000 7f5297c06740 1 -- 172.21.15.148:0/4233577475 wait complete. 2024-09-19T07:25:21.885 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.879+0000 7f5297c06740 20 client.17493 trim_cache size 0 max 16384 2024-09-19T07:25:21.904 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.903+0000 7f5297c06740 1 Processor -- start 2024-09-19T07:25:21.904 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.904+0000 7f5297c06740 1 -- start start 2024-09-19T07:25:21.905 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.904+0000 7f5297c06740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a3ca37b0e0 0x55a3ca38e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:21.905 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.904+0000 7f5297c06740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a3ca384300 0x55a3ca38cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:21.905 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.904+0000 7f5297c06740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a3ca384c20 0x55a3ca3895b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:21.905 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.904+0000 7f5297c06740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f52901b6790 con 0x55a3ca37b0e0 2024-09-19T07:25:21.905 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.904+0000 7f5297c06740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f52901b4000 con 0x55a3ca384300 2024-09-19T07:25:21.905 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.904+0000 7f528e59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a3ca37b0e0 0x55a3ca38e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:21.905 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.904+0000 7f528e59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a3ca37b0e0 0x55a3ca38e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36628/0 (socket says 172.21.15.148:36628) 2024-09-19T07:25:21.905 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.905+0000 7f528e59c640 1 -- 172.21.15.148:0/1553385917 learned_addr learned my addr 172.21.15.148:0/1553385917 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:25:21.906 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.905+0000 7f528ed9d640 1 --2- 172.21.15.148:0/1553385917 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a3ca384c20 0x55a3ca3895b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:21.906 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.905+0000 7f5297c06740 1 -- 172.21.15.148:0/1553385917 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f52901b1e90 con 0x55a3ca384c20 2024-09-19T07:25:21.906 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.905+0000 7f528e59c640 1 -- 172.21.15.148:0/1553385917 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a3ca384c20 msgr2=0x55a3ca3895b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:21.906 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.905+0000 7f528e59c640 1 --2- 172.21.15.148:0/1553385917 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a3ca384c20 0x55a3ca3895b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:21.907 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.905+0000 7f528e59c640 1 -- 172.21.15.148:0/1553385917 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a3ca384300 msgr2=0x55a3ca38cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:21.907 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.905+0000 7f528dd9b640 1 --2- 172.21.15.148:0/1553385917 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a3ca384300 0x55a3ca38cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:21.907 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.905+0000 7f528e59c640 1 --2- 172.21.15.148:0/1553385917 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a3ca384300 0x55a3ca38cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:21.907 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.905+0000 7f528e59c640 1 -- 172.21.15.148:0/1553385917 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3ca3806a0 con 0x55a3ca37b0e0 2024-09-19T07:25:21.907 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.905+0000 7f528dd9b640 1 --2- 172.21.15.148:0/1553385917 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a3ca384300 0x55a3ca38cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:25:21.907 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.906+0000 7f528e59c640 1 --2- 172.21.15.148:0/1553385917 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a3ca37b0e0 0x55a3ca38e2e0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f52800bc010 tx=0x7f52800cf000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d300798e3c5cc68 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:21.907 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.906+0000 7f5277fff640 1 -- 172.21.15.148:0/1553385917 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52800b5260 con 0x55a3ca37b0e0 2024-09-19T07:25:21.907 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.906+0000 7f5277fff640 1 -- 172.21.15.148:0/1553385917 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52840318f0 con 0x55a3ca37b0e0 2024-09-19T07:25:21.907 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.906+0000 7f5277fff640 1 -- 172.21.15.148:0/1553385917 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f528009b9d0 con 0x55a3ca37b0e0 2024-09-19T07:25:21.908 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.907+0000 7f5297c06740 1 -- 172.21.15.148:0/1553385917 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a3ca37b0e0 msgr2=0x55a3ca38e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:21.908 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.907+0000 7f5297c06740 1 --2- 172.21.15.148:0/1553385917 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a3ca37b0e0 0x55a3ca38e2e0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f52800bc010 tx=0x7f52800cf000 comp rx=0 tx=0).stop 2024-09-19T07:25:21.909 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.907+0000 7f5297c06740 1 -- 172.21.15.148:0/1553385917 shutdown_connections 2024-09-19T07:25:21.909 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.907+0000 7f5297c06740 1 --2- 172.21.15.148:0/1553385917 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a3ca384c20 0x55a3ca3895b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:21.909 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.908+0000 7f5297c06740 1 --2- 172.21.15.148:0/1553385917 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a3ca384300 0x55a3ca38cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:21.909 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.908+0000 7f5297c06740 1 --2- 172.21.15.148:0/1553385917 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a3ca37b0e0 0x55a3ca38e2e0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:21.909 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.908+0000 7f5297c06740 1 -- 172.21.15.148:0/1553385917 >> 172.21.15.148:0/1553385917 conn(0x55a3ca380870 msgr2=0x55a3ca38dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:21.909 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.908+0000 7f5297c06740 1 -- 172.21.15.148:0/1553385917 shutdown_connections 2024-09-19T07:25:21.909 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.908+0000 7f5297c06740 1 -- 172.21.15.148:0/1553385917 wait complete. 2024-09-19T07:25:21.911 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.909+0000 7f5297c06740 1 -- start start 2024-09-19T07:25:21.911 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.909+0000 7f5297c06740 1 Processor -- start 2024-09-19T07:25:21.911 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.910+0000 7f5297c06740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a3ca37b0e0 0x55a3ca39e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:21.911 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.910+0000 7f5297c06740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a3ca384300 0x55a3ca39e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:21.911 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.910+0000 7f5297c06740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a3ca384c20 0x55a3ca3ffbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:21.911 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.910+0000 7f528e59c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a3ca37b0e0 0x55a3ca39e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:21.911 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.910+0000 7f5297c06740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f52901b24e0 con 0x55a3ca384300 2024-09-19T07:25:21.911 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.910+0000 7f528e59c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a3ca37b0e0 0x55a3ca39e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:32930/0 (socket says 172.21.15.148:32930) 2024-09-19T07:25:21.911 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.910+0000 7f528e59c640 1 -- 172.21.15.148:0/1662968838 learned_addr learned my addr 172.21.15.148:0/1662968838 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:25:21.911 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.910+0000 7f5297c06740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f52901b3930 con 0x55a3ca384c20 2024-09-19T07:25:21.912 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.910+0000 7f528ed9d640 1 --2- 172.21.15.148:0/1662968838 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a3ca384c20 0x55a3ca3ffbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:21.912 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.910+0000 7f5297c06740 1 -- 172.21.15.148:0/1662968838 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f52901b2b90 con 0x55a3ca37b0e0 2024-09-19T07:25:21.912 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.910+0000 7f528dd9b640 1 --2- 172.21.15.148:0/1662968838 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a3ca384300 0x55a3ca39e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:21.912 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.910+0000 7f5297c06740 10 client.0 _ll_register_callbacks cb 0x7f528009c0f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:25:21.913 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.911+0000 7f528e59c640 1 -- 172.21.15.148:0/1662968838 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a3ca384c20 msgr2=0x55a3ca3ffbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:21.913 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.911+0000 7f528e59c640 1 --2- 172.21.15.148:0/1662968838 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a3ca384c20 0x55a3ca3ffbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:21.913 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.911+0000 7f528e59c640 1 -- 172.21.15.148:0/1662968838 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a3ca384300 msgr2=0x55a3ca39e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:21.913 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.911+0000 7f528e59c640 1 --2- 172.21.15.148:0/1662968838 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a3ca384300 0x55a3ca39e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:21.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.911+0000 7f528e59c640 1 -- 172.21.15.148:0/1662968838 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3ca400120 con 0x55a3ca37b0e0 2024-09-19T07:25:21.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.911+0000 7f528e59c640 1 --2- 172.21.15.148:0/1662968838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a3ca37b0e0 0x55a3ca39e0c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f528009c2b0 tx=0x7f5280000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c2f4ddbfa84c637 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:21.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.911+0000 7f5275ffb640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-19T07:25:21.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.911+0000 7f5275ffb640 1 -- 172.21.15.148:0/1662968838 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52800b5260 con 0x55a3ca37b0e0 2024-09-19T07:25:21.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.911+0000 7f5275ffb640 1 -- 172.21.15.148:0/1662968838 <== mon.1 v2:172.21.15.179:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8556+0+0 (secure 0 0 0) 0x7f5280010430 con 0x55a3ca37b0e0 2024-09-19T07:25:21.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.911+0000 7f5297c06740 1 -- 172.21.15.148:0/1662968838 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52840318f0 con 0x55a3ca37b0e0 2024-09-19T07:25:21.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.912+0000 7f5275ffb640 1 -- 172.21.15.148:0/1662968838 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f52800a0620 con 0x55a3ca37b0e0 2024-09-19T07:25:21.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.912+0000 7f5297c06740 10 client.26662 fetch_fsmap learned FSMap version 51 2024-09-19T07:25:21.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.912+0000 7f5297c06740 1 -- 172.21.15.148:0/1662968838 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55a3ca400120 con 0x55a3ca37b0e0 2024-09-19T07:25:21.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.912+0000 7f5275ffb640 1 -- 172.21.15.148:0/1662968838 <== mon.1 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52800a7030 con 0x55a3ca37b0e0 2024-09-19T07:25:21.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.913+0000 7f5275ffb640 1 -- 172.21.15.148:0/1662968838 <== mon.1 v2:172.21.15.179:3300/0 5 ==== fsmap(e 51) ==== 8354+0+0 (secure 0 0 0) 0x7f528009b1e0 con 0x55a3ca37b0e0 2024-09-19T07:25:21.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.913+0000 7f5297c06740 10 client.26662 fetch_fsmap finished waiting for FSMap version 51 2024-09-19T07:25:21.915 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.913+0000 7f5297c06740 10 client.26662 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:25:21.915 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.913+0000 7f5297c06740 20 client.26662 populate_metadata read hostname 'smithi148' 2024-09-19T07:25:21.915 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.913+0000 7f5297c06740 1 --2- 172.21.15.148:0/1662968838 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55a3ca38f4c0 0x55a3ca4036b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:21.915 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.913+0000 7f5297c06740 4 client.26662 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:25:21.915 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.913+0000 7f5297c06740 1 -- 172.21.15.148:0/1662968838 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f52840318f0 con 0x55a3ca38f4c0 2024-09-19T07:25:21.915 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.914+0000 7f528dd9b640 1 --2- 172.21.15.148:0/1662968838 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55a3ca38f4c0 0x55a3ca4036b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:21.916 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.914+0000 7f528dd9b640 1 --2- 172.21.15.148:0/1662968838 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55a3ca38f4c0 0x55a3ca4036b0 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1262e6c4ecadd875 server_cookie=9fe70a9e733a9ce1 in_seq=0 out_seq=0 2024-09-19T07:25:21.916 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.914+0000 7f5275ffb640 10 client.26662 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:25:21.929 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.929+0000 7f5275ffb640 1 -- 172.21.15.148:0/1662968838 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f52840318f0 con 0x55a3ca38f4c0 2024-09-19T07:25:21.929 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.929+0000 7f5275ffb640 10 client.26662 handle_command_reply: tid=0 2024-09-19T07:25:21.929 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.929+0000 7f5297c06740 1 client.26662 shutdown 2024-09-19T07:25:21.931 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.929+0000 7f5297c06740 1 -- 172.21.15.148:0/1662968838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a3ca37b0e0 msgr2=0x55a3ca39e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:21.931 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.929+0000 7f5297c06740 1 --2- 172.21.15.148:0/1662968838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a3ca37b0e0 0x55a3ca39e0c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f528009c2b0 tx=0x7f5280000bc0 comp rx=0 tx=0).stop 2024-09-19T07:25:21.931 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.930+0000 7f5297c06740 1 -- 172.21.15.148:0/1662968838 shutdown_connections 2024-09-19T07:25:21.931 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.930+0000 7f5297c06740 1 --2- 172.21.15.148:0/1662968838 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55a3ca38f4c0 0x55a3ca4036b0 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:21.931 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.930+0000 7f5297c06740 1 --2- 172.21.15.148:0/1662968838 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a3ca384c20 0x55a3ca3ffbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:21.931 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.930+0000 7f5275ffb640 0 client.26662 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:25:21.931 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.930+0000 7f5297c06740 1 --2- 172.21.15.148:0/1662968838 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a3ca384300 0x55a3ca39e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:21.931 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.930+0000 7f5297c06740 1 --2- 172.21.15.148:0/1662968838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a3ca37b0e0 0x55a3ca39e0c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:21.932 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.930+0000 7f5297c06740 1 -- 172.21.15.148:0/1662968838 >> 172.21.15.148:0/1662968838 conn(0x55a3ca380870 msgr2=0x55a3ca38a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:21.932 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.930+0000 7f5297c06740 1 -- 172.21.15.148:0/1662968838 shutdown_connections 2024-09-19T07:25:21.932 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.930+0000 7f5297c06740 1 -- 172.21.15.148:0/1662968838 wait complete. 2024-09-19T07:25:21.932 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.930+0000 7f5297c06740 20 client.26662 trim_cache size 0 max 16384 2024-09-19T07:25:21.932 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:25:21.932 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:25:21.932 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:25:21.932 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:25:21.933 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.931+0000 7f5294e65640 1 -- 172.21.15.148:0/3485634453 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f52780a3560 msgr2=0x7f52780a5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:21.933 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.931+0000 7f5294e65640 1 --2- 172.21.15.148:0/3485634453 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f52780a3560 0x7f52780a5a20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5288010a90 tx=0x7f5288010a20 comp rx=0 tx=0).stop 2024-09-19T07:25:21.933 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.931+0000 7f5294e65640 1 -- 172.21.15.148:0/3485634453 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5290109280 msgr2=0x7f52901a68c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:21.933 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.931+0000 7f5294e65640 1 --2- 172.21.15.148:0/3485634453 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5290109280 0x7f52901a68c0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f528000e9f0 tx=0x7f528000eeb0 comp rx=0 tx=0).stop 2024-09-19T07:25:21.933 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.932+0000 7f5294e65640 1 -- 172.21.15.148:0/3485634453 shutdown_connections 2024-09-19T07:25:21.934 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.932+0000 7f5294e65640 1 --2- 172.21.15.148:0/3485634453 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f52780a3560 0x7f52780a5a20 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:21.934 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.932+0000 7f5294e65640 1 --2- 172.21.15.148:0/3485634453 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5290114ab0 0x7f52901a0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:21.934 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.932+0000 7f5294e65640 1 --2- 172.21.15.148:0/3485634453 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5290109c30 0x7f52901a6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:21.934 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.932+0000 7f5294e65640 1 --2- 172.21.15.148:0/3485634453 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5290109280 0x7f52901a68c0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:21.934 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.932+0000 7f5294e65640 1 -- 172.21.15.148:0/3485634453 >> 172.21.15.148:0/3485634453 conn(0x7f529006d210 msgr2=0x7f5290070850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:21.934 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.932+0000 7f5294e65640 1 -- 172.21.15.148:0/3485634453 shutdown_connections 2024-09-19T07:25:21.934 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:21.932+0000 7f5294e65640 1 -- 172.21.15.148:0/3485634453 wait complete. 2024-09-19T07:25:23.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:25:22 smithi179 ceph-mon[35716]: pgmap v449: 97 pgs: 97 active+clean; 1.7 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.2 MiB/s wr, 366 op/s 2024-09-19T07:25:23.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:25:22 smithi148 ceph-mon[31180]: pgmap v449: 97 pgs: 97 active+clean; 1.7 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.2 MiB/s wr, 366 op/s 2024-09-19T07:25:23.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:25:22 smithi165 ceph-mon[35326]: pgmap v449: 97 pgs: 97 active+clean; 1.7 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.2 MiB/s wr, 366 op/s 2024-09-19T07:25:25.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:25:24 smithi179 ceph-mon[35716]: pgmap v450: 97 pgs: 97 active+clean; 1.7 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.2 MiB/s wr, 393 op/s 2024-09-19T07:25:25.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:25:24 smithi148 ceph-mon[31180]: pgmap v450: 97 pgs: 97 active+clean; 1.7 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.2 MiB/s wr, 393 op/s 2024-09-19T07:25:25.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:25:24 smithi165 ceph-mon[35326]: pgmap v450: 97 pgs: 97 active+clean; 1.7 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.2 MiB/s wr, 393 op/s 2024-09-19T07:25:27.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:25:26 smithi179 ceph-mon[35716]: pgmap v451: 97 pgs: 97 active+clean; 1.8 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.5 MiB/s wr, 443 op/s 2024-09-19T07:25:27.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:25:26 smithi148 ceph-mon[31180]: pgmap v451: 97 pgs: 97 active+clean; 1.8 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.5 MiB/s wr, 443 op/s 2024-09-19T07:25:27.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:25:26 smithi165 ceph-mon[35326]: pgmap v451: 97 pgs: 97 active+clean; 1.8 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.5 MiB/s wr, 443 op/s 2024-09-19T07:25:28.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:25:27 smithi179 ceph-mon[35716]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:25:28.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:25:27 smithi148 ceph-mon[31180]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:25:28.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:25:27 smithi165 ceph-mon[35326]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:25:29.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:25:28 smithi179 ceph-mon[35716]: pgmap v452: 97 pgs: 97 active+clean; 1.8 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.5 MiB/s wr, 443 op/s 2024-09-19T07:25:29.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:25:28 smithi148 ceph-mon[31180]: pgmap v452: 97 pgs: 97 active+clean; 1.8 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.5 MiB/s wr, 443 op/s 2024-09-19T07:25:29.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:25:28 smithi165 ceph-mon[35326]: pgmap v452: 97 pgs: 97 active+clean; 1.8 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.5 MiB/s wr, 443 op/s 2024-09-19T07:25:31.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:25:30 smithi179 ceph-mon[35716]: pgmap v453: 97 pgs: 97 active+clean; 1.8 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.9 MiB/s wr, 417 op/s 2024-09-19T07:25:31.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:25:30 smithi148 ceph-mon[31180]: pgmap v453: 97 pgs: 97 active+clean; 1.8 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.9 MiB/s wr, 417 op/s 2024-09-19T07:25:31.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:25:30 smithi165 ceph-mon[35326]: pgmap v453: 97 pgs: 97 active+clean; 1.8 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.9 MiB/s wr, 417 op/s 2024-09-19T07:25:33.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:25:32 smithi179 ceph-mon[35716]: pgmap v454: 97 pgs: 97 active+clean; 1.8 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.6 MiB/s wr, 496 op/s 2024-09-19T07:25:33.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:25:32 smithi179 ceph-mon[35716]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:25:33.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:25:32 smithi148 ceph-mon[31180]: pgmap v454: 97 pgs: 97 active+clean; 1.8 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.6 MiB/s wr, 496 op/s 2024-09-19T07:25:33.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:25:32 smithi148 ceph-mon[31180]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:25:33.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:25:32 smithi165 ceph-mon[35326]: pgmap v454: 97 pgs: 97 active+clean; 1.8 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.6 MiB/s wr, 496 op/s 2024-09-19T07:25:33.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:25:32 smithi165 ceph-mon[35326]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:25:35.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:25:34 smithi179 ceph-mon[35716]: pgmap v455: 97 pgs: 97 active+clean; 1.8 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.5 MiB/s wr, 397 op/s 2024-09-19T07:25:35.030 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.028+0000 7f390f1e4640 1 -- 172.21.15.148:0/1504053389 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3908102ca0 msgr2=0x7f3908103080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:35.030 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.028+0000 7f390f1e4640 1 --2- 172.21.15.148:0/1504053389 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3908102ca0 0x7f3908103080 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f38fc009900 tx=0x7f38fc02a480 comp rx=0 tx=0).stop 2024-09-19T07:25:35.030 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.028+0000 7f390f1e4640 1 -- 172.21.15.148:0/1504053389 shutdown_connections 2024-09-19T07:25:35.030 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.028+0000 7f390f1e4640 1 --2- 172.21.15.148:0/1504053389 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f390810c0f0 0x7f390810e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:35.031 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.028+0000 7f390f1e4640 1 --2- 172.21.15.148:0/1504053389 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39081035c0 0x7f390810baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:35.031 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.028+0000 7f390f1e4640 1 --2- 172.21.15.148:0/1504053389 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3908102ca0 0x7f3908103080 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:35.031 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.028+0000 7f390f1e4640 1 -- 172.21.15.148:0/1504053389 >> 172.21.15.148:0/1504053389 conn(0x7f39080fc690 msgr2=0x7f39080feab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:35.031 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.028+0000 7f390f1e4640 1 -- 172.21.15.148:0/1504053389 shutdown_connections 2024-09-19T07:25:35.031 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.028+0000 7f390f1e4640 1 -- 172.21.15.148:0/1504053389 wait complete. 2024-09-19T07:25:35.031 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.029+0000 7f390f1e4640 1 Processor -- start 2024-09-19T07:25:35.031 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.029+0000 7f390f1e4640 1 -- start start 2024-09-19T07:25:35.031 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.029+0000 7f390f1e4640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3908102ca0 0x7f3908198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:35.031 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.029+0000 7f390f1e4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39081035c0 0x7f39081988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:35.031 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.029+0000 7f390f1e4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f390810c0f0 0x7f390819cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:35.031 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.029+0000 7f390f1e4640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3908111ed0 con 0x7f390810c0f0 2024-09-19T07:25:35.031 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.029+0000 7f390f1e4640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3908111d50 con 0x7f3908102ca0 2024-09-19T07:25:35.032 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.029+0000 7f390f1e4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3908112050 con 0x7f39081035c0 2024-09-19T07:25:35.032 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.029+0000 7f390d781640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f390810c0f0 0x7f390819cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:35.032 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.029+0000 7f390d781640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f390810c0f0 0x7f390819cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47170/0 (socket says 172.21.15.148:47170) 2024-09-19T07:25:35.032 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.029+0000 7f390cf80640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3908102ca0 0x7f3908198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:35.032 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.029+0000 7f390d781640 1 -- 172.21.15.148:0/2849841107 learned_addr learned my addr 172.21.15.148:0/2849841107 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:25:35.032 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.029+0000 7f3907fff640 1 --2- 172.21.15.148:0/2849841107 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39081035c0 0x7f39081988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:35.032 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.029+0000 7f390d781640 1 -- 172.21.15.148:0/2849841107 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39081035c0 msgr2=0x7f39081988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:35.032 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.029+0000 7f390d781640 1 --2- 172.21.15.148:0/2849841107 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39081035c0 0x7f39081988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:35.032 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.029+0000 7f390d781640 1 -- 172.21.15.148:0/2849841107 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3908102ca0 msgr2=0x7f3908198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:35.032 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.029+0000 7f390d781640 1 --2- 172.21.15.148:0/2849841107 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3908102ca0 0x7f3908198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:35.033 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.029+0000 7f390d781640 1 -- 172.21.15.148:0/2849841107 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f390819d350 con 0x7f390810c0f0 2024-09-19T07:25:35.033 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.030+0000 7f390d781640 1 --2- 172.21.15.148:0/2849841107 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f390810c0f0 0x7f390819cc20 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f390000eaa0 tx=0x7f390000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:35.033 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.030+0000 7f3905ffb640 1 -- 172.21.15.148:0/2849841107 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f390000cdb0 con 0x7f390810c0f0 2024-09-19T07:25:35.033 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.030+0000 7f3905ffb640 1 -- 172.21.15.148:0/2849841107 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3900005020 con 0x7f390810c0f0 2024-09-19T07:25:35.033 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.030+0000 7f390f1e4640 1 -- 172.21.15.148:0/2849841107 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f390819d640 con 0x7f390810c0f0 2024-09-19T07:25:35.033 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.030+0000 7f3905ffb640 1 -- 172.21.15.148:0/2849841107 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39000116b0 con 0x7f390810c0f0 2024-09-19T07:25:35.033 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.030+0000 7f390f1e4640 1 -- 172.21.15.148:0/2849841107 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39081a4ed0 con 0x7f390810c0f0 2024-09-19T07:25:35.039 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.032+0000 7f3905ffb640 1 -- 172.21.15.148:0/2849841107 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f3900005560 con 0x7f390810c0f0 2024-09-19T07:25:35.039 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.032+0000 7f3912059740 1 Processor -- start 2024-09-19T07:25:35.039 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.033+0000 7f3912059740 1 -- start start 2024-09-19T07:25:35.039 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.033+0000 7f3912059740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5565dd910af0 0x5565dd910ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:35.039 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.033+0000 7f3912059740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5565dd911410 0x5565dd91b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:35.039 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.033+0000 7f3912059740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5565dd91bcb0 0x5565dd91e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:35.039 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.033+0000 7f3912059740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5565dd8752f0 con 0x5565dd91bcb0 2024-09-19T07:25:35.040 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.033+0000 7f3912059740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5565dd81d270 con 0x5565dd911410 2024-09-19T07:25:35.040 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.033+0000 7f3912059740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5565dd8712b0 con 0x5565dd910af0 2024-09-19T07:25:35.040 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.033+0000 7f3905ffb640 1 --2- 172.21.15.148:0/2849841107 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f38f80a3460 0x7f38f80a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:35.040 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.033+0000 7f3907fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5565dd91bcb0 0x5565dd91e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:35.040 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.033+0000 7f390cf80640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5565dd911410 0x5565dd91b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:35.040 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.033+0000 7f3907fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5565dd91bcb0 0x5565dd91e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47184/0 (socket says 172.21.15.148:47184) 2024-09-19T07:25:35.040 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.033+0000 7f3907fff640 1 -- 172.21.15.148:0/1204055671 learned_addr learned my addr 172.21.15.148:0/1204055671 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:25:35.040 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.033+0000 7f3907fff640 1 --2- 172.21.15.148:0/1204055671 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5565dd910af0 0x5565dd910ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:35.040 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.033+0000 7f390d781640 1 --2- 172.21.15.148:0/2849841107 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f38f80a3460 0x7f38f80a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:35.040 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.033+0000 7f3905ffb640 1 -- 172.21.15.148:0/2849841107 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8556+0+0 (secure 0 0 0) 0x7f39000cff00 con 0x7f390810c0f0 2024-09-19T07:25:35.040 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.033+0000 7f3907fff640 1 -- 172.21.15.148:0/1204055671 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5565dd910af0 msgr2=0x5565dd910ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:35.040 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.033+0000 7f3907fff640 1 --2- 172.21.15.148:0/1204055671 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5565dd910af0 0x5565dd910ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:35.041 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.033+0000 7f3907fff640 1 -- 172.21.15.148:0/1204055671 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5565dd911410 msgr2=0x5565dd91b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:35.041 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.033+0000 7f3907fff640 1 --2- 172.21.15.148:0/1204055671 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5565dd911410 0x5565dd91b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:35.041 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.033+0000 7f3907fff640 1 -- 172.21.15.148:0/1204055671 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565dd81c340 con 0x5565dd91bcb0 2024-09-19T07:25:35.041 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.034+0000 7f3907fff640 1 --2- 172.21.15.148:0/1204055671 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5565dd91bcb0 0x5565dd91e0a0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f38f4012770 tx=0x7f38f400b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cde23864465e0b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:35.041 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.034+0000 7f390d781640 1 --2- 172.21.15.148:0/2849841107 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f38f80a3460 0x7f38f80a5920 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3900014010 tx=0x7f39000054d0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:35.041 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.034+0000 7f38f2ffd640 1 -- 172.21.15.148:0/1204055671 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f4012cf0 con 0x5565dd91bcb0 2024-09-19T07:25:35.041 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.034+0000 7f38f2ffd640 1 -- 172.21.15.148:0/1204055671 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38f4005020 con 0x5565dd91bcb0 2024-09-19T07:25:35.041 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.034+0000 7f38f2ffd640 1 -- 172.21.15.148:0/1204055671 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f4004b20 con 0x5565dd91bcb0 2024-09-19T07:25:35.041 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.034+0000 7f3912059740 1 -- 172.21.15.148:0/1204055671 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5565dd91bcb0 msgr2=0x5565dd91e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:35.041 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.034+0000 7f3912059740 1 --2- 172.21.15.148:0/1204055671 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5565dd91bcb0 0x5565dd91e0a0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f38f4012770 tx=0x7f38f400b7b0 comp rx=0 tx=0).stop 2024-09-19T07:25:35.041 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.034+0000 7f3912059740 1 -- 172.21.15.148:0/1204055671 shutdown_connections 2024-09-19T07:25:35.042 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.034+0000 7f3912059740 1 --2- 172.21.15.148:0/1204055671 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5565dd91bcb0 0x5565dd91e0a0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:35.042 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.034+0000 7f3912059740 1 --2- 172.21.15.148:0/1204055671 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5565dd911410 0x5565dd91b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:35.042 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.034+0000 7f3912059740 1 --2- 172.21.15.148:0/1204055671 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5565dd910af0 0x5565dd910ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:35.042 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.034+0000 7f3912059740 1 -- 172.21.15.148:0/1204055671 >> 172.21.15.148:0/1204055671 conn(0x5565dd90d060 msgr2=0x5565dd90d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:35.042 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.034+0000 7f3912059740 1 -- 172.21.15.148:0/1204055671 shutdown_connections 2024-09-19T07:25:35.042 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.034+0000 7f3912059740 1 -- 172.21.15.148:0/1204055671 wait complete. 2024-09-19T07:25:35.042 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.035+0000 7f3912059740 1 -- start start 2024-09-19T07:25:35.042 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.035+0000 7f3912059740 1 Processor -- start 2024-09-19T07:25:35.042 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.035+0000 7f3912059740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5565dd910af0 0x5565dd918bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:35.042 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.035+0000 7f3912059740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5565dd911410 0x5565dd919130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:35.042 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.035+0000 7f3912059740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5565dd91bcb0 0x5565dd919670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:35.043 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.035+0000 7f3912059740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5565dd91e880 con 0x5565dd91bcb0 2024-09-19T07:25:35.043 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.035+0000 7f3912059740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5565dd7fe290 con 0x5565dd911410 2024-09-19T07:25:35.043 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.035+0000 7f3912059740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5565dd91ea00 con 0x5565dd910af0 2024-09-19T07:25:35.043 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.035+0000 7f3912059740 10 client.0 _ll_register_callbacks cb 0x5565dd82f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:25:35.043 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.035+0000 7f390cf80640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5565dd911410 0x5565dd919130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:35.043 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.035+0000 7f3907fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5565dd91bcb0 0x5565dd919670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:35.043 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.035+0000 7f390cf80640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5565dd911410 0x5565dd919130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:46722/0 (socket says 172.21.15.148:46722) 2024-09-19T07:25:35.043 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.035+0000 7f390cf80640 1 -- 172.21.15.148:0/1965062187 learned_addr learned my addr 172.21.15.148:0/1965062187 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:25:35.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.035+0000 7f3907fff640 1 --2- 172.21.15.148:0/1965062187 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5565dd910af0 0x5565dd918bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:35.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.036+0000 7f390cf80640 1 -- 172.21.15.148:0/1965062187 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5565dd910af0 msgr2=0x5565dd918bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:35.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.036+0000 7f390cf80640 1 --2- 172.21.15.148:0/1965062187 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5565dd910af0 0x5565dd918bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:35.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.036+0000 7f390cf80640 1 -- 172.21.15.148:0/1965062187 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5565dd91bcb0 msgr2=0x5565dd919670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:35.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.036+0000 7f390cf80640 1 --2- 172.21.15.148:0/1965062187 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5565dd91bcb0 0x5565dd919670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:35.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.036+0000 7f390cf80640 1 -- 172.21.15.148:0/1965062187 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565dd588210 con 0x5565dd911410 2024-09-19T07:25:35.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.036+0000 7f3907fff640 1 --2- 172.21.15.148:0/1965062187 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5565dd91bcb0 0x5565dd919670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:25:35.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.036+0000 7f390cf80640 1 --2- 172.21.15.148:0/1965062187 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5565dd911410 0x5565dd919130 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f38fc02a9a0 tx=0x7f38fc0319b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc061a67794a6d11 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:35.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.036+0000 7f38e7fff640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-19T07:25:35.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.036+0000 7f38e7fff640 1 -- 172.21.15.148:0/1965062187 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38fc035040 con 0x5565dd911410 2024-09-19T07:25:35.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.036+0000 7f38e7fff640 1 -- 172.21.15.148:0/1965062187 <== mon.2 v2:172.21.15.165:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8556+0+0 (secure 0 0 0) 0x7f38fc005020 con 0x5565dd911410 2024-09-19T07:25:35.044 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.036+0000 7f3912059740 1 -- 172.21.15.148:0/1965062187 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38f4005020 con 0x5565dd911410 2024-09-19T07:25:35.045 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.036+0000 7f38e7fff640 1 -- 172.21.15.148:0/1965062187 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f38fc005220 con 0x5565dd911410 2024-09-19T07:25:35.045 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.036+0000 7f3912059740 10 client.26552 fetch_fsmap learned FSMap version 53 2024-09-19T07:25:35.045 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.036+0000 7f3912059740 1 -- 172.21.15.148:0/1965062187 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x5565dd654620 con 0x5565dd911410 2024-09-19T07:25:35.045 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.037+0000 7f38e7fff640 1 -- 172.21.15.148:0/1965062187 <== mon.2 v2:172.21.15.165:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38f4005020 con 0x5565dd911410 2024-09-19T07:25:35.045 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.037+0000 7f38e7fff640 1 -- 172.21.15.148:0/1965062187 <== mon.2 v2:172.21.15.165:3300/0 5 ==== fsmap(e 53) ==== 8362+0+0 (secure 0 0 0) 0x7f38fc0035f0 con 0x5565dd911410 2024-09-19T07:25:35.045 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.037+0000 7f3912059740 10 client.26552 fetch_fsmap finished waiting for FSMap version 53 2024-09-19T07:25:35.045 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.037+0000 7f3912059740 10 client.26552 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:25:35.045 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.037+0000 7f3912059740 20 client.26552 populate_metadata read hostname 'smithi148' 2024-09-19T07:25:35.045 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.037+0000 7f3912059740 1 --2- 172.21.15.148:0/1965062187 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5565dd92bc50 0x5565dd92e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:35.045 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.037+0000 7f3912059740 4 client.26552 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:25:35.045 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.037+0000 7f3912059740 1 -- 172.21.15.148:0/1965062187 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5565dd882a20 con 0x5565dd92bc50 2024-09-19T07:25:35.045 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.037+0000 7f3907fff640 1 --2- 172.21.15.148:0/1965062187 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5565dd92bc50 0x5565dd92e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:35.045 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.037+0000 7f3907fff640 1 --2- 172.21.15.148:0/1965062187 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5565dd92bc50 0x5565dd92e040 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffa785f51ffd31d7 server_cookie=42200d99043a83a7 in_seq=0 out_seq=0 2024-09-19T07:25:35.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.037+0000 7f38e7fff640 10 client.26552 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:25:35.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.038+0000 7f38e7fff640 1 -- 172.21.15.148:0/1965062187 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5565dd882a20 con 0x5565dd92bc50 2024-09-19T07:25:35.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.038+0000 7f38e7fff640 10 client.26552 handle_command_reply: tid=0 2024-09-19T07:25:35.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.038+0000 7f3912059740 1 client.26552 shutdown 2024-09-19T07:25:35.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.038+0000 7f3912059740 1 -- 172.21.15.148:0/1965062187 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5565dd911410 msgr2=0x5565dd919130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:35.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.038+0000 7f3912059740 1 --2- 172.21.15.148:0/1965062187 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5565dd911410 0x5565dd919130 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f38fc02a9a0 tx=0x7f38fc0319b0 comp rx=0 tx=0).stop 2024-09-19T07:25:35.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.038+0000 7f3912059740 1 -- 172.21.15.148:0/1965062187 shutdown_connections 2024-09-19T07:25:35.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.038+0000 7f3912059740 1 --2- 172.21.15.148:0/1965062187 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5565dd92bc50 0x5565dd92e040 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:35.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.038+0000 7f3912059740 1 --2- 172.21.15.148:0/1965062187 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5565dd91bcb0 0x5565dd919670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:35.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.038+0000 7f38e7fff640 0 client.26552 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:25:35.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.038+0000 7f3912059740 1 --2- 172.21.15.148:0/1965062187 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5565dd911410 0x5565dd919130 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:35.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.038+0000 7f3912059740 1 --2- 172.21.15.148:0/1965062187 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5565dd910af0 0x5565dd918bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:35.046 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.038+0000 7f3912059740 1 -- 172.21.15.148:0/1965062187 >> 172.21.15.148:0/1965062187 conn(0x5565dd90d060 msgr2=0x5565dd912d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:35.047 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.038+0000 7f3912059740 1 -- 172.21.15.148:0/1965062187 shutdown_connections 2024-09-19T07:25:35.047 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.038+0000 7f3912059740 1 -- 172.21.15.148:0/1965062187 wait complete. 2024-09-19T07:25:35.047 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.038+0000 7f3912059740 20 client.26552 trim_cache size 0 max 16384 2024-09-19T07:25:35.058 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.053+0000 7f3912059740 1 Processor -- start 2024-09-19T07:25:35.058 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.053+0000 7f3912059740 1 -- start start 2024-09-19T07:25:35.058 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.053+0000 7f3912059740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5565dd910af0 0x5565dd9194a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:35.058 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.053+0000 7f3912059740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5565dd911410 0x5565dd933910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:35.058 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.053+0000 7f3912059740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5565dd91bcb0 0x5565dd933e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:35.058 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.053+0000 7f3912059740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f39081b0150 con 0x5565dd911410 2024-09-19T07:25:35.058 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.053+0000 7f3912059740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f39081ad9c0 con 0x5565dd910af0 2024-09-19T07:25:35.058 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.053+0000 7f3912059740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f39081ab830 con 0x5565dd91bcb0 2024-09-19T07:25:35.058 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.053+0000 7f390cf80640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5565dd911410 0x5565dd933910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:35.059 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.054+0000 7f390cf80640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5565dd911410 0x5565dd933910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47200/0 (socket says 172.21.15.148:47200) 2024-09-19T07:25:35.059 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.054+0000 7f390cf80640 1 -- 172.21.15.148:0/3451718773 learned_addr learned my addr 172.21.15.148:0/3451718773 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:25:35.059 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.054+0000 7f3907fff640 1 --2- 172.21.15.148:0/3451718773 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5565dd910af0 0x5565dd9194a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:35.059 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.054+0000 7f3907fff640 1 --2- 172.21.15.148:0/3451718773 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5565dd91bcb0 0x5565dd933e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:35.059 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.054+0000 7f390cf80640 1 -- 172.21.15.148:0/3451718773 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5565dd91bcb0 msgr2=0x5565dd933e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:35.059 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.054+0000 7f390cf80640 1 --2- 172.21.15.148:0/3451718773 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5565dd91bcb0 0x5565dd933e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:35.059 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.054+0000 7f390cf80640 1 -- 172.21.15.148:0/3451718773 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5565dd910af0 msgr2=0x5565dd9194a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:35.059 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.054+0000 7f390cf80640 1 --2- 172.21.15.148:0/3451718773 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5565dd910af0 0x5565dd9194a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:35.059 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.054+0000 7f390cf80640 1 -- 172.21.15.148:0/3451718773 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565dd911240 con 0x5565dd911410 2024-09-19T07:25:35.059 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.054+0000 7f3907fff640 1 --2- 172.21.15.148:0/3451718773 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5565dd91bcb0 0x5565dd933e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:25:35.059 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.054+0000 7f390cf80640 1 --2- 172.21.15.148:0/3451718773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5565dd911410 0x5565dd933910 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f38fc009900 tx=0x7f38fc02a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99024bf8e78cc978 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:35.059 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.054+0000 7f38f27fc640 1 -- 172.21.15.148:0/3451718773 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38fc035030 con 0x5565dd911410 2024-09-19T07:25:35.059 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.054+0000 7f38f27fc640 1 -- 172.21.15.148:0/3451718773 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38fc041070 con 0x5565dd911410 2024-09-19T07:25:35.059 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.054+0000 7f38f27fc640 1 -- 172.21.15.148:0/3451718773 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38fc051070 con 0x5565dd911410 2024-09-19T07:25:35.060 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.055+0000 7f3912059740 1 -- 172.21.15.148:0/3451718773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5565dd911410 msgr2=0x5565dd933910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:35.060 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.055+0000 7f3912059740 1 --2- 172.21.15.148:0/3451718773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5565dd911410 0x5565dd933910 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f38fc009900 tx=0x7f38fc02a480 comp rx=0 tx=0).stop 2024-09-19T07:25:35.060 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.055+0000 7f3912059740 1 -- 172.21.15.148:0/3451718773 shutdown_connections 2024-09-19T07:25:35.060 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.055+0000 7f3912059740 1 --2- 172.21.15.148:0/3451718773 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5565dd91bcb0 0x5565dd933e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:35.060 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.055+0000 7f3912059740 1 --2- 172.21.15.148:0/3451718773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5565dd911410 0x5565dd933910 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:35.060 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.055+0000 7f3912059740 1 --2- 172.21.15.148:0/3451718773 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5565dd910af0 0x5565dd9194a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:35.060 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.055+0000 7f3912059740 1 -- 172.21.15.148:0/3451718773 >> 172.21.15.148:0/3451718773 conn(0x5565dd90d060 msgr2=0x5565dd91ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:35.060 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.055+0000 7f3912059740 1 -- 172.21.15.148:0/3451718773 shutdown_connections 2024-09-19T07:25:35.060 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.055+0000 7f3912059740 1 -- 172.21.15.148:0/3451718773 wait complete. 2024-09-19T07:25:35.060 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.055+0000 7f3912059740 1 -- start start 2024-09-19T07:25:35.060 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.055+0000 7f3912059740 1 Processor -- start 2024-09-19T07:25:35.060 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.055+0000 7f3912059740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5565dd910af0 0x5565dd924120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:35.061 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.055+0000 7f3912059740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5565dd911410 0x5565dd915630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:35.061 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.055+0000 7f3912059740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5565dd91bcb0 0x5565dd915b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:35.061 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.055+0000 7f3912059740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f39081abe80 con 0x5565dd910af0 2024-09-19T07:25:35.061 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.055+0000 7f3912059740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f39081ad2f0 con 0x5565dd91bcb0 2024-09-19T07:25:35.061 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.055+0000 7f3912059740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f39081ac550 con 0x5565dd911410 2024-09-19T07:25:35.061 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.055+0000 7f3912059740 10 client.0 _ll_register_callbacks cb 0x7f38fc009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:25:35.061 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.056+0000 7f3907fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5565dd910af0 0x5565dd924120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:35.061 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.056+0000 7f390cf80640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5565dd911410 0x5565dd915630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:35.061 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.056+0000 7f3907fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5565dd910af0 0x5565dd924120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47212/0 (socket says 172.21.15.148:47212) 2024-09-19T07:25:35.061 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.056+0000 7f3907fff640 1 -- 172.21.15.148:0/2717060587 learned_addr learned my addr 172.21.15.148:0/2717060587 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:25:35.061 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.056+0000 7f3907fff640 1 --2- 172.21.15.148:0/2717060587 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5565dd91bcb0 0x5565dd915b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:35.061 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.056+0000 7f3907fff640 1 -- 172.21.15.148:0/2717060587 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5565dd911410 msgr2=0x5565dd915630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:35.062 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.056+0000 7f3907fff640 1 --2- 172.21.15.148:0/2717060587 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5565dd911410 0x5565dd915630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:35.062 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.056+0000 7f3907fff640 1 -- 172.21.15.148:0/2717060587 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5565dd91bcb0 msgr2=0x5565dd915b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:35.062 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.056+0000 7f3907fff640 1 --2- 172.21.15.148:0/2717060587 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5565dd91bcb0 0x5565dd915b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:35.062 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.056+0000 7f3907fff640 1 -- 172.21.15.148:0/2717060587 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565dd9160b0 con 0x5565dd910af0 2024-09-19T07:25:35.062 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.056+0000 7f3907fff640 1 --2- 172.21.15.148:0/2717060587 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5565dd910af0 0x5565dd924120 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f38f4006010 tx=0x7f38f400b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=975c6a200b07740d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:35.062 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.056+0000 7f38e7fff640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:25:35.062 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.056+0000 7f38e7fff640 1 -- 172.21.15.148:0/2717060587 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f40053f0 con 0x5565dd910af0 2024-09-19T07:25:35.062 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.056+0000 7f38e7fff640 1 -- 172.21.15.148:0/2717060587 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8556+0+0 (secure 0 0 0) 0x7f38f4010740 con 0x5565dd910af0 2024-09-19T07:25:35.062 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.056+0000 7f3912059740 1 -- 172.21.15.148:0/2717060587 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38fc041070 con 0x5565dd910af0 2024-09-19T07:25:35.062 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.056+0000 7f38e7fff640 1 -- 172.21.15.148:0/2717060587 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f38f4010940 con 0x5565dd910af0 2024-09-19T07:25:35.062 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.056+0000 7f3912059740 10 client.17517 fetch_fsmap learned FSMap version 53 2024-09-19T07:25:35.062 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.056+0000 7f3912059740 1 -- 172.21.15.148:0/2717060587 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x5565dd996600 con 0x5565dd910af0 2024-09-19T07:25:35.063 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.057+0000 7f38e7fff640 1 -- 172.21.15.148:0/2717060587 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38fc041070 con 0x5565dd910af0 2024-09-19T07:25:35.063 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.057+0000 7f38e7fff640 1 -- 172.21.15.148:0/2717060587 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 53) ==== 8362+0+0 (secure 0 0 0) 0x7f38f4004c10 con 0x5565dd910af0 2024-09-19T07:25:35.063 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.057+0000 7f3912059740 10 client.17517 fetch_fsmap finished waiting for FSMap version 53 2024-09-19T07:25:35.063 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.057+0000 7f3912059740 10 client.17517 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:25:35.063 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.057+0000 7f3912059740 20 client.17517 populate_metadata read hostname 'smithi148' 2024-09-19T07:25:35.063 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.057+0000 7f3912059740 1 --2- 172.21.15.148:0/2717060587 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5565dd996b70 0x5565dd998f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:35.063 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.057+0000 7f3912059740 4 client.17517 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:25:35.063 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.057+0000 7f3912059740 1 -- 172.21.15.148:0/2717060587 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5565dd87cd70 con 0x5565dd996b70 2024-09-19T07:25:35.063 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.057+0000 7f390cf80640 1 --2- 172.21.15.148:0/2717060587 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5565dd996b70 0x5565dd998f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:35.063 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.057+0000 7f390cf80640 1 --2- 172.21.15.148:0/2717060587 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5565dd996b70 0x5565dd998f90 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ec148584be86d1 server_cookie=a21399b16152b39a in_seq=0 out_seq=0 2024-09-19T07:25:35.063 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.057+0000 7f38e7fff640 10 client.17517 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:25:35.069 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.068+0000 7f38e7fff640 1 -- 172.21.15.148:0/2717060587 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5565dd87cd70 con 0x5565dd996b70 2024-09-19T07:25:35.069 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.068+0000 7f38e7fff640 10 client.17517 handle_command_reply: tid=0 2024-09-19T07:25:35.069 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.068+0000 7f3912059740 1 client.17517 shutdown 2024-09-19T07:25:35.069 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.068+0000 7f3912059740 1 -- 172.21.15.148:0/2717060587 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5565dd910af0 msgr2=0x5565dd924120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:35.069 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.068+0000 7f3912059740 1 --2- 172.21.15.148:0/2717060587 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5565dd910af0 0x5565dd924120 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f38f4006010 tx=0x7f38f400b7b0 comp rx=0 tx=0).stop 2024-09-19T07:25:35.069 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.068+0000 7f3912059740 1 -- 172.21.15.148:0/2717060587 shutdown_connections 2024-09-19T07:25:35.069 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.068+0000 7f3912059740 1 --2- 172.21.15.148:0/2717060587 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5565dd996b70 0x5565dd998f90 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:35.069 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.068+0000 7f3912059740 1 --2- 172.21.15.148:0/2717060587 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5565dd91bcb0 0x5565dd915b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:35.069 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.068+0000 7f38e7fff640 0 client.17517 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:25:35.070 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.068+0000 7f3912059740 1 --2- 172.21.15.148:0/2717060587 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5565dd911410 0x5565dd915630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:35.070 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.068+0000 7f3912059740 1 --2- 172.21.15.148:0/2717060587 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5565dd910af0 0x5565dd924120 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:35.070 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.068+0000 7f3912059740 1 -- 172.21.15.148:0/2717060587 >> 172.21.15.148:0/2717060587 conn(0x5565dd90d060 msgr2=0x5565dd91ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:35.070 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.068+0000 7f3912059740 1 -- 172.21.15.148:0/2717060587 shutdown_connections 2024-09-19T07:25:35.070 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.068+0000 7f3912059740 1 -- 172.21.15.148:0/2717060587 wait complete. 2024-09-19T07:25:35.070 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.068+0000 7f3912059740 20 client.17517 trim_cache size 0 max 16384 2024-09-19T07:25:35.070 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:25:35.070 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:25:35.070 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:25:35.070 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:25:35.071 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.069+0000 7f390f1e4640 1 -- 172.21.15.148:0/2849841107 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f38f80a3460 msgr2=0x7f38f80a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:35.071 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.069+0000 7f390f1e4640 1 --2- 172.21.15.148:0/2849841107 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f38f80a3460 0x7f38f80a5920 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3900014010 tx=0x7f39000054d0 comp rx=0 tx=0).stop 2024-09-19T07:25:35.071 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.069+0000 7f390f1e4640 1 -- 172.21.15.148:0/2849841107 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f390810c0f0 msgr2=0x7f390819cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:35.072 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.069+0000 7f390f1e4640 1 --2- 172.21.15.148:0/2849841107 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f390810c0f0 0x7f390819cc20 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f390000eaa0 tx=0x7f390000ef60 comp rx=0 tx=0).stop 2024-09-19T07:25:35.072 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.069+0000 7f390f1e4640 1 -- 172.21.15.148:0/2849841107 shutdown_connections 2024-09-19T07:25:35.072 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.069+0000 7f390f1e4640 1 --2- 172.21.15.148:0/2849841107 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f38f80a3460 0x7f38f80a5920 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:35.072 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.069+0000 7f390f1e4640 1 --2- 172.21.15.148:0/2849841107 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f390810c0f0 0x7f390819cc20 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:35.072 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.069+0000 7f390f1e4640 1 --2- 172.21.15.148:0/2849841107 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39081035c0 0x7f39081988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:35.072 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.069+0000 7f390f1e4640 1 --2- 172.21.15.148:0/2849841107 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3908102ca0 0x7f3908198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:35.072 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.069+0000 7f390f1e4640 1 -- 172.21.15.148:0/2849841107 >> 172.21.15.148:0/2849841107 conn(0x7f39080fc690 msgr2=0x7f39080fd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:35.072 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.069+0000 7f390f1e4640 1 -- 172.21.15.148:0/2849841107 shutdown_connections 2024-09-19T07:25:35.072 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:35.069+0000 7f390f1e4640 1 -- 172.21.15.148:0/2849841107 wait complete. 2024-09-19T07:25:35.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:25:34 smithi148 ceph-mon[31180]: pgmap v455: 97 pgs: 97 active+clean; 1.8 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.5 MiB/s wr, 397 op/s 2024-09-19T07:25:35.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:25:34 smithi165 ceph-mon[35326]: pgmap v455: 97 pgs: 97 active+clean; 1.8 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.5 MiB/s wr, 397 op/s 2024-09-19T07:25:37.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:25:36 smithi179 ceph-mon[35716]: pgmap v456: 97 pgs: 97 active+clean; 1.8 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 4.8 MiB/s wr, 485 op/s 2024-09-19T07:25:37.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:25:36 smithi148 ceph-mon[31180]: pgmap v456: 97 pgs: 97 active+clean; 1.8 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 4.8 MiB/s wr, 485 op/s 2024-09-19T07:25:37.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:25:36 smithi165 ceph-mon[35326]: pgmap v456: 97 pgs: 97 active+clean; 1.8 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 4.8 MiB/s wr, 485 op/s 2024-09-19T07:25:39.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:25:38 smithi179 ceph-mon[35716]: pgmap v457: 97 pgs: 97 active+clean; 1.8 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 319 op/s 2024-09-19T07:25:39.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:25:38 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:25:39.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:25:38 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:25:39.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:25:38 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:25:39.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:25:38 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:25:39.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:25:38 smithi148 ceph-mon[31180]: pgmap v457: 97 pgs: 97 active+clean; 1.8 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 319 op/s 2024-09-19T07:25:39.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:25:38 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:25:39.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:25:38 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:25:39.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:25:38 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:25:39.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:25:38 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:25:39.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:25:38 smithi165 ceph-mon[35326]: pgmap v457: 97 pgs: 97 active+clean; 1.8 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 319 op/s 2024-09-19T07:25:39.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:25:38 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:25:39.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:25:38 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:25:39.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:25:38 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:25:39.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:25:38 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:25:41.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:25:40 smithi179 ceph-mon[35716]: pgmap v458: 97 pgs: 97 active+clean; 1.8 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.0 MiB/s wr, 356 op/s 2024-09-19T07:25:41.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:25:40 smithi148 ceph-mon[31180]: pgmap v458: 97 pgs: 97 active+clean; 1.8 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.0 MiB/s wr, 356 op/s 2024-09-19T07:25:41.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:25:40 smithi165 ceph-mon[35326]: pgmap v458: 97 pgs: 97 active+clean; 1.8 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.0 MiB/s wr, 356 op/s 2024-09-19T07:25:43.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:25:42 smithi179 ceph-mon[35716]: pgmap v459: 97 pgs: 97 active+clean; 1.8 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.2 MiB/s wr, 418 op/s 2024-09-19T07:25:43.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:25:42 smithi148 ceph-mon[31180]: pgmap v459: 97 pgs: 97 active+clean; 1.8 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.2 MiB/s wr, 418 op/s 2024-09-19T07:25:43.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:25:42 smithi165 ceph-mon[35326]: pgmap v459: 97 pgs: 97 active+clean; 1.8 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.2 MiB/s wr, 418 op/s 2024-09-19T07:25:45.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:25:44 smithi179 ceph-mon[35716]: pgmap v460: 97 pgs: 97 active+clean; 1.8 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 341 op/s 2024-09-19T07:25:45.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:25:44 smithi148 ceph-mon[31180]: pgmap v460: 97 pgs: 97 active+clean; 1.8 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 341 op/s 2024-09-19T07:25:45.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:25:44 smithi165 ceph-mon[35326]: pgmap v460: 97 pgs: 97 active+clean; 1.8 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 341 op/s 2024-09-19T07:25:47.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:25:46 smithi179 ceph-mon[35716]: pgmap v461: 97 pgs: 97 active+clean; 1.8 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.5 MiB/s wr, 428 op/s 2024-09-19T07:25:47.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:25:46 smithi148 ceph-mon[31180]: pgmap v461: 97 pgs: 97 active+clean; 1.8 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.5 MiB/s wr, 428 op/s 2024-09-19T07:25:47.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:25:46 smithi165 ceph-mon[35326]: pgmap v461: 97 pgs: 97 active+clean; 1.8 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.5 MiB/s wr, 428 op/s 2024-09-19T07:25:48.161 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.158+0000 7fd9531cf640 1 -- 172.21.15.148:0/638642571 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd94c1009c0 msgr2=0x7fd94c100e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:48.161 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.158+0000 7fd9531cf640 1 --2- 172.21.15.148:0/638642571 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd94c1009c0 0x7fd94c100e20 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fd938009930 tx=0x7fd93802a420 comp rx=0 tx=0).stop 2024-09-19T07:25:48.161 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.158+0000 7fd9531cf640 1 -- 172.21.15.148:0/638642571 shutdown_connections 2024-09-19T07:25:48.161 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.158+0000 7fd9531cf640 1 --2- 172.21.15.148:0/638642571 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd94c101360 0x7fd94c10d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.161 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.158+0000 7fd9531cf640 1 --2- 172.21.15.148:0/638642571 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd94c1009c0 0x7fd94c100e20 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.161 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.158+0000 7fd9531cf640 1 --2- 172.21.15.148:0/638642571 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd94c1069d0 0x7fd94c106db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.161 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.158+0000 7fd9531cf640 1 -- 172.21.15.148:0/638642571 >> 172.21.15.148:0/638642571 conn(0x7fd94c0fc700 msgr2=0x7fd94c0feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:48.162 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.158+0000 7fd9531cf640 1 -- 172.21.15.148:0/638642571 shutdown_connections 2024-09-19T07:25:48.162 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.158+0000 7fd9531cf640 1 -- 172.21.15.148:0/638642571 wait complete. 2024-09-19T07:25:48.162 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.159+0000 7fd9531cf640 1 Processor -- start 2024-09-19T07:25:48.162 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.159+0000 7fd9531cf640 1 -- start start 2024-09-19T07:25:48.162 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.159+0000 7fd9531cf640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd94c1009c0 0x7fd94c198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:48.162 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.159+0000 7fd9531cf640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd94c101360 0x7fd94c1988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:48.162 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.159+0000 7fd9531cf640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd94c1069d0 0x7fd94c19cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:48.162 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.159+0000 7fd9531cf640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd94c110e10 con 0x7fd94c101360 2024-09-19T07:25:48.162 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.159+0000 7fd9531cf640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd94c110c90 con 0x7fd94c1069d0 2024-09-19T07:25:48.162 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.159+0000 7fd9531cf640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd94c110f90 con 0x7fd94c1009c0 2024-09-19T07:25:48.162 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.159+0000 7fd94bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd94c101360 0x7fd94c1988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:48.162 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.159+0000 7fd94bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd94c101360 0x7fd94c1988b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40796/0 (socket says 172.21.15.148:40796) 2024-09-19T07:25:48.162 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.159+0000 7fd950f6b640 1 --2- 172.21.15.148:0/154331408 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd94c1009c0 0x7fd94c198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:48.163 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.159+0000 7fd94bfff640 1 -- 172.21.15.148:0/154331408 learned_addr learned my addr 172.21.15.148:0/154331408 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:25:48.163 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.160+0000 7fd95176c640 1 --2- 172.21.15.148:0/154331408 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd94c1069d0 0x7fd94c19cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:48.163 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.160+0000 7fd94bfff640 1 -- 172.21.15.148:0/154331408 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd94c1009c0 msgr2=0x7fd94c198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:48.163 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.160+0000 7fd94bfff640 1 --2- 172.21.15.148:0/154331408 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd94c1009c0 0x7fd94c198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.163 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.160+0000 7fd94bfff640 1 -- 172.21.15.148:0/154331408 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd94c1069d0 msgr2=0x7fd94c19cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:48.163 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.160+0000 7fd94bfff640 1 --2- 172.21.15.148:0/154331408 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd94c1069d0 0x7fd94c19cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.163 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.160+0000 7fd94bfff640 1 -- 172.21.15.148:0/154331408 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd94c19d360 con 0x7fd94c101360 2024-09-19T07:25:48.163 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.160+0000 7fd94bfff640 1 --2- 172.21.15.148:0/154331408 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd94c101360 0x7fd94c1988b0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fd938009230 tx=0x7fd938004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:48.163 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.160+0000 7fd949ffb640 1 -- 172.21.15.148:0/154331408 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93803f030 con 0x7fd94c101360 2024-09-19T07:25:48.163 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.160+0000 7fd949ffb640 1 -- 172.21.15.148:0/154331408 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd938004440 con 0x7fd94c101360 2024-09-19T07:25:48.163 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.160+0000 7fd9531cf640 1 -- 172.21.15.148:0/154331408 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd94c19d5f0 con 0x7fd94c101360 2024-09-19T07:25:48.163 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.160+0000 7fd949ffb640 1 -- 172.21.15.148:0/154331408 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd938035070 con 0x7fd94c101360 2024-09-19T07:25:48.163 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.160+0000 7fd9531cf640 1 -- 172.21.15.148:0/154331408 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd94c1a4ee0 con 0x7fd94c101360 2024-09-19T07:25:48.170 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.162+0000 7fd949ffb640 1 -- 172.21.15.148:0/154331408 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fd938042030 con 0x7fd94c101360 2024-09-19T07:25:48.170 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.163+0000 7fd956045740 1 Processor -- start 2024-09-19T07:25:48.170 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.163+0000 7fd949ffb640 1 --2- 172.21.15.148:0/154331408 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fd93c0a34e0 0x7fd93c0a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:48.170 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.163+0000 7fd956045740 1 -- start start 2024-09-19T07:25:48.170 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.163+0000 7fd950f6b640 1 --2- 172.21.15.148:0/154331408 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fd93c0a34e0 0x7fd93c0a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:48.170 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.163+0000 7fd949ffb640 1 -- 172.21.15.148:0/154331408 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8556+0+0 (secure 0 0 0) 0x7fd9380eff80 con 0x7fd94c101360 2024-09-19T07:25:48.170 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.163+0000 7fd956045740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56255c0a8af0 0x56255c0a8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:48.170 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.163+0000 7fd956045740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56255c0a9410 0x56255c0b3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:48.170 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.163+0000 7fd956045740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56255c0b3cb0 0x56255c0b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:48.170 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.163+0000 7fd956045740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56255c00d2f0 con 0x56255c0a9410 2024-09-19T07:25:48.171 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.163+0000 7fd956045740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56255bfb5270 con 0x56255c0b3cb0 2024-09-19T07:25:48.171 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.164+0000 7fd956045740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56255c0092b0 con 0x56255c0a8af0 2024-09-19T07:25:48.171 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.164+0000 7fd94bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56255c0a9410 0x56255c0b3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:48.171 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.164+0000 7fd950f6b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56255c0a8af0 0x56255c0a8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:48.171 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.164+0000 7fd94bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56255c0a9410 0x56255c0b3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40798/0 (socket says 172.21.15.148:40798) 2024-09-19T07:25:48.171 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.164+0000 7fd94bfff640 1 -- 172.21.15.148:0/3327030015 learned_addr learned my addr 172.21.15.148:0/3327030015 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:25:48.171 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.164+0000 7fd95176c640 1 --2- 172.21.15.148:0/3327030015 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56255c0b3cb0 0x56255c0b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:48.171 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.164+0000 7fd950f6b640 1 --2- 172.21.15.148:0/154331408 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fd93c0a34e0 0x7fd93c0a59a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd940011440 tx=0x7fd940011840 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:48.171 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.164+0000 7fd94bfff640 1 -- 172.21.15.148:0/3327030015 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56255c0a8af0 msgr2=0x56255c0a8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:48.171 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.164+0000 7fd94bfff640 1 --2- 172.21.15.148:0/3327030015 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56255c0a8af0 0x56255c0a8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.171 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.164+0000 7fd94bfff640 1 -- 172.21.15.148:0/3327030015 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56255c0b3cb0 msgr2=0x56255c0b60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.164+0000 7fd94bfff640 1 --2- 172.21.15.148:0/3327030015 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56255c0b3cb0 0x56255c0b60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.164+0000 7fd94bfff640 1 -- 172.21.15.148:0/3327030015 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56255bfb4340 con 0x56255c0a9410 2024-09-19T07:25:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.164+0000 7fd95176c640 1 --2- 172.21.15.148:0/3327030015 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56255c0b3cb0 0x56255c0b60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:25:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.164+0000 7fd94bfff640 1 --2- 172.21.15.148:0/3327030015 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56255c0a9410 0x56255c0b3770 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fd9380c4980 tx=0x7fd9380bbef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=696778f3eacf86e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.164+0000 7fd936ffd640 1 -- 172.21.15.148:0/3327030015 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd938049040 con 0x56255c0a9410 2024-09-19T07:25:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.164+0000 7fd936ffd640 1 -- 172.21.15.148:0/3327030015 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9380c4eb0 con 0x56255c0a9410 2024-09-19T07:25:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.164+0000 7fd936ffd640 1 -- 172.21.15.148:0/3327030015 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9380dc0c0 con 0x56255c0a9410 2024-09-19T07:25:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.165+0000 7fd956045740 1 -- 172.21.15.148:0/3327030015 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56255c0a9410 msgr2=0x56255c0b3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.165+0000 7fd956045740 1 --2- 172.21.15.148:0/3327030015 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56255c0a9410 0x56255c0b3770 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fd9380c4980 tx=0x7fd9380bbef0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.165+0000 7fd956045740 1 -- 172.21.15.148:0/3327030015 shutdown_connections 2024-09-19T07:25:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.165+0000 7fd956045740 1 --2- 172.21.15.148:0/3327030015 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56255c0b3cb0 0x56255c0b60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.165+0000 7fd956045740 1 --2- 172.21.15.148:0/3327030015 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56255c0a9410 0x56255c0b3770 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.165+0000 7fd956045740 1 --2- 172.21.15.148:0/3327030015 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56255c0a8af0 0x56255c0a8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.165+0000 7fd956045740 1 -- 172.21.15.148:0/3327030015 >> 172.21.15.148:0/3327030015 conn(0x56255c0a5060 msgr2=0x56255c0a5440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.165+0000 7fd956045740 1 -- 172.21.15.148:0/3327030015 shutdown_connections 2024-09-19T07:25:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.165+0000 7fd956045740 1 -- 172.21.15.148:0/3327030015 wait complete. 2024-09-19T07:25:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.166+0000 7fd956045740 1 -- start start 2024-09-19T07:25:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.166+0000 7fd956045740 1 Processor -- start 2024-09-19T07:25:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.166+0000 7fd956045740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56255c0a8af0 0x56255c0b0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.166+0000 7fd956045740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56255c0a9410 0x56255c0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.166+0000 7fd956045740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56255c0b3cb0 0x56255c0b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.166+0000 7fd956045740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56255c00d2f0 con 0x56255c0a9410 2024-09-19T07:25:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.166+0000 7fd956045740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56255bf96290 con 0x56255c0a8af0 2024-09-19T07:25:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.166+0000 7fd956045740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56255c0b6640 con 0x56255c0b3cb0 2024-09-19T07:25:48.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.166+0000 7fd956045740 10 client.0 _ll_register_callbacks cb 0x56255bfc7140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:25:48.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.166+0000 7fd94bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56255c0a9410 0x56255c0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:48.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.166+0000 7fd950f6b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56255c0a8af0 0x56255c0b0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:48.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.166+0000 7fd94bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56255c0a9410 0x56255c0b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40804/0 (socket says 172.21.15.148:40804) 2024-09-19T07:25:48.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.166+0000 7fd95176c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56255c0b3cb0 0x56255c0b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:48.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.166+0000 7fd94bfff640 1 -- 172.21.15.148:0/316504686 learned_addr learned my addr 172.21.15.148:0/316504686 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:25:48.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.167+0000 7fd94bfff640 1 -- 172.21.15.148:0/316504686 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56255c0b3cb0 msgr2=0x56255c0b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:48.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.167+0000 7fd94bfff640 1 --2- 172.21.15.148:0/316504686 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56255c0b3cb0 0x56255c0b1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.167+0000 7fd94bfff640 1 -- 172.21.15.148:0/316504686 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56255c0a8af0 msgr2=0x56255c0b0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:48.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.167+0000 7fd94bfff640 1 --2- 172.21.15.148:0/316504686 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56255c0a8af0 0x56255c0b0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.167+0000 7fd94bfff640 1 -- 172.21.15.148:0/316504686 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56255bd20210 con 0x56255c0a9410 2024-09-19T07:25:48.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.167+0000 7fd950f6b640 1 --2- 172.21.15.148:0/316504686 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56255c0a8af0 0x56255c0b0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:25:48.174 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.167+0000 7fd95176c640 1 --2- 172.21.15.148:0/316504686 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56255c0b3cb0 0x56255c0b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:25:48.175 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.167+0000 7fd94bfff640 1 --2- 172.21.15.148:0/316504686 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56255c0a9410 0x56255c0b1130 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fd9380edcb0 tx=0x7fd938003f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ada98229f0a4051 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:48.175 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.167+0000 7fd92bfff640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:25:48.175 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.167+0000 7fd92bfff640 1 -- 172.21.15.148:0/316504686 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9380d9020 con 0x56255c0a9410 2024-09-19T07:25:48.175 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.167+0000 7fd92bfff640 1 -- 172.21.15.148:0/316504686 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8556+0+0 (secure 0 0 0) 0x7fd9380ba5f0 con 0x56255c0a9410 2024-09-19T07:25:48.175 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.167+0000 7fd956045740 1 -- 172.21.15.148:0/316504686 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9380c4eb0 con 0x56255c0a9410 2024-09-19T07:25:48.175 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.167+0000 7fd92bfff640 1 -- 172.21.15.148:0/316504686 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7fd938049070 con 0x56255c0a9410 2024-09-19T07:25:48.175 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.167+0000 7fd956045740 10 client.17529 fetch_fsmap learned FSMap version 53 2024-09-19T07:25:48.175 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.167+0000 7fd956045740 1 -- 172.21.15.148:0/316504686 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x56255bdec620 con 0x56255c0a9410 2024-09-19T07:25:48.175 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.167+0000 7fd92bfff640 1 -- 172.21.15.148:0/316504686 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9380c4eb0 con 0x56255c0a9410 2024-09-19T07:25:48.175 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.168+0000 7fd92bfff640 1 -- 172.21.15.148:0/316504686 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 53) ==== 8362+0+0 (secure 0 0 0) 0x7fd9380a5100 con 0x56255c0a9410 2024-09-19T07:25:48.175 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.168+0000 7fd956045740 10 client.17529 fetch_fsmap finished waiting for FSMap version 53 2024-09-19T07:25:48.175 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.168+0000 7fd956045740 10 client.17529 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:25:48.176 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.168+0000 7fd956045740 20 client.17529 populate_metadata read hostname 'smithi148' 2024-09-19T07:25:48.176 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.168+0000 7fd956045740 1 --2- 172.21.15.148:0/316504686 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56255c0c37c0 0x56255c0c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:48.176 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.168+0000 7fd956045740 4 client.17529 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:25:48.176 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.168+0000 7fd956045740 1 -- 172.21.15.148:0/316504686 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56255c01aa20 con 0x56255c0c37c0 2024-09-19T07:25:48.176 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.168+0000 7fd950f6b640 1 --2- 172.21.15.148:0/316504686 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56255c0c37c0 0x56255c0c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:48.176 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.168+0000 7fd92bfff640 10 client.17529 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:25:48.176 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.168+0000 7fd950f6b640 1 --2- 172.21.15.148:0/316504686 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56255c0c37c0 0x56255c0c5bb0 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28e1bc5f54a5bdc server_cookie=c8bd2c925480f699 in_seq=0 out_seq=0 2024-09-19T07:25:48.176 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.169+0000 7fd92bfff640 1 -- 172.21.15.148:0/316504686 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56255c01aa20 con 0x56255c0c37c0 2024-09-19T07:25:48.176 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.169+0000 7fd92bfff640 10 client.17529 handle_command_reply: tid=0 2024-09-19T07:25:48.176 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.169+0000 7fd956045740 1 client.17529 shutdown 2024-09-19T07:25:48.176 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.169+0000 7fd956045740 1 -- 172.21.15.148:0/316504686 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56255c0a9410 msgr2=0x56255c0b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:48.176 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.169+0000 7fd956045740 1 --2- 172.21.15.148:0/316504686 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56255c0a9410 0x56255c0b1130 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fd9380edcb0 tx=0x7fd938003f50 comp rx=0 tx=0).stop 2024-09-19T07:25:48.176 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.169+0000 7fd956045740 1 -- 172.21.15.148:0/316504686 shutdown_connections 2024-09-19T07:25:48.177 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.169+0000 7fd956045740 1 --2- 172.21.15.148:0/316504686 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56255c0c37c0 0x56255c0c5bb0 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.177 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.169+0000 7fd956045740 1 --2- 172.21.15.148:0/316504686 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56255c0b3cb0 0x56255c0b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.177 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.169+0000 7fd956045740 1 --2- 172.21.15.148:0/316504686 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56255c0a9410 0x56255c0b1130 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.177 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.169+0000 7fd956045740 1 --2- 172.21.15.148:0/316504686 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56255c0a8af0 0x56255c0b0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.177 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.169+0000 7fd92bfff640 0 client.17529 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:25:48.177 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.169+0000 7fd956045740 1 -- 172.21.15.148:0/316504686 >> 172.21.15.148:0/316504686 conn(0x56255c0a5060 msgr2=0x56255c0aad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:48.177 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.169+0000 7fd956045740 1 -- 172.21.15.148:0/316504686 shutdown_connections 2024-09-19T07:25:48.177 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.169+0000 7fd956045740 1 -- 172.21.15.148:0/316504686 wait complete. 2024-09-19T07:25:48.177 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.169+0000 7fd956045740 20 client.17529 trim_cache size 0 max 16384 2024-09-19T07:25:48.187 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.185+0000 7fd956045740 1 Processor -- start 2024-09-19T07:25:48.187 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.185+0000 7fd956045740 1 -- start start 2024-09-19T07:25:48.187 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.185+0000 7fd956045740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56255c0a8af0 0x56255c0b14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:48.187 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.185+0000 7fd956045740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56255c0a9410 0x56255c0cb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:48.187 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.185+0000 7fd956045740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56255c0b3cb0 0x56255c0cb950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:48.187 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.185+0000 7fd956045740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd94c1adef0 con 0x56255c0a9410 2024-09-19T07:25:48.187 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.185+0000 7fd956045740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd94c1ab760 con 0x56255c0a8af0 2024-09-19T07:25:48.187 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.185+0000 7fd956045740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd94c1a95d0 con 0x56255c0b3cb0 2024-09-19T07:25:48.187 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.186+0000 7fd94bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56255c0a9410 0x56255c0cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:48.188 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.186+0000 7fd94bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56255c0a9410 0x56255c0cb410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40820/0 (socket says 172.21.15.148:40820) 2024-09-19T07:25:48.188 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.186+0000 7fd94bfff640 1 -- 172.21.15.148:0/3094137230 learned_addr learned my addr 172.21.15.148:0/3094137230 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:25:48.188 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.186+0000 7fd950f6b640 1 --2- 172.21.15.148:0/3094137230 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56255c0a8af0 0x56255c0b14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:48.188 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.186+0000 7fd95176c640 1 --2- 172.21.15.148:0/3094137230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56255c0b3cb0 0x56255c0cb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:48.188 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.186+0000 7fd94bfff640 1 -- 172.21.15.148:0/3094137230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56255c0b3cb0 msgr2=0x56255c0cb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:48.188 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.186+0000 7fd94bfff640 1 --2- 172.21.15.148:0/3094137230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56255c0b3cb0 0x56255c0cb950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.188 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.186+0000 7fd94bfff640 1 -- 172.21.15.148:0/3094137230 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56255c0a8af0 msgr2=0x56255c0b14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:48.188 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.186+0000 7fd94bfff640 1 --2- 172.21.15.148:0/3094137230 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56255c0a8af0 0x56255c0b14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.188 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.186+0000 7fd94bfff640 1 -- 172.21.15.148:0/3094137230 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56255c0a9240 con 0x56255c0a9410 2024-09-19T07:25:48.188 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.186+0000 7fd94bfff640 1 --2- 172.21.15.148:0/3094137230 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56255c0a9410 0x56255c0cb410 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fd938009900 tx=0x7fd9380c0770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e77f3161011dd72 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:48.188 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.186+0000 7fd9367fc640 1 -- 172.21.15.148:0/3094137230 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9380d9070 con 0x56255c0a9410 2024-09-19T07:25:48.188 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.186+0000 7fd9367fc640 1 -- 172.21.15.148:0/3094137230 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9380c4eb0 con 0x56255c0a9410 2024-09-19T07:25:48.188 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.186+0000 7fd9367fc640 1 -- 172.21.15.148:0/3094137230 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9380ed930 con 0x56255c0a9410 2024-09-19T07:25:48.192 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.187+0000 7fd956045740 1 -- 172.21.15.148:0/3094137230 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56255c0a9410 msgr2=0x56255c0cb410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:48.192 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.187+0000 7fd956045740 1 --2- 172.21.15.148:0/3094137230 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56255c0a9410 0x56255c0cb410 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fd938009900 tx=0x7fd9380c0770 comp rx=0 tx=0).stop 2024-09-19T07:25:48.192 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.187+0000 7fd956045740 1 -- 172.21.15.148:0/3094137230 shutdown_connections 2024-09-19T07:25:48.192 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.187+0000 7fd956045740 1 --2- 172.21.15.148:0/3094137230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56255c0b3cb0 0x56255c0cb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.192 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.187+0000 7fd956045740 1 --2- 172.21.15.148:0/3094137230 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56255c0a9410 0x56255c0cb410 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.192 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.187+0000 7fd956045740 1 --2- 172.21.15.148:0/3094137230 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56255c0a8af0 0x56255c0b14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.192 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.187+0000 7fd956045740 1 -- 172.21.15.148:0/3094137230 >> 172.21.15.148:0/3094137230 conn(0x56255c0a5060 msgr2=0x56255c0b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:48.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.187+0000 7fd956045740 1 -- 172.21.15.148:0/3094137230 shutdown_connections 2024-09-19T07:25:48.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.187+0000 7fd956045740 1 -- 172.21.15.148:0/3094137230 wait complete. 2024-09-19T07:25:48.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.187+0000 7fd956045740 1 -- start start 2024-09-19T07:25:48.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.187+0000 7fd956045740 1 Processor -- start 2024-09-19T07:25:48.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.188+0000 7fd956045740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56255c0a8af0 0x56255c0bbc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:48.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.188+0000 7fd956045740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56255c0a9410 0x56255c0bc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:48.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.188+0000 7fd956045740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56255c0b3cb0 0x56255c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:48.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.188+0000 7fd956045740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd94c1a9c20 con 0x56255c0a8af0 2024-09-19T07:25:48.193 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.188+0000 7fd956045740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd94c1ab090 con 0x56255c0a9410 2024-09-19T07:25:48.194 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.188+0000 7fd956045740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd94c1aa2f0 con 0x56255c0b3cb0 2024-09-19T07:25:48.194 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.188+0000 7fd956045740 10 client.0 _ll_register_callbacks cb 0x7fd944009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:25:48.194 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.188+0000 7fd950f6b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56255c0a8af0 0x56255c0bbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:48.194 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.188+0000 7fd950f6b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56255c0a8af0 0x56255c0bbc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40836/0 (socket says 172.21.15.148:40836) 2024-09-19T07:25:48.194 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.188+0000 7fd950f6b640 1 -- 172.21.15.148:0/3317765720 learned_addr learned my addr 172.21.15.148:0/3317765720 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:25:48.194 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.188+0000 7fd94bfff640 1 --2- 172.21.15.148:0/3317765720 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56255c0a9410 0x56255c0bc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:48.194 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.188+0000 7fd95176c640 1 --2- 172.21.15.148:0/3317765720 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56255c0b3cb0 0x56255c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:48.194 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.188+0000 7fd950f6b640 1 -- 172.21.15.148:0/3317765720 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56255c0b3cb0 msgr2=0x56255c0b71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:48.194 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.188+0000 7fd950f6b640 1 --2- 172.21.15.148:0/3317765720 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56255c0b3cb0 0x56255c0b71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.194 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.188+0000 7fd950f6b640 1 -- 172.21.15.148:0/3317765720 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56255c0a9410 msgr2=0x56255c0bc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:48.194 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.188+0000 7fd950f6b640 1 --2- 172.21.15.148:0/3317765720 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56255c0a9410 0x56255c0bc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.194 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.188+0000 7fd950f6b640 1 -- 172.21.15.148:0/3317765720 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56255c0b79e0 con 0x56255c0a8af0 2024-09-19T07:25:48.194 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.188+0000 7fd95176c640 1 --2- 172.21.15.148:0/3317765720 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56255c0b3cb0 0x56255c0b71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:25:48.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.188+0000 7fd950f6b640 1 --2- 172.21.15.148:0/3317765720 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56255c0a8af0 0x56255c0bbc60 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fd940009d60 tx=0x7fd940004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4f8f43014eddc49 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:48.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.188+0000 7fd92bfff640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:25:48.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.189+0000 7fd92bfff640 1 -- 172.21.15.148:0/3317765720 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd94001a040 con 0x56255c0a8af0 2024-09-19T07:25:48.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.189+0000 7fd92bfff640 1 -- 172.21.15.148:0/3317765720 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8556+0+0 (secure 0 0 0) 0x7fd940009050 con 0x56255c0a8af0 2024-09-19T07:25:48.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.189+0000 7fd956045740 1 -- 172.21.15.148:0/3317765720 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9380c4eb0 con 0x56255c0a8af0 2024-09-19T07:25:48.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.189+0000 7fd92bfff640 1 -- 172.21.15.148:0/3317765720 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7fd94000fe10 con 0x56255c0a8af0 2024-09-19T07:25:48.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.189+0000 7fd956045740 10 client.17535 fetch_fsmap learned FSMap version 53 2024-09-19T07:25:48.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.189+0000 7fd956045740 1 -- 172.21.15.148:0/3317765720 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x56255c12e0e0 con 0x56255c0a8af0 2024-09-19T07:25:48.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.189+0000 7fd92bfff640 1 -- 172.21.15.148:0/3317765720 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9380c4eb0 con 0x56255c0a8af0 2024-09-19T07:25:48.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.189+0000 7fd92bfff640 1 -- 172.21.15.148:0/3317765720 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 53) ==== 8362+0+0 (secure 0 0 0) 0x7fd94001d030 con 0x56255c0a8af0 2024-09-19T07:25:48.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.189+0000 7fd956045740 10 client.17535 fetch_fsmap finished waiting for FSMap version 53 2024-09-19T07:25:48.195 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.189+0000 7fd956045740 10 client.17535 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:25:48.196 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.189+0000 7fd956045740 20 client.17535 populate_metadata read hostname 'smithi148' 2024-09-19T07:25:48.196 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.189+0000 7fd956045740 1 --2- 172.21.15.148:0/3317765720 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56255c12e7e0 0x56255c130c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:48.196 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.189+0000 7fd956045740 4 client.17535 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:25:48.196 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.189+0000 7fd956045740 1 -- 172.21.15.148:0/3317765720 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56255c014d70 con 0x56255c12e7e0 2024-09-19T07:25:48.196 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.189+0000 7fd94bfff640 1 --2- 172.21.15.148:0/3317765720 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56255c12e7e0 0x56255c130c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:48.196 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.190+0000 7fd94bfff640 1 --2- 172.21.15.148:0/3317765720 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56255c12e7e0 0x56255c130c00 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d676cba4c88fb92c server_cookie=d9ef2ef2e42d5b47 in_seq=0 out_seq=0 2024-09-19T07:25:48.196 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.190+0000 7fd92bfff640 10 client.17535 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:25:48.201 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.199+0000 7fd92bfff640 1 -- 172.21.15.148:0/3317765720 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56255c014d70 con 0x56255c12e7e0 2024-09-19T07:25:48.201 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.200+0000 7fd92bfff640 10 client.17535 handle_command_reply: tid=0 2024-09-19T07:25:48.201 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.200+0000 7fd956045740 1 client.17535 shutdown 2024-09-19T07:25:48.201 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.200+0000 7fd956045740 1 -- 172.21.15.148:0/3317765720 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56255c0a8af0 msgr2=0x56255c0bbc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:48.201 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.200+0000 7fd956045740 1 --2- 172.21.15.148:0/3317765720 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56255c0a8af0 0x56255c0bbc60 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fd940009d60 tx=0x7fd940004730 comp rx=0 tx=0).stop 2024-09-19T07:25:48.201 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.200+0000 7fd956045740 1 -- 172.21.15.148:0/3317765720 shutdown_connections 2024-09-19T07:25:48.201 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.200+0000 7fd956045740 1 --2- 172.21.15.148:0/3317765720 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56255c12e7e0 0x56255c130c00 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.201 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.200+0000 7fd956045740 1 --2- 172.21.15.148:0/3317765720 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56255c0b3cb0 0x56255c0b71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.201 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.200+0000 7fd956045740 1 --2- 172.21.15.148:0/3317765720 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56255c0a9410 0x56255c0bc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.201 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.200+0000 7fd92bfff640 0 client.17535 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:25:48.201 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.200+0000 7fd956045740 1 --2- 172.21.15.148:0/3317765720 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56255c0a8af0 0x56255c0bbc60 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.201 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.200+0000 7fd956045740 1 -- 172.21.15.148:0/3317765720 >> 172.21.15.148:0/3317765720 conn(0x56255c0a5060 msgr2=0x56255c0aa4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:48.202 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.200+0000 7fd956045740 1 -- 172.21.15.148:0/3317765720 shutdown_connections 2024-09-19T07:25:48.202 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.200+0000 7fd956045740 1 -- 172.21.15.148:0/3317765720 wait complete. 2024-09-19T07:25:48.202 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.200+0000 7fd956045740 20 client.17535 trim_cache size 0 max 16384 2024-09-19T07:25:48.202 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:25:48.202 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:25:48.202 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:25:48.202 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:25:48.203 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.201+0000 7fd9531cf640 1 -- 172.21.15.148:0/154331408 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fd93c0a34e0 msgr2=0x7fd93c0a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:48.203 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.201+0000 7fd9531cf640 1 --2- 172.21.15.148:0/154331408 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fd93c0a34e0 0x7fd93c0a59a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd940011440 tx=0x7fd940011840 comp rx=0 tx=0).stop 2024-09-19T07:25:48.203 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.201+0000 7fd9531cf640 1 -- 172.21.15.148:0/154331408 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd94c101360 msgr2=0x7fd94c1988b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:48.203 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.201+0000 7fd9531cf640 1 --2- 172.21.15.148:0/154331408 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd94c101360 0x7fd94c1988b0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fd938009230 tx=0x7fd938004040 comp rx=0 tx=0).stop 2024-09-19T07:25:48.203 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.201+0000 7fd9531cf640 1 -- 172.21.15.148:0/154331408 shutdown_connections 2024-09-19T07:25:48.204 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.201+0000 7fd9531cf640 1 --2- 172.21.15.148:0/154331408 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fd93c0a34e0 0x7fd93c0a59a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.204 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.201+0000 7fd9531cf640 1 --2- 172.21.15.148:0/154331408 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd94c1069d0 0x7fd94c19cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.204 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.201+0000 7fd9531cf640 1 --2- 172.21.15.148:0/154331408 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd94c101360 0x7fd94c1988b0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.204 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.201+0000 7fd9531cf640 1 --2- 172.21.15.148:0/154331408 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd94c1009c0 0x7fd94c198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.204 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.201+0000 7fd9531cf640 1 -- 172.21.15.148:0/154331408 >> 172.21.15.148:0/154331408 conn(0x7fd94c0fc700 msgr2=0x7fd94c06a580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:48.204 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.201+0000 7fd9531cf640 1 -- 172.21.15.148:0/154331408 shutdown_connections 2024-09-19T07:25:48.204 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:25:48.201+0000 7fd9531cf640 1 -- 172.21.15.148:0/154331408 wait complete. 2024-09-19T07:25:49.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:25:48 smithi179 ceph-mon[35716]: pgmap v462: 97 pgs: 97 active+clean; 1.8 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.2 MiB/s wr, 295 op/s 2024-09-19T07:25:49.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:25:48 smithi148 ceph-mon[31180]: pgmap v462: 97 pgs: 97 active+clean; 1.8 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.2 MiB/s wr, 295 op/s 2024-09-19T07:25:49.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:25:48 smithi165 ceph-mon[35326]: pgmap v462: 97 pgs: 97 active+clean; 1.8 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.2 MiB/s wr, 295 op/s 2024-09-19T07:25:51.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:25:50 smithi179 ceph-mon[35716]: pgmap v463: 97 pgs: 97 active+clean; 1.8 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.2 MiB/s wr, 329 op/s 2024-09-19T07:25:51.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:25:50 smithi148 ceph-mon[31180]: pgmap v463: 97 pgs: 97 active+clean; 1.8 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.2 MiB/s wr, 329 op/s 2024-09-19T07:25:51.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:25:50 smithi165 ceph-mon[35326]: pgmap v463: 97 pgs: 97 active+clean; 1.8 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.2 MiB/s wr, 329 op/s 2024-09-19T07:25:53.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:25:52 smithi179 ceph-mon[35716]: pgmap v464: 97 pgs: 97 active+clean; 1.8 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.2 MiB/s wr, 407 op/s 2024-09-19T07:25:53.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:25:52 smithi148 ceph-mon[31180]: pgmap v464: 97 pgs: 97 active+clean; 1.8 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.2 MiB/s wr, 407 op/s 2024-09-19T07:25:53.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:25:52 smithi165 ceph-mon[35326]: pgmap v464: 97 pgs: 97 active+clean; 1.8 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.2 MiB/s wr, 407 op/s 2024-09-19T07:25:55.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:25:54 smithi179 ceph-mon[35716]: pgmap v465: 97 pgs: 97 active+clean; 1.8 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.8 MiB/s wr, 325 op/s 2024-09-19T07:25:55.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:25:54 smithi148 ceph-mon[31180]: pgmap v465: 97 pgs: 97 active+clean; 1.8 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.8 MiB/s wr, 325 op/s 2024-09-19T07:25:55.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:25:54 smithi165 ceph-mon[35326]: pgmap v465: 97 pgs: 97 active+clean; 1.8 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.8 MiB/s wr, 325 op/s 2024-09-19T07:25:57.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:25:56 smithi179 ceph-mon[35716]: pgmap v466: 97 pgs: 97 active+clean; 1.8 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.4 MiB/s wr, 417 op/s 2024-09-19T07:25:57.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:25:56 smithi148 ceph-mon[31180]: pgmap v466: 97 pgs: 97 active+clean; 1.8 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.4 MiB/s wr, 417 op/s 2024-09-19T07:25:57.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:25:56 smithi165 ceph-mon[35326]: pgmap v466: 97 pgs: 97 active+clean; 1.8 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.4 MiB/s wr, 417 op/s 2024-09-19T07:25:59.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:25:58 smithi179 ceph-mon[35716]: pgmap v467: 97 pgs: 97 active+clean; 1.8 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.9 MiB/s wr, 307 op/s 2024-09-19T07:25:59.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:25:58 smithi148 ceph-mon[31180]: pgmap v467: 97 pgs: 97 active+clean; 1.8 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.9 MiB/s wr, 307 op/s 2024-09-19T07:25:59.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:25:58 smithi165 ceph-mon[35326]: pgmap v467: 97 pgs: 97 active+clean; 1.8 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.9 MiB/s wr, 307 op/s 2024-09-19T07:26:01.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:26:00 smithi179 ceph-mon[35716]: pgmap v468: 97 pgs: 97 active+clean; 1.8 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 338 op/s 2024-09-19T07:26:01.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:26:00 smithi148 ceph-mon[31180]: pgmap v468: 97 pgs: 97 active+clean; 1.8 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 338 op/s 2024-09-19T07:26:01.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:26:00 smithi165 ceph-mon[35326]: pgmap v468: 97 pgs: 97 active+clean; 1.8 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 338 op/s 2024-09-19T07:26:01.291 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.288+0000 7f8dadf31640 1 -- 172.21.15.148:0/2635816529 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8da81035c0 msgr2=0x7f8da810baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:01.291 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.288+0000 7f8dadf31640 1 --2- 172.21.15.148:0/2635816529 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8da81035c0 0x7f8da810baa0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c009900 tx=0x7f8d9c02a480 comp rx=0 tx=0).stop 2024-09-19T07:26:01.291 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.288+0000 7f8dadf31640 1 -- 172.21.15.148:0/2635816529 shutdown_connections 2024-09-19T07:26:01.291 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.288+0000 7f8dadf31640 1 --2- 172.21.15.148:0/2635816529 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8da810c0c0 0x7f8da810e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:01.291 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.288+0000 7f8dadf31640 1 --2- 172.21.15.148:0/2635816529 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8da81035c0 0x7f8da810baa0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:01.291 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.288+0000 7f8dadf31640 1 --2- 172.21.15.148:0/2635816529 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8da8102ca0 0x7f8da8103080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:01.291 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.288+0000 7f8dadf31640 1 -- 172.21.15.148:0/2635816529 >> 172.21.15.148:0/2635816529 conn(0x7f8da80fc6f0 msgr2=0x7f8da80feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:01.292 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.288+0000 7f8dadf31640 1 -- 172.21.15.148:0/2635816529 shutdown_connections 2024-09-19T07:26:01.292 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.288+0000 7f8dadf31640 1 -- 172.21.15.148:0/2635816529 wait complete. 2024-09-19T07:26:01.292 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.289+0000 7f8dadf31640 1 Processor -- start 2024-09-19T07:26:01.292 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.289+0000 7f8dadf31640 1 -- start start 2024-09-19T07:26:01.292 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.289+0000 7f8dadf31640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8da8102ca0 0x7f8da8198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:01.292 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.289+0000 7f8dadf31640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8da81035c0 0x7f8da8198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:01.292 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.289+0000 7f8dadf31640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8da810c0c0 0x7f8da819cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:01.292 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.289+0000 7f8dadf31640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8da8111ee0 con 0x7f8da810c0c0 2024-09-19T07:26:01.292 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.289+0000 7f8dadf31640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8da8111d60 con 0x7f8da8102ca0 2024-09-19T07:26:01.292 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.289+0000 7f8dadf31640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8da8112060 con 0x7f8da81035c0 2024-09-19T07:26:01.293 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.290+0000 7f8da7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8da810c0c0 0x7f8da819cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:01.293 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.290+0000 7f8da7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8da810c0c0 0x7f8da819cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57030/0 (socket says 172.21.15.148:57030) 2024-09-19T07:26:01.293 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.290+0000 7f8da7fff640 1 -- 172.21.15.148:0/47076051 learned_addr learned my addr 172.21.15.148:0/47076051 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:26:01.293 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.290+0000 7f8da6ffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8da81035c0 0x7f8da8198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:01.293 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.290+0000 7f8da77fe640 1 --2- 172.21.15.148:0/47076051 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8da8102ca0 0x7f8da8198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:01.293 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.290+0000 7f8da7fff640 1 -- 172.21.15.148:0/47076051 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8da81035c0 msgr2=0x7f8da8198850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:01.293 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.290+0000 7f8da7fff640 1 --2- 172.21.15.148:0/47076051 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8da81035c0 0x7f8da8198850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:01.293 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.290+0000 7f8da7fff640 1 -- 172.21.15.148:0/47076051 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8da8102ca0 msgr2=0x7f8da8198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:01.293 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.290+0000 7f8da7fff640 1 --2- 172.21.15.148:0/47076051 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8da8102ca0 0x7f8da8198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:01.293 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.290+0000 7f8da7fff640 1 -- 172.21.15.148:0/47076051 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8da819d300 con 0x7f8da810c0c0 2024-09-19T07:26:01.293 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.290+0000 7f8da77fe640 1 --2- 172.21.15.148:0/47076051 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8da8102ca0 0x7f8da8198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:26:01.293 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.290+0000 7f8da7fff640 1 --2- 172.21.15.148:0/47076051 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8da810c0c0 0x7f8da819cbd0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f8da000eb10 tx=0x7f8da000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:01.293 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.290+0000 7f8da4ff9640 1 -- 172.21.15.148:0/47076051 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da0004b20 con 0x7f8da810c0c0 2024-09-19T07:26:01.294 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.290+0000 7f8da4ff9640 1 -- 172.21.15.148:0/47076051 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8da0004cc0 con 0x7f8da810c0c0 2024-09-19T07:26:01.294 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.290+0000 7f8dadf31640 1 -- 172.21.15.148:0/47076051 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8da819d5f0 con 0x7f8da810c0c0 2024-09-19T07:26:01.294 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.290+0000 7f8da4ff9640 1 -- 172.21.15.148:0/47076051 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da0010760 con 0x7f8da810c0c0 2024-09-19T07:26:01.294 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.290+0000 7f8dadf31640 1 -- 172.21.15.148:0/47076051 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8da81a4e80 con 0x7f8da810c0c0 2024-09-19T07:26:01.300 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.292+0000 7f8da4ff9640 1 -- 172.21.15.148:0/47076051 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f8da0005020 con 0x7f8da810c0c0 2024-09-19T07:26:01.300 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.293+0000 7f8db0cd2740 1 Processor -- start 2024-09-19T07:26:01.300 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.293+0000 7f8db0cd2740 1 -- start start 2024-09-19T07:26:01.300 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.293+0000 7f8db0cd2740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be00ae9af0 0x55be00ae9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:01.300 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.293+0000 7f8db0cd2740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55be00aea410 0x55be00af4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:01.301 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.293+0000 7f8db0cd2740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55be00af4cb0 0x55be00af70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:01.301 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.293+0000 7f8db0cd2740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55be00a4e2f0 con 0x55be00ae9af0 2024-09-19T07:26:01.301 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.293+0000 7f8db0cd2740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55be009f6270 con 0x55be00aea410 2024-09-19T07:26:01.301 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.293+0000 7f8db0cd2740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55be00a4a2b0 con 0x55be00af4cb0 2024-09-19T07:26:01.301 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.293+0000 7f8da4ff9640 1 --2- 172.21.15.148:0/47076051 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f8d900a3460 0x7f8d900a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:01.301 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.293+0000 7f8da6ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be00ae9af0 0x55be00ae9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:01.301 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.293+0000 7f8da6ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be00ae9af0 0x55be00ae9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57042/0 (socket says 172.21.15.148:57042) 2024-09-19T07:26:01.301 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.293+0000 7f8da6ffd640 1 -- 172.21.15.148:0/3648941514 learned_addr learned my addr 172.21.15.148:0/3648941514 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:26:01.301 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.293+0000 7f8da7fff640 1 --2- 172.21.15.148:0/47076051 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f8d900a3460 0x7f8d900a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:01.301 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.293+0000 7f8da6ffd640 1 --2- 172.21.15.148:0/3648941514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55be00af4cb0 0x55be00af70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:01.301 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.293+0000 7f8da77fe640 1 --2- 172.21.15.148:0/3648941514 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55be00aea410 0x55be00af4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:01.301 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.293+0000 7f8da4ff9640 1 -- 172.21.15.148:0/47076051 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8556+0+0 (secure 0 0 0) 0x7f8da00d0420 con 0x7f8da810c0c0 2024-09-19T07:26:01.301 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.293+0000 7f8da6ffd640 1 -- 172.21.15.148:0/3648941514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55be00af4cb0 msgr2=0x55be00af70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:01.302 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.293+0000 7f8da6ffd640 1 --2- 172.21.15.148:0/3648941514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55be00af4cb0 0x55be00af70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:01.302 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.294+0000 7f8da6ffd640 1 -- 172.21.15.148:0/3648941514 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55be00aea410 msgr2=0x55be00af4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:01.302 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.294+0000 7f8da6ffd640 1 --2- 172.21.15.148:0/3648941514 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55be00aea410 0x55be00af4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:01.302 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.294+0000 7f8da6ffd640 1 -- 172.21.15.148:0/3648941514 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be009f5340 con 0x55be00ae9af0 2024-09-19T07:26:01.302 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.294+0000 7f8da7fff640 1 --2- 172.21.15.148:0/47076051 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f8d900a3460 0x7f8d900a5920 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8da0098b40 tx=0x7f8da006f510 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:01.302 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.294+0000 7f8da6ffd640 1 --2- 172.21.15.148:0/3648941514 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be00ae9af0 0x55be00ae9ed0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c005c40 tx=0x7f8d9c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12180fca0b09429a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:01.302 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.294+0000 7f8d8dffb640 1 -- 172.21.15.148:0/3648941514 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c044030 con 0x55be00ae9af0 2024-09-19T07:26:01.302 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.294+0000 7f8d8dffb640 1 -- 172.21.15.148:0/3648941514 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d9c0316f0 con 0x55be00ae9af0 2024-09-19T07:26:01.302 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.294+0000 7f8d8dffb640 1 -- 172.21.15.148:0/3648941514 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c035040 con 0x55be00ae9af0 2024-09-19T07:26:01.302 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.295+0000 7f8db0cd2740 1 -- 172.21.15.148:0/3648941514 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be00ae9af0 msgr2=0x55be00ae9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:01.302 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.295+0000 7f8db0cd2740 1 --2- 172.21.15.148:0/3648941514 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be00ae9af0 0x55be00ae9ed0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c005c40 tx=0x7f8d9c000bc0 comp rx=0 tx=0).stop 2024-09-19T07:26:01.302 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.295+0000 7f8db0cd2740 1 -- 172.21.15.148:0/3648941514 shutdown_connections 2024-09-19T07:26:01.302 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.295+0000 7f8db0cd2740 1 --2- 172.21.15.148:0/3648941514 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55be00af4cb0 0x55be00af70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:01.302 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.295+0000 7f8db0cd2740 1 --2- 172.21.15.148:0/3648941514 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55be00aea410 0x55be00af4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:01.303 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.295+0000 7f8db0cd2740 1 --2- 172.21.15.148:0/3648941514 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be00ae9af0 0x55be00ae9ed0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:01.303 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.295+0000 7f8db0cd2740 1 -- 172.21.15.148:0/3648941514 >> 172.21.15.148:0/3648941514 conn(0x55be00ae6060 msgr2=0x55be00ae6440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:01.303 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.295+0000 7f8db0cd2740 1 -- 172.21.15.148:0/3648941514 shutdown_connections 2024-09-19T07:26:01.303 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.295+0000 7f8db0cd2740 1 -- 172.21.15.148:0/3648941514 wait complete. 2024-09-19T07:26:01.303 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.295+0000 7f8db0cd2740 1 -- start start 2024-09-19T07:26:01.303 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.295+0000 7f8db0cd2740 1 Processor -- start 2024-09-19T07:26:01.303 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.295+0000 7f8db0cd2740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be00ae9af0 0x55be00af1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:01.303 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.295+0000 7f8db0cd2740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55be00aea410 0x55be00af2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:01.303 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.295+0000 7f8db0cd2740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55be00af4cb0 0x55be00af25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:01.303 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.295+0000 7f8db0cd2740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55be00af7880 con 0x55be00ae9af0 2024-09-19T07:26:01.303 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.295+0000 7f8db0cd2740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55be009d7290 con 0x55be00af4cb0 2024-09-19T07:26:01.303 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.295+0000 7f8db0cd2740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55be00af7a00 con 0x55be00aea410 2024-09-19T07:26:01.303 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.296+0000 7f8db0cd2740 10 client.0 _ll_register_callbacks cb 0x55be00a08140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:26:01.304 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.296+0000 7f8da6ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be00ae9af0 0x55be00af1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:01.304 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.296+0000 7f8da6ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be00ae9af0 0x55be00af1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57056/0 (socket says 172.21.15.148:57056) 2024-09-19T07:26:01.304 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.296+0000 7f8da6ffd640 1 -- 172.21.15.148:0/193244283 learned_addr learned my addr 172.21.15.148:0/193244283 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:26:01.304 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.296+0000 7f8da77fe640 1 --2- 172.21.15.148:0/193244283 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55be00aea410 0x55be00af2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:01.304 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.296+0000 7f8da6ffd640 1 --2- 172.21.15.148:0/193244283 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55be00af4cb0 0x55be00af25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:01.304 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.296+0000 7f8da6ffd640 1 -- 172.21.15.148:0/193244283 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55be00aea410 msgr2=0x55be00af2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:01.304 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.296+0000 7f8da6ffd640 1 --2- 172.21.15.148:0/193244283 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55be00aea410 0x55be00af2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:01.304 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.296+0000 7f8da6ffd640 1 -- 172.21.15.148:0/193244283 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55be00af4cb0 msgr2=0x55be00af25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:01.304 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.296+0000 7f8da6ffd640 1 --2- 172.21.15.148:0/193244283 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55be00af4cb0 0x55be00af25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:01.304 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.296+0000 7f8da6ffd640 1 -- 172.21.15.148:0/193244283 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be00761210 con 0x55be00ae9af0 2024-09-19T07:26:01.304 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.296+0000 7f8da6ffd640 1 --2- 172.21.15.148:0/193244283 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be00ae9af0 0x55be00af1b30 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c031b50 tx=0x7f8d9c005240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffdad4756ffd630b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:01.304 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.296+0000 7f8d86ffd640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:26:01.304 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.296+0000 7f8d86ffd640 1 -- 172.21.15.148:0/193244283 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c052060 con 0x55be00ae9af0 2024-09-19T07:26:01.305 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.296+0000 7f8d86ffd640 1 -- 172.21.15.148:0/193244283 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8556+0+0 (secure 0 0 0) 0x7f8d9c0055a0 con 0x55be00ae9af0 2024-09-19T07:26:01.305 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.296+0000 7f8db0cd2740 1 -- 172.21.15.148:0/193244283 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d9c0316f0 con 0x55be00ae9af0 2024-09-19T07:26:01.305 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.296+0000 7f8d86ffd640 1 -- 172.21.15.148:0/193244283 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f8d9c035030 con 0x55be00ae9af0 2024-09-19T07:26:01.305 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.296+0000 7f8db0cd2740 10 client.17547 fetch_fsmap learned FSMap version 53 2024-09-19T07:26:01.305 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.296+0000 7f8db0cd2740 1 -- 172.21.15.148:0/193244283 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x55be0082d620 con 0x55be00ae9af0 2024-09-19T07:26:01.305 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.296+0000 7f8d86ffd640 1 -- 172.21.15.148:0/193244283 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d9c0316f0 con 0x55be00ae9af0 2024-09-19T07:26:01.305 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.297+0000 7f8d86ffd640 1 -- 172.21.15.148:0/193244283 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 53) ==== 8362+0+0 (secure 0 0 0) 0x7f8d9c0035f0 con 0x55be00ae9af0 2024-09-19T07:26:01.305 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.297+0000 7f8db0cd2740 10 client.17547 fetch_fsmap finished waiting for FSMap version 53 2024-09-19T07:26:01.305 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.297+0000 7f8db0cd2740 10 client.17547 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:26:01.305 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.297+0000 7f8db0cd2740 20 client.17547 populate_metadata read hostname 'smithi148' 2024-09-19T07:26:01.305 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.297+0000 7f8db0cd2740 1 --2- 172.21.15.148:0/193244283 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55be00b04a40 0x55be00b06e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:01.305 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.297+0000 7f8db0cd2740 4 client.17547 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:26:01.305 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.297+0000 7f8db0cd2740 1 -- 172.21.15.148:0/193244283 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55be00a5ba20 con 0x55be00b04a40 2024-09-19T07:26:01.305 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.297+0000 7f8da77fe640 1 --2- 172.21.15.148:0/193244283 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55be00b04a40 0x55be00b06e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:01.306 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.297+0000 7f8da77fe640 1 --2- 172.21.15.148:0/193244283 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55be00b04a40 0x55be00b06e30 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4f9101da3407770 server_cookie=379cd8e456545be5 in_seq=0 out_seq=0 2024-09-19T07:26:01.306 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.297+0000 7f8d86ffd640 10 client.17547 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:26:01.306 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.298+0000 7f8d86ffd640 1 -- 172.21.15.148:0/193244283 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55be00a5ba20 con 0x55be00b04a40 2024-09-19T07:26:01.306 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.298+0000 7f8d86ffd640 10 client.17547 handle_command_reply: tid=0 2024-09-19T07:26:01.306 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.298+0000 7f8db0cd2740 1 client.17547 shutdown 2024-09-19T07:26:01.306 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.299+0000 7f8db0cd2740 1 -- 172.21.15.148:0/193244283 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be00ae9af0 msgr2=0x55be00af1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:01.306 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.299+0000 7f8db0cd2740 1 --2- 172.21.15.148:0/193244283 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be00ae9af0 0x55be00af1b30 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c031b50 tx=0x7f8d9c005240 comp rx=0 tx=0).stop 2024-09-19T07:26:01.306 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.299+0000 7f8db0cd2740 1 -- 172.21.15.148:0/193244283 shutdown_connections 2024-09-19T07:26:01.306 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.299+0000 7f8db0cd2740 1 --2- 172.21.15.148:0/193244283 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55be00b04a40 0x55be00b06e30 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:01.306 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.299+0000 7f8db0cd2740 1 --2- 172.21.15.148:0/193244283 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55be00af4cb0 0x55be00af25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:01.306 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.299+0000 7f8d86ffd640 0 client.17547 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:26:01.306 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.299+0000 7f8db0cd2740 1 --2- 172.21.15.148:0/193244283 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55be00aea410 0x55be00af2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:01.306 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.299+0000 7f8db0cd2740 1 --2- 172.21.15.148:0/193244283 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be00ae9af0 0x55be00af1b30 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:01.306 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.299+0000 7f8db0cd2740 1 -- 172.21.15.148:0/193244283 >> 172.21.15.148:0/193244283 conn(0x55be00ae6060 msgr2=0x55be00aebdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:01.307 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.299+0000 7f8db0cd2740 1 -- 172.21.15.148:0/193244283 shutdown_connections 2024-09-19T07:26:01.307 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.299+0000 7f8db0cd2740 1 -- 172.21.15.148:0/193244283 wait complete. 2024-09-19T07:26:01.307 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.299+0000 7f8db0cd2740 20 client.17547 trim_cache size 0 max 16384 2024-09-19T07:26:01.318 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.313+0000 7f8db0cd2740 1 Processor -- start 2024-09-19T07:26:01.318 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.313+0000 7f8db0cd2740 1 -- start start 2024-09-19T07:26:01.318 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.313+0000 7f8db0cd2740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55be00ae9af0 0x55be00af23e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:01.318 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.313+0000 7f8db0cd2740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be00aea410 0x55be00b09e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:01.319 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.313+0000 7f8db0cd2740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55be00af4cb0 0x55be00b0a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:01.319 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.313+0000 7f8db0cd2740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8da81b00f0 con 0x55be00aea410 2024-09-19T07:26:01.319 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.313+0000 7f8db0cd2740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8da81ad960 con 0x55be00ae9af0 2024-09-19T07:26:01.319 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.313+0000 7f8db0cd2740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8da81ab7d0 con 0x55be00af4cb0 2024-09-19T07:26:01.319 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.313+0000 7f8da77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be00aea410 0x55be00b09e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:01.319 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.313+0000 7f8da77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be00aea410 0x55be00b09e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57072/0 (socket says 172.21.15.148:57072) 2024-09-19T07:26:01.319 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.313+0000 7f8da77fe640 1 -- 172.21.15.148:0/2592769833 learned_addr learned my addr 172.21.15.148:0/2592769833 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:26:01.319 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.313+0000 7f8da6ffd640 1 --2- 172.21.15.148:0/2592769833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55be00af4cb0 0x55be00b0a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:01.319 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.313+0000 7f8da6ffd640 1 --2- 172.21.15.148:0/2592769833 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55be00ae9af0 0x55be00af23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:01.319 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.313+0000 7f8da77fe640 1 -- 172.21.15.148:0/2592769833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55be00af4cb0 msgr2=0x55be00b0a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:01.319 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.313+0000 7f8da77fe640 1 --2- 172.21.15.148:0/2592769833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55be00af4cb0 0x55be00b0a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:01.319 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.313+0000 7f8da77fe640 1 -- 172.21.15.148:0/2592769833 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55be00ae9af0 msgr2=0x55be00af23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:01.319 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.313+0000 7f8da77fe640 1 --2- 172.21.15.148:0/2592769833 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55be00ae9af0 0x55be00af23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:01.320 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.313+0000 7f8da77fe640 1 -- 172.21.15.148:0/2592769833 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be00ae5e90 con 0x55be00aea410 2024-09-19T07:26:01.320 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.313+0000 7f8da6ffd640 1 --2- 172.21.15.148:0/2592769833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55be00af4cb0 0x55be00b0a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:26:01.320 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.313+0000 7f8da77fe640 1 --2- 172.21.15.148:0/2592769833 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be00aea410 0x55be00b09e50 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f8d98000c00 tx=0x7f8d980094b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9397255501f4657 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:01.320 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.313+0000 7f8d8d7fa640 1 -- 172.21.15.148:0/2592769833 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9801f070 con 0x55be00aea410 2024-09-19T07:26:01.320 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.313+0000 7f8d8d7fa640 1 -- 172.21.15.148:0/2592769833 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d98004730 con 0x55be00aea410 2024-09-19T07:26:01.320 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.313+0000 7f8d8d7fa640 1 -- 172.21.15.148:0/2592769833 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9801b5b0 con 0x55be00aea410 2024-09-19T07:26:01.320 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.314+0000 7f8db0cd2740 1 -- 172.21.15.148:0/2592769833 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be00aea410 msgr2=0x55be00b09e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:01.320 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.314+0000 7f8db0cd2740 1 --2- 172.21.15.148:0/2592769833 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be00aea410 0x55be00b09e50 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f8d98000c00 tx=0x7f8d980094b0 comp rx=0 tx=0).stop 2024-09-19T07:26:01.320 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.314+0000 7f8db0cd2740 1 -- 172.21.15.148:0/2592769833 shutdown_connections 2024-09-19T07:26:01.320 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.314+0000 7f8db0cd2740 1 --2- 172.21.15.148:0/2592769833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55be00af4cb0 0x55be00b0a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:01.320 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.314+0000 7f8db0cd2740 1 --2- 172.21.15.148:0/2592769833 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be00aea410 0x55be00b09e50 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:01.320 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.314+0000 7f8db0cd2740 1 --2- 172.21.15.148:0/2592769833 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55be00ae9af0 0x55be00af23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:01.320 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.314+0000 7f8db0cd2740 1 -- 172.21.15.148:0/2592769833 >> 172.21.15.148:0/2592769833 conn(0x55be00ae6060 msgr2=0x55be00af3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:01.320 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.314+0000 7f8db0cd2740 1 -- 172.21.15.148:0/2592769833 shutdown_connections 2024-09-19T07:26:01.321 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.314+0000 7f8db0cd2740 1 -- 172.21.15.148:0/2592769833 wait complete. 2024-09-19T07:26:01.321 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.314+0000 7f8db0cd2740 1 -- start start 2024-09-19T07:26:01.321 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.315+0000 7f8db0cd2740 1 Processor -- start 2024-09-19T07:26:01.321 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.315+0000 7f8db0cd2740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55be00ae9af0 0x55be00b07e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:01.321 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.315+0000 7f8db0cd2740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55be00aea410 0x55be00b083d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:01.321 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.315+0000 7f8db0cd2740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be00af4cb0 0x55be00b08910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:01.321 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.315+0000 7f8db0cd2740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8da81abe20 con 0x55be00af4cb0 2024-09-19T07:26:01.321 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.315+0000 7f8db0cd2740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8da81ad290 con 0x55be00ae9af0 2024-09-19T07:26:01.321 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.315+0000 7f8db0cd2740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8da81ac4f0 con 0x55be00aea410 2024-09-19T07:26:01.321 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.315+0000 7f8db0cd2740 10 client.0 _ll_register_callbacks cb 0x7f8d9c031e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:26:01.322 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.315+0000 7f8da6ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be00af4cb0 0x55be00b08910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:01.322 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.315+0000 7f8da6ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be00af4cb0 0x55be00b08910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57076/0 (socket says 172.21.15.148:57076) 2024-09-19T07:26:01.322 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.315+0000 7f8da6ffd640 1 -- 172.21.15.148:0/3504463655 learned_addr learned my addr 172.21.15.148:0/3504463655 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:26:01.322 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.315+0000 7f8da77fe640 1 --2- 172.21.15.148:0/3504463655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55be00aea410 0x55be00b083d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:01.322 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.315+0000 7f8da6ffd640 1 --2- 172.21.15.148:0/3504463655 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55be00ae9af0 0x55be00b07e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:01.322 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.315+0000 7f8da6ffd640 1 -- 172.21.15.148:0/3504463655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55be00aea410 msgr2=0x55be00b083d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:01.322 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.315+0000 7f8da6ffd640 1 --2- 172.21.15.148:0/3504463655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55be00aea410 0x55be00b083d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:01.322 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.315+0000 7f8da6ffd640 1 -- 172.21.15.148:0/3504463655 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55be00ae9af0 msgr2=0x55be00b07e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:01.322 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.315+0000 7f8da6ffd640 1 --2- 172.21.15.148:0/3504463655 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55be00ae9af0 0x55be00b07e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:01.322 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.315+0000 7f8da6ffd640 1 -- 172.21.15.148:0/3504463655 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be00b6e5d0 con 0x55be00af4cb0 2024-09-19T07:26:01.322 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.315+0000 7f8da6ffd640 1 --2- 172.21.15.148:0/3504463655 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be00af4cb0 0x55be00b08910 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c031440 tx=0x7f8d9c005240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87c820fba8bc9205 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:01.322 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.315+0000 7f8d86ffd640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:26:01.322 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.315+0000 7f8d86ffd640 1 -- 172.21.15.148:0/3504463655 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c052030 con 0x55be00af4cb0 2024-09-19T07:26:01.323 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.315+0000 7f8d86ffd640 1 -- 172.21.15.148:0/3504463655 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8556+0+0 (secure 0 0 0) 0x7f8d9c0056c0 con 0x55be00af4cb0 2024-09-19T07:26:01.323 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.316+0000 7f8db0cd2740 1 -- 172.21.15.148:0/3504463655 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d98004730 con 0x55be00af4cb0 2024-09-19T07:26:01.323 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.316+0000 7f8d86ffd640 1 -- 172.21.15.148:0/3504463655 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f8d9c044040 con 0x55be00af4cb0 2024-09-19T07:26:01.323 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.316+0000 7f8db0cd2740 10 client.17553 fetch_fsmap learned FSMap version 53 2024-09-19T07:26:01.323 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.316+0000 7f8db0cd2740 1 -- 172.21.15.148:0/3504463655 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x55be00b6f8e0 con 0x55be00af4cb0 2024-09-19T07:26:01.323 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.316+0000 7f8d86ffd640 1 -- 172.21.15.148:0/3504463655 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d98004730 con 0x55be00af4cb0 2024-09-19T07:26:01.323 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.316+0000 7f8d86ffd640 1 -- 172.21.15.148:0/3504463655 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 53) ==== 8362+0+0 (secure 0 0 0) 0x7f8d9c05f040 con 0x55be00af4cb0 2024-09-19T07:26:01.323 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.316+0000 7f8db0cd2740 10 client.17553 fetch_fsmap finished waiting for FSMap version 53 2024-09-19T07:26:01.323 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.316+0000 7f8db0cd2740 10 client.17553 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:26:01.323 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.316+0000 7f8db0cd2740 20 client.17553 populate_metadata read hostname 'smithi148' 2024-09-19T07:26:01.323 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.316+0000 7f8db0cd2740 1 --2- 172.21.15.148:0/3504463655 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55be00b6fef0 0x55be00b722e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:01.323 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.316+0000 7f8db0cd2740 4 client.17553 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:26:01.323 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.316+0000 7f8db0cd2740 1 -- 172.21.15.148:0/3504463655 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55be00a55d70 con 0x55be00b6fef0 2024-09-19T07:26:01.324 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.316+0000 7f8da77fe640 1 --2- 172.21.15.148:0/3504463655 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55be00b6fef0 0x55be00b722e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:01.324 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.317+0000 7f8d86ffd640 10 client.17553 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:26:01.324 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:01.317+0000 7f8da77fe640 1 --2- 172.21.15.148:0/3504463655 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55be00b6fef0 0x55be00b722e0 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af64c076419ec535 server_cookie=4bc1fc8aaa4f33d7 in_seq=0 out_seq=0 2024-09-19T07:26:03.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:26:02 smithi179 ceph-mon[35716]: pgmap v469: 97 pgs: 97 active+clean; 1.8 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.6 MiB/s wr, 396 op/s 2024-09-19T07:26:03.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:26:02 smithi179 ceph-mon[35716]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:26:03.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:26:02 smithi148 ceph-mon[31180]: pgmap v469: 97 pgs: 97 active+clean; 1.8 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.6 MiB/s wr, 396 op/s 2024-09-19T07:26:03.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:26:02 smithi148 ceph-mon[31180]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:26:03.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:26:02 smithi165 ceph-mon[35326]: pgmap v469: 97 pgs: 97 active+clean; 1.8 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.6 MiB/s wr, 396 op/s 2024-09-19T07:26:03.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:26:02 smithi165 ceph-mon[35326]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:26:04.470 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:04.469+0000 7f8d86ffd640 1 -- 172.21.15.148:0/3504463655 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55be00a55d70 con 0x55be00b6fef0 2024-09-19T07:26:04.470 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:04.469+0000 7f8d86ffd640 10 client.17553 handle_command_reply: tid=0 2024-09-19T07:26:04.470 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:04.469+0000 7f8db0cd2740 1 client.17553 shutdown 2024-09-19T07:26:04.470 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:04.469+0000 7f8db0cd2740 1 -- 172.21.15.148:0/3504463655 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be00af4cb0 msgr2=0x55be00b08910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:04.471 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:04.469+0000 7f8db0cd2740 1 --2- 172.21.15.148:0/3504463655 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be00af4cb0 0x55be00b08910 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c031440 tx=0x7f8d9c005240 comp rx=0 tx=0).stop 2024-09-19T07:26:04.471 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:04.469+0000 7f8db0cd2740 1 -- 172.21.15.148:0/3504463655 shutdown_connections 2024-09-19T07:26:04.471 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:04.469+0000 7f8db0cd2740 1 --2- 172.21.15.148:0/3504463655 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55be00b6fef0 0x55be00b722e0 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:04.471 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:04.469+0000 7f8d86ffd640 0 client.17553 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:26:04.471 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:04.469+0000 7f8db0cd2740 1 --2- 172.21.15.148:0/3504463655 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55be00af4cb0 0x55be00b08910 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:04.471 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:04.469+0000 7f8db0cd2740 1 --2- 172.21.15.148:0/3504463655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55be00aea410 0x55be00b083d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:04.471 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:04.469+0000 7f8db0cd2740 1 --2- 172.21.15.148:0/3504463655 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55be00ae9af0 0x55be00b07e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:04.471 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:04.469+0000 7f8db0cd2740 1 -- 172.21.15.148:0/3504463655 >> 172.21.15.148:0/3504463655 conn(0x55be00ae6060 msgr2=0x55be00affcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:04.471 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:04.469+0000 7f8db0cd2740 1 -- 172.21.15.148:0/3504463655 shutdown_connections 2024-09-19T07:26:04.471 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:04.469+0000 7f8db0cd2740 1 -- 172.21.15.148:0/3504463655 wait complete. 2024-09-19T07:26:04.471 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:04.470+0000 7f8db0cd2740 20 client.17553 trim_cache size 0 max 16384 2024-09-19T07:26:04.472 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:26:04.472 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:26:04.472 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:26:04.472 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:26:04.473 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:04.470+0000 7f8dadf31640 1 -- 172.21.15.148:0/47076051 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f8d900a3460 msgr2=0x7f8d900a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:04.473 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:04.470+0000 7f8dadf31640 1 --2- 172.21.15.148:0/47076051 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f8d900a3460 0x7f8d900a5920 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8da0098b40 tx=0x7f8da006f510 comp rx=0 tx=0).stop 2024-09-19T07:26:04.473 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:04.470+0000 7f8dadf31640 1 -- 172.21.15.148:0/47076051 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8da810c0c0 msgr2=0x7f8da819cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:04.473 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:04.470+0000 7f8dadf31640 1 --2- 172.21.15.148:0/47076051 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8da810c0c0 0x7f8da819cbd0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f8da000eb10 tx=0x7f8da000c2d0 comp rx=0 tx=0).stop 2024-09-19T07:26:04.473 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:04.470+0000 7f8dadf31640 1 -- 172.21.15.148:0/47076051 shutdown_connections 2024-09-19T07:26:04.473 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:04.470+0000 7f8dadf31640 1 --2- 172.21.15.148:0/47076051 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f8d900a3460 0x7f8d900a5920 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:04.473 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:04.470+0000 7f8dadf31640 1 --2- 172.21.15.148:0/47076051 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8da810c0c0 0x7f8da819cbd0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:04.473 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:04.470+0000 7f8dadf31640 1 --2- 172.21.15.148:0/47076051 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8da81035c0 0x7f8da8198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:04.473 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:04.470+0000 7f8dadf31640 1 --2- 172.21.15.148:0/47076051 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8da8102ca0 0x7f8da8198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:04.473 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:04.470+0000 7f8dadf31640 1 -- 172.21.15.148:0/47076051 >> 172.21.15.148:0/47076051 conn(0x7f8da80fc6f0 msgr2=0x7f8da80fd350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:04.473 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:04.470+0000 7f8dadf31640 1 -- 172.21.15.148:0/47076051 shutdown_connections 2024-09-19T07:26:04.473 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:04.470+0000 7f8dadf31640 1 -- 172.21.15.148:0/47076051 wait complete. 2024-09-19T07:26:05.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:26:04 smithi179 ceph-mon[35716]: pgmap v470: 97 pgs: 97 active+clean; 1.8 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 407 op/s 2024-09-19T07:26:05.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:26:04 smithi148 ceph-mon[31180]: pgmap v470: 97 pgs: 97 active+clean; 1.8 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 407 op/s 2024-09-19T07:26:05.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:26:04 smithi165 ceph-mon[35326]: pgmap v470: 97 pgs: 97 active+clean; 1.8 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 407 op/s 2024-09-19T07:26:07.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:26:06 smithi148 ceph-mon[31180]: pgmap v471: 97 pgs: 97 active+clean; 1.8 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.2 MiB/s wr, 1.32k op/s 2024-09-19T07:26:07.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:26:06 smithi165 ceph-mon[35326]: pgmap v471: 97 pgs: 97 active+clean; 1.8 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.2 MiB/s wr, 1.32k op/s 2024-09-19T07:26:07.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:26:06 smithi179 ceph-mon[35716]: pgmap v471: 97 pgs: 97 active+clean; 1.8 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.2 MiB/s wr, 1.32k op/s 2024-09-19T07:26:08.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:26:07 smithi148 ceph-mon[31180]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:26:08.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:26:07 smithi165 ceph-mon[35326]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:26:08.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:26:07 smithi179 ceph-mon[35716]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:26:09.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:26:08 smithi148 ceph-mon[31180]: pgmap v472: 97 pgs: 97 active+clean; 1.8 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.7 MiB/s wr, 1.19k op/s 2024-09-19T07:26:09.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:26:08 smithi165 ceph-mon[35326]: pgmap v472: 97 pgs: 97 active+clean; 1.8 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.7 MiB/s wr, 1.19k op/s 2024-09-19T07:26:09.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:26:08 smithi179 ceph-mon[35716]: pgmap v472: 97 pgs: 97 active+clean; 1.8 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.7 MiB/s wr, 1.19k op/s 2024-09-19T07:26:11.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:26:10 smithi148 ceph-mon[31180]: pgmap v473: 97 pgs: 97 active+clean; 1.8 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 1.28k op/s 2024-09-19T07:26:11.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:26:10 smithi165 ceph-mon[35326]: pgmap v473: 97 pgs: 97 active+clean; 1.8 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 1.28k op/s 2024-09-19T07:26:11.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:26:10 smithi179 ceph-mon[35716]: pgmap v473: 97 pgs: 97 active+clean; 1.8 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 1.28k op/s 2024-09-19T07:26:13.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:26:12 smithi148 ceph-mon[31180]: pgmap v474: 97 pgs: 97 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.7 MiB/s wr, 1.36k op/s 2024-09-19T07:26:13.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:26:12 smithi148 ceph-mon[31180]: osdmap e99: 12 total, 12 up, 12 in 2024-09-19T07:26:13.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:26:12 smithi165 ceph-mon[35326]: pgmap v474: 97 pgs: 97 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.7 MiB/s wr, 1.36k op/s 2024-09-19T07:26:13.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:26:12 smithi165 ceph-mon[35326]: osdmap e99: 12 total, 12 up, 12 in 2024-09-19T07:26:13.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:26:12 smithi179 ceph-mon[35716]: pgmap v474: 97 pgs: 97 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.7 MiB/s wr, 1.36k op/s 2024-09-19T07:26:13.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:26:12 smithi179 ceph-mon[35716]: osdmap e99: 12 total, 12 up, 12 in 2024-09-19T07:26:15.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:26:14 smithi148 ceph-mon[31180]: pgmap v476: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.7 MiB/s wr, 1.39k op/s 2024-09-19T07:26:15.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:26:14 smithi165 ceph-mon[35326]: pgmap v476: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.7 MiB/s wr, 1.39k op/s 2024-09-19T07:26:15.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:26:14 smithi179 ceph-mon[35716]: pgmap v476: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.7 MiB/s wr, 1.39k op/s 2024-09-19T07:26:17.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:26:16 smithi148 ceph-mon[31180]: pgmap v477: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.9 MiB/s wr, 365 op/s 2024-09-19T07:26:17.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:26:16 smithi165 ceph-mon[35326]: pgmap v477: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.9 MiB/s wr, 365 op/s 2024-09-19T07:26:17.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:26:16 smithi179 ceph-mon[35716]: pgmap v477: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.9 MiB/s wr, 365 op/s 2024-09-19T07:26:17.603 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.602+0000 7f3904fd8640 1 -- 172.21.15.148:0/282505694 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f390010d4d0 msgr2=0x7f3900115020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:17.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.602+0000 7f3904fd8640 1 --2- 172.21.15.148:0/282505694 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f390010d4d0 0x7f3900115020 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f38f0009860 tx=0x7f38f002a340 comp rx=0 tx=0).stop 2024-09-19T07:26:17.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.603+0000 7f3904fd8640 1 -- 172.21.15.148:0/282505694 shutdown_connections 2024-09-19T07:26:17.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.603+0000 7f3904fd8640 1 --2- 172.21.15.148:0/282505694 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f390010d4d0 0x7f3900115020 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:17.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.603+0000 7f3904fd8640 1 --2- 172.21.15.148:0/282505694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3900108d30 0x7f390010cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:17.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.603+0000 7f3904fd8640 1 --2- 172.21.15.148:0/282505694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3900108380 0x7f3900108760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:17.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.603+0000 7f3904fd8640 1 -- 172.21.15.148:0/282505694 >> 172.21.15.148:0/282505694 conn(0x7f3900077b20 msgr2=0x7f3900079f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:17.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.603+0000 7f3904fd8640 1 -- 172.21.15.148:0/282505694 shutdown_connections 2024-09-19T07:26:17.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.603+0000 7f3904fd8640 1 -- 172.21.15.148:0/282505694 wait complete. 2024-09-19T07:26:17.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.604+0000 7f3904fd8640 1 Processor -- start 2024-09-19T07:26:17.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.604+0000 7f3904fd8640 1 -- start start 2024-09-19T07:26:17.605 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.604+0000 7f3904fd8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3900108380 0x7f390007c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:17.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.604+0000 7f3904fd8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f390010d4d0 0x7f390007ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:17.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.604+0000 7f3904fd8640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3900080e10 0x7f3900081290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:17.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.604+0000 7f3904fd8640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f390007add0 con 0x7f3900108380 2024-09-19T07:26:17.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.604+0000 7f3904fd8640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f390007ac50 con 0x7f3900080e10 2024-09-19T07:26:17.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.604+0000 7f3904fd8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f390007af50 con 0x7f390010d4d0 2024-09-19T07:26:17.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.605+0000 7f38fed9d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3900080e10 0x7f3900081290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:17.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.605+0000 7f38fed9d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3900080e10 0x7f3900081290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:41228/0 (socket says 172.21.15.148:41228) 2024-09-19T07:26:17.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.605+0000 7f38fed9d640 1 -- 172.21.15.148:0/389115755 learned_addr learned my addr 172.21.15.148:0/389115755 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:26:17.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.605+0000 7f38fe59c640 1 --2- 172.21.15.148:0/389115755 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3900108380 0x7f390007c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:17.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.605+0000 7f38fdd9b640 1 --2- 172.21.15.148:0/389115755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f390010d4d0 0x7f390007ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:17.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.605+0000 7f38fed9d640 1 -- 172.21.15.148:0/389115755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f390010d4d0 msgr2=0x7f390007ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:17.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.605+0000 7f38fed9d640 1 --2- 172.21.15.148:0/389115755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f390010d4d0 0x7f390007ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:17.606 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.605+0000 7f38fed9d640 1 -- 172.21.15.148:0/389115755 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3900108380 msgr2=0x7f390007c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:17.607 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.605+0000 7f38fed9d640 1 --2- 172.21.15.148:0/389115755 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3900108380 0x7f390007c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:17.607 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.605+0000 7f38fed9d640 1 -- 172.21.15.148:0/389115755 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39000817d0 con 0x7f3900080e10 2024-09-19T07:26:17.607 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.606+0000 7f38fed9d640 1 --2- 172.21.15.148:0/389115755 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3900080e10 0x7f3900081290 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f38f0031000 tx=0x7f38f0033d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:17.607 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.606+0000 7f38ef7fe640 1 -- 172.21.15.148:0/389115755 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f003f020 con 0x7f3900080e10 2024-09-19T07:26:17.608 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.607+0000 7f38ef7fe640 1 -- 172.21.15.148:0/389115755 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38f0004240 con 0x7f3900080e10 2024-09-19T07:26:17.608 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.607+0000 7f38ef7fe640 1 -- 172.21.15.148:0/389115755 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f0037040 con 0x7f3900080e10 2024-09-19T07:26:17.608 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.607+0000 7f3904fd8640 1 -- 172.21.15.148:0/389115755 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3900081a60 con 0x7f3900080e10 2024-09-19T07:26:17.608 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.607+0000 7f3904fd8640 1 -- 172.21.15.148:0/389115755 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39001b40a0 con 0x7f3900080e10 2024-09-19T07:26:17.611 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.611+0000 7f38ef7fe640 1 -- 172.21.15.148:0/389115755 <== mon.2 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f38f0042020 con 0x7f3900080e10 2024-09-19T07:26:17.613 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.613+0000 7f3907e4b740 1 Processor -- start 2024-09-19T07:26:17.614 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.614+0000 7f38ef7fe640 1 --2- 172.21.15.148:0/389115755 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f38e80a34e0 0x7f38e80a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:17.615 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.614+0000 7f3907e4b740 1 -- start start 2024-09-19T07:26:17.616 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.615+0000 7f3907e4b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56092a0daaf0 0x56092a0daed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:17.616 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.615+0000 7f3907e4b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56092a0db410 0x56092a0e5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:17.616 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.615+0000 7f3907e4b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56092a0e5cb0 0x56092a0e80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:17.616 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.615+0000 7f3907e4b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56092a03f2f0 con 0x56092a0e5cb0 2024-09-19T07:26:17.616 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.615+0000 7f3907e4b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x560929fe7270 con 0x56092a0db410 2024-09-19T07:26:17.616 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.615+0000 7f3907e4b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56092a03b2b0 con 0x56092a0daaf0 2024-09-19T07:26:17.616 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.615+0000 7f38fdd9b640 1 --2- 172.21.15.148:0/389115755 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f38e80a34e0 0x7f38e80a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:17.616 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.615+0000 7f38fed9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56092a0e5cb0 0x56092a0e80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:17.616 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.615+0000 7f38fed9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56092a0e5cb0 0x56092a0e80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39796/0 (socket says 172.21.15.148:39796) 2024-09-19T07:26:17.616 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.615+0000 7f38fed9d640 1 -- 172.21.15.148:0/208287414 learned_addr learned my addr 172.21.15.148:0/208287414 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:26:17.616 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.615+0000 7f38fe59c640 1 --2- 172.21.15.148:0/208287414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56092a0daaf0 0x56092a0daed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:17.616 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.615+0000 7f38ef7fe640 1 -- 172.21.15.148:0/389115755 <== mon.2 v2:172.21.15.165:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8600+0+0 (secure 0 0 0) 0x7f38f00f0820 con 0x7f3900080e10 2024-09-19T07:26:17.617 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.616+0000 7f38fdd9b640 1 --2- 172.21.15.148:0/208287414 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56092a0db410 0x56092a0e5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:17.617 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.616+0000 7f38fdd9b640 1 -- 172.21.15.148:0/208287414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56092a0daaf0 msgr2=0x56092a0daed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:17.617 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.616+0000 7f38fdd9b640 1 --2- 172.21.15.148:0/208287414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56092a0daaf0 0x56092a0daed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:17.617 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.616+0000 7f38fdd9b640 1 -- 172.21.15.148:0/208287414 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56092a0e5cb0 msgr2=0x56092a0e80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:17.617 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.616+0000 7f38fdd9b640 1 --2- 172.21.15.148:0/208287414 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56092a0e5cb0 0x56092a0e80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:17.617 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.616+0000 7f38fdd9b640 1 -- 172.21.15.148:0/208287414 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560929fe6340 con 0x56092a0db410 2024-09-19T07:26:17.618 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.617+0000 7f38fdd9b640 1 --2- 172.21.15.148:0/389115755 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f38e80a34e0 0x7f38e80a59a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3900078280 tx=0x7f38f4014950 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:17.618 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.617+0000 7f38fdd9b640 1 --2- 172.21.15.148:0/208287414 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56092a0db410 0x56092a0e5770 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f38f4005fd0 tx=0x7f38f401a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=436a1911c7807f4e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:17.618 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.617+0000 7f38ecff9640 1 -- 172.21.15.148:0/208287414 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f400e490 con 0x56092a0db410 2024-09-19T07:26:17.618 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.617+0000 7f38ecff9640 1 -- 172.21.15.148:0/208287414 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38f4025070 con 0x56092a0db410 2024-09-19T07:26:17.618 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.617+0000 7f38ecff9640 1 -- 172.21.15.148:0/208287414 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f4020930 con 0x56092a0db410 2024-09-19T07:26:17.619 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.619+0000 7f3907e4b740 1 -- 172.21.15.148:0/208287414 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56092a0db410 msgr2=0x56092a0e5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:17.619 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.619+0000 7f3907e4b740 1 --2- 172.21.15.148:0/208287414 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56092a0db410 0x56092a0e5770 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f38f4005fd0 tx=0x7f38f401a000 comp rx=0 tx=0).stop 2024-09-19T07:26:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.620+0000 7f3907e4b740 1 -- 172.21.15.148:0/208287414 shutdown_connections 2024-09-19T07:26:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.621+0000 7f3907e4b740 1 --2- 172.21.15.148:0/208287414 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56092a0e5cb0 0x56092a0e80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.621+0000 7f3907e4b740 1 --2- 172.21.15.148:0/208287414 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56092a0db410 0x56092a0e5770 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.621+0000 7f3907e4b740 1 --2- 172.21.15.148:0/208287414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56092a0daaf0 0x56092a0daed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.621+0000 7f3907e4b740 1 -- 172.21.15.148:0/208287414 >> 172.21.15.148:0/208287414 conn(0x56092a0d7060 msgr2=0x56092a0d7440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.623+0000 7f3907e4b740 1 -- 172.21.15.148:0/208287414 shutdown_connections 2024-09-19T07:26:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.623+0000 7f3907e4b740 1 -- 172.21.15.148:0/208287414 wait complete. 2024-09-19T07:26:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.623+0000 7f3907e4b740 1 -- start start 2024-09-19T07:26:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.623+0000 7f3907e4b740 1 Processor -- start 2024-09-19T07:26:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.624+0000 7f3907e4b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56092a0daaf0 0x56092a0e2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.624+0000 7f3907e4b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56092a0db410 0x56092a0e2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.624+0000 7f3907e4b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56092a0e5cb0 0x56092a0e34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.624+0000 7f3907e4b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56092a0f9890 con 0x56092a0daaf0 2024-09-19T07:26:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.624+0000 7f3907e4b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x560929fc8290 con 0x56092a0e5cb0 2024-09-19T07:26:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.624+0000 7f3907e4b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56092a0f9a10 con 0x56092a0db410 2024-09-19T07:26:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.624+0000 7f3907e4b740 10 client.0 _ll_register_callbacks cb 0x560929ff9140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:26:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.624+0000 7f38fe59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56092a0daaf0 0x56092a0e2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.624+0000 7f38fe59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56092a0daaf0 0x56092a0e2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39812/0 (socket says 172.21.15.148:39812) 2024-09-19T07:26:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.624+0000 7f38fe59c640 1 -- 172.21.15.148:0/4265258510 learned_addr learned my addr 172.21.15.148:0/4265258510 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:26:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.625+0000 7f38fe59c640 1 -- 172.21.15.148:0/4265258510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56092a0db410 msgr2=0x56092a0e2f80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T07:26:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.625+0000 7f38fe59c640 1 --2- 172.21.15.148:0/4265258510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56092a0db410 0x56092a0e2f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.625+0000 7f38fe59c640 1 -- 172.21.15.148:0/4265258510 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56092a0e5cb0 msgr2=0x56092a0e34c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T07:26:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.625+0000 7f38fe59c640 1 --2- 172.21.15.148:0/4265258510 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56092a0e5cb0 0x56092a0e34c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.625+0000 7f38fe59c640 1 -- 172.21.15.148:0/4265258510 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560929d52210 con 0x56092a0daaf0 2024-09-19T07:26:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.625+0000 7f38fe59c640 1 --2- 172.21.15.148:0/4265258510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56092a0daaf0 0x56092a0e2a40 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f38f800fbd0 tx=0x7f38f800e7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f036cd4c7ae94626 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.625+0000 7f38e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:26:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.626+0000 7f38e5ffb640 1 -- 172.21.15.148:0/4265258510 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f801e060 con 0x56092a0daaf0 2024-09-19T07:26:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.626+0000 7f3907e4b740 1 -- 172.21.15.148:0/4265258510 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38f4025070 con 0x56092a0daaf0 2024-09-19T07:26:17.628 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.626+0000 7f38e5ffb640 1 -- 172.21.15.148:0/4265258510 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8600+0+0 (secure 0 0 0) 0x7f38f80195f0 con 0x56092a0daaf0 2024-09-19T07:26:17.628 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.626+0000 7f38e5ffb640 1 -- 172.21.15.148:0/4265258510 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f38f8019850 con 0x56092a0daaf0 2024-09-19T07:26:17.628 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.626+0000 7f3907e4b740 10 client.17565 fetch_fsmap learned FSMap version 55 2024-09-19T07:26:17.628 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.626+0000 7f3907e4b740 1 -- 172.21.15.148:0/4265258510 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x560929e1e620 con 0x56092a0daaf0 2024-09-19T07:26:17.629 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.627+0000 7f38e5ffb640 1 -- 172.21.15.148:0/4265258510 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38f4025070 con 0x56092a0daaf0 2024-09-19T07:26:17.629 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.627+0000 7f38e5ffb640 1 -- 172.21.15.148:0/4265258510 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 55) ==== 8370+0+0 (secure 0 0 0) 0x7f38f8018070 con 0x56092a0daaf0 2024-09-19T07:26:17.629 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.627+0000 7f3907e4b740 10 client.17565 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T07:26:17.629 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.627+0000 7f3907e4b740 10 client.17565 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:26:17.629 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.627+0000 7f3907e4b740 20 client.17565 populate_metadata read hostname 'smithi148' 2024-09-19T07:26:17.629 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.627+0000 7f3907e4b740 1 --2- 172.21.15.148:0/4265258510 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56092a106ce0 0x56092a1091a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:17.629 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.627+0000 7f3907e4b740 4 client.17565 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:26:17.629 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.627+0000 7f3907e4b740 1 -- 172.21.15.148:0/4265258510 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56092a04ca20 con 0x56092a106ce0 2024-09-19T07:26:17.629 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.628+0000 7f38fdd9b640 1 --2- 172.21.15.148:0/4265258510 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56092a106ce0 0x56092a1091a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:17.631 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.631+0000 7f38fdd9b640 1 --2- 172.21.15.148:0/4265258510 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56092a106ce0 0x56092a1091a0 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7273b8f9cd1d23e9 server_cookie=354ba9e19fce39a6 in_seq=0 out_seq=0 2024-09-19T07:26:17.631 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.631+0000 7f38e5ffb640 10 client.17565 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:26:17.636 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.636+0000 7f38e5ffb640 1 -- 172.21.15.148:0/4265258510 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56092a04ca20 con 0x56092a106ce0 2024-09-19T07:26:17.636 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.636+0000 7f38e5ffb640 10 client.17565 handle_command_reply: tid=0 2024-09-19T07:26:17.636 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.636+0000 7f3907e4b740 1 client.17565 shutdown 2024-09-19T07:26:17.637 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.637+0000 7f3907e4b740 1 -- 172.21.15.148:0/4265258510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56092a0daaf0 msgr2=0x56092a0e2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:17.637 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.637+0000 7f3907e4b740 1 --2- 172.21.15.148:0/4265258510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56092a0daaf0 0x56092a0e2a40 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f38f800fbd0 tx=0x7f38f800e7c0 comp rx=0 tx=0).stop 2024-09-19T07:26:17.640 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.639+0000 7f3907e4b740 1 -- 172.21.15.148:0/4265258510 shutdown_connections 2024-09-19T07:26:17.640 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.639+0000 7f3907e4b740 1 --2- 172.21.15.148:0/4265258510 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56092a106ce0 0x56092a1091a0 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:17.640 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.639+0000 7f3907e4b740 1 --2- 172.21.15.148:0/4265258510 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56092a0e5cb0 0x56092a0e34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:17.640 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.639+0000 7f3907e4b740 1 --2- 172.21.15.148:0/4265258510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56092a0db410 0x56092a0e2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:17.640 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.639+0000 7f3907e4b740 1 --2- 172.21.15.148:0/4265258510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56092a0daaf0 0x56092a0e2a40 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:17.640 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.639+0000 7f3907e4b740 1 -- 172.21.15.148:0/4265258510 >> 172.21.15.148:0/4265258510 conn(0x56092a0d7060 msgr2=0x56092a0d61c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.642+0000 7f38e5ffb640 0 client.17565 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:26:17.643 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.642+0000 7f3907e4b740 1 -- 172.21.15.148:0/4265258510 shutdown_connections 2024-09-19T07:26:17.643 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.642+0000 7f3907e4b740 1 -- 172.21.15.148:0/4265258510 wait complete. 2024-09-19T07:26:17.643 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.642+0000 7f3907e4b740 20 client.17565 trim_cache size 0 max 16384 2024-09-19T07:26:17.668 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.668+0000 7f3907e4b740 1 Processor -- start 2024-09-19T07:26:17.669 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.668+0000 7f3907e4b740 1 -- start start 2024-09-19T07:26:17.669 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.668+0000 7f3907e4b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56092a0daaf0 0x56092a10eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:17.669 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.668+0000 7f3907e4b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56092a0db410 0x56092a10eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:17.669 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.668+0000 7f3907e4b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56092a0e5cb0 0x56092a0dc550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:17.669 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.668+0000 7f3907e4b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f38e00111c0 con 0x56092a0e5cb0 2024-09-19T07:26:17.669 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.668+0000 7f3907e4b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f38e000e9d0 con 0x56092a0daaf0 2024-09-19T07:26:17.669 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.668+0000 7f3907e4b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f38e000c840 con 0x56092a0db410 2024-09-19T07:26:17.670 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.668+0000 7f38fdd9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56092a0db410 0x56092a10eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:17.670 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.668+0000 7f38fdd9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56092a0db410 0x56092a10eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:51276/0 (socket says 172.21.15.148:51276) 2024-09-19T07:26:17.670 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.668+0000 7f38fdd9b640 1 -- 172.21.15.148:0/3492653425 learned_addr learned my addr 172.21.15.148:0/3492653425 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:26:17.670 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.669+0000 7f38fed9d640 1 --2- 172.21.15.148:0/3492653425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56092a0e5cb0 0x56092a0dc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:17.670 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.669+0000 7f38fe59c640 1 --2- 172.21.15.148:0/3492653425 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56092a0daaf0 0x56092a10eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:17.670 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.669+0000 7f38fed9d640 1 -- 172.21.15.148:0/3492653425 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56092a0db410 msgr2=0x56092a10eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:17.670 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.669+0000 7f38fed9d640 1 --2- 172.21.15.148:0/3492653425 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56092a0db410 0x56092a10eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:17.670 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.669+0000 7f38fed9d640 1 -- 172.21.15.148:0/3492653425 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56092a0daaf0 msgr2=0x56092a10eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:17.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.669+0000 7f38fed9d640 1 --2- 172.21.15.148:0/3492653425 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56092a0daaf0 0x56092a10eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:17.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.669+0000 7f38fed9d640 1 -- 172.21.15.148:0/3492653425 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56092a0db240 con 0x56092a0e5cb0 2024-09-19T07:26:17.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.670+0000 7f38fed9d640 1 --2- 172.21.15.148:0/3492653425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56092a0e5cb0 0x56092a0dc550 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f38f0048000 tx=0x7f38f002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c330a0adce4a935b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:17.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.670+0000 7f38e7fff640 1 -- 172.21.15.148:0/3492653425 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f00a5e60 con 0x56092a0e5cb0 2024-09-19T07:26:17.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.670+0000 7f38e7fff640 1 -- 172.21.15.148:0/3492653425 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38f00bd260 con 0x56092a0e5cb0 2024-09-19T07:26:17.671 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.670+0000 7f38e7fff640 1 -- 172.21.15.148:0/3492653425 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f00c0f10 con 0x56092a0e5cb0 2024-09-19T07:26:17.672 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.672+0000 7f3907e4b740 1 -- 172.21.15.148:0/3492653425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56092a0e5cb0 msgr2=0x56092a0dc550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:17.673 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.672+0000 7f3907e4b740 1 --2- 172.21.15.148:0/3492653425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56092a0e5cb0 0x56092a0dc550 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f38f0048000 tx=0x7f38f002c000 comp rx=0 tx=0).stop 2024-09-19T07:26:17.673 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.672+0000 7f3907e4b740 1 -- 172.21.15.148:0/3492653425 shutdown_connections 2024-09-19T07:26:17.673 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.672+0000 7f3907e4b740 1 --2- 172.21.15.148:0/3492653425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56092a0e5cb0 0x56092a0dc550 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:17.673 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.672+0000 7f3907e4b740 1 --2- 172.21.15.148:0/3492653425 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56092a0db410 0x56092a10eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:17.673 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.672+0000 7f3907e4b740 1 --2- 172.21.15.148:0/3492653425 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56092a0daaf0 0x56092a10eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:17.673 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.672+0000 7f3907e4b740 1 -- 172.21.15.148:0/3492653425 >> 172.21.15.148:0/3492653425 conn(0x56092a0d7060 msgr2=0x56092a0e1b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:17.673 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.673+0000 7f3907e4b740 1 -- 172.21.15.148:0/3492653425 shutdown_connections 2024-09-19T07:26:17.674 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.673+0000 7f3907e4b740 1 -- 172.21.15.148:0/3492653425 wait complete. 2024-09-19T07:26:17.675 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.674+0000 7f3907e4b740 1 -- start start 2024-09-19T07:26:17.675 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.674+0000 7f3907e4b740 1 Processor -- start 2024-09-19T07:26:17.675 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.674+0000 7f3907e4b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56092a0daaf0 0x56092a0ff5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:17.675 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.674+0000 7f3907e4b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56092a0db410 0x56092a0e6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:17.675 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.674+0000 7f3907e4b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56092a0e5cb0 0x56092a0e7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:17.675 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.674+0000 7f3907e4b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f38e000ce90 con 0x56092a0db410 2024-09-19T07:26:17.675 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.674+0000 7f3907e4b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f38e000e300 con 0x56092a0e5cb0 2024-09-19T07:26:17.675 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.674+0000 7f3907e4b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f38e000d560 con 0x56092a0daaf0 2024-09-19T07:26:17.675 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.674+0000 7f38fdd9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56092a0db410 0x56092a0e6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:17.675 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.674+0000 7f3907e4b740 10 client.0 _ll_register_callbacks cb 0x7f38f800f7e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:26:17.676 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.675+0000 7f38fe59c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56092a0daaf0 0x56092a0ff5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:17.676 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.675+0000 7f38fe59c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56092a0daaf0 0x56092a0ff5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:51290/0 (socket says 172.21.15.148:51290) 2024-09-19T07:26:17.676 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.675+0000 7f38fe59c640 1 -- 172.21.15.148:0/2579241200 learned_addr learned my addr 172.21.15.148:0/2579241200 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:26:17.676 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.675+0000 7f38fed9d640 1 --2- 172.21.15.148:0/2579241200 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56092a0e5cb0 0x56092a0e7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:17.676 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.675+0000 7f38fe59c640 1 -- 172.21.15.148:0/2579241200 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56092a0e5cb0 msgr2=0x56092a0e7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:17.677 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.675+0000 7f38fe59c640 1 --2- 172.21.15.148:0/2579241200 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56092a0e5cb0 0x56092a0e7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:17.677 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.675+0000 7f38fe59c640 1 -- 172.21.15.148:0/2579241200 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56092a0db410 msgr2=0x56092a0e6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:17.677 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.675+0000 7f38fe59c640 1 --2- 172.21.15.148:0/2579241200 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56092a0db410 0x56092a0e6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:17.677 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.675+0000 7f38fe59c640 1 -- 172.21.15.148:0/2579241200 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56092a0fd0b0 con 0x56092a0daaf0 2024-09-19T07:26:17.677 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.675+0000 7f38fdd9b640 1 --2- 172.21.15.148:0/2579241200 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56092a0db410 0x56092a0e6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:26:17.677 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.676+0000 7f38fe59c640 1 --2- 172.21.15.148:0/2579241200 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56092a0daaf0 0x56092a0ff5a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f38f8002230 tx=0x7f38f801aa80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d0440191008f9e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:17.678 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.676+0000 7f38e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-19T07:26:17.679 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.678+0000 7f38e5ffb640 1 -- 172.21.15.148:0/2579241200 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f800c3e0 con 0x56092a0daaf0 2024-09-19T07:26:17.679 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.678+0000 7f3907e4b740 1 -- 172.21.15.148:0/2579241200 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38f00bd260 con 0x56092a0daaf0 2024-09-19T07:26:17.679 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.679+0000 7f38e5ffb640 1 -- 172.21.15.148:0/2579241200 <== mon.1 v2:172.21.15.179:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8600+0+0 (secure 0 0 0) 0x7f38f800c580 con 0x56092a0daaf0 2024-09-19T07:26:17.680 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.680+0000 7f38e5ffb640 1 -- 172.21.15.148:0/2579241200 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f38f8038050 con 0x56092a0daaf0 2024-09-19T07:26:17.680 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.680+0000 7f3907e4b740 10 client.26728 fetch_fsmap learned FSMap version 55 2024-09-19T07:26:17.680 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.680+0000 7f3907e4b740 1 -- 172.21.15.148:0/2579241200 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x56092a171cb0 con 0x56092a0daaf0 2024-09-19T07:26:17.681 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.680+0000 7f38e5ffb640 1 -- 172.21.15.148:0/2579241200 <== mon.1 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38f00bd260 con 0x56092a0daaf0 2024-09-19T07:26:17.681 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.680+0000 7f38e5ffb640 1 -- 172.21.15.148:0/2579241200 <== mon.1 v2:172.21.15.179:3300/0 5 ==== fsmap(e 55) ==== 8370+0+0 (secure 0 0 0) 0x7f38f8033030 con 0x56092a0daaf0 2024-09-19T07:26:17.681 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.681+0000 7f3907e4b740 10 client.26728 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T07:26:17.681 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.681+0000 7f3907e4b740 10 client.26728 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:26:17.681 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.681+0000 7f3907e4b740 20 client.26728 populate_metadata read hostname 'smithi148' 2024-09-19T07:26:17.681 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.681+0000 7f3907e4b740 1 --2- 172.21.15.148:0/2579241200 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56092a172460 0x56092a174880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:17.681 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.681+0000 7f3907e4b740 4 client.26728 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:26:17.681 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.681+0000 7f3907e4b740 1 -- 172.21.15.148:0/2579241200 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56092a046d70 con 0x56092a172460 2024-09-19T07:26:17.682 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.681+0000 7f38fdd9b640 1 --2- 172.21.15.148:0/2579241200 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56092a172460 0x56092a174880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:17.682 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.682+0000 7f38fdd9b640 1 --2- 172.21.15.148:0/2579241200 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56092a172460 0x56092a174880 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42e9fbc5937a22d3 server_cookie=c75e88cf015ae31 in_seq=0 out_seq=0 2024-09-19T07:26:17.682 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.682+0000 7f38e5ffb640 10 client.26728 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:26:17.848 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.847+0000 7f38e5ffb640 1 -- 172.21.15.148:0/2579241200 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56092a046d70 con 0x56092a172460 2024-09-19T07:26:17.849 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.847+0000 7f38e5ffb640 10 client.26728 handle_command_reply: tid=0 2024-09-19T07:26:17.849 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.847+0000 7f3907e4b740 1 client.26728 shutdown 2024-09-19T07:26:17.849 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.848+0000 7f3907e4b740 1 -- 172.21.15.148:0/2579241200 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56092a0daaf0 msgr2=0x56092a0ff5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:17.849 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.848+0000 7f3907e4b740 1 --2- 172.21.15.148:0/2579241200 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56092a0daaf0 0x56092a0ff5a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f38f8002230 tx=0x7f38f801aa80 comp rx=0 tx=0).stop 2024-09-19T07:26:17.849 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.848+0000 7f3907e4b740 1 -- 172.21.15.148:0/2579241200 shutdown_connections 2024-09-19T07:26:17.849 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.848+0000 7f3907e4b740 1 --2- 172.21.15.148:0/2579241200 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56092a172460 0x56092a174880 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:17.849 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.848+0000 7f3907e4b740 1 --2- 172.21.15.148:0/2579241200 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56092a0e5cb0 0x56092a0e7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:17.849 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.848+0000 7f3907e4b740 1 --2- 172.21.15.148:0/2579241200 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56092a0db410 0x56092a0e6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:17.849 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.848+0000 7f38e5ffb640 0 client.26728 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:26:17.849 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.848+0000 7f3907e4b740 1 --2- 172.21.15.148:0/2579241200 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56092a0daaf0 0x56092a0ff5a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:17.849 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.848+0000 7f3907e4b740 1 -- 172.21.15.148:0/2579241200 >> 172.21.15.148:0/2579241200 conn(0x56092a0d7060 msgr2=0x56092a0dc550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:17.849 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.848+0000 7f3907e4b740 1 -- 172.21.15.148:0/2579241200 shutdown_connections 2024-09-19T07:26:17.849 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.848+0000 7f3907e4b740 1 -- 172.21.15.148:0/2579241200 wait complete. 2024-09-19T07:26:17.850 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.848+0000 7f3907e4b740 20 client.26728 trim_cache size 0 max 16384 2024-09-19T07:26:17.850 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:26:17.850 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:26:17.850 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:26:17.850 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:26:17.851 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.849+0000 7f3904fd8640 1 -- 172.21.15.148:0/389115755 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f38e80a34e0 msgr2=0x7f38e80a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:17.851 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.849+0000 7f3904fd8640 1 --2- 172.21.15.148:0/389115755 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f38e80a34e0 0x7f38e80a59a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3900078280 tx=0x7f38f4014950 comp rx=0 tx=0).stop 2024-09-19T07:26:17.852 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.849+0000 7f3904fd8640 1 -- 172.21.15.148:0/389115755 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3900080e10 msgr2=0x7f3900081290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:17.852 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.849+0000 7f3904fd8640 1 --2- 172.21.15.148:0/389115755 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3900080e10 0x7f3900081290 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f38f0031000 tx=0x7f38f0033d90 comp rx=0 tx=0).stop 2024-09-19T07:26:17.852 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.849+0000 7f3904fd8640 1 -- 172.21.15.148:0/389115755 shutdown_connections 2024-09-19T07:26:17.852 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.849+0000 7f3904fd8640 1 --2- 172.21.15.148:0/389115755 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f38e80a34e0 0x7f38e80a59a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:17.852 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.849+0000 7f3904fd8640 1 --2- 172.21.15.148:0/389115755 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3900080e10 0x7f3900081290 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:17.852 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.849+0000 7f3904fd8640 1 --2- 172.21.15.148:0/389115755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f390010d4d0 0x7f390007ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:17.852 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.849+0000 7f3904fd8640 1 --2- 172.21.15.148:0/389115755 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3900108380 0x7f390007c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:17.852 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.849+0000 7f3904fd8640 1 -- 172.21.15.148:0/389115755 >> 172.21.15.148:0/389115755 conn(0x7f3900077b20 msgr2=0x7f3900079ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:17.852 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.849+0000 7f3904fd8640 1 -- 172.21.15.148:0/389115755 shutdown_connections 2024-09-19T07:26:17.852 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:17.849+0000 7f3904fd8640 1 -- 172.21.15.148:0/389115755 wait complete. 2024-09-19T07:26:19.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:26:18 smithi148 ceph-mon[31180]: pgmap v478: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.9 MiB/s wr, 364 op/s 2024-09-19T07:26:19.224 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:26:18 smithi165 ceph-mon[35326]: pgmap v478: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.9 MiB/s wr, 364 op/s 2024-09-19T07:26:19.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:26:18 smithi179 ceph-mon[35716]: pgmap v478: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.9 MiB/s wr, 364 op/s 2024-09-19T07:26:21.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:26:20 smithi148 ceph-mon[31180]: pgmap v479: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 278 op/s 2024-09-19T07:26:21.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:26:20 smithi165 ceph-mon[35326]: pgmap v479: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 278 op/s 2024-09-19T07:26:21.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:26:20 smithi179 ceph-mon[35716]: pgmap v479: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 278 op/s 2024-09-19T07:26:23.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:26:22 smithi148 ceph-mon[31180]: pgmap v480: 97 pgs: 21 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 37 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 217 op/s 2024-09-19T07:26:23.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:26:22 smithi165 ceph-mon[35326]: pgmap v480: 97 pgs: 21 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 37 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 217 op/s 2024-09-19T07:26:23.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:26:22 smithi179 ceph-mon[35716]: pgmap v480: 97 pgs: 21 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 37 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 217 op/s 2024-09-19T07:26:25.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:26:24 smithi148 ceph-mon[31180]: pgmap v481: 97 pgs: 21 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 37 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 193 op/s 2024-09-19T07:26:25.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:26:24 smithi165 ceph-mon[35326]: pgmap v481: 97 pgs: 21 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 37 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 193 op/s 2024-09-19T07:26:25.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:26:24 smithi179 ceph-mon[35716]: pgmap v481: 97 pgs: 21 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 37 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 193 op/s 2024-09-19T07:26:25.764 INFO:tasks.quiescer.fs.[cephfs]:Total duration (58.9) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T07:26:25.764 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.45 2024-09-19T07:26:25.765 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:26:26.180 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:26:26.954 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:26:26 smithi148 ceph-mon[31180]: pgmap v482: 97 pgs: 12 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 60 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 239 op/s 2024-09-19T07:26:27.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.084+0000 7f07d3fff640 1 -- 172.21.15.148:0/3253740395 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d80319b0 con 0x7f07dc109450 2024-09-19T07:26:27.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.085+0000 7f07e39ea640 1 -- 172.21.15.148:0/3253740395 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f07dc109450 msgr2=0x7f07dc110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:27.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.085+0000 7f07e39ea640 1 --2- 172.21.15.148:0/3253740395 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f07dc109450 0x7f07dc110250 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f07d8009900 tx=0x7f07d802a410 comp rx=0 tx=0).stop 2024-09-19T07:26:27.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.085+0000 7f07e39ea640 1 -- 172.21.15.148:0/3253740395 shutdown_connections 2024-09-19T07:26:27.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.085+0000 7f07e39ea640 1 --2- 172.21.15.148:0/3253740395 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07dc11b140 0x7f07dc11d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:27.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.085+0000 7f07e39ea640 1 --2- 172.21.15.148:0/3253740395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07dc109830 0x7f07dc109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:27.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.085+0000 7f07e39ea640 1 --2- 172.21.15.148:0/3253740395 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f07dc109450 0x7f07dc110250 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:27.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.085+0000 7f07e39ea640 1 -- 172.21.15.148:0/3253740395 >> 172.21.15.148:0/3253740395 conn(0x7f07dc06e140 msgr2=0x7f07dc06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:27.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.085+0000 7f07e39ea640 1 -- 172.21.15.148:0/3253740395 shutdown_connections 2024-09-19T07:26:27.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.085+0000 7f07e39ea640 1 -- 172.21.15.148:0/3253740395 wait complete. 2024-09-19T07:26:27.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.086+0000 7f07e39ea640 1 Processor -- start 2024-09-19T07:26:27.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.086+0000 7f07e39ea640 1 -- start start 2024-09-19T07:26:27.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.087+0000 7f07e39ea640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07dc109450 0x7f07dc1a7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:27.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.087+0000 7f07e39ea640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07dc109830 0x7f07dc1a78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:27.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.087+0000 7f07e39ea640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f07dc11b140 0x7f07dc1abc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:27.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.087+0000 7f07e39ea640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f07dc120e10 con 0x7f07dc109450 2024-09-19T07:26:27.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.087+0000 7f07e39ea640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f07dc120c90 con 0x7f07dc11b140 2024-09-19T07:26:27.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.087+0000 7f07e39ea640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f07dc120f90 con 0x7f07dc109830 2024-09-19T07:26:27.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.087+0000 7f07e0f85640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07dc109830 0x7f07dc1a78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:27.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.087+0000 7f07e0f85640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07dc109830 0x7f07dc1a78b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:49638/0 (socket says 172.21.15.148:49638) 2024-09-19T07:26:27.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.087+0000 7f07e0f85640 1 -- 172.21.15.148:0/2654619895 learned_addr learned my addr 172.21.15.148:0/2654619895 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:26:27.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.087+0000 7f07e1f87640 1 --2- 172.21.15.148:0/2654619895 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f07dc11b140 0x7f07dc1abc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:27.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.087+0000 7f07e1786640 1 --2- 172.21.15.148:0/2654619895 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07dc109450 0x7f07dc1a7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:27.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.088+0000 7f07e1f87640 1 -- 172.21.15.148:0/2654619895 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07dc109830 msgr2=0x7f07dc1a78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:27.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.088+0000 7f07e1f87640 1 --2- 172.21.15.148:0/2654619895 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07dc109830 0x7f07dc1a78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:27.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.088+0000 7f07e1f87640 1 -- 172.21.15.148:0/2654619895 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07dc109450 msgr2=0x7f07dc1a7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:27.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.088+0000 7f07e1f87640 1 --2- 172.21.15.148:0/2654619895 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07dc109450 0x7f07dc1a7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:27.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.088+0000 7f07e1f87640 1 -- 172.21.15.148:0/2654619895 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07dc1ac320 con 0x7f07dc11b140 2024-09-19T07:26:27.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.088+0000 7f07e1f87640 1 --2- 172.21.15.148:0/2654619895 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f07dc11b140 0x7f07dc1abc40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f07d4009fd0 tx=0x7f07d400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:27.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.089+0000 7f07d27fc640 1 -- 172.21.15.148:0/2654619895 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d4004d20 con 0x7f07dc11b140 2024-09-19T07:26:27.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.089+0000 7f07e39ea640 1 -- 172.21.15.148:0/2654619895 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07dc1ac610 con 0x7f07dc11b140 2024-09-19T07:26:27.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.089+0000 7f07d27fc640 1 -- 172.21.15.148:0/2654619895 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f07d4005020 con 0x7f07dc11b140 2024-09-19T07:26:27.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.089+0000 7f07d27fc640 1 -- 172.21.15.148:0/2654619895 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d40116b0 con 0x7f07dc11b140 2024-09-19T07:26:27.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.089+0000 7f07e39ea640 1 -- 172.21.15.148:0/2654619895 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07dc07a450 con 0x7f07dc11b140 2024-09-19T07:26:27.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.093+0000 7f07e39ea640 1 -- 172.21.15.148:0/2654619895 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07c0005290 con 0x7f07dc11b140 2024-09-19T07:26:27.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.093+0000 7f07d27fc640 1 -- 172.21.15.148:0/2654619895 <== mon.2 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f07d400cb20 con 0x7f07dc11b140 2024-09-19T07:26:27.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.094+0000 7f07d27fc640 1 --2- 172.21.15.148:0/2654619895 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f07c80a35c0 0x7f07c80a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:27.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.095+0000 7f07e1786640 1 --2- 172.21.15.148:0/2654619895 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f07c80a35c0 0x7f07c80a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:27.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.095+0000 7f07d27fc640 1 -- 172.21.15.148:0/2654619895 <== mon.2 v2:172.21.15.165:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8600+0+0 (secure 0 0 0) 0x7f07d40cfd50 con 0x7f07dc11b140 2024-09-19T07:26:27.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.097+0000 7f07e1786640 1 --2- 172.21.15.148:0/2654619895 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f07c80a35c0 0x7f07c80a5a80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f07d8000c00 tx=0x7f07d80041a0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:27.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.102+0000 7f07d27fc640 1 -- 172.21.15.148:0/2654619895 <== mon.2 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f07d4016030 con 0x7f07dc11b140 2024-09-19T07:26:27.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:26:26 smithi165 ceph-mon[35326]: pgmap v482: 97 pgs: 12 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 60 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 239 op/s 2024-09-19T07:26:27.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:26:26 smithi179 ceph-mon[35716]: pgmap v482: 97 pgs: 12 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 60 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 239 op/s 2024-09-19T07:26:27.490 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.490+0000 7f07e39ea640 1 -- 172.21.15.148:0/2654619895 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f07c0005850 con 0x7f07dc11b140 2024-09-19T07:26:27.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.492+0000 7f07d27fc640 1 -- 172.21.15.148:0/2654619895 <== mon.2 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+11947 (secure 0 0 0) 0x7f07d409c680 con 0x7f07dc11b140 2024-09-19T07:26:27.493 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:26:27.493 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":55,"btime":"2024-09-19T07:26:06:767218+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/4263868576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":4263868576},{"type":"v1","addr":"172.21.15.148:6841","nonce":4263868576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":25606,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3891676893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3891676893},{"type":"v1","addr":"172.21.15.179:6835","nonce":3891676893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":55,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:09:19.543369+0000","modified":"2024-09-19T07:26:06.157910+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24457,"mds_1":24437,"mds_2":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":75,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":71,"addr":"172.21.15.165:6839/3993490234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":3993490234},{"type":"v1","addr":"172.21.15.165:6839","nonce":3993490234}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25823":{"gid":25823,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6835/380886107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":380886107},{"type":"v1","addr":"172.21.15.165:6835","nonce":380886107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24457,"qdb_cluster":[24457,24437,24436]},"id":1}]} 2024-09-19T07:26:27.493 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 55 2024-09-19T07:26:27.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.496+0000 7f07e39ea640 1 -- 172.21.15.148:0/2654619895 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f07c80a35c0 msgr2=0x7f07c80a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:27.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.496+0000 7f07e39ea640 1 --2- 172.21.15.148:0/2654619895 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f07c80a35c0 0x7f07c80a5a80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f07d8000c00 tx=0x7f07d80041a0 comp rx=0 tx=0).stop 2024-09-19T07:26:27.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.496+0000 7f07e39ea640 1 -- 172.21.15.148:0/2654619895 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f07dc11b140 msgr2=0x7f07dc1abc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:27.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.496+0000 7f07e39ea640 1 --2- 172.21.15.148:0/2654619895 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f07dc11b140 0x7f07dc1abc40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f07d4009fd0 tx=0x7f07d400edf0 comp rx=0 tx=0).stop 2024-09-19T07:26:27.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.496+0000 7f07e39ea640 1 -- 172.21.15.148:0/2654619895 shutdown_connections 2024-09-19T07:26:27.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.496+0000 7f07e39ea640 1 --2- 172.21.15.148:0/2654619895 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f07c80a35c0 0x7f07c80a5a80 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:27.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.496+0000 7f07e39ea640 1 --2- 172.21.15.148:0/2654619895 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f07dc11b140 0x7f07dc1abc40 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:27.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.496+0000 7f07e39ea640 1 --2- 172.21.15.148:0/2654619895 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07dc109830 0x7f07dc1a78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:27.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.496+0000 7f07e39ea640 1 --2- 172.21.15.148:0/2654619895 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07dc109450 0x7f07dc1a7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:27.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.496+0000 7f07e39ea640 1 -- 172.21.15.148:0/2654619895 >> 172.21.15.148:0/2654619895 conn(0x7f07dc06e140 msgr2=0x7f07dc11be00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:27.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.496+0000 7f07e39ea640 1 -- 172.21.15.148:0/2654619895 shutdown_connections 2024-09-19T07:26:27.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:27.496+0000 7f07e39ea640 1 -- 172.21.15.148:0/2654619895 wait complete. 2024-09-19T07:26:28.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:26:27 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/2654619895' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:26:28.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:26:27 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/2654619895' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:26:28.172 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:26:27 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/2654619895' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:26:28.719 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24457 quiesce db / --timeout 90 --expiration 149.45 --await-for 45.0' 2024-09-19T07:26:28.719 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24457 quiesce db / --timeout 90 --expiration 149.45 --await-for 45.0 2024-09-19T07:26:28.974 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:26:29.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:26:28 smithi148 ceph-mon[31180]: pgmap v483: 97 pgs: 12 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 60 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 154 op/s 2024-09-19T07:26:29.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:26:28 smithi165 ceph-mon[35326]: pgmap v483: 97 pgs: 12 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 60 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 154 op/s 2024-09-19T07:26:29.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:26:28 smithi179 ceph-mon[35716]: pgmap v483: 97 pgs: 12 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 60 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 154 op/s 2024-09-19T07:26:29.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.493+0000 7f9461f30640 1 -- 172.21.15.148:0/1396771415 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f945c106a80 msgr2=0x7f945c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:29.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.493+0000 7f9461f30640 1 --2- 172.21.15.148:0/1396771415 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f945c106a80 0x7f945c106e60 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f944c009900 tx=0x7f944c02a410 comp rx=0 tx=0).stop 2024-09-19T07:26:29.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.493+0000 7f9461f30640 1 -- 172.21.15.148:0/1396771415 shutdown_connections 2024-09-19T07:26:29.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.493+0000 7f9461f30640 1 --2- 172.21.15.148:0/1396771415 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f945c101420 0x7f945c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:29.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.493+0000 7f9461f30640 1 --2- 172.21.15.148:0/1396771415 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f945c100a80 0x7f945c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:29.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.493+0000 7f9461f30640 1 --2- 172.21.15.148:0/1396771415 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f945c106a80 0x7f945c106e60 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:29.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.493+0000 7f9461f30640 1 -- 172.21.15.148:0/1396771415 >> 172.21.15.148:0/1396771415 conn(0x7f945c0fc7a0 msgr2=0x7f945c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:29.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.493+0000 7f9461f30640 1 -- 172.21.15.148:0/1396771415 shutdown_connections 2024-09-19T07:26:29.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.493+0000 7f9461f30640 1 -- 172.21.15.148:0/1396771415 wait complete. 2024-09-19T07:26:29.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.494+0000 7f9461f30640 1 Processor -- start 2024-09-19T07:26:29.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.494+0000 7f9461f30640 1 -- start start 2024-09-19T07:26:29.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.494+0000 7f9461f30640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f945c100a80 0x7f945c198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:29.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.494+0000 7f9461f30640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f945c101420 0x7f945c198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:29.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.494+0000 7f9461f30640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f945c106a80 0x7f945c19cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:29.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.494+0000 7f9461f30640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f945c111f20 con 0x7f945c101420 2024-09-19T07:26:29.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.494+0000 7f9461f30640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f945c111da0 con 0x7f945c100a80 2024-09-19T07:26:29.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.494+0000 7f9461f30640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f945c1120a0 con 0x7f945c106a80 2024-09-19T07:26:29.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.494+0000 7f945affd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f945c101420 0x7f945c198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:29.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.494+0000 7f945affd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f945c101420 0x7f945c198980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59442/0 (socket says 172.21.15.148:59442) 2024-09-19T07:26:29.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.494+0000 7f945affd640 1 -- 172.21.15.148:0/3189900035 learned_addr learned my addr 172.21.15.148:0/3189900035 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:26:29.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.494+0000 7f945bfff640 1 --2- 172.21.15.148:0/3189900035 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f945c106a80 0x7f945c19cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:29.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.494+0000 7f945b7fe640 1 --2- 172.21.15.148:0/3189900035 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f945c100a80 0x7f945c198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:29.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.494+0000 7f945affd640 1 -- 172.21.15.148:0/3189900035 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f945c106a80 msgr2=0x7f945c19cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:29.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.494+0000 7f945affd640 1 --2- 172.21.15.148:0/3189900035 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f945c106a80 0x7f945c19cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:29.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.494+0000 7f945affd640 1 -- 172.21.15.148:0/3189900035 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f945c100a80 msgr2=0x7f945c198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:29.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.494+0000 7f945affd640 1 --2- 172.21.15.148:0/3189900035 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f945c100a80 0x7f945c198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:29.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.494+0000 7f945affd640 1 -- 172.21.15.148:0/3189900035 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f945c19d3f0 con 0x7f945c101420 2024-09-19T07:26:29.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.495+0000 7f945affd640 1 --2- 172.21.15.148:0/3189900035 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f945c101420 0x7f945c198980 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f945000c890 tx=0x7f945000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:29.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.495+0000 7f9458ff9640 1 -- 172.21.15.148:0/3189900035 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9450004220 con 0x7f945c101420 2024-09-19T07:26:29.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.495+0000 7f9461f30640 1 -- 172.21.15.148:0/3189900035 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f945c19d6e0 con 0x7f945c101420 2024-09-19T07:26:29.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.495+0000 7f9458ff9640 1 -- 172.21.15.148:0/3189900035 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94500043c0 con 0x7f945c101420 2024-09-19T07:26:29.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.495+0000 7f9458ff9640 1 -- 172.21.15.148:0/3189900035 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9450004a00 con 0x7f945c101420 2024-09-19T07:26:29.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.495+0000 7f9461f30640 1 -- 172.21.15.148:0/3189900035 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f945c1a4fc0 con 0x7f945c101420 2024-09-19T07:26:29.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.497+0000 7f9458ff9640 1 -- 172.21.15.148:0/3189900035 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f94500079b0 con 0x7f945c101420 2024-09-19T07:26:29.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.498+0000 7f9464309740 1 Processor -- start 2024-09-19T07:26:29.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.498+0000 7f9464309740 1 -- start start 2024-09-19T07:26:29.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.498+0000 7f9464309740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dbf8dab850 0x55dbf8dabc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:29.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.498+0000 7f9464309740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf8dac170 0x55dbf8db64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:29.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.498+0000 7f9464309740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dbf8db6a30 0x55dbf8db8e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:29.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.498+0000 7f9464309740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55dbf8d10160 con 0x55dbf8dac170 2024-09-19T07:26:29.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.498+0000 7f9464309740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55dbf8cb7720 con 0x55dbf8dab850 2024-09-19T07:26:29.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.498+0000 7f9464309740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55dbf8d0c120 con 0x55dbf8db6a30 2024-09-19T07:26:29.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.498+0000 7f9458ff9640 1 --2- 172.21.15.148:0/3189900035 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f94440a33b0 0x7f94440a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:29.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.498+0000 7f945b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf8dac170 0x55dbf8db64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:29.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.498+0000 7f945b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf8dac170 0x55dbf8db64f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59450/0 (socket says 172.21.15.148:59450) 2024-09-19T07:26:29.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.498+0000 7f945b7fe640 1 -- 172.21.15.148:0/614363785 learned_addr learned my addr 172.21.15.148:0/614363785 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:26:29.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.498+0000 7f945bfff640 1 --2- 172.21.15.148:0/3189900035 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f94440a33b0 0x7f94440a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:29.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.498+0000 7f945affd640 1 --2- 172.21.15.148:0/614363785 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dbf8db6a30 0x55dbf8db8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:29.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.498+0000 7f945bfff640 1 --2- 172.21.15.148:0/614363785 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dbf8dab850 0x55dbf8dabc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:29.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.498+0000 7f9458ff9640 1 -- 172.21.15.148:0/3189900035 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8600+0+0 (secure 0 0 0) 0x7f94500cfad0 con 0x7f945c101420 2024-09-19T07:26:29.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.498+0000 7f945b7fe640 1 -- 172.21.15.148:0/614363785 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dbf8db6a30 msgr2=0x55dbf8db8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:29.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.499+0000 7f945b7fe640 1 --2- 172.21.15.148:0/614363785 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dbf8db6a30 0x55dbf8db8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:29.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.499+0000 7f945b7fe640 1 -- 172.21.15.148:0/614363785 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dbf8dab850 msgr2=0x55dbf8dabc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:29.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.499+0000 7f945b7fe640 1 --2- 172.21.15.148:0/614363785 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dbf8dab850 0x55dbf8dabc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:29.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.499+0000 7f945b7fe640 1 -- 172.21.15.148:0/614363785 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbf8a81ba0 con 0x55dbf8dac170 2024-09-19T07:26:29.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.499+0000 7f945affd640 1 --2- 172.21.15.148:0/614363785 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dbf8db6a30 0x55dbf8db8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:26:29.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.499+0000 7f945b7fe640 1 --2- 172.21.15.148:0/614363785 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf8dac170 0x55dbf8db64f0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f944c033000 tx=0x7f944c032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab396c8e61290984 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:29.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.499+0000 7f945bfff640 1 --2- 172.21.15.148:0/3189900035 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f94440a33b0 0x7f94440a5870 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f94540098b0 tx=0x7f9454009840 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:29.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.499+0000 7f9441ffb640 1 -- 172.21.15.148:0/614363785 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f944c03f070 con 0x55dbf8dac170 2024-09-19T07:26:29.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.499+0000 7f9441ffb640 1 -- 172.21.15.148:0/614363785 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f944c0317b0 con 0x55dbf8dac170 2024-09-19T07:26:29.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.499+0000 7f9441ffb640 1 -- 172.21.15.148:0/614363785 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f944c035070 con 0x55dbf8dac170 2024-09-19T07:26:29.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.500+0000 7f9464309740 1 -- 172.21.15.148:0/614363785 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf8dac170 msgr2=0x55dbf8db64f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:29.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.500+0000 7f9464309740 1 --2- 172.21.15.148:0/614363785 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf8dac170 0x55dbf8db64f0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f944c033000 tx=0x7f944c032ce0 comp rx=0 tx=0).stop 2024-09-19T07:26:29.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.500+0000 7f9464309740 1 -- 172.21.15.148:0/614363785 shutdown_connections 2024-09-19T07:26:29.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.500+0000 7f9464309740 1 --2- 172.21.15.148:0/614363785 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dbf8db6a30 0x55dbf8db8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:29.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.500+0000 7f9464309740 1 --2- 172.21.15.148:0/614363785 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf8dac170 0x55dbf8db64f0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:29.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.500+0000 7f9464309740 1 --2- 172.21.15.148:0/614363785 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dbf8dab850 0x55dbf8dabc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:29.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.500+0000 7f9464309740 1 -- 172.21.15.148:0/614363785 >> 172.21.15.148:0/614363785 conn(0x55dbf8da7de0 msgr2=0x55dbf8da81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:29.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.500+0000 7f9464309740 1 -- 172.21.15.148:0/614363785 shutdown_connections 2024-09-19T07:26:29.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.500+0000 7f9464309740 1 -- 172.21.15.148:0/614363785 wait complete. 2024-09-19T07:26:29.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.500+0000 7f9464309740 1 -- start start 2024-09-19T07:26:29.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.500+0000 7f9464309740 1 Processor -- start 2024-09-19T07:26:29.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.500+0000 7f9464309740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dbf8dab850 0x55dbf8db3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:29.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.500+0000 7f9464309740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dbf8dac170 0x55dbf8db3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:29.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.500+0000 7f9464309740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf8db6a30 0x55dbf8db4300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:29.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.501+0000 7f9464309740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55dbf8db9600 con 0x55dbf8db6a30 2024-09-19T07:26:29.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.501+0000 7f9464309740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55dbf8c98900 con 0x55dbf8dac170 2024-09-19T07:26:29.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.501+0000 7f9464309740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55dbf8db9780 con 0x55dbf8dab850 2024-09-19T07:26:29.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.501+0000 7f9464309740 10 client.0 _ll_register_callbacks cb 0x55dbf8c96780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:26:29.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.501+0000 7f945bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf8db6a30 0x55dbf8db4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:29.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.501+0000 7f945bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf8db6a30 0x55dbf8db4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59464/0 (socket says 172.21.15.148:59464) 2024-09-19T07:26:29.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.501+0000 7f945bfff640 1 -- 172.21.15.148:0/426650200 learned_addr learned my addr 172.21.15.148:0/426650200 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:26:29.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.501+0000 7f945affd640 1 --2- 172.21.15.148:0/426650200 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dbf8dac170 0x55dbf8db3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:29.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.501+0000 7f945b7fe640 1 --2- 172.21.15.148:0/426650200 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dbf8dab850 0x55dbf8db3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:29.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.501+0000 7f945bfff640 1 -- 172.21.15.148:0/426650200 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dbf8dab850 msgr2=0x55dbf8db3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:29.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.501+0000 7f945bfff640 1 --2- 172.21.15.148:0/426650200 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dbf8dab850 0x55dbf8db3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:29.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.501+0000 7f945bfff640 1 -- 172.21.15.148:0/426650200 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dbf8dac170 msgr2=0x55dbf8db3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:29.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.501+0000 7f945bfff640 1 --2- 172.21.15.148:0/426650200 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dbf8dac170 0x55dbf8db3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:29.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.501+0000 7f945bfff640 1 -- 172.21.15.148:0/426650200 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbf8cd8c50 con 0x55dbf8db6a30 2024-09-19T07:26:29.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.501+0000 7f945bfff640 1 --2- 172.21.15.148:0/426650200 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf8db6a30 0x55dbf8db4300 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f9454003c50 tx=0x7f9454004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5a15c8372ffc631 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:29.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.501+0000 7f943affd640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:26:29.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.501+0000 7f943affd640 1 -- 172.21.15.148:0/426650200 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9454004530 con 0x55dbf8db6a30 2024-09-19T07:26:29.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.501+0000 7f943affd640 1 -- 172.21.15.148:0/426650200 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8600+0+0 (secure 0 0 0) 0x7f94540046d0 con 0x55dbf8db6a30 2024-09-19T07:26:29.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.501+0000 7f9464309740 1 -- 172.21.15.148:0/426650200 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f944c0317b0 con 0x55dbf8db6a30 2024-09-19T07:26:29.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.501+0000 7f943affd640 1 -- 172.21.15.148:0/426650200 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f9454020410 con 0x55dbf8db6a30 2024-09-19T07:26:29.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.501+0000 7f9464309740 10 client.17589 fetch_fsmap learned FSMap version 55 2024-09-19T07:26:29.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.501+0000 7f9464309740 1 -- 172.21.15.148:0/426650200 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x55dbf8dc52f0 con 0x55dbf8db6a30 2024-09-19T07:26:29.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.502+0000 7f943affd640 1 -- 172.21.15.148:0/426650200 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f944c0317b0 con 0x55dbf8db6a30 2024-09-19T07:26:29.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.502+0000 7f943affd640 1 -- 172.21.15.148:0/426650200 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 55) ==== 8370+0+0 (secure 0 0 0) 0x7f945401c070 con 0x55dbf8db6a30 2024-09-19T07:26:29.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.502+0000 7f9464309740 10 client.17589 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T07:26:29.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.502+0000 7f9464309740 10 client.17589 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:26:29.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.502+0000 7f9464309740 20 client.17589 populate_metadata read hostname 'smithi148' 2024-09-19T07:26:29.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.502+0000 7f9464309740 1 --2- 172.21.15.148:0/426650200 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55dbf8dc67b0 0x55dbf8dc8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:29.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.502+0000 7f9464309740 4 client.17589 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:26:29.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.502+0000 7f9464309740 1 -- 172.21.15.148:0/426650200 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dbf8d1d890 con 0x55dbf8dc67b0 2024-09-19T07:26:29.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.502+0000 7f945b7fe640 1 --2- 172.21.15.148:0/426650200 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55dbf8dc67b0 0x55dbf8dc8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:29.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.502+0000 7f943affd640 10 client.17589 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:26:29.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.502+0000 7f945b7fe640 1 --2- 172.21.15.148:0/426650200 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55dbf8dc67b0 0x55dbf8dc8c70 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d095f08905720fb server_cookie=dec201baaafaa60a in_seq=0 out_seq=0 2024-09-19T07:26:29.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.503+0000 7f943affd640 1 -- 172.21.15.148:0/426650200 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dbf8d1d890 con 0x55dbf8dc67b0 2024-09-19T07:26:29.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.503+0000 7f943affd640 10 client.17589 handle_command_reply: tid=0 2024-09-19T07:26:29.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.503+0000 7f9464309740 1 client.17589 shutdown 2024-09-19T07:26:29.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.503+0000 7f9464309740 1 -- 172.21.15.148:0/426650200 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf8db6a30 msgr2=0x55dbf8db4300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:29.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.503+0000 7f9464309740 1 --2- 172.21.15.148:0/426650200 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf8db6a30 0x55dbf8db4300 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f9454003c50 tx=0x7f9454004ab0 comp rx=0 tx=0).stop 2024-09-19T07:26:29.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.503+0000 7f9464309740 1 -- 172.21.15.148:0/426650200 shutdown_connections 2024-09-19T07:26:29.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.503+0000 7f9464309740 1 --2- 172.21.15.148:0/426650200 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55dbf8dc67b0 0x55dbf8dc8c70 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:29.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.503+0000 7f9464309740 1 --2- 172.21.15.148:0/426650200 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf8db6a30 0x55dbf8db4300 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:29.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.503+0000 7f9464309740 1 --2- 172.21.15.148:0/426650200 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dbf8dac170 0x55dbf8db3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:29.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.503+0000 7f9464309740 1 --2- 172.21.15.148:0/426650200 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dbf8dab850 0x55dbf8db3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:29.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.503+0000 7f9464309740 1 -- 172.21.15.148:0/426650200 >> 172.21.15.148:0/426650200 conn(0x55dbf8da7de0 msgr2=0x55dbf8dadb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:29.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.503+0000 7f943affd640 0 client.17589 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:26:29.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.503+0000 7f9464309740 1 -- 172.21.15.148:0/426650200 shutdown_connections 2024-09-19T07:26:29.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.503+0000 7f9464309740 1 -- 172.21.15.148:0/426650200 wait complete. 2024-09-19T07:26:29.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.504+0000 7f9464309740 20 client.17589 trim_cache size 0 max 16384 2024-09-19T07:26:29.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.521+0000 7f9464309740 1 Processor -- start 2024-09-19T07:26:29.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.521+0000 7f9464309740 1 -- start start 2024-09-19T07:26:29.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.521+0000 7f9464309740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf8dab850 0x55dbf8dae300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:29.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.521+0000 7f9464309740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dbf8dac170 0x55dbf8db3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:29.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.521+0000 7f9464309740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dbf8db6a30 0x55dbf8dce540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:29.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.521+0000 7f9464309740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f945c1b02b0 con 0x55dbf8dab850 2024-09-19T07:26:29.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.521+0000 7f9464309740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f945c1adac0 con 0x55dbf8dac170 2024-09-19T07:26:29.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.521+0000 7f9464309740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f945c1ab930 con 0x55dbf8db6a30 2024-09-19T07:26:29.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.521+0000 7f945b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf8dab850 0x55dbf8dae300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:29.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.521+0000 7f945b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf8dab850 0x55dbf8dae300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59476/0 (socket says 172.21.15.148:59476) 2024-09-19T07:26:29.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.521+0000 7f945b7fe640 1 -- 172.21.15.148:0/2222919315 learned_addr learned my addr 172.21.15.148:0/2222919315 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:26:29.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.521+0000 7f945affd640 1 --2- 172.21.15.148:0/2222919315 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dbf8dac170 0x55dbf8db3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:29.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.521+0000 7f945bfff640 1 --2- 172.21.15.148:0/2222919315 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dbf8db6a30 0x55dbf8dce540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:29.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.521+0000 7f945b7fe640 1 -- 172.21.15.148:0/2222919315 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dbf8db6a30 msgr2=0x55dbf8dce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:29.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.521+0000 7f945b7fe640 1 --2- 172.21.15.148:0/2222919315 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dbf8db6a30 0x55dbf8dce540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:29.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.521+0000 7f945b7fe640 1 -- 172.21.15.148:0/2222919315 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dbf8dac170 msgr2=0x55dbf8db3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:29.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.521+0000 7f945b7fe640 1 --2- 172.21.15.148:0/2222919315 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dbf8dac170 0x55dbf8db3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:29.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.521+0000 7f945b7fe640 1 -- 172.21.15.148:0/2222919315 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbf8da7c10 con 0x55dbf8dab850 2024-09-19T07:26:29.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.521+0000 7f945affd640 1 --2- 172.21.15.148:0/2222919315 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dbf8dac170 0x55dbf8db3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:26:29.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.521+0000 7f945b7fe640 1 --2- 172.21.15.148:0/2222919315 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf8dab850 0x55dbf8dae300 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f944c032d50 tx=0x7f944c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e350a8837b8fbbd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:29.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.522+0000 7f94417fa640 1 -- 172.21.15.148:0/2222919315 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f944c03f040 con 0x55dbf8dab850 2024-09-19T07:26:29.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.522+0000 7f94417fa640 1 -- 172.21.15.148:0/2222919315 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f944c031970 con 0x55dbf8dab850 2024-09-19T07:26:29.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.522+0000 7f94417fa640 1 -- 172.21.15.148:0/2222919315 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f944c035040 con 0x55dbf8dab850 2024-09-19T07:26:29.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.522+0000 7f9464309740 1 -- 172.21.15.148:0/2222919315 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf8dab850 msgr2=0x55dbf8dae300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:29.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.522+0000 7f9464309740 1 --2- 172.21.15.148:0/2222919315 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf8dab850 0x55dbf8dae300 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f944c032d50 tx=0x7f944c000bc0 comp rx=0 tx=0).stop 2024-09-19T07:26:29.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.522+0000 7f9464309740 1 -- 172.21.15.148:0/2222919315 shutdown_connections 2024-09-19T07:26:29.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.522+0000 7f9464309740 1 --2- 172.21.15.148:0/2222919315 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dbf8db6a30 0x55dbf8dce540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:29.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.522+0000 7f9464309740 1 --2- 172.21.15.148:0/2222919315 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dbf8dac170 0x55dbf8db3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:29.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.522+0000 7f9464309740 1 --2- 172.21.15.148:0/2222919315 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf8dab850 0x55dbf8dae300 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:29.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.522+0000 7f9464309740 1 -- 172.21.15.148:0/2222919315 >> 172.21.15.148:0/2222919315 conn(0x55dbf8da7de0 msgr2=0x55dbf8db3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:29.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.522+0000 7f9464309740 1 -- 172.21.15.148:0/2222919315 shutdown_connections 2024-09-19T07:26:29.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.522+0000 7f9464309740 1 -- 172.21.15.148:0/2222919315 wait complete. 2024-09-19T07:26:29.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.523+0000 7f9464309740 1 -- start start 2024-09-19T07:26:29.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.523+0000 7f9464309740 1 Processor -- start 2024-09-19T07:26:29.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.523+0000 7f9464309740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf8dab850 0x55dbf8dbea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:29.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.523+0000 7f9464309740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dbf8dac170 0x55dbf8dbef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:29.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.523+0000 7f9464309740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dbf8db6a30 0x55dbf8dbb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:29.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.523+0000 7f9464309740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f945c1abf80 con 0x55dbf8dab850 2024-09-19T07:26:29.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.523+0000 7f9464309740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f945c1ad3f0 con 0x55dbf8db6a30 2024-09-19T07:26:29.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.523+0000 7f9464309740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f945c1ac650 con 0x55dbf8dac170 2024-09-19T07:26:29.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.523+0000 7f9464309740 10 client.0 _ll_register_callbacks cb 0x7f94540124d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:26:29.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.523+0000 7f945b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf8dab850 0x55dbf8dbea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:29.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.523+0000 7f945b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf8dab850 0x55dbf8dbea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59482/0 (socket says 172.21.15.148:59482) 2024-09-19T07:26:29.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.523+0000 7f945b7fe640 1 -- 172.21.15.148:0/2394506989 learned_addr learned my addr 172.21.15.148:0/2394506989 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:26:29.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.523+0000 7f945bfff640 1 --2- 172.21.15.148:0/2394506989 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dbf8db6a30 0x55dbf8dbb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:29.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.523+0000 7f945affd640 1 --2- 172.21.15.148:0/2394506989 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dbf8dac170 0x55dbf8dbef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:29.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.524+0000 7f945b7fe640 1 -- 172.21.15.148:0/2394506989 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dbf8dac170 msgr2=0x55dbf8dbef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:29.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.524+0000 7f945b7fe640 1 --2- 172.21.15.148:0/2394506989 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dbf8dac170 0x55dbf8dbef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:29.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.524+0000 7f945b7fe640 1 -- 172.21.15.148:0/2394506989 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dbf8db6a30 msgr2=0x55dbf8dbb9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:29.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.524+0000 7f945b7fe640 1 --2- 172.21.15.148:0/2394506989 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dbf8db6a30 0x55dbf8dbb9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:29.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.524+0000 7f945b7fe640 1 -- 172.21.15.148:0/2394506989 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbf8da33f0 con 0x55dbf8dab850 2024-09-19T07:26:29.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.524+0000 7f945bfff640 1 --2- 172.21.15.148:0/2394506989 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dbf8db6a30 0x55dbf8dbb9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:26:29.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.524+0000 7f945b7fe640 1 --2- 172.21.15.148:0/2394506989 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf8dab850 0x55dbf8dbea00 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f944c02a450 tx=0x7f944c02ab20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42d1fa3543bcbd75 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:29.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.524+0000 7f943affd640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:26:29.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.524+0000 7f943affd640 1 -- 172.21.15.148:0/2394506989 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f944c035050 con 0x55dbf8dab850 2024-09-19T07:26:29.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.524+0000 7f943affd640 1 -- 172.21.15.148:0/2394506989 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8600+0+0 (secure 0 0 0) 0x7f944c005410 con 0x55dbf8dab850 2024-09-19T07:26:29.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.524+0000 7f9464309740 1 -- 172.21.15.148:0/2394506989 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f944c031970 con 0x55dbf8dab850 2024-09-19T07:26:29.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.524+0000 7f943affd640 1 -- 172.21.15.148:0/2394506989 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f944c065050 con 0x55dbf8dab850 2024-09-19T07:26:29.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.524+0000 7f9464309740 10 client.17595 fetch_fsmap learned FSMap version 55 2024-09-19T07:26:29.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.524+0000 7f9464309740 1 -- 172.21.15.148:0/2394506989 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x55dbf8e31b60 con 0x55dbf8dab850 2024-09-19T07:26:29.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.524+0000 7f943affd640 1 -- 172.21.15.148:0/2394506989 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f944c031970 con 0x55dbf8dab850 2024-09-19T07:26:29.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.524+0000 7f943affd640 1 -- 172.21.15.148:0/2394506989 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 55) ==== 8370+0+0 (secure 0 0 0) 0x7f944c04c070 con 0x55dbf8dab850 2024-09-19T07:26:29.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.524+0000 7f9464309740 10 client.17595 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T07:26:29.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.525+0000 7f9464309740 10 client.17595 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:26:29.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.525+0000 7f9464309740 20 client.17595 populate_metadata read hostname 'smithi148' 2024-09-19T07:26:29.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.525+0000 7f9464309740 1 --2- 172.21.15.148:0/2394506989 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55dbf8e31df0 0x55dbf8e341e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:29.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.525+0000 7f9464309740 4 client.17595 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.45, "await_for": 45.0}] 2024-09-19T07:26:29.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.525+0000 7f9464309740 1 -- 172.21.15.148:0/2394506989 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.45, "await_for": 45.0}) -- 0x55dbf8d17be0 con 0x55dbf8e31df0 2024-09-19T07:26:29.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.525+0000 7f945affd640 1 --2- 172.21.15.148:0/2394506989 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55dbf8e31df0 0x55dbf8e341e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:29.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.525+0000 7f945affd640 1 --2- 172.21.15.148:0/2394506989 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55dbf8e31df0 0x55dbf8e341e0 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5eced1123cc64eb2 server_cookie=1a32ba0e87df9037 in_seq=0 out_seq=0 2024-09-19T07:26:29.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:29.525+0000 7f943affd640 10 client.17595 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:26:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.956+0000 7f1941601640 1 -- 172.21.15.148:0/1716763129 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f193c101350 msgr2=0x7f193c10d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.956+0000 7f1941601640 1 --2- 172.21.15.148:0/1716763129 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f193c101350 0x7f193c10d880 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f1934009cd0 tx=0x7f193402a8e0 comp rx=0 tx=0).stop 2024-09-19T07:26:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.956+0000 7f1941601640 1 -- 172.21.15.148:0/1716763129 shutdown_connections 2024-09-19T07:26:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.956+0000 7f1941601640 1 --2- 172.21.15.148:0/1716763129 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f193c101350 0x7f193c10d880 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.956+0000 7f1941601640 1 --2- 172.21.15.148:0/1716763129 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f193c1009b0 0x7f193c100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.956+0000 7f1941601640 1 --2- 172.21.15.148:0/1716763129 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f193c1069c0 0x7f193c106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.956+0000 7f1941601640 1 -- 172.21.15.148:0/1716763129 >> 172.21.15.148:0/1716763129 conn(0x7f193c077990 msgr2=0x7f193c0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.956+0000 7f1941601640 1 -- 172.21.15.148:0/1716763129 shutdown_connections 2024-09-19T07:26:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.956+0000 7f1941601640 1 -- 172.21.15.148:0/1716763129 wait complete. 2024-09-19T07:26:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.957+0000 7f1941601640 1 Processor -- start 2024-09-19T07:26:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.957+0000 7f1941601640 1 -- start start 2024-09-19T07:26:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.957+0000 7f1941601640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f193c1009b0 0x7f193c198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.957+0000 7f1941601640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f193c101350 0x7f193c198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.957+0000 7f1941601640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f193c1069c0 0x7f193c19cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.957+0000 7f1941601640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f193c110e00 con 0x7f193c101350 2024-09-19T07:26:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.957+0000 7f1941601640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f193c110c80 con 0x7f193c1009b0 2024-09-19T07:26:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.957+0000 7f1941601640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f193c110f80 con 0x7f193c1069c0 2024-09-19T07:26:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.958+0000 7f19327fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f193c101350 0x7f193c198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.958+0000 7f193b7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f193c1069c0 0x7f193c19cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:30.961 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.958+0000 7f193b7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f193c1069c0 0x7f193c19cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:49726/0 (socket says 172.21.15.148:49726) 2024-09-19T07:26:30.961 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.958+0000 7f19327fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f193c101350 0x7f193c198860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59502/0 (socket says 172.21.15.148:59502) 2024-09-19T07:26:30.961 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.958+0000 7f193b7fe640 1 -- 172.21.15.148:0/2791218193 learned_addr learned my addr 172.21.15.148:0/2791218193 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:26:30.961 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.958+0000 7f193affd640 1 --2- 172.21.15.148:0/2791218193 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f193c1009b0 0x7f193c198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:30.961 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.958+0000 7f193b7fe640 1 -- 172.21.15.148:0/2791218193 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f193c1009b0 msgr2=0x7f193c198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:30.961 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.958+0000 7f193b7fe640 1 --2- 172.21.15.148:0/2791218193 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f193c1009b0 0x7f193c198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:30.961 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.958+0000 7f193b7fe640 1 -- 172.21.15.148:0/2791218193 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f193c101350 msgr2=0x7f193c198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:30.961 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.958+0000 7f193b7fe640 1 --2- 172.21.15.148:0/2791218193 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f193c101350 0x7f193c198860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:30.961 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.958+0000 7f193b7fe640 1 -- 172.21.15.148:0/2791218193 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f193c19d310 con 0x7f193c1069c0 2024-09-19T07:26:30.961 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.958+0000 7f193b7fe640 1 --2- 172.21.15.148:0/2791218193 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f193c1069c0 0x7f193c19cbe0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1934005cc0 tx=0x7f1934032f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:30.961 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.958+0000 7f1938ff9640 1 -- 172.21.15.148:0/2791218193 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1934004040 con 0x7f193c1069c0 2024-09-19T07:26:30.961 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.958+0000 7f1941601640 1 -- 172.21.15.148:0/2791218193 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f193c19d5a0 con 0x7f193c1069c0 2024-09-19T07:26:30.961 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.958+0000 7f1938ff9640 1 -- 172.21.15.148:0/2791218193 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19340046c0 con 0x7f193c1069c0 2024-09-19T07:26:30.962 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.958+0000 7f1938ff9640 1 -- 172.21.15.148:0/2791218193 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1934030c20 con 0x7f193c1069c0 2024-09-19T07:26:30.962 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.958+0000 7f1941601640 1 -- 172.21.15.148:0/2791218193 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f193c1a4e90 con 0x7f193c1069c0 2024-09-19T07:26:30.963 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.962+0000 7f1944471740 1 Processor -- start 2024-09-19T07:26:30.964 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.962+0000 7f1938ff9640 1 -- 172.21.15.148:0/2791218193 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f19340305a0 con 0x7f193c1069c0 2024-09-19T07:26:30.964 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.962+0000 7f1944471740 1 -- start start 2024-09-19T07:26:30.964 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.962+0000 7f1944471740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55792b43eaf0 0x55792b43eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:30.964 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.962+0000 7f1944471740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55792b43f410 0x55792b449770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:30.964 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.962+0000 7f1944471740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55792b449cb0 0x55792b44c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:30.964 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.962+0000 7f1944471740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55792b3a32f0 con 0x55792b43f410 2024-09-19T07:26:30.964 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.962+0000 7f1944471740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55792b34b270 con 0x55792b449cb0 2024-09-19T07:26:30.964 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.962+0000 7f1944471740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55792b39f2b0 con 0x55792b43eaf0 2024-09-19T07:26:30.964 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.962+0000 7f19327fc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55792b43eaf0 0x55792b43eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:30.964 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.962+0000 7f193affd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55792b43f410 0x55792b449770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:30.964 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.962+0000 7f19327fc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55792b43eaf0 0x55792b43eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:49736/0 (socket says 172.21.15.148:49736) 2024-09-19T07:26:30.965 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.962+0000 7f19327fc640 1 -- 172.21.15.148:0/249102831 learned_addr learned my addr 172.21.15.148:0/249102831 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:26:30.965 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.962+0000 7f19327fc640 1 --2- 172.21.15.148:0/249102831 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55792b449cb0 0x55792b44c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:30.965 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.963+0000 7f19327fc640 1 -- 172.21.15.148:0/249102831 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55792b449cb0 msgr2=0x55792b44c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:30.965 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.963+0000 7f19327fc640 1 --2- 172.21.15.148:0/249102831 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55792b449cb0 0x55792b44c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:30.965 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.963+0000 7f1938ff9640 1 --2- 172.21.15.148:0/2791218193 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f19280a3460 0x7f19280a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:30.965 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.963+0000 7f19327fc640 1 -- 172.21.15.148:0/249102831 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55792b43f410 msgr2=0x55792b449770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:30.965 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.963+0000 7f19327fc640 1 --2- 172.21.15.148:0/249102831 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55792b43f410 0x55792b449770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:30.965 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.963+0000 7f19327fc640 1 -- 172.21.15.148:0/249102831 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55792b34a340 con 0x55792b43eaf0 2024-09-19T07:26:30.965 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.963+0000 7f193b7fe640 1 --2- 172.21.15.148:0/2791218193 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f19280a3460 0x7f19280a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:30.966 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.963+0000 7f19327fc640 1 --2- 172.21.15.148:0/249102831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55792b43eaf0 0x55792b43eed0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1924011810 tx=0x7f19240097d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b80d9b3baa615d54 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:30.966 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.963+0000 7f1938ff9640 1 -- 172.21.15.148:0/2791218193 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8600+0+0 (secure 0 0 0) 0x7f19340f1250 con 0x7f193c1069c0 2024-09-19T07:26:30.966 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.963+0000 7f19317fa640 1 -- 172.21.15.148:0/249102831 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1924004030 con 0x55792b43eaf0 2024-09-19T07:26:30.966 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.963+0000 7f19317fa640 1 -- 172.21.15.148:0/249102831 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1924011e50 con 0x55792b43eaf0 2024-09-19T07:26:30.966 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.963+0000 7f19317fa640 1 -- 172.21.15.148:0/249102831 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1924003850 con 0x55792b43eaf0 2024-09-19T07:26:30.969 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.964+0000 7f1944471740 1 -- 172.21.15.148:0/249102831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55792b43eaf0 msgr2=0x55792b43eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:30.969 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.964+0000 7f193b7fe640 1 --2- 172.21.15.148:0/2791218193 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f19280a3460 0x7f19280a5920 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f19340eeb10 tx=0x7f193403d040 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:30.969 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.964+0000 7f1944471740 1 --2- 172.21.15.148:0/249102831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55792b43eaf0 0x55792b43eed0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1924011810 tx=0x7f19240097d0 comp rx=0 tx=0).stop 2024-09-19T07:26:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.964+0000 7f1944471740 1 -- 172.21.15.148:0/249102831 shutdown_connections 2024-09-19T07:26:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.964+0000 7f1944471740 1 --2- 172.21.15.148:0/249102831 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55792b449cb0 0x55792b44c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.964+0000 7f1944471740 1 --2- 172.21.15.148:0/249102831 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55792b43f410 0x55792b449770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.964+0000 7f1944471740 1 --2- 172.21.15.148:0/249102831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55792b43eaf0 0x55792b43eed0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.964+0000 7f1944471740 1 -- 172.21.15.148:0/249102831 >> 172.21.15.148:0/249102831 conn(0x55792b43b060 msgr2=0x55792b43b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.964+0000 7f1944471740 1 -- 172.21.15.148:0/249102831 shutdown_connections 2024-09-19T07:26:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.964+0000 7f1944471740 1 -- 172.21.15.148:0/249102831 wait complete. 2024-09-19T07:26:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.964+0000 7f1944471740 1 -- start start 2024-09-19T07:26:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.964+0000 7f1944471740 1 Processor -- start 2024-09-19T07:26:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.965+0000 7f1944471740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55792b43eaf0 0x55792b449620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.965+0000 7f1944471740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55792b43f410 0x55792b446b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:30.971 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.965+0000 7f1944471740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55792b449cb0 0x55792b447080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:30.971 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.965+0000 7f1944471740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55792b44c880 con 0x55792b43eaf0 2024-09-19T07:26:30.971 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.965+0000 7f1944471740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55792b32c290 con 0x55792b43f410 2024-09-19T07:26:30.971 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.965+0000 7f1944471740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55792b44ca00 con 0x55792b449cb0 2024-09-19T07:26:30.971 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.965+0000 7f1944471740 10 client.0 _ll_register_callbacks cb 0x55792b35d140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:26:30.971 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.965+0000 7f19327fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55792b43eaf0 0x55792b449620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:30.971 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.965+0000 7f19327fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55792b43eaf0 0x55792b449620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59508/0 (socket says 172.21.15.148:59508) 2024-09-19T07:26:30.971 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.965+0000 7f19327fc640 1 -- 172.21.15.148:0/738343488 learned_addr learned my addr 172.21.15.148:0/738343488 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:26:30.971 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.965+0000 7f193affd640 1 --2- 172.21.15.148:0/738343488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55792b43f410 0x55792b446b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:30.971 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.965+0000 7f19327fc640 1 --2- 172.21.15.148:0/738343488 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55792b449cb0 0x55792b447080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:30.971 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.965+0000 7f193affd640 1 -- 172.21.15.148:0/738343488 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55792b449cb0 msgr2=0x55792b447080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:30.971 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.965+0000 7f193affd640 1 --2- 172.21.15.148:0/738343488 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55792b449cb0 0x55792b447080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:30.971 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.965+0000 7f193affd640 1 -- 172.21.15.148:0/738343488 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55792b43eaf0 msgr2=0x55792b449620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:30.972 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.965+0000 7f193affd640 1 --2- 172.21.15.148:0/738343488 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55792b43eaf0 0x55792b449620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:30.972 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.965+0000 7f193affd640 1 -- 172.21.15.148:0/738343488 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55792b0b6210 con 0x55792b43f410 2024-09-19T07:26:30.972 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.965+0000 7f193affd640 1 --2- 172.21.15.148:0/738343488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55792b43f410 0x55792b446b40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f192c005fd0 tx=0x7f192c00de00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77993aa5fb4f675 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:30.972 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.965+0000 7f19227fc640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-19T07:26:30.972 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.966+0000 7f19227fc640 1 -- 172.21.15.148:0/738343488 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f192c005020 con 0x55792b43f410 2024-09-19T07:26:30.972 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.966+0000 7f19227fc640 1 -- 172.21.15.148:0/738343488 <== mon.2 v2:172.21.15.165:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8600+0+0 (secure 0 0 0) 0x7f192c0051c0 con 0x55792b43f410 2024-09-19T07:26:30.972 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.966+0000 7f1944471740 1 -- 172.21.15.148:0/738343488 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1924011e50 con 0x55792b43f410 2024-09-19T07:26:30.972 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.966+0000 7f19227fc640 1 -- 172.21.15.148:0/738343488 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f192c0053c0 con 0x55792b43f410 2024-09-19T07:26:30.972 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.966+0000 7f1944471740 10 client.26639 fetch_fsmap learned FSMap version 55 2024-09-19T07:26:30.972 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.966+0000 7f1944471740 1 -- 172.21.15.148:0/738343488 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x55792b182620 con 0x55792b43f410 2024-09-19T07:26:30.973 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.966+0000 7f19227fc640 1 -- 172.21.15.148:0/738343488 <== mon.2 v2:172.21.15.165:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1924011e50 con 0x55792b43f410 2024-09-19T07:26:30.973 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.966+0000 7f19227fc640 1 -- 172.21.15.148:0/738343488 <== mon.2 v2:172.21.15.165:3300/0 5 ==== fsmap(e 55) ==== 8370+0+0 (secure 0 0 0) 0x7f192c019030 con 0x55792b43f410 2024-09-19T07:26:30.973 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.966+0000 7f1944471740 10 client.26639 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T07:26:30.973 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.966+0000 7f1944471740 10 client.26639 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:26:30.973 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.966+0000 7f1944471740 20 client.26639 populate_metadata read hostname 'smithi148' 2024-09-19T07:26:30.973 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.966+0000 7f1944471740 1 --2- 172.21.15.148:0/738343488 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55792b4624d0 0x55792b4648c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:30.973 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.966+0000 7f1944471740 4 client.26639 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:26:30.973 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.966+0000 7f1944471740 1 -- 172.21.15.148:0/738343488 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55792b3b0a20 con 0x55792b4624d0 2024-09-19T07:26:30.973 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.966+0000 7f19327fc640 1 --2- 172.21.15.148:0/738343488 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55792b4624d0 0x55792b4648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:30.973 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.967+0000 7f19227fc640 10 client.26639 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:26:30.973 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:30.967+0000 7f19327fc640 1 --2- 172.21.15.148:0/738343488 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55792b4624d0 0x55792b4648c0 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b8c801b5c2d858c server_cookie=fbfda6362363c3df in_seq=0 out_seq=0 2024-09-19T07:26:31.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:26:30 smithi165 ceph-mon[35326]: pgmap v484: 97 pgs: 11 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 61 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 175 op/s 2024-09-19T07:26:31.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:26:30 smithi179 ceph-mon[35716]: pgmap v484: 97 pgs: 11 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 61 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 175 op/s 2024-09-19T07:26:31.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:26:30 smithi148 ceph-mon[31180]: pgmap v484: 97 pgs: 11 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 61 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 175 op/s 2024-09-19T07:26:31.750 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.749+0000 7f19227fc640 1 -- 172.21.15.148:0/738343488 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55792b3b0a20 con 0x55792b4624d0 2024-09-19T07:26:31.750 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.749+0000 7f19227fc640 10 client.26639 handle_command_reply: tid=0 2024-09-19T07:26:31.750 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.749+0000 7f1944471740 1 client.26639 shutdown 2024-09-19T07:26:31.751 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.749+0000 7f1944471740 1 -- 172.21.15.148:0/738343488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55792b43f410 msgr2=0x55792b446b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:31.751 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.749+0000 7f1944471740 1 --2- 172.21.15.148:0/738343488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55792b43f410 0x55792b446b40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f192c005fd0 tx=0x7f192c00de00 comp rx=0 tx=0).stop 2024-09-19T07:26:31.751 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.749+0000 7f1944471740 1 -- 172.21.15.148:0/738343488 shutdown_connections 2024-09-19T07:26:31.751 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.749+0000 7f1944471740 1 --2- 172.21.15.148:0/738343488 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55792b4624d0 0x55792b4648c0 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:31.751 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.749+0000 7f1944471740 1 --2- 172.21.15.148:0/738343488 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55792b449cb0 0x55792b447080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:31.751 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.749+0000 7f19227fc640 0 client.26639 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:26:31.751 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.749+0000 7f1944471740 1 --2- 172.21.15.148:0/738343488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55792b43f410 0x55792b446b40 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:31.751 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.749+0000 7f1944471740 1 --2- 172.21.15.148:0/738343488 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55792b43eaf0 0x55792b449620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:31.751 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.749+0000 7f1944471740 1 -- 172.21.15.148:0/738343488 >> 172.21.15.148:0/738343488 conn(0x55792b43b060 msgr2=0x55792b440dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:31.751 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.749+0000 7f1944471740 1 -- 172.21.15.148:0/738343488 shutdown_connections 2024-09-19T07:26:31.751 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.749+0000 7f1944471740 1 -- 172.21.15.148:0/738343488 wait complete. 2024-09-19T07:26:31.751 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.750+0000 7f1944471740 20 client.26639 trim_cache size 0 max 16384 2024-09-19T07:26:31.765 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.764+0000 7f1944471740 1 Processor -- start 2024-09-19T07:26:31.765 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.765+0000 7f1944471740 1 -- start start 2024-09-19T07:26:31.767 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.765+0000 7f1944471740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55792b43eaf0 0x55792b46a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:31.767 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.765+0000 7f1944471740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55792b43f410 0x55792b46a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:31.767 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.765+0000 7f1944471740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55792b449cb0 0x55792b4483a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:31.767 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.765+0000 7f1944471740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f193c1adf50 con 0x55792b43f410 2024-09-19T07:26:31.767 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.765+0000 7f1944471740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f193c1ab760 con 0x55792b43eaf0 2024-09-19T07:26:31.767 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.765+0000 7f1944471740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f193c1a95d0 con 0x55792b449cb0 2024-09-19T07:26:31.767 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.765+0000 7f193affd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55792b43f410 0x55792b46a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:31.767 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.765+0000 7f193affd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55792b43f410 0x55792b46a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59518/0 (socket says 172.21.15.148:59518) 2024-09-19T07:26:31.767 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.765+0000 7f193affd640 1 -- 172.21.15.148:0/4024445961 learned_addr learned my addr 172.21.15.148:0/4024445961 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:26:31.767 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.765+0000 7f19327fc640 1 --2- 172.21.15.148:0/4024445961 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55792b449cb0 0x55792b4483a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:31.768 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.765+0000 7f19327fc640 1 --2- 172.21.15.148:0/4024445961 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55792b43eaf0 0x55792b46a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:31.768 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.766+0000 7f193affd640 1 -- 172.21.15.148:0/4024445961 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55792b449cb0 msgr2=0x55792b4483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:31.768 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.766+0000 7f193affd640 1 --2- 172.21.15.148:0/4024445961 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55792b449cb0 0x55792b4483a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:31.768 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.766+0000 7f193affd640 1 -- 172.21.15.148:0/4024445961 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55792b43eaf0 msgr2=0x55792b46a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:31.768 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.766+0000 7f193affd640 1 --2- 172.21.15.148:0/4024445961 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55792b43eaf0 0x55792b46a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:31.768 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.766+0000 7f193affd640 1 -- 172.21.15.148:0/4024445961 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55792b43f240 con 0x55792b43f410 2024-09-19T07:26:31.768 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.766+0000 7f19327fc640 1 --2- 172.21.15.148:0/4024445961 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55792b43eaf0 0x55792b46a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:26:31.768 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.766+0000 7f193affd640 1 --2- 172.21.15.148:0/4024445961 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55792b43f410 0x55792b46a6b0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f192c011790 tx=0x7f192c011650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c5c8cf94ee52dd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:31.768 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.766+0000 7f1930ff9640 1 -- 172.21.15.148:0/4024445961 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f192c026040 con 0x55792b43f410 2024-09-19T07:26:31.768 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.766+0000 7f1930ff9640 1 -- 172.21.15.148:0/4024445961 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f192c011980 con 0x55792b43f410 2024-09-19T07:26:31.768 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.766+0000 7f1930ff9640 1 -- 172.21.15.148:0/4024445961 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f192c022d50 con 0x55792b43f410 2024-09-19T07:26:31.772 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.767+0000 7f1944471740 1 -- 172.21.15.148:0/4024445961 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55792b43f410 msgr2=0x55792b46a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:31.772 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.767+0000 7f1944471740 1 --2- 172.21.15.148:0/4024445961 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55792b43f410 0x55792b46a6b0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f192c011790 tx=0x7f192c011650 comp rx=0 tx=0).stop 2024-09-19T07:26:31.772 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.767+0000 7f1944471740 1 -- 172.21.15.148:0/4024445961 shutdown_connections 2024-09-19T07:26:31.772 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.767+0000 7f1944471740 1 --2- 172.21.15.148:0/4024445961 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55792b449cb0 0x55792b4483a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:31.772 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.767+0000 7f1944471740 1 --2- 172.21.15.148:0/4024445961 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55792b43f410 0x55792b46a6b0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:31.772 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.767+0000 7f1944471740 1 --2- 172.21.15.148:0/4024445961 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55792b43eaf0 0x55792b46a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:31.772 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.767+0000 7f1944471740 1 -- 172.21.15.148:0/4024445961 >> 172.21.15.148:0/4024445961 conn(0x55792b43b060 msgr2=0x55792b441e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:31.772 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.767+0000 7f1944471740 1 -- 172.21.15.148:0/4024445961 shutdown_connections 2024-09-19T07:26:31.772 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.767+0000 7f1944471740 1 -- 172.21.15.148:0/4024445961 wait complete. 2024-09-19T07:26:31.772 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.768+0000 7f1944471740 1 -- start start 2024-09-19T07:26:31.773 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.768+0000 7f1944471740 1 Processor -- start 2024-09-19T07:26:31.773 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.768+0000 7f1944471740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55792b43eaf0 0x55792b45ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:31.773 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.768+0000 7f1944471740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55792b43f410 0x55792b45f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:31.773 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.768+0000 7f1944471740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55792b449cb0 0x55792b443890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:31.773 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.768+0000 7f1944471740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f193c1a9c20 con 0x55792b449cb0 2024-09-19T07:26:31.773 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.768+0000 7f1944471740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f193c1ab090 con 0x55792b43f410 2024-09-19T07:26:31.773 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.768+0000 7f1944471740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f193c1aa2f0 con 0x55792b43eaf0 2024-09-19T07:26:31.773 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.768+0000 7f1944471740 10 client.0 _ll_register_callbacks cb 0x7f192c0043d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:26:31.773 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.768+0000 7f19327fc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55792b43eaf0 0x55792b45ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:31.773 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.768+0000 7f19327fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55792b449cb0 0x55792b443890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:31.773 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.768+0000 7f19327fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55792b449cb0 0x55792b443890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59522/0 (socket says 172.21.15.148:59522) 2024-09-19T07:26:31.773 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.768+0000 7f19327fc640 1 -- 172.21.15.148:0/1924344852 learned_addr learned my addr 172.21.15.148:0/1924344852 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:26:31.774 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.768+0000 7f193affd640 1 --2- 172.21.15.148:0/1924344852 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55792b43f410 0x55792b45f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:31.774 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.768+0000 7f19327fc640 1 -- 172.21.15.148:0/1924344852 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55792b43eaf0 msgr2=0x55792b45ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:31.774 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.768+0000 7f19327fc640 1 --2- 172.21.15.148:0/1924344852 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55792b43eaf0 0x55792b45ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:31.774 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.768+0000 7f19327fc640 1 -- 172.21.15.148:0/1924344852 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55792b43f410 msgr2=0x55792b45f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:31.774 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.768+0000 7f19327fc640 1 --2- 172.21.15.148:0/1924344852 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55792b43f410 0x55792b45f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:31.774 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.768+0000 7f19327fc640 1 -- 172.21.15.148:0/1924344852 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55792b444090 con 0x55792b449cb0 2024-09-19T07:26:31.774 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.769+0000 7f19327fc640 1 --2- 172.21.15.148:0/1924344852 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55792b449cb0 0x55792b443890 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f19240058c0 tx=0x7f1924009b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52184e1dab0107d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:31.774 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.769+0000 7f19227fc640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:26:31.774 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.769+0000 7f19227fc640 1 -- 172.21.15.148:0/1924344852 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1924034040 con 0x55792b449cb0 2024-09-19T07:26:31.774 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.769+0000 7f19227fc640 1 -- 172.21.15.148:0/1924344852 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8600+0+0 (secure 0 0 0) 0x7f192402fe80 con 0x55792b449cb0 2024-09-19T07:26:31.774 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.769+0000 7f1944471740 1 -- 172.21.15.148:0/1924344852 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f192c011980 con 0x55792b449cb0 2024-09-19T07:26:31.774 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.769+0000 7f19227fc640 1 -- 172.21.15.148:0/1924344852 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f1924005020 con 0x55792b449cb0 2024-09-19T07:26:31.774 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.769+0000 7f1944471740 10 client.17613 fetch_fsmap learned FSMap version 55 2024-09-19T07:26:31.775 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.769+0000 7f1944471740 1 -- 172.21.15.148:0/1924344852 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x55792b4ccdd0 con 0x55792b449cb0 2024-09-19T07:26:31.775 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.769+0000 7f19227fc640 1 -- 172.21.15.148:0/1924344852 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f192c011980 con 0x55792b449cb0 2024-09-19T07:26:31.775 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.769+0000 7f19227fc640 1 -- 172.21.15.148:0/1924344852 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 55) ==== 8370+0+0 (secure 0 0 0) 0x7f1924004770 con 0x55792b449cb0 2024-09-19T07:26:31.775 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.770+0000 7f1944471740 10 client.17613 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T07:26:31.775 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.770+0000 7f1944471740 10 client.17613 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:26:31.775 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.770+0000 7f1944471740 20 client.17613 populate_metadata read hostname 'smithi148' 2024-09-19T07:26:31.775 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.770+0000 7f1944471740 1 --2- 172.21.15.148:0/1924344852 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55792b4cd2f0 0x55792b4cf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:31.775 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.770+0000 7f1944471740 4 client.17613 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:26:31.775 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.770+0000 7f1944471740 1 -- 172.21.15.148:0/1924344852 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55792b3aad70 con 0x55792b4cd2f0 2024-09-19T07:26:31.775 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.770+0000 7f193affd640 1 --2- 172.21.15.148:0/1924344852 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55792b4cd2f0 0x55792b4cf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:31.775 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.770+0000 7f19227fc640 10 client.17613 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:26:31.775 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:31.770+0000 7f193affd640 1 --2- 172.21.15.148:0/1924344852 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55792b4cd2f0 0x55792b4cf6e0 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0d760079468ff60 server_cookie=18fe0e753ad6a9c1 in_seq=0 out_seq=0 2024-09-19T07:26:33.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:26:32 smithi165 ceph-mon[35326]: pgmap v485: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 238 op/s 2024-09-19T07:26:33.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:26:32 smithi179 ceph-mon[35716]: pgmap v485: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 238 op/s 2024-09-19T07:26:33.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:26:32 smithi148 ceph-mon[31180]: pgmap v485: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 238 op/s 2024-09-19T07:26:34.314 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:34.314+0000 7f19227fc640 1 -- 172.21.15.148:0/1924344852 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55792b3aad70 con 0x55792b4cd2f0 2024-09-19T07:26:34.314 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:34.314+0000 7f19227fc640 10 client.17613 handle_command_reply: tid=0 2024-09-19T07:26:34.314 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:34.314+0000 7f1944471740 1 client.17613 shutdown 2024-09-19T07:26:34.315 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:34.314+0000 7f1944471740 1 -- 172.21.15.148:0/1924344852 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55792b449cb0 msgr2=0x55792b443890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:34.315 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:34.314+0000 7f1944471740 1 --2- 172.21.15.148:0/1924344852 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55792b449cb0 0x55792b443890 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f19240058c0 tx=0x7f1924009b70 comp rx=0 tx=0).stop 2024-09-19T07:26:34.316 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:34.314+0000 7f1944471740 1 -- 172.21.15.148:0/1924344852 shutdown_connections 2024-09-19T07:26:34.316 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:34.314+0000 7f1944471740 1 --2- 172.21.15.148:0/1924344852 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55792b4cd2f0 0x55792b4cf6e0 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:34.316 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:34.314+0000 7f1944471740 1 --2- 172.21.15.148:0/1924344852 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55792b449cb0 0x55792b443890 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:34.316 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:34.314+0000 7f1944471740 1 --2- 172.21.15.148:0/1924344852 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55792b43f410 0x55792b45f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:34.316 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:34.314+0000 7f1944471740 1 --2- 172.21.15.148:0/1924344852 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55792b43eaf0 0x55792b45ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:34.316 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:34.314+0000 7f19227fc640 0 client.17613 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:26:34.316 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:34.314+0000 7f1944471740 1 -- 172.21.15.148:0/1924344852 >> 172.21.15.148:0/1924344852 conn(0x55792b43b060 msgr2=0x55792b4399a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:34.316 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:34.314+0000 7f1944471740 1 -- 172.21.15.148:0/1924344852 shutdown_connections 2024-09-19T07:26:34.316 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:34.315+0000 7f1944471740 1 -- 172.21.15.148:0/1924344852 wait complete. 2024-09-19T07:26:34.316 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:34.315+0000 7f1944471740 20 client.17613 trim_cache size 0 max 16384 2024-09-19T07:26:34.317 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:26:34.317 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:26:34.317 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:26:34.317 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:26:34.317 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:34.315+0000 7f1941601640 1 -- 172.21.15.148:0/2791218193 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f19280a3460 msgr2=0x7f19280a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:34.318 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:34.315+0000 7f1941601640 1 --2- 172.21.15.148:0/2791218193 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f19280a3460 0x7f19280a5920 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f19340eeb10 tx=0x7f193403d040 comp rx=0 tx=0).stop 2024-09-19T07:26:34.318 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:34.315+0000 7f1941601640 1 -- 172.21.15.148:0/2791218193 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f193c1069c0 msgr2=0x7f193c19cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:34.318 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:34.315+0000 7f1941601640 1 --2- 172.21.15.148:0/2791218193 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f193c1069c0 0x7f193c19cbe0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1934005cc0 tx=0x7f1934032f40 comp rx=0 tx=0).stop 2024-09-19T07:26:34.318 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:34.315+0000 7f1941601640 1 -- 172.21.15.148:0/2791218193 shutdown_connections 2024-09-19T07:26:34.318 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:34.315+0000 7f1941601640 1 --2- 172.21.15.148:0/2791218193 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f19280a3460 0x7f19280a5920 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:34.318 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:34.316+0000 7f1941601640 1 --2- 172.21.15.148:0/2791218193 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f193c1069c0 0x7f193c19cbe0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:34.318 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:34.316+0000 7f1941601640 1 --2- 172.21.15.148:0/2791218193 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f193c101350 0x7f193c198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:34.318 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:34.316+0000 7f1941601640 1 --2- 172.21.15.148:0/2791218193 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f193c1009b0 0x7f193c198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:34.319 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:34.316+0000 7f1941601640 1 -- 172.21.15.148:0/2791218193 >> 172.21.15.148:0/2791218193 conn(0x7f193c077990 msgr2=0x7f193c069a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:34.319 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:34.316+0000 7f1941601640 1 -- 172.21.15.148:0/2791218193 shutdown_connections 2024-09-19T07:26:34.319 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:34.316+0000 7f1941601640 1 -- 172.21.15.148:0/2791218193 wait complete. 2024-09-19T07:26:34.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:34.451+0000 7f943affd640 1 -- 172.21.15.148:0/2394506989 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55dbf8d17be0 con 0x55dbf8e31df0 2024-09-19T07:26:34.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:34.451+0000 7f943affd640 10 client.17595 handle_command_reply: tid=0 2024-09-19T07:26:34.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:34.451+0000 7f9464309740 1 client.17595 shutdown 2024-09-19T07:26:34.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:34.451+0000 7f9464309740 1 -- 172.21.15.148:0/2394506989 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf8dab850 msgr2=0x55dbf8dbea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:34.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:34.451+0000 7f9464309740 1 --2- 172.21.15.148:0/2394506989 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf8dab850 0x55dbf8dbea00 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f944c02a450 tx=0x7f944c02ab20 comp rx=0 tx=0).stop 2024-09-19T07:26:34.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:34.452+0000 7f9464309740 1 -- 172.21.15.148:0/2394506989 shutdown_connections 2024-09-19T07:26:34.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:34.452+0000 7f9464309740 1 --2- 172.21.15.148:0/2394506989 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55dbf8e31df0 0x55dbf8e341e0 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:34.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:34.452+0000 7f9464309740 1 --2- 172.21.15.148:0/2394506989 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dbf8db6a30 0x55dbf8dbb9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:34.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:34.452+0000 7f9464309740 1 --2- 172.21.15.148:0/2394506989 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dbf8dac170 0x55dbf8dbef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:34.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:34.452+0000 7f9464309740 1 --2- 172.21.15.148:0/2394506989 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dbf8dab850 0x55dbf8dbea00 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:34.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:34.452+0000 7f943affd640 0 client.17595 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:26:34.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:34.452+0000 7f9464309740 1 -- 172.21.15.148:0/2394506989 >> 172.21.15.148:0/2394506989 conn(0x55dbf8da7de0 msgr2=0x55dbf8da6ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:34.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:34.452+0000 7f9464309740 1 -- 172.21.15.148:0/2394506989 shutdown_connections 2024-09-19T07:26:34.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:34.452+0000 7f9464309740 1 -- 172.21.15.148:0/2394506989 wait complete. 2024-09-19T07:26:34.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:34.452+0000 7f9464309740 20 client.17595 trim_cache size 0 max 16384 2024-09-19T07:26:34.454 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:26:34.454 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 55, 2024-09-19T07:26:34.455 INFO:teuthology.orchestra.run.smithi148.stdout: "leader": 24457, 2024-09-19T07:26:34.455 INFO:teuthology.orchestra.run.smithi148.stdout: "set_version": 50, 2024-09-19T07:26:34.455 INFO:teuthology.orchestra.run.smithi148.stdout: "sets": { 2024-09-19T07:26:34.455 INFO:teuthology.orchestra.run.smithi148.stdout: "aac99a66": { 2024-09-19T07:26:34.455 INFO:teuthology.orchestra.run.smithi148.stdout: "version": 50, 2024-09-19T07:26:34.455 INFO:teuthology.orchestra.run.smithi148.stdout: "age_ref": 0.0, 2024-09-19T07:26:34.455 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:26:34.455 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "QUIESCED", 2024-09-19T07:26:34.455 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:26:34.455 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:26:34.455 INFO:teuthology.orchestra.run.smithi148.stdout: "timeout": 90.0, 2024-09-19T07:26:34.455 INFO:teuthology.orchestra.run.smithi148.stdout: "expiration": 149.4, 2024-09-19T07:26:34.455 INFO:teuthology.orchestra.run.smithi148.stdout: "members": { 2024-09-19T07:26:34.456 INFO:teuthology.orchestra.run.smithi148.stdout: "file:/": { 2024-09-19T07:26:34.456 INFO:teuthology.orchestra.run.smithi148.stdout: "excluded": false, 2024-09-19T07:26:34.456 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:26:34.456 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "QUIESCED", 2024-09-19T07:26:34.456 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:26:34.456 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:26:34.456 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:26:34.456 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:26:34.456 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:26:34.456 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:26:34.456 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:26:34.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:34.453+0000 7f9461f30640 1 -- 172.21.15.148:0/3189900035 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f94440a33b0 msgr2=0x7f94440a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:34.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:34.453+0000 7f9461f30640 1 --2- 172.21.15.148:0/3189900035 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f94440a33b0 0x7f94440a5870 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f94540098b0 tx=0x7f9454009840 comp rx=0 tx=0).stop 2024-09-19T07:26:34.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:34.453+0000 7f9461f30640 1 -- 172.21.15.148:0/3189900035 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f945c101420 msgr2=0x7f945c198980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:34.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:34.453+0000 7f9461f30640 1 --2- 172.21.15.148:0/3189900035 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f945c101420 0x7f945c198980 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f945000c890 tx=0x7f945000cd50 comp rx=0 tx=0).stop 2024-09-19T07:26:34.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:34.453+0000 7f9461f30640 1 -- 172.21.15.148:0/3189900035 shutdown_connections 2024-09-19T07:26:34.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:34.453+0000 7f9461f30640 1 --2- 172.21.15.148:0/3189900035 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f94440a33b0 0x7f94440a5870 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:34.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:34.453+0000 7f9461f30640 1 --2- 172.21.15.148:0/3189900035 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f945c106a80 0x7f945c19cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:34.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:34.453+0000 7f9461f30640 1 --2- 172.21.15.148:0/3189900035 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f945c101420 0x7f945c198980 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:34.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:34.453+0000 7f9461f30640 1 --2- 172.21.15.148:0/3189900035 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f945c100a80 0x7f945c198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:34.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:34.453+0000 7f9461f30640 1 -- 172.21.15.148:0/3189900035 >> 172.21.15.148:0/3189900035 conn(0x7f945c0fc7a0 msgr2=0x7f945c0fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:34.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:34.453+0000 7f9461f30640 1 -- 172.21.15.148:0/3189900035 shutdown_connections 2024-09-19T07:26:34.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:34.453+0000 7f9461f30640 1 -- 172.21.15.148:0/3189900035 wait complete. 2024-09-19T07:26:35.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:26:34 smithi165 ceph-mon[35326]: pgmap v486: 97 pgs: 97 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 184 op/s 2024-09-19T07:26:35.183 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:26:34 smithi148 ceph-mon[31180]: pgmap v486: 97 pgs: 97 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 184 op/s 2024-09-19T07:26:35.212 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'aac99a66', quiesce took 9.4 seconds. Will release after: 20.049999999999997 2024-09-19T07:26:35.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:26:34 smithi179 ceph-mon[35716]: pgmap v486: 97 pgs: 97 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 184 op/s 2024-09-19T07:26:37.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:26:36 smithi165 ceph-mon[35326]: pgmap v487: 97 pgs: 97 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 274 op/s 2024-09-19T07:26:37.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:26:36 smithi179 ceph-mon[35716]: pgmap v487: 97 pgs: 97 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 274 op/s 2024-09-19T07:26:37.332 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:26:36 smithi148 ceph-mon[31180]: pgmap v487: 97 pgs: 97 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 274 op/s 2024-09-19T07:26:39.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:26:38 smithi165 ceph-mon[35326]: pgmap v488: 97 pgs: 97 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 900 KiB/s rd, 800 KiB/s wr, 211 op/s 2024-09-19T07:26:39.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:26:38 smithi165 ceph-mon[35326]: osdmap e100: 12 total, 12 up, 12 in 2024-09-19T07:26:39.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:26:38 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:26:39.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:26:38 smithi179 ceph-mon[35716]: pgmap v488: 97 pgs: 97 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 900 KiB/s rd, 800 KiB/s wr, 211 op/s 2024-09-19T07:26:39.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:26:38 smithi179 ceph-mon[35716]: osdmap e100: 12 total, 12 up, 12 in 2024-09-19T07:26:39.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:26:38 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:26:39.332 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:26:38 smithi148 ceph-mon[31180]: pgmap v488: 97 pgs: 97 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 900 KiB/s rd, 800 KiB/s wr, 211 op/s 2024-09-19T07:26:39.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:26:38 smithi148 ceph-mon[31180]: osdmap e100: 12 total, 12 up, 12 in 2024-09-19T07:26:39.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:26:38 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:26:40.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:26:39 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:26:40.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:26:39 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:26:40.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:26:39 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:26:40.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:26:39 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:26:40.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:26:39 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:26:40.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:26:39 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:26:40.332 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:26:39 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:26:40.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:26:39 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:26:40.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:26:39 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:26:41.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:26:41 smithi165 ceph-mon[35326]: pgmap v490: 97 pgs: 97 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 960 KiB/s wr, 231 op/s 2024-09-19T07:26:41.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:26:41 smithi179 ceph-mon[35716]: pgmap v490: 97 pgs: 97 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 960 KiB/s wr, 231 op/s 2024-09-19T07:26:41.832 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:26:41 smithi148 ceph-mon[31180]: pgmap v490: 97 pgs: 97 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 960 KiB/s wr, 231 op/s 2024-09-19T07:26:43.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:26:43 smithi165 ceph-mon[35326]: pgmap v491: 97 pgs: 97 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 253 KiB/s wr, 140 op/s 2024-09-19T07:26:43.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:26:43 smithi179 ceph-mon[35716]: pgmap v491: 97 pgs: 97 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 253 KiB/s wr, 140 op/s 2024-09-19T07:26:43.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:26:43 smithi148 ceph-mon[31180]: pgmap v491: 97 pgs: 97 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 253 KiB/s wr, 140 op/s 2024-09-19T07:26:45.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:26:45 smithi165 ceph-mon[35326]: pgmap v492: 97 pgs: 97 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 253 KiB/s wr, 127 op/s 2024-09-19T07:26:45.635 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:26:45 smithi148 ceph-mon[31180]: pgmap v492: 97 pgs: 97 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 253 KiB/s wr, 127 op/s 2024-09-19T07:26:45.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:26:45 smithi179 ceph-mon[35716]: pgmap v492: 97 pgs: 97 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 253 KiB/s wr, 127 op/s 2024-09-19T07:26:47.411 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.408+0000 7ff1e0af1640 1 -- 172.21.15.148:0/733649816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1dc101350 msgr2=0x7ff1dc10d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:47.411 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.408+0000 7ff1e0af1640 1 --2- 172.21.15.148:0/733649816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1dc101350 0x7ff1dc10d880 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4009cd0 tx=0x7ff1d402a8e0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.411 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.408+0000 7ff1e0af1640 1 -- 172.21.15.148:0/733649816 shutdown_connections 2024-09-19T07:26:47.411 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.408+0000 7ff1e0af1640 1 --2- 172.21.15.148:0/733649816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1dc101350 0x7ff1dc10d880 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.411 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.408+0000 7ff1e0af1640 1 --2- 172.21.15.148:0/733649816 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff1dc1009b0 0x7ff1dc100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.412 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.408+0000 7ff1e0af1640 1 --2- 172.21.15.148:0/733649816 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1dc1069c0 0x7ff1dc106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.412 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.408+0000 7ff1e0af1640 1 -- 172.21.15.148:0/733649816 >> 172.21.15.148:0/733649816 conn(0x7ff1dc077990 msgr2=0x7ff1dc0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:47.412 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.408+0000 7ff1e0af1640 1 -- 172.21.15.148:0/733649816 shutdown_connections 2024-09-19T07:26:47.412 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.408+0000 7ff1e0af1640 1 -- 172.21.15.148:0/733649816 wait complete. 2024-09-19T07:26:47.412 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.409+0000 7ff1e0af1640 1 Processor -- start 2024-09-19T07:26:47.412 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.409+0000 7ff1e0af1640 1 -- start start 2024-09-19T07:26:47.412 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.409+0000 7ff1e0af1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1dc1009b0 0x7ff1dc199170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:47.412 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.409+0000 7ff1e0af1640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff1dc101350 0x7ff1dc1996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:47.412 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.409+0000 7ff1e0af1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1dc1069c0 0x7ff1dc1a41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:47.412 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.409+0000 7ff1e0af1640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff1dc110e00 con 0x7ff1dc1009b0 2024-09-19T07:26:47.412 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.409+0000 7ff1e0af1640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff1dc110c80 con 0x7ff1dc101350 2024-09-19T07:26:47.413 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.409+0000 7ff1e0af1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff1dc110f80 con 0x7ff1dc1069c0 2024-09-19T07:26:47.413 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.409+0000 7ff1da59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1dc1009b0 0x7ff1dc199170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:47.413 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.409+0000 7ff1da59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1dc1009b0 0x7ff1dc199170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35164/0 (socket says 172.21.15.148:35164) 2024-09-19T07:26:47.413 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.409+0000 7ff1da59c640 1 -- 172.21.15.148:0/2187281530 learned_addr learned my addr 172.21.15.148:0/2187281530 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:26:47.413 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.409+0000 7ff1d9d9b640 1 --2- 172.21.15.148:0/2187281530 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff1dc101350 0x7ff1dc1996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:47.413 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.410+0000 7ff1dad9d640 1 --2- 172.21.15.148:0/2187281530 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1dc1069c0 0x7ff1dc1a41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:47.413 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.410+0000 7ff1da59c640 1 -- 172.21.15.148:0/2187281530 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1dc1069c0 msgr2=0x7ff1dc1a41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:47.413 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.410+0000 7ff1da59c640 1 --2- 172.21.15.148:0/2187281530 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1dc1069c0 0x7ff1dc1a41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.413 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.410+0000 7ff1da59c640 1 -- 172.21.15.148:0/2187281530 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff1dc101350 msgr2=0x7ff1dc1996b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:47.413 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.410+0000 7ff1da59c640 1 --2- 172.21.15.148:0/2187281530 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff1dc101350 0x7ff1dc1996b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.413 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.410+0000 7ff1da59c640 1 -- 172.21.15.148:0/2187281530 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1dc1a4730 con 0x7ff1dc1009b0 2024-09-19T07:26:47.413 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.410+0000 7ff1dad9d640 1 --2- 172.21.15.148:0/2187281530 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1dc1069c0 0x7ff1dc1a41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:26:47.413 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.410+0000 7ff1da59c640 1 --2- 172.21.15.148:0/2187281530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1dc1009b0 0x7ff1dc199170 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc00e9f0 tx=0x7ff1cc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:47.414 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.410+0000 7ff1cb7fe640 1 -- 172.21.15.148:0/2187281530 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc00cd80 con 0x7ff1dc1009b0 2024-09-19T07:26:47.414 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.410+0000 7ff1e0af1640 1 -- 172.21.15.148:0/2187281530 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1dc1a4900 con 0x7ff1dc1009b0 2024-09-19T07:26:47.414 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.410+0000 7ff1cb7fe640 1 -- 172.21.15.148:0/2187281530 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1cc005500 con 0x7ff1dc1009b0 2024-09-19T07:26:47.414 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.410+0000 7ff1cb7fe640 1 -- 172.21.15.148:0/2187281530 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc010690 con 0x7ff1dc1009b0 2024-09-19T07:26:47.414 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.410+0000 7ff1e0af1640 1 -- 172.21.15.148:0/2187281530 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1dc1a4e20 con 0x7ff1dc1009b0 2024-09-19T07:26:47.421 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.413+0000 7ff1e388b740 1 Processor -- start 2024-09-19T07:26:47.421 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.413+0000 7ff1cb7fe640 1 -- 172.21.15.148:0/2187281530 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7ff1cc0046c0 con 0x7ff1dc1009b0 2024-09-19T07:26:47.421 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.413+0000 7ff1e388b740 1 -- start start 2024-09-19T07:26:47.421 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.413+0000 7ff1e388b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2bfcdb9d0 0x55a2bfcdbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:47.421 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.413+0000 7ff1e388b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a2bfcdc2f0 0x55a2bfceab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:47.421 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.413+0000 7ff1e388b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a2bfceb0c0 0x55a2bfced4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:47.421 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.413+0000 7ff1e388b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55a2bfc402f0 con 0x55a2bfceb0c0 2024-09-19T07:26:47.421 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.413+0000 7ff1e388b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55a2bfbe8270 con 0x55a2bfcdc2f0 2024-09-19T07:26:47.421 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.413+0000 7ff1e388b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a2bfc3c2b0 con 0x55a2bfcdb9d0 2024-09-19T07:26:47.421 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.414+0000 7ff1d9d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a2bfceb0c0 0x55a2bfced4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:47.422 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.414+0000 7ff1d9d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a2bfceb0c0 0x55a2bfced4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35170/0 (socket says 172.21.15.148:35170) 2024-09-19T07:26:47.422 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.414+0000 7ff1d9d9b640 1 -- 172.21.15.148:0/3890481082 learned_addr learned my addr 172.21.15.148:0/3890481082 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:26:47.422 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.414+0000 7ff1dad9d640 1 --2- 172.21.15.148:0/3890481082 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2bfcdb9d0 0x55a2bfcdbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:47.422 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.414+0000 7ff1da59c640 1 --2- 172.21.15.148:0/3890481082 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a2bfcdc2f0 0x55a2bfceab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:47.422 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.414+0000 7ff1d9d9b640 1 -- 172.21.15.148:0/3890481082 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2bfcdb9d0 msgr2=0x55a2bfcdbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:47.422 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.414+0000 7ff1d9d9b640 1 --2- 172.21.15.148:0/3890481082 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2bfcdb9d0 0x55a2bfcdbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.422 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.414+0000 7ff1cb7fe640 1 --2- 172.21.15.148:0/2187281530 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7ff1c40a3460 0x7ff1c40a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:47.422 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.414+0000 7ff1d9d9b640 1 -- 172.21.15.148:0/3890481082 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a2bfcdc2f0 msgr2=0x55a2bfceab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:47.422 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.414+0000 7ff1d9d9b640 1 --2- 172.21.15.148:0/3890481082 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a2bfcdc2f0 0x55a2bfceab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.422 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.414+0000 7ff1d9d9b640 1 -- 172.21.15.148:0/3890481082 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2bfbe7340 con 0x55a2bfceb0c0 2024-09-19T07:26:47.422 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.414+0000 7ff1dad9d640 1 --2- 172.21.15.148:0/2187281530 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7ff1c40a3460 0x7ff1c40a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:47.422 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.414+0000 7ff1cb7fe640 1 -- 172.21.15.148:0/2187281530 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8556+0+0 (secure 0 0 0) 0x7ff1cc0d0150 con 0x7ff1dc1009b0 2024-09-19T07:26:47.422 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.414+0000 7ff1d9d9b640 1 --2- 172.21.15.148:0/3890481082 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a2bfceb0c0 0x55a2bfced4b0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0009cc0 tx=0x7ff1d0011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bff9d7a7d79620ac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:47.422 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.414+0000 7ff1c8ff9640 1 -- 172.21.15.148:0/3890481082 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d001e070 con 0x55a2bfceb0c0 2024-09-19T07:26:47.423 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.414+0000 7ff1c8ff9640 1 -- 172.21.15.148:0/3890481082 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1d0019b10 con 0x55a2bfceb0c0 2024-09-19T07:26:47.423 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.414+0000 7ff1c8ff9640 1 -- 172.21.15.148:0/3890481082 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d001e070 con 0x55a2bfceb0c0 2024-09-19T07:26:47.423 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.415+0000 7ff1e388b740 1 -- 172.21.15.148:0/3890481082 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a2bfceb0c0 msgr2=0x55a2bfced4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:47.423 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.415+0000 7ff1dad9d640 1 --2- 172.21.15.148:0/2187281530 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7ff1c40a3460 0x7ff1c40a5920 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4009a60 tx=0x7ff1d4005d80 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:47.423 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.415+0000 7ff1e388b740 1 --2- 172.21.15.148:0/3890481082 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a2bfceb0c0 0x55a2bfced4b0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0009cc0 tx=0x7ff1d0011810 comp rx=0 tx=0).stop 2024-09-19T07:26:47.423 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.415+0000 7ff1e388b740 1 -- 172.21.15.148:0/3890481082 shutdown_connections 2024-09-19T07:26:47.423 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.415+0000 7ff1e388b740 1 --2- 172.21.15.148:0/3890481082 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a2bfceb0c0 0x55a2bfced4b0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.423 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.415+0000 7ff1e388b740 1 --2- 172.21.15.148:0/3890481082 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a2bfcdc2f0 0x55a2bfceab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.423 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.415+0000 7ff1e388b740 1 --2- 172.21.15.148:0/3890481082 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2bfcdb9d0 0x55a2bfcdbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.423 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.415+0000 7ff1e388b740 1 -- 172.21.15.148:0/3890481082 >> 172.21.15.148:0/3890481082 conn(0x55a2bfcd8060 msgr2=0x55a2bfcd8440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:47.423 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.415+0000 7ff1e388b740 1 -- 172.21.15.148:0/3890481082 shutdown_connections 2024-09-19T07:26:47.423 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.415+0000 7ff1e388b740 1 -- 172.21.15.148:0/3890481082 wait complete. 2024-09-19T07:26:47.423 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.416+0000 7ff1e388b740 1 -- start start 2024-09-19T07:26:47.423 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.416+0000 7ff1e388b740 1 Processor -- start 2024-09-19T07:26:47.424 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.416+0000 7ff1e388b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2bfcdb9d0 0x55a2bfce8020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:47.424 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.416+0000 7ff1e388b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a2bfcdc2f0 0x55a2bfce8560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:47.424 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.416+0000 7ff1e388b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a2bfceb0c0 0x55a2bfce8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:47.424 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.416+0000 7ff1e388b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55a2bfcedcf0 con 0x55a2bfceb0c0 2024-09-19T07:26:47.424 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.416+0000 7ff1e388b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55a2bfbc9290 con 0x55a2bfcdc2f0 2024-09-19T07:26:47.424 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.416+0000 7ff1e388b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a2bfcede70 con 0x55a2bfcdb9d0 2024-09-19T07:26:47.424 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.416+0000 7ff1e388b740 10 client.0 _ll_register_callbacks cb 0x55a2bfbfa140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:26:47.424 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.416+0000 7ff1dad9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a2bfceb0c0 0x55a2bfce8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:47.424 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.416+0000 7ff1dad9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a2bfceb0c0 0x55a2bfce8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35174/0 (socket says 172.21.15.148:35174) 2024-09-19T07:26:47.424 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.416+0000 7ff1dad9d640 1 -- 172.21.15.148:0/363041202 learned_addr learned my addr 172.21.15.148:0/363041202 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:26:47.424 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.416+0000 7ff1da59c640 1 --2- 172.21.15.148:0/363041202 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2bfcdb9d0 0x55a2bfce8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:47.424 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.416+0000 7ff1d9d9b640 1 --2- 172.21.15.148:0/363041202 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a2bfcdc2f0 0x55a2bfce8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:47.425 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.416+0000 7ff1dad9d640 1 -- 172.21.15.148:0/363041202 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2bfcdb9d0 msgr2=0x55a2bfce8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:47.425 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.416+0000 7ff1dad9d640 1 --2- 172.21.15.148:0/363041202 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2bfcdb9d0 0x55a2bfce8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.425 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.416+0000 7ff1dad9d640 1 -- 172.21.15.148:0/363041202 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a2bfcdc2f0 msgr2=0x55a2bfce8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:47.425 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.416+0000 7ff1dad9d640 1 --2- 172.21.15.148:0/363041202 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a2bfcdc2f0 0x55a2bfce8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.425 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.416+0000 7ff1dad9d640 1 -- 172.21.15.148:0/363041202 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2bf953210 con 0x55a2bfceb0c0 2024-09-19T07:26:47.425 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.416+0000 7ff1da59c640 1 --2- 172.21.15.148:0/363041202 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2bfcdb9d0 0x55a2bfce8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:26:47.425 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.416+0000 7ff1d9d9b640 1 --2- 172.21.15.148:0/363041202 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a2bfcdc2f0 0x55a2bfce8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:26:47.425 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.417+0000 7ff1dad9d640 1 --2- 172.21.15.148:0/363041202 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a2bfceb0c0 0x55a2bfce8aa0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4009c20 tx=0x7ff1d40095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0d76945392675b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:47.425 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.417+0000 7ff1c1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:26:47.425 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.417+0000 7ff1c1ffb640 1 -- 172.21.15.148:0/363041202 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d4004130 con 0x55a2bfceb0c0 2024-09-19T07:26:47.425 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.417+0000 7ff1c1ffb640 1 -- 172.21.15.148:0/363041202 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8556+0+0 (secure 0 0 0) 0x7ff1d40042d0 con 0x55a2bfceb0c0 2024-09-19T07:26:47.425 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.417+0000 7ff1e388b740 1 -- 172.21.15.148:0/363041202 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1d0019b10 con 0x55a2bfceb0c0 2024-09-19T07:26:47.425 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.417+0000 7ff1c1ffb640 1 -- 172.21.15.148:0/363041202 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7ff1d40044d0 con 0x55a2bfceb0c0 2024-09-19T07:26:47.425 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.417+0000 7ff1e388b740 10 client.17625 fetch_fsmap learned FSMap version 55 2024-09-19T07:26:47.426 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.417+0000 7ff1e388b740 1 -- 172.21.15.148:0/363041202 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x55a2bfa1f620 con 0x55a2bfceb0c0 2024-09-19T07:26:47.426 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.417+0000 7ff1c1ffb640 1 -- 172.21.15.148:0/363041202 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1d0019b10 con 0x55a2bfceb0c0 2024-09-19T07:26:47.426 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.417+0000 7ff1c1ffb640 1 -- 172.21.15.148:0/363041202 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 55) ==== 8370+0+0 (secure 0 0 0) 0x7ff1d4030070 con 0x55a2bfceb0c0 2024-09-19T07:26:47.426 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.417+0000 7ff1e388b740 10 client.17625 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T07:26:47.426 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.417+0000 7ff1e388b740 10 client.17625 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:26:47.426 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.417+0000 7ff1e388b740 20 client.17625 populate_metadata read hostname 'smithi148' 2024-09-19T07:26:47.426 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.417+0000 7ff1e388b740 1 --2- 172.21.15.148:0/363041202 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55a2bfcfb180 0x55a2bfcfd620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:47.426 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.417+0000 7ff1e388b740 4 client.17625 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:26:47.426 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.417+0000 7ff1e388b740 1 -- 172.21.15.148:0/363041202 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a2bfc4da20 con 0x55a2bfcfb180 2024-09-19T07:26:47.426 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.418+0000 7ff1da59c640 1 --2- 172.21.15.148:0/363041202 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55a2bfcfb180 0x55a2bfcfd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:47.426 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.418+0000 7ff1da59c640 1 --2- 172.21.15.148:0/363041202 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55a2bfcfb180 0x55a2bfcfd620 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ad7b2c2c2d4e98f server_cookie=be866e235d3ad162 in_seq=0 out_seq=0 2024-09-19T07:26:47.426 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.418+0000 7ff1c1ffb640 10 client.17625 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:26:47.426 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.419+0000 7ff1c1ffb640 1 -- 172.21.15.148:0/363041202 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a2bfc4da20 con 0x55a2bfcfb180 2024-09-19T07:26:47.426 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.419+0000 7ff1c1ffb640 10 client.17625 handle_command_reply: tid=0 2024-09-19T07:26:47.426 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.419+0000 7ff1e388b740 1 client.17625 shutdown 2024-09-19T07:26:47.427 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.419+0000 7ff1e388b740 1 -- 172.21.15.148:0/363041202 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a2bfceb0c0 msgr2=0x55a2bfce8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:47.427 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.419+0000 7ff1e388b740 1 --2- 172.21.15.148:0/363041202 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a2bfceb0c0 0x55a2bfce8aa0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4009c20 tx=0x7ff1d40095c0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.427 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.419+0000 7ff1e388b740 1 -- 172.21.15.148:0/363041202 shutdown_connections 2024-09-19T07:26:47.427 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.419+0000 7ff1e388b740 1 --2- 172.21.15.148:0/363041202 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55a2bfcfb180 0x55a2bfcfd620 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.427 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.419+0000 7ff1e388b740 1 --2- 172.21.15.148:0/363041202 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a2bfceb0c0 0x55a2bfce8aa0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.427 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.419+0000 7ff1c1ffb640 0 client.17625 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:26:47.427 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.419+0000 7ff1e388b740 1 --2- 172.21.15.148:0/363041202 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a2bfcdc2f0 0x55a2bfce8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.427 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.419+0000 7ff1e388b740 1 --2- 172.21.15.148:0/363041202 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2bfcdb9d0 0x55a2bfce8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.427 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.419+0000 7ff1e388b740 1 -- 172.21.15.148:0/363041202 >> 172.21.15.148:0/363041202 conn(0x55a2bfcd8060 msgr2=0x55a2bfcddd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:47.427 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.419+0000 7ff1e388b740 1 -- 172.21.15.148:0/363041202 shutdown_connections 2024-09-19T07:26:47.427 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.419+0000 7ff1e388b740 1 -- 172.21.15.148:0/363041202 wait complete. 2024-09-19T07:26:47.427 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.419+0000 7ff1e388b740 20 client.17625 trim_cache size 0 max 16384 2024-09-19T07:26:47.437 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.433+0000 7ff1e388b740 1 Processor -- start 2024-09-19T07:26:47.438 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.433+0000 7ff1e388b740 1 -- start start 2024-09-19T07:26:47.438 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.433+0000 7ff1e388b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a2bfcdb9d0 0x55a2bfd02f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:47.438 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.433+0000 7ff1e388b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2bfcdc2f0 0x55a2bfd03470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:47.438 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.433+0000 7ff1e388b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a2bfceb0c0 0x55a2bfce52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:47.438 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.433+0000 7ff1e388b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff1dc1adf80 con 0x55a2bfcdb9d0 2024-09-19T07:26:47.438 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.433+0000 7ff1e388b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff1dc1ab790 con 0x55a2bfceb0c0 2024-09-19T07:26:47.438 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.433+0000 7ff1e388b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff1dc1a9620 con 0x55a2bfcdc2f0 2024-09-19T07:26:47.438 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.433+0000 7ff1da59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a2bfcdb9d0 0x55a2bfd02f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:47.438 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.433+0000 7ff1da59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a2bfcdb9d0 0x55a2bfd02f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35188/0 (socket says 172.21.15.148:35188) 2024-09-19T07:26:47.438 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.433+0000 7ff1da59c640 1 -- 172.21.15.148:0/1303166612 learned_addr learned my addr 172.21.15.148:0/1303166612 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:26:47.438 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.434+0000 7ff1da59c640 1 -- 172.21.15.148:0/1303166612 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2bfcdc2f0 msgr2=0x55a2bfd03470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:47.438 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.434+0000 7ff1da59c640 1 --2- 172.21.15.148:0/1303166612 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2bfcdc2f0 0x55a2bfd03470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.434+0000 7ff1dad9d640 1 --2- 172.21.15.148:0/1303166612 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a2bfceb0c0 0x55a2bfce52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.434+0000 7ff1da59c640 1 -- 172.21.15.148:0/1303166612 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a2bfceb0c0 msgr2=0x55a2bfce52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.434+0000 7ff1da59c640 1 --2- 172.21.15.148:0/1303166612 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a2bfceb0c0 0x55a2bfce52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.434+0000 7ff1da59c640 1 -- 172.21.15.148:0/1303166612 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2bfce6ff0 con 0x55a2bfcdb9d0 2024-09-19T07:26:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.434+0000 7ff1da59c640 1 --2- 172.21.15.148:0/1303166612 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a2bfcdb9d0 0x55a2bfd02f30 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc0049d0 tx=0x7ff1cc0d2660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f80d66c88f7c2008 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.434+0000 7ff1c3fff640 1 -- 172.21.15.148:0/1303166612 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc09bd70 con 0x55a2bfcdb9d0 2024-09-19T07:26:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.434+0000 7ff1c3fff640 1 -- 172.21.15.148:0/1303166612 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1cc09cb10 con 0x55a2bfcdb9d0 2024-09-19T07:26:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.434+0000 7ff1c3fff640 1 -- 172.21.15.148:0/1303166612 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc09a7f0 con 0x55a2bfcdb9d0 2024-09-19T07:26:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.435+0000 7ff1e388b740 1 -- 172.21.15.148:0/1303166612 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a2bfcdb9d0 msgr2=0x55a2bfd02f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.435+0000 7ff1e388b740 1 --2- 172.21.15.148:0/1303166612 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a2bfcdb9d0 0x55a2bfd02f30 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc0049d0 tx=0x7ff1cc0d2660 comp rx=0 tx=0).stop 2024-09-19T07:26:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.435+0000 7ff1e388b740 1 -- 172.21.15.148:0/1303166612 shutdown_connections 2024-09-19T07:26:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.435+0000 7ff1e388b740 1 --2- 172.21.15.148:0/1303166612 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a2bfceb0c0 0x55a2bfce52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.435+0000 7ff1e388b740 1 --2- 172.21.15.148:0/1303166612 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2bfcdc2f0 0x55a2bfd03470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.440 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.435+0000 7ff1e388b740 1 --2- 172.21.15.148:0/1303166612 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a2bfcdb9d0 0x55a2bfd02f30 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.440 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.435+0000 7ff1e388b740 1 -- 172.21.15.148:0/1303166612 >> 172.21.15.148:0/1303166612 conn(0x55a2bfcd8060 msgr2=0x55a2bfcea0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:47.440 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.435+0000 7ff1e388b740 1 -- 172.21.15.148:0/1303166612 shutdown_connections 2024-09-19T07:26:47.440 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.435+0000 7ff1e388b740 1 -- 172.21.15.148:0/1303166612 wait complete. 2024-09-19T07:26:47.440 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.435+0000 7ff1e388b740 1 -- start start 2024-09-19T07:26:47.440 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.435+0000 7ff1e388b740 1 Processor -- start 2024-09-19T07:26:47.440 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.435+0000 7ff1e388b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a2bfcdb9d0 0x55a2bfcf3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:47.440 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.435+0000 7ff1e388b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a2bfcdc2f0 0x55a2bfcf38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:47.440 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.435+0000 7ff1e388b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2bfceb0c0 0x55a2bfcf0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:47.440 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.435+0000 7ff1e388b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff1dc1a9c70 con 0x55a2bfcdb9d0 2024-09-19T07:26:47.440 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.435+0000 7ff1e388b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff1dc1ab0c0 con 0x55a2bfcdc2f0 2024-09-19T07:26:47.440 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.435+0000 7ff1e388b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff1dc1aa320 con 0x55a2bfceb0c0 2024-09-19T07:26:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.435+0000 7ff1e388b740 10 client.0 _ll_register_callbacks cb 0x7ff1cc005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:26:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.435+0000 7ff1da59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a2bfcdb9d0 0x55a2bfcf3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.435+0000 7ff1da59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a2bfcdb9d0 0x55a2bfcf3380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35202/0 (socket says 172.21.15.148:35202) 2024-09-19T07:26:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.435+0000 7ff1da59c640 1 -- 172.21.15.148:0/2214018964 learned_addr learned my addr 172.21.15.148:0/2214018964 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:26:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.435+0000 7ff1d9d9b640 1 --2- 172.21.15.148:0/2214018964 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a2bfcdc2f0 0x55a2bfcf38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.436+0000 7ff1da59c640 1 -- 172.21.15.148:0/2214018964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2bfceb0c0 msgr2=0x55a2bfcf0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.436+0000 7ff1da59c640 1 --2- 172.21.15.148:0/2214018964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2bfceb0c0 0x55a2bfcf0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.436+0000 7ff1da59c640 1 -- 172.21.15.148:0/2214018964 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a2bfcdc2f0 msgr2=0x55a2bfcf38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.436+0000 7ff1da59c640 1 --2- 172.21.15.148:0/2214018964 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a2bfcdc2f0 0x55a2bfcf38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.436+0000 7ff1da59c640 1 -- 172.21.15.148:0/2214018964 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2bfced820 con 0x55a2bfcdb9d0 2024-09-19T07:26:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.436+0000 7ff1da59c640 1 --2- 172.21.15.148:0/2214018964 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a2bfcdb9d0 0x55a2bfcf3380 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc00c6a0 tx=0x7ff1cc004ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8941ac9848794db server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.436+0000 7ff1c1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:26:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.436+0000 7ff1c1ffb640 1 -- 172.21.15.148:0/2214018964 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc09bd70 con 0x55a2bfcdb9d0 2024-09-19T07:26:47.442 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.436+0000 7ff1c1ffb640 1 -- 172.21.15.148:0/2214018964 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8556+0+0 (secure 0 0 0) 0x7ff1cc0a4bf0 con 0x55a2bfcdb9d0 2024-09-19T07:26:47.442 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.436+0000 7ff1e388b740 1 -- 172.21.15.148:0/2214018964 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1cc09cb10 con 0x55a2bfcdb9d0 2024-09-19T07:26:47.442 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.436+0000 7ff1c1ffb640 1 -- 172.21.15.148:0/2214018964 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7ff1cc09c410 con 0x55a2bfcdb9d0 2024-09-19T07:26:47.442 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.436+0000 7ff1e388b740 10 client.17631 fetch_fsmap learned FSMap version 55 2024-09-19T07:26:47.442 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.436+0000 7ff1e388b740 1 -- 172.21.15.148:0/2214018964 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x55a2bfd66900 con 0x55a2bfcdb9d0 2024-09-19T07:26:47.442 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.436+0000 7ff1c1ffb640 1 -- 172.21.15.148:0/2214018964 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1cc09cb10 con 0x55a2bfcdb9d0 2024-09-19T07:26:47.442 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.436+0000 7ff1c1ffb640 1 -- 172.21.15.148:0/2214018964 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 55) ==== 8370+0+0 (secure 0 0 0) 0x7ff1cc0b5180 con 0x55a2bfcdb9d0 2024-09-19T07:26:47.442 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.436+0000 7ff1e388b740 10 client.17631 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T07:26:47.442 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.436+0000 7ff1e388b740 10 client.17631 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:26:47.442 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.436+0000 7ff1e388b740 20 client.17631 populate_metadata read hostname 'smithi148' 2024-09-19T07:26:47.442 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.436+0000 7ff1e388b740 1 --2- 172.21.15.148:0/2214018964 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55a2bfd67050 0x55a2bfd69470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:47.442 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.436+0000 7ff1e388b740 4 client.17631 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:26:47.442 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.436+0000 7ff1e388b740 1 -- 172.21.15.148:0/2214018964 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a2bfc47d70 con 0x55a2bfd67050 2024-09-19T07:26:47.442 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.437+0000 7ff1d9d9b640 1 --2- 172.21.15.148:0/2214018964 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55a2bfd67050 0x55a2bfd69470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:47.443 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.437+0000 7ff1c1ffb640 10 client.17631 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:26:47.443 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.437+0000 7ff1d9d9b640 1 --2- 172.21.15.148:0/2214018964 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55a2bfd67050 0x55a2bfd69470 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=343ec4c938d8b7a3 server_cookie=af42ed5768cf22c2 in_seq=0 out_seq=0 2024-09-19T07:26:47.453 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.452+0000 7ff1c1ffb640 1 -- 172.21.15.148:0/2214018964 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a2bfc47d70 con 0x55a2bfd67050 2024-09-19T07:26:47.453 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.452+0000 7ff1c1ffb640 10 client.17631 handle_command_reply: tid=0 2024-09-19T07:26:47.453 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.452+0000 7ff1e388b740 1 client.17631 shutdown 2024-09-19T07:26:47.453 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.452+0000 7ff1e388b740 1 -- 172.21.15.148:0/2214018964 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a2bfcdb9d0 msgr2=0x55a2bfcf3380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:47.453 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.452+0000 7ff1e388b740 1 --2- 172.21.15.148:0/2214018964 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a2bfcdb9d0 0x55a2bfcf3380 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc00c6a0 tx=0x7ff1cc004ae0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.453 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.452+0000 7ff1e388b740 1 -- 172.21.15.148:0/2214018964 shutdown_connections 2024-09-19T07:26:47.454 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.452+0000 7ff1e388b740 1 --2- 172.21.15.148:0/2214018964 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55a2bfd67050 0x55a2bfd69470 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.454 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.452+0000 7ff1e388b740 1 --2- 172.21.15.148:0/2214018964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a2bfceb0c0 0x55a2bfcf0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.454 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.452+0000 7ff1c1ffb640 0 client.17631 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:26:47.454 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.452+0000 7ff1e388b740 1 --2- 172.21.15.148:0/2214018964 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a2bfcdc2f0 0x55a2bfcf38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.454 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.452+0000 7ff1e388b740 1 --2- 172.21.15.148:0/2214018964 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a2bfcdb9d0 0x55a2bfcf3380 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.454 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.452+0000 7ff1e388b740 1 -- 172.21.15.148:0/2214018964 >> 172.21.15.148:0/2214018964 conn(0x55a2bfcd8060 msgr2=0x55a2bfcd69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:47.454 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.452+0000 7ff1e388b740 1 -- 172.21.15.148:0/2214018964 shutdown_connections 2024-09-19T07:26:47.454 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.452+0000 7ff1e388b740 1 -- 172.21.15.148:0/2214018964 wait complete. 2024-09-19T07:26:47.454 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.453+0000 7ff1e388b740 20 client.17631 trim_cache size 0 max 16384 2024-09-19T07:26:47.454 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:26:47.454 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:26:47.455 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:26:47.455 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:26:47.455 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.453+0000 7ff1e0af1640 1 -- 172.21.15.148:0/2187281530 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7ff1c40a3460 msgr2=0x7ff1c40a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:47.455 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.453+0000 7ff1e0af1640 1 --2- 172.21.15.148:0/2187281530 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7ff1c40a3460 0x7ff1c40a5920 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4009a60 tx=0x7ff1d4005d80 comp rx=0 tx=0).stop 2024-09-19T07:26:47.456 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.453+0000 7ff1e0af1640 1 -- 172.21.15.148:0/2187281530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1dc1009b0 msgr2=0x7ff1dc199170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:47.456 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.453+0000 7ff1e0af1640 1 --2- 172.21.15.148:0/2187281530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1dc1009b0 0x7ff1dc199170 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc00e9f0 tx=0x7ff1cc00edf0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.456 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.453+0000 7ff1e0af1640 1 -- 172.21.15.148:0/2187281530 shutdown_connections 2024-09-19T07:26:47.456 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.453+0000 7ff1e0af1640 1 --2- 172.21.15.148:0/2187281530 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7ff1c40a3460 0x7ff1c40a5920 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.456 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.453+0000 7ff1e0af1640 1 --2- 172.21.15.148:0/2187281530 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1dc1069c0 0x7ff1dc1a41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.456 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.453+0000 7ff1e0af1640 1 --2- 172.21.15.148:0/2187281530 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff1dc101350 0x7ff1dc1996b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.456 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.453+0000 7ff1e0af1640 1 --2- 172.21.15.148:0/2187281530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1dc1009b0 0x7ff1dc199170 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.456 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.453+0000 7ff1e0af1640 1 -- 172.21.15.148:0/2187281530 >> 172.21.15.148:0/2187281530 conn(0x7ff1dc077990 msgr2=0x7ff1dc103680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:47.456 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.453+0000 7ff1e0af1640 1 -- 172.21.15.148:0/2187281530 shutdown_connections 2024-09-19T07:26:47.456 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:26:47.453+0000 7ff1e0af1640 1 -- 172.21.15.148:0/2187281530 wait complete. 2024-09-19T07:26:47.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:26:47 smithi165 ceph-mon[35326]: pgmap v493: 97 pgs: 97 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 15 KiB/s wr, 13 op/s 2024-09-19T07:26:47.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:26:47 smithi179 ceph-mon[35716]: pgmap v493: 97 pgs: 97 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 15 KiB/s wr, 13 op/s 2024-09-19T07:26:47.832 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:26:47 smithi148 ceph-mon[31180]: pgmap v493: 97 pgs: 97 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 15 KiB/s wr, 13 op/s 2024-09-19T07:26:49.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:26:49 smithi165 ceph-mon[35326]: pgmap v494: 97 pgs: 97 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 15 KiB/s wr, 13 op/s 2024-09-19T07:26:49.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:26:49 smithi179 ceph-mon[35716]: pgmap v494: 97 pgs: 97 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 15 KiB/s wr, 13 op/s 2024-09-19T07:26:49.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:26:49 smithi148 ceph-mon[31180]: pgmap v494: 97 pgs: 97 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 15 KiB/s wr, 13 op/s 2024-09-19T07:26:51.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:26:51 smithi165 ceph-mon[35326]: pgmap v495: 97 pgs: 97 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 10 op/s 2024-09-19T07:26:51.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:26:51 smithi179 ceph-mon[35716]: pgmap v495: 97 pgs: 97 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 10 op/s 2024-09-19T07:26:51.832 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:26:51 smithi148 ceph-mon[31180]: pgmap v495: 97 pgs: 97 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 10 op/s 2024-09-19T07:26:53.634 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:26:53 smithi165 ceph-mon[35326]: pgmap v496: 97 pgs: 97 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 14 op/s 2024-09-19T07:26:53.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:26:53 smithi179 ceph-mon[35716]: pgmap v496: 97 pgs: 97 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 14 op/s 2024-09-19T07:26:53.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:26:53 smithi148 ceph-mon[31180]: pgmap v496: 97 pgs: 97 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 14 op/s 2024-09-19T07:26:55.263 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:26:55.530 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:26:55.583 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:26:55 smithi148 ceph-mon[31180]: pgmap v497: 97 pgs: 97 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 6.8 KiB/s wr, 8 op/s 2024-09-19T07:26:55.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:26:55 smithi165 ceph-mon[35326]: pgmap v497: 97 pgs: 97 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 6.8 KiB/s wr, 8 op/s 2024-09-19T07:26:55.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:26:55 smithi179 ceph-mon[35716]: pgmap v497: 97 pgs: 97 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 6.8 KiB/s wr, 8 op/s 2024-09-19T07:26:56.061 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.056+0000 7fe398f29640 1 -- 172.21.15.148:0/1012058223 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe394105f40 msgr2=0x7fe3941063d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:56.061 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.056+0000 7fe398f29640 1 --2- 172.21.15.148:0/1012058223 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe394105f40 0x7fe3941063d0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fe38c009ca0 tx=0x7fe38c02a940 comp rx=0 tx=0).stop 2024-09-19T07:26:56.061 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.056+0000 7fe398f29640 1 -- 172.21.15.148:0/1012058223 shutdown_connections 2024-09-19T07:26:56.061 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.056+0000 7fe398f29640 1 --2- 172.21.15.148:0/1012058223 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe394105f40 0x7fe3941063d0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:56.061 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.056+0000 7fe398f29640 1 --2- 172.21.15.148:0/1012058223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe394101450 0x7fe394105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:56.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.056+0000 7fe398f29640 1 --2- 172.21.15.148:0/1012058223 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe394100b30 0x7fe394100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:56.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.056+0000 7fe398f29640 1 -- 172.21.15.148:0/1012058223 >> 172.21.15.148:0/1012058223 conn(0x7fe3940fc7a0 msgr2=0x7fe3940febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:56.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.056+0000 7fe398f29640 1 -- 172.21.15.148:0/1012058223 shutdown_connections 2024-09-19T07:26:56.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.056+0000 7fe398f29640 1 -- 172.21.15.148:0/1012058223 wait complete. 2024-09-19T07:26:56.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.057+0000 7fe398f29640 1 Processor -- start 2024-09-19T07:26:56.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.057+0000 7fe398f29640 1 -- start start 2024-09-19T07:26:56.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.057+0000 7fe398f29640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe394100b30 0x7fe3941a4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:56.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.057+0000 7fe398f29640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe394101450 0x7fe3941a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:56.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.057+0000 7fe398f29640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe394105f40 0x7fe39419e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:56.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.057+0000 7fe398f29640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe394118640 con 0x7fe394100b30 2024-09-19T07:26:56.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.057+0000 7fe398f29640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe3941184c0 con 0x7fe394105f40 2024-09-19T07:26:56.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.057+0000 7fe398f29640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe3941187c0 con 0x7fe394101450 2024-09-19T07:26:56.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.057+0000 7fe39259c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe394100b30 0x7fe3941a4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:56.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.058+0000 7fe39259c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe394100b30 0x7fe3941a4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60344/0 (socket says 172.21.15.148:60344) 2024-09-19T07:26:56.063 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.058+0000 7fe39259c640 1 -- 172.21.15.148:0/2965268040 learned_addr learned my addr 172.21.15.148:0/2965268040 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:26:56.063 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.058+0000 7fe392d9d640 1 --2- 172.21.15.148:0/2965268040 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe394105f40 0x7fe39419e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:56.063 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.058+0000 7fe38bfff640 1 --2- 172.21.15.148:0/2965268040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe394101450 0x7fe3941a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:56.063 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.058+0000 7fe39259c640 1 -- 172.21.15.148:0/2965268040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe394101450 msgr2=0x7fe3941a4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:56.063 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.058+0000 7fe39259c640 1 --2- 172.21.15.148:0/2965268040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe394101450 0x7fe3941a4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:56.063 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.058+0000 7fe39259c640 1 -- 172.21.15.148:0/2965268040 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe394105f40 msgr2=0x7fe39419e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:56.063 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.058+0000 7fe39259c640 1 --2- 172.21.15.148:0/2965268040 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe394105f40 0x7fe39419e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:56.063 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.058+0000 7fe39259c640 1 -- 172.21.15.148:0/2965268040 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe39419f100 con 0x7fe394100b30 2024-09-19T07:26:56.063 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.058+0000 7fe39259c640 1 --2- 172.21.15.148:0/2965268040 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe394100b30 0x7fe3941a4810 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fe38400b4a0 tx=0x7fe38400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:56.063 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.058+0000 7fe38b7fe640 1 -- 172.21.15.148:0/2965268040 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe384014070 con 0x7fe394100b30 2024-09-19T07:26:56.063 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.058+0000 7fe38b7fe640 1 -- 172.21.15.148:0/2965268040 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe384010af0 con 0x7fe394100b30 2024-09-19T07:26:56.063 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.058+0000 7fe398f29640 1 -- 172.21.15.148:0/2965268040 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe39419f3f0 con 0x7fe394100b30 2024-09-19T07:26:56.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.058+0000 7fe38b7fe640 1 -- 172.21.15.148:0/2965268040 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe384017d10 con 0x7fe394100b30 2024-09-19T07:26:56.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.058+0000 7fe398f29640 1 -- 172.21.15.148:0/2965268040 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3941ab6e0 con 0x7fe394100b30 2024-09-19T07:26:56.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.059+0000 7fe398f29640 1 -- 172.21.15.148:0/2965268040 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3941059a0 con 0x7fe394100b30 2024-09-19T07:26:56.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.060+0000 7fe38b7fe640 1 -- 172.21.15.148:0/2965268040 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fe384017070 con 0x7fe394100b30 2024-09-19T07:26:56.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.061+0000 7fe38b7fe640 1 --2- 172.21.15.148:0/2965268040 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe3800a33b0 0x7fe3800a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:56.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.061+0000 7fe38bfff640 1 --2- 172.21.15.148:0/2965268040 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe3800a33b0 0x7fe3800a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:56.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.061+0000 7fe38b7fe640 1 -- 172.21.15.148:0/2965268040 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8556+0+0 (secure 0 0 0) 0x7fe3840cf0b0 con 0x7fe394100b30 2024-09-19T07:26:56.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.062+0000 7fe38bfff640 1 --2- 172.21.15.148:0/2965268040 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe3800a33b0 0x7fe3800a5870 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe3940fec40 tx=0x7fe37c008040 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:56.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.065+0000 7fe38b7fe640 1 -- 172.21.15.148:0/2965268040 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe38409bb80 con 0x7fe394100b30 2024-09-19T07:26:56.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.269+0000 7fe398f29640 1 -- 172.21.15.148:0/2965268040 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe3941ab9e0 con 0x7fe394100b30 2024-09-19T07:26:56.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.270+0000 7fe38b7fe640 1 -- 172.21.15.148:0/2965268040 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+11947 (secure 0 0 0) 0x7fe38409b480 con 0x7fe394100b30 2024-09-19T07:26:56.272 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:26:56.272 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":55,"btime":"2024-09-19T07:26:06:767218+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/4263868576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":4263868576},{"type":"v1","addr":"172.21.15.148:6841","nonce":4263868576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":25606,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3891676893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3891676893},{"type":"v1","addr":"172.21.15.179:6835","nonce":3891676893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":55,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:09:19.543369+0000","modified":"2024-09-19T07:26:06.157910+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24457,"mds_1":24437,"mds_2":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":75,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":71,"addr":"172.21.15.165:6839/3993490234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":3993490234},{"type":"v1","addr":"172.21.15.165:6839","nonce":3993490234}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25823":{"gid":25823,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6835/380886107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":380886107},{"type":"v1","addr":"172.21.15.165:6835","nonce":380886107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24457,"qdb_cluster":[24457,24437,24436]},"id":1}]} 2024-09-19T07:26:56.272 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 55 2024-09-19T07:26:56.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.273+0000 7fe398f29640 1 -- 172.21.15.148:0/2965268040 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe3800a33b0 msgr2=0x7fe3800a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:56.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.273+0000 7fe398f29640 1 --2- 172.21.15.148:0/2965268040 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe3800a33b0 0x7fe3800a5870 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe3940fec40 tx=0x7fe37c008040 comp rx=0 tx=0).stop 2024-09-19T07:26:56.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.273+0000 7fe398f29640 1 -- 172.21.15.148:0/2965268040 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe394100b30 msgr2=0x7fe3941a4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:56.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.273+0000 7fe398f29640 1 --2- 172.21.15.148:0/2965268040 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe394100b30 0x7fe3941a4810 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fe38400b4a0 tx=0x7fe38400b960 comp rx=0 tx=0).stop 2024-09-19T07:26:56.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.273+0000 7fe398f29640 1 -- 172.21.15.148:0/2965268040 shutdown_connections 2024-09-19T07:26:56.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.273+0000 7fe398f29640 1 --2- 172.21.15.148:0/2965268040 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe3800a33b0 0x7fe3800a5870 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:56.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.273+0000 7fe398f29640 1 --2- 172.21.15.148:0/2965268040 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe394105f40 0x7fe39419e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:56.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.273+0000 7fe398f29640 1 --2- 172.21.15.148:0/2965268040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe394101450 0x7fe3941a4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:56.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.273+0000 7fe398f29640 1 --2- 172.21.15.148:0/2965268040 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe394100b30 0x7fe3941a4810 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:56.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.273+0000 7fe398f29640 1 -- 172.21.15.148:0/2965268040 >> 172.21.15.148:0/2965268040 conn(0x7fe3940fc7a0 msgr2=0x7fe39410f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:56.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.273+0000 7fe398f29640 1 -- 172.21.15.148:0/2965268040 shutdown_connections 2024-09-19T07:26:56.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:56.273+0000 7fe398f29640 1 -- 172.21.15.148:0/2965268040 wait complete. 2024-09-19T07:26:56.582 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:26:56 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/2965268040' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:26:56.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:26:56 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/2965268040' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:26:56.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:26:56 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/2965268040' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:26:57.002 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24457 quiesce db --set-id aac99a66 --release --await' 2024-09-19T07:26:57.002 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24457 quiesce db --set-id aac99a66 --release --await 2024-09-19T07:26:57.250 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:26:57.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:26:57 smithi165 ceph-mon[35326]: pgmap v498: 97 pgs: 97 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.8 KiB/s wr, 11 op/s 2024-09-19T07:26:57.709 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:26:57 smithi148 ceph-mon[31180]: pgmap v498: 97 pgs: 97 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.8 KiB/s wr, 11 op/s 2024-09-19T07:26:57.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:26:57 smithi179 ceph-mon[35716]: pgmap v498: 97 pgs: 97 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.8 KiB/s wr, 11 op/s 2024-09-19T07:26:57.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.796+0000 7fe3b202f640 1 -- 172.21.15.148:0/3674887147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3ac102790 msgr2=0x7fe3ac1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:57.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.796+0000 7fe3b202f640 1 --2- 172.21.15.148:0/3674887147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3ac102790 0x7fe3ac1067e0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fe394009900 tx=0x7fe39402a410 comp rx=0 tx=0).stop 2024-09-19T07:26:57.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.796+0000 7fe3b202f640 1 -- 172.21.15.148:0/3674887147 shutdown_connections 2024-09-19T07:26:57.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.796+0000 7fe3b202f640 1 --2- 172.21.15.148:0/3674887147 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3ac106f10 0x7fe3ac10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:57.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.796+0000 7fe3b202f640 1 --2- 172.21.15.148:0/3674887147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3ac102790 0x7fe3ac1067e0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:57.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.796+0000 7fe3b202f640 1 --2- 172.21.15.148:0/3674887147 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3ac101de0 0x7fe3ac1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:57.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.796+0000 7fe3b202f640 1 -- 172.21.15.148:0/3674887147 >> 172.21.15.148:0/3674887147 conn(0x7fe3ac0fd8c0 msgr2=0x7fe3ac0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:57.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.796+0000 7fe3b202f640 1 -- 172.21.15.148:0/3674887147 shutdown_connections 2024-09-19T07:26:57.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.797+0000 7fe3b202f640 1 -- 172.21.15.148:0/3674887147 wait complete. 2024-09-19T07:26:57.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.797+0000 7fe3b202f640 1 Processor -- start 2024-09-19T07:26:57.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.797+0000 7fe3b202f640 1 -- start start 2024-09-19T07:26:57.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.797+0000 7fe3b202f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3ac101de0 0x7fe3ac198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:57.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.797+0000 7fe3b202f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3ac102790 0x7fe3ac1988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:57.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.797+0000 7fe3b202f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3ac106f10 0x7fe3ac19cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:57.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.797+0000 7fe3b202f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe3ac111f70 con 0x7fe3ac101de0 2024-09-19T07:26:57.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.797+0000 7fe3b202f640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe3ac111df0 con 0x7fe3ac102790 2024-09-19T07:26:57.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.797+0000 7fe3b202f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe3ac1120f0 con 0x7fe3ac106f10 2024-09-19T07:26:57.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.797+0000 7fe3ab7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3ac101de0 0x7fe3ac198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:57.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.797+0000 7fe3ab7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3ac101de0 0x7fe3ac198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60368/0 (socket says 172.21.15.148:60368) 2024-09-19T07:26:57.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.797+0000 7fe3ab7fe640 1 -- 172.21.15.148:0/1539531341 learned_addr learned my addr 172.21.15.148:0/1539531341 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:26:57.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.798+0000 7fe3abfff640 1 --2- 172.21.15.148:0/1539531341 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3ac106f10 0x7fe3ac19cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:57.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.798+0000 7fe3a3fff640 1 --2- 172.21.15.148:0/1539531341 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3ac102790 0x7fe3ac1988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:57.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.798+0000 7fe3ab7fe640 1 -- 172.21.15.148:0/1539531341 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3ac106f10 msgr2=0x7fe3ac19cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:57.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.798+0000 7fe3ab7fe640 1 --2- 172.21.15.148:0/1539531341 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3ac106f10 0x7fe3ac19cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:57.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.798+0000 7fe3ab7fe640 1 -- 172.21.15.148:0/1539531341 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3ac102790 msgr2=0x7fe3ac1988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:57.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.798+0000 7fe3ab7fe640 1 --2- 172.21.15.148:0/1539531341 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3ac102790 0x7fe3ac1988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:57.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.798+0000 7fe3ab7fe640 1 -- 172.21.15.148:0/1539531341 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3ac19d330 con 0x7fe3ac101de0 2024-09-19T07:26:57.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.798+0000 7fe3a3fff640 1 --2- 172.21.15.148:0/1539531341 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3ac102790 0x7fe3ac1988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:26:57.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.798+0000 7fe3ab7fe640 1 --2- 172.21.15.148:0/1539531341 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3ac101de0 0x7fe3ac198380 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fe39c00c920 tx=0x7fe39c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:57.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.798+0000 7fe3a97fa640 1 -- 172.21.15.148:0/1539531341 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39c007c70 con 0x7fe3ac101de0 2024-09-19T07:26:57.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.798+0000 7fe3a97fa640 1 -- 172.21.15.148:0/1539531341 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe39c007e10 con 0x7fe3ac101de0 2024-09-19T07:26:57.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.798+0000 7fe3b202f640 1 -- 172.21.15.148:0/1539531341 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3ac19d620 con 0x7fe3ac101de0 2024-09-19T07:26:57.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.798+0000 7fe3a97fa640 1 -- 172.21.15.148:0/1539531341 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39c018890 con 0x7fe3ac101de0 2024-09-19T07:26:57.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.798+0000 7fe3b202f640 1 -- 172.21.15.148:0/1539531341 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3ac1a4f00 con 0x7fe3ac101de0 2024-09-19T07:26:57.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.800+0000 7fe3a97fa640 1 -- 172.21.15.148:0/1539531341 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fe39c018a70 con 0x7fe3ac101de0 2024-09-19T07:26:57.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.801+0000 7fe3b4408740 1 Processor -- start 2024-09-19T07:26:57.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.801+0000 7fe3b4408740 1 -- start start 2024-09-19T07:26:57.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.801+0000 7fe3b4408740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e47ce0d470 0x55e47ce0d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:57.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.801+0000 7fe3b4408740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e47ce0dd90 0x55e47ce18110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:57.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.801+0000 7fe3b4408740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e47ce18650 0x55e47ce1aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:57.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.801+0000 7fe3b4408740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55e47cd6e620 con 0x55e47ce18650 2024-09-19T07:26:57.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.801+0000 7fe3b4408740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55e47cd15e50 con 0x55e47ce0dd90 2024-09-19T07:26:57.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.801+0000 7fe3b4408740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55e47cd6a5e0 con 0x55e47ce0d470 2024-09-19T07:26:57.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.801+0000 7fe3a3fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e47ce18650 0x55e47ce1aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:57.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.801+0000 7fe3a3fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e47ce18650 0x55e47ce1aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60372/0 (socket says 172.21.15.148:60372) 2024-09-19T07:26:57.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.801+0000 7fe3a3fff640 1 -- 172.21.15.148:0/3342925812 learned_addr learned my addr 172.21.15.148:0/3342925812 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:26:57.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.801+0000 7fe3a97fa640 1 --2- 172.21.15.148:0/1539531341 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe3980a33b0 0x7fe3980a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:57.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.801+0000 7fe3ab7fe640 1 --2- 172.21.15.148:0/3342925812 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e47ce0dd90 0x55e47ce18110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:57.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.801+0000 7fe3abfff640 1 --2- 172.21.15.148:0/3342925812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e47ce0d470 0x55e47ce0d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:57.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.801+0000 7fe3abfff640 1 --2- 172.21.15.148:0/1539531341 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe3980a33b0 0x7fe3980a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:57.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.801+0000 7fe3a3fff640 1 -- 172.21.15.148:0/3342925812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e47ce0d470 msgr2=0x55e47ce0d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:57.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.801+0000 7fe3a3fff640 1 --2- 172.21.15.148:0/3342925812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e47ce0d470 0x55e47ce0d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:57.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.802+0000 7fe3a3fff640 1 -- 172.21.15.148:0/3342925812 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e47ce0dd90 msgr2=0x55e47ce18110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:57.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.802+0000 7fe3a3fff640 1 --2- 172.21.15.148:0/3342925812 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e47ce0dd90 0x55e47ce18110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:57.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.802+0000 7fe3a3fff640 1 -- 172.21.15.148:0/3342925812 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e47cd06d40 con 0x55e47ce18650 2024-09-19T07:26:57.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.802+0000 7fe3a97fa640 1 -- 172.21.15.148:0/1539531341 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8556+0+0 (secure 0 0 0) 0x7fe39c0cff40 con 0x7fe3ac101de0 2024-09-19T07:26:57.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.802+0000 7fe3a3fff640 1 --2- 172.21.15.148:0/3342925812 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e47ce18650 0x55e47ce1aa40 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fe394005c40 tx=0x7fe394032cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7386ec5b701ce4e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:57.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.802+0000 7fe3a1ffb640 1 -- 172.21.15.148:0/3342925812 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39403f070 con 0x55e47ce18650 2024-09-19T07:26:57.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.802+0000 7fe3abfff640 1 --2- 172.21.15.148:0/1539531341 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe3980a33b0 0x7fe3980a5870 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe3a4009fd0 tx=0x7fe3a4005bd0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:57.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.802+0000 7fe3a1ffb640 1 -- 172.21.15.148:0/3342925812 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3940317b0 con 0x55e47ce18650 2024-09-19T07:26:57.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.802+0000 7fe3a1ffb640 1 -- 172.21.15.148:0/3342925812 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe394035070 con 0x55e47ce18650 2024-09-19T07:26:57.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.803+0000 7fe3b4408740 1 -- 172.21.15.148:0/3342925812 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e47ce18650 msgr2=0x55e47ce1aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:57.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.803+0000 7fe3b4408740 1 --2- 172.21.15.148:0/3342925812 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e47ce18650 0x55e47ce1aa40 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fe394005c40 tx=0x7fe394032cb0 comp rx=0 tx=0).stop 2024-09-19T07:26:57.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.803+0000 7fe3b4408740 1 -- 172.21.15.148:0/3342925812 shutdown_connections 2024-09-19T07:26:57.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.803+0000 7fe3b4408740 1 --2- 172.21.15.148:0/3342925812 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e47ce18650 0x55e47ce1aa40 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:57.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.803+0000 7fe3b4408740 1 --2- 172.21.15.148:0/3342925812 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e47ce0dd90 0x55e47ce18110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:57.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.803+0000 7fe3b4408740 1 --2- 172.21.15.148:0/3342925812 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e47ce0d470 0x55e47ce0d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:57.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.803+0000 7fe3b4408740 1 -- 172.21.15.148:0/3342925812 >> 172.21.15.148:0/3342925812 conn(0x55e47ce09a00 msgr2=0x55e47ce09de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:57.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.803+0000 7fe3b4408740 1 -- 172.21.15.148:0/3342925812 shutdown_connections 2024-09-19T07:26:57.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.803+0000 7fe3b4408740 1 -- 172.21.15.148:0/3342925812 wait complete. 2024-09-19T07:26:57.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.803+0000 7fe3b4408740 1 -- start start 2024-09-19T07:26:57.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.803+0000 7fe3b4408740 1 Processor -- start 2024-09-19T07:26:57.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.804+0000 7fe3b4408740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e47ce0d470 0x55e47ce154a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:57.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.804+0000 7fe3b4408740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e47ce0dd90 0x55e47ce159e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:57.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.804+0000 7fe3b4408740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e47ce18650 0x55e47ce15f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:57.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.804+0000 7fe3b4408740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55e47ce1b220 con 0x55e47ce0dd90 2024-09-19T07:26:57.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.804+0000 7fe3b4408740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55e47ccf6f10 con 0x55e47ce18650 2024-09-19T07:26:57.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.804+0000 7fe3b4408740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55e47ce1b3a0 con 0x55e47ce0d470 2024-09-19T07:26:57.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.804+0000 7fe3b4408740 10 client.0 _ll_register_callbacks cb 0x55e47cd1adb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:26:57.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.804+0000 7fe3a3fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e47ce0dd90 0x55e47ce159e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:57.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.804+0000 7fe3a3fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e47ce0dd90 0x55e47ce159e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60388/0 (socket says 172.21.15.148:60388) 2024-09-19T07:26:57.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.804+0000 7fe3a3fff640 1 -- 172.21.15.148:0/1587296290 learned_addr learned my addr 172.21.15.148:0/1587296290 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:26:57.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.804+0000 7fe3ab7fe640 1 --2- 172.21.15.148:0/1587296290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e47ce0d470 0x55e47ce154a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:57.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.804+0000 7fe3abfff640 1 --2- 172.21.15.148:0/1587296290 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e47ce18650 0x55e47ce15f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:57.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.804+0000 7fe3a3fff640 1 -- 172.21.15.148:0/1587296290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e47ce0d470 msgr2=0x55e47ce154a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:57.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.804+0000 7fe3a3fff640 1 --2- 172.21.15.148:0/1587296290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e47ce0d470 0x55e47ce154a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:57.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.804+0000 7fe3a3fff640 1 -- 172.21.15.148:0/1587296290 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e47ce18650 msgr2=0x55e47ce15f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:57.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.804+0000 7fe3a3fff640 1 --2- 172.21.15.148:0/1587296290 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e47ce18650 0x55e47ce15f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:57.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.804+0000 7fe3a3fff640 1 -- 172.21.15.148:0/1587296290 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e47ca7d580 con 0x55e47ce0dd90 2024-09-19T07:26:57.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.804+0000 7fe3a3fff640 1 --2- 172.21.15.148:0/1587296290 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e47ce0dd90 0x55e47ce159e0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fe394031550 tx=0x7fe3940316a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62a7a3de4d51a59c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:57.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.804+0000 7fe38affd640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:26:57.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.804+0000 7fe38affd640 1 -- 172.21.15.148:0/1587296290 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39403f070 con 0x55e47ce0dd90 2024-09-19T07:26:57.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.804+0000 7fe38affd640 1 -- 172.21.15.148:0/1587296290 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8556+0+0 (secure 0 0 0) 0x7fe394004250 con 0x55e47ce0dd90 2024-09-19T07:26:57.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.804+0000 7fe3b4408740 1 -- 172.21.15.148:0/1587296290 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3940317b0 con 0x55e47ce0dd90 2024-09-19T07:26:57.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.805+0000 7fe38affd640 1 -- 172.21.15.148:0/1587296290 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7fe394054050 con 0x55e47ce0dd90 2024-09-19T07:26:57.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.805+0000 7fe3b4408740 10 client.17649 fetch_fsmap learned FSMap version 55 2024-09-19T07:26:57.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.805+0000 7fe3b4408740 1 -- 172.21.15.148:0/1587296290 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x55e47cb47960 con 0x55e47ce0dd90 2024-09-19T07:26:57.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.805+0000 7fe38affd640 1 -- 172.21.15.148:0/1587296290 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3940317b0 con 0x55e47ce0dd90 2024-09-19T07:26:57.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.805+0000 7fe38affd640 1 -- 172.21.15.148:0/1587296290 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 55) ==== 8370+0+0 (secure 0 0 0) 0x7fe394004900 con 0x55e47ce0dd90 2024-09-19T07:26:57.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.805+0000 7fe3b4408740 10 client.17649 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T07:26:57.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.805+0000 7fe3b4408740 10 client.17649 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:26:57.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.805+0000 7fe3b4408740 20 client.17649 populate_metadata read hostname 'smithi148' 2024-09-19T07:26:57.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.805+0000 7fe3b4408740 1 --2- 172.21.15.148:0/1587296290 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e47ce27fb0 0x55e47ce2a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:57.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.805+0000 7fe3b4408740 4 client.17649 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:26:57.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.805+0000 7fe3b4408740 1 -- 172.21.15.148:0/1587296290 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e47cd7bb90 con 0x55e47ce27fb0 2024-09-19T07:26:57.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.805+0000 7fe3ab7fe640 1 --2- 172.21.15.148:0/1587296290 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e47ce27fb0 0x55e47ce2a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:57.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.806+0000 7fe38affd640 10 client.17649 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:26:57.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.806+0000 7fe3ab7fe640 1 --2- 172.21.15.148:0/1587296290 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e47ce27fb0 0x55e47ce2a3a0 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=751e65fd68fbf428 server_cookie=880adceae2327405 in_seq=0 out_seq=0 2024-09-19T07:26:57.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.806+0000 7fe38affd640 1 -- 172.21.15.148:0/1587296290 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e47cd7bb90 con 0x55e47ce27fb0 2024-09-19T07:26:57.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.806+0000 7fe38affd640 10 client.17649 handle_command_reply: tid=0 2024-09-19T07:26:57.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.806+0000 7fe3b4408740 1 client.17649 shutdown 2024-09-19T07:26:57.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.807+0000 7fe3b4408740 1 -- 172.21.15.148:0/1587296290 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e47ce0dd90 msgr2=0x55e47ce159e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:57.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.807+0000 7fe3b4408740 1 --2- 172.21.15.148:0/1587296290 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e47ce0dd90 0x55e47ce159e0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fe394031550 tx=0x7fe3940316a0 comp rx=0 tx=0).stop 2024-09-19T07:26:57.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.807+0000 7fe3b4408740 1 -- 172.21.15.148:0/1587296290 shutdown_connections 2024-09-19T07:26:57.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.807+0000 7fe3b4408740 1 --2- 172.21.15.148:0/1587296290 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e47ce27fb0 0x55e47ce2a3a0 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:57.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.807+0000 7fe3b4408740 1 --2- 172.21.15.148:0/1587296290 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e47ce18650 0x55e47ce15f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:57.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.807+0000 7fe3b4408740 1 --2- 172.21.15.148:0/1587296290 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e47ce0dd90 0x55e47ce159e0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:57.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.807+0000 7fe3b4408740 1 --2- 172.21.15.148:0/1587296290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e47ce0d470 0x55e47ce154a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:57.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.807+0000 7fe3b4408740 1 -- 172.21.15.148:0/1587296290 >> 172.21.15.148:0/1587296290 conn(0x55e47ce09a00 msgr2=0x55e47ce04750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:57.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.807+0000 7fe38affd640 0 client.17649 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:26:57.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.807+0000 7fe3b4408740 1 -- 172.21.15.148:0/1587296290 shutdown_connections 2024-09-19T07:26:57.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.807+0000 7fe3b4408740 1 -- 172.21.15.148:0/1587296290 wait complete. 2024-09-19T07:26:57.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.807+0000 7fe3b4408740 20 client.17649 trim_cache size 0 max 16384 2024-09-19T07:26:57.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.824+0000 7fe3b4408740 1 Processor -- start 2024-09-19T07:26:57.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.824+0000 7fe3b4408740 1 -- start start 2024-09-19T07:26:57.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.824+0000 7fe3b4408740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e47ce0d470 0x55e47ce2fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:57.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.824+0000 7fe3b4408740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e47ce0dd90 0x55e47ce2ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:57.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.824+0000 7fe3b4408740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e47ce18650 0x55e47ce12760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:57.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.824+0000 7fe3b4408740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe3ac1adfb0 con 0x55e47ce0dd90 2024-09-19T07:26:57.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.824+0000 7fe3b4408740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe3ac1ab7c0 con 0x55e47ce18650 2024-09-19T07:26:57.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.824+0000 7fe3b4408740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe3ac1a9630 con 0x55e47ce0d470 2024-09-19T07:26:57.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.824+0000 7fe3a3fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e47ce0dd90 0x55e47ce2ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:57.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.824+0000 7fe3a3fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e47ce0dd90 0x55e47ce2ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60400/0 (socket says 172.21.15.148:60400) 2024-09-19T07:26:57.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.824+0000 7fe3a3fff640 1 -- 172.21.15.148:0/2819157166 learned_addr learned my addr 172.21.15.148:0/2819157166 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:26:57.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.824+0000 7fe3ab7fe640 1 --2- 172.21.15.148:0/2819157166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e47ce0d470 0x55e47ce2fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:57.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.824+0000 7fe3a3fff640 1 -- 172.21.15.148:0/2819157166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e47ce0d470 msgr2=0x55e47ce2fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:57.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.824+0000 7fe3a3fff640 1 --2- 172.21.15.148:0/2819157166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e47ce0d470 0x55e47ce2fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:57.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.824+0000 7fe3a3fff640 1 -- 172.21.15.148:0/2819157166 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e47ce18650 msgr2=0x55e47ce12760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:57.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.824+0000 7fe3a3fff640 1 --2- 172.21.15.148:0/2819157166 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e47ce18650 0x55e47ce12760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:57.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.824+0000 7fe3a3fff640 1 -- 172.21.15.148:0/2819157166 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e47ce00930 con 0x55e47ce0dd90 2024-09-19T07:26:57.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.824+0000 7fe3ab7fe640 1 --2- 172.21.15.148:0/2819157166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e47ce0d470 0x55e47ce2fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:26:57.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.825+0000 7fe3a3fff640 1 --2- 172.21.15.148:0/2819157166 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e47ce0dd90 0x55e47ce2ff40 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fe394004d50 tx=0x7fe3940315b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f6228b42d363ea6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:57.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.825+0000 7fe3a17fa640 1 -- 172.21.15.148:0/2819157166 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39403f070 con 0x55e47ce0dd90 2024-09-19T07:26:57.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.825+0000 7fe3a17fa640 1 -- 172.21.15.148:0/2819157166 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe394048030 con 0x55e47ce0dd90 2024-09-19T07:26:57.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.825+0000 7fe3a17fa640 1 -- 172.21.15.148:0/2819157166 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe394035040 con 0x55e47ce0dd90 2024-09-19T07:26:57.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.825+0000 7fe3b4408740 1 -- 172.21.15.148:0/2819157166 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e47ce0dd90 msgr2=0x55e47ce2ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:57.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.825+0000 7fe3b4408740 1 --2- 172.21.15.148:0/2819157166 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e47ce0dd90 0x55e47ce2ff40 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fe394004d50 tx=0x7fe3940315b0 comp rx=0 tx=0).stop 2024-09-19T07:26:57.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.825+0000 7fe3b4408740 1 -- 172.21.15.148:0/2819157166 shutdown_connections 2024-09-19T07:26:57.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.825+0000 7fe3b4408740 1 --2- 172.21.15.148:0/2819157166 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e47ce18650 0x55e47ce12760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:57.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.825+0000 7fe3b4408740 1 --2- 172.21.15.148:0/2819157166 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e47ce0dd90 0x55e47ce2ff40 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:57.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.825+0000 7fe3b4408740 1 --2- 172.21.15.148:0/2819157166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e47ce0d470 0x55e47ce2fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:57.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.825+0000 7fe3b4408740 1 -- 172.21.15.148:0/2819157166 >> 172.21.15.148:0/2819157166 conn(0x55e47ce09a00 msgr2=0x55e47ce13db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:57.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.826+0000 7fe3b4408740 1 -- 172.21.15.148:0/2819157166 shutdown_connections 2024-09-19T07:26:57.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.826+0000 7fe3b4408740 1 -- 172.21.15.148:0/2819157166 wait complete. 2024-09-19T07:26:57.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.826+0000 7fe3b4408740 1 -- start start 2024-09-19T07:26:57.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.826+0000 7fe3b4408740 1 Processor -- start 2024-09-19T07:26:57.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.826+0000 7fe3b4408740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e47ce0d470 0x55e47ce208f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:57.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.826+0000 7fe3b4408740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e47ce0dd90 0x55e47ce20e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:57.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.826+0000 7fe3b4408740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e47ce18650 0x55e47ce1d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:57.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.826+0000 7fe3b4408740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe3ac1a9c80 con 0x55e47ce0d470 2024-09-19T07:26:57.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.826+0000 7fe3b4408740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe3ac1ab0f0 con 0x55e47ce18650 2024-09-19T07:26:57.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.826+0000 7fe3b4408740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe3ac1aa350 con 0x55e47ce0dd90 2024-09-19T07:26:57.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.826+0000 7fe3b4408740 10 client.0 _ll_register_callbacks cb 0x7fe39402ab60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:26:57.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.826+0000 7fe3ab7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e47ce0d470 0x55e47ce208f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:57.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.826+0000 7fe3ab7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e47ce0d470 0x55e47ce208f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60410/0 (socket says 172.21.15.148:60410) 2024-09-19T07:26:57.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.826+0000 7fe3ab7fe640 1 -- 172.21.15.148:0/63288935 learned_addr learned my addr 172.21.15.148:0/63288935 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:26:57.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.827+0000 7fe3a3fff640 1 --2- 172.21.15.148:0/63288935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e47ce0dd90 0x55e47ce20e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:57.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.827+0000 7fe3ab7fe640 1 -- 172.21.15.148:0/63288935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e47ce0dd90 msgr2=0x55e47ce20e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:57.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.827+0000 7fe3abfff640 1 --2- 172.21.15.148:0/63288935 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e47ce18650 0x55e47ce1d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:57.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.827+0000 7fe3ab7fe640 1 --2- 172.21.15.148:0/63288935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e47ce0dd90 0x55e47ce20e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:57.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.827+0000 7fe3ab7fe640 1 -- 172.21.15.148:0/63288935 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e47ce18650 msgr2=0x55e47ce1d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:57.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.827+0000 7fe3ab7fe640 1 --2- 172.21.15.148:0/63288935 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e47ce18650 0x55e47ce1d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:57.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.827+0000 7fe3ab7fe640 1 -- 172.21.15.148:0/63288935 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e47ce1dee0 con 0x55e47ce0d470 2024-09-19T07:26:57.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.827+0000 7fe3a3fff640 1 --2- 172.21.15.148:0/63288935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e47ce0dd90 0x55e47ce20e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:26:57.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.827+0000 7fe3ab7fe640 1 --2- 172.21.15.148:0/63288935 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e47ce0d470 0x55e47ce208f0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fe39c098bd0 tx=0x7fe39c0bc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b93503b12a39b0fa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:57.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.827+0000 7fe38affd640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:26:57.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.827+0000 7fe38affd640 1 -- 172.21.15.148:0/63288935 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39c0a05b0 con 0x55e47ce0d470 2024-09-19T07:26:57.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.827+0000 7fe38affd640 1 -- 172.21.15.148:0/63288935 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8556+0+0 (secure 0 0 0) 0x7fe39c00fb30 con 0x55e47ce0d470 2024-09-19T07:26:57.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.827+0000 7fe3b4408740 1 -- 172.21.15.148:0/63288935 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe394048030 con 0x55e47ce0d470 2024-09-19T07:26:57.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.827+0000 7fe38affd640 1 -- 172.21.15.148:0/63288935 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7fe39c0a4e70 con 0x55e47ce0d470 2024-09-19T07:26:57.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.827+0000 7fe3b4408740 10 client.17655 fetch_fsmap learned FSMap version 55 2024-09-19T07:26:57.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.827+0000 7fe3b4408740 1 -- 172.21.15.148:0/63288935 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x55e47ce93610 con 0x55e47ce0d470 2024-09-19T07:26:57.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.827+0000 7fe38affd640 1 -- 172.21.15.148:0/63288935 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe394048030 con 0x55e47ce0d470 2024-09-19T07:26:57.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.828+0000 7fe38affd640 1 -- 172.21.15.148:0/63288935 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 55) ==== 8370+0+0 (secure 0 0 0) 0x7fe39c09c460 con 0x55e47ce0d470 2024-09-19T07:26:57.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.828+0000 7fe3b4408740 10 client.17655 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T07:26:57.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.828+0000 7fe3b4408740 10 client.17655 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:26:57.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.828+0000 7fe3b4408740 20 client.17655 populate_metadata read hostname 'smithi148' 2024-09-19T07:26:57.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.828+0000 7fe3b4408740 1 --2- 172.21.15.148:0/63288935 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e47ce93da0 0x55e47ce961c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:57.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.828+0000 7fe3b4408740 4 client.17655 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "aac99a66", "release": true, "await": true}] 2024-09-19T07:26:57.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.828+0000 7fe3b4408740 1 -- 172.21.15.148:0/63288935 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "quiesce db", "set_id": "aac99a66", "release": true, "await": true}) -- 0x55e47cd760a0 con 0x55e47ce93da0 2024-09-19T07:26:57.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.828+0000 7fe3a3fff640 1 --2- 172.21.15.148:0/63288935 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e47ce93da0 0x55e47ce961c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:57.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.828+0000 7fe38affd640 10 client.17655 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:26:57.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:57.828+0000 7fe3a3fff640 1 --2- 172.21.15.148:0/63288935 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e47ce93da0 0x55e47ce961c0 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5513ac08a8b971d2 server_cookie=e2ee6114149906b1 in_seq=0 out_seq=0 2024-09-19T07:26:58.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:58.381+0000 7fe38affd640 1 -- 172.21.15.148:0/63288935 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55e47cd760a0 con 0x55e47ce93da0 2024-09-19T07:26:58.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:58.381+0000 7fe38affd640 10 client.17655 handle_command_reply: tid=0 2024-09-19T07:26:58.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:58.381+0000 7fe3b4408740 1 client.17655 shutdown 2024-09-19T07:26:58.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:58.381+0000 7fe3b4408740 1 -- 172.21.15.148:0/63288935 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e47ce0d470 msgr2=0x55e47ce208f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:58.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:58.381+0000 7fe3b4408740 1 --2- 172.21.15.148:0/63288935 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e47ce0d470 0x55e47ce208f0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fe39c098bd0 tx=0x7fe39c0bc040 comp rx=0 tx=0).stop 2024-09-19T07:26:58.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:58.381+0000 7fe3b4408740 1 -- 172.21.15.148:0/63288935 shutdown_connections 2024-09-19T07:26:58.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:58.381+0000 7fe3b4408740 1 --2- 172.21.15.148:0/63288935 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55e47ce93da0 0x55e47ce961c0 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:58.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:58.381+0000 7fe3b4408740 1 --2- 172.21.15.148:0/63288935 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e47ce18650 0x55e47ce1d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:58.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:58.381+0000 7fe3b4408740 1 --2- 172.21.15.148:0/63288935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e47ce0dd90 0x55e47ce20e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:58.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:58.381+0000 7fe3b4408740 1 --2- 172.21.15.148:0/63288935 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e47ce0d470 0x55e47ce208f0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:58.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:58.381+0000 7fe38affd640 0 client.17655 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:26:58.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:58.381+0000 7fe3b4408740 1 -- 172.21.15.148:0/63288935 >> 172.21.15.148:0/63288935 conn(0x55e47ce09a00 msgr2=0x55e47ce03f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:58.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:58.381+0000 7fe3b4408740 1 -- 172.21.15.148:0/63288935 shutdown_connections 2024-09-19T07:26:58.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:58.381+0000 7fe3b4408740 1 -- 172.21.15.148:0/63288935 wait complete. 2024-09-19T07:26:58.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:58.381+0000 7fe3b4408740 20 client.17655 trim_cache size 0 max 16384 2024-09-19T07:26:58.383 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:26:58.383 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 55, 2024-09-19T07:26:58.383 INFO:teuthology.orchestra.run.smithi148.stdout: "leader": 24457, 2024-09-19T07:26:58.383 INFO:teuthology.orchestra.run.smithi148.stdout: "set_version": 52, 2024-09-19T07:26:58.383 INFO:teuthology.orchestra.run.smithi148.stdout: "sets": { 2024-09-19T07:26:58.383 INFO:teuthology.orchestra.run.smithi148.stdout: "aac99a66": { 2024-09-19T07:26:58.384 INFO:teuthology.orchestra.run.smithi148.stdout: "version": 52, 2024-09-19T07:26:58.384 INFO:teuthology.orchestra.run.smithi148.stdout: "age_ref": 0.0, 2024-09-19T07:26:58.384 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:26:58.384 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RELEASED", 2024-09-19T07:26:58.384 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:26:58.384 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:26:58.384 INFO:teuthology.orchestra.run.smithi148.stdout: "timeout": 90.0, 2024-09-19T07:26:58.384 INFO:teuthology.orchestra.run.smithi148.stdout: "expiration": 149.4, 2024-09-19T07:26:58.384 INFO:teuthology.orchestra.run.smithi148.stdout: "members": { 2024-09-19T07:26:58.384 INFO:teuthology.orchestra.run.smithi148.stdout: "file:/": { 2024-09-19T07:26:58.384 INFO:teuthology.orchestra.run.smithi148.stdout: "excluded": false, 2024-09-19T07:26:58.384 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:26:58.384 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RELEASED", 2024-09-19T07:26:58.385 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:26:58.385 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:26:58.385 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:26:58.385 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:26:58.385 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:26:58.385 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:26:58.385 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:26:58.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:58.382+0000 7fe3b202f640 1 -- 172.21.15.148:0/1539531341 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe3980a33b0 msgr2=0x7fe3980a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:58.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:58.382+0000 7fe3b202f640 1 --2- 172.21.15.148:0/1539531341 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe3980a33b0 0x7fe3980a5870 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe3a4009fd0 tx=0x7fe3a4005bd0 comp rx=0 tx=0).stop 2024-09-19T07:26:58.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:58.382+0000 7fe3b202f640 1 -- 172.21.15.148:0/1539531341 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3ac101de0 msgr2=0x7fe3ac198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:58.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:58.382+0000 7fe3b202f640 1 --2- 172.21.15.148:0/1539531341 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3ac101de0 0x7fe3ac198380 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fe39c00c920 tx=0x7fe39c00cde0 comp rx=0 tx=0).stop 2024-09-19T07:26:58.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:58.382+0000 7fe3b202f640 1 -- 172.21.15.148:0/1539531341 shutdown_connections 2024-09-19T07:26:58.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:58.382+0000 7fe3b202f640 1 --2- 172.21.15.148:0/1539531341 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fe3980a33b0 0x7fe3980a5870 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:58.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:58.382+0000 7fe3b202f640 1 --2- 172.21.15.148:0/1539531341 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3ac106f10 0x7fe3ac19cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:58.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:58.382+0000 7fe3b202f640 1 --2- 172.21.15.148:0/1539531341 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3ac102790 0x7fe3ac1988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:58.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:58.382+0000 7fe3b202f640 1 --2- 172.21.15.148:0/1539531341 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3ac101de0 0x7fe3ac198380 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:58.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:58.382+0000 7fe3b202f640 1 -- 172.21.15.148:0/1539531341 >> 172.21.15.148:0/1539531341 conn(0x7fe3ac0fd8c0 msgr2=0x7fe3ac0fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:58.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:58.382+0000 7fe3b202f640 1 -- 172.21.15.148:0/1539531341 shutdown_connections 2024-09-19T07:26:58.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:26:58.382+0000 7fe3b202f640 1 -- 172.21.15.148:0/1539531341 wait complete. 2024-09-19T07:26:59.203 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'aac99a66', total seconds elapsed: 33.4 2024-09-19T07:26:59.203 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.45 2024-09-19T07:26:59.204 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:26:59.469 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:26:59.582 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:26:59 smithi148 ceph-mon[31180]: pgmap v499: 97 pgs: 97 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 5.3 KiB/s wr, 8 op/s 2024-09-19T07:26:59.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:26:59 smithi165 ceph-mon[35326]: pgmap v499: 97 pgs: 97 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 5.3 KiB/s wr, 8 op/s 2024-09-19T07:26:59.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:26:59 smithi179 ceph-mon[35716]: pgmap v499: 97 pgs: 97 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 5.3 KiB/s wr, 8 op/s 2024-09-19T07:27:00.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.005+0000 7f59a1688640 1 -- 172.21.15.148:0/3572299647 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f599c100a90 msgr2=0x7f599c100ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:00.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.005+0000 7f59a1688640 1 --2- 172.21.15.148:0/3572299647 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f599c100a90 0x7f599c100ef0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f599000dcc0 tx=0x7f599002e3b0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.005+0000 7f59a1688640 1 -- 172.21.15.148:0/3572299647 shutdown_connections 2024-09-19T07:27:00.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.005+0000 7f59a1688640 1 --2- 172.21.15.148:0/3572299647 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f599c101430 0x7f599c10d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.005+0000 7f59a1688640 1 --2- 172.21.15.148:0/3572299647 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f599c100a90 0x7f599c100ef0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.005+0000 7f59a1688640 1 --2- 172.21.15.148:0/3572299647 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f599c106a90 0x7f599c106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.005+0000 7f59a1688640 1 -- 172.21.15.148:0/3572299647 >> 172.21.15.148:0/3572299647 conn(0x7f599c0fc7d0 msgr2=0x7f599c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:00.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.005+0000 7f59a1688640 1 -- 172.21.15.148:0/3572299647 shutdown_connections 2024-09-19T07:27:00.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.005+0000 7f59a1688640 1 -- 172.21.15.148:0/3572299647 wait complete. 2024-09-19T07:27:00.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.006+0000 7f59a1688640 1 Processor -- start 2024-09-19T07:27:00.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.006+0000 7f59a1688640 1 -- start start 2024-09-19T07:27:00.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.006+0000 7f59a1688640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f599c100a90 0x7f599c196330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:00.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.006+0000 7f59a1688640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f599c101430 0x7f599c196870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:00.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.007+0000 7f59a1688640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f599c106a90 0x7f599c19ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:00.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.007+0000 7f59a1688640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f599c10fe10 con 0x7f599c106a90 2024-09-19T07:27:00.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.007+0000 7f59a1688640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f599c10fc90 con 0x7f599c100a90 2024-09-19T07:27:00.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.007+0000 7f59a1688640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f599c10ff90 con 0x7f599c101430 2024-09-19T07:27:00.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.007+0000 7f599affd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f599c100a90 0x7f599c196330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:00.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.007+0000 7f599b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f599c106a90 0x7f599c19ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:00.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.007+0000 7f599affd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f599c100a90 0x7f599c196330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:51490/0 (socket says 172.21.15.148:51490) 2024-09-19T07:27:00.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.007+0000 7f599affd640 1 -- 172.21.15.148:0/1559539510 learned_addr learned my addr 172.21.15.148:0/1559539510 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:27:00.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.007+0000 7f599a7fc640 1 --2- 172.21.15.148:0/1559539510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f599c101430 0x7f599c196870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:00.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.007+0000 7f599b7fe640 1 -- 172.21.15.148:0/1559539510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f599c101430 msgr2=0x7f599c196870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:00.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.007+0000 7f599b7fe640 1 --2- 172.21.15.148:0/1559539510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f599c101430 0x7f599c196870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.007+0000 7f599b7fe640 1 -- 172.21.15.148:0/1559539510 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f599c100a90 msgr2=0x7f599c196330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:00.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.007+0000 7f599b7fe640 1 --2- 172.21.15.148:0/1559539510 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f599c100a90 0x7f599c196330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.007+0000 7f599b7fe640 1 -- 172.21.15.148:0/1559539510 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f599c19b2e0 con 0x7f599c106a90 2024-09-19T07:27:00.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.007+0000 7f599b7fe640 1 --2- 172.21.15.148:0/1559539510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f599c106a90 0x7f599c19ac00 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f599400be00 tx=0x7f599400bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:00.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.007+0000 7f5983fff640 1 -- 172.21.15.148:0/1559539510 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5994019070 con 0x7f599c106a90 2024-09-19T07:27:00.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.007+0000 7f5983fff640 1 -- 172.21.15.148:0/1559539510 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5994014920 con 0x7f599c106a90 2024-09-19T07:27:00.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.007+0000 7f59a1688640 1 -- 172.21.15.148:0/1559539510 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f599c19b5d0 con 0x7f599c106a90 2024-09-19T07:27:00.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.008+0000 7f5983fff640 1 -- 172.21.15.148:0/1559539510 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5994012920 con 0x7f599c106a90 2024-09-19T07:27:00.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.008+0000 7f59a1688640 1 -- 172.21.15.148:0/1559539510 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f599c1a2eb0 con 0x7f599c106a90 2024-09-19T07:27:00.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.008+0000 7f59a1688640 1 -- 172.21.15.148:0/1559539510 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f599c100ef0 con 0x7f599c106a90 2024-09-19T07:27:00.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.010+0000 7f5983fff640 1 -- 172.21.15.148:0/1559539510 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f599401c070 con 0x7f599c106a90 2024-09-19T07:27:00.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.011+0000 7f5983fff640 1 --2- 172.21.15.148:0/1559539510 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f59840a34b0 0x7f59840a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:00.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.011+0000 7f599affd640 1 --2- 172.21.15.148:0/1559539510 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f59840a34b0 0x7f59840a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:00.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.011+0000 7f5983fff640 1 -- 172.21.15.148:0/1559539510 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8556+0+0 (secure 0 0 0) 0x7f59940cfa70 con 0x7f599c106a90 2024-09-19T07:27:00.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.012+0000 7f599affd640 1 --2- 172.21.15.148:0/1559539510 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f59840a34b0 0x7f59840a5970 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f598c005fd0 tx=0x7f598c00b480 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:00.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.016+0000 7f5983fff640 1 -- 172.21.15.148:0/1559539510 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f599409be90 con 0x7f599c106a90 2024-09-19T07:27:00.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.354+0000 7f59a1688640 1 -- 172.21.15.148:0/1559539510 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f599c197690 con 0x7f599c106a90 2024-09-19T07:27:00.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.354+0000 7f5983fff640 1 -- 172.21.15.148:0/1559539510 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+11947 (secure 0 0 0) 0x7f59940a0190 con 0x7f599c106a90 2024-09-19T07:27:00.355 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:27:00.355 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":55,"btime":"2024-09-19T07:26:06:767218+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/4263868576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":4263868576},{"type":"v1","addr":"172.21.15.148:6841","nonce":4263868576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":25606,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3891676893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3891676893},{"type":"v1","addr":"172.21.15.179:6835","nonce":3891676893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":55,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:09:19.543369+0000","modified":"2024-09-19T07:26:06.157910+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24457,"mds_1":24437,"mds_2":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":75,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":71,"addr":"172.21.15.165:6839/3993490234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":3993490234},{"type":"v1","addr":"172.21.15.165:6839","nonce":3993490234}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25823":{"gid":25823,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6835/380886107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":380886107},{"type":"v1","addr":"172.21.15.165:6835","nonce":380886107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24457,"qdb_cluster":[24457,24437,24436]},"id":1}]} 2024-09-19T07:27:00.355 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 55 2024-09-19T07:27:00.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.357+0000 7f59a1688640 1 -- 172.21.15.148:0/1559539510 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f59840a34b0 msgr2=0x7f59840a5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:00.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.357+0000 7f59a1688640 1 --2- 172.21.15.148:0/1559539510 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f59840a34b0 0x7f59840a5970 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f598c005fd0 tx=0x7f598c00b480 comp rx=0 tx=0).stop 2024-09-19T07:27:00.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.357+0000 7f59a1688640 1 -- 172.21.15.148:0/1559539510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f599c106a90 msgr2=0x7f599c19ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:00.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.357+0000 7f59a1688640 1 --2- 172.21.15.148:0/1559539510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f599c106a90 0x7f599c19ac00 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f599400be00 tx=0x7f599400bef0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.357+0000 7f59a1688640 1 -- 172.21.15.148:0/1559539510 shutdown_connections 2024-09-19T07:27:00.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.357+0000 7f59a1688640 1 --2- 172.21.15.148:0/1559539510 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f59840a34b0 0x7f59840a5970 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.357+0000 7f59a1688640 1 --2- 172.21.15.148:0/1559539510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f599c106a90 0x7f599c19ac00 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.357+0000 7f59a1688640 1 --2- 172.21.15.148:0/1559539510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f599c101430 0x7f599c196870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.357+0000 7f59a1688640 1 --2- 172.21.15.148:0/1559539510 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f599c100a90 0x7f599c196330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.357+0000 7f59a1688640 1 -- 172.21.15.148:0/1559539510 >> 172.21.15.148:0/1559539510 conn(0x7f599c0fc7d0 msgr2=0x7f599c0fcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:00.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.357+0000 7f59a1688640 1 -- 172.21.15.148:0/1559539510 shutdown_connections 2024-09-19T07:27:00.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:00.357+0000 7f59a1688640 1 -- 172.21.15.148:0/1559539510 wait complete. 2024-09-19T07:27:00.546 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.544+0000 7f94940dd640 1 -- 172.21.15.148:0/3222895497 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f948c102c80 msgr2=0x7f948c103060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:00.546 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.544+0000 7f94940dd640 1 --2- 172.21.15.148:0/3222895497 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f948c102c80 0x7f948c103060 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f9488009ca0 tx=0x7f948802a950 comp rx=0 tx=0).stop 2024-09-19T07:27:00.547 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.544+0000 7f94940dd640 1 -- 172.21.15.148:0/3222895497 shutdown_connections 2024-09-19T07:27:00.547 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.544+0000 7f94940dd640 1 --2- 172.21.15.148:0/3222895497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f948c10c0d0 0x7f948c10e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.547 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.544+0000 7f94940dd640 1 --2- 172.21.15.148:0/3222895497 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f948c1035a0 0x7f948c10ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.547 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.544+0000 7f94940dd640 1 --2- 172.21.15.148:0/3222895497 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f948c102c80 0x7f948c103060 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.547 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.544+0000 7f94940dd640 1 -- 172.21.15.148:0/3222895497 >> 172.21.15.148:0/3222895497 conn(0x7f948c077990 msgr2=0x7f948c0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:00.547 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.544+0000 7f94940dd640 1 -- 172.21.15.148:0/3222895497 shutdown_connections 2024-09-19T07:27:00.547 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.544+0000 7f94940dd640 1 -- 172.21.15.148:0/3222895497 wait complete. 2024-09-19T07:27:00.547 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.544+0000 7f94940dd640 1 Processor -- start 2024-09-19T07:27:00.547 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.544+0000 7f94940dd640 1 -- start start 2024-09-19T07:27:00.547 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.545+0000 7f94940dd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f948c102c80 0x7f948c198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:00.547 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.545+0000 7f94940dd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f948c1035a0 0x7f948c198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:00.547 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.545+0000 7f94940dd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f948c10c0d0 0x7f948c19cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:00.548 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.545+0000 7f94940dd640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f948c111eb0 con 0x7f948c10c0d0 2024-09-19T07:27:00.548 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.545+0000 7f94940dd640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f948c111d30 con 0x7f948c1035a0 2024-09-19T07:27:00.548 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.545+0000 7f94940dd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f948c112030 con 0x7f948c102c80 2024-09-19T07:27:00.548 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.545+0000 7f9491e79640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f948c102c80 0x7f948c198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:00.548 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.545+0000 7f949267a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f948c10c0d0 0x7f948c19cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:00.548 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.545+0000 7f9491e79640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f948c102c80 0x7f948c198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:35900/0 (socket says 172.21.15.148:35900) 2024-09-19T07:27:00.548 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.545+0000 7f9491e79640 1 -- 172.21.15.148:0/3984770848 learned_addr learned my addr 172.21.15.148:0/3984770848 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:27:00.548 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.545+0000 7f949267a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f948c10c0d0 0x7f948c19cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60440/0 (socket says 172.21.15.148:60440) 2024-09-19T07:27:00.548 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.545+0000 7f9491678640 1 --2- 172.21.15.148:0/3984770848 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f948c1035a0 0x7f948c198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:00.548 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.545+0000 7f9491e79640 1 -- 172.21.15.148:0/3984770848 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f948c1035a0 msgr2=0x7f948c198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:00.548 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.545+0000 7f9491e79640 1 --2- 172.21.15.148:0/3984770848 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f948c1035a0 0x7f948c198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.548 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.545+0000 7f9491e79640 1 -- 172.21.15.148:0/3984770848 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f948c10c0d0 msgr2=0x7f948c19cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:00.548 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.545+0000 7f9491e79640 1 --2- 172.21.15.148:0/3984770848 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f948c10c0d0 0x7f948c19cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.549 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.545+0000 7f9491e79640 1 -- 172.21.15.148:0/3984770848 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f948c19d330 con 0x7f948c102c80 2024-09-19T07:27:00.549 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.545+0000 7f949267a640 1 --2- 172.21.15.148:0/3984770848 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f948c10c0d0 0x7f948c19cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:27:00.549 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.545+0000 7f9491e79640 1 --2- 172.21.15.148:0/3984770848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f948c102c80 0x7f948c198340 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9488005cc0 tx=0x7f948802f420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:00.549 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.545+0000 7f9482ffd640 1 -- 172.21.15.148:0/3984770848 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9488034040 con 0x7f948c102c80 2024-09-19T07:27:00.549 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.545+0000 7f94940dd640 1 -- 172.21.15.148:0/3984770848 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f948c19d5c0 con 0x7f948c102c80 2024-09-19T07:27:00.549 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.546+0000 7f94940dd640 1 -- 172.21.15.148:0/3984770848 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f948c1a4eb0 con 0x7f948c102c80 2024-09-19T07:27:00.549 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.546+0000 7f9482ffd640 1 -- 172.21.15.148:0/3984770848 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94880098c0 con 0x7f948c102c80 2024-09-19T07:27:00.549 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.546+0000 7f9482ffd640 1 -- 172.21.15.148:0/3984770848 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9488039430 con 0x7f948c102c80 2024-09-19T07:27:00.555 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.548+0000 7f9482ffd640 1 -- 172.21.15.148:0/3984770848 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f9488037020 con 0x7f948c102c80 2024-09-19T07:27:00.555 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.548+0000 7f9496e7b740 1 Processor -- start 2024-09-19T07:27:00.555 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.548+0000 7f9496e7b740 1 -- start start 2024-09-19T07:27:00.555 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.548+0000 7f9496e7b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c11306daf0 0x55c11306ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:00.555 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.548+0000 7f9496e7b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c11306e410 0x55c113078770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:00.555 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.548+0000 7f9496e7b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c113078cb0 0x55c11307b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:00.555 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.548+0000 7f9496e7b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55c112fd22f0 con 0x55c11306e410 2024-09-19T07:27:00.555 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.548+0000 7f9496e7b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55c112f7a270 con 0x55c11306daf0 2024-09-19T07:27:00.555 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.548+0000 7f9496e7b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c112fce2b0 con 0x55c113078cb0 2024-09-19T07:27:00.555 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.548+0000 7f9482ffd640 1 --2- 172.21.15.148:0/3984770848 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f94780a3460 0x7f94780a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:00.555 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.549+0000 7f9491e79640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c11306e410 0x55c113078770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:00.555 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.549+0000 7f9491678640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c113078cb0 0x55c11307b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:00.556 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.549+0000 7f9491e79640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c11306e410 0x55c113078770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60442/0 (socket says 172.21.15.148:60442) 2024-09-19T07:27:00.556 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.549+0000 7f9491e79640 1 -- 172.21.15.148:0/2089025071 learned_addr learned my addr 172.21.15.148:0/2089025071 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:27:00.556 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.549+0000 7f949267a640 1 --2- 172.21.15.148:0/2089025071 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c11306daf0 0x55c11306ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:00.556 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.549+0000 7f949267a640 1 --2- 172.21.15.148:0/3984770848 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f94780a3460 0x7f94780a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:00.556 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.549+0000 7f9482ffd640 1 -- 172.21.15.148:0/3984770848 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8556+0+0 (secure 0 0 0) 0x7f94880f0980 con 0x7f948c102c80 2024-09-19T07:27:00.556 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.549+0000 7f9491678640 1 -- 172.21.15.148:0/2089025071 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c11306daf0 msgr2=0x55c11306ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:00.556 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.549+0000 7f9491678640 1 --2- 172.21.15.148:0/2089025071 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c11306daf0 0x55c11306ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.556 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.549+0000 7f9491678640 1 -- 172.21.15.148:0/2089025071 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c11306e410 msgr2=0x55c113078770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:00.556 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.549+0000 7f9491678640 1 --2- 172.21.15.148:0/2089025071 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c11306e410 0x55c113078770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.556 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.549+0000 7f9491678640 1 -- 172.21.15.148:0/2089025071 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c112f79340 con 0x55c113078cb0 2024-09-19T07:27:00.556 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.549+0000 7f9491678640 1 --2- 172.21.15.148:0/2089025071 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c113078cb0 0x55c11307b0a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f947c009be0 tx=0x7f947c011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1d3b7b7fe39aae8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:00.556 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.549+0000 7f949267a640 1 --2- 172.21.15.148:0/3984770848 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f94780a3460 0x7f94780a5920 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9484009fd0 tx=0x7f9484005f90 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:00.556 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.549+0000 7f9477fff640 1 -- 172.21.15.148:0/2089025071 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947c004050 con 0x55c113078cb0 2024-09-19T07:27:00.557 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.549+0000 7f9477fff640 1 -- 172.21.15.148:0/2089025071 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f947c005500 con 0x55c113078cb0 2024-09-19T07:27:00.557 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.549+0000 7f9477fff640 1 -- 172.21.15.148:0/2089025071 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947c004dd0 con 0x55c113078cb0 2024-09-19T07:27:00.557 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.550+0000 7f9496e7b740 1 -- 172.21.15.148:0/2089025071 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c113078cb0 msgr2=0x55c11307b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:00.557 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.550+0000 7f9496e7b740 1 --2- 172.21.15.148:0/2089025071 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c113078cb0 0x55c11307b0a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f947c009be0 tx=0x7f947c011810 comp rx=0 tx=0).stop 2024-09-19T07:27:00.557 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.550+0000 7f9496e7b740 1 -- 172.21.15.148:0/2089025071 shutdown_connections 2024-09-19T07:27:00.557 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.550+0000 7f9496e7b740 1 --2- 172.21.15.148:0/2089025071 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c113078cb0 0x55c11307b0a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.557 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.550+0000 7f9496e7b740 1 --2- 172.21.15.148:0/2089025071 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c11306e410 0x55c113078770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.557 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.550+0000 7f9496e7b740 1 --2- 172.21.15.148:0/2089025071 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c11306daf0 0x55c11306ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.557 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.550+0000 7f9496e7b740 1 -- 172.21.15.148:0/2089025071 >> 172.21.15.148:0/2089025071 conn(0x55c11306a060 msgr2=0x55c11306a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:00.557 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.550+0000 7f9496e7b740 1 -- 172.21.15.148:0/2089025071 shutdown_connections 2024-09-19T07:27:00.557 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.550+0000 7f9496e7b740 1 -- 172.21.15.148:0/2089025071 wait complete. 2024-09-19T07:27:00.557 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.550+0000 7f9496e7b740 1 -- start start 2024-09-19T07:27:00.558 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.551+0000 7f9496e7b740 1 Processor -- start 2024-09-19T07:27:00.558 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.551+0000 7f9496e7b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c11306daf0 0x55c113075a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:00.558 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.551+0000 7f9496e7b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c11306e410 0x55c113075fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:00.558 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.551+0000 7f9496e7b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c113078cb0 0x55c113076510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:00.558 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.551+0000 7f9496e7b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55c11307b880 con 0x55c11306daf0 2024-09-19T07:27:00.558 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.551+0000 7f9496e7b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55c112f5b290 con 0x55c11306e410 2024-09-19T07:27:00.558 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.551+0000 7f9496e7b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c11307ba00 con 0x55c113078cb0 2024-09-19T07:27:00.558 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.551+0000 7f9496e7b740 10 client.0 _ll_register_callbacks cb 0x55c112f8c140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:27:00.558 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.551+0000 7f9491e79640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c11306daf0 0x55c113075a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:00.558 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.551+0000 7f9491e79640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c11306daf0 0x55c113075a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60446/0 (socket says 172.21.15.148:60446) 2024-09-19T07:27:00.558 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.551+0000 7f9491e79640 1 -- 172.21.15.148:0/1244770002 learned_addr learned my addr 172.21.15.148:0/1244770002 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:27:00.558 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.551+0000 7f949267a640 1 --2- 172.21.15.148:0/1244770002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c113078cb0 0x55c113076510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:00.559 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.551+0000 7f9491678640 1 --2- 172.21.15.148:0/1244770002 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c11306e410 0x55c113075fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:00.559 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.551+0000 7f9491e79640 1 -- 172.21.15.148:0/1244770002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c113078cb0 msgr2=0x55c113076510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:00.559 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.551+0000 7f9491e79640 1 --2- 172.21.15.148:0/1244770002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c113078cb0 0x55c113076510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.559 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.551+0000 7f9491e79640 1 -- 172.21.15.148:0/1244770002 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c11306e410 msgr2=0x55c113075fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:00.559 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.551+0000 7f9491e79640 1 --2- 172.21.15.148:0/1244770002 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c11306e410 0x55c113075fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.559 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.551+0000 7f9491e79640 1 -- 172.21.15.148:0/1244770002 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c112ce5210 con 0x55c11306daf0 2024-09-19T07:27:00.559 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.551+0000 7f9491e79640 1 --2- 172.21.15.148:0/1244770002 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c11306daf0 0x55c113075a90 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f94880b9720 tx=0x7f948802a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ae9259835a25540 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:00.559 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.551+0000 7f94757fa640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:27:00.559 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.552+0000 7f94757fa640 1 -- 172.21.15.148:0/1244770002 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9488003d70 con 0x55c11306daf0 2024-09-19T07:27:00.559 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.552+0000 7f94757fa640 1 -- 172.21.15.148:0/1244770002 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8556+0+0 (secure 0 0 0) 0x7f94880c5530 con 0x55c11306daf0 2024-09-19T07:27:00.559 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.552+0000 7f9496e7b740 1 -- 172.21.15.148:0/1244770002 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f947c005500 con 0x55c11306daf0 2024-09-19T07:27:00.559 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.552+0000 7f94757fa640 1 -- 172.21.15.148:0/1244770002 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f94880da050 con 0x55c11306daf0 2024-09-19T07:27:00.559 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.552+0000 7f9496e7b740 10 client.17673 fetch_fsmap learned FSMap version 55 2024-09-19T07:27:00.559 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.552+0000 7f9496e7b740 1 -- 172.21.15.148:0/1244770002 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x55c112db1620 con 0x55c11306daf0 2024-09-19T07:27:00.560 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.552+0000 7f94757fa640 1 -- 172.21.15.148:0/1244770002 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f947c005500 con 0x55c11306daf0 2024-09-19T07:27:00.560 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.552+0000 7f94757fa640 1 -- 172.21.15.148:0/1244770002 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 55) ==== 8370+0+0 (secure 0 0 0) 0x7f948804d030 con 0x55c11306daf0 2024-09-19T07:27:00.560 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.552+0000 7f9496e7b740 10 client.17673 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T07:27:00.560 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.552+0000 7f9496e7b740 10 client.17673 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:27:00.560 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.552+0000 7f9496e7b740 20 client.17673 populate_metadata read hostname 'smithi148' 2024-09-19T07:27:00.560 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.552+0000 7f9496e7b740 1 --2- 172.21.15.148:0/1244770002 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55c113088b70 0x55c11308b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:00.560 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.552+0000 7f9496e7b740 4 client.17673 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:27:00.560 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.552+0000 7f9496e7b740 1 -- 172.21.15.148:0/1244770002 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c112fdfa20 con 0x55c113088b70 2024-09-19T07:27:00.560 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.552+0000 7f9491678640 1 --2- 172.21.15.148:0/1244770002 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55c113088b70 0x55c11308b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:00.560 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.553+0000 7f9491678640 1 --2- 172.21.15.148:0/1244770002 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55c113088b70 0x55c11308b010 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a08a721d406c020 server_cookie=2a005cb0d389cae6 in_seq=0 out_seq=0 2024-09-19T07:27:00.560 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.553+0000 7f94757fa640 10 client.17673 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:27:00.561 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.555+0000 7f94757fa640 1 -- 172.21.15.148:0/1244770002 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c112fdfa20 con 0x55c113088b70 2024-09-19T07:27:00.561 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.555+0000 7f94757fa640 10 client.17673 handle_command_reply: tid=0 2024-09-19T07:27:00.561 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.555+0000 7f9496e7b740 1 client.17673 shutdown 2024-09-19T07:27:00.561 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.555+0000 7f9496e7b740 1 -- 172.21.15.148:0/1244770002 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c11306daf0 msgr2=0x55c113075a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:00.561 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.555+0000 7f9496e7b740 1 --2- 172.21.15.148:0/1244770002 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c11306daf0 0x55c113075a90 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f94880b9720 tx=0x7f948802a950 comp rx=0 tx=0).stop 2024-09-19T07:27:00.562 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.555+0000 7f9496e7b740 1 -- 172.21.15.148:0/1244770002 shutdown_connections 2024-09-19T07:27:00.562 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.555+0000 7f9496e7b740 1 --2- 172.21.15.148:0/1244770002 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55c113088b70 0x55c11308b010 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.562 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.555+0000 7f9496e7b740 1 --2- 172.21.15.148:0/1244770002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c113078cb0 0x55c113076510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.562 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.555+0000 7f9496e7b740 1 --2- 172.21.15.148:0/1244770002 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c11306e410 0x55c113075fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.562 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.555+0000 7f9496e7b740 1 --2- 172.21.15.148:0/1244770002 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c11306daf0 0x55c113075a90 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.562 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.555+0000 7f94757fa640 0 client.17673 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:27:00.562 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.555+0000 7f9496e7b740 1 -- 172.21.15.148:0/1244770002 >> 172.21.15.148:0/1244770002 conn(0x55c11306a060 msgr2=0x55c11306fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:00.562 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.555+0000 7f9496e7b740 1 -- 172.21.15.148:0/1244770002 shutdown_connections 2024-09-19T07:27:00.562 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.555+0000 7f9496e7b740 1 -- 172.21.15.148:0/1244770002 wait complete. 2024-09-19T07:27:00.562 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.555+0000 7f9496e7b740 20 client.17673 trim_cache size 0 max 16384 2024-09-19T07:27:00.575 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.570+0000 7f9496e7b740 1 Processor -- start 2024-09-19T07:27:00.576 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.570+0000 7f9496e7b740 1 -- start start 2024-09-19T07:27:00.576 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.570+0000 7f9496e7b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c11306daf0 0x55c113076340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:00.576 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.570+0000 7f9496e7b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c11306e410 0x55c113090920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:00.576 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.570+0000 7f9496e7b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c113078cb0 0x55c113090e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:00.576 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.570+0000 7f9496e7b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9470011090 con 0x55c11306e410 2024-09-19T07:27:00.576 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.570+0000 7f9496e7b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f947000e8a0 con 0x55c113078cb0 2024-09-19T07:27:00.576 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.570+0000 7f9496e7b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f947000c710 con 0x55c11306daf0 2024-09-19T07:27:00.576 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.571+0000 7f9491678640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c11306e410 0x55c113090920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:00.576 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.571+0000 7f9491678640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c11306e410 0x55c113090920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60458/0 (socket says 172.21.15.148:60458) 2024-09-19T07:27:00.576 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.571+0000 7f9491678640 1 -- 172.21.15.148:0/232494335 learned_addr learned my addr 172.21.15.148:0/232494335 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:27:00.577 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.571+0000 7f9491e79640 1 --2- 172.21.15.148:0/232494335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c11306daf0 0x55c113076340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:00.577 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.571+0000 7f949267a640 1 --2- 172.21.15.148:0/232494335 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c113078cb0 0x55c113090e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:00.577 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.571+0000 7f9491678640 1 -- 172.21.15.148:0/232494335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c11306daf0 msgr2=0x55c113076340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:00.577 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.571+0000 7f9491678640 1 --2- 172.21.15.148:0/232494335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c11306daf0 0x55c113076340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.577 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.571+0000 7f9491678640 1 -- 172.21.15.148:0/232494335 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c113078cb0 msgr2=0x55c113090e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:00.577 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.571+0000 7f9491678640 1 --2- 172.21.15.148:0/232494335 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c113078cb0 0x55c113090e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.577 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.571+0000 7f9491678640 1 -- 172.21.15.148:0/232494335 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c113069e90 con 0x55c11306e410 2024-09-19T07:27:00.577 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.571+0000 7f949267a640 1 --2- 172.21.15.148:0/232494335 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c113078cb0 0x55c113090e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:27:00.577 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.571+0000 7f9491678640 1 --2- 172.21.15.148:0/232494335 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c11306e410 0x55c113090920 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f947c000c00 tx=0x7f947c009610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76afca46c3548f83 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:00.577 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.571+0000 7f94777fe640 1 -- 172.21.15.148:0/232494335 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947c033070 con 0x55c11306e410 2024-09-19T07:27:00.577 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.571+0000 7f94777fe640 1 -- 172.21.15.148:0/232494335 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f947c004810 con 0x55c11306e410 2024-09-19T07:27:00.577 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.571+0000 7f94777fe640 1 -- 172.21.15.148:0/232494335 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947c02e3e0 con 0x55c11306e410 2024-09-19T07:27:00.577 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.572+0000 7f9496e7b740 1 -- 172.21.15.148:0/232494335 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c11306e410 msgr2=0x55c113090920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:00.577 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.572+0000 7f9496e7b740 1 --2- 172.21.15.148:0/232494335 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c11306e410 0x55c113090920 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f947c000c00 tx=0x7f947c009610 comp rx=0 tx=0).stop 2024-09-19T07:27:00.578 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.572+0000 7f9496e7b740 1 -- 172.21.15.148:0/232494335 shutdown_connections 2024-09-19T07:27:00.578 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.572+0000 7f9496e7b740 1 --2- 172.21.15.148:0/232494335 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c113078cb0 0x55c113090e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.578 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.572+0000 7f9496e7b740 1 --2- 172.21.15.148:0/232494335 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c11306e410 0x55c113090920 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.578 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.572+0000 7f9496e7b740 1 --2- 172.21.15.148:0/232494335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c11306daf0 0x55c113076340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.578 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.572+0000 7f9496e7b740 1 -- 172.21.15.148:0/232494335 >> 172.21.15.148:0/232494335 conn(0x55c11306a060 msgr2=0x55c113077b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:00.578 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.572+0000 7f9496e7b740 1 -- 172.21.15.148:0/232494335 shutdown_connections 2024-09-19T07:27:00.578 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.572+0000 7f9496e7b740 1 -- 172.21.15.148:0/232494335 wait complete. 2024-09-19T07:27:00.578 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.572+0000 7f9496e7b740 1 -- start start 2024-09-19T07:27:00.578 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.572+0000 7f9496e7b740 1 Processor -- start 2024-09-19T07:27:00.578 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.573+0000 7f9496e7b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c11306daf0 0x55c113080d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:00.578 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.573+0000 7f9496e7b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c11306e410 0x55c113081240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:00.578 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.573+0000 7f9496e7b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c113078cb0 0x55c11307bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:00.578 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.573+0000 7f9496e7b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f947000cd60 con 0x55c113078cb0 2024-09-19T07:27:00.578 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.573+0000 7f9496e7b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f947000e1d0 con 0x55c11306e410 2024-09-19T07:27:00.579 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.573+0000 7f9496e7b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f947000d430 con 0x55c11306daf0 2024-09-19T07:27:00.579 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.573+0000 7f9496e7b740 10 client.0 _ll_register_callbacks cb 0x7f94880b8980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:27:00.579 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.573+0000 7f949267a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c113078cb0 0x55c11307bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:00.579 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.573+0000 7f9491e79640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c11306daf0 0x55c113080d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:00.579 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.573+0000 7f949267a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c113078cb0 0x55c11307bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60460/0 (socket says 172.21.15.148:60460) 2024-09-19T07:27:00.579 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.573+0000 7f949267a640 1 -- 172.21.15.148:0/2995706087 learned_addr learned my addr 172.21.15.148:0/2995706087 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:27:00.579 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.573+0000 7f9491678640 1 --2- 172.21.15.148:0/2995706087 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c11306e410 0x55c113081240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:00.579 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.573+0000 7f949267a640 1 -- 172.21.15.148:0/2995706087 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c11306daf0 msgr2=0x55c113080d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:00.579 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.573+0000 7f949267a640 1 --2- 172.21.15.148:0/2995706087 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c11306daf0 0x55c113080d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.579 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.573+0000 7f949267a640 1 -- 172.21.15.148:0/2995706087 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c11306e410 msgr2=0x55c113081240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:00.579 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.573+0000 7f949267a640 1 --2- 172.21.15.148:0/2995706087 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c11306e410 0x55c113081240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.579 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.573+0000 7f949267a640 1 -- 172.21.15.148:0/2995706087 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c113081980 con 0x55c113078cb0 2024-09-19T07:27:00.579 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.573+0000 7f9491678640 1 --2- 172.21.15.148:0/2995706087 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c11306e410 0x55c113081240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:27:00.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.573+0000 7f9491e79640 1 --2- 172.21.15.148:0/2995706087 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c11306daf0 0x55c113080d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:27:00.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.573+0000 7f949267a640 1 --2- 172.21.15.148:0/2995706087 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c113078cb0 0x55c11307bcb0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f9484010000 tx=0x7f9484004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96dea07088765851 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:00.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.573+0000 7f94757fa640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:27:00.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.573+0000 7f94757fa640 1 -- 172.21.15.148:0/2995706087 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9484003980 con 0x55c113078cb0 2024-09-19T07:27:00.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.573+0000 7f94757fa640 1 -- 172.21.15.148:0/2995706087 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8556+0+0 (secure 0 0 0) 0x7f9484003b20 con 0x55c113078cb0 2024-09-19T07:27:00.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.573+0000 7f9496e7b740 1 -- 172.21.15.148:0/2995706087 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f947c004810 con 0x55c113078cb0 2024-09-19T07:27:00.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.574+0000 7f94757fa640 1 -- 172.21.15.148:0/2995706087 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f9484003d20 con 0x55c113078cb0 2024-09-19T07:27:00.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.574+0000 7f9496e7b740 10 client.17679 fetch_fsmap learned FSMap version 55 2024-09-19T07:27:00.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.574+0000 7f9496e7b740 1 -- 172.21.15.148:0/2995706087 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x55c1130f3f60 con 0x55c113078cb0 2024-09-19T07:27:00.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.574+0000 7f94757fa640 1 -- 172.21.15.148:0/2995706087 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f947c004810 con 0x55c113078cb0 2024-09-19T07:27:00.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.574+0000 7f94757fa640 1 -- 172.21.15.148:0/2995706087 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 55) ==== 8370+0+0 (secure 0 0 0) 0x7f9484011ce0 con 0x55c113078cb0 2024-09-19T07:27:00.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.574+0000 7f9496e7b740 10 client.17679 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T07:27:00.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.574+0000 7f9496e7b740 10 client.17679 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:27:00.581 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.574+0000 7f9496e7b740 20 client.17679 populate_metadata read hostname 'smithi148' 2024-09-19T07:27:00.581 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.574+0000 7f9496e7b740 1 --2- 172.21.15.148:0/2995706087 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55c1130f47c0 0x55c1130f6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:00.581 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.574+0000 7f9496e7b740 4 client.17679 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:27:00.581 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.574+0000 7f9496e7b740 1 -- 172.21.15.148:0/2995706087 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c112fd9d70 con 0x55c1130f47c0 2024-09-19T07:27:00.581 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.574+0000 7f9491e79640 1 --2- 172.21.15.148:0/2995706087 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55c1130f47c0 0x55c1130f6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:00.581 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.575+0000 7f94757fa640 10 client.17679 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:27:00.581 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.575+0000 7f9491e79640 1 --2- 172.21.15.148:0/2995706087 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55c1130f47c0 0x55c1130f6be0 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd5bfe6f4fce70c0 server_cookie=4921636bb988112f in_seq=0 out_seq=0 2024-09-19T07:27:00.714 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:27:00 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/1559539510' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:27:00.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:27:00 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/1559539510' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:27:00.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:27:00 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/1559539510' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:27:00.968 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.966+0000 7f94757fa640 1 -- 172.21.15.148:0/2995706087 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c112fd9d70 con 0x55c1130f47c0 2024-09-19T07:27:00.968 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.966+0000 7f94757fa640 10 client.17679 handle_command_reply: tid=0 2024-09-19T07:27:00.968 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.967+0000 7f9496e7b740 1 client.17679 shutdown 2024-09-19T07:27:00.968 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.967+0000 7f9496e7b740 1 -- 172.21.15.148:0/2995706087 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c113078cb0 msgr2=0x55c11307bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:00.968 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.967+0000 7f9496e7b740 1 --2- 172.21.15.148:0/2995706087 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c113078cb0 0x55c11307bcb0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f9484010000 tx=0x7f9484004730 comp rx=0 tx=0).stop 2024-09-19T07:27:00.968 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.967+0000 7f9496e7b740 1 -- 172.21.15.148:0/2995706087 shutdown_connections 2024-09-19T07:27:00.969 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.967+0000 7f9496e7b740 1 --2- 172.21.15.148:0/2995706087 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55c1130f47c0 0x55c1130f6be0 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.969 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.967+0000 7f9496e7b740 1 --2- 172.21.15.148:0/2995706087 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c113078cb0 0x55c11307bcb0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.969 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.967+0000 7f94757fa640 0 client.17679 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:27:00.969 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.967+0000 7f9496e7b740 1 --2- 172.21.15.148:0/2995706087 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c11306e410 0x55c113081240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.969 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.967+0000 7f9496e7b740 1 --2- 172.21.15.148:0/2995706087 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c11306daf0 0x55c113080d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.969 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.967+0000 7f9496e7b740 1 -- 172.21.15.148:0/2995706087 >> 172.21.15.148:0/2995706087 conn(0x55c11306a060 msgr2=0x55c11306f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:00.969 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.967+0000 7f9496e7b740 1 -- 172.21.15.148:0/2995706087 shutdown_connections 2024-09-19T07:27:00.969 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.967+0000 7f9496e7b740 1 -- 172.21.15.148:0/2995706087 wait complete. 2024-09-19T07:27:00.969 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.968+0000 7f9496e7b740 20 client.17679 trim_cache size 0 max 16384 2024-09-19T07:27:00.970 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:27:00.970 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:27:00.970 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:27:00.970 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:27:00.972 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.968+0000 7f94940dd640 1 -- 172.21.15.148:0/3984770848 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f94780a3460 msgr2=0x7f94780a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:00.972 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.968+0000 7f94940dd640 1 --2- 172.21.15.148:0/3984770848 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f94780a3460 0x7f94780a5920 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9484009fd0 tx=0x7f9484005f90 comp rx=0 tx=0).stop 2024-09-19T07:27:00.972 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.968+0000 7f94940dd640 1 -- 172.21.15.148:0/3984770848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f948c102c80 msgr2=0x7f948c198340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:00.972 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.968+0000 7f94940dd640 1 --2- 172.21.15.148:0/3984770848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f948c102c80 0x7f948c198340 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9488005cc0 tx=0x7f948802f420 comp rx=0 tx=0).stop 2024-09-19T07:27:00.972 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.969+0000 7f94940dd640 1 -- 172.21.15.148:0/3984770848 shutdown_connections 2024-09-19T07:27:00.972 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.969+0000 7f94940dd640 1 --2- 172.21.15.148:0/3984770848 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f94780a3460 0x7f94780a5920 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.973 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.969+0000 7f94940dd640 1 --2- 172.21.15.148:0/3984770848 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f948c10c0d0 0x7f948c19cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.973 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.969+0000 7f94940dd640 1 --2- 172.21.15.148:0/3984770848 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f948c1035a0 0x7f948c198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.973 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.969+0000 7f94940dd640 1 --2- 172.21.15.148:0/3984770848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f948c102c80 0x7f948c198340 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.973 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.969+0000 7f94940dd640 1 -- 172.21.15.148:0/3984770848 >> 172.21.15.148:0/3984770848 conn(0x7f948c077990 msgr2=0x7f948c0fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:00.973 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.969+0000 7f94940dd640 1 -- 172.21.15.148:0/3984770848 shutdown_connections 2024-09-19T07:27:00.973 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:00.969+0000 7f94940dd640 1 -- 172.21.15.148:0/3984770848 wait complete. 2024-09-19T07:27:01.125 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24457 quiesce db / --timeout 90 --expiration 149.45 --await-for 45.0' 2024-09-19T07:27:01.125 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24457 quiesce db / --timeout 90 --expiration 149.45 --await-for 45.0 2024-09-19T07:27:01.389 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:27:01.633 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:27:01 smithi165 ceph-mon[35326]: pgmap v500: 97 pgs: 97 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.3 KiB/s wr, 8 op/s 2024-09-19T07:27:01.634 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:27:01 smithi148 ceph-mon[31180]: pgmap v500: 97 pgs: 97 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.3 KiB/s wr, 8 op/s 2024-09-19T07:27:01.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:27:01 smithi179 ceph-mon[35716]: pgmap v500: 97 pgs: 97 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.3 KiB/s wr, 8 op/s 2024-09-19T07:27:01.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.854+0000 7fab9e664640 1 -- 172.21.15.148:0/1455399408 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab98106f10 msgr2=0x7fab9810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:01.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.854+0000 7fab9e664640 1 --2- 172.21.15.148:0/1455399408 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab98106f10 0x7fab9810ea90 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fab90009be0 tx=0x7fab9002a6c0 comp rx=0 tx=0).stop 2024-09-19T07:27:01.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.854+0000 7fab9e664640 1 -- 172.21.15.148:0/1455399408 shutdown_connections 2024-09-19T07:27:01.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.854+0000 7fab9e664640 1 --2- 172.21.15.148:0/1455399408 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab98106f10 0x7fab9810ea90 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:01.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.854+0000 7fab9e664640 1 --2- 172.21.15.148:0/1455399408 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab98102790 0x7fab981067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:01.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.854+0000 7fab9e664640 1 --2- 172.21.15.148:0/1455399408 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab98101de0 0x7fab981021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:01.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.854+0000 7fab9e664640 1 -- 172.21.15.148:0/1455399408 >> 172.21.15.148:0/1455399408 conn(0x7fab980fd8c0 msgr2=0x7fab980ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:01.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.854+0000 7fab9e664640 1 -- 172.21.15.148:0/1455399408 shutdown_connections 2024-09-19T07:27:01.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.854+0000 7fab9e664640 1 -- 172.21.15.148:0/1455399408 wait complete. 2024-09-19T07:27:01.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.854+0000 7fab9e664640 1 Processor -- start 2024-09-19T07:27:01.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.854+0000 7fab9e664640 1 -- start start 2024-09-19T07:27:01.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.854+0000 7fab9e664640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab98101de0 0x7fab980744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:01.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.854+0000 7fab9e664640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab98102790 0x7fab98074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:01.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.854+0000 7fab9e664640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab98106f10 0x7fab98074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:01.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.854+0000 7fab9e664640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fab98111f20 con 0x7fab98106f10 2024-09-19T07:27:01.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.854+0000 7fab9e664640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fab98111da0 con 0x7fab98101de0 2024-09-19T07:27:01.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.854+0000 7fab9e664640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fab981120a0 con 0x7fab98102790 2024-09-19T07:27:01.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.855+0000 7fab9cc01640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab98106f10 0x7fab98074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:01.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.855+0000 7fab97fff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab98101de0 0x7fab980744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:01.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.855+0000 7fab8ffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab98102790 0x7fab98074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:01.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.855+0000 7fab9cc01640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab98106f10 0x7fab98074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60476/0 (socket says 172.21.15.148:60476) 2024-09-19T07:27:01.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.855+0000 7fab9cc01640 1 -- 172.21.15.148:0/2347392857 learned_addr learned my addr 172.21.15.148:0/2347392857 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:27:01.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.855+0000 7fab97fff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab98101de0 0x7fab980744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:51550/0 (socket says 172.21.15.148:51550) 2024-09-19T07:27:01.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.855+0000 7fab97fff640 1 -- 172.21.15.148:0/2347392857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab98102790 msgr2=0x7fab98074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:01.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.855+0000 7fab97fff640 1 --2- 172.21.15.148:0/2347392857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab98102790 0x7fab98074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:01.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.855+0000 7fab97fff640 1 -- 172.21.15.148:0/2347392857 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab98106f10 msgr2=0x7fab98074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:01.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.855+0000 7fab97fff640 1 --2- 172.21.15.148:0/2347392857 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab98106f10 0x7fab98074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:01.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.855+0000 7fab97fff640 1 -- 172.21.15.148:0/2347392857 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab981a6860 con 0x7fab98101de0 2024-09-19T07:27:01.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.855+0000 7fab8ffff640 1 --2- 172.21.15.148:0/2347392857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab98102790 0x7fab98074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:27:01.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.855+0000 7fab9cc01640 1 --2- 172.21.15.148:0/2347392857 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab98106f10 0x7fab98074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:27:01.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.855+0000 7fab97fff640 1 --2- 172.21.15.148:0/2347392857 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab98101de0 0x7fab980744f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fab8800e790 tx=0x7fab8800ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:01.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.855+0000 7fab95ffb640 1 -- 172.21.15.148:0/2347392857 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab8800eea0 con 0x7fab98101de0 2024-09-19T07:27:01.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.855+0000 7fab95ffb640 1 -- 172.21.15.148:0/2347392857 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab8800ccc0 con 0x7fab98101de0 2024-09-19T07:27:01.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.855+0000 7fab9e664640 1 -- 172.21.15.148:0/2347392857 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab981a6b50 con 0x7fab98101de0 2024-09-19T07:27:01.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.855+0000 7fab95ffb640 1 -- 172.21.15.148:0/2347392857 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab88018780 con 0x7fab98101de0 2024-09-19T07:27:01.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.856+0000 7fab9e664640 1 -- 172.21.15.148:0/2347392857 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab981a70e0 con 0x7fab98101de0 2024-09-19T07:27:01.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.858+0000 7fab95ffb640 1 -- 172.21.15.148:0/2347392857 <== mon.2 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fab88010430 con 0x7fab98101de0 2024-09-19T07:27:01.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.858+0000 7faba0a3d740 1 Processor -- start 2024-09-19T07:27:01.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.858+0000 7faba0a3d740 1 -- start start 2024-09-19T07:27:01.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.858+0000 7faba0a3d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55797113b850 0x55797113bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:01.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.858+0000 7faba0a3d740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55797113c170 0x5579711464f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:01.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.858+0000 7faba0a3d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557971146a30 0x557971148e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:01.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.858+0000 7faba0a3d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5579710a0160 con 0x557971146a30 2024-09-19T07:27:01.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.858+0000 7faba0a3d740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x557971047720 con 0x55797113c170 2024-09-19T07:27:01.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.858+0000 7faba0a3d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55797109c120 con 0x55797113b850 2024-09-19T07:27:01.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.858+0000 7fab9cc01640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55797113b850 0x55797113bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:01.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.858+0000 7fab8ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557971146a30 0x557971148e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:01.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.858+0000 7fab9cc01640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55797113b850 0x55797113bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:35958/0 (socket says 172.21.15.148:35958) 2024-09-19T07:27:01.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.858+0000 7fab9cc01640 1 -- 172.21.15.148:0/2171240708 learned_addr learned my addr 172.21.15.148:0/2171240708 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:27:01.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.859+0000 7fab97fff640 1 --2- 172.21.15.148:0/2171240708 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55797113c170 0x5579711464f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:01.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.859+0000 7fab95ffb640 1 --2- 172.21.15.148:0/2347392857 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fab840a3430 0x7fab840a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:01.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.859+0000 7fab9cc01640 1 -- 172.21.15.148:0/2171240708 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55797113c170 msgr2=0x5579711464f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:01.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.859+0000 7fab9cc01640 1 --2- 172.21.15.148:0/2171240708 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55797113c170 0x5579711464f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:01.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.859+0000 7fab9cc01640 1 -- 172.21.15.148:0/2171240708 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557971146a30 msgr2=0x557971148e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:01.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.859+0000 7fab9cc01640 1 --2- 172.21.15.148:0/2171240708 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557971146a30 0x557971148e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:01.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.859+0000 7fab9cc01640 1 -- 172.21.15.148:0/2171240708 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557970e11ba0 con 0x55797113b850 2024-09-19T07:27:01.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.859+0000 7fab8ffff640 1 --2- 172.21.15.148:0/2171240708 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557971146a30 0x557971148e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:27:01.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.859+0000 7fab9cc01640 1 --2- 172.21.15.148:0/2347392857 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fab840a3430 0x7fab840a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:01.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.859+0000 7fab95ffb640 1 -- 172.21.15.148:0/2347392857 <== mon.2 v2:172.21.15.165:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8556+0+0 (secure 0 0 0) 0x7fab880cfe80 con 0x7fab98101de0 2024-09-19T07:27:01.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.859+0000 7fab9cc01640 1 --2- 172.21.15.148:0/2171240708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55797113b850 0x55797113bc30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fab900099a0 tx=0x7fab900303a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33d8035e862b4f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:01.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.859+0000 7fab8e7fc640 1 -- 172.21.15.148:0/2171240708 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9004f070 con 0x55797113b850 2024-09-19T07:27:01.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.859+0000 7fab8e7fc640 1 -- 172.21.15.148:0/2171240708 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab90037040 con 0x55797113b850 2024-09-19T07:27:01.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.859+0000 7fab8e7fc640 1 -- 172.21.15.148:0/2171240708 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab90036070 con 0x55797113b850 2024-09-19T07:27:01.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.859+0000 7fab9cc01640 1 --2- 172.21.15.148:0/2347392857 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fab840a3430 0x7fab840a58f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fab9004c000 tx=0x7fab9004d000 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:01.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.860+0000 7faba0a3d740 1 -- 172.21.15.148:0/2171240708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55797113b850 msgr2=0x55797113bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:01.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.860+0000 7faba0a3d740 1 --2- 172.21.15.148:0/2171240708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55797113b850 0x55797113bc30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fab900099a0 tx=0x7fab900303a0 comp rx=0 tx=0).stop 2024-09-19T07:27:01.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.860+0000 7faba0a3d740 1 -- 172.21.15.148:0/2171240708 shutdown_connections 2024-09-19T07:27:01.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.860+0000 7faba0a3d740 1 --2- 172.21.15.148:0/2171240708 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557971146a30 0x557971148e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:01.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.860+0000 7faba0a3d740 1 --2- 172.21.15.148:0/2171240708 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55797113c170 0x5579711464f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:01.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.860+0000 7faba0a3d740 1 --2- 172.21.15.148:0/2171240708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55797113b850 0x55797113bc30 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:01.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.860+0000 7faba0a3d740 1 -- 172.21.15.148:0/2171240708 >> 172.21.15.148:0/2171240708 conn(0x557971137de0 msgr2=0x5579711381c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:01.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.860+0000 7faba0a3d740 1 -- 172.21.15.148:0/2171240708 shutdown_connections 2024-09-19T07:27:01.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.860+0000 7faba0a3d740 1 -- 172.21.15.148:0/2171240708 wait complete. 2024-09-19T07:27:01.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.860+0000 7faba0a3d740 1 -- start start 2024-09-19T07:27:01.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.861+0000 7faba0a3d740 1 Processor -- start 2024-09-19T07:27:01.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.861+0000 7faba0a3d740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55797113b850 0x557971143910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:01.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.861+0000 7faba0a3d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55797113c170 0x557971143e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:01.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.861+0000 7faba0a3d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557971146a30 0x557971144390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:01.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.861+0000 7faba0a3d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x557971149600 con 0x55797113c170 2024-09-19T07:27:01.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.861+0000 7faba0a3d740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x557971028900 con 0x55797113b850 2024-09-19T07:27:01.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.861+0000 7faba0a3d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x557971149780 con 0x557971146a30 2024-09-19T07:27:01.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.861+0000 7faba0a3d740 10 client.0 _ll_register_callbacks cb 0x557971026780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:27:01.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.861+0000 7fab8ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55797113c170 0x557971143e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:01.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.861+0000 7fab9cc01640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557971146a30 0x557971144390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:01.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.861+0000 7fab97fff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55797113b850 0x557971143910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:01.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.861+0000 7fab8ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55797113c170 0x557971143e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60494/0 (socket says 172.21.15.148:60494) 2024-09-19T07:27:01.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.861+0000 7fab8ffff640 1 -- 172.21.15.148:0/2523849139 learned_addr learned my addr 172.21.15.148:0/2523849139 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:27:01.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.861+0000 7fab8ffff640 1 -- 172.21.15.148:0/2523849139 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557971146a30 msgr2=0x557971144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:01.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.861+0000 7fab8ffff640 1 --2- 172.21.15.148:0/2523849139 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557971146a30 0x557971144390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:01.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.861+0000 7fab8ffff640 1 -- 172.21.15.148:0/2523849139 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55797113b850 msgr2=0x557971143910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:01.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.861+0000 7fab8ffff640 1 --2- 172.21.15.148:0/2523849139 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55797113b850 0x557971143910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:01.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.861+0000 7fab8ffff640 1 -- 172.21.15.148:0/2523849139 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557971068c50 con 0x55797113c170 2024-09-19T07:27:01.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.862+0000 7fab8ffff640 1 --2- 172.21.15.148:0/2523849139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55797113c170 0x557971143e50 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fab80012d30 tx=0x7fab8000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66dd3ff573b0cf39 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:01.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.862+0000 7fab777fe640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:27:01.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.862+0000 7fab777fe640 1 -- 172.21.15.148:0/2523849139 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab8000fe20 con 0x55797113c170 2024-09-19T07:27:01.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.862+0000 7fab777fe640 1 -- 172.21.15.148:0/2523849139 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8556+0+0 (secure 0 0 0) 0x7fab800120d0 con 0x55797113c170 2024-09-19T07:27:01.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.862+0000 7faba0a3d740 1 -- 172.21.15.148:0/2523849139 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab90037040 con 0x55797113c170 2024-09-19T07:27:01.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.862+0000 7fab777fe640 1 -- 172.21.15.148:0/2523849139 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7fab80004020 con 0x55797113c170 2024-09-19T07:27:01.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.862+0000 7faba0a3d740 10 client.17691 fetch_fsmap learned FSMap version 55 2024-09-19T07:27:01.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.862+0000 7faba0a3d740 1 -- 172.21.15.148:0/2523849139 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x557971155360 con 0x55797113c170 2024-09-19T07:27:01.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.862+0000 7fab777fe640 1 -- 172.21.15.148:0/2523849139 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab90037040 con 0x55797113c170 2024-09-19T07:27:01.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.862+0000 7fab777fe640 1 -- 172.21.15.148:0/2523849139 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 55) ==== 8370+0+0 (secure 0 0 0) 0x7fab8001c470 con 0x55797113c170 2024-09-19T07:27:01.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.862+0000 7faba0a3d740 10 client.17691 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T07:27:01.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.862+0000 7faba0a3d740 10 client.17691 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:27:01.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.862+0000 7faba0a3d740 20 client.17691 populate_metadata read hostname 'smithi148' 2024-09-19T07:27:01.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.863+0000 7faba0a3d740 1 --2- 172.21.15.148:0/2523849139 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x557971156820 0x557971158c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:01.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.863+0000 7faba0a3d740 4 client.17691 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:27:01.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.863+0000 7faba0a3d740 1 -- 172.21.15.148:0/2523849139 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5579710ad890 con 0x557971156820 2024-09-19T07:27:01.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.863+0000 7fab97fff640 1 --2- 172.21.15.148:0/2523849139 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x557971156820 0x557971158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:01.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.863+0000 7fab97fff640 1 --2- 172.21.15.148:0/2523849139 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x557971156820 0x557971158c50 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2a7146123bd5213 server_cookie=c6a354da7fa5b2e7 in_seq=0 out_seq=0 2024-09-19T07:27:01.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.863+0000 7fab777fe640 10 client.17691 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:27:01.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.865+0000 7fab777fe640 1 -- 172.21.15.148:0/2523849139 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5579710ad890 con 0x557971156820 2024-09-19T07:27:01.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.865+0000 7fab777fe640 10 client.17691 handle_command_reply: tid=0 2024-09-19T07:27:01.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.865+0000 7faba0a3d740 1 client.17691 shutdown 2024-09-19T07:27:01.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.866+0000 7faba0a3d740 1 -- 172.21.15.148:0/2523849139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55797113c170 msgr2=0x557971143e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:01.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.866+0000 7faba0a3d740 1 --2- 172.21.15.148:0/2523849139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55797113c170 0x557971143e50 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fab80012d30 tx=0x7fab8000f790 comp rx=0 tx=0).stop 2024-09-19T07:27:01.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.866+0000 7faba0a3d740 1 -- 172.21.15.148:0/2523849139 shutdown_connections 2024-09-19T07:27:01.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.866+0000 7faba0a3d740 1 --2- 172.21.15.148:0/2523849139 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x557971156820 0x557971158c50 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:01.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.866+0000 7faba0a3d740 1 --2- 172.21.15.148:0/2523849139 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557971146a30 0x557971144390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:01.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.866+0000 7faba0a3d740 1 --2- 172.21.15.148:0/2523849139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55797113c170 0x557971143e50 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:01.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.866+0000 7fab777fe640 0 client.17691 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:27:01.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.866+0000 7faba0a3d740 1 --2- 172.21.15.148:0/2523849139 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55797113b850 0x557971143910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:01.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.866+0000 7faba0a3d740 1 -- 172.21.15.148:0/2523849139 >> 172.21.15.148:0/2523849139 conn(0x557971137de0 msgr2=0x55797113dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:01.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.866+0000 7faba0a3d740 1 -- 172.21.15.148:0/2523849139 shutdown_connections 2024-09-19T07:27:01.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.866+0000 7faba0a3d740 1 -- 172.21.15.148:0/2523849139 wait complete. 2024-09-19T07:27:01.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.866+0000 7faba0a3d740 20 client.17691 trim_cache size 0 max 16384 2024-09-19T07:27:01.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.884+0000 7faba0a3d740 1 Processor -- start 2024-09-19T07:27:01.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.884+0000 7faba0a3d740 1 -- start start 2024-09-19T07:27:01.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.884+0000 7faba0a3d740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55797113b850 0x55797113e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:01.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.884+0000 7faba0a3d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55797113c170 0x557971145880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:01.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.884+0000 7faba0a3d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557971146a30 0x55797115e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:01.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.884+0000 7faba0a3d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fab981b2450 con 0x55797113c170 2024-09-19T07:27:01.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.884+0000 7faba0a3d740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fab981afc60 con 0x55797113b850 2024-09-19T07:27:01.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.884+0000 7faba0a3d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fab981adad0 con 0x557971146a30 2024-09-19T07:27:01.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.884+0000 7fab8ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55797113c170 0x557971145880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:01.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.884+0000 7fab8ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55797113c170 0x557971145880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60508/0 (socket says 172.21.15.148:60508) 2024-09-19T07:27:01.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.884+0000 7fab9cc01640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557971146a30 0x55797115e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:01.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.884+0000 7fab8ffff640 1 -- 172.21.15.148:0/3652313960 learned_addr learned my addr 172.21.15.148:0/3652313960 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:27:01.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.884+0000 7fab97fff640 1 --2- 172.21.15.148:0/3652313960 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55797113b850 0x55797113e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:01.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.884+0000 7fab8ffff640 1 -- 172.21.15.148:0/3652313960 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557971146a30 msgr2=0x55797115e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:01.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.884+0000 7fab8ffff640 1 --2- 172.21.15.148:0/3652313960 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557971146a30 0x55797115e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:01.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.884+0000 7fab8ffff640 1 -- 172.21.15.148:0/3652313960 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55797113b850 msgr2=0x55797113e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:01.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.884+0000 7fab8ffff640 1 --2- 172.21.15.148:0/3652313960 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55797113b850 0x55797113e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:01.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.885+0000 7fab8ffff640 1 -- 172.21.15.148:0/3652313960 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55797113bfa0 con 0x55797113c170 2024-09-19T07:27:01.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.885+0000 7fab8ffff640 1 --2- 172.21.15.148:0/3652313960 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55797113c170 0x557971145880 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fab8000a010 tx=0x7fab800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6571e6e41c151a35 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:01.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.885+0000 7fab8dffb640 1 -- 172.21.15.148:0/3652313960 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab80028070 con 0x55797113c170 2024-09-19T07:27:01.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.885+0000 7fab8dffb640 1 -- 172.21.15.148:0/3652313960 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab800120d0 con 0x55797113c170 2024-09-19T07:27:01.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.885+0000 7fab8dffb640 1 -- 172.21.15.148:0/3652313960 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab800035f0 con 0x55797113c170 2024-09-19T07:27:01.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.886+0000 7faba0a3d740 1 -- 172.21.15.148:0/3652313960 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55797113c170 msgr2=0x557971145880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:01.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.886+0000 7faba0a3d740 1 --2- 172.21.15.148:0/3652313960 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55797113c170 0x557971145880 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fab8000a010 tx=0x7fab800057f0 comp rx=0 tx=0).stop 2024-09-19T07:27:01.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.886+0000 7faba0a3d740 1 -- 172.21.15.148:0/3652313960 shutdown_connections 2024-09-19T07:27:01.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.886+0000 7faba0a3d740 1 --2- 172.21.15.148:0/3652313960 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557971146a30 0x55797115e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:01.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.886+0000 7faba0a3d740 1 --2- 172.21.15.148:0/3652313960 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55797113c170 0x557971145880 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:01.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.886+0000 7faba0a3d740 1 --2- 172.21.15.148:0/3652313960 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55797113b850 0x55797113e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:01.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.886+0000 7faba0a3d740 1 -- 172.21.15.148:0/3652313960 >> 172.21.15.148:0/3652313960 conn(0x557971137de0 msgr2=0x557971145170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:01.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.886+0000 7faba0a3d740 1 -- 172.21.15.148:0/3652313960 shutdown_connections 2024-09-19T07:27:01.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.886+0000 7faba0a3d740 1 -- 172.21.15.148:0/3652313960 wait complete. 2024-09-19T07:27:01.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.886+0000 7faba0a3d740 1 -- start start 2024-09-19T07:27:01.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.886+0000 7faba0a3d740 1 Processor -- start 2024-09-19T07:27:01.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.887+0000 7faba0a3d740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55797113b850 0x55797114aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:01.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.887+0000 7faba0a3d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55797113c170 0x55797114b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:01.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.887+0000 7faba0a3d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557971146a30 0x5579711c04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:01.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.887+0000 7faba0a3d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fab981ae120 con 0x55797113c170 2024-09-19T07:27:01.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.887+0000 7faba0a3d740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fab981af590 con 0x55797113b850 2024-09-19T07:27:01.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.887+0000 7faba0a3d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fab981ae7f0 con 0x557971146a30 2024-09-19T07:27:01.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.887+0000 7faba0a3d740 10 client.0 _ll_register_callbacks cb 0x7fab80009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:27:01.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.887+0000 7fab8ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55797113c170 0x55797114b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:01.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.887+0000 7fab8ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55797113c170 0x55797114b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60524/0 (socket says 172.21.15.148:60524) 2024-09-19T07:27:01.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.887+0000 7fab8ffff640 1 -- 172.21.15.148:0/3035538033 learned_addr learned my addr 172.21.15.148:0/3035538033 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:27:01.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.887+0000 7fab97fff640 1 --2- 172.21.15.148:0/3035538033 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55797113b850 0x55797114aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:01.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.887+0000 7fab9cc01640 1 --2- 172.21.15.148:0/3035538033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557971146a30 0x5579711c04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:01.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.887+0000 7fab8ffff640 1 -- 172.21.15.148:0/3035538033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557971146a30 msgr2=0x5579711c04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:01.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.887+0000 7fab8ffff640 1 --2- 172.21.15.148:0/3035538033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557971146a30 0x5579711c04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:01.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.887+0000 7fab8ffff640 1 -- 172.21.15.148:0/3035538033 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55797113b850 msgr2=0x55797114aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:01.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.887+0000 7fab8ffff640 1 --2- 172.21.15.148:0/3035538033 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55797113b850 0x55797114aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:01.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.887+0000 7fab8ffff640 1 -- 172.21.15.148:0/3035538033 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579711c0a20 con 0x55797113c170 2024-09-19T07:27:01.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.887+0000 7fab97fff640 1 --2- 172.21.15.148:0/3035538033 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55797113b850 0x55797114aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:27:01.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.887+0000 7fab8ffff640 1 --2- 172.21.15.148:0/3035538033 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55797113c170 0x55797114b400 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fab8001c8e0 tx=0x7fab8000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=753a064e9401beae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:01.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.887+0000 7fab777fe640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:27:01.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.887+0000 7fab777fe640 1 -- 172.21.15.148:0/3035538033 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab80031070 con 0x55797113c170 2024-09-19T07:27:01.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.887+0000 7fab777fe640 1 -- 172.21.15.148:0/3035538033 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8556+0+0 (secure 0 0 0) 0x7fab80005440 con 0x55797113c170 2024-09-19T07:27:01.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.887+0000 7faba0a3d740 1 -- 172.21.15.148:0/3035538033 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab800120d0 con 0x55797113c170 2024-09-19T07:27:01.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.888+0000 7fab777fe640 1 -- 172.21.15.148:0/3035538033 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7fab8003d050 con 0x55797113c170 2024-09-19T07:27:01.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.888+0000 7faba0a3d740 10 client.17697 fetch_fsmap learned FSMap version 55 2024-09-19T07:27:01.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.888+0000 7faba0a3d740 1 -- 172.21.15.148:0/3035538033 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x5579711c1d00 con 0x55797113c170 2024-09-19T07:27:01.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.888+0000 7fab777fe640 1 -- 172.21.15.148:0/3035538033 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab800120d0 con 0x55797113c170 2024-09-19T07:27:01.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.888+0000 7fab777fe640 1 -- 172.21.15.148:0/3035538033 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 55) ==== 8370+0+0 (secure 0 0 0) 0x7fab8002d460 con 0x55797113c170 2024-09-19T07:27:01.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.888+0000 7faba0a3d740 10 client.17697 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T07:27:01.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.888+0000 7faba0a3d740 10 client.17697 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:27:01.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.888+0000 7faba0a3d740 20 client.17697 populate_metadata read hostname 'smithi148' 2024-09-19T07:27:01.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.888+0000 7faba0a3d740 1 --2- 172.21.15.148:0/3035538033 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5579711c2440 0x5579711c4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:01.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.888+0000 7faba0a3d740 4 client.17697 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.45, "await_for": 45.0}] 2024-09-19T07:27:01.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.888+0000 7faba0a3d740 1 -- 172.21.15.148:0/3035538033 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.45, "await_for": 45.0}) -- 0x5579710a7be0 con 0x5579711c2440 2024-09-19T07:27:01.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.888+0000 7fab97fff640 1 --2- 172.21.15.148:0/3035538033 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5579711c2440 0x5579711c4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:01.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.889+0000 7fab777fe640 10 client.17697 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:27:01.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:01.889+0000 7fab97fff640 1 --2- 172.21.15.148:0/3035538033 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5579711c2440 0x5579711c4860 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3aec4a37f27daf9 server_cookie=2f5524dac0792a82 in_seq=0 out_seq=0 2024-09-19T07:27:03.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:27:03 smithi179 ceph-mon[35716]: pgmap v501: 97 pgs: 97 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 334 KiB/s wr, 23 op/s 2024-09-19T07:27:03.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:27:03 smithi179 ceph-mon[35716]: osdmap e101: 12 total, 12 up, 12 in 2024-09-19T07:27:03.832 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:27:03 smithi148 ceph-mon[31180]: pgmap v501: 97 pgs: 97 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 334 KiB/s wr, 23 op/s 2024-09-19T07:27:03.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:27:03 smithi148 ceph-mon[31180]: osdmap e101: 12 total, 12 up, 12 in 2024-09-19T07:27:03.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:27:03 smithi165 ceph-mon[35326]: pgmap v501: 97 pgs: 97 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 334 KiB/s wr, 23 op/s 2024-09-19T07:27:03.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:27:03 smithi165 ceph-mon[35326]: osdmap e101: 12 total, 12 up, 12 in 2024-09-19T07:27:04.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:27:04 smithi179 ceph-mon[35716]: pgmap v503: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 395 KiB/s wr, 37 op/s 2024-09-19T07:27:04.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:27:04 smithi148 ceph-mon[31180]: pgmap v503: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 395 KiB/s wr, 37 op/s 2024-09-19T07:27:04.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:27:04 smithi165 ceph-mon[35326]: pgmap v503: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 395 KiB/s wr, 37 op/s 2024-09-19T07:27:06.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:27:06 smithi165 ceph-mon[35326]: pgmap v504: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 201 op/s 2024-09-19T07:27:07.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:27:06 smithi179 ceph-mon[35716]: pgmap v504: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 201 op/s 2024-09-19T07:27:07.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:27:06 smithi148 ceph-mon[31180]: pgmap v504: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 201 op/s 2024-09-19T07:27:08.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:27:08 smithi165 ceph-mon[35326]: pgmap v505: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 201 op/s 2024-09-19T07:27:09.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:27:08 smithi179 ceph-mon[35716]: pgmap v505: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 201 op/s 2024-09-19T07:27:09.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:27:08 smithi148 ceph-mon[31180]: pgmap v505: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 201 op/s 2024-09-19T07:27:10.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:27:10 smithi165 ceph-mon[35326]: pgmap v506: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 207 op/s 2024-09-19T07:27:11.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:27:10 smithi179 ceph-mon[35716]: pgmap v506: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 207 op/s 2024-09-19T07:27:11.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:27:10 smithi148 ceph-mon[31180]: pgmap v506: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 207 op/s 2024-09-19T07:27:12.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:12.543+0000 7fab777fe640 1 -- 172.21.15.148:0/3035538033 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5579710a7be0 con 0x5579711c2440 2024-09-19T07:27:12.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:12.543+0000 7fab777fe640 10 client.17697 handle_command_reply: tid=0 2024-09-19T07:27:12.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:12.543+0000 7faba0a3d740 1 client.17697 shutdown 2024-09-19T07:27:12.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:12.543+0000 7faba0a3d740 1 -- 172.21.15.148:0/3035538033 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55797113c170 msgr2=0x55797114b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:12.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:12.543+0000 7faba0a3d740 1 --2- 172.21.15.148:0/3035538033 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55797113c170 0x55797114b400 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fab8001c8e0 tx=0x7fab8000f790 comp rx=0 tx=0).stop 2024-09-19T07:27:12.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:12.543+0000 7faba0a3d740 1 -- 172.21.15.148:0/3035538033 shutdown_connections 2024-09-19T07:27:12.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:12.543+0000 7faba0a3d740 1 --2- 172.21.15.148:0/3035538033 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5579711c2440 0x5579711c4860 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:12.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:12.543+0000 7faba0a3d740 1 --2- 172.21.15.148:0/3035538033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557971146a30 0x5579711c04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:12.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:12.543+0000 7faba0a3d740 1 --2- 172.21.15.148:0/3035538033 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55797113c170 0x55797114b400 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:12.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:12.543+0000 7fab777fe640 0 client.17697 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:27:12.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:12.543+0000 7faba0a3d740 1 --2- 172.21.15.148:0/3035538033 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55797113b850 0x55797114aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:12.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:12.543+0000 7faba0a3d740 1 -- 172.21.15.148:0/3035538033 >> 172.21.15.148:0/3035538033 conn(0x557971137de0 msgr2=0x557971145990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:12.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:12.544+0000 7faba0a3d740 1 -- 172.21.15.148:0/3035538033 shutdown_connections 2024-09-19T07:27:12.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:12.544+0000 7faba0a3d740 1 -- 172.21.15.148:0/3035538033 wait complete. 2024-09-19T07:27:12.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:12.544+0000 7faba0a3d740 20 client.17697 trim_cache size 0 max 16384 2024-09-19T07:27:12.546 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:27:12.546 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 55, 2024-09-19T07:27:12.546 INFO:teuthology.orchestra.run.smithi148.stdout: "leader": 24457, 2024-09-19T07:27:12.546 INFO:teuthology.orchestra.run.smithi148.stdout: "set_version": 54, 2024-09-19T07:27:12.546 INFO:teuthology.orchestra.run.smithi148.stdout: "sets": { 2024-09-19T07:27:12.546 INFO:teuthology.orchestra.run.smithi148.stdout: "ecadb53f": { 2024-09-19T07:27:12.546 INFO:teuthology.orchestra.run.smithi148.stdout: "version": 54, 2024-09-19T07:27:12.546 INFO:teuthology.orchestra.run.smithi148.stdout: "age_ref": 0.0, 2024-09-19T07:27:12.546 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:27:12.546 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "QUIESCED", 2024-09-19T07:27:12.546 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:27:12.547 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:27:12.547 INFO:teuthology.orchestra.run.smithi148.stdout: "timeout": 90.0, 2024-09-19T07:27:12.547 INFO:teuthology.orchestra.run.smithi148.stdout: "expiration": 149.4, 2024-09-19T07:27:12.547 INFO:teuthology.orchestra.run.smithi148.stdout: "members": { 2024-09-19T07:27:12.547 INFO:teuthology.orchestra.run.smithi148.stdout: "file:/": { 2024-09-19T07:27:12.547 INFO:teuthology.orchestra.run.smithi148.stdout: "excluded": false, 2024-09-19T07:27:12.547 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:27:12.547 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "QUIESCED", 2024-09-19T07:27:12.547 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:27:12.547 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:27:12.547 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:27:12.547 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:27:12.547 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:27:12.547 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:27:12.548 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:27:12.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:12.544+0000 7fab9e664640 1 -- 172.21.15.148:0/2347392857 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fab840a3430 msgr2=0x7fab840a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:12.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:12.544+0000 7fab9e664640 1 --2- 172.21.15.148:0/2347392857 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fab840a3430 0x7fab840a58f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fab9004c000 tx=0x7fab9004d000 comp rx=0 tx=0).stop 2024-09-19T07:27:12.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:12.544+0000 7fab9e664640 1 -- 172.21.15.148:0/2347392857 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab98101de0 msgr2=0x7fab980744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:12.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:12.544+0000 7fab9e664640 1 --2- 172.21.15.148:0/2347392857 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab98101de0 0x7fab980744f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fab8800e790 tx=0x7fab8800ec50 comp rx=0 tx=0).stop 2024-09-19T07:27:12.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:12.544+0000 7fab9e664640 1 -- 172.21.15.148:0/2347392857 shutdown_connections 2024-09-19T07:27:12.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:12.544+0000 7fab9e664640 1 --2- 172.21.15.148:0/2347392857 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fab840a3430 0x7fab840a58f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:12.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:12.544+0000 7fab9e664640 1 --2- 172.21.15.148:0/2347392857 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab98106f10 0x7fab98074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:12.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:12.544+0000 7fab9e664640 1 --2- 172.21.15.148:0/2347392857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab98102790 0x7fab98074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:12.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:12.544+0000 7fab9e664640 1 --2- 172.21.15.148:0/2347392857 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab98101de0 0x7fab980744f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:12.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:12.544+0000 7fab9e664640 1 -- 172.21.15.148:0/2347392857 >> 172.21.15.148:0/2347392857 conn(0x7fab980fd8c0 msgr2=0x7fab980fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:12.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:12.544+0000 7fab9e664640 1 -- 172.21.15.148:0/2347392857 shutdown_connections 2024-09-19T07:27:12.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:12.544+0000 7fab9e664640 1 -- 172.21.15.148:0/2347392857 wait complete. 2024-09-19T07:27:12.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:27:12 smithi148 ceph-mon[31180]: pgmap v507: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 209 op/s 2024-09-19T07:27:12.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:27:12 smithi165 ceph-mon[35326]: pgmap v507: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 209 op/s 2024-09-19T07:27:13.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:27:12 smithi179 ceph-mon[35716]: pgmap v507: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 209 op/s 2024-09-19T07:27:13.324 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'ecadb53f', quiesce took 14.1 seconds. Will release after: 15.35 2024-09-19T07:27:14.120 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.116+0000 7f5d6582c640 1 -- 172.21.15.148:0/3813600852 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d601026f0 msgr2=0x7f5d6010d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:14.120 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.116+0000 7f5d6582c640 1 --2- 172.21.15.148:0/3813600852 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d601026f0 0x7f5d6010d110 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5d5800acc0 tx=0x7f5d5802eb00 comp rx=0 tx=0).stop 2024-09-19T07:27:14.120 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.118+0000 7f5d6582c640 1 -- 172.21.15.148:0/3813600852 shutdown_connections 2024-09-19T07:27:14.120 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.118+0000 7f5d6582c640 1 --2- 172.21.15.148:0/3813600852 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d601026f0 0x7f5d6010d110 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.120 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.118+0000 7f5d6582c640 1 --2- 172.21.15.148:0/3813600852 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5d60101d70 0x7f5d601021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.120 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.118+0000 7f5d6582c640 1 --2- 172.21.15.148:0/3813600852 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d60100490 0x7f5d60100870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.120 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.118+0000 7f5d6582c640 1 -- 172.21.15.148:0/3813600852 >> 172.21.15.148:0/3813600852 conn(0x7f5d600770f0 msgr2=0x7f5d600fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:14.121 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.120+0000 7f5d6582c640 1 -- 172.21.15.148:0/3813600852 shutdown_connections 2024-09-19T07:27:14.123 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.122+0000 7f5d6582c640 1 -- 172.21.15.148:0/3813600852 wait complete. 2024-09-19T07:27:14.124 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.123+0000 7f5d6582c640 1 Processor -- start 2024-09-19T07:27:14.125 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.125+0000 7f5d6582c640 1 -- start start 2024-09-19T07:27:14.125 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.125+0000 7f5d6582c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5d60100490 0x7f5d60073b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:14.125 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.125+0000 7f5d6582c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d60101d70 0x7f5d6006cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:14.125 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.125+0000 7f5d6582c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d601026f0 0x7f5d6006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:14.126 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.125+0000 7f5d6582c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5d601186a0 con 0x7f5d601026f0 2024-09-19T07:27:14.126 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.126+0000 7f5d6582c640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5d60118520 con 0x7f5d60100490 2024-09-19T07:27:14.126 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.126+0000 7f5d6582c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5d60118820 con 0x7f5d60101d70 2024-09-19T07:27:14.126 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.126+0000 7f5d5f7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d601026f0 0x7f5d6006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:14.126 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.126+0000 7f5d5f7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d601026f0 0x7f5d6006d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58584/0 (socket says 172.21.15.148:58584) 2024-09-19T07:27:14.126 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.126+0000 7f5d5f7fe640 1 -- 172.21.15.148:0/878381103 learned_addr learned my addr 172.21.15.148:0/878381103 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:27:14.128 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.126+0000 7f5d5effd640 1 --2- 172.21.15.148:0/878381103 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5d60100490 0x7f5d60073b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:14.128 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.126+0000 7f5d5e7fc640 1 --2- 172.21.15.148:0/878381103 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d60101d70 0x7f5d6006cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:14.128 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.126+0000 7f5d5f7fe640 1 -- 172.21.15.148:0/878381103 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d60101d70 msgr2=0x7f5d6006cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:14.128 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.126+0000 7f5d5f7fe640 1 --2- 172.21.15.148:0/878381103 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d60101d70 0x7f5d6006cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.128 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.126+0000 7f5d5f7fe640 1 -- 172.21.15.148:0/878381103 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5d60100490 msgr2=0x7f5d60073b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:14.128 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.127+0000 7f5d5f7fe640 1 --2- 172.21.15.148:0/878381103 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5d60100490 0x7f5d60073b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.128 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.127+0000 7f5d5f7fe640 1 -- 172.21.15.148:0/878381103 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d6006d820 con 0x7f5d601026f0 2024-09-19T07:27:14.128 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.127+0000 7f5d5e7fc640 1 --2- 172.21.15.148:0/878381103 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d60101d70 0x7f5d6006cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:27:14.128 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.127+0000 7f5d5effd640 1 --2- 172.21.15.148:0/878381103 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5d60100490 0x7f5d60073b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:27:14.129 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.127+0000 7f5d5f7fe640 1 --2- 172.21.15.148:0/878381103 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d601026f0 0x7f5d6006d0f0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f5d5802f0f0 tx=0x7f5d5803adf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:14.129 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.128+0000 7f5d6482a640 1 -- 172.21.15.148:0/878381103 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d580042c0 con 0x7f5d601026f0 2024-09-19T07:27:14.129 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.128+0000 7f5d6482a640 1 -- 172.21.15.148:0/878381103 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d58030620 con 0x7f5d601026f0 2024-09-19T07:27:14.130 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.128+0000 7f5d6482a640 1 -- 172.21.15.148:0/878381103 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d58042660 con 0x7f5d601026f0 2024-09-19T07:27:14.130 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.128+0000 7f5d6582c640 1 -- 172.21.15.148:0/878381103 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d60071650 con 0x7f5d601026f0 2024-09-19T07:27:14.130 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.129+0000 7f5d6582c640 1 -- 172.21.15.148:0/878381103 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d60071af0 con 0x7f5d601026f0 2024-09-19T07:27:14.133 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.132+0000 7f5d685bf740 1 Processor -- start 2024-09-19T07:27:14.134 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.133+0000 7f5d6482a640 1 -- 172.21.15.148:0/878381103 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f5d58004460 con 0x7f5d601026f0 2024-09-19T07:27:14.134 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.134+0000 7f5d685bf740 1 -- start start 2024-09-19T07:27:14.137 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.134+0000 7f5d685bf740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5aead5af0 0x55c5aead5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:14.137 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.134+0000 7f5d685bf740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c5aead6410 0x55c5aeae0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:14.137 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.134+0000 7f5d685bf740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c5aeae0cb0 0x55c5aeae30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:14.137 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.134+0000 7f5d685bf740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55c5aea3a2f0 con 0x55c5aead6410 2024-09-19T07:27:14.137 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.134+0000 7f5d685bf740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55c5ae9e2270 con 0x55c5aead5af0 2024-09-19T07:27:14.137 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.134+0000 7f5d685bf740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c5aea362b0 con 0x55c5aeae0cb0 2024-09-19T07:27:14.137 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.135+0000 7f5d6482a640 1 --2- 172.21.15.148:0/878381103 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f5d480a3610 0x7f5d480a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:14.137 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.135+0000 7f5d6482a640 1 -- 172.21.15.148:0/878381103 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8600+0+0 (secure 0 0 0) 0x7f5d580f0ad0 con 0x7f5d601026f0 2024-09-19T07:27:14.137 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.136+0000 7f5d5e7fc640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5aead5af0 0x55c5aead5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:14.138 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.136+0000 7f5d5e7fc640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5aead5af0 0x55c5aead5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:46030/0 (socket says 172.21.15.148:46030) 2024-09-19T07:27:14.138 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.136+0000 7f5d5e7fc640 1 -- 172.21.15.148:0/1803455634 learned_addr learned my addr 172.21.15.148:0/1803455634 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:27:14.138 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.136+0000 7f5d5e7fc640 1 --2- 172.21.15.148:0/1803455634 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c5aeae0cb0 0x55c5aeae30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:14.138 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.136+0000 7f5d5effd640 1 --2- 172.21.15.148:0/1803455634 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c5aead6410 0x55c5aeae0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:14.138 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.136+0000 7f5d5e7fc640 1 -- 172.21.15.148:0/1803455634 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c5aeae0cb0 msgr2=0x55c5aeae30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:14.138 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.136+0000 7f5d5e7fc640 1 --2- 172.21.15.148:0/1803455634 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c5aeae0cb0 0x55c5aeae30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.138 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.136+0000 7f5d5e7fc640 1 -- 172.21.15.148:0/1803455634 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c5aead6410 msgr2=0x55c5aeae0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:14.138 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.136+0000 7f5d5e7fc640 1 --2- 172.21.15.148:0/1803455634 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c5aead6410 0x55c5aeae0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.138 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.136+0000 7f5d5e7fc640 1 -- 172.21.15.148:0/1803455634 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5ae9e1340 con 0x55c5aead5af0 2024-09-19T07:27:14.138 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.137+0000 7f5d5e7fc640 1 --2- 172.21.15.148:0/1803455634 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5aead5af0 0x55c5aead5ed0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5d50015600 tx=0x7f5d5000c1f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=255a174be5f707ef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:14.139 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.137+0000 7f5d5f7fe640 1 --2- 172.21.15.148:0/878381103 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f5d480a3610 0x7f5d480a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:14.139 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.138+0000 7f5d5f7fe640 1 --2- 172.21.15.148:0/878381103 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f5d480a3610 0x7f5d480a5ad0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5d580b96d0 tx=0x7f5d5803ae60 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:14.139 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.138+0000 7f5d45ffb640 1 -- 172.21.15.148:0/1803455634 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d5001c070 con 0x55c5aead5af0 2024-09-19T07:27:14.139 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.138+0000 7f5d45ffb640 1 -- 172.21.15.148:0/1803455634 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d50017af0 con 0x55c5aead5af0 2024-09-19T07:27:14.139 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.138+0000 7f5d45ffb640 1 -- 172.21.15.148:0/1803455634 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d5000f040 con 0x55c5aead5af0 2024-09-19T07:27:14.140 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.139+0000 7f5d685bf740 1 -- 172.21.15.148:0/1803455634 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5aead5af0 msgr2=0x55c5aead5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:14.140 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.139+0000 7f5d685bf740 1 --2- 172.21.15.148:0/1803455634 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5aead5af0 0x55c5aead5ed0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5d50015600 tx=0x7f5d5000c1f0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.141 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.140+0000 7f5d685bf740 1 -- 172.21.15.148:0/1803455634 shutdown_connections 2024-09-19T07:27:14.141 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.140+0000 7f5d685bf740 1 --2- 172.21.15.148:0/1803455634 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c5aeae0cb0 0x55c5aeae30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.141 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.140+0000 7f5d685bf740 1 --2- 172.21.15.148:0/1803455634 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c5aead6410 0x55c5aeae0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.142 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.140+0000 7f5d685bf740 1 --2- 172.21.15.148:0/1803455634 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5aead5af0 0x55c5aead5ed0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.142 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.140+0000 7f5d685bf740 1 -- 172.21.15.148:0/1803455634 >> 172.21.15.148:0/1803455634 conn(0x55c5aead2060 msgr2=0x55c5aead2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:14.145 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.144+0000 7f5d685bf740 1 -- 172.21.15.148:0/1803455634 shutdown_connections 2024-09-19T07:27:14.149 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.147+0000 7f5d685bf740 1 -- 172.21.15.148:0/1803455634 wait complete. 2024-09-19T07:27:14.149 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.147+0000 7f5d685bf740 1 -- start start 2024-09-19T07:27:14.149 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.148+0000 7f5d685bf740 1 Processor -- start 2024-09-19T07:27:14.149 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.148+0000 7f5d685bf740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c5aead5af0 0x55c5aeaddc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:14.149 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.148+0000 7f5d685bf740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c5aead6410 0x55c5aeade190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:14.150 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.148+0000 7f5d685bf740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5aeae0cb0 0x55c5aeade6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:14.150 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.148+0000 7f5d685bf740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55c5aeae3880 con 0x55c5aead6410 2024-09-19T07:27:14.150 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.148+0000 7f5d685bf740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55c5ae9c3290 con 0x55c5aeae0cb0 2024-09-19T07:27:14.150 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.148+0000 7f5d685bf740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c5aeae3a00 con 0x55c5aead5af0 2024-09-19T07:27:14.150 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.148+0000 7f5d685bf740 10 client.0 _ll_register_callbacks cb 0x55c5ae9f4140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:27:14.150 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.149+0000 7f5d5e7fc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c5aead5af0 0x55c5aeaddc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:14.150 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.149+0000 7f5d5e7fc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c5aead5af0 0x55c5aeaddc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:52400/0 (socket says 172.21.15.148:52400) 2024-09-19T07:27:14.150 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.149+0000 7f5d5e7fc640 1 -- 172.21.15.148:0/2274052228 learned_addr learned my addr 172.21.15.148:0/2274052228 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:27:14.150 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.149+0000 7f5d5e7fc640 1 --2- 172.21.15.148:0/2274052228 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5aeae0cb0 0x55c5aeade6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:14.151 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.150+0000 7f5d5effd640 1 --2- 172.21.15.148:0/2274052228 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c5aead6410 0x55c5aeade190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:14.151 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.150+0000 7f5d5e7fc640 1 -- 172.21.15.148:0/2274052228 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5aeae0cb0 msgr2=0x55c5aeade6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:14.151 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.150+0000 7f5d5e7fc640 1 --2- 172.21.15.148:0/2274052228 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5aeae0cb0 0x55c5aeade6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.151 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.150+0000 7f5d5e7fc640 1 -- 172.21.15.148:0/2274052228 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c5aead6410 msgr2=0x55c5aeade190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:14.151 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.150+0000 7f5d5e7fc640 1 --2- 172.21.15.148:0/2274052228 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c5aead6410 0x55c5aeade190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.152 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.150+0000 7f5d5e7fc640 1 -- 172.21.15.148:0/2274052228 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5ae74d210 con 0x55c5aead5af0 2024-09-19T07:27:14.153 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.152+0000 7f5d5e7fc640 1 --2- 172.21.15.148:0/2274052228 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c5aead5af0 0x55c5aeaddc50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5d500167b0 tx=0x7f5d500166b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=578858f712f17cc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:14.153 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.153+0000 7f5d3effd640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-19T07:27:14.153 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.153+0000 7f5d3effd640 1 -- 172.21.15.148:0/2274052228 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d5001c070 con 0x55c5aead5af0 2024-09-19T07:27:14.153 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.153+0000 7f5d3effd640 1 -- 172.21.15.148:0/2274052228 <== mon.1 v2:172.21.15.179:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8600+0+0 (secure 0 0 0) 0x7f5d50016d60 con 0x55c5aead5af0 2024-09-19T07:27:14.153 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.153+0000 7f5d685bf740 1 -- 172.21.15.148:0/2274052228 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d50017af0 con 0x55c5aead5af0 2024-09-19T07:27:14.154 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.154+0000 7f5d3effd640 1 -- 172.21.15.148:0/2274052228 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f5d500169b0 con 0x55c5aead5af0 2024-09-19T07:27:14.154 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.154+0000 7f5d685bf740 10 client.26842 fetch_fsmap learned FSMap version 55 2024-09-19T07:27:14.154 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.154+0000 7f5d685bf740 1 -- 172.21.15.148:0/2274052228 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x55c5ae819620 con 0x55c5aead5af0 2024-09-19T07:27:14.157 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.156+0000 7f5d3effd640 1 -- 172.21.15.148:0/2274052228 <== mon.1 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d50017af0 con 0x55c5aead5af0 2024-09-19T07:27:14.157 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.156+0000 7f5d3effd640 1 -- 172.21.15.148:0/2274052228 <== mon.1 v2:172.21.15.179:3300/0 5 ==== fsmap(e 55) ==== 8370+0+0 (secure 0 0 0) 0x7f5d50015040 con 0x55c5aead5af0 2024-09-19T07:27:14.157 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.157+0000 7f5d685bf740 10 client.26842 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T07:27:14.157 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.157+0000 7f5d685bf740 10 client.26842 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:27:14.157 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.157+0000 7f5d685bf740 20 client.26842 populate_metadata read hostname 'smithi148' 2024-09-19T07:27:14.157 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.157+0000 7f5d685bf740 1 --2- 172.21.15.148:0/2274052228 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55c5aeb12c10 0x55c5aeb15000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:14.157 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.157+0000 7f5d685bf740 4 client.26842 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:27:14.157 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.157+0000 7f5d685bf740 1 -- 172.21.15.148:0/2274052228 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c5aea47a20 con 0x55c5aeb12c10 2024-09-19T07:27:14.159 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.159+0000 7f5d5effd640 1 --2- 172.21.15.148:0/2274052228 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55c5aeb12c10 0x55c5aeb15000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:14.162 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.161+0000 7f5d3effd640 10 client.26842 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:27:14.162 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.161+0000 7f5d5effd640 1 --2- 172.21.15.148:0/2274052228 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55c5aeb12c10 0x55c5aeb15000 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f674419cbb45590 server_cookie=e09bff52c0c2bde0 in_seq=0 out_seq=0 2024-09-19T07:27:14.166 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.165+0000 7f5d3effd640 1 -- 172.21.15.148:0/2274052228 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c5aea47a20 con 0x55c5aeb12c10 2024-09-19T07:27:14.166 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.165+0000 7f5d3effd640 10 client.26842 handle_command_reply: tid=0 2024-09-19T07:27:14.166 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.165+0000 7f5d685bf740 1 client.26842 shutdown 2024-09-19T07:27:14.169 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.169+0000 7f5d685bf740 1 -- 172.21.15.148:0/2274052228 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c5aead5af0 msgr2=0x55c5aeaddc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:14.169 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.169+0000 7f5d685bf740 1 --2- 172.21.15.148:0/2274052228 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c5aead5af0 0x55c5aeaddc50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5d500167b0 tx=0x7f5d500166b0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.172 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.171+0000 7f5d685bf740 1 -- 172.21.15.148:0/2274052228 shutdown_connections 2024-09-19T07:27:14.172 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.172+0000 7f5d685bf740 1 --2- 172.21.15.148:0/2274052228 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55c5aeb12c10 0x55c5aeb15000 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.172 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.172+0000 7f5d685bf740 1 --2- 172.21.15.148:0/2274052228 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5aeae0cb0 0x55c5aeade6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.172 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.172+0000 7f5d685bf740 1 --2- 172.21.15.148:0/2274052228 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c5aead6410 0x55c5aeade190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.172 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.172+0000 7f5d685bf740 1 --2- 172.21.15.148:0/2274052228 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c5aead5af0 0x55c5aeaddc50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.172 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.172+0000 7f5d685bf740 1 -- 172.21.15.148:0/2274052228 >> 172.21.15.148:0/2274052228 conn(0x55c5aead2060 msgr2=0x55c5aead7dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:14.172 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.172+0000 7f5d3effd640 0 client.26842 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:27:14.177 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.173+0000 7f5d685bf740 1 -- 172.21.15.148:0/2274052228 shutdown_connections 2024-09-19T07:27:14.177 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.174+0000 7f5d685bf740 1 -- 172.21.15.148:0/2274052228 wait complete. 2024-09-19T07:27:14.177 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.174+0000 7f5d685bf740 20 client.26842 trim_cache size 0 max 16384 2024-09-19T07:27:14.204 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.201+0000 7f5d685bf740 1 Processor -- start 2024-09-19T07:27:14.204 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.201+0000 7f5d685bf740 1 -- start start 2024-09-19T07:27:14.204 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.201+0000 7f5d685bf740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5aead5af0 0x55c5aead85b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:14.204 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.201+0000 7f5d685bf740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c5aead6410 0x55c5aeade500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:14.204 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.201+0000 7f5d685bf740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c5aeae0cb0 0x55c5aeb18020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:14.204 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.201+0000 7f5d685bf740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5d60120c70 con 0x55c5aead6410 2024-09-19T07:27:14.205 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.201+0000 7f5d685bf740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5d6011e480 con 0x55c5aead5af0 2024-09-19T07:27:14.205 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.201+0000 7f5d685bf740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5d6011c2f0 con 0x55c5aeae0cb0 2024-09-19T07:27:14.205 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.202+0000 7f5d5effd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c5aead6410 0x55c5aeade500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:14.205 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.202+0000 7f5d5effd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c5aead6410 0x55c5aeade500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51784/0 (socket says 172.21.15.148:51784) 2024-09-19T07:27:14.205 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.202+0000 7f5d5effd640 1 -- 172.21.15.148:0/4112565449 learned_addr learned my addr 172.21.15.148:0/4112565449 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:27:14.205 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.202+0000 7f5d5effd640 1 -- 172.21.15.148:0/4112565449 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c5aeae0cb0 msgr2=0x55c5aeb18020 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T07:27:14.205 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.202+0000 7f5d5effd640 1 --2- 172.21.15.148:0/4112565449 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c5aeae0cb0 0x55c5aeb18020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.205 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.202+0000 7f5d5effd640 1 -- 172.21.15.148:0/4112565449 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5aead5af0 msgr2=0x55c5aead85b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T07:27:14.205 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.202+0000 7f5d5effd640 1 --2- 172.21.15.148:0/4112565449 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5aead5af0 0x55c5aead85b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.206 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.202+0000 7f5d5effd640 1 -- 172.21.15.148:0/4112565449 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5aead2cf0 con 0x55c5aead6410 2024-09-19T07:27:14.206 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.203+0000 7f5d5effd640 1 --2- 172.21.15.148:0/4112565449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c5aead6410 0x55c5aeade500 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f5d540047b0 tx=0x7f5d54008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32b7e553c382fd9b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:14.206 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.203+0000 7f5d457fa640 1 -- 172.21.15.148:0/4112565449 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d54016ac0 con 0x55c5aead6410 2024-09-19T07:27:14.206 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.203+0000 7f5d457fa640 1 -- 172.21.15.148:0/4112565449 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d54016c60 con 0x55c5aead6410 2024-09-19T07:27:14.206 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.203+0000 7f5d457fa640 1 -- 172.21.15.148:0/4112565449 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d54016ac0 con 0x55c5aead6410 2024-09-19T07:27:14.207 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.204+0000 7f5d685bf740 1 -- 172.21.15.148:0/4112565449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c5aead6410 msgr2=0x55c5aeade500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:14.207 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.204+0000 7f5d685bf740 1 --2- 172.21.15.148:0/4112565449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c5aead6410 0x55c5aeade500 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f5d540047b0 tx=0x7f5d54008040 comp rx=0 tx=0).stop 2024-09-19T07:27:14.207 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.205+0000 7f5d685bf740 1 -- 172.21.15.148:0/4112565449 shutdown_connections 2024-09-19T07:27:14.208 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.205+0000 7f5d685bf740 1 --2- 172.21.15.148:0/4112565449 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c5aeae0cb0 0x55c5aeb18020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.208 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.205+0000 7f5d685bf740 1 --2- 172.21.15.148:0/4112565449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c5aead6410 0x55c5aeade500 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.208 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.205+0000 7f5d685bf740 1 --2- 172.21.15.148:0/4112565449 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5aead5af0 0x55c5aead85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.208 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.205+0000 7f5d685bf740 1 -- 172.21.15.148:0/4112565449 >> 172.21.15.148:0/4112565449 conn(0x55c5aead2060 msgr2=0x55c5aeadfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:14.209 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.208+0000 7f5d685bf740 1 -- 172.21.15.148:0/4112565449 shutdown_connections 2024-09-19T07:27:14.209 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.209+0000 7f5d685bf740 1 -- 172.21.15.148:0/4112565449 wait complete. 2024-09-19T07:27:14.209 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.209+0000 7f5d685bf740 1 -- start start 2024-09-19T07:27:14.209 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.209+0000 7f5d685bf740 1 Processor -- start 2024-09-19T07:27:14.211 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.210+0000 7f5d685bf740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c5aead5af0 0x55c5aeb15f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:14.211 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.210+0000 7f5d685bf740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c5aead6410 0x55c5aeb16490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:14.211 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.210+0000 7f5d685bf740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5aeae0cb0 0x55c5aeb169d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:14.211 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.210+0000 7f5d5e7fc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c5aead5af0 0x55c5aeb15f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:14.211 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.210+0000 7f5d685bf740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5d6011c940 con 0x55c5aead6410 2024-09-19T07:27:14.211 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.210+0000 7f5d685bf740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5d6011ddb0 con 0x55c5aeae0cb0 2024-09-19T07:27:14.211 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.210+0000 7f5d685bf740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5d6011d010 con 0x55c5aead5af0 2024-09-19T07:27:14.211 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.210+0000 7f5d5e7fc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c5aead5af0 0x55c5aeb15f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:52416/0 (socket says 172.21.15.148:52416) 2024-09-19T07:27:14.211 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.210+0000 7f5d5e7fc640 1 -- 172.21.15.148:0/1175232890 learned_addr learned my addr 172.21.15.148:0/1175232890 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:27:14.211 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.210+0000 7f5d685bf740 10 client.0 _ll_register_callbacks cb 0x7f5d5001a070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:27:14.211 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.210+0000 7f5d5e7fc640 1 --2- 172.21.15.148:0/1175232890 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5aeae0cb0 0x55c5aeb169d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:14.212 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.210+0000 7f5d5effd640 1 --2- 172.21.15.148:0/1175232890 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c5aead6410 0x55c5aeb16490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:14.212 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.211+0000 7f5d5effd640 1 -- 172.21.15.148:0/1175232890 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c5aead5af0 msgr2=0x55c5aeb15f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:14.212 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.211+0000 7f5d5effd640 1 --2- 172.21.15.148:0/1175232890 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c5aead5af0 0x55c5aeb15f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.212 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.211+0000 7f5d5effd640 1 -- 172.21.15.148:0/1175232890 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5aeae0cb0 msgr2=0x55c5aeb169d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:14.213 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.211+0000 7f5d5effd640 1 --2- 172.21.15.148:0/1175232890 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5aeae0cb0 0x55c5aeb169d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.213 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.211+0000 7f5d5effd640 1 -- 172.21.15.148:0/1175232890 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5aeacd2d0 con 0x55c5aead6410 2024-09-19T07:27:14.214 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.211+0000 7f5d5effd640 1 --2- 172.21.15.148:0/1175232890 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c5aead6410 0x55c5aeb16490 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f5d5400aa10 tx=0x7f5d54005af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1efcd66056c9bad5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:14.214 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.211+0000 7f5d3effd640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:27:14.214 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.212+0000 7f5d3effd640 1 -- 172.21.15.148:0/1175232890 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d5402b070 con 0x55c5aead6410 2024-09-19T07:27:14.215 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.212+0000 7f5d685bf740 1 -- 172.21.15.148:0/1175232890 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d54016c60 con 0x55c5aead6410 2024-09-19T07:27:14.215 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.212+0000 7f5d3effd640 1 -- 172.21.15.148:0/1175232890 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8600+0+0 (secure 0 0 0) 0x7f5d540062d0 con 0x55c5aead6410 2024-09-19T07:27:14.215 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.212+0000 7f5d3effd640 1 -- 172.21.15.148:0/1175232890 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f5d54037050 con 0x55c5aead6410 2024-09-19T07:27:14.215 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.212+0000 7f5d685bf740 10 client.17712 fetch_fsmap learned FSMap version 55 2024-09-19T07:27:14.215 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.212+0000 7f5d685bf740 1 -- 172.21.15.148:0/1175232890 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x55c5aeb7d810 con 0x55c5aead6410 2024-09-19T07:27:14.215 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.213+0000 7f5d3effd640 1 -- 172.21.15.148:0/1175232890 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d54016c60 con 0x55c5aead6410 2024-09-19T07:27:14.215 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.214+0000 7f5d3effd640 1 -- 172.21.15.148:0/1175232890 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 55) ==== 8370+0+0 (secure 0 0 0) 0x7f5d54025420 con 0x55c5aead6410 2024-09-19T07:27:14.215 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.214+0000 7f5d685bf740 10 client.17712 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T07:27:14.215 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.214+0000 7f5d685bf740 10 client.17712 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:27:14.215 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.214+0000 7f5d685bf740 20 client.17712 populate_metadata read hostname 'smithi148' 2024-09-19T07:27:14.215 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.214+0000 7f5d685bf740 1 --2- 172.21.15.148:0/1175232890 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55c5aeb7de60 0x55c5aeb80280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:14.215 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.214+0000 7f5d685bf740 4 client.17712 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:27:14.215 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.214+0000 7f5d685bf740 1 -- 172.21.15.148:0/1175232890 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c5aea41d70 con 0x55c5aeb7de60 2024-09-19T07:27:14.216 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.216+0000 7f5d5e7fc640 1 --2- 172.21.15.148:0/1175232890 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55c5aeb7de60 0x55c5aeb80280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:14.218 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.218+0000 7f5d5e7fc640 1 --2- 172.21.15.148:0/1175232890 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55c5aeb7de60 0x55c5aeb80280 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=234a0ffe99988290 server_cookie=a569df6b7df14e70 in_seq=0 out_seq=0 2024-09-19T07:27:14.218 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.218+0000 7f5d3effd640 10 client.17712 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:27:14.335 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.333+0000 7f5d3effd640 1 -- 172.21.15.148:0/1175232890 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c5aea41d70 con 0x55c5aeb7de60 2024-09-19T07:27:14.335 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.334+0000 7f5d3effd640 10 client.17712 handle_command_reply: tid=0 2024-09-19T07:27:14.335 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.334+0000 7f5d685bf740 1 client.17712 shutdown 2024-09-19T07:27:14.335 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.334+0000 7f5d685bf740 1 -- 172.21.15.148:0/1175232890 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c5aead6410 msgr2=0x55c5aeb16490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:14.336 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.334+0000 7f5d685bf740 1 --2- 172.21.15.148:0/1175232890 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c5aead6410 0x55c5aeb16490 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f5d5400aa10 tx=0x7f5d54005af0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.336 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.334+0000 7f5d685bf740 1 -- 172.21.15.148:0/1175232890 shutdown_connections 2024-09-19T07:27:14.336 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.334+0000 7f5d685bf740 1 --2- 172.21.15.148:0/1175232890 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55c5aeb7de60 0x55c5aeb80280 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.336 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.334+0000 7f5d685bf740 1 --2- 172.21.15.148:0/1175232890 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5aeae0cb0 0x55c5aeb169d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.336 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.334+0000 7f5d685bf740 1 --2- 172.21.15.148:0/1175232890 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c5aead6410 0x55c5aeb16490 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.336 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.334+0000 7f5d685bf740 1 --2- 172.21.15.148:0/1175232890 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c5aead5af0 0x55c5aeb15f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.336 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.334+0000 7f5d685bf740 1 -- 172.21.15.148:0/1175232890 >> 172.21.15.148:0/1175232890 conn(0x55c5aead2060 msgr2=0x55c5aead09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:14.336 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.334+0000 7f5d3effd640 0 client.17712 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:27:14.336 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.334+0000 7f5d685bf740 1 -- 172.21.15.148:0/1175232890 shutdown_connections 2024-09-19T07:27:14.336 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.334+0000 7f5d685bf740 1 -- 172.21.15.148:0/1175232890 wait complete. 2024-09-19T07:27:14.337 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.334+0000 7f5d685bf740 20 client.17712 trim_cache size 0 max 16384 2024-09-19T07:27:14.337 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:27:14.337 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:27:14.337 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:27:14.337 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:27:14.338 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.335+0000 7f5d6582c640 1 -- 172.21.15.148:0/878381103 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f5d480a3610 msgr2=0x7f5d480a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:14.339 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.335+0000 7f5d6582c640 1 --2- 172.21.15.148:0/878381103 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f5d480a3610 0x7f5d480a5ad0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5d580b96d0 tx=0x7f5d5803ae60 comp rx=0 tx=0).stop 2024-09-19T07:27:14.339 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.335+0000 7f5d6582c640 1 -- 172.21.15.148:0/878381103 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d601026f0 msgr2=0x7f5d6006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:14.339 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.335+0000 7f5d6582c640 1 --2- 172.21.15.148:0/878381103 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d601026f0 0x7f5d6006d0f0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f5d5802f0f0 tx=0x7f5d5803adf0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.339 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.335+0000 7f5d6582c640 1 -- 172.21.15.148:0/878381103 shutdown_connections 2024-09-19T07:27:14.339 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.335+0000 7f5d6582c640 1 --2- 172.21.15.148:0/878381103 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f5d480a3610 0x7f5d480a5ad0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.339 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.335+0000 7f5d6582c640 1 --2- 172.21.15.148:0/878381103 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d601026f0 0x7f5d6006d0f0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.339 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.335+0000 7f5d6582c640 1 --2- 172.21.15.148:0/878381103 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d60101d70 0x7f5d6006cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.339 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.335+0000 7f5d6582c640 1 --2- 172.21.15.148:0/878381103 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5d60100490 0x7f5d60073b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.339 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.336+0000 7f5d6582c640 1 -- 172.21.15.148:0/878381103 >> 172.21.15.148:0/878381103 conn(0x7f5d600770f0 msgr2=0x7f5d60104450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:14.339 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.336+0000 7f5d6582c640 1 -- 172.21.15.148:0/878381103 shutdown_connections 2024-09-19T07:27:14.339 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:14.336+0000 7f5d6582c640 1 -- 172.21.15.148:0/878381103 wait complete. 2024-09-19T07:27:14.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:27:14 smithi165 ceph-mon[35326]: pgmap v508: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 188 op/s 2024-09-19T07:27:15.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:27:14 smithi179 ceph-mon[35716]: pgmap v508: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 188 op/s 2024-09-19T07:27:15.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:27:14 smithi148 ceph-mon[31180]: pgmap v508: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 188 op/s 2024-09-19T07:27:16.820 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:27:16 smithi148 ceph-mon[31180]: pgmap v509: 97 pgs: 19 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 43 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 181 op/s 2024-09-19T07:27:16.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:27:16 smithi165 ceph-mon[35326]: pgmap v509: 97 pgs: 19 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 43 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 181 op/s 2024-09-19T07:27:17.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:27:16 smithi179 ceph-mon[35716]: pgmap v509: 97 pgs: 19 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 43 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 181 op/s 2024-09-19T07:27:18.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:27:18 smithi165 ceph-mon[35326]: pgmap v510: 97 pgs: 19 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 43 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 63 KiB/s wr, 41 op/s 2024-09-19T07:27:19.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:27:18 smithi179 ceph-mon[35716]: pgmap v510: 97 pgs: 19 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 43 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 63 KiB/s wr, 41 op/s 2024-09-19T07:27:19.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:27:18 smithi148 ceph-mon[31180]: pgmap v510: 97 pgs: 19 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 43 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 63 KiB/s wr, 41 op/s 2024-09-19T07:27:20.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:27:20 smithi165 ceph-mon[35326]: pgmap v511: 97 pgs: 19 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 43 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 63 KiB/s wr, 41 op/s 2024-09-19T07:27:21.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:27:20 smithi179 ceph-mon[35716]: pgmap v511: 97 pgs: 19 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 43 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 63 KiB/s wr, 41 op/s 2024-09-19T07:27:21.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:27:20 smithi148 ceph-mon[31180]: pgmap v511: 97 pgs: 19 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 43 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 63 KiB/s wr, 41 op/s 2024-09-19T07:27:22.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:27:22 smithi165 ceph-mon[35326]: pgmap v512: 97 pgs: 12 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 55 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 67 KiB/s wr, 39 op/s 2024-09-19T07:27:23.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:27:22 smithi179 ceph-mon[35716]: pgmap v512: 97 pgs: 12 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 55 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 67 KiB/s wr, 39 op/s 2024-09-19T07:27:23.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:27:22 smithi148 ceph-mon[31180]: pgmap v512: 97 pgs: 12 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 55 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 67 KiB/s wr, 39 op/s 2024-09-19T07:27:24.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:27:24 smithi165 ceph-mon[35326]: pgmap v513: 97 pgs: 11 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 62 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 43 KiB/s wr, 22 op/s 2024-09-19T07:27:25.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:27:24 smithi179 ceph-mon[35716]: pgmap v513: 97 pgs: 11 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 62 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 43 KiB/s wr, 22 op/s 2024-09-19T07:27:25.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:27:24 smithi148 ceph-mon[31180]: pgmap v513: 97 pgs: 11 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 62 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 43 KiB/s wr, 22 op/s 2024-09-19T07:27:26.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:27:26 smithi165 ceph-mon[35326]: pgmap v514: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 48 KiB/s wr, 25 op/s 2024-09-19T07:27:27.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:27:26 smithi179 ceph-mon[35716]: pgmap v514: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 48 KiB/s wr, 25 op/s 2024-09-19T07:27:27.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:27:26 smithi148 ceph-mon[31180]: pgmap v514: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 48 KiB/s wr, 25 op/s 2024-09-19T07:27:27.435 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.434+0000 7f920d5b7640 1 -- 172.21.15.148:0/1707937985 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9208107b80 msgr2=0x7f9208107f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:27.435 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.434+0000 7f920d5b7640 1 --2- 172.21.15.148:0/1707937985 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9208107b80 0x7f9208107f60 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f91f8009930 tx=0x7f91f802a420 comp rx=0 tx=0).stop 2024-09-19T07:27:27.435 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.434+0000 7f920d5b7640 1 -- 172.21.15.148:0/1707937985 shutdown_connections 2024-09-19T07:27:27.435 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.434+0000 7f920d5b7640 1 --2- 172.21.15.148:0/1707937985 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9208102480 0x7f920810e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.435 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.434+0000 7f920d5b7640 1 --2- 172.21.15.148:0/1707937985 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9208101ae0 0x7f9208101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.435 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.434+0000 7f920d5b7640 1 --2- 172.21.15.148:0/1707937985 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9208107b80 0x7f9208107f60 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.435 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.434+0000 7f920d5b7640 1 -- 172.21.15.148:0/1707937985 >> 172.21.15.148:0/1707937985 conn(0x7f92080fd7e0 msgr2=0x7f92080ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:27.435 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.434+0000 7f920d5b7640 1 -- 172.21.15.148:0/1707937985 shutdown_connections 2024-09-19T07:27:27.435 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.434+0000 7f920d5b7640 1 -- 172.21.15.148:0/1707937985 wait complete. 2024-09-19T07:27:27.435 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.434+0000 7f920d5b7640 1 Processor -- start 2024-09-19T07:27:27.436 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.435+0000 7f920d5b7640 1 -- start start 2024-09-19T07:27:27.437 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.435+0000 7f920d5b7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9208101ae0 0x7f9208198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:27.437 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.435+0000 7f920d5b7640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9208102480 0x7f9208198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:27.438 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.435+0000 7f920d5b7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9208107b80 0x7f920819cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:27.438 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.435+0000 7f920d5b7640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9208111f30 con 0x7f9208107b80 2024-09-19T07:27:27.438 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.435+0000 7f920d5b7640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9208111db0 con 0x7f9208102480 2024-09-19T07:27:27.438 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.435+0000 7f920d5b7640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f92081120b0 con 0x7f9208101ae0 2024-09-19T07:27:27.438 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.435+0000 7f92077fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9208107b80 0x7f920819cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:27.438 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.435+0000 7f92077fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9208107b80 0x7f920819cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55060/0 (socket says 172.21.15.148:55060) 2024-09-19T07:27:27.438 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.435+0000 7f9206ffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9208101ae0 0x7f9208198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:27.438 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.435+0000 7f92077fe640 1 -- 172.21.15.148:0/286479222 learned_addr learned my addr 172.21.15.148:0/286479222 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:27:27.438 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.435+0000 7f92067fc640 1 --2- 172.21.15.148:0/286479222 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9208102480 0x7f9208198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:27.438 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.435+0000 7f92077fe640 1 -- 172.21.15.148:0/286479222 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9208101ae0 msgr2=0x7f9208198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:27.438 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.435+0000 7f92077fe640 1 --2- 172.21.15.148:0/286479222 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9208101ae0 0x7f9208198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.438 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.435+0000 7f92077fe640 1 -- 172.21.15.148:0/286479222 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9208102480 msgr2=0x7f9208198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:27.439 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.435+0000 7f92077fe640 1 --2- 172.21.15.148:0/286479222 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9208102480 0x7f9208198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.439 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.435+0000 7f92077fe640 1 -- 172.21.15.148:0/286479222 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f920819d2f0 con 0x7f9208107b80 2024-09-19T07:27:27.439 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.435+0000 7f92067fc640 1 --2- 172.21.15.148:0/286479222 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9208102480 0x7f9208198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:27:27.439 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.435+0000 7f92077fe640 1 --2- 172.21.15.148:0/286479222 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9208107b80 0x7f920819cbc0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f920000cce0 tx=0x7f920000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:27.439 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.436+0000 7f91fffff640 1 -- 172.21.15.148:0/286479222 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f920000f450 con 0x7f9208107b80 2024-09-19T07:27:27.439 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.436+0000 7f91fffff640 1 -- 172.21.15.148:0/286479222 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f920000fad0 con 0x7f9208107b80 2024-09-19T07:27:27.439 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.436+0000 7f920d5b7640 1 -- 172.21.15.148:0/286479222 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f920819d5e0 con 0x7f9208107b80 2024-09-19T07:27:27.439 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.436+0000 7f91fffff640 1 -- 172.21.15.148:0/286479222 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9200018c10 con 0x7f9208107b80 2024-09-19T07:27:27.439 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.436+0000 7f920d5b7640 1 -- 172.21.15.148:0/286479222 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92081a4e70 con 0x7f9208107b80 2024-09-19T07:27:27.446 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.439+0000 7f921042a740 1 Processor -- start 2024-09-19T07:27:27.446 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.439+0000 7f91fffff640 1 -- 172.21.15.148:0/286479222 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f920000f5f0 con 0x7f9208107b80 2024-09-19T07:27:27.447 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.439+0000 7f921042a740 1 -- start start 2024-09-19T07:27:27.447 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.439+0000 7f921042a740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559f548f99b0 0x559f548f9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:27.447 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.439+0000 7f921042a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559f548fa2d0 0x559f54908b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:27.447 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.439+0000 7f921042a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f549090c0 0x559f5490b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:27.447 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.439+0000 7f921042a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x559f5485e2f0 con 0x559f548fa2d0 2024-09-19T07:27:27.447 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.439+0000 7f921042a740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x559f54806270 con 0x559f548f99b0 2024-09-19T07:27:27.447 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.439+0000 7f921042a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x559f5485a2b0 con 0x559f549090c0 2024-09-19T07:27:27.447 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.439+0000 7f9206ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559f548fa2d0 0x559f54908b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:27.447 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.439+0000 7f9206ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559f548fa2d0 0x559f54908b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55070/0 (socket says 172.21.15.148:55070) 2024-09-19T07:27:27.447 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.439+0000 7f9206ffd640 1 -- 172.21.15.148:0/1724043396 learned_addr learned my addr 172.21.15.148:0/1724043396 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:27:27.447 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.439+0000 7f91fffff640 1 --2- 172.21.15.148:0/286479222 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f91f40a3460 0x7f91f40a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:27.447 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.440+0000 7f9206ffd640 1 -- 172.21.15.148:0/1724043396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f549090c0 msgr2=0x559f5490b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:27.448 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.440+0000 7f9206ffd640 1 --2- 172.21.15.148:0/1724043396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f549090c0 0x559f5490b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.448 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.440+0000 7f92067fc640 1 --2- 172.21.15.148:0/1724043396 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559f548f99b0 0x559f548f9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:27.448 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.440+0000 7f9206ffd640 1 -- 172.21.15.148:0/1724043396 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559f548f99b0 msgr2=0x559f548f9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:27.448 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.440+0000 7f9206ffd640 1 --2- 172.21.15.148:0/1724043396 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559f548f99b0 0x559f548f9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.448 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.440+0000 7f9206ffd640 1 -- 172.21.15.148:0/1724043396 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f54805340 con 0x559f548fa2d0 2024-09-19T07:27:27.448 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.440+0000 7f92067fc640 1 --2- 172.21.15.148:0/1724043396 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559f548f99b0 0x559f548f9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:27:27.448 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.440+0000 7f92077fe640 1 --2- 172.21.15.148:0/286479222 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f91f40a3460 0x7f91f40a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:27.448 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.440+0000 7f91fffff640 1 -- 172.21.15.148:0/286479222 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8600+0+0 (secure 0 0 0) 0x7f92000d03f0 con 0x7f9208107b80 2024-09-19T07:27:27.448 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.440+0000 7f9206ffd640 1 --2- 172.21.15.148:0/1724043396 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559f548fa2d0 0x559f54908b80 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f91f8009930 tx=0x7f91f8031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8e133e88eacbbb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:27.448 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.440+0000 7f91fd7fa640 1 -- 172.21.15.148:0/1724043396 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f8040070 con 0x559f548fa2d0 2024-09-19T07:27:27.448 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.440+0000 7f91fd7fa640 1 -- 172.21.15.148:0/1724043396 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91f8005020 con 0x559f548fa2d0 2024-09-19T07:27:27.448 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.440+0000 7f91fd7fa640 1 -- 172.21.15.148:0/1724043396 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f8035040 con 0x559f548fa2d0 2024-09-19T07:27:27.448 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.441+0000 7f921042a740 1 -- 172.21.15.148:0/1724043396 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559f548fa2d0 msgr2=0x559f54908b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:27.449 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.441+0000 7f92077fe640 1 --2- 172.21.15.148:0/286479222 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f91f40a3460 0x7f91f40a5920 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f920009c380 tx=0x7f920006e400 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:27.449 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.441+0000 7f921042a740 1 --2- 172.21.15.148:0/1724043396 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559f548fa2d0 0x559f54908b80 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f91f8009930 tx=0x7f91f8031630 comp rx=0 tx=0).stop 2024-09-19T07:27:27.449 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.441+0000 7f921042a740 1 -- 172.21.15.148:0/1724043396 shutdown_connections 2024-09-19T07:27:27.449 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.441+0000 7f921042a740 1 --2- 172.21.15.148:0/1724043396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f549090c0 0x559f5490b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.449 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.441+0000 7f921042a740 1 --2- 172.21.15.148:0/1724043396 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559f548fa2d0 0x559f54908b80 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.449 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.441+0000 7f921042a740 1 --2- 172.21.15.148:0/1724043396 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559f548f99b0 0x559f548f9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.449 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.441+0000 7f921042a740 1 -- 172.21.15.148:0/1724043396 >> 172.21.15.148:0/1724043396 conn(0x559f548f6060 msgr2=0x559f548f6440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:27.449 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.441+0000 7f921042a740 1 -- 172.21.15.148:0/1724043396 shutdown_connections 2024-09-19T07:27:27.449 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.441+0000 7f921042a740 1 -- 172.21.15.148:0/1724043396 wait complete. 2024-09-19T07:27:27.449 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.441+0000 7f921042a740 1 -- start start 2024-09-19T07:27:27.449 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.441+0000 7f921042a740 1 Processor -- start 2024-09-19T07:27:27.449 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.441+0000 7f921042a740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559f548f99b0 0x559f54905f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:27.449 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.442+0000 7f921042a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f548fa2d0 0x559f549064b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:27.450 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.442+0000 7f921042a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559f549090c0 0x559f549069f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:27.450 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.442+0000 7f921042a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x559f5490bc30 con 0x559f549090c0 2024-09-19T07:27:27.450 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.442+0000 7f921042a740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x559f547e7290 con 0x559f548f99b0 2024-09-19T07:27:27.450 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.442+0000 7f921042a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x559f5490bdb0 con 0x559f548fa2d0 2024-09-19T07:27:27.450 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.442+0000 7f921042a740 10 client.0 _ll_register_callbacks cb 0x559f54818140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:27:27.450 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.442+0000 7f92067fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559f549090c0 0x559f549069f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:27.450 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.442+0000 7f92067fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559f549090c0 0x559f549069f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55082/0 (socket says 172.21.15.148:55082) 2024-09-19T07:27:27.450 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.442+0000 7f92067fc640 1 -- 172.21.15.148:0/3105225478 learned_addr learned my addr 172.21.15.148:0/3105225478 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:27:27.450 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.442+0000 7f92067fc640 1 --2- 172.21.15.148:0/3105225478 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559f548f99b0 0x559f54905f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:27.450 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.442+0000 7f9206ffd640 1 --2- 172.21.15.148:0/3105225478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f548fa2d0 0x559f549064b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:27.450 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.442+0000 7f92067fc640 1 -- 172.21.15.148:0/3105225478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f548fa2d0 msgr2=0x559f549064b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:27.450 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.442+0000 7f92067fc640 1 --2- 172.21.15.148:0/3105225478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f548fa2d0 0x559f549064b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.450 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.442+0000 7f92067fc640 1 -- 172.21.15.148:0/3105225478 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559f548f99b0 msgr2=0x559f54905f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:27.451 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.442+0000 7f92067fc640 1 --2- 172.21.15.148:0/3105225478 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559f548f99b0 0x559f54905f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.451 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.442+0000 7f92067fc640 1 -- 172.21.15.148:0/3105225478 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f54571210 con 0x559f549090c0 2024-09-19T07:27:27.451 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.442+0000 7f9206ffd640 1 --2- 172.21.15.148:0/3105225478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f548fa2d0 0x559f549064b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:27:27.451 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.442+0000 7f92067fc640 1 --2- 172.21.15.148:0/3105225478 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559f549090c0 0x559f549069f0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f91f0012fa0 tx=0x7f91f000d580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ef7682a8dd48c09 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:27.451 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.442+0000 7f91ee7fc640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:27:27.451 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.442+0000 7f91ee7fc640 1 -- 172.21.15.148:0/3105225478 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f001f420 con 0x559f549090c0 2024-09-19T07:27:27.451 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.442+0000 7f921042a740 1 -- 172.21.15.148:0/3105225478 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91f8005020 con 0x559f549090c0 2024-09-19T07:27:27.451 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.442+0000 7f91ee7fc640 1 -- 172.21.15.148:0/3105225478 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8600+0+0 (secure 0 0 0) 0x7f91f001f5c0 con 0x559f549090c0 2024-09-19T07:27:27.451 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.442+0000 7f91ee7fc640 1 -- 172.21.15.148:0/3105225478 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f91f001f7c0 con 0x559f549090c0 2024-09-19T07:27:27.451 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.442+0000 7f921042a740 10 client.17724 fetch_fsmap learned FSMap version 55 2024-09-19T07:27:27.451 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.442+0000 7f921042a740 1 -- 172.21.15.148:0/3105225478 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x559f5463d620 con 0x559f549090c0 2024-09-19T07:27:27.451 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.443+0000 7f91ee7fc640 1 -- 172.21.15.148:0/3105225478 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91f8005020 con 0x559f549090c0 2024-09-19T07:27:27.451 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.443+0000 7f91ee7fc640 1 -- 172.21.15.148:0/3105225478 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 55) ==== 8370+0+0 (secure 0 0 0) 0x7f91f0027a30 con 0x559f549090c0 2024-09-19T07:27:27.452 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.443+0000 7f921042a740 10 client.17724 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T07:27:27.453 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.443+0000 7f921042a740 10 client.17724 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:27:27.453 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.443+0000 7f921042a740 20 client.17724 populate_metadata read hostname 'smithi148' 2024-09-19T07:27:27.453 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.443+0000 7f921042a740 1 --2- 172.21.15.148:0/3105225478 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x559f54918f90 0x559f5491b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:27.453 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.443+0000 7f921042a740 4 client.17724 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:27:27.453 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.443+0000 7f921042a740 1 -- 172.21.15.148:0/3105225478 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f5486ba20 con 0x559f54918f90 2024-09-19T07:27:27.453 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.443+0000 7f9206ffd640 1 --2- 172.21.15.148:0/3105225478 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x559f54918f90 0x559f5491b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:27.453 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.444+0000 7f91ee7fc640 10 client.17724 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:27:27.453 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.444+0000 7f9206ffd640 1 --2- 172.21.15.148:0/3105225478 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x559f54918f90 0x559f5491b3d0 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4e2001d0f6639d3 server_cookie=1e8e93d34adc56a2 in_seq=0 out_seq=0 2024-09-19T07:27:27.453 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.444+0000 7f91ee7fc640 1 -- 172.21.15.148:0/3105225478 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559f5486ba20 con 0x559f54918f90 2024-09-19T07:27:27.453 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.444+0000 7f91ee7fc640 10 client.17724 handle_command_reply: tid=0 2024-09-19T07:27:27.453 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.444+0000 7f921042a740 1 client.17724 shutdown 2024-09-19T07:27:27.453 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.444+0000 7f921042a740 1 -- 172.21.15.148:0/3105225478 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559f549090c0 msgr2=0x559f549069f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:27.453 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.444+0000 7f921042a740 1 --2- 172.21.15.148:0/3105225478 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559f549090c0 0x559f549069f0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f91f0012fa0 tx=0x7f91f000d580 comp rx=0 tx=0).stop 2024-09-19T07:27:27.454 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.444+0000 7f921042a740 1 -- 172.21.15.148:0/3105225478 shutdown_connections 2024-09-19T07:27:27.454 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.444+0000 7f921042a740 1 --2- 172.21.15.148:0/3105225478 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x559f54918f90 0x559f5491b3d0 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.454 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.444+0000 7f921042a740 1 --2- 172.21.15.148:0/3105225478 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559f549090c0 0x559f549069f0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.454 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.444+0000 7f91ee7fc640 0 client.17724 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:27:27.454 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.444+0000 7f921042a740 1 --2- 172.21.15.148:0/3105225478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f548fa2d0 0x559f549064b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.454 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.444+0000 7f921042a740 1 --2- 172.21.15.148:0/3105225478 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559f548f99b0 0x559f54905f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.454 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.444+0000 7f921042a740 1 -- 172.21.15.148:0/3105225478 >> 172.21.15.148:0/3105225478 conn(0x559f548f6060 msgr2=0x559f548fbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:27.454 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.445+0000 7f921042a740 1 -- 172.21.15.148:0/3105225478 shutdown_connections 2024-09-19T07:27:27.454 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.445+0000 7f921042a740 1 -- 172.21.15.148:0/3105225478 wait complete. 2024-09-19T07:27:27.454 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.445+0000 7f921042a740 20 client.17724 trim_cache size 0 max 16384 2024-09-19T07:27:27.463 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.459+0000 7f921042a740 1 Processor -- start 2024-09-19T07:27:27.463 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.459+0000 7f921042a740 1 -- start start 2024-09-19T07:27:27.463 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.459+0000 7f921042a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559f548f99b0 0x559f549082a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:27.463 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.459+0000 7f921042a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f548fa2d0 0x559f54920ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:27.463 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.459+0000 7f921042a740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559f549090c0 0x559f549211e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:27.463 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.459+0000 7f921042a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f92081adf80 con 0x559f548f99b0 2024-09-19T07:27:27.463 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.459+0000 7f921042a740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f92081ab790 con 0x559f549090c0 2024-09-19T07:27:27.464 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.459+0000 7f921042a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f92081a9600 con 0x559f548fa2d0 2024-09-19T07:27:27.464 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.459+0000 7f92067fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559f548f99b0 0x559f549082a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:27.464 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.459+0000 7f92067fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559f548f99b0 0x559f549082a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55094/0 (socket says 172.21.15.148:55094) 2024-09-19T07:27:27.464 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.459+0000 7f92067fc640 1 -- 172.21.15.148:0/3276201259 learned_addr learned my addr 172.21.15.148:0/3276201259 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:27:27.464 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.459+0000 7f9206ffd640 1 --2- 172.21.15.148:0/3276201259 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f548fa2d0 0x559f54920ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:27.464 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.459+0000 7f92067fc640 1 -- 172.21.15.148:0/3276201259 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f548fa2d0 msgr2=0x559f54920ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:27.464 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.459+0000 7f92067fc640 1 --2- 172.21.15.148:0/3276201259 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f548fa2d0 0x559f54920ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.464 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.459+0000 7f92067fc640 1 -- 172.21.15.148:0/3276201259 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559f549090c0 msgr2=0x559f549211e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:27.464 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.459+0000 7f92067fc640 1 --2- 172.21.15.148:0/3276201259 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559f549090c0 0x559f549211e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.464 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.459+0000 7f92067fc640 1 -- 172.21.15.148:0/3276201259 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f54900d50 con 0x559f548f99b0 2024-09-19T07:27:27.464 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.459+0000 7f92067fc640 1 --2- 172.21.15.148:0/3276201259 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559f548f99b0 0x559f549082a0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f91f0012fd0 tx=0x7f91f000d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28a62dab4968616c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:27.464 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.460+0000 7f91fcff9640 1 -- 172.21.15.148:0/3276201259 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f0034070 con 0x559f548f99b0 2024-09-19T07:27:27.464 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.460+0000 7f91fcff9640 1 -- 172.21.15.148:0/3276201259 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91f000e3b0 con 0x559f548f99b0 2024-09-19T07:27:27.465 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.460+0000 7f91fcff9640 1 -- 172.21.15.148:0/3276201259 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f00052a0 con 0x559f548f99b0 2024-09-19T07:27:27.465 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.460+0000 7f921042a740 1 -- 172.21.15.148:0/3276201259 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559f548f99b0 msgr2=0x559f549082a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:27.465 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.460+0000 7f921042a740 1 --2- 172.21.15.148:0/3276201259 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559f548f99b0 0x559f549082a0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f91f0012fd0 tx=0x7f91f000d340 comp rx=0 tx=0).stop 2024-09-19T07:27:27.465 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.460+0000 7f921042a740 1 -- 172.21.15.148:0/3276201259 shutdown_connections 2024-09-19T07:27:27.465 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.460+0000 7f921042a740 1 --2- 172.21.15.148:0/3276201259 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559f549090c0 0x559f549211e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.465 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.460+0000 7f921042a740 1 --2- 172.21.15.148:0/3276201259 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f548fa2d0 0x559f54920ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.465 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.460+0000 7f921042a740 1 --2- 172.21.15.148:0/3276201259 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559f548f99b0 0x559f549082a0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.465 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.460+0000 7f921042a740 1 -- 172.21.15.148:0/3276201259 >> 172.21.15.148:0/3276201259 conn(0x559f548f6060 msgr2=0x559f548f51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:27.465 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.460+0000 7f921042a740 1 -- 172.21.15.148:0/3276201259 shutdown_connections 2024-09-19T07:27:27.465 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.460+0000 7f921042a740 1 -- 172.21.15.148:0/3276201259 wait complete. 2024-09-19T07:27:27.465 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.461+0000 7f921042a740 1 -- start start 2024-09-19T07:27:27.465 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.461+0000 7f921042a740 1 Processor -- start 2024-09-19T07:27:27.465 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.461+0000 7f921042a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559f548f99b0 0x559f549115e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:27.465 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.461+0000 7f921042a740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559f548fa2d0 0x559f5490c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:27.466 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.461+0000 7f921042a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f549090c0 0x559f5490ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:27.466 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.461+0000 7f921042a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f92081a9c50 con 0x559f548f99b0 2024-09-19T07:27:27.466 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.461+0000 7f921042a740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f92081ab0c0 con 0x559f548fa2d0 2024-09-19T07:27:27.466 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.461+0000 7f921042a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f92081aa320 con 0x559f549090c0 2024-09-19T07:27:27.466 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.461+0000 7f921042a740 10 client.0 _ll_register_callbacks cb 0x7f91f0012b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:27:27.466 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.461+0000 7f92067fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559f548f99b0 0x559f549115e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:27.466 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.461+0000 7f92067fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559f548f99b0 0x559f549115e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55104/0 (socket says 172.21.15.148:55104) 2024-09-19T07:27:27.466 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.461+0000 7f92067fc640 1 -- 172.21.15.148:0/1668556211 learned_addr learned my addr 172.21.15.148:0/1668556211 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:27:27.466 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.461+0000 7f92067fc640 1 -- 172.21.15.148:0/1668556211 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f549090c0 msgr2=0x559f5490ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:27.466 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.461+0000 7f92067fc640 1 --2- 172.21.15.148:0/1668556211 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f549090c0 0x559f5490ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.466 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.461+0000 7f92067fc640 1 -- 172.21.15.148:0/1668556211 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559f548fa2d0 msgr2=0x559f5490c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:27.466 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.461+0000 7f92067fc640 1 --2- 172.21.15.148:0/1668556211 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559f548fa2d0 0x559f5490c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.466 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.461+0000 7f92067fc640 1 -- 172.21.15.148:0/1668556211 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f5490d480 con 0x559f548f99b0 2024-09-19T07:27:27.466 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.461+0000 7f92067fc640 1 --2- 172.21.15.148:0/1668556211 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559f548f99b0 0x559f549115e0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f91f0000bc0 tx=0x7f91f001ff40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efa6ad9b110847c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:27.467 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.461+0000 7f91ee7fc640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:27:27.467 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.462+0000 7f91ee7fc640 1 -- 172.21.15.148:0/1668556211 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f0034020 con 0x559f548f99b0 2024-09-19T07:27:27.467 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.462+0000 7f91ee7fc640 1 -- 172.21.15.148:0/1668556211 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8600+0+0 (secure 0 0 0) 0x7f91f0005680 con 0x559f548f99b0 2024-09-19T07:27:27.467 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.462+0000 7f921042a740 1 -- 172.21.15.148:0/1668556211 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91f000e3b0 con 0x559f548f99b0 2024-09-19T07:27:27.467 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.462+0000 7f91ee7fc640 1 -- 172.21.15.148:0/1668556211 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f91f000d3e0 con 0x559f548f99b0 2024-09-19T07:27:27.467 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.462+0000 7f921042a740 10 client.17730 fetch_fsmap learned FSMap version 55 2024-09-19T07:27:27.467 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.462+0000 7f921042a740 1 -- 172.21.15.148:0/1668556211 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x559f54983ad0 con 0x559f548f99b0 2024-09-19T07:27:27.467 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.462+0000 7f91ee7fc640 1 -- 172.21.15.148:0/1668556211 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91f000e3b0 con 0x559f548f99b0 2024-09-19T07:27:27.467 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.462+0000 7f91ee7fc640 1 -- 172.21.15.148:0/1668556211 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 55) ==== 8370+0+0 (secure 0 0 0) 0x7f91f0027400 con 0x559f548f99b0 2024-09-19T07:27:27.467 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.462+0000 7f921042a740 10 client.17730 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T07:27:27.467 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.462+0000 7f921042a740 10 client.17730 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:27:27.467 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.462+0000 7f921042a740 20 client.17730 populate_metadata read hostname 'smithi148' 2024-09-19T07:27:27.467 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.462+0000 7f921042a740 1 --2- 172.21.15.148:0/1668556211 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x559f549841b0 0x559f549865d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:27.467 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.462+0000 7f921042a740 4 client.17730 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:27:27.468 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.462+0000 7f921042a740 1 -- 172.21.15.148:0/1668556211 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559f54865d70 con 0x559f549841b0 2024-09-19T07:27:27.468 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.462+0000 7f9206ffd640 1 --2- 172.21.15.148:0/1668556211 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x559f549841b0 0x559f549865d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:27.468 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.463+0000 7f9206ffd640 1 --2- 172.21.15.148:0/1668556211 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x559f549841b0 0x559f549865d0 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8baf9e0f3ed184e server_cookie=f5d086a64331ede9 in_seq=0 out_seq=0 2024-09-19T07:27:27.468 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.463+0000 7f91ee7fc640 10 client.17730 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:27:27.475 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.474+0000 7f91ee7fc640 1 -- 172.21.15.148:0/1668556211 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559f54865d70 con 0x559f549841b0 2024-09-19T07:27:27.475 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.474+0000 7f91ee7fc640 10 client.17730 handle_command_reply: tid=0 2024-09-19T07:27:27.475 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.474+0000 7f921042a740 1 client.17730 shutdown 2024-09-19T07:27:27.475 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.474+0000 7f921042a740 1 -- 172.21.15.148:0/1668556211 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559f548f99b0 msgr2=0x559f549115e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:27.475 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.474+0000 7f921042a740 1 --2- 172.21.15.148:0/1668556211 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559f548f99b0 0x559f549115e0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f91f0000bc0 tx=0x7f91f001ff40 comp rx=0 tx=0).stop 2024-09-19T07:27:27.475 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.474+0000 7f921042a740 1 -- 172.21.15.148:0/1668556211 shutdown_connections 2024-09-19T07:27:27.475 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.474+0000 7f921042a740 1 --2- 172.21.15.148:0/1668556211 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x559f549841b0 0x559f549865d0 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.475 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.474+0000 7f921042a740 1 --2- 172.21.15.148:0/1668556211 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559f549090c0 0x559f5490ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.475 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.474+0000 7f91ee7fc640 0 client.17730 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:27:27.475 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.474+0000 7f921042a740 1 --2- 172.21.15.148:0/1668556211 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559f548fa2d0 0x559f5490c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.475 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.474+0000 7f921042a740 1 --2- 172.21.15.148:0/1668556211 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559f548f99b0 0x559f549115e0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.475 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.474+0000 7f921042a740 1 -- 172.21.15.148:0/1668556211 >> 172.21.15.148:0/1668556211 conn(0x559f548f6060 msgr2=0x559f549046f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:27.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.474+0000 7f921042a740 1 -- 172.21.15.148:0/1668556211 shutdown_connections 2024-09-19T07:27:27.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.474+0000 7f921042a740 1 -- 172.21.15.148:0/1668556211 wait complete. 2024-09-19T07:27:27.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.474+0000 7f921042a740 20 client.17730 trim_cache size 0 max 16384 2024-09-19T07:27:27.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:27:27.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:27:27.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:27:27.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:27:27.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.475+0000 7f920d5b7640 1 -- 172.21.15.148:0/286479222 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f91f40a3460 msgr2=0x7f91f40a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:27.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.475+0000 7f920d5b7640 1 --2- 172.21.15.148:0/286479222 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f91f40a3460 0x7f91f40a5920 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f920009c380 tx=0x7f920006e400 comp rx=0 tx=0).stop 2024-09-19T07:27:27.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.475+0000 7f920d5b7640 1 -- 172.21.15.148:0/286479222 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9208107b80 msgr2=0x7f920819cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:27.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.475+0000 7f920d5b7640 1 --2- 172.21.15.148:0/286479222 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9208107b80 0x7f920819cbc0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f920000cce0 tx=0x7f920000a620 comp rx=0 tx=0).stop 2024-09-19T07:27:27.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.475+0000 7f920d5b7640 1 -- 172.21.15.148:0/286479222 shutdown_connections 2024-09-19T07:27:27.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.475+0000 7f920d5b7640 1 --2- 172.21.15.148:0/286479222 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f91f40a3460 0x7f91f40a5920 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.475+0000 7f920d5b7640 1 --2- 172.21.15.148:0/286479222 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9208107b80 0x7f920819cbc0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.475+0000 7f920d5b7640 1 --2- 172.21.15.148:0/286479222 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9208102480 0x7f9208198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.475+0000 7f920d5b7640 1 --2- 172.21.15.148:0/286479222 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9208101ae0 0x7f9208198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.475+0000 7f920d5b7640 1 -- 172.21.15.148:0/286479222 >> 172.21.15.148:0/286479222 conn(0x7f92080fd7e0 msgr2=0x7f92080fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:27.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.475+0000 7f920d5b7640 1 -- 172.21.15.148:0/286479222 shutdown_connections 2024-09-19T07:27:27.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:27.475+0000 7f920d5b7640 1 -- 172.21.15.148:0/286479222 wait complete. 2024-09-19T07:27:28.675 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:27:28.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:27:28 smithi165 ceph-mon[35326]: pgmap v515: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.5 KiB/s wr, 5 op/s 2024-09-19T07:27:28.931 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:27:29.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:27:28 smithi179 ceph-mon[35716]: pgmap v515: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.5 KiB/s wr, 5 op/s 2024-09-19T07:27:29.053 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:27:28 smithi148 ceph-mon[31180]: pgmap v515: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.5 KiB/s wr, 5 op/s 2024-09-19T07:27:29.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.402+0000 7f10a6f74640 1 -- 172.21.15.148:0/2201254327 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10a01027a0 msgr2=0x7f10a01067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:29.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.402+0000 7f10a6f74640 1 --2- 172.21.15.148:0/2201254327 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10a01027a0 0x7f10a01067f0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f108c009900 tx=0x7f108c02a410 comp rx=0 tx=0).stop 2024-09-19T07:27:29.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.402+0000 7f10a6f74640 1 -- 172.21.15.148:0/2201254327 shutdown_connections 2024-09-19T07:27:29.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.402+0000 7f10a6f74640 1 --2- 172.21.15.148:0/2201254327 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10a0106f20 0x7f10a010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:29.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.402+0000 7f10a6f74640 1 --2- 172.21.15.148:0/2201254327 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10a01027a0 0x7f10a01067f0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:29.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.402+0000 7f10a6f74640 1 --2- 172.21.15.148:0/2201254327 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10a0101df0 0x7f10a01021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:29.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.402+0000 7f10a6f74640 1 -- 172.21.15.148:0/2201254327 >> 172.21.15.148:0/2201254327 conn(0x7f10a00fd8f0 msgr2=0x7f10a00ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:29.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.402+0000 7f10a6f74640 1 -- 172.21.15.148:0/2201254327 shutdown_connections 2024-09-19T07:27:29.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.402+0000 7f10a6f74640 1 -- 172.21.15.148:0/2201254327 wait complete. 2024-09-19T07:27:29.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.403+0000 7f10a6f74640 1 Processor -- start 2024-09-19T07:27:29.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.403+0000 7f10a6f74640 1 -- start start 2024-09-19T07:27:29.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.403+0000 7f10a6f74640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10a0101df0 0x7f10a00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:29.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.403+0000 7f10a6f74640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10a01027a0 0x7f10a0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:29.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.403+0000 7f10a6f74640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10a0106f20 0x7f10a0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:29.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.403+0000 7f10a6f74640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f10a0111f80 con 0x7f10a01027a0 2024-09-19T07:27:29.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.403+0000 7f10a6f74640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f10a0111e00 con 0x7f10a0101df0 2024-09-19T07:27:29.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.403+0000 7f10a6f74640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f10a0112100 con 0x7f10a0106f20 2024-09-19T07:27:29.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.403+0000 7f109ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10a01027a0 0x7f10a0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:29.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.403+0000 7f109ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10a01027a0 0x7f10a0074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55118/0 (socket says 172.21.15.148:55118) 2024-09-19T07:27:29.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.403+0000 7f109ffff640 1 -- 172.21.15.148:0/3119035523 learned_addr learned my addr 172.21.15.148:0/3119035523 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:27:29.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.403+0000 7f10a4d10640 1 --2- 172.21.15.148:0/3119035523 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10a0101df0 0x7f10a00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:29.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.404+0000 7f10a5511640 1 --2- 172.21.15.148:0/3119035523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10a0106f20 0x7f10a0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:29.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.404+0000 7f109ffff640 1 -- 172.21.15.148:0/3119035523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10a0106f20 msgr2=0x7f10a0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:29.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.404+0000 7f109ffff640 1 --2- 172.21.15.148:0/3119035523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10a0106f20 0x7f10a0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:29.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.404+0000 7f109ffff640 1 -- 172.21.15.148:0/3119035523 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10a0101df0 msgr2=0x7f10a00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:29.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.404+0000 7f109ffff640 1 --2- 172.21.15.148:0/3119035523 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10a0101df0 0x7f10a00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:29.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.404+0000 7f109ffff640 1 -- 172.21.15.148:0/3119035523 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a01a6980 con 0x7f10a01027a0 2024-09-19T07:27:29.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.404+0000 7f109ffff640 1 --2- 172.21.15.148:0/3119035523 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10a01027a0 0x7f10a0074a30 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f108c006010 tx=0x7f108c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:29.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.404+0000 7f109dffb640 1 -- 172.21.15.148:0/3119035523 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f108c03f030 con 0x7f10a01027a0 2024-09-19T07:27:29.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.404+0000 7f109dffb640 1 -- 172.21.15.148:0/3119035523 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f108c003ce0 con 0x7f10a01027a0 2024-09-19T07:27:29.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.404+0000 7f10a6f74640 1 -- 172.21.15.148:0/3119035523 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10a01a6c10 con 0x7f10a01027a0 2024-09-19T07:27:29.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.404+0000 7f109dffb640 1 -- 172.21.15.148:0/3119035523 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f108c035070 con 0x7f10a01027a0 2024-09-19T07:27:29.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.404+0000 7f10a6f74640 1 -- 172.21.15.148:0/3119035523 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10a01a70f0 con 0x7f10a01027a0 2024-09-19T07:27:29.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.405+0000 7f10a6f74640 1 -- 172.21.15.148:0/3119035523 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10a01021d0 con 0x7f10a01027a0 2024-09-19T07:27:29.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.407+0000 7f109dffb640 1 -- 172.21.15.148:0/3119035523 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f108c042030 con 0x7f10a01027a0 2024-09-19T07:27:29.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.408+0000 7f109dffb640 1 --2- 172.21.15.148:0/3119035523 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f10900a33b0 0x7f10900a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:29.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.408+0000 7f10a4d10640 1 --2- 172.21.15.148:0/3119035523 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f10900a33b0 0x7f10900a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:29.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.408+0000 7f109dffb640 1 -- 172.21.15.148:0/3119035523 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8600+0+0 (secure 0 0 0) 0x7f108c0f0510 con 0x7f10a01027a0 2024-09-19T07:27:29.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.409+0000 7f10a4d10640 1 --2- 172.21.15.148:0/3119035523 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f10900a33b0 0x7f10900a5870 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1094005d00 tx=0x7f109400b410 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:29.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.411+0000 7f109dffb640 1 -- 172.21.15.148:0/3119035523 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f108c0bcf60 con 0x7f10a01027a0 2024-09-19T07:27:29.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.622+0000 7f10a6f74640 1 -- 172.21.15.148:0/3119035523 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f10a010a100 con 0x7f10a01027a0 2024-09-19T07:27:29.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.623+0000 7f109dffb640 1 -- 172.21.15.148:0/3119035523 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+11947 (secure 0 0 0) 0x7f108c0bc860 con 0x7f10a01027a0 2024-09-19T07:27:29.623 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:27:29.623 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":55,"btime":"2024-09-19T07:26:06:767218+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/4263868576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":4263868576},{"type":"v1","addr":"172.21.15.148:6841","nonce":4263868576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":25606,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3891676893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3891676893},{"type":"v1","addr":"172.21.15.179:6835","nonce":3891676893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":55,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:09:19.543369+0000","modified":"2024-09-19T07:26:06.157910+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24457,"mds_1":24437,"mds_2":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":75,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":71,"addr":"172.21.15.165:6839/3993490234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":3993490234},{"type":"v1","addr":"172.21.15.165:6839","nonce":3993490234}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25823":{"gid":25823,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6835/380886107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":380886107},{"type":"v1","addr":"172.21.15.165:6835","nonce":380886107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24457,"qdb_cluster":[24457,24437,24436]},"id":1}]} 2024-09-19T07:27:29.624 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 55 2024-09-19T07:27:29.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.626+0000 7f10a6f74640 1 -- 172.21.15.148:0/3119035523 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f10900a33b0 msgr2=0x7f10900a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:29.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.626+0000 7f10a6f74640 1 --2- 172.21.15.148:0/3119035523 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f10900a33b0 0x7f10900a5870 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1094005d00 tx=0x7f109400b410 comp rx=0 tx=0).stop 2024-09-19T07:27:29.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.626+0000 7f10a6f74640 1 -- 172.21.15.148:0/3119035523 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10a01027a0 msgr2=0x7f10a0074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:29.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.626+0000 7f10a6f74640 1 --2- 172.21.15.148:0/3119035523 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10a01027a0 0x7f10a0074a30 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f108c006010 tx=0x7f108c0042f0 comp rx=0 tx=0).stop 2024-09-19T07:27:29.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.626+0000 7f10a6f74640 1 -- 172.21.15.148:0/3119035523 shutdown_connections 2024-09-19T07:27:29.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.626+0000 7f10a6f74640 1 --2- 172.21.15.148:0/3119035523 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f10900a33b0 0x7f10900a5870 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:29.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.626+0000 7f10a6f74640 1 --2- 172.21.15.148:0/3119035523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10a0106f20 0x7f10a0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:29.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.626+0000 7f10a6f74640 1 --2- 172.21.15.148:0/3119035523 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10a01027a0 0x7f10a0074a30 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:29.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.626+0000 7f10a6f74640 1 --2- 172.21.15.148:0/3119035523 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10a0101df0 0x7f10a00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:29.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.626+0000 7f10a6f74640 1 -- 172.21.15.148:0/3119035523 >> 172.21.15.148:0/3119035523 conn(0x7f10a00fd8f0 msgr2=0x7f10a00fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:29.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.627+0000 7f10a6f74640 1 -- 172.21.15.148:0/3119035523 shutdown_connections 2024-09-19T07:27:29.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:29.627+0000 7f10a6f74640 1 -- 172.21.15.148:0/3119035523 wait complete. 2024-09-19T07:27:30.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:27:29 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/3119035523' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:27:30.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:27:29 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/3119035523' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:27:30.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:27:29 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/3119035523' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:27:30.528 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24457 quiesce db --set-id ecadb53f --release --await' 2024-09-19T07:27:30.528 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24457 quiesce db --set-id ecadb53f --release --await 2024-09-19T07:27:30.780 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:27:30.832 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:27:30 smithi148 ceph-mon[31180]: pgmap v516: 97 pgs: 97 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.5 KiB/s wr, 5 op/s 2024-09-19T07:27:31.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:27:30 smithi179 ceph-mon[35716]: pgmap v516: 97 pgs: 97 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.5 KiB/s wr, 5 op/s 2024-09-19T07:27:31.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:27:30 smithi165 ceph-mon[35326]: pgmap v516: 97 pgs: 97 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.5 KiB/s wr, 5 op/s 2024-09-19T07:27:31.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.290+0000 7fc9de24e640 1 -- 172.21.15.148:0/4131336828 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9d8102790 msgr2=0x7fc9d81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:31.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.290+0000 7fc9de24e640 1 --2- 172.21.15.148:0/4131336828 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9d8102790 0x7fc9d81067e0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0009900 tx=0x7fc9c002a410 comp rx=0 tx=0).stop 2024-09-19T07:27:31.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.290+0000 7fc9de24e640 1 -- 172.21.15.148:0/4131336828 shutdown_connections 2024-09-19T07:27:31.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.290+0000 7fc9de24e640 1 --2- 172.21.15.148:0/4131336828 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9d8106f10 0x7fc9d810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:31.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.290+0000 7fc9de24e640 1 --2- 172.21.15.148:0/4131336828 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9d8102790 0x7fc9d81067e0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:31.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.290+0000 7fc9de24e640 1 --2- 172.21.15.148:0/4131336828 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9d8101de0 0x7fc9d81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:31.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.290+0000 7fc9de24e640 1 -- 172.21.15.148:0/4131336828 >> 172.21.15.148:0/4131336828 conn(0x7fc9d80fd8c0 msgr2=0x7fc9d80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:31.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.290+0000 7fc9de24e640 1 -- 172.21.15.148:0/4131336828 shutdown_connections 2024-09-19T07:27:31.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.290+0000 7fc9de24e640 1 -- 172.21.15.148:0/4131336828 wait complete. 2024-09-19T07:27:31.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.290+0000 7fc9de24e640 1 Processor -- start 2024-09-19T07:27:31.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.290+0000 7fc9de24e640 1 -- start start 2024-09-19T07:27:31.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.290+0000 7fc9de24e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9d8101de0 0x7fc9d8198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:31.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.291+0000 7fc9de24e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9d8102790 0x7fc9d8198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:31.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.291+0000 7fc9de24e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9d8106f10 0x7fc9d819ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:31.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.291+0000 7fc9de24e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d8111f90 con 0x7fc9d8101de0 2024-09-19T07:27:31.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.291+0000 7fc9de24e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d8111e10 con 0x7fc9d8106f10 2024-09-19T07:27:31.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.291+0000 7fc9de24e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d8112110 con 0x7fc9d8102790 2024-09-19T07:27:31.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.291+0000 7fc9d77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9d8101de0 0x7fc9d8198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:31.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.291+0000 7fc9d77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9d8101de0 0x7fc9d8198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55136/0 (socket says 172.21.15.148:55136) 2024-09-19T07:27:31.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.291+0000 7fc9d77fe640 1 -- 172.21.15.148:0/4187341223 learned_addr learned my addr 172.21.15.148:0/4187341223 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:27:31.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.291+0000 7fc9cffff640 1 --2- 172.21.15.148:0/4187341223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9d8102790 0x7fc9d8198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:31.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.291+0000 7fc9d7fff640 1 --2- 172.21.15.148:0/4187341223 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9d8106f10 0x7fc9d819ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:31.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.291+0000 7fc9d77fe640 1 -- 172.21.15.148:0/4187341223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9d8102790 msgr2=0x7fc9d8198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:31.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.291+0000 7fc9d77fe640 1 --2- 172.21.15.148:0/4187341223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9d8102790 0x7fc9d8198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:31.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.291+0000 7fc9d77fe640 1 -- 172.21.15.148:0/4187341223 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9d8106f10 msgr2=0x7fc9d819ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:31.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.291+0000 7fc9d77fe640 1 --2- 172.21.15.148:0/4187341223 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9d8106f10 0x7fc9d819ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:31.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.291+0000 7fc9d77fe640 1 -- 172.21.15.148:0/4187341223 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9d819d3d0 con 0x7fc9d8101de0 2024-09-19T07:27:31.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.291+0000 7fc9d77fe640 1 --2- 172.21.15.148:0/4187341223 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9d8101de0 0x7fc9d8198420 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fc9c800c920 tx=0x7fc9c800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:31.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.291+0000 7fc9d57fa640 1 -- 172.21.15.148:0/4187341223 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c8007c70 con 0x7fc9d8101de0 2024-09-19T07:27:31.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.291+0000 7fc9de24e640 1 -- 172.21.15.148:0/4187341223 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9d819d6c0 con 0x7fc9d8101de0 2024-09-19T07:27:31.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.291+0000 7fc9d57fa640 1 -- 172.21.15.148:0/4187341223 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9c8007e10 con 0x7fc9d8101de0 2024-09-19T07:27:31.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.291+0000 7fc9d57fa640 1 -- 172.21.15.148:0/4187341223 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c8018890 con 0x7fc9d8101de0 2024-09-19T07:27:31.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.291+0000 7fc9de24e640 1 -- 172.21.15.148:0/4187341223 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9d81a4fa0 con 0x7fc9d8101de0 2024-09-19T07:27:31.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.293+0000 7fc9d57fa640 1 -- 172.21.15.148:0/4187341223 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fc9c8018a70 con 0x7fc9d8101de0 2024-09-19T07:27:31.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.294+0000 7fc9e0627740 1 Processor -- start 2024-09-19T07:27:31.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.294+0000 7fc9e0627740 1 -- start start 2024-09-19T07:27:31.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.294+0000 7fc9d57fa640 1 --2- 172.21.15.148:0/4187341223 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc9c40a33b0 0x7fc9c40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:31.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.294+0000 7fc9e0627740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556529393060 0x556529393440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:31.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.294+0000 7fc9e0627740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556529393980 0x55652939dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:31.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.294+0000 7fc9e0627740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55652939e240 0x5565293a0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:31.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.294+0000 7fc9e0627740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5565292f8620 con 0x556529393060 2024-09-19T07:27:31.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.294+0000 7fc9e0627740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55652929fe50 con 0x55652939e240 2024-09-19T07:27:31.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.294+0000 7fc9e0627740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5565292f45e0 con 0x556529393980 2024-09-19T07:27:31.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.294+0000 7fc9d77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556529393060 0x556529393440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:31.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.294+0000 7fc9d7fff640 1 --2- 172.21.15.148:0/4187341223 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc9c40a33b0 0x7fc9c40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:31.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.294+0000 7fc9d77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556529393060 0x556529393440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55150/0 (socket says 172.21.15.148:55150) 2024-09-19T07:27:31.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.294+0000 7fc9d77fe640 1 -- 172.21.15.148:0/1869885950 learned_addr learned my addr 172.21.15.148:0/1869885950 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:27:31.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.294+0000 7fc9d57fa640 1 -- 172.21.15.148:0/4187341223 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8600+0+0 (secure 0 0 0) 0x7fc9c80cffd0 con 0x7fc9d8101de0 2024-09-19T07:27:31.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.294+0000 7fc9cffff640 1 --2- 172.21.15.148:0/1869885950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556529393980 0x55652939dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:31.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.295+0000 7fc9d7fff640 1 --2- 172.21.15.148:0/1869885950 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55652939e240 0x5565293a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:31.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.295+0000 7fc9d77fe640 1 -- 172.21.15.148:0/1869885950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556529393980 msgr2=0x55652939dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:31.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.295+0000 7fc9d77fe640 1 --2- 172.21.15.148:0/1869885950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556529393980 0x55652939dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:31.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.295+0000 7fc9d77fe640 1 -- 172.21.15.148:0/1869885950 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55652939e240 msgr2=0x5565293a0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:31.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.295+0000 7fc9d77fe640 1 --2- 172.21.15.148:0/1869885950 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55652939e240 0x5565293a0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:31.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.295+0000 7fc9d77fe640 1 -- 172.21.15.148:0/1869885950 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556529290d40 con 0x556529393060 2024-09-19T07:27:31.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.295+0000 7fc9cffff640 1 --2- 172.21.15.148:0/1869885950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556529393980 0x55652939dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:27:31.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.295+0000 7fc9d7fff640 1 --2- 172.21.15.148:0/4187341223 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc9c40a33b0 0x7fc9c40a5870 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc9d0014400 tx=0x7fc9d0014800 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:31.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.295+0000 7fc9d77fe640 1 --2- 172.21.15.148:0/1869885950 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556529393060 0x556529393440 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fc9c809c190 tx=0x7fc9c8014400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=438120e49729bb64 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:31.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.295+0000 7fc9cdffb640 1 -- 172.21.15.148:0/1869885950 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c800de20 con 0x556529393060 2024-09-19T07:27:31.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.295+0000 7fc9cdffb640 1 -- 172.21.15.148:0/1869885950 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9c80a5d30 con 0x556529393060 2024-09-19T07:27:31.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.295+0000 7fc9cdffb640 1 -- 172.21.15.148:0/1869885950 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c80a05b0 con 0x556529393060 2024-09-19T07:27:31.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.296+0000 7fc9e0627740 1 -- 172.21.15.148:0/1869885950 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556529393060 msgr2=0x556529393440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:31.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.296+0000 7fc9e0627740 1 --2- 172.21.15.148:0/1869885950 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556529393060 0x556529393440 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fc9c809c190 tx=0x7fc9c8014400 comp rx=0 tx=0).stop 2024-09-19T07:27:31.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.296+0000 7fc9e0627740 1 -- 172.21.15.148:0/1869885950 shutdown_connections 2024-09-19T07:27:31.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.296+0000 7fc9e0627740 1 --2- 172.21.15.148:0/1869885950 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55652939e240 0x5565293a0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:31.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.296+0000 7fc9e0627740 1 --2- 172.21.15.148:0/1869885950 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556529393980 0x55652939dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:31.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.296+0000 7fc9e0627740 1 --2- 172.21.15.148:0/1869885950 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556529393060 0x556529393440 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:31.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.296+0000 7fc9e0627740 1 -- 172.21.15.148:0/1869885950 >> 172.21.15.148:0/1869885950 conn(0x55652938f5f0 msgr2=0x55652938f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:31.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.296+0000 7fc9e0627740 1 -- 172.21.15.148:0/1869885950 shutdown_connections 2024-09-19T07:27:31.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.296+0000 7fc9e0627740 1 -- 172.21.15.148:0/1869885950 wait complete. 2024-09-19T07:27:31.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.296+0000 7fc9e0627740 1 -- start start 2024-09-19T07:27:31.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.296+0000 7fc9e0627740 1 Processor -- start 2024-09-19T07:27:31.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.297+0000 7fc9e0627740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556529393060 0x55652939b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:31.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.297+0000 7fc9e0627740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556529393980 0x55652939b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:31.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.297+0000 7fc9e0627740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55652939e240 0x55652939bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:31.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.297+0000 7fc9e0627740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5565293a0e10 con 0x556529393060 2024-09-19T07:27:31.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.297+0000 7fc9e0627740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x556529280f10 con 0x556529393980 2024-09-19T07:27:31.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.297+0000 7fc9e0627740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5565293a0f90 con 0x55652939e240 2024-09-19T07:27:31.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.297+0000 7fc9e0627740 10 client.0 _ll_register_callbacks cb 0x5565292a4db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:27:31.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.297+0000 7fc9d77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556529393060 0x55652939b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:31.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.297+0000 7fc9d77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556529393060 0x55652939b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55156/0 (socket says 172.21.15.148:55156) 2024-09-19T07:27:31.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.297+0000 7fc9d77fe640 1 -- 172.21.15.148:0/872001311 learned_addr learned my addr 172.21.15.148:0/872001311 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:27:31.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.297+0000 7fc9cffff640 1 --2- 172.21.15.148:0/872001311 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556529393980 0x55652939b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:31.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.297+0000 7fc9d7fff640 1 --2- 172.21.15.148:0/872001311 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55652939e240 0x55652939bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:31.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.297+0000 7fc9d77fe640 1 -- 172.21.15.148:0/872001311 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55652939e240 msgr2=0x55652939bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:31.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.297+0000 7fc9d77fe640 1 --2- 172.21.15.148:0/872001311 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55652939e240 0x55652939bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:31.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.297+0000 7fc9d77fe640 1 -- 172.21.15.148:0/872001311 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556529393980 msgr2=0x55652939b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:31.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.297+0000 7fc9d77fe640 1 --2- 172.21.15.148:0/872001311 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556529393980 0x55652939b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:31.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.297+0000 7fc9d77fe640 1 -- 172.21.15.148:0/872001311 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556529007580 con 0x556529393060 2024-09-19T07:27:31.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.297+0000 7fc9cffff640 1 --2- 172.21.15.148:0/872001311 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556529393980 0x55652939b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:27:31.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.297+0000 7fc9d77fe640 1 --2- 172.21.15.148:0/872001311 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556529393060 0x55652939b1b0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fc9c8098bd0 tx=0x7fc9c809c200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d4c0c6782553e2e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:31.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.297+0000 7fc9b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:27:31.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.297+0000 7fc9b6ffd640 1 -- 172.21.15.148:0/872001311 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c80b5060 con 0x556529393060 2024-09-19T07:27:31.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.297+0000 7fc9b6ffd640 1 -- 172.21.15.148:0/872001311 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8600+0+0 (secure 0 0 0) 0x7fc9c8018d60 con 0x556529393060 2024-09-19T07:27:31.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.297+0000 7fc9e0627740 1 -- 172.21.15.148:0/872001311 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9c80a5d30 con 0x556529393060 2024-09-19T07:27:31.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.297+0000 7fc9b6ffd640 1 -- 172.21.15.148:0/872001311 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7fc9c80b5200 con 0x556529393060 2024-09-19T07:27:31.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.298+0000 7fc9e0627740 10 client.17748 fetch_fsmap learned FSMap version 55 2024-09-19T07:27:31.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.298+0000 7fc9e0627740 1 -- 172.21.15.148:0/872001311 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x5565290d1960 con 0x556529393060 2024-09-19T07:27:31.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.298+0000 7fc9b6ffd640 1 -- 172.21.15.148:0/872001311 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9c80a5d30 con 0x556529393060 2024-09-19T07:27:31.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.298+0000 7fc9b6ffd640 1 -- 172.21.15.148:0/872001311 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 55) ==== 8370+0+0 (secure 0 0 0) 0x7fc9c80cd8f0 con 0x556529393060 2024-09-19T07:27:31.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.298+0000 7fc9e0627740 10 client.17748 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T07:27:31.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.298+0000 7fc9e0627740 10 client.17748 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:27:31.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.298+0000 7fc9e0627740 20 client.17748 populate_metadata read hostname 'smithi148' 2024-09-19T07:27:31.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.298+0000 7fc9e0627740 1 --2- 172.21.15.148:0/872001311 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5565293adcc0 0x5565293b00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:31.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.298+0000 7fc9e0627740 4 client.17748 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:27:31.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.298+0000 7fc9e0627740 1 -- 172.21.15.148:0/872001311 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556529305b90 con 0x5565293adcc0 2024-09-19T07:27:31.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.298+0000 7fc9cffff640 1 --2- 172.21.15.148:0/872001311 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5565293adcc0 0x5565293b00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:31.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.299+0000 7fc9b6ffd640 10 client.17748 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:27:31.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.299+0000 7fc9cffff640 1 --2- 172.21.15.148:0/872001311 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5565293adcc0 0x5565293b00b0 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b47d1987b03cbfa4 server_cookie=b6eed8da9a05477e in_seq=0 out_seq=0 2024-09-19T07:27:31.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.299+0000 7fc9b6ffd640 1 -- 172.21.15.148:0/872001311 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556529305b90 con 0x5565293adcc0 2024-09-19T07:27:31.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.299+0000 7fc9b6ffd640 10 client.17748 handle_command_reply: tid=0 2024-09-19T07:27:31.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.299+0000 7fc9e0627740 1 client.17748 shutdown 2024-09-19T07:27:31.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.299+0000 7fc9e0627740 1 -- 172.21.15.148:0/872001311 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556529393060 msgr2=0x55652939b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:31.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.299+0000 7fc9e0627740 1 --2- 172.21.15.148:0/872001311 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556529393060 0x55652939b1b0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fc9c8098bd0 tx=0x7fc9c809c200 comp rx=0 tx=0).stop 2024-09-19T07:27:31.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.300+0000 7fc9e0627740 1 -- 172.21.15.148:0/872001311 shutdown_connections 2024-09-19T07:27:31.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.300+0000 7fc9e0627740 1 --2- 172.21.15.148:0/872001311 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5565293adcc0 0x5565293b00b0 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:31.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.300+0000 7fc9e0627740 1 --2- 172.21.15.148:0/872001311 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55652939e240 0x55652939bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:31.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.300+0000 7fc9e0627740 1 --2- 172.21.15.148:0/872001311 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556529393980 0x55652939b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:31.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.300+0000 7fc9b6ffd640 0 client.17748 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:27:31.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.300+0000 7fc9e0627740 1 --2- 172.21.15.148:0/872001311 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556529393060 0x55652939b1b0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:31.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.300+0000 7fc9e0627740 1 -- 172.21.15.148:0/872001311 >> 172.21.15.148:0/872001311 conn(0x55652938f5f0 msgr2=0x556529395320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:31.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.300+0000 7fc9e0627740 1 -- 172.21.15.148:0/872001311 shutdown_connections 2024-09-19T07:27:31.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.300+0000 7fc9e0627740 1 -- 172.21.15.148:0/872001311 wait complete. 2024-09-19T07:27:31.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.300+0000 7fc9e0627740 20 client.17748 trim_cache size 0 max 16384 2024-09-19T07:27:31.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.316+0000 7fc9e0627740 1 Processor -- start 2024-09-19T07:27:31.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.316+0000 7fc9e0627740 1 -- start start 2024-09-19T07:27:31.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.316+0000 7fc9e0627740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556529393060 0x5565293951c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:31.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.316+0000 7fc9e0627740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556529393980 0x556529398410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:31.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.316+0000 7fc9e0627740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55652939e240 0x556529398950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:31.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.317+0000 7fc9e0627740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d81b0220 con 0x55652939e240 2024-09-19T07:27:31.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.317+0000 7fc9e0627740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d81ada30 con 0x556529393980 2024-09-19T07:27:31.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.317+0000 7fc9e0627740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d81ab8a0 con 0x556529393060 2024-09-19T07:27:31.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.317+0000 7fc9d7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55652939e240 0x556529398950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:31.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.317+0000 7fc9d7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55652939e240 0x556529398950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55166/0 (socket says 172.21.15.148:55166) 2024-09-19T07:27:31.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.317+0000 7fc9d7fff640 1 -- 172.21.15.148:0/3714668229 learned_addr learned my addr 172.21.15.148:0/3714668229 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:27:31.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.317+0000 7fc9d77fe640 1 --2- 172.21.15.148:0/3714668229 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556529393060 0x5565293951c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:31.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.317+0000 7fc9cffff640 1 --2- 172.21.15.148:0/3714668229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556529393980 0x556529398410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:31.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.317+0000 7fc9d7fff640 1 -- 172.21.15.148:0/3714668229 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556529393060 msgr2=0x5565293951c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:31.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.317+0000 7fc9d7fff640 1 --2- 172.21.15.148:0/3714668229 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556529393060 0x5565293951c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:31.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.317+0000 7fc9d7fff640 1 -- 172.21.15.148:0/3714668229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556529393980 msgr2=0x556529398410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:31.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.317+0000 7fc9d7fff640 1 --2- 172.21.15.148:0/3714668229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556529393980 0x556529398410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:31.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.317+0000 7fc9d7fff640 1 -- 172.21.15.148:0/3714668229 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556529396010 con 0x55652939e240 2024-09-19T07:27:31.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.317+0000 7fc9d7fff640 1 --2- 172.21.15.148:0/3714668229 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55652939e240 0x556529398950 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fc9d0016550 tx=0x7fc9d001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d226a2a584691c64 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:31.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.317+0000 7fc9cd7fa640 1 -- 172.21.15.148:0/3714668229 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d001f050 con 0x55652939e240 2024-09-19T07:27:31.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.317+0000 7fc9cd7fa640 1 -- 172.21.15.148:0/3714668229 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9d0020040 con 0x55652939e240 2024-09-19T07:27:31.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.317+0000 7fc9cd7fa640 1 -- 172.21.15.148:0/3714668229 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d0024aa0 con 0x55652939e240 2024-09-19T07:27:31.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.318+0000 7fc9e0627740 1 -- 172.21.15.148:0/3714668229 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55652939e240 msgr2=0x556529398950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:31.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.318+0000 7fc9e0627740 1 --2- 172.21.15.148:0/3714668229 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55652939e240 0x556529398950 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fc9d0016550 tx=0x7fc9d001a000 comp rx=0 tx=0).stop 2024-09-19T07:27:31.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.318+0000 7fc9e0627740 1 -- 172.21.15.148:0/3714668229 shutdown_connections 2024-09-19T07:27:31.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.318+0000 7fc9e0627740 1 --2- 172.21.15.148:0/3714668229 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55652939e240 0x556529398950 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:31.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.318+0000 7fc9e0627740 1 --2- 172.21.15.148:0/3714668229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556529393980 0x556529398410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:31.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.318+0000 7fc9e0627740 1 --2- 172.21.15.148:0/3714668229 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556529393060 0x5565293951c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:31.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.318+0000 7fc9e0627740 1 -- 172.21.15.148:0/3714668229 >> 172.21.15.148:0/3714668229 conn(0x55652938f5f0 msgr2=0x556529394ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:31.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.318+0000 7fc9e0627740 1 -- 172.21.15.148:0/3714668229 shutdown_connections 2024-09-19T07:27:31.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.318+0000 7fc9e0627740 1 -- 172.21.15.148:0/3714668229 wait complete. 2024-09-19T07:27:31.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.318+0000 7fc9e0627740 1 -- start start 2024-09-19T07:27:31.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.319+0000 7fc9e0627740 1 Processor -- start 2024-09-19T07:27:31.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.319+0000 7fc9e0627740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556529393060 0x5565293b19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:31.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.319+0000 7fc9e0627740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556529393980 0x5565293b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:31.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.319+0000 7fc9e0627740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55652939e240 0x5565293b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:31.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.319+0000 7fc9e0627740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d81abef0 con 0x556529393060 2024-09-19T07:27:31.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.319+0000 7fc9e0627740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d81ad360 con 0x556529393980 2024-09-19T07:27:31.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.319+0000 7fc9e0627740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d81ac5c0 con 0x55652939e240 2024-09-19T07:27:31.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.319+0000 7fc9e0627740 10 client.0 _ll_register_callbacks cb 0x7fc9c809c9c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:27:31.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.319+0000 7fc9d77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556529393060 0x5565293b19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:31.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.319+0000 7fc9d77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556529393060 0x5565293b19d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55182/0 (socket says 172.21.15.148:55182) 2024-09-19T07:27:31.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.319+0000 7fc9d77fe640 1 -- 172.21.15.148:0/3623059689 learned_addr learned my addr 172.21.15.148:0/3623059689 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:27:31.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.319+0000 7fc9cffff640 1 --2- 172.21.15.148:0/3623059689 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556529393980 0x5565293b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:31.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.319+0000 7fc9d7fff640 1 --2- 172.21.15.148:0/3623059689 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55652939e240 0x5565293b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:31.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.319+0000 7fc9d77fe640 1 -- 172.21.15.148:0/3623059689 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55652939e240 msgr2=0x5565293b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:31.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.319+0000 7fc9d77fe640 1 --2- 172.21.15.148:0/3623059689 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55652939e240 0x5565293b2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:31.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.319+0000 7fc9d77fe640 1 -- 172.21.15.148:0/3623059689 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556529393980 msgr2=0x5565293b1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:31.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.319+0000 7fc9d77fe640 1 --2- 172.21.15.148:0/3623059689 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556529393980 0x5565293b1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:31.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.319+0000 7fc9d77fe640 1 -- 172.21.15.148:0/3623059689 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565293b35a0 con 0x556529393060 2024-09-19T07:27:31.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.319+0000 7fc9cffff640 1 --2- 172.21.15.148:0/3623059689 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556529393980 0x5565293b1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:27:31.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.319+0000 7fc9d7fff640 1 --2- 172.21.15.148:0/3623059689 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55652939e240 0x5565293b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:27:31.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.319+0000 7fc9d77fe640 1 --2- 172.21.15.148:0/3623059689 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556529393060 0x5565293b19d0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fc9c8012e90 tx=0x7fc9c800fea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6858be54930df534 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:31.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.319+0000 7fc9b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:27:31.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.320+0000 7fc9b6ffd640 1 -- 172.21.15.148:0/3623059689 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c80b9020 con 0x556529393060 2024-09-19T07:27:31.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.320+0000 7fc9b6ffd640 1 -- 172.21.15.148:0/3623059689 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8600+0+0 (secure 0 0 0) 0x7fc9c800fb30 con 0x556529393060 2024-09-19T07:27:31.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.320+0000 7fc9e0627740 1 -- 172.21.15.148:0/3623059689 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9d0020040 con 0x556529393060 2024-09-19T07:27:31.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.320+0000 7fc9b6ffd640 1 -- 172.21.15.148:0/3623059689 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7fc9c80b5060 con 0x556529393060 2024-09-19T07:27:31.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.320+0000 7fc9e0627740 10 client.17754 fetch_fsmap learned FSMap version 55 2024-09-19T07:27:31.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.320+0000 7fc9e0627740 1 -- 172.21.15.148:0/3623059689 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x5565294191a0 con 0x556529393060 2024-09-19T07:27:31.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.320+0000 7fc9b6ffd640 1 -- 172.21.15.148:0/3623059689 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9d0020040 con 0x556529393060 2024-09-19T07:27:31.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.320+0000 7fc9b6ffd640 1 -- 172.21.15.148:0/3623059689 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 55) ==== 8370+0+0 (secure 0 0 0) 0x7fc9c80ac130 con 0x556529393060 2024-09-19T07:27:31.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.320+0000 7fc9e0627740 10 client.17754 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T07:27:31.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.320+0000 7fc9e0627740 10 client.17754 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:27:31.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.320+0000 7fc9e0627740 20 client.17754 populate_metadata read hostname 'smithi148' 2024-09-19T07:27:31.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.320+0000 7fc9e0627740 1 --2- 172.21.15.148:0/3623059689 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5565294196a0 0x55652941bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:31.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.320+0000 7fc9e0627740 4 client.17754 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "ecadb53f", "release": true, "await": true}] 2024-09-19T07:27:31.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.320+0000 7fc9e0627740 1 -- 172.21.15.148:0/3623059689 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "quiesce db", "set_id": "ecadb53f", "release": true, "await": true}) -- 0x5565293000a0 con 0x5565294196a0 2024-09-19T07:27:31.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.320+0000 7fc9cffff640 1 --2- 172.21.15.148:0/3623059689 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5565294196a0 0x55652941bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:31.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.321+0000 7fc9cffff640 1 --2- 172.21.15.148:0/3623059689 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5565294196a0 0x55652941bac0 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48be9d4e9199f568 server_cookie=8b7275bee15920cb in_seq=0 out_seq=0 2024-09-19T07:27:31.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:31.321+0000 7fc9b6ffd640 10 client.17754 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:27:32.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:32.167+0000 7fc9b6ffd640 1 -- 172.21.15.148:0/3623059689 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5565293000a0 con 0x5565294196a0 2024-09-19T07:27:32.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:32.167+0000 7fc9b6ffd640 10 client.17754 handle_command_reply: tid=0 2024-09-19T07:27:32.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:32.167+0000 7fc9e0627740 1 client.17754 shutdown 2024-09-19T07:27:32.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:32.168+0000 7fc9e0627740 1 -- 172.21.15.148:0/3623059689 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556529393060 msgr2=0x5565293b19d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:32.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:32.168+0000 7fc9e0627740 1 --2- 172.21.15.148:0/3623059689 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556529393060 0x5565293b19d0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fc9c8012e90 tx=0x7fc9c800fea0 comp rx=0 tx=0).stop 2024-09-19T07:27:32.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:32.168+0000 7fc9e0627740 1 -- 172.21.15.148:0/3623059689 shutdown_connections 2024-09-19T07:27:32.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:32.168+0000 7fc9e0627740 1 --2- 172.21.15.148:0/3623059689 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5565294196a0 0x55652941bac0 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:32.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:32.168+0000 7fc9e0627740 1 --2- 172.21.15.148:0/3623059689 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55652939e240 0x5565293b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:32.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:32.168+0000 7fc9e0627740 1 --2- 172.21.15.148:0/3623059689 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556529393980 0x5565293b1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:32.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:32.168+0000 7fc9e0627740 1 --2- 172.21.15.148:0/3623059689 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556529393060 0x5565293b19d0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:32.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:32.168+0000 7fc9e0627740 1 -- 172.21.15.148:0/3623059689 >> 172.21.15.148:0/3623059689 conn(0x55652938f5f0 msgr2=0x55652938e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:32.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:32.168+0000 7fc9b6ffd640 0 client.17754 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:27:32.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:32.168+0000 7fc9e0627740 1 -- 172.21.15.148:0/3623059689 shutdown_connections 2024-09-19T07:27:32.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:32.168+0000 7fc9e0627740 1 -- 172.21.15.148:0/3623059689 wait complete. 2024-09-19T07:27:32.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:32.168+0000 7fc9e0627740 20 client.17754 trim_cache size 0 max 16384 2024-09-19T07:27:32.170 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:27:32.171 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 55, 2024-09-19T07:27:32.171 INFO:teuthology.orchestra.run.smithi148.stdout: "leader": 24457, 2024-09-19T07:27:32.171 INFO:teuthology.orchestra.run.smithi148.stdout: "set_version": 56, 2024-09-19T07:27:32.171 INFO:teuthology.orchestra.run.smithi148.stdout: "sets": { 2024-09-19T07:27:32.171 INFO:teuthology.orchestra.run.smithi148.stdout: "ecadb53f": { 2024-09-19T07:27:32.171 INFO:teuthology.orchestra.run.smithi148.stdout: "version": 56, 2024-09-19T07:27:32.171 INFO:teuthology.orchestra.run.smithi148.stdout: "age_ref": 0.0, 2024-09-19T07:27:32.171 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:27:32.171 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RELEASED", 2024-09-19T07:27:32.171 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:27:32.171 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:27:32.171 INFO:teuthology.orchestra.run.smithi148.stdout: "timeout": 90.0, 2024-09-19T07:27:32.171 INFO:teuthology.orchestra.run.smithi148.stdout: "expiration": 149.4, 2024-09-19T07:27:32.172 INFO:teuthology.orchestra.run.smithi148.stdout: "members": { 2024-09-19T07:27:32.172 INFO:teuthology.orchestra.run.smithi148.stdout: "file:/": { 2024-09-19T07:27:32.172 INFO:teuthology.orchestra.run.smithi148.stdout: "excluded": false, 2024-09-19T07:27:32.172 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:27:32.172 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RELEASED", 2024-09-19T07:27:32.172 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:27:32.172 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:27:32.172 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:27:32.172 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:27:32.172 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:27:32.172 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:27:32.172 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:27:32.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:32.169+0000 7fc9de24e640 1 -- 172.21.15.148:0/4187341223 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc9c40a33b0 msgr2=0x7fc9c40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:32.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:32.169+0000 7fc9de24e640 1 --2- 172.21.15.148:0/4187341223 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc9c40a33b0 0x7fc9c40a5870 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc9d0014400 tx=0x7fc9d0014800 comp rx=0 tx=0).stop 2024-09-19T07:27:32.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:32.169+0000 7fc9de24e640 1 -- 172.21.15.148:0/4187341223 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9d8101de0 msgr2=0x7fc9d8198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:32.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:32.169+0000 7fc9de24e640 1 --2- 172.21.15.148:0/4187341223 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9d8101de0 0x7fc9d8198420 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fc9c800c920 tx=0x7fc9c800cde0 comp rx=0 tx=0).stop 2024-09-19T07:27:32.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:32.169+0000 7fc9de24e640 1 -- 172.21.15.148:0/4187341223 shutdown_connections 2024-09-19T07:27:32.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:32.169+0000 7fc9de24e640 1 --2- 172.21.15.148:0/4187341223 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc9c40a33b0 0x7fc9c40a5870 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:32.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:32.169+0000 7fc9de24e640 1 --2- 172.21.15.148:0/4187341223 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9d8106f10 0x7fc9d819ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:32.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:32.169+0000 7fc9de24e640 1 --2- 172.21.15.148:0/4187341223 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9d8102790 0x7fc9d8198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:32.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:32.169+0000 7fc9de24e640 1 --2- 172.21.15.148:0/4187341223 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9d8101de0 0x7fc9d8198420 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:32.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:32.169+0000 7fc9de24e640 1 -- 172.21.15.148:0/4187341223 >> 172.21.15.148:0/4187341223 conn(0x7fc9d80fd8c0 msgr2=0x7fc9d80fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:32.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:32.170+0000 7fc9de24e640 1 -- 172.21.15.148:0/4187341223 shutdown_connections 2024-09-19T07:27:32.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:27:32.170+0000 7fc9de24e640 1 -- 172.21.15.148:0/4187341223 wait complete. 2024-09-19T07:27:32.973 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:27:32 smithi148 ceph-mon[31180]: pgmap v517: 97 pgs: 97 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 KiB/s wr, 9 op/s 2024-09-19T07:27:33.001 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'ecadb53f', total seconds elapsed: 33.8 2024-09-19T07:27:33.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:27:32 smithi179 ceph-mon[35716]: pgmap v517: 97 pgs: 97 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 KiB/s wr, 9 op/s 2024-09-19T07:27:33.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:27:32 smithi165 ceph-mon[35326]: pgmap v517: 97 pgs: 97 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 KiB/s wr, 9 op/s 2024-09-19T07:27:34.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:27:34 smithi179 ceph-mon[35716]: osdmap e102: 12 total, 12 up, 12 in 2024-09-19T07:27:34.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:27:34 smithi179 ceph-mon[35716]: pgmap v519: 97 pgs: 97 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 8 op/s 2024-09-19T07:27:34.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:27:34 smithi148 ceph-mon[31180]: osdmap e102: 12 total, 12 up, 12 in 2024-09-19T07:27:34.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:27:34 smithi148 ceph-mon[31180]: pgmap v519: 97 pgs: 97 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 8 op/s 2024-09-19T07:27:34.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:27:34 smithi165 ceph-mon[35326]: osdmap e102: 12 total, 12 up, 12 in 2024-09-19T07:27:34.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:27:34 smithi165 ceph-mon[35326]: pgmap v519: 97 pgs: 97 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 8 op/s 2024-09-19T07:27:36.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:27:36 smithi165 ceph-mon[35326]: pgmap v520: 97 pgs: 97 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 466 KiB/s wr, 79 op/s 2024-09-19T07:27:37.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:27:36 smithi179 ceph-mon[35716]: pgmap v520: 97 pgs: 97 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 466 KiB/s wr, 79 op/s 2024-09-19T07:27:37.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:27:36 smithi148 ceph-mon[31180]: pgmap v520: 97 pgs: 97 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 466 KiB/s wr, 79 op/s 2024-09-19T07:27:38.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:27:38 smithi165 ceph-mon[35326]: pgmap v521: 97 pgs: 97 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 466 KiB/s wr, 79 op/s 2024-09-19T07:27:39.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:27:38 smithi179 ceph-mon[35716]: pgmap v521: 97 pgs: 97 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 466 KiB/s wr, 79 op/s 2024-09-19T07:27:39.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:27:38 smithi148 ceph-mon[31180]: pgmap v521: 97 pgs: 97 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 466 KiB/s wr, 79 op/s 2024-09-19T07:27:39.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:27:39 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:27:40.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:27:39 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:27:40.080 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:27:39 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:27:40.568 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.565+0000 7f7d8efb9640 1 -- 172.21.15.148:0/746942878 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d881069c0 msgr2=0x7f7d88106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:40.568 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.565+0000 7f7d8efb9640 1 --2- 172.21.15.148:0/746942878 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d881069c0 0x7f7d88106da0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c009930 tx=0x7f7d7c02a420 comp rx=0 tx=0).stop 2024-09-19T07:27:40.568 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.566+0000 7f7d8efb9640 1 -- 172.21.15.148:0/746942878 shutdown_connections 2024-09-19T07:27:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.566+0000 7f7d8efb9640 1 --2- 172.21.15.148:0/746942878 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7d88101350 0x7f7d8810d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.566+0000 7f7d8efb9640 1 --2- 172.21.15.148:0/746942878 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d881009b0 0x7f7d88100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.566+0000 7f7d8efb9640 1 --2- 172.21.15.148:0/746942878 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d881069c0 0x7f7d88106da0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.566+0000 7f7d8efb9640 1 -- 172.21.15.148:0/746942878 >> 172.21.15.148:0/746942878 conn(0x7f7d88077990 msgr2=0x7f7d880fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.566+0000 7f7d8efb9640 1 -- 172.21.15.148:0/746942878 shutdown_connections 2024-09-19T07:27:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.566+0000 7f7d8efb9640 1 -- 172.21.15.148:0/746942878 wait complete. 2024-09-19T07:27:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.566+0000 7f7d8efb9640 1 Processor -- start 2024-09-19T07:27:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.566+0000 7f7d8efb9640 1 -- start start 2024-09-19T07:27:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.566+0000 7f7d8efb9640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7d881009b0 0x7f7d881991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.566+0000 7f7d8efb9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d88101350 0x7f7d88199710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.566+0000 7f7d8efb9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d881069c0 0x7f7d881a4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.566+0000 7f7d8efb9640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7d88110e00 con 0x7f7d88101350 2024-09-19T07:27:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.567+0000 7f7d8efb9640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7d88110c80 con 0x7f7d881009b0 2024-09-19T07:27:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.567+0000 7f7d8efb9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7d88110f80 con 0x7f7d881069c0 2024-09-19T07:27:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.567+0000 7f7d87fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d88101350 0x7f7d88199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.567+0000 7f7d8cd55640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7d881009b0 0x7f7d881991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.567+0000 7f7d8cd55640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7d881009b0 0x7f7d881991d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:50946/0 (socket says 172.21.15.148:50946) 2024-09-19T07:27:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.567+0000 7f7d8d556640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d881069c0 0x7f7d881a4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.567+0000 7f7d8cd55640 1 -- 172.21.15.148:0/508674615 learned_addr learned my addr 172.21.15.148:0/508674615 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:27:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.567+0000 7f7d87fff640 1 -- 172.21.15.148:0/508674615 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d881069c0 msgr2=0x7f7d881a4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.567+0000 7f7d87fff640 1 --2- 172.21.15.148:0/508674615 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d881069c0 0x7f7d881a4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.567+0000 7f7d87fff640 1 -- 172.21.15.148:0/508674615 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7d881009b0 msgr2=0x7f7d881991d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.567+0000 7f7d87fff640 1 --2- 172.21.15.148:0/508674615 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7d881009b0 0x7f7d881991d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.567+0000 7f7d87fff640 1 -- 172.21.15.148:0/508674615 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d881a4790 con 0x7f7d88101350 2024-09-19T07:27:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.567+0000 7f7d8cd55640 1 --2- 172.21.15.148:0/508674615 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7d881009b0 0x7f7d881991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:27:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.567+0000 7f7d8d556640 1 --2- 172.21.15.148:0/508674615 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d881069c0 0x7f7d881a4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:27:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.567+0000 7f7d87fff640 1 --2- 172.21.15.148:0/508674615 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d88101350 0x7f7d88199710 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f7d7400e9f0 tx=0x7f7d7400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.567+0000 7f7d85ffb640 1 -- 172.21.15.148:0/508674615 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7400ccc0 con 0x7f7d88101350 2024-09-19T07:27:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.567+0000 7f7d8efb9640 1 -- 172.21.15.148:0/508674615 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d881a4960 con 0x7f7d88101350 2024-09-19T07:27:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.567+0000 7f7d85ffb640 1 -- 172.21.15.148:0/508674615 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d74005020 con 0x7f7d88101350 2024-09-19T07:27:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.567+0000 7f7d85ffb640 1 -- 172.21.15.148:0/508674615 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d740049e0 con 0x7f7d88101350 2024-09-19T07:27:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.568+0000 7f7d8efb9640 1 -- 172.21.15.148:0/508674615 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d881a4e30 con 0x7f7d88101350 2024-09-19T07:27:40.577 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.569+0000 7f7d85ffb640 1 -- 172.21.15.148:0/508674615 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f7d74005560 con 0x7f7d88101350 2024-09-19T07:27:40.577 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.570+0000 7f7d91e26740 1 Processor -- start 2024-09-19T07:27:40.577 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.570+0000 7f7d91e26740 1 -- start start 2024-09-19T07:27:40.577 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.570+0000 7f7d85ffb640 1 --2- 172.21.15.148:0/508674615 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f7d780a3460 0x7f7d780a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:40.577 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.570+0000 7f7d91e26740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5597dfd8daf0 0x5597dfd8ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:40.577 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.570+0000 7f7d91e26740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5597dfd8e410 0x5597dfd98770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:40.577 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.570+0000 7f7d91e26740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5597dfd98cb0 0x5597dfd9b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:40.577 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.570+0000 7f7d91e26740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5597dfcf22f0 con 0x5597dfd8daf0 2024-09-19T07:27:40.577 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.570+0000 7f7d91e26740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5597dfc9a270 con 0x5597dfd8e410 2024-09-19T07:27:40.577 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.570+0000 7f7d91e26740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5597dfcee2b0 con 0x5597dfd98cb0 2024-09-19T07:27:40.577 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.570+0000 7f7d8cd55640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5597dfd8daf0 0x5597dfd8ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.570+0000 7f7d8d556640 1 --2- 172.21.15.148:0/508674615 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f7d780a3460 0x7f7d780a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.570+0000 7f7d8cd55640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5597dfd8daf0 0x5597dfd8ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45934/0 (socket says 172.21.15.148:45934) 2024-09-19T07:27:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.570+0000 7f7d8cd55640 1 -- 172.21.15.148:0/1123233668 learned_addr learned my addr 172.21.15.148:0/1123233668 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:27:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.570+0000 7f7d85ffb640 1 -- 172.21.15.148:0/508674615 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8556+0+0 (secure 0 0 0) 0x7f7d740cfcf0 con 0x7f7d88101350 2024-09-19T07:27:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.570+0000 7f7d87fff640 1 --2- 172.21.15.148:0/1123233668 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5597dfd8e410 0x5597dfd98770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.570+0000 7f7d8d556640 1 --2- 172.21.15.148:0/1123233668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5597dfd98cb0 0x5597dfd9b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.571+0000 7f7d87fff640 1 -- 172.21.15.148:0/1123233668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5597dfd98cb0 msgr2=0x5597dfd9b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.571+0000 7f7d87fff640 1 --2- 172.21.15.148:0/1123233668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5597dfd98cb0 0x5597dfd9b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.571+0000 7f7d87fff640 1 -- 172.21.15.148:0/1123233668 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5597dfd8daf0 msgr2=0x5597dfd8ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.571+0000 7f7d87fff640 1 --2- 172.21.15.148:0/1123233668 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5597dfd8daf0 0x5597dfd8ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.571+0000 7f7d87fff640 1 -- 172.21.15.148:0/1123233668 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597dfc99340 con 0x5597dfd8e410 2024-09-19T07:27:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.571+0000 7f7d8cd55640 1 --2- 172.21.15.148:0/1123233668 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5597dfd8daf0 0x5597dfd8ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:27:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.571+0000 7f7d8d556640 1 --2- 172.21.15.148:0/508674615 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f7d780a3460 0x7f7d780a5920 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7d80009fd0 tx=0x7f7d80012570 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.571+0000 7f7d87fff640 1 --2- 172.21.15.148:0/1123233668 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5597dfd8e410 0x5597dfd98770 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7d740cd3c0 tx=0x7f7d74098320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2717b97c70c8473 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.571+0000 7f7d72ffd640 1 -- 172.21.15.148:0/1123233668 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7401c040 con 0x5597dfd8e410 2024-09-19T07:27:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.571+0000 7f7d72ffd640 1 -- 172.21.15.148:0/1123233668 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d740051d0 con 0x5597dfd8e410 2024-09-19T07:27:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.571+0000 7f7d72ffd640 1 -- 172.21.15.148:0/1123233668 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d740985c0 con 0x5597dfd8e410 2024-09-19T07:27:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.572+0000 7f7d91e26740 1 -- 172.21.15.148:0/1123233668 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5597dfd8e410 msgr2=0x5597dfd98770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.572+0000 7f7d91e26740 1 --2- 172.21.15.148:0/1123233668 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5597dfd8e410 0x5597dfd98770 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7d740cd3c0 tx=0x7f7d74098320 comp rx=0 tx=0).stop 2024-09-19T07:27:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.572+0000 7f7d91e26740 1 -- 172.21.15.148:0/1123233668 shutdown_connections 2024-09-19T07:27:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.572+0000 7f7d91e26740 1 --2- 172.21.15.148:0/1123233668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5597dfd98cb0 0x5597dfd9b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.572+0000 7f7d91e26740 1 --2- 172.21.15.148:0/1123233668 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5597dfd8e410 0x5597dfd98770 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.572+0000 7f7d91e26740 1 --2- 172.21.15.148:0/1123233668 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5597dfd8daf0 0x5597dfd8ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.572+0000 7f7d91e26740 1 -- 172.21.15.148:0/1123233668 >> 172.21.15.148:0/1123233668 conn(0x5597dfd8a060 msgr2=0x5597dfd8a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.572+0000 7f7d91e26740 1 -- 172.21.15.148:0/1123233668 shutdown_connections 2024-09-19T07:27:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.572+0000 7f7d91e26740 1 -- 172.21.15.148:0/1123233668 wait complete. 2024-09-19T07:27:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.572+0000 7f7d91e26740 1 -- start start 2024-09-19T07:27:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.572+0000 7f7d91e26740 1 Processor -- start 2024-09-19T07:27:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.573+0000 7f7d91e26740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5597dfd8daf0 0x5597dfd95c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.573+0000 7f7d91e26740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5597dfd8e410 0x5597dfd96160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.573+0000 7f7d91e26740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5597dfd98cb0 0x5597dfd966a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.573+0000 7f7d91e26740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5597dfd9b880 con 0x5597dfd98cb0 2024-09-19T07:27:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.573+0000 7f7d91e26740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5597dfc7b290 con 0x5597dfd8e410 2024-09-19T07:27:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.573+0000 7f7d91e26740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5597dfd9ba00 con 0x5597dfd8daf0 2024-09-19T07:27:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.573+0000 7f7d91e26740 10 client.0 _ll_register_callbacks cb 0x5597dfcac140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:27:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.573+0000 7f7d8d556640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5597dfd98cb0 0x5597dfd966a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.573+0000 7f7d8d556640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5597dfd98cb0 0x5597dfd966a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45944/0 (socket says 172.21.15.148:45944) 2024-09-19T07:27:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.573+0000 7f7d8cd55640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5597dfd8daf0 0x5597dfd95c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.573+0000 7f7d8d556640 1 -- 172.21.15.148:0/2786983751 learned_addr learned my addr 172.21.15.148:0/2786983751 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:27:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.573+0000 7f7d87fff640 1 --2- 172.21.15.148:0/2786983751 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5597dfd8e410 0x5597dfd96160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.573+0000 7f7d8d556640 1 -- 172.21.15.148:0/2786983751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5597dfd8daf0 msgr2=0x5597dfd95c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.573+0000 7f7d8d556640 1 --2- 172.21.15.148:0/2786983751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5597dfd8daf0 0x5597dfd95c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.573+0000 7f7d8d556640 1 -- 172.21.15.148:0/2786983751 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5597dfd8e410 msgr2=0x5597dfd96160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.573+0000 7f7d8d556640 1 --2- 172.21.15.148:0/2786983751 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5597dfd8e410 0x5597dfd96160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.573+0000 7f7d8d556640 1 -- 172.21.15.148:0/2786983751 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597dfa05210 con 0x5597dfd98cb0 2024-09-19T07:27:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.573+0000 7f7d8d556640 1 --2- 172.21.15.148:0/2786983751 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5597dfd98cb0 0x5597dfd966a0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f7d80012ab0 tx=0x7f7d8001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c16e9752016a0a9b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.573+0000 7f7d67fff640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:27:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.574+0000 7f7d67fff640 1 -- 172.21.15.148:0/2786983751 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d80020790 con 0x5597dfd98cb0 2024-09-19T07:27:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.574+0000 7f7d91e26740 1 -- 172.21.15.148:0/2786983751 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d740051d0 con 0x5597dfd98cb0 2024-09-19T07:27:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.574+0000 7f7d67fff640 1 -- 172.21.15.148:0/2786983751 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8556+0+0 (secure 0 0 0) 0x7f7d80020930 con 0x5597dfd98cb0 2024-09-19T07:27:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.574+0000 7f7d67fff640 1 -- 172.21.15.148:0/2786983751 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f7d80020b30 con 0x5597dfd98cb0 2024-09-19T07:27:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.574+0000 7f7d91e26740 10 client.17766 fetch_fsmap learned FSMap version 55 2024-09-19T07:27:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.574+0000 7f7d91e26740 1 -- 172.21.15.148:0/2786983751 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x5597dfad1620 con 0x5597dfd98cb0 2024-09-19T07:27:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.574+0000 7f7d67fff640 1 -- 172.21.15.148:0/2786983751 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d740051d0 con 0x5597dfd98cb0 2024-09-19T07:27:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.574+0000 7f7d67fff640 1 -- 172.21.15.148:0/2786983751 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 55) ==== 8370+0+0 (secure 0 0 0) 0x7f7d8001f070 con 0x5597dfd98cb0 2024-09-19T07:27:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.574+0000 7f7d91e26740 10 client.17766 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T07:27:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.574+0000 7f7d91e26740 10 client.17766 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:27:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.574+0000 7f7d91e26740 20 client.17766 populate_metadata read hostname 'smithi148' 2024-09-19T07:27:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.574+0000 7f7d91e26740 1 --2- 172.21.15.148:0/2786983751 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5597dfda8cc0 0x5597dfdab0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.574+0000 7f7d91e26740 4 client.17766 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:27:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.574+0000 7f7d91e26740 1 -- 172.21.15.148:0/2786983751 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5597dfcffa20 con 0x5597dfda8cc0 2024-09-19T07:27:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.574+0000 7f7d8cd55640 1 --2- 172.21.15.148:0/2786983751 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5597dfda8cc0 0x5597dfdab0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.575+0000 7f7d67fff640 10 client.17766 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:27:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.575+0000 7f7d8cd55640 1 --2- 172.21.15.148:0/2786983751 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5597dfda8cc0 0x5597dfdab0f0 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88b9ad12093e94fe server_cookie=a28bf21e995c4c3d in_seq=0 out_seq=0 2024-09-19T07:27:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.576+0000 7f7d67fff640 1 -- 172.21.15.148:0/2786983751 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5597dfcffa20 con 0x5597dfda8cc0 2024-09-19T07:27:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.576+0000 7f7d67fff640 10 client.17766 handle_command_reply: tid=0 2024-09-19T07:27:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.576+0000 7f7d91e26740 1 client.17766 shutdown 2024-09-19T07:27:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.576+0000 7f7d91e26740 1 -- 172.21.15.148:0/2786983751 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5597dfd98cb0 msgr2=0x5597dfd966a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.576+0000 7f7d91e26740 1 --2- 172.21.15.148:0/2786983751 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5597dfd98cb0 0x5597dfd966a0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f7d80012ab0 tx=0x7f7d8001c000 comp rx=0 tx=0).stop 2024-09-19T07:27:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.576+0000 7f7d91e26740 1 -- 172.21.15.148:0/2786983751 shutdown_connections 2024-09-19T07:27:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.576+0000 7f7d91e26740 1 --2- 172.21.15.148:0/2786983751 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5597dfda8cc0 0x5597dfdab0f0 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.576+0000 7f7d91e26740 1 --2- 172.21.15.148:0/2786983751 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5597dfd98cb0 0x5597dfd966a0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.576+0000 7f7d91e26740 1 --2- 172.21.15.148:0/2786983751 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5597dfd8e410 0x5597dfd96160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.576+0000 7f7d67fff640 0 client.17766 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:27:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.576+0000 7f7d91e26740 1 --2- 172.21.15.148:0/2786983751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5597dfd8daf0 0x5597dfd95c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.576+0000 7f7d91e26740 1 -- 172.21.15.148:0/2786983751 >> 172.21.15.148:0/2786983751 conn(0x5597dfd8a060 msgr2=0x5597dfd8fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.576+0000 7f7d91e26740 1 -- 172.21.15.148:0/2786983751 shutdown_connections 2024-09-19T07:27:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.576+0000 7f7d91e26740 1 -- 172.21.15.148:0/2786983751 wait complete. 2024-09-19T07:27:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.576+0000 7f7d91e26740 20 client.17766 trim_cache size 0 max 16384 2024-09-19T07:27:40.603 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.601+0000 7f7d91e26740 1 Processor -- start 2024-09-19T07:27:40.603 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.601+0000 7f7d91e26740 1 -- start start 2024-09-19T07:27:40.603 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.601+0000 7f7d91e26740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5597dfd8daf0 0x5597dfd905b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:40.603 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.601+0000 7f7d91e26740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5597dfd8e410 0x5597dfd964d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:40.603 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.601+0000 7f7d91e26740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5597dfd98cb0 0x5597dfdb0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:40.603 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.601+0000 7f7d91e26740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7d881b0180 con 0x5597dfd8daf0 2024-09-19T07:27:40.603 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.601+0000 7f7d91e26740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7d881ad990 con 0x5597dfd8e410 2024-09-19T07:27:40.603 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.601+0000 7f7d91e26740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7d881ab800 con 0x5597dfd98cb0 2024-09-19T07:27:40.603 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.602+0000 7f7d8cd55640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5597dfd8daf0 0x5597dfd905b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:40.603 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.602+0000 7f7d8cd55640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5597dfd8daf0 0x5597dfd905b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45958/0 (socket says 172.21.15.148:45958) 2024-09-19T07:27:40.603 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.602+0000 7f7d8d556640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5597dfd98cb0 0x5597dfdb0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:40.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.602+0000 7f7d8cd55640 1 -- 172.21.15.148:0/3421038793 learned_addr learned my addr 172.21.15.148:0/3421038793 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:27:40.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.602+0000 7f7d87fff640 1 --2- 172.21.15.148:0/3421038793 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5597dfd8e410 0x5597dfd964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:40.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.602+0000 7f7d8cd55640 1 -- 172.21.15.148:0/3421038793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5597dfd98cb0 msgr2=0x5597dfdb0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:40.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.602+0000 7f7d8cd55640 1 --2- 172.21.15.148:0/3421038793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5597dfd98cb0 0x5597dfdb0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.602+0000 7f7d8cd55640 1 -- 172.21.15.148:0/3421038793 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5597dfd8e410 msgr2=0x5597dfd964d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:40.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.602+0000 7f7d8cd55640 1 --2- 172.21.15.148:0/3421038793 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5597dfd8e410 0x5597dfd964d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.602+0000 7f7d8cd55640 1 -- 172.21.15.148:0/3421038793 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597dfdab770 con 0x5597dfd8daf0 2024-09-19T07:27:40.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.602+0000 7f7d8cd55640 1 --2- 172.21.15.148:0/3421038793 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5597dfd8daf0 0x5597dfd905b0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c009230 tx=0x7f7d7c032ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34e4780d337a55f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:40.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.602+0000 7f7d727fc640 1 -- 172.21.15.148:0/3421038793 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c035040 con 0x5597dfd8daf0 2024-09-19T07:27:40.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.602+0000 7f7d727fc640 1 -- 172.21.15.148:0/3421038793 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d7c005520 con 0x5597dfd8daf0 2024-09-19T07:27:40.604 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.602+0000 7f7d727fc640 1 -- 172.21.15.148:0/3421038793 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c004d60 con 0x5597dfd8daf0 2024-09-19T07:27:40.608 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.603+0000 7f7d91e26740 1 -- 172.21.15.148:0/3421038793 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5597dfd8daf0 msgr2=0x5597dfd905b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:40.608 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.603+0000 7f7d91e26740 1 --2- 172.21.15.148:0/3421038793 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5597dfd8daf0 0x5597dfd905b0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c009230 tx=0x7f7d7c032ab0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.608 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.603+0000 7f7d91e26740 1 -- 172.21.15.148:0/3421038793 shutdown_connections 2024-09-19T07:27:40.608 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.603+0000 7f7d91e26740 1 --2- 172.21.15.148:0/3421038793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5597dfd98cb0 0x5597dfdb0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.608 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.603+0000 7f7d91e26740 1 --2- 172.21.15.148:0/3421038793 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5597dfd8e410 0x5597dfd964d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.608 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.603+0000 7f7d91e26740 1 --2- 172.21.15.148:0/3421038793 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5597dfd8daf0 0x5597dfd905b0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.608 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.603+0000 7f7d91e26740 1 -- 172.21.15.148:0/3421038793 >> 172.21.15.148:0/3421038793 conn(0x5597dfd8a060 msgr2=0x5597dfd97ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:40.608 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.603+0000 7f7d91e26740 1 -- 172.21.15.148:0/3421038793 shutdown_connections 2024-09-19T07:27:40.608 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.603+0000 7f7d91e26740 1 -- 172.21.15.148:0/3421038793 wait complete. 2024-09-19T07:27:40.608 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.603+0000 7f7d91e26740 1 -- start start 2024-09-19T07:27:40.608 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.604+0000 7f7d91e26740 1 Processor -- start 2024-09-19T07:27:40.608 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.604+0000 7f7d91e26740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5597dfd8daf0 0x5597dfda1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:40.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.604+0000 7f7d91e26740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5597dfd8e410 0x5597dfd9c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:40.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.604+0000 7f7d91e26740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5597dfd98cb0 0x5597dfd9d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:40.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.604+0000 7f7d91e26740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7d881abe50 con 0x5597dfd98cb0 2024-09-19T07:27:40.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.604+0000 7f7d91e26740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7d881ad2c0 con 0x5597dfd8e410 2024-09-19T07:27:40.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.604+0000 7f7d91e26740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7d881ac520 con 0x5597dfd8daf0 2024-09-19T07:27:40.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.604+0000 7f7d91e26740 10 client.0 _ll_register_callbacks cb 0x7f7d800127a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:27:40.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.604+0000 7f7d8cd55640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5597dfd8daf0 0x5597dfda1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:40.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.604+0000 7f7d8d556640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5597dfd98cb0 0x5597dfd9d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:40.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.604+0000 7f7d8cd55640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5597dfd8daf0 0x5597dfda1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:51180/0 (socket says 172.21.15.148:51180) 2024-09-19T07:27:40.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.604+0000 7f7d8cd55640 1 -- 172.21.15.148:0/246561278 learned_addr learned my addr 172.21.15.148:0/246561278 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:27:40.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.604+0000 7f7d87fff640 1 --2- 172.21.15.148:0/246561278 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5597dfd8e410 0x5597dfd9c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:40.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.604+0000 7f7d8cd55640 1 -- 172.21.15.148:0/246561278 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5597dfd8e410 msgr2=0x5597dfd9c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:40.609 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.604+0000 7f7d8cd55640 1 --2- 172.21.15.148:0/246561278 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5597dfd8e410 0x5597dfd9c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.604+0000 7f7d8cd55640 1 -- 172.21.15.148:0/246561278 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5597dfd98cb0 msgr2=0x5597dfd9d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:40.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.604+0000 7f7d8cd55640 1 --2- 172.21.15.148:0/246561278 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5597dfd98cb0 0x5597dfd9d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.604+0000 7f7d8cd55640 1 -- 172.21.15.148:0/246561278 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597dfd852d0 con 0x5597dfd8daf0 2024-09-19T07:27:40.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.605+0000 7f7d8cd55640 1 --2- 172.21.15.148:0/246561278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5597dfd8daf0 0x5597dfda1550 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c009610 tx=0x7f7d7c02a420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92a5f3afcfade2d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:40.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.605+0000 7f7d67fff640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-19T07:27:40.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.605+0000 7f7d67fff640 1 -- 172.21.15.148:0/246561278 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c058020 con 0x5597dfd8daf0 2024-09-19T07:27:40.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.605+0000 7f7d67fff640 1 -- 172.21.15.148:0/246561278 <== mon.1 v2:172.21.15.179:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8556+0+0 (secure 0 0 0) 0x7f7d7c031be0 con 0x5597dfd8daf0 2024-09-19T07:27:40.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.605+0000 7f7d91e26740 1 -- 172.21.15.148:0/246561278 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d7c005520 con 0x5597dfd8daf0 2024-09-19T07:27:40.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.605+0000 7f7d67fff640 1 -- 172.21.15.148:0/246561278 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f7d7c063050 con 0x5597dfd8daf0 2024-09-19T07:27:40.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.605+0000 7f7d91e26740 10 client.26890 fetch_fsmap learned FSMap version 55 2024-09-19T07:27:40.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.605+0000 7f7d91e26740 1 -- 172.21.15.148:0/246561278 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x5597dfd89e90 con 0x5597dfd8daf0 2024-09-19T07:27:40.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.605+0000 7f7d67fff640 1 -- 172.21.15.148:0/246561278 <== mon.1 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d7c005520 con 0x5597dfd8daf0 2024-09-19T07:27:40.610 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.605+0000 7f7d67fff640 1 -- 172.21.15.148:0/246561278 <== mon.1 v2:172.21.15.179:3300/0 5 ==== fsmap(e 55) ==== 8370+0+0 (secure 0 0 0) 0x7f7d7c004b70 con 0x5597dfd8daf0 2024-09-19T07:27:40.611 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.605+0000 7f7d91e26740 10 client.26890 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T07:27:40.611 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.605+0000 7f7d91e26740 10 client.26890 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:27:40.611 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.605+0000 7f7d91e26740 20 client.26890 populate_metadata read hostname 'smithi148' 2024-09-19T07:27:40.611 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.605+0000 7f7d91e26740 1 --2- 172.21.15.148:0/246561278 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5597dfe13f60 0x5597dfe16380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:40.611 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.605+0000 7f7d91e26740 4 client.26890 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:27:40.611 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.605+0000 7f7d91e26740 1 -- 172.21.15.148:0/246561278 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5597dfcf9d70 con 0x5597dfe13f60 2024-09-19T07:27:40.611 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.606+0000 7f7d87fff640 1 --2- 172.21.15.148:0/246561278 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5597dfe13f60 0x5597dfe16380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:40.611 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.606+0000 7f7d67fff640 10 client.26890 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:27:40.611 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.606+0000 7f7d87fff640 1 --2- 172.21.15.148:0/246561278 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5597dfe13f60 0x5597dfe16380 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9200f343b0c43d51 server_cookie=90cb22684d55cbc6 in_seq=0 out_seq=0 2024-09-19T07:27:40.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:27:40 smithi165 ceph-mon[35326]: pgmap v522: 97 pgs: 97 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 816 KiB/s rd, 728 KiB/s wr, 113 op/s 2024-09-19T07:27:40.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:27:40 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:27:40.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:27:40 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:27:40.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:27:40 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:27:40.965 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.964+0000 7f7d67fff640 1 -- 172.21.15.148:0/246561278 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5597dfcf9d70 con 0x5597dfe13f60 2024-09-19T07:27:40.965 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.964+0000 7f7d67fff640 10 client.26890 handle_command_reply: tid=0 2024-09-19T07:27:40.965 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.964+0000 7f7d91e26740 1 client.26890 shutdown 2024-09-19T07:27:40.966 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.964+0000 7f7d91e26740 1 -- 172.21.15.148:0/246561278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5597dfd8daf0 msgr2=0x5597dfda1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:40.966 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.964+0000 7f7d91e26740 1 --2- 172.21.15.148:0/246561278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5597dfd8daf0 0x5597dfda1550 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c009610 tx=0x7f7d7c02a420 comp rx=0 tx=0).stop 2024-09-19T07:27:40.966 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.964+0000 7f7d91e26740 1 -- 172.21.15.148:0/246561278 shutdown_connections 2024-09-19T07:27:40.966 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.964+0000 7f7d91e26740 1 --2- 172.21.15.148:0/246561278 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5597dfe13f60 0x5597dfe16380 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.966 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.965+0000 7f7d91e26740 1 --2- 172.21.15.148:0/246561278 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5597dfd98cb0 0x5597dfd9d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.966 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.965+0000 7f7d91e26740 1 --2- 172.21.15.148:0/246561278 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5597dfd8e410 0x5597dfd9c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.966 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.965+0000 7f7d91e26740 1 --2- 172.21.15.148:0/246561278 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5597dfd8daf0 0x5597dfda1550 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.966 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.965+0000 7f7d91e26740 1 -- 172.21.15.148:0/246561278 >> 172.21.15.148:0/246561278 conn(0x5597dfd8a060 msgr2=0x5597dfd889a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:40.966 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.965+0000 7f7d67fff640 0 client.26890 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:27:40.966 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.965+0000 7f7d91e26740 1 -- 172.21.15.148:0/246561278 shutdown_connections 2024-09-19T07:27:40.966 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.965+0000 7f7d91e26740 1 -- 172.21.15.148:0/246561278 wait complete. 2024-09-19T07:27:40.966 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.965+0000 7f7d91e26740 20 client.26890 trim_cache size 0 max 16384 2024-09-19T07:27:40.967 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:27:40.967 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:27:40.967 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:27:40.967 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:27:40.968 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.966+0000 7f7d8efb9640 1 -- 172.21.15.148:0/508674615 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f7d780a3460 msgr2=0x7f7d780a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:40.968 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.966+0000 7f7d8efb9640 1 --2- 172.21.15.148:0/508674615 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f7d780a3460 0x7f7d780a5920 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7d80009fd0 tx=0x7f7d80012570 comp rx=0 tx=0).stop 2024-09-19T07:27:40.968 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.966+0000 7f7d8efb9640 1 -- 172.21.15.148:0/508674615 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d88101350 msgr2=0x7f7d88199710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:40.968 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.966+0000 7f7d8efb9640 1 --2- 172.21.15.148:0/508674615 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d88101350 0x7f7d88199710 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f7d7400e9f0 tx=0x7f7d7400eeb0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.968 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.966+0000 7f7d8efb9640 1 -- 172.21.15.148:0/508674615 shutdown_connections 2024-09-19T07:27:40.968 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.966+0000 7f7d8efb9640 1 --2- 172.21.15.148:0/508674615 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f7d780a3460 0x7f7d780a5920 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.968 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.966+0000 7f7d8efb9640 1 --2- 172.21.15.148:0/508674615 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d881069c0 0x7f7d881a4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.968 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.966+0000 7f7d8efb9640 1 --2- 172.21.15.148:0/508674615 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d88101350 0x7f7d88199710 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.968 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.966+0000 7f7d8efb9640 1 --2- 172.21.15.148:0/508674615 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7d881009b0 0x7f7d881991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.968 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.966+0000 7f7d8efb9640 1 -- 172.21.15.148:0/508674615 >> 172.21.15.148:0/508674615 conn(0x7f7d88077990 msgr2=0x7f7d88103750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:40.969 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.966+0000 7f7d8efb9640 1 -- 172.21.15.148:0/508674615 shutdown_connections 2024-09-19T07:27:40.969 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:40.966+0000 7f7d8efb9640 1 -- 172.21.15.148:0/508674615 wait complete. 2024-09-19T07:27:41.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:27:40 smithi179 ceph-mon[35716]: pgmap v522: 97 pgs: 97 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 816 KiB/s rd, 728 KiB/s wr, 113 op/s 2024-09-19T07:27:41.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:27:40 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:27:41.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:27:40 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:27:41.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:27:40 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:27:41.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:27:40 smithi148 ceph-mon[31180]: pgmap v522: 97 pgs: 97 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 816 KiB/s rd, 728 KiB/s wr, 113 op/s 2024-09-19T07:27:41.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:27:40 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:27:41.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:27:40 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:27:41.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:27:40 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:27:42.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:27:42 smithi165 ceph-mon[35326]: pgmap v523: 97 pgs: 97 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 250 op/s 2024-09-19T07:27:43.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:27:42 smithi179 ceph-mon[35716]: pgmap v523: 97 pgs: 97 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 250 op/s 2024-09-19T07:27:43.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:27:42 smithi148 ceph-mon[31180]: pgmap v523: 97 pgs: 97 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 250 op/s 2024-09-19T07:27:44.886 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:27:44 smithi165 ceph-mon[35326]: pgmap v524: 97 pgs: 97 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 265 op/s 2024-09-19T07:27:45.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:27:44 smithi179 ceph-mon[35716]: pgmap v524: 97 pgs: 97 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 265 op/s 2024-09-19T07:27:45.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:27:44 smithi148 ceph-mon[31180]: pgmap v524: 97 pgs: 97 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 265 op/s 2024-09-19T07:27:46.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:27:46 smithi165 ceph-mon[35326]: pgmap v525: 97 pgs: 97 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 418 op/s 2024-09-19T07:27:46.884 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:27:46 smithi148 ceph-mon[31180]: pgmap v525: 97 pgs: 97 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 418 op/s 2024-09-19T07:27:47.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:27:46 smithi179 ceph-mon[35716]: pgmap v525: 97 pgs: 97 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 418 op/s 2024-09-19T07:27:48.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:27:48 smithi165 ceph-mon[35326]: pgmap v526: 97 pgs: 97 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 356 op/s 2024-09-19T07:27:49.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:27:48 smithi179 ceph-mon[35716]: pgmap v526: 97 pgs: 97 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 356 op/s 2024-09-19T07:27:49.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:27:48 smithi148 ceph-mon[31180]: pgmap v526: 97 pgs: 97 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 356 op/s 2024-09-19T07:27:50.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:27:50 smithi165 ceph-mon[35326]: pgmap v527: 97 pgs: 97 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 390 op/s 2024-09-19T07:27:51.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:27:50 smithi179 ceph-mon[35716]: pgmap v527: 97 pgs: 97 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 390 op/s 2024-09-19T07:27:51.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:27:50 smithi148 ceph-mon[31180]: pgmap v527: 97 pgs: 97 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 390 op/s 2024-09-19T07:27:52.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:27:52 smithi165 ceph-mon[35326]: pgmap v528: 97 pgs: 97 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.2 MiB/s wr, 479 op/s 2024-09-19T07:27:53.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:27:52 smithi179 ceph-mon[35716]: pgmap v528: 97 pgs: 97 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.2 MiB/s wr, 479 op/s 2024-09-19T07:27:53.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:27:52 smithi148 ceph-mon[31180]: pgmap v528: 97 pgs: 97 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.2 MiB/s wr, 479 op/s 2024-09-19T07:27:54.062 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.061+0000 7f4e6a427640 1 -- 172.21.15.148:0/863355040 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e64107b70 msgr2=0x7f4e64107f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:54.063 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.061+0000 7f4e6a427640 1 --2- 172.21.15.148:0/863355040 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e64107b70 0x7f4e64107f50 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f4e54009930 tx=0x7f4e5402a420 comp rx=0 tx=0).stop 2024-09-19T07:27:54.063 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.062+0000 7f4e6a427640 1 -- 172.21.15.148:0/863355040 shutdown_connections 2024-09-19T07:27:54.063 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.062+0000 7f4e6a427640 1 --2- 172.21.15.148:0/863355040 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e64102470 0x7f4e6410e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:54.063 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.062+0000 7f4e6a427640 1 --2- 172.21.15.148:0/863355040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e64101ad0 0x7f4e64101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:54.063 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.062+0000 7f4e6a427640 1 --2- 172.21.15.148:0/863355040 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e64107b70 0x7f4e64107f50 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:54.063 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.062+0000 7f4e6a427640 1 -- 172.21.15.148:0/863355040 >> 172.21.15.148:0/863355040 conn(0x7f4e640fd7d0 msgr2=0x7f4e640ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:54.063 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.062+0000 7f4e6a427640 1 -- 172.21.15.148:0/863355040 shutdown_connections 2024-09-19T07:27:54.063 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.062+0000 7f4e6a427640 1 -- 172.21.15.148:0/863355040 wait complete. 2024-09-19T07:27:54.063 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.062+0000 7f4e6a427640 1 Processor -- start 2024-09-19T07:27:54.063 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.062+0000 7f4e6a427640 1 -- start start 2024-09-19T07:27:54.065 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.063+0000 7f4e6a427640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e64101ad0 0x7f4e64198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:54.065 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.063+0000 7f4e6a427640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e64102470 0x7f4e641988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:54.065 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.063+0000 7f4e6a427640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e64107b70 0x7f4e6419cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:54.065 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.063+0000 7f4e6a427640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4e64111f20 con 0x7f4e64107b70 2024-09-19T07:27:54.065 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.063+0000 7f4e6a427640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4e64111da0 con 0x7f4e64102470 2024-09-19T07:27:54.065 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.063+0000 7f4e6a427640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4e641120a0 con 0x7f4e64101ad0 2024-09-19T07:27:54.065 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.063+0000 7f4e689c4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e64107b70 0x7f4e6419cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:54.065 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.063+0000 7f4e63fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e64101ad0 0x7f4e64198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:54.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.063+0000 7f4e689c4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e64107b70 0x7f4e6419cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51500/0 (socket says 172.21.15.148:51500) 2024-09-19T07:27:54.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.063+0000 7f4e637fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e64102470 0x7f4e641988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:54.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.063+0000 7f4e689c4640 1 -- 172.21.15.148:0/3557725769 learned_addr learned my addr 172.21.15.148:0/3557725769 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:27:54.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.063+0000 7f4e689c4640 1 -- 172.21.15.148:0/3557725769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e64101ad0 msgr2=0x7f4e64198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:54.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.063+0000 7f4e689c4640 1 --2- 172.21.15.148:0/3557725769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e64101ad0 0x7f4e64198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:54.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.063+0000 7f4e689c4640 1 -- 172.21.15.148:0/3557725769 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e64102470 msgr2=0x7f4e641988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:54.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.063+0000 7f4e689c4640 1 --2- 172.21.15.148:0/3557725769 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e64102470 0x7f4e641988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:54.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.063+0000 7f4e689c4640 1 -- 172.21.15.148:0/3557725769 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e6419d380 con 0x7f4e64107b70 2024-09-19T07:27:54.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.063+0000 7f4e689c4640 1 --2- 172.21.15.148:0/3557725769 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e64107b70 0x7f4e6419cc50 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c009fd0 tx=0x7f4e5c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:54.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.063+0000 7f4e617fa640 1 -- 172.21.15.148:0/3557725769 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c017070 con 0x7f4e64107b70 2024-09-19T07:27:54.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.063+0000 7f4e617fa640 1 -- 172.21.15.148:0/3557725769 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e5c003e50 con 0x7f4e64107b70 2024-09-19T07:27:54.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.063+0000 7f4e6a427640 1 -- 172.21.15.148:0/3557725769 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e6419d670 con 0x7f4e64107b70 2024-09-19T07:27:54.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.063+0000 7f4e617fa640 1 -- 172.21.15.148:0/3557725769 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c0106c0 con 0x7f4e64107b70 2024-09-19T07:27:54.067 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.063+0000 7f4e6a427640 1 -- 172.21.15.148:0/3557725769 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e641a4f00 con 0x7f4e64107b70 2024-09-19T07:27:54.072 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.066+0000 7f4e617fa640 1 -- 172.21.15.148:0/3557725769 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f4e5c003970 con 0x7f4e64107b70 2024-09-19T07:27:54.073 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.066+0000 7f4e617fa640 1 --2- 172.21.15.148:0/3557725769 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f4e4c0a3460 0x7f4e4c0a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:54.073 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.066+0000 7f4e63fff640 1 --2- 172.21.15.148:0/3557725769 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f4e4c0a3460 0x7f4e4c0a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:54.073 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.066+0000 7f4e6d1c3740 1 Processor -- start 2024-09-19T07:27:54.073 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.066+0000 7f4e617fa640 1 -- 172.21.15.148:0/3557725769 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8556+0+0 (secure 0 0 0) 0x7f4e5c0cf9c0 con 0x7f4e64107b70 2024-09-19T07:27:54.073 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.066+0000 7f4e6d1c3740 1 -- start start 2024-09-19T07:27:54.073 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.067+0000 7f4e6d1c3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b876c38af0 0x55b876c38ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:54.073 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.067+0000 7f4e6d1c3740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b876c39410 0x55b876c43770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:54.073 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.067+0000 7f4e6d1c3740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b876c43cb0 0x55b876c460a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:54.073 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.067+0000 7f4e6d1c3740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55b876b9d2f0 con 0x55b876c43cb0 2024-09-19T07:27:54.073 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.067+0000 7f4e6d1c3740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55b876b45270 con 0x55b876c39410 2024-09-19T07:27:54.073 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.067+0000 7f4e6d1c3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55b876b992b0 con 0x55b876c38af0 2024-09-19T07:27:54.073 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.067+0000 7f4e63fff640 1 --2- 172.21.15.148:0/3557725769 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f4e4c0a3460 0x7f4e4c0a5920 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4e54009900 tx=0x7f4e540058d0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:54.074 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.067+0000 7f4e689c4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b876c43cb0 0x55b876c460a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:54.074 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.067+0000 7f4e63fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b876c38af0 0x55b876c38ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:54.074 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.067+0000 7f4e689c4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b876c43cb0 0x55b876c460a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51512/0 (socket says 172.21.15.148:51512) 2024-09-19T07:27:54.074 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.067+0000 7f4e63fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b876c38af0 0x55b876c38ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:42328/0 (socket says 172.21.15.148:42328) 2024-09-19T07:27:54.074 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.067+0000 7f4e637fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b876c39410 0x55b876c43770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:54.074 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.067+0000 7f4e689c4640 1 -- 172.21.15.148:0/22492328 learned_addr learned my addr 172.21.15.148:0/22492328 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:27:54.074 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.067+0000 7f4e689c4640 1 -- 172.21.15.148:0/22492328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b876c38af0 msgr2=0x55b876c38ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:54.074 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.067+0000 7f4e689c4640 1 --2- 172.21.15.148:0/22492328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b876c38af0 0x55b876c38ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:54.074 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.067+0000 7f4e689c4640 1 -- 172.21.15.148:0/22492328 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b876c39410 msgr2=0x55b876c43770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:54.074 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.067+0000 7f4e689c4640 1 --2- 172.21.15.148:0/22492328 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b876c39410 0x55b876c43770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:54.074 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.067+0000 7f4e689c4640 1 -- 172.21.15.148:0/22492328 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b876b44340 con 0x55b876c43cb0 2024-09-19T07:27:54.074 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.067+0000 7f4e63fff640 1 --2- 172.21.15.148:0/22492328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b876c38af0 0x55b876c38ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:27:54.074 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.067+0000 7f4e689c4640 1 --2- 172.21.15.148:0/22492328 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b876c43cb0 0x55b876c460a0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c098190 tx=0x7f4e5c09b750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a60a0d6323db538 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:54.075 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.067+0000 7f4e4a7fc640 1 -- 172.21.15.148:0/22492328 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c020040 con 0x55b876c43cb0 2024-09-19T07:27:54.075 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.067+0000 7f4e4a7fc640 1 -- 172.21.15.148:0/22492328 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e5c0a0030 con 0x55b876c43cb0 2024-09-19T07:27:54.075 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.067+0000 7f4e4a7fc640 1 -- 172.21.15.148:0/22492328 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c0983a0 con 0x55b876c43cb0 2024-09-19T07:27:54.075 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.068+0000 7f4e6d1c3740 1 -- 172.21.15.148:0/22492328 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b876c43cb0 msgr2=0x55b876c460a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:54.075 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.068+0000 7f4e6d1c3740 1 --2- 172.21.15.148:0/22492328 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b876c43cb0 0x55b876c460a0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c098190 tx=0x7f4e5c09b750 comp rx=0 tx=0).stop 2024-09-19T07:27:54.075 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.068+0000 7f4e6d1c3740 1 -- 172.21.15.148:0/22492328 shutdown_connections 2024-09-19T07:27:54.075 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.068+0000 7f4e6d1c3740 1 --2- 172.21.15.148:0/22492328 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b876c43cb0 0x55b876c460a0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:54.075 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.068+0000 7f4e6d1c3740 1 --2- 172.21.15.148:0/22492328 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b876c39410 0x55b876c43770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:54.075 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.068+0000 7f4e6d1c3740 1 --2- 172.21.15.148:0/22492328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b876c38af0 0x55b876c38ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:54.075 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.068+0000 7f4e6d1c3740 1 -- 172.21.15.148:0/22492328 >> 172.21.15.148:0/22492328 conn(0x55b876c35060 msgr2=0x55b876c35440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:54.075 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.068+0000 7f4e6d1c3740 1 -- 172.21.15.148:0/22492328 shutdown_connections 2024-09-19T07:27:54.075 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.068+0000 7f4e6d1c3740 1 -- 172.21.15.148:0/22492328 wait complete. 2024-09-19T07:27:54.075 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.068+0000 7f4e6d1c3740 1 -- start start 2024-09-19T07:27:54.075 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.069+0000 7f4e6d1c3740 1 Processor -- start 2024-09-19T07:27:54.075 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.069+0000 7f4e6d1c3740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b876c38af0 0x55b876c40c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:54.076 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.069+0000 7f4e6d1c3740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b876c39410 0x55b876c41170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:54.076 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.069+0000 7f4e6d1c3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b876c43cb0 0x55b876c416b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:54.076 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.069+0000 7f4e6d1c3740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55b876c46880 con 0x55b876c39410 2024-09-19T07:27:54.076 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.069+0000 7f4e6d1c3740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55b876b26290 con 0x55b876c38af0 2024-09-19T07:27:54.076 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.069+0000 7f4e6d1c3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55b876c46a00 con 0x55b876c43cb0 2024-09-19T07:27:54.076 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.069+0000 7f4e637fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b876c39410 0x55b876c41170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:54.076 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.069+0000 7f4e6d1c3740 10 client.0 _ll_register_callbacks cb 0x55b876b57140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:27:54.076 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.069+0000 7f4e637fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b876c39410 0x55b876c41170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51526/0 (socket says 172.21.15.148:51526) 2024-09-19T07:27:54.076 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.069+0000 7f4e637fe640 1 -- 172.21.15.148:0/2602158422 learned_addr learned my addr 172.21.15.148:0/2602158422 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:27:54.076 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.069+0000 7f4e63fff640 1 --2- 172.21.15.148:0/2602158422 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b876c38af0 0x55b876c40c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:54.076 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.069+0000 7f4e689c4640 1 --2- 172.21.15.148:0/2602158422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b876c43cb0 0x55b876c416b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:54.076 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.069+0000 7f4e637fe640 1 -- 172.21.15.148:0/2602158422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b876c43cb0 msgr2=0x55b876c416b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:54.076 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.069+0000 7f4e637fe640 1 --2- 172.21.15.148:0/2602158422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b876c43cb0 0x55b876c416b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:54.077 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.069+0000 7f4e637fe640 1 -- 172.21.15.148:0/2602158422 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b876c38af0 msgr2=0x55b876c40c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:54.077 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.069+0000 7f4e637fe640 1 --2- 172.21.15.148:0/2602158422 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b876c38af0 0x55b876c40c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:54.077 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.069+0000 7f4e637fe640 1 -- 172.21.15.148:0/2602158422 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8768b0210 con 0x55b876c39410 2024-09-19T07:27:54.077 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.070+0000 7f4e637fe640 1 --2- 172.21.15.148:0/2602158422 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b876c39410 0x55b876c41170 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f4e5800ba60 tx=0x7f4e5800bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d485eaacf5cfc77e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:54.077 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.070+0000 7f4e437fe640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:27:54.077 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.070+0000 7f4e437fe640 1 -- 172.21.15.148:0/2602158422 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e58005020 con 0x55b876c39410 2024-09-19T07:27:54.077 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.070+0000 7f4e437fe640 1 -- 172.21.15.148:0/2602158422 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8556+0+0 (secure 0 0 0) 0x7f4e580051c0 con 0x55b876c39410 2024-09-19T07:27:54.077 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.070+0000 7f4e6d1c3740 1 -- 172.21.15.148:0/2602158422 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e5c0a0030 con 0x55b876c39410 2024-09-19T07:27:54.077 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.070+0000 7f4e437fe640 1 -- 172.21.15.148:0/2602158422 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f4e580053c0 con 0x55b876c39410 2024-09-19T07:27:54.077 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.070+0000 7f4e6d1c3740 10 client.17784 fetch_fsmap learned FSMap version 55 2024-09-19T07:27:54.077 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.070+0000 7f4e6d1c3740 1 -- 172.21.15.148:0/2602158422 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x55b87697c620 con 0x55b876c39410 2024-09-19T07:27:54.077 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.070+0000 7f4e437fe640 1 -- 172.21.15.148:0/2602158422 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e5c0a0030 con 0x55b876c39410 2024-09-19T07:27:54.078 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.070+0000 7f4e437fe640 1 -- 172.21.15.148:0/2602158422 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 55) ==== 8370+0+0 (secure 0 0 0) 0x7f4e5801b6a0 con 0x55b876c39410 2024-09-19T07:27:54.078 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.070+0000 7f4e6d1c3740 10 client.17784 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T07:27:54.078 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.070+0000 7f4e6d1c3740 10 client.17784 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:27:54.078 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.070+0000 7f4e6d1c3740 20 client.17784 populate_metadata read hostname 'smithi148' 2024-09-19T07:27:54.078 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.070+0000 7f4e6d1c3740 1 --2- 172.21.15.148:0/2602158422 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55b876c53cf0 0x55b876c56130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:54.078 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.070+0000 7f4e6d1c3740 4 client.17784 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:27:54.078 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.070+0000 7f4e6d1c3740 1 -- 172.21.15.148:0/2602158422 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b876baaa20 con 0x55b876c53cf0 2024-09-19T07:27:54.078 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.071+0000 7f4e63fff640 1 --2- 172.21.15.148:0/2602158422 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55b876c53cf0 0x55b876c56130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:54.078 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.071+0000 7f4e63fff640 1 --2- 172.21.15.148:0/2602158422 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55b876c53cf0 0x55b876c56130 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a36586122f1364a server_cookie=ffecdd47afb7a777 in_seq=0 out_seq=0 2024-09-19T07:27:54.078 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.071+0000 7f4e437fe640 10 client.17784 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:27:54.078 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.072+0000 7f4e437fe640 1 -- 172.21.15.148:0/2602158422 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b876baaa20 con 0x55b876c53cf0 2024-09-19T07:27:54.078 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.072+0000 7f4e437fe640 10 client.17784 handle_command_reply: tid=0 2024-09-19T07:27:54.078 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.072+0000 7f4e6d1c3740 1 client.17784 shutdown 2024-09-19T07:27:54.079 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.072+0000 7f4e6d1c3740 1 -- 172.21.15.148:0/2602158422 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b876c39410 msgr2=0x55b876c41170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:54.079 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.072+0000 7f4e6d1c3740 1 --2- 172.21.15.148:0/2602158422 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b876c39410 0x55b876c41170 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f4e5800ba60 tx=0x7f4e5800bf20 comp rx=0 tx=0).stop 2024-09-19T07:27:54.079 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.072+0000 7f4e6d1c3740 1 -- 172.21.15.148:0/2602158422 shutdown_connections 2024-09-19T07:27:54.079 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.072+0000 7f4e6d1c3740 1 --2- 172.21.15.148:0/2602158422 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55b876c53cf0 0x55b876c56130 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:54.079 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.072+0000 7f4e6d1c3740 1 --2- 172.21.15.148:0/2602158422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b876c43cb0 0x55b876c416b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:54.079 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.072+0000 7f4e6d1c3740 1 --2- 172.21.15.148:0/2602158422 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b876c39410 0x55b876c41170 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:54.079 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.072+0000 7f4e6d1c3740 1 --2- 172.21.15.148:0/2602158422 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b876c38af0 0x55b876c40c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:54.079 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.072+0000 7f4e437fe640 0 client.17784 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:27:54.079 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.072+0000 7f4e6d1c3740 1 -- 172.21.15.148:0/2602158422 >> 172.21.15.148:0/2602158422 conn(0x55b876c35060 msgr2=0x55b876c341c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:54.079 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.072+0000 7f4e6d1c3740 1 -- 172.21.15.148:0/2602158422 shutdown_connections 2024-09-19T07:27:54.079 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.072+0000 7f4e6d1c3740 1 -- 172.21.15.148:0/2602158422 wait complete. 2024-09-19T07:27:54.079 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.072+0000 7f4e6d1c3740 20 client.17784 trim_cache size 0 max 16384 2024-09-19T07:27:54.088 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.086+0000 7f4e6d1c3740 1 Processor -- start 2024-09-19T07:27:54.088 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.086+0000 7f4e6d1c3740 1 -- start start 2024-09-19T07:27:54.088 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.086+0000 7f4e6d1c3740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b876c38af0 0x55b876c3b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:54.088 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.086+0000 7f4e6d1c3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b876c39410 0x55b876c414e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:54.088 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.086+0000 7f4e6d1c3740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b876c43cb0 0x55b876c5ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:54.088 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.086+0000 7f4e6d1c3740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4e641b0240 con 0x55b876c43cb0 2024-09-19T07:27:54.088 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.086+0000 7f4e6d1c3740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4e641ada50 con 0x55b876c38af0 2024-09-19T07:27:54.088 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.086+0000 7f4e6d1c3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4e641ab8c0 con 0x55b876c39410 2024-09-19T07:27:54.088 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.087+0000 7f4e689c4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b876c43cb0 0x55b876c5ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:54.088 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.087+0000 7f4e63fff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b876c38af0 0x55b876c3b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:54.088 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.087+0000 7f4e689c4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b876c43cb0 0x55b876c5ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51534/0 (socket says 172.21.15.148:51534) 2024-09-19T07:27:54.088 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.087+0000 7f4e689c4640 1 -- 172.21.15.148:0/3407226737 learned_addr learned my addr 172.21.15.148:0/3407226737 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:27:54.089 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.087+0000 7f4e637fe640 1 --2- 172.21.15.148:0/3407226737 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b876c39410 0x55b876c414e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:54.089 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.087+0000 7f4e689c4640 1 -- 172.21.15.148:0/3407226737 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b876c39410 msgr2=0x55b876c414e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:54.089 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.087+0000 7f4e689c4640 1 --2- 172.21.15.148:0/3407226737 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b876c39410 0x55b876c414e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:54.089 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.087+0000 7f4e689c4640 1 -- 172.21.15.148:0/3407226737 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b876c38af0 msgr2=0x55b876c3b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:54.089 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.087+0000 7f4e689c4640 1 --2- 172.21.15.148:0/3407226737 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b876c38af0 0x55b876c3b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:54.089 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.087+0000 7f4e689c4640 1 -- 172.21.15.148:0/3407226737 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b876c38920 con 0x55b876c43cb0 2024-09-19T07:27:54.089 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.087+0000 7f4e689c4640 1 --2- 172.21.15.148:0/3407226737 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b876c43cb0 0x55b876c5ba40 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c09bcc0 tx=0x7f4e5c09be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45965ef1900e5449 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:54.089 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.087+0000 7f4e49ffb640 1 -- 172.21.15.148:0/3407226737 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c0b9070 con 0x55b876c43cb0 2024-09-19T07:27:54.089 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.087+0000 7f4e49ffb640 1 -- 172.21.15.148:0/3407226737 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e5c003c60 con 0x55b876c43cb0 2024-09-19T07:27:54.089 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.087+0000 7f4e49ffb640 1 -- 172.21.15.148:0/3407226737 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c020040 con 0x55b876c43cb0 2024-09-19T07:27:54.093 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.088+0000 7f4e6d1c3740 1 -- 172.21.15.148:0/3407226737 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b876c43cb0 msgr2=0x55b876c5ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:54.093 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.088+0000 7f4e6d1c3740 1 --2- 172.21.15.148:0/3407226737 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b876c43cb0 0x55b876c5ba40 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c09bcc0 tx=0x7f4e5c09be70 comp rx=0 tx=0).stop 2024-09-19T07:27:54.093 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.088+0000 7f4e6d1c3740 1 -- 172.21.15.148:0/3407226737 shutdown_connections 2024-09-19T07:27:54.093 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.088+0000 7f4e6d1c3740 1 --2- 172.21.15.148:0/3407226737 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b876c43cb0 0x55b876c5ba40 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:54.093 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.088+0000 7f4e6d1c3740 1 --2- 172.21.15.148:0/3407226737 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b876c39410 0x55b876c414e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:54.093 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.088+0000 7f4e6d1c3740 1 --2- 172.21.15.148:0/3407226737 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b876c38af0 0x55b876c3b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:54.093 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.088+0000 7f4e6d1c3740 1 -- 172.21.15.148:0/3407226737 >> 172.21.15.148:0/3407226737 conn(0x55b876c35060 msgr2=0x55b876c42cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:54.093 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.088+0000 7f4e6d1c3740 1 -- 172.21.15.148:0/3407226737 shutdown_connections 2024-09-19T07:27:54.093 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.088+0000 7f4e6d1c3740 1 -- 172.21.15.148:0/3407226737 wait complete. 2024-09-19T07:27:54.093 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.088+0000 7f4e6d1c3740 1 -- start start 2024-09-19T07:27:54.093 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.088+0000 7f4e6d1c3740 1 Processor -- start 2024-09-19T07:27:54.094 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.089+0000 7f4e6d1c3740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b876c38af0 0x55b876c3dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:54.094 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.089+0000 7f4e6d1c3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b876c39410 0x55b876c3e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:54.094 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.089+0000 7f4e6d1c3740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b876c43cb0 0x55b876c3e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:54.094 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.089+0000 7f4e6d1c3740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4e641abf10 con 0x55b876c43cb0 2024-09-19T07:27:54.094 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.089+0000 7f4e6d1c3740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4e641ad380 con 0x55b876c38af0 2024-09-19T07:27:54.094 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.089+0000 7f4e6d1c3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4e641ac5e0 con 0x55b876c39410 2024-09-19T07:27:54.094 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.089+0000 7f4e6d1c3740 10 client.0 _ll_register_callbacks cb 0x7f4e580042b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:27:54.094 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.089+0000 7f4e689c4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b876c43cb0 0x55b876c3e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:54.094 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.089+0000 7f4e689c4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b876c43cb0 0x55b876c3e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51538/0 (socket says 172.21.15.148:51538) 2024-09-19T07:27:54.094 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.089+0000 7f4e689c4640 1 -- 172.21.15.148:0/2438684106 learned_addr learned my addr 172.21.15.148:0/2438684106 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:27:54.094 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.089+0000 7f4e63fff640 1 --2- 172.21.15.148:0/2438684106 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b876c38af0 0x55b876c3dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:54.094 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.089+0000 7f4e637fe640 1 --2- 172.21.15.148:0/2438684106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b876c39410 0x55b876c3e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:54.094 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.089+0000 7f4e689c4640 1 -- 172.21.15.148:0/2438684106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b876c39410 msgr2=0x55b876c3e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:54.095 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.089+0000 7f4e689c4640 1 --2- 172.21.15.148:0/2438684106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b876c39410 0x55b876c3e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:54.095 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.089+0000 7f4e689c4640 1 -- 172.21.15.148:0/2438684106 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b876c38af0 msgr2=0x55b876c3dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:54.095 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.089+0000 7f4e689c4640 1 --2- 172.21.15.148:0/2438684106 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b876c38af0 0x55b876c3dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:54.095 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.089+0000 7f4e689c4640 1 -- 172.21.15.148:0/2438684106 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b876cbdbe0 con 0x55b876c43cb0 2024-09-19T07:27:54.095 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.089+0000 7f4e689c4640 1 --2- 172.21.15.148:0/2438684106 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b876c43cb0 0x55b876c3e860 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c099fe0 tx=0x7f4e5c09b750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c097d1535c035108 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:54.095 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.089+0000 7f4e437fe640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:27:54.095 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.089+0000 7f4e437fe640 1 -- 172.21.15.148:0/2438684106 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c07e060 con 0x55b876c43cb0 2024-09-19T07:27:54.095 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.089+0000 7f4e437fe640 1 -- 172.21.15.148:0/2438684106 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8556+0+0 (secure 0 0 0) 0x7f4e5c0983a0 con 0x55b876c43cb0 2024-09-19T07:27:54.095 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.089+0000 7f4e6d1c3740 1 -- 172.21.15.148:0/2438684106 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e5c003c60 con 0x55b876c43cb0 2024-09-19T07:27:54.095 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.089+0000 7f4e437fe640 1 -- 172.21.15.148:0/2438684106 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f4e5c020070 con 0x55b876c43cb0 2024-09-19T07:27:54.095 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.089+0000 7f4e6d1c3740 10 client.17790 fetch_fsmap learned FSMap version 55 2024-09-19T07:27:54.095 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.089+0000 7f4e6d1c3740 1 -- 172.21.15.148:0/2438684106 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x55b876cbeeb0 con 0x55b876c43cb0 2024-09-19T07:27:54.095 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.090+0000 7f4e437fe640 1 -- 172.21.15.148:0/2438684106 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e5c003c60 con 0x55b876c43cb0 2024-09-19T07:27:54.096 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.090+0000 7f4e437fe640 1 -- 172.21.15.148:0/2438684106 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 55) ==== 8370+0+0 (secure 0 0 0) 0x7f4e5c09abf0 con 0x55b876c43cb0 2024-09-19T07:27:54.096 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.090+0000 7f4e6d1c3740 10 client.17790 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T07:27:54.096 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.090+0000 7f4e6d1c3740 10 client.17790 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:27:54.096 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.090+0000 7f4e6d1c3740 20 client.17790 populate_metadata read hostname 'smithi148' 2024-09-19T07:27:54.096 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.090+0000 7f4e6d1c3740 1 --2- 172.21.15.148:0/2438684106 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55b876cbeeb0 0x55b876cc12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:54.096 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.090+0000 7f4e6d1c3740 4 client.17790 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:27:54.096 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.090+0000 7f4e6d1c3740 1 -- 172.21.15.148:0/2438684106 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b876ba4d70 con 0x55b876cbeeb0 2024-09-19T07:27:54.096 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.090+0000 7f4e63fff640 1 --2- 172.21.15.148:0/2438684106 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55b876cbeeb0 0x55b876cc12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:54.096 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.090+0000 7f4e63fff640 1 --2- 172.21.15.148:0/2438684106 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55b876cbeeb0 0x55b876cc12a0 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c86431d53279c49c server_cookie=583f0ce6c5d550e4 in_seq=0 out_seq=0 2024-09-19T07:27:54.096 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.090+0000 7f4e437fe640 10 client.17790 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:27:54.177 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.176+0000 7f4e437fe640 1 -- 172.21.15.148:0/2438684106 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b876ba4d70 con 0x55b876cbeeb0 2024-09-19T07:27:54.177 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.176+0000 7f4e437fe640 10 client.17790 handle_command_reply: tid=0 2024-09-19T07:27:54.177 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.176+0000 7f4e6d1c3740 1 client.17790 shutdown 2024-09-19T07:27:54.177 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.176+0000 7f4e6d1c3740 1 -- 172.21.15.148:0/2438684106 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b876c43cb0 msgr2=0x55b876c3e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:54.177 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.176+0000 7f4e6d1c3740 1 --2- 172.21.15.148:0/2438684106 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b876c43cb0 0x55b876c3e860 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c099fe0 tx=0x7f4e5c09b750 comp rx=0 tx=0).stop 2024-09-19T07:27:54.177 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.176+0000 7f4e6d1c3740 1 -- 172.21.15.148:0/2438684106 shutdown_connections 2024-09-19T07:27:54.177 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.176+0000 7f4e6d1c3740 1 --2- 172.21.15.148:0/2438684106 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55b876cbeeb0 0x55b876cc12a0 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:54.177 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.176+0000 7f4e6d1c3740 1 --2- 172.21.15.148:0/2438684106 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b876c43cb0 0x55b876c3e860 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:54.177 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.176+0000 7f4e6d1c3740 1 --2- 172.21.15.148:0/2438684106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b876c39410 0x55b876c3e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:54.177 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.176+0000 7f4e437fe640 0 client.17790 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:27:54.178 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.176+0000 7f4e6d1c3740 1 --2- 172.21.15.148:0/2438684106 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b876c38af0 0x55b876c3dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:54.178 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.176+0000 7f4e6d1c3740 1 -- 172.21.15.148:0/2438684106 >> 172.21.15.148:0/2438684106 conn(0x55b876c35060 msgr2=0x55b876c42490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:54.178 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.176+0000 7f4e6d1c3740 1 -- 172.21.15.148:0/2438684106 shutdown_connections 2024-09-19T07:27:54.178 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.176+0000 7f4e6d1c3740 1 -- 172.21.15.148:0/2438684106 wait complete. 2024-09-19T07:27:54.178 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.176+0000 7f4e6d1c3740 20 client.17790 trim_cache size 0 max 16384 2024-09-19T07:27:54.178 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:27:54.178 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:27:54.178 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:27:54.178 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:27:54.179 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.177+0000 7f4e6a427640 1 -- 172.21.15.148:0/3557725769 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f4e4c0a3460 msgr2=0x7f4e4c0a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:54.179 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.177+0000 7f4e6a427640 1 --2- 172.21.15.148:0/3557725769 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f4e4c0a3460 0x7f4e4c0a5920 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4e54009900 tx=0x7f4e540058d0 comp rx=0 tx=0).stop 2024-09-19T07:27:54.179 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.177+0000 7f4e6a427640 1 -- 172.21.15.148:0/3557725769 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e64107b70 msgr2=0x7f4e6419cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:54.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.177+0000 7f4e6a427640 1 --2- 172.21.15.148:0/3557725769 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e64107b70 0x7f4e6419cc50 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c009fd0 tx=0x7f4e5c00b260 comp rx=0 tx=0).stop 2024-09-19T07:27:54.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.177+0000 7f4e6a427640 1 -- 172.21.15.148:0/3557725769 shutdown_connections 2024-09-19T07:27:54.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.177+0000 7f4e6a427640 1 --2- 172.21.15.148:0/3557725769 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f4e4c0a3460 0x7f4e4c0a5920 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:54.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.177+0000 7f4e6a427640 1 --2- 172.21.15.148:0/3557725769 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e64107b70 0x7f4e6419cc50 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:54.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.177+0000 7f4e6a427640 1 --2- 172.21.15.148:0/3557725769 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e64102470 0x7f4e641988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:54.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.177+0000 7f4e6a427640 1 --2- 172.21.15.148:0/3557725769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e64101ad0 0x7f4e64198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:54.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.177+0000 7f4e6a427640 1 -- 172.21.15.148:0/3557725769 >> 172.21.15.148:0/3557725769 conn(0x7f4e640fd7d0 msgr2=0x7f4e640fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:54.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.177+0000 7f4e6a427640 1 -- 172.21.15.148:0/3557725769 shutdown_connections 2024-09-19T07:27:54.180 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:27:54.177+0000 7f4e6a427640 1 -- 172.21.15.148:0/3557725769 wait complete. 2024-09-19T07:27:54.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:27:54 smithi165 ceph-mon[35326]: pgmap v529: 97 pgs: 97 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 378 op/s 2024-09-19T07:27:55.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:27:54 smithi179 ceph-mon[35716]: pgmap v529: 97 pgs: 97 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 378 op/s 2024-09-19T07:27:55.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:27:54 smithi148 ceph-mon[31180]: pgmap v529: 97 pgs: 97 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 378 op/s 2024-09-19T07:27:56.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:27:56 smithi165 ceph-mon[35326]: pgmap v530: 97 pgs: 97 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.9 MiB/s wr, 541 op/s 2024-09-19T07:27:57.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:27:56 smithi179 ceph-mon[35716]: pgmap v530: 97 pgs: 97 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.9 MiB/s wr, 541 op/s 2024-09-19T07:27:57.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:27:56 smithi148 ceph-mon[31180]: pgmap v530: 97 pgs: 97 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.9 MiB/s wr, 541 op/s 2024-09-19T07:27:59.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:27:58 smithi179 ceph-mon[35716]: pgmap v531: 97 pgs: 97 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 346 op/s 2024-09-19T07:27:59.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:27:58 smithi148 ceph-mon[31180]: pgmap v531: 97 pgs: 97 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 346 op/s 2024-09-19T07:27:59.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:27:58 smithi165 ceph-mon[35326]: pgmap v531: 97 pgs: 97 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 346 op/s 2024-09-19T07:28:01.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:28:00 smithi179 ceph-mon[35716]: pgmap v532: 97 pgs: 97 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 380 op/s 2024-09-19T07:28:01.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:28:00 smithi148 ceph-mon[31180]: pgmap v532: 97 pgs: 97 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 380 op/s 2024-09-19T07:28:01.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:28:00 smithi165 ceph-mon[35326]: pgmap v532: 97 pgs: 97 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 380 op/s 2024-09-19T07:28:03.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:28:02 smithi179 ceph-mon[35716]: pgmap v533: 97 pgs: 97 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.0 MiB/s wr, 461 op/s 2024-09-19T07:28:03.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:28:02 smithi148 ceph-mon[31180]: pgmap v533: 97 pgs: 97 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.0 MiB/s wr, 461 op/s 2024-09-19T07:28:03.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:28:02 smithi165 ceph-mon[35326]: pgmap v533: 97 pgs: 97 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.0 MiB/s wr, 461 op/s 2024-09-19T07:28:05.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:28:04 smithi179 ceph-mon[35716]: pgmap v534: 97 pgs: 97 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 361 op/s 2024-09-19T07:28:05.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:28:04 smithi148 ceph-mon[31180]: pgmap v534: 97 pgs: 97 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 361 op/s 2024-09-19T07:28:05.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:28:04 smithi165 ceph-mon[35326]: pgmap v534: 97 pgs: 97 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 361 op/s 2024-09-19T07:28:07.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:28:06 smithi179 ceph-mon[35716]: pgmap v535: 97 pgs: 97 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.5 MiB/s wr, 497 op/s 2024-09-19T07:28:07.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:28:06 smithi148 ceph-mon[31180]: pgmap v535: 97 pgs: 97 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.5 MiB/s wr, 497 op/s 2024-09-19T07:28:07.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:28:06 smithi165 ceph-mon[35326]: pgmap v535: 97 pgs: 97 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.5 MiB/s wr, 497 op/s 2024-09-19T07:28:07.268 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.265+0000 7f204bae4640 1 -- 172.21.15.148:0/1813315468 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2044105ec0 msgr2=0x7f2044106370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:28:07.268 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.265+0000 7f204bae4640 1 --2- 172.21.15.148:0/1813315468 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2044105ec0 0x7f2044106370 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f203c009cd0 tx=0x7f203c02a970 comp rx=0 tx=0).stop 2024-09-19T07:28:07.268 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.265+0000 7f204bae4640 1 -- 172.21.15.148:0/1813315468 shutdown_connections 2024-09-19T07:28:07.268 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.265+0000 7f204bae4640 1 --2- 172.21.15.148:0/1813315468 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2044105ec0 0x7f2044106370 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:07.268 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.265+0000 7f204bae4640 1 --2- 172.21.15.148:0/1813315468 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20441013b0 0x7f2044105870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.265+0000 7f204bae4640 1 --2- 172.21.15.148:0/1813315468 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2044100a90 0x7f2044100e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.265+0000 7f204bae4640 1 -- 172.21.15.148:0/1813315468 >> 172.21.15.148:0/1813315468 conn(0x7f20440fc6f0 msgr2=0x7f20440feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:28:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.266+0000 7f204bae4640 1 -- 172.21.15.148:0/1813315468 shutdown_connections 2024-09-19T07:28:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.266+0000 7f204bae4640 1 -- 172.21.15.148:0/1813315468 wait complete. 2024-09-19T07:28:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.266+0000 7f204bae4640 1 Processor -- start 2024-09-19T07:28:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.266+0000 7f204bae4640 1 -- start start 2024-09-19T07:28:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.266+0000 7f204bae4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2044100a90 0x7f20441a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.266+0000 7f204bae4640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20441013b0 0x7f20441a4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.266+0000 7f204bae4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2044105ec0 0x7f204419e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.266+0000 7f204bae4640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f20441184f0 con 0x7f2044100a90 2024-09-19T07:28:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.266+0000 7f204bae4640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2044118370 con 0x7f20441013b0 2024-09-19T07:28:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.266+0000 7f204bae4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2044118670 con 0x7f2044105ec0 2024-09-19T07:28:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.266+0000 7f2049880640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2044100a90 0x7f20441a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.266+0000 7f2049880640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2044100a90 0x7f20441a46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55750/0 (socket says 172.21.15.148:55750) 2024-09-19T07:28:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.266+0000 7f2049880640 1 -- 172.21.15.148:0/3117300535 learned_addr learned my addr 172.21.15.148:0/3117300535 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:28:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.266+0000 7f204907f640 1 --2- 172.21.15.148:0/3117300535 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20441013b0 0x7f20441a4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.266+0000 7f204a081640 1 --2- 172.21.15.148:0/3117300535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2044105ec0 0x7f204419e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.267+0000 7f2049880640 1 -- 172.21.15.148:0/3117300535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2044105ec0 msgr2=0x7f204419e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:28:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.267+0000 7f2049880640 1 --2- 172.21.15.148:0/3117300535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2044105ec0 0x7f204419e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.267+0000 7f2049880640 1 -- 172.21.15.148:0/3117300535 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20441013b0 msgr2=0x7f20441a4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:28:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.267+0000 7f2049880640 1 --2- 172.21.15.148:0/3117300535 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20441013b0 0x7f20441a4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.267+0000 7f2049880640 1 -- 172.21.15.148:0/3117300535 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f204419f020 con 0x7f2044100a90 2024-09-19T07:28:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.267+0000 7f2049880640 1 --2- 172.21.15.148:0/3117300535 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2044100a90 0x7f20441a46a0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f204000e9f0 tx=0x7f204000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:28:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.267+0000 7f203affd640 1 -- 172.21.15.148:0/3117300535 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204000cd80 con 0x7f2044100a90 2024-09-19T07:28:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.267+0000 7f204bae4640 1 -- 172.21.15.148:0/3117300535 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f204419f310 con 0x7f2044100a90 2024-09-19T07:28:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.267+0000 7f203affd640 1 -- 172.21.15.148:0/3117300535 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2040010910 con 0x7f2044100a90 2024-09-19T07:28:07.271 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.267+0000 7f203affd640 1 -- 172.21.15.148:0/3117300535 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20400188f0 con 0x7f2044100a90 2024-09-19T07:28:07.271 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.267+0000 7f204bae4640 1 -- 172.21.15.148:0/3117300535 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20441ab620 con 0x7f2044100a90 2024-09-19T07:28:07.277 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.269+0000 7f203affd640 1 -- 172.21.15.148:0/3117300535 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f2040010ac0 con 0x7f2044100a90 2024-09-19T07:28:07.277 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.270+0000 7f204e886740 1 Processor -- start 2024-09-19T07:28:07.277 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.270+0000 7f204e886740 1 -- start start 2024-09-19T07:28:07.277 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.270+0000 7f204e886740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d69ee8af0 0x557d69ee8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:07.277 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.270+0000 7f204e886740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d69ee9410 0x557d69ef3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:07.277 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.270+0000 7f204e886740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557d69ef3cb0 0x557d69ef60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.270+0000 7f204e886740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x557d69e4d2f0 con 0x557d69ee9410 2024-09-19T07:28:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.270+0000 7f204e886740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x557d69df5270 con 0x557d69ef3cb0 2024-09-19T07:28:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.270+0000 7f204e886740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x557d69e492b0 con 0x557d69ee8af0 2024-09-19T07:28:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.270+0000 7f2049880640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d69ee9410 0x557d69ef3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.270+0000 7f204a081640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d69ee8af0 0x557d69ee8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.270+0000 7f204907f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557d69ef3cb0 0x557d69ef60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.270+0000 7f204a081640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d69ee8af0 0x557d69ee8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:39838/0 (socket says 172.21.15.148:39838) 2024-09-19T07:28:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.270+0000 7f204a081640 1 -- 172.21.15.148:0/543898887 learned_addr learned my addr 172.21.15.148:0/543898887 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:28:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.270+0000 7f203affd640 1 --2- 172.21.15.148:0/3117300535 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f20300a3460 0x7f20300a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.271+0000 7f204a081640 1 -- 172.21.15.148:0/543898887 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557d69ef3cb0 msgr2=0x557d69ef60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:28:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.271+0000 7f204a081640 1 --2- 172.21.15.148:0/543898887 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557d69ef3cb0 0x557d69ef60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.271+0000 7f204a081640 1 -- 172.21.15.148:0/543898887 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d69ee9410 msgr2=0x557d69ef3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:28:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.271+0000 7f204a081640 1 --2- 172.21.15.148:0/543898887 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d69ee9410 0x557d69ef3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.271+0000 7f204a081640 1 -- 172.21.15.148:0/543898887 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d69df4340 con 0x557d69ee8af0 2024-09-19T07:28:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.271+0000 7f204907f640 1 --2- 172.21.15.148:0/543898887 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557d69ef3cb0 0x557d69ef60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:28:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.271+0000 7f2049880640 1 --2- 172.21.15.148:0/543898887 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d69ee9410 0x557d69ef3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:28:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.271+0000 7f204a081640 1 --2- 172.21.15.148:0/3117300535 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f20300a3460 0x7f20300a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.271+0000 7f203affd640 1 -- 172.21.15.148:0/3117300535 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8556+0+0 (secure 0 0 0) 0x7f20400d00f0 con 0x7f2044100a90 2024-09-19T07:28:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.271+0000 7f204a081640 1 --2- 172.21.15.148:0/543898887 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d69ee8af0 0x557d69ee8ed0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f203c009cd0 tx=0x7f203c02e450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55179ded2ea58d09 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:28:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.271+0000 7f202ffff640 1 -- 172.21.15.148:0/543898887 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f203c034070 con 0x557d69ee8af0 2024-09-19T07:28:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.271+0000 7f202ffff640 1 -- 172.21.15.148:0/543898887 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f203c02f7d0 con 0x557d69ee8af0 2024-09-19T07:28:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.271+0000 7f202ffff640 1 -- 172.21.15.148:0/543898887 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f203c030890 con 0x557d69ee8af0 2024-09-19T07:28:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.272+0000 7f204e886740 1 -- 172.21.15.148:0/543898887 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d69ee8af0 msgr2=0x557d69ee8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:28:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.272+0000 7f204a081640 1 --2- 172.21.15.148:0/3117300535 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f20300a3460 0x7f20300a5920 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f203c04b000 tx=0x7f203c04c000 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:28:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.272+0000 7f204e886740 1 --2- 172.21.15.148:0/543898887 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d69ee8af0 0x557d69ee8ed0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f203c009cd0 tx=0x7f203c02e450 comp rx=0 tx=0).stop 2024-09-19T07:28:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.272+0000 7f204e886740 1 -- 172.21.15.148:0/543898887 shutdown_connections 2024-09-19T07:28:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.272+0000 7f204e886740 1 --2- 172.21.15.148:0/543898887 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557d69ef3cb0 0x557d69ef60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.272+0000 7f204e886740 1 --2- 172.21.15.148:0/543898887 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d69ee9410 0x557d69ef3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.272+0000 7f204e886740 1 --2- 172.21.15.148:0/543898887 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d69ee8af0 0x557d69ee8ed0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.272+0000 7f204e886740 1 -- 172.21.15.148:0/543898887 >> 172.21.15.148:0/543898887 conn(0x557d69ee5060 msgr2=0x557d69ee5440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:28:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.272+0000 7f204e886740 1 -- 172.21.15.148:0/543898887 shutdown_connections 2024-09-19T07:28:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.272+0000 7f204e886740 1 -- 172.21.15.148:0/543898887 wait complete. 2024-09-19T07:28:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.272+0000 7f204e886740 1 -- start start 2024-09-19T07:28:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.272+0000 7f204e886740 1 Processor -- start 2024-09-19T07:28:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.273+0000 7f204e886740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d69ee8af0 0x557d69ef0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.273+0000 7f204e886740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557d69ee9410 0x557d69ef1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.273+0000 7f204e886740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d69ef3cb0 0x557d69ef1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.273+0000 7f204e886740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x557d69ef6880 con 0x557d69ee8af0 2024-09-19T07:28:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.273+0000 7f204e886740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x557d69dd6290 con 0x557d69ee9410 2024-09-19T07:28:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.273+0000 7f204e886740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x557d69ef6a00 con 0x557d69ef3cb0 2024-09-19T07:28:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.273+0000 7f204e886740 10 client.0 _ll_register_callbacks cb 0x557d69e07140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:28:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.273+0000 7f2049880640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d69ee8af0 0x557d69ef0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.273+0000 7f2049880640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d69ee8af0 0x557d69ef0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55762/0 (socket says 172.21.15.148:55762) 2024-09-19T07:28:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.273+0000 7f2049880640 1 -- 172.21.15.148:0/1997773512 learned_addr learned my addr 172.21.15.148:0/1997773512 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:28:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.273+0000 7f204907f640 1 --2- 172.21.15.148:0/1997773512 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557d69ee9410 0x557d69ef1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.273+0000 7f204a081640 1 --2- 172.21.15.148:0/1997773512 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d69ef3cb0 0x557d69ef1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.273+0000 7f2049880640 1 -- 172.21.15.148:0/1997773512 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d69ef3cb0 msgr2=0x557d69ef1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:28:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.273+0000 7f2049880640 1 --2- 172.21.15.148:0/1997773512 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d69ef3cb0 0x557d69ef1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.273+0000 7f2049880640 1 -- 172.21.15.148:0/1997773512 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557d69ee9410 msgr2=0x557d69ef1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:28:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.273+0000 7f2049880640 1 --2- 172.21.15.148:0/1997773512 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557d69ee9410 0x557d69ef1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.273+0000 7f2049880640 1 -- 172.21.15.148:0/1997773512 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d69b60210 con 0x557d69ee8af0 2024-09-19T07:28:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.273+0000 7f204a081640 1 --2- 172.21.15.148:0/1997773512 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d69ef3cb0 0x557d69ef1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:28:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.273+0000 7f2049880640 1 --2- 172.21.15.148:0/1997773512 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d69ee8af0 0x557d69ef0bc0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f20400988c0 tx=0x7f2040098820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa37f54a56b4812e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:28:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.273+0000 7f202d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:28:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.274+0000 7f202d7fa640 1 -- 172.21.15.148:0/1997773512 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204009bdc0 con 0x557d69ee8af0 2024-09-19T07:28:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.274+0000 7f202d7fa640 1 -- 172.21.15.148:0/1997773512 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8556+0+0 (secure 0 0 0) 0x7f20400d20f0 con 0x557d69ee8af0 2024-09-19T07:28:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.274+0000 7f204e886740 1 -- 172.21.15.148:0/1997773512 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f203c02f7d0 con 0x557d69ee8af0 2024-09-19T07:28:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.274+0000 7f202d7fa640 1 -- 172.21.15.148:0/1997773512 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f20400a5020 con 0x557d69ee8af0 2024-09-19T07:28:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.274+0000 7f204e886740 10 client.17802 fetch_fsmap learned FSMap version 55 2024-09-19T07:28:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.274+0000 7f204e886740 1 -- 172.21.15.148:0/1997773512 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x557d69c2c620 con 0x557d69ee8af0 2024-09-19T07:28:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.274+0000 7f202d7fa640 1 -- 172.21.15.148:0/1997773512 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f203c02f7d0 con 0x557d69ee8af0 2024-09-19T07:28:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.274+0000 7f202d7fa640 1 -- 172.21.15.148:0/1997773512 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 55) ==== 8370+0+0 (secure 0 0 0) 0x7f204009b8b0 con 0x557d69ee8af0 2024-09-19T07:28:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.274+0000 7f204e886740 10 client.17802 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T07:28:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.274+0000 7f204e886740 10 client.17802 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:28:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.274+0000 7f204e886740 20 client.17802 populate_metadata read hostname 'smithi148' 2024-09-19T07:28:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.274+0000 7f204e886740 1 --2- 172.21.15.148:0/1997773512 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x557d69f03c80 0x557d69f06090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.274+0000 7f204e886740 4 client.17802 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:28:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.274+0000 7f204e886740 1 -- 172.21.15.148:0/1997773512 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d69e5aa20 con 0x557d69f03c80 2024-09-19T07:28:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.274+0000 7f204907f640 1 --2- 172.21.15.148:0/1997773512 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x557d69f03c80 0x557d69f06090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.275+0000 7f202d7fa640 10 client.17802 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:28:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.275+0000 7f204907f640 1 --2- 172.21.15.148:0/1997773512 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x557d69f03c80 0x557d69f06090 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e2f4d4b2e3abd69 server_cookie=75b687e66e53944 in_seq=0 out_seq=0 2024-09-19T07:28:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.275+0000 7f202d7fa640 1 -- 172.21.15.148:0/1997773512 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557d69e5aa20 con 0x557d69f03c80 2024-09-19T07:28:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.275+0000 7f202d7fa640 10 client.17802 handle_command_reply: tid=0 2024-09-19T07:28:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.275+0000 7f204e886740 1 client.17802 shutdown 2024-09-19T07:28:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.275+0000 7f204e886740 1 -- 172.21.15.148:0/1997773512 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d69ee8af0 msgr2=0x557d69ef0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:28:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.275+0000 7f204e886740 1 --2- 172.21.15.148:0/1997773512 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d69ee8af0 0x557d69ef0bc0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f20400988c0 tx=0x7f2040098820 comp rx=0 tx=0).stop 2024-09-19T07:28:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.275+0000 7f204e886740 1 -- 172.21.15.148:0/1997773512 shutdown_connections 2024-09-19T07:28:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.275+0000 7f204e886740 1 --2- 172.21.15.148:0/1997773512 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x557d69f03c80 0x557d69f06090 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.275+0000 7f204e886740 1 --2- 172.21.15.148:0/1997773512 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d69ef3cb0 0x557d69ef1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.275+0000 7f204e886740 1 --2- 172.21.15.148:0/1997773512 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557d69ee9410 0x557d69ef1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.275+0000 7f204e886740 1 --2- 172.21.15.148:0/1997773512 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d69ee8af0 0x557d69ef0bc0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.275+0000 7f202d7fa640 0 client.17802 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:28:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.275+0000 7f204e886740 1 -- 172.21.15.148:0/1997773512 >> 172.21.15.148:0/1997773512 conn(0x557d69ee5060 msgr2=0x557d69eeadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:28:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.276+0000 7f204e886740 1 -- 172.21.15.148:0/1997773512 shutdown_connections 2024-09-19T07:28:07.285 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.276+0000 7f204e886740 1 -- 172.21.15.148:0/1997773512 wait complete. 2024-09-19T07:28:07.285 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.276+0000 7f204e886740 20 client.17802 trim_cache size 0 max 16384 2024-09-19T07:28:07.295 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.291+0000 7f204e886740 1 Processor -- start 2024-09-19T07:28:07.295 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.291+0000 7f204e886740 1 -- start start 2024-09-19T07:28:07.295 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.291+0000 7f204e886740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d69ee8af0 0x557d69ef1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:07.296 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.291+0000 7f204e886740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557d69ee9410 0x557d69f0b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:07.296 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.291+0000 7f204e886740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d69ef3cb0 0x557d69f0bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:07.296 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.291+0000 7f204e886740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f20441b6770 con 0x557d69ef3cb0 2024-09-19T07:28:07.296 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.291+0000 7f204e886740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f20441b3f80 con 0x557d69ee9410 2024-09-19T07:28:07.296 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.291+0000 7f204e886740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f20441b1df0 con 0x557d69ee8af0 2024-09-19T07:28:07.296 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.291+0000 7f204a081640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d69ef3cb0 0x557d69f0bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:07.296 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.291+0000 7f204a081640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d69ef3cb0 0x557d69f0bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55766/0 (socket says 172.21.15.148:55766) 2024-09-19T07:28:07.296 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.291+0000 7f204a081640 1 -- 172.21.15.148:0/1923725601 learned_addr learned my addr 172.21.15.148:0/1923725601 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:28:07.296 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.291+0000 7f204907f640 1 --2- 172.21.15.148:0/1923725601 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557d69ee9410 0x557d69f0b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:07.296 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.291+0000 7f2049880640 1 --2- 172.21.15.148:0/1923725601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d69ee8af0 0x557d69ef1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:07.296 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.291+0000 7f204a081640 1 -- 172.21.15.148:0/1923725601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d69ee8af0 msgr2=0x557d69ef1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:28:07.296 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.291+0000 7f204a081640 1 --2- 172.21.15.148:0/1923725601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d69ee8af0 0x557d69ef1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.291+0000 7f204a081640 1 -- 172.21.15.148:0/1923725601 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557d69ee9410 msgr2=0x557d69f0b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:28:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.291+0000 7f204a081640 1 --2- 172.21.15.148:0/1923725601 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557d69ee9410 0x557d69f0b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.291+0000 7f204a081640 1 -- 172.21.15.148:0/1923725601 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d69ee5cf0 con 0x557d69ef3cb0 2024-09-19T07:28:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.291+0000 7f204a081640 1 --2- 172.21.15.148:0/1923725601 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d69ef3cb0 0x557d69f0bee0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f203c009cd0 tx=0x7f203c040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7fdc01e08abac97 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:28:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.292+0000 7f202f7fe640 1 -- 172.21.15.148:0/1923725601 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f203c05e020 con 0x557d69ef3cb0 2024-09-19T07:28:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.292+0000 7f202f7fe640 1 -- 172.21.15.148:0/1923725601 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f203c02fcf0 con 0x557d69ef3cb0 2024-09-19T07:28:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.292+0000 7f202f7fe640 1 -- 172.21.15.148:0/1923725601 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f203c034040 con 0x557d69ef3cb0 2024-09-19T07:28:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.292+0000 7f204e886740 1 -- 172.21.15.148:0/1923725601 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d69ef3cb0 msgr2=0x557d69f0bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:28:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.292+0000 7f204e886740 1 --2- 172.21.15.148:0/1923725601 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d69ef3cb0 0x557d69f0bee0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f203c009cd0 tx=0x7f203c040000 comp rx=0 tx=0).stop 2024-09-19T07:28:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.292+0000 7f204e886740 1 -- 172.21.15.148:0/1923725601 shutdown_connections 2024-09-19T07:28:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.292+0000 7f204e886740 1 --2- 172.21.15.148:0/1923725601 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d69ef3cb0 0x557d69f0bee0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.292+0000 7f204e886740 1 --2- 172.21.15.148:0/1923725601 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557d69ee9410 0x557d69f0b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:07.298 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.292+0000 7f204e886740 1 --2- 172.21.15.148:0/1923725601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d69ee8af0 0x557d69ef1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:07.298 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.292+0000 7f204e886740 1 -- 172.21.15.148:0/1923725601 >> 172.21.15.148:0/1923725601 conn(0x557d69ee5060 msgr2=0x557d69ef2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:28:07.298 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.292+0000 7f204e886740 1 -- 172.21.15.148:0/1923725601 shutdown_connections 2024-09-19T07:28:07.298 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.292+0000 7f204e886740 1 -- 172.21.15.148:0/1923725601 wait complete. 2024-09-19T07:28:07.298 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.293+0000 7f204e886740 1 -- start start 2024-09-19T07:28:07.298 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.293+0000 7f204e886740 1 Processor -- start 2024-09-19T07:28:07.298 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.293+0000 7f204e886740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d69ee8af0 0x557d69efc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:07.298 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.293+0000 7f204e886740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557d69ee9410 0x557d69ef76c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:07.298 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.293+0000 7f204e886740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d69ef3cb0 0x557d69ef7c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:07.298 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.293+0000 7f204e886740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f20441b2440 con 0x557d69ef3cb0 2024-09-19T07:28:07.298 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.293+0000 7f204e886740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f20441b38b0 con 0x557d69ee9410 2024-09-19T07:28:07.298 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.293+0000 7f204e886740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f20441b2b10 con 0x557d69ee8af0 2024-09-19T07:28:07.298 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.293+0000 7f204e886740 10 client.0 _ll_register_callbacks cb 0x7f204000cf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:28:07.299 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.293+0000 7f204a081640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d69ef3cb0 0x557d69ef7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:07.299 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.293+0000 7f204a081640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d69ef3cb0 0x557d69ef7c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55780/0 (socket says 172.21.15.148:55780) 2024-09-19T07:28:07.299 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.293+0000 7f204a081640 1 -- 172.21.15.148:0/2412473054 learned_addr learned my addr 172.21.15.148:0/2412473054 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:28:07.299 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.293+0000 7f204907f640 1 --2- 172.21.15.148:0/2412473054 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557d69ee9410 0x557d69ef76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:07.299 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.293+0000 7f204a081640 1 -- 172.21.15.148:0/2412473054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d69ee8af0 msgr2=0x557d69efc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:28:07.299 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.293+0000 7f2049880640 1 --2- 172.21.15.148:0/2412473054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d69ee8af0 0x557d69efc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:07.299 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.293+0000 7f204a081640 1 --2- 172.21.15.148:0/2412473054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d69ee8af0 0x557d69efc3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:07.299 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.293+0000 7f204a081640 1 -- 172.21.15.148:0/2412473054 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557d69ee9410 msgr2=0x557d69ef76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:28:07.299 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.293+0000 7f204a081640 1 --2- 172.21.15.148:0/2412473054 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557d69ee9410 0x557d69ef76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:07.299 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.293+0000 7f204a081640 1 -- 172.21.15.148:0/2412473054 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d69ef8400 con 0x557d69ef3cb0 2024-09-19T07:28:07.299 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.293+0000 7f204907f640 1 --2- 172.21.15.148:0/2412473054 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557d69ee9410 0x557d69ef76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:28:07.299 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.294+0000 7f204a081640 1 --2- 172.21.15.148:0/2412473054 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d69ef3cb0 0x557d69ef7c00 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f203c006010 tx=0x7f203c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34f06af6d43c0a00 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:28:07.300 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.294+0000 7f202d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:28:07.300 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.294+0000 7f202d7fa640 1 -- 172.21.15.148:0/2412473054 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f203c05e070 con 0x557d69ef3cb0 2024-09-19T07:28:07.300 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.294+0000 7f202d7fa640 1 -- 172.21.15.148:0/2412473054 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8556+0+0 (secure 0 0 0) 0x7f203c030830 con 0x557d69ef3cb0 2024-09-19T07:28:07.300 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.294+0000 7f204e886740 1 -- 172.21.15.148:0/2412473054 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f203c02fcf0 con 0x557d69ef3cb0 2024-09-19T07:28:07.300 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.294+0000 7f202d7fa640 1 -- 172.21.15.148:0/2412473054 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f203c030a30 con 0x557d69ef3cb0 2024-09-19T07:28:07.300 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.294+0000 7f204e886740 10 client.17808 fetch_fsmap learned FSMap version 55 2024-09-19T07:28:07.300 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.294+0000 7f204e886740 1 -- 172.21.15.148:0/2412473054 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x557d69f6e950 con 0x557d69ef3cb0 2024-09-19T07:28:07.300 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.294+0000 7f202d7fa640 1 -- 172.21.15.148:0/2412473054 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f203c02fcf0 con 0x557d69ef3cb0 2024-09-19T07:28:07.300 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.294+0000 7f202d7fa640 1 -- 172.21.15.148:0/2412473054 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 55) ==== 8370+0+0 (secure 0 0 0) 0x7f203c02e9e0 con 0x557d69ef3cb0 2024-09-19T07:28:07.300 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.294+0000 7f204e886740 10 client.17808 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T07:28:07.300 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.294+0000 7f204e886740 10 client.17808 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:28:07.300 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.294+0000 7f204e886740 20 client.17808 populate_metadata read hostname 'smithi148' 2024-09-19T07:28:07.300 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.294+0000 7f204e886740 1 --2- 172.21.15.148:0/2412473054 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x557d69f6ec70 0x557d69f71060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:07.301 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.294+0000 7f204e886740 4 client.17808 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:28:07.301 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.294+0000 7f204e886740 1 -- 172.21.15.148:0/2412473054 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557d69eec7a0 con 0x557d69f6ec70 2024-09-19T07:28:07.301 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.295+0000 7f2049880640 1 --2- 172.21.15.148:0/2412473054 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x557d69f6ec70 0x557d69f71060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:07.301 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.295+0000 7f2049880640 1 --2- 172.21.15.148:0/2412473054 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x557d69f6ec70 0x557d69f71060 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd9f90ee774dc6bb server_cookie=ff09049d55fbc5c4 in_seq=0 out_seq=0 2024-09-19T07:28:07.301 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.295+0000 7f202d7fa640 10 client.17808 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:28:07.306 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.305+0000 7f202d7fa640 1 -- 172.21.15.148:0/2412473054 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557d69eec7a0 con 0x557d69f6ec70 2024-09-19T07:28:07.306 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.305+0000 7f202d7fa640 10 client.17808 handle_command_reply: tid=0 2024-09-19T07:28:07.306 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.305+0000 7f204e886740 1 client.17808 shutdown 2024-09-19T07:28:07.306 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.305+0000 7f204e886740 1 -- 172.21.15.148:0/2412473054 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d69ef3cb0 msgr2=0x557d69ef7c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:28:07.306 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.305+0000 7f204e886740 1 --2- 172.21.15.148:0/2412473054 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d69ef3cb0 0x557d69ef7c00 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f203c006010 tx=0x7f203c004270 comp rx=0 tx=0).stop 2024-09-19T07:28:07.306 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.305+0000 7f204e886740 1 -- 172.21.15.148:0/2412473054 shutdown_connections 2024-09-19T07:28:07.306 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.305+0000 7f204e886740 1 --2- 172.21.15.148:0/2412473054 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x557d69f6ec70 0x557d69f71060 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:07.306 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.305+0000 7f204e886740 1 --2- 172.21.15.148:0/2412473054 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d69ef3cb0 0x557d69ef7c00 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:07.306 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.305+0000 7f204e886740 1 --2- 172.21.15.148:0/2412473054 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557d69ee9410 0x557d69ef76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:07.306 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.305+0000 7f202d7fa640 0 client.17808 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:28:07.306 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.305+0000 7f204e886740 1 --2- 172.21.15.148:0/2412473054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d69ee8af0 0x557d69efc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:07.306 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.305+0000 7f204e886740 1 -- 172.21.15.148:0/2412473054 >> 172.21.15.148:0/2412473054 conn(0x557d69ee5060 msgr2=0x557d69eea550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:28:07.306 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.305+0000 7f204e886740 1 -- 172.21.15.148:0/2412473054 shutdown_connections 2024-09-19T07:28:07.307 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.305+0000 7f204e886740 1 -- 172.21.15.148:0/2412473054 wait complete. 2024-09-19T07:28:07.307 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.305+0000 7f204e886740 20 client.17808 trim_cache size 0 max 16384 2024-09-19T07:28:07.307 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:28:07.307 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:28:07.307 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:28:07.307 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:28:07.308 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.306+0000 7f204bae4640 1 -- 172.21.15.148:0/3117300535 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f20300a3460 msgr2=0x7f20300a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:28:07.308 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.306+0000 7f204bae4640 1 --2- 172.21.15.148:0/3117300535 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f20300a3460 0x7f20300a5920 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f203c04b000 tx=0x7f203c04c000 comp rx=0 tx=0).stop 2024-09-19T07:28:07.308 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.306+0000 7f204bae4640 1 -- 172.21.15.148:0/3117300535 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2044100a90 msgr2=0x7f20441a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:28:07.308 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.306+0000 7f204bae4640 1 --2- 172.21.15.148:0/3117300535 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2044100a90 0x7f20441a46a0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f204000e9f0 tx=0x7f204000eeb0 comp rx=0 tx=0).stop 2024-09-19T07:28:07.308 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.306+0000 7f204bae4640 1 -- 172.21.15.148:0/3117300535 shutdown_connections 2024-09-19T07:28:07.308 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.306+0000 7f204bae4640 1 --2- 172.21.15.148:0/3117300535 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f20300a3460 0x7f20300a5920 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:07.308 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.306+0000 7f204bae4640 1 --2- 172.21.15.148:0/3117300535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2044105ec0 0x7f204419e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:07.309 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.306+0000 7f204bae4640 1 --2- 172.21.15.148:0/3117300535 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20441013b0 0x7f20441a4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:07.309 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.306+0000 7f204bae4640 1 --2- 172.21.15.148:0/3117300535 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2044100a90 0x7f20441a46a0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:07.309 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.306+0000 7f204bae4640 1 -- 172.21.15.148:0/3117300535 >> 172.21.15.148:0/3117300535 conn(0x7f20440fc6f0 msgr2=0x7f2044103840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:28:07.309 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.306+0000 7f204bae4640 1 -- 172.21.15.148:0/3117300535 shutdown_connections 2024-09-19T07:28:07.309 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:07.306+0000 7f204bae4640 1 -- 172.21.15.148:0/3117300535 wait complete. 2024-09-19T07:28:09.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:28:08 smithi179 ceph-mon[35716]: pgmap v536: 97 pgs: 97 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 319 op/s 2024-09-19T07:28:09.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:28:08 smithi179 ceph-mon[35716]: osdmap e103: 12 total, 12 up, 12 in 2024-09-19T07:28:09.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:28:08 smithi148 ceph-mon[31180]: pgmap v536: 97 pgs: 97 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 319 op/s 2024-09-19T07:28:09.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:28:08 smithi148 ceph-mon[31180]: osdmap e103: 12 total, 12 up, 12 in 2024-09-19T07:28:09.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:28:08 smithi165 ceph-mon[35326]: pgmap v536: 97 pgs: 97 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 319 op/s 2024-09-19T07:28:09.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:28:08 smithi165 ceph-mon[35326]: osdmap e103: 12 total, 12 up, 12 in 2024-09-19T07:28:11.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:28:10 smithi179 ceph-mon[35716]: pgmap v538: 97 pgs: 11 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 82 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.5 MiB/s wr, 381 op/s 2024-09-19T07:28:11.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:28:10 smithi148 ceph-mon[31180]: pgmap v538: 97 pgs: 11 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 82 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.5 MiB/s wr, 381 op/s 2024-09-19T07:28:11.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:28:10 smithi165 ceph-mon[35326]: pgmap v538: 97 pgs: 11 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 82 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.5 MiB/s wr, 381 op/s 2024-09-19T07:28:13.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:28:12 smithi179 ceph-mon[35716]: pgmap v539: 97 pgs: 41 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 33 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.1 MiB/s wr, 357 op/s 2024-09-19T07:28:13.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:28:12 smithi148 ceph-mon[31180]: pgmap v539: 97 pgs: 41 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 33 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.1 MiB/s wr, 357 op/s 2024-09-19T07:28:13.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:28:12 smithi165 ceph-mon[35326]: pgmap v539: 97 pgs: 41 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 33 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.1 MiB/s wr, 357 op/s 2024-09-19T07:28:15.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:28:14 smithi179 ceph-mon[35716]: pgmap v540: 97 pgs: 41 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 33 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.1 MiB/s wr, 346 op/s 2024-09-19T07:28:15.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:28:14 smithi148 ceph-mon[31180]: pgmap v540: 97 pgs: 41 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 33 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.1 MiB/s wr, 346 op/s 2024-09-19T07:28:15.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:28:14 smithi165 ceph-mon[35326]: pgmap v540: 97 pgs: 41 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 33 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.1 MiB/s wr, 346 op/s 2024-09-19T07:28:17.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:28:16 smithi179 ceph-mon[35716]: pgmap v541: 97 pgs: 41 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 33 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 244 op/s 2024-09-19T07:28:17.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:28:16 smithi148 ceph-mon[31180]: pgmap v541: 97 pgs: 41 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 33 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 244 op/s 2024-09-19T07:28:17.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:28:16 smithi165 ceph-mon[35326]: pgmap v541: 97 pgs: 41 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 33 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 244 op/s 2024-09-19T07:28:19.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:28:18 smithi179 ceph-mon[35716]: pgmap v542: 97 pgs: 41 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 33 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 244 op/s 2024-09-19T07:28:19.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:28:18 smithi148 ceph-mon[31180]: pgmap v542: 97 pgs: 41 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 33 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 244 op/s 2024-09-19T07:28:19.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:28:18 smithi165 ceph-mon[35326]: pgmap v542: 97 pgs: 41 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 33 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 244 op/s 2024-09-19T07:28:20.445 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.445+0000 7fa7c2f9f640 1 -- 172.21.15.148:0/3088699973 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7bc101200 msgr2=0x7fa7bc10d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:28:20.445 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.445+0000 7fa7c2f9f640 1 --2- 172.21.15.148:0/3088699973 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7bc101200 0x7fa7bc10d730 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa7b401acb0 tx=0x7fa7b403b920 comp rx=0 tx=0).stop 2024-09-19T07:28:20.446 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.445+0000 7fa7c2f9f640 1 -- 172.21.15.148:0/3088699973 shutdown_connections 2024-09-19T07:28:20.446 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.445+0000 7fa7c2f9f640 1 --2- 172.21.15.148:0/3088699973 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7bc101200 0x7fa7bc10d730 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:20.446 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.445+0000 7fa7c2f9f640 1 --2- 172.21.15.148:0/3088699973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7bc100860 0x7fa7bc100cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:20.446 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.445+0000 7fa7c2f9f640 1 --2- 172.21.15.148:0/3088699973 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7bc106870 0x7fa7bc106c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:20.446 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.445+0000 7fa7c2f9f640 1 -- 172.21.15.148:0/3088699973 >> 172.21.15.148:0/3088699973 conn(0x7fa7bc0fc560 msgr2=0x7fa7bc0fe980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:28:20.446 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.445+0000 7fa7c2f9f640 1 -- 172.21.15.148:0/3088699973 shutdown_connections 2024-09-19T07:28:20.447 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.445+0000 7fa7c2f9f640 1 -- 172.21.15.148:0/3088699973 wait complete. 2024-09-19T07:28:20.448 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.446+0000 7fa7c2f9f640 1 Processor -- start 2024-09-19T07:28:20.448 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.446+0000 7fa7c2f9f640 1 -- start start 2024-09-19T07:28:20.448 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.447+0000 7fa7c2f9f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7bc100860 0x7fa7bc073d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:20.448 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.447+0000 7fa7c2f9f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7bc101200 0x7fa7bc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:20.448 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.447+0000 7fa7c2f9f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7bc106870 0x7fa7bc06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:20.448 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.447+0000 7fa7c1f9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7bc100860 0x7fa7bc073d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:20.449 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.447+0000 7fa7c1f9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7bc100860 0x7fa7bc073d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:48450/0 (socket says 172.21.15.148:48450) 2024-09-19T07:28:20.449 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.447+0000 7fa7c1f9d640 1 -- 172.21.15.148:0/3616321500 learned_addr learned my addr 172.21.15.148:0/3616321500 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:28:20.449 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.447+0000 7fa7c2f9f640 1 -- 172.21.15.148:0/3616321500 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc06d540 con 0x7fa7bc106870 2024-09-19T07:28:20.449 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.447+0000 7fa7c179c640 1 --2- 172.21.15.148:0/3616321500 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7bc101200 0x7fa7bc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:20.449 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.447+0000 7fa7c2f9f640 1 -- 172.21.15.148:0/3616321500 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc06d3c0 con 0x7fa7bc101200 2024-09-19T07:28:20.449 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.448+0000 7fa7c2f9f640 1 -- 172.21.15.148:0/3616321500 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc06d6c0 con 0x7fa7bc100860 2024-09-19T07:28:20.449 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.448+0000 7fa7c279e640 1 --2- 172.21.15.148:0/3616321500 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7bc106870 0x7fa7bc06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:20.449 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.448+0000 7fa7c1f9d640 1 -- 172.21.15.148:0/3616321500 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7bc101200 msgr2=0x7fa7bc06ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:28:20.449 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.448+0000 7fa7c1f9d640 1 --2- 172.21.15.148:0/3616321500 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7bc101200 0x7fa7bc06ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:20.450 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.448+0000 7fa7c1f9d640 1 -- 172.21.15.148:0/3616321500 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7bc106870 msgr2=0x7fa7bc06f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:28:20.450 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.448+0000 7fa7c1f9d640 1 --2- 172.21.15.148:0/3616321500 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7bc106870 0x7fa7bc06f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:20.450 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.448+0000 7fa7c1f9d640 1 -- 172.21.15.148:0/3616321500 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7bc06fa50 con 0x7fa7bc100860 2024-09-19T07:28:20.450 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.450+0000 7fa7c1f9d640 1 --2- 172.21.15.148:0/3616321500 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7bc100860 0x7fa7bc073d60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac00b450 tx=0x7fa7ac00b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:28:20.451 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.450+0000 7fa7b2ffd640 1 -- 172.21.15.148:0/3616321500 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac015020 con 0x7fa7bc100860 2024-09-19T07:28:20.451 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.450+0000 7fa7b2ffd640 1 -- 172.21.15.148:0/3616321500 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7ac011d70 con 0x7fa7bc100860 2024-09-19T07:28:20.451 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.450+0000 7fa7b2ffd640 1 -- 172.21.15.148:0/3616321500 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac00f340 con 0x7fa7bc100860 2024-09-19T07:28:20.452 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.452+0000 7fa7c2f9f640 1 -- 172.21.15.148:0/3616321500 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7bc1a2880 con 0x7fa7bc100860 2024-09-19T07:28:20.452 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.452+0000 7fa7c2f9f640 1 -- 172.21.15.148:0/3616321500 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7bc1a2c30 con 0x7fa7bc100860 2024-09-19T07:28:20.461 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.458+0000 7fa7b2ffd640 1 -- 172.21.15.148:0/3616321500 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fa7ac018020 con 0x7fa7bc100860 2024-09-19T07:28:20.461 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.458+0000 7fa7c7075740 1 Processor -- start 2024-09-19T07:28:20.461 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.460+0000 7fa7b2ffd640 1 --2- 172.21.15.148:0/3616321500 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fa7a80a35a0 0x7fa7a80a5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:20.461 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.461+0000 7fa7b2ffd640 1 -- 172.21.15.148:0/3616321500 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 8600+0+0 (secure 0 0 0) 0x7fa7ac010d10 con 0x7fa7bc100860 2024-09-19T07:28:20.462 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.461+0000 7fa7c279e640 1 --2- 172.21.15.148:0/3616321500 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fa7a80a35a0 0x7fa7a80a5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:20.464 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.462+0000 7fa7c279e640 1 --2- 172.21.15.148:0/3616321500 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fa7a80a35a0 0x7fa7a80a5a60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa7b401a8e0 tx=0x7fa7b404e040 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:28:20.464 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.463+0000 7fa7c7075740 1 -- start start 2024-09-19T07:28:20.464 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.463+0000 7fa7c7075740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56396c08bcc0 0x56396c08c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:20.464 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.463+0000 7fa7c7075740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56396c08c5e0 0x56396c096940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:20.464 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.463+0000 7fa7c7075740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56396c096e80 0x56396c099270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:20.464 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.463+0000 7fa7c7075740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56396bff02f0 con 0x56396c08c5e0 2024-09-19T07:28:20.464 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.463+0000 7fa7c7075740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56396bf98270 con 0x56396c08bcc0 2024-09-19T07:28:20.464 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.463+0000 7fa7c7075740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56396bfec2b0 con 0x56396c096e80 2024-09-19T07:28:20.464 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.463+0000 7fa7c279e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56396c096e80 0x56396c099270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:20.464 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.463+0000 7fa7c279e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56396c096e80 0x56396c099270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:48462/0 (socket says 172.21.15.148:48462) 2024-09-19T07:28:20.464 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.463+0000 7fa7c279e640 1 -- 172.21.15.148:0/82565787 learned_addr learned my addr 172.21.15.148:0/82565787 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:28:20.465 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.465+0000 7fa7c1f9d640 1 --2- 172.21.15.148:0/82565787 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56396c08bcc0 0x56396c08c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:20.467 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.466+0000 7fa7c179c640 1 --2- 172.21.15.148:0/82565787 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56396c08c5e0 0x56396c096940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:20.467 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.466+0000 7fa7c1f9d640 1 -- 172.21.15.148:0/82565787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56396c096e80 msgr2=0x56396c099270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:28:20.467 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.466+0000 7fa7c1f9d640 1 --2- 172.21.15.148:0/82565787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56396c096e80 0x56396c099270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:20.467 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.466+0000 7fa7c1f9d640 1 -- 172.21.15.148:0/82565787 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56396c08c5e0 msgr2=0x56396c096940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:28:20.468 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.466+0000 7fa7c1f9d640 1 --2- 172.21.15.148:0/82565787 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56396c08c5e0 0x56396c096940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:20.468 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.467+0000 7fa7c1f9d640 1 -- 172.21.15.148:0/82565787 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56396bf97340 con 0x56396c08bcc0 2024-09-19T07:28:20.468 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.467+0000 7fa7c179c640 1 --2- 172.21.15.148:0/82565787 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56396c08c5e0 0x56396c096940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:28:20.468 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.467+0000 7fa7c1f9d640 1 --2- 172.21.15.148:0/82565787 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56396c08bcc0 0x56396c08c0a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac0ccaf0 tx=0x7fa7ac09b2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78c9d7fd33e0ebec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:28:20.468 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.467+0000 7fa7c279e640 1 --2- 172.21.15.148:0/82565787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56396c096e80 0x56396c099270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:28:20.469 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.467+0000 7fa7a7fff640 1 -- 172.21.15.148:0/82565787 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac0b3070 con 0x56396c08bcc0 2024-09-19T07:28:20.469 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.467+0000 7fa7a7fff640 1 -- 172.21.15.148:0/82565787 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7ac09fa30 con 0x56396c08bcc0 2024-09-19T07:28:20.469 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.467+0000 7fa7a7fff640 1 -- 172.21.15.148:0/82565787 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac0b3070 con 0x56396c08bcc0 2024-09-19T07:28:20.469 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.468+0000 7fa7c7075740 1 -- 172.21.15.148:0/82565787 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56396c08bcc0 msgr2=0x56396c08c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:28:20.470 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.468+0000 7fa7c7075740 1 --2- 172.21.15.148:0/82565787 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56396c08bcc0 0x56396c08c0a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac0ccaf0 tx=0x7fa7ac09b2c0 comp rx=0 tx=0).stop 2024-09-19T07:28:20.470 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.469+0000 7fa7c7075740 1 -- 172.21.15.148:0/82565787 shutdown_connections 2024-09-19T07:28:20.470 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.469+0000 7fa7c7075740 1 --2- 172.21.15.148:0/82565787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56396c096e80 0x56396c099270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:20.470 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.469+0000 7fa7c7075740 1 --2- 172.21.15.148:0/82565787 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56396c08c5e0 0x56396c096940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:20.470 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.469+0000 7fa7c7075740 1 --2- 172.21.15.148:0/82565787 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56396c08bcc0 0x56396c08c0a0 secure :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac0ccaf0 tx=0x7fa7ac09b2c0 comp rx=0 tx=0).stop 2024-09-19T07:28:20.470 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.469+0000 7fa7c7075740 1 -- 172.21.15.148:0/82565787 >> 172.21.15.148:0/82565787 conn(0x56396c088230 msgr2=0x56396c088610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:28:20.471 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.471+0000 7fa7c7075740 1 -- 172.21.15.148:0/82565787 shutdown_connections 2024-09-19T07:28:20.471 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.471+0000 7fa7c7075740 1 -- 172.21.15.148:0/82565787 wait complete. 2024-09-19T07:28:20.471 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.471+0000 7fa7c7075740 1 -- start start 2024-09-19T07:28:20.472 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.472+0000 7fa7c7075740 1 Processor -- start 2024-09-19T07:28:20.473 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.472+0000 7fa7c7075740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56396c08c5e0 0x56396c093e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:20.473 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.472+0000 7fa7c7075740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56396c096e80 0x56396c0943b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:20.474 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.472+0000 7fa7c7075740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56396c0948f0 0x56396c0a2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:20.474 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.472+0000 7fa7c7075740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56396c099a50 con 0x56396c08c5e0 2024-09-19T07:28:20.474 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.472+0000 7fa7c7075740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56396bf79290 con 0x56396c096e80 2024-09-19T07:28:20.474 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.472+0000 7fa7c7075740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56396c099bd0 con 0x56396c0948f0 2024-09-19T07:28:20.474 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.472+0000 7fa7c179c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56396c096e80 0x56396c0943b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:20.474 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.472+0000 7fa7c179c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56396c096e80 0x56396c0943b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:55162/0 (socket says 172.21.15.148:55162) 2024-09-19T07:28:20.474 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.472+0000 7fa7c179c640 1 -- 172.21.15.148:0/714717270 learned_addr learned my addr 172.21.15.148:0/714717270 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:28:20.474 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.473+0000 7fa7c279e640 1 --2- 172.21.15.148:0/714717270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56396c0948f0 0x56396c0a2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:20.474 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.473+0000 7fa7c7075740 10 client.0 _ll_register_callbacks cb 0x56396bfaa140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:28:20.474 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.473+0000 7fa7c1f9d640 1 --2- 172.21.15.148:0/714717270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56396c08c5e0 0x56396c093e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:20.474 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.473+0000 7fa7c179c640 1 -- 172.21.15.148:0/714717270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56396c0948f0 msgr2=0x56396c0a2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:28:20.474 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.473+0000 7fa7c179c640 1 --2- 172.21.15.148:0/714717270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56396c0948f0 0x56396c0a2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:20.475 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.473+0000 7fa7c179c640 1 -- 172.21.15.148:0/714717270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56396c08c5e0 msgr2=0x56396c093e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:28:20.475 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.473+0000 7fa7c179c640 1 --2- 172.21.15.148:0/714717270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56396c08c5e0 0x56396c093e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:20.475 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.473+0000 7fa7c179c640 1 -- 172.21.15.148:0/714717270 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56396bd03210 con 0x56396c096e80 2024-09-19T07:28:20.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.473+0000 7fa7c179c640 1 --2- 172.21.15.148:0/714717270 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56396c096e80 0x56396c0943b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa7b80104a0 tx=0x7fa7b8010960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4bac98e5324f544 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:28:20.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.473+0000 7fa7a57fa640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-19T07:28:20.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.474+0000 7fa7a57fa640 1 -- 172.21.15.148:0/714717270 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b8018070 con 0x56396c096e80 2024-09-19T07:28:20.477 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.474+0000 7fa7c7075740 1 -- 172.21.15.148:0/714717270 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7ac09fa30 con 0x56396c096e80 2024-09-19T07:28:20.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.474+0000 7fa7a57fa640 1 -- 172.21.15.148:0/714717270 <== mon.2 v2:172.21.15.165:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 8600+0+0 (secure 0 0 0) 0x7fa7b8014800 con 0x56396c096e80 2024-09-19T07:28:20.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.474+0000 7fa7a57fa640 1 -- 172.21.15.148:0/714717270 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7fa7b800f040 con 0x56396c096e80 2024-09-19T07:28:20.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.474+0000 7fa7c7075740 10 client.26801 fetch_fsmap learned FSMap version 55 2024-09-19T07:28:20.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.474+0000 7fa7c7075740 1 -- 172.21.15.148:0/714717270 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x56396bdcf620 con 0x56396c096e80 2024-09-19T07:28:20.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.475+0000 7fa7a57fa640 1 -- 172.21.15.148:0/714717270 <== mon.2 v2:172.21.15.165:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7b801d440 con 0x56396c096e80 2024-09-19T07:28:20.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.475+0000 7fa7a57fa640 1 -- 172.21.15.148:0/714717270 <== mon.2 v2:172.21.15.165:3300/0 5 ==== fsmap(e 55) ==== 8370+0+0 (secure 0 0 0) 0x7fa7b8025080 con 0x56396c096e80 2024-09-19T07:28:20.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.475+0000 7fa7c7075740 10 client.26801 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T07:28:20.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.475+0000 7fa7c7075740 10 client.26801 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:28:20.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.475+0000 7fa7c7075740 20 client.26801 populate_metadata read hostname 'smithi148' 2024-09-19T07:28:20.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.475+0000 7fa7c7075740 1 --2- 172.21.15.148:0/714717270 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56396c0a72c0 0x56396c0a9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:20.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.475+0000 7fa7c7075740 4 client.26801 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:28:20.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.475+0000 7fa7c7075740 1 -- 172.21.15.148:0/714717270 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa7ac09fa30 con 0x56396c0a72c0 2024-09-19T07:28:20.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.476+0000 7fa7c1f9d640 1 --2- 172.21.15.148:0/714717270 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56396c0a72c0 0x56396c0a9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:20.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.477+0000 7fa7c1f9d640 1 --2- 172.21.15.148:0/714717270 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56396c0a72c0 0x56396c0a9710 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=437ccdad5f5446d4 server_cookie=6efc2cec9fe3bbf3 in_seq=0 out_seq=0 2024-09-19T07:28:20.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.477+0000 7fa7a57fa640 10 client.26801 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:28:20.480 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.478+0000 7fa7a57fa640 1 -- 172.21.15.148:0/714717270 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fa7ac09fa30 con 0x56396c0a72c0 2024-09-19T07:28:20.481 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.478+0000 7fa7a57fa640 10 client.26801 handle_command_reply: tid=0 2024-09-19T07:28:20.481 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.478+0000 7fa7c7075740 1 client.26801 shutdown 2024-09-19T07:28:20.481 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.479+0000 7fa7c7075740 1 -- 172.21.15.148:0/714717270 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56396c096e80 msgr2=0x56396c0943b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:28:20.481 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.479+0000 7fa7c7075740 1 --2- 172.21.15.148:0/714717270 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56396c096e80 0x56396c0943b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa7b80104a0 tx=0x7fa7b8010960 comp rx=0 tx=0).stop 2024-09-19T07:28:20.481 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.479+0000 7fa7c7075740 1 -- 172.21.15.148:0/714717270 shutdown_connections 2024-09-19T07:28:20.481 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.480+0000 7fa7c7075740 1 --2- 172.21.15.148:0/714717270 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56396c0a72c0 0x56396c0a9710 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:20.481 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.480+0000 7fa7a57fa640 0 client.26801 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:28:20.481 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.480+0000 7fa7c7075740 1 --2- 172.21.15.148:0/714717270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56396c0948f0 0x56396c0a2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:20.481 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.480+0000 7fa7c7075740 1 --2- 172.21.15.148:0/714717270 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56396c096e80 0x56396c0943b0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:20.481 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.480+0000 7fa7c7075740 1 --2- 172.21.15.148:0/714717270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56396c08c5e0 0x56396c093e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:20.481 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.480+0000 7fa7c7075740 1 -- 172.21.15.148:0/714717270 >> 172.21.15.148:0/714717270 conn(0x56396c088230 msgr2=0x56396c08df90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:28:20.482 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.480+0000 7fa7c7075740 1 -- 172.21.15.148:0/714717270 shutdown_connections 2024-09-19T07:28:20.482 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.480+0000 7fa7c7075740 1 -- 172.21.15.148:0/714717270 wait complete. 2024-09-19T07:28:20.482 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.480+0000 7fa7c7075740 20 client.26801 trim_cache size 0 max 16384 2024-09-19T07:28:20.507 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.507+0000 7fa7c7075740 1 Processor -- start 2024-09-19T07:28:20.507 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.507+0000 7fa7c7075740 1 -- start start 2024-09-19T07:28:20.509 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.507+0000 7fa7c7075740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56396c08c5e0 0x56396c0a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:20.509 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.508+0000 7fa7c7075740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56396c0948f0 0x56396c0af070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:20.509 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.508+0000 7fa7c7075740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56396c096e80 0x56396c0af5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:20.509 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.508+0000 7fa7c1f9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56396c08c5e0 0x56396c0a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:20.509 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.508+0000 7fa7c1f9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56396c08c5e0 0x56396c0a2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:48480/0 (socket says 172.21.15.148:48480) 2024-09-19T07:28:20.509 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.508+0000 7fa7c1f9d640 1 -- 172.21.15.148:0/2837039006 learned_addr learned my addr 172.21.15.148:0/2837039006 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:28:20.509 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.508+0000 7fa7c7075740 1 -- 172.21.15.148:0/2837039006 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc1adf60 con 0x56396c0948f0 2024-09-19T07:28:20.509 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.508+0000 7fa7c7075740 1 -- 172.21.15.148:0/2837039006 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc1ab770 con 0x56396c096e80 2024-09-19T07:28:20.509 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.508+0000 7fa7c279e640 1 --2- 172.21.15.148:0/2837039006 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56396c096e80 0x56396c0af5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:20.509 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.508+0000 7fa7c7075740 1 -- 172.21.15.148:0/2837039006 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc1a95e0 con 0x56396c08c5e0 2024-09-19T07:28:20.510 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.509+0000 7fa7c1f9d640 1 -- 172.21.15.148:0/2837039006 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56396c096e80 msgr2=0x56396c0af5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:28:20.510 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.509+0000 7fa7c1f9d640 1 --2- 172.21.15.148:0/2837039006 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56396c096e80 0x56396c0af5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:20.510 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.509+0000 7fa7c1f9d640 1 -- 172.21.15.148:0/2837039006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56396c0948f0 msgr2=0x56396c0af070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:28:20.510 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.509+0000 7fa7c1f9d640 1 --2- 172.21.15.148:0/2837039006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56396c0948f0 0x56396c0af070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:20.511 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.509+0000 7fa7c1f9d640 1 -- 172.21.15.148:0/2837039006 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56396c0a3c60 con 0x56396c08c5e0 2024-09-19T07:28:20.511 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.509+0000 7fa7c1f9d640 1 --2- 172.21.15.148:0/2837039006 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56396c08c5e0 0x56396c0a2cf0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac0ccba0 tx=0x7fa7ac0ccc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e6ad75dd718b235 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:28:20.511 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.509+0000 7fa7a77fe640 1 -- 172.21.15.148:0/2837039006 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac0b3070 con 0x56396c08c5e0 2024-09-19T07:28:20.511 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.510+0000 7fa7a77fe640 1 -- 172.21.15.148:0/2837039006 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7ac010550 con 0x56396c08c5e0 2024-09-19T07:28:20.511 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.510+0000 7fa7a77fe640 1 -- 172.21.15.148:0/2837039006 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac0afba0 con 0x56396c08c5e0 2024-09-19T07:28:20.512 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.511+0000 7fa7c7075740 1 -- 172.21.15.148:0/2837039006 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56396c08c5e0 msgr2=0x56396c0a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:28:20.512 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.511+0000 7fa7c7075740 1 --2- 172.21.15.148:0/2837039006 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56396c08c5e0 0x56396c0a2cf0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac0ccba0 tx=0x7fa7ac0ccc60 comp rx=0 tx=0).stop 2024-09-19T07:28:20.512 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.511+0000 7fa7c7075740 1 -- 172.21.15.148:0/2837039006 shutdown_connections 2024-09-19T07:28:20.512 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.511+0000 7fa7c7075740 1 --2- 172.21.15.148:0/2837039006 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56396c096e80 0x56396c0af5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:20.512 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.511+0000 7fa7c7075740 1 --2- 172.21.15.148:0/2837039006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56396c0948f0 0x56396c0af070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:20.512 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.511+0000 7fa7c7075740 1 --2- 172.21.15.148:0/2837039006 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56396c08c5e0 0x56396c0a2cf0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:20.513 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.511+0000 7fa7c7075740 1 -- 172.21.15.148:0/2837039006 >> 172.21.15.148:0/2837039006 conn(0x56396c088230 msgr2=0x56396c08f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:28:20.513 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.512+0000 7fa7c7075740 1 -- 172.21.15.148:0/2837039006 shutdown_connections 2024-09-19T07:28:20.513 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.512+0000 7fa7c7075740 1 -- 172.21.15.148:0/2837039006 wait complete. 2024-09-19T07:28:20.514 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.512+0000 7fa7c7075740 1 -- start start 2024-09-19T07:28:20.515 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.512+0000 7fa7c7075740 1 Processor -- start 2024-09-19T07:28:20.515 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.513+0000 7fa7c7075740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56396c08c5e0 0x56396c09f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:20.515 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.513+0000 7fa7c7075740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56396c0948f0 0x56396c09f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:20.515 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.513+0000 7fa7c7075740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56396c096e80 0x56396c0906c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:20.515 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.513+0000 7fa7c7075740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc1a9c30 con 0x56396c08c5e0 2024-09-19T07:28:20.515 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.513+0000 7fa7c7075740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc1ab0a0 con 0x56396c0948f0 2024-09-19T07:28:20.515 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.513+0000 7fa7c7075740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc1aa300 con 0x56396c096e80 2024-09-19T07:28:20.515 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.513+0000 7fa7c7075740 10 client.0 _ll_register_callbacks cb 0x7fa7b80093d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:28:20.515 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.513+0000 7fa7c1f9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56396c08c5e0 0x56396c09f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:20.515 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.513+0000 7fa7c1f9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56396c08c5e0 0x56396c09f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:41602/0 (socket says 172.21.15.148:41602) 2024-09-19T07:28:20.515 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.513+0000 7fa7c1f9d640 1 -- 172.21.15.148:0/3596766405 learned_addr learned my addr 172.21.15.148:0/3596766405 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:28:20.515 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.513+0000 7fa7c179c640 1 --2- 172.21.15.148:0/3596766405 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56396c0948f0 0x56396c09f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:20.515 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.514+0000 7fa7c1f9d640 1 -- 172.21.15.148:0/3596766405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56396c096e80 msgr2=0x56396c0906c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:28:20.516 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.514+0000 7fa7c1f9d640 1 --2- 172.21.15.148:0/3596766405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56396c096e80 0x56396c0906c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:20.516 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.514+0000 7fa7c1f9d640 1 -- 172.21.15.148:0/3596766405 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56396c0948f0 msgr2=0x56396c09f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:28:20.516 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.514+0000 7fa7c1f9d640 1 --2- 172.21.15.148:0/3596766405 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56396c0948f0 0x56396c09f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:20.516 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.514+0000 7fa7c1f9d640 1 -- 172.21.15.148:0/3596766405 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56396c090ef0 con 0x56396c08c5e0 2024-09-19T07:28:20.516 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.514+0000 7fa7c1f9d640 1 --2- 172.21.15.148:0/3596766405 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56396c08c5e0 0x56396c09f050 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac0ccf60 tx=0x7fa7ac09b560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c4b9524db2c70f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:28:20.516 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.514+0000 7fa7a57fa640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:28:20.516 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.514+0000 7fa7a57fa640 1 -- 172.21.15.148:0/3596766405 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac0b3050 con 0x56396c08c5e0 2024-09-19T07:28:20.516 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.514+0000 7fa7a57fa640 1 -- 172.21.15.148:0/3596766405 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 8600+0+0 (secure 0 0 0) 0x7fa7ac097d60 con 0x56396c08c5e0 2024-09-19T07:28:20.516 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.514+0000 7fa7c7075740 1 -- 172.21.15.148:0/3596766405 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7ac010550 con 0x56396c08c5e0 2024-09-19T07:28:20.517 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.515+0000 7fa7a57fa640 1 -- 172.21.15.148:0/3596766405 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7fa7ac09fa30 con 0x56396c08c5e0 2024-09-19T07:28:20.518 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.518+0000 7fa7c7075740 10 client.17817 fetch_fsmap learned FSMap version 55 2024-09-19T07:28:20.519 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.518+0000 7fa7c7075740 1 -- 172.21.15.148:0/3596766405 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x56396c111af0 con 0x56396c08c5e0 2024-09-19T07:28:20.520 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.520+0000 7fa7a57fa640 1 -- 172.21.15.148:0/3596766405 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7ac010550 con 0x56396c08c5e0 2024-09-19T07:28:20.520 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.520+0000 7fa7a57fa640 1 -- 172.21.15.148:0/3596766405 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 55) ==== 8370+0+0 (secure 0 0 0) 0x7fa7ac022060 con 0x56396c08c5e0 2024-09-19T07:28:20.524 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.521+0000 7fa7c7075740 10 client.17817 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T07:28:20.524 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.521+0000 7fa7c7075740 10 client.17817 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:28:20.524 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.521+0000 7fa7c7075740 20 client.17817 populate_metadata read hostname 'smithi148' 2024-09-19T07:28:20.524 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.521+0000 7fa7c7075740 1 --2- 172.21.15.148:0/3596766405 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56396c0a72c0 0x56396c113d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:20.524 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.521+0000 7fa7c7075740 4 client.17817 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:28:20.524 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.521+0000 7fa7c7075740 1 -- 172.21.15.148:0/3596766405 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56396bffda20 con 0x56396c0a72c0 2024-09-19T07:28:20.524 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.522+0000 7fa7c179c640 1 --2- 172.21.15.148:0/3596766405 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56396c0a72c0 0x56396c113d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:20.527 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.525+0000 7fa7c179c640 1 --2- 172.21.15.148:0/3596766405 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56396c0a72c0 0x56396c113d80 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24278991aed3e0f1 server_cookie=d4a80eab78196ab2 in_seq=0 out_seq=0 2024-09-19T07:28:20.527 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.526+0000 7fa7a57fa640 10 client.17817 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:28:20.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.579+0000 7fa7a57fa640 1 -- 172.21.15.148:0/3596766405 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56396bffda20 con 0x56396c0a72c0 2024-09-19T07:28:20.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.579+0000 7fa7a57fa640 10 client.17817 handle_command_reply: tid=0 2024-09-19T07:28:20.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.579+0000 7fa7c7075740 1 client.17817 shutdown 2024-09-19T07:28:20.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.579+0000 7fa7c7075740 1 -- 172.21.15.148:0/3596766405 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56396c08c5e0 msgr2=0x56396c09f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:28:20.580 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.579+0000 7fa7c7075740 1 --2- 172.21.15.148:0/3596766405 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56396c08c5e0 0x56396c09f050 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac0ccf60 tx=0x7fa7ac09b560 comp rx=0 tx=0).stop 2024-09-19T07:28:20.581 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.579+0000 7fa7c7075740 1 -- 172.21.15.148:0/3596766405 shutdown_connections 2024-09-19T07:28:20.581 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.579+0000 7fa7c7075740 1 --2- 172.21.15.148:0/3596766405 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x56396c0a72c0 0x56396c113d80 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:20.581 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.579+0000 7fa7a57fa640 0 client.17817 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:28:20.581 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.579+0000 7fa7c7075740 1 --2- 172.21.15.148:0/3596766405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56396c096e80 0x56396c0906c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:20.581 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.579+0000 7fa7c7075740 1 --2- 172.21.15.148:0/3596766405 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56396c0948f0 0x56396c09f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:20.581 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.579+0000 7fa7c7075740 1 --2- 172.21.15.148:0/3596766405 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56396c08c5e0 0x56396c09f050 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:20.581 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.579+0000 7fa7c7075740 1 -- 172.21.15.148:0/3596766405 >> 172.21.15.148:0/3596766405 conn(0x56396c088230 msgr2=0x56396c093710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:28:20.581 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.580+0000 7fa7c7075740 1 -- 172.21.15.148:0/3596766405 shutdown_connections 2024-09-19T07:28:20.581 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.580+0000 7fa7c7075740 1 -- 172.21.15.148:0/3596766405 wait complete. 2024-09-19T07:28:20.582 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.580+0000 7fa7c7075740 20 client.17817 trim_cache size 0 max 16384 2024-09-19T07:28:20.582 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:28:20.582 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:28:20.582 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:28:20.582 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:28:20.583 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.581+0000 7fa7c2f9f640 1 -- 172.21.15.148:0/3616321500 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fa7a80a35a0 msgr2=0x7fa7a80a5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:28:20.583 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.581+0000 7fa7c2f9f640 1 --2- 172.21.15.148:0/3616321500 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fa7a80a35a0 0x7fa7a80a5a60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa7b401a8e0 tx=0x7fa7b404e040 comp rx=0 tx=0).stop 2024-09-19T07:28:20.583 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.581+0000 7fa7c2f9f640 1 -- 172.21.15.148:0/3616321500 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7bc100860 msgr2=0x7fa7bc073d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:28:20.583 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.581+0000 7fa7c2f9f640 1 --2- 172.21.15.148:0/3616321500 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7bc100860 0x7fa7bc073d60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac00b450 tx=0x7fa7ac00b910 comp rx=0 tx=0).stop 2024-09-19T07:28:20.583 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.581+0000 7fa7c2f9f640 1 -- 172.21.15.148:0/3616321500 shutdown_connections 2024-09-19T07:28:20.583 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.581+0000 7fa7c2f9f640 1 --2- 172.21.15.148:0/3616321500 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fa7a80a35a0 0x7fa7a80a5a60 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:20.583 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.581+0000 7fa7c2f9f640 1 --2- 172.21.15.148:0/3616321500 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7bc106870 0x7fa7bc06f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:20.583 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.581+0000 7fa7c2f9f640 1 --2- 172.21.15.148:0/3616321500 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7bc101200 0x7fa7bc06ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:20.584 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.581+0000 7fa7c2f9f640 1 --2- 172.21.15.148:0/3616321500 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7bc100860 0x7fa7bc073d60 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:20.584 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.581+0000 7fa7c2f9f640 1 -- 172.21.15.148:0/3616321500 >> 172.21.15.148:0/3616321500 conn(0x7fa7bc0fc560 msgr2=0x7fa7bc0fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:28:20.584 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.582+0000 7fa7c2f9f640 1 -- 172.21.15.148:0/3616321500 shutdown_connections 2024-09-19T07:28:20.584 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:20.582+0000 7fa7c2f9f640 1 -- 172.21.15.148:0/3616321500 wait complete. 2024-09-19T07:28:21.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:28:20 smithi179 ceph-mon[35716]: pgmap v543: 97 pgs: 41 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 33 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 216 op/s 2024-09-19T07:28:21.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:28:20 smithi148 ceph-mon[31180]: pgmap v543: 97 pgs: 41 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 33 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 216 op/s 2024-09-19T07:28:21.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:28:20 smithi165 ceph-mon[35326]: pgmap v543: 97 pgs: 41 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 33 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 216 op/s 2024-09-19T07:28:23.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:28:22 smithi179 ceph-mon[35716]: pgmap v544: 97 pgs: 41 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 33 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.2 MiB/s wr, 237 op/s 2024-09-19T07:28:23.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:28:22 smithi148 ceph-mon[31180]: pgmap v544: 97 pgs: 41 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 33 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.2 MiB/s wr, 237 op/s 2024-09-19T07:28:23.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:28:22 smithi165 ceph-mon[35326]: pgmap v544: 97 pgs: 41 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 33 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.2 MiB/s wr, 237 op/s 2024-09-19T07:28:25.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:28:24 smithi179 ceph-mon[35716]: pgmap v545: 97 pgs: 41 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 33 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 148 op/s 2024-09-19T07:28:25.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:28:24 smithi148 ceph-mon[31180]: pgmap v545: 97 pgs: 41 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 33 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 148 op/s 2024-09-19T07:28:25.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:28:24 smithi165 ceph-mon[35326]: pgmap v545: 97 pgs: 41 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 33 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 148 op/s 2024-09-19T07:28:27.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:28:26 smithi179 ceph-mon[35716]: pgmap v546: 97 pgs: 39 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 37 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 200 op/s 2024-09-19T07:28:27.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:28:26 smithi148 ceph-mon[31180]: pgmap v546: 97 pgs: 39 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 37 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 200 op/s 2024-09-19T07:28:27.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:28:26 smithi165 ceph-mon[35326]: pgmap v546: 97 pgs: 39 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 37 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 200 op/s 2024-09-19T07:28:29.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:28:28 smithi179 ceph-mon[35716]: pgmap v547: 97 pgs: 39 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 37 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 132 op/s 2024-09-19T07:28:29.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:28:28 smithi148 ceph-mon[31180]: pgmap v547: 97 pgs: 39 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 37 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 132 op/s 2024-09-19T07:28:29.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:28:28 smithi165 ceph-mon[35326]: pgmap v547: 97 pgs: 39 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 37 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 132 op/s 2024-09-19T07:28:31.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:28:30 smithi179 ceph-mon[35716]: pgmap v548: 97 pgs: 39 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 37 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 147 op/s 2024-09-19T07:28:31.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:28:30 smithi148 ceph-mon[31180]: pgmap v548: 97 pgs: 39 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 37 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 147 op/s 2024-09-19T07:28:31.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:28:30 smithi165 ceph-mon[35326]: pgmap v548: 97 pgs: 39 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 37 active+clean; 1.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 147 op/s 2024-09-19T07:28:33.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:28:32 smithi179 ceph-mon[35716]: pgmap v549: 97 pgs: 35 active+clean+snaptrim_wait, 18 active+clean+snaptrim, 44 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 205 op/s 2024-09-19T07:28:33.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:28:32 smithi148 ceph-mon[31180]: pgmap v549: 97 pgs: 35 active+clean+snaptrim_wait, 18 active+clean+snaptrim, 44 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 205 op/s 2024-09-19T07:28:33.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:28:32 smithi165 ceph-mon[35326]: pgmap v549: 97 pgs: 35 active+clean+snaptrim_wait, 18 active+clean+snaptrim, 44 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 205 op/s 2024-09-19T07:28:33.720 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.719+0000 7f13bdffb640 1 -- 172.21.15.148:0/3353154327 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b002f300 con 0x7f13c0100aa0 2024-09-19T07:28:33.720 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.720+0000 7f13c568d640 1 -- 172.21.15.148:0/3353154327 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13c0100aa0 msgr2=0x7f13c0100e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:28:33.720 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.720+0000 7f13c568d640 1 --2- 172.21.15.148:0/3353154327 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13c0100aa0 0x7f13c0100e80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f13b0009860 tx=0x7f13b002a410 comp rx=0 tx=0).stop 2024-09-19T07:28:33.724 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.723+0000 7f13c568d640 1 -- 172.21.15.148:0/3353154327 shutdown_connections 2024-09-19T07:28:33.725 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.723+0000 7f13c568d640 1 --2- 172.21.15.148:0/3353154327 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13c0105ed0 0x7f13c0106340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:33.725 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.723+0000 7f13c568d640 1 --2- 172.21.15.148:0/3353154327 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13c01013c0 0x7f13c0105880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:33.725 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.723+0000 7f13c568d640 1 --2- 172.21.15.148:0/3353154327 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13c0100aa0 0x7f13c0100e80 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:33.725 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.723+0000 7f13c568d640 1 -- 172.21.15.148:0/3353154327 >> 172.21.15.148:0/3353154327 conn(0x7f13c00fc6e0 msgr2=0x7f13c00feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:28:33.727 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.726+0000 7f13c568d640 1 -- 172.21.15.148:0/3353154327 shutdown_connections 2024-09-19T07:28:33.727 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.727+0000 7f13c568d640 1 -- 172.21.15.148:0/3353154327 wait complete. 2024-09-19T07:28:33.728 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.727+0000 7f13c568d640 1 Processor -- start 2024-09-19T07:28:33.728 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.728+0000 7f13c568d640 1 -- start start 2024-09-19T07:28:33.729 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.728+0000 7f13c568d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13c0100aa0 0x7f13c0072dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:33.729 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.728+0000 7f13c568d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13c01013c0 0x7f13c0073300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:33.729 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.728+0000 7f13c568d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13c0105ed0 0x7f13c0115180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:33.729 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.729+0000 7f13c568d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f13c0109890 con 0x7f13c0100aa0 2024-09-19T07:28:33.729 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.729+0000 7f13c568d640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f13c0109710 con 0x7f13c0105ed0 2024-09-19T07:28:33.729 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.729+0000 7f13c568d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f13c0109a10 con 0x7f13c01013c0 2024-09-19T07:28:33.729 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.729+0000 7f13bf7fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13c0105ed0 0x7f13c0115180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:33.729 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.729+0000 7f13bf7fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13c0105ed0 0x7f13c0115180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:60574/0 (socket says 172.21.15.148:60574) 2024-09-19T07:28:33.730 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.729+0000 7f13bf7fe640 1 -- 172.21.15.148:0/94554339 learned_addr learned my addr 172.21.15.148:0/94554339 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:28:33.730 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.729+0000 7f13be7fc640 1 --2- 172.21.15.148:0/94554339 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13c01013c0 0x7f13c0073300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:33.730 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.729+0000 7f13beffd640 1 --2- 172.21.15.148:0/94554339 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13c0100aa0 0x7f13c0072dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:33.731 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.729+0000 7f13bf7fe640 1 -- 172.21.15.148:0/94554339 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13c01013c0 msgr2=0x7f13c0073300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:28:33.731 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.729+0000 7f13bf7fe640 1 --2- 172.21.15.148:0/94554339 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13c01013c0 0x7f13c0073300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:33.731 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.729+0000 7f13bf7fe640 1 -- 172.21.15.148:0/94554339 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13c0100aa0 msgr2=0x7f13c0072dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:28:33.731 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.729+0000 7f13bf7fe640 1 --2- 172.21.15.148:0/94554339 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13c0100aa0 0x7f13c0072dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:33.731 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.729+0000 7f13bf7fe640 1 -- 172.21.15.148:0/94554339 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13c010e2a0 con 0x7f13c0105ed0 2024-09-19T07:28:33.731 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.730+0000 7f13bf7fe640 1 --2- 172.21.15.148:0/94554339 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13c0105ed0 0x7f13c0115180 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f13b801fd90 tx=0x7f13b801d750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:28:33.731 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.730+0000 7f13a7fff640 1 -- 172.21.15.148:0/94554339 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b801de60 con 0x7f13c0105ed0 2024-09-19T07:28:33.731 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.730+0000 7f13c568d640 1 -- 172.21.15.148:0/94554339 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13c010e530 con 0x7f13c0105ed0 2024-09-19T07:28:33.732 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.730+0000 7f13c568d640 1 -- 172.21.15.148:0/94554339 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13c010e9c0 con 0x7f13c0105ed0 2024-09-19T07:28:33.732 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.731+0000 7f13a7fff640 1 -- 172.21.15.148:0/94554339 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13b8003970 con 0x7f13c0105ed0 2024-09-19T07:28:33.732 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.731+0000 7f13a7fff640 1 -- 172.21.15.148:0/94554339 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b8004400 con 0x7f13c0105ed0 2024-09-19T07:28:33.734 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.734+0000 7f13a7fff640 1 -- 172.21.15.148:0/94554339 <== mon.2 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f13b802e020 con 0x7f13c0105ed0 2024-09-19T07:28:33.735 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.735+0000 7f13a7fff640 1 --2- 172.21.15.148:0/94554339 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f13a80a3560 0x7f13a80a5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:33.736 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.735+0000 7f13a7fff640 1 -- 172.21.15.148:0/94554339 <== mon.2 v2:172.21.15.165:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 8600+0+0 (secure 0 0 0) 0x7f13b8004b20 con 0x7f13c0105ed0 2024-09-19T07:28:33.736 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.735+0000 7f13c8427740 1 Processor -- start 2024-09-19T07:28:33.736 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.735+0000 7f13beffd640 1 --2- 172.21.15.148:0/94554339 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f13a80a3560 0x7f13a80a5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:33.736 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.735+0000 7f13c8427740 1 -- start start 2024-09-19T07:28:33.736 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.736+0000 7f13c8427740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55814c3cfaf0 0x55814c3cfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:33.736 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.736+0000 7f13c8427740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55814c3d0410 0x55814c3da770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:33.737 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.736+0000 7f13c8427740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55814c3dacb0 0x55814c3dd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:33.737 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.736+0000 7f13c8427740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55814c3342f0 con 0x55814c3d0410 2024-09-19T07:28:33.737 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.736+0000 7f13be7fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55814c3d0410 0x55814c3da770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:33.737 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.736+0000 7f13c8427740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55814c2dc270 con 0x55814c3dacb0 2024-09-19T07:28:33.737 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.736+0000 7f13c8427740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55814c3302b0 con 0x55814c3cfaf0 2024-09-19T07:28:33.737 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.736+0000 7f13be7fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55814c3d0410 0x55814c3da770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33448/0 (socket says 172.21.15.148:33448) 2024-09-19T07:28:33.737 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.736+0000 7f13be7fc640 1 -- 172.21.15.148:0/2976788035 learned_addr learned my addr 172.21.15.148:0/2976788035 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:28:33.738 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.736+0000 7f13be7fc640 1 -- 172.21.15.148:0/2976788035 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55814c3cfaf0 msgr2=0x55814c3cfed0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T07:28:33.738 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.736+0000 7f13be7fc640 1 --2- 172.21.15.148:0/2976788035 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55814c3cfaf0 0x55814c3cfed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:33.738 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.736+0000 7f13be7fc640 1 -- 172.21.15.148:0/2976788035 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55814c3dacb0 msgr2=0x55814c3dd0a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T07:28:33.738 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.736+0000 7f13be7fc640 1 --2- 172.21.15.148:0/2976788035 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55814c3dacb0 0x55814c3dd0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:33.738 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.736+0000 7f13be7fc640 1 -- 172.21.15.148:0/2976788035 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55814c2db340 con 0x55814c3d0410 2024-09-19T07:28:33.738 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.737+0000 7f13be7fc640 1 --2- 172.21.15.148:0/2976788035 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55814c3d0410 0x55814c3da770 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f13b4009a00 tx=0x7f13b4009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38c865c6f602fe11 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:28:33.738 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.737+0000 7f13a57fa640 1 -- 172.21.15.148:0/2976788035 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b4017070 con 0x55814c3d0410 2024-09-19T07:28:33.738 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.737+0000 7f13a57fa640 1 -- 172.21.15.148:0/2976788035 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13b4013470 con 0x55814c3d0410 2024-09-19T07:28:33.738 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.737+0000 7f13a57fa640 1 -- 172.21.15.148:0/2976788035 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b4012630 con 0x55814c3d0410 2024-09-19T07:28:33.739 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.738+0000 7f13c8427740 1 -- 172.21.15.148:0/2976788035 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55814c3d0410 msgr2=0x55814c3da770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:28:33.740 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.738+0000 7f13c8427740 1 --2- 172.21.15.148:0/2976788035 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55814c3d0410 0x55814c3da770 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f13b4009a00 tx=0x7f13b4009ec0 comp rx=0 tx=0).stop 2024-09-19T07:28:33.740 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.739+0000 7f13c8427740 1 -- 172.21.15.148:0/2976788035 shutdown_connections 2024-09-19T07:28:33.740 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.739+0000 7f13c8427740 1 --2- 172.21.15.148:0/2976788035 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55814c3dacb0 0x55814c3dd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:33.740 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.739+0000 7f13c8427740 1 --2- 172.21.15.148:0/2976788035 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55814c3d0410 0x55814c3da770 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:33.740 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.739+0000 7f13c8427740 1 --2- 172.21.15.148:0/2976788035 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55814c3cfaf0 0x55814c3cfed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:33.740 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.739+0000 7f13c8427740 1 -- 172.21.15.148:0/2976788035 >> 172.21.15.148:0/2976788035 conn(0x55814c3cc060 msgr2=0x55814c3cc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:28:33.740 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.739+0000 7f13beffd640 1 --2- 172.21.15.148:0/94554339 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f13a80a3560 0x7f13a80a5a20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f13b000b230 tx=0x7f13b00058b0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:28:33.740 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.739+0000 7f13c8427740 1 -- 172.21.15.148:0/2976788035 shutdown_connections 2024-09-19T07:28:33.740 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.739+0000 7f13c8427740 1 -- 172.21.15.148:0/2976788035 wait complete. 2024-09-19T07:28:33.740 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.739+0000 7f13c8427740 1 -- start start 2024-09-19T07:28:33.740 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.739+0000 7f13c8427740 1 Processor -- start 2024-09-19T07:28:33.741 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.740+0000 7f13c8427740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55814c3cfaf0 0x55814c3d7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:33.742 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.740+0000 7f13c8427740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55814c3d0410 0x55814c3d8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:33.742 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.740+0000 7f13c8427740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55814c3dacb0 0x55814c3d8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:33.742 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.740+0000 7f13c8427740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55814c3dd880 con 0x55814c3cfaf0 2024-09-19T07:28:33.742 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.740+0000 7f13c8427740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55814c2bd290 con 0x55814c3dacb0 2024-09-19T07:28:33.742 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.740+0000 7f13beffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55814c3cfaf0 0x55814c3d7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:33.742 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.740+0000 7f13c8427740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55814c3dda00 con 0x55814c3d0410 2024-09-19T07:28:33.742 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.740+0000 7f13beffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55814c3cfaf0 0x55814c3d7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33454/0 (socket says 172.21.15.148:33454) 2024-09-19T07:28:33.742 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.740+0000 7f13beffd640 1 -- 172.21.15.148:0/4205664229 learned_addr learned my addr 172.21.15.148:0/4205664229 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:28:33.743 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.740+0000 7f13be7fc640 1 --2- 172.21.15.148:0/4205664229 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55814c3d0410 0x55814c3d8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:33.743 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.740+0000 7f13c8427740 10 client.0 _ll_register_callbacks cb 0x55814c2ee140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:28:33.743 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.740+0000 7f13bf7fe640 1 --2- 172.21.15.148:0/4205664229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55814c3dacb0 0x55814c3d8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:33.743 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.741+0000 7f13be7fc640 1 -- 172.21.15.148:0/4205664229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55814c3dacb0 msgr2=0x55814c3d8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:28:33.743 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.741+0000 7f13be7fc640 1 --2- 172.21.15.148:0/4205664229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55814c3dacb0 0x55814c3d8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:33.743 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.741+0000 7f13be7fc640 1 -- 172.21.15.148:0/4205664229 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55814c3cfaf0 msgr2=0x55814c3d7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:28:33.743 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.741+0000 7f13be7fc640 1 --2- 172.21.15.148:0/4205664229 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55814c3cfaf0 0x55814c3d7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:33.743 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.741+0000 7f13be7fc640 1 -- 172.21.15.148:0/4205664229 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55814c047210 con 0x55814c3d0410 2024-09-19T07:28:33.743 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.741+0000 7f13be7fc640 1 --2- 172.21.15.148:0/4205664229 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55814c3d0410 0x55814c3d8110 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x55814c3ccec0 tx=0x7f13b4013850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4dd43c721a4b32a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:28:33.743 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.741+0000 7f13a2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-19T07:28:33.743 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.741+0000 7f13a2ff5640 1 -- 172.21.15.148:0/4205664229 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b4029060 con 0x55814c3d0410 2024-09-19T07:28:33.743 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.741+0000 7f13a2ff5640 1 -- 172.21.15.148:0/4205664229 <== mon.1 v2:172.21.15.179:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 8600+0+0 (secure 0 0 0) 0x7f13b401c660 con 0x55814c3d0410 2024-09-19T07:28:33.743 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.741+0000 7f13c8427740 1 -- 172.21.15.148:0/4205664229 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13b4013470 con 0x55814c3d0410 2024-09-19T07:28:33.746 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.741+0000 7f13a2ff5640 1 -- 172.21.15.148:0/4205664229 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f13b4017040 con 0x55814c3d0410 2024-09-19T07:28:33.746 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.742+0000 7f13c8427740 10 client.26932 fetch_fsmap learned FSMap version 55 2024-09-19T07:28:33.746 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.742+0000 7f13c8427740 1 -- 172.21.15.148:0/4205664229 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x55814c113620 con 0x55814c3d0410 2024-09-19T07:28:33.746 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.742+0000 7f13a2ff5640 1 -- 172.21.15.148:0/4205664229 <== mon.1 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13b4013470 con 0x55814c3d0410 2024-09-19T07:28:33.746 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.743+0000 7f13a2ff5640 1 -- 172.21.15.148:0/4205664229 <== mon.1 v2:172.21.15.179:3300/0 5 ==== fsmap(e 55) ==== 8370+0+0 (secure 0 0 0) 0x7f13b4012820 con 0x55814c3d0410 2024-09-19T07:28:33.746 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.743+0000 7f13c8427740 10 client.26932 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T07:28:33.746 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.743+0000 7f13c8427740 10 client.26932 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:28:33.746 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.743+0000 7f13c8427740 20 client.26932 populate_metadata read hostname 'smithi148' 2024-09-19T07:28:33.746 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.743+0000 7f13c8427740 1 --2- 172.21.15.148:0/4205664229 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55814c3eab10 0x55814c3ecf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:33.747 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.743+0000 7f13c8427740 4 client.26932 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:28:33.747 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.743+0000 7f13c8427740 1 -- 172.21.15.148:0/4205664229 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55814c341a20 con 0x55814c3eab10 2024-09-19T07:28:33.747 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.743+0000 7f13beffd640 1 --2- 172.21.15.148:0/4205664229 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55814c3eab10 0x55814c3ecf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:33.747 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.744+0000 7f13beffd640 1 --2- 172.21.15.148:0/4205664229 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55814c3eab10 0x55814c3ecf20 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ec82da9b53c46e7 server_cookie=fd2dbc0996754eba in_seq=0 out_seq=0 2024-09-19T07:28:33.747 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.744+0000 7f13a2ff5640 10 client.26932 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:28:33.747 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.745+0000 7f13a2ff5640 1 -- 172.21.15.148:0/4205664229 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55814c341a20 con 0x55814c3eab10 2024-09-19T07:28:33.747 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.745+0000 7f13a2ff5640 10 client.26932 handle_command_reply: tid=0 2024-09-19T07:28:33.747 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.745+0000 7f13c8427740 1 client.26932 shutdown 2024-09-19T07:28:33.747 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.745+0000 7f13c8427740 1 -- 172.21.15.148:0/4205664229 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55814c3d0410 msgr2=0x55814c3d8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:28:33.747 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.745+0000 7f13c8427740 1 --2- 172.21.15.148:0/4205664229 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55814c3d0410 0x55814c3d8110 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x55814c3ccec0 tx=0x7f13b4013850 comp rx=0 tx=0).stop 2024-09-19T07:28:33.747 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.745+0000 7f13c8427740 1 -- 172.21.15.148:0/4205664229 shutdown_connections 2024-09-19T07:28:33.747 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.745+0000 7f13c8427740 1 --2- 172.21.15.148:0/4205664229 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55814c3eab10 0x55814c3ecf20 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:33.747 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.745+0000 7f13c8427740 1 --2- 172.21.15.148:0/4205664229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55814c3dacb0 0x55814c3d8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:33.748 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.745+0000 7f13a2ff5640 0 client.26932 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:28:33.748 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.745+0000 7f13c8427740 1 --2- 172.21.15.148:0/4205664229 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55814c3d0410 0x55814c3d8110 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:33.748 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.745+0000 7f13c8427740 1 --2- 172.21.15.148:0/4205664229 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55814c3cfaf0 0x55814c3d7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:33.748 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.745+0000 7f13c8427740 1 -- 172.21.15.148:0/4205664229 >> 172.21.15.148:0/4205664229 conn(0x55814c3cc060 msgr2=0x55814c3d1dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:28:33.748 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.745+0000 7f13c8427740 1 -- 172.21.15.148:0/4205664229 shutdown_connections 2024-09-19T07:28:33.748 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.746+0000 7f13c8427740 1 -- 172.21.15.148:0/4205664229 wait complete. 2024-09-19T07:28:33.748 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.746+0000 7f13c8427740 20 client.26932 trim_cache size 0 max 16384 2024-09-19T07:28:33.771 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.771+0000 7f13c8427740 1 Processor -- start 2024-09-19T07:28:33.772 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.771+0000 7f13c8427740 1 -- start start 2024-09-19T07:28:33.772 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.771+0000 7f13c8427740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55814c3cfaf0 0x55814c3ecf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:33.772 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.771+0000 7f13c8427740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55814c3d0410 0x55814c3d8480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:33.772 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.772+0000 7f13c8427740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55814c3dacb0 0x55814c3f2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:33.773 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.772+0000 7f13be7fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55814c3d0410 0x55814c3d8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:33.773 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.772+0000 7f13be7fc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55814c3d0410 0x55814c3d8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33458/0 (socket says 172.21.15.148:33458) 2024-09-19T07:28:33.773 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.772+0000 7f13be7fc640 1 -- 172.21.15.148:0/1568537392 learned_addr learned my addr 172.21.15.148:0/1568537392 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:28:33.773 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.772+0000 7f13c8427740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f13ac0111f0 con 0x55814c3d0410 2024-09-19T07:28:33.773 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.772+0000 7f13c8427740 1 -- 172.21.15.148:0/1568537392 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f13ac00ea00 con 0x55814c3dacb0 2024-09-19T07:28:33.773 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.772+0000 7f13c8427740 1 -- 172.21.15.148:0/1568537392 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f13ac00c870 con 0x55814c3cfaf0 2024-09-19T07:28:33.773 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.772+0000 7f13bf7fe640 1 --2- 172.21.15.148:0/1568537392 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55814c3dacb0 0x55814c3f2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:33.774 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.772+0000 7f13bf7fe640 1 -- 172.21.15.148:0/1568537392 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55814c3cfaf0 msgr2=0x55814c3ecf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:28:33.774 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.772+0000 7f13bf7fe640 1 --2- 172.21.15.148:0/1568537392 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55814c3cfaf0 0x55814c3ecf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:33.774 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.772+0000 7f13bf7fe640 1 -- 172.21.15.148:0/1568537392 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55814c3d0410 msgr2=0x55814c3d8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:28:33.774 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.772+0000 7f13bf7fe640 1 --2- 172.21.15.148:0/1568537392 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55814c3d0410 0x55814c3d8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:33.774 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.772+0000 7f13bf7fe640 1 -- 172.21.15.148:0/1568537392 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55814c3d6b60 con 0x55814c3dacb0 2024-09-19T07:28:33.776 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.776+0000 7f13bf7fe640 1 --2- 172.21.15.148:0/1568537392 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55814c3dacb0 0x55814c3f2830 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f13b80deec0 tx=0x7f13b80ad470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6dbe168efe7f6b26 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:28:33.780 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.777+0000 7f13a4ff9640 1 -- 172.21.15.148:0/1568537392 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b802b040 con 0x55814c3dacb0 2024-09-19T07:28:33.780 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.777+0000 7f13a4ff9640 1 -- 172.21.15.148:0/1568537392 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13b80ada50 con 0x55814c3dacb0 2024-09-19T07:28:33.780 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.778+0000 7f13c8427740 1 -- 172.21.15.148:0/1568537392 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55814c3dacb0 msgr2=0x55814c3f2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:28:33.780 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.778+0000 7f13c8427740 1 --2- 172.21.15.148:0/1568537392 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55814c3dacb0 0x55814c3f2830 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f13b80deec0 tx=0x7f13b80ad470 comp rx=0 tx=0).stop 2024-09-19T07:28:33.780 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.779+0000 7f13c8427740 1 -- 172.21.15.148:0/1568537392 shutdown_connections 2024-09-19T07:28:33.780 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.779+0000 7f13c8427740 1 --2- 172.21.15.148:0/1568537392 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55814c3dacb0 0x55814c3f2830 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:33.780 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.779+0000 7f13c8427740 1 --2- 172.21.15.148:0/1568537392 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55814c3d0410 0x55814c3d8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:33.780 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.779+0000 7f13c8427740 1 --2- 172.21.15.148:0/1568537392 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55814c3cfaf0 0x55814c3ecf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:33.780 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.779+0000 7f13c8427740 1 -- 172.21.15.148:0/1568537392 >> 172.21.15.148:0/1568537392 conn(0x55814c3cc060 msgr2=0x55814c3d9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:28:33.786 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.785+0000 7f13c8427740 1 -- 172.21.15.148:0/1568537392 shutdown_connections 2024-09-19T07:28:33.787 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.787+0000 7f13c8427740 1 -- 172.21.15.148:0/1568537392 wait complete. 2024-09-19T07:28:33.787 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.787+0000 7f13c8427740 1 -- start start 2024-09-19T07:28:33.787 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.787+0000 7f13c8427740 1 Processor -- start 2024-09-19T07:28:33.788 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.788+0000 7f13c8427740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55814c3cfaf0 0x55814c3e33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:33.788 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.788+0000 7f13c8427740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55814c3d0410 0x55814c3d48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:33.788 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.788+0000 7f13c8427740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55814c3dacb0 0x55814c3d4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:33.789 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.788+0000 7f13c8427740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f13ac00cec0 con 0x55814c3dacb0 2024-09-19T07:28:33.789 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.788+0000 7f13c8427740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f13ac00e330 con 0x55814c3d0410 2024-09-19T07:28:33.789 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.788+0000 7f13c8427740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f13ac00d590 con 0x55814c3cfaf0 2024-09-19T07:28:33.789 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.788+0000 7f13c8427740 10 client.0 _ll_register_callbacks cb 0x7f13b4009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:28:33.789 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.788+0000 7f13bf7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55814c3dacb0 0x55814c3d4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:33.790 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.789+0000 7f13bf7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55814c3dacb0 0x55814c3d4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33468/0 (socket says 172.21.15.148:33468) 2024-09-19T07:28:33.790 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.789+0000 7f13bf7fe640 1 -- 172.21.15.148:0/1983169381 learned_addr learned my addr 172.21.15.148:0/1983169381 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:28:33.790 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.789+0000 7f13be7fc640 1 --2- 172.21.15.148:0/1983169381 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55814c3d0410 0x55814c3d48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:33.790 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.789+0000 7f13be7fc640 1 -- 172.21.15.148:0/1983169381 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55814c3cfaf0 msgr2=0x55814c3e33b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T07:28:33.790 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.789+0000 7f13be7fc640 1 --2- 172.21.15.148:0/1983169381 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55814c3cfaf0 0x55814c3e33b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:33.790 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.789+0000 7f13be7fc640 1 -- 172.21.15.148:0/1983169381 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55814c3dacb0 msgr2=0x55814c3d4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:28:33.790 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.789+0000 7f13be7fc640 1 --2- 172.21.15.148:0/1983169381 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55814c3dacb0 0x55814c3d4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:33.790 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.789+0000 7f13be7fc640 1 -- 172.21.15.148:0/1983169381 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55814c3d5650 con 0x55814c3d0410 2024-09-19T07:28:33.790 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.789+0000 7f13bf7fe640 1 --2- 172.21.15.148:0/1983169381 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55814c3dacb0 0x55814c3d4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:28:33.790 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.789+0000 7f13be7fc640 1 --2- 172.21.15.148:0/1983169381 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55814c3d0410 0x55814c3d48e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f13b4009a00 tx=0x7f13b40046e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=406c51aa0d1cef1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:28:33.790 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.789+0000 7f13a2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-19T07:28:33.791 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.790+0000 7f13a2ff5640 1 -- 172.21.15.148:0/1983169381 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b4029040 con 0x55814c3d0410 2024-09-19T07:28:33.791 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.790+0000 7f13c8427740 1 -- 172.21.15.148:0/1983169381 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13b80ada50 con 0x55814c3d0410 2024-09-19T07:28:33.791 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.790+0000 7f13a2ff5640 1 -- 172.21.15.148:0/1983169381 <== mon.2 v2:172.21.15.165:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 8600+0+0 (secure 0 0 0) 0x7f13b40123d0 con 0x55814c3d0410 2024-09-19T07:28:33.791 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.790+0000 7f13a2ff5640 1 -- 172.21.15.148:0/1983169381 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f13b403b050 con 0x55814c3d0410 2024-09-19T07:28:33.791 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.790+0000 7f13c8427740 10 client.26822 fetch_fsmap learned FSMap version 55 2024-09-19T07:28:33.791 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.790+0000 7f13c8427740 1 -- 172.21.15.148:0/1983169381 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x55814c4557e0 con 0x55814c3d0410 2024-09-19T07:28:33.791 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.791+0000 7f13a2ff5640 1 -- 172.21.15.148:0/1983169381 <== mon.2 v2:172.21.15.165:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13b80ada50 con 0x55814c3d0410 2024-09-19T07:28:33.792 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.791+0000 7f13a2ff5640 1 -- 172.21.15.148:0/1983169381 <== mon.2 v2:172.21.15.165:3300/0 5 ==== fsmap(e 55) ==== 8370+0+0 (secure 0 0 0) 0x7f13b4003a60 con 0x55814c3d0410 2024-09-19T07:28:33.792 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.791+0000 7f13c8427740 10 client.26822 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T07:28:33.792 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.791+0000 7f13c8427740 10 client.26822 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:28:33.792 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.791+0000 7f13c8427740 20 client.26822 populate_metadata read hostname 'smithi148' 2024-09-19T07:28:33.792 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.791+0000 7f13c8427740 1 --2- 172.21.15.148:0/1983169381 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55814c3eab10 0x55814c457f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:33.792 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.791+0000 7f13c8427740 4 client.26822 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:28:33.792 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.791+0000 7f13c8427740 1 -- 172.21.15.148:0/1983169381 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f13b80aa250 con 0x55814c3eab10 2024-09-19T07:28:33.793 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.792+0000 7f13beffd640 1 --2- 172.21.15.148:0/1983169381 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55814c3eab10 0x55814c457f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:33.794 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.794+0000 7f13a2ff5640 10 client.26822 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:28:33.794 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.794+0000 7f13beffd640 1 --2- 172.21.15.148:0/1983169381 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55814c3eab10 0x55814c457f10 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50193b6b90b48855 server_cookie=1480ed7566c81b26 in_seq=0 out_seq=0 2024-09-19T07:28:33.904 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.903+0000 7f13a2ff5640 1 -- 172.21.15.148:0/1983169381 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f13b80aa250 con 0x55814c3eab10 2024-09-19T07:28:33.904 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.903+0000 7f13a2ff5640 10 client.26822 handle_command_reply: tid=0 2024-09-19T07:28:33.904 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.903+0000 7f13c8427740 1 client.26822 shutdown 2024-09-19T07:28:33.904 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.903+0000 7f13c8427740 1 -- 172.21.15.148:0/1983169381 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55814c3d0410 msgr2=0x55814c3d48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:28:33.904 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.903+0000 7f13c8427740 1 --2- 172.21.15.148:0/1983169381 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55814c3d0410 0x55814c3d48e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f13b4009a00 tx=0x7f13b40046e0 comp rx=0 tx=0).stop 2024-09-19T07:28:33.905 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.903+0000 7f13c8427740 1 -- 172.21.15.148:0/1983169381 shutdown_connections 2024-09-19T07:28:33.905 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.903+0000 7f13c8427740 1 --2- 172.21.15.148:0/1983169381 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55814c3eab10 0x55814c457f10 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:33.905 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.903+0000 7f13c8427740 1 --2- 172.21.15.148:0/1983169381 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55814c3dacb0 0x55814c3d4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:33.905 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.903+0000 7f13c8427740 1 --2- 172.21.15.148:0/1983169381 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55814c3d0410 0x55814c3d48e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:33.905 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.903+0000 7f13c8427740 1 --2- 172.21.15.148:0/1983169381 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55814c3cfaf0 0x55814c3e33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:33.905 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.903+0000 7f13c8427740 1 -- 172.21.15.148:0/1983169381 >> 172.21.15.148:0/1983169381 conn(0x55814c3cc060 msgr2=0x55814c3ca9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:28:33.905 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.903+0000 7f13a2ff5640 0 client.26822 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:28:33.905 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.903+0000 7f13c8427740 1 -- 172.21.15.148:0/1983169381 shutdown_connections 2024-09-19T07:28:33.905 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.904+0000 7f13c8427740 1 -- 172.21.15.148:0/1983169381 wait complete. 2024-09-19T07:28:33.905 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.904+0000 7f13c8427740 20 client.26822 trim_cache size 0 max 16384 2024-09-19T07:28:33.906 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:28:33.906 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:28:33.906 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:28:33.906 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:28:33.906 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.904+0000 7f13c568d640 1 -- 172.21.15.148:0/94554339 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f13a80a3560 msgr2=0x7f13a80a5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:28:33.907 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.904+0000 7f13c568d640 1 --2- 172.21.15.148:0/94554339 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f13a80a3560 0x7f13a80a5a20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f13b000b230 tx=0x7f13b00058b0 comp rx=0 tx=0).stop 2024-09-19T07:28:33.907 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.904+0000 7f13c568d640 1 -- 172.21.15.148:0/94554339 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13c0105ed0 msgr2=0x7f13c0115180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:28:33.907 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.905+0000 7f13c568d640 1 --2- 172.21.15.148:0/94554339 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13c0105ed0 0x7f13c0115180 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f13b801fd90 tx=0x7f13b801d750 comp rx=0 tx=0).stop 2024-09-19T07:28:33.907 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.905+0000 7f13c568d640 1 -- 172.21.15.148:0/94554339 shutdown_connections 2024-09-19T07:28:33.907 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.905+0000 7f13c568d640 1 --2- 172.21.15.148:0/94554339 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f13a80a3560 0x7f13a80a5a20 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:33.907 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.905+0000 7f13c568d640 1 --2- 172.21.15.148:0/94554339 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13c0105ed0 0x7f13c0115180 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:33.907 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.905+0000 7f13c568d640 1 --2- 172.21.15.148:0/94554339 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13c01013c0 0x7f13c0073300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:33.907 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.905+0000 7f13c568d640 1 --2- 172.21.15.148:0/94554339 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13c0100aa0 0x7f13c0072dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:33.907 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.905+0000 7f13c568d640 1 -- 172.21.15.148:0/94554339 >> 172.21.15.148:0/94554339 conn(0x7f13c00fc6e0 msgr2=0x7f13c00fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:28:33.907 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.905+0000 7f13c568d640 1 -- 172.21.15.148:0/94554339 shutdown_connections 2024-09-19T07:28:33.907 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:33.905+0000 7f13c568d640 1 -- 172.21.15.148:0/94554339 wait complete. 2024-09-19T07:28:35.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:28:34 smithi179 ceph-mon[35716]: pgmap v550: 97 pgs: 35 active+clean+snaptrim_wait, 18 active+clean+snaptrim, 44 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 156 op/s 2024-09-19T07:28:35.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:28:34 smithi148 ceph-mon[31180]: pgmap v550: 97 pgs: 35 active+clean+snaptrim_wait, 18 active+clean+snaptrim, 44 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 156 op/s 2024-09-19T07:28:35.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:28:34 smithi165 ceph-mon[35326]: pgmap v550: 97 pgs: 35 active+clean+snaptrim_wait, 18 active+clean+snaptrim, 44 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 156 op/s 2024-09-19T07:28:37.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:28:36 smithi179 ceph-mon[35716]: pgmap v551: 97 pgs: 30 active+clean+snaptrim_wait, 13 active+clean+snaptrim, 54 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 199 op/s 2024-09-19T07:28:37.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:28:36 smithi148 ceph-mon[31180]: pgmap v551: 97 pgs: 30 active+clean+snaptrim_wait, 13 active+clean+snaptrim, 54 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 199 op/s 2024-09-19T07:28:37.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:28:36 smithi165 ceph-mon[35326]: pgmap v551: 97 pgs: 30 active+clean+snaptrim_wait, 13 active+clean+snaptrim, 54 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 199 op/s 2024-09-19T07:28:39.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:28:38 smithi179 ceph-mon[35716]: pgmap v552: 97 pgs: 30 active+clean+snaptrim_wait, 13 active+clean+snaptrim, 54 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 139 op/s 2024-09-19T07:28:39.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:28:38 smithi148 ceph-mon[31180]: pgmap v552: 97 pgs: 30 active+clean+snaptrim_wait, 13 active+clean+snaptrim, 54 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 139 op/s 2024-09-19T07:28:39.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:28:38 smithi165 ceph-mon[35326]: pgmap v552: 97 pgs: 30 active+clean+snaptrim_wait, 13 active+clean+snaptrim, 54 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 139 op/s 2024-09-19T07:28:41.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:28:40 smithi179 ceph-mon[35716]: pgmap v553: 97 pgs: 25 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 61 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 156 op/s 2024-09-19T07:28:41.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:28:40 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:28:41.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:28:40 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:28:41.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:28:40 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:28:41.023 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:28:40 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:28:41.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:28:40 smithi148 ceph-mon[31180]: pgmap v553: 97 pgs: 25 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 61 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 156 op/s 2024-09-19T07:28:41.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:28:40 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:28:41.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:28:40 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:28:41.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:28:40 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:28:41.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:28:40 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:28:41.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:28:40 smithi165 ceph-mon[35326]: pgmap v553: 97 pgs: 25 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 61 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 156 op/s 2024-09-19T07:28:41.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:28:40 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:28:41.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:28:40 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:28:41.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:28:40 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:28:41.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:28:40 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:28:43.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:28:42 smithi179 ceph-mon[35716]: pgmap v554: 97 pgs: 12 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 79 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 219 op/s 2024-09-19T07:28:43.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:28:42 smithi148 ceph-mon[31180]: pgmap v554: 97 pgs: 12 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 79 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 219 op/s 2024-09-19T07:28:43.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:28:42 smithi165 ceph-mon[35326]: pgmap v554: 97 pgs: 12 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 79 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 219 op/s 2024-09-19T07:28:44.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:28:44 smithi179 ceph-mon[35716]: pgmap v555: 97 pgs: 12 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 79 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 159 op/s 2024-09-19T07:28:44.832 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:28:44 smithi148 ceph-mon[31180]: pgmap v555: 97 pgs: 12 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 79 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 159 op/s 2024-09-19T07:28:44.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:28:44 smithi165 ceph-mon[35326]: pgmap v555: 97 pgs: 12 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 79 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 159 op/s 2024-09-19T07:28:46.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:28:46 smithi165 ceph-mon[35326]: pgmap v556: 97 pgs: 6 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 88 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.8 MiB/s wr, 240 op/s 2024-09-19T07:28:47.010 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.010+0000 7f141a453640 1 -- 172.21.15.148:0/418729805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1414102ca0 msgr2=0x7f1414103080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:28:47.011 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.010+0000 7f141a453640 1 --2- 172.21.15.148:0/418729805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1414102ca0 0x7f1414103080 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f1404009900 tx=0x7f140402a410 comp rx=0 tx=0).stop 2024-09-19T07:28:47.011 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.010+0000 7f141a453640 1 -- 172.21.15.148:0/418729805 shutdown_connections 2024-09-19T07:28:47.011 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.010+0000 7f141a453640 1 --2- 172.21.15.148:0/418729805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f141410c0d0 0x7f141410e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:47.011 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.010+0000 7f141a453640 1 --2- 172.21.15.148:0/418729805 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f14141035c0 0x7f141410baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:47.011 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.010+0000 7f141a453640 1 --2- 172.21.15.148:0/418729805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1414102ca0 0x7f1414103080 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:47.011 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.010+0000 7f141a453640 1 -- 172.21.15.148:0/418729805 >> 172.21.15.148:0/418729805 conn(0x7f14140fc6b0 msgr2=0x7f14140fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:28:47.011 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.010+0000 7f141a453640 1 -- 172.21.15.148:0/418729805 shutdown_connections 2024-09-19T07:28:47.011 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.010+0000 7f141a453640 1 -- 172.21.15.148:0/418729805 wait complete. 2024-09-19T07:28:47.012 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.011+0000 7f141a453640 1 Processor -- start 2024-09-19T07:28:47.014 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.014+0000 7f141a453640 1 -- start start 2024-09-19T07:28:47.014 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.014+0000 7f141a453640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1414102ca0 0x7f141419efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:47.014 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.014+0000 7f141a453640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14141035c0 0x7f141419f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:47.014 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.014+0000 7f141a453640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f141410c0d0 0x7f141410ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:47.015 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.014+0000 7f141a453640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1414111f20 con 0x7f1414102ca0 2024-09-19T07:28:47.015 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.014+0000 7f141a453640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1414111da0 con 0x7f141410c0d0 2024-09-19T07:28:47.015 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.014+0000 7f141a453640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f14141120a0 con 0x7f14141035c0 2024-09-19T07:28:47.015 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.014+0000 7f140bfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14141035c0 0x7f141419f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:47.015 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.014+0000 7f140bfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14141035c0 0x7f141419f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:51936/0 (socket says 172.21.15.148:51936) 2024-09-19T07:28:47.015 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.014+0000 7f140bfff640 1 -- 172.21.15.148:0/3620778773 learned_addr learned my addr 172.21.15.148:0/3620778773 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:28:47.015 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.014+0000 7f14189f0640 1 --2- 172.21.15.148:0/3620778773 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f141410c0d0 0x7f141410ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:47.015 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.014+0000 7f1413fff640 1 --2- 172.21.15.148:0/3620778773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1414102ca0 0x7f141419efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:47.016 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.015+0000 7f1413fff640 1 -- 172.21.15.148:0/3620778773 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14141035c0 msgr2=0x7f141419f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:28:47.016 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.015+0000 7f1413fff640 1 --2- 172.21.15.148:0/3620778773 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14141035c0 0x7f141419f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:47.016 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.015+0000 7f1413fff640 1 -- 172.21.15.148:0/3620778773 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f141410c0d0 msgr2=0x7f141410ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:28:47.016 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.015+0000 7f1413fff640 1 --2- 172.21.15.148:0/3620778773 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f141410c0d0 0x7f141410ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:47.016 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.015+0000 7f1413fff640 1 -- 172.21.15.148:0/3620778773 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f141410b450 con 0x7f1414102ca0 2024-09-19T07:28:47.016 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.016+0000 7f1413fff640 1 --2- 172.21.15.148:0/3620778773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1414102ca0 0x7f141419efb0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f140402a930 tx=0x7f1404003b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:28:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.016+0000 7f1411ffb640 1 -- 172.21.15.148:0/3620778773 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f140403f070 con 0x7f1414102ca0 2024-09-19T07:28:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.016+0000 7f141a453640 1 -- 172.21.15.148:0/3620778773 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f141410b6e0 con 0x7f1414102ca0 2024-09-19T07:28:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.016+0000 7f141a453640 1 -- 172.21.15.148:0/3620778773 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f141419abd0 con 0x7f1414102ca0 2024-09-19T07:28:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.017+0000 7f1411ffb640 1 -- 172.21.15.148:0/3620778773 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1404031c90 con 0x7f1414102ca0 2024-09-19T07:28:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.017+0000 7f1411ffb640 1 -- 172.21.15.148:0/3620778773 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1404035030 con 0x7f1414102ca0 2024-09-19T07:28:47.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.020+0000 7f141d1ee740 1 Processor -- start 2024-09-19T07:28:47.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.020+0000 7f1411ffb640 1 -- 172.21.15.148:0/3620778773 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f1404042070 con 0x7f1414102ca0 2024-09-19T07:28:47.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.020+0000 7f141d1ee740 1 -- start start 2024-09-19T07:28:47.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.020+0000 7f141d1ee740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633b9ab6af0 0x5633b9ab6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:47.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.020+0000 7f141d1ee740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633b9ab7410 0x5633b9ac1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:47.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.020+0000 7f141d1ee740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633b9ac1cb0 0x5633b9ac40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:47.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.020+0000 7f141d1ee740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5633b9a1b2f0 con 0x5633b9ab6af0 2024-09-19T07:28:47.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.020+0000 7f141d1ee740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5633b99c3270 con 0x5633b9ab7410 2024-09-19T07:28:47.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.020+0000 7f141d1ee740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5633b9a172b0 con 0x5633b9ac1cb0 2024-09-19T07:28:47.022 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.020+0000 7f14189f0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633b9ab6af0 0x5633b9ab6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:47.023 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.020+0000 7f14189f0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633b9ab6af0 0x5633b9ab6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59170/0 (socket says 172.21.15.148:59170) 2024-09-19T07:28:47.023 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.020+0000 7f14189f0640 1 -- 172.21.15.148:0/2373153630 learned_addr learned my addr 172.21.15.148:0/2373153630 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:28:47.023 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.020+0000 7f140bfff640 1 --2- 172.21.15.148:0/2373153630 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633b9ac1cb0 0x5633b9ac40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:47.023 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.020+0000 7f1413fff640 1 --2- 172.21.15.148:0/2373153630 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633b9ab7410 0x5633b9ac1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:47.023 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.021+0000 7f14189f0640 1 -- 172.21.15.148:0/2373153630 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633b9ac1cb0 msgr2=0x5633b9ac40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:28:47.023 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.021+0000 7f14189f0640 1 --2- 172.21.15.148:0/2373153630 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633b9ac1cb0 0x5633b9ac40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:47.023 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.021+0000 7f14189f0640 1 -- 172.21.15.148:0/2373153630 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633b9ab7410 msgr2=0x5633b9ac1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:28:47.023 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.021+0000 7f14189f0640 1 --2- 172.21.15.148:0/2373153630 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633b9ab7410 0x5633b9ac1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:47.023 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.021+0000 7f14189f0640 1 -- 172.21.15.148:0/2373153630 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633b99c2340 con 0x5633b9ab6af0 2024-09-19T07:28:47.023 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.021+0000 7f1411ffb640 1 --2- 172.21.15.148:0/3620778773 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f14000a35c0 0x7f14000a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:47.023 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.021+0000 7f1413fff640 1 --2- 172.21.15.148:0/3620778773 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f14000a35c0 0x7f14000a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:47.023 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.021+0000 7f14189f0640 1 --2- 172.21.15.148:0/2373153630 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633b9ab6af0 0x5633b9ab6ed0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f140c009f30 tx=0x7f140c0118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=409d68feba3bddf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:28:47.023 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.021+0000 7f1411ffb640 1 -- 172.21.15.148:0/3620778773 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 8600+0+0 (secure 0 0 0) 0x7f14040f0380 con 0x7f1414102ca0 2024-09-19T07:28:47.024 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.021+0000 7f140a7fc640 1 -- 172.21.15.148:0/2373153630 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f140c004d20 con 0x5633b9ab6af0 2024-09-19T07:28:47.024 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.021+0000 7f140a7fc640 1 -- 172.21.15.148:0/2373153630 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f140c004050 con 0x5633b9ab6af0 2024-09-19T07:28:47.024 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.021+0000 7f140a7fc640 1 -- 172.21.15.148:0/2373153630 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f140c005280 con 0x5633b9ab6af0 2024-09-19T07:28:47.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:28:46 smithi179 ceph-mon[35716]: pgmap v556: 97 pgs: 6 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 88 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.8 MiB/s wr, 240 op/s 2024-09-19T07:28:47.025 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.022+0000 7f141d1ee740 1 -- 172.21.15.148:0/2373153630 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633b9ab6af0 msgr2=0x5633b9ab6ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:28:47.025 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.022+0000 7f1413fff640 1 --2- 172.21.15.148:0/3620778773 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f14000a35c0 0x7f14000a5a80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f14040edb30 tx=0x7f14040f3ed0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:28:47.025 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.022+0000 7f141d1ee740 1 --2- 172.21.15.148:0/2373153630 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633b9ab6af0 0x5633b9ab6ed0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f140c009f30 tx=0x7f140c0118d0 comp rx=0 tx=0).stop 2024-09-19T07:28:47.026 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.022+0000 7f141d1ee740 1 -- 172.21.15.148:0/2373153630 shutdown_connections 2024-09-19T07:28:47.026 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.022+0000 7f141d1ee740 1 --2- 172.21.15.148:0/2373153630 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633b9ac1cb0 0x5633b9ac40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:47.026 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.022+0000 7f141d1ee740 1 --2- 172.21.15.148:0/2373153630 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633b9ab7410 0x5633b9ac1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:47.026 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.022+0000 7f141d1ee740 1 --2- 172.21.15.148:0/2373153630 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633b9ab6af0 0x5633b9ab6ed0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:47.026 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.022+0000 7f141d1ee740 1 -- 172.21.15.148:0/2373153630 >> 172.21.15.148:0/2373153630 conn(0x5633b9ab3060 msgr2=0x5633b9ab3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:28:47.026 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.022+0000 7f141d1ee740 1 -- 172.21.15.148:0/2373153630 shutdown_connections 2024-09-19T07:28:47.026 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.022+0000 7f141d1ee740 1 -- 172.21.15.148:0/2373153630 wait complete. 2024-09-19T07:28:47.026 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.023+0000 7f141d1ee740 1 -- start start 2024-09-19T07:28:47.026 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.023+0000 7f141d1ee740 1 Processor -- start 2024-09-19T07:28:47.026 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.023+0000 7f141d1ee740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633b9ab6af0 0x5633b9abea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:47.026 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.024+0000 7f141d1ee740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633b9ab7410 0x5633b9abefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:47.026 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.024+0000 7f141d1ee740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633b9ac1cb0 0x5633b9abf510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:47.026 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.024+0000 7f141d1ee740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5633b9ac4880 con 0x5633b9ab6af0 2024-09-19T07:28:47.027 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.024+0000 7f141d1ee740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5633b99a4290 con 0x5633b9ab7410 2024-09-19T07:28:47.027 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.024+0000 7f141d1ee740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5633b9ac4a00 con 0x5633b9ac1cb0 2024-09-19T07:28:47.027 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.024+0000 7f141d1ee740 10 client.0 _ll_register_callbacks cb 0x5633b99d5140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:28:47.027 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.024+0000 7f14189f0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633b9ac1cb0 0x5633b9abf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:47.027 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.024+0000 7f14189f0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633b9ac1cb0 0x5633b9abf510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:51960/0 (socket says 172.21.15.148:51960) 2024-09-19T07:28:47.027 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.024+0000 7f14189f0640 1 -- 172.21.15.148:0/1890607750 learned_addr learned my addr 172.21.15.148:0/1890607750 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:28:47.027 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.024+0000 7f14189f0640 1 --2- 172.21.15.148:0/1890607750 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633b9ab6af0 0x5633b9abea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:47.027 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.025+0000 7f14189f0640 1 -- 172.21.15.148:0/1890607750 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633b9ab7410 msgr2=0x5633b9abefd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T07:28:47.027 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.025+0000 7f14189f0640 1 --2- 172.21.15.148:0/1890607750 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633b9ab7410 0x5633b9abefd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:47.027 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.025+0000 7f14189f0640 1 -- 172.21.15.148:0/1890607750 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633b9ab6af0 msgr2=0x5633b9abea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:28:47.027 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.025+0000 7f14189f0640 1 --2- 172.21.15.148:0/1890607750 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633b9ab6af0 0x5633b9abea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:47.027 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.025+0000 7f14189f0640 1 -- 172.21.15.148:0/1890607750 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633b972e210 con 0x5633b9ac1cb0 2024-09-19T07:28:47.027 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.025+0000 7f14189f0640 1 --2- 172.21.15.148:0/1890607750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633b9ac1cb0 0x5633b9abf510 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f140c004990 tx=0x7f140c005bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e92f142d7ef2defa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:28:47.028 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.027+0000 7f13f37fe640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-19T07:28:47.028 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.027+0000 7f13f37fe640 1 -- 172.21.15.148:0/1890607750 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f140c049450 con 0x5633b9ac1cb0 2024-09-19T07:28:47.029 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.027+0000 7f141d1ee740 1 -- 172.21.15.148:0/1890607750 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f140c004050 con 0x5633b9ac1cb0 2024-09-19T07:28:47.029 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.027+0000 7f13f37fe640 1 -- 172.21.15.148:0/1890607750 <== mon.1 v2:172.21.15.179:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 8600+0+0 (secure 0 0 0) 0x7f140c0495f0 con 0x5633b9ac1cb0 2024-09-19T07:28:47.029 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.027+0000 7f13f37fe640 1 -- 172.21.15.148:0/1890607750 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f140c0497f0 con 0x5633b9ac1cb0 2024-09-19T07:28:47.029 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.028+0000 7f141d1ee740 10 client.26944 fetch_fsmap learned FSMap version 55 2024-09-19T07:28:47.029 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.028+0000 7f141d1ee740 1 -- 172.21.15.148:0/1890607750 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x5633b97fa620 con 0x5633b9ac1cb0 2024-09-19T07:28:47.029 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.028+0000 7f13f37fe640 1 -- 172.21.15.148:0/1890607750 <== mon.1 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f140c004050 con 0x5633b9ac1cb0 2024-09-19T07:28:47.029 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.028+0000 7f13f37fe640 1 -- 172.21.15.148:0/1890607750 <== mon.1 v2:172.21.15.179:3300/0 5 ==== fsmap(e 55) ==== 8370+0+0 (secure 0 0 0) 0x7f140c025b40 con 0x5633b9ac1cb0 2024-09-19T07:28:47.029 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.028+0000 7f141d1ee740 10 client.26944 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T07:28:47.029 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.028+0000 7f141d1ee740 10 client.26944 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:28:47.030 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.028+0000 7f141d1ee740 20 client.26944 populate_metadata read hostname 'smithi148' 2024-09-19T07:28:47.030 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.028+0000 7f141d1ee740 1 --2- 172.21.15.148:0/1890607750 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5633b9ad1af0 0x5633b9ad3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:47.030 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.028+0000 7f141d1ee740 4 client.26944 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:28:47.030 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.028+0000 7f141d1ee740 1 -- 172.21.15.148:0/1890607750 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5633b9a28a20 con 0x5633b9ad1af0 2024-09-19T07:28:47.030 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.029+0000 7f140bfff640 1 --2- 172.21.15.148:0/1890607750 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5633b9ad1af0 0x5633b9ad3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:47.030 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.030+0000 7f140bfff640 1 --2- 172.21.15.148:0/1890607750 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5633b9ad1af0 0x5633b9ad3ee0 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb06dafeb20ee9cf server_cookie=cfacaf1b658915f6 in_seq=0 out_seq=0 2024-09-19T07:28:47.030 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.030+0000 7f13f37fe640 10 client.26944 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:28:47.033 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.033+0000 7f13f37fe640 1 -- 172.21.15.148:0/1890607750 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5633b9a28a20 con 0x5633b9ad1af0 2024-09-19T07:28:47.033 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.033+0000 7f13f37fe640 10 client.26944 handle_command_reply: tid=0 2024-09-19T07:28:47.033 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.033+0000 7f141d1ee740 1 client.26944 shutdown 2024-09-19T07:28:47.034 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.033+0000 7f141d1ee740 1 -- 172.21.15.148:0/1890607750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633b9ac1cb0 msgr2=0x5633b9abf510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:28:47.034 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.033+0000 7f141d1ee740 1 --2- 172.21.15.148:0/1890607750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633b9ac1cb0 0x5633b9abf510 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f140c004990 tx=0x7f140c005bd0 comp rx=0 tx=0).stop 2024-09-19T07:28:47.034 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.033+0000 7f141d1ee740 1 -- 172.21.15.148:0/1890607750 shutdown_connections 2024-09-19T07:28:47.034 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.033+0000 7f141d1ee740 1 --2- 172.21.15.148:0/1890607750 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5633b9ad1af0 0x5633b9ad3ee0 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:47.034 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.033+0000 7f141d1ee740 1 --2- 172.21.15.148:0/1890607750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633b9ac1cb0 0x5633b9abf510 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:47.034 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.033+0000 7f141d1ee740 1 --2- 172.21.15.148:0/1890607750 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633b9ab7410 0x5633b9abefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:47.034 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.033+0000 7f141d1ee740 1 --2- 172.21.15.148:0/1890607750 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633b9ab6af0 0x5633b9abea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:47.034 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.033+0000 7f141d1ee740 1 -- 172.21.15.148:0/1890607750 >> 172.21.15.148:0/1890607750 conn(0x5633b9ab3060 msgr2=0x5633b9ab8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:28:47.035 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.033+0000 7f13f37fe640 0 client.26944 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:28:47.035 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.033+0000 7f141d1ee740 1 -- 172.21.15.148:0/1890607750 shutdown_connections 2024-09-19T07:28:47.035 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.033+0000 7f141d1ee740 1 -- 172.21.15.148:0/1890607750 wait complete. 2024-09-19T07:28:47.035 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.033+0000 7f141d1ee740 20 client.26944 trim_cache size 0 max 16384 2024-09-19T07:28:47.054 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.053+0000 7f141d1ee740 1 Processor -- start 2024-09-19T07:28:47.054 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.053+0000 7f141d1ee740 1 -- start start 2024-09-19T07:28:47.054 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.053+0000 7f141d1ee740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633b9ab6af0 0x5633b9abf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:47.054 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.053+0000 7f141d1ee740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633b9ab7410 0x5633b9ac0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:47.054 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.053+0000 7f141d1ee740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633b9ac1cb0 0x5633b9ad9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:47.054 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.053+0000 7f141d1ee740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f13f4011280 con 0x5633b9ab6af0 2024-09-19T07:28:47.055 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.053+0000 7f141d1ee740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f13f400ea90 con 0x5633b9ac1cb0 2024-09-19T07:28:47.055 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.053+0000 7f141d1ee740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f13f400c900 con 0x5633b9ab7410 2024-09-19T07:28:47.055 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.053+0000 7f140bfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633b9ab7410 0x5633b9ac0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:47.055 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.053+0000 7f14189f0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633b9ab6af0 0x5633b9abf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:47.055 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.053+0000 7f140bfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633b9ab7410 0x5633b9ac0a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:51970/0 (socket says 172.21.15.148:51970) 2024-09-19T07:28:47.055 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.054+0000 7f140bfff640 1 -- 172.21.15.148:0/3375771685 learned_addr learned my addr 172.21.15.148:0/3375771685 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:28:47.055 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.054+0000 7f14189f0640 1 --2- 172.21.15.148:0/3375771685 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633b9ac1cb0 0x5633b9ad9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:47.055 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.054+0000 7f14189f0640 1 -- 172.21.15.148:0/3375771685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633b9ab7410 msgr2=0x5633b9ac0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:28:47.055 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.054+0000 7f14189f0640 1 --2- 172.21.15.148:0/3375771685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633b9ab7410 0x5633b9ac0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:47.055 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.054+0000 7f14189f0640 1 -- 172.21.15.148:0/3375771685 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633b9ac1cb0 msgr2=0x5633b9ad9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:28:47.055 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.054+0000 7f14189f0640 1 --2- 172.21.15.148:0/3375771685 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633b9ac1cb0 0x5633b9ad9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:47.055 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.054+0000 7f14189f0640 1 -- 172.21.15.148:0/3375771685 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633b9ab2e90 con 0x5633b9ab6af0 2024-09-19T07:28:47.063 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.054+0000 7f14189f0640 1 --2- 172.21.15.148:0/3375771685 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633b9ab6af0 0x5633b9abf340 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f140c009d40 tx=0x7f140c0118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b762c99c8fdcb77 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:28:47.063 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.054+0000 7f1409ffb640 1 -- 172.21.15.148:0/3375771685 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f140c009e00 con 0x5633b9ab6af0 2024-09-19T07:28:47.063 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.055+0000 7f1409ffb640 1 -- 172.21.15.148:0/3375771685 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f140c015070 con 0x5633b9ab6af0 2024-09-19T07:28:47.063 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.055+0000 7f1409ffb640 1 -- 172.21.15.148:0/3375771685 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f140c003dc0 con 0x5633b9ab6af0 2024-09-19T07:28:47.064 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.056+0000 7f141d1ee740 1 -- 172.21.15.148:0/3375771685 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633b9ab6af0 msgr2=0x5633b9abf340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:28:47.064 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.056+0000 7f141d1ee740 1 --2- 172.21.15.148:0/3375771685 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633b9ab6af0 0x5633b9abf340 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f140c009d40 tx=0x7f140c0118d0 comp rx=0 tx=0).stop 2024-09-19T07:28:47.064 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.056+0000 7f141d1ee740 1 -- 172.21.15.148:0/3375771685 shutdown_connections 2024-09-19T07:28:47.064 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.056+0000 7f141d1ee740 1 --2- 172.21.15.148:0/3375771685 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633b9ac1cb0 0x5633b9ad9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:47.064 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.056+0000 7f141d1ee740 1 --2- 172.21.15.148:0/3375771685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633b9ab7410 0x5633b9ac0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:47.064 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.056+0000 7f141d1ee740 1 --2- 172.21.15.148:0/3375771685 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633b9ab6af0 0x5633b9abf340 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:47.064 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.056+0000 7f141d1ee740 1 -- 172.21.15.148:0/3375771685 >> 172.21.15.148:0/3375771685 conn(0x5633b9ab3060 msgr2=0x5633b9ac02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:28:47.064 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.056+0000 7f141d1ee740 1 -- 172.21.15.148:0/3375771685 shutdown_connections 2024-09-19T07:28:47.064 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.056+0000 7f141d1ee740 1 -- 172.21.15.148:0/3375771685 wait complete. 2024-09-19T07:28:47.064 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.056+0000 7f141d1ee740 1 -- start start 2024-09-19T07:28:47.064 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.056+0000 7f141d1ee740 1 Processor -- start 2024-09-19T07:28:47.065 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.057+0000 7f141d1ee740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633b9ab6af0 0x5633b9abb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:47.065 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.057+0000 7f141d1ee740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633b9ab7410 0x5633b9abb610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:47.065 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.057+0000 7f141d1ee740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633b9ac1cb0 0x5633b9ac8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:47.065 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.057+0000 7f14189f0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633b9ab6af0 0x5633b9abb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:47.065 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.057+0000 7f14189f0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633b9ab6af0 0x5633b9abb0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59206/0 (socket says 172.21.15.148:59206) 2024-09-19T07:28:47.065 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.057+0000 7f14189f0640 1 -- 172.21.15.148:0/2507537819 learned_addr learned my addr 172.21.15.148:0/2507537819 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:28:47.065 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.057+0000 7f141d1ee740 1 -- 172.21.15.148:0/2507537819 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f13f400cf50 con 0x5633b9ab6af0 2024-09-19T07:28:47.065 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.057+0000 7f141d1ee740 1 -- 172.21.15.148:0/2507537819 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f13f400e3c0 con 0x5633b9ac1cb0 2024-09-19T07:28:47.065 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.057+0000 7f141d1ee740 1 -- 172.21.15.148:0/2507537819 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f13f400d620 con 0x5633b9ab7410 2024-09-19T07:28:47.065 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.057+0000 7f141d1ee740 10 client.0 _ll_register_callbacks cb 0x7f14040f3da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:28:47.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.057+0000 7f140bfff640 1 --2- 172.21.15.148:0/2507537819 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633b9ab7410 0x5633b9abb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:47.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.057+0000 7f14189f0640 1 -- 172.21.15.148:0/2507537819 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633b9ab7410 msgr2=0x5633b9abb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:28:47.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.057+0000 7f14189f0640 1 --2- 172.21.15.148:0/2507537819 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633b9ab7410 0x5633b9abb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:47.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.057+0000 7f14189f0640 1 -- 172.21.15.148:0/2507537819 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633b9ac1cb0 msgr2=0x5633b9ac8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:28:47.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.057+0000 7f14189f0640 1 --2- 172.21.15.148:0/2507537819 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633b9ac1cb0 0x5633b9ac8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:47.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.057+0000 7f14189f0640 1 -- 172.21.15.148:0/2507537819 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633b9aae2d0 con 0x5633b9ab6af0 2024-09-19T07:28:47.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.057+0000 7f140bfff640 1 --2- 172.21.15.148:0/2507537819 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633b9ab7410 0x5633b9abb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:28:47.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.058+0000 7f14189f0640 1 --2- 172.21.15.148:0/2507537819 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633b9ab6af0 0x5633b9abb0d0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f140c002230 tx=0x7f140c004690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=befbb0ea004cb96 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:28:47.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.058+0000 7f13f37fe640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:28:47.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.058+0000 7f13f37fe640 1 -- 172.21.15.148:0/2507537819 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f140c06f060 con 0x5633b9ab6af0 2024-09-19T07:28:47.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.058+0000 7f13f37fe640 1 -- 172.21.15.148:0/2507537819 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 8600+0+0 (secure 0 0 0) 0x7f140c049990 con 0x5633b9ab6af0 2024-09-19T07:28:47.066 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.058+0000 7f141d1ee740 1 -- 172.21.15.148:0/2507537819 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f140c015070 con 0x5633b9ab6af0 2024-09-19T07:28:47.067 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.058+0000 7f13f37fe640 1 -- 172.21.15.148:0/2507537819 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f140c00f480 con 0x5633b9ab6af0 2024-09-19T07:28:47.067 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.058+0000 7f141d1ee740 10 client.17853 fetch_fsmap learned FSMap version 55 2024-09-19T07:28:47.067 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.058+0000 7f141d1ee740 1 -- 172.21.15.148:0/2507537819 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x5633b9aca1d0 con 0x5633b9ab6af0 2024-09-19T07:28:47.067 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.058+0000 7f13f37fe640 1 -- 172.21.15.148:0/2507537819 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f140c015070 con 0x5633b9ab6af0 2024-09-19T07:28:47.067 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.059+0000 7f13f37fe640 1 -- 172.21.15.148:0/2507537819 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 55) ==== 8370+0+0 (secure 0 0 0) 0x7f140c0256c0 con 0x5633b9ab6af0 2024-09-19T07:28:47.067 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.059+0000 7f141d1ee740 10 client.17853 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T07:28:47.067 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.059+0000 7f141d1ee740 10 client.17853 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:28:47.067 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.059+0000 7f141d1ee740 20 client.17853 populate_metadata read hostname 'smithi148' 2024-09-19T07:28:47.067 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.059+0000 7f141d1ee740 1 --2- 172.21.15.148:0/2507537819 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5633b9b3c720 0x5633b9b3eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:28:47.067 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.059+0000 7f141d1ee740 4 client.17853 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:28:47.067 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.059+0000 7f141d1ee740 1 -- 172.21.15.148:0/2507537819 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5633b9a22d70 con 0x5633b9b3c720 2024-09-19T07:28:47.067 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.059+0000 7f140bfff640 1 --2- 172.21.15.148:0/2507537819 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5633b9b3c720 0x5633b9b3eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:28:47.067 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.060+0000 7f13f37fe640 10 client.17853 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:28:47.067 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.060+0000 7f140bfff640 1 --2- 172.21.15.148:0/2507537819 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5633b9b3c720 0x5633b9b3eb10 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=246574faf030ea30 server_cookie=cc314d3240c44864 in_seq=0 out_seq=0 2024-09-19T07:28:47.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:28:46 smithi148 ceph-mon[31180]: pgmap v556: 97 pgs: 6 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 88 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.8 MiB/s wr, 240 op/s 2024-09-19T07:28:47.089 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.088+0000 7f13f37fe640 1 -- 172.21.15.148:0/2507537819 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5633b9a22d70 con 0x5633b9b3c720 2024-09-19T07:28:47.089 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.088+0000 7f13f37fe640 10 client.17853 handle_command_reply: tid=0 2024-09-19T07:28:47.089 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.088+0000 7f141d1ee740 1 client.17853 shutdown 2024-09-19T07:28:47.089 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.088+0000 7f141d1ee740 1 -- 172.21.15.148:0/2507537819 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633b9ab6af0 msgr2=0x5633b9abb0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:28:47.089 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.088+0000 7f141d1ee740 1 --2- 172.21.15.148:0/2507537819 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633b9ab6af0 0x5633b9abb0d0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f140c002230 tx=0x7f140c004690 comp rx=0 tx=0).stop 2024-09-19T07:28:47.089 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.088+0000 7f141d1ee740 1 -- 172.21.15.148:0/2507537819 shutdown_connections 2024-09-19T07:28:47.089 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.088+0000 7f141d1ee740 1 --2- 172.21.15.148:0/2507537819 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5633b9b3c720 0x5633b9b3eb10 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:47.090 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.088+0000 7f141d1ee740 1 --2- 172.21.15.148:0/2507537819 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633b9ac1cb0 0x5633b9ac8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:47.090 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.088+0000 7f141d1ee740 1 --2- 172.21.15.148:0/2507537819 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5633b9ab7410 0x5633b9abb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:47.090 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.088+0000 7f13f37fe640 0 client.17853 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:28:47.090 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.088+0000 7f141d1ee740 1 --2- 172.21.15.148:0/2507537819 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5633b9ab6af0 0x5633b9abb0d0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:47.090 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.088+0000 7f141d1ee740 1 -- 172.21.15.148:0/2507537819 >> 172.21.15.148:0/2507537819 conn(0x5633b9ab3060 msgr2=0x5633b9ab21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:28:47.090 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.089+0000 7f141d1ee740 1 -- 172.21.15.148:0/2507537819 shutdown_connections 2024-09-19T07:28:47.090 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.089+0000 7f141d1ee740 1 -- 172.21.15.148:0/2507537819 wait complete. 2024-09-19T07:28:47.090 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.089+0000 7f141d1ee740 20 client.17853 trim_cache size 0 max 16384 2024-09-19T07:28:47.090 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:28:47.090 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:28:47.091 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:28:47.091 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:28:47.091 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.089+0000 7f141a453640 1 -- 172.21.15.148:0/3620778773 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f14000a35c0 msgr2=0x7f14000a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:28:47.092 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.089+0000 7f141a453640 1 --2- 172.21.15.148:0/3620778773 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f14000a35c0 0x7f14000a5a80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f14040edb30 tx=0x7f14040f3ed0 comp rx=0 tx=0).stop 2024-09-19T07:28:47.092 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.089+0000 7f141a453640 1 -- 172.21.15.148:0/3620778773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1414102ca0 msgr2=0x7f141419efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:28:47.092 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.089+0000 7f141a453640 1 --2- 172.21.15.148:0/3620778773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1414102ca0 0x7f141419efb0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f140402a930 tx=0x7f1404003b20 comp rx=0 tx=0).stop 2024-09-19T07:28:47.092 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.089+0000 7f141a453640 1 -- 172.21.15.148:0/3620778773 shutdown_connections 2024-09-19T07:28:47.092 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.089+0000 7f141a453640 1 --2- 172.21.15.148:0/3620778773 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f14000a35c0 0x7f14000a5a80 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:47.092 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.089+0000 7f141a453640 1 --2- 172.21.15.148:0/3620778773 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f141410c0d0 0x7f141410ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:47.092 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.089+0000 7f141a453640 1 --2- 172.21.15.148:0/3620778773 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14141035c0 0x7f141419f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:47.092 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.089+0000 7f141a453640 1 --2- 172.21.15.148:0/3620778773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1414102ca0 0x7f141419efb0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:28:47.092 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.089+0000 7f141a453640 1 -- 172.21.15.148:0/3620778773 >> 172.21.15.148:0/3620778773 conn(0x7f14140fc6b0 msgr2=0x7f14140feaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:28:47.092 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.090+0000 7f141a453640 1 -- 172.21.15.148:0/3620778773 shutdown_connections 2024-09-19T07:28:47.092 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:28:47.090+0000 7f141a453640 1 -- 172.21.15.148:0/3620778773 wait complete. 2024-09-19T07:28:48.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:28:48 smithi165 ceph-mon[35326]: pgmap v557: 97 pgs: 6 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 88 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 190 op/s 2024-09-19T07:28:49.037 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:28:48 smithi179 ceph-mon[35716]: pgmap v557: 97 pgs: 6 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 88 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 190 op/s 2024-09-19T07:28:49.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:28:48 smithi148 ceph-mon[31180]: pgmap v557: 97 pgs: 6 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 88 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 190 op/s 2024-09-19T07:28:50.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:28:50 smithi165 ceph-mon[35326]: pgmap v558: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 216 op/s 2024-09-19T07:28:51.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:28:50 smithi179 ceph-mon[35716]: pgmap v558: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 216 op/s 2024-09-19T07:28:51.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:28:50 smithi148 ceph-mon[31180]: pgmap v558: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 216 op/s 2024-09-19T07:28:52.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:28:52 smithi165 ceph-mon[35326]: pgmap v559: 97 pgs: 97 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.5 MiB/s wr, 318 op/s 2024-09-19T07:28:53.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:28:52 smithi179 ceph-mon[35716]: pgmap v559: 97 pgs: 97 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.5 MiB/s wr, 318 op/s 2024-09-19T07:28:53.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:28:52 smithi148 ceph-mon[31180]: pgmap v559: 97 pgs: 97 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.5 MiB/s wr, 318 op/s 2024-09-19T07:28:54.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:28:54 smithi179 ceph-mon[35716]: osdmap e104: 12 total, 12 up, 12 in 2024-09-19T07:28:54.772 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:28:54 smithi179 ceph-mon[35716]: pgmap v561: 97 pgs: 97 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.3 MiB/s wr, 298 op/s 2024-09-19T07:28:54.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:28:54 smithi148 ceph-mon[31180]: osdmap e104: 12 total, 12 up, 12 in 2024-09-19T07:28:54.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:28:54 smithi148 ceph-mon[31180]: pgmap v561: 97 pgs: 97 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.3 MiB/s wr, 298 op/s 2024-09-19T07:28:54.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:28:54 smithi165 ceph-mon[35326]: osdmap e104: 12 total, 12 up, 12 in 2024-09-19T07:28:54.884 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:28:54 smithi165 ceph-mon[35326]: pgmap v561: 97 pgs: 97 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.3 MiB/s wr, 298 op/s 2024-09-19T07:28:56.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:28:56 smithi165 ceph-mon[35326]: pgmap v562: 97 pgs: 97 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.5 MiB/s wr, 367 op/s 2024-09-19T07:28:57.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:28:56 smithi179 ceph-mon[35716]: pgmap v562: 97 pgs: 97 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.5 MiB/s wr, 367 op/s 2024-09-19T07:28:57.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:28:56 smithi148 ceph-mon[31180]: pgmap v562: 97 pgs: 97 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.5 MiB/s wr, 367 op/s 2024-09-19T07:28:58.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:28:58 smithi165 ceph-mon[35326]: pgmap v563: 97 pgs: 97 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.5 MiB/s wr, 367 op/s 2024-09-19T07:28:59.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:28:58 smithi179 ceph-mon[35716]: pgmap v563: 97 pgs: 97 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.5 MiB/s wr, 367 op/s 2024-09-19T07:28:59.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:28:58 smithi148 ceph-mon[31180]: pgmap v563: 97 pgs: 97 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.5 MiB/s wr, 367 op/s 2024-09-19T07:29:00.218 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.216+0000 7f7172713640 1 -- 172.21.15.148:0/190142883 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f716c1011d0 msgr2=0x7f716c10de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:00.219 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.216+0000 7f7172713640 1 --2- 172.21.15.148:0/190142883 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f716c1011d0 0x7f716c10de90 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f7160009900 tx=0x7f716002a410 comp rx=0 tx=0).stop 2024-09-19T07:29:00.219 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.217+0000 7f7172713640 1 -- 172.21.15.148:0/190142883 shutdown_connections 2024-09-19T07:29:00.219 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.217+0000 7f7172713640 1 --2- 172.21.15.148:0/190142883 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f716c10e3d0 0x7f716c1107c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:00.219 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.217+0000 7f7172713640 1 --2- 172.21.15.148:0/190142883 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f716c1011d0 0x7f716c10de90 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:00.219 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.217+0000 7f7172713640 1 --2- 172.21.15.148:0/190142883 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f716c1008b0 0x7f716c100c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:00.219 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.217+0000 7f7172713640 1 -- 172.21.15.148:0/190142883 >> 172.21.15.148:0/190142883 conn(0x7f716c0fc6b0 msgr2=0x7f716c0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:00.219 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.217+0000 7f7172713640 1 -- 172.21.15.148:0/190142883 shutdown_connections 2024-09-19T07:29:00.219 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.217+0000 7f7172713640 1 -- 172.21.15.148:0/190142883 wait complete. 2024-09-19T07:29:00.220 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.217+0000 7f7172713640 1 Processor -- start 2024-09-19T07:29:00.220 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.217+0000 7f7172713640 1 -- start start 2024-09-19T07:29:00.221 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.218+0000 7f7172713640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f716c1008b0 0x7f716c19a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:00.222 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.218+0000 7f7172713640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f716c1011d0 0x7f716c19aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:00.222 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.218+0000 7f7172713640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f716c10e3d0 0x7f716c19ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:00.222 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.218+0000 7f716b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f716c1011d0 0x7f716c19aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:00.222 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.218+0000 7f716b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f716c1011d0 0x7f716c19aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43678/0 (socket says 172.21.15.148:43678) 2024-09-19T07:29:00.222 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.218+0000 7f716b7fe640 1 -- 172.21.15.148:0/1324357857 learned_addr learned my addr 172.21.15.148:0/1324357857 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:29:00.222 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.218+0000 7f7172713640 1 -- 172.21.15.148:0/1324357857 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f716c114110 con 0x7f716c1011d0 2024-09-19T07:29:00.222 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.218+0000 7f7172713640 1 -- 172.21.15.148:0/1324357857 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f716c113f90 con 0x7f716c10e3d0 2024-09-19T07:29:00.222 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.218+0000 7f7172713640 1 -- 172.21.15.148:0/1324357857 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f716c114290 con 0x7f716c1008b0 2024-09-19T07:29:00.222 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.218+0000 7f716bfff640 1 --2- 172.21.15.148:0/1324357857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f716c1008b0 0x7f716c19a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:00.223 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.218+0000 7f716b7fe640 1 -- 172.21.15.148:0/1324357857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f716c1008b0 msgr2=0x7f716c19a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:00.223 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.218+0000 7f716b7fe640 1 --2- 172.21.15.148:0/1324357857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f716c1008b0 0x7f716c19a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:00.223 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.218+0000 7f716b7fe640 1 -- 172.21.15.148:0/1324357857 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f716c10e3d0 msgr2=0x7f716c19ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:00.223 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.218+0000 7f7170cb0640 1 --2- 172.21.15.148:0/1324357857 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f716c10e3d0 0x7f716c19ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:00.223 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.218+0000 7f716b7fe640 1 --2- 172.21.15.148:0/1324357857 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f716c10e3d0 0x7f716c19ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:00.223 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.218+0000 7f716b7fe640 1 -- 172.21.15.148:0/1324357857 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f716c19f590 con 0x7f716c1011d0 2024-09-19T07:29:00.223 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.218+0000 7f7170cb0640 1 --2- 172.21.15.148:0/1324357857 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f716c10e3d0 0x7f716c19ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:29:00.223 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.218+0000 7f716b7fe640 1 --2- 172.21.15.148:0/1324357857 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f716c1011d0 0x7f716c19aae0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f7160004770 tx=0x7f7160003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:00.223 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.219+0000 7f71697fa640 1 -- 172.21.15.148:0/1324357857 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f716003f070 con 0x7f716c1011d0 2024-09-19T07:29:00.223 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.219+0000 7f71697fa640 1 -- 172.21.15.148:0/1324357857 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7160031ca0 con 0x7f716c1011d0 2024-09-19T07:29:00.223 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.219+0000 7f7172713640 1 -- 172.21.15.148:0/1324357857 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f716c19f820 con 0x7f716c1011d0 2024-09-19T07:29:00.223 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.219+0000 7f71697fa640 1 -- 172.21.15.148:0/1324357857 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7160035030 con 0x7f716c1011d0 2024-09-19T07:29:00.223 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.219+0000 7f7172713640 1 -- 172.21.15.148:0/1324357857 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f716c1a7110 con 0x7f716c1011d0 2024-09-19T07:29:00.225 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.223+0000 7f71754a4740 1 Processor -- start 2024-09-19T07:29:00.225 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.223+0000 7f71754a4740 1 -- start start 2024-09-19T07:29:00.225 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.223+0000 7f71697fa640 1 -- 172.21.15.148:0/1324357857 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f7160042070 con 0x7f716c1011d0 2024-09-19T07:29:00.225 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.223+0000 7f71754a4740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561b75057af0 0x561b75057ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:00.225 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.223+0000 7f71754a4740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b75058410 0x561b75062770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:00.226 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.223+0000 7f71754a4740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b75062cb0 0x561b750650a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:00.226 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.223+0000 7f71754a4740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x561b74fbc2f0 con 0x561b75058410 2024-09-19T07:29:00.226 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.223+0000 7f71754a4740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x561b74f64270 con 0x561b75057af0 2024-09-19T07:29:00.226 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.223+0000 7f71754a4740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x561b74fb82b0 con 0x561b75062cb0 2024-09-19T07:29:00.226 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.224+0000 7f7170cb0640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561b75057af0 0x561b75057ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:00.226 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.224+0000 7f7170cb0640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561b75057af0 0x561b75057ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:51808/0 (socket says 172.21.15.148:51808) 2024-09-19T07:29:00.226 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.224+0000 7f7170cb0640 1 -- 172.21.15.148:0/1419014931 learned_addr learned my addr 172.21.15.148:0/1419014931 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:29:00.226 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.224+0000 7f716b7fe640 1 --2- 172.21.15.148:0/1419014931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b75062cb0 0x561b750650a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:00.227 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.224+0000 7f7170cb0640 1 -- 172.21.15.148:0/1419014931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b75062cb0 msgr2=0x561b750650a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:00.227 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.224+0000 7f7170cb0640 1 --2- 172.21.15.148:0/1419014931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b75062cb0 0x561b750650a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:00.227 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.224+0000 7f7170cb0640 1 -- 172.21.15.148:0/1419014931 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b75058410 msgr2=0x561b75062770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T07:29:00.227 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.224+0000 7f7170cb0640 1 --2- 172.21.15.148:0/1419014931 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b75058410 0x561b75062770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:00.227 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.224+0000 7f7170cb0640 1 -- 172.21.15.148:0/1419014931 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b74f63340 con 0x561b75057af0 2024-09-19T07:29:00.228 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.224+0000 7f716b7fe640 1 --2- 172.21.15.148:0/1419014931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b75062cb0 0x561b750650a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:29:00.228 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.224+0000 7f71697fa640 1 --2- 172.21.15.148:0/1324357857 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f71540a34e0 0x7f71540a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:00.228 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.225+0000 7f71697fa640 1 -- 172.21.15.148:0/1324357857 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8556+0+0 (secure 0 0 0) 0x7f71600f03f0 con 0x7f716c1011d0 2024-09-19T07:29:00.228 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.225+0000 7f7170cb0640 1 --2- 172.21.15.148:0/1419014931 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561b75057af0 0x561b75057ed0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7164009ee0 tx=0x7f716400f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afdb319fffc6071 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:00.228 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.225+0000 7f716bfff640 1 --2- 172.21.15.148:0/1324357857 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f71540a34e0 0x7f71540a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:00.228 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.225+0000 7f71527fc640 1 -- 172.21.15.148:0/1419014931 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7164011640 con 0x561b75057af0 2024-09-19T07:29:00.228 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.226+0000 7f71527fc640 1 -- 172.21.15.148:0/1419014931 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7164011cc0 con 0x561b75057af0 2024-09-19T07:29:00.228 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.226+0000 7f71527fc640 1 -- 172.21.15.148:0/1419014931 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f716401bde0 con 0x561b75057af0 2024-09-19T07:29:00.232 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.227+0000 7f71754a4740 1 -- 172.21.15.148:0/1419014931 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561b75057af0 msgr2=0x561b75057ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:00.232 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.227+0000 7f71754a4740 1 --2- 172.21.15.148:0/1419014931 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561b75057af0 0x561b75057ed0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7164009ee0 tx=0x7f716400f730 comp rx=0 tx=0).stop 2024-09-19T07:29:00.232 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.227+0000 7f71754a4740 1 -- 172.21.15.148:0/1419014931 shutdown_connections 2024-09-19T07:29:00.232 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.227+0000 7f71754a4740 1 --2- 172.21.15.148:0/1419014931 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b75062cb0 0x561b750650a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:00.232 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.227+0000 7f71754a4740 1 --2- 172.21.15.148:0/1419014931 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b75058410 0x561b75062770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:00.233 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.227+0000 7f71754a4740 1 --2- 172.21.15.148:0/1419014931 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561b75057af0 0x561b75057ed0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:00.233 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.227+0000 7f71754a4740 1 -- 172.21.15.148:0/1419014931 >> 172.21.15.148:0/1419014931 conn(0x561b75054060 msgr2=0x561b75054440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:00.233 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.227+0000 7f716bfff640 1 --2- 172.21.15.148:0/1324357857 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f71540a34e0 0x7f71540a59a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x561b75054ec0 tx=0x7f715c00b390 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:00.233 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.230+0000 7f71754a4740 1 -- 172.21.15.148:0/1419014931 shutdown_connections 2024-09-19T07:29:00.233 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.230+0000 7f71754a4740 1 -- 172.21.15.148:0/1419014931 wait complete. 2024-09-19T07:29:00.233 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.231+0000 7f71754a4740 1 -- start start 2024-09-19T07:29:00.233 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.231+0000 7f71754a4740 1 Processor -- start 2024-09-19T07:29:00.235 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.231+0000 7f71754a4740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b75057af0 0x561b7505fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:00.235 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.231+0000 7f71754a4740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561b75058410 0x561b750600f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:00.236 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.231+0000 7f71754a4740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b75062cb0 0x561b75060630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:00.236 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.231+0000 7f71754a4740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x561b75065880 con 0x561b75062cb0 2024-09-19T07:29:00.236 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.231+0000 7f71754a4740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x561b74f45290 con 0x561b75058410 2024-09-19T07:29:00.236 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.231+0000 7f71754a4740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x561b75065a00 con 0x561b75057af0 2024-09-19T07:29:00.236 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.231+0000 7f71754a4740 10 client.0 _ll_register_callbacks cb 0x561b74f76140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:29:00.236 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.232+0000 7f716bfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b75057af0 0x561b7505fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:00.236 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.232+0000 7f716bfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b75057af0 0x561b7505fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:44698/0 (socket says 172.21.15.148:44698) 2024-09-19T07:29:00.236 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.232+0000 7f7170cb0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b75062cb0 0x561b75060630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:00.236 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.232+0000 7f716bfff640 1 -- 172.21.15.148:0/3921647247 learned_addr learned my addr 172.21.15.148:0/3921647247 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:29:00.236 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.232+0000 7f716b7fe640 1 --2- 172.21.15.148:0/3921647247 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561b75058410 0x561b750600f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:00.236 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.232+0000 7f7170cb0640 1 -- 172.21.15.148:0/3921647247 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b75057af0 msgr2=0x561b7505fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:00.236 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.232+0000 7f7170cb0640 1 --2- 172.21.15.148:0/3921647247 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b75057af0 0x561b7505fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:00.236 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.232+0000 7f7170cb0640 1 -- 172.21.15.148:0/3921647247 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561b75058410 msgr2=0x561b750600f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:00.237 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.232+0000 7f7170cb0640 1 --2- 172.21.15.148:0/3921647247 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561b75058410 0x561b750600f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:00.237 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.232+0000 7f7170cb0640 1 -- 172.21.15.148:0/3921647247 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b74ccf210 con 0x561b75062cb0 2024-09-19T07:29:00.237 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.232+0000 7f7170cb0640 1 --2- 172.21.15.148:0/3921647247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b75062cb0 0x561b75060630 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f7164009ee0 tx=0x7f7164009fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b82e41d969141f7c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:00.237 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.232+0000 7f714b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:29:00.237 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.233+0000 7f714b7fe640 1 -- 172.21.15.148:0/3921647247 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f716402a060 con 0x561b75062cb0 2024-09-19T07:29:00.237 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.233+0000 7f714b7fe640 1 -- 172.21.15.148:0/3921647247 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8556+0+0 (secure 0 0 0) 0x7f716401bc70 con 0x561b75062cb0 2024-09-19T07:29:00.237 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.233+0000 7f71754a4740 1 -- 172.21.15.148:0/3921647247 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7164011cc0 con 0x561b75062cb0 2024-09-19T07:29:00.237 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.233+0000 7f714b7fe640 1 -- 172.21.15.148:0/3921647247 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f7164004a40 con 0x561b75062cb0 2024-09-19T07:29:00.237 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.233+0000 7f71754a4740 10 client.17862 fetch_fsmap learned FSMap version 55 2024-09-19T07:29:00.237 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.233+0000 7f71754a4740 1 -- 172.21.15.148:0/3921647247 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x561b74d9b620 con 0x561b75062cb0 2024-09-19T07:29:00.237 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.233+0000 7f714b7fe640 1 -- 172.21.15.148:0/3921647247 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7164003e50 con 0x561b75062cb0 2024-09-19T07:29:00.237 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.233+0000 7f714b7fe640 1 -- 172.21.15.148:0/3921647247 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 55) ==== 8370+0+0 (secure 0 0 0) 0x7f7164011620 con 0x561b75062cb0 2024-09-19T07:29:00.237 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.234+0000 7f71754a4740 10 client.17862 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T07:29:00.238 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.234+0000 7f71754a4740 10 client.17862 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:29:00.238 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.234+0000 7f71754a4740 20 client.17862 populate_metadata read hostname 'smithi148' 2024-09-19T07:29:00.238 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.234+0000 7f71754a4740 1 --2- 172.21.15.148:0/3921647247 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561b75072bd0 0x561b75074fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:00.238 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.234+0000 7f71754a4740 4 client.17862 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:29:00.238 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.234+0000 7f71754a4740 1 -- 172.21.15.148:0/3921647247 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f7164011cc0 con 0x561b75072bd0 2024-09-19T07:29:00.238 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.234+0000 7f716bfff640 1 --2- 172.21.15.148:0/3921647247 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561b75072bd0 0x561b75074fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:00.238 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.234+0000 7f714b7fe640 10 client.17862 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:29:00.238 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.234+0000 7f716bfff640 1 --2- 172.21.15.148:0/3921647247 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561b75072bd0 0x561b75074fc0 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34f7bd6b158b3b8f server_cookie=381bd5d17676bfe9 in_seq=0 out_seq=0 2024-09-19T07:29:00.239 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.235+0000 7f714b7fe640 1 -- 172.21.15.148:0/3921647247 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f7164011cc0 con 0x561b75072bd0 2024-09-19T07:29:00.239 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.235+0000 7f714b7fe640 10 client.17862 handle_command_reply: tid=0 2024-09-19T07:29:00.239 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.235+0000 7f71754a4740 1 client.17862 shutdown 2024-09-19T07:29:00.239 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.235+0000 7f71754a4740 1 -- 172.21.15.148:0/3921647247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b75062cb0 msgr2=0x561b75060630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:00.239 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.235+0000 7f71754a4740 1 --2- 172.21.15.148:0/3921647247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b75062cb0 0x561b75060630 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f7164009ee0 tx=0x7f7164009fd0 comp rx=0 tx=0).stop 2024-09-19T07:29:00.239 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.236+0000 7f71754a4740 1 -- 172.21.15.148:0/3921647247 shutdown_connections 2024-09-19T07:29:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.236+0000 7f71754a4740 1 --2- 172.21.15.148:0/3921647247 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561b75072bd0 0x561b75074fc0 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.236+0000 7f71754a4740 1 --2- 172.21.15.148:0/3921647247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b75062cb0 0x561b75060630 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.236+0000 7f71754a4740 1 --2- 172.21.15.148:0/3921647247 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561b75058410 0x561b750600f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.236+0000 7f714b7fe640 0 client.17862 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:29:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.236+0000 7f71754a4740 1 --2- 172.21.15.148:0/3921647247 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b75057af0 0x561b7505fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.236+0000 7f71754a4740 1 -- 172.21.15.148:0/3921647247 >> 172.21.15.148:0/3921647247 conn(0x561b75054060 msgr2=0x561b75059dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.236+0000 7f71754a4740 1 -- 172.21.15.148:0/3921647247 shutdown_connections 2024-09-19T07:29:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.236+0000 7f71754a4740 1 -- 172.21.15.148:0/3921647247 wait complete. 2024-09-19T07:29:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.236+0000 7f71754a4740 20 client.17862 trim_cache size 0 max 16384 2024-09-19T07:29:00.262 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.259+0000 7f71754a4740 1 Processor -- start 2024-09-19T07:29:00.262 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.259+0000 7f71754a4740 1 -- start start 2024-09-19T07:29:00.262 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.259+0000 7f71754a4740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b75057af0 0x561b7505a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:00.262 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.259+0000 7f71754a4740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561b75058410 0x561b75060460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:00.262 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.259+0000 7f71754a4740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b75062cb0 0x561b7507a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:00.262 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.260+0000 7f71754a4740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f716c1b2460 con 0x561b75062cb0 2024-09-19T07:29:00.262 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.260+0000 7f71754a4740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f716c1afc70 con 0x561b75058410 2024-09-19T07:29:00.262 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.260+0000 7f71754a4740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f716c1adae0 con 0x561b75057af0 2024-09-19T07:29:00.262 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.260+0000 7f716b7fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561b75058410 0x561b75060460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:00.262 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.260+0000 7f716bfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b75057af0 0x561b7505a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:00.263 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.260+0000 7f716bfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b75057af0 0x561b7505a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:44702/0 (socket says 172.21.15.148:44702) 2024-09-19T07:29:00.263 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.260+0000 7f716b7fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561b75058410 0x561b75060460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:51836/0 (socket says 172.21.15.148:51836) 2024-09-19T07:29:00.263 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.260+0000 7f716bfff640 1 -- 172.21.15.148:0/2728636157 learned_addr learned my addr 172.21.15.148:0/2728636157 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:29:00.263 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.260+0000 7f7170cb0640 1 --2- 172.21.15.148:0/2728636157 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b75062cb0 0x561b7507a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:00.263 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.260+0000 7f716b7fe640 1 -- 172.21.15.148:0/2728636157 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b75057af0 msgr2=0x561b7505a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:00.263 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.260+0000 7f716b7fe640 1 --2- 172.21.15.148:0/2728636157 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b75057af0 0x561b7505a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:00.263 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.260+0000 7f716b7fe640 1 -- 172.21.15.148:0/2728636157 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b75062cb0 msgr2=0x561b7507a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:00.263 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.260+0000 7f716b7fe640 1 --2- 172.21.15.148:0/2728636157 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b75062cb0 0x561b7507a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:00.263 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.260+0000 7f716b7fe640 1 -- 172.21.15.148:0/2728636157 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b7504f2d0 con 0x561b75058410 2024-09-19T07:29:00.263 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.261+0000 7f716b7fe640 1 --2- 172.21.15.148:0/2728636157 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561b75058410 0x561b75060460 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f71600edb20 tx=0x7f716003b890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b10984300b6788a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:00.268 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.261+0000 7f7151ffb640 1 -- 172.21.15.148:0/2728636157 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7160049040 con 0x561b75058410 2024-09-19T07:29:00.268 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.261+0000 7f7151ffb640 1 -- 172.21.15.148:0/2728636157 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7160031e50 con 0x561b75058410 2024-09-19T07:29:00.268 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.261+0000 7f7151ffb640 1 -- 172.21.15.148:0/2728636157 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71600c5320 con 0x561b75058410 2024-09-19T07:29:00.268 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.262+0000 7f71754a4740 1 -- 172.21.15.148:0/2728636157 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561b75058410 msgr2=0x561b75060460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:00.268 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.262+0000 7f71754a4740 1 --2- 172.21.15.148:0/2728636157 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561b75058410 0x561b75060460 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f71600edb20 tx=0x7f716003b890 comp rx=0 tx=0).stop 2024-09-19T07:29:00.268 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.262+0000 7f71754a4740 1 -- 172.21.15.148:0/2728636157 shutdown_connections 2024-09-19T07:29:00.268 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.262+0000 7f71754a4740 1 --2- 172.21.15.148:0/2728636157 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b75062cb0 0x561b7507a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:00.268 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.262+0000 7f71754a4740 1 --2- 172.21.15.148:0/2728636157 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561b75058410 0x561b75060460 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:00.268 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.262+0000 7f71754a4740 1 --2- 172.21.15.148:0/2728636157 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b75057af0 0x561b7505a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:00.268 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.262+0000 7f71754a4740 1 -- 172.21.15.148:0/2728636157 >> 172.21.15.148:0/2728636157 conn(0x561b75054060 msgr2=0x561b75061c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:00.269 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.262+0000 7f71754a4740 1 -- 172.21.15.148:0/2728636157 shutdown_connections 2024-09-19T07:29:00.269 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.263+0000 7f71754a4740 1 -- 172.21.15.148:0/2728636157 wait complete. 2024-09-19T07:29:00.269 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.263+0000 7f71754a4740 1 -- start start 2024-09-19T07:29:00.269 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.263+0000 7f71754a4740 1 Processor -- start 2024-09-19T07:29:00.269 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.264+0000 7f71754a4740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b75057af0 0x561b7506ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:00.269 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.264+0000 7f71754a4740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b75058410 0x561b7506b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:00.269 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.264+0000 7f71754a4740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561b75062cb0 0x561b7505c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:00.269 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.264+0000 7f71754a4740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f716c1ae130 con 0x561b75057af0 2024-09-19T07:29:00.269 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.264+0000 7f716bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b75057af0 0x561b7506ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:00.269 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.264+0000 7f71754a4740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f716c1af5a0 con 0x561b75062cb0 2024-09-19T07:29:00.269 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.264+0000 7f716bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b75057af0 0x561b7506ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43704/0 (socket says 172.21.15.148:43704) 2024-09-19T07:29:00.269 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.264+0000 7f716bfff640 1 -- 172.21.15.148:0/2114257264 learned_addr learned my addr 172.21.15.148:0/2114257264 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:29:00.269 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.264+0000 7f71754a4740 1 -- 172.21.15.148:0/2114257264 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f716c1ae800 con 0x561b75058410 2024-09-19T07:29:00.270 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.264+0000 7f7170cb0640 1 --2- 172.21.15.148:0/2114257264 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561b75062cb0 0x561b7505c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:00.270 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.264+0000 7f71754a4740 10 client.0 _ll_register_callbacks cb 0x7f7164015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:29:00.270 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.264+0000 7f716b7fe640 1 --2- 172.21.15.148:0/2114257264 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b75058410 0x561b7506b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:00.270 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.264+0000 7f716bfff640 1 -- 172.21.15.148:0/2114257264 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b75058410 msgr2=0x561b7506b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:00.270 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.264+0000 7f716bfff640 1 --2- 172.21.15.148:0/2114257264 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b75058410 0x561b7506b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:00.270 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.264+0000 7f716bfff640 1 -- 172.21.15.148:0/2114257264 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561b75062cb0 msgr2=0x561b7505c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:00.270 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.264+0000 7f716bfff640 1 --2- 172.21.15.148:0/2114257264 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561b75062cb0 0x561b7505c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:00.270 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.264+0000 7f716bfff640 1 -- 172.21.15.148:0/2114257264 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b7505cc10 con 0x561b75057af0 2024-09-19T07:29:00.270 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.264+0000 7f7170cb0640 1 --2- 172.21.15.148:0/2114257264 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561b75062cb0 0x561b7505c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:29:00.270 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.264+0000 7f716b7fe640 1 --2- 172.21.15.148:0/2114257264 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b75058410 0x561b7506b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:29:00.270 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.265+0000 7f716bfff640 1 --2- 172.21.15.148:0/2114257264 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b75057af0 0x561b7506ae80 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f715c010860 tx=0x7f715c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=921c7c644fe5c3f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:00.270 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.265+0000 7f714b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:29:00.270 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.265+0000 7f714b7fe640 1 -- 172.21.15.148:0/2114257264 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f715c01ea10 con 0x561b75057af0 2024-09-19T07:29:00.271 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.265+0000 7f714b7fe640 1 -- 172.21.15.148:0/2114257264 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8556+0+0 (secure 0 0 0) 0x7f715c01ebb0 con 0x561b75057af0 2024-09-19T07:29:00.271 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.265+0000 7f71754a4740 1 -- 172.21.15.148:0/2114257264 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7160031e50 con 0x561b75057af0 2024-09-19T07:29:00.271 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.265+0000 7f714b7fe640 1 -- 172.21.15.148:0/2114257264 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f715c01edb0 con 0x561b75057af0 2024-09-19T07:29:00.271 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.265+0000 7f71754a4740 10 client.17868 fetch_fsmap learned FSMap version 55 2024-09-19T07:29:00.271 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.265+0000 7f71754a4740 1 -- 172.21.15.148:0/2114257264 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x561b750dd050 con 0x561b75057af0 2024-09-19T07:29:00.271 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.265+0000 7f714b7fe640 1 -- 172.21.15.148:0/2114257264 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f715c02b070 con 0x561b75057af0 2024-09-19T07:29:00.271 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.266+0000 7f714b7fe640 1 -- 172.21.15.148:0/2114257264 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 55) ==== 8370+0+0 (secure 0 0 0) 0x7f715c036540 con 0x561b75057af0 2024-09-19T07:29:00.271 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.266+0000 7f71754a4740 10 client.17868 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T07:29:00.271 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.266+0000 7f71754a4740 10 client.17868 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:29:00.271 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.266+0000 7f71754a4740 20 client.17868 populate_metadata read hostname 'smithi148' 2024-09-19T07:29:00.271 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.266+0000 7f71754a4740 1 --2- 172.21.15.148:0/2114257264 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561b750dd800 0x561b750dfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:00.271 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.266+0000 7f71754a4740 4 client.17868 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:29:00.271 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.266+0000 7f71754a4740 1 -- 172.21.15.148:0/2114257264 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f7160031e50 con 0x561b750dd800 2024-09-19T07:29:00.271 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.266+0000 7f716b7fe640 1 --2- 172.21.15.148:0/2114257264 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561b750dd800 0x561b750dfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:00.272 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.266+0000 7f716b7fe640 1 --2- 172.21.15.148:0/2114257264 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561b750dd800 0x561b750dfc20 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9ff2090116c89b9 server_cookie=7720915999cc92cf in_seq=0 out_seq=0 2024-09-19T07:29:00.272 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.266+0000 7f714b7fe640 10 client.17868 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:29:00.289 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.287+0000 7f714b7fe640 1 -- 172.21.15.148:0/2114257264 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f7160031e50 con 0x561b750dd800 2024-09-19T07:29:00.289 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.288+0000 7f714b7fe640 10 client.17868 handle_command_reply: tid=0 2024-09-19T07:29:00.290 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.288+0000 7f71754a4740 1 client.17868 shutdown 2024-09-19T07:29:00.290 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.288+0000 7f71754a4740 1 -- 172.21.15.148:0/2114257264 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b75057af0 msgr2=0x561b7506ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:00.290 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.288+0000 7f71754a4740 1 --2- 172.21.15.148:0/2114257264 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b75057af0 0x561b7506ae80 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f715c010860 tx=0x7f715c004730 comp rx=0 tx=0).stop 2024-09-19T07:29:00.290 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.288+0000 7f71754a4740 1 -- 172.21.15.148:0/2114257264 shutdown_connections 2024-09-19T07:29:00.290 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.288+0000 7f71754a4740 1 --2- 172.21.15.148:0/2114257264 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x561b750dd800 0x561b750dfc20 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:00.290 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.288+0000 7f71754a4740 1 --2- 172.21.15.148:0/2114257264 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561b75062cb0 0x561b7505c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:00.290 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.288+0000 7f71754a4740 1 --2- 172.21.15.148:0/2114257264 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b75058410 0x561b7506b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:00.290 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.288+0000 7f71754a4740 1 --2- 172.21.15.148:0/2114257264 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b75057af0 0x561b7506ae80 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:00.290 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.288+0000 7f71754a4740 1 -- 172.21.15.148:0/2114257264 >> 172.21.15.148:0/2114257264 conn(0x561b75054060 msgr2=0x561b750529a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:00.291 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.288+0000 7f714b7fe640 0 client.17868 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:29:00.291 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.288+0000 7f71754a4740 1 -- 172.21.15.148:0/2114257264 shutdown_connections 2024-09-19T07:29:00.291 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.288+0000 7f71754a4740 1 -- 172.21.15.148:0/2114257264 wait complete. 2024-09-19T07:29:00.291 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.289+0000 7f71754a4740 20 client.17868 trim_cache size 0 max 16384 2024-09-19T07:29:00.291 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:29:00.291 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:29:00.291 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:29:00.291 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:29:00.292 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.289+0000 7f7172713640 1 -- 172.21.15.148:0/1324357857 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f71540a34e0 msgr2=0x7f71540a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:00.292 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.289+0000 7f7172713640 1 --2- 172.21.15.148:0/1324357857 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f71540a34e0 0x7f71540a59a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x561b75054ec0 tx=0x7f715c00b390 comp rx=0 tx=0).stop 2024-09-19T07:29:00.292 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.289+0000 7f7172713640 1 -- 172.21.15.148:0/1324357857 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f716c1011d0 msgr2=0x7f716c19aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:00.292 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.289+0000 7f7172713640 1 --2- 172.21.15.148:0/1324357857 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f716c1011d0 0x7f716c19aae0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f7160004770 tx=0x7f7160003c10 comp rx=0 tx=0).stop 2024-09-19T07:29:00.293 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.289+0000 7f7172713640 1 -- 172.21.15.148:0/1324357857 shutdown_connections 2024-09-19T07:29:00.293 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.289+0000 7f7172713640 1 --2- 172.21.15.148:0/1324357857 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f71540a34e0 0x7f71540a59a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:00.293 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.289+0000 7f7172713640 1 --2- 172.21.15.148:0/1324357857 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f716c10e3d0 0x7f716c19ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:00.293 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.289+0000 7f7172713640 1 --2- 172.21.15.148:0/1324357857 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f716c1011d0 0x7f716c19aae0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:00.293 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.289+0000 7f7172713640 1 --2- 172.21.15.148:0/1324357857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f716c1008b0 0x7f716c19a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:00.293 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.289+0000 7f7172713640 1 -- 172.21.15.148:0/1324357857 >> 172.21.15.148:0/1324357857 conn(0x7f716c0fc6b0 msgr2=0x7f716c0feaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:00.293 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.289+0000 7f7172713640 1 -- 172.21.15.148:0/1324357857 shutdown_connections 2024-09-19T07:29:00.293 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:00.290+0000 7f7172713640 1 -- 172.21.15.148:0/1324357857 wait complete. 2024-09-19T07:29:00.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:29:00 smithi165 ceph-mon[35326]: pgmap v564: 97 pgs: 97 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.5 MiB/s wr, 372 op/s 2024-09-19T07:29:01.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:29:00 smithi179 ceph-mon[35716]: pgmap v564: 97 pgs: 97 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.5 MiB/s wr, 372 op/s 2024-09-19T07:29:01.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:29:00 smithi148 ceph-mon[31180]: pgmap v564: 97 pgs: 97 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.5 MiB/s wr, 372 op/s 2024-09-19T07:29:02.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:29:02 smithi165 ceph-mon[35326]: pgmap v565: 97 pgs: 97 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.9 MiB/s wr, 372 op/s 2024-09-19T07:29:03.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:29:02 smithi179 ceph-mon[35716]: pgmap v565: 97 pgs: 97 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.9 MiB/s wr, 372 op/s 2024-09-19T07:29:03.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:29:02 smithi148 ceph-mon[31180]: pgmap v565: 97 pgs: 97 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.9 MiB/s wr, 372 op/s 2024-09-19T07:29:04.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:29:04 smithi165 ceph-mon[35326]: pgmap v566: 97 pgs: 97 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.9 MiB/s wr, 363 op/s 2024-09-19T07:29:05.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:29:04 smithi179 ceph-mon[35716]: pgmap v566: 97 pgs: 97 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.9 MiB/s wr, 363 op/s 2024-09-19T07:29:05.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:29:04 smithi148 ceph-mon[31180]: pgmap v566: 97 pgs: 97 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.9 MiB/s wr, 363 op/s 2024-09-19T07:29:06.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:29:06 smithi165 ceph-mon[35326]: pgmap v567: 97 pgs: 97 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.3 MiB/s wr, 455 op/s 2024-09-19T07:29:07.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:29:06 smithi179 ceph-mon[35716]: pgmap v567: 97 pgs: 97 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.3 MiB/s wr, 455 op/s 2024-09-19T07:29:07.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:29:06 smithi148 ceph-mon[31180]: pgmap v567: 97 pgs: 97 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.3 MiB/s wr, 455 op/s 2024-09-19T07:29:08.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:29:08 smithi165 ceph-mon[35326]: pgmap v568: 97 pgs: 97 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 311 op/s 2024-09-19T07:29:09.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:29:08 smithi179 ceph-mon[35716]: pgmap v568: 97 pgs: 97 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 311 op/s 2024-09-19T07:29:09.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:29:08 smithi148 ceph-mon[31180]: pgmap v568: 97 pgs: 97 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 311 op/s 2024-09-19T07:29:10.883 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:29:10 smithi165 ceph-mon[35326]: pgmap v569: 97 pgs: 97 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.1 MiB/s wr, 344 op/s 2024-09-19T07:29:11.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:29:10 smithi179 ceph-mon[35716]: pgmap v569: 97 pgs: 97 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.1 MiB/s wr, 344 op/s 2024-09-19T07:29:11.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:29:10 smithi148 ceph-mon[31180]: pgmap v569: 97 pgs: 97 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.1 MiB/s wr, 344 op/s 2024-09-19T07:29:13.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:29:12 smithi179 ceph-mon[35716]: pgmap v570: 97 pgs: 97 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.6 MiB/s wr, 418 op/s 2024-09-19T07:29:13.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:29:12 smithi148 ceph-mon[31180]: pgmap v570: 97 pgs: 97 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.6 MiB/s wr, 418 op/s 2024-09-19T07:29:13.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:29:12 smithi165 ceph-mon[35326]: pgmap v570: 97 pgs: 97 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.6 MiB/s wr, 418 op/s 2024-09-19T07:29:13.440 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.435+0000 7fc9f1c5e640 1 -- 172.21.15.148:0/1803244839 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9ec11b140 msgr2=0x7fc9ec11d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:13.440 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.435+0000 7fc9f1c5e640 1 --2- 172.21.15.148:0/1803244839 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9ec11b140 0x7fc9ec11d530 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4009cd0 tx=0x7fc9e402a930 comp rx=0 tx=0).stop 2024-09-19T07:29:13.442 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.440+0000 7fc9f1c5e640 1 -- 172.21.15.148:0/1803244839 shutdown_connections 2024-09-19T07:29:13.442 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.441+0000 7fc9f1c5e640 1 --2- 172.21.15.148:0/1803244839 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9ec11b140 0x7fc9ec11d530 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:13.442 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.441+0000 7fc9f1c5e640 1 --2- 172.21.15.148:0/1803244839 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9ec1095d0 0x7fc9ec109a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:13.442 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.441+0000 7fc9f1c5e640 1 --2- 172.21.15.148:0/1803244839 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9ec1091f0 0x7fc9ec110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:13.442 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.441+0000 7fc9f1c5e640 1 -- 172.21.15.148:0/1803244839 >> 172.21.15.148:0/1803244839 conn(0x7fc9ec06ce00 msgr2=0x7fc9ec06d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:13.444 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.443+0000 7fc9f1c5e640 1 -- 172.21.15.148:0/1803244839 shutdown_connections 2024-09-19T07:29:13.445 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.445+0000 7fc9f1c5e640 1 -- 172.21.15.148:0/1803244839 wait complete. 2024-09-19T07:29:13.445 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.445+0000 7fc9f1c5e640 1 Processor -- start 2024-09-19T07:29:13.446 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.446+0000 7fc9f1c5e640 1 -- start start 2024-09-19T07:29:13.446 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.446+0000 7fc9f1c5e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9ec1091f0 0x7fc9ec1a7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:13.447 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.446+0000 7fc9f1c5e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9ec1095d0 0x7fc9ec1a77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:13.447 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.446+0000 7fc9f1c5e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9ec11b140 0x7fc9ec1abb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:13.447 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.446+0000 7fc9f1c5e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ec120da0 con 0x7fc9ec1091f0 2024-09-19T07:29:13.447 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.446+0000 7fc9f1c5e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ec120c20 con 0x7fc9ec11b140 2024-09-19T07:29:13.447 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.446+0000 7fc9f1c5e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ec120f20 con 0x7fc9ec1095d0 2024-09-19T07:29:13.447 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.447+0000 7fc9ebfff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9ec11b140 0x7fc9ec1abb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:13.448 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.447+0000 7fc9ebfff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9ec11b140 0x7fc9ec1abb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:35696/0 (socket says 172.21.15.148:35696) 2024-09-19T07:29:13.448 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.447+0000 7fc9ebfff640 1 -- 172.21.15.148:0/2265978452 learned_addr learned my addr 172.21.15.148:0/2265978452 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:29:13.448 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.447+0000 7fc9eb7fe640 1 --2- 172.21.15.148:0/2265978452 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9ec1091f0 0x7fc9ec1a7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:13.451 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.448+0000 7fc9eb7fe640 1 -- 172.21.15.148:0/2265978452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9ec1095d0 msgr2=0x7fc9ec1a77d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T07:29:13.451 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.448+0000 7fc9eb7fe640 1 --2- 172.21.15.148:0/2265978452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9ec1095d0 0x7fc9ec1a77d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:13.451 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.448+0000 7fc9eb7fe640 1 -- 172.21.15.148:0/2265978452 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9ec11b140 msgr2=0x7fc9ec1abb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:13.451 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.448+0000 7fc9eb7fe640 1 --2- 172.21.15.148:0/2265978452 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9ec11b140 0x7fc9ec1abb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:13.451 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.448+0000 7fc9eb7fe640 1 -- 172.21.15.148:0/2265978452 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9ec1ac280 con 0x7fc9ec1091f0 2024-09-19T07:29:13.451 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.448+0000 7fc9eb7fe640 1 --2- 172.21.15.148:0/2265978452 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9ec1091f0 0x7fc9ec1a7290 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc009fd0 tx=0x7fc9dc00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:13.451 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.448+0000 7fc9e8ff9640 1 -- 172.21.15.148:0/2265978452 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc015020 con 0x7fc9ec1091f0 2024-09-19T07:29:13.451 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.449+0000 7fc9e8ff9640 1 -- 172.21.15.148:0/2265978452 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9dc011d10 con 0x7fc9ec1091f0 2024-09-19T07:29:13.451 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.449+0000 7fc9e8ff9640 1 -- 172.21.15.148:0/2265978452 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc00f2e0 con 0x7fc9ec1091f0 2024-09-19T07:29:13.454 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.452+0000 7fc9f1c5e640 1 -- 172.21.15.148:0/2265978452 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9ec1ac570 con 0x7fc9ec1091f0 2024-09-19T07:29:13.454 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.453+0000 7fc9f1c5e640 1 -- 172.21.15.148:0/2265978452 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9ec1b3e00 con 0x7fc9ec1091f0 2024-09-19T07:29:13.457 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.457+0000 7fc9e8ff9640 1 -- 172.21.15.148:0/2265978452 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fc9dc018020 con 0x7fc9ec1091f0 2024-09-19T07:29:13.459 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.459+0000 7fc9f49fc740 1 Processor -- start 2024-09-19T07:29:13.460 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.459+0000 7fc9e8ff9640 1 --2- 172.21.15.148:0/2265978452 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc9d40a3690 0x7fc9d40a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:13.460 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.460+0000 7fc9e8ff9640 1 -- 172.21.15.148:0/2265978452 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8600+0+0 (secure 0 0 0) 0x7fc9dc0cf380 con 0x7fc9ec1091f0 2024-09-19T07:29:13.460 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.460+0000 7fc9f49fc740 1 -- start start 2024-09-19T07:29:13.461 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.460+0000 7fc9f49fc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae5cd1daf0 0x55ae5cd1ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:13.461 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.460+0000 7fc9f49fc740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ae5cd1e410 0x55ae5cd28770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:13.461 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.460+0000 7fc9f49fc740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ae5cd28cb0 0x55ae5cd2b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:13.461 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.460+0000 7fc9f49fc740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55ae5cc822f0 con 0x55ae5cd1e410 2024-09-19T07:29:13.461 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.460+0000 7fc9f49fc740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ae5cc2a270 con 0x55ae5cd28cb0 2024-09-19T07:29:13.461 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.460+0000 7fc9f49fc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ae5cc7e2b0 con 0x55ae5cd1daf0 2024-09-19T07:29:13.461 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.461+0000 7fc9ebfff640 1 --2- 172.21.15.148:0/2265978452 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc9d40a3690 0x7fc9d40a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:13.462 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.461+0000 7fc9eaffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ae5cd1e410 0x55ae5cd28770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:13.462 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.461+0000 7fc9eaffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ae5cd1e410 0x55ae5cd28770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47350/0 (socket says 172.21.15.148:47350) 2024-09-19T07:29:13.462 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.461+0000 7fc9eaffd640 1 -- 172.21.15.148:0/2309930488 learned_addr learned my addr 172.21.15.148:0/2309930488 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:29:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.461+0000 7fc9eb7fe640 1 --2- 172.21.15.148:0/2309930488 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae5cd1daf0 0x55ae5cd1ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.462+0000 7fc9ebfff640 1 --2- 172.21.15.148:0/2309930488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ae5cd28cb0 0x55ae5cd2b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.462+0000 7fc9eaffd640 1 -- 172.21.15.148:0/2309930488 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae5cd1daf0 msgr2=0x55ae5cd1ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.462+0000 7fc9eaffd640 1 --2- 172.21.15.148:0/2309930488 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae5cd1daf0 0x55ae5cd1ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.462+0000 7fc9eaffd640 1 -- 172.21.15.148:0/2309930488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ae5cd28cb0 msgr2=0x55ae5cd2b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.462+0000 7fc9eaffd640 1 --2- 172.21.15.148:0/2309930488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ae5cd28cb0 0x55ae5cd2b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.462+0000 7fc9eaffd640 1 -- 172.21.15.148:0/2309930488 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae5cc29340 con 0x55ae5cd1e410 2024-09-19T07:29:13.464 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.462+0000 7fc9eb7fe640 1 --2- 172.21.15.148:0/2309930488 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae5cd1daf0 0x55ae5cd1ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:29:13.464 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.462+0000 7fc9ebfff640 1 --2- 172.21.15.148:0/2309930488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ae5cd28cb0 0x55ae5cd2b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:29:13.464 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.463+0000 7fc9ebfff640 1 --2- 172.21.15.148:0/2265978452 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc9d40a3690 0x7fc9d40a5b50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x55ae5cd1b3e0 tx=0x7fc9e402f4a0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:13.464 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.463+0000 7fc9eaffd640 1 --2- 172.21.15.148:0/2309930488 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ae5cd1e410 0x55ae5cd28770 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0009740 tx=0x7fc9e0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae9fa447ab38d37a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:13.466 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.466+0000 7fc9d1ffb640 1 -- 172.21.15.148:0/2309930488 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e0015020 con 0x55ae5cd1e410 2024-09-19T07:29:13.466 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.466+0000 7fc9d1ffb640 1 -- 172.21.15.148:0/2309930488 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9e0009e50 con 0x55ae5cd1e410 2024-09-19T07:29:13.467 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.467+0000 7fc9f49fc740 1 -- 172.21.15.148:0/2309930488 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ae5cd1e410 msgr2=0x55ae5cd28770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:13.467 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.467+0000 7fc9f49fc740 1 --2- 172.21.15.148:0/2309930488 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ae5cd1e410 0x55ae5cd28770 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0009740 tx=0x7fc9e0009c00 comp rx=0 tx=0).stop 2024-09-19T07:29:13.468 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.468+0000 7fc9f49fc740 1 -- 172.21.15.148:0/2309930488 shutdown_connections 2024-09-19T07:29:13.468 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.468+0000 7fc9f49fc740 1 --2- 172.21.15.148:0/2309930488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ae5cd28cb0 0x55ae5cd2b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:13.468 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.468+0000 7fc9f49fc740 1 --2- 172.21.15.148:0/2309930488 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ae5cd1e410 0x55ae5cd28770 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:13.468 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.468+0000 7fc9f49fc740 1 --2- 172.21.15.148:0/2309930488 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae5cd1daf0 0x55ae5cd1ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:13.468 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.468+0000 7fc9f49fc740 1 -- 172.21.15.148:0/2309930488 >> 172.21.15.148:0/2309930488 conn(0x55ae5cd1a060 msgr2=0x55ae5cd1a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:13.471 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.469+0000 7fc9f49fc740 1 -- 172.21.15.148:0/2309930488 shutdown_connections 2024-09-19T07:29:13.472 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.471+0000 7fc9f49fc740 1 -- 172.21.15.148:0/2309930488 wait complete. 2024-09-19T07:29:13.472 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.471+0000 7fc9f49fc740 1 -- start start 2024-09-19T07:29:13.472 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.472+0000 7fc9f49fc740 1 Processor -- start 2024-09-19T07:29:13.472 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.472+0000 7fc9f49fc740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ae5cd1daf0 0x55ae5cd25ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:13.472 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.472+0000 7fc9f49fc740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ae5cd1e410 0x55ae5cd25ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:13.473 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.472+0000 7fc9f49fc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae5cd28cb0 0x55ae5cd26530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:13.473 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.472+0000 7fc9f49fc740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55ae5cd2b8d0 con 0x55ae5cd1e410 2024-09-19T07:29:13.473 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.472+0000 7fc9f49fc740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ae5cc0b290 con 0x55ae5cd1daf0 2024-09-19T07:29:13.473 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.472+0000 7fc9f49fc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ae5cd2ba50 con 0x55ae5cd28cb0 2024-09-19T07:29:13.473 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.472+0000 7fc9f49fc740 10 client.0 _ll_register_callbacks cb 0x55ae5cc3c140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:29:13.474 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.473+0000 7fc9eb7fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ae5cd1daf0 0x55ae5cd25ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:13.474 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.473+0000 7fc9eb7fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ae5cd1daf0 0x55ae5cd25ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:35720/0 (socket says 172.21.15.148:35720) 2024-09-19T07:29:13.474 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.473+0000 7fc9eb7fe640 1 -- 172.21.15.148:0/262335936 learned_addr learned my addr 172.21.15.148:0/262335936 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:29:13.474 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.473+0000 7fc9ebfff640 1 --2- 172.21.15.148:0/262335936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae5cd28cb0 0x55ae5cd26530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:13.475 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.473+0000 7fc9eb7fe640 1 -- 172.21.15.148:0/262335936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae5cd28cb0 msgr2=0x55ae5cd26530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:13.475 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.473+0000 7fc9eb7fe640 1 --2- 172.21.15.148:0/262335936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae5cd28cb0 0x55ae5cd26530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:13.475 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.473+0000 7fc9eb7fe640 1 -- 172.21.15.148:0/262335936 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ae5cd1e410 msgr2=0x55ae5cd25ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:13.475 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.473+0000 7fc9eb7fe640 1 --2- 172.21.15.148:0/262335936 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ae5cd1e410 0x55ae5cd25ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:13.475 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.473+0000 7fc9eb7fe640 1 -- 172.21.15.148:0/262335936 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae5c995210 con 0x55ae5cd1daf0 2024-09-19T07:29:13.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.474+0000 7fc9eb7fe640 1 --2- 172.21.15.148:0/262335936 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ae5cd1daf0 0x55ae5cd25ab0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc006fd0 tx=0x7fc9dc09bf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83f6986e554aacb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:13.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.474+0000 7fc9caffd640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-19T07:29:13.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.474+0000 7fc9caffd640 1 -- 172.21.15.148:0/262335936 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc0b4070 con 0x55ae5cd1daf0 2024-09-19T07:29:13.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.475+0000 7fc9f49fc740 1 -- 172.21.15.148:0/262335936 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9e0009e50 con 0x55ae5cd1daf0 2024-09-19T07:29:13.476 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.475+0000 7fc9caffd640 1 -- 172.21.15.148:0/262335936 <== mon.2 v2:172.21.15.165:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 8600+0+0 (secure 0 0 0) 0x7fc9dc0999c0 con 0x55ae5cd1daf0 2024-09-19T07:29:13.478 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.478+0000 7fc9caffd640 1 -- 172.21.15.148:0/262335936 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7fc9dc0ce040 con 0x55ae5cd1daf0 2024-09-19T07:29:13.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.479+0000 7fc9f49fc740 10 client.26858 fetch_fsmap learned FSMap version 55 2024-09-19T07:29:13.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.479+0000 7fc9f49fc740 1 -- 172.21.15.148:0/262335936 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x55ae5ca61620 con 0x55ae5cd1daf0 2024-09-19T07:29:13.481 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.481+0000 7fc9caffd640 1 -- 172.21.15.148:0/262335936 <== mon.2 v2:172.21.15.165:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9e0009e50 con 0x55ae5cd1daf0 2024-09-19T07:29:13.482 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.482+0000 7fc9caffd640 1 -- 172.21.15.148:0/262335936 <== mon.2 v2:172.21.15.165:3300/0 5 ==== fsmap(e 55) ==== 8370+0+0 (secure 0 0 0) 0x7fc9dc022060 con 0x55ae5cd1daf0 2024-09-19T07:29:13.482 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.482+0000 7fc9f49fc740 10 client.26858 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T07:29:13.483 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.482+0000 7fc9f49fc740 10 client.26858 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:29:13.483 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.482+0000 7fc9f49fc740 20 client.26858 populate_metadata read hostname 'smithi148' 2024-09-19T07:29:13.483 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.482+0000 7fc9f49fc740 1 --2- 172.21.15.148:0/262335936 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ae5cd49b30 0x55ae5cd4bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:13.483 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.482+0000 7fc9f49fc740 4 client.26858 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:29:13.483 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.482+0000 7fc9f49fc740 1 -- 172.21.15.148:0/262335936 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ae5cc8fa20 con 0x55ae5cd49b30 2024-09-19T07:29:13.489 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.487+0000 7fc9eaffd640 1 --2- 172.21.15.148:0/262335936 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ae5cd49b30 0x55ae5cd4bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:13.492 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.492+0000 7fc9eaffd640 1 --2- 172.21.15.148:0/262335936 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ae5cd49b30 0x55ae5cd4bfd0 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a685117eba6d8210 server_cookie=5f0c656c517d3ef5 in_seq=0 out_seq=0 2024-09-19T07:29:13.493 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.493+0000 7fc9caffd640 10 client.26858 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:29:13.493 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.493+0000 7fc9caffd640 1 -- 172.21.15.148:0/262335936 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ae5cc8fa20 con 0x55ae5cd49b30 2024-09-19T07:29:13.493 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.493+0000 7fc9caffd640 10 client.26858 handle_command_reply: tid=0 2024-09-19T07:29:13.493 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.493+0000 7fc9f49fc740 1 client.26858 shutdown 2024-09-19T07:29:13.495 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.495+0000 7fc9f49fc740 1 -- 172.21.15.148:0/262335936 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ae5cd1daf0 msgr2=0x55ae5cd25ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:13.495 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.495+0000 7fc9f49fc740 1 --2- 172.21.15.148:0/262335936 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ae5cd1daf0 0x55ae5cd25ab0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc006fd0 tx=0x7fc9dc09bf00 comp rx=0 tx=0).stop 2024-09-19T07:29:13.497 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.496+0000 7fc9f49fc740 1 -- 172.21.15.148:0/262335936 shutdown_connections 2024-09-19T07:29:13.498 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.496+0000 7fc9f49fc740 1 --2- 172.21.15.148:0/262335936 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ae5cd49b30 0x55ae5cd4bfd0 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:13.498 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.496+0000 7fc9f49fc740 1 --2- 172.21.15.148:0/262335936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae5cd28cb0 0x55ae5cd26530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:13.498 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.496+0000 7fc9f49fc740 1 --2- 172.21.15.148:0/262335936 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ae5cd1e410 0x55ae5cd25ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:13.498 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.496+0000 7fc9f49fc740 1 --2- 172.21.15.148:0/262335936 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ae5cd1daf0 0x55ae5cd25ab0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:13.498 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.496+0000 7fc9f49fc740 1 -- 172.21.15.148:0/262335936 >> 172.21.15.148:0/262335936 conn(0x55ae5cd1a060 msgr2=0x55ae5cd1fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:13.498 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.496+0000 7fc9caffd640 0 client.26858 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:29:13.498 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.497+0000 7fc9f49fc740 1 -- 172.21.15.148:0/262335936 shutdown_connections 2024-09-19T07:29:13.498 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.497+0000 7fc9f49fc740 1 -- 172.21.15.148:0/262335936 wait complete. 2024-09-19T07:29:13.498 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.497+0000 7fc9f49fc740 20 client.26858 trim_cache size 0 max 16384 2024-09-19T07:29:13.528 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.528+0000 7fc9f49fc740 1 Processor -- start 2024-09-19T07:29:13.528 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.528+0000 7fc9f49fc740 1 -- start start 2024-09-19T07:29:13.530 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.529+0000 7fc9f49fc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae5cd1daf0 0x55ae5cd26360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:13.530 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.529+0000 7fc9f49fc740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ae5cd1e410 0x55ae5cd518e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:13.530 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.529+0000 7fc9eb7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae5cd1daf0 0x55ae5cd26360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:13.530 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.529+0000 7fc9eb7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae5cd1daf0 0x55ae5cd26360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:37538/0 (socket says 172.21.15.148:37538) 2024-09-19T07:29:13.530 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.529+0000 7fc9eaffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ae5cd1e410 0x55ae5cd518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:13.531 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.529+0000 7fc9eb7fe640 1 -- 172.21.15.148:0/781444383 learned_addr learned my addr 172.21.15.148:0/781444383 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:29:13.531 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.529+0000 7fc9f49fc740 1 --2- 172.21.15.148:0/781444383 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ae5cd28cb0 0x55ae5cd51e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:13.531 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.529+0000 7fc9f49fc740 1 -- 172.21.15.148:0/781444383 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ec1b69f0 con 0x55ae5cd1e410 2024-09-19T07:29:13.531 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.530+0000 7fc9f49fc740 1 -- 172.21.15.148:0/781444383 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ec1b4200 con 0x55ae5cd28cb0 2024-09-19T07:29:13.531 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.530+0000 7fc9f49fc740 1 -- 172.21.15.148:0/781444383 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ec117100 con 0x55ae5cd1daf0 2024-09-19T07:29:13.531 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.530+0000 7fc9ebfff640 1 --2- 172.21.15.148:0/781444383 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ae5cd28cb0 0x55ae5cd51e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:13.532 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.530+0000 7fc9eaffd640 1 -- 172.21.15.148:0/781444383 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae5cd1daf0 msgr2=0x55ae5cd26360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:13.532 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.530+0000 7fc9eaffd640 1 --2- 172.21.15.148:0/781444383 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae5cd1daf0 0x55ae5cd26360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:13.532 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.530+0000 7fc9eaffd640 1 -- 172.21.15.148:0/781444383 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ae5cd28cb0 msgr2=0x55ae5cd51e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:13.532 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.530+0000 7fc9eaffd640 1 --2- 172.21.15.148:0/781444383 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ae5cd28cb0 0x55ae5cd51e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:13.532 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.530+0000 7fc9eaffd640 1 -- 172.21.15.148:0/781444383 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae5cd19e90 con 0x55ae5cd1e410 2024-09-19T07:29:13.532 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.531+0000 7fc9eaffd640 1 --2- 172.21.15.148:0/781444383 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ae5cd1e410 0x55ae5cd518e0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x55ae5cd270f0 tx=0x7fc9e00090e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c63d5a30b2eeb5c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:13.532 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.531+0000 7fc9d17fa640 1 -- 172.21.15.148:0/781444383 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e0015040 con 0x55ae5cd1e410 2024-09-19T07:29:13.533 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.531+0000 7fc9d17fa640 1 -- 172.21.15.148:0/781444383 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9e000b8d0 con 0x55ae5cd1e410 2024-09-19T07:29:13.533 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.531+0000 7fc9d17fa640 1 -- 172.21.15.148:0/781444383 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e00044d0 con 0x55ae5cd1e410 2024-09-19T07:29:13.534 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.533+0000 7fc9f49fc740 1 -- 172.21.15.148:0/781444383 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ae5cd1e410 msgr2=0x55ae5cd518e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:13.534 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.533+0000 7fc9f49fc740 1 --2- 172.21.15.148:0/781444383 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ae5cd1e410 0x55ae5cd518e0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x55ae5cd270f0 tx=0x7fc9e00090e0 comp rx=0 tx=0).stop 2024-09-19T07:29:13.534 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.533+0000 7fc9eb7fe640 1 --2- 172.21.15.148:0/781444383 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae5cd1daf0 0x55ae5cd26360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:29:13.534 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.533+0000 7fc9ebfff640 1 --2- 172.21.15.148:0/781444383 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ae5cd28cb0 0x55ae5cd51e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:29:13.534 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.533+0000 7fc9f49fc740 1 -- 172.21.15.148:0/781444383 shutdown_connections 2024-09-19T07:29:13.534 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.533+0000 7fc9f49fc740 1 --2- 172.21.15.148:0/781444383 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ae5cd28cb0 0x55ae5cd51e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:13.534 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.533+0000 7fc9f49fc740 1 --2- 172.21.15.148:0/781444383 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ae5cd1e410 0x55ae5cd518e0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:13.534 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.533+0000 7fc9f49fc740 1 --2- 172.21.15.148:0/781444383 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae5cd1daf0 0x55ae5cd26360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:13.534 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.533+0000 7fc9f49fc740 1 -- 172.21.15.148:0/781444383 >> 172.21.15.148:0/781444383 conn(0x55ae5cd1a060 msgr2=0x55ae5cd27b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:13.535 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.533+0000 7fc9f49fc740 1 -- 172.21.15.148:0/781444383 shutdown_connections 2024-09-19T07:29:13.535 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.533+0000 7fc9f49fc740 1 -- 172.21.15.148:0/781444383 wait complete. 2024-09-19T07:29:13.535 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.533+0000 7fc9f49fc740 1 -- start start 2024-09-19T07:29:13.535 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.534+0000 7fc9f49fc740 1 Processor -- start 2024-09-19T07:29:13.536 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.534+0000 7fc9f49fc740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ae5cd1daf0 0x55ae5cd31520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:13.536 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.534+0000 7fc9f49fc740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ae5cd1e410 0x55ae5cd227c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:13.536 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.534+0000 7fc9f49fc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae5cd28cb0 0x55ae5cd22d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:13.536 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.534+0000 7fc9f49fc740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ec117750 con 0x55ae5cd1e410 2024-09-19T07:29:13.536 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.534+0000 7fc9f49fc740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ec118bc0 con 0x55ae5cd1daf0 2024-09-19T07:29:13.536 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.534+0000 7fc9f49fc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ec117e20 con 0x55ae5cd28cb0 2024-09-19T07:29:13.537 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.534+0000 7fc9f49fc740 10 client.0 _ll_register_callbacks cb 0x7fc9dc097320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:29:13.537 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.535+0000 7fc9eb7fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ae5cd1daf0 0x55ae5cd31520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:13.537 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.535+0000 7fc9eb7fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ae5cd1daf0 0x55ae5cd31520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:35742/0 (socket says 172.21.15.148:35742) 2024-09-19T07:29:13.537 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.535+0000 7fc9eb7fe640 1 -- 172.21.15.148:0/1706164432 learned_addr learned my addr 172.21.15.148:0/1706164432 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:29:13.537 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.535+0000 7fc9ebfff640 1 --2- 172.21.15.148:0/1706164432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae5cd28cb0 0x55ae5cd22d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:13.537 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.535+0000 7fc9eaffd640 1 --2- 172.21.15.148:0/1706164432 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ae5cd1e410 0x55ae5cd227c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:13.537 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.535+0000 7fc9eb7fe640 1 -- 172.21.15.148:0/1706164432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae5cd28cb0 msgr2=0x55ae5cd22d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:13.537 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.535+0000 7fc9eb7fe640 1 --2- 172.21.15.148:0/1706164432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae5cd28cb0 0x55ae5cd22d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:13.537 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.535+0000 7fc9eb7fe640 1 -- 172.21.15.148:0/1706164432 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ae5cd1e410 msgr2=0x55ae5cd227c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:13.537 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.535+0000 7fc9eb7fe640 1 --2- 172.21.15.148:0/1706164432 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ae5cd1e410 0x55ae5cd227c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:13.537 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.535+0000 7fc9eb7fe640 1 -- 172.21.15.148:0/1706164432 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae5cd152d0 con 0x55ae5cd1daf0 2024-09-19T07:29:13.537 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.536+0000 7fc9eb7fe640 1 --2- 172.21.15.148:0/1706164432 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ae5cd1daf0 0x55ae5cd31520 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc0cd000 tx=0x7fc9dc010950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b005c21cd401b521 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:13.538 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.536+0000 7fc9caffd640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-19T07:29:13.538 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.536+0000 7fc9caffd640 1 -- 172.21.15.148:0/1706164432 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc0b4040 con 0x55ae5cd1daf0 2024-09-19T07:29:13.538 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.537+0000 7fc9f49fc740 1 -- 172.21.15.148:0/1706164432 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9e000b8d0 con 0x55ae5cd1daf0 2024-09-19T07:29:13.539 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.537+0000 7fc9caffd640 1 -- 172.21.15.148:0/1706164432 <== mon.2 v2:172.21.15.165:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 8600+0+0 (secure 0 0 0) 0x7fc9dc010380 con 0x55ae5cd1daf0 2024-09-19T07:29:13.539 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.538+0000 7fc9caffd640 1 -- 172.21.15.148:0/1706164432 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7fc9dc097960 con 0x55ae5cd1daf0 2024-09-19T07:29:13.540 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.540+0000 7fc9f49fc740 10 client.26861 fetch_fsmap learned FSMap version 55 2024-09-19T07:29:13.540 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.540+0000 7fc9f49fc740 1 -- 172.21.15.148:0/1706164432 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x55ae5cd1acf0 con 0x55ae5cd1daf0 2024-09-19T07:29:13.542 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.542+0000 7fc9caffd640 1 -- 172.21.15.148:0/1706164432 <== mon.2 v2:172.21.15.165:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9e000b8d0 con 0x55ae5cd1daf0 2024-09-19T07:29:13.542 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.542+0000 7fc9caffd640 1 -- 172.21.15.148:0/1706164432 <== mon.2 v2:172.21.15.165:3300/0 5 ==== fsmap(e 55) ==== 8370+0+0 (secure 0 0 0) 0x7fc9dc020b50 con 0x55ae5cd1daf0 2024-09-19T07:29:13.543 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.543+0000 7fc9f49fc740 10 client.26861 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T07:29:13.543 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.543+0000 7fc9f49fc740 10 client.26861 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:29:13.543 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.543+0000 7fc9f49fc740 20 client.26861 populate_metadata read hostname 'smithi148' 2024-09-19T07:29:13.544 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.543+0000 7fc9f49fc740 1 --2- 172.21.15.148:0/1706164432 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ae5cdb49c0 0x55ae5cdb6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:13.544 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.543+0000 7fc9f49fc740 4 client.26861 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:29:13.544 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.543+0000 7fc9f49fc740 1 -- 172.21.15.148:0/1706164432 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ae5cc89d70 con 0x55ae5cdb49c0 2024-09-19T07:29:13.544 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.544+0000 7fc9eaffd640 1 --2- 172.21.15.148:0/1706164432 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ae5cdb49c0 0x55ae5cdb6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:13.548 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.548+0000 7fc9eaffd640 1 --2- 172.21.15.148:0/1706164432 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ae5cdb49c0 0x55ae5cdb6db0 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a07d08425f78729 server_cookie=1f7768cfb3271e0e in_seq=0 out_seq=0 2024-09-19T07:29:13.549 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.549+0000 7fc9caffd640 10 client.26861 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:29:13.694 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.692+0000 7fc9caffd640 1 -- 172.21.15.148:0/1706164432 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ae5cc89d70 con 0x55ae5cdb49c0 2024-09-19T07:29:13.694 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.692+0000 7fc9caffd640 10 client.26861 handle_command_reply: tid=0 2024-09-19T07:29:13.694 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.692+0000 7fc9f49fc740 1 client.26861 shutdown 2024-09-19T07:29:13.695 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.693+0000 7fc9f49fc740 1 -- 172.21.15.148:0/1706164432 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ae5cd1daf0 msgr2=0x55ae5cd31520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:13.695 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.693+0000 7fc9f49fc740 1 --2- 172.21.15.148:0/1706164432 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ae5cd1daf0 0x55ae5cd31520 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc0cd000 tx=0x7fc9dc010950 comp rx=0 tx=0).stop 2024-09-19T07:29:13.695 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.693+0000 7fc9f49fc740 1 -- 172.21.15.148:0/1706164432 shutdown_connections 2024-09-19T07:29:13.695 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.693+0000 7fc9f49fc740 1 --2- 172.21.15.148:0/1706164432 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ae5cdb49c0 0x55ae5cdb6db0 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:13.695 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.693+0000 7fc9f49fc740 1 --2- 172.21.15.148:0/1706164432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ae5cd28cb0 0x55ae5cd22d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:13.695 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.693+0000 7fc9f49fc740 1 --2- 172.21.15.148:0/1706164432 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ae5cd1e410 0x55ae5cd227c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:13.696 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.693+0000 7fc9f49fc740 1 --2- 172.21.15.148:0/1706164432 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ae5cd1daf0 0x55ae5cd31520 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:13.696 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.693+0000 7fc9f49fc740 1 -- 172.21.15.148:0/1706164432 >> 172.21.15.148:0/1706164432 conn(0x55ae5cd1a060 msgr2=0x55ae5cd189a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:13.696 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.693+0000 7fc9caffd640 0 client.26861 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:29:13.696 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.693+0000 7fc9f49fc740 1 -- 172.21.15.148:0/1706164432 shutdown_connections 2024-09-19T07:29:13.696 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.693+0000 7fc9f49fc740 1 -- 172.21.15.148:0/1706164432 wait complete. 2024-09-19T07:29:13.696 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.693+0000 7fc9f49fc740 20 client.26861 trim_cache size 0 max 16384 2024-09-19T07:29:13.697 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:29:13.697 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:29:13.697 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:29:13.697 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:29:13.699 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.694+0000 7fc9f1c5e640 1 -- 172.21.15.148:0/2265978452 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc9d40a3690 msgr2=0x7fc9d40a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:13.699 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.694+0000 7fc9f1c5e640 1 --2- 172.21.15.148:0/2265978452 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc9d40a3690 0x7fc9d40a5b50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x55ae5cd1b3e0 tx=0x7fc9e402f4a0 comp rx=0 tx=0).stop 2024-09-19T07:29:13.699 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.694+0000 7fc9f1c5e640 1 -- 172.21.15.148:0/2265978452 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9ec1091f0 msgr2=0x7fc9ec1a7290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:13.700 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.694+0000 7fc9f1c5e640 1 --2- 172.21.15.148:0/2265978452 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9ec1091f0 0x7fc9ec1a7290 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc009fd0 tx=0x7fc9dc00b870 comp rx=0 tx=0).stop 2024-09-19T07:29:13.700 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.694+0000 7fc9f1c5e640 1 -- 172.21.15.148:0/2265978452 shutdown_connections 2024-09-19T07:29:13.700 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.694+0000 7fc9f1c5e640 1 --2- 172.21.15.148:0/2265978452 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fc9d40a3690 0x7fc9d40a5b50 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:13.700 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.694+0000 7fc9f1c5e640 1 --2- 172.21.15.148:0/2265978452 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9ec11b140 0x7fc9ec1abb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:13.700 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.694+0000 7fc9f1c5e640 1 --2- 172.21.15.148:0/2265978452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9ec1095d0 0x7fc9ec1a77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:13.701 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.694+0000 7fc9f1c5e640 1 --2- 172.21.15.148:0/2265978452 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9ec1091f0 0x7fc9ec1a7290 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:13.701 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.694+0000 7fc9f1c5e640 1 -- 172.21.15.148:0/2265978452 >> 172.21.15.148:0/2265978452 conn(0x7fc9ec06ce00 msgr2=0x7fc9ec11b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:13.701 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.694+0000 7fc9f1c5e640 1 -- 172.21.15.148:0/2265978452 shutdown_connections 2024-09-19T07:29:13.701 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:13.694+0000 7fc9f1c5e640 1 -- 172.21.15.148:0/2265978452 wait complete. 2024-09-19T07:29:14.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:29:13 smithi179 ceph-mon[35716]: osdmap e105: 12 total, 12 up, 12 in 2024-09-19T07:29:14.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:29:13 smithi148 ceph-mon[31180]: osdmap e105: 12 total, 12 up, 12 in 2024-09-19T07:29:14.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:29:13 smithi165 ceph-mon[35326]: osdmap e105: 12 total, 12 up, 12 in 2024-09-19T07:29:15.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:29:14 smithi179 ceph-mon[35716]: pgmap v572: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.4 MiB/s wr, 362 op/s 2024-09-19T07:29:15.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:29:14 smithi148 ceph-mon[31180]: pgmap v572: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.4 MiB/s wr, 362 op/s 2024-09-19T07:29:15.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:29:14 smithi165 ceph-mon[35326]: pgmap v572: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.4 MiB/s wr, 362 op/s 2024-09-19T07:29:17.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:29:16 smithi179 ceph-mon[35716]: pgmap v573: 97 pgs: 21 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 37 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.5 MiB/s wr, 296 op/s 2024-09-19T07:29:17.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:29:16 smithi148 ceph-mon[31180]: pgmap v573: 97 pgs: 21 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 37 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.5 MiB/s wr, 296 op/s 2024-09-19T07:29:17.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:29:16 smithi165 ceph-mon[35326]: pgmap v573: 97 pgs: 21 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 37 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.5 MiB/s wr, 296 op/s 2024-09-19T07:29:19.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:29:18 smithi179 ceph-mon[35716]: pgmap v574: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.5 MiB/s wr, 303 op/s 2024-09-19T07:29:19.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:29:18 smithi148 ceph-mon[31180]: pgmap v574: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.5 MiB/s wr, 303 op/s 2024-09-19T07:29:19.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:29:18 smithi165 ceph-mon[35326]: pgmap v574: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.5 MiB/s wr, 303 op/s 2024-09-19T07:29:21.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:29:20 smithi179 ceph-mon[35716]: pgmap v575: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.1 MiB/s wr, 284 op/s 2024-09-19T07:29:21.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:29:20 smithi148 ceph-mon[31180]: pgmap v575: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.1 MiB/s wr, 284 op/s 2024-09-19T07:29:21.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:29:20 smithi165 ceph-mon[35326]: pgmap v575: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.1 MiB/s wr, 284 op/s 2024-09-19T07:29:22.389 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 17.1 2024-09-19T07:29:22.390 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:29:22.842 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:29:22.987 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:29:22 smithi148 ceph-mon[31180]: pgmap v576: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 242 op/s 2024-09-19T07:29:23.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:29:22 smithi179 ceph-mon[35716]: pgmap v576: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 242 op/s 2024-09-19T07:29:23.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:29:22 smithi165 ceph-mon[35326]: pgmap v576: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 242 op/s 2024-09-19T07:29:24.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.361+0000 7f349ad6c640 1 -- 172.21.15.148:0/1368425470 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34941008d0 msgr2=0x7f3494100d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:24.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.361+0000 7f349ad6c640 1 --2- 172.21.15.148:0/1368425470 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34941008d0 0x7f3494100d30 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f3484009930 tx=0x7f348402a440 comp rx=0 tx=0).stop 2024-09-19T07:29:24.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.363+0000 7f349ad6c640 1 -- 172.21.15.148:0/1368425470 shutdown_connections 2024-09-19T07:29:24.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.363+0000 7f349ad6c640 1 --2- 172.21.15.148:0/1368425470 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3494101270 0x7f349410d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:24.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.363+0000 7f349ad6c640 1 --2- 172.21.15.148:0/1368425470 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34941008d0 0x7f3494100d30 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:24.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.363+0000 7f349ad6c640 1 --2- 172.21.15.148:0/1368425470 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34941068d0 0x7f3494106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:24.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.363+0000 7f349ad6c640 1 -- 172.21.15.148:0/1368425470 >> 172.21.15.148:0/1368425470 conn(0x7f34940fc610 msgr2=0x7f34940fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:24.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.363+0000 7f349ad6c640 1 -- 172.21.15.148:0/1368425470 shutdown_connections 2024-09-19T07:29:24.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.363+0000 7f349ad6c640 1 -- 172.21.15.148:0/1368425470 wait complete. 2024-09-19T07:29:24.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.364+0000 7f349ad6c640 1 Processor -- start 2024-09-19T07:29:24.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.364+0000 7f349ad6c640 1 -- start start 2024-09-19T07:29:24.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.364+0000 7f349ad6c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34941008d0 0x7f3494073940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:24.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.364+0000 7f349ad6c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3494101270 0x7f3494073e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:24.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.364+0000 7f349ad6c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f34941068d0 0x7f349406cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:24.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.364+0000 7f349ad6c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f349410fc80 con 0x7f34941008d0 2024-09-19T07:29:24.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.364+0000 7f349ad6c640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f349410fb00 con 0x7f34941068d0 2024-09-19T07:29:24.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.364+0000 7f349ad6c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f349410fe00 con 0x7f3494101270 2024-09-19T07:29:24.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.365+0000 7f349a56b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f34941068d0 0x7f349406cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:24.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.365+0000 7f349a56b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f34941068d0 0x7f349406cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:35782/0 (socket says 172.21.15.148:35782) 2024-09-19T07:29:24.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.365+0000 7f349a56b640 1 -- 172.21.15.148:0/1868316191 learned_addr learned my addr 172.21.15.148:0/1868316191 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:29:24.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.365+0000 7f3499d6a640 1 --2- 172.21.15.148:0/1868316191 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34941008d0 0x7f3494073940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:24.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.365+0000 7f3499569640 1 --2- 172.21.15.148:0/1868316191 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3494101270 0x7f3494073e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:24.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.365+0000 7f3499d6a640 1 -- 172.21.15.148:0/1868316191 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3494101270 msgr2=0x7f3494073e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:24.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.365+0000 7f3499d6a640 1 --2- 172.21.15.148:0/1868316191 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3494101270 0x7f3494073e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:24.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.365+0000 7f3499d6a640 1 -- 172.21.15.148:0/1868316191 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f34941068d0 msgr2=0x7f349406cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:24.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.365+0000 7f3499d6a640 1 --2- 172.21.15.148:0/1868316191 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f34941068d0 0x7f349406cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:24.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.365+0000 7f3499d6a640 1 -- 172.21.15.148:0/1868316191 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f349406d470 con 0x7f34941008d0 2024-09-19T07:29:24.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.365+0000 7f3499569640 1 --2- 172.21.15.148:0/1868316191 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3494101270 0x7f3494073e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:29:24.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.366+0000 7f3499d6a640 1 --2- 172.21.15.148:0/1868316191 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34941008d0 0x7f3494073940 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f348c009fd0 tx=0x7f348c00ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:24.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.366+0000 7f348affd640 1 -- 172.21.15.148:0/1868316191 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f348c004b20 con 0x7f34941008d0 2024-09-19T07:29:24.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.366+0000 7f349ad6c640 1 -- 172.21.15.148:0/1868316191 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f349406d700 con 0x7f34941008d0 2024-09-19T07:29:24.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.366+0000 7f349ad6c640 1 -- 172.21.15.148:0/1868316191 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34940716a0 con 0x7f34941008d0 2024-09-19T07:29:24.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.366+0000 7f348affd640 1 -- 172.21.15.148:0/1868316191 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f348c004cc0 con 0x7f34941008d0 2024-09-19T07:29:24.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.366+0000 7f348affd640 1 -- 172.21.15.148:0/1868316191 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f348c0107b0 con 0x7f34941008d0 2024-09-19T07:29:24.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.367+0000 7f349ad6c640 1 -- 172.21.15.148:0/1868316191 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3494102010 con 0x7f34941008d0 2024-09-19T07:29:24.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.372+0000 7f348affd640 1 -- 172.21.15.148:0/1868316191 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f348c010950 con 0x7f34941008d0 2024-09-19T07:29:24.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.372+0000 7f348affd640 1 --2- 172.21.15.148:0/1868316191 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f34800a3500 0x7f34800a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:24.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.373+0000 7f348affd640 1 -- 172.21.15.148:0/1868316191 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8600+0+0 (secure 0 0 0) 0x7f348c0d05c0 con 0x7f34941008d0 2024-09-19T07:29:24.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.383+0000 7f3499569640 1 --2- 172.21.15.148:0/1868316191 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f34800a3500 0x7f34800a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:24.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.384+0000 7f3499569640 1 --2- 172.21.15.148:0/1868316191 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f34800a3500 0x7f34800a59c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3484005ab0 tx=0x7f348402a940 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:24.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.385+0000 7f348affd640 1 -- 172.21.15.148:0/1868316191 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f348c09cef0 con 0x7f34941008d0 2024-09-19T07:29:24.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.784+0000 7f349ad6c640 1 -- 172.21.15.148:0/1868316191 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3494100d30 con 0x7f34941008d0 2024-09-19T07:29:24.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.786+0000 7f348affd640 1 -- 172.21.15.148:0/1868316191 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+11947 (secure 0 0 0) 0x7f348c09c7f0 con 0x7f34941008d0 2024-09-19T07:29:24.787 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:29:24.787 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":55,"btime":"2024-09-19T07:26:06:767218+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/4263868576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":4263868576},{"type":"v1","addr":"172.21.15.148:6841","nonce":4263868576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":25606,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3891676893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3891676893},{"type":"v1","addr":"172.21.15.179:6835","nonce":3891676893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":55,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:09:19.543369+0000","modified":"2024-09-19T07:26:06.157910+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24457,"mds_1":24437,"mds_2":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":75,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":71,"addr":"172.21.15.165:6839/3993490234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":3993490234},{"type":"v1","addr":"172.21.15.165:6839","nonce":3993490234}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25823":{"gid":25823,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6835/380886107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":380886107},{"type":"v1","addr":"172.21.15.165:6835","nonce":380886107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24457,"qdb_cluster":[24457,24437,24436]},"id":1}]} 2024-09-19T07:29:24.788 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 55 2024-09-19T07:29:24.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.789+0000 7f349ad6c640 1 -- 172.21.15.148:0/1868316191 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f34800a3500 msgr2=0x7f34800a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:24.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.789+0000 7f349ad6c640 1 --2- 172.21.15.148:0/1868316191 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f34800a3500 0x7f34800a59c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3484005ab0 tx=0x7f348402a940 comp rx=0 tx=0).stop 2024-09-19T07:29:24.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.789+0000 7f349ad6c640 1 -- 172.21.15.148:0/1868316191 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34941008d0 msgr2=0x7f3494073940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:24.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.789+0000 7f349ad6c640 1 --2- 172.21.15.148:0/1868316191 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34941008d0 0x7f3494073940 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f348c009fd0 tx=0x7f348c00ef90 comp rx=0 tx=0).stop 2024-09-19T07:29:24.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.790+0000 7f349ad6c640 1 -- 172.21.15.148:0/1868316191 shutdown_connections 2024-09-19T07:29:24.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.790+0000 7f349ad6c640 1 --2- 172.21.15.148:0/1868316191 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f34800a3500 0x7f34800a59c0 secure :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3484005ab0 tx=0x7f348402a940 comp rx=0 tx=0).stop 2024-09-19T07:29:24.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.790+0000 7f349ad6c640 1 --2- 172.21.15.148:0/1868316191 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f34941068d0 0x7f349406cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:24.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.790+0000 7f349ad6c640 1 --2- 172.21.15.148:0/1868316191 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3494101270 0x7f3494073e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:24.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.790+0000 7f349ad6c640 1 --2- 172.21.15.148:0/1868316191 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34941008d0 0x7f3494073940 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:24.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.790+0000 7f349ad6c640 1 -- 172.21.15.148:0/1868316191 >> 172.21.15.148:0/1868316191 conn(0x7f34940fc610 msgr2=0x7f34940fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:24.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.791+0000 7f349ad6c640 1 -- 172.21.15.148:0/1868316191 shutdown_connections 2024-09-19T07:29:24.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:24.793+0000 7f349ad6c640 1 -- 172.21.15.148:0/1868316191 wait complete. 2024-09-19T07:29:25.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:29:24 smithi179 ceph-mon[35716]: pgmap v577: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 228 op/s 2024-09-19T07:29:25.059 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:29:24 smithi148 ceph-mon[31180]: pgmap v577: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 228 op/s 2024-09-19T07:29:25.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:29:24 smithi165 ceph-mon[35326]: pgmap v577: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 228 op/s 2024-09-19T07:29:25.677 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24457 quiesce db / --timeout 90 --expiration 137.1 --await-for 45.0' 2024-09-19T07:29:25.677 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24457 quiesce db / --timeout 90 --expiration 137.1 --await-for 45.0 2024-09-19T07:29:26.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:29:25 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/1868316191' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:29:26.034 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:29:25 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/1868316191' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:29:26.086 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:29:25 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/1868316191' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:29:26.163 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:29:26.864 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.864+0000 7feb0d615640 1 -- 172.21.15.148:0/3717484238 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb0811b140 msgr2=0x7feb0811d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:26.865 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.864+0000 7feb0d615640 1 --2- 172.21.15.148:0/3717484238 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb0811b140 0x7feb0811d530 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7feb00009ca0 tx=0x7feb0002a8f0 comp rx=0 tx=0).stop 2024-09-19T07:29:26.870 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.869+0000 7feb0d615640 1 -- 172.21.15.148:0/3717484238 shutdown_connections 2024-09-19T07:29:26.870 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.869+0000 7feb0d615640 1 --2- 172.21.15.148:0/3717484238 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb0811b140 0x7feb0811d530 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:26.870 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.869+0000 7feb0d615640 1 --2- 172.21.15.148:0/3717484238 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb081095d0 0x7feb08109a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:26.870 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.869+0000 7feb0d615640 1 --2- 172.21.15.148:0/3717484238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb081091f0 0x7feb08110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:26.870 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.869+0000 7feb0d615640 1 -- 172.21.15.148:0/3717484238 >> 172.21.15.148:0/3717484238 conn(0x7feb0806cbf0 msgr2=0x7feb0806d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:26.873 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.872+0000 7feb0d615640 1 -- 172.21.15.148:0/3717484238 shutdown_connections 2024-09-19T07:29:26.873 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.873+0000 7feb0d615640 1 -- 172.21.15.148:0/3717484238 wait complete. 2024-09-19T07:29:26.874 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.874+0000 7feb0d615640 1 Processor -- start 2024-09-19T07:29:26.875 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.874+0000 7feb0d615640 1 -- start start 2024-09-19T07:29:26.876 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.874+0000 7feb0d615640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb081091f0 0x7feb08118780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:26.876 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.875+0000 7feb0d615640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb081095d0 0x7feb08111800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:26.876 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.875+0000 7feb0d615640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb0811b140 0x7feb08111d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:26.876 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.875+0000 7feb0d615640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7feb08120ba0 con 0x7feb0811b140 2024-09-19T07:29:26.876 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.875+0000 7feb0d615640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7feb08120a20 con 0x7feb081095d0 2024-09-19T07:29:26.876 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.875+0000 7feb0d615640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7feb08120d20 con 0x7feb081091f0 2024-09-19T07:29:26.876 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.875+0000 7feb0ce14640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb0811b140 0x7feb08111d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:26.876 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.876+0000 7feb0ce14640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb0811b140 0x7feb08111d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48184/0 (socket says 172.21.15.148:48184) 2024-09-19T07:29:26.876 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.876+0000 7feb0ce14640 1 -- 172.21.15.148:0/685610858 learned_addr learned my addr 172.21.15.148:0/685610858 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:29:26.877 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.876+0000 7feb0ce14640 1 -- 172.21.15.148:0/685610858 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb081091f0 msgr2=0x7feb08118780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:26.877 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.876+0000 7feb0ce14640 1 --2- 172.21.15.148:0/685610858 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb081091f0 0x7feb08118780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:26.878 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.876+0000 7feb0ce14640 1 -- 172.21.15.148:0/685610858 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb081095d0 msgr2=0x7feb08111800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:26.878 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.876+0000 7feb0ce14640 1 --2- 172.21.15.148:0/685610858 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb081095d0 0x7feb08111800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:26.878 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.876+0000 7feb0ce14640 1 -- 172.21.15.148:0/685610858 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb08112380 con 0x7feb0811b140 2024-09-19T07:29:26.878 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.877+0000 7feb0ce14640 1 --2- 172.21.15.148:0/685610858 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb0811b140 0x7feb08111d40 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7feb000097b0 tx=0x7feb00031480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:26.879 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.878+0000 7feb057fa640 1 -- 172.21.15.148:0/685610858 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb00031860 con 0x7feb0811b140 2024-09-19T07:29:26.879 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.878+0000 7feb057fa640 1 -- 172.21.15.148:0/685610858 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb0002d070 con 0x7feb0811b140 2024-09-19T07:29:26.879 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.878+0000 7feb057fa640 1 -- 172.21.15.148:0/685610858 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb0002fb70 con 0x7feb0811b140 2024-09-19T07:29:26.879 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.878+0000 7feb0d615640 1 -- 172.21.15.148:0/685610858 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb08112610 con 0x7feb0811b140 2024-09-19T07:29:26.879 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.878+0000 7feb0d615640 1 -- 172.21.15.148:0/685610858 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb081165a0 con 0x7feb0811b140 2024-09-19T07:29:26.883 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.883+0000 7feb11609740 1 Processor -- start 2024-09-19T07:29:26.885 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.884+0000 7feb11609740 1 -- start start 2024-09-19T07:29:26.885 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.884+0000 7feb11609740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ecfaab6cc0 0x55ecfaab70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:26.885 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.884+0000 7feb11609740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ecfaab75e0 0x55ecfaac1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:26.885 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.884+0000 7feb11609740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ecfaac1e80 0x55ecfaac4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:26.885 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.884+0000 7feb11609740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55ecfaa1b2f0 con 0x55ecfaab6cc0 2024-09-19T07:29:26.885 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.884+0000 7feb11609740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ecfa9c3270 con 0x55ecfaac1e80 2024-09-19T07:29:26.885 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.884+0000 7feb11609740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ecfaa172b0 con 0x55ecfaab75e0 2024-09-19T07:29:26.885 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.884+0000 7feb057fa640 1 -- 172.21.15.148:0/685610858 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7feb0002fd10 con 0x7feb0811b140 2024-09-19T07:29:26.885 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.885+0000 7feb077fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ecfaac1e80 0x55ecfaac4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:26.886 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.885+0000 7feb077fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ecfaac1e80 0x55ecfaac4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:35808/0 (socket says 172.21.15.148:35808) 2024-09-19T07:29:26.886 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.885+0000 7feb077fe640 1 -- 172.21.15.148:0/3615884356 learned_addr learned my addr 172.21.15.148:0/3615884356 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:29:26.886 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.885+0000 7feb07fff640 1 --2- 172.21.15.148:0/3615884356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ecfaab75e0 0x55ecfaac1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:26.886 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.885+0000 7feb077fe640 1 -- 172.21.15.148:0/3615884356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ecfaab75e0 msgr2=0x55ecfaac1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:26.886 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.885+0000 7feb077fe640 1 --2- 172.21.15.148:0/3615884356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ecfaab75e0 0x55ecfaac1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:26.887 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.885+0000 7feb077fe640 1 -- 172.21.15.148:0/3615884356 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ecfaab6cc0 msgr2=0x55ecfaab70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:26.887 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.885+0000 7feb077fe640 1 --2- 172.21.15.148:0/3615884356 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ecfaab6cc0 0x55ecfaab70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:26.887 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.885+0000 7feb077fe640 1 -- 172.21.15.148:0/3615884356 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecfa9c2340 con 0x55ecfaac1e80 2024-09-19T07:29:26.887 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.885+0000 7feb077fe640 1 --2- 172.21.15.148:0/3615884356 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ecfaac1e80 0x55ecfaac4270 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7feaf400bd20 tx=0x7feaf400d420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0c9815a3773348b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:26.887 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.886+0000 7feb057fa640 1 --2- 172.21.15.148:0/685610858 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7feaec0a35c0 0x7feaec0a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:26.887 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.887+0000 7feb07fff640 1 --2- 172.21.15.148:0/685610858 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7feaec0a35c0 0x7feaec0a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:26.887 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.887+0000 7feb057fa640 1 -- 172.21.15.148:0/685610858 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8600+0+0 (secure 0 0 0) 0x7feb000f13e0 con 0x7feb0811b140 2024-09-19T07:29:26.888 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.888+0000 7feb07fff640 1 --2- 172.21.15.148:0/685610858 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7feaec0a35c0 0x7feaec0a5a80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x55ecfaab4090 tx=0x7feaf8009110 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:26.889 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.889+0000 7feafe7fc640 1 -- 172.21.15.148:0/3615884356 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf4019070 con 0x55ecfaac1e80 2024-09-19T07:29:26.890 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.889+0000 7feafe7fc640 1 -- 172.21.15.148:0/3615884356 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feaf4004d30 con 0x55ecfaac1e80 2024-09-19T07:29:26.890 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.889+0000 7feafe7fc640 1 -- 172.21.15.148:0/3615884356 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf4014410 con 0x55ecfaac1e80 2024-09-19T07:29:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.891+0000 7feb11609740 1 -- 172.21.15.148:0/3615884356 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ecfaac1e80 msgr2=0x55ecfaac4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.891+0000 7feb11609740 1 --2- 172.21.15.148:0/3615884356 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ecfaac1e80 0x55ecfaac4270 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7feaf400bd20 tx=0x7feaf400d420 comp rx=0 tx=0).stop 2024-09-19T07:29:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.892+0000 7feb11609740 1 -- 172.21.15.148:0/3615884356 shutdown_connections 2024-09-19T07:29:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.892+0000 7feb11609740 1 --2- 172.21.15.148:0/3615884356 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ecfaac1e80 0x55ecfaac4270 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.892+0000 7feb11609740 1 --2- 172.21.15.148:0/3615884356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ecfaab75e0 0x55ecfaac1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.892+0000 7feb11609740 1 --2- 172.21.15.148:0/3615884356 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ecfaab6cc0 0x55ecfaab70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.892+0000 7feb11609740 1 -- 172.21.15.148:0/3615884356 >> 172.21.15.148:0/3615884356 conn(0x55ecfaab3230 msgr2=0x55ecfaab3610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:26.893 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.892+0000 7feb11609740 1 -- 172.21.15.148:0/3615884356 shutdown_connections 2024-09-19T07:29:26.894 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.892+0000 7feb11609740 1 -- 172.21.15.148:0/3615884356 wait complete. 2024-09-19T07:29:26.894 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.893+0000 7feb11609740 1 -- start start 2024-09-19T07:29:26.894 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.893+0000 7feb11609740 1 Processor -- start 2024-09-19T07:29:26.894 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.894+0000 7feb11609740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ecfaab6cc0 0x55ecfaabeee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:26.894 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.894+0000 7feb11609740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ecfaab75e0 0x55ecfaabf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:26.894 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.894+0000 7feb11609740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ecfaac1e80 0x55ecfaabf960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:26.894 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.894+0000 7feb11609740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55ecfaac4a50 con 0x55ecfaab75e0 2024-09-19T07:29:26.895 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.894+0000 7feb11609740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ecfa9a4290 con 0x55ecfaab6cc0 2024-09-19T07:29:26.895 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.894+0000 7feb11609740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ecfaac4bd0 con 0x55ecfaac1e80 2024-09-19T07:29:26.895 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.894+0000 7feb11609740 10 client.0 _ll_register_callbacks cb 0x55ecfa9d5140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:29:26.895 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.895+0000 7feb0ce14640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ecfaac1e80 0x55ecfaabf960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:26.895 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.895+0000 7feb0ce14640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ecfaac1e80 0x55ecfaabf960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:45016/0 (socket says 172.21.15.148:45016) 2024-09-19T07:29:26.895 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.895+0000 7feb0ce14640 1 -- 172.21.15.148:0/1076491456 learned_addr learned my addr 172.21.15.148:0/1076491456 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:29:26.896 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.895+0000 7feb0ce14640 1 -- 172.21.15.148:0/1076491456 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ecfaab6cc0 msgr2=0x55ecfaabeee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T07:29:26.896 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.895+0000 7feb0ce14640 1 --2- 172.21.15.148:0/1076491456 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ecfaab6cc0 0x55ecfaabeee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:26.896 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.896+0000 7feb0ce14640 1 -- 172.21.15.148:0/1076491456 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ecfaab75e0 msgr2=0x55ecfaabf420 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T07:29:26.897 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.896+0000 7feb0ce14640 1 --2- 172.21.15.148:0/1076491456 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ecfaab75e0 0x55ecfaabf420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:26.897 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.896+0000 7feb0ce14640 1 -- 172.21.15.148:0/1076491456 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecfa72e210 con 0x55ecfaac1e80 2024-09-19T07:29:26.897 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.896+0000 7feb0ce14640 1 --2- 172.21.15.148:0/1076491456 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ecfaac1e80 0x55ecfaabf960 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7feb000ba0f0 tx=0x7feb000bd080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4715bf8ead509a34 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:26.897 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.897+0000 7feaeb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-19T07:29:26.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.900+0000 7feaeb7fe640 1 -- 172.21.15.148:0/1076491456 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb000d5020 con 0x55ecfaac1e80 2024-09-19T07:29:26.900 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.900+0000 7feb11609740 1 -- 172.21.15.148:0/1076491456 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feaf4004d30 con 0x55ecfaac1e80 2024-09-19T07:29:26.903 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.902+0000 7feaeb7fe640 1 -- 172.21.15.148:0/1076491456 <== mon.1 v2:172.21.15.179:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 8600+0+0 (secure 0 0 0) 0x7feb00044e30 con 0x55ecfaac1e80 2024-09-19T07:29:26.904 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.902+0000 7feaeb7fe640 1 -- 172.21.15.148:0/1076491456 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7feb000bd720 con 0x55ecfaac1e80 2024-09-19T07:29:26.905 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.905+0000 7feb11609740 10 client.26986 fetch_fsmap learned FSMap version 55 2024-09-19T07:29:26.905 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.905+0000 7feb11609740 1 -- 172.21.15.148:0/1076491456 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x55ecfa7fa620 con 0x55ecfaac1e80 2024-09-19T07:29:26.905 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.905+0000 7feaeb7fe640 1 -- 172.21.15.148:0/1076491456 <== mon.1 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feaf4004d30 con 0x55ecfaac1e80 2024-09-19T07:29:26.907 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.907+0000 7feaeb7fe640 1 -- 172.21.15.148:0/1076491456 <== mon.1 v2:172.21.15.179:3300/0 5 ==== fsmap(e 55) ==== 8370+0+0 (secure 0 0 0) 0x7feb000c5f00 con 0x55ecfaac1e80 2024-09-19T07:29:26.907 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.907+0000 7feb11609740 10 client.26986 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T07:29:26.907 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.907+0000 7feb11609740 10 client.26986 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:29:26.907 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.907+0000 7feb11609740 20 client.26986 populate_metadata read hostname 'smithi148' 2024-09-19T07:29:26.907 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.907+0000 7feb11609740 1 --2- 172.21.15.148:0/1076491456 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ecfaad2230 0x55ecfaad46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:26.907 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.907+0000 7feb11609740 4 client.26986 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:29:26.908 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.907+0000 7feb11609740 1 -- 172.21.15.148:0/1076491456 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ecfaa28a20 con 0x55ecfaad2230 2024-09-19T07:29:26.908 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.907+0000 7feb07fff640 1 --2- 172.21.15.148:0/1076491456 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ecfaad2230 0x55ecfaad46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:26.909 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.909+0000 7feb07fff640 1 --2- 172.21.15.148:0/1076491456 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ecfaad2230 0x55ecfaad46f0 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2e71f3adbccaab2 server_cookie=5b76248be4db98e2 in_seq=0 out_seq=0 2024-09-19T07:29:26.910 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.909+0000 7feaeb7fe640 10 client.26986 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:29:26.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.913+0000 7feaeb7fe640 1 -- 172.21.15.148:0/1076491456 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ecfaa28a20 con 0x55ecfaad2230 2024-09-19T07:29:26.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.914+0000 7feaeb7fe640 10 client.26986 handle_command_reply: tid=0 2024-09-19T07:29:26.915 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.915+0000 7feb11609740 1 client.26986 shutdown 2024-09-19T07:29:26.921 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.919+0000 7feb11609740 1 -- 172.21.15.148:0/1076491456 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ecfaac1e80 msgr2=0x55ecfaabf960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:26.921 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.919+0000 7feb11609740 1 --2- 172.21.15.148:0/1076491456 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ecfaac1e80 0x55ecfaabf960 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7feb000ba0f0 tx=0x7feb000bd080 comp rx=0 tx=0).stop 2024-09-19T07:29:26.922 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:29:26 smithi148 ceph-mon[31180]: pgmap v578: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 251 op/s 2024-09-19T07:29:26.923 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.922+0000 7feb11609740 1 -- 172.21.15.148:0/1076491456 shutdown_connections 2024-09-19T07:29:26.923 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.922+0000 7feb11609740 1 --2- 172.21.15.148:0/1076491456 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ecfaad2230 0x55ecfaad46f0 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:26.923 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.922+0000 7feb11609740 1 --2- 172.21.15.148:0/1076491456 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ecfaac1e80 0x55ecfaabf960 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:26.923 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.922+0000 7feb11609740 1 --2- 172.21.15.148:0/1076491456 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ecfaab75e0 0x55ecfaabf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:26.923 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.922+0000 7feb11609740 1 --2- 172.21.15.148:0/1076491456 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ecfaab6cc0 0x55ecfaabeee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:26.923 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.922+0000 7feb11609740 1 -- 172.21.15.148:0/1076491456 >> 172.21.15.148:0/1076491456 conn(0x55ecfaab3230 msgr2=0x55ecfaab8f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:26.923 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.922+0000 7feaeb7fe640 0 client.26986 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:29:26.928 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.927+0000 7feb11609740 1 -- 172.21.15.148:0/1076491456 shutdown_connections 2024-09-19T07:29:26.929 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.929+0000 7feb11609740 1 -- 172.21.15.148:0/1076491456 wait complete. 2024-09-19T07:29:26.929 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.929+0000 7feb11609740 20 client.26986 trim_cache size 0 max 16384 2024-09-19T07:29:26.960 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.959+0000 7feb11609740 1 Processor -- start 2024-09-19T07:29:26.960 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.960+0000 7feb11609740 1 -- start start 2024-09-19T07:29:26.961 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.960+0000 7feb11609740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ecfaab3230 0x55ecfaabf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:26.961 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.960+0000 7feb11609740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ecfaab6cc0 0x55ecfaad9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:26.961 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.960+0000 7feb11609740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ecfaab75e0 0x55ecfaada500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:26.961 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.960+0000 7feb11609740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7feb081c7660 con 0x55ecfaab3230 2024-09-19T07:29:26.961 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.960+0000 7feb11609740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7feb081c4e70 con 0x55ecfaab75e0 2024-09-19T07:29:26.961 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.960+0000 7feb11609740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7feb081c2d70 con 0x55ecfaab6cc0 2024-09-19T07:29:26.961 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.960+0000 7feb07fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ecfaab3230 0x55ecfaabf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:26.961 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.960+0000 7feb07fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ecfaab3230 0x55ecfaabf790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48204/0 (socket says 172.21.15.148:48204) 2024-09-19T07:29:26.961 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.960+0000 7feb07fff640 1 -- 172.21.15.148:0/347555595 learned_addr learned my addr 172.21.15.148:0/347555595 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:29:26.961 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.961+0000 7feb077fe640 1 --2- 172.21.15.148:0/347555595 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ecfaab6cc0 0x55ecfaad9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:26.962 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.961+0000 7feb0ce14640 1 --2- 172.21.15.148:0/347555595 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ecfaab75e0 0x55ecfaada500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:26.962 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.961+0000 7feb07fff640 1 -- 172.21.15.148:0/347555595 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ecfaab6cc0 msgr2=0x55ecfaad9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:26.963 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.961+0000 7feb07fff640 1 --2- 172.21.15.148:0/347555595 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ecfaab6cc0 0x55ecfaad9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:26.963 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.961+0000 7feb07fff640 1 -- 172.21.15.148:0/347555595 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ecfaab75e0 msgr2=0x55ecfaada500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:26.963 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.961+0000 7feb07fff640 1 --2- 172.21.15.148:0/347555595 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ecfaab75e0 0x55ecfaada500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:26.963 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.961+0000 7feb07fff640 1 -- 172.21.15.148:0/347555595 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecfaab70a0 con 0x55ecfaab3230 2024-09-19T07:29:26.963 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.961+0000 7feb0ce14640 1 --2- 172.21.15.148:0/347555595 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ecfaab75e0 0x55ecfaada500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:29:26.963 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.961+0000 7feb077fe640 1 --2- 172.21.15.148:0/347555595 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ecfaab6cc0 0x55ecfaad9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:29:26.963 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.961+0000 7feb07fff640 1 --2- 172.21.15.148:0/347555595 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ecfaab3230 0x55ecfaabf790 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7feaf800e5a0 tx=0x7feaf8011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a4de9ead93b3857 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:26.963 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.962+0000 7feafdffb640 1 -- 172.21.15.148:0/347555595 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf802e070 con 0x55ecfaab3230 2024-09-19T07:29:26.963 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.962+0000 7feafdffb640 1 -- 172.21.15.148:0/347555595 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feaf8013450 con 0x55ecfaab3230 2024-09-19T07:29:26.963 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.962+0000 7feafdffb640 1 -- 172.21.15.148:0/347555595 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf801b040 con 0x55ecfaab3230 2024-09-19T07:29:26.964 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.963+0000 7feb11609740 1 -- 172.21.15.148:0/347555595 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ecfaab3230 msgr2=0x55ecfaabf790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:26.964 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.963+0000 7feb11609740 1 --2- 172.21.15.148:0/347555595 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ecfaab3230 0x55ecfaabf790 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7feaf800e5a0 tx=0x7feaf8011000 comp rx=0 tx=0).stop 2024-09-19T07:29:26.964 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.963+0000 7feb11609740 1 -- 172.21.15.148:0/347555595 shutdown_connections 2024-09-19T07:29:26.965 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.963+0000 7feb11609740 1 --2- 172.21.15.148:0/347555595 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ecfaab75e0 0x55ecfaada500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:26.965 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.963+0000 7feb11609740 1 --2- 172.21.15.148:0/347555595 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ecfaab6cc0 0x55ecfaad9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:26.965 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.963+0000 7feb11609740 1 --2- 172.21.15.148:0/347555595 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ecfaab3230 0x55ecfaabf790 secure :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7feaf800e5a0 tx=0x7feaf8011000 comp rx=0 tx=0).stop 2024-09-19T07:29:26.965 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.963+0000 7feb11609740 1 -- 172.21.15.148:0/347555595 >> 172.21.15.148:0/347555595 conn(0x55ecfaab3cb0 msgr2=0x55ecfaab2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:26.965 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.964+0000 7feb11609740 1 -- 172.21.15.148:0/347555595 shutdown_connections 2024-09-19T07:29:26.965 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.965+0000 7feb11609740 1 -- 172.21.15.148:0/347555595 wait complete. 2024-09-19T07:29:26.966 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.966+0000 7feb11609740 1 -- start start 2024-09-19T07:29:26.967 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.966+0000 7feb11609740 1 Processor -- start 2024-09-19T07:29:26.967 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.967+0000 7feb11609740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ecfaab6cc0 0x55ecfaabc010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:26.968 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.967+0000 7feb11609740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ecfaab75e0 0x55ecfaabc550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:26.968 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.967+0000 7feb07fff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ecfaab6cc0 0x55ecfaabc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:26.968 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.967+0000 7feb07fff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ecfaab6cc0 0x55ecfaabc010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:35844/0 (socket says 172.21.15.148:35844) 2024-09-19T07:29:26.968 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.968+0000 7feb07fff640 1 -- 172.21.15.148:0/1636784061 learned_addr learned my addr 172.21.15.148:0/1636784061 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:29:26.968 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.968+0000 7feb077fe640 1 --2- 172.21.15.148:0/1636784061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ecfaab75e0 0x55ecfaabc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:26.969 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.968+0000 7feb11609740 1 --2- 172.21.15.148:0/1636784061 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ecfaac1e80 0x55ecfaabca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:26.969 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.968+0000 7feb11609740 1 -- 172.21.15.148:0/1636784061 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7feb081c3330 con 0x55ecfaac1e80 2024-09-19T07:29:26.969 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.968+0000 7feb11609740 1 -- 172.21.15.148:0/1636784061 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7feb081c47a0 con 0x55ecfaab6cc0 2024-09-19T07:29:26.969 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.968+0000 7feb11609740 1 -- 172.21.15.148:0/1636784061 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7feb081c3a00 con 0x55ecfaab75e0 2024-09-19T07:29:26.969 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.968+0000 7feb11609740 10 client.0 _ll_register_callbacks cb 0x7feb00031a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:29:26.969 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.969+0000 7feb07fff640 1 -- 172.21.15.148:0/1636784061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ecfaab75e0 msgr2=0x55ecfaabc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:26.969 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.969+0000 7feb07fff640 1 --2- 172.21.15.148:0/1636784061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ecfaab75e0 0x55ecfaabc550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:26.969 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.969+0000 7feb07fff640 1 -- 172.21.15.148:0/1636784061 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ecfaac1e80 msgr2=0x55ecfaabca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:26.970 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.969+0000 7feb07fff640 1 --2- 172.21.15.148:0/1636784061 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ecfaac1e80 0x55ecfaabca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:26.970 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.969+0000 7feb07fff640 1 -- 172.21.15.148:0/1636784061 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecfab3c190 con 0x55ecfaab6cc0 2024-09-19T07:29:26.971 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.971+0000 7feb07fff640 1 --2- 172.21.15.148:0/1636784061 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ecfaab6cc0 0x55ecfaabc010 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7feaf802c040 tx=0x7feaf8004840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55f34e8959866f02 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:26.972 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.971+0000 7feaeb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-19T07:29:26.973 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.972+0000 7feaeb7fe640 1 -- 172.21.15.148:0/1636784061 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf802e040 con 0x55ecfaab6cc0 2024-09-19T07:29:26.973 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.973+0000 7feaeb7fe640 1 -- 172.21.15.148:0/1636784061 <== mon.2 v2:172.21.15.165:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 8600+0+0 (secure 0 0 0) 0x7feaf8015b00 con 0x55ecfaab6cc0 2024-09-19T07:29:26.973 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.973+0000 7feb11609740 1 -- 172.21.15.148:0/1636784061 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feaf8013450 con 0x55ecfaab6cc0 2024-09-19T07:29:26.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.971+0000 7f517bb68640 1 -- 172.21.15.148:0/2899738833 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5174102570 msgr2=0x7f51741029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:26.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.971+0000 7f5178902640 1 -- 172.21.15.148:0/2899738833 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5170031600 con 0x7f5174102570 2024-09-19T07:29:26.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.971+0000 7f517bb68640 1 --2- 172.21.15.148:0/2899738833 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5174102570 0x7f51741029b0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f5170009900 tx=0x7f517002a4d0 comp rx=0 tx=0).stop 2024-09-19T07:29:26.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.971+0000 7f517bb68640 1 -- 172.21.15.148:0/2899738833 shutdown_connections 2024-09-19T07:29:26.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.971+0000 7f517bb68640 1 --2- 172.21.15.148:0/2899738833 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5174102ef0 0x7f5174069f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:26.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.971+0000 7f517bb68640 1 --2- 172.21.15.148:0/2899738833 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5174102570 0x7f51741029b0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:26.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.971+0000 7f517bb68640 1 --2- 172.21.15.148:0/2899738833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5174100e20 0x7f5174101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:26.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.971+0000 7f517bb68640 1 -- 172.21.15.148:0/2899738833 >> 172.21.15.148:0/2899738833 conn(0x7f51740fc7d0 msgr2=0x7f51740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:26.975 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.973+0000 7feaeb7fe640 1 -- 172.21.15.148:0/1636784061 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7feaf8015d00 con 0x55ecfaab6cc0 2024-09-19T07:29:26.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.972+0000 7f517bb68640 1 -- 172.21.15.148:0/2899738833 shutdown_connections 2024-09-19T07:29:26.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.972+0000 7f517bb68640 1 -- 172.21.15.148:0/2899738833 wait complete. 2024-09-19T07:29:26.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.972+0000 7f517bb68640 1 Processor -- start 2024-09-19T07:29:26.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.973+0000 7f517bb68640 1 -- start start 2024-09-19T07:29:26.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.973+0000 7f517bb68640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5174100e20 0x7f5174113910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:26.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.973+0000 7f517bb68640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5174102570 0x7f51741109c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:26.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.973+0000 7f517bb68640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5174102ef0 0x7f5174110f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:26.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.973+0000 7f517bb68640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f51741143f0 con 0x7f5174102570 2024-09-19T07:29:26.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.973+0000 7f517bb68640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5174114270 con 0x7f5174102ef0 2024-09-19T07:29:26.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.973+0000 7f517bb68640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5174114570 con 0x7f5174100e20 2024-09-19T07:29:26.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.973+0000 7f517a105640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5174102ef0 0x7f5174110f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:26.976 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.975+0000 7feb11609740 10 client.26879 fetch_fsmap learned FSMap version 55 2024-09-19T07:29:26.976 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.975+0000 7feb11609740 1 -- 172.21.15.148:0/1636784061 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x55ecfab3d440 con 0x55ecfaab6cc0 2024-09-19T07:29:26.977 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.976+0000 7feaeb7fe640 1 -- 172.21.15.148:0/1636784061 <== mon.2 v2:172.21.15.165:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feaf8032440 con 0x55ecfaab6cc0 2024-09-19T07:29:26.977 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.976+0000 7feaeb7fe640 1 -- 172.21.15.148:0/1636784061 <== mon.2 v2:172.21.15.165:3300/0 5 ==== fsmap(e 55) ==== 8370+0+0 (secure 0 0 0) 0x7feaf8028070 con 0x55ecfaab6cc0 2024-09-19T07:29:26.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.973+0000 7f517a105640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5174102ef0 0x7f5174110f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:35858/0 (socket says 172.21.15.148:35858) 2024-09-19T07:29:26.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.973+0000 7f517a105640 1 -- 172.21.15.148:0/1935263725 learned_addr learned my addr 172.21.15.148:0/1935263725 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:29:26.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.974+0000 7f517a105640 1 -- 172.21.15.148:0/1935263725 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5174100e20 msgr2=0x7f5174113910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:26.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.974+0000 7f517a105640 1 --2- 172.21.15.148:0/1935263725 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5174100e20 0x7f5174113910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:26.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.974+0000 7f517a105640 1 -- 172.21.15.148:0/1935263725 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5174102570 msgr2=0x7f51741109c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:26.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.974+0000 7f517a105640 1 --2- 172.21.15.148:0/1935263725 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5174102570 0x7f51741109c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:26.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.974+0000 7f517a105640 1 -- 172.21.15.148:0/1935263725 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5174111740 con 0x7f5174102ef0 2024-09-19T07:29:26.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.975+0000 7f517a105640 1 --2- 172.21.15.148:0/1935263725 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5174102ef0 0x7f5174110f00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f516c00b970 tx=0x7f516c00be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:26.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.975+0000 7f5166ffd640 1 -- 172.21.15.148:0/1935263725 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f516c019070 con 0x7f5174102ef0 2024-09-19T07:29:26.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.975+0000 7f517bb68640 1 -- 172.21.15.148:0/1935263725 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51741a0900 con 0x7f5174102ef0 2024-09-19T07:29:26.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.975+0000 7f5166ffd640 1 -- 172.21.15.148:0/1935263725 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f516c00cb40 con 0x7f5174102ef0 2024-09-19T07:29:26.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.975+0000 7f5166ffd640 1 -- 172.21.15.148:0/1935263725 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f516c0076e0 con 0x7f5174102ef0 2024-09-19T07:29:26.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.975+0000 7f517bb68640 1 -- 172.21.15.148:0/1935263725 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51741a0ec0 con 0x7f5174102ef0 2024-09-19T07:29:26.979 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.977+0000 7feb11609740 10 client.26879 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T07:29:26.979 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.977+0000 7feb11609740 10 client.26879 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:29:26.979 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.977+0000 7feb11609740 20 client.26879 populate_metadata read hostname 'smithi148' 2024-09-19T07:29:26.980 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.977+0000 7feb11609740 1 --2- 172.21.15.148:0/1636784061 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ecfab3da00 0x55ecfab3fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:26.980 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.977+0000 7feb11609740 4 client.26879 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:29:26.980 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.977+0000 7feb11609740 1 -- 172.21.15.148:0/1636784061 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7feaf8013450 con 0x55ecfab3da00 2024-09-19T07:29:26.980 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.979+0000 7feb077fe640 1 --2- 172.21.15.148:0/1636784061 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ecfab3da00 0x55ecfab3fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:26.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.979+0000 7f517df41740 1 Processor -- start 2024-09-19T07:29:26.983 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.981+0000 7feb077fe640 1 --2- 172.21.15.148:0/1636784061 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ecfab3da00 0x55ecfab3fe20 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1bce605724f4fdf8 server_cookie=4e523e30b99a2274 in_seq=0 out_seq=0 2024-09-19T07:29:26.983 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:26.981+0000 7feaeb7fe640 10 client.26879 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:29:26.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.982+0000 7f517df41740 1 -- start start 2024-09-19T07:29:26.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.982+0000 7f517df41740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55770656a760 0x55770656ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:26.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.982+0000 7f517df41740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55770656b080 0x557706575400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:26.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.982+0000 7f517df41740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557706575940 0x557706577d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:26.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.982+0000 7f517df41740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5577064d02a0 con 0x55770656a760 2024-09-19T07:29:26.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.982+0000 7f517df41740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x557706477b10 con 0x55770656b080 2024-09-19T07:29:26.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.982+0000 7f517df41740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5577064cc260 con 0x557706575940 2024-09-19T07:29:26.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.983+0000 7f5166ffd640 1 -- 172.21.15.148:0/1935263725 <== mon.2 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f516c01c070 con 0x7f5174102ef0 2024-09-19T07:29:26.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.983+0000 7f5179103640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55770656a760 0x55770656ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:26.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.983+0000 7f5179103640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55770656a760 0x55770656ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48254/0 (socket says 172.21.15.148:48254) 2024-09-19T07:29:26.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.983+0000 7f5179103640 1 -- 172.21.15.148:0/2599516020 learned_addr learned my addr 172.21.15.148:0/2599516020 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:29:26.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.984+0000 7f5166ffd640 1 --2- 172.21.15.148:0/1935263725 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f51600a34f0 0x7f51600a59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:26.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.985+0000 7f5179904640 1 --2- 172.21.15.148:0/2599516020 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55770656b080 0x557706575400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:26.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.985+0000 7f5166ffd640 1 -- 172.21.15.148:0/1935263725 <== mon.2 v2:172.21.15.165:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8600+0+0 (secure 0 0 0) 0x7f516c0cf190 con 0x7f5174102ef0 2024-09-19T07:29:26.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.986+0000 7f517a105640 1 --2- 172.21.15.148:0/1935263725 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f51600a34f0 0x7f51600a59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:26.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.987+0000 7f5179103640 1 --2- 172.21.15.148:0/2599516020 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557706575940 0x557706577d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:26.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.987+0000 7f5179904640 1 -- 172.21.15.148:0/2599516020 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557706575940 msgr2=0x557706577d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:26.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.987+0000 7f5179904640 1 --2- 172.21.15.148:0/2599516020 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557706575940 0x557706577d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:26.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.987+0000 7f5179904640 1 -- 172.21.15.148:0/2599516020 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55770656a760 msgr2=0x55770656ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:26.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.987+0000 7f5179904640 1 --2- 172.21.15.148:0/2599516020 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55770656a760 0x55770656ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:26.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.987+0000 7f517a105640 1 --2- 172.21.15.148:0/1935263725 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f51600a34f0 0x7f51600a59b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f516c00bfd0 tx=0x7f516c097040 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:26.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.987+0000 7f5179904640 1 -- 172.21.15.148:0/2599516020 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557706241b90 con 0x55770656b080 2024-09-19T07:29:26.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.988+0000 7f5179904640 1 --2- 172.21.15.148:0/2599516020 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55770656b080 0x557706575400 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5168009720 tx=0x7f5168009be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1aaee99738186951 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:26.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.990+0000 7f515ffff640 1 -- 172.21.15.148:0/2599516020 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5168015020 con 0x55770656b080 2024-09-19T07:29:26.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.990+0000 7f515ffff640 1 -- 172.21.15.148:0/2599516020 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5168009e30 con 0x55770656b080 2024-09-19T07:29:26.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.990+0000 7f515ffff640 1 -- 172.21.15.148:0/2599516020 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51680105e0 con 0x55770656b080 2024-09-19T07:29:26.991 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.991+0000 7f517df41740 1 -- 172.21.15.148:0/2599516020 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55770656b080 msgr2=0x557706575400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:26.992 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.991+0000 7f517df41740 1 --2- 172.21.15.148:0/2599516020 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55770656b080 0x557706575400 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5168009720 tx=0x7f5168009be0 comp rx=0 tx=0).stop 2024-09-19T07:29:26.992 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.991+0000 7f517df41740 1 -- 172.21.15.148:0/2599516020 shutdown_connections 2024-09-19T07:29:26.992 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.991+0000 7f517df41740 1 --2- 172.21.15.148:0/2599516020 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557706575940 0x557706577d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:26.992 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.991+0000 7f517df41740 1 --2- 172.21.15.148:0/2599516020 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55770656b080 0x557706575400 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:26.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.991+0000 7f517df41740 1 --2- 172.21.15.148:0/2599516020 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55770656a760 0x55770656ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:26.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.991+0000 7f517df41740 1 -- 172.21.15.148:0/2599516020 >> 172.21.15.148:0/2599516020 conn(0x557706566cf0 msgr2=0x5577065670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:26.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.991+0000 7f517df41740 1 -- 172.21.15.148:0/2599516020 shutdown_connections 2024-09-19T07:29:26.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.992+0000 7f517df41740 1 -- 172.21.15.148:0/2599516020 wait complete. 2024-09-19T07:29:26.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.992+0000 7f517df41740 1 -- start start 2024-09-19T07:29:26.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.992+0000 7f517df41740 1 Processor -- start 2024-09-19T07:29:26.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.993+0000 7f517df41740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55770656a760 0x5577065727a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:26.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.993+0000 7f517df41740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55770656b080 0x557706572ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:26.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.993+0000 7f517df41740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557706575940 0x557706573220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:26.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.993+0000 7f517df41740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x557706578510 con 0x557706575940 2024-09-19T07:29:26.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.993+0000 7f517df41740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5577064586e0 con 0x55770656b080 2024-09-19T07:29:26.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.993+0000 7f517df41740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x557706578690 con 0x55770656a760 2024-09-19T07:29:26.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.993+0000 7f517df41740 10 client.0 _ll_register_callbacks cb 0x55770647ca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:29:26.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.994+0000 7f5179103640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557706575940 0x557706573220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:26.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.994+0000 7f5179103640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557706575940 0x557706573220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48270/0 (socket says 172.21.15.148:48270) 2024-09-19T07:29:26.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.994+0000 7f5179103640 1 -- 172.21.15.148:0/3385367264 learned_addr learned my addr 172.21.15.148:0/3385367264 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:29:26.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.994+0000 7f5179103640 1 --2- 172.21.15.148:0/3385367264 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55770656a760 0x5577065727a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:26.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.994+0000 7f5179904640 1 --2- 172.21.15.148:0/3385367264 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55770656b080 0x557706572ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:26.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.994+0000 7f5179103640 1 -- 172.21.15.148:0/3385367264 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55770656b080 msgr2=0x557706572ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:26.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.994+0000 7f5179103640 1 --2- 172.21.15.148:0/3385367264 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55770656b080 0x557706572ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:26.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.994+0000 7f5179103640 1 -- 172.21.15.148:0/3385367264 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557706575940 msgr2=0x557706573220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:26.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.994+0000 7f5179103640 1 --2- 172.21.15.148:0/3385367264 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557706575940 0x557706573220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:26.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.994+0000 7f5179103640 1 -- 172.21.15.148:0/3385367264 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557706581a10 con 0x55770656a760 2024-09-19T07:29:26.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.995+0000 7f5179904640 1 --2- 172.21.15.148:0/3385367264 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55770656b080 0x557706572ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:29:26.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.995+0000 7f5179103640 1 --2- 172.21.15.148:0/3385367264 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55770656a760 0x5577065727a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5170005090 tx=0x7f5170005bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21f92af8d3043b7a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:26.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.995+0000 7f515d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-19T07:29:26.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.995+0000 7f515d7fa640 1 -- 172.21.15.148:0/3385367264 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5170005500 con 0x55770656a760 2024-09-19T07:29:26.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.996+0000 7f517df41740 1 -- 172.21.15.148:0/3385367264 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5168009e30 con 0x55770656a760 2024-09-19T07:29:26.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.996+0000 7f515d7fa640 1 -- 172.21.15.148:0/3385367264 <== mon.1 v2:172.21.15.179:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 8600+0+0 (secure 0 0 0) 0x7f5170004030 con 0x55770656a760 2024-09-19T07:29:26.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.996+0000 7f515d7fa640 1 -- 172.21.15.148:0/3385367264 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f5170051050 con 0x55770656a760 2024-09-19T07:29:26.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.996+0000 7f517df41740 10 client.26998 fetch_fsmap learned FSMap version 55 2024-09-19T07:29:26.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.996+0000 7f517df41740 1 -- 172.21.15.148:0/3385367264 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x557706584420 con 0x55770656a760 2024-09-19T07:29:26.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.996+0000 7f515d7fa640 1 -- 172.21.15.148:0/3385367264 <== mon.1 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5168009e30 con 0x55770656a760 2024-09-19T07:29:26.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.997+0000 7f515d7fa640 1 -- 172.21.15.148:0/3385367264 <== mon.1 v2:172.21.15.179:3300/0 5 ==== fsmap(e 55) ==== 8370+0+0 (secure 0 0 0) 0x7f5170054020 con 0x55770656a760 2024-09-19T07:29:26.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.997+0000 7f517df41740 10 client.26998 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T07:29:26.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.997+0000 7f517df41740 10 client.26998 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:29:26.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.997+0000 7f517df41740 20 client.26998 populate_metadata read hostname 'smithi148' 2024-09-19T07:29:26.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.997+0000 7f517df41740 1 --2- 172.21.15.148:0/3385367264 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5577065859f0 0x557706587e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:26.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.997+0000 7f517df41740 4 client.26998 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:29:26.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.997+0000 7f517df41740 1 -- 172.21.15.148:0/3385367264 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5577064dd9d0 con 0x5577065859f0 2024-09-19T07:29:26.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.997+0000 7f5179904640 1 --2- 172.21.15.148:0/3385367264 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5577065859f0 0x557706587e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:26.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.998+0000 7f515d7fa640 10 client.26998 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:29:26.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.998+0000 7f5179904640 1 --2- 172.21.15.148:0/3385367264 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5577065859f0 0x557706587e60 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33079b23249678c2 server_cookie=4a4df1d45d48f7be in_seq=0 out_seq=0 2024-09-19T07:29:26.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.999+0000 7f515d7fa640 1 -- 172.21.15.148:0/3385367264 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5577064dd9d0 con 0x5577065859f0 2024-09-19T07:29:26.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.999+0000 7f515d7fa640 10 client.26998 handle_command_reply: tid=0 2024-09-19T07:29:26.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.999+0000 7f517df41740 1 client.26998 shutdown 2024-09-19T07:29:27.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.999+0000 7f517df41740 1 -- 172.21.15.148:0/3385367264 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55770656a760 msgr2=0x5577065727a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:27.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.999+0000 7f517df41740 1 --2- 172.21.15.148:0/3385367264 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55770656a760 0x5577065727a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5170005090 tx=0x7f5170005bb0 comp rx=0 tx=0).stop 2024-09-19T07:29:27.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.999+0000 7f517df41740 1 -- 172.21.15.148:0/3385367264 shutdown_connections 2024-09-19T07:29:27.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.999+0000 7f517df41740 1 --2- 172.21.15.148:0/3385367264 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5577065859f0 0x557706587e60 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:27.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.000+0000 7f515d7fa640 0 client.26998 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:29:27.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:26.999+0000 7f517df41740 1 --2- 172.21.15.148:0/3385367264 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557706575940 0x557706573220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:27.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.000+0000 7f517df41740 1 --2- 172.21.15.148:0/3385367264 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55770656b080 0x557706572ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:27.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.000+0000 7f517df41740 1 --2- 172.21.15.148:0/3385367264 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55770656a760 0x5577065727a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:27.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.000+0000 7f517df41740 1 -- 172.21.15.148:0/3385367264 >> 172.21.15.148:0/3385367264 conn(0x557706566cf0 msgr2=0x557706565e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:27.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.000+0000 7f517df41740 1 -- 172.21.15.148:0/3385367264 shutdown_connections 2024-09-19T07:29:27.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.000+0000 7f517df41740 1 -- 172.21.15.148:0/3385367264 wait complete. 2024-09-19T07:29:27.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.000+0000 7f517df41740 20 client.26998 trim_cache size 0 max 16384 2024-09-19T07:29:27.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:29:26 smithi179 ceph-mon[35716]: pgmap v578: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 251 op/s 2024-09-19T07:29:27.035 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.034+0000 7f517df41740 1 Processor -- start 2024-09-19T07:29:27.035 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.034+0000 7f517df41740 1 -- start start 2024-09-19T07:29:27.035 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.034+0000 7f517df41740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55770656a760 0x55770656d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:27.035 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.035+0000 7f517df41740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55770656b080 0x557706565d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:27.035 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.035+0000 7f517df41740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557706575940 0x55770658d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:27.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.035+0000 7f5179103640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55770656a760 0x55770656d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:27.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.035+0000 7f5179103640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55770656a760 0x55770656d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:35894/0 (socket says 172.21.15.148:35894) 2024-09-19T07:29:27.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.035+0000 7f5179103640 1 -- 172.21.15.148:0/4142835857 learned_addr learned my addr 172.21.15.148:0/4142835857 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:29:27.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.035+0000 7f517df41740 1 -- 172.21.15.148:0/4142835857 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f51580111c0 con 0x557706575940 2024-09-19T07:29:27.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.035+0000 7f517df41740 1 -- 172.21.15.148:0/4142835857 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f515800e9d0 con 0x55770656a760 2024-09-19T07:29:27.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.035+0000 7f517df41740 1 -- 172.21.15.148:0/4142835857 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f515800c840 con 0x55770656b080 2024-09-19T07:29:27.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.036+0000 7f5179904640 1 --2- 172.21.15.148:0/4142835857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55770656b080 0x557706565d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:27.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.037+0000 7f5179904640 1 -- 172.21.15.148:0/4142835857 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55770656a760 msgr2=0x55770656d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:27.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.037+0000 7f5179904640 1 --2- 172.21.15.148:0/4142835857 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55770656a760 0x55770656d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:27.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.037+0000 7f5179904640 1 -- 172.21.15.148:0/4142835857 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557706575940 msgr2=0x55770658d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:27.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.037+0000 7f5179904640 1 --2- 172.21.15.148:0/4142835857 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557706575940 0x55770658d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:27.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.037+0000 7f5179904640 1 -- 172.21.15.148:0/4142835857 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55770656e390 con 0x55770656b080 2024-09-19T07:29:27.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.038+0000 7f5179103640 1 --2- 172.21.15.148:0/4142835857 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55770656a760 0x55770656d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:29:27.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.039+0000 7f5179904640 1 --2- 172.21.15.148:0/4142835857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55770656b080 0x557706565d60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x557706572030 tx=0x7f5168008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7d89d84dd3c15c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:27.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.041+0000 7f515f7fe640 1 -- 172.21.15.148:0/4142835857 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5168015040 con 0x55770656b080 2024-09-19T07:29:27.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.041+0000 7f515f7fe640 1 -- 172.21.15.148:0/4142835857 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5168009e30 con 0x55770656b080 2024-09-19T07:29:27.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.042+0000 7f517df41740 1 -- 172.21.15.148:0/4142835857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55770656b080 msgr2=0x557706565d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:27.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.042+0000 7f517df41740 1 --2- 172.21.15.148:0/4142835857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55770656b080 0x557706565d60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x557706572030 tx=0x7f5168008040 comp rx=0 tx=0).stop 2024-09-19T07:29:27.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.044+0000 7f517df41740 1 -- 172.21.15.148:0/4142835857 shutdown_connections 2024-09-19T07:29:27.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.044+0000 7f517df41740 1 --2- 172.21.15.148:0/4142835857 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557706575940 0x55770658d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:27.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.044+0000 7f517df41740 1 --2- 172.21.15.148:0/4142835857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55770656b080 0x557706565d60 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:27.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.044+0000 7f517df41740 1 --2- 172.21.15.148:0/4142835857 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55770656a760 0x55770656d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:27.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.044+0000 7f517df41740 1 -- 172.21.15.148:0/4142835857 >> 172.21.15.148:0/4142835857 conn(0x557706566cf0 msgr2=0x557706565650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:27.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.047+0000 7f517df41740 1 -- 172.21.15.148:0/4142835857 shutdown_connections 2024-09-19T07:29:27.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.047+0000 7f517df41740 1 -- 172.21.15.148:0/4142835857 wait complete. 2024-09-19T07:29:27.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.048+0000 7f517df41740 1 -- start start 2024-09-19T07:29:27.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.048+0000 7f517df41740 1 Processor -- start 2024-09-19T07:29:27.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.048+0000 7f517df41740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55770656a760 0x55770657ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:27.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.048+0000 7f517df41740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557706575940 0x55770657a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:27.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.048+0000 7f517df41740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5577065859f0 0x55770657a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:27.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.048+0000 7f517df41740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f515800ce90 con 0x5577065859f0 2024-09-19T07:29:27.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.048+0000 7f517df41740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f515800e300 con 0x55770656a760 2024-09-19T07:29:27.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.048+0000 7f517df41740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f515800d560 con 0x557706575940 2024-09-19T07:29:27.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.049+0000 7f517df41740 10 client.0 _ll_register_callbacks cb 0x7f5170030660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:29:27.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.049+0000 7f5179904640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557706575940 0x55770657a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:27.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.049+0000 7f5179904640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557706575940 0x55770657a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:45094/0 (socket says 172.21.15.148:45094) 2024-09-19T07:29:27.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.049+0000 7f5179904640 1 -- 172.21.15.148:0/564370813 learned_addr learned my addr 172.21.15.148:0/564370813 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:29:27.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.049+0000 7f5179103640 1 --2- 172.21.15.148:0/564370813 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55770656a760 0x55770657ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:27.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.049+0000 7f5179103640 1 --2- 172.21.15.148:0/564370813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5577065859f0 0x55770657a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:27.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.049+0000 7f5179904640 1 -- 172.21.15.148:0/564370813 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55770656a760 msgr2=0x55770657ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:27.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.049+0000 7f5179904640 1 --2- 172.21.15.148:0/564370813 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55770656a760 0x55770657ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:27.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.049+0000 7f5179904640 1 -- 172.21.15.148:0/564370813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5577065859f0 msgr2=0x55770657a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:27.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.049+0000 7f5179904640 1 --2- 172.21.15.148:0/564370813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5577065859f0 0x55770657a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:27.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.049+0000 7f5179904640 1 -- 172.21.15.148:0/564370813 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55770657ab20 con 0x557706575940 2024-09-19T07:29:27.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.050+0000 7f5179904640 1 --2- 172.21.15.148:0/564370813 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557706575940 0x55770657a0a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5168013010 tx=0x7f5168000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=936264b073f9cf3e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:27.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.050+0000 7f515d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-19T07:29:27.054 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.053+0000 7f515d7fa640 1 -- 172.21.15.148:0/564370813 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5168015040 con 0x557706575940 2024-09-19T07:29:27.054 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.053+0000 7f515d7fa640 1 -- 172.21.15.148:0/564370813 <== mon.1 v2:172.21.15.179:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 8600+0+0 (secure 0 0 0) 0x7f516800b950 con 0x557706575940 2024-09-19T07:29:27.054 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.054+0000 7f517df41740 1 -- 172.21.15.148:0/564370813 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5168009e30 con 0x557706575940 2024-09-19T07:29:27.054 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.054+0000 7f515d7fa640 1 -- 172.21.15.148:0/564370813 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f516803b050 con 0x557706575940 2024-09-19T07:29:27.055 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.054+0000 7f517df41740 10 client.27004 fetch_fsmap learned FSMap version 55 2024-09-19T07:29:27.055 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.054+0000 7f517df41740 1 -- 172.21.15.148:0/564370813 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x5577065f1350 con 0x557706575940 2024-09-19T07:29:27.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.054+0000 7f515d7fa640 1 -- 172.21.15.148:0/564370813 <== mon.1 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5168009e30 con 0x557706575940 2024-09-19T07:29:27.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.055+0000 7f515d7fa640 1 -- 172.21.15.148:0/564370813 <== mon.1 v2:172.21.15.179:3300/0 5 ==== fsmap(e 55) ==== 8370+0+0 (secure 0 0 0) 0x7f5168036030 con 0x557706575940 2024-09-19T07:29:27.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.055+0000 7f517df41740 10 client.27004 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T07:29:27.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.055+0000 7f517df41740 10 client.27004 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:29:27.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.055+0000 7f517df41740 20 client.27004 populate_metadata read hostname 'smithi148' 2024-09-19T07:29:27.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.055+0000 7f517df41740 1 --2- 172.21.15.148:0/564370813 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5577065f1ae0 0x5577065f3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:27.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.055+0000 7f517df41740 4 client.27004 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 137.1, "await_for": 45.0}] 2024-09-19T07:29:27.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.055+0000 7f517df41740 1 -- 172.21.15.148:0/564370813 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 137.1, "await_for": 45.0}) -- 0x5577064d7d20 con 0x5577065f1ae0 2024-09-19T07:29:27.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.055+0000 7f5179103640 1 --2- 172.21.15.148:0/564370813 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5577065f1ae0 0x5577065f3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:27.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.058+0000 7f5179103640 1 --2- 172.21.15.148:0/564370813 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5577065f1ae0 0x5577065f3f00 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7eb5015f40080e52 server_cookie=5f19e941bfdb9b3a in_seq=0 out_seq=0 2024-09-19T07:29:27.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.058+0000 7f515d7fa640 10 client.27004 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:29:27.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:29:26 smithi165 ceph-mon[35326]: pgmap v578: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 251 op/s 2024-09-19T07:29:27.285 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:27.284+0000 7feaeb7fe640 1 -- 172.21.15.148:0/1636784061 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7feaf8013450 con 0x55ecfab3da00 2024-09-19T07:29:27.285 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:27.284+0000 7feaeb7fe640 10 client.26879 handle_command_reply: tid=0 2024-09-19T07:29:27.285 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:27.284+0000 7feb11609740 1 client.26879 shutdown 2024-09-19T07:29:27.285 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:27.284+0000 7feb11609740 1 -- 172.21.15.148:0/1636784061 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ecfaab6cc0 msgr2=0x55ecfaabc010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:27.285 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:27.284+0000 7feb11609740 1 --2- 172.21.15.148:0/1636784061 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ecfaab6cc0 0x55ecfaabc010 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7feaf802c040 tx=0x7feaf8004840 comp rx=0 tx=0).stop 2024-09-19T07:29:27.286 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:27.284+0000 7feb11609740 1 -- 172.21.15.148:0/1636784061 shutdown_connections 2024-09-19T07:29:27.286 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:27.284+0000 7feb11609740 1 --2- 172.21.15.148:0/1636784061 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55ecfab3da00 0x55ecfab3fe20 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:27.286 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:27.284+0000 7feb11609740 1 --2- 172.21.15.148:0/1636784061 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ecfaac1e80 0x55ecfaabca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:27.286 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:27.284+0000 7feb11609740 1 --2- 172.21.15.148:0/1636784061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ecfaab75e0 0x55ecfaabc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:27.286 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:27.284+0000 7feaeb7fe640 0 client.26879 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:29:27.286 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:27.284+0000 7feb11609740 1 --2- 172.21.15.148:0/1636784061 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ecfaab6cc0 0x55ecfaabc010 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:27.286 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:27.284+0000 7feb11609740 1 -- 172.21.15.148:0/1636784061 >> 172.21.15.148:0/1636784061 conn(0x55ecfaab3cb0 msgr2=0x55ecfaab8770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:27.286 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:27.284+0000 7feb11609740 1 -- 172.21.15.148:0/1636784061 shutdown_connections 2024-09-19T07:29:27.286 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:27.284+0000 7feb11609740 1 -- 172.21.15.148:0/1636784061 wait complete. 2024-09-19T07:29:27.286 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:27.285+0000 7feb11609740 20 client.26879 trim_cache size 0 max 16384 2024-09-19T07:29:27.287 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:29:27.287 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:29:27.287 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:29:27.287 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:29:27.287 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:27.285+0000 7feb0d615640 1 -- 172.21.15.148:0/685610858 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7feaec0a35c0 msgr2=0x7feaec0a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:27.285+0000 7feb0d615640 1 --2- 172.21.15.148:0/685610858 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7feaec0a35c0 0x7feaec0a5a80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x55ecfaab4090 tx=0x7feaf8009110 comp rx=0 tx=0).stop 2024-09-19T07:29:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:27.285+0000 7feb0d615640 1 -- 172.21.15.148:0/685610858 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb0811b140 msgr2=0x7feb08111d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:27.285+0000 7feb0d615640 1 --2- 172.21.15.148:0/685610858 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb0811b140 0x7feb08111d40 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7feb000097b0 tx=0x7feb00031480 comp rx=0 tx=0).stop 2024-09-19T07:29:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:27.285+0000 7feb0d615640 1 -- 172.21.15.148:0/685610858 shutdown_connections 2024-09-19T07:29:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:27.285+0000 7feb0d615640 1 --2- 172.21.15.148:0/685610858 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7feaec0a35c0 0x7feaec0a5a80 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:27.285+0000 7feb0d615640 1 --2- 172.21.15.148:0/685610858 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb0811b140 0x7feb08111d40 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:27.285+0000 7feb0d615640 1 --2- 172.21.15.148:0/685610858 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb081095d0 0x7feb08111800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:27.285+0000 7feb0d615640 1 --2- 172.21.15.148:0/685610858 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb081091f0 0x7feb08118780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:27.285+0000 7feb0d615640 1 -- 172.21.15.148:0/685610858 >> 172.21.15.148:0/685610858 conn(0x7feb0806cbf0 msgr2=0x7feb0811b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:27.285+0000 7feb0d615640 1 -- 172.21.15.148:0/685610858 shutdown_connections 2024-09-19T07:29:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:27.285+0000 7feb0d615640 1 -- 172.21.15.148:0/685610858 wait complete. 2024-09-19T07:29:27.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.977+0000 7f515d7fa640 1 -- 172.21.15.148:0/564370813 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5577064d7d20 con 0x5577065f1ae0 2024-09-19T07:29:27.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.977+0000 7f515d7fa640 10 client.27004 handle_command_reply: tid=0 2024-09-19T07:29:27.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.977+0000 7f517df41740 1 client.27004 shutdown 2024-09-19T07:29:27.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.977+0000 7f517df41740 1 -- 172.21.15.148:0/564370813 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557706575940 msgr2=0x55770657a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:27.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.977+0000 7f517df41740 1 --2- 172.21.15.148:0/564370813 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557706575940 0x55770657a0a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5168013010 tx=0x7f5168000bc0 comp rx=0 tx=0).stop 2024-09-19T07:29:27.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.977+0000 7f517df41740 1 -- 172.21.15.148:0/564370813 shutdown_connections 2024-09-19T07:29:27.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.977+0000 7f517df41740 1 --2- 172.21.15.148:0/564370813 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x5577065f1ae0 0x5577065f3f00 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:27.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.977+0000 7f517df41740 1 --2- 172.21.15.148:0/564370813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5577065859f0 0x55770657a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:27.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.977+0000 7f517df41740 1 --2- 172.21.15.148:0/564370813 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557706575940 0x55770657a0a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:27.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.977+0000 7f517df41740 1 --2- 172.21.15.148:0/564370813 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55770656a760 0x55770657ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:27.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.977+0000 7f517df41740 1 -- 172.21.15.148:0/564370813 >> 172.21.15.148:0/564370813 conn(0x557706566cf0 msgr2=0x557706581010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:27.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.977+0000 7f515d7fa640 0 client.27004 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:29:27.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.977+0000 7f517df41740 1 -- 172.21.15.148:0/564370813 shutdown_connections 2024-09-19T07:29:27.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.977+0000 7f517df41740 1 -- 172.21.15.148:0/564370813 wait complete. 2024-09-19T07:29:27.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.978+0000 7f517df41740 20 client.27004 trim_cache size 0 max 16384 2024-09-19T07:29:27.979 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:29:27.979 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 55, 2024-09-19T07:29:27.980 INFO:teuthology.orchestra.run.smithi148.stdout: "leader": 24457, 2024-09-19T07:29:27.980 INFO:teuthology.orchestra.run.smithi148.stdout: "set_version": 58, 2024-09-19T07:29:27.980 INFO:teuthology.orchestra.run.smithi148.stdout: "sets": { 2024-09-19T07:29:27.980 INFO:teuthology.orchestra.run.smithi148.stdout: "f7e07a68": { 2024-09-19T07:29:27.980 INFO:teuthology.orchestra.run.smithi148.stdout: "version": 58, 2024-09-19T07:29:27.980 INFO:teuthology.orchestra.run.smithi148.stdout: "age_ref": 0.0, 2024-09-19T07:29:27.980 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:29:27.980 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "QUIESCED", 2024-09-19T07:29:27.980 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:29:27.980 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:29:27.980 INFO:teuthology.orchestra.run.smithi148.stdout: "timeout": 90.0, 2024-09-19T07:29:27.980 INFO:teuthology.orchestra.run.smithi148.stdout: "expiration": 137.1, 2024-09-19T07:29:27.980 INFO:teuthology.orchestra.run.smithi148.stdout: "members": { 2024-09-19T07:29:27.981 INFO:teuthology.orchestra.run.smithi148.stdout: "file:/": { 2024-09-19T07:29:27.981 INFO:teuthology.orchestra.run.smithi148.stdout: "excluded": false, 2024-09-19T07:29:27.981 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:29:27.981 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "QUIESCED", 2024-09-19T07:29:27.981 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:29:27.981 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:29:27.981 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:29:27.981 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:29:27.981 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:29:27.981 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:29:27.981 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:29:27.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.978+0000 7f517bb68640 1 -- 172.21.15.148:0/1935263725 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f51600a34f0 msgr2=0x7f51600a59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:27.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.978+0000 7f517bb68640 1 --2- 172.21.15.148:0/1935263725 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f51600a34f0 0x7f51600a59b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f516c00bfd0 tx=0x7f516c097040 comp rx=0 tx=0).stop 2024-09-19T07:29:27.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.978+0000 7f517bb68640 1 -- 172.21.15.148:0/1935263725 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5174102ef0 msgr2=0x7f5174110f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:27.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.978+0000 7f517bb68640 1 --2- 172.21.15.148:0/1935263725 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5174102ef0 0x7f5174110f00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f516c00b970 tx=0x7f516c00be30 comp rx=0 tx=0).stop 2024-09-19T07:29:27.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.978+0000 7f517bb68640 1 -- 172.21.15.148:0/1935263725 shutdown_connections 2024-09-19T07:29:27.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.978+0000 7f517bb68640 1 --2- 172.21.15.148:0/1935263725 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f51600a34f0 0x7f51600a59b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:27.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.978+0000 7f517bb68640 1 --2- 172.21.15.148:0/1935263725 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5174102ef0 0x7f5174110f00 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:27.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.978+0000 7f517bb68640 1 --2- 172.21.15.148:0/1935263725 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5174102570 0x7f51741109c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:27.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.978+0000 7f517bb68640 1 --2- 172.21.15.148:0/1935263725 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5174100e20 0x7f5174113910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:27.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.978+0000 7f517bb68640 1 -- 172.21.15.148:0/1935263725 >> 172.21.15.148:0/1935263725 conn(0x7f51740fc7d0 msgr2=0x7f5174103b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:27.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.978+0000 7f517bb68640 1 -- 172.21.15.148:0/1935263725 shutdown_connections 2024-09-19T07:29:27.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:27.978+0000 7f517bb68640 1 -- 172.21.15.148:0/1935263725 wait complete. 2024-09-19T07:29:28.721 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'f7e07a68', quiesce took 6.3 seconds. Will release after: 10.8 2024-09-19T07:29:29.024 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:29:28 smithi179 ceph-mon[35716]: pgmap v579: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 168 op/s 2024-09-19T07:29:29.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:29:28 smithi148 ceph-mon[31180]: pgmap v579: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 168 op/s 2024-09-19T07:29:29.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:29:28 smithi165 ceph-mon[35326]: pgmap v579: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 168 op/s 2024-09-19T07:29:31.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:29:30 smithi179 ceph-mon[35716]: pgmap v580: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 177 op/s 2024-09-19T07:29:31.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:29:30 smithi148 ceph-mon[31180]: pgmap v580: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 177 op/s 2024-09-19T07:29:31.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:29:30 smithi165 ceph-mon[35326]: pgmap v580: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 177 op/s 2024-09-19T07:29:33.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:29:32 smithi179 ceph-mon[35716]: pgmap v581: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 210 op/s 2024-09-19T07:29:33.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:29:32 smithi148 ceph-mon[31180]: pgmap v581: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 210 op/s 2024-09-19T07:29:33.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:29:32 smithi165 ceph-mon[35326]: pgmap v581: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 210 op/s 2024-09-19T07:29:35.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:29:34 smithi179 ceph-mon[35716]: pgmap v582: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 141 op/s 2024-09-19T07:29:35.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:29:34 smithi148 ceph-mon[31180]: pgmap v582: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 141 op/s 2024-09-19T07:29:35.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:29:34 smithi165 ceph-mon[35326]: pgmap v582: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 141 op/s 2024-09-19T07:29:37.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:29:36 smithi179 ceph-mon[35716]: pgmap v583: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 141 op/s 2024-09-19T07:29:37.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:29:36 smithi148 ceph-mon[31180]: pgmap v583: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 141 op/s 2024-09-19T07:29:37.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:29:36 smithi165 ceph-mon[35326]: pgmap v583: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 141 op/s 2024-09-19T07:29:39.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:29:38 smithi179 ceph-mon[35716]: pgmap v584: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 551 KiB/s wr, 86 op/s 2024-09-19T07:29:39.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:29:38 smithi148 ceph-mon[31180]: pgmap v584: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 551 KiB/s wr, 86 op/s 2024-09-19T07:29:39.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:29:38 smithi165 ceph-mon[35326]: pgmap v584: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 2.0 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 551 KiB/s wr, 86 op/s 2024-09-19T07:29:39.521 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:29:39.960 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:29:40.439 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.437+0000 7f6d138a6640 1 -- 172.21.15.148:0/4233758551 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6d0c1091f0 msgr2=0x7f6d0c1095d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:40.440 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.437+0000 7f6d138a6640 1 --2- 172.21.15.148:0/4233758551 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6d0c1091f0 0x7f6d0c1095d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6d04009cd0 tx=0x7f6d0402a930 comp rx=0 tx=0).stop 2024-09-19T07:29:40.440 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.437+0000 7f6d138a6640 1 -- 172.21.15.148:0/4233758551 shutdown_connections 2024-09-19T07:29:40.440 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.437+0000 7f6d138a6640 1 --2- 172.21.15.148:0/4233758551 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6d0c10e780 0x7f6d0c10ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:40.440 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.437+0000 7f6d138a6640 1 --2- 172.21.15.148:0/4233758551 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d0c109b10 0x7f6d0c10e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:40.440 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.437+0000 7f6d138a6640 1 --2- 172.21.15.148:0/4233758551 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6d0c1091f0 0x7f6d0c1095d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:40.440 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.437+0000 7f6d138a6640 1 -- 172.21.15.148:0/4233758551 >> 172.21.15.148:0/4233758551 conn(0x7f6d0c06ce00 msgr2=0x7f6d0c06d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:40.440 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.437+0000 7f6d138a6640 1 -- 172.21.15.148:0/4233758551 shutdown_connections 2024-09-19T07:29:40.446 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.440+0000 7f6d138a6640 1 -- 172.21.15.148:0/4233758551 wait complete. 2024-09-19T07:29:40.446 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.441+0000 7f6d138a6640 1 Processor -- start 2024-09-19T07:29:40.446 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.441+0000 7f6d138a6640 1 -- start start 2024-09-19T07:29:40.446 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.441+0000 7f6d138a6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6d0c1091f0 0x7f6d0c1abe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:40.446 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.441+0000 7f6d138a6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d0c109b10 0x7f6d0c1ac360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:40.446 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.441+0000 7f6d138a6640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6d0c10e780 0x7f6d0c1a7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:40.446 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.441+0000 7f6d138a6640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0c113ef0 con 0x7f6d0c1091f0 2024-09-19T07:29:40.446 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.441+0000 7f6d138a6640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0c113d70 con 0x7f6d0c10e780 2024-09-19T07:29:40.446 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.441+0000 7f6d138a6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0c114070 con 0x7f6d0c109b10 2024-09-19T07:29:40.446 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.441+0000 7f6d11642640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6d0c1091f0 0x7f6d0c1abe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:40.447 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.442+0000 7f6d11e43640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6d0c10e780 0x7f6d0c1a7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:40.447 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.442+0000 7f6d11e43640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6d0c10e780 0x7f6d0c1a7490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:46210/0 (socket says 172.21.15.148:46210) 2024-09-19T07:29:40.447 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.442+0000 7f6d11e43640 1 -- 172.21.15.148:0/4199081300 learned_addr learned my addr 172.21.15.148:0/4199081300 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:29:40.447 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.442+0000 7f6d10e41640 1 --2- 172.21.15.148:0/4199081300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d0c109b10 0x7f6d0c1ac360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:40.447 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.442+0000 7f6d11e43640 1 -- 172.21.15.148:0/4199081300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d0c109b10 msgr2=0x7f6d0c1ac360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:40.447 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.442+0000 7f6d11e43640 1 --2- 172.21.15.148:0/4199081300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d0c109b10 0x7f6d0c1ac360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:40.447 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.442+0000 7f6d11e43640 1 -- 172.21.15.148:0/4199081300 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6d0c1091f0 msgr2=0x7f6d0c1abe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:40.447 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.442+0000 7f6d11e43640 1 --2- 172.21.15.148:0/4199081300 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6d0c1091f0 0x7f6d0c1abe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:40.447 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.442+0000 7f6d11e43640 1 -- 172.21.15.148:0/4199081300 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d0c1a7cc0 con 0x7f6d0c10e780 2024-09-19T07:29:40.447 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.442+0000 7f6d10e41640 1 --2- 172.21.15.148:0/4199081300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d0c109b10 0x7f6d0c1ac360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:29:40.447 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.442+0000 7f6d11e43640 1 --2- 172.21.15.148:0/4199081300 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6d0c10e780 0x7f6d0c1a7490 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6d08009fd0 tx=0x7f6d0800b8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:40.447 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.443+0000 7f6d027fc640 1 -- 172.21.15.148:0/4199081300 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d08011830 con 0x7f6d0c10e780 2024-09-19T07:29:40.448 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.444+0000 7f6d138a6640 1 -- 172.21.15.148:0/4199081300 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d0c1a7fb0 con 0x7f6d0c10e780 2024-09-19T07:29:40.448 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.444+0000 7f6d027fc640 1 -- 172.21.15.148:0/4199081300 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d08016070 con 0x7f6d0c10e780 2024-09-19T07:29:40.451 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.445+0000 7f6d027fc640 1 -- 172.21.15.148:0/4199081300 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d0800f2e0 con 0x7f6d0c10e780 2024-09-19T07:29:40.451 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.448+0000 7f6d138a6640 1 -- 172.21.15.148:0/4199081300 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d0c07a630 con 0x7f6d0c10e780 2024-09-19T07:29:40.452 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.451+0000 7f6d027fc640 1 -- 172.21.15.148:0/4199081300 <== mon.2 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f6d08010380 con 0x7f6d0c10e780 2024-09-19T07:29:40.455 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.454+0000 7f6d1663c740 1 Processor -- start 2024-09-19T07:29:40.455 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.454+0000 7f6d1663c740 1 -- start start 2024-09-19T07:29:40.456 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.455+0000 7f6d1663c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d5bc78af0 0x557d5bc78ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:40.456 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.455+0000 7f6d1663c740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d5bc79410 0x557d5bc83770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:40.457 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.455+0000 7f6d1663c740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557d5bc83cb0 0x557d5bc860a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:40.457 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.455+0000 7f6d1663c740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x557d5bbdd2f0 con 0x557d5bc79410 2024-09-19T07:29:40.457 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.455+0000 7f6d1663c740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x557d5bb85270 con 0x557d5bc83cb0 2024-09-19T07:29:40.457 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.455+0000 7f6d1663c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x557d5bbd92b0 con 0x557d5bc78af0 2024-09-19T07:29:40.457 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.456+0000 7f6d027fc640 1 --2- 172.21.15.148:0/4199081300 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f6cf80a3450 0x7f6cf80a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:40.458 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.457+0000 7f6d11e43640 1 --2- 172.21.15.148:0/4199081300 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f6cf80a3450 0x7f6cf80a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:40.458 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.457+0000 7f6d027fc640 1 -- 172.21.15.148:0/4199081300 <== mon.2 v2:172.21.15.165:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8600+0+0 (secure 0 0 0) 0x7f6d080d2170 con 0x7f6d0c10e780 2024-09-19T07:29:40.460 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.458+0000 7f6d10e41640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d5bc78af0 0x557d5bc78ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:40.460 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.458+0000 7f6d10e41640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d5bc78af0 0x557d5bc78ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:34336/0 (socket says 172.21.15.148:34336) 2024-09-19T07:29:40.460 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.458+0000 7f6d10e41640 1 -- 172.21.15.148:0/157094253 learned_addr learned my addr 172.21.15.148:0/157094253 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:29:40.460 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.458+0000 7f6d10e41640 1 --2- 172.21.15.148:0/157094253 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557d5bc83cb0 0x557d5bc860a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:40.461 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.458+0000 7f6d11642640 1 --2- 172.21.15.148:0/157094253 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d5bc79410 0x557d5bc83770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:40.461 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.459+0000 7f6d10e41640 1 -- 172.21.15.148:0/157094253 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557d5bc83cb0 msgr2=0x557d5bc860a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:40.461 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.459+0000 7f6d10e41640 1 --2- 172.21.15.148:0/157094253 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557d5bc83cb0 0x557d5bc860a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:40.461 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.459+0000 7f6d10e41640 1 -- 172.21.15.148:0/157094253 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d5bc79410 msgr2=0x557d5bc83770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:40.461 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.459+0000 7f6d10e41640 1 --2- 172.21.15.148:0/157094253 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d5bc79410 0x557d5bc83770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:40.461 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.459+0000 7f6d10e41640 1 -- 172.21.15.148:0/157094253 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d5bb84340 con 0x557d5bc78af0 2024-09-19T07:29:40.462 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.459+0000 7f6d10e41640 1 --2- 172.21.15.148:0/157094253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d5bc78af0 0x557d5bc78ed0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc013860 tx=0x7f6cfc00b400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0571f62ee41f0a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:40.462 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.459+0000 7f6d11e43640 1 --2- 172.21.15.148:0/4199081300 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f6cf80a3450 0x7f6cf80a5910 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c1a7c10 tx=0x7f6d080bb040 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:40.462 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.460+0000 7f6cf77fe640 1 -- 172.21.15.148:0/157094253 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc00e8f0 con 0x557d5bc78af0 2024-09-19T07:29:40.462 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.460+0000 7f6cf77fe640 1 -- 172.21.15.148:0/157094253 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cfc01e430 con 0x557d5bc78af0 2024-09-19T07:29:40.462 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.461+0000 7f6d1663c740 1 -- 172.21.15.148:0/157094253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d5bc78af0 msgr2=0x557d5bc78ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:40.463 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.461+0000 7f6d1663c740 1 --2- 172.21.15.148:0/157094253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d5bc78af0 0x557d5bc78ed0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc013860 tx=0x7f6cfc00b400 comp rx=0 tx=0).stop 2024-09-19T07:29:40.463 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.462+0000 7f6d1663c740 1 -- 172.21.15.148:0/157094253 shutdown_connections 2024-09-19T07:29:40.463 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.462+0000 7f6d1663c740 1 --2- 172.21.15.148:0/157094253 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557d5bc83cb0 0x557d5bc860a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:40.463 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.462+0000 7f6d1663c740 1 --2- 172.21.15.148:0/157094253 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d5bc79410 0x557d5bc83770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:40.463 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.462+0000 7f6d1663c740 1 --2- 172.21.15.148:0/157094253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d5bc78af0 0x557d5bc78ed0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:40.463 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.462+0000 7f6d1663c740 1 -- 172.21.15.148:0/157094253 >> 172.21.15.148:0/157094253 conn(0x557d5bc75060 msgr2=0x557d5bc75440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:40.464 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.463+0000 7f6d1663c740 1 -- 172.21.15.148:0/157094253 shutdown_connections 2024-09-19T07:29:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.463+0000 7f6d1663c740 1 -- 172.21.15.148:0/157094253 wait complete. 2024-09-19T07:29:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.463+0000 7f6d1663c740 1 -- start start 2024-09-19T07:29:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.464+0000 7f6d1663c740 1 Processor -- start 2024-09-19T07:29:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.464+0000 7f6d1663c740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557d5bc78af0 0x557d5bc80ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.464+0000 7f6d1663c740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d5bc79410 0x557d5bc81010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.464+0000 7f6d1663c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d5bc83cb0 0x557d5bc81550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.464+0000 7f6d1663c740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x557d5bc868d0 con 0x557d5bc79410 2024-09-19T07:29:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.464+0000 7f6d1663c740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x557d5bb66290 con 0x557d5bc78af0 2024-09-19T07:29:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.464+0000 7f6d1663c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x557d5bc86a50 con 0x557d5bc83cb0 2024-09-19T07:29:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.464+0000 7f6d1663c740 10 client.0 _ll_register_callbacks cb 0x557d5bb97140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:29:40.467 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.465+0000 7f6d10e41640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557d5bc78af0 0x557d5bc80ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:40.467 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.465+0000 7f6d10e41640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557d5bc78af0 0x557d5bc80ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:46238/0 (socket says 172.21.15.148:46238) 2024-09-19T07:29:40.467 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.465+0000 7f6d10e41640 1 -- 172.21.15.148:0/208305586 learned_addr learned my addr 172.21.15.148:0/208305586 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:29:40.467 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.465+0000 7f6d11642640 1 --2- 172.21.15.148:0/208305586 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d5bc79410 0x557d5bc81010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:40.467 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.465+0000 7f6d10e41640 1 --2- 172.21.15.148:0/208305586 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d5bc83cb0 0x557d5bc81550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:40.468 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.466+0000 7f6d10e41640 1 -- 172.21.15.148:0/208305586 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557d5bc78af0 msgr2=0x557d5bc80ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:40.468 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.466+0000 7f6d10e41640 1 --2- 172.21.15.148:0/208305586 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557d5bc78af0 0x557d5bc80ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:40.468 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.466+0000 7f6d10e41640 1 -- 172.21.15.148:0/208305586 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d5bc79410 msgr2=0x557d5bc81010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:40.468 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.466+0000 7f6d10e41640 1 --2- 172.21.15.148:0/208305586 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d5bc79410 0x557d5bc81010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:40.468 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.466+0000 7f6d10e41640 1 -- 172.21.15.148:0/208305586 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d5b8f0210 con 0x557d5bc83cb0 2024-09-19T07:29:40.468 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.466+0000 7f6d10e41640 1 --2- 172.21.15.148:0/208305586 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d5bc83cb0 0x557d5bc81550 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc0134b0 tx=0x7f6cfc005850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b45abe3891977e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:40.468 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.466+0000 7f6cf4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-19T07:29:40.472 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.471+0000 7f6cf4ff9640 1 -- 172.21.15.148:0/208305586 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc01e9f0 con 0x557d5bc83cb0 2024-09-19T07:29:40.472 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.471+0000 7f6d1663c740 1 -- 172.21.15.148:0/208305586 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6cfc01e430 con 0x557d5bc83cb0 2024-09-19T07:29:40.472 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.471+0000 7f6cf4ff9640 1 -- 172.21.15.148:0/208305586 <== mon.1 v2:172.21.15.179:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 8600+0+0 (secure 0 0 0) 0x7f6cfc004020 con 0x557d5bc83cb0 2024-09-19T07:29:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.472+0000 7f6cf4ff9640 1 -- 172.21.15.148:0/208305586 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f6cfc01eb90 con 0x557d5bc83cb0 2024-09-19T07:29:40.475 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.474+0000 7f6d1663c740 10 client.27013 fetch_fsmap learned FSMap version 55 2024-09-19T07:29:40.475 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.474+0000 7f6d1663c740 1 -- 172.21.15.148:0/208305586 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x557d5b9bc620 con 0x557d5bc83cb0 2024-09-19T07:29:40.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.476+0000 7f6cf4ff9640 1 -- 172.21.15.148:0/208305586 <== mon.1 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cfc01e430 con 0x557d5bc83cb0 2024-09-19T07:29:40.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.476+0000 7f6cf4ff9640 1 -- 172.21.15.148:0/208305586 <== mon.1 v2:172.21.15.179:3300/0 5 ==== fsmap(e 55) ==== 8370+0+0 (secure 0 0 0) 0x7f6cfc00f040 con 0x557d5bc83cb0 2024-09-19T07:29:40.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.478+0000 7f6d1663c740 10 client.27013 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T07:29:40.479 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.478+0000 7f6d1663c740 10 client.27013 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:29:40.480 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.478+0000 7f6d1663c740 20 client.27013 populate_metadata read hostname 'smithi148' 2024-09-19T07:29:40.480 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.478+0000 7f6d1663c740 1 --2- 172.21.15.148:0/208305586 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x557d5bc93b60 0x557d5bc95f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:40.480 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.478+0000 7f6d1663c740 4 client.27013 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:29:40.480 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.478+0000 7f6d1663c740 1 -- 172.21.15.148:0/208305586 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d5bbeaa20 con 0x557d5bc93b60 2024-09-19T07:29:40.480 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.478+0000 7f6d11642640 1 --2- 172.21.15.148:0/208305586 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x557d5bc93b60 0x557d5bc95f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:40.481 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.479+0000 7f6d11642640 1 --2- 172.21.15.148:0/208305586 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x557d5bc93b60 0x557d5bc95f50 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84fbef9f5c73f4e9 server_cookie=46c838ca6af1593d in_seq=0 out_seq=0 2024-09-19T07:29:40.482 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.480+0000 7f6cf4ff9640 10 client.27013 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:29:40.482 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.480+0000 7f6cf4ff9640 1 -- 172.21.15.148:0/208305586 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557d5bbeaa20 con 0x557d5bc93b60 2024-09-19T07:29:40.482 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.480+0000 7f6cf4ff9640 10 client.27013 handle_command_reply: tid=0 2024-09-19T07:29:40.482 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.481+0000 7f6d1663c740 1 client.27013 shutdown 2024-09-19T07:29:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.484+0000 7f6d1663c740 1 -- 172.21.15.148:0/208305586 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d5bc83cb0 msgr2=0x557d5bc81550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.484+0000 7f6d1663c740 1 --2- 172.21.15.148:0/208305586 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d5bc83cb0 0x557d5bc81550 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc0134b0 tx=0x7f6cfc005850 comp rx=0 tx=0).stop 2024-09-19T07:29:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.484+0000 7f6d1663c740 1 -- 172.21.15.148:0/208305586 shutdown_connections 2024-09-19T07:29:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.484+0000 7f6d1663c740 1 --2- 172.21.15.148:0/208305586 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x557d5bc93b60 0x557d5bc95f50 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:40.486 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.484+0000 7f6d1663c740 1 --2- 172.21.15.148:0/208305586 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d5bc83cb0 0x557d5bc81550 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:40.486 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.484+0000 7f6d1663c740 1 --2- 172.21.15.148:0/208305586 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d5bc79410 0x557d5bc81010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:40.486 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.484+0000 7f6d1663c740 1 --2- 172.21.15.148:0/208305586 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557d5bc78af0 0x557d5bc80ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:40.486 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.484+0000 7f6d1663c740 1 -- 172.21.15.148:0/208305586 >> 172.21.15.148:0/208305586 conn(0x557d5bc75060 msgr2=0x557d5bc7adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:40.486 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.485+0000 7f6cf4ff9640 0 client.27013 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:29:40.489 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.487+0000 7f6d1663c740 1 -- 172.21.15.148:0/208305586 shutdown_connections 2024-09-19T07:29:40.490 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.489+0000 7f6d1663c740 1 -- 172.21.15.148:0/208305586 wait complete. 2024-09-19T07:29:40.492 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.491+0000 7f6d1663c740 20 client.27013 trim_cache size 0 max 16384 2024-09-19T07:29:40.528 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.527+0000 7f6d1663c740 1 Processor -- start 2024-09-19T07:29:40.528 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.527+0000 7f6d1663c740 1 -- start start 2024-09-19T07:29:40.528 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.527+0000 7f6d1663c740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557d5bc78af0 0x557d5bc81380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:40.528 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.527+0000 7f6d1663c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d5bc79410 0x557d5bc98b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:40.529 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.527+0000 7f6d1663c740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d5bc83cb0 0x557d5bc990d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:40.529 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.527+0000 7f6d1663c740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0c1d0020 con 0x557d5bc83cb0 2024-09-19T07:29:40.529 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.527+0000 7f6d1663c740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0c082f40 con 0x557d5bc78af0 2024-09-19T07:29:40.529 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.527+0000 7f6d1663c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0c080db0 con 0x557d5bc79410 2024-09-19T07:29:40.530 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.529+0000 7f6d11642640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d5bc79410 0x557d5bc98b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:40.530 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.529+0000 7f6d11642640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d5bc79410 0x557d5bc98b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:34348/0 (socket says 172.21.15.148:34348) 2024-09-19T07:29:40.530 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.529+0000 7f6d11642640 1 -- 172.21.15.148:0/1340260233 learned_addr learned my addr 172.21.15.148:0/1340260233 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:29:40.530 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.529+0000 7f6d10e41640 1 --2- 172.21.15.148:0/1340260233 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d5bc83cb0 0x557d5bc990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:40.533 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.532+0000 7f6d11642640 1 -- 172.21.15.148:0/1340260233 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557d5bc78af0 msgr2=0x557d5bc81380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:40.533 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.532+0000 7f6d11642640 1 --2- 172.21.15.148:0/1340260233 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557d5bc78af0 0x557d5bc81380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:40.533 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.532+0000 7f6d11642640 1 -- 172.21.15.148:0/1340260233 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d5bc83cb0 msgr2=0x557d5bc990d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:40.533 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.532+0000 7f6d11642640 1 --2- 172.21.15.148:0/1340260233 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d5bc83cb0 0x557d5bc990d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:40.533 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.532+0000 7f6d11642640 1 -- 172.21.15.148:0/1340260233 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d5bc74e90 con 0x557d5bc79410 2024-09-19T07:29:40.534 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.533+0000 7f6d11642640 1 --2- 172.21.15.148:0/1340260233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d5bc79410 0x557d5bc98b90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6d04009cd0 tx=0x7f6d0402b070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efd0d374ae95854d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:40.536 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.535+0000 7f6cf6ffd640 1 -- 172.21.15.148:0/1340260233 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d04031480 con 0x557d5bc79410 2024-09-19T07:29:40.536 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.535+0000 7f6cf6ffd640 1 -- 172.21.15.148:0/1340260233 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d04036040 con 0x557d5bc79410 2024-09-19T07:29:40.536 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.535+0000 7f6cf6ffd640 1 -- 172.21.15.148:0/1340260233 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d0402fdd0 con 0x557d5bc79410 2024-09-19T07:29:40.538 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.536+0000 7f6d1663c740 1 -- 172.21.15.148:0/1340260233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d5bc79410 msgr2=0x557d5bc98b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:40.538 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.536+0000 7f6d1663c740 1 --2- 172.21.15.148:0/1340260233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d5bc79410 0x557d5bc98b90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6d04009cd0 tx=0x7f6d0402b070 comp rx=0 tx=0).stop 2024-09-19T07:29:40.538 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.537+0000 7f6d1663c740 1 -- 172.21.15.148:0/1340260233 shutdown_connections 2024-09-19T07:29:40.538 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.537+0000 7f6d1663c740 1 --2- 172.21.15.148:0/1340260233 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d5bc83cb0 0x557d5bc990d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:40.538 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.537+0000 7f6d1663c740 1 --2- 172.21.15.148:0/1340260233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d5bc79410 0x557d5bc98b90 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:40.538 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.537+0000 7f6d1663c740 1 --2- 172.21.15.148:0/1340260233 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557d5bc78af0 0x557d5bc81380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:40.538 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.537+0000 7f6d1663c740 1 -- 172.21.15.148:0/1340260233 >> 172.21.15.148:0/1340260233 conn(0x557d5bc75060 msgr2=0x557d5bc82b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:40.545 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.544+0000 7f6d1663c740 1 -- 172.21.15.148:0/1340260233 shutdown_connections 2024-09-19T07:29:40.546 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.544+0000 7f6d1663c740 1 -- 172.21.15.148:0/1340260233 wait complete. 2024-09-19T07:29:40.546 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.544+0000 7f6d1663c740 1 -- start start 2024-09-19T07:29:40.546 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.544+0000 7f6d1663c740 1 Processor -- start 2024-09-19T07:29:40.546 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.545+0000 7f6d1663c740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d5bc78af0 0x557d5bc98bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:40.547 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.545+0000 7f6d1663c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d5bc79410 0x557d5bc99110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:40.547 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.545+0000 7f6d1663c740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557d5bc83cb0 0x557d5bc961d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:40.547 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.545+0000 7f6d1663c740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0c081400 con 0x557d5bc78af0 2024-09-19T07:29:40.547 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.545+0000 7f6d1663c740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0c082870 con 0x557d5bc83cb0 2024-09-19T07:29:40.547 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.545+0000 7f6d1663c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0c081ad0 con 0x557d5bc79410 2024-09-19T07:29:40.547 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.545+0000 7f6d1663c740 10 client.0 _ll_register_callbacks cb 0x7f6cfc00be40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:29:40.547 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.545+0000 7f6d11642640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d5bc79410 0x557d5bc99110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:40.547 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.545+0000 7f6d11642640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d5bc79410 0x557d5bc99110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:34354/0 (socket says 172.21.15.148:34354) 2024-09-19T07:29:40.547 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.545+0000 7f6d11642640 1 -- 172.21.15.148:0/1390545852 learned_addr learned my addr 172.21.15.148:0/1390545852 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:29:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.547+0000 7f6d10e41640 1 --2- 172.21.15.148:0/1390545852 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557d5bc83cb0 0x557d5bc961d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.547+0000 7f6d10e41640 1 --2- 172.21.15.148:0/1390545852 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d5bc78af0 0x557d5bc98bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.548+0000 7f6d11642640 1 -- 172.21.15.148:0/1390545852 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557d5bc83cb0 msgr2=0x557d5bc961d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.548+0000 7f6d11642640 1 --2- 172.21.15.148:0/1390545852 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557d5bc83cb0 0x557d5bc961d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.548+0000 7f6d11642640 1 -- 172.21.15.148:0/1390545852 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d5bc78af0 msgr2=0x557d5bc98bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.548+0000 7f6d11642640 1 --2- 172.21.15.148:0/1390545852 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d5bc78af0 0x557d5bc98bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.548+0000 7f6d11642640 1 -- 172.21.15.148:0/1390545852 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d5bc968c0 con 0x557d5bc79410 2024-09-19T07:29:40.550 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.548+0000 7f6d11642640 1 --2- 172.21.15.148:0/1390545852 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d5bc79410 0x557d5bc99110 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6d0402a970 tx=0x7f6d0402f4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f099a13c29ee1846 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:40.550 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.548+0000 7f6cf4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-19T07:29:40.550 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.548+0000 7f6cf4ff9640 1 -- 172.21.15.148:0/1390545852 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d0402f690 con 0x557d5bc79410 2024-09-19T07:29:40.551 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.548+0000 7f6cf4ff9640 1 -- 172.21.15.148:0/1390545852 <== mon.1 v2:172.21.15.179:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 8600+0+0 (secure 0 0 0) 0x7f6d0402f830 con 0x557d5bc79410 2024-09-19T07:29:40.551 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.549+0000 7f6d1663c740 1 -- 172.21.15.148:0/1390545852 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d04036040 con 0x557d5bc79410 2024-09-19T07:29:40.551 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.549+0000 7f6cf4ff9640 1 -- 172.21.15.148:0/1390545852 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f6d0402fa70 con 0x557d5bc79410 2024-09-19T07:29:40.551 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.550+0000 7f6d1663c740 10 client.27019 fetch_fsmap learned FSMap version 55 2024-09-19T07:29:40.551 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.550+0000 7f6d1663c740 1 -- 172.21.15.148:0/1390545852 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x557d5bcfdfb0 con 0x557d5bc79410 2024-09-19T07:29:40.553 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.552+0000 7f6cf4ff9640 1 -- 172.21.15.148:0/1390545852 <== mon.1 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d04036040 con 0x557d5bc79410 2024-09-19T07:29:40.553 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.552+0000 7f6cf4ff9640 1 -- 172.21.15.148:0/1390545852 <== mon.1 v2:172.21.15.179:3300/0 5 ==== fsmap(e 55) ==== 8370+0+0 (secure 0 0 0) 0x7f6d0405a030 con 0x557d5bc79410 2024-09-19T07:29:40.554 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.553+0000 7f6d1663c740 10 client.27019 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T07:29:40.554 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.553+0000 7f6d1663c740 10 client.27019 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:29:40.555 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.553+0000 7f6d1663c740 20 client.27019 populate_metadata read hostname 'smithi148' 2024-09-19T07:29:40.555 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.553+0000 7f6d1663c740 1 --2- 172.21.15.148:0/1390545852 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x557d5bcfe680 0x557d5bd00aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:40.555 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.553+0000 7f6d1663c740 4 client.27019 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:29:40.555 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.553+0000 7f6d1663c740 1 -- 172.21.15.148:0/1390545852 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557d5bbe4d70 con 0x557d5bcfe680 2024-09-19T07:29:40.555 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.554+0000 7f6d10e41640 1 --2- 172.21.15.148:0/1390545852 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x557d5bcfe680 0x557d5bd00aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:40.556 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.555+0000 7f6d10e41640 1 --2- 172.21.15.148:0/1390545852 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x557d5bcfe680 0x557d5bd00aa0 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2234797ebd8f263 server_cookie=58cc7c824ed5f28 in_seq=0 out_seq=0 2024-09-19T07:29:40.556 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.555+0000 7f6cf4ff9640 10 client.27019 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:29:40.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.567+0000 7f13b72ae640 1 -- 172.21.15.148:0/3459360446 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13b011b140 msgr2=0x7f13b011d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:40.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.567+0000 7f13b72ae640 1 --2- 172.21.15.148:0/3459360446 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13b011b140 0x7f13b011d530 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f13a8009860 tx=0x7f13a802a360 comp rx=0 tx=0).stop 2024-09-19T07:29:40.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.568+0000 7f13b72ae640 1 -- 172.21.15.148:0/3459360446 shutdown_connections 2024-09-19T07:29:40.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.568+0000 7f13b72ae640 1 --2- 172.21.15.148:0/3459360446 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13b011b140 0x7f13b011d530 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:40.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.568+0000 7f13b72ae640 1 --2- 172.21.15.148:0/3459360446 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13b0109830 0x7f13b0109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:40.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.568+0000 7f13b72ae640 1 --2- 172.21.15.148:0/3459360446 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13b0109450 0x7f13b0110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:40.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.568+0000 7f13b72ae640 1 -- 172.21.15.148:0/3459360446 >> 172.21.15.148:0/3459360446 conn(0x7f13b006e140 msgr2=0x7f13b006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:40.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.568+0000 7f13b72ae640 1 -- 172.21.15.148:0/3459360446 shutdown_connections 2024-09-19T07:29:40.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.568+0000 7f13b72ae640 1 -- 172.21.15.148:0/3459360446 wait complete. 2024-09-19T07:29:40.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.569+0000 7f13b72ae640 1 Processor -- start 2024-09-19T07:29:40.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.569+0000 7f13b72ae640 1 -- start start 2024-09-19T07:29:40.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.569+0000 7f13b72ae640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13b0109450 0x7f13b011a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:40.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.569+0000 7f13b72ae640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13b0109830 0x7f13b0116780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:40.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.569+0000 7f13b72ae640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13b011b140 0x7f13b0116cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:40.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.569+0000 7f13b72ae640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f13b01132b0 con 0x7f13b011b140 2024-09-19T07:29:40.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.569+0000 7f13b72ae640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f13b0113130 con 0x7f13b0109830 2024-09-19T07:29:40.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.569+0000 7f13b72ae640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f13b0113430 con 0x7f13b0109450 2024-09-19T07:29:40.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.570+0000 7f13b4849640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13b0109830 0x7f13b0116780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:40.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.570+0000 7f13b4849640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13b0109830 0x7f13b0116780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:46266/0 (socket says 172.21.15.148:46266) 2024-09-19T07:29:40.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.570+0000 7f13b4849640 1 -- 172.21.15.148:0/3745112858 learned_addr learned my addr 172.21.15.148:0/3745112858 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:29:40.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.570+0000 7f13b504a640 1 --2- 172.21.15.148:0/3745112858 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13b0109450 0x7f13b011a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:40.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.570+0000 7f13b584b640 1 --2- 172.21.15.148:0/3745112858 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13b011b140 0x7f13b0116cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:40.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.570+0000 7f13b504a640 1 -- 172.21.15.148:0/3745112858 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13b0109830 msgr2=0x7f13b0116780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:40.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.570+0000 7f13b504a640 1 --2- 172.21.15.148:0/3745112858 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13b0109830 0x7f13b0116780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:40.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.570+0000 7f13b504a640 1 -- 172.21.15.148:0/3745112858 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13b011b140 msgr2=0x7f13b0116cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:40.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.570+0000 7f13b504a640 1 --2- 172.21.15.148:0/3745112858 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13b011b140 0x7f13b0116cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:40.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.570+0000 7f13b504a640 1 -- 172.21.15.148:0/3745112858 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13b0117200 con 0x7f13b0109450 2024-09-19T07:29:40.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.571+0000 7f13b504a640 1 --2- 172.21.15.148:0/3745112858 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13b0109450 0x7f13b011a6e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f13a000eb00 tx=0x7f13a000c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:40.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.574+0000 7f13ae7fc640 1 -- 172.21.15.148:0/3745112858 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a0010430 con 0x7f13b0109450 2024-09-19T07:29:40.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.574+0000 7f13ae7fc640 1 -- 172.21.15.148:0/3745112858 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13a0010ab0 con 0x7f13b0109450 2024-09-19T07:29:40.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.574+0000 7f13b72ae640 1 -- 172.21.15.148:0/3745112858 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13b01174f0 con 0x7f13b0109450 2024-09-19T07:29:40.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.574+0000 7f13b72ae640 1 -- 172.21.15.148:0/3745112858 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13b01ab450 con 0x7f13b0109450 2024-09-19T07:29:40.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.574+0000 7f13ae7fc640 1 -- 172.21.15.148:0/3745112858 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a0017bd0 con 0x7f13b0109450 2024-09-19T07:29:40.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.576+0000 7f13b72ae640 1 -- 172.21.15.148:0/3745112858 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f139c0052c0 con 0x7f13b0109450 2024-09-19T07:29:40.584 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.581+0000 7f13ae7fc640 1 -- 172.21.15.148:0/3745112858 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f13a0010c60 con 0x7f13b0109450 2024-09-19T07:29:40.584 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.582+0000 7f13ae7fc640 1 --2- 172.21.15.148:0/3745112858 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f13980a3580 0x7f13980a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:40.584 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.582+0000 7f13ae7fc640 1 -- 172.21.15.148:0/3745112858 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8600+0+0 (secure 0 0 0) 0x7f13a00d0860 con 0x7f13b0109450 2024-09-19T07:29:40.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.583+0000 7f13b4849640 1 --2- 172.21.15.148:0/3745112858 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f13980a3580 0x7f13980a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:40.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.584+0000 7f13b4849640 1 --2- 172.21.15.148:0/3745112858 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f13980a3580 0x7f13980a5a40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f13b0117f40 tx=0x7f13a401a270 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:40.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.586+0000 7f13ae7fc640 1 -- 172.21.15.148:0/3745112858 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f13a009d210 con 0x7f13b0109450 2024-09-19T07:29:40.638 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.636+0000 7f6cf4ff9640 1 -- 172.21.15.148:0/1390545852 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557d5bbe4d70 con 0x557d5bcfe680 2024-09-19T07:29:40.638 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.636+0000 7f6cf4ff9640 10 client.27019 handle_command_reply: tid=0 2024-09-19T07:29:40.638 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.636+0000 7f6d1663c740 1 client.27019 shutdown 2024-09-19T07:29:40.639 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.637+0000 7f6d1663c740 1 -- 172.21.15.148:0/1390545852 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d5bc79410 msgr2=0x557d5bc99110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:40.639 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.637+0000 7f6d1663c740 1 --2- 172.21.15.148:0/1390545852 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d5bc79410 0x557d5bc99110 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6d0402a970 tx=0x7f6d0402f4f0 comp rx=0 tx=0).stop 2024-09-19T07:29:40.639 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.637+0000 7f6d1663c740 1 -- 172.21.15.148:0/1390545852 shutdown_connections 2024-09-19T07:29:40.639 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.637+0000 7f6d1663c740 1 --2- 172.21.15.148:0/1390545852 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x557d5bcfe680 0x557d5bd00aa0 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:40.639 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.637+0000 7f6d1663c740 1 --2- 172.21.15.148:0/1390545852 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557d5bc83cb0 0x557d5bc961d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:40.639 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.637+0000 7f6d1663c740 1 --2- 172.21.15.148:0/1390545852 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557d5bc79410 0x557d5bc99110 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:40.639 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.637+0000 7f6d1663c740 1 --2- 172.21.15.148:0/1390545852 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d5bc78af0 0x557d5bc98bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:40.639 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.637+0000 7f6d1663c740 1 -- 172.21.15.148:0/1390545852 >> 172.21.15.148:0/1390545852 conn(0x557d5bc75060 msgr2=0x557d5bc739a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:40.639 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.637+0000 7f6cf4ff9640 0 client.27019 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:29:40.639 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.637+0000 7f6d1663c740 1 -- 172.21.15.148:0/1390545852 shutdown_connections 2024-09-19T07:29:40.640 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.637+0000 7f6d1663c740 1 -- 172.21.15.148:0/1390545852 wait complete. 2024-09-19T07:29:40.640 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.637+0000 7f6d1663c740 20 client.27019 trim_cache size 0 max 16384 2024-09-19T07:29:40.640 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:29:40.640 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:29:40.640 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:29:40.640 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:29:40.641 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.638+0000 7f6d138a6640 1 -- 172.21.15.148:0/4199081300 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f6cf80a3450 msgr2=0x7f6cf80a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:40.642 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.638+0000 7f6d138a6640 1 --2- 172.21.15.148:0/4199081300 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f6cf80a3450 0x7f6cf80a5910 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c1a7c10 tx=0x7f6d080bb040 comp rx=0 tx=0).stop 2024-09-19T07:29:40.642 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.638+0000 7f6d138a6640 1 -- 172.21.15.148:0/4199081300 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6d0c10e780 msgr2=0x7f6d0c1a7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:40.642 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.638+0000 7f6d138a6640 1 --2- 172.21.15.148:0/4199081300 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6d0c10e780 0x7f6d0c1a7490 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6d08009fd0 tx=0x7f6d0800b8e0 comp rx=0 tx=0).stop 2024-09-19T07:29:40.642 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.639+0000 7f6d138a6640 1 -- 172.21.15.148:0/4199081300 shutdown_connections 2024-09-19T07:29:40.642 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.639+0000 7f6d138a6640 1 --2- 172.21.15.148:0/4199081300 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f6cf80a3450 0x7f6cf80a5910 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:40.642 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.639+0000 7f6d138a6640 1 --2- 172.21.15.148:0/4199081300 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6d0c10e780 0x7f6d0c1a7490 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:40.642 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.639+0000 7f6d138a6640 1 --2- 172.21.15.148:0/4199081300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d0c109b10 0x7f6d0c1ac360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:40.642 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.639+0000 7f6d138a6640 1 --2- 172.21.15.148:0/4199081300 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6d0c1091f0 0x7f6d0c1abe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:40.642 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.639+0000 7f6d138a6640 1 -- 172.21.15.148:0/4199081300 >> 172.21.15.148:0/4199081300 conn(0x7f6d0c06ce00 msgr2=0x7f6d0c10a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:40.642 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.640+0000 7f6d138a6640 1 -- 172.21.15.148:0/4199081300 shutdown_connections 2024-09-19T07:29:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:40.643+0000 7f6d138a6640 1 -- 172.21.15.148:0/4199081300 wait complete. 2024-09-19T07:29:40.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.977+0000 7f13b72ae640 1 -- 172.21.15.148:0/3745112858 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f139c0055b0 con 0x7f13b0109450 2024-09-19T07:29:40.984 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:29:40.984 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":55,"btime":"2024-09-19T07:26:06:767218+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/4263868576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":4263868576},{"type":"v1","addr":"172.21.15.148:6841","nonce":4263868576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":25606,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3891676893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3891676893},{"type":"v1","addr":"172.21.15.179:6835","nonce":3891676893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":55,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:09:19.543369+0000","modified":"2024-09-19T07:26:06.157910+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24457,"mds_1":24437,"mds_2":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":75,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":71,"addr":"172.21.15.165:6839/3993490234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":3993490234},{"type":"v1","addr":"172.21.15.165:6839","nonce":3993490234}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25823":{"gid":25823,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6835/380886107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":380886107},{"type":"v1","addr":"172.21.15.165:6835","nonce":380886107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24457,"qdb_cluster":[24457,24437,24436]},"id":1}]} 2024-09-19T07:29:40.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.981+0000 7f13ae7fc640 1 -- 172.21.15.148:0/3745112858 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+11947 (secure 0 0 0) 0x7f13a009cb10 con 0x7f13b0109450 2024-09-19T07:29:40.985 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 55 2024-09-19T07:29:40.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.984+0000 7f13b72ae640 1 -- 172.21.15.148:0/3745112858 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f13980a3580 msgr2=0x7f13980a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:40.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.984+0000 7f13b72ae640 1 --2- 172.21.15.148:0/3745112858 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f13980a3580 0x7f13980a5a40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f13b0117f40 tx=0x7f13a401a270 comp rx=0 tx=0).stop 2024-09-19T07:29:40.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.985+0000 7f13b72ae640 1 -- 172.21.15.148:0/3745112858 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13b0109450 msgr2=0x7f13b011a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:40.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.985+0000 7f13b72ae640 1 --2- 172.21.15.148:0/3745112858 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13b0109450 0x7f13b011a6e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f13a000eb00 tx=0x7f13a000c2d0 comp rx=0 tx=0).stop 2024-09-19T07:29:40.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.985+0000 7f13b72ae640 1 -- 172.21.15.148:0/3745112858 shutdown_connections 2024-09-19T07:29:40.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.985+0000 7f13b72ae640 1 --2- 172.21.15.148:0/3745112858 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f13980a3580 0x7f13980a5a40 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:40.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.985+0000 7f13b72ae640 1 --2- 172.21.15.148:0/3745112858 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13b011b140 0x7f13b0116cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:40.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.985+0000 7f13b72ae640 1 --2- 172.21.15.148:0/3745112858 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13b0109830 0x7f13b0116780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:40.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.985+0000 7f13b72ae640 1 --2- 172.21.15.148:0/3745112858 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13b0109450 0x7f13b011a6e0 secure :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f13a000eb00 tx=0x7f13a000c2d0 comp rx=0 tx=0).stop 2024-09-19T07:29:40.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.985+0000 7f13b72ae640 1 -- 172.21.15.148:0/3745112858 >> 172.21.15.148:0/3745112858 conn(0x7f13b006e140 msgr2=0x7f13b0072280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:40.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.987+0000 7f13b72ae640 1 -- 172.21.15.148:0/3745112858 shutdown_connections 2024-09-19T07:29:40.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:40.987+0000 7f13b72ae640 1 -- 172.21.15.148:0/3745112858 wait complete. 2024-09-19T07:29:41.008 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:29:40 smithi148 ceph-mon[31180]: pgmap v585: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 539 KiB/s wr, 73 op/s 2024-09-19T07:29:41.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:29:40 smithi179 ceph-mon[35716]: pgmap v585: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 539 KiB/s wr, 73 op/s 2024-09-19T07:29:41.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:29:40 smithi165 ceph-mon[35326]: pgmap v585: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 539 KiB/s wr, 73 op/s 2024-09-19T07:29:41.827 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24457 quiesce db --set-id f7e07a68 --release --await' 2024-09-19T07:29:41.827 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24457 quiesce db --set-id f7e07a68 --release --await 2024-09-19T07:29:42.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:29:41 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:29:42.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:29:41 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/3745112858' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:29:42.085 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:29:41 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:29:42.086 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:29:41 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/3745112858' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:29:42.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:29:41 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:29:42.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:29:41 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/3745112858' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:29:42.297 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:29:42.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.926+0000 7f4e12b82640 1 -- 172.21.15.148:0/1401069195 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e0c10d9b0 msgr2=0x7f4e0c115510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:42.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.926+0000 7f4e12b82640 1 --2- 172.21.15.148:0/1401069195 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e0c10d9b0 0x7f4e0c115510 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4e040077b0 tx=0x7f4e0402b460 comp rx=0 tx=0).stop 2024-09-19T07:29:42.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.927+0000 7f4e12b82640 1 -- 172.21.15.148:0/1401069195 shutdown_connections 2024-09-19T07:29:42.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.927+0000 7f4e12b82640 1 --2- 172.21.15.148:0/1401069195 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e0c10d9b0 0x7f4e0c115510 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:42.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.927+0000 7f4e12b82640 1 --2- 172.21.15.148:0/1401069195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e0c10ef30 0x7f4e0c10d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:42.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.927+0000 7f4e12b82640 1 --2- 172.21.15.148:0/1401069195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e0c10e580 0x7f4e0c10e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:42.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.927+0000 7f4e12b82640 1 -- 172.21.15.148:0/1401069195 >> 172.21.15.148:0/1401069195 conn(0x7f4e0c06e140 msgr2=0x7f4e0c06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:42.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.929+0000 7f4e12b82640 1 -- 172.21.15.148:0/1401069195 shutdown_connections 2024-09-19T07:29:42.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.929+0000 7f4e12b82640 1 -- 172.21.15.148:0/1401069195 wait complete. 2024-09-19T07:29:42.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.929+0000 7f4e12b82640 1 Processor -- start 2024-09-19T07:29:42.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.929+0000 7f4e12b82640 1 -- start start 2024-09-19T07:29:42.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.930+0000 7f4e12b82640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e0c10e580 0x7f4e0c115340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:42.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.930+0000 7f4e12b82640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e0c10ef30 0x7f4e0c112440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:42.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.930+0000 7f4e12b82640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e0c112980 0x7f4e0c112de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:42.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.930+0000 7f4e12b82640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0c118360 con 0x7f4e0c10e580 2024-09-19T07:29:42.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.930+0000 7f4e12b82640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0c1181e0 con 0x7f4e0c10ef30 2024-09-19T07:29:42.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.930+0000 7f4e12b82640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0c1184e0 con 0x7f4e0c112980 2024-09-19T07:29:42.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.930+0000 7f4e1091e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e0c10e580 0x7f4e0c115340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:42.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.930+0000 7f4e1091e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e0c10e580 0x7f4e0c115340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43466/0 (socket says 172.21.15.148:43466) 2024-09-19T07:29:42.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.930+0000 7f4e1091e640 1 -- 172.21.15.148:0/4186428352 learned_addr learned my addr 172.21.15.148:0/4186428352 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:29:42.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.932+0000 7f4e1111f640 1 --2- 172.21.15.148:0/4186428352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e0c112980 0x7f4e0c112de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:42.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.932+0000 7f4e0bfff640 1 --2- 172.21.15.148:0/4186428352 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e0c10ef30 0x7f4e0c112440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:42.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.935+0000 7f4e1111f640 1 -- 172.21.15.148:0/4186428352 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e0c10ef30 msgr2=0x7f4e0c112440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:42.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.935+0000 7f4e1111f640 1 --2- 172.21.15.148:0/4186428352 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e0c10ef30 0x7f4e0c112440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:42.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.935+0000 7f4e1111f640 1 -- 172.21.15.148:0/4186428352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e0c10e580 msgr2=0x7f4e0c115340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:42.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.935+0000 7f4e1111f640 1 --2- 172.21.15.148:0/4186428352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e0c10e580 0x7f4e0c115340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:42.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.935+0000 7f4e1111f640 1 -- 172.21.15.148:0/4186428352 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e0c11d170 con 0x7f4e0c112980 2024-09-19T07:29:42.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.937+0000 7f4e1111f640 1 --2- 172.21.15.148:0/4186428352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e0c112980 0x7f4e0c112de0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4e04007780 tx=0x7f4e04009fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:42.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.938+0000 7f4e09ffb640 1 -- 172.21.15.148:0/4186428352 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e04037040 con 0x7f4e0c112980 2024-09-19T07:29:42.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.939+0000 7f4e09ffb640 1 -- 172.21.15.148:0/4186428352 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e04003b70 con 0x7f4e0c112980 2024-09-19T07:29:42.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.939+0000 7f4e09ffb640 1 -- 172.21.15.148:0/4186428352 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e0400a540 con 0x7f4e0c112980 2024-09-19T07:29:42.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.939+0000 7f4e12b82640 1 -- 172.21.15.148:0/4186428352 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e0c11d400 con 0x7f4e0c112980 2024-09-19T07:29:42.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.939+0000 7f4e12b82640 1 -- 172.21.15.148:0/4186428352 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e0c11d960 con 0x7f4e0c112980 2024-09-19T07:29:42.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.943+0000 7f4e14f5b740 1 Processor -- start 2024-09-19T07:29:42.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.943+0000 7f4e14f5b740 1 -- start start 2024-09-19T07:29:42.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.943+0000 7f4e14f5b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557559511060 0x557559511440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:42.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.943+0000 7f4e14f5b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557559511980 0x55755951bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:42.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.943+0000 7f4e14f5b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55755951c240 0x55755951e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:42.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.943+0000 7f4e14f5b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x557559476620 con 0x55755951c240 2024-09-19T07:29:42.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.943+0000 7f4e14f5b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55755941de50 con 0x557559511060 2024-09-19T07:29:42.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.943+0000 7f4e14f5b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5575594725e0 con 0x557559511980 2024-09-19T07:29:42.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.944+0000 7f4e0bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55755951c240 0x55755951e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:42.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.944+0000 7f4e0bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55755951c240 0x55755951e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43468/0 (socket says 172.21.15.148:43468) 2024-09-19T07:29:42.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.944+0000 7f4e0bfff640 1 -- 172.21.15.148:0/301030756 learned_addr learned my addr 172.21.15.148:0/301030756 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:29:42.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.944+0000 7f4e0bfff640 1 --2- 172.21.15.148:0/301030756 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557559511060 0x557559511440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:42.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.945+0000 7f4e0bfff640 1 -- 172.21.15.148:0/301030756 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557559511980 msgr2=0x55755951bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:42.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.945+0000 7f4e0bfff640 1 --2- 172.21.15.148:0/301030756 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557559511980 0x55755951bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:42.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.945+0000 7f4e0bfff640 1 -- 172.21.15.148:0/301030756 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55755951c240 msgr2=0x55755951e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:42.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.945+0000 7f4e0bfff640 1 --2- 172.21.15.148:0/301030756 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55755951c240 0x55755951e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:42.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.945+0000 7f4e0bfff640 1 -- 172.21.15.148:0/301030756 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55755940ed40 con 0x557559511060 2024-09-19T07:29:42.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.945+0000 7f4e0bfff640 1 --2- 172.21.15.148:0/301030756 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557559511060 0x557559511440 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4e00009fd0 tx=0x7f4e00009110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57a7cbdfb3d5ef43 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:42.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.946+0000 7f4df6ffd640 1 -- 172.21.15.148:0/301030756 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e00015730 con 0x557559511060 2024-09-19T07:29:42.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.946+0000 7f4df6ffd640 1 -- 172.21.15.148:0/301030756 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e0001d070 con 0x557559511060 2024-09-19T07:29:42.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.946+0000 7f4df6ffd640 1 -- 172.21.15.148:0/301030756 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e000189b0 con 0x557559511060 2024-09-19T07:29:42.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.948+0000 7f4e09ffb640 1 -- 172.21.15.148:0/4186428352 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f4e0400a6e0 con 0x7f4e0c112980 2024-09-19T07:29:42.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.948+0000 7f4e14f5b740 1 -- 172.21.15.148:0/301030756 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557559511060 msgr2=0x557559511440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:42.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.948+0000 7f4e14f5b740 1 --2- 172.21.15.148:0/301030756 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557559511060 0x557559511440 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4e00009fd0 tx=0x7f4e00009110 comp rx=0 tx=0).stop 2024-09-19T07:29:42.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.948+0000 7f4e14f5b740 1 -- 172.21.15.148:0/301030756 shutdown_connections 2024-09-19T07:29:42.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.948+0000 7f4e14f5b740 1 --2- 172.21.15.148:0/301030756 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55755951c240 0x55755951e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:42.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.948+0000 7f4e14f5b740 1 --2- 172.21.15.148:0/301030756 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557559511980 0x55755951bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:42.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.948+0000 7f4e14f5b740 1 --2- 172.21.15.148:0/301030756 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557559511060 0x557559511440 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:42.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.948+0000 7f4e14f5b740 1 -- 172.21.15.148:0/301030756 >> 172.21.15.148:0/301030756 conn(0x55755950d5f0 msgr2=0x55755950d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:42.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.949+0000 7f4e09ffb640 1 --2- 172.21.15.148:0/4186428352 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f4dfc0a3520 0x7f4dfc0a59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:42.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.949+0000 7f4e09ffb640 1 -- 172.21.15.148:0/4186428352 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8600+0+0 (secure 0 0 0) 0x7f4e040ef740 con 0x7f4e0c112980 2024-09-19T07:29:42.951 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.949+0000 7f4e14f5b740 1 -- 172.21.15.148:0/301030756 shutdown_connections 2024-09-19T07:29:42.951 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.950+0000 7f4e14f5b740 1 -- 172.21.15.148:0/301030756 wait complete. 2024-09-19T07:29:42.951 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.950+0000 7f4e1091e640 1 --2- 172.21.15.148:0/4186428352 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f4dfc0a3520 0x7f4dfc0a59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:42.951 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.950+0000 7f4e14f5b740 1 -- start start 2024-09-19T07:29:42.951 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.950+0000 7f4e14f5b740 1 Processor -- start 2024-09-19T07:29:42.951 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.951+0000 7f4e1091e640 1 --2- 172.21.15.148:0/4186428352 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f4dfc0a3520 0x7f4dfc0a59e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x55755950e450 tx=0x7f4df80046c0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:42.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.951+0000 7f4e14f5b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557559511060 0x55755951aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:42.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.951+0000 7f4e14f5b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557559511980 0x55755951afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:42.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.951+0000 7f4e14f5b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55755951c240 0x55755951b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:42.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.951+0000 7f4e14f5b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55755951ee10 con 0x557559511980 2024-09-19T07:29:42.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.951+0000 7f4e14f5b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5575593fef10 con 0x55755951c240 2024-09-19T07:29:42.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.951+0000 7f4e14f5b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55755951ef90 con 0x557559511060 2024-09-19T07:29:42.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.951+0000 7f4e14f5b740 10 client.0 _ll_register_callbacks cb 0x557559422db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:29:42.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.951+0000 7f4e0bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557559511980 0x55755951afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:42.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.951+0000 7f4e0bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557559511980 0x55755951afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43470/0 (socket says 172.21.15.148:43470) 2024-09-19T07:29:42.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.951+0000 7f4e0bfff640 1 -- 172.21.15.148:0/1192122396 learned_addr learned my addr 172.21.15.148:0/1192122396 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:29:42.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.951+0000 7f4e1111f640 1 --2- 172.21.15.148:0/1192122396 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55755951c240 0x55755951b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:42.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.951+0000 7f4e1091e640 1 --2- 172.21.15.148:0/1192122396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557559511060 0x55755951aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:42.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.952+0000 7f4e1111f640 1 -- 172.21.15.148:0/1192122396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557559511060 msgr2=0x55755951aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:42.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.952+0000 7f4e1111f640 1 --2- 172.21.15.148:0/1192122396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557559511060 0x55755951aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:42.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.952+0000 7f4e1111f640 1 -- 172.21.15.148:0/1192122396 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557559511980 msgr2=0x55755951afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:42.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.952+0000 7f4e1111f640 1 --2- 172.21.15.148:0/1192122396 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557559511980 0x55755951afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:42.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.952+0000 7f4e1111f640 1 -- 172.21.15.148:0/1192122396 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557559185580 con 0x55755951c240 2024-09-19T07:29:42.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.952+0000 7f4e1111f640 1 --2- 172.21.15.148:0/1192122396 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55755951c240 0x55755951b500 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4e040ecde0 tx=0x7f4e0400a9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae633efeb1ef3122 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:42.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.952+0000 7f4debfff640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-19T07:29:42.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.952+0000 7f4debfff640 1 -- 172.21.15.148:0/1192122396 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e040bba00 con 0x55755951c240 2024-09-19T07:29:42.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.953+0000 7f4e14f5b740 1 -- 172.21.15.148:0/1192122396 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e0001d070 con 0x55755951c240 2024-09-19T07:29:42.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.953+0000 7f4debfff640 1 -- 172.21.15.148:0/1192122396 <== mon.2 v2:172.21.15.165:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 8600+0+0 (secure 0 0 0) 0x7f4e040ed060 con 0x55755951c240 2024-09-19T07:29:42.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.953+0000 7f4debfff640 1 -- 172.21.15.148:0/1192122396 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f4e040ed260 con 0x55755951c240 2024-09-19T07:29:42.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.953+0000 7f4e14f5b740 10 client.26921 fetch_fsmap learned FSMap version 55 2024-09-19T07:29:42.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.953+0000 7f4e14f5b740 1 -- 172.21.15.148:0/1192122396 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x55755924f960 con 0x55755951c240 2024-09-19T07:29:42.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.954+0000 7f4debfff640 1 -- 172.21.15.148:0/1192122396 <== mon.2 v2:172.21.15.165:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e0001d070 con 0x55755951c240 2024-09-19T07:29:42.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.954+0000 7f4debfff640 1 -- 172.21.15.148:0/1192122396 <== mon.2 v2:172.21.15.165:3300/0 5 ==== fsmap(e 55) ==== 8370+0+0 (secure 0 0 0) 0x7f4e0403a030 con 0x55755951c240 2024-09-19T07:29:42.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.954+0000 7f4e14f5b740 10 client.26921 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T07:29:42.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.954+0000 7f4e14f5b740 10 client.26921 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:29:42.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.954+0000 7f4e14f5b740 20 client.26921 populate_metadata read hostname 'smithi148' 2024-09-19T07:29:42.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.954+0000 7f4e14f5b740 1 --2- 172.21.15.148:0/1192122396 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55755952beb0 0x55755952e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:42.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.954+0000 7f4e14f5b740 4 client.26921 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:29:42.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.954+0000 7f4e14f5b740 1 -- 172.21.15.148:0/1192122396 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557559483b90 con 0x55755952beb0 2024-09-19T07:29:42.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.955+0000 7f4e1091e640 1 --2- 172.21.15.148:0/1192122396 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55755952beb0 0x55755952e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:42.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.956+0000 7f4debfff640 10 client.26921 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:29:42.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.956+0000 7f4e1091e640 1 --2- 172.21.15.148:0/1192122396 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55755952beb0 0x55755952e350 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88423125424a7b01 server_cookie=cf151b88a93433dc in_seq=0 out_seq=0 2024-09-19T07:29:42.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.958+0000 7f4debfff640 1 -- 172.21.15.148:0/1192122396 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557559483b90 con 0x55755952beb0 2024-09-19T07:29:42.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.958+0000 7f4debfff640 10 client.26921 handle_command_reply: tid=0 2024-09-19T07:29:42.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.958+0000 7f4e14f5b740 1 client.26921 shutdown 2024-09-19T07:29:42.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.958+0000 7f4e14f5b740 1 -- 172.21.15.148:0/1192122396 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55755951c240 msgr2=0x55755951b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:42.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.958+0000 7f4e14f5b740 1 --2- 172.21.15.148:0/1192122396 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55755951c240 0x55755951b500 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4e040ecde0 tx=0x7f4e0400a9d0 comp rx=0 tx=0).stop 2024-09-19T07:29:42.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.958+0000 7f4e14f5b740 1 -- 172.21.15.148:0/1192122396 shutdown_connections 2024-09-19T07:29:42.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.958+0000 7f4e14f5b740 1 --2- 172.21.15.148:0/1192122396 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55755952beb0 0x55755952e350 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:42.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.958+0000 7f4e14f5b740 1 --2- 172.21.15.148:0/1192122396 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55755951c240 0x55755951b500 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:42.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.958+0000 7f4e14f5b740 1 --2- 172.21.15.148:0/1192122396 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557559511980 0x55755951afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:42.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.958+0000 7f4e14f5b740 1 --2- 172.21.15.148:0/1192122396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557559511060 0x55755951aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:42.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.958+0000 7f4e14f5b740 1 -- 172.21.15.148:0/1192122396 >> 172.21.15.148:0/1192122396 conn(0x55755950d5f0 msgr2=0x557559513320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:42.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.959+0000 7f4debfff640 0 client.26921 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:29:42.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.960+0000 7f4e14f5b740 1 -- 172.21.15.148:0/1192122396 shutdown_connections 2024-09-19T07:29:42.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.960+0000 7f4e14f5b740 1 -- 172.21.15.148:0/1192122396 wait complete. 2024-09-19T07:29:42.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.960+0000 7f4e14f5b740 20 client.26921 trim_cache size 0 max 16384 2024-09-19T07:29:42.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.993+0000 7f4e14f5b740 1 Processor -- start 2024-09-19T07:29:42.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.993+0000 7f4e14f5b740 1 -- start start 2024-09-19T07:29:42.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.994+0000 7f4e14f5b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557559511060 0x55755950d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:42.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.994+0000 7f4e14f5b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557559511980 0x557559513ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:42.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.994+0000 7f4e14f5b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55755951c240 0x55755950c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:42.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.994+0000 7f4e14f5b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0c1c7a40 con 0x557559511980 2024-09-19T07:29:42.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.994+0000 7f4e14f5b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0c1c5250 con 0x55755951c240 2024-09-19T07:29:42.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.994+0000 7f4e14f5b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0c124250 con 0x557559511060 2024-09-19T07:29:42.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.994+0000 7f4e1091e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557559511060 0x55755950d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:42.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.994+0000 7f4e1091e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557559511060 0x55755950d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:34420/0 (socket says 172.21.15.148:34420) 2024-09-19T07:29:42.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.994+0000 7f4e1091e640 1 -- 172.21.15.148:0/3322201184 learned_addr learned my addr 172.21.15.148:0/3322201184 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:29:42.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.997+0000 7f4e1111f640 1 --2- 172.21.15.148:0/3322201184 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55755951c240 0x55755950c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:42.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.998+0000 7f4e0bfff640 1 --2- 172.21.15.148:0/3322201184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557559511980 0x557559513ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:43.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.999+0000 7f4e1091e640 1 -- 172.21.15.148:0/3322201184 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55755951c240 msgr2=0x55755950c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:43.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.999+0000 7f4e1091e640 1 --2- 172.21.15.148:0/3322201184 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55755951c240 0x55755950c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:43.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.999+0000 7f4e1091e640 1 -- 172.21.15.148:0/3322201184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557559511980 msgr2=0x557559513ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:43.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.999+0000 7f4e1091e640 1 --2- 172.21.15.148:0/3322201184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557559511980 0x557559513ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:43.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:42.999+0000 7f4e1091e640 1 -- 172.21.15.148:0/3322201184 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55755951b160 con 0x557559511060 2024-09-19T07:29:43.006 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:29:42 smithi148 ceph-mon[31180]: pgmap v586: 97 pgs: 19 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 43 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 540 KiB/s wr, 62 op/s 2024-09-19T07:29:43.006 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:29:42 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:29:43.006 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:29:42 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:29:43.006 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:29:42 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:29:43.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.004+0000 7f4e1091e640 1 --2- 172.21.15.148:0/3322201184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557559511060 0x55755950d9d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x55755952ec00 tx=0x7f4df8014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b621fcc08a2c5928 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:43.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.004+0000 7f4df67fc640 1 -- 172.21.15.148:0/3322201184 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df80043c0 con 0x557559511060 2024-09-19T07:29:43.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.004+0000 7f4df67fc640 1 -- 172.21.15.148:0/3322201184 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4df8005500 con 0x557559511060 2024-09-19T07:29:43.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.004+0000 7f4df67fc640 1 -- 172.21.15.148:0/3322201184 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df80275d0 con 0x557559511060 2024-09-19T07:29:43.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.005+0000 7f4e14f5b740 1 -- 172.21.15.148:0/3322201184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557559511060 msgr2=0x55755950d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:43.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.005+0000 7f4e14f5b740 1 --2- 172.21.15.148:0/3322201184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557559511060 0x55755950d9d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x55755952ec00 tx=0x7f4df8014000 comp rx=0 tx=0).stop 2024-09-19T07:29:43.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.006+0000 7f4e14f5b740 1 -- 172.21.15.148:0/3322201184 shutdown_connections 2024-09-19T07:29:43.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.006+0000 7f4e14f5b740 1 --2- 172.21.15.148:0/3322201184 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55755951c240 0x55755950c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:43.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.006+0000 7f4e14f5b740 1 --2- 172.21.15.148:0/3322201184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557559511980 0x557559513ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:43.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.006+0000 7f4e14f5b740 1 --2- 172.21.15.148:0/3322201184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557559511060 0x55755950d9d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:43.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.006+0000 7f4e14f5b740 1 -- 172.21.15.148:0/3322201184 >> 172.21.15.148:0/3322201184 conn(0x55755950d5f0 msgr2=0x55755950bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:43.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.007+0000 7f4e14f5b740 1 -- 172.21.15.148:0/3322201184 shutdown_connections 2024-09-19T07:29:43.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.007+0000 7f4e14f5b740 1 -- 172.21.15.148:0/3322201184 wait complete. 2024-09-19T07:29:43.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.007+0000 7f4e14f5b740 1 -- start start 2024-09-19T07:29:43.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.008+0000 7f4e14f5b740 1 Processor -- start 2024-09-19T07:29:43.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.008+0000 7f4e14f5b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557559511060 0x557559516420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:43.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.008+0000 7f4e14f5b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557559511980 0x557559516960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:43.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.008+0000 7f4e14f5b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55755951c240 0x557559516ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:43.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.008+0000 7f4e14f5b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0c1248a0 con 0x55755951c240 2024-09-19T07:29:43.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.008+0000 7f4e14f5b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0c1c4b80 con 0x557559511980 2024-09-19T07:29:43.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.008+0000 7f4e14f5b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0c124f70 con 0x557559511060 2024-09-19T07:29:43.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.008+0000 7f4e14f5b740 10 client.0 _ll_register_callbacks cb 0x7f4e040bb540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:29:43.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.009+0000 7f4e1111f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55755951c240 0x557559516ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:43.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.009+0000 7f4e1111f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55755951c240 0x557559516ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43482/0 (socket says 172.21.15.148:43482) 2024-09-19T07:29:43.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.009+0000 7f4e1111f640 1 -- 172.21.15.148:0/1645455448 learned_addr learned my addr 172.21.15.148:0/1645455448 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:29:43.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.009+0000 7f4e1091e640 1 --2- 172.21.15.148:0/1645455448 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557559511060 0x557559516420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:43.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.009+0000 7f4e0bfff640 1 --2- 172.21.15.148:0/1645455448 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557559511980 0x557559516960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:43.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.010+0000 7f4e1091e640 1 -- 172.21.15.148:0/1645455448 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557559511980 msgr2=0x557559516960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:43.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.010+0000 7f4e1091e640 1 --2- 172.21.15.148:0/1645455448 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557559511980 0x557559516960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:43.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.010+0000 7f4e1091e640 1 -- 172.21.15.148:0/1645455448 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55755951c240 msgr2=0x557559516ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:43.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.010+0000 7f4e1091e640 1 --2- 172.21.15.148:0/1645455448 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55755951c240 0x557559516ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:43.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.010+0000 7f4e1091e640 1 -- 172.21.15.148:0/1645455448 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557559595d90 con 0x557559511060 2024-09-19T07:29:43.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.011+0000 7f4e1091e640 1 --2- 172.21.15.148:0/1645455448 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557559511060 0x557559516420 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4df80097f0 tx=0x7f4df8005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8206f04da2fb6fd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:43.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.011+0000 7f4debfff640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-19T07:29:43.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.011+0000 7f4debfff640 1 -- 172.21.15.148:0/1645455448 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df8036020 con 0x557559511060 2024-09-19T07:29:43.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.011+0000 7f4e14f5b740 1 -- 172.21.15.148:0/1645455448 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4df8005500 con 0x557559511060 2024-09-19T07:29:43.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.011+0000 7f4debfff640 1 -- 172.21.15.148:0/1645455448 <== mon.1 v2:172.21.15.179:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 8600+0+0 (secure 0 0 0) 0x7f4df802e040 con 0x557559511060 2024-09-19T07:29:43.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.012+0000 7f4debfff640 1 -- 172.21.15.148:0/1645455448 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f4df80047f0 con 0x557559511060 2024-09-19T07:29:43.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.017+0000 7f4e14f5b740 10 client.27040 fetch_fsmap learned FSMap version 55 2024-09-19T07:29:43.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.017+0000 7f4e14f5b740 1 -- 172.21.15.148:0/1645455448 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x5575595970b0 con 0x557559511060 2024-09-19T07:29:43.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.018+0000 7f4debfff640 1 -- 172.21.15.148:0/1645455448 <== mon.1 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4df8005500 con 0x557559511060 2024-09-19T07:29:43.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.018+0000 7f4debfff640 1 -- 172.21.15.148:0/1645455448 <== mon.1 v2:172.21.15.179:3300/0 5 ==== fsmap(e 55) ==== 8370+0+0 (secure 0 0 0) 0x7f4df8027a60 con 0x557559511060 2024-09-19T07:29:43.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.018+0000 7f4e14f5b740 10 client.27040 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T07:29:43.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.018+0000 7f4e14f5b740 10 client.27040 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:29:43.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.018+0000 7f4e14f5b740 20 client.27040 populate_metadata read hostname 'smithi148' 2024-09-19T07:29:43.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.018+0000 7f4e14f5b740 1 --2- 172.21.15.148:0/1645455448 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x557559597860 0x557559599c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:43.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.018+0000 7f4e14f5b740 4 client.27040 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "f7e07a68", "release": true, "await": true}] 2024-09-19T07:29:43.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.018+0000 7f4e14f5b740 1 -- 172.21.15.148:0/1645455448 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "quiesce db", "set_id": "f7e07a68", "release": true, "await": true}) -- 0x55755947e0a0 con 0x557559597860 2024-09-19T07:29:43.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.019+0000 7f4e0bfff640 1 --2- 172.21.15.148:0/1645455448 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x557559597860 0x557559599c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:43.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:29:42 smithi179 ceph-mon[35716]: pgmap v586: 97 pgs: 19 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 43 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 540 KiB/s wr, 62 op/s 2024-09-19T07:29:43.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:29:42 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:29:43.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:29:42 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:29:43.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:29:42 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:29:43.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.023+0000 7f4e0bfff640 1 --2- 172.21.15.148:0/1645455448 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x557559597860 0x557559599c80 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee6a2005b913d8c7 server_cookie=89d349f175ec4d3a in_seq=0 out_seq=0 2024-09-19T07:29:43.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.024+0000 7f4debfff640 10 client.27040 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:29:43.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:29:42 smithi165 ceph-mon[35326]: pgmap v586: 97 pgs: 19 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 43 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 540 KiB/s wr, 62 op/s 2024-09-19T07:29:43.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:29:42 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:29:43.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:29:42 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:29:43.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:29:42 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:29:43.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.173+0000 7f4debfff640 1 -- 172.21.15.148:0/1645455448 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55755947e0a0 con 0x557559597860 2024-09-19T07:29:43.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.173+0000 7f4debfff640 10 client.27040 handle_command_reply: tid=0 2024-09-19T07:29:43.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.173+0000 7f4e14f5b740 1 client.27040 shutdown 2024-09-19T07:29:43.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.174+0000 7f4e14f5b740 1 -- 172.21.15.148:0/1645455448 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557559511060 msgr2=0x557559516420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:43.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.174+0000 7f4e14f5b740 1 --2- 172.21.15.148:0/1645455448 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557559511060 0x557559516420 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4df80097f0 tx=0x7f4df8005740 comp rx=0 tx=0).stop 2024-09-19T07:29:43.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.174+0000 7f4e14f5b740 1 -- 172.21.15.148:0/1645455448 shutdown_connections 2024-09-19T07:29:43.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.174+0000 7f4e14f5b740 1 --2- 172.21.15.148:0/1645455448 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x557559597860 0x557559599c80 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:43.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.174+0000 7f4e14f5b740 1 --2- 172.21.15.148:0/1645455448 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55755951c240 0x557559516ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:43.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.174+0000 7f4e14f5b740 1 --2- 172.21.15.148:0/1645455448 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557559511980 0x557559516960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:43.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.174+0000 7f4e14f5b740 1 --2- 172.21.15.148:0/1645455448 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557559511060 0x557559516420 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:43.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.174+0000 7f4e14f5b740 1 -- 172.21.15.148:0/1645455448 >> 172.21.15.148:0/1645455448 conn(0x55755950d5f0 msgr2=0x557559519a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:43.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.174+0000 7f4debfff640 0 client.27040 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:29:43.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.174+0000 7f4e14f5b740 1 -- 172.21.15.148:0/1645455448 shutdown_connections 2024-09-19T07:29:43.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.174+0000 7f4e14f5b740 1 -- 172.21.15.148:0/1645455448 wait complete. 2024-09-19T07:29:43.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.174+0000 7f4e14f5b740 20 client.27040 trim_cache size 0 max 16384 2024-09-19T07:29:43.176 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:29:43.176 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 55, 2024-09-19T07:29:43.176 INFO:teuthology.orchestra.run.smithi148.stdout: "leader": 24457, 2024-09-19T07:29:43.177 INFO:teuthology.orchestra.run.smithi148.stdout: "set_version": 60, 2024-09-19T07:29:43.177 INFO:teuthology.orchestra.run.smithi148.stdout: "sets": { 2024-09-19T07:29:43.177 INFO:teuthology.orchestra.run.smithi148.stdout: "f7e07a68": { 2024-09-19T07:29:43.177 INFO:teuthology.orchestra.run.smithi148.stdout: "version": 60, 2024-09-19T07:29:43.177 INFO:teuthology.orchestra.run.smithi148.stdout: "age_ref": 0.0, 2024-09-19T07:29:43.177 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:29:43.177 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RELEASED", 2024-09-19T07:29:43.177 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:29:43.177 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:29:43.177 INFO:teuthology.orchestra.run.smithi148.stdout: "timeout": 90.0, 2024-09-19T07:29:43.177 INFO:teuthology.orchestra.run.smithi148.stdout: "expiration": 137.1, 2024-09-19T07:29:43.177 INFO:teuthology.orchestra.run.smithi148.stdout: "members": { 2024-09-19T07:29:43.177 INFO:teuthology.orchestra.run.smithi148.stdout: "file:/": { 2024-09-19T07:29:43.178 INFO:teuthology.orchestra.run.smithi148.stdout: "excluded": false, 2024-09-19T07:29:43.178 INFO:teuthology.orchestra.run.smithi148.stdout: "state": { 2024-09-19T07:29:43.178 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RELEASED", 2024-09-19T07:29:43.178 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0 2024-09-19T07:29:43.178 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:29:43.178 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:29:43.178 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:29:43.178 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:29:43.178 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:29:43.178 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:29:43.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.175+0000 7f4e12b82640 1 -- 172.21.15.148:0/4186428352 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f4dfc0a3520 msgr2=0x7f4dfc0a59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:43.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.175+0000 7f4e12b82640 1 --2- 172.21.15.148:0/4186428352 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f4dfc0a3520 0x7f4dfc0a59e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x55755950e450 tx=0x7f4df80046c0 comp rx=0 tx=0).stop 2024-09-19T07:29:43.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.175+0000 7f4e12b82640 1 -- 172.21.15.148:0/4186428352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e0c112980 msgr2=0x7f4e0c112de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:43.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.175+0000 7f4e12b82640 1 --2- 172.21.15.148:0/4186428352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e0c112980 0x7f4e0c112de0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4e04007780 tx=0x7f4e04009fb0 comp rx=0 tx=0).stop 2024-09-19T07:29:43.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.175+0000 7f4e12b82640 1 -- 172.21.15.148:0/4186428352 shutdown_connections 2024-09-19T07:29:43.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.175+0000 7f4e12b82640 1 --2- 172.21.15.148:0/4186428352 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f4dfc0a3520 0x7f4dfc0a59e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:43.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.175+0000 7f4e12b82640 1 --2- 172.21.15.148:0/4186428352 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e0c112980 0x7f4e0c112de0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:43.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.175+0000 7f4e12b82640 1 --2- 172.21.15.148:0/4186428352 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e0c10ef30 0x7f4e0c112440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:43.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.175+0000 7f4e12b82640 1 --2- 172.21.15.148:0/4186428352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e0c10e580 0x7f4e0c115340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:43.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.175+0000 7f4e12b82640 1 -- 172.21.15.148:0/4186428352 >> 172.21.15.148:0/4186428352 conn(0x7f4e0c06e140 msgr2=0x7f4e0c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:43.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.175+0000 7f4e12b82640 1 -- 172.21.15.148:0/4186428352 shutdown_connections 2024-09-19T07:29:43.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:43.175+0000 7f4e12b82640 1 -- 172.21.15.148:0/4186428352 wait complete. 2024-09-19T07:29:43.877 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'f7e07a68', total seconds elapsed: 21.5 2024-09-19T07:29:45.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:29:44 smithi179 ceph-mon[35716]: pgmap v587: 97 pgs: 19 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 43 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T07:29:45.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:29:44 smithi148 ceph-mon[31180]: pgmap v587: 97 pgs: 19 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 43 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T07:29:45.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:29:44 smithi165 ceph-mon[35326]: pgmap v587: 97 pgs: 19 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 43 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T07:29:47.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:29:46 smithi179 ceph-mon[35716]: pgmap v588: 97 pgs: 17 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 50 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 115 KiB/s wr, 27 op/s 2024-09-19T07:29:47.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:29:46 smithi148 ceph-mon[31180]: pgmap v588: 97 pgs: 17 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 50 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 115 KiB/s wr, 27 op/s 2024-09-19T07:29:47.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:29:46 smithi165 ceph-mon[35326]: pgmap v588: 97 pgs: 17 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 50 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 115 KiB/s wr, 27 op/s 2024-09-19T07:29:49.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:29:48 smithi148 ceph-mon[31180]: pgmap v589: 97 pgs: 15 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 52 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 449 KiB/s wr, 28 op/s 2024-09-19T07:29:49.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:29:48 smithi165 ceph-mon[35326]: pgmap v589: 97 pgs: 15 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 52 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 449 KiB/s wr, 28 op/s 2024-09-19T07:29:49.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:29:48 smithi179 ceph-mon[35716]: pgmap v589: 97 pgs: 15 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 52 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 449 KiB/s wr, 28 op/s 2024-09-19T07:29:51.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:29:50 smithi148 ceph-mon[31180]: pgmap v590: 97 pgs: 15 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 52 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 449 KiB/s wr, 29 op/s 2024-09-19T07:29:51.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:29:50 smithi165 ceph-mon[35326]: pgmap v590: 97 pgs: 15 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 52 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 449 KiB/s wr, 29 op/s 2024-09-19T07:29:51.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:29:50 smithi179 ceph-mon[35716]: pgmap v590: 97 pgs: 15 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 52 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 449 KiB/s wr, 29 op/s 2024-09-19T07:29:53.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:29:52 smithi148 ceph-mon[31180]: pgmap v591: 97 pgs: 13 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 58 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 107 op/s 2024-09-19T07:29:53.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:29:52 smithi165 ceph-mon[35326]: pgmap v591: 97 pgs: 13 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 58 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 107 op/s 2024-09-19T07:29:53.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:29:52 smithi179 ceph-mon[35716]: pgmap v591: 97 pgs: 13 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 58 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 107 op/s 2024-09-19T07:29:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.791+0000 7fed01362640 1 -- 172.21.15.148:0/3350790842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fecf4099880 msgr2=0x7fecf40a1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.791+0000 7fed01362640 1 --2- 172.21.15.148:0/3350790842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fecf4099880 0x7fecf40a1420 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fecfc050280 tx=0x7fecfc096be0 comp rx=0 tx=0).stop 2024-09-19T07:29:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.791+0000 7fed01362640 1 -- 172.21.15.148:0/3350790842 shutdown_connections 2024-09-19T07:29:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.791+0000 7fed01362640 1 --2- 172.21.15.148:0/3350790842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fecf4099880 0x7fecf40a1420 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.791+0000 7fed01362640 1 --2- 172.21.15.148:0/3350790842 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fecf4095520 0x7fecf4099170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:53.795 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.791+0000 7fed01362640 1 --2- 172.21.15.148:0/3350790842 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fecf4094b70 0x7fecf4094f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:53.795 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.791+0000 7fed01362640 1 -- 172.21.15.148:0/3350790842 >> 172.21.15.148:0/3350790842 conn(0x7fecf400a1e0 msgr2=0x7fecf400a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:53.795 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.792+0000 7fed01362640 1 -- 172.21.15.148:0/3350790842 shutdown_connections 2024-09-19T07:29:53.795 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.792+0000 7fed01362640 1 -- 172.21.15.148:0/3350790842 wait complete. 2024-09-19T07:29:53.795 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.793+0000 7fed01362640 1 Processor -- start 2024-09-19T07:29:53.796 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.794+0000 7fed01362640 1 -- start start 2024-09-19T07:29:53.796 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.794+0000 7fed01362640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fecf4094b70 0x7fecf4129cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:53.796 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.794+0000 7fed01362640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fecf4099880 0x7fecf412a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:53.796 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.794+0000 7fed01362640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fecf412d4c0 0x7fecf412d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:53.796 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.794+0000 7fed01362640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fecf40a3720 con 0x7fecf4094b70 2024-09-19T07:29:53.796 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.794+0000 7fed01362640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fecf40a35a0 con 0x7fecf4099880 2024-09-19T07:29:53.797 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.794+0000 7fed01362640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fecf40a38a0 con 0x7fecf412d4c0 2024-09-19T07:29:53.797 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.795+0000 7fed00b61640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fecf412d4c0 0x7fecf412d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:53.797 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.795+0000 7fed00b61640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fecf412d4c0 0x7fecf412d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:39560/0 (socket says 172.21.15.148:39560) 2024-09-19T07:29:53.797 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.795+0000 7fed00b61640 1 -- 172.21.15.148:0/1244670970 learned_addr learned my addr 172.21.15.148:0/1244670970 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:29:53.797 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.795+0000 7fecfb7fe640 1 --2- 172.21.15.148:0/1244670970 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fecf4099880 0x7fecf412a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:53.797 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.795+0000 7fecfbfff640 1 --2- 172.21.15.148:0/1244670970 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fecf4094b70 0x7fecf4129cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:53.798 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.795+0000 7fed00b61640 1 -- 172.21.15.148:0/1244670970 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fecf4099880 msgr2=0x7fecf412a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:53.798 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.795+0000 7fed00b61640 1 --2- 172.21.15.148:0/1244670970 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fecf4099880 0x7fecf412a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:53.798 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.795+0000 7fed00b61640 1 -- 172.21.15.148:0/1244670970 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fecf4094b70 msgr2=0x7fecf4129cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:53.798 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.795+0000 7fed00b61640 1 --2- 172.21.15.148:0/1244670970 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fecf4094b70 0x7fecf4129cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:53.798 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.795+0000 7fed00b61640 1 -- 172.21.15.148:0/1244670970 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecf412dfb0 con 0x7fecf412d4c0 2024-09-19T07:29:53.798 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.796+0000 7fed00b61640 1 --2- 172.21.15.148:0/1244670970 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fecf412d4c0 0x7fecf412d970 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fecfc065360 tx=0x7fecfc06b730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:53.798 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.797+0000 7fecf97fa640 1 -- 172.21.15.148:0/1244670970 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecfc063260 con 0x7fecf412d4c0 2024-09-19T07:29:53.798 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.797+0000 7fecf97fa640 1 -- 172.21.15.148:0/1244670970 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecfc063400 con 0x7fecf412d4c0 2024-09-19T07:29:53.799 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.797+0000 7fecf97fa640 1 -- 172.21.15.148:0/1244670970 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecfc098a50 con 0x7fecf412d4c0 2024-09-19T07:29:53.799 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.798+0000 7fed01362640 1 -- 172.21.15.148:0/1244670970 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecf412e240 con 0x7fecf412d4c0 2024-09-19T07:29:53.799 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.798+0000 7fed01362640 1 -- 172.21.15.148:0/1244670970 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecf4136a30 con 0x7fecf412d4c0 2024-09-19T07:29:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.801+0000 7fecf97fa640 1 -- 172.21.15.148:0/1244670970 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fecfc062cf0 con 0x7fecf412d4c0 2024-09-19T07:29:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.802+0000 7fecf97fa640 1 --2- 172.21.15.148:0/1244670970 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fecec0a79a0 0x7fecec0a9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:53.804 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.802+0000 7fecf97fa640 1 -- 172.21.15.148:0/1244670970 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8600+0+0 (secure 0 0 0) 0x7fecfc15c4f0 con 0x7fecf412d4c0 2024-09-19T07:29:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.805+0000 7fecfbfff640 1 --2- 172.21.15.148:0/1244670970 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fecec0a79a0 0x7fecec0a9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.805+0000 7fed05439740 1 Processor -- start 2024-09-19T07:29:53.807 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.805+0000 7fed05439740 1 -- start start 2024-09-19T07:29:53.807 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.805+0000 7fed05439740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55eab0980be0 0x55eab0980fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:53.807 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.805+0000 7fed05439740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55eab0981500 0x55eab0994150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:53.807 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.805+0000 7fed05439740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eab0994690 0x55eab0996a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:53.807 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.805+0000 7fed05439740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55eab08e52f0 con 0x55eab0980be0 2024-09-19T07:29:53.807 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.805+0000 7fed05439740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55eab088d270 con 0x55eab0981500 2024-09-19T07:29:53.808 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.805+0000 7fed05439740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55eab08e12b0 con 0x55eab0994690 2024-09-19T07:29:53.808 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.806+0000 7fecfb7fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55eab0981500 0x55eab0994150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:53.808 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.806+0000 7fecfb7fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55eab0981500 0x55eab0994150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:52182/0 (socket says 172.21.15.148:52182) 2024-09-19T07:29:53.808 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.806+0000 7fecfb7fe640 1 -- 172.21.15.148:0/384226610 learned_addr learned my addr 172.21.15.148:0/384226610 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:29:53.808 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.806+0000 7fecfbfff640 1 --2- 172.21.15.148:0/384226610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55eab0980be0 0x55eab0980fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:53.808 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.806+0000 7fed00b61640 1 --2- 172.21.15.148:0/384226610 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eab0994690 0x55eab0996a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:53.809 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.806+0000 7fecfb7fe640 1 -- 172.21.15.148:0/384226610 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eab0994690 msgr2=0x55eab0996a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:53.810 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.806+0000 7fecfb7fe640 1 --2- 172.21.15.148:0/384226610 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eab0994690 0x55eab0996a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:53.810 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.806+0000 7fecfb7fe640 1 -- 172.21.15.148:0/384226610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55eab0980be0 msgr2=0x55eab0980fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:53.810 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.806+0000 7fecfb7fe640 1 --2- 172.21.15.148:0/384226610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55eab0980be0 0x55eab0980fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:53.810 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.806+0000 7fecfb7fe640 1 -- 172.21.15.148:0/384226610 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eab088c340 con 0x55eab0981500 2024-09-19T07:29:53.810 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.806+0000 7fecfbfff640 1 --2- 172.21.15.148:0/384226610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55eab0980be0 0x55eab0980fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:29:53.810 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.806+0000 7fecfbfff640 1 --2- 172.21.15.148:0/1244670970 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fecec0a79a0 0x7fecec0a9e60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fecf0009b60 tx=0x7fecf0005f90 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:53.811 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.806+0000 7fecfb7fe640 1 --2- 172.21.15.148:0/384226610 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55eab0981500 0x55eab0994150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fece80045c0 tx=0x7fece80045f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bb18ba59bca171c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:53.811 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.807+0000 7fece67fc640 1 -- 172.21.15.148:0/384226610 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece8003af0 con 0x55eab0981500 2024-09-19T07:29:53.811 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.807+0000 7fece67fc640 1 -- 172.21.15.148:0/384226610 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fece8015070 con 0x55eab0981500 2024-09-19T07:29:53.811 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.808+0000 7fece67fc640 1 -- 172.21.15.148:0/384226610 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece8011640 con 0x55eab0981500 2024-09-19T07:29:53.811 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.808+0000 7fed05439740 1 -- 172.21.15.148:0/384226610 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55eab0981500 msgr2=0x55eab0994150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:53.811 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.808+0000 7fed05439740 1 --2- 172.21.15.148:0/384226610 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55eab0981500 0x55eab0994150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fece80045c0 tx=0x7fece80045f0 comp rx=0 tx=0).stop 2024-09-19T07:29:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.812+0000 7fed05439740 1 -- 172.21.15.148:0/384226610 shutdown_connections 2024-09-19T07:29:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.812+0000 7fed05439740 1 --2- 172.21.15.148:0/384226610 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eab0994690 0x55eab0996a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.812+0000 7fed05439740 1 --2- 172.21.15.148:0/384226610 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55eab0981500 0x55eab0994150 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.812+0000 7fed05439740 1 --2- 172.21.15.148:0/384226610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55eab0980be0 0x55eab0980fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.812+0000 7fed05439740 1 -- 172.21.15.148:0/384226610 >> 172.21.15.148:0/384226610 conn(0x55eab097d230 msgr2=0x55eab097d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.813+0000 7fed05439740 1 -- 172.21.15.148:0/384226610 shutdown_connections 2024-09-19T07:29:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.813+0000 7fed05439740 1 -- 172.21.15.148:0/384226610 wait complete. 2024-09-19T07:29:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.813+0000 7fed05439740 1 -- start start 2024-09-19T07:29:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.813+0000 7fed05439740 1 Processor -- start 2024-09-19T07:29:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.814+0000 7fed05439740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55eab0980be0 0x55eab098e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.814+0000 7fed05439740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eab0981500 0x55eab098e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.814+0000 7fed05439740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55eab0994690 0x55eab0993e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.814+0000 7fed05439740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55eab0983bd0 con 0x55eab0980be0 2024-09-19T07:29:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.814+0000 7fed05439740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55eab086e290 con 0x55eab0994690 2024-09-19T07:29:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.814+0000 7fed05439740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55eab0983d50 con 0x55eab0981500 2024-09-19T07:29:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.814+0000 7fed05439740 10 client.0 _ll_register_callbacks cb 0x55eab089f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:29:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.814+0000 7fecfbfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55eab0980be0 0x55eab098e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.814+0000 7fecfb7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eab0981500 0x55eab098e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.814+0000 7fecfbfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55eab0980be0 0x55eab098e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39938/0 (socket says 172.21.15.148:39938) 2024-09-19T07:29:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.814+0000 7fecfbfff640 1 -- 172.21.15.148:0/382551469 learned_addr learned my addr 172.21.15.148:0/382551469 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:29:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.814+0000 7fed00b61640 1 --2- 172.21.15.148:0/382551469 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55eab0994690 0x55eab0993e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.814+0000 7fecfbfff640 1 -- 172.21.15.148:0/382551469 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eab0981500 msgr2=0x55eab098e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.814+0000 7fecfbfff640 1 --2- 172.21.15.148:0/382551469 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eab0981500 0x55eab098e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.814+0000 7fecfbfff640 1 -- 172.21.15.148:0/382551469 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55eab0994690 msgr2=0x55eab0993e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.814+0000 7fecfbfff640 1 --2- 172.21.15.148:0/382551469 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55eab0994690 0x55eab0993e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.814+0000 7fecfbfff640 1 -- 172.21.15.148:0/382551469 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eab05f8210 con 0x55eab0980be0 2024-09-19T07:29:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.815+0000 7fecfbfff640 1 --2- 172.21.15.148:0/382551469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55eab0980be0 0x55eab098e160 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fecf0012000 tx=0x7fecf0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d8578127506ded7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.815+0000 7fecdb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:29:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.815+0000 7fecdb7fe640 1 -- 172.21.15.148:0/382551469 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf001eb50 con 0x55eab0980be0 2024-09-19T07:29:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.815+0000 7fecdb7fe640 1 -- 172.21.15.148:0/382551469 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 8600+0+0 (secure 0 0 0) 0x7fecf001ecf0 con 0x55eab0980be0 2024-09-19T07:29:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.815+0000 7fed05439740 1 -- 172.21.15.148:0/382551469 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fece8015070 con 0x55eab0980be0 2024-09-19T07:29:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.816+0000 7fecdb7fe640 1 -- 172.21.15.148:0/382551469 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7fecf0030450 con 0x55eab0980be0 2024-09-19T07:29:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.816+0000 7fed05439740 10 client.17949 fetch_fsmap learned FSMap version 55 2024-09-19T07:29:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.816+0000 7fed05439740 1 -- 172.21.15.148:0/382551469 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x55eab06c4620 con 0x55eab0980be0 2024-09-19T07:29:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.816+0000 7fecdb7fe640 1 -- 172.21.15.148:0/382551469 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fece8015070 con 0x55eab0980be0 2024-09-19T07:29:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.816+0000 7fecdb7fe640 1 -- 172.21.15.148:0/382551469 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 55) ==== 8370+0+0 (secure 0 0 0) 0x7fecf0039750 con 0x55eab0980be0 2024-09-19T07:29:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.816+0000 7fed05439740 10 client.17949 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T07:29:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.816+0000 7fed05439740 10 client.17949 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:29:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.816+0000 7fed05439740 20 client.17949 populate_metadata read hostname 'smithi148' 2024-09-19T07:29:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.816+0000 7fed05439740 1 --2- 172.21.15.148:0/382551469 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55eab09ace40 0x55eab09af250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.816+0000 7fed05439740 4 client.17949 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:29:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.816+0000 7fed05439740 1 -- 172.21.15.148:0/382551469 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eab08f2a20 con 0x55eab09ace40 2024-09-19T07:29:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.816+0000 7fecfb7fe640 1 --2- 172.21.15.148:0/382551469 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55eab09ace40 0x55eab09af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.817+0000 7fecdb7fe640 10 client.17949 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:29:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.817+0000 7fecfb7fe640 1 --2- 172.21.15.148:0/382551469 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55eab09ace40 0x55eab09af250 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14c49cd01d141b14 server_cookie=70118a535edc71d6 in_seq=0 out_seq=0 2024-09-19T07:29:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.818+0000 7fecdb7fe640 1 -- 172.21.15.148:0/382551469 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55eab08f2a20 con 0x55eab09ace40 2024-09-19T07:29:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.818+0000 7fecdb7fe640 10 client.17949 handle_command_reply: tid=0 2024-09-19T07:29:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.818+0000 7fed05439740 1 client.17949 shutdown 2024-09-19T07:29:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.819+0000 7fed05439740 1 -- 172.21.15.148:0/382551469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55eab0980be0 msgr2=0x55eab098e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.819+0000 7fed05439740 1 --2- 172.21.15.148:0/382551469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55eab0980be0 0x55eab098e160 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fecf0012000 tx=0x7fecf0004730 comp rx=0 tx=0).stop 2024-09-19T07:29:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.819+0000 7fed05439740 1 -- 172.21.15.148:0/382551469 shutdown_connections 2024-09-19T07:29:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.819+0000 7fed05439740 1 --2- 172.21.15.148:0/382551469 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55eab09ace40 0x55eab09af250 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.819+0000 7fed05439740 1 --2- 172.21.15.148:0/382551469 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55eab0994690 0x55eab0993e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.819+0000 7fed05439740 1 --2- 172.21.15.148:0/382551469 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eab0981500 0x55eab098e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.819+0000 7fed05439740 1 --2- 172.21.15.148:0/382551469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55eab0980be0 0x55eab098e160 secure :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fecf0012000 tx=0x7fecf0004730 comp rx=0 tx=0).stop 2024-09-19T07:29:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.819+0000 7fed05439740 1 -- 172.21.15.148:0/382551469 >> 172.21.15.148:0/382551469 conn(0x55eab097d230 msgr2=0x55eab0982ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.819+0000 7fecdb7fe640 0 client.17949 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:29:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.819+0000 7fed05439740 1 -- 172.21.15.148:0/382551469 shutdown_connections 2024-09-19T07:29:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.819+0000 7fed05439740 1 -- 172.21.15.148:0/382551469 wait complete. 2024-09-19T07:29:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.820+0000 7fed05439740 20 client.17949 trim_cache size 0 max 16384 2024-09-19T07:29:53.847 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.846+0000 7fed05439740 1 Processor -- start 2024-09-19T07:29:53.847 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.846+0000 7fed05439740 1 -- start start 2024-09-19T07:29:53.847 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.846+0000 7fed05439740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eab0981500 0x55eab097d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:53.847 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.846+0000 7fed05439740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55eab0994690 0x55eab09b4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:53.847 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.846+0000 7fed05439740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55eab09b50a0 0x55eab09c0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:53.848 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.847+0000 7fecfbfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eab0981500 0x55eab097d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:53.848 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.847+0000 7fecfbfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eab0981500 0x55eab097d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:39586/0 (socket says 172.21.15.148:39586) 2024-09-19T07:29:53.848 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.847+0000 7fecfbfff640 1 -- 172.21.15.148:0/503204695 learned_addr learned my addr 172.21.15.148:0/503204695 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:29:53.848 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.847+0000 7fed05439740 1 -- 172.21.15.148:0/503204695 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fecf4141ae0 con 0x55eab09b50a0 2024-09-19T07:29:53.848 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.847+0000 7fed05439740 1 -- 172.21.15.148:0/503204695 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fecf413f2f0 con 0x55eab0994690 2024-09-19T07:29:53.848 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.847+0000 7fed05439740 1 -- 172.21.15.148:0/503204695 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fecf413d160 con 0x55eab0981500 2024-09-19T07:29:53.849 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.847+0000 7fed00b61640 1 --2- 172.21.15.148:0/503204695 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55eab09b50a0 0x55eab09c0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:53.849 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.847+0000 7fecfbfff640 1 -- 172.21.15.148:0/503204695 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55eab0994690 msgr2=0x55eab09b4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:53.849 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.847+0000 7fecfbfff640 1 --2- 172.21.15.148:0/503204695 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55eab0994690 0x55eab09b4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:53.850 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.847+0000 7fecfbfff640 1 -- 172.21.15.148:0/503204695 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55eab09b50a0 msgr2=0x55eab09c0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:53.850 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.847+0000 7fecfbfff640 1 --2- 172.21.15.148:0/503204695 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55eab09b50a0 0x55eab09c0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:53.850 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.847+0000 7fecfbfff640 1 -- 172.21.15.148:0/503204695 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eab0988420 con 0x55eab0981500 2024-09-19T07:29:53.850 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.847+0000 7fecfbfff640 1 --2- 172.21.15.148:0/503204695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eab0981500 0x55eab097d610 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fecf0000c00 tx=0x7fecf0009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30fe73db5ed78581 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:53.850 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.848+0000 7fece5ffb640 1 -- 172.21.15.148:0/503204695 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf0045080 con 0x55eab0981500 2024-09-19T07:29:53.850 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.848+0000 7fece5ffb640 1 -- 172.21.15.148:0/503204695 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecf0011940 con 0x55eab0981500 2024-09-19T07:29:53.850 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.848+0000 7fece5ffb640 1 -- 172.21.15.148:0/503204695 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf001eb60 con 0x55eab0981500 2024-09-19T07:29:53.850 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.849+0000 7fed05439740 1 -- 172.21.15.148:0/503204695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eab0981500 msgr2=0x55eab097d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:53.850 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.849+0000 7fed05439740 1 --2- 172.21.15.148:0/503204695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eab0981500 0x55eab097d610 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fecf0000c00 tx=0x7fecf0009260 comp rx=0 tx=0).stop 2024-09-19T07:29:53.851 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.850+0000 7fed05439740 1 -- 172.21.15.148:0/503204695 shutdown_connections 2024-09-19T07:29:53.851 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.850+0000 7fed05439740 1 --2- 172.21.15.148:0/503204695 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55eab09b50a0 0x55eab09c0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:53.851 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.850+0000 7fed05439740 1 --2- 172.21.15.148:0/503204695 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55eab0994690 0x55eab09b4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:53.852 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.850+0000 7fed05439740 1 --2- 172.21.15.148:0/503204695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eab0981500 0x55eab097d610 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:53.852 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.850+0000 7fed05439740 1 -- 172.21.15.148:0/503204695 >> 172.21.15.148:0/503204695 conn(0x55eab097d230 msgr2=0x55eab097c280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:53.852 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.850+0000 7fed05439740 1 -- 172.21.15.148:0/503204695 shutdown_connections 2024-09-19T07:29:53.852 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.850+0000 7fed05439740 1 -- 172.21.15.148:0/503204695 wait complete. 2024-09-19T07:29:53.852 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.851+0000 7fed05439740 1 -- start start 2024-09-19T07:29:53.852 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.851+0000 7fed05439740 1 Processor -- start 2024-09-19T07:29:53.856 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.852+0000 7fed05439740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55eab0981500 0x55eab09c0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:53.857 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.852+0000 7fed05439740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55eab0994690 0x55eab09c0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:53.857 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.852+0000 7fecfbfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55eab0981500 0x55eab09c0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:53.857 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.852+0000 7fecfbfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55eab0981500 0x55eab09c0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39960/0 (socket says 172.21.15.148:39960) 2024-09-19T07:29:53.857 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.852+0000 7fecfbfff640 1 -- 172.21.15.148:0/2171921547 learned_addr learned my addr 172.21.15.148:0/2171921547 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:29:53.857 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.852+0000 7fed05439740 1 --2- 172.21.15.148:0/2171921547 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eab09b50a0 0x55eab09bd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:53.857 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.852+0000 7fecfb7fe640 1 --2- 172.21.15.148:0/2171921547 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55eab0994690 0x55eab09c0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:53.858 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.852+0000 7fed05439740 1 -- 172.21.15.148:0/2171921547 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fecf413d7b0 con 0x55eab0981500 2024-09-19T07:29:53.858 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.852+0000 7fed00b61640 1 --2- 172.21.15.148:0/2171921547 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eab09b50a0 0x55eab09bd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:53.858 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.853+0000 7fed05439740 1 -- 172.21.15.148:0/2171921547 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fecf413ec20 con 0x55eab0994690 2024-09-19T07:29:53.858 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.853+0000 7fed05439740 1 -- 172.21.15.148:0/2171921547 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fecf413de80 con 0x55eab09b50a0 2024-09-19T07:29:53.858 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.853+0000 7fed05439740 10 client.0 _ll_register_callbacks cb 0x7fecf0011be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:29:53.858 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.853+0000 7fecfbfff640 1 -- 172.21.15.148:0/2171921547 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eab09b50a0 msgr2=0x55eab09bd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:53.858 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.853+0000 7fecfbfff640 1 --2- 172.21.15.148:0/2171921547 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eab09b50a0 0x55eab09bd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:53.859 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.853+0000 7fecfbfff640 1 -- 172.21.15.148:0/2171921547 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55eab0994690 msgr2=0x55eab09c0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:53.859 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.853+0000 7fecfbfff640 1 --2- 172.21.15.148:0/2171921547 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55eab0994690 0x55eab09c0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:53.859 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.853+0000 7fecfbfff640 1 -- 172.21.15.148:0/2171921547 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eab09bdef0 con 0x55eab0981500 2024-09-19T07:29:53.859 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.854+0000 7fecfbfff640 1 --2- 172.21.15.148:0/2171921547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55eab0981500 0x55eab09c0a80 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fecf0039d60 tx=0x7fecf0004550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9559924301bef51b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:53.859 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.854+0000 7fecdb7fe640 10 client.17955 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-19T07:29:53.859 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.854+0000 7fed05439740 1 -- 172.21.15.148:0/2171921547 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fecf0011940 con 0x55eab0981500 2024-09-19T07:29:53.859 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.854+0000 7fecdb7fe640 1 -- 172.21.15.148:0/2171921547 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf0057060 con 0x55eab0981500 2024-09-19T07:29:53.860 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.854+0000 7fecdb7fe640 1 -- 172.21.15.148:0/2171921547 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 8600+0+0 (secure 0 0 0) 0x7fecf0005030 con 0x55eab0981500 2024-09-19T07:29:53.860 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.854+0000 7fecdb7fe640 1 -- 172.21.15.148:0/2171921547 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7fecf0039940 con 0x55eab0981500 2024-09-19T07:29:53.860 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.854+0000 7fed05439740 10 client.17955 fetch_fsmap learned FSMap version 55 2024-09-19T07:29:53.860 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.854+0000 7fed05439740 1 -- 172.21.15.148:0/2171921547 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({fsmap=55}) -- 0x55eab0a181d0 con 0x55eab0981500 2024-09-19T07:29:53.860 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.855+0000 7fecdb7fe640 1 -- 172.21.15.148:0/2171921547 <== mon.0 v2:172.21.15.148:3300/0 4 ==== fsmap(e 55) ==== 8370+0+0 (secure 0 0 0) 0x7fecf0005230 con 0x55eab0981500 2024-09-19T07:29:53.860 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.855+0000 7fed05439740 10 client.17955 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T07:29:53.860 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.855+0000 7fed05439740 10 client.17955 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T07:29:53.861 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.855+0000 7fed05439740 20 client.17955 populate_metadata read hostname 'smithi148' 2024-09-19T07:29:53.861 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.855+0000 7fed05439740 1 --2- 172.21.15.148:0/2171921547 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55eab0a18640 0x55eab0a1aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:53.861 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.855+0000 7fed05439740 4 client.17955 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:29:53.861 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.855+0000 7fed05439740 1 -- 172.21.15.148:0/2171921547 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fecf0011940 con 0x55eab0a18640 2024-09-19T07:29:53.861 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.855+0000 7fecfb7fe640 1 --2- 172.21.15.148:0/2171921547 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55eab0a18640 0x55eab0a1aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:53.861 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.856+0000 7fecfb7fe640 1 --2- 172.21.15.148:0/2171921547 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55eab0a18640 0x55eab0a1aa60 crc :-1 s=READY pgs=292 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2432ae19e5be084c server_cookie=3ff8030ee7425440 in_seq=0 out_seq=0 2024-09-19T07:29:53.861 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.856+0000 7fecdb7fe640 10 client.17955 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:29:53.909 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.908+0000 7fecdb7fe640 1 -- 172.21.15.148:0/2171921547 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fecf0011940 con 0x55eab0a18640 2024-09-19T07:29:53.909 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.908+0000 7fecdb7fe640 10 client.17955 handle_command_reply: tid=0 2024-09-19T07:29:53.910 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.908+0000 7fed05439740 1 client.17955 shutdown 2024-09-19T07:29:53.910 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.909+0000 7fed05439740 1 -- 172.21.15.148:0/2171921547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55eab0981500 msgr2=0x55eab09c0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:53.910 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.909+0000 7fed05439740 1 --2- 172.21.15.148:0/2171921547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55eab0981500 0x55eab09c0a80 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fecf0039d60 tx=0x7fecf0004550 comp rx=0 tx=0).stop 2024-09-19T07:29:53.911 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.909+0000 7fed05439740 1 -- 172.21.15.148:0/2171921547 shutdown_connections 2024-09-19T07:29:53.911 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.909+0000 7fed05439740 1 --2- 172.21.15.148:0/2171921547 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55eab0a18640 0x55eab0a1aa60 crc :-1 s=READY pgs=292 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:53.911 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.910+0000 7fecdb7fe640 0 client.17955 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:29:53.912 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.910+0000 7fed05439740 1 --2- 172.21.15.148:0/2171921547 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eab09b50a0 0x55eab09bd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:53.912 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.910+0000 7fed05439740 1 --2- 172.21.15.148:0/2171921547 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55eab0994690 0x55eab09c0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:53.912 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.910+0000 7fed05439740 1 --2- 172.21.15.148:0/2171921547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55eab0981500 0x55eab09c0a80 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:53.912 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.910+0000 7fed05439740 1 -- 172.21.15.148:0/2171921547 >> 172.21.15.148:0/2171921547 conn(0x55eab097d230 msgr2=0x55eab0982690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:53.912 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.910+0000 7fed05439740 1 -- 172.21.15.148:0/2171921547 shutdown_connections 2024-09-19T07:29:53.912 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.910+0000 7fed05439740 1 -- 172.21.15.148:0/2171921547 wait complete. 2024-09-19T07:29:53.912 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.910+0000 7fed05439740 20 client.17955 trim_cache size 0 max 16384 2024-09-19T07:29:53.913 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:{ 2024-09-19T07:29:53.913 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "message": "", 2024-09-19T07:29:53.913 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout: "return_code": 0 2024-09-19T07:29:53.913 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stdout:} 2024-09-19T07:29:53.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.911+0000 7fed01362640 1 -- 172.21.15.148:0/1244670970 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fecec0a79a0 msgr2=0x7fecec0a9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:53.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.911+0000 7fed01362640 1 --2- 172.21.15.148:0/1244670970 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fecec0a79a0 0x7fecec0a9e60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fecf0009b60 tx=0x7fecf0005f90 comp rx=0 tx=0).stop 2024-09-19T07:29:53.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.911+0000 7fed01362640 1 -- 172.21.15.148:0/1244670970 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fecf412d4c0 msgr2=0x7fecf412d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:53.914 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.911+0000 7fed01362640 1 --2- 172.21.15.148:0/1244670970 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fecf412d4c0 0x7fecf412d970 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fecfc065360 tx=0x7fecfc06b730 comp rx=0 tx=0).stop 2024-09-19T07:29:53.915 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.912+0000 7fed01362640 1 -- 172.21.15.148:0/1244670970 shutdown_connections 2024-09-19T07:29:53.915 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.912+0000 7fed01362640 1 --2- 172.21.15.148:0/1244670970 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fecec0a79a0 0x7fecec0a9e60 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:53.915 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.912+0000 7fed01362640 1 --2- 172.21.15.148:0/1244670970 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fecf412d4c0 0x7fecf412d970 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:53.915 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.912+0000 7fed01362640 1 --2- 172.21.15.148:0/1244670970 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fecf4099880 0x7fecf412a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:53.915 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.912+0000 7fed01362640 1 --2- 172.21.15.148:0/1244670970 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fecf4094b70 0x7fecf4129cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:53.915 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.912+0000 7fed01362640 1 -- 172.21.15.148:0/1244670970 >> 172.21.15.148:0/1244670970 conn(0x7fecf400a1e0 msgr2=0x7fecf40983a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:53.915 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.912+0000 7fed01362640 1 -- 172.21.15.148:0/1244670970 shutdown_connections 2024-09-19T07:29:53.915 INFO:teuthology.task.background_exec.ubuntu@smithi148.front.sepia.ceph.com.smithi148.stderr:2024-09-19T07:29:53.912+0000 7fed01362640 1 -- 172.21.15.148:0/1244670970 wait complete. 2024-09-19T07:29:54.130 INFO:tasks.workunit:Stopping ['suites/blogbench.sh'] on client.0... 2024-09-19T07:29:54.130 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-19T07:29:54.593 DEBUG:teuthology.parallel:result is None 2024-09-19T07:29:54.594 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T07:29:54.647 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T07:29:54.647 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-09-19T07:29:54.659 INFO:tasks.quiescer:joining Quiescers 2024-09-19T07:29:54.659 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-09-19T07:29:54.659 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:29:55.048 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:29:55.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:29:54 smithi148 ceph-mon[31180]: pgmap v592: 97 pgs: 13 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 58 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 112 op/s 2024-09-19T07:29:55.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:29:54 smithi165 ceph-mon[35326]: pgmap v592: 97 pgs: 13 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 58 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 112 op/s 2024-09-19T07:29:55.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:29:54 smithi179 ceph-mon[35716]: pgmap v592: 97 pgs: 13 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 58 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 112 op/s 2024-09-19T07:29:55.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:55.761+0000 7f98c0812640 1 -- 172.21.15.148:0/131774813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f98bc11b140 msgr2=0x7f98bc11d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:55.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:55.761+0000 7f98c0812640 1 --2- 172.21.15.148:0/131774813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f98bc11b140 0x7f98bc11d530 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f98b4009ca0 tx=0x7f98b402a8d0 comp rx=0 tx=0).stop 2024-09-19T07:29:55.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:55.762+0000 7f98c0812640 1 -- 172.21.15.148:0/131774813 shutdown_connections 2024-09-19T07:29:55.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:55.762+0000 7f98c0812640 1 --2- 172.21.15.148:0/131774813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f98bc11b140 0x7f98bc11d530 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:55.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:55.762+0000 7f98c0812640 1 --2- 172.21.15.148:0/131774813 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f98bc06ea30 0x7f98bc06ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:55.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:55.762+0000 7f98c0812640 1 --2- 172.21.15.148:0/131774813 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98bc110190 0x7f98bc06e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:55.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:55.762+0000 7f98c0812640 1 -- 172.21.15.148:0/131774813 >> 172.21.15.148:0/131774813 conn(0x7f98bc073180 msgr2=0x7f98bc073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:55.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:55.764+0000 7f98c0812640 1 -- 172.21.15.148:0/131774813 shutdown_connections 2024-09-19T07:29:55.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:55.764+0000 7f98c0812640 1 -- 172.21.15.148:0/131774813 wait complete. 2024-09-19T07:29:55.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:55.765+0000 7f98c0812640 1 Processor -- start 2024-09-19T07:29:55.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:55.765+0000 7f98c0812640 1 -- start start 2024-09-19T07:29:55.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:55.765+0000 7f98c0812640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f98bc110190 0x7f98bc118880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:55.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:55.765+0000 7f98c0812640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98bc11b140 0x7f98bc111910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:55.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:55.765+0000 7f98c0812640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f98bc111e50 0x7f98bc112300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:55.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:55.765+0000 7f98c0812640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f98bc120bf0 con 0x7f98bc110190 2024-09-19T07:29:55.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:55.765+0000 7f98c0812640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f98bc120a70 con 0x7f98bc111e50 2024-09-19T07:29:55.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:55.765+0000 7f98c0812640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f98bc120d70 con 0x7f98bc11b140 2024-09-19T07:29:55.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:55.766+0000 7f98baffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98bc11b140 0x7f98bc111910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:55.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:55.766+0000 7f98baffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98bc11b140 0x7f98bc111910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:56780/0 (socket says 172.21.15.148:56780) 2024-09-19T07:29:55.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:55.766+0000 7f98baffd640 1 -- 172.21.15.148:0/1074650899 learned_addr learned my addr 172.21.15.148:0/1074650899 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:29:55.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:55.766+0000 7f98bbfff640 1 --2- 172.21.15.148:0/1074650899 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f98bc111e50 0x7f98bc112300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:55.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:55.766+0000 7f98baffd640 1 -- 172.21.15.148:0/1074650899 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f98bc111e50 msgr2=0x7f98bc112300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:55.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:55.766+0000 7f98baffd640 1 --2- 172.21.15.148:0/1074650899 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f98bc111e50 0x7f98bc112300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:55.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:55.766+0000 7f98baffd640 1 -- 172.21.15.148:0/1074650899 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f98bc110190 msgr2=0x7f98bc118880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:55.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:55.766+0000 7f98baffd640 1 --2- 172.21.15.148:0/1074650899 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f98bc110190 0x7f98bc118880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:55.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:55.766+0000 7f98baffd640 1 -- 172.21.15.148:0/1074650899 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98bc1163e0 con 0x7f98bc11b140 2024-09-19T07:29:55.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:55.767+0000 7f98baffd640 1 --2- 172.21.15.148:0/1074650899 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98bc11b140 0x7f98bc111910 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f98ac006fd0 tx=0x7f98ac00b890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:55.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:55.767+0000 7f98b8ff9640 1 -- 172.21.15.148:0/1074650899 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98ac015020 con 0x7f98bc11b140 2024-09-19T07:29:55.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:55.767+0000 7f98c0812640 1 -- 172.21.15.148:0/1074650899 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98bc1166d0 con 0x7f98bc11b140 2024-09-19T07:29:55.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:55.767+0000 7f98c0812640 1 -- 172.21.15.148:0/1074650899 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98bc116c10 con 0x7f98bc11b140 2024-09-19T07:29:55.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:55.767+0000 7f98b8ff9640 1 -- 172.21.15.148:0/1074650899 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98ac011d10 con 0x7f98bc11b140 2024-09-19T07:29:55.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:55.767+0000 7f98b8ff9640 1 -- 172.21.15.148:0/1074650899 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98ac00f2e0 con 0x7f98bc11b140 2024-09-19T07:29:55.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:55.769+0000 7f98c0812640 1 -- 172.21.15.148:0/1074650899 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98a8005290 con 0x7f98bc11b140 2024-09-19T07:29:55.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:55.771+0000 7f98b8ff9640 1 -- 172.21.15.148:0/1074650899 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f98ac018020 con 0x7f98bc11b140 2024-09-19T07:29:55.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:55.772+0000 7f98b8ff9640 1 --2- 172.21.15.148:0/1074650899 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f98a40a3540 0x7f98a40a5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:55.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:55.772+0000 7f98bb7fe640 1 --2- 172.21.15.148:0/1074650899 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f98a40a3540 0x7f98a40a5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:55.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:55.773+0000 7f98b8ff9640 1 -- 172.21.15.148:0/1074650899 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8600+0+0 (secure 0 0 0) 0x7f98ac0cf3c0 con 0x7f98bc11b140 2024-09-19T07:29:55.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:55.773+0000 7f98bb7fe640 1 --2- 172.21.15.148:0/1074650899 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f98a40a3540 0x7f98a40a5a00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f98b00058c0 tx=0x7f98b0005850 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:55.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:55.777+0000 7f98b8ff9640 1 -- 172.21.15.148:0/1074650899 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f98ac01f020 con 0x7f98bc11b140 2024-09-19T07:29:56.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:56.154+0000 7f98c0812640 1 -- 172.21.15.148:0/1074650899 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f98a8005850 con 0x7f98bc11b140 2024-09-19T07:29:56.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:56.154+0000 7f98b8ff9640 1 -- 172.21.15.148:0/1074650899 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+11947 (secure 0 0 0) 0x7f98ac09be00 con 0x7f98bc11b140 2024-09-19T07:29:56.155 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:29:56.156 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":55,"btime":"2024-09-19T07:26:06:767218+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/4263868576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":4263868576},{"type":"v1","addr":"172.21.15.148:6841","nonce":4263868576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":25606,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3891676893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3891676893},{"type":"v1","addr":"172.21.15.179:6835","nonce":3891676893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":55,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:09:19.543369+0000","modified":"2024-09-19T07:26:06.157910+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24457,"mds_1":24437,"mds_2":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":75,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":71,"addr":"172.21.15.165:6839/3993490234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":3993490234},{"type":"v1","addr":"172.21.15.165:6839","nonce":3993490234}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25823":{"gid":25823,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6835/380886107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":380886107},{"type":"v1","addr":"172.21.15.165:6835","nonce":380886107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24457,"qdb_cluster":[24457,24437,24436]},"id":1}]} 2024-09-19T07:29:56.156 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 55 2024-09-19T07:29:56.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:56.158+0000 7f98c0812640 1 -- 172.21.15.148:0/1074650899 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f98a40a3540 msgr2=0x7f98a40a5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:56.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:56.158+0000 7f98c0812640 1 --2- 172.21.15.148:0/1074650899 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f98a40a3540 0x7f98a40a5a00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f98b00058c0 tx=0x7f98b0005850 comp rx=0 tx=0).stop 2024-09-19T07:29:56.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:56.158+0000 7f98c0812640 1 -- 172.21.15.148:0/1074650899 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98bc11b140 msgr2=0x7f98bc111910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:56.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:56.158+0000 7f98c0812640 1 --2- 172.21.15.148:0/1074650899 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98bc11b140 0x7f98bc111910 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f98ac006fd0 tx=0x7f98ac00b890 comp rx=0 tx=0).stop 2024-09-19T07:29:56.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:56.159+0000 7f98c0812640 1 -- 172.21.15.148:0/1074650899 shutdown_connections 2024-09-19T07:29:56.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:56.159+0000 7f98c0812640 1 --2- 172.21.15.148:0/1074650899 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f98a40a3540 0x7f98a40a5a00 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:56.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:56.159+0000 7f98c0812640 1 --2- 172.21.15.148:0/1074650899 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f98bc111e50 0x7f98bc112300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:56.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:56.159+0000 7f98c0812640 1 --2- 172.21.15.148:0/1074650899 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f98bc11b140 0x7f98bc111910 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:56.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:56.159+0000 7f98c0812640 1 --2- 172.21.15.148:0/1074650899 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f98bc110190 0x7f98bc118880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:56.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:56.159+0000 7f98c0812640 1 -- 172.21.15.148:0/1074650899 >> 172.21.15.148:0/1074650899 conn(0x7f98bc073180 msgr2=0x7f98bc1194b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:56.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:56.159+0000 7f98c0812640 1 -- 172.21.15.148:0/1074650899 shutdown_connections 2024-09-19T07:29:56.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:56.159+0000 7f98c0812640 1 -- 172.21.15.148:0/1074650899 wait complete. 2024-09-19T07:29:56.987 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24457 quiesce db --cancel --all' 2024-09-19T07:29:56.987 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24457 quiesce db --cancel --all 2024-09-19T07:29:57.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:29:56 smithi148 ceph-mon[31180]: pgmap v593: 97 pgs: 10 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 70 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 159 op/s 2024-09-19T07:29:57.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:29:56 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/1074650899' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:29:57.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:29:56 smithi165 ceph-mon[35326]: pgmap v593: 97 pgs: 10 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 70 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 159 op/s 2024-09-19T07:29:57.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:29:56 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/1074650899' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:29:57.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:29:56 smithi179 ceph-mon[35716]: pgmap v593: 97 pgs: 10 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 70 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 159 op/s 2024-09-19T07:29:57.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:29:56 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/1074650899' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:29:57.385 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:29:57.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:57.994+0000 7f7798aa8640 1 -- 172.21.15.148:0/1527283523 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7794100e20 msgr2=0x7f7794101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:57.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:57.994+0000 7f7798aa8640 1 --2- 172.21.15.148:0/1527283523 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7794100e20 0x7f7794101200 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f778c00b880 tx=0x7f778c005f90 comp rx=0 tx=0).stop 2024-09-19T07:29:57.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:57.995+0000 7f7798aa8640 1 -- 172.21.15.148:0/1527283523 shutdown_connections 2024-09-19T07:29:57.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:57.995+0000 7f7798aa8640 1 --2- 172.21.15.148:0/1527283523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7794102ef0 0x7f779410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:57.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:57.995+0000 7f7798aa8640 1 --2- 172.21.15.148:0/1527283523 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7794102570 0x7f77941029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:57.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:57.995+0000 7f7798aa8640 1 --2- 172.21.15.148:0/1527283523 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7794100e20 0x7f7794101200 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:57.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:57.995+0000 7f7798aa8640 1 -- 172.21.15.148:0/1527283523 >> 172.21.15.148:0/1527283523 conn(0x7f77940fc7d0 msgr2=0x7f77940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:57.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:57.995+0000 7f7798aa8640 1 -- 172.21.15.148:0/1527283523 shutdown_connections 2024-09-19T07:29:57.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:57.995+0000 7f7798aa8640 1 -- 172.21.15.148:0/1527283523 wait complete. 2024-09-19T07:29:57.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:57.996+0000 7f7798aa8640 1 Processor -- start 2024-09-19T07:29:57.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:57.996+0000 7f7798aa8640 1 -- start start 2024-09-19T07:29:57.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:57.996+0000 7f7798aa8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7794100e20 0x7f779419d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:57.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:57.996+0000 7f7798aa8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7794102570 0x7f77941953c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:57.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:57.996+0000 7f7798aa8640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7794102ef0 0x7f7794195900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:57.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:57.996+0000 7f7798aa8640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f779410fe80 con 0x7f7794100e20 2024-09-19T07:29:57.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:57.996+0000 7f7798aa8640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f779410fd00 con 0x7f7794102ef0 2024-09-19T07:29:57.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:57.996+0000 7f7798aa8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7794110000 con 0x7f7794102570 2024-09-19T07:29:57.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:57.997+0000 7f779259c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7794100e20 0x7f779419d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:57.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:57.997+0000 7f779259c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7794100e20 0x7f779419d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54106/0 (socket says 172.21.15.148:54106) 2024-09-19T07:29:57.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:57.997+0000 7f779259c640 1 -- 172.21.15.148:0/4082593911 learned_addr learned my addr 172.21.15.148:0/4082593911 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:29:57.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:57.997+0000 7f7791d9b640 1 --2- 172.21.15.148:0/4082593911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7794102570 0x7f77941953c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:57.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:57.997+0000 7f7792d9d640 1 --2- 172.21.15.148:0/4082593911 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7794102ef0 0x7f7794195900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:57.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:57.997+0000 7f7791d9b640 1 -- 172.21.15.148:0/4082593911 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7794102ef0 msgr2=0x7f7794195900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:57.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:57.997+0000 7f7791d9b640 1 --2- 172.21.15.148:0/4082593911 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7794102ef0 0x7f7794195900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:57.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:57.997+0000 7f7791d9b640 1 -- 172.21.15.148:0/4082593911 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7794100e20 msgr2=0x7f779419d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:57.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:57.997+0000 7f7791d9b640 1 --2- 172.21.15.148:0/4082593911 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7794100e20 0x7f779419d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:57.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:57.997+0000 7f7791d9b640 1 -- 172.21.15.148:0/4082593911 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7794196120 con 0x7f7794102570 2024-09-19T07:29:58.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:57.998+0000 7f7791d9b640 1 --2- 172.21.15.148:0/4082593911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7794102570 0x7f77941953c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f778400ef60 tx=0x7f778400ef90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:58.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:57.998+0000 7f77837fe640 1 -- 172.21.15.148:0/4082593911 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778401b070 con 0x7f7794102570 2024-09-19T07:29:58.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:57.998+0000 7f77837fe640 1 -- 172.21.15.148:0/4082593911 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f778400ba50 con 0x7f7794102570 2024-09-19T07:29:58.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:57.999+0000 7f77837fe640 1 -- 172.21.15.148:0/4082593911 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7784016bd0 con 0x7f7794102570 2024-09-19T07:29:58.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:57.999+0000 7f7798aa8640 1 -- 172.21.15.148:0/4082593911 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77941b38e0 con 0x7f7794102570 2024-09-19T07:29:58.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:57.999+0000 7f7798aa8640 1 -- 172.21.15.148:0/4082593911 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77941b3da0 con 0x7f7794102570 2024-09-19T07:29:58.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.003+0000 7f77837fe640 1 -- 172.21.15.148:0/4082593911 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f778400bc00 con 0x7f7794102570 2024-09-19T07:29:58.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.005+0000 7f77837fe640 1 --2- 172.21.15.148:0/4082593911 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f777c0a34b0 0x7f777c0a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:58.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.005+0000 7f779259c640 1 --2- 172.21.15.148:0/4082593911 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f777c0a34b0 0x7f777c0a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:58.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.005+0000 7f77837fe640 1 -- 172.21.15.148:0/4082593911 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8600+0+0 (secure 0 0 0) 0x7f77840cff70 con 0x7f7794102570 2024-09-19T07:29:58.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.006+0000 7f779259c640 1 --2- 172.21.15.148:0/4082593911 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f777c0a34b0 0x7f777c0a5970 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f778c000c00 tx=0x7f778c0056f0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:58.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.008+0000 7f779ae81740 1 Processor -- start 2024-09-19T07:29:58.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.008+0000 7f779ae81740 1 -- start start 2024-09-19T07:29:58.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.009+0000 7f779ae81740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55983cb79a00 0x55983cb79de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:58.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.009+0000 7f779ae81740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55983cb7a320 0x55983cb846a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:58.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.009+0000 7f779ae81740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55983cb84be0 0x55983cb86fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:58.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.009+0000 7f779ae81740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55983cade200 con 0x55983cb79a00 2024-09-19T07:29:58.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.009+0000 7f779ae81740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55983ca84dc0 con 0x55983cb84be0 2024-09-19T07:29:58.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.009+0000 7f779ae81740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55983cada1c0 con 0x55983cb7a320 2024-09-19T07:29:58.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.009+0000 7f7791d9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55983cb7a320 0x55983cb846a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:58.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.009+0000 7f7791d9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55983cb7a320 0x55983cb846a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:56802/0 (socket says 172.21.15.148:56802) 2024-09-19T07:29:58.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.009+0000 7f7791d9b640 1 -- 172.21.15.148:0/3956184697 learned_addr learned my addr 172.21.15.148:0/3956184697 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:29:58.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.009+0000 7f7792d9d640 1 --2- 172.21.15.148:0/3956184697 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55983cb84be0 0x55983cb86fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:58.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.009+0000 7f779259c640 1 --2- 172.21.15.148:0/3956184697 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55983cb79a00 0x55983cb79de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:58.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.010+0000 7f7791d9b640 1 -- 172.21.15.148:0/3956184697 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55983cb84be0 msgr2=0x55983cb86fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:58.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.010+0000 7f7791d9b640 1 --2- 172.21.15.148:0/3956184697 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55983cb84be0 0x55983cb86fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:58.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.010+0000 7f7791d9b640 1 -- 172.21.15.148:0/3956184697 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55983cb79a00 msgr2=0x55983cb79de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:58.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.010+0000 7f7791d9b640 1 --2- 172.21.15.148:0/3956184697 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55983cb79a00 0x55983cb79de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:58.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.010+0000 7f7791d9b640 1 -- 172.21.15.148:0/3956184697 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55983c84f620 con 0x55983cb7a320 2024-09-19T07:29:58.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.010+0000 7f7792d9d640 1 --2- 172.21.15.148:0/3956184697 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55983cb84be0 0x55983cb86fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:29:58.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.010+0000 7f7791d9b640 1 --2- 172.21.15.148:0/3956184697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55983cb7a320 0x55983cb846a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7784098600 tx=0x7f778409c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fc82c435e852154 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:58.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.010+0000 7f7780ff9640 1 -- 172.21.15.148:0/3956184697 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77840a4e10 con 0x55983cb7a320 2024-09-19T07:29:58.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.010+0000 7f7780ff9640 1 -- 172.21.15.148:0/3956184697 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7784098810 con 0x55983cb7a320 2024-09-19T07:29:58.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.010+0000 7f7780ff9640 1 -- 172.21.15.148:0/3956184697 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77840cda90 con 0x55983cb7a320 2024-09-19T07:29:58.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.011+0000 7f779ae81740 1 -- 172.21.15.148:0/3956184697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55983cb7a320 msgr2=0x55983cb846a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:58.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.011+0000 7f779ae81740 1 --2- 172.21.15.148:0/3956184697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55983cb7a320 0x55983cb846a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7784098600 tx=0x7f778409c8a0 comp rx=0 tx=0).stop 2024-09-19T07:29:58.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.011+0000 7f779ae81740 1 -- 172.21.15.148:0/3956184697 shutdown_connections 2024-09-19T07:29:58.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.011+0000 7f779ae81740 1 --2- 172.21.15.148:0/3956184697 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55983cb84be0 0x55983cb86fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:58.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.011+0000 7f779ae81740 1 --2- 172.21.15.148:0/3956184697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55983cb7a320 0x55983cb846a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:58.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.011+0000 7f779ae81740 1 --2- 172.21.15.148:0/3956184697 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55983cb79a00 0x55983cb79de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:58.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.011+0000 7f779ae81740 1 -- 172.21.15.148:0/3956184697 >> 172.21.15.148:0/3956184697 conn(0x55983cb75f90 msgr2=0x55983cb76370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:58.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.011+0000 7f779ae81740 1 -- 172.21.15.148:0/3956184697 shutdown_connections 2024-09-19T07:29:58.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.012+0000 7f779ae81740 1 -- 172.21.15.148:0/3956184697 wait complete. 2024-09-19T07:29:58.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.012+0000 7f779ae81740 1 -- start start 2024-09-19T07:29:58.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.012+0000 7f779ae81740 1 Processor -- start 2024-09-19T07:29:58.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.013+0000 7f779ae81740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55983cb79a00 0x55983cb844e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:58.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.013+0000 7f779ae81740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55983cb7a320 0x55983cb81790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:58.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.013+0000 7f779ae81740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55983cb84be0 0x55983cb81cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:58.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.013+0000 7f7791d9b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55983cb7a320 0x55983cb81790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:58.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.013+0000 7f7791d9b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55983cb7a320 0x55983cb81790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:59372/0 (socket says 172.21.15.148:59372) 2024-09-19T07:29:58.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.013+0000 7f7791d9b640 1 -- 172.21.15.148:0/2852043744 learned_addr learned my addr 172.21.15.148:0/2852043744 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:29:58.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.013+0000 7f779ae81740 1 -- 172.21.15.148:0/2852043744 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55983cb877b0 con 0x55983cb79a00 2024-09-19T07:29:58.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.013+0000 7f7792d9d640 1 --2- 172.21.15.148:0/2852043744 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55983cb84be0 0x55983cb81cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:58.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.013+0000 7f779ae81740 1 -- 172.21.15.148:0/2852043744 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55983ca78c50 con 0x55983cb7a320 2024-09-19T07:29:58.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.013+0000 7f779ae81740 1 -- 172.21.15.148:0/2852043744 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55983cb87930 con 0x55983cb84be0 2024-09-19T07:29:58.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.013+0000 7f779259c640 1 --2- 172.21.15.148:0/2852043744 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55983cb79a00 0x55983cb844e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:58.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.014+0000 7f779ae81740 10 client.0 _ll_register_callbacks cb 0x55983ca8aba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:29:58.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.014+0000 7f7791d9b640 1 -- 172.21.15.148:0/2852043744 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55983cb84be0 msgr2=0x55983cb81cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:58.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.014+0000 7f7791d9b640 1 --2- 172.21.15.148:0/2852043744 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55983cb84be0 0x55983cb81cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:58.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.014+0000 7f7791d9b640 1 -- 172.21.15.148:0/2852043744 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55983cb79a00 msgr2=0x55983cb844e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:58.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.014+0000 7f7791d9b640 1 --2- 172.21.15.148:0/2852043744 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55983cb79a00 0x55983cb844e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:58.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.014+0000 7f7791d9b640 1 -- 172.21.15.148:0/2852043744 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55983cb82520 con 0x55983cb7a320 2024-09-19T07:29:58.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.014+0000 7f779ae81740 1 -- 172.21.15.148:0/2852043744 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7784098810 con 0x55983cb7a320 2024-09-19T07:29:58.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.014+0000 7f7791d9b640 1 --2- 172.21.15.148:0/2852043744 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55983cb7a320 0x55983cb81790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f778400cc90 tx=0x7f778409b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57b4d42762d6ea7b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:58.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.014+0000 7f7779ffb640 10 client.26957 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-19T07:29:58.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.015+0000 7f7779ffb640 1 -- 172.21.15.148:0/2852043744 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778407f060 con 0x55983cb7a320 2024-09-19T07:29:58.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.015+0000 7f7779ffb640 1 -- 172.21.15.148:0/2852043744 <== mon.2 v2:172.21.15.165:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 8600+0+0 (secure 0 0 0) 0x7f778400b570 con 0x55983cb7a320 2024-09-19T07:29:58.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.015+0000 7f7779ffb640 1 -- 172.21.15.148:0/2852043744 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f77840ba030 con 0x55983cb7a320 2024-09-19T07:29:58.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.015+0000 7f779ae81740 10 client.26957 fetch_fsmap learned FSMap version 55 2024-09-19T07:29:58.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.015+0000 7f779ae81740 1 -- 172.21.15.148:0/2852043744 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({fsmap=55}) -- 0x55983cb877b0 con 0x55983cb7a320 2024-09-19T07:29:58.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.016+0000 7f7779ffb640 1 -- 172.21.15.148:0/2852043744 <== mon.2 v2:172.21.15.165:3300/0 4 ==== fsmap(e 55) ==== 8370+0+0 (secure 0 0 0) 0x7f778400b040 con 0x55983cb7a320 2024-09-19T07:29:58.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.016+0000 7f779ae81740 10 client.26957 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T07:29:58.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.016+0000 7f779ae81740 10 client.26957 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:29:58.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.016+0000 7f779ae81740 20 client.26957 populate_metadata read hostname 'smithi148' 2024-09-19T07:29:58.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.016+0000 7f779ae81740 1 --2- 172.21.15.148:0/2852043744 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55983cb943c0 0x55983cb967b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:58.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.016+0000 7f779ae81740 4 client.26957 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:29:58.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.016+0000 7f779ae81740 1 -- 172.21.15.148:0/2852043744 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55983caeb770 con 0x55983cb943c0 2024-09-19T07:29:58.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.016+0000 7f779259c640 1 --2- 172.21.15.148:0/2852043744 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55983cb943c0 0x55983cb967b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:58.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.017+0000 7f779259c640 1 --2- 172.21.15.148:0/2852043744 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55983cb943c0 0x55983cb967b0 crc :-1 s=READY pgs=293 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba7737a0e7f1cdf server_cookie=3c0f25d09cbba252 in_seq=0 out_seq=0 2024-09-19T07:29:58.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.017+0000 7f7779ffb640 10 client.26957 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:29:58.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.017+0000 7f7779ffb640 1 -- 172.21.15.148:0/2852043744 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55983caeb770 con 0x55983cb943c0 2024-09-19T07:29:58.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.018+0000 7f7779ffb640 10 client.26957 handle_command_reply: tid=0 2024-09-19T07:29:58.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.018+0000 7f779ae81740 1 client.26957 shutdown 2024-09-19T07:29:58.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.018+0000 7f779ae81740 1 -- 172.21.15.148:0/2852043744 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55983cb7a320 msgr2=0x55983cb81790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:58.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.018+0000 7f779ae81740 1 --2- 172.21.15.148:0/2852043744 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55983cb7a320 0x55983cb81790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f778400cc90 tx=0x7f778409b820 comp rx=0 tx=0).stop 2024-09-19T07:29:58.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.018+0000 7f779ae81740 1 -- 172.21.15.148:0/2852043744 shutdown_connections 2024-09-19T07:29:58.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.018+0000 7f779ae81740 1 --2- 172.21.15.148:0/2852043744 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55983cb943c0 0x55983cb967b0 crc :-1 s=READY pgs=293 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:58.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.018+0000 7f779ae81740 1 --2- 172.21.15.148:0/2852043744 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55983cb84be0 0x55983cb81cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:58.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.018+0000 7f779ae81740 1 --2- 172.21.15.148:0/2852043744 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55983cb7a320 0x55983cb81790 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:58.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.018+0000 7f779ae81740 1 --2- 172.21.15.148:0/2852043744 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55983cb79a00 0x55983cb844e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:58.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.018+0000 7f7779ffb640 0 client.26957 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:29:58.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.018+0000 7f779ae81740 1 -- 172.21.15.148:0/2852043744 >> 172.21.15.148:0/2852043744 conn(0x55983cb75f90 msgr2=0x55983cb751d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:58.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.018+0000 7f779ae81740 1 -- 172.21.15.148:0/2852043744 shutdown_connections 2024-09-19T07:29:58.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.018+0000 7f779ae81740 1 -- 172.21.15.148:0/2852043744 wait complete. 2024-09-19T07:29:58.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.019+0000 7f779ae81740 20 client.26957 trim_cache size 0 max 16384 2024-09-19T07:29:58.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.045+0000 7f779ae81740 1 Processor -- start 2024-09-19T07:29:58.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.045+0000 7f779ae81740 1 -- start start 2024-09-19T07:29:58.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.045+0000 7f779ae81740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55983cb75f90 0x55983cb90a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:58.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.045+0000 7f779ae81740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55983cb79a00 0x55983cb80770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:58.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.045+0000 7f779ae81740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55983cb7a320 0x55983cb9bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:58.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.046+0000 7f779ae81740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f77941bf1c0 con 0x55983cb75f90 2024-09-19T07:29:58.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.046+0000 7f779ae81740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f77941bc9d0 con 0x55983cb79a00 2024-09-19T07:29:58.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.046+0000 7f779259c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55983cb75f90 0x55983cb90a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:58.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.046+0000 7f779259c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55983cb75f90 0x55983cb90a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54134/0 (socket says 172.21.15.148:54134) 2024-09-19T07:29:58.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.046+0000 7f779259c640 1 -- 172.21.15.148:0/3887399841 learned_addr learned my addr 172.21.15.148:0/3887399841 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:29:58.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.046+0000 7f7792d9d640 1 --2- 172.21.15.148:0/3887399841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55983cb7a320 0x55983cb9bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:58.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.046+0000 7f779ae81740 1 -- 172.21.15.148:0/3887399841 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f77941ba840 con 0x55983cb7a320 2024-09-19T07:29:58.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.046+0000 7f7792d9d640 1 -- 172.21.15.148:0/3887399841 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55983cb79a00 msgr2=0x55983cb80770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:58.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.046+0000 7f7792d9d640 1 --2- 172.21.15.148:0/3887399841 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55983cb79a00 0x55983cb80770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:58.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.046+0000 7f7792d9d640 1 -- 172.21.15.148:0/3887399841 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55983cb75f90 msgr2=0x55983cb90a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:58.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.046+0000 7f7792d9d640 1 --2- 172.21.15.148:0/3887399841 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55983cb75f90 0x55983cb90a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:58.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.046+0000 7f7792d9d640 1 -- 172.21.15.148:0/3887399841 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55983cae3480 con 0x55983cb7a320 2024-09-19T07:29:58.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.047+0000 7f7792d9d640 1 --2- 172.21.15.148:0/3887399841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55983cb7a320 0x55983cb9bde0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f778800da00 tx=0x7f778800f040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=164f7cec9fe77a66 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:58.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.047+0000 7f777bfff640 1 -- 172.21.15.148:0/3887399841 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778801e030 con 0x55983cb7a320 2024-09-19T07:29:58.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.047+0000 7f777bfff640 1 -- 172.21.15.148:0/3887399841 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7788005500 con 0x55983cb7a320 2024-09-19T07:29:58.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.047+0000 7f777bfff640 1 -- 172.21.15.148:0/3887399841 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7788004d90 con 0x55983cb7a320 2024-09-19T07:29:58.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.048+0000 7f779ae81740 1 -- 172.21.15.148:0/3887399841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55983cb7a320 msgr2=0x55983cb9bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:58.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.048+0000 7f779ae81740 1 --2- 172.21.15.148:0/3887399841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55983cb7a320 0x55983cb9bde0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f778800da00 tx=0x7f778800f040 comp rx=0 tx=0).stop 2024-09-19T07:29:58.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.048+0000 7f779ae81740 1 -- 172.21.15.148:0/3887399841 shutdown_connections 2024-09-19T07:29:58.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.048+0000 7f779ae81740 1 --2- 172.21.15.148:0/3887399841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55983cb7a320 0x55983cb9bde0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:58.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.048+0000 7f779ae81740 1 --2- 172.21.15.148:0/3887399841 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55983cb79a00 0x55983cb80770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:58.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.048+0000 7f779ae81740 1 --2- 172.21.15.148:0/3887399841 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55983cb75f90 0x55983cb90a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:58.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.048+0000 7f779ae81740 1 -- 172.21.15.148:0/3887399841 >> 172.21.15.148:0/3887399841 conn(0x55983cb81e30 msgr2=0x55983cb80060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:58.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.048+0000 7f779ae81740 1 -- 172.21.15.148:0/3887399841 shutdown_connections 2024-09-19T07:29:58.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.048+0000 7f779ae81740 1 -- 172.21.15.148:0/3887399841 wait complete. 2024-09-19T07:29:58.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.049+0000 7f779ae81740 1 -- start start 2024-09-19T07:29:58.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.049+0000 7f779ae81740 1 Processor -- start 2024-09-19T07:29:58.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.049+0000 7f779ae81740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55983cb75f90 0x55983cb7e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:58.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.049+0000 7f779ae81740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55983cb79a00 0x55983cb7ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:58.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.049+0000 7f779ae81740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55983cb7a320 0x55983cb7f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:58.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.049+0000 7f779ae81740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f77941bae90 con 0x55983cb79a00 2024-09-19T07:29:58.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.049+0000 7f779ae81740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f77941bc300 con 0x55983cb7a320 2024-09-19T07:29:58.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.049+0000 7f779ae81740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f77941bb560 con 0x55983cb75f90 2024-09-19T07:29:58.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.049+0000 7f779ae81740 10 client.0 _ll_register_callbacks cb 0x7f779419da50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:29:58.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.050+0000 7f779259c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55983cb75f90 0x55983cb7e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:58.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.050+0000 7f779259c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55983cb75f90 0x55983cb7e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:56812/0 (socket says 172.21.15.148:56812) 2024-09-19T07:29:58.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.050+0000 7f779259c640 1 -- 172.21.15.148:0/55074597 learned_addr learned my addr 172.21.15.148:0/55074597 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:29:58.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.050+0000 7f7791d9b640 1 --2- 172.21.15.148:0/55074597 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55983cb79a00 0x55983cb7ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:58.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.050+0000 7f7792d9d640 1 --2- 172.21.15.148:0/55074597 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55983cb7a320 0x55983cb7f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:58.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.050+0000 7f779259c640 1 -- 172.21.15.148:0/55074597 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55983cb7a320 msgr2=0x55983cb7f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:58.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.050+0000 7f779259c640 1 --2- 172.21.15.148:0/55074597 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55983cb7a320 0x55983cb7f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:58.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.050+0000 7f779259c640 1 -- 172.21.15.148:0/55074597 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55983cb79a00 msgr2=0x55983cb7ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:29:58.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.050+0000 7f779259c640 1 --2- 172.21.15.148:0/55074597 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55983cb79a00 0x55983cb7ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:58.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.050+0000 7f779259c640 1 -- 172.21.15.148:0/55074597 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55983cbfde30 con 0x55983cb75f90 2024-09-19T07:29:58.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.050+0000 7f779259c640 1 --2- 172.21.15.148:0/55074597 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55983cb75f90 0x55983cb7e810 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f778c009340 tx=0x7f778c005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1094c9baee3d53b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:58.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.050+0000 7f7779ffb640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-19T07:29:58.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.051+0000 7f7779ffb640 1 -- 172.21.15.148:0/55074597 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778c057020 con 0x55983cb75f90 2024-09-19T07:29:58.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.051+0000 7f7779ffb640 1 -- 172.21.15.148:0/55074597 <== mon.1 v2:172.21.15.179:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 8600+0+0 (secure 0 0 0) 0x7f778c0323f0 con 0x55983cb75f90 2024-09-19T07:29:58.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.051+0000 7f779ae81740 1 -- 172.21.15.148:0/55074597 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7788005500 con 0x55983cb75f90 2024-09-19T07:29:58.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.051+0000 7f7779ffb640 1 -- 172.21.15.148:0/55074597 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f778c062050 con 0x55983cb75f90 2024-09-19T07:29:58.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.051+0000 7f779ae81740 10 client.27082 fetch_fsmap learned FSMap version 55 2024-09-19T07:29:58.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.051+0000 7f779ae81740 1 -- 172.21.15.148:0/55074597 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x55983cbff130 con 0x55983cb75f90 2024-09-19T07:29:58.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.051+0000 7f7779ffb640 1 -- 172.21.15.148:0/55074597 <== mon.1 v2:172.21.15.179:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7788005500 con 0x55983cb75f90 2024-09-19T07:29:58.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.052+0000 7f7779ffb640 1 -- 172.21.15.148:0/55074597 <== mon.1 v2:172.21.15.179:3300/0 5 ==== fsmap(e 55) ==== 8370+0+0 (secure 0 0 0) 0x7f778c0538e0 con 0x55983cb75f90 2024-09-19T07:29:58.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.052+0000 7f779ae81740 10 client.27082 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T07:29:58.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.052+0000 7f779ae81740 10 client.27082 resolve_mds: validated gid 24457 aka daemon mds.i 2024-09-19T07:29:58.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.052+0000 7f779ae81740 20 client.27082 populate_metadata read hostname 'smithi148' 2024-09-19T07:29:58.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.052+0000 7f779ae81740 1 --2- 172.21.15.148:0/55074597 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55983cb84be0 0x55983cc01940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:58.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.052+0000 7f779ae81740 4 client.27082 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-09-19T07:29:58.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.052+0000 7f779ae81740 1 -- 172.21.15.148:0/55074597 --> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x55983cae5c80 con 0x55983cb84be0 2024-09-19T07:29:58.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.052+0000 7f7791d9b640 1 --2- 172.21.15.148:0/55074597 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55983cb84be0 0x55983cc01940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:58.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.053+0000 7f7791d9b640 1 --2- 172.21.15.148:0/55074597 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55983cb84be0 0x55983cc01940 crc :-1 s=READY pgs=294 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12c3b343914db0e9 server_cookie=db0abc474f767457 in_seq=0 out_seq=0 2024-09-19T07:29:58.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.053+0000 7f7779ffb640 10 client.27082 ms_handle_connect on v2:172.21.15.179:6838/2031305914 2024-09-19T07:29:58.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.053+0000 7f7779ffb640 1 -- 172.21.15.148:0/55074597 <== mds.0 v2:172.21.15.179:6838/2031305914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x55983cae5c80 con 0x55983cb84be0 2024-09-19T07:29:58.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.053+0000 7f7779ffb640 10 client.27082 handle_command_reply: tid=0 2024-09-19T07:29:58.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.053+0000 7f779ae81740 1 client.27082 shutdown 2024-09-19T07:29:58.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.053+0000 7f779ae81740 1 -- 172.21.15.148:0/55074597 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55983cb75f90 msgr2=0x55983cb7e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:58.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.053+0000 7f779ae81740 1 --2- 172.21.15.148:0/55074597 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55983cb75f90 0x55983cb7e810 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f778c009340 tx=0x7f778c005f90 comp rx=0 tx=0).stop 2024-09-19T07:29:58.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.053+0000 7f779ae81740 1 -- 172.21.15.148:0/55074597 shutdown_connections 2024-09-19T07:29:58.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.053+0000 7f779ae81740 1 --2- 172.21.15.148:0/55074597 >> [v2:172.21.15.179:6838/2031305914,v1:172.21.15.179:6839/2031305914] conn(0x55983cb84be0 0x55983cc01940 crc :-1 s=READY pgs=294 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:58.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.053+0000 7f779ae81740 1 --2- 172.21.15.148:0/55074597 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55983cb7a320 0x55983cb7f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:58.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.053+0000 7f7779ffb640 0 client.27082 ms_handle_reset on v2:172.21.15.179:6838/2031305914 2024-09-19T07:29:58.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.053+0000 7f779ae81740 1 --2- 172.21.15.148:0/55074597 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55983cb79a00 0x55983cb7ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:58.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.054+0000 7f779ae81740 1 --2- 172.21.15.148:0/55074597 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55983cb75f90 0x55983cb7e810 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:58.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.054+0000 7f779ae81740 1 -- 172.21.15.148:0/55074597 >> 172.21.15.148:0/55074597 conn(0x55983cb81e30 msgr2=0x55983cb80880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:58.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.054+0000 7f779ae81740 1 -- 172.21.15.148:0/55074597 shutdown_connections 2024-09-19T07:29:58.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.054+0000 7f779ae81740 1 -- 172.21.15.148:0/55074597 wait complete. 2024-09-19T07:29:58.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.054+0000 7f779ae81740 20 client.27082 trim_cache size 0 max 16384 2024-09-19T07:29:58.060 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:29:58.060 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 55, 2024-09-19T07:29:58.060 INFO:teuthology.orchestra.run.smithi148.stdout: "leader": 24457, 2024-09-19T07:29:58.060 INFO:teuthology.orchestra.run.smithi148.stdout: "set_version": 60, 2024-09-19T07:29:58.060 INFO:teuthology.orchestra.run.smithi148.stdout: "sets": {} 2024-09-19T07:29:58.060 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:29:58.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.055+0000 7f7798aa8640 1 -- 172.21.15.148:0/4082593911 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f777c0a34b0 msgr2=0x7f777c0a5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:58.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.055+0000 7f7798aa8640 1 --2- 172.21.15.148:0/4082593911 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f777c0a34b0 0x7f777c0a5970 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f778c000c00 tx=0x7f778c0056f0 comp rx=0 tx=0).stop 2024-09-19T07:29:58.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.055+0000 7f7798aa8640 1 -- 172.21.15.148:0/4082593911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7794102570 msgr2=0x7f77941953c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:58.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.055+0000 7f7798aa8640 1 --2- 172.21.15.148:0/4082593911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7794102570 0x7f77941953c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f778400ef60 tx=0x7f778400ef90 comp rx=0 tx=0).stop 2024-09-19T07:29:58.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.055+0000 7f7798aa8640 1 -- 172.21.15.148:0/4082593911 shutdown_connections 2024-09-19T07:29:58.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.056+0000 7f7798aa8640 1 --2- 172.21.15.148:0/4082593911 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f777c0a34b0 0x7f777c0a5970 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:58.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.056+0000 7f7798aa8640 1 --2- 172.21.15.148:0/4082593911 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7794102ef0 0x7f7794195900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:58.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.056+0000 7f7798aa8640 1 --2- 172.21.15.148:0/4082593911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7794102570 0x7f77941953c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:58.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.056+0000 7f7798aa8640 1 --2- 172.21.15.148:0/4082593911 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7794100e20 0x7f779419d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:58.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.056+0000 7f7798aa8640 1 -- 172.21.15.148:0/4082593911 >> 172.21.15.148:0/4082593911 conn(0x7f77940fc7d0 msgr2=0x7f77940fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:58.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.056+0000 7f7798aa8640 1 -- 172.21.15.148:0/4082593911 shutdown_connections 2024-09-19T07:29:58.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:58.056+0000 7f7798aa8640 1 -- 172.21.15.148:0/4082593911 wait complete. 2024-09-19T07:29:59.033 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:29:58 smithi148 ceph-mon[31180]: pgmap v594: 97 pgs: 9 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 71 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 168 op/s 2024-09-19T07:29:59.080 INFO:tasks.quiescer:done joining Quiescers 2024-09-19T07:29:59.080 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-19T07:29:59.090 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi148.front.sepia.ceph.com 2024-09-19T07:29:59.100 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-19T07:29:59.113 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-19T07:29:59.113 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T07:29:59.113 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi148.front.sepia.ceph.com 2024-09-19T07:29:59.113 DEBUG:teuthology.orchestra.run.smithi148:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-09-19T07:29:59.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:29:58 smithi165 ceph-mon[35326]: pgmap v594: 97 pgs: 9 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 71 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 168 op/s 2024-09-19T07:29:59.180 DEBUG:teuthology.orchestra.run.smithi148:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-09-19T07:29:59.260 DEBUG:teuthology.orchestra.run.smithi148:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-19T07:29:59.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:29:58 smithi179 ceph-mon[35716]: pgmap v594: 97 pgs: 9 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 71 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 168 op/s 2024-09-19T07:29:59.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.449+0000 7fd38e7fc640 1 -- 172.21.15.148:0/1665048669 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3800319b0 con 0x7fd3901010b0 2024-09-19T07:29:59.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.450+0000 7fd395c5a640 1 -- 172.21.15.148:0/1665048669 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3901010b0 msgr2=0x7fd3901014f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:59.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.450+0000 7fd395c5a640 1 --2- 172.21.15.148:0/1665048669 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3901010b0 0x7fd3901014f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd380009930 tx=0x7fd38002a420 comp rx=0 tx=0).stop 2024-09-19T07:29:59.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.450+0000 7fd395c5a640 1 -- 172.21.15.148:0/1665048669 shutdown_connections 2024-09-19T07:29:59.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.450+0000 7fd395c5a640 1 --2- 172.21.15.148:0/1665048669 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd390101a30 0x7fd39010d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:59.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.450+0000 7fd395c5a640 1 --2- 172.21.15.148:0/1665048669 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3901010b0 0x7fd3901014f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:59.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.450+0000 7fd395c5a640 1 --2- 172.21.15.148:0/1665048669 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3901028d0 0x7fd390102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:59.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.450+0000 7fd395c5a640 1 -- 172.21.15.148:0/1665048669 >> 172.21.15.148:0/1665048669 conn(0x7fd3900770f0 msgr2=0x7fd3900fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:59.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.450+0000 7fd395c5a640 1 -- 172.21.15.148:0/1665048669 shutdown_connections 2024-09-19T07:29:59.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.450+0000 7fd395c5a640 1 -- 172.21.15.148:0/1665048669 wait complete. 2024-09-19T07:29:59.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.451+0000 7fd395c5a640 1 Processor -- start 2024-09-19T07:29:59.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.451+0000 7fd395c5a640 1 -- start start 2024-09-19T07:29:59.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.451+0000 7fd395c5a640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3901010b0 0x7fd390195f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:59.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.451+0000 7fd395c5a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd390101a30 0x7fd3901964a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:59.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.452+0000 7fd395c5a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3901028d0 0x7fd39019a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:59.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.452+0000 7fd395c5a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd39010fd90 con 0x7fd3901028d0 2024-09-19T07:29:59.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.452+0000 7fd395c5a640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd39010fc10 con 0x7fd3901010b0 2024-09-19T07:29:59.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.452+0000 7fd395c5a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd39010ff10 con 0x7fd390101a30 2024-09-19T07:29:59.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.452+0000 7fd38effd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd390101a30 0x7fd3901964a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:59.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.452+0000 7fd38effd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd390101a30 0x7fd3901964a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:56838/0 (socket says 172.21.15.148:56838) 2024-09-19T07:29:59.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.452+0000 7fd38effd640 1 -- 172.21.15.148:0/3743794725 learned_addr learned my addr 172.21.15.148:0/3743794725 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:29:59.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.452+0000 7fd38ffff640 1 --2- 172.21.15.148:0/3743794725 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3901028d0 0x7fd39019a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:59.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.452+0000 7fd38f7fe640 1 --2- 172.21.15.148:0/3743794725 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3901010b0 0x7fd390195f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:59.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.452+0000 7fd38effd640 1 -- 172.21.15.148:0/3743794725 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3901010b0 msgr2=0x7fd390195f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:59.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.452+0000 7fd38effd640 1 --2- 172.21.15.148:0/3743794725 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3901010b0 0x7fd390195f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:59.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.452+0000 7fd38effd640 1 -- 172.21.15.148:0/3743794725 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3901028d0 msgr2=0x7fd39019a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:59.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.452+0000 7fd38effd640 1 --2- 172.21.15.148:0/3743794725 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3901028d0 0x7fd39019a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:59.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.452+0000 7fd38effd640 1 -- 172.21.15.148:0/3743794725 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd39019af50 con 0x7fd390101a30 2024-09-19T07:29:59.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.453+0000 7fd38effd640 1 --2- 172.21.15.148:0/3743794725 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd390101a30 0x7fd3901964a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd380009900 tx=0x7fd380030650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:59.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.453+0000 7fd38cff9640 1 -- 172.21.15.148:0/3743794725 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd38003f070 con 0x7fd390101a30 2024-09-19T07:29:59.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.453+0000 7fd38cff9640 1 -- 172.21.15.148:0/3743794725 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd380004460 con 0x7fd390101a30 2024-09-19T07:29:59.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.453+0000 7fd38cff9640 1 -- 172.21.15.148:0/3743794725 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd380035030 con 0x7fd390101a30 2024-09-19T07:29:59.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.453+0000 7fd395c5a640 1 -- 172.21.15.148:0/3743794725 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd39019b240 con 0x7fd390101a30 2024-09-19T07:29:59.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.453+0000 7fd395c5a640 1 -- 172.21.15.148:0/3743794725 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3901a2ad0 con 0x7fd390101a30 2024-09-19T07:29:59.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.456+0000 7fd38cff9640 1 -- 172.21.15.148:0/3743794725 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fd380042070 con 0x7fd390101a30 2024-09-19T07:29:59.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.456+0000 7fd395c5a640 1 -- 172.21.15.148:0/3743794725 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3901972b0 con 0x7fd390101a30 2024-09-19T07:29:59.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.457+0000 7fd38cff9640 1 --2- 172.21.15.148:0/3743794725 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fd3780a3560 0x7fd3780a5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:59.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.457+0000 7fd38cff9640 1 -- 172.21.15.148:0/3743794725 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8600+0+0 (secure 0 0 0) 0x7fd3800f0680 con 0x7fd390101a30 2024-09-19T07:29:59.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.457+0000 7fd38f7fe640 1 --2- 172.21.15.148:0/3743794725 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fd3780a3560 0x7fd3780a5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:59.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.458+0000 7fd38f7fe640 1 --2- 172.21.15.148:0/3743794725 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fd3780a3560 0x7fd3780a5a20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd38400d5c0 tx=0x7fd38400f040 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:59.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.463+0000 7fd38cff9640 1 -- 172.21.15.148:0/3743794725 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd380049030 con 0x7fd390101a30 2024-09-19T07:29:59.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.758+0000 7fd395c5a640 1 -- 172.21.15.148:0/3743794725 --> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7fd390104ca0 con 0x7fd3780a3560 2024-09-19T07:29:59.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.771+0000 7fd38cff9640 1 -- 172.21.15.148:0/3743794725 <== mgr.15123 v2:172.21.15.148:6800/3902535850 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+351 (secure 0 0 0) 0x7fd390104ca0 con 0x7fd3780a3560 2024-09-19T07:29:59.771 INFO:teuthology.orchestra.run.smithi148.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-19T00:00:00", "created": "2024-09-19T07:11:13", "first": "2024-09-19T07:12:00", "last": "2024-09-19T07:29:00", "last_pruned": "2024-09-19T07:29:02", "created_count": 18, "pruned_count": 12, "active": true} 2024-09-19T07:29:59.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.774+0000 7fd395c5a640 1 -- 172.21.15.148:0/3743794725 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fd3780a3560 msgr2=0x7fd3780a5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:59.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.774+0000 7fd395c5a640 1 --2- 172.21.15.148:0/3743794725 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fd3780a3560 0x7fd3780a5a20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd38400d5c0 tx=0x7fd38400f040 comp rx=0 tx=0).stop 2024-09-19T07:29:59.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.774+0000 7fd395c5a640 1 -- 172.21.15.148:0/3743794725 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd390101a30 msgr2=0x7fd3901964a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:59.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.774+0000 7fd395c5a640 1 --2- 172.21.15.148:0/3743794725 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd390101a30 0x7fd3901964a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd380009900 tx=0x7fd380030650 comp rx=0 tx=0).stop 2024-09-19T07:29:59.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.774+0000 7fd395c5a640 1 -- 172.21.15.148:0/3743794725 shutdown_connections 2024-09-19T07:29:59.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.774+0000 7fd395c5a640 1 --2- 172.21.15.148:0/3743794725 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fd3780a3560 0x7fd3780a5a20 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:59.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.774+0000 7fd395c5a640 1 --2- 172.21.15.148:0/3743794725 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3901028d0 0x7fd39019a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:59.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.774+0000 7fd395c5a640 1 --2- 172.21.15.148:0/3743794725 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd390101a30 0x7fd3901964a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:59.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.774+0000 7fd395c5a640 1 --2- 172.21.15.148:0/3743794725 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3901010b0 0x7fd390195f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:59.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.774+0000 7fd395c5a640 1 -- 172.21.15.148:0/3743794725 >> 172.21.15.148:0/3743794725 conn(0x7fd3900770f0 msgr2=0x7fd390104590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:59.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.774+0000 7fd395c5a640 1 -- 172.21.15.148:0/3743794725 shutdown_connections 2024-09-19T07:29:59.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.775+0000 7fd395c5a640 1 -- 172.21.15.148:0/3743794725 wait complete. 2024-09-19T07:29:59.792 DEBUG:teuthology.orchestra.run.smithi148:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-19T07:29:59.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.933+0000 7f75b2f31640 1 -- 172.21.15.148:0/3118415826 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75ac102c80 msgr2=0x7f75ac103060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:59.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.933+0000 7f75b2f31640 1 --2- 172.21.15.148:0/3118415826 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75ac102c80 0x7f75ac103060 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f75a0009900 tx=0x7f75a002a480 comp rx=0 tx=0).stop 2024-09-19T07:29:59.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.933+0000 7f75b2f31640 1 -- 172.21.15.148:0/3118415826 shutdown_connections 2024-09-19T07:29:59.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.933+0000 7f75b2f31640 1 --2- 172.21.15.148:0/3118415826 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75ac10c0d0 0x7f75ac10e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:59.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.933+0000 7f75b2f31640 1 --2- 172.21.15.148:0/3118415826 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f75ac1035a0 0x7f75ac10ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:59.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.933+0000 7f75b2f31640 1 --2- 172.21.15.148:0/3118415826 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75ac102c80 0x7f75ac103060 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:59.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.933+0000 7f75b2f31640 1 -- 172.21.15.148:0/3118415826 >> 172.21.15.148:0/3118415826 conn(0x7f75ac077990 msgr2=0x7f75ac0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:29:59.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.933+0000 7f75b2f31640 1 -- 172.21.15.148:0/3118415826 shutdown_connections 2024-09-19T07:29:59.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.933+0000 7f75b2f31640 1 -- 172.21.15.148:0/3118415826 wait complete. 2024-09-19T07:29:59.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.934+0000 7f75b2f31640 1 Processor -- start 2024-09-19T07:29:59.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.934+0000 7f75b2f31640 1 -- start start 2024-09-19T07:29:59.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.935+0000 7f75b2f31640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75ac102c80 0x7f75ac198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:59.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.935+0000 7f75b2f31640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75ac1035a0 0x7f75ac1988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:59.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.935+0000 7f75b2f31640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f75ac10c0d0 0x7f75ac19cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:59.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.935+0000 7f75abfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75ac1035a0 0x7f75ac1988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:59.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.935+0000 7f75abfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75ac1035a0 0x7f75ac1988a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54184/0 (socket says 172.21.15.148:54184) 2024-09-19T07:29:59.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.935+0000 7f75abfff640 1 -- 172.21.15.148:0/2606742292 learned_addr learned my addr 172.21.15.148:0/2606742292 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:29:59.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.935+0000 7f75b0ccd640 1 --2- 172.21.15.148:0/2606742292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75ac102c80 0x7f75ac198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:59.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.935+0000 7f75b2f31640 1 -- 172.21.15.148:0/2606742292 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f75ac111f00 con 0x7f75ac1035a0 2024-09-19T07:29:59.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.935+0000 7f75b2f31640 1 -- 172.21.15.148:0/2606742292 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f75ac111d80 con 0x7f75ac10c0d0 2024-09-19T07:29:59.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.935+0000 7f75b2f31640 1 -- 172.21.15.148:0/2606742292 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f75ac112080 con 0x7f75ac102c80 2024-09-19T07:29:59.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.935+0000 7f75b14ce640 1 --2- 172.21.15.148:0/2606742292 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f75ac10c0d0 0x7f75ac19cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:59.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.936+0000 7f75abfff640 1 -- 172.21.15.148:0/2606742292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75ac102c80 msgr2=0x7f75ac198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:59.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.936+0000 7f75abfff640 1 --2- 172.21.15.148:0/2606742292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75ac102c80 0x7f75ac198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:59.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.936+0000 7f75abfff640 1 -- 172.21.15.148:0/2606742292 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f75ac10c0d0 msgr2=0x7f75ac19cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:29:59.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.936+0000 7f75abfff640 1 --2- 172.21.15.148:0/2606742292 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f75ac10c0d0 0x7f75ac19cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:29:59.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.936+0000 7f75abfff640 1 -- 172.21.15.148:0/2606742292 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75ac19d350 con 0x7f75ac1035a0 2024-09-19T07:29:59.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.936+0000 7f75abfff640 1 --2- 172.21.15.148:0/2606742292 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75ac1035a0 0x7f75ac1988a0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f759800e9f0 tx=0x7f759800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:59.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.936+0000 7f75a9ffb640 1 -- 172.21.15.148:0/2606742292 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f759800ccc0 con 0x7f75ac1035a0 2024-09-19T07:29:59.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.936+0000 7f75a9ffb640 1 -- 172.21.15.148:0/2606742292 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7598010910 con 0x7f75ac1035a0 2024-09-19T07:29:59.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.936+0000 7f75a9ffb640 1 -- 172.21.15.148:0/2606742292 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7598018920 con 0x7f75ac1035a0 2024-09-19T07:29:59.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.936+0000 7f75b2f31640 1 -- 172.21.15.148:0/2606742292 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75ac19d640 con 0x7f75ac1035a0 2024-09-19T07:29:59.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.937+0000 7f75b2f31640 1 -- 172.21.15.148:0/2606742292 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75ac1a4ed0 con 0x7f75ac1035a0 2024-09-19T07:29:59.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.937+0000 7f75b2f31640 1 -- 172.21.15.148:0/2606742292 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75ac103060 con 0x7f75ac1035a0 2024-09-19T07:29:59.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.939+0000 7f75a9ffb640 1 -- 172.21.15.148:0/2606742292 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f7598010430 con 0x7f75ac1035a0 2024-09-19T07:29:59.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.941+0000 7f75a9ffb640 1 --2- 172.21.15.148:0/2606742292 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f759c0a3460 0x7f759c0a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:29:59.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.941+0000 7f75a9ffb640 1 -- 172.21.15.148:0/2606742292 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8600+0+0 (secure 0 0 0) 0x7f75980d0480 con 0x7f75ac1035a0 2024-09-19T07:29:59.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.941+0000 7f75b0ccd640 1 --2- 172.21.15.148:0/2606742292 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f759c0a3460 0x7f759c0a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:29:59.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.942+0000 7f75b0ccd640 1 --2- 172.21.15.148:0/2606742292 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f759c0a3460 0x7f759c0a5920 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f75a0000c00 tx=0x7f75a0005b50 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:29:59.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:29:59.945+0000 7f75a9ffb640 1 -- 172.21.15.148:0/2606742292 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f759809c7c0 con 0x7f75ac1035a0 2024-09-19T07:30:00.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:00 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mon-a[31176]: 2024-09-19T07:29:59.999+0000 7f2e51b2a640 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 2 MDSs report damaged metadata 2024-09-19T07:30:00.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.252+0000 7f75b2f31640 1 -- 172.21.15.148:0/2606742292 --> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f75ac0fd6c0 con 0x7f759c0a3460 2024-09-19T07:30:00.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.263+0000 7f75a9ffb640 1 -- 172.21.15.148:0/2606742292 <== mgr.15123 v2:172.21.15.148:6800/3902535850 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f75ac0fd6c0 con 0x7f759c0a3460 2024-09-19T07:30:00.263 INFO:teuthology.orchestra.run.smithi148.stdout:/ 1m 6m3h 2024-09-19T07:30:00.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.265+0000 7f75b2f31640 1 -- 172.21.15.148:0/2606742292 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f759c0a3460 msgr2=0x7f759c0a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:00.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.265+0000 7f75b2f31640 1 --2- 172.21.15.148:0/2606742292 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f759c0a3460 0x7f759c0a5920 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f75a0000c00 tx=0x7f75a0005b50 comp rx=0 tx=0).stop 2024-09-19T07:30:00.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.265+0000 7f75b2f31640 1 -- 172.21.15.148:0/2606742292 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75ac1035a0 msgr2=0x7f75ac1988a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:00.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.265+0000 7f75b2f31640 1 --2- 172.21.15.148:0/2606742292 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75ac1035a0 0x7f75ac1988a0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f759800e9f0 tx=0x7f759800eeb0 comp rx=0 tx=0).stop 2024-09-19T07:30:00.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.265+0000 7f75b2f31640 1 -- 172.21.15.148:0/2606742292 shutdown_connections 2024-09-19T07:30:00.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.265+0000 7f75b2f31640 1 --2- 172.21.15.148:0/2606742292 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f759c0a3460 0x7f759c0a5920 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:00.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.265+0000 7f75b2f31640 1 --2- 172.21.15.148:0/2606742292 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f75ac10c0d0 0x7f75ac19cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:00.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.265+0000 7f75b2f31640 1 --2- 172.21.15.148:0/2606742292 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75ac1035a0 0x7f75ac1988a0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:00.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.265+0000 7f75b2f31640 1 --2- 172.21.15.148:0/2606742292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75ac102c80 0x7f75ac198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:00.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.265+0000 7f75b2f31640 1 -- 172.21.15.148:0/2606742292 >> 172.21.15.148:0/2606742292 conn(0x7f75ac077990 msgr2=0x7f75ac0fcfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:30:00.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.265+0000 7f75b2f31640 1 -- 172.21.15.148:0/2606742292 shutdown_connections 2024-09-19T07:30:00.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.265+0000 7f75b2f31640 1 -- 172.21.15.148:0/2606742292 wait complete. 2024-09-19T07:30:00.281 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-19T07:30:00.291 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-19T07:30:00.291 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 155, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 90, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2024-09-19T07:30:00.292 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-19T07:30:00.302 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T07:30:00.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.458+0000 7fb625e65640 1 -- 172.21.15.148:0/2730212055 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb620105f10 msgr2=0x7fb6201063c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:00.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.458+0000 7fb625e65640 1 --2- 172.21.15.148:0/2730212055 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb620105f10 0x7fb6201063c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb614009930 tx=0x7fb61402a4f0 comp rx=0 tx=0).stop 2024-09-19T07:30:00.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.458+0000 7fb625e65640 1 -- 172.21.15.148:0/2730212055 shutdown_connections 2024-09-19T07:30:00.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.458+0000 7fb625e65640 1 --2- 172.21.15.148:0/2730212055 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb620105f10 0x7fb6201063c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:00.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.458+0000 7fb625e65640 1 --2- 172.21.15.148:0/2730212055 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb620101400 0x7fb6201058c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:00.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.458+0000 7fb625e65640 1 --2- 172.21.15.148:0/2730212055 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb620100ae0 0x7fb620100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:00.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.458+0000 7fb625e65640 1 -- 172.21.15.148:0/2730212055 >> 172.21.15.148:0/2730212055 conn(0x7fb620077a10 msgr2=0x7fb6200fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:30:00.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.458+0000 7fb625e65640 1 -- 172.21.15.148:0/2730212055 shutdown_connections 2024-09-19T07:30:00.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.458+0000 7fb625e65640 1 -- 172.21.15.148:0/2730212055 wait complete. 2024-09-19T07:30:00.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.459+0000 7fb625e65640 1 Processor -- start 2024-09-19T07:30:00.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.459+0000 7fb625e65640 1 -- start start 2024-09-19T07:30:00.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.460+0000 7fb625e65640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb620100ae0 0x7fb6201a4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:00.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.460+0000 7fb625e65640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb620101400 0x7fb6201a4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:00.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.460+0000 7fb625e65640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb620105f10 0x7fb62019e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:00.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.460+0000 7fb625e65640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb620118480 con 0x7fb620105f10 2024-09-19T07:30:00.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.460+0000 7fb625e65640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb620118300 con 0x7fb620101400 2024-09-19T07:30:00.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.460+0000 7fb625e65640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb620118600 con 0x7fb620100ae0 2024-09-19T07:30:00.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.460+0000 7fb61f7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb620100ae0 0x7fb6201a4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:30:00.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.460+0000 7fb61f7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb620100ae0 0x7fb6201a4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:56878/0 (socket says 172.21.15.148:56878) 2024-09-19T07:30:00.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.460+0000 7fb61f7fe640 1 -- 172.21.15.148:0/2983614187 learned_addr learned my addr 172.21.15.148:0/2983614187 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:30:00.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.460+0000 7fb61ffff640 1 --2- 172.21.15.148:0/2983614187 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb620105f10 0x7fb62019e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:30:00.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.460+0000 7fb61effd640 1 --2- 172.21.15.148:0/2983614187 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb620101400 0x7fb6201a4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:30:00.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.460+0000 7fb61effd640 1 -- 172.21.15.148:0/2983614187 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb620100ae0 msgr2=0x7fb6201a4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:00.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.460+0000 7fb61effd640 1 --2- 172.21.15.148:0/2983614187 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb620100ae0 0x7fb6201a4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:00.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.460+0000 7fb61effd640 1 -- 172.21.15.148:0/2983614187 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb620105f10 msgr2=0x7fb62019e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:00.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.460+0000 7fb61effd640 1 --2- 172.21.15.148:0/2983614187 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb620105f10 0x7fb62019e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:00.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.460+0000 7fb61effd640 1 -- 172.21.15.148:0/2983614187 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb62019efc0 con 0x7fb620101400 2024-09-19T07:30:00.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.460+0000 7fb61f7fe640 1 --2- 172.21.15.148:0/2983614187 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb620100ae0 0x7fb6201a4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:30:00.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.461+0000 7fb61effd640 1 --2- 172.21.15.148:0/2983614187 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb620101400 0x7fb6201a4bc0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb61800eb00 tx=0x7fb61800c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:30:00.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.461+0000 7fb61cff9640 1 -- 172.21.15.148:0/2983614187 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb618010430 con 0x7fb620101400 2024-09-19T07:30:00.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.461+0000 7fb61cff9640 1 -- 172.21.15.148:0/2983614187 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb618010ab0 con 0x7fb620101400 2024-09-19T07:30:00.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.461+0000 7fb61cff9640 1 -- 172.21.15.148:0/2983614187 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb618017bb0 con 0x7fb620101400 2024-09-19T07:30:00.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.461+0000 7fb625e65640 1 -- 172.21.15.148:0/2983614187 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb62019f2b0 con 0x7fb620101400 2024-09-19T07:30:00.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.462+0000 7fb625e65640 1 -- 172.21.15.148:0/2983614187 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6201ab4d0 con 0x7fb620101400 2024-09-19T07:30:00.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.463+0000 7fb625e65640 1 -- 172.21.15.148:0/2983614187 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb620069bc0 con 0x7fb620101400 2024-09-19T07:30:00.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.465+0000 7fb61cff9640 1 -- 172.21.15.148:0/2983614187 <== mon.2 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fb618010c60 con 0x7fb620101400 2024-09-19T07:30:00.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.466+0000 7fb61cff9640 1 --2- 172.21.15.148:0/2983614187 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fb6080a34c0 0x7fb6080a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:00.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.466+0000 7fb61cff9640 1 -- 172.21.15.148:0/2983614187 <== mon.2 v2:172.21.15.165:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8600+0+0 (secure 0 0 0) 0x7fb6180d0840 con 0x7fb620101400 2024-09-19T07:30:00.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.467+0000 7fb61f7fe640 1 --2- 172.21.15.148:0/2983614187 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fb6080a34c0 0x7fb6080a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:30:00.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.468+0000 7fb61f7fe640 1 --2- 172.21.15.148:0/2983614187 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fb6080a34c0 0x7fb6080a5980 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb6100058c0 tx=0x7fb61000a380 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:30:00.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.470+0000 7fb61cff9640 1 -- 172.21.15.148:0/2983614187 <== mon.2 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb61809d170 con 0x7fb620101400 2024-09-19T07:30:00.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.740+0000 7fb625e65640 1 -- 172.21.15.148:0/2983614187 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb6201058c0 con 0x7fb620101400 2024-09-19T07:30:00.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.742+0000 7fb61cff9640 1 -- 172.21.15.148:0/2983614187 <== mon.2 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) ==== 74+0+23416 (secure 0 0 0) 0x7fb6201058c0 con 0x7fb620101400 2024-09-19T07:30:00.743 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:30:00.743 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":105,"fsid":"eae8a4a8-7654-11ef-bceb-c7b262605968","created":"2024-09-19T07:01:47.891210+0000","modified":"2024-09-19T07:29:12.633905+0000","last_up_change":"2024-09-19T07:08:30.785262+0000","last_in_change":"2024-09-19T07:08:07.001808+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:04:49.313270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T07:09:15.840600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T07:09:17.690782+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":31,"snap_epoch":105,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7b854fad-d5a3-43e3-862e-7a0e8f243c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6803","nonce":512186330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6805","nonce":512186330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6809","nonce":512186330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6807","nonce":512186330}]},"public_addr":"172.21.15.148:6803/512186330","cluster_addr":"172.21.15.148:6805/512186330","heartbeat_back_addr":"172.21.15.148:6809/512186330","heartbeat_front_addr":"172.21.15.148:6807/512186330","state":["exists","up"]},{"osd":1,"uuid":"61b26278-f4db-40f0-97b9-c12a6ef1cd06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6801","nonce":2433984552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6803","nonce":2433984552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6807","nonce":2433984552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6805","nonce":2433984552}]},"public_addr":"172.21.15.165:6801/2433984552","cluster_addr":"172.21.15.165:6803/2433984552","heartbeat_back_addr":"172.21.15.165:6807/2433984552","heartbeat_front_addr":"172.21.15.165:6805/2433984552","state":["exists","up"]},{"osd":2,"uuid":"06620bbc-cdb5-4afc-8122-0bb3126630f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6801","nonce":3048365223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6803","nonce":3048365223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6807","nonce":3048365223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6805","nonce":3048365223}]},"public_addr":"172.21.15.179:6801/3048365223","cluster_addr":"172.21.15.179:6803/3048365223","heartbeat_back_addr":"172.21.15.179:6807/3048365223","heartbeat_front_addr":"172.21.15.179:6805/3048365223","state":["exists","up"]},{"osd":3,"uuid":"d7df45d4-5ef1-4f66-84a7-f61b8756c0c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6811","nonce":3662789091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6813","nonce":3662789091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6817","nonce":3662789091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6815","nonce":3662789091}]},"public_addr":"172.21.15.148:6811/3662789091","cluster_addr":"172.21.15.148:6813/3662789091","heartbeat_back_addr":"172.21.15.148:6817/3662789091","heartbeat_front_addr":"172.21.15.148:6815/3662789091","state":["exists","up"]},{"osd":4,"uuid":"5cfd359b-a8d2-4bdc-858f-087d26e0869c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6809","nonce":3082550323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6811","nonce":3082550323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6815","nonce":3082550323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6813","nonce":3082550323}]},"public_addr":"172.21.15.165:6809/3082550323","cluster_addr":"172.21.15.165:6811/3082550323","heartbeat_back_addr":"172.21.15.165:6815/3082550323","heartbeat_front_addr":"172.21.15.165:6813/3082550323","state":["exists","up"]},{"osd":5,"uuid":"8295e69b-87fe-4403-bb2e-d9dd42e2f398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6809","nonce":2125213751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6811","nonce":2125213751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6815","nonce":2125213751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6813","nonce":2125213751}]},"public_addr":"172.21.15.179:6809/2125213751","cluster_addr":"172.21.15.179:6811/2125213751","heartbeat_back_addr":"172.21.15.179:6815/2125213751","heartbeat_front_addr":"172.21.15.179:6813/2125213751","state":["exists","up"]},{"osd":6,"uuid":"4ce38d1a-06d3-4606-b00d-aa1ff977025f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6819","nonce":2178980310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6821","nonce":2178980310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6825","nonce":2178980310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6823","nonce":2178980310}]},"public_addr":"172.21.15.148:6819/2178980310","cluster_addr":"172.21.15.148:6821/2178980310","heartbeat_back_addr":"172.21.15.148:6825/2178980310","heartbeat_front_addr":"172.21.15.148:6823/2178980310","state":["exists","up"]},{"osd":7,"uuid":"9e68e2b2-9838-4ec0-b473-24f2434695ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6817","nonce":3961600099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6819","nonce":3961600099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6823","nonce":3961600099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6821","nonce":3961600099}]},"public_addr":"172.21.15.165:6817/3961600099","cluster_addr":"172.21.15.165:6819/3961600099","heartbeat_back_addr":"172.21.15.165:6823/3961600099","heartbeat_front_addr":"172.21.15.165:6821/3961600099","state":["exists","up"]},{"osd":8,"uuid":"297acce6-d3c7-4e1a-bf87-be093de51a6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6817","nonce":3642931467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6819","nonce":3642931467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6823","nonce":3642931467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6821","nonce":3642931467}]},"public_addr":"172.21.15.179:6817/3642931467","cluster_addr":"172.21.15.179:6819/3642931467","heartbeat_back_addr":"172.21.15.179:6823/3642931467","heartbeat_front_addr":"172.21.15.179:6821/3642931467","state":["exists","up"]},{"osd":9,"uuid":"ef488c5e-5353-4695-99dd-5b74ade436d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6827","nonce":3135409630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6829","nonce":3135409630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6833","nonce":3135409630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6831","nonce":3135409630}]},"public_addr":"172.21.15.148:6827/3135409630","cluster_addr":"172.21.15.148:6829/3135409630","heartbeat_back_addr":"172.21.15.148:6833/3135409630","heartbeat_front_addr":"172.21.15.148:6831/3135409630","state":["exists","up"]},{"osd":10,"uuid":"7a9f0379-1199-4266-910c-8d1d313d39e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6825","nonce":3554110731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6827","nonce":3554110731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6831","nonce":3554110731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6829","nonce":3554110731}]},"public_addr":"172.21.15.165:6825/3554110731","cluster_addr":"172.21.15.165:6827/3554110731","heartbeat_back_addr":"172.21.15.165:6831/3554110731","heartbeat_front_addr":"172.21.15.165:6829/3554110731","state":["exists","up"]},{"osd":11,"uuid":"eede97e9-5685-4603-806e-7078c6940536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6825","nonce":2026109940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6827","nonce":2026109940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6831","nonce":2026109940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6829","nonce":2026109940}]},"public_addr":"172.21.15.179:6825/2026109940","cluster_addr":"172.21.15.179:6827/2026109940","heartbeat_back_addr":"172.21.15.179:6831/2026109940","heartbeat_front_addr":"172.21.15.179:6829/2026109940","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:03:56.291685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:21.419682+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:46.377012+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:11.484234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:36.723101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:06:00.294617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:06:25.147230+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:06:49.318576+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:07:13.896399+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:07:38.930999+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:08:03.803463+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:08:28.731343+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.148:0/2510377205":"2024-09-20T07:11:03.220856+0000","172.21.15.148:0/1725756124":"2024-09-20T07:11:03.220856+0000","172.21.15.148:0/2638338746":"2024-09-20T07:11:03.220856+0000","172.21.15.148:0/174481494":"2024-09-20T07:02:14.557425+0000","172.21.15.148:0/3756905316":"2024-09-20T07:11:03.220856+0000","172.21.15.148:0/1480486619":"2024-09-20T07:02:14.557425+0000","172.21.15.148:6801/2161746152":"2024-09-20T07:02:14.557425+0000","172.21.15.148:6800/2161746152":"2024-09-20T07:02:14.557425+0000","172.21.15.148:6800/1949849385":"2024-09-20T07:02:37.007183+0000","172.21.15.148:0/1114469409":"2024-09-20T07:02:14.557425+0000","172.21.15.148:0/1922521135":"2024-09-20T07:02:37.007183+0000","172.21.15.148:6801/3007822654":"2024-09-20T07:11:03.220856+0000","172.21.15.148:0/1958388906":"2024-09-20T07:02:37.007183+0000","172.21.15.148:6801/1949849385":"2024-09-20T07:02:37.007183+0000","172.21.15.148:0/3534559227":"2024-09-20T07:02:37.007183+0000","172.21.15.148:0/1224758996":"2024-09-20T07:11:03.220856+0000","172.21.15.148:6800/3007822654":"2024-09-20T07:11:03.220856+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":18,"length":1},{"begin":31,"length":1}]}],"new_removed_snaps":[{"pool":3,"snaps":[{"begin":18,"length":1},{"begin":31,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T07:30:00.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.745+0000 7fb625e65640 1 -- 172.21.15.148:0/2983614187 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fb6080a34c0 msgr2=0x7fb6080a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:00.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.745+0000 7fb625e65640 1 --2- 172.21.15.148:0/2983614187 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fb6080a34c0 0x7fb6080a5980 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb6100058c0 tx=0x7fb61000a380 comp rx=0 tx=0).stop 2024-09-19T07:30:00.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.745+0000 7fb625e65640 1 -- 172.21.15.148:0/2983614187 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb620101400 msgr2=0x7fb6201a4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:00.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.745+0000 7fb625e65640 1 --2- 172.21.15.148:0/2983614187 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb620101400 0x7fb6201a4bc0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb61800eb00 tx=0x7fb61800c2d0 comp rx=0 tx=0).stop 2024-09-19T07:30:00.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.746+0000 7fb625e65640 1 -- 172.21.15.148:0/2983614187 shutdown_connections 2024-09-19T07:30:00.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.746+0000 7fb625e65640 1 --2- 172.21.15.148:0/2983614187 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fb6080a34c0 0x7fb6080a5980 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:00.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.746+0000 7fb625e65640 1 --2- 172.21.15.148:0/2983614187 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb620105f10 0x7fb62019e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:00.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.746+0000 7fb625e65640 1 --2- 172.21.15.148:0/2983614187 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb620101400 0x7fb6201a4bc0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:00.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.746+0000 7fb625e65640 1 --2- 172.21.15.148:0/2983614187 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb620100ae0 0x7fb6201a4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:00.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.746+0000 7fb625e65640 1 -- 172.21.15.148:0/2983614187 >> 172.21.15.148:0/2983614187 conn(0x7fb620077a10 msgr2=0x7fb62010f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:30:00.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.746+0000 7fb625e65640 1 -- 172.21.15.148:0/2983614187 shutdown_connections 2024-09-19T07:30:00.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.746+0000 7fb625e65640 1 -- 172.21.15.148:0/2983614187 wait complete. 2024-09-19T07:30:00.762 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T07:04:49.313270+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T07:09:15.840600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T07:09:17.690782+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '105', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 31, 'snap_epoch': 105, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T07:30:00.763 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T07:30:00.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.911+0000 7fec0959a640 1 -- 172.21.15.148:0/1066040742 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febfc037070 con 0x7fec0c1069b0 2024-09-19T07:30:00.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.912+0000 7fec10928640 1 -- 172.21.15.148:0/1066040742 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec0c1069b0 msgr2=0x7fec0c106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:00.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.912+0000 7fec10928640 1 --2- 172.21.15.148:0/1066040742 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec0c1069b0 0x7fec0c106d90 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7febfc009890 tx=0x7febfc02a380 comp rx=0 tx=0).stop 2024-09-19T07:30:00.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.912+0000 7fec10928640 1 -- 172.21.15.148:0/1066040742 shutdown_connections 2024-09-19T07:30:00.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.912+0000 7fec10928640 1 --2- 172.21.15.148:0/1066040742 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec0c101340 0x7fec0c10d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:00.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.912+0000 7fec10928640 1 --2- 172.21.15.148:0/1066040742 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec0c1009a0 0x7fec0c100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:00.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.912+0000 7fec10928640 1 --2- 172.21.15.148:0/1066040742 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec0c1069b0 0x7fec0c106d90 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:00.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.912+0000 7fec10928640 1 -- 172.21.15.148:0/1066040742 >> 172.21.15.148:0/1066040742 conn(0x7fec0c0fc6a0 msgr2=0x7fec0c0feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:30:00.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.912+0000 7fec10928640 1 -- 172.21.15.148:0/1066040742 shutdown_connections 2024-09-19T07:30:00.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.912+0000 7fec10928640 1 -- 172.21.15.148:0/1066040742 wait complete. 2024-09-19T07:30:00.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.914+0000 7fec10928640 1 Processor -- start 2024-09-19T07:30:00.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.914+0000 7fec10928640 1 -- start start 2024-09-19T07:30:00.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.914+0000 7fec10928640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec0c1009a0 0x7fec0c1972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:00.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.914+0000 7fec10928640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec0c101340 0x7fec0c1977e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:00.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.914+0000 7fec10928640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec0c1069b0 0x7fec0c19bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:00.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.914+0000 7fec0a59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec0c1009a0 0x7fec0c1972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:30:00.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.915+0000 7fec10928640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fec0c110df0 con 0x7fec0c1009a0 2024-09-19T07:30:00.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.915+0000 7fec0a59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec0c1009a0 0x7fec0c1972a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54224/0 (socket says 172.21.15.148:54224) 2024-09-19T07:30:00.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.915+0000 7fec10928640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fec0c110c70 con 0x7fec0c1069b0 2024-09-19T07:30:00.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.915+0000 7fec10928640 1 -- 172.21.15.148:0/139857724 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fec0c110f70 con 0x7fec0c101340 2024-09-19T07:30:00.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.915+0000 7fec0a59c640 1 -- 172.21.15.148:0/139857724 learned_addr learned my addr 172.21.15.148:0/139857724 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:30:00.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.915+0000 7fec09d9b640 1 --2- 172.21.15.148:0/139857724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec0c101340 0x7fec0c1977e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:30:00.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.915+0000 7fec0ad9d640 1 --2- 172.21.15.148:0/139857724 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec0c1069b0 0x7fec0c19bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:30:00.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.915+0000 7fec09d9b640 1 -- 172.21.15.148:0/139857724 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec0c1069b0 msgr2=0x7fec0c19bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:00.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.915+0000 7fec09d9b640 1 --2- 172.21.15.148:0/139857724 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec0c1069b0 0x7fec0c19bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:00.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.915+0000 7fec09d9b640 1 -- 172.21.15.148:0/139857724 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec0c1009a0 msgr2=0x7fec0c1972a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:00.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.915+0000 7fec09d9b640 1 --2- 172.21.15.148:0/139857724 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec0c1009a0 0x7fec0c1972a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:00.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.915+0000 7fec09d9b640 1 -- 172.21.15.148:0/139857724 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec0c19c290 con 0x7fec0c101340 2024-09-19T07:30:00.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.915+0000 7fec0a59c640 1 --2- 172.21.15.148:0/139857724 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec0c1009a0 0x7fec0c1972a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:30:00.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.915+0000 7fec0ad9d640 1 --2- 172.21.15.148:0/139857724 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec0c1069b0 0x7fec0c19bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:30:00.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.915+0000 7fec09d9b640 1 --2- 172.21.15.148:0/139857724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec0c101340 0x7fec0c1977e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fec0000e790 tx=0x7fec0000ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:30:00.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.916+0000 7febfb7fe640 1 -- 172.21.15.148:0/139857724 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec0000eea0 con 0x7fec0c101340 2024-09-19T07:30:00.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.916+0000 7febfb7fe640 1 -- 172.21.15.148:0/139857724 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec0000ccc0 con 0x7fec0c101340 2024-09-19T07:30:00.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.916+0000 7fec10928640 1 -- 172.21.15.148:0/139857724 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec0c19c580 con 0x7fec0c101340 2024-09-19T07:30:00.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.916+0000 7febfb7fe640 1 -- 172.21.15.148:0/139857724 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec00018780 con 0x7fec0c101340 2024-09-19T07:30:00.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.916+0000 7fec10928640 1 -- 172.21.15.148:0/139857724 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec0c06a360 con 0x7fec0c101340 2024-09-19T07:30:00.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.917+0000 7fec10928640 1 -- 172.21.15.148:0/139857724 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec0c100e00 con 0x7fec0c101340 2024-09-19T07:30:00.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.918+0000 7febfb7fe640 1 -- 172.21.15.148:0/139857724 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fec00010430 con 0x7fec0c101340 2024-09-19T07:30:00.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.919+0000 7febfb7fe640 1 --2- 172.21.15.148:0/139857724 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7febf40a3440 0x7febf40a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:00.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.920+0000 7febfb7fe640 1 -- 172.21.15.148:0/139857724 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8600+0+0 (secure 0 0 0) 0x7fec000cff70 con 0x7fec0c101340 2024-09-19T07:30:00.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.920+0000 7fec0a59c640 1 --2- 172.21.15.148:0/139857724 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7febf40a3440 0x7febf40a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:30:00.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.921+0000 7fec0a59c640 1 --2- 172.21.15.148:0/139857724 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7febf40a3440 0x7febf40a5900 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7febfc030460 tx=0x7febfc009490 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:30:00.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:00.924+0000 7febfb7fe640 1 -- 172.21.15.148:0/139857724 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fec0009c900 con 0x7fec0c101340 2024-09-19T07:30:01.073 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:00 smithi179 ceph-mon[35716]: pgmap v595: 97 pgs: 9 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 71 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 163 op/s 2024-09-19T07:30:01.073 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:00 smithi179 ceph-mon[35716]: from='client.27088 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:30:01.073 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:00 smithi179 ceph-mon[35716]: overall HEALTH_ERR 2 MDSs report damaged metadata 2024-09-19T07:30:01.073 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:00 smithi179 ceph-mon[35716]: from='client.17988 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:30:01.073 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:00 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/2983614187' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:30:01.082 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:00 smithi148 ceph-mon[31180]: pgmap v595: 97 pgs: 9 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 71 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 163 op/s 2024-09-19T07:30:01.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:00 smithi148 ceph-mon[31180]: from='client.27088 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:30:01.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:00 smithi148 ceph-mon[31180]: overall HEALTH_ERR 2 MDSs report damaged metadata 2024-09-19T07:30:01.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:00 smithi148 ceph-mon[31180]: from='client.17988 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:30:01.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:00 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/2983614187' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:30:01.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:00 smithi165 ceph-mon[35326]: pgmap v595: 97 pgs: 9 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 71 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 163 op/s 2024-09-19T07:30:01.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:00 smithi165 ceph-mon[35326]: from='client.27088 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:30:01.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:00 smithi165 ceph-mon[35326]: overall HEALTH_ERR 2 MDSs report damaged metadata 2024-09-19T07:30:01.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:00 smithi165 ceph-mon[35326]: from='client.17988 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:30:01.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:00 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/2983614187' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:30:01.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.180+0000 7fec10928640 1 -- 172.21.15.148:0/139857724 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fec0c06ade0 con 0x7fec0c101340 2024-09-19T07:30:01.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.180+0000 7febfb7fe640 1 -- 172.21.15.148:0/139857724 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v105) ==== 93+0+10 (secure 0 0 0) 0x7fec0009c200 con 0x7fec0c101340 2024-09-19T07:30:01.181 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 1 2024-09-19T07:30:01.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.182+0000 7fec10928640 1 -- 172.21.15.148:0/139857724 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7febf40a3440 msgr2=0x7febf40a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:01.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.182+0000 7fec10928640 1 --2- 172.21.15.148:0/139857724 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7febf40a3440 0x7febf40a5900 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7febfc030460 tx=0x7febfc009490 comp rx=0 tx=0).stop 2024-09-19T07:30:01.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.182+0000 7fec10928640 1 -- 172.21.15.148:0/139857724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec0c101340 msgr2=0x7fec0c1977e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:01.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.182+0000 7fec10928640 1 --2- 172.21.15.148:0/139857724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec0c101340 0x7fec0c1977e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fec0000e790 tx=0x7fec0000ec50 comp rx=0 tx=0).stop 2024-09-19T07:30:01.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.182+0000 7fec10928640 1 -- 172.21.15.148:0/139857724 shutdown_connections 2024-09-19T07:30:01.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.182+0000 7fec10928640 1 --2- 172.21.15.148:0/139857724 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7febf40a3440 0x7febf40a5900 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:01.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.182+0000 7fec10928640 1 --2- 172.21.15.148:0/139857724 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec0c1069b0 0x7fec0c19bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:01.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.182+0000 7fec10928640 1 --2- 172.21.15.148:0/139857724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec0c101340 0x7fec0c1977e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:01.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.182+0000 7fec10928640 1 --2- 172.21.15.148:0/139857724 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec0c1009a0 0x7fec0c1972a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:01.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.182+0000 7fec10928640 1 -- 172.21.15.148:0/139857724 >> 172.21.15.148:0/139857724 conn(0x7fec0c0fc6a0 msgr2=0x7fec0c0fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:30:01.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.182+0000 7fec10928640 1 -- 172.21.15.148:0/139857724 shutdown_connections 2024-09-19T07:30:01.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.182+0000 7fec10928640 1 -- 172.21.15.148:0/139857724 wait complete. 2024-09-19T07:30:01.195 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T07:30:01.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.324+0000 7f7d7722e640 1 -- 172.21.15.148:0/2378700553 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d70101340 msgr2=0x7f7d7010d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:01.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.324+0000 7f7d7722e640 1 --2- 172.21.15.148:0/2378700553 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d70101340 0x7f7d7010d870 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f7d68009cd0 tx=0x7f7d6802a8e0 comp rx=0 tx=0).stop 2024-09-19T07:30:01.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.324+0000 7f7d7722e640 1 -- 172.21.15.148:0/2378700553 shutdown_connections 2024-09-19T07:30:01.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.324+0000 7f7d7722e640 1 --2- 172.21.15.148:0/2378700553 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d70101340 0x7f7d7010d870 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:01.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.324+0000 7f7d7722e640 1 --2- 172.21.15.148:0/2378700553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d701009a0 0x7f7d70100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:01.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.324+0000 7f7d7722e640 1 --2- 172.21.15.148:0/2378700553 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7d701069b0 0x7f7d70106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:01.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.324+0000 7f7d7722e640 1 -- 172.21.15.148:0/2378700553 >> 172.21.15.148:0/2378700553 conn(0x7f7d700fc680 msgr2=0x7f7d700feaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:30:01.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.324+0000 7f7d7722e640 1 -- 172.21.15.148:0/2378700553 shutdown_connections 2024-09-19T07:30:01.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.324+0000 7f7d7722e640 1 -- 172.21.15.148:0/2378700553 wait complete. 2024-09-19T07:30:01.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.325+0000 7f7d7722e640 1 Processor -- start 2024-09-19T07:30:01.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.325+0000 7f7d7722e640 1 -- start start 2024-09-19T07:30:01.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.325+0000 7f7d7722e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d701009a0 0x7f7d701972e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:01.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.325+0000 7f7d7722e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7d70101340 0x7f7d70197820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:01.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.325+0000 7f7d7722e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d701069b0 0x7f7d7019bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:01.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.325+0000 7f7d7722e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7d70110df0 con 0x7f7d701009a0 2024-09-19T07:30:01.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.325+0000 7f7d7722e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7d70110c70 con 0x7f7d70101340 2024-09-19T07:30:01.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.325+0000 7f7d7722e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7d70110f70 con 0x7f7d701069b0 2024-09-19T07:30:01.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.325+0000 7f7d74fca640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d701009a0 0x7f7d701972e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:30:01.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.325+0000 7f7d74fca640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d701009a0 0x7f7d701972e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54240/0 (socket says 172.21.15.148:54240) 2024-09-19T07:30:01.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.325+0000 7f7d757cb640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d701069b0 0x7f7d7019bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:30:01.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.325+0000 7f7d74fca640 1 -- 172.21.15.148:0/379233160 learned_addr learned my addr 172.21.15.148:0/379233160 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:30:01.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.326+0000 7f7d6ffff640 1 --2- 172.21.15.148:0/379233160 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7d70101340 0x7f7d70197820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:30:01.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.326+0000 7f7d74fca640 1 -- 172.21.15.148:0/379233160 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d701069b0 msgr2=0x7f7d7019bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:01.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.326+0000 7f7d74fca640 1 --2- 172.21.15.148:0/379233160 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d701069b0 0x7f7d7019bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:01.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.326+0000 7f7d74fca640 1 -- 172.21.15.148:0/379233160 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7d70101340 msgr2=0x7f7d70197820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:01.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.326+0000 7f7d74fca640 1 --2- 172.21.15.148:0/379233160 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7d70101340 0x7f7d70197820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:01.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.326+0000 7f7d74fca640 1 -- 172.21.15.148:0/379233160 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d7019c2d0 con 0x7f7d701009a0 2024-09-19T07:30:01.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.326+0000 7f7d74fca640 1 --2- 172.21.15.148:0/379233160 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d701009a0 0x7f7d701972e0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f7d6400e9f0 tx=0x7f7d6400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:30:01.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.326+0000 7f7d6dffb640 1 -- 172.21.15.148:0/379233160 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d6400cd80 con 0x7f7d701009a0 2024-09-19T07:30:01.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.326+0000 7f7d7722e640 1 -- 172.21.15.148:0/379233160 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d7019c5c0 con 0x7f7d701009a0 2024-09-19T07:30:01.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.326+0000 7f7d6dffb640 1 -- 172.21.15.148:0/379233160 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d64010910 con 0x7f7d701009a0 2024-09-19T07:30:01.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.326+0000 7f7d6dffb640 1 -- 172.21.15.148:0/379233160 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d640188f0 con 0x7f7d701009a0 2024-09-19T07:30:01.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.326+0000 7f7d7722e640 1 -- 172.21.15.148:0/379233160 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d701a3e50 con 0x7f7d701009a0 2024-09-19T07:30:01.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.328+0000 7f7d7722e640 1 -- 172.21.15.148:0/379233160 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d70100e00 con 0x7f7d701009a0 2024-09-19T07:30:01.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.329+0000 7f7d6dffb640 1 -- 172.21.15.148:0/379233160 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f7d64010ac0 con 0x7f7d701009a0 2024-09-19T07:30:01.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.330+0000 7f7d6dffb640 1 --2- 172.21.15.148:0/379233160 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f7d600a33c0 0x7f7d600a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:01.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.330+0000 7f7d6dffb640 1 -- 172.21.15.148:0/379233160 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8600+0+0 (secure 0 0 0) 0x7f7d640d00b0 con 0x7f7d701009a0 2024-09-19T07:30:01.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.330+0000 7f7d6ffff640 1 --2- 172.21.15.148:0/379233160 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f7d600a33c0 0x7f7d600a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:30:01.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.330+0000 7f7d6ffff640 1 --2- 172.21.15.148:0/379233160 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f7d600a33c0 0x7f7d600a5880 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7d700fed30 tx=0x7f7d5c005f90 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:30:01.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.334+0000 7f7d6dffb640 1 -- 172.21.15.148:0/379233160 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7d6409c3f0 con 0x7f7d701009a0 2024-09-19T07:30:01.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.564+0000 7f7d7722e640 1 -- 172.21.15.148:0/379233160 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f7d7002d7c0 con 0x7f7d701009a0 2024-09-19T07:30:01.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.564+0000 7f7d6dffb640 1 -- 172.21.15.148:0/379233160 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v105) ==== 104+0+11 (secure 0 0 0) 0x7f7d640a06f0 con 0x7f7d701009a0 2024-09-19T07:30:01.565 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 32 2024-09-19T07:30:01.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.567+0000 7f7d7722e640 1 -- 172.21.15.148:0/379233160 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f7d600a33c0 msgr2=0x7f7d600a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:01.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.567+0000 7f7d7722e640 1 --2- 172.21.15.148:0/379233160 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f7d600a33c0 0x7f7d600a5880 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7d700fed30 tx=0x7f7d5c005f90 comp rx=0 tx=0).stop 2024-09-19T07:30:01.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.567+0000 7f7d7722e640 1 -- 172.21.15.148:0/379233160 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d701009a0 msgr2=0x7f7d701972e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:01.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.568+0000 7f7d7722e640 1 --2- 172.21.15.148:0/379233160 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d701009a0 0x7f7d701972e0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f7d6400e9f0 tx=0x7f7d6400eeb0 comp rx=0 tx=0).stop 2024-09-19T07:30:01.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.568+0000 7f7d7722e640 1 -- 172.21.15.148:0/379233160 shutdown_connections 2024-09-19T07:30:01.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.568+0000 7f7d7722e640 1 --2- 172.21.15.148:0/379233160 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f7d600a33c0 0x7f7d600a5880 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:01.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.568+0000 7f7d7722e640 1 --2- 172.21.15.148:0/379233160 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d701069b0 0x7f7d7019bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:01.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.568+0000 7f7d7722e640 1 --2- 172.21.15.148:0/379233160 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7d70101340 0x7f7d70197820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:01.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.568+0000 7f7d7722e640 1 --2- 172.21.15.148:0/379233160 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d701009a0 0x7f7d701972e0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:01.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.568+0000 7f7d7722e640 1 -- 172.21.15.148:0/379233160 >> 172.21.15.148:0/379233160 conn(0x7f7d700fc680 msgr2=0x7f7d700fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:30:01.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.568+0000 7f7d7722e640 1 -- 172.21.15.148:0/379233160 shutdown_connections 2024-09-19T07:30:01.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.568+0000 7f7d7722e640 1 -- 172.21.15.148:0/379233160 wait complete. 2024-09-19T07:30:01.581 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T07:30:01.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.703+0000 7f55effe4640 1 -- 172.21.15.148:0/404434110 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55e8100a20 msgr2=0x7f55e8100e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:01.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.703+0000 7f55effe4640 1 --2- 172.21.15.148:0/404434110 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55e8100a20 0x7f55e8100e80 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f55d8009930 tx=0x7f55d802a420 comp rx=0 tx=0).stop 2024-09-19T07:30:01.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.703+0000 7f55effe4640 1 -- 172.21.15.148:0/404434110 shutdown_connections 2024-09-19T07:30:01.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.703+0000 7f55effe4640 1 --2- 172.21.15.148:0/404434110 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55e81013c0 0x7f55e810d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:01.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.703+0000 7f55effe4640 1 --2- 172.21.15.148:0/404434110 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55e8100a20 0x7f55e8100e80 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:01.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.703+0000 7f55effe4640 1 --2- 172.21.15.148:0/404434110 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f55e8106a30 0x7f55e8106e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:01.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.703+0000 7f55effe4640 1 -- 172.21.15.148:0/404434110 >> 172.21.15.148:0/404434110 conn(0x7f55e80fc740 msgr2=0x7f55e80feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:30:01.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.703+0000 7f55effe4640 1 -- 172.21.15.148:0/404434110 shutdown_connections 2024-09-19T07:30:01.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.703+0000 7f55effe4640 1 -- 172.21.15.148:0/404434110 wait complete. 2024-09-19T07:30:01.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.704+0000 7f55effe4640 1 Processor -- start 2024-09-19T07:30:01.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.704+0000 7f55effe4640 1 -- start start 2024-09-19T07:30:01.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.704+0000 7f55effe4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55e8100a20 0x7f55e81984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:01.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.704+0000 7f55effe4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55e81013c0 0x7f55e8198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:01.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.704+0000 7f55effe4640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f55e8106a30 0x7f55e819cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:01.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.704+0000 7f55effe4640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f55e8110e70 con 0x7f55e81013c0 2024-09-19T07:30:01.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.704+0000 7f55effe4640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f55e8110cf0 con 0x7f55e8106a30 2024-09-19T07:30:01.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.704+0000 7f55effe4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f55e8110ff0 con 0x7f55e8100a20 2024-09-19T07:30:01.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.704+0000 7f55ed57f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55e81013c0 0x7f55e8198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:30:01.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.704+0000 7f55ed57f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55e81013c0 0x7f55e8198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54268/0 (socket says 172.21.15.148:54268) 2024-09-19T07:30:01.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.704+0000 7f55ed57f640 1 -- 172.21.15.148:0/3707406204 learned_addr learned my addr 172.21.15.148:0/3707406204 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:30:01.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.704+0000 7f55ee581640 1 --2- 172.21.15.148:0/3707406204 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f55e8106a30 0x7f55e819cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:30:01.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.704+0000 7f55edd80640 1 --2- 172.21.15.148:0/3707406204 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55e8100a20 0x7f55e81984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:30:01.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.704+0000 7f55ed57f640 1 -- 172.21.15.148:0/3707406204 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55e8100a20 msgr2=0x7f55e81984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:01.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.704+0000 7f55ed57f640 1 --2- 172.21.15.148:0/3707406204 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55e8100a20 0x7f55e81984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:01.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.704+0000 7f55ed57f640 1 -- 172.21.15.148:0/3707406204 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f55e8106a30 msgr2=0x7f55e819cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:01.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.704+0000 7f55ed57f640 1 --2- 172.21.15.148:0/3707406204 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f55e8106a30 0x7f55e819cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:01.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.704+0000 7f55ed57f640 1 -- 172.21.15.148:0/3707406204 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e819d4b0 con 0x7f55e81013c0 2024-09-19T07:30:01.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.704+0000 7f55ed57f640 1 --2- 172.21.15.148:0/3707406204 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55e81013c0 0x7f55e8198a00 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f55d8009230 tx=0x7f55d8004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:30:01.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.705+0000 7f55deffd640 1 -- 172.21.15.148:0/3707406204 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d803f030 con 0x7f55e81013c0 2024-09-19T07:30:01.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.705+0000 7f55deffd640 1 -- 172.21.15.148:0/3707406204 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55d8004440 con 0x7f55e81013c0 2024-09-19T07:30:01.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.705+0000 7f55effe4640 1 -- 172.21.15.148:0/3707406204 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55e819d740 con 0x7f55e81013c0 2024-09-19T07:30:01.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.705+0000 7f55deffd640 1 -- 172.21.15.148:0/3707406204 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d8035070 con 0x7f55e81013c0 2024-09-19T07:30:01.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.705+0000 7f55effe4640 1 -- 172.21.15.148:0/3707406204 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55e81a5030 con 0x7f55e81013c0 2024-09-19T07:30:01.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.706+0000 7f55effe4640 1 -- 172.21.15.148:0/3707406204 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55e8100e80 con 0x7f55e81013c0 2024-09-19T07:30:01.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.707+0000 7f55deffd640 1 -- 172.21.15.148:0/3707406204 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f55d8042030 con 0x7f55e81013c0 2024-09-19T07:30:01.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.708+0000 7f55deffd640 1 --2- 172.21.15.148:0/3707406204 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f55d40a33c0 0x7f55d40a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:01.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.708+0000 7f55edd80640 1 --2- 172.21.15.148:0/3707406204 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f55d40a33c0 0x7f55d40a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:30:01.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.708+0000 7f55deffd640 1 -- 172.21.15.148:0/3707406204 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8600+0+0 (secure 0 0 0) 0x7f55d80f0460 con 0x7f55e81013c0 2024-09-19T07:30:01.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.708+0000 7f55edd80640 1 --2- 172.21.15.148:0/3707406204 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f55d40a33c0 0x7f55d40a5880 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f55e4009b50 tx=0x7f55e4005f90 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:30:01.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.711+0000 7f55deffd640 1 -- 172.21.15.148:0/3707406204 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f55d80bc7a0 con 0x7f55e81013c0 2024-09-19T07:30:01.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:01 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/139857724' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T07:30:01.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:01 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/379233160' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T07:30:01.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.907+0000 7f55effe4640 1 -- 172.21.15.148:0/3707406204 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f55e8109fa0 con 0x7f55e81013c0 2024-09-19T07:30:01.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.907+0000 7f55deffd640 1 -- 172.21.15.148:0/3707406204 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v105) ==== 100+0+11 (secure 0 0 0) 0x7f55d80c0aa0 con 0x7f55e81013c0 2024-09-19T07:30:01.908 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 64 2024-09-19T07:30:01.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.910+0000 7f55effe4640 1 -- 172.21.15.148:0/3707406204 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f55d40a33c0 msgr2=0x7f55d40a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:01.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.910+0000 7f55effe4640 1 --2- 172.21.15.148:0/3707406204 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f55d40a33c0 0x7f55d40a5880 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f55e4009b50 tx=0x7f55e4005f90 comp rx=0 tx=0).stop 2024-09-19T07:30:01.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.910+0000 7f55effe4640 1 -- 172.21.15.148:0/3707406204 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55e81013c0 msgr2=0x7f55e8198a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:01.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.910+0000 7f55effe4640 1 --2- 172.21.15.148:0/3707406204 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55e81013c0 0x7f55e8198a00 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f55d8009230 tx=0x7f55d8004040 comp rx=0 tx=0).stop 2024-09-19T07:30:01.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.910+0000 7f55effe4640 1 -- 172.21.15.148:0/3707406204 shutdown_connections 2024-09-19T07:30:01.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.910+0000 7f55effe4640 1 --2- 172.21.15.148:0/3707406204 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f55d40a33c0 0x7f55d40a5880 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:01.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.910+0000 7f55effe4640 1 --2- 172.21.15.148:0/3707406204 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f55e8106a30 0x7f55e819cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:01.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.910+0000 7f55effe4640 1 --2- 172.21.15.148:0/3707406204 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55e81013c0 0x7f55e8198a00 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:01.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.910+0000 7f55effe4640 1 --2- 172.21.15.148:0/3707406204 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55e8100a20 0x7f55e81984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:01.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.910+0000 7f55effe4640 1 -- 172.21.15.148:0/3707406204 >> 172.21.15.148:0/3707406204 conn(0x7f55e80fc740 msgr2=0x7f55e806a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:30:01.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.910+0000 7f55effe4640 1 -- 172.21.15.148:0/3707406204 shutdown_connections 2024-09-19T07:30:01.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:01.910+0000 7f55effe4640 1 -- 172.21.15.148:0/3707406204 wait complete. 2024-09-19T07:30:01.922 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-19T07:30:02.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.025+0000 7fab9bc0e640 1 -- 172.21.15.148:0/3291460988 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab94103690 msgr2=0x7fab9410bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:02.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.025+0000 7fab9bc0e640 1 --2- 172.21.15.148:0/3291460988 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab94103690 0x7fab9410bb70 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fab84009900 tx=0x7fab8402a480 comp rx=0 tx=0).stop 2024-09-19T07:30:02.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.025+0000 7fab9bc0e640 1 -- 172.21.15.148:0/3291460988 shutdown_connections 2024-09-19T07:30:02.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.025+0000 7fab9bc0e640 1 --2- 172.21.15.148:0/3291460988 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab9410c140 0x7fab9410e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:02.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.025+0000 7fab9bc0e640 1 --2- 172.21.15.148:0/3291460988 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab94103690 0x7fab9410bb70 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:02.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.025+0000 7fab9bc0e640 1 --2- 172.21.15.148:0/3291460988 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab94102d70 0x7fab94103150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:02.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.025+0000 7fab9bc0e640 1 -- 172.21.15.148:0/3291460988 >> 172.21.15.148:0/3291460988 conn(0x7fab940fc740 msgr2=0x7fab940feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:30:02.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.025+0000 7fab9bc0e640 1 -- 172.21.15.148:0/3291460988 shutdown_connections 2024-09-19T07:30:02.027 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.025+0000 7fab9bc0e640 1 -- 172.21.15.148:0/3291460988 wait complete. 2024-09-19T07:30:02.029 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.026+0000 7fab9bc0e640 1 Processor -- start 2024-09-19T07:30:02.029 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.026+0000 7fab9bc0e640 1 -- start start 2024-09-19T07:30:02.029 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.026+0000 7fab9bc0e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab94102d70 0x7fab94198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:02.029 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.026+0000 7fab9bc0e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab94103690 0x7fab941989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:02.029 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.026+0000 7fab9bc0e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab9410c140 0x7fab9419cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:02.029 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.026+0000 7fab9bc0e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fab94111f40 con 0x7fab94103690 2024-09-19T07:30:02.029 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.026+0000 7fab9bc0e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fab94111dc0 con 0x7fab94102d70 2024-09-19T07:30:02.029 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.026+0000 7fab9bc0e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fab941120c0 con 0x7fab9410c140 2024-09-19T07:30:02.029 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.026+0000 7fab991a9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab94103690 0x7fab941989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:30:02.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.026+0000 7fab991a9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab94103690 0x7fab941989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54300/0 (socket says 172.21.15.148:54300) 2024-09-19T07:30:02.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.026+0000 7fab991a9640 1 -- 172.21.15.148:0/39650827 learned_addr learned my addr 172.21.15.148:0/39650827 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:30:02.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.026+0000 7fab999aa640 1 --2- 172.21.15.148:0/39650827 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab94102d70 0x7fab94198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:30:02.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.027+0000 7fab9a1ab640 1 --2- 172.21.15.148:0/39650827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab9410c140 0x7fab9419cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:30:02.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.027+0000 7fab991a9640 1 -- 172.21.15.148:0/39650827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab9410c140 msgr2=0x7fab9419cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:02.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.027+0000 7fab991a9640 1 --2- 172.21.15.148:0/39650827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab9410c140 0x7fab9419cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:02.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.027+0000 7fab991a9640 1 -- 172.21.15.148:0/39650827 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab94102d70 msgr2=0x7fab94198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:02.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.027+0000 7fab991a9640 1 --2- 172.21.15.148:0/39650827 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab94102d70 0x7fab94198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:02.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.027+0000 7fab991a9640 1 -- 172.21.15.148:0/39650827 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab9419d470 con 0x7fab94103690 2024-09-19T07:30:02.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.027+0000 7fab991a9640 1 --2- 172.21.15.148:0/39650827 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab94103690 0x7fab941989c0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fab84006010 tx=0x7fab840042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:30:02.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.027+0000 7fab8affd640 1 -- 172.21.15.148:0/39650827 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab8403f030 con 0x7fab94103690 2024-09-19T07:30:02.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.027+0000 7fab8affd640 1 -- 172.21.15.148:0/39650827 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab84031990 con 0x7fab94103690 2024-09-19T07:30:02.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.027+0000 7fab9bc0e640 1 -- 172.21.15.148:0/39650827 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab9419d700 con 0x7fab94103690 2024-09-19T07:30:02.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.027+0000 7fab8affd640 1 -- 172.21.15.148:0/39650827 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab84035070 con 0x7fab94103690 2024-09-19T07:30:02.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.027+0000 7fab9bc0e640 1 -- 172.21.15.148:0/39650827 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab941a4ff0 con 0x7fab94103690 2024-09-19T07:30:02.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.028+0000 7fab9bc0e640 1 -- 172.21.15.148:0/39650827 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab94103150 con 0x7fab94103690 2024-09-19T07:30:02.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.029+0000 7fab8affd640 1 -- 172.21.15.148:0/39650827 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fab84042030 con 0x7fab94103690 2024-09-19T07:30:02.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.030+0000 7fab8affd640 1 --2- 172.21.15.148:0/39650827 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fab800a3440 0x7fab800a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:02.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.030+0000 7fab999aa640 1 --2- 172.21.15.148:0/39650827 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fab800a3440 0x7fab800a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:30:02.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.030+0000 7fab8affd640 1 -- 172.21.15.148:0/39650827 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8600+0+0 (secure 0 0 0) 0x7fab840f0310 con 0x7fab94103690 2024-09-19T07:30:02.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.031+0000 7fab999aa640 1 --2- 172.21.15.148:0/39650827 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fab800a3440 0x7fab800a5900 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fab90009bd0 tx=0x7fab90005f90 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:30:02.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.037+0000 7fab8affd640 1 -- 172.21.15.148:0/39650827 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fab840bcd60 con 0x7fab94103690 2024-09-19T07:30:02.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:01 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/139857724' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T07:30:02.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:01 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/379233160' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T07:30:02.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:01 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/139857724' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T07:30:02.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:01 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/379233160' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T07:30:02.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.289+0000 7fab9bc0e640 1 -- 172.21.15.148:0/39650827 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fab941997d0 con 0x7fab94103690 2024-09-19T07:30:02.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.297+0000 7fab8affd640 1 -- 172.21.15.148:0/39650827 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v25) ==== 81+0+742883 (secure 0 0 0) 0x7fab941997d0 con 0x7fab94103690 2024-09-19T07:30:02.308 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:30:02.308 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:30:02.308 INFO:teuthology.orchestra.run.smithi148.stdout: "epoch": 25, 2024-09-19T07:30:02.308 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.308 INFO:teuthology.orchestra.run.smithi148.stdout: "active_gid": 15123, 2024-09-19T07:30:02.308 INFO:teuthology.orchestra.run.smithi148.stdout: "active_name": "x", 2024-09-19T07:30:02.308 INFO:teuthology.orchestra.run.smithi148.stdout: "active_addrs": { 2024-09-19T07:30:02.308 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-09-19T07:30:02.308 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:02.309 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-09-19T07:30:02.309 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6800", 2024-09-19T07:30:02.309 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 3902535850 2024-09-19T07:30:02.309 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.309 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:02.309 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-09-19T07:30:02.309 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:6801", 2024-09-19T07:30:02.309 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 3902535850 2024-09-19T07:30:02.309 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.309 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-19T07:30:02.309 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.309 INFO:teuthology.orchestra.run.smithi148.stdout: "active_addr": "172.21.15.148:6801/3902535850", 2024-09-19T07:30:02.309 INFO:teuthology.orchestra.run.smithi148.stdout: "active_change": "2024-09-19T07:11:03.221171+0000", 2024-09-19T07:30:02.310 INFO:teuthology.orchestra.run.smithi148.stdout: "active_mgr_features": 4540701547738038271, 2024-09-19T07:30:02.310 INFO:teuthology.orchestra.run.smithi148.stdout: "available": true, 2024-09-19T07:30:02.310 INFO:teuthology.orchestra.run.smithi148.stdout: "standbys": [ 2024-09-19T07:30:02.310 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:02.310 INFO:teuthology.orchestra.run.smithi148.stdout: "gid": 24719, 2024-09-19T07:30:02.310 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "y", 2024-09-19T07:30:02.310 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr_features": 4540701547738038271, 2024-09-19T07:30:02.310 INFO:teuthology.orchestra.run.smithi148.stdout: "available_modules": [ 2024-09-19T07:30:02.310 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:02.310 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "alerts", 2024-09-19T07:30:02.310 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:02.310 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:02.310 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:02.311 INFO:teuthology.orchestra.run.smithi148.stdout: "interval": { 2024-09-19T07:30:02.311 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "interval", 2024-09-19T07:30:02.311 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:02.311 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.311 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.311 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "60", 2024-09-19T07:30:02.311 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.311 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.311 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.311 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T07:30:02.311 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.311 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.311 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.312 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.312 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:02.312 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:02.312 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.312 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.312 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.312 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.312 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.312 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.312 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.312 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.312 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.312 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.313 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.313 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.313 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.313 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.313 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.313 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.313 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.313 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.313 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.313 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:02.313 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:02.313 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.314 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.314 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.314 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.314 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.314 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.314 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.314 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.314 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.314 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.314 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.314 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.314 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:02.314 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:02.315 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.315 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.315 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.315 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:02.315 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.315 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.315 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.315 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.315 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.315 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.315 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.315 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.315 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.316 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.316 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.316 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.316 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.316 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.316 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.316 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:02.316 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:02.316 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.316 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.316 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.316 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.316 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.316 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.317 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.317 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.317 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.317 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.317 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.317 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.317 INFO:teuthology.orchestra.run.smithi148.stdout: "smtp_destination": { 2024-09-19T07:30:02.317 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smtp_destination", 2024-09-19T07:30:02.317 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.317 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.317 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.317 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.317 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.318 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.318 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.318 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Email address to send alerts to", 2024-09-19T07:30:02.318 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.318 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.318 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.318 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.318 INFO:teuthology.orchestra.run.smithi148.stdout: "smtp_from_name": { 2024-09-19T07:30:02.318 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smtp_from_name", 2024-09-19T07:30:02.318 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.318 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.318 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.318 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "Ceph", 2024-09-19T07:30:02.318 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.319 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.319 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.319 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Email From: name", 2024-09-19T07:30:02.319 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.319 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.319 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.319 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.319 INFO:teuthology.orchestra.run.smithi148.stdout: "smtp_host": { 2024-09-19T07:30:02.319 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smtp_host", 2024-09-19T07:30:02.319 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.319 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.319 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.319 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.320 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.320 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.320 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.320 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "SMTP server", 2024-09-19T07:30:02.320 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.320 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.320 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.320 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.320 INFO:teuthology.orchestra.run.smithi148.stdout: "smtp_password": { 2024-09-19T07:30:02.320 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smtp_password", 2024-09-19T07:30:02.320 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.320 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.320 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.320 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.321 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.321 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.321 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.321 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Password to authenticate with", 2024-09-19T07:30:02.321 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.321 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.321 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.321 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.321 INFO:teuthology.orchestra.run.smithi148.stdout: "smtp_port": { 2024-09-19T07:30:02.321 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smtp_port", 2024-09-19T07:30:02.321 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.321 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.321 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.322 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "465", 2024-09-19T07:30:02.322 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.322 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.322 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.322 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "SMTP port", 2024-09-19T07:30:02.322 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.322 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.322 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.322 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.322 INFO:teuthology.orchestra.run.smithi148.stdout: "smtp_sender": { 2024-09-19T07:30:02.322 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smtp_sender", 2024-09-19T07:30:02.322 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.322 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.322 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.323 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.323 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.323 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.323 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.323 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "SMTP envelope sender", 2024-09-19T07:30:02.323 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.323 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.323 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.323 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.323 INFO:teuthology.orchestra.run.smithi148.stdout: "smtp_ssl": { 2024-09-19T07:30:02.323 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smtp_ssl", 2024-09-19T07:30:02.323 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.324 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.324 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.324 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.324 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.324 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.324 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.324 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T07:30:02.324 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.324 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.324 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.324 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.324 INFO:teuthology.orchestra.run.smithi148.stdout: "smtp_user": { 2024-09-19T07:30:02.324 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smtp_user", 2024-09-19T07:30:02.324 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.325 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.325 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.325 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.325 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.325 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.325 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.325 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "User to authenticate as", 2024-09-19T07:30:02.325 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.325 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.325 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.325 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.325 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.325 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.326 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:02.326 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "balancer", 2024-09-19T07:30:02.326 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:02.326 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:02.326 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:02.326 INFO:teuthology.orchestra.run.smithi148.stdout: "active": { 2024-09-19T07:30:02.326 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "active", 2024-09-19T07:30:02.326 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.326 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.326 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.326 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.326 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.326 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.327 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.327 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T07:30:02.327 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.327 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.327 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.327 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.327 INFO:teuthology.orchestra.run.smithi148.stdout: "begin_time": { 2024-09-19T07:30:02.327 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "begin_time", 2024-09-19T07:30:02.327 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.327 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.327 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.327 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0000", 2024-09-19T07:30:02.327 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.327 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.328 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.328 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T07:30:02.328 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T07:30:02.328 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.328 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.328 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.328 INFO:teuthology.orchestra.run.smithi148.stdout: "begin_weekday": { 2024-09-19T07:30:02.328 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "begin_weekday", 2024-09-19T07:30:02.328 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "uint", 2024-09-19T07:30:02.328 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.328 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.328 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-19T07:30:02.329 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "0", 2024-09-19T07:30:02.329 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "6", 2024-09-19T07:30:02.329 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.329 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T07:30:02.329 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T07:30:02.329 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.329 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.329 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.329 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_compat_max_iterations": { 2024-09-19T07:30:02.329 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "crush_compat_max_iterations", 2024-09-19T07:30:02.329 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "uint", 2024-09-19T07:30:02.329 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.329 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.329 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "25", 2024-09-19T07:30:02.330 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "1", 2024-09-19T07:30:02.330 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "250", 2024-09-19T07:30:02.330 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.330 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T07:30:02.330 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.330 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.330 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.330 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.330 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_compat_metrics": { 2024-09-19T07:30:02.330 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "crush_compat_metrics", 2024-09-19T07:30:02.330 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.330 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.330 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.331 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T07:30:02.331 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.331 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.331 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.331 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T07:30:02.331 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T07:30:02.331 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.331 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.331 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.331 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_compat_step": { 2024-09-19T07:30:02.331 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "crush_compat_step", 2024-09-19T07:30:02.331 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "float", 2024-09-19T07:30:02.331 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.331 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.332 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0.5", 2024-09-19T07:30:02.332 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "0.001", 2024-09-19T07:30:02.332 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "0.999", 2024-09-19T07:30:02.332 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.332 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "aggressiveness of optimization", 2024-09-19T07:30:02.332 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T07:30:02.332 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.332 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.332 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.332 INFO:teuthology.orchestra.run.smithi148.stdout: "end_time": { 2024-09-19T07:30:02.332 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "end_time", 2024-09-19T07:30:02.332 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.332 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.332 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.333 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "2359", 2024-09-19T07:30:02.333 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.333 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.333 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.333 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T07:30:02.333 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T07:30:02.333 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.333 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.333 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.333 INFO:teuthology.orchestra.run.smithi148.stdout: "end_weekday": { 2024-09-19T07:30:02.333 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "end_weekday", 2024-09-19T07:30:02.333 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "uint", 2024-09-19T07:30:02.333 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.333 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.334 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-19T07:30:02.334 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "0", 2024-09-19T07:30:02.334 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "6", 2024-09-19T07:30:02.334 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.334 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T07:30:02.334 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T07:30:02.334 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.334 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.334 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.334 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:02.334 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:02.334 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.334 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.334 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.335 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.335 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.335 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.335 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.335 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.335 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.335 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.335 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.335 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.335 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.335 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.335 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.335 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.335 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.336 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.336 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.336 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:02.336 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:02.336 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.336 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.336 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.336 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.336 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.336 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.336 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.337 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.337 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.337 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.337 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.337 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.337 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:02.337 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:02.337 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.337 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.337 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.337 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:02.337 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.338 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.338 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.338 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.338 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.338 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.338 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.338 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.338 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.338 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.338 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.338 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.338 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.338 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.339 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.339 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:02.339 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:02.339 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.339 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.339 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.339 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.339 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.339 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.339 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.339 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.339 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.339 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.339 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.340 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.340 INFO:teuthology.orchestra.run.smithi148.stdout: "min_score": { 2024-09-19T07:30:02.340 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "min_score", 2024-09-19T07:30:02.340 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "float", 2024-09-19T07:30:02.340 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.340 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.340 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-19T07:30:02.340 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.340 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.340 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.340 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T07:30:02.340 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.340 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.341 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.341 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.341 INFO:teuthology.orchestra.run.smithi148.stdout: "mode": { 2024-09-19T07:30:02.341 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "mode", 2024-09-19T07:30:02.341 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.341 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.341 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.341 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "upmap", 2024-09-19T07:30:02.341 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.341 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.341 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.341 INFO:teuthology.orchestra.run.smithi148.stdout: "crush-compat", 2024-09-19T07:30:02.341 INFO:teuthology.orchestra.run.smithi148.stdout: "none", 2024-09-19T07:30:02.342 INFO:teuthology.orchestra.run.smithi148.stdout: "read", 2024-09-19T07:30:02.342 INFO:teuthology.orchestra.run.smithi148.stdout: "upmap", 2024-09-19T07:30:02.342 INFO:teuthology.orchestra.run.smithi148.stdout: "upmap-read" 2024-09-19T07:30:02.342 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.342 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Balancer mode", 2024-09-19T07:30:02.342 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.342 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.342 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.342 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.342 INFO:teuthology.orchestra.run.smithi148.stdout: "pool_ids": { 2024-09-19T07:30:02.342 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "pool_ids", 2024-09-19T07:30:02.342 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.342 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.342 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.343 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.343 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.343 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.343 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.343 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T07:30:02.343 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.343 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.343 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.343 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.344 INFO:teuthology.orchestra.run.smithi148.stdout: "sleep_interval": { 2024-09-19T07:30:02.344 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sleep_interval", 2024-09-19T07:30:02.344 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:02.344 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.344 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.344 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "60", 2024-09-19T07:30:02.344 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.344 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.344 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.344 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T07:30:02.344 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.344 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.344 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.344 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.345 INFO:teuthology.orchestra.run.smithi148.stdout: "upmap_max_deviation": { 2024-09-19T07:30:02.345 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "upmap_max_deviation", 2024-09-19T07:30:02.345 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.345 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.345 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.345 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "5", 2024-09-19T07:30:02.345 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "1", 2024-09-19T07:30:02.345 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.345 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.345 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T07:30:02.345 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T07:30:02.345 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.346 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.346 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.346 INFO:teuthology.orchestra.run.smithi148.stdout: "upmap_max_optimizations": { 2024-09-19T07:30:02.346 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "upmap_max_optimizations", 2024-09-19T07:30:02.346 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "uint", 2024-09-19T07:30:02.346 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.346 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.346 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10", 2024-09-19T07:30:02.346 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.346 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.346 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.346 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T07:30:02.346 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.346 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.347 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.347 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.347 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.347 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.347 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:02.347 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "cephadm", 2024-09-19T07:30:02.347 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:02.347 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:02.347 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:02.347 INFO:teuthology.orchestra.run.smithi148.stdout: "agent_down_multiplier": { 2024-09-19T07:30:02.347 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "agent_down_multiplier", 2024-09-19T07:30:02.347 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "float", 2024-09-19T07:30:02.347 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.347 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.348 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "3.0", 2024-09-19T07:30:02.348 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.348 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.348 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.348 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T07:30:02.348 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.348 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.348 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.348 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.348 INFO:teuthology.orchestra.run.smithi148.stdout: "agent_refresh_rate": { 2024-09-19T07:30:02.348 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "agent_refresh_rate", 2024-09-19T07:30:02.348 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:02.348 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.349 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.349 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "20", 2024-09-19T07:30:02.349 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.349 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.349 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.349 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T07:30:02.349 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.349 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.349 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.349 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.349 INFO:teuthology.orchestra.run.smithi148.stdout: "agent_starting_port": { 2024-09-19T07:30:02.349 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "agent_starting_port", 2024-09-19T07:30:02.349 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.350 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.350 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.350 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "4721", 2024-09-19T07:30:02.350 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.350 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.350 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.350 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T07:30:02.350 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.350 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.350 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.350 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.350 INFO:teuthology.orchestra.run.smithi148.stdout: "allow_ptrace": { 2024-09-19T07:30:02.351 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "allow_ptrace", 2024-09-19T07:30:02.351 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.351 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.351 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.351 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.351 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.351 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.351 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.351 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T07:30:02.351 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T07:30:02.351 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.351 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.351 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.352 INFO:teuthology.orchestra.run.smithi148.stdout: "autotune_interval": { 2024-09-19T07:30:02.352 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "autotune_interval", 2024-09-19T07:30:02.352 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:02.352 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.352 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.352 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "600", 2024-09-19T07:30:02.352 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.352 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.352 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.352 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T07:30:02.352 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.352 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.352 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.353 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.353 INFO:teuthology.orchestra.run.smithi148.stdout: "autotune_memory_target_ratio": { 2024-09-19T07:30:02.353 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T07:30:02.353 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "float", 2024-09-19T07:30:02.353 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.353 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.353 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0.7", 2024-09-19T07:30:02.353 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.353 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.353 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.353 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T07:30:02.353 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.353 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.353 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.354 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.354 INFO:teuthology.orchestra.run.smithi148.stdout: "cephadm_log_destination": { 2024-09-19T07:30:02.354 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "cephadm_log_destination", 2024-09-19T07:30:02.354 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.354 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.354 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.354 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.354 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.354 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.354 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.354 INFO:teuthology.orchestra.run.smithi148.stdout: "file", 2024-09-19T07:30:02.354 INFO:teuthology.orchestra.run.smithi148.stdout: "file,syslog", 2024-09-19T07:30:02.354 INFO:teuthology.orchestra.run.smithi148.stdout: "syslog" 2024-09-19T07:30:02.355 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.355 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T07:30:02.355 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.355 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.355 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.355 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.355 INFO:teuthology.orchestra.run.smithi148.stdout: "cgroups_split": { 2024-09-19T07:30:02.355 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "cgroups_split", 2024-09-19T07:30:02.355 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.355 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.355 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.355 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.355 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.356 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.356 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.356 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T07:30:02.356 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.356 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.356 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.356 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.356 INFO:teuthology.orchestra.run.smithi148.stdout: "config_checks_enabled": { 2024-09-19T07:30:02.356 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "config_checks_enabled", 2024-09-19T07:30:02.356 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.356 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.356 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.356 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.357 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.357 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.357 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.357 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T07:30:02.357 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.357 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.357 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.357 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.357 INFO:teuthology.orchestra.run.smithi148.stdout: "config_dashboard": { 2024-09-19T07:30:02.357 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "config_dashboard", 2024-09-19T07:30:02.357 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.357 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.357 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.358 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.358 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.358 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.358 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.358 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T07:30:02.358 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.358 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.358 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.358 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.358 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_alertmanager": { 2024-09-19T07:30:02.358 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_alertmanager", 2024-09-19T07:30:02.358 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.358 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.358 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.359 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T07:30:02.359 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.359 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.359 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.359 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Prometheus container image", 2024-09-19T07:30:02.359 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.359 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.359 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.359 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.359 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_base": { 2024-09-19T07:30:02.359 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_base", 2024-09-19T07:30:02.359 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.359 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.360 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.360 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T07:30:02.360 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.360 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.360 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.360 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Container image name, without the tag", 2024-09-19T07:30:02.360 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.360 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.360 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.360 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.360 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_elasticsearch": { 2024-09-19T07:30:02.360 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_elasticsearch", 2024-09-19T07:30:02.360 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.360 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.361 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.361 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T07:30:02.361 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.361 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.361 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.361 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "elasticsearch container image", 2024-09-19T07:30:02.361 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.361 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.361 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.361 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.361 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_grafana": { 2024-09-19T07:30:02.361 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_grafana", 2024-09-19T07:30:02.361 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.362 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.362 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.362 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T07:30:02.362 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.362 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.362 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.362 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Prometheus container image", 2024-09-19T07:30:02.362 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.362 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.362 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.362 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.362 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_haproxy": { 2024-09-19T07:30:02.362 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_haproxy", 2024-09-19T07:30:02.362 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.363 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.363 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.363 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T07:30:02.363 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.363 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.363 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.363 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "HAproxy container image", 2024-09-19T07:30:02.363 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.363 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.363 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.363 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.363 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_jaeger_agent": { 2024-09-19T07:30:02.364 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_jaeger_agent", 2024-09-19T07:30:02.364 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.364 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.364 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.364 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T07:30:02.364 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.364 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.364 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.364 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Jaeger agent container image", 2024-09-19T07:30:02.364 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.364 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.364 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.364 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.365 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_jaeger_collector": { 2024-09-19T07:30:02.365 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_jaeger_collector", 2024-09-19T07:30:02.365 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.365 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.365 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.365 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T07:30:02.365 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.365 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.365 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.365 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Jaeger collector container image", 2024-09-19T07:30:02.365 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.365 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.365 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.365 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.366 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_jaeger_query": { 2024-09-19T07:30:02.366 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_jaeger_query", 2024-09-19T07:30:02.366 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.366 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.366 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.366 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T07:30:02.366 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.366 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.366 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.366 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Jaeger query container image", 2024-09-19T07:30:02.366 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.366 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.366 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.367 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.367 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_keepalived": { 2024-09-19T07:30:02.367 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_keepalived", 2024-09-19T07:30:02.367 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.367 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.367 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.367 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T07:30:02.367 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.367 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.367 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.367 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Keepalived container image", 2024-09-19T07:30:02.367 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.367 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.367 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.368 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.368 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_loki": { 2024-09-19T07:30:02.368 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_loki", 2024-09-19T07:30:02.368 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.368 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.368 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.368 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T07:30:02.368 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.368 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.368 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.368 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Loki container image", 2024-09-19T07:30:02.368 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.368 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.369 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.369 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.369 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_node_exporter": { 2024-09-19T07:30:02.369 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_node_exporter", 2024-09-19T07:30:02.369 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.369 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.369 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.369 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T07:30:02.369 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.369 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.369 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.369 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Prometheus container image", 2024-09-19T07:30:02.369 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.370 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.370 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.370 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.370 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_nvmeof": { 2024-09-19T07:30:02.370 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_nvmeof", 2024-09-19T07:30:02.370 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.370 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.370 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.370 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T07:30:02.370 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.370 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.370 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.370 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Nvme-of container image", 2024-09-19T07:30:02.370 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.371 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.371 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.371 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.371 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_prometheus": { 2024-09-19T07:30:02.371 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_prometheus", 2024-09-19T07:30:02.371 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.371 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.371 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.371 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T07:30:02.371 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.371 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.371 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.371 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Prometheus container image", 2024-09-19T07:30:02.371 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.372 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.372 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.372 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.372 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_promtail": { 2024-09-19T07:30:02.372 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_promtail", 2024-09-19T07:30:02.372 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.372 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.372 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.372 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T07:30:02.372 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.372 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.372 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.372 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Promtail container image", 2024-09-19T07:30:02.373 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.373 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.373 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.373 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.373 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_samba": { 2024-09-19T07:30:02.373 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_samba", 2024-09-19T07:30:02.373 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.373 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.373 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.373 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T07:30:02.373 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.373 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.373 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.374 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Samba/SMB container image", 2024-09-19T07:30:02.374 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.374 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.374 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.374 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.374 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_snmp_gateway": { 2024-09-19T07:30:02.374 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_snmp_gateway", 2024-09-19T07:30:02.374 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.374 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.374 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.374 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T07:30:02.374 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.374 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.374 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.374 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "SNMP Gateway container image", 2024-09-19T07:30:02.375 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.375 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.375 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.375 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.375 INFO:teuthology.orchestra.run.smithi148.stdout: "container_init": { 2024-09-19T07:30:02.375 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_init", 2024-09-19T07:30:02.375 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.375 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.375 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.375 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.375 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.375 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.375 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.376 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T07:30:02.376 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.376 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.376 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.376 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.376 INFO:teuthology.orchestra.run.smithi148.stdout: "daemon_cache_timeout": { 2024-09-19T07:30:02.376 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "daemon_cache_timeout", 2024-09-19T07:30:02.376 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:02.376 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.376 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.376 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "600", 2024-09-19T07:30:02.376 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.376 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.377 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.377 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T07:30:02.377 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.377 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.377 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.377 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.377 INFO:teuthology.orchestra.run.smithi148.stdout: "default_cephadm_command_timeout": { 2024-09-19T07:30:02.377 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T07:30:02.377 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.377 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.377 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.377 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "900", 2024-09-19T07:30:02.377 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.378 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.378 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.378 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T07:30:02.378 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.378 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.378 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.378 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.378 INFO:teuthology.orchestra.run.smithi148.stdout: "default_registry": { 2024-09-19T07:30:02.378 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "default_registry", 2024-09-19T07:30:02.378 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.378 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.378 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.378 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "docker.io", 2024-09-19T07:30:02.379 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.379 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.379 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.379 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T07:30:02.379 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.379 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.379 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.379 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.379 INFO:teuthology.orchestra.run.smithi148.stdout: "device_cache_timeout": { 2024-09-19T07:30:02.379 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "device_cache_timeout", 2024-09-19T07:30:02.379 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:02.379 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.380 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.380 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "1800", 2024-09-19T07:30:02.380 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.380 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.380 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.380 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "seconds to cache device inventory", 2024-09-19T07:30:02.380 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.380 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.380 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.380 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.380 INFO:teuthology.orchestra.run.smithi148.stdout: "device_enhanced_scan": { 2024-09-19T07:30:02.380 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "device_enhanced_scan", 2024-09-19T07:30:02.380 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.381 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.381 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.381 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.381 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.381 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.381 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.381 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T07:30:02.381 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.381 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.381 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.381 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.381 INFO:teuthology.orchestra.run.smithi148.stdout: "facts_cache_timeout": { 2024-09-19T07:30:02.381 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "facts_cache_timeout", 2024-09-19T07:30:02.382 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:02.382 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.382 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.382 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "60", 2024-09-19T07:30:02.382 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.382 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.382 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.382 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "seconds to cache host facts data", 2024-09-19T07:30:02.382 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.382 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.382 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.382 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.382 INFO:teuthology.orchestra.run.smithi148.stdout: "grafana_dashboards_path": { 2024-09-19T07:30:02.383 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "grafana_dashboards_path", 2024-09-19T07:30:02.383 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.383 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.383 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.383 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T07:30:02.383 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.383 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.383 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.383 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T07:30:02.383 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.383 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.383 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.383 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.383 INFO:teuthology.orchestra.run.smithi148.stdout: "host_check_interval": { 2024-09-19T07:30:02.384 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "host_check_interval", 2024-09-19T07:30:02.384 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:02.384 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.384 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.384 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "600", 2024-09-19T07:30:02.384 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.384 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.384 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.384 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "how frequently to perform a host check", 2024-09-19T07:30:02.384 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.384 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.384 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.384 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.385 INFO:teuthology.orchestra.run.smithi148.stdout: "hw_monitoring": { 2024-09-19T07:30:02.385 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "hw_monitoring", 2024-09-19T07:30:02.385 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.385 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.385 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.385 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.385 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.385 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.385 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.385 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T07:30:02.385 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.385 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.385 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.386 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.386 INFO:teuthology.orchestra.run.smithi148.stdout: "inventory_list_all": { 2024-09-19T07:30:02.386 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "inventory_list_all", 2024-09-19T07:30:02.386 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.386 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.386 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.386 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.386 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.386 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.386 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.386 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T07:30:02.386 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.386 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.387 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.387 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.387 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:02.387 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:02.387 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.387 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.387 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.387 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.387 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.387 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.387 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.387 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.387 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.388 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.388 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.388 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.388 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.388 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.388 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.388 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.388 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.388 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.388 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.388 INFO:teuthology.orchestra.run.smithi148.stdout: "log_refresh_metadata": { 2024-09-19T07:30:02.388 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_refresh_metadata", 2024-09-19T07:30:02.388 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.388 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.389 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.389 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.389 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.389 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.389 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.389 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T07:30:02.389 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.389 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.389 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.389 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.389 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:02.389 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:02.390 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.390 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.390 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.390 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.390 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.390 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.390 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.390 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T07:30:02.390 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.390 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.390 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.390 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.390 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:02.391 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:02.391 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.391 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.391 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.391 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:02.391 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.391 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.391 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.391 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.391 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.391 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.391 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.391 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.392 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.392 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.392 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.392 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.392 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.392 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.392 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.392 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:02.392 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:02.392 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.392 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.392 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.392 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.393 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.393 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.393 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.393 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.393 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.393 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.393 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.393 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.393 INFO:teuthology.orchestra.run.smithi148.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T07:30:02.393 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T07:30:02.393 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.393 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.393 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.393 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.394 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.394 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.394 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.394 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T07:30:02.394 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.394 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.394 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.394 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.394 INFO:teuthology.orchestra.run.smithi148.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T07:30:02.394 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T07:30:02.394 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.394 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.394 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.395 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "*", 2024-09-19T07:30:02.395 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.395 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.395 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.395 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T07:30:02.395 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.395 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.395 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.395 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.395 INFO:teuthology.orchestra.run.smithi148.stdout: "max_count_per_host": { 2024-09-19T07:30:02.395 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "max_count_per_host", 2024-09-19T07:30:02.395 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.395 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.395 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.396 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10", 2024-09-19T07:30:02.396 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.396 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.396 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.396 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "max number of daemons per service per host", 2024-09-19T07:30:02.396 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.396 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.396 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.396 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.396 INFO:teuthology.orchestra.run.smithi148.stdout: "max_osd_draining_count": { 2024-09-19T07:30:02.396 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "max_osd_draining_count", 2024-09-19T07:30:02.396 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.396 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.397 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.397 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10", 2024-09-19T07:30:02.397 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.397 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.397 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.397 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T07:30:02.397 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.397 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.397 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.397 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.397 INFO:teuthology.orchestra.run.smithi148.stdout: "migration_current": { 2024-09-19T07:30:02.397 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "migration_current", 2024-09-19T07:30:02.397 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.397 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.398 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.398 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.398 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.398 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.398 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.398 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "internal - do not modify", 2024-09-19T07:30:02.398 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.398 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.398 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.398 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.398 INFO:teuthology.orchestra.run.smithi148.stdout: "mode": { 2024-09-19T07:30:02.398 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "mode", 2024-09-19T07:30:02.398 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.399 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.399 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.399 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "root", 2024-09-19T07:30:02.399 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.399 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.399 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.399 INFO:teuthology.orchestra.run.smithi148.stdout: "cephadm-package", 2024-09-19T07:30:02.399 INFO:teuthology.orchestra.run.smithi148.stdout: "root" 2024-09-19T07:30:02.399 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.399 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T07:30:02.399 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.399 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.399 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.399 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.400 INFO:teuthology.orchestra.run.smithi148.stdout: "oob_default_addr": { 2024-09-19T07:30:02.400 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "oob_default_addr", 2024-09-19T07:30:02.400 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.400 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.400 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.400 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "169.254.1.1", 2024-09-19T07:30:02.400 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.400 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.400 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.400 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T07:30:02.400 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.400 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.400 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.401 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.401 INFO:teuthology.orchestra.run.smithi148.stdout: "prometheus_alerts_path": { 2024-09-19T07:30:02.401 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "prometheus_alerts_path", 2024-09-19T07:30:02.401 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.401 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.401 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.401 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T07:30:02.401 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.401 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.401 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.401 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T07:30:02.401 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.401 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.401 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.402 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.402 INFO:teuthology.orchestra.run.smithi148.stdout: "registry_insecure": { 2024-09-19T07:30:02.402 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "registry_insecure", 2024-09-19T07:30:02.402 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.402 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.402 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.402 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.402 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.402 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.402 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.402 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T07:30:02.402 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.403 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.403 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.403 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.403 INFO:teuthology.orchestra.run.smithi148.stdout: "registry_password": { 2024-09-19T07:30:02.403 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "registry_password", 2024-09-19T07:30:02.403 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.403 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.403 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.403 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.403 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.403 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.403 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.404 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T07:30:02.404 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.404 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.404 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.404 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.404 INFO:teuthology.orchestra.run.smithi148.stdout: "registry_url": { 2024-09-19T07:30:02.404 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "registry_url", 2024-09-19T07:30:02.404 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.404 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.404 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.404 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.404 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.404 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.405 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.405 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T07:30:02.405 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.405 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.405 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.405 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.405 INFO:teuthology.orchestra.run.smithi148.stdout: "registry_username": { 2024-09-19T07:30:02.405 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "registry_username", 2024-09-19T07:30:02.405 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.405 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.405 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.405 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.405 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.406 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.406 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.406 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T07:30:02.406 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.406 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.406 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.406 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.406 INFO:teuthology.orchestra.run.smithi148.stdout: "secure_monitoring_stack": { 2024-09-19T07:30:02.406 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "secure_monitoring_stack", 2024-09-19T07:30:02.406 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.406 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.406 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.406 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.407 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.407 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.407 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.407 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T07:30:02.407 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.407 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.407 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.407 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.407 INFO:teuthology.orchestra.run.smithi148.stdout: "service_discovery_port": { 2024-09-19T07:30:02.407 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "service_discovery_port", 2024-09-19T07:30:02.407 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.407 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.407 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.408 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "8765", 2024-09-19T07:30:02.408 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.408 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.408 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.408 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "cephadm service discovery port", 2024-09-19T07:30:02.408 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.408 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.408 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.408 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.408 INFO:teuthology.orchestra.run.smithi148.stdout: "ssh_config_file": { 2024-09-19T07:30:02.408 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ssh_config_file", 2024-09-19T07:30:02.408 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.408 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.408 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.409 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.409 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.409 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.409 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.409 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T07:30:02.409 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.409 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.409 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.409 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.409 INFO:teuthology.orchestra.run.smithi148.stdout: "use_agent": { 2024-09-19T07:30:02.409 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "use_agent", 2024-09-19T07:30:02.409 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.410 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.410 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.410 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.410 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.410 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.410 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.410 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T07:30:02.410 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.410 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.410 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.410 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.410 INFO:teuthology.orchestra.run.smithi148.stdout: "use_repo_digest": { 2024-09-19T07:30:02.410 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "use_repo_digest", 2024-09-19T07:30:02.410 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.411 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.411 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.411 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.411 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.411 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.411 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.411 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T07:30:02.411 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.411 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.411 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.411 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.411 INFO:teuthology.orchestra.run.smithi148.stdout: "warn_on_failed_host_check": { 2024-09-19T07:30:02.411 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "warn_on_failed_host_check", 2024-09-19T07:30:02.411 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.412 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.412 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.412 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.412 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.412 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.412 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.412 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T07:30:02.412 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.412 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.412 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.412 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.412 INFO:teuthology.orchestra.run.smithi148.stdout: "warn_on_stray_daemons": { 2024-09-19T07:30:02.412 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "warn_on_stray_daemons", 2024-09-19T07:30:02.412 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.413 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.413 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.413 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.413 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.413 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.413 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.413 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T07:30:02.413 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.413 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.413 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.413 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.413 INFO:teuthology.orchestra.run.smithi148.stdout: "warn_on_stray_hosts": { 2024-09-19T07:30:02.413 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "warn_on_stray_hosts", 2024-09-19T07:30:02.414 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.414 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.414 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.414 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.414 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.414 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.414 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.414 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T07:30:02.414 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.414 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.414 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.414 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.414 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.414 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.415 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:02.415 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "crash", 2024-09-19T07:30:02.415 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:02.415 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:02.415 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:02.415 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:02.415 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:02.415 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.415 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.415 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.415 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.415 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.415 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.416 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.416 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.416 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.416 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.416 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.416 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.416 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.416 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.416 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.416 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.416 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.416 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.417 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.417 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:02.417 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:02.417 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.417 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.417 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.417 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.417 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.417 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.417 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.417 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.417 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.417 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.418 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.418 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.418 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:02.418 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:02.418 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.418 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.418 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.418 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:02.418 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.418 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.418 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.418 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.418 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.418 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.419 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.419 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.419 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.419 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.419 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.419 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.419 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.419 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.419 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.419 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:02.419 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:02.419 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.419 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.420 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.420 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.420 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.420 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.420 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.420 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.420 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.420 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.420 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.420 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.420 INFO:teuthology.orchestra.run.smithi148.stdout: "retain_interval": { 2024-09-19T07:30:02.420 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "retain_interval", 2024-09-19T07:30:02.420 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:02.421 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.421 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.421 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "31536000", 2024-09-19T07:30:02.421 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.421 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.421 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.421 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T07:30:02.421 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.421 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.421 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.421 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.421 INFO:teuthology.orchestra.run.smithi148.stdout: "warn_recent_interval": { 2024-09-19T07:30:02.421 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "warn_recent_interval", 2024-09-19T07:30:02.422 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:02.422 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.422 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.422 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "1209600", 2024-09-19T07:30:02.422 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.422 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.422 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.422 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T07:30:02.422 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.422 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.422 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.422 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.422 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.422 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.423 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:02.423 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "dashboard", 2024-09-19T07:30:02.423 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:02.423 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:02.423 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:02.423 INFO:teuthology.orchestra.run.smithi148.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T07:30:02.423 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T07:30:02.423 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.423 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.423 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.423 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10", 2024-09-19T07:30:02.423 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.423 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.423 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.424 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.424 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.424 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.424 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.424 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.424 INFO:teuthology.orchestra.run.smithi148.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T07:30:02.424 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T07:30:02.424 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.424 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.424 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.424 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.424 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.425 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.425 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.425 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.425 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.425 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.425 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.425 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.425 INFO:teuthology.orchestra.run.smithi148.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T07:30:02.425 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T07:30:02.425 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.425 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.425 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.425 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.425 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.426 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.426 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.426 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.426 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.426 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.426 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.426 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.426 INFO:teuthology.orchestra.run.smithi148.stdout: "AUDIT_API_ENABLED": { 2024-09-19T07:30:02.426 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T07:30:02.426 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.426 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.426 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.426 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.426 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.427 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.427 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.427 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.427 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.427 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.427 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.427 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.427 INFO:teuthology.orchestra.run.smithi148.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T07:30:02.427 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T07:30:02.427 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.427 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.427 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.427 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.428 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.428 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.428 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.428 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.428 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.428 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.428 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.428 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.428 INFO:teuthology.orchestra.run.smithi148.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T07:30:02.428 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T07:30:02.428 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.428 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.428 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.429 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.429 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.429 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.429 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.429 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.429 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.429 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.429 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.429 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.429 INFO:teuthology.orchestra.run.smithi148.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T07:30:02.429 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T07:30:02.429 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.430 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.430 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.430 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.430 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.430 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.430 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.430 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.430 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.430 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.430 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.430 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.430 INFO:teuthology.orchestra.run.smithi148.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T07:30:02.430 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T07:30:02.430 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.431 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.431 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.431 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.431 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.431 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.431 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.431 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.431 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.431 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.431 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.431 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.431 INFO:teuthology.orchestra.run.smithi148.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T07:30:02.431 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T07:30:02.432 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.432 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.432 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.432 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.432 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.432 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.432 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.432 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.432 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.432 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.432 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.432 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.432 INFO:teuthology.orchestra.run.smithi148.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T07:30:02.433 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T07:30:02.433 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.433 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.433 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.433 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.433 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.433 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.433 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.433 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.433 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.433 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.433 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.433 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.434 INFO:teuthology.orchestra.run.smithi148.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T07:30:02.434 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T07:30:02.434 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.434 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.434 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.434 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.434 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.434 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.434 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.434 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.434 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.434 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.434 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.434 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.435 INFO:teuthology.orchestra.run.smithi148.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T07:30:02.435 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T07:30:02.435 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.435 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.435 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.435 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.435 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.435 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.435 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.435 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.435 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.435 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.435 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.435 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.436 INFO:teuthology.orchestra.run.smithi148.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T07:30:02.436 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T07:30:02.436 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.436 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.436 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.436 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.436 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.436 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.436 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.436 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.436 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.436 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.436 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.437 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.437 INFO:teuthology.orchestra.run.smithi148.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T07:30:02.437 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T07:30:02.437 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.437 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.437 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.437 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.437 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.437 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.437 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.437 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.437 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.437 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.438 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.438 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.438 INFO:teuthology.orchestra.run.smithi148.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T07:30:02.438 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T07:30:02.438 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.438 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.438 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.438 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "admin", 2024-09-19T07:30:02.438 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.438 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.438 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.438 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.438 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.438 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.439 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.439 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.439 INFO:teuthology.orchestra.run.smithi148.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T07:30:02.439 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T07:30:02.439 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.439 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.439 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.439 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.439 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.439 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.439 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.439 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.439 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.439 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.440 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.440 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.440 INFO:teuthology.orchestra.run.smithi148.stdout: "GRAFANA_API_URL": { 2024-09-19T07:30:02.440 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "GRAFANA_API_URL", 2024-09-19T07:30:02.440 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.440 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.440 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.440 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.440 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.440 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.440 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.440 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.440 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.441 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.441 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.441 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.441 INFO:teuthology.orchestra.run.smithi148.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T07:30:02.441 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T07:30:02.441 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.441 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.441 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.441 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "admin", 2024-09-19T07:30:02.441 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.441 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.441 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.441 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.441 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.442 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.442 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.442 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.442 INFO:teuthology.orchestra.run.smithi148.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T07:30:02.442 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T07:30:02.442 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.442 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.442 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.442 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.442 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.442 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.442 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.442 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.442 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.443 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.443 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.443 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.443 INFO:teuthology.orchestra.run.smithi148.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T07:30:02.443 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T07:30:02.443 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.443 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.443 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.444 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.444 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.444 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.444 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.444 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.444 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.444 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.444 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.444 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.444 INFO:teuthology.orchestra.run.smithi148.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T07:30:02.444 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T07:30:02.444 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.444 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.445 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.445 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.445 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.445 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.445 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.445 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.445 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.445 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.445 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.445 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.445 INFO:teuthology.orchestra.run.smithi148.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T07:30:02.445 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T07:30:02.446 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.446 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.446 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.446 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.446 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.446 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.446 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.446 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.446 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.446 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.446 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.446 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.446 INFO:teuthology.orchestra.run.smithi148.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T07:30:02.446 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T07:30:02.447 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.447 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.447 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.447 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.447 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.447 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.447 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.447 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.447 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.447 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.447 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.447 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.447 INFO:teuthology.orchestra.run.smithi148.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T07:30:02.448 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T07:30:02.448 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.448 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.448 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.448 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.448 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.448 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.448 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.448 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.448 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.448 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.448 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.448 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.448 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T07:30:02.449 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T07:30:02.449 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.449 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.449 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.449 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.449 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.449 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.449 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.449 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.449 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.449 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.449 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.449 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.449 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T07:30:02.450 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T07:30:02.450 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.450 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.450 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.450 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.450 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.450 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.450 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.450 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.450 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.450 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.450 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.450 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.451 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T07:30:02.451 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T07:30:02.451 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.451 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.451 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.451 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.451 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.451 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.451 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.451 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.451 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.451 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.451 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.452 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.452 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T07:30:02.452 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T07:30:02.452 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.452 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.452 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.452 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.452 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.452 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.452 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.452 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.452 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.452 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.452 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.453 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.453 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T07:30:02.453 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T07:30:02.453 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.453 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.453 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.453 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.453 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.453 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.453 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.453 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.453 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.453 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.454 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.454 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.454 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T07:30:02.454 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T07:30:02.454 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.454 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.454 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.454 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.454 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.454 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.454 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.454 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.454 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.454 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.455 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.455 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.455 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T07:30:02.455 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T07:30:02.455 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.455 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.455 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.455 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.455 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.455 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.455 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.455 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.455 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.455 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.456 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.456 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.456 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T07:30:02.456 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T07:30:02.456 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.456 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.456 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.456 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.456 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.456 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.456 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.456 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.456 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.457 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.457 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.457 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.457 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T07:30:02.457 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T07:30:02.457 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.457 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.457 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.457 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T07:30:02.457 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.457 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.457 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.458 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.458 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.458 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.458 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.458 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.458 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T07:30:02.458 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T07:30:02.458 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.458 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.458 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.458 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10", 2024-09-19T07:30:02.458 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.458 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.458 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.459 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.459 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.459 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.459 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.459 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.459 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T07:30:02.459 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T07:30:02.459 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.459 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.459 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.459 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "8", 2024-09-19T07:30:02.459 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.459 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.460 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.460 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.460 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.460 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.460 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.460 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.460 INFO:teuthology.orchestra.run.smithi148.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T07:30:02.460 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T07:30:02.460 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.460 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.460 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.460 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "45", 2024-09-19T07:30:02.460 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.460 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.461 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.461 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.461 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.461 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.461 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.461 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.461 INFO:teuthology.orchestra.run.smithi148.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T07:30:02.461 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T07:30:02.461 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.461 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.461 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.461 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.461 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.462 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.462 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.462 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.462 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.462 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.462 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.462 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.462 INFO:teuthology.orchestra.run.smithi148.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T07:30:02.462 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T07:30:02.462 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.462 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.462 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.462 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "admin", 2024-09-19T07:30:02.462 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.463 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.463 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.463 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.463 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.463 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.463 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.463 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.463 INFO:teuthology.orchestra.run.smithi148.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T07:30:02.463 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T07:30:02.463 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.463 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.463 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.463 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.464 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.464 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.464 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.464 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.464 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.464 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.464 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.464 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.464 INFO:teuthology.orchestra.run.smithi148.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T07:30:02.464 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T07:30:02.464 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.464 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.464 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.465 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.465 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.465 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.465 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.465 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.465 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.465 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.465 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.465 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.465 INFO:teuthology.orchestra.run.smithi148.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T07:30:02.465 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T07:30:02.465 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.465 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.465 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.466 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-19T07:30:02.466 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.466 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.466 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.466 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.466 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.466 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.466 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.466 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.466 INFO:teuthology.orchestra.run.smithi148.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T07:30:02.466 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T07:30:02.466 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.466 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.466 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.467 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10", 2024-09-19T07:30:02.467 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.467 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.467 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.467 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.467 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.467 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.467 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.467 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.467 INFO:teuthology.orchestra.run.smithi148.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T07:30:02.467 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T07:30:02.467 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.467 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.468 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.468 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "5", 2024-09-19T07:30:02.468 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.468 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.468 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.468 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.468 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.468 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.468 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.468 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.468 INFO:teuthology.orchestra.run.smithi148.stdout: "cross_origin_url": { 2024-09-19T07:30:02.468 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "cross_origin_url", 2024-09-19T07:30:02.468 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.468 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.469 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.469 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.469 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.469 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.469 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.469 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.469 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.469 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.469 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.469 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.469 INFO:teuthology.orchestra.run.smithi148.stdout: "crt_file": { 2024-09-19T07:30:02.469 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "crt_file", 2024-09-19T07:30:02.469 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.470 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.470 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.470 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.470 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.470 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.470 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.470 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.470 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.470 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.470 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.470 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.470 INFO:teuthology.orchestra.run.smithi148.stdout: "debug": { 2024-09-19T07:30:02.470 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "debug", 2024-09-19T07:30:02.471 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.471 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.471 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.471 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.471 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.471 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.471 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.471 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Enable/disable debug options", 2024-09-19T07:30:02.471 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.471 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.471 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.471 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.472 INFO:teuthology.orchestra.run.smithi148.stdout: "jwt_token_ttl": { 2024-09-19T07:30:02.472 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "jwt_token_ttl", 2024-09-19T07:30:02.472 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.472 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.472 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.472 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "28800", 2024-09-19T07:30:02.472 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.472 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.472 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.472 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.472 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.472 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.472 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.473 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.473 INFO:teuthology.orchestra.run.smithi148.stdout: "key_file": { 2024-09-19T07:30:02.473 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "key_file", 2024-09-19T07:30:02.473 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.473 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.473 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.473 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.473 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.473 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.473 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.473 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.473 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.473 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.474 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.474 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.474 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:02.474 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:02.474 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.474 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.474 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.474 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.474 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.474 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.474 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.474 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.474 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.474 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.475 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.475 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.475 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.475 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.475 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.475 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.475 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.475 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.475 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.475 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:02.475 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:02.475 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.475 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.476 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.476 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.476 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.476 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.476 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.476 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.476 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.476 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.476 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.476 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.476 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:02.476 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:02.476 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.477 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.477 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.477 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:02.477 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.477 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.477 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.477 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.477 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.477 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.477 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.477 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.477 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.477 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.478 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.478 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.478 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.478 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.478 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.478 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:02.478 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:02.478 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.478 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.478 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.478 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.478 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.478 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.478 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.479 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.479 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.479 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.479 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.479 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.479 INFO:teuthology.orchestra.run.smithi148.stdout: "motd": { 2024-09-19T07:30:02.479 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "motd", 2024-09-19T07:30:02.479 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.479 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.479 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.479 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.479 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.479 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.479 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.480 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "The message of the day", 2024-09-19T07:30:02.480 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.480 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.480 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.480 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.480 INFO:teuthology.orchestra.run.smithi148.stdout: "redirect_resolve_ip_addr": { 2024-09-19T07:30:02.480 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T07:30:02.480 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.480 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.480 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.480 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.480 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.480 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.481 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.481 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.481 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.481 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.481 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.481 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.481 INFO:teuthology.orchestra.run.smithi148.stdout: "server_addr": { 2024-09-19T07:30:02.481 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "server_addr", 2024-09-19T07:30:02.481 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.481 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.481 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.481 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "::", 2024-09-19T07:30:02.481 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.481 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.482 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.482 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.482 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.482 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.482 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.482 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.482 INFO:teuthology.orchestra.run.smithi148.stdout: "server_port": { 2024-09-19T07:30:02.482 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "server_port", 2024-09-19T07:30:02.482 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.482 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.482 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.482 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "8080", 2024-09-19T07:30:02.482 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.482 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.483 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.483 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.483 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.483 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.483 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.483 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.483 INFO:teuthology.orchestra.run.smithi148.stdout: "ssl": { 2024-09-19T07:30:02.483 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ssl", 2024-09-19T07:30:02.483 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.483 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.483 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.483 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.483 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.484 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.484 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.484 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.484 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.484 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.484 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.484 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.484 INFO:teuthology.orchestra.run.smithi148.stdout: "ssl_server_port": { 2024-09-19T07:30:02.484 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ssl_server_port", 2024-09-19T07:30:02.484 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.484 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.484 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.484 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "8443", 2024-09-19T07:30:02.485 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.485 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.485 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.485 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.485 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.485 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.485 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.485 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.485 INFO:teuthology.orchestra.run.smithi148.stdout: "standby_behaviour": { 2024-09-19T07:30:02.485 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "standby_behaviour", 2024-09-19T07:30:02.485 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.485 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.486 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.486 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "redirect", 2024-09-19T07:30:02.486 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.486 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.486 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.486 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.486 INFO:teuthology.orchestra.run.smithi148.stdout: "redirect" 2024-09-19T07:30:02.486 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.486 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.486 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.486 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.486 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.486 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.487 INFO:teuthology.orchestra.run.smithi148.stdout: "standby_error_status_code": { 2024-09-19T07:30:02.487 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "standby_error_status_code", 2024-09-19T07:30:02.487 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.487 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.487 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.487 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "500", 2024-09-19T07:30:02.487 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "400", 2024-09-19T07:30:02.487 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "599", 2024-09-19T07:30:02.487 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.487 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.487 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.487 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.487 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.488 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.488 INFO:teuthology.orchestra.run.smithi148.stdout: "url_prefix": { 2024-09-19T07:30:02.488 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "url_prefix", 2024-09-19T07:30:02.488 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.488 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.488 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.488 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.488 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.488 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.488 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.488 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.488 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.488 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.488 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.489 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.489 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.489 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.489 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:02.489 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "devicehealth", 2024-09-19T07:30:02.489 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:02.489 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:02.489 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:02.489 INFO:teuthology.orchestra.run.smithi148.stdout: "enable_monitoring": { 2024-09-19T07:30:02.489 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "enable_monitoring", 2024-09-19T07:30:02.489 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.489 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.489 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.489 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.490 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.490 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.490 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.490 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "monitor device health metrics", 2024-09-19T07:30:02.490 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.490 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.490 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.490 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.490 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:02.490 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:02.490 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.490 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.490 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.491 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.491 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.491 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.491 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.491 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.491 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.491 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.491 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.491 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.491 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.491 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.491 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.491 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.491 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.492 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.492 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.492 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:02.492 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:02.492 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.492 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.492 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.492 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.492 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.492 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.492 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.492 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.492 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.493 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.493 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.493 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.493 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:02.493 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:02.493 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.493 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.493 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.493 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:02.493 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.493 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.493 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.493 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.494 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.494 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.494 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.494 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.494 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.494 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.494 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.494 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.494 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.494 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.494 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.494 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:02.494 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:02.494 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.495 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.495 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.495 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.495 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.495 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.495 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.495 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.495 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.495 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.495 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.495 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.495 INFO:teuthology.orchestra.run.smithi148.stdout: "mark_out_threshold": { 2024-09-19T07:30:02.495 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "mark_out_threshold", 2024-09-19T07:30:02.495 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:02.496 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.496 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.496 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "2419200", 2024-09-19T07:30:02.496 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.496 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.496 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.496 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T07:30:02.496 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.496 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.496 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.496 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.496 INFO:teuthology.orchestra.run.smithi148.stdout: "pool_name": { 2024-09-19T07:30:02.496 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "pool_name", 2024-09-19T07:30:02.497 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.497 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.497 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.497 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "device_health_metrics", 2024-09-19T07:30:02.497 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.497 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.497 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.497 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T07:30:02.497 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.497 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.497 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.497 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.497 INFO:teuthology.orchestra.run.smithi148.stdout: "retention_period": { 2024-09-19T07:30:02.498 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "retention_period", 2024-09-19T07:30:02.498 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:02.498 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.498 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.498 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "15552000", 2024-09-19T07:30:02.498 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.498 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.498 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.498 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "how long to retain device health metrics", 2024-09-19T07:30:02.498 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.498 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.498 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.498 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.499 INFO:teuthology.orchestra.run.smithi148.stdout: "scrape_frequency": { 2024-09-19T07:30:02.499 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "scrape_frequency", 2024-09-19T07:30:02.499 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:02.499 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.499 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.499 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "86400", 2024-09-19T07:30:02.499 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.499 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.499 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.499 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T07:30:02.499 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.499 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.500 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.500 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.500 INFO:teuthology.orchestra.run.smithi148.stdout: "self_heal": { 2024-09-19T07:30:02.500 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "self_heal", 2024-09-19T07:30:02.500 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.500 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.500 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.500 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.500 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.500 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.500 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.500 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T07:30:02.500 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.500 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.501 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.501 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.501 INFO:teuthology.orchestra.run.smithi148.stdout: "sleep_interval": { 2024-09-19T07:30:02.501 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sleep_interval", 2024-09-19T07:30:02.501 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:02.501 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.501 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.501 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "600", 2024-09-19T07:30:02.501 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.501 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.501 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.501 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T07:30:02.501 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.502 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.502 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.502 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.502 INFO:teuthology.orchestra.run.smithi148.stdout: "warn_threshold": { 2024-09-19T07:30:02.502 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "warn_threshold", 2024-09-19T07:30:02.502 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:02.502 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.502 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.502 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "7257600", 2024-09-19T07:30:02.502 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.502 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.502 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.502 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T07:30:02.502 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.503 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.503 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.503 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.503 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.503 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.503 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:02.503 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "diskprediction_local", 2024-09-19T07:30:02.503 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:02.503 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:02.503 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:02.503 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:02.503 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:02.503 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.504 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.504 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.504 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.504 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.504 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.504 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.504 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.504 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.504 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.504 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.504 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.504 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.504 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.505 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.505 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.505 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.505 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.505 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.505 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:02.505 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:02.505 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.505 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.505 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.505 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.505 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.505 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.506 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.506 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.506 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.506 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.506 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.506 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.506 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:02.506 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:02.506 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.506 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.506 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.506 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:02.506 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.506 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.507 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.507 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.507 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.507 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.507 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.507 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.507 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.507 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.507 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.507 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.507 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.507 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.507 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.508 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:02.508 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:02.508 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.508 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.508 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.508 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.508 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.508 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.508 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.508 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.508 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.508 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.508 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.509 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.509 INFO:teuthology.orchestra.run.smithi148.stdout: "predict_interval": { 2024-09-19T07:30:02.509 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "predict_interval", 2024-09-19T07:30:02.509 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.509 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.509 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.509 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "86400", 2024-09-19T07:30:02.509 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.509 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.509 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.509 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.509 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.509 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.509 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.510 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.510 INFO:teuthology.orchestra.run.smithi148.stdout: "predictor_model": { 2024-09-19T07:30:02.510 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "predictor_model", 2024-09-19T07:30:02.510 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.510 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.510 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.510 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "prophetstor", 2024-09-19T07:30:02.510 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.510 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.510 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.510 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.510 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.510 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.510 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.511 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.511 INFO:teuthology.orchestra.run.smithi148.stdout: "sleep_interval": { 2024-09-19T07:30:02.511 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sleep_interval", 2024-09-19T07:30:02.511 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.511 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.511 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.511 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "600", 2024-09-19T07:30:02.511 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.511 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.511 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.511 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.511 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.511 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.511 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.512 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.512 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.512 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.512 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:02.512 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "influx", 2024-09-19T07:30:02.512 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": false, 2024-09-19T07:30:02.512 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "influxdb python module not found", 2024-09-19T07:30:02.512 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:02.512 INFO:teuthology.orchestra.run.smithi148.stdout: "batch_size": { 2024-09-19T07:30:02.512 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "batch_size", 2024-09-19T07:30:02.512 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.512 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.512 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.513 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "5000", 2024-09-19T07:30:02.513 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.513 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.513 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.513 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T07:30:02.513 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.513 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.513 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.513 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.513 INFO:teuthology.orchestra.run.smithi148.stdout: "database": { 2024-09-19T07:30:02.513 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "database", 2024-09-19T07:30:02.513 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.513 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.514 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.514 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "ceph", 2024-09-19T07:30:02.514 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.514 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.514 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.514 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T07:30:02.514 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.514 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.514 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.514 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.514 INFO:teuthology.orchestra.run.smithi148.stdout: "hostname": { 2024-09-19T07:30:02.514 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "hostname", 2024-09-19T07:30:02.514 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.515 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.515 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.515 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.515 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.515 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.515 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.515 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "InfluxDB server hostname", 2024-09-19T07:30:02.515 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.515 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.515 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.515 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.515 INFO:teuthology.orchestra.run.smithi148.stdout: "interval": { 2024-09-19T07:30:02.515 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "interval", 2024-09-19T07:30:02.515 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:02.516 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.516 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.516 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "30", 2024-09-19T07:30:02.516 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "5", 2024-09-19T07:30:02.516 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.516 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.516 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T07:30:02.516 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.516 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.516 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.516 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.516 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:02.516 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:02.517 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.517 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.517 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.517 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.517 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.517 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.517 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.517 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.517 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.517 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.517 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.517 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.517 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.518 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.518 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.518 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.518 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.518 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.518 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.518 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:02.518 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:02.518 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.518 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.518 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.518 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.518 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.518 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.519 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.519 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.519 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.519 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.519 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.519 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.519 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:02.519 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:02.519 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.519 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.519 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.519 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:02.519 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.519 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.520 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.520 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.520 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.520 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.520 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.520 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.520 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.520 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.520 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.520 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.520 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.520 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.520 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.521 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:02.521 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:02.521 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.521 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.521 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.521 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.521 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.521 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.521 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.521 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.521 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.521 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.521 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.522 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.522 INFO:teuthology.orchestra.run.smithi148.stdout: "password": { 2024-09-19T07:30:02.522 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "password", 2024-09-19T07:30:02.522 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.522 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.522 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.522 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.522 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.522 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.522 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.522 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "password of InfluxDB server user", 2024-09-19T07:30:02.522 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.522 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.523 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.523 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.523 INFO:teuthology.orchestra.run.smithi148.stdout: "port": { 2024-09-19T07:30:02.523 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "port", 2024-09-19T07:30:02.523 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.523 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.523 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.523 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "8086", 2024-09-19T07:30:02.523 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.523 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.523 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.523 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "InfluxDB server port", 2024-09-19T07:30:02.523 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.523 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.524 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.524 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.524 INFO:teuthology.orchestra.run.smithi148.stdout: "ssl": { 2024-09-19T07:30:02.524 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ssl", 2024-09-19T07:30:02.524 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.524 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.524 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.524 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "false", 2024-09-19T07:30:02.524 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.524 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.524 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.524 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T07:30:02.524 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.524 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.525 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.525 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.525 INFO:teuthology.orchestra.run.smithi148.stdout: "threads": { 2024-09-19T07:30:02.525 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "threads", 2024-09-19T07:30:02.525 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.525 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.525 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.525 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "5", 2024-09-19T07:30:02.525 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "1", 2024-09-19T07:30:02.525 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "32", 2024-09-19T07:30:02.525 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.525 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T07:30:02.525 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.526 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.526 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.526 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.526 INFO:teuthology.orchestra.run.smithi148.stdout: "username": { 2024-09-19T07:30:02.526 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "username", 2024-09-19T07:30:02.526 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.526 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.526 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.526 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.526 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.526 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.526 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.526 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "username of InfluxDB server user", 2024-09-19T07:30:02.526 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.527 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.527 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.527 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.527 INFO:teuthology.orchestra.run.smithi148.stdout: "verify_ssl": { 2024-09-19T07:30:02.527 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "verify_ssl", 2024-09-19T07:30:02.527 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.527 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.527 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.527 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "true", 2024-09-19T07:30:02.527 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.527 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.527 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.527 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T07:30:02.528 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.528 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.528 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.528 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.528 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.528 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.528 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:02.528 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "insights", 2024-09-19T07:30:02.528 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:02.528 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:02.528 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:02.528 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:02.528 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:02.529 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.529 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.529 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.529 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.529 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.529 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.529 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.529 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.529 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.529 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.529 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.530 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.530 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.530 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.530 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.530 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.530 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.530 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.530 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.530 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:02.530 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:02.530 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.530 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.530 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.530 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.531 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.531 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.531 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.531 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.531 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.531 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.531 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.531 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.531 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:02.531 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:02.531 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.531 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.531 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.531 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:02.532 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.532 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.532 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.532 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.532 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.532 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.532 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.532 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.532 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.532 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.532 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.532 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.532 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.533 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.533 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.533 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:02.533 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:02.533 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.533 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.533 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.533 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.533 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.533 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.533 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.533 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.533 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.534 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.534 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.534 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.534 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.534 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.534 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:02.534 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "iostat", 2024-09-19T07:30:02.534 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:02.534 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:02.534 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:02.534 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:02.534 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:02.534 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.535 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.535 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.535 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.535 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.535 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.535 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.535 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.535 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.535 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.535 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.535 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.535 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.535 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.536 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.536 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.536 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.536 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.536 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.536 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:02.536 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:02.536 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.536 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.536 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.536 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.536 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.536 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.537 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.537 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.537 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.537 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.537 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.537 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.537 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:02.537 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:02.537 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.537 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.537 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.537 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:02.537 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.537 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.538 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.538 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.538 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.538 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.538 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.538 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.538 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.538 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.538 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.538 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.538 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.538 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.538 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.539 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:02.539 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:02.539 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.539 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.539 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.539 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.539 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.539 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.539 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.539 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.539 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.539 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.539 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.539 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.540 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.540 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.540 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:02.540 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "k8sevents", 2024-09-19T07:30:02.540 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:02.540 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:02.540 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:02.540 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph_event_retention_days": { 2024-09-19T07:30:02.540 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ceph_event_retention_days", 2024-09-19T07:30:02.540 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.540 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.540 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.540 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "7", 2024-09-19T07:30:02.541 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.541 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.541 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.541 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T07:30:02.541 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.541 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.541 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.541 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.541 INFO:teuthology.orchestra.run.smithi148.stdout: "config_check_secs": { 2024-09-19T07:30:02.541 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "config_check_secs", 2024-09-19T07:30:02.541 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.541 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.541 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.541 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10", 2024-09-19T07:30:02.542 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "10", 2024-09-19T07:30:02.542 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.542 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.542 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T07:30:02.542 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.542 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.542 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.542 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.542 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:02.542 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:02.542 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.542 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.543 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.543 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.543 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.543 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.543 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.543 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.543 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.543 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.543 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.543 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.543 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.543 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.543 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.544 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.544 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.544 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.544 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.544 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:02.544 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:02.544 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.544 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.544 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.544 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.544 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.545 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.545 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.545 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.545 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.545 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.545 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.545 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.545 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:02.545 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:02.545 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.545 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.545 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.545 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:02.546 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.546 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.546 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.546 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.546 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.546 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.546 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.547 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.547 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.547 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.547 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.547 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.547 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.547 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.547 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.547 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:02.547 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:02.547 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.547 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.547 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.548 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.548 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.548 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.548 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.548 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.548 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.548 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.548 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.548 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.548 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.548 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.548 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:02.548 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "localpool", 2024-09-19T07:30:02.548 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:02.549 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:02.549 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:02.549 INFO:teuthology.orchestra.run.smithi148.stdout: "failure_domain": { 2024-09-19T07:30:02.549 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "failure_domain", 2024-09-19T07:30:02.549 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.549 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.549 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.549 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "host", 2024-09-19T07:30:02.549 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.549 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.549 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.549 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "failure domain for any created local pool", 2024-09-19T07:30:02.549 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T07:30:02.550 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.550 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.550 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.550 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:02.550 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:02.550 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.550 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.550 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.550 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.550 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.550 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.550 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.550 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.550 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.551 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.551 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.551 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.551 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.551 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.551 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.551 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.551 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.551 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.551 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.551 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:02.551 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:02.551 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.551 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.552 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.552 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.552 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.552 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.552 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.552 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.552 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.552 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.552 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.552 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.552 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:02.552 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:02.552 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.553 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.553 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.553 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:02.553 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.553 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.553 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.553 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.553 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.553 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.553 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.553 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.553 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.553 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.553 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.554 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.554 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.554 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.554 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.554 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:02.554 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:02.554 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.554 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.554 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.554 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.554 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.554 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.554 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.554 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.555 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.555 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.555 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.555 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.555 INFO:teuthology.orchestra.run.smithi148.stdout: "min_size": { 2024-09-19T07:30:02.555 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "min_size", 2024-09-19T07:30:02.555 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.555 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.555 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.555 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.555 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.555 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.555 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.556 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "default min_size for any created local pool", 2024-09-19T07:30:02.556 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T07:30:02.556 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.556 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.556 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.556 INFO:teuthology.orchestra.run.smithi148.stdout: "num_rep": { 2024-09-19T07:30:02.556 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "num_rep", 2024-09-19T07:30:02.556 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.556 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.556 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.556 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "3", 2024-09-19T07:30:02.556 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.557 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.557 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.557 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "default replica count for any created local pool", 2024-09-19T07:30:02.557 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.557 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.557 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.557 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.557 INFO:teuthology.orchestra.run.smithi148.stdout: "pg_num": { 2024-09-19T07:30:02.557 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "pg_num", 2024-09-19T07:30:02.557 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.557 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.557 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.557 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "128", 2024-09-19T07:30:02.558 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.558 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.558 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.558 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T07:30:02.558 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.558 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.558 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.558 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.558 INFO:teuthology.orchestra.run.smithi148.stdout: "prefix": { 2024-09-19T07:30:02.558 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "prefix", 2024-09-19T07:30:02.558 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.558 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.558 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.559 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.559 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.559 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.559 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.559 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "name prefix for any created local pool", 2024-09-19T07:30:02.559 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.559 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.559 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.559 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.559 INFO:teuthology.orchestra.run.smithi148.stdout: "subtree": { 2024-09-19T07:30:02.559 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "subtree", 2024-09-19T07:30:02.559 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.559 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.560 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.560 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "rack", 2024-09-19T07:30:02.560 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.560 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.560 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.560 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T07:30:02.560 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T07:30:02.560 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.560 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.560 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.560 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.560 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.560 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:02.561 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "mds_autoscaler", 2024-09-19T07:30:02.561 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:02.561 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:02.561 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:02.561 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:02.561 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:02.561 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.561 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.561 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.561 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.561 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.561 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.561 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.562 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.562 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.562 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.562 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.562 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.562 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.562 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.562 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.562 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.562 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.562 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.562 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.562 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:02.563 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:02.563 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.563 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.563 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.563 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.563 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.563 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.563 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.563 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.563 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.563 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.563 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.563 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.564 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:02.564 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:02.564 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.564 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.564 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.564 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:02.564 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.564 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.564 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.564 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.564 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.564 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.564 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.564 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.565 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.565 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.565 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.565 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.565 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.565 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.565 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.565 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:02.565 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:02.565 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.565 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.565 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.565 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.565 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.566 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.566 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.566 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.566 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.566 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.566 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.566 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.566 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.566 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.566 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:02.566 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "mirroring", 2024-09-19T07:30:02.566 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:02.566 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:02.566 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:02.567 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:02.567 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:02.567 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.567 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.567 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.567 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.567 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.567 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.567 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.567 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.567 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.567 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.567 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.568 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.568 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.568 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.568 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.568 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.568 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.568 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.568 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.568 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:02.568 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:02.568 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.568 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.568 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.569 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.569 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.569 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.569 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.569 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.569 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.569 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.569 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.569 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.569 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:02.569 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:02.569 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.569 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.569 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.570 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:02.570 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.570 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.570 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.570 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.570 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.570 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.570 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.570 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.570 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.570 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.570 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.570 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.570 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.571 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.571 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.571 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:02.571 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:02.571 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.571 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.571 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.571 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.571 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.571 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.571 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.571 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.572 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.572 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.572 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.572 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.572 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.572 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.572 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:02.572 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "nfs", 2024-09-19T07:30:02.572 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:02.572 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:02.572 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:02.572 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:02.572 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:02.573 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.573 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.573 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.573 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.573 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.573 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.573 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.573 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.573 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.573 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.573 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.573 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.573 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.574 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.574 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.574 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.574 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.574 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.574 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.574 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:02.574 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:02.574 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.574 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.574 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.574 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.574 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.575 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.575 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.575 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.575 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.575 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.575 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.575 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.575 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:02.575 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:02.575 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.575 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.575 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.575 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:02.576 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.576 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.576 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.576 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.576 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.576 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.576 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.576 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.576 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.576 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.576 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.576 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.576 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.576 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.577 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.577 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:02.577 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:02.577 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.577 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.577 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.577 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.577 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.577 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.577 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.577 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.577 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.577 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.578 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.578 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.578 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.578 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.578 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:02.578 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "orchestrator", 2024-09-19T07:30:02.578 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:02.578 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:02.578 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:02.578 INFO:teuthology.orchestra.run.smithi148.stdout: "fail_fs": { 2024-09-19T07:30:02.578 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "fail_fs", 2024-09-19T07:30:02.578 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.578 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.578 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.579 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.579 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.579 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.579 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.579 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T07:30:02.579 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.579 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.579 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.579 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.579 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:02.579 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:02.579 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.579 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.580 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.580 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.580 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.580 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.580 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.580 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.580 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.580 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.580 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.580 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.580 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.580 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.580 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.581 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.581 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.581 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.581 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:02.581 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:02.581 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.581 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.581 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.581 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.581 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.581 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.581 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.581 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.582 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.582 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.582 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.582 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.582 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:02.582 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:02.582 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.582 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.582 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.582 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:02.582 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.582 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.582 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.583 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.583 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.583 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.583 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.583 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.583 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.583 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.583 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.583 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.583 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.583 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.583 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:02.584 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:02.584 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.584 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.584 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.584 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.584 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.584 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.584 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.584 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.584 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.584 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.584 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.584 INFO:teuthology.orchestra.run.smithi148.stdout: "orchestrator": { 2024-09-19T07:30:02.585 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "orchestrator", 2024-09-19T07:30:02.585 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.585 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.585 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.585 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.585 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.585 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.585 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.585 INFO:teuthology.orchestra.run.smithi148.stdout: "cephadm", 2024-09-19T07:30:02.585 INFO:teuthology.orchestra.run.smithi148.stdout: "rook", 2024-09-19T07:30:02.585 INFO:teuthology.orchestra.run.smithi148.stdout: "test_orchestrator" 2024-09-19T07:30:02.585 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.585 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Orchestrator backend", 2024-09-19T07:30:02.586 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.586 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.586 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.586 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.586 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.586 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.586 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:02.586 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "osd_perf_query", 2024-09-19T07:30:02.586 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:02.586 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:02.586 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:02.586 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:02.587 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:02.587 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.587 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.587 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.587 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.587 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.587 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.587 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.587 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.587 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.587 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.587 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.587 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.587 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.588 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.588 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.588 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.588 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.588 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.588 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:02.588 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:02.588 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.588 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.588 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.588 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.588 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.589 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.589 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.589 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.589 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.589 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.589 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.589 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:02.589 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:02.589 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.593 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.593 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.593 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:02.593 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.593 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.593 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.593 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.593 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.593 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.593 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.593 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.593 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.594 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.594 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.594 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.594 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.594 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.594 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.594 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:02.594 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:02.594 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.594 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.594 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.594 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.594 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.595 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.595 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.595 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.595 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.595 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.595 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.595 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.595 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.595 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.595 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:02.595 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "osd_support", 2024-09-19T07:30:02.595 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:02.595 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:02.596 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:02.596 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:02.596 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:02.596 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.596 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.596 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.596 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.596 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.596 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.596 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.596 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.596 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.596 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.597 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.597 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.597 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.597 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.597 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.597 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.597 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.597 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.597 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.597 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:02.597 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:02.597 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.597 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.597 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.598 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.598 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.598 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.598 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.598 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.598 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.598 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.598 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.598 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.598 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:02.598 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:02.598 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.598 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.598 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.599 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:02.599 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.599 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.599 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.599 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.599 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.599 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.599 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.599 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.599 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.599 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.599 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.599 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.600 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.600 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.600 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.600 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:02.600 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:02.600 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.600 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.600 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.600 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.600 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.600 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.600 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.600 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.601 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.601 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.601 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.601 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.601 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.601 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.601 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:02.601 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "pg_autoscaler", 2024-09-19T07:30:02.601 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:02.601 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:02.601 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:02.601 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:02.601 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:02.602 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.602 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.602 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.602 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.602 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.602 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.602 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.602 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.602 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.602 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.602 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.602 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.602 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.602 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.603 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.603 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.603 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.603 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.603 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:02.603 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:02.603 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.603 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.603 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.603 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.603 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.603 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.604 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.604 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.604 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.604 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.604 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.604 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.604 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:02.604 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:02.604 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.604 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.604 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.604 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:02.605 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.605 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.605 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.605 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.605 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.605 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.605 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.605 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.605 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.605 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.605 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.605 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.605 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.606 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.606 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:02.606 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:02.606 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.606 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.606 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.606 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.606 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.606 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.606 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.606 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.606 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.607 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.607 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.607 INFO:teuthology.orchestra.run.smithi148.stdout: "sleep_interval": { 2024-09-19T07:30:02.607 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sleep_interval", 2024-09-19T07:30:02.607 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:02.607 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.607 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.607 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "60", 2024-09-19T07:30:02.607 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.607 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.607 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.607 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.607 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.608 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.608 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.608 INFO:teuthology.orchestra.run.smithi148.stdout: "threshold": { 2024-09-19T07:30:02.608 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "threshold", 2024-09-19T07:30:02.608 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "float", 2024-09-19T07:30:02.608 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.608 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.608 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "3.0", 2024-09-19T07:30:02.608 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "1.0", 2024-09-19T07:30:02.608 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.608 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.608 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "scaling threshold", 2024-09-19T07:30:02.609 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T07:30:02.609 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.609 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.609 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.609 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.609 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.609 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:02.609 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "progress", 2024-09-19T07:30:02.609 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:02.609 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:02.609 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:02.609 INFO:teuthology.orchestra.run.smithi148.stdout: "allow_pg_recovery_event": { 2024-09-19T07:30:02.609 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "allow_pg_recovery_event", 2024-09-19T07:30:02.610 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.610 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.610 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.610 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.610 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.610 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.610 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.610 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T07:30:02.610 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.610 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.610 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.610 INFO:teuthology.orchestra.run.smithi148.stdout: "enabled": { 2024-09-19T07:30:02.610 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "enabled", 2024-09-19T07:30:02.611 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.611 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.611 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.611 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.611 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.611 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.611 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.611 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.611 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.611 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.611 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.611 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:02.611 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:02.612 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.612 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.612 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.612 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.612 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.612 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.612 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.612 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.612 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.612 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.612 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.612 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.612 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.612 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.613 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.613 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.613 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.613 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.613 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.613 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:02.613 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:02.613 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.613 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.613 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.613 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.613 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.613 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.613 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.614 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.614 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.614 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.614 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.614 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.614 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:02.614 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:02.614 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.614 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.614 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.614 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:02.614 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.614 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.615 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.615 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.615 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.615 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.615 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.615 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.615 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.615 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.615 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.615 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.615 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.615 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.615 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.616 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:02.616 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:02.616 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.616 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.616 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.616 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.616 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.616 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.616 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.616 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.616 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.616 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.616 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.616 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.617 INFO:teuthology.orchestra.run.smithi148.stdout: "max_completed_events": { 2024-09-19T07:30:02.617 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "max_completed_events", 2024-09-19T07:30:02.617 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.617 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.617 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.617 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "50", 2024-09-19T07:30:02.617 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.617 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.617 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.617 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "number of past completed events to remember", 2024-09-19T07:30:02.617 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.617 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.617 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.618 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.618 INFO:teuthology.orchestra.run.smithi148.stdout: "sleep_interval": { 2024-09-19T07:30:02.618 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sleep_interval", 2024-09-19T07:30:02.618 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:02.618 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.618 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.618 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "5", 2024-09-19T07:30:02.618 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.618 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.618 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.618 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "how long the module is going to sleep", 2024-09-19T07:30:02.618 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.618 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.619 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.619 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.619 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.619 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.619 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:02.619 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "prometheus", 2024-09-19T07:30:02.619 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:02.619 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:02.619 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:02.619 INFO:teuthology.orchestra.run.smithi148.stdout: "cache": { 2024-09-19T07:30:02.619 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "cache", 2024-09-19T07:30:02.619 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.619 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.620 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.620 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.620 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.620 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.620 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.620 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.620 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.620 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.620 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.620 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.620 INFO:teuthology.orchestra.run.smithi148.stdout: "exclude_perf_counters": { 2024-09-19T07:30:02.620 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "exclude_perf_counters", 2024-09-19T07:30:02.620 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.621 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.621 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.621 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.621 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.621 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.621 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.621 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T07:30:02.621 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T07:30:02.621 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.621 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.621 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.621 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:02.621 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:02.622 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.622 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.622 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.622 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.622 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.622 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.622 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.622 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.622 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.622 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.622 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.622 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.622 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.622 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.623 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.623 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.623 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.623 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.623 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.623 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:02.623 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:02.623 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.623 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.623 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.623 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.623 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.624 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.624 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.624 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.624 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.624 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.624 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.624 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.624 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:02.624 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:02.624 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.624 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.624 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.624 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:02.625 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.625 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.625 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.625 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.625 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.625 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.625 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.625 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.625 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.625 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.625 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.625 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.625 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.626 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.626 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.626 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:02.626 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:02.626 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.626 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.626 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.626 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.626 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.626 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.626 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.626 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.626 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.627 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.627 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.627 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.627 INFO:teuthology.orchestra.run.smithi148.stdout: "rbd_stats_pools": { 2024-09-19T07:30:02.627 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rbd_stats_pools", 2024-09-19T07:30:02.627 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.627 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.627 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.627 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.627 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.627 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.628 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.628 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.628 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.628 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.628 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.628 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.628 INFO:teuthology.orchestra.run.smithi148.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T07:30:02.628 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T07:30:02.628 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.628 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.628 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.628 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "300", 2024-09-19T07:30:02.628 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.629 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.629 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.629 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.629 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.629 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.629 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.629 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.629 INFO:teuthology.orchestra.run.smithi148.stdout: "scrape_interval": { 2024-09-19T07:30:02.629 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "scrape_interval", 2024-09-19T07:30:02.629 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "float", 2024-09-19T07:30:02.629 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.629 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.629 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "15.0", 2024-09-19T07:30:02.630 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.630 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.630 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.630 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.630 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.630 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.630 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.630 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.630 INFO:teuthology.orchestra.run.smithi148.stdout: "server_addr": { 2024-09-19T07:30:02.630 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "server_addr", 2024-09-19T07:30:02.630 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.630 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.630 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.631 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "::", 2024-09-19T07:30:02.631 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.631 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.631 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.631 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T07:30:02.631 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.631 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.631 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.631 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.631 INFO:teuthology.orchestra.run.smithi148.stdout: "server_port": { 2024-09-19T07:30:02.631 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "server_port", 2024-09-19T07:30:02.631 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.631 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.632 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.632 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "9283", 2024-09-19T07:30:02.632 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.632 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.632 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.632 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T07:30:02.632 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.632 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.632 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.632 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.632 INFO:teuthology.orchestra.run.smithi148.stdout: "stale_cache_strategy": { 2024-09-19T07:30:02.632 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "stale_cache_strategy", 2024-09-19T07:30:02.633 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.633 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.633 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.633 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "log", 2024-09-19T07:30:02.633 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.633 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.633 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.633 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.633 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.633 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.633 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.633 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.633 INFO:teuthology.orchestra.run.smithi148.stdout: "standby_behaviour": { 2024-09-19T07:30:02.633 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "standby_behaviour", 2024-09-19T07:30:02.634 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.634 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.634 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.634 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "default", 2024-09-19T07:30:02.634 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.634 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.634 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.634 INFO:teuthology.orchestra.run.smithi148.stdout: "default", 2024-09-19T07:30:02.634 INFO:teuthology.orchestra.run.smithi148.stdout: "error" 2024-09-19T07:30:02.634 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.634 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.634 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.634 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.635 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.635 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.635 INFO:teuthology.orchestra.run.smithi148.stdout: "standby_error_status_code": { 2024-09-19T07:30:02.635 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "standby_error_status_code", 2024-09-19T07:30:02.635 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.635 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.635 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.635 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "500", 2024-09-19T07:30:02.635 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "400", 2024-09-19T07:30:02.635 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "599", 2024-09-19T07:30:02.635 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.635 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.635 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.636 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.636 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.636 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.636 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.636 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.636 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:02.636 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rbd_support", 2024-09-19T07:30:02.636 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:02.636 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:02.636 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:02.636 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:02.636 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:02.636 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.637 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.637 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.637 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.637 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.637 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.637 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.637 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.637 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.637 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.637 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.637 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.637 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.637 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.637 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.638 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.638 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.638 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.638 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.638 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:02.638 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:02.638 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.638 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.638 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.638 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.638 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.638 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.639 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.639 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.639 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.639 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.639 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.639 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.639 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:02.639 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:02.639 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.639 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.639 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.639 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:02.639 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.640 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.640 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.640 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.640 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.640 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.640 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.640 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.640 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.640 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.640 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.640 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.640 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.640 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.641 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.641 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:02.641 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:02.641 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.641 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.641 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.641 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.641 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.641 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.641 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.641 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.641 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.641 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.642 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.642 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.642 INFO:teuthology.orchestra.run.smithi148.stdout: "max_concurrent_snap_create": { 2024-09-19T07:30:02.642 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "max_concurrent_snap_create", 2024-09-19T07:30:02.642 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.642 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.642 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.642 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10", 2024-09-19T07:30:02.642 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.642 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.642 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.642 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.642 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.642 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.643 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.643 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.643 INFO:teuthology.orchestra.run.smithi148.stdout: "mirror_snapshot_schedule": { 2024-09-19T07:30:02.643 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T07:30:02.643 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.643 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.643 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.643 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.643 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.643 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.643 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.643 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.643 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.644 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.644 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.644 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.644 INFO:teuthology.orchestra.run.smithi148.stdout: "trash_purge_schedule": { 2024-09-19T07:30:02.644 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "trash_purge_schedule", 2024-09-19T07:30:02.644 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.644 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.644 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.644 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.644 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.644 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.644 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.644 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.645 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.645 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.645 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.645 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.645 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.645 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.645 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:02.645 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "restful", 2024-09-19T07:30:02.645 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:02.645 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:02.645 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:02.645 INFO:teuthology.orchestra.run.smithi148.stdout: "enable_auth": { 2024-09-19T07:30:02.645 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "enable_auth", 2024-09-19T07:30:02.646 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.646 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.646 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.646 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.646 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.646 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.646 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.646 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.646 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.646 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.646 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.646 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.646 INFO:teuthology.orchestra.run.smithi148.stdout: "key_file": { 2024-09-19T07:30:02.646 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "key_file", 2024-09-19T07:30:02.646 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.647 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.647 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.647 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.647 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.647 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.647 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.647 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.647 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.647 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.647 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.648 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.648 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:02.648 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:02.648 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.648 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.648 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.648 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.648 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.648 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.648 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.648 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.648 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.648 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.648 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.649 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.649 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.649 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.649 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.649 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.649 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.649 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.649 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.649 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:02.649 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:02.649 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.649 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.650 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.650 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.650 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.650 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.650 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.650 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.650 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.650 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.650 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.650 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.650 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:02.650 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:02.650 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.650 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.651 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.651 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:02.651 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.651 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.651 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.651 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.651 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.651 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.651 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.651 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.651 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.651 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.651 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.652 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.652 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.652 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.652 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.652 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:02.652 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:02.652 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.652 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.652 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.652 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.652 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.652 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.652 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.653 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.653 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.653 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.653 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.653 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.653 INFO:teuthology.orchestra.run.smithi148.stdout: "server_addr": { 2024-09-19T07:30:02.653 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "server_addr", 2024-09-19T07:30:02.653 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.653 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.653 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.653 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.653 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.653 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.654 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.654 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.654 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.654 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.654 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.654 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.654 INFO:teuthology.orchestra.run.smithi148.stdout: "server_port": { 2024-09-19T07:30:02.654 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "server_port", 2024-09-19T07:30:02.654 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.654 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.654 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.654 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.654 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.655 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.655 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.655 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.655 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.655 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.655 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.655 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.655 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.655 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.655 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:02.655 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rgw", 2024-09-19T07:30:02.655 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:02.655 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:02.656 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:02.656 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:02.656 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:02.656 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.656 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.656 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.656 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.656 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.656 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.656 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.656 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.656 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.656 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.657 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.657 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.657 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.657 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.657 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.657 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.657 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.657 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.657 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.657 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:02.657 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:02.657 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.657 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.657 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.658 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.658 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.658 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.658 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.658 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.658 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.658 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.658 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.658 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.658 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:02.658 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:02.658 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.658 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.659 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.659 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:02.659 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.659 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.659 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.659 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.659 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.659 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.659 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.659 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.659 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.659 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.659 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.660 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.660 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.660 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.660 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.660 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:02.660 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:02.660 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.660 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.660 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.660 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.660 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.660 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.660 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.661 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.661 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.661 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.661 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.661 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.661 INFO:teuthology.orchestra.run.smithi148.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T07:30:02.661 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T07:30:02.661 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.661 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.661 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.661 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "5", 2024-09-19T07:30:02.661 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.661 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.662 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.662 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T07:30:02.662 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.662 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.662 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.662 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.662 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.662 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.662 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:02.662 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rook", 2024-09-19T07:30:02.662 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:02.662 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:02.663 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:02.663 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:02.663 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:02.663 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.663 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.663 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.663 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.663 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.663 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.663 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.663 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.663 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.663 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.664 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.664 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.664 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.664 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.664 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.664 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.664 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.664 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.664 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.664 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:02.664 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:02.664 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.665 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.665 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.665 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.665 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.665 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.665 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.665 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.665 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.665 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.665 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.665 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.665 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:02.665 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:02.665 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.666 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.666 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.666 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:02.666 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.666 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.666 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.666 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.666 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.666 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.666 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.666 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.666 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.666 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.667 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.667 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.667 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.667 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.667 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.667 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:02.667 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:02.667 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.667 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.667 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.667 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.667 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.667 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.668 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.668 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.668 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.668 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.668 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.668 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.668 INFO:teuthology.orchestra.run.smithi148.stdout: "storage_class": { 2024-09-19T07:30:02.668 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "storage_class", 2024-09-19T07:30:02.668 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.668 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.668 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.668 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "local", 2024-09-19T07:30:02.668 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.668 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.669 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.669 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T07:30:02.669 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.669 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.669 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.669 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.669 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.669 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.669 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:02.669 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "selftest", 2024-09-19T07:30:02.669 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:02.669 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:02.669 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:02.669 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:02.670 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:02.670 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.670 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.670 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.670 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.670 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.670 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.670 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.670 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.670 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.670 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.670 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.670 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.671 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.671 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.671 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.671 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.671 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.671 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.671 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.671 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:02.671 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:02.671 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.671 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.671 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.671 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.672 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.672 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.672 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.672 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.672 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.672 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.672 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.672 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.672 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:02.672 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:02.672 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.672 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.672 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.673 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:02.673 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.673 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.673 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.673 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.673 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.673 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.673 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.673 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.673 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.673 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.673 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.673 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.673 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.674 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.674 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.674 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:02.674 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:02.674 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.674 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.674 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.674 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.674 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.674 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.674 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.674 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.674 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.675 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.675 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.675 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.675 INFO:teuthology.orchestra.run.smithi148.stdout: "roption1": { 2024-09-19T07:30:02.675 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "roption1", 2024-09-19T07:30:02.675 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.675 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.675 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.675 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.675 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.675 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.675 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.675 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.675 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.676 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.676 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.676 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.676 INFO:teuthology.orchestra.run.smithi148.stdout: "roption2": { 2024-09-19T07:30:02.676 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "roption2", 2024-09-19T07:30:02.676 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.676 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.676 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.676 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "xyz", 2024-09-19T07:30:02.676 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.676 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.676 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.676 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.676 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.677 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.677 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.677 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.677 INFO:teuthology.orchestra.run.smithi148.stdout: "rwoption1": { 2024-09-19T07:30:02.677 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rwoption1", 2024-09-19T07:30:02.677 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.677 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.677 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.677 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.677 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.677 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.677 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.678 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.678 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.678 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.678 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.678 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.678 INFO:teuthology.orchestra.run.smithi148.stdout: "rwoption2": { 2024-09-19T07:30:02.678 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rwoption2", 2024-09-19T07:30:02.678 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.678 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.678 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.678 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.678 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.678 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.679 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.679 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.679 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.679 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.679 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.679 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.679 INFO:teuthology.orchestra.run.smithi148.stdout: "rwoption3": { 2024-09-19T07:30:02.679 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rwoption3", 2024-09-19T07:30:02.679 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "float", 2024-09-19T07:30:02.679 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.679 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.679 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.679 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.679 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.680 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.680 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.680 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.680 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.680 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.680 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.680 INFO:teuthology.orchestra.run.smithi148.stdout: "rwoption4": { 2024-09-19T07:30:02.680 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rwoption4", 2024-09-19T07:30:02.680 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.680 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.680 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.680 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.680 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.681 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.681 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.681 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.681 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.681 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.681 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.681 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.681 INFO:teuthology.orchestra.run.smithi148.stdout: "rwoption5": { 2024-09-19T07:30:02.681 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rwoption5", 2024-09-19T07:30:02.681 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.681 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.681 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.681 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.681 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.682 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.682 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.682 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.682 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.682 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.682 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.682 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.682 INFO:teuthology.orchestra.run.smithi148.stdout: "rwoption6": { 2024-09-19T07:30:02.682 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rwoption6", 2024-09-19T07:30:02.682 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.682 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.682 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.682 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.682 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.683 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.683 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.683 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.683 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.683 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.683 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.683 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.683 INFO:teuthology.orchestra.run.smithi148.stdout: "rwoption7": { 2024-09-19T07:30:02.683 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rwoption7", 2024-09-19T07:30:02.683 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.683 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.683 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.683 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.684 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "1", 2024-09-19T07:30:02.684 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "42", 2024-09-19T07:30:02.684 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.684 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.684 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.684 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.684 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.684 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.684 INFO:teuthology.orchestra.run.smithi148.stdout: "testkey": { 2024-09-19T07:30:02.684 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "testkey", 2024-09-19T07:30:02.684 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.684 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.684 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.685 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.685 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.685 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.685 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.685 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.685 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.685 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.685 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.685 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.685 INFO:teuthology.orchestra.run.smithi148.stdout: "testlkey": { 2024-09-19T07:30:02.685 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "testlkey", 2024-09-19T07:30:02.685 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.685 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.686 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.686 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.686 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.686 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.686 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.686 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.686 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.686 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.686 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.686 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.686 INFO:teuthology.orchestra.run.smithi148.stdout: "testnewline": { 2024-09-19T07:30:02.686 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "testnewline", 2024-09-19T07:30:02.686 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.686 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.687 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.687 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.687 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.687 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.687 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.687 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.687 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.687 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.687 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.687 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.687 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.687 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.687 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:02.687 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "snap_schedule", 2024-09-19T07:30:02.688 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:02.688 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:02.688 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:02.688 INFO:teuthology.orchestra.run.smithi148.stdout: "allow_m_granularity": { 2024-09-19T07:30:02.688 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "allow_m_granularity", 2024-09-19T07:30:02.688 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.688 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.688 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.688 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.688 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.688 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.688 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.688 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T07:30:02.689 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.689 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.689 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.689 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.689 INFO:teuthology.orchestra.run.smithi148.stdout: "dump_on_update": { 2024-09-19T07:30:02.689 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "dump_on_update", 2024-09-19T07:30:02.689 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.689 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.689 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.689 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.689 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.689 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.689 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.689 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "dump database to debug log on update", 2024-09-19T07:30:02.690 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.690 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.690 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.690 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.690 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:02.690 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:02.690 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.690 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.690 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.690 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.690 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.690 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.691 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.691 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.691 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.691 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.691 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.691 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.691 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.691 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.691 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.691 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.691 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.691 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.691 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.692 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:02.692 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:02.692 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.692 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.692 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.692 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.692 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.692 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.692 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.692 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.692 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.692 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.692 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.693 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.693 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:02.693 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:02.693 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.693 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.693 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.693 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:02.693 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.693 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.693 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.693 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.693 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.693 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.694 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.694 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.694 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.694 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.694 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.694 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.694 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.694 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.694 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.694 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:02.694 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:02.694 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.694 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.695 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.695 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.695 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.695 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.695 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.695 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.695 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.695 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.695 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.695 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.695 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.695 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.695 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:02.696 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "stats", 2024-09-19T07:30:02.696 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:02.696 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:02.696 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:02.696 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:02.696 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:02.696 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.696 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.696 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.696 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.696 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.696 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.696 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.697 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.697 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.697 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.697 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.697 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.697 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.697 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.697 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.697 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.697 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.697 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.697 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.697 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:02.698 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:02.698 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.698 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.698 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.698 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.698 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.698 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.698 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.698 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.698 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.698 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.698 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.698 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.699 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:02.699 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:02.699 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.699 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.699 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.699 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:02.699 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.699 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.699 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.699 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.699 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.699 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.699 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.700 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.700 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.700 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.700 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.700 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.700 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.700 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.700 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.700 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:02.700 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:02.700 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.700 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.700 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.701 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.701 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.701 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.701 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.701 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.701 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.701 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.701 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.701 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.701 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.701 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.701 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:02.701 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "status", 2024-09-19T07:30:02.702 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:02.702 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:02.702 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:02.702 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:02.702 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:02.702 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.702 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.702 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.702 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.702 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.702 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.702 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.702 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.703 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.703 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.703 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.703 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.703 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.703 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.703 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.703 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.703 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.703 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.703 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.703 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:02.703 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:02.703 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.704 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.704 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.704 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.704 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.704 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.704 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.704 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.704 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.704 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.704 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.704 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.704 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:02.704 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:02.705 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.705 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.705 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.705 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:02.705 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.705 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.705 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.705 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.705 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.705 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.705 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.705 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.705 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.706 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.706 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.706 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.706 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.706 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.706 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.706 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:02.706 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:02.706 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.706 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.706 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.706 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.706 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.707 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.707 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.707 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.707 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.707 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.707 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.707 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.707 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.707 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.707 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:02.707 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "telegraf", 2024-09-19T07:30:02.707 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:02.708 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:02.708 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:02.708 INFO:teuthology.orchestra.run.smithi148.stdout: "address": { 2024-09-19T07:30:02.708 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "address", 2024-09-19T07:30:02.708 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.708 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.708 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.708 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T07:30:02.708 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.708 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.708 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.708 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.709 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.709 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.709 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.709 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.709 INFO:teuthology.orchestra.run.smithi148.stdout: "interval": { 2024-09-19T07:30:02.709 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "interval", 2024-09-19T07:30:02.709 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:02.709 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.709 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.709 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "15", 2024-09-19T07:30:02.709 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.709 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.709 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.710 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.710 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.710 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.710 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.710 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.710 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:02.710 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:02.710 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.710 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.710 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.710 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.710 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.710 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.711 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.711 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.711 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.711 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.711 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.711 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.711 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.711 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.711 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.711 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.711 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.711 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.711 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.712 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:02.712 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:02.712 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.712 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.712 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.712 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.712 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.712 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.712 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.712 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.712 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.712 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.712 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.712 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.713 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:02.713 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:02.713 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.713 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.713 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.713 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:02.713 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.713 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.713 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.713 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.713 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.713 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.714 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.714 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.714 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.714 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.714 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.714 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.714 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.714 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.714 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.714 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:02.714 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:02.714 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.714 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.715 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.715 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.715 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.715 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.715 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.715 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.715 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.715 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.715 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.715 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.715 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.715 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.715 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:02.715 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "telemetry", 2024-09-19T07:30:02.716 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:02.716 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:02.716 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:02.716 INFO:teuthology.orchestra.run.smithi148.stdout: "channel_basic": { 2024-09-19T07:30:02.716 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "channel_basic", 2024-09-19T07:30:02.716 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.716 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.716 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.716 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.716 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.716 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.716 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.716 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T07:30:02.717 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.717 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.717 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.717 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.717 INFO:teuthology.orchestra.run.smithi148.stdout: "channel_crash": { 2024-09-19T07:30:02.717 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "channel_crash", 2024-09-19T07:30:02.717 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.717 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.717 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.717 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.717 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.717 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.717 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.718 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T07:30:02.718 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.718 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.718 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.718 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.718 INFO:teuthology.orchestra.run.smithi148.stdout: "channel_device": { 2024-09-19T07:30:02.718 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "channel_device", 2024-09-19T07:30:02.718 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.718 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.718 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.718 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.718 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.718 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.718 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.719 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T07:30:02.719 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.719 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.719 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.719 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.719 INFO:teuthology.orchestra.run.smithi148.stdout: "channel_ident": { 2024-09-19T07:30:02.719 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "channel_ident", 2024-09-19T07:30:02.719 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.719 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.719 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.719 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.719 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.720 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.720 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.720 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T07:30:02.720 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.720 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.720 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.720 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.720 INFO:teuthology.orchestra.run.smithi148.stdout: "channel_perf": { 2024-09-19T07:30:02.720 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "channel_perf", 2024-09-19T07:30:02.720 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.720 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.720 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.720 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.720 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.721 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.721 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.721 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T07:30:02.721 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.721 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.721 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.721 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.721 INFO:teuthology.orchestra.run.smithi148.stdout: "contact": { 2024-09-19T07:30:02.721 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "contact", 2024-09-19T07:30:02.721 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.721 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.721 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.721 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.722 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.722 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.722 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.722 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.722 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.722 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.722 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.722 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.722 INFO:teuthology.orchestra.run.smithi148.stdout: "description": { 2024-09-19T07:30:02.722 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "description", 2024-09-19T07:30:02.722 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.722 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.722 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.723 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.723 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.723 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.723 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.723 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.723 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.723 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.723 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.723 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.723 INFO:teuthology.orchestra.run.smithi148.stdout: "device_url": { 2024-09-19T07:30:02.723 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "device_url", 2024-09-19T07:30:02.723 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.723 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.723 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.724 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T07:30:02.724 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.724 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.724 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.724 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.724 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.724 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.724 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.724 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.724 INFO:teuthology.orchestra.run.smithi148.stdout: "enabled": { 2024-09-19T07:30:02.724 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "enabled", 2024-09-19T07:30:02.724 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.724 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.725 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.725 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.725 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.725 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.725 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.725 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.725 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.725 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.725 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.725 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.725 INFO:teuthology.orchestra.run.smithi148.stdout: "interval": { 2024-09-19T07:30:02.725 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "interval", 2024-09-19T07:30:02.725 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.725 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.726 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.726 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "24", 2024-09-19T07:30:02.726 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "8", 2024-09-19T07:30:02.726 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.726 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.726 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.726 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.726 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.726 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.726 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.726 INFO:teuthology.orchestra.run.smithi148.stdout: "last_opt_revision": { 2024-09-19T07:30:02.726 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "last_opt_revision", 2024-09-19T07:30:02.726 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.726 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.727 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.727 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "1", 2024-09-19T07:30:02.727 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.727 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.727 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.727 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.727 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.727 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.727 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.727 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.727 INFO:teuthology.orchestra.run.smithi148.stdout: "leaderboard": { 2024-09-19T07:30:02.727 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "leaderboard", 2024-09-19T07:30:02.727 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.728 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.728 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.728 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.728 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.728 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.728 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.728 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.728 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.728 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.728 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.728 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.728 INFO:teuthology.orchestra.run.smithi148.stdout: "leaderboard_description": { 2024-09-19T07:30:02.729 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "leaderboard_description", 2024-09-19T07:30:02.729 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.729 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.729 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.729 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.729 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.729 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.729 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.729 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.729 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.729 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.729 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.729 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.729 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:02.730 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:02.730 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.730 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.730 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.730 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.730 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.730 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.730 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.730 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.730 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.730 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.730 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.730 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.730 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.731 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.731 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.731 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.731 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.731 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.731 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.731 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:02.731 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:02.731 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.731 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.731 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.731 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.731 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.732 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.732 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.732 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.732 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.732 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.732 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.732 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.732 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:02.732 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:02.732 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.732 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.732 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.732 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:02.733 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.733 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.733 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.733 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.733 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.733 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.733 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.733 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.733 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.733 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.733 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.733 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.733 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.733 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.734 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.734 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:02.734 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:02.734 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.734 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.734 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.734 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.734 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.734 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.734 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.734 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.734 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.734 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.734 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.735 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.735 INFO:teuthology.orchestra.run.smithi148.stdout: "organization": { 2024-09-19T07:30:02.735 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "organization", 2024-09-19T07:30:02.735 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.735 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.735 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.735 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.735 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.735 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.735 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.735 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.735 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.736 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.736 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.736 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.736 INFO:teuthology.orchestra.run.smithi148.stdout: "proxy": { 2024-09-19T07:30:02.736 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "proxy", 2024-09-19T07:30:02.736 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.736 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.736 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.736 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.736 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.736 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.736 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.736 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.737 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.737 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.737 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.737 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.737 INFO:teuthology.orchestra.run.smithi148.stdout: "url": { 2024-09-19T07:30:02.737 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "url", 2024-09-19T07:30:02.737 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.737 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.737 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.737 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T07:30:02.737 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.737 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.737 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.738 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.738 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.738 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.738 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.738 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.738 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.738 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.738 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:02.738 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "test_orchestrator", 2024-09-19T07:30:02.738 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:02.738 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:02.738 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:02.738 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:02.739 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:02.739 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.739 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.739 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.739 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.739 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.739 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.739 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.739 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.739 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.739 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.739 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.739 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.740 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.740 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.740 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.740 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.740 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.740 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.740 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.740 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:02.740 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:02.740 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.740 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.740 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.740 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.741 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.741 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.741 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.741 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.741 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.741 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.741 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.741 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.741 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:02.741 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:02.741 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.741 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.741 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.741 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:02.742 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.742 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.742 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.742 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.742 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.742 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.742 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.742 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.742 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.742 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.742 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.742 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.742 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.743 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.743 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.743 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:02.743 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:02.743 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.743 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.743 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.743 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.743 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.743 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.743 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.743 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.743 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.743 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.744 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.744 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.744 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.744 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.744 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:02.744 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "volumes", 2024-09-19T07:30:02.744 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:02.744 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:02.744 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:02.744 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:02.744 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:02.744 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.744 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.745 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.745 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.745 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.745 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.745 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.745 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.745 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.745 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.745 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.745 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.745 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.745 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.745 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.745 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.746 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.746 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.746 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.746 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:02.746 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:02.746 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.746 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.746 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.746 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.746 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.746 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.746 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.746 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.747 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.747 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.747 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.747 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.747 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:02.747 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:02.747 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.747 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.747 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.747 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:02.747 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.747 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.747 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.748 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.748 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.748 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.748 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.748 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.748 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.748 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.748 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.748 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.748 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.748 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.748 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.748 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:02.749 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:02.749 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.749 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.749 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.749 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.749 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.749 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.749 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.749 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.749 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.749 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.749 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.749 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.750 INFO:teuthology.orchestra.run.smithi148.stdout: "max_concurrent_clones": { 2024-09-19T07:30:02.750 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "max_concurrent_clones", 2024-09-19T07:30:02.750 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.750 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.750 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.750 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "4", 2024-09-19T07:30:02.750 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.750 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.750 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.750 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T07:30:02.750 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.750 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.751 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.751 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.751 INFO:teuthology.orchestra.run.smithi148.stdout: "periodic_async_work": { 2024-09-19T07:30:02.751 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "periodic_async_work", 2024-09-19T07:30:02.751 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.751 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.751 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.751 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.751 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.751 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.751 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.751 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Periodically check for async work", 2024-09-19T07:30:02.751 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.751 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.752 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.752 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.752 INFO:teuthology.orchestra.run.smithi148.stdout: "snapshot_clone_delay": { 2024-09-19T07:30:02.752 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "snapshot_clone_delay", 2024-09-19T07:30:02.752 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.752 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.752 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.752 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-19T07:30:02.752 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.752 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.752 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.752 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T07:30:02.753 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.753 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.753 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.753 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.753 INFO:teuthology.orchestra.run.smithi148.stdout: "snapshot_clone_no_wait": { 2024-09-19T07:30:02.753 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T07:30:02.753 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.753 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.753 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.753 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.757 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.757 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.757 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.757 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T07:30:02.757 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.757 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.757 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.757 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.758 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.758 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.758 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:02.758 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "zabbix", 2024-09-19T07:30:02.758 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:02.758 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:02.758 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:02.758 INFO:teuthology.orchestra.run.smithi148.stdout: "discovery_interval": { 2024-09-19T07:30:02.758 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "discovery_interval", 2024-09-19T07:30:02.758 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "uint", 2024-09-19T07:30:02.758 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.758 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.758 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "100", 2024-09-19T07:30:02.758 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.759 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.759 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.759 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.759 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.759 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.759 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.759 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.759 INFO:teuthology.orchestra.run.smithi148.stdout: "identifier": { 2024-09-19T07:30:02.759 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "identifier", 2024-09-19T07:30:02.759 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.759 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.759 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.759 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.760 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.760 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.760 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.760 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.760 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.760 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.760 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.760 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.760 INFO:teuthology.orchestra.run.smithi148.stdout: "interval": { 2024-09-19T07:30:02.760 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "interval", 2024-09-19T07:30:02.760 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:02.760 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.760 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.761 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "60", 2024-09-19T07:30:02.761 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.761 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.761 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.761 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.761 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.761 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.761 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.761 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.761 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:02.761 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:02.761 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.761 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.761 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.762 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.762 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.762 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.762 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.762 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.762 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.762 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.762 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.762 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.762 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.762 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.762 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.762 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.762 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.763 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.763 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.763 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:02.763 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:02.763 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.763 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.763 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.763 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.763 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.763 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.763 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.763 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.763 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.764 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.764 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.764 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.764 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:02.764 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:02.764 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.764 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.764 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.764 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:02.764 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.764 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.764 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.764 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.765 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.765 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.765 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.765 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.765 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.765 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.765 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.765 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.765 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.765 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.765 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.765 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:02.765 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:02.765 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.766 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.766 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.766 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.766 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.766 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.766 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.766 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.766 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.766 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.766 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.766 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.766 INFO:teuthology.orchestra.run.smithi148.stdout: "zabbix_host": { 2024-09-19T07:30:02.766 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "zabbix_host", 2024-09-19T07:30:02.767 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.767 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.767 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.767 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.767 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.767 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.767 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.767 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.767 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.767 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.767 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.767 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.767 INFO:teuthology.orchestra.run.smithi148.stdout: "zabbix_port": { 2024-09-19T07:30:02.767 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "zabbix_port", 2024-09-19T07:30:02.768 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.768 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.768 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.768 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10051", 2024-09-19T07:30:02.768 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.768 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.768 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.768 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.768 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.768 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.768 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.768 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.769 INFO:teuthology.orchestra.run.smithi148.stdout: "zabbix_sender": { 2024-09-19T07:30:02.769 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "zabbix_sender", 2024-09-19T07:30:02.769 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.769 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.769 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.769 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T07:30:02.769 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.769 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.769 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.769 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.769 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.769 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.769 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.769 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.770 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.770 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.770 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-19T07:30:02.770 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.770 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:02.770 INFO:teuthology.orchestra.run.smithi148.stdout: "gid": 24784, 2024-09-19T07:30:02.770 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "z", 2024-09-19T07:30:02.770 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr_features": 4540701547738038271, 2024-09-19T07:30:02.770 INFO:teuthology.orchestra.run.smithi148.stdout: "available_modules": [ 2024-09-19T07:30:02.770 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:02.770 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "alerts", 2024-09-19T07:30:02.770 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:02.770 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:02.771 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:02.771 INFO:teuthology.orchestra.run.smithi148.stdout: "interval": { 2024-09-19T07:30:02.771 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "interval", 2024-09-19T07:30:02.771 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:02.771 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.771 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.771 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "60", 2024-09-19T07:30:02.771 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.771 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.771 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.771 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T07:30:02.771 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.771 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.771 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.772 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.772 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:02.772 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:02.772 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.772 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.772 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.772 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.772 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.772 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.772 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.772 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.772 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.773 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.773 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.773 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.773 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.773 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.773 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.773 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.773 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.773 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.773 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.773 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:02.773 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:02.773 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.773 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.774 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.774 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.774 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.774 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.774 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.774 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.774 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.774 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.774 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.774 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.774 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:02.774 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:02.774 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.775 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.775 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.775 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:02.775 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.775 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.775 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.775 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.775 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.775 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.775 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.775 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.775 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.775 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.775 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.776 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.776 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.776 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.776 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.776 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:02.776 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:02.776 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.776 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.776 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.776 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.776 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.776 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.777 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.777 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.777 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.777 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.777 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.777 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.777 INFO:teuthology.orchestra.run.smithi148.stdout: "smtp_destination": { 2024-09-19T07:30:02.777 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smtp_destination", 2024-09-19T07:30:02.777 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.777 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.777 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.777 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.777 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.778 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.778 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.778 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Email address to send alerts to", 2024-09-19T07:30:02.778 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.778 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.778 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.778 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.778 INFO:teuthology.orchestra.run.smithi148.stdout: "smtp_from_name": { 2024-09-19T07:30:02.778 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smtp_from_name", 2024-09-19T07:30:02.778 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.778 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.778 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.778 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "Ceph", 2024-09-19T07:30:02.778 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.779 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.779 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.779 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Email From: name", 2024-09-19T07:30:02.779 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.779 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.779 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.779 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.779 INFO:teuthology.orchestra.run.smithi148.stdout: "smtp_host": { 2024-09-19T07:30:02.779 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smtp_host", 2024-09-19T07:30:02.779 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.779 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.779 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.779 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.779 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.780 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.780 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.780 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "SMTP server", 2024-09-19T07:30:02.780 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.780 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.780 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.780 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.780 INFO:teuthology.orchestra.run.smithi148.stdout: "smtp_password": { 2024-09-19T07:30:02.780 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smtp_password", 2024-09-19T07:30:02.780 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.780 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.780 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.780 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.781 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.781 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.781 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.781 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Password to authenticate with", 2024-09-19T07:30:02.781 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.781 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.781 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.781 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.781 INFO:teuthology.orchestra.run.smithi148.stdout: "smtp_port": { 2024-09-19T07:30:02.781 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smtp_port", 2024-09-19T07:30:02.781 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.781 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.781 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.782 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "465", 2024-09-19T07:30:02.782 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.782 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.782 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.782 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "SMTP port", 2024-09-19T07:30:02.782 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.782 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.782 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.782 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.782 INFO:teuthology.orchestra.run.smithi148.stdout: "smtp_sender": { 2024-09-19T07:30:02.782 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smtp_sender", 2024-09-19T07:30:02.782 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.782 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.783 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.783 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.783 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.783 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.783 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.783 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "SMTP envelope sender", 2024-09-19T07:30:02.783 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.783 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.783 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.783 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.783 INFO:teuthology.orchestra.run.smithi148.stdout: "smtp_ssl": { 2024-09-19T07:30:02.783 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smtp_ssl", 2024-09-19T07:30:02.783 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.784 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.784 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.784 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.784 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.784 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.784 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.784 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T07:30:02.784 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.784 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.784 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.784 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.784 INFO:teuthology.orchestra.run.smithi148.stdout: "smtp_user": { 2024-09-19T07:30:02.785 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smtp_user", 2024-09-19T07:30:02.785 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.785 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.785 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.785 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.785 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.785 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.785 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.785 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "User to authenticate as", 2024-09-19T07:30:02.785 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.785 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.785 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.785 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.786 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.786 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.786 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:02.786 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "balancer", 2024-09-19T07:30:02.786 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:02.786 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:02.786 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:02.786 INFO:teuthology.orchestra.run.smithi148.stdout: "active": { 2024-09-19T07:30:02.786 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "active", 2024-09-19T07:30:02.786 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.786 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.786 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.786 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.787 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.787 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.787 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.787 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T07:30:02.787 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.787 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.787 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.787 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.787 INFO:teuthology.orchestra.run.smithi148.stdout: "begin_time": { 2024-09-19T07:30:02.787 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "begin_time", 2024-09-19T07:30:02.787 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.787 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.787 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.787 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0000", 2024-09-19T07:30:02.788 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.788 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.788 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.788 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T07:30:02.788 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T07:30:02.788 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.788 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.788 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.788 INFO:teuthology.orchestra.run.smithi148.stdout: "begin_weekday": { 2024-09-19T07:30:02.788 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "begin_weekday", 2024-09-19T07:30:02.788 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "uint", 2024-09-19T07:30:02.788 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.788 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.789 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-19T07:30:02.789 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "0", 2024-09-19T07:30:02.789 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "6", 2024-09-19T07:30:02.789 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.789 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T07:30:02.789 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T07:30:02.789 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.789 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.789 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.789 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_compat_max_iterations": { 2024-09-19T07:30:02.789 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "crush_compat_max_iterations", 2024-09-19T07:30:02.789 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "uint", 2024-09-19T07:30:02.789 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.790 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.790 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "25", 2024-09-19T07:30:02.790 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "1", 2024-09-19T07:30:02.790 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "250", 2024-09-19T07:30:02.790 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.790 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T07:30:02.790 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.790 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.790 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.790 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.790 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_compat_metrics": { 2024-09-19T07:30:02.790 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "crush_compat_metrics", 2024-09-19T07:30:02.790 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.790 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.791 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.791 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T07:30:02.791 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.791 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.791 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.791 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T07:30:02.791 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T07:30:02.791 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.791 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.791 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.791 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_compat_step": { 2024-09-19T07:30:02.791 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "crush_compat_step", 2024-09-19T07:30:02.791 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "float", 2024-09-19T07:30:02.791 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.792 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.792 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0.5", 2024-09-19T07:30:02.792 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "0.001", 2024-09-19T07:30:02.792 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "0.999", 2024-09-19T07:30:02.792 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.792 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "aggressiveness of optimization", 2024-09-19T07:30:02.792 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T07:30:02.792 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.792 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.792 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.792 INFO:teuthology.orchestra.run.smithi148.stdout: "end_time": { 2024-09-19T07:30:02.792 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "end_time", 2024-09-19T07:30:02.792 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.793 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.793 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.793 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "2359", 2024-09-19T07:30:02.793 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.793 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.793 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.793 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T07:30:02.793 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T07:30:02.793 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.793 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.793 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.793 INFO:teuthology.orchestra.run.smithi148.stdout: "end_weekday": { 2024-09-19T07:30:02.793 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "end_weekday", 2024-09-19T07:30:02.794 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "uint", 2024-09-19T07:30:02.794 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.794 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.794 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-19T07:30:02.794 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "0", 2024-09-19T07:30:02.794 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "6", 2024-09-19T07:30:02.794 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.794 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T07:30:02.794 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T07:30:02.794 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.794 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.794 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.794 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:02.794 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:02.795 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.795 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.795 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.795 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.795 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.795 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.795 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.795 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.795 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.795 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.795 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.795 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.795 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.796 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.796 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.796 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.796 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.796 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.796 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.796 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:02.796 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:02.796 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.796 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.796 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.796 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.796 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.797 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.797 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.797 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.797 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.797 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.797 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.797 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.797 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:02.797 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:02.797 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.797 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.797 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.797 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:02.798 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.798 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.798 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.798 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.798 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.798 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.798 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.798 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.798 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.798 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.798 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.798 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.798 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.799 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.799 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.799 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:02.799 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:02.799 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.799 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.799 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.799 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.799 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.799 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.799 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.799 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.799 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.800 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.800 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.800 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.800 INFO:teuthology.orchestra.run.smithi148.stdout: "min_score": { 2024-09-19T07:30:02.800 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "min_score", 2024-09-19T07:30:02.800 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "float", 2024-09-19T07:30:02.800 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.800 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.800 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-19T07:30:02.800 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.800 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.800 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.800 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T07:30:02.801 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.801 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.801 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.801 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.801 INFO:teuthology.orchestra.run.smithi148.stdout: "mode": { 2024-09-19T07:30:02.801 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "mode", 2024-09-19T07:30:02.801 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.801 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.801 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.801 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "upmap", 2024-09-19T07:30:02.801 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.801 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.801 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.802 INFO:teuthology.orchestra.run.smithi148.stdout: "crush-compat", 2024-09-19T07:30:02.802 INFO:teuthology.orchestra.run.smithi148.stdout: "none", 2024-09-19T07:30:02.802 INFO:teuthology.orchestra.run.smithi148.stdout: "read", 2024-09-19T07:30:02.802 INFO:teuthology.orchestra.run.smithi148.stdout: "upmap", 2024-09-19T07:30:02.802 INFO:teuthology.orchestra.run.smithi148.stdout: "upmap-read" 2024-09-19T07:30:02.802 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.802 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Balancer mode", 2024-09-19T07:30:02.802 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.802 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.802 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.802 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.802 INFO:teuthology.orchestra.run.smithi148.stdout: "pool_ids": { 2024-09-19T07:30:02.802 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "pool_ids", 2024-09-19T07:30:02.803 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.803 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.803 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.803 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.803 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.803 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.803 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.803 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T07:30:02.803 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.803 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.803 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.803 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.803 INFO:teuthology.orchestra.run.smithi148.stdout: "sleep_interval": { 2024-09-19T07:30:02.803 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sleep_interval", 2024-09-19T07:30:02.804 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:02.804 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.804 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.804 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "60", 2024-09-19T07:30:02.804 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.804 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.804 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.804 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T07:30:02.804 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.804 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.804 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.804 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.804 INFO:teuthology.orchestra.run.smithi148.stdout: "upmap_max_deviation": { 2024-09-19T07:30:02.805 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "upmap_max_deviation", 2024-09-19T07:30:02.805 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.805 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.805 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.805 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "5", 2024-09-19T07:30:02.805 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "1", 2024-09-19T07:30:02.805 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.805 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.805 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T07:30:02.805 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T07:30:02.805 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.805 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.805 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.805 INFO:teuthology.orchestra.run.smithi148.stdout: "upmap_max_optimizations": { 2024-09-19T07:30:02.806 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "upmap_max_optimizations", 2024-09-19T07:30:02.806 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "uint", 2024-09-19T07:30:02.806 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.806 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.806 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10", 2024-09-19T07:30:02.806 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.806 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.806 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.806 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T07:30:02.806 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.806 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.806 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.806 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.806 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.807 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.807 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:02.807 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "cephadm", 2024-09-19T07:30:02.807 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:02.807 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:02.807 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:02.807 INFO:teuthology.orchestra.run.smithi148.stdout: "agent_down_multiplier": { 2024-09-19T07:30:02.807 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "agent_down_multiplier", 2024-09-19T07:30:02.807 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "float", 2024-09-19T07:30:02.807 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.807 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.807 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "3.0", 2024-09-19T07:30:02.807 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.807 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.808 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.808 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T07:30:02.808 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.808 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.808 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.808 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.808 INFO:teuthology.orchestra.run.smithi148.stdout: "agent_refresh_rate": { 2024-09-19T07:30:02.808 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "agent_refresh_rate", 2024-09-19T07:30:02.808 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:02.808 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.808 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.808 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "20", 2024-09-19T07:30:02.808 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.809 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.809 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.809 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T07:30:02.809 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.809 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.809 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.809 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.809 INFO:teuthology.orchestra.run.smithi148.stdout: "agent_starting_port": { 2024-09-19T07:30:02.809 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "agent_starting_port", 2024-09-19T07:30:02.809 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.809 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.809 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.809 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "4721", 2024-09-19T07:30:02.809 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.810 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.810 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.810 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T07:30:02.810 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.810 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.810 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.810 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.810 INFO:teuthology.orchestra.run.smithi148.stdout: "allow_ptrace": { 2024-09-19T07:30:02.810 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "allow_ptrace", 2024-09-19T07:30:02.810 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.810 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.810 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.810 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.811 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.811 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.811 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.811 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T07:30:02.811 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T07:30:02.811 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.811 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.811 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.811 INFO:teuthology.orchestra.run.smithi148.stdout: "autotune_interval": { 2024-09-19T07:30:02.811 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "autotune_interval", 2024-09-19T07:30:02.811 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:02.811 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.811 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.812 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "600", 2024-09-19T07:30:02.812 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.812 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.812 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.812 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T07:30:02.812 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.812 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.812 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.812 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.812 INFO:teuthology.orchestra.run.smithi148.stdout: "autotune_memory_target_ratio": { 2024-09-19T07:30:02.812 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T07:30:02.812 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "float", 2024-09-19T07:30:02.812 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.812 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.813 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0.7", 2024-09-19T07:30:02.813 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.813 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.813 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.813 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T07:30:02.813 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.813 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.813 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.813 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.813 INFO:teuthology.orchestra.run.smithi148.stdout: "cephadm_log_destination": { 2024-09-19T07:30:02.813 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "cephadm_log_destination", 2024-09-19T07:30:02.813 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.813 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.814 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.814 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.814 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.814 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.814 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.814 INFO:teuthology.orchestra.run.smithi148.stdout: "file", 2024-09-19T07:30:02.814 INFO:teuthology.orchestra.run.smithi148.stdout: "file,syslog", 2024-09-19T07:30:02.814 INFO:teuthology.orchestra.run.smithi148.stdout: "syslog" 2024-09-19T07:30:02.814 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.814 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T07:30:02.814 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.814 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.814 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.815 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.815 INFO:teuthology.orchestra.run.smithi148.stdout: "cgroups_split": { 2024-09-19T07:30:02.815 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "cgroups_split", 2024-09-19T07:30:02.815 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.815 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.815 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.815 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.815 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.815 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.815 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.815 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T07:30:02.815 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.815 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.815 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.816 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.816 INFO:teuthology.orchestra.run.smithi148.stdout: "config_checks_enabled": { 2024-09-19T07:30:02.816 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "config_checks_enabled", 2024-09-19T07:30:02.816 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.816 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.816 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.816 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.816 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.816 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.816 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.816 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T07:30:02.816 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.816 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.817 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.817 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.817 INFO:teuthology.orchestra.run.smithi148.stdout: "config_dashboard": { 2024-09-19T07:30:02.817 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "config_dashboard", 2024-09-19T07:30:02.817 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.817 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.817 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.817 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.817 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.817 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.817 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.817 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T07:30:02.817 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.818 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.818 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.818 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.818 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_alertmanager": { 2024-09-19T07:30:02.818 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_alertmanager", 2024-09-19T07:30:02.818 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.818 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.818 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.818 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T07:30:02.818 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.818 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.818 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.818 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Prometheus container image", 2024-09-19T07:30:02.818 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.819 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.819 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.819 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.819 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_base": { 2024-09-19T07:30:02.819 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_base", 2024-09-19T07:30:02.819 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.819 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.819 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.819 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T07:30:02.819 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.819 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.819 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.819 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Container image name, without the tag", 2024-09-19T07:30:02.820 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.820 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.820 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.820 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.820 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_elasticsearch": { 2024-09-19T07:30:02.820 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_elasticsearch", 2024-09-19T07:30:02.820 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.820 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.820 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.820 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T07:30:02.820 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.820 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.820 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.820 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "elasticsearch container image", 2024-09-19T07:30:02.821 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.821 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.821 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.821 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.821 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_grafana": { 2024-09-19T07:30:02.821 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_grafana", 2024-09-19T07:30:02.821 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.821 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.821 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.821 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T07:30:02.821 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.821 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.821 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.821 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Prometheus container image", 2024-09-19T07:30:02.822 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.822 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.822 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.822 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.822 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_haproxy": { 2024-09-19T07:30:02.822 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_haproxy", 2024-09-19T07:30:02.822 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.822 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.822 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.822 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T07:30:02.822 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.822 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.823 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.823 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "HAproxy container image", 2024-09-19T07:30:02.823 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.823 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.823 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.823 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.823 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_jaeger_agent": { 2024-09-19T07:30:02.823 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_jaeger_agent", 2024-09-19T07:30:02.823 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.823 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.823 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.823 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T07:30:02.823 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.824 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.824 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.824 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Jaeger agent container image", 2024-09-19T07:30:02.824 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.824 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.824 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.824 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.824 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_jaeger_collector": { 2024-09-19T07:30:02.824 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_jaeger_collector", 2024-09-19T07:30:02.824 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.824 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.824 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.824 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T07:30:02.825 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.825 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.825 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.825 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Jaeger collector container image", 2024-09-19T07:30:02.825 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.825 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.825 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.825 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.825 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_jaeger_query": { 2024-09-19T07:30:02.825 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_jaeger_query", 2024-09-19T07:30:02.825 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.825 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.825 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.826 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T07:30:02.826 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.826 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.826 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.826 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Jaeger query container image", 2024-09-19T07:30:02.826 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.826 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.826 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.826 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.826 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_keepalived": { 2024-09-19T07:30:02.826 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_keepalived", 2024-09-19T07:30:02.826 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.826 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.827 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.827 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T07:30:02.827 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.827 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.827 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.827 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Keepalived container image", 2024-09-19T07:30:02.827 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.827 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.827 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.827 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.827 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_loki": { 2024-09-19T07:30:02.827 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_loki", 2024-09-19T07:30:02.827 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.827 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.828 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.828 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T07:30:02.828 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.828 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.828 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.828 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Loki container image", 2024-09-19T07:30:02.828 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.828 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.828 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.828 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.828 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_node_exporter": { 2024-09-19T07:30:02.828 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_node_exporter", 2024-09-19T07:30:02.828 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.829 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.829 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.829 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T07:30:02.829 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.829 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.829 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.829 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Prometheus container image", 2024-09-19T07:30:02.829 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.829 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.829 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.829 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.829 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_nvmeof": { 2024-09-19T07:30:02.829 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_nvmeof", 2024-09-19T07:30:02.830 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.830 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.830 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.830 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T07:30:02.830 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.830 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.830 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.830 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Nvme-of container image", 2024-09-19T07:30:02.830 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.830 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.830 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.830 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.830 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_prometheus": { 2024-09-19T07:30:02.830 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_prometheus", 2024-09-19T07:30:02.831 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.831 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.831 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.831 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T07:30:02.831 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.831 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.831 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.831 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Prometheus container image", 2024-09-19T07:30:02.831 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.831 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.831 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.831 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.831 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_promtail": { 2024-09-19T07:30:02.832 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_promtail", 2024-09-19T07:30:02.832 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.832 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.832 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.832 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T07:30:02.832 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.832 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.832 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.832 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Promtail container image", 2024-09-19T07:30:02.832 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.832 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.832 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.832 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.833 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_samba": { 2024-09-19T07:30:02.833 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_samba", 2024-09-19T07:30:02.833 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.833 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.833 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.833 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T07:30:02.833 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.833 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.833 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.833 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Samba/SMB container image", 2024-09-19T07:30:02.833 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.833 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.833 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.833 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.834 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_snmp_gateway": { 2024-09-19T07:30:02.834 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_snmp_gateway", 2024-09-19T07:30:02.834 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.834 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.834 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.834 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T07:30:02.834 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.834 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.834 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.834 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "SNMP Gateway container image", 2024-09-19T07:30:02.834 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.834 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.834 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.835 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.835 INFO:teuthology.orchestra.run.smithi148.stdout: "container_init": { 2024-09-19T07:30:02.835 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_init", 2024-09-19T07:30:02.835 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.835 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.835 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.835 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.835 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.835 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.835 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.835 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T07:30:02.835 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.836 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.836 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.836 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.836 INFO:teuthology.orchestra.run.smithi148.stdout: "daemon_cache_timeout": { 2024-09-19T07:30:02.836 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "daemon_cache_timeout", 2024-09-19T07:30:02.836 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:02.836 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.836 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.836 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "600", 2024-09-19T07:30:02.836 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.836 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.836 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.836 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T07:30:02.837 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.837 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.837 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.837 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.837 INFO:teuthology.orchestra.run.smithi148.stdout: "default_cephadm_command_timeout": { 2024-09-19T07:30:02.837 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T07:30:02.837 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.837 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.837 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.837 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "900", 2024-09-19T07:30:02.837 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.837 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.837 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.838 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T07:30:02.838 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.838 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.838 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.838 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.838 INFO:teuthology.orchestra.run.smithi148.stdout: "default_registry": { 2024-09-19T07:30:02.838 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "default_registry", 2024-09-19T07:30:02.838 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.838 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.838 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.838 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "docker.io", 2024-09-19T07:30:02.838 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.838 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.838 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.839 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T07:30:02.839 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.839 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.839 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.839 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.839 INFO:teuthology.orchestra.run.smithi148.stdout: "device_cache_timeout": { 2024-09-19T07:30:02.839 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "device_cache_timeout", 2024-09-19T07:30:02.839 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:02.839 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.839 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.839 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "1800", 2024-09-19T07:30:02.839 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.839 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.840 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.840 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "seconds to cache device inventory", 2024-09-19T07:30:02.840 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.840 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.840 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.840 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.840 INFO:teuthology.orchestra.run.smithi148.stdout: "device_enhanced_scan": { 2024-09-19T07:30:02.840 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "device_enhanced_scan", 2024-09-19T07:30:02.840 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.840 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.840 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.840 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.840 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.841 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.841 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.841 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T07:30:02.841 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.841 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.841 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.841 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.841 INFO:teuthology.orchestra.run.smithi148.stdout: "facts_cache_timeout": { 2024-09-19T07:30:02.841 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "facts_cache_timeout", 2024-09-19T07:30:02.841 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:02.841 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.841 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.841 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "60", 2024-09-19T07:30:02.841 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.842 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.842 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.842 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "seconds to cache host facts data", 2024-09-19T07:30:02.842 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.842 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.842 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.842 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.842 INFO:teuthology.orchestra.run.smithi148.stdout: "grafana_dashboards_path": { 2024-09-19T07:30:02.842 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "grafana_dashboards_path", 2024-09-19T07:30:02.842 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.842 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.842 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.842 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T07:30:02.843 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.843 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.843 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.843 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T07:30:02.843 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.843 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.843 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.843 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.843 INFO:teuthology.orchestra.run.smithi148.stdout: "host_check_interval": { 2024-09-19T07:30:02.843 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "host_check_interval", 2024-09-19T07:30:02.843 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:02.843 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.843 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.843 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "600", 2024-09-19T07:30:02.844 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.844 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.844 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.844 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "how frequently to perform a host check", 2024-09-19T07:30:02.844 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.844 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.844 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.844 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.844 INFO:teuthology.orchestra.run.smithi148.stdout: "hw_monitoring": { 2024-09-19T07:30:02.844 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "hw_monitoring", 2024-09-19T07:30:02.844 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.844 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.845 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.845 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.845 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.845 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.845 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.845 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T07:30:02.845 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.845 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.845 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.845 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.845 INFO:teuthology.orchestra.run.smithi148.stdout: "inventory_list_all": { 2024-09-19T07:30:02.845 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "inventory_list_all", 2024-09-19T07:30:02.845 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.845 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.846 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.846 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.846 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.846 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.846 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.846 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T07:30:02.846 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.846 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.846 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.846 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.846 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:02.846 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:02.846 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.846 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.847 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.847 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.847 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.847 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.847 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.847 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.847 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.847 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.847 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.847 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.847 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.847 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.848 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.848 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.848 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.848 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.848 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.848 INFO:teuthology.orchestra.run.smithi148.stdout: "log_refresh_metadata": { 2024-09-19T07:30:02.848 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_refresh_metadata", 2024-09-19T07:30:02.848 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.848 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.848 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.848 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.848 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.848 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.849 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.849 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T07:30:02.849 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.849 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.849 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.849 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.849 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:02.849 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:02.849 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.849 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.849 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.849 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.850 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.850 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.850 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.850 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T07:30:02.850 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.850 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.850 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.850 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.850 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:02.850 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:02.850 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.850 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.850 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.850 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:02.851 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.851 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.851 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.851 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.851 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.851 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.851 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.851 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.851 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.851 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.851 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.851 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.851 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.851 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.852 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.852 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:02.852 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:02.852 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.852 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.852 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.852 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.852 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.852 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.852 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.852 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.852 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.852 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.853 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.853 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.853 INFO:teuthology.orchestra.run.smithi148.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T07:30:02.853 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T07:30:02.853 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.853 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.853 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.853 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.853 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.853 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.853 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.853 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T07:30:02.853 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.854 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.854 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.854 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.854 INFO:teuthology.orchestra.run.smithi148.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T07:30:02.854 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T07:30:02.854 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.854 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.854 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.854 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "*", 2024-09-19T07:30:02.854 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.854 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.854 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.854 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T07:30:02.855 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.855 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.855 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.855 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.855 INFO:teuthology.orchestra.run.smithi148.stdout: "max_count_per_host": { 2024-09-19T07:30:02.855 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "max_count_per_host", 2024-09-19T07:30:02.855 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.855 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.855 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.855 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10", 2024-09-19T07:30:02.855 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.855 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.855 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.855 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "max number of daemons per service per host", 2024-09-19T07:30:02.856 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.856 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.856 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.856 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.856 INFO:teuthology.orchestra.run.smithi148.stdout: "max_osd_draining_count": { 2024-09-19T07:30:02.856 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "max_osd_draining_count", 2024-09-19T07:30:02.856 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.856 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.856 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.856 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10", 2024-09-19T07:30:02.856 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.856 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.856 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.856 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T07:30:02.857 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.857 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.857 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.857 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.857 INFO:teuthology.orchestra.run.smithi148.stdout: "migration_current": { 2024-09-19T07:30:02.857 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "migration_current", 2024-09-19T07:30:02.857 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.857 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.857 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.857 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.857 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.857 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.857 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.857 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "internal - do not modify", 2024-09-19T07:30:02.858 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.858 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.858 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.858 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.858 INFO:teuthology.orchestra.run.smithi148.stdout: "mode": { 2024-09-19T07:30:02.858 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "mode", 2024-09-19T07:30:02.858 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.858 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.858 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.858 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "root", 2024-09-19T07:30:02.858 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.858 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.858 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.859 INFO:teuthology.orchestra.run.smithi148.stdout: "cephadm-package", 2024-09-19T07:30:02.859 INFO:teuthology.orchestra.run.smithi148.stdout: "root" 2024-09-19T07:30:02.859 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.859 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T07:30:02.859 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.859 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.859 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.859 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.859 INFO:teuthology.orchestra.run.smithi148.stdout: "oob_default_addr": { 2024-09-19T07:30:02.859 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "oob_default_addr", 2024-09-19T07:30:02.859 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.859 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.859 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.859 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "169.254.1.1", 2024-09-19T07:30:02.860 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.860 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.860 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.860 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T07:30:02.860 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.860 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.860 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.860 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.860 INFO:teuthology.orchestra.run.smithi148.stdout: "prometheus_alerts_path": { 2024-09-19T07:30:02.860 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "prometheus_alerts_path", 2024-09-19T07:30:02.860 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.860 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.860 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.861 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T07:30:02.861 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.861 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.861 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.861 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T07:30:02.861 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.861 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.861 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.861 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.861 INFO:teuthology.orchestra.run.smithi148.stdout: "registry_insecure": { 2024-09-19T07:30:02.861 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "registry_insecure", 2024-09-19T07:30:02.861 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.861 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.862 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.862 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.862 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.862 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.862 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.862 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T07:30:02.862 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.862 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.862 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.862 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.862 INFO:teuthology.orchestra.run.smithi148.stdout: "registry_password": { 2024-09-19T07:30:02.862 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "registry_password", 2024-09-19T07:30:02.862 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.862 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.863 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.863 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.863 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.863 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.863 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.863 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T07:30:02.863 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.863 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.863 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.863 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.863 INFO:teuthology.orchestra.run.smithi148.stdout: "registry_url": { 2024-09-19T07:30:02.863 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "registry_url", 2024-09-19T07:30:02.863 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.864 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.864 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.864 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.864 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.864 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.864 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.864 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T07:30:02.864 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.864 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.864 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.864 INFO:teuthology.orchestra.run.smithi148.stdout: "registry_username": { 2024-09-19T07:30:02.864 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "registry_username", 2024-09-19T07:30:02.865 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.865 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.865 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.865 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.865 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.865 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.865 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.865 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T07:30:02.865 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.865 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.865 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.865 INFO:teuthology.orchestra.run.smithi148.stdout: "secure_monitoring_stack": { 2024-09-19T07:30:02.866 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "secure_monitoring_stack", 2024-09-19T07:30:02.866 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.866 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.866 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.866 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.866 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.866 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.866 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.866 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T07:30:02.866 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.866 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.866 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.866 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.866 INFO:teuthology.orchestra.run.smithi148.stdout: "service_discovery_port": { 2024-09-19T07:30:02.867 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "service_discovery_port", 2024-09-19T07:30:02.867 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.867 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.867 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.867 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "8765", 2024-09-19T07:30:02.867 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.867 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.867 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.867 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "cephadm service discovery port", 2024-09-19T07:30:02.867 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.867 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.867 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.867 INFO:teuthology.orchestra.run.smithi148.stdout: "ssh_config_file": { 2024-09-19T07:30:02.868 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ssh_config_file", 2024-09-19T07:30:02.868 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.868 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.868 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.868 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.868 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.868 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.868 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.868 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T07:30:02.868 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.868 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.868 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.869 INFO:teuthology.orchestra.run.smithi148.stdout: "use_agent": { 2024-09-19T07:30:02.869 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "use_agent", 2024-09-19T07:30:02.869 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.869 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.869 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.869 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.869 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.869 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.869 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.869 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T07:30:02.869 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.869 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.869 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.870 INFO:teuthology.orchestra.run.smithi148.stdout: "use_repo_digest": { 2024-09-19T07:30:02.870 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "use_repo_digest", 2024-09-19T07:30:02.870 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.870 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.870 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.870 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.870 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.870 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.870 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.870 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T07:30:02.870 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.870 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.871 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.871 INFO:teuthology.orchestra.run.smithi148.stdout: "warn_on_failed_host_check": { 2024-09-19T07:30:02.871 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "warn_on_failed_host_check", 2024-09-19T07:30:02.871 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.871 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.871 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.871 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.871 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.871 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.871 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.871 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T07:30:02.871 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.871 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.872 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.872 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.872 INFO:teuthology.orchestra.run.smithi148.stdout: "warn_on_stray_daemons": { 2024-09-19T07:30:02.872 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "warn_on_stray_daemons", 2024-09-19T07:30:02.872 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.872 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.872 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.872 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.872 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.872 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.872 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.872 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T07:30:02.872 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.873 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.873 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.873 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.873 INFO:teuthology.orchestra.run.smithi148.stdout: "warn_on_stray_hosts": { 2024-09-19T07:30:02.873 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "warn_on_stray_hosts", 2024-09-19T07:30:02.873 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.873 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.873 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.873 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.873 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.873 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.873 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.873 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T07:30:02.873 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.874 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.874 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.874 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.874 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.874 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:02.874 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "crash", 2024-09-19T07:30:02.874 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:02.874 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:02.874 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:02.874 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:02.874 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:02.875 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.875 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.875 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.875 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.875 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.875 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.875 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.875 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.875 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.875 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.875 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.875 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.875 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.875 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.876 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.876 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.876 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.876 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.876 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:02.876 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:02.876 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.876 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.876 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.876 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.876 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.876 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.877 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.877 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.877 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.877 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.877 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.877 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:02.877 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:02.877 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.877 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.877 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.877 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:02.877 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.878 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.878 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.878 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.878 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.878 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.878 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.878 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.878 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.878 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.878 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.878 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.878 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.878 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.878 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.879 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:02.879 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:02.879 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.879 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.879 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.879 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.879 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.879 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.879 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.879 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.879 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.879 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.879 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.880 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.880 INFO:teuthology.orchestra.run.smithi148.stdout: "retain_interval": { 2024-09-19T07:30:02.880 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "retain_interval", 2024-09-19T07:30:02.880 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:02.880 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.880 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.880 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "31536000", 2024-09-19T07:30:02.880 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.880 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.880 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.880 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T07:30:02.880 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.880 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.881 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.881 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.881 INFO:teuthology.orchestra.run.smithi148.stdout: "warn_recent_interval": { 2024-09-19T07:30:02.881 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "warn_recent_interval", 2024-09-19T07:30:02.881 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:02.881 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.881 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.881 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "1209600", 2024-09-19T07:30:02.881 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.881 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.881 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.881 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T07:30:02.881 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.882 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.882 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.882 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.882 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:02.882 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "dashboard", 2024-09-19T07:30:02.882 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:02.882 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:02.882 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:02.882 INFO:teuthology.orchestra.run.smithi148.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T07:30:02.882 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T07:30:02.882 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.883 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.883 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.883 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10", 2024-09-19T07:30:02.883 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.883 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.883 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.883 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.883 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.883 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.883 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.883 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.883 INFO:teuthology.orchestra.run.smithi148.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T07:30:02.883 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T07:30:02.883 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.884 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.884 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.884 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.884 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.884 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.884 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.884 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.884 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.884 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.884 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.884 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.884 INFO:teuthology.orchestra.run.smithi148.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T07:30:02.884 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T07:30:02.885 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.885 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.885 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.885 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.885 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.885 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.885 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.885 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.885 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.885 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.885 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.885 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.885 INFO:teuthology.orchestra.run.smithi148.stdout: "AUDIT_API_ENABLED": { 2024-09-19T07:30:02.885 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T07:30:02.886 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.886 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.886 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.886 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.886 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.886 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.886 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.886 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.886 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.886 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.886 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.886 INFO:teuthology.orchestra.run.smithi148.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T07:30:02.887 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T07:30:02.887 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.887 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.887 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.887 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.887 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.887 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.887 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.887 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.887 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.887 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.887 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.887 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.887 INFO:teuthology.orchestra.run.smithi148.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T07:30:02.888 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T07:30:02.888 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.888 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.888 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.888 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.888 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.888 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.888 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.888 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.888 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.888 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.888 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.888 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.889 INFO:teuthology.orchestra.run.smithi148.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T07:30:02.889 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T07:30:02.889 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.889 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.889 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.889 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.889 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.889 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.889 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.889 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.889 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.889 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.889 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.890 INFO:teuthology.orchestra.run.smithi148.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T07:30:02.890 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T07:30:02.890 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.890 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.890 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.890 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.890 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.890 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.890 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.890 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.890 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.890 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.890 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.891 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.891 INFO:teuthology.orchestra.run.smithi148.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T07:30:02.891 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T07:30:02.891 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.891 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.891 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.891 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.891 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.891 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.891 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.891 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.891 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.891 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.891 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.892 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.892 INFO:teuthology.orchestra.run.smithi148.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T07:30:02.892 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T07:30:02.892 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.892 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.892 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.892 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.892 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.892 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.892 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.892 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.892 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.892 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.893 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.893 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.893 INFO:teuthology.orchestra.run.smithi148.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T07:30:02.893 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T07:30:02.893 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.893 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.893 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.893 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.893 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.893 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.893 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.893 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.893 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.893 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.894 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.894 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.894 INFO:teuthology.orchestra.run.smithi148.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T07:30:02.894 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T07:30:02.894 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.894 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.894 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.894 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.894 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.894 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.894 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.894 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.894 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.895 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.895 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.895 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.895 INFO:teuthology.orchestra.run.smithi148.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T07:30:02.895 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T07:30:02.895 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.895 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.895 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.895 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.895 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.895 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.895 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.895 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.896 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.896 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.896 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.896 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.896 INFO:teuthology.orchestra.run.smithi148.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T07:30:02.896 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T07:30:02.896 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.896 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.896 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.896 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.896 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.896 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.896 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.897 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.897 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.897 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.897 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.897 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.897 INFO:teuthology.orchestra.run.smithi148.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T07:30:02.897 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T07:30:02.897 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.897 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.897 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.897 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "admin", 2024-09-19T07:30:02.897 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.897 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.898 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.898 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.898 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.898 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.898 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.898 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.898 INFO:teuthology.orchestra.run.smithi148.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T07:30:02.898 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T07:30:02.898 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.898 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.898 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.898 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.898 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.899 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.899 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.899 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.899 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.899 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.899 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.899 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.899 INFO:teuthology.orchestra.run.smithi148.stdout: "GRAFANA_API_URL": { 2024-09-19T07:30:02.899 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "GRAFANA_API_URL", 2024-09-19T07:30:02.899 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.899 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.899 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.899 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.899 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.900 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.900 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.900 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.900 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.900 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.900 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.900 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.900 INFO:teuthology.orchestra.run.smithi148.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T07:30:02.900 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T07:30:02.900 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.900 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.900 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.900 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "admin", 2024-09-19T07:30:02.901 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.901 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.901 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.901 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.901 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.901 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.901 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.901 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.901 INFO:teuthology.orchestra.run.smithi148.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T07:30:02.901 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T07:30:02.901 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.901 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.901 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.902 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.902 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.902 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.902 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.902 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.902 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.902 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.902 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.902 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.902 INFO:teuthology.orchestra.run.smithi148.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T07:30:02.902 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T07:30:02.902 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.902 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.903 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.903 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.903 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.903 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.903 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.903 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.903 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.903 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.903 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.903 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.903 INFO:teuthology.orchestra.run.smithi148.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T07:30:02.903 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T07:30:02.904 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.904 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.904 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.904 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.904 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.904 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.904 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.904 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.904 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.904 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.904 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.904 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.904 INFO:teuthology.orchestra.run.smithi148.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T07:30:02.905 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T07:30:02.905 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.905 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.905 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.905 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.905 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.905 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.905 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.905 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.905 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.905 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.905 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.905 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.906 INFO:teuthology.orchestra.run.smithi148.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T07:30:02.906 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T07:30:02.906 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.906 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.906 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.906 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.906 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.906 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.906 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.906 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.906 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.906 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.906 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.907 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.907 INFO:teuthology.orchestra.run.smithi148.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T07:30:02.907 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T07:30:02.907 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.907 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.907 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.907 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.907 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.907 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.907 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.907 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.907 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.907 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.908 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.908 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.908 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T07:30:02.908 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T07:30:02.908 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.908 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.908 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.908 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.908 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.908 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.908 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.908 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.908 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.909 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.909 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.909 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.909 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T07:30:02.909 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T07:30:02.909 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.909 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.909 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.909 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.909 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.909 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.909 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.909 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.910 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.910 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.910 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.910 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.910 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T07:30:02.910 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T07:30:02.910 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.910 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.910 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.910 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.910 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.910 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.910 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.911 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.911 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.911 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.911 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.911 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.911 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T07:30:02.911 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T07:30:02.911 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.911 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.911 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.911 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.911 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.911 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.912 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.912 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.912 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.912 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.912 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.912 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.912 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T07:30:02.912 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T07:30:02.912 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.912 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.912 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.912 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.912 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.913 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.913 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.913 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.913 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.913 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.913 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.913 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.913 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T07:30:02.913 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T07:30:02.913 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.913 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.913 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.913 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.914 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.914 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.914 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.914 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.914 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.914 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.914 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.914 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.914 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T07:30:02.914 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T07:30:02.914 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.914 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.914 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.914 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.915 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.915 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.915 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.915 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.915 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.915 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.915 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.915 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.915 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T07:30:02.915 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T07:30:02.915 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.915 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.915 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.916 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.916 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.916 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.916 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.916 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.916 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.916 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.916 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.916 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.916 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T07:30:02.916 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T07:30:02.916 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.917 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.917 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.917 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T07:30:02.917 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.917 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.917 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.917 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.917 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.917 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.917 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.917 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.917 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T07:30:02.917 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T07:30:02.917 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.918 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.918 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.918 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10", 2024-09-19T07:30:02.918 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.918 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.918 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.918 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.918 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.918 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.918 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.918 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.918 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T07:30:02.918 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T07:30:02.919 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.919 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.919 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.919 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "8", 2024-09-19T07:30:02.919 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.919 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.919 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.919 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.919 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.919 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.919 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.919 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.920 INFO:teuthology.orchestra.run.smithi148.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T07:30:02.920 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T07:30:02.920 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.920 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.920 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.920 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "45", 2024-09-19T07:30:02.920 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.920 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.920 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.920 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.920 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.920 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.920 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.920 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.921 INFO:teuthology.orchestra.run.smithi148.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T07:30:02.921 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T07:30:02.921 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.921 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.921 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.921 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.921 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.921 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.921 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.921 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.921 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.921 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.921 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.921 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.922 INFO:teuthology.orchestra.run.smithi148.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T07:30:02.922 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T07:30:02.922 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.922 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.922 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.922 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "admin", 2024-09-19T07:30:02.922 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.922 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.922 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.922 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.922 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.922 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.922 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.923 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.923 INFO:teuthology.orchestra.run.smithi148.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T07:30:02.923 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T07:30:02.923 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.923 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.923 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.923 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.923 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.923 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.923 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.923 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.923 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.923 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.923 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.924 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.924 INFO:teuthology.orchestra.run.smithi148.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T07:30:02.924 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T07:30:02.924 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.924 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.924 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.924 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.924 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.924 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.924 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.924 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.924 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.924 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.925 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.925 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.925 INFO:teuthology.orchestra.run.smithi148.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T07:30:02.925 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T07:30:02.925 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.925 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.925 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.925 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-19T07:30:02.925 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.925 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.925 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.925 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.925 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.925 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.926 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.926 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.926 INFO:teuthology.orchestra.run.smithi148.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T07:30:02.926 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T07:30:02.926 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.926 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.926 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.926 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10", 2024-09-19T07:30:02.926 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.926 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.926 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.926 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.926 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.926 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.927 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.927 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.927 INFO:teuthology.orchestra.run.smithi148.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T07:30:02.927 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T07:30:02.927 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.927 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.927 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.927 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "5", 2024-09-19T07:30:02.927 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.927 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.927 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.927 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.927 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.928 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.928 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.928 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.928 INFO:teuthology.orchestra.run.smithi148.stdout: "cross_origin_url": { 2024-09-19T07:30:02.928 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "cross_origin_url", 2024-09-19T07:30:02.928 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.928 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.928 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.928 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.928 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.928 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.928 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.928 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.929 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.929 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.929 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.929 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.929 INFO:teuthology.orchestra.run.smithi148.stdout: "crt_file": { 2024-09-19T07:30:02.929 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "crt_file", 2024-09-19T07:30:02.929 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.929 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.929 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.929 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.929 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.929 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.929 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.929 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.930 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.930 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.930 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.930 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.930 INFO:teuthology.orchestra.run.smithi148.stdout: "debug": { 2024-09-19T07:30:02.930 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "debug", 2024-09-19T07:30:02.930 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.930 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.930 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.930 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.930 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.930 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.931 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.931 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Enable/disable debug options", 2024-09-19T07:30:02.931 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.931 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.931 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.931 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.931 INFO:teuthology.orchestra.run.smithi148.stdout: "jwt_token_ttl": { 2024-09-19T07:30:02.931 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "jwt_token_ttl", 2024-09-19T07:30:02.931 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.931 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.931 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.931 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "28800", 2024-09-19T07:30:02.931 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.931 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.932 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.932 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.932 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.932 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.932 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.932 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.932 INFO:teuthology.orchestra.run.smithi148.stdout: "key_file": { 2024-09-19T07:30:02.932 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "key_file", 2024-09-19T07:30:02.932 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.932 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.932 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.932 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.933 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.933 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.933 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.933 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.933 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.933 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.933 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.933 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.933 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:02.933 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:02.933 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.933 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.933 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.933 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.934 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.934 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.934 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.934 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.934 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.934 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.934 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.934 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.934 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.934 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.934 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.934 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.934 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.935 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.935 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.935 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:02.935 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:02.935 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.935 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.935 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.935 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.935 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.935 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.935 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.935 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.935 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.936 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.936 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.936 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.936 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:02.936 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:02.936 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.936 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.936 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.936 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:02.936 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.936 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.936 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.937 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.937 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.937 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.937 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.937 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.937 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.937 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.937 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.937 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.937 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.937 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.937 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.937 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:02.938 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:02.938 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.938 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.938 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.938 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.938 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.938 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.938 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.938 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.938 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.938 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.938 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.938 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.938 INFO:teuthology.orchestra.run.smithi148.stdout: "motd": { 2024-09-19T07:30:02.939 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "motd", 2024-09-19T07:30:02.939 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.939 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.939 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.939 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.939 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.939 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.939 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.939 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "The message of the day", 2024-09-19T07:30:02.939 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.939 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.939 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.939 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.939 INFO:teuthology.orchestra.run.smithi148.stdout: "redirect_resolve_ip_addr": { 2024-09-19T07:30:02.940 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T07:30:02.940 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.940 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.940 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.940 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.940 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.940 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.940 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.940 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.940 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.940 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.940 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.940 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.941 INFO:teuthology.orchestra.run.smithi148.stdout: "server_addr": { 2024-09-19T07:30:02.941 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "server_addr", 2024-09-19T07:30:02.941 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.941 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.941 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.941 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "::", 2024-09-19T07:30:02.941 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.941 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.941 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.941 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.941 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.941 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.941 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.942 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.942 INFO:teuthology.orchestra.run.smithi148.stdout: "server_port": { 2024-09-19T07:30:02.942 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "server_port", 2024-09-19T07:30:02.942 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.942 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.942 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.942 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "8080", 2024-09-19T07:30:02.942 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.942 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.942 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.942 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.942 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.942 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.942 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.943 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.943 INFO:teuthology.orchestra.run.smithi148.stdout: "ssl": { 2024-09-19T07:30:02.943 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ssl", 2024-09-19T07:30:02.943 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.943 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.943 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.943 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.943 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.943 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.943 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.943 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.943 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.943 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.944 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.944 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.944 INFO:teuthology.orchestra.run.smithi148.stdout: "ssl_server_port": { 2024-09-19T07:30:02.944 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ssl_server_port", 2024-09-19T07:30:02.944 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.944 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.944 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.944 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "8443", 2024-09-19T07:30:02.944 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.944 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.944 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.944 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.945 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.945 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.945 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.945 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.945 INFO:teuthology.orchestra.run.smithi148.stdout: "standby_behaviour": { 2024-09-19T07:30:02.945 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "standby_behaviour", 2024-09-19T07:30:02.945 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.945 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.945 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.945 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "redirect", 2024-09-19T07:30:02.945 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.945 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.945 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.945 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.946 INFO:teuthology.orchestra.run.smithi148.stdout: "redirect" 2024-09-19T07:30:02.946 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.946 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.946 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.946 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.946 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.946 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.946 INFO:teuthology.orchestra.run.smithi148.stdout: "standby_error_status_code": { 2024-09-19T07:30:02.946 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "standby_error_status_code", 2024-09-19T07:30:02.946 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.946 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.946 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.947 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "500", 2024-09-19T07:30:02.947 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "400", 2024-09-19T07:30:02.947 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "599", 2024-09-19T07:30:02.947 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.947 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.947 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.947 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.947 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.947 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.947 INFO:teuthology.orchestra.run.smithi148.stdout: "url_prefix": { 2024-09-19T07:30:02.947 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "url_prefix", 2024-09-19T07:30:02.947 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.947 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.947 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.948 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.948 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.948 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.948 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.948 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.948 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.948 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.948 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.948 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.948 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.948 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.948 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:02.948 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "devicehealth", 2024-09-19T07:30:02.949 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:02.949 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:02.949 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:02.949 INFO:teuthology.orchestra.run.smithi148.stdout: "enable_monitoring": { 2024-09-19T07:30:02.949 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "enable_monitoring", 2024-09-19T07:30:02.949 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.949 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.949 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.949 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.949 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.949 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.949 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.949 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "monitor device health metrics", 2024-09-19T07:30:02.950 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.950 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.950 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.950 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.950 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:02.950 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:02.950 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.950 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.950 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.950 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.950 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.950 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.950 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.951 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.951 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.951 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.951 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.951 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.951 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.951 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.951 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.951 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.951 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.951 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.951 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.951 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:02.952 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:02.952 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.952 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.952 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.952 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.952 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.952 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.952 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.952 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.952 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.952 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.952 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.952 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.952 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:02.953 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:02.953 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.953 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.953 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.953 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:02.953 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.953 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.953 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.953 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.953 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.953 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.953 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.953 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.954 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.954 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.954 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.954 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.954 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.954 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.954 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.954 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:02.954 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:02.954 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.954 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.954 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.954 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.955 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.955 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.955 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.955 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.955 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.955 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.955 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.955 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.955 INFO:teuthology.orchestra.run.smithi148.stdout: "mark_out_threshold": { 2024-09-19T07:30:02.955 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "mark_out_threshold", 2024-09-19T07:30:02.955 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:02.955 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.955 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.955 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "2419200", 2024-09-19T07:30:02.956 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.956 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.956 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.956 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T07:30:02.956 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.956 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.956 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.956 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.956 INFO:teuthology.orchestra.run.smithi148.stdout: "pool_name": { 2024-09-19T07:30:02.956 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "pool_name", 2024-09-19T07:30:02.956 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.956 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.956 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.956 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "device_health_metrics", 2024-09-19T07:30:02.957 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.957 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.957 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.957 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T07:30:02.957 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.957 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.957 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.957 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.957 INFO:teuthology.orchestra.run.smithi148.stdout: "retention_period": { 2024-09-19T07:30:02.957 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "retention_period", 2024-09-19T07:30:02.957 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:02.957 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.957 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.957 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "15552000", 2024-09-19T07:30:02.958 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.958 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.958 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.958 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "how long to retain device health metrics", 2024-09-19T07:30:02.958 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.958 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.958 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.958 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.958 INFO:teuthology.orchestra.run.smithi148.stdout: "scrape_frequency": { 2024-09-19T07:30:02.958 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "scrape_frequency", 2024-09-19T07:30:02.958 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:02.958 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.958 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.959 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "86400", 2024-09-19T07:30:02.959 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.959 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.959 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.959 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T07:30:02.959 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.959 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.959 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.959 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.959 INFO:teuthology.orchestra.run.smithi148.stdout: "self_heal": { 2024-09-19T07:30:02.959 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "self_heal", 2024-09-19T07:30:02.959 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.960 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.960 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.960 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:02.960 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.960 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.960 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.960 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T07:30:02.960 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.960 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.960 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.960 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.960 INFO:teuthology.orchestra.run.smithi148.stdout: "sleep_interval": { 2024-09-19T07:30:02.960 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sleep_interval", 2024-09-19T07:30:02.961 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:02.961 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.961 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.961 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "600", 2024-09-19T07:30:02.961 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.961 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.961 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.961 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T07:30:02.961 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.961 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.961 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.961 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.961 INFO:teuthology.orchestra.run.smithi148.stdout: "warn_threshold": { 2024-09-19T07:30:02.961 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "warn_threshold", 2024-09-19T07:30:02.962 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:02.962 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.962 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.962 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "7257600", 2024-09-19T07:30:02.962 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.962 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.962 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.962 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T07:30:02.962 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.962 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.962 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.962 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.962 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.963 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.963 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:02.963 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "diskprediction_local", 2024-09-19T07:30:02.963 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:02.963 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:02.963 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:02.963 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:02.963 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:02.963 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.963 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.963 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.963 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.963 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.964 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.964 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.964 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.964 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.964 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.964 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.964 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.964 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.964 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.964 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.964 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.964 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.964 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.965 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.965 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:02.965 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:02.965 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.965 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.965 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.965 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.965 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.965 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.965 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.965 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.965 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.966 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.966 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.966 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.966 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:02.966 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:02.966 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.966 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.966 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.966 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:02.966 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.966 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.966 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.966 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.966 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.966 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.967 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.967 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.967 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.967 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.967 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.967 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.967 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.967 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.967 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.967 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:02.967 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:02.967 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.967 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.968 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.968 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.968 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.968 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.968 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.968 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.968 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.968 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.968 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.968 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.968 INFO:teuthology.orchestra.run.smithi148.stdout: "predict_interval": { 2024-09-19T07:30:02.968 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "predict_interval", 2024-09-19T07:30:02.969 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.969 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.969 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.969 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "86400", 2024-09-19T07:30:02.969 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.969 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.969 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.969 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.969 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.969 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.969 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.969 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.969 INFO:teuthology.orchestra.run.smithi148.stdout: "predictor_model": { 2024-09-19T07:30:02.970 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "predictor_model", 2024-09-19T07:30:02.970 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.970 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.970 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.970 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "prophetstor", 2024-09-19T07:30:02.970 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.970 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.970 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.970 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.970 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.970 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.970 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.970 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.971 INFO:teuthology.orchestra.run.smithi148.stdout: "sleep_interval": { 2024-09-19T07:30:02.971 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sleep_interval", 2024-09-19T07:30:02.971 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.971 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.971 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.971 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "600", 2024-09-19T07:30:02.971 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.971 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.971 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.971 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.971 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.971 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.971 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.971 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.972 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.972 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.972 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:02.972 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "influx", 2024-09-19T07:30:02.972 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": false, 2024-09-19T07:30:02.972 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "influxdb python module not found", 2024-09-19T07:30:02.972 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:02.972 INFO:teuthology.orchestra.run.smithi148.stdout: "batch_size": { 2024-09-19T07:30:02.972 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "batch_size", 2024-09-19T07:30:02.972 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.972 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.972 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.972 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "5000", 2024-09-19T07:30:02.973 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.973 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.973 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.973 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T07:30:02.973 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.973 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.973 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.973 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.973 INFO:teuthology.orchestra.run.smithi148.stdout: "database": { 2024-09-19T07:30:02.973 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "database", 2024-09-19T07:30:02.973 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.973 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.974 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.974 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "ceph", 2024-09-19T07:30:02.974 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.974 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.974 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.974 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T07:30:02.974 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.974 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.974 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.974 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.974 INFO:teuthology.orchestra.run.smithi148.stdout: "hostname": { 2024-09-19T07:30:02.974 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "hostname", 2024-09-19T07:30:02.974 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.974 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.975 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.975 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.975 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.975 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.975 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.975 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "InfluxDB server hostname", 2024-09-19T07:30:02.975 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.975 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.975 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.975 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.975 INFO:teuthology.orchestra.run.smithi148.stdout: "interval": { 2024-09-19T07:30:02.975 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "interval", 2024-09-19T07:30:02.975 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:02.976 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.976 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.976 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "30", 2024-09-19T07:30:02.976 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "5", 2024-09-19T07:30:02.976 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.976 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.976 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T07:30:02.976 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.976 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.976 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.976 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.976 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:02.976 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:02.977 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.977 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.977 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.977 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.977 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.977 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.977 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.977 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.977 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.977 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.977 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.977 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.977 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.977 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.978 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.978 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.978 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.978 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.978 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.978 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:02.978 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:02.978 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.978 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.978 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.978 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.978 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.978 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.979 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.979 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.979 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.979 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.979 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.979 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.979 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:02.979 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:02.979 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.979 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.979 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.979 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:02.979 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.980 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.980 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.980 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.980 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.980 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.980 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.980 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.980 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.980 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.980 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.980 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.980 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.980 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.980 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.981 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:02.981 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:02.981 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.981 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.981 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.981 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.981 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.981 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.981 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.981 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.981 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.981 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.981 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.982 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.982 INFO:teuthology.orchestra.run.smithi148.stdout: "password": { 2024-09-19T07:30:02.982 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "password", 2024-09-19T07:30:02.982 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.982 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.982 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.982 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.982 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.982 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.982 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.982 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "password of InfluxDB server user", 2024-09-19T07:30:02.982 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.982 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.983 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.983 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.983 INFO:teuthology.orchestra.run.smithi148.stdout: "port": { 2024-09-19T07:30:02.983 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "port", 2024-09-19T07:30:02.983 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.983 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.983 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.983 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "8086", 2024-09-19T07:30:02.983 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.983 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.983 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.983 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "InfluxDB server port", 2024-09-19T07:30:02.983 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.983 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.984 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.984 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.984 INFO:teuthology.orchestra.run.smithi148.stdout: "ssl": { 2024-09-19T07:30:02.984 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ssl", 2024-09-19T07:30:02.984 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.984 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.984 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.984 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "false", 2024-09-19T07:30:02.984 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.984 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.984 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.984 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T07:30:02.984 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.985 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.985 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.985 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.985 INFO:teuthology.orchestra.run.smithi148.stdout: "threads": { 2024-09-19T07:30:02.985 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "threads", 2024-09-19T07:30:02.985 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:02.985 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.985 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.985 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "5", 2024-09-19T07:30:02.985 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "1", 2024-09-19T07:30:02.985 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "32", 2024-09-19T07:30:02.985 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.985 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T07:30:02.986 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.986 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.986 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.986 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.986 INFO:teuthology.orchestra.run.smithi148.stdout: "username": { 2024-09-19T07:30:02.986 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "username", 2024-09-19T07:30:02.986 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.986 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.986 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.986 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.986 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.986 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.986 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.986 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "username of InfluxDB server user", 2024-09-19T07:30:02.987 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.987 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.987 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.987 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.987 INFO:teuthology.orchestra.run.smithi148.stdout: "verify_ssl": { 2024-09-19T07:30:02.987 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "verify_ssl", 2024-09-19T07:30:02.987 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.987 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.987 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:02.987 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "true", 2024-09-19T07:30:02.987 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.987 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.987 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.988 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T07:30:02.988 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.988 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.988 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.988 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.988 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.988 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.988 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:02.988 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "insights", 2024-09-19T07:30:02.988 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:02.988 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:02.988 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:02.988 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:02.989 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:02.989 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.989 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.989 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.989 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.989 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.989 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.989 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.989 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.989 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.989 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.989 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.989 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.989 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.990 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.990 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.990 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.990 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.990 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.990 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.990 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:02.990 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:02.990 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.990 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.990 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.990 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.990 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.990 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.991 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.991 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.991 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.991 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.991 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.991 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.991 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:02.991 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:02.991 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.991 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.991 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.991 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:02.991 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.991 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.992 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.992 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.992 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.992 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.992 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.992 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.992 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.992 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.992 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.992 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.992 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.992 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.992 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.993 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:02.993 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:02.993 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.993 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.993 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.993 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.993 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.993 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.993 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.993 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.993 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.993 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.993 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.993 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.994 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.994 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.994 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:02.994 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "iostat", 2024-09-19T07:30:02.994 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:02.994 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:02.994 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:02.994 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:02.994 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:02.994 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.994 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.994 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.994 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:02.995 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.995 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.995 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.995 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.995 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.995 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.995 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.995 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.995 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.995 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.995 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.995 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.995 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.995 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.996 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.996 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:02.996 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:02.996 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.996 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.996 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.996 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.996 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.996 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.996 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.996 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.996 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.996 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.997 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.997 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.997 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:02.997 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:02.997 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:02.997 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.997 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.997 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:02.997 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.997 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.997 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:02.997 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:02.997 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:02.997 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:02.998 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:02.998 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:02.998 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:02.998 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:02.998 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.998 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.998 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.998 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.998 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.998 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:02.998 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:02.998 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:02.998 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:02.999 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:02.999 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:02.999 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:02.999 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:02.999 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:02.999 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:02.999 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:02.999 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:02.999 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:02.999 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.999 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:02.999 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:02.999 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:02.999 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "k8sevents", 2024-09-19T07:30:03.000 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.000 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.000 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.000 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph_event_retention_days": { 2024-09-19T07:30:03.000 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ceph_event_retention_days", 2024-09-19T07:30:03.000 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.000 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.000 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.000 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "7", 2024-09-19T07:30:03.000 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.000 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.000 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.000 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T07:30:03.001 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.001 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.001 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.001 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.001 INFO:teuthology.orchestra.run.smithi148.stdout: "config_check_secs": { 2024-09-19T07:30:03.001 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "config_check_secs", 2024-09-19T07:30:03.001 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.001 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.005 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.005 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10", 2024-09-19T07:30:03.005 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "10", 2024-09-19T07:30:03.005 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.005 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.005 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T07:30:03.005 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.005 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.005 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.005 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.005 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.005 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.005 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.006 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.006 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.006 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.006 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.006 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.006 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.006 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.006 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.006 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.006 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.006 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.006 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.006 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.007 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.007 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.007 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.007 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.007 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.007 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.007 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.007 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.007 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.007 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.007 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.007 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.007 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.008 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.008 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.008 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.008 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.008 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.008 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.008 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.008 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.008 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.008 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.008 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.008 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.008 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.009 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.009 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.009 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.009 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.009 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.009 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.009 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.009 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.009 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.009 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.009 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.009 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.009 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.010 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.010 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.010 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.010 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.010 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.010 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.010 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.010 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.010 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.010 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.010 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.010 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.010 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.010 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.011 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.011 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.011 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.011 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.011 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "localpool", 2024-09-19T07:30:03.011 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.011 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.011 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.011 INFO:teuthology.orchestra.run.smithi148.stdout: "failure_domain": { 2024-09-19T07:30:03.011 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "failure_domain", 2024-09-19T07:30:03.011 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.011 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.012 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.012 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "host", 2024-09-19T07:30:03.012 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.012 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.012 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.012 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "failure domain for any created local pool", 2024-09-19T07:30:03.012 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T07:30:03.012 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.012 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.012 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.012 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.012 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.012 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.012 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.013 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.013 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.013 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.013 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.013 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.013 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.013 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.013 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.013 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.013 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.013 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.013 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.013 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.014 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.014 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.014 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.014 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.014 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.014 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.014 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.014 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.014 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.014 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.014 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.014 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.014 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.014 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.015 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.015 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.015 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.015 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.015 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.015 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.015 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.015 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.015 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.015 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.015 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.015 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.015 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.016 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.016 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.016 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.016 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.016 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.016 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.016 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.016 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.016 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.016 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.016 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.016 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.016 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.016 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.017 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.017 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.017 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.017 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.017 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.017 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.017 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.017 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.017 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.017 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.017 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.017 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.017 INFO:teuthology.orchestra.run.smithi148.stdout: "min_size": { 2024-09-19T07:30:03.017 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "min_size", 2024-09-19T07:30:03.018 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.018 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.018 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.018 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.018 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.018 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.018 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.018 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "default min_size for any created local pool", 2024-09-19T07:30:03.018 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T07:30:03.018 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.018 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.018 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.018 INFO:teuthology.orchestra.run.smithi148.stdout: "num_rep": { 2024-09-19T07:30:03.018 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "num_rep", 2024-09-19T07:30:03.019 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.019 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.019 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.019 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "3", 2024-09-19T07:30:03.019 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.019 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.019 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.019 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "default replica count for any created local pool", 2024-09-19T07:30:03.019 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.019 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.020 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.020 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.020 INFO:teuthology.orchestra.run.smithi148.stdout: "pg_num": { 2024-09-19T07:30:03.020 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "pg_num", 2024-09-19T07:30:03.020 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.020 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.020 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.020 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "128", 2024-09-19T07:30:03.020 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.020 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.020 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.020 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T07:30:03.020 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.021 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.021 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.021 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.021 INFO:teuthology.orchestra.run.smithi148.stdout: "prefix": { 2024-09-19T07:30:03.021 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "prefix", 2024-09-19T07:30:03.021 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.021 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.021 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.021 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.021 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.021 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.021 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.021 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "name prefix for any created local pool", 2024-09-19T07:30:03.021 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.022 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.022 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.022 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.022 INFO:teuthology.orchestra.run.smithi148.stdout: "subtree": { 2024-09-19T07:30:03.022 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "subtree", 2024-09-19T07:30:03.022 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.022 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.022 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.022 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "rack", 2024-09-19T07:30:03.022 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.022 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.022 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.022 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T07:30:03.023 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T07:30:03.023 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.023 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.023 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.023 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.023 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.023 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.023 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "mds_autoscaler", 2024-09-19T07:30:03.023 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.023 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.023 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.023 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.023 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.023 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.024 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.024 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.024 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.024 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.024 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.024 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.024 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.024 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.024 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.024 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.024 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.024 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.024 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.025 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.025 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.025 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.025 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.025 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.025 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.025 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.025 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.025 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.025 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.025 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.025 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.025 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.025 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.026 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.026 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.026 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.026 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.026 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.026 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.026 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.026 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.026 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.026 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.026 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.026 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.026 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.026 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.027 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.027 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.027 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.027 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.027 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.027 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.027 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.027 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.027 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.027 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.027 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.027 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.027 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.028 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.028 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.028 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.028 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.028 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.028 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.028 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.028 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.028 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.028 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.028 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.028 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.028 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.028 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.029 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.029 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.029 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "mirroring", 2024-09-19T07:30:03.029 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.029 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.029 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.029 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.029 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.029 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.029 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.029 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.029 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.030 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.030 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.030 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.030 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.030 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.030 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.030 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.030 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.030 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.030 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.030 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.030 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.030 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.031 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.031 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.031 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.031 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.031 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.031 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.031 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.031 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.031 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.031 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.031 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.031 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.031 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.031 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.032 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.032 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.032 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.032 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.032 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.032 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.032 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.032 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.032 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.032 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.032 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.032 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.033 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.033 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.033 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.033 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.033 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.033 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.033 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.033 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.033 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.033 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.033 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.034 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.034 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.034 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.034 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.034 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.034 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.034 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.034 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.034 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.034 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.034 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.034 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.034 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.035 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.035 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.035 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.035 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.035 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "nfs", 2024-09-19T07:30:03.035 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.035 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.035 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.035 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.035 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.035 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.035 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.035 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.035 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.036 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.036 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.036 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.036 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.036 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.036 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.036 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.036 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.036 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.036 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.036 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.036 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.036 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.037 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.037 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.037 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.037 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.037 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.037 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.037 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.037 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.037 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.037 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.037 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.037 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.037 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.038 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.038 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.038 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.038 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.038 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.038 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.038 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.038 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.038 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.038 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.038 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.038 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.038 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.039 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.039 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.039 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.039 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.039 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.039 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.039 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.039 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.039 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.039 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.039 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.039 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.039 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.040 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.040 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.040 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.040 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.040 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.040 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.040 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.040 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.040 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.040 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.040 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.040 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.040 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.041 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.041 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.041 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "orchestrator", 2024-09-19T07:30:03.041 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.041 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.041 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.041 INFO:teuthology.orchestra.run.smithi148.stdout: "fail_fs": { 2024-09-19T07:30:03.041 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "fail_fs", 2024-09-19T07:30:03.041 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.041 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.041 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.041 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.041 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.042 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.042 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.042 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T07:30:03.042 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.042 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.042 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.042 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.042 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.042 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.042 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.042 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.042 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.042 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.043 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.043 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.043 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.043 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.043 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.043 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.043 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.043 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.043 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.043 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.043 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.043 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.043 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.043 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.044 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.044 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.044 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.044 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.044 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.044 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.044 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.044 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.044 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.044 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.044 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.044 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.044 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.044 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.045 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.045 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.045 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.045 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.045 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.045 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.045 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.045 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.045 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.045 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.045 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.045 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.045 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.045 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.046 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.046 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.046 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.046 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.046 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.046 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.046 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.046 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.046 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.046 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.046 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.046 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.046 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.046 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.047 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.047 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.047 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.047 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.047 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.047 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.047 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.047 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.047 INFO:teuthology.orchestra.run.smithi148.stdout: "orchestrator": { 2024-09-19T07:30:03.047 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "orchestrator", 2024-09-19T07:30:03.047 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.047 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.047 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.048 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.048 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.048 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.048 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.048 INFO:teuthology.orchestra.run.smithi148.stdout: "cephadm", 2024-09-19T07:30:03.048 INFO:teuthology.orchestra.run.smithi148.stdout: "rook", 2024-09-19T07:30:03.048 INFO:teuthology.orchestra.run.smithi148.stdout: "test_orchestrator" 2024-09-19T07:30:03.048 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.048 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Orchestrator backend", 2024-09-19T07:30:03.048 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.048 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.048 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.048 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.049 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.049 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.049 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.049 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "osd_perf_query", 2024-09-19T07:30:03.049 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.049 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.049 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.049 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.049 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.049 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.049 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.049 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.049 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.050 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.050 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.050 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.050 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.050 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.050 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.050 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.050 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.050 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.050 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.050 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.050 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.050 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.050 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.051 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.051 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.051 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.051 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.051 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.051 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.051 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.051 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.051 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.051 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.051 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.051 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.051 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.052 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.052 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.052 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.052 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.052 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.052 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.052 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.052 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.052 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.052 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.052 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.052 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.052 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.053 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.053 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.053 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.053 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.053 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.053 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.053 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.053 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.053 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.053 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.053 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.053 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.053 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.053 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.054 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.054 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.054 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.054 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.054 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.054 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.054 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.054 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.054 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.054 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.054 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.054 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.054 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.054 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "osd_support", 2024-09-19T07:30:03.055 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.055 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.055 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.055 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.055 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.055 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.055 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.055 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.055 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.055 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.055 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.055 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.055 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.055 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.056 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.056 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.056 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.056 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.056 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.056 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.056 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.056 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.056 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.056 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.056 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.056 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.056 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.057 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.057 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.057 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.057 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.057 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.057 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.057 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.057 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.057 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.057 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.057 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.057 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.057 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.057 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.058 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.058 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.058 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.058 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.058 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.058 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.058 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.058 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.058 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.058 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.058 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.058 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.058 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.058 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.059 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.059 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.059 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.059 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.059 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.059 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.059 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.059 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.059 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.059 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.059 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.059 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.059 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.060 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.060 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.060 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.060 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.060 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.060 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.060 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.060 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.060 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "pg_autoscaler", 2024-09-19T07:30:03.060 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.060 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.060 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.060 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.061 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.061 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.061 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.061 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.061 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.061 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.061 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.061 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.061 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.061 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.061 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.061 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.061 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.061 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.062 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.062 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.062 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.062 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.062 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.062 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.062 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.062 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.062 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.062 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.062 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.062 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.062 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.062 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.063 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.063 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.063 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.063 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.063 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.063 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.063 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.063 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.063 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.063 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.063 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.063 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.064 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.064 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.064 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.064 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.064 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.064 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.064 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.064 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.064 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.064 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.064 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.064 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.064 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.065 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.065 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.065 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.065 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.065 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.065 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.065 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.065 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.065 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.065 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.065 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.065 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.065 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.065 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.066 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.066 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.066 INFO:teuthology.orchestra.run.smithi148.stdout: "sleep_interval": { 2024-09-19T07:30:03.066 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sleep_interval", 2024-09-19T07:30:03.066 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:03.066 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.066 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.066 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "60", 2024-09-19T07:30:03.066 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.066 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.066 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.066 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.066 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.067 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.067 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.067 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.067 INFO:teuthology.orchestra.run.smithi148.stdout: "threshold": { 2024-09-19T07:30:03.067 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "threshold", 2024-09-19T07:30:03.067 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "float", 2024-09-19T07:30:03.067 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.067 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.067 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "3.0", 2024-09-19T07:30:03.067 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "1.0", 2024-09-19T07:30:03.067 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.068 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.068 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "scaling threshold", 2024-09-19T07:30:03.068 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T07:30:03.068 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.068 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.068 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.068 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.068 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.068 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.068 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "progress", 2024-09-19T07:30:03.068 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.068 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.068 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.069 INFO:teuthology.orchestra.run.smithi148.stdout: "allow_pg_recovery_event": { 2024-09-19T07:30:03.069 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "allow_pg_recovery_event", 2024-09-19T07:30:03.069 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.069 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.069 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.069 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.069 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.069 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.069 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.069 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T07:30:03.069 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.069 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.069 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.070 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.070 INFO:teuthology.orchestra.run.smithi148.stdout: "enabled": { 2024-09-19T07:30:03.070 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "enabled", 2024-09-19T07:30:03.070 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.070 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.070 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.070 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:03.070 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.070 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.070 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.070 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.070 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.070 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.070 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.071 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.071 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.071 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.071 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.071 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.071 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.071 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.071 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.071 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.071 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.071 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.071 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.071 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.072 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.072 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.072 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.072 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.072 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.072 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.072 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.072 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.072 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.072 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.072 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.072 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.072 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.073 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.073 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.073 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.073 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.073 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.073 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.073 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.073 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.073 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.073 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.073 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.073 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.073 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.074 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.074 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.074 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.074 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.074 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.074 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.074 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.074 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.074 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.074 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.074 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.074 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.074 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.075 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.075 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.075 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.075 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.075 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.075 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.075 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.075 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.075 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.075 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.075 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.075 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.075 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.076 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.076 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.076 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.076 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.076 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.076 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.076 INFO:teuthology.orchestra.run.smithi148.stdout: "max_completed_events": { 2024-09-19T07:30:03.076 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "max_completed_events", 2024-09-19T07:30:03.076 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.076 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.076 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.076 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "50", 2024-09-19T07:30:03.076 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.077 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.077 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.077 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "number of past completed events to remember", 2024-09-19T07:30:03.077 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.077 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.077 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.077 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.077 INFO:teuthology.orchestra.run.smithi148.stdout: "sleep_interval": { 2024-09-19T07:30:03.077 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sleep_interval", 2024-09-19T07:30:03.077 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:03.077 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.077 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.077 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "5", 2024-09-19T07:30:03.078 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.078 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.078 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.078 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "how long the module is going to sleep", 2024-09-19T07:30:03.078 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.078 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.078 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.078 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.078 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.078 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.078 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.078 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "prometheus", 2024-09-19T07:30:03.078 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.078 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.079 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.079 INFO:teuthology.orchestra.run.smithi148.stdout: "cache": { 2024-09-19T07:30:03.079 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "cache", 2024-09-19T07:30:03.079 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.079 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.079 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.079 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:03.079 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.079 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.079 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.079 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.079 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.079 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.079 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.080 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.080 INFO:teuthology.orchestra.run.smithi148.stdout: "exclude_perf_counters": { 2024-09-19T07:30:03.080 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "exclude_perf_counters", 2024-09-19T07:30:03.080 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.080 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.080 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.080 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:03.080 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.080 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.080 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.080 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T07:30:03.080 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T07:30:03.080 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.081 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.081 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.081 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.081 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.081 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.081 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.081 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.081 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.081 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.081 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.081 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.081 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.081 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.081 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.082 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.082 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.082 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.082 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.082 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.082 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.082 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.082 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.082 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.082 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.082 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.082 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.082 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.083 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.083 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.083 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.083 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.083 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.083 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.083 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.083 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.083 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.083 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.083 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.083 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.083 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.083 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.084 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.084 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.084 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.084 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.084 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.084 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.084 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.084 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.084 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.084 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.084 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.084 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.084 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.084 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.085 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.085 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.085 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.085 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.085 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.085 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.085 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.085 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.085 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.085 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.085 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.085 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.085 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.086 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.086 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.086 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.086 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.086 INFO:teuthology.orchestra.run.smithi148.stdout: "rbd_stats_pools": { 2024-09-19T07:30:03.086 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rbd_stats_pools", 2024-09-19T07:30:03.086 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.086 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.086 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.086 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.086 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.086 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.086 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.086 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.087 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.087 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.087 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.087 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.087 INFO:teuthology.orchestra.run.smithi148.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T07:30:03.087 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T07:30:03.087 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.087 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.087 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.087 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "300", 2024-09-19T07:30:03.087 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.087 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.087 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.087 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.088 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.088 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.088 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.088 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.088 INFO:teuthology.orchestra.run.smithi148.stdout: "scrape_interval": { 2024-09-19T07:30:03.088 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "scrape_interval", 2024-09-19T07:30:03.088 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "float", 2024-09-19T07:30:03.088 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.088 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.088 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "15.0", 2024-09-19T07:30:03.088 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.088 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.088 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.089 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.089 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.089 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.089 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.089 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.089 INFO:teuthology.orchestra.run.smithi148.stdout: "server_addr": { 2024-09-19T07:30:03.089 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "server_addr", 2024-09-19T07:30:03.089 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.089 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.089 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.089 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "::", 2024-09-19T07:30:03.089 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.089 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.089 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.090 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T07:30:03.090 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.090 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.090 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.090 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.090 INFO:teuthology.orchestra.run.smithi148.stdout: "server_port": { 2024-09-19T07:30:03.090 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "server_port", 2024-09-19T07:30:03.090 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.090 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.090 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.090 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "9283", 2024-09-19T07:30:03.090 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.090 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.090 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.091 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T07:30:03.091 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.091 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.091 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.091 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.091 INFO:teuthology.orchestra.run.smithi148.stdout: "stale_cache_strategy": { 2024-09-19T07:30:03.091 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "stale_cache_strategy", 2024-09-19T07:30:03.091 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.091 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.091 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.091 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "log", 2024-09-19T07:30:03.091 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.091 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.092 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.092 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.092 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.092 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.092 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.092 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.092 INFO:teuthology.orchestra.run.smithi148.stdout: "standby_behaviour": { 2024-09-19T07:30:03.092 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "standby_behaviour", 2024-09-19T07:30:03.092 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.092 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.092 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.092 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "default", 2024-09-19T07:30:03.092 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.093 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.093 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.093 INFO:teuthology.orchestra.run.smithi148.stdout: "default", 2024-09-19T07:30:03.093 INFO:teuthology.orchestra.run.smithi148.stdout: "error" 2024-09-19T07:30:03.093 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.093 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.093 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.093 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.093 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.093 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.093 INFO:teuthology.orchestra.run.smithi148.stdout: "standby_error_status_code": { 2024-09-19T07:30:03.093 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "standby_error_status_code", 2024-09-19T07:30:03.093 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.093 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.094 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.094 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "500", 2024-09-19T07:30:03.094 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "400", 2024-09-19T07:30:03.094 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "599", 2024-09-19T07:30:03.094 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.094 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.094 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.094 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.094 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.094 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.094 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.094 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.094 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.094 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rbd_support", 2024-09-19T07:30:03.095 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.095 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.095 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.095 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.095 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.095 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.095 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.095 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.095 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.095 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.095 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.095 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.095 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.096 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.096 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.096 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.096 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.096 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.096 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.096 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.096 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.096 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.096 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.096 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.096 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.096 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.097 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.097 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.097 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.097 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.097 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.097 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.097 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.097 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.097 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.097 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.097 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.097 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.097 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.097 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.098 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.098 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.098 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.098 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.098 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.098 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.098 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.098 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.098 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.098 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.098 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.098 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.098 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.099 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.099 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.099 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.099 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.099 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.099 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.099 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.099 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.099 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.099 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.099 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.099 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.099 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.099 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.100 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.100 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.100 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.100 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.100 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.100 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.100 INFO:teuthology.orchestra.run.smithi148.stdout: "max_concurrent_snap_create": { 2024-09-19T07:30:03.100 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "max_concurrent_snap_create", 2024-09-19T07:30:03.100 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.100 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.100 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.100 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10", 2024-09-19T07:30:03.100 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.100 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.101 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.101 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.101 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.101 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.101 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.101 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.101 INFO:teuthology.orchestra.run.smithi148.stdout: "mirror_snapshot_schedule": { 2024-09-19T07:30:03.101 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T07:30:03.101 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.101 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.101 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.101 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.101 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.101 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.102 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.102 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.102 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.102 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.102 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.102 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.102 INFO:teuthology.orchestra.run.smithi148.stdout: "trash_purge_schedule": { 2024-09-19T07:30:03.102 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "trash_purge_schedule", 2024-09-19T07:30:03.102 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.102 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.102 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.102 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.102 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.103 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.103 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.103 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.103 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.103 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.103 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.103 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.103 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.103 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.103 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.103 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "restful", 2024-09-19T07:30:03.103 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.103 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.103 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.104 INFO:teuthology.orchestra.run.smithi148.stdout: "enable_auth": { 2024-09-19T07:30:03.104 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "enable_auth", 2024-09-19T07:30:03.104 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.104 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.104 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.104 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:03.104 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.104 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.104 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.104 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.104 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.104 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.104 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.104 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.105 INFO:teuthology.orchestra.run.smithi148.stdout: "key_file": { 2024-09-19T07:30:03.105 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "key_file", 2024-09-19T07:30:03.105 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.105 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.105 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.105 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.105 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.105 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.105 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.105 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.105 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.105 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.105 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.106 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.106 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.106 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.106 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.106 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.106 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.106 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.106 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.106 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.106 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.106 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.106 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.106 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.106 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.107 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.107 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.107 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.107 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.107 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.107 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.107 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.107 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.107 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.107 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.107 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.107 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.107 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.108 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.108 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.108 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.108 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.108 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.108 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.108 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.108 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.108 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.108 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.108 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.108 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.108 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.109 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.109 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.109 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.109 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.109 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.109 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.109 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.109 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.109 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.109 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.109 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.109 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.109 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.109 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.110 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.110 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.110 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.110 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.110 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.110 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.110 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.110 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.110 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.110 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.110 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.110 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.110 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.111 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.111 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.111 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.111 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.111 INFO:teuthology.orchestra.run.smithi148.stdout: "server_addr": { 2024-09-19T07:30:03.111 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "server_addr", 2024-09-19T07:30:03.111 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.111 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.111 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.111 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.111 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.111 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.111 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.111 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.112 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.112 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.112 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.112 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.112 INFO:teuthology.orchestra.run.smithi148.stdout: "server_port": { 2024-09-19T07:30:03.112 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "server_port", 2024-09-19T07:30:03.112 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.112 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.112 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.112 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.112 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.112 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.112 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.112 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.113 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.113 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.113 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.113 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.113 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.113 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.113 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.113 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rgw", 2024-09-19T07:30:03.113 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.113 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.113 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.113 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.113 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.113 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.114 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.114 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.114 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.114 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.114 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.114 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.114 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.114 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.114 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.114 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.114 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.114 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.114 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.115 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.115 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.115 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.115 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.115 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.115 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.115 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.115 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.115 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.115 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.115 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.115 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.115 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.115 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.116 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.116 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.116 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.116 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.116 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.116 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.116 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.116 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.116 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.116 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.116 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.116 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.116 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.117 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.117 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.117 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.117 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.117 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.117 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.117 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.117 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.117 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.117 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.117 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.117 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.117 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.118 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.118 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.118 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.118 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.118 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.118 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.118 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.118 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.118 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.118 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.118 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.118 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.118 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.119 INFO:teuthology.orchestra.run.smithi148.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T07:30:03.119 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T07:30:03.119 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.119 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.119 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.119 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "5", 2024-09-19T07:30:03.119 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.119 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.119 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.119 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T07:30:03.119 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.119 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.119 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.120 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.120 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.120 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.120 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.120 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rook", 2024-09-19T07:30:03.120 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.120 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.120 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.120 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.120 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.120 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.120 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.120 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.121 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.121 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.121 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.121 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.121 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.121 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.121 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.121 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.121 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.121 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.121 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.121 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.121 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.121 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.122 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.122 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.122 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.122 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.122 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.122 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.122 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.122 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.122 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.122 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.122 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.122 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.123 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.123 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.123 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.123 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.123 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.123 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.123 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.123 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.123 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.123 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.123 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.123 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.123 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.123 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.124 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.124 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.124 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.124 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.124 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.124 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.124 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.124 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.124 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.124 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.124 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.124 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.124 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.125 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.125 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.125 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.125 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.125 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.125 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.125 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.125 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.125 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.125 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.125 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.125 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.125 INFO:teuthology.orchestra.run.smithi148.stdout: "storage_class": { 2024-09-19T07:30:03.126 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "storage_class", 2024-09-19T07:30:03.126 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.126 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.126 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.126 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "local", 2024-09-19T07:30:03.126 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.126 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.126 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.126 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T07:30:03.126 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.126 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.126 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.127 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.127 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.127 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.127 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.127 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "selftest", 2024-09-19T07:30:03.127 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.127 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.127 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.127 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.127 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.127 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.127 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.127 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.128 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.128 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.128 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.128 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.128 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.128 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.128 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.128 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.128 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.128 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.128 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.128 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.129 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.129 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.129 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.129 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.129 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.129 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.129 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.129 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.129 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.129 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.129 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.129 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.130 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.130 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.130 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.130 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.130 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.130 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.130 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.130 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.130 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.130 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.130 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.130 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.130 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.131 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.131 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.131 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.131 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.131 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.131 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.131 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.131 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.131 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.131 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.131 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.131 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.131 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.132 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.132 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.132 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.132 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.132 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.132 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.132 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.132 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.132 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.132 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.132 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.132 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.132 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.132 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.133 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.133 INFO:teuthology.orchestra.run.smithi148.stdout: "roption1": { 2024-09-19T07:30:03.133 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "roption1", 2024-09-19T07:30:03.133 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.133 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.133 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.133 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.133 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.133 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.133 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.133 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.133 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.134 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.134 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.134 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.134 INFO:teuthology.orchestra.run.smithi148.stdout: "roption2": { 2024-09-19T07:30:03.134 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "roption2", 2024-09-19T07:30:03.134 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.134 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.134 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.134 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "xyz", 2024-09-19T07:30:03.134 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.134 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.134 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.134 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.134 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.135 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.135 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.135 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.135 INFO:teuthology.orchestra.run.smithi148.stdout: "rwoption1": { 2024-09-19T07:30:03.135 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rwoption1", 2024-09-19T07:30:03.135 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.135 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.135 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.135 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.135 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.135 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.135 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.136 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.136 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.136 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.136 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.136 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.136 INFO:teuthology.orchestra.run.smithi148.stdout: "rwoption2": { 2024-09-19T07:30:03.136 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rwoption2", 2024-09-19T07:30:03.136 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.136 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.136 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.136 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.136 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.136 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.137 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.137 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.137 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.137 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.137 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.137 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.137 INFO:teuthology.orchestra.run.smithi148.stdout: "rwoption3": { 2024-09-19T07:30:03.137 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rwoption3", 2024-09-19T07:30:03.137 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "float", 2024-09-19T07:30:03.137 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.137 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.137 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.137 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.138 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.138 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.138 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.138 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.138 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.138 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.138 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.138 INFO:teuthology.orchestra.run.smithi148.stdout: "rwoption4": { 2024-09-19T07:30:03.138 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rwoption4", 2024-09-19T07:30:03.138 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.138 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.138 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.138 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.138 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.139 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.139 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.139 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.139 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.139 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.139 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.139 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.139 INFO:teuthology.orchestra.run.smithi148.stdout: "rwoption5": { 2024-09-19T07:30:03.139 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rwoption5", 2024-09-19T07:30:03.139 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.139 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.139 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.139 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.140 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.140 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.140 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.140 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.140 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.140 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.140 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.140 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.140 INFO:teuthology.orchestra.run.smithi148.stdout: "rwoption6": { 2024-09-19T07:30:03.140 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rwoption6", 2024-09-19T07:30:03.140 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.140 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.140 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.140 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:03.141 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.141 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.141 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.141 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.141 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.141 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.141 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.141 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.141 INFO:teuthology.orchestra.run.smithi148.stdout: "rwoption7": { 2024-09-19T07:30:03.141 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rwoption7", 2024-09-19T07:30:03.141 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.141 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.141 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.142 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.142 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "1", 2024-09-19T07:30:03.142 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "42", 2024-09-19T07:30:03.142 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.142 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.142 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.142 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.142 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.142 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.142 INFO:teuthology.orchestra.run.smithi148.stdout: "testkey": { 2024-09-19T07:30:03.142 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "testkey", 2024-09-19T07:30:03.142 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.142 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.142 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.143 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.143 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.143 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.143 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.143 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.143 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.143 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.143 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.143 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.143 INFO:teuthology.orchestra.run.smithi148.stdout: "testlkey": { 2024-09-19T07:30:03.143 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "testlkey", 2024-09-19T07:30:03.143 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.143 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.144 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.144 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.144 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.144 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.144 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.144 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.144 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.144 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.144 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.144 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.144 INFO:teuthology.orchestra.run.smithi148.stdout: "testnewline": { 2024-09-19T07:30:03.144 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "testnewline", 2024-09-19T07:30:03.144 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.145 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.145 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.145 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.145 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.145 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.145 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.145 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.145 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.145 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.145 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.145 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.145 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.145 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.146 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.146 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "snap_schedule", 2024-09-19T07:30:03.146 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.146 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.146 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.146 INFO:teuthology.orchestra.run.smithi148.stdout: "allow_m_granularity": { 2024-09-19T07:30:03.146 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "allow_m_granularity", 2024-09-19T07:30:03.146 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.146 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.146 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.146 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.146 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.146 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.146 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.147 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T07:30:03.147 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.147 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.147 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.147 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.147 INFO:teuthology.orchestra.run.smithi148.stdout: "dump_on_update": { 2024-09-19T07:30:03.147 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "dump_on_update", 2024-09-19T07:30:03.147 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.147 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.147 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.147 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.147 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.147 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.147 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.148 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "dump database to debug log on update", 2024-09-19T07:30:03.148 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.148 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.148 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.148 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.148 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.148 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.148 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.148 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.148 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.148 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.148 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.148 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.149 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.149 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.149 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.149 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.149 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.149 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.149 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.149 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.149 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.149 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.149 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.149 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.149 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.150 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.150 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.150 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.150 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.150 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.150 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.150 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.150 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.150 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.150 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.150 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.150 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.150 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.150 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.151 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.151 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.151 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.151 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.151 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.151 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.151 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.151 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.151 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.151 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.151 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.151 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.151 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.152 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.152 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.152 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.152 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.152 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.152 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.152 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.152 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.152 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.152 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.152 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.152 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.152 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.153 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.153 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.153 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.153 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.153 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.153 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.153 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.153 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.153 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.153 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.153 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.153 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.153 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "stats", 2024-09-19T07:30:03.154 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.154 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.154 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.154 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.154 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.154 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.154 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.154 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.154 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.154 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.154 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.154 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.154 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.155 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.155 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.155 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.155 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.155 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.155 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.155 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.155 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.155 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.155 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.155 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.155 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.155 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.155 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.156 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.156 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.156 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.156 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.156 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.156 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.156 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.156 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.156 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.156 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.156 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.156 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.156 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.157 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.157 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.157 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.157 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.157 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.157 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.157 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.157 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.157 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.157 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.157 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.157 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.157 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.158 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.158 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.158 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.158 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.158 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.158 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.158 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.158 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.158 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.158 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.158 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.158 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.158 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.159 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.159 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.159 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.159 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.159 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.159 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.159 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.159 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.159 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.159 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.159 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "status", 2024-09-19T07:30:03.159 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.159 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.160 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.160 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.160 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.160 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.160 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.160 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.160 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.160 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.160 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.160 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.160 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.160 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.160 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.160 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.161 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.161 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.161 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.161 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.161 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.161 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.161 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.161 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.161 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.161 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.161 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.161 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.161 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.161 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.162 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.162 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.162 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.162 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.162 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.162 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.162 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.162 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.162 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.162 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.162 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.162 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.162 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.162 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.163 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.163 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.163 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.163 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.163 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.163 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.163 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.163 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.163 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.163 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.163 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.163 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.163 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.164 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.164 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.164 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.164 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.164 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.164 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.164 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.164 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.164 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.164 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.164 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.164 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.164 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.165 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.165 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.165 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.165 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.165 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.165 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.165 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "telegraf", 2024-09-19T07:30:03.165 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.165 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.165 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.165 INFO:teuthology.orchestra.run.smithi148.stdout: "address": { 2024-09-19T07:30:03.165 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "address", 2024-09-19T07:30:03.165 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.165 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.166 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.166 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T07:30:03.166 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.166 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.166 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.166 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.166 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.166 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.166 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.166 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.166 INFO:teuthology.orchestra.run.smithi148.stdout: "interval": { 2024-09-19T07:30:03.166 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "interval", 2024-09-19T07:30:03.166 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:03.167 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.167 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.167 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "15", 2024-09-19T07:30:03.167 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.167 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.167 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.167 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.167 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.167 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.167 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.167 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.167 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.167 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.167 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.168 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.168 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.168 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.168 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.168 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.168 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.168 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.168 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.168 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.168 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.168 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.168 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.168 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.168 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.169 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.169 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.169 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.169 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.169 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.169 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.169 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.169 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.169 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.169 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.169 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.169 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.170 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.170 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.170 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.170 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.170 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.170 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.170 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.170 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.170 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.170 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.170 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.170 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.170 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.170 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.171 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.171 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.171 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.171 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.171 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.171 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.171 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.171 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.171 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.171 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.171 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.171 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.171 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.171 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.172 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.172 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.172 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.172 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.172 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.172 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.172 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.172 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.172 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.172 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.172 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.172 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.172 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.172 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.173 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.173 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.173 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "telemetry", 2024-09-19T07:30:03.173 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.173 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.173 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.173 INFO:teuthology.orchestra.run.smithi148.stdout: "channel_basic": { 2024-09-19T07:30:03.173 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "channel_basic", 2024-09-19T07:30:03.173 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.173 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.173 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.173 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:03.173 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.173 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.174 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.174 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T07:30:03.174 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.174 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.174 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.174 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.174 INFO:teuthology.orchestra.run.smithi148.stdout: "channel_crash": { 2024-09-19T07:30:03.174 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "channel_crash", 2024-09-19T07:30:03.174 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.174 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.174 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.174 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:03.175 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.175 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.175 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.175 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T07:30:03.175 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.175 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.175 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.175 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.175 INFO:teuthology.orchestra.run.smithi148.stdout: "channel_device": { 2024-09-19T07:30:03.175 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "channel_device", 2024-09-19T07:30:03.175 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.175 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.175 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.175 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:03.176 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.176 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.176 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.176 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T07:30:03.176 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.176 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.176 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.176 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.176 INFO:teuthology.orchestra.run.smithi148.stdout: "channel_ident": { 2024-09-19T07:30:03.176 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "channel_ident", 2024-09-19T07:30:03.176 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.176 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.176 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.177 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.177 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.177 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.177 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.177 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T07:30:03.177 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.177 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.177 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.177 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.177 INFO:teuthology.orchestra.run.smithi148.stdout: "channel_perf": { 2024-09-19T07:30:03.177 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "channel_perf", 2024-09-19T07:30:03.177 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.177 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.178 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.178 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.178 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.178 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.178 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.178 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T07:30:03.178 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.178 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.178 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.178 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.178 INFO:teuthology.orchestra.run.smithi148.stdout: "contact": { 2024-09-19T07:30:03.178 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "contact", 2024-09-19T07:30:03.178 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.179 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.179 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.179 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.179 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.179 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.179 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.179 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.179 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.179 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.179 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.179 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.179 INFO:teuthology.orchestra.run.smithi148.stdout: "description": { 2024-09-19T07:30:03.179 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "description", 2024-09-19T07:30:03.180 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.180 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.180 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.180 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.180 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.180 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.180 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.180 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.180 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.180 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.180 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.180 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.181 INFO:teuthology.orchestra.run.smithi148.stdout: "device_url": { 2024-09-19T07:30:03.181 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "device_url", 2024-09-19T07:30:03.181 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.181 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.181 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.181 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T07:30:03.181 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.181 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.181 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.181 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.181 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.181 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.181 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.181 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.182 INFO:teuthology.orchestra.run.smithi148.stdout: "enabled": { 2024-09-19T07:30:03.182 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "enabled", 2024-09-19T07:30:03.182 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.182 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.182 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.182 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.182 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.182 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.182 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.182 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.182 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.182 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.182 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.183 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.183 INFO:teuthology.orchestra.run.smithi148.stdout: "interval": { 2024-09-19T07:30:03.183 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "interval", 2024-09-19T07:30:03.183 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.183 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.183 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.183 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "24", 2024-09-19T07:30:03.183 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "8", 2024-09-19T07:30:03.183 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.183 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.183 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.183 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.183 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.183 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.184 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.184 INFO:teuthology.orchestra.run.smithi148.stdout: "last_opt_revision": { 2024-09-19T07:30:03.184 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "last_opt_revision", 2024-09-19T07:30:03.184 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.184 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.184 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.184 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "1", 2024-09-19T07:30:03.184 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.184 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.184 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.184 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.184 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.184 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.185 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.185 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.185 INFO:teuthology.orchestra.run.smithi148.stdout: "leaderboard": { 2024-09-19T07:30:03.185 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "leaderboard", 2024-09-19T07:30:03.185 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.185 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.185 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.185 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.185 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.185 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.185 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.185 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.185 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.186 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.186 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.186 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.186 INFO:teuthology.orchestra.run.smithi148.stdout: "leaderboard_description": { 2024-09-19T07:30:03.186 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "leaderboard_description", 2024-09-19T07:30:03.186 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.186 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.186 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.186 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.186 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.186 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.186 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.186 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.186 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.187 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.187 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.187 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.187 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.187 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.187 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.187 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.187 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.187 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.187 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.187 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.187 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.187 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.187 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.188 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.188 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.188 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.188 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.188 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.188 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.188 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.188 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.188 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.188 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.188 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.188 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.189 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.189 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.189 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.189 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.189 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.189 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.189 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.189 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.189 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.189 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.189 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.189 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.189 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.190 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.190 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.190 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.190 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.190 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.190 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.190 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.190 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.190 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.190 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.190 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.190 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.190 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.190 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.191 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.191 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.191 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.191 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.191 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.191 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.191 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.191 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.191 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.191 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.191 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.191 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.191 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.191 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.192 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.192 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.192 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.192 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.192 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.192 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.192 INFO:teuthology.orchestra.run.smithi148.stdout: "organization": { 2024-09-19T07:30:03.192 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "organization", 2024-09-19T07:30:03.192 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.192 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.192 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.192 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.193 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.193 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.193 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.193 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.193 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.193 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.193 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.193 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.193 INFO:teuthology.orchestra.run.smithi148.stdout: "proxy": { 2024-09-19T07:30:03.193 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "proxy", 2024-09-19T07:30:03.193 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.193 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.193 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.194 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.194 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.194 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.194 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.194 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.194 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.194 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.194 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.194 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.194 INFO:teuthology.orchestra.run.smithi148.stdout: "url": { 2024-09-19T07:30:03.194 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "url", 2024-09-19T07:30:03.194 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.194 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.195 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.195 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T07:30:03.195 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.195 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.195 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.195 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.195 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.195 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.195 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.195 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.195 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.195 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.195 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.196 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "test_orchestrator", 2024-09-19T07:30:03.196 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.196 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.196 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.196 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.196 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.196 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.196 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.196 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.196 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.196 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.196 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.196 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.197 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.197 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.197 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.197 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.197 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.197 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.197 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.197 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.197 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.197 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.197 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.197 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.197 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.198 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.198 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.198 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.198 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.198 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.198 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.198 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.198 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.198 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.198 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.198 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.198 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.198 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.199 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.199 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.199 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.199 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.199 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.199 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.199 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.199 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.199 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.199 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.199 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.199 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.199 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.199 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.200 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.200 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.200 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.200 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.200 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.200 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.200 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.200 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.200 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.200 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.200 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.200 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.200 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.201 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.201 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.201 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.201 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.201 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.201 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.201 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.201 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.201 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.201 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.201 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.201 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "volumes", 2024-09-19T07:30:03.201 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.202 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.202 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.202 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.202 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.202 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.202 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.202 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.202 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.202 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.202 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.202 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.202 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.202 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.202 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.203 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.203 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.203 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.203 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.203 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.203 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.203 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.203 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.203 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.203 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.203 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.203 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.203 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.204 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.204 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.204 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.204 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.204 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.204 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.204 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.204 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.204 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.204 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.204 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.204 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.204 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.205 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.205 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.205 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.205 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.205 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.205 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.205 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.205 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.205 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.205 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.205 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.205 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.205 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.206 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.206 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.206 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.206 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.206 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.206 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.206 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.206 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.206 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.206 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.206 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.206 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.206 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.206 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.207 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.207 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.207 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.207 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.207 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.207 INFO:teuthology.orchestra.run.smithi148.stdout: "max_concurrent_clones": { 2024-09-19T07:30:03.207 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "max_concurrent_clones", 2024-09-19T07:30:03.207 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.207 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.207 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.207 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "4", 2024-09-19T07:30:03.207 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.208 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.208 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.208 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T07:30:03.208 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.208 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.208 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.208 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.208 INFO:teuthology.orchestra.run.smithi148.stdout: "periodic_async_work": { 2024-09-19T07:30:03.208 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "periodic_async_work", 2024-09-19T07:30:03.208 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.208 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.208 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.208 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.208 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.209 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.209 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.209 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Periodically check for async work", 2024-09-19T07:30:03.209 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.209 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.209 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.209 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.209 INFO:teuthology.orchestra.run.smithi148.stdout: "snapshot_clone_delay": { 2024-09-19T07:30:03.209 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "snapshot_clone_delay", 2024-09-19T07:30:03.209 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.209 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.209 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.209 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-19T07:30:03.210 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.210 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.210 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.210 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T07:30:03.210 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.210 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.210 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.210 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.210 INFO:teuthology.orchestra.run.smithi148.stdout: "snapshot_clone_no_wait": { 2024-09-19T07:30:03.210 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T07:30:03.210 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.210 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.210 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.210 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:03.211 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.211 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.211 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.211 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T07:30:03.211 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.211 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.211 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.211 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.211 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.211 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.211 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.211 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "zabbix", 2024-09-19T07:30:03.211 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.212 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.212 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.212 INFO:teuthology.orchestra.run.smithi148.stdout: "discovery_interval": { 2024-09-19T07:30:03.212 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "discovery_interval", 2024-09-19T07:30:03.212 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "uint", 2024-09-19T07:30:03.212 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.212 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.212 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "100", 2024-09-19T07:30:03.212 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.212 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.212 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.213 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.213 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.213 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.213 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.213 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.213 INFO:teuthology.orchestra.run.smithi148.stdout: "identifier": { 2024-09-19T07:30:03.213 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "identifier", 2024-09-19T07:30:03.213 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.213 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.213 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.213 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.213 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.213 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.214 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.214 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.214 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.214 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.214 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.214 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.214 INFO:teuthology.orchestra.run.smithi148.stdout: "interval": { 2024-09-19T07:30:03.214 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "interval", 2024-09-19T07:30:03.214 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:03.214 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.214 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.214 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "60", 2024-09-19T07:30:03.214 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.214 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.215 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.215 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.215 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.215 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.215 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.215 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.215 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.215 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.215 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.215 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.215 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.215 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.215 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.216 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.216 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.216 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.216 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.216 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.216 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.216 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.216 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.216 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.216 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.216 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.216 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.216 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.217 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.217 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.217 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.217 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.217 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.217 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.217 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.217 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.217 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.217 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.217 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.217 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.217 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.217 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.218 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.218 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.218 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.218 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.218 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.218 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.218 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.218 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.218 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.218 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.218 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.218 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.218 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.218 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.219 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.219 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.219 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.219 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.219 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.219 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.219 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.219 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.219 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.219 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.219 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.219 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.219 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.220 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.220 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.220 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.220 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.220 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.220 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.220 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.220 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.220 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.220 INFO:teuthology.orchestra.run.smithi148.stdout: "zabbix_host": { 2024-09-19T07:30:03.220 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "zabbix_host", 2024-09-19T07:30:03.220 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.220 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.221 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.221 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.221 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.221 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.221 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.221 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.221 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.221 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.221 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.221 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.221 INFO:teuthology.orchestra.run.smithi148.stdout: "zabbix_port": { 2024-09-19T07:30:03.221 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "zabbix_port", 2024-09-19T07:30:03.221 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.222 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.222 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.222 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10051", 2024-09-19T07:30:03.222 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.222 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.222 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.222 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.222 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.222 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.222 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.222 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.222 INFO:teuthology.orchestra.run.smithi148.stdout: "zabbix_sender": { 2024-09-19T07:30:03.222 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "zabbix_sender", 2024-09-19T07:30:03.223 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.223 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.223 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.223 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T07:30:03.223 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.223 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.223 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.223 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.223 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.223 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.223 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.223 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.223 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.224 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.224 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-19T07:30:03.224 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.224 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.224 INFO:teuthology.orchestra.run.smithi148.stdout: "modules": [ 2024-09-19T07:30:03.224 INFO:teuthology.orchestra.run.smithi148.stdout: "cephadm", 2024-09-19T07:30:03.224 INFO:teuthology.orchestra.run.smithi148.stdout: "dashboard", 2024-09-19T07:30:03.224 INFO:teuthology.orchestra.run.smithi148.stdout: "iostat", 2024-09-19T07:30:03.224 INFO:teuthology.orchestra.run.smithi148.stdout: "nfs", 2024-09-19T07:30:03.224 INFO:teuthology.orchestra.run.smithi148.stdout: "restful", 2024-09-19T07:30:03.224 INFO:teuthology.orchestra.run.smithi148.stdout: "snap_schedule" 2024-09-19T07:30:03.224 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.224 INFO:teuthology.orchestra.run.smithi148.stdout: "available_modules": [ 2024-09-19T07:30:03.224 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.225 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "alerts", 2024-09-19T07:30:03.225 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.225 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.225 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.225 INFO:teuthology.orchestra.run.smithi148.stdout: "interval": { 2024-09-19T07:30:03.225 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "interval", 2024-09-19T07:30:03.225 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:03.225 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.225 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.225 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "60", 2024-09-19T07:30:03.225 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.225 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.225 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.226 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T07:30:03.226 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.226 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.226 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.226 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.226 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.226 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.226 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.226 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.226 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.226 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.226 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.226 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.227 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.227 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.227 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.227 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.227 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.227 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.227 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.227 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.227 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.227 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.227 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.227 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.227 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.228 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.228 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.228 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.228 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.228 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.228 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.228 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.228 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.228 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.228 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.228 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.228 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.228 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.229 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.229 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.229 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.229 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.229 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.229 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.229 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.229 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.229 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.229 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.229 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.229 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.229 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.230 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.230 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.230 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.230 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.230 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.230 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.230 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.230 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.230 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.230 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.230 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.230 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.230 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.230 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.230 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.231 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.231 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.231 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.231 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.231 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.231 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.231 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.231 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.231 INFO:teuthology.orchestra.run.smithi148.stdout: "smtp_destination": { 2024-09-19T07:30:03.231 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smtp_destination", 2024-09-19T07:30:03.231 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.231 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.231 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.232 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.232 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.232 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.232 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.232 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Email address to send alerts to", 2024-09-19T07:30:03.232 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.232 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.232 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.232 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.232 INFO:teuthology.orchestra.run.smithi148.stdout: "smtp_from_name": { 2024-09-19T07:30:03.232 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smtp_from_name", 2024-09-19T07:30:03.232 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.232 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.232 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.233 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "Ceph", 2024-09-19T07:30:03.233 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.233 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.233 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.233 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Email From: name", 2024-09-19T07:30:03.233 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.233 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.233 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.233 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.233 INFO:teuthology.orchestra.run.smithi148.stdout: "smtp_host": { 2024-09-19T07:30:03.233 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smtp_host", 2024-09-19T07:30:03.233 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.233 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.233 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.234 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.234 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.234 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.234 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.234 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "SMTP server", 2024-09-19T07:30:03.234 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.234 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.234 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.234 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.234 INFO:teuthology.orchestra.run.smithi148.stdout: "smtp_password": { 2024-09-19T07:30:03.234 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smtp_password", 2024-09-19T07:30:03.234 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.234 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.234 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.235 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.235 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.235 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.235 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.235 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Password to authenticate with", 2024-09-19T07:30:03.235 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.235 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.235 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.235 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.235 INFO:teuthology.orchestra.run.smithi148.stdout: "smtp_port": { 2024-09-19T07:30:03.235 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smtp_port", 2024-09-19T07:30:03.235 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.235 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.236 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.236 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "465", 2024-09-19T07:30:03.236 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.236 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.236 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.236 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "SMTP port", 2024-09-19T07:30:03.236 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.236 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.236 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.236 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.236 INFO:teuthology.orchestra.run.smithi148.stdout: "smtp_sender": { 2024-09-19T07:30:03.236 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smtp_sender", 2024-09-19T07:30:03.236 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.236 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.237 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.237 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.237 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.237 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.237 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.237 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "SMTP envelope sender", 2024-09-19T07:30:03.237 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.237 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.237 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.237 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.237 INFO:teuthology.orchestra.run.smithi148.stdout: "smtp_ssl": { 2024-09-19T07:30:03.237 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smtp_ssl", 2024-09-19T07:30:03.237 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.237 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.238 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.238 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:03.238 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.238 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.238 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.238 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T07:30:03.238 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.238 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.238 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.238 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.238 INFO:teuthology.orchestra.run.smithi148.stdout: "smtp_user": { 2024-09-19T07:30:03.238 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "smtp_user", 2024-09-19T07:30:03.238 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.239 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.239 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.239 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.239 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.239 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.239 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.239 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "User to authenticate as", 2024-09-19T07:30:03.239 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.239 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.239 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.239 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.239 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.239 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.239 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.240 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "balancer", 2024-09-19T07:30:03.240 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.240 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.240 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.240 INFO:teuthology.orchestra.run.smithi148.stdout: "active": { 2024-09-19T07:30:03.240 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "active", 2024-09-19T07:30:03.240 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.240 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.240 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.240 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:03.240 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.240 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.240 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.241 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T07:30:03.241 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.241 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.241 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.241 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.241 INFO:teuthology.orchestra.run.smithi148.stdout: "begin_time": { 2024-09-19T07:30:03.241 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "begin_time", 2024-09-19T07:30:03.241 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.241 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.241 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.241 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0000", 2024-09-19T07:30:03.241 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.242 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.242 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.242 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T07:30:03.242 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T07:30:03.242 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.242 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.242 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.242 INFO:teuthology.orchestra.run.smithi148.stdout: "begin_weekday": { 2024-09-19T07:30:03.242 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "begin_weekday", 2024-09-19T07:30:03.242 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "uint", 2024-09-19T07:30:03.242 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.242 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.242 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-19T07:30:03.242 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "0", 2024-09-19T07:30:03.243 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "6", 2024-09-19T07:30:03.243 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.243 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T07:30:03.243 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T07:30:03.243 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.243 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.243 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.243 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_compat_max_iterations": { 2024-09-19T07:30:03.243 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "crush_compat_max_iterations", 2024-09-19T07:30:03.243 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "uint", 2024-09-19T07:30:03.243 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.243 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.243 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "25", 2024-09-19T07:30:03.243 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "1", 2024-09-19T07:30:03.244 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "250", 2024-09-19T07:30:03.244 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.244 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T07:30:03.244 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.244 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.244 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.244 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.244 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_compat_metrics": { 2024-09-19T07:30:03.244 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "crush_compat_metrics", 2024-09-19T07:30:03.244 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.244 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.244 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.244 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T07:30:03.245 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.245 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.245 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.245 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T07:30:03.245 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T07:30:03.245 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.245 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.245 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.245 INFO:teuthology.orchestra.run.smithi148.stdout: "crush_compat_step": { 2024-09-19T07:30:03.245 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "crush_compat_step", 2024-09-19T07:30:03.245 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "float", 2024-09-19T07:30:03.245 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.245 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.245 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0.5", 2024-09-19T07:30:03.246 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "0.001", 2024-09-19T07:30:03.246 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "0.999", 2024-09-19T07:30:03.246 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.246 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "aggressiveness of optimization", 2024-09-19T07:30:03.246 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T07:30:03.246 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.246 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.246 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.246 INFO:teuthology.orchestra.run.smithi148.stdout: "end_time": { 2024-09-19T07:30:03.246 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "end_time", 2024-09-19T07:30:03.246 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.246 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.246 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.247 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "2359", 2024-09-19T07:30:03.247 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.247 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.247 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.247 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T07:30:03.247 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T07:30:03.247 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.247 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.247 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.247 INFO:teuthology.orchestra.run.smithi148.stdout: "end_weekday": { 2024-09-19T07:30:03.247 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "end_weekday", 2024-09-19T07:30:03.247 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "uint", 2024-09-19T07:30:03.247 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.247 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.248 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-19T07:30:03.248 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "0", 2024-09-19T07:30:03.248 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "6", 2024-09-19T07:30:03.248 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.248 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T07:30:03.248 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T07:30:03.248 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.248 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.248 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.248 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.248 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.248 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.248 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.248 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.249 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.249 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.249 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.249 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.249 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.249 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.249 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.249 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.249 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.249 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.249 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.249 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.249 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.250 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.250 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.250 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.250 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.250 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.250 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.250 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.250 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.250 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.250 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.250 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.250 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.250 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.250 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.251 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.251 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.251 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.251 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.251 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.251 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.251 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.251 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.251 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.251 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.251 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.251 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.251 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.251 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.252 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.252 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.252 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.252 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.252 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.252 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.252 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.252 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.252 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.252 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.252 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.252 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.252 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.253 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.253 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.253 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.253 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.253 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.253 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.253 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.253 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.253 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.253 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.253 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.253 INFO:teuthology.orchestra.run.smithi148.stdout: "min_score": { 2024-09-19T07:30:03.253 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "min_score", 2024-09-19T07:30:03.253 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "float", 2024-09-19T07:30:03.254 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.254 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.254 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-19T07:30:03.254 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.254 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.254 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.254 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T07:30:03.254 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.254 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.254 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.254 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.254 INFO:teuthology.orchestra.run.smithi148.stdout: "mode": { 2024-09-19T07:30:03.254 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "mode", 2024-09-19T07:30:03.255 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.255 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.255 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.255 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "upmap", 2024-09-19T07:30:03.255 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.255 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.255 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.255 INFO:teuthology.orchestra.run.smithi148.stdout: "crush-compat", 2024-09-19T07:30:03.255 INFO:teuthology.orchestra.run.smithi148.stdout: "none", 2024-09-19T07:30:03.255 INFO:teuthology.orchestra.run.smithi148.stdout: "read", 2024-09-19T07:30:03.255 INFO:teuthology.orchestra.run.smithi148.stdout: "upmap", 2024-09-19T07:30:03.255 INFO:teuthology.orchestra.run.smithi148.stdout: "upmap-read" 2024-09-19T07:30:03.255 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.256 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Balancer mode", 2024-09-19T07:30:03.256 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.256 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.256 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.256 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.256 INFO:teuthology.orchestra.run.smithi148.stdout: "pool_ids": { 2024-09-19T07:30:03.256 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "pool_ids", 2024-09-19T07:30:03.256 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.256 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.256 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.256 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.256 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.256 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.256 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.257 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T07:30:03.257 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.257 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.257 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.257 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.257 INFO:teuthology.orchestra.run.smithi148.stdout: "sleep_interval": { 2024-09-19T07:30:03.257 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sleep_interval", 2024-09-19T07:30:03.257 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:03.257 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.257 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.257 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "60", 2024-09-19T07:30:03.257 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.257 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.258 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.258 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T07:30:03.258 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.258 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.258 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.258 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.258 INFO:teuthology.orchestra.run.smithi148.stdout: "upmap_max_deviation": { 2024-09-19T07:30:03.258 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "upmap_max_deviation", 2024-09-19T07:30:03.258 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.258 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.258 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.258 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "5", 2024-09-19T07:30:03.258 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "1", 2024-09-19T07:30:03.258 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.259 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.259 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T07:30:03.259 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T07:30:03.259 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.259 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.259 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.259 INFO:teuthology.orchestra.run.smithi148.stdout: "upmap_max_optimizations": { 2024-09-19T07:30:03.259 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "upmap_max_optimizations", 2024-09-19T07:30:03.259 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "uint", 2024-09-19T07:30:03.259 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.259 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.259 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10", 2024-09-19T07:30:03.259 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.260 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.260 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.260 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T07:30:03.260 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.260 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.260 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.260 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.260 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.260 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.260 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.260 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "cephadm", 2024-09-19T07:30:03.260 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.260 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.261 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.261 INFO:teuthology.orchestra.run.smithi148.stdout: "agent_down_multiplier": { 2024-09-19T07:30:03.261 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "agent_down_multiplier", 2024-09-19T07:30:03.261 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "float", 2024-09-19T07:30:03.261 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.261 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.261 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "3.0", 2024-09-19T07:30:03.261 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.261 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.261 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.261 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T07:30:03.261 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.261 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.261 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.262 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.262 INFO:teuthology.orchestra.run.smithi148.stdout: "agent_refresh_rate": { 2024-09-19T07:30:03.262 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "agent_refresh_rate", 2024-09-19T07:30:03.262 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:03.262 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.262 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.262 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "20", 2024-09-19T07:30:03.262 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.262 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.262 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.262 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T07:30:03.262 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.262 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.263 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.263 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.263 INFO:teuthology.orchestra.run.smithi148.stdout: "agent_starting_port": { 2024-09-19T07:30:03.263 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "agent_starting_port", 2024-09-19T07:30:03.263 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.263 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.263 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.263 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "4721", 2024-09-19T07:30:03.263 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.263 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.263 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.263 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T07:30:03.263 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.264 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.264 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.264 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.264 INFO:teuthology.orchestra.run.smithi148.stdout: "allow_ptrace": { 2024-09-19T07:30:03.264 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "allow_ptrace", 2024-09-19T07:30:03.264 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.264 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.264 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.264 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.264 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.264 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.264 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.264 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T07:30:03.265 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T07:30:03.265 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.265 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.265 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.265 INFO:teuthology.orchestra.run.smithi148.stdout: "autotune_interval": { 2024-09-19T07:30:03.265 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "autotune_interval", 2024-09-19T07:30:03.265 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:03.265 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.265 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.265 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "600", 2024-09-19T07:30:03.265 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.265 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.265 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.265 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T07:30:03.266 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.266 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.266 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.266 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.266 INFO:teuthology.orchestra.run.smithi148.stdout: "autotune_memory_target_ratio": { 2024-09-19T07:30:03.266 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T07:30:03.266 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "float", 2024-09-19T07:30:03.266 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.266 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.266 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0.7", 2024-09-19T07:30:03.266 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.266 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.266 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.266 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T07:30:03.267 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.267 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.267 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.267 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.267 INFO:teuthology.orchestra.run.smithi148.stdout: "cephadm_log_destination": { 2024-09-19T07:30:03.267 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "cephadm_log_destination", 2024-09-19T07:30:03.267 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.267 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.267 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.267 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.267 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.267 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.267 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.267 INFO:teuthology.orchestra.run.smithi148.stdout: "file", 2024-09-19T07:30:03.268 INFO:teuthology.orchestra.run.smithi148.stdout: "file,syslog", 2024-09-19T07:30:03.268 INFO:teuthology.orchestra.run.smithi148.stdout: "syslog" 2024-09-19T07:30:03.268 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.268 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T07:30:03.268 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.268 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.268 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.268 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.268 INFO:teuthology.orchestra.run.smithi148.stdout: "cgroups_split": { 2024-09-19T07:30:03.268 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "cgroups_split", 2024-09-19T07:30:03.268 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.268 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.268 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.269 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:03.269 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.269 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.269 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.269 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T07:30:03.269 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.269 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.269 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.269 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.269 INFO:teuthology.orchestra.run.smithi148.stdout: "config_checks_enabled": { 2024-09-19T07:30:03.269 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "config_checks_enabled", 2024-09-19T07:30:03.269 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.269 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.270 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.270 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.270 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.270 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.270 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.270 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T07:30:03.270 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.270 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.270 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.270 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.270 INFO:teuthology.orchestra.run.smithi148.stdout: "config_dashboard": { 2024-09-19T07:30:03.270 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "config_dashboard", 2024-09-19T07:30:03.270 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.270 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.271 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.271 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:03.271 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.271 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.271 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.271 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T07:30:03.271 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.271 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.271 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.271 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.271 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_alertmanager": { 2024-09-19T07:30:03.271 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_alertmanager", 2024-09-19T07:30:03.271 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.272 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.272 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.272 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T07:30:03.272 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.272 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.272 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.272 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Prometheus container image", 2024-09-19T07:30:03.272 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.272 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.272 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.272 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.272 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_base": { 2024-09-19T07:30:03.272 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_base", 2024-09-19T07:30:03.273 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.273 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.273 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.273 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T07:30:03.273 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.273 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.273 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.273 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Container image name, without the tag", 2024-09-19T07:30:03.273 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.273 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.273 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.273 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.273 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_elasticsearch": { 2024-09-19T07:30:03.273 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_elasticsearch", 2024-09-19T07:30:03.274 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.274 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.274 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.274 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T07:30:03.274 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.274 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.274 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.274 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "elasticsearch container image", 2024-09-19T07:30:03.274 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.274 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.274 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.274 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.274 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_grafana": { 2024-09-19T07:30:03.274 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_grafana", 2024-09-19T07:30:03.275 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.275 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.275 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.275 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T07:30:03.275 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.275 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.275 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.275 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Prometheus container image", 2024-09-19T07:30:03.275 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.275 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.275 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.275 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.275 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_haproxy": { 2024-09-19T07:30:03.276 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_haproxy", 2024-09-19T07:30:03.276 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.276 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.276 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.276 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T07:30:03.276 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.276 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.276 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.276 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "HAproxy container image", 2024-09-19T07:30:03.276 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.276 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.276 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.276 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.276 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_jaeger_agent": { 2024-09-19T07:30:03.277 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_jaeger_agent", 2024-09-19T07:30:03.277 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.277 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.277 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.277 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T07:30:03.277 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.277 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.277 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.277 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Jaeger agent container image", 2024-09-19T07:30:03.277 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.277 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.277 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.277 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.278 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_jaeger_collector": { 2024-09-19T07:30:03.278 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_jaeger_collector", 2024-09-19T07:30:03.278 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.278 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.278 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.278 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T07:30:03.278 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.278 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.278 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.278 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Jaeger collector container image", 2024-09-19T07:30:03.278 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.278 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.278 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.279 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.279 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_jaeger_query": { 2024-09-19T07:30:03.279 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_jaeger_query", 2024-09-19T07:30:03.279 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.279 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.279 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.279 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T07:30:03.279 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.279 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.279 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.279 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Jaeger query container image", 2024-09-19T07:30:03.279 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.279 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.279 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.280 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.280 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_keepalived": { 2024-09-19T07:30:03.280 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_keepalived", 2024-09-19T07:30:03.280 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.280 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.280 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.280 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T07:30:03.280 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.280 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.280 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.281 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Keepalived container image", 2024-09-19T07:30:03.281 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.281 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.281 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.281 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.281 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_loki": { 2024-09-19T07:30:03.281 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_loki", 2024-09-19T07:30:03.281 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.281 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.281 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.281 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T07:30:03.281 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.281 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.281 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.282 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Loki container image", 2024-09-19T07:30:03.282 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.282 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.282 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.282 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.282 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_node_exporter": { 2024-09-19T07:30:03.282 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_node_exporter", 2024-09-19T07:30:03.282 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.282 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.282 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.282 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T07:30:03.282 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.282 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.282 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.283 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Prometheus container image", 2024-09-19T07:30:03.283 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.283 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.283 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.283 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.283 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_nvmeof": { 2024-09-19T07:30:03.283 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_nvmeof", 2024-09-19T07:30:03.283 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.283 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.283 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.283 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T07:30:03.283 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.283 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.283 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.284 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Nvme-of container image", 2024-09-19T07:30:03.284 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.284 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.284 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.284 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.284 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_prometheus": { 2024-09-19T07:30:03.284 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_prometheus", 2024-09-19T07:30:03.284 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.284 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.284 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.284 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T07:30:03.284 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.284 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.285 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.285 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Prometheus container image", 2024-09-19T07:30:03.285 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.285 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.285 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.285 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.285 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_promtail": { 2024-09-19T07:30:03.285 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_promtail", 2024-09-19T07:30:03.285 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.285 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.285 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.285 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T07:30:03.285 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.285 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.286 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.286 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Promtail container image", 2024-09-19T07:30:03.286 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.286 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.286 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.286 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.286 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_samba": { 2024-09-19T07:30:03.286 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_samba", 2024-09-19T07:30:03.286 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.286 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.286 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.286 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T07:30:03.286 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.287 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.287 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.287 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Samba/SMB container image", 2024-09-19T07:30:03.287 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.287 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.287 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.287 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.287 INFO:teuthology.orchestra.run.smithi148.stdout: "container_image_snmp_gateway": { 2024-09-19T07:30:03.287 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_image_snmp_gateway", 2024-09-19T07:30:03.287 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.287 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.287 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.288 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T07:30:03.288 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.288 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.288 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.288 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "SNMP Gateway container image", 2024-09-19T07:30:03.288 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.288 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.288 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.288 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.288 INFO:teuthology.orchestra.run.smithi148.stdout: "container_init": { 2024-09-19T07:30:03.288 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "container_init", 2024-09-19T07:30:03.288 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.288 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.289 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.289 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:03.289 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.289 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.289 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.289 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T07:30:03.289 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.289 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.289 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.289 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.289 INFO:teuthology.orchestra.run.smithi148.stdout: "daemon_cache_timeout": { 2024-09-19T07:30:03.289 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "daemon_cache_timeout", 2024-09-19T07:30:03.289 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:03.289 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.290 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.290 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "600", 2024-09-19T07:30:03.290 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.290 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.290 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.290 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T07:30:03.290 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.290 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.290 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.290 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.290 INFO:teuthology.orchestra.run.smithi148.stdout: "default_cephadm_command_timeout": { 2024-09-19T07:30:03.290 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T07:30:03.290 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.291 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.291 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.291 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "900", 2024-09-19T07:30:03.291 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.291 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.291 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.291 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T07:30:03.291 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.291 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.291 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.291 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.291 INFO:teuthology.orchestra.run.smithi148.stdout: "default_registry": { 2024-09-19T07:30:03.291 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "default_registry", 2024-09-19T07:30:03.291 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.292 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.292 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.292 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "docker.io", 2024-09-19T07:30:03.292 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.292 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.292 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.292 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T07:30:03.292 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.292 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.292 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.292 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.292 INFO:teuthology.orchestra.run.smithi148.stdout: "device_cache_timeout": { 2024-09-19T07:30:03.292 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "device_cache_timeout", 2024-09-19T07:30:03.293 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:03.293 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.293 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.293 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "1800", 2024-09-19T07:30:03.293 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.293 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.293 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.293 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "seconds to cache device inventory", 2024-09-19T07:30:03.293 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.293 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.293 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.293 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.293 INFO:teuthology.orchestra.run.smithi148.stdout: "device_enhanced_scan": { 2024-09-19T07:30:03.294 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "device_enhanced_scan", 2024-09-19T07:30:03.294 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.294 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.294 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.294 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.294 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.294 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.294 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.294 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T07:30:03.294 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.294 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.294 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.294 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.294 INFO:teuthology.orchestra.run.smithi148.stdout: "facts_cache_timeout": { 2024-09-19T07:30:03.295 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "facts_cache_timeout", 2024-09-19T07:30:03.295 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:03.295 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.295 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.295 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "60", 2024-09-19T07:30:03.295 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.295 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.295 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.295 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "seconds to cache host facts data", 2024-09-19T07:30:03.295 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.295 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.295 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.295 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.295 INFO:teuthology.orchestra.run.smithi148.stdout: "grafana_dashboards_path": { 2024-09-19T07:30:03.296 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "grafana_dashboards_path", 2024-09-19T07:30:03.296 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.296 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.296 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.296 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T07:30:03.296 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.296 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.296 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.296 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T07:30:03.296 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.296 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.296 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.296 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.297 INFO:teuthology.orchestra.run.smithi148.stdout: "host_check_interval": { 2024-09-19T07:30:03.297 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "host_check_interval", 2024-09-19T07:30:03.297 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:03.297 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.297 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.297 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "600", 2024-09-19T07:30:03.297 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.297 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.297 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.297 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "how frequently to perform a host check", 2024-09-19T07:30:03.297 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.297 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.297 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.297 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.298 INFO:teuthology.orchestra.run.smithi148.stdout: "hw_monitoring": { 2024-09-19T07:30:03.298 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "hw_monitoring", 2024-09-19T07:30:03.298 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.298 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.298 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.298 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.298 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.298 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.298 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.298 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T07:30:03.298 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.298 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.298 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.298 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.299 INFO:teuthology.orchestra.run.smithi148.stdout: "inventory_list_all": { 2024-09-19T07:30:03.299 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "inventory_list_all", 2024-09-19T07:30:03.299 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.299 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.299 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.299 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.299 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.299 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.299 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.299 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T07:30:03.299 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.299 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.299 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.299 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.300 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.300 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.300 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.300 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.300 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.300 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.300 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.300 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.300 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.300 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.300 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.300 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.300 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.300 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.301 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.301 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.301 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.301 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.301 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.301 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.301 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.301 INFO:teuthology.orchestra.run.smithi148.stdout: "log_refresh_metadata": { 2024-09-19T07:30:03.301 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_refresh_metadata", 2024-09-19T07:30:03.301 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.301 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.301 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.302 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.302 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.302 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.302 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.302 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T07:30:03.302 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.302 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.302 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.302 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.302 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.302 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.302 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.302 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.302 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.303 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:03.303 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.303 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.303 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.303 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T07:30:03.303 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.303 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.303 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.303 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.303 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.303 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.303 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.303 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.304 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.304 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.304 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.304 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.304 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.304 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.304 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.304 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.304 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.304 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.304 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.304 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.304 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.305 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.305 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.305 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.305 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.305 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.305 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.305 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.305 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.305 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.305 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.305 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.305 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.305 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.306 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.306 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.306 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.306 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.306 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.306 INFO:teuthology.orchestra.run.smithi148.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T07:30:03.306 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T07:30:03.306 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.306 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.306 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.306 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.306 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.306 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.306 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.307 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T07:30:03.307 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.307 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.307 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.307 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.307 INFO:teuthology.orchestra.run.smithi148.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T07:30:03.307 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T07:30:03.307 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.307 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.307 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.307 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "*", 2024-09-19T07:30:03.307 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.307 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.307 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.308 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T07:30:03.308 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.308 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.308 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.308 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.308 INFO:teuthology.orchestra.run.smithi148.stdout: "max_count_per_host": { 2024-09-19T07:30:03.308 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "max_count_per_host", 2024-09-19T07:30:03.308 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.308 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.308 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.308 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10", 2024-09-19T07:30:03.308 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.308 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.309 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.309 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "max number of daemons per service per host", 2024-09-19T07:30:03.309 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.309 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.309 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.309 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.309 INFO:teuthology.orchestra.run.smithi148.stdout: "max_osd_draining_count": { 2024-09-19T07:30:03.309 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "max_osd_draining_count", 2024-09-19T07:30:03.309 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.309 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.309 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.309 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10", 2024-09-19T07:30:03.309 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.309 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.310 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.310 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T07:30:03.310 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.310 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.310 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.310 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.310 INFO:teuthology.orchestra.run.smithi148.stdout: "migration_current": { 2024-09-19T07:30:03.310 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "migration_current", 2024-09-19T07:30:03.310 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.310 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.310 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.310 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.310 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.311 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.311 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.311 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "internal - do not modify", 2024-09-19T07:30:03.311 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.311 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.311 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.311 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.311 INFO:teuthology.orchestra.run.smithi148.stdout: "mode": { 2024-09-19T07:30:03.311 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "mode", 2024-09-19T07:30:03.311 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.311 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.311 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.311 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "root", 2024-09-19T07:30:03.312 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.312 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.312 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.312 INFO:teuthology.orchestra.run.smithi148.stdout: "cephadm-package", 2024-09-19T07:30:03.312 INFO:teuthology.orchestra.run.smithi148.stdout: "root" 2024-09-19T07:30:03.312 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.312 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T07:30:03.312 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.312 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.312 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.312 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.312 INFO:teuthology.orchestra.run.smithi148.stdout: "oob_default_addr": { 2024-09-19T07:30:03.312 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "oob_default_addr", 2024-09-19T07:30:03.312 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.313 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.313 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.313 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "169.254.1.1", 2024-09-19T07:30:03.313 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.313 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.313 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.313 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T07:30:03.313 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.313 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.313 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.313 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.313 INFO:teuthology.orchestra.run.smithi148.stdout: "prometheus_alerts_path": { 2024-09-19T07:30:03.313 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "prometheus_alerts_path", 2024-09-19T07:30:03.313 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.314 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.314 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.314 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T07:30:03.314 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.314 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.314 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.314 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T07:30:03.314 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.314 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.314 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.314 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.314 INFO:teuthology.orchestra.run.smithi148.stdout: "registry_insecure": { 2024-09-19T07:30:03.314 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "registry_insecure", 2024-09-19T07:30:03.314 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.314 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.315 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.315 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.315 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.315 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.315 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.315 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T07:30:03.315 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.315 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.315 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.315 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.315 INFO:teuthology.orchestra.run.smithi148.stdout: "registry_password": { 2024-09-19T07:30:03.315 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "registry_password", 2024-09-19T07:30:03.315 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.316 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.316 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.316 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.316 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.316 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.316 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.316 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T07:30:03.316 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.316 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.316 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.316 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.316 INFO:teuthology.orchestra.run.smithi148.stdout: "registry_url": { 2024-09-19T07:30:03.316 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "registry_url", 2024-09-19T07:30:03.317 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.317 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.317 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.317 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.317 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.317 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.317 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.317 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T07:30:03.317 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.317 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.317 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.317 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.317 INFO:teuthology.orchestra.run.smithi148.stdout: "registry_username": { 2024-09-19T07:30:03.317 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "registry_username", 2024-09-19T07:30:03.318 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.318 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.318 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.318 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.318 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.318 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.318 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.318 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T07:30:03.318 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.318 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.318 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.318 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.318 INFO:teuthology.orchestra.run.smithi148.stdout: "secure_monitoring_stack": { 2024-09-19T07:30:03.318 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "secure_monitoring_stack", 2024-09-19T07:30:03.319 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.319 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.319 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.319 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.319 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.319 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.319 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.319 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T07:30:03.319 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.319 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.319 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.319 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.319 INFO:teuthology.orchestra.run.smithi148.stdout: "service_discovery_port": { 2024-09-19T07:30:03.319 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "service_discovery_port", 2024-09-19T07:30:03.319 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.320 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.320 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.320 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "8765", 2024-09-19T07:30:03.320 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.320 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.320 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.320 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "cephadm service discovery port", 2024-09-19T07:30:03.320 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.320 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.320 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.320 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.320 INFO:teuthology.orchestra.run.smithi148.stdout: "ssh_config_file": { 2024-09-19T07:30:03.321 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ssh_config_file", 2024-09-19T07:30:03.321 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.321 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.321 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.321 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.321 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.321 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.321 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.321 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T07:30:03.321 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.321 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.321 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.321 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.322 INFO:teuthology.orchestra.run.smithi148.stdout: "use_agent": { 2024-09-19T07:30:03.322 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "use_agent", 2024-09-19T07:30:03.322 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.322 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.322 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.322 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.322 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.322 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.322 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.322 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T07:30:03.322 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.322 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.322 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.323 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.323 INFO:teuthology.orchestra.run.smithi148.stdout: "use_repo_digest": { 2024-09-19T07:30:03.323 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "use_repo_digest", 2024-09-19T07:30:03.323 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.323 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.323 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.323 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:03.323 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.323 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.323 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.323 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T07:30:03.323 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.323 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.324 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.324 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.324 INFO:teuthology.orchestra.run.smithi148.stdout: "warn_on_failed_host_check": { 2024-09-19T07:30:03.324 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "warn_on_failed_host_check", 2024-09-19T07:30:03.324 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.324 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.324 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.324 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:03.324 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.324 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.324 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.324 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T07:30:03.324 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.324 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.325 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.325 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.325 INFO:teuthology.orchestra.run.smithi148.stdout: "warn_on_stray_daemons": { 2024-09-19T07:30:03.325 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "warn_on_stray_daemons", 2024-09-19T07:30:03.325 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.325 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.325 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.325 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:03.325 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.325 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.325 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.325 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T07:30:03.325 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.325 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.326 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.326 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.326 INFO:teuthology.orchestra.run.smithi148.stdout: "warn_on_stray_hosts": { 2024-09-19T07:30:03.326 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "warn_on_stray_hosts", 2024-09-19T07:30:03.326 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.326 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.326 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.326 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:03.326 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.326 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.326 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.326 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T07:30:03.326 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.326 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.327 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.327 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.327 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.327 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.327 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.327 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "crash", 2024-09-19T07:30:03.327 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.327 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.327 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.327 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.327 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.327 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.327 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.328 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.328 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.328 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.328 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.328 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.328 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.328 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.328 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.328 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.328 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.328 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.328 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.328 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.329 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.329 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.329 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.329 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.329 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.329 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.329 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.329 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.329 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.329 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.329 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.329 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.329 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.329 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.330 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.330 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.330 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.330 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.330 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.330 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.330 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.330 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.330 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.330 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.330 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.330 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.330 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.331 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.331 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.331 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.331 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.331 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.331 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.331 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.331 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.331 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.331 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.331 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.331 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.331 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.332 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.332 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.332 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.332 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.332 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.332 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.332 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.332 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.332 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.332 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.332 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.332 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.332 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.332 INFO:teuthology.orchestra.run.smithi148.stdout: "retain_interval": { 2024-09-19T07:30:03.333 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "retain_interval", 2024-09-19T07:30:03.333 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:03.333 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.333 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.333 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "31536000", 2024-09-19T07:30:03.333 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.333 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.333 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.333 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T07:30:03.333 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.333 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.333 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.333 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.334 INFO:teuthology.orchestra.run.smithi148.stdout: "warn_recent_interval": { 2024-09-19T07:30:03.334 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "warn_recent_interval", 2024-09-19T07:30:03.334 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:03.334 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.334 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.334 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "1209600", 2024-09-19T07:30:03.334 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.334 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.334 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.334 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T07:30:03.334 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.334 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.334 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.335 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.335 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.335 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.335 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.335 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "dashboard", 2024-09-19T07:30:03.335 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.335 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.335 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.335 INFO:teuthology.orchestra.run.smithi148.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T07:30:03.335 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T07:30:03.335 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.335 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.335 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.336 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10", 2024-09-19T07:30:03.336 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.336 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.336 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.336 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.336 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.336 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.336 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.336 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.336 INFO:teuthology.orchestra.run.smithi148.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T07:30:03.336 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T07:30:03.336 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.336 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.337 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.337 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.337 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.337 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.337 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.337 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.337 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.337 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.337 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.337 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.337 INFO:teuthology.orchestra.run.smithi148.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T07:30:03.337 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T07:30:03.338 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.338 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.338 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.338 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:03.338 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.338 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.338 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.338 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.338 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.338 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.338 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.338 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.338 INFO:teuthology.orchestra.run.smithi148.stdout: "AUDIT_API_ENABLED": { 2024-09-19T07:30:03.339 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T07:30:03.339 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.339 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.339 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.339 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.339 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.339 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.339 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.339 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.339 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.339 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.339 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.339 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.339 INFO:teuthology.orchestra.run.smithi148.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T07:30:03.340 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T07:30:03.340 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.340 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.340 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.340 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:03.340 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.340 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.340 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.340 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.340 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.340 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.340 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.341 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.341 INFO:teuthology.orchestra.run.smithi148.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T07:30:03.341 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T07:30:03.341 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.341 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.341 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.341 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:03.341 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.341 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.341 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.341 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.341 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.341 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.342 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.342 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.342 INFO:teuthology.orchestra.run.smithi148.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T07:30:03.342 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T07:30:03.342 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.342 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.342 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.342 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:03.342 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.342 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.342 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.342 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.342 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.342 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.343 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.343 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.343 INFO:teuthology.orchestra.run.smithi148.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T07:30:03.343 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T07:30:03.343 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.343 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.343 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.343 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:03.343 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.343 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.343 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.343 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.343 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.344 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.344 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.344 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.344 INFO:teuthology.orchestra.run.smithi148.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T07:30:03.344 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T07:30:03.344 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.344 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.344 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.344 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:03.344 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.344 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.344 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.344 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.344 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.345 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.345 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.345 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.345 INFO:teuthology.orchestra.run.smithi148.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T07:30:03.345 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T07:30:03.345 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.345 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.345 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.345 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:03.345 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.345 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.345 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.345 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.346 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.346 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.346 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.346 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.346 INFO:teuthology.orchestra.run.smithi148.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T07:30:03.346 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T07:30:03.346 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.346 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.346 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.346 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:03.346 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.346 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.346 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.346 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.347 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.347 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.347 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.347 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.347 INFO:teuthology.orchestra.run.smithi148.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T07:30:03.347 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T07:30:03.347 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.347 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.347 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.347 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:03.347 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.347 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.347 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.348 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.348 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.348 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.348 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.348 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.348 INFO:teuthology.orchestra.run.smithi148.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T07:30:03.348 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T07:30:03.348 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.348 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.348 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.348 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:03.348 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.348 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.348 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.349 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.349 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.349 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.349 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.349 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.349 INFO:teuthology.orchestra.run.smithi148.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T07:30:03.349 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T07:30:03.349 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.349 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.349 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.349 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.350 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.350 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.350 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.350 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.350 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.350 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.350 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.350 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.350 INFO:teuthology.orchestra.run.smithi148.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T07:30:03.350 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T07:30:03.350 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.350 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.350 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.351 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "admin", 2024-09-19T07:30:03.351 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.351 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.351 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.351 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.351 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.351 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.351 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.351 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.351 INFO:teuthology.orchestra.run.smithi148.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T07:30:03.351 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T07:30:03.351 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.351 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.351 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.352 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:03.352 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.352 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.352 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.352 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.352 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.352 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.352 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.352 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.352 INFO:teuthology.orchestra.run.smithi148.stdout: "GRAFANA_API_URL": { 2024-09-19T07:30:03.352 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "GRAFANA_API_URL", 2024-09-19T07:30:03.352 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.353 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.353 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.353 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.353 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.353 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.353 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.353 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.353 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.353 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.353 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.353 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.353 INFO:teuthology.orchestra.run.smithi148.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T07:30:03.353 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T07:30:03.354 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.354 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.354 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.354 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "admin", 2024-09-19T07:30:03.354 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.354 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.354 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.354 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.354 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.354 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.354 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.354 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.354 INFO:teuthology.orchestra.run.smithi148.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T07:30:03.354 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T07:30:03.354 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.355 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.355 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.355 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.355 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.355 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.355 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.355 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.355 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.355 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.355 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.355 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.355 INFO:teuthology.orchestra.run.smithi148.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T07:30:03.355 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T07:30:03.356 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.356 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.356 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.356 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.356 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.356 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.356 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.356 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.356 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.356 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.356 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.356 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.356 INFO:teuthology.orchestra.run.smithi148.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T07:30:03.356 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T07:30:03.357 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.357 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.357 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.357 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:03.357 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.357 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.357 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.357 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.357 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.357 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.357 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.357 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.357 INFO:teuthology.orchestra.run.smithi148.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T07:30:03.358 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T07:30:03.358 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.358 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.358 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.358 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.358 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.358 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.358 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.358 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.358 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.358 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.358 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.358 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.358 INFO:teuthology.orchestra.run.smithi148.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T07:30:03.359 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T07:30:03.359 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.359 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.359 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.359 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.359 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.359 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.359 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.359 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.359 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.359 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.359 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.359 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.359 INFO:teuthology.orchestra.run.smithi148.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T07:30:03.360 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T07:30:03.360 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.360 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.360 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.360 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:03.360 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.360 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.360 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.360 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.360 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.360 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.360 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.360 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.361 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T07:30:03.361 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T07:30:03.361 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.361 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.361 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.361 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.361 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.361 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.361 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.361 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.361 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.361 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.361 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.361 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.362 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T07:30:03.362 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T07:30:03.362 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.362 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.362 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.362 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.362 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.362 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.362 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.362 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.362 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.362 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.362 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.362 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.363 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T07:30:03.363 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T07:30:03.363 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.363 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.363 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.363 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:03.363 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.363 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.363 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.363 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.363 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.363 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.363 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.364 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.364 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T07:30:03.364 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T07:30:03.364 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.364 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.364 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.364 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:03.364 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.364 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.364 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.364 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.364 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.364 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.364 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.365 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.365 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T07:30:03.365 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T07:30:03.365 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.365 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.365 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.365 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.365 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.365 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.365 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.365 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.365 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.365 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.365 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.366 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.366 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T07:30:03.366 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T07:30:03.366 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.366 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.366 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.366 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.366 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.366 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.366 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.366 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.366 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.366 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.367 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.367 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.367 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T07:30:03.367 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T07:30:03.367 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.367 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.367 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.367 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.367 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.367 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.367 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.367 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.367 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.368 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.368 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.368 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.368 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T07:30:03.368 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T07:30:03.368 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.368 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.368 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.368 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:03.368 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.368 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.368 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.368 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.368 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.369 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.369 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.369 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.369 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T07:30:03.369 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T07:30:03.369 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.369 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.369 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.369 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T07:30:03.369 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.369 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.369 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.369 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.369 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.370 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.370 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.370 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.370 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T07:30:03.370 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T07:30:03.370 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.370 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.370 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.370 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10", 2024-09-19T07:30:03.370 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.370 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.370 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.370 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.371 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.371 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.371 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.371 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.371 INFO:teuthology.orchestra.run.smithi148.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T07:30:03.371 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T07:30:03.371 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.371 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.371 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.371 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "8", 2024-09-19T07:30:03.371 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.371 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.371 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.371 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.372 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.372 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.372 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.372 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.372 INFO:teuthology.orchestra.run.smithi148.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T07:30:03.372 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T07:30:03.372 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.372 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.372 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.372 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "45", 2024-09-19T07:30:03.372 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.372 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.372 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.373 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.373 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.373 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.373 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.373 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.373 INFO:teuthology.orchestra.run.smithi148.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T07:30:03.373 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T07:30:03.373 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.373 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.373 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.373 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.373 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.373 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.374 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.374 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.374 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.374 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.374 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.374 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.374 INFO:teuthology.orchestra.run.smithi148.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T07:30:03.374 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T07:30:03.374 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.374 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.374 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.374 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "admin", 2024-09-19T07:30:03.374 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.374 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.375 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.375 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.375 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.375 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.375 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.375 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.375 INFO:teuthology.orchestra.run.smithi148.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T07:30:03.375 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T07:30:03.375 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.375 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.375 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.375 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.375 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.375 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.376 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.376 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.376 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.376 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.376 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.376 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.376 INFO:teuthology.orchestra.run.smithi148.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T07:30:03.376 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T07:30:03.376 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.376 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.376 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.376 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:03.376 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.377 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.377 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.377 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.377 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.377 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.377 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.377 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.377 INFO:teuthology.orchestra.run.smithi148.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T07:30:03.377 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T07:30:03.377 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.377 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.377 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.377 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-19T07:30:03.378 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.378 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.378 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.378 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.378 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.378 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.378 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.378 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.378 INFO:teuthology.orchestra.run.smithi148.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T07:30:03.378 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T07:30:03.378 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.378 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.378 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.378 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10", 2024-09-19T07:30:03.379 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.379 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.379 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.379 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.379 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.379 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.379 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.379 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.379 INFO:teuthology.orchestra.run.smithi148.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T07:30:03.379 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T07:30:03.379 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.379 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.379 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.380 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "5", 2024-09-19T07:30:03.380 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.380 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.380 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.380 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.380 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.380 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.380 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.380 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.380 INFO:teuthology.orchestra.run.smithi148.stdout: "cross_origin_url": { 2024-09-19T07:30:03.380 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "cross_origin_url", 2024-09-19T07:30:03.380 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.380 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.380 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.381 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.381 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.381 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.381 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.381 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.381 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.381 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.381 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.381 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.381 INFO:teuthology.orchestra.run.smithi148.stdout: "crt_file": { 2024-09-19T07:30:03.381 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "crt_file", 2024-09-19T07:30:03.381 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.381 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.382 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.382 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.382 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.382 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.382 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.382 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.382 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.382 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.382 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.382 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.382 INFO:teuthology.orchestra.run.smithi148.stdout: "debug": { 2024-09-19T07:30:03.382 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "debug", 2024-09-19T07:30:03.382 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.382 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.383 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.383 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.383 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.383 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.383 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.383 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Enable/disable debug options", 2024-09-19T07:30:03.383 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.383 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.383 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.383 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.383 INFO:teuthology.orchestra.run.smithi148.stdout: "jwt_token_ttl": { 2024-09-19T07:30:03.383 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "jwt_token_ttl", 2024-09-19T07:30:03.384 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.384 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.384 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.384 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "28800", 2024-09-19T07:30:03.384 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.384 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.384 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.384 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.384 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.384 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.384 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.384 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.384 INFO:teuthology.orchestra.run.smithi148.stdout: "key_file": { 2024-09-19T07:30:03.385 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "key_file", 2024-09-19T07:30:03.385 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.385 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.385 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.385 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.385 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.385 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.385 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.385 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.385 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.385 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.385 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.385 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.386 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.386 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.386 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.386 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.386 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.386 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.386 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.386 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.386 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.386 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.386 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.386 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.386 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.387 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.387 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.387 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.387 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.387 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.387 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.387 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.387 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.387 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.387 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.387 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.387 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.387 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.387 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.388 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.388 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.388 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.388 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.388 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.388 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.388 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.388 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.388 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.388 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.388 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.388 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.388 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.389 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.389 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.389 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.389 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.389 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.389 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.389 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.389 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.389 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.389 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.389 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.389 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.389 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.390 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.390 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.390 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.390 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.390 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.390 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.390 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.390 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.390 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.390 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.390 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.390 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.390 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.390 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.391 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.391 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.391 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.391 INFO:teuthology.orchestra.run.smithi148.stdout: "motd": { 2024-09-19T07:30:03.391 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "motd", 2024-09-19T07:30:03.391 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.391 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.391 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.391 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.391 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.391 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.391 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.391 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "The message of the day", 2024-09-19T07:30:03.392 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.392 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.392 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.392 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.392 INFO:teuthology.orchestra.run.smithi148.stdout: "redirect_resolve_ip_addr": { 2024-09-19T07:30:03.392 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T07:30:03.392 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.392 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.392 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.392 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.392 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.392 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.392 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.393 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.393 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.393 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.393 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.393 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.393 INFO:teuthology.orchestra.run.smithi148.stdout: "server_addr": { 2024-09-19T07:30:03.393 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "server_addr", 2024-09-19T07:30:03.393 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.393 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.393 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.393 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "::", 2024-09-19T07:30:03.393 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.393 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.393 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.394 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.394 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.394 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.394 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.394 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.394 INFO:teuthology.orchestra.run.smithi148.stdout: "server_port": { 2024-09-19T07:30:03.394 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "server_port", 2024-09-19T07:30:03.394 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.394 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.394 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.394 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "8080", 2024-09-19T07:30:03.394 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.394 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.394 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.395 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.395 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.395 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.395 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.395 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.395 INFO:teuthology.orchestra.run.smithi148.stdout: "ssl": { 2024-09-19T07:30:03.395 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ssl", 2024-09-19T07:30:03.395 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.395 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.395 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.395 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:03.395 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.395 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.395 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.396 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.396 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.396 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.396 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.396 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.396 INFO:teuthology.orchestra.run.smithi148.stdout: "ssl_server_port": { 2024-09-19T07:30:03.396 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ssl_server_port", 2024-09-19T07:30:03.396 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.396 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.396 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.396 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "8443", 2024-09-19T07:30:03.396 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.396 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.397 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.397 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.397 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.397 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.397 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.397 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.397 INFO:teuthology.orchestra.run.smithi148.stdout: "standby_behaviour": { 2024-09-19T07:30:03.397 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "standby_behaviour", 2024-09-19T07:30:03.397 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.397 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.397 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.397 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "redirect", 2024-09-19T07:30:03.397 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.397 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.398 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.398 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.398 INFO:teuthology.orchestra.run.smithi148.stdout: "redirect" 2024-09-19T07:30:03.398 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.398 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.398 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.398 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.398 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.398 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.398 INFO:teuthology.orchestra.run.smithi148.stdout: "standby_error_status_code": { 2024-09-19T07:30:03.398 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "standby_error_status_code", 2024-09-19T07:30:03.398 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.398 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.398 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.399 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "500", 2024-09-19T07:30:03.399 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "400", 2024-09-19T07:30:03.399 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "599", 2024-09-19T07:30:03.399 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.399 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.399 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.399 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.399 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.399 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.399 INFO:teuthology.orchestra.run.smithi148.stdout: "url_prefix": { 2024-09-19T07:30:03.399 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "url_prefix", 2024-09-19T07:30:03.399 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.399 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.400 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.400 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.400 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.400 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.400 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.400 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.400 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.400 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.400 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.400 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.400 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.400 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.400 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.401 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "devicehealth", 2024-09-19T07:30:03.401 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.401 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.401 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.401 INFO:teuthology.orchestra.run.smithi148.stdout: "enable_monitoring": { 2024-09-19T07:30:03.401 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "enable_monitoring", 2024-09-19T07:30:03.401 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.401 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.401 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.401 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:03.401 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.401 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.401 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.402 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "monitor device health metrics", 2024-09-19T07:30:03.402 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.402 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.402 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.402 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.402 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.402 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.402 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.402 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.402 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.402 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.402 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.402 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.402 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.403 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.403 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.403 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.403 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.403 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.403 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.403 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.403 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.403 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.403 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.403 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.403 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.403 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.404 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.404 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.404 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.404 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.404 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.404 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.404 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.404 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.404 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.404 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.404 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.404 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.404 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.405 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.405 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.405 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.405 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.405 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.405 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.405 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.405 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.405 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.405 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.405 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.405 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.405 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.405 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.406 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.406 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.406 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.406 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.406 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.406 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.406 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.406 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.406 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.406 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.406 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.406 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.406 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.407 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.407 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.407 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.407 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.407 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.407 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.407 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.407 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.407 INFO:teuthology.orchestra.run.smithi148.stdout: "mark_out_threshold": { 2024-09-19T07:30:03.407 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "mark_out_threshold", 2024-09-19T07:30:03.407 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:03.407 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.407 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.408 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "2419200", 2024-09-19T07:30:03.408 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.408 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.408 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.408 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T07:30:03.408 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.408 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.408 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.408 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.408 INFO:teuthology.orchestra.run.smithi148.stdout: "pool_name": { 2024-09-19T07:30:03.408 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "pool_name", 2024-09-19T07:30:03.408 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.409 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.409 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.409 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "device_health_metrics", 2024-09-19T07:30:03.409 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.409 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.409 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.409 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T07:30:03.409 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.409 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.409 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.409 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.409 INFO:teuthology.orchestra.run.smithi148.stdout: "retention_period": { 2024-09-19T07:30:03.409 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "retention_period", 2024-09-19T07:30:03.410 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:03.410 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.410 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.410 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "15552000", 2024-09-19T07:30:03.410 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.410 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.410 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.410 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "how long to retain device health metrics", 2024-09-19T07:30:03.410 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.410 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.410 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.410 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.410 INFO:teuthology.orchestra.run.smithi148.stdout: "scrape_frequency": { 2024-09-19T07:30:03.410 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "scrape_frequency", 2024-09-19T07:30:03.411 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:03.411 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.411 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.411 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "86400", 2024-09-19T07:30:03.411 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.411 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.411 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.411 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T07:30:03.411 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.411 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.411 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.411 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.411 INFO:teuthology.orchestra.run.smithi148.stdout: "self_heal": { 2024-09-19T07:30:03.411 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "self_heal", 2024-09-19T07:30:03.412 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.412 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.412 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.412 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:03.412 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.412 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.412 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.412 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T07:30:03.412 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.412 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.412 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.412 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.412 INFO:teuthology.orchestra.run.smithi148.stdout: "sleep_interval": { 2024-09-19T07:30:03.413 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sleep_interval", 2024-09-19T07:30:03.413 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:03.413 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.413 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.413 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "600", 2024-09-19T07:30:03.413 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.413 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.413 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.413 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T07:30:03.413 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.413 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.413 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.413 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.413 INFO:teuthology.orchestra.run.smithi148.stdout: "warn_threshold": { 2024-09-19T07:30:03.414 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "warn_threshold", 2024-09-19T07:30:03.414 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:03.414 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.414 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.414 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "7257600", 2024-09-19T07:30:03.414 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.414 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.414 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.414 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T07:30:03.414 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.414 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.414 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.414 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.415 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.415 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.415 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.415 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "diskprediction_local", 2024-09-19T07:30:03.415 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.415 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.415 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.415 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.415 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.415 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.415 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.415 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.415 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.415 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.416 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.416 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.416 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.416 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.416 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.416 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.416 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.416 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.416 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.416 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.416 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.416 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.416 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.417 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.417 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.417 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.417 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.417 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.417 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.417 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.417 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.417 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.417 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.417 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.417 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.417 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.418 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.418 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.418 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.418 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.418 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.418 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.418 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.418 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.418 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.418 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.418 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.419 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.419 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.419 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.419 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.419 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.419 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.419 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.419 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.419 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.419 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.419 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.419 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.419 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.419 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.420 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.420 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.420 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.420 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.420 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.420 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.420 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.420 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.420 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.420 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.420 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.420 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.420 INFO:teuthology.orchestra.run.smithi148.stdout: "predict_interval": { 2024-09-19T07:30:03.421 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "predict_interval", 2024-09-19T07:30:03.421 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.421 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.421 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.421 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "86400", 2024-09-19T07:30:03.421 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.421 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.421 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.421 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.421 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.421 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.421 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.421 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.421 INFO:teuthology.orchestra.run.smithi148.stdout: "predictor_model": { 2024-09-19T07:30:03.422 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "predictor_model", 2024-09-19T07:30:03.422 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.422 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.422 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.422 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "prophetstor", 2024-09-19T07:30:03.422 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.422 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.422 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.422 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.422 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.422 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.422 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.422 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.423 INFO:teuthology.orchestra.run.smithi148.stdout: "sleep_interval": { 2024-09-19T07:30:03.423 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sleep_interval", 2024-09-19T07:30:03.423 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.423 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.423 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.423 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "600", 2024-09-19T07:30:03.423 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.423 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.423 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.423 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.423 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.423 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.423 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.423 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.424 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.424 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.424 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.424 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "influx", 2024-09-19T07:30:03.424 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": false, 2024-09-19T07:30:03.424 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "influxdb python module not found", 2024-09-19T07:30:03.424 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.424 INFO:teuthology.orchestra.run.smithi148.stdout: "batch_size": { 2024-09-19T07:30:03.424 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "batch_size", 2024-09-19T07:30:03.424 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.424 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.424 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.424 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "5000", 2024-09-19T07:30:03.425 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.425 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.425 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.425 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T07:30:03.425 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.425 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.425 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.425 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.425 INFO:teuthology.orchestra.run.smithi148.stdout: "database": { 2024-09-19T07:30:03.425 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "database", 2024-09-19T07:30:03.425 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.425 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.425 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.425 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "ceph", 2024-09-19T07:30:03.426 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.426 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.426 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.426 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T07:30:03.426 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.426 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.426 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.426 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.426 INFO:teuthology.orchestra.run.smithi148.stdout: "hostname": { 2024-09-19T07:30:03.426 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "hostname", 2024-09-19T07:30:03.426 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.426 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.426 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.427 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.427 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.427 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.427 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.427 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "InfluxDB server hostname", 2024-09-19T07:30:03.427 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.427 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.427 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.427 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.427 INFO:teuthology.orchestra.run.smithi148.stdout: "interval": { 2024-09-19T07:30:03.427 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "interval", 2024-09-19T07:30:03.427 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:03.427 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.427 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.428 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "30", 2024-09-19T07:30:03.428 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "5", 2024-09-19T07:30:03.428 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.428 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.428 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T07:30:03.428 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.428 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.428 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.428 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.428 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.428 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.428 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.428 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.429 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.429 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.429 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.429 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.429 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.429 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.429 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.429 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.429 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.429 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.429 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.429 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.429 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.429 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.430 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.430 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.430 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.430 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.430 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.430 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.430 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.430 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.430 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.430 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.430 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.430 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.430 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.430 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.431 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.431 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.431 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.431 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.431 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.431 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.431 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.431 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.431 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.431 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.431 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.431 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.431 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.432 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.432 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.432 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.432 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.432 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.432 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.432 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.432 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.432 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.432 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.432 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.432 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.432 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.432 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.433 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.433 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.433 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.433 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.433 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.433 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.433 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.433 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.433 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.433 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.433 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.433 INFO:teuthology.orchestra.run.smithi148.stdout: "password": { 2024-09-19T07:30:03.433 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "password", 2024-09-19T07:30:03.433 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.434 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.434 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.434 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.434 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.434 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.434 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.434 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "password of InfluxDB server user", 2024-09-19T07:30:03.434 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.434 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.434 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.434 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.434 INFO:teuthology.orchestra.run.smithi148.stdout: "port": { 2024-09-19T07:30:03.434 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "port", 2024-09-19T07:30:03.435 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.435 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.435 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.435 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "8086", 2024-09-19T07:30:03.435 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.435 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.435 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.435 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "InfluxDB server port", 2024-09-19T07:30:03.435 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.435 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.435 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.435 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.435 INFO:teuthology.orchestra.run.smithi148.stdout: "ssl": { 2024-09-19T07:30:03.436 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ssl", 2024-09-19T07:30:03.436 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.436 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.436 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.436 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "false", 2024-09-19T07:30:03.436 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.436 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.436 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.436 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T07:30:03.436 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.436 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.436 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.436 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.437 INFO:teuthology.orchestra.run.smithi148.stdout: "threads": { 2024-09-19T07:30:03.437 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "threads", 2024-09-19T07:30:03.437 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.437 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.437 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.437 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "5", 2024-09-19T07:30:03.437 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "1", 2024-09-19T07:30:03.437 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "32", 2024-09-19T07:30:03.437 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.437 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T07:30:03.437 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.437 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.437 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.437 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.438 INFO:teuthology.orchestra.run.smithi148.stdout: "username": { 2024-09-19T07:30:03.438 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "username", 2024-09-19T07:30:03.438 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.438 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.438 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.438 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.438 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.438 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.438 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.438 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "username of InfluxDB server user", 2024-09-19T07:30:03.438 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.438 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.438 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.439 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.439 INFO:teuthology.orchestra.run.smithi148.stdout: "verify_ssl": { 2024-09-19T07:30:03.439 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "verify_ssl", 2024-09-19T07:30:03.439 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.439 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.439 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.439 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "true", 2024-09-19T07:30:03.439 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.439 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.439 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.439 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T07:30:03.439 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.439 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.439 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.440 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.440 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.440 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.440 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.440 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "insights", 2024-09-19T07:30:03.440 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.440 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.440 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.440 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.440 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.440 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.440 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.440 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.440 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.441 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.441 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.441 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.441 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.441 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.441 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.441 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.441 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.441 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.441 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.441 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.441 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.441 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.441 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.442 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.442 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.442 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.442 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.442 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.442 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.442 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.442 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.442 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.442 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.442 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.442 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.442 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.442 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.443 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.443 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.443 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.443 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.443 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.443 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.443 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.443 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.443 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.443 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.443 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.443 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.443 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.444 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.444 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.444 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.444 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.444 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.444 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.444 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.444 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.444 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.444 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.444 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.444 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.444 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.445 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.445 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.445 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.445 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.445 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.445 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.445 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.445 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.445 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.445 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.445 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.445 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.445 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.445 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "iostat", 2024-09-19T07:30:03.446 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.446 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.446 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.446 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.446 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.446 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.446 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.446 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.446 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.446 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.446 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.446 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.446 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.446 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.447 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.447 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.447 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.447 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.447 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.447 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.447 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.447 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.447 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.447 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.447 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.447 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.447 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.447 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.448 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.448 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.448 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.448 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.448 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.448 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.448 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.448 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.448 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.448 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.448 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.448 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.448 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.449 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.449 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.449 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.449 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.449 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.449 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.449 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.449 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.449 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.449 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.449 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.449 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.449 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.450 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.450 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.450 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.450 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.450 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.450 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.450 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.450 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.450 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.450 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.450 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.450 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.450 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.450 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.451 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.451 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.451 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.451 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.451 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.451 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.451 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.451 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.451 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "k8sevents", 2024-09-19T07:30:03.451 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.451 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.451 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.451 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph_event_retention_days": { 2024-09-19T07:30:03.451 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "ceph_event_retention_days", 2024-09-19T07:30:03.452 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.452 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.452 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.452 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "7", 2024-09-19T07:30:03.452 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.452 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.452 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.452 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T07:30:03.452 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.452 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.452 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.452 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.452 INFO:teuthology.orchestra.run.smithi148.stdout: "config_check_secs": { 2024-09-19T07:30:03.453 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "config_check_secs", 2024-09-19T07:30:03.453 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.453 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.453 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.453 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10", 2024-09-19T07:30:03.453 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "10", 2024-09-19T07:30:03.453 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.453 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.453 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T07:30:03.453 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.453 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.453 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.453 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.454 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.454 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.454 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.454 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.454 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.454 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.454 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.454 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.454 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.454 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.454 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.454 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.454 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.454 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.455 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.455 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.455 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.455 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.455 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.455 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.455 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.455 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.455 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.455 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.455 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.455 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.455 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.455 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.456 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.456 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.456 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.456 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.456 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.456 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.456 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.456 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.456 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.456 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.456 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.456 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.456 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.457 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.457 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.457 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.457 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.457 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.457 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.457 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.457 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.457 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.457 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.457 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.457 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.457 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.458 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.458 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.458 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.458 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.458 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.458 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.458 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.458 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.458 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.458 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.458 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.458 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.458 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.458 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.459 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.459 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.459 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.459 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.459 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.459 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "localpool", 2024-09-19T07:30:03.459 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.459 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.459 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.459 INFO:teuthology.orchestra.run.smithi148.stdout: "failure_domain": { 2024-09-19T07:30:03.459 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "failure_domain", 2024-09-19T07:30:03.459 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.460 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.460 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.460 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "host", 2024-09-19T07:30:03.460 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.460 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.460 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.460 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "failure domain for any created local pool", 2024-09-19T07:30:03.460 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T07:30:03.460 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.460 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.460 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.460 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.460 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.461 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.461 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.461 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.461 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.461 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.461 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.461 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.461 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.461 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.461 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.461 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.461 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.461 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.461 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.462 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.462 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.462 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.462 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.462 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.462 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.462 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.462 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.462 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.462 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.462 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.462 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.462 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.463 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.463 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.463 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.463 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.463 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.463 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.463 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.463 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.463 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.463 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.463 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.463 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.463 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.464 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.464 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.464 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.464 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.464 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.464 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.464 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.464 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.464 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.464 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.464 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.464 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.464 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.465 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.465 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.465 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.465 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.465 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.465 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.465 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.465 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.465 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.465 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.465 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.465 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.465 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.465 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.466 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.466 INFO:teuthology.orchestra.run.smithi148.stdout: "min_size": { 2024-09-19T07:30:03.466 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "min_size", 2024-09-19T07:30:03.466 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.466 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.466 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.466 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.466 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.466 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.466 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.466 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "default min_size for any created local pool", 2024-09-19T07:30:03.466 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T07:30:03.466 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.467 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.467 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.467 INFO:teuthology.orchestra.run.smithi148.stdout: "num_rep": { 2024-09-19T07:30:03.467 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "num_rep", 2024-09-19T07:30:03.467 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.467 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.467 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.467 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "3", 2024-09-19T07:30:03.467 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.467 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.467 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.467 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "default replica count for any created local pool", 2024-09-19T07:30:03.468 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.468 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.468 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.468 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.468 INFO:teuthology.orchestra.run.smithi148.stdout: "pg_num": { 2024-09-19T07:30:03.468 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "pg_num", 2024-09-19T07:30:03.468 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.468 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.468 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.468 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "128", 2024-09-19T07:30:03.468 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.468 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.468 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.468 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T07:30:03.469 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.469 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.469 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.469 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.469 INFO:teuthology.orchestra.run.smithi148.stdout: "prefix": { 2024-09-19T07:30:03.469 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "prefix", 2024-09-19T07:30:03.469 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.469 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.469 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.469 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.469 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.469 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.469 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.470 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "name prefix for any created local pool", 2024-09-19T07:30:03.470 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.470 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.470 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.470 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.470 INFO:teuthology.orchestra.run.smithi148.stdout: "subtree": { 2024-09-19T07:30:03.470 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "subtree", 2024-09-19T07:30:03.470 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.470 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.470 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.470 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "rack", 2024-09-19T07:30:03.470 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.470 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.471 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.471 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T07:30:03.471 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T07:30:03.471 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.471 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.471 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.471 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.471 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.471 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.471 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "mds_autoscaler", 2024-09-19T07:30:03.471 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.471 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.471 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.471 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.472 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.472 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.472 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.472 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.472 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.472 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.472 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.472 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.472 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.472 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.472 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.472 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.473 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.473 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.473 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.473 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.473 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.473 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.473 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.473 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.473 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.473 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.473 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.473 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.473 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.473 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.474 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.474 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.474 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.474 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.474 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.474 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.474 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.474 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.474 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.474 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.474 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.474 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.474 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.475 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.475 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.475 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.475 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.475 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.475 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.475 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.475 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.475 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.475 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.475 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.475 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.475 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.475 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.476 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.476 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.476 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.476 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.476 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.476 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.476 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.476 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.476 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.476 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.476 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.476 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.476 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.476 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.477 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.477 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.477 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.477 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.477 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.477 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "mirroring", 2024-09-19T07:30:03.477 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.477 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.477 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.477 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.477 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.477 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.477 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.478 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.478 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.478 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.478 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.478 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.478 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.478 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.478 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.478 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.478 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.478 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.478 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.479 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.479 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.479 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.479 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.479 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.479 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.479 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.479 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.479 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.479 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.479 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.479 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.479 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.479 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.480 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.480 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.480 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.480 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.480 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.480 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.480 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.480 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.480 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.480 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.480 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.480 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.480 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.481 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.481 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.481 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.481 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.481 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.481 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.481 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.481 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.481 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.481 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.481 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.481 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.481 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.482 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.482 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.482 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.482 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.482 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.482 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.482 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.482 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.482 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.482 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.482 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.482 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.482 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.483 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.483 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.483 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.483 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.483 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "nfs", 2024-09-19T07:30:03.483 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.483 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.483 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.483 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.483 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.483 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.483 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.483 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.484 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.484 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.484 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.484 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.484 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.484 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.484 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.484 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.484 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.484 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.484 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.484 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.484 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.485 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.485 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.485 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.485 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.485 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.485 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.485 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.485 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.485 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.485 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.485 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.485 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.485 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.485 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.486 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.486 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.486 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.486 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.486 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.486 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.486 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.486 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.486 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.486 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.486 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.486 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.486 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.486 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.487 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.487 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.487 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.487 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.487 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.487 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.487 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.487 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.487 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.487 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.487 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.487 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.487 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.487 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.488 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.488 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.488 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.488 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.488 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.488 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.488 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.488 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.488 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.488 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.488 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.488 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.489 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.489 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "orchestrator", 2024-09-19T07:30:03.489 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.489 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.489 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.489 INFO:teuthology.orchestra.run.smithi148.stdout: "fail_fs": { 2024-09-19T07:30:03.489 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "fail_fs", 2024-09-19T07:30:03.489 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.489 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.489 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.489 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.489 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.489 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.489 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.490 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T07:30:03.490 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.490 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.490 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.490 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.490 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.490 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.490 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.490 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.490 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.490 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.490 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.490 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.491 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.491 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.491 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.491 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.491 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.491 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.491 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.491 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.491 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.491 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.491 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.491 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.491 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.491 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.492 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.492 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.492 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.492 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.492 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.492 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.492 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.492 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.492 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.492 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.492 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.492 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.492 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.492 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.493 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.493 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.493 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.493 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.493 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.493 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.493 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.493 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.493 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.493 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.493 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.493 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.493 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.494 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.494 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.494 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.494 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.494 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.494 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.494 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.494 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.494 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.494 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.494 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.494 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.494 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.495 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.495 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.495 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.495 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.495 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.495 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.495 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.495 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.495 INFO:teuthology.orchestra.run.smithi148.stdout: "orchestrator": { 2024-09-19T07:30:03.495 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "orchestrator", 2024-09-19T07:30:03.495 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.495 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.495 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.496 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.496 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.496 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.496 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.496 INFO:teuthology.orchestra.run.smithi148.stdout: "cephadm", 2024-09-19T07:30:03.496 INFO:teuthology.orchestra.run.smithi148.stdout: "rook", 2024-09-19T07:30:03.496 INFO:teuthology.orchestra.run.smithi148.stdout: "test_orchestrator" 2024-09-19T07:30:03.496 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.496 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Orchestrator backend", 2024-09-19T07:30:03.496 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.496 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.496 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.496 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.497 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.497 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.497 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.497 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "osd_perf_query", 2024-09-19T07:30:03.497 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.497 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.497 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.497 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.497 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.497 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.497 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.497 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.497 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.498 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.498 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.498 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.498 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.498 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.498 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.498 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.498 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.498 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.498 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.498 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.498 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.498 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.498 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.499 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.499 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.499 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.499 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.499 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.499 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.499 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.499 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.499 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.499 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.499 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.499 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.499 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.499 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.500 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.500 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.500 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.500 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.500 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.500 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.500 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.500 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.500 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.500 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.500 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.500 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.500 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.501 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.501 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.501 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.501 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.501 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.501 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.501 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.501 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.501 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.501 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.501 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.501 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.501 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.502 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.502 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.502 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.502 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.502 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.502 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.502 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.502 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.502 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.502 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.502 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.502 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.502 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.503 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "osd_support", 2024-09-19T07:30:03.503 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.503 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.503 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.503 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.503 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.503 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.503 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.503 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.503 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.503 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.503 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.503 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.503 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.504 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.504 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.504 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.504 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.504 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.504 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.504 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.504 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.504 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.504 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.504 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.504 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.504 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.505 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.505 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.505 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.505 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.505 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.505 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.505 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.505 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.505 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.505 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.505 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.505 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.505 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.506 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.506 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.506 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.506 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.506 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.506 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.506 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.506 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.506 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.506 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.506 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.506 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.506 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.506 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.507 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.507 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.507 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.507 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.507 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.507 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.507 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.507 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.507 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.507 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.507 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.507 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.508 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.508 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.508 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.508 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.508 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.508 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.508 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.508 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.508 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.508 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.508 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.508 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "pg_autoscaler", 2024-09-19T07:30:03.509 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.509 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.509 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.509 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.509 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.509 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.509 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.509 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.509 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.509 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.509 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.509 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.509 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.510 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.510 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.510 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.510 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.510 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.510 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.510 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.510 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.510 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.510 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.510 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.510 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.510 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.510 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.511 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.511 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.511 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.511 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.511 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.511 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.511 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.511 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.511 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.511 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.511 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.511 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.511 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.512 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.512 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.512 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.512 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.512 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.512 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.512 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.512 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.512 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.512 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.512 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.512 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.512 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.513 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.513 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.513 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.513 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.513 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.513 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.513 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.513 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.513 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.513 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.513 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.513 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.513 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.514 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.514 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.514 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.514 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.514 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.514 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.514 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.514 INFO:teuthology.orchestra.run.smithi148.stdout: "sleep_interval": { 2024-09-19T07:30:03.514 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sleep_interval", 2024-09-19T07:30:03.514 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:03.514 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.514 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.514 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "60", 2024-09-19T07:30:03.515 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.515 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.515 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.515 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.515 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.515 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.515 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.515 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.515 INFO:teuthology.orchestra.run.smithi148.stdout: "threshold": { 2024-09-19T07:30:03.515 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "threshold", 2024-09-19T07:30:03.515 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "float", 2024-09-19T07:30:03.515 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.515 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.515 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "3.0", 2024-09-19T07:30:03.516 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "1.0", 2024-09-19T07:30:03.516 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.516 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.516 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "scaling threshold", 2024-09-19T07:30:03.516 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T07:30:03.516 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.516 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.516 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.516 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.516 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.516 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.516 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "progress", 2024-09-19T07:30:03.516 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.517 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.517 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.517 INFO:teuthology.orchestra.run.smithi148.stdout: "allow_pg_recovery_event": { 2024-09-19T07:30:03.517 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "allow_pg_recovery_event", 2024-09-19T07:30:03.517 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.517 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.517 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.517 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.517 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.517 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.517 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.517 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T07:30:03.517 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.518 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.518 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.518 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.518 INFO:teuthology.orchestra.run.smithi148.stdout: "enabled": { 2024-09-19T07:30:03.518 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "enabled", 2024-09-19T07:30:03.518 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.518 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.518 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.518 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:03.518 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.518 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.518 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.518 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.519 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.519 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.519 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.519 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.519 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.519 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.519 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.519 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.519 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.519 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.519 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.519 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.519 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.519 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.519 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.520 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.520 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.520 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.520 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.520 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.520 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.520 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.520 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.520 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.520 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.520 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.520 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.520 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.521 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.521 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.521 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.521 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.521 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.521 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.521 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.521 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.521 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.521 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.521 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.521 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.521 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.521 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.522 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.522 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.522 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.522 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.522 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.522 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.522 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.522 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.522 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.522 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.522 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.522 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.522 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.523 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.523 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.523 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.523 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.523 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.523 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.523 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.523 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.523 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.523 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.523 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.523 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.523 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.523 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.524 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.524 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.524 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.524 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.524 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.524 INFO:teuthology.orchestra.run.smithi148.stdout: "max_completed_events": { 2024-09-19T07:30:03.524 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "max_completed_events", 2024-09-19T07:30:03.524 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.524 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.524 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.524 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "50", 2024-09-19T07:30:03.524 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.524 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.525 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.525 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "number of past completed events to remember", 2024-09-19T07:30:03.525 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.525 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.525 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.525 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.525 INFO:teuthology.orchestra.run.smithi148.stdout: "sleep_interval": { 2024-09-19T07:30:03.525 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "sleep_interval", 2024-09-19T07:30:03.525 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:03.525 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.525 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.525 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "5", 2024-09-19T07:30:03.525 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.525 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.526 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.526 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "how long the module is going to sleep", 2024-09-19T07:30:03.526 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.526 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.526 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.526 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.526 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.526 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.526 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.526 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "prometheus", 2024-09-19T07:30:03.526 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.526 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.526 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.527 INFO:teuthology.orchestra.run.smithi148.stdout: "cache": { 2024-09-19T07:30:03.527 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "cache", 2024-09-19T07:30:03.527 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.527 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.527 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.527 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:03.527 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.527 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.527 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.527 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.527 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.527 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.527 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.527 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.528 INFO:teuthology.orchestra.run.smithi148.stdout: "exclude_perf_counters": { 2024-09-19T07:30:03.528 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "exclude_perf_counters", 2024-09-19T07:30:03.528 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.528 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.528 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.528 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:03.528 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.528 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.528 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.528 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T07:30:03.528 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T07:30:03.528 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.528 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.529 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.529 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.529 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.529 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.529 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.529 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.529 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.529 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.529 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.529 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.529 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.529 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.529 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.530 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.530 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.530 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.530 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.530 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.530 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.530 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.530 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.530 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.530 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.530 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.530 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.530 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.530 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.531 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.531 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.531 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.531 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.531 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.531 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.531 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.531 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.531 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.531 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.531 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.531 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.531 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.531 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.532 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.532 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.532 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.532 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.532 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.532 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.532 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.532 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.532 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.532 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.532 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.532 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.532 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.533 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.533 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.533 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.533 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.533 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.533 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.533 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.533 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.533 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.533 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.533 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.533 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.533 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.534 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.534 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.534 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.534 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.534 INFO:teuthology.orchestra.run.smithi148.stdout: "rbd_stats_pools": { 2024-09-19T07:30:03.534 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rbd_stats_pools", 2024-09-19T07:30:03.534 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.534 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.534 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.534 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.534 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.534 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.534 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.534 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.535 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.535 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.535 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.535 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.535 INFO:teuthology.orchestra.run.smithi148.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T07:30:03.535 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T07:30:03.535 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.535 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.535 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.535 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "300", 2024-09-19T07:30:03.535 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.535 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.535 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.535 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.536 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.536 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.536 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.536 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.536 INFO:teuthology.orchestra.run.smithi148.stdout: "scrape_interval": { 2024-09-19T07:30:03.536 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "scrape_interval", 2024-09-19T07:30:03.536 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "float", 2024-09-19T07:30:03.536 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.536 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.536 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "15.0", 2024-09-19T07:30:03.536 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.536 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.536 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.537 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.537 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.537 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.537 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.537 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.537 INFO:teuthology.orchestra.run.smithi148.stdout: "server_addr": { 2024-09-19T07:30:03.537 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "server_addr", 2024-09-19T07:30:03.537 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.537 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.537 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.537 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "::", 2024-09-19T07:30:03.537 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.537 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.537 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.538 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T07:30:03.538 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.538 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.538 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.538 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.538 INFO:teuthology.orchestra.run.smithi148.stdout: "server_port": { 2024-09-19T07:30:03.538 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "server_port", 2024-09-19T07:30:03.538 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.538 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.538 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.538 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "9283", 2024-09-19T07:30:03.538 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.538 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.538 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.539 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T07:30:03.539 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.539 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.539 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.539 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.539 INFO:teuthology.orchestra.run.smithi148.stdout: "stale_cache_strategy": { 2024-09-19T07:30:03.539 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "stale_cache_strategy", 2024-09-19T07:30:03.539 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.539 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.539 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.539 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "log", 2024-09-19T07:30:03.539 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.539 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.539 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.540 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.540 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.540 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.540 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.540 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.540 INFO:teuthology.orchestra.run.smithi148.stdout: "standby_behaviour": { 2024-09-19T07:30:03.540 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "standby_behaviour", 2024-09-19T07:30:03.540 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.540 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.540 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.540 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "default", 2024-09-19T07:30:03.540 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.540 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.541 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.541 INFO:teuthology.orchestra.run.smithi148.stdout: "default", 2024-09-19T07:30:03.541 INFO:teuthology.orchestra.run.smithi148.stdout: "error" 2024-09-19T07:30:03.541 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.541 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.541 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.541 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.541 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.541 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.541 INFO:teuthology.orchestra.run.smithi148.stdout: "standby_error_status_code": { 2024-09-19T07:30:03.541 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "standby_error_status_code", 2024-09-19T07:30:03.541 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.541 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.541 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.542 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "500", 2024-09-19T07:30:03.542 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "400", 2024-09-19T07:30:03.542 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "599", 2024-09-19T07:30:03.542 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.542 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.542 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.542 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.542 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.542 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.542 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.542 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.542 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.542 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rbd_support", 2024-09-19T07:30:03.542 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.543 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.543 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.543 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.543 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.543 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.543 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.543 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.543 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.543 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.543 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.543 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.543 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.543 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.544 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.544 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.544 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.544 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.544 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.544 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.544 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.544 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.544 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.544 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.544 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.544 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.545 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.545 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.545 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.545 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.545 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.545 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.545 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.545 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.545 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.545 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.545 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.545 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.545 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.546 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.546 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.546 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.546 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.546 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.546 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.546 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.546 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.546 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.546 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.546 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.546 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.546 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.547 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.547 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.547 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.547 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.547 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.547 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.547 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.547 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.547 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.547 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.548 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.548 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.548 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.548 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.548 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.548 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.548 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.548 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.548 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.548 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.548 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.548 INFO:teuthology.orchestra.run.smithi148.stdout: "max_concurrent_snap_create": { 2024-09-19T07:30:03.549 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "max_concurrent_snap_create", 2024-09-19T07:30:03.549 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.549 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.549 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.549 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10", 2024-09-19T07:30:03.549 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.549 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.549 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.549 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.549 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.549 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.549 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.549 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.550 INFO:teuthology.orchestra.run.smithi148.stdout: "mirror_snapshot_schedule": { 2024-09-19T07:30:03.550 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T07:30:03.550 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.550 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.550 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.550 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.550 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.550 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.550 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.550 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.550 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.550 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.550 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.550 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.551 INFO:teuthology.orchestra.run.smithi148.stdout: "trash_purge_schedule": { 2024-09-19T07:30:03.551 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "trash_purge_schedule", 2024-09-19T07:30:03.551 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.551 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.551 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.551 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.551 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.551 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.551 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.551 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.551 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.551 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.551 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.552 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.552 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.552 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.552 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.552 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "restful", 2024-09-19T07:30:03.552 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.552 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.552 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.552 INFO:teuthology.orchestra.run.smithi148.stdout: "enable_auth": { 2024-09-19T07:30:03.552 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "enable_auth", 2024-09-19T07:30:03.552 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.552 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.552 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.553 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:03.553 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.553 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.553 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.553 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.553 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.553 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.553 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.553 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.553 INFO:teuthology.orchestra.run.smithi148.stdout: "key_file": { 2024-09-19T07:30:03.553 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "key_file", 2024-09-19T07:30:03.553 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.553 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.553 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.554 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.554 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.554 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.554 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.554 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.554 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.554 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.554 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.554 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.554 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.554 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.554 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.554 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.555 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.555 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.555 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.555 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.555 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.555 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.555 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.555 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.555 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.555 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.555 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.555 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.555 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.555 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.556 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.556 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.556 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.556 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.556 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.556 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.556 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.556 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.556 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.556 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.556 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.556 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.556 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.556 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.557 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.557 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.557 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.557 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.557 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.557 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.557 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.557 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.557 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.557 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.557 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.557 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.557 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.558 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.558 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.558 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.558 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.558 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.558 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.558 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.558 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.558 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.558 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.558 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.558 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.558 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.558 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.559 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.559 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.559 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.559 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.559 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.559 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.559 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.559 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.559 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.559 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.559 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.559 INFO:teuthology.orchestra.run.smithi148.stdout: "server_addr": { 2024-09-19T07:30:03.559 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "server_addr", 2024-09-19T07:30:03.560 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.560 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.560 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.560 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.560 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.560 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.560 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.560 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.560 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.560 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.560 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.560 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.561 INFO:teuthology.orchestra.run.smithi148.stdout: "server_port": { 2024-09-19T07:30:03.561 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "server_port", 2024-09-19T07:30:03.561 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.561 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.561 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.561 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.561 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.561 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.561 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.561 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.561 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.561 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.561 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.562 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.562 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.562 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.562 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.562 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rgw", 2024-09-19T07:30:03.562 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.562 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.562 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.562 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.562 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.562 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.562 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.562 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.562 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.563 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.563 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.563 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.563 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.563 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.563 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.563 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.563 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.563 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.563 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.563 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.563 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.563 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.564 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.564 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.564 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.564 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.564 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.564 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.564 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.564 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.564 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.564 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.564 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.564 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.564 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.565 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.565 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.565 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.565 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.565 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.565 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.565 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.565 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.565 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.565 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.565 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.565 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.566 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.566 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.566 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.566 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.566 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.566 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.566 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.566 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.566 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.566 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.566 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.566 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.566 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.566 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.567 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.567 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.567 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.567 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.567 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.567 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.567 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.567 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.567 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.567 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.567 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.567 INFO:teuthology.orchestra.run.smithi148.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T07:30:03.567 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T07:30:03.568 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.568 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.568 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.568 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "5", 2024-09-19T07:30:03.568 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.568 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.568 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.568 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T07:30:03.568 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.568 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.568 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.568 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.568 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.569 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.569 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.569 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rook", 2024-09-19T07:30:03.569 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.569 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.569 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.569 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.569 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.569 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.569 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.569 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.569 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.570 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.570 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.570 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.570 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.570 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.570 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.570 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.570 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.570 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.570 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.570 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.570 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.570 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.570 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.571 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.571 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.571 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.571 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.571 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.571 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.571 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.571 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.571 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.571 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.571 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.571 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.571 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.572 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.572 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.572 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.572 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.572 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.572 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.572 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.572 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.572 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.572 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.572 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.572 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.572 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.573 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.573 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.573 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.573 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.573 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.573 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.573 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.573 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.573 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.573 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.573 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.573 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.573 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.573 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.574 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.574 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.574 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.574 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.574 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.574 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.574 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.574 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.574 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.574 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.574 INFO:teuthology.orchestra.run.smithi148.stdout: "storage_class": { 2024-09-19T07:30:03.574 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "storage_class", 2024-09-19T07:30:03.574 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.574 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.575 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.575 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "local", 2024-09-19T07:30:03.575 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.575 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.575 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.575 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T07:30:03.575 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.575 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.575 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.575 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.575 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.575 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.575 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.575 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "selftest", 2024-09-19T07:30:03.576 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.576 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.576 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.576 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.576 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.576 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.576 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.576 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.576 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.576 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.576 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.576 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.576 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.577 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.577 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.577 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.577 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.577 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.577 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.577 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.577 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.577 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.577 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.577 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.577 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.577 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.578 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.578 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.578 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.578 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.578 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.578 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.578 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.578 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.578 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.578 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.578 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.578 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.578 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.578 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.579 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.579 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.579 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.579 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.579 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.579 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.579 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.579 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.579 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.579 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.579 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.579 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.579 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.580 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.580 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.580 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.580 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.580 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.580 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.580 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.580 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.580 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.580 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.580 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.581 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.581 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.581 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.581 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.581 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.581 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.581 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.581 INFO:teuthology.orchestra.run.smithi148.stdout: "roption1": { 2024-09-19T07:30:03.581 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "roption1", 2024-09-19T07:30:03.581 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.581 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.581 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.581 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.582 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.582 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.582 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.582 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.582 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.582 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.582 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.582 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.582 INFO:teuthology.orchestra.run.smithi148.stdout: "roption2": { 2024-09-19T07:30:03.582 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "roption2", 2024-09-19T07:30:03.582 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.582 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.582 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.583 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "xyz", 2024-09-19T07:30:03.583 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.583 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.583 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.583 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.583 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.583 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.583 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.583 INFO:teuthology.orchestra.run.smithi148.stdout: "rwoption1": { 2024-09-19T07:30:03.583 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rwoption1", 2024-09-19T07:30:03.583 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.583 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.583 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.584 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.584 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.584 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.584 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.584 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.584 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.584 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.584 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.584 INFO:teuthology.orchestra.run.smithi148.stdout: "rwoption2": { 2024-09-19T07:30:03.584 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rwoption2", 2024-09-19T07:30:03.584 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.584 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.585 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.585 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.585 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.585 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.585 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.585 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.585 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.585 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.585 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.585 INFO:teuthology.orchestra.run.smithi148.stdout: "rwoption3": { 2024-09-19T07:30:03.585 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rwoption3", 2024-09-19T07:30:03.586 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "float", 2024-09-19T07:30:03.586 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.586 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.586 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.586 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.586 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.586 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.586 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.586 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.586 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.586 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.586 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.586 INFO:teuthology.orchestra.run.smithi148.stdout: "rwoption4": { 2024-09-19T07:30:03.587 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rwoption4", 2024-09-19T07:30:03.587 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.587 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.587 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.587 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.587 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.587 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.587 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.587 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.587 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.587 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.587 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.587 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.587 INFO:teuthology.orchestra.run.smithi148.stdout: "rwoption5": { 2024-09-19T07:30:03.588 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rwoption5", 2024-09-19T07:30:03.588 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.588 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.588 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.588 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.588 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.588 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.588 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.588 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.588 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.588 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.588 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.589 INFO:teuthology.orchestra.run.smithi148.stdout: "rwoption6": { 2024-09-19T07:30:03.589 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rwoption6", 2024-09-19T07:30:03.589 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.589 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.589 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.589 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:03.589 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.589 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.589 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.589 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.589 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.589 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.590 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.590 INFO:teuthology.orchestra.run.smithi148.stdout: "rwoption7": { 2024-09-19T07:30:03.590 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rwoption7", 2024-09-19T07:30:03.590 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.590 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.590 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.590 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.590 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "1", 2024-09-19T07:30:03.590 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "42", 2024-09-19T07:30:03.590 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.590 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.590 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.590 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.590 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.591 INFO:teuthology.orchestra.run.smithi148.stdout: "testkey": { 2024-09-19T07:30:03.591 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "testkey", 2024-09-19T07:30:03.591 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.591 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.591 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.591 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.591 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.591 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.591 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.591 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.591 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.591 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.592 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.592 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.592 INFO:teuthology.orchestra.run.smithi148.stdout: "testlkey": { 2024-09-19T07:30:03.592 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "testlkey", 2024-09-19T07:30:03.592 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.592 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.592 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.592 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.592 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.592 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.592 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.592 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.593 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.593 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.593 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.593 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.593 INFO:teuthology.orchestra.run.smithi148.stdout: "testnewline": { 2024-09-19T07:30:03.593 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "testnewline", 2024-09-19T07:30:03.593 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.593 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.593 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.593 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.593 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.593 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.593 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.594 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.594 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.594 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.594 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.594 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.594 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.594 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.594 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "snap_schedule", 2024-09-19T07:30:03.594 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.594 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.594 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.594 INFO:teuthology.orchestra.run.smithi148.stdout: "allow_m_granularity": { 2024-09-19T07:30:03.595 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "allow_m_granularity", 2024-09-19T07:30:03.595 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.595 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.595 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.595 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.595 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.595 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.595 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.595 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T07:30:03.595 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.595 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.595 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.596 INFO:teuthology.orchestra.run.smithi148.stdout: "dump_on_update": { 2024-09-19T07:30:03.596 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "dump_on_update", 2024-09-19T07:30:03.596 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.596 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.596 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.596 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.596 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.596 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.596 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.596 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "dump database to debug log on update", 2024-09-19T07:30:03.596 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.596 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.597 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.597 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.597 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.597 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.597 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.597 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.597 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.597 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.597 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.597 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.597 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.597 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.597 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.598 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.598 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.598 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.598 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.598 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.598 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.598 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.598 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.598 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.598 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.598 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.598 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.598 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.599 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.599 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.599 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.599 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.599 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.599 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.599 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.599 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.599 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.599 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.599 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.599 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.599 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.600 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.600 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.600 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.600 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.600 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.600 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.600 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.600 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.600 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.600 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.600 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.600 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.600 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.601 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.601 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.601 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.601 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.601 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.601 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.601 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.601 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.601 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.601 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.601 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.601 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.601 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.602 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.602 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.602 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.602 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.602 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.602 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.602 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.602 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "stats", 2024-09-19T07:30:03.602 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.602 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.602 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.602 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.603 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.603 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.603 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.603 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.603 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.603 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.603 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.603 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.603 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.603 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.603 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.603 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.603 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.603 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.604 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.604 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.604 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.604 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.604 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.604 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.604 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.604 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.604 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.604 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.604 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.604 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.604 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.604 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.605 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.605 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.605 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.605 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.605 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.605 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.605 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.605 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.605 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.605 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.605 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.605 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.606 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.606 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.606 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.606 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.606 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.606 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.606 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.606 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.606 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.606 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.606 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.606 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.606 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.607 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.607 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.607 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.607 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.607 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.607 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.607 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.607 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.607 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.607 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.607 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.607 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.608 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.608 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.608 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.608 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "status", 2024-09-19T07:30:03.608 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.608 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.608 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.608 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.608 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.608 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.608 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.609 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.609 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.609 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.609 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.609 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.609 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.609 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.609 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.609 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.609 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.609 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.609 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.609 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.610 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.610 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.610 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.610 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.610 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.610 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.610 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.610 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.610 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.610 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.610 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.610 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.611 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.611 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.611 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.611 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.611 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.611 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.611 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.611 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.611 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.611 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.611 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.611 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.611 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.612 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.612 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.612 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.612 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.612 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.612 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.612 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.612 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.612 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.612 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.612 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.612 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.612 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.612 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.613 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.613 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.613 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.613 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.613 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.613 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.613 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.613 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.613 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.613 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.613 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.613 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.613 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.614 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.614 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.614 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "telegraf", 2024-09-19T07:30:03.614 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.614 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.614 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.614 INFO:teuthology.orchestra.run.smithi148.stdout: "address": { 2024-09-19T07:30:03.614 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "address", 2024-09-19T07:30:03.614 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.614 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.614 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.614 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T07:30:03.614 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.615 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.615 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.615 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.615 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.615 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.615 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.615 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.615 INFO:teuthology.orchestra.run.smithi148.stdout: "interval": { 2024-09-19T07:30:03.615 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "interval", 2024-09-19T07:30:03.615 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:03.615 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.615 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.615 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "15", 2024-09-19T07:30:03.615 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.616 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.616 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.616 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.616 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.616 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.616 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.616 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.616 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.616 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.616 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.616 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.616 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.617 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.617 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.617 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.617 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.617 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.617 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.617 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.617 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.617 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.617 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.617 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.617 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.617 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.618 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.618 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.618 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.618 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.618 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.618 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.618 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.618 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.618 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.618 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.618 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.618 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.618 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.618 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.618 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.619 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.619 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.619 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.619 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.619 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.619 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.619 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.619 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.619 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.619 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.619 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.619 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.619 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.620 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.620 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.620 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.620 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.620 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.620 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.620 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.620 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.620 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.620 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.620 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.620 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.620 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.621 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.621 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.621 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.621 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.621 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.621 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.621 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.621 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.621 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.621 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.621 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.621 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.621 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.621 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.622 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "telemetry", 2024-09-19T07:30:03.622 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.622 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.622 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.622 INFO:teuthology.orchestra.run.smithi148.stdout: "channel_basic": { 2024-09-19T07:30:03.622 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "channel_basic", 2024-09-19T07:30:03.622 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.622 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.622 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.622 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:03.622 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.622 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.622 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.623 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T07:30:03.623 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.623 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.623 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.623 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.623 INFO:teuthology.orchestra.run.smithi148.stdout: "channel_crash": { 2024-09-19T07:30:03.623 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "channel_crash", 2024-09-19T07:30:03.623 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.623 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.623 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.623 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:03.623 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.623 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.624 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.624 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T07:30:03.624 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.624 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.624 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.624 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.624 INFO:teuthology.orchestra.run.smithi148.stdout: "channel_device": { 2024-09-19T07:30:03.624 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "channel_device", 2024-09-19T07:30:03.624 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.624 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.624 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.624 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:03.624 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.624 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.625 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.625 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T07:30:03.625 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.625 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.625 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.625 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.625 INFO:teuthology.orchestra.run.smithi148.stdout: "channel_ident": { 2024-09-19T07:30:03.625 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "channel_ident", 2024-09-19T07:30:03.625 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.625 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.625 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.625 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.625 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.625 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.626 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.626 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T07:30:03.626 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.626 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.626 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.626 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.626 INFO:teuthology.orchestra.run.smithi148.stdout: "channel_perf": { 2024-09-19T07:30:03.626 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "channel_perf", 2024-09-19T07:30:03.626 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.626 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.626 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.626 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.626 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.627 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.627 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.627 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T07:30:03.627 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.627 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.627 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.627 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.627 INFO:teuthology.orchestra.run.smithi148.stdout: "contact": { 2024-09-19T07:30:03.627 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "contact", 2024-09-19T07:30:03.627 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.627 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.627 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.627 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.628 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.628 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.628 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.628 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.628 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.628 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.628 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.628 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.628 INFO:teuthology.orchestra.run.smithi148.stdout: "description": { 2024-09-19T07:30:03.628 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "description", 2024-09-19T07:30:03.628 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.629 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.629 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.629 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.629 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.629 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.629 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.629 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.629 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.629 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.629 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.629 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.629 INFO:teuthology.orchestra.run.smithi148.stdout: "device_url": { 2024-09-19T07:30:03.629 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "device_url", 2024-09-19T07:30:03.629 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.630 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.630 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.630 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T07:30:03.630 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.630 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.630 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.630 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.630 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.630 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.630 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.630 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.630 INFO:teuthology.orchestra.run.smithi148.stdout: "enabled": { 2024-09-19T07:30:03.630 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "enabled", 2024-09-19T07:30:03.631 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.631 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.631 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.631 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.631 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.631 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.631 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.631 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.631 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.631 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.631 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.631 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.631 INFO:teuthology.orchestra.run.smithi148.stdout: "interval": { 2024-09-19T07:30:03.632 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "interval", 2024-09-19T07:30:03.632 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.632 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.632 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.632 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "24", 2024-09-19T07:30:03.632 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "8", 2024-09-19T07:30:03.632 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.632 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.632 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.632 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.632 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.632 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.632 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.632 INFO:teuthology.orchestra.run.smithi148.stdout: "last_opt_revision": { 2024-09-19T07:30:03.633 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "last_opt_revision", 2024-09-19T07:30:03.633 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.633 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.633 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.633 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "1", 2024-09-19T07:30:03.633 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.633 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.633 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.633 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.633 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.633 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.633 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.633 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.634 INFO:teuthology.orchestra.run.smithi148.stdout: "leaderboard": { 2024-09-19T07:30:03.634 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "leaderboard", 2024-09-19T07:30:03.634 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.634 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.634 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.634 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.634 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.634 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.634 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.634 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.634 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.634 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.634 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.634 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.635 INFO:teuthology.orchestra.run.smithi148.stdout: "leaderboard_description": { 2024-09-19T07:30:03.635 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "leaderboard_description", 2024-09-19T07:30:03.635 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.635 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.635 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.635 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.635 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.635 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.635 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.635 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.635 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.635 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.635 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.635 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.636 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.636 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.636 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.636 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.636 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.636 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.636 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.636 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.636 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.636 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.636 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.636 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.636 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.637 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.637 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.637 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.637 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.637 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.637 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.637 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.637 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.637 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.637 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.637 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.637 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.637 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.638 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.638 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.638 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.638 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.638 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.638 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.638 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.638 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.638 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.638 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.638 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.638 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.638 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.638 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.639 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.639 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.639 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.639 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.639 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.639 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.639 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.639 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.639 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.639 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.639 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.639 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.639 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.640 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.640 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.640 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.640 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.640 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.640 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.640 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.640 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.640 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.640 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.640 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.640 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.640 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.640 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.641 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.641 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.641 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.641 INFO:teuthology.orchestra.run.smithi148.stdout: "organization": { 2024-09-19T07:30:03.641 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "organization", 2024-09-19T07:30:03.641 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.641 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.641 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.641 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.641 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.641 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.641 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.641 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.641 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.642 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.642 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.642 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.642 INFO:teuthology.orchestra.run.smithi148.stdout: "proxy": { 2024-09-19T07:30:03.642 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "proxy", 2024-09-19T07:30:03.642 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.642 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.642 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.642 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.642 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.642 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.642 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.642 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.642 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.643 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.643 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.643 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.643 INFO:teuthology.orchestra.run.smithi148.stdout: "url": { 2024-09-19T07:30:03.643 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "url", 2024-09-19T07:30:03.643 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.643 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.643 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.643 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T07:30:03.643 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.643 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.643 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.643 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.644 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.644 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.644 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.644 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.644 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.644 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.644 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.644 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "test_orchestrator", 2024-09-19T07:30:03.644 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.644 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.644 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.644 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.644 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.644 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.645 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.645 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.645 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.645 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.645 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.645 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.645 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.645 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.645 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.645 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.645 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.645 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.645 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.646 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.646 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.646 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.646 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.646 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.646 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.646 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.646 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.646 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.646 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.646 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.646 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.646 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.646 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.647 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.647 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.647 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.647 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.647 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.647 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.647 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.647 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.647 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.647 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.647 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.647 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.647 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.647 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.648 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.648 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.648 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.648 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.648 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.648 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.648 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.648 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.648 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.648 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.648 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.648 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.648 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.649 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.649 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.649 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.649 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.649 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.649 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.649 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.649 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.649 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.649 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.649 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.649 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.649 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.649 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.650 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.650 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.650 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "volumes", 2024-09-19T07:30:03.650 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.650 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.650 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.650 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.650 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.650 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.650 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.650 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.650 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.650 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.651 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.651 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.651 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.651 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.651 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.651 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.651 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.651 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.651 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.651 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.651 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.651 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.651 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.651 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.652 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.652 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.652 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.652 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.652 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.652 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.652 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.652 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.652 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.652 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.652 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.652 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.652 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.653 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.653 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.653 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.653 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.653 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.653 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.653 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.653 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.653 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.653 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.653 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.653 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.653 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.654 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.654 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.654 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.654 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.654 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.654 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.654 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.654 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.654 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.654 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.654 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.654 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.654 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.654 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.655 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.655 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.655 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.655 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.655 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.655 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.655 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.655 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.655 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.655 INFO:teuthology.orchestra.run.smithi148.stdout: "max_concurrent_clones": { 2024-09-19T07:30:03.655 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "max_concurrent_clones", 2024-09-19T07:30:03.655 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.655 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.655 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.656 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "4", 2024-09-19T07:30:03.656 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.656 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.656 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.656 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T07:30:03.656 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.656 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.656 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.656 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.656 INFO:teuthology.orchestra.run.smithi148.stdout: "periodic_async_work": { 2024-09-19T07:30:03.656 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "periodic_async_work", 2024-09-19T07:30:03.656 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.657 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.657 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.657 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.657 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.657 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.657 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.657 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Periodically check for async work", 2024-09-19T07:30:03.657 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.657 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.657 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.657 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.657 INFO:teuthology.orchestra.run.smithi148.stdout: "snapshot_clone_delay": { 2024-09-19T07:30:03.657 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "snapshot_clone_delay", 2024-09-19T07:30:03.658 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.658 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.658 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.658 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "0", 2024-09-19T07:30:03.658 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.658 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.658 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.658 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T07:30:03.658 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.658 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.658 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.659 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.659 INFO:teuthology.orchestra.run.smithi148.stdout: "snapshot_clone_no_wait": { 2024-09-19T07:30:03.659 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T07:30:03.659 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.659 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.659 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.659 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "True", 2024-09-19T07:30:03.659 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.659 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.659 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.659 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T07:30:03.659 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.659 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.659 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.660 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.660 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.660 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.660 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.660 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "zabbix", 2024-09-19T07:30:03.660 INFO:teuthology.orchestra.run.smithi148.stdout: "can_run": true, 2024-09-19T07:30:03.660 INFO:teuthology.orchestra.run.smithi148.stdout: "error_string": "", 2024-09-19T07:30:03.660 INFO:teuthology.orchestra.run.smithi148.stdout: "module_options": { 2024-09-19T07:30:03.660 INFO:teuthology.orchestra.run.smithi148.stdout: "discovery_interval": { 2024-09-19T07:30:03.660 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "discovery_interval", 2024-09-19T07:30:03.660 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "uint", 2024-09-19T07:30:03.660 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.660 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.661 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "100", 2024-09-19T07:30:03.661 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.661 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.661 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.661 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.661 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.661 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.661 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.661 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.661 INFO:teuthology.orchestra.run.smithi148.stdout: "identifier": { 2024-09-19T07:30:03.661 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "identifier", 2024-09-19T07:30:03.661 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.661 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.662 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.662 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.662 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.662 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.662 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.662 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.662 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.662 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.662 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.662 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.662 INFO:teuthology.orchestra.run.smithi148.stdout: "interval": { 2024-09-19T07:30:03.662 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "interval", 2024-09-19T07:30:03.662 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "secs", 2024-09-19T07:30:03.663 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.663 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.663 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "60", 2024-09-19T07:30:03.663 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.663 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.663 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.663 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.663 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.663 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.663 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.663 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.663 INFO:teuthology.orchestra.run.smithi148.stdout: "log_level": { 2024-09-19T07:30:03.663 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_level", 2024-09-19T07:30:03.664 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.664 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.664 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.664 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.664 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.664 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.664 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.664 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.664 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.664 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.664 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.664 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.664 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.664 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.665 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.665 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.665 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.665 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.665 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.665 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster": { 2024-09-19T07:30:03.665 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster", 2024-09-19T07:30:03.665 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.665 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.665 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.665 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.665 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.665 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.666 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.666 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.666 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.666 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.666 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.666 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.666 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_cluster_level": { 2024-09-19T07:30:03.666 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_cluster_level", 2024-09-19T07:30:03.666 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.666 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.666 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.666 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "info", 2024-09-19T07:30:03.666 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.667 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.667 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [ 2024-09-19T07:30:03.667 INFO:teuthology.orchestra.run.smithi148.stdout: "", 2024-09-19T07:30:03.667 INFO:teuthology.orchestra.run.smithi148.stdout: "critical", 2024-09-19T07:30:03.667 INFO:teuthology.orchestra.run.smithi148.stdout: "debug", 2024-09-19T07:30:03.667 INFO:teuthology.orchestra.run.smithi148.stdout: "error", 2024-09-19T07:30:03.667 INFO:teuthology.orchestra.run.smithi148.stdout: "info", 2024-09-19T07:30:03.667 INFO:teuthology.orchestra.run.smithi148.stdout: "warning" 2024-09-19T07:30:03.667 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.667 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.667 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.667 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.667 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.667 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.668 INFO:teuthology.orchestra.run.smithi148.stdout: "log_to_file": { 2024-09-19T07:30:03.668 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "log_to_file", 2024-09-19T07:30:03.668 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "bool", 2024-09-19T07:30:03.668 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.668 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 1, 2024-09-19T07:30:03.668 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "False", 2024-09-19T07:30:03.668 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.668 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.668 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.668 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.668 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.668 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.669 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.669 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.669 INFO:teuthology.orchestra.run.smithi148.stdout: "zabbix_host": { 2024-09-19T07:30:03.669 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "zabbix_host", 2024-09-19T07:30:03.669 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.669 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.669 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.669 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "", 2024-09-19T07:30:03.669 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.669 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.669 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.669 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.670 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.670 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.670 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.670 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.670 INFO:teuthology.orchestra.run.smithi148.stdout: "zabbix_port": { 2024-09-19T07:30:03.670 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "zabbix_port", 2024-09-19T07:30:03.670 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "int", 2024-09-19T07:30:03.670 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.670 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.670 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "10051", 2024-09-19T07:30:03.670 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.670 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.670 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.671 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.671 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.671 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.671 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.671 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.671 INFO:teuthology.orchestra.run.smithi148.stdout: "zabbix_sender": { 2024-09-19T07:30:03.671 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "zabbix_sender", 2024-09-19T07:30:03.671 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "str", 2024-09-19T07:30:03.671 INFO:teuthology.orchestra.run.smithi148.stdout: "level": "advanced", 2024-09-19T07:30:03.671 INFO:teuthology.orchestra.run.smithi148.stdout: "flags": 0, 2024-09-19T07:30:03.671 INFO:teuthology.orchestra.run.smithi148.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T07:30:03.671 INFO:teuthology.orchestra.run.smithi148.stdout: "min": "", 2024-09-19T07:30:03.671 INFO:teuthology.orchestra.run.smithi148.stdout: "max": "", 2024-09-19T07:30:03.671 INFO:teuthology.orchestra.run.smithi148.stdout: "enum_allowed": [], 2024-09-19T07:30:03.672 INFO:teuthology.orchestra.run.smithi148.stdout: "desc": "", 2024-09-19T07:30:03.672 INFO:teuthology.orchestra.run.smithi148.stdout: "long_desc": "", 2024-09-19T07:30:03.672 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-19T07:30:03.672 INFO:teuthology.orchestra.run.smithi148.stdout: "see_also": [] 2024-09-19T07:30:03.672 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.672 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.672 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.672 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.672 INFO:teuthology.orchestra.run.smithi148.stdout: "services": { 2024-09-19T07:30:03.672 INFO:teuthology.orchestra.run.smithi148.stdout: "dashboard": "https://172.21.15.148:8443/" 2024-09-19T07:30:03.672 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.672 INFO:teuthology.orchestra.run.smithi148.stdout: "always_on_modules": { 2024-09-19T07:30:03.672 INFO:teuthology.orchestra.run.smithi148.stdout: "octopus": [ 2024-09-19T07:30:03.673 INFO:teuthology.orchestra.run.smithi148.stdout: "balancer", 2024-09-19T07:30:03.673 INFO:teuthology.orchestra.run.smithi148.stdout: "crash", 2024-09-19T07:30:03.673 INFO:teuthology.orchestra.run.smithi148.stdout: "devicehealth", 2024-09-19T07:30:03.673 INFO:teuthology.orchestra.run.smithi148.stdout: "orchestrator", 2024-09-19T07:30:03.673 INFO:teuthology.orchestra.run.smithi148.stdout: "pg_autoscaler", 2024-09-19T07:30:03.673 INFO:teuthology.orchestra.run.smithi148.stdout: "progress", 2024-09-19T07:30:03.673 INFO:teuthology.orchestra.run.smithi148.stdout: "rbd_support", 2024-09-19T07:30:03.673 INFO:teuthology.orchestra.run.smithi148.stdout: "status", 2024-09-19T07:30:03.673 INFO:teuthology.orchestra.run.smithi148.stdout: "telemetry", 2024-09-19T07:30:03.673 INFO:teuthology.orchestra.run.smithi148.stdout: "volumes" 2024-09-19T07:30:03.673 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.673 INFO:teuthology.orchestra.run.smithi148.stdout: "pacific": [ 2024-09-19T07:30:03.673 INFO:teuthology.orchestra.run.smithi148.stdout: "balancer", 2024-09-19T07:30:03.673 INFO:teuthology.orchestra.run.smithi148.stdout: "crash", 2024-09-19T07:30:03.674 INFO:teuthology.orchestra.run.smithi148.stdout: "devicehealth", 2024-09-19T07:30:03.674 INFO:teuthology.orchestra.run.smithi148.stdout: "orchestrator", 2024-09-19T07:30:03.674 INFO:teuthology.orchestra.run.smithi148.stdout: "pg_autoscaler", 2024-09-19T07:30:03.674 INFO:teuthology.orchestra.run.smithi148.stdout: "progress", 2024-09-19T07:30:03.674 INFO:teuthology.orchestra.run.smithi148.stdout: "rbd_support", 2024-09-19T07:30:03.674 INFO:teuthology.orchestra.run.smithi148.stdout: "status", 2024-09-19T07:30:03.674 INFO:teuthology.orchestra.run.smithi148.stdout: "telemetry", 2024-09-19T07:30:03.674 INFO:teuthology.orchestra.run.smithi148.stdout: "volumes" 2024-09-19T07:30:03.674 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.674 INFO:teuthology.orchestra.run.smithi148.stdout: "quincy": [ 2024-09-19T07:30:03.674 INFO:teuthology.orchestra.run.smithi148.stdout: "balancer", 2024-09-19T07:30:03.674 INFO:teuthology.orchestra.run.smithi148.stdout: "crash", 2024-09-19T07:30:03.674 INFO:teuthology.orchestra.run.smithi148.stdout: "devicehealth", 2024-09-19T07:30:03.675 INFO:teuthology.orchestra.run.smithi148.stdout: "orchestrator", 2024-09-19T07:30:03.675 INFO:teuthology.orchestra.run.smithi148.stdout: "pg_autoscaler", 2024-09-19T07:30:03.675 INFO:teuthology.orchestra.run.smithi148.stdout: "progress", 2024-09-19T07:30:03.675 INFO:teuthology.orchestra.run.smithi148.stdout: "rbd_support", 2024-09-19T07:30:03.675 INFO:teuthology.orchestra.run.smithi148.stdout: "status", 2024-09-19T07:30:03.675 INFO:teuthology.orchestra.run.smithi148.stdout: "telemetry", 2024-09-19T07:30:03.675 INFO:teuthology.orchestra.run.smithi148.stdout: "volumes" 2024-09-19T07:30:03.675 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.675 INFO:teuthology.orchestra.run.smithi148.stdout: "reef": [ 2024-09-19T07:30:03.675 INFO:teuthology.orchestra.run.smithi148.stdout: "balancer", 2024-09-19T07:30:03.675 INFO:teuthology.orchestra.run.smithi148.stdout: "crash", 2024-09-19T07:30:03.675 INFO:teuthology.orchestra.run.smithi148.stdout: "devicehealth", 2024-09-19T07:30:03.675 INFO:teuthology.orchestra.run.smithi148.stdout: "orchestrator", 2024-09-19T07:30:03.675 INFO:teuthology.orchestra.run.smithi148.stdout: "pg_autoscaler", 2024-09-19T07:30:03.676 INFO:teuthology.orchestra.run.smithi148.stdout: "progress", 2024-09-19T07:30:03.676 INFO:teuthology.orchestra.run.smithi148.stdout: "rbd_support", 2024-09-19T07:30:03.676 INFO:teuthology.orchestra.run.smithi148.stdout: "status", 2024-09-19T07:30:03.676 INFO:teuthology.orchestra.run.smithi148.stdout: "telemetry", 2024-09-19T07:30:03.676 INFO:teuthology.orchestra.run.smithi148.stdout: "volumes" 2024-09-19T07:30:03.676 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-19T07:30:03.676 INFO:teuthology.orchestra.run.smithi148.stdout: "squid": [ 2024-09-19T07:30:03.676 INFO:teuthology.orchestra.run.smithi148.stdout: "balancer", 2024-09-19T07:30:03.676 INFO:teuthology.orchestra.run.smithi148.stdout: "crash", 2024-09-19T07:30:03.676 INFO:teuthology.orchestra.run.smithi148.stdout: "devicehealth", 2024-09-19T07:30:03.676 INFO:teuthology.orchestra.run.smithi148.stdout: "orchestrator", 2024-09-19T07:30:03.676 INFO:teuthology.orchestra.run.smithi148.stdout: "pg_autoscaler", 2024-09-19T07:30:03.676 INFO:teuthology.orchestra.run.smithi148.stdout: "progress", 2024-09-19T07:30:03.677 INFO:teuthology.orchestra.run.smithi148.stdout: "rbd_support", 2024-09-19T07:30:03.677 INFO:teuthology.orchestra.run.smithi148.stdout: "status", 2024-09-19T07:30:03.677 INFO:teuthology.orchestra.run.smithi148.stdout: "telemetry", 2024-09-19T07:30:03.677 INFO:teuthology.orchestra.run.smithi148.stdout: "volumes" 2024-09-19T07:30:03.677 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-19T07:30:03.677 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.677 INFO:teuthology.orchestra.run.smithi148.stdout: "last_failure_osd_epoch": 81, 2024-09-19T07:30:03.677 INFO:teuthology.orchestra.run.smithi148.stdout: "active_clients": [ 2024-09-19T07:30:03.677 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.677 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "devicehealth", 2024-09-19T07:30:03.677 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-09-19T07:30:03.677 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.677 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-09-19T07:30:03.678 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:0", 2024-09-19T07:30:03.678 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 2428272318 2024-09-19T07:30:03.678 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.678 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-19T07:30:03.678 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.678 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.678 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "libcephsqlite", 2024-09-19T07:30:03.678 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-09-19T07:30:03.678 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.678 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-09-19T07:30:03.678 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:0", 2024-09-19T07:30:03.678 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 1779953565 2024-09-19T07:30:03.678 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.678 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-19T07:30:03.679 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.679 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.679 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "rbd_support", 2024-09-19T07:30:03.679 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-09-19T07:30:03.679 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.679 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-09-19T07:30:03.679 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:0", 2024-09-19T07:30:03.679 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 3782726681 2024-09-19T07:30:03.679 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.679 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-19T07:30:03.679 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.679 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.679 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "snap_schedule", 2024-09-19T07:30:03.679 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-09-19T07:30:03.680 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.680 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-09-19T07:30:03.680 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:0", 2024-09-19T07:30:03.680 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 1172112787 2024-09-19T07:30:03.680 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.680 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-19T07:30:03.680 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.680 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.680 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "snap_schedule", 2024-09-19T07:30:03.680 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-09-19T07:30:03.680 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.680 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-09-19T07:30:03.680 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:0", 2024-09-19T07:30:03.680 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 3116247483 2024-09-19T07:30:03.681 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.681 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-19T07:30:03.681 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:03.681 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.681 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "volumes", 2024-09-19T07:30:03.681 INFO:teuthology.orchestra.run.smithi148.stdout: "addrvec": [ 2024-09-19T07:30:03.681 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-19T07:30:03.681 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v2", 2024-09-19T07:30:03.681 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "172.21.15.148:0", 2024-09-19T07:30:03.681 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 4158985226 2024-09-19T07:30:03.681 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.681 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-19T07:30:03.681 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:03.682 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-19T07:30:03.682 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:30:03.683 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:02 smithi179 ceph-mon[35716]: pgmap v596: 97 pgs: 4 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 87 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 169 op/s 2024-09-19T07:30:03.683 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:02 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/3707406204' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T07:30:03.683 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:02 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/39650827' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T07:30:03.683 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:02 smithi165 ceph-mon[35326]: pgmap v596: 97 pgs: 4 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 87 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 169 op/s 2024-09-19T07:30:03.683 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:02 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/3707406204' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T07:30:03.683 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:02 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/39650827' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T07:30:03.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.303+0000 7fab9bc0e640 1 -- 172.21.15.148:0/39650827 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fab800a3440 msgr2=0x7fab800a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:03.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.303+0000 7fab9bc0e640 1 --2- 172.21.15.148:0/39650827 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fab800a3440 0x7fab800a5900 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fab90009bd0 tx=0x7fab90005f90 comp rx=0 tx=0).stop 2024-09-19T07:30:03.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.303+0000 7fab9bc0e640 1 -- 172.21.15.148:0/39650827 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab94103690 msgr2=0x7fab941989c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:03.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.303+0000 7fab9bc0e640 1 --2- 172.21.15.148:0/39650827 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab94103690 0x7fab941989c0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fab84006010 tx=0x7fab840042f0 comp rx=0 tx=0).stop 2024-09-19T07:30:03.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.303+0000 7fab9bc0e640 1 -- 172.21.15.148:0/39650827 shutdown_connections 2024-09-19T07:30:03.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.303+0000 7fab9bc0e640 1 --2- 172.21.15.148:0/39650827 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fab800a3440 0x7fab800a5900 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:03.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.303+0000 7fab9bc0e640 1 --2- 172.21.15.148:0/39650827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab9410c140 0x7fab9419cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:03.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.303+0000 7fab9bc0e640 1 --2- 172.21.15.148:0/39650827 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab94103690 0x7fab941989c0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:03.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.303+0000 7fab9bc0e640 1 --2- 172.21.15.148:0/39650827 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab94102d70 0x7fab94198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:03.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.303+0000 7fab9bc0e640 1 -- 172.21.15.148:0/39650827 >> 172.21.15.148:0/39650827 conn(0x7fab940fc740 msgr2=0x7fab940fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:30:03.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.303+0000 7fab9bc0e640 1 -- 172.21.15.148:0/39650827 shutdown_connections 2024-09-19T07:30:03.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:02.303+0000 7fab9bc0e640 1 -- 172.21.15.148:0/39650827 wait complete. 2024-09-19T07:30:03.691 DEBUG:tasks.check_counter:Getting stats from a 2024-09-19T07:30:03.691 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-19T07:30:03.691 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:02 smithi148 ceph-mon[31180]: pgmap v596: 97 pgs: 4 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 87 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 169 op/s 2024-09-19T07:30:03.692 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:02 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/3707406204' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T07:30:03.692 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:02 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/39650827' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T07:30:03.953 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:30:04.470 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:30:04.471 INFO:teuthology.orchestra.run.smithi148.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T07:30:04.471 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_messages": 4, 2024-09-19T07:30:04.471 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages": 4, 2024-09-19T07:30:04.471 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_bytes": 3024, 2024-09-19T07:30:04.471 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_bytes": 448, 2024-09-19T07:30:04.471 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_created_connections": 4, 2024-09-19T07:30:04.471 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_active_connections": 0, 2024-09-19T07:30:04.471 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_total_time": 0.003219266, 2024-09-19T07:30:04.471 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_send_time": 0.000036550, 2024-09-19T07:30:04.471 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_recv_time": 0.002251013, 2024-09-19T07:30:04.472 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T07:30:04.472 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:30:04.472 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 3, 2024-09-19T07:30:04.472 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.004051957, 2024-09-19T07:30:04.472 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.001350652 2024-09-19T07:30:04.472 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:04.472 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:30:04.472 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-19T07:30:04.472 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-19T07:30:04.472 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-19T07:30:04.472 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:04.472 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-09-19T07:30:04.473 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T07:30:04.473 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:04.473 INFO:teuthology.orchestra.run.smithi148.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T07:30:04.473 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_messages": 344, 2024-09-19T07:30:04.473 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages": 334, 2024-09-19T07:30:04.473 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_bytes": 1483088, 2024-09-19T07:30:04.473 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_bytes": 206640, 2024-09-19T07:30:04.473 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_created_connections": 2, 2024-09-19T07:30:04.473 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_active_connections": 1, 2024-09-19T07:30:04.473 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_total_time": 0.057570116, 2024-09-19T07:30:04.473 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_send_time": 0.023013388, 2024-09-19T07:30:04.473 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_recv_time": 0.046766992, 2024-09-19T07:30:04.473 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T07:30:04.474 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:30:04.474 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 333, 2024-09-19T07:30:04.474 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.016874140, 2024-09-19T07:30:04.474 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000050673 2024-09-19T07:30:04.474 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:04.474 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:30:04.474 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-19T07:30:04.474 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-19T07:30:04.474 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-19T07:30:04.474 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:04.474 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_encrypted_bytes": 1483088, 2024-09-19T07:30:04.474 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_encrypted_bytes": 206640 2024-09-19T07:30:04.474 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:04.475 INFO:teuthology.orchestra.run.smithi148.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T07:30:04.475 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_messages": 3, 2024-09-19T07:30:04.475 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages": 258, 2024-09-19T07:30:04.475 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_bytes": 480, 2024-09-19T07:30:04.475 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_bytes": 281520, 2024-09-19T07:30:04.475 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_created_connections": 6, 2024-09-19T07:30:04.475 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_active_connections": 3, 2024-09-19T07:30:04.475 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_total_time": 0.019396697, 2024-09-19T07:30:04.475 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_send_time": 0.013424838, 2024-09-19T07:30:04.475 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_recv_time": 0.002874360, 2024-09-19T07:30:04.475 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T07:30:04.475 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:30:04.475 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 255, 2024-09-19T07:30:04.475 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.024222462, 2024-09-19T07:30:04.476 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000094990 2024-09-19T07:30:04.476 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:04.476 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:30:04.476 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-19T07:30:04.476 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-19T07:30:04.476 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-19T07:30:04.476 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:04.476 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_encrypted_bytes": 480, 2024-09-19T07:30:04.476 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_encrypted_bytes": 281520 2024-09-19T07:30:04.476 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:04.476 INFO:teuthology.orchestra.run.smithi148.stdout: "cct": { 2024-09-19T07:30:04.476 INFO:teuthology.orchestra.run.smithi148.stdout: "total_workers": 0, 2024-09-19T07:30:04.476 INFO:teuthology.orchestra.run.smithi148.stdout: "unhealthy_workers": 0 2024-09-19T07:30:04.477 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:04.477 INFO:teuthology.orchestra.run.smithi148.stdout: "mempool": { 2024-09-19T07:30:04.477 INFO:teuthology.orchestra.run.smithi148.stdout: "bloom_filter_bytes": 0, 2024-09-19T07:30:04.477 INFO:teuthology.orchestra.run.smithi148.stdout: "bloom_filter_items": 0, 2024-09-19T07:30:04.477 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T07:30:04.477 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_alloc_items": 0, 2024-09-19T07:30:04.477 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T07:30:04.477 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_data_items": 0, 2024-09-19T07:30:04.477 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T07:30:04.477 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T07:30:04.477 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T07:30:04.477 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T07:30:04.477 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T07:30:04.478 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_other_items": 0, 2024-09-19T07:30:04.478 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T07:30:04.478 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T07:30:04.478 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_extent_bytes": 0, 2024-09-19T07:30:04.478 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_extent_items": 0, 2024-09-19T07:30:04.478 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_blob_bytes": 0, 2024-09-19T07:30:04.478 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_blob_items": 0, 2024-09-19T07:30:04.478 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T07:30:04.478 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T07:30:04.478 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T07:30:04.478 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T07:30:04.478 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T07:30:04.478 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_fsck_items": 0, 2024-09-19T07:30:04.478 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_txc_bytes": 0, 2024-09-19T07:30:04.479 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_txc_items": 0, 2024-09-19T07:30:04.479 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T07:30:04.479 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T07:30:04.479 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_writing_bytes": 0, 2024-09-19T07:30:04.479 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_writing_items": 0, 2024-09-19T07:30:04.479 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_bytes": 0, 2024-09-19T07:30:04.479 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_items": 0, 2024-09-19T07:30:04.479 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T07:30:04.479 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_file_reader_items": 0, 2024-09-19T07:30:04.479 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T07:30:04.479 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_file_writer_items": 0, 2024-09-19T07:30:04.479 INFO:teuthology.orchestra.run.smithi148.stdout: "buffer_anon_bytes": 148714, 2024-09-19T07:30:04.479 INFO:teuthology.orchestra.run.smithi148.stdout: "buffer_anon_items": 30, 2024-09-19T07:30:04.479 INFO:teuthology.orchestra.run.smithi148.stdout: "buffer_meta_bytes": 0, 2024-09-19T07:30:04.480 INFO:teuthology.orchestra.run.smithi148.stdout: "buffer_meta_items": 0, 2024-09-19T07:30:04.480 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_bytes": 0, 2024-09-19T07:30:04.480 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_items": 0, 2024-09-19T07:30:04.480 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_mapbl_bytes": 0, 2024-09-19T07:30:04.480 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_mapbl_items": 0, 2024-09-19T07:30:04.480 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_pglog_bytes": 0, 2024-09-19T07:30:04.480 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_pglog_items": 0, 2024-09-19T07:30:04.480 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_bytes": 0, 2024-09-19T07:30:04.480 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_items": 0, 2024-09-19T07:30:04.480 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T07:30:04.480 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_mapping_items": 0, 2024-09-19T07:30:04.480 INFO:teuthology.orchestra.run.smithi148.stdout: "pgmap_bytes": 0, 2024-09-19T07:30:04.480 INFO:teuthology.orchestra.run.smithi148.stdout: "pgmap_items": 0, 2024-09-19T07:30:04.481 INFO:teuthology.orchestra.run.smithi148.stdout: "mds_co_bytes": 928, 2024-09-19T07:30:04.481 INFO:teuthology.orchestra.run.smithi148.stdout: "mds_co_items": 2, 2024-09-19T07:30:04.481 INFO:teuthology.orchestra.run.smithi148.stdout: "unittest_1_bytes": 0, 2024-09-19T07:30:04.481 INFO:teuthology.orchestra.run.smithi148.stdout: "unittest_1_items": 0, 2024-09-19T07:30:04.481 INFO:teuthology.orchestra.run.smithi148.stdout: "unittest_2_bytes": 0, 2024-09-19T07:30:04.481 INFO:teuthology.orchestra.run.smithi148.stdout: "unittest_2_items": 0 2024-09-19T07:30:04.481 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:04.481 INFO:teuthology.orchestra.run.smithi148.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T07:30:04.481 INFO:teuthology.orchestra.run.smithi148.stdout: "val": 0, 2024-09-19T07:30:04.481 INFO:teuthology.orchestra.run.smithi148.stdout: "max": 104857600, 2024-09-19T07:30:04.481 INFO:teuthology.orchestra.run.smithi148.stdout: "get_started": 0, 2024-09-19T07:30:04.481 INFO:teuthology.orchestra.run.smithi148.stdout: "get": 347, 2024-09-19T07:30:04.482 INFO:teuthology.orchestra.run.smithi148.stdout: "get_sum": 1434518, 2024-09-19T07:30:04.482 INFO:teuthology.orchestra.run.smithi148.stdout: "get_or_fail_fail": 0, 2024-09-19T07:30:04.482 INFO:teuthology.orchestra.run.smithi148.stdout: "get_or_fail_success": 347, 2024-09-19T07:30:04.482 INFO:teuthology.orchestra.run.smithi148.stdout: "take": 0, 2024-09-19T07:30:04.482 INFO:teuthology.orchestra.run.smithi148.stdout: "take_sum": 0, 2024-09-19T07:30:04.482 INFO:teuthology.orchestra.run.smithi148.stdout: "put": 347, 2024-09-19T07:30:04.482 INFO:teuthology.orchestra.run.smithi148.stdout: "put_sum": 1434518, 2024-09-19T07:30:04.482 INFO:teuthology.orchestra.run.smithi148.stdout: "wait": { 2024-09-19T07:30:04.482 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-19T07:30:04.482 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-19T07:30:04.482 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-19T07:30:04.482 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:04.482 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:04.482 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:30:05.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:04 smithi148 ceph-mon[31180]: pgmap v597: 97 pgs: 2 active+clean+snaptrim, 95 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 849 KiB/s rd, 587 KiB/s wr, 91 op/s 2024-09-19T07:30:05.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:04 smithi165 ceph-mon[35326]: pgmap v597: 97 pgs: 2 active+clean+snaptrim, 95 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 849 KiB/s rd, 587 KiB/s wr, 91 op/s 2024-09-19T07:30:05.261 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-09-19T07:30:05.261 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-09-19T07:30:05.261 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2024-09-19T07:30:05.261 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2024-09-19T07:30:05.261 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2024-09-19T07:30:05.262 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2024-09-19T07:30:05.262 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2024-09-19T07:30:05.262 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.a 2024-09-19T07:30:05.262 DEBUG:tasks.check_counter:Getting stats from d 2024-09-19T07:30:05.262 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-19T07:30:05.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:04 smithi179 ceph-mon[35716]: pgmap v597: 97 pgs: 2 active+clean+snaptrim, 95 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 849 KiB/s rd, 587 KiB/s wr, 91 op/s 2024-09-19T07:30:05.509 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:30:06.047 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:30:06.047 INFO:teuthology.orchestra.run.smithi148.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T07:30:06.047 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_messages": 4, 2024-09-19T07:30:06.047 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages": 4, 2024-09-19T07:30:06.047 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_bytes": 3024, 2024-09-19T07:30:06.047 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_bytes": 448, 2024-09-19T07:30:06.047 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_created_connections": 4, 2024-09-19T07:30:06.047 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_active_connections": 0, 2024-09-19T07:30:06.047 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_total_time": 0.003003117, 2024-09-19T07:30:06.048 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_send_time": 0.000029727, 2024-09-19T07:30:06.048 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_recv_time": 0.002131482, 2024-09-19T07:30:06.048 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T07:30:06.048 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:30:06.048 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 3, 2024-09-19T07:30:06.048 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.003904211, 2024-09-19T07:30:06.048 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.001301403 2024-09-19T07:30:06.048 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:06.048 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:30:06.048 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-19T07:30:06.048 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-19T07:30:06.048 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-19T07:30:06.048 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:06.049 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-09-19T07:30:06.049 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T07:30:06.049 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:06.049 INFO:teuthology.orchestra.run.smithi148.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T07:30:06.049 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_messages": 350, 2024-09-19T07:30:06.049 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages": 340, 2024-09-19T07:30:06.049 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_bytes": 1485344, 2024-09-19T07:30:06.049 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_bytes": 210176, 2024-09-19T07:30:06.049 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_created_connections": 2, 2024-09-19T07:30:06.049 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_active_connections": 1, 2024-09-19T07:30:06.049 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_total_time": 0.059969152, 2024-09-19T07:30:06.049 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_send_time": 0.024687726, 2024-09-19T07:30:06.049 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_recv_time": 0.048491524, 2024-09-19T07:30:06.049 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T07:30:06.050 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:30:06.050 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 339, 2024-09-19T07:30:06.050 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.017982989, 2024-09-19T07:30:06.050 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000053047 2024-09-19T07:30:06.050 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:06.050 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:30:06.050 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-19T07:30:06.050 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-19T07:30:06.050 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-19T07:30:06.050 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:06.050 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_encrypted_bytes": 1485344, 2024-09-19T07:30:06.050 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_encrypted_bytes": 210176 2024-09-19T07:30:06.050 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:06.050 INFO:teuthology.orchestra.run.smithi148.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T07:30:06.051 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_messages": 3, 2024-09-19T07:30:06.051 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages": 261, 2024-09-19T07:30:06.051 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_bytes": 480, 2024-09-19T07:30:06.051 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_bytes": 282048, 2024-09-19T07:30:06.051 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_created_connections": 6, 2024-09-19T07:30:06.051 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_active_connections": 3, 2024-09-19T07:30:06.051 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_total_time": 0.019312502, 2024-09-19T07:30:06.051 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_send_time": 0.013924170, 2024-09-19T07:30:06.051 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_recv_time": 0.002151197, 2024-09-19T07:30:06.051 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T07:30:06.051 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:30:06.051 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 258, 2024-09-19T07:30:06.051 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.019671164, 2024-09-19T07:30:06.051 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000076244 2024-09-19T07:30:06.052 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:06.052 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:30:06.052 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-19T07:30:06.052 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-19T07:30:06.052 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-19T07:30:06.052 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:06.052 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_encrypted_bytes": 480, 2024-09-19T07:30:06.052 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_encrypted_bytes": 282048 2024-09-19T07:30:06.052 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:06.052 INFO:teuthology.orchestra.run.smithi148.stdout: "cct": { 2024-09-19T07:30:06.052 INFO:teuthology.orchestra.run.smithi148.stdout: "total_workers": 0, 2024-09-19T07:30:06.052 INFO:teuthology.orchestra.run.smithi148.stdout: "unhealthy_workers": 0 2024-09-19T07:30:06.052 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:06.052 INFO:teuthology.orchestra.run.smithi148.stdout: "mempool": { 2024-09-19T07:30:06.053 INFO:teuthology.orchestra.run.smithi148.stdout: "bloom_filter_bytes": 0, 2024-09-19T07:30:06.053 INFO:teuthology.orchestra.run.smithi148.stdout: "bloom_filter_items": 0, 2024-09-19T07:30:06.053 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T07:30:06.053 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_alloc_items": 0, 2024-09-19T07:30:06.053 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T07:30:06.053 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_data_items": 0, 2024-09-19T07:30:06.053 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T07:30:06.053 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T07:30:06.053 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T07:30:06.053 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T07:30:06.053 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T07:30:06.053 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_other_items": 0, 2024-09-19T07:30:06.053 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T07:30:06.053 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T07:30:06.054 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_extent_bytes": 0, 2024-09-19T07:30:06.054 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_extent_items": 0, 2024-09-19T07:30:06.054 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_blob_bytes": 0, 2024-09-19T07:30:06.054 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_blob_items": 0, 2024-09-19T07:30:06.054 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T07:30:06.054 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T07:30:06.054 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T07:30:06.054 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T07:30:06.054 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T07:30:06.054 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_fsck_items": 0, 2024-09-19T07:30:06.054 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_txc_bytes": 0, 2024-09-19T07:30:06.054 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_txc_items": 0, 2024-09-19T07:30:06.054 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T07:30:06.054 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T07:30:06.055 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_writing_bytes": 0, 2024-09-19T07:30:06.055 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_writing_items": 0, 2024-09-19T07:30:06.055 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_bytes": 0, 2024-09-19T07:30:06.055 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_items": 0, 2024-09-19T07:30:06.055 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T07:30:06.055 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_file_reader_items": 0, 2024-09-19T07:30:06.055 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T07:30:06.055 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_file_writer_items": 0, 2024-09-19T07:30:06.055 INFO:teuthology.orchestra.run.smithi148.stdout: "buffer_anon_bytes": 148714, 2024-09-19T07:30:06.055 INFO:teuthology.orchestra.run.smithi148.stdout: "buffer_anon_items": 30, 2024-09-19T07:30:06.056 INFO:teuthology.orchestra.run.smithi148.stdout: "buffer_meta_bytes": 0, 2024-09-19T07:30:06.056 INFO:teuthology.orchestra.run.smithi148.stdout: "buffer_meta_items": 0, 2024-09-19T07:30:06.056 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_bytes": 0, 2024-09-19T07:30:06.056 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_items": 0, 2024-09-19T07:30:06.056 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_mapbl_bytes": 0, 2024-09-19T07:30:06.056 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_mapbl_items": 0, 2024-09-19T07:30:06.056 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_pglog_bytes": 0, 2024-09-19T07:30:06.056 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_pglog_items": 0, 2024-09-19T07:30:06.056 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_bytes": 0, 2024-09-19T07:30:06.056 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_items": 0, 2024-09-19T07:30:06.056 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T07:30:06.056 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_mapping_items": 0, 2024-09-19T07:30:06.056 INFO:teuthology.orchestra.run.smithi148.stdout: "pgmap_bytes": 0, 2024-09-19T07:30:06.056 INFO:teuthology.orchestra.run.smithi148.stdout: "pgmap_items": 0, 2024-09-19T07:30:06.057 INFO:teuthology.orchestra.run.smithi148.stdout: "mds_co_bytes": 928, 2024-09-19T07:30:06.057 INFO:teuthology.orchestra.run.smithi148.stdout: "mds_co_items": 2, 2024-09-19T07:30:06.057 INFO:teuthology.orchestra.run.smithi148.stdout: "unittest_1_bytes": 0, 2024-09-19T07:30:06.057 INFO:teuthology.orchestra.run.smithi148.stdout: "unittest_1_items": 0, 2024-09-19T07:30:06.057 INFO:teuthology.orchestra.run.smithi148.stdout: "unittest_2_bytes": 0, 2024-09-19T07:30:06.057 INFO:teuthology.orchestra.run.smithi148.stdout: "unittest_2_items": 0 2024-09-19T07:30:06.057 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:06.057 INFO:teuthology.orchestra.run.smithi148.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T07:30:06.057 INFO:teuthology.orchestra.run.smithi148.stdout: "val": 0, 2024-09-19T07:30:06.057 INFO:teuthology.orchestra.run.smithi148.stdout: "max": 104857600, 2024-09-19T07:30:06.057 INFO:teuthology.orchestra.run.smithi148.stdout: "get_started": 0, 2024-09-19T07:30:06.057 INFO:teuthology.orchestra.run.smithi148.stdout: "get": 353, 2024-09-19T07:30:06.057 INFO:teuthology.orchestra.run.smithi148.stdout: "get_sum": 1435935, 2024-09-19T07:30:06.057 INFO:teuthology.orchestra.run.smithi148.stdout: "get_or_fail_fail": 0, 2024-09-19T07:30:06.058 INFO:teuthology.orchestra.run.smithi148.stdout: "get_or_fail_success": 353, 2024-09-19T07:30:06.058 INFO:teuthology.orchestra.run.smithi148.stdout: "take": 0, 2024-09-19T07:30:06.058 INFO:teuthology.orchestra.run.smithi148.stdout: "take_sum": 0, 2024-09-19T07:30:06.058 INFO:teuthology.orchestra.run.smithi148.stdout: "put": 353, 2024-09-19T07:30:06.058 INFO:teuthology.orchestra.run.smithi148.stdout: "put_sum": 1435935, 2024-09-19T07:30:06.058 INFO:teuthology.orchestra.run.smithi148.stdout: "wait": { 2024-09-19T07:30:06.058 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-19T07:30:06.058 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-19T07:30:06.058 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-19T07:30:06.058 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:06.058 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:06.058 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:30:06.711 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-19T07:30:06.711 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-19T07:30:06.711 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-09-19T07:30:06.711 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-09-19T07:30:06.711 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-09-19T07:30:06.711 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-09-19T07:30:06.711 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-09-19T07:30:06.712 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2024-09-19T07:30:06.712 DEBUG:tasks.check_counter:Getting stats from g 2024-09-19T07:30:06.712 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-19T07:30:07.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:06 smithi148 ceph-mon[31180]: pgmap v598: 97 pgs: 97 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 860 KiB/s rd, 620 KiB/s wr, 101 op/s 2024-09-19T07:30:07.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:06 smithi165 ceph-mon[35326]: pgmap v598: 97 pgs: 97 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 860 KiB/s rd, 620 KiB/s wr, 101 op/s 2024-09-19T07:30:07.138 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:30:07.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:06 smithi179 ceph-mon[35716]: pgmap v598: 97 pgs: 97 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 860 KiB/s rd, 620 KiB/s wr, 101 op/s 2024-09-19T07:30:07.937 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:07 smithi148 ceph-mon[31180]: osdmap e106: 12 total, 12 up, 12 in 2024-09-19T07:30:08.107 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:30:08.107 INFO:teuthology.orchestra.run.smithi148.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T07:30:08.107 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_messages": 4, 2024-09-19T07:30:08.108 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages": 4, 2024-09-19T07:30:08.108 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_bytes": 3024, 2024-09-19T07:30:08.108 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_bytes": 448, 2024-09-19T07:30:08.108 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_created_connections": 4, 2024-09-19T07:30:08.108 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_active_connections": 0, 2024-09-19T07:30:08.108 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_total_time": 0.003344529, 2024-09-19T07:30:08.108 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_send_time": 0.000036326, 2024-09-19T07:30:08.108 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_recv_time": 0.002323976, 2024-09-19T07:30:08.108 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T07:30:08.108 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:30:08.108 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 3, 2024-09-19T07:30:08.108 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.004216093, 2024-09-19T07:30:08.108 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.001405364 2024-09-19T07:30:08.109 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:08.109 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:30:08.109 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-19T07:30:08.109 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-19T07:30:08.109 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-19T07:30:08.109 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:08.109 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-09-19T07:30:08.109 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T07:30:08.109 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:08.109 INFO:teuthology.orchestra.run.smithi148.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T07:30:08.109 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_messages": 347, 2024-09-19T07:30:08.109 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages": 337, 2024-09-19T07:30:08.109 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_bytes": 1484528, 2024-09-19T07:30:08.110 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_bytes": 208256, 2024-09-19T07:30:08.110 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_created_connections": 2, 2024-09-19T07:30:08.110 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_active_connections": 1, 2024-09-19T07:30:08.110 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_total_time": 0.057510412, 2024-09-19T07:30:08.110 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_send_time": 0.023364029, 2024-09-19T07:30:08.110 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_recv_time": 0.045702850, 2024-09-19T07:30:08.110 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T07:30:08.110 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:30:08.110 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 336, 2024-09-19T07:30:08.110 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.019355819, 2024-09-19T07:30:08.110 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000057606 2024-09-19T07:30:08.110 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:08.110 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:30:08.110 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-19T07:30:08.111 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-19T07:30:08.111 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-19T07:30:08.111 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:08.111 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_encrypted_bytes": 1484528, 2024-09-19T07:30:08.111 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_encrypted_bytes": 208256 2024-09-19T07:30:08.111 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:08.111 INFO:teuthology.orchestra.run.smithi148.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T07:30:08.111 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_messages": 3, 2024-09-19T07:30:08.111 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages": 258, 2024-09-19T07:30:08.111 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_bytes": 480, 2024-09-19T07:30:08.111 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_bytes": 281520, 2024-09-19T07:30:08.111 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_created_connections": 6, 2024-09-19T07:30:08.111 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_active_connections": 3, 2024-09-19T07:30:08.111 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_total_time": 0.020863223, 2024-09-19T07:30:08.112 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_send_time": 0.015235788, 2024-09-19T07:30:08.112 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_recv_time": 0.002196635, 2024-09-19T07:30:08.112 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T07:30:08.112 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:30:08.112 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 255, 2024-09-19T07:30:08.112 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.022827331, 2024-09-19T07:30:08.112 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000089518 2024-09-19T07:30:08.112 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:08.112 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:30:08.112 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-19T07:30:08.112 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-19T07:30:08.112 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-19T07:30:08.112 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:08.112 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_encrypted_bytes": 480, 2024-09-19T07:30:08.113 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_encrypted_bytes": 281520 2024-09-19T07:30:08.113 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:08.113 INFO:teuthology.orchestra.run.smithi148.stdout: "cct": { 2024-09-19T07:30:08.113 INFO:teuthology.orchestra.run.smithi148.stdout: "total_workers": 0, 2024-09-19T07:30:08.113 INFO:teuthology.orchestra.run.smithi148.stdout: "unhealthy_workers": 0 2024-09-19T07:30:08.113 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:08.113 INFO:teuthology.orchestra.run.smithi148.stdout: "mempool": { 2024-09-19T07:30:08.113 INFO:teuthology.orchestra.run.smithi148.stdout: "bloom_filter_bytes": 0, 2024-09-19T07:30:08.113 INFO:teuthology.orchestra.run.smithi148.stdout: "bloom_filter_items": 0, 2024-09-19T07:30:08.113 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T07:30:08.113 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_alloc_items": 0, 2024-09-19T07:30:08.113 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T07:30:08.113 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_data_items": 0, 2024-09-19T07:30:08.113 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T07:30:08.114 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T07:30:08.114 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T07:30:08.114 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T07:30:08.114 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T07:30:08.114 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_other_items": 0, 2024-09-19T07:30:08.114 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T07:30:08.114 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T07:30:08.114 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_extent_bytes": 0, 2024-09-19T07:30:08.114 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_extent_items": 0, 2024-09-19T07:30:08.114 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_blob_bytes": 0, 2024-09-19T07:30:08.114 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_blob_items": 0, 2024-09-19T07:30:08.114 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T07:30:08.114 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T07:30:08.114 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T07:30:08.115 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T07:30:08.115 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T07:30:08.115 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_fsck_items": 0, 2024-09-19T07:30:08.115 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_txc_bytes": 0, 2024-09-19T07:30:08.115 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_txc_items": 0, 2024-09-19T07:30:08.115 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T07:30:08.115 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T07:30:08.115 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_writing_bytes": 0, 2024-09-19T07:30:08.115 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_writing_items": 0, 2024-09-19T07:30:08.115 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_bytes": 0, 2024-09-19T07:30:08.115 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_items": 0, 2024-09-19T07:30:08.115 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T07:30:08.115 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_file_reader_items": 0, 2024-09-19T07:30:08.116 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T07:30:08.116 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_file_writer_items": 0, 2024-09-19T07:30:08.116 INFO:teuthology.orchestra.run.smithi148.stdout: "buffer_anon_bytes": 148714, 2024-09-19T07:30:08.116 INFO:teuthology.orchestra.run.smithi148.stdout: "buffer_anon_items": 30, 2024-09-19T07:30:08.116 INFO:teuthology.orchestra.run.smithi148.stdout: "buffer_meta_bytes": 0, 2024-09-19T07:30:08.116 INFO:teuthology.orchestra.run.smithi148.stdout: "buffer_meta_items": 0, 2024-09-19T07:30:08.116 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_bytes": 0, 2024-09-19T07:30:08.116 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_items": 0, 2024-09-19T07:30:08.116 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_mapbl_bytes": 0, 2024-09-19T07:30:08.116 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_mapbl_items": 0, 2024-09-19T07:30:08.116 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_pglog_bytes": 0, 2024-09-19T07:30:08.116 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_pglog_items": 0, 2024-09-19T07:30:08.116 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_bytes": 0, 2024-09-19T07:30:08.117 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_items": 0, 2024-09-19T07:30:08.117 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T07:30:08.117 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_mapping_items": 0, 2024-09-19T07:30:08.117 INFO:teuthology.orchestra.run.smithi148.stdout: "pgmap_bytes": 0, 2024-09-19T07:30:08.117 INFO:teuthology.orchestra.run.smithi148.stdout: "pgmap_items": 0, 2024-09-19T07:30:08.117 INFO:teuthology.orchestra.run.smithi148.stdout: "mds_co_bytes": 928, 2024-09-19T07:30:08.117 INFO:teuthology.orchestra.run.smithi148.stdout: "mds_co_items": 2, 2024-09-19T07:30:08.117 INFO:teuthology.orchestra.run.smithi148.stdout: "unittest_1_bytes": 0, 2024-09-19T07:30:08.118 INFO:teuthology.orchestra.run.smithi148.stdout: "unittest_1_items": 0, 2024-09-19T07:30:08.118 INFO:teuthology.orchestra.run.smithi148.stdout: "unittest_2_bytes": 0, 2024-09-19T07:30:08.118 INFO:teuthology.orchestra.run.smithi148.stdout: "unittest_2_items": 0 2024-09-19T07:30:08.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:08.118 INFO:teuthology.orchestra.run.smithi148.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T07:30:08.118 INFO:teuthology.orchestra.run.smithi148.stdout: "val": 0, 2024-09-19T07:30:08.118 INFO:teuthology.orchestra.run.smithi148.stdout: "max": 104857600, 2024-09-19T07:30:08.118 INFO:teuthology.orchestra.run.smithi148.stdout: "get_started": 0, 2024-09-19T07:30:08.118 INFO:teuthology.orchestra.run.smithi148.stdout: "get": 350, 2024-09-19T07:30:08.118 INFO:teuthology.orchestra.run.smithi148.stdout: "get_sum": 1435545, 2024-09-19T07:30:08.118 INFO:teuthology.orchestra.run.smithi148.stdout: "get_or_fail_fail": 0, 2024-09-19T07:30:08.118 INFO:teuthology.orchestra.run.smithi148.stdout: "get_or_fail_success": 350, 2024-09-19T07:30:08.119 INFO:teuthology.orchestra.run.smithi148.stdout: "take": 0, 2024-09-19T07:30:08.119 INFO:teuthology.orchestra.run.smithi148.stdout: "take_sum": 0, 2024-09-19T07:30:08.119 INFO:teuthology.orchestra.run.smithi148.stdout: "put": 350, 2024-09-19T07:30:08.119 INFO:teuthology.orchestra.run.smithi148.stdout: "put_sum": 1435545, 2024-09-19T07:30:08.119 INFO:teuthology.orchestra.run.smithi148.stdout: "wait": { 2024-09-19T07:30:08.119 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-19T07:30:08.119 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-19T07:30:08.119 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-19T07:30:08.119 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:08.119 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:08.119 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:30:08.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:07 smithi165 ceph-mon[35326]: osdmap e106: 12 total, 12 up, 12 in 2024-09-19T07:30:08.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:07 smithi179 ceph-mon[35716]: osdmap e106: 12 total, 12 up, 12 in 2024-09-19T07:30:08.860 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-19T07:30:08.860 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-19T07:30:08.860 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2024-09-19T07:30:08.860 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2024-09-19T07:30:08.860 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-09-19T07:30:08.860 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-09-19T07:30:08.860 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-09-19T07:30:08.860 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.g 2024-09-19T07:30:08.861 DEBUG:tasks.check_counter:Getting stats from j 2024-09-19T07:30:08.861 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-19T07:30:08.907 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:08 smithi148 ceph-mon[31180]: pgmap v600: 97 pgs: 97 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 70 KiB/s wr, 40 op/s 2024-09-19T07:30:08.907 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:08 smithi148 ceph-mon[31180]: osdmap e107: 12 total, 12 up, 12 in 2024-09-19T07:30:09.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:08 smithi165 ceph-mon[35326]: pgmap v600: 97 pgs: 97 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 70 KiB/s wr, 40 op/s 2024-09-19T07:30:09.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:08 smithi165 ceph-mon[35326]: osdmap e107: 12 total, 12 up, 12 in 2024-09-19T07:30:09.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:08 smithi179 ceph-mon[35716]: pgmap v600: 97 pgs: 97 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 70 KiB/s wr, 40 op/s 2024-09-19T07:30:09.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:08 smithi179 ceph-mon[35716]: osdmap e107: 12 total, 12 up, 12 in 2024-09-19T07:30:09.325 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:30:09.969 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-19T07:30:09.970 INFO:teuthology.orchestra.run.smithi148.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T07:30:09.970 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_messages": 356, 2024-09-19T07:30:09.970 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages": 344, 2024-09-19T07:30:09.970 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_bytes": 1488912, 2024-09-19T07:30:09.970 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_bytes": 211904, 2024-09-19T07:30:09.970 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_created_connections": 4, 2024-09-19T07:30:09.970 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_active_connections": 0, 2024-09-19T07:30:09.970 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_total_time": 0.059306931, 2024-09-19T07:30:09.970 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_send_time": 0.022811652, 2024-09-19T07:30:09.970 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_recv_time": 0.050106394, 2024-09-19T07:30:09.970 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T07:30:09.971 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:30:09.971 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 344, 2024-09-19T07:30:09.971 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.023228332, 2024-09-19T07:30:09.971 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000067524 2024-09-19T07:30:09.971 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:09.971 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:30:09.971 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-19T07:30:09.971 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-19T07:30:09.971 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-19T07:30:09.971 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:09.971 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_encrypted_bytes": 1488912, 2024-09-19T07:30:09.971 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_encrypted_bytes": 211904 2024-09-19T07:30:09.971 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:09.972 INFO:teuthology.orchestra.run.smithi148.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T07:30:09.972 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_messages": 3, 2024-09-19T07:30:09.972 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages": 263, 2024-09-19T07:30:09.972 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_bytes": 480, 2024-09-19T07:30:09.972 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_bytes": 282400, 2024-09-19T07:30:09.972 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_created_connections": 6, 2024-09-19T07:30:09.972 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_active_connections": 3, 2024-09-19T07:30:09.972 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_total_time": 0.020170867, 2024-09-19T07:30:09.972 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_send_time": 0.014449353, 2024-09-19T07:30:09.972 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_recv_time": 0.002390237, 2024-09-19T07:30:09.972 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T07:30:09.972 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:30:09.972 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 260, 2024-09-19T07:30:09.972 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.021749321, 2024-09-19T07:30:09.973 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000083651 2024-09-19T07:30:09.973 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:09.973 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:30:09.973 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-19T07:30:09.973 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-19T07:30:09.973 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-19T07:30:09.973 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:09.973 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_encrypted_bytes": 480, 2024-09-19T07:30:09.973 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_encrypted_bytes": 282400 2024-09-19T07:30:09.973 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:09.973 INFO:teuthology.orchestra.run.smithi148.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T07:30:09.973 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_messages": 0, 2024-09-19T07:30:09.973 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages": 2, 2024-09-19T07:30:09.973 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_bytes": 0, 2024-09-19T07:30:09.974 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_bytes": 0, 2024-09-19T07:30:09.974 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_created_connections": 2, 2024-09-19T07:30:09.974 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_active_connections": 1, 2024-09-19T07:30:09.974 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_total_time": 0.000375188, 2024-09-19T07:30:09.974 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T07:30:09.974 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_recv_time": 0.000295310, 2024-09-19T07:30:09.974 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T07:30:09.974 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:30:09.974 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-19T07:30:09.974 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-19T07:30:09.974 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-19T07:30:09.974 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:09.974 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:30:09.974 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-19T07:30:09.975 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-19T07:30:09.975 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-19T07:30:09.975 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:09.975 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T07:30:09.975 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T07:30:09.975 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:09.975 INFO:teuthology.orchestra.run.smithi148.stdout: "cct": { 2024-09-19T07:30:09.975 INFO:teuthology.orchestra.run.smithi148.stdout: "total_workers": 0, 2024-09-19T07:30:09.975 INFO:teuthology.orchestra.run.smithi148.stdout: "unhealthy_workers": 0 2024-09-19T07:30:09.975 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:09.975 INFO:teuthology.orchestra.run.smithi148.stdout: "mempool": { 2024-09-19T07:30:09.975 INFO:teuthology.orchestra.run.smithi148.stdout: "bloom_filter_bytes": 0, 2024-09-19T07:30:09.976 INFO:teuthology.orchestra.run.smithi148.stdout: "bloom_filter_items": 0, 2024-09-19T07:30:09.976 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T07:30:09.976 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_alloc_items": 0, 2024-09-19T07:30:09.976 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T07:30:09.976 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_data_items": 0, 2024-09-19T07:30:09.976 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T07:30:09.976 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T07:30:09.976 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T07:30:09.976 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T07:30:09.976 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T07:30:09.977 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_other_items": 0, 2024-09-19T07:30:09.977 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T07:30:09.977 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T07:30:09.977 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_extent_bytes": 0, 2024-09-19T07:30:09.977 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_extent_items": 0, 2024-09-19T07:30:09.977 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_blob_bytes": 0, 2024-09-19T07:30:09.977 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_blob_items": 0, 2024-09-19T07:30:09.977 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T07:30:09.977 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T07:30:09.977 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T07:30:09.977 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T07:30:09.977 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T07:30:09.977 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_fsck_items": 0, 2024-09-19T07:30:09.978 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_txc_bytes": 0, 2024-09-19T07:30:09.978 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_txc_items": 0, 2024-09-19T07:30:09.978 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T07:30:09.978 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T07:30:09.978 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_writing_bytes": 0, 2024-09-19T07:30:09.978 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_writing_items": 0, 2024-09-19T07:30:09.978 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_bytes": 0, 2024-09-19T07:30:09.978 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_items": 0, 2024-09-19T07:30:09.978 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T07:30:09.978 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_file_reader_items": 0, 2024-09-19T07:30:09.978 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T07:30:09.978 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_file_writer_items": 0, 2024-09-19T07:30:09.978 INFO:teuthology.orchestra.run.smithi148.stdout: "buffer_anon_bytes": 148692, 2024-09-19T07:30:09.978 INFO:teuthology.orchestra.run.smithi148.stdout: "buffer_anon_items": 30, 2024-09-19T07:30:09.979 INFO:teuthology.orchestra.run.smithi148.stdout: "buffer_meta_bytes": 0, 2024-09-19T07:30:09.979 INFO:teuthology.orchestra.run.smithi148.stdout: "buffer_meta_items": 0, 2024-09-19T07:30:09.979 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_bytes": 0, 2024-09-19T07:30:09.979 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_items": 0, 2024-09-19T07:30:09.979 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_mapbl_bytes": 0, 2024-09-19T07:30:09.979 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_mapbl_items": 0, 2024-09-19T07:30:09.979 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_pglog_bytes": 0, 2024-09-19T07:30:09.979 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_pglog_items": 0, 2024-09-19T07:30:09.979 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_bytes": 0, 2024-09-19T07:30:09.979 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_items": 0, 2024-09-19T07:30:09.979 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T07:30:09.979 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_mapping_items": 0, 2024-09-19T07:30:09.979 INFO:teuthology.orchestra.run.smithi148.stdout: "pgmap_bytes": 0, 2024-09-19T07:30:09.979 INFO:teuthology.orchestra.run.smithi148.stdout: "pgmap_items": 0, 2024-09-19T07:30:09.980 INFO:teuthology.orchestra.run.smithi148.stdout: "mds_co_bytes": 928, 2024-09-19T07:30:09.980 INFO:teuthology.orchestra.run.smithi148.stdout: "mds_co_items": 2, 2024-09-19T07:30:09.980 INFO:teuthology.orchestra.run.smithi148.stdout: "unittest_1_bytes": 0, 2024-09-19T07:30:09.980 INFO:teuthology.orchestra.run.smithi148.stdout: "unittest_1_items": 0, 2024-09-19T07:30:09.980 INFO:teuthology.orchestra.run.smithi148.stdout: "unittest_2_bytes": 0, 2024-09-19T07:30:09.980 INFO:teuthology.orchestra.run.smithi148.stdout: "unittest_2_items": 0 2024-09-19T07:30:09.980 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-19T07:30:09.980 INFO:teuthology.orchestra.run.smithi148.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T07:30:09.980 INFO:teuthology.orchestra.run.smithi148.stdout: "val": 0, 2024-09-19T07:30:09.980 INFO:teuthology.orchestra.run.smithi148.stdout: "max": 104857600, 2024-09-19T07:30:09.980 INFO:teuthology.orchestra.run.smithi148.stdout: "get_started": 0, 2024-09-19T07:30:09.980 INFO:teuthology.orchestra.run.smithi148.stdout: "get": 355, 2024-09-19T07:30:09.980 INFO:teuthology.orchestra.run.smithi148.stdout: "get_sum": 1436195, 2024-09-19T07:30:09.980 INFO:teuthology.orchestra.run.smithi148.stdout: "get_or_fail_fail": 0, 2024-09-19T07:30:09.981 INFO:teuthology.orchestra.run.smithi148.stdout: "get_or_fail_success": 355, 2024-09-19T07:30:09.981 INFO:teuthology.orchestra.run.smithi148.stdout: "take": 0, 2024-09-19T07:30:09.981 INFO:teuthology.orchestra.run.smithi148.stdout: "take_sum": 0, 2024-09-19T07:30:09.981 INFO:teuthology.orchestra.run.smithi148.stdout: "put": 355, 2024-09-19T07:30:09.981 INFO:teuthology.orchestra.run.smithi148.stdout: "put_sum": 1436195, 2024-09-19T07:30:09.981 INFO:teuthology.orchestra.run.smithi148.stdout: "wait": { 2024-09-19T07:30:09.981 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-19T07:30:09.981 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-19T07:30:09.981 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-19T07:30:09.981 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:09.981 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-19T07:30:09.981 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-19T07:30:10.831 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-19T07:30:10.832 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-19T07:30:10.832 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-09-19T07:30:10.832 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-09-19T07:30:10.832 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-09-19T07:30:10.832 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-09-19T07:30:10.832 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-09-19T07:30:10.832 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2024-09-19T07:30:10.832 DEBUG:tasks.check_counter:Getting stats from b 2024-09-19T07:30:10.832 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-19T07:30:11.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:10 smithi148 ceph-mon[31180]: pgmap v602: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 64 KiB/s wr, 31 op/s 2024-09-19T07:30:11.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:10 smithi165 ceph-mon[35326]: pgmap v602: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 64 KiB/s wr, 31 op/s 2024-09-19T07:30:11.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:10 smithi179 ceph-mon[35716]: pgmap v602: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 64 KiB/s wr, 31 op/s 2024-09-19T07:30:11.357 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T07:30:12.077 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-09-19T07:30:12.077 INFO:teuthology.orchestra.run.smithi165.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T07:30:12.078 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_messages": 68670, 2024-09-19T07:30:12.078 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_messages": 72313, 2024-09-19T07:30:12.078 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_bytes": 64671223, 2024-09-19T07:30:12.078 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_bytes": 365129336, 2024-09-19T07:30:12.078 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_created_connections": 10, 2024-09-19T07:30:12.078 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_active_connections": 5, 2024-09-19T07:30:12.078 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_total_time": 5.041280621, 2024-09-19T07:30:12.078 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_send_time": 2.119647671, 2024-09-19T07:30:12.078 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_recv_time": 2.135095431, 2024-09-19T07:30:12.078 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_fast_dispatch_time": 1.005743799, 2024-09-19T07:30:12.078 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:30:12.078 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 72311, 2024-09-19T07:30:12.079 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 15.694189833, 2024-09-19T07:30:12.079 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000217037 2024-09-19T07:30:12.079 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.079 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:30:12.079 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 87312, 2024-09-19T07:30:12.079 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.017102289, 2024-09-19T07:30:12.079 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000195 2024-09-19T07:30:12.079 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.079 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T07:30:12.079 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_encrypted_bytes": 500688 2024-09-19T07:30:12.079 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.079 INFO:teuthology.orchestra.run.smithi165.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T07:30:12.079 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_messages": 109716, 2024-09-19T07:30:12.079 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_messages": 143217, 2024-09-19T07:30:12.080 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_bytes": 61476079, 2024-09-19T07:30:12.080 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_bytes": 288444477, 2024-09-19T07:30:12.080 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_created_connections": 18, 2024-09-19T07:30:12.080 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_active_connections": 9, 2024-09-19T07:30:12.080 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_total_time": 7.196355252, 2024-09-19T07:30:12.080 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_send_time": 3.031341745, 2024-09-19T07:30:12.080 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_recv_time": 3.319713215, 2024-09-19T07:30:12.080 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_fast_dispatch_time": 1.198231295, 2024-09-19T07:30:12.080 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:30:12.080 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 143216, 2024-09-19T07:30:12.080 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 13.381005619, 2024-09-19T07:30:12.080 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000093432 2024-09-19T07:30:12.081 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.081 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:30:12.081 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 197465, 2024-09-19T07:30:12.081 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.032428200, 2024-09-19T07:30:12.081 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000164 2024-09-19T07:30:12.081 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.081 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_encrypted_bytes": 1666912, 2024-09-19T07:30:12.081 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_encrypted_bytes": 402640 2024-09-19T07:30:12.081 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.081 INFO:teuthology.orchestra.run.smithi165.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T07:30:12.081 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_messages": 415503, 2024-09-19T07:30:12.081 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_messages": 607007, 2024-09-19T07:30:12.082 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_bytes": 142059978, 2024-09-19T07:30:12.082 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_bytes": 623541370, 2024-09-19T07:30:12.082 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_created_connections": 20, 2024-09-19T07:30:12.082 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_active_connections": 5, 2024-09-19T07:30:12.082 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_total_time": 21.372487654, 2024-09-19T07:30:12.082 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_send_time": 9.008009795, 2024-09-19T07:30:12.082 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_recv_time": 16.504151625, 2024-09-19T07:30:12.082 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_fast_dispatch_time": 1.227304306, 2024-09-19T07:30:12.082 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:30:12.082 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 607005, 2024-09-19T07:30:12.082 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 56.801831841, 2024-09-19T07:30:12.082 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000093577 2024-09-19T07:30:12.082 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.083 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:30:12.083 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 823636, 2024-09-19T07:30:12.083 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.148342761, 2024-09-19T07:30:12.083 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000180 2024-09-19T07:30:12.083 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.083 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_encrypted_bytes": 8448, 2024-09-19T07:30:12.083 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_encrypted_bytes": 144912 2024-09-19T07:30:12.083 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.083 INFO:teuthology.orchestra.run.smithi165.stdout: "cct": { 2024-09-19T07:30:12.083 INFO:teuthology.orchestra.run.smithi165.stdout: "total_workers": 1, 2024-09-19T07:30:12.083 INFO:teuthology.orchestra.run.smithi165.stdout: "unhealthy_workers": 0 2024-09-19T07:30:12.083 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.083 INFO:teuthology.orchestra.run.smithi165.stdout: "finisher-MDSRank": { 2024-09-19T07:30:12.084 INFO:teuthology.orchestra.run.smithi165.stdout: "queue_len": 0, 2024-09-19T07:30:12.084 INFO:teuthology.orchestra.run.smithi165.stdout: "complete_latency": { 2024-09-19T07:30:12.084 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 17680, 2024-09-19T07:30:12.084 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 135.552570404, 2024-09-19T07:30:12.084 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.007667000 2024-09-19T07:30:12.084 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-19T07:30:12.084 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.085 INFO:teuthology.orchestra.run.smithi165.stdout: "finisher-PurgeQueue": { 2024-09-19T07:30:12.085 INFO:teuthology.orchestra.run.smithi165.stdout: "queue_len": 0, 2024-09-19T07:30:12.085 INFO:teuthology.orchestra.run.smithi165.stdout: "complete_latency": { 2024-09-19T07:30:12.085 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 82349, 2024-09-19T07:30:12.085 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 18.131398945, 2024-09-19T07:30:12.085 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000220177 2024-09-19T07:30:12.085 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-19T07:30:12.085 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.085 INFO:teuthology.orchestra.run.smithi165.stdout: "mds": { 2024-09-19T07:30:12.085 INFO:teuthology.orchestra.run.smithi165.stdout: "request": 244316, 2024-09-19T07:30:12.085 INFO:teuthology.orchestra.run.smithi165.stdout: "reply": 231036, 2024-09-19T07:30:12.085 INFO:teuthology.orchestra.run.smithi165.stdout: "reply_latency": { 2024-09-19T07:30:12.085 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 231036, 2024-09-19T07:30:12.086 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 4745.252611749, 2024-09-19T07:30:12.086 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.020539018 2024-09-19T07:30:12.086 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.086 INFO:teuthology.orchestra.run.smithi165.stdout: "slow_reply": 0, 2024-09-19T07:30:12.086 INFO:teuthology.orchestra.run.smithi165.stdout: "forward": 13221, 2024-09-19T07:30:12.086 INFO:teuthology.orchestra.run.smithi165.stdout: "dir_fetch_complete": 486, 2024-09-19T07:30:12.086 INFO:teuthology.orchestra.run.smithi165.stdout: "dir_fetch_keys": 0, 2024-09-19T07:30:12.086 INFO:teuthology.orchestra.run.smithi165.stdout: "dir_commit": 1660, 2024-09-19T07:30:12.086 INFO:teuthology.orchestra.run.smithi165.stdout: "dir_split": 105, 2024-09-19T07:30:12.086 INFO:teuthology.orchestra.run.smithi165.stdout: "dir_merge": 2, 2024-09-19T07:30:12.086 INFO:teuthology.orchestra.run.smithi165.stdout: "inodes": 101360, 2024-09-19T07:30:12.086 INFO:teuthology.orchestra.run.smithi165.stdout: "inodes_top": 20034, 2024-09-19T07:30:12.086 INFO:teuthology.orchestra.run.smithi165.stdout: "inodes_bottom": 81061, 2024-09-19T07:30:12.086 INFO:teuthology.orchestra.run.smithi165.stdout: "inodes_pin_tail": 265, 2024-09-19T07:30:12.087 INFO:teuthology.orchestra.run.smithi165.stdout: "inodes_pinned": 72739, 2024-09-19T07:30:12.087 INFO:teuthology.orchestra.run.smithi165.stdout: "inodes_expired": 55280, 2024-09-19T07:30:12.087 INFO:teuthology.orchestra.run.smithi165.stdout: "inodes_with_caps": 2, 2024-09-19T07:30:12.087 INFO:teuthology.orchestra.run.smithi165.stdout: "caps": 3, 2024-09-19T07:30:12.087 INFO:teuthology.orchestra.run.smithi165.stdout: "subtrees": 5, 2024-09-19T07:30:12.087 INFO:teuthology.orchestra.run.smithi165.stdout: "traverse": 410410, 2024-09-19T07:30:12.087 INFO:teuthology.orchestra.run.smithi165.stdout: "traverse_hit": 348736, 2024-09-19T07:30:12.087 INFO:teuthology.orchestra.run.smithi165.stdout: "traverse_forward": 13121, 2024-09-19T07:30:12.087 INFO:teuthology.orchestra.run.smithi165.stdout: "traverse_discover": 1217, 2024-09-19T07:30:12.087 INFO:teuthology.orchestra.run.smithi165.stdout: "traverse_dir_fetch": 42, 2024-09-19T07:30:12.087 INFO:teuthology.orchestra.run.smithi165.stdout: "traverse_remote_ino": 0, 2024-09-19T07:30:12.087 INFO:teuthology.orchestra.run.smithi165.stdout: "traverse_lock": 880, 2024-09-19T07:30:12.087 INFO:teuthology.orchestra.run.smithi165.stdout: "load_cent": 4401, 2024-09-19T07:30:12.088 INFO:teuthology.orchestra.run.smithi165.stdout: "q": 0, 2024-09-19T07:30:12.088 INFO:teuthology.orchestra.run.smithi165.stdout: "exported": 177, 2024-09-19T07:30:12.088 INFO:teuthology.orchestra.run.smithi165.stdout: "exported_inodes": 40938, 2024-09-19T07:30:12.088 INFO:teuthology.orchestra.run.smithi165.stdout: "imported": 192, 2024-09-19T07:30:12.088 INFO:teuthology.orchestra.run.smithi165.stdout: "imported_inodes": 103577, 2024-09-19T07:30:12.088 INFO:teuthology.orchestra.run.smithi165.stdout: "openino_dir_fetch": 0, 2024-09-19T07:30:12.088 INFO:teuthology.orchestra.run.smithi165.stdout: "openino_backtrace_fetch": 969, 2024-09-19T07:30:12.088 INFO:teuthology.orchestra.run.smithi165.stdout: "openino_peer_discover": 0, 2024-09-19T07:30:12.088 INFO:teuthology.orchestra.run.smithi165.stdout: "root_rfiles": 58682, 2024-09-19T07:30:12.088 INFO:teuthology.orchestra.run.smithi165.stdout: "root_rbytes": 1240435999, 2024-09-19T07:30:12.088 INFO:teuthology.orchestra.run.smithi165.stdout: "root_rsnaps": 6, 2024-09-19T07:30:12.088 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_backtrace_fetch": 969, 2024-09-19T07:30:12.088 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_set_tag": 0, 2024-09-19T07:30:12.089 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T07:30:12.089 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_inotable_repaired": 0, 2024-09-19T07:30:12.089 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_dir_inodes": 0, 2024-09-19T07:30:12.089 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T07:30:12.089 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T07:30:12.089 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_file_inodes": 969, 2024-09-19T07:30:12.089 INFO:teuthology.orchestra.run.smithi165.stdout: "handle_inode_file_caps": 623, 2024-09-19T07:30:12.089 INFO:teuthology.orchestra.run.smithi165.stdout: "ceph_cap_op_revoke": 83882, 2024-09-19T07:30:12.089 INFO:teuthology.orchestra.run.smithi165.stdout: "ceph_cap_op_grant": 102562, 2024-09-19T07:30:12.089 INFO:teuthology.orchestra.run.smithi165.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T07:30:12.089 INFO:teuthology.orchestra.run.smithi165.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T07:30:12.089 INFO:teuthology.orchestra.run.smithi165.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T07:30:12.089 INFO:teuthology.orchestra.run.smithi165.stdout: "handle_client_caps": 111966, 2024-09-19T07:30:12.089 INFO:teuthology.orchestra.run.smithi165.stdout: "handle_client_caps_dirty": 23681, 2024-09-19T07:30:12.090 INFO:teuthology.orchestra.run.smithi165.stdout: "handle_client_cap_release": 5355, 2024-09-19T07:30:12.090 INFO:teuthology.orchestra.run.smithi165.stdout: "process_request_cap_release": 77966 2024-09-19T07:30:12.090 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.090 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_cache": { 2024-09-19T07:30:12.090 INFO:teuthology.orchestra.run.smithi165.stdout: "dir_update": 5142, 2024-09-19T07:30:12.090 INFO:teuthology.orchestra.run.smithi165.stdout: "dir_update_receipt": 5311, 2024-09-19T07:30:12.090 INFO:teuthology.orchestra.run.smithi165.stdout: "dir_try_discover": 3227, 2024-09-19T07:30:12.090 INFO:teuthology.orchestra.run.smithi165.stdout: "dir_send_discover": 4871, 2024-09-19T07:30:12.090 INFO:teuthology.orchestra.run.smithi165.stdout: "dir_handle_discover": 6705, 2024-09-19T07:30:12.090 INFO:teuthology.orchestra.run.smithi165.stdout: "num_strays": 295, 2024-09-19T07:30:12.090 INFO:teuthology.orchestra.run.smithi165.stdout: "num_strays_delayed": 0, 2024-09-19T07:30:12.090 INFO:teuthology.orchestra.run.smithi165.stdout: "num_strays_enqueuing": 0, 2024-09-19T07:30:12.090 INFO:teuthology.orchestra.run.smithi165.stdout: "strays_created": 48768, 2024-09-19T07:30:12.091 INFO:teuthology.orchestra.run.smithi165.stdout: "strays_enqueued": 48475, 2024-09-19T07:30:12.091 INFO:teuthology.orchestra.run.smithi165.stdout: "strays_reintegrated": 0, 2024-09-19T07:30:12.091 INFO:teuthology.orchestra.run.smithi165.stdout: "strays_migrated": 0, 2024-09-19T07:30:12.091 INFO:teuthology.orchestra.run.smithi165.stdout: "num_recovering_processing": 0, 2024-09-19T07:30:12.091 INFO:teuthology.orchestra.run.smithi165.stdout: "num_recovering_enqueued": 0, 2024-09-19T07:30:12.091 INFO:teuthology.orchestra.run.smithi165.stdout: "num_recovering_prioritized": 0, 2024-09-19T07:30:12.091 INFO:teuthology.orchestra.run.smithi165.stdout: "recovery_started": 0, 2024-09-19T07:30:12.091 INFO:teuthology.orchestra.run.smithi165.stdout: "recovery_completed": 0, 2024-09-19T07:30:12.091 INFO:teuthology.orchestra.run.smithi165.stdout: "ireq_quiesce_path": 15, 2024-09-19T07:30:12.091 INFO:teuthology.orchestra.run.smithi165.stdout: "ireq_quiesce_inode": 235183, 2024-09-19T07:30:12.091 INFO:teuthology.orchestra.run.smithi165.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T07:30:12.091 INFO:teuthology.orchestra.run.smithi165.stdout: "ireq_exportdir": 179, 2024-09-19T07:30:12.091 INFO:teuthology.orchestra.run.smithi165.stdout: "ireq_flush": 0, 2024-09-19T07:30:12.091 INFO:teuthology.orchestra.run.smithi165.stdout: "ireq_fragmentdir": 110, 2024-09-19T07:30:12.092 INFO:teuthology.orchestra.run.smithi165.stdout: "ireq_fragstats": 0, 2024-09-19T07:30:12.092 INFO:teuthology.orchestra.run.smithi165.stdout: "ireq_inodestats": 0 2024-09-19T07:30:12.092 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.092 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_log": { 2024-09-19T07:30:12.092 INFO:teuthology.orchestra.run.smithi165.stdout: "evlrg": 9, 2024-09-19T07:30:12.092 INFO:teuthology.orchestra.run.smithi165.stdout: "evadd": 194978, 2024-09-19T07:30:12.092 INFO:teuthology.orchestra.run.smithi165.stdout: "evex": 113104, 2024-09-19T07:30:12.092 INFO:teuthology.orchestra.run.smithi165.stdout: "evtrm": 110611, 2024-09-19T07:30:12.092 INFO:teuthology.orchestra.run.smithi165.stdout: "ev": 84367, 2024-09-19T07:30:12.092 INFO:teuthology.orchestra.run.smithi165.stdout: "evexg": 0, 2024-09-19T07:30:12.092 INFO:teuthology.orchestra.run.smithi165.stdout: "evexd": 2493, 2024-09-19T07:30:12.092 INFO:teuthology.orchestra.run.smithi165.stdout: "segadd": 288, 2024-09-19T07:30:12.092 INFO:teuthology.orchestra.run.smithi165.stdout: "segex": 160, 2024-09-19T07:30:12.092 INFO:teuthology.orchestra.run.smithi165.stdout: "segtrm": 156, 2024-09-19T07:30:12.093 INFO:teuthology.orchestra.run.smithi165.stdout: "seg": 132, 2024-09-19T07:30:12.093 INFO:teuthology.orchestra.run.smithi165.stdout: "segmjr": 7, 2024-09-19T07:30:12.093 INFO:teuthology.orchestra.run.smithi165.stdout: "segexg": 0, 2024-09-19T07:30:12.093 INFO:teuthology.orchestra.run.smithi165.stdout: "segexd": 4, 2024-09-19T07:30:12.093 INFO:teuthology.orchestra.run.smithi165.stdout: "expos": 328857269, 2024-09-19T07:30:12.093 INFO:teuthology.orchestra.run.smithi165.stdout: "wrpos": 852322779, 2024-09-19T07:30:12.093 INFO:teuthology.orchestra.run.smithi165.stdout: "rdpos": 0, 2024-09-19T07:30:12.093 INFO:teuthology.orchestra.run.smithi165.stdout: "jlat": { 2024-09-19T07:30:12.093 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 10779, 2024-09-19T07:30:12.093 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 538.677630082, 2024-09-19T07:30:12.093 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.049974731 2024-09-19T07:30:12.093 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.093 INFO:teuthology.orchestra.run.smithi165.stdout: "replayed": 0 2024-09-19T07:30:12.094 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.094 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_mem": { 2024-09-19T07:30:12.094 INFO:teuthology.orchestra.run.smithi165.stdout: "ino": 57139, 2024-09-19T07:30:12.094 INFO:teuthology.orchestra.run.smithi165.stdout: "ino+": 140744, 2024-09-19T07:30:12.094 INFO:teuthology.orchestra.run.smithi165.stdout: "ino-": 83605, 2024-09-19T07:30:12.094 INFO:teuthology.orchestra.run.smithi165.stdout: "dir": 1997, 2024-09-19T07:30:12.094 INFO:teuthology.orchestra.run.smithi165.stdout: "dir+": 5265, 2024-09-19T07:30:12.094 INFO:teuthology.orchestra.run.smithi165.stdout: "dir-": 3268, 2024-09-19T07:30:12.094 INFO:teuthology.orchestra.run.smithi165.stdout: "dn": 101360, 2024-09-19T07:30:12.094 INFO:teuthology.orchestra.run.smithi165.stdout: "dn+": 239360, 2024-09-19T07:30:12.094 INFO:teuthology.orchestra.run.smithi165.stdout: "dn-": 138000, 2024-09-19T07:30:12.094 INFO:teuthology.orchestra.run.smithi165.stdout: "cap": 3, 2024-09-19T07:30:12.094 INFO:teuthology.orchestra.run.smithi165.stdout: "cap+": 81639, 2024-09-19T07:30:12.095 INFO:teuthology.orchestra.run.smithi165.stdout: "cap-": 81636, 2024-09-19T07:30:12.095 INFO:teuthology.orchestra.run.smithi165.stdout: "rss": 392428, 2024-09-19T07:30:12.095 INFO:teuthology.orchestra.run.smithi165.stdout: "heap": 223520 2024-09-19T07:30:12.095 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.095 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_server": { 2024-09-19T07:30:12.095 INFO:teuthology.orchestra.run.smithi165.stdout: "dispatch_client_request": 263903, 2024-09-19T07:30:12.095 INFO:teuthology.orchestra.run.smithi165.stdout: "dispatch_server_request": 4682, 2024-09-19T07:30:12.095 INFO:teuthology.orchestra.run.smithi165.stdout: "handle_client_request": 244316, 2024-09-19T07:30:12.095 INFO:teuthology.orchestra.run.smithi165.stdout: "handle_client_session": 353, 2024-09-19T07:30:12.095 INFO:teuthology.orchestra.run.smithi165.stdout: "handle_peer_request": 12328, 2024-09-19T07:30:12.095 INFO:teuthology.orchestra.run.smithi165.stdout: "req_create_latency": { 2024-09-19T07:30:12.095 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 18920, 2024-09-19T07:30:12.095 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 331.428938630, 2024-09-19T07:30:12.095 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.017517385 2024-09-19T07:30:12.096 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.096 INFO:teuthology.orchestra.run.smithi165.stdout: "req_getattr_latency": { 2024-09-19T07:30:12.096 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 4622, 2024-09-19T07:30:12.096 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 565.474234739, 2024-09-19T07:30:12.096 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.122344057 2024-09-19T07:30:12.096 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.096 INFO:teuthology.orchestra.run.smithi165.stdout: "req_getfilelock_latency": { 2024-09-19T07:30:12.096 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:12.096 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:12.096 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:12.096 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.096 INFO:teuthology.orchestra.run.smithi165.stdout: "req_link_latency": { 2024-09-19T07:30:12.096 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:12.097 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:12.097 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:12.097 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.097 INFO:teuthology.orchestra.run.smithi165.stdout: "req_lookup_latency": { 2024-09-19T07:30:12.097 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 127174, 2024-09-19T07:30:12.097 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 3033.368750436, 2024-09-19T07:30:12.097 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.023852114 2024-09-19T07:30:12.097 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.097 INFO:teuthology.orchestra.run.smithi165.stdout: "req_lookuphash_latency": { 2024-09-19T07:30:12.097 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:12.097 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:12.097 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:12.097 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.098 INFO:teuthology.orchestra.run.smithi165.stdout: "req_lookupino_latency": { 2024-09-19T07:30:12.098 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 1, 2024-09-19T07:30:12.098 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000146043, 2024-09-19T07:30:12.098 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000146043 2024-09-19T07:30:12.098 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.098 INFO:teuthology.orchestra.run.smithi165.stdout: "req_lookupname_latency": { 2024-09-19T07:30:12.098 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:12.098 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:12.098 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:12.098 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.098 INFO:teuthology.orchestra.run.smithi165.stdout: "req_lookupparent_latency": { 2024-09-19T07:30:12.098 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:12.098 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:12.098 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:12.099 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.099 INFO:teuthology.orchestra.run.smithi165.stdout: "req_lookupsnap_latency": { 2024-09-19T07:30:12.099 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:12.099 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:12.100 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:12.100 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.100 INFO:teuthology.orchestra.run.smithi165.stdout: "req_lssnap_latency": { 2024-09-19T07:30:12.100 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:12.100 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:12.100 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:12.100 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.100 INFO:teuthology.orchestra.run.smithi165.stdout: "req_mkdir_latency": { 2024-09-19T07:30:12.100 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 95, 2024-09-19T07:30:12.100 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 29.024289881, 2024-09-19T07:30:12.100 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.305518840 2024-09-19T07:30:12.100 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.100 INFO:teuthology.orchestra.run.smithi165.stdout: "req_mknod_latency": { 2024-09-19T07:30:12.100 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:12.101 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:12.101 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:12.101 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.101 INFO:teuthology.orchestra.run.smithi165.stdout: "req_mksnap_latency": { 2024-09-19T07:30:12.101 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:12.101 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:12.101 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:12.101 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.101 INFO:teuthology.orchestra.run.smithi165.stdout: "req_open_latency": { 2024-09-19T07:30:12.101 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 14875, 2024-09-19T07:30:12.101 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 125.727565523, 2024-09-19T07:30:12.101 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.008452273 2024-09-19T07:30:12.101 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.102 INFO:teuthology.orchestra.run.smithi165.stdout: "req_readdir_latency": { 2024-09-19T07:30:12.102 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 2127, 2024-09-19T07:30:12.102 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 5.063864231, 2024-09-19T07:30:12.102 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.002380754 2024-09-19T07:30:12.102 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.102 INFO:teuthology.orchestra.run.smithi165.stdout: "req_rename_latency": { 2024-09-19T07:30:12.102 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 18910, 2024-09-19T07:30:12.102 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 476.067427855, 2024-09-19T07:30:12.102 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.025175432 2024-09-19T07:30:12.102 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.102 INFO:teuthology.orchestra.run.smithi165.stdout: "req_renamesnap_latency": { 2024-09-19T07:30:12.102 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:12.102 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:12.102 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:12.103 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.103 INFO:teuthology.orchestra.run.smithi165.stdout: "req_snapdiff_latency": { 2024-09-19T07:30:12.103 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:12.103 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:12.103 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:12.103 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.103 INFO:teuthology.orchestra.run.smithi165.stdout: "req_rmdir_latency": { 2024-09-19T07:30:12.103 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 315, 2024-09-19T07:30:12.103 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 49.937557836, 2024-09-19T07:30:12.103 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.158531929 2024-09-19T07:30:12.103 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.103 INFO:teuthology.orchestra.run.smithi165.stdout: "req_rmsnap_latency": { 2024-09-19T07:30:12.103 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:12.104 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:12.104 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:12.104 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.104 INFO:teuthology.orchestra.run.smithi165.stdout: "req_rmxattr_latency": { 2024-09-19T07:30:12.104 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:12.104 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:12.104 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:12.104 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.104 INFO:teuthology.orchestra.run.smithi165.stdout: "req_setattr_latency": { 2024-09-19T07:30:12.104 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:12.104 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:12.104 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:12.105 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.105 INFO:teuthology.orchestra.run.smithi165.stdout: "req_setdirlayout_latency": { 2024-09-19T07:30:12.105 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:12.105 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:12.105 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:12.105 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.105 INFO:teuthology.orchestra.run.smithi165.stdout: "req_setfilelock_latency": { 2024-09-19T07:30:12.105 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:12.105 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:12.105 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:12.105 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.105 INFO:teuthology.orchestra.run.smithi165.stdout: "req_setlayout_latency": { 2024-09-19T07:30:12.105 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:12.106 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:12.106 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:12.106 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.106 INFO:teuthology.orchestra.run.smithi165.stdout: "req_setxattr_latency": { 2024-09-19T07:30:12.106 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:12.106 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:12.106 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:12.106 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.106 INFO:teuthology.orchestra.run.smithi165.stdout: "req_symlink_latency": { 2024-09-19T07:30:12.106 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:12.106 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:12.106 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:12.106 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.106 INFO:teuthology.orchestra.run.smithi165.stdout: "req_unlink_latency": { 2024-09-19T07:30:12.107 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 43997, 2024-09-19T07:30:12.107 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 129.159836575, 2024-09-19T07:30:12.107 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.002935650 2024-09-19T07:30:12.107 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.107 INFO:teuthology.orchestra.run.smithi165.stdout: "cap_revoke_eviction": 0, 2024-09-19T07:30:12.107 INFO:teuthology.orchestra.run.smithi165.stdout: "cap_acquisition_throttle": 0, 2024-09-19T07:30:12.107 INFO:teuthology.orchestra.run.smithi165.stdout: "req_getvxattr_latency": { 2024-09-19T07:30:12.107 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:12.107 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:12.107 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:12.107 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-19T07:30:12.107 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.108 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_sessions": { 2024-09-19T07:30:12.108 INFO:teuthology.orchestra.run.smithi165.stdout: "session_count": 2, 2024-09-19T07:30:12.108 INFO:teuthology.orchestra.run.smithi165.stdout: "session_add": 5, 2024-09-19T07:30:12.108 INFO:teuthology.orchestra.run.smithi165.stdout: "session_remove": 3, 2024-09-19T07:30:12.108 INFO:teuthology.orchestra.run.smithi165.stdout: "sessions_open": 2, 2024-09-19T07:30:12.108 INFO:teuthology.orchestra.run.smithi165.stdout: "sessions_stale": 0, 2024-09-19T07:30:12.108 INFO:teuthology.orchestra.run.smithi165.stdout: "total_load": 23483, 2024-09-19T07:30:12.108 INFO:teuthology.orchestra.run.smithi165.stdout: "average_load": 11741, 2024-09-19T07:30:12.108 INFO:teuthology.orchestra.run.smithi165.stdout: "avg_session_uptime": 1116, 2024-09-19T07:30:12.108 INFO:teuthology.orchestra.run.smithi165.stdout: "mdthresh_evicted": 0 2024-09-19T07:30:12.108 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.108 INFO:teuthology.orchestra.run.smithi165.stdout: "mempool": { 2024-09-19T07:30:12.108 INFO:teuthology.orchestra.run.smithi165.stdout: "bloom_filter_bytes": 0, 2024-09-19T07:30:12.108 INFO:teuthology.orchestra.run.smithi165.stdout: "bloom_filter_items": 0, 2024-09-19T07:30:12.109 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T07:30:12.109 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_alloc_items": 0, 2024-09-19T07:30:12.109 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T07:30:12.109 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_data_items": 0, 2024-09-19T07:30:12.109 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T07:30:12.109 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T07:30:12.109 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T07:30:12.109 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T07:30:12.109 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T07:30:12.109 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_other_items": 0, 2024-09-19T07:30:12.109 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T07:30:12.109 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T07:30:12.109 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_extent_bytes": 0, 2024-09-19T07:30:12.110 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_extent_items": 0, 2024-09-19T07:30:12.110 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_blob_bytes": 0, 2024-09-19T07:30:12.110 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_blob_items": 0, 2024-09-19T07:30:12.110 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T07:30:12.110 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T07:30:12.110 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T07:30:12.110 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T07:30:12.110 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T07:30:12.110 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_fsck_items": 0, 2024-09-19T07:30:12.110 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_txc_bytes": 0, 2024-09-19T07:30:12.110 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_txc_items": 0, 2024-09-19T07:30:12.110 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T07:30:12.110 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T07:30:12.111 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_writing_bytes": 0, 2024-09-19T07:30:12.111 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_writing_items": 0, 2024-09-19T07:30:12.111 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_bytes": 0, 2024-09-19T07:30:12.111 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_items": 0, 2024-09-19T07:30:12.111 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T07:30:12.111 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_file_reader_items": 0, 2024-09-19T07:30:12.111 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T07:30:12.111 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_file_writer_items": 0, 2024-09-19T07:30:12.111 INFO:teuthology.orchestra.run.smithi165.stdout: "buffer_anon_bytes": 4764018, 2024-09-19T07:30:12.111 INFO:teuthology.orchestra.run.smithi165.stdout: "buffer_anon_items": 56469, 2024-09-19T07:30:12.111 INFO:teuthology.orchestra.run.smithi165.stdout: "buffer_meta_bytes": 0, 2024-09-19T07:30:12.111 INFO:teuthology.orchestra.run.smithi165.stdout: "buffer_meta_items": 0, 2024-09-19T07:30:12.111 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_bytes": 0, 2024-09-19T07:30:12.112 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_items": 0, 2024-09-19T07:30:12.112 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_mapbl_bytes": 0, 2024-09-19T07:30:12.112 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_mapbl_items": 0, 2024-09-19T07:30:12.112 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pglog_bytes": 0, 2024-09-19T07:30:12.112 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pglog_items": 0, 2024-09-19T07:30:12.112 INFO:teuthology.orchestra.run.smithi165.stdout: "osdmap_bytes": 8344, 2024-09-19T07:30:12.112 INFO:teuthology.orchestra.run.smithi165.stdout: "osdmap_items": 185, 2024-09-19T07:30:12.112 INFO:teuthology.orchestra.run.smithi165.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T07:30:12.112 INFO:teuthology.orchestra.run.smithi165.stdout: "osdmap_mapping_items": 0, 2024-09-19T07:30:12.112 INFO:teuthology.orchestra.run.smithi165.stdout: "pgmap_bytes": 0, 2024-09-19T07:30:12.112 INFO:teuthology.orchestra.run.smithi165.stdout: "pgmap_items": 0, 2024-09-19T07:30:12.112 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_co_bytes": 207115153, 2024-09-19T07:30:12.112 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_co_items": 2026149, 2024-09-19T07:30:12.113 INFO:teuthology.orchestra.run.smithi165.stdout: "unittest_1_bytes": 0, 2024-09-19T07:30:12.113 INFO:teuthology.orchestra.run.smithi165.stdout: "unittest_1_items": 0, 2024-09-19T07:30:12.113 INFO:teuthology.orchestra.run.smithi165.stdout: "unittest_2_bytes": 0, 2024-09-19T07:30:12.113 INFO:teuthology.orchestra.run.smithi165.stdout: "unittest_2_items": 0 2024-09-19T07:30:12.113 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.113 INFO:teuthology.orchestra.run.smithi165.stdout: "objecter": { 2024-09-19T07:30:12.113 INFO:teuthology.orchestra.run.smithi165.stdout: "op_active": 0, 2024-09-19T07:30:12.113 INFO:teuthology.orchestra.run.smithi165.stdout: "op_laggy": 0, 2024-09-19T07:30:12.113 INFO:teuthology.orchestra.run.smithi165.stdout: "op_send": 70088, 2024-09-19T07:30:12.113 INFO:teuthology.orchestra.run.smithi165.stdout: "op_send_bytes": 890398720, 2024-09-19T07:30:12.113 INFO:teuthology.orchestra.run.smithi165.stdout: "op_resend": 29, 2024-09-19T07:30:12.113 INFO:teuthology.orchestra.run.smithi165.stdout: "op_reply": 70088, 2024-09-19T07:30:12.113 INFO:teuthology.orchestra.run.smithi165.stdout: "op_latency": { 2024-09-19T07:30:12.114 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 70088, 2024-09-19T07:30:12.114 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 1950.323618974, 2024-09-19T07:30:12.114 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.027826783 2024-09-19T07:30:12.114 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.114 INFO:teuthology.orchestra.run.smithi165.stdout: "op_inflight": 0, 2024-09-19T07:30:12.114 INFO:teuthology.orchestra.run.smithi165.stdout: "oplen_avg": { 2024-09-19T07:30:12.114 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 70088, 2024-09-19T07:30:12.114 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 83598 2024-09-19T07:30:12.114 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.114 INFO:teuthology.orchestra.run.smithi165.stdout: "op": 70088, 2024-09-19T07:30:12.114 INFO:teuthology.orchestra.run.smithi165.stdout: "op_r": 2289, 2024-09-19T07:30:12.114 INFO:teuthology.orchestra.run.smithi165.stdout: "op_w": 67799, 2024-09-19T07:30:12.114 INFO:teuthology.orchestra.run.smithi165.stdout: "op_rmw": 0, 2024-09-19T07:30:12.114 INFO:teuthology.orchestra.run.smithi165.stdout: "op_pg": 0, 2024-09-19T07:30:12.115 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_stat": 700, 2024-09-19T07:30:12.115 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_create": 4477, 2024-09-19T07:30:12.115 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_read": 834, 2024-09-19T07:30:12.115 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_write": 11616, 2024-09-19T07:30:12.115 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_writefull": 443, 2024-09-19T07:30:12.115 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_writesame": 0, 2024-09-19T07:30:12.115 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_append": 0, 2024-09-19T07:30:12.115 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_zero": 2, 2024-09-19T07:30:12.115 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_truncate": 105, 2024-09-19T07:30:12.115 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_delete": 48926, 2024-09-19T07:30:12.115 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_mapext": 0, 2024-09-19T07:30:12.115 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_sparse_read": 0, 2024-09-19T07:30:12.115 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_clonerange": 0, 2024-09-19T07:30:12.115 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_getxattr": 978, 2024-09-19T07:30:12.116 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_setxattr": 8954, 2024-09-19T07:30:12.116 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_cmpxattr": 0, 2024-09-19T07:30:12.116 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_rmxattr": 0, 2024-09-19T07:30:12.116 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_resetxattrs": 0, 2024-09-19T07:30:12.116 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_call": 0, 2024-09-19T07:30:12.116 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_watch": 0, 2024-09-19T07:30:12.116 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_notify": 0, 2024-09-19T07:30:12.116 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T07:30:12.116 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_pgls": 0, 2024-09-19T07:30:12.116 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_pgls_filter": 0, 2024-09-19T07:30:12.116 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_other": 0, 2024-09-19T07:30:12.116 INFO:teuthology.orchestra.run.smithi165.stdout: "linger_active": 0, 2024-09-19T07:30:12.116 INFO:teuthology.orchestra.run.smithi165.stdout: "linger_send": 0, 2024-09-19T07:30:12.117 INFO:teuthology.orchestra.run.smithi165.stdout: "linger_resend": 0, 2024-09-19T07:30:12.117 INFO:teuthology.orchestra.run.smithi165.stdout: "linger_ping": 0, 2024-09-19T07:30:12.117 INFO:teuthology.orchestra.run.smithi165.stdout: "poolop_active": 0, 2024-09-19T07:30:12.117 INFO:teuthology.orchestra.run.smithi165.stdout: "poolop_send": 0, 2024-09-19T07:30:12.117 INFO:teuthology.orchestra.run.smithi165.stdout: "poolop_resend": 0, 2024-09-19T07:30:12.117 INFO:teuthology.orchestra.run.smithi165.stdout: "poolstat_active": 0, 2024-09-19T07:30:12.117 INFO:teuthology.orchestra.run.smithi165.stdout: "poolstat_send": 0, 2024-09-19T07:30:12.117 INFO:teuthology.orchestra.run.smithi165.stdout: "poolstat_resend": 0, 2024-09-19T07:30:12.117 INFO:teuthology.orchestra.run.smithi165.stdout: "statfs_active": 0, 2024-09-19T07:30:12.117 INFO:teuthology.orchestra.run.smithi165.stdout: "statfs_send": 0, 2024-09-19T07:30:12.117 INFO:teuthology.orchestra.run.smithi165.stdout: "statfs_resend": 0, 2024-09-19T07:30:12.117 INFO:teuthology.orchestra.run.smithi165.stdout: "command_active": 0, 2024-09-19T07:30:12.117 INFO:teuthology.orchestra.run.smithi165.stdout: "command_send": 0, 2024-09-19T07:30:12.118 INFO:teuthology.orchestra.run.smithi165.stdout: "command_resend": 0, 2024-09-19T07:30:12.118 INFO:teuthology.orchestra.run.smithi165.stdout: "map_epoch": 107, 2024-09-19T07:30:12.118 INFO:teuthology.orchestra.run.smithi165.stdout: "map_full": 0, 2024-09-19T07:30:12.118 INFO:teuthology.orchestra.run.smithi165.stdout: "map_inc": 29, 2024-09-19T07:30:12.118 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_sessions": 12, 2024-09-19T07:30:12.118 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_session_open": 12, 2024-09-19T07:30:12.118 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_session_close": 0, 2024-09-19T07:30:12.118 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_laggy": 0, 2024-09-19T07:30:12.118 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_wr": 4391, 2024-09-19T07:30:12.118 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_rd": 972, 2024-09-19T07:30:12.118 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_del": 1200 2024-09-19T07:30:12.118 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.118 INFO:teuthology.orchestra.run.smithi165.stdout: "oft": { 2024-09-19T07:30:12.118 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_total_objs": 1, 2024-09-19T07:30:12.119 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_total_kv_pairs": 0, 2024-09-19T07:30:12.119 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_total_updates": 0, 2024-09-19T07:30:12.119 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_total_removes": 0 2024-09-19T07:30:12.119 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.119 INFO:teuthology.orchestra.run.smithi165.stdout: "osd-slow-ops": { 2024-09-19T07:30:12.119 INFO:teuthology.orchestra.run.smithi165.stdout: "slow_ops_count": 235139 2024-09-19T07:30:12.119 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.119 INFO:teuthology.orchestra.run.smithi165.stdout: "purge_queue": { 2024-09-19T07:30:12.119 INFO:teuthology.orchestra.run.smithi165.stdout: "pq_executing_ops": 0, 2024-09-19T07:30:12.119 INFO:teuthology.orchestra.run.smithi165.stdout: "pq_executing_ops_high_water": 18, 2024-09-19T07:30:12.119 INFO:teuthology.orchestra.run.smithi165.stdout: "pq_executing": 0, 2024-09-19T07:30:12.119 INFO:teuthology.orchestra.run.smithi165.stdout: "pq_executing_high_water": 10, 2024-09-19T07:30:12.119 INFO:teuthology.orchestra.run.smithi165.stdout: "pq_executed_ops": 48619, 2024-09-19T07:30:12.119 INFO:teuthology.orchestra.run.smithi165.stdout: "pq_executed": 48475, 2024-09-19T07:30:12.120 INFO:teuthology.orchestra.run.smithi165.stdout: "pq_item_in_journal": 0 2024-09-19T07:30:12.120 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.120 INFO:teuthology.orchestra.run.smithi165.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T07:30:12.120 INFO:teuthology.orchestra.run.smithi165.stdout: "val": 0, 2024-09-19T07:30:12.120 INFO:teuthology.orchestra.run.smithi165.stdout: "max": 104857600, 2024-09-19T07:30:12.120 INFO:teuthology.orchestra.run.smithi165.stdout: "get_started": 0, 2024-09-19T07:30:12.120 INFO:teuthology.orchestra.run.smithi165.stdout: "get": 593885, 2024-09-19T07:30:12.120 INFO:teuthology.orchestra.run.smithi165.stdout: "get_sum": 214730774, 2024-09-19T07:30:12.120 INFO:teuthology.orchestra.run.smithi165.stdout: "get_or_fail_fail": 0, 2024-09-19T07:30:12.120 INFO:teuthology.orchestra.run.smithi165.stdout: "get_or_fail_success": 593885, 2024-09-19T07:30:12.120 INFO:teuthology.orchestra.run.smithi165.stdout: "take": 0, 2024-09-19T07:30:12.120 INFO:teuthology.orchestra.run.smithi165.stdout: "take_sum": 0, 2024-09-19T07:30:12.120 INFO:teuthology.orchestra.run.smithi165.stdout: "put": 593885, 2024-09-19T07:30:12.121 INFO:teuthology.orchestra.run.smithi165.stdout: "put_sum": 214730774, 2024-09-19T07:30:12.121 INFO:teuthology.orchestra.run.smithi165.stdout: "wait": { 2024-09-19T07:30:12.121 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:12.121 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:12.121 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:12.121 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-19T07:30:12.121 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.121 INFO:teuthology.orchestra.run.smithi165.stdout: "throttle-objecter_bytes": { 2024-09-19T07:30:12.121 INFO:teuthology.orchestra.run.smithi165.stdout: "val": 0, 2024-09-19T07:30:12.121 INFO:teuthology.orchestra.run.smithi165.stdout: "max": 104857600, 2024-09-19T07:30:12.121 INFO:teuthology.orchestra.run.smithi165.stdout: "get_started": 0, 2024-09-19T07:30:12.121 INFO:teuthology.orchestra.run.smithi165.stdout: "get": 0, 2024-09-19T07:30:12.121 INFO:teuthology.orchestra.run.smithi165.stdout: "get_sum": 0, 2024-09-19T07:30:12.122 INFO:teuthology.orchestra.run.smithi165.stdout: "get_or_fail_fail": 0, 2024-09-19T07:30:12.122 INFO:teuthology.orchestra.run.smithi165.stdout: "get_or_fail_success": 0, 2024-09-19T07:30:12.122 INFO:teuthology.orchestra.run.smithi165.stdout: "take": 70088, 2024-09-19T07:30:12.122 INFO:teuthology.orchestra.run.smithi165.stdout: "take_sum": 897432751, 2024-09-19T07:30:12.122 INFO:teuthology.orchestra.run.smithi165.stdout: "put": 70088, 2024-09-19T07:30:12.122 INFO:teuthology.orchestra.run.smithi165.stdout: "put_sum": 897432751, 2024-09-19T07:30:12.122 INFO:teuthology.orchestra.run.smithi165.stdout: "wait": { 2024-09-19T07:30:12.122 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:12.122 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:12.122 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:12.122 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-19T07:30:12.122 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.122 INFO:teuthology.orchestra.run.smithi165.stdout: "throttle-objecter_ops": { 2024-09-19T07:30:12.123 INFO:teuthology.orchestra.run.smithi165.stdout: "val": 0, 2024-09-19T07:30:12.123 INFO:teuthology.orchestra.run.smithi165.stdout: "max": 1024, 2024-09-19T07:30:12.123 INFO:teuthology.orchestra.run.smithi165.stdout: "get_started": 0, 2024-09-19T07:30:12.123 INFO:teuthology.orchestra.run.smithi165.stdout: "get": 0, 2024-09-19T07:30:12.123 INFO:teuthology.orchestra.run.smithi165.stdout: "get_sum": 0, 2024-09-19T07:30:12.123 INFO:teuthology.orchestra.run.smithi165.stdout: "get_or_fail_fail": 0, 2024-09-19T07:30:12.123 INFO:teuthology.orchestra.run.smithi165.stdout: "get_or_fail_success": 0, 2024-09-19T07:30:12.123 INFO:teuthology.orchestra.run.smithi165.stdout: "take": 70088, 2024-09-19T07:30:12.123 INFO:teuthology.orchestra.run.smithi165.stdout: "take_sum": 70088, 2024-09-19T07:30:12.123 INFO:teuthology.orchestra.run.smithi165.stdout: "put": 70088, 2024-09-19T07:30:12.123 INFO:teuthology.orchestra.run.smithi165.stdout: "put_sum": 70088, 2024-09-19T07:30:12.123 INFO:teuthology.orchestra.run.smithi165.stdout: "wait": { 2024-09-19T07:30:12.123 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:12.123 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:12.124 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:12.124 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-19T07:30:12.124 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.124 INFO:teuthology.orchestra.run.smithi165.stdout: "throttle-write_buf_throttle": { 2024-09-19T07:30:12.124 INFO:teuthology.orchestra.run.smithi165.stdout: "val": 0, 2024-09-19T07:30:12.124 INFO:teuthology.orchestra.run.smithi165.stdout: "max": 3758096384, 2024-09-19T07:30:12.124 INFO:teuthology.orchestra.run.smithi165.stdout: "get_started": 0, 2024-09-19T07:30:12.124 INFO:teuthology.orchestra.run.smithi165.stdout: "get": 48475, 2024-09-19T07:30:12.124 INFO:teuthology.orchestra.run.smithi165.stdout: "get_sum": 7041807, 2024-09-19T07:30:12.124 INFO:teuthology.orchestra.run.smithi165.stdout: "get_or_fail_fail": 0, 2024-09-19T07:30:12.124 INFO:teuthology.orchestra.run.smithi165.stdout: "get_or_fail_success": 48475, 2024-09-19T07:30:12.124 INFO:teuthology.orchestra.run.smithi165.stdout: "take": 0, 2024-09-19T07:30:12.124 INFO:teuthology.orchestra.run.smithi165.stdout: "take_sum": 0, 2024-09-19T07:30:12.124 INFO:teuthology.orchestra.run.smithi165.stdout: "put": 834, 2024-09-19T07:30:12.125 INFO:teuthology.orchestra.run.smithi165.stdout: "put_sum": 7041807, 2024-09-19T07:30:12.125 INFO:teuthology.orchestra.run.smithi165.stdout: "wait": { 2024-09-19T07:30:12.125 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:12.125 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:12.125 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:12.125 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-19T07:30:12.125 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:12.125 INFO:teuthology.orchestra.run.smithi165.stdout: "throttle-write_buf_throttle-0x561fb0dd2960": { 2024-09-19T07:30:12.125 INFO:teuthology.orchestra.run.smithi165.stdout: "val": 0, 2024-09-19T07:30:12.125 INFO:teuthology.orchestra.run.smithi165.stdout: "max": 3758096384, 2024-09-19T07:30:12.125 INFO:teuthology.orchestra.run.smithi165.stdout: "get_started": 0, 2024-09-19T07:30:12.125 INFO:teuthology.orchestra.run.smithi165.stdout: "get": 194978, 2024-09-19T07:30:12.125 INFO:teuthology.orchestra.run.smithi165.stdout: "get_sum": 848128475, 2024-09-19T07:30:12.125 INFO:teuthology.orchestra.run.smithi165.stdout: "get_or_fail_fail": 0, 2024-09-19T07:30:12.126 INFO:teuthology.orchestra.run.smithi165.stdout: "get_or_fail_success": 194978, 2024-09-19T07:30:12.126 INFO:teuthology.orchestra.run.smithi165.stdout: "take": 0, 2024-09-19T07:30:12.126 INFO:teuthology.orchestra.run.smithi165.stdout: "take_sum": 0, 2024-09-19T07:30:12.126 INFO:teuthology.orchestra.run.smithi165.stdout: "put": 10779, 2024-09-19T07:30:12.126 INFO:teuthology.orchestra.run.smithi165.stdout: "put_sum": 848128475, 2024-09-19T07:30:12.126 INFO:teuthology.orchestra.run.smithi165.stdout: "wait": { 2024-09-19T07:30:12.126 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:12.126 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:12.126 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:12.126 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-19T07:30:12.126 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-19T07:30:12.126 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-09-19T07:30:13.101 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:12 smithi165 ceph-mon[35326]: pgmap v603: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 65 KiB/s wr, 35 op/s 2024-09-19T07:30:13.108 INFO:tasks.check_counter:Daemon mds.b mds.exported=177 2024-09-19T07:30:13.108 INFO:tasks.check_counter:Daemon mds.b mds.imported=192 2024-09-19T07:30:13.108 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=5142 2024-09-19T07:30:13.108 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=5311 2024-09-19T07:30:13.108 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-09-19T07:30:13.109 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=0 2024-09-19T07:30:13.109 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T07:30:13.109 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=105 2024-09-19T07:30:13.109 DEBUG:tasks.check_counter:Getting stats from e 2024-09-19T07:30:13.109 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-19T07:30:13.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:12 smithi179 ceph-mon[35716]: pgmap v603: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 65 KiB/s wr, 35 op/s 2024-09-19T07:30:13.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:12 smithi148 ceph-mon[31180]: pgmap v603: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 65 KiB/s wr, 35 op/s 2024-09-19T07:30:13.593 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T07:30:14.293 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-09-19T07:30:14.293 INFO:teuthology.orchestra.run.smithi165.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T07:30:14.293 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_messages": 375, 2024-09-19T07:30:14.293 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_messages": 377, 2024-09-19T07:30:14.294 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_bytes": 88193711, 2024-09-19T07:30:14.294 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_bytes": 119256, 2024-09-19T07:30:14.294 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_created_connections": 8, 2024-09-19T07:30:14.294 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_active_connections": 4, 2024-09-19T07:30:14.294 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_total_time": 0.079598143, 2024-09-19T07:30:14.294 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_send_time": 0.007237929, 2024-09-19T07:30:14.294 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_recv_time": 0.059930219, 2024-09-19T07:30:14.294 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_fast_dispatch_time": 0.008930265, 2024-09-19T07:30:14.294 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:30:14.294 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 375, 2024-09-19T07:30:14.294 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.012922960, 2024-09-19T07:30:14.294 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000034461 2024-09-19T07:30:14.294 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.295 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:30:14.295 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:14.295 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:14.295 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:14.295 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.295 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T07:30:14.295 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T07:30:14.295 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.295 INFO:teuthology.orchestra.run.smithi165.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T07:30:14.295 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_messages": 1664, 2024-09-19T07:30:14.295 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_messages": 1835, 2024-09-19T07:30:14.295 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_bytes": 76026161, 2024-09-19T07:30:14.295 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_bytes": 922839, 2024-09-19T07:30:14.296 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_created_connections": 7, 2024-09-19T07:30:14.296 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_active_connections": 6, 2024-09-19T07:30:14.296 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_total_time": 0.186447906, 2024-09-19T07:30:14.296 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_send_time": 0.054749051, 2024-09-19T07:30:14.296 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_recv_time": 0.075306900, 2024-09-19T07:30:14.296 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_fast_dispatch_time": 0.043327700, 2024-09-19T07:30:14.296 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:30:14.296 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 1834, 2024-09-19T07:30:14.296 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.115685208, 2024-09-19T07:30:14.296 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000063078 2024-09-19T07:30:14.296 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.296 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:30:14.296 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:14.297 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:14.297 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:14.297 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.297 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_encrypted_bytes": 3184, 2024-09-19T07:30:14.297 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_encrypted_bytes": 395216 2024-09-19T07:30:14.297 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.297 INFO:teuthology.orchestra.run.smithi165.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T07:30:14.297 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_messages": 1375, 2024-09-19T07:30:14.297 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_messages": 1354, 2024-09-19T07:30:14.297 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_bytes": 93690681, 2024-09-19T07:30:14.297 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_bytes": 494316, 2024-09-19T07:30:14.297 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_created_connections": 5, 2024-09-19T07:30:14.297 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_active_connections": 4, 2024-09-19T07:30:14.298 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_total_time": 0.162733941, 2024-09-19T07:30:14.298 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_send_time": 0.039726007, 2024-09-19T07:30:14.298 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_recv_time": 0.090041750, 2024-09-19T07:30:14.298 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_fast_dispatch_time": 0.029042557, 2024-09-19T07:30:14.298 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:30:14.298 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 1353, 2024-09-19T07:30:14.298 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.050221468, 2024-09-19T07:30:14.298 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000037118 2024-09-19T07:30:14.298 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.298 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:30:14.298 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:14.298 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:14.298 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:14.299 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.299 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_encrypted_bytes": 323824, 2024-09-19T07:30:14.299 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_encrypted_bytes": 146096 2024-09-19T07:30:14.299 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.299 INFO:teuthology.orchestra.run.smithi165.stdout: "cct": { 2024-09-19T07:30:14.299 INFO:teuthology.orchestra.run.smithi165.stdout: "total_workers": 1, 2024-09-19T07:30:14.299 INFO:teuthology.orchestra.run.smithi165.stdout: "unhealthy_workers": 0 2024-09-19T07:30:14.299 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.299 INFO:teuthology.orchestra.run.smithi165.stdout: "finisher-MDSRank": { 2024-09-19T07:30:14.299 INFO:teuthology.orchestra.run.smithi165.stdout: "queue_len": 0, 2024-09-19T07:30:14.299 INFO:teuthology.orchestra.run.smithi165.stdout: "complete_latency": { 2024-09-19T07:30:14.299 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 5043, 2024-09-19T07:30:14.299 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.551042868, 2024-09-19T07:30:14.300 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000109268 2024-09-19T07:30:14.300 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-19T07:30:14.300 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.300 INFO:teuthology.orchestra.run.smithi165.stdout: "finisher-PurgeQueue": { 2024-09-19T07:30:14.300 INFO:teuthology.orchestra.run.smithi165.stdout: "queue_len": 0, 2024-09-19T07:30:14.300 INFO:teuthology.orchestra.run.smithi165.stdout: "complete_latency": { 2024-09-19T07:30:14.300 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:14.300 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:14.300 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:14.300 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-19T07:30:14.300 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.300 INFO:teuthology.orchestra.run.smithi165.stdout: "mds": { 2024-09-19T07:30:14.300 INFO:teuthology.orchestra.run.smithi165.stdout: "request": 0, 2024-09-19T07:30:14.301 INFO:teuthology.orchestra.run.smithi165.stdout: "reply": 0, 2024-09-19T07:30:14.301 INFO:teuthology.orchestra.run.smithi165.stdout: "reply_latency": { 2024-09-19T07:30:14.301 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:14.301 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:14.301 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:14.301 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.301 INFO:teuthology.orchestra.run.smithi165.stdout: "slow_reply": 0, 2024-09-19T07:30:14.301 INFO:teuthology.orchestra.run.smithi165.stdout: "forward": 0, 2024-09-19T07:30:14.301 INFO:teuthology.orchestra.run.smithi165.stdout: "dir_fetch_complete": 0, 2024-09-19T07:30:14.301 INFO:teuthology.orchestra.run.smithi165.stdout: "dir_fetch_keys": 0, 2024-09-19T07:30:14.301 INFO:teuthology.orchestra.run.smithi165.stdout: "dir_commit": 0, 2024-09-19T07:30:14.301 INFO:teuthology.orchestra.run.smithi165.stdout: "dir_split": 0, 2024-09-19T07:30:14.301 INFO:teuthology.orchestra.run.smithi165.stdout: "dir_merge": 0, 2024-09-19T07:30:14.302 INFO:teuthology.orchestra.run.smithi165.stdout: "inodes": 26023, 2024-09-19T07:30:14.302 INFO:teuthology.orchestra.run.smithi165.stdout: "inodes_top": 18168, 2024-09-19T07:30:14.302 INFO:teuthology.orchestra.run.smithi165.stdout: "inodes_bottom": 7855, 2024-09-19T07:30:14.302 INFO:teuthology.orchestra.run.smithi165.stdout: "inodes_pin_tail": 0, 2024-09-19T07:30:14.302 INFO:teuthology.orchestra.run.smithi165.stdout: "inodes_pinned": 68, 2024-09-19T07:30:14.302 INFO:teuthology.orchestra.run.smithi165.stdout: "inodes_expired": 0, 2024-09-19T07:30:14.302 INFO:teuthology.orchestra.run.smithi165.stdout: "inodes_with_caps": 0, 2024-09-19T07:30:14.302 INFO:teuthology.orchestra.run.smithi165.stdout: "caps": 0, 2024-09-19T07:30:14.302 INFO:teuthology.orchestra.run.smithi165.stdout: "subtrees": 3, 2024-09-19T07:30:14.302 INFO:teuthology.orchestra.run.smithi165.stdout: "traverse": 0, 2024-09-19T07:30:14.302 INFO:teuthology.orchestra.run.smithi165.stdout: "traverse_hit": 0, 2024-09-19T07:30:14.302 INFO:teuthology.orchestra.run.smithi165.stdout: "traverse_forward": 0, 2024-09-19T07:30:14.302 INFO:teuthology.orchestra.run.smithi165.stdout: "traverse_discover": 0, 2024-09-19T07:30:14.303 INFO:teuthology.orchestra.run.smithi165.stdout: "traverse_dir_fetch": 0, 2024-09-19T07:30:14.303 INFO:teuthology.orchestra.run.smithi165.stdout: "traverse_remote_ino": 0, 2024-09-19T07:30:14.303 INFO:teuthology.orchestra.run.smithi165.stdout: "traverse_lock": 0, 2024-09-19T07:30:14.303 INFO:teuthology.orchestra.run.smithi165.stdout: "load_cent": 0, 2024-09-19T07:30:14.303 INFO:teuthology.orchestra.run.smithi165.stdout: "q": 0, 2024-09-19T07:30:14.303 INFO:teuthology.orchestra.run.smithi165.stdout: "exported": 0, 2024-09-19T07:30:14.303 INFO:teuthology.orchestra.run.smithi165.stdout: "exported_inodes": 0, 2024-09-19T07:30:14.303 INFO:teuthology.orchestra.run.smithi165.stdout: "imported": 0, 2024-09-19T07:30:14.303 INFO:teuthology.orchestra.run.smithi165.stdout: "imported_inodes": 0, 2024-09-19T07:30:14.303 INFO:teuthology.orchestra.run.smithi165.stdout: "openino_dir_fetch": 0, 2024-09-19T07:30:14.303 INFO:teuthology.orchestra.run.smithi165.stdout: "openino_backtrace_fetch": 0, 2024-09-19T07:30:14.303 INFO:teuthology.orchestra.run.smithi165.stdout: "openino_peer_discover": 0, 2024-09-19T07:30:14.303 INFO:teuthology.orchestra.run.smithi165.stdout: "root_rfiles": 4, 2024-09-19T07:30:14.304 INFO:teuthology.orchestra.run.smithi165.stdout: "root_rbytes": 234, 2024-09-19T07:30:14.304 INFO:teuthology.orchestra.run.smithi165.stdout: "root_rsnaps": 6, 2024-09-19T07:30:14.304 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T07:30:14.304 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_set_tag": 0, 2024-09-19T07:30:14.304 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T07:30:14.304 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_inotable_repaired": 0, 2024-09-19T07:30:14.304 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_dir_inodes": 0, 2024-09-19T07:30:14.304 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T07:30:14.304 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T07:30:14.304 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_file_inodes": 0, 2024-09-19T07:30:14.304 INFO:teuthology.orchestra.run.smithi165.stdout: "handle_inode_file_caps": 0, 2024-09-19T07:30:14.304 INFO:teuthology.orchestra.run.smithi165.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T07:30:14.304 INFO:teuthology.orchestra.run.smithi165.stdout: "ceph_cap_op_grant": 0, 2024-09-19T07:30:14.304 INFO:teuthology.orchestra.run.smithi165.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T07:30:14.305 INFO:teuthology.orchestra.run.smithi165.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T07:30:14.305 INFO:teuthology.orchestra.run.smithi165.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T07:30:14.305 INFO:teuthology.orchestra.run.smithi165.stdout: "handle_client_caps": 0, 2024-09-19T07:30:14.305 INFO:teuthology.orchestra.run.smithi165.stdout: "handle_client_caps_dirty": 0, 2024-09-19T07:30:14.305 INFO:teuthology.orchestra.run.smithi165.stdout: "handle_client_cap_release": 0, 2024-09-19T07:30:14.305 INFO:teuthology.orchestra.run.smithi165.stdout: "process_request_cap_release": 0 2024-09-19T07:30:14.305 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.305 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_cache": { 2024-09-19T07:30:14.305 INFO:teuthology.orchestra.run.smithi165.stdout: "dir_update": 0, 2024-09-19T07:30:14.305 INFO:teuthology.orchestra.run.smithi165.stdout: "dir_update_receipt": 0, 2024-09-19T07:30:14.305 INFO:teuthology.orchestra.run.smithi165.stdout: "dir_try_discover": 0, 2024-09-19T07:30:14.305 INFO:teuthology.orchestra.run.smithi165.stdout: "dir_send_discover": 0, 2024-09-19T07:30:14.305 INFO:teuthology.orchestra.run.smithi165.stdout: "dir_handle_discover": 0, 2024-09-19T07:30:14.306 INFO:teuthology.orchestra.run.smithi165.stdout: "num_strays": 0, 2024-09-19T07:30:14.306 INFO:teuthology.orchestra.run.smithi165.stdout: "num_strays_delayed": 0, 2024-09-19T07:30:14.306 INFO:teuthology.orchestra.run.smithi165.stdout: "num_strays_enqueuing": 0, 2024-09-19T07:30:14.306 INFO:teuthology.orchestra.run.smithi165.stdout: "strays_created": 0, 2024-09-19T07:30:14.306 INFO:teuthology.orchestra.run.smithi165.stdout: "strays_enqueued": 0, 2024-09-19T07:30:14.306 INFO:teuthology.orchestra.run.smithi165.stdout: "strays_reintegrated": 0, 2024-09-19T07:30:14.306 INFO:teuthology.orchestra.run.smithi165.stdout: "strays_migrated": 0, 2024-09-19T07:30:14.306 INFO:teuthology.orchestra.run.smithi165.stdout: "num_recovering_processing": 0, 2024-09-19T07:30:14.306 INFO:teuthology.orchestra.run.smithi165.stdout: "num_recovering_enqueued": 0, 2024-09-19T07:30:14.306 INFO:teuthology.orchestra.run.smithi165.stdout: "num_recovering_prioritized": 0, 2024-09-19T07:30:14.306 INFO:teuthology.orchestra.run.smithi165.stdout: "recovery_started": 0, 2024-09-19T07:30:14.306 INFO:teuthology.orchestra.run.smithi165.stdout: "recovery_completed": 0, 2024-09-19T07:30:14.306 INFO:teuthology.orchestra.run.smithi165.stdout: "ireq_quiesce_path": 0, 2024-09-19T07:30:14.306 INFO:teuthology.orchestra.run.smithi165.stdout: "ireq_quiesce_inode": 0, 2024-09-19T07:30:14.307 INFO:teuthology.orchestra.run.smithi165.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T07:30:14.307 INFO:teuthology.orchestra.run.smithi165.stdout: "ireq_exportdir": 0, 2024-09-19T07:30:14.307 INFO:teuthology.orchestra.run.smithi165.stdout: "ireq_flush": 0, 2024-09-19T07:30:14.307 INFO:teuthology.orchestra.run.smithi165.stdout: "ireq_fragmentdir": 0, 2024-09-19T07:30:14.307 INFO:teuthology.orchestra.run.smithi165.stdout: "ireq_fragstats": 0, 2024-09-19T07:30:14.307 INFO:teuthology.orchestra.run.smithi165.stdout: "ireq_inodestats": 0 2024-09-19T07:30:14.307 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.307 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_log": { 2024-09-19T07:30:14.307 INFO:teuthology.orchestra.run.smithi165.stdout: "evlrg": 0, 2024-09-19T07:30:14.307 INFO:teuthology.orchestra.run.smithi165.stdout: "evadd": 0, 2024-09-19T07:30:14.307 INFO:teuthology.orchestra.run.smithi165.stdout: "evex": 0, 2024-09-19T07:30:14.307 INFO:teuthology.orchestra.run.smithi165.stdout: "evtrm": 0, 2024-09-19T07:30:14.307 INFO:teuthology.orchestra.run.smithi165.stdout: "ev": 78162, 2024-09-19T07:30:14.308 INFO:teuthology.orchestra.run.smithi165.stdout: "evexg": 0, 2024-09-19T07:30:14.308 INFO:teuthology.orchestra.run.smithi165.stdout: "evexd": 0, 2024-09-19T07:30:14.308 INFO:teuthology.orchestra.run.smithi165.stdout: "segadd": 0, 2024-09-19T07:30:14.308 INFO:teuthology.orchestra.run.smithi165.stdout: "segex": 0, 2024-09-19T07:30:14.308 INFO:teuthology.orchestra.run.smithi165.stdout: "segtrm": 0, 2024-09-19T07:30:14.308 INFO:teuthology.orchestra.run.smithi165.stdout: "seg": 2, 2024-09-19T07:30:14.308 INFO:teuthology.orchestra.run.smithi165.stdout: "segmjr": 61, 2024-09-19T07:30:14.308 INFO:teuthology.orchestra.run.smithi165.stdout: "segexg": 0, 2024-09-19T07:30:14.308 INFO:teuthology.orchestra.run.smithi165.stdout: "segexd": 0, 2024-09-19T07:30:14.308 INFO:teuthology.orchestra.run.smithi165.stdout: "expos": 492014251, 2024-09-19T07:30:14.308 INFO:teuthology.orchestra.run.smithi165.stdout: "wrpos": 492067462, 2024-09-19T07:30:14.308 INFO:teuthology.orchestra.run.smithi165.stdout: "rdpos": 492050755, 2024-09-19T07:30:14.308 INFO:teuthology.orchestra.run.smithi165.stdout: "jlat": { 2024-09-19T07:30:14.309 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:14.309 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:14.309 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:14.309 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.309 INFO:teuthology.orchestra.run.smithi165.stdout: "replayed": 78162 2024-09-19T07:30:14.309 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.309 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_mem": { 2024-09-19T07:30:14.309 INFO:teuthology.orchestra.run.smithi165.stdout: "ino": 8048, 2024-09-19T07:30:14.309 INFO:teuthology.orchestra.run.smithi165.stdout: "ino+": 60894, 2024-09-19T07:30:14.309 INFO:teuthology.orchestra.run.smithi165.stdout: "ino-": 52846, 2024-09-19T07:30:14.309 INFO:teuthology.orchestra.run.smithi165.stdout: "dir": 379, 2024-09-19T07:30:14.309 INFO:teuthology.orchestra.run.smithi165.stdout: "dir+": 2156, 2024-09-19T07:30:14.309 INFO:teuthology.orchestra.run.smithi165.stdout: "dir-": 1777, 2024-09-19T07:30:14.309 INFO:teuthology.orchestra.run.smithi165.stdout: "dn": 26023, 2024-09-19T07:30:14.310 INFO:teuthology.orchestra.run.smithi165.stdout: "dn+": 90572, 2024-09-19T07:30:14.310 INFO:teuthology.orchestra.run.smithi165.stdout: "dn-": 64549, 2024-09-19T07:30:14.310 INFO:teuthology.orchestra.run.smithi165.stdout: "cap": 0, 2024-09-19T07:30:14.310 INFO:teuthology.orchestra.run.smithi165.stdout: "cap+": 0, 2024-09-19T07:30:14.310 INFO:teuthology.orchestra.run.smithi165.stdout: "cap-": 0, 2024-09-19T07:30:14.310 INFO:teuthology.orchestra.run.smithi165.stdout: "rss": 99976, 2024-09-19T07:30:14.310 INFO:teuthology.orchestra.run.smithi165.stdout: "heap": 215328 2024-09-19T07:30:14.310 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.310 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_server": { 2024-09-19T07:30:14.310 INFO:teuthology.orchestra.run.smithi165.stdout: "dispatch_client_request": 0, 2024-09-19T07:30:14.310 INFO:teuthology.orchestra.run.smithi165.stdout: "dispatch_server_request": 0, 2024-09-19T07:30:14.310 INFO:teuthology.orchestra.run.smithi165.stdout: "handle_client_request": 0, 2024-09-19T07:30:14.310 INFO:teuthology.orchestra.run.smithi165.stdout: "handle_client_session": 0, 2024-09-19T07:30:14.310 INFO:teuthology.orchestra.run.smithi165.stdout: "handle_peer_request": 0, 2024-09-19T07:30:14.311 INFO:teuthology.orchestra.run.smithi165.stdout: "req_create_latency": { 2024-09-19T07:30:14.311 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:14.311 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:14.311 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:14.311 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.311 INFO:teuthology.orchestra.run.smithi165.stdout: "req_getattr_latency": { 2024-09-19T07:30:14.311 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:14.311 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:14.311 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:14.311 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.311 INFO:teuthology.orchestra.run.smithi165.stdout: "req_getfilelock_latency": { 2024-09-19T07:30:14.311 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:14.311 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:14.311 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:14.312 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.312 INFO:teuthology.orchestra.run.smithi165.stdout: "req_link_latency": { 2024-09-19T07:30:14.312 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:14.312 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:14.312 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:14.312 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.312 INFO:teuthology.orchestra.run.smithi165.stdout: "req_lookup_latency": { 2024-09-19T07:30:14.312 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:14.312 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:14.312 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:14.312 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.312 INFO:teuthology.orchestra.run.smithi165.stdout: "req_lookuphash_latency": { 2024-09-19T07:30:14.313 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:14.313 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:14.313 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:14.313 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.313 INFO:teuthology.orchestra.run.smithi165.stdout: "req_lookupino_latency": { 2024-09-19T07:30:14.313 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:14.313 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:14.313 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:14.313 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.313 INFO:teuthology.orchestra.run.smithi165.stdout: "req_lookupname_latency": { 2024-09-19T07:30:14.313 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:14.313 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:14.313 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:14.314 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.314 INFO:teuthology.orchestra.run.smithi165.stdout: "req_lookupparent_latency": { 2024-09-19T07:30:14.314 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:14.314 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:14.314 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:14.314 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.314 INFO:teuthology.orchestra.run.smithi165.stdout: "req_lookupsnap_latency": { 2024-09-19T07:30:14.314 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:14.314 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:14.314 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:14.314 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.314 INFO:teuthology.orchestra.run.smithi165.stdout: "req_lssnap_latency": { 2024-09-19T07:30:14.314 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:14.314 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:14.315 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:14.315 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.315 INFO:teuthology.orchestra.run.smithi165.stdout: "req_mkdir_latency": { 2024-09-19T07:30:14.315 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:14.315 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:14.315 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:14.316 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.316 INFO:teuthology.orchestra.run.smithi165.stdout: "req_mknod_latency": { 2024-09-19T07:30:14.316 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:14.316 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:14.316 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:14.316 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.316 INFO:teuthology.orchestra.run.smithi165.stdout: "req_mksnap_latency": { 2024-09-19T07:30:14.316 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:14.316 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:14.316 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:14.316 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.316 INFO:teuthology.orchestra.run.smithi165.stdout: "req_open_latency": { 2024-09-19T07:30:14.316 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:14.317 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:14.317 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:14.317 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.317 INFO:teuthology.orchestra.run.smithi165.stdout: "req_readdir_latency": { 2024-09-19T07:30:14.317 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:14.317 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:14.317 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:14.317 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.317 INFO:teuthology.orchestra.run.smithi165.stdout: "req_rename_latency": { 2024-09-19T07:30:14.317 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:14.317 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:14.317 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:14.318 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.318 INFO:teuthology.orchestra.run.smithi165.stdout: "req_renamesnap_latency": { 2024-09-19T07:30:14.318 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:14.318 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:14.318 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:14.318 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.318 INFO:teuthology.orchestra.run.smithi165.stdout: "req_snapdiff_latency": { 2024-09-19T07:30:14.318 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:14.318 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:14.318 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:14.318 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.318 INFO:teuthology.orchestra.run.smithi165.stdout: "req_rmdir_latency": { 2024-09-19T07:30:14.318 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:14.319 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:14.319 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:14.319 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.319 INFO:teuthology.orchestra.run.smithi165.stdout: "req_rmsnap_latency": { 2024-09-19T07:30:14.319 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:14.319 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:14.319 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:14.319 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.319 INFO:teuthology.orchestra.run.smithi165.stdout: "req_rmxattr_latency": { 2024-09-19T07:30:14.319 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:14.319 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:14.319 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:14.319 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.319 INFO:teuthology.orchestra.run.smithi165.stdout: "req_setattr_latency": { 2024-09-19T07:30:14.320 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:14.320 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:14.320 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:14.320 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.320 INFO:teuthology.orchestra.run.smithi165.stdout: "req_setdirlayout_latency": { 2024-09-19T07:30:14.320 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:14.320 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:14.320 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:14.320 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.320 INFO:teuthology.orchestra.run.smithi165.stdout: "req_setfilelock_latency": { 2024-09-19T07:30:14.320 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:14.320 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:14.321 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:14.321 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.321 INFO:teuthology.orchestra.run.smithi165.stdout: "req_setlayout_latency": { 2024-09-19T07:30:14.321 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:14.321 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:14.321 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:14.321 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.321 INFO:teuthology.orchestra.run.smithi165.stdout: "req_setxattr_latency": { 2024-09-19T07:30:14.321 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:14.321 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:14.321 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:14.321 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.321 INFO:teuthology.orchestra.run.smithi165.stdout: "req_symlink_latency": { 2024-09-19T07:30:14.321 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:14.322 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:14.322 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:14.322 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.322 INFO:teuthology.orchestra.run.smithi165.stdout: "req_unlink_latency": { 2024-09-19T07:30:14.322 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:14.322 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:14.322 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:14.322 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.322 INFO:teuthology.orchestra.run.smithi165.stdout: "cap_revoke_eviction": 0, 2024-09-19T07:30:14.322 INFO:teuthology.orchestra.run.smithi165.stdout: "cap_acquisition_throttle": 0, 2024-09-19T07:30:14.322 INFO:teuthology.orchestra.run.smithi165.stdout: "req_getvxattr_latency": { 2024-09-19T07:30:14.322 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:14.322 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:14.323 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:14.323 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-19T07:30:14.323 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.323 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_sessions": { 2024-09-19T07:30:14.323 INFO:teuthology.orchestra.run.smithi165.stdout: "session_count": 2, 2024-09-19T07:30:14.323 INFO:teuthology.orchestra.run.smithi165.stdout: "session_add": 2, 2024-09-19T07:30:14.323 INFO:teuthology.orchestra.run.smithi165.stdout: "session_remove": 0, 2024-09-19T07:30:14.323 INFO:teuthology.orchestra.run.smithi165.stdout: "sessions_open": 0, 2024-09-19T07:30:14.323 INFO:teuthology.orchestra.run.smithi165.stdout: "sessions_stale": 0, 2024-09-19T07:30:14.323 INFO:teuthology.orchestra.run.smithi165.stdout: "total_load": 0, 2024-09-19T07:30:14.323 INFO:teuthology.orchestra.run.smithi165.stdout: "average_load": 0, 2024-09-19T07:30:14.323 INFO:teuthology.orchestra.run.smithi165.stdout: "avg_session_uptime": 2363, 2024-09-19T07:30:14.323 INFO:teuthology.orchestra.run.smithi165.stdout: "mdthresh_evicted": 0 2024-09-19T07:30:14.324 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.324 INFO:teuthology.orchestra.run.smithi165.stdout: "mempool": { 2024-09-19T07:30:14.324 INFO:teuthology.orchestra.run.smithi165.stdout: "bloom_filter_bytes": 0, 2024-09-19T07:30:14.324 INFO:teuthology.orchestra.run.smithi165.stdout: "bloom_filter_items": 0, 2024-09-19T07:30:14.324 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T07:30:14.324 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_alloc_items": 0, 2024-09-19T07:30:14.324 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T07:30:14.324 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_data_items": 0, 2024-09-19T07:30:14.324 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T07:30:14.324 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T07:30:14.324 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T07:30:14.324 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T07:30:14.324 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T07:30:14.324 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_other_items": 0, 2024-09-19T07:30:14.325 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T07:30:14.325 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T07:30:14.325 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_extent_bytes": 0, 2024-09-19T07:30:14.325 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_extent_items": 0, 2024-09-19T07:30:14.325 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_blob_bytes": 0, 2024-09-19T07:30:14.325 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_blob_items": 0, 2024-09-19T07:30:14.325 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T07:30:14.325 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T07:30:14.325 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T07:30:14.325 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T07:30:14.325 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T07:30:14.325 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_fsck_items": 0, 2024-09-19T07:30:14.325 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_txc_bytes": 0, 2024-09-19T07:30:14.326 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_txc_items": 0, 2024-09-19T07:30:14.326 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T07:30:14.326 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T07:30:14.326 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_writing_bytes": 0, 2024-09-19T07:30:14.326 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_writing_items": 0, 2024-09-19T07:30:14.326 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_bytes": 0, 2024-09-19T07:30:14.326 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_items": 0, 2024-09-19T07:30:14.326 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T07:30:14.326 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_file_reader_items": 0, 2024-09-19T07:30:14.326 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T07:30:14.326 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_file_writer_items": 0, 2024-09-19T07:30:14.326 INFO:teuthology.orchestra.run.smithi165.stdout: "buffer_anon_bytes": 542084, 2024-09-19T07:30:14.326 INFO:teuthology.orchestra.run.smithi165.stdout: "buffer_anon_items": 8277, 2024-09-19T07:30:14.327 INFO:teuthology.orchestra.run.smithi165.stdout: "buffer_meta_bytes": 0, 2024-09-19T07:30:14.327 INFO:teuthology.orchestra.run.smithi165.stdout: "buffer_meta_items": 0, 2024-09-19T07:30:14.327 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_bytes": 0, 2024-09-19T07:30:14.327 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_items": 0, 2024-09-19T07:30:14.327 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_mapbl_bytes": 0, 2024-09-19T07:30:14.327 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_mapbl_items": 0, 2024-09-19T07:30:14.327 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pglog_bytes": 0, 2024-09-19T07:30:14.327 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pglog_items": 0, 2024-09-19T07:30:14.327 INFO:teuthology.orchestra.run.smithi165.stdout: "osdmap_bytes": 8344, 2024-09-19T07:30:14.327 INFO:teuthology.orchestra.run.smithi165.stdout: "osdmap_items": 185, 2024-09-19T07:30:14.327 INFO:teuthology.orchestra.run.smithi165.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T07:30:14.327 INFO:teuthology.orchestra.run.smithi165.stdout: "osdmap_mapping_items": 0, 2024-09-19T07:30:14.327 INFO:teuthology.orchestra.run.smithi165.stdout: "pgmap_bytes": 0, 2024-09-19T07:30:14.327 INFO:teuthology.orchestra.run.smithi165.stdout: "pgmap_items": 0, 2024-09-19T07:30:14.328 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_co_bytes": 37275701, 2024-09-19T07:30:14.328 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_co_items": 298138, 2024-09-19T07:30:14.328 INFO:teuthology.orchestra.run.smithi165.stdout: "unittest_1_bytes": 0, 2024-09-19T07:30:14.328 INFO:teuthology.orchestra.run.smithi165.stdout: "unittest_1_items": 0, 2024-09-19T07:30:14.328 INFO:teuthology.orchestra.run.smithi165.stdout: "unittest_2_bytes": 0, 2024-09-19T07:30:14.328 INFO:teuthology.orchestra.run.smithi165.stdout: "unittest_2_items": 0 2024-09-19T07:30:14.328 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.328 INFO:teuthology.orchestra.run.smithi165.stdout: "objecter": { 2024-09-19T07:30:14.328 INFO:teuthology.orchestra.run.smithi165.stdout: "op_active": 0, 2024-09-19T07:30:14.328 INFO:teuthology.orchestra.run.smithi165.stdout: "op_laggy": 0, 2024-09-19T07:30:14.328 INFO:teuthology.orchestra.run.smithi165.stdout: "op_send": 3129, 2024-09-19T07:30:14.328 INFO:teuthology.orchestra.run.smithi165.stdout: "op_send_bytes": 26, 2024-09-19T07:30:14.328 INFO:teuthology.orchestra.run.smithi165.stdout: "op_resend": 4, 2024-09-19T07:30:14.329 INFO:teuthology.orchestra.run.smithi165.stdout: "op_reply": 3129, 2024-09-19T07:30:14.329 INFO:teuthology.orchestra.run.smithi165.stdout: "op_latency": { 2024-09-19T07:30:14.329 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 3129, 2024-09-19T07:30:14.329 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 15.961749542, 2024-09-19T07:30:14.329 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.005101230 2024-09-19T07:30:14.329 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.329 INFO:teuthology.orchestra.run.smithi165.stdout: "op_inflight": 0, 2024-09-19T07:30:14.329 INFO:teuthology.orchestra.run.smithi165.stdout: "oplen_avg": { 2024-09-19T07:30:14.329 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 3129, 2024-09-19T07:30:14.329 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 3130 2024-09-19T07:30:14.329 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.329 INFO:teuthology.orchestra.run.smithi165.stdout: "op": 3129, 2024-09-19T07:30:14.329 INFO:teuthology.orchestra.run.smithi165.stdout: "op_r": 3129, 2024-09-19T07:30:14.329 INFO:teuthology.orchestra.run.smithi165.stdout: "op_w": 0, 2024-09-19T07:30:14.330 INFO:teuthology.orchestra.run.smithi165.stdout: "op_rmw": 0, 2024-09-19T07:30:14.330 INFO:teuthology.orchestra.run.smithi165.stdout: "op_pg": 0, 2024-09-19T07:30:14.330 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_stat": 1901, 2024-09-19T07:30:14.330 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_create": 0, 2024-09-19T07:30:14.330 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_read": 1225, 2024-09-19T07:30:14.330 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_write": 0, 2024-09-19T07:30:14.330 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_writefull": 0, 2024-09-19T07:30:14.330 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_writesame": 0, 2024-09-19T07:30:14.330 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_append": 0, 2024-09-19T07:30:14.330 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_zero": 0, 2024-09-19T07:30:14.330 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_truncate": 0, 2024-09-19T07:30:14.330 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_delete": 0, 2024-09-19T07:30:14.330 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_mapext": 0, 2024-09-19T07:30:14.330 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_sparse_read": 0, 2024-09-19T07:30:14.331 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_clonerange": 0, 2024-09-19T07:30:14.331 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_getxattr": 2, 2024-09-19T07:30:14.331 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_setxattr": 0, 2024-09-19T07:30:14.331 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_cmpxattr": 0, 2024-09-19T07:30:14.331 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_rmxattr": 0, 2024-09-19T07:30:14.331 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_resetxattrs": 0, 2024-09-19T07:30:14.331 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_call": 0, 2024-09-19T07:30:14.331 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_watch": 0, 2024-09-19T07:30:14.331 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_notify": 0, 2024-09-19T07:30:14.331 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T07:30:14.331 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_pgls": 0, 2024-09-19T07:30:14.331 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_pgls_filter": 0, 2024-09-19T07:30:14.331 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_other": 0, 2024-09-19T07:30:14.331 INFO:teuthology.orchestra.run.smithi165.stdout: "linger_active": 0, 2024-09-19T07:30:14.332 INFO:teuthology.orchestra.run.smithi165.stdout: "linger_send": 0, 2024-09-19T07:30:14.332 INFO:teuthology.orchestra.run.smithi165.stdout: "linger_resend": 0, 2024-09-19T07:30:14.332 INFO:teuthology.orchestra.run.smithi165.stdout: "linger_ping": 0, 2024-09-19T07:30:14.332 INFO:teuthology.orchestra.run.smithi165.stdout: "poolop_active": 0, 2024-09-19T07:30:14.332 INFO:teuthology.orchestra.run.smithi165.stdout: "poolop_send": 0, 2024-09-19T07:30:14.332 INFO:teuthology.orchestra.run.smithi165.stdout: "poolop_resend": 0, 2024-09-19T07:30:14.332 INFO:teuthology.orchestra.run.smithi165.stdout: "poolstat_active": 0, 2024-09-19T07:30:14.332 INFO:teuthology.orchestra.run.smithi165.stdout: "poolstat_send": 0, 2024-09-19T07:30:14.332 INFO:teuthology.orchestra.run.smithi165.stdout: "poolstat_resend": 0, 2024-09-19T07:30:14.332 INFO:teuthology.orchestra.run.smithi165.stdout: "statfs_active": 0, 2024-09-19T07:30:14.332 INFO:teuthology.orchestra.run.smithi165.stdout: "statfs_send": 0, 2024-09-19T07:30:14.332 INFO:teuthology.orchestra.run.smithi165.stdout: "statfs_resend": 0, 2024-09-19T07:30:14.332 INFO:teuthology.orchestra.run.smithi165.stdout: "command_active": 0, 2024-09-19T07:30:14.333 INFO:teuthology.orchestra.run.smithi165.stdout: "command_send": 0, 2024-09-19T07:30:14.333 INFO:teuthology.orchestra.run.smithi165.stdout: "command_resend": 0, 2024-09-19T07:30:14.333 INFO:teuthology.orchestra.run.smithi165.stdout: "map_epoch": 107, 2024-09-19T07:30:14.333 INFO:teuthology.orchestra.run.smithi165.stdout: "map_full": 0, 2024-09-19T07:30:14.333 INFO:teuthology.orchestra.run.smithi165.stdout: "map_inc": 25, 2024-09-19T07:30:14.333 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_sessions": 11, 2024-09-19T07:30:14.333 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_session_open": 11, 2024-09-19T07:30:14.333 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_session_close": 0, 2024-09-19T07:30:14.333 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_laggy": 0, 2024-09-19T07:30:14.333 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_wr": 0, 2024-09-19T07:30:14.333 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_rd": 2, 2024-09-19T07:30:14.333 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_del": 0 2024-09-19T07:30:14.333 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.334 INFO:teuthology.orchestra.run.smithi165.stdout: "oft": { 2024-09-19T07:30:14.334 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_total_objs": 0, 2024-09-19T07:30:14.334 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_total_kv_pairs": 0, 2024-09-19T07:30:14.334 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_total_updates": 0, 2024-09-19T07:30:14.334 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_total_removes": 0 2024-09-19T07:30:14.334 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.334 INFO:teuthology.orchestra.run.smithi165.stdout: "osd-slow-ops": { 2024-09-19T07:30:14.334 INFO:teuthology.orchestra.run.smithi165.stdout: "slow_ops_count": 0 2024-09-19T07:30:14.334 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.334 INFO:teuthology.orchestra.run.smithi165.stdout: "purge_queue": { 2024-09-19T07:30:14.334 INFO:teuthology.orchestra.run.smithi165.stdout: "pq_executing_ops": 0, 2024-09-19T07:30:14.334 INFO:teuthology.orchestra.run.smithi165.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T07:30:14.334 INFO:teuthology.orchestra.run.smithi165.stdout: "pq_executing": 0, 2024-09-19T07:30:14.334 INFO:teuthology.orchestra.run.smithi165.stdout: "pq_executing_high_water": 0, 2024-09-19T07:30:14.335 INFO:teuthology.orchestra.run.smithi165.stdout: "pq_executed_ops": 0, 2024-09-19T07:30:14.335 INFO:teuthology.orchestra.run.smithi165.stdout: "pq_executed": 0, 2024-09-19T07:30:14.335 INFO:teuthology.orchestra.run.smithi165.stdout: "pq_item_in_journal": 0 2024-09-19T07:30:14.335 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.335 INFO:teuthology.orchestra.run.smithi165.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T07:30:14.335 INFO:teuthology.orchestra.run.smithi165.stdout: "val": 0, 2024-09-19T07:30:14.335 INFO:teuthology.orchestra.run.smithi165.stdout: "max": 104857600, 2024-09-19T07:30:14.335 INFO:teuthology.orchestra.run.smithi165.stdout: "get_started": 0, 2024-09-19T07:30:14.335 INFO:teuthology.orchestra.run.smithi165.stdout: "get": 3410, 2024-09-19T07:30:14.335 INFO:teuthology.orchestra.run.smithi165.stdout: "get_sum": 257586415, 2024-09-19T07:30:14.335 INFO:teuthology.orchestra.run.smithi165.stdout: "get_or_fail_fail": 0, 2024-09-19T07:30:14.335 INFO:teuthology.orchestra.run.smithi165.stdout: "get_or_fail_success": 3410, 2024-09-19T07:30:14.335 INFO:teuthology.orchestra.run.smithi165.stdout: "take": 0, 2024-09-19T07:30:14.336 INFO:teuthology.orchestra.run.smithi165.stdout: "take_sum": 0, 2024-09-19T07:30:14.336 INFO:teuthology.orchestra.run.smithi165.stdout: "put": 3410, 2024-09-19T07:30:14.336 INFO:teuthology.orchestra.run.smithi165.stdout: "put_sum": 257586415, 2024-09-19T07:30:14.336 INFO:teuthology.orchestra.run.smithi165.stdout: "wait": { 2024-09-19T07:30:14.336 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:14.336 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:14.336 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:14.336 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-19T07:30:14.336 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.336 INFO:teuthology.orchestra.run.smithi165.stdout: "throttle-objecter_bytes": { 2024-09-19T07:30:14.336 INFO:teuthology.orchestra.run.smithi165.stdout: "val": 0, 2024-09-19T07:30:14.336 INFO:teuthology.orchestra.run.smithi165.stdout: "max": 104857600, 2024-09-19T07:30:14.336 INFO:teuthology.orchestra.run.smithi165.stdout: "get_started": 0, 2024-09-19T07:30:14.336 INFO:teuthology.orchestra.run.smithi165.stdout: "get": 0, 2024-09-19T07:30:14.337 INFO:teuthology.orchestra.run.smithi165.stdout: "get_sum": 0, 2024-09-19T07:30:14.337 INFO:teuthology.orchestra.run.smithi165.stdout: "get_or_fail_fail": 0, 2024-09-19T07:30:14.337 INFO:teuthology.orchestra.run.smithi165.stdout: "get_or_fail_success": 0, 2024-09-19T07:30:14.337 INFO:teuthology.orchestra.run.smithi165.stdout: "take": 3129, 2024-09-19T07:30:14.337 INFO:teuthology.orchestra.run.smithi165.stdout: "take_sum": 256706452, 2024-09-19T07:30:14.337 INFO:teuthology.orchestra.run.smithi165.stdout: "put": 3129, 2024-09-19T07:30:14.337 INFO:teuthology.orchestra.run.smithi165.stdout: "put_sum": 256706452, 2024-09-19T07:30:14.337 INFO:teuthology.orchestra.run.smithi165.stdout: "wait": { 2024-09-19T07:30:14.337 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:14.337 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:14.337 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:14.337 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-19T07:30:14.337 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.338 INFO:teuthology.orchestra.run.smithi165.stdout: "throttle-objecter_ops": { 2024-09-19T07:30:14.338 INFO:teuthology.orchestra.run.smithi165.stdout: "val": 0, 2024-09-19T07:30:14.338 INFO:teuthology.orchestra.run.smithi165.stdout: "max": 1024, 2024-09-19T07:30:14.338 INFO:teuthology.orchestra.run.smithi165.stdout: "get_started": 0, 2024-09-19T07:30:14.338 INFO:teuthology.orchestra.run.smithi165.stdout: "get": 0, 2024-09-19T07:30:14.338 INFO:teuthology.orchestra.run.smithi165.stdout: "get_sum": 0, 2024-09-19T07:30:14.338 INFO:teuthology.orchestra.run.smithi165.stdout: "get_or_fail_fail": 0, 2024-09-19T07:30:14.338 INFO:teuthology.orchestra.run.smithi165.stdout: "get_or_fail_success": 0, 2024-09-19T07:30:14.338 INFO:teuthology.orchestra.run.smithi165.stdout: "take": 3129, 2024-09-19T07:30:14.338 INFO:teuthology.orchestra.run.smithi165.stdout: "take_sum": 3129, 2024-09-19T07:30:14.338 INFO:teuthology.orchestra.run.smithi165.stdout: "put": 3129, 2024-09-19T07:30:14.338 INFO:teuthology.orchestra.run.smithi165.stdout: "put_sum": 3129, 2024-09-19T07:30:14.338 INFO:teuthology.orchestra.run.smithi165.stdout: "wait": { 2024-09-19T07:30:14.338 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:14.339 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:14.339 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:14.339 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-19T07:30:14.339 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.339 INFO:teuthology.orchestra.run.smithi165.stdout: "throttle-write_buf_throttle": { 2024-09-19T07:30:14.339 INFO:teuthology.orchestra.run.smithi165.stdout: "val": 0, 2024-09-19T07:30:14.339 INFO:teuthology.orchestra.run.smithi165.stdout: "max": 3758096384, 2024-09-19T07:30:14.339 INFO:teuthology.orchestra.run.smithi165.stdout: "get_started": 0, 2024-09-19T07:30:14.339 INFO:teuthology.orchestra.run.smithi165.stdout: "get": 0, 2024-09-19T07:30:14.339 INFO:teuthology.orchestra.run.smithi165.stdout: "get_sum": 0, 2024-09-19T07:30:14.339 INFO:teuthology.orchestra.run.smithi165.stdout: "get_or_fail_fail": 0, 2024-09-19T07:30:14.339 INFO:teuthology.orchestra.run.smithi165.stdout: "get_or_fail_success": 0, 2024-09-19T07:30:14.339 INFO:teuthology.orchestra.run.smithi165.stdout: "take": 0, 2024-09-19T07:30:14.339 INFO:teuthology.orchestra.run.smithi165.stdout: "take_sum": 0, 2024-09-19T07:30:14.340 INFO:teuthology.orchestra.run.smithi165.stdout: "put": 0, 2024-09-19T07:30:14.340 INFO:teuthology.orchestra.run.smithi165.stdout: "put_sum": 0, 2024-09-19T07:30:14.340 INFO:teuthology.orchestra.run.smithi165.stdout: "wait": { 2024-09-19T07:30:14.340 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:14.340 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:14.340 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:14.340 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-19T07:30:14.340 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:14.340 INFO:teuthology.orchestra.run.smithi165.stdout: "throttle-write_buf_throttle-0x55b759c806e0": { 2024-09-19T07:30:14.340 INFO:teuthology.orchestra.run.smithi165.stdout: "val": 0, 2024-09-19T07:30:14.340 INFO:teuthology.orchestra.run.smithi165.stdout: "max": 3758096384, 2024-09-19T07:30:14.340 INFO:teuthology.orchestra.run.smithi165.stdout: "get_started": 0, 2024-09-19T07:30:14.340 INFO:teuthology.orchestra.run.smithi165.stdout: "get": 0, 2024-09-19T07:30:14.340 INFO:teuthology.orchestra.run.smithi165.stdout: "get_sum": 0, 2024-09-19T07:30:14.341 INFO:teuthology.orchestra.run.smithi165.stdout: "get_or_fail_fail": 0, 2024-09-19T07:30:14.341 INFO:teuthology.orchestra.run.smithi165.stdout: "get_or_fail_success": 0, 2024-09-19T07:30:14.341 INFO:teuthology.orchestra.run.smithi165.stdout: "take": 0, 2024-09-19T07:30:14.341 INFO:teuthology.orchestra.run.smithi165.stdout: "take_sum": 0, 2024-09-19T07:30:14.341 INFO:teuthology.orchestra.run.smithi165.stdout: "put": 0, 2024-09-19T07:30:14.341 INFO:teuthology.orchestra.run.smithi165.stdout: "put_sum": 0, 2024-09-19T07:30:14.341 INFO:teuthology.orchestra.run.smithi165.stdout: "wait": { 2024-09-19T07:30:14.341 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:14.341 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:14.341 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:14.341 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-19T07:30:14.341 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-19T07:30:14.341 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-09-19T07:30:15.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:14 smithi165 ceph-mon[35326]: pgmap v604: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 7 op/s 2024-09-19T07:30:15.221 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-19T07:30:15.221 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-19T07:30:15.221 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-09-19T07:30:15.221 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-09-19T07:30:15.221 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=6 2024-09-19T07:30:15.221 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-09-19T07:30:15.221 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T07:30:15.221 INFO:tasks.check_counter:Daemon mds.e mds.dir_split=0 2024-09-19T07:30:15.221 DEBUG:tasks.check_counter:Getting stats from h 2024-09-19T07:30:15.222 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-19T07:30:15.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:14 smithi179 ceph-mon[35716]: pgmap v604: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 7 op/s 2024-09-19T07:30:15.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:14 smithi148 ceph-mon[31180]: pgmap v604: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 7 op/s 2024-09-19T07:30:15.713 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T07:30:16.342 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-09-19T07:30:16.342 INFO:teuthology.orchestra.run.smithi165.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T07:30:16.343 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_messages": 1582, 2024-09-19T07:30:16.343 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_messages": 1584, 2024-09-19T07:30:16.343 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_bytes": 143026509, 2024-09-19T07:30:16.343 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_bytes": 503140, 2024-09-19T07:30:16.343 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_created_connections": 8, 2024-09-19T07:30:16.343 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_active_connections": 4, 2024-09-19T07:30:16.343 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_total_time": 0.203688738, 2024-09-19T07:30:16.343 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_send_time": 0.039617789, 2024-09-19T07:30:16.343 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_recv_time": 0.110101140, 2024-09-19T07:30:16.343 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_fast_dispatch_time": 0.041109213, 2024-09-19T07:30:16.343 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:30:16.343 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 1582, 2024-09-19T07:30:16.344 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.057006553, 2024-09-19T07:30:16.344 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000036034 2024-09-19T07:30:16.344 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.344 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:30:16.344 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:16.344 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:16.344 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:16.344 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.344 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T07:30:16.344 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T07:30:16.344 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.344 INFO:teuthology.orchestra.run.smithi165.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T07:30:16.344 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_messages": 1346, 2024-09-19T07:30:16.344 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_messages": 1534, 2024-09-19T07:30:16.345 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_bytes": 90914181, 2024-09-19T07:30:16.345 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_bytes": 1013321, 2024-09-19T07:30:16.345 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_created_connections": 6, 2024-09-19T07:30:16.345 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_active_connections": 5, 2024-09-19T07:30:16.345 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_total_time": 0.197267865, 2024-09-19T07:30:16.345 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_send_time": 0.051198011, 2024-09-19T07:30:16.345 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_recv_time": 0.127855493, 2024-09-19T07:30:16.345 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_fast_dispatch_time": 0.026179615, 2024-09-19T07:30:16.345 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:30:16.345 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 1534, 2024-09-19T07:30:16.345 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.080605465, 2024-09-19T07:30:16.345 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000052545 2024-09-19T07:30:16.345 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.346 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:30:16.346 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:16.346 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:16.346 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:16.346 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.346 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_encrypted_bytes": 1655088, 2024-09-19T07:30:16.346 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_encrypted_bytes": 718848 2024-09-19T07:30:16.346 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.346 INFO:teuthology.orchestra.run.smithi165.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T07:30:16.346 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_messages": 1893, 2024-09-19T07:30:16.346 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_messages": 1920, 2024-09-19T07:30:16.346 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_bytes": 97070701, 2024-09-19T07:30:16.346 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_bytes": 723304, 2024-09-19T07:30:16.346 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_created_connections": 8, 2024-09-19T07:30:16.346 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_active_connections": 6, 2024-09-19T07:30:16.347 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_total_time": 0.230655306, 2024-09-19T07:30:16.347 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_send_time": 0.053018309, 2024-09-19T07:30:16.347 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_recv_time": 0.101483454, 2024-09-19T07:30:16.347 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_fast_dispatch_time": 0.059382853, 2024-09-19T07:30:16.347 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:30:16.347 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 1917, 2024-09-19T07:30:16.347 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.089412611, 2024-09-19T07:30:16.347 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000046641 2024-09-19T07:30:16.347 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.347 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:30:16.347 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:16.347 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:16.347 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:16.347 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.348 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T07:30:16.348 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_encrypted_bytes": 121648 2024-09-19T07:30:16.348 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.348 INFO:teuthology.orchestra.run.smithi165.stdout: "cct": { 2024-09-19T07:30:16.348 INFO:teuthology.orchestra.run.smithi165.stdout: "total_workers": 1, 2024-09-19T07:30:16.348 INFO:teuthology.orchestra.run.smithi165.stdout: "unhealthy_workers": 0 2024-09-19T07:30:16.348 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.348 INFO:teuthology.orchestra.run.smithi165.stdout: "finisher-MDSRank": { 2024-09-19T07:30:16.348 INFO:teuthology.orchestra.run.smithi165.stdout: "queue_len": 0, 2024-09-19T07:30:16.348 INFO:teuthology.orchestra.run.smithi165.stdout: "complete_latency": { 2024-09-19T07:30:16.348 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 7129, 2024-09-19T07:30:16.348 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.196718077, 2024-09-19T07:30:16.348 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000027594 2024-09-19T07:30:16.348 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-19T07:30:16.349 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.349 INFO:teuthology.orchestra.run.smithi165.stdout: "finisher-PurgeQueue": { 2024-09-19T07:30:16.349 INFO:teuthology.orchestra.run.smithi165.stdout: "queue_len": 0, 2024-09-19T07:30:16.349 INFO:teuthology.orchestra.run.smithi165.stdout: "complete_latency": { 2024-09-19T07:30:16.349 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:16.349 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:16.349 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:16.349 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-19T07:30:16.349 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.349 INFO:teuthology.orchestra.run.smithi165.stdout: "mds": { 2024-09-19T07:30:16.349 INFO:teuthology.orchestra.run.smithi165.stdout: "request": 0, 2024-09-19T07:30:16.349 INFO:teuthology.orchestra.run.smithi165.stdout: "reply": 0, 2024-09-19T07:30:16.349 INFO:teuthology.orchestra.run.smithi165.stdout: "reply_latency": { 2024-09-19T07:30:16.349 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:16.350 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:16.350 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:16.350 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.350 INFO:teuthology.orchestra.run.smithi165.stdout: "slow_reply": 0, 2024-09-19T07:30:16.350 INFO:teuthology.orchestra.run.smithi165.stdout: "forward": 0, 2024-09-19T07:30:16.350 INFO:teuthology.orchestra.run.smithi165.stdout: "dir_fetch_complete": 0, 2024-09-19T07:30:16.350 INFO:teuthology.orchestra.run.smithi165.stdout: "dir_fetch_keys": 0, 2024-09-19T07:30:16.350 INFO:teuthology.orchestra.run.smithi165.stdout: "dir_commit": 0, 2024-09-19T07:30:16.350 INFO:teuthology.orchestra.run.smithi165.stdout: "dir_split": 0, 2024-09-19T07:30:16.350 INFO:teuthology.orchestra.run.smithi165.stdout: "dir_merge": 0, 2024-09-19T07:30:16.350 INFO:teuthology.orchestra.run.smithi165.stdout: "inodes": 36116, 2024-09-19T07:30:16.350 INFO:teuthology.orchestra.run.smithi165.stdout: "inodes_top": 2710, 2024-09-19T07:30:16.350 INFO:teuthology.orchestra.run.smithi165.stdout: "inodes_bottom": 33406, 2024-09-19T07:30:16.350 INFO:teuthology.orchestra.run.smithi165.stdout: "inodes_pin_tail": 0, 2024-09-19T07:30:16.350 INFO:teuthology.orchestra.run.smithi165.stdout: "inodes_pinned": 32244, 2024-09-19T07:30:16.351 INFO:teuthology.orchestra.run.smithi165.stdout: "inodes_expired": 0, 2024-09-19T07:30:16.351 INFO:teuthology.orchestra.run.smithi165.stdout: "inodes_with_caps": 0, 2024-09-19T07:30:16.351 INFO:teuthology.orchestra.run.smithi165.stdout: "caps": 0, 2024-09-19T07:30:16.351 INFO:teuthology.orchestra.run.smithi165.stdout: "subtrees": 1, 2024-09-19T07:30:16.351 INFO:teuthology.orchestra.run.smithi165.stdout: "traverse": 0, 2024-09-19T07:30:16.351 INFO:teuthology.orchestra.run.smithi165.stdout: "traverse_hit": 0, 2024-09-19T07:30:16.351 INFO:teuthology.orchestra.run.smithi165.stdout: "traverse_forward": 0, 2024-09-19T07:30:16.351 INFO:teuthology.orchestra.run.smithi165.stdout: "traverse_discover": 0, 2024-09-19T07:30:16.351 INFO:teuthology.orchestra.run.smithi165.stdout: "traverse_dir_fetch": 0, 2024-09-19T07:30:16.351 INFO:teuthology.orchestra.run.smithi165.stdout: "traverse_remote_ino": 0, 2024-09-19T07:30:16.351 INFO:teuthology.orchestra.run.smithi165.stdout: "traverse_lock": 0, 2024-09-19T07:30:16.351 INFO:teuthology.orchestra.run.smithi165.stdout: "load_cent": 0, 2024-09-19T07:30:16.351 INFO:teuthology.orchestra.run.smithi165.stdout: "q": 0, 2024-09-19T07:30:16.351 INFO:teuthology.orchestra.run.smithi165.stdout: "exported": 0, 2024-09-19T07:30:16.351 INFO:teuthology.orchestra.run.smithi165.stdout: "exported_inodes": 0, 2024-09-19T07:30:16.352 INFO:teuthology.orchestra.run.smithi165.stdout: "imported": 0, 2024-09-19T07:30:16.352 INFO:teuthology.orchestra.run.smithi165.stdout: "imported_inodes": 0, 2024-09-19T07:30:16.352 INFO:teuthology.orchestra.run.smithi165.stdout: "openino_dir_fetch": 0, 2024-09-19T07:30:16.352 INFO:teuthology.orchestra.run.smithi165.stdout: "openino_backtrace_fetch": 0, 2024-09-19T07:30:16.352 INFO:teuthology.orchestra.run.smithi165.stdout: "openino_peer_discover": 0, 2024-09-19T07:30:16.352 INFO:teuthology.orchestra.run.smithi165.stdout: "root_rfiles": 0, 2024-09-19T07:30:16.352 INFO:teuthology.orchestra.run.smithi165.stdout: "root_rbytes": 0, 2024-09-19T07:30:16.352 INFO:teuthology.orchestra.run.smithi165.stdout: "root_rsnaps": 0, 2024-09-19T07:30:16.352 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T07:30:16.352 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_set_tag": 0, 2024-09-19T07:30:16.352 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T07:30:16.352 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_inotable_repaired": 0, 2024-09-19T07:30:16.352 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_dir_inodes": 0, 2024-09-19T07:30:16.352 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T07:30:16.353 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T07:30:16.353 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_file_inodes": 0, 2024-09-19T07:30:16.353 INFO:teuthology.orchestra.run.smithi165.stdout: "handle_inode_file_caps": 0, 2024-09-19T07:30:16.353 INFO:teuthology.orchestra.run.smithi165.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T07:30:16.353 INFO:teuthology.orchestra.run.smithi165.stdout: "ceph_cap_op_grant": 0, 2024-09-19T07:30:16.353 INFO:teuthology.orchestra.run.smithi165.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T07:30:16.353 INFO:teuthology.orchestra.run.smithi165.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T07:30:16.353 INFO:teuthology.orchestra.run.smithi165.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T07:30:16.353 INFO:teuthology.orchestra.run.smithi165.stdout: "handle_client_caps": 0, 2024-09-19T07:30:16.353 INFO:teuthology.orchestra.run.smithi165.stdout: "handle_client_caps_dirty": 0, 2024-09-19T07:30:16.353 INFO:teuthology.orchestra.run.smithi165.stdout: "handle_client_cap_release": 0, 2024-09-19T07:30:16.353 INFO:teuthology.orchestra.run.smithi165.stdout: "process_request_cap_release": 0 2024-09-19T07:30:16.353 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.353 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_cache": { 2024-09-19T07:30:16.353 INFO:teuthology.orchestra.run.smithi165.stdout: "dir_update": 0, 2024-09-19T07:30:16.354 INFO:teuthology.orchestra.run.smithi165.stdout: "dir_update_receipt": 0, 2024-09-19T07:30:16.354 INFO:teuthology.orchestra.run.smithi165.stdout: "dir_try_discover": 0, 2024-09-19T07:30:16.354 INFO:teuthology.orchestra.run.smithi165.stdout: "dir_send_discover": 0, 2024-09-19T07:30:16.354 INFO:teuthology.orchestra.run.smithi165.stdout: "dir_handle_discover": 0, 2024-09-19T07:30:16.354 INFO:teuthology.orchestra.run.smithi165.stdout: "num_strays": 0, 2024-09-19T07:30:16.354 INFO:teuthology.orchestra.run.smithi165.stdout: "num_strays_delayed": 0, 2024-09-19T07:30:16.354 INFO:teuthology.orchestra.run.smithi165.stdout: "num_strays_enqueuing": 0, 2024-09-19T07:30:16.354 INFO:teuthology.orchestra.run.smithi165.stdout: "strays_created": 0, 2024-09-19T07:30:16.354 INFO:teuthology.orchestra.run.smithi165.stdout: "strays_enqueued": 0, 2024-09-19T07:30:16.354 INFO:teuthology.orchestra.run.smithi165.stdout: "strays_reintegrated": 0, 2024-09-19T07:30:16.354 INFO:teuthology.orchestra.run.smithi165.stdout: "strays_migrated": 0, 2024-09-19T07:30:16.354 INFO:teuthology.orchestra.run.smithi165.stdout: "num_recovering_processing": 0, 2024-09-19T07:30:16.354 INFO:teuthology.orchestra.run.smithi165.stdout: "num_recovering_enqueued": 0, 2024-09-19T07:30:16.354 INFO:teuthology.orchestra.run.smithi165.stdout: "num_recovering_prioritized": 0, 2024-09-19T07:30:16.354 INFO:teuthology.orchestra.run.smithi165.stdout: "recovery_started": 0, 2024-09-19T07:30:16.355 INFO:teuthology.orchestra.run.smithi165.stdout: "recovery_completed": 0, 2024-09-19T07:30:16.355 INFO:teuthology.orchestra.run.smithi165.stdout: "ireq_quiesce_path": 0, 2024-09-19T07:30:16.355 INFO:teuthology.orchestra.run.smithi165.stdout: "ireq_quiesce_inode": 0, 2024-09-19T07:30:16.355 INFO:teuthology.orchestra.run.smithi165.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T07:30:16.355 INFO:teuthology.orchestra.run.smithi165.stdout: "ireq_exportdir": 0, 2024-09-19T07:30:16.355 INFO:teuthology.orchestra.run.smithi165.stdout: "ireq_flush": 0, 2024-09-19T07:30:16.355 INFO:teuthology.orchestra.run.smithi165.stdout: "ireq_fragmentdir": 0, 2024-09-19T07:30:16.355 INFO:teuthology.orchestra.run.smithi165.stdout: "ireq_fragstats": 0, 2024-09-19T07:30:16.355 INFO:teuthology.orchestra.run.smithi165.stdout: "ireq_inodestats": 0 2024-09-19T07:30:16.355 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.355 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_log": { 2024-09-19T07:30:16.355 INFO:teuthology.orchestra.run.smithi165.stdout: "evlrg": 0, 2024-09-19T07:30:16.355 INFO:teuthology.orchestra.run.smithi165.stdout: "evadd": 0, 2024-09-19T07:30:16.355 INFO:teuthology.orchestra.run.smithi165.stdout: "evex": 0, 2024-09-19T07:30:16.355 INFO:teuthology.orchestra.run.smithi165.stdout: "evtrm": 0, 2024-09-19T07:30:16.356 INFO:teuthology.orchestra.run.smithi165.stdout: "ev": 105025, 2024-09-19T07:30:16.356 INFO:teuthology.orchestra.run.smithi165.stdout: "evexg": 0, 2024-09-19T07:30:16.356 INFO:teuthology.orchestra.run.smithi165.stdout: "evexd": 0, 2024-09-19T07:30:16.356 INFO:teuthology.orchestra.run.smithi165.stdout: "segadd": 0, 2024-09-19T07:30:16.356 INFO:teuthology.orchestra.run.smithi165.stdout: "segex": 0, 2024-09-19T07:30:16.356 INFO:teuthology.orchestra.run.smithi165.stdout: "segtrm": 0, 2024-09-19T07:30:16.356 INFO:teuthology.orchestra.run.smithi165.stdout: "seg": 134, 2024-09-19T07:30:16.356 INFO:teuthology.orchestra.run.smithi165.stdout: "segmjr": 10, 2024-09-19T07:30:16.356 INFO:teuthology.orchestra.run.smithi165.stdout: "segexg": 0, 2024-09-19T07:30:16.356 INFO:teuthology.orchestra.run.smithi165.stdout: "segexd": 0, 2024-09-19T07:30:16.356 INFO:teuthology.orchestra.run.smithi165.stdout: "expos": 30149232, 2024-09-19T07:30:16.356 INFO:teuthology.orchestra.run.smithi165.stdout: "wrpos": 332283695, 2024-09-19T07:30:16.356 INFO:teuthology.orchestra.run.smithi165.stdout: "rdpos": 332272923, 2024-09-19T07:30:16.356 INFO:teuthology.orchestra.run.smithi165.stdout: "jlat": { 2024-09-19T07:30:16.357 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:16.357 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:16.357 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:16.357 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.357 INFO:teuthology.orchestra.run.smithi165.stdout: "replayed": 105025 2024-09-19T07:30:16.357 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.357 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_mem": { 2024-09-19T07:30:16.357 INFO:teuthology.orchestra.run.smithi165.stdout: "ino": 9647, 2024-09-19T07:30:16.357 INFO:teuthology.orchestra.run.smithi165.stdout: "ino+": 55365, 2024-09-19T07:30:16.357 INFO:teuthology.orchestra.run.smithi165.stdout: "ino-": 45718, 2024-09-19T07:30:16.357 INFO:teuthology.orchestra.run.smithi165.stdout: "dir": 370, 2024-09-19T07:30:16.357 INFO:teuthology.orchestra.run.smithi165.stdout: "dir+": 1527, 2024-09-19T07:30:16.357 INFO:teuthology.orchestra.run.smithi165.stdout: "dir-": 1157, 2024-09-19T07:30:16.358 INFO:teuthology.orchestra.run.smithi165.stdout: "dn": 36116, 2024-09-19T07:30:16.358 INFO:teuthology.orchestra.run.smithi165.stdout: "dn+": 90012, 2024-09-19T07:30:16.358 INFO:teuthology.orchestra.run.smithi165.stdout: "dn-": 53896, 2024-09-19T07:30:16.358 INFO:teuthology.orchestra.run.smithi165.stdout: "cap": 0, 2024-09-19T07:30:16.358 INFO:teuthology.orchestra.run.smithi165.stdout: "cap+": 0, 2024-09-19T07:30:16.358 INFO:teuthology.orchestra.run.smithi165.stdout: "cap-": 0, 2024-09-19T07:30:16.358 INFO:teuthology.orchestra.run.smithi165.stdout: "rss": 157452, 2024-09-19T07:30:16.358 INFO:teuthology.orchestra.run.smithi165.stdout: "heap": 215328 2024-09-19T07:30:16.358 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.358 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_server": { 2024-09-19T07:30:16.358 INFO:teuthology.orchestra.run.smithi165.stdout: "dispatch_client_request": 0, 2024-09-19T07:30:16.358 INFO:teuthology.orchestra.run.smithi165.stdout: "dispatch_server_request": 0, 2024-09-19T07:30:16.358 INFO:teuthology.orchestra.run.smithi165.stdout: "handle_client_request": 0, 2024-09-19T07:30:16.358 INFO:teuthology.orchestra.run.smithi165.stdout: "handle_client_session": 0, 2024-09-19T07:30:16.358 INFO:teuthology.orchestra.run.smithi165.stdout: "handle_peer_request": 0, 2024-09-19T07:30:16.359 INFO:teuthology.orchestra.run.smithi165.stdout: "req_create_latency": { 2024-09-19T07:30:16.359 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:16.359 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:16.359 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:16.359 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.359 INFO:teuthology.orchestra.run.smithi165.stdout: "req_getattr_latency": { 2024-09-19T07:30:16.359 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:16.359 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:16.359 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:16.359 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.359 INFO:teuthology.orchestra.run.smithi165.stdout: "req_getfilelock_latency": { 2024-09-19T07:30:16.359 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:16.359 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:16.359 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:16.359 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.359 INFO:teuthology.orchestra.run.smithi165.stdout: "req_link_latency": { 2024-09-19T07:30:16.360 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:16.360 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:16.360 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:16.360 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.360 INFO:teuthology.orchestra.run.smithi165.stdout: "req_lookup_latency": { 2024-09-19T07:30:16.360 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:16.360 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:16.360 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:16.360 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.360 INFO:teuthology.orchestra.run.smithi165.stdout: "req_lookuphash_latency": { 2024-09-19T07:30:16.360 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:16.360 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:16.360 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:16.360 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.361 INFO:teuthology.orchestra.run.smithi165.stdout: "req_lookupino_latency": { 2024-09-19T07:30:16.361 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:16.361 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:16.361 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:16.361 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.361 INFO:teuthology.orchestra.run.smithi165.stdout: "req_lookupname_latency": { 2024-09-19T07:30:16.361 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:16.361 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:16.361 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:16.361 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.361 INFO:teuthology.orchestra.run.smithi165.stdout: "req_lookupparent_latency": { 2024-09-19T07:30:16.361 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:16.361 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:16.361 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:16.361 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.362 INFO:teuthology.orchestra.run.smithi165.stdout: "req_lookupsnap_latency": { 2024-09-19T07:30:16.362 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:16.362 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:16.362 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:16.362 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.362 INFO:teuthology.orchestra.run.smithi165.stdout: "req_lssnap_latency": { 2024-09-19T07:30:16.362 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:16.362 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:16.362 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:16.362 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.363 INFO:teuthology.orchestra.run.smithi165.stdout: "req_mkdir_latency": { 2024-09-19T07:30:16.363 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:16.363 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:16.363 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:16.363 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.363 INFO:teuthology.orchestra.run.smithi165.stdout: "req_mknod_latency": { 2024-09-19T07:30:16.363 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:16.363 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:16.363 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:16.363 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.363 INFO:teuthology.orchestra.run.smithi165.stdout: "req_mksnap_latency": { 2024-09-19T07:30:16.364 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:16.364 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:16.364 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:16.364 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.364 INFO:teuthology.orchestra.run.smithi165.stdout: "req_open_latency": { 2024-09-19T07:30:16.364 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:16.364 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:16.364 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:16.364 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.364 INFO:teuthology.orchestra.run.smithi165.stdout: "req_readdir_latency": { 2024-09-19T07:30:16.364 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:16.364 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:16.364 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:16.364 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.365 INFO:teuthology.orchestra.run.smithi165.stdout: "req_rename_latency": { 2024-09-19T07:30:16.365 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:16.365 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:16.365 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:16.365 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.365 INFO:teuthology.orchestra.run.smithi165.stdout: "req_renamesnap_latency": { 2024-09-19T07:30:16.365 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:16.365 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:16.365 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:16.365 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.365 INFO:teuthology.orchestra.run.smithi165.stdout: "req_snapdiff_latency": { 2024-09-19T07:30:16.365 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:16.365 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:16.365 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:16.365 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.366 INFO:teuthology.orchestra.run.smithi165.stdout: "req_rmdir_latency": { 2024-09-19T07:30:16.366 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:16.366 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:16.366 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:16.366 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.366 INFO:teuthology.orchestra.run.smithi165.stdout: "req_rmsnap_latency": { 2024-09-19T07:30:16.366 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:16.366 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:16.366 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:16.366 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.366 INFO:teuthology.orchestra.run.smithi165.stdout: "req_rmxattr_latency": { 2024-09-19T07:30:16.366 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:16.366 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:16.367 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:16.367 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.367 INFO:teuthology.orchestra.run.smithi165.stdout: "req_setattr_latency": { 2024-09-19T07:30:16.367 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:16.367 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:16.367 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:16.367 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.367 INFO:teuthology.orchestra.run.smithi165.stdout: "req_setdirlayout_latency": { 2024-09-19T07:30:16.367 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:16.367 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:16.367 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:16.367 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.367 INFO:teuthology.orchestra.run.smithi165.stdout: "req_setfilelock_latency": { 2024-09-19T07:30:16.367 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:16.368 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:16.368 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:16.368 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.368 INFO:teuthology.orchestra.run.smithi165.stdout: "req_setlayout_latency": { 2024-09-19T07:30:16.368 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:16.368 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:16.368 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:16.368 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.368 INFO:teuthology.orchestra.run.smithi165.stdout: "req_setxattr_latency": { 2024-09-19T07:30:16.368 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:16.368 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:16.368 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:16.368 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.368 INFO:teuthology.orchestra.run.smithi165.stdout: "req_symlink_latency": { 2024-09-19T07:30:16.369 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:16.369 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:16.369 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:16.369 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.369 INFO:teuthology.orchestra.run.smithi165.stdout: "req_unlink_latency": { 2024-09-19T07:30:16.369 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:16.369 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:16.369 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:16.369 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.369 INFO:teuthology.orchestra.run.smithi165.stdout: "cap_revoke_eviction": 0, 2024-09-19T07:30:16.369 INFO:teuthology.orchestra.run.smithi165.stdout: "cap_acquisition_throttle": 0, 2024-09-19T07:30:16.369 INFO:teuthology.orchestra.run.smithi165.stdout: "req_getvxattr_latency": { 2024-09-19T07:30:16.369 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:16.370 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:16.370 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:16.370 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-19T07:30:16.370 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.370 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_sessions": { 2024-09-19T07:30:16.370 INFO:teuthology.orchestra.run.smithi165.stdout: "session_count": 1, 2024-09-19T07:30:16.370 INFO:teuthology.orchestra.run.smithi165.stdout: "session_add": 4, 2024-09-19T07:30:16.370 INFO:teuthology.orchestra.run.smithi165.stdout: "session_remove": 3, 2024-09-19T07:30:16.370 INFO:teuthology.orchestra.run.smithi165.stdout: "sessions_open": 3, 2024-09-19T07:30:16.370 INFO:teuthology.orchestra.run.smithi165.stdout: "sessions_stale": 0, 2024-09-19T07:30:16.370 INFO:teuthology.orchestra.run.smithi165.stdout: "total_load": 0, 2024-09-19T07:30:16.370 INFO:teuthology.orchestra.run.smithi165.stdout: "average_load": 0, 2024-09-19T07:30:16.370 INFO:teuthology.orchestra.run.smithi165.stdout: "avg_session_uptime": 4802, 2024-09-19T07:30:16.370 INFO:teuthology.orchestra.run.smithi165.stdout: "mdthresh_evicted": 0 2024-09-19T07:30:16.370 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.370 INFO:teuthology.orchestra.run.smithi165.stdout: "mempool": { 2024-09-19T07:30:16.371 INFO:teuthology.orchestra.run.smithi165.stdout: "bloom_filter_bytes": 0, 2024-09-19T07:30:16.371 INFO:teuthology.orchestra.run.smithi165.stdout: "bloom_filter_items": 0, 2024-09-19T07:30:16.371 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T07:30:16.371 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_alloc_items": 0, 2024-09-19T07:30:16.371 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T07:30:16.371 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_data_items": 0, 2024-09-19T07:30:16.371 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T07:30:16.371 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T07:30:16.371 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T07:30:16.371 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T07:30:16.371 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T07:30:16.371 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_other_items": 0, 2024-09-19T07:30:16.371 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T07:30:16.371 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T07:30:16.371 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_extent_bytes": 0, 2024-09-19T07:30:16.372 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_extent_items": 0, 2024-09-19T07:30:16.372 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_blob_bytes": 0, 2024-09-19T07:30:16.372 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_blob_items": 0, 2024-09-19T07:30:16.372 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T07:30:16.372 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T07:30:16.372 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T07:30:16.372 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T07:30:16.372 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T07:30:16.372 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_fsck_items": 0, 2024-09-19T07:30:16.372 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_txc_bytes": 0, 2024-09-19T07:30:16.372 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_txc_items": 0, 2024-09-19T07:30:16.372 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T07:30:16.372 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T07:30:16.373 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_writing_bytes": 0, 2024-09-19T07:30:16.373 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_writing_items": 0, 2024-09-19T07:30:16.373 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_bytes": 0, 2024-09-19T07:30:16.373 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_items": 0, 2024-09-19T07:30:16.373 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T07:30:16.373 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_file_reader_items": 0, 2024-09-19T07:30:16.373 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T07:30:16.373 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_file_writer_items": 0, 2024-09-19T07:30:16.373 INFO:teuthology.orchestra.run.smithi165.stdout: "buffer_anon_bytes": 604527, 2024-09-19T07:30:16.373 INFO:teuthology.orchestra.run.smithi165.stdout: "buffer_anon_items": 9927, 2024-09-19T07:30:16.373 INFO:teuthology.orchestra.run.smithi165.stdout: "buffer_meta_bytes": 0, 2024-09-19T07:30:16.373 INFO:teuthology.orchestra.run.smithi165.stdout: "buffer_meta_items": 0, 2024-09-19T07:30:16.373 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_bytes": 0, 2024-09-19T07:30:16.373 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_items": 0, 2024-09-19T07:30:16.374 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_mapbl_bytes": 0, 2024-09-19T07:30:16.374 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_mapbl_items": 0, 2024-09-19T07:30:16.374 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pglog_bytes": 0, 2024-09-19T07:30:16.374 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pglog_items": 0, 2024-09-19T07:30:16.374 INFO:teuthology.orchestra.run.smithi165.stdout: "osdmap_bytes": 8344, 2024-09-19T07:30:16.374 INFO:teuthology.orchestra.run.smithi165.stdout: "osdmap_items": 185, 2024-09-19T07:30:16.374 INFO:teuthology.orchestra.run.smithi165.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T07:30:16.374 INFO:teuthology.orchestra.run.smithi165.stdout: "osdmap_mapping_items": 0, 2024-09-19T07:30:16.374 INFO:teuthology.orchestra.run.smithi165.stdout: "pgmap_bytes": 0, 2024-09-19T07:30:16.374 INFO:teuthology.orchestra.run.smithi165.stdout: "pgmap_items": 0, 2024-09-19T07:30:16.374 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_co_bytes": 48263508, 2024-09-19T07:30:16.374 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_co_items": 487020, 2024-09-19T07:30:16.374 INFO:teuthology.orchestra.run.smithi165.stdout: "unittest_1_bytes": 0, 2024-09-19T07:30:16.374 INFO:teuthology.orchestra.run.smithi165.stdout: "unittest_1_items": 0, 2024-09-19T07:30:16.374 INFO:teuthology.orchestra.run.smithi165.stdout: "unittest_2_bytes": 0, 2024-09-19T07:30:16.375 INFO:teuthology.orchestra.run.smithi165.stdout: "unittest_2_items": 0 2024-09-19T07:30:16.375 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.375 INFO:teuthology.orchestra.run.smithi165.stdout: "objecter": { 2024-09-19T07:30:16.375 INFO:teuthology.orchestra.run.smithi165.stdout: "op_active": 0, 2024-09-19T07:30:16.375 INFO:teuthology.orchestra.run.smithi165.stdout: "op_laggy": 0, 2024-09-19T07:30:16.375 INFO:teuthology.orchestra.run.smithi165.stdout: "op_send": 4400, 2024-09-19T07:30:16.375 INFO:teuthology.orchestra.run.smithi165.stdout: "op_send_bytes": 21, 2024-09-19T07:30:16.375 INFO:teuthology.orchestra.run.smithi165.stdout: "op_resend": 3, 2024-09-19T07:30:16.375 INFO:teuthology.orchestra.run.smithi165.stdout: "op_reply": 4400, 2024-09-19T07:30:16.375 INFO:teuthology.orchestra.run.smithi165.stdout: "op_latency": { 2024-09-19T07:30:16.375 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 4400, 2024-09-19T07:30:16.375 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 18.027717394, 2024-09-19T07:30:16.375 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.004097208 2024-09-19T07:30:16.375 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.375 INFO:teuthology.orchestra.run.smithi165.stdout: "op_inflight": 0, 2024-09-19T07:30:16.376 INFO:teuthology.orchestra.run.smithi165.stdout: "oplen_avg": { 2024-09-19T07:30:16.376 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 4400, 2024-09-19T07:30:16.376 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 4401 2024-09-19T07:30:16.376 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.376 INFO:teuthology.orchestra.run.smithi165.stdout: "op": 4400, 2024-09-19T07:30:16.376 INFO:teuthology.orchestra.run.smithi165.stdout: "op_r": 4400, 2024-09-19T07:30:16.376 INFO:teuthology.orchestra.run.smithi165.stdout: "op_w": 0, 2024-09-19T07:30:16.376 INFO:teuthology.orchestra.run.smithi165.stdout: "op_rmw": 0, 2024-09-19T07:30:16.376 INFO:teuthology.orchestra.run.smithi165.stdout: "op_pg": 0, 2024-09-19T07:30:16.376 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_stat": 2720, 2024-09-19T07:30:16.376 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_create": 0, 2024-09-19T07:30:16.376 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_read": 1678, 2024-09-19T07:30:16.376 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_write": 0, 2024-09-19T07:30:16.376 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_writefull": 0, 2024-09-19T07:30:16.377 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_writesame": 0, 2024-09-19T07:30:16.377 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_append": 0, 2024-09-19T07:30:16.377 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_zero": 0, 2024-09-19T07:30:16.377 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_truncate": 0, 2024-09-19T07:30:16.377 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_delete": 0, 2024-09-19T07:30:16.377 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_mapext": 0, 2024-09-19T07:30:16.377 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_sparse_read": 0, 2024-09-19T07:30:16.377 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_clonerange": 0, 2024-09-19T07:30:16.377 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_getxattr": 1, 2024-09-19T07:30:16.377 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_setxattr": 0, 2024-09-19T07:30:16.377 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_cmpxattr": 0, 2024-09-19T07:30:16.377 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_rmxattr": 0, 2024-09-19T07:30:16.377 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_resetxattrs": 0, 2024-09-19T07:30:16.377 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_call": 0, 2024-09-19T07:30:16.377 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_watch": 0, 2024-09-19T07:30:16.378 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_notify": 0, 2024-09-19T07:30:16.378 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T07:30:16.378 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_pgls": 0, 2024-09-19T07:30:16.378 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_pgls_filter": 0, 2024-09-19T07:30:16.378 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_other": 0, 2024-09-19T07:30:16.378 INFO:teuthology.orchestra.run.smithi165.stdout: "linger_active": 0, 2024-09-19T07:30:16.378 INFO:teuthology.orchestra.run.smithi165.stdout: "linger_send": 0, 2024-09-19T07:30:16.378 INFO:teuthology.orchestra.run.smithi165.stdout: "linger_resend": 0, 2024-09-19T07:30:16.378 INFO:teuthology.orchestra.run.smithi165.stdout: "linger_ping": 0, 2024-09-19T07:30:16.378 INFO:teuthology.orchestra.run.smithi165.stdout: "poolop_active": 0, 2024-09-19T07:30:16.378 INFO:teuthology.orchestra.run.smithi165.stdout: "poolop_send": 0, 2024-09-19T07:30:16.378 INFO:teuthology.orchestra.run.smithi165.stdout: "poolop_resend": 0, 2024-09-19T07:30:16.378 INFO:teuthology.orchestra.run.smithi165.stdout: "poolstat_active": 0, 2024-09-19T07:30:16.378 INFO:teuthology.orchestra.run.smithi165.stdout: "poolstat_send": 0, 2024-09-19T07:30:16.378 INFO:teuthology.orchestra.run.smithi165.stdout: "poolstat_resend": 0, 2024-09-19T07:30:16.378 INFO:teuthology.orchestra.run.smithi165.stdout: "statfs_active": 0, 2024-09-19T07:30:16.379 INFO:teuthology.orchestra.run.smithi165.stdout: "statfs_send": 0, 2024-09-19T07:30:16.379 INFO:teuthology.orchestra.run.smithi165.stdout: "statfs_resend": 0, 2024-09-19T07:30:16.379 INFO:teuthology.orchestra.run.smithi165.stdout: "command_active": 0, 2024-09-19T07:30:16.379 INFO:teuthology.orchestra.run.smithi165.stdout: "command_send": 0, 2024-09-19T07:30:16.379 INFO:teuthology.orchestra.run.smithi165.stdout: "command_resend": 0, 2024-09-19T07:30:16.379 INFO:teuthology.orchestra.run.smithi165.stdout: "map_epoch": 107, 2024-09-19T07:30:16.379 INFO:teuthology.orchestra.run.smithi165.stdout: "map_full": 0, 2024-09-19T07:30:16.379 INFO:teuthology.orchestra.run.smithi165.stdout: "map_inc": 29, 2024-09-19T07:30:16.379 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_sessions": 11, 2024-09-19T07:30:16.379 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_session_open": 11, 2024-09-19T07:30:16.379 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_session_close": 0, 2024-09-19T07:30:16.379 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_laggy": 0, 2024-09-19T07:30:16.379 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_wr": 0, 2024-09-19T07:30:16.379 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_rd": 2, 2024-09-19T07:30:16.380 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_del": 0 2024-09-19T07:30:16.380 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.380 INFO:teuthology.orchestra.run.smithi165.stdout: "oft": { 2024-09-19T07:30:16.380 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_total_objs": 0, 2024-09-19T07:30:16.380 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_total_kv_pairs": 0, 2024-09-19T07:30:16.380 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_total_updates": 0, 2024-09-19T07:30:16.380 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_total_removes": 0 2024-09-19T07:30:16.380 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.380 INFO:teuthology.orchestra.run.smithi165.stdout: "osd-slow-ops": { 2024-09-19T07:30:16.380 INFO:teuthology.orchestra.run.smithi165.stdout: "slow_ops_count": 0 2024-09-19T07:30:16.380 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.380 INFO:teuthology.orchestra.run.smithi165.stdout: "purge_queue": { 2024-09-19T07:30:16.380 INFO:teuthology.orchestra.run.smithi165.stdout: "pq_executing_ops": 0, 2024-09-19T07:30:16.380 INFO:teuthology.orchestra.run.smithi165.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T07:30:16.380 INFO:teuthology.orchestra.run.smithi165.stdout: "pq_executing": 0, 2024-09-19T07:30:16.381 INFO:teuthology.orchestra.run.smithi165.stdout: "pq_executing_high_water": 0, 2024-09-19T07:30:16.381 INFO:teuthology.orchestra.run.smithi165.stdout: "pq_executed_ops": 0, 2024-09-19T07:30:16.381 INFO:teuthology.orchestra.run.smithi165.stdout: "pq_executed": 0, 2024-09-19T07:30:16.381 INFO:teuthology.orchestra.run.smithi165.stdout: "pq_item_in_journal": 0 2024-09-19T07:30:16.381 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.381 INFO:teuthology.orchestra.run.smithi165.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T07:30:16.381 INFO:teuthology.orchestra.run.smithi165.stdout: "val": 0, 2024-09-19T07:30:16.381 INFO:teuthology.orchestra.run.smithi165.stdout: "max": 104857600, 2024-09-19T07:30:16.381 INFO:teuthology.orchestra.run.smithi165.stdout: "get_started": 0, 2024-09-19T07:30:16.381 INFO:teuthology.orchestra.run.smithi165.stdout: "get": 4817, 2024-09-19T07:30:16.381 INFO:teuthology.orchestra.run.smithi165.stdout: "get_sum": 330553741, 2024-09-19T07:30:16.381 INFO:teuthology.orchestra.run.smithi165.stdout: "get_or_fail_fail": 0, 2024-09-19T07:30:16.381 INFO:teuthology.orchestra.run.smithi165.stdout: "get_or_fail_success": 4817, 2024-09-19T07:30:16.382 INFO:teuthology.orchestra.run.smithi165.stdout: "take": 0, 2024-09-19T07:30:16.382 INFO:teuthology.orchestra.run.smithi165.stdout: "take_sum": 0, 2024-09-19T07:30:16.382 INFO:teuthology.orchestra.run.smithi165.stdout: "put": 4817, 2024-09-19T07:30:16.382 INFO:teuthology.orchestra.run.smithi165.stdout: "put_sum": 330553741, 2024-09-19T07:30:16.382 INFO:teuthology.orchestra.run.smithi165.stdout: "wait": { 2024-09-19T07:30:16.382 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:16.382 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:16.382 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:16.382 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-19T07:30:16.382 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.382 INFO:teuthology.orchestra.run.smithi165.stdout: "throttle-objecter_bytes": { 2024-09-19T07:30:16.382 INFO:teuthology.orchestra.run.smithi165.stdout: "val": 0, 2024-09-19T07:30:16.382 INFO:teuthology.orchestra.run.smithi165.stdout: "max": 104857600, 2024-09-19T07:30:16.382 INFO:teuthology.orchestra.run.smithi165.stdout: "get_started": 0, 2024-09-19T07:30:16.382 INFO:teuthology.orchestra.run.smithi165.stdout: "get": 0, 2024-09-19T07:30:16.383 INFO:teuthology.orchestra.run.smithi165.stdout: "get_sum": 0, 2024-09-19T07:30:16.383 INFO:teuthology.orchestra.run.smithi165.stdout: "get_or_fail_fail": 0, 2024-09-19T07:30:16.383 INFO:teuthology.orchestra.run.smithi165.stdout: "get_or_fail_success": 0, 2024-09-19T07:30:16.383 INFO:teuthology.orchestra.run.smithi165.stdout: "take": 4400, 2024-09-19T07:30:16.383 INFO:teuthology.orchestra.run.smithi165.stdout: "take_sum": 328134211, 2024-09-19T07:30:16.383 INFO:teuthology.orchestra.run.smithi165.stdout: "put": 4400, 2024-09-19T07:30:16.383 INFO:teuthology.orchestra.run.smithi165.stdout: "put_sum": 328134211, 2024-09-19T07:30:16.383 INFO:teuthology.orchestra.run.smithi165.stdout: "wait": { 2024-09-19T07:30:16.383 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:16.383 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:16.383 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:16.383 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-19T07:30:16.383 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.383 INFO:teuthology.orchestra.run.smithi165.stdout: "throttle-objecter_ops": { 2024-09-19T07:30:16.384 INFO:teuthology.orchestra.run.smithi165.stdout: "val": 0, 2024-09-19T07:30:16.384 INFO:teuthology.orchestra.run.smithi165.stdout: "max": 1024, 2024-09-19T07:30:16.384 INFO:teuthology.orchestra.run.smithi165.stdout: "get_started": 0, 2024-09-19T07:30:16.384 INFO:teuthology.orchestra.run.smithi165.stdout: "get": 0, 2024-09-19T07:30:16.384 INFO:teuthology.orchestra.run.smithi165.stdout: "get_sum": 0, 2024-09-19T07:30:16.384 INFO:teuthology.orchestra.run.smithi165.stdout: "get_or_fail_fail": 0, 2024-09-19T07:30:16.384 INFO:teuthology.orchestra.run.smithi165.stdout: "get_or_fail_success": 0, 2024-09-19T07:30:16.384 INFO:teuthology.orchestra.run.smithi165.stdout: "take": 4400, 2024-09-19T07:30:16.384 INFO:teuthology.orchestra.run.smithi165.stdout: "take_sum": 4400, 2024-09-19T07:30:16.384 INFO:teuthology.orchestra.run.smithi165.stdout: "put": 4400, 2024-09-19T07:30:16.384 INFO:teuthology.orchestra.run.smithi165.stdout: "put_sum": 4400, 2024-09-19T07:30:16.384 INFO:teuthology.orchestra.run.smithi165.stdout: "wait": { 2024-09-19T07:30:16.384 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:16.385 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:16.385 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:16.385 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-19T07:30:16.385 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.385 INFO:teuthology.orchestra.run.smithi165.stdout: "throttle-write_buf_throttle": { 2024-09-19T07:30:16.385 INFO:teuthology.orchestra.run.smithi165.stdout: "val": 0, 2024-09-19T07:30:16.385 INFO:teuthology.orchestra.run.smithi165.stdout: "max": 3758096384, 2024-09-19T07:30:16.385 INFO:teuthology.orchestra.run.smithi165.stdout: "get_started": 0, 2024-09-19T07:30:16.385 INFO:teuthology.orchestra.run.smithi165.stdout: "get": 0, 2024-09-19T07:30:16.385 INFO:teuthology.orchestra.run.smithi165.stdout: "get_sum": 0, 2024-09-19T07:30:16.385 INFO:teuthology.orchestra.run.smithi165.stdout: "get_or_fail_fail": 0, 2024-09-19T07:30:16.385 INFO:teuthology.orchestra.run.smithi165.stdout: "get_or_fail_success": 0, 2024-09-19T07:30:16.385 INFO:teuthology.orchestra.run.smithi165.stdout: "take": 0, 2024-09-19T07:30:16.385 INFO:teuthology.orchestra.run.smithi165.stdout: "take_sum": 0, 2024-09-19T07:30:16.386 INFO:teuthology.orchestra.run.smithi165.stdout: "put": 0, 2024-09-19T07:30:16.386 INFO:teuthology.orchestra.run.smithi165.stdout: "put_sum": 0, 2024-09-19T07:30:16.386 INFO:teuthology.orchestra.run.smithi165.stdout: "wait": { 2024-09-19T07:30:16.386 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:16.386 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:16.386 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:16.386 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-19T07:30:16.386 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:16.386 INFO:teuthology.orchestra.run.smithi165.stdout: "throttle-write_buf_throttle-0x55e5de008b40": { 2024-09-19T07:30:16.386 INFO:teuthology.orchestra.run.smithi165.stdout: "val": 0, 2024-09-19T07:30:16.386 INFO:teuthology.orchestra.run.smithi165.stdout: "max": 3758096384, 2024-09-19T07:30:16.386 INFO:teuthology.orchestra.run.smithi165.stdout: "get_started": 0, 2024-09-19T07:30:16.386 INFO:teuthology.orchestra.run.smithi165.stdout: "get": 0, 2024-09-19T07:30:16.386 INFO:teuthology.orchestra.run.smithi165.stdout: "get_sum": 0, 2024-09-19T07:30:16.386 INFO:teuthology.orchestra.run.smithi165.stdout: "get_or_fail_fail": 0, 2024-09-19T07:30:16.387 INFO:teuthology.orchestra.run.smithi165.stdout: "get_or_fail_success": 0, 2024-09-19T07:30:16.387 INFO:teuthology.orchestra.run.smithi165.stdout: "take": 0, 2024-09-19T07:30:16.387 INFO:teuthology.orchestra.run.smithi165.stdout: "take_sum": 0, 2024-09-19T07:30:16.387 INFO:teuthology.orchestra.run.smithi165.stdout: "put": 0, 2024-09-19T07:30:16.387 INFO:teuthology.orchestra.run.smithi165.stdout: "put_sum": 0, 2024-09-19T07:30:16.387 INFO:teuthology.orchestra.run.smithi165.stdout: "wait": { 2024-09-19T07:30:16.387 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:16.387 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:16.387 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:16.387 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-19T07:30:16.387 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-19T07:30:16.387 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-09-19T07:30:17.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:16 smithi165 ceph-mon[35326]: pgmap v605: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 2.2 KiB/s wr, 5 op/s 2024-09-19T07:30:17.134 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:16 smithi148 ceph-mon[31180]: pgmap v605: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 2.2 KiB/s wr, 5 op/s 2024-09-19T07:30:17.249 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-19T07:30:17.249 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-19T07:30:17.249 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-09-19T07:30:17.249 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=0 2024-09-19T07:30:17.249 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=0 2024-09-19T07:30:17.250 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-09-19T07:30:17.250 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T07:30:17.250 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=0 2024-09-19T07:30:17.250 DEBUG:tasks.check_counter:Getting stats from k 2024-09-19T07:30:17.250 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-19T07:30:17.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:16 smithi179 ceph-mon[35716]: pgmap v605: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 2.2 KiB/s wr, 5 op/s 2024-09-19T07:30:17.730 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T07:30:19.120 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:18 smithi165 ceph-mon[35326]: pgmap v606: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-09-19T07:30:19.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:18 smithi179 ceph-mon[35716]: pgmap v606: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-09-19T07:30:19.286 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-09-19T07:30:19.286 INFO:teuthology.orchestra.run.smithi165.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T07:30:19.287 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_messages": 4, 2024-09-19T07:30:19.287 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_messages": 4, 2024-09-19T07:30:19.287 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_bytes": 3024, 2024-09-19T07:30:19.287 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_bytes": 448, 2024-09-19T07:30:19.287 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_created_connections": 4, 2024-09-19T07:30:19.287 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_active_connections": 0, 2024-09-19T07:30:19.287 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_total_time": 0.003029560, 2024-09-19T07:30:19.287 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_send_time": 0.000040899, 2024-09-19T07:30:19.287 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_recv_time": 0.002168721, 2024-09-19T07:30:19.287 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T07:30:19.287 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:30:19.288 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 3, 2024-09-19T07:30:19.288 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.004096097, 2024-09-19T07:30:19.288 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.001365365 2024-09-19T07:30:19.288 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:19.288 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:30:19.288 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:19.288 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:19.288 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:19.288 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:19.288 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-09-19T07:30:19.288 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T07:30:19.289 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:19.289 INFO:teuthology.orchestra.run.smithi165.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T07:30:19.289 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_messages": 355, 2024-09-19T07:30:19.289 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_messages": 345, 2024-09-19T07:30:19.289 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_bytes": 1486704, 2024-09-19T07:30:19.289 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_bytes": 213376, 2024-09-19T07:30:19.289 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_created_connections": 2, 2024-09-19T07:30:19.289 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_active_connections": 1, 2024-09-19T07:30:19.289 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_total_time": 0.056306055, 2024-09-19T07:30:19.289 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_send_time": 0.021704800, 2024-09-19T07:30:19.289 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_recv_time": 0.047507206, 2024-09-19T07:30:19.289 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T07:30:19.290 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:30:19.290 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 344, 2024-09-19T07:30:19.290 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.019223641, 2024-09-19T07:30:19.290 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000055882 2024-09-19T07:30:19.290 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:19.290 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:30:19.290 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:19.290 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:19.290 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:19.290 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:19.290 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_encrypted_bytes": 1486704, 2024-09-19T07:30:19.290 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_encrypted_bytes": 213376 2024-09-19T07:30:19.291 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:19.291 INFO:teuthology.orchestra.run.smithi165.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T07:30:19.291 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_messages": 3, 2024-09-19T07:30:19.291 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_messages": 266, 2024-09-19T07:30:19.291 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_bytes": 480, 2024-09-19T07:30:19.291 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_bytes": 282928, 2024-09-19T07:30:19.291 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_created_connections": 6, 2024-09-19T07:30:19.291 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_active_connections": 3, 2024-09-19T07:30:19.291 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_total_time": 0.015509783, 2024-09-19T07:30:19.291 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_send_time": 0.010593689, 2024-09-19T07:30:19.291 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_recv_time": 0.002083005, 2024-09-19T07:30:19.291 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T07:30:19.291 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:30:19.292 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 263, 2024-09-19T07:30:19.292 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.031581445, 2024-09-19T07:30:19.292 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000120081 2024-09-19T07:30:19.292 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:19.292 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:30:19.292 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:19.292 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:19.292 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:19.292 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:19.292 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_encrypted_bytes": 480, 2024-09-19T07:30:19.292 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_encrypted_bytes": 282928 2024-09-19T07:30:19.292 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:19.292 INFO:teuthology.orchestra.run.smithi165.stdout: "cct": { 2024-09-19T07:30:19.293 INFO:teuthology.orchestra.run.smithi165.stdout: "total_workers": 0, 2024-09-19T07:30:19.293 INFO:teuthology.orchestra.run.smithi165.stdout: "unhealthy_workers": 0 2024-09-19T07:30:19.293 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:19.293 INFO:teuthology.orchestra.run.smithi165.stdout: "mempool": { 2024-09-19T07:30:19.293 INFO:teuthology.orchestra.run.smithi165.stdout: "bloom_filter_bytes": 0, 2024-09-19T07:30:19.293 INFO:teuthology.orchestra.run.smithi165.stdout: "bloom_filter_items": 0, 2024-09-19T07:30:19.293 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T07:30:19.293 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_alloc_items": 0, 2024-09-19T07:30:19.293 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T07:30:19.293 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_data_items": 0, 2024-09-19T07:30:19.293 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T07:30:19.293 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T07:30:19.293 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T07:30:19.293 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T07:30:19.294 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T07:30:19.294 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_other_items": 0, 2024-09-19T07:30:19.294 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T07:30:19.294 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T07:30:19.294 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_extent_bytes": 0, 2024-09-19T07:30:19.294 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_extent_items": 0, 2024-09-19T07:30:19.294 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_blob_bytes": 0, 2024-09-19T07:30:19.294 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_blob_items": 0, 2024-09-19T07:30:19.294 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T07:30:19.294 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T07:30:19.294 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T07:30:19.294 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T07:30:19.294 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T07:30:19.294 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_fsck_items": 0, 2024-09-19T07:30:19.295 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_txc_bytes": 0, 2024-09-19T07:30:19.295 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_txc_items": 0, 2024-09-19T07:30:19.295 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T07:30:19.295 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T07:30:19.295 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_writing_bytes": 0, 2024-09-19T07:30:19.295 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_writing_items": 0, 2024-09-19T07:30:19.295 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_bytes": 0, 2024-09-19T07:30:19.295 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_items": 0, 2024-09-19T07:30:19.295 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T07:30:19.295 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_file_reader_items": 0, 2024-09-19T07:30:19.295 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T07:30:19.295 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_file_writer_items": 0, 2024-09-19T07:30:19.295 INFO:teuthology.orchestra.run.smithi165.stdout: "buffer_anon_bytes": 148714, 2024-09-19T07:30:19.296 INFO:teuthology.orchestra.run.smithi165.stdout: "buffer_anon_items": 30, 2024-09-19T07:30:19.296 INFO:teuthology.orchestra.run.smithi165.stdout: "buffer_meta_bytes": 0, 2024-09-19T07:30:19.296 INFO:teuthology.orchestra.run.smithi165.stdout: "buffer_meta_items": 0, 2024-09-19T07:30:19.296 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_bytes": 0, 2024-09-19T07:30:19.296 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_items": 0, 2024-09-19T07:30:19.296 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_mapbl_bytes": 0, 2024-09-19T07:30:19.296 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_mapbl_items": 0, 2024-09-19T07:30:19.296 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pglog_bytes": 0, 2024-09-19T07:30:19.296 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pglog_items": 0, 2024-09-19T07:30:19.296 INFO:teuthology.orchestra.run.smithi165.stdout: "osdmap_bytes": 0, 2024-09-19T07:30:19.296 INFO:teuthology.orchestra.run.smithi165.stdout: "osdmap_items": 0, 2024-09-19T07:30:19.296 INFO:teuthology.orchestra.run.smithi165.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T07:30:19.297 INFO:teuthology.orchestra.run.smithi165.stdout: "osdmap_mapping_items": 0, 2024-09-19T07:30:19.297 INFO:teuthology.orchestra.run.smithi165.stdout: "pgmap_bytes": 0, 2024-09-19T07:30:19.297 INFO:teuthology.orchestra.run.smithi165.stdout: "pgmap_items": 0, 2024-09-19T07:30:19.297 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_co_bytes": 928, 2024-09-19T07:30:19.297 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_co_items": 2, 2024-09-19T07:30:19.297 INFO:teuthology.orchestra.run.smithi165.stdout: "unittest_1_bytes": 0, 2024-09-19T07:30:19.297 INFO:teuthology.orchestra.run.smithi165.stdout: "unittest_1_items": 0, 2024-09-19T07:30:19.297 INFO:teuthology.orchestra.run.smithi165.stdout: "unittest_2_bytes": 0, 2024-09-19T07:30:19.297 INFO:teuthology.orchestra.run.smithi165.stdout: "unittest_2_items": 0 2024-09-19T07:30:19.297 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-19T07:30:19.297 INFO:teuthology.orchestra.run.smithi165.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T07:30:19.297 INFO:teuthology.orchestra.run.smithi165.stdout: "val": 0, 2024-09-19T07:30:19.297 INFO:teuthology.orchestra.run.smithi165.stdout: "max": 104857600, 2024-09-19T07:30:19.298 INFO:teuthology.orchestra.run.smithi165.stdout: "get_started": 0, 2024-09-19T07:30:19.298 INFO:teuthology.orchestra.run.smithi165.stdout: "get": 358, 2024-09-19T07:30:19.298 INFO:teuthology.orchestra.run.smithi165.stdout: "get_sum": 1436585, 2024-09-19T07:30:19.298 INFO:teuthology.orchestra.run.smithi165.stdout: "get_or_fail_fail": 0, 2024-09-19T07:30:19.298 INFO:teuthology.orchestra.run.smithi165.stdout: "get_or_fail_success": 358, 2024-09-19T07:30:19.298 INFO:teuthology.orchestra.run.smithi165.stdout: "take": 0, 2024-09-19T07:30:19.298 INFO:teuthology.orchestra.run.smithi165.stdout: "take_sum": 0, 2024-09-19T07:30:19.298 INFO:teuthology.orchestra.run.smithi165.stdout: "put": 358, 2024-09-19T07:30:19.298 INFO:teuthology.orchestra.run.smithi165.stdout: "put_sum": 1436585, 2024-09-19T07:30:19.298 INFO:teuthology.orchestra.run.smithi165.stdout: "wait": { 2024-09-19T07:30:19.298 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-19T07:30:19.298 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-19T07:30:19.298 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-19T07:30:19.298 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-19T07:30:19.299 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-19T07:30:19.299 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-09-19T07:30:19.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:18 smithi148 ceph-mon[31180]: pgmap v606: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-09-19T07:30:20.040 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-09-19T07:30:20.040 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-09-19T07:30:20.041 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2024-09-19T07:30:20.041 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2024-09-19T07:30:20.041 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2024-09-19T07:30:20.041 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2024-09-19T07:30:20.041 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2024-09-19T07:30:20.041 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.k 2024-09-19T07:30:20.041 DEBUG:tasks.check_counter:Getting stats from c 2024-09-19T07:30:20.041 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-19T07:30:20.730 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:30:21.125 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:20 smithi179 ceph-mon[35716]: pgmap v607: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.8 KiB/s wr, 5 op/s 2024-09-19T07:30:21.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:20 smithi165 ceph-mon[35326]: pgmap v607: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.8 KiB/s wr, 5 op/s 2024-09-19T07:30:21.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:20 smithi148 ceph-mon[31180]: pgmap v607: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.8 KiB/s wr, 5 op/s 2024-09-19T07:30:21.929 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-19T07:30:21.929 INFO:teuthology.orchestra.run.smithi179.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T07:30:21.929 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_messages": 179301, 2024-09-19T07:30:21.929 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages": 142849, 2024-09-19T07:30:21.929 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_bytes": 84646989, 2024-09-19T07:30:21.929 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_bytes": 156697160, 2024-09-19T07:30:21.930 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_created_connections": 13, 2024-09-19T07:30:21.930 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_active_connections": 6, 2024-09-19T07:30:21.930 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_total_time": 7.640578538, 2024-09-19T07:30:21.930 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_send_time": 3.272307559, 2024-09-19T07:30:21.930 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_recv_time": 5.227868171, 2024-09-19T07:30:21.930 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_fast_dispatch_time": 0.378635577, 2024-09-19T07:30:21.930 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:30:21.930 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 142851, 2024-09-19T07:30:21.930 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 7.857263973, 2024-09-19T07:30:21.930 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000055003 2024-09-19T07:30:21.930 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.930 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:30:21.930 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 298449, 2024-09-19T07:30:21.930 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.041266967, 2024-09-19T07:30:21.931 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000138 2024-09-19T07:30:21.931 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.931 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T07:30:21.931 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T07:30:21.931 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.931 INFO:teuthology.orchestra.run.smithi179.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T07:30:21.931 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_messages": 9977, 2024-09-19T07:30:21.931 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages": 10174, 2024-09-19T07:30:21.931 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_bytes": 4552496, 2024-09-19T07:30:21.931 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_bytes": 123475580, 2024-09-19T07:30:21.931 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_created_connections": 15, 2024-09-19T07:30:21.931 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_active_connections": 6, 2024-09-19T07:30:21.932 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_total_time": 1.258041802, 2024-09-19T07:30:21.932 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_send_time": 0.596604739, 2024-09-19T07:30:21.932 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_recv_time": 0.220775995, 2024-09-19T07:30:21.932 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_fast_dispatch_time": 0.406058184, 2024-09-19T07:30:21.932 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:30:21.932 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 10174, 2024-09-19T07:30:21.932 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 2.549564755, 2024-09-19T07:30:21.932 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000250596 2024-09-19T07:30:21.932 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.933 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:30:21.933 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 8, 2024-09-19T07:30:21.933 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000539, 2024-09-19T07:30:21.933 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000067 2024-09-19T07:30:21.933 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.933 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_encrypted_bytes": 1666880, 2024-09-19T07:30:21.933 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_encrypted_bytes": 982912 2024-09-19T07:30:21.933 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.933 INFO:teuthology.orchestra.run.smithi179.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T07:30:21.933 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_messages": 322180, 2024-09-19T07:30:21.933 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages": 434611, 2024-09-19T07:30:21.933 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_bytes": 108779467, 2024-09-19T07:30:21.933 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_bytes": 319317217, 2024-09-19T07:30:21.934 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_created_connections": 19, 2024-09-19T07:30:21.934 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_active_connections": 8, 2024-09-19T07:30:21.934 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_total_time": 14.023438767, 2024-09-19T07:30:21.934 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_send_time": 6.172717519, 2024-09-19T07:30:21.934 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_recv_time": 14.693656458, 2024-09-19T07:30:21.934 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_fast_dispatch_time": 0.629295575, 2024-09-19T07:30:21.934 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:30:21.934 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 434604, 2024-09-19T07:30:21.934 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 34.454942040, 2024-09-19T07:30:21.934 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000079278 2024-09-19T07:30:21.935 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.935 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:30:21.935 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 607291, 2024-09-19T07:30:21.935 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.126550853, 2024-09-19T07:30:21.935 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000208 2024-09-19T07:30:21.935 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.935 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_encrypted_bytes": 4512, 2024-09-19T07:30:21.935 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_encrypted_bytes": 127040 2024-09-19T07:30:21.935 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.935 INFO:teuthology.orchestra.run.smithi179.stdout: "cct": { 2024-09-19T07:30:21.935 INFO:teuthology.orchestra.run.smithi179.stdout: "total_workers": 1, 2024-09-19T07:30:21.936 INFO:teuthology.orchestra.run.smithi179.stdout: "unhealthy_workers": 0 2024-09-19T07:30:21.936 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.936 INFO:teuthology.orchestra.run.smithi179.stdout: "finisher-MDSRank": { 2024-09-19T07:30:21.936 INFO:teuthology.orchestra.run.smithi179.stdout: "queue_len": 0, 2024-09-19T07:30:21.936 INFO:teuthology.orchestra.run.smithi179.stdout: "complete_latency": { 2024-09-19T07:30:21.936 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 19149, 2024-09-19T07:30:21.936 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 74.825327194, 2024-09-19T07:30:21.936 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.003907531 2024-09-19T07:30:21.936 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-19T07:30:21.936 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.936 INFO:teuthology.orchestra.run.smithi179.stdout: "finisher-PurgeQueue": { 2024-09-19T07:30:21.937 INFO:teuthology.orchestra.run.smithi179.stdout: "queue_len": 0, 2024-09-19T07:30:21.937 INFO:teuthology.orchestra.run.smithi179.stdout: "complete_latency": { 2024-09-19T07:30:21.937 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 20906, 2024-09-19T07:30:21.937 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 6.272167002, 2024-09-19T07:30:21.937 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000300017 2024-09-19T07:30:21.937 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-19T07:30:21.937 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.937 INFO:teuthology.orchestra.run.smithi179.stdout: "mds": { 2024-09-19T07:30:21.937 INFO:teuthology.orchestra.run.smithi179.stdout: "request": 149710, 2024-09-19T07:30:21.937 INFO:teuthology.orchestra.run.smithi179.stdout: "reply": 134087, 2024-09-19T07:30:21.937 INFO:teuthology.orchestra.run.smithi179.stdout: "reply_latency": { 2024-09-19T07:30:21.938 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 134087, 2024-09-19T07:30:21.938 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 5879.566748472, 2024-09-19T07:30:21.938 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.043848894 2024-09-19T07:30:21.938 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.938 INFO:teuthology.orchestra.run.smithi179.stdout: "slow_reply": 0, 2024-09-19T07:30:21.938 INFO:teuthology.orchestra.run.smithi179.stdout: "forward": 15620, 2024-09-19T07:30:21.938 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_fetch_complete": 81, 2024-09-19T07:30:21.938 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_fetch_keys": 0, 2024-09-19T07:30:21.938 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_commit": 802, 2024-09-19T07:30:21.938 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_split": 80, 2024-09-19T07:30:21.938 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_merge": 0, 2024-09-19T07:30:21.938 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes": 18239, 2024-09-19T07:30:21.938 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_top": 3, 2024-09-19T07:30:21.939 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_bottom": 8, 2024-09-19T07:30:21.939 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_pin_tail": 18228, 2024-09-19T07:30:21.939 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_pinned": 18231, 2024-09-19T07:30:21.939 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_expired": 60840, 2024-09-19T07:30:21.939 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_with_caps": 1, 2024-09-19T07:30:21.939 INFO:teuthology.orchestra.run.smithi179.stdout: "caps": 1, 2024-09-19T07:30:21.939 INFO:teuthology.orchestra.run.smithi179.stdout: "subtrees": 4, 2024-09-19T07:30:21.939 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse": 273558, 2024-09-19T07:30:21.939 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_hit": 207824, 2024-09-19T07:30:21.939 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_forward": 15071, 2024-09-19T07:30:21.939 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_discover": 1465, 2024-09-19T07:30:21.939 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_dir_fetch": 14, 2024-09-19T07:30:21.939 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_remote_ino": 0, 2024-09-19T07:30:21.940 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_lock": 991, 2024-09-19T07:30:21.940 INFO:teuthology.orchestra.run.smithi179.stdout: "load_cent": 0, 2024-09-19T07:30:21.940 INFO:teuthology.orchestra.run.smithi179.stdout: "q": 0, 2024-09-19T07:30:21.940 INFO:teuthology.orchestra.run.smithi179.stdout: "exported": 282, 2024-09-19T07:30:21.940 INFO:teuthology.orchestra.run.smithi179.stdout: "exported_inodes": 50128, 2024-09-19T07:30:21.940 INFO:teuthology.orchestra.run.smithi179.stdout: "imported": 226, 2024-09-19T07:30:21.940 INFO:teuthology.orchestra.run.smithi179.stdout: "imported_inodes": 37948, 2024-09-19T07:30:21.940 INFO:teuthology.orchestra.run.smithi179.stdout: "openino_dir_fetch": 0, 2024-09-19T07:30:21.940 INFO:teuthology.orchestra.run.smithi179.stdout: "openino_backtrace_fetch": 1829, 2024-09-19T07:30:21.940 INFO:teuthology.orchestra.run.smithi179.stdout: "openino_peer_discover": 0, 2024-09-19T07:30:21.940 INFO:teuthology.orchestra.run.smithi179.stdout: "root_rfiles": 58682, 2024-09-19T07:30:21.940 INFO:teuthology.orchestra.run.smithi179.stdout: "root_rbytes": 1240435999, 2024-09-19T07:30:21.940 INFO:teuthology.orchestra.run.smithi179.stdout: "root_rsnaps": 6, 2024-09-19T07:30:21.941 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_backtrace_fetch": 1829, 2024-09-19T07:30:21.941 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_set_tag": 0, 2024-09-19T07:30:21.941 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T07:30:21.941 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_inotable_repaired": 0, 2024-09-19T07:30:21.941 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_dir_inodes": 0, 2024-09-19T07:30:21.941 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T07:30:21.941 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T07:30:21.941 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_file_inodes": 1829, 2024-09-19T07:30:21.941 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_inode_file_caps": 380, 2024-09-19T07:30:21.941 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_revoke": 67748, 2024-09-19T07:30:21.941 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_grant": 54608, 2024-09-19T07:30:21.941 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T07:30:21.941 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T07:30:21.942 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T07:30:21.942 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_caps": 93770, 2024-09-19T07:30:21.942 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_caps_dirty": 23717, 2024-09-19T07:30:21.942 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_cap_release": 2389, 2024-09-19T07:30:21.942 INFO:teuthology.orchestra.run.smithi179.stdout: "process_request_cap_release": 36587 2024-09-19T07:30:21.942 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.942 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_cache": { 2024-09-19T07:30:21.942 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_update": 1782, 2024-09-19T07:30:21.942 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_update_receipt": 7651, 2024-09-19T07:30:21.942 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_try_discover": 4222, 2024-09-19T07:30:21.942 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_send_discover": 5390, 2024-09-19T07:30:21.942 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_handle_discover": 2950, 2024-09-19T07:30:21.942 INFO:teuthology.orchestra.run.smithi179.stdout: "num_strays": 51, 2024-09-19T07:30:21.943 INFO:teuthology.orchestra.run.smithi179.stdout: "num_strays_delayed": 0, 2024-09-19T07:30:21.943 INFO:teuthology.orchestra.run.smithi179.stdout: "num_strays_enqueuing": 0, 2024-09-19T07:30:21.943 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_created": 11891, 2024-09-19T07:30:21.943 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_enqueued": 11840, 2024-09-19T07:30:21.943 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_reintegrated": 0, 2024-09-19T07:30:21.943 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_migrated": 0, 2024-09-19T07:30:21.943 INFO:teuthology.orchestra.run.smithi179.stdout: "num_recovering_processing": 0, 2024-09-19T07:30:21.943 INFO:teuthology.orchestra.run.smithi179.stdout: "num_recovering_enqueued": 0, 2024-09-19T07:30:21.943 INFO:teuthology.orchestra.run.smithi179.stdout: "num_recovering_prioritized": 0, 2024-09-19T07:30:21.943 INFO:teuthology.orchestra.run.smithi179.stdout: "recovery_started": 0, 2024-09-19T07:30:21.943 INFO:teuthology.orchestra.run.smithi179.stdout: "recovery_completed": 0, 2024-09-19T07:30:21.943 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_quiesce_path": 15, 2024-09-19T07:30:21.944 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_quiesce_inode": 185314, 2024-09-19T07:30:21.944 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T07:30:21.944 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_exportdir": 286, 2024-09-19T07:30:21.944 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_flush": 0, 2024-09-19T07:30:21.944 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_fragmentdir": 80, 2024-09-19T07:30:21.944 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_fragstats": 0, 2024-09-19T07:30:21.944 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_inodestats": 0 2024-09-19T07:30:21.944 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.944 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_log": { 2024-09-19T07:30:21.944 INFO:teuthology.orchestra.run.smithi179.stdout: "evlrg": 3, 2024-09-19T07:30:21.944 INFO:teuthology.orchestra.run.smithi179.stdout: "evadd": 105025, 2024-09-19T07:30:21.945 INFO:teuthology.orchestra.run.smithi179.stdout: "evex": 17233, 2024-09-19T07:30:21.945 INFO:teuthology.orchestra.run.smithi179.stdout: "evtrm": 12291, 2024-09-19T07:30:21.945 INFO:teuthology.orchestra.run.smithi179.stdout: "ev": 92734, 2024-09-19T07:30:21.945 INFO:teuthology.orchestra.run.smithi179.stdout: "evexg": 0, 2024-09-19T07:30:21.945 INFO:teuthology.orchestra.run.smithi179.stdout: "evexd": 4942, 2024-09-19T07:30:21.945 INFO:teuthology.orchestra.run.smithi179.stdout: "segadd": 148, 2024-09-19T07:30:21.945 INFO:teuthology.orchestra.run.smithi179.stdout: "segex": 20, 2024-09-19T07:30:21.945 INFO:teuthology.orchestra.run.smithi179.stdout: "segtrm": 14, 2024-09-19T07:30:21.945 INFO:teuthology.orchestra.run.smithi179.stdout: "seg": 134, 2024-09-19T07:30:21.945 INFO:teuthology.orchestra.run.smithi179.stdout: "segmjr": 8, 2024-09-19T07:30:21.945 INFO:teuthology.orchestra.run.smithi179.stdout: "segexg": 0, 2024-09-19T07:30:21.946 INFO:teuthology.orchestra.run.smithi179.stdout: "segexd": 6, 2024-09-19T07:30:21.946 INFO:teuthology.orchestra.run.smithi179.stdout: "expos": 30149232, 2024-09-19T07:30:21.946 INFO:teuthology.orchestra.run.smithi179.stdout: "wrpos": 332283695, 2024-09-19T07:30:21.946 INFO:teuthology.orchestra.run.smithi179.stdout: "rdpos": 0, 2024-09-19T07:30:21.946 INFO:teuthology.orchestra.run.smithi179.stdout: "jlat": { 2024-09-19T07:30:21.946 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 12599, 2024-09-19T07:30:21.946 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 537.647878195, 2024-09-19T07:30:21.946 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.042673853 2024-09-19T07:30:21.946 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.946 INFO:teuthology.orchestra.run.smithi179.stdout: "replayed": 0 2024-09-19T07:30:21.946 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.947 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_mem": { 2024-09-19T07:30:21.947 INFO:teuthology.orchestra.run.smithi179.stdout: "ino": 8971, 2024-09-19T07:30:21.947 INFO:teuthology.orchestra.run.smithi179.stdout: "ino+": 55889, 2024-09-19T07:30:21.947 INFO:teuthology.orchestra.run.smithi179.stdout: "ino-": 46918, 2024-09-19T07:30:21.947 INFO:teuthology.orchestra.run.smithi179.stdout: "dir": 383, 2024-09-19T07:30:21.947 INFO:teuthology.orchestra.run.smithi179.stdout: "dir+": 4999, 2024-09-19T07:30:21.947 INFO:teuthology.orchestra.run.smithi179.stdout: "dir-": 4616, 2024-09-19T07:30:21.947 INFO:teuthology.orchestra.run.smithi179.stdout: "dn": 18239, 2024-09-19T07:30:21.947 INFO:teuthology.orchestra.run.smithi179.stdout: "dn+": 93868, 2024-09-19T07:30:21.948 INFO:teuthology.orchestra.run.smithi179.stdout: "dn-": 75629, 2024-09-19T07:30:21.948 INFO:teuthology.orchestra.run.smithi179.stdout: "cap": 1, 2024-09-19T07:30:21.948 INFO:teuthology.orchestra.run.smithi179.stdout: "cap+": 45125, 2024-09-19T07:30:21.948 INFO:teuthology.orchestra.run.smithi179.stdout: "cap-": 45124, 2024-09-19T07:30:21.948 INFO:teuthology.orchestra.run.smithi179.stdout: "rss": 239392, 2024-09-19T07:30:21.948 INFO:teuthology.orchestra.run.smithi179.stdout: "heap": 223520 2024-09-19T07:30:21.948 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.948 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_server": { 2024-09-19T07:30:21.948 INFO:teuthology.orchestra.run.smithi179.stdout: "dispatch_client_request": 164992, 2024-09-19T07:30:21.948 INFO:teuthology.orchestra.run.smithi179.stdout: "dispatch_server_request": 5336, 2024-09-19T07:30:21.949 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_request": 149710, 2024-09-19T07:30:21.949 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_session": 515, 2024-09-19T07:30:21.949 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_peer_request": 15824, 2024-09-19T07:30:21.949 INFO:teuthology.orchestra.run.smithi179.stdout: "req_create_latency": { 2024-09-19T07:30:21.949 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 15822, 2024-09-19T07:30:21.949 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 389.350808416, 2024-09-19T07:30:21.949 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.024608191 2024-09-19T07:30:21.949 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.949 INFO:teuthology.orchestra.run.smithi179.stdout: "req_getattr_latency": { 2024-09-19T07:30:21.949 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 160, 2024-09-19T07:30:21.950 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 25.878674939, 2024-09-19T07:30:21.950 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.161741718 2024-09-19T07:30:21.950 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.950 INFO:teuthology.orchestra.run.smithi179.stdout: "req_getfilelock_latency": { 2024-09-19T07:30:21.950 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:21.950 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:21.950 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:21.950 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.950 INFO:teuthology.orchestra.run.smithi179.stdout: "req_link_latency": { 2024-09-19T07:30:21.950 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:21.951 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:21.951 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:21.951 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.951 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookup_latency": { 2024-09-19T07:30:21.951 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 84361, 2024-09-19T07:30:21.951 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 4868.372544205, 2024-09-19T07:30:21.951 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.057708805 2024-09-19T07:30:21.951 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.951 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookuphash_latency": { 2024-09-19T07:30:21.951 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:21.951 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:21.951 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:21.952 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.952 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupino_latency": { 2024-09-19T07:30:21.952 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 1, 2024-09-19T07:30:21.952 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000134864, 2024-09-19T07:30:21.952 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000134864 2024-09-19T07:30:21.952 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.952 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupname_latency": { 2024-09-19T07:30:21.952 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:21.952 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:21.952 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:21.952 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.952 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupparent_latency": { 2024-09-19T07:30:21.952 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:21.953 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:21.953 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:21.953 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.953 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupsnap_latency": { 2024-09-19T07:30:21.953 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:21.953 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:21.953 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:21.953 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.953 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lssnap_latency": { 2024-09-19T07:30:21.953 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:21.953 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:21.953 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:21.953 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.954 INFO:teuthology.orchestra.run.smithi179.stdout: "req_mkdir_latency": { 2024-09-19T07:30:21.954 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 65, 2024-09-19T07:30:21.954 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 4.278244493, 2024-09-19T07:30:21.954 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.065819146 2024-09-19T07:30:21.954 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.954 INFO:teuthology.orchestra.run.smithi179.stdout: "req_mknod_latency": { 2024-09-19T07:30:21.954 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:21.954 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:21.954 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:21.954 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.954 INFO:teuthology.orchestra.run.smithi179.stdout: "req_mksnap_latency": { 2024-09-19T07:30:21.954 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:21.954 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:21.954 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:21.955 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.955 INFO:teuthology.orchestra.run.smithi179.stdout: "req_open_latency": { 2024-09-19T07:30:21.955 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 10235, 2024-09-19T07:30:21.955 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 65.960605892, 2024-09-19T07:30:21.955 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.006444612 2024-09-19T07:30:21.955 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.955 INFO:teuthology.orchestra.run.smithi179.stdout: "req_readdir_latency": { 2024-09-19T07:30:21.955 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 362, 2024-09-19T07:30:21.955 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 1.740298414, 2024-09-19T07:30:21.955 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.004807454 2024-09-19T07:30:21.955 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.955 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rename_latency": { 2024-09-19T07:30:21.956 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 15779, 2024-09-19T07:30:21.956 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 508.017850452, 2024-09-19T07:30:21.956 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.032195820 2024-09-19T07:30:21.956 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.956 INFO:teuthology.orchestra.run.smithi179.stdout: "req_renamesnap_latency": { 2024-09-19T07:30:21.956 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:21.956 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:21.956 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:21.956 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.956 INFO:teuthology.orchestra.run.smithi179.stdout: "req_snapdiff_latency": { 2024-09-19T07:30:21.956 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:21.956 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:21.956 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:21.957 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.957 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rmdir_latency": { 2024-09-19T07:30:21.957 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 51, 2024-09-19T07:30:21.957 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 5.280644532, 2024-09-19T07:30:21.957 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.103542049 2024-09-19T07:30:21.957 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.957 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rmsnap_latency": { 2024-09-19T07:30:21.957 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:21.957 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:21.957 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:21.957 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.957 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rmxattr_latency": { 2024-09-19T07:30:21.957 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:21.958 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:21.958 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:21.958 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.958 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setattr_latency": { 2024-09-19T07:30:21.958 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:21.958 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:21.958 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:21.958 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.958 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setdirlayout_latency": { 2024-09-19T07:30:21.958 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:21.958 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:21.958 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:21.958 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.959 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setfilelock_latency": { 2024-09-19T07:30:21.959 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:21.959 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:21.959 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:21.959 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.959 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setlayout_latency": { 2024-09-19T07:30:21.959 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:21.959 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:21.959 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:21.959 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.959 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setxattr_latency": { 2024-09-19T07:30:21.959 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:21.959 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:21.960 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:21.960 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.960 INFO:teuthology.orchestra.run.smithi179.stdout: "req_symlink_latency": { 2024-09-19T07:30:21.960 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:21.960 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:21.960 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:21.960 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.960 INFO:teuthology.orchestra.run.smithi179.stdout: "req_unlink_latency": { 2024-09-19T07:30:21.960 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 7251, 2024-09-19T07:30:21.960 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 10.686942265, 2024-09-19T07:30:21.960 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.001473857 2024-09-19T07:30:21.960 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.960 INFO:teuthology.orchestra.run.smithi179.stdout: "cap_revoke_eviction": 0, 2024-09-19T07:30:21.960 INFO:teuthology.orchestra.run.smithi179.stdout: "cap_acquisition_throttle": 0, 2024-09-19T07:30:21.961 INFO:teuthology.orchestra.run.smithi179.stdout: "req_getvxattr_latency": { 2024-09-19T07:30:21.961 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:21.961 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:21.961 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:21.961 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-19T07:30:21.961 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.961 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_sessions": { 2024-09-19T07:30:21.961 INFO:teuthology.orchestra.run.smithi179.stdout: "session_count": 1, 2024-09-19T07:30:21.961 INFO:teuthology.orchestra.run.smithi179.stdout: "session_add": 4, 2024-09-19T07:30:21.961 INFO:teuthology.orchestra.run.smithi179.stdout: "session_remove": 3, 2024-09-19T07:30:21.961 INFO:teuthology.orchestra.run.smithi179.stdout: "sessions_open": 1, 2024-09-19T07:30:21.961 INFO:teuthology.orchestra.run.smithi179.stdout: "sessions_stale": 0, 2024-09-19T07:30:21.961 INFO:teuthology.orchestra.run.smithi179.stdout: "total_load": 12905, 2024-09-19T07:30:21.962 INFO:teuthology.orchestra.run.smithi179.stdout: "average_load": 12905, 2024-09-19T07:30:21.962 INFO:teuthology.orchestra.run.smithi179.stdout: "avg_session_uptime": 1134, 2024-09-19T07:30:21.962 INFO:teuthology.orchestra.run.smithi179.stdout: "mdthresh_evicted": 0 2024-09-19T07:30:21.962 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.962 INFO:teuthology.orchestra.run.smithi179.stdout: "mempool": { 2024-09-19T07:30:21.962 INFO:teuthology.orchestra.run.smithi179.stdout: "bloom_filter_bytes": 0, 2024-09-19T07:30:21.962 INFO:teuthology.orchestra.run.smithi179.stdout: "bloom_filter_items": 0, 2024-09-19T07:30:21.962 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T07:30:21.962 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_alloc_items": 0, 2024-09-19T07:30:21.962 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T07:30:21.962 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_data_items": 0, 2024-09-19T07:30:21.962 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T07:30:21.962 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T07:30:21.963 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T07:30:21.963 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T07:30:21.963 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T07:30:21.963 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_other_items": 0, 2024-09-19T07:30:21.963 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T07:30:21.963 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T07:30:21.963 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_extent_bytes": 0, 2024-09-19T07:30:21.963 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_extent_items": 0, 2024-09-19T07:30:21.963 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_blob_bytes": 0, 2024-09-19T07:30:21.963 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_blob_items": 0, 2024-09-19T07:30:21.963 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T07:30:21.963 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T07:30:21.963 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T07:30:21.963 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T07:30:21.964 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T07:30:21.964 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_fsck_items": 0, 2024-09-19T07:30:21.964 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_txc_bytes": 0, 2024-09-19T07:30:21.964 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_txc_items": 0, 2024-09-19T07:30:21.964 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T07:30:21.964 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T07:30:21.964 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_bytes": 0, 2024-09-19T07:30:21.964 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_items": 0, 2024-09-19T07:30:21.964 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_bytes": 0, 2024-09-19T07:30:21.964 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_items": 0, 2024-09-19T07:30:21.964 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T07:30:21.964 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_reader_items": 0, 2024-09-19T07:30:21.964 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T07:30:21.964 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_writer_items": 0, 2024-09-19T07:30:21.965 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_anon_bytes": 1023126, 2024-09-19T07:30:21.965 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_anon_items": 8592, 2024-09-19T07:30:21.965 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_meta_bytes": 0, 2024-09-19T07:30:21.965 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_meta_items": 0, 2024-09-19T07:30:21.965 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_bytes": 0, 2024-09-19T07:30:21.965 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_items": 0, 2024-09-19T07:30:21.965 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_mapbl_bytes": 0, 2024-09-19T07:30:21.965 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_mapbl_items": 0, 2024-09-19T07:30:21.965 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_pglog_bytes": 0, 2024-09-19T07:30:21.965 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_pglog_items": 0, 2024-09-19T07:30:21.965 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_bytes": 8344, 2024-09-19T07:30:21.965 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_items": 185, 2024-09-19T07:30:21.965 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T07:30:21.965 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_mapping_items": 0, 2024-09-19T07:30:21.966 INFO:teuthology.orchestra.run.smithi179.stdout: "pgmap_bytes": 0, 2024-09-19T07:30:21.966 INFO:teuthology.orchestra.run.smithi179.stdout: "pgmap_items": 0, 2024-09-19T07:30:21.966 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_co_bytes": 34443906, 2024-09-19T07:30:21.966 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_co_items": 371643, 2024-09-19T07:30:21.966 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_1_bytes": 0, 2024-09-19T07:30:21.966 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_1_items": 0, 2024-09-19T07:30:21.966 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_2_bytes": 0, 2024-09-19T07:30:21.966 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_2_items": 0 2024-09-19T07:30:21.966 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.966 INFO:teuthology.orchestra.run.smithi179.stdout: "objecter": { 2024-09-19T07:30:21.966 INFO:teuthology.orchestra.run.smithi179.stdout: "op_active": 0, 2024-09-19T07:30:21.966 INFO:teuthology.orchestra.run.smithi179.stdout: "op_laggy": 0, 2024-09-19T07:30:21.966 INFO:teuthology.orchestra.run.smithi179.stdout: "op_send": 29702, 2024-09-19T07:30:21.966 INFO:teuthology.orchestra.run.smithi179.stdout: "op_send_bytes": 348030767, 2024-09-19T07:30:21.967 INFO:teuthology.orchestra.run.smithi179.stdout: "op_resend": 32, 2024-09-19T07:30:21.967 INFO:teuthology.orchestra.run.smithi179.stdout: "op_reply": 29702, 2024-09-19T07:30:21.967 INFO:teuthology.orchestra.run.smithi179.stdout: "op_latency": { 2024-09-19T07:30:21.967 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 29702, 2024-09-19T07:30:21.967 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 677.015576485, 2024-09-19T07:30:21.967 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.022793602 2024-09-19T07:30:21.967 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.967 INFO:teuthology.orchestra.run.smithi179.stdout: "op_inflight": 0, 2024-09-19T07:30:21.967 INFO:teuthology.orchestra.run.smithi179.stdout: "oplen_avg": { 2024-09-19T07:30:21.967 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 29702, 2024-09-19T07:30:21.967 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 32719 2024-09-19T07:30:21.967 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.967 INFO:teuthology.orchestra.run.smithi179.stdout: "op": 29702, 2024-09-19T07:30:21.967 INFO:teuthology.orchestra.run.smithi179.stdout: "op_r": 2406, 2024-09-19T07:30:21.968 INFO:teuthology.orchestra.run.smithi179.stdout: "op_w": 27296, 2024-09-19T07:30:21.968 INFO:teuthology.orchestra.run.smithi179.stdout: "op_rmw": 0, 2024-09-19T07:30:21.968 INFO:teuthology.orchestra.run.smithi179.stdout: "op_pg": 0, 2024-09-19T07:30:21.968 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_stat": 80, 2024-09-19T07:30:21.968 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_create": 592, 2024-09-19T07:30:21.968 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_read": 496, 2024-09-19T07:30:21.968 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_write": 13095, 2024-09-19T07:30:21.968 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_writefull": 314, 2024-09-19T07:30:21.968 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_writesame": 0, 2024-09-19T07:30:21.968 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_append": 0, 2024-09-19T07:30:21.968 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_zero": 0, 2024-09-19T07:30:21.968 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_truncate": 80, 2024-09-19T07:30:21.968 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_delete": 11936, 2024-09-19T07:30:21.969 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_mapext": 0, 2024-09-19T07:30:21.969 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_sparse_read": 0, 2024-09-19T07:30:21.969 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_clonerange": 0, 2024-09-19T07:30:21.969 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_getxattr": 1829, 2024-09-19T07:30:21.969 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_setxattr": 1184, 2024-09-19T07:30:21.969 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_cmpxattr": 0, 2024-09-19T07:30:21.969 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_rmxattr": 0, 2024-09-19T07:30:21.969 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_resetxattrs": 0, 2024-09-19T07:30:21.969 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_call": 0, 2024-09-19T07:30:21.969 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_watch": 0, 2024-09-19T07:30:21.969 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_notify": 0, 2024-09-19T07:30:21.969 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T07:30:21.969 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_pgls": 0, 2024-09-19T07:30:21.969 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_pgls_filter": 0, 2024-09-19T07:30:21.970 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_other": 0, 2024-09-19T07:30:21.970 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_active": 0, 2024-09-19T07:30:21.970 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_send": 0, 2024-09-19T07:30:21.970 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_resend": 0, 2024-09-19T07:30:21.970 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_ping": 0, 2024-09-19T07:30:21.970 INFO:teuthology.orchestra.run.smithi179.stdout: "poolop_active": 0, 2024-09-19T07:30:21.970 INFO:teuthology.orchestra.run.smithi179.stdout: "poolop_send": 0, 2024-09-19T07:30:21.970 INFO:teuthology.orchestra.run.smithi179.stdout: "poolop_resend": 0, 2024-09-19T07:30:21.970 INFO:teuthology.orchestra.run.smithi179.stdout: "poolstat_active": 0, 2024-09-19T07:30:21.970 INFO:teuthology.orchestra.run.smithi179.stdout: "poolstat_send": 0, 2024-09-19T07:30:21.970 INFO:teuthology.orchestra.run.smithi179.stdout: "poolstat_resend": 0, 2024-09-19T07:30:21.970 INFO:teuthology.orchestra.run.smithi179.stdout: "statfs_active": 0, 2024-09-19T07:30:21.970 INFO:teuthology.orchestra.run.smithi179.stdout: "statfs_send": 0, 2024-09-19T07:30:21.970 INFO:teuthology.orchestra.run.smithi179.stdout: "statfs_resend": 0, 2024-09-19T07:30:21.971 INFO:teuthology.orchestra.run.smithi179.stdout: "command_active": 0, 2024-09-19T07:30:21.971 INFO:teuthology.orchestra.run.smithi179.stdout: "command_send": 0, 2024-09-19T07:30:21.971 INFO:teuthology.orchestra.run.smithi179.stdout: "command_resend": 0, 2024-09-19T07:30:21.971 INFO:teuthology.orchestra.run.smithi179.stdout: "map_epoch": 107, 2024-09-19T07:30:21.971 INFO:teuthology.orchestra.run.smithi179.stdout: "map_full": 0, 2024-09-19T07:30:21.971 INFO:teuthology.orchestra.run.smithi179.stdout: "map_inc": 29, 2024-09-19T07:30:21.971 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_sessions": 12, 2024-09-19T07:30:21.971 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_session_open": 12, 2024-09-19T07:30:21.971 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_session_close": 0, 2024-09-19T07:30:21.971 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_laggy": 0, 2024-09-19T07:30:21.971 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_wr": 2472, 2024-09-19T07:30:21.971 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_rd": 162, 2024-09-19T07:30:21.971 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_del": 479 2024-09-19T07:30:21.972 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.972 INFO:teuthology.orchestra.run.smithi179.stdout: "oft": { 2024-09-19T07:30:21.972 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_objs": 1, 2024-09-19T07:30:21.972 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_kv_pairs": 0, 2024-09-19T07:30:21.972 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_updates": 0, 2024-09-19T07:30:21.972 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_removes": 0 2024-09-19T07:30:21.972 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.972 INFO:teuthology.orchestra.run.smithi179.stdout: "osd-slow-ops": { 2024-09-19T07:30:21.972 INFO:teuthology.orchestra.run.smithi179.stdout: "slow_ops_count": 185141 2024-09-19T07:30:21.972 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.972 INFO:teuthology.orchestra.run.smithi179.stdout: "purge_queue": { 2024-09-19T07:30:21.972 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing_ops": 0, 2024-09-19T07:30:21.972 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing_ops_high_water": 10, 2024-09-19T07:30:21.973 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing": 0, 2024-09-19T07:30:21.973 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing_high_water": 10, 2024-09-19T07:30:21.973 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executed_ops": 11840, 2024-09-19T07:30:21.973 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executed": 11840, 2024-09-19T07:30:21.973 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_item_in_journal": 0 2024-09-19T07:30:21.973 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.973 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T07:30:21.973 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-09-19T07:30:21.973 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 104857600, 2024-09-19T07:30:21.973 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-09-19T07:30:21.973 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 511454, 2024-09-19T07:30:21.973 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 151921418, 2024-09-19T07:30:21.973 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-09-19T07:30:21.974 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 511454, 2024-09-19T07:30:21.974 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 0, 2024-09-19T07:30:21.974 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 0, 2024-09-19T07:30:21.974 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 511454, 2024-09-19T07:30:21.974 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 151921418, 2024-09-19T07:30:21.974 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-09-19T07:30:21.974 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:21.975 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:21.975 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:21.975 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-19T07:30:21.975 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.975 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-objecter_bytes": { 2024-09-19T07:30:21.975 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-09-19T07:30:21.975 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 104857600, 2024-09-19T07:30:21.975 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-09-19T07:30:21.976 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 0, 2024-09-19T07:30:21.976 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 0, 2024-09-19T07:30:21.976 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-09-19T07:30:21.976 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 0, 2024-09-19T07:30:21.976 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 29702, 2024-09-19T07:30:21.976 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 349616479, 2024-09-19T07:30:21.976 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 29702, 2024-09-19T07:30:21.976 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 349616479, 2024-09-19T07:30:21.976 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-09-19T07:30:21.976 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:21.977 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:21.977 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:21.977 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-19T07:30:21.977 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.977 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-objecter_ops": { 2024-09-19T07:30:21.977 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-09-19T07:30:21.977 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 1024, 2024-09-19T07:30:21.977 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-09-19T07:30:21.977 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 0, 2024-09-19T07:30:21.977 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 0, 2024-09-19T07:30:21.977 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-09-19T07:30:21.977 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 0, 2024-09-19T07:30:21.978 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 29702, 2024-09-19T07:30:21.978 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 29702, 2024-09-19T07:30:21.978 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 29702, 2024-09-19T07:30:21.978 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 29702, 2024-09-19T07:30:21.978 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-09-19T07:30:21.978 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:21.978 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:21.978 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:21.978 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-19T07:30:21.978 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.978 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-write_buf_throttle": { 2024-09-19T07:30:21.978 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-09-19T07:30:21.979 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 3758096384, 2024-09-19T07:30:21.979 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-09-19T07:30:21.979 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 11840, 2024-09-19T07:30:21.979 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 1587008, 2024-09-19T07:30:21.979 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-09-19T07:30:21.979 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 11840, 2024-09-19T07:30:21.979 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 0, 2024-09-19T07:30:21.979 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 0, 2024-09-19T07:30:21.979 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 496, 2024-09-19T07:30:21.979 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 1587008, 2024-09-19T07:30:21.979 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-09-19T07:30:21.979 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:21.979 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:21.980 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:21.980 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-19T07:30:21.980 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:21.980 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-write_buf_throttle-0x55c35a758960": { 2024-09-19T07:30:21.980 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-09-19T07:30:21.980 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 3758096384, 2024-09-19T07:30:21.980 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-09-19T07:30:21.980 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 105025, 2024-09-19T07:30:21.980 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 328089391, 2024-09-19T07:30:21.981 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-09-19T07:30:21.981 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 105025, 2024-09-19T07:30:21.981 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 0, 2024-09-19T07:30:21.981 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 0, 2024-09-19T07:30:21.981 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 12599, 2024-09-19T07:30:21.981 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 328089391, 2024-09-19T07:30:21.981 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-09-19T07:30:21.981 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:21.981 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:21.981 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:21.981 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-19T07:30:21.982 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-19T07:30:21.982 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-19T07:30:23.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:22 smithi165 ceph-mon[35326]: pgmap v608: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-09-19T07:30:23.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:22 smithi179 ceph-mon[35716]: pgmap v608: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-09-19T07:30:23.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:22 smithi148 ceph-mon[31180]: pgmap v608: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-09-19T07:30:23.658 INFO:tasks.check_counter:Daemon mds.c mds.exported=282 2024-09-19T07:30:23.659 INFO:tasks.check_counter:Daemon mds.c mds.imported=226 2024-09-19T07:30:23.659 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=1782 2024-09-19T07:30:23.659 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=7651 2024-09-19T07:30:23.659 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=6 2024-09-19T07:30:23.659 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-09-19T07:30:23.659 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T07:30:23.659 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=80 2024-09-19T07:30:23.659 DEBUG:tasks.check_counter:Getting stats from f 2024-09-19T07:30:23.659 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-19T07:30:24.213 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:30:25.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:24 smithi165 ceph-mon[35326]: pgmap v609: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2024-09-19T07:30:25.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:24 smithi179 ceph-mon[35716]: pgmap v609: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2024-09-19T07:30:25.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:24 smithi148 ceph-mon[31180]: pgmap v609: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2024-09-19T07:30:25.802 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-19T07:30:25.802 INFO:teuthology.orchestra.run.smithi179.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T07:30:25.802 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_messages": 0, 2024-09-19T07:30:25.802 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages": 2, 2024-09-19T07:30:25.802 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_bytes": 0, 2024-09-19T07:30:25.803 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_bytes": 0, 2024-09-19T07:30:25.803 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_created_connections": 4, 2024-09-19T07:30:25.803 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_active_connections": 0, 2024-09-19T07:30:25.803 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_total_time": 0.001515095, 2024-09-19T07:30:25.803 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T07:30:25.803 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_recv_time": 0.000266131, 2024-09-19T07:30:25.803 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T07:30:25.803 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:30:25.803 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:25.803 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:25.803 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:25.804 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:25.804 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:30:25.804 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:25.804 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:25.804 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:25.804 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:25.804 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T07:30:25.804 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T07:30:25.804 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:25.804 INFO:teuthology.orchestra.run.smithi179.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T07:30:25.804 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_messages": 2, 2024-09-19T07:30:25.805 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages": 204, 2024-09-19T07:30:25.805 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_bytes": 320, 2024-09-19T07:30:25.805 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_bytes": 193312, 2024-09-19T07:30:25.805 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_created_connections": 4, 2024-09-19T07:30:25.805 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_active_connections": 2, 2024-09-19T07:30:25.805 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_total_time": 0.011632032, 2024-09-19T07:30:25.805 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_send_time": 0.008373777, 2024-09-19T07:30:25.805 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_recv_time": 0.001248854, 2024-09-19T07:30:25.805 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T07:30:25.806 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:30:25.806 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 202, 2024-09-19T07:30:25.806 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.009725245, 2024-09-19T07:30:25.806 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000048144 2024-09-19T07:30:25.806 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:25.806 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:30:25.806 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:25.806 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:25.806 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:25.806 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:25.807 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T07:30:25.807 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_encrypted_bytes": 193312 2024-09-19T07:30:25.807 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:25.807 INFO:teuthology.orchestra.run.smithi179.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T07:30:25.807 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_messages": 272, 2024-09-19T07:30:25.807 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages": 269, 2024-09-19T07:30:25.807 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_bytes": 220560, 2024-09-19T07:30:25.807 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_bytes": 164992, 2024-09-19T07:30:25.808 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_created_connections": 2, 2024-09-19T07:30:25.808 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_active_connections": 1, 2024-09-19T07:30:25.808 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_total_time": 0.034404202, 2024-09-19T07:30:25.808 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_send_time": 0.015796637, 2024-09-19T07:30:25.808 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_recv_time": 0.020386337, 2024-09-19T07:30:25.808 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T07:30:25.808 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:30:25.808 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 269, 2024-09-19T07:30:25.808 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.018035966, 2024-09-19T07:30:25.808 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000067048 2024-09-19T07:30:25.808 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:25.808 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:30:25.809 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:25.809 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:25.809 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:25.809 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:25.809 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_encrypted_bytes": 220560, 2024-09-19T07:30:25.809 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_encrypted_bytes": 164992 2024-09-19T07:30:25.809 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:25.809 INFO:teuthology.orchestra.run.smithi179.stdout: "cct": { 2024-09-19T07:30:25.809 INFO:teuthology.orchestra.run.smithi179.stdout: "total_workers": 0, 2024-09-19T07:30:25.809 INFO:teuthology.orchestra.run.smithi179.stdout: "unhealthy_workers": 0 2024-09-19T07:30:25.809 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:25.809 INFO:teuthology.orchestra.run.smithi179.stdout: "mempool": { 2024-09-19T07:30:25.809 INFO:teuthology.orchestra.run.smithi179.stdout: "bloom_filter_bytes": 0, 2024-09-19T07:30:25.810 INFO:teuthology.orchestra.run.smithi179.stdout: "bloom_filter_items": 0, 2024-09-19T07:30:25.810 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T07:30:25.810 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_alloc_items": 0, 2024-09-19T07:30:25.810 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T07:30:25.810 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_data_items": 0, 2024-09-19T07:30:25.810 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T07:30:25.810 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T07:30:25.810 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T07:30:25.810 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T07:30:25.810 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T07:30:25.811 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_other_items": 0, 2024-09-19T07:30:25.811 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T07:30:25.811 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T07:30:25.811 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_extent_bytes": 0, 2024-09-19T07:30:25.811 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_extent_items": 0, 2024-09-19T07:30:25.811 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_blob_bytes": 0, 2024-09-19T07:30:25.811 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_blob_items": 0, 2024-09-19T07:30:25.811 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T07:30:25.811 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T07:30:25.811 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T07:30:25.811 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T07:30:25.811 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T07:30:25.811 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_fsck_items": 0, 2024-09-19T07:30:25.812 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_txc_bytes": 0, 2024-09-19T07:30:25.812 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_txc_items": 0, 2024-09-19T07:30:25.812 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T07:30:25.812 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T07:30:25.812 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_bytes": 0, 2024-09-19T07:30:25.812 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_items": 0, 2024-09-19T07:30:25.812 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_bytes": 0, 2024-09-19T07:30:25.812 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_items": 0, 2024-09-19T07:30:25.813 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T07:30:25.813 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_reader_items": 0, 2024-09-19T07:30:25.813 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T07:30:25.813 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_writer_items": 0, 2024-09-19T07:30:25.813 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_anon_bytes": 147920, 2024-09-19T07:30:25.813 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_anon_items": 27, 2024-09-19T07:30:25.813 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_meta_bytes": 0, 2024-09-19T07:30:25.813 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_meta_items": 0, 2024-09-19T07:30:25.813 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_bytes": 0, 2024-09-19T07:30:25.813 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_items": 0, 2024-09-19T07:30:25.814 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_mapbl_bytes": 0, 2024-09-19T07:30:25.814 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_mapbl_items": 0, 2024-09-19T07:30:25.814 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_pglog_bytes": 0, 2024-09-19T07:30:25.814 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_pglog_items": 0, 2024-09-19T07:30:25.814 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_bytes": 0, 2024-09-19T07:30:25.814 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_items": 0, 2024-09-19T07:30:25.814 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T07:30:25.814 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_mapping_items": 0, 2024-09-19T07:30:25.814 INFO:teuthology.orchestra.run.smithi179.stdout: "pgmap_bytes": 0, 2024-09-19T07:30:25.814 INFO:teuthology.orchestra.run.smithi179.stdout: "pgmap_items": 0, 2024-09-19T07:30:25.814 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_co_bytes": 928, 2024-09-19T07:30:25.814 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_co_items": 2, 2024-09-19T07:30:25.814 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_1_bytes": 0, 2024-09-19T07:30:25.815 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_1_items": 0, 2024-09-19T07:30:25.815 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_2_bytes": 0, 2024-09-19T07:30:25.815 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_2_items": 0 2024-09-19T07:30:25.815 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:25.815 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T07:30:25.815 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-09-19T07:30:25.815 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 104857600, 2024-09-19T07:30:25.815 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-09-19T07:30:25.815 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 270, 2024-09-19T07:30:25.815 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 179665, 2024-09-19T07:30:25.815 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-09-19T07:30:25.815 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 270, 2024-09-19T07:30:25.815 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 0, 2024-09-19T07:30:25.816 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 0, 2024-09-19T07:30:25.816 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 270, 2024-09-19T07:30:25.816 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 179665, 2024-09-19T07:30:25.816 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-09-19T07:30:25.816 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:25.816 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:25.816 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:25.817 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-19T07:30:25.818 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-19T07:30:25.818 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-19T07:30:27.230 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:26 smithi179 ceph-mon[35716]: pgmap v610: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-19T07:30:27.277 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.f 2024-09-19T07:30:27.278 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.f 2024-09-19T07:30:27.278 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.f 2024-09-19T07:30:27.278 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.f 2024-09-19T07:30:27.278 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.f 2024-09-19T07:30:27.278 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.f 2024-09-19T07:30:27.278 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.f 2024-09-19T07:30:27.278 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.f 2024-09-19T07:30:27.278 DEBUG:tasks.check_counter:Getting stats from i 2024-09-19T07:30:27.278 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-19T07:30:27.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:26 smithi148 ceph-mon[31180]: pgmap v610: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-19T07:30:27.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:26 smithi165 ceph-mon[35326]: pgmap v610: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-19T07:30:27.761 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:30:28.402 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-19T07:30:28.403 INFO:teuthology.orchestra.run.smithi179.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T07:30:28.403 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_messages": 76104, 2024-09-19T07:30:28.403 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages": 72567, 2024-09-19T07:30:28.403 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_bytes": 54047539, 2024-09-19T07:30:28.403 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_bytes": 289450026, 2024-09-19T07:30:28.403 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_created_connections": 218, 2024-09-19T07:30:28.403 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_active_connections": 5, 2024-09-19T07:30:28.403 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_total_time": 5.298228371, 2024-09-19T07:30:28.403 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_send_time": 2.242423992, 2024-09-19T07:30:28.403 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_recv_time": 2.314092171, 2024-09-19T07:30:28.403 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_fast_dispatch_time": 1.027719623, 2024-09-19T07:30:28.404 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:30:28.404 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 72569, 2024-09-19T07:30:28.404 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 19.580559481, 2024-09-19T07:30:28.404 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000269819 2024-09-19T07:30:28.404 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.404 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:30:28.404 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 88144, 2024-09-19T07:30:28.404 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.014509901, 2024-09-19T07:30:28.404 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000164 2024-09-19T07:30:28.404 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.404 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_encrypted_bytes": 1719120, 2024-09-19T07:30:28.404 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_encrypted_bytes": 236032 2024-09-19T07:30:28.404 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.405 INFO:teuthology.orchestra.run.smithi179.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T07:30:28.405 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_messages": 36054, 2024-09-19T07:30:28.405 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages": 36153, 2024-09-19T07:30:28.405 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_bytes": 15975229, 2024-09-19T07:30:28.405 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_bytes": 218977227, 2024-09-19T07:30:28.405 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_created_connections": 46, 2024-09-19T07:30:28.405 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_active_connections": 5, 2024-09-19T07:30:28.405 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_total_time": 3.112181743, 2024-09-19T07:30:28.405 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_send_time": 1.323622909, 2024-09-19T07:30:28.405 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_recv_time": 0.467749206, 2024-09-19T07:30:28.405 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_fast_dispatch_time": 1.193692113, 2024-09-19T07:30:28.405 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:30:28.405 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 36150, 2024-09-19T07:30:28.406 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 58.088360413, 2024-09-19T07:30:28.406 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.001606870 2024-09-19T07:30:28.406 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.406 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:30:28.406 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 331, 2024-09-19T07:30:28.406 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000053106, 2024-09-19T07:30:28.406 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000160 2024-09-19T07:30:28.406 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.406 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_encrypted_bytes": 103312, 2024-09-19T07:30:28.406 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_encrypted_bytes": 669680 2024-09-19T07:30:28.406 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.406 INFO:teuthology.orchestra.run.smithi179.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T07:30:28.406 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_messages": 367558, 2024-09-19T07:30:28.406 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages": 539713, 2024-09-19T07:30:28.406 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_bytes": 128159507, 2024-09-19T07:30:28.407 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_bytes": 404394819, 2024-09-19T07:30:28.407 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_created_connections": 32, 2024-09-19T07:30:28.407 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_active_connections": 8, 2024-09-19T07:30:28.407 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_total_time": 19.296723086, 2024-09-19T07:30:28.407 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_send_time": 8.414345996, 2024-09-19T07:30:28.407 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_recv_time": 18.287776681, 2024-09-19T07:30:28.407 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_fast_dispatch_time": 1.314972613, 2024-09-19T07:30:28.407 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:30:28.407 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 539708, 2024-09-19T07:30:28.407 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 52.186709943, 2024-09-19T07:30:28.407 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000096694 2024-09-19T07:30:28.407 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.407 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:30:28.408 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 764659, 2024-09-19T07:30:28.408 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.148765027, 2024-09-19T07:30:28.408 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000194 2024-09-19T07:30:28.408 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.408 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_encrypted_bytes": 594704, 2024-09-19T07:30:28.408 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_encrypted_bytes": 194384 2024-09-19T07:30:28.408 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.408 INFO:teuthology.orchestra.run.smithi179.stdout: "cct": { 2024-09-19T07:30:28.408 INFO:teuthology.orchestra.run.smithi179.stdout: "total_workers": 1, 2024-09-19T07:30:28.408 INFO:teuthology.orchestra.run.smithi179.stdout: "unhealthy_workers": 0 2024-09-19T07:30:28.408 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.408 INFO:teuthology.orchestra.run.smithi179.stdout: "finisher-MDSRank": { 2024-09-19T07:30:28.408 INFO:teuthology.orchestra.run.smithi179.stdout: "queue_len": 0, 2024-09-19T07:30:28.409 INFO:teuthology.orchestra.run.smithi179.stdout: "complete_latency": { 2024-09-19T07:30:28.409 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 23752, 2024-09-19T07:30:28.409 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 150.649071633, 2024-09-19T07:30:28.409 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.006342584 2024-09-19T07:30:28.409 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-19T07:30:28.409 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.409 INFO:teuthology.orchestra.run.smithi179.stdout: "finisher-PurgeQueue": { 2024-09-19T07:30:28.409 INFO:teuthology.orchestra.run.smithi179.stdout: "queue_len": 0, 2024-09-19T07:30:28.409 INFO:teuthology.orchestra.run.smithi179.stdout: "complete_latency": { 2024-09-19T07:30:28.409 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 21662, 2024-09-19T07:30:28.409 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 7.452523473, 2024-09-19T07:30:28.409 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000344036 2024-09-19T07:30:28.409 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-19T07:30:28.410 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.410 INFO:teuthology.orchestra.run.smithi179.stdout: "mds": { 2024-09-19T07:30:28.410 INFO:teuthology.orchestra.run.smithi179.stdout: "request": 174932, 2024-09-19T07:30:28.410 INFO:teuthology.orchestra.run.smithi179.stdout: "reply": 152420, 2024-09-19T07:30:28.410 INFO:teuthology.orchestra.run.smithi179.stdout: "reply_latency": { 2024-09-19T07:30:28.410 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 152420, 2024-09-19T07:30:28.410 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 2428.069922038, 2024-09-19T07:30:28.410 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.015930126 2024-09-19T07:30:28.410 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.410 INFO:teuthology.orchestra.run.smithi179.stdout: "slow_reply": 0, 2024-09-19T07:30:28.410 INFO:teuthology.orchestra.run.smithi179.stdout: "forward": 22512, 2024-09-19T07:30:28.410 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_fetch_complete": 353, 2024-09-19T07:30:28.410 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_fetch_keys": 1, 2024-09-19T07:30:28.410 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_commit": 7625, 2024-09-19T07:30:28.411 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_split": 162, 2024-09-19T07:30:28.411 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_merge": 0, 2024-09-19T07:30:28.411 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes": 11079, 2024-09-19T07:30:28.411 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_top": 7710, 2024-09-19T07:30:28.411 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_bottom": 3311, 2024-09-19T07:30:28.411 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_pin_tail": 58, 2024-09-19T07:30:28.411 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_pinned": 61, 2024-09-19T07:30:28.411 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_expired": 116494, 2024-09-19T07:30:28.411 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_with_caps": 1, 2024-09-19T07:30:28.411 INFO:teuthology.orchestra.run.smithi179.stdout: "caps": 1, 2024-09-19T07:30:28.411 INFO:teuthology.orchestra.run.smithi179.stdout: "subtrees": 4, 2024-09-19T07:30:28.411 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse": 272545, 2024-09-19T07:30:28.411 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_hit": 216430, 2024-09-19T07:30:28.412 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_forward": 22125, 2024-09-19T07:30:28.412 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_discover": 809, 2024-09-19T07:30:28.412 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_dir_fetch": 20, 2024-09-19T07:30:28.412 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_remote_ino": 0, 2024-09-19T07:30:28.412 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_lock": 368, 2024-09-19T07:30:28.412 INFO:teuthology.orchestra.run.smithi179.stdout: "load_cent": 30, 2024-09-19T07:30:28.412 INFO:teuthology.orchestra.run.smithi179.stdout: "q": 0, 2024-09-19T07:30:28.412 INFO:teuthology.orchestra.run.smithi179.stdout: "exported": 211, 2024-09-19T07:30:28.412 INFO:teuthology.orchestra.run.smithi179.stdout: "exported_inodes": 86758, 2024-09-19T07:30:28.412 INFO:teuthology.orchestra.run.smithi179.stdout: "imported": 252, 2024-09-19T07:30:28.412 INFO:teuthology.orchestra.run.smithi179.stdout: "imported_inodes": 36299, 2024-09-19T07:30:28.412 INFO:teuthology.orchestra.run.smithi179.stdout: "openino_dir_fetch": 0, 2024-09-19T07:30:28.412 INFO:teuthology.orchestra.run.smithi179.stdout: "openino_backtrace_fetch": 4352, 2024-09-19T07:30:28.413 INFO:teuthology.orchestra.run.smithi179.stdout: "openino_peer_discover": 0, 2024-09-19T07:30:28.413 INFO:teuthology.orchestra.run.smithi179.stdout: "root_rfiles": 4, 2024-09-19T07:30:28.413 INFO:teuthology.orchestra.run.smithi179.stdout: "root_rbytes": 234, 2024-09-19T07:30:28.413 INFO:teuthology.orchestra.run.smithi179.stdout: "root_rsnaps": 6, 2024-09-19T07:30:28.413 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_backtrace_fetch": 4352, 2024-09-19T07:30:28.413 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_set_tag": 0, 2024-09-19T07:30:28.413 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T07:30:28.413 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_inotable_repaired": 0, 2024-09-19T07:30:28.413 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_dir_inodes": 100, 2024-09-19T07:30:28.413 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_dir_base_inodes": 5, 2024-09-19T07:30:28.413 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_dirfrag_rstats": 95, 2024-09-19T07:30:28.413 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_file_inodes": 4252, 2024-09-19T07:30:28.413 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_inode_file_caps": 269, 2024-09-19T07:30:28.413 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_revoke": 69152, 2024-09-19T07:30:28.414 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_grant": 71446, 2024-09-19T07:30:28.414 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_trunc": 10, 2024-09-19T07:30:28.414 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T07:30:28.414 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T07:30:28.414 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_caps": 110335, 2024-09-19T07:30:28.414 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_caps_dirty": 37149, 2024-09-19T07:30:28.414 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_cap_release": 2767, 2024-09-19T07:30:28.414 INFO:teuthology.orchestra.run.smithi179.stdout: "process_request_cap_release": 51881 2024-09-19T07:30:28.414 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.415 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_cache": { 2024-09-19T07:30:28.415 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_update": 1661, 2024-09-19T07:30:28.415 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_update_receipt": 6717, 2024-09-19T07:30:28.415 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_try_discover": 3645, 2024-09-19T07:30:28.415 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_send_discover": 4103, 2024-09-19T07:30:28.415 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_handle_discover": 5112, 2024-09-19T07:30:28.415 INFO:teuthology.orchestra.run.smithi179.stdout: "num_strays": 57, 2024-09-19T07:30:28.415 INFO:teuthology.orchestra.run.smithi179.stdout: "num_strays_delayed": 0, 2024-09-19T07:30:28.415 INFO:teuthology.orchestra.run.smithi179.stdout: "num_strays_enqueuing": 0, 2024-09-19T07:30:28.415 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_created": 12599, 2024-09-19T07:30:28.415 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_enqueued": 12544, 2024-09-19T07:30:28.415 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_reintegrated": 0, 2024-09-19T07:30:28.415 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_migrated": 0, 2024-09-19T07:30:28.415 INFO:teuthology.orchestra.run.smithi179.stdout: "num_recovering_processing": 0, 2024-09-19T07:30:28.416 INFO:teuthology.orchestra.run.smithi179.stdout: "num_recovering_enqueued": 0, 2024-09-19T07:30:28.416 INFO:teuthology.orchestra.run.smithi179.stdout: "num_recovering_prioritized": 0, 2024-09-19T07:30:28.416 INFO:teuthology.orchestra.run.smithi179.stdout: "recovery_started": 0, 2024-09-19T07:30:28.416 INFO:teuthology.orchestra.run.smithi179.stdout: "recovery_completed": 0, 2024-09-19T07:30:28.416 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_quiesce_path": 15, 2024-09-19T07:30:28.416 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_quiesce_inode": 77794, 2024-09-19T07:30:28.416 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_enqueue_scrub": 5, 2024-09-19T07:30:28.416 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_exportdir": 212, 2024-09-19T07:30:28.416 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_flush": 0, 2024-09-19T07:30:28.416 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_fragmentdir": 163, 2024-09-19T07:30:28.416 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_fragstats": 0, 2024-09-19T07:30:28.416 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_inodestats": 0 2024-09-19T07:30:28.416 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.416 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_log": { 2024-09-19T07:30:28.417 INFO:teuthology.orchestra.run.smithi179.stdout: "evlrg": 6, 2024-09-19T07:30:28.417 INFO:teuthology.orchestra.run.smithi179.stdout: "evadd": 169095, 2024-09-19T07:30:28.417 INFO:teuthology.orchestra.run.smithi179.stdout: "evex": 169082, 2024-09-19T07:30:28.417 INFO:teuthology.orchestra.run.smithi179.stdout: "evtrm": 169082, 2024-09-19T07:30:28.417 INFO:teuthology.orchestra.run.smithi179.stdout: "ev": 13, 2024-09-19T07:30:28.417 INFO:teuthology.orchestra.run.smithi179.stdout: "evexg": 0, 2024-09-19T07:30:28.417 INFO:teuthology.orchestra.run.smithi179.stdout: "evexd": 5, 2024-09-19T07:30:28.417 INFO:teuthology.orchestra.run.smithi179.stdout: "segadd": 306, 2024-09-19T07:30:28.417 INFO:teuthology.orchestra.run.smithi179.stdout: "segex": 305, 2024-09-19T07:30:28.417 INFO:teuthology.orchestra.run.smithi179.stdout: "segtrm": 305, 2024-09-19T07:30:28.417 INFO:teuthology.orchestra.run.smithi179.stdout: "seg": 1, 2024-09-19T07:30:28.417 INFO:teuthology.orchestra.run.smithi179.stdout: "segmjr": 1, 2024-09-19T07:30:28.417 INFO:teuthology.orchestra.run.smithi179.stdout: "segexg": 0, 2024-09-19T07:30:28.417 INFO:teuthology.orchestra.run.smithi179.stdout: "segexd": 1, 2024-09-19T07:30:28.418 INFO:teuthology.orchestra.run.smithi179.stdout: "expos": 492014251, 2024-09-19T07:30:28.418 INFO:teuthology.orchestra.run.smithi179.stdout: "wrpos": 492067462, 2024-09-19T07:30:28.418 INFO:teuthology.orchestra.run.smithi179.stdout: "rdpos": 0, 2024-09-19T07:30:28.418 INFO:teuthology.orchestra.run.smithi179.stdout: "jlat": { 2024-09-19T07:30:28.418 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 14551, 2024-09-19T07:30:28.418 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 506.681345009, 2024-09-19T07:30:28.418 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.034821066 2024-09-19T07:30:28.418 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.418 INFO:teuthology.orchestra.run.smithi179.stdout: "replayed": 0 2024-09-19T07:30:28.418 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.418 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_mem": { 2024-09-19T07:30:28.418 INFO:teuthology.orchestra.run.smithi179.stdout: "ino": 4366, 2024-09-19T07:30:28.418 INFO:teuthology.orchestra.run.smithi179.stdout: "ino+": 82852, 2024-09-19T07:30:28.419 INFO:teuthology.orchestra.run.smithi179.stdout: "ino-": 78486, 2024-09-19T07:30:28.419 INFO:teuthology.orchestra.run.smithi179.stdout: "dir": 362, 2024-09-19T07:30:28.419 INFO:teuthology.orchestra.run.smithi179.stdout: "dir+": 6046, 2024-09-19T07:30:28.419 INFO:teuthology.orchestra.run.smithi179.stdout: "dir-": 5684, 2024-09-19T07:30:28.419 INFO:teuthology.orchestra.run.smithi179.stdout: "dn": 11079, 2024-09-19T07:30:28.419 INFO:teuthology.orchestra.run.smithi179.stdout: "dn+": 140561, 2024-09-19T07:30:28.420 INFO:teuthology.orchestra.run.smithi179.stdout: "dn-": 129482, 2024-09-19T07:30:28.420 INFO:teuthology.orchestra.run.smithi179.stdout: "cap": 1, 2024-09-19T07:30:28.420 INFO:teuthology.orchestra.run.smithi179.stdout: "cap+": 57905, 2024-09-19T07:30:28.420 INFO:teuthology.orchestra.run.smithi179.stdout: "cap-": 57904, 2024-09-19T07:30:28.420 INFO:teuthology.orchestra.run.smithi179.stdout: "rss": 173860, 2024-09-19T07:30:28.420 INFO:teuthology.orchestra.run.smithi179.stdout: "heap": 231712 2024-09-19T07:30:28.420 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.420 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_server": { 2024-09-19T07:30:28.420 INFO:teuthology.orchestra.run.smithi179.stdout: "dispatch_client_request": 183550, 2024-09-19T07:30:28.420 INFO:teuthology.orchestra.run.smithi179.stdout: "dispatch_server_request": 11996, 2024-09-19T07:30:28.420 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_request": 174932, 2024-09-19T07:30:28.420 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_session": 293, 2024-09-19T07:30:28.420 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_peer_request": 24881, 2024-09-19T07:30:28.421 INFO:teuthology.orchestra.run.smithi179.stdout: "req_create_latency": { 2024-09-19T07:30:28.421 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 38094, 2024-09-19T07:30:28.421 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 218.540427615, 2024-09-19T07:30:28.421 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.005736872 2024-09-19T07:30:28.421 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.421 INFO:teuthology.orchestra.run.smithi179.stdout: "req_getattr_latency": { 2024-09-19T07:30:28.421 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 2492, 2024-09-19T07:30:28.421 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 412.662172804, 2024-09-19T07:30:28.421 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.165594772 2024-09-19T07:30:28.421 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.421 INFO:teuthology.orchestra.run.smithi179.stdout: "req_getfilelock_latency": { 2024-09-19T07:30:28.421 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:28.421 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:28.422 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:28.422 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.422 INFO:teuthology.orchestra.run.smithi179.stdout: "req_link_latency": { 2024-09-19T07:30:28.422 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:28.422 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:28.422 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:28.422 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.422 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookup_latency": { 2024-09-19T07:30:28.422 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 50354, 2024-09-19T07:30:28.422 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 998.595866337, 2024-09-19T07:30:28.422 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.019831510 2024-09-19T07:30:28.422 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.422 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookuphash_latency": { 2024-09-19T07:30:28.422 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:28.423 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:28.423 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:28.423 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.423 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupino_latency": { 2024-09-19T07:30:28.423 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:28.423 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:28.423 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:28.423 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.423 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupname_latency": { 2024-09-19T07:30:28.423 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:28.423 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:28.423 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:28.423 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.423 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupparent_latency": { 2024-09-19T07:30:28.424 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:28.424 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:28.424 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:28.424 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.424 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupsnap_latency": { 2024-09-19T07:30:28.425 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:28.425 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:28.425 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:28.425 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.425 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lssnap_latency": { 2024-09-19T07:30:28.425 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 19, 2024-09-19T07:30:28.425 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.006634915, 2024-09-19T07:30:28.425 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000349206 2024-09-19T07:30:28.425 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.425 INFO:teuthology.orchestra.run.smithi179.stdout: "req_mkdir_latency": { 2024-09-19T07:30:28.425 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 270, 2024-09-19T07:30:28.425 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 55.008797217, 2024-09-19T07:30:28.425 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.203736285 2024-09-19T07:30:28.426 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.426 INFO:teuthology.orchestra.run.smithi179.stdout: "req_mknod_latency": { 2024-09-19T07:30:28.426 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:28.426 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:28.426 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:28.426 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.426 INFO:teuthology.orchestra.run.smithi179.stdout: "req_mksnap_latency": { 2024-09-19T07:30:28.426 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 19, 2024-09-19T07:30:28.426 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 20.535863815, 2024-09-19T07:30:28.426 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 1.080834937 2024-09-19T07:30:28.426 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.426 INFO:teuthology.orchestra.run.smithi179.stdout: "req_open_latency": { 2024-09-19T07:30:28.426 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 15137, 2024-09-19T07:30:28.427 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 129.740912074, 2024-09-19T07:30:28.427 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.008571111 2024-09-19T07:30:28.427 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.427 INFO:teuthology.orchestra.run.smithi179.stdout: "req_readdir_latency": { 2024-09-19T07:30:28.427 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 422, 2024-09-19T07:30:28.427 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 1.476864762, 2024-09-19T07:30:28.427 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.003499679 2024-09-19T07:30:28.427 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.427 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rename_latency": { 2024-09-19T07:30:28.427 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 37768, 2024-09-19T07:30:28.427 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 494.718417113, 2024-09-19T07:30:28.427 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.013098877 2024-09-19T07:30:28.427 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.427 INFO:teuthology.orchestra.run.smithi179.stdout: "req_renamesnap_latency": { 2024-09-19T07:30:28.427 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:28.428 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:28.428 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:28.428 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.428 INFO:teuthology.orchestra.run.smithi179.stdout: "req_snapdiff_latency": { 2024-09-19T07:30:28.428 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:28.428 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:28.428 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:28.428 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.428 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rmdir_latency": { 2024-09-19T07:30:28.428 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 58, 2024-09-19T07:30:28.428 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 37.450027346, 2024-09-19T07:30:28.428 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.645690126 2024-09-19T07:30:28.428 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.429 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rmsnap_latency": { 2024-09-19T07:30:28.429 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 13, 2024-09-19T07:30:28.429 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 18.392441018, 2024-09-19T07:30:28.429 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 1.414803155 2024-09-19T07:30:28.429 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.429 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rmxattr_latency": { 2024-09-19T07:30:28.429 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:28.429 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:28.429 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:28.429 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.429 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setattr_latency": { 2024-09-19T07:30:28.429 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 11, 2024-09-19T07:30:28.429 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.733238607, 2024-09-19T07:30:28.430 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.066658055 2024-09-19T07:30:28.430 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.430 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setdirlayout_latency": { 2024-09-19T07:30:28.430 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:28.430 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:28.430 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:28.430 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.430 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setfilelock_latency": { 2024-09-19T07:30:28.430 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:28.430 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:28.430 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:28.430 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.430 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setlayout_latency": { 2024-09-19T07:30:28.430 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:28.431 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:28.431 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:28.431 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.431 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setxattr_latency": { 2024-09-19T07:30:28.431 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 7, 2024-09-19T07:30:28.431 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.595837517, 2024-09-19T07:30:28.431 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.085119645 2024-09-19T07:30:28.431 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.431 INFO:teuthology.orchestra.run.smithi179.stdout: "req_symlink_latency": { 2024-09-19T07:30:28.431 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 3, 2024-09-19T07:30:28.431 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.001831754, 2024-09-19T07:30:28.431 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000610584 2024-09-19T07:30:28.431 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.431 INFO:teuthology.orchestra.run.smithi179.stdout: "req_unlink_latency": { 2024-09-19T07:30:28.432 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 7753, 2024-09-19T07:30:28.432 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 39.610589144, 2024-09-19T07:30:28.432 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.005109066 2024-09-19T07:30:28.432 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.432 INFO:teuthology.orchestra.run.smithi179.stdout: "cap_revoke_eviction": 0, 2024-09-19T07:30:28.432 INFO:teuthology.orchestra.run.smithi179.stdout: "cap_acquisition_throttle": 0, 2024-09-19T07:30:28.432 INFO:teuthology.orchestra.run.smithi179.stdout: "req_getvxattr_latency": { 2024-09-19T07:30:28.432 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:28.432 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:28.432 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:28.432 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-19T07:30:28.432 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.432 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_sessions": { 2024-09-19T07:30:28.433 INFO:teuthology.orchestra.run.smithi179.stdout: "session_count": 2, 2024-09-19T07:30:28.433 INFO:teuthology.orchestra.run.smithi179.stdout: "session_add": 5, 2024-09-19T07:30:28.433 INFO:teuthology.orchestra.run.smithi179.stdout: "session_remove": 3, 2024-09-19T07:30:28.433 INFO:teuthology.orchestra.run.smithi179.stdout: "sessions_open": 2, 2024-09-19T07:30:28.433 INFO:teuthology.orchestra.run.smithi179.stdout: "sessions_stale": 0, 2024-09-19T07:30:28.433 INFO:teuthology.orchestra.run.smithi179.stdout: "total_load": 2333, 2024-09-19T07:30:28.433 INFO:teuthology.orchestra.run.smithi179.stdout: "average_load": 1166, 2024-09-19T07:30:28.433 INFO:teuthology.orchestra.run.smithi179.stdout: "avg_session_uptime": 1135, 2024-09-19T07:30:28.433 INFO:teuthology.orchestra.run.smithi179.stdout: "mdthresh_evicted": 0 2024-09-19T07:30:28.433 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.433 INFO:teuthology.orchestra.run.smithi179.stdout: "mempool": { 2024-09-19T07:30:28.433 INFO:teuthology.orchestra.run.smithi179.stdout: "bloom_filter_bytes": 935, 2024-09-19T07:30:28.433 INFO:teuthology.orchestra.run.smithi179.stdout: "bloom_filter_items": 935, 2024-09-19T07:30:28.434 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T07:30:28.434 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_alloc_items": 0, 2024-09-19T07:30:28.434 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T07:30:28.434 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_data_items": 0, 2024-09-19T07:30:28.434 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T07:30:28.434 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T07:30:28.434 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T07:30:28.434 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T07:30:28.434 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T07:30:28.434 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_other_items": 0, 2024-09-19T07:30:28.434 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T07:30:28.434 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T07:30:28.434 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_extent_bytes": 0, 2024-09-19T07:30:28.434 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_extent_items": 0, 2024-09-19T07:30:28.435 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_blob_bytes": 0, 2024-09-19T07:30:28.435 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_blob_items": 0, 2024-09-19T07:30:28.435 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T07:30:28.435 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T07:30:28.435 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T07:30:28.435 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T07:30:28.435 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T07:30:28.435 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_fsck_items": 0, 2024-09-19T07:30:28.435 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_txc_bytes": 0, 2024-09-19T07:30:28.435 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_txc_items": 0, 2024-09-19T07:30:28.435 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T07:30:28.435 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T07:30:28.436 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_bytes": 0, 2024-09-19T07:30:28.436 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_items": 0, 2024-09-19T07:30:28.436 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_bytes": 0, 2024-09-19T07:30:28.436 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_items": 0, 2024-09-19T07:30:28.436 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T07:30:28.436 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_reader_items": 0, 2024-09-19T07:30:28.436 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T07:30:28.436 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_writer_items": 0, 2024-09-19T07:30:28.436 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_anon_bytes": 876700, 2024-09-19T07:30:28.436 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_anon_items": 4551, 2024-09-19T07:30:28.436 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_meta_bytes": 88, 2024-09-19T07:30:28.436 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_meta_items": 1, 2024-09-19T07:30:28.436 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_bytes": 0, 2024-09-19T07:30:28.437 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_items": 0, 2024-09-19T07:30:28.437 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_mapbl_bytes": 0, 2024-09-19T07:30:28.437 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_mapbl_items": 0, 2024-09-19T07:30:28.437 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_pglog_bytes": 0, 2024-09-19T07:30:28.437 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_pglog_items": 0, 2024-09-19T07:30:28.437 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_bytes": 8344, 2024-09-19T07:30:28.437 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_items": 185, 2024-09-19T07:30:28.437 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T07:30:28.437 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_mapping_items": 0, 2024-09-19T07:30:28.437 INFO:teuthology.orchestra.run.smithi179.stdout: "pgmap_bytes": 0, 2024-09-19T07:30:28.437 INFO:teuthology.orchestra.run.smithi179.stdout: "pgmap_items": 0, 2024-09-19T07:30:28.438 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_co_bytes": 18739764, 2024-09-19T07:30:28.438 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_co_items": 185857, 2024-09-19T07:30:28.438 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_1_bytes": 0, 2024-09-19T07:30:28.438 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_1_items": 0, 2024-09-19T07:30:28.438 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_2_bytes": 0, 2024-09-19T07:30:28.438 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_2_items": 0 2024-09-19T07:30:28.438 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.438 INFO:teuthology.orchestra.run.smithi179.stdout: "objecter": { 2024-09-19T07:30:28.438 INFO:teuthology.orchestra.run.smithi179.stdout: "op_active": 0, 2024-09-19T07:30:28.438 INFO:teuthology.orchestra.run.smithi179.stdout: "op_laggy": 0, 2024-09-19T07:30:28.438 INFO:teuthology.orchestra.run.smithi179.stdout: "op_send": 83823, 2024-09-19T07:30:28.438 INFO:teuthology.orchestra.run.smithi179.stdout: "op_send_bytes": 592461599, 2024-09-19T07:30:28.438 INFO:teuthology.orchestra.run.smithi179.stdout: "op_resend": 32, 2024-09-19T07:30:28.438 INFO:teuthology.orchestra.run.smithi179.stdout: "op_reply": 83823, 2024-09-19T07:30:28.439 INFO:teuthology.orchestra.run.smithi179.stdout: "op_latency": { 2024-09-19T07:30:28.439 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 83823, 2024-09-19T07:30:28.439 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 21242.328798689, 2024-09-19T07:30:28.439 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.253418856 2024-09-19T07:30:28.439 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.439 INFO:teuthology.orchestra.run.smithi179.stdout: "op_inflight": 0, 2024-09-19T07:30:28.439 INFO:teuthology.orchestra.run.smithi179.stdout: "oplen_avg": { 2024-09-19T07:30:28.439 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 83823, 2024-09-19T07:30:28.439 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 183797 2024-09-19T07:30:28.439 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.439 INFO:teuthology.orchestra.run.smithi179.stdout: "op": 83823, 2024-09-19T07:30:28.439 INFO:teuthology.orchestra.run.smithi179.stdout: "op_r": 5144, 2024-09-19T07:30:28.440 INFO:teuthology.orchestra.run.smithi179.stdout: "op_w": 78679, 2024-09-19T07:30:28.440 INFO:teuthology.orchestra.run.smithi179.stdout: "op_rmw": 0, 2024-09-19T07:30:28.440 INFO:teuthology.orchestra.run.smithi179.stdout: "op_pg": 0, 2024-09-19T07:30:28.440 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_stat": 6081, 2024-09-19T07:30:28.440 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_create": 41481, 2024-09-19T07:30:28.440 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_read": 433, 2024-09-19T07:30:28.440 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_write": 14980, 2024-09-19T07:30:28.440 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_writefull": 556, 2024-09-19T07:30:28.440 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_writesame": 0, 2024-09-19T07:30:28.440 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_append": 0, 2024-09-19T07:30:28.440 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_zero": 2, 2024-09-19T07:30:28.440 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_truncate": 162, 2024-09-19T07:30:28.441 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_delete": 13286, 2024-09-19T07:30:28.441 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_mapext": 0, 2024-09-19T07:30:28.441 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_sparse_read": 0, 2024-09-19T07:30:28.441 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_clonerange": 0, 2024-09-19T07:30:28.441 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_getxattr": 4376, 2024-09-19T07:30:28.441 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_setxattr": 82962, 2024-09-19T07:30:28.441 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_cmpxattr": 0, 2024-09-19T07:30:28.441 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_rmxattr": 0, 2024-09-19T07:30:28.441 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_resetxattrs": 0, 2024-09-19T07:30:28.441 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_call": 0, 2024-09-19T07:30:28.441 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_watch": 0, 2024-09-19T07:30:28.441 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_notify": 0, 2024-09-19T07:30:28.441 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T07:30:28.442 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_pgls": 0, 2024-09-19T07:30:28.442 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_pgls_filter": 0, 2024-09-19T07:30:28.442 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_other": 10, 2024-09-19T07:30:28.442 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_active": 0, 2024-09-19T07:30:28.442 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_send": 0, 2024-09-19T07:30:28.442 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_resend": 0, 2024-09-19T07:30:28.442 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_ping": 0, 2024-09-19T07:30:28.442 INFO:teuthology.orchestra.run.smithi179.stdout: "poolop_active": 0, 2024-09-19T07:30:28.442 INFO:teuthology.orchestra.run.smithi179.stdout: "poolop_send": 0, 2024-09-19T07:30:28.442 INFO:teuthology.orchestra.run.smithi179.stdout: "poolop_resend": 0, 2024-09-19T07:30:28.442 INFO:teuthology.orchestra.run.smithi179.stdout: "poolstat_active": 0, 2024-09-19T07:30:28.442 INFO:teuthology.orchestra.run.smithi179.stdout: "poolstat_send": 0, 2024-09-19T07:30:28.443 INFO:teuthology.orchestra.run.smithi179.stdout: "poolstat_resend": 0, 2024-09-19T07:30:28.443 INFO:teuthology.orchestra.run.smithi179.stdout: "statfs_active": 0, 2024-09-19T07:30:28.443 INFO:teuthology.orchestra.run.smithi179.stdout: "statfs_send": 0, 2024-09-19T07:30:28.443 INFO:teuthology.orchestra.run.smithi179.stdout: "statfs_resend": 0, 2024-09-19T07:30:28.443 INFO:teuthology.orchestra.run.smithi179.stdout: "command_active": 0, 2024-09-19T07:30:28.443 INFO:teuthology.orchestra.run.smithi179.stdout: "command_send": 0, 2024-09-19T07:30:28.443 INFO:teuthology.orchestra.run.smithi179.stdout: "command_resend": 0, 2024-09-19T07:30:28.443 INFO:teuthology.orchestra.run.smithi179.stdout: "map_epoch": 107, 2024-09-19T07:30:28.443 INFO:teuthology.orchestra.run.smithi179.stdout: "map_full": 0, 2024-09-19T07:30:28.443 INFO:teuthology.orchestra.run.smithi179.stdout: "map_inc": 29, 2024-09-19T07:30:28.443 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_sessions": 12, 2024-09-19T07:30:28.443 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_session_open": 12, 2024-09-19T07:30:28.443 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_session_close": 0, 2024-09-19T07:30:28.443 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_laggy": 0, 2024-09-19T07:30:28.444 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_wr": 15672, 2024-09-19T07:30:28.444 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_rd": 708, 2024-09-19T07:30:28.444 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_del": 3088 2024-09-19T07:30:28.444 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.444 INFO:teuthology.orchestra.run.smithi179.stdout: "oft": { 2024-09-19T07:30:28.444 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_objs": 1, 2024-09-19T07:30:28.444 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_kv_pairs": 0, 2024-09-19T07:30:28.444 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_updates": 0, 2024-09-19T07:30:28.444 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_removes": 0 2024-09-19T07:30:28.444 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.444 INFO:teuthology.orchestra.run.smithi179.stdout: "osd-slow-ops": { 2024-09-19T07:30:28.444 INFO:teuthology.orchestra.run.smithi179.stdout: "slow_ops_count": 77720 2024-09-19T07:30:28.444 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.445 INFO:teuthology.orchestra.run.smithi179.stdout: "purge_queue": { 2024-09-19T07:30:28.445 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing_ops": 0, 2024-09-19T07:30:28.445 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing_ops_high_water": 10, 2024-09-19T07:30:28.445 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing": 0, 2024-09-19T07:30:28.445 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing_high_water": 10, 2024-09-19T07:30:28.445 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executed_ops": 12544, 2024-09-19T07:30:28.445 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executed": 12544, 2024-09-19T07:30:28.445 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_item_in_journal": 0 2024-09-19T07:30:28.445 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.445 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T07:30:28.445 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-09-19T07:30:28.445 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 104857600, 2024-09-19T07:30:28.445 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-09-19T07:30:28.445 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 479712, 2024-09-19T07:30:28.446 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 154903631, 2024-09-19T07:30:28.446 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-09-19T07:30:28.446 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 479712, 2024-09-19T07:30:28.446 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 0, 2024-09-19T07:30:28.446 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 0, 2024-09-19T07:30:28.446 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 479712, 2024-09-19T07:30:28.446 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 154903631, 2024-09-19T07:30:28.446 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-09-19T07:30:28.446 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:28.446 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:28.446 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:28.446 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-19T07:30:28.446 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.447 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-objecter_bytes": { 2024-09-19T07:30:28.447 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-09-19T07:30:28.447 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 104857600, 2024-09-19T07:30:28.447 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-09-19T07:30:28.447 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 0, 2024-09-19T07:30:28.447 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 0, 2024-09-19T07:30:28.447 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-09-19T07:30:28.447 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 0, 2024-09-19T07:30:28.447 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 83823, 2024-09-19T07:30:28.447 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 594105651, 2024-09-19T07:30:28.447 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 83823, 2024-09-19T07:30:28.447 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 594105651, 2024-09-19T07:30:28.447 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-09-19T07:30:28.447 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:28.448 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:28.448 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:28.448 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-19T07:30:28.448 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.448 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-objecter_ops": { 2024-09-19T07:30:28.448 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-09-19T07:30:28.448 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 1024, 2024-09-19T07:30:28.448 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-09-19T07:30:28.448 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 0, 2024-09-19T07:30:28.448 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 0, 2024-09-19T07:30:28.448 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-09-19T07:30:28.448 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 0, 2024-09-19T07:30:28.448 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 83823, 2024-09-19T07:30:28.449 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 83823, 2024-09-19T07:30:28.449 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 83823, 2024-09-19T07:30:28.449 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 83823, 2024-09-19T07:30:28.449 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-09-19T07:30:28.449 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:28.449 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:28.449 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:28.449 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-19T07:30:28.449 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.449 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-write_buf_throttle": { 2024-09-19T07:30:28.449 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-09-19T07:30:28.449 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 3758096384, 2024-09-19T07:30:28.449 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-09-19T07:30:28.449 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 12544, 2024-09-19T07:30:28.450 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 1649704, 2024-09-19T07:30:28.450 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-09-19T07:30:28.450 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 12544, 2024-09-19T07:30:28.450 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 0, 2024-09-19T07:30:28.450 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 0, 2024-09-19T07:30:28.450 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 428, 2024-09-19T07:30:28.450 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 1649704, 2024-09-19T07:30:28.450 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-09-19T07:30:28.450 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:28.450 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:28.450 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:28.450 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-19T07:30:28.450 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:28.450 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-write_buf_throttle-0x55f4514d4960": { 2024-09-19T07:30:28.450 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-09-19T07:30:28.451 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 3758096384, 2024-09-19T07:30:28.451 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-09-19T07:30:28.451 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 169095, 2024-09-19T07:30:28.451 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 487873158, 2024-09-19T07:30:28.451 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-09-19T07:30:28.451 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 169095, 2024-09-19T07:30:28.451 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 0, 2024-09-19T07:30:28.451 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 0, 2024-09-19T07:30:28.451 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 14551, 2024-09-19T07:30:28.451 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 487873158, 2024-09-19T07:30:28.451 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-09-19T07:30:28.451 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:28.451 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:28.451 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:28.451 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-19T07:30:28.452 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-19T07:30:28.452 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-19T07:30:29.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:28 smithi165 ceph-mon[35326]: pgmap v611: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T07:30:29.187 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:28 smithi179 ceph-mon[35716]: pgmap v611: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T07:30:29.235 INFO:tasks.check_counter:Daemon mds.i mds.exported=211 2024-09-19T07:30:29.235 INFO:tasks.check_counter:Daemon mds.i mds.imported=252 2024-09-19T07:30:29.235 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=1661 2024-09-19T07:30:29.236 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=6717 2024-09-19T07:30:29.236 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-09-19T07:30:29.236 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=19 2024-09-19T07:30:29.236 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=13 2024-09-19T07:30:29.236 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=162 2024-09-19T07:30:29.236 DEBUG:tasks.check_counter:Getting stats from l 2024-09-19T07:30:29.236 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-19T07:30:29.255 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:28 smithi148 ceph-mon[31180]: pgmap v611: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T07:30:29.694 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:30:30.320 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-19T07:30:30.320 INFO:teuthology.orchestra.run.smithi179.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T07:30:30.320 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_messages": 3415, 2024-09-19T07:30:30.320 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages": 3417, 2024-09-19T07:30:30.320 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_bytes": 332481225, 2024-09-19T07:30:30.320 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_bytes": 1085977, 2024-09-19T07:30:30.320 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_created_connections": 8, 2024-09-19T07:30:30.320 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_active_connections": 4, 2024-09-19T07:30:30.320 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_total_time": 0.452583264, 2024-09-19T07:30:30.321 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_send_time": 0.087833909, 2024-09-19T07:30:30.321 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_recv_time": 0.242061870, 2024-09-19T07:30:30.321 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_fast_dispatch_time": 0.098727786, 2024-09-19T07:30:30.321 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:30:30.321 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 3415, 2024-09-19T07:30:30.321 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.129656247, 2024-09-19T07:30:30.321 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000037966 2024-09-19T07:30:30.321 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.321 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:30:30.321 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:30.321 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:30.321 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:30.322 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.322 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T07:30:30.322 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T07:30:30.322 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.322 INFO:teuthology.orchestra.run.smithi179.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T07:30:30.322 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_messages": 1185, 2024-09-19T07:30:30.322 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages": 1144, 2024-09-19T07:30:30.322 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_bytes": 228377405, 2024-09-19T07:30:30.322 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_bytes": 463452, 2024-09-19T07:30:30.322 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_created_connections": 6, 2024-09-19T07:30:30.323 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_active_connections": 5, 2024-09-19T07:30:30.323 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_total_time": 0.243310233, 2024-09-19T07:30:30.323 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_send_time": 0.037589014, 2024-09-19T07:30:30.323 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_recv_time": 0.197699850, 2024-09-19T07:30:30.323 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_fast_dispatch_time": 0.018113008, 2024-09-19T07:30:30.323 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:30:30.323 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 1143, 2024-09-19T07:30:30.323 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.050396959, 2024-09-19T07:30:30.323 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000044091 2024-09-19T07:30:30.323 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.323 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:30:30.323 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:30.324 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:30.324 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:30.324 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.324 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_encrypted_bytes": 1654416, 2024-09-19T07:30:30.324 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_encrypted_bytes": 221392 2024-09-19T07:30:30.324 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.324 INFO:teuthology.orchestra.run.smithi179.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T07:30:30.324 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_messages": 1196, 2024-09-19T07:30:30.324 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages": 1459, 2024-09-19T07:30:30.324 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_bytes": 290666768, 2024-09-19T07:30:30.324 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_bytes": 1008884, 2024-09-19T07:30:30.324 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_created_connections": 8, 2024-09-19T07:30:30.324 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_active_connections": 6, 2024-09-19T07:30:30.324 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_total_time": 0.256501681, 2024-09-19T07:30:30.325 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_send_time": 0.036243676, 2024-09-19T07:30:30.325 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_recv_time": 0.179234300, 2024-09-19T07:30:30.325 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_running_fast_dispatch_time": 0.030067520, 2024-09-19T07:30:30.325 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:30:30.325 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 1457, 2024-09-19T07:30:30.325 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.075928646, 2024-09-19T07:30:30.325 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000052113 2024-09-19T07:30:30.325 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.325 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:30:30.325 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:30.325 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:30.326 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:30.326 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.326 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_recv_encrypted_bytes": 3344, 2024-09-19T07:30:30.326 INFO:teuthology.orchestra.run.smithi179.stdout: "msgr_send_encrypted_bytes": 630464 2024-09-19T07:30:30.326 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.326 INFO:teuthology.orchestra.run.smithi179.stdout: "cct": { 2024-09-19T07:30:30.326 INFO:teuthology.orchestra.run.smithi179.stdout: "total_workers": 1, 2024-09-19T07:30:30.326 INFO:teuthology.orchestra.run.smithi179.stdout: "unhealthy_workers": 0 2024-09-19T07:30:30.326 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.327 INFO:teuthology.orchestra.run.smithi179.stdout: "finisher-MDSRank": { 2024-09-19T07:30:30.327 INFO:teuthology.orchestra.run.smithi179.stdout: "queue_len": 0, 2024-09-19T07:30:30.327 INFO:teuthology.orchestra.run.smithi179.stdout: "complete_latency": { 2024-09-19T07:30:30.327 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 8292, 2024-09-19T07:30:30.327 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.320783527, 2024-09-19T07:30:30.327 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000038685 2024-09-19T07:30:30.327 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-19T07:30:30.327 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.327 INFO:teuthology.orchestra.run.smithi179.stdout: "finisher-PurgeQueue": { 2024-09-19T07:30:30.327 INFO:teuthology.orchestra.run.smithi179.stdout: "queue_len": 0, 2024-09-19T07:30:30.327 INFO:teuthology.orchestra.run.smithi179.stdout: "complete_latency": { 2024-09-19T07:30:30.327 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:30.327 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:30.328 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:30.328 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-19T07:30:30.328 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.328 INFO:teuthology.orchestra.run.smithi179.stdout: "mds": { 2024-09-19T07:30:30.328 INFO:teuthology.orchestra.run.smithi179.stdout: "request": 0, 2024-09-19T07:30:30.328 INFO:teuthology.orchestra.run.smithi179.stdout: "reply": 0, 2024-09-19T07:30:30.328 INFO:teuthology.orchestra.run.smithi179.stdout: "reply_latency": { 2024-09-19T07:30:30.328 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:30.328 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:30.328 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:30.328 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.328 INFO:teuthology.orchestra.run.smithi179.stdout: "slow_reply": 0, 2024-09-19T07:30:30.329 INFO:teuthology.orchestra.run.smithi179.stdout: "forward": 0, 2024-09-19T07:30:30.329 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_fetch_complete": 0, 2024-09-19T07:30:30.329 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_fetch_keys": 0, 2024-09-19T07:30:30.329 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_commit": 0, 2024-09-19T07:30:30.329 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_split": 0, 2024-09-19T07:30:30.329 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_merge": 0, 2024-09-19T07:30:30.329 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes": 184738, 2024-09-19T07:30:30.329 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_top": 40203, 2024-09-19T07:30:30.329 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_bottom": 144535, 2024-09-19T07:30:30.329 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_pin_tail": 0, 2024-09-19T07:30:30.329 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_pinned": 127306, 2024-09-19T07:30:30.329 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_expired": 0, 2024-09-19T07:30:30.330 INFO:teuthology.orchestra.run.smithi179.stdout: "inodes_with_caps": 0, 2024-09-19T07:30:30.330 INFO:teuthology.orchestra.run.smithi179.stdout: "caps": 0, 2024-09-19T07:30:30.330 INFO:teuthology.orchestra.run.smithi179.stdout: "subtrees": 3, 2024-09-19T07:30:30.330 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse": 0, 2024-09-19T07:30:30.330 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_hit": 0, 2024-09-19T07:30:30.330 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_forward": 0, 2024-09-19T07:30:30.330 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_discover": 0, 2024-09-19T07:30:30.330 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_dir_fetch": 0, 2024-09-19T07:30:30.330 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_remote_ino": 0, 2024-09-19T07:30:30.330 INFO:teuthology.orchestra.run.smithi179.stdout: "traverse_lock": 0, 2024-09-19T07:30:30.330 INFO:teuthology.orchestra.run.smithi179.stdout: "load_cent": 0, 2024-09-19T07:30:30.331 INFO:teuthology.orchestra.run.smithi179.stdout: "q": 0, 2024-09-19T07:30:30.331 INFO:teuthology.orchestra.run.smithi179.stdout: "exported": 0, 2024-09-19T07:30:30.331 INFO:teuthology.orchestra.run.smithi179.stdout: "exported_inodes": 0, 2024-09-19T07:30:30.331 INFO:teuthology.orchestra.run.smithi179.stdout: "imported": 0, 2024-09-19T07:30:30.331 INFO:teuthology.orchestra.run.smithi179.stdout: "imported_inodes": 0, 2024-09-19T07:30:30.331 INFO:teuthology.orchestra.run.smithi179.stdout: "openino_dir_fetch": 0, 2024-09-19T07:30:30.331 INFO:teuthology.orchestra.run.smithi179.stdout: "openino_backtrace_fetch": 0, 2024-09-19T07:30:30.331 INFO:teuthology.orchestra.run.smithi179.stdout: "openino_peer_discover": 0, 2024-09-19T07:30:30.331 INFO:teuthology.orchestra.run.smithi179.stdout: "root_rfiles": 0, 2024-09-19T07:30:30.332 INFO:teuthology.orchestra.run.smithi179.stdout: "root_rbytes": 0, 2024-09-19T07:30:30.332 INFO:teuthology.orchestra.run.smithi179.stdout: "root_rsnaps": 0, 2024-09-19T07:30:30.332 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T07:30:30.332 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_set_tag": 0, 2024-09-19T07:30:30.332 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T07:30:30.332 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_inotable_repaired": 0, 2024-09-19T07:30:30.332 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_dir_inodes": 0, 2024-09-19T07:30:30.332 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T07:30:30.332 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T07:30:30.332 INFO:teuthology.orchestra.run.smithi179.stdout: "scrub_file_inodes": 0, 2024-09-19T07:30:30.332 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_inode_file_caps": 0, 2024-09-19T07:30:30.333 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T07:30:30.333 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_grant": 0, 2024-09-19T07:30:30.333 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T07:30:30.333 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T07:30:30.333 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T07:30:30.333 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_caps": 0, 2024-09-19T07:30:30.333 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_caps_dirty": 0, 2024-09-19T07:30:30.333 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_cap_release": 0, 2024-09-19T07:30:30.333 INFO:teuthology.orchestra.run.smithi179.stdout: "process_request_cap_release": 0 2024-09-19T07:30:30.333 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.333 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_cache": { 2024-09-19T07:30:30.333 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_update": 0, 2024-09-19T07:30:30.334 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_update_receipt": 0, 2024-09-19T07:30:30.334 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_try_discover": 0, 2024-09-19T07:30:30.334 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_send_discover": 0, 2024-09-19T07:30:30.334 INFO:teuthology.orchestra.run.smithi179.stdout: "dir_handle_discover": 0, 2024-09-19T07:30:30.334 INFO:teuthology.orchestra.run.smithi179.stdout: "num_strays": 0, 2024-09-19T07:30:30.334 INFO:teuthology.orchestra.run.smithi179.stdout: "num_strays_delayed": 0, 2024-09-19T07:30:30.334 INFO:teuthology.orchestra.run.smithi179.stdout: "num_strays_enqueuing": 0, 2024-09-19T07:30:30.334 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_created": 0, 2024-09-19T07:30:30.334 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_enqueued": 0, 2024-09-19T07:30:30.334 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_reintegrated": 0, 2024-09-19T07:30:30.334 INFO:teuthology.orchestra.run.smithi179.stdout: "strays_migrated": 0, 2024-09-19T07:30:30.334 INFO:teuthology.orchestra.run.smithi179.stdout: "num_recovering_processing": 0, 2024-09-19T07:30:30.335 INFO:teuthology.orchestra.run.smithi179.stdout: "num_recovering_enqueued": 0, 2024-09-19T07:30:30.335 INFO:teuthology.orchestra.run.smithi179.stdout: "num_recovering_prioritized": 0, 2024-09-19T07:30:30.335 INFO:teuthology.orchestra.run.smithi179.stdout: "recovery_started": 0, 2024-09-19T07:30:30.335 INFO:teuthology.orchestra.run.smithi179.stdout: "recovery_completed": 0, 2024-09-19T07:30:30.335 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_quiesce_path": 0, 2024-09-19T07:30:30.335 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_quiesce_inode": 0, 2024-09-19T07:30:30.335 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T07:30:30.335 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_exportdir": 0, 2024-09-19T07:30:30.335 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_flush": 0, 2024-09-19T07:30:30.335 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_fragmentdir": 0, 2024-09-19T07:30:30.335 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_fragstats": 0, 2024-09-19T07:30:30.336 INFO:teuthology.orchestra.run.smithi179.stdout: "ireq_inodestats": 0 2024-09-19T07:30:30.336 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.336 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_log": { 2024-09-19T07:30:30.336 INFO:teuthology.orchestra.run.smithi179.stdout: "evlrg": 0, 2024-09-19T07:30:30.336 INFO:teuthology.orchestra.run.smithi179.stdout: "evadd": 0, 2024-09-19T07:30:30.336 INFO:teuthology.orchestra.run.smithi179.stdout: "evex": 0, 2024-09-19T07:30:30.336 INFO:teuthology.orchestra.run.smithi179.stdout: "evtrm": 0, 2024-09-19T07:30:30.336 INFO:teuthology.orchestra.run.smithi179.stdout: "ev": 194979, 2024-09-19T07:30:30.336 INFO:teuthology.orchestra.run.smithi179.stdout: "evexg": 0, 2024-09-19T07:30:30.336 INFO:teuthology.orchestra.run.smithi179.stdout: "evexd": 0, 2024-09-19T07:30:30.336 INFO:teuthology.orchestra.run.smithi179.stdout: "segadd": 0, 2024-09-19T07:30:30.336 INFO:teuthology.orchestra.run.smithi179.stdout: "segex": 0, 2024-09-19T07:30:30.336 INFO:teuthology.orchestra.run.smithi179.stdout: "segtrm": 0, 2024-09-19T07:30:30.337 INFO:teuthology.orchestra.run.smithi179.stdout: "seg": 132, 2024-09-19T07:30:30.337 INFO:teuthology.orchestra.run.smithi179.stdout: "segmjr": 17, 2024-09-19T07:30:30.337 INFO:teuthology.orchestra.run.smithi179.stdout: "segexg": 0, 2024-09-19T07:30:30.337 INFO:teuthology.orchestra.run.smithi179.stdout: "segexd": 0, 2024-09-19T07:30:30.337 INFO:teuthology.orchestra.run.smithi179.stdout: "expos": 328857269, 2024-09-19T07:30:30.337 INFO:teuthology.orchestra.run.smithi179.stdout: "wrpos": 852323353, 2024-09-19T07:30:30.337 INFO:teuthology.orchestra.run.smithi179.stdout: "rdpos": 852322779, 2024-09-19T07:30:30.337 INFO:teuthology.orchestra.run.smithi179.stdout: "jlat": { 2024-09-19T07:30:30.337 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:30.337 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:30.337 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:30.337 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.337 INFO:teuthology.orchestra.run.smithi179.stdout: "replayed": 194979 2024-09-19T07:30:30.338 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.338 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_mem": { 2024-09-19T07:30:30.338 INFO:teuthology.orchestra.run.smithi179.stdout: "ino": 60789, 2024-09-19T07:30:30.338 INFO:teuthology.orchestra.run.smithi179.stdout: "ino+": 140423, 2024-09-19T07:30:30.338 INFO:teuthology.orchestra.run.smithi179.stdout: "ino-": 79634, 2024-09-19T07:30:30.338 INFO:teuthology.orchestra.run.smithi179.stdout: "dir": 1982, 2024-09-19T07:30:30.338 INFO:teuthology.orchestra.run.smithi179.stdout: "dir+": 3369, 2024-09-19T07:30:30.338 INFO:teuthology.orchestra.run.smithi179.stdout: "dir-": 1387, 2024-09-19T07:30:30.338 INFO:teuthology.orchestra.run.smithi179.stdout: "dn": 184738, 2024-09-19T07:30:30.338 INFO:teuthology.orchestra.run.smithi179.stdout: "dn+": 235758, 2024-09-19T07:30:30.338 INFO:teuthology.orchestra.run.smithi179.stdout: "dn-": 51020, 2024-09-19T07:30:30.338 INFO:teuthology.orchestra.run.smithi179.stdout: "cap": 0, 2024-09-19T07:30:30.339 INFO:teuthology.orchestra.run.smithi179.stdout: "cap+": 0, 2024-09-19T07:30:30.339 INFO:teuthology.orchestra.run.smithi179.stdout: "cap-": 0, 2024-09-19T07:30:30.339 INFO:teuthology.orchestra.run.smithi179.stdout: "rss": 372192, 2024-09-19T07:30:30.339 INFO:teuthology.orchestra.run.smithi179.stdout: "heap": 215328 2024-09-19T07:30:30.339 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.339 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_server": { 2024-09-19T07:30:30.339 INFO:teuthology.orchestra.run.smithi179.stdout: "dispatch_client_request": 0, 2024-09-19T07:30:30.339 INFO:teuthology.orchestra.run.smithi179.stdout: "dispatch_server_request": 0, 2024-09-19T07:30:30.339 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_request": 0, 2024-09-19T07:30:30.339 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_client_session": 0, 2024-09-19T07:30:30.339 INFO:teuthology.orchestra.run.smithi179.stdout: "handle_peer_request": 0, 2024-09-19T07:30:30.339 INFO:teuthology.orchestra.run.smithi179.stdout: "req_create_latency": { 2024-09-19T07:30:30.339 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:30.339 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:30.340 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:30.340 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.340 INFO:teuthology.orchestra.run.smithi179.stdout: "req_getattr_latency": { 2024-09-19T07:30:30.340 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:30.340 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:30.340 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:30.340 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.340 INFO:teuthology.orchestra.run.smithi179.stdout: "req_getfilelock_latency": { 2024-09-19T07:30:30.340 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:30.340 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:30.340 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:30.340 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.341 INFO:teuthology.orchestra.run.smithi179.stdout: "req_link_latency": { 2024-09-19T07:30:30.341 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:30.341 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:30.341 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:30.341 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.341 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookup_latency": { 2024-09-19T07:30:30.341 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:30.341 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:30.341 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:30.341 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.341 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookuphash_latency": { 2024-09-19T07:30:30.342 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:30.342 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:30.342 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:30.342 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.342 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupino_latency": { 2024-09-19T07:30:30.342 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:30.342 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:30.342 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:30.342 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.342 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupname_latency": { 2024-09-19T07:30:30.342 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:30.342 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:30.342 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:30.342 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.343 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupparent_latency": { 2024-09-19T07:30:30.343 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:30.343 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:30.343 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:30.343 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.343 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lookupsnap_latency": { 2024-09-19T07:30:30.343 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:30.343 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:30.343 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:30.343 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.343 INFO:teuthology.orchestra.run.smithi179.stdout: "req_lssnap_latency": { 2024-09-19T07:30:30.343 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:30.343 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:30.344 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:30.344 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.344 INFO:teuthology.orchestra.run.smithi179.stdout: "req_mkdir_latency": { 2024-09-19T07:30:30.344 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:30.345 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:30.345 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:30.345 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.345 INFO:teuthology.orchestra.run.smithi179.stdout: "req_mknod_latency": { 2024-09-19T07:30:30.345 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:30.345 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:30.345 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:30.345 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.346 INFO:teuthology.orchestra.run.smithi179.stdout: "req_mksnap_latency": { 2024-09-19T07:30:30.346 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:30.346 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:30.346 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:30.346 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.346 INFO:teuthology.orchestra.run.smithi179.stdout: "req_open_latency": { 2024-09-19T07:30:30.346 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:30.346 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:30.346 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:30.346 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.346 INFO:teuthology.orchestra.run.smithi179.stdout: "req_readdir_latency": { 2024-09-19T07:30:30.347 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:30.347 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:30.347 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:30.347 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.347 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rename_latency": { 2024-09-19T07:30:30.347 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:30.347 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:30.347 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:30.347 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.347 INFO:teuthology.orchestra.run.smithi179.stdout: "req_renamesnap_latency": { 2024-09-19T07:30:30.347 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:30.347 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:30.347 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:30.348 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.348 INFO:teuthology.orchestra.run.smithi179.stdout: "req_snapdiff_latency": { 2024-09-19T07:30:30.348 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:30.348 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:30.348 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:30.348 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.348 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rmdir_latency": { 2024-09-19T07:30:30.348 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:30.348 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:30.348 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:30.348 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.349 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rmsnap_latency": { 2024-09-19T07:30:30.349 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:30.349 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:30.349 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:30.349 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.349 INFO:teuthology.orchestra.run.smithi179.stdout: "req_rmxattr_latency": { 2024-09-19T07:30:30.349 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:30.349 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:30.349 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:30.349 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.349 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setattr_latency": { 2024-09-19T07:30:30.349 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:30.350 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:30.350 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:30.350 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.350 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setdirlayout_latency": { 2024-09-19T07:30:30.350 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:30.350 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:30.350 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:30.350 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.350 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setfilelock_latency": { 2024-09-19T07:30:30.350 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:30.350 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:30.350 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:30.351 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.351 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setlayout_latency": { 2024-09-19T07:30:30.351 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:30.351 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:30.351 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:30.351 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.351 INFO:teuthology.orchestra.run.smithi179.stdout: "req_setxattr_latency": { 2024-09-19T07:30:30.351 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:30.351 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:30.351 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:30.351 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.351 INFO:teuthology.orchestra.run.smithi179.stdout: "req_symlink_latency": { 2024-09-19T07:30:30.351 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:30.352 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:30.352 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:30.352 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.352 INFO:teuthology.orchestra.run.smithi179.stdout: "req_unlink_latency": { 2024-09-19T07:30:30.352 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:30.352 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:30.352 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:30.352 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.352 INFO:teuthology.orchestra.run.smithi179.stdout: "cap_revoke_eviction": 0, 2024-09-19T07:30:30.352 INFO:teuthology.orchestra.run.smithi179.stdout: "cap_acquisition_throttle": 0, 2024-09-19T07:30:30.352 INFO:teuthology.orchestra.run.smithi179.stdout: "req_getvxattr_latency": { 2024-09-19T07:30:30.352 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:30.352 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:30.353 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:30.353 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-19T07:30:30.353 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.353 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_sessions": { 2024-09-19T07:30:30.353 INFO:teuthology.orchestra.run.smithi179.stdout: "session_count": 2, 2024-09-19T07:30:30.353 INFO:teuthology.orchestra.run.smithi179.stdout: "session_add": 5, 2024-09-19T07:30:30.353 INFO:teuthology.orchestra.run.smithi179.stdout: "session_remove": 3, 2024-09-19T07:30:30.353 INFO:teuthology.orchestra.run.smithi179.stdout: "sessions_open": 4, 2024-09-19T07:30:30.353 INFO:teuthology.orchestra.run.smithi179.stdout: "sessions_stale": 0, 2024-09-19T07:30:30.353 INFO:teuthology.orchestra.run.smithi179.stdout: "total_load": 0, 2024-09-19T07:30:30.353 INFO:teuthology.orchestra.run.smithi179.stdout: "average_load": 0, 2024-09-19T07:30:30.353 INFO:teuthology.orchestra.run.smithi179.stdout: "avg_session_uptime": 5902, 2024-09-19T07:30:30.353 INFO:teuthology.orchestra.run.smithi179.stdout: "mdthresh_evicted": 0 2024-09-19T07:30:30.354 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.354 INFO:teuthology.orchestra.run.smithi179.stdout: "mempool": { 2024-09-19T07:30:30.354 INFO:teuthology.orchestra.run.smithi179.stdout: "bloom_filter_bytes": 0, 2024-09-19T07:30:30.354 INFO:teuthology.orchestra.run.smithi179.stdout: "bloom_filter_items": 0, 2024-09-19T07:30:30.354 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T07:30:30.354 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_alloc_items": 0, 2024-09-19T07:30:30.354 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T07:30:30.354 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_data_items": 0, 2024-09-19T07:30:30.354 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T07:30:30.354 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T07:30:30.354 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T07:30:30.354 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T07:30:30.354 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T07:30:30.354 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_other_items": 0, 2024-09-19T07:30:30.354 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T07:30:30.355 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T07:30:30.355 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_extent_bytes": 0, 2024-09-19T07:30:30.355 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_extent_items": 0, 2024-09-19T07:30:30.355 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_blob_bytes": 0, 2024-09-19T07:30:30.355 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_blob_items": 0, 2024-09-19T07:30:30.355 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T07:30:30.355 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T07:30:30.355 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T07:30:30.355 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T07:30:30.355 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T07:30:30.355 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_fsck_items": 0, 2024-09-19T07:30:30.355 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_txc_bytes": 0, 2024-09-19T07:30:30.356 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_txc_items": 0, 2024-09-19T07:30:30.356 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T07:30:30.356 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T07:30:30.356 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_bytes": 0, 2024-09-19T07:30:30.356 INFO:teuthology.orchestra.run.smithi179.stdout: "bluestore_writing_items": 0, 2024-09-19T07:30:30.356 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_bytes": 0, 2024-09-19T07:30:30.356 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_items": 0, 2024-09-19T07:30:30.356 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T07:30:30.356 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_reader_items": 0, 2024-09-19T07:30:30.356 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T07:30:30.356 INFO:teuthology.orchestra.run.smithi179.stdout: "bluefs_file_writer_items": 0, 2024-09-19T07:30:30.356 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_anon_bytes": 2527602, 2024-09-19T07:30:30.356 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_anon_items": 61921, 2024-09-19T07:30:30.356 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_meta_bytes": 0, 2024-09-19T07:30:30.357 INFO:teuthology.orchestra.run.smithi179.stdout: "buffer_meta_items": 0, 2024-09-19T07:30:30.357 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_bytes": 0, 2024-09-19T07:30:30.357 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_items": 0, 2024-09-19T07:30:30.357 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_mapbl_bytes": 0, 2024-09-19T07:30:30.357 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_mapbl_items": 0, 2024-09-19T07:30:30.357 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_pglog_bytes": 0, 2024-09-19T07:30:30.357 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_pglog_items": 0, 2024-09-19T07:30:30.357 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_bytes": 8344, 2024-09-19T07:30:30.357 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_items": 185, 2024-09-19T07:30:30.357 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T07:30:30.357 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_mapping_items": 0, 2024-09-19T07:30:30.357 INFO:teuthology.orchestra.run.smithi179.stdout: "pgmap_bytes": 0, 2024-09-19T07:30:30.357 INFO:teuthology.orchestra.run.smithi179.stdout: "pgmap_items": 0, 2024-09-19T07:30:30.357 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_co_bytes": 272459563, 2024-09-19T07:30:30.358 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_co_items": 2608152, 2024-09-19T07:30:30.358 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_1_bytes": 0, 2024-09-19T07:30:30.358 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_1_items": 0, 2024-09-19T07:30:30.358 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_2_bytes": 0, 2024-09-19T07:30:30.358 INFO:teuthology.orchestra.run.smithi179.stdout: "unittest_2_items": 0 2024-09-19T07:30:30.358 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.358 INFO:teuthology.orchestra.run.smithi179.stdout: "objecter": { 2024-09-19T07:30:30.358 INFO:teuthology.orchestra.run.smithi179.stdout: "op_active": 0, 2024-09-19T07:30:30.358 INFO:teuthology.orchestra.run.smithi179.stdout: "op_laggy": 0, 2024-09-19T07:30:30.358 INFO:teuthology.orchestra.run.smithi179.stdout: "op_send": 5366, 2024-09-19T07:30:30.358 INFO:teuthology.orchestra.run.smithi179.stdout: "op_send_bytes": 21, 2024-09-19T07:30:30.358 INFO:teuthology.orchestra.run.smithi179.stdout: "op_resend": 3, 2024-09-19T07:30:30.359 INFO:teuthology.orchestra.run.smithi179.stdout: "op_reply": 5366, 2024-09-19T07:30:30.359 INFO:teuthology.orchestra.run.smithi179.stdout: "op_latency": { 2024-09-19T07:30:30.359 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 5366, 2024-09-19T07:30:30.359 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 23.207467552, 2024-09-19T07:30:30.359 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.004324910 2024-09-19T07:30:30.359 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.359 INFO:teuthology.orchestra.run.smithi179.stdout: "op_inflight": 0, 2024-09-19T07:30:30.359 INFO:teuthology.orchestra.run.smithi179.stdout: "oplen_avg": { 2024-09-19T07:30:30.359 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 5366, 2024-09-19T07:30:30.359 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 5367 2024-09-19T07:30:30.359 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.359 INFO:teuthology.orchestra.run.smithi179.stdout: "op": 5366, 2024-09-19T07:30:30.359 INFO:teuthology.orchestra.run.smithi179.stdout: "op_r": 5366, 2024-09-19T07:30:30.360 INFO:teuthology.orchestra.run.smithi179.stdout: "op_w": 0, 2024-09-19T07:30:30.360 INFO:teuthology.orchestra.run.smithi179.stdout: "op_rmw": 0, 2024-09-19T07:30:30.360 INFO:teuthology.orchestra.run.smithi179.stdout: "op_pg": 0, 2024-09-19T07:30:30.360 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_stat": 3388, 2024-09-19T07:30:30.360 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_create": 0, 2024-09-19T07:30:30.360 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_read": 1976, 2024-09-19T07:30:30.360 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_write": 0, 2024-09-19T07:30:30.360 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_writefull": 0, 2024-09-19T07:30:30.360 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_writesame": 0, 2024-09-19T07:30:30.360 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_append": 0, 2024-09-19T07:30:30.360 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_zero": 0, 2024-09-19T07:30:30.360 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_truncate": 0, 2024-09-19T07:30:30.360 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_delete": 0, 2024-09-19T07:30:30.360 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_mapext": 0, 2024-09-19T07:30:30.361 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_sparse_read": 0, 2024-09-19T07:30:30.361 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_clonerange": 0, 2024-09-19T07:30:30.361 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_getxattr": 1, 2024-09-19T07:30:30.361 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_setxattr": 0, 2024-09-19T07:30:30.361 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_cmpxattr": 0, 2024-09-19T07:30:30.361 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_rmxattr": 0, 2024-09-19T07:30:30.361 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_resetxattrs": 0, 2024-09-19T07:30:30.361 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_call": 0, 2024-09-19T07:30:30.361 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_watch": 0, 2024-09-19T07:30:30.361 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_notify": 0, 2024-09-19T07:30:30.361 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T07:30:30.361 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_pgls": 0, 2024-09-19T07:30:30.361 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_pgls_filter": 0, 2024-09-19T07:30:30.362 INFO:teuthology.orchestra.run.smithi179.stdout: "osdop_other": 0, 2024-09-19T07:30:30.362 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_active": 0, 2024-09-19T07:30:30.362 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_send": 0, 2024-09-19T07:30:30.362 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_resend": 0, 2024-09-19T07:30:30.362 INFO:teuthology.orchestra.run.smithi179.stdout: "linger_ping": 0, 2024-09-19T07:30:30.362 INFO:teuthology.orchestra.run.smithi179.stdout: "poolop_active": 0, 2024-09-19T07:30:30.362 INFO:teuthology.orchestra.run.smithi179.stdout: "poolop_send": 0, 2024-09-19T07:30:30.362 INFO:teuthology.orchestra.run.smithi179.stdout: "poolop_resend": 0, 2024-09-19T07:30:30.362 INFO:teuthology.orchestra.run.smithi179.stdout: "poolstat_active": 0, 2024-09-19T07:30:30.362 INFO:teuthology.orchestra.run.smithi179.stdout: "poolstat_send": 0, 2024-09-19T07:30:30.362 INFO:teuthology.orchestra.run.smithi179.stdout: "poolstat_resend": 0, 2024-09-19T07:30:30.362 INFO:teuthology.orchestra.run.smithi179.stdout: "statfs_active": 0, 2024-09-19T07:30:30.362 INFO:teuthology.orchestra.run.smithi179.stdout: "statfs_send": 0, 2024-09-19T07:30:30.362 INFO:teuthology.orchestra.run.smithi179.stdout: "statfs_resend": 0, 2024-09-19T07:30:30.363 INFO:teuthology.orchestra.run.smithi179.stdout: "command_active": 0, 2024-09-19T07:30:30.363 INFO:teuthology.orchestra.run.smithi179.stdout: "command_send": 0, 2024-09-19T07:30:30.363 INFO:teuthology.orchestra.run.smithi179.stdout: "command_resend": 0, 2024-09-19T07:30:30.363 INFO:teuthology.orchestra.run.smithi179.stdout: "map_epoch": 107, 2024-09-19T07:30:30.363 INFO:teuthology.orchestra.run.smithi179.stdout: "map_full": 0, 2024-09-19T07:30:30.363 INFO:teuthology.orchestra.run.smithi179.stdout: "map_inc": 29, 2024-09-19T07:30:30.363 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_sessions": 11, 2024-09-19T07:30:30.363 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_session_open": 11, 2024-09-19T07:30:30.363 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_session_close": 0, 2024-09-19T07:30:30.363 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_laggy": 0, 2024-09-19T07:30:30.363 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_wr": 0, 2024-09-19T07:30:30.363 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_rd": 2, 2024-09-19T07:30:30.363 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_del": 0 2024-09-19T07:30:30.363 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.364 INFO:teuthology.orchestra.run.smithi179.stdout: "oft": { 2024-09-19T07:30:30.364 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_objs": 0, 2024-09-19T07:30:30.364 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_kv_pairs": 0, 2024-09-19T07:30:30.364 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_updates": 0, 2024-09-19T07:30:30.364 INFO:teuthology.orchestra.run.smithi179.stdout: "omap_total_removes": 0 2024-09-19T07:30:30.364 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.364 INFO:teuthology.orchestra.run.smithi179.stdout: "osd-slow-ops": { 2024-09-19T07:30:30.364 INFO:teuthology.orchestra.run.smithi179.stdout: "slow_ops_count": 0 2024-09-19T07:30:30.364 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.364 INFO:teuthology.orchestra.run.smithi179.stdout: "purge_queue": { 2024-09-19T07:30:30.364 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing_ops": 0, 2024-09-19T07:30:30.364 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T07:30:30.364 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing": 0, 2024-09-19T07:30:30.364 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executing_high_water": 0, 2024-09-19T07:30:30.365 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executed_ops": 0, 2024-09-19T07:30:30.365 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_executed": 0, 2024-09-19T07:30:30.365 INFO:teuthology.orchestra.run.smithi179.stdout: "pq_item_in_journal": 0 2024-09-19T07:30:30.365 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.365 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T07:30:30.365 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-09-19T07:30:30.365 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 104857600, 2024-09-19T07:30:30.365 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-09-19T07:30:30.365 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 5792, 2024-09-19T07:30:30.365 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 850979530, 2024-09-19T07:30:30.365 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-09-19T07:30:30.365 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 5792, 2024-09-19T07:30:30.365 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 0, 2024-09-19T07:30:30.365 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 0, 2024-09-19T07:30:30.366 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 5792, 2024-09-19T07:30:30.366 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 850979530, 2024-09-19T07:30:30.366 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-09-19T07:30:30.366 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:30.366 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:30.366 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:30.366 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-19T07:30:30.366 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.366 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-objecter_bytes": { 2024-09-19T07:30:30.366 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-09-19T07:30:30.366 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 104857600, 2024-09-19T07:30:30.366 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-09-19T07:30:30.366 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 0, 2024-09-19T07:30:30.366 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 0, 2024-09-19T07:30:30.366 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-09-19T07:30:30.367 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 0, 2024-09-19T07:30:30.367 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 5366, 2024-09-19T07:30:30.367 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 848393974, 2024-09-19T07:30:30.367 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 5366, 2024-09-19T07:30:30.367 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 848393974, 2024-09-19T07:30:30.367 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-09-19T07:30:30.367 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:30.367 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:30.367 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:30.367 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-19T07:30:30.367 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.367 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-objecter_ops": { 2024-09-19T07:30:30.367 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-09-19T07:30:30.367 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 1024, 2024-09-19T07:30:30.368 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-09-19T07:30:30.368 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 0, 2024-09-19T07:30:30.368 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 0, 2024-09-19T07:30:30.368 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-09-19T07:30:30.368 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 0, 2024-09-19T07:30:30.368 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 5366, 2024-09-19T07:30:30.368 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 5366, 2024-09-19T07:30:30.368 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 5366, 2024-09-19T07:30:30.368 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 5366, 2024-09-19T07:30:30.368 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-09-19T07:30:30.368 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:30.368 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:30.368 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:30.369 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-19T07:30:30.369 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.369 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-write_buf_throttle": { 2024-09-19T07:30:30.369 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-09-19T07:30:30.369 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 3758096384, 2024-09-19T07:30:30.369 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-09-19T07:30:30.369 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 0, 2024-09-19T07:30:30.369 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 0, 2024-09-19T07:30:30.369 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-09-19T07:30:30.369 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 0, 2024-09-19T07:30:30.369 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 0, 2024-09-19T07:30:30.369 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 0, 2024-09-19T07:30:30.369 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 0, 2024-09-19T07:30:30.369 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 0, 2024-09-19T07:30:30.370 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-09-19T07:30:30.370 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:30.370 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:30.370 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:30.370 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-19T07:30:30.370 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-19T07:30:30.370 INFO:teuthology.orchestra.run.smithi179.stdout: "throttle-write_buf_throttle-0x55f70807eb40": { 2024-09-19T07:30:30.370 INFO:teuthology.orchestra.run.smithi179.stdout: "val": 0, 2024-09-19T07:30:30.370 INFO:teuthology.orchestra.run.smithi179.stdout: "max": 3758096384, 2024-09-19T07:30:30.370 INFO:teuthology.orchestra.run.smithi179.stdout: "get_started": 0, 2024-09-19T07:30:30.370 INFO:teuthology.orchestra.run.smithi179.stdout: "get": 0, 2024-09-19T07:30:30.370 INFO:teuthology.orchestra.run.smithi179.stdout: "get_sum": 0, 2024-09-19T07:30:30.371 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_fail": 0, 2024-09-19T07:30:30.371 INFO:teuthology.orchestra.run.smithi179.stdout: "get_or_fail_success": 0, 2024-09-19T07:30:30.371 INFO:teuthology.orchestra.run.smithi179.stdout: "take": 0, 2024-09-19T07:30:30.371 INFO:teuthology.orchestra.run.smithi179.stdout: "take_sum": 0, 2024-09-19T07:30:30.371 INFO:teuthology.orchestra.run.smithi179.stdout: "put": 0, 2024-09-19T07:30:30.371 INFO:teuthology.orchestra.run.smithi179.stdout: "put_sum": 0, 2024-09-19T07:30:30.371 INFO:teuthology.orchestra.run.smithi179.stdout: "wait": { 2024-09-19T07:30:30.371 INFO:teuthology.orchestra.run.smithi179.stdout: "avgcount": 0, 2024-09-19T07:30:30.371 INFO:teuthology.orchestra.run.smithi179.stdout: "sum": 0.000000000, 2024-09-19T07:30:30.371 INFO:teuthology.orchestra.run.smithi179.stdout: "avgtime": 0.000000000 2024-09-19T07:30:30.371 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-19T07:30:30.371 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-19T07:30:30.371 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-19T07:30:31.169 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-09-19T07:30:31.170 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-09-19T07:30:31.170 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2024-09-19T07:30:31.170 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=0 2024-09-19T07:30:31.170 INFO:tasks.check_counter:Daemon mds.l mds.root_rsnaps=0 2024-09-19T07:30:31.170 INFO:tasks.check_counter:Daemon mds.l mds_server.req_mksnap_latency.avgcount=0 2024-09-19T07:30:31.170 INFO:tasks.check_counter:Daemon mds.l mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T07:30:31.170 INFO:tasks.check_counter:Daemon mds.l mds.dir_split=0 2024-09-19T07:30:31.170 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-19T07:30:31.183 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-19T07:30:31.183 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-19T07:30:31.184 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T07:30:31.184 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:30 smithi179 ceph-mon[35716]: pgmap v612: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T07:30:31.216 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-19T07:30:31.216 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T07:30:31.289 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T07:30:31.332 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:30 smithi148 ceph-mon[31180]: pgmap v612: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T07:30:31.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:30 smithi165 ceph-mon[35326]: pgmap v612: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T07:30:31.819 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:30:32.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.432+0000 7f6ffb70b640 1 -- 172.21.15.148:0/3207149951 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ff410d4b0 msgr2=0x7f6ff4115030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:32.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.432+0000 7f6ffb70b640 1 --2- 172.21.15.148:0/3207149951 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ff410d4b0 0x7f6ff4115030 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6fec009be0 tx=0x7f6fec02a6f0 comp rx=0 tx=0).stop 2024-09-19T07:30:32.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.432+0000 7f6ffb70b640 1 -- 172.21.15.148:0/3207149951 shutdown_connections 2024-09-19T07:30:32.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.432+0000 7f6ffb70b640 1 --2- 172.21.15.148:0/3207149951 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ff410d4b0 0x7f6ff4115030 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:32.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.432+0000 7f6ffb70b640 1 --2- 172.21.15.148:0/3207149951 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ff4108c30 0x7f6ff410cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:32.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.432+0000 7f6ffb70b640 1 --2- 172.21.15.148:0/3207149951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ff4108280 0x7f6ff4108660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:32.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.432+0000 7f6ffb70b640 1 -- 172.21.15.148:0/3207149951 >> 172.21.15.148:0/3207149951 conn(0x7f6ff4077a10 msgr2=0x7f6ff4079e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:30:32.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.433+0000 7f6ffb70b640 1 -- 172.21.15.148:0/3207149951 shutdown_connections 2024-09-19T07:30:32.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.435+0000 7f6ffb70b640 1 -- 172.21.15.148:0/3207149951 wait complete. 2024-09-19T07:30:32.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.436+0000 7f6ffb70b640 1 Processor -- start 2024-09-19T07:30:32.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.436+0000 7f6ffb70b640 1 -- start start 2024-09-19T07:30:32.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.437+0000 7f6ffb70b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ff4108280 0x7f6ff41a4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:32.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.437+0000 7f6ffb70b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ff4108c30 0x7f6ff41a4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:32.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.437+0000 7f6ffb70b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ff410d4b0 0x7f6ff419e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:32.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.437+0000 7f6ffb70b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff41184d0 con 0x7f6ff4108280 2024-09-19T07:30:32.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.437+0000 7f6ffb70b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff4118350 con 0x7f6ff4108c30 2024-09-19T07:30:32.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.437+0000 7f6ffb70b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff4118650 con 0x7f6ff410d4b0 2024-09-19T07:30:32.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.437+0000 7f6ff9ca8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ff410d4b0 0x7f6ff419e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:30:32.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.437+0000 7f6ff9ca8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ff410d4b0 0x7f6ff419e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:52462/0 (socket says 172.21.15.148:52462) 2024-09-19T07:30:32.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.437+0000 7f6ff9ca8640 1 -- 172.21.15.148:0/1356078429 learned_addr learned my addr 172.21.15.148:0/1356078429 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:30:32.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.437+0000 7f6ff94a7640 1 --2- 172.21.15.148:0/1356078429 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ff4108280 0x7f6ff41a4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:30:32.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.437+0000 7f6ff8ca6640 1 --2- 172.21.15.148:0/1356078429 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ff4108c30 0x7f6ff41a4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:30:32.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.438+0000 7f6ff9ca8640 1 -- 172.21.15.148:0/1356078429 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ff4108c30 msgr2=0x7f6ff41a4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:32.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.438+0000 7f6ff9ca8640 1 --2- 172.21.15.148:0/1356078429 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ff4108c30 0x7f6ff41a4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:32.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.438+0000 7f6ff9ca8640 1 -- 172.21.15.148:0/1356078429 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ff4108280 msgr2=0x7f6ff41a4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:32.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.438+0000 7f6ff9ca8640 1 --2- 172.21.15.148:0/1356078429 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ff4108280 0x7f6ff41a4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:32.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.438+0000 7f6ff9ca8640 1 -- 172.21.15.148:0/1356078429 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ff419ef80 con 0x7f6ff410d4b0 2024-09-19T07:30:32.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.438+0000 7f6ff9ca8640 1 --2- 172.21.15.148:0/1356078429 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ff410d4b0 0x7f6ff419e7e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6fec004af0 tx=0x7f6fec032f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:30:32.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.438+0000 7f6fea7fc640 1 -- 172.21.15.148:0/1356078429 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec041020 con 0x7f6ff410d4b0 2024-09-19T07:30:32.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.438+0000 7f6fea7fc640 1 -- 172.21.15.148:0/1356078429 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6fec030880 con 0x7f6ff410d4b0 2024-09-19T07:30:32.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.438+0000 7f6fea7fc640 1 -- 172.21.15.148:0/1356078429 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec036040 con 0x7f6ff410d4b0 2024-09-19T07:30:32.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.442+0000 7f6ffb70b640 1 -- 172.21.15.148:0/1356078429 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ff419f210 con 0x7f6ff410d4b0 2024-09-19T07:30:32.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.442+0000 7f6ffb70b640 1 -- 172.21.15.148:0/1356078429 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ff419f670 con 0x7f6ff410d4b0 2024-09-19T07:30:32.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.443+0000 7f6ffb70b640 1 -- 172.21.15.148:0/1356078429 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ff4109750 con 0x7f6ff410d4b0 2024-09-19T07:30:32.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.446+0000 7f6fea7fc640 1 -- 172.21.15.148:0/1356078429 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f6fec044020 con 0x7f6ff410d4b0 2024-09-19T07:30:32.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.447+0000 7f6fea7fc640 1 --2- 172.21.15.148:0/1356078429 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f6fe00a3430 0x7f6fe00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:32.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.448+0000 7f6fea7fc640 1 -- 172.21.15.148:0/1356078429 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 8600+0+0 (secure 0 0 0) 0x7f6fec0f01a0 con 0x7f6ff410d4b0 2024-09-19T07:30:32.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.449+0000 7f6ff94a7640 1 --2- 172.21.15.148:0/1356078429 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f6fe00a3430 0x7f6fe00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:30:32.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.453+0000 7f6ff94a7640 1 --2- 172.21.15.148:0/1356078429 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f6fe00a3430 0x7f6fe00a58f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0005fd0 tx=0x7f6ff0009260 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:30:32.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.453+0000 7f6fea7fc640 1 -- 172.21.15.148:0/1356078429 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6fec04b020 con 0x7f6ff410d4b0 2024-09-19T07:30:32.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.810+0000 7f6ffb70b640 1 -- 172.21.15.148:0/1356078429 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6ff4108660 con 0x7f6ff410d4b0 2024-09-19T07:30:32.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.811+0000 7f6fea7fc640 1 -- 172.21.15.148:0/1356078429 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 17 entries v107) ==== 81+0+1020 (secure 0 0 0) 0x7f6fec0bcad0 con 0x7f6ff410d4b0 2024-09-19T07:30:32.816 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/2510377205 2024-09-20T07:11:03.220856+0000 2024-09-19T07:30:32.816 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/1725756124 2024-09-20T07:11:03.220856+0000 2024-09-19T07:30:32.816 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/2638338746 2024-09-20T07:11:03.220856+0000 2024-09-19T07:30:32.816 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/174481494 2024-09-20T07:02:14.557425+0000 2024-09-19T07:30:32.817 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/3756905316 2024-09-20T07:11:03.220856+0000 2024-09-19T07:30:32.817 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/1480486619 2024-09-20T07:02:14.557425+0000 2024-09-19T07:30:32.817 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:6801/2161746152 2024-09-20T07:02:14.557425+0000 2024-09-19T07:30:32.817 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:6800/2161746152 2024-09-20T07:02:14.557425+0000 2024-09-19T07:30:32.817 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:6800/1949849385 2024-09-20T07:02:37.007183+0000 2024-09-19T07:30:32.817 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/1114469409 2024-09-20T07:02:14.557425+0000 2024-09-19T07:30:32.817 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/1922521135 2024-09-20T07:02:37.007183+0000 2024-09-19T07:30:32.817 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:6801/3007822654 2024-09-20T07:11:03.220856+0000 2024-09-19T07:30:32.817 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/1958388906 2024-09-20T07:02:37.007183+0000 2024-09-19T07:30:32.817 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:6801/1949849385 2024-09-20T07:02:37.007183+0000 2024-09-19T07:30:32.817 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/3534559227 2024-09-20T07:02:37.007183+0000 2024-09-19T07:30:32.817 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/1224758996 2024-09-20T07:11:03.220856+0000 2024-09-19T07:30:32.817 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:6800/3007822654 2024-09-20T07:11:03.220856+0000 2024-09-19T07:30:32.818 INFO:teuthology.orchestra.run.smithi148.stderr:listed 17 entries 2024-09-19T07:30:32.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.819+0000 7f6ffb70b640 1 -- 172.21.15.148:0/1356078429 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f6fe00a3430 msgr2=0x7f6fe00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:32.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.819+0000 7f6ffb70b640 1 --2- 172.21.15.148:0/1356078429 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f6fe00a3430 0x7f6fe00a58f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0005fd0 tx=0x7f6ff0009260 comp rx=0 tx=0).stop 2024-09-19T07:30:32.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.819+0000 7f6ffb70b640 1 -- 172.21.15.148:0/1356078429 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ff410d4b0 msgr2=0x7f6ff419e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:32.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.819+0000 7f6ffb70b640 1 --2- 172.21.15.148:0/1356078429 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ff410d4b0 0x7f6ff419e7e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6fec004af0 tx=0x7f6fec032f80 comp rx=0 tx=0).stop 2024-09-19T07:30:32.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.819+0000 7f6ffb70b640 1 -- 172.21.15.148:0/1356078429 shutdown_connections 2024-09-19T07:30:32.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.819+0000 7f6ffb70b640 1 --2- 172.21.15.148:0/1356078429 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f6fe00a3430 0x7f6fe00a58f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:32.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.819+0000 7f6ffb70b640 1 --2- 172.21.15.148:0/1356078429 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ff410d4b0 0x7f6ff419e7e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:32.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.819+0000 7f6ffb70b640 1 --2- 172.21.15.148:0/1356078429 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ff4108c30 0x7f6ff41a4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:32.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.819+0000 7f6ffb70b640 1 --2- 172.21.15.148:0/1356078429 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ff4108280 0x7f6ff41a4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:32.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.819+0000 7f6ffb70b640 1 -- 172.21.15.148:0/1356078429 >> 172.21.15.148:0/1356078429 conn(0x7f6ff4077a10 msgr2=0x7f6ff4078d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:30:32.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.821+0000 7f6ffb70b640 1 -- 172.21.15.148:0/1356078429 shutdown_connections 2024-09-19T07:30:32.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:32.822+0000 7f6ffb70b640 1 -- 172.21.15.148:0/1356078429 wait complete. 2024-09-19T07:30:33.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:32 smithi148 ceph-mon[31180]: pgmap v613: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 1.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-19T07:30:33.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:32 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/1356078429' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T07:30:33.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:32 smithi179 ceph-mon[35716]: pgmap v613: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 1.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-19T07:30:33.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:32 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/1356078429' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T07:30:33.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:32 smithi165 ceph-mon[35326]: pgmap v613: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 1.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-19T07:30:33.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:32 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/1356078429' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T07:30:33.583 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-19T07:30:33.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:30:33.584 DEBUG:teuthology.orchestra.run.smithi148:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-19T07:30:33.820 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2024-09-19T07:30:33.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:30:33.821 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T07:30:33.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:30:33.870 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2024-09-19T07:30:33.913 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T07:30:33.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:30:33.914 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T07:30:34.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:30:34.032 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link delete ceph-brx 2024-09-19T07:30:34.156 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-19T07:30:34.156 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-19T07:30:34.157 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T07:30:34.209 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12687 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/sda1 /var/lib/containers/storage/overlay ext4 rw,seclabel,relatime 0 0 overlay /var/lib/containers/storage/overlay/7b4135c992e997675d997c725ad85cf0c2400eeafdc13b7dc3d406ca8a0246f3/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/G7X7TAPU765EXJRLK2HTOJVFPT:/var/lib/containers/storage/overlay/l/C34KQDXMCQOUS74MTMB2O7N3WV,upperdir=/var/lib/containers/storage/overlay/7b4135c992e997675d997c725ad85cf0c2400eeafdc13b7dc3d406ca8a0246f3/diff,workdir=/var/lib/containers/storage/overlay/7b4135c992e997675d997c725ad85cf0c2400eeafdc13b7dc3d406ca8a0246f3/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/6912588a4067b174b18889178e7815f7c5be410d91956a59028a55a6e2a27424/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/G7X7TAPU765EXJRLK2HTOJVFPT:/var/lib/containers/storage/overlay/l/C34KQDXMCQOUS74MTMB2O7N3WV,upperdir=/var/lib/containers/storage/overlay/6912588a4067b174b18889178e7815f7c5be410d91956a59028a55a6e2a27424/diff,workdir=/var/lib/containers/storage/overlay/6912588a4067b174b18889178e7815f7c5be410d91956a59028a55a6e2a27424/work,metacopy=on,volatile 0 0 tmpfs /run/user/0 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,inode64 0 0 binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,nosuid,nodev,noexec,relatime 0 0 overlay /var/lib/containers/storage/overlay/400d35b222ea0b17105b9a0abcfe5d1ef9da615caef72b1ee46b16e748366fd2/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/G7X7TAPU765EXJRLK2HTOJVFPT:/var/lib/containers/storage/overlay/l/C34KQDXMCQOUS74MTMB2O7N3WV,upperdir=/var/lib/containers/storage/overlay/400d35b222ea0b17105b9a0abcfe5d1ef9da615caef72b1ee46b16e748366fd2/diff,workdir=/var/lib/containers/storage/overlay/400d35b222ea0b17105b9a0abcfe5d1ef9da615caef72b1ee46b16e748366fd2/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/a7d8c1a34c46a70d1c46e3a61fba637eaa639aeed722721f6d4771fc44afccff/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/G7X7TAPU765EXJRLK2HTOJVFPT:/var/lib/containers/storage/overlay/l/C34KQDXMCQOUS74MTMB2O7N3WV,upperdir=/var/lib/containers/storage/overlay/a7d8c1a34c46a70d1c46e3a61fba637eaa639aeed722721f6d4771fc44afccff/diff,workdir=/var/lib/containers/storage/overlay/a7d8c1a34c46a70d1c46e3a61fba637eaa639aeed722721f6d4771fc44afccff/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/8a64d7f64328fd6c400450ac378287dc22add3e7e330f4175fea38a7821b7394/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/G7X7TAPU765EXJRLK2HTOJVFPT:/var/lib/containers/storage/overlay/l/C34KQDXMCQOUS74MTMB2O7N3WV,upperdir=/var/lib/containers/storage/overlay/8a64d7f64328fd6c400450ac378287dc22add3e7e330f4175fea38a7821b7394/diff,workdir=/var/lib/containers/storage/overlay/8a64d7f64328fd6c400450ac378287dc22add3e7e330f4175fea38a7821b7394/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/f062860971d13dac0bcc3a63af8393878962de0b360d1f2e542f3fa967205b6c/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/G7X7TAPU765EXJRLK2HTOJVFPT:/var/lib/containers/storage/overlay/l/C34KQDXMCQOUS74MTMB2O7N3WV,upperdir=/var/lib/containers/storage/overlay/f062860971d13dac0bcc3a63af8393878962de0b360d1f2e542f3fa967205b6c/diff,workdir=/var/lib/containers/storage/overlay/f062860971d13dac0bcc3a63af8393878962de0b360d1f2e542f3fa967205b6c/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/28ec6dc0d55bfdd449352afbd376a9621d34c08e66919fc463bbf0d6e85c4689/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/G7X7TAPU765EXJRLK2HTOJVFPT:/var/lib/containers/storage/overlay/l/C34KQDXMCQOUS74MTMB2O7N3WV,upperdir=/var/lib/containers/storage/overlay/28ec6dc0d55bfdd449352afbd376a9621d34c08e66919fc463bbf0d6e85c4689/diff,workdir=/var/lib/containers/storage/overlay/28ec6dc0d55bfdd449352afbd376a9621d34c08e66919fc463bbf0d6e85c4689/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/53d7ee612470f17a24faa26cbeb76664a0f52723ddc65c871b52256e11617f79/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/G7X7TAPU765EXJRLK2HTOJVFPT:/var/lib/containers/storage/overlay/l/C34KQDXMCQOUS74MTMB2O7N3WV,upperdir=/var/lib/containers/storage/overlay/53d7ee612470f17a24faa26cbeb76664a0f52723ddc65c871b52256e11617f79/diff,workdir=/var/lib/containers/storage/overlay/53d7ee612470f17a24faa26cbeb76664a0f52723ddc65c871b52256e11617f79/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/3f6ab00417831f049aeefa768dc160a3c011c9a9021aaf65f9f8788b089c12b1/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/G7X7TAPU765EXJRLK2HTOJVFPT:/var/lib/containers/storage/overlay/l/C34KQDXMCQOUS74MTMB2O7N3WV,upperdir=/var/lib/containers/storage/overlay/3f6ab00417831f049aeefa768dc160a3c011c9a9021aaf65f9f8788b089c12b1/diff,workdir=/var/lib/containers/storage/overlay/3f6ab00417831f049aeefa768dc160a3c011c9a9021aaf65f9f8788b089c12b1/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/3148177c61d3b398f9ade32c41225dac04b3f42b7d88ed1d2fd6a608ed463ef3/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/G7X7TAPU765EXJRLK2HTOJVFPT:/var/lib/containers/storage/overlay/l/C34KQDXMCQOUS74MTMB2O7N3WV,upperdir=/var/lib/containers/storage/overlay/3148177c61d3b398f9ade32c41225dac04b3f42b7d88ed1d2fd6a608ed463ef3/diff,workdir=/var/lib/containers/storage/overlay/3148177c61d3b398f9ade32c41225dac04b3f42b7d88ed1d2fd6a608ed463ef3/work,metacopy=on,volatile 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 2024-09-19T07:30:34.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:30:34.210 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2024-09-19T07:30:34.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:30:34.246 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link delete ceph-brx 2024-09-19T07:30:34.363 INFO:teuthology.orchestra.run.smithi148.stderr:Cannot find device "ceph-brx" 2024-09-19T07:30:34.365 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:30:34.366 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-19T07:30:34.376 INFO:tasks.cephadm:Teardown begin 2024-09-19T07:30:34.377 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T07:30:34.377 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:30:34.940 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:30:35.099 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:34 smithi148 ceph-mon[31180]: pgmap v614: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 1.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:30:35.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:34 smithi179 ceph-mon[35716]: pgmap v614: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 1.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:30:35.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:34 smithi165 ceph-mon[35326]: pgmap v614: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 1.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:30:35.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:35.627+0000 7f2a59bcc640 1 -- 172.21.15.148:0/2577361294 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a5411b140 msgr2=0x7f2a5411d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:35.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:35.627+0000 7f2a59bcc640 1 --2- 172.21.15.148:0/2577361294 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a5411b140 0x7f2a5411d530 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c009ca0 tx=0x7f2a4c02a8f0 comp rx=0 tx=0).stop 2024-09-19T07:30:35.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:35.627+0000 7f2a59bcc640 1 -- 172.21.15.148:0/2577361294 shutdown_connections 2024-09-19T07:30:35.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:35.627+0000 7f2a59bcc640 1 --2- 172.21.15.148:0/2577361294 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a5411b140 0x7f2a5411d530 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:35.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:35.627+0000 7f2a59bcc640 1 --2- 172.21.15.148:0/2577361294 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a54109830 0x7f2a54109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:35.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:35.627+0000 7f2a59bcc640 1 --2- 172.21.15.148:0/2577361294 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a54109450 0x7f2a54110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:35.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:35.627+0000 7f2a59bcc640 1 -- 172.21.15.148:0/2577361294 >> 172.21.15.148:0/2577361294 conn(0x7f2a5406e140 msgr2=0x7f2a5406e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:30:35.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:35.627+0000 7f2a59bcc640 1 -- 172.21.15.148:0/2577361294 shutdown_connections 2024-09-19T07:30:35.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:35.627+0000 7f2a59bcc640 1 -- 172.21.15.148:0/2577361294 wait complete. 2024-09-19T07:30:35.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:35.629+0000 7f2a59bcc640 1 Processor -- start 2024-09-19T07:30:35.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:35.636+0000 7f2a59bcc640 1 -- start start 2024-09-19T07:30:35.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:35.636+0000 7f2a59bcc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a54109450 0x7f2a541a72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:35.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:35.636+0000 7f2a59bcc640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a54109830 0x7f2a541a7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:35.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:35.636+0000 7f2a59bcc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a5411b140 0x7f2a541abbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:35.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:35.636+0000 7f2a59bcc640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2a54120e10 con 0x7f2a5411b140 2024-09-19T07:30:35.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:35.636+0000 7f2a59bcc640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2a54120c90 con 0x7f2a54109830 2024-09-19T07:30:35.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:35.636+0000 7f2a59bcc640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2a54120f90 con 0x7f2a54109450 2024-09-19T07:30:35.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:35.637+0000 7f2a537fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a54109450 0x7f2a541a72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:30:35.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:35.637+0000 7f2a537fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a54109450 0x7f2a541a72f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:58104/0 (socket says 172.21.15.148:58104) 2024-09-19T07:30:35.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:35.637+0000 7f2a537fe640 1 -- 172.21.15.148:0/3027575152 learned_addr learned my addr 172.21.15.148:0/3027575152 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:30:35.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:35.638+0000 7f2a4bfff640 1 --2- 172.21.15.148:0/3027575152 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a54109830 0x7f2a541a7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:30:35.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:35.638+0000 7f2a4bfff640 1 -- 172.21.15.148:0/3027575152 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a54109450 msgr2=0x7f2a541a72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:35.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:35.638+0000 7f2a4bfff640 1 --2- 172.21.15.148:0/3027575152 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a54109450 0x7f2a541a72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:35.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:35.638+0000 7f2a4bfff640 1 -- 172.21.15.148:0/3027575152 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a5411b140 msgr2=0x7f2a541abbc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T07:30:35.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:35.638+0000 7f2a4bfff640 1 --2- 172.21.15.148:0/3027575152 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a5411b140 0x7f2a541abbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:35.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:35.638+0000 7f2a4bfff640 1 -- 172.21.15.148:0/3027575152 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a541ac2c0 con 0x7f2a54109830 2024-09-19T07:30:35.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:35.639+0000 7f2a4bfff640 1 --2- 172.21.15.148:0/3027575152 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a54109830 0x7f2a541a7830 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2a4400b3f0 tx=0x7f2a4400b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:30:35.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:35.639+0000 7f2a517fa640 1 -- 172.21.15.148:0/3027575152 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a44015020 con 0x7f2a54109830 2024-09-19T07:30:35.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:35.639+0000 7f2a59bcc640 1 -- 172.21.15.148:0/3027575152 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a541ac5b0 con 0x7f2a54109830 2024-09-19T07:30:35.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:35.639+0000 7f2a517fa640 1 -- 172.21.15.148:0/3027575152 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a44011d10 con 0x7f2a54109830 2024-09-19T07:30:35.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:35.639+0000 7f2a59bcc640 1 -- 172.21.15.148:0/3027575152 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a54110920 con 0x7f2a54109830 2024-09-19T07:30:35.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:35.640+0000 7f2a517fa640 1 -- 172.21.15.148:0/3027575152 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a4400f2e0 con 0x7f2a54109830 2024-09-19T07:30:35.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:35.642+0000 7f2a59bcc640 1 -- 172.21.15.148:0/3027575152 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a541a8650 con 0x7f2a54109830 2024-09-19T07:30:35.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:35.646+0000 7f2a517fa640 1 -- 172.21.15.148:0/3027575152 <== mon.2 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f2a44018020 con 0x7f2a54109830 2024-09-19T07:30:35.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:35.647+0000 7f2a517fa640 1 --2- 172.21.15.148:0/3027575152 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f2a400a34b0 0x7f2a400a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:35.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:35.647+0000 7f2a517fa640 1 -- 172.21.15.148:0/3027575152 <== mon.2 v2:172.21.15.165:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 8600+0+0 (secure 0 0 0) 0x7f2a440cf9b0 con 0x7f2a54109830 2024-09-19T07:30:35.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:35.648+0000 7f2a537fe640 1 --2- 172.21.15.148:0/3027575152 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f2a400a34b0 0x7f2a400a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:30:35.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:35.649+0000 7f2a537fe640 1 --2- 172.21.15.148:0/3027575152 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f2a400a34b0 0x7f2a400a5970 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c0058c0 tx=0x7f2a3c00a380 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:30:35.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:35.652+0000 7f2a517fa640 1 -- 172.21.15.148:0/3027575152 <== mon.2 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2a4401f020 con 0x7f2a54109830 2024-09-19T07:30:36.048 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:30:36.048 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":55,"btime":"2024-09-19T07:26:06:767218+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/4263868576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":4263868576},{"type":"v1","addr":"172.21.15.148:6841","nonce":4263868576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":25606,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3891676893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3891676893},{"type":"v1","addr":"172.21.15.179:6835","nonce":3891676893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":55,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:09:19.543369+0000","modified":"2024-09-19T07:26:06.157910+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24457,"mds_1":24437,"mds_2":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":75,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":71,"addr":"172.21.15.165:6839/3993490234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":3993490234},{"type":"v1","addr":"172.21.15.165:6839","nonce":3993490234}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25823":{"gid":25823,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6835/380886107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":380886107},{"type":"v1","addr":"172.21.15.165:6835","nonce":380886107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24457,"qdb_cluster":[24457,24437,24436]},"id":1}]} 2024-09-19T07:30:36.048 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 55 2024-09-19T07:30:36.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:36.045+0000 7f2a59bcc640 1 -- 172.21.15.148:0/3027575152 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2a5410b3a0 con 0x7f2a54109830 2024-09-19T07:30:36.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:36.047+0000 7f2a517fa640 1 -- 172.21.15.148:0/3027575152 <== mon.2 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+11947 (secure 0 0 0) 0x7f2a4409c3f0 con 0x7f2a54109830 2024-09-19T07:30:36.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:36.056+0000 7f2a59bcc640 1 -- 172.21.15.148:0/3027575152 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f2a400a34b0 msgr2=0x7f2a400a5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:36.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:36.056+0000 7f2a59bcc640 1 --2- 172.21.15.148:0/3027575152 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f2a400a34b0 0x7f2a400a5970 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c0058c0 tx=0x7f2a3c00a380 comp rx=0 tx=0).stop 2024-09-19T07:30:36.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:36.056+0000 7f2a59bcc640 1 -- 172.21.15.148:0/3027575152 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a54109830 msgr2=0x7f2a541a7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:36.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:36.056+0000 7f2a59bcc640 1 --2- 172.21.15.148:0/3027575152 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a54109830 0x7f2a541a7830 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2a4400b3f0 tx=0x7f2a4400b8b0 comp rx=0 tx=0).stop 2024-09-19T07:30:36.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:36.058+0000 7f2a59bcc640 1 -- 172.21.15.148:0/3027575152 shutdown_connections 2024-09-19T07:30:36.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:36.058+0000 7f2a59bcc640 1 --2- 172.21.15.148:0/3027575152 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f2a400a34b0 0x7f2a400a5970 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:36.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:36.058+0000 7f2a59bcc640 1 --2- 172.21.15.148:0/3027575152 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a5411b140 0x7f2a541abbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:36.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:36.058+0000 7f2a59bcc640 1 --2- 172.21.15.148:0/3027575152 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a54109830 0x7f2a541a7830 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:36.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:36.058+0000 7f2a59bcc640 1 --2- 172.21.15.148:0/3027575152 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a54109450 0x7f2a541a72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:36.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:36.058+0000 7f2a59bcc640 1 -- 172.21.15.148:0/3027575152 >> 172.21.15.148:0/3027575152 conn(0x7f2a5406e140 msgr2=0x7f2a5411bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:30:36.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:36.060+0000 7f2a59bcc640 1 -- 172.21.15.148:0/3027575152 shutdown_connections 2024-09-19T07:30:36.063 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:36.062+0000 7f2a59bcc640 1 -- 172.21.15.148:0/3027575152 wait complete. 2024-09-19T07:30:36.802 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:30:37.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:36 smithi148 ceph-mon[31180]: pgmap v615: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 1.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T07:30:37.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:36 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/3027575152' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:30:37.250 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:30:37.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:36 smithi179 ceph-mon[35716]: pgmap v615: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 1.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T07:30:37.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:36 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/3027575152' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:30:37.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:36 smithi165 ceph-mon[35326]: pgmap v615: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 1.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T07:30:37.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:36 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/3027575152' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:30:37.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:37.843+0000 7f36cb6b7640 1 -- 172.21.15.148:0/731558440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36c4102d30 msgr2=0x7f36c4103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:37.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:37.843+0000 7f36cb6b7640 1 --2- 172.21.15.148:0/731558440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36c4102d30 0x7f36c4103110 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f36c0009930 tx=0x7f36c002a480 comp rx=0 tx=0).stop 2024-09-19T07:30:37.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:37.843+0000 7f36cb6b7640 1 -- 172.21.15.148:0/731558440 shutdown_connections 2024-09-19T07:30:37.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:37.843+0000 7f36cb6b7640 1 --2- 172.21.15.148:0/731558440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36c41082a0 0x7f36c410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:37.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:37.843+0000 7f36cb6b7640 1 --2- 172.21.15.148:0/731558440 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36c41036e0 0x7f36c4107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:37.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:37.843+0000 7f36cb6b7640 1 --2- 172.21.15.148:0/731558440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36c4102d30 0x7f36c4103110 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:37.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:37.843+0000 7f36cb6b7640 1 -- 172.21.15.148:0/731558440 >> 172.21.15.148:0/731558440 conn(0x7f36c40fc7d0 msgr2=0x7f36c40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:30:37.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:37.843+0000 7f36cb6b7640 1 -- 172.21.15.148:0/731558440 shutdown_connections 2024-09-19T07:30:37.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:37.843+0000 7f36cb6b7640 1 -- 172.21.15.148:0/731558440 wait complete. 2024-09-19T07:30:37.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:37.844+0000 7f36cb6b7640 1 Processor -- start 2024-09-19T07:30:37.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:37.844+0000 7f36cb6b7640 1 -- start start 2024-09-19T07:30:37.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:37.844+0000 7f36cb6b7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36c4102d30 0x7f36c40739a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:37.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:37.844+0000 7f36cb6b7640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36c41036e0 0x7f36c4073ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:37.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:37.844+0000 7f36cb6b7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36c41082a0 0x7f36c406cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:37.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:37.844+0000 7f36cb6b7640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f36c4102600 con 0x7f36c41082a0 2024-09-19T07:30:37.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:37.844+0000 7f36cb6b7640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f36c4102480 con 0x7f36c41036e0 2024-09-19T07:30:37.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:37.844+0000 7f36cb6b7640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f36c4102780 con 0x7f36c4102d30 2024-09-19T07:30:37.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:37.845+0000 7f36c8c52640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36c41036e0 0x7f36c4073ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:30:37.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:37.845+0000 7f36c8c52640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36c41036e0 0x7f36c4073ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.148:43604/0 (socket says 172.21.15.148:43604) 2024-09-19T07:30:37.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:37.845+0000 7f36c8c52640 1 -- 172.21.15.148:0/535765472 learned_addr learned my addr 172.21.15.148:0/535765472 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:30:37.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:37.845+0000 7f36c9453640 1 --2- 172.21.15.148:0/535765472 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36c4102d30 0x7f36c40739a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:30:37.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:37.845+0000 7f36c9c54640 1 --2- 172.21.15.148:0/535765472 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36c41082a0 0x7f36c406cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:30:37.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:37.846+0000 7f36c9c54640 1 -- 172.21.15.148:0/535765472 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36c4102d30 msgr2=0x7f36c40739a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:37.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:37.846+0000 7f36c9c54640 1 --2- 172.21.15.148:0/535765472 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36c4102d30 0x7f36c40739a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:37.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:37.846+0000 7f36c9c54640 1 -- 172.21.15.148:0/535765472 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36c41036e0 msgr2=0x7f36c4073ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:37.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:37.846+0000 7f36c9c54640 1 --2- 172.21.15.148:0/535765472 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36c41036e0 0x7f36c4073ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:37.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:37.846+0000 7f36c9c54640 1 -- 172.21.15.148:0/535765472 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36c406d4d0 con 0x7f36c41082a0 2024-09-19T07:30:37.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:37.846+0000 7f36c9c54640 1 --2- 172.21.15.148:0/535765472 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36c41082a0 0x7f36c406cc10 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f36b400d680 tx=0x7f36b400db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:30:37.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:37.846+0000 7f36ba7fc640 1 -- 172.21.15.148:0/535765472 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b4017070 con 0x7f36c41082a0 2024-09-19T07:30:37.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:37.846+0000 7f36ba7fc640 1 -- 172.21.15.148:0/535765472 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36b4009820 con 0x7f36c41082a0 2024-09-19T07:30:37.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:37.846+0000 7f36ba7fc640 1 -- 172.21.15.148:0/535765472 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b4004e00 con 0x7f36c41082a0 2024-09-19T07:30:37.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:37.847+0000 7f36cb6b7640 1 -- 172.21.15.148:0/535765472 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36c406d7c0 con 0x7f36c41082a0 2024-09-19T07:30:37.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:37.847+0000 7f36cb6b7640 1 -- 172.21.15.148:0/535765472 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36c4071760 con 0x7f36c41082a0 2024-09-19T07:30:37.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:37.848+0000 7f36cb6b7640 1 -- 172.21.15.148:0/535765472 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36c406a850 con 0x7f36c41082a0 2024-09-19T07:30:37.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:37.854+0000 7f36ba7fc640 1 -- 172.21.15.148:0/535765472 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f36b40099d0 con 0x7f36c41082a0 2024-09-19T07:30:37.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:37.855+0000 7f36ba7fc640 1 --2- 172.21.15.148:0/535765472 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f36b00a3500 0x7f36b00a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:37.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:37.855+0000 7f36ba7fc640 1 -- 172.21.15.148:0/535765472 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 8600+0+0 (secure 0 0 0) 0x7f36b40cf8f0 con 0x7f36c41082a0 2024-09-19T07:30:37.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:37.858+0000 7f36c9453640 1 --2- 172.21.15.148:0/535765472 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f36b00a3500 0x7f36b00a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:30:37.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:37.859+0000 7f36c9453640 1 --2- 172.21.15.148:0/535765472 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f36b00a3500 0x7f36b00a59c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f36c0009900 tx=0x7f36c0005850 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:30:37.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:37.863+0000 7f36ba7fc640 1 -- 172.21.15.148:0/535765472 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f36b409bc50 con 0x7f36c41082a0 2024-09-19T07:30:38.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:38.240+0000 7f36cb6b7640 1 -- 172.21.15.148:0/535765472 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f36c4072240 con 0x7f36c41082a0 2024-09-19T07:30:38.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:38.241+0000 7f36ba7fc640 1 -- 172.21.15.148:0/535765472 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+11947 (secure 0 0 0) 0x7f36b409ff50 con 0x7f36c41082a0 2024-09-19T07:30:38.242 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:30:38.242 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":55,"btime":"2024-09-19T07:26:06:767218+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14520,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1040309943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":1040309943},{"type":"v1","addr":"172.21.15.148:6835","nonce":1040309943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/2835228384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":2835228384},{"type":"v1","addr":"172.21.15.148:6837","nonce":2835228384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/2974467793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":2974467793},{"type":"v1","addr":"172.21.15.148:6839","nonce":2974467793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6841/4263868576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6840","nonce":4263868576},{"type":"v1","addr":"172.21.15.148:6841","nonce":4263868576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24362,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1860818320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1860818320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1860818320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":25606,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3891676893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3891676893},{"type":"v1","addr":"172.21.15.179:6835","nonce":3891676893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":55,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:09:19.543369+0000","modified":"2024-09-19T07:26:06.157910+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24457,"mds_1":24437,"mds_2":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24410":{"gid":24410,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6837/3847988837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":3847988837},{"type":"v1","addr":"172.21.15.165:6837","nonce":3847988837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.179:6833/1289882987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1289882987},{"type":"v1","addr":"172.21.15.179:6833","nonce":1289882987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":75,"addr":"172.21.15.179:6837/3827671241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":3827671241},{"type":"v1","addr":"172.21.15.179:6837","nonce":3827671241}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":71,"addr":"172.21.15.165:6839/3993490234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":3993490234},{"type":"v1","addr":"172.21.15.165:6839","nonce":3993490234}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.179:6839/2031305914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6838","nonce":2031305914},{"type":"v1","addr":"172.21.15.179:6839","nonce":2031305914}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25823":{"gid":25823,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6835/380886107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":380886107},{"type":"v1","addr":"172.21.15.165:6835","nonce":380886107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24457,"qdb_cluster":[24457,24437,24436]},"id":1}]} 2024-09-19T07:30:38.242 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 55 2024-09-19T07:30:38.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:38.245+0000 7f36cb6b7640 1 -- 172.21.15.148:0/535765472 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f36b00a3500 msgr2=0x7f36b00a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:38.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:38.245+0000 7f36cb6b7640 1 --2- 172.21.15.148:0/535765472 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f36b00a3500 0x7f36b00a59c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f36c0009900 tx=0x7f36c0005850 comp rx=0 tx=0).stop 2024-09-19T07:30:38.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:38.245+0000 7f36cb6b7640 1 -- 172.21.15.148:0/535765472 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36c41082a0 msgr2=0x7f36c406cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:38.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:38.245+0000 7f36cb6b7640 1 --2- 172.21.15.148:0/535765472 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36c41082a0 0x7f36c406cc10 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f36b400d680 tx=0x7f36b400db40 comp rx=0 tx=0).stop 2024-09-19T07:30:38.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:38.245+0000 7f36cb6b7640 1 -- 172.21.15.148:0/535765472 shutdown_connections 2024-09-19T07:30:38.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:38.245+0000 7f36cb6b7640 1 --2- 172.21.15.148:0/535765472 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f36b00a3500 0x7f36b00a59c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:38.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:38.245+0000 7f36cb6b7640 1 --2- 172.21.15.148:0/535765472 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36c41082a0 0x7f36c406cc10 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:38.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:38.245+0000 7f36cb6b7640 1 --2- 172.21.15.148:0/535765472 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36c41036e0 0x7f36c4073ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:38.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:38.245+0000 7f36cb6b7640 1 --2- 172.21.15.148:0/535765472 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36c4102d30 0x7f36c40739a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:38.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:38.245+0000 7f36cb6b7640 1 -- 172.21.15.148:0/535765472 >> 172.21.15.148:0/535765472 conn(0x7f36c40fc7d0 msgr2=0x7f36c4106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:30:38.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:38.245+0000 7f36cb6b7640 1 -- 172.21.15.148:0/535765472 shutdown_connections 2024-09-19T07:30:38.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:38.245+0000 7f36cb6b7640 1 -- 172.21.15.148:0/535765472 wait complete. 2024-09-19T07:30:38.997 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T07:30:39.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:38 smithi179 ceph-mon[35716]: pgmap v616: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 1.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-19T07:30:39.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:38 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/535765472' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:30:39.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:38 smithi148 ceph-mon[31180]: pgmap v616: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 1.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-19T07:30:39.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:38 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/535765472' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:30:39.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:38 smithi165 ceph-mon[35326]: pgmap v616: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 1.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-19T07:30:39.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:38 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/535765472' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:30:39.396 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:30:39.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:39.971+0000 7f4732ffd640 1 -- 172.21.15.148:0/19535779 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f472c030d80 con 0x7f4734109830 2024-09-19T07:30:39.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:39.972+0000 7f473a406640 1 -- 172.21.15.148:0/19535779 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4734109830 msgr2=0x7f4734109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:39.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:39.972+0000 7f473a406640 1 --2- 172.21.15.148:0/19535779 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4734109830 0x7f4734109c90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f472c009be0 tx=0x7f472c02a710 comp rx=0 tx=0).stop 2024-09-19T07:30:39.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:39.972+0000 7f473a406640 1 -- 172.21.15.148:0/19535779 shutdown_connections 2024-09-19T07:30:39.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:39.972+0000 7f473a406640 1 --2- 172.21.15.148:0/19535779 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f473411b140 0x7f473411d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:39.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:39.972+0000 7f473a406640 1 --2- 172.21.15.148:0/19535779 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4734109830 0x7f4734109c90 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:39.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:39.972+0000 7f473a406640 1 --2- 172.21.15.148:0/19535779 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4734109450 0x7f4734110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:39.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:39.972+0000 7f473a406640 1 -- 172.21.15.148:0/19535779 >> 172.21.15.148:0/19535779 conn(0x7f473406e140 msgr2=0x7f473406e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:30:39.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:39.972+0000 7f473a406640 1 -- 172.21.15.148:0/19535779 shutdown_connections 2024-09-19T07:30:39.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:39.972+0000 7f473a406640 1 -- 172.21.15.148:0/19535779 wait complete. 2024-09-19T07:30:39.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:39.973+0000 7f473a406640 1 Processor -- start 2024-09-19T07:30:39.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:39.973+0000 7f473a406640 1 -- start start 2024-09-19T07:30:39.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:39.973+0000 7f473a406640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4734109450 0x7f47341a72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:39.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:39.973+0000 7f473a406640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4734109830 0x7f47341a7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:39.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:39.973+0000 7f473a406640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f473411b140 0x7f47341abbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:39.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:39.973+0000 7f473a406640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4734120df0 con 0x7f473411b140 2024-09-19T07:30:39.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:39.973+0000 7f473a406640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4734120c70 con 0x7f4734109450 2024-09-19T07:30:39.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:39.973+0000 7f473a406640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4734120f70 con 0x7f4734109830 2024-09-19T07:30:39.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:39.974+0000 7f47337fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4734109830 0x7f47341a7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:30:39.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:39.974+0000 7f47337fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4734109830 0x7f47341a7830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:58160/0 (socket says 172.21.15.148:58160) 2024-09-19T07:30:39.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:39.974+0000 7f47337fe640 1 -- 172.21.15.148:0/15357635 learned_addr learned my addr 172.21.15.148:0/15357635 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:30:39.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:39.974+0000 7f4733fff640 1 --2- 172.21.15.148:0/15357635 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4734109450 0x7f47341a72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:30:39.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:39.974+0000 7f47389a3640 1 --2- 172.21.15.148:0/15357635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f473411b140 0x7f47341abbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:30:39.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:39.974+0000 7f47389a3640 1 -- 172.21.15.148:0/15357635 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4734109830 msgr2=0x7f47341a7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:39.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:39.974+0000 7f47389a3640 1 --2- 172.21.15.148:0/15357635 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4734109830 0x7f47341a7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:39.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:39.974+0000 7f47389a3640 1 -- 172.21.15.148:0/15357635 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4734109450 msgr2=0x7f47341a72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:39.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:39.974+0000 7f47389a3640 1 --2- 172.21.15.148:0/15357635 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4734109450 0x7f47341a72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:39.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:39.974+0000 7f47389a3640 1 -- 172.21.15.148:0/15357635 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47341ac2a0 con 0x7f473411b140 2024-09-19T07:30:39.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:39.974+0000 7f4733fff640 1 --2- 172.21.15.148:0/15357635 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4734109450 0x7f47341a72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:30:39.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:39.974+0000 7f47389a3640 1 --2- 172.21.15.148:0/15357635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f473411b140 0x7f47341abbc0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f472800e970 tx=0x7f472800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:30:39.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:39.977+0000 7f47317fa640 1 -- 172.21.15.148:0/15357635 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f472800ccc0 con 0x7f473411b140 2024-09-19T07:30:39.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:39.977+0000 7f473a406640 1 -- 172.21.15.148:0/15357635 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47341ac590 con 0x7f473411b140 2024-09-19T07:30:39.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:39.977+0000 7f473a406640 1 -- 172.21.15.148:0/15357635 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47341b3e70 con 0x7f473411b140 2024-09-19T07:30:39.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:39.977+0000 7f47317fa640 1 -- 172.21.15.148:0/15357635 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4728009e30 con 0x7f473411b140 2024-09-19T07:30:39.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:39.977+0000 7f47317fa640 1 -- 172.21.15.148:0/15357635 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4728004a00 con 0x7f473411b140 2024-09-19T07:30:39.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:39.978+0000 7f473a406640 1 -- 172.21.15.148:0/15357635 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4720005290 con 0x7f473411b140 2024-09-19T07:30:39.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:39.980+0000 7f47317fa640 1 -- 172.21.15.148:0/15357635 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f4728005020 con 0x7f473411b140 2024-09-19T07:30:39.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:39.981+0000 7f47317fa640 1 --2- 172.21.15.148:0/15357635 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f471c0a3500 0x7f471c0a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:39.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:39.981+0000 7f4733fff640 1 --2- 172.21.15.148:0/15357635 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f471c0a3500 0x7f471c0a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:30:39.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:39.982+0000 7f47317fa640 1 -- 172.21.15.148:0/15357635 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 8600+0+0 (secure 0 0 0) 0x7f47280cfcb0 con 0x7f473411b140 2024-09-19T07:30:39.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:39.982+0000 7f4733fff640 1 --2- 172.21.15.148:0/15357635 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f471c0a3500 0x7f471c0a59c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4724005fd0 tx=0x7f4724009260 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:30:39.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:39.988+0000 7f47317fa640 1 -- 172.21.15.148:0/15357635 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f472809c750 con 0x7f473411b140 2024-09-19T07:30:40.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:40.298+0000 7f473a406640 1 -- 172.21.15.148:0/15357635 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4720005850 con 0x7f473411b140 2024-09-19T07:30:40.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:40.300+0000 7f47317fa640 1 -- 172.21.15.148:0/15357635 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) ==== 74+0+23416 (secure 0 0 0) 0x7f472809c050 con 0x7f473411b140 2024-09-19T07:30:40.301 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-19T07:30:40.301 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":107,"fsid":"eae8a4a8-7654-11ef-bceb-c7b262605968","created":"2024-09-19T07:01:47.891210+0000","modified":"2024-09-19T07:30:08.484409+0000","last_up_change":"2024-09-19T07:08:30.785262+0000","last_in_change":"2024-09-19T07:08:07.001808+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:04:49.313270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T07:09:15.840600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T07:09:17.690782+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":33,"snap_epoch":106,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7b854fad-d5a3-43e3-862e-7a0e8f243c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6803","nonce":512186330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6805","nonce":512186330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6809","nonce":512186330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":512186330},{"type":"v1","addr":"172.21.15.148:6807","nonce":512186330}]},"public_addr":"172.21.15.148:6803/512186330","cluster_addr":"172.21.15.148:6805/512186330","heartbeat_back_addr":"172.21.15.148:6809/512186330","heartbeat_front_addr":"172.21.15.148:6807/512186330","state":["exists","up"]},{"osd":1,"uuid":"61b26278-f4db-40f0-97b9-c12a6ef1cd06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6801","nonce":2433984552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6803","nonce":2433984552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6807","nonce":2433984552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2433984552},{"type":"v1","addr":"172.21.15.165:6805","nonce":2433984552}]},"public_addr":"172.21.15.165:6801/2433984552","cluster_addr":"172.21.15.165:6803/2433984552","heartbeat_back_addr":"172.21.15.165:6807/2433984552","heartbeat_front_addr":"172.21.15.165:6805/2433984552","state":["exists","up"]},{"osd":2,"uuid":"06620bbc-cdb5-4afc-8122-0bb3126630f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6801","nonce":3048365223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6803","nonce":3048365223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6807","nonce":3048365223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3048365223},{"type":"v1","addr":"172.21.15.179:6805","nonce":3048365223}]},"public_addr":"172.21.15.179:6801/3048365223","cluster_addr":"172.21.15.179:6803/3048365223","heartbeat_back_addr":"172.21.15.179:6807/3048365223","heartbeat_front_addr":"172.21.15.179:6805/3048365223","state":["exists","up"]},{"osd":3,"uuid":"d7df45d4-5ef1-4f66-84a7-f61b8756c0c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6811","nonce":3662789091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6813","nonce":3662789091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6817","nonce":3662789091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":3662789091},{"type":"v1","addr":"172.21.15.148:6815","nonce":3662789091}]},"public_addr":"172.21.15.148:6811/3662789091","cluster_addr":"172.21.15.148:6813/3662789091","heartbeat_back_addr":"172.21.15.148:6817/3662789091","heartbeat_front_addr":"172.21.15.148:6815/3662789091","state":["exists","up"]},{"osd":4,"uuid":"5cfd359b-a8d2-4bdc-858f-087d26e0869c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6809","nonce":3082550323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6811","nonce":3082550323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6815","nonce":3082550323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":3082550323},{"type":"v1","addr":"172.21.15.165:6813","nonce":3082550323}]},"public_addr":"172.21.15.165:6809/3082550323","cluster_addr":"172.21.15.165:6811/3082550323","heartbeat_back_addr":"172.21.15.165:6815/3082550323","heartbeat_front_addr":"172.21.15.165:6813/3082550323","state":["exists","up"]},{"osd":5,"uuid":"8295e69b-87fe-4403-bb2e-d9dd42e2f398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6809","nonce":2125213751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6811","nonce":2125213751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6815","nonce":2125213751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2125213751},{"type":"v1","addr":"172.21.15.179:6813","nonce":2125213751}]},"public_addr":"172.21.15.179:6809/2125213751","cluster_addr":"172.21.15.179:6811/2125213751","heartbeat_back_addr":"172.21.15.179:6815/2125213751","heartbeat_front_addr":"172.21.15.179:6813/2125213751","state":["exists","up"]},{"osd":6,"uuid":"4ce38d1a-06d3-4606-b00d-aa1ff977025f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6819","nonce":2178980310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6821","nonce":2178980310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6825","nonce":2178980310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":2178980310},{"type":"v1","addr":"172.21.15.148:6823","nonce":2178980310}]},"public_addr":"172.21.15.148:6819/2178980310","cluster_addr":"172.21.15.148:6821/2178980310","heartbeat_back_addr":"172.21.15.148:6825/2178980310","heartbeat_front_addr":"172.21.15.148:6823/2178980310","state":["exists","up"]},{"osd":7,"uuid":"9e68e2b2-9838-4ec0-b473-24f2434695ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6817","nonce":3961600099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6819","nonce":3961600099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6823","nonce":3961600099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":3961600099},{"type":"v1","addr":"172.21.15.165:6821","nonce":3961600099}]},"public_addr":"172.21.15.165:6817/3961600099","cluster_addr":"172.21.15.165:6819/3961600099","heartbeat_back_addr":"172.21.15.165:6823/3961600099","heartbeat_front_addr":"172.21.15.165:6821/3961600099","state":["exists","up"]},{"osd":8,"uuid":"297acce6-d3c7-4e1a-bf87-be093de51a6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6817","nonce":3642931467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6819","nonce":3642931467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6823","nonce":3642931467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3642931467},{"type":"v1","addr":"172.21.15.179:6821","nonce":3642931467}]},"public_addr":"172.21.15.179:6817/3642931467","cluster_addr":"172.21.15.179:6819/3642931467","heartbeat_back_addr":"172.21.15.179:6823/3642931467","heartbeat_front_addr":"172.21.15.179:6821/3642931467","state":["exists","up"]},{"osd":9,"uuid":"ef488c5e-5353-4695-99dd-5b74ade436d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6827","nonce":3135409630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6829","nonce":3135409630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6833","nonce":3135409630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":3135409630},{"type":"v1","addr":"172.21.15.148:6831","nonce":3135409630}]},"public_addr":"172.21.15.148:6827/3135409630","cluster_addr":"172.21.15.148:6829/3135409630","heartbeat_back_addr":"172.21.15.148:6833/3135409630","heartbeat_front_addr":"172.21.15.148:6831/3135409630","state":["exists","up"]},{"osd":10,"uuid":"7a9f0379-1199-4266-910c-8d1d313d39e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6825","nonce":3554110731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6827","nonce":3554110731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6831","nonce":3554110731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":3554110731},{"type":"v1","addr":"172.21.15.165:6829","nonce":3554110731}]},"public_addr":"172.21.15.165:6825/3554110731","cluster_addr":"172.21.15.165:6827/3554110731","heartbeat_back_addr":"172.21.15.165:6831/3554110731","heartbeat_front_addr":"172.21.15.165:6829/3554110731","state":["exists","up"]},{"osd":11,"uuid":"eede97e9-5685-4603-806e-7078c6940536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6825","nonce":2026109940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6827","nonce":2026109940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6831","nonce":2026109940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":2026109940},{"type":"v1","addr":"172.21.15.179:6829","nonce":2026109940}]},"public_addr":"172.21.15.179:6825/2026109940","cluster_addr":"172.21.15.179:6827/2026109940","heartbeat_back_addr":"172.21.15.179:6831/2026109940","heartbeat_front_addr":"172.21.15.179:6829/2026109940","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:03:56.291685+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:21.419682+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:46.377012+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:11.484234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:36.723101+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:06:00.294617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:06:25.147230+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:06:49.318576+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:07:13.896399+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:07:38.930999+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:08:03.803463+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:08:28.731343+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.148:0/2510377205":"2024-09-20T07:11:03.220856+0000","172.21.15.148:0/1725756124":"2024-09-20T07:11:03.220856+0000","172.21.15.148:0/2638338746":"2024-09-20T07:11:03.220856+0000","172.21.15.148:0/174481494":"2024-09-20T07:02:14.557425+0000","172.21.15.148:0/3756905316":"2024-09-20T07:11:03.220856+0000","172.21.15.148:0/1480486619":"2024-09-20T07:02:14.557425+0000","172.21.15.148:6801/2161746152":"2024-09-20T07:02:14.557425+0000","172.21.15.148:6800/2161746152":"2024-09-20T07:02:14.557425+0000","172.21.15.148:6800/1949849385":"2024-09-20T07:02:37.007183+0000","172.21.15.148:0/1114469409":"2024-09-20T07:02:14.557425+0000","172.21.15.148:0/1922521135":"2024-09-20T07:02:37.007183+0000","172.21.15.148:6801/3007822654":"2024-09-20T07:11:03.220856+0000","172.21.15.148:0/1958388906":"2024-09-20T07:02:37.007183+0000","172.21.15.148:6801/1949849385":"2024-09-20T07:02:37.007183+0000","172.21.15.148:0/3534559227":"2024-09-20T07:02:37.007183+0000","172.21.15.148:0/1224758996":"2024-09-20T07:11:03.220856+0000","172.21.15.148:6800/3007822654":"2024-09-20T07:11:03.220856+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":20,"length":1},{"begin":33,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":18,"length":1},{"begin":31,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T07:30:40.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:40.304+0000 7f473a406640 1 -- 172.21.15.148:0/15357635 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f471c0a3500 msgr2=0x7f471c0a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:40.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:40.304+0000 7f473a406640 1 --2- 172.21.15.148:0/15357635 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f471c0a3500 0x7f471c0a59c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4724005fd0 tx=0x7f4724009260 comp rx=0 tx=0).stop 2024-09-19T07:30:40.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:40.304+0000 7f473a406640 1 -- 172.21.15.148:0/15357635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f473411b140 msgr2=0x7f47341abbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:40.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:40.304+0000 7f473a406640 1 --2- 172.21.15.148:0/15357635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f473411b140 0x7f47341abbc0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f472800e970 tx=0x7f472800ed70 comp rx=0 tx=0).stop 2024-09-19T07:30:40.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:40.304+0000 7f473a406640 1 -- 172.21.15.148:0/15357635 shutdown_connections 2024-09-19T07:30:40.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:40.304+0000 7f473a406640 1 --2- 172.21.15.148:0/15357635 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f471c0a3500 0x7f471c0a59c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:40.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:40.304+0000 7f473a406640 1 --2- 172.21.15.148:0/15357635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f473411b140 0x7f47341abbc0 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:40.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:40.304+0000 7f473a406640 1 --2- 172.21.15.148:0/15357635 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4734109830 0x7f47341a7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:40.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:40.304+0000 7f473a406640 1 --2- 172.21.15.148:0/15357635 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4734109450 0x7f47341a72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:40.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:40.304+0000 7f473a406640 1 -- 172.21.15.148:0/15357635 >> 172.21.15.148:0/15357635 conn(0x7f473406e140 msgr2=0x7f473411be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:30:40.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:40.305+0000 7f473a406640 1 -- 172.21.15.148:0/15357635 shutdown_connections 2024-09-19T07:30:40.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:40.305+0000 7f473a406640 1 -- 172.21.15.148:0/15357635 wait complete. 2024-09-19T07:30:41.013 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:40 smithi148 ceph-mon[31180]: pgmap v617: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 1.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-19T07:30:41.013 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:40 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/15357635' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:30:41.069 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs fail cephfs 2024-09-19T07:30:41.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:40 smithi179 ceph-mon[35716]: pgmap v617: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 1.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-19T07:30:41.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:40 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/15357635' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:30:41.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:40 smithi165 ceph-mon[35326]: pgmap v617: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 1.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-19T07:30:41.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:40 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/15357635' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:30:41.497 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:30:42.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.090+0000 7f19a8a6e640 1 -- 172.21.15.148:0/1640457620 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1994037070 con 0x7f19a4109450 2024-09-19T07:30:42.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.091+0000 7f19abcd4640 1 -- 172.21.15.148:0/1640457620 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19a4109450 msgr2=0x7f19a4110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:42.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.091+0000 7f19abcd4640 1 --2- 172.21.15.148:0/1640457620 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19a4109450 0x7f19a4110250 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1994009860 tx=0x7f199402a340 comp rx=0 tx=0).stop 2024-09-19T07:30:42.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.091+0000 7f19abcd4640 1 -- 172.21.15.148:0/1640457620 shutdown_connections 2024-09-19T07:30:42.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.091+0000 7f19abcd4640 1 --2- 172.21.15.148:0/1640457620 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19a411b140 0x7f19a411d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:42.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.091+0000 7f19abcd4640 1 --2- 172.21.15.148:0/1640457620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19a4109830 0x7f19a4109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:42.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.091+0000 7f19abcd4640 1 --2- 172.21.15.148:0/1640457620 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19a4109450 0x7f19a4110250 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:42.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.091+0000 7f19abcd4640 1 -- 172.21.15.148:0/1640457620 >> 172.21.15.148:0/1640457620 conn(0x7f19a406e140 msgr2=0x7f19a406e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:30:42.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.091+0000 7f19abcd4640 1 -- 172.21.15.148:0/1640457620 shutdown_connections 2024-09-19T07:30:42.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.091+0000 7f19abcd4640 1 -- 172.21.15.148:0/1640457620 wait complete. 2024-09-19T07:30:42.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.092+0000 7f19abcd4640 1 Processor -- start 2024-09-19T07:30:42.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.092+0000 7f19abcd4640 1 -- start start 2024-09-19T07:30:42.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.092+0000 7f19abcd4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19a4109450 0x7f19a41a72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:42.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.092+0000 7f19abcd4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19a4109830 0x7f19a41a77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:42.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.092+0000 7f19abcd4640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19a411b140 0x7f19a41abb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:42.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.092+0000 7f19abcd4640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f19a4120df0 con 0x7f19a4109830 2024-09-19T07:30:42.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.092+0000 7f19abcd4640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f19a4120c70 con 0x7f19a411b140 2024-09-19T07:30:42.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.092+0000 7f19abcd4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f19a4120f70 con 0x7f19a4109450 2024-09-19T07:30:42.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.092+0000 7f19a9a70640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19a4109450 0x7f19a41a72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:30:42.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.093+0000 7f19a9a70640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19a4109450 0x7f19a41a72b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:58188/0 (socket says 172.21.15.148:58188) 2024-09-19T07:30:42.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.093+0000 7f19a9a70640 1 -- 172.21.15.148:0/372196612 learned_addr learned my addr 172.21.15.148:0/372196612 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:30:42.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.093+0000 7f19aa271640 1 --2- 172.21.15.148:0/372196612 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19a411b140 0x7f19a41abb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:30:42.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.093+0000 7f19a9a70640 1 -- 172.21.15.148:0/372196612 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19a411b140 msgr2=0x7f19a41abb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:42.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.093+0000 7f19a9a70640 1 --2- 172.21.15.148:0/372196612 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19a411b140 0x7f19a41abb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:42.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.093+0000 7f19a9a70640 1 -- 172.21.15.148:0/372196612 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19a4109830 msgr2=0x7f19a41a77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:42.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.093+0000 7f19a9a70640 1 --2- 172.21.15.148:0/372196612 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19a4109830 0x7f19a41a77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:42.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.093+0000 7f19a9a70640 1 -- 172.21.15.148:0/372196612 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19a41ac260 con 0x7f19a4109450 2024-09-19T07:30:42.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.094+0000 7f19a9a70640 1 --2- 172.21.15.148:0/372196612 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19a4109450 0x7f19a41a72b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1994035040 tx=0x7f1994033d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:30:42.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.094+0000 7f199affd640 1 -- 172.21.15.148:0/372196612 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1994037040 con 0x7f19a4109450 2024-09-19T07:30:42.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.094+0000 7f19abcd4640 1 -- 172.21.15.148:0/372196612 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19a41ac4f0 con 0x7f19a4109450 2024-09-19T07:30:42.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.094+0000 7f19abcd4640 1 -- 172.21.15.148:0/372196612 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19a41b3e30 con 0x7f19a4109450 2024-09-19T07:30:42.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.095+0000 7f199affd640 1 -- 172.21.15.148:0/372196612 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1994042070 con 0x7f19a4109450 2024-09-19T07:30:42.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.095+0000 7f199affd640 1 -- 172.21.15.148:0/372196612 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1994003850 con 0x7f19a4109450 2024-09-19T07:30:42.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.096+0000 7f19abcd4640 1 -- 172.21.15.148:0/372196612 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1988005290 con 0x7f19a4109450 2024-09-19T07:30:42.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.098+0000 7f199affd640 1 -- 172.21.15.148:0/372196612 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f1994030820 con 0x7f19a4109450 2024-09-19T07:30:42.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.099+0000 7f199affd640 1 --2- 172.21.15.148:0/372196612 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f19900a3430 0x7f19900a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:42.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.099+0000 7f19a926f640 1 --2- 172.21.15.148:0/372196612 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f19900a3430 0x7f19900a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:30:42.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.099+0000 7f199affd640 1 -- 172.21.15.148:0/372196612 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 8600+0+0 (secure 0 0 0) 0x7f19940f00c0 con 0x7f19a4109450 2024-09-19T07:30:42.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.102+0000 7f19a926f640 1 --2- 172.21.15.148:0/372196612 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f19900a3430 0x7f19900a58f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f199c005c40 tx=0x7f199c005bd0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:30:42.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.107+0000 7f199affd640 1 -- 172.21.15.148:0/372196612 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f19940bcb60 con 0x7f19a4109450 2024-09-19T07:30:42.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.486+0000 7f19abcd4640 1 -- 172.21.15.148:0/372196612 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f1988005850 con 0x7f19a4109450 2024-09-19T07:30:42.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.505+0000 7f199affd640 1 -- 172.21.15.148:0/372196612 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v56) ==== 161+0+0 (secure 0 0 0) 0x7f19940bc460 con 0x7f19a4109450 2024-09-19T07:30:42.505 INFO:teuthology.orchestra.run.smithi148.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T07:30:42.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.508+0000 7f19abcd4640 1 -- 172.21.15.148:0/372196612 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f19900a3430 msgr2=0x7f19900a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:42.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.508+0000 7f19abcd4640 1 --2- 172.21.15.148:0/372196612 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f19900a3430 0x7f19900a58f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f199c005c40 tx=0x7f199c005bd0 comp rx=0 tx=0).stop 2024-09-19T07:30:42.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.508+0000 7f19abcd4640 1 -- 172.21.15.148:0/372196612 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19a4109450 msgr2=0x7f19a41a72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:42.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.508+0000 7f19abcd4640 1 --2- 172.21.15.148:0/372196612 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19a4109450 0x7f19a41a72b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1994035040 tx=0x7f1994033d90 comp rx=0 tx=0).stop 2024-09-19T07:30:42.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.508+0000 7f19abcd4640 1 -- 172.21.15.148:0/372196612 shutdown_connections 2024-09-19T07:30:42.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.508+0000 7f19abcd4640 1 --2- 172.21.15.148:0/372196612 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f19900a3430 0x7f19900a58f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:42.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.508+0000 7f19abcd4640 1 --2- 172.21.15.148:0/372196612 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19a411b140 0x7f19a41abb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:42.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.508+0000 7f19abcd4640 1 --2- 172.21.15.148:0/372196612 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19a4109830 0x7f19a41a77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:42.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.508+0000 7f19abcd4640 1 --2- 172.21.15.148:0/372196612 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19a4109450 0x7f19a41a72b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:42.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.508+0000 7f19abcd4640 1 -- 172.21.15.148:0/372196612 >> 172.21.15.148:0/372196612 conn(0x7f19a406e140 msgr2=0x7f19a411bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:30:42.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.508+0000 7f19abcd4640 1 -- 172.21.15.148:0/372196612 shutdown_connections 2024-09-19T07:30:42.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:42.508+0000 7f19abcd4640 1 -- 172.21.15.148:0/372196612 wait complete. 2024-09-19T07:30:42.833 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:42 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mon-a[31176]: 2024-09-19T07:30:42.489+0000 7f2e4f325640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T07:30:42.884 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:30:42 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: ignoring --setuser ceph since I am not root 2024-09-19T07:30:42.884 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:30:42 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: ignoring --setgroup ceph since I am not root 2024-09-19T07:30:42.884 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:30:42 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: starting mds.b at 2024-09-19T07:30:42.884 INFO:journalctl@ceph.mds.e.smithi165.stdout:Sep 19 07:30:42 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-e[64984]: ignoring --setuser ceph since I am not root 2024-09-19T07:30:42.884 INFO:journalctl@ceph.mds.e.smithi165.stdout:Sep 19 07:30:42 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-e[64984]: ignoring --setgroup ceph since I am not root 2024-09-19T07:30:42.884 INFO:journalctl@ceph.mds.e.smithi165.stdout:Sep 19 07:30:42 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-e[64984]: starting mds.e at 2024-09-19T07:30:42.885 INFO:journalctl@ceph.mds.h.smithi165.stdout:Sep 19 07:30:42 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-h[65284]: ignoring --setuser ceph since I am not root 2024-09-19T07:30:42.885 INFO:journalctl@ceph.mds.h.smithi165.stdout:Sep 19 07:30:42 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-h[65284]: ignoring --setgroup ceph since I am not root 2024-09-19T07:30:42.885 INFO:journalctl@ceph.mds.h.smithi165.stdout:Sep 19 07:30:42 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-h[65284]: starting mds.h at 2024-09-19T07:30:42.928 INFO:journalctl@ceph.mds.i.smithi179.stdout:Sep 19 07:30:42 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-i[66282]: ignoring --setuser ceph since I am not root 2024-09-19T07:30:42.928 INFO:journalctl@ceph.mds.i.smithi179.stdout:Sep 19 07:30:42 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-i[66282]: ignoring --setgroup ceph since I am not root 2024-09-19T07:30:42.929 INFO:journalctl@ceph.mds.i.smithi179.stdout:Sep 19 07:30:42 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-i[66282]: starting mds.i at 2024-09-19T07:30:42.929 INFO:journalctl@ceph.mds.i.smithi179.stdout:Sep 19 07:30:42 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-i[66282]: 2024-09-19T07:30:42.661+0000 7fbbe568f640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6833/0: (98) Address already in use 2024-09-19T07:30:42.929 INFO:journalctl@ceph.mds.l.smithi179.stdout:Sep 19 07:30:42 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-l[65376]: ignoring --setuser ceph since I am not root 2024-09-19T07:30:42.929 INFO:journalctl@ceph.mds.l.smithi179.stdout:Sep 19 07:30:42 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-l[65376]: ignoring --setgroup ceph since I am not root 2024-09-19T07:30:42.929 INFO:journalctl@ceph.mds.l.smithi179.stdout:Sep 19 07:30:42 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-l[65376]: starting mds.l at 2024-09-19T07:30:42.929 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:30:42 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: ignoring --setuser ceph since I am not root 2024-09-19T07:30:42.930 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:30:42 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: ignoring --setgroup ceph since I am not root 2024-09-19T07:30:42.930 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:30:42 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: starting mds.c at 2024-09-19T07:30:43.165 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:42 smithi148 ceph-mon[31180]: pgmap v618: 97 pgs: 17 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 45 active+clean; 1.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-19T07:30:43.165 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:42 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:30:43.165 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:42 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/372196612' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T07:30:43.165 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:42 smithi148 ceph-mon[31180]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T07:30:43.166 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:42 smithi148 ceph-mon[31180]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T07:30:43.166 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:42 smithi148 ceph-mon[31180]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T07:30:43.166 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:42 smithi148 ceph-mon[31180]: Health check cleared: MDS_DAMAGE (was: 2 MDSs report damaged metadata) 2024-09-19T07:30:43.166 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:42 smithi148 ceph-mon[31180]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T07:30:43.166 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:42 smithi148 ceph-mon[31180]: osdmap e108: 12 total, 12 up, 12 in 2024-09-19T07:30:43.166 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:42 smithi148 ceph-mon[31180]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-19T07:30:43.212 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T07:30:43.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:42 smithi179 ceph-mon[35716]: pgmap v618: 97 pgs: 17 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 45 active+clean; 1.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-19T07:30:43.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:42 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:30:43.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:42 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/372196612' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T07:30:43.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:42 smithi179 ceph-mon[35716]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T07:30:43.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:42 smithi179 ceph-mon[35716]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T07:30:43.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:42 smithi179 ceph-mon[35716]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T07:30:43.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:42 smithi179 ceph-mon[35716]: Health check cleared: MDS_DAMAGE (was: 2 MDSs report damaged metadata) 2024-09-19T07:30:43.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:42 smithi179 ceph-mon[35716]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T07:30:43.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:42 smithi179 ceph-mon[35716]: osdmap e108: 12 total, 12 up, 12 in 2024-09-19T07:30:43.274 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:42 smithi179 ceph-mon[35716]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-19T07:30:43.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:42 smithi165 ceph-mon[35326]: pgmap v618: 97 pgs: 17 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 45 active+clean; 1.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-19T07:30:43.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:42 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:30:43.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:42 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/372196612' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T07:30:43.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:42 smithi165 ceph-mon[35326]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T07:30:43.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:42 smithi165 ceph-mon[35326]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T07:30:43.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:42 smithi165 ceph-mon[35326]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T07:30:43.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:42 smithi165 ceph-mon[35326]: Health check cleared: MDS_DAMAGE (was: 2 MDSs report damaged metadata) 2024-09-19T07:30:43.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:42 smithi165 ceph-mon[35326]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T07:30:43.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:42 smithi165 ceph-mon[35326]: osdmap e108: 12 total, 12 up, 12 in 2024-09-19T07:30:43.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:42 smithi165 ceph-mon[35326]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-19T07:30:43.622 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:30:44.051 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:43 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:30:44.051 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:43 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:30:44.051 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:43 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:30:44.051 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:43 smithi148 ceph-mon[31180]: mds.? [v2:172.21.15.165:6834/3001885741,v1:172.21.15.165:6835/3001885741] up:boot 2024-09-19T07:30:44.051 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:43 smithi148 ceph-mon[31180]: mds.? [v2:172.21.15.165:6836/2876174331,v1:172.21.15.165:6837/2876174331] up:boot 2024-09-19T07:30:44.051 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:43 smithi148 ceph-mon[31180]: mds.? [v2:172.21.15.165:6838/2591532769,v1:172.21.15.165:6839/2591532769] up:boot 2024-09-19T07:30:44.051 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:43 smithi148 ceph-mon[31180]: mds.? [v2:172.21.15.179:6833/210774788,v1:172.21.15.179:6837/210774788] up:boot 2024-09-19T07:30:44.051 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:43 smithi148 ceph-mon[31180]: mds.? [v2:172.21.15.179:6832/2760109527,v1:172.21.15.179:6836/2760109527] up:boot 2024-09-19T07:30:44.052 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:43 smithi148 ceph-mon[31180]: mds.? [v2:172.21.15.179:6838/1779795762,v1:172.21.15.179:6839/1779795762] up:boot 2024-09-19T07:30:44.052 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:43 smithi148 ceph-mon[31180]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-19T07:30:44.052 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:43 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T07:30:44.052 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:43 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T07:30:44.052 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:43 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T07:30:44.052 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:43 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T07:30:44.052 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:43 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T07:30:44.052 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:43 smithi148 ceph-mon[31180]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T07:30:44.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:44.269+0000 7fea43c10640 1 -- 172.21.15.148:0/1033657880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea3c102ef0 msgr2=0x7fea3c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:44.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:44.269+0000 7fea43c10640 1 --2- 172.21.15.148:0/1033657880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea3c102ef0 0x7fea3c10da40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fea3400bda0 tx=0x7fea3402c510 comp rx=0 tx=0).stop 2024-09-19T07:30:44.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:44.269+0000 7fea43c10640 1 -- 172.21.15.148:0/1033657880 shutdown_connections 2024-09-19T07:30:44.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:44.269+0000 7fea43c10640 1 --2- 172.21.15.148:0/1033657880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea3c102ef0 0x7fea3c10da40 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:44.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:44.269+0000 7fea43c10640 1 --2- 172.21.15.148:0/1033657880 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea3c102570 0x7fea3c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:44.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:44.269+0000 7fea43c10640 1 --2- 172.21.15.148:0/1033657880 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fea3c100e20 0x7fea3c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:44.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:44.269+0000 7fea43c10640 1 -- 172.21.15.148:0/1033657880 >> 172.21.15.148:0/1033657880 conn(0x7fea3c0fc7d0 msgr2=0x7fea3c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:30:44.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:44.269+0000 7fea43c10640 1 -- 172.21.15.148:0/1033657880 shutdown_connections 2024-09-19T07:30:44.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:44.270+0000 7fea43c10640 1 -- 172.21.15.148:0/1033657880 wait complete. 2024-09-19T07:30:44.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:43 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:30:44.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:43 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:30:44.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:43 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:30:44.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:43 smithi179 ceph-mon[35716]: mds.? [v2:172.21.15.165:6834/3001885741,v1:172.21.15.165:6835/3001885741] up:boot 2024-09-19T07:30:44.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:43 smithi179 ceph-mon[35716]: mds.? [v2:172.21.15.165:6836/2876174331,v1:172.21.15.165:6837/2876174331] up:boot 2024-09-19T07:30:44.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:43 smithi179 ceph-mon[35716]: mds.? [v2:172.21.15.165:6838/2591532769,v1:172.21.15.165:6839/2591532769] up:boot 2024-09-19T07:30:44.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:43 smithi179 ceph-mon[35716]: mds.? [v2:172.21.15.179:6833/210774788,v1:172.21.15.179:6837/210774788] up:boot 2024-09-19T07:30:44.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:43 smithi179 ceph-mon[35716]: mds.? [v2:172.21.15.179:6832/2760109527,v1:172.21.15.179:6836/2760109527] up:boot 2024-09-19T07:30:44.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:43 smithi179 ceph-mon[35716]: mds.? [v2:172.21.15.179:6838/1779795762,v1:172.21.15.179:6839/1779795762] up:boot 2024-09-19T07:30:44.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:43 smithi179 ceph-mon[35716]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-19T07:30:44.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:43 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T07:30:44.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:43 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T07:30:44.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:43 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T07:30:44.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:43 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T07:30:44.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:43 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T07:30:44.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:43 smithi179 ceph-mon[35716]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T07:30:44.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:44.270+0000 7fea43c10640 1 Processor -- start 2024-09-19T07:30:44.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:44.270+0000 7fea43c10640 1 -- start start 2024-09-19T07:30:44.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:44.271+0000 7fea43c10640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fea3c100e20 0x7fea3c116610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:44.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:44.271+0000 7fea43c10640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea3c102570 0x7fea3c110690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:44.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:44.271+0000 7fea43c10640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea3c102ef0 0x7fea3c110bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:44.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:44.271+0000 7fea43c10640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fea3c10f080 con 0x7fea3c102570 2024-09-19T07:30:44.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:44.271+0000 7fea43c10640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fea3c10ef00 con 0x7fea3c100e20 2024-09-19T07:30:44.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:44.271+0000 7fea43c10640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fea3c10f200 con 0x7fea3c102ef0 2024-09-19T07:30:44.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:44.271+0000 7fea421ad640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea3c102ef0 0x7fea3c110bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:30:44.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:44.271+0000 7fea421ad640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea3c102ef0 0x7fea3c110bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:52266/0 (socket says 172.21.15.148:52266) 2024-09-19T07:30:44.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:44.271+0000 7fea421ad640 1 -- 172.21.15.148:0/4130047126 learned_addr learned my addr 172.21.15.148:0/4130047126 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:30:44.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:44.271+0000 7fea411ab640 1 --2- 172.21.15.148:0/4130047126 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea3c102570 0x7fea3c110690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:30:44.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:44.272+0000 7fea421ad640 1 -- 172.21.15.148:0/4130047126 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fea3c100e20 msgr2=0x7fea3c116610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:44.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:44.272+0000 7fea421ad640 1 --2- 172.21.15.148:0/4130047126 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fea3c100e20 0x7fea3c116610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:44.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:44.272+0000 7fea421ad640 1 -- 172.21.15.148:0/4130047126 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea3c102570 msgr2=0x7fea3c110690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:44.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:44.272+0000 7fea421ad640 1 --2- 172.21.15.148:0/4130047126 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea3c102570 0x7fea3c110690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:44.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:44.272+0000 7fea421ad640 1 -- 172.21.15.148:0/4130047126 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea3c111370 con 0x7fea3c102ef0 2024-09-19T07:30:44.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:44.272+0000 7fea421ad640 1 --2- 172.21.15.148:0/4130047126 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea3c102ef0 0x7fea3c110bd0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fea3400b460 tx=0x7fea34034830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:30:44.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:44.273+0000 7fea32ffd640 1 -- 172.21.15.148:0/4130047126 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea34064020 con 0x7fea3c102ef0 2024-09-19T07:30:44.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:44.273+0000 7fea43c10640 1 -- 172.21.15.148:0/4130047126 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea3c06bc10 con 0x7fea3c102ef0 2024-09-19T07:30:44.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:44.273+0000 7fea43c10640 1 -- 172.21.15.148:0/4130047126 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea3c06c140 con 0x7fea3c102ef0 2024-09-19T07:30:44.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:44.274+0000 7fea30ff9640 1 -- 172.21.15.148:0/4130047126 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea20005290 con 0x7fea3c102ef0 2024-09-19T07:30:44.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:44.275+0000 7fea32ffd640 1 -- 172.21.15.148:0/4130047126 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea34034e20 con 0x7fea3c102ef0 2024-09-19T07:30:44.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:44.275+0000 7fea32ffd640 1 -- 172.21.15.148:0/4130047126 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea34038040 con 0x7fea3c102ef0 2024-09-19T07:30:44.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:44.277+0000 7fea32ffd640 1 -- 172.21.15.148:0/4130047126 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fea34067020 con 0x7fea3c102ef0 2024-09-19T07:30:44.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:44.278+0000 7fea32ffd640 1 --2- 172.21.15.148:0/4130047126 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fea280a3540 0x7fea280a5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:44.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:44.278+0000 7fea32ffd640 1 -- 172.21.15.148:0/4130047126 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 8814+0+0 (secure 0 0 0) 0x7fea34114130 con 0x7fea3c102ef0 2024-09-19T07:30:44.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:44.278+0000 7fea419ac640 1 --2- 172.21.15.148:0/4130047126 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fea280a3540 0x7fea280a5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:30:44.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:44.279+0000 7fea419ac640 1 --2- 172.21.15.148:0/4130047126 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fea280a3540 0x7fea280a5a00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fea380096f0 tx=0x7fea38006c40 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:30:44.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:44.284+0000 7fea32ffd640 1 -- 172.21.15.148:0/4130047126 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fea3406e020 con 0x7fea3c102ef0 2024-09-19T07:30:44.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:43 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:30:44.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:43 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:30:44.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:43 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' 2024-09-19T07:30:44.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:43 smithi165 ceph-mon[35326]: mds.? [v2:172.21.15.165:6834/3001885741,v1:172.21.15.165:6835/3001885741] up:boot 2024-09-19T07:30:44.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:43 smithi165 ceph-mon[35326]: mds.? [v2:172.21.15.165:6836/2876174331,v1:172.21.15.165:6837/2876174331] up:boot 2024-09-19T07:30:44.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:43 smithi165 ceph-mon[35326]: mds.? [v2:172.21.15.165:6838/2591532769,v1:172.21.15.165:6839/2591532769] up:boot 2024-09-19T07:30:44.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:43 smithi165 ceph-mon[35326]: mds.? [v2:172.21.15.179:6833/210774788,v1:172.21.15.179:6837/210774788] up:boot 2024-09-19T07:30:44.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:43 smithi165 ceph-mon[35326]: mds.? [v2:172.21.15.179:6832/2760109527,v1:172.21.15.179:6836/2760109527] up:boot 2024-09-19T07:30:44.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:43 smithi165 ceph-mon[35326]: mds.? [v2:172.21.15.179:6838/1779795762,v1:172.21.15.179:6839/1779795762] up:boot 2024-09-19T07:30:44.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:43 smithi165 ceph-mon[35326]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-19T07:30:44.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:43 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T07:30:44.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:43 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T07:30:44.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:43 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T07:30:44.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:43 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T07:30:44.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:43 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T07:30:44.385 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:43 smithi165 ceph-mon[35326]: from='mgr.15123 172.21.15.148:0/68652017' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T07:30:44.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:44.671+0000 7fea30ff9640 1 -- 172.21.15.148:0/4130047126 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fea20005850 con 0x7fea3c102ef0 2024-09-19T07:30:45.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:44 smithi179 ceph-mon[35716]: pgmap v620: 97 pgs: 17 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 45 active+clean; 1.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 921 B/s wr, 7 op/s 2024-09-19T07:30:45.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:44 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/4130047126' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T07:30:45.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:44 smithi179 ceph-mon[35716]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T07:30:45.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:44 smithi148 ceph-mon[31180]: pgmap v620: 97 pgs: 17 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 45 active+clean; 1.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 921 B/s wr, 7 op/s 2024-09-19T07:30:45.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:44 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/4130047126' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T07:30:45.334 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:44 smithi148 ceph-mon[31180]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T07:30:45.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:44 smithi165 ceph-mon[35326]: pgmap v620: 97 pgs: 17 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 45 active+clean; 1.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 921 B/s wr, 7 op/s 2024-09-19T07:30:45.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:44 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/4130047126' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T07:30:45.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:44 smithi165 ceph-mon[35326]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T07:30:45.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:45.511+0000 7fea32ffd640 1 -- 172.21.15.148:0/4130047126 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v58) ==== 104+0+0 (secure 0 0 0) 0x7fea340e0990 con 0x7fea3c102ef0 2024-09-19T07:30:45.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:45.514+0000 7fea30ff9640 1 -- 172.21.15.148:0/4130047126 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fea280a3540 msgr2=0x7fea280a5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:45.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:45.514+0000 7fea30ff9640 1 --2- 172.21.15.148:0/4130047126 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fea280a3540 0x7fea280a5a00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fea380096f0 tx=0x7fea38006c40 comp rx=0 tx=0).stop 2024-09-19T07:30:45.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:45.514+0000 7fea30ff9640 1 -- 172.21.15.148:0/4130047126 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea3c102ef0 msgr2=0x7fea3c110bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:45.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:45.514+0000 7fea30ff9640 1 --2- 172.21.15.148:0/4130047126 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea3c102ef0 0x7fea3c110bd0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fea3400b460 tx=0x7fea34034830 comp rx=0 tx=0).stop 2024-09-19T07:30:45.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:45.514+0000 7fea30ff9640 1 -- 172.21.15.148:0/4130047126 shutdown_connections 2024-09-19T07:30:45.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:45.514+0000 7fea30ff9640 1 --2- 172.21.15.148:0/4130047126 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fea280a3540 0x7fea280a5a00 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:45.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:45.514+0000 7fea30ff9640 1 --2- 172.21.15.148:0/4130047126 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea3c102ef0 0x7fea3c110bd0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:45.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:45.514+0000 7fea30ff9640 1 --2- 172.21.15.148:0/4130047126 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea3c102570 0x7fea3c110690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:45.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:45.514+0000 7fea30ff9640 1 --2- 172.21.15.148:0/4130047126 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fea3c100e20 0x7fea3c116610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:45.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:45.514+0000 7fea30ff9640 1 -- 172.21.15.148:0/4130047126 >> 172.21.15.148:0/4130047126 conn(0x7fea3c0fc7d0 msgr2=0x7fea3c1048f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:30:45.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:45.515+0000 7fea30ff9640 1 -- 172.21.15.148:0/4130047126 shutdown_connections 2024-09-19T07:30:45.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:45.515+0000 7fea30ff9640 1 -- 172.21.15.148:0/4130047126 wait complete. 2024-09-19T07:30:46.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:45 smithi148 ceph-mon[31180]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T07:30:46.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:45 smithi148 ceph-mon[31180]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T07:30:46.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:45 smithi148 ceph-mon[31180]: Cluster is now healthy 2024-09-19T07:30:46.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:45 smithi148 ceph-mon[31180]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T07:30:46.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:45 smithi148 ceph-mon[31180]: fsmap 12 up:standby 2024-09-19T07:30:46.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:45 smithi179 ceph-mon[35716]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T07:30:46.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:45 smithi179 ceph-mon[35716]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T07:30:46.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:45 smithi179 ceph-mon[35716]: Cluster is now healthy 2024-09-19T07:30:46.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:45 smithi179 ceph-mon[35716]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T07:30:46.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:45 smithi179 ceph-mon[35716]: fsmap 12 up:standby 2024-09-19T07:30:46.322 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T07:30:46.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:45 smithi165 ceph-mon[35326]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T07:30:46.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:45 smithi165 ceph-mon[35326]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T07:30:46.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:45 smithi165 ceph-mon[35326]: Cluster is now healthy 2024-09-19T07:30:46.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:45 smithi165 ceph-mon[35326]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T07:30:46.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:45 smithi165 ceph-mon[35326]: fsmap 12 up:standby 2024-09-19T07:30:46.749 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:30:47.182 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:46 smithi148 ceph-mon[31180]: pgmap v621: 97 pgs: 17 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 45 active+clean; 1.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 614 B/s wr, 6 op/s 2024-09-19T07:30:47.273 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:46 smithi179 ceph-mon[35716]: pgmap v621: 97 pgs: 17 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 45 active+clean; 1.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 614 B/s wr, 6 op/s 2024-09-19T07:30:47.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:46 smithi165 ceph-mon[35326]: pgmap v621: 97 pgs: 17 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 45 active+clean; 1.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 614 B/s wr, 6 op/s 2024-09-19T07:30:47.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.605+0000 7fdb96c5c640 1 -- 172.21.15.148:0/3084818455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb9010d3a0 msgr2=0x7fdb90114f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:47.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.605+0000 7fdb96c5c640 1 --2- 172.21.15.148:0/3084818455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb9010d3a0 0x7fdb90114f20 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fdb80009900 tx=0x7fdb8002a410 comp rx=0 tx=0).stop 2024-09-19T07:30:47.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.605+0000 7fdb96c5c640 1 -- 172.21.15.148:0/3084818455 shutdown_connections 2024-09-19T07:30:47.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.605+0000 7fdb96c5c640 1 --2- 172.21.15.148:0/3084818455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb9010d3a0 0x7fdb90114f20 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:47.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.605+0000 7fdb96c5c640 1 --2- 172.21.15.148:0/3084818455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb90108c30 0x7fdb9010cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:47.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.605+0000 7fdb96c5c640 1 --2- 172.21.15.148:0/3084818455 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdb90108280 0x7fdb90108660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:47.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.605+0000 7fdb96c5c640 1 -- 172.21.15.148:0/3084818455 >> 172.21.15.148:0/3084818455 conn(0x7fdb90077a00 msgr2=0x7fdb90079e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:30:47.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.606+0000 7fdb96c5c640 1 -- 172.21.15.148:0/3084818455 shutdown_connections 2024-09-19T07:30:47.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.606+0000 7fdb96c5c640 1 -- 172.21.15.148:0/3084818455 wait complete. 2024-09-19T07:30:47.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.606+0000 7fdb96c5c640 1 Processor -- start 2024-09-19T07:30:47.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.607+0000 7fdb96c5c640 1 -- start start 2024-09-19T07:30:47.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.607+0000 7fdb96c5c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdb90108280 0x7fdb900738f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:47.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.607+0000 7fdb96c5c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb90108c30 0x7fdb90073e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:47.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.607+0000 7fdb96c5c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb9010d3a0 0x7fdb9006cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:47.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.607+0000 7fdb96c5c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdb90118430 con 0x7fdb9010d3a0 2024-09-19T07:30:47.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.607+0000 7fdb96c5c640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdb901182b0 con 0x7fdb90108280 2024-09-19T07:30:47.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.607+0000 7fdb96c5c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdb901185b0 con 0x7fdb90108c30 2024-09-19T07:30:47.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.610+0000 7fdb8ffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb90108c30 0x7fdb90073e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:30:47.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.610+0000 7fdb8ffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb90108c30 0x7fdb90073e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.148:52288/0 (socket says 172.21.15.148:52288) 2024-09-19T07:30:47.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.610+0000 7fdb8ffff640 1 -- 172.21.15.148:0/2725972325 learned_addr learned my addr 172.21.15.148:0/2725972325 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:30:47.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.610+0000 7fdb8ffff640 1 -- 172.21.15.148:0/2725972325 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdb90108280 msgr2=0x7fdb900738f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T07:30:47.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.610+0000 7fdb8ffff640 1 --2- 172.21.15.148:0/2725972325 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdb90108280 0x7fdb900738f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:47.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.610+0000 7fdb8ffff640 1 -- 172.21.15.148:0/2725972325 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb9010d3a0 msgr2=0x7fdb9006cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:47.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.610+0000 7fdb8ffff640 1 --2- 172.21.15.148:0/2725972325 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb9010d3a0 0x7fdb9006cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:47.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.610+0000 7fdb8ffff640 1 -- 172.21.15.148:0/2725972325 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb9006d410 con 0x7fdb90108c30 2024-09-19T07:30:47.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.611+0000 7fdb8ffff640 1 --2- 172.21.15.148:0/2725972325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb90108c30 0x7fdb90073e30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fdb8400e9f0 tx=0x7fdb8400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:30:47.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.611+0000 7fdb8dffb640 1 -- 172.21.15.148:0/2725972325 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb8400cd80 con 0x7fdb90108c30 2024-09-19T07:30:47.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.611+0000 7fdb96c5c640 1 -- 172.21.15.148:0/2725972325 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb9006d700 con 0x7fdb90108c30 2024-09-19T07:30:47.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.612+0000 7fdb96c5c640 1 -- 172.21.15.148:0/2725972325 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb90071700 con 0x7fdb90108c30 2024-09-19T07:30:47.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.612+0000 7fdb8dffb640 1 -- 172.21.15.148:0/2725972325 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb84005500 con 0x7fdb90108c30 2024-09-19T07:30:47.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.612+0000 7fdb8dffb640 1 -- 172.21.15.148:0/2725972325 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb84010690 con 0x7fdb90108c30 2024-09-19T07:30:47.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.613+0000 7fdb96c5c640 1 -- 172.21.15.148:0/2725972325 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb7c005290 con 0x7fdb90108c30 2024-09-19T07:30:47.619 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.616+0000 7fdb8dffb640 1 -- 172.21.15.148:0/2725972325 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fdb840046c0 con 0x7fdb90108c30 2024-09-19T07:30:47.619 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.617+0000 7fdb8dffb640 1 --2- 172.21.15.148:0/2725972325 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fdb780a34f0 0x7fdb780a59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:47.619 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.617+0000 7fdb8dffb640 1 -- 172.21.15.148:0/2725972325 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 8814+0+0 (secure 0 0 0) 0x7fdb840d03d0 con 0x7fdb90108c30 2024-09-19T07:30:47.619 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.617+0000 7fdb949f8640 1 --2- 172.21.15.148:0/2725972325 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fdb780a34f0 0x7fdb780a59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:30:47.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.619+0000 7fdb949f8640 1 --2- 172.21.15.148:0/2725972325 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fdb780a34f0 0x7fdb780a59b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fdb88005c40 tx=0x7fdb88005bd0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:30:47.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.621+0000 7fdb8dffb640 1 -- 172.21.15.148:0/2725972325 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdb84054210 con 0x7fdb90108c30 2024-09-19T07:30:47.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.930+0000 7fdb96c5c640 1 -- 172.21.15.148:0/2725972325 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fdb7c005580 con 0x7fdb90108c30 2024-09-19T07:30:47.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.951+0000 7fdb8dffb640 1 -- 172.21.15.148:0/2725972325 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v109) ==== 181+0+0 (secure 0 0 0) 0x7fdb8409cc30 con 0x7fdb90108c30 2024-09-19T07:30:47.956 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_metadata' removed 2024-09-19T07:30:47.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.955+0000 7fdb96c5c640 1 -- 172.21.15.148:0/2725972325 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fdb780a34f0 msgr2=0x7fdb780a59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:47.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.955+0000 7fdb96c5c640 1 --2- 172.21.15.148:0/2725972325 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fdb780a34f0 0x7fdb780a59b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fdb88005c40 tx=0x7fdb88005bd0 comp rx=0 tx=0).stop 2024-09-19T07:30:47.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.955+0000 7fdb96c5c640 1 -- 172.21.15.148:0/2725972325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb90108c30 msgr2=0x7fdb90073e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:47.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.955+0000 7fdb96c5c640 1 --2- 172.21.15.148:0/2725972325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb90108c30 0x7fdb90073e30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fdb8400e9f0 tx=0x7fdb8400edf0 comp rx=0 tx=0).stop 2024-09-19T07:30:47.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.955+0000 7fdb96c5c640 1 -- 172.21.15.148:0/2725972325 shutdown_connections 2024-09-19T07:30:47.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.955+0000 7fdb96c5c640 1 --2- 172.21.15.148:0/2725972325 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7fdb780a34f0 0x7fdb780a59b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:47.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.955+0000 7fdb96c5c640 1 --2- 172.21.15.148:0/2725972325 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb9010d3a0 0x7fdb9006cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:47.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.955+0000 7fdb96c5c640 1 --2- 172.21.15.148:0/2725972325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb90108c30 0x7fdb90073e30 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:47.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.955+0000 7fdb96c5c640 1 --2- 172.21.15.148:0/2725972325 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdb90108280 0x7fdb900738f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:47.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.956+0000 7fdb96c5c640 1 -- 172.21.15.148:0/2725972325 >> 172.21.15.148:0/2725972325 conn(0x7fdb90077a00 msgr2=0x7fdb90078830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:30:47.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.956+0000 7fdb96c5c640 1 -- 172.21.15.148:0/2725972325 shutdown_connections 2024-09-19T07:30:47.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:47.957+0000 7fdb96c5c640 1 -- 172.21.15.148:0/2725972325 wait complete. 2024-09-19T07:30:48.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:47 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/2725972325' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T07:30:48.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:47 smithi148 ceph-mon[31180]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T07:30:48.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:47 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/2725972325' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T07:30:48.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:47 smithi179 ceph-mon[35716]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T07:30:48.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:47 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/2725972325' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T07:30:48.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:47 smithi165 ceph-mon[35326]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T07:30:48.933 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T07:30:49.266 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:48 smithi148 ceph-mon[31180]: pgmap v622: 97 pgs: 13 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 54 active+clean; 1.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-09-19T07:30:49.266 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:48 smithi148 ceph-mon[31180]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T07:30:49.266 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:48 smithi148 ceph-mon[31180]: osdmap e109: 12 total, 12 up, 12 in 2024-09-19T07:30:49.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:48 smithi179 ceph-mon[35716]: pgmap v622: 97 pgs: 13 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 54 active+clean; 1.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-09-19T07:30:49.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:48 smithi179 ceph-mon[35716]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T07:30:49.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:48 smithi179 ceph-mon[35716]: osdmap e109: 12 total, 12 up, 12 in 2024-09-19T07:30:49.358 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:30:49.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:48 smithi165 ceph-mon[35326]: pgmap v622: 97 pgs: 13 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 54 active+clean; 1.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-09-19T07:30:49.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:48 smithi165 ceph-mon[35326]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T07:30:49.384 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:48 smithi165 ceph-mon[35326]: osdmap e109: 12 total, 12 up, 12 in 2024-09-19T07:30:49.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:49.927+0000 7f6366533640 1 -- 172.21.15.148:0/1185171889 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6360100e20 msgr2=0x7f6360101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:49.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:49.927+0000 7f6366533640 1 --2- 172.21.15.148:0/1185171889 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6360100e20 0x7f6360101200 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f6350009900 tx=0x7f635002a480 comp rx=0 tx=0).stop 2024-09-19T07:30:49.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:49.927+0000 7f6366533640 1 -- 172.21.15.148:0/1185171889 shutdown_connections 2024-09-19T07:30:49.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:49.927+0000 7f6366533640 1 --2- 172.21.15.148:0/1185171889 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6360102ef0 0x7f636010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:49.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:49.927+0000 7f6366533640 1 --2- 172.21.15.148:0/1185171889 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6360102570 0x7f63601029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:49.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:49.927+0000 7f6366533640 1 --2- 172.21.15.148:0/1185171889 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6360100e20 0x7f6360101200 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:49.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:49.927+0000 7f6366533640 1 -- 172.21.15.148:0/1185171889 >> 172.21.15.148:0/1185171889 conn(0x7f63600fc7d0 msgr2=0x7f63600febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:30:49.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:49.928+0000 7f6366533640 1 -- 172.21.15.148:0/1185171889 shutdown_connections 2024-09-19T07:30:49.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:49.928+0000 7f6366533640 1 -- 172.21.15.148:0/1185171889 wait complete. 2024-09-19T07:30:49.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:49.929+0000 7f6366533640 1 Processor -- start 2024-09-19T07:30:49.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:49.929+0000 7f6366533640 1 -- start start 2024-09-19T07:30:49.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:49.929+0000 7f6366533640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6360100e20 0x7f63601a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:49.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:49.929+0000 7f6366533640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6360102570 0x7f63601a0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:49.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:49.929+0000 7f6366533640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6360102ef0 0x7f636019a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:49.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:49.929+0000 7f6366533640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f636010fe80 con 0x7f6360100e20 2024-09-19T07:30:49.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:49.929+0000 7f6366533640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f636010fd00 con 0x7f6360102ef0 2024-09-19T07:30:49.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:49.929+0000 7f6366533640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6360110000 con 0x7f6360102570 2024-09-19T07:30:49.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:49.930+0000 7f635ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6360100e20 0x7f63601a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:30:49.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:49.930+0000 7f635ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6360100e20 0x7f63601a0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57144/0 (socket says 172.21.15.148:57144) 2024-09-19T07:30:49.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:49.930+0000 7f635ffff640 1 -- 172.21.15.148:0/2671240430 learned_addr learned my addr 172.21.15.148:0/2671240430 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-19T07:30:49.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:49.930+0000 7f6364ad0640 1 --2- 172.21.15.148:0/2671240430 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6360102ef0 0x7f636019a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:30:49.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:49.930+0000 7f635f7fe640 1 --2- 172.21.15.148:0/2671240430 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6360102570 0x7f63601a0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:30:49.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:49.930+0000 7f6364ad0640 1 -- 172.21.15.148:0/2671240430 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6360102570 msgr2=0x7f63601a0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:49.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:49.930+0000 7f6364ad0640 1 --2- 172.21.15.148:0/2671240430 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6360102570 0x7f63601a0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:49.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:49.930+0000 7f6364ad0640 1 -- 172.21.15.148:0/2671240430 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6360100e20 msgr2=0x7f63601a0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:49.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:49.930+0000 7f6364ad0640 1 --2- 172.21.15.148:0/2671240430 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6360100e20 0x7f63601a0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:49.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:49.930+0000 7f6364ad0640 1 -- 172.21.15.148:0/2671240430 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f636019adb0 con 0x7f6360102ef0 2024-09-19T07:30:49.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:49.930+0000 7f635ffff640 1 --2- 172.21.15.148:0/2671240430 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6360100e20 0x7f63601a0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:30:49.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:49.930+0000 7f6364ad0640 1 --2- 172.21.15.148:0/2671240430 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6360102ef0 0x7f636019a680 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6358009fd0 tx=0x7f635800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:30:49.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:49.931+0000 7f635d7fa640 1 -- 172.21.15.148:0/2671240430 <== mon.2 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f635800ce20 con 0x7f6360102ef0 2024-09-19T07:30:49.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:49.931+0000 7f635d7fa640 1 -- 172.21.15.148:0/2671240430 <== mon.2 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6358005020 con 0x7f6360102ef0 2024-09-19T07:30:49.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:49.931+0000 7f635d7fa640 1 -- 172.21.15.148:0/2671240430 <== mon.2 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6358010720 con 0x7f6360102ef0 2024-09-19T07:30:49.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:49.932+0000 7f6366533640 1 -- 172.21.15.148:0/2671240430 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f636019b0a0 con 0x7f6360102ef0 2024-09-19T07:30:49.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:49.932+0000 7f6366533640 1 -- 172.21.15.148:0/2671240430 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63601a72e0 con 0x7f6360102ef0 2024-09-19T07:30:49.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:49.933+0000 7f6366533640 1 -- 172.21.15.148:0/2671240430 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6360101200 con 0x7f6360102ef0 2024-09-19T07:30:49.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:49.935+0000 7f635d7fa640 1 -- 172.21.15.148:0/2671240430 <== mon.2 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f6358005540 con 0x7f6360102ef0 2024-09-19T07:30:49.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:49.936+0000 7f635d7fa640 1 --2- 172.21.15.148:0/2671240430 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f63480a3430 0x7f63480a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:30:49.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:49.936+0000 7f635d7fa640 1 -- 172.21.15.148:0/2671240430 <== mon.2 v2:172.21.15.165:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 8289+0+0 (secure 0 0 0) 0x7f63580d1010 con 0x7f6360102ef0 2024-09-19T07:30:49.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:49.937+0000 7f635ffff640 1 --2- 172.21.15.148:0/2671240430 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f63480a3430 0x7f63480a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:30:49.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:49.937+0000 7f635ffff640 1 --2- 172.21.15.148:0/2671240430 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f63480a3430 0x7f63480a58f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6350005940 tx=0x7f63500046c0 comp rx=0 tx=0).ready entity=mgr.15123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:30:49.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:49.942+0000 7f635d7fa640 1 -- 172.21.15.148:0/2671240430 <== mon.2 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f635801d060 con 0x7f6360102ef0 2024-09-19T07:30:50.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:50.217+0000 7f6366533640 1 -- 172.21.15.148:0/2671240430 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f63601a7540 con 0x7f6360102ef0 2024-09-19T07:30:50.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:50.966+0000 7f635d7fa640 1 -- 172.21.15.148:0/2671240430 <== mon.2 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v110) ==== 169+0+0 (secure 0 0 0) 0x7f635809dad0 con 0x7f6360102ef0 2024-09-19T07:30:50.972 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_data' removed 2024-09-19T07:30:50.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:50.970+0000 7f6366533640 1 -- 172.21.15.148:0/2671240430 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f63480a3430 msgr2=0x7f63480a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:50.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:50.970+0000 7f6366533640 1 --2- 172.21.15.148:0/2671240430 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f63480a3430 0x7f63480a58f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6350005940 tx=0x7f63500046c0 comp rx=0 tx=0).stop 2024-09-19T07:30:50.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:50.970+0000 7f6366533640 1 -- 172.21.15.148:0/2671240430 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6360102ef0 msgr2=0x7f636019a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:30:50.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:50.970+0000 7f6366533640 1 --2- 172.21.15.148:0/2671240430 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6360102ef0 0x7f636019a680 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6358009fd0 tx=0x7f635800ef10 comp rx=0 tx=0).stop 2024-09-19T07:30:50.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:50.970+0000 7f6366533640 1 -- 172.21.15.148:0/2671240430 shutdown_connections 2024-09-19T07:30:50.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:50.970+0000 7f6366533640 1 --2- 172.21.15.148:0/2671240430 >> [v2:172.21.15.148:6800/3902535850,v1:172.21.15.148:6801/3902535850] conn(0x7f63480a3430 0x7f63480a58f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:50.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:50.970+0000 7f6366533640 1 --2- 172.21.15.148:0/2671240430 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6360102ef0 0x7f636019a680 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:50.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:50.970+0000 7f6366533640 1 --2- 172.21.15.148:0/2671240430 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6360102570 0x7f63601a0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:50.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:50.970+0000 7f6366533640 1 --2- 172.21.15.148:0/2671240430 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6360100e20 0x7f63601a0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:30:50.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:50.970+0000 7f6366533640 1 -- 172.21.15.148:0/2671240430 >> 172.21.15.148:0/2671240430 conn(0x7f63600fc7d0 msgr2=0x7f63600fd390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:30:50.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:50.970+0000 7f6366533640 1 -- 172.21.15.148:0/2671240430 shutdown_connections 2024-09-19T07:30:50.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-19T07:30:50.970+0000 7f6366533640 1 -- 172.21.15.148:0/2671240430 wait complete. 2024-09-19T07:30:51.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:50 smithi179 ceph-mon[35716]: pgmap v624: 65 pgs: 13 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 22 active+clean; 1.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:30:51.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:50 smithi179 ceph-mon[35716]: from='client.? 172.21.15.148:0/2671240430' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T07:30:51.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:50 smithi179 ceph-mon[35716]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T07:30:51.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:50 smithi148 ceph-mon[31180]: pgmap v624: 65 pgs: 13 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 22 active+clean; 1.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:30:51.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:50 smithi148 ceph-mon[31180]: from='client.? 172.21.15.148:0/2671240430' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T07:30:51.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:50 smithi148 ceph-mon[31180]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T07:30:51.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:50 smithi165 ceph-mon[35326]: pgmap v624: 65 pgs: 13 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 22 active+clean; 1.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:30:51.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:50 smithi165 ceph-mon[35326]: from='client.? 172.21.15.148:0/2671240430' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T07:30:51.383 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:50 smithi165 ceph-mon[35326]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T07:30:51.731 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T07:30:51.773 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T07:30:51.864 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T07:30:51.916 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-19T07:30:51.917 DEBUG:teuthology.orchestra.run.smithi148:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T07:30:51.941 DEBUG:teuthology.orchestra.run.smithi165:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T07:30:51.964 DEBUG:teuthology.orchestra.run.smithi179:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T07:30:51.993 INFO:tasks.cephadm:Stopping all daemons... 2024-09-19T07:30:51.994 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-19T07:30:51.994 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mon.a 2024-09-19T07:30:52.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:51 smithi165 ceph-mon[35326]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T07:30:52.263 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:51 smithi165 ceph-mon[35326]: osdmap e110: 12 total, 12 up, 12 in 2024-09-19T07:30:52.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:51 smithi179 ceph-mon[35716]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T07:30:52.272 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:51 smithi179 ceph-mon[35716]: osdmap e110: 12 total, 12 up, 12 in 2024-09-19T07:30:52.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:51 smithi148 ceph-mon[31180]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T07:30:52.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:51 smithi148 ceph-mon[31180]: osdmap e110: 12 total, 12 up, 12 in 2024-09-19T07:30:52.333 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:52 smithi148 systemd[1]: Stopping Ceph mon.a for eae8a4a8-7654-11ef-bceb-c7b262605968... 2024-09-19T07:30:52.813 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:52 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mon-a[31176]: 2024-09-19T07:30:52.463+0000 7f2e54b30640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:30:52.813 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:52 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mon-a[31176]: 2024-09-19T07:30:52.463+0000 7f2e54b30640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-19T07:30:52.813 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:52 smithi148 podman[107500]: 2024-09-19 07:30:52.504525748 +0000 UTC m=+0.190427193 container died 7c0ab7162492a83152cb993c7727315c02780aa3214440381f958117d46c2d43 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mon-a, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux ) 2024-09-19T07:30:53.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:52 smithi148 podman[107500]: 2024-09-19 07:30:52.920237975 +0000 UTC m=+0.606139408 container cleanup 7c0ab7162492a83152cb993c7727315c02780aa3214440381f958117d46c2d43 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mon-a, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-19T07:30:53.083 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:52 smithi148 bash[107500]: ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mon-a 2024-09-19T07:30:53.408 INFO:journalctl@ceph.mon.a.smithi148.stdout:Sep 19 07:30:53 smithi148 podman[107511]: 2024-09-19 07:30:53.130177725 +0000 UTC m=+0.626095818 container remove 7c0ab7162492a83152cb993c7727315c02780aa3214440381f958117d46c2d43 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mon-a, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-19T07:30:53.420 DEBUG:teuthology.orchestra.run.smithi148:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mon.a.service' 2024-09-19T07:30:53.469 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:30:53.469 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-19T07:30:53.470 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-19T07:30:53.470 DEBUG:teuthology.orchestra.run.smithi165:> sudo systemctl stop ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mon.b 2024-09-19T07:30:53.796 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:53 smithi165 systemd[1]: Stopping Ceph mon.b for eae8a4a8-7654-11ef-bceb-c7b262605968... 2024-09-19T07:30:54.133 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:53 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mon-b[35322]: 2024-09-19T07:30:53.795+0000 7f46769cf640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:30:54.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:53 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mon-b[35322]: 2024-09-19T07:30:53.795+0000 7f46769cf640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-19T07:30:54.134 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:53 smithi165 podman[72906]: 2024-09-19 07:30:53.907276987 +0000 UTC m=+0.214083726 container died a39d85e5c1ae7256cede4b5f0fdfd2478d3ac53c937d810b47d8eaaebdf8943c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mon-b, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-19T07:30:54.546 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:54 smithi165 podman[72906]: 2024-09-19 07:30:54.253695505 +0000 UTC m=+0.560502242 container cleanup a39d85e5c1ae7256cede4b5f0fdfd2478d3ac53c937d810b47d8eaaebdf8943c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mon-b, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:30:54.546 INFO:journalctl@ceph.mon.b.smithi165.stdout:Sep 19 07:30:54 smithi165 bash[72906]: ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mon-b 2024-09-19T07:30:54.673 DEBUG:teuthology.orchestra.run.smithi165:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mon.b.service' 2024-09-19T07:30:54.732 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:30:54.732 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-19T07:30:54.732 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-19T07:30:54.732 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mon.c 2024-09-19T07:30:55.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:54 smithi179 systemd[1]: Stopping Ceph mon.c for eae8a4a8-7654-11ef-bceb-c7b262605968... 2024-09-19T07:30:55.457 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:55 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mon-c[35711]: 2024-09-19T07:30:55.171+0000 7f78e012a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:30:55.457 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:55 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mon-c[35711]: 2024-09-19T07:30:55.171+0000 7f78e012a640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-19T07:30:55.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:55 smithi179 podman[73526]: 2024-09-19 07:30:55.457580023 +0000 UTC m=+0.407548182 container died 1e64fd3b171300230f246009e665796b80e1c37437e86555db0f896e20188481 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mon-c, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-19T07:30:56.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:55 smithi179 podman[73526]: 2024-09-19 07:30:55.839320357 +0000 UTC m=+0.789288516 container cleanup 1e64fd3b171300230f246009e665796b80e1c37437e86555db0f896e20188481 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mon-c, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-19T07:30:56.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 19 07:30:55 smithi179 bash[73526]: ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mon-c 2024-09-19T07:30:56.268 DEBUG:teuthology.orchestra.run.smithi179:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mon.c.service' 2024-09-19T07:30:56.313 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:30:56.313 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-19T07:30:56.314 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-19T07:30:56.314 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mgr.x 2024-09-19T07:30:56.833 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:30:56 smithi148 systemd[1]: Stopping Ceph mgr.x for eae8a4a8-7654-11ef-bceb-c7b262605968... 2024-09-19T07:30:57.583 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:30:57 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x[31404]: 2024-09-19T07:30:57.300+0000 7f0f69724640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:30:57.583 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:30:57 smithi148 podman[107616]: 2024-09-19 07:30:57.342356574 +0000 UTC m=+0.840361895 container died f319d52d4e72ceef90f179d1eedf72b045f0674af830881876f9f0320726772c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-19T07:30:58.083 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:30:57 smithi148 podman[107616]: 2024-09-19 07:30:57.900563882 +0000 UTC m=+1.398569209 container cleanup f319d52d4e72ceef90f179d1eedf72b045f0674af830881876f9f0320726772c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-19T07:30:58.083 INFO:journalctl@ceph.mgr.x.smithi148.stdout:Sep 19 07:30:57 smithi148 bash[107616]: ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-x 2024-09-19T07:30:58.339 DEBUG:teuthology.orchestra.run.smithi148:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mgr.x.service' 2024-09-19T07:30:58.377 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:30:58.377 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-19T07:30:58.378 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-19T07:30:58.378 DEBUG:teuthology.orchestra.run.smithi165:> sudo systemctl stop ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mgr.y 2024-09-19T07:30:58.771 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:30:58 smithi165 systemd[1]: Stopping Ceph mgr.y for eae8a4a8-7654-11ef-bceb-c7b262605968... 2024-09-19T07:30:59.064 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:30:58 smithi165 podman[73038]: 2024-09-19 07:30:58.771952278 +0000 UTC m=+0.202745977 container died 5462059cc1dfc71f36300b0fd2738badf4fe9fcddaa71e16d03c6af903de87bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True) 2024-09-19T07:30:59.383 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:30:59 smithi165 podman[73038]: 2024-09-19 07:30:59.174517427 +0000 UTC m=+0.605311125 container cleanup 5462059cc1dfc71f36300b0fd2738badf4fe9fcddaa71e16d03c6af903de87bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-19T07:30:59.383 INFO:journalctl@ceph.mgr.y.smithi165.stdout:Sep 19 07:30:59 smithi165 bash[73038]: ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-y 2024-09-19T07:30:59.560 DEBUG:teuthology.orchestra.run.smithi165:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mgr.y.service' 2024-09-19T07:30:59.597 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:30:59.597 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-19T07:30:59.597 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-19T07:30:59.598 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mgr.z 2024-09-19T07:30:59.925 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:30:59 smithi179 systemd[1]: Stopping Ceph mgr.z for eae8a4a8-7654-11ef-bceb-c7b262605968... 2024-09-19T07:31:00.194 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:30:59 smithi179 podman[73649]: 2024-09-19 07:30:59.9249515 +0000 UTC m=+0.136701638 container died 217ea58788b84adc27a0a6a82eff251118e348438c94915648854e2ce328aa6c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-19T07:31:00.522 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:31:00 smithi179 podman[73649]: 2024-09-19 07:31:00.293743109 +0000 UTC m=+0.505493230 container cleanup 217ea58788b84adc27a0a6a82eff251118e348438c94915648854e2ce328aa6c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True) 2024-09-19T07:31:00.522 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 19 07:31:00 smithi179 bash[73649]: ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mgr-z 2024-09-19T07:31:00.663 DEBUG:teuthology.orchestra.run.smithi179:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mgr.z.service' 2024-09-19T07:31:00.697 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:31:00.698 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-19T07:31:00.698 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-19T07:31:00.698 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@osd.0 2024-09-19T07:31:00.996 INFO:journalctl@ceph.osd.0.smithi148.stdout:Sep 19 07:31:00 smithi148 systemd[1]: Stopping Ceph osd.0 for eae8a4a8-7654-11ef-bceb-c7b262605968... 2024-09-19T07:31:01.333 INFO:journalctl@ceph.osd.0.smithi148.stdout:Sep 19 07:31:00 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-0[42190]: 2024-09-19T07:31:00.995+0000 7f32df8b8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:31:01.333 INFO:journalctl@ceph.osd.0.smithi148.stdout:Sep 19 07:31:00 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-0[42190]: 2024-09-19T07:31:00.995+0000 7f32df8b8640 -1 osd.0 110 *** Got signal Terminated *** 2024-09-19T07:31:01.333 INFO:journalctl@ceph.osd.0.smithi148.stdout:Sep 19 07:31:00 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-0[42190]: 2024-09-19T07:31:00.995+0000 7f32df8b8640 -1 osd.0 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T07:31:06.680 INFO:journalctl@ceph.osd.0.smithi148.stdout:Sep 19 07:31:06 smithi148 podman[107738]: 2024-09-19 07:31:06.427606393 +0000 UTC m=+5.537733091 container died 0632d1a8a3bb07fab87fa5023fb0782f9b289e3c1f609295a7a77522b0caf6e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-19T07:31:07.038 INFO:journalctl@ceph.osd.0.smithi148.stdout:Sep 19 07:31:06 smithi148 podman[107738]: 2024-09-19 07:31:06.770935415 +0000 UTC m=+5.881062112 container cleanup 0632d1a8a3bb07fab87fa5023fb0782f9b289e3c1f609295a7a77522b0caf6e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-19T07:31:07.039 INFO:journalctl@ceph.osd.0.smithi148.stdout:Sep 19 07:31:06 smithi148 bash[107738]: ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-0 2024-09-19T07:31:07.333 INFO:journalctl@ceph.osd.0.smithi148.stdout:Sep 19 07:31:07 smithi148 podman[107752]: 2024-09-19 07:31:07.039121546 +0000 UTC m=+0.615098602 container remove 0632d1a8a3bb07fab87fa5023fb0782f9b289e3c1f609295a7a77522b0caf6e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-19T07:31:07.651 INFO:journalctl@ceph.osd.0.smithi148.stdout:Sep 19 07:31:07 smithi148 podman[107841]: 2024-09-19 07:31:07.294034815 +0000 UTC m=+0.016275727 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:31:07.651 INFO:journalctl@ceph.osd.0.smithi148.stdout:Sep 19 07:31:07 smithi148 podman[107841]: 2024-09-19 07:31:07.423181412 +0000 UTC m=+0.145422319 container create ed4c961237e8c14263b9850256e535395279bc86ee481d3a0de31b7b54081f3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, io.buildah.version=1.37.2) 2024-09-19T07:31:08.083 INFO:journalctl@ceph.osd.0.smithi148.stdout:Sep 19 07:31:07 smithi148 podman[107841]: 2024-09-19 07:31:07.650875644 +0000 UTC m=+0.373116547 container init ed4c961237e8c14263b9850256e535395279bc86ee481d3a0de31b7b54081f3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-19T07:31:08.083 INFO:journalctl@ceph.osd.0.smithi148.stdout:Sep 19 07:31:07 smithi148 podman[107841]: 2024-09-19 07:31:07.654630036 +0000 UTC m=+0.376870932 container start ed4c961237e8c14263b9850256e535395279bc86ee481d3a0de31b7b54081f3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-19T07:31:08.083 INFO:journalctl@ceph.osd.0.smithi148.stdout:Sep 19 07:31:07 smithi148 podman[107841]: 2024-09-19 07:31:07.750912378 +0000 UTC m=+0.473153275 container attach ed4c961237e8c14263b9850256e535395279bc86ee481d3a0de31b7b54081f3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-19T07:31:08.083 INFO:journalctl@ceph.osd.0.smithi148.stdout:Sep 19 07:31:07 smithi148 podman[107841]: 2024-09-19 07:31:07.83935279 +0000 UTC m=+0.561593687 container died ed4c961237e8c14263b9850256e535395279bc86ee481d3a0de31b7b54081f3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-19T07:31:08.462 DEBUG:teuthology.orchestra.run.smithi148:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@osd.0.service' 2024-09-19T07:31:08.503 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:31:08.503 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-19T07:31:08.503 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-19T07:31:08.503 DEBUG:teuthology.orchestra.run.smithi165:> sudo systemctl stop ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@osd.1 2024-09-19T07:31:08.633 INFO:journalctl@ceph.osd.1.smithi165.stdout:Sep 19 07:31:08 smithi165 systemd[1]: Stopping Ceph osd.1 for eae8a4a8-7654-11ef-bceb-c7b262605968... 2024-09-19T07:31:09.133 INFO:journalctl@ceph.osd.1.smithi165.stdout:Sep 19 07:31:08 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-1[39697]: 2024-09-19T07:31:08.786+0000 7f5fd4b88640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:31:09.133 INFO:journalctl@ceph.osd.1.smithi165.stdout:Sep 19 07:31:08 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-1[39697]: 2024-09-19T07:31:08.786+0000 7f5fd4b88640 -1 osd.1 110 *** Got signal Terminated *** 2024-09-19T07:31:09.133 INFO:journalctl@ceph.osd.1.smithi165.stdout:Sep 19 07:31:08 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-1[39697]: 2024-09-19T07:31:08.786+0000 7f5fd4b88640 -1 osd.1 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T07:31:14.503 INFO:journalctl@ceph.osd.1.smithi165.stdout:Sep 19 07:31:14 smithi165 podman[73166]: 2024-09-19 07:31:14.240553006 +0000 UTC m=+5.550395923 container died dc67c658431519d1141d4e48872f5ea286464292dd9b4f56d063b286f640be53 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-1, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:31:14.778 INFO:journalctl@ceph.osd.1.smithi165.stdout:Sep 19 07:31:14 smithi165 podman[73166]: 2024-09-19 07:31:14.585869413 +0000 UTC m=+5.895712322 container cleanup dc67c658431519d1141d4e48872f5ea286464292dd9b4f56d063b286f640be53 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-1, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True) 2024-09-19T07:31:14.778 INFO:journalctl@ceph.osd.1.smithi165.stdout:Sep 19 07:31:14 smithi165 bash[73166]: ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-1 2024-09-19T07:31:15.133 INFO:journalctl@ceph.osd.1.smithi165.stdout:Sep 19 07:31:14 smithi165 podman[73181]: 2024-09-19 07:31:14.7786065 +0000 UTC m=+0.534209632 container remove dc67c658431519d1141d4e48872f5ea286464292dd9b4f56d063b286f640be53 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-1, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-19T07:31:15.490 INFO:journalctl@ceph.osd.1.smithi165.stdout:Sep 19 07:31:15 smithi165 podman[73271]: 2024-09-19 07:31:15.088829471 +0000 UTC m=+0.016299716 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:31:15.490 INFO:journalctl@ceph.osd.1.smithi165.stdout:Sep 19 07:31:15 smithi165 podman[73271]: 2024-09-19 07:31:15.24597981 +0000 UTC m=+0.173450059 container create 7713278394ed33d6839592bc161eb8a01105ca3e742cd1cfe0f098c4fb365617 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-19T07:31:15.490 INFO:journalctl@ceph.osd.1.smithi165.stdout:Sep 19 07:31:15 smithi165 podman[73271]: 2024-09-19 07:31:15.490307174 +0000 UTC m=+0.417777418 container init 7713278394ed33d6839592bc161eb8a01105ca3e742cd1cfe0f098c4fb365617 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:31:15.883 INFO:journalctl@ceph.osd.1.smithi165.stdout:Sep 19 07:31:15 smithi165 podman[73271]: 2024-09-19 07:31:15.493744194 +0000 UTC m=+0.421214444 container start 7713278394ed33d6839592bc161eb8a01105ca3e742cd1cfe0f098c4fb365617 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:31:15.883 INFO:journalctl@ceph.osd.1.smithi165.stdout:Sep 19 07:31:15 smithi165 podman[73271]: 2024-09-19 07:31:15.590239561 +0000 UTC m=+0.517709809 container attach 7713278394ed33d6839592bc161eb8a01105ca3e742cd1cfe0f098c4fb365617 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-19T07:31:15.883 INFO:journalctl@ceph.osd.1.smithi165.stdout:Sep 19 07:31:15 smithi165 podman[73271]: 2024-09-19 07:31:15.732568854 +0000 UTC m=+0.660039098 container died 7713278394ed33d6839592bc161eb8a01105ca3e742cd1cfe0f098c4fb365617 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-1-deactivate, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-19T07:31:16.265 INFO:journalctl@ceph.osd.1.smithi165.stdout:Sep 19 07:31:16 smithi165 podman[73294]: 2024-09-19 07:31:16.251531311 +0000 UTC m=+0.509900886 container remove 7713278394ed33d6839592bc161eb8a01105ca3e742cd1cfe0f098c4fb365617 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-19T07:31:16.271 DEBUG:teuthology.orchestra.run.smithi165:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@osd.1.service' 2024-09-19T07:31:16.310 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:31:16.310 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-19T07:31:16.310 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-19T07:31:16.310 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@osd.2 2024-09-19T07:31:16.623 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 19 07:31:16 smithi179 systemd[1]: Stopping Ceph osd.2 for eae8a4a8-7654-11ef-bceb-c7b262605968... 2024-09-19T07:31:17.022 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 19 07:31:16 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-2[40686]: 2024-09-19T07:31:16.622+0000 7f5ab82fd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:31:17.022 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 19 07:31:16 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-2[40686]: 2024-09-19T07:31:16.622+0000 7f5ab82fd640 -1 osd.2 110 *** Got signal Terminated *** 2024-09-19T07:31:17.022 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 19 07:31:16 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-2[40686]: 2024-09-19T07:31:16.622+0000 7f5ab82fd640 -1 osd.2 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T07:31:22.364 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 19 07:31:22 smithi179 podman[73786]: 2024-09-19 07:31:22.054381598 +0000 UTC m=+5.547028067 container died 55cce6785ab90ed763dc29eb6be1ec6d8a631ecb1e5ba2ae079b5ca2fedb5d30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-19T07:31:22.632 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 19 07:31:22 smithi179 podman[73786]: 2024-09-19 07:31:22.363994792 +0000 UTC m=+5.856641261 container cleanup 55cce6785ab90ed763dc29eb6be1ec6d8a631ecb1e5ba2ae079b5ca2fedb5d30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-19T07:31:22.632 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 19 07:31:22 smithi179 bash[73786]: ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-2 2024-09-19T07:31:22.940 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 19 07:31:22 smithi179 podman[73806]: 2024-09-19 07:31:22.6321241 +0000 UTC m=+0.574130593 container remove 55cce6785ab90ed763dc29eb6be1ec6d8a631ecb1e5ba2ae079b5ca2fedb5d30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:31:23.260 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 19 07:31:22 smithi179 podman[73894]: 2024-09-19 07:31:22.941150147 +0000 UTC m=+0.112139654 container create f79797e6ef820b0260c575721bba07398e65b1b82a0993b19248da90aec5ad27 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:31:23.261 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 19 07:31:22 smithi179 podman[73894]: 2024-09-19 07:31:22.845172876 +0000 UTC m=+0.016162393 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:31:23.261 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 19 07:31:23 smithi179 podman[73894]: 2024-09-19 07:31:23.177040267 +0000 UTC m=+0.348029775 container init f79797e6ef820b0260c575721bba07398e65b1b82a0993b19248da90aec5ad27 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-19T07:31:23.261 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 19 07:31:23 smithi179 podman[73894]: 2024-09-19 07:31:23.180511656 +0000 UTC m=+0.351501164 container start f79797e6ef820b0260c575721bba07398e65b1b82a0993b19248da90aec5ad27 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True) 2024-09-19T07:31:23.261 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 19 07:31:23 smithi179 podman[73894]: 2024-09-19 07:31:23.260460829 +0000 UTC m=+0.431450415 container attach f79797e6ef820b0260c575721bba07398e65b1b82a0993b19248da90aec5ad27 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:31:23.847 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 19 07:31:23 smithi179 podman[73894]: 2024-09-19 07:31:23.54891012 +0000 UTC m=+0.719899627 container died f79797e6ef820b0260c575721bba07398e65b1b82a0993b19248da90aec5ad27 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=squid-2f599a4) 2024-09-19T07:31:24.155 DEBUG:teuthology.orchestra.run.smithi179:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@osd.2.service' 2024-09-19T07:31:24.203 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:31:24.204 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-19T07:31:24.204 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-19T07:31:24.204 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@osd.3 2024-09-19T07:31:24.523 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 19 07:31:24 smithi148 systemd[1]: Stopping Ceph osd.3 for eae8a4a8-7654-11ef-bceb-c7b262605968... 2024-09-19T07:31:24.833 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 19 07:31:24 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-3[49116]: 2024-09-19T07:31:24.522+0000 7fd53234a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:31:24.833 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 19 07:31:24 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-3[49116]: 2024-09-19T07:31:24.522+0000 7fd53234a640 -1 osd.3 110 *** Got signal Terminated *** 2024-09-19T07:31:24.833 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 19 07:31:24 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-3[49116]: 2024-09-19T07:31:24.522+0000 7fd53234a640 -1 osd.3 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T07:31:27.522 INFO:journalctl@ceph.osd.5.smithi179.stdout:Sep 19 07:31:27 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-5[47352]: 2024-09-19T07:31:27.197+0000 7f8094743640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.397849+0000 front 2024-09-19T07:31:02.397920+0000 (oldest deadline 2024-09-19T07:31:27.097840+0000) 2024-09-19T07:31:27.522 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:27 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:27.408+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:31:27.883 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:27 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:27.447+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:31:28.522 INFO:journalctl@ceph.osd.5.smithi179.stdout:Sep 19 07:31:28 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-5[47352]: 2024-09-19T07:31:28.206+0000 7f8094743640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.397849+0000 front 2024-09-19T07:31:02.397920+0000 (oldest deadline 2024-09-19T07:31:27.097840+0000) 2024-09-19T07:31:28.522 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:28 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:28.422+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:31:28.883 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:28 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:28.416+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:31:29.522 INFO:journalctl@ceph.osd.5.smithi179.stdout:Sep 19 07:31:29 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-5[47352]: 2024-09-19T07:31:29.187+0000 7f8094743640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.397849+0000 front 2024-09-19T07:31:02.397920+0000 (oldest deadline 2024-09-19T07:31:27.097840+0000) 2024-09-19T07:31:29.522 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:29 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:29.385+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:31:29.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:29 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:29.101+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.842153+0000 front 2024-09-19T07:31:02.842300+0000 (oldest deadline 2024-09-19T07:31:28.142247+0000) 2024-09-19T07:31:29.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:29 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:29.374+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:31:30.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:30 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:30.051+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.842153+0000 front 2024-09-19T07:31:02.842300+0000 (oldest deadline 2024-09-19T07:31:28.142247+0000) 2024-09-19T07:31:30.333 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 19 07:31:30 smithi148 podman[107958]: 2024-09-19 07:31:30.16525122 +0000 UTC m=+5.757795788 container died 037052b5c1535604f54e15ff75071b166c10483e43d5068fe7dc91feb6586048 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-3, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-19T07:31:30.522 INFO:journalctl@ceph.osd.5.smithi179.stdout:Sep 19 07:31:30 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-5[47352]: 2024-09-19T07:31:30.174+0000 7f8094743640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.397849+0000 front 2024-09-19T07:31:02.397920+0000 (oldest deadline 2024-09-19T07:31:27.097840+0000) 2024-09-19T07:31:30.522 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:30 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:30.336+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:31:30.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:30 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:30.364+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:31:30.833 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 19 07:31:30 smithi148 podman[107958]: 2024-09-19 07:31:30.631157665 +0000 UTC m=+6.223702226 container cleanup 037052b5c1535604f54e15ff75071b166c10483e43d5068fe7dc91feb6586048 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2) 2024-09-19T07:31:30.833 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 19 07:31:30 smithi148 bash[107958]: ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-3 2024-09-19T07:31:31.218 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 19 07:31:30 smithi148 podman[107978]: 2024-09-19 07:31:30.899370646 +0000 UTC m=+0.730409861 container remove 037052b5c1535604f54e15ff75071b166c10483e43d5068fe7dc91feb6586048 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-3, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True) 2024-09-19T07:31:31.219 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:31 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:31.013+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.842153+0000 front 2024-09-19T07:31:02.842300+0000 (oldest deadline 2024-09-19T07:31:28.142247+0000) 2024-09-19T07:31:31.219 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:31 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:31.104+0000 7f269019e640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:01.030364+0000 front 2024-09-19T07:31:01.030407+0000 (oldest deadline 2024-09-19T07:31:30.431021+0000) 2024-09-19T07:31:31.469 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 19 07:31:31 smithi148 podman[108067]: 2024-09-19 07:31:31.121343981 +0000 UTC m=+0.015915829 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:31:31.469 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 19 07:31:31 smithi148 podman[108067]: 2024-09-19 07:31:31.225180557 +0000 UTC m=+0.119752442 container create b78fa51cabd50aa6f9e7a1f88601fbb957f4057bdee24920925bf35858a3d22a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-19T07:31:31.522 INFO:journalctl@ceph.osd.5.smithi179.stdout:Sep 19 07:31:31 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-5[47352]: 2024-09-19T07:31:31.205+0000 7f8094743640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.397849+0000 front 2024-09-19T07:31:02.397920+0000 (oldest deadline 2024-09-19T07:31:27.097840+0000) 2024-09-19T07:31:31.522 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:31 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:31.298+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:31:31.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:31 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:31.331+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:31:31.833 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 19 07:31:31 smithi148 podman[108067]: 2024-09-19 07:31:31.469114717 +0000 UTC m=+0.363686565 container init b78fa51cabd50aa6f9e7a1f88601fbb957f4057bdee24920925bf35858a3d22a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-19T07:31:31.833 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 19 07:31:31 smithi148 podman[108067]: 2024-09-19 07:31:31.472713144 +0000 UTC m=+0.367284983 container start b78fa51cabd50aa6f9e7a1f88601fbb957f4057bdee24920925bf35858a3d22a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-19T07:31:31.833 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 19 07:31:31 smithi148 podman[108067]: 2024-09-19 07:31:31.552534712 +0000 UTC m=+0.447106569 container attach b78fa51cabd50aa6f9e7a1f88601fbb957f4057bdee24920925bf35858a3d22a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:31:31.833 INFO:journalctl@ceph.osd.3.smithi148.stdout:Sep 19 07:31:31 smithi148 podman[108067]: 2024-09-19 07:31:31.657434084 +0000 UTC m=+0.552005934 container died b78fa51cabd50aa6f9e7a1f88601fbb957f4057bdee24920925bf35858a3d22a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-19T07:31:32.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:32 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:32.026+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.842153+0000 front 2024-09-19T07:31:02.842300+0000 (oldest deadline 2024-09-19T07:31:28.142247+0000) 2024-09-19T07:31:32.333 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:32 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:32.126+0000 7f269019e640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:01.030364+0000 front 2024-09-19T07:31:01.030407+0000 (oldest deadline 2024-09-19T07:31:30.431021+0000) 2024-09-19T07:31:32.414 DEBUG:teuthology.orchestra.run.smithi148:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@osd.3.service' 2024-09-19T07:31:32.454 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:31:32.454 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-19T07:31:32.454 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-19T07:31:32.455 DEBUG:teuthology.orchestra.run.smithi165:> sudo systemctl stop ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@osd.4 2024-09-19T07:31:32.522 INFO:journalctl@ceph.osd.5.smithi179.stdout:Sep 19 07:31:32 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-5[47352]: 2024-09-19T07:31:32.210+0000 7f8094743640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.397849+0000 front 2024-09-19T07:31:02.397920+0000 (oldest deadline 2024-09-19T07:31:27.097840+0000) 2024-09-19T07:31:32.522 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:32 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:32.323+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:31:32.633 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 19 07:31:32 smithi165 systemd[1]: Stopping Ceph osd.4 for eae8a4a8-7654-11ef-bceb-c7b262605968... 2024-09-19T07:31:32.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:32 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:32.373+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:31:33.133 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 19 07:31:32 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-4[46511]: 2024-09-19T07:31:32.744+0000 7f000ec63640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:31:33.133 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 19 07:31:32 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-4[46511]: 2024-09-19T07:31:32.744+0000 7f000ec63640 -1 osd.4 110 *** Got signal Terminated *** 2024-09-19T07:31:33.133 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 19 07:31:32 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-4[46511]: 2024-09-19T07:31:32.744+0000 7f000ec63640 -1 osd.4 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T07:31:33.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:33 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:33.052+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.842153+0000 front 2024-09-19T07:31:02.842300+0000 (oldest deadline 2024-09-19T07:31:28.142247+0000) 2024-09-19T07:31:33.333 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:33 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:33.130+0000 7f269019e640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:01.030364+0000 front 2024-09-19T07:31:01.030407+0000 (oldest deadline 2024-09-19T07:31:30.431021+0000) 2024-09-19T07:31:33.522 INFO:journalctl@ceph.osd.5.smithi179.stdout:Sep 19 07:31:33 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-5[47352]: 2024-09-19T07:31:33.179+0000 7f8094743640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.397849+0000 front 2024-09-19T07:31:02.397920+0000 (oldest deadline 2024-09-19T07:31:27.097840+0000) 2024-09-19T07:31:33.522 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:33 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:33.340+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:31:33.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:33 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:33.359+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:31:34.333 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:34 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:34.124+0000 7f269019e640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:01.030364+0000 front 2024-09-19T07:31:01.030407+0000 (oldest deadline 2024-09-19T07:31:30.431021+0000) 2024-09-19T07:31:34.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:34 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:34.050+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.842153+0000 front 2024-09-19T07:31:02.842300+0000 (oldest deadline 2024-09-19T07:31:28.142247+0000) 2024-09-19T07:31:34.522 INFO:journalctl@ceph.osd.5.smithi179.stdout:Sep 19 07:31:34 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-5[47352]: 2024-09-19T07:31:34.140+0000 7f8094743640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.397849+0000 front 2024-09-19T07:31:02.397920+0000 (oldest deadline 2024-09-19T07:31:27.097840+0000) 2024-09-19T07:31:34.522 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:34 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:34.341+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:31:34.522 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:34 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:34.341+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:31:34.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:34 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:34.356+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:31:35.333 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:35 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:35.151+0000 7f269019e640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:01.030364+0000 front 2024-09-19T07:31:01.030407+0000 (oldest deadline 2024-09-19T07:31:30.431021+0000) 2024-09-19T07:31:35.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:35 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:35.007+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.842153+0000 front 2024-09-19T07:31:02.842300+0000 (oldest deadline 2024-09-19T07:31:28.142247+0000) 2024-09-19T07:31:35.522 INFO:journalctl@ceph.osd.5.smithi179.stdout:Sep 19 07:31:35 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-5[47352]: 2024-09-19T07:31:35.124+0000 7f8094743640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.397849+0000 front 2024-09-19T07:31:02.397920+0000 (oldest deadline 2024-09-19T07:31:27.097840+0000) 2024-09-19T07:31:35.522 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:35 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:35.357+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:31:35.522 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:35 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:35.357+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:31:35.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:35 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:35.380+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:31:36.341 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:36 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:36.118+0000 7f269019e640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:01.030364+0000 front 2024-09-19T07:31:01.030407+0000 (oldest deadline 2024-09-19T07:31:30.431021+0000) 2024-09-19T07:31:36.341 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:36 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:36.006+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.842153+0000 front 2024-09-19T07:31:02.842300+0000 (oldest deadline 2024-09-19T07:31:28.142247+0000) 2024-09-19T07:31:36.444 INFO:journalctl@ceph.osd.5.smithi179.stdout:Sep 19 07:31:36 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-5[47352]: 2024-09-19T07:31:36.172+0000 7f8094743640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.397849+0000 front 2024-09-19T07:31:02.397920+0000 (oldest deadline 2024-09-19T07:31:27.097840+0000) 2024-09-19T07:31:36.444 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:36 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:36.391+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:31:36.444 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:36 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:36.391+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:31:36.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:36 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:36.334+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:31:36.772 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:31:36 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:31:36.437+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.176044+0000 front 2024-09-19T07:31:13.176112+0000 (oldest deadline 2024-09-19T07:31:36.076128+0000) 2024-09-19T07:31:37.333 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:37 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:37.116+0000 7f269019e640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:01.030364+0000 front 2024-09-19T07:31:01.030407+0000 (oldest deadline 2024-09-19T07:31:30.431021+0000) 2024-09-19T07:31:37.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:36 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:36.995+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.842153+0000 front 2024-09-19T07:31:02.842300+0000 (oldest deadline 2024-09-19T07:31:28.142247+0000) 2024-09-19T07:31:37.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:36 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:36.995+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:11.543800+0000 front 2024-09-19T07:31:11.543952+0000 (oldest deadline 2024-09-19T07:31:36.243874+0000) 2024-09-19T07:31:37.522 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:31:37 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:31:37.426+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.176044+0000 front 2024-09-19T07:31:13.176112+0000 (oldest deadline 2024-09-19T07:31:36.076128+0000) 2024-09-19T07:31:37.522 INFO:journalctl@ceph.osd.5.smithi179.stdout:Sep 19 07:31:37 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-5[47352]: 2024-09-19T07:31:37.181+0000 7f8094743640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.397849+0000 front 2024-09-19T07:31:02.397920+0000 (oldest deadline 2024-09-19T07:31:27.097840+0000) 2024-09-19T07:31:37.523 INFO:journalctl@ceph.osd.5.smithi179.stdout:Sep 19 07:31:37 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-5[47352]: 2024-09-19T07:31:37.181+0000 7f8094743640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.999120+0000 front 2024-09-19T07:31:12.999095+0000 (oldest deadline 2024-09-19T07:31:36.499059+0000) 2024-09-19T07:31:37.523 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:37 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:37.412+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:31:37.523 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:37 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:37.412+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:31:37.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:37 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:37.364+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:31:37.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:37 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:37.364+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.515166+0000 front 2024-09-19T07:31:12.515206+0000 (oldest deadline 2024-09-19T07:31:36.615343+0000) 2024-09-19T07:31:38.333 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:38 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:38.075+0000 7f269019e640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:01.030364+0000 front 2024-09-19T07:31:01.030407+0000 (oldest deadline 2024-09-19T07:31:30.431021+0000) 2024-09-19T07:31:38.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:38 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:38.002+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.842153+0000 front 2024-09-19T07:31:02.842300+0000 (oldest deadline 2024-09-19T07:31:28.142247+0000) 2024-09-19T07:31:38.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:38 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:38.002+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:11.543800+0000 front 2024-09-19T07:31:11.543952+0000 (oldest deadline 2024-09-19T07:31:36.243874+0000) 2024-09-19T07:31:38.462 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 19 07:31:38 smithi165 podman[73389]: 2024-09-19 07:31:38.158414487 +0000 UTC m=+5.508368935 container died a4d4791ba24cb6db45799af891864e433555196191aef1f793ee1937601710f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-4, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-19T07:31:38.463 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:38 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:38.371+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:31:38.463 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:38 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:38.371+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.515166+0000 front 2024-09-19T07:31:12.515206+0000 (oldest deadline 2024-09-19T07:31:36.615343+0000) 2024-09-19T07:31:38.522 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:31:38 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:31:38.440+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.176044+0000 front 2024-09-19T07:31:13.176112+0000 (oldest deadline 2024-09-19T07:31:36.076128+0000) 2024-09-19T07:31:38.522 INFO:journalctl@ceph.osd.5.smithi179.stdout:Sep 19 07:31:38 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-5[47352]: 2024-09-19T07:31:38.216+0000 7f8094743640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.397849+0000 front 2024-09-19T07:31:02.397920+0000 (oldest deadline 2024-09-19T07:31:27.097840+0000) 2024-09-19T07:31:38.522 INFO:journalctl@ceph.osd.5.smithi179.stdout:Sep 19 07:31:38 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-5[47352]: 2024-09-19T07:31:38.216+0000 7f8094743640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.999120+0000 front 2024-09-19T07:31:12.999095+0000 (oldest deadline 2024-09-19T07:31:36.499059+0000) 2024-09-19T07:31:38.522 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:38 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:38.451+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:31:38.523 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:38 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:38.451+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:31:38.812 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 19 07:31:38 smithi165 podman[73389]: 2024-09-19 07:31:38.561713554 +0000 UTC m=+5.911668002 container cleanup a4d4791ba24cb6db45799af891864e433555196191aef1f793ee1937601710f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:31:38.813 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 19 07:31:38 smithi165 bash[73389]: ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-4 2024-09-19T07:31:39.123 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 19 07:31:38 smithi165 podman[73405]: 2024-09-19 07:31:38.812843722 +0000 UTC m=+0.648136429 container remove a4d4791ba24cb6db45799af891864e433555196191aef1f793ee1937601710f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:31:39.333 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:39 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:39.098+0000 7f269019e640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:01.030364+0000 front 2024-09-19T07:31:01.030407+0000 (oldest deadline 2024-09-19T07:31:30.431021+0000) 2024-09-19T07:31:39.333 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:39 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:39.098+0000 7f269019e640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.133003+0000 front 2024-09-19T07:31:13.132863+0000 (oldest deadline 2024-09-19T07:31:38.433071+0000) 2024-09-19T07:31:39.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:39 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:39.041+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.842153+0000 front 2024-09-19T07:31:02.842300+0000 (oldest deadline 2024-09-19T07:31:28.142247+0000) 2024-09-19T07:31:39.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:39 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:39.041+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:11.543800+0000 front 2024-09-19T07:31:11.543952+0000 (oldest deadline 2024-09-19T07:31:36.243874+0000) 2024-09-19T07:31:39.383 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 19 07:31:39 smithi165 podman[73493]: 2024-09-19 07:31:39.026628649 +0000 UTC m=+0.015866884 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:31:39.384 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 19 07:31:39 smithi165 podman[73493]: 2024-09-19 07:31:39.130269998 +0000 UTC m=+0.119508232 container create 81a22e0911defc544bdd18fee0e1774f393ae084b0b6fd82a43b74b41ccfa250 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-4-deactivate, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-19T07:31:39.384 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 19 07:31:39 smithi165 podman[73493]: 2024-09-19 07:31:39.349422306 +0000 UTC m=+0.338660541 container init 81a22e0911defc544bdd18fee0e1774f393ae084b0b6fd82a43b74b41ccfa250 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:31:39.384 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 19 07:31:39 smithi165 podman[73493]: 2024-09-19 07:31:39.352705942 +0000 UTC m=+0.341944186 container start 81a22e0911defc544bdd18fee0e1774f393ae084b0b6fd82a43b74b41ccfa250 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:31:39.525 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:31:39 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:31:39.458+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.176044+0000 front 2024-09-19T07:31:13.176112+0000 (oldest deadline 2024-09-19T07:31:36.076128+0000) 2024-09-19T07:31:39.526 INFO:journalctl@ceph.osd.5.smithi179.stdout:Sep 19 07:31:39 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-5[47352]: 2024-09-19T07:31:39.224+0000 7f8094743640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.397849+0000 front 2024-09-19T07:31:02.397920+0000 (oldest deadline 2024-09-19T07:31:27.097840+0000) 2024-09-19T07:31:39.526 INFO:journalctl@ceph.osd.5.smithi179.stdout:Sep 19 07:31:39 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-5[47352]: 2024-09-19T07:31:39.224+0000 7f8094743640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.999120+0000 front 2024-09-19T07:31:12.999095+0000 (oldest deadline 2024-09-19T07:31:36.499059+0000) 2024-09-19T07:31:39.526 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:39 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:39.464+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:31:39.526 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:39 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:39.464+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:31:39.835 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 19 07:31:39 smithi165 podman[73493]: 2024-09-19 07:31:39.424219595 +0000 UTC m=+0.413457830 container attach 81a22e0911defc544bdd18fee0e1774f393ae084b0b6fd82a43b74b41ccfa250 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-19T07:31:39.836 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 19 07:31:39 smithi165 podman[73493]: 2024-09-19 07:31:39.541604661 +0000 UTC m=+0.530842900 container died 81a22e0911defc544bdd18fee0e1774f393ae084b0b6fd82a43b74b41ccfa250 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-19T07:31:39.836 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:39 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:39.385+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:31:39.836 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:39 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:39.385+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.515166+0000 front 2024-09-19T07:31:12.515206+0000 (oldest deadline 2024-09-19T07:31:36.615343+0000) 2024-09-19T07:31:40.136 DEBUG:teuthology.orchestra.run.smithi165:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@osd.4.service' 2024-09-19T07:31:40.178 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:31:40.178 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-19T07:31:40.178 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-19T07:31:40.179 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@osd.5 2024-09-19T07:31:40.333 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:40 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:40.056+0000 7f269019e640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:01.030364+0000 front 2024-09-19T07:31:01.030407+0000 (oldest deadline 2024-09-19T07:31:30.431021+0000) 2024-09-19T07:31:40.333 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:40 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:40.056+0000 7f269019e640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.133003+0000 front 2024-09-19T07:31:13.132863+0000 (oldest deadline 2024-09-19T07:31:38.433071+0000) 2024-09-19T07:31:40.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:40 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:40.074+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.842153+0000 front 2024-09-19T07:31:02.842300+0000 (oldest deadline 2024-09-19T07:31:28.142247+0000) 2024-09-19T07:31:40.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:40 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:40.074+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:11.543800+0000 front 2024-09-19T07:31:11.543952+0000 (oldest deadline 2024-09-19T07:31:36.243874+0000) 2024-09-19T07:31:40.383 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:31:40 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:31:40.147+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.672336+0000 front 2024-09-19T07:31:13.672274+0000 (oldest deadline 2024-09-19T07:31:39.572492+0000) 2024-09-19T07:31:40.384 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:40 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:40.350+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:31:40.384 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:40 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:40.350+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.515166+0000 front 2024-09-19T07:31:12.515206+0000 (oldest deadline 2024-09-19T07:31:36.615343+0000) 2024-09-19T07:31:40.484 INFO:journalctl@ceph.osd.5.smithi179.stdout:Sep 19 07:31:40 smithi179 systemd[1]: Stopping Ceph osd.5 for eae8a4a8-7654-11ef-bceb-c7b262605968... 2024-09-19T07:31:40.484 INFO:journalctl@ceph.osd.5.smithi179.stdout:Sep 19 07:31:40 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-5[47352]: 2024-09-19T07:31:40.256+0000 7f8094743640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.397849+0000 front 2024-09-19T07:31:02.397920+0000 (oldest deadline 2024-09-19T07:31:27.097840+0000) 2024-09-19T07:31:40.484 INFO:journalctl@ceph.osd.5.smithi179.stdout:Sep 19 07:31:40 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-5[47352]: 2024-09-19T07:31:40.256+0000 7f8094743640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.999120+0000 front 2024-09-19T07:31:12.999095+0000 (oldest deadline 2024-09-19T07:31:36.499059+0000) 2024-09-19T07:31:40.772 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:31:40 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:31:40.483+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.176044+0000 front 2024-09-19T07:31:13.176112+0000 (oldest deadline 2024-09-19T07:31:36.076128+0000) 2024-09-19T07:31:40.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:40 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:40.498+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:31:40.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:40 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:40.498+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:31:40.772 INFO:journalctl@ceph.osd.5.smithi179.stdout:Sep 19 07:31:40 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-5[47352]: 2024-09-19T07:31:40.524+0000 7f809c146640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:31:40.773 INFO:journalctl@ceph.osd.5.smithi179.stdout:Sep 19 07:31:40 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-5[47352]: 2024-09-19T07:31:40.524+0000 7f809c146640 -1 osd.5 110 *** Got signal Terminated *** 2024-09-19T07:31:40.773 INFO:journalctl@ceph.osd.5.smithi179.stdout:Sep 19 07:31:40 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-5[47352]: 2024-09-19T07:31:40.524+0000 7f809c146640 -1 osd.5 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T07:31:41.333 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:41 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:41.040+0000 7f269019e640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:01.030364+0000 front 2024-09-19T07:31:01.030407+0000 (oldest deadline 2024-09-19T07:31:30.431021+0000) 2024-09-19T07:31:41.333 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:41 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:41.040+0000 7f269019e640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.133003+0000 front 2024-09-19T07:31:13.132863+0000 (oldest deadline 2024-09-19T07:31:38.433071+0000) 2024-09-19T07:31:41.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:41 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:41.048+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.842153+0000 front 2024-09-19T07:31:02.842300+0000 (oldest deadline 2024-09-19T07:31:28.142247+0000) 2024-09-19T07:31:41.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:41 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:41.048+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:11.543800+0000 front 2024-09-19T07:31:11.543952+0000 (oldest deadline 2024-09-19T07:31:36.243874+0000) 2024-09-19T07:31:41.633 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:31:41 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:31:41.139+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.672336+0000 front 2024-09-19T07:31:13.672274+0000 (oldest deadline 2024-09-19T07:31:39.572492+0000) 2024-09-19T07:31:41.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:41 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:41.370+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:31:41.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:41 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:41.370+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.515166+0000 front 2024-09-19T07:31:12.515206+0000 (oldest deadline 2024-09-19T07:31:36.615343+0000) 2024-09-19T07:31:41.772 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:31:41 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:31:41.461+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.176044+0000 front 2024-09-19T07:31:13.176112+0000 (oldest deadline 2024-09-19T07:31:36.076128+0000) 2024-09-19T07:31:41.772 INFO:journalctl@ceph.osd.5.smithi179.stdout:Sep 19 07:31:41 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-5[47352]: 2024-09-19T07:31:41.302+0000 7f8094743640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.397849+0000 front 2024-09-19T07:31:02.397920+0000 (oldest deadline 2024-09-19T07:31:27.097840+0000) 2024-09-19T07:31:41.772 INFO:journalctl@ceph.osd.5.smithi179.stdout:Sep 19 07:31:41 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-5[47352]: 2024-09-19T07:31:41.302+0000 7f8094743640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.999120+0000 front 2024-09-19T07:31:12.999095+0000 (oldest deadline 2024-09-19T07:31:36.499059+0000) 2024-09-19T07:31:41.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:41 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:41.472+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:31:41.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:41 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:41.472+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:31:42.333 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:42 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:42.066+0000 7f269019e640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:01.030364+0000 front 2024-09-19T07:31:01.030407+0000 (oldest deadline 2024-09-19T07:31:30.431021+0000) 2024-09-19T07:31:42.333 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:42 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:42.066+0000 7f269019e640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.133003+0000 front 2024-09-19T07:31:13.132863+0000 (oldest deadline 2024-09-19T07:31:38.433071+0000) 2024-09-19T07:31:42.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:42 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:42.012+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.842153+0000 front 2024-09-19T07:31:02.842300+0000 (oldest deadline 2024-09-19T07:31:28.142247+0000) 2024-09-19T07:31:42.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:42 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:42.012+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:11.543800+0000 front 2024-09-19T07:31:11.543952+0000 (oldest deadline 2024-09-19T07:31:36.243874+0000) 2024-09-19T07:31:42.381 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:31:42 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:31:42.104+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.672336+0000 front 2024-09-19T07:31:13.672274+0000 (oldest deadline 2024-09-19T07:31:39.572492+0000) 2024-09-19T07:31:42.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:42 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:42.380+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:31:42.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:42 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:42.380+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.515166+0000 front 2024-09-19T07:31:12.515206+0000 (oldest deadline 2024-09-19T07:31:36.615343+0000) 2024-09-19T07:31:42.772 INFO:journalctl@ceph.osd.5.smithi179.stdout:Sep 19 07:31:42 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-5[47352]: 2024-09-19T07:31:42.305+0000 7f8094743640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.397849+0000 front 2024-09-19T07:31:02.397920+0000 (oldest deadline 2024-09-19T07:31:27.097840+0000) 2024-09-19T07:31:42.772 INFO:journalctl@ceph.osd.5.smithi179.stdout:Sep 19 07:31:42 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-5[47352]: 2024-09-19T07:31:42.305+0000 7f8094743640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.999120+0000 front 2024-09-19T07:31:12.999095+0000 (oldest deadline 2024-09-19T07:31:36.499059+0000) 2024-09-19T07:31:42.773 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:31:42 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:31:42.509+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.176044+0000 front 2024-09-19T07:31:13.176112+0000 (oldest deadline 2024-09-19T07:31:36.076128+0000) 2024-09-19T07:31:42.773 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:31:42 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:31:42.509+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:16.577263+0000 front 2024-09-19T07:31:16.577228+0000 (oldest deadline 2024-09-19T07:31:42.477389+0000) 2024-09-19T07:31:42.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:42 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:42.504+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:31:42.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:42 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:42.504+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:31:42.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:42 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:42.504+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:31:43.333 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:43 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:43.099+0000 7f269019e640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:01.030364+0000 front 2024-09-19T07:31:01.030407+0000 (oldest deadline 2024-09-19T07:31:30.431021+0000) 2024-09-19T07:31:43.333 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:43 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:43.099+0000 7f269019e640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.133003+0000 front 2024-09-19T07:31:13.132863+0000 (oldest deadline 2024-09-19T07:31:38.433071+0000) 2024-09-19T07:31:43.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:43 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:43.053+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.842153+0000 front 2024-09-19T07:31:02.842300+0000 (oldest deadline 2024-09-19T07:31:28.142247+0000) 2024-09-19T07:31:43.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:43 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:43.053+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:11.543800+0000 front 2024-09-19T07:31:11.543952+0000 (oldest deadline 2024-09-19T07:31:36.243874+0000) 2024-09-19T07:31:43.365 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:31:43 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:31:43.063+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.672336+0000 front 2024-09-19T07:31:13.672274+0000 (oldest deadline 2024-09-19T07:31:39.572492+0000) 2024-09-19T07:31:43.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:43 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:43.364+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:31:43.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:43 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:43.364+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.515166+0000 front 2024-09-19T07:31:12.515206+0000 (oldest deadline 2024-09-19T07:31:36.615343+0000) 2024-09-19T07:31:43.772 INFO:journalctl@ceph.osd.5.smithi179.stdout:Sep 19 07:31:43 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-5[47352]: 2024-09-19T07:31:43.333+0000 7f8094743640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.397849+0000 front 2024-09-19T07:31:02.397920+0000 (oldest deadline 2024-09-19T07:31:27.097840+0000) 2024-09-19T07:31:43.772 INFO:journalctl@ceph.osd.5.smithi179.stdout:Sep 19 07:31:43 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-5[47352]: 2024-09-19T07:31:43.333+0000 7f8094743640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.999120+0000 front 2024-09-19T07:31:12.999095+0000 (oldest deadline 2024-09-19T07:31:36.499059+0000) 2024-09-19T07:31:43.773 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:31:43 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:31:43.477+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.176044+0000 front 2024-09-19T07:31:13.176112+0000 (oldest deadline 2024-09-19T07:31:36.076128+0000) 2024-09-19T07:31:43.773 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:31:43 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:31:43.477+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:16.577263+0000 front 2024-09-19T07:31:16.577228+0000 (oldest deadline 2024-09-19T07:31:42.477389+0000) 2024-09-19T07:31:43.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:43 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:43.473+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:31:43.774 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:43 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:43.473+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:31:43.774 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:43 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:43.473+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:31:44.336 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:44 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:44.116+0000 7f269019e640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:01.030364+0000 front 2024-09-19T07:31:01.030407+0000 (oldest deadline 2024-09-19T07:31:30.431021+0000) 2024-09-19T07:31:44.336 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:44 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:44.116+0000 7f269019e640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.133003+0000 front 2024-09-19T07:31:13.132863+0000 (oldest deadline 2024-09-19T07:31:38.433071+0000) 2024-09-19T07:31:44.336 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:44 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:44.061+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.842153+0000 front 2024-09-19T07:31:02.842300+0000 (oldest deadline 2024-09-19T07:31:28.142247+0000) 2024-09-19T07:31:44.336 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:44 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:44.061+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:11.543800+0000 front 2024-09-19T07:31:11.543952+0000 (oldest deadline 2024-09-19T07:31:36.243874+0000) 2024-09-19T07:31:44.336 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:44 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:44.061+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.145101+0000 front 2024-09-19T07:31:19.145035+0000 (oldest deadline 2024-09-19T07:31:43.145546+0000) 2024-09-19T07:31:44.383 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:31:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:31:44.102+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.672336+0000 front 2024-09-19T07:31:13.672274+0000 (oldest deadline 2024-09-19T07:31:39.572492+0000) 2024-09-19T07:31:44.773 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:31:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:31:44.430+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.176044+0000 front 2024-09-19T07:31:13.176112+0000 (oldest deadline 2024-09-19T07:31:36.076128+0000) 2024-09-19T07:31:44.773 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:31:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:31:44.430+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:16.577263+0000 front 2024-09-19T07:31:16.577228+0000 (oldest deadline 2024-09-19T07:31:42.477389+0000) 2024-09-19T07:31:44.773 INFO:journalctl@ceph.osd.5.smithi179.stdout:Sep 19 07:31:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-5[47352]: 2024-09-19T07:31:44.382+0000 7f8094743640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.397849+0000 front 2024-09-19T07:31:02.397920+0000 (oldest deadline 2024-09-19T07:31:27.097840+0000) 2024-09-19T07:31:44.773 INFO:journalctl@ceph.osd.5.smithi179.stdout:Sep 19 07:31:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-5[47352]: 2024-09-19T07:31:44.382+0000 7f8094743640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.999120+0000 front 2024-09-19T07:31:12.999095+0000 (oldest deadline 2024-09-19T07:31:36.499059+0000) 2024-09-19T07:31:44.774 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:44.462+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:31:44.774 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:44.462+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:31:44.774 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:44 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:44.462+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:31:44.883 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:44.385+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:31:44.883 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:44.385+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.515166+0000 front 2024-09-19T07:31:12.515206+0000 (oldest deadline 2024-09-19T07:31:36.615343+0000) 2024-09-19T07:31:44.883 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:44 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:44.385+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:18.316513+0000 front 2024-09-19T07:31:18.316455+0000 (oldest deadline 2024-09-19T07:31:43.616558+0000) 2024-09-19T07:31:45.333 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:45 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:45.157+0000 7f269019e640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:01.030364+0000 front 2024-09-19T07:31:01.030407+0000 (oldest deadline 2024-09-19T07:31:30.431021+0000) 2024-09-19T07:31:45.333 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:45 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:45.157+0000 7f269019e640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.133003+0000 front 2024-09-19T07:31:13.132863+0000 (oldest deadline 2024-09-19T07:31:38.433071+0000) 2024-09-19T07:31:45.333 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:45 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:45.157+0000 7f269019e640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:21.334201+0000 front 2024-09-19T07:31:21.334098+0000 (oldest deadline 2024-09-19T07:31:44.234035+0000) 2024-09-19T07:31:45.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:45 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:45.044+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.842153+0000 front 2024-09-19T07:31:02.842300+0000 (oldest deadline 2024-09-19T07:31:28.142247+0000) 2024-09-19T07:31:45.334 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:45 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:45.044+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:11.543800+0000 front 2024-09-19T07:31:11.543952+0000 (oldest deadline 2024-09-19T07:31:36.243874+0000) 2024-09-19T07:31:45.334 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:45 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:45.044+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.145101+0000 front 2024-09-19T07:31:19.145035+0000 (oldest deadline 2024-09-19T07:31:43.145546+0000) 2024-09-19T07:31:45.383 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:31:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:31:45.096+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.672336+0000 front 2024-09-19T07:31:13.672274+0000 (oldest deadline 2024-09-19T07:31:39.572492+0000) 2024-09-19T07:31:45.383 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:31:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:31:45.096+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.573083+0000 front 2024-09-19T07:31:19.573178+0000 (oldest deadline 2024-09-19T07:31:44.873101+0000) 2024-09-19T07:31:45.772 INFO:journalctl@ceph.osd.5.smithi179.stdout:Sep 19 07:31:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-5[47352]: 2024-09-19T07:31:45.419+0000 7f8094743640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.397849+0000 front 2024-09-19T07:31:02.397920+0000 (oldest deadline 2024-09-19T07:31:27.097840+0000) 2024-09-19T07:31:45.772 INFO:journalctl@ceph.osd.5.smithi179.stdout:Sep 19 07:31:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-5[47352]: 2024-09-19T07:31:45.419+0000 7f8094743640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.999120+0000 front 2024-09-19T07:31:12.999095+0000 (oldest deadline 2024-09-19T07:31:36.499059+0000) 2024-09-19T07:31:45.772 INFO:journalctl@ceph.osd.5.smithi179.stdout:Sep 19 07:31:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-5[47352]: 2024-09-19T07:31:45.419+0000 7f8094743640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:18.799739+0000 front 2024-09-19T07:31:18.799769+0000 (oldest deadline 2024-09-19T07:31:45.200499+0000) 2024-09-19T07:31:45.772 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:31:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:31:45.438+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.176044+0000 front 2024-09-19T07:31:13.176112+0000 (oldest deadline 2024-09-19T07:31:36.076128+0000) 2024-09-19T07:31:45.773 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:31:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:31:45.438+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:16.577263+0000 front 2024-09-19T07:31:16.577228+0000 (oldest deadline 2024-09-19T07:31:42.477389+0000) 2024-09-19T07:31:45.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:45.420+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:31:45.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:45.420+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:31:45.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:45 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:45.420+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:31:45.883 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:45.426+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:31:45.883 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:45.426+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.515166+0000 front 2024-09-19T07:31:12.515206+0000 (oldest deadline 2024-09-19T07:31:36.615343+0000) 2024-09-19T07:31:45.883 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:45 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:45.426+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:18.316513+0000 front 2024-09-19T07:31:18.316455+0000 (oldest deadline 2024-09-19T07:31:43.616558+0000) 2024-09-19T07:31:46.333 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:46 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:46.134+0000 7f269019e640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:01.030364+0000 front 2024-09-19T07:31:01.030407+0000 (oldest deadline 2024-09-19T07:31:30.431021+0000) 2024-09-19T07:31:46.333 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:46 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:46.134+0000 7f269019e640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.133003+0000 front 2024-09-19T07:31:13.132863+0000 (oldest deadline 2024-09-19T07:31:38.433071+0000) 2024-09-19T07:31:46.333 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:46 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:46.134+0000 7f269019e640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:21.334201+0000 front 2024-09-19T07:31:21.334098+0000 (oldest deadline 2024-09-19T07:31:44.234035+0000) 2024-09-19T07:31:46.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:46 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:46.077+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.842153+0000 front 2024-09-19T07:31:02.842300+0000 (oldest deadline 2024-09-19T07:31:28.142247+0000) 2024-09-19T07:31:46.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:46 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:46.077+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:11.543800+0000 front 2024-09-19T07:31:11.543952+0000 (oldest deadline 2024-09-19T07:31:36.243874+0000) 2024-09-19T07:31:46.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:46 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:46.077+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.145101+0000 front 2024-09-19T07:31:19.145035+0000 (oldest deadline 2024-09-19T07:31:43.145546+0000) 2024-09-19T07:31:46.381 INFO:journalctl@ceph.osd.5.smithi179.stdout:Sep 19 07:31:46 smithi179 podman[74009]: 2024-09-19 07:31:46.105821712 +0000 UTC m=+5.717051539 container stop 770b6efd1b0e74ad827e221cc595e3ec890bdca647d0e02aee1bb7a4f2f7e8e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-5, GIT_CLEAN=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-19T07:31:46.381 INFO:journalctl@ceph.osd.5.smithi179.stdout:Sep 19 07:31:46 smithi179 podman[74009]: 2024-09-19 07:31:46.131479837 +0000 UTC m=+5.742709667 container died 770b6efd1b0e74ad827e221cc595e3ec890bdca647d0e02aee1bb7a4f2f7e8e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-5, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:31:46.383 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:31:46 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:31:46.085+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.672336+0000 front 2024-09-19T07:31:13.672274+0000 (oldest deadline 2024-09-19T07:31:39.572492+0000) 2024-09-19T07:31:46.383 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:31:46 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:31:46.085+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.573083+0000 front 2024-09-19T07:31:19.573178+0000 (oldest deadline 2024-09-19T07:31:44.873101+0000) 2024-09-19T07:31:46.677 INFO:journalctl@ceph.osd.5.smithi179.stdout:Sep 19 07:31:46 smithi179 podman[74009]: 2024-09-19 07:31:46.493280501 +0000 UTC m=+6.104510325 container cleanup 770b6efd1b0e74ad827e221cc595e3ec890bdca647d0e02aee1bb7a4f2f7e8e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-5, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-19T07:31:46.677 INFO:journalctl@ceph.osd.5.smithi179.stdout:Sep 19 07:31:46 smithi179 bash[74009]: ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-5 2024-09-19T07:31:46.678 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:31:46 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:31:46.461+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.176044+0000 front 2024-09-19T07:31:13.176112+0000 (oldest deadline 2024-09-19T07:31:36.076128+0000) 2024-09-19T07:31:46.678 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:31:46 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:31:46.461+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:16.577263+0000 front 2024-09-19T07:31:16.577228+0000 (oldest deadline 2024-09-19T07:31:42.477389+0000) 2024-09-19T07:31:46.678 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:46 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:46.377+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:31:46.678 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:46 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:46.377+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:31:46.678 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:46 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:46.377+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:31:46.883 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:46 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:46.469+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:31:46.883 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:46 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:46.469+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.515166+0000 front 2024-09-19T07:31:12.515206+0000 (oldest deadline 2024-09-19T07:31:36.615343+0000) 2024-09-19T07:31:46.883 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:46 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:46.469+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:18.316513+0000 front 2024-09-19T07:31:18.316455+0000 (oldest deadline 2024-09-19T07:31:43.616558+0000) 2024-09-19T07:31:47.022 INFO:journalctl@ceph.osd.5.smithi179.stdout:Sep 19 07:31:46 smithi179 podman[74024]: 2024-09-19 07:31:46.677566617 +0000 UTC m=+0.564854029 container remove 770b6efd1b0e74ad827e221cc595e3ec890bdca647d0e02aee1bb7a4f2f7e8e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-5, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-19T07:31:47.333 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:47 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:47.163+0000 7f269019e640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:01.030364+0000 front 2024-09-19T07:31:01.030407+0000 (oldest deadline 2024-09-19T07:31:30.431021+0000) 2024-09-19T07:31:47.333 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:47 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:47.163+0000 7f269019e640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.133003+0000 front 2024-09-19T07:31:13.132863+0000 (oldest deadline 2024-09-19T07:31:38.433071+0000) 2024-09-19T07:31:47.333 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:47 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:47.163+0000 7f269019e640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:21.334201+0000 front 2024-09-19T07:31:21.334098+0000 (oldest deadline 2024-09-19T07:31:44.234035+0000) 2024-09-19T07:31:47.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:47 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:47.081+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.842153+0000 front 2024-09-19T07:31:02.842300+0000 (oldest deadline 2024-09-19T07:31:28.142247+0000) 2024-09-19T07:31:47.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:47 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:47.081+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:11.543800+0000 front 2024-09-19T07:31:11.543952+0000 (oldest deadline 2024-09-19T07:31:36.243874+0000) 2024-09-19T07:31:47.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:47 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:47.081+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.145101+0000 front 2024-09-19T07:31:19.145035+0000 (oldest deadline 2024-09-19T07:31:43.145546+0000) 2024-09-19T07:31:47.383 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:31:47 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:31:47.089+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.672336+0000 front 2024-09-19T07:31:13.672274+0000 (oldest deadline 2024-09-19T07:31:39.572492+0000) 2024-09-19T07:31:47.383 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:31:47 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:31:47.089+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.573083+0000 front 2024-09-19T07:31:19.573178+0000 (oldest deadline 2024-09-19T07:31:44.873101+0000) 2024-09-19T07:31:47.413 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:47 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:47.341+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:31:47.413 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:47 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:47.341+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:31:47.413 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:47 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:47.341+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:31:47.414 INFO:journalctl@ceph.osd.5.smithi179.stdout:Sep 19 07:31:47 smithi179 podman[74114]: 2024-09-19 07:31:47.015960855 +0000 UTC m=+0.016293657 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:31:47.414 INFO:journalctl@ceph.osd.5.smithi179.stdout:Sep 19 07:31:47 smithi179 podman[74114]: 2024-09-19 07:31:47.145151577 +0000 UTC m=+0.145484425 container create 201d290edb49c1dc96950bdbaeec35ab28a443323c247aa8d54e49c56a70328f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:31:47.414 INFO:journalctl@ceph.osd.5.smithi179.stdout:Sep 19 07:31:47 smithi179 podman[74114]: 2024-09-19 07:31:47.347319531 +0000 UTC m=+0.347652332 container init 201d290edb49c1dc96950bdbaeec35ab28a443323c247aa8d54e49c56a70328f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:31:47.414 INFO:journalctl@ceph.osd.5.smithi179.stdout:Sep 19 07:31:47 smithi179 podman[74114]: 2024-09-19 07:31:47.350497157 +0000 UTC m=+0.350829965 container start 201d290edb49c1dc96950bdbaeec35ab28a443323c247aa8d54e49c56a70328f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:31:47.414 INFO:journalctl@ceph.osd.5.smithi179.stdout:Sep 19 07:31:47 smithi179 podman[74114]: 2024-09-19 07:31:47.413814827 +0000 UTC m=+0.414147633 container attach 201d290edb49c1dc96950bdbaeec35ab28a443323c247aa8d54e49c56a70328f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-19T07:31:47.772 INFO:journalctl@ceph.osd.5.smithi179.stdout:Sep 19 07:31:47 smithi179 podman[74114]: 2024-09-19 07:31:47.539013048 +0000 UTC m=+0.539345861 container died 201d290edb49c1dc96950bdbaeec35ab28a443323c247aa8d54e49c56a70328f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-19T07:31:47.773 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:31:47 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:31:47.420+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.176044+0000 front 2024-09-19T07:31:13.176112+0000 (oldest deadline 2024-09-19T07:31:36.076128+0000) 2024-09-19T07:31:47.773 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:31:47 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:31:47.420+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:16.577263+0000 front 2024-09-19T07:31:16.577228+0000 (oldest deadline 2024-09-19T07:31:42.477389+0000) 2024-09-19T07:31:47.883 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:47 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:47.500+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:31:47.883 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:47 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:47.500+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.515166+0000 front 2024-09-19T07:31:12.515206+0000 (oldest deadline 2024-09-19T07:31:36.615343+0000) 2024-09-19T07:31:47.883 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:47 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:47.500+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:18.316513+0000 front 2024-09-19T07:31:18.316455+0000 (oldest deadline 2024-09-19T07:31:43.616558+0000) 2024-09-19T07:31:48.154 DEBUG:teuthology.orchestra.run.smithi179:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@osd.5.service' 2024-09-19T07:31:48.195 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:31:48.195 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-19T07:31:48.195 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-19T07:31:48.195 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@osd.6 2024-09-19T07:31:48.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:48 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:48.060+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.842153+0000 front 2024-09-19T07:31:02.842300+0000 (oldest deadline 2024-09-19T07:31:28.142247+0000) 2024-09-19T07:31:48.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:48 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:48.060+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:11.543800+0000 front 2024-09-19T07:31:11.543952+0000 (oldest deadline 2024-09-19T07:31:36.243874+0000) 2024-09-19T07:31:48.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:48 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:48.060+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.145101+0000 front 2024-09-19T07:31:19.145035+0000 (oldest deadline 2024-09-19T07:31:43.145546+0000) 2024-09-19T07:31:48.334 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:48 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:48.165+0000 7f269019e640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:01.030364+0000 front 2024-09-19T07:31:01.030407+0000 (oldest deadline 2024-09-19T07:31:30.431021+0000) 2024-09-19T07:31:48.334 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:48 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:48.165+0000 7f269019e640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.133003+0000 front 2024-09-19T07:31:13.132863+0000 (oldest deadline 2024-09-19T07:31:38.433071+0000) 2024-09-19T07:31:48.334 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:48 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:48.165+0000 7f269019e640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:21.334201+0000 front 2024-09-19T07:31:21.334098+0000 (oldest deadline 2024-09-19T07:31:44.234035+0000) 2024-09-19T07:31:48.334 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:48 smithi148 systemd[1]: Stopping Ceph osd.6 for eae8a4a8-7654-11ef-bceb-c7b262605968... 2024-09-19T07:31:48.383 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:31:48 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:31:48.126+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.672336+0000 front 2024-09-19T07:31:13.672274+0000 (oldest deadline 2024-09-19T07:31:39.572492+0000) 2024-09-19T07:31:48.383 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:31:48 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:31:48.126+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.573083+0000 front 2024-09-19T07:31:19.573178+0000 (oldest deadline 2024-09-19T07:31:44.873101+0000) 2024-09-19T07:31:48.395 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:48 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:48.376+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:31:48.395 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:48 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:48.376+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:31:48.395 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:48 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:48.376+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:31:48.772 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:31:48 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:31:48.395+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.176044+0000 front 2024-09-19T07:31:13.176112+0000 (oldest deadline 2024-09-19T07:31:36.076128+0000) 2024-09-19T07:31:48.772 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:31:48 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:31:48.395+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:16.577263+0000 front 2024-09-19T07:31:16.577228+0000 (oldest deadline 2024-09-19T07:31:42.477389+0000) 2024-09-19T07:31:48.836 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:48 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:48.509+0000 7f2697ba1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:31:48.837 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:48 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:48.509+0000 7f2697ba1640 -1 osd.6 110 *** Got signal Terminated *** 2024-09-19T07:31:48.837 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:48 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:48.509+0000 7f2697ba1640 -1 osd.6 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T07:31:48.883 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:48 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:48.488+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:31:48.883 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:48 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:48.488+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.515166+0000 front 2024-09-19T07:31:12.515206+0000 (oldest deadline 2024-09-19T07:31:36.615343+0000) 2024-09-19T07:31:48.883 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:48 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:48.488+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:18.316513+0000 front 2024-09-19T07:31:18.316455+0000 (oldest deadline 2024-09-19T07:31:43.616558+0000) 2024-09-19T07:31:49.333 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:49 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:49.159+0000 7f269019e640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:01.030364+0000 front 2024-09-19T07:31:01.030407+0000 (oldest deadline 2024-09-19T07:31:30.431021+0000) 2024-09-19T07:31:49.333 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:49 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:49.159+0000 7f269019e640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.133003+0000 front 2024-09-19T07:31:13.132863+0000 (oldest deadline 2024-09-19T07:31:38.433071+0000) 2024-09-19T07:31:49.333 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:49 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:49.159+0000 7f269019e640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:21.334201+0000 front 2024-09-19T07:31:21.334098+0000 (oldest deadline 2024-09-19T07:31:44.234035+0000) 2024-09-19T07:31:49.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:49 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:49.017+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.842153+0000 front 2024-09-19T07:31:02.842300+0000 (oldest deadline 2024-09-19T07:31:28.142247+0000) 2024-09-19T07:31:49.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:49 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:49.017+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:11.543800+0000 front 2024-09-19T07:31:11.543952+0000 (oldest deadline 2024-09-19T07:31:36.243874+0000) 2024-09-19T07:31:49.334 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:49 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:49.017+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.145101+0000 front 2024-09-19T07:31:19.145035+0000 (oldest deadline 2024-09-19T07:31:43.145546+0000) 2024-09-19T07:31:49.383 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:31:49 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:31:49.077+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.672336+0000 front 2024-09-19T07:31:13.672274+0000 (oldest deadline 2024-09-19T07:31:39.572492+0000) 2024-09-19T07:31:49.383 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:31:49 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:31:49.077+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.573083+0000 front 2024-09-19T07:31:19.573178+0000 (oldest deadline 2024-09-19T07:31:44.873101+0000) 2024-09-19T07:31:49.772 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:31:49 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:31:49.351+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.176044+0000 front 2024-09-19T07:31:13.176112+0000 (oldest deadline 2024-09-19T07:31:36.076128+0000) 2024-09-19T07:31:49.772 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:31:49 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:31:49.351+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:16.577263+0000 front 2024-09-19T07:31:16.577228+0000 (oldest deadline 2024-09-19T07:31:42.477389+0000) 2024-09-19T07:31:49.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:49 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:49.327+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:31:49.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:49 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:49.327+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:31:49.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:49 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:49.327+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:31:49.883 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:49 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:49.464+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:31:49.884 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:49 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:49.464+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.515166+0000 front 2024-09-19T07:31:12.515206+0000 (oldest deadline 2024-09-19T07:31:36.615343+0000) 2024-09-19T07:31:49.884 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:49 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:49.464+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:18.316513+0000 front 2024-09-19T07:31:18.316455+0000 (oldest deadline 2024-09-19T07:31:43.616558+0000) 2024-09-19T07:31:50.333 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:50 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:50.127+0000 7f269019e640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:01.030364+0000 front 2024-09-19T07:31:01.030407+0000 (oldest deadline 2024-09-19T07:31:30.431021+0000) 2024-09-19T07:31:50.333 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:50 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:50.127+0000 7f269019e640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.133003+0000 front 2024-09-19T07:31:13.132863+0000 (oldest deadline 2024-09-19T07:31:38.433071+0000) 2024-09-19T07:31:50.333 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:50 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:50.127+0000 7f269019e640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:21.334201+0000 front 2024-09-19T07:31:21.334098+0000 (oldest deadline 2024-09-19T07:31:44.234035+0000) 2024-09-19T07:31:50.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:50 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:50.046+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.842153+0000 front 2024-09-19T07:31:02.842300+0000 (oldest deadline 2024-09-19T07:31:28.142247+0000) 2024-09-19T07:31:50.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:50 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:50.046+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:11.543800+0000 front 2024-09-19T07:31:11.543952+0000 (oldest deadline 2024-09-19T07:31:36.243874+0000) 2024-09-19T07:31:50.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:50 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:50.046+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.145101+0000 front 2024-09-19T07:31:19.145035+0000 (oldest deadline 2024-09-19T07:31:43.145546+0000) 2024-09-19T07:31:50.383 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:31:50 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:31:50.050+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.672336+0000 front 2024-09-19T07:31:13.672274+0000 (oldest deadline 2024-09-19T07:31:39.572492+0000) 2024-09-19T07:31:50.383 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:31:50 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:31:50.050+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.573083+0000 front 2024-09-19T07:31:19.573178+0000 (oldest deadline 2024-09-19T07:31:44.873101+0000) 2024-09-19T07:31:50.772 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:31:50 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:31:50.350+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.176044+0000 front 2024-09-19T07:31:13.176112+0000 (oldest deadline 2024-09-19T07:31:36.076128+0000) 2024-09-19T07:31:50.772 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:31:50 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:31:50.350+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:16.577263+0000 front 2024-09-19T07:31:16.577228+0000 (oldest deadline 2024-09-19T07:31:42.477389+0000) 2024-09-19T07:31:50.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:50 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:50.342+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:31:50.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:50 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:50.342+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:31:50.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:50 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:50.342+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:31:50.883 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:50 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:50.472+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:31:50.883 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:50 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:50.472+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.515166+0000 front 2024-09-19T07:31:12.515206+0000 (oldest deadline 2024-09-19T07:31:36.615343+0000) 2024-09-19T07:31:50.883 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:50 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:50.472+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:18.316513+0000 front 2024-09-19T07:31:18.316455+0000 (oldest deadline 2024-09-19T07:31:43.616558+0000) 2024-09-19T07:31:51.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:51 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:51.073+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.842153+0000 front 2024-09-19T07:31:02.842300+0000 (oldest deadline 2024-09-19T07:31:28.142247+0000) 2024-09-19T07:31:51.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:51 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:51.073+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:11.543800+0000 front 2024-09-19T07:31:11.543952+0000 (oldest deadline 2024-09-19T07:31:36.243874+0000) 2024-09-19T07:31:51.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:51 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:51.073+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.145101+0000 front 2024-09-19T07:31:19.145035+0000 (oldest deadline 2024-09-19T07:31:43.145546+0000) 2024-09-19T07:31:51.334 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:51 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:51.144+0000 7f269019e640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:01.030364+0000 front 2024-09-19T07:31:01.030407+0000 (oldest deadline 2024-09-19T07:31:30.431021+0000) 2024-09-19T07:31:51.334 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:51 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:51.144+0000 7f269019e640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.133003+0000 front 2024-09-19T07:31:13.132863+0000 (oldest deadline 2024-09-19T07:31:38.433071+0000) 2024-09-19T07:31:51.334 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:51 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:51.144+0000 7f269019e640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:21.334201+0000 front 2024-09-19T07:31:21.334098+0000 (oldest deadline 2024-09-19T07:31:44.234035+0000) 2024-09-19T07:31:51.334 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:51 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:51.144+0000 7f269019e640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:27.734954+0000 front 2024-09-19T07:31:27.735033+0000 (oldest deadline 2024-09-19T07:31:50.635067+0000) 2024-09-19T07:31:51.383 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:31:51 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:31:51.081+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.672336+0000 front 2024-09-19T07:31:13.672274+0000 (oldest deadline 2024-09-19T07:31:39.572492+0000) 2024-09-19T07:31:51.383 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:31:51 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:31:51.081+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.573083+0000 front 2024-09-19T07:31:19.573178+0000 (oldest deadline 2024-09-19T07:31:44.873101+0000) 2024-09-19T07:31:51.774 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:31:51 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:31:51.364+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.176044+0000 front 2024-09-19T07:31:13.176112+0000 (oldest deadline 2024-09-19T07:31:36.076128+0000) 2024-09-19T07:31:51.774 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:31:51 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:31:51.364+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:16.577263+0000 front 2024-09-19T07:31:16.577228+0000 (oldest deadline 2024-09-19T07:31:42.477389+0000) 2024-09-19T07:31:51.775 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:51 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:51.351+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:31:51.775 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:51 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:51.351+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:31:51.775 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:51 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:51.351+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:31:51.883 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:51 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:51.443+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:31:51.884 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:51 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:51.443+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.515166+0000 front 2024-09-19T07:31:12.515206+0000 (oldest deadline 2024-09-19T07:31:36.615343+0000) 2024-09-19T07:31:51.884 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:51 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:51.443+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:18.316513+0000 front 2024-09-19T07:31:18.316455+0000 (oldest deadline 2024-09-19T07:31:43.616558+0000) 2024-09-19T07:31:51.884 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:51 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:51.443+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:27.518740+0000 front 2024-09-19T07:31:27.518782+0000 (oldest deadline 2024-09-19T07:31:51.018670+0000) 2024-09-19T07:31:52.383 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:31:52 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:31:52.117+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.672336+0000 front 2024-09-19T07:31:13.672274+0000 (oldest deadline 2024-09-19T07:31:39.572492+0000) 2024-09-19T07:31:52.383 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:31:52 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:31:52.117+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.573083+0000 front 2024-09-19T07:31:19.573178+0000 (oldest deadline 2024-09-19T07:31:44.873101+0000) 2024-09-19T07:31:52.383 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:31:52 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:31:52.117+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:24.873530+0000 front 2024-09-19T07:31:24.873680+0000 (oldest deadline 2024-09-19T07:31:51.874117+0000) 2024-09-19T07:31:52.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:52 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:52.108+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.842153+0000 front 2024-09-19T07:31:02.842300+0000 (oldest deadline 2024-09-19T07:31:28.142247+0000) 2024-09-19T07:31:52.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:52 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:52.108+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:11.543800+0000 front 2024-09-19T07:31:11.543952+0000 (oldest deadline 2024-09-19T07:31:36.243874+0000) 2024-09-19T07:31:52.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:52 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:52.108+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.145101+0000 front 2024-09-19T07:31:19.145035+0000 (oldest deadline 2024-09-19T07:31:43.145546+0000) 2024-09-19T07:31:52.583 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:52 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:52.121+0000 7f269019e640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:01.030364+0000 front 2024-09-19T07:31:01.030407+0000 (oldest deadline 2024-09-19T07:31:30.431021+0000) 2024-09-19T07:31:52.583 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:52 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:52.121+0000 7f269019e640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.133003+0000 front 2024-09-19T07:31:13.132863+0000 (oldest deadline 2024-09-19T07:31:38.433071+0000) 2024-09-19T07:31:52.584 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:52 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:52.121+0000 7f269019e640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:21.334201+0000 front 2024-09-19T07:31:21.334098+0000 (oldest deadline 2024-09-19T07:31:44.234035+0000) 2024-09-19T07:31:52.584 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:52 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:52.121+0000 7f269019e640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:27.734954+0000 front 2024-09-19T07:31:27.735033+0000 (oldest deadline 2024-09-19T07:31:50.635067+0000) 2024-09-19T07:31:52.772 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:31:52 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:31:52.382+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.176044+0000 front 2024-09-19T07:31:13.176112+0000 (oldest deadline 2024-09-19T07:31:36.076128+0000) 2024-09-19T07:31:52.772 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:31:52 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:31:52.382+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:16.577263+0000 front 2024-09-19T07:31:16.577228+0000 (oldest deadline 2024-09-19T07:31:42.477389+0000) 2024-09-19T07:31:52.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:52 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:52.345+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:31:52.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:52 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:52.345+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:31:52.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:52 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:52.345+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:31:52.883 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:52 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:52.441+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:31:52.884 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:52 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:52.441+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.515166+0000 front 2024-09-19T07:31:12.515206+0000 (oldest deadline 2024-09-19T07:31:36.615343+0000) 2024-09-19T07:31:52.884 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:52 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:52.441+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:18.316513+0000 front 2024-09-19T07:31:18.316455+0000 (oldest deadline 2024-09-19T07:31:43.616558+0000) 2024-09-19T07:31:52.884 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:52 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:52.441+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:27.518740+0000 front 2024-09-19T07:31:27.518782+0000 (oldest deadline 2024-09-19T07:31:51.018670+0000) 2024-09-19T07:31:53.383 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:31:53 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:31:53.072+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.672336+0000 front 2024-09-19T07:31:13.672274+0000 (oldest deadline 2024-09-19T07:31:39.572492+0000) 2024-09-19T07:31:53.383 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:31:53 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:31:53.072+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.573083+0000 front 2024-09-19T07:31:19.573178+0000 (oldest deadline 2024-09-19T07:31:44.873101+0000) 2024-09-19T07:31:53.383 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:31:53 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:31:53.072+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:24.873530+0000 front 2024-09-19T07:31:24.873680+0000 (oldest deadline 2024-09-19T07:31:51.874117+0000) 2024-09-19T07:31:53.583 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:53 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:53.138+0000 7f269019e640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:01.030364+0000 front 2024-09-19T07:31:01.030407+0000 (oldest deadline 2024-09-19T07:31:30.431021+0000) 2024-09-19T07:31:53.583 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:53 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:53.138+0000 7f269019e640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.133003+0000 front 2024-09-19T07:31:13.132863+0000 (oldest deadline 2024-09-19T07:31:38.433071+0000) 2024-09-19T07:31:53.583 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:53 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:53.138+0000 7f269019e640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:21.334201+0000 front 2024-09-19T07:31:21.334098+0000 (oldest deadline 2024-09-19T07:31:44.234035+0000) 2024-09-19T07:31:53.583 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:53 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6[55615]: 2024-09-19T07:31:53.138+0000 7f269019e640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:27.734954+0000 front 2024-09-19T07:31:27.735033+0000 (oldest deadline 2024-09-19T07:31:50.635067+0000) 2024-09-19T07:31:53.584 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:53 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:53.110+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.842153+0000 front 2024-09-19T07:31:02.842300+0000 (oldest deadline 2024-09-19T07:31:28.142247+0000) 2024-09-19T07:31:53.584 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:53 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:53.110+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:11.543800+0000 front 2024-09-19T07:31:11.543952+0000 (oldest deadline 2024-09-19T07:31:36.243874+0000) 2024-09-19T07:31:53.584 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:53 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:53.110+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.145101+0000 front 2024-09-19T07:31:19.145035+0000 (oldest deadline 2024-09-19T07:31:43.145546+0000) 2024-09-19T07:31:53.584 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:53 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:53.110+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:28.347129+0000 front 2024-09-19T07:31:28.347192+0000 (oldest deadline 2024-09-19T07:31:52.447192+0000) 2024-09-19T07:31:53.772 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:31:53 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:31:53.425+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.176044+0000 front 2024-09-19T07:31:13.176112+0000 (oldest deadline 2024-09-19T07:31:36.076128+0000) 2024-09-19T07:31:53.772 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:31:53 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:31:53.425+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:16.577263+0000 front 2024-09-19T07:31:16.577228+0000 (oldest deadline 2024-09-19T07:31:42.477389+0000) 2024-09-19T07:31:53.772 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:31:53 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:31:53.425+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:28.080275+0000 front 2024-09-19T07:31:28.080121+0000 (oldest deadline 2024-09-19T07:31:52.780155+0000) 2024-09-19T07:31:53.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:53 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:53.378+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:31:53.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:53 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:53.378+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:31:53.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:53 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:53.378+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:31:53.883 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:53 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:53.456+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:31:53.883 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:53 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:53.456+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.515166+0000 front 2024-09-19T07:31:12.515206+0000 (oldest deadline 2024-09-19T07:31:36.615343+0000) 2024-09-19T07:31:53.884 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:53 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:53.456+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:18.316513+0000 front 2024-09-19T07:31:18.316455+0000 (oldest deadline 2024-09-19T07:31:43.616558+0000) 2024-09-19T07:31:53.884 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:53 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:53.456+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:27.518740+0000 front 2024-09-19T07:31:27.518782+0000 (oldest deadline 2024-09-19T07:31:51.018670+0000) 2024-09-19T07:31:54.383 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:31:54 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:31:54.089+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.672336+0000 front 2024-09-19T07:31:13.672274+0000 (oldest deadline 2024-09-19T07:31:39.572492+0000) 2024-09-19T07:31:54.384 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:31:54 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:31:54.089+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.573083+0000 front 2024-09-19T07:31:19.573178+0000 (oldest deadline 2024-09-19T07:31:44.873101+0000) 2024-09-19T07:31:54.384 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:31:54 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:31:54.089+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:24.873530+0000 front 2024-09-19T07:31:24.873680+0000 (oldest deadline 2024-09-19T07:31:51.874117+0000) 2024-09-19T07:31:54.427 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:54 smithi148 podman[108171]: 2024-09-19 07:31:54.164896644 +0000 UTC m=+5.760532923 container died 956c02145633cdbb93e01facabb5b461de8e33bf3f5a298371d247b73f96a456 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-19T07:31:54.427 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:54 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:54.096+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.842153+0000 front 2024-09-19T07:31:02.842300+0000 (oldest deadline 2024-09-19T07:31:28.142247+0000) 2024-09-19T07:31:54.428 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:54 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:54.096+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:11.543800+0000 front 2024-09-19T07:31:11.543952+0000 (oldest deadline 2024-09-19T07:31:36.243874+0000) 2024-09-19T07:31:54.428 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:54 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:54.096+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.145101+0000 front 2024-09-19T07:31:19.145035+0000 (oldest deadline 2024-09-19T07:31:43.145546+0000) 2024-09-19T07:31:54.428 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:54 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:54.096+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:28.347129+0000 front 2024-09-19T07:31:28.347192+0000 (oldest deadline 2024-09-19T07:31:52.447192+0000) 2024-09-19T07:31:54.772 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:31:54 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:31:54.400+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.176044+0000 front 2024-09-19T07:31:13.176112+0000 (oldest deadline 2024-09-19T07:31:36.076128+0000) 2024-09-19T07:31:54.772 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:31:54 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:31:54.400+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:16.577263+0000 front 2024-09-19T07:31:16.577228+0000 (oldest deadline 2024-09-19T07:31:42.477389+0000) 2024-09-19T07:31:54.772 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:31:54 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:31:54.400+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:28.080275+0000 front 2024-09-19T07:31:28.080121+0000 (oldest deadline 2024-09-19T07:31:52.780155+0000) 2024-09-19T07:31:54.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:54 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:54.408+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:31:54.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:54 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:54.408+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:31:54.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:54 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:54.408+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:31:54.833 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:54 smithi148 podman[108171]: 2024-09-19 07:31:54.609924509 +0000 UTC m=+6.205560788 container cleanup 956c02145633cdbb93e01facabb5b461de8e33bf3f5a298371d247b73f96a456 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-19T07:31:54.833 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:54 smithi148 bash[108171]: ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6 2024-09-19T07:31:54.883 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:54 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:54.442+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:31:54.883 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:54 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:54.442+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.515166+0000 front 2024-09-19T07:31:12.515206+0000 (oldest deadline 2024-09-19T07:31:36.615343+0000) 2024-09-19T07:31:54.883 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:54 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:54.442+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:18.316513+0000 front 2024-09-19T07:31:18.316455+0000 (oldest deadline 2024-09-19T07:31:43.616558+0000) 2024-09-19T07:31:54.883 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:54 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:54.442+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:27.518740+0000 front 2024-09-19T07:31:27.518782+0000 (oldest deadline 2024-09-19T07:31:51.018670+0000) 2024-09-19T07:31:55.269 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:54 smithi148 podman[108198]: 2024-09-19 07:31:54.920126122 +0000 UTC m=+0.753948785 container remove 956c02145633cdbb93e01facabb5b461de8e33bf3f5a298371d247b73f96a456 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-19T07:31:55.269 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:55 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:55.052+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.842153+0000 front 2024-09-19T07:31:02.842300+0000 (oldest deadline 2024-09-19T07:31:28.142247+0000) 2024-09-19T07:31:55.269 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:55 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:55.052+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:11.543800+0000 front 2024-09-19T07:31:11.543952+0000 (oldest deadline 2024-09-19T07:31:36.243874+0000) 2024-09-19T07:31:55.269 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:55 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:55.052+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.145101+0000 front 2024-09-19T07:31:19.145035+0000 (oldest deadline 2024-09-19T07:31:43.145546+0000) 2024-09-19T07:31:55.269 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:55 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:55.052+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:28.347129+0000 front 2024-09-19T07:31:28.347192+0000 (oldest deadline 2024-09-19T07:31:52.447192+0000) 2024-09-19T07:31:55.383 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:31:55 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:31:55.101+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.672336+0000 front 2024-09-19T07:31:13.672274+0000 (oldest deadline 2024-09-19T07:31:39.572492+0000) 2024-09-19T07:31:55.383 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:31:55 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:31:55.101+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.573083+0000 front 2024-09-19T07:31:19.573178+0000 (oldest deadline 2024-09-19T07:31:44.873101+0000) 2024-09-19T07:31:55.383 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:31:55 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:31:55.101+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:24.873530+0000 front 2024-09-19T07:31:24.873680+0000 (oldest deadline 2024-09-19T07:31:51.874117+0000) 2024-09-19T07:31:55.531 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:55 smithi148 podman[108288]: 2024-09-19 07:31:55.172467228 +0000 UTC m=+0.016504751 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:31:55.531 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:55 smithi148 podman[108288]: 2024-09-19 07:31:55.296806362 +0000 UTC m=+0.140843939 container create 4773d81f19ecddd9af94fcc29102811244e77ebdf8496968f4c245532aba98df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-19T07:31:55.531 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:55 smithi148 podman[108288]: 2024-09-19 07:31:55.531502339 +0000 UTC m=+0.375539857 container init 4773d81f19ecddd9af94fcc29102811244e77ebdf8496968f4c245532aba98df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-19T07:31:55.772 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:31:55 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:31:55.425+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.176044+0000 front 2024-09-19T07:31:13.176112+0000 (oldest deadline 2024-09-19T07:31:36.076128+0000) 2024-09-19T07:31:55.772 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:31:55 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:31:55.425+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:16.577263+0000 front 2024-09-19T07:31:16.577228+0000 (oldest deadline 2024-09-19T07:31:42.477389+0000) 2024-09-19T07:31:55.772 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:31:55 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:31:55.425+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:28.080275+0000 front 2024-09-19T07:31:28.080121+0000 (oldest deadline 2024-09-19T07:31:52.780155+0000) 2024-09-19T07:31:55.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:55 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:55.382+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:31:55.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:55 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:55.382+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:31:55.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:55 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:55.382+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:31:55.833 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:55 smithi148 podman[108288]: 2024-09-19 07:31:55.534943063 +0000 UTC m=+0.378980578 container start 4773d81f19ecddd9af94fcc29102811244e77ebdf8496968f4c245532aba98df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True) 2024-09-19T07:31:55.833 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:55 smithi148 podman[108288]: 2024-09-19 07:31:55.614911242 +0000 UTC m=+0.458948775 container attach 4773d81f19ecddd9af94fcc29102811244e77ebdf8496968f4c245532aba98df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-19T07:31:55.833 INFO:journalctl@ceph.osd.6.smithi148.stdout:Sep 19 07:31:55 smithi148 podman[108288]: 2024-09-19 07:31:55.732280056 +0000 UTC m=+0.576317581 container died 4773d81f19ecddd9af94fcc29102811244e77ebdf8496968f4c245532aba98df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-19T07:31:55.883 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:55 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:55.437+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:31:55.883 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:55 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:55.437+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.515166+0000 front 2024-09-19T07:31:12.515206+0000 (oldest deadline 2024-09-19T07:31:36.615343+0000) 2024-09-19T07:31:55.883 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:55 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:55.437+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:18.316513+0000 front 2024-09-19T07:31:18.316455+0000 (oldest deadline 2024-09-19T07:31:43.616558+0000) 2024-09-19T07:31:55.883 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:55 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:55.437+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:27.518740+0000 front 2024-09-19T07:31:27.518782+0000 (oldest deadline 2024-09-19T07:31:51.018670+0000) 2024-09-19T07:31:56.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:56 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:56.063+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.842153+0000 front 2024-09-19T07:31:02.842300+0000 (oldest deadline 2024-09-19T07:31:28.142247+0000) 2024-09-19T07:31:56.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:56 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:56.063+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:11.543800+0000 front 2024-09-19T07:31:11.543952+0000 (oldest deadline 2024-09-19T07:31:36.243874+0000) 2024-09-19T07:31:56.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:56 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:56.063+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.145101+0000 front 2024-09-19T07:31:19.145035+0000 (oldest deadline 2024-09-19T07:31:43.145546+0000) 2024-09-19T07:31:56.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:56 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:56.063+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:28.347129+0000 front 2024-09-19T07:31:28.347192+0000 (oldest deadline 2024-09-19T07:31:52.447192+0000) 2024-09-19T07:31:56.383 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:31:56 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:31:56.113+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.672336+0000 front 2024-09-19T07:31:13.672274+0000 (oldest deadline 2024-09-19T07:31:39.572492+0000) 2024-09-19T07:31:56.383 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:31:56 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:31:56.113+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.573083+0000 front 2024-09-19T07:31:19.573178+0000 (oldest deadline 2024-09-19T07:31:44.873101+0000) 2024-09-19T07:31:56.384 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:31:56 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:31:56.113+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:24.873530+0000 front 2024-09-19T07:31:24.873680+0000 (oldest deadline 2024-09-19T07:31:51.874117+0000) 2024-09-19T07:31:56.441 DEBUG:teuthology.orchestra.run.smithi148:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@osd.6.service' 2024-09-19T07:31:56.481 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:31:56.481 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-19T07:31:56.481 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-19T07:31:56.482 DEBUG:teuthology.orchestra.run.smithi165:> sudo systemctl stop ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@osd.7 2024-09-19T07:31:56.772 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:31:56 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:31:56.439+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.176044+0000 front 2024-09-19T07:31:13.176112+0000 (oldest deadline 2024-09-19T07:31:36.076128+0000) 2024-09-19T07:31:56.772 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:31:56 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:31:56.439+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:16.577263+0000 front 2024-09-19T07:31:16.577228+0000 (oldest deadline 2024-09-19T07:31:42.477389+0000) 2024-09-19T07:31:56.772 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:31:56 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:31:56.439+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:28.080275+0000 front 2024-09-19T07:31:28.080121+0000 (oldest deadline 2024-09-19T07:31:52.780155+0000) 2024-09-19T07:31:56.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:56 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:56.427+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:31:56.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:56 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:56.427+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:31:56.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:56 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:56.427+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:31:56.796 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:31:56 smithi165 systemd[1]: Stopping Ceph osd.7 for eae8a4a8-7654-11ef-bceb-c7b262605968... 2024-09-19T07:31:56.796 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:56 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:56.422+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:31:56.796 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:56 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:56.422+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.515166+0000 front 2024-09-19T07:31:12.515206+0000 (oldest deadline 2024-09-19T07:31:36.615343+0000) 2024-09-19T07:31:56.796 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:56 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:56.422+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:18.316513+0000 front 2024-09-19T07:31:18.316455+0000 (oldest deadline 2024-09-19T07:31:43.616558+0000) 2024-09-19T07:31:56.797 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:56 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:56.422+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:27.518740+0000 front 2024-09-19T07:31:27.518782+0000 (oldest deadline 2024-09-19T07:31:51.018670+0000) 2024-09-19T07:31:57.069 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:31:56 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:31:56.795+0000 7f911d9f8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:31:57.069 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:31:56 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:31:56.795+0000 7f911d9f8640 -1 osd.7 110 *** Got signal Terminated *** 2024-09-19T07:31:57.070 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:31:56 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:31:56.795+0000 7f911d9f8640 -1 osd.7 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T07:31:57.070 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:31:57 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:31:57.069+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.672336+0000 front 2024-09-19T07:31:13.672274+0000 (oldest deadline 2024-09-19T07:31:39.572492+0000) 2024-09-19T07:31:57.070 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:31:57 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:31:57.069+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.573083+0000 front 2024-09-19T07:31:19.573178+0000 (oldest deadline 2024-09-19T07:31:44.873101+0000) 2024-09-19T07:31:57.070 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:31:57 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:31:57.069+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:24.873530+0000 front 2024-09-19T07:31:24.873680+0000 (oldest deadline 2024-09-19T07:31:51.874117+0000) 2024-09-19T07:31:57.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:57 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:57.077+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.842153+0000 front 2024-09-19T07:31:02.842300+0000 (oldest deadline 2024-09-19T07:31:28.142247+0000) 2024-09-19T07:31:57.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:57 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:57.077+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:11.543800+0000 front 2024-09-19T07:31:11.543952+0000 (oldest deadline 2024-09-19T07:31:36.243874+0000) 2024-09-19T07:31:57.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:57 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:57.077+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.145101+0000 front 2024-09-19T07:31:19.145035+0000 (oldest deadline 2024-09-19T07:31:43.145546+0000) 2024-09-19T07:31:57.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:57 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:57.077+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:28.347129+0000 front 2024-09-19T07:31:28.347192+0000 (oldest deadline 2024-09-19T07:31:52.447192+0000) 2024-09-19T07:31:57.772 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:31:57 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:31:57.488+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.176044+0000 front 2024-09-19T07:31:13.176112+0000 (oldest deadline 2024-09-19T07:31:36.076128+0000) 2024-09-19T07:31:57.772 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:31:57 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:31:57.488+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:16.577263+0000 front 2024-09-19T07:31:16.577228+0000 (oldest deadline 2024-09-19T07:31:42.477389+0000) 2024-09-19T07:31:57.772 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:31:57 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:31:57.488+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:28.080275+0000 front 2024-09-19T07:31:28.080121+0000 (oldest deadline 2024-09-19T07:31:52.780155+0000) 2024-09-19T07:31:57.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:57 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:57.434+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:31:57.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:57 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:57.434+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:31:57.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:57 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:57.434+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:31:57.883 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:57 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:57.424+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:31:57.883 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:57 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:57.424+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.515166+0000 front 2024-09-19T07:31:12.515206+0000 (oldest deadline 2024-09-19T07:31:36.615343+0000) 2024-09-19T07:31:57.884 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:57 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:57.424+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:18.316513+0000 front 2024-09-19T07:31:18.316455+0000 (oldest deadline 2024-09-19T07:31:43.616558+0000) 2024-09-19T07:31:57.884 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:57 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:57.424+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:27.518740+0000 front 2024-09-19T07:31:27.518782+0000 (oldest deadline 2024-09-19T07:31:51.018670+0000) 2024-09-19T07:31:58.380 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:31:58 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:31:58.054+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.672336+0000 front 2024-09-19T07:31:13.672274+0000 (oldest deadline 2024-09-19T07:31:39.572492+0000) 2024-09-19T07:31:58.380 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:31:58 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:31:58.054+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.573083+0000 front 2024-09-19T07:31:19.573178+0000 (oldest deadline 2024-09-19T07:31:44.873101+0000) 2024-09-19T07:31:58.381 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:31:58 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:31:58.054+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:24.873530+0000 front 2024-09-19T07:31:24.873680+0000 (oldest deadline 2024-09-19T07:31:51.874117+0000) 2024-09-19T07:31:58.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:58 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:58.125+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.842153+0000 front 2024-09-19T07:31:02.842300+0000 (oldest deadline 2024-09-19T07:31:28.142247+0000) 2024-09-19T07:31:58.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:58 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:58.125+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:11.543800+0000 front 2024-09-19T07:31:11.543952+0000 (oldest deadline 2024-09-19T07:31:36.243874+0000) 2024-09-19T07:31:58.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:58 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:58.125+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.145101+0000 front 2024-09-19T07:31:19.145035+0000 (oldest deadline 2024-09-19T07:31:43.145546+0000) 2024-09-19T07:31:58.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:58 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:58.125+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:28.347129+0000 front 2024-09-19T07:31:28.347192+0000 (oldest deadline 2024-09-19T07:31:52.447192+0000) 2024-09-19T07:31:58.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:58 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:58.380+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:31:58.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:58 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:58.380+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.515166+0000 front 2024-09-19T07:31:12.515206+0000 (oldest deadline 2024-09-19T07:31:36.615343+0000) 2024-09-19T07:31:58.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:58 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:58.380+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:18.316513+0000 front 2024-09-19T07:31:18.316455+0000 (oldest deadline 2024-09-19T07:31:43.616558+0000) 2024-09-19T07:31:58.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:58 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:58.380+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:27.518740+0000 front 2024-09-19T07:31:27.518782+0000 (oldest deadline 2024-09-19T07:31:51.018670+0000) 2024-09-19T07:31:58.772 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:31:58 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:31:58.457+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.176044+0000 front 2024-09-19T07:31:13.176112+0000 (oldest deadline 2024-09-19T07:31:36.076128+0000) 2024-09-19T07:31:58.772 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:31:58 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:31:58.457+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:16.577263+0000 front 2024-09-19T07:31:16.577228+0000 (oldest deadline 2024-09-19T07:31:42.477389+0000) 2024-09-19T07:31:58.772 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:31:58 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:31:58.457+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:28.080275+0000 front 2024-09-19T07:31:28.080121+0000 (oldest deadline 2024-09-19T07:31:52.780155+0000) 2024-09-19T07:31:58.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:58 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:58.484+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:31:58.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:58 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:58.484+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:31:58.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:58 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:58.484+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:31:59.362 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:31:59 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:31:59.010+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.672336+0000 front 2024-09-19T07:31:13.672274+0000 (oldest deadline 2024-09-19T07:31:39.572492+0000) 2024-09-19T07:31:59.362 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:31:59 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:31:59.010+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.573083+0000 front 2024-09-19T07:31:19.573178+0000 (oldest deadline 2024-09-19T07:31:44.873101+0000) 2024-09-19T07:31:59.362 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:31:59 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:31:59.010+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:24.873530+0000 front 2024-09-19T07:31:24.873680+0000 (oldest deadline 2024-09-19T07:31:51.874117+0000) 2024-09-19T07:31:59.362 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:31:59 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:31:59.010+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.575099+0000 front 2024-09-19T07:31:36.575122+0000 (oldest deadline 2024-09-19T07:31:58.275349+0000) 2024-09-19T07:31:59.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:59 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:59.109+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.842153+0000 front 2024-09-19T07:31:02.842300+0000 (oldest deadline 2024-09-19T07:31:28.142247+0000) 2024-09-19T07:31:59.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:59 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:59.109+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:11.543800+0000 front 2024-09-19T07:31:11.543952+0000 (oldest deadline 2024-09-19T07:31:36.243874+0000) 2024-09-19T07:31:59.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:59 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:59.109+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.145101+0000 front 2024-09-19T07:31:19.145035+0000 (oldest deadline 2024-09-19T07:31:43.145546+0000) 2024-09-19T07:31:59.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:31:59 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:31:59.109+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:28.347129+0000 front 2024-09-19T07:31:28.347192+0000 (oldest deadline 2024-09-19T07:31:52.447192+0000) 2024-09-19T07:31:59.617 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:59 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:59.361+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:31:59.618 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:59 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:59.361+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.515166+0000 front 2024-09-19T07:31:12.515206+0000 (oldest deadline 2024-09-19T07:31:36.615343+0000) 2024-09-19T07:31:59.618 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:59 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:59.361+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:18.316513+0000 front 2024-09-19T07:31:18.316455+0000 (oldest deadline 2024-09-19T07:31:43.616558+0000) 2024-09-19T07:31:59.618 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:31:59 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:31:59.361+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:27.518740+0000 front 2024-09-19T07:31:27.518782+0000 (oldest deadline 2024-09-19T07:31:51.018670+0000) 2024-09-19T07:31:59.772 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:31:59 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:31:59.471+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.176044+0000 front 2024-09-19T07:31:13.176112+0000 (oldest deadline 2024-09-19T07:31:36.076128+0000) 2024-09-19T07:31:59.772 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:31:59 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:31:59.471+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:16.577263+0000 front 2024-09-19T07:31:16.577228+0000 (oldest deadline 2024-09-19T07:31:42.477389+0000) 2024-09-19T07:31:59.772 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:31:59 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:31:59.471+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:28.080275+0000 front 2024-09-19T07:31:28.080121+0000 (oldest deadline 2024-09-19T07:31:52.780155+0000) 2024-09-19T07:31:59.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:59 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:59.494+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:31:59.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:59 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:59.494+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:31:59.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:31:59 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:31:59.494+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:32:00.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:00 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:00.078+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.842153+0000 front 2024-09-19T07:31:02.842300+0000 (oldest deadline 2024-09-19T07:31:28.142247+0000) 2024-09-19T07:32:00.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:00 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:00.078+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:11.543800+0000 front 2024-09-19T07:31:11.543952+0000 (oldest deadline 2024-09-19T07:31:36.243874+0000) 2024-09-19T07:32:00.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:00 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:00.078+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.145101+0000 front 2024-09-19T07:31:19.145035+0000 (oldest deadline 2024-09-19T07:31:43.145546+0000) 2024-09-19T07:32:00.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:00 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:00.078+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:28.347129+0000 front 2024-09-19T07:31:28.347192+0000 (oldest deadline 2024-09-19T07:31:52.447192+0000) 2024-09-19T07:32:00.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:00 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:00.078+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.348886+0000 front 2024-09-19T07:31:36.348871+0000 (oldest deadline 2024-09-19T07:31:59.248549+0000) 2024-09-19T07:32:00.383 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:32:00 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:32:00.024+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.672336+0000 front 2024-09-19T07:31:13.672274+0000 (oldest deadline 2024-09-19T07:31:39.572492+0000) 2024-09-19T07:32:00.384 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:32:00 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:32:00.024+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.573083+0000 front 2024-09-19T07:31:19.573178+0000 (oldest deadline 2024-09-19T07:31:44.873101+0000) 2024-09-19T07:32:00.384 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:32:00 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:32:00.024+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:24.873530+0000 front 2024-09-19T07:31:24.873680+0000 (oldest deadline 2024-09-19T07:31:51.874117+0000) 2024-09-19T07:32:00.384 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:32:00 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:32:00.024+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.575099+0000 front 2024-09-19T07:31:36.575122+0000 (oldest deadline 2024-09-19T07:31:58.275349+0000) 2024-09-19T07:32:00.772 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:00 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:32:00.434+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.176044+0000 front 2024-09-19T07:31:13.176112+0000 (oldest deadline 2024-09-19T07:31:36.076128+0000) 2024-09-19T07:32:00.772 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:00 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:32:00.434+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:16.577263+0000 front 2024-09-19T07:31:16.577228+0000 (oldest deadline 2024-09-19T07:31:42.477389+0000) 2024-09-19T07:32:00.772 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:00 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:32:00.434+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:28.080275+0000 front 2024-09-19T07:31:28.080121+0000 (oldest deadline 2024-09-19T07:31:52.780155+0000) 2024-09-19T07:32:00.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:00 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:00.495+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:32:00.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:00 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:00.495+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:32:00.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:00 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:00.495+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:32:00.883 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:00 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:00.410+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:32:00.884 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:00 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:00.410+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.515166+0000 front 2024-09-19T07:31:12.515206+0000 (oldest deadline 2024-09-19T07:31:36.615343+0000) 2024-09-19T07:32:00.884 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:00 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:00.410+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:18.316513+0000 front 2024-09-19T07:31:18.316455+0000 (oldest deadline 2024-09-19T07:31:43.616558+0000) 2024-09-19T07:32:00.884 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:00 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:00.410+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:27.518740+0000 front 2024-09-19T07:31:27.518782+0000 (oldest deadline 2024-09-19T07:31:51.018670+0000) 2024-09-19T07:32:00.884 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:00 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:00.410+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:37.419876+0000 front 2024-09-19T07:31:37.419797+0000 (oldest deadline 2024-09-19T07:32:00.319962+0000) 2024-09-19T07:32:01.375 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:01 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:01.374+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:32:01.376 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:01 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:01.374+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.515166+0000 front 2024-09-19T07:31:12.515206+0000 (oldest deadline 2024-09-19T07:31:36.615343+0000) 2024-09-19T07:32:01.376 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:01 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:01.375+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:18.316513+0000 front 2024-09-19T07:31:18.316455+0000 (oldest deadline 2024-09-19T07:31:43.616558+0000) 2024-09-19T07:32:01.376 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:32:01 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:32:01.003+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.672336+0000 front 2024-09-19T07:31:13.672274+0000 (oldest deadline 2024-09-19T07:31:39.572492+0000) 2024-09-19T07:32:01.376 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:32:01 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:32:01.003+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.573083+0000 front 2024-09-19T07:31:19.573178+0000 (oldest deadline 2024-09-19T07:31:44.873101+0000) 2024-09-19T07:32:01.376 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:32:01 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:32:01.003+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:24.873530+0000 front 2024-09-19T07:31:24.873680+0000 (oldest deadline 2024-09-19T07:31:51.874117+0000) 2024-09-19T07:32:01.376 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:32:01 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7[53328]: 2024-09-19T07:32:01.003+0000 7f9115ff5640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.575099+0000 front 2024-09-19T07:31:36.575122+0000 (oldest deadline 2024-09-19T07:31:58.275349+0000) 2024-09-19T07:32:01.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:01 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:01.088+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.842153+0000 front 2024-09-19T07:31:02.842300+0000 (oldest deadline 2024-09-19T07:31:28.142247+0000) 2024-09-19T07:32:01.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:01 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:01.088+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:11.543800+0000 front 2024-09-19T07:31:11.543952+0000 (oldest deadline 2024-09-19T07:31:36.243874+0000) 2024-09-19T07:32:01.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:01 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:01.088+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.145101+0000 front 2024-09-19T07:31:19.145035+0000 (oldest deadline 2024-09-19T07:31:43.145546+0000) 2024-09-19T07:32:01.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:01 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:01.088+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:28.347129+0000 front 2024-09-19T07:31:28.347192+0000 (oldest deadline 2024-09-19T07:31:52.447192+0000) 2024-09-19T07:32:01.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:01 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:01.088+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.348886+0000 front 2024-09-19T07:31:36.348871+0000 (oldest deadline 2024-09-19T07:31:59.248549+0000) 2024-09-19T07:32:01.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:01 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:01.375+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:27.518740+0000 front 2024-09-19T07:31:27.518782+0000 (oldest deadline 2024-09-19T07:31:51.018670+0000) 2024-09-19T07:32:01.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:01 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:01.375+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:37.419876+0000 front 2024-09-19T07:31:37.419797+0000 (oldest deadline 2024-09-19T07:32:00.319962+0000) 2024-09-19T07:32:01.673 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:01 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:32:01.399+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.176044+0000 front 2024-09-19T07:31:13.176112+0000 (oldest deadline 2024-09-19T07:31:36.076128+0000) 2024-09-19T07:32:01.673 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:01 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:32:01.399+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:16.577263+0000 front 2024-09-19T07:31:16.577228+0000 (oldest deadline 2024-09-19T07:31:42.477389+0000) 2024-09-19T07:32:01.674 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:01 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:32:01.399+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:28.080275+0000 front 2024-09-19T07:31:28.080121+0000 (oldest deadline 2024-09-19T07:31:52.780155+0000) 2024-09-19T07:32:01.674 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:01 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:01.454+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:32:01.674 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:01 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:01.454+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:32:01.674 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:01 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:01.454+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:32:02.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:02 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:02.065+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.842153+0000 front 2024-09-19T07:31:02.842300+0000 (oldest deadline 2024-09-19T07:31:28.142247+0000) 2024-09-19T07:32:02.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:02 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:02.065+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:11.543800+0000 front 2024-09-19T07:31:11.543952+0000 (oldest deadline 2024-09-19T07:31:36.243874+0000) 2024-09-19T07:32:02.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:02 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:02.065+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.145101+0000 front 2024-09-19T07:31:19.145035+0000 (oldest deadline 2024-09-19T07:31:43.145546+0000) 2024-09-19T07:32:02.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:02 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:02.065+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:28.347129+0000 front 2024-09-19T07:31:28.347192+0000 (oldest deadline 2024-09-19T07:31:52.447192+0000) 2024-09-19T07:32:02.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:02 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:02.065+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.348886+0000 front 2024-09-19T07:31:36.348871+0000 (oldest deadline 2024-09-19T07:31:59.248549+0000) 2024-09-19T07:32:02.604 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:02 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:02.336+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:32:02.604 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:02 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:02.336+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.515166+0000 front 2024-09-19T07:31:12.515206+0000 (oldest deadline 2024-09-19T07:31:36.615343+0000) 2024-09-19T07:32:02.604 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:02 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:02.336+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:18.316513+0000 front 2024-09-19T07:31:18.316455+0000 (oldest deadline 2024-09-19T07:31:43.616558+0000) 2024-09-19T07:32:02.604 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:02 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:02.336+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:27.518740+0000 front 2024-09-19T07:31:27.518782+0000 (oldest deadline 2024-09-19T07:31:51.018670+0000) 2024-09-19T07:32:02.605 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:02 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:02.336+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:37.419876+0000 front 2024-09-19T07:31:37.419797+0000 (oldest deadline 2024-09-19T07:32:00.319962+0000) 2024-09-19T07:32:02.605 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:32:02 smithi165 podman[73597]: 2024-09-19 07:32:02.294536022 +0000 UTC m=+5.615640133 container died 5ecd2bc5264ddfdc3524cbfe766a5437c53fa9ca76f1c17e5c3a0d8f07334d0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-19T07:32:02.688 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:02 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:32:02.426+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.176044+0000 front 2024-09-19T07:31:13.176112+0000 (oldest deadline 2024-09-19T07:31:36.076128+0000) 2024-09-19T07:32:02.689 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:02 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:32:02.426+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:16.577263+0000 front 2024-09-19T07:31:16.577228+0000 (oldest deadline 2024-09-19T07:31:42.477389+0000) 2024-09-19T07:32:02.689 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:02 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:32:02.426+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:28.080275+0000 front 2024-09-19T07:31:28.080121+0000 (oldest deadline 2024-09-19T07:31:52.780155+0000) 2024-09-19T07:32:02.689 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:02 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:02.434+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:32:02.689 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:02 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:02.434+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:32:02.689 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:02 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:02.434+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:32:02.689 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:02 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:02.434+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.858371+0000 front 2024-09-19T07:31:36.858566+0000 (oldest deadline 2024-09-19T07:32:01.459028+0000) 2024-09-19T07:32:02.883 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:32:02 smithi165 podman[73597]: 2024-09-19 07:32:02.603642151 +0000 UTC m=+5.924746254 container cleanup 5ecd2bc5264ddfdc3524cbfe766a5437c53fa9ca76f1c17e5c3a0d8f07334d0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-19T07:32:02.883 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:32:02 smithi165 bash[73597]: ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7 2024-09-19T07:32:02.884 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:32:02 smithi165 podman[73624]: 2024-09-19 07:32:02.804564954 +0000 UTC m=+0.507790838 container remove 5ecd2bc5264ddfdc3524cbfe766a5437c53fa9ca76f1c17e5c3a0d8f07334d0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-19T07:32:03.424 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:03 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:03.304+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:32:03.424 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:03 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:03.304+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.515166+0000 front 2024-09-19T07:31:12.515206+0000 (oldest deadline 2024-09-19T07:31:36.615343+0000) 2024-09-19T07:32:03.424 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:03 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:03.304+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:18.316513+0000 front 2024-09-19T07:31:18.316455+0000 (oldest deadline 2024-09-19T07:31:43.616558+0000) 2024-09-19T07:32:03.424 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:03 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:03.304+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:27.518740+0000 front 2024-09-19T07:31:27.518782+0000 (oldest deadline 2024-09-19T07:31:51.018670+0000) 2024-09-19T07:32:03.424 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:03 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:03.304+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:37.419876+0000 front 2024-09-19T07:31:37.419797+0000 (oldest deadline 2024-09-19T07:32:00.319962+0000) 2024-09-19T07:32:03.425 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:32:03 smithi165 podman[73714]: 2024-09-19 07:32:03.138904064 +0000 UTC m=+0.111398499 container create 792d50b234294636fc46194ae55615c2bd7e4a56bfa43452c05fd5588643d0ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-19T07:32:03.425 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:32:03 smithi165 podman[73714]: 2024-09-19 07:32:03.043408159 +0000 UTC m=+0.015902603 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:32:03.425 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:32:03 smithi165 podman[73714]: 2024-09-19 07:32:03.357591232 +0000 UTC m=+0.330085667 container init 792d50b234294636fc46194ae55615c2bd7e4a56bfa43452c05fd5588643d0ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-19T07:32:03.425 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:32:03 smithi165 podman[73714]: 2024-09-19 07:32:03.360755179 +0000 UTC m=+0.333249623 container start 792d50b234294636fc46194ae55615c2bd7e4a56bfa43452c05fd5588643d0ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:32:03.425 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:32:03 smithi165 podman[73714]: 2024-09-19 07:32:03.424191323 +0000 UTC m=+0.396685770 container attach 792d50b234294636fc46194ae55615c2bd7e4a56bfa43452c05fd5588643d0ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-19T07:32:03.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:03 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:03.095+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.842153+0000 front 2024-09-19T07:31:02.842300+0000 (oldest deadline 2024-09-19T07:31:28.142247+0000) 2024-09-19T07:32:03.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:03 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:03.095+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:11.543800+0000 front 2024-09-19T07:31:11.543952+0000 (oldest deadline 2024-09-19T07:31:36.243874+0000) 2024-09-19T07:32:03.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:03 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:03.095+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.145101+0000 front 2024-09-19T07:31:19.145035+0000 (oldest deadline 2024-09-19T07:31:43.145546+0000) 2024-09-19T07:32:03.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:03 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:03.095+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:28.347129+0000 front 2024-09-19T07:31:28.347192+0000 (oldest deadline 2024-09-19T07:31:52.447192+0000) 2024-09-19T07:32:03.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:03 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:03.095+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.348886+0000 front 2024-09-19T07:31:36.348871+0000 (oldest deadline 2024-09-19T07:31:59.248549+0000) 2024-09-19T07:32:03.772 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:03 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:32:03.396+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.176044+0000 front 2024-09-19T07:31:13.176112+0000 (oldest deadline 2024-09-19T07:31:36.076128+0000) 2024-09-19T07:32:03.772 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:03 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:32:03.396+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:16.577263+0000 front 2024-09-19T07:31:16.577228+0000 (oldest deadline 2024-09-19T07:31:42.477389+0000) 2024-09-19T07:32:03.772 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:03 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:32:03.396+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:28.080275+0000 front 2024-09-19T07:31:28.080121+0000 (oldest deadline 2024-09-19T07:31:52.780155+0000) 2024-09-19T07:32:03.773 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:03 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:32:03.396+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.881162+0000 front 2024-09-19T07:31:36.881178+0000 (oldest deadline 2024-09-19T07:32:02.781055+0000) 2024-09-19T07:32:03.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:03 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:03.456+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:32:03.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:03 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:03.456+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:32:03.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:03 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:03.456+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:32:03.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:03 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:03.456+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.858371+0000 front 2024-09-19T07:31:36.858566+0000 (oldest deadline 2024-09-19T07:32:01.459028+0000) 2024-09-19T07:32:03.818 INFO:journalctl@ceph.osd.7.smithi165.stdout:Sep 19 07:32:03 smithi165 podman[73714]: 2024-09-19 07:32:03.555410218 +0000 UTC m=+0.527904659 container died 792d50b234294636fc46194ae55615c2bd7e4a56bfa43452c05fd5588643d0ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, ceph=True) 2024-09-19T07:32:04.039 DEBUG:teuthology.orchestra.run.smithi165:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@osd.7.service' 2024-09-19T07:32:04.079 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:32:04.079 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-19T07:32:04.079 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-19T07:32:04.079 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@osd.8 2024-09-19T07:32:04.272 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:04 smithi179 systemd[1]: Stopping Ceph osd.8 for eae8a4a8-7654-11ef-bceb-c7b262605968... 2024-09-19T07:32:04.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:04 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:04.124+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.842153+0000 front 2024-09-19T07:31:02.842300+0000 (oldest deadline 2024-09-19T07:31:28.142247+0000) 2024-09-19T07:32:04.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:04 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:04.124+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:11.543800+0000 front 2024-09-19T07:31:11.543952+0000 (oldest deadline 2024-09-19T07:31:36.243874+0000) 2024-09-19T07:32:04.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:04 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:04.124+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.145101+0000 front 2024-09-19T07:31:19.145035+0000 (oldest deadline 2024-09-19T07:31:43.145546+0000) 2024-09-19T07:32:04.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:04 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:04.124+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:28.347129+0000 front 2024-09-19T07:31:28.347192+0000 (oldest deadline 2024-09-19T07:31:52.447192+0000) 2024-09-19T07:32:04.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:04 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:04.124+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.348886+0000 front 2024-09-19T07:31:36.348871+0000 (oldest deadline 2024-09-19T07:31:59.248549+0000) 2024-09-19T07:32:04.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:04 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:04.342+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:32:04.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:04 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:04.342+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.515166+0000 front 2024-09-19T07:31:12.515206+0000 (oldest deadline 2024-09-19T07:31:36.615343+0000) 2024-09-19T07:32:04.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:04 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:04.342+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:18.316513+0000 front 2024-09-19T07:31:18.316455+0000 (oldest deadline 2024-09-19T07:31:43.616558+0000) 2024-09-19T07:32:04.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:04 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:04.342+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:27.518740+0000 front 2024-09-19T07:31:27.518782+0000 (oldest deadline 2024-09-19T07:31:51.018670+0000) 2024-09-19T07:32:04.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:04 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:04.342+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:37.419876+0000 front 2024-09-19T07:31:37.419797+0000 (oldest deadline 2024-09-19T07:32:00.319962+0000) 2024-09-19T07:32:04.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:04 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:04.452+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:32:04.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:04 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:04.452+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:32:04.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:04 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:04.452+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:32:04.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:04 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:04.452+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.858371+0000 front 2024-09-19T07:31:36.858566+0000 (oldest deadline 2024-09-19T07:32:01.459028+0000) 2024-09-19T07:32:04.773 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:04 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:32:04.369+0000 7fb32c1d6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:32:04.773 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:04 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:32:04.369+0000 7fb32c1d6640 -1 osd.8 110 *** Got signal Terminated *** 2024-09-19T07:32:04.773 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:04 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:32:04.369+0000 7fb32c1d6640 -1 osd.8 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T07:32:04.773 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:04 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:32:04.383+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.176044+0000 front 2024-09-19T07:31:13.176112+0000 (oldest deadline 2024-09-19T07:31:36.076128+0000) 2024-09-19T07:32:04.773 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:04 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:32:04.383+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:16.577263+0000 front 2024-09-19T07:31:16.577228+0000 (oldest deadline 2024-09-19T07:31:42.477389+0000) 2024-09-19T07:32:04.773 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:04 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:32:04.383+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:28.080275+0000 front 2024-09-19T07:31:28.080121+0000 (oldest deadline 2024-09-19T07:31:52.780155+0000) 2024-09-19T07:32:04.773 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:04 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:32:04.383+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.881162+0000 front 2024-09-19T07:31:36.881178+0000 (oldest deadline 2024-09-19T07:32:02.781055+0000) 2024-09-19T07:32:05.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:05 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:05.126+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.842153+0000 front 2024-09-19T07:31:02.842300+0000 (oldest deadline 2024-09-19T07:31:28.142247+0000) 2024-09-19T07:32:05.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:05 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:05.126+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:11.543800+0000 front 2024-09-19T07:31:11.543952+0000 (oldest deadline 2024-09-19T07:31:36.243874+0000) 2024-09-19T07:32:05.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:05 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:05.126+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.145101+0000 front 2024-09-19T07:31:19.145035+0000 (oldest deadline 2024-09-19T07:31:43.145546+0000) 2024-09-19T07:32:05.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:05 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:05.126+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:28.347129+0000 front 2024-09-19T07:31:28.347192+0000 (oldest deadline 2024-09-19T07:31:52.447192+0000) 2024-09-19T07:32:05.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:05 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:05.126+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.348886+0000 front 2024-09-19T07:31:36.348871+0000 (oldest deadline 2024-09-19T07:31:59.248549+0000) 2024-09-19T07:32:05.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:05 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:05.355+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:32:05.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:05 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:05.355+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.515166+0000 front 2024-09-19T07:31:12.515206+0000 (oldest deadline 2024-09-19T07:31:36.615343+0000) 2024-09-19T07:32:05.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:05 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:05.355+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:18.316513+0000 front 2024-09-19T07:31:18.316455+0000 (oldest deadline 2024-09-19T07:31:43.616558+0000) 2024-09-19T07:32:05.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:05 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:05.355+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:27.518740+0000 front 2024-09-19T07:31:27.518782+0000 (oldest deadline 2024-09-19T07:31:51.018670+0000) 2024-09-19T07:32:05.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:05 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:05.355+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:37.419876+0000 front 2024-09-19T07:31:37.419797+0000 (oldest deadline 2024-09-19T07:32:00.319962+0000) 2024-09-19T07:32:05.772 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:05 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:32:05.376+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.176044+0000 front 2024-09-19T07:31:13.176112+0000 (oldest deadline 2024-09-19T07:31:36.076128+0000) 2024-09-19T07:32:05.772 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:05 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:32:05.376+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:16.577263+0000 front 2024-09-19T07:31:16.577228+0000 (oldest deadline 2024-09-19T07:31:42.477389+0000) 2024-09-19T07:32:05.772 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:05 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:32:05.376+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:28.080275+0000 front 2024-09-19T07:31:28.080121+0000 (oldest deadline 2024-09-19T07:31:52.780155+0000) 2024-09-19T07:32:05.772 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:05 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:32:05.376+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.881162+0000 front 2024-09-19T07:31:36.881178+0000 (oldest deadline 2024-09-19T07:32:02.781055+0000) 2024-09-19T07:32:05.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:05 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:05.448+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:32:05.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:05 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:05.448+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:32:05.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:05 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:05.448+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:32:05.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:05 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:05.448+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.858371+0000 front 2024-09-19T07:31:36.858566+0000 (oldest deadline 2024-09-19T07:32:01.459028+0000) 2024-09-19T07:32:06.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:06 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:06.080+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.842153+0000 front 2024-09-19T07:31:02.842300+0000 (oldest deadline 2024-09-19T07:31:28.142247+0000) 2024-09-19T07:32:06.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:06 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:06.080+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:11.543800+0000 front 2024-09-19T07:31:11.543952+0000 (oldest deadline 2024-09-19T07:31:36.243874+0000) 2024-09-19T07:32:06.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:06 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:06.080+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.145101+0000 front 2024-09-19T07:31:19.145035+0000 (oldest deadline 2024-09-19T07:31:43.145546+0000) 2024-09-19T07:32:06.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:06 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:06.080+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:28.347129+0000 front 2024-09-19T07:31:28.347192+0000 (oldest deadline 2024-09-19T07:31:52.447192+0000) 2024-09-19T07:32:06.333 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:06 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:06.080+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.348886+0000 front 2024-09-19T07:31:36.348871+0000 (oldest deadline 2024-09-19T07:31:59.248549+0000) 2024-09-19T07:32:06.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:06 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:06.325+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:32:06.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:06 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:06.325+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.515166+0000 front 2024-09-19T07:31:12.515206+0000 (oldest deadline 2024-09-19T07:31:36.615343+0000) 2024-09-19T07:32:06.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:06 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:06.325+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:18.316513+0000 front 2024-09-19T07:31:18.316455+0000 (oldest deadline 2024-09-19T07:31:43.616558+0000) 2024-09-19T07:32:06.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:06 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:06.325+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:27.518740+0000 front 2024-09-19T07:31:27.518782+0000 (oldest deadline 2024-09-19T07:31:51.018670+0000) 2024-09-19T07:32:06.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:06 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:06.325+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:37.419876+0000 front 2024-09-19T07:31:37.419797+0000 (oldest deadline 2024-09-19T07:32:00.319962+0000) 2024-09-19T07:32:06.772 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:06 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:32:06.394+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.176044+0000 front 2024-09-19T07:31:13.176112+0000 (oldest deadline 2024-09-19T07:31:36.076128+0000) 2024-09-19T07:32:06.772 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:06 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:32:06.394+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:16.577263+0000 front 2024-09-19T07:31:16.577228+0000 (oldest deadline 2024-09-19T07:31:42.477389+0000) 2024-09-19T07:32:06.772 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:06 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:32:06.394+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:28.080275+0000 front 2024-09-19T07:31:28.080121+0000 (oldest deadline 2024-09-19T07:31:52.780155+0000) 2024-09-19T07:32:06.773 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:06 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:32:06.394+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.881162+0000 front 2024-09-19T07:31:36.881178+0000 (oldest deadline 2024-09-19T07:32:02.781055+0000) 2024-09-19T07:32:06.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:06 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:06.483+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:32:06.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:06 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:06.483+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:32:06.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:06 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:06.483+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:32:06.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:06 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:06.483+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.858371+0000 front 2024-09-19T07:31:36.858566+0000 (oldest deadline 2024-09-19T07:32:01.459028+0000) 2024-09-19T07:32:07.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:07 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:07.097+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.842153+0000 front 2024-09-19T07:31:02.842300+0000 (oldest deadline 2024-09-19T07:31:28.142247+0000) 2024-09-19T07:32:07.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:07 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:07.097+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:11.543800+0000 front 2024-09-19T07:31:11.543952+0000 (oldest deadline 2024-09-19T07:31:36.243874+0000) 2024-09-19T07:32:07.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:07 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:07.097+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.145101+0000 front 2024-09-19T07:31:19.145035+0000 (oldest deadline 2024-09-19T07:31:43.145546+0000) 2024-09-19T07:32:07.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:07 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:07.097+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:28.347129+0000 front 2024-09-19T07:31:28.347192+0000 (oldest deadline 2024-09-19T07:31:52.447192+0000) 2024-09-19T07:32:07.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:07 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:07.097+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.348886+0000 front 2024-09-19T07:31:36.348871+0000 (oldest deadline 2024-09-19T07:31:59.248549+0000) 2024-09-19T07:32:07.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:07 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:07.097+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:42.149818+0000 front 2024-09-19T07:31:42.149734+0000 (oldest deadline 2024-09-19T07:32:06.849610+0000) 2024-09-19T07:32:07.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:07 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:07.334+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:32:07.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:07 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:07.334+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.515166+0000 front 2024-09-19T07:31:12.515206+0000 (oldest deadline 2024-09-19T07:31:36.615343+0000) 2024-09-19T07:32:07.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:07 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:07.334+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:18.316513+0000 front 2024-09-19T07:31:18.316455+0000 (oldest deadline 2024-09-19T07:31:43.616558+0000) 2024-09-19T07:32:07.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:07 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:07.334+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:27.518740+0000 front 2024-09-19T07:31:27.518782+0000 (oldest deadline 2024-09-19T07:31:51.018670+0000) 2024-09-19T07:32:07.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:07 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:07.334+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:37.419876+0000 front 2024-09-19T07:31:37.419797+0000 (oldest deadline 2024-09-19T07:32:00.319962+0000) 2024-09-19T07:32:07.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:07 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:07.334+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:45.020932+0000 front 2024-09-19T07:31:45.020965+0000 (oldest deadline 2024-09-19T07:32:06.720950+0000) 2024-09-19T07:32:07.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:07 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:07.439+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:32:07.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:07 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:07.439+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:32:07.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:07 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:07.439+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:32:07.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:07 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:07.439+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.858371+0000 front 2024-09-19T07:31:36.858566+0000 (oldest deadline 2024-09-19T07:32:01.459028+0000) 2024-09-19T07:32:07.773 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:07 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:32:07.375+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.176044+0000 front 2024-09-19T07:31:13.176112+0000 (oldest deadline 2024-09-19T07:31:36.076128+0000) 2024-09-19T07:32:07.773 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:07 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:32:07.375+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:16.577263+0000 front 2024-09-19T07:31:16.577228+0000 (oldest deadline 2024-09-19T07:31:42.477389+0000) 2024-09-19T07:32:07.773 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:07 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:32:07.375+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:28.080275+0000 front 2024-09-19T07:31:28.080121+0000 (oldest deadline 2024-09-19T07:31:52.780155+0000) 2024-09-19T07:32:07.773 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:07 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:32:07.375+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.881162+0000 front 2024-09-19T07:31:36.881178+0000 (oldest deadline 2024-09-19T07:32:02.781055+0000) 2024-09-19T07:32:08.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:08 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:08.110+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.842153+0000 front 2024-09-19T07:31:02.842300+0000 (oldest deadline 2024-09-19T07:31:28.142247+0000) 2024-09-19T07:32:08.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:08 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:08.110+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:11.543800+0000 front 2024-09-19T07:31:11.543952+0000 (oldest deadline 2024-09-19T07:31:36.243874+0000) 2024-09-19T07:32:08.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:08 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:08.110+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.145101+0000 front 2024-09-19T07:31:19.145035+0000 (oldest deadline 2024-09-19T07:31:43.145546+0000) 2024-09-19T07:32:08.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:08 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:08.110+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:28.347129+0000 front 2024-09-19T07:31:28.347192+0000 (oldest deadline 2024-09-19T07:31:52.447192+0000) 2024-09-19T07:32:08.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:08 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:08.110+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.348886+0000 front 2024-09-19T07:31:36.348871+0000 (oldest deadline 2024-09-19T07:31:59.248549+0000) 2024-09-19T07:32:08.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:08 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:08.110+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:42.149818+0000 front 2024-09-19T07:31:42.149734+0000 (oldest deadline 2024-09-19T07:32:06.849610+0000) 2024-09-19T07:32:08.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:08 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:08.372+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:32:08.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:08 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:08.372+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.515166+0000 front 2024-09-19T07:31:12.515206+0000 (oldest deadline 2024-09-19T07:31:36.615343+0000) 2024-09-19T07:32:08.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:08 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:08.372+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:18.316513+0000 front 2024-09-19T07:31:18.316455+0000 (oldest deadline 2024-09-19T07:31:43.616558+0000) 2024-09-19T07:32:08.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:08 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:08.372+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:27.518740+0000 front 2024-09-19T07:31:27.518782+0000 (oldest deadline 2024-09-19T07:31:51.018670+0000) 2024-09-19T07:32:08.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:08 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:08.372+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:37.419876+0000 front 2024-09-19T07:31:37.419797+0000 (oldest deadline 2024-09-19T07:32:00.319962+0000) 2024-09-19T07:32:08.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:08 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:08.372+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:45.020932+0000 front 2024-09-19T07:31:45.020965+0000 (oldest deadline 2024-09-19T07:32:06.720950+0000) 2024-09-19T07:32:08.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:08 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:08.449+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:32:08.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:08 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:08.449+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:32:08.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:08 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:08.449+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:32:08.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:08 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:08.449+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.858371+0000 front 2024-09-19T07:31:36.858566+0000 (oldest deadline 2024-09-19T07:32:01.459028+0000) 2024-09-19T07:32:08.773 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:08 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:32:08.363+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.176044+0000 front 2024-09-19T07:31:13.176112+0000 (oldest deadline 2024-09-19T07:31:36.076128+0000) 2024-09-19T07:32:08.773 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:08 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:32:08.363+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:16.577263+0000 front 2024-09-19T07:31:16.577228+0000 (oldest deadline 2024-09-19T07:31:42.477389+0000) 2024-09-19T07:32:08.773 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:08 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:32:08.363+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:28.080275+0000 front 2024-09-19T07:31:28.080121+0000 (oldest deadline 2024-09-19T07:31:52.780155+0000) 2024-09-19T07:32:08.773 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:08 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:32:08.363+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.881162+0000 front 2024-09-19T07:31:36.881178+0000 (oldest deadline 2024-09-19T07:32:02.781055+0000) 2024-09-19T07:32:08.773 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:08 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:32:08.363+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:42.781432+0000 front 2024-09-19T07:31:42.781449+0000 (oldest deadline 2024-09-19T07:32:07.481496+0000) 2024-09-19T07:32:09.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:09 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:09.145+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.842153+0000 front 2024-09-19T07:31:02.842300+0000 (oldest deadline 2024-09-19T07:31:28.142247+0000) 2024-09-19T07:32:09.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:09 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:09.145+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:11.543800+0000 front 2024-09-19T07:31:11.543952+0000 (oldest deadline 2024-09-19T07:31:36.243874+0000) 2024-09-19T07:32:09.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:09 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:09.145+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.145101+0000 front 2024-09-19T07:31:19.145035+0000 (oldest deadline 2024-09-19T07:31:43.145546+0000) 2024-09-19T07:32:09.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:09 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:09.145+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:28.347129+0000 front 2024-09-19T07:31:28.347192+0000 (oldest deadline 2024-09-19T07:31:52.447192+0000) 2024-09-19T07:32:09.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:09 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:09.145+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.348886+0000 front 2024-09-19T07:31:36.348871+0000 (oldest deadline 2024-09-19T07:31:59.248549+0000) 2024-09-19T07:32:09.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:09 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:09.145+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:42.149818+0000 front 2024-09-19T07:31:42.149734+0000 (oldest deadline 2024-09-19T07:32:06.849610+0000) 2024-09-19T07:32:09.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:09 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:09.406+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:32:09.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:09 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:09.406+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:32:09.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:09 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:09.406+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:32:09.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:09 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:09.406+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.858371+0000 front 2024-09-19T07:31:36.858566+0000 (oldest deadline 2024-09-19T07:32:01.459028+0000) 2024-09-19T07:32:09.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:09 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:09.406+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:43.760018+0000 front 2024-09-19T07:31:43.760155+0000 (oldest deadline 2024-09-19T07:32:08.460108+0000) 2024-09-19T07:32:09.773 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:09 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:32:09.325+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:13.176044+0000 front 2024-09-19T07:31:13.176112+0000 (oldest deadline 2024-09-19T07:31:36.076128+0000) 2024-09-19T07:32:09.773 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:09 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:32:09.325+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:16.577263+0000 front 2024-09-19T07:31:16.577228+0000 (oldest deadline 2024-09-19T07:31:42.477389+0000) 2024-09-19T07:32:09.773 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:09 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:32:09.325+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:28.080275+0000 front 2024-09-19T07:31:28.080121+0000 (oldest deadline 2024-09-19T07:31:52.780155+0000) 2024-09-19T07:32:09.773 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:09 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:32:09.325+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.881162+0000 front 2024-09-19T07:31:36.881178+0000 (oldest deadline 2024-09-19T07:32:02.781055+0000) 2024-09-19T07:32:09.773 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:09 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8[53894]: 2024-09-19T07:32:09.325+0000 7fb3247d3640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:42.781432+0000 front 2024-09-19T07:31:42.781449+0000 (oldest deadline 2024-09-19T07:32:07.481496+0000) 2024-09-19T07:32:09.883 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:09 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:09.404+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:32:09.884 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:09 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:09.404+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.515166+0000 front 2024-09-19T07:31:12.515206+0000 (oldest deadline 2024-09-19T07:31:36.615343+0000) 2024-09-19T07:32:09.884 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:09 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:09.404+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:18.316513+0000 front 2024-09-19T07:31:18.316455+0000 (oldest deadline 2024-09-19T07:31:43.616558+0000) 2024-09-19T07:32:09.884 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:09 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:09.404+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:27.518740+0000 front 2024-09-19T07:31:27.518782+0000 (oldest deadline 2024-09-19T07:31:51.018670+0000) 2024-09-19T07:32:09.884 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:09 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:09.404+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:37.419876+0000 front 2024-09-19T07:31:37.419797+0000 (oldest deadline 2024-09-19T07:32:00.319962+0000) 2024-09-19T07:32:09.884 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:09 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:09.404+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:45.020932+0000 front 2024-09-19T07:31:45.020965+0000 (oldest deadline 2024-09-19T07:32:06.720950+0000) 2024-09-19T07:32:10.272 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:09 smithi179 podman[74227]: 2024-09-19 07:32:09.998209018 +0000 UTC m=+5.727629166 container died 315150e54c12f5f6df18d33fd6508d4e2f0faef775d3aad2877ba1fca1adb3a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-19T07:32:10.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:10 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:10.190+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.842153+0000 front 2024-09-19T07:31:02.842300+0000 (oldest deadline 2024-09-19T07:31:28.142247+0000) 2024-09-19T07:32:10.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:10 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:10.190+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:11.543800+0000 front 2024-09-19T07:31:11.543952+0000 (oldest deadline 2024-09-19T07:31:36.243874+0000) 2024-09-19T07:32:10.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:10 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:10.190+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.145101+0000 front 2024-09-19T07:31:19.145035+0000 (oldest deadline 2024-09-19T07:31:43.145546+0000) 2024-09-19T07:32:10.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:10 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:10.190+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:28.347129+0000 front 2024-09-19T07:31:28.347192+0000 (oldest deadline 2024-09-19T07:31:52.447192+0000) 2024-09-19T07:32:10.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:10 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:10.190+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.348886+0000 front 2024-09-19T07:31:36.348871+0000 (oldest deadline 2024-09-19T07:31:59.248549+0000) 2024-09-19T07:32:10.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:10 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:10.190+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:42.149818+0000 front 2024-09-19T07:31:42.149734+0000 (oldest deadline 2024-09-19T07:32:06.849610+0000) 2024-09-19T07:32:10.620 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:10 smithi179 podman[74227]: 2024-09-19 07:32:10.361271136 +0000 UTC m=+6.090691280 container cleanup 315150e54c12f5f6df18d33fd6508d4e2f0faef775d3aad2877ba1fca1adb3a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-2f599a4) 2024-09-19T07:32:10.620 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:10 smithi179 bash[74227]: ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8 2024-09-19T07:32:10.621 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:10 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:10.441+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:32:10.621 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:10 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:10.441+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:32:10.621 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:10 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:10.441+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:32:10.621 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:10 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:10.441+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.858371+0000 front 2024-09-19T07:31:36.858566+0000 (oldest deadline 2024-09-19T07:32:01.459028+0000) 2024-09-19T07:32:10.621 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:10 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:10.441+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:43.760018+0000 front 2024-09-19T07:31:43.760155+0000 (oldest deadline 2024-09-19T07:32:08.460108+0000) 2024-09-19T07:32:10.884 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:10 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:10.384+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:32:10.884 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:10 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:10.384+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.515166+0000 front 2024-09-19T07:31:12.515206+0000 (oldest deadline 2024-09-19T07:31:36.615343+0000) 2024-09-19T07:32:10.884 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:10 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:10.384+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:18.316513+0000 front 2024-09-19T07:31:18.316455+0000 (oldest deadline 2024-09-19T07:31:43.616558+0000) 2024-09-19T07:32:10.884 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:10 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:10.384+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:27.518740+0000 front 2024-09-19T07:31:27.518782+0000 (oldest deadline 2024-09-19T07:31:51.018670+0000) 2024-09-19T07:32:10.884 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:10 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:10.384+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:37.419876+0000 front 2024-09-19T07:31:37.419797+0000 (oldest deadline 2024-09-19T07:32:00.319962+0000) 2024-09-19T07:32:10.884 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:10 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:10.384+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:45.020932+0000 front 2024-09-19T07:31:45.020965+0000 (oldest deadline 2024-09-19T07:32:06.720950+0000) 2024-09-19T07:32:10.971 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:10 smithi179 podman[74241]: 2024-09-19 07:32:10.620632065 +0000 UTC m=+0.617041887 container remove 315150e54c12f5f6df18d33fd6508d4e2f0faef775d3aad2877ba1fca1adb3a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-19T07:32:11.258 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:10 smithi179 podman[74331]: 2024-09-19 07:32:10.874463265 +0000 UTC m=+0.015867703 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:32:11.258 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:10 smithi179 podman[74331]: 2024-09-19 07:32:10.971758545 +0000 UTC m=+0.113162972 container create 356e46d1c497f395192a2916c0609923139e38f6199219c449c341bcca2a7f2a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8-deactivate, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:32:11.258 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:11 smithi179 podman[74331]: 2024-09-19 07:32:11.182558986 +0000 UTC m=+0.323963422 container init 356e46d1c497f395192a2916c0609923139e38f6199219c449c341bcca2a7f2a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8-deactivate, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-19T07:32:11.258 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:11 smithi179 podman[74331]: 2024-09-19 07:32:11.185758868 +0000 UTC m=+0.327163301 container start 356e46d1c497f395192a2916c0609923139e38f6199219c449c341bcca2a7f2a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:32:11.258 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:11 smithi179 podman[74331]: 2024-09-19 07:32:11.257344118 +0000 UTC m=+0.398748546 container attach 356e46d1c497f395192a2916c0609923139e38f6199219c449c341bcca2a7f2a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-19T07:32:11.523 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:11 smithi179 podman[74331]: 2024-09-19 07:32:11.377606877 +0000 UTC m=+0.519011306 container died 356e46d1c497f395192a2916c0609923139e38f6199219c449c341bcca2a7f2a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-19T07:32:11.523 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:11 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:11.465+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:32:11.524 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:11 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:11.465+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:32:11.524 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:11 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:11.465+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:32:11.524 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:11 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:11.465+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.858371+0000 front 2024-09-19T07:31:36.858566+0000 (oldest deadline 2024-09-19T07:32:01.459028+0000) 2024-09-19T07:32:11.524 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:11 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:11.465+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:43.760018+0000 front 2024-09-19T07:31:43.760155+0000 (oldest deadline 2024-09-19T07:32:08.460108+0000) 2024-09-19T07:32:11.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:11 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:11.195+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.842153+0000 front 2024-09-19T07:31:02.842300+0000 (oldest deadline 2024-09-19T07:31:28.142247+0000) 2024-09-19T07:32:11.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:11 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:11.195+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:11.543800+0000 front 2024-09-19T07:31:11.543952+0000 (oldest deadline 2024-09-19T07:31:36.243874+0000) 2024-09-19T07:32:11.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:11 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:11.195+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.145101+0000 front 2024-09-19T07:31:19.145035+0000 (oldest deadline 2024-09-19T07:31:43.145546+0000) 2024-09-19T07:32:11.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:11 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:11.195+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:28.347129+0000 front 2024-09-19T07:31:28.347192+0000 (oldest deadline 2024-09-19T07:31:52.447192+0000) 2024-09-19T07:32:11.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:11 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:11.195+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.348886+0000 front 2024-09-19T07:31:36.348871+0000 (oldest deadline 2024-09-19T07:31:59.248549+0000) 2024-09-19T07:32:11.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:11 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:11.195+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:42.149818+0000 front 2024-09-19T07:31:42.149734+0000 (oldest deadline 2024-09-19T07:32:06.849610+0000) 2024-09-19T07:32:11.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:11 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:11.348+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:32:11.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:11 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:11.348+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.515166+0000 front 2024-09-19T07:31:12.515206+0000 (oldest deadline 2024-09-19T07:31:36.615343+0000) 2024-09-19T07:32:11.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:11 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:11.348+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:18.316513+0000 front 2024-09-19T07:31:18.316455+0000 (oldest deadline 2024-09-19T07:31:43.616558+0000) 2024-09-19T07:32:11.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:11 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:11.348+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:27.518740+0000 front 2024-09-19T07:31:27.518782+0000 (oldest deadline 2024-09-19T07:31:51.018670+0000) 2024-09-19T07:32:11.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:11 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:11.348+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:37.419876+0000 front 2024-09-19T07:31:37.419797+0000 (oldest deadline 2024-09-19T07:32:00.319962+0000) 2024-09-19T07:32:11.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:11 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:11.348+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:45.020932+0000 front 2024-09-19T07:31:45.020965+0000 (oldest deadline 2024-09-19T07:32:06.720950+0000) 2024-09-19T07:32:11.955 INFO:journalctl@ceph.osd.8.smithi179.stdout:Sep 19 07:32:11 smithi179 podman[74355]: 2024-09-19 07:32:11.935585172 +0000 UTC m=+0.547502621 container remove 356e46d1c497f395192a2916c0609923139e38f6199219c449c341bcca2a7f2a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True) 2024-09-19T07:32:11.961 DEBUG:teuthology.orchestra.run.smithi179:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@osd.8.service' 2024-09-19T07:32:12.000 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:32:12.001 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-19T07:32:12.001 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-19T07:32:12.001 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@osd.9 2024-09-19T07:32:12.296 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:12 smithi148 systemd[1]: Stopping Ceph osd.9 for eae8a4a8-7654-11ef-bceb-c7b262605968... 2024-09-19T07:32:12.296 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:12 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:12.178+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.842153+0000 front 2024-09-19T07:31:02.842300+0000 (oldest deadline 2024-09-19T07:31:28.142247+0000) 2024-09-19T07:32:12.296 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:12 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:12.178+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:11.543800+0000 front 2024-09-19T07:31:11.543952+0000 (oldest deadline 2024-09-19T07:31:36.243874+0000) 2024-09-19T07:32:12.296 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:12 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:12.178+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.145101+0000 front 2024-09-19T07:31:19.145035+0000 (oldest deadline 2024-09-19T07:31:43.145546+0000) 2024-09-19T07:32:12.296 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:12 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:12.178+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:28.347129+0000 front 2024-09-19T07:31:28.347192+0000 (oldest deadline 2024-09-19T07:31:52.447192+0000) 2024-09-19T07:32:12.296 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:12 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:12.178+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.348886+0000 front 2024-09-19T07:31:36.348871+0000 (oldest deadline 2024-09-19T07:31:59.248549+0000) 2024-09-19T07:32:12.296 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:12 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:12.178+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:42.149818+0000 front 2024-09-19T07:31:42.149734+0000 (oldest deadline 2024-09-19T07:32:06.849610+0000) 2024-09-19T07:32:12.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:12 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:12.295+0000 7f84892be640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:32:12.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:12 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:12.295+0000 7f84892be640 -1 osd.9 110 *** Got signal Terminated *** 2024-09-19T07:32:12.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:12 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:12.295+0000 7f84892be640 -1 osd.9 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T07:32:12.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:12 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:12.312+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:32:12.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:12 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:12.312+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.515166+0000 front 2024-09-19T07:31:12.515206+0000 (oldest deadline 2024-09-19T07:31:36.615343+0000) 2024-09-19T07:32:12.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:12 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:12.312+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:18.316513+0000 front 2024-09-19T07:31:18.316455+0000 (oldest deadline 2024-09-19T07:31:43.616558+0000) 2024-09-19T07:32:12.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:12 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:12.312+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:27.518740+0000 front 2024-09-19T07:31:27.518782+0000 (oldest deadline 2024-09-19T07:31:51.018670+0000) 2024-09-19T07:32:12.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:12 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:12.312+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:37.419876+0000 front 2024-09-19T07:31:37.419797+0000 (oldest deadline 2024-09-19T07:32:00.319962+0000) 2024-09-19T07:32:12.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:12 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:12.312+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:45.020932+0000 front 2024-09-19T07:31:45.020965+0000 (oldest deadline 2024-09-19T07:32:06.720950+0000) 2024-09-19T07:32:12.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:12 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:12.500+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:32:12.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:12 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:12.500+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:32:12.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:12 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:12.500+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:32:12.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:12 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:12.500+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.858371+0000 front 2024-09-19T07:31:36.858566+0000 (oldest deadline 2024-09-19T07:32:01.459028+0000) 2024-09-19T07:32:12.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:12 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:12.500+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:43.760018+0000 front 2024-09-19T07:31:43.760155+0000 (oldest deadline 2024-09-19T07:32:08.460108+0000) 2024-09-19T07:32:13.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:13 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:13.186+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.842153+0000 front 2024-09-19T07:31:02.842300+0000 (oldest deadline 2024-09-19T07:31:28.142247+0000) 2024-09-19T07:32:13.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:13 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:13.186+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:11.543800+0000 front 2024-09-19T07:31:11.543952+0000 (oldest deadline 2024-09-19T07:31:36.243874+0000) 2024-09-19T07:32:13.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:13 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:13.186+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.145101+0000 front 2024-09-19T07:31:19.145035+0000 (oldest deadline 2024-09-19T07:31:43.145546+0000) 2024-09-19T07:32:13.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:13 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:13.186+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:28.347129+0000 front 2024-09-19T07:31:28.347192+0000 (oldest deadline 2024-09-19T07:31:52.447192+0000) 2024-09-19T07:32:13.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:13 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:13.186+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.348886+0000 front 2024-09-19T07:31:36.348871+0000 (oldest deadline 2024-09-19T07:31:59.248549+0000) 2024-09-19T07:32:13.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:13 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:13.186+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:42.149818+0000 front 2024-09-19T07:31:42.149734+0000 (oldest deadline 2024-09-19T07:32:06.849610+0000) 2024-09-19T07:32:13.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:13 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:13.292+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:32:13.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:13 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:13.292+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.515166+0000 front 2024-09-19T07:31:12.515206+0000 (oldest deadline 2024-09-19T07:31:36.615343+0000) 2024-09-19T07:32:13.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:13 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:13.292+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:18.316513+0000 front 2024-09-19T07:31:18.316455+0000 (oldest deadline 2024-09-19T07:31:43.616558+0000) 2024-09-19T07:32:13.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:13 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:13.292+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:27.518740+0000 front 2024-09-19T07:31:27.518782+0000 (oldest deadline 2024-09-19T07:31:51.018670+0000) 2024-09-19T07:32:13.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:13 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:13.292+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:37.419876+0000 front 2024-09-19T07:31:37.419797+0000 (oldest deadline 2024-09-19T07:32:00.319962+0000) 2024-09-19T07:32:13.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:13 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:13.292+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:45.020932+0000 front 2024-09-19T07:31:45.020965+0000 (oldest deadline 2024-09-19T07:32:06.720950+0000) 2024-09-19T07:32:13.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:13 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:13.472+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:32:13.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:13 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:13.472+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:32:13.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:13 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:13.472+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:32:13.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:13 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:13.472+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.858371+0000 front 2024-09-19T07:31:36.858566+0000 (oldest deadline 2024-09-19T07:32:01.459028+0000) 2024-09-19T07:32:13.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:13 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:13.472+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:43.760018+0000 front 2024-09-19T07:31:43.760155+0000 (oldest deadline 2024-09-19T07:32:08.460108+0000) 2024-09-19T07:32:14.383 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:14 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:14.281+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:32:14.384 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:14 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:14.281+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.515166+0000 front 2024-09-19T07:31:12.515206+0000 (oldest deadline 2024-09-19T07:31:36.615343+0000) 2024-09-19T07:32:14.384 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:14 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:14.281+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:18.316513+0000 front 2024-09-19T07:31:18.316455+0000 (oldest deadline 2024-09-19T07:31:43.616558+0000) 2024-09-19T07:32:14.384 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:14 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:14.281+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:27.518740+0000 front 2024-09-19T07:31:27.518782+0000 (oldest deadline 2024-09-19T07:31:51.018670+0000) 2024-09-19T07:32:14.384 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:14 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:14.281+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:37.419876+0000 front 2024-09-19T07:31:37.419797+0000 (oldest deadline 2024-09-19T07:32:00.319962+0000) 2024-09-19T07:32:14.384 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:14 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:14.281+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:45.020932+0000 front 2024-09-19T07:31:45.020965+0000 (oldest deadline 2024-09-19T07:32:06.720950+0000) 2024-09-19T07:32:14.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:14 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:14.188+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.842153+0000 front 2024-09-19T07:31:02.842300+0000 (oldest deadline 2024-09-19T07:31:28.142247+0000) 2024-09-19T07:32:14.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:14 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:14.188+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:11.543800+0000 front 2024-09-19T07:31:11.543952+0000 (oldest deadline 2024-09-19T07:31:36.243874+0000) 2024-09-19T07:32:14.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:14 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:14.188+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.145101+0000 front 2024-09-19T07:31:19.145035+0000 (oldest deadline 2024-09-19T07:31:43.145546+0000) 2024-09-19T07:32:14.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:14 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:14.188+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:28.347129+0000 front 2024-09-19T07:31:28.347192+0000 (oldest deadline 2024-09-19T07:31:52.447192+0000) 2024-09-19T07:32:14.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:14 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:14.188+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.348886+0000 front 2024-09-19T07:31:36.348871+0000 (oldest deadline 2024-09-19T07:31:59.248549+0000) 2024-09-19T07:32:14.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:14 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:14.188+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:42.149818+0000 front 2024-09-19T07:31:42.149734+0000 (oldest deadline 2024-09-19T07:32:06.849610+0000) 2024-09-19T07:32:14.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:14 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:14.476+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:32:14.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:14 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:14.476+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:32:14.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:14 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:14.476+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:32:14.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:14 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:14.476+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.858371+0000 front 2024-09-19T07:31:36.858566+0000 (oldest deadline 2024-09-19T07:32:01.459028+0000) 2024-09-19T07:32:14.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:14 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:14.476+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:43.760018+0000 front 2024-09-19T07:31:43.760155+0000 (oldest deadline 2024-09-19T07:32:08.460108+0000) 2024-09-19T07:32:15.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:15 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:15.236+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.842153+0000 front 2024-09-19T07:31:02.842300+0000 (oldest deadline 2024-09-19T07:31:28.142247+0000) 2024-09-19T07:32:15.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:15 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:15.236+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:11.543800+0000 front 2024-09-19T07:31:11.543952+0000 (oldest deadline 2024-09-19T07:31:36.243874+0000) 2024-09-19T07:32:15.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:15 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:15.236+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.145101+0000 front 2024-09-19T07:31:19.145035+0000 (oldest deadline 2024-09-19T07:31:43.145546+0000) 2024-09-19T07:32:15.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:15 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:15.236+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:28.347129+0000 front 2024-09-19T07:31:28.347192+0000 (oldest deadline 2024-09-19T07:31:52.447192+0000) 2024-09-19T07:32:15.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:15 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:15.236+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.348886+0000 front 2024-09-19T07:31:36.348871+0000 (oldest deadline 2024-09-19T07:31:59.248549+0000) 2024-09-19T07:32:15.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:15 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:15.236+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:42.149818+0000 front 2024-09-19T07:31:42.149734+0000 (oldest deadline 2024-09-19T07:32:06.849610+0000) 2024-09-19T07:32:15.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:15 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:15.245+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:32:15.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:15 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:15.245+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.515166+0000 front 2024-09-19T07:31:12.515206+0000 (oldest deadline 2024-09-19T07:31:36.615343+0000) 2024-09-19T07:32:15.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:15 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:15.245+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:18.316513+0000 front 2024-09-19T07:31:18.316455+0000 (oldest deadline 2024-09-19T07:31:43.616558+0000) 2024-09-19T07:32:15.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:15 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:15.245+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:27.518740+0000 front 2024-09-19T07:31:27.518782+0000 (oldest deadline 2024-09-19T07:31:51.018670+0000) 2024-09-19T07:32:15.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:15 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:15.245+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:37.419876+0000 front 2024-09-19T07:31:37.419797+0000 (oldest deadline 2024-09-19T07:32:00.319962+0000) 2024-09-19T07:32:15.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:15 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:15.245+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:45.020932+0000 front 2024-09-19T07:31:45.020965+0000 (oldest deadline 2024-09-19T07:32:06.720950+0000) 2024-09-19T07:32:16.022 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:15 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:15.521+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:32:16.022 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:15 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:15.521+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:32:16.022 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:15 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:15.522+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:32:16.023 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:15 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:15.522+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.858371+0000 front 2024-09-19T07:31:36.858566+0000 (oldest deadline 2024-09-19T07:32:01.459028+0000) 2024-09-19T07:32:16.023 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:15 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:15.522+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:43.760018+0000 front 2024-09-19T07:31:43.760155+0000 (oldest deadline 2024-09-19T07:32:08.460108+0000) 2024-09-19T07:32:16.023 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:15 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:15.522+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-19T07:31:53.061849+0000 front 2024-09-19T07:31:53.061863+0000 (oldest deadline 2024-09-19T07:32:14.761784+0000) 2024-09-19T07:32:16.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:16 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:16.285+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.842153+0000 front 2024-09-19T07:31:02.842300+0000 (oldest deadline 2024-09-19T07:31:28.142247+0000) 2024-09-19T07:32:16.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:16 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:16.285+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:11.543800+0000 front 2024-09-19T07:31:11.543952+0000 (oldest deadline 2024-09-19T07:31:36.243874+0000) 2024-09-19T07:32:16.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:16 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:16.285+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.145101+0000 front 2024-09-19T07:31:19.145035+0000 (oldest deadline 2024-09-19T07:31:43.145546+0000) 2024-09-19T07:32:16.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:16 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:16.285+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:28.347129+0000 front 2024-09-19T07:31:28.347192+0000 (oldest deadline 2024-09-19T07:31:52.447192+0000) 2024-09-19T07:32:16.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:16 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:16.285+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.348886+0000 front 2024-09-19T07:31:36.348871+0000 (oldest deadline 2024-09-19T07:31:59.248549+0000) 2024-09-19T07:32:16.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:16 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:16.285+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:42.149818+0000 front 2024-09-19T07:31:42.149734+0000 (oldest deadline 2024-09-19T07:32:06.849610+0000) 2024-09-19T07:32:16.584 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:16 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:16.285+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-19T07:31:50.950305+0000 front 2024-09-19T07:31:50.950333+0000 (oldest deadline 2024-09-19T07:32:15.650382+0000) 2024-09-19T07:32:16.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:16 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:16.272+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:32:16.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:16 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:16.272+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.515166+0000 front 2024-09-19T07:31:12.515206+0000 (oldest deadline 2024-09-19T07:31:36.615343+0000) 2024-09-19T07:32:16.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:16 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:16.272+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:18.316513+0000 front 2024-09-19T07:31:18.316455+0000 (oldest deadline 2024-09-19T07:31:43.616558+0000) 2024-09-19T07:32:16.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:16 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:16.272+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:27.518740+0000 front 2024-09-19T07:31:27.518782+0000 (oldest deadline 2024-09-19T07:31:51.018670+0000) 2024-09-19T07:32:16.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:16 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:16.272+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:37.419876+0000 front 2024-09-19T07:31:37.419797+0000 (oldest deadline 2024-09-19T07:32:00.319962+0000) 2024-09-19T07:32:16.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:16 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:16.272+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:45.020932+0000 front 2024-09-19T07:31:45.020965+0000 (oldest deadline 2024-09-19T07:32:06.720950+0000) 2024-09-19T07:32:16.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:16 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:16.474+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:32:16.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:16 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:16.474+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:32:16.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:16 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:16.474+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:32:16.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:16 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:16.474+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.858371+0000 front 2024-09-19T07:31:36.858566+0000 (oldest deadline 2024-09-19T07:32:01.459028+0000) 2024-09-19T07:32:16.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:16 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:16.474+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:43.760018+0000 front 2024-09-19T07:31:43.760155+0000 (oldest deadline 2024-09-19T07:32:08.460108+0000) 2024-09-19T07:32:16.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:16 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:16.474+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-19T07:31:53.061849+0000 front 2024-09-19T07:31:53.061863+0000 (oldest deadline 2024-09-19T07:32:14.761784+0000) 2024-09-19T07:32:17.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:17 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:17.287+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:02.842153+0000 front 2024-09-19T07:31:02.842300+0000 (oldest deadline 2024-09-19T07:31:28.142247+0000) 2024-09-19T07:32:17.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:17 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:17.287+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:11.543800+0000 front 2024-09-19T07:31:11.543952+0000 (oldest deadline 2024-09-19T07:31:36.243874+0000) 2024-09-19T07:32:17.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:17 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:17.287+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:19.145101+0000 front 2024-09-19T07:31:19.145035+0000 (oldest deadline 2024-09-19T07:31:43.145546+0000) 2024-09-19T07:32:17.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:17 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:17.287+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:28.347129+0000 front 2024-09-19T07:31:28.347192+0000 (oldest deadline 2024-09-19T07:31:52.447192+0000) 2024-09-19T07:32:17.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:17 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:17.287+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.348886+0000 front 2024-09-19T07:31:36.348871+0000 (oldest deadline 2024-09-19T07:31:59.248549+0000) 2024-09-19T07:32:17.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:17 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:17.287+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:42.149818+0000 front 2024-09-19T07:31:42.149734+0000 (oldest deadline 2024-09-19T07:32:06.849610+0000) 2024-09-19T07:32:17.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:17 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9[62158]: 2024-09-19T07:32:17.287+0000 7f84818bb640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-19T07:31:50.950305+0000 front 2024-09-19T07:31:50.950333+0000 (oldest deadline 2024-09-19T07:32:15.650382+0000) 2024-09-19T07:32:17.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:17 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:17.279+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:32:17.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:17 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:17.279+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.515166+0000 front 2024-09-19T07:31:12.515206+0000 (oldest deadline 2024-09-19T07:31:36.615343+0000) 2024-09-19T07:32:17.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:17 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:17.279+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:18.316513+0000 front 2024-09-19T07:31:18.316455+0000 (oldest deadline 2024-09-19T07:31:43.616558+0000) 2024-09-19T07:32:17.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:17 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:17.279+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:27.518740+0000 front 2024-09-19T07:31:27.518782+0000 (oldest deadline 2024-09-19T07:31:51.018670+0000) 2024-09-19T07:32:17.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:17 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:17.279+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:37.419876+0000 front 2024-09-19T07:31:37.419797+0000 (oldest deadline 2024-09-19T07:32:00.319962+0000) 2024-09-19T07:32:17.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:17 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:17.279+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:45.020932+0000 front 2024-09-19T07:31:45.020965+0000 (oldest deadline 2024-09-19T07:32:06.720950+0000) 2024-09-19T07:32:17.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:17 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:17.279+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-19T07:31:50.821705+0000 front 2024-09-19T07:31:50.821718+0000 (oldest deadline 2024-09-19T07:32:16.721765+0000) 2024-09-19T07:32:17.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:17 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:17.501+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:32:17.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:17 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:17.501+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:32:17.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:17 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:17.501+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:32:17.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:17 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:17.501+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.858371+0000 front 2024-09-19T07:31:36.858566+0000 (oldest deadline 2024-09-19T07:32:01.459028+0000) 2024-09-19T07:32:17.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:17 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:17.501+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:43.760018+0000 front 2024-09-19T07:31:43.760155+0000 (oldest deadline 2024-09-19T07:32:08.460108+0000) 2024-09-19T07:32:17.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:17 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:17.501+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-19T07:31:53.061849+0000 front 2024-09-19T07:31:53.061863+0000 (oldest deadline 2024-09-19T07:32:14.761784+0000) 2024-09-19T07:32:18.128 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:17 smithi148 podman[108390]: 2024-09-19 07:32:17.85481479 +0000 UTC m=+5.655788934 container died 71f8f552c731cf3d7ea522b3748f028538eb2b8e2997f2509eda0c648515045f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:32:18.571 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:18 smithi148 podman[108390]: 2024-09-19 07:32:18.312036904 +0000 UTC m=+6.113011104 container cleanup 71f8f552c731cf3d7ea522b3748f028538eb2b8e2997f2509eda0c648515045f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-19T07:32:18.571 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:18 smithi148 bash[108390]: ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9 2024-09-19T07:32:18.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:18 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:18.324+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:32:18.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:18 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:18.324+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.515166+0000 front 2024-09-19T07:31:12.515206+0000 (oldest deadline 2024-09-19T07:31:36.615343+0000) 2024-09-19T07:32:18.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:18 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:18.324+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:18.316513+0000 front 2024-09-19T07:31:18.316455+0000 (oldest deadline 2024-09-19T07:31:43.616558+0000) 2024-09-19T07:32:18.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:18 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:18.324+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:27.518740+0000 front 2024-09-19T07:31:27.518782+0000 (oldest deadline 2024-09-19T07:31:51.018670+0000) 2024-09-19T07:32:18.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:18 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:18.324+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:37.419876+0000 front 2024-09-19T07:31:37.419797+0000 (oldest deadline 2024-09-19T07:32:00.319962+0000) 2024-09-19T07:32:18.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:18 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:18.324+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:45.020932+0000 front 2024-09-19T07:31:45.020965+0000 (oldest deadline 2024-09-19T07:32:06.720950+0000) 2024-09-19T07:32:18.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:18 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:18.324+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-19T07:31:50.821705+0000 front 2024-09-19T07:31:50.821718+0000 (oldest deadline 2024-09-19T07:32:16.721765+0000) 2024-09-19T07:32:18.833 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:18 smithi148 podman[108406]: 2024-09-19 07:32:18.571656206 +0000 UTC m=+0.716575702 container remove 71f8f552c731cf3d7ea522b3748f028538eb2b8e2997f2509eda0c648515045f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-19T07:32:19.022 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:18 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:18.539+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:32:19.022 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:18 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:18.539+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:32:19.022 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:18 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:18.539+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:32:19.022 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:18 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:18.539+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.858371+0000 front 2024-09-19T07:31:36.858566+0000 (oldest deadline 2024-09-19T07:32:01.459028+0000) 2024-09-19T07:32:19.022 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:18 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:18.539+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:43.760018+0000 front 2024-09-19T07:31:43.760155+0000 (oldest deadline 2024-09-19T07:32:08.460108+0000) 2024-09-19T07:32:19.023 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:18 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:18.540+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-19T07:31:53.061849+0000 front 2024-09-19T07:31:53.061863+0000 (oldest deadline 2024-09-19T07:32:14.761784+0000) 2024-09-19T07:32:19.191 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:18 smithi148 podman[108495]: 2024-09-19 07:32:18.823676078 +0000 UTC m=+0.015941989 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:32:19.191 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:18 smithi148 podman[108495]: 2024-09-19 07:32:18.972508703 +0000 UTC m=+0.164774656 container create f349965a9e16194bb925c61c775d9ae698bad81927b7081ee9fd7ed12135f96f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-19T07:32:19.191 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:19 smithi148 podman[108495]: 2024-09-19 07:32:19.191442427 +0000 UTC m=+0.383708354 container init f349965a9e16194bb925c61c775d9ae698bad81927b7081ee9fd7ed12135f96f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:32:19.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:19 smithi148 podman[108495]: 2024-09-19 07:32:19.194833595 +0000 UTC m=+0.387099507 container start f349965a9e16194bb925c61c775d9ae698bad81927b7081ee9fd7ed12135f96f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-19T07:32:19.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:19 smithi148 podman[108495]: 2024-09-19 07:32:19.291729676 +0000 UTC m=+0.483995606 container attach f349965a9e16194bb925c61c775d9ae698bad81927b7081ee9fd7ed12135f96f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-19T07:32:19.583 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:19 smithi148 podman[108495]: 2024-09-19 07:32:19.384826883 +0000 UTC m=+0.577092798 container died f349965a9e16194bb925c61c775d9ae698bad81927b7081ee9fd7ed12135f96f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-19T07:32:19.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:19 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:19.292+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:32:19.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:19 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:19.292+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.515166+0000 front 2024-09-19T07:31:12.515206+0000 (oldest deadline 2024-09-19T07:31:36.615343+0000) 2024-09-19T07:32:19.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:19 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:19.292+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:18.316513+0000 front 2024-09-19T07:31:18.316455+0000 (oldest deadline 2024-09-19T07:31:43.616558+0000) 2024-09-19T07:32:19.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:19 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:19.292+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:27.518740+0000 front 2024-09-19T07:31:27.518782+0000 (oldest deadline 2024-09-19T07:31:51.018670+0000) 2024-09-19T07:32:19.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:19 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:19.292+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:37.419876+0000 front 2024-09-19T07:31:37.419797+0000 (oldest deadline 2024-09-19T07:32:00.319962+0000) 2024-09-19T07:32:19.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:19 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:19.292+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:45.020932+0000 front 2024-09-19T07:31:45.020965+0000 (oldest deadline 2024-09-19T07:32:06.720950+0000) 2024-09-19T07:32:19.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:19 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:19.292+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-19T07:31:50.821705+0000 front 2024-09-19T07:31:50.821718+0000 (oldest deadline 2024-09-19T07:32:16.721765+0000) 2024-09-19T07:32:19.938 INFO:journalctl@ceph.osd.9.smithi148.stdout:Sep 19 07:32:19 smithi148 podman[108518]: 2024-09-19 07:32:19.911511242 +0000 UTC m=+0.520421114 container remove f349965a9e16194bb925c61c775d9ae698bad81927b7081ee9fd7ed12135f96f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-19T07:32:19.945 DEBUG:teuthology.orchestra.run.smithi148:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@osd.9.service' 2024-09-19T07:32:19.987 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:32:19.987 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-19T07:32:19.988 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-19T07:32:19.988 DEBUG:teuthology.orchestra.run.smithi165:> sudo systemctl stop ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@osd.10 2024-09-19T07:32:20.022 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:19 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:19.575+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:32:20.022 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:19 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:19.575+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:32:20.022 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:19 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:19.575+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:32:20.022 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:19 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:19.575+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.858371+0000 front 2024-09-19T07:31:36.858566+0000 (oldest deadline 2024-09-19T07:32:01.459028+0000) 2024-09-19T07:32:20.022 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:19 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:19.575+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:43.760018+0000 front 2024-09-19T07:31:43.760155+0000 (oldest deadline 2024-09-19T07:32:08.460108+0000) 2024-09-19T07:32:20.022 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:19 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:19.575+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-19T07:31:53.061849+0000 front 2024-09-19T07:31:53.061863+0000 (oldest deadline 2024-09-19T07:32:14.761784+0000) 2024-09-19T07:32:20.270 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:20 smithi165 systemd[1]: Stopping Ceph osd.10 for eae8a4a8-7654-11ef-bceb-c7b262605968... 2024-09-19T07:32:20.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:20 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:20.269+0000 7f7e1f15c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:32:20.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:20 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:20.269+0000 7f7e1f15c640 -1 osd.10 110 *** Got signal Terminated *** 2024-09-19T07:32:20.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:20 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:20.269+0000 7f7e1f15c640 -1 osd.10 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T07:32:20.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:20 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:20.272+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:32:20.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:20 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:20.272+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.515166+0000 front 2024-09-19T07:31:12.515206+0000 (oldest deadline 2024-09-19T07:31:36.615343+0000) 2024-09-19T07:32:20.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:20 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:20.272+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:18.316513+0000 front 2024-09-19T07:31:18.316455+0000 (oldest deadline 2024-09-19T07:31:43.616558+0000) 2024-09-19T07:32:20.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:20 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:20.272+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:27.518740+0000 front 2024-09-19T07:31:27.518782+0000 (oldest deadline 2024-09-19T07:31:51.018670+0000) 2024-09-19T07:32:20.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:20 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:20.272+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:37.419876+0000 front 2024-09-19T07:31:37.419797+0000 (oldest deadline 2024-09-19T07:32:00.319962+0000) 2024-09-19T07:32:20.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:20 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:20.272+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:45.020932+0000 front 2024-09-19T07:31:45.020965+0000 (oldest deadline 2024-09-19T07:32:06.720950+0000) 2024-09-19T07:32:20.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:20 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:20.272+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-19T07:31:50.821705+0000 front 2024-09-19T07:31:50.821718+0000 (oldest deadline 2024-09-19T07:32:16.721765+0000) 2024-09-19T07:32:21.022 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:20 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:20.535+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:32:21.022 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:20 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:20.535+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:32:21.022 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:20 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:20.535+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:32:21.022 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:20 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:20.535+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.858371+0000 front 2024-09-19T07:31:36.858566+0000 (oldest deadline 2024-09-19T07:32:01.459028+0000) 2024-09-19T07:32:21.022 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:20 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:20.535+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:43.760018+0000 front 2024-09-19T07:31:43.760155+0000 (oldest deadline 2024-09-19T07:32:08.460108+0000) 2024-09-19T07:32:21.022 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:20 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:20.535+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-19T07:31:53.061849+0000 front 2024-09-19T07:31:53.061863+0000 (oldest deadline 2024-09-19T07:32:14.761784+0000) 2024-09-19T07:32:21.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:21 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:21.268+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:32:21.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:21 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:21.268+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.515166+0000 front 2024-09-19T07:31:12.515206+0000 (oldest deadline 2024-09-19T07:31:36.615343+0000) 2024-09-19T07:32:21.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:21 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:21.268+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:18.316513+0000 front 2024-09-19T07:31:18.316455+0000 (oldest deadline 2024-09-19T07:31:43.616558+0000) 2024-09-19T07:32:21.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:21 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:21.268+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:27.518740+0000 front 2024-09-19T07:31:27.518782+0000 (oldest deadline 2024-09-19T07:31:51.018670+0000) 2024-09-19T07:32:21.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:21 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:21.268+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:37.419876+0000 front 2024-09-19T07:31:37.419797+0000 (oldest deadline 2024-09-19T07:32:00.319962+0000) 2024-09-19T07:32:21.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:21 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:21.268+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:45.020932+0000 front 2024-09-19T07:31:45.020965+0000 (oldest deadline 2024-09-19T07:32:06.720950+0000) 2024-09-19T07:32:21.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:21 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:21.268+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-19T07:31:50.821705+0000 front 2024-09-19T07:31:50.821718+0000 (oldest deadline 2024-09-19T07:32:16.721765+0000) 2024-09-19T07:32:22.022 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:21 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:21.535+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:32:22.022 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:21 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:21.535+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:32:22.022 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:21 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:21.535+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:32:22.022 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:21 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:21.535+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.858371+0000 front 2024-09-19T07:31:36.858566+0000 (oldest deadline 2024-09-19T07:32:01.459028+0000) 2024-09-19T07:32:22.022 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:21 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:21.535+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:43.760018+0000 front 2024-09-19T07:31:43.760155+0000 (oldest deadline 2024-09-19T07:32:08.460108+0000) 2024-09-19T07:32:22.023 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:21 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:21.535+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-19T07:31:53.061849+0000 front 2024-09-19T07:31:53.061863+0000 (oldest deadline 2024-09-19T07:32:14.761784+0000) 2024-09-19T07:32:22.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:22 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:22.219+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:32:22.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:22 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:22.219+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.515166+0000 front 2024-09-19T07:31:12.515206+0000 (oldest deadline 2024-09-19T07:31:36.615343+0000) 2024-09-19T07:32:22.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:22 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:22.219+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:18.316513+0000 front 2024-09-19T07:31:18.316455+0000 (oldest deadline 2024-09-19T07:31:43.616558+0000) 2024-09-19T07:32:22.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:22 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:22.219+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:27.518740+0000 front 2024-09-19T07:31:27.518782+0000 (oldest deadline 2024-09-19T07:31:51.018670+0000) 2024-09-19T07:32:22.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:22 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:22.219+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:37.419876+0000 front 2024-09-19T07:31:37.419797+0000 (oldest deadline 2024-09-19T07:32:00.319962+0000) 2024-09-19T07:32:22.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:22 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:22.219+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:45.020932+0000 front 2024-09-19T07:31:45.020965+0000 (oldest deadline 2024-09-19T07:32:06.720950+0000) 2024-09-19T07:32:22.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:22 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:22.219+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-19T07:31:50.821705+0000 front 2024-09-19T07:31:50.821718+0000 (oldest deadline 2024-09-19T07:32:16.721765+0000) 2024-09-19T07:32:23.022 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:22 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:22.583+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:32:23.022 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:22 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:22.583+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:32:23.022 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:22 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:22.583+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:32:23.022 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:22 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:22.583+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.858371+0000 front 2024-09-19T07:31:36.858566+0000 (oldest deadline 2024-09-19T07:32:01.459028+0000) 2024-09-19T07:32:23.023 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:22 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:22.583+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:43.760018+0000 front 2024-09-19T07:31:43.760155+0000 (oldest deadline 2024-09-19T07:32:08.460108+0000) 2024-09-19T07:32:23.023 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:22 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:22.583+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-19T07:31:53.061849+0000 front 2024-09-19T07:31:53.061863+0000 (oldest deadline 2024-09-19T07:32:14.761784+0000) 2024-09-19T07:32:23.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:23 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:23.216+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:32:23.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:23 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:23.216+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.515166+0000 front 2024-09-19T07:31:12.515206+0000 (oldest deadline 2024-09-19T07:31:36.615343+0000) 2024-09-19T07:32:23.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:23 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:23.216+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:18.316513+0000 front 2024-09-19T07:31:18.316455+0000 (oldest deadline 2024-09-19T07:31:43.616558+0000) 2024-09-19T07:32:23.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:23 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:23.216+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:27.518740+0000 front 2024-09-19T07:31:27.518782+0000 (oldest deadline 2024-09-19T07:31:51.018670+0000) 2024-09-19T07:32:23.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:23 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:23.216+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:37.419876+0000 front 2024-09-19T07:31:37.419797+0000 (oldest deadline 2024-09-19T07:32:00.319962+0000) 2024-09-19T07:32:23.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:23 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:23.216+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:45.020932+0000 front 2024-09-19T07:31:45.020965+0000 (oldest deadline 2024-09-19T07:32:06.720950+0000) 2024-09-19T07:32:23.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:23 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:23.216+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-19T07:31:50.821705+0000 front 2024-09-19T07:31:50.821718+0000 (oldest deadline 2024-09-19T07:32:16.721765+0000) 2024-09-19T07:32:24.022 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:23 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:23.537+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:32:24.022 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:23 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:23.537+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:32:24.022 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:23 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:23.537+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:32:24.022 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:23 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:23.537+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.858371+0000 front 2024-09-19T07:31:36.858566+0000 (oldest deadline 2024-09-19T07:32:01.459028+0000) 2024-09-19T07:32:24.022 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:23 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:23.537+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:43.760018+0000 front 2024-09-19T07:31:43.760155+0000 (oldest deadline 2024-09-19T07:32:08.460108+0000) 2024-09-19T07:32:24.023 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:23 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:23.537+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-19T07:31:53.061849+0000 front 2024-09-19T07:31:53.061863+0000 (oldest deadline 2024-09-19T07:32:14.761784+0000) 2024-09-19T07:32:24.636 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:24 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:24.210+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:32:24.636 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:24 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:24.210+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.515166+0000 front 2024-09-19T07:31:12.515206+0000 (oldest deadline 2024-09-19T07:31:36.615343+0000) 2024-09-19T07:32:24.636 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:24 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:24.210+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:18.316513+0000 front 2024-09-19T07:31:18.316455+0000 (oldest deadline 2024-09-19T07:31:43.616558+0000) 2024-09-19T07:32:24.637 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:24 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:24.210+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:27.518740+0000 front 2024-09-19T07:31:27.518782+0000 (oldest deadline 2024-09-19T07:31:51.018670+0000) 2024-09-19T07:32:24.637 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:24 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:24.210+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:37.419876+0000 front 2024-09-19T07:31:37.419797+0000 (oldest deadline 2024-09-19T07:32:00.319962+0000) 2024-09-19T07:32:24.637 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:24 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:24.210+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:45.020932+0000 front 2024-09-19T07:31:45.020965+0000 (oldest deadline 2024-09-19T07:32:06.720950+0000) 2024-09-19T07:32:24.637 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:24 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:24.210+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-19T07:31:50.821705+0000 front 2024-09-19T07:31:50.821718+0000 (oldest deadline 2024-09-19T07:32:16.721765+0000) 2024-09-19T07:32:25.022 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:24 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:24.527+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:32:25.022 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:24 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:24.527+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:32:25.022 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:24 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:24.527+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:32:25.022 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:24 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:24.527+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.858371+0000 front 2024-09-19T07:31:36.858566+0000 (oldest deadline 2024-09-19T07:32:01.459028+0000) 2024-09-19T07:32:25.023 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:24 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:24.527+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:43.760018+0000 front 2024-09-19T07:31:43.760155+0000 (oldest deadline 2024-09-19T07:32:08.460108+0000) 2024-09-19T07:32:25.023 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:24 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:24.527+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-19T07:31:53.061849+0000 front 2024-09-19T07:31:53.061863+0000 (oldest deadline 2024-09-19T07:32:14.761784+0000) 2024-09-19T07:32:25.023 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:24 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:24.527+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6820 osd.7 since back 2024-09-19T07:31:58.262956+0000 front 2024-09-19T07:31:58.262790+0000 (oldest deadline 2024-09-19T07:32:24.162624+0000) 2024-09-19T07:32:25.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:25 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:25.194+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:03.412975+0000 front 2024-09-19T07:31:03.413092+0000 (oldest deadline 2024-09-19T07:31:26.912954+0000) 2024-09-19T07:32:25.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:25 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:25.194+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:12.515166+0000 front 2024-09-19T07:31:12.515206+0000 (oldest deadline 2024-09-19T07:31:36.615343+0000) 2024-09-19T07:32:25.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:25 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:25.194+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:18.316513+0000 front 2024-09-19T07:31:18.316455+0000 (oldest deadline 2024-09-19T07:31:43.616558+0000) 2024-09-19T07:32:25.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:25 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:25.194+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6814 osd.3 since back 2024-09-19T07:31:27.518740+0000 front 2024-09-19T07:31:27.518782+0000 (oldest deadline 2024-09-19T07:31:51.018670+0000) 2024-09-19T07:32:25.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:25 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:25.194+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:37.419876+0000 front 2024-09-19T07:31:37.419797+0000 (oldest deadline 2024-09-19T07:32:00.319962+0000) 2024-09-19T07:32:25.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:25 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:25.194+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:45.020932+0000 front 2024-09-19T07:31:45.020965+0000 (oldest deadline 2024-09-19T07:32:06.720950+0000) 2024-09-19T07:32:25.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:25 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10[59924]: 2024-09-19T07:32:25.194+0000 7f7e17759640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-19T07:31:50.821705+0000 front 2024-09-19T07:31:50.821718+0000 (oldest deadline 2024-09-19T07:32:16.721765+0000) 2024-09-19T07:32:25.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:25 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:25.483+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:32:25.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:25 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:25.483+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:32:25.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:25 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:25.483+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:32:25.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:25 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:25.483+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.858371+0000 front 2024-09-19T07:31:36.858566+0000 (oldest deadline 2024-09-19T07:32:01.459028+0000) 2024-09-19T07:32:25.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:25 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:25.483+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:43.760018+0000 front 2024-09-19T07:31:43.760155+0000 (oldest deadline 2024-09-19T07:32:08.460108+0000) 2024-09-19T07:32:25.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:25 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:25.483+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-19T07:31:53.061849+0000 front 2024-09-19T07:31:53.061863+0000 (oldest deadline 2024-09-19T07:32:14.761784+0000) 2024-09-19T07:32:25.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:25 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:25.483+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6820 osd.7 since back 2024-09-19T07:31:58.262956+0000 front 2024-09-19T07:31:58.262790+0000 (oldest deadline 2024-09-19T07:32:24.162624+0000) 2024-09-19T07:32:26.133 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:25 smithi165 podman[73819]: 2024-09-19 07:32:25.835533458 +0000 UTC m=+5.651008522 container died 9ddbfcb0d27a0f3130d930a798388d599949339e403985961dd8c88fba5fc09e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:32:26.633 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:26 smithi165 podman[73819]: 2024-09-19 07:32:26.144001199 +0000 UTC m=+5.959476262 container cleanup 9ddbfcb0d27a0f3130d930a798388d599949339e403985961dd8c88fba5fc09e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:32:26.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:26 smithi165 bash[73819]: ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10 2024-09-19T07:32:26.634 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:26 smithi165 podman[73838]: 2024-09-19 07:32:26.336903232 +0000 UTC m=+0.498396770 container remove 9ddbfcb0d27a0f3130d930a798388d599949339e403985961dd8c88fba5fc09e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux ) 2024-09-19T07:32:26.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:26 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:26.450+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:32:26.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:26 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:26.450+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:32:26.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:26 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:26.450+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:32:26.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:26 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:26.450+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.858371+0000 front 2024-09-19T07:31:36.858566+0000 (oldest deadline 2024-09-19T07:32:01.459028+0000) 2024-09-19T07:32:26.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:26 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:26.450+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:43.760018+0000 front 2024-09-19T07:31:43.760155+0000 (oldest deadline 2024-09-19T07:32:08.460108+0000) 2024-09-19T07:32:26.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:26 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:26.450+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-19T07:31:53.061849+0000 front 2024-09-19T07:31:53.061863+0000 (oldest deadline 2024-09-19T07:32:14.761784+0000) 2024-09-19T07:32:26.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:26 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:26.450+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6820 osd.7 since back 2024-09-19T07:31:58.262956+0000 front 2024-09-19T07:31:58.262790+0000 (oldest deadline 2024-09-19T07:32:24.162624+0000) 2024-09-19T07:32:27.023 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:26 smithi165 podman[73922]: 2024-09-19 07:32:26.666838608 +0000 UTC m=+0.016076020 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:32:27.023 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:26 smithi165 podman[73922]: 2024-09-19 07:32:26.787689444 +0000 UTC m=+0.136926836 container create b10da739b16be6c227c0a77421344b14463402f4bafc51faa8bad886c30e75d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-19T07:32:27.295 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:27 smithi165 podman[73922]: 2024-09-19 07:32:27.023331626 +0000 UTC m=+0.372569019 container init b10da739b16be6c227c0a77421344b14463402f4bafc51faa8bad886c30e75d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:32:27.295 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:27 smithi165 podman[73922]: 2024-09-19 07:32:27.027028125 +0000 UTC m=+0.376265519 container start b10da739b16be6c227c0a77421344b14463402f4bafc51faa8bad886c30e75d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-19T07:32:27.295 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:27 smithi165 podman[73922]: 2024-09-19 07:32:27.098137048 +0000 UTC m=+0.447374445 container attach b10da739b16be6c227c0a77421344b14463402f4bafc51faa8bad886c30e75d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:32:27.295 INFO:journalctl@ceph.osd.10.smithi165.stdout:Sep 19 07:32:27 smithi165 podman[73922]: 2024-09-19 07:32:27.220555941 +0000 UTC m=+0.569793338 container died b10da739b16be6c227c0a77421344b14463402f4bafc51faa8bad886c30e75d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-19T07:32:27.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:27 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:27.433+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:32:27.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:27 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:27.433+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:32:27.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:27 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:27.433+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:32:27.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:27 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:27.433+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.858371+0000 front 2024-09-19T07:31:36.858566+0000 (oldest deadline 2024-09-19T07:32:01.459028+0000) 2024-09-19T07:32:27.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:27 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:27.433+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:43.760018+0000 front 2024-09-19T07:31:43.760155+0000 (oldest deadline 2024-09-19T07:32:08.460108+0000) 2024-09-19T07:32:27.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:27 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:27.433+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-19T07:31:53.061849+0000 front 2024-09-19T07:31:53.061863+0000 (oldest deadline 2024-09-19T07:32:14.761784+0000) 2024-09-19T07:32:27.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:27 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:27.433+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6820 osd.7 since back 2024-09-19T07:31:58.262956+0000 front 2024-09-19T07:31:58.262790+0000 (oldest deadline 2024-09-19T07:32:24.162624+0000) 2024-09-19T07:32:27.876 DEBUG:teuthology.orchestra.run.smithi165:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@osd.10.service' 2024-09-19T07:32:27.914 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:32:27.914 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-19T07:32:27.914 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-19T07:32:27.914 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@osd.11 2024-09-19T07:32:28.222 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:27 smithi179 systemd[1]: Stopping Ceph osd.11 for eae8a4a8-7654-11ef-bceb-c7b262605968... 2024-09-19T07:32:28.522 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:28 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:28.221+0000 7f5c22332640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:32:28.522 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:28 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:28.221+0000 7f5c22332640 -1 osd.11 110 *** Got signal Terminated *** 2024-09-19T07:32:28.522 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:28 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:28.221+0000 7f5c22332640 -1 osd.11 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T07:32:28.522 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:28 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:28.401+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:32:28.523 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:28 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:28.401+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:32:28.523 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:28 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:28.401+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:32:28.523 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:28 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:28.401+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.858371+0000 front 2024-09-19T07:31:36.858566+0000 (oldest deadline 2024-09-19T07:32:01.459028+0000) 2024-09-19T07:32:28.523 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:28 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:28.401+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:43.760018+0000 front 2024-09-19T07:31:43.760155+0000 (oldest deadline 2024-09-19T07:32:08.460108+0000) 2024-09-19T07:32:28.523 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:28 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:28.401+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-19T07:31:53.061849+0000 front 2024-09-19T07:31:53.061863+0000 (oldest deadline 2024-09-19T07:32:14.761784+0000) 2024-09-19T07:32:28.523 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:28 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:28.401+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6820 osd.7 since back 2024-09-19T07:31:58.262956+0000 front 2024-09-19T07:31:58.262790+0000 (oldest deadline 2024-09-19T07:32:24.162624+0000) 2024-09-19T07:32:29.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:29 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:29.442+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:32:29.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:29 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:29.442+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:32:29.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:29 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:29.442+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:32:29.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:29 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:29.442+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.858371+0000 front 2024-09-19T07:31:36.858566+0000 (oldest deadline 2024-09-19T07:32:01.459028+0000) 2024-09-19T07:32:29.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:29 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:29.442+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:43.760018+0000 front 2024-09-19T07:31:43.760155+0000 (oldest deadline 2024-09-19T07:32:08.460108+0000) 2024-09-19T07:32:29.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:29 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:29.442+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-19T07:31:53.061849+0000 front 2024-09-19T07:31:53.061863+0000 (oldest deadline 2024-09-19T07:32:14.761784+0000) 2024-09-19T07:32:29.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:29 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:29.442+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6820 osd.7 since back 2024-09-19T07:31:58.262956+0000 front 2024-09-19T07:31:58.262790+0000 (oldest deadline 2024-09-19T07:32:24.162624+0000) 2024-09-19T07:32:30.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:30 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:30.411+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:32:30.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:30 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:30.411+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:32:30.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:30 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:30.411+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:32:30.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:30 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:30.411+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.858371+0000 front 2024-09-19T07:31:36.858566+0000 (oldest deadline 2024-09-19T07:32:01.459028+0000) 2024-09-19T07:32:30.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:30 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:30.411+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:43.760018+0000 front 2024-09-19T07:31:43.760155+0000 (oldest deadline 2024-09-19T07:32:08.460108+0000) 2024-09-19T07:32:30.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:30 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:30.411+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-19T07:31:53.061849+0000 front 2024-09-19T07:31:53.061863+0000 (oldest deadline 2024-09-19T07:32:14.761784+0000) 2024-09-19T07:32:30.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:30 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:30.411+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6820 osd.7 since back 2024-09-19T07:31:58.262956+0000 front 2024-09-19T07:31:58.262790+0000 (oldest deadline 2024-09-19T07:32:24.162624+0000) 2024-09-19T07:32:31.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:31 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:31.450+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:32:31.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:31 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:31.450+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:32:31.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:31 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:31.450+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:32:31.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:31 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:31.450+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.858371+0000 front 2024-09-19T07:31:36.858566+0000 (oldest deadline 2024-09-19T07:32:01.459028+0000) 2024-09-19T07:32:31.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:31 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:31.450+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:43.760018+0000 front 2024-09-19T07:31:43.760155+0000 (oldest deadline 2024-09-19T07:32:08.460108+0000) 2024-09-19T07:32:31.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:31 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:31.450+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-19T07:31:53.061849+0000 front 2024-09-19T07:31:53.061863+0000 (oldest deadline 2024-09-19T07:32:14.761784+0000) 2024-09-19T07:32:31.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:31 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:31.450+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6820 osd.7 since back 2024-09-19T07:31:58.262956+0000 front 2024-09-19T07:31:58.262790+0000 (oldest deadline 2024-09-19T07:32:24.162624+0000) 2024-09-19T07:32:32.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:32 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:32.482+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-09-19T07:31:04.953205+0000 front 2024-09-19T07:31:04.953275+0000 (oldest deadline 2024-09-19T07:31:27.253091+0000) 2024-09-19T07:32:32.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:32 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:32.482+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6804 osd.1 since back 2024-09-19T07:31:10.753905+0000 front 2024-09-19T07:31:10.754028+0000 (oldest deadline 2024-09-19T07:31:34.254041+0000) 2024-09-19T07:32:32.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:32 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:32.482+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6804 osd.2 since back 2024-09-19T07:31:20.655516+0000 front 2024-09-19T07:31:20.655313+0000 (oldest deadline 2024-09-19T07:31:42.355486+0000) 2024-09-19T07:32:32.772 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:32 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:32.482+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6812 osd.4 since back 2024-09-19T07:31:36.858371+0000 front 2024-09-19T07:31:36.858566+0000 (oldest deadline 2024-09-19T07:32:01.459028+0000) 2024-09-19T07:32:32.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:32 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:32.482+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.179:6812 osd.5 since back 2024-09-19T07:31:43.760018+0000 front 2024-09-19T07:31:43.760155+0000 (oldest deadline 2024-09-19T07:32:08.460108+0000) 2024-09-19T07:32:32.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:32 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:32.482+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.148:6822 osd.6 since back 2024-09-19T07:31:53.061849+0000 front 2024-09-19T07:31:53.061863+0000 (oldest deadline 2024-09-19T07:32:14.761784+0000) 2024-09-19T07:32:32.773 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:32 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11[60667]: 2024-09-19T07:32:32.482+0000 7f5c1a92f640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.165:6820 osd.7 since back 2024-09-19T07:31:58.262956+0000 front 2024-09-19T07:31:58.262790+0000 (oldest deadline 2024-09-19T07:32:24.162624+0000) 2024-09-19T07:32:33.996 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:33 smithi179 podman[74436]: 2024-09-19 07:32:33.741310213 +0000 UTC m=+5.631616714 container died 88eaa425856cd9f7a4aa9616adfe270ddaac00308481b7ba463e950ba24930a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True) 2024-09-19T07:32:34.272 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:34 smithi179 podman[74436]: 2024-09-19 07:32:34.087648589 +0000 UTC m=+5.977955090 container cleanup 88eaa425856cd9f7a4aa9616adfe270ddaac00308481b7ba463e950ba24930a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-19T07:32:34.272 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:34 smithi179 bash[74436]: ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11 2024-09-19T07:32:34.699 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:34 smithi179 podman[74452]: 2024-09-19 07:32:34.29721958 +0000 UTC m=+0.551381363 container remove 88eaa425856cd9f7a4aa9616adfe270ddaac00308481b7ba463e950ba24930a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-19T07:32:34.992 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:34 smithi179 podman[74541]: 2024-09-19 07:32:34.602577181 +0000 UTC m=+0.015816124 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:32:34.992 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:34 smithi179 podman[74541]: 2024-09-19 07:32:34.706140548 +0000 UTC m=+0.119379497 container create 5d05115883da1068d16e97b0befba5ad057d57ca71cb9f2591a656e8dcb84c2c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-19T07:32:34.992 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:34 smithi179 podman[74541]: 2024-09-19 07:32:34.92555564 +0000 UTC m=+0.338794596 container init 5d05115883da1068d16e97b0befba5ad057d57ca71cb9f2591a656e8dcb84c2c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-19T07:32:34.992 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:34 smithi179 podman[74541]: 2024-09-19 07:32:34.928755713 +0000 UTC m=+0.341994656 container start 5d05115883da1068d16e97b0befba5ad057d57ca71cb9f2591a656e8dcb84c2c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2) 2024-09-19T07:32:34.992 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:34 smithi179 podman[74541]: 2024-09-19 07:32:34.992093914 +0000 UTC m=+0.405332858 container attach 5d05115883da1068d16e97b0befba5ad057d57ca71cb9f2591a656e8dcb84c2c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11-deactivate, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-19T07:32:35.272 INFO:journalctl@ceph.osd.11.smithi179.stdout:Sep 19 07:32:35 smithi179 podman[74541]: 2024-09-19 07:32:35.111725218 +0000 UTC m=+0.524964174 container died 5d05115883da1068d16e97b0befba5ad057d57ca71cb9f2591a656e8dcb84c2c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2) 2024-09-19T07:32:35.674 DEBUG:teuthology.orchestra.run.smithi179:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@osd.11.service' 2024-09-19T07:32:35.714 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:32:35.714 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-19T07:32:35.715 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-19T07:32:35.715 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mds.a 2024-09-19T07:32:36.080 INFO:journalctl@ceph.mds.a.smithi148.stdout:Sep 19 07:32:35 smithi148 systemd[1]: Stopping Ceph mds.a for eae8a4a8-7654-11ef-bceb-c7b262605968... 2024-09-19T07:32:36.333 INFO:journalctl@ceph.mds.a.smithi148.stdout:Sep 19 07:32:36 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-a[69168]: 2024-09-19T07:32:36.079+0000 7fc1e536c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:32:36.333 INFO:journalctl@ceph.mds.a.smithi148.stdout:Sep 19 07:32:36 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-a[69168]: 2024-09-19T07:32:36.079+0000 7fc1e536c640 -1 mds.a *** got signal Terminated *** 2024-09-19T07:32:39.563 INFO:journalctl@ceph.mds.a.smithi148.stdout:Sep 19 07:32:39 smithi148 podman[108612]: 2024-09-19 07:32:39.225285591 +0000 UTC m=+3.317456170 container died 7fa2e17b51b11d0002b4e4dc2eec0dfd0eabdafbcd838af8fcaf6604afbffb46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-a, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True) 2024-09-19T07:32:39.833 INFO:journalctl@ceph.mds.a.smithi148.stdout:Sep 19 07:32:39 smithi148 podman[108612]: 2024-09-19 07:32:39.746223367 +0000 UTC m=+3.838394001 container cleanup 7fa2e17b51b11d0002b4e4dc2eec0dfd0eabdafbcd838af8fcaf6604afbffb46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-a, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-19T07:32:39.833 INFO:journalctl@ceph.mds.a.smithi148.stdout:Sep 19 07:32:39 smithi148 bash[108612]: ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-a 2024-09-19T07:32:40.223 INFO:journalctl@ceph.mds.a.smithi148.stdout:Sep 19 07:32:39 smithi148 podman[108626]: 2024-09-19 07:32:39.972731664 +0000 UTC m=+0.740453037 container remove 7fa2e17b51b11d0002b4e4dc2eec0dfd0eabdafbcd838af8fcaf6604afbffb46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-19T07:32:40.227 DEBUG:teuthology.orchestra.run.smithi148:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mds.a.service' 2024-09-19T07:32:40.263 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:32:40.263 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-19T07:32:40.263 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-19T07:32:40.264 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mds.d 2024-09-19T07:32:40.576 INFO:journalctl@ceph.mds.d.smithi148.stdout:Sep 19 07:32:40 smithi148 systemd[1]: Stopping Ceph mds.d for eae8a4a8-7654-11ef-bceb-c7b262605968... 2024-09-19T07:32:40.833 INFO:journalctl@ceph.mds.d.smithi148.stdout:Sep 19 07:32:40 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-d[67984]: 2024-09-19T07:32:40.575+0000 7f212fcdb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:32:40.833 INFO:journalctl@ceph.mds.d.smithi148.stdout:Sep 19 07:32:40 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-d[67984]: 2024-09-19T07:32:40.575+0000 7f212fcdb640 -1 mds.d *** got signal Terminated *** 2024-09-19T07:32:44.876 INFO:journalctl@ceph.mds.d.smithi148.stdout:Sep 19 07:32:44 smithi148 podman[108734]: 2024-09-19 07:32:44.589151611 +0000 UTC m=+4.110908948 container died bd659d4c6ecdcd1c6ad40ab091d294fd4cbd55fd351ab7b36167961a68aa4aff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-19T07:32:45.201 INFO:journalctl@ceph.mds.d.smithi148.stdout:Sep 19 07:32:44 smithi148 podman[108734]: 2024-09-19 07:32:44.991374218 +0000 UTC m=+4.513131556 container cleanup bd659d4c6ecdcd1c6ad40ab091d294fd4cbd55fd351ab7b36167961a68aa4aff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-d, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-19T07:32:45.201 INFO:journalctl@ceph.mds.d.smithi148.stdout:Sep 19 07:32:44 smithi148 bash[108734]: ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-d 2024-09-19T07:32:45.435 DEBUG:teuthology.orchestra.run.smithi148:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mds.d.service' 2024-09-19T07:32:45.457 INFO:journalctl@ceph.mds.d.smithi148.stdout:Sep 19 07:32:45 smithi148 podman[108749]: 2024-09-19 07:32:45.201107704 +0000 UTC m=+0.612337468 container remove bd659d4c6ecdcd1c6ad40ab091d294fd4cbd55fd351ab7b36167961a68aa4aff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-d, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:32:45.457 INFO:journalctl@ceph.mds.d.smithi148.stdout:Sep 19 07:32:45 smithi148 systemd[1]: ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mds.d.service: Deactivated successfully. 2024-09-19T07:32:45.457 INFO:journalctl@ceph.mds.d.smithi148.stdout:Sep 19 07:32:45 smithi148 systemd[1]: Stopped Ceph mds.d for eae8a4a8-7654-11ef-bceb-c7b262605968. 2024-09-19T07:32:45.457 INFO:journalctl@ceph.mds.d.smithi148.stdout:Sep 19 07:32:45 smithi148 systemd[1]: ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mds.d.service: Consumed 1.149s CPU time. 2024-09-19T07:32:45.469 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:32:45.469 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-19T07:32:45.469 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-19T07:32:45.469 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mds.g 2024-09-19T07:32:45.779 INFO:journalctl@ceph.mds.g.smithi148.stdout:Sep 19 07:32:45 smithi148 systemd[1]: Stopping Ceph mds.g for eae8a4a8-7654-11ef-bceb-c7b262605968... 2024-09-19T07:32:46.082 INFO:journalctl@ceph.mds.g.smithi148.stdout:Sep 19 07:32:45 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-g[68754]: 2024-09-19T07:32:45.778+0000 7f16b7527640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:32:46.083 INFO:journalctl@ceph.mds.g.smithi148.stdout:Sep 19 07:32:45 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-g[68754]: 2024-09-19T07:32:45.778+0000 7f16b7527640 -1 mds.g *** got signal Terminated *** 2024-09-19T07:32:47.833 INFO:journalctl@ceph.mds.g.smithi148.stdout:Sep 19 07:32:47 smithi148 podman[108857]: 2024-09-19 07:32:47.572076958 +0000 UTC m=+1.886912195 container died 0244447b28e5a87c69c7bf3db9cd9368180e54ad46be48c2e3beae6d2bbd2e23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-g, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True) 2024-09-19T07:32:48.188 INFO:journalctl@ceph.mds.g.smithi148.stdout:Sep 19 07:32:48 smithi148 podman[108857]: 2024-09-19 07:32:48.003659322 +0000 UTC m=+2.318494567 container cleanup 0244447b28e5a87c69c7bf3db9cd9368180e54ad46be48c2e3beae6d2bbd2e23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-g, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:32:48.188 INFO:journalctl@ceph.mds.g.smithi148.stdout:Sep 19 07:32:48 smithi148 bash[108857]: ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-g 2024-09-19T07:32:48.434 DEBUG:teuthology.orchestra.run.smithi148:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mds.g.service' 2024-09-19T07:32:48.457 INFO:journalctl@ceph.mds.g.smithi148.stdout:Sep 19 07:32:48 smithi148 podman[108869]: 2024-09-19 07:32:48.188120389 +0000 UTC m=+0.616170822 container remove 0244447b28e5a87c69c7bf3db9cd9368180e54ad46be48c2e3beae6d2bbd2e23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-g, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:32:48.457 INFO:journalctl@ceph.mds.g.smithi148.stdout:Sep 19 07:32:48 smithi148 systemd[1]: ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mds.g.service: Deactivated successfully. 2024-09-19T07:32:48.457 INFO:journalctl@ceph.mds.g.smithi148.stdout:Sep 19 07:32:48 smithi148 systemd[1]: Stopped Ceph mds.g for eae8a4a8-7654-11ef-bceb-c7b262605968. 2024-09-19T07:32:48.457 INFO:journalctl@ceph.mds.g.smithi148.stdout:Sep 19 07:32:48 smithi148 systemd[1]: ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mds.g.service: Consumed 1.130s CPU time. 2024-09-19T07:32:48.466 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:32:48.467 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-19T07:32:48.467 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-19T07:32:48.467 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mds.j 2024-09-19T07:32:48.799 INFO:journalctl@ceph.mds.j.smithi148.stdout:Sep 19 07:32:48 smithi148 systemd[1]: Stopping Ceph mds.j for eae8a4a8-7654-11ef-bceb-c7b262605968... 2024-09-19T07:32:49.082 INFO:journalctl@ceph.mds.j.smithi148.stdout:Sep 19 07:32:48 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-j[67572]: 2024-09-19T07:32:48.798+0000 7f959c33f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:32:49.083 INFO:journalctl@ceph.mds.j.smithi148.stdout:Sep 19 07:32:48 smithi148 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-j[67572]: 2024-09-19T07:32:48.798+0000 7f959c33f640 -1 mds.j *** got signal Terminated *** 2024-09-19T07:32:53.082 INFO:journalctl@ceph.mds.j.smithi148.stdout:Sep 19 07:32:52 smithi148 podman[108978]: 2024-09-19 07:32:52.804419458 +0000 UTC m=+4.111971370 container died dd7931079e2177e8d1c199c484b0b152038b1553f89e66905b972d1d74ec2344 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-j, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-19T07:32:53.333 INFO:journalctl@ceph.mds.j.smithi148.stdout:Sep 19 07:32:53 smithi148 podman[108978]: 2024-09-19 07:32:53.190503095 +0000 UTC m=+4.498055013 container cleanup dd7931079e2177e8d1c199c484b0b152038b1553f89e66905b972d1d74ec2344 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-19T07:32:53.333 INFO:journalctl@ceph.mds.j.smithi148.stdout:Sep 19 07:32:53 smithi148 bash[108978]: ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-j 2024-09-19T07:32:53.614 DEBUG:teuthology.orchestra.run.smithi148:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mds.j.service' 2024-09-19T07:32:53.645 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:32:53.646 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-19T07:32:53.646 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-19T07:32:53.646 DEBUG:teuthology.orchestra.run.smithi165:> sudo systemctl stop ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mds.b 2024-09-19T07:32:53.943 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:32:53 smithi165 systemd[1]: Stopping Ceph mds.b for eae8a4a8-7654-11ef-bceb-c7b262605968... 2024-09-19T07:32:54.383 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:32:53 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:32:53.941+0000 7fcd2af63640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:32:54.383 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:32:53 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b[65585]: 2024-09-19T07:32:53.941+0000 7fcd2af63640 -1 mds.b *** got signal Terminated *** 2024-09-19T07:32:58.249 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:32:57 smithi165 podman[74036]: 2024-09-19 07:32:57.950874152 +0000 UTC m=+4.105854091 container died db467f6599bcc454824df7f3738beb6dc258a0d8d74fd301d12c88f9685c850c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:32:58.633 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:32:58 smithi165 podman[74036]: 2024-09-19 07:32:58.300189922 +0000 UTC m=+4.455169848 container cleanup db467f6599bcc454824df7f3738beb6dc258a0d8d74fd301d12c88f9685c850c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True) 2024-09-19T07:32:58.634 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:32:58 smithi165 bash[74036]: ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b 2024-09-19T07:32:58.634 INFO:journalctl@ceph.mds.b.smithi165.stdout:Sep 19 07:32:58 smithi165 podman[74050]: 2024-09-19 07:32:58.484581719 +0000 UTC m=+0.525979648 container remove db467f6599bcc454824df7f3738beb6dc258a0d8d74fd301d12c88f9685c850c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-19T07:32:58.716 DEBUG:teuthology.orchestra.run.smithi165:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mds.b.service' 2024-09-19T07:32:58.753 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:32:58.753 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-19T07:32:58.754 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-19T07:32:58.754 DEBUG:teuthology.orchestra.run.smithi165:> sudo systemctl stop ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mds.e 2024-09-19T07:32:59.103 INFO:journalctl@ceph.mds.e.smithi165.stdout:Sep 19 07:32:58 smithi165 systemd[1]: Stopping Ceph mds.e for eae8a4a8-7654-11ef-bceb-c7b262605968... 2024-09-19T07:32:59.383 INFO:journalctl@ceph.mds.e.smithi165.stdout:Sep 19 07:32:59 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-e[64984]: 2024-09-19T07:32:59.103+0000 7efed34c0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:32:59.383 INFO:journalctl@ceph.mds.e.smithi165.stdout:Sep 19 07:32:59 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-e[64984]: 2024-09-19T07:32:59.103+0000 7efed34c0640 -1 mds.e *** got signal Terminated *** 2024-09-19T07:33:02.879 INFO:journalctl@ceph.mds.e.smithi165.stdout:Sep 19 07:33:02 smithi165 podman[74166]: 2024-09-19 07:33:02.597241396 +0000 UTC m=+3.582327628 container died a7ec468e1ee23e6b9c326fe331f509cbd69ca4a78c16abc29506aa49d4066744 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-19T07:33:03.133 INFO:journalctl@ceph.mds.e.smithi165.stdout:Sep 19 07:33:02 smithi165 podman[74166]: 2024-09-19 07:33:02.953441683 +0000 UTC m=+3.938527963 container cleanup a7ec468e1ee23e6b9c326fe331f509cbd69ca4a78c16abc29506aa49d4066744 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-e, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-19T07:33:03.133 INFO:journalctl@ceph.mds.e.smithi165.stdout:Sep 19 07:33:02 smithi165 bash[74166]: ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-e 2024-09-19T07:33:03.379 DEBUG:teuthology.orchestra.run.smithi165:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mds.e.service' 2024-09-19T07:33:03.413 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:33:03.414 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-19T07:33:03.414 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-19T07:33:03.414 DEBUG:teuthology.orchestra.run.smithi165:> sudo systemctl stop ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mds.h 2024-09-19T07:33:03.732 INFO:journalctl@ceph.mds.h.smithi165.stdout:Sep 19 07:33:03 smithi165 systemd[1]: Stopping Ceph mds.h for eae8a4a8-7654-11ef-bceb-c7b262605968... 2024-09-19T07:33:04.133 INFO:journalctl@ceph.mds.h.smithi165.stdout:Sep 19 07:33:03 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-h[65284]: 2024-09-19T07:33:03.731+0000 7fdafca25640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:33:04.133 INFO:journalctl@ceph.mds.h.smithi165.stdout:Sep 19 07:33:03 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-h[65284]: 2024-09-19T07:33:03.731+0000 7fdafca25640 -1 mds.h *** got signal Terminated *** 2024-09-19T07:33:06.939 INFO:journalctl@ceph.mds.h.smithi165.stdout:Sep 19 07:33:06 smithi165 podman[74287]: 2024-09-19 07:33:06.651804334 +0000 UTC m=+3.020372514 container died 4a374e4fdd28f4c9a0cda75f00c51e190a630c8f3e82356a22c6e095065a3716 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-h, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-19T07:33:06.939 INFO:journalctl@ceph.mds.h.smithi165.stdout:Sep 19 07:33:06 smithi165 podman[74287]: 2024-09-19 07:33:06.939578915 +0000 UTC m=+3.308147097 container cleanup 4a374e4fdd28f4c9a0cda75f00c51e190a630c8f3e82356a22c6e095065a3716 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-h, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-19T07:33:07.344 INFO:journalctl@ceph.mds.h.smithi165.stdout:Sep 19 07:33:06 smithi165 bash[74287]: ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-h 2024-09-19T07:33:07.344 INFO:journalctl@ceph.mds.h.smithi165.stdout:Sep 19 07:33:07 smithi165 podman[74299]: 2024-09-19 07:33:07.115595619 +0000 UTC m=+0.460448635 container remove 4a374e4fdd28f4c9a0cda75f00c51e190a630c8f3e82356a22c6e095065a3716 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-h, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-19T07:33:07.358 DEBUG:teuthology.orchestra.run.smithi165:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mds.h.service' 2024-09-19T07:33:07.392 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:33:07.392 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-19T07:33:07.392 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-19T07:33:07.392 DEBUG:teuthology.orchestra.run.smithi165:> sudo systemctl stop ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mds.k 2024-09-19T07:33:07.633 INFO:journalctl@ceph.mds.k.smithi165.stdout:Sep 19 07:33:07 smithi165 systemd[1]: Stopping Ceph mds.k for eae8a4a8-7654-11ef-bceb-c7b262605968... 2024-09-19T07:33:08.133 INFO:journalctl@ceph.mds.k.smithi165.stdout:Sep 19 07:33:07 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-k[64673]: 2024-09-19T07:33:07.734+0000 7f8bb8b4d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:33:08.133 INFO:journalctl@ceph.mds.k.smithi165.stdout:Sep 19 07:33:07 smithi165 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-k[64673]: 2024-09-19T07:33:07.734+0000 7f8bb8b4d640 -1 mds.k *** got signal Terminated *** 2024-09-19T07:33:10.501 INFO:journalctl@ceph.mds.k.smithi165.stdout:Sep 19 07:33:10 smithi165 podman[74406]: 2024-09-19 07:33:10.22492333 +0000 UTC m=+2.614419509 container died 76df50e4476490c1e571e2ebba43d80e51d5a65f6f14c0d354aeafc3316862d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-k, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-19T07:33:10.851 INFO:journalctl@ceph.mds.k.smithi165.stdout:Sep 19 07:33:10 smithi165 podman[74406]: 2024-09-19 07:33:10.584155529 +0000 UTC m=+2.973651708 container cleanup 76df50e4476490c1e571e2ebba43d80e51d5a65f6f14c0d354aeafc3316862d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-k, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-19T07:33:10.852 INFO:journalctl@ceph.mds.k.smithi165.stdout:Sep 19 07:33:10 smithi165 bash[74406]: ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-k 2024-09-19T07:33:11.009 DEBUG:teuthology.orchestra.run.smithi165:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mds.k.service' 2024-09-19T07:33:11.042 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:33:11.042 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-19T07:33:11.042 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-19T07:33:11.042 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mds.c 2024-09-19T07:33:11.354 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:33:11 smithi179 systemd[1]: Stopping Ceph mds.c for eae8a4a8-7654-11ef-bceb-c7b262605968... 2024-09-19T07:33:11.772 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:33:11 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:33:11.353+0000 7f048366f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:33:11.772 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:33:11 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c[65976]: 2024-09-19T07:33:11.353+0000 7f048366f640 -1 mds.c *** got signal Terminated *** 2024-09-19T07:33:15.264 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:33:14 smithi179 podman[74658]: 2024-09-19 07:33:14.984227369 +0000 UTC m=+3.745167234 container died 195696a9dfe25af7aed767dec73af5ed55cf03b70aede4dc4c02c95e945498f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-19T07:33:15.522 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:33:15 smithi179 podman[74658]: 2024-09-19 07:33:15.369770956 +0000 UTC m=+4.130710835 container cleanup 195696a9dfe25af7aed767dec73af5ed55cf03b70aede4dc4c02c95e945498f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:33:15.522 INFO:journalctl@ceph.mds.c.smithi179.stdout:Sep 19 07:33:15 smithi179 bash[74658]: ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-c 2024-09-19T07:33:15.728 DEBUG:teuthology.orchestra.run.smithi179:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mds.c.service' 2024-09-19T07:33:15.765 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:33:15.765 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-19T07:33:15.765 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-19T07:33:15.765 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mds.f 2024-09-19T07:33:16.022 INFO:journalctl@ceph.mds.f.smithi179.stdout:Sep 19 07:33:15 smithi179 systemd[1]: Stopping Ceph mds.f for eae8a4a8-7654-11ef-bceb-c7b262605968... 2024-09-19T07:33:16.522 INFO:journalctl@ceph.mds.f.smithi179.stdout:Sep 19 07:33:16 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-f[69825]: 2024-09-19T07:33:16.115+0000 7f118b9e0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:33:16.522 INFO:journalctl@ceph.mds.f.smithi179.stdout:Sep 19 07:33:16 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-f[69825]: 2024-09-19T07:33:16.115+0000 7f118b9e0640 -1 mds.f *** got signal Terminated *** 2024-09-19T07:33:17.750 INFO:journalctl@ceph.mds.f.smithi179.stdout:Sep 19 07:33:17 smithi179 podman[74778]: 2024-09-19 07:33:17.487320847 +0000 UTC m=+1.502181205 container died 77788550133c7c42c5b90da22dff7a625da3ecb69030e1ed2d7225bc611bc844 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-f, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-19T07:33:18.008 INFO:journalctl@ceph.mds.f.smithi179.stdout:Sep 19 07:33:17 smithi179 podman[74778]: 2024-09-19 07:33:17.832381541 +0000 UTC m=+1.847241892 container cleanup 77788550133c7c42c5b90da22dff7a625da3ecb69030e1ed2d7225bc611bc844 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-f, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-19T07:33:18.008 INFO:journalctl@ceph.mds.f.smithi179.stdout:Sep 19 07:33:17 smithi179 bash[74778]: ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-f 2024-09-19T07:33:18.223 DEBUG:teuthology.orchestra.run.smithi179:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mds.f.service' 2024-09-19T07:33:18.256 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:33:18.256 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-19T07:33:18.256 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-19T07:33:18.256 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mds.i 2024-09-19T07:33:18.569 INFO:journalctl@ceph.mds.i.smithi179.stdout:Sep 19 07:33:18 smithi179 systemd[1]: Stopping Ceph mds.i for eae8a4a8-7654-11ef-bceb-c7b262605968... 2024-09-19T07:33:19.022 INFO:journalctl@ceph.mds.i.smithi179.stdout:Sep 19 07:33:18 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-i[66282]: 2024-09-19T07:33:18.568+0000 7fbbe368b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:33:19.022 INFO:journalctl@ceph.mds.i.smithi179.stdout:Sep 19 07:33:18 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-i[66282]: 2024-09-19T07:33:18.568+0000 7fbbe368b640 -1 mds.i *** got signal Terminated *** 2024-09-19T07:33:22.845 INFO:journalctl@ceph.mds.i.smithi179.stdout:Sep 19 07:33:22 smithi179 podman[74899]: 2024-09-19 07:33:22.573978646 +0000 UTC m=+4.098312180 container died 9b255789fa9189021ec25f837e79f7ca77400f1f6df4a16f5ee9f40a0f981dec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-i, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-19T07:33:23.128 INFO:journalctl@ceph.mds.i.smithi179.stdout:Sep 19 07:33:22 smithi179 podman[74899]: 2024-09-19 07:33:22.910397341 +0000 UTC m=+4.434730877 container cleanup 9b255789fa9189021ec25f837e79f7ca77400f1f6df4a16f5ee9f40a0f981dec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-i, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-19T07:33:23.128 INFO:journalctl@ceph.mds.i.smithi179.stdout:Sep 19 07:33:22 smithi179 bash[74899]: ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-i 2024-09-19T07:33:23.358 DEBUG:teuthology.orchestra.run.smithi179:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mds.i.service' 2024-09-19T07:33:23.380 INFO:journalctl@ceph.mds.i.smithi179.stdout:Sep 19 07:33:23 smithi179 podman[74910]: 2024-09-19 07:33:23.128667187 +0000 UTC m=+0.546792257 container remove 9b255789fa9189021ec25f837e79f7ca77400f1f6df4a16f5ee9f40a0f981dec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-i, RELEASE=squid-2f599a4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-19T07:33:23.380 INFO:journalctl@ceph.mds.i.smithi179.stdout:Sep 19 07:33:23 smithi179 systemd[1]: ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mds.i.service: Deactivated successfully. 2024-09-19T07:33:23.380 INFO:journalctl@ceph.mds.i.smithi179.stdout:Sep 19 07:33:23 smithi179 systemd[1]: Stopped Ceph mds.i for eae8a4a8-7654-11ef-bceb-c7b262605968. 2024-09-19T07:33:23.380 INFO:journalctl@ceph.mds.i.smithi179.stdout:Sep 19 07:33:23 smithi179 systemd[1]: ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mds.i.service: Consumed 8min 22.408s CPU time. 2024-09-19T07:33:23.391 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:33:23.391 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-19T07:33:23.391 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-19T07:33:23.391 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mds.l 2024-09-19T07:33:23.706 INFO:journalctl@ceph.mds.l.smithi179.stdout:Sep 19 07:33:23 smithi179 systemd[1]: Stopping Ceph mds.l for eae8a4a8-7654-11ef-bceb-c7b262605968... 2024-09-19T07:33:24.022 INFO:journalctl@ceph.mds.l.smithi179.stdout:Sep 19 07:33:23 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-l[65376]: 2024-09-19T07:33:23.705+0000 7fadc3759640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:33:24.022 INFO:journalctl@ceph.mds.l.smithi179.stdout:Sep 19 07:33:23 smithi179 ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-l[65376]: 2024-09-19T07:33:23.705+0000 7fadc3759640 -1 mds.l *** got signal Terminated *** 2024-09-19T07:33:27.013 INFO:journalctl@ceph.mds.l.smithi179.stdout:Sep 19 07:33:26 smithi179 podman[75020]: 2024-09-19 07:33:26.708790471 +0000 UTC m=+3.105830684 container died 2c0b8b4f0308dd6835796d0103478006e2670fc9c79f5781781e2ba29e4f9959 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-l, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:33:27.014 INFO:journalctl@ceph.mds.l.smithi179.stdout:Sep 19 07:33:27 smithi179 podman[75020]: 2024-09-19 07:33:27.013997614 +0000 UTC m=+3.411037814 container cleanup 2c0b8b4f0308dd6835796d0103478006e2670fc9c79f5781781e2ba29e4f9959 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-l, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-19T07:33:27.272 INFO:journalctl@ceph.mds.l.smithi179.stdout:Sep 19 07:33:27 smithi179 bash[75020]: ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-l 2024-09-19T07:33:27.272 INFO:journalctl@ceph.mds.l.smithi179.stdout:Sep 19 07:33:27 smithi179 podman[75032]: 2024-09-19 07:33:27.256679626 +0000 UTC m=+0.540528246 container remove 2c0b8b4f0308dd6835796d0103478006e2670fc9c79f5781781e2ba29e4f9959 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-eae8a4a8-7654-11ef-bceb-c7b262605968-mds-l, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-19T07:33:27.379 DEBUG:teuthology.orchestra.run.smithi179:> sudo pkill -f 'journalctl -f -n 0 -u ceph-eae8a4a8-7654-11ef-bceb-c7b262605968@mds.l.service' 2024-09-19T07:33:27.411 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:33:27.411 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-19T07:33:27.412 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T07:33:27.616 INFO:teuthology.orchestra.run.smithi148.stdout:Deleting cluster with fsid: eae8a4a8-7654-11ef-bceb-c7b262605968 2024-09-19T07:33:30.202 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T07:33:30.405 INFO:teuthology.orchestra.run.smithi165.stdout:Deleting cluster with fsid: eae8a4a8-7654-11ef-bceb-c7b262605968 2024-09-19T07:33:32.961 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T07:33:33.162 INFO:teuthology.orchestra.run.smithi179.stdout:Deleting cluster with fsid: eae8a4a8-7654-11ef-bceb-c7b262605968 2024-09-19T07:33:35.831 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T07:33:35.866 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T07:33:35.899 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T07:33:35.926 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-19T07:33:35.929 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911775/remote/smithi148/crash 2024-09-19T07:33:35.930 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/crash -- . 2024-09-19T07:33:35.958 INFO:teuthology.orchestra.run.smithi148.stderr:tar: /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T07:33:35.958 INFO:teuthology.orchestra.run.smithi148.stderr:tar: Error is not recoverable: exiting now 2024-09-19T07:33:35.960 DEBUG:teuthology.misc:Transferring archived files from smithi165:/var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911775/remote/smithi165/crash 2024-09-19T07:33:35.961 DEBUG:teuthology.orchestra.run.smithi165:> sudo tar c -f - -C /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/crash -- . 2024-09-19T07:33:36.032 INFO:teuthology.orchestra.run.smithi165.stderr:tar: /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T07:33:36.033 INFO:teuthology.orchestra.run.smithi165.stderr:tar: Error is not recoverable: exiting now 2024-09-19T07:33:36.034 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911775/remote/smithi179/crash 2024-09-19T07:33:36.035 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/crash -- . 2024-09-19T07:33:36.081 INFO:teuthology.orchestra.run.smithi179.stderr:tar: /var/lib/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T07:33:36.081 INFO:teuthology.orchestra.run.smithi179.stderr:tar: Error is not recoverable: exiting now 2024-09-19T07:33:36.082 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-19T07:33:36.082 DEBUG:teuthology.orchestra.run.smithi148:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-19T07:33:36.124 INFO:teuthology.orchestra.run.smithi148.stdout:2024-09-19T07:13:44.346433+0000 mds.b (mds.1) 2 : cluster [WRN] Scrub error on inode 0x10000000372 (/volumes/qa/sv_1/54a4a3dd-38da-4966-86c2-35568425810f/client.0/tmp/blogbench-1.0/man/Makefile) see mds.b log and `damage ls` output for details 2024-09-19T07:33:36.125 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-09-19T07:33:36.125 INFO:tasks.cephadm:Compressing logs... 2024-09-19T07:33:36.125 DEBUG:teuthology.orchestra.run.smithi148:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T07:33:36.168 DEBUG:teuthology.orchestra.run.smithi165:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T07:33:36.171 DEBUG:teuthology.orchestra.run.smithi179:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T07:33:36.192 INFO:teuthology.orchestra.run.smithi148.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-19T07:33:36.192 INFO:teuthology.orchestra.run.smithi148.stderr:: No such file or directory 2024-09-19T07:33:36.192 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-osd.9.log 2024-09-19T07:33:36.193 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T07:33:36.193 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-osd.0.log: /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T07:33:36.194 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mds.a.log 2024-09-19T07:33:36.194 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T07:33:36.194 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mon.a.log 2024-09-19T07:33:36.194 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mds.g.log 2024-09-19T07:33:36.196 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mon.a.log: 84.6% -- replaced with /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T07:33:36.196 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-osd.6.log 2024-09-19T07:33:36.196 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph.log 2024-09-19T07:33:36.196 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-osd.6.log: 90.3% -- replaced with /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T07:33:36.199 INFO:teuthology.orchestra.run.smithi165.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-19T07:33:36.200 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mds.d.log 2024-09-19T07:33:36.200 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph.log: 94.6% -- replaced with /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mds.a.log.gz 2024-09-19T07:33:36.200 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-osd.10.log 2024-09-19T07:33:36.201 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-19T07:33:36.201 INFO:teuthology.orchestra.run.smithi148.stderr: 94.6% -- replaced with /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mds.g.log.gz 2024-09-19T07:33:36.202 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mgr.x.log 2024-09-19T07:33:36.202 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-osd.7.log 2024-09-19T07:33:36.203 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-osd.10.log: /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T07:33:36.203 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mds.b.log 2024-09-19T07:33:36.203 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mds.k.log 2024-09-19T07:33:36.206 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-19T07:33:36.206 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mds.b.log: /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T07:33:36.206 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T07:33:36.206 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mgr.y.log 2024-09-19T07:33:36.206 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph.log 2024-09-19T07:33:36.206 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mds.h.log 2024-09-19T07:33:36.206 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mon.b.log 2024-09-19T07:33:36.206 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mds.e.log 2024-09-19T07:33:36.206 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T07:33:36.208 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mds.j.log 2024-09-19T07:33:36.208 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mgr.x.log: 91.1% -- replaced with /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T07:33:36.208 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-19T07:33:36.208 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mds.j.log: 91.0% -- replaced with /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T07:33:36.208 INFO:teuthology.orchestra.run.smithi148.stderr: 94.6% -- replaced with /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mds.d.log.gz 2024-09-19T07:33:36.209 INFO:teuthology.orchestra.run.smithi179.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-19T07:33:36.209 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T07:33:36.209 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T07:33:36.209 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mds.i.log 2024-09-19T07:33:36.209 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-volume.log: /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mon.c.log 2024-09-19T07:33:36.212 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T07:33:36.212 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-osd.11.log 2024-09-19T07:33:36.212 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-19T07:33:36.212 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-19T07:33:36.213 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph.log 2024-09-19T07:33:36.213 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mds.l.log 2024-09-19T07:33:36.213 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-osd.8.log 2024-09-19T07:33:36.213 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mgr.z.log 2024-09-19T07:33:36.213 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mds.c.log 2024-09-19T07:33:36.213 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mds.f.log 2024-09-19T07:33:36.213 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T07:33:36.214 INFO:teuthology.orchestra.run.smithi148.stderr: 94.7% -- replaced with /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mds.j.log.gz 2024-09-19T07:33:36.214 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T07:33:36.223 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-osd.3.log: /var/log/ceph/cephadm.log: 94.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T07:33:36.289 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 82.0% -- replaced with /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T07:33:36.317 INFO:teuthology.orchestra.run.smithi179.stderr: 90.5% -- replaced with /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T07:33:36.317 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 82.0% -- replaced with /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T07:33:36.320 INFO:teuthology.orchestra.run.smithi165.stderr: 90.5% -- replaced with /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T07:33:36.367 INFO:teuthology.orchestra.run.smithi165.stderr: 92.4% -- replaced with /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mgr.y.log.gz 2024-09-19T07:33:36.419 INFO:teuthology.orchestra.run.smithi179.stderr: 92.4% -- replaced with /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mgr.z.log.gz 2024-09-19T07:33:36.422 INFO:teuthology.orchestra.run.smithi179.stderr: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T07:33:36.447 INFO:teuthology.orchestra.run.smithi179.stderr: 91.0% -- replaced with /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T07:33:36.534 INFO:teuthology.orchestra.run.smithi165.stderr: 94.4% -- replaced with /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mds.k.log.gz 2024-09-19T07:33:36.650 INFO:teuthology.orchestra.run.smithi165.stderr: 91.2% -- replaced with /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T07:33:36.682 INFO:teuthology.orchestra.run.smithi148.stderr: 90.6% -- replaced with /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mgr.x.log.gz 2024-09-19T07:33:36.706 INFO:teuthology.orchestra.run.smithi165.stderr: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T07:33:36.725 INFO:teuthology.orchestra.run.smithi179.stderr: 91.1% -- replaced with /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T07:33:36.740 INFO:teuthology.orchestra.run.smithi165.stderr: 91.0% -- replaced with /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T07:33:37.858 INFO:teuthology.orchestra.run.smithi148.stderr: 90.3% -- replaced with /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mon.a.log.gz 2024-09-19T07:33:51.617 INFO:teuthology.orchestra.run.smithi165.stderr: 91.8% -- replaced with /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mon.b.log.gz 2024-09-19T07:33:52.405 INFO:teuthology.orchestra.run.smithi148.stderr: 93.7% -- replaced with /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-osd.9.log.gz 2024-09-19T07:33:55.629 INFO:teuthology.orchestra.run.smithi179.stderr: 91.7% -- replaced with /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mon.c.log.gz 2024-09-19T07:33:56.305 INFO:teuthology.orchestra.run.smithi148.stderr: 93.6% -- replaced with /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-osd.6.log.gz 2024-09-19T07:33:59.361 INFO:teuthology.orchestra.run.smithi148.stderr: 93.5% -- replaced with /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-19T07:33:59.661 INFO:teuthology.orchestra.run.smithi148.stderr: 93.5% -- replaced with /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-19T07:33:59.663 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-09-19T07:33:59.663 INFO:teuthology.orchestra.run.smithi148.stderr:real 0m23.482s 2024-09-19T07:33:59.663 INFO:teuthology.orchestra.run.smithi148.stderr:user 1m21.958s 2024-09-19T07:33:59.664 INFO:teuthology.orchestra.run.smithi148.stderr:sys 0m3.042s 2024-09-19T07:33:59.998 INFO:teuthology.orchestra.run.smithi179.stderr: 95.3% -- replaced with /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mds.f.log.gz 2024-09-19T07:34:42.939 INFO:teuthology.orchestra.run.smithi165.stderr: 93.6% -- replaced with /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-osd.10.log.gz 2024-09-19T07:34:49.418 INFO:teuthology.orchestra.run.smithi165.stderr: 95.1% -- replaced with /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mds.h.log.gz 2024-09-19T07:34:54.141 INFO:teuthology.orchestra.run.smithi165.stderr: 95.1% -- replaced with /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mds.e.log.gz 2024-09-19T07:35:10.949 INFO:teuthology.orchestra.run.smithi165.stderr: 93.8% -- replaced with /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-19T07:35:24.340 INFO:teuthology.orchestra.run.smithi179.stderr: 93.6% -- replaced with /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-osd.8.log.gz 2024-09-19T07:35:41.894 INFO:teuthology.orchestra.run.smithi179.stderr: 93.5% -- replaced with /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-osd.11.log.gz 2024-09-19T07:36:07.802 INFO:teuthology.orchestra.run.smithi165.stderr: 93.6% -- replaced with /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-osd.7.log.gz 2024-09-19T07:36:08.015 INFO:teuthology.orchestra.run.smithi179.stderr: 93.6% -- replaced with /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-19T07:36:20.686 INFO:teuthology.orchestra.run.smithi165.stderr: 93.5% -- replaced with /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-19T07:36:36.899 INFO:teuthology.orchestra.run.smithi179.stderr: 95.2% -- replaced with /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mds.l.log.gz 2024-09-19T07:37:17.658 INFO:teuthology.orchestra.run.smithi179.stderr: 93.5% -- replaced with /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-19T07:40:15.633 INFO:teuthology.orchestra.run.smithi165.stderr: 94.3% -- replaced with /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mds.b.log.gz 2024-09-19T07:40:15.635 INFO:teuthology.orchestra.run.smithi165.stderr: 2024-09-19T07:40:15.635 INFO:teuthology.orchestra.run.smithi165.stderr:real 6m39.449s 2024-09-19T07:40:15.635 INFO:teuthology.orchestra.run.smithi165.stderr:user 5m22.592s 2024-09-19T07:40:15.635 INFO:teuthology.orchestra.run.smithi165.stderr:sys 0m13.193s 2024-09-19T07:47:30.084 INFO:teuthology.orchestra.run.smithi179.stderr: 94.7% -- replaced with /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mds.c.log.gz 2024-09-19T07:47:58.641 INFO:teuthology.orchestra.run.smithi179.stderr: 93.9% -- replaced with /var/log/ceph/eae8a4a8-7654-11ef-bceb-c7b262605968/ceph-mds.i.log.gz 2024-09-19T07:47:58.643 INFO:teuthology.orchestra.run.smithi179.stderr: 2024-09-19T07:47:58.643 INFO:teuthology.orchestra.run.smithi179.stderr:real 14m22.458s 2024-09-19T07:47:58.643 INFO:teuthology.orchestra.run.smithi179.stderr:user 7m0.260s 2024-09-19T07:47:58.643 INFO:teuthology.orchestra.run.smithi179.stderr:sys 0m19.023s 2024-09-19T07:47:58.644 INFO:tasks.cephadm:Archiving logs... 2024-09-19T07:47:58.645 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911775/remote/smithi148/log 2024-09-19T07:47:58.646 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T07:48:11.568 DEBUG:teuthology.misc:Transferring archived files from smithi165:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911775/remote/smithi165/log 2024-09-19T07:48:11.569 DEBUG:teuthology.orchestra.run.smithi165:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T07:48:59.711 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911775/remote/smithi179/log 2024-09-19T07:48:59.712 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T07:49:57.492 INFO:tasks.cephadm:Removing cluster... 2024-09-19T07:49:57.493 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 --force 2024-09-19T07:49:57.696 INFO:teuthology.orchestra.run.smithi148.stdout:Deleting cluster with fsid: eae8a4a8-7654-11ef-bceb-c7b262605968 2024-09-19T07:49:58.086 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 --force 2024-09-19T07:49:58.576 INFO:teuthology.orchestra.run.smithi165.stdout:Deleting cluster with fsid: eae8a4a8-7654-11ef-bceb-c7b262605968 2024-09-19T07:49:59.120 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid eae8a4a8-7654-11ef-bceb-c7b262605968 --force 2024-09-19T07:49:59.627 INFO:teuthology.orchestra.run.smithi179.stdout:Deleting cluster with fsid: eae8a4a8-7654-11ef-bceb-c7b262605968 2024-09-19T07:50:00.250 INFO:tasks.cephadm:Removing cephadm ... 2024-09-19T07:50:00.251 DEBUG:teuthology.orchestra.run.smithi148:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T07:50:00.272 DEBUG:teuthology.orchestra.run.smithi165:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T07:50:00.292 DEBUG:teuthology.orchestra.run.smithi179:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T07:50:00.308 INFO:tasks.cephadm:Teardown complete 2024-09-19T07:50:00.308 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-19T07:50:00.320 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-19T07:50:00.320 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T07:50:00.323 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T07:50:00.334 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T07:50:00.486 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-19T07:50:00.497 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-19T07:50:00.497 DEBUG:teuthology.orchestra.run.smithi148:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T07:50:00.500 DEBUG:teuthology.orchestra.run.smithi165:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T07:50:00.503 DEBUG:teuthology.orchestra.run.smithi179:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T07:50:00.514 INFO:teuthology.orchestra.run.smithi148.stderr:bash: line 1: ntpq: command not found 2024-09-19T07:50:00.517 INFO:teuthology.orchestra.run.smithi179.stderr:bash: line 1: ntpq: command not found 2024-09-19T07:50:00.518 INFO:teuthology.orchestra.run.smithi165.stderr:bash: line 1: ntpq: command not found 2024-09-19T07:50:00.519 INFO:teuthology.orchestra.run.smithi148.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T07:50:00.519 INFO:teuthology.orchestra.run.smithi148.stdout:=============================================================================== 2024-09-19T07:50:00.519 INFO:teuthology.orchestra.run.smithi148.stdout:^* hv01.front.sepia.ceph.com 3 6 377 64 +1128us[+1118us] +/- 54ms 2024-09-19T07:50:00.519 INFO:teuthology.orchestra.run.smithi148.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 63 -2608us[-2608us] +/- 64ms 2024-09-19T07:50:00.519 INFO:teuthology.orchestra.run.smithi148.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 58 +1142us[+1142us] +/- 62ms 2024-09-19T07:50:00.519 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:50:00.542 INFO:teuthology.orchestra.run.smithi179.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T07:50:00.542 INFO:teuthology.orchestra.run.smithi179.stdout:=============================================================================== 2024-09-19T07:50:00.542 INFO:teuthology.orchestra.run.smithi179.stdout:^* hv01.front.sepia.ceph.com 3 6 377 63 +1139us[+1143us] +/- 54ms 2024-09-19T07:50:00.542 INFO:teuthology.orchestra.run.smithi179.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 60 -2609us[-2609us] +/- 64ms 2024-09-19T07:50:00.542 INFO:teuthology.orchestra.run.smithi179.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 63 +1155us[+1159us] +/- 62ms 2024-09-19T07:50:00.543 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:50:00.549 INFO:teuthology.orchestra.run.smithi165.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T07:50:00.549 INFO:teuthology.orchestra.run.smithi165.stdout:=============================================================================== 2024-09-19T07:50:00.549 INFO:teuthology.orchestra.run.smithi165.stdout:^* hv01.front.sepia.ceph.com 3 6 377 61 +1158us[+1192us] +/- 55ms 2024-09-19T07:50:00.549 INFO:teuthology.orchestra.run.smithi165.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 64 -2583us[-2549us] +/- 64ms 2024-09-19T07:50:00.549 INFO:teuthology.orchestra.run.smithi165.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 61 +1172us[+1205us] +/- 62ms 2024-09-19T07:50:00.549 INFO:teuthology.orchestra.run.smithi165.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:50:00.550 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-19T07:50:00.562 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-19T07:50:00.563 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-19T07:50:00.574 DEBUG:teuthology.orchestra.run.smithi148:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T07:50:00.663 DEBUG:teuthology.orchestra.run.smithi165:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T07:50:00.794 DEBUG:teuthology.orchestra.run.smithi179:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T07:50:00.948 DEBUG:teuthology.orchestra.run.smithi148:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T07:50:00.980 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:50:00.980 DEBUG:teuthology.orchestra.run.smithi165:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T07:50:01.013 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:50:01.014 DEBUG:teuthology.orchestra.run.smithi179:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T07:50:01.042 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:50:01.042 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-19T07:50:01.061 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-19T07:50:01.108 INFO:teuthology.task.internal:Duration was 3293.925046 seconds 2024-09-19T07:50:01.109 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-19T07:50:01.143 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-19T07:50:01.144 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T07:50:01.149 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T07:50:01.153 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T07:50:01.191 INFO:teuthology.orchestra.run.smithi148.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T07:50:01.204 INFO:teuthology.orchestra.run.smithi165.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T07:50:01.214 INFO:teuthology.orchestra.run.smithi179.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T07:50:01.569 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-19T07:50:01.569 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi148.front.sepia.ceph.com 2024-09-19T07:50:01.569 DEBUG:teuthology.orchestra.run.smithi148:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T07:50:01.597 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi165.front.sepia.ceph.com 2024-09-19T07:50:01.597 DEBUG:teuthology.orchestra.run.smithi165:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T07:50:01.631 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi179.front.sepia.ceph.com 2024-09-19T07:50:01.632 DEBUG:teuthology.orchestra.run.smithi179:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T07:50:01.659 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-19T07:50:01.659 DEBUG:teuthology.orchestra.run.smithi148:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T07:50:01.667 DEBUG:teuthology.orchestra.run.smithi165:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T07:50:01.676 DEBUG:teuthology.orchestra.run.smithi179:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T07:50:01.737 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-19T07:50:01.738 DEBUG:teuthology.orchestra.run.smithi148:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T07:50:01.740 DEBUG:teuthology.orchestra.run.smithi165:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T07:50:01.751 DEBUG:teuthology.orchestra.run.smithi179:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T07:50:02.817 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-19T07:50:02.830 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-19T07:50:02.830 DEBUG:teuthology.orchestra.run.smithi148:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T07:50:02.855 DEBUG:teuthology.orchestra.run.smithi165:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T07:50:02.896 DEBUG:teuthology.orchestra.run.smithi179:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T07:50:02.927 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-19T07:50:02.939 DEBUG:teuthology.orchestra.run.smithi148:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T07:50:02.942 DEBUG:teuthology.orchestra.run.smithi165:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T07:50:02.945 DEBUG:teuthology.orchestra.run.smithi179:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T07:50:02.963 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern = core 2024-09-19T07:50:02.974 INFO:teuthology.orchestra.run.smithi165.stdout:kernel.core_pattern = core 2024-09-19T07:50:02.995 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern = core 2024-09-19T07:50:03.027 DEBUG:teuthology.orchestra.run.smithi148:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T07:50:03.042 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:50:03.043 DEBUG:teuthology.orchestra.run.smithi165:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T07:50:03.059 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:50:03.060 DEBUG:teuthology.orchestra.run.smithi179:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T07:50:03.084 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:50:03.085 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-19T07:50:03.097 INFO:teuthology.task.internal:Transferring archived files... 2024-09-19T07:50:03.098 DEBUG:teuthology.misc:Transferring archived files from smithi148:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911775/remote/smithi148 2024-09-19T07:50:03.099 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T07:50:03.161 DEBUG:teuthology.misc:Transferring archived files from smithi165:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911775/remote/smithi165 2024-09-19T07:50:03.161 DEBUG:teuthology.orchestra.run.smithi165:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T07:50:03.202 DEBUG:teuthology.misc:Transferring archived files from smithi179:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911775/remote/smithi179 2024-09-19T07:50:03.202 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T07:50:03.244 INFO:teuthology.task.internal:Removing archive directory... 2024-09-19T07:50:03.244 DEBUG:teuthology.orchestra.run.smithi148:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T07:50:03.247 DEBUG:teuthology.orchestra.run.smithi165:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T07:50:03.249 DEBUG:teuthology.orchestra.run.smithi179:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T07:50:03.294 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-19T07:50:03.308 INFO:teuthology.task.internal:Not uploading archives. 2024-09-19T07:50:03.308 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-19T07:50:03.320 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-19T07:50:03.320 DEBUG:teuthology.orchestra.run.smithi148:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T07:50:03.322 DEBUG:teuthology.orchestra.run.smithi165:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T07:50:03.325 DEBUG:teuthology.orchestra.run.smithi179:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T07:50:03.335 INFO:teuthology.orchestra.run.smithi148.stdout: 265861 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 07:50 /home/ubuntu/cephtest 2024-09-19T07:50:03.339 INFO:teuthology.orchestra.run.smithi165.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 07:50 /home/ubuntu/cephtest 2024-09-19T07:50:03.350 INFO:teuthology.orchestra.run.smithi179.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 07:50 /home/ubuntu/cephtest 2024-09-19T07:50:03.351 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-19T07:50:03.364 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-19T07:50:03.392 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/blogbench}} duration: 3293.9250462055206 failure_reason: 'error during scrub thrashing: rank damage found: {''backtrace''}' flavor: default owner: scheduled_teuthology@teuthology status: fail success: false 2024-09-19T07:50:03.393 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T07:50:03.485 INFO:teuthology.run:FAIL